2021-11-03T16:32:06.841 INFO:root:teuthology version: 1.1.0-c56135d1 2021-11-03T16:32:06.843 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_sage@teuthology --name sage-2021-11-03_16:24:16-orch:cephadm-wip-sage-testing-2021-11-03-1039-distro-basic-smithi --verbose --archive /home/teuthworker/archive/sage-2021-11-03_16:24:16-orch:cephadm-wip-sage-testing-2021-11-03-1039-distro-basic-smithi/6481848 --description orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/sage-2021-11-03_16:24:16-orch:cephadm-wip-sage-testing-2021-11-03-1039-distro-basic-smithi/6481848/orig.config.yaml 2021-11-03T16:32:06.897 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-11-03T16:32:06.970 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/sage-2021-11-03_16:24:16-orch:cephadm-wip-sage-testing-2021-11-03-1039-distro-basic-smithi/6481848 branch: wip-sage-testing-2021-11-03-1039 description: orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} email: null first_in_suite: false job_id: '6481848' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/pacific v16.2.4 ' name: sage-2021-11-03_16:24:16-orch:cephadm-wip-sage-testing-2021-11-03-1039-distro-basic-smithi nuke-on-error: true os_type: centos os_version: '8.3' overrides: admin_socket: branch: wip-sage-testing-2021-11-03-1039 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 15m rados osd op timeout: 15m global: mon pg warn min per osd: 0 mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 15m rados osd op timeout: 15m mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 6e90212d8510e2d506395a8c82057d0d1787f3a4 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: sha1: 6e90212d8510e2d506395a8c82057d0d1787f3a4 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-sage-testing-2021-11-03-1039 sha1: 6e90212d8510e2d506395a8c82057d0d1787f3a4 owner: scheduled_sage@teuthology priority: 75 repo: git://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 sha1: 6e90212d8510e2d506395a8c82057d0d1787f3a4 sleep_before_teardown: 0 suite: orch:cephadm suite_branch: wip-sage-testing-2021-11-03-1039 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_6e90212d8510e2d506395a8c82057d0d1787f3a4/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: 6e90212d8510e2d506395a8c82057d0d1787f3a4 targets: smithi026.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCZk7Iz4HNS0qb5QY/FHHVonLBvRBS9GxBwsEerrq3/oNKDqRtxfyOTCSzCZP9x6OwclDondnr9KoL+U+d4nGLfTv3FpMhqcqeIGm1kr/CyYciF7+I3QGcdeQxM+O368ptoGwiOBG5jLsynIPghxo41gGiPFEffDz6pK+ibaCFKSRCR7qIBumSPUwdR+dBrX8MupuUntBwIfWj2jumSGGIaBHKndx77Yk/3Z3QB6AjQRcExsPFmvzTYU9japaaNSk5TD7H1r8y0FZVQ1IBdvycF+mq8OBC8TD//EZWArLHYfH9pgYbPPcZnzFZDl1Ld5GXIjJ7fav/TnViGWiV40T/URBQMy4RQ0VtUm1fr7uTLqUOdZppXPd2DkbjEkip+qwEOgS+Lb0cDQgMU3DWRnqa0NfTyjjJst0OCITpZ5/dLcJHUr/SLUwj91UyzTq+AtqopaiR81trpVID+FI9+7WKweuYC+6lGbqmQnH9uS92cgOfVBvlhUEkdng2PzK62bXE= smithi194.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDqOUQhrkjL4j+fY9SslSxF+CrO3Z8vV8Xx8H4Gbach7Z33TGGRJ8wrReP77RBIWo0Vcjf4TndHo1eeX41QmGgAhp9qHKzVvItueLb9LcNjYm+CrS3m5L/1USM6XUTYbZfblJFCwL4A0nRPSwEMkYgP8q4RhKfuqWThraiFjJ953/3vPEerB+swgsdgEbsl99vfL2fu8gMoLTVu94qbOigbWp+V1Z7mteH6fOh+ZMV7xbm69WTrP4Rr7Nuc/e2Q5odbeI6GK7jp8dctmXtEm+C9xzkQUJutW6vrBXeuIs1kl8Vj3zFgLl5FQaPCMgjmwUwzfx6fg6loEAWhVxxVBrPwUE3/KWwVjwUU2sl3WdmUVo1J7qL8slF0C+T9kwTl6zqwZOSex8ZBZiTGfR2+yhAqxEXHbBBvfqns7aFnCV9Zi/znQGv+g6JeacqPNwJDZeMlFZpIqL4sz5tjXm97tNTkktadEsrRhoP/zC8Cv0QvuK3wmKXgubff1zvWv2wPKMk= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:3.0 - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: exclude_packages: - ceph-volume tag: v16.2.4 - cephadm: avoid_pacific_features: true cephadm_branch: v16.2.4 cephadm_git_url: https://github.com/ceph/ceph image: docker.io/ceph/ceph:v16.2.4 roleless: true - print: '**** done starting v16.2.4' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - ceph --format=json mds versions | jq -e ". | add == 4" - fs.pre_upgrade_save: null - kclient: null - print: '**** done kclient client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology_branch: master teuthology_sha1: c56135d151713269e811ede3163c9743c2e269de timestamp: 2021-11-03_16:24:16 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true ; do ceph orch ps ; ceph versions ; ceph fs dump; sleep 30 ; done - ceph orch ps - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: sage verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.6888 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2021-11-03T16:32:06.971 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_6e90212d8510e2d506395a8c82057d0d1787f3a4/qa; will attempt to use it 2021-11-03T16:32:06.972 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_6e90212d8510e2d506395a8c82057d0d1787f3a4/qa/tasks 2021-11-03T16:32:06.972 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-11-03T16:32:06.974 INFO:teuthology.task.internal:Checking packages... 2021-11-03T16:32:07.001 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '6e90212d8510e2d506395a8c82057d0d1787f3a4' 2021-11-03T16:32:07.001 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-11-03T16:32:07.002 INFO:teuthology.packaging:ref: None 2021-11-03T16:32:07.003 INFO:teuthology.packaging:tag: None 2021-11-03T16:32:07.003 INFO:teuthology.packaging:branch: wip-sage-testing-2021-11-03-1039 2021-11-03T16:32:07.003 INFO:teuthology.packaging:sha1: 6e90212d8510e2d506395a8c82057d0d1787f3a4 2021-11-03T16:32:07.004 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-sage-testing-2021-11-03-1039 2021-11-03T16:32:07.364 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-8776.g6e90212d 2021-11-03T16:32:07.364 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-11-03T16:32:07.376 INFO:teuthology.task.internal:no buildpackages task found 2021-11-03T16:32:07.377 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-11-03T16:32:07.407 INFO:teuthology.task.internal:Saving configuration 2021-11-03T16:32:07.426 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-11-03T16:32:07.437 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-11-03T16:32:07.467 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/sage-2021-11-03_16:24:16-orch:cephadm-wip-sage-testing-2021-11-03-1039-distro-basic-smithi/6481848', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-11-03 16:27:22.828949', 'locked_by': 'scheduled_sage@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA+jQNmq+dV3KuzEo7nnT3kGqBQyooBlUMjNrqXAJw6iLCyq5UOLsn9S6OXQKP9x614dfd8MeuNXiurXGEg3r40='} 2021-11-03T16:32:07.489 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/sage-2021-11-03_16:24:16-orch:cephadm-wip-sage-testing-2021-11-03-1039-distro-basic-smithi/6481848', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-11-03 16:27:22.827408', 'locked_by': 'scheduled_sage@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKGAVswK8HBjHPLoaIjdHh9pL5ATseCSuFb3bym4i18AAmdVafrGlWL0gWGXTaYeBw1GySaUtghkkpoZMIz9gGs='} 2021-11-03T16:32:07.490 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-11-03T16:32:07.501 INFO:teuthology.task.internal:roles: ubuntu@smithi026.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2021-11-03T16:32:07.502 INFO:teuthology.task.internal:roles: ubuntu@smithi194.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2021-11-03T16:32:07.503 INFO:teuthology.run_tasks:Running task console_log... 2021-11-03T16:32:07.598 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8571fd1d08>, signals=[15]) 2021-11-03T16:32:07.600 INFO:teuthology.run_tasks:Running task internal.connect... 2021-11-03T16:32:07.610 INFO:teuthology.task.internal:Opening connections... 2021-11-03T16:32:07.611 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi026.front.sepia.ceph.com 2021-11-03T16:32:07.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-03T16:32:07.686 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi194.front.sepia.ceph.com 2021-11-03T16:32:07.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-03T16:32:07.755 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-11-03T16:32:07.765 DEBUG:teuthology.orchestra.run.smithi026:> uname -m 2021-11-03T16:32:07.786 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64 2021-11-03T16:32:07.786 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2021-11-03T16:32:07.844 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="CentOS Linux" 2021-11-03T16:32:07.844 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="8" 2021-11-03T16:32:07.844 INFO:teuthology.orchestra.run.smithi026.stdout:ID="centos" 2021-11-03T16:32:07.844 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="rhel fedora" 2021-11-03T16:32:07.845 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="8" 2021-11-03T16:32:07.845 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el8" 2021-11-03T16:32:07.845 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="CentOS Linux 8" 2021-11-03T16:32:07.846 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2021-11-03T16:32:07.846 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-11-03T16:32:07.846 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://centos.org/" 2021-11-03T16:32:07.847 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-11-03T16:32:07.847 INFO:teuthology.orchestra.run.smithi026.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-11-03T16:32:07.847 INFO:teuthology.orchestra.run.smithi026.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-11-03T16:32:07.849 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2021-11-03T16:32:07.869 DEBUG:teuthology.orchestra.run.smithi194:> uname -m 2021-11-03T16:32:07.885 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2021-11-03T16:32:07.886 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2021-11-03T16:32:07.940 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Linux" 2021-11-03T16:32:07.940 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="8" 2021-11-03T16:32:07.941 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos" 2021-11-03T16:32:07.941 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora" 2021-11-03T16:32:07.941 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="8" 2021-11-03T16:32:07.941 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el8" 2021-11-03T16:32:07.942 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Linux 8" 2021-11-03T16:32:07.942 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2021-11-03T16:32:07.942 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-11-03T16:32:07.942 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/" 2021-11-03T16:32:07.943 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-11-03T16:32:07.943 INFO:teuthology.orchestra.run.smithi194.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-11-03T16:32:07.943 INFO:teuthology.orchestra.run.smithi194.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-11-03T16:32:07.943 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2021-11-03T16:32:07.962 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-11-03T16:32:07.974 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-11-03T16:32:08.016 INFO:teuthology.task.internal:Checking for old test directory... 2021-11-03T16:32:08.016 DEBUG:teuthology.orchestra.run.smithi026:> test '!' -e /home/ubuntu/cephtest 2021-11-03T16:32:08.019 DEBUG:teuthology.orchestra.run.smithi194:> test '!' -e /home/ubuntu/cephtest 2021-11-03T16:32:08.033 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-11-03T16:32:08.045 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-11-03T16:32:08.045 DEBUG:teuthology.orchestra.run.smithi026:> test -z $(ls -A /var/lib/ceph) 2021-11-03T16:32:08.076 DEBUG:teuthology.orchestra.run.smithi194:> test -z $(ls -A /var/lib/ceph) 2021-11-03T16:32:08.105 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-11-03T16:32:08.160 INFO:teuthology.run_tasks:Running task kernel... 2021-11-03T16:32:08.177 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2021-11-03T16:32:08.177 INFO:teuthology.task.kernel:config {'host.a': {'kdb': True, 'sha1': 'distro'}, 'host.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-11-03T16:32:08.178 DEBUG:teuthology.orchestra.run.smithi026:> uname -r 2021-11-03T16:32:08.195 INFO:teuthology.orchestra.run.smithi026.stdout:4.18.0-305.10.2.el8_4.x86_64 2021-11-03T16:32:08.196 INFO:teuthology.task.kernel:Running kernel on smithi026: 4.18.0-305.10.2.el8_4.x86_64 2021-11-03T16:32:08.196 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum install -y kernel 2021-11-03T16:32:10.520 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS-8 - AppStream 36 MB/s | 9.5 MB 00:00 2021-11-03T16:32:12.282 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS-8 - Base 37 MB/s | 7.5 MB 00:00 2021-11-03T16:32:13.417 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS-8 - Extras 160 kB/s | 10 kB 00:00 2021-11-03T16:32:16.020 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Linux 8 - AppStream 3.7 MB/s | 9.5 MB 00:02 2021-11-03T16:32:18.027 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Linux 8 - BaseOS 17 MB/s | 7.5 MB 00:00 2021-11-03T16:32:19.268 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Linux 8 - Extras 64 kB/s | 10 kB 00:00 2021-11-03T16:32:19.731 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS-8 - PowerTools 5.9 MB/s | 2.4 MB 00:00 2021-11-03T16:32:20.270 INFO:teuthology.orchestra.run.smithi026.stdout:Copr repo for python3-asyncssh owned by ceph 47 kB/s | 3.5 kB 00:00 2021-11-03T16:32:21.088 INFO:teuthology.orchestra.run.smithi026.stdout:Extra Packages for Enterprise Linux 14 MB/s | 11 MB 00:00 2021-11-03T16:32:23.486 INFO:teuthology.orchestra.run.smithi026.stdout:lab-extras 382 kB/s | 24 kB 00:00 2021-11-03T16:32:25.629 INFO:teuthology.orchestra.run.smithi026.stdout:Package kernel-4.18.0-305.10.2.el8_4.x86_64 is already installed. 2021-11-03T16:32:25.629 INFO:teuthology.orchestra.run.smithi026.stdout:Package kernel-4.18.0-240.el8.x86_64 is already installed. 2021-11-03T16:32:25.956 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2021-11-03T16:32:25.957 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:32:25.957 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2021-11-03T16:32:25.957 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:32:25.958 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2021-11-03T16:32:25.958 INFO:teuthology.orchestra.run.smithi026.stdout: kernel x86_64 4.18.0-305.19.1.el8_4 CentOS-Base 5.9 M 2021-11-03T16:32:25.958 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2021-11-03T16:32:25.958 INFO:teuthology.orchestra.run.smithi026.stdout: kernel-core x86_64 4.18.0-305.19.1.el8_4 CentOS-Base 36 M 2021-11-03T16:32:25.959 INFO:teuthology.orchestra.run.smithi026.stdout: kernel-modules x86_64 4.18.0-305.19.1.el8_4 CentOS-Base 28 M 2021-11-03T16:32:25.959 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:32:25.959 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2021-11-03T16:32:25.959 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:32:25.960 INFO:teuthology.orchestra.run.smithi026.stdout:Install 3 Packages 2021-11-03T16:32:25.961 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:32:25.961 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 70 M 2021-11-03T16:32:25.962 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 88 M 2021-11-03T16:32:25.962 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2021-11-03T16:32:26.152 INFO:teuthology.orchestra.run.smithi026.stdout:(1/3): kernel-4.18.0-305.19.1.el8_4.x86_64.rpm 31 MB/s | 5.9 MB 00:00 2021-11-03T16:32:27.122 INFO:teuthology.orchestra.run.smithi026.stdout:(2/3): kernel-core-4.18.0-305.19.1.el8_4.x86_64 31 MB/s | 36 MB 00:01 2021-11-03T16:32:27.343 INFO:teuthology.orchestra.run.smithi026.stdout:(3/3): kernel-modules-4.18.0-305.19.1.el8_4.x86 20 MB/s | 28 MB 00:01 2021-11-03T16:32:27.346 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2021-11-03T16:32:27.347 INFO:teuthology.orchestra.run.smithi026.stdout:Total 50 MB/s | 70 MB 00:01 2021-11-03T16:32:27.465 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2021-11-03T16:32:27.825 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2021-11-03T16:32:27.825 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2021-11-03T16:32:29.023 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2021-11-03T16:32:29.046 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2021-11-03T16:32:31.633 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2021-11-03T16:32:32.163 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : kernel-core-4.18.0-305.19.1.el8_4.x86_64 1/3 2021-11-03T16:32:35.565 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: kernel-core-4.18.0-305.19.1.el8_4.x86_64 1/3 2021-11-03T16:32:35.929 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : kernel-modules-4.18.0-305.19.1.el8_4.x86_64 2/3 2021-11-03T16:32:39.121 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: kernel-modules-4.18.0-305.19.1.el8_4.x86_64 2/3 2021-11-03T16:32:39.351 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : kernel-4.18.0-305.19.1.el8_4.x86_64 3/3 2021-11-03T16:33:01.398 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: kernel-core-4.18.0-305.19.1.el8_4.x86_64 3/3 2021-11-03T16:33:01.714 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: kernel-4.18.0-305.19.1.el8_4.x86_64 3/3 2021-11-03T16:33:01.715 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : kernel-4.18.0-305.19.1.el8_4.x86_64 1/3 2021-11-03T16:33:01.715 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : kernel-core-4.18.0-305.19.1.el8_4.x86_64 2/3 2021-11-03T16:33:02.304 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : kernel-modules-4.18.0-305.19.1.el8_4.x86_64 3/3 2021-11-03T16:33:02.305 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:33:02.305 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2021-11-03T16:33:02.305 INFO:teuthology.orchestra.run.smithi026.stdout: kernel-4.18.0-305.19.1.el8_4.x86_64 2021-11-03T16:33:02.305 INFO:teuthology.orchestra.run.smithi026.stdout: kernel-core-4.18.0-305.19.1.el8_4.x86_64 2021-11-03T16:33:02.306 INFO:teuthology.orchestra.run.smithi026.stdout: kernel-modules-4.18.0-305.19.1.el8_4.x86_64 2021-11-03T16:33:02.306 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:33:02.306 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2021-11-03T16:33:02.362 DEBUG:teuthology.orchestra.run.smithi026:> rpm -q kernel --last | head -n 1 2021-11-03T16:33:02.527 INFO:teuthology.orchestra.run.smithi026.stdout:kernel-4.18.0-305.19.1.el8_4.x86_64 Wed 03 Nov 2021 04:32:39 PM UTC 2021-11-03T16:33:02.528 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-305.19.1.el8_4.x86_64 2021-11-03T16:33:02.529 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.10.2.el8_4.x86_64 Expected: 4.18.0-305.19.1.el8_4.x86_64 2021-11-03T16:33:02.530 DEBUG:teuthology.orchestra.run.smithi194:> uname -r 2021-11-03T16:33:02.549 INFO:teuthology.orchestra.run.smithi194.stdout:4.18.0-305.10.2.el8_4.x86_64 2021-11-03T16:33:02.549 INFO:teuthology.task.kernel:Running kernel on smithi194: 4.18.0-305.10.2.el8_4.x86_64 2021-11-03T16:33:02.550 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum install -y kernel 2021-11-03T16:33:04.822 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS-8 - AppStream 31 MB/s | 9.5 MB 00:00 2021-11-03T16:33:06.538 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS-8 - Base 37 MB/s | 7.5 MB 00:00 2021-11-03T16:33:07.628 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS-8 - Extras 161 kB/s | 10 kB 00:00 2021-11-03T16:33:10.883 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Linux 8 - AppStream 3.0 MB/s | 9.5 MB 00:03 2021-11-03T16:33:12.965 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Linux 8 - BaseOS 12 MB/s | 7.5 MB 00:00 2021-11-03T16:33:14.297 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Linux 8 - Extras 34 kB/s | 10 kB 00:00 2021-11-03T16:33:14.648 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS-8 - PowerTools 8.1 MB/s | 2.4 MB 00:00 2021-11-03T16:33:15.144 INFO:teuthology.orchestra.run.smithi194.stdout:Copr repo for python3-asyncssh owned by ceph 42 kB/s | 3.5 kB 00:00 2021-11-03T16:33:16.907 INFO:teuthology.orchestra.run.smithi194.stdout:Extra Packages for Enterprise Linux 6.2 MB/s | 11 MB 00:01 2021-11-03T16:33:19.096 INFO:teuthology.orchestra.run.smithi194.stdout:lab-extras 4.5 MB/s | 24 kB 00:00 2021-11-03T16:33:21.139 INFO:teuthology.orchestra.run.smithi194.stdout:Package kernel-4.18.0-305.10.2.el8_4.x86_64 is already installed. 2021-11-03T16:33:21.140 INFO:teuthology.orchestra.run.smithi194.stdout:Package kernel-4.18.0-240.el8.x86_64 is already installed. 2021-11-03T16:33:21.458 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2021-11-03T16:33:21.459 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:33:21.459 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2021-11-03T16:33:21.459 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:33:21.460 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2021-11-03T16:33:21.460 INFO:teuthology.orchestra.run.smithi194.stdout: kernel x86_64 4.18.0-305.19.1.el8_4 CentOS-Base 5.9 M 2021-11-03T16:33:21.460 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2021-11-03T16:33:21.460 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-core x86_64 4.18.0-305.19.1.el8_4 CentOS-Base 36 M 2021-11-03T16:33:21.461 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-modules x86_64 4.18.0-305.19.1.el8_4 CentOS-Base 28 M 2021-11-03T16:33:21.461 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:33:21.461 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2021-11-03T16:33:21.461 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:33:21.461 INFO:teuthology.orchestra.run.smithi194.stdout:Install 3 Packages 2021-11-03T16:33:21.462 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:33:21.462 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 70 M 2021-11-03T16:33:21.462 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 88 M 2021-11-03T16:33:21.462 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2021-11-03T16:33:22.079 INFO:teuthology.orchestra.run.smithi194.stdout:(1/3): kernel-4.18.0-305.19.1.el8_4.x86_64.rpm 9.5 MB/s | 5.9 MB 00:00 2021-11-03T16:33:22.465 INFO:teuthology.orchestra.run.smithi194.stdout:(2/3): kernel-core-4.18.0-305.19.1.el8_4.x86_64 36 MB/s | 36 MB 00:01 2021-11-03T16:33:23.222 INFO:teuthology.orchestra.run.smithi194.stdout:(3/3): kernel-modules-4.18.0-305.19.1.el8_4.x86 16 MB/s | 28 MB 00:01 2021-11-03T16:33:23.226 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2021-11-03T16:33:23.226 INFO:teuthology.orchestra.run.smithi194.stdout:Total 40 MB/s | 70 MB 00:01 2021-11-03T16:33:23.339 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2021-11-03T16:33:23.682 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2021-11-03T16:33:23.682 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2021-11-03T16:33:24.867 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2021-11-03T16:33:24.884 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2021-11-03T16:33:27.300 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2021-11-03T16:33:27.738 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : kernel-core-4.18.0-305.19.1.el8_4.x86_64 1/3 2021-11-03T16:33:30.901 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-core-4.18.0-305.19.1.el8_4.x86_64 1/3 2021-11-03T16:33:31.253 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : kernel-modules-4.18.0-305.19.1.el8_4.x86_64 2/3 2021-11-03T16:33:34.221 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-modules-4.18.0-305.19.1.el8_4.x86_64 2/3 2021-11-03T16:33:34.414 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : kernel-4.18.0-305.19.1.el8_4.x86_64 3/3 2021-11-03T16:33:54.778 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-core-4.18.0-305.19.1.el8_4.x86_64 3/3 2021-11-03T16:33:55.094 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-4.18.0-305.19.1.el8_4.x86_64 3/3 2021-11-03T16:33:55.095 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : kernel-4.18.0-305.19.1.el8_4.x86_64 1/3 2021-11-03T16:33:55.095 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : kernel-core-4.18.0-305.19.1.el8_4.x86_64 2/3 2021-11-03T16:33:55.510 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : kernel-modules-4.18.0-305.19.1.el8_4.x86_64 3/3 2021-11-03T16:33:55.510 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:33:55.511 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2021-11-03T16:33:55.511 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-4.18.0-305.19.1.el8_4.x86_64 2021-11-03T16:33:55.511 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-core-4.18.0-305.19.1.el8_4.x86_64 2021-11-03T16:33:55.511 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-modules-4.18.0-305.19.1.el8_4.x86_64 2021-11-03T16:33:55.512 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:33:55.512 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2021-11-03T16:33:55.593 DEBUG:teuthology.orchestra.run.smithi194:> rpm -q kernel --last | head -n 1 2021-11-03T16:33:55.735 INFO:teuthology.orchestra.run.smithi194.stdout:kernel-4.18.0-305.19.1.el8_4.x86_64 Wed 03 Nov 2021 04:33:34 PM UTC 2021-11-03T16:33:55.737 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-305.19.1.el8_4.x86_64 2021-11-03T16:33:55.737 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.10.2.el8_4.x86_64 Expected: 4.18.0-305.19.1.el8_4.x86_64 2021-11-03T16:33:55.738 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-11-03T16:33:55.738 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-11-03T16:33:55.738 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-11-03T16:33:55.739 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2021-11-03T16:33:55.739 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi026.front.sepia.ceph.com, path=None, version=distro) 2021-11-03T16:33:55.739 DEBUG:teuthology.orchestra.run.smithi026:> rpm -q kernel --last | head -n 1 2021-11-03T16:33:55.886 INFO:teuthology.orchestra.run.smithi026.stdout:kernel-4.18.0-305.19.1.el8_4.x86_64 Wed 03 Nov 2021 04:32:39 PM UTC 2021-11-03T16:33:55.889 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-305.19.1.el8_4.x86_64 2021-11-03T16:33:55.890 DEBUG:teuthology.orchestra.run.smithi026:> sudo rpm -qi grub2-tools 2021-11-03T16:33:55.922 INFO:teuthology.orchestra.run.smithi026.stdout:Name : grub2-tools 2021-11-03T16:33:55.923 INFO:teuthology.orchestra.run.smithi026.stdout:Epoch : 1 2021-11-03T16:33:55.923 INFO:teuthology.orchestra.run.smithi026.stdout:Version : 2.02 2021-11-03T16:33:55.923 INFO:teuthology.orchestra.run.smithi026.stdout:Release : 90.el8 2021-11-03T16:33:55.923 INFO:teuthology.orchestra.run.smithi026.stdout:Architecture: x86_64 2021-11-03T16:33:55.924 INFO:teuthology.orchestra.run.smithi026.stdout:Install Date: Wed 11 Aug 2021 06:38:04 PM UTC 2021-11-03T16:33:55.924 INFO:teuthology.orchestra.run.smithi026.stdout:Group : System Environment/Base 2021-11-03T16:33:55.924 INFO:teuthology.orchestra.run.smithi026.stdout:Size : 9197207 2021-11-03T16:33:55.924 INFO:teuthology.orchestra.run.smithi026.stdout:License : GPLv3+ 2021-11-03T16:33:55.925 INFO:teuthology.orchestra.run.smithi026.stdout:Signature : RSA/SHA256, Tue 08 Sep 2020 07:14:39 PM UTC, Key ID 05b555b38483c65d 2021-11-03T16:33:55.925 INFO:teuthology.orchestra.run.smithi026.stdout:Source RPM : grub2-2.02-90.el8.src.rpm 2021-11-03T16:33:55.925 INFO:teuthology.orchestra.run.smithi026.stdout:Build Date : Tue 08 Sep 2020 07:00:29 PM UTC 2021-11-03T16:33:55.925 INFO:teuthology.orchestra.run.smithi026.stdout:Build Host : kbuilder.bsys.centos.org 2021-11-03T16:33:55.926 INFO:teuthology.orchestra.run.smithi026.stdout:Relocations : (not relocatable) 2021-11-03T16:33:55.926 INFO:teuthology.orchestra.run.smithi026.stdout:Packager : CentOS BuildSystem 2021-11-03T16:33:55.926 INFO:teuthology.orchestra.run.smithi026.stdout:Vendor : CentOS 2021-11-03T16:33:55.926 INFO:teuthology.orchestra.run.smithi026.stdout:URL : http://www.gnu.org/software/grub/ 2021-11-03T16:33:55.927 INFO:teuthology.orchestra.run.smithi026.stdout:Summary : Support tools for GRUB. 2021-11-03T16:33:55.927 INFO:teuthology.orchestra.run.smithi026.stdout:Description : 2021-11-03T16:33:55.927 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:33:55.927 INFO:teuthology.orchestra.run.smithi026.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2021-11-03T16:33:55.928 INFO:teuthology.orchestra.run.smithi026.stdout:customizable bootloader with modular architecture. It supports a rich 2021-11-03T16:33:55.928 INFO:teuthology.orchestra.run.smithi026.stdout:variety of kernel formats, file systems, computer architectures and 2021-11-03T16:33:55.928 INFO:teuthology.orchestra.run.smithi026.stdout:hardware devices. 2021-11-03T16:33:55.928 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:33:55.929 INFO:teuthology.orchestra.run.smithi026.stdout:This subpackage provides tools for support of all platforms. 2021-11-03T16:33:55.930 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2021-11-03T16:33:55.930 INFO:teuthology.task.kernel:Updating grub on smithi026 to boot 4.18.0-305.19.1.el8_4.x86_64 2021-11-03T16:33:55.930 DEBUG:teuthology.orchestra.run.smithi026:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2021-11-03T16:33:56.766 INFO:teuthology.orchestra.run.smithi026.stderr:Generating grub configuration file ... 2021-11-03T16:33:58.725 INFO:teuthology.orchestra.run.smithi026.stderr:done 2021-11-03T16:33:58.727 DEBUG:teuthology.orchestra.run.smithi026:> mktemp 2021-11-03T16:33:58.753 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.uk8RRlSBVE 2021-11-03T16:33:58.753 DEBUG:teuthology.orchestra.run.smithi026:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.uk8RRlSBVE 2021-11-03T16:33:58.821 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0666 /tmp/tmp.uk8RRlSBVE 2021-11-03T16:33:58.975 DEBUG:teuthology.orchestra.remote:smithi026:/tmp/tmp.uk8RRlSBVE is 6KB 2021-11-03T16:33:59.029 DEBUG:teuthology.orchestra.run.smithi026:> rm -fr /tmp/tmp.uk8RRlSBVE 2021-11-03T16:33:59.046 DEBUG:teuthology.orchestra.run.smithi026:> sudo /bin/ls /boot/loader/entries || true 2021-11-03T16:33:59.108 INFO:teuthology.orchestra.run.smithi026.stdout:ecc66dffcd264e5181894e69c53ff13c-0-rescue.conf 2021-11-03T16:33:59.108 INFO:teuthology.orchestra.run.smithi026.stdout:ecc66dffcd264e5181894e69c53ff13c-4.18.0-240.el8.x86_64.conf 2021-11-03T16:33:59.108 INFO:teuthology.orchestra.run.smithi026.stdout:ecc66dffcd264e5181894e69c53ff13c-4.18.0-305.10.2.el8_4.x86_64.conf 2021-11-03T16:33:59.109 INFO:teuthology.orchestra.run.smithi026.stdout:ecc66dffcd264e5181894e69c53ff13c-4.18.0-305.19.1.el8_4.x86_64.conf 2021-11-03T16:33:59.110 DEBUG:teuthology.orchestra.run.smithi026:> sudo grub2-set-default ecc66dffcd264e5181894e69c53ff13c-4.18.0-305.19.1.el8_4.x86_64 2021-11-03T16:33:59.266 DEBUG:teuthology.orchestra.run.smithi026:> sudo shutdown -r now 2021-11-03T16:33:59.268 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2021-11-03T16:33:59.269 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi194.front.sepia.ceph.com, path=None, version=distro) 2021-11-03T16:33:59.269 DEBUG:teuthology.orchestra.run.smithi194:> rpm -q kernel --last | head -n 1 2021-11-03T16:33:59.408 INFO:teuthology.orchestra.run.smithi194.stdout:kernel-4.18.0-305.19.1.el8_4.x86_64 Wed 03 Nov 2021 04:33:34 PM UTC 2021-11-03T16:33:59.410 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-305.19.1.el8_4.x86_64 2021-11-03T16:33:59.410 DEBUG:teuthology.orchestra.run.smithi194:> sudo rpm -qi grub2-tools 2021-11-03T16:33:59.440 INFO:teuthology.orchestra.run.smithi194.stdout:Name : grub2-tools 2021-11-03T16:33:59.440 INFO:teuthology.orchestra.run.smithi194.stdout:Epoch : 1 2021-11-03T16:33:59.440 INFO:teuthology.orchestra.run.smithi194.stdout:Version : 2.02 2021-11-03T16:33:59.441 INFO:teuthology.orchestra.run.smithi194.stdout:Release : 90.el8 2021-11-03T16:33:59.441 INFO:teuthology.orchestra.run.smithi194.stdout:Architecture: x86_64 2021-11-03T16:33:59.441 INFO:teuthology.orchestra.run.smithi194.stdout:Install Date: Wed 11 Aug 2021 06:38:04 PM UTC 2021-11-03T16:33:59.442 INFO:teuthology.orchestra.run.smithi194.stdout:Group : System Environment/Base 2021-11-03T16:33:59.442 INFO:teuthology.orchestra.run.smithi194.stdout:Size : 9197207 2021-11-03T16:33:59.442 INFO:teuthology.orchestra.run.smithi194.stdout:License : GPLv3+ 2021-11-03T16:33:59.443 INFO:teuthology.orchestra.run.smithi194.stdout:Signature : RSA/SHA256, Tue 08 Sep 2020 07:14:39 PM UTC, Key ID 05b555b38483c65d 2021-11-03T16:33:59.443 INFO:teuthology.orchestra.run.smithi194.stdout:Source RPM : grub2-2.02-90.el8.src.rpm 2021-11-03T16:33:59.443 INFO:teuthology.orchestra.run.smithi194.stdout:Build Date : Tue 08 Sep 2020 07:00:29 PM UTC 2021-11-03T16:33:59.444 INFO:teuthology.orchestra.run.smithi194.stdout:Build Host : kbuilder.bsys.centos.org 2021-11-03T16:33:59.444 INFO:teuthology.orchestra.run.smithi194.stdout:Relocations : (not relocatable) 2021-11-03T16:33:59.444 INFO:teuthology.orchestra.run.smithi194.stdout:Packager : CentOS BuildSystem 2021-11-03T16:33:59.445 INFO:teuthology.orchestra.run.smithi194.stdout:Vendor : CentOS 2021-11-03T16:33:59.445 INFO:teuthology.orchestra.run.smithi194.stdout:URL : http://www.gnu.org/software/grub/ 2021-11-03T16:33:59.445 INFO:teuthology.orchestra.run.smithi194.stdout:Summary : Support tools for GRUB. 2021-11-03T16:33:59.446 INFO:teuthology.orchestra.run.smithi194.stdout:Description : 2021-11-03T16:33:59.446 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:33:59.446 INFO:teuthology.orchestra.run.smithi194.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2021-11-03T16:33:59.446 INFO:teuthology.orchestra.run.smithi194.stdout:customizable bootloader with modular architecture. It supports a rich 2021-11-03T16:33:59.447 INFO:teuthology.orchestra.run.smithi194.stdout:variety of kernel formats, file systems, computer architectures and 2021-11-03T16:33:59.447 INFO:teuthology.orchestra.run.smithi194.stdout:hardware devices. 2021-11-03T16:33:59.447 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:33:59.447 INFO:teuthology.orchestra.run.smithi194.stdout:This subpackage provides tools for support of all platforms. 2021-11-03T16:33:59.449 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2021-11-03T16:33:59.449 INFO:teuthology.task.kernel:Updating grub on smithi194 to boot 4.18.0-305.19.1.el8_4.x86_64 2021-11-03T16:33:59.449 DEBUG:teuthology.orchestra.run.smithi194:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2021-11-03T16:34:01.010 INFO:teuthology.orchestra.run.smithi194.stderr:Generating grub configuration file ... 2021-11-03T16:34:02.805 INFO:teuthology.orchestra.run.smithi194.stderr:done 2021-11-03T16:34:02.807 DEBUG:teuthology.orchestra.run.smithi194:> mktemp 2021-11-03T16:34:02.877 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.SuYKH3bU2h 2021-11-03T16:34:02.878 DEBUG:teuthology.orchestra.run.smithi194:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.SuYKH3bU2h 2021-11-03T16:34:02.908 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.SuYKH3bU2h 2021-11-03T16:34:03.068 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.SuYKH3bU2h is 6KB 2021-11-03T16:34:03.116 DEBUG:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.SuYKH3bU2h 2021-11-03T16:34:03.130 DEBUG:teuthology.orchestra.run.smithi194:> sudo /bin/ls /boot/loader/entries || true 2021-11-03T16:34:03.199 INFO:teuthology.orchestra.run.smithi194.stdout:ecc66dffcd264e5181894e69c53ff13c-0-rescue.conf 2021-11-03T16:34:03.200 INFO:teuthology.orchestra.run.smithi194.stdout:ecc66dffcd264e5181894e69c53ff13c-4.18.0-240.el8.x86_64.conf 2021-11-03T16:34:03.200 INFO:teuthology.orchestra.run.smithi194.stdout:ecc66dffcd264e5181894e69c53ff13c-4.18.0-305.10.2.el8_4.x86_64.conf 2021-11-03T16:34:03.200 INFO:teuthology.orchestra.run.smithi194.stdout:ecc66dffcd264e5181894e69c53ff13c-4.18.0-305.19.1.el8_4.x86_64.conf 2021-11-03T16:34:03.201 DEBUG:teuthology.orchestra.run.smithi194:> sudo grub2-set-default ecc66dffcd264e5181894e69c53ff13c-4.18.0-305.19.1.el8_4.x86_64 2021-11-03T16:34:03.363 DEBUG:teuthology.orchestra.run.smithi194:> sudo shutdown -r now 2021-11-03T16:34:33.395 INFO:teuthology.misc:Re-opening connections... 2021-11-03T16:34:33.395 INFO:teuthology.misc:trying to connect to ubuntu@smithi026.front.sepia.ceph.com 2021-11-03T16:34:33.396 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2021-11-03T16:34:33.397 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-03T16:35:33.459 DEBUG:teuthology.orchestra.remote:timed out 2021-11-03T16:35:33.461 INFO:teuthology.misc:trying to connect to ubuntu@smithi194.front.sepia.ceph.com 2021-11-03T16:35:33.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2021-11-03T16:35:33.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-03T16:36:36.583 DEBUG:teuthology.orchestra.remote:timed out 2021-11-03T16:36:36.584 DEBUG:teuthology.misc:waited 123.18887448310852 2021-11-03T16:36:37.586 INFO:teuthology.misc:trying to connect to ubuntu@smithi026.front.sepia.ceph.com 2021-11-03T16:36:37.586 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2021-11-03T16:36:37.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-03T16:36:37.881 DEBUG:teuthology.orchestra.run.smithi026:> true 2021-11-03T16:36:38.218 DEBUG:teuthology.misc:waited 124.82215309143066 2021-11-03T16:36:39.219 INFO:teuthology.misc:trying to connect to ubuntu@smithi194.front.sepia.ceph.com 2021-11-03T16:36:39.220 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2021-11-03T16:36:39.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-03T16:36:39.553 DEBUG:teuthology.orchestra.run.smithi194:> true 2021-11-03T16:36:39.848 DEBUG:teuthology.misc:waited 126.45311284065247 2021-11-03T16:36:40.850 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2021-11-03T16:36:40.850 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "4.18.0-305.19.1.el8_4.x86_64"... 2021-11-03T16:36:40.851 DEBUG:teuthology.orchestra.run.smithi026:> uname -r 2021-11-03T16:36:40.868 INFO:teuthology.orchestra.run.smithi026.stdout:4.18.0-305.19.1.el8_4.x86_64 2021-11-03T16:36:40.869 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-305.19.1.el8_4.x86_64 vs 4.18.0-305.19.1.el8_4.x86_64 2021-11-03T16:36:40.869 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-11-03T16:36:40.870 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2021-11-03T16:36:40.870 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2021-11-03T16:36:40.870 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "4.18.0-305.19.1.el8_4.x86_64"... 2021-11-03T16:36:40.871 DEBUG:teuthology.orchestra.run.smithi194:> uname -r 2021-11-03T16:36:40.888 INFO:teuthology.orchestra.run.smithi194.stdout:4.18.0-305.19.1.el8_4.x86_64 2021-11-03T16:36:40.888 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-305.19.1.el8_4.x86_64 vs 4.18.0-305.19.1.el8_4.x86_64 2021-11-03T16:36:40.889 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-11-03T16:36:40.889 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2021-11-03T16:36:41.890 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2021-11-03T16:36:41.891 DEBUG:teuthology.orchestra.run.smithi026:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-11-03T16:36:41.974 INFO:teuthology.orchestra.run.smithi026.stdout:ttyS1 2021-11-03T16:36:41.986 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2021-11-03T16:36:41.987 DEBUG:teuthology.orchestra.run.smithi194:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-11-03T16:36:42.069 INFO:teuthology.orchestra.run.smithi194.stdout:ttyS1 2021-11-03T16:36:42.083 INFO:teuthology.run_tasks:Running task internal.base... 2021-11-03T16:36:42.095 INFO:teuthology.task.internal:Creating test directory... 2021-11-03T16:36:42.096 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-11-03T16:36:42.099 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-11-03T16:36:42.117 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-11-03T16:36:42.140 INFO:teuthology.run_tasks:Running task internal.archive... 2021-11-03T16:36:42.217 INFO:teuthology.task.internal:Creating archive directory... 2021-11-03T16:36:42.218 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-11-03T16:36:42.220 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-11-03T16:36:42.265 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-11-03T16:36:42.287 INFO:teuthology.task.internal:Enabling coredump saving... 2021-11-03T16:36:42.288 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-11-03T16:36:42.300 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-11-03T16:36:42.331 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-11-03T16:36:42.335 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-11-03T16:36:42.342 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-11-03T16:36:42.348 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-11-03T16:36:42.349 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-11-03T16:36:42.361 INFO:teuthology.task.internal:Configuring sudo... 2021-11-03T16:36:42.361 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-11-03T16:36:42.392 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-11-03T16:36:42.424 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-11-03T16:36:42.443 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-11-03T16:36:42.444 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-11-03T16:36:42.461 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-11-03T16:36:42.480 DEBUG:teuthology.orchestra.run.smithi026:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-11-03T16:36:42.560 DEBUG:teuthology.orchestra.run.smithi026:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2021-11-03T16:36:42.615 DEBUG:teuthology.orchestra.run.smithi026:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-11-03T16:36:42.697 DEBUG:teuthology.orchestra.run.smithi026:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2021-11-03T16:36:42.743 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2021-11-03T16:36:42.743 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-11-03T16:36:42.810 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-11-03T16:36:42.853 DEBUG:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2021-11-03T16:36:42.904 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-11-03T16:36:42.988 DEBUG:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2021-11-03T16:36:43.029 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2021-11-03T16:36:43.030 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-11-03T16:36:43.095 DEBUG:teuthology.orchestra.run.smithi026:> sudo service rsyslog restart 2021-11-03T16:36:43.098 DEBUG:teuthology.orchestra.run.smithi194:> sudo service rsyslog restart 2021-11-03T16:36:43.156 INFO:teuthology.orchestra.run.smithi026.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2021-11-03T16:36:43.178 INFO:teuthology.orchestra.run.smithi194.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2021-11-03T16:36:43.510 INFO:teuthology.run_tasks:Running task internal.timer... 2021-11-03T16:36:43.521 INFO:teuthology.task.internal:Starting timer... 2021-11-03T16:36:43.521 INFO:teuthology.run_tasks:Running task pcp... 2021-11-03T16:36:43.552 INFO:teuthology.run_tasks:Running task selinux... 2021-11-03T16:36:43.584 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2021-11-03T16:36:43.584 DEBUG:teuthology.orchestra.run.smithi026:> sudo service auditd rotate 2021-11-03T16:36:43.669 INFO:teuthology.orchestra.run.smithi026.stdout:Rotating logs: [ OK ] 2021-11-03T16:36:43.671 DEBUG:teuthology.orchestra.run.smithi194:> sudo service auditd rotate 2021-11-03T16:36:43.757 INFO:teuthology.orchestra.run.smithi194.stdout:Rotating logs: [ OK ] 2021-11-03T16:36:43.758 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-11-03T16:36:43.759 DEBUG:teuthology.orchestra.run.smithi026:> /usr/sbin/getenforce 2021-11-03T16:36:43.783 INFO:teuthology.orchestra.run.smithi026.stdout:Permissive 2021-11-03T16:36:43.784 DEBUG:teuthology.orchestra.run.smithi194:> /usr/sbin/getenforce 2021-11-03T16:36:43.814 INFO:teuthology.orchestra.run.smithi194.stdout:Permissive 2021-11-03T16:36:43.814 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi026.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi194.front.sepia.ceph.com': 'permissive'} 2021-11-03T16:36:43.815 DEBUG:teuthology.orchestra.run.smithi026:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|scontext=system_u:system_r:logrotate_t:s0\)' 2021-11-03T16:36:43.849 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-03T16:36:43.850 DEBUG:teuthology.orchestra.run.smithi194:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|scontext=system_u:system_r:logrotate_t:s0\)' 2021-11-03T16:36:43.878 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-03T16:36:43.879 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-11-03T16:36:43.880 DEBUG:teuthology.orchestra.run.smithi026:> sudo /usr/sbin/setenforce permissive 2021-11-03T16:36:43.920 DEBUG:teuthology.orchestra.run.smithi194:> sudo /usr/sbin/setenforce permissive 2021-11-03T16:36:43.968 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-11-03T16:36:43.984 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated or references a specific commit; assuming it is current 2021-11-03T16:36:43.985 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-11-03T16:36:44.006 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2021-11-03T16:36:44.008 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi026.front.sepia.ceph.com,smithi194.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-11-03T16:36:44.394 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-11-03T16:36:45.247 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-11-03T16:36:48.056 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-11-03T16:36:48.163 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:36:48 +0000 (0:00:00.123) 0:00:00.123 **** 2021-11-03T16:36:48.173 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:36:48 +0000 (0:00:00.010) 0:00:00.134 **** 2021-11-03T16:36:49.571 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi194.front.sepia.ceph.com] 2021-11-03T16:36:49.620 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:36:49 +0000 (0:00:01.446) 0:00:01.581 **** 2021-11-03T16:36:49.630 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] 2021-11-03T16:36:49.680 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:36:49 +0000 (0:00:00.059) 0:00:01.640 **** 2021-11-03T16:36:49.884 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-11-03T16:36:49.886 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-11-03T16:36:49.914 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:36:49 +0000 (0:00:00.233) 0:00:01.874 **** 2021-11-03T16:36:49.937 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:36:49 +0000 (0:00:00.021) 0:00:01.896 **** 2021-11-03T16:36:50.456 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** ok: [smithi194.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-11-03T16:36:50.457 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-11-03T16:36:50.479 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:36:50 +0000 (0:00:00.543) 0:00:02.440 **** 2021-11-03T16:36:50.499 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:36:50 +0000 (0:00:00.018) 0:00:02.459 **** 2021-11-03T16:36:50.558 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-11-03T16:36:50.560 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:36:50.581 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:36:50 +0000 (0:00:00.082) 0:00:02.541 **** 2021-11-03T16:36:50.588 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:36:50.613 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:36:50 +0000 (0:00:00.031) 0:00:02.573 **** 2021-11-03T16:36:50.836 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2021-11-03T16:36:50.838 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-03T16:36:50.859 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:36:50 +0000 (0:00:00.246) 0:00:02.820 **** 2021-11-03T16:36:50.866 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-03T16:36:50.891 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:36:50 +0000 (0:00:00.031) 0:00:02.851 **** 2021-11-03T16:36:51.615 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-11-03T16:36:51.617 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1635957410.905812-31238-136131468840111/source", "state": "file", "uid": 0} changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1635957410.9346218-31241-121628242559880/source", "state": "file", "uid": 0} 2021-11-03T16:36:51.638 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:36:51 +0000 (0:00:00.746) 0:00:03.598 **** 2021-11-03T16:36:51.658 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:36:51 +0000 (0:00:00.020) 0:00:03.618 **** 2021-11-03T16:36:52.041 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-11-03T16:36:52.043 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-11-03T16:36:52.044 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-11-03T16:36:52.063 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-11-03T16:36:52.065 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-11-03T16:36:52.138 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2021-11-03T16:36:52.140 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-11-03T16:36:52.153 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* Wednesday 03 November 2021 16:36:52 +0000 (0:00:00.495) 0:00:04.114 **** 2021-11-03T16:36:52.689 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] 2021-11-03T16:36:53.701 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] 2021-11-03T16:36:53.720 INFO:teuthology.task.ansible.out: TASK [set_fact] **************************************************************** Wednesday 03 November 2021 16:36:53 +0000 (0:00:01.566) 0:00:05.681 **** 2021-11-03T16:36:53.746 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-11-03T16:36:53.758 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-11-03T16:36:53.763 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-11-03T16:36:53.929 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:36:53 +0000 (0:00:00.208) 0:00:05.890 **** 2021-11-03T16:36:53.951 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:36:53 +0000 (0:00:00.020) 0:00:05.910 **** 2021-11-03T16:36:54.599 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi026.front.sepia.ceph.com] 2021-11-03T16:36:54.634 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] 2021-11-03T16:36:54.780 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. Wednesday 03 November 2021 16:36:54 +0000 (0:00:00.714) 0:00:06.625 **** Wednesday 03 November 2021 16:36:54 +0000 (0:00:00.045) 0:00:06.670 **** 2021-11-03T16:36:55.368 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-11-03T16:36:55.370 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.242497", "end": "2021-11-03 16:36:55.348618", "rc": 0, "start": "2021-11-03 16:36:55.106121", "stderr": "", "stderr_lines": [], "stdout": "d8709f98c8dde30910ea11812e94aaab26c7240d", "stdout_lines": ["d8709f98c8dde30910ea11812e94aaab26c7240d"]} 2021-11-03T16:36:55.390 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:36:55 +0000 (0:00:00.680) 0:00:07.351 **** 2021-11-03T16:36:55.398 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.247934", "end": "2021-11-03 16:36:55.350928", "rc": 0, "start": "2021-11-03 16:36:55.102994", "stderr": "", "stderr_lines": [], "stdout": "d8709f98c8dde30910ea11812e94aaab26c7240d", "stdout_lines": ["d8709f98c8dde30910ea11812e94aaab26c7240d"]} 2021-11-03T16:36:55.423 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:36:55 +0000 (0:00:00.032) 0:00:07.383 **** 2021-11-03T16:36:55.587 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-11-03T16:36:55.589 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.013682", "end": "2021-11-03 16:36:55.574953", "failed_when_result": false, "rc": 0, "start": "2021-11-03 16:36:55.561271", "stderr": "", "stderr_lines": [], "stdout": "c29274177b79f72740fc714fa28b55400cd0737f", "stdout_lines": ["c29274177b79f72740fc714fa28b55400cd0737f"]} 2021-11-03T16:36:55.612 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:36:55 +0000 (0:00:00.188) 0:00:07.572 **** 2021-11-03T16:36:55.640 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.019813", "end": "2021-11-03 16:36:55.625837", "failed_when_result": false, "rc": 0, "start": "2021-11-03 16:36:55.606024", "stderr": "", "stderr_lines": [], "stdout": "c29274177b79f72740fc714fa28b55400cd0737f", "stdout_lines": ["c29274177b79f72740fc714fa28b55400cd0737f"]} 2021-11-03T16:36:55.665 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:36:55 +0000 (0:00:00.053) 0:00:07.625 **** 2021-11-03T16:36:55.683 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-11-03T16:36:55.685 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:36:55.708 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:36:55 +0000 (0:00:00.042) 0:00:07.668 **** 2021-11-03T16:36:55.737 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:36:55.762 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:36:55 +0000 (0:00:00.054) 0:00:07.722 **** 2021-11-03T16:36:55.780 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:36:55.805 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:36:55 +0000 (0:00:00.042) 0:00:07.765 **** 2021-11-03T16:36:55.833 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:36:55.857 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:36:55 +0000 (0:00:00.052) 0:00:07.818 **** 2021-11-03T16:36:55.875 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:36:55.898 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:36:55 +0000 (0:00:00.040) 0:00:07.858 **** 2021-11-03T16:36:55.936 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:36:55.960 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:36:55 +0000 (0:00:00.062) 0:00:07.920 **** 2021-11-03T16:36:55.968 INFO:teuthology.task.ansible.out: 2021-11-03T16:36:55.970 INFO:teuthology.task.ansible.out:TASK [Filter the managed_users list] ******************************************* skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:36:55.994 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:36:55 +0000 (0:00:00.033) 0:00:07.954 **** 2021-11-03T16:36:56.032 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:36:56.059 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:36:56 +0000 (0:00:00.064) 0:00:08.019 **** 2021-11-03T16:36:56.067 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-11-03T16:36:56.069 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:36:56.092 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:36:56 +0000 (0:00:00.033) 0:00:08.052 **** 2021-11-03T16:36:56.129 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:36:56.154 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:36:56 +0000 (0:00:00.061) 0:00:08.114 **** 2021-11-03T16:36:56.316 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-11-03T16:36:56.317 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-03T16:36:56.340 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:36:56 +0000 (0:00:00.186) 0:00:08.300 **** 2021-11-03T16:36:56.399 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-03T16:36:56.427 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:36:56 +0000 (0:00:00.086) 0:00:08.387 **** 2021-11-03T16:36:56.625 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-11-03T16:36:56.721 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-11-03T16:36:56.816 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-11-03T16:36:56.932 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-11-03T16:36:57.016 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-11-03T16:36:57.134 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-11-03T16:36:57.218 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-11-03T16:36:57.336 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-11-03T16:36:57.410 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-11-03T16:36:57.537 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-11-03T16:36:57.613 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-11-03T16:36:57.748 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-11-03T16:36:57.816 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-11-03T16:36:57.942 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-11-03T16:36:58.017 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-11-03T16:36:58.155 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-11-03T16:36:58.207 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-11-03T16:36:58.357 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-11-03T16:36:58.411 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-11-03T16:36:58.562 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-11-03T16:36:58.608 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-11-03T16:36:58.768 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-11-03T16:36:58.801 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-11-03T16:36:58.982 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-11-03T16:36:58.994 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-11-03T16:36:59.185 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-11-03T16:36:59.199 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-11-03T16:36:59.392 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-11-03T16:36:59.394 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-11-03T16:36:59.597 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-11-03T16:36:59.600 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-11-03T16:36:59.778 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-11-03T16:36:59.801 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-11-03T16:36:59.979 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-11-03T16:37:00.016 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-11-03T16:37:00.187 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-11-03T16:37:00.224 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-11-03T16:37:00.383 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-11-03T16:37:00.427 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-11-03T16:37:00.591 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-11-03T16:37:00.647 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-11-03T16:37:00.784 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-11-03T16:37:00.849 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-11-03T16:37:00.976 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-11-03T16:37:01.061 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-11-03T16:37:01.166 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-11-03T16:37:01.262 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-11-03T16:37:01.359 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-11-03T16:37:01.465 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-11-03T16:37:01.559 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-11-03T16:37:01.674 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-11-03T16:37:01.758 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-11-03T16:37:01.874 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-11-03T16:37:01.947 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-11-03T16:37:02.076 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-11-03T16:37:02.141 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-11-03T16:37:02.282 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-11-03T16:37:02.336 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-11-03T16:37:02.484 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-11-03T16:37:02.537 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-11-03T16:37:02.690 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-11-03T16:37:02.731 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-11-03T16:37:02.900 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-11-03T16:37:02.922 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-11-03T16:37:03.103 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-11-03T16:37:03.126 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-11-03T16:37:03.306 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-11-03T16:37:03.328 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-11-03T16:37:03.506 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-11-03T16:37:03.519 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-11-03T16:37:03.713 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-11-03T16:37:03.715 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-11-03T16:37:03.915 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-11-03T16:37:03.927 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-11-03T16:37:04.115 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-11-03T16:37:04.139 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-11-03T16:37:04.305 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-11-03T16:37:04.338 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-11-03T16:37:04.497 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-11-03T16:37:04.546 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-11-03T16:37:04.694 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-11-03T16:37:04.759 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-11-03T16:37:04.896 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-11-03T16:37:04.962 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-11-03T16:37:05.097 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-11-03T16:37:05.172 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-11-03T16:37:05.288 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-11-03T16:37:05.382 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-11-03T16:37:05.488 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-11-03T16:37:05.583 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-11-03T16:37:05.678 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-11-03T16:37:05.784 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-11-03T16:37:05.878 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-11-03T16:37:05.983 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-11-03T16:37:06.068 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-11-03T16:37:06.186 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-11-03T16:37:06.261 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-11-03T16:37:06.398 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-11-03T16:37:06.461 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-11-03T16:37:06.597 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-11-03T16:37:06.650 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-11-03T16:37:06.798 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-11-03T16:37:06.851 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-11-03T16:37:07.009 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-11-03T16:37:07.051 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-11-03T16:37:07.209 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-11-03T16:37:07.241 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-11-03T16:37:07.409 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-11-03T16:37:07.442 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-11-03T16:37:07.619 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-11-03T16:37:07.633 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-11-03T16:37:07.833 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1158} ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-11-03T16:37:08.024 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-11-03T16:37:08.036 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-11-03T16:37:08.227 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-11-03T16:37:08.228 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-11-03T16:37:08.417 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-11-03T16:37:08.439 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-11-03T16:37:08.618 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-11-03T16:37:08.640 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-11-03T16:37:08.808 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-11-03T16:37:08.843 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-11-03T16:37:09.011 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-11-03T16:37:09.055 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-11-03T16:37:09.202 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-11-03T16:37:09.256 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-11-03T16:37:09.403 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-11-03T16:37:09.467 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-11-03T16:37:09.594 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-11-03T16:37:09.678 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-11-03T16:37:09.794 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-11-03T16:37:09.891 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-11-03T16:37:09.986 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-11-03T16:37:10.095 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-11-03T16:37:10.190 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-11-03T16:37:10.306 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-11-03T16:37:10.380 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-11-03T16:37:10.508 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-11-03T16:37:10.579 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-11-03T16:37:10.727 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-11-03T16:37:10.781 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-11-03T16:37:10.918 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-11-03T16:37:10.972 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-11-03T16:37:11.119 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-11-03T16:37:11.172 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-11-03T16:37:11.328 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-11-03T16:37:11.360 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-11-03T16:37:11.527 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-11-03T16:37:11.570 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-11-03T16:37:11.727 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-11-03T16:37:11.761 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-11-03T16:37:11.947 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-11-03T16:37:11.958 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-11-03T16:37:12.149 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-11-03T16:37:12.161 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-11-03T16:37:12.350 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-11-03T16:37:12.351 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-11-03T16:37:12.544 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-11-03T16:37:12.555 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-11-03T16:37:12.743 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-11-03T16:37:12.755 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-11-03T16:37:12.933 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-11-03T16:37:12.965 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-11-03T16:37:13.134 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-11-03T16:37:13.168 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-11-03T16:37:13.325 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-11-03T16:37:13.368 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-11-03T16:37:13.527 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-11-03T16:37:13.569 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-11-03T16:37:13.719 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-11-03T16:37:13.772 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-11-03T16:37:13.921 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-11-03T16:37:13.984 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-11-03T16:37:14.121 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-11-03T16:37:14.185 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-11-03T16:37:14.311 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-11-03T16:37:14.396 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-11-03T16:37:14.512 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-11-03T16:37:14.597 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-11-03T16:37:14.708 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-11-03T16:37:14.814 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-11-03T16:37:14.898 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-11-03T16:37:15.019 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-11-03T16:37:15.093 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-11-03T16:37:15.220 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-11-03T16:37:15.294 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-11-03T16:37:15.431 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-11-03T16:37:15.496 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-11-03T16:37:15.634 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-11-03T16:37:15.688 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-11-03T16:37:15.834 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-11-03T16:37:15.887 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-11-03T16:37:16.044 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-11-03T16:37:16.097 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-11-03T16:37:16.244 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-11-03T16:37:16.287 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-11-03T16:37:16.444 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-11-03T16:37:16.487 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-11-03T16:37:16.656 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-11-03T16:37:16.678 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-11-03T16:37:16.856 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-11-03T16:37:16.878 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-11-03T16:37:17.067 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-11-03T16:37:17.078 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-11-03T16:37:17.267 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-11-03T16:37:17.268 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-11-03T16:37:17.461 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-11-03T16:37:17.463 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-11-03T16:37:17.662 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-11-03T16:37:17.674 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-11-03T16:37:17.853 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-11-03T16:37:17.874 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-11-03T16:37:18.043 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-11-03T16:37:18.096 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-11-03T16:37:18.244 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-11-03T16:37:18.290 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-11-03T16:37:18.439 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-11-03T16:37:18.499 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-11-03T16:37:18.641 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-11-03T16:37:18.722 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-11-03T16:37:18.863 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-11-03T16:37:18.938 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-11-03T16:37:19.054 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-11-03T16:37:19.140 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-11-03T16:37:19.258 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-11-03T16:37:19.343 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-11-03T16:37:19.449 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-11-03T16:37:19.554 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-11-03T16:37:19.648 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-11-03T16:37:19.753 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-11-03T16:37:19.849 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-11-03T16:37:19.965 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-11-03T16:37:20.039 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-11-03T16:37:20.166 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-11-03T16:37:20.244 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-11-03T16:37:20.387 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-11-03T16:37:20.448 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-11-03T16:37:20.576 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-11-03T16:37:20.664 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-11-03T16:37:20.782 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-11-03T16:37:20.855 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-11-03T16:37:20.991 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-11-03T16:37:21.055 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-11-03T16:37:21.193 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-11-03T16:37:21.268 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-11-03T16:37:21.405 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-11-03T16:37:21.480 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-11-03T16:37:21.606 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-11-03T16:37:21.669 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-11-03T16:37:21.808 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-11-03T16:37:21.875 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-11-03T16:37:22.014 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-11-03T16:37:22.068 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-11-03T16:37:22.222 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-11-03T16:37:22.270 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-11-03T16:37:22.459 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-11-03T16:37:22.461 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-11-03T16:37:22.660 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-11-03T16:37:22.662 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-11-03T16:37:22.872 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1238, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 1238} 2021-11-03T16:37:22.874 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-11-03T16:37:23.066 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1239, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 1239} 2021-11-03T16:37:23.088 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-11-03T16:37:23.262 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1240, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 1240} 2021-11-03T16:37:23.296 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-11-03T16:37:23.457 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1241, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 1241} 2021-11-03T16:37:23.510 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-11-03T16:37:23.649 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1242, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 1242} 2021-11-03T16:37:23.714 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-11-03T16:37:23.863 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1243, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 1243} 2021-11-03T16:37:23.918 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-11-03T16:37:24.056 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1244, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 1244} 2021-11-03T16:37:24.131 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1238, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 1238} 2021-11-03T16:37:24.250 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1245, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 1245} 2021-11-03T16:37:24.335 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1239, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 1239} 2021-11-03T16:37:24.453 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1246, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 1246} 2021-11-03T16:37:24.539 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1240, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 1240} 2021-11-03T16:37:24.646 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1247, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 1247} 2021-11-03T16:37:24.753 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1241, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 1241} 2021-11-03T16:37:24.849 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1248, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 1248} 2021-11-03T16:37:24.964 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1242, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 1242} 2021-11-03T16:37:25.040 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1249, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 1249} 2021-11-03T16:37:25.166 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1243, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 1243} 2021-11-03T16:37:25.241 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1250, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 1250} 2021-11-03T16:37:25.371 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1244, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 1244} 2021-11-03T16:37:25.437 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1251, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 1251} 2021-11-03T16:37:25.574 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1245, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 1245} 2021-11-03T16:37:25.627 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1252, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 1252} 2021-11-03T16:37:25.785 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1246, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 1246} 2021-11-03T16:37:25.818 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1253, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 1253} 2021-11-03T16:37:25.988 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1247, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 1247} 2021-11-03T16:37:26.190 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1248, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 1248} 2021-11-03T16:37:26.397 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1249, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 1249} 2021-11-03T16:37:26.595 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1250, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 1250} 2021-11-03T16:37:26.801 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1251, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 1251} 2021-11-03T16:37:27.011 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1252, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 1252} 2021-11-03T16:37:27.210 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1253, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 1253} 2021-11-03T16:37:27.479 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10102, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-11-03T16:37:28.951 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10102, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-11-03T16:37:29.295 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-11-03T16:37:30.897 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-11-03T16:37:31.057 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "name": "xuwang", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-11-03T16:37:32.609 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "name": "xuwang", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-11-03T16:37:32.631 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "name": "blaine", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2021-11-03T16:37:32.789 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:37:32 +0000 (0:00:36.362) 0:00:44.749 **** 2021-11-03T16:37:32.861 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-11-03T16:37:32.884 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:37:32 +0000 (0:00:00.094) 0:00:44.844 **** 2021-11-03T16:37:32.979 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-11-03T16:37:32.981 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@desktop 2021-11-03T16:37:32.983 INFO:teuthology.task.ansible.out: QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b26 2021-11-03T16:37:32.985 INFO:teuthology.task.ansible.out:5c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed20 2021-11-03T16:37:32.987 INFO:teuthology.task.ansible.out:82caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name" 2021-11-03T16:37:32.988 INFO:teuthology.task.ansible.out:: "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu" 2021-11-03T16:37:32.989 INFO:teuthology.task.ansible.out:, "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915 2021-11-03T16:37:32.990 INFO:teuthology.task.ansible.out:d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZ 2021-11-03T16:37:32.992 INFO:teuthology.task.ansible.out:YM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 2021-11-03T16:37:32.993 INFO:teuthology.task.ansible.out: 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp 2021-11-03T16:37:32.995 INFO:teuthology.task.ansible.out:", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3 2021-11-03T16:37:32.996 INFO:teuthology.task.ansible.out:624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9Jj 2021-11-03T16:37:32.998 INFO:teuthology.task.ansible.out:enDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "sh 2021-11-03T16:37:33.000 INFO:teuthology.task.ansible.out:yamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a 2021-11-03T16:37:33.001 INFO:teuthology.task.ansible.out:28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": " 2021-11-03T16:37:33.003 INFO:teuthology.task.ansible.out:zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}]}, "changed": false} 2021-11-03T16:37:33.028 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:37:33 +0000 (0:00:00.143) 0:00:44.988 **** 2021-11-03T16:37:33.939 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-11-03T16:37:33.940 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"after": "d8709f98c8dde30910ea11812e94aaab26c7240d", "attempts": 1, "before": "d8709f98c8dde30910ea11812e94aaab26c7240d", "changed": false, "remote_url_changed": false} 2021-11-03T16:37:33.961 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:37:33 +0000 (0:00:00.933) 0:00:45.921 **** 2021-11-03T16:37:34.285 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-03T16:37:34.286 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-11-03T16:37:34.330 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-11-03T16:37:34.332 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "name": "blaine", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2021-11-03T16:37:34.476 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:37:34 +0000 (0:00:00.514) 0:00:46.436 **** 2021-11-03T16:37:34.503 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-03T16:37:34.505 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-11-03T16:37:34.547 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-11-03T16:37:34.572 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:37:34 +0000 (0:00:00.095) 0:00:46.532 **** 2021-11-03T16:37:34.718 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-03T16:37:34.721 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-11-03T16:37:34.794 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-11-03T16:37:34.796 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@desktop 2021-11-03T16:37:34.798 INFO:teuthology.task.ansible.out: QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b26 2021-11-03T16:37:34.800 INFO:teuthology.task.ansible.out:5c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed20 2021-11-03T16:37:34.802 INFO:teuthology.task.ansible.out:82caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name" 2021-11-03T16:37:34.804 INFO:teuthology.task.ansible.out:: "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "v 2021-11-03T16:37:34.805 INFO:teuthology.task.ansible.out:asu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915 2021-11-03T16:37:34.806 INFO:teuthology.task.ansible.out:d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZ 2021-11-03T16:37:34.808 INFO:teuthology.task.ansible.out:YM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 2021-11-03T16:37:34.811 INFO:teuthology.task.ansible.out: 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp 2021-11-03T16:37:34.813 INFO:teuthology.task.ansible.out:", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3 2021-11-03T16:37:34.814 INFO:teuthology.task.ansible.out:624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9Jj 2021-11-03T16:37:34.816 INFO:teuthology.task.ansible.out:enDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "sh 2021-11-03T16:37:34.818 INFO:teuthology.task.ansible.out:yamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70c 2021-11-03T16:37:34.818 INFO:teuthology.task.ansible.out:f55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a 2021-11-03T16:37:34.820 INFO:teuthology.task.ansible.out:28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": " 2021-11-03T16:37:34.821 INFO:teuthology.task.ansible.out:zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}]}, "changed": false} 2021-11-03T16:37:34.850 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:37:34 +0000 (0:00:00.278) 0:00:46.810 **** 2021-11-03T16:37:34.933 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-03T16:37:34.935 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-11-03T16:37:34.936 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-11-03T16:37:35.135 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-11-03T16:37:35.351 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-11-03T16:37:35.354 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-11-03T16:37:35.561 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-11-03T16:37:35.583 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-11-03T16:37:35.586 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"after": "d8709f98c8dde30910ea11812e94aaab26c7240d", "attempts": 1, "before": "d8709f98c8dde30910ea11812e94aaab26c7240d", "changed": false, "remote_url_changed": false} 2021-11-03T16:37:35.606 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:37:35 +0000 (0:00:00.755) 0:00:47.566 **** 2021-11-03T16:37:35.780 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-11-03T16:37:35.991 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-11-03T16:37:36.002 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:37:36.086 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-11-03T16:37:36.203 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-11-03T16:37:36.204 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-11-03T16:37:36.308 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-11-03T16:37:36.413 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-11-03T16:37:36.416 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-11-03T16:37:36.425 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:37:36.427 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:37:36.542 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-11-03T16:37:36.639 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-11-03T16:37:36.755 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-11-03T16:37:36.756 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-11-03T16:37:36.850 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-11-03T16:37:36.852 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-11-03T16:37:36.975 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-11-03T16:37:37.059 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-11-03T16:37:37.196 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-11-03T16:37:37.198 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-11-03T16:37:37.270 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-11-03T16:37:37.407 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-11-03T16:37:37.471 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-11-03T16:37:37.618 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-11-03T16:37:37.684 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-11-03T16:37:37.686 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-11-03T16:37:37.832 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-11-03T16:37:37.853 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:37:37.886 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-11-03T16:37:37.887 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-11-03T16:37:38.065 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-11-03T16:37:38.066 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-11-03T16:37:38.117 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-11-03T16:37:38.288 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-11-03T16:37:38.290 INFO:teuthology.task.ansible.out:son", "validate_certs": true} skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:37:38.301 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:37:38.321 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-11-03T16:37:38.511 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-11-03T16:37:38.523 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlI 2021-11-03T16:37:38.525 INFO:teuthology.task.ansible.out:Qv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-11-03T16:37:38.738 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-11-03T16:37:38.749 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-11-03T16:37:38.752 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-11-03T16:37:38.940 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-11-03T16:37:38.972 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-11-03T16:37:39.154 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-11-03T16:37:39.195 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-11-03T16:37:39.353 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-11-03T16:37:39.407 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-11-03T16:37:39.574 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-11-03T16:37:39.628 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-11-03T16:37:39.630 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-11-03T16:37:39.778 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-11-03T16:37:39.781 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-11-03T16:37:39.864 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-11-03T16:37:39.866 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-11-03T16:37:39.992 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-11-03T16:37:40.080 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-11-03T16:37:40.228 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-11-03T16:37:40.292 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-11-03T16:37:40.432 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-11-03T16:37:40.517 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlI 2021-11-03T16:37:40.519 INFO:teuthology.task.ansible.out:Qv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-11-03T16:37:40.633 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-11-03T16:37:40.738 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-11-03T16:37:40.936 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-11-03T16:37:40.956 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-11-03T16:37:41.054 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-11-03T16:37:41.186 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-11-03T16:37:41.260 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-11-03T16:37:41.411 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-11-03T16:37:41.475 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-11-03T16:37:41.478 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-11-03T16:37:41.624 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-11-03T16:37:41.689 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-11-03T16:37:41.692 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-11-03T16:37:41.861 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-11-03T16:37:41.863 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-11-03T16:37:41.916 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-11-03T16:37:42.088 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-11-03T16:37:42.121 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-11-03T16:37:42.299 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-11-03T16:37:42.321 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-11-03T16:37:42.519 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-11-03T16:37:42.542 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNH 2021-11-03T16:37:42.544 INFO:teuthology.task.ansible.out:ORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-11-03T16:37:42.730 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-11-03T16:37:42.762 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-11-03T16:37:42.765 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-11-03T16:37:42.768 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-11-03T16:37:42.948 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-11-03T16:37:42.969 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-11-03T16:37:43.163 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-11-03T16:37:43.175 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-11-03T16:37:43.374 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-11-03T16:37:43.386 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-11-03T16:37:43.587 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-11-03T16:37:43.588 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-11-03T16:37:43.590 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-11-03T16:37:43.791 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-11-03T16:37:43.805 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-11-03T16:37:43.807 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-11-03T16:37:43.994 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-11-03T16:37:43.996 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-11-03T16:37:44.016 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-11-03T16:37:44.227 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-11-03T16:37:44.230 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-11-03T16:37:44.429 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-11-03T16:37:44.451 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-11-03T16:37:44.640 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-11-03T16:37:44.644 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-11-03T16:37:44.694 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNH 2021-11-03T16:37:44.696 INFO:teuthology.task.ansible.out:ORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-11-03T16:37:44.845 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-11-03T16:37:44.921 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-11-03T16:37:44.923 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-11-03T16:37:44.925 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-11-03T16:37:45.070 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-11-03T16:37:45.134 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-11-03T16:37:45.273 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-11-03T16:37:45.275 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-11-03T16:37:45.347 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-11-03T16:37:45.484 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-11-03T16:37:45.581 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-11-03T16:37:45.695 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-11-03T16:37:45.790 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-11-03T16:37:45.905 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-11-03T16:37:46.011 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-11-03T16:37:46.110 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-11-03T16:37:46.238 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-11-03T16:37:46.240 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-11-03T16:37:46.324 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-11-03T16:37:46.471 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-11-03T16:37:46.524 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-11-03T16:37:46.681 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-11-03T16:37:46.745 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-11-03T16:37:46.896 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-11-03T16:37:46.898 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-11-03T16:37:46.950 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-11-03T16:37:47.111 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-11-03T16:37:47.143 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-11-03T16:37:47.144 INFO:teuthology.task.ansible.out: 2021-11-03T16:37:47.328 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-11-03T16:37:47.351 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-11-03T16:37:47.546 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-11-03T16:37:47.548 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-11-03T16:37:47.570 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-11-03T16:37:47.761 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-11-03T16:37:47.773 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-11-03T16:37:47.984 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-11-03T16:37:47.985 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-11-03T16:37:48.188 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-11-03T16:37:48.199 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-11-03T16:37:48.398 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-11-03T16:37:48.410 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-11-03T16:37:48.611 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-11-03T16:37:48.633 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-11-03T16:37:48.812 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-11-03T16:37:48.844 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-11-03T16:37:49.017 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-11-03T16:37:49.059 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-11-03T16:37:49.229 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-11-03T16:37:49.272 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-11-03T16:37:49.430 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-11-03T16:37:49.494 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-11-03T16:37:49.641 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-11-03T16:37:49.642 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-11-03T16:37:49.714 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-11-03T16:37:49.851 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-11-03T16:37:49.925 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-11-03T16:37:50.064 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-11-03T16:37:50.149 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-11-03T16:37:50.266 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-11-03T16:37:50.372 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-11-03T16:37:50.468 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-11-03T16:37:50.470 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-11-03T16:37:50.585 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-11-03T16:37:50.681 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-11-03T16:37:50.809 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-11-03T16:37:50.884 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-11-03T16:37:51.022 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-11-03T16:37:51.085 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-11-03T16:37:51.245 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-11-03T16:37:51.298 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-11-03T16:37:51.468 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-11-03T16:37:51.502 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-11-03T16:37:51.693 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-11-03T16:37:51.715 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-11-03T16:37:51.914 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-11-03T16:37:51.926 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-11-03T16:37:52.129 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-11-03T16:37:52.131 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD 2021-11-03T16:37:52.133 INFO:teuthology.task.ansible.out:4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.local", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-11-03T16:37:52.345 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-11-03T16:37:52.346 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-11-03T16:37:52.550 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-11-03T16:37:52.551 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-11-03T16:37:52.774 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-11-03T16:37:52.777 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-11-03T16:37:52.991 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-11-03T16:37:52.993 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-11-03T16:37:52.994 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-11-03T16:37:53.193 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-11-03T16:37:53.226 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-11-03T16:37:53.404 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-11-03T16:37:53.446 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-11-03T16:37:53.613 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/ 2021-11-03T16:37:53.615 INFO:teuthology.task.ansible.out:yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-11-03T16:37:53.656 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-11-03T16:37:53.815 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-11-03T16:37:53.867 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-11-03T16:37:54.025 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-11-03T16:37:54.088 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-11-03T16:37:54.237 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-11-03T16:37:54.300 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-11-03T16:37:54.437 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-11-03T16:37:54.521 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-11-03T16:37:54.648 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-11-03T16:37:54.743 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-11-03T16:37:54.746 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-11-03T16:37:54.848 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-11-03T16:37:54.954 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-11-03T16:37:55.071 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-11-03T16:37:55.176 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-11-03T16:37:55.272 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-11-03T16:37:55.398 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-11-03T16:37:55.472 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-11-03T16:37:55.609 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-11-03T16:37:55.684 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-11-03T16:37:55.831 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-11-03T16:37:55.886 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-11-03T16:37:56.045 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-11-03T16:37:56.099 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-11-03T16:37:56.263 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/ 2021-11-03T16:37:56.264 INFO:teuthology.task.ansible.out:yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-11-03T16:37:56.305 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-11-03T16:37:56.484 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-11-03T16:37:56.506 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-11-03T16:37:56.717 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWp 2021-11-03T16:37:56.720 INFO:teuthology.task.ansible.out:G6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-11-03T16:37:56.921 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-11-03T16:37:56.932 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-11-03T16:37:57.127 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-11-03T16:37:57.149 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-11-03T16:37:57.338 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-11-03T16:37:57.383 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-11-03T16:37:57.552 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-11-03T16:37:57.554 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-11-03T16:37:57.594 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-11-03T16:37:57.754 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-11-03T16:37:57.819 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-11-03T16:37:57.957 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-11-03T16:37:58.032 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-11-03T16:37:58.171 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-11-03T16:37:58.246 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-11-03T16:37:58.383 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-11-03T16:37:58.468 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-11-03T16:37:58.586 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-11-03T16:37:58.693 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-11-03T16:37:58.800 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-11-03T16:37:58.907 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-11-03T16:37:59.005 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-11-03T16:37:59.132 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-11-03T16:37:59.207 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-11-03T16:37:59.356 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-11-03T16:37:59.420 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-11-03T16:37:59.567 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-11-03T16:37:59.620 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-11-03T16:37:59.778 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-11-03T16:37:59.831 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-11-03T16:37:59.999 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-11-03T16:38:00.031 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-11-03T16:38:00.221 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-11-03T16:38:00.243 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCoeyVaMjhcGrWQB+4Rq+SSIi8+OY/kx2s1vofiGt1gu3RNtFmG0Df1VITJJ32dbzaW7kTNxaRvhldNd/n7yEMssG+Wg+a5WKvSudlbVMmscbSXdFuVbcCW1jNrTGCYrxL7Sn5e7NQEQfAsCbfXwTcYBw33NdBVovC+gs2V3sZGvX3Y0akZONNuVg1mhu0L4m1/5IegJh005KeilwetHA2A5Dr10RG6oyIgT7t4z5gZXsrOiG3UQBXaekILYV9jxMWoFXGkVLc8TpL9SUAdxE3Owc0u1XiPqYYlEN+zDvE0554Zj8Oc2ZO6HRXCZXQFvzXeCD12YswcOfkIDmJRF7GT prashant@mauli", "key_options": null, "k 2021-11-03T16:38:00.245 INFO:teuthology.task.ansible.out:eyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-11-03T16:38:00.431 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-11-03T16:38:00.433 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-11-03T16:38:00.453 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-11-03T16:38:00.651 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-11-03T16:38:00.662 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-11-03T16:38:00.872 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-11-03T16:38:00.884 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_ 2021-11-03T16:38:00.886 INFO:teuthology.task.ansible.out:options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-11-03T16:38:01.084 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} changed: [smithi194.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt4sQTrDDg562IWY9Bw2fxFR7Y7b5lfo9egHa1qNFR5K4gt8lUwQXgzcxZK5dgSTZXHDGxrbYKWsdb8NbpgU/YjSqDUIptMZrhTI6pdHKZ2usY+nieaJj0NIZP/S7M93BbJeoNBYACjvDUr+vXEg6ZL3uAj+zFXr/4te+p4Nq 2021-11-03T16:38:01.085 INFO:teuthology.task.ansible.out:JBl4bSpvjcRK12O+F6HE3Q93j0Vlfs8IbXP4vcPcqOW+2usXw7JPdfjwuACJxrLTx/0mBsv8qXJDfOpPIHAMA/9SdTAzhs6XMo+fOwVOKkV+ki2fO3sl8pE16aFOkI3cYX36nkYYpZ2bJLnIPcLv37i3Nypl8eNLA4gzjkDf1o/KLO5vXOs76H189WGLqjh0SHAx/3KO6mrIhTq8Bv6YWoT3ntg22fXaxeajNhHcQ0bKZtGOAb0W1FcMRbSTkgEFAassYxlpTtuaCDIuA4fUVKW97Zu62eDDsSUtTWak/Yf940qAbptPPAw4ljmrvZRcjM9y6mGU8lKi5H4QoEOfbPok= nia@fedora", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-11-03T16:38:01.291 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-11-03T16:38:01.293 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-11-03T16:38:01.491 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-11-03T16:38:01.513 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-11-03T16:38:01.701 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-11-03T16:38:01.723 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-11-03T16:38:01.903 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-11-03T16:38:01.936 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-11-03T16:38:02.105 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-11-03T16:38:02.160 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-11-03T16:38:02.317 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-11-03T16:38:02.383 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-11-03T16:38:02.522 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-11-03T16:38:02.583 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-11-03T16:38:02.731 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-11-03T16:38:02.805 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-11-03T16:38:02.931 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-11-03T16:38:03.038 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-11-03T16:38:03.143 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-11-03T16:38:03.248 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCoeyVaMjhcGrWQB+4Rq+SSIi8+OY/kx2s1vofiGt1gu3RNtFmG0Df1VITJJ32dbzaW7kTNxaRvhldNd/n7yEMssG+Wg+a5WKvSudlbVMmscbSXdFuVbcCW1jNrTGCYrxL7Sn5e7NQEQfAsCbfXwTcYBw33NdBVovC+gs2V3sZGvX3Y0akZONNuVg1mhu0L4m1/5IegJh005KeilwetHA2A5Dr10RG6oyIgT7t4z5gZXsrOiG3UQBXaekILYV9jxMWoFXGkVLc8TpL9SUAdxE3Owc0u1XiPqYYlEN+zDvE0554Zj8Oc2ZO6HRXCZXQFvzXeCD12YswcOfkIDmJRF7GT prashant@mauli", "key_options": null, "k 2021-11-03T16:38:03.251 INFO:teuthology.task.ansible.out:eyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-11-03T16:38:03.352 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-11-03T16:38:03.488 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-11-03T16:38:03.552 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-11-03T16:38:03.708 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-11-03T16:38:03.762 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-11-03T16:38:03.918 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_ 2021-11-03T16:38:03.920 INFO:teuthology.task.ansible.out:options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-11-03T16:38:03.961 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-11-03T16:38:04.140 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt4sQTrDDg562IWY9Bw2fxFR7Y7b5lfo9egHa1qNFR5K4gt8lUwQXgzcxZK5dgSTZXHDGxrbYKWsdb8NbpgU/YjSqDUIptMZrhTI6pdHKZ2usY+nieaJj0NIZP/S7M93BbJeoNBYACjvDUr+vXEg6ZL3uAj+zFXr/4te+p4NqJBl4bSpvjcRK12O+F6HE3Q93j0Vlfs8IbXP4vcPcqOW+2usXw7JPdfjwuACJxrLTx/0mBsv8qXJDfOpPIHAMA/9SdTAzhs6XMo+fOwVOKkV+ki2fO3sl8pE16aFOkI3cYX36nkYYpZ2bJLnIPcLv37i3Nypl8eNLA4gzjkDf1o/KLO5vXOs76H189WGLqjh0SHAx/3KO6mrIhTq8Bv6YWoT3ntg22fXaxeajNhHcQ0bKZtGOAb0W1FcMRbSTkgEFAassYxlpTtuaCDIuA4fUVKW97Zu62eDDsSUtTWak/Yf940qAbptPPAw4ljmrvZRcjM9y6mGU8lKi5H4QoEOfbPok= nia@fedora", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-11-03T16:38:04.173 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-11-03T16:38:04.350 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-11-03T16:38:04.371 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2021-11-03T16:38:04.580 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-11-03T16:38:04.582 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-11-03T16:38:04.790 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2021-11-03T16:38:04.792 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-11-03T16:38:04.989 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2021-11-03T16:38:05.012 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-11-03T16:38:05.201 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-11-03T16:38:05.233 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-11-03T16:38:05.410 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2021-11-03T16:38:05.623 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-11-03T16:38:05.645 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:05 +0000 (0:00:30.038) 0:01:17.605 **** 2021-11-03T16:38:05.677 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-11-03T16:38:05.729 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-03T16:38:05.731 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:05.741 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:05.753 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd 2021-11-03T16:38:05.755 INFO:teuthology.task.ansible.out:0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:05.764 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:05.766 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:05.776 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:05.788 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:05.872 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-11-03T16:38:05.988 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-03T16:38:05.990 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-11-03T16:38:05.999 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.000 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.083 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-03T16:38:06.085 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-11-03T16:38:06.208 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-03T16:38:06.210 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-11-03T16:38:06.324 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-11-03T16:38:06.436 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi194.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi 2021-11-03T16:38:06.438 INFO:teuthology.task.ansible.out:wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZuju 2021-11-03T16:38:06.439 INFO:teuthology.task.ansible.out:zsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.441 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.452 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.454 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.463 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.475 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.475 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.487 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.498 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.509 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.510 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.523 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.534 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.535 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** changed: [smithi026.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.546 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.557 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.559 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.569 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.580 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.591 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.592 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.603 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.603 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.614 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.625 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.627 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.637 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.638 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.648 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.659 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.661 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.670 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.672 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.682 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.693 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.704 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.706 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.715 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.716 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.727 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.738 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.739 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.750 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.752 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.762 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.763 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.773 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.775 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.784 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.795 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.797 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.807 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.817 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.819 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.829 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.830 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.840 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.851 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.852 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.862 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.864 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.873 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.884 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.886 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.895 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.906 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.908 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.918 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.919 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.929 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.940 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.940 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.951 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.953 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.963 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.964 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-11-03T16:38:06.974 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-03T16:38:06.976 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.986 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.987 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:06.997 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.008 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.009 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.024 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.026 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.035 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.046 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.057 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.058 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.069 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.070 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.080 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.081 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.091 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.102 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.103 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.113 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.115 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.124 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.135 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.137 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.146 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.148 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.158 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.169 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.170 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.180 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.181 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.191 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-03T16:38:07.193 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpa 2021-11-03T16:38:07.194 INFO:teuthology.task.ansible.out:d CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.203 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.215 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.217 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.226 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.227 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.238 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.248 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.250 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.260 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.271 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.272 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.282 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.284 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.294 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.296 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.305 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.316 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.318 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.327 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.329 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.339 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.350 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.351 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.361 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.363 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.372 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.383 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.404 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-03T16:38:07.406 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-11-03T16:38:07.427 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:07 +0000 (0:00:01.781) 0:01:19.387 **** 2021-11-03T16:38:07.496 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* 2021-11-03T16:38:07.498 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:07.518 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:07 +0000 (0:00:00.091) 0:01:19.478 **** 2021-11-03T16:38:07.619 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-03T16:38:07.621 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2021-11-03T16:38:07.796 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-03T16:38:07.798 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-11-03T16:38:07.829 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-03T16:38:07.830 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-11-03T16:38:07.986 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-03T16:38:07.988 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-11-03T16:38:08.049 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-03T16:38:08.051 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2021-11-03T16:38:08.175 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi194.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-11-03T16:38:08.269 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-03T16:38:08.271 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2021-11-03T16:38:08.374 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-03T16:38:08.376 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-11-03T16:38:08.488 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-03T16:38:08.490 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-11-03T16:38:08.562 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi194.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-11-03T16:38:08.707 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-03T16:38:08.709 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2021-11-03T16:38:08.777 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi194.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-11-03T16:38:08.800 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:08 +0000 (0:00:01.281) 0:01:20.760 **** 2021-11-03T16:38:08.893 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-03T16:38:08.895 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:08.904 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:08.907 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:08.915 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:08.926 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:08.928 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:08.938 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:08.939 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-03T16:38:08.939 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-11-03T16:38:08.950 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-03T16:38:08.952 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.138 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-03T16:38:09.140 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-11-03T16:38:09.181 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-03T16:38:09.183 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e 2021-11-03T16:38:09.185 INFO:teuthology.task.ansible.out:1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.329 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi194.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-11-03T16:38:09.403 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-03T16:38:09.405 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-11-03T16:38:09.520 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-03T16:38:09.522 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-11-03T16:38:09.615 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-03T16:38:09.617 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfad 2021-11-03T16:38:09.618 INFO:teuthology.task.ansible.out:a28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.627 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.637 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.639 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.649 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.659 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.661 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.671 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.672 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.692 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.694 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.704 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.705 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi194.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-11-03T16:38:09.707 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.717 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.728 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.730 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.739 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.750 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.752 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.761 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.763 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.773 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.784 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.786 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.796 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.798 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.807 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.818 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.820 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.830 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.831 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.841 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.852 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.854 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.864 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.865 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.875 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.886 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.888 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.897 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.899 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi194.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.910 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.920 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.922 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.931 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.933 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.943 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.954 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.955 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.965 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.966 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.977 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.987 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.989 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:09.999 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.000 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.010 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.021 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.022 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.032 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.043 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.045 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.054 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.056 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.069 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.080 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.081 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.091 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-03T16:38:10.092 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.103 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.104 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.114 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.116 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.125 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.136 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.138 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.147 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.149 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.159 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.170 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.171 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.181 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.192 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.203 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.205 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.215 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.225 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.247 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.258 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.268 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.280 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.281 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} TASK [Remove revoked users] **************************************************** ok: [smithi194.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-11-03T16:38:10.282 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-03T16:38:10.282 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.293 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.303 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.305 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.315 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.326 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.328 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.337 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.339 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.349 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.350 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.360 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.371 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.373 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.382 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.384 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.394 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.404 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.406 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.416 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.417 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.427 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.438 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.439 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.449 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.460 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.461 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.472 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-03T16:38:10.473 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.484 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.486 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.496 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.507 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.518 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.519 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.529 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.540 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.551 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.553 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.563 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.564 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.574 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.585 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.586 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.596 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.598 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.608 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.618 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.664 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:10 +0000 (0:00:01.863) 0:01:22.624 **** 2021-11-03T16:38:10.671 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-03T16:38:10.673 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-11-03T16:38:10.737 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:10.759 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:10 +0000 (0:00:00.095) 0:01:22.719 **** 2021-11-03T16:38:10.859 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-03T16:38:10.861 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-11-03T16:38:11.046 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-11-03T16:38:11.047 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-11-03T16:38:11.239 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-11-03T16:38:11.250 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-11-03T16:38:11.428 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-11-03T16:38:11.450 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-11-03T16:38:11.617 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-11-03T16:38:11.650 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-11-03T16:38:11.818 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-11-03T16:38:11.851 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-11-03T16:38:12.009 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-11-03T16:38:12.052 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-11-03T16:38:12.200 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-11-03T16:38:12.254 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-11-03T16:38:12.390 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-11-03T16:38:12.454 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-11-03T16:38:12.578 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-11-03T16:38:12.652 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-11-03T16:38:12.777 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-11-03T16:38:12.851 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-11-03T16:38:12.967 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-11-03T16:38:13.051 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-11-03T16:38:13.161 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-11-03T16:38:13.268 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-11-03T16:38:13.352 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-11-03T16:38:13.467 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-11-03T16:38:13.541 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-11-03T16:38:13.668 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-11-03T16:38:13.731 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-11-03T16:38:13.867 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-11-03T16:38:13.931 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-11-03T16:38:14.067 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-11-03T16:38:14.120 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-11-03T16:38:14.267 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-11-03T16:38:14.310 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-11-03T16:38:14.467 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-11-03T16:38:14.500 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-11-03T16:38:14.668 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-11-03T16:38:14.700 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-11-03T16:38:14.867 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-11-03T16:38:14.889 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-11-03T16:38:15.067 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-11-03T16:38:15.089 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-11-03T16:38:15.276 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-11-03T16:38:15.473 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-11-03T16:38:15.674 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-11-03T16:38:15.873 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-11-03T16:38:16.073 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-11-03T16:38:16.273 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-11-03T16:38:16.472 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-11-03T16:38:16.619 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "davidz", "name": "davidz", "remove": false, "state": "absent"} 2021-11-03T16:38:16.672 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-11-03T16:38:16.871 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-11-03T16:38:17.076 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-11-03T16:38:17.275 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-11-03T16:38:17.475 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-11-03T16:38:17.674 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-11-03T16:38:17.872 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-11-03T16:38:18.072 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-11-03T16:38:18.136 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "wusui", "name": "wusui", "remove": false, "state": "absent"} 2021-11-03T16:38:18.272 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-11-03T16:38:18.472 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-11-03T16:38:18.673 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-11-03T16:38:19.637 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "nwatkins", "name": "nwatkins", "remove": false, "state": "absent"} 2021-11-03T16:38:20.299 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "davidz", "name": "davidz", "remove": false, "state": "absent"} 2021-11-03T16:38:21.107 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "sidharthanup", "name": "sidharthanup", "remove": false, "state": "absent"} 2021-11-03T16:38:22.043 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "wusui", "name": "wusui", "remove": false, "state": "absent"} 2021-11-03T16:38:22.597 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "varsha", "name": "varsha", "remove": false, "state": "absent"} 2021-11-03T16:38:23.693 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "nwatkins", "name": "nwatkins", "remove": false, "state": "absent"} 2021-11-03T16:38:24.128 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "hmunjulu", "name": "hmunjulu", "remove": false, "state": "absent"} 2021-11-03T16:38:24.327 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-11-03T16:38:24.537 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-11-03T16:38:24.726 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-11-03T16:38:24.914 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-11-03T16:38:25.115 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-11-03T16:38:25.283 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "sidharthanup", "name": "sidharthanup", "remove": false, "state": "absent"} 2021-11-03T16:38:25.314 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-11-03T16:38:25.512 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-11-03T16:38:25.712 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-11-03T16:38:25.900 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-11-03T16:38:26.112 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-11-03T16:38:26.172 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:26 +0000 (0:00:15.412) 0:01:38.132 **** 2021-11-03T16:38:26.713 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-11-03T16:38:26.715 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "checksum": "2551e778b6ddae713f4992ad172b228017a89982", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "bd234e5f7b7bb28068648cde28f6f057", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1635957506.2675352-12050-112610161675757/source", "state": "file", "uid": 0} 2021-11-03T16:38:26.736 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:26 +0000 (0:00:00.564) 0:01:38.696 **** 2021-11-03T16:38:26.805 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-11-03T16:38:26.807 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => { "msg": "Host smithi194.front.sepia.ceph.com is running CentOS 8.3 (n/a)" } 2021-11-03T16:38:26.832 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:26 +0000 (0:00:00.094) 0:01:38.791 **** 2021-11-03T16:38:26.860 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** changed: [smithi026.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "varsha", "name": "varsha", "remove": false, "state": "absent"} 2021-11-03T16:38:26.904 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-11-03T16:38:26.906 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2021-11-03T16:38:26.928 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:26 +0000 (0:00:00.097) 0:01:38.888 **** 2021-11-03T16:38:26.997 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-11-03T16:38:26.999 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:27.019 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:27 +0000 (0:00:00.091) 0:01:38.980 **** 2021-11-03T16:38:27.355 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-11-03T16:38:27.357 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.083128", "end": "2021-11-03 16:38:27.332583", "rc": 0, "start": "2021-11-03 16:38:27.249455", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-11-03T16:38:27.379 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:27 +0000 (0:00:00.357) 0:01:39.337 **** 2021-11-03T16:38:27.446 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-11-03T16:38:27.448 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:27.472 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:27 +0000 (0:00:00.094) 0:01:39.432 **** 2021-11-03T16:38:27.542 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-11-03T16:38:27.544 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:27.578 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:27 +0000 (0:00:00.105) 0:01:39.538 **** 2021-11-03T16:38:27.651 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-11-03T16:38:27.654 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:27.673 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:27 +0000 (0:00:00.096) 0:01:39.634 **** 2021-11-03T16:38:27.741 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:27.765 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:27 +0000 (0:00:00.089) 0:01:39.724 **** 2021-11-03T16:38:27.831 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-11-03T16:38:27.833 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:27.853 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:27 +0000 (0:00:00.089) 0:01:39.813 **** 2021-11-03T16:38:27.921 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-11-03T16:38:27.923 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:27.944 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:27 +0000 (0:00:00.091) 0:01:39.905 **** 2021-11-03T16:38:28.023 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-11-03T16:38:28.025 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi194.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-03T16:38:28.046 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:28 +0000 (0:00:00.101) 0:01:40.007 **** 2021-11-03T16:38:28.128 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:28.150 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:28 +0000 (0:00:00.103) 0:01:40.110 **** 2021-11-03T16:38:28.230 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-11-03T16:38:28.232 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:28.254 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:28 +0000 (0:00:00.103) 0:01:40.214 **** 2021-11-03T16:38:28.324 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* 2021-11-03T16:38:28.326 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:28.347 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:28 +0000 (0:00:00.092) 0:01:40.307 **** 2021-11-03T16:38:28.417 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [smithi194.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-03T16:38:28.441 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:28 +0000 (0:00:00.094) 0:01:40.401 **** 2021-11-03T16:38:28.481 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-03T16:38:28.482 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "hmunjulu", "name": "hmunjulu", "remove": false, "state": "absent"} 2021-11-03T16:38:28.514 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-11-03T16:38:28.516 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:28.541 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:28 +0000 (0:00:00.099) 0:01:40.501 **** 2021-11-03T16:38:28.622 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-11-03T16:38:28.623 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-03T16:38:28.644 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:28 +0000 (0:00:00.103) 0:01:40.604 **** 2021-11-03T16:38:28.694 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-03T16:38:28.695 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-11-03T16:38:28.708 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-11-03T16:38:28.710 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:28.731 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:28 +0000 (0:00:00.086) 0:01:40.691 **** 2021-11-03T16:38:28.801 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-11-03T16:38:28.803 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:28.824 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:28 +0000 (0:00:00.092) 0:01:40.784 **** 2021-11-03T16:38:28.905 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-03T16:38:28.907 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:28.932 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:28 +0000 (0:00:00.107) 0:01:40.892 **** 2021-11-03T16:38:29.002 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:29.024 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:29 +0000 (0:00:00.092) 0:01:40.984 **** 2021-11-03T16:38:29.093 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-11-03T16:38:29.095 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-03T16:38:29.117 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:29 +0000 (0:00:00.092) 0:01:41.077 **** 2021-11-03T16:38:29.123 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-03T16:38:29.124 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-11-03T16:38:29.189 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:29.214 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:29 +0000 (0:00:00.097) 0:01:41.175 **** 2021-11-03T16:38:29.285 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:29.309 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:29 +0000 (0:00:00.094) 0:01:41.269 **** 2021-11-03T16:38:29.316 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-03T16:38:29.318 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-11-03T16:38:29.404 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:29.431 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:29 +0000 (0:00:00.122) 0:01:41.391 **** 2021-11-03T16:38:29.502 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:29.525 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:29 +0000 (0:00:00.093) 0:01:41.485 **** 2021-11-03T16:38:29.531 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-03T16:38:29.533 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-11-03T16:38:29.597 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:29.620 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:29 +0000 (0:00:00.094) 0:01:41.580 **** 2021-11-03T16:38:29.698 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-11-03T16:38:29.700 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:29.721 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:29 +0000 (0:00:00.101) 0:01:41.682 **** 2021-11-03T16:38:29.729 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi026.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-11-03T16:38:29.793 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** skipping: [smithi194.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-03T16:38:29.820 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:29 +0000 (0:00:00.098) 0:01:41.780 **** 2021-11-03T16:38:29.890 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-11-03T16:38:29.892 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:29.915 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:29 +0000 (0:00:00.094) 0:01:41.875 **** 2021-11-03T16:38:29.922 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-03T16:38:29.924 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-11-03T16:38:29.986 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:30.010 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:30 +0000 (0:00:00.095) 0:01:41.970 **** 2021-11-03T16:38:30.111 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi026.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-11-03T16:38:30.269 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-11-03T16:38:30.271 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-03T16:38:30.293 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:30 +0000 (0:00:00.283) 0:01:42.254 **** 2021-11-03T16:38:30.312 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-03T16:38:30.314 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-11-03T16:38:30.517 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-11-03T16:38:30.566 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:30 +0000 (0:00:00.273) 0:01:42.527 **** 2021-11-03T16:38:31.084 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-11-03T16:38:31.086 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2021-11-03T16:38:31.127 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-11-03T16:38:31.129 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "checksum": "2551e778b6ddae713f4992ad172b228017a89982", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "bd234e5f7b7bb28068648cde28f6f057", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1635957510.6629028-12826-1623505712763/source", "state": "file", "uid": 0} 2021-11-03T16:38:31.151 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:31 +0000 (0:00:00.584) 0:01:43.111 **** 2021-11-03T16:38:31.220 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-11-03T16:38:31.222 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => { "msg": "Host smithi026.front.sepia.ceph.com is running CentOS 8.3 (n/a)" } 2021-11-03T16:38:31.243 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:31 +0000 (0:00:00.092) 0:01:43.204 **** 2021-11-03T16:38:31.324 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-11-03T16:38:31.326 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2021-11-03T16:38:31.350 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:31 +0000 (0:00:00.106) 0:01:43.311 **** 2021-11-03T16:38:31.421 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:31.444 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:31 +0000 (0:00:00.093) 0:01:43.405 **** 2021-11-03T16:38:31.515 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-11-03T16:38:31.517 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2021-11-03T16:38:31.542 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:31 +0000 (0:00:00.097) 0:01:43.502 **** 2021-11-03T16:38:31.770 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-11-03T16:38:31.772 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.078695", "end": "2021-11-03 16:38:31.753394", "rc": 0, "start": "2021-11-03 16:38:31.674699", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-11-03T16:38:31.795 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:31 +0000 (0:00:00.253) 0:01:43.755 **** 2021-11-03T16:38:31.866 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-11-03T16:38:31.868 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:31.890 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:31 +0000 (0:00:00.094) 0:01:43.850 **** 2021-11-03T16:38:31.965 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:31.982 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:31 +0000 (0:00:00.092) 0:01:43.943 **** 2021-11-03T16:38:32.053 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-11-03T16:38:32.055 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2021-11-03T16:38:32.065 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-11-03T16:38:32.065 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:32.087 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:32 +0000 (0:00:00.104) 0:01:44.047 **** 2021-11-03T16:38:32.157 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-11-03T16:38:32.159 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:32.183 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:32 +0000 (0:00:00.092) 0:01:44.140 **** 2021-11-03T16:38:32.249 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-11-03T16:38:32.251 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:32.272 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:32 +0000 (0:00:00.092) 0:01:44.233 **** 2021-11-03T16:38:32.342 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-11-03T16:38:32.344 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:32.364 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:32 +0000 (0:00:00.091) 0:01:44.325 **** 2021-11-03T16:38:32.446 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-11-03T16:38:32.447 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi026.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-03T16:38:32.469 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:32 +0000 (0:00:00.104) 0:01:44.430 **** 2021-11-03T16:38:32.487 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-11-03T16:38:32.489 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2021-11-03T16:38:32.513 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:32 +0000 (0:00:00.043) 0:01:44.473 **** 2021-11-03T16:38:32.540 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-11-03T16:38:32.542 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:32.564 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:32 +0000 (0:00:00.050) 0:01:44.524 **** 2021-11-03T16:38:32.591 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-11-03T16:38:32.593 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:32.618 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:32 +0000 (0:00:00.054) 0:01:44.578 **** 2021-11-03T16:38:32.645 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-11-03T16:38:32.648 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:32.670 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:32 +0000 (0:00:00.051) 0:01:44.630 **** 2021-11-03T16:38:32.686 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-11-03T16:38:32.688 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:32.711 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:32 +0000 (0:00:00.041) 0:01:44.671 **** 2021-11-03T16:38:32.739 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* 2021-11-03T16:38:32.740 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:32.762 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:32 +0000 (0:00:00.051) 0:01:44.723 **** 2021-11-03T16:38:32.781 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:32.805 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:32 +0000 (0:00:00.042) 0:01:44.765 **** 2021-11-03T16:38:32.833 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-11-03T16:38:32.834 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-03T16:38:32.857 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:32 +0000 (0:00:00.051) 0:01:44.817 **** 2021-11-03T16:38:32.874 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-11-03T16:38:32.876 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:32.899 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:32 +0000 (0:00:00.041) 0:01:44.859 **** 2021-11-03T16:38:32.927 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-11-03T16:38:32.929 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:32.951 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:32 +0000 (0:00:00.051) 0:01:44.911 **** 2021-11-03T16:38:32.969 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** skipping: [smithi194.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} 2021-11-03T16:38:32.980 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} 2021-11-03T16:38:32.982 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} 2021-11-03T16:38:32.992 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-11-03T16:38:33.016 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:33 +0000 (0:00:00.065) 0:01:44.976 **** 2021-11-03T16:38:33.023 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-11-03T16:38:33.025 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-03T16:38:33.048 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:33 +0000 (0:00:00.032) 0:01:45.009 **** 2021-11-03T16:38:33.076 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-11-03T16:38:33.078 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:33.102 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:33 +0000 (0:00:00.053) 0:01:45.062 **** 2021-11-03T16:38:33.120 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:33.144 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:33 +0000 (0:00:00.041) 0:01:45.104 **** 2021-11-03T16:38:33.173 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:33.197 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:33 +0000 (0:00:00.053) 0:01:45.157 **** 2021-11-03T16:38:33.225 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-11-03T16:38:33.227 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:33.250 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:33 +0000 (0:00:00.052) 0:01:45.210 **** 2021-11-03T16:38:33.277 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-11-03T16:38:33.278 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:33.303 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:33 +0000 (0:00:00.053) 0:01:45.263 **** 2021-11-03T16:38:33.323 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-11-03T16:38:33.324 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:33.347 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:33 +0000 (0:00:00.043) 0:01:45.307 **** 2021-11-03T16:38:33.396 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-11-03T16:38:33.397 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:33.420 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:33 +0000 (0:00:00.073) 0:01:45.380 **** 2021-11-03T16:38:33.428 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-11-03T16:38:33.430 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:33.456 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:33 +0000 (0:00:00.036) 0:01:45.416 **** 2021-11-03T16:38:33.485 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-11-03T16:38:33.487 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:33.510 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:33 +0000 (0:00:00.053) 0:01:45.470 **** 2021-11-03T16:38:33.528 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-11-03T16:38:33.530 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-03T16:38:33.553 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:33 +0000 (0:00:00.043) 0:01:45.513 **** 2021-11-03T16:38:33.633 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-11-03T16:38:33.635 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:33.656 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:33 +0000 (0:00:00.103) 0:01:45.617 **** 2021-11-03T16:38:33.725 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-11-03T16:38:33.727 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:33.747 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:33 +0000 (0:00:00.090) 0:01:45.707 **** 2021-11-03T16:38:33.826 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-11-03T16:38:33.828 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:33.857 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:33 +0000 (0:00:00.109) 0:01:45.817 **** 2021-11-03T16:38:33.926 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-11-03T16:38:33.928 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:33.949 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:33 +0000 (0:00:00.092) 0:01:45.909 **** 2021-11-03T16:38:34.019 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-11-03T16:38:34.020 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:34.042 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:34 +0000 (0:00:00.092) 0:01:46.002 **** 2021-11-03T16:38:34.112 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-11-03T16:38:34.114 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:34.135 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:34 +0000 (0:00:00.092) 0:01:46.095 **** 2021-11-03T16:38:34.204 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-11-03T16:38:34.206 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-03T16:38:34.235 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:34 +0000 (0:00:00.093) 0:01:46.188 **** 2021-11-03T16:38:34.309 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-11-03T16:38:34.310 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:34.332 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:34 +0000 (0:00:00.103) 0:01:46.292 **** 2021-11-03T16:38:34.402 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-11-03T16:38:34.404 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:34.425 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:34 +0000 (0:00:00.093) 0:01:46.385 **** 2021-11-03T16:38:34.515 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-11-03T16:38:34.517 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.814993", "end": "2021-11-03 16:38:34.500337", "rc": 0, "start": "2021-11-03 16:38:33.685344", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-03T16:38:34.540 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:34 +0000 (0:00:00.115) 0:01:46.500 **** 2021-11-03T16:38:34.704 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-11-03T16:38:34.706 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-03T16:38:34.729 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:34 +0000 (0:00:00.188) 0:01:46.689 **** 2021-11-03T16:38:35.290 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-11-03T16:38:35.291 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2021-11-03T16:38:35.740 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2021-11-03T16:38:35.769 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:35 +0000 (0:00:01.039) 0:01:47.729 **** 2021-11-03T16:38:36.315 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-11-03T16:38:36.317 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2021-11-03T16:38:36.764 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2021-11-03T16:38:36.801 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:36 +0000 (0:00:01.031) 0:01:48.761 **** 2021-11-03T16:38:36.880 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-11-03T16:38:36.882 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:36.902 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:36 +0000 (0:00:00.101) 0:01:48.863 **** 2021-11-03T16:38:36.971 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:36.994 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:36 +0000 (0:00:00.091) 0:01:48.954 **** 2021-11-03T16:38:37.062 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:37.085 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:37 +0000 (0:00:00.091) 0:01:49.045 **** 2021-11-03T16:38:37.153 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:37.176 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:37 +0000 (0:00:00.090) 0:01:49.136 **** 2021-11-03T16:38:37.245 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-11-03T16:38:37.246 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} 2021-11-03T16:38:37.256 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} 2021-11-03T16:38:37.257 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-11-03T16:38:37.280 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:37 +0000 (0:00:00.104) 0:01:49.240 **** 2021-11-03T16:38:37.350 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-11-03T16:38:37.351 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:37.373 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:37 +0000 (0:00:00.092) 0:01:49.333 **** 2021-11-03T16:38:37.441 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-11-03T16:38:37.443 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:37.464 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:37 +0000 (0:00:00.091) 0:01:49.424 **** 2021-11-03T16:38:37.533 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-11-03T16:38:37.534 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:37.555 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:37 +0000 (0:00:00.091) 0:01:49.515 **** 2021-11-03T16:38:37.625 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-11-03T16:38:37.627 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:37.650 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:37 +0000 (0:00:00.094) 0:01:49.610 **** 2021-11-03T16:38:37.720 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:37.742 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:37 +0000 (0:00:00.091) 0:01:49.702 **** 2021-11-03T16:38:38.520 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-11-03T16:38:38.522 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.573888", "end": "2021-11-03 16:38:38.500341", "rc": 0, "start": "2021-11-03 16:38:37.926453", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-03T16:38:38.545 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:38 +0000 (0:00:00.802) 0:01:50.505 **** 2021-11-03T16:38:38.659 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-11-03T16:38:38.660 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-03T16:38:38.683 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:38 +0000 (0:00:00.138) 0:01:50.644 **** 2021-11-03T16:38:38.754 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:38.777 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:38 +0000 (0:00:00.093) 0:01:50.737 **** 2021-11-03T16:38:38.847 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:38.870 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:38 +0000 (0:00:00.092) 0:01:50.830 **** 2021-11-03T16:38:38.940 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-11-03T16:38:38.942 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:38.963 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:38 +0000 (0:00:00.093) 0:01:50.923 **** 2021-11-03T16:38:39.032 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:39.055 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:39 +0000 (0:00:00.092) 0:01:51.015 **** 2021-11-03T16:38:39.578 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2021-11-03T16:38:39.600 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:39 +0000 (0:00:00.544) 0:01:51.560 **** 2021-11-03T16:38:41.233 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-03T16:38:41.258 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:41 +0000 (0:00:01.658) 0:01:53.218 **** 2021-11-03T16:38:41.791 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-11-03T16:38:41.793 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2021-11-03T16:38:42.240 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2021-11-03T16:38:42.440 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-03T16:38:42.465 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:42 +0000 (0:00:01.206) 0:01:54.425 **** 2021-11-03T16:38:42.536 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:42.560 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:42 +0000 (0:00:00.095) 0:01:54.521 **** 2021-11-03T16:38:42.631 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-11-03T16:38:42.633 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:42.654 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:42 +0000 (0:00:00.093) 0:01:54.614 **** 2021-11-03T16:38:42.662 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-11-03T16:38:42.664 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2021-11-03T16:38:42.690 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:42 +0000 (0:00:00.035) 0:01:54.650 **** 2021-11-03T16:38:42.717 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-11-03T16:38:42.719 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:42.747 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:42 +0000 (0:00:00.054) 0:01:54.705 **** 2021-11-03T16:38:42.814 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:42.840 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:42 +0000 (0:00:00.095) 0:01:54.801 **** 2021-11-03T16:38:42.879 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-11-03T16:38:42.881 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-11-03T16:38:42.904 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:42 +0000 (0:00:00.063) 0:01:54.865 **** 2021-11-03T16:38:43.346 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-11-03T16:38:43.348 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2021-11-03T16:38:43.381 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:43 +0000 (0:00:00.476) 0:01:55.341 **** 2021-11-03T16:38:43.411 INFO:teuthology.task.ansible.out: 2021-11-03T16:38:43.413 INFO:teuthology.task.ansible.out:TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi194.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 13355, "state": "file", "uid": 0} 2021-11-03T16:38:43.837 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2021-11-03T16:38:44.260 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3612, "state": "file", "uid": 0} 2021-11-03T16:38:44.327 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:44 +0000 (0:00:00.946) 0:01:56.287 **** 2021-11-03T16:38:44.366 INFO:teuthology.task.ansible.out: TASK [common : Include dnf_system vars] **************************************** ok: [smithi194.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/dnf_systems.yml"], "changed": false} 2021-11-03T16:38:44.389 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:44 +0000 (0:00:00.062) 0:01:56.349 **** 2021-11-03T16:38:44.585 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* changed: [smithi194.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-11-03T16:38:44.608 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:44 +0000 (0:00:00.218) 0:01:56.568 **** 2021-11-03T16:38:44.645 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-11-03T16:38:44.647 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-03T16:38:44.656 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-03T16:38:44.667 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-03T16:38:44.678 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-03T16:38:44.701 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:44 +0000 (0:00:00.093) 0:01:56.661 **** 2021-11-03T16:38:45.108 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-11-03T16:38:45.109 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-03T16:38:45.131 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:45 +0000 (0:00:00.430) 0:01:57.092 **** 2021-11-03T16:38:45.645 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-11-03T16:38:45.646 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2021-11-03T16:38:46.093 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2021-11-03T16:38:46.315 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-11-03T16:38:46.316 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-03T16:38:46.339 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:46 +0000 (0:00:01.207) 0:01:58.299 **** 2021-11-03T16:38:46.367 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (non-RHEL/CentOS)] ******** skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:46.391 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:46 +0000 (0:00:00.051) 0:01:58.351 **** 2021-11-03T16:38:46.541 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-11-03T16:38:46.542 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2021-11-03T16:38:46.567 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:46 +0000 (0:00:00.176) 0:01:58.528 **** 2021-11-03T16:38:46.765 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-11-03T16:38:46.767 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-11-03T16:38:46.791 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:46 +0000 (0:00:00.223) 0:01:58.751 **** 2021-11-03T16:38:46.861 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-11-03T16:38:46.863 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2021-11-03T16:38:46.888 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:46 +0000 (0:00:00.096) 0:01:58.848 **** 2021-11-03T16:38:47.255 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi026.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 13355, "state": "file", "uid": 0} 2021-11-03T16:38:47.354 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-11-03T16:38:47.356 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2021-11-03T16:38:47.379 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:47 +0000 (0:00:00.491) 0:01:59.339 **** 2021-11-03T16:38:47.418 INFO:teuthology.task.ansible.out: 2021-11-03T16:38:47.421 INFO:teuthology.task.ansible.out:TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ skipping: [smithi194.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} skipping: [smithi194.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2021-11-03T16:38:47.445 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:47 +0000 (0:00:00.065) 0:01:59.405 **** 2021-11-03T16:38:47.642 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-11-03T16:38:47.644 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-03T16:38:47.665 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:47 +0000 (0:00:00.220) 0:01:59.626 **** 2021-11-03T16:38:47.693 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-11-03T16:38:47.695 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2021-11-03T16:38:47.884 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** fatal: [smithi194.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2021-11-03T16:38:47.906 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:47 +0000 (0:00:00.241) 0:01:59.867 **** 2021-11-03T16:38:47.934 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-11-03T16:38:47.936 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:47.957 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:47 +0000 (0:00:00.050) 0:01:59.917 **** 2021-11-03T16:38:48.124 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-11-03T16:38:48.126 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3612, "state": "file", "uid": 0} 2021-11-03T16:38:48.153 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:48 +0000 (0:00:00.196) 0:02:00.113 **** 2021-11-03T16:38:48.192 INFO:teuthology.task.ansible.out: TASK [common : Include dnf_system vars] **************************************** 2021-11-03T16:38:48.194 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/dnf_systems.yml"], "changed": false} 2021-11-03T16:38:48.215 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:48 +0000 (0:00:00.061) 0:02:00.175 **** 2021-11-03T16:38:48.421 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-11-03T16:38:48.423 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} TASK [common : Check for epel] ************************************************* changed: [smithi026.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-11-03T16:38:48.444 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:48 +0000 (0:00:00.229) 0:02:00.404 **** 2021-11-03T16:38:48.469 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:48 +0000 (0:00:00.024) 0:02:00.429 **** 2021-11-03T16:38:48.489 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-11-03T16:38:48.491 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-03T16:38:48.500 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-03T16:38:48.502 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-03T16:38:48.523 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-03T16:38:48.552 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:48 +0000 (0:00:00.083) 0:02:00.512 **** 2021-11-03T16:38:49.104 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-11-03T16:38:49.105 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveState": "active", "AllowedCPUs": "", "AllowedMemoryNodes": "", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "DevicePolicy": "auto", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/nrpe (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1253", "ExecMainStartTimestamp": "Wed 2021-11-03 16:35:44 UTC", "ExecMainStartTimestampMonotonic": "20228277", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_errors=no ; start_time=[Wed 2021-11-03 16:35:44 UTC] ; stop_time=[n/a] ; pid=1253 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FileDescriptorStoreMax": "0", "GID": "984", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "L 2021-11-03T16:38:49.106 INFO:teuthology.task.ansible.out:imitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127246", "LimitNPROCSoft": "127246", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127246", "LimitSIGPENDINGSoft": "127246", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "MainPID": "1253", "MemoryAccounting": "yes", "MemoryCurrent": "679936", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Nice": "0", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "PIDFile": "/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "RemainAfterExit": "no", "Restart": "on-abort", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeMaxUSec": "infinity", "SecureBits": "0", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StatusErrno": "0", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203593", "TimeoutStar 2021-11-03T16:38:49.108 INFO:teuthology.task.ansible.out:tUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Type": "simple", "UID": "988", "UMask": "0022", "WatchdogTimestamp": "Wed 2021-11-03 16:35:44 UTC", "WatchdogTimestampMonotonic": "20228620", "WatchdogUSec": "0"}} 2021-11-03T16:38:49.129 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:49 +0000 (0:00:00.576) 0:02:01.089 **** 2021-11-03T16:38:49.313 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-11-03T16:38:49.315 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001773", "end": "2021-11-03 16:38:49.299383", "rc": 0, "start": "2021-11-03 16:38:49.297610", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2021-11-03T16:38:49.336 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:49 +0000 (0:00:00.207) 0:02:01.297 **** 2021-11-03T16:38:50.279 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-11-03T16:38:50.281 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-03T16:38:50.303 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:50 +0000 (0:00:00.966) 0:02:02.263 **** 2021-11-03T16:38:50.333 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (non-RHEL/CentOS)] ******** 2021-11-03T16:38:50.335 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:50.358 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:50 +0000 (0:00:00.055) 0:02:02.318 **** 2021-11-03T16:38:50.832 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-11-03T16:38:50.833 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2021-11-03T16:38:50.859 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:50 +0000 (0:00:00.501) 0:02:02.820 **** 2021-11-03T16:38:50.933 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-11-03T16:38:50.935 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-03T16:38:50.957 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:50 +0000 (0:00:00.097) 0:02:02.918 **** 2021-11-03T16:38:51.350 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-11-03T16:38:51.353 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2021-11-03T16:38:51.379 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:51 +0000 (0:00:00.421) 0:02:03.339 **** 2021-11-03T16:38:51.417 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-11-03T16:38:51.419 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2021-11-03T16:38:51.441 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:51 +0000 (0:00:00.062) 0:02:03.401 **** 2021-11-03T16:38:51.647 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-11-03T16:38:51.649 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-03T16:38:51.670 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:51 +0000 (0:00:00.229) 0:02:03.631 **** 2021-11-03T16:38:51.928 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-11-03T16:38:51.930 INFO:teuthology.task.ansible.out:fatal: [smithi026.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2021-11-03T16:38:51.952 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:51 +0000 (0:00:00.280) 0:02:03.911 **** 2021-11-03T16:38:51.978 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-11-03T16:38:51.980 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:38:52.000 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:51 +0000 (0:00:00.049) 0:02:03.961 **** 2021-11-03T16:38:52.467 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-11-03T16:38:52.469 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2021-11-03T16:38:52.493 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:52 +0000 (0:00:00.492) 0:02:04.454 **** 2021-11-03T16:38:52.825 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-11-03T16:38:52.827 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveState": "active", "AllowedCPUs": "", "AllowedMemoryNodes": "", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "DevicePolicy": "auto", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/nrpe (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1205", "ExecMainStartTimestamp": "Wed 2021-11-03 16:35:28 UTC", "ExecMainStartTimestampMonotonic": "21232312", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_errors=no ; start_time=[Wed 2021-11-03 16:35:28 UTC] ; stop_time=[n/a] ; pid=1205 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FileDescriptorStoreMax": "0", "GID": "984", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "L 2021-11-03T16:38:52.829 INFO:teuthology.task.ansible.out:imitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127269", "LimitNPROCSoft": "127269", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127269", "LimitSIGPENDINGSoft": "127269", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "MainPID": "1205", "MemoryAccounting": "yes", "MemoryCurrent": "679936", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Nice": "0", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "PIDFile": "/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "RemainAfterExit": "no", "Restart": "on-abort", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeMaxUSec": "infinity", "SecureBits": "0", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StatusErrno": "0", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203631", "TimeoutStar 2021-11-03T16:38:52.831 INFO:teuthology.task.ansible.out:tUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Type": "simple", "UID": "988", "UMask": "0022", "WatchdogTimestamp": "Wed 2021-11-03 16:35:28 UTC", "WatchdogTimestampMonotonic": "21232350", "WatchdogUSec": "0"}} 2021-11-03T16:38:52.849 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:52 +0000 (0:00:00.355) 0:02:04.809 **** 2021-11-03T16:38:53.054 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-11-03T16:38:53.056 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001795", "end": "2021-11-03 16:38:53.034004", "rc": 0, "start": "2021-11-03 16:38:53.032209", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2021-11-03T16:38:53.078 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:53 +0000 (0:00:00.229) 0:02:05.038 **** 2021-11-03T16:38:54.762 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-11-03T16:38:54.764 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-03T16:38:54.784 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:38:54 +0000 (0:00:01.705) 0:02:06.744 **** 2021-11-03T16:39:28.432 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-11-03T16:39:28.434 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: selinux-policy-targeted-3.14.3-67.el8_4.2.noarch", "Installed: selinux-policy-3.14.3-67.el8_4.2.noarch", "Removed: selinux-policy-3.14.3-67.el8.noarch", "Removed: selinux-policy-targeted-3.14.3-67.el8.noarch"]} 2021-11-03T16:39:28.459 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:39:28 +0000 (0:00:33.674) 0:02:40.419 **** 2021-11-03T16:39:29.144 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2021-11-03T16:39:29.167 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:39:29 +0000 (0:00:00.708) 0:02:41.128 **** 2021-11-03T16:39:33.931 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-11-03T16:39:33.933 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: selinux-policy-targeted-3.14.3-67.el8_4.2.noarch", "Installed: selinux-policy-3.14.3-67.el8_4.2.noarch", "Removed: selinux-policy-3.14.3-67.el8.noarch", "Removed: selinux-policy-targeted-3.14.3-67.el8.noarch"]} 2021-11-03T16:39:33.956 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:39:33 +0000 (0:00:04.788) 0:02:45.916 **** 2021-11-03T16:39:34.438 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-11-03T16:39:34.440 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2021-11-03T16:39:34.464 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:39:34 +0000 (0:00:00.508) 0:02:46.425 **** 2021-11-03T16:39:44.124 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-11-03T16:39:44.126 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:14.767002", "end": "2021-11-03 16:39:44.105539", "failed_when_result": false, "rc": 0, "start": "2021-11-03 16:39:29.338537", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2021-11-03T16:39:44.150 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:39:44 +0000 (0:00:09.685) 0:02:56.110 **** 2021-11-03T16:39:44.604 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-11-03T16:39:44.605 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2021-11-03T16:39:44.627 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:39:44 +0000 (0:00:00.477) 0:02:56.587 **** 2021-11-03T16:39:44.830 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-11-03T16:39:44.832 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.012951", "end": "2021-11-03 16:39:44.812275", "rc": 0, "start": "2021-11-03 16:39:44.799324", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-03T16:39:44.854 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:39:44 +0000 (0:00:00.226) 0:02:56.814 **** 2021-11-03T16:39:45.057 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-11-03T16:39:45.059 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.017397", "end": "2021-11-03 16:39:45.043264", "rc": 0, "start": "2021-11-03 16:39:45.025867", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-03T16:39:45.082 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:39:45 +0000 (0:00:00.228) 0:02:57.042 **** 2021-11-03T16:39:50.115 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-11-03T16:39:50.117 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:15.446142", "end": "2021-11-03 16:39:50.092910", "failed_when_result": false, "rc": 0, "start": "2021-11-03 16:39:34.646768", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2021-11-03T16:39:50.140 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:39:50 +0000 (0:00:05.057) 0:03:02.100 **** 2021-11-03T16:39:50.620 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-11-03T16:39:50.621 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2021-11-03T16:39:50.642 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:39:50 +0000 (0:00:00.502) 0:03:02.603 **** 2021-11-03T16:39:50.849 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-11-03T16:39:50.851 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.011839", "end": "2021-11-03 16:39:50.831869", "rc": 0, "start": "2021-11-03 16:39:50.820030", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-03T16:39:50.881 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:39:50 +0000 (0:00:00.238) 0:03:02.841 **** 2021-11-03T16:39:51.092 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-11-03T16:39:51.094 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.007782", "end": "2021-11-03 16:39:51.069459", "rc": 0, "start": "2021-11-03 16:39:51.061677", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-03T16:39:51.116 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:39:51 +0000 (0:00:00.235) 0:03:03.076 **** 2021-11-03T16:40:00.108 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-11-03T16:40:00.110 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:14.836207", "end": "2021-11-03 16:40:00.091148", "rc": 0, "start": "2021-11-03 16:39:45.254941", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-03T16:40:00.133 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:00 +0000 (0:00:09.017) 0:03:12.093 **** 2021-11-03T16:40:00.341 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-11-03T16:40:00.343 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2021-11-03T16:40:00.364 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:00 +0000 (0:00:00.230) 0:03:12.324 **** 2021-11-03T16:40:00.391 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-11-03T16:40:00.393 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "dash_stream": "", "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2021-11-03T16:40:00.426 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:00 +0000 (0:00:00.061) 0:03:12.386 **** 2021-11-03T16:40:00.467 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* ok: [smithi194.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-11-03T16:40:00.503 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:00 +0000 (0:00:00.077) 0:03:12.464 **** 2021-11-03T16:40:00.545 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-11-03T16:40:00.546 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"apache-arrow": {"baseurl": "https://apache.jfrog.io/artifactory/arrow/centos/8/$basearch", "enabled": 1, "gpgcheck": 1, "name": "Apache Arrow"}, "lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ceph/python3-asyncssh"], "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["redhat-lsb-core", "dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "packages_to_upgrade": ["libgcrypt"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist", "CentOS-PowerTools-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}, "CentOS-PowerTools": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/R 2021-11-03T16:40:00.548 INFO:teuthology.task.ansible.out:PM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "name": "CentOS-$releasever - PowerTools"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2021-11-03T16:40:00.583 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:00 +0000 (0:00:00.080) 0:03:12.544 **** 2021-11-03T16:40:00.624 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-11-03T16:40:00.626 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-11-03T16:40:00.647 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:00 +0000 (0:00:00.063) 0:03:12.607 **** 2021-11-03T16:40:00.831 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-11-03T16:40:00.833 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-11-03T16:40:00.854 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:00 +0000 (0:00:00.207) 0:03:12.815 **** 2021-11-03T16:40:01.049 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "gid": 1254, "name": "ubuntu", "state": "present", "system": false} 2021-11-03T16:40:01.072 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:01 +0000 (0:00:00.217) 0:03:13.032 **** 2021-11-03T16:40:01.098 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-11-03T16:40:01.100 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:01.122 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:01 +0000 (0:00:00.050) 0:03:13.082 **** 2021-11-03T16:40:01.149 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:01.171 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:01 +0000 (0:00:00.049) 0:03:13.132 **** 2021-11-03T16:40:01.389 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-11-03T16:40:01.391 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2021-11-03T16:40:01.414 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:01 +0000 (0:00:00.242) 0:03:13.374 **** 2021-11-03T16:40:01.942 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-11-03T16:40:01.944 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2021-11-03T16:40:01.967 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:01 +0000 (0:00:00.553) 0:03:13.927 **** 2021-11-03T16:40:02.005 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* ok: [smithi194.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi194"}, "changed": false} 2021-11-03T16:40:02.027 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:02 +0000 (0:00:00.060) 0:03:13.988 **** 2021-11-03T16:40:02.916 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ changed: [smithi194.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi194.front.sepia.ceph.com", "ansible_hostname": "smithi194", "ansible_nodename": "smithi194"}, "changed": true, "name": "smithi194"} 2021-11-03T16:40:02.939 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:02 +0000 (0:00:00.911) 0:03:14.900 **** 2021-11-03T16:40:03.397 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-11-03T16:40:03.399 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2021-11-03T16:40:03.420 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:03 +0000 (0:00:00.480) 0:03:15.381 **** 2021-11-03T16:40:03.879 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-11-03T16:40:03.883 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2021-11-03T16:40:03.904 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:03 +0000 (0:00:00.483) 0:03:15.864 **** 2021-11-03T16:40:04.456 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-11-03T16:40:04.458 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-11-03T16:40:04.479 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:04 +0000 (0:00:00.575) 0:03:16.439 **** 2021-11-03T16:40:04.947 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-11-03T16:40:04.949 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2021-11-03T16:40:04.971 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:04 +0000 (0:00:00.491) 0:03:16.931 **** 2021-11-03T16:40:05.172 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-11-03T16:40:05.174 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2021-11-03T16:40:05.195 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:05 +0000 (0:00:00.224) 0:03:17.156 **** 2021-11-03T16:40:05.391 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-11-03T16:40:05.392 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2021-11-03T16:40:05.414 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:05 +0000 (0:00:00.218) 0:03:17.374 **** 2021-11-03T16:40:05.634 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-11-03T16:40:05.636 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1254, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-11-03T16:40:05.657 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:05 +0000 (0:00:00.243) 0:03:17.617 **** 2021-11-03T16:40:05.659 INFO:teuthology.task.ansible.out: 2021-11-03T16:40:06.121 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-11-03T16:40:06.123 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2021-11-03T16:40:06.145 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:06 +0000 (0:00:00.488) 0:03:18.106 **** 2021-11-03T16:40:06.635 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-11-03T16:40:06.637 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2021-11-03T16:40:06.658 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:06 +0000 (0:00:00.512) 0:03:18.619 **** 2021-11-03T16:40:06.824 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:15.504779", "end": "2021-11-03 16:40:06.798369", "rc": 0, "start": "2021-11-03 16:39:51.293590", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-03T16:40:06.848 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:06 +0000 (0:00:00.189) 0:03:18.808 **** 2021-11-03T16:40:07.054 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-11-03T16:40:07.056 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2021-11-03T16:40:07.078 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:07 +0000 (0:00:00.229) 0:03:19.038 **** 2021-11-03T16:40:07.105 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** ok: [smithi026.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "dash_stream": "", "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2021-11-03T16:40:07.131 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:07 +0000 (0:00:00.053) 0:03:19.092 **** 2021-11-03T16:40:07.169 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-11-03T16:40:07.170 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-11-03T16:40:07.194 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:07 +0000 (0:00:00.061) 0:03:19.153 **** 2021-11-03T16:40:07.232 INFO:teuthology.task.ansible.out: 2021-11-03T16:40:07.234 INFO:teuthology.task.ansible.out:TASK [testnode : Including major version specific variables.] ****************** ok: [smithi026.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"apache-arrow": {"baseurl": "https://apache.jfrog.io/artifactory/arrow/centos/8/$basearch", "enabled": 1, "gpgcheck": 1, "name": "Apache Arrow"}, "lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ceph/python3-asyncssh"], "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["redhat-lsb-core", "dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "packages_to_upgrade": ["libgcrypt"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist", "CentOS-PowerTools-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}, "Cent 2021-11-03T16:40:07.236 INFO:teuthology.task.ansible.out:OS-PowerTools": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "name": "CentOS-$releasever - PowerTools"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2021-11-03T16:40:07.258 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:07 +0000 (0:00:00.064) 0:03:19.218 **** 2021-11-03T16:40:07.298 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [smithi026.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-11-03T16:40:07.322 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:07 +0000 (0:00:00.063) 0:03:19.282 **** 2021-11-03T16:40:07.516 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-11-03T16:40:07.517 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-11-03T16:40:07.538 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:07 +0000 (0:00:00.216) 0:03:19.498 **** 2021-11-03T16:40:07.733 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-11-03T16:40:07.735 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "gid": 1254, "name": "ubuntu", "state": "present", "system": false} 2021-11-03T16:40:07.756 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:07 +0000 (0:00:00.217) 0:03:19.716 **** 2021-11-03T16:40:07.787 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:07.815 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:07 +0000 (0:00:00.059) 0:03:19.775 **** 2021-11-03T16:40:07.848 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:07.877 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:07 +0000 (0:00:00.061) 0:03:19.837 **** 2021-11-03T16:40:08.110 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-11-03T16:40:08.112 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2021-11-03T16:40:08.133 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:08 +0000 (0:00:00.256) 0:03:20.094 **** 2021-11-03T16:40:08.681 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-11-03T16:40:08.683 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2021-11-03T16:40:08.704 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:08 +0000 (0:00:00.571) 0:03:20.665 **** 2021-11-03T16:40:08.743 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-11-03T16:40:08.744 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi026"}, "changed": false} 2021-11-03T16:40:08.765 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:08 +0000 (0:00:00.060) 0:03:20.725 **** 2021-11-03T16:40:09.148 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-11-03T16:40:09.150 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.301448", "end": "2021-11-03 16:40:09.131104", "rc": 0, "start": "2021-11-03 16:40:06.829656", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-03T16:40:09.176 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:09 +0000 (0:00:00.410) 0:03:21.136 **** 2021-11-03T16:40:09.205 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:09.226 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:09 +0000 (0:00:00.050) 0:03:21.187 **** 2021-11-03T16:40:09.264 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-03T16:40:09.266 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:09.287 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:09 +0000 (0:00:00.060) 0:03:21.247 **** 2021-11-03T16:40:09.324 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* 2021-11-03T16:40:09.326 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8_stream.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8_stream.yml", "skip_reason": "Conditional result was False"} 2021-11-03T16:40:09.347 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:09 +0000 (0:00:00.059) 0:03:21.307 **** 2021-11-03T16:40:09.385 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-11-03T16:40:09.387 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi026.front.sepia.ceph.com", "ansible_hostname": "smithi026", "ansible_nodename": "smithi026"}, "changed": true, "name": "smithi026"} 2021-11-03T16:40:09.409 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:09 +0000 (0:00:00.061) 0:03:21.369 **** 2021-11-03T16:40:09.847 INFO:teuthology.task.ansible.out: 2021-11-03T16:40:09.849 INFO:teuthology.task.ansible.out:TASK [testnode : Configure local mirrorlists] ********************************** ok: [smithi194.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2021-11-03T16:40:09.881 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-11-03T16:40:09.883 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2021-11-03T16:40:09.907 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:09 +0000 (0:00:00.497) 0:03:21.867 **** 2021-11-03T16:40:10.276 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-11-03T16:40:10.277 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "state": "file", "uid": 0} 2021-11-03T16:40:10.392 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-11-03T16:40:10.394 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2021-11-03T16:40:10.415 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:10 +0000 (0:00:00.508) 0:03:22.375 **** 2021-11-03T16:40:10.719 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** ok: [smithi194.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "state": "file", "uid": 0} 2021-11-03T16:40:10.993 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-11-03T16:40:10.995 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-11-03T16:40:11.021 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:11 +0000 (0:00:00.605) 0:03:22.981 **** 2021-11-03T16:40:11.165 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-11-03T16:40:11.166 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=CentOS-PowerTools-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "20107eac0ba9a84b318fa5f29b02a387051bff98", "dest": "/etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-PowerTools-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2021-11-03T16:40:11.194 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:11 +0000 (0:00:00.173) 0:03:23.154 **** 2021-11-03T16:40:11.506 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-11-03T16:40:11.507 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2021-11-03T16:40:11.533 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:11 +0000 (0:00:00.338) 0:03:23.493 **** 2021-11-03T16:40:11.666 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* ok: [smithi194.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2021-11-03T16:40:11.741 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-11-03T16:40:11.742 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2021-11-03T16:40:11.766 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:11 +0000 (0:00:00.233) 0:03:23.726 **** 2021-11-03T16:40:11.965 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-11-03T16:40:11.967 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2021-11-03T16:40:11.987 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:11 +0000 (0:00:00.221) 0:03:23.947 **** 2021-11-03T16:40:12.144 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-11-03T16:40:12.146 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'key': 'apache-arrow', 'value': {'name': 'Apache Arrow', 'baseurl': 'https://apache.jfrog.io/artifactory/arrow/centos/8/$basearch', 'enabled': 1, 'gpgcheck': 1}}) => {"ansible_loop_var": "item", "changed": true, "checksum": "86b924db6e383ddad921a207c09a708e6cca6a67", "dest": "/etc/yum.repos.d/apache-arrow.repo", "gid": 0, "group": "root", "item": {"key": "apache-arrow", "value": {"baseurl": "https://apache.jfrog.io/artifactory/arrow/centos/8/$basearch", "enabled": 1, "gpgcheck": 1, "name": "Apache Arrow"}}, "md5sum": "183d0889f7213a1e38c7f48965d7549e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 215, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1635957611.696647-26056-89838914646162/source", "state": "file", "uid": 0} 2021-11-03T16:40:12.171 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:12 +0000 (0:00:00.184) 0:03:24.131 **** 2021-11-03T16:40:12.220 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-11-03T16:40:12.223 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1254, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-11-03T16:40:12.244 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:12 +0000 (0:00:00.073) 0:03:24.205 **** 2021-11-03T16:40:12.649 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-11-03T16:40:12.650 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'key': 'CentOS-AppStream', 'value': {'name': 'CentOS-$releasever - AppStream', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2021-11-03T16:40:12.724 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-11-03T16:40:12.726 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2021-11-03T16:40:12.748 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:12 +0000 (0:00:00.503) 0:03:24.708 **** 2021-11-03T16:40:13.080 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-11-03T16:40:13.082 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'key': 'CentOS-Base', 'value': {'name': 'CentOS-$releasever - Base', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2021-11-03T16:40:13.228 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-11-03T16:40:13.230 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2021-11-03T16:40:13.252 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:13 +0000 (0:00:00.503) 0:03:25.212 **** 2021-11-03T16:40:13.502 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** ok: [smithi194.front.sepia.ceph.com] => (item={'key': 'CentOS-Extras', 'value': {'name': 'CentOS-$releasever - Extras', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2021-11-03T16:40:13.931 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'key': 'CentOS-PowerTools', 'value': {'name': 'CentOS-$releasever - PowerTools', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-PowerTools-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "76441d1028936932e965a46c12ad393f767201d3", "dest": "/etc/yum.repos.d/CentOS-PowerTools.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-PowerTools", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "name": "CentOS-$releasever - PowerTools"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-PowerTools.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 292, "state": "file", "uid": 0} 2021-11-03T16:40:13.960 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:13 +0000 (0:00:00.707) 0:03:25.920 **** 2021-11-03T16:40:14.429 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-11-03T16:40:14.432 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item=ceph/python3-asyncssh) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ceph/python3-asyncssh"], "delta": "0:00:00.267548", "end": "2021-11-03 16:40:14.409026", "item": "ceph/python3-asyncssh", "rc": 0, "start": "2021-11-03 16:40:14.141478", "stderr": "Enabling a Copr repository. Please note that this repository is not part\nof the main distribution, and quality may vary.\n\nThe Fedora Project does not exercise any power over the contents of\nthis repository beyond the rules outlined in the Copr FAQ at\n,\nand packages are not held to any quality or security level.\n\nPlease do not file bug reports about these packages in Fedora\nBugzilla. In case of problems, contact the owner of this repository.", "stderr_lines": ["Enabling a Copr repository. Please note that this repository is not part", "of the main distribution, and quality may vary.", "", "The Fedora Project does not exercise any power over the contents of", "this repository beyond the rules outlined in the Copr FAQ at", ",", "and packages are not held to any quality or security level.", "", "Please do not file bug reports about these packages in Fedora", "Bugzilla. In case of problems, contact the owner of this repository."], "stdout": "Repository successfully enabled.", "stdout_lines": ["Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} [WARNING]: Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'comma 2021-11-03T16:40:14.434 INFO:teuthology.task.ansible.out:nd_warnings=False' in ansible.cfg to get rid of this message. 2021-11-03T16:40:14.453 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:14 +0000 (0:00:00.493) 0:03:26.413 **** 2021-11-03T16:40:15.851 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.391364", "end": "2021-11-03 16:40:15.823216", "rc": 0, "start": "2021-11-03 16:40:13.431852", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-03T16:40:15.874 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:15 +0000 (0:00:01.421) 0:03:27.834 **** 2021-11-03T16:40:15.903 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ 2021-11-03T16:40:15.905 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:15.931 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:15 +0000 (0:00:00.056) 0:03:27.891 **** 2021-11-03T16:40:15.969 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-03T16:40:15.971 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:15.994 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:15 +0000 (0:00:00.063) 0:03:27.954 **** 2021-11-03T16:40:16.042 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* 2021-11-03T16:40:16.044 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8_stream.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8_stream.yml", "skip_reason": "Conditional result was False"} 2021-11-03T16:40:16.067 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:16 +0000 (0:00:00.073) 0:03:28.027 **** 2021-11-03T16:40:16.579 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-11-03T16:40:16.581 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2021-11-03T16:40:17.030 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "state": "file", "uid": 0} 2021-11-03T16:40:17.421 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-11-03T16:40:17.423 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-03T16:40:17.445 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:17 +0000 (0:00:01.378) 0:03:29.406 **** 2021-11-03T16:40:17.485 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-11-03T16:40:17.487 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "state": "file", "uid": 0} 2021-11-03T16:40:17.927 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=CentOS-PowerTools-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "20107eac0ba9a84b318fa5f29b02a387051bff98", "dest": "/etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-PowerTools-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2021-11-03T16:40:17.952 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:17 +0000 (0:00:00.506) 0:03:29.912 **** 2021-11-03T16:40:18.223 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-11-03T16:40:18.225 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": true, "item": "https://download.ceph.com/keys/release.asc"} 2021-11-03T16:40:18.455 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-11-03T16:40:18.457 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2021-11-03T16:40:18.696 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* changed: [smithi194.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": true, "item": "https://download.ceph.com/keys/autobuild.asc"} 2021-11-03T16:40:18.960 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-11-03T16:40:18.962 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'key': 'apache-arrow', 'value': {'name': 'Apache Arrow', 'baseurl': 'https://apache.jfrog.io/artifactory/arrow/centos/8/$basearch', 'enabled': 1, 'gpgcheck': 1}}) => {"ansible_loop_var": "item", "changed": true, "checksum": "86b924db6e383ddad921a207c09a708e6cca6a67", "dest": "/etc/yum.repos.d/apache-arrow.repo", "gid": 0, "group": "root", "item": {"key": "apache-arrow", "value": {"baseurl": "https://apache.jfrog.io/artifactory/arrow/centos/8/$basearch", "enabled": 1, "gpgcheck": 1, "name": "Apache Arrow"}}, "md5sum": "183d0889f7213a1e38c7f48965d7549e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 215, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1635957618.48388-26899-241592792822270/source", "state": "file", "uid": 0} 2021-11-03T16:40:18.986 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:18 +0000 (0:00:01.033) 0:03:30.946 **** 2021-11-03T16:40:19.477 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-11-03T16:40:19.479 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'key': 'CentOS-AppStream', 'value': {'name': 'CentOS-$releasever - AppStream', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2021-11-03T16:40:19.939 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'key': 'CentOS-Base', 'value': {'name': 'CentOS-$releasever - Base', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2021-11-03T16:40:20.200 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-11-03T16:40:20.202 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item=https://dist.apache.org/repos/dist/dev/arrow/KEYS) => {"ansible_loop_var": "item", "changed": true, "item": "https://dist.apache.org/repos/dist/dev/arrow/KEYS"} 2021-11-03T16:40:20.229 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:20 +0000 (0:00:01.241) 0:03:32.187 **** 2021-11-03T16:40:20.385 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-11-03T16:40:20.388 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'key': 'CentOS-Extras', 'value': {'name': 'CentOS-$releasever - Extras', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2021-11-03T16:40:20.632 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-11-03T16:40:20.634 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the yum module rather than running 'yum'. If you need to use command because yum is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "cmd": "yum clean all", "delta": "0:00:00.193666", "end": "2021-11-03 16:40:20.612825", "rc": 0, "start": "2021-11-03 16:40:20.419159", "stderr": "", "stderr_lines": [], "stdout": "78 files removed", "stdout_lines": ["78 files removed"]} 2021-11-03T16:40:20.659 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:20 +0000 (0:00:00.431) 0:03:32.619 **** 2021-11-03T16:40:20.699 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-03T16:40:20.701 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2021-11-03T16:40:20.722 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:20 +0000 (0:00:00.063) 0:03:32.682 **** 2021-11-03T16:40:20.761 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-11-03T16:40:20.763 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:20.784 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:20 +0000 (0:00:00.061) 0:03:32.744 **** 2021-11-03T16:40:20.822 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-11-03T16:40:20.824 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:20.851 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:20 +0000 (0:00:00.067) 0:03:32.811 **** 2021-11-03T16:40:20.860 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-11-03T16:40:20.862 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'key': 'CentOS-PowerTools', 'value': {'name': 'CentOS-$releasever - PowerTools', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-PowerTools-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "76441d1028936932e965a46c12ad393f767201d3", "dest": "/etc/yum.repos.d/CentOS-PowerTools.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-PowerTools", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "name": "CentOS-$releasever - PowerTools"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-PowerTools.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 292, "state": "file", "uid": 0} 2021-11-03T16:40:20.895 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:20 +0000 (0:00:00.043) 0:03:32.855 **** 2021-11-03T16:40:21.050 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-11-03T16:40:21.051 INFO:teuthology.task.ansible.out:fatal: [smithi194.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.007241", "end": "2021-11-03 16:40:21.028836", "msg": "non-zero return code", "rc": 1, "start": "2021-11-03 16:40:21.021595", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2021-11-03T16:40:21.075 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:21 +0000 (0:00:00.178) 0:03:33.034 **** 2021-11-03T16:40:21.113 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-11-03T16:40:21.115 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:21.136 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:21 +0000 (0:00:00.062) 0:03:33.097 **** 2021-11-03T16:40:21.405 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-11-03T16:40:21.407 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item=ceph/python3-asyncssh) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ceph/python3-asyncssh"], "delta": "0:00:00.302794", "end": "2021-11-03 16:40:21.387894", "item": "ceph/python3-asyncssh", "rc": 0, "start": "2021-11-03 16:40:21.085100", "stderr": "Enabling a Copr repository. Please note that this repository is not part\nof the main distribution, and quality may vary.\n\nThe Fedora Project does not exercise any power over the contents of\nthis repository beyond the rules outlined in the Copr FAQ at\n,\nand packages are not held to any quality or security level.\n\nPlease do not file bug reports about these packages in Fedora\nBugzilla. In case of problems, contact the owner of this repository.", "stderr_lines": ["Enabling a Copr repository. Please note that this repository is not part", "of the main distribution, and quality may vary.", "", "The Fedora Project does not exercise any power over the contents of", "this repository beyond the rules outlined in the Copr FAQ at", ",", "and packages are not held to any quality or security level.", "", "Please do not file bug reports about these packages in Fedora", "Bugzilla. In case of problems, contact the owner of this repository."], "stdout": "Repository successfully enabled.", "stdout_lines": ["Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} 2021-11-03T16:40:21.431 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:21 +0000 (0:00:00.294) 0:03:33.391 **** 2021-11-03T16:40:24.489 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-11-03T16:40:24.491 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-03T16:40:24.513 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:24 +0000 (0:00:03.081) 0:03:36.473 **** 2021-11-03T16:40:25.079 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-11-03T16:40:25.081 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": true, "item": "https://download.ceph.com/keys/release.asc"} 2021-11-03T16:40:25.539 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": true, "item": "https://download.ceph.com/keys/autobuild.asc"} 2021-11-03T16:40:27.393 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item=https://dist.apache.org/repos/dist/dev/arrow/KEYS) => {"ansible_loop_var": "item", "changed": true, "item": "https://dist.apache.org/repos/dist/dev/arrow/KEYS"} 2021-11-03T16:40:27.417 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:27 +0000 (0:00:02.904) 0:03:39.377 **** 2021-11-03T16:40:27.833 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-11-03T16:40:27.835 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "cmd": "yum clean all", "delta": "0:00:00.198271", "end": "2021-11-03 16:40:27.817782", "rc": 0, "start": "2021-11-03 16:40:27.619511", "stderr": "", "stderr_lines": [], "stdout": "78 files removed", "stdout_lines": ["78 files removed"]} 2021-11-03T16:40:27.856 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:27 +0000 (0:00:00.439) 0:03:39.816 **** 2021-11-03T16:40:27.894 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-03T16:40:27.896 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2021-11-03T16:40:27.917 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:27 +0000 (0:00:00.060) 0:03:39.877 **** 2021-11-03T16:40:27.954 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-11-03T16:40:27.955 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:27.976 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:27 +0000 (0:00:00.059) 0:03:39.937 **** 2021-11-03T16:40:28.014 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-11-03T16:40:28.016 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:28.037 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:28 +0000 (0:00:00.060) 0:03:39.997 **** 2021-11-03T16:40:28.242 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-11-03T16:40:28.244 INFO:teuthology.task.ansible.out:fatal: [smithi026.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.007588", "end": "2021-11-03 16:40:28.224707", "msg": "non-zero return code", "rc": 1, "start": "2021-11-03 16:40:28.217119", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2021-11-03T16:40:28.270 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:28 +0000 (0:00:00.232) 0:03:40.230 **** 2021-11-03T16:40:28.308 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:28.331 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:28 +0000 (0:00:00.060) 0:03:40.291 **** 2021-11-03T16:40:39.952 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-11-03T16:40:39.953 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64"]} 2021-11-03T16:40:39.988 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:39 +0000 (0:00:11.657) 0:03:51.948 **** 2021-11-03T16:40:42.572 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-11-03T16:40:42.574 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-10.el8.x86_64", "Removed: boost-random-1.66.0-10.el8.x86_64"]} 2021-11-03T16:40:42.598 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:42 +0000 (0:00:02.610) 0:03:54.559 **** 2021-11-03T16:40:47.440 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64"]} 2021-11-03T16:40:47.464 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:47 +0000 (0:00:04.865) 0:03:59.424 **** 2021-11-03T16:40:50.073 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-03T16:40:50.075 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: qemu-kvm-core-15:4.2.0-48.module_el8.4.0+885+5e18b468.3.x86_64", "Installed: qemu-img-15:4.2.0-48.module_el8.4.0+885+5e18b468.3.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:4.2.0-48.module_el8.4.0+885+5e18b468.3.x86_64", "Installed: boost-program-options-1.66.0-10.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: boost-random-1.66.0-10.el8.x86_64", "Installed: qemu-kvm-common-15:4.2.0-48.module_el8.4.0+885+5e18b468.3.x86_64", "Removed: qemu-kvm-core-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64", "Removed: qemu-img-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64", "Removed: qemu-kvm-common-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64"]} 2021-11-03T16:40:50.097 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:50 +0000 (0:00:02.633) 0:04:02.058 **** 2021-11-03T16:40:50.135 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-11-03T16:40:50.137 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:50.158 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:50 +0000 (0:00:00.061) 0:04:02.119 **** 2021-11-03T16:40:50.338 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-11-03T16:40:50.340 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-10.el8.x86_64", "Removed: boost-random-1.66.0-10.el8.x86_64"]} 2021-11-03T16:40:50.363 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:50 +0000 (0:00:00.204) 0:04:02.323 **** 2021-11-03T16:40:51.924 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-11-03T16:40:51.926 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-03T16:40:51.948 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:51 +0000 (0:00:01.585) 0:04:03.909 **** 2021-11-03T16:40:53.578 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-11-03T16:40:53.580 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-03T16:40:53.601 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:53 +0000 (0:00:01.652) 0:04:05.561 **** 2021-11-03T16:40:53.925 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveState": "inactive", "AllowedCPUs": "", "AllowedMemoryNodes": "", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "ControlPID": "0", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "DevicePolicy": "auto", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FileDescriptorStoreMax": "0", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", 2021-11-03T16:40:53.927 INFO:teuthology.task.ansible.out: "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127246", "LimitNPROCSoft": "127246", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127246", "LimitSIGPENDINGSoft": "127246", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Nice": "0", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "PermissionsStartOnly": "no", "RemainAfterExit": "no", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeMaxUSec": "infinity", "SecureBits": "0", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StatusErrno": "0", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "203593", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-03T16:40:53.947 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:53 +0000 (0:00:00.345) 0:04:05.907 **** 2021-11-03T16:40:54.257 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-11-03T16:40:54.259 INFO:teuthology.task.ansible.out:fatal: [smithi194.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2021-11-03T16:40:54.287 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:54 +0000 (0:00:00.339) 0:04:06.247 **** 2021-11-03T16:40:54.937 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-11-03T16:40:54.939 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2021-11-03T16:40:54.964 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:54 +0000 (0:00:00.677) 0:04:06.924 **** 2021-11-03T16:40:54.991 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-11-03T16:40:54.993 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:55.014 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:55 +0000 (0:00:00.050) 0:04:06.975 **** 2021-11-03T16:40:55.042 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-11-03T16:40:55.043 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:55.075 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:55 +0000 (0:00:00.060) 0:04:07.035 **** 2021-11-03T16:40:55.104 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:55.126 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:55 +0000 (0:00:00.051) 0:04:07.086 **** 2021-11-03T16:40:55.153 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-11-03T16:40:55.154 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:55.178 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:55 +0000 (0:00:00.052) 0:04:07.138 **** 2021-11-03T16:40:55.206 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-11-03T16:40:55.207 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:55.229 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:55 +0000 (0:00:00.050) 0:04:07.189 **** 2021-11-03T16:40:55.256 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-11-03T16:40:55.258 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:55.280 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:55 +0000 (0:00:00.051) 0:04:07.241 **** 2021-11-03T16:40:55.307 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-11-03T16:40:55.330 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:55 +0000 (0:00:00.049) 0:04:07.290 **** 2021-11-03T16:40:55.356 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-11-03T16:40:55.358 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:55.378 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:55 +0000 (0:00:00.047) 0:04:07.338 **** 2021-11-03T16:40:55.404 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-11-03T16:40:55.406 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:55.425 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:55 +0000 (0:00:00.047) 0:04:07.385 **** 2021-11-03T16:40:55.463 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-11-03T16:40:55.464 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi194.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-11-03T16:40:55.485 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:55 +0000 (0:00:00.059) 0:04:07.445 **** 2021-11-03T16:40:55.512 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:55.534 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:55 +0000 (0:00:00.049) 0:04:07.494 **** 2021-11-03T16:40:55.561 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-11-03T16:40:55.583 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:55 +0000 (0:00:00.049) 0:04:07.544 **** 2021-11-03T16:40:55.610 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:55.632 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:55 +0000 (0:00:00.048) 0:04:07.592 **** 2021-11-03T16:40:55.669 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:55.694 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:55 +0000 (0:00:00.061) 0:04:07.654 **** 2021-11-03T16:40:55.721 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-11-03T16:40:55.723 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:55.743 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:55 +0000 (0:00:00.048) 0:04:07.703 **** 2021-11-03T16:40:55.769 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-11-03T16:40:55.771 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:55.791 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:55 +0000 (0:00:00.048) 0:04:07.751 **** 2021-11-03T16:40:55.818 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-11-03T16:40:55.819 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:55.840 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:55 +0000 (0:00:00.048) 0:04:07.800 **** 2021-11-03T16:40:55.867 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-03T16:40:55.869 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:55.890 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:55 +0000 (0:00:00.049) 0:04:07.850 **** 2021-11-03T16:40:55.917 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-11-03T16:40:55.919 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:55.939 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:55 +0000 (0:00:00.049) 0:04:07.899 **** 2021-11-03T16:40:55.966 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-11-03T16:40:55.968 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:55.990 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:55 +0000 (0:00:00.050) 0:04:07.950 **** 2021-11-03T16:40:56.016 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-11-03T16:40:56.018 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:56.038 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:56 +0000 (0:00:00.048) 0:04:07.999 **** 2021-11-03T16:40:56.065 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-11-03T16:40:56.066 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:56.087 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:56 +0000 (0:00:00.048) 0:04:08.047 **** 2021-11-03T16:40:56.124 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-11-03T16:40:56.126 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:56.147 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:56 +0000 (0:00:00.059) 0:04:08.107 **** 2021-11-03T16:40:56.173 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-11-03T16:40:56.175 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:56.196 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:56 +0000 (0:00:00.049) 0:04:08.156 **** 2021-11-03T16:40:56.222 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-11-03T16:40:56.224 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:56.244 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:56 +0000 (0:00:00.048) 0:04:08.205 **** 2021-11-03T16:40:56.271 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-11-03T16:40:56.272 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:56.293 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:56 +0000 (0:00:00.048) 0:04:08.253 **** 2021-11-03T16:40:56.320 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-11-03T16:40:56.322 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:56.342 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:56 +0000 (0:00:00.049) 0:04:08.303 **** 2021-11-03T16:40:56.369 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-11-03T16:40:56.371 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:56.391 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:56 +0000 (0:00:00.048) 0:04:08.351 **** 2021-11-03T16:40:56.417 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-11-03T16:40:56.419 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:56.444 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:56 +0000 (0:00:00.052) 0:04:08.404 **** 2021-11-03T16:40:56.470 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-11-03T16:40:56.472 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:56.493 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:56 +0000 (0:00:00.048) 0:04:08.453 **** 2021-11-03T16:40:56.519 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-11-03T16:40:56.522 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:56.545 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:56 +0000 (0:00:00.051) 0:04:08.505 **** 2021-11-03T16:40:56.571 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-11-03T16:40:56.573 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:56.593 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:56 +0000 (0:00:00.049) 0:04:08.554 **** 2021-11-03T16:40:56.621 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:56.644 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:56 +0000 (0:00:00.050) 0:04:08.605 **** 2021-11-03T16:40:56.672 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:56.694 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:56 +0000 (0:00:00.050) 0:04:08.655 **** 2021-11-03T16:40:56.721 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-11-03T16:40:56.723 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:56.744 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:56 +0000 (0:00:00.049) 0:04:08.705 **** 2021-11-03T16:40:56.772 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-03T16:40:56.774 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:56.795 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:56 +0000 (0:00:00.050) 0:04:08.756 **** 2021-11-03T16:40:56.823 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-11-03T16:40:56.824 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:56.845 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:56 +0000 (0:00:00.050) 0:04:08.806 **** 2021-11-03T16:40:56.873 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-03T16:40:56.875 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:56.896 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:56 +0000 (0:00:00.050) 0:04:08.856 **** 2021-11-03T16:40:56.923 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-11-03T16:40:56.925 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:56.946 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:56 +0000 (0:00:00.050) 0:04:08.907 **** 2021-11-03T16:40:56.974 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-11-03T16:40:56.976 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:56.998 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:56 +0000 (0:00:00.051) 0:04:08.958 **** 2021-11-03T16:40:57.212 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2021-11-03T16:40:57.235 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:57 +0000 (0:00:00.236) 0:04:09.195 **** 2021-11-03T16:40:57.439 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-11-03T16:40:57.441 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-11-03T16:40:57.463 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:57 +0000 (0:00:00.228) 0:04:09.423 **** 2021-11-03T16:40:57.658 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-11-03T16:40:57.660 INFO:teuthology.task.ansible.out:[WARNING]: Cannot set fs attributes on a non-existent symlink target. follow should be set to False to avoid this. ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2021-11-03T16:40:57.682 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:57 +0000 (0:00:00.219) 0:04:09.642 **** 2021-11-03T16:40:57.710 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-11-03T16:40:57.711 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:57.736 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:57 +0000 (0:00:00.053) 0:04:09.696 **** 2021-11-03T16:40:57.774 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-11-03T16:40:57.776 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:57.798 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:57 +0000 (0:00:00.061) 0:04:09.758 **** 2021-11-03T16:40:57.826 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-11-03T16:40:57.828 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:57.848 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:57 +0000 (0:00:00.050) 0:04:09.809 **** 2021-11-03T16:40:57.885 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-11-03T16:40:57.887 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:57.911 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:57 +0000 (0:00:00.062) 0:04:09.871 **** 2021-11-03T16:40:57.938 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-11-03T16:40:57.939 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:57.961 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:57 +0000 (0:00:00.050) 0:04:09.921 **** 2021-11-03T16:40:57.989 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:58.012 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:58 +0000 (0:00:00.050) 0:04:09.972 **** 2021-11-03T16:40:58.050 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-11-03T16:40:58.052 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:58.073 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:58 +0000 (0:00:00.061) 0:04:10.033 **** 2021-11-03T16:40:58.101 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-11-03T16:40:58.103 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:58.124 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:58 +0000 (0:00:00.051) 0:04:10.084 **** 2021-11-03T16:40:58.152 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-11-03T16:40:58.153 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:58.176 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:58 +0000 (0:00:00.052) 0:04:10.137 **** 2021-11-03T16:40:58.205 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-11-03T16:40:58.207 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:58.230 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:58 +0000 (0:00:00.053) 0:04:10.191 **** 2021-11-03T16:40:58.260 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:58.284 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:58 +0000 (0:00:00.053) 0:04:10.244 **** 2021-11-03T16:40:58.314 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-11-03T16:40:58.316 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:58.349 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:58 +0000 (0:00:00.065) 0:04:10.309 **** 2021-11-03T16:40:58.377 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:58.399 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:58 +0000 (0:00:00.049) 0:04:10.359 **** 2021-11-03T16:40:58.427 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: qemu-kvm-core-15:4.2.0-48.module_el8.4.0+885+5e18b468.3.x86_64", "Installed: qemu-img-15:4.2.0-48.module_el8.4.0+885+5e18b468.3.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:4.2.0-48.module_el8.4.0+885+5e18b468.3.x86_64", "Installed: boost-program-options-1.66.0-10.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: boost-random-1.66.0-10.el8.x86_64", "Installed: qemu-kvm-common-15:4.2.0-48.module_el8.4.0+885+5e18b468.3.x86_64", "Removed: qemu-kvm-core-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64", "Removed: qemu-img-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64", "Removed: qemu-kvm-common-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64"]} TASK [testnode : Upload weekly kernel-clean crontab.] ************************** skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:58.456 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:58 +0000 (0:00:00.057) 0:04:10.416 **** 2021-11-03T16:40:58.478 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:58 +0000 (0:00:00.022) 0:04:10.438 **** 2021-11-03T16:40:58.496 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-11-03T16:40:58.498 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:58.519 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:58 +0000 (0:00:00.041) 0:04:10.480 **** 2021-11-03T16:40:58.526 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-11-03T16:40:58.528 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:58.551 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:58 +0000 (0:00:00.031) 0:04:10.512 **** 2021-11-03T16:40:58.579 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-11-03T16:40:58.580 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:58.601 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:58 +0000 (0:00:00.049) 0:04:10.561 **** 2021-11-03T16:40:58.627 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-11-03T16:40:58.629 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:58.651 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:58 +0000 (0:00:00.049) 0:04:10.611 **** 2021-11-03T16:40:58.679 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-11-03T16:40:58.681 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:58.702 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:58 +0000 (0:00:00.050) 0:04:10.662 **** 2021-11-03T16:40:58.729 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-11-03T16:40:58.731 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:58.752 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:58 +0000 (0:00:00.049) 0:04:10.712 **** 2021-11-03T16:40:58.789 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-11-03T16:40:58.791 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:58.816 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:58 +0000 (0:00:00.064) 0:04:10.777 **** 2021-11-03T16:40:58.845 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-11-03T16:40:58.847 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:58.872 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:58 +0000 (0:00:00.055) 0:04:10.832 **** 2021-11-03T16:40:58.901 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-11-03T16:40:58.903 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:58.925 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:58 +0000 (0:00:00.052) 0:04:10.885 **** 2021-11-03T16:40:58.964 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-03T16:40:58.966 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-11-03T16:40:58.987 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:58 +0000 (0:00:00.062) 0:04:10.947 **** 2021-11-03T16:40:59.025 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-11-03T16:40:59.026 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-11-03T16:40:59.036 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-11-03T16:40:59.047 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi194.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-11-03T16:40:59.058 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-11-03T16:40:59.069 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-11-03T16:40:59.071 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-11-03T16:40:59.095 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:59 +0000 (0:00:00.108) 0:04:11.056 **** 2021-11-03T16:40:59.314 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-11-03T16:40:59.316 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003581", "end": "2021-11-03 16:40:59.280130", "rc": 0, "start": "2021-11-03 16:40:59.276549", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/bin/teuthology-lock"]} 2021-11-03T16:40:59.340 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:59 +0000 (0:00:00.244) 0:04:11.300 **** 2021-11-03T16:40:59.368 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-11-03T16:40:59.371 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:59.398 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:59 +0000 (0:00:00.057) 0:04:11.358 **** 2021-11-03T16:40:59.439 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:59.462 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:59 +0000 (0:00:00.063) 0:04:11.422 **** 2021-11-03T16:40:59.489 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-11-03T16:40:59.491 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:59.511 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:59 +0000 (0:00:00.049) 0:04:11.472 **** 2021-11-03T16:40:59.539 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-11-03T16:40:59.541 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:40:59.568 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:40:59 +0000 (0:00:00.056) 0:04:11.528 **** 2021-11-03T16:41:00.275 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-11-03T16:41:00.277 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-03T16:41:00.299 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:00 +0000 (0:00:00.731) 0:04:12.259 **** 2021-11-03T16:41:01.189 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-03T16:41:01.213 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:01 +0000 (0:00:00.913) 0:04:13.173 **** 2021-11-03T16:41:01.262 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-11-03T16:41:01.264 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930249592832, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227111717, 'block_used': 12983391, 'inode_total': 61054976, 'inode_available': 60985864, 'inode_used': 69112, 'uuid': 'fcc12580-8f3b-4cec-aef7-e7427fa239b7'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227111717, "block_size": 4096, "block_total": 240095108, "block_used": 12983391, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985864, "inode_total": 61054976, "inode_used": 69112, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930249592832, "size_total": 983429562368, "uuid": "fcc12580-8f3b-4cec-aef7-e7427fa239b7"}} 2021-11-03T16:41:01.291 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:01 +0000 (0:00:00.078) 0:04:13.252 **** 2021-11-03T16:41:01.497 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-11-03T16:41:01.498 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005060", "end": "2021-11-03 16:41:01.481463", "rc": 0, "start": "2021-11-03 16:41:01.476403", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-03T16:41:01.520 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:01 +0000 (0:00:00.228) 0:04:13.480 **** 2021-11-03T16:41:01.560 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-11-03T16:41:01.562 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930249592832, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227111717, 'block_used': 12983391, 'inode_total': 61054976, 'inode_available': 60985864, 'inode_used': 69112, 'uuid': 'fcc12580-8f3b-4cec-aef7-e7427fa239b7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227111717, "block_size": 4096, "block_total": 240095108, "block_used": 12983391, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985864, "inode_total": 61054976, "inode_used": 69112, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930249592832, "size_total": 983429562368, "uuid": "fcc12580-8f3b-4cec-aef7-e7427fa239b7"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:01.596 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:01 +0000 (0:00:00.076) 0:04:13.556 **** 2021-11-03T16:41:01.625 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-11-03T16:41:01.646 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:01 +0000 (0:00:00.050) 0:04:13.607 **** 2021-11-03T16:41:02.030 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-11-03T16:41:02.032 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-03T16:41:02.054 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:02 +0000 (0:00:00.408) 0:04:14.015 **** 2021-11-03T16:41:02.387 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-11-03T16:41:02.389 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveState": "inactive", "AllowedCPUs": "", "AllowedMemoryNodes": "", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "ControlPID": "0", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "DevicePolicy": "auto", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FileDescriptorStoreMax": "0", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity 2021-11-03T16:41:02.390 INFO:teuthology.task.ansible.out:", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127269", "LimitNPROCSoft": "127269", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127269", "LimitSIGPENDINGSoft": "127269", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Nice": "0", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "PermissionsStartOnly": "no", "RemainAfterExit": "no", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeMaxUSec": "infinity", "SecureBits": "0", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StatusErrno": "0", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "203631", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-03T16:41:02.418 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:02 +0000 (0:00:00.363) 0:04:14.378 **** 2021-11-03T16:41:02.732 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ fatal: [smithi026.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2021-11-03T16:41:02.755 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:02 +0000 (0:00:00.336) 0:04:14.715 **** 2021-11-03T16:41:03.039 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2021-11-03T16:41:03.068 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:03 +0000 (0:00:00.312) 0:04:15.028 **** 2021-11-03T16:41:03.109 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:03.133 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:03 +0000 (0:00:00.065) 0:04:15.093 **** 2021-11-03T16:41:03.175 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:03.195 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:03 +0000 (0:00:00.062) 0:04:15.156 **** 2021-11-03T16:41:03.224 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:03.247 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:03 +0000 (0:00:00.052) 0:04:15.208 **** 2021-11-03T16:41:03.277 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:03.300 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:03 +0000 (0:00:00.052) 0:04:15.260 **** 2021-11-03T16:41:03.338 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-11-03T16:41:03.340 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:03.361 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:03 +0000 (0:00:00.061) 0:04:15.321 **** 2021-11-03T16:41:03.388 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-11-03T16:41:03.391 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:03.411 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:03 +0000 (0:00:00.049) 0:04:15.371 **** 2021-11-03T16:41:03.438 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-11-03T16:41:03.439 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-03T16:41:03.439 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-CaeLJ7mowNnaeQRIkTHQ9268EfTD4v8qFmAM66TXzZSUWUdaiwZ5w7igBArxZKHr'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.572890", "end": "2021-11-03 16:41:03.408608", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-CaeLJ7mowNnaeQRIkTHQ9268EfTD4v8qFmAM66TXzZSUWUdaiwZ5w7igBArxZKHr"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-03 16:41:01.835718", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-03T16:41:03.462 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:03 +0000 (0:00:00.051) 0:04:15.422 **** 2021-11-03T16:41:03.489 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-11-03T16:41:03.492 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:03.512 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:03 +0000 (0:00:00.049) 0:04:15.472 **** 2021-11-03T16:41:03.539 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-11-03T16:41:03.540 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:03.561 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:03 +0000 (0:00:00.049) 0:04:15.521 **** 2021-11-03T16:41:03.598 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-11-03T16:41:03.600 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-11-03T16:41:03.621 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:03 +0000 (0:00:00.060) 0:04:15.582 **** 2021-11-03T16:41:03.648 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-11-03T16:41:03.651 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:03.670 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:03 +0000 (0:00:00.048) 0:04:15.630 **** 2021-11-03T16:41:03.697 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-11-03T16:41:03.720 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:03 +0000 (0:00:00.049) 0:04:15.680 **** 2021-11-03T16:41:03.749 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:03.771 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:03 +0000 (0:00:00.050) 0:04:15.731 **** 2021-11-03T16:41:03.799 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:03.819 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:03 +0000 (0:00:00.048) 0:04:15.779 **** 2021-11-03T16:41:03.848 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-11-03T16:41:03.850 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:03.870 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:03 +0000 (0:00:00.050) 0:04:15.830 **** 2021-11-03T16:41:03.897 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:03.921 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:03 +0000 (0:00:00.050) 0:04:15.881 **** 2021-11-03T16:41:03.922 INFO:teuthology.task.ansible.out: 2021-11-03T16:41:03.952 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-11-03T16:41:03.954 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:03.981 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:03 +0000 (0:00:00.060) 0:04:15.941 **** 2021-11-03T16:41:04.012 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:04.037 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:04 +0000 (0:00:00.056) 0:04:15.998 **** 2021-11-03T16:41:04.065 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-11-03T16:41:04.067 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:04.088 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:04 +0000 (0:00:00.050) 0:04:16.048 **** 2021-11-03T16:41:04.115 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:04.137 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:04 +0000 (0:00:00.049) 0:04:16.097 **** 2021-11-03T16:41:04.164 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-11-03T16:41:04.166 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:04.187 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:04 +0000 (0:00:00.049) 0:04:16.147 **** 2021-11-03T16:41:04.215 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-11-03T16:41:04.217 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:04.248 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:04 +0000 (0:00:00.055) 0:04:16.203 **** 2021-11-03T16:41:04.286 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-11-03T16:41:04.288 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:04.335 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:04 +0000 (0:00:00.091) 0:04:16.294 **** 2021-11-03T16:41:04.365 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:04.387 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:04 +0000 (0:00:00.053) 0:04:16.347 **** 2021-11-03T16:41:04.415 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:04.447 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:04 +0000 (0:00:00.060) 0:04:16.408 **** 2021-11-03T16:41:04.485 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-11-03T16:41:04.487 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:04.514 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:04 +0000 (0:00:00.066) 0:04:16.475 **** 2021-11-03T16:41:04.543 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-11-03T16:41:04.545 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:04.566 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:04 +0000 (0:00:00.052) 0:04:16.527 **** 2021-11-03T16:41:04.594 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:04.616 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:04 +0000 (0:00:00.049) 0:04:16.576 **** 2021-11-03T16:41:04.654 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-11-03T16:41:04.656 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:04.677 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:04 +0000 (0:00:00.060) 0:04:16.637 **** 2021-11-03T16:41:04.684 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-03T16:41:04.685 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-q7hepB-MXyN-rjrl-saHf-5sGE-Nc8N-QB32PW', 'nvme-INTEL_SSDPEDMD400G4_CVFT6240002A400BGN', 'nvme-nvme.8086-43564654363234303030324134303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.050021", "end": "2021-11-03 16:41:04.648648", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-q7hepB-MXyN-rjrl-saHf-5sGE-Nc8N-QB32PW", "nvme-INTEL_SSDPEDMD400G4_CVFT6240002A400BGN", "nvme-nvme.8086-43564654363234303030324134303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-03 16:41:03.598627", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2021-11-03T16:41:04.687 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-03T16:41:04.707 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:04.729 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:04 +0000 (0:00:00.052) 0:04:16.690 **** 2021-11-03T16:41:04.757 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-11-03T16:41:04.758 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:04.780 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:04 +0000 (0:00:00.049) 0:04:16.739 **** 2021-11-03T16:41:04.808 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:04.829 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:04 +0000 (0:00:00.050) 0:04:16.789 **** 2021-11-03T16:41:04.867 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-11-03T16:41:04.869 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:04.890 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:04 +0000 (0:00:00.060) 0:04:16.850 **** 2021-11-03T16:41:04.918 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-11-03T16:41:04.919 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:04.944 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:04 +0000 (0:00:00.054) 0:04:16.904 **** 2021-11-03T16:41:04.973 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:04.998 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:04 +0000 (0:00:00.050) 0:04:16.955 **** 2021-11-03T16:41:05.034 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-03T16:41:05.038 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:05.057 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:05 +0000 (0:00:00.062) 0:04:17.017 **** 2021-11-03T16:41:05.084 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:05.107 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:05 +0000 (0:00:00.049) 0:04:17.067 **** 2021-11-03T16:41:05.135 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:05.157 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:05 +0000 (0:00:00.050) 0:04:17.118 **** 2021-11-03T16:41:05.185 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:05.209 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:05 +0000 (0:00:00.051) 0:04:17.169 **** 2021-11-03T16:41:05.239 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-11-03T16:41:05.241 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:05.261 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:05 +0000 (0:00:00.052) 0:04:17.221 **** 2021-11-03T16:41:05.486 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-11-03T16:41:05.488 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2021-11-03T16:41:05.509 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:05 +0000 (0:00:00.248) 0:04:17.470 **** 2021-11-03T16:41:05.735 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-11-03T16:41:05.736 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-11-03T16:41:05.757 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:05 +0000 (0:00:00.247) 0:04:17.717 **** 2021-11-03T16:41:05.902 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-03T16:41:05.904 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-CaeLJ7mowNnaeQRIkTHQ9268EfTD4v8qSvKdmBPFrqOIv7XadYpJ6IOjbFefidHf'], 'uuids': ['7709c17b-7294-48a8-9422-87726d4f03ee'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.039314", "end": "2021-11-03 16:41:05.876943", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-CaeLJ7mowNnaeQRIkTHQ9268EfTD4v8qSvKdmBPFrqOIv7XadYpJ6IOjbFefidHf"], "labels": [], "masters": [], "uuids": ["7709c17b-7294-48a8-9422-87726d4f03ee"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-03 16:41:04.837629", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-03T16:41:05.970 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2021-11-03T16:41:05.992 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:05 +0000 (0:00:00.235) 0:04:17.953 **** 2021-11-03T16:41:06.021 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:06.044 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:06 +0000 (0:00:00.052) 0:04:18.005 **** 2021-11-03T16:41:06.074 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:06.096 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:06 +0000 (0:00:00.051) 0:04:18.057 **** 2021-11-03T16:41:06.124 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-11-03T16:41:06.125 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:06.146 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:06 +0000 (0:00:00.050) 0:04:18.107 **** 2021-11-03T16:41:06.174 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-11-03T16:41:06.176 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:06.198 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:06 +0000 (0:00:00.050) 0:04:18.158 **** 2021-11-03T16:41:06.226 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-11-03T16:41:06.228 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:06.252 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:06 +0000 (0:00:00.054) 0:04:18.212 **** 2021-11-03T16:41:06.280 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-11-03T16:41:06.282 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:06.302 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:06 +0000 (0:00:00.050) 0:04:18.263 **** 2021-11-03T16:41:06.341 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:06.368 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:06 +0000 (0:00:00.065) 0:04:18.329 **** 2021-11-03T16:41:06.397 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-11-03T16:41:06.399 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:06.421 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:06 +0000 (0:00:00.052) 0:04:18.381 **** 2021-11-03T16:41:06.448 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-11-03T16:41:06.450 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:06.470 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:06 +0000 (0:00:00.049) 0:04:18.431 **** 2021-11-03T16:41:06.497 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-11-03T16:41:06.499 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:06.528 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:06 +0000 (0:00:00.057) 0:04:18.488 **** 2021-11-03T16:41:06.557 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:06.579 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:06 +0000 (0:00:00.051) 0:04:18.540 **** 2021-11-03T16:41:06.607 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-11-03T16:41:06.609 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:06.630 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:06 +0000 (0:00:00.050) 0:04:18.590 **** 2021-11-03T16:41:06.659 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:06.681 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:06 +0000 (0:00:00.050) 0:04:18.641 **** 2021-11-03T16:41:06.708 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-11-03T16:41:06.710 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:06.730 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:06 +0000 (0:00:00.049) 0:04:18.690 **** 2021-11-03T16:41:06.757 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-11-03T16:41:06.759 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:06.779 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:06 +0000 (0:00:00.049) 0:04:18.740 **** 2021-11-03T16:41:06.807 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-11-03T16:41:06.809 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:06.829 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:06 +0000 (0:00:00.050) 0:04:18.790 **** 2021-11-03T16:41:06.858 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-11-03T16:41:06.860 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:06.882 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:06 +0000 (0:00:00.052) 0:04:18.842 **** 2021-11-03T16:41:06.910 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-11-03T16:41:06.912 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:06.933 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:06 +0000 (0:00:00.051) 0:04:18.893 **** 2021-11-03T16:41:06.961 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-11-03T16:41:06.963 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:06.984 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:06 +0000 (0:00:00.051) 0:04:18.945 **** 2021-11-03T16:41:07.013 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:07.035 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:07 +0000 (0:00:00.050) 0:04:18.995 **** 2021-11-03T16:41:07.062 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-11-03T16:41:07.064 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:07.087 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:07 +0000 (0:00:00.051) 0:04:19.047 **** 2021-11-03T16:41:07.116 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-11-03T16:41:07.118 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:07.140 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:07 +0000 (0:00:00.053) 0:04:19.100 **** 2021-11-03T16:41:07.148 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-03T16:41:07.149 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-CaeLJ7mowNnaeQRIkTHQ9268EfTD4v8qoFoybrvpPAxqT04s4bWNE7IDEQR47cH3'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.049656", "end": "2021-11-03 16:41:07.110869", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-CaeLJ7mowNnaeQRIkTHQ9268EfTD4v8qoFoybrvpPAxqT04s4bWNE7IDEQR47cH3"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-03 16:41:06.061213", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-03T16:41:07.171 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-03T16:41:07.173 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-11-03T16:41:07.193 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:07 +0000 (0:00:00.053) 0:04:19.154 **** 2021-11-03T16:41:07.242 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-11-03T16:41:07.244 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-11-03T16:41:07.425 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-11-03T16:41:07.435 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-11-03T16:41:07.446 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-11-03T16:41:07.457 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-11-03T16:41:07.458 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-11-03T16:41:07.468 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-11-03T16:41:07.493 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:07 +0000 (0:00:00.299) 0:04:19.454 **** 2021-11-03T16:41:07.689 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-11-03T16:41:07.691 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003227", "end": "2021-11-03 16:41:07.665106", "rc": 0, "start": "2021-11-03 16:41:07.661879", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/bin/teuthology-lock"]} 2021-11-03T16:41:07.714 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:07 +0000 (0:00:00.221) 0:04:19.675 **** 2021-11-03T16:41:07.752 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:07.777 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:07 +0000 (0:00:00.063) 0:04:19.738 **** 2021-11-03T16:41:07.805 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:07.828 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:07 +0000 (0:00:00.050) 0:04:19.788 **** 2021-11-03T16:41:07.856 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-11-03T16:41:07.858 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:07.878 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:07 +0000 (0:00:00.050) 0:04:19.839 **** 2021-11-03T16:41:07.905 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-11-03T16:41:07.907 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:07.928 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:07 +0000 (0:00:00.049) 0:04:19.888 **** 2021-11-03T16:41:08.374 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-03T16:41:08.376 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-CaeLJ7mowNnaeQRIkTHQ9268EfTD4v8qGrgtbpaWnpHHzllqthV9quB9YIYgnlDL'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.050245", "end": "2021-11-03 16:41:08.344394", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-CaeLJ7mowNnaeQRIkTHQ9268EfTD4v8qGrgtbpaWnpHHzllqthV9quB9YIYgnlDL"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-03 16:41:07.294149", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-03T16:41:08.377 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM 2021-11-03T16:41:08.379 INFO:teuthology.task.ansible.out:0033-9ZM173_Z1W5XNHZ', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XNHZ', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XNHZ', 'scsi-35000c50092941eb0', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XNHZ', 'wwn-0x5000c50092941eb0'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XNHZ', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50092941eb0', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XNHZ-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XNHZ-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XNHZ-part1', 'scsi-35000c50092941eb0-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XNHZ-part1', 'wwn-0x5000c50092941eb0-part1'], 'uuids': ['fcc12580-8f3b-4cec-aef7-e7427fa239b7'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': 'fcc12580-8f3b-4cec-aef7-e7427fa239b7', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XNHZ", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XNHZ", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XNHZ", "scsi-35000c50092941eb0", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XNHZ", "wwn-0x5000c50092941eb0"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XNHZ-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XNHZ-part1", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XNHZ-part1", "scsi-35000c50092941eb0-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XNHZ-part1", "wwn-0x5000c50092941eb0-part 2021-11-03T16:41:08.381 INFO:teuthology.task.ansible.out:1"], "labels": [], "masters": [], "uuids": ["fcc12580-8f3b-4cec-aef7-e7427fa239b7"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "fcc12580-8f3b-4cec-aef7-e7427fa239b7"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XNHZ", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092941eb0"}}, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:09.627 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-CaeLJ7mowNnaeQRIkTHQ9268EfTD4v8qrCQfjY2lLs1unAvMgzjxvNDmDmr9orlI'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.051224", "end": "2021-11-03 16:41:09.601902", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-CaeLJ7mowNnaeQRIkTHQ9268EfTD4v8qrCQfjY2lLs1unAvMgzjxvNDmDmr9orlI"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-03 16:41:08.550678", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-03T16:41:09.661 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:09 +0000 (0:00:01.733) 0:04:21.622 **** 2021-11-03T16:41:09.669 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-11-03T16:41:09.670 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-03T16:41:09.695 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:09 +0000 (0:00:00.033) 0:04:21.655 **** 2021-11-03T16:41:09.994 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-11-03T16:41:09.996 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930249474048, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227111688, 'block_used': 12983420, 'inode_total': 61054976, 'inode_available': 60985860, 'inode_used': 69116, 'uuid': 'fcc12580-8f3b-4cec-aef7-e7427fa239b7'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227111688, "block_size": 4096, "block_total": 240095108, "block_used": 12983420, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985860, "inode_total": 61054976, "inode_used": 69116, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930249474048, "size_total": 983429562368, "uuid": "fcc12580-8f3b-4cec-aef7-e7427fa239b7"}} 2021-11-03T16:41:10.018 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:10 +0000 (0:00:00.322) 0:04:21.978 **** 2021-11-03T16:41:10.202 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-03T16:41:10.204 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-CaeLJ7mowNnaeQRIkTHQ9268EfTD4v8qFmAM66TXzZSUWUdaiwZ5w7igBArxZKHr'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.143956", "end": "2021-11-03 16:41:10.180153", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-CaeLJ7mowNnaeQRIkTHQ9268EfTD4v8qFmAM66TXzZSUWUdaiwZ5w7igBArxZKHr"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-03 16:41:10.036197", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.141227 s, 817 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.141227 s, 817 MB/s"], "stdout": "", "stdout_lines": []} 2021-11-03T16:41:10.225 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005301", "end": "2021-11-03 16:41:10.207011", "rc": 0, "start": "2021-11-03 16:41:10.201710", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-03T16:41:10.247 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:10 +0000 (0:00:00.229) 0:04:22.208 **** 2021-11-03T16:41:10.284 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-11-03T16:41:10.286 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930249474048, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227111688, 'block_used': 12983420, 'inode_total': 61054976, 'inode_available': 60985860, 'inode_used': 69116, 'uuid': 'fcc12580-8f3b-4cec-aef7-e7427fa239b7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227111688, "block_size": 4096, "block_total": 240095108, "block_used": 12983420, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985860, "inode_total": 61054976, "inode_used": 69116, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930249474048, "size_total": 983429562368, "uuid": "fcc12580-8f3b-4cec-aef7-e7427fa239b7"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:10.307 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:10 +0000 (0:00:00.059) 0:04:22.267 **** 2021-11-03T16:41:10.335 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-11-03T16:41:10.357 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:10 +0000 (0:00:00.050) 0:04:22.318 **** 2021-11-03T16:41:10.416 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-03T16:41:10.417 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-q7hepB-MXyN-rjrl-saHf-5sGE-Nc8N-QB32PW', 'nvme-INTEL_SSDPEDMD400G4_CVFT6240002A400BGN', 'nvme-nvme.8086-43564654363234303030324134303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.038597", "end": "2021-11-03 16:41:10.390626", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-q7hepB-MXyN-rjrl-saHf-5sGE-Nc8N-QB32PW", "nvme-INTEL_SSDPEDMD400G4_CVFT6240002A400BGN", "nvme-nvme.8086-43564654363234303030324134303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-03 16:41:10.352029", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.035958 s, 3.2 GB/s", "stde 2021-11-03T16:41:10.419 INFO:teuthology.task.ansible.out:rr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.035958 s, 3.2 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-03T16:41:10.762 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-CaeLJ7mowNnaeQRIkTHQ9268EfTD4v8qSvKdmBPFrqOIv7XadYpJ6IOjbFefidHf'], 'uuids': ['7709c17b-7294-48a8-9422-87726d4f03ee'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.153497", "end": "2021-11-03 16:41:10.738811", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-CaeLJ7mowNnaeQRIkTHQ9268EfTD4v8qSvKdmBPFrqOIv7XadYpJ6IOjbFefidHf"], "labels": [], "masters": [], "uuids": ["7709c17b-7294-48a8-9422-87726d4f03ee"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-03 16:41:10.585314", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.150914 s, 764 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.150914 s, 764 MB/s"], "stdout": "", "stdout_lines": []} 2021-11-03T16:41:11.075 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-CaeLJ7mowNnaeQRIkTHQ9268EfTD4v8qoFoybrvpPAxqT04s4bWNE7IDEQR47cH3'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.143508", "end": "2021-11-03 16:41:11.053593", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-CaeLJ7mowNnaeQRIkTHQ9268EfTD4v8qoFoybrvpPAxqT04s4bWNE7IDEQR47cH3"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-03 16:41:10.910085", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.140883 s, 819 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.140883 s, 819 MB/s"], "stdout": "", "stdout_lines": []} 2021-11-03T16:41:11.397 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-CaeLJ7mowNnaeQRIkTHQ9268EfTD4v8qGrgtbpaWnpHHzllqthV9quB9YIYgnlDL'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.146958", "end": "2021-11-03 16:41:11.369961", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-CaeLJ7mowNnaeQRIkTHQ9268EfTD4v8qGrgtbpaWnpHHzllqthV9quB9YIYgnlDL"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-03 16:41:11.223003", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.144314 s, 799 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.144314 s, 799 MB/s"], "stdout": "", "stdout_lines": []} 2021-11-03T16:41:11.399 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XNHZ', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XNHZ', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XNHZ', 'scsi-35000c50092941eb0', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XNHZ', 'wwn-0x5000c50092941eb0'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XNHZ', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50092941eb0', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XNHZ-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XNHZ-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XNHZ-part1', 'scsi-35000c50092941eb0-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XNHZ-part1', 'wwn-0x5000c50092941eb0-part1'], 'uuids': ['fcc12580-8f3b-4cec-aef7-e7427fa239b7'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': 'fcc12580-8f3b-4cec-aef7-e7427fa239b7', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XNHZ", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XNHZ", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XNHZ", "scsi-35000c50092941eb0", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XNHZ", "wwn-0x5000c50092941eb0"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XNHZ-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XNHZ-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2021-11-03T16:41:11.400 INFO:teuthology.task.ansible.out:Z1W5XNHZ-part1", "scsi-35000c50092941eb0-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XNHZ-part1", "wwn-0x5000c50092941eb0-part1"], "labels": [], "masters": [], "uuids": ["fcc12580-8f3b-4cec-aef7-e7427fa239b7"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "fcc12580-8f3b-4cec-aef7-e7427fa239b7"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XNHZ", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092941eb0"}}, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:11.721 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-CaeLJ7mowNnaeQRIkTHQ9268EfTD4v8qrCQfjY2lLs1unAvMgzjxvNDmDmr9orlI'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.144514", "end": "2021-11-03 16:41:11.695707", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-CaeLJ7mowNnaeQRIkTHQ9268EfTD4v8qrCQfjY2lLs1unAvMgzjxvNDmDmr9orlI"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-03 16:41:11.551193", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.141789 s, 813 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.141789 s, 813 MB/s"], "stdout": "", "stdout_lines": []} 2021-11-03T16:41:11.752 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:11 +0000 (0:00:01.394) 0:04:23.713 **** 2021-11-03T16:41:11.988 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-11-03T16:41:11.990 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.048823", "end": "2021-11-03 16:41:11.968359", "rc": 0, "start": "2021-11-03 16:41:11.919536", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-03T16:41:12.010 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:12 +0000 (0:00:00.258) 0:04:23.971 **** 2021-11-03T16:41:12.089 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-03T16:41:12.094 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-7JCbcfHqPne3pbXLWTa8Di0vVS9J17srDB2PpQe6fh7IF0Xfdc3gXh3L07Axjv4b'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.507051", "end": "2021-11-03 16:41:12.061819", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-7JCbcfHqPne3pbXLWTa8Di0vVS9J17srDB2PpQe6fh7IF0Xfdc3gXh3L07Axjv4b"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-03 16:41:10.554768", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-03T16:41:12.242 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.042696", "end": "2021-11-03 16:41:12.218357", "rc": 0, "start": "2021-11-03 16:41:12.175661", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-03T16:41:12.265 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:12 +0000 (0:00:00.254) 0:04:24.225 **** 2021-11-03T16:41:12.293 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-11-03T16:41:12.317 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:12 +0000 (0:00:00.052) 0:04:24.277 **** 2021-11-03T16:41:12.344 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-11-03T16:41:12.346 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:12.369 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:12 +0000 (0:00:00.051) 0:04:24.329 **** 2021-11-03T16:41:12.395 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-11-03T16:41:12.397 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:12.418 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:12 +0000 (0:00:00.049) 0:04:24.379 **** 2021-11-03T16:41:12.445 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-11-03T16:41:12.447 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:12.471 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:12 +0000 (0:00:00.052) 0:04:24.431 **** 2021-11-03T16:41:12.498 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-11-03T16:41:12.499 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:12.520 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:12 +0000 (0:00:00.049) 0:04:24.481 **** 2021-11-03T16:41:12.711 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi194.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-03T16:41:12.734 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:12 +0000 (0:00:00.213) 0:04:24.694 **** 2021-11-03T16:41:12.783 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-11-03T16:41:12.785 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930249592832, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227111717, 'block_used': 12983391, 'inode_total': 61054976, 'inode_available': 60985864, 'inode_used': 69112, 'uuid': 'fcc12580-8f3b-4cec-aef7-e7427fa239b7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227111717, "block_size": 4096, "block_total": 240095108, "block_used": 12983391, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985864, "inode_total": 61054976, "inode_used": 69112, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930249592832, "size_total": 983429562368, "uuid": "fcc12580-8f3b-4cec-aef7-e7427fa239b7"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:12.807 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:12 +0000 (0:00:00.072) 0:04:24.767 **** 2021-11-03T16:41:12.835 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:12.859 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:12 +0000 (0:00:00.051) 0:04:24.819 **** 2021-11-03T16:41:12.897 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-03T16:41:12.899 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:12.921 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:12 +0000 (0:00:00.061) 0:04:24.881 **** 2021-11-03T16:41:12.949 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-03T16:41:12.951 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:12.972 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:12 +0000 (0:00:00.050) 0:04:24.932 **** 2021-11-03T16:41:13.010 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:13.033 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:13 +0000 (0:00:00.060) 0:04:24.993 **** 2021-11-03T16:41:13.060 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-11-03T16:41:13.061 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:13.083 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:13 +0000 (0:00:00.050) 0:04:25.043 **** 2021-11-03T16:41:13.120 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-11-03T16:41:13.122 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:13.143 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:13 +0000 (0:00:00.060) 0:04:25.103 **** 2021-11-03T16:41:13.412 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi026.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-gN1EEh-LhN7-Cecg-MVGF-Hdhj-BSHF-sHbNSF', 'nvme-INTEL_SSDPED1D480GA_PHMB74760020480DGN', 'nvme-nvme.8086-50484d42373437363030323034383044474e-494e54454c2053534450454431443438304741-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPED1D480GA', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '937703088', 'sectorsize': '512', 'size': '447.13 GB', 'host': 'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.124801", "end": "2021-11-03 16:41:13.384398", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-gN1EEh-LhN7-Cecg-MVGF-Hdhj-BSHF-sHbNSF", "nvme-INTEL_SSDPED1D480GA_PHMB74760020480DGN", "nvme-nvme.8086-50484d42373437363030323034383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-03 16:41:12.259597", "stderr": "", "stderr_lines": [], 2021-11-03T16:41:13.414 INFO:teuthology.task.ansible.out: "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-03T16:41:13.666 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-11-03T16:41:13.668 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-11-03T16:41:13.700 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:13 +0000 (0:00:00.557) 0:04:25.660 **** 2021-11-03T16:41:14.188 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-03T16:41:14.190 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-03T16:41:14.532 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-03T16:41:14.648 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-03T16:41:14.650 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-7JCbcfHqPne3pbXLWTa8Di0vVS9J17sr5z3FVE0jAQYMeIdCSM4ADGrSx9ctadfr'], 'uuids': ['278ac7fc-7988-4548-b45b-069fce932ca1'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.045512", "end": "2021-11-03 16:41:14.626143", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-7JCbcfHqPne3pbXLWTa8Di0vVS9J17sr5z3FVE0jAQYMeIdCSM4ADGrSx9ctadfr"], "labels": [], "masters": [], "uuids": ["278ac7fc-7988-4548-b45b-069fce932ca1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-03 16:41:13.580631", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-03T16:41:14.869 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-03T16:41:14.871 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-03T16:41:15.214 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-03T16:41:15.551 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-03T16:41:15.575 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:15 +0000 (0:00:01.874) 0:04:27.535 **** 2021-11-03T16:41:15.779 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-11-03T16:41:15.781 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-11-03T16:41:15.803 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:15 +0000 (0:00:00.227) 0:04:27.763 **** 2021-11-03T16:41:16.017 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-03T16:41:16.019 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-03T16:41:16.061 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi026.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-7JCbcfHqPne3pbXLWTa8Di0vVS9J17srW2c1wByj5M5mL2rgT0nYjAmNy3KpshoT'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.212472", "end": "2021-11-03 16:41:16.035385", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-7JCbcfHqPne3pbXLWTa8Di0vVS9J17srW2c1wByj5M5mL2rgT0nYjAmNy3KpshoT"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-03 16:41:14.822913", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-03T16:41:16.187 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-03T16:41:16.189 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-03T16:41:16.365 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-03T16:41:16.553 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-03T16:41:16.564 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:16.600 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:16 +0000 (0:00:00.797) 0:04:28.560 **** 2021-11-03T16:41:16.629 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:16.656 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:16 +0000 (0:00:00.056) 0:04:28.617 **** 2021-11-03T16:41:16.695 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:16.719 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:16 +0000 (0:00:00.062) 0:04:28.679 **** 2021-11-03T16:41:16.912 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-11-03T16:41:16.914 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-11-03T16:41:16.940 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:16 +0000 (0:00:00.220) 0:04:28.900 **** 2021-11-03T16:41:16.977 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-11-03T16:41:16.979 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-11-03T16:41:17.006 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:17 +0000 (0:00:00.066) 0:04:28.966 **** 2021-11-03T16:41:17.307 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-03T16:41:17.309 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-7JCbcfHqPne3pbXLWTa8Di0vVS9J17srORcAmPWeuc1oBlAMqSW05mwAw030L0YQ'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.050534", "end": "2021-11-03 16:41:17.282107", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-7JCbcfHqPne3pbXLWTa8Di0vVS9J17srORcAmPWeuc1oBlAMqSW05mwAw030L0YQ"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-03 16:41:16.231573", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-03T16:41:17.320 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4H3KL', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W4H3KL', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W4H3KL', 'scsi-35000c500871b4821', 'scsi-SATA_ST1000NM0033-9ZM_Z1W4H3KL', 'wwn-0x5000c500871b4821'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W4H3KL', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c500871b4821', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4H3KL-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W4H3KL-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W4H3KL-part1', 'scsi-35000c500871b4821-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W4H3KL-part1', 'wwn-0x5000c500871b4821-part1'], 'uuids': ['fcc12580-8f3b-4cec-aef7-e7427fa239b7'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': 'fcc12580-8f3b-4cec-aef7-e7427fa239b7', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4H3KL", "scsi-0ATA_ST1000NM0033-9ZM_Z1W4H3KL", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W4H3KL", "scsi-35000c500871b4821", "scsi-SATA_ST1000NM0033-9ZM_Z1W4H3KL", "wwn-0x5000c500871b4821"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4H3KL-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W4H3KL-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2021-11-03T16:41:17.322 INFO:teuthology.task.ansible.out:Z1W4H3KL-part1", "scsi-35000c500871b4821-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W4H3KL-part1", "wwn-0x5000c500871b4821-part1"], "labels": [], "masters": [], "uuids": ["fcc12580-8f3b-4cec-aef7-e7427fa239b7"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "fcc12580-8f3b-4cec-aef7-e7427fa239b7"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4H3KL", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871b4821"}}, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:17.374 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi194.front.sepia.ceph.com] => {"changed": true} 2021-11-03T16:41:17.399 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:17 +0000 (0:00:00.393) 0:04:29.359 **** 2021-11-03T16:41:17.794 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-11-03T16:41:17.795 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-11-03T16:41:17.817 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:17 +0000 (0:00:00.417) 0:04:29.777 **** 2021-11-03T16:41:17.845 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-11-03T16:41:17.847 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:17.867 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:17 +0000 (0:00:00.050) 0:04:29.827 **** 2021-11-03T16:41:17.894 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-11-03T16:41:17.896 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:17.917 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:17 +0000 (0:00:00.049) 0:04:29.877 **** 2021-11-03T16:41:17.943 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-11-03T16:41:17.945 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:17.965 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:17 +0000 (0:00:00.048) 0:04:29.926 **** 2021-11-03T16:41:17.991 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-11-03T16:41:17.993 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:18.014 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:18 +0000 (0:00:00.048) 0:04:29.974 **** 2021-11-03T16:41:18.041 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-11-03T16:41:18.042 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:18.063 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:18 +0000 (0:00:00.049) 0:04:30.024 **** 2021-11-03T16:41:18.090 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-11-03T16:41:18.092 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:18.112 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:18 +0000 (0:00:00.048) 0:04:30.072 **** 2021-11-03T16:41:18.139 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-11-03T16:41:18.140 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:18.161 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:18 +0000 (0:00:00.048) 0:04:30.121 **** 2021-11-03T16:41:18.187 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-11-03T16:41:18.189 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:18.210 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:18 +0000 (0:00:00.048) 0:04:30.170 **** 2021-11-03T16:41:18.235 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-11-03T16:41:18.237 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:18.262 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:18 +0000 (0:00:00.051) 0:04:30.222 **** 2021-11-03T16:41:18.289 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-11-03T16:41:18.291 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:18.312 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:18 +0000 (0:00:00.050) 0:04:30.272 **** 2021-11-03T16:41:18.339 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-11-03T16:41:18.341 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:18.362 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:18 +0000 (0:00:00.050) 0:04:30.322 **** 2021-11-03T16:41:18.390 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-11-03T16:41:18.392 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:18.412 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:18 +0000 (0:00:00.050) 0:04:30.373 **** 2021-11-03T16:41:18.440 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-11-03T16:41:18.441 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:18.462 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:18 +0000 (0:00:00.049) 0:04:30.422 **** 2021-11-03T16:41:18.489 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:18.518 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:18 +0000 (0:00:00.055) 0:04:30.478 **** 2021-11-03T16:41:18.547 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-11-03T16:41:18.549 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:18.571 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:18 +0000 (0:00:00.053) 0:04:30.531 **** 2021-11-03T16:41:18.578 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-03T16:41:18.579 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-7JCbcfHqPne3pbXLWTa8Di0vVS9J17srX4sJOaNyt2JkQ8aAbvnhBRTK9TVo1ASY'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.051498", "end": "2021-11-03 16:41:18.536602", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-7JCbcfHqPne3pbXLWTa8Di0vVS9J17srX4sJOaNyt2JkQ8aAbvnhBRTK9TVo1ASY"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-03 16:41:17.485104", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-03T16:41:18.615 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:18 +0000 (0:00:00.043) 0:04:30.575 **** 2021-11-03T16:41:18.946 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-03T16:41:18.948 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-7JCbcfHqPne3pbXLWTa8Di0vVS9J17srDB2PpQe6fh7IF0Xfdc3gXh3L07Axjv4b'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.100208", "end": "2021-11-03 16:41:18.922805", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-7JCbcfHqPne3pbXLWTa8Di0vVS9J17srDB2PpQe6fh7IF0Xfdc3gXh3L07Axjv4b"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-03 16:41:18.822597", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0972905 s, 1.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0972905 s, 1.2 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-03T16:41:19.042 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2021-11-03T16:41:19.079 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:19 +0000 (0:00:00.464) 0:04:31.039 **** 2021-11-03T16:41:19.161 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-03T16:41:19.163 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-gN1EEh-LhN7-Cecg-MVGF-Hdhj-BSHF-sHbNSF', 'nvme-INTEL_SSDPED1D480GA_PHMB74760020480DGN', 'nvme-nvme.8086-50484d42373437363030323034383044474e-494e54454c2053534450454431443438304741-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPED1D480GA', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '937703088', 'sectorsize': '512', 'size': '447.13 GB', 'host': 'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.038856", "end": "2021-11-03 16:41:19.143470", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-gN1EEh-LhN7-Cecg-MVGF-Hdhj-BSHF-sHbNSF", "nvme-INTEL_SSDPED1D480GA_PHMB74760020480DGN", "nvme-nvme.8086-50484d42373437363030323034383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-03 16:41:19.104614", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0361046 s, 3.2 GB/s", "stderr_lines": [" 2021-11-03T16:41:19.165 INFO:teuthology.task.ansible.out:110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0361046 s, 3.2 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-03T16:41:19.392 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-11-03T16:41:19.394 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveState": "active", "AllowedCPUs": "", "AllowedMemoryNodes": "", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "DevicePolicy": "auto", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "866", "ExecMainStartTimestamp": "Wed 2021-11-03 16:35:37 UTC", "ExecMainStartTimestampMonotonic": "12667387", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FileDescriptorStoreMax": "0", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSI 2021-11-03T16:41:19.396 INFO:teuthology.task.ansible.out:ZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127246", "LimitNPROCSoft": "127246", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127246", "LimitSIGPENDINGSoft": "127246", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "MainPID": "866", "MemoryAccounting": "yes", "MemoryCurrent": "1908736", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Nice": "0", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "RemainAfterExit": "no", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeMaxUSec": "infinity", "SecureBits": "0", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StatusErrno": "0", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203593", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Type": "forking", "UID": "[not set]", "UMask": "0022", "WatchdogTimestamp": "Wed 2021-11-03 1 2021-11-03T16:41:19.397 INFO:teuthology.task.ansible.out:6:35:37 UTC", "WatchdogTimestampMonotonic": "12667401", "WatchdogUSec": "0"}} 2021-11-03T16:41:19.417 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:19 +0000 (0:00:00.337) 0:04:31.377 **** 2021-11-03T16:41:19.444 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-03T16:41:19.446 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi026.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-7JCbcfHqPne3pbXLWTa8Di0vVS9J17sr5z3FVE0jAQYMeIdCSM4ADGrSx9ctadfr'], 'uuids': ['278ac7fc-7988-4548-b45b-069fce932ca1'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.100037", "end": "2021-11-03 16:41:19.423921", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-7JCbcfHqPne3pbXLWTa8Di0vVS9J17sr5z3FVE0jAQYMeIdCSM4ADGrSx9ctadfr"], "labels": [], "masters": [], "uuids": ["278ac7fc-7988-4548-b45b-069fce932ca1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-03 16:41:19.323884", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0972917 s, 1.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0972917 s, 1.2 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-03T16:41:19.471 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:19 +0000 (0:00:00.051) 0:04:31.429 **** 2021-11-03T16:41:19.506 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-03T16:41:19.508 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-11-03T16:41:19.528 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:19 +0000 (0:00:00.060) 0:04:31.489 **** 2021-11-03T16:41:19.566 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:19.589 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:19 +0000 (0:00:00.060) 0:04:31.549 **** 2021-11-03T16:41:19.616 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:19.641 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:19 +0000 (0:00:00.052) 0:04:31.601 **** 2021-11-03T16:41:19.668 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-11-03T16:41:19.669 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:19.692 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:19 +0000 (0:00:00.050) 0:04:31.652 **** 2021-11-03T16:41:19.720 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-03T16:41:19.722 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-7JCbcfHqPne3pbXLWTa8Di0vVS9J17srW2c1wByj5M5mL2rgT0nYjAmNy3KpshoT'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.097840", "end": "2021-11-03 16:41:19.700591", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-7JCbcfHqPne3pbXLWTa8Di0vVS9J17srW2c1wByj5M5mL2rgT0nYjAmNy3KpshoT"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-03 16:41:19.602751", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0951022 s, 1.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0951022 s, 1.2 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-03T16:41:19.901 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-11-03T16:41:19.903 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "gid": 1254, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2021-11-03T16:41:19.924 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:19 +0000 (0:00:00.232) 0:04:31.884 **** 2021-11-03T16:41:20.007 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi026.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-7JCbcfHqPne3pbXLWTa8Di0vVS9J17srORcAmPWeuc1oBlAMqSW05mwAw030L0YQ'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.099246", "end": "2021-11-03 16:41:19.982592", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-7JCbcfHqPne3pbXLWTa8Di0vVS9J17srORcAmPWeuc1oBlAMqSW05mwAw030L0YQ"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-03 16:41:19.883346", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0965202 s, 1.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0965202 s, 1.2 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-03T16:41:20.018 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4H3KL', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W4H3KL', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W4H3KL', 'scsi-35000c500871b4821', 'scsi-SATA_ST1000NM0033-9ZM_Z1W4H3KL', 'wwn-0x5000c500871b4821'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W4H3KL', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c500871b4821', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4H3KL-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W4H3KL-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W4H3KL-part1', 'scsi-35000c500871b4821-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W4H3KL-part1', 'wwn-0x5000c500871b4821-part1'], 'uuids': ['fcc12580-8f3b-4cec-aef7-e7427fa239b7'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': 'fcc12580-8f3b-4cec-aef7-e7427fa239b7', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4H3KL", "scsi-0ATA_ST1000NM0033-9ZM_Z1W4H3KL", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W4H3KL", "scsi-35000c500871b4821", "scsi-SATA_ST1000NM0033-9ZM_Z1W4H3KL", "wwn-0x5000c500871b4821"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4H3KL-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W4H3KL-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2021-11-03T16:41:20.020 INFO:teuthology.task.ansible.out:Z1W4H3KL-part1", "scsi-35000c500871b4821-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W4H3KL-part1", "wwn-0x5000c500871b4821-part1"], "labels": [], "masters": [], "uuids": ["fcc12580-8f3b-4cec-aef7-e7427fa239b7"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "fcc12580-8f3b-4cec-aef7-e7427fa239b7"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4H3KL", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871b4821"}}, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:20.292 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-7JCbcfHqPne3pbXLWTa8Di0vVS9J17srX4sJOaNyt2JkQ8aAbvnhBRTK9TVo1ASY'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.103759", "end": "2021-11-03 16:41:20.273958", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-7JCbcfHqPne3pbXLWTa8Di0vVS9J17srX4sJOaNyt2JkQ8aAbvnhBRTK9TVo1ASY"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-03 16:41:20.170199", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.101025 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.101025 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-03T16:41:20.325 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:20 +0000 (0:00:00.400) 0:04:32.285 **** 2021-11-03T16:41:20.385 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-11-03T16:41:20.387 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1254, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2021-11-03T16:41:20.410 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:20 +0000 (0:00:00.085) 0:04:32.370 **** 2021-11-03T16:41:20.574 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi026.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.053508", "end": "2021-11-03 16:41:20.550012", "rc": 0, "start": "2021-11-03 16:41:20.496504", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-03T16:41:20.597 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:20 +0000 (0:00:00.186) 0:04:32.557 **** 2021-11-03T16:41:20.833 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-11-03T16:41:20.835 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.040097", "end": "2021-11-03 16:41:20.815647", "rc": 0, "start": "2021-11-03 16:41:20.775550", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-03T16:41:20.857 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:20 +0000 (0:00:00.260) 0:04:32.817 **** 2021-11-03T16:41:20.896 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-11-03T16:41:20.922 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:20 +0000 (0:00:00.065) 0:04:32.882 **** 2021-11-03T16:41:20.952 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-11-03T16:41:20.954 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:20.978 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:20 +0000 (0:00:00.055) 0:04:32.938 **** 2021-11-03T16:41:21.006 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-11-03T16:41:21.007 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:21.028 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:21 +0000 (0:00:00.050) 0:04:32.989 **** 2021-11-03T16:41:21.056 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:21.081 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:21 +0000 (0:00:00.052) 0:04:33.042 **** 2021-11-03T16:41:21.109 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-11-03T16:41:21.112 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:21.133 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:21 +0000 (0:00:00.050) 0:04:33.092 **** 2021-11-03T16:41:21.342 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-11-03T16:41:21.344 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-03T16:41:21.364 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:21 +0000 (0:00:00.232) 0:04:33.325 **** 2021-11-03T16:41:21.412 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-11-03T16:41:21.414 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930249474048, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227111688, 'block_used': 12983420, 'inode_total': 61054976, 'inode_available': 60985860, 'inode_used': 69116, 'uuid': 'fcc12580-8f3b-4cec-aef7-e7427fa239b7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227111688, "block_size": 4096, "block_total": 240095108, "block_used": 12983420, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985860, "inode_total": 61054976, "inode_used": 69116, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930249474048, "size_total": 983429562368, "uuid": "fcc12580-8f3b-4cec-aef7-e7427fa239b7"}, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:21.436 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:21 +0000 (0:00:00.072) 0:04:33.397 **** 2021-11-03T16:41:21.474 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-11-03T16:41:21.476 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:21.497 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:21 +0000 (0:00:00.060) 0:04:33.457 **** 2021-11-03T16:41:21.526 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-03T16:41:21.527 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:21.550 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:21 +0000 (0:00:00.052) 0:04:33.510 **** 2021-11-03T16:41:21.557 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-11-03T16:41:21.559 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-11-03T16:41:21.586 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:21 +0000 (0:00:00.034) 0:04:33.545 **** 2021-11-03T16:41:21.592 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-03T16:41:21.593 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:21.617 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:21 +0000 (0:00:00.032) 0:04:33.577 **** 2021-11-03T16:41:21.624 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-11-03T16:41:21.626 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:21.649 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:21 +0000 (0:00:00.032) 0:04:33.609 **** 2021-11-03T16:41:21.656 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-11-03T16:41:21.657 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:21.683 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:21 +0000 (0:00:00.034) 0:04:33.643 **** 2021-11-03T16:41:21.689 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-11-03T16:41:21.691 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-11-03T16:41:21.715 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:21 +0000 (0:00:00.031) 0:04:33.675 **** 2021-11-03T16:41:21.722 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-11-03T16:41:21.724 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:21.749 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:21 +0000 (0:00:00.032) 0:04:33.708 **** 2021-11-03T16:41:21.777 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-11-03T16:41:21.778 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:21.799 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:21 +0000 (0:00:00.050) 0:04:33.759 **** 2021-11-03T16:41:21.900 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-11-03T16:41:21.902 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-11-03T16:41:21.928 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:21 +0000 (0:00:00.129) 0:04:33.889 **** 2021-11-03T16:41:21.957 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:21.980 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:21 +0000 (0:00:00.051) 0:04:33.940 **** 2021-11-03T16:41:22.007 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-11-03T16:41:22.009 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-11-03T16:41:22.030 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:22 +0000 (0:00:00.050) 0:04:33.990 **** 2021-11-03T16:41:22.073 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-11-03T16:41:22.075 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:22.097 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:22 +0000 (0:00:00.066) 0:04:34.057 **** 2021-11-03T16:41:22.260 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-11-03T16:41:22.262 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-11-03T16:41:22.285 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:22 +0000 (0:00:00.188) 0:04:34.245 **** 2021-11-03T16:41:22.292 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-11-03T16:41:22.294 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-11-03T16:41:22.317 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:22 +0000 (0:00:00.032) 0:04:34.278 **** 2021-11-03T16:41:22.511 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-11-03T16:41:22.513 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-11-03T16:41:22.540 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:22 +0000 (0:00:00.222) 0:04:34.500 **** 2021-11-03T16:41:22.567 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-11-03T16:41:22.569 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:22.589 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:22 +0000 (0:00:00.049) 0:04:34.549 **** 2021-11-03T16:41:22.626 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-11-03T16:41:22.628 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} skipping: [smithi194.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-11-03T16:41:22.641 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-11-03T16:41:22.643 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi194.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2021-11-03T16:41:22.666 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:22 +0000 (0:00:00.076) 0:04:34.626 **** 2021-11-03T16:41:22.673 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-03T16:41:22.674 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-03T16:41:22.706 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-11-03T16:41:22.708 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi194.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:22.717 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:22.719 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:22.729 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:22.754 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:22 +0000 (0:00:00.087) 0:04:34.714 **** 2021-11-03T16:41:22.782 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-03T16:41:22.784 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:22.807 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:22 +0000 (0:00:00.052) 0:04:34.767 **** 2021-11-03T16:41:22.834 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-11-03T16:41:22.836 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:22.862 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:22 +0000 (0:00:00.054) 0:04:34.821 **** 2021-11-03T16:41:22.888 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-11-03T16:41:22.890 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:22.913 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:22 +0000 (0:00:00.052) 0:04:34.874 **** 2021-11-03T16:41:22.942 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-11-03T16:41:22.943 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:22.966 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:22 +0000 (0:00:00.052) 0:04:34.926 **** 2021-11-03T16:41:22.995 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:23.020 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:23 +0000 (0:00:00.054) 0:04:34.980 **** 2021-11-03T16:41:23.041 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-03T16:41:23.043 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-03T16:41:23.053 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-11-03T16:41:23.055 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:23.088 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:23 +0000 (0:00:00.067) 0:04:35.048 **** 2021-11-03T16:41:23.115 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-11-03T16:41:23.117 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:23.142 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:23 +0000 (0:00:00.054) 0:04:35.103 **** 2021-11-03T16:41:23.171 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:23.206 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:23 +0000 (0:00:00.063) 0:04:35.166 **** 2021-11-03T16:41:23.374 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-03T16:41:23.376 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-03T16:41:23.427 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-03T16:41:23.429 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005031", "end": "2021-11-03 16:41:23.395658", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-11-03 16:41:23.390627", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-03T16:41:23.606 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003046", "end": "2021-11-03 16:41:23.579357", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-11-03 16:41:23.576311", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-03T16:41:23.710 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi026.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-03T16:41:23.785 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-03T16:41:23.787 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002770", "end": "2021-11-03 16:41:23.756429", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-11-03 16:41:23.753659", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2021-11-03T16:41:23.964 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.003044", "end": "2021-11-03 16:41:23.940632", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-11-03 16:41:23.937588", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-03T16:41:24.000 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:23 +0000 (0:00:00.793) 0:04:35.960 **** 2021-11-03T16:41:24.026 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-11-03T16:41:24.051 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:24 +0000 (0:00:00.049) 0:04:36.009 **** 2021-11-03T16:41:24.067 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi026.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-03T16:41:24.102 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:24 +0000 (0:00:00.052) 0:04:36.062 **** 2021-11-03T16:41:24.109 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-11-03T16:41:24.112 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:24.336 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-11-03T16:41:24.338 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-11-03T16:41:24.359 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:24 +0000 (0:00:00.256) 0:04:36.319 **** 2021-11-03T16:41:24.595 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-03T16:41:24.596 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-03T16:41:24.756 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-03T16:41:24.943 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-03T16:41:25.122 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-03T16:41:25.134 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:25.160 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:25 +0000 (0:00:00.800) 0:04:37.120 **** 2021-11-03T16:41:25.187 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-11-03T16:41:25.189 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:25.209 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:25 +0000 (0:00:00.049) 0:04:37.170 **** 2021-11-03T16:41:25.250 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-11-03T16:41:25.252 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:25.273 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:25 +0000 (0:00:00.064) 0:04:37.234 **** 2021-11-03T16:41:25.490 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-11-03T16:41:25.492 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-11-03T16:41:25.514 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:25 +0000 (0:00:00.240) 0:04:37.474 **** 2021-11-03T16:41:25.552 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-11-03T16:41:25.554 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-11-03T16:41:25.575 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:25 +0000 (0:00:00.060) 0:04:37.535 **** 2021-11-03T16:41:25.802 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi026.front.sepia.ceph.com] => {"changed": true} 2021-11-03T16:41:25.823 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:25 +0000 (0:00:00.249) 0:04:37.784 **** 2021-11-03T16:41:26.145 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-11-03T16:41:26.146 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-11-03T16:41:26.168 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:26 +0000 (0:00:00.344) 0:04:38.128 **** 2021-11-03T16:41:26.196 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-11-03T16:41:26.198 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:26.234 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:26 +0000 (0:00:00.065) 0:04:38.194 **** 2021-11-03T16:41:26.276 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-11-03T16:41:26.278 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:26.310 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:26 +0000 (0:00:00.075) 0:04:38.270 **** 2021-11-03T16:41:26.338 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-11-03T16:41:26.340 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:26.362 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:26 +0000 (0:00:00.052) 0:04:38.322 **** 2021-11-03T16:41:26.389 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-11-03T16:41:26.391 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:26.417 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:26 +0000 (0:00:00.054) 0:04:38.377 **** 2021-11-03T16:41:26.444 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-11-03T16:41:26.446 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:26.467 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:26 +0000 (0:00:00.049) 0:04:38.426 **** 2021-11-03T16:41:26.492 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-11-03T16:41:26.494 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:26.515 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:26 +0000 (0:00:00.049) 0:04:38.475 **** 2021-11-03T16:41:26.544 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-11-03T16:41:26.545 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:26.568 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:26 +0000 (0:00:00.052) 0:04:38.528 **** 2021-11-03T16:41:26.606 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-11-03T16:41:26.609 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:26.629 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:26 +0000 (0:00:00.061) 0:04:38.589 **** 2021-11-03T16:41:26.656 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-11-03T16:41:26.659 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:26.690 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:26 +0000 (0:00:00.060) 0:04:38.650 **** 2021-11-03T16:41:26.720 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-11-03T16:41:26.722 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:26.743 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:26 +0000 (0:00:00.052) 0:04:38.703 **** 2021-11-03T16:41:26.770 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-11-03T16:41:26.772 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:26.793 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:26 +0000 (0:00:00.050) 0:04:38.753 **** 2021-11-03T16:41:26.820 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:26.844 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:26 +0000 (0:00:00.050) 0:04:38.804 **** 2021-11-03T16:41:26.872 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-11-03T16:41:26.874 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:26.894 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:26 +0000 (0:00:00.050) 0:04:38.855 **** 2021-11-03T16:41:26.922 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:26.946 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:26 +0000 (0:00:00.051) 0:04:38.906 **** 2021-11-03T16:41:26.974 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-11-03T16:41:26.977 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:26.997 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:26 +0000 (0:00:00.050) 0:04:38.957 **** 2021-11-03T16:41:27.483 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-11-03T16:41:27.485 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2021-11-03T16:41:27.507 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:27 +0000 (0:00:00.509) 0:04:39.467 **** 2021-11-03T16:41:27.831 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-11-03T16:41:27.831 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveState": "active", "AllowedCPUs": "", "AllowedMemoryNodes": "", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "DevicePolicy": "auto", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "801", "ExecMainStartTimestamp": "Wed 2021-11-03 16:35:19 UTC", "ExecMainStartTimestampMonotonic": "11854799", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FileDescriptorStoreMax": "0", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSI 2021-11-03T16:41:27.833 INFO:teuthology.task.ansible.out:ZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127269", "LimitNPROCSoft": "127269", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127269", "LimitSIGPENDINGSoft": "127269", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "MainPID": "801", "MemoryAccounting": "yes", "MemoryCurrent": "2138112", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Nice": "0", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "RemainAfterExit": "no", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeMaxUSec": "infinity", "SecureBits": "0", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StatusErrno": "0", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203631", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Type": "forking", "UID": "[not set]", "UMask": "0022", "WatchdogTimestamp": "Wed 2021-11-03 1 2021-11-03T16:41:27.835 INFO:teuthology.task.ansible.out:6:35:19 UTC", "WatchdogTimestampMonotonic": "11854997", "WatchdogUSec": "0"}} 2021-11-03T16:41:27.855 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:27 +0000 (0:00:00.348) 0:04:39.815 **** 2021-11-03T16:41:27.883 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi026.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-11-03T16:41:27.904 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:27 +0000 (0:00:00.048) 0:04:39.864 **** 2021-11-03T16:41:27.941 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-03T16:41:27.943 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-11-03T16:41:27.964 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:27 +0000 (0:00:00.059) 0:04:39.924 **** 2021-11-03T16:41:27.991 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:28.014 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:28 +0000 (0:00:00.050) 0:04:39.974 **** 2021-11-03T16:41:28.052 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-11-03T16:41:28.054 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:28.084 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:28 +0000 (0:00:00.069) 0:04:40.044 **** 2021-11-03T16:41:28.112 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-11-03T16:41:28.114 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:28.134 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:28 +0000 (0:00:00.050) 0:04:40.095 **** 2021-11-03T16:41:28.340 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-11-03T16:41:28.342 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "gid": 1254, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2021-11-03T16:41:28.363 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:28 +0000 (0:00:00.228) 0:04:40.323 **** 2021-11-03T16:41:28.859 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-11-03T16:41:28.861 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1254, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2021-11-03T16:41:28.882 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:28 +0000 (0:00:00.519) 0:04:40.842 **** 2021-11-03T16:41:29.957 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-11-03T16:41:29.979 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:29 +0000 (0:00:01.097) 0:04:41.940 **** 2021-11-03T16:41:30.006 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-11-03T16:41:30.008 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:30.029 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:30 +0000 (0:00:00.049) 0:04:41.990 **** 2021-11-03T16:41:30.067 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-11-03T16:41:30.069 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2021-11-03T16:41:30.089 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:30 +0000 (0:00:00.059) 0:04:42.050 **** 2021-11-03T16:41:30.282 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-11-03T16:41:30.284 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-11-03T16:41:30.306 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:30 +0000 (0:00:00.216) 0:04:42.266 **** 2021-11-03T16:41:30.333 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-11-03T16:41:30.334 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:30.357 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:30 +0000 (0:00:00.050) 0:04:42.317 **** 2021-11-03T16:41:30.395 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-11-03T16:41:30.397 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-11-03T16:41:30.422 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:30 +0000 (0:00:00.065) 0:04:42.382 **** 2021-11-03T16:41:30.449 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-11-03T16:41:30.451 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:30.472 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:30 +0000 (0:00:00.050) 0:04:42.433 **** 2021-11-03T16:41:30.676 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-11-03T16:41:30.678 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-11-03T16:41:30.705 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:30 +0000 (0:00:00.232) 0:04:42.665 **** 2021-11-03T16:41:30.910 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-11-03T16:41:30.912 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-11-03T16:41:30.938 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:30 +0000 (0:00:00.233) 0:04:42.898 **** 2021-11-03T16:41:30.964 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:30.988 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:30 +0000 (0:00:00.050) 0:04:42.948 **** 2021-11-03T16:41:31.025 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-11-03T16:41:31.027 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-11-03T16:41:31.037 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} 2021-11-03T16:41:31.037 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-11-03T16:41:31.048 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-11-03T16:41:31.072 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:31 +0000 (0:00:00.084) 0:04:43.033 **** 2021-11-03T16:41:31.120 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-11-03T16:41:31.122 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:31.134 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:31.135 INFO:teuthology.task.ansible.out: skipping: [smithi026.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:31.162 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:31 +0000 (0:00:00.089) 0:04:43.122 **** 2021-11-03T16:41:31.190 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-03T16:41:31.192 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:31.215 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:31 +0000 (0:00:00.053) 0:04:43.175 **** 2021-11-03T16:41:31.243 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-11-03T16:41:31.245 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:31.266 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:31 +0000 (0:00:00.051) 0:04:43.227 **** 2021-11-03T16:41:31.304 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-11-03T16:41:31.306 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:31.330 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:31 +0000 (0:00:00.063) 0:04:43.290 **** 2021-11-03T16:41:31.357 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-11-03T16:41:31.359 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:31.382 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:31 +0000 (0:00:00.052) 0:04:43.342 **** 2021-11-03T16:41:31.410 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-11-03T16:41:31.412 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:31.435 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:31 +0000 (0:00:00.053) 0:04:43.395 **** 2021-11-03T16:41:31.463 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-11-03T16:41:31.466 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:31.490 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:31 +0000 (0:00:00.054) 0:04:43.450 **** 2021-11-03T16:41:31.530 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:31.554 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:31 +0000 (0:00:00.064) 0:04:43.515 **** 2021-11-03T16:41:31.582 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-11-03T16:41:31.584 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:31.604 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:31 +0000 (0:00:00.050) 0:04:43.565 **** 2021-11-03T16:41:31.832 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi026.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005692", "end": "2021-11-03 16:41:31.805536", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-11-03 16:41:31.799844", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-03T16:41:32.020 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003145", "end": "2021-11-03 16:41:31.990465", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-11-03 16:41:31.987320", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-03T16:41:32.209 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.003092", "end": "2021-11-03 16:41:32.182977", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-11-03 16:41:32.179885", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2021-11-03T16:41:32.389 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.003256", "end": "2021-11-03 16:41:32.362987", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-11-03 16:41:32.359731", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-03T16:41:32.424 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:32 +0000 (0:00:00.819) 0:04:44.384 **** 2021-11-03T16:41:32.455 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-11-03T16:41:32.479 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:32 +0000 (0:00:00.054) 0:04:44.439 **** 2021-11-03T16:41:32.516 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-11-03T16:41:32.518 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:32.586 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-11-03T16:41:32.605 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:32 +0000 (0:00:00.126) 0:04:44.565 **** 2021-11-03T16:41:32.629 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:32 +0000 (0:00:00.021) 0:04:44.587 **** 2021-11-03T16:41:33.274 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi026.front.sepia.ceph.com] 2021-11-03T16:41:33.340 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:33 +0000 (0:00:00.712) 0:04:45.300 **** 2021-11-03T16:41:33.371 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-03T16:41:33.373 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:33.402 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:33 +0000 (0:00:00.061) 0:04:45.362 **** 2021-11-03T16:41:33.439 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-03T16:41:33.441 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "yum"}, "changed": false} 2021-11-03T16:41:33.469 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:33 +0000 (0:00:00.066) 0:04:45.429 **** 2021-11-03T16:41:33.519 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-11-03T16:41:33.521 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml) => {"ansible_facts": {"container_packages": ["podman", "podman-docker"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"} 2021-11-03T16:41:33.546 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:33 +0000 (0:00:00.077) 0:04:45.506 **** 2021-11-03T16:41:34.313 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi194.front.sepia.ceph.com] 2021-11-03T16:41:34.315 INFO:teuthology.task.ansible.out: 2021-11-03T16:41:34.364 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:34 +0000 (0:00:00.817) 0:04:46.324 **** 2021-11-03T16:41:34.393 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-03T16:41:34.395 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:34.415 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:34 +0000 (0:00:00.050) 0:04:46.375 **** 2021-11-03T16:41:34.452 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-03T16:41:34.454 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "yum"}, "changed": false} 2021-11-03T16:41:34.477 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:34 +0000 (0:00:00.061) 0:04:46.437 **** 2021-11-03T16:41:34.527 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-11-03T16:41:34.529 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml) => {"ansible_facts": {"container_packages": ["podman", "podman-docker"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"} 2021-11-03T16:41:34.554 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:34 +0000 (0:00:00.077) 0:04:46.514 **** 2021-11-03T16:41:39.699 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-11-03T16:41:39.700 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: podman-docker-3.2.3-0.11.module_el8.4.0+942+d25aada8.noarch", "Installed: podman-catatonit-3.2.3-0.11.module_el8.4.0+942+d25aada8.x86_64", "Installed: podman-3.2.3-0.11.module_el8.4.0+942+d25aada8.x86_64", "Removed: podman-3.0.1-7.module_el8.4.0+830+8027e1c4.x86_64", "Removed: podman-catatonit-3.0.1-7.module_el8.4.0+830+8027e1c4.x86_64", "Removed: podman-docker-3.0.1-7.module_el8.4.0+830+8027e1c4.noarch"]} 2021-11-03T16:41:39.723 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:39 +0000 (0:00:05.169) 0:04:51.683 **** 2021-11-03T16:41:39.751 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-03T16:41:39.753 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/containers/registries.conf"}, "changed": false} 2021-11-03T16:41:39.774 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:39 +0000 (0:00:00.051) 0:04:51.734 **** 2021-11-03T16:41:39.811 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:39.834 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:39 +0000 (0:00:00.059) 0:04:51.794 **** 2021-11-03T16:41:40.079 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-11-03T16:41:40.081 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-11-03T16:41:40.298 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-11-03T16:41:40.324 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:40 +0000 (0:00:00.490) 0:04:52.284 **** 2021-11-03T16:41:40.434 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-11-03T16:41:40.436 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: podman-docker-3.2.3-0.11.module_el8.4.0+942+d25aada8.noarch", "Installed: podman-catatonit-3.2.3-0.11.module_el8.4.0+942+d25aada8.x86_64", "Installed: podman-3.2.3-0.11.module_el8.4.0+942+d25aada8.x86_64", "Removed: podman-3.0.1-7.module_el8.4.0+830+8027e1c4.x86_64", "Removed: podman-catatonit-3.0.1-7.module_el8.4.0+830+8027e1c4.x86_64", "Removed: podman-docker-3.0.1-7.module_el8.4.0+830+8027e1c4.noarch"]} 2021-11-03T16:41:40.459 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:40 +0000 (0:00:00.134) 0:04:52.419 **** 2021-11-03T16:41:40.496 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-03T16:41:40.498 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/containers/registries.conf"}, "changed": false} 2021-11-03T16:41:40.519 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:40 +0000 (0:00:00.059) 0:04:52.479 **** 2021-11-03T16:41:40.546 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-03T16:41:40.548 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:40.571 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:40 +0000 (0:00:00.052) 0:04:52.532 **** 2021-11-03T16:41:40.805 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-11-03T16:41:40.806 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-11-03T16:41:40.818 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-11-03T16:41:40.819 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "secontext": "system_u:object_r:cert_t:s0", "size": 2334, "state": "file", "uid": 0} 2021-11-03T16:41:40.984 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-11-03T16:41:40.986 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-11-03T16:41:41.009 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:41 +0000 (0:00:00.437) 0:04:52.969 **** 2021-11-03T16:41:41.255 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-11-03T16:41:41.257 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "secontext": "system_u:object_r:etc_t:s0", "size": 2334, "state": "file", "uid": 0} 2021-11-03T16:41:41.281 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:41 +0000 (0:00:00.272) 0:04:53.241 **** 2021-11-03T16:41:41.517 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "secontext": "system_u:object_r:cert_t:s0", "size": 2334, "state": "file", "uid": 0} 2021-11-03T16:41:41.939 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "secontext": "system_u:object_r:etc_t:s0", "size": 2334, "state": "file", "uid": 0} 2021-11-03T16:41:41.978 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:41 +0000 (0:00:00.696) 0:04:53.938 **** 2021-11-03T16:41:43.004 INFO:teuthology.task.ansible.out: TASK [container-host : Ensure git is installed] ******************************** 2021-11-03T16:41:43.006 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-03T16:41:43.038 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:43 +0000 (0:00:01.060) 0:04:54.998 **** 2021-11-03T16:41:43.604 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-03T16:41:43.631 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:43 +0000 (0:00:00.592) 0:04:55.591 **** 2021-11-03T16:41:45.571 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-11-03T16:41:45.572 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-deqr3eg_-build\nRequirement already up-to-date: toml in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)\nRequirement already up-to-date: docopt in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)\nInstalling collected packages: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-deqr3eg_-build", "Requirement already up-to-date: toml in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)", "Requirement already up-to-date: docopt in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)", "Installing collected packages: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", " Running setup.py in 2021-11-03T16:41:45.574 INFO:teuthology.task.ansible.out:stall for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-11-03T16:41:45.595 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:45 +0000 (0:00:01.964) 0:04:57.556 **** 2021-11-03T16:41:45.633 INFO:teuthology.task.ansible.out: 2021-11-03T16:41:45.634 INFO:teuthology.task.ansible.out:TASK [container-host : Check for docker's daemon.json] ************************* skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:45.658 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:45 +0000 (0:00:00.062) 0:04:57.619 **** 2021-11-03T16:41:45.685 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/containers/registries.conf if necessary] **** 2021-11-03T16:41:45.687 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:45.709 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:45 +0000 (0:00:00.050) 0:04:57.669 **** 2021-11-03T16:41:46.004 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-11-03T16:41:46.005 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-74pt6did-build\nRequirement already up-to-date: toml in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)\nRequirement already up-to-date: docopt in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)\nInstalling collected packages: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-74pt6did-build", "Requirement already up-to-date: toml in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)", "Requirement already up-to-date: docopt in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)", "Installing collected packages: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", " Running setup.py in 2021-11-03T16:41:46.007 INFO:teuthology.task.ansible.out:stall for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-11-03T16:41:46.029 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:46 +0000 (0:00:00.319) 0:04:57.989 **** 2021-11-03T16:41:46.066 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-11-03T16:41:46.067 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [container-host : Add local docker.io registry mirror] ******************** changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.160857", "end": "2021-11-03 16:41:46.050901", "rc": 0, "start": "2021-11-03 16:41:45.890044", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-03T16:41:46.091 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:46 +0000 (0:00:00.062) 0:04:58.051 **** 2021-11-03T16:41:46.112 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:46 +0000 (0:00:00.021) 0:04:58.073 **** 2021-11-03T16:41:46.120 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-11-03T16:41:46.124 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:46.145 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/containers/registries.conf if necessary] **** skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:46.177 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:46 +0000 (0:00:00.065) 0:04:58.138 **** 2021-11-03T16:41:46.518 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-11-03T16:41:46.520 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.150930", "end": "2021-11-03 16:41:46.503239", "rc": 0, "start": "2021-11-03 16:41:46.352309", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-03T16:41:46.541 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:46 +0000 (0:00:00.363) 0:04:58.501 **** 2021-11-03T16:41:46.579 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-03T16:41:46.647 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-11-03T16:41:46.648 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-11-03T16:41:46.650 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2021-11-03T16:41:46.652 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-11-03T16:41:46.664 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* Wednesday 03 November 2021 16:41:46 +0000 (0:00:00.123) 0:04:58.624 **** 2021-11-03T16:41:47.329 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] 2021-11-03T16:41:47.340 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] 2021-11-03T16:41:47.360 INFO:teuthology.task.ansible.out: TASK [Touch /ceph-qa-ready] **************************************************** 2021-11-03T16:41:47.362 INFO:teuthology.task.ansible.out:Wednesday 03 November 2021 16:41:47 +0000 (0:00:00.696) 0:04:59.321 **** 2021-11-03T16:41:47.570 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2021-11-03T16:41:47.582 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2021-11-03T16:41:47.584 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* smithi026.front.sepia.ceph.com : ok=135 changed=43 unreachable=0 failed=0 skipped=184 rescued=0 ignored=3 2021-11-03T16:41:47.587 INFO:teuthology.task.ansible.out:smithi194.front.sepia.ceph.com : ok=135 changed=43 unreachable=0 failed=0 skipped=184 rescued=0 ignored=3 Wednesday 03 November 2021 16:41:47 +0000 (0:00:00.224) 0:04:59.545 **** =============================================================================== Create all admin users with sudo access. ------------------------------- 36.36s common : nrpe - Ensure SELinux policy is up to date -------------------- 33.67s users : Update authorized_keys using the keys repo --------------------- 30.04s Remove revoked users --------------------------------------------------- 15.41s testnode : Ensure ceph packages are not present. ----------------------- 11.66s common : nrpe - Remove SELinux policy package --------------------------- 9.69s common : nrpe - Load SELinux policy package ----------------------------- 9.02s container-host : Install container packages ----------------------------- 5.17s testnode : Install GPG -------------------------------------------------- 3.08s 2021-11-03T16:41:47.587 INFO:teuthology.task.ansible.out:testnode : Install GPG keys --------------------------------------------- 2.90s testnode : Ensure ceph dependency packages are not present. ------------- 2.63s container-host : Install registries-conf-ctl ---------------------------- 1.96s users : Update authorized_keys for each user with literal keys ---------- 1.86s testnode : Make sure rpm dependencies are installed --------------------- 1.73s common : nrpe - Install SELinux dependencies ---------------------------- 1.71s testnode : Install packages --------------------------------------------- 1.59s Gathering Facts --------------------------------------------------------- 1.57s Gathering Facts --------------------------------------------------------- 1.45s testnode : Zap all non-root disks --------------------------------------- 1.39s testnode : Configure local mirrorlists ---------------------------------- 1.38s 2021-11-03T16:41:47.984 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi026.front.sepia.ceph.com'), Remote(name='ubuntu@smithi194.front.sepia.ceph.com')] 2021-11-03T16:41:47.986 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2021-11-03T16:41:47.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-03T16:41:48.065 DEBUG:teuthology.orchestra.run.smithi026:> true 2021-11-03T16:41:48.148 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2021-11-03T16:41:48.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-03T16:41:48.216 DEBUG:teuthology.orchestra.run.smithi194:> true 2021-11-03T16:41:48.299 INFO:teuthology.run_tasks:Running task clock... 2021-11-03T16:41:48.313 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-11-03T16:41:48.314 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-11-03T16:41:48.316 DEBUG:teuthology.orchestra.run.smithi026:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-11-03T16:41:48.352 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2021-11-03T16:41:48.368 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2021-11-03T16:41:48.408 INFO:teuthology.orchestra.run.smithi026.stderr:sudo: ntpd: command not found 2021-11-03T16:41:48.419 INFO:teuthology.orchestra.run.smithi026.stdout:506 Cannot talk to daemon 2021-11-03T16:41:48.433 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to start ntp.service: Unit ntp.service not found. 2021-11-03T16:41:48.447 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2021-11-03T16:41:48.512 INFO:teuthology.orchestra.run.smithi026.stderr:bash: ntpq: command not found 2021-11-03T16:41:48.514 INFO:teuthology.orchestra.run.smithi026.stdout:210 Number of sources = 4 2021-11-03T16:41:48.514 INFO:teuthology.orchestra.run.smithi026.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2021-11-03T16:41:48.514 INFO:teuthology.orchestra.run.smithi026.stdout:=============================================================================== 2021-11-03T16:41:48.515 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-11-03T16:41:48.515 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-11-03T16:41:48.515 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-11-03T16:41:48.515 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-11-03T16:41:48.516 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-11-03T16:41:48.516 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-11-03T16:41:48.550 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2021-11-03T16:41:48.564 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2021-11-03T16:41:48.606 INFO:teuthology.orchestra.run.smithi194.stderr:sudo: ntpd: command not found 2021-11-03T16:41:48.616 INFO:teuthology.orchestra.run.smithi194.stdout:506 Cannot talk to daemon 2021-11-03T16:41:48.629 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to start ntp.service: Unit ntp.service not found. 2021-11-03T16:41:48.643 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2021-11-03T16:41:48.699 INFO:teuthology.orchestra.run.smithi194.stderr:bash: ntpq: command not found 2021-11-03T16:41:48.702 INFO:teuthology.orchestra.run.smithi194.stdout:210 Number of sources = 4 2021-11-03T16:41:48.702 INFO:teuthology.orchestra.run.smithi194.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2021-11-03T16:41:48.703 INFO:teuthology.orchestra.run.smithi194.stdout:=============================================================================== 2021-11-03T16:41:48.703 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-11-03T16:41:48.703 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-11-03T16:41:48.703 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-11-03T16:41:48.703 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-11-03T16:41:48.704 INFO:teuthology.run_tasks:Running task pexec... 2021-11-03T16:41:48.716 INFO:teuthology.task.pexec:Executing custom commands... 2021-11-03T16:41:48.717 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi026.front.sepia.ceph.com 2021-11-03T16:41:48.718 DEBUG:teuthology.orchestra.run.smithi026:> TESTDIR=/home/ubuntu/cephtest bash -s 2021-11-03T16:41:48.718 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi194.front.sepia.ceph.com 2021-11-03T16:41:48.719 DEBUG:teuthology.orchestra.run.smithi194:> TESTDIR=/home/ubuntu/cephtest bash -s 2021-11-03T16:41:49.229 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:13 ago on Wed 03 Nov 2021 04:40:36 PM UTC. 2021-11-03T16:41:49.236 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:06 ago on Wed 03 Nov 2021 04:40:43 PM UTC. 2021-11-03T16:41:50.280 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2021-11-03T16:41:50.281 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:41:50.281 INFO:teuthology.orchestra.run.smithi194.stdout: Package Architecture Version Repository Size 2021-11-03T16:41:50.281 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:41:50.281 INFO:teuthology.orchestra.run.smithi194.stdout:Resetting modules: 2021-11-03T16:41:50.282 INFO:teuthology.orchestra.run.smithi194.stdout: container-tools 2021-11-03T16:41:50.282 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:41:50.282 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2021-11-03T16:41:50.282 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:41:50.283 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:41:50.346 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2021-11-03T16:41:50.347 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:41:50.347 INFO:teuthology.orchestra.run.smithi026.stdout: Package Architecture Version Repository Size 2021-11-03T16:41:50.348 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:41:50.348 INFO:teuthology.orchestra.run.smithi026.stdout:Resetting modules: 2021-11-03T16:41:50.348 INFO:teuthology.orchestra.run.smithi026.stdout: container-tools 2021-11-03T16:41:50.348 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:41:50.349 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2021-11-03T16:41:50.349 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:41:50.349 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:41:50.492 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2021-11-03T16:41:50.587 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2021-11-03T16:41:50.970 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:14 ago on Wed 03 Nov 2021 04:40:36 PM UTC. 2021-11-03T16:41:51.086 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:08 ago on Wed 03 Nov 2021 04:40:43 PM UTC. 2021-11-03T16:41:52.019 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2021-11-03T16:41:52.021 INFO:teuthology.orchestra.run.smithi194.stdout:======================================================================================================== 2021-11-03T16:41:52.022 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2021-11-03T16:41:52.022 INFO:teuthology.orchestra.run.smithi194.stdout:======================================================================================================== 2021-11-03T16:41:52.022 INFO:teuthology.orchestra.run.smithi194.stdout:Upgrading: 2021-11-03T16:41:52.022 INFO:teuthology.orchestra.run.smithi194.stdout: containernetworking-plugins x86_64 0.9.1-1.module_el8.4.0+786+4668b267 CentOS-AppStream 20 M 2021-11-03T16:41:52.023 INFO:teuthology.orchestra.run.smithi194.stdout: criu x86_64 3.15-1.module_el8.4.0+786+4668b267 CentOS-AppStream 511 k 2021-11-03T16:41:52.023 INFO:teuthology.orchestra.run.smithi194.stdout: libslirp x86_64 4.3.1-1.module_el8.4.0+786+4668b267 CentOS-AppStream 69 k 2021-11-03T16:41:52.023 INFO:teuthology.orchestra.run.smithi194.stdout: slirp4netns x86_64 1.1.8-1.module_el8.4.0+786+4668b267 CentOS-AppStream 51 k 2021-11-03T16:41:52.023 INFO:teuthology.orchestra.run.smithi194.stdout:Installing group/module packages: 2021-11-03T16:41:52.023 INFO:teuthology.orchestra.run.smithi194.stdout: buildah x86_64 1.19.7-1.module_el8.4.0+786+4668b267 CentOS-AppStream 6.9 M 2021-11-03T16:41:52.024 INFO:teuthology.orchestra.run.smithi194.stdout: cockpit-podman noarch 29-2.module_el8.4.0+786+4668b267 CentOS-AppStream 1.1 M 2021-11-03T16:41:52.024 INFO:teuthology.orchestra.run.smithi194.stdout: skopeo x86_64 1:1.2.2-7.module_el8.4.0+786+4668b267 CentOS-AppStream 5.9 M 2021-11-03T16:41:52.024 INFO:teuthology.orchestra.run.smithi194.stdout: toolbox noarch 0.0.8-1.module_el8.4.0+786+4668b267 CentOS-AppStream 16 k 2021-11-03T16:41:52.024 INFO:teuthology.orchestra.run.smithi194.stdout: udica noarch 0.2.4-1.module_el8.4.0+786+4668b267 CentOS-AppStream 51 k 2021-11-03T16:41:52.025 INFO:teuthology.orchestra.run.smithi194.stdout:Downgrading: 2021-11-03T16:41:52.025 INFO:teuthology.orchestra.run.smithi194.stdout: conmon x86_64 2:2.0.26-1.module_el8.4.0+786+4668b267 CentOS-AppStream 51 k 2021-11-03T16:41:52.025 INFO:teuthology.orchestra.run.smithi194.stdout: container-selinux noarch 2:2.158.0-1.module_el8.4.0+786+4668b267 CentOS-AppStream 51 k 2021-11-03T16:41:52.025 INFO:teuthology.orchestra.run.smithi194.stdout: containers-common x86_64 1:1.2.2-7.module_el8.4.0+786+4668b267 CentOS-AppStream 97 k 2021-11-03T16:41:52.026 INFO:teuthology.orchestra.run.smithi194.stdout: crun x86_64 0.18-2.module_el8.4.0+786+4668b267 CentOS-AppStream 185 k 2021-11-03T16:41:52.026 INFO:teuthology.orchestra.run.smithi194.stdout: fuse-overlayfs x86_64 1.4.0-2.module_el8.4.0+786+4668b267 CentOS-AppStream 72 k 2021-11-03T16:41:52.027 INFO:teuthology.orchestra.run.smithi194.stdout: podman x86_64 3.0.1-6.module_el8.4.0+786+4668b267 CentOS-AppStream 11 M 2021-11-03T16:41:52.027 INFO:teuthology.orchestra.run.smithi194.stdout: podman-catatonit x86_64 3.0.1-6.module_el8.4.0+786+4668b267 CentOS-AppStream 320 k 2021-11-03T16:41:52.027 INFO:teuthology.orchestra.run.smithi194.stdout: podman-docker noarch 3.0.1-6.module_el8.4.0+786+4668b267 CentOS-AppStream 55 k 2021-11-03T16:41:52.027 INFO:teuthology.orchestra.run.smithi194.stdout: runc x86_64 1.0.0-71.rc92.module_el8.4.0+833+9763146c CentOS-AppStream 3.1 M 2021-11-03T16:41:52.028 INFO:teuthology.orchestra.run.smithi194.stdout:Installing module profiles: 2021-11-03T16:41:52.028 INFO:teuthology.orchestra.run.smithi194.stdout: container-tools/common 2021-11-03T16:41:52.028 INFO:teuthology.orchestra.run.smithi194.stdout:Enabling module streams: 2021-11-03T16:41:52.028 INFO:teuthology.orchestra.run.smithi194.stdout: container-tools 3.0 2021-11-03T16:41:52.029 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:41:52.029 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2021-11-03T16:41:52.029 INFO:teuthology.orchestra.run.smithi194.stdout:======================================================================================================== 2021-11-03T16:41:52.029 INFO:teuthology.orchestra.run.smithi194.stdout:Install 5 Packages 2021-11-03T16:41:52.029 INFO:teuthology.orchestra.run.smithi194.stdout:Upgrade 4 Packages 2021-11-03T16:41:52.030 INFO:teuthology.orchestra.run.smithi194.stdout:Downgrade 9 Packages 2021-11-03T16:41:52.030 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:41:52.031 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 49 M 2021-11-03T16:41:52.031 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2021-11-03T16:41:52.101 INFO:teuthology.orchestra.run.smithi194.stdout:(1/18): conmon-2.0.26-1.module_el8.4.0+786+4668 676 kB/s | 51 kB 00:00 2021-11-03T16:41:52.109 INFO:teuthology.orchestra.run.smithi194.stdout:(2/18): container-selinux-2.158.0-1.module_el8. 606 kB/s | 51 kB 00:00 2021-11-03T16:41:52.127 INFO:teuthology.orchestra.run.smithi194.stdout:(3/18): containers-common-1.2.2-7.module_el8.4. 954 kB/s | 97 kB 00:00 2021-11-03T16:41:52.132 INFO:teuthology.orchestra.run.smithi194.stdout:(4/18): fuse-overlayfs-1.4.0-2.module_el8.4.0+7 3.1 MB/s | 72 kB 00:00 2021-11-03T16:41:52.135 INFO:teuthology.orchestra.run.smithi194.stdout:(5/18): crun-0.18-2.module_el8.4.0+786+4668b267 5.2 MB/s | 185 kB 00:00 2021-11-03T16:41:52.148 INFO:teuthology.orchestra.run.smithi194.stdout:(6/18): podman-docker-3.0.1-6.module_el8.4.0+78 4.4 MB/s | 55 kB 00:00 2021-11-03T16:41:52.174 INFO:teuthology.orchestra.run.smithi194.stdout:(7/18): podman-catatonit-3.0.1-6.module_el8.4.0 7.5 MB/s | 320 kB 00:00 2021-11-03T16:41:52.217 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2021-11-03T16:41:52.219 INFO:teuthology.orchestra.run.smithi026.stdout:======================================================================================================== 2021-11-03T16:41:52.220 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2021-11-03T16:41:52.220 INFO:teuthology.orchestra.run.smithi026.stdout:======================================================================================================== 2021-11-03T16:41:52.220 INFO:teuthology.orchestra.run.smithi026.stdout:Upgrading: 2021-11-03T16:41:52.221 INFO:teuthology.orchestra.run.smithi026.stdout: containernetworking-plugins x86_64 0.9.1-1.module_el8.4.0+786+4668b267 CentOS-AppStream 20 M 2021-11-03T16:41:52.221 INFO:teuthology.orchestra.run.smithi026.stdout: criu x86_64 3.15-1.module_el8.4.0+786+4668b267 CentOS-AppStream 511 k 2021-11-03T16:41:52.221 INFO:teuthology.orchestra.run.smithi026.stdout: libslirp x86_64 4.3.1-1.module_el8.4.0+786+4668b267 CentOS-AppStream 69 k 2021-11-03T16:41:52.222 INFO:teuthology.orchestra.run.smithi026.stdout: slirp4netns x86_64 1.1.8-1.module_el8.4.0+786+4668b267 CentOS-AppStream 51 k 2021-11-03T16:41:52.222 INFO:teuthology.orchestra.run.smithi026.stdout:Installing group/module packages: 2021-11-03T16:41:52.222 INFO:teuthology.orchestra.run.smithi026.stdout: buildah x86_64 1.19.7-1.module_el8.4.0+786+4668b267 CentOS-AppStream 6.9 M 2021-11-03T16:41:52.222 INFO:teuthology.orchestra.run.smithi026.stdout: cockpit-podman noarch 29-2.module_el8.4.0+786+4668b267 CentOS-AppStream 1.1 M 2021-11-03T16:41:52.222 INFO:teuthology.orchestra.run.smithi026.stdout: skopeo x86_64 1:1.2.2-7.module_el8.4.0+786+4668b267 CentOS-AppStream 5.9 M 2021-11-03T16:41:52.223 INFO:teuthology.orchestra.run.smithi026.stdout: toolbox noarch 0.0.8-1.module_el8.4.0+786+4668b267 CentOS-AppStream 16 k 2021-11-03T16:41:52.223 INFO:teuthology.orchestra.run.smithi026.stdout: udica noarch 0.2.4-1.module_el8.4.0+786+4668b267 CentOS-AppStream 51 k 2021-11-03T16:41:52.223 INFO:teuthology.orchestra.run.smithi026.stdout:Downgrading: 2021-11-03T16:41:52.223 INFO:teuthology.orchestra.run.smithi026.stdout: conmon x86_64 2:2.0.26-1.module_el8.4.0+786+4668b267 CentOS-AppStream 51 k 2021-11-03T16:41:52.224 INFO:teuthology.orchestra.run.smithi026.stdout: container-selinux noarch 2:2.158.0-1.module_el8.4.0+786+4668b267 CentOS-AppStream 51 k 2021-11-03T16:41:52.224 INFO:teuthology.orchestra.run.smithi026.stdout: containers-common x86_64 1:1.2.2-7.module_el8.4.0+786+4668b267 CentOS-AppStream 97 k 2021-11-03T16:41:52.224 INFO:teuthology.orchestra.run.smithi026.stdout: crun x86_64 0.18-2.module_el8.4.0+786+4668b267 CentOS-AppStream 185 k 2021-11-03T16:41:52.225 INFO:teuthology.orchestra.run.smithi026.stdout: fuse-overlayfs x86_64 1.4.0-2.module_el8.4.0+786+4668b267 CentOS-AppStream 72 k 2021-11-03T16:41:52.225 INFO:teuthology.orchestra.run.smithi026.stdout: podman x86_64 3.0.1-6.module_el8.4.0+786+4668b267 CentOS-AppStream 11 M 2021-11-03T16:41:52.226 INFO:teuthology.orchestra.run.smithi026.stdout: podman-catatonit x86_64 3.0.1-6.module_el8.4.0+786+4668b267 CentOS-AppStream 320 k 2021-11-03T16:41:52.226 INFO:teuthology.orchestra.run.smithi026.stdout: podman-docker noarch 3.0.1-6.module_el8.4.0+786+4668b267 CentOS-AppStream 55 k 2021-11-03T16:41:52.227 INFO:teuthology.orchestra.run.smithi026.stdout: runc x86_64 1.0.0-71.rc92.module_el8.4.0+833+9763146c CentOS-AppStream 3.1 M 2021-11-03T16:41:52.227 INFO:teuthology.orchestra.run.smithi026.stdout:Installing module profiles: 2021-11-03T16:41:52.227 INFO:teuthology.orchestra.run.smithi026.stdout: container-tools/common 2021-11-03T16:41:52.227 INFO:teuthology.orchestra.run.smithi026.stdout:Enabling module streams: 2021-11-03T16:41:52.228 INFO:teuthology.orchestra.run.smithi026.stdout: container-tools 3.0 2021-11-03T16:41:52.228 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:41:52.228 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2021-11-03T16:41:52.229 INFO:teuthology.orchestra.run.smithi026.stdout:======================================================================================================== 2021-11-03T16:41:52.229 INFO:teuthology.orchestra.run.smithi026.stdout:Install 5 Packages 2021-11-03T16:41:52.229 INFO:teuthology.orchestra.run.smithi026.stdout:Upgrade 4 Packages 2021-11-03T16:41:52.229 INFO:teuthology.orchestra.run.smithi026.stdout:Downgrade 9 Packages 2021-11-03T16:41:52.229 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:41:52.230 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 49 M 2021-11-03T16:41:52.230 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2021-11-03T16:41:52.306 INFO:teuthology.orchestra.run.smithi026.stdout:(1/18): container-selinux-2.158.0-1.module_el8. 621 kB/s | 51 kB 00:00 2021-11-03T16:41:52.313 INFO:teuthology.orchestra.run.smithi026.stdout:(2/18): conmon-2.0.26-1.module_el8.4.0+786+4668 566 kB/s | 51 kB 00:00 2021-11-03T16:41:52.316 INFO:teuthology.orchestra.run.smithi026.stdout:(3/18): containers-common-1.2.2-7.module_el8.4. 1.0 MB/s | 97 kB 00:00 2021-11-03T16:41:52.331 INFO:teuthology.orchestra.run.smithi026.stdout:(4/18): fuse-overlayfs-1.4.0-2.module_el8.4.0+7 3.9 MB/s | 72 kB 00:00 2021-11-03T16:41:52.332 INFO:teuthology.orchestra.run.smithi026.stdout:(5/18): crun-0.18-2.module_el8.4.0+786+4668b267 6.9 MB/s | 185 kB 00:00 2021-11-03T16:41:52.343 INFO:teuthology.orchestra.run.smithi026.stdout:(6/18): podman-docker-3.0.1-6.module_el8.4.0+78 5.1 MB/s | 55 kB 00:00 2021-11-03T16:41:52.378 INFO:teuthology.orchestra.run.smithi026.stdout:(7/18): podman-catatonit-3.0.1-6.module_el8.4.0 6.6 MB/s | 320 kB 00:00 2021-11-03T16:41:52.430 INFO:teuthology.orchestra.run.smithi194.stdout:(8/18): runc-1.0.0-71.rc92.module_el8.4.0+833+9 11 MB/s | 3.1 MB 00:00 2021-11-03T16:41:52.523 INFO:teuthology.orchestra.run.smithi194.stdout:(9/18): cockpit-podman-29-2.module_el8.4.0+786+ 12 MB/s | 1.1 MB 00:00 2021-11-03T16:41:52.770 INFO:teuthology.orchestra.run.smithi194.stdout:(10/18): buildah-1.19.7-1.module_el8.4.0+786+46 12 MB/s | 6.9 MB 00:00 2021-11-03T16:41:52.778 INFO:teuthology.orchestra.run.smithi026.stdout:(8/18): runc-1.0.0-71.rc92.module_el8.4.0+833+9 7.0 MB/s | 3.1 MB 00:00 2021-11-03T16:41:52.791 INFO:teuthology.orchestra.run.smithi194.stdout:(11/18): toolbox-0.0.8-1.module_el8.4.0+786+466 784 kB/s | 16 kB 00:00 2021-11-03T16:41:52.820 INFO:teuthology.orchestra.run.smithi194.stdout:(12/18): udica-0.2.4-1.module_el8.4.0+786+4668b 1.7 MB/s | 51 kB 00:00 2021-11-03T16:41:52.918 INFO:teuthology.orchestra.run.smithi026.stdout:(9/18): cockpit-podman-29-2.module_el8.4.0+786+ 7.7 MB/s | 1.1 MB 00:00 2021-11-03T16:41:52.963 INFO:teuthology.orchestra.run.smithi194.stdout:(13/18): podman-3.0.1-6.module_el8.4.0+786+4668 13 MB/s | 11 MB 00:00 2021-11-03T16:41:53.026 INFO:teuthology.orchestra.run.smithi194.stdout:(14/18): skopeo-1.2.2-7.module_el8.4.0+786+4668 12 MB/s | 5.9 MB 00:00 2021-11-03T16:41:53.028 INFO:teuthology.orchestra.run.smithi194.stdout:(15/18): criu-3.15-1.module_el8.4.0+786+4668b26 7.7 MB/s | 511 kB 00:00 2021-11-03T16:41:53.047 INFO:teuthology.orchestra.run.smithi194.stdout:(16/18): libslirp-4.3.1-1.module_el8.4.0+786+46 3.3 MB/s | 69 kB 00:00 2021-11-03T16:41:53.048 INFO:teuthology.orchestra.run.smithi194.stdout:(17/18): slirp4netns-1.1.8-1.module_el8.4.0+786 2.4 MB/s | 51 kB 00:00 2021-11-03T16:41:53.211 INFO:teuthology.orchestra.run.smithi026.stdout:(10/18): buildah-1.19.7-1.module_el8.4.0+786+46 8.3 MB/s | 6.9 MB 00:00 2021-11-03T16:41:53.231 INFO:teuthology.orchestra.run.smithi026.stdout:(11/18): toolbox-0.0.8-1.module_el8.4.0+786+466 812 kB/s | 16 kB 00:00 2021-11-03T16:41:53.249 INFO:teuthology.orchestra.run.smithi026.stdout:(12/18): udica-0.2.4-1.module_el8.4.0+786+4668b 2.7 MB/s | 51 kB 00:00 2021-11-03T16:41:53.415 INFO:teuthology.orchestra.run.smithi026.stdout:(13/18): podman-3.0.1-6.module_el8.4.0+786+4668 10 MB/s | 11 MB 00:01 2021-11-03T16:41:53.537 INFO:teuthology.orchestra.run.smithi026.stdout:(14/18): skopeo-1.2.2-7.module_el8.4.0+786+4668 9.5 MB/s | 5.9 MB 00:00 2021-11-03T16:41:53.541 INFO:teuthology.orchestra.run.smithi026.stdout:(15/18): criu-3.15-1.module_el8.4.0+786+4668b26 3.9 MB/s | 511 kB 00:00 2021-11-03T16:41:53.560 INFO:teuthology.orchestra.run.smithi026.stdout:(16/18): libslirp-4.3.1-1.module_el8.4.0+786+46 2.9 MB/s | 69 kB 00:00 2021-11-03T16:41:53.567 INFO:teuthology.orchestra.run.smithi026.stdout:(17/18): slirp4netns-1.1.8-1.module_el8.4.0+786 2.0 MB/s | 51 kB 00:00 2021-11-03T16:41:53.732 INFO:teuthology.orchestra.run.smithi194.stdout:(18/18): containernetworking-plugins-0.9.1-1.mo 22 MB/s | 20 MB 00:00 2021-11-03T16:41:53.736 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2021-11-03T16:41:53.736 INFO:teuthology.orchestra.run.smithi194.stdout:Total 29 MB/s | 49 MB 00:01 2021-11-03T16:41:53.765 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2021-11-03T16:41:53.808 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2021-11-03T16:41:53.809 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2021-11-03T16:41:54.009 INFO:teuthology.orchestra.run.smithi026.stdout:(18/18): containernetworking-plugins-0.9.1-1.mo 26 MB/s | 20 MB 00:00 2021-11-03T16:41:54.013 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2021-11-03T16:41:54.013 INFO:teuthology.orchestra.run.smithi026.stdout:Total 28 MB/s | 49 MB 00:01 2021-11-03T16:41:54.044 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2021-11-03T16:41:54.091 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2021-11-03T16:41:54.092 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2021-11-03T16:41:54.286 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2021-11-03T16:41:54.289 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2021-11-03T16:41:54.591 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2021-11-03T16:41:54.595 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2021-11-03T16:41:55.376 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2021-11-03T16:41:55.409 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: fuse-overlayfs-1.4.0-2.module_el8.4.0+786+4668b267.x 1/1 2021-11-03T16:41:55.548 INFO:teuthology.orchestra.run.smithi194.stdout: Downgrading : fuse-overlayfs-1.4.0-2.module_el8.4.0+786+4668b267 1/31 2021-11-03T16:41:55.555 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: fuse-overlayfs-1.4.0-2.module_el8.4.0+786+4668b267 1/31 2021-11-03T16:41:55.571 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: container-selinux-2:2.158.0-1.module_el8.4.0+786+4 2/31 2021-11-03T16:41:55.697 INFO:teuthology.orchestra.run.smithi194.stdout: Downgrading : container-selinux-2:2.158.0-1.module_el8.4.0+786+4 2/31 2021-11-03T16:41:55.775 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2021-11-03T16:41:55.815 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: fuse-overlayfs-1.4.0-2.module_el8.4.0+786+4668b267.x 1/1 2021-11-03T16:41:55.941 INFO:teuthology.orchestra.run.smithi026.stdout: Downgrading : fuse-overlayfs-1.4.0-2.module_el8.4.0+786+4668b267 1/31 2021-11-03T16:41:55.949 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: fuse-overlayfs-1.4.0-2.module_el8.4.0+786+4668b267 1/31 2021-11-03T16:41:55.967 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: container-selinux-2:2.158.0-1.module_el8.4.0+786+4 2/31 2021-11-03T16:41:56.132 INFO:teuthology.orchestra.run.smithi026.stdout: Downgrading : container-selinux-2:2.158.0-1.module_el8.4.0+786+4 2/31 2021-11-03T16:42:10.890 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: container-selinux-2:2.158.0-1.module_el8.4.0+786+4 2/31 2021-11-03T16:42:11.050 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : libslirp-4.3.1-1.module_el8.4.0+786+4668b267.x86_6 3/31 2021-11-03T16:42:11.229 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : slirp4netns-1.1.8-1.module_el8.4.0+786+4668b267.x8 4/31 2021-11-03T16:42:11.446 INFO:teuthology.orchestra.run.smithi194.stdout: Downgrading : containers-common-1:1.2.2-7.module_el8.4.0+786+466 5/31 2021-11-03T16:42:11.964 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : criu-3.15-1.module_el8.4.0+786+4668b267.x86_64 6/31 2021-11-03T16:42:12.113 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: container-selinux-2:2.158.0-1.module_el8.4.0+786+4 2/31 2021-11-03T16:42:12.306 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : libslirp-4.3.1-1.module_el8.4.0+786+4668b267.x86_6 3/31 2021-11-03T16:42:12.467 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : slirp4netns-1.1.8-1.module_el8.4.0+786+4668b267.x8 4/31 2021-11-03T16:42:12.720 INFO:teuthology.orchestra.run.smithi026.stdout: Downgrading : containers-common-1:1.2.2-7.module_el8.4.0+786+466 5/31 2021-11-03T16:42:13.245 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : criu-3.15-1.module_el8.4.0+786+4668b267.x86_64 6/31 2021-11-03T16:42:13.781 INFO:teuthology.orchestra.run.smithi194.stdout: Downgrading : runc-1.0.0-71.rc92.module_el8.4.0+833+9763146c.x86 7/31 2021-11-03T16:42:14.014 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : containernetworking-plugins-0.9.1-1.module_el8.4.0 8/31 2021-11-03T16:42:14.152 INFO:teuthology.orchestra.run.smithi194.stdout: Downgrading : crun-0.18-2.module_el8.4.0+786+4668b267.x86_64 9/31 2021-11-03T16:42:14.320 INFO:teuthology.orchestra.run.smithi194.stdout: Downgrading : conmon-2:2.0.26-1.module_el8.4.0+786+4668b267.x86_ 10/31 2021-11-03T16:42:15.242 INFO:teuthology.orchestra.run.smithi026.stdout: Downgrading : runc-1.0.0-71.rc92.module_el8.4.0+833+9763146c.x86 7/31 2021-11-03T16:42:15.477 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : containernetworking-plugins-0.9.1-1.module_el8.4.0 8/31 2021-11-03T16:42:15.644 INFO:teuthology.orchestra.run.smithi026.stdout: Downgrading : crun-0.18-2.module_el8.4.0+786+4668b267.x86_64 9/31 2021-11-03T16:42:15.766 INFO:teuthology.orchestra.run.smithi194.stdout: Downgrading : podman-catatonit-3.0.1-6.module_el8.4.0+786+4668b2 11/31 2021-11-03T16:42:15.815 INFO:teuthology.orchestra.run.smithi026.stdout: Downgrading : conmon-2:2.0.26-1.module_el8.4.0+786+4668b267.x86_ 10/31 2021-11-03T16:42:16.049 INFO:teuthology.orchestra.run.smithi194.stdout: Downgrading : podman-3.0.1-6.module_el8.4.0+786+4668b267.x86_64 12/31 2021-11-03T16:42:16.277 INFO:teuthology.orchestra.run.smithi194.stdout: Downgrading : podman-docker-3.0.1-6.module_el8.4.0+786+4668b267. 13/31 2021-11-03T16:42:16.405 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cockpit-podman-29-2.module_el8.4.0+786+4668b267.no 14/31 2021-11-03T16:42:17.107 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : toolbox-0.0.8-1.module_el8.4.0+786+4668b267.noarch 15/31 2021-11-03T16:42:17.354 INFO:teuthology.orchestra.run.smithi026.stdout: Downgrading : podman-catatonit-3.0.1-6.module_el8.4.0+786+4668b2 11/31 2021-11-03T16:42:17.640 INFO:teuthology.orchestra.run.smithi026.stdout: Downgrading : podman-3.0.1-6.module_el8.4.0+786+4668b267.x86_64 12/31 2021-11-03T16:42:17.756 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : buildah-1.19.7-1.module_el8.4.0+786+4668b267.x86_6 16/31 2021-11-03T16:42:17.882 INFO:teuthology.orchestra.run.smithi026.stdout: Downgrading : podman-docker-3.0.1-6.module_el8.4.0+786+4668b267. 13/31 2021-11-03T16:42:17.903 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : skopeo-1:1.2.2-7.module_el8.4.0+786+4668b267.x86_6 17/31 2021-11-03T16:42:18.069 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : udica-0.2.4-1.module_el8.4.0+786+4668b267.noarch 18/31 2021-11-03T16:42:18.166 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : cockpit-podman-29-2.module_el8.4.0+786+4668b267.no 14/31 2021-11-03T16:42:18.173 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : podman-docker-3.2.3-0.11.module_el8.4.0+942+d25aad 19/31 2021-11-03T16:42:18.345 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : podman-3.2.3-0.11.module_el8.4.0+942+d25aada8.x86_ 20/31 2021-11-03T16:42:18.543 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : containers-common-1:1.2.2-10.module_el8.4.0+830+80 21/31 2021-11-03T16:42:18.695 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : slirp4netns-1.1.8-1.module_el8.4.0+641+6116a774.x8 22/31 2021-11-03T16:42:18.836 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : runc-1.0.0-73.rc93.module_el8.4.0+830+8027e1c4.x86 23/31 2021-11-03T16:42:18.837 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : container-selinux-2:2.162.0-1.module_el8.4.0+830+8 24/31 2021-11-03T16:42:18.934 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : toolbox-0.0.8-1.module_el8.4.0+786+4668b267.noarch 15/31 2021-11-03T16:42:18.978 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: container-selinux-2:2.162.0-1.module_el8.4.0+830+8 24/31 2021-11-03T16:42:19.103 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : podman-catatonit-3.2.3-0.11.module_el8.4.0+942+d25 25/31 2021-11-03T16:42:19.291 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : criu-3.15-1.module_el8.4.0+641+6116a774.x86_64 26/31 2021-11-03T16:42:19.436 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : libslirp-4.3.1-1.module_el8.4.0+575+63b40ad7.x86_6 27/31 2021-11-03T16:42:19.578 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : crun-0.18-2.module_el8.4.0+830+8027e1c4.x86_64 28/31 2021-11-03T16:42:19.642 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : buildah-1.19.7-1.module_el8.4.0+786+4668b267.x86_6 16/31 2021-11-03T16:42:19.720 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : fuse-overlayfs-1.4.0-3.module_el8.4.0+830+8027e1c4 29/31 2021-11-03T16:42:19.814 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : skopeo-1:1.2.2-7.module_el8.4.0+786+4668b267.x86_6 17/31 2021-11-03T16:42:19.864 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : conmon-2:2.0.26-3.module_el8.4.0+830+8027e1c4.x86_ 30/31 2021-11-03T16:42:20.021 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : udica-0.2.4-1.module_el8.4.0+786+4668b267.noarch 18/31 2021-11-03T16:42:20.044 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : containernetworking-plugins-0.9.1-1.module_el8.4.0 31/31 2021-11-03T16:42:20.160 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : podman-docker-3.2.3-0.11.module_el8.4.0+942+d25aad 19/31 2021-11-03T16:42:20.297 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : podman-3.2.3-0.11.module_el8.4.0+942+d25aada8.x86_ 20/31 2021-11-03T16:42:20.485 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : containers-common-1:1.2.2-10.module_el8.4.0+830+80 21/31 2021-11-03T16:42:20.647 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : slirp4netns-1.1.8-1.module_el8.4.0+641+6116a774.x8 22/31 2021-11-03T16:42:20.771 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : runc-1.0.0-73.rc93.module_el8.4.0+830+8027e1c4.x86 23/31 2021-11-03T16:42:20.771 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : container-selinux-2:2.162.0-1.module_el8.4.0+830+8 24/31 2021-11-03T16:42:20.939 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: container-selinux-2:2.162.0-1.module_el8.4.0+830+8 24/31 2021-11-03T16:42:21.046 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : podman-catatonit-3.2.3-0.11.module_el8.4.0+942+d25 25/31 2021-11-03T16:42:21.216 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : criu-3.15-1.module_el8.4.0+641+6116a774.x86_64 26/31 2021-11-03T16:42:21.338 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : libslirp-4.3.1-1.module_el8.4.0+575+63b40ad7.x86_6 27/31 2021-11-03T16:42:21.488 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : crun-0.18-2.module_el8.4.0+830+8027e1c4.x86_64 28/31 2021-11-03T16:42:21.629 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : fuse-overlayfs-1.4.0-3.module_el8.4.0+830+8027e1c4 29/31 2021-11-03T16:42:21.806 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : conmon-2:2.0.26-3.module_el8.4.0+830+8027e1c4.x86_ 30/31 2021-11-03T16:42:21.996 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : containernetworking-plugins-0.9.1-1.module_el8.4.0 31/31 2021-11-03T16:42:38.406 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: container-selinux-2:2.158.0-1.module_el8.4.0+786+4 31/31 2021-11-03T16:42:38.856 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: containernetworking-plugins-0.9.1-1.module_el8.4.0 31/31 2021-11-03T16:42:38.857 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : conmon-2:2.0.26-1.module_el8.4.0+786+4668b267.x86_ 1/31 2021-11-03T16:42:38.857 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : conmon-2:2.0.26-3.module_el8.4.0+830+8027e1c4.x86_ 2/31 2021-11-03T16:42:38.857 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : container-selinux-2:2.158.0-1.module_el8.4.0+786+4 3/31 2021-11-03T16:42:38.857 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : container-selinux-2:2.162.0-1.module_el8.4.0+830+8 4/31 2021-11-03T16:42:38.858 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : containers-common-1:1.2.2-7.module_el8.4.0+786+466 5/31 2021-11-03T16:42:38.858 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : containers-common-1:1.2.2-10.module_el8.4.0+830+80 6/31 2021-11-03T16:42:38.858 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : crun-0.18-2.module_el8.4.0+786+4668b267.x86_64 7/31 2021-11-03T16:42:38.858 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : crun-0.18-2.module_el8.4.0+830+8027e1c4.x86_64 8/31 2021-11-03T16:42:38.859 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : fuse-overlayfs-1.4.0-2.module_el8.4.0+786+4668b267 9/31 2021-11-03T16:42:38.859 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : fuse-overlayfs-1.4.0-3.module_el8.4.0+830+8027e1c4 10/31 2021-11-03T16:42:38.859 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : podman-3.0.1-6.module_el8.4.0+786+4668b267.x86_64 11/31 2021-11-03T16:42:38.859 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : podman-3.2.3-0.11.module_el8.4.0+942+d25aada8.x86_ 12/31 2021-11-03T16:42:38.859 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : podman-catatonit-3.0.1-6.module_el8.4.0+786+4668b2 13/31 2021-11-03T16:42:38.860 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : podman-catatonit-3.2.3-0.11.module_el8.4.0+942+d25 14/31 2021-11-03T16:42:38.861 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : podman-docker-3.0.1-6.module_el8.4.0+786+4668b267. 15/31 2021-11-03T16:42:38.861 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : podman-docker-3.2.3-0.11.module_el8.4.0+942+d25aad 16/31 2021-11-03T16:42:38.861 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : runc-1.0.0-71.rc92.module_el8.4.0+833+9763146c.x86 17/31 2021-11-03T16:42:38.862 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : runc-1.0.0-73.rc93.module_el8.4.0+830+8027e1c4.x86 18/31 2021-11-03T16:42:38.863 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : buildah-1.19.7-1.module_el8.4.0+786+4668b267.x86_6 19/31 2021-11-03T16:42:38.863 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cockpit-podman-29-2.module_el8.4.0+786+4668b267.no 20/31 2021-11-03T16:42:38.863 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : skopeo-1:1.2.2-7.module_el8.4.0+786+4668b267.x86_6 21/31 2021-11-03T16:42:38.863 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : toolbox-0.0.8-1.module_el8.4.0+786+4668b267.noarch 22/31 2021-11-03T16:42:38.864 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : udica-0.2.4-1.module_el8.4.0+786+4668b267.noarch 23/31 2021-11-03T16:42:38.864 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : containernetworking-plugins-0.9.1-1.module_el8.4.0 24/31 2021-11-03T16:42:38.864 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : containernetworking-plugins-0.9.1-1.module_el8.4.0 25/31 2021-11-03T16:42:38.864 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : criu-3.15-1.module_el8.4.0+786+4668b267.x86_64 26/31 2021-11-03T16:42:38.865 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : criu-3.15-1.module_el8.4.0+641+6116a774.x86_64 27/31 2021-11-03T16:42:38.865 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libslirp-4.3.1-1.module_el8.4.0+786+4668b267.x86_6 28/31 2021-11-03T16:42:38.865 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libslirp-4.3.1-1.module_el8.4.0+575+63b40ad7.x86_6 29/31 2021-11-03T16:42:38.865 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : slirp4netns-1.1.8-1.module_el8.4.0+786+4668b267.x8 30/31 2021-11-03T16:42:39.398 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : slirp4netns-1.1.8-1.module_el8.4.0+641+6116a774.x8 31/31 2021-11-03T16:42:39.398 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:42:39.399 INFO:teuthology.orchestra.run.smithi194.stdout:Upgraded: 2021-11-03T16:42:39.399 INFO:teuthology.orchestra.run.smithi194.stdout: containernetworking-plugins-0.9.1-1.module_el8.4.0+786+4668b267.x86_64 2021-11-03T16:42:39.399 INFO:teuthology.orchestra.run.smithi194.stdout: criu-3.15-1.module_el8.4.0+786+4668b267.x86_64 2021-11-03T16:42:39.399 INFO:teuthology.orchestra.run.smithi194.stdout: libslirp-4.3.1-1.module_el8.4.0+786+4668b267.x86_64 2021-11-03T16:42:39.400 INFO:teuthology.orchestra.run.smithi194.stdout: slirp4netns-1.1.8-1.module_el8.4.0+786+4668b267.x86_64 2021-11-03T16:42:39.400 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:42:39.400 INFO:teuthology.orchestra.run.smithi194.stdout:Downgraded: 2021-11-03T16:42:39.400 INFO:teuthology.orchestra.run.smithi194.stdout: conmon-2:2.0.26-1.module_el8.4.0+786+4668b267.x86_64 2021-11-03T16:42:39.400 INFO:teuthology.orchestra.run.smithi194.stdout: container-selinux-2:2.158.0-1.module_el8.4.0+786+4668b267.noarch 2021-11-03T16:42:39.401 INFO:teuthology.orchestra.run.smithi194.stdout: containers-common-1:1.2.2-7.module_el8.4.0+786+4668b267.x86_64 2021-11-03T16:42:39.401 INFO:teuthology.orchestra.run.smithi194.stdout: crun-0.18-2.module_el8.4.0+786+4668b267.x86_64 2021-11-03T16:42:39.401 INFO:teuthology.orchestra.run.smithi194.stdout: fuse-overlayfs-1.4.0-2.module_el8.4.0+786+4668b267.x86_64 2021-11-03T16:42:39.401 INFO:teuthology.orchestra.run.smithi194.stdout: podman-3.0.1-6.module_el8.4.0+786+4668b267.x86_64 2021-11-03T16:42:39.402 INFO:teuthology.orchestra.run.smithi194.stdout: podman-catatonit-3.0.1-6.module_el8.4.0+786+4668b267.x86_64 2021-11-03T16:42:39.402 INFO:teuthology.orchestra.run.smithi194.stdout: podman-docker-3.0.1-6.module_el8.4.0+786+4668b267.noarch 2021-11-03T16:42:39.402 INFO:teuthology.orchestra.run.smithi194.stdout: runc-1.0.0-71.rc92.module_el8.4.0+833+9763146c.x86_64 2021-11-03T16:42:39.402 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:42:39.402 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2021-11-03T16:42:39.403 INFO:teuthology.orchestra.run.smithi194.stdout: buildah-1.19.7-1.module_el8.4.0+786+4668b267.x86_64 2021-11-03T16:42:39.403 INFO:teuthology.orchestra.run.smithi194.stdout: cockpit-podman-29-2.module_el8.4.0+786+4668b267.noarch 2021-11-03T16:42:39.403 INFO:teuthology.orchestra.run.smithi194.stdout: skopeo-1:1.2.2-7.module_el8.4.0+786+4668b267.x86_64 2021-11-03T16:42:39.403 INFO:teuthology.orchestra.run.smithi194.stdout: toolbox-0.0.8-1.module_el8.4.0+786+4668b267.noarch 2021-11-03T16:42:39.403 INFO:teuthology.orchestra.run.smithi194.stdout: udica-0.2.4-1.module_el8.4.0+786+4668b267.noarch 2021-11-03T16:42:39.404 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:42:39.404 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2021-11-03T16:42:39.647 DEBUG:teuthology.parallel:result is None 2021-11-03T16:42:42.140 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: container-selinux-2:2.158.0-1.module_el8.4.0+786+4 31/31 2021-11-03T16:42:42.664 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: containernetworking-plugins-0.9.1-1.module_el8.4.0 31/31 2021-11-03T16:42:42.665 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : conmon-2:2.0.26-1.module_el8.4.0+786+4668b267.x86_ 1/31 2021-11-03T16:42:42.665 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : conmon-2:2.0.26-3.module_el8.4.0+830+8027e1c4.x86_ 2/31 2021-11-03T16:42:42.665 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : container-selinux-2:2.158.0-1.module_el8.4.0+786+4 3/31 2021-11-03T16:42:42.665 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : container-selinux-2:2.162.0-1.module_el8.4.0+830+8 4/31 2021-11-03T16:42:42.666 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : containers-common-1:1.2.2-7.module_el8.4.0+786+466 5/31 2021-11-03T16:42:42.666 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : containers-common-1:1.2.2-10.module_el8.4.0+830+80 6/31 2021-11-03T16:42:42.666 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : crun-0.18-2.module_el8.4.0+786+4668b267.x86_64 7/31 2021-11-03T16:42:42.666 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : crun-0.18-2.module_el8.4.0+830+8027e1c4.x86_64 8/31 2021-11-03T16:42:42.667 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : fuse-overlayfs-1.4.0-2.module_el8.4.0+786+4668b267 9/31 2021-11-03T16:42:42.667 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : fuse-overlayfs-1.4.0-3.module_el8.4.0+830+8027e1c4 10/31 2021-11-03T16:42:42.667 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : podman-3.0.1-6.module_el8.4.0+786+4668b267.x86_64 11/31 2021-11-03T16:42:42.667 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : podman-3.2.3-0.11.module_el8.4.0+942+d25aada8.x86_ 12/31 2021-11-03T16:42:42.667 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : podman-catatonit-3.0.1-6.module_el8.4.0+786+4668b2 13/31 2021-11-03T16:42:42.668 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : podman-catatonit-3.2.3-0.11.module_el8.4.0+942+d25 14/31 2021-11-03T16:42:42.668 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : podman-docker-3.0.1-6.module_el8.4.0+786+4668b267. 15/31 2021-11-03T16:42:42.669 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : podman-docker-3.2.3-0.11.module_el8.4.0+942+d25aad 16/31 2021-11-03T16:42:42.669 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : runc-1.0.0-71.rc92.module_el8.4.0+833+9763146c.x86 17/31 2021-11-03T16:42:42.669 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : runc-1.0.0-73.rc93.module_el8.4.0+830+8027e1c4.x86 18/31 2021-11-03T16:42:42.669 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : buildah-1.19.7-1.module_el8.4.0+786+4668b267.x86_6 19/31 2021-11-03T16:42:42.669 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : cockpit-podman-29-2.module_el8.4.0+786+4668b267.no 20/31 2021-11-03T16:42:42.670 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : skopeo-1:1.2.2-7.module_el8.4.0+786+4668b267.x86_6 21/31 2021-11-03T16:42:42.670 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : toolbox-0.0.8-1.module_el8.4.0+786+4668b267.noarch 22/31 2021-11-03T16:42:42.671 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : udica-0.2.4-1.module_el8.4.0+786+4668b267.noarch 23/31 2021-11-03T16:42:42.671 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : containernetworking-plugins-0.9.1-1.module_el8.4.0 24/31 2021-11-03T16:42:42.671 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : containernetworking-plugins-0.9.1-1.module_el8.4.0 25/31 2021-11-03T16:42:42.671 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : criu-3.15-1.module_el8.4.0+786+4668b267.x86_64 26/31 2021-11-03T16:42:42.671 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : criu-3.15-1.module_el8.4.0+641+6116a774.x86_64 27/31 2021-11-03T16:42:42.672 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libslirp-4.3.1-1.module_el8.4.0+786+4668b267.x86_6 28/31 2021-11-03T16:42:42.672 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libslirp-4.3.1-1.module_el8.4.0+575+63b40ad7.x86_6 29/31 2021-11-03T16:42:42.672 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : slirp4netns-1.1.8-1.module_el8.4.0+786+4668b267.x8 30/31 2021-11-03T16:42:43.256 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : slirp4netns-1.1.8-1.module_el8.4.0+641+6116a774.x8 31/31 2021-11-03T16:42:43.256 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:42:43.256 INFO:teuthology.orchestra.run.smithi026.stdout:Upgraded: 2021-11-03T16:42:43.257 INFO:teuthology.orchestra.run.smithi026.stdout: containernetworking-plugins-0.9.1-1.module_el8.4.0+786+4668b267.x86_64 2021-11-03T16:42:43.257 INFO:teuthology.orchestra.run.smithi026.stdout: criu-3.15-1.module_el8.4.0+786+4668b267.x86_64 2021-11-03T16:42:43.257 INFO:teuthology.orchestra.run.smithi026.stdout: libslirp-4.3.1-1.module_el8.4.0+786+4668b267.x86_64 2021-11-03T16:42:43.257 INFO:teuthology.orchestra.run.smithi026.stdout: slirp4netns-1.1.8-1.module_el8.4.0+786+4668b267.x86_64 2021-11-03T16:42:43.257 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:42:43.258 INFO:teuthology.orchestra.run.smithi026.stdout:Downgraded: 2021-11-03T16:42:43.258 INFO:teuthology.orchestra.run.smithi026.stdout: conmon-2:2.0.26-1.module_el8.4.0+786+4668b267.x86_64 2021-11-03T16:42:43.258 INFO:teuthology.orchestra.run.smithi026.stdout: container-selinux-2:2.158.0-1.module_el8.4.0+786+4668b267.noarch 2021-11-03T16:42:43.258 INFO:teuthology.orchestra.run.smithi026.stdout: containers-common-1:1.2.2-7.module_el8.4.0+786+4668b267.x86_64 2021-11-03T16:42:43.259 INFO:teuthology.orchestra.run.smithi026.stdout: crun-0.18-2.module_el8.4.0+786+4668b267.x86_64 2021-11-03T16:42:43.259 INFO:teuthology.orchestra.run.smithi026.stdout: fuse-overlayfs-1.4.0-2.module_el8.4.0+786+4668b267.x86_64 2021-11-03T16:42:43.259 INFO:teuthology.orchestra.run.smithi026.stdout: podman-3.0.1-6.module_el8.4.0+786+4668b267.x86_64 2021-11-03T16:42:43.259 INFO:teuthology.orchestra.run.smithi026.stdout: podman-catatonit-3.0.1-6.module_el8.4.0+786+4668b267.x86_64 2021-11-03T16:42:43.260 INFO:teuthology.orchestra.run.smithi026.stdout: podman-docker-3.0.1-6.module_el8.4.0+786+4668b267.noarch 2021-11-03T16:42:43.260 INFO:teuthology.orchestra.run.smithi026.stdout: runc-1.0.0-71.rc92.module_el8.4.0+833+9763146c.x86_64 2021-11-03T16:42:43.260 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:42:43.260 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2021-11-03T16:42:43.260 INFO:teuthology.orchestra.run.smithi026.stdout: buildah-1.19.7-1.module_el8.4.0+786+4668b267.x86_64 2021-11-03T16:42:43.261 INFO:teuthology.orchestra.run.smithi026.stdout: cockpit-podman-29-2.module_el8.4.0+786+4668b267.noarch 2021-11-03T16:42:43.261 INFO:teuthology.orchestra.run.smithi026.stdout: skopeo-1:1.2.2-7.module_el8.4.0+786+4668b267.x86_64 2021-11-03T16:42:43.261 INFO:teuthology.orchestra.run.smithi026.stdout: toolbox-0.0.8-1.module_el8.4.0+786+4668b267.noarch 2021-11-03T16:42:43.261 INFO:teuthology.orchestra.run.smithi026.stdout: udica-0.2.4-1.module_el8.4.0+786+4668b267.noarch 2021-11-03T16:42:43.261 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:42:43.262 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2021-11-03T16:42:43.521 DEBUG:teuthology.parallel:result is None 2021-11-03T16:42:43.522 INFO:teuthology.run_tasks:Running task install... 2021-11-03T16:42:43.531 DEBUG:teuthology.task.install:project ceph 2021-11-03T16:42:43.532 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '6e90212d8510e2d506395a8c82057d0d1787f3a4'}} 2021-11-03T16:42:43.532 DEBUG:teuthology.task.install:config {'exclude_packages': ['ceph-volume'], 'tag': 'v16.2.4', 'sha1': '6e90212d8510e2d506395a8c82057d0d1787f3a4'} 2021-11-03T16:42:43.533 INFO:teuthology.task.install:Using flavor: default 2021-11-03T16:42:43.540 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2021-11-03T16:42:43.541 INFO:teuthology.task.install:extra packages: [] 2021-11-03T16:42:43.541 DEBUG:teuthology.orchestra.run.smithi026:> sudo lsb_release -is 2021-11-03T16:42:43.574 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS 2021-11-03T16:42:43.576 DEBUG:teuthology.misc:System to be installed: CentOS 2021-11-03T16:42:43.576 DEBUG:teuthology.orchestra.run.smithi194:> sudo lsb_release -is 2021-11-03T16:42:43.577 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6e90212d8510e2d506395a8c82057d0d1787f3a4', 'tag': 'v16.2.4', 'wait_for_package': False} 2021-11-03T16:42:43.578 DEBUG:teuthology.orchestra.run.smithi026:> sudo lsb_release -is 2021-11-03T16:42:43.619 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS 2021-11-03T16:42:43.620 DEBUG:teuthology.misc:System to be installed: CentOS 2021-11-03T16:42:43.620 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6e90212d8510e2d506395a8c82057d0d1787f3a4', 'tag': 'v16.2.4', 'wait_for_package': False} 2021-11-03T16:42:43.620 DEBUG:teuthology.orchestra.run.smithi194:> sudo lsb_release -is 2021-11-03T16:42:43.650 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS 2021-11-03T16:42:43.652 DEBUG:teuthology.misc:System to be installed: CentOS 2021-11-03T16:42:43.652 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2021-11-03T16:42:43.653 INFO:teuthology.packaging:ref: None 2021-11-03T16:42:43.653 INFO:teuthology.packaging:tag: v16.2.4 2021-11-03T16:42:43.653 INFO:teuthology.packaging:branch: None 2021-11-03T16:42:43.654 INFO:teuthology.packaging:sha1: 6e90212d8510e2d506395a8c82057d0d1787f3a4 2021-11-03T16:42:43.689 DEBUG:teuthology.repo_utils:git ls-remote git://git.ceph.com/ceph-ci v16.2.4^{} -> 3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2021-11-03T16:42:43.690 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2021-11-03T16:42:43.741 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS 2021-11-03T16:42:43.741 DEBUG:teuthology.misc:System to be installed: CentOS 2021-11-03T16:42:43.742 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2021-11-03T16:42:43.742 INFO:teuthology.packaging:ref: None 2021-11-03T16:42:43.743 INFO:teuthology.packaging:tag: v16.2.4 2021-11-03T16:42:43.743 INFO:teuthology.packaging:branch: None 2021-11-03T16:42:43.743 INFO:teuthology.packaging:sha1: 6e90212d8510e2d506395a8c82057d0d1787f3a4 2021-11-03T16:42:43.771 DEBUG:teuthology.repo_utils:git ls-remote git://git.ceph.com/ceph-ci v16.2.4^{} -> 3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2021-11-03T16:42:43.772 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2021-11-03T16:42:43.926 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/ 2021-11-03T16:42:43.927 INFO:teuthology.task.install.rpm:Package version is 16.2.4-0 2021-11-03T16:42:43.965 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2021-11-03T16:42:43.966 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2021-11-03T16:42:43.967 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/yum.repos.d/ceph.repo 2021-11-03T16:42:43.995 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/ 2021-11-03T16:42:43.995 INFO:teuthology.task.install.rpm:Package version is 16.2.4-0 2021-11-03T16:42:43.998 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2021-11-03T16:42:43.999 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2021-11-03T16:42:43.999 INFO:teuthology.packaging:ref: None 2021-11-03T16:42:43.999 INFO:teuthology.packaging:tag: v16.2.4 2021-11-03T16:42:44.000 INFO:teuthology.packaging:branch: None 2021-11-03T16:42:44.000 INFO:teuthology.packaging:sha1: 6e90212d8510e2d506395a8c82057d0d1787f3a4 2021-11-03T16:42:44.000 DEBUG:teuthology.orchestra.run.smithi026:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v16.2.4/;g' /etc/yum.repos.d/ceph.repo ; fi 2021-11-03T16:42:44.024 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2021-11-03T16:42:44.024 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2021-11-03T16:42:44.025 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/yum.repos.d/ceph.repo 2021-11-03T16:42:44.053 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2021-11-03T16:42:44.053 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2021-11-03T16:42:44.054 INFO:teuthology.packaging:ref: None 2021-11-03T16:42:44.054 INFO:teuthology.packaging:tag: v16.2.4 2021-11-03T16:42:44.055 INFO:teuthology.packaging:branch: None 2021-11-03T16:42:44.055 INFO:teuthology.packaging:sha1: 6e90212d8510e2d506395a8c82057d0d1787f3a4 2021-11-03T16:42:44.056 DEBUG:teuthology.orchestra.run.smithi194:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v16.2.4/;g' /etc/yum.repos.d/ceph.repo ; fi 2021-11-03T16:42:44.064 DEBUG:teuthology.orchestra.run.smithi026:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2021-11-03T16:42:44.122 DEBUG:teuthology.orchestra.run.smithi194:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2021-11-03T16:42:44.140 DEBUG:teuthology.orchestra.run.smithi026:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2021-11-03T16:42:44.200 DEBUG:teuthology.orchestra.run.smithi194:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2021-11-03T16:42:44.204 INFO:teuthology.orchestra.run.smithi026.stdout:check_obsoletes = 1 2021-11-03T16:42:44.206 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum clean all 2021-11-03T16:42:44.264 INFO:teuthology.orchestra.run.smithi194.stdout:check_obsoletes = 1 2021-11-03T16:42:44.266 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum clean all 2021-11-03T16:42:44.456 INFO:teuthology.orchestra.run.smithi026.stdout:87 files removed 2021-11-03T16:42:44.476 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-radosgw 2021-11-03T16:42:44.505 INFO:teuthology.orchestra.run.smithi194.stdout:87 files removed 2021-11-03T16:42:44.524 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-radosgw 2021-11-03T16:42:44.853 INFO:teuthology.orchestra.run.smithi026.stdout:ceph packages for x86_64 2.5 MB/s | 74 kB 00:00 2021-11-03T16:42:44.876 INFO:teuthology.orchestra.run.smithi194.stdout:ceph packages for x86_64 2.9 MB/s | 74 kB 00:00 2021-11-03T16:42:44.911 INFO:teuthology.orchestra.run.smithi026.stdout:ceph noarch packages 599 kB/s | 15 kB 00:00 2021-11-03T16:42:44.932 INFO:teuthology.orchestra.run.smithi194.stdout:ceph noarch packages 631 kB/s | 15 kB 00:00 2021-11-03T16:42:44.961 INFO:teuthology.orchestra.run.smithi026.stdout:ceph source packages 71 kB/s | 1.7 kB 00:00 2021-11-03T16:42:44.978 INFO:teuthology.orchestra.run.smithi194.stdout:ceph source packages 77 kB/s | 1.7 kB 00:00 2021-11-03T16:42:45.432 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS-8 - AppStream 22 MB/s | 9.5 MB 00:00 2021-11-03T16:42:45.433 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS-8 - AppStream 21 MB/s | 9.5 MB 00:00 2021-11-03T16:42:47.139 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS-8 - Base 33 MB/s | 7.5 MB 00:00 2021-11-03T16:42:47.277 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS-8 - Base 27 MB/s | 7.5 MB 00:00 2021-11-03T16:42:48.212 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS-8 - Extras 161 kB/s | 10 kB 00:00 2021-11-03T16:42:48.439 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS-8 - Extras 156 kB/s | 10 kB 00:00 2021-11-03T16:42:50.971 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Linux 8 - AppStream 3.5 MB/s | 9.5 MB 00:02 2021-11-03T16:42:51.127 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Linux 8 - AppStream 3.6 MB/s | 9.5 MB 00:02 2021-11-03T16:42:53.350 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Linux 8 - BaseOS 11 MB/s | 7.5 MB 00:00 2021-11-03T16:42:53.353 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Linux 8 - BaseOS 8.8 MB/s | 7.5 MB 00:00 2021-11-03T16:42:54.617 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Linux 8 - Extras 58 kB/s | 10 kB 00:00 2021-11-03T16:42:54.711 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Linux 8 - Extras 32 kB/s | 10 kB 00:00 2021-11-03T16:42:54.831 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS-8 - PowerTools 16 MB/s | 2.4 MB 00:00 2021-11-03T16:42:54.927 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS-8 - PowerTools 15 MB/s | 2.4 MB 00:00 2021-11-03T16:42:55.389 INFO:teuthology.orchestra.run.smithi026.stdout:Copr repo for python3-asyncssh owned by ceph 37 kB/s | 3.5 kB 00:00 2021-11-03T16:42:55.424 INFO:teuthology.orchestra.run.smithi194.stdout:Copr repo for python3-asyncssh owned by ceph 45 kB/s | 3.5 kB 00:00 2021-11-03T16:42:56.646 INFO:teuthology.orchestra.run.smithi026.stdout:Apache Arrow 130 kB/s | 156 kB 00:01 2021-11-03T16:42:56.681 INFO:teuthology.orchestra.run.smithi194.stdout:Apache Arrow 130 kB/s | 156 kB 00:01 2021-11-03T16:42:57.486 INFO:teuthology.orchestra.run.smithi026.stdout:Extra Packages for Enterprise Linux 14 MB/s | 11 MB 00:00 2021-11-03T16:42:57.505 INFO:teuthology.orchestra.run.smithi194.stdout:Extra Packages for Enterprise Linux 14 MB/s | 11 MB 00:00 2021-11-03T16:42:59.704 INFO:teuthology.orchestra.run.smithi194.stdout:lab-extras 4.2 MB/s | 24 kB 00:00 2021-11-03T16:42:59.913 INFO:teuthology.orchestra.run.smithi026.stdout:lab-extras 4.8 MB/s | 24 kB 00:00 2021-11-03T16:43:02.067 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2021-11-03T16:43:02.070 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:43:02.070 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2021-11-03T16:43:02.071 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:43:02.071 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2021-11-03T16:43:02.071 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-radosgw x86_64 2:16.2.4-0.el8 ceph 13 M 2021-11-03T16:43:02.071 INFO:teuthology.orchestra.run.smithi194.stdout:Upgrading: 2021-11-03T16:43:02.072 INFO:teuthology.orchestra.run.smithi194.stdout: librados2 x86_64 2:16.2.4-0.el8 ceph 3.7 M 2021-11-03T16:43:02.072 INFO:teuthology.orchestra.run.smithi194.stdout: librbd1 x86_64 2:16.2.4-0.el8 ceph 4.0 M 2021-11-03T16:43:02.072 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2021-11-03T16:43:02.072 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-base x86_64 2:16.2.4-0.el8 ceph 6.0 M 2021-11-03T16:43:02.073 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-common x86_64 2:16.2.4-0.el8 ceph 24 M 2021-11-03T16:43:02.073 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-selinux x86_64 2:16.2.4-0.el8 ceph 25 k 2021-11-03T16:43:02.073 INFO:teuthology.orchestra.run.smithi194.stdout: daxctl-libs x86_64 71.1-2.el8 CentOS-Base 41 k 2021-11-03T16:43:02.073 INFO:teuthology.orchestra.run.smithi194.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2021-11-03T16:43:02.073 INFO:teuthology.orchestra.run.smithi194.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2021-11-03T16:43:02.074 INFO:teuthology.orchestra.run.smithi194.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2021-11-03T16:43:02.074 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs2 x86_64 2:16.2.4-0.el8 ceph 801 k 2021-11-03T16:43:02.074 INFO:teuthology.orchestra.run.smithi194.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2021-11-03T16:43:02.074 INFO:teuthology.orchestra.run.smithi194.stdout: libpmemobj x86_64 1.6.1-1.el8 CentOS-AppStream 145 k 2021-11-03T16:43:02.075 INFO:teuthology.orchestra.run.smithi194.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-Base 47 k 2021-11-03T16:43:02.075 INFO:teuthology.orchestra.run.smithi194.stdout: libradosstriper1 x86_64 2:16.2.4-0.el8 ceph 486 k 2021-11-03T16:43:02.075 INFO:teuthology.orchestra.run.smithi194.stdout: librdkafka x86_64 0.11.4-1.el8 CentOS-AppStream 353 k 2021-11-03T16:43:02.075 INFO:teuthology.orchestra.run.smithi194.stdout: librgw2 x86_64 2:16.2.4-0.el8 ceph 4.1 M 2021-11-03T16:43:02.076 INFO:teuthology.orchestra.run.smithi194.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2021-11-03T16:43:02.076 INFO:teuthology.orchestra.run.smithi194.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2021-11-03T16:43:02.076 INFO:teuthology.orchestra.run.smithi194.stdout: ndctl-libs x86_64 71.1-2.el8 CentOS-Base 78 k 2021-11-03T16:43:02.076 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-argparse x86_64 2:16.2.4-0.el8 ceph 44 k 2021-11-03T16:43:02.076 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-common x86_64 2:16.2.4-0.el8 ceph 80 k 2021-11-03T16:43:02.077 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cephfs x86_64 2:16.2.4-0.el8 ceph 213 k 2021-11-03T16:43:02.077 INFO:teuthology.orchestra.run.smithi194.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2021-11-03T16:43:02.077 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rados x86_64 2:16.2.4-0.el8 ceph 387 k 2021-11-03T16:43:02.077 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rbd x86_64 2:16.2.4-0.el8 ceph 368 k 2021-11-03T16:43:02.078 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rgw x86_64 2:16.2.4-0.el8 ceph 114 k 2021-11-03T16:43:02.078 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:43:02.078 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2021-11-03T16:43:02.078 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:43:02.078 INFO:teuthology.orchestra.run.smithi194.stdout:Install 25 Packages 2021-11-03T16:43:02.079 INFO:teuthology.orchestra.run.smithi194.stdout:Upgrade 2 Packages 2021-11-03T16:43:02.079 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:43:02.080 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 59 M 2021-11-03T16:43:02.080 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2021-11-03T16:43:02.345 INFO:teuthology.orchestra.run.smithi194.stdout:(1/27): ceph-base-16.2.4-0.el8.x86_64.rpm 22 MB/s | 6.0 MB 00:00 2021-11-03T16:43:02.346 INFO:teuthology.orchestra.run.smithi194.stdout:(2/27): ceph-selinux-16.2.4-0.el8.x86_64.rpm 19 MB/s | 25 kB 00:00 2021-11-03T16:43:02.375 INFO:teuthology.orchestra.run.smithi194.stdout:(3/27): libcephfs2-16.2.4-0.el8.x86_64.rpm 27 MB/s | 801 kB 00:00 2021-11-03T16:43:02.394 INFO:teuthology.orchestra.run.smithi194.stdout:(4/27): libradosstriper1-16.2.4-0.el8.x86_64.rp 27 MB/s | 486 kB 00:00 2021-11-03T16:43:02.446 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2021-11-03T16:43:02.449 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:43:02.449 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2021-11-03T16:43:02.449 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:43:02.450 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2021-11-03T16:43:02.450 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-radosgw x86_64 2:16.2.4-0.el8 ceph 13 M 2021-11-03T16:43:02.450 INFO:teuthology.orchestra.run.smithi026.stdout:Upgrading: 2021-11-03T16:43:02.450 INFO:teuthology.orchestra.run.smithi026.stdout: librados2 x86_64 2:16.2.4-0.el8 ceph 3.7 M 2021-11-03T16:43:02.451 INFO:teuthology.orchestra.run.smithi026.stdout: librbd1 x86_64 2:16.2.4-0.el8 ceph 4.0 M 2021-11-03T16:43:02.451 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2021-11-03T16:43:02.451 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-base x86_64 2:16.2.4-0.el8 ceph 6.0 M 2021-11-03T16:43:02.451 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-common x86_64 2:16.2.4-0.el8 ceph 24 M 2021-11-03T16:43:02.452 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-selinux x86_64 2:16.2.4-0.el8 ceph 25 k 2021-11-03T16:43:02.452 INFO:teuthology.orchestra.run.smithi026.stdout: daxctl-libs x86_64 71.1-2.el8 CentOS-Base 41 k 2021-11-03T16:43:02.452 INFO:teuthology.orchestra.run.smithi026.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2021-11-03T16:43:02.452 INFO:teuthology.orchestra.run.smithi026.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2021-11-03T16:43:02.453 INFO:teuthology.orchestra.run.smithi026.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2021-11-03T16:43:02.453 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs2 x86_64 2:16.2.4-0.el8 ceph 801 k 2021-11-03T16:43:02.453 INFO:teuthology.orchestra.run.smithi026.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2021-11-03T16:43:02.453 INFO:teuthology.orchestra.run.smithi026.stdout: libpmemobj x86_64 1.6.1-1.el8 CentOS-AppStream 145 k 2021-11-03T16:43:02.453 INFO:teuthology.orchestra.run.smithi026.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-Base 47 k 2021-11-03T16:43:02.454 INFO:teuthology.orchestra.run.smithi026.stdout: libradosstriper1 x86_64 2:16.2.4-0.el8 ceph 486 k 2021-11-03T16:43:02.454 INFO:teuthology.orchestra.run.smithi026.stdout: librdkafka x86_64 0.11.4-1.el8 CentOS-AppStream 353 k 2021-11-03T16:43:02.454 INFO:teuthology.orchestra.run.smithi026.stdout: librgw2 x86_64 2:16.2.4-0.el8 ceph 4.1 M 2021-11-03T16:43:02.454 INFO:teuthology.orchestra.run.smithi026.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2021-11-03T16:43:02.455 INFO:teuthology.orchestra.run.smithi026.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2021-11-03T16:43:02.455 INFO:teuthology.orchestra.run.smithi026.stdout: ndctl-libs x86_64 71.1-2.el8 CentOS-Base 78 k 2021-11-03T16:43:02.455 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-argparse x86_64 2:16.2.4-0.el8 ceph 44 k 2021-11-03T16:43:02.455 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-common x86_64 2:16.2.4-0.el8 ceph 80 k 2021-11-03T16:43:02.455 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cephfs x86_64 2:16.2.4-0.el8 ceph 213 k 2021-11-03T16:43:02.456 INFO:teuthology.orchestra.run.smithi026.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2021-11-03T16:43:02.456 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados x86_64 2:16.2.4-0.el8 ceph 387 k 2021-11-03T16:43:02.456 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rbd x86_64 2:16.2.4-0.el8 ceph 368 k 2021-11-03T16:43:02.456 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rgw x86_64 2:16.2.4-0.el8 ceph 114 k 2021-11-03T16:43:02.457 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:43:02.457 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2021-11-03T16:43:02.457 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:43:02.457 INFO:teuthology.orchestra.run.smithi026.stdout:Install 25 Packages 2021-11-03T16:43:02.458 INFO:teuthology.orchestra.run.smithi026.stdout:Upgrade 2 Packages 2021-11-03T16:43:02.458 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:43:02.459 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 59 M 2021-11-03T16:43:02.459 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2021-11-03T16:43:02.581 INFO:teuthology.orchestra.run.smithi194.stdout:(5/27): ceph-radosgw-16.2.4-0.el8.x86_64.rpm 25 MB/s | 13 MB 00:00 2021-11-03T16:43:02.582 INFO:teuthology.orchestra.run.smithi194.stdout:(6/27): python3-ceph-argparse-16.2.4-0.el8.x86_ 25 MB/s | 44 kB 00:00 2021-11-03T16:43:02.585 INFO:teuthology.orchestra.run.smithi194.stdout:(7/27): python3-ceph-common-16.2.4-0.el8.x86_64 31 MB/s | 80 kB 00:00 2021-11-03T16:43:02.598 INFO:teuthology.orchestra.run.smithi194.stdout:(8/27): python3-cephfs-16.2.4-0.el8.x86_64.rpm 17 MB/s | 213 kB 00:00 2021-11-03T16:43:02.621 INFO:teuthology.orchestra.run.smithi194.stdout:(9/27): python3-rados-16.2.4-0.el8.x86_64.rpm 16 MB/s | 387 kB 00:00 2021-11-03T16:43:02.652 INFO:teuthology.orchestra.run.smithi194.stdout:(10/27): librgw2-16.2.4-0.el8.x86_64.rpm 16 MB/s | 4.1 MB 00:00 2021-11-03T16:43:02.654 INFO:teuthology.orchestra.run.smithi194.stdout:(11/27): python3-rbd-16.2.4-0.el8.x86_64.rpm 11 MB/s | 368 kB 00:00 2021-11-03T16:43:02.659 INFO:teuthology.orchestra.run.smithi194.stdout:(12/27): python3-rgw-16.2.4-0.el8.x86_64.rpm 34 MB/s | 114 kB 00:00 2021-11-03T16:43:02.707 INFO:teuthology.orchestra.run.smithi194.stdout:(13/27): librdkafka-0.11.4-1.el8.x86_64.rpm 6.8 MB/s | 353 kB 00:00 2021-11-03T16:43:02.711 INFO:teuthology.orchestra.run.smithi194.stdout:(14/27): lttng-ust-2.8.1-11.el8.x86_64.rpm 65 MB/s | 259 kB 00:00 2021-11-03T16:43:02.712 INFO:teuthology.orchestra.run.smithi194.stdout:(15/27): python3-prettytable-0.7.2-14.el8.noarc 30 MB/s | 44 kB 00:00 2021-11-03T16:43:02.717 INFO:teuthology.orchestra.run.smithi194.stdout:(16/27): libpmemobj-1.6.1-1.el8.x86_64.rpm 2.3 MB/s | 145 kB 00:00 2021-11-03T16:43:02.719 INFO:teuthology.orchestra.run.smithi194.stdout:(17/27): librabbitmq-0.9.0-3.el8.x86_64.rpm 22 MB/s | 47 kB 00:00 2021-11-03T16:43:02.732 INFO:teuthology.orchestra.run.smithi194.stdout:(18/27): daxctl-libs-71.1-2.el8.x86_64.rpm 2.1 MB/s | 41 kB 00:00 2021-11-03T16:43:02.735 INFO:teuthology.orchestra.run.smithi194.stdout:(19/27): ndctl-libs-71.1-2.el8.x86_64.rpm 4.9 MB/s | 78 kB 00:00 2021-11-03T16:43:02.799 INFO:teuthology.orchestra.run.smithi026.stdout:(1/27): ceph-base-16.2.4-0.el8.x86_64.rpm 17 MB/s | 6.0 MB 00:00 2021-11-03T16:43:02.810 INFO:teuthology.orchestra.run.smithi026.stdout:(2/27): ceph-selinux-16.2.4-0.el8.x86_64.rpm 2.4 MB/s | 25 kB 00:00 2021-11-03T16:43:02.853 INFO:teuthology.orchestra.run.smithi026.stdout:(3/27): libcephfs2-16.2.4-0.el8.x86_64.rpm 18 MB/s | 801 kB 00:00 2021-11-03T16:43:02.886 INFO:teuthology.orchestra.run.smithi026.stdout:(4/27): libradosstriper1-16.2.4-0.el8.x86_64.rp 15 MB/s | 486 kB 00:00 2021-11-03T16:43:03.112 INFO:teuthology.orchestra.run.smithi194.stdout:(20/27): fmt-6.2.1-1.el8.x86_64.rpm 306 kB/s | 116 kB 00:00 2021-11-03T16:43:03.146 INFO:teuthology.orchestra.run.smithi194.stdout:(21/27): gperftools-libs-2.7-9.el8.x86_64.rpm 745 kB/s | 306 kB 00:00 2021-11-03T16:43:03.154 INFO:teuthology.orchestra.run.smithi026.stdout:(5/27): ceph-radosgw-16.2.4-0.el8.x86_64.rpm 18 MB/s | 13 MB 00:00 2021-11-03T16:43:03.157 INFO:teuthology.orchestra.run.smithi026.stdout:(6/27): python3-ceph-argparse-16.2.4-0.el8.x86_ 13 MB/s | 44 kB 00:00 2021-11-03T16:43:03.169 INFO:teuthology.orchestra.run.smithi026.stdout:(7/27): librgw2-16.2.4-0.el8.x86_64.rpm 14 MB/s | 4.1 MB 00:00 2021-11-03T16:43:03.170 INFO:teuthology.orchestra.run.smithi026.stdout:(8/27): python3-ceph-common-16.2.4-0.el8.x86_64 6.3 MB/s | 80 kB 00:00 2021-11-03T16:43:03.174 INFO:teuthology.orchestra.run.smithi194.stdout:(22/27): leveldb-1.22-1.el8.x86_64.rpm 2.9 MB/s | 181 kB 00:00 2021-11-03T16:43:03.174 INFO:teuthology.orchestra.run.smithi194.stdout:(23/27): liboath-2.6.2-3.el8.x86_64.rpm 2.0 MB/s | 59 kB 00:00 2021-11-03T16:43:03.180 INFO:teuthology.orchestra.run.smithi026.stdout:(9/27): python3-cephfs-16.2.4-0.el8.x86_64.rpm 21 MB/s | 213 kB 00:00 2021-11-03T16:43:03.185 INFO:teuthology.orchestra.run.smithi026.stdout:(10/27): python3-rados-16.2.4-0.el8.x86_64.rpm 26 MB/s | 387 kB 00:00 2021-11-03T16:43:03.199 INFO:teuthology.orchestra.run.smithi026.stdout:(11/27): python3-rbd-16.2.4-0.el8.x86_64.rpm 18 MB/s | 368 kB 00:00 2021-11-03T16:43:03.207 INFO:teuthology.orchestra.run.smithi026.stdout:(12/27): python3-rgw-16.2.4-0.el8.x86_64.rpm 5.2 MB/s | 114 kB 00:00 2021-11-03T16:43:03.225 INFO:teuthology.orchestra.run.smithi194.stdout:(24/27): libunwind-1.3.1-3.el8.x86_64.rpm 1.4 MB/s | 75 kB 00:00 2021-11-03T16:43:03.232 INFO:teuthology.orchestra.run.smithi026.stdout:(13/27): libpmemobj-1.6.1-1.el8.x86_64.rpm 4.3 MB/s | 145 kB 00:00 2021-11-03T16:43:03.256 INFO:teuthology.orchestra.run.smithi026.stdout:(14/27): lttng-ust-2.8.1-11.el8.x86_64.rpm 11 MB/s | 259 kB 00:00 2021-11-03T16:43:03.257 INFO:teuthology.orchestra.run.smithi026.stdout:(15/27): librdkafka-0.11.4-1.el8.x86_64.rpm 6.9 MB/s | 353 kB 00:00 2021-11-03T16:43:03.258 INFO:teuthology.orchestra.run.smithi026.stdout:(16/27): python3-prettytable-0.7.2-14.el8.noarc 17 MB/s | 44 kB 00:00 2021-11-03T16:43:03.259 INFO:teuthology.orchestra.run.smithi026.stdout:(17/27): daxctl-libs-71.1-2.el8.x86_64.rpm 22 MB/s | 41 kB 00:00 2021-11-03T16:43:03.260 INFO:teuthology.orchestra.run.smithi026.stdout:(18/27): librabbitmq-0.9.0-3.el8.x86_64.rpm 26 MB/s | 47 kB 00:00 2021-11-03T16:43:03.261 INFO:teuthology.orchestra.run.smithi026.stdout:(19/27): ndctl-libs-71.1-2.el8.x86_64.rpm 39 MB/s | 78 kB 00:00 2021-11-03T16:43:03.462 INFO:teuthology.orchestra.run.smithi194.stdout:(25/27): librbd1-16.2.4-0.el8.x86_64.rpm 17 MB/s | 4.0 MB 00:00 2021-11-03T16:43:03.479 INFO:teuthology.orchestra.run.smithi026.stdout:(20/27): ceph-common-16.2.4-0.el8.x86_64.rpm 23 MB/s | 24 MB 00:01 2021-11-03T16:43:03.480 INFO:teuthology.orchestra.run.smithi194.stdout:(26/27): librados2-16.2.4-0.el8.x86_64.rpm 12 MB/s | 3.7 MB 00:00 2021-11-03T16:43:03.528 INFO:teuthology.orchestra.run.smithi026.stdout:(21/27): gperftools-libs-2.7-9.el8.x86_64.rpm 1.1 MB/s | 306 kB 00:00 2021-11-03T16:43:03.556 INFO:teuthology.orchestra.run.smithi026.stdout:(22/27): liboath-2.6.2-3.el8.x86_64.rpm 2.1 MB/s | 59 kB 00:00 2021-11-03T16:43:03.584 INFO:teuthology.orchestra.run.smithi026.stdout:(23/27): libunwind-1.3.1-3.el8.x86_64.rpm 2.6 MB/s | 75 kB 00:00 2021-11-03T16:43:03.606 INFO:teuthology.orchestra.run.smithi026.stdout:(24/27): fmt-6.2.1-1.el8.x86_64.rpm 337 kB/s | 116 kB 00:00 2021-11-03T16:43:03.671 INFO:teuthology.orchestra.run.smithi026.stdout:(25/27): librados2-16.2.4-0.el8.x86_64.rpm 43 MB/s | 3.7 MB 00:00 2021-11-03T16:43:03.682 INFO:teuthology.orchestra.run.smithi194.stdout:(27/27): ceph-common-16.2.4-0.el8.x86_64.rpm 15 MB/s | 24 MB 00:01 2021-11-03T16:43:03.687 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2021-11-03T16:43:03.687 INFO:teuthology.orchestra.run.smithi194.stdout:Total 36 MB/s | 59 MB 00:01 2021-11-03T16:43:03.694 INFO:teuthology.orchestra.run.smithi026.stdout:(26/27): librbd1-16.2.4-0.el8.x86_64.rpm 46 MB/s | 4.0 MB 00:00 2021-11-03T16:43:03.699 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2021-11-03T16:43:03.746 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2021-11-03T16:43:03.746 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2021-11-03T16:43:03.894 INFO:teuthology.orchestra.run.smithi026.stdout:(27/27): leveldb-1.22-1.el8.x86_64.rpm 436 kB/s | 181 kB 00:00 2021-11-03T16:43:03.898 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2021-11-03T16:43:03.899 INFO:teuthology.orchestra.run.smithi026.stdout:Total 41 MB/s | 59 MB 00:01 2021-11-03T16:43:03.912 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2021-11-03T16:43:03.964 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2021-11-03T16:43:03.964 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2021-11-03T16:43:04.066 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2021-11-03T16:43:04.069 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2021-11-03T16:43:04.299 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2021-11-03T16:43:04.302 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2021-11-03T16:43:05.220 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2021-11-03T16:43:05.383 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/29 2021-11-03T16:43:05.529 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/29 2021-11-03T16:43:05.584 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2021-11-03T16:43:05.685 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/29 2021-11-03T16:43:05.761 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/29 2021-11-03T16:43:05.909 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/29 2021-11-03T16:43:06.080 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/29 2021-11-03T16:43:06.089 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/29 2021-11-03T16:43:06.269 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : librados2-2:16.2.4-0.el8.x86_64 4/29 2021-11-03T16:43:06.370 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librados2-2:16.2.4-0.el8.x86_64 4/29 2021-11-03T16:43:06.489 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/29 2021-11-03T16:43:06.584 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rados-2:16.2.4-0.el8.x86_64 5/29 2021-11-03T16:43:06.638 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : librados2-2:16.2.4-0.el8.x86_64 4/29 2021-11-03T16:43:06.723 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librados2-2:16.2.4-0.el8.x86_64 4/29 2021-11-03T16:43:06.727 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephfs2-2:16.2.4-0.el8.x86_64 6/29 2021-11-03T16:43:06.790 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libcephfs2-2:16.2.4-0.el8.x86_64 6/29 2021-11-03T16:43:06.933 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rados-2:16.2.4-0.el8.x86_64 5/29 2021-11-03T16:43:06.975 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 7/29 2021-11-03T16:43:07.096 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephfs2-2:16.2.4-0.el8.x86_64 6/29 2021-11-03T16:43:07.144 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/29 2021-11-03T16:43:07.150 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libcephfs2-2:16.2.4-0.el8.x86_64 6/29 2021-11-03T16:43:07.330 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 7/29 2021-11-03T16:43:07.454 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/29 2021-11-03T16:43:07.544 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/29 2021-11-03T16:43:07.735 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librgw2-2:16.2.4-0.el8.x86_64 9/29 2021-11-03T16:43:07.797 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librgw2-2:16.2.4-0.el8.x86_64 9/29 2021-11-03T16:43:07.921 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/29 2021-11-03T16:43:07.932 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/29 2021-11-03T16:43:08.069 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : daxctl-libs-71.1-2.el8.x86_64 11/29 2021-11-03T16:43:08.104 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librgw2-2:16.2.4-0.el8.x86_64 9/29 2021-11-03T16:43:08.120 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: daxctl-libs-71.1-2.el8.x86_64 11/29 2021-11-03T16:43:08.183 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librgw2-2:16.2.4-0.el8.x86_64 9/29 2021-11-03T16:43:08.298 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ceph-argparse-2:16.2.4-0.el8.x86_64 12/29 2021-11-03T16:43:08.343 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/29 2021-11-03T16:43:08.477 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cephfs-2:16.2.4-0.el8.x86_64 13/29 2021-11-03T16:43:08.479 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : daxctl-libs-71.1-2.el8.x86_64 11/29 2021-11-03T16:43:08.581 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: daxctl-libs-71.1-2.el8.x86_64 11/29 2021-11-03T16:43:08.652 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ndctl-libs-71.1-2.el8.x86_64 14/29 2021-11-03T16:43:08.713 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ndctl-libs-71.1-2.el8.x86_64 14/29 2021-11-03T16:43:08.779 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-ceph-argparse-2:16.2.4-0.el8.x86_64 12/29 2021-11-03T16:43:08.868 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libpmemobj-1.6.1-1.el8.x86_64 15/29 2021-11-03T16:43:08.931 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cephfs-2:16.2.4-0.el8.x86_64 13/29 2021-11-03T16:43:09.121 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ndctl-libs-71.1-2.el8.x86_64 14/29 2021-11-03T16:43:09.200 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ndctl-libs-71.1-2.el8.x86_64 14/29 2021-11-03T16:43:09.274 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libpmemobj-1.6.1-1.el8.x86_64 15/29 2021-11-03T16:43:09.379 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libpmemobj-1.6.1-1.el8.x86_64 15/29 2021-11-03T16:43:09.468 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : librbd1-2:16.2.4-0.el8.x86_64 16/29 2021-11-03T16:43:09.611 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librbd1-2:16.2.4-0.el8.x86_64 16/29 2021-11-03T16:43:09.763 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rbd-2:16.2.4-0.el8.x86_64 17/29 2021-11-03T16:43:09.837 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libpmemobj-1.6.1-1.el8.x86_64 15/29 2021-11-03T16:43:09.970 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rgw-2:16.2.4-0.el8.x86_64 18/29 2021-11-03T16:43:10.012 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : librbd1-2:16.2.4-0.el8.x86_64 16/29 2021-11-03T16:43:10.098 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librbd1-2:16.2.4-0.el8.x86_64 16/29 2021-11-03T16:43:10.118 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libradosstriper1-2:16.2.4-0.el8.x86_64 19/29 2021-11-03T16:43:10.187 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libradosstriper1-2:16.2.4-0.el8.x86_64 19/29 2021-11-03T16:43:10.258 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rbd-2:16.2.4-0.el8.x86_64 17/29 2021-11-03T16:43:10.376 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 20/29 2021-11-03T16:43:10.484 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rgw-2:16.2.4-0.el8.x86_64 18/29 2021-11-03T16:43:10.560 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 21/29 2021-11-03T16:43:10.754 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libradosstriper1-2:16.2.4-0.el8.x86_64 19/29 2021-11-03T16:43:10.771 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 22/29 2021-11-03T16:43:10.806 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libradosstriper1-2:16.2.4-0.el8.x86_64 19/29 2021-11-03T16:43:10.935 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ceph-common-2:16.2.4-0.el8.x86_64 23/29 2021-11-03T16:43:11.022 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 20/29 2021-11-03T16:43:11.221 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 21/29 2021-11-03T16:43:11.391 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 22/29 2021-11-03T16:43:11.562 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-ceph-common-2:16.2.4-0.el8.x86_64 23/29 2021-11-03T16:43:15.124 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-common-2:16.2.4-0.el8.x86_64 24/29 2021-11-03T16:43:15.332 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-common-2:16.2.4-0.el8.x86_64 24/29 2021-11-03T16:43:16.025 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-common-2:16.2.4-0.el8.x86_64 24/29 2021-11-03T16:43:16.034 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-common-2:16.2.4-0.el8.x86_64 24/29 2021-11-03T16:43:16.237 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-common-2:16.2.4-0.el8.x86_64 24/29 2021-11-03T16:43:16.333 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-base-2:16.2.4-0.el8.x86_64 25/29 2021-11-03T16:43:16.424 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-base-2:16.2.4-0.el8.x86_64 25/29 2021-11-03T16:43:16.542 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-selinux-2:16.2.4-0.el8.x86_64 26/29 2021-11-03T16:43:16.977 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-common-2:16.2.4-0.el8.x86_64 24/29 2021-11-03T16:43:17.268 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-base-2:16.2.4-0.el8.x86_64 25/29 2021-11-03T16:43:17.358 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-base-2:16.2.4-0.el8.x86_64 25/29 2021-11-03T16:43:17.528 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-selinux-2:16.2.4-0.el8.x86_64 26/29 2021-11-03T16:43:32.041 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-selinux-2:16.2.4-0.el8.x86_64 26/29 2021-11-03T16:43:32.042 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /sys 2021-11-03T16:43:32.042 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /proc 2021-11-03T16:43:32.042 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /dev 2021-11-03T16:43:32.042 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /run 2021-11-03T16:43:32.043 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /mnt 2021-11-03T16:43:32.043 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /var/tmp 2021-11-03T16:43:32.043 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /home 2021-11-03T16:43:32.043 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /tmp 2021-11-03T16:43:32.044 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /dev 2021-11-03T16:43:32.044 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:43:33.372 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-radosgw-2:16.2.4-0.el8.x86_64 27/29 2021-11-03T16:43:33.446 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-radosgw-2:16.2.4-0.el8.x86_64 27/29 2021-11-03T16:43:33.446 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 28/29 2021-11-03T16:43:33.634 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 28/29 2021-11-03T16:43:33.634 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 29/29 2021-11-03T16:43:33.906 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-selinux-2:16.2.4-0.el8.x86_64 26/29 2021-11-03T16:43:33.907 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /sys 2021-11-03T16:43:33.907 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /proc 2021-11-03T16:43:33.907 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /dev 2021-11-03T16:43:33.908 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /run 2021-11-03T16:43:33.908 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /mnt 2021-11-03T16:43:33.908 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /var/tmp 2021-11-03T16:43:33.908 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /home 2021-11-03T16:43:33.908 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /tmp 2021-11-03T16:43:33.909 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /dev 2021-11-03T16:43:33.909 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:43:34.379 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 29/29 2021-11-03T16:43:34.379 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-base-2:16.2.4-0.el8.x86_64 1/29 2021-11-03T16:43:34.380 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-common-2:16.2.4-0.el8.x86_64 2/29 2021-11-03T16:43:34.380 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-radosgw-2:16.2.4-0.el8.x86_64 3/29 2021-11-03T16:43:34.380 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-selinux-2:16.2.4-0.el8.x86_64 4/29 2021-11-03T16:43:34.380 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephfs2-2:16.2.4-0.el8.x86_64 5/29 2021-11-03T16:43:34.381 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libradosstriper1-2:16.2.4-0.el8.x86_64 6/29 2021-11-03T16:43:34.381 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librgw2-2:16.2.4-0.el8.x86_64 7/29 2021-11-03T16:43:34.381 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ceph-argparse-2:16.2.4-0.el8.x86_64 8/29 2021-11-03T16:43:34.381 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ceph-common-2:16.2.4-0.el8.x86_64 9/29 2021-11-03T16:43:34.382 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cephfs-2:16.2.4-0.el8.x86_64 10/29 2021-11-03T16:43:34.382 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rados-2:16.2.4-0.el8.x86_64 11/29 2021-11-03T16:43:34.382 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rbd-2:16.2.4-0.el8.x86_64 12/29 2021-11-03T16:43:34.382 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rgw-2:16.2.4-0.el8.x86_64 13/29 2021-11-03T16:43:34.383 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libpmemobj-1.6.1-1.el8.x86_64 14/29 2021-11-03T16:43:34.383 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 15/29 2021-11-03T16:43:34.383 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 16/29 2021-11-03T16:43:34.383 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 17/29 2021-11-03T16:43:34.383 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : daxctl-libs-71.1-2.el8.x86_64 18/29 2021-11-03T16:43:34.384 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 19/29 2021-11-03T16:43:34.384 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ndctl-libs-71.1-2.el8.x86_64 20/29 2021-11-03T16:43:34.384 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 21/29 2021-11-03T16:43:34.385 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 22/29 2021-11-03T16:43:34.385 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : leveldb-1.22-1.el8.x86_64 23/29 2021-11-03T16:43:34.385 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 24/29 2021-11-03T16:43:34.385 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 25/29 2021-11-03T16:43:34.386 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados2-2:16.2.4-0.el8.x86_64 26/29 2021-11-03T16:43:34.386 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 27/29 2021-11-03T16:43:34.386 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librbd1-2:16.2.4-0.el8.x86_64 28/29 2021-11-03T16:43:35.172 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 29/29 2021-11-03T16:43:35.172 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:43:35.173 INFO:teuthology.orchestra.run.smithi194.stdout:Upgraded: 2021-11-03T16:43:35.173 INFO:teuthology.orchestra.run.smithi194.stdout: librados2-2:16.2.4-0.el8.x86_64 librbd1-2:16.2.4-0.el8.x86_64 2021-11-03T16:43:35.173 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:43:35.173 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2021-11-03T16:43:35.173 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-base-2:16.2.4-0.el8.x86_64 2021-11-03T16:43:35.174 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-common-2:16.2.4-0.el8.x86_64 2021-11-03T16:43:35.174 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-radosgw-2:16.2.4-0.el8.x86_64 2021-11-03T16:43:35.174 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-selinux-2:16.2.4-0.el8.x86_64 2021-11-03T16:43:35.174 INFO:teuthology.orchestra.run.smithi194.stdout: daxctl-libs-71.1-2.el8.x86_64 2021-11-03T16:43:35.175 INFO:teuthology.orchestra.run.smithi194.stdout: fmt-6.2.1-1.el8.x86_64 2021-11-03T16:43:35.175 INFO:teuthology.orchestra.run.smithi194.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2021-11-03T16:43:35.175 INFO:teuthology.orchestra.run.smithi194.stdout: leveldb-1.22-1.el8.x86_64 2021-11-03T16:43:35.175 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs2-2:16.2.4-0.el8.x86_64 2021-11-03T16:43:35.175 INFO:teuthology.orchestra.run.smithi194.stdout: liboath-2.6.2-3.el8.x86_64 2021-11-03T16:43:35.176 INFO:teuthology.orchestra.run.smithi194.stdout: libpmemobj-1.6.1-1.el8.x86_64 2021-11-03T16:43:35.176 INFO:teuthology.orchestra.run.smithi194.stdout: librabbitmq-0.9.0-3.el8.x86_64 2021-11-03T16:43:35.176 INFO:teuthology.orchestra.run.smithi194.stdout: libradosstriper1-2:16.2.4-0.el8.x86_64 2021-11-03T16:43:35.176 INFO:teuthology.orchestra.run.smithi194.stdout: librdkafka-0.11.4-1.el8.x86_64 2021-11-03T16:43:35.177 INFO:teuthology.orchestra.run.smithi194.stdout: librgw2-2:16.2.4-0.el8.x86_64 2021-11-03T16:43:35.177 INFO:teuthology.orchestra.run.smithi194.stdout: libunwind-1.3.1-3.el8.x86_64 2021-11-03T16:43:35.177 INFO:teuthology.orchestra.run.smithi194.stdout: lttng-ust-2.8.1-11.el8.x86_64 2021-11-03T16:43:35.177 INFO:teuthology.orchestra.run.smithi194.stdout: ndctl-libs-71.1-2.el8.x86_64 2021-11-03T16:43:35.178 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-argparse-2:16.2.4-0.el8.x86_64 2021-11-03T16:43:35.178 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-common-2:16.2.4-0.el8.x86_64 2021-11-03T16:43:35.178 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cephfs-2:16.2.4-0.el8.x86_64 2021-11-03T16:43:35.178 INFO:teuthology.orchestra.run.smithi194.stdout: python3-prettytable-0.7.2-14.el8.noarch 2021-11-03T16:43:35.178 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rados-2:16.2.4-0.el8.x86_64 2021-11-03T16:43:35.179 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rbd-2:16.2.4-0.el8.x86_64 2021-11-03T16:43:35.179 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rgw-2:16.2.4-0.el8.x86_64 2021-11-03T16:43:35.179 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:43:35.179 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2021-11-03T16:43:35.289 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-radosgw-2:16.2.4-0.el8.x86_64 27/29 2021-11-03T16:43:35.336 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-test 2021-11-03T16:43:35.500 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-radosgw-2:16.2.4-0.el8.x86_64 27/29 2021-11-03T16:43:35.500 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 28/29 2021-11-03T16:43:35.736 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 28/29 2021-11-03T16:43:35.736 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 29/29 2021-11-03T16:43:35.802 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:00:36 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:43:36.446 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 29/29 2021-11-03T16:43:36.446 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-base-2:16.2.4-0.el8.x86_64 1/29 2021-11-03T16:43:36.446 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-common-2:16.2.4-0.el8.x86_64 2/29 2021-11-03T16:43:36.447 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-radosgw-2:16.2.4-0.el8.x86_64 3/29 2021-11-03T16:43:36.447 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-selinux-2:16.2.4-0.el8.x86_64 4/29 2021-11-03T16:43:36.447 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephfs2-2:16.2.4-0.el8.x86_64 5/29 2021-11-03T16:43:36.447 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libradosstriper1-2:16.2.4-0.el8.x86_64 6/29 2021-11-03T16:43:36.448 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librgw2-2:16.2.4-0.el8.x86_64 7/29 2021-11-03T16:43:36.448 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-argparse-2:16.2.4-0.el8.x86_64 8/29 2021-11-03T16:43:36.448 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-common-2:16.2.4-0.el8.x86_64 9/29 2021-11-03T16:43:36.448 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cephfs-2:16.2.4-0.el8.x86_64 10/29 2021-11-03T16:43:36.449 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rados-2:16.2.4-0.el8.x86_64 11/29 2021-11-03T16:43:36.449 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rbd-2:16.2.4-0.el8.x86_64 12/29 2021-11-03T16:43:36.449 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rgw-2:16.2.4-0.el8.x86_64 13/29 2021-11-03T16:43:36.449 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libpmemobj-1.6.1-1.el8.x86_64 14/29 2021-11-03T16:43:36.450 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 15/29 2021-11-03T16:43:36.450 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 16/29 2021-11-03T16:43:36.450 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 17/29 2021-11-03T16:43:36.450 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : daxctl-libs-71.1-2.el8.x86_64 18/29 2021-11-03T16:43:36.450 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 19/29 2021-11-03T16:43:36.451 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ndctl-libs-71.1-2.el8.x86_64 20/29 2021-11-03T16:43:36.451 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 21/29 2021-11-03T16:43:36.451 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 22/29 2021-11-03T16:43:36.451 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : leveldb-1.22-1.el8.x86_64 23/29 2021-11-03T16:43:36.452 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 24/29 2021-11-03T16:43:36.452 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 25/29 2021-11-03T16:43:36.452 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados2-2:16.2.4-0.el8.x86_64 26/29 2021-11-03T16:43:36.452 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 27/29 2021-11-03T16:43:36.453 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librbd1-2:16.2.4-0.el8.x86_64 28/29 2021-11-03T16:43:36.805 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2021-11-03T16:43:36.806 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:43:36.806 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2021-11-03T16:43:36.806 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:43:36.807 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2021-11-03T16:43:36.807 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-test x86_64 2:16.2.4-0.el8 ceph 52 M 2021-11-03T16:43:36.807 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2021-11-03T16:43:36.807 INFO:teuthology.orchestra.run.smithi194.stdout: jq x86_64 1.5-12.el8 CentOS-AppStream 161 k 2021-11-03T16:43:36.807 INFO:teuthology.orchestra.run.smithi194.stdout: libcephsqlite x86_64 2:16.2.4-0.el8 ceph 169 k 2021-11-03T16:43:36.808 INFO:teuthology.orchestra.run.smithi194.stdout: libxslt x86_64 1.1.32-6.el8 CentOS-Base 250 k 2021-11-03T16:43:36.808 INFO:teuthology.orchestra.run.smithi194.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2021-11-03T16:43:36.808 INFO:teuthology.orchestra.run.smithi194.stdout: socat x86_64 1.7.3.3-2.el8 CentOS-AppStream 302 k 2021-11-03T16:43:36.808 INFO:teuthology.orchestra.run.smithi194.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2021-11-03T16:43:36.809 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:43:36.809 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2021-11-03T16:43:36.809 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:43:36.809 INFO:teuthology.orchestra.run.smithi194.stdout:Install 7 Packages 2021-11-03T16:43:36.809 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:43:36.810 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 53 M 2021-11-03T16:43:36.811 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 229 M 2021-11-03T16:43:36.811 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2021-11-03T16:43:36.837 INFO:teuthology.orchestra.run.smithi194.stdout:(1/7): libcephsqlite-16.2.4-0.el8.x86_64.rpm 5.8 MB/s | 169 kB 00:00 2021-11-03T16:43:36.851 INFO:teuthology.orchestra.run.smithi194.stdout:(2/7): jq-1.5-12.el8.x86_64.rpm 3.7 MB/s | 161 kB 00:00 2021-11-03T16:43:36.881 INFO:teuthology.orchestra.run.smithi194.stdout:(3/7): socat-1.7.3.3-2.el8.x86_64.rpm 9.9 MB/s | 302 kB 00:00 2021-11-03T16:43:36.887 INFO:teuthology.orchestra.run.smithi194.stdout:(4/7): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2021-11-03T16:43:36.889 INFO:teuthology.orchestra.run.smithi194.stdout:(5/7): libxslt-1.1.32-6.el8.x86_64.rpm 33 MB/s | 250 kB 00:00 2021-11-03T16:43:36.985 INFO:teuthology.orchestra.run.smithi194.stdout:(6/7): xmlstarlet-1.6.1-11.el8.x86_64.rpm 709 kB/s | 69 kB 00:00 2021-11-03T16:43:37.257 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 29/29 2021-11-03T16:43:37.258 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:43:37.258 INFO:teuthology.orchestra.run.smithi026.stdout:Upgraded: 2021-11-03T16:43:37.258 INFO:teuthology.orchestra.run.smithi026.stdout: librados2-2:16.2.4-0.el8.x86_64 librbd1-2:16.2.4-0.el8.x86_64 2021-11-03T16:43:37.258 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:43:37.259 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2021-11-03T16:43:37.259 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-base-2:16.2.4-0.el8.x86_64 2021-11-03T16:43:37.259 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-common-2:16.2.4-0.el8.x86_64 2021-11-03T16:43:37.259 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-radosgw-2:16.2.4-0.el8.x86_64 2021-11-03T16:43:37.260 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-selinux-2:16.2.4-0.el8.x86_64 2021-11-03T16:43:37.260 INFO:teuthology.orchestra.run.smithi026.stdout: daxctl-libs-71.1-2.el8.x86_64 2021-11-03T16:43:37.260 INFO:teuthology.orchestra.run.smithi026.stdout: fmt-6.2.1-1.el8.x86_64 2021-11-03T16:43:37.260 INFO:teuthology.orchestra.run.smithi026.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2021-11-03T16:43:37.261 INFO:teuthology.orchestra.run.smithi026.stdout: leveldb-1.22-1.el8.x86_64 2021-11-03T16:43:37.261 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs2-2:16.2.4-0.el8.x86_64 2021-11-03T16:43:37.261 INFO:teuthology.orchestra.run.smithi026.stdout: liboath-2.6.2-3.el8.x86_64 2021-11-03T16:43:37.262 INFO:teuthology.orchestra.run.smithi026.stdout: libpmemobj-1.6.1-1.el8.x86_64 2021-11-03T16:43:37.262 INFO:teuthology.orchestra.run.smithi026.stdout: librabbitmq-0.9.0-3.el8.x86_64 2021-11-03T16:43:37.262 INFO:teuthology.orchestra.run.smithi026.stdout: libradosstriper1-2:16.2.4-0.el8.x86_64 2021-11-03T16:43:37.262 INFO:teuthology.orchestra.run.smithi026.stdout: librdkafka-0.11.4-1.el8.x86_64 2021-11-03T16:43:37.263 INFO:teuthology.orchestra.run.smithi026.stdout: librgw2-2:16.2.4-0.el8.x86_64 2021-11-03T16:43:37.263 INFO:teuthology.orchestra.run.smithi026.stdout: libunwind-1.3.1-3.el8.x86_64 2021-11-03T16:43:37.263 INFO:teuthology.orchestra.run.smithi026.stdout: lttng-ust-2.8.1-11.el8.x86_64 2021-11-03T16:43:37.263 INFO:teuthology.orchestra.run.smithi026.stdout: ndctl-libs-71.1-2.el8.x86_64 2021-11-03T16:43:37.264 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-argparse-2:16.2.4-0.el8.x86_64 2021-11-03T16:43:37.264 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-common-2:16.2.4-0.el8.x86_64 2021-11-03T16:43:37.264 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cephfs-2:16.2.4-0.el8.x86_64 2021-11-03T16:43:37.264 INFO:teuthology.orchestra.run.smithi026.stdout: python3-prettytable-0.7.2-14.el8.noarch 2021-11-03T16:43:37.265 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados-2:16.2.4-0.el8.x86_64 2021-11-03T16:43:37.265 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rbd-2:16.2.4-0.el8.x86_64 2021-11-03T16:43:37.265 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rgw-2:16.2.4-0.el8.x86_64 2021-11-03T16:43:37.265 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:43:37.265 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2021-11-03T16:43:37.480 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-test 2021-11-03T16:43:37.961 INFO:teuthology.orchestra.run.smithi194.stdout:(7/7): ceph-test-16.2.4-0.el8.x86_64.rpm 45 MB/s | 52 MB 00:01 2021-11-03T16:43:37.965 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2021-11-03T16:43:37.966 INFO:teuthology.orchestra.run.smithi194.stdout:Total 46 MB/s | 53 MB 00:01 2021-11-03T16:43:37.970 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:00:38 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:43:37.973 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2021-11-03T16:43:37.998 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2021-11-03T16:43:37.998 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2021-11-03T16:43:38.279 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2021-11-03T16:43:38.282 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2021-11-03T16:43:38.801 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2021-11-03T16:43:38.982 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libxslt-1.1.32-6.el8.x86_64 1/7 2021-11-03T16:43:39.016 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2021-11-03T16:43:39.017 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:43:39.017 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2021-11-03T16:43:39.017 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:43:39.018 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2021-11-03T16:43:39.018 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-test x86_64 2:16.2.4-0.el8 ceph 52 M 2021-11-03T16:43:39.018 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2021-11-03T16:43:39.018 INFO:teuthology.orchestra.run.smithi026.stdout: jq x86_64 1.5-12.el8 CentOS-AppStream 161 k 2021-11-03T16:43:39.019 INFO:teuthology.orchestra.run.smithi026.stdout: libcephsqlite x86_64 2:16.2.4-0.el8 ceph 169 k 2021-11-03T16:43:39.019 INFO:teuthology.orchestra.run.smithi026.stdout: libxslt x86_64 1.1.32-6.el8 CentOS-Base 250 k 2021-11-03T16:43:39.019 INFO:teuthology.orchestra.run.smithi026.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2021-11-03T16:43:39.020 INFO:teuthology.orchestra.run.smithi026.stdout: socat x86_64 1.7.3.3-2.el8 CentOS-AppStream 302 k 2021-11-03T16:43:39.020 INFO:teuthology.orchestra.run.smithi026.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2021-11-03T16:43:39.020 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:43:39.020 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2021-11-03T16:43:39.021 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:43:39.021 INFO:teuthology.orchestra.run.smithi026.stdout:Install 7 Packages 2021-11-03T16:43:39.021 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:43:39.022 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 53 M 2021-11-03T16:43:39.022 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 229 M 2021-11-03T16:43:39.023 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2021-11-03T16:43:39.048 INFO:teuthology.orchestra.run.smithi026.stdout:(1/7): libcephsqlite-16.2.4-0.el8.x86_64.rpm 5.9 MB/s | 169 kB 00:00 2021-11-03T16:43:39.074 INFO:teuthology.orchestra.run.smithi026.stdout:(2/7): jq-1.5-12.el8.x86_64.rpm 2.9 MB/s | 161 kB 00:00 2021-11-03T16:43:39.081 INFO:teuthology.orchestra.run.smithi026.stdout:(3/7): socat-1.7.3.3-2.el8.x86_64.rpm 45 MB/s | 302 kB 00:00 2021-11-03T16:43:39.085 INFO:teuthology.orchestra.run.smithi026.stdout:(4/7): libxslt-1.1.32-6.el8.x86_64.rpm 57 MB/s | 250 kB 00:00 2021-11-03T16:43:39.088 INFO:teuthology.orchestra.run.smithi026.stdout:(5/7): oniguruma-6.8.2-2.el8.x86_64.rpm 4.6 MB/s | 187 kB 00:00 2021-11-03T16:43:39.197 INFO:teuthology.orchestra.run.smithi026.stdout:(6/7): xmlstarlet-1.6.1-11.el8.x86_64.rpm 621 kB/s | 69 kB 00:00 2021-11-03T16:43:39.202 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 2/7 2021-11-03T16:43:39.827 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 3/7 2021-11-03T16:43:39.997 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 4/7 2021-11-03T16:43:40.099 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 4/7 2021-11-03T16:43:40.140 INFO:teuthology.orchestra.run.smithi026.stdout:(7/7): ceph-test-16.2.4-0.el8.x86_64.rpm 46 MB/s | 52 MB 00:01 2021-11-03T16:43:40.145 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2021-11-03T16:43:40.145 INFO:teuthology.orchestra.run.smithi026.stdout:Total 47 MB/s | 53 MB 00:01 2021-11-03T16:43:40.154 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2021-11-03T16:43:40.181 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2021-11-03T16:43:40.181 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2021-11-03T16:43:40.288 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : jq-1.5-12.el8.x86_64 5/7 2021-11-03T16:43:40.430 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephsqlite-2:16.2.4-0.el8.x86_64 6/7 2021-11-03T16:43:40.479 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2021-11-03T16:43:40.483 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2021-11-03T16:43:41.045 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2021-11-03T16:43:41.202 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libxslt-1.1.32-6.el8.x86_64 1/7 2021-11-03T16:43:41.387 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 2/7 2021-11-03T16:43:41.587 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 3/7 2021-11-03T16:43:41.774 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 4/7 2021-11-03T16:43:41.853 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 4/7 2021-11-03T16:43:42.049 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : jq-1.5-12.el8.x86_64 5/7 2021-11-03T16:43:42.191 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephsqlite-2:16.2.4-0.el8.x86_64 6/7 2021-11-03T16:43:45.216 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libcephsqlite-2:16.2.4-0.el8.x86_64 6/7 2021-11-03T16:43:46.319 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-test-2:16.2.4-0.el8.x86_64 7/7 2021-11-03T16:43:46.569 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-test-2:16.2.4-0.el8.x86_64 7/7 2021-11-03T16:43:46.570 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-test-2:16.2.4-0.el8.x86_64 1/7 2021-11-03T16:43:46.570 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephsqlite-2:16.2.4-0.el8.x86_64 2/7 2021-11-03T16:43:46.570 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : jq-1.5-12.el8.x86_64 3/7 2021-11-03T16:43:46.570 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/7 2021-11-03T16:43:46.571 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 5/7 2021-11-03T16:43:46.571 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libxslt-1.1.32-6.el8.x86_64 6/7 2021-11-03T16:43:46.933 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 7/7 2021-11-03T16:43:46.933 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:43:46.934 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2021-11-03T16:43:46.934 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-test-2:16.2.4-0.el8.x86_64 jq-1.5-12.el8.x86_64 2021-11-03T16:43:46.935 INFO:teuthology.orchestra.run.smithi194.stdout: libcephsqlite-2:16.2.4-0.el8.x86_64 libxslt-1.1.32-6.el8.x86_64 2021-11-03T16:43:46.935 INFO:teuthology.orchestra.run.smithi194.stdout: oniguruma-6.8.2-2.el8.x86_64 socat-1.7.3.3-2.el8.x86_64 2021-11-03T16:43:46.936 INFO:teuthology.orchestra.run.smithi194.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2021-11-03T16:43:46.936 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:43:46.936 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2021-11-03T16:43:47.124 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph 2021-11-03T16:43:47.293 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libcephsqlite-2:16.2.4-0.el8.x86_64 6/7 2021-11-03T16:43:47.580 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-test-2:16.2.4-0.el8.x86_64 7/7 2021-11-03T16:43:47.581 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:00:48 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:43:47.839 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-test-2:16.2.4-0.el8.x86_64 7/7 2021-11-03T16:43:47.840 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-test-2:16.2.4-0.el8.x86_64 1/7 2021-11-03T16:43:47.840 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephsqlite-2:16.2.4-0.el8.x86_64 2/7 2021-11-03T16:43:47.840 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : jq-1.5-12.el8.x86_64 3/7 2021-11-03T16:43:47.841 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/7 2021-11-03T16:43:47.841 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 5/7 2021-11-03T16:43:47.841 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libxslt-1.1.32-6.el8.x86_64 6/7 2021-11-03T16:43:48.198 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 7/7 2021-11-03T16:43:48.198 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:43:48.198 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2021-11-03T16:43:48.199 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-test-2:16.2.4-0.el8.x86_64 jq-1.5-12.el8.x86_64 2021-11-03T16:43:48.199 INFO:teuthology.orchestra.run.smithi026.stdout: libcephsqlite-2:16.2.4-0.el8.x86_64 libxslt-1.1.32-6.el8.x86_64 2021-11-03T16:43:48.199 INFO:teuthology.orchestra.run.smithi026.stdout: oniguruma-6.8.2-2.el8.x86_64 socat-1.7.3.3-2.el8.x86_64 2021-11-03T16:43:48.200 INFO:teuthology.orchestra.run.smithi026.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2021-11-03T16:43:48.200 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:43:48.201 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2021-11-03T16:43:48.316 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph 2021-11-03T16:43:48.575 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2021-11-03T16:43:48.579 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:43:48.579 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2021-11-03T16:43:48.579 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:43:48.580 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2021-11-03T16:43:48.580 INFO:teuthology.orchestra.run.smithi194.stdout: ceph x86_64 2:16.2.4-0.el8 ceph 6.3 k 2021-11-03T16:43:48.580 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2021-11-03T16:43:48.580 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mds x86_64 2:16.2.4-0.el8 ceph 2.4 M 2021-11-03T16:43:48.581 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr x86_64 2:16.2.4-0.el8 ceph 1.6 M 2021-11-03T16:43:48.581 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-modules-core noarch 2:16.2.4-0.el8 ceph-noarch 220 k 2021-11-03T16:43:48.581 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mon x86_64 2:16.2.4-0.el8 ceph 5.0 M 2021-11-03T16:43:48.582 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-osd x86_64 2:16.2.4-0.el8 ceph 18 M 2021-11-03T16:43:48.582 INFO:teuthology.orchestra.run.smithi194.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2021-11-03T16:43:48.582 INFO:teuthology.orchestra.run.smithi194.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2021-11-03T16:43:48.583 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-Base 237 k 2021-11-03T16:43:48.583 INFO:teuthology.orchestra.run.smithi194.stdout: python3-chardet noarch 3.0.4-7.el8 CentOS-Base 195 k 2021-11-03T16:43:48.583 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2021-11-03T16:43:48.584 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2021-11-03T16:43:48.584 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cryptography x86_64 3.2.1-4.el8 CentOS-Base 559 k 2021-11-03T16:43:48.584 INFO:teuthology.orchestra.run.smithi194.stdout: python3-idna noarch 2.5-5.el8 CentOS-Base 97 k 2021-11-03T16:43:48.584 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2021-11-03T16:43:48.584 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2021-11-03T16:43:48.585 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2021-11-03T16:43:48.585 INFO:teuthology.orchestra.run.smithi194.stdout: python3-lxml x86_64 4.2.3-2.el8 CentOS-AppStream 1.5 M 2021-11-03T16:43:48.585 INFO:teuthology.orchestra.run.smithi194.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2021-11-03T16:43:48.585 INFO:teuthology.orchestra.run.smithi194.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2021-11-03T16:43:48.586 INFO:teuthology.orchestra.run.smithi194.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2021-11-03T16:43:48.586 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2021-11-03T16:43:48.586 INFO:teuthology.orchestra.run.smithi194.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2021-11-03T16:43:48.586 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2021-11-03T16:43:48.587 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-Base 109 k 2021-11-03T16:43:48.587 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pysocks noarch 1.6.8-3.el8 CentOS-Base 34 k 2021-11-03T16:43:48.587 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2021-11-03T16:43:48.587 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests noarch 2.20.0-2.1.el8_1 CentOS-Base 123 k 2021-11-03T16:43:48.588 INFO:teuthology.orchestra.run.smithi194.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2021-11-03T16:43:48.588 INFO:teuthology.orchestra.run.smithi194.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2021-11-03T16:43:48.588 INFO:teuthology.orchestra.run.smithi194.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2021-11-03T16:43:48.588 INFO:teuthology.orchestra.run.smithi194.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2021-11-03T16:43:48.588 INFO:teuthology.orchestra.run.smithi194.stdout: python3-urllib3 noarch 1.24.2-5.el8 CentOS-Base 177 k 2021-11-03T16:43:48.589 INFO:teuthology.orchestra.run.smithi194.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2021-11-03T16:43:48.589 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webencodings noarch 0.5.1-6.el8 CentOS-AppStream 27 k 2021-11-03T16:43:48.589 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2021-11-03T16:43:48.589 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2021-11-03T16:43:48.590 INFO:teuthology.orchestra.run.smithi194.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2021-11-03T16:43:48.590 INFO:teuthology.orchestra.run.smithi194.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2021-11-03T16:43:48.590 INFO:teuthology.orchestra.run.smithi194.stdout:Installing weak dependencies: 2021-11-03T16:43:48.590 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2021-11-03T16:43:48.591 INFO:teuthology.orchestra.run.smithi194.stdout: python3-html5lib noarch 1:0.999999999-6.el8 CentOS-AppStream 214 k 2021-11-03T16:43:48.591 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:43:48.591 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2021-11-03T16:43:48.591 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:43:48.591 INFO:teuthology.orchestra.run.smithi194.stdout:Install 41 Packages 2021-11-03T16:43:48.592 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:43:48.593 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 33 M 2021-11-03T16:43:48.594 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 119 M 2021-11-03T16:43:48.594 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2021-11-03T16:43:48.605 INFO:teuthology.orchestra.run.smithi194.stdout:(1/41): ceph-16.2.4-0.el8.x86_64.rpm 324 kB/s | 6.3 kB 00:00 2021-11-03T16:43:48.655 INFO:teuthology.orchestra.run.smithi194.stdout:(2/41): ceph-mds-16.2.4-0.el8.x86_64.rpm 35 MB/s | 2.4 MB 00:00 2021-11-03T16:43:48.738 INFO:teuthology.orchestra.run.smithi194.stdout:(3/41): ceph-mgr-16.2.4-0.el8.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2021-11-03T16:43:48.762 INFO:teuthology.orchestra.run.smithi194.stdout:(4/41): ceph-mgr-modules-core-16.2.4-0.el8.noar 9.2 MB/s | 220 kB 00:00 2021-11-03T16:43:48.781 INFO:teuthology.orchestra.run.smithi194.stdout:(5/41): ceph-mon-16.2.4-0.el8.x86_64.rpm 28 MB/s | 5.0 MB 00:00 2021-11-03T16:43:48.797 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:00:49 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:43:49.027 INFO:teuthology.orchestra.run.smithi194.stdout:(6/41): ceph-osd-16.2.4-0.el8.x86_64.rpm 49 MB/s | 18 MB 00:00 2021-11-03T16:43:49.064 INFO:teuthology.orchestra.run.smithi194.stdout:(7/41): python3-mako-1.0.6-13.el8.noarch.rpm 4.1 MB/s | 157 kB 00:00 2021-11-03T16:43:49.066 INFO:teuthology.orchestra.run.smithi194.stdout:(8/41): python3-markupsafe-0.23-19.el8.x86_64.r 24 MB/s | 39 kB 00:00 2021-11-03T16:43:49.068 INFO:teuthology.orchestra.run.smithi194.stdout:(9/41): python3-html5lib-0.999999999-6.el8.noar 696 kB/s | 214 kB 00:00 2021-11-03T16:43:49.069 INFO:teuthology.orchestra.run.smithi194.stdout:(10/41): python3-pyOpenSSL-19.0.0-1.el8.noarch. 30 MB/s | 103 kB 00:00 2021-11-03T16:43:49.071 INFO:teuthology.orchestra.run.smithi194.stdout:(11/41): python3-pytz-2017.2-9.el8.noarch.rpm 28 MB/s | 54 kB 00:00 2021-11-03T16:43:49.071 INFO:teuthology.orchestra.run.smithi194.stdout:(12/41): python3-webencodings-0.5.1-6.el8.noarc 16 MB/s | 27 kB 00:00 2021-11-03T16:43:49.078 INFO:teuthology.orchestra.run.smithi194.stdout:(13/41): python3-cffi-1.11.5-5.el8.x86_64.rpm 34 MB/s | 237 kB 00:00 2021-11-03T16:43:49.085 INFO:teuthology.orchestra.run.smithi194.stdout:(14/41): python3-chardet-3.0.4-7.el8.noarch.rpm 29 MB/s | 195 kB 00:00 2021-11-03T16:43:49.088 INFO:teuthology.orchestra.run.smithi194.stdout:(15/41): python3-werkzeug-0.12.2-4.el8.noarch.r 26 MB/s | 457 kB 00:00 2021-11-03T16:43:49.095 INFO:teuthology.orchestra.run.smithi194.stdout:(16/41): python3-lxml-4.2.3-2.el8.x86_64.rpm 4.8 MB/s | 1.5 MB 00:00 2021-11-03T16:43:49.096 INFO:teuthology.orchestra.run.smithi194.stdout:(17/41): python3-idna-2.5-5.el8.noarch.rpm 12 MB/s | 97 kB 00:00 2021-11-03T16:43:49.098 INFO:teuthology.orchestra.run.smithi194.stdout:(18/41): python3-pycparser-2.14-14.el8.noarch.r 38 MB/s | 109 kB 00:00 2021-11-03T16:43:49.099 INFO:teuthology.orchestra.run.smithi194.stdout:(19/41): python3-pysocks-1.6.8-3.el8.noarch.rpm 10 MB/s | 34 kB 00:00 2021-11-03T16:43:49.102 INFO:teuthology.orchestra.run.smithi194.stdout:(20/41): python3-cryptography-3.2.1-4.el8.x86_6 33 MB/s | 559 kB 00:00 2021-11-03T16:43:49.103 INFO:teuthology.orchestra.run.smithi194.stdout:(21/41): python3-requests-2.20.0-2.1.el8_1.noar 27 MB/s | 123 kB 00:00 2021-11-03T16:43:49.105 INFO:teuthology.orchestra.run.smithi194.stdout:(22/41): python3-urllib3-1.24.2-5.el8.noarch.rp 34 MB/s | 177 kB 00:00 2021-11-03T16:43:49.200 INFO:teuthology.orchestra.run.smithi194.stdout:(23/41): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 446 kB/s | 44 kB 00:00 2021-11-03T16:43:49.225 INFO:teuthology.orchestra.run.smithi194.stdout:(24/41): python3-beautifulsoup4-4.6.3-2.el8.1.n 1.5 MB/s | 185 kB 00:00 2021-11-03T16:43:49.243 INFO:teuthology.orchestra.run.smithi194.stdout:(25/41): python3-cheroot-8.5.2-1.el8.noarch.rpm 1.2 MB/s | 173 kB 00:00 2021-11-03T16:43:49.251 INFO:teuthology.orchestra.run.smithi194.stdout:(26/41): python3-cssselect-0.9.2-10.el8.noarch. 1.5 MB/s | 40 kB 00:00 2021-11-03T16:43:49.271 INFO:teuthology.orchestra.run.smithi194.stdout:(27/41): python3-jaraco-6.2-6.el8.noarch.rpm 398 kB/s | 11 kB 00:00 2021-11-03T16:43:49.276 INFO:teuthology.orchestra.run.smithi194.stdout:(28/41): python3-jaraco-functools-2.0-4.el8.noa 684 kB/s | 18 kB 00:00 2021-11-03T16:43:49.299 INFO:teuthology.orchestra.run.smithi194.stdout:(29/41): python3-cherrypy-18.4.0-1.el8.noarch.r 3.8 MB/s | 384 kB 00:00 2021-11-03T16:43:49.300 INFO:teuthology.orchestra.run.smithi194.stdout:(30/41): python3-logutils-0.3.5-11.el8.noarch.r 1.7 MB/s | 49 kB 00:00 2021-11-03T16:43:49.302 INFO:teuthology.orchestra.run.smithi194.stdout:(31/41): python3-more-itertools-7.2.0-3.el8.noa 2.3 MB/s | 59 kB 00:00 2021-11-03T16:43:49.327 INFO:teuthology.orchestra.run.smithi194.stdout:(32/41): python3-simplegeneric-0.8.1-17.el8.noa 749 kB/s | 19 kB 00:00 2021-11-03T16:43:49.328 INFO:teuthology.orchestra.run.smithi194.stdout:(33/41): python3-portend-2.6-1.el8.noarch.rpm 563 kB/s | 16 kB 00:00 2021-11-03T16:43:49.351 INFO:teuthology.orchestra.run.smithi194.stdout:(34/41): python3-pecan-1.3.2-9.el8.noarch.rpm 5.4 MB/s | 283 kB 00:00 2021-11-03T16:43:49.352 INFO:teuthology.orchestra.run.smithi194.stdout:(35/41): python3-singledispatch-3.4.0.3-18.el8. 971 kB/s | 24 kB 00:00 2021-11-03T16:43:49.356 INFO:teuthology.orchestra.run.smithi194.stdout:(36/41): python3-tempora-1.14.1-5.el8.noarch.rp 1.0 MB/s | 29 kB 00:00 2021-11-03T16:43:49.376 INFO:teuthology.orchestra.run.smithi194.stdout:(37/41): python3-trustme-0.6.0-4.el8.noarch.rpm 1.1 MB/s | 27 kB 00:00 2021-11-03T16:43:49.402 INFO:teuthology.orchestra.run.smithi194.stdout:(38/41): python3-webtest-2.0.33-1.el8.noarch.rp 3.2 MB/s | 85 kB 00:00 2021-11-03T16:43:49.403 INFO:teuthology.orchestra.run.smithi194.stdout:(39/41): python3-waitress-1.2.1-2.el8.1.noarch. 4.6 MB/s | 241 kB 00:00 2021-11-03T16:43:49.417 INFO:teuthology.orchestra.run.smithi194.stdout:(40/41): python3-webob-1.8.5-1.el8.1.noarch.rpm 4.1 MB/s | 251 kB 00:00 2021-11-03T16:43:49.428 INFO:teuthology.orchestra.run.smithi194.stdout:(41/41): python3-zc-lockfile-2.0-2.el8.noarch.r 899 kB/s | 23 kB 00:00 2021-11-03T16:43:49.432 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2021-11-03T16:43:49.432 INFO:teuthology.orchestra.run.smithi194.stdout:Total 39 MB/s | 33 MB 00:00 2021-11-03T16:43:49.457 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2021-11-03T16:43:49.498 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2021-11-03T16:43:49.498 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2021-11-03T16:43:49.732 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2021-11-03T16:43:49.741 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2021-11-03T16:43:50.369 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2021-11-03T16:43:50.373 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:43:50.374 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2021-11-03T16:43:50.374 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:43:50.374 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2021-11-03T16:43:50.374 INFO:teuthology.orchestra.run.smithi026.stdout: ceph x86_64 2:16.2.4-0.el8 ceph 6.3 k 2021-11-03T16:43:50.375 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2021-11-03T16:43:50.375 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mds x86_64 2:16.2.4-0.el8 ceph 2.4 M 2021-11-03T16:43:50.375 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr x86_64 2:16.2.4-0.el8 ceph 1.6 M 2021-11-03T16:43:50.375 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-modules-core noarch 2:16.2.4-0.el8 ceph-noarch 220 k 2021-11-03T16:43:50.376 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mon x86_64 2:16.2.4-0.el8 ceph 5.0 M 2021-11-03T16:43:50.376 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-osd x86_64 2:16.2.4-0.el8 ceph 18 M 2021-11-03T16:43:50.376 INFO:teuthology.orchestra.run.smithi026.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2021-11-03T16:43:50.376 INFO:teuthology.orchestra.run.smithi026.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2021-11-03T16:43:50.377 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-Base 237 k 2021-11-03T16:43:50.377 INFO:teuthology.orchestra.run.smithi026.stdout: python3-chardet noarch 3.0.4-7.el8 CentOS-Base 195 k 2021-11-03T16:43:50.377 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2021-11-03T16:43:50.377 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2021-11-03T16:43:50.377 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cryptography x86_64 3.2.1-4.el8 CentOS-Base 559 k 2021-11-03T16:43:50.378 INFO:teuthology.orchestra.run.smithi026.stdout: python3-idna noarch 2.5-5.el8 CentOS-Base 97 k 2021-11-03T16:43:50.378 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2021-11-03T16:43:50.378 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2021-11-03T16:43:50.378 INFO:teuthology.orchestra.run.smithi026.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2021-11-03T16:43:50.379 INFO:teuthology.orchestra.run.smithi026.stdout: python3-lxml x86_64 4.2.3-2.el8 CentOS-AppStream 1.5 M 2021-11-03T16:43:50.379 INFO:teuthology.orchestra.run.smithi026.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2021-11-03T16:43:50.379 INFO:teuthology.orchestra.run.smithi026.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2021-11-03T16:43:50.379 INFO:teuthology.orchestra.run.smithi026.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2021-11-03T16:43:50.379 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2021-11-03T16:43:50.380 INFO:teuthology.orchestra.run.smithi026.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2021-11-03T16:43:50.380 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2021-11-03T16:43:50.380 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-Base 109 k 2021-11-03T16:43:50.380 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pysocks noarch 1.6.8-3.el8 CentOS-Base 34 k 2021-11-03T16:43:50.381 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2021-11-03T16:43:50.381 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests noarch 2.20.0-2.1.el8_1 CentOS-Base 123 k 2021-11-03T16:43:50.381 INFO:teuthology.orchestra.run.smithi026.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2021-11-03T16:43:50.381 INFO:teuthology.orchestra.run.smithi026.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2021-11-03T16:43:50.381 INFO:teuthology.orchestra.run.smithi026.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2021-11-03T16:43:50.382 INFO:teuthology.orchestra.run.smithi026.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2021-11-03T16:43:50.382 INFO:teuthology.orchestra.run.smithi026.stdout: python3-urllib3 noarch 1.24.2-5.el8 CentOS-Base 177 k 2021-11-03T16:43:50.382 INFO:teuthology.orchestra.run.smithi026.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2021-11-03T16:43:50.382 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webencodings noarch 0.5.1-6.el8 CentOS-AppStream 27 k 2021-11-03T16:43:50.383 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2021-11-03T16:43:50.383 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2021-11-03T16:43:50.383 INFO:teuthology.orchestra.run.smithi026.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2021-11-03T16:43:50.383 INFO:teuthology.orchestra.run.smithi026.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2021-11-03T16:43:50.383 INFO:teuthology.orchestra.run.smithi026.stdout:Installing weak dependencies: 2021-11-03T16:43:50.384 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2021-11-03T16:43:50.384 INFO:teuthology.orchestra.run.smithi026.stdout: python3-html5lib noarch 1:0.999999999-6.el8 CentOS-AppStream 214 k 2021-11-03T16:43:50.384 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:43:50.384 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2021-11-03T16:43:50.385 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:43:50.385 INFO:teuthology.orchestra.run.smithi026.stdout:Install 41 Packages 2021-11-03T16:43:50.385 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:43:50.386 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 33 M 2021-11-03T16:43:50.386 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 119 M 2021-11-03T16:43:50.386 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2021-11-03T16:43:50.440 INFO:teuthology.orchestra.run.smithi026.stdout:(1/41): ceph-16.2.4-0.el8.x86_64.rpm 106 kB/s | 6.3 kB 00:00 2021-11-03T16:43:50.493 INFO:teuthology.orchestra.run.smithi026.stdout:(2/41): ceph-mds-16.2.4-0.el8.x86_64.rpm 21 MB/s | 2.4 MB 00:00 2021-11-03T16:43:50.525 INFO:teuthology.orchestra.run.smithi026.stdout:(3/41): ceph-mgr-16.2.4-0.el8.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2021-11-03T16:43:50.545 INFO:teuthology.orchestra.run.smithi026.stdout:(4/41): ceph-mgr-modules-core-16.2.4-0.el8.noar 11 MB/s | 220 kB 00:00 2021-11-03T16:43:50.578 INFO:teuthology.orchestra.run.smithi026.stdout:(5/41): python3-html5lib-0.999999999-6.el8.noar 6.4 MB/s | 214 kB 00:00 2021-11-03T16:43:50.598 INFO:teuthology.orchestra.run.smithi026.stdout:(6/41): python3-lxml-4.2.3-2.el8.x86_64.rpm 77 MB/s | 1.5 MB 00:00 2021-11-03T16:43:50.603 INFO:teuthology.orchestra.run.smithi026.stdout:(7/41): python3-mako-1.0.6-13.el8.noarch.rpm 31 MB/s | 157 kB 00:00 2021-11-03T16:43:50.606 INFO:teuthology.orchestra.run.smithi026.stdout:(8/41): python3-markupsafe-0.23-19.el8.x86_64.r 14 MB/s | 39 kB 00:00 2021-11-03T16:43:50.609 INFO:teuthology.orchestra.run.smithi026.stdout:(9/41): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 29 MB/s | 103 kB 00:00 2021-11-03T16:43:50.614 INFO:teuthology.orchestra.run.smithi026.stdout:(10/41): python3-pytz-2017.2-9.el8.noarch.rpm 15 MB/s | 54 kB 00:00 2021-11-03T16:43:50.615 INFO:teuthology.orchestra.run.smithi026.stdout:(11/41): python3-webencodings-0.5.1-6.el8.noarc 16 MB/s | 27 kB 00:00 2021-11-03T16:43:50.624 INFO:teuthology.orchestra.run.smithi026.stdout:(12/41): python3-werkzeug-0.12.2-4.el8.noarch.r 48 MB/s | 457 kB 00:00 2021-11-03T16:43:50.629 INFO:teuthology.orchestra.run.smithi026.stdout:(13/41): python3-cffi-1.11.5-5.el8.x86_64.rpm 48 MB/s | 237 kB 00:00 2021-11-03T16:43:50.635 INFO:teuthology.orchestra.run.smithi026.stdout:(14/41): python3-chardet-3.0.4-7.el8.noarch.rpm 38 MB/s | 195 kB 00:00 2021-11-03T16:43:50.651 INFO:teuthology.orchestra.run.smithi026.stdout:(15/41): python3-cryptography-3.2.1-4.el8.x86_6 33 MB/s | 559 kB 00:00 2021-11-03T16:43:50.653 INFO:teuthology.orchestra.run.smithi026.stdout:(16/41): python3-idna-2.5-5.el8.noarch.rpm 49 MB/s | 97 kB 00:00 2021-11-03T16:43:50.656 INFO:teuthology.orchestra.run.smithi026.stdout:(17/41): python3-pycparser-2.14-14.el8.noarch.r 45 MB/s | 109 kB 00:00 2021-11-03T16:43:50.657 INFO:teuthology.orchestra.run.smithi026.stdout:(18/41): python3-pysocks-1.6.8-3.el8.noarch.rpm 27 MB/s | 34 kB 00:00 2021-11-03T16:43:50.660 INFO:teuthology.orchestra.run.smithi026.stdout:(19/41): python3-requests-2.20.0-2.1.el8_1.noar 43 MB/s | 123 kB 00:00 2021-11-03T16:43:50.663 INFO:teuthology.orchestra.run.smithi026.stdout:(20/41): python3-urllib3-1.24.2-5.el8.noarch.rp 61 MB/s | 177 kB 00:00 2021-11-03T16:43:50.760 INFO:teuthology.orchestra.run.smithi026.stdout:(21/41): ceph-mon-16.2.4-0.el8.x86_64.rpm 16 MB/s | 5.0 MB 00:00 2021-11-03T16:43:50.775 INFO:teuthology.orchestra.run.smithi026.stdout:(22/41): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 392 kB/s | 44 kB 00:00 2021-11-03T16:43:50.916 INFO:teuthology.orchestra.run.smithi026.stdout:(23/41): ceph-osd-16.2.4-0.el8.x86_64.rpm 43 MB/s | 18 MB 00:00 2021-11-03T16:43:50.917 INFO:teuthology.orchestra.run.smithi026.stdout:(24/41): python3-cheroot-8.5.2-1.el8.noarch.rpm 1.2 MB/s | 173 kB 00:00 2021-11-03T16:43:50.945 INFO:teuthology.orchestra.run.smithi026.stdout:(25/41): python3-cssselect-0.9.2-10.el8.noarch. 1.4 MB/s | 40 kB 00:00 2021-11-03T16:43:50.974 INFO:teuthology.orchestra.run.smithi026.stdout:(26/41): python3-jaraco-6.2-6.el8.noarch.rpm 394 kB/s | 11 kB 00:00 2021-11-03T16:43:51.002 INFO:teuthology.orchestra.run.smithi026.stdout:(27/41): python3-jaraco-functools-2.0-4.el8.noa 626 kB/s | 18 kB 00:00 2021-11-03T16:43:51.027 INFO:teuthology.orchestra.run.smithi026.stdout:(28/41): python3-beautifulsoup4-4.6.3-2.el8.1.n 694 kB/s | 185 kB 00:00 2021-11-03T16:43:51.031 INFO:teuthology.orchestra.run.smithi026.stdout:(29/41): python3-logutils-0.3.5-11.el8.noarch.r 1.7 MB/s | 49 kB 00:00 2021-11-03T16:43:51.056 INFO:teuthology.orchestra.run.smithi026.stdout:(30/41): python3-more-itertools-7.2.0-3.el8.noa 2.0 MB/s | 59 kB 00:00 2021-11-03T16:43:51.084 INFO:teuthology.orchestra.run.smithi026.stdout:(31/41): python3-portend-2.6-1.el8.noarch.rpm 556 kB/s | 16 kB 00:00 2021-11-03T16:43:51.085 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2021-11-03T16:43:51.089 INFO:teuthology.orchestra.run.smithi026.stdout:(32/41): python3-cherrypy-18.4.0-1.el8.noarch.r 2.2 MB/s | 384 kB 00:00 2021-11-03T16:43:51.090 INFO:teuthology.orchestra.run.smithi026.stdout:(33/41): python3-pecan-1.3.2-9.el8.noarch.rpm 4.7 MB/s | 283 kB 00:00 2021-11-03T16:43:51.112 INFO:teuthology.orchestra.run.smithi026.stdout:(34/41): python3-simplegeneric-0.8.1-17.el8.noa 661 kB/s | 19 kB 00:00 2021-11-03T16:43:51.114 INFO:teuthology.orchestra.run.smithi026.stdout:(35/41): python3-singledispatch-3.4.0.3-18.el8. 956 kB/s | 24 kB 00:00 2021-11-03T16:43:51.118 INFO:teuthology.orchestra.run.smithi026.stdout:(36/41): python3-tempora-1.14.1-5.el8.noarch.rp 1.0 MB/s | 29 kB 00:00 2021-11-03T16:43:51.142 INFO:teuthology.orchestra.run.smithi026.stdout:(37/41): python3-trustme-0.6.0-4.el8.noarch.rpm 939 kB/s | 27 kB 00:00 2021-11-03T16:43:51.166 INFO:teuthology.orchestra.run.smithi026.stdout:(38/41): python3-waitress-1.2.1-2.el8.1.noarch. 4.6 MB/s | 241 kB 00:00 2021-11-03T16:43:51.172 INFO:teuthology.orchestra.run.smithi026.stdout:(39/41): python3-webtest-2.0.33-1.el8.noarch.rp 2.8 MB/s | 85 kB 00:00 2021-11-03T16:43:51.175 INFO:teuthology.orchestra.run.smithi026.stdout:(40/41): python3-webob-1.8.5-1.el8.1.noarch.rpm 4.3 MB/s | 251 kB 00:00 2021-11-03T16:43:51.192 INFO:teuthology.orchestra.run.smithi026.stdout:(41/41): python3-zc-lockfile-2.0-2.el8.noarch.r 883 kB/s | 23 kB 00:00 2021-11-03T16:43:51.195 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2021-11-03T16:43:51.196 INFO:teuthology.orchestra.run.smithi026.stdout:Total 41 MB/s | 33 MB 00:00 2021-11-03T16:43:51.225 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2021-11-03T16:43:51.271 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2021-11-03T16:43:51.272 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2021-11-03T16:43:51.303 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/41 2021-11-03T16:43:51.524 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2021-11-03T16:43:51.527 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2021-11-03T16:43:51.650 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/41 2021-11-03T16:43:51.853 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-idna-2.5-5.el8.noarch 3/41 2021-11-03T16:43:52.072 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 4/41 2021-11-03T16:43:52.251 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 5/41 2021-11-03T16:43:52.399 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 6/41 2021-11-03T16:43:52.572 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 7/41 2021-11-03T16:43:52.748 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 8/41 2021-11-03T16:43:52.886 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 9/41 2021-11-03T16:43:52.997 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2021-11-03T16:43:53.049 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 10/41 2021-11-03T16:43:53.195 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 11/41 2021-11-03T16:43:53.251 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/41 2021-11-03T16:43:53.456 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 12/41 2021-11-03T16:43:53.477 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/41 2021-11-03T16:43:53.631 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-idna-2.5-5.el8.noarch 3/41 2021-11-03T16:43:53.690 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-urllib3-1.24.2-5.el8.noarch 13/41 2021-11-03T16:43:53.888 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 4/41 2021-11-03T16:43:53.938 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 14/41 2021-11-03T16:43:54.105 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 5/41 2021-11-03T16:43:54.294 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 6/41 2021-11-03T16:43:54.338 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 15/41 2021-11-03T16:43:54.452 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 7/41 2021-11-03T16:43:54.573 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cryptography-3.2.1-4.el8.x86_64 16/41 2021-11-03T16:43:54.659 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 8/41 2021-11-03T16:43:54.778 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 17/41 2021-11-03T16:43:54.847 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 9/41 2021-11-03T16:43:54.989 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 18/41 2021-11-03T16:43:55.003 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 10/41 2021-11-03T16:43:55.190 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 11/41 2021-11-03T16:43:55.220 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 19/41 2021-11-03T16:43:55.446 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 20/41 2021-11-03T16:43:55.470 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 12/41 2021-11-03T16:43:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 21/41 2021-11-03T16:43:55.726 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-urllib3-1.24.2-5.el8.noarch 13/41 2021-11-03T16:43:55.898 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 22/41 2021-11-03T16:43:55.986 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 14/41 2021-11-03T16:43:56.131 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 23/41 2021-11-03T16:43:56.366 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 24/41 2021-11-03T16:43:56.408 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 15/41 2021-11-03T16:43:56.590 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 25/41 2021-11-03T16:43:56.644 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cryptography-3.2.1-4.el8.x86_64 16/41 2021-11-03T16:43:56.847 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 17/41 2021-11-03T16:43:56.937 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 26/41 2021-11-03T16:43:57.102 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 18/41 2021-11-03T16:43:57.349 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 19/41 2021-11-03T16:43:57.530 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-lxml-4.2.3-2.el8.x86_64 27/41 2021-11-03T16:43:57.621 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 20/41 2021-11-03T16:43:57.701 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 28/41 2021-11-03T16:43:57.838 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 21/41 2021-11-03T16:43:57.914 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 29/41 2021-11-03T16:43:58.107 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 22/41 2021-11-03T16:43:58.108 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 30/41 2021-11-03T16:43:58.351 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 23/41 2021-11-03T16:43:58.391 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-portend-2.6-1.el8.noarch 31/41 2021-11-03T16:43:58.614 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 24/41 2021-11-03T16:43:58.616 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 32/41 2021-11-03T16:43:58.829 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 33/41 2021-11-03T16:43:58.878 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 25/41 2021-11-03T16:43:59.169 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 34/41 2021-11-03T16:43:59.274 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 26/41 2021-11-03T16:43:59.521 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-lxml-4.2.3-2.el8.x86_64 27/41 2021-11-03T16:43:59.538 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 35/41 2021-11-03T16:43:59.745 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 28/41 2021-11-03T16:43:59.897 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 36/41 2021-11-03T16:43:59.941 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 29/41 2021-11-03T16:44:00.067 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-2:16.2.4-0.el8.x86_64 37/41 2021-11-03T16:44:00.177 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 30/41 2021-11-03T16:44:00.611 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-portend-2.6-1.el8.noarch 31/41 2021-11-03T16:44:00.886 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 32/41 2021-11-03T16:44:01.179 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 33/41 2021-11-03T16:44:01.591 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-2:16.2.4-0.el8.x86_64 37/41 2021-11-03T16:44:01.733 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 34/41 2021-11-03T16:44:01.817 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-osd-2:16.2.4-0.el8.x86_64 38/41 2021-11-03T16:44:02.115 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 35/41 2021-11-03T16:44:02.248 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-osd-2:16.2.4-0.el8.x86_64 38/41 2021-11-03T16:44:02.467 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mon-2:16.2.4-0.el8.x86_64 39/41 2021-11-03T16:44:02.516 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 36/41 2021-11-03T16:44:02.685 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-2:16.2.4-0.el8.x86_64 37/41 2021-11-03T16:44:02.688 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mon-2:16.2.4-0.el8.x86_64 39/41 2021-11-03T16:44:03.327 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mds-2:16.2.4-0.el8.x86_64 40/41 2021-11-03T16:44:03.347 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mds-2:16.2.4-0.el8.x86_64 40/41 2021-11-03T16:44:03.459 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-2:16.2.4-0.el8.x86_64 41/41 2021-11-03T16:44:03.833 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-2:16.2.4-0.el8.x86_64 41/41 2021-11-03T16:44:03.833 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-2:16.2.4-0.el8.x86_64 1/41 2021-11-03T16:44:03.833 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mds-2:16.2.4-0.el8.x86_64 2/41 2021-11-03T16:44:03.834 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-2:16.2.4-0.el8.x86_64 3/41 2021-11-03T16:44:03.834 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mon-2:16.2.4-0.el8.x86_64 4/41 2021-11-03T16:44:03.834 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-osd-2:16.2.4-0.el8.x86_64 5/41 2021-11-03T16:44:03.834 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 6/41 2021-11-03T16:44:03.835 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 7/41 2021-11-03T16:44:03.835 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-lxml-4.2.3-2.el8.x86_64 8/41 2021-11-03T16:44:03.835 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 9/41 2021-11-03T16:44:03.835 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 10/41 2021-11-03T16:44:03.835 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 11/41 2021-11-03T16:44:03.836 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 12/41 2021-11-03T16:44:03.836 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 13/41 2021-11-03T16:44:03.836 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 14/41 2021-11-03T16:44:03.836 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 15/41 2021-11-03T16:44:03.837 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 16/41 2021-11-03T16:44:03.837 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cryptography-3.2.1-4.el8.x86_64 17/41 2021-11-03T16:44:03.837 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-idna-2.5-5.el8.noarch 18/41 2021-11-03T16:44:03.837 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 19/41 2021-11-03T16:44:03.837 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 20/41 2021-11-03T16:44:03.838 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 21/41 2021-11-03T16:44:03.838 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-urllib3-1.24.2-5.el8.noarch 22/41 2021-11-03T16:44:03.838 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 23/41 2021-11-03T16:44:03.838 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 24/41 2021-11-03T16:44:03.839 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 25/41 2021-11-03T16:44:03.839 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 26/41 2021-11-03T16:44:03.839 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 27/41 2021-11-03T16:44:03.839 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 28/41 2021-11-03T16:44:03.839 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 29/41 2021-11-03T16:44:03.840 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 30/41 2021-11-03T16:44:03.840 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 31/41 2021-11-03T16:44:03.840 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 32/41 2021-11-03T16:44:03.840 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-portend-2.6-1.el8.noarch 33/41 2021-11-03T16:44:03.841 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 34/41 2021-11-03T16:44:03.841 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 35/41 2021-11-03T16:44:03.841 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 36/41 2021-11-03T16:44:03.841 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 37/41 2021-11-03T16:44:03.841 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 38/41 2021-11-03T16:44:03.842 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 39/41 2021-11-03T16:44:03.842 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 40/41 2021-11-03T16:44:04.308 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-2:16.2.4-0.el8.x86_64 37/41 2021-11-03T16:44:04.651 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 41/41 2021-11-03T16:44:04.652 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:44:04.652 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2021-11-03T16:44:04.652 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-2:16.2.4-0.el8.x86_64 2021-11-03T16:44:04.652 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mds-2:16.2.4-0.el8.x86_64 2021-11-03T16:44:04.653 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-2:16.2.4-0.el8.x86_64 2021-11-03T16:44:04.653 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 2021-11-03T16:44:04.653 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mon-2:16.2.4-0.el8.x86_64 2021-11-03T16:44:04.653 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-osd-2:16.2.4-0.el8.x86_64 2021-11-03T16:44:04.654 INFO:teuthology.orchestra.run.smithi194.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2021-11-03T16:44:04.654 INFO:teuthology.orchestra.run.smithi194.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2021-11-03T16:44:04.654 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cffi-1.11.5-5.el8.x86_64 2021-11-03T16:44:04.654 INFO:teuthology.orchestra.run.smithi194.stdout: python3-chardet-3.0.4-7.el8.noarch 2021-11-03T16:44:04.654 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cheroot-8.5.2-1.el8.noarch 2021-11-03T16:44:04.655 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2021-11-03T16:44:04.655 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cryptography-3.2.1-4.el8.x86_64 2021-11-03T16:44:04.655 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cssselect-0.9.2-10.el8.noarch 2021-11-03T16:44:04.655 INFO:teuthology.orchestra.run.smithi194.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2021-11-03T16:44:04.656 INFO:teuthology.orchestra.run.smithi194.stdout: python3-idna-2.5-5.el8.noarch 2021-11-03T16:44:04.656 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-6.2-6.el8.noarch 2021-11-03T16:44:04.656 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2021-11-03T16:44:04.656 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils-0.3.5-11.el8.noarch 2021-11-03T16:44:04.656 INFO:teuthology.orchestra.run.smithi194.stdout: python3-lxml-4.2.3-2.el8.x86_64 2021-11-03T16:44:04.657 INFO:teuthology.orchestra.run.smithi194.stdout: python3-mako-1.0.6-13.el8.noarch 2021-11-03T16:44:04.657 INFO:teuthology.orchestra.run.smithi194.stdout: python3-markupsafe-0.23-19.el8.x86_64 2021-11-03T16:44:04.657 INFO:teuthology.orchestra.run.smithi194.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2021-11-03T16:44:04.657 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan-1.3.2-9.el8.noarch 2021-11-03T16:44:04.658 INFO:teuthology.orchestra.run.smithi194.stdout: python3-portend-2.6-1.el8.noarch 2021-11-03T16:44:04.658 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2021-11-03T16:44:04.658 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pycparser-2.14-14.el8.noarch 2021-11-03T16:44:04.658 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pysocks-1.6.8-3.el8.noarch 2021-11-03T16:44:04.659 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pytz-2017.2-9.el8.noarch 2021-11-03T16:44:04.659 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2021-11-03T16:44:04.659 INFO:teuthology.orchestra.run.smithi194.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2021-11-03T16:44:04.659 INFO:teuthology.orchestra.run.smithi194.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2021-11-03T16:44:04.660 INFO:teuthology.orchestra.run.smithi194.stdout: python3-tempora-1.14.1-5.el8.noarch 2021-11-03T16:44:04.660 INFO:teuthology.orchestra.run.smithi194.stdout: python3-trustme-0.6.0-4.el8.noarch 2021-11-03T16:44:04.660 INFO:teuthology.orchestra.run.smithi194.stdout: python3-urllib3-1.24.2-5.el8.noarch 2021-11-03T16:44:04.660 INFO:teuthology.orchestra.run.smithi194.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2021-11-03T16:44:04.660 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webencodings-0.5.1-6.el8.noarch 2021-11-03T16:44:04.661 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webob-1.8.5-1.el8.1.noarch 2021-11-03T16:44:04.661 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webtest-2.0.33-1.el8.noarch 2021-11-03T16:44:04.661 INFO:teuthology.orchestra.run.smithi194.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2021-11-03T16:44:04.661 INFO:teuthology.orchestra.run.smithi194.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2021-11-03T16:44:04.662 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:44:04.662 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2021-11-03T16:44:04.693 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-osd-2:16.2.4-0.el8.x86_64 38/41 2021-11-03T16:44:04.923 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-base 2021-11-03T16:44:05.153 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-osd-2:16.2.4-0.el8.x86_64 38/41 2021-11-03T16:44:05.351 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mon-2:16.2.4-0.el8.x86_64 39/41 2021-11-03T16:44:05.378 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:06 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:44:05.586 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mon-2:16.2.4-0.el8.x86_64 39/41 2021-11-03T16:44:05.804 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mds-2:16.2.4-0.el8.x86_64 40/41 2021-11-03T16:44:05.821 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mds-2:16.2.4-0.el8.x86_64 40/41 2021-11-03T16:44:05.978 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-2:16.2.4-0.el8.x86_64 41/41 2021-11-03T16:44:06.098 INFO:teuthology.orchestra.run.smithi194.stdout:Package ceph-base-2:16.2.4-0.el8.x86_64 is already installed. 2021-11-03T16:44:06.375 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2021-11-03T16:44:06.377 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2021-11-03T16:44:06.377 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2021-11-03T16:44:06.382 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-2:16.2.4-0.el8.x86_64 41/41 2021-11-03T16:44:06.383 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-2:16.2.4-0.el8.x86_64 1/41 2021-11-03T16:44:06.383 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mds-2:16.2.4-0.el8.x86_64 2/41 2021-11-03T16:44:06.383 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-2:16.2.4-0.el8.x86_64 3/41 2021-11-03T16:44:06.383 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mon-2:16.2.4-0.el8.x86_64 4/41 2021-11-03T16:44:06.384 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-osd-2:16.2.4-0.el8.x86_64 5/41 2021-11-03T16:44:06.384 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 6/41 2021-11-03T16:44:06.384 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 7/41 2021-11-03T16:44:06.384 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-lxml-4.2.3-2.el8.x86_64 8/41 2021-11-03T16:44:06.385 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 9/41 2021-11-03T16:44:06.385 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 10/41 2021-11-03T16:44:06.385 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 11/41 2021-11-03T16:44:06.385 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 12/41 2021-11-03T16:44:06.386 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 13/41 2021-11-03T16:44:06.386 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 14/41 2021-11-03T16:44:06.386 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 15/41 2021-11-03T16:44:06.386 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 16/41 2021-11-03T16:44:06.387 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cryptography-3.2.1-4.el8.x86_64 17/41 2021-11-03T16:44:06.387 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-idna-2.5-5.el8.noarch 18/41 2021-11-03T16:44:06.387 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 19/41 2021-11-03T16:44:06.387 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 20/41 2021-11-03T16:44:06.387 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 21/41 2021-11-03T16:44:06.388 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-urllib3-1.24.2-5.el8.noarch 22/41 2021-11-03T16:44:06.388 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 23/41 2021-11-03T16:44:06.388 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 24/41 2021-11-03T16:44:06.388 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 25/41 2021-11-03T16:44:06.389 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 26/41 2021-11-03T16:44:06.389 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 27/41 2021-11-03T16:44:06.389 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 28/41 2021-11-03T16:44:06.391 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 29/41 2021-11-03T16:44:06.391 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 30/41 2021-11-03T16:44:06.392 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 31/41 2021-11-03T16:44:06.392 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 32/41 2021-11-03T16:44:06.392 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-portend-2.6-1.el8.noarch 33/41 2021-11-03T16:44:06.392 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 34/41 2021-11-03T16:44:06.393 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 35/41 2021-11-03T16:44:06.393 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 36/41 2021-11-03T16:44:06.393 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 37/41 2021-11-03T16:44:06.393 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 38/41 2021-11-03T16:44:06.394 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 39/41 2021-11-03T16:44:06.394 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 40/41 2021-11-03T16:44:06.429 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install cephadm 2021-11-03T16:44:06.878 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:07 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:44:07.649 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 41/41 2021-11-03T16:44:07.650 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:44:07.650 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2021-11-03T16:44:07.650 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-2:16.2.4-0.el8.x86_64 2021-11-03T16:44:07.650 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mds-2:16.2.4-0.el8.x86_64 2021-11-03T16:44:07.651 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-2:16.2.4-0.el8.x86_64 2021-11-03T16:44:07.651 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 2021-11-03T16:44:07.651 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mon-2:16.2.4-0.el8.x86_64 2021-11-03T16:44:07.651 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-osd-2:16.2.4-0.el8.x86_64 2021-11-03T16:44:07.651 INFO:teuthology.orchestra.run.smithi026.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2021-11-03T16:44:07.652 INFO:teuthology.orchestra.run.smithi026.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2021-11-03T16:44:07.652 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cffi-1.11.5-5.el8.x86_64 2021-11-03T16:44:07.652 INFO:teuthology.orchestra.run.smithi026.stdout: python3-chardet-3.0.4-7.el8.noarch 2021-11-03T16:44:07.652 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cheroot-8.5.2-1.el8.noarch 2021-11-03T16:44:07.653 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2021-11-03T16:44:07.653 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cryptography-3.2.1-4.el8.x86_64 2021-11-03T16:44:07.653 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cssselect-0.9.2-10.el8.noarch 2021-11-03T16:44:07.653 INFO:teuthology.orchestra.run.smithi026.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2021-11-03T16:44:07.653 INFO:teuthology.orchestra.run.smithi026.stdout: python3-idna-2.5-5.el8.noarch 2021-11-03T16:44:07.654 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-6.2-6.el8.noarch 2021-11-03T16:44:07.654 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2021-11-03T16:44:07.654 INFO:teuthology.orchestra.run.smithi026.stdout: python3-logutils-0.3.5-11.el8.noarch 2021-11-03T16:44:07.654 INFO:teuthology.orchestra.run.smithi026.stdout: python3-lxml-4.2.3-2.el8.x86_64 2021-11-03T16:44:07.655 INFO:teuthology.orchestra.run.smithi026.stdout: python3-mako-1.0.6-13.el8.noarch 2021-11-03T16:44:07.655 INFO:teuthology.orchestra.run.smithi026.stdout: python3-markupsafe-0.23-19.el8.x86_64 2021-11-03T16:44:07.655 INFO:teuthology.orchestra.run.smithi026.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2021-11-03T16:44:07.655 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pecan-1.3.2-9.el8.noarch 2021-11-03T16:44:07.656 INFO:teuthology.orchestra.run.smithi026.stdout: python3-portend-2.6-1.el8.noarch 2021-11-03T16:44:07.656 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2021-11-03T16:44:07.656 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pycparser-2.14-14.el8.noarch 2021-11-03T16:44:07.656 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pysocks-1.6.8-3.el8.noarch 2021-11-03T16:44:07.656 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pytz-2017.2-9.el8.noarch 2021-11-03T16:44:07.657 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2021-11-03T16:44:07.657 INFO:teuthology.orchestra.run.smithi026.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2021-11-03T16:44:07.657 INFO:teuthology.orchestra.run.smithi026.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2021-11-03T16:44:07.657 INFO:teuthology.orchestra.run.smithi026.stdout: python3-tempora-1.14.1-5.el8.noarch 2021-11-03T16:44:07.657 INFO:teuthology.orchestra.run.smithi026.stdout: python3-trustme-0.6.0-4.el8.noarch 2021-11-03T16:44:07.658 INFO:teuthology.orchestra.run.smithi026.stdout: python3-urllib3-1.24.2-5.el8.noarch 2021-11-03T16:44:07.658 INFO:teuthology.orchestra.run.smithi026.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2021-11-03T16:44:07.658 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webencodings-0.5.1-6.el8.noarch 2021-11-03T16:44:07.658 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webob-1.8.5-1.el8.1.noarch 2021-11-03T16:44:07.659 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webtest-2.0.33-1.el8.noarch 2021-11-03T16:44:07.660 INFO:teuthology.orchestra.run.smithi026.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2021-11-03T16:44:07.660 INFO:teuthology.orchestra.run.smithi026.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2021-11-03T16:44:07.660 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:44:07.661 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2021-11-03T16:44:07.832 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-base 2021-11-03T16:44:07.879 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2021-11-03T16:44:07.880 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:44:07.881 INFO:teuthology.orchestra.run.smithi194.stdout: Package Architecture Version Repository Size 2021-11-03T16:44:07.881 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:44:07.881 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2021-11-03T16:44:07.881 INFO:teuthology.orchestra.run.smithi194.stdout: cephadm noarch 2:16.2.4-0.el8 ceph-noarch 71 k 2021-11-03T16:44:07.882 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:44:07.882 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2021-11-03T16:44:07.882 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:44:07.882 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2021-11-03T16:44:07.883 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:44:07.883 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 71 k 2021-11-03T16:44:07.883 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 290 k 2021-11-03T16:44:07.883 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2021-11-03T16:44:07.893 INFO:teuthology.orchestra.run.smithi194.stdout:cephadm-16.2.4-0.el8.noarch.rpm 5.7 MB/s | 71 kB 00:00 2021-11-03T16:44:07.894 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2021-11-03T16:44:07.894 INFO:teuthology.orchestra.run.smithi194.stdout:Total 5.1 MB/s | 71 kB 00:00 2021-11-03T16:44:07.895 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2021-11-03T16:44:07.902 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2021-11-03T16:44:07.903 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2021-11-03T16:44:07.904 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2021-11-03T16:44:07.907 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2021-11-03T16:44:07.955 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2021-11-03T16:44:08.314 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:09 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:44:09.096 INFO:teuthology.orchestra.run.smithi026.stdout:Package ceph-base-2:16.2.4-0.el8.x86_64 is already installed. 2021-11-03T16:44:09.391 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2021-11-03T16:44:09.393 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2021-11-03T16:44:09.393 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2021-11-03T16:44:09.446 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install cephadm 2021-11-03T16:44:09.923 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:10 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:44:10.128 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: cephadm-2:16.2.4-0.el8.noarch 1/1 2021-11-03T16:44:10.362 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephadm-2:16.2.4-0.el8.noarch 1/1 2021-11-03T16:44:10.550 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: cephadm-2:16.2.4-0.el8.noarch 1/1 2021-11-03T16:44:10.839 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephadm-2:16.2.4-0.el8.noarch 1/1 2021-11-03T16:44:10.839 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:44:10.840 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2021-11-03T16:44:10.840 INFO:teuthology.orchestra.run.smithi194.stdout: cephadm-2:16.2.4-0.el8.noarch 2021-11-03T16:44:10.840 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:44:10.840 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2021-11-03T16:44:10.968 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2021-11-03T16:44:10.969 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:44:10.969 INFO:teuthology.orchestra.run.smithi026.stdout: Package Architecture Version Repository Size 2021-11-03T16:44:10.969 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:44:10.970 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2021-11-03T16:44:10.970 INFO:teuthology.orchestra.run.smithi026.stdout: cephadm noarch 2:16.2.4-0.el8 ceph-noarch 71 k 2021-11-03T16:44:10.970 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:44:10.970 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2021-11-03T16:44:10.971 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:44:10.971 INFO:teuthology.orchestra.run.smithi026.stdout:Install 1 Package 2021-11-03T16:44:10.971 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:44:10.971 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 71 k 2021-11-03T16:44:10.972 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 290 k 2021-11-03T16:44:10.972 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2021-11-03T16:44:10.982 INFO:teuthology.orchestra.run.smithi026.stdout:cephadm-16.2.4-0.el8.noarch.rpm 5.7 MB/s | 71 kB 00:00 2021-11-03T16:44:10.983 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2021-11-03T16:44:10.983 INFO:teuthology.orchestra.run.smithi026.stdout:Total 5.2 MB/s | 71 kB 00:00 2021-11-03T16:44:10.983 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2021-11-03T16:44:10.991 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2021-11-03T16:44:10.991 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2021-11-03T16:44:10.993 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2021-11-03T16:44:10.996 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2021-11-03T16:44:11.005 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-immutable-object-cache 2021-11-03T16:44:11.064 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2021-11-03T16:44:11.471 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:12 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:44:12.464 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2021-11-03T16:44:12.465 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:44:12.466 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repo Size 2021-11-03T16:44:12.466 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:44:12.466 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2021-11-03T16:44:12.466 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-immutable-object-cache x86_64 2:16.2.4-0.el8 ceph 163 k 2021-11-03T16:44:12.467 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:44:12.467 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2021-11-03T16:44:12.467 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:44:12.467 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2021-11-03T16:44:12.467 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:44:12.468 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 163 k 2021-11-03T16:44:12.468 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 587 k 2021-11-03T16:44:12.468 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2021-11-03T16:44:12.480 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-immutable-object-cache-16.2.4-0.el8.x86_64 11 MB/s | 163 kB 00:00 2021-11-03T16:44:12.480 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2021-11-03T16:44:12.481 INFO:teuthology.orchestra.run.smithi194.stdout:Total 10 MB/s | 163 kB 00:00 2021-11-03T16:44:12.481 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2021-11-03T16:44:12.494 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2021-11-03T16:44:12.495 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2021-11-03T16:44:12.542 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2021-11-03T16:44:12.545 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2021-11-03T16:44:12.654 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2021-11-03T16:44:12.866 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2021-11-03T16:44:13.234 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2021-11-03T16:44:13.493 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: cephadm-2:16.2.4-0.el8.noarch 1/1 2021-11-03T16:44:13.780 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : cephadm-2:16.2.4-0.el8.noarch 1/1 2021-11-03T16:44:13.969 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: cephadm-2:16.2.4-0.el8.noarch 1/1 2021-11-03T16:44:14.094 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2021-11-03T16:44:14.095 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:44:14.095 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2021-11-03T16:44:14.095 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 2021-11-03T16:44:14.095 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:44:14.096 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2021-11-03T16:44:14.264 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : cephadm-2:16.2.4-0.el8.noarch 1/1 2021-11-03T16:44:14.265 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:44:14.265 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2021-11-03T16:44:14.265 INFO:teuthology.orchestra.run.smithi026.stdout: cephadm-2:16.2.4-0.el8.noarch 2021-11-03T16:44:14.265 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:44:14.266 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2021-11-03T16:44:14.395 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-immutable-object-cache 2021-11-03T16:44:14.886 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:15 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:44:15.794 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-mgr 2021-11-03T16:44:15.942 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2021-11-03T16:44:15.943 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:44:15.943 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repo Size 2021-11-03T16:44:15.943 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:44:15.944 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2021-11-03T16:44:15.944 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-immutable-object-cache x86_64 2:16.2.4-0.el8 ceph 163 k 2021-11-03T16:44:15.944 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:44:15.944 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2021-11-03T16:44:15.945 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:44:15.945 INFO:teuthology.orchestra.run.smithi026.stdout:Install 1 Package 2021-11-03T16:44:15.945 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:44:15.945 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 163 k 2021-11-03T16:44:15.945 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 587 k 2021-11-03T16:44:15.946 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2021-11-03T16:44:15.956 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-immutable-object-cache-16.2.4-0.el8.x86_64 12 MB/s | 163 kB 00:00 2021-11-03T16:44:15.957 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2021-11-03T16:44:15.957 INFO:teuthology.orchestra.run.smithi026.stdout:Total 11 MB/s | 163 kB 00:00 2021-11-03T16:44:15.958 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2021-11-03T16:44:15.971 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2021-11-03T16:44:15.972 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2021-11-03T16:44:16.022 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2021-11-03T16:44:16.025 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2021-11-03T16:44:16.141 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2021-11-03T16:44:16.260 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:17 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:44:16.393 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2021-11-03T16:44:16.798 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2021-11-03T16:44:16.979 INFO:teuthology.orchestra.run.smithi194.stdout:Package ceph-mgr-2:16.2.4-0.el8.x86_64 is already installed. 2021-11-03T16:44:17.252 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2021-11-03T16:44:17.253 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2021-11-03T16:44:17.253 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2021-11-03T16:44:17.309 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-mgr-dashboard 2021-11-03T16:44:17.605 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2021-11-03T16:44:17.606 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:44:17.606 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2021-11-03T16:44:17.606 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 2021-11-03T16:44:17.607 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:44:17.607 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2021-11-03T16:44:17.760 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:18 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:44:18.755 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2021-11-03T16:44:18.756 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:44:18.757 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2021-11-03T16:44:18.757 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:44:18.757 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2021-11-03T16:44:18.757 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-dashboard noarch 2:16.2.4-0.el8 ceph-noarch 2.7 M 2021-11-03T16:44:18.758 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2021-11-03T16:44:18.758 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-grafana-dashboards noarch 2:16.2.4-0.el8 ceph-noarch 24 k 2021-11-03T16:44:18.758 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-prometheus-alerts noarch 2:16.2.4-0.el8 ceph-noarch 8.9 k 2021-11-03T16:44:18.758 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-Base 43 k 2021-11-03T16:44:18.758 INFO:teuthology.orchestra.run.smithi194.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2021-11-03T16:44:18.759 INFO:teuthology.orchestra.run.smithi194.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2021-11-03T16:44:18.759 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:44:18.759 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2021-11-03T16:44:18.759 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:44:18.760 INFO:teuthology.orchestra.run.smithi194.stdout:Install 6 Packages 2021-11-03T16:44:18.760 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:44:18.761 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 3.0 M 2021-11-03T16:44:18.761 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 15 M 2021-11-03T16:44:18.761 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2021-11-03T16:44:18.780 INFO:teuthology.orchestra.run.smithi194.stdout:(1/6): ceph-grafana-dashboards-16.2.4-0.el8.noa 1.1 MB/s | 24 kB 00:00 2021-11-03T16:44:18.786 INFO:teuthology.orchestra.run.smithi194.stdout:(2/6): ceph-prometheus-alerts-16.2.4-0.el8.noar 324 kB/s | 8.9 kB 00:00 2021-11-03T16:44:18.817 INFO:teuthology.orchestra.run.smithi194.stdout:(3/6): ceph-mgr-dashboard-16.2.4-0.el8.noarch.r 45 MB/s | 2.7 MB 00:00 2021-11-03T16:44:18.820 INFO:teuthology.orchestra.run.smithi194.stdout:(4/6): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2021-11-03T16:44:18.866 INFO:teuthology.orchestra.run.smithi194.stdout:(5/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 422 kB/s | 34 kB 00:00 2021-11-03T16:44:18.984 INFO:teuthology.orchestra.run.smithi194.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.2 MB/s | 196 kB 00:00 2021-11-03T16:44:18.987 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2021-11-03T16:44:18.987 INFO:teuthology.orchestra.run.smithi194.stdout:Total 13 MB/s | 3.0 MB 00:00 2021-11-03T16:44:18.989 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2021-11-03T16:44:18.998 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2021-11-03T16:44:18.999 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2021-11-03T16:44:19.068 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2021-11-03T16:44:19.071 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2021-11-03T16:44:19.300 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-mgr 2021-11-03T16:44:19.318 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2021-11-03T16:44:19.507 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2021-11-03T16:44:19.751 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2021-11-03T16:44:19.790 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:20 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:44:19.959 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2021-11-03T16:44:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 4/6 2021-11-03T16:44:20.570 INFO:teuthology.orchestra.run.smithi026.stdout:Package ceph-mgr-2:16.2.4-0.el8.x86_64 is already installed. 2021-11-03T16:44:20.858 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2021-11-03T16:44:20.860 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2021-11-03T16:44:20.860 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2021-11-03T16:44:21.037 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-mgr-dashboard 2021-11-03T16:44:21.144 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 5/6 2021-11-03T16:44:21.455 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 6/6 2021-11-03T16:44:21.517 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:22 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:44:21.684 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 6/6 2021-11-03T16:44:21.684 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 1/6 2021-11-03T16:44:21.684 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 2/6 2021-11-03T16:44:21.685 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 3/6 2021-11-03T16:44:21.685 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2021-11-03T16:44:21.685 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2021-11-03T16:44:21.998 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2021-11-03T16:44:21.998 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:44:21.999 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2021-11-03T16:44:21.999 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 2021-11-03T16:44:21.999 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 2021-11-03T16:44:21.999 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 2021-11-03T16:44:21.999 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jwt-1.6.1-2.el8.noarch 2021-11-03T16:44:22.000 INFO:teuthology.orchestra.run.smithi194.stdout: python3-repoze-lru-0.7-6.el8.noarch 2021-11-03T16:44:22.000 INFO:teuthology.orchestra.run.smithi194.stdout: python3-routes-2.4.1-12.el8.noarch 2021-11-03T16:44:22.000 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:44:22.000 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2021-11-03T16:44:22.063 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-mgr-diskprediction-local 2021-11-03T16:44:22.514 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:23 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:44:22.571 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2021-11-03T16:44:22.573 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:44:22.573 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2021-11-03T16:44:22.574 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:44:22.574 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2021-11-03T16:44:22.574 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-dashboard noarch 2:16.2.4-0.el8 ceph-noarch 2.7 M 2021-11-03T16:44:22.575 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2021-11-03T16:44:22.575 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-grafana-dashboards noarch 2:16.2.4-0.el8 ceph-noarch 24 k 2021-11-03T16:44:22.575 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-prometheus-alerts noarch 2:16.2.4-0.el8 ceph-noarch 8.9 k 2021-11-03T16:44:22.575 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-Base 43 k 2021-11-03T16:44:22.576 INFO:teuthology.orchestra.run.smithi026.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2021-11-03T16:44:22.576 INFO:teuthology.orchestra.run.smithi026.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2021-11-03T16:44:22.576 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:44:22.576 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2021-11-03T16:44:22.577 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:44:22.577 INFO:teuthology.orchestra.run.smithi026.stdout:Install 6 Packages 2021-11-03T16:44:22.577 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:44:22.577 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 3.0 M 2021-11-03T16:44:22.577 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 15 M 2021-11-03T16:44:22.578 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2021-11-03T16:44:22.595 INFO:teuthology.orchestra.run.smithi026.stdout:(1/6): ceph-grafana-dashboards-16.2.4-0.el8.noa 1.1 MB/s | 24 kB 00:00 2021-11-03T16:44:22.602 INFO:teuthology.orchestra.run.smithi026.stdout:(2/6): ceph-prometheus-alerts-16.2.4-0.el8.noar 324 kB/s | 8.9 kB 00:00 2021-11-03T16:44:22.626 INFO:teuthology.orchestra.run.smithi026.stdout:(3/6): ceph-mgr-dashboard-16.2.4-0.el8.noarch.r 51 MB/s | 2.7 MB 00:00 2021-11-03T16:44:22.630 INFO:teuthology.orchestra.run.smithi026.stdout:(4/6): python3-jwt-1.6.1-2.el8.noarch.rpm 1.2 MB/s | 43 kB 00:00 2021-11-03T16:44:22.698 INFO:teuthology.orchestra.run.smithi026.stdout:(5/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 352 kB/s | 34 kB 00:00 2021-11-03T16:44:22.793 INFO:teuthology.orchestra.run.smithi026.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.2 MB/s | 196 kB 00:00 2021-11-03T16:44:22.796 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2021-11-03T16:44:22.796 INFO:teuthology.orchestra.run.smithi026.stdout:Total 13 MB/s | 3.0 MB 00:00 2021-11-03T16:44:22.799 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2021-11-03T16:44:22.808 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2021-11-03T16:44:22.809 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2021-11-03T16:44:22.883 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2021-11-03T16:44:22.886 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2021-11-03T16:44:23.286 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2021-11-03T16:44:23.504 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2021-11-03T16:44:23.505 INFO:teuthology.orchestra.run.smithi194.stdout:===================================================================================================== 2021-11-03T16:44:23.505 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2021-11-03T16:44:23.505 INFO:teuthology.orchestra.run.smithi194.stdout:===================================================================================================== 2021-11-03T16:44:23.505 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2021-11-03T16:44:23.506 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.4-0.el8 ceph-noarch 8.6 M 2021-11-03T16:44:23.506 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2021-11-03T16:44:23.506 INFO:teuthology.orchestra.run.smithi194.stdout: libgfortran x86_64 8.4.1-1.el8 CentOS-Base 639 k 2021-11-03T16:44:23.506 INFO:teuthology.orchestra.run.smithi194.stdout: libquadmath x86_64 8.4.1-1.el8 CentOS-Base 169 k 2021-11-03T16:44:23.507 INFO:teuthology.orchestra.run.smithi194.stdout: openblas x86_64 0.3.12-1.el8 CentOS-AppStream 4.6 M 2021-11-03T16:44:23.507 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-threads x86_64 0.3.12-1.el8 CentOS-AppStream 4.7 M 2021-11-03T16:44:23.507 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy x86_64 1:1.14.3-9.el8 CentOS-AppStream 3.7 M 2021-11-03T16:44:23.507 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 CentOS-AppStream 225 k 2021-11-03T16:44:23.508 INFO:teuthology.orchestra.run.smithi194.stdout: python3-scipy x86_64 1.0.0-20.module_el8.4.0+790+083e3d81 CentOS-AppStream 15 M 2021-11-03T16:44:23.508 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:44:23.508 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2021-11-03T16:44:23.508 INFO:teuthology.orchestra.run.smithi194.stdout:===================================================================================================== 2021-11-03T16:44:23.509 INFO:teuthology.orchestra.run.smithi194.stdout:Install 8 Packages 2021-11-03T16:44:23.509 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:44:23.510 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 37 M 2021-11-03T16:44:23.510 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 197 M 2021-11-03T16:44:23.510 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2021-11-03T16:44:23.546 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2021-11-03T16:44:23.626 INFO:teuthology.orchestra.run.smithi194.stdout:(1/8): ceph-mgr-diskprediction-local-16.2.4-0.e 73 MB/s | 8.6 MB 00:00 2021-11-03T16:44:23.664 INFO:teuthology.orchestra.run.smithi194.stdout:(2/8): openblas-0.3.12-1.el8.x86_64.rpm 29 MB/s | 4.6 MB 00:00 2021-11-03T16:44:23.670 INFO:teuthology.orchestra.run.smithi194.stdout:(3/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 46 MB/s | 225 kB 00:00 2021-11-03T16:44:23.806 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2021-11-03T16:44:23.831 INFO:teuthology.orchestra.run.smithi194.stdout:(4/8): openblas-threads-0.3.12-1.el8.x86_64.rpm 15 MB/s | 4.7 MB 00:00 2021-11-03T16:44:23.865 INFO:teuthology.orchestra.run.smithi194.stdout:(5/8): libgfortran-8.4.1-1.el8.x86_64.rpm 19 MB/s | 639 kB 00:00 2021-11-03T16:44:23.877 INFO:teuthology.orchestra.run.smithi194.stdout:(6/8): libquadmath-8.4.1-1.el8.x86_64.rpm 14 MB/s | 169 kB 00:00 2021-11-03T16:44:24.045 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2021-11-03T16:44:24.078 INFO:teuthology.orchestra.run.smithi194.stdout:(7/8): python3-scipy-1.0.0-20.module_el8.4.0+79 36 MB/s | 15 MB 00:00 2021-11-03T16:44:24.088 INFO:teuthology.orchestra.run.smithi194.stdout:(8/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 8.1 MB/s | 3.7 MB 00:00 2021-11-03T16:44:24.093 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2021-11-03T16:44:24.093 INFO:teuthology.orchestra.run.smithi194.stdout:Total 63 MB/s | 37 MB 00:00 2021-11-03T16:44:24.108 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2021-11-03T16:44:24.127 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2021-11-03T16:44:24.127 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2021-11-03T16:44:24.200 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 4/6 2021-11-03T16:44:24.428 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2021-11-03T16:44:24.431 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2021-11-03T16:44:24.965 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2021-11-03T16:44:25.139 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 1/8 2021-11-03T16:44:25.258 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 1/8 2021-11-03T16:44:25.355 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 5/6 2021-11-03T16:44:25.439 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 2/8 2021-11-03T16:44:25.656 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 6/6 2021-11-03T16:44:25.895 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 6/6 2021-11-03T16:44:25.896 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 1/6 2021-11-03T16:44:25.896 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 2/6 2021-11-03T16:44:25.896 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 3/6 2021-11-03T16:44:25.897 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2021-11-03T16:44:25.897 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2021-11-03T16:44:25.953 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 2/8 2021-11-03T16:44:26.139 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openblas-0.3.12-1.el8.x86_64 3/8 2021-11-03T16:44:26.201 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2021-11-03T16:44:26.202 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:44:26.202 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2021-11-03T16:44:26.203 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 2021-11-03T16:44:26.203 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 2021-11-03T16:44:26.204 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 2021-11-03T16:44:26.204 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jwt-1.6.1-2.el8.noarch 2021-11-03T16:44:26.205 INFO:teuthology.orchestra.run.smithi026.stdout: python3-repoze-lru-0.7-6.el8.noarch 2021-11-03T16:44:26.205 INFO:teuthology.orchestra.run.smithi026.stdout: python3-routes-2.4.1-12.el8.noarch 2021-11-03T16:44:26.205 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:44:26.206 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2021-11-03T16:44:26.263 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-mgr-diskprediction-local 2021-11-03T16:44:26.665 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 3/8 2021-11-03T16:44:26.745 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:27 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:44:26.857 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 4/8 2021-11-03T16:44:27.553 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 4/8 2021-11-03T16:44:27.816 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2021-11-03T16:44:27.817 INFO:teuthology.orchestra.run.smithi026.stdout:===================================================================================================== 2021-11-03T16:44:27.817 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2021-11-03T16:44:27.817 INFO:teuthology.orchestra.run.smithi026.stdout:===================================================================================================== 2021-11-03T16:44:27.818 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2021-11-03T16:44:27.818 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.4-0.el8 ceph-noarch 8.6 M 2021-11-03T16:44:27.818 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2021-11-03T16:44:27.818 INFO:teuthology.orchestra.run.smithi026.stdout: libgfortran x86_64 8.4.1-1.el8 CentOS-Base 639 k 2021-11-03T16:44:27.819 INFO:teuthology.orchestra.run.smithi026.stdout: libquadmath x86_64 8.4.1-1.el8 CentOS-Base 169 k 2021-11-03T16:44:27.819 INFO:teuthology.orchestra.run.smithi026.stdout: openblas x86_64 0.3.12-1.el8 CentOS-AppStream 4.6 M 2021-11-03T16:44:27.819 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-threads x86_64 0.3.12-1.el8 CentOS-AppStream 4.7 M 2021-11-03T16:44:27.819 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy x86_64 1:1.14.3-9.el8 CentOS-AppStream 3.7 M 2021-11-03T16:44:27.820 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 CentOS-AppStream 225 k 2021-11-03T16:44:27.820 INFO:teuthology.orchestra.run.smithi026.stdout: python3-scipy x86_64 1.0.0-20.module_el8.4.0+790+083e3d81 CentOS-AppStream 15 M 2021-11-03T16:44:27.820 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:44:27.820 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2021-11-03T16:44:27.821 INFO:teuthology.orchestra.run.smithi026.stdout:===================================================================================================== 2021-11-03T16:44:27.821 INFO:teuthology.orchestra.run.smithi026.stdout:Install 8 Packages 2021-11-03T16:44:27.821 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:44:27.822 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 37 M 2021-11-03T16:44:27.822 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 197 M 2021-11-03T16:44:27.822 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2021-11-03T16:44:27.897 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2021-11-03T16:44:27.969 INFO:teuthology.orchestra.run.smithi026.stdout:(1/8): openblas-threads-0.3.12-1.el8.x86_64.rpm 32 MB/s | 4.7 MB 00:00 2021-11-03T16:44:27.994 INFO:teuthology.orchestra.run.smithi026.stdout:(2/8): ceph-mgr-diskprediction-local-16.2.4-0.e 49 MB/s | 8.6 MB 00:00 2021-11-03T16:44:28.051 INFO:teuthology.orchestra.run.smithi026.stdout:(3/8): openblas-0.3.12-1.el8.x86_64.rpm 20 MB/s | 4.6 MB 00:00 2021-11-03T16:44:28.076 INFO:teuthology.orchestra.run.smithi026.stdout:(4/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 2.7 MB/s | 225 kB 00:00 2021-11-03T16:44:28.101 INFO:teuthology.orchestra.run.smithi026.stdout:(5/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 28 MB/s | 3.7 MB 00:00 2021-11-03T16:44:28.112 INFO:teuthology.orchestra.run.smithi026.stdout:(6/8): libquadmath-8.4.1-1.el8.x86_64.rpm 27 MB/s | 169 kB 00:00 2021-11-03T16:44:28.118 INFO:teuthology.orchestra.run.smithi026.stdout:(7/8): libgfortran-8.4.1-1.el8.x86_64.rpm 15 MB/s | 639 kB 00:00 2021-11-03T16:44:28.156 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-11-03T16:44:28.393 INFO:teuthology.orchestra.run.smithi026.stdout:(8/8): python3-scipy-1.0.0-20.module_el8.4.0+79 42 MB/s | 15 MB 00:00 2021-11-03T16:44:28.397 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2021-11-03T16:44:28.398 INFO:teuthology.orchestra.run.smithi026.stdout:Total 64 MB/s | 37 MB 00:00 2021-11-03T16:44:28.413 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2021-11-03T16:44:28.434 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2021-11-03T16:44:28.434 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2021-11-03T16:44:28.756 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2021-11-03T16:44:28.759 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2021-11-03T16:44:29.461 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2021-11-03T16:44:29.641 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 1/8 2021-11-03T16:44:29.765 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 1/8 2021-11-03T16:44:30.136 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-11-03T16:44:30.299 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 2/8 2021-11-03T16:44:30.842 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 2/8 2021-11-03T16:44:31.066 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : openblas-0.3.12-1.el8.x86_64 3/8 2021-11-03T16:44:31.436 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-scipy-1.0.0-20.module_el8.4.0+790+083e3d81.x 7/8 2021-11-03T16:44:31.629 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 3/8 2021-11-03T16:44:31.802 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 4/8 2021-11-03T16:44:32.586 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 4/8 2021-11-03T16:44:32.783 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 8/8 2021-11-03T16:44:32.999 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2021-11-03T16:44:33.057 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 8/8 2021-11-03T16:44:33.058 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 1/8 2021-11-03T16:44:33.058 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 2/8 2021-11-03T16:44:33.058 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 3/8 2021-11-03T16:44:33.058 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 4/8 2021-11-03T16:44:33.058 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 5/8 2021-11-03T16:44:33.059 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.4.0+790+083e3d81.x 6/8 2021-11-03T16:44:33.059 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 7/8 2021-11-03T16:44:33.257 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-11-03T16:44:33.370 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 8/8 2021-11-03T16:44:33.370 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:44:33.370 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2021-11-03T16:44:33.371 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 2021-11-03T16:44:33.371 INFO:teuthology.orchestra.run.smithi194.stdout: libgfortran-8.4.1-1.el8.x86_64 2021-11-03T16:44:33.371 INFO:teuthology.orchestra.run.smithi194.stdout: libquadmath-8.4.1-1.el8.x86_64 2021-11-03T16:44:33.371 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-0.3.12-1.el8.x86_64 2021-11-03T16:44:33.372 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-threads-0.3.12-1.el8.x86_64 2021-11-03T16:44:33.372 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2021-11-03T16:44:33.372 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2021-11-03T16:44:33.372 INFO:teuthology.orchestra.run.smithi194.stdout: python3-scipy-1.0.0-20.module_el8.4.0+790+083e3d81.x86_64 2021-11-03T16:44:33.372 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:44:33.373 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2021-11-03T16:44:33.461 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-mgr-rook 2021-11-03T16:44:33.915 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:34 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:44:34.920 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2021-11-03T16:44:34.922 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:44:34.922 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2021-11-03T16:44:34.922 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:44:34.923 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2021-11-03T16:44:34.923 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-rook noarch 2:16.2.4-0.el8 ceph-noarch 27 k 2021-11-03T16:44:34.923 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2021-11-03T16:44:34.923 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2021-11-03T16:44:34.923 INFO:teuthology.orchestra.run.smithi194.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2021-11-03T16:44:34.924 INFO:teuthology.orchestra.run.smithi194.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2021-11-03T16:44:34.924 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2021-11-03T16:44:34.924 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2021-11-03T16:44:34.924 INFO:teuthology.orchestra.run.smithi194.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2021-11-03T16:44:34.925 INFO:teuthology.orchestra.run.smithi194.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-Base 155 k 2021-11-03T16:44:34.925 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2021-11-03T16:44:34.926 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2021-11-03T16:44:34.926 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-Base 43 k 2021-11-03T16:44:34.927 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rsa noarch 4.7.2-1.el8 epel 61 k 2021-11-03T16:44:34.927 INFO:teuthology.orchestra.run.smithi194.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2021-11-03T16:44:34.928 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:44:34.928 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2021-11-03T16:44:34.928 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:44:34.929 INFO:teuthology.orchestra.run.smithi194.stdout:Install 13 Packages 2021-11-03T16:44:34.929 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:44:34.931 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 1.9 M 2021-11-03T16:44:34.931 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 24 M 2021-11-03T16:44:34.932 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2021-11-03T16:44:34.946 INFO:teuthology.orchestra.run.smithi194.stdout:(1/13): ceph-mgr-rook-16.2.4-0.el8.noarch.rpm 1.3 MB/s | 27 kB 00:00 2021-11-03T16:44:34.957 INFO:teuthology.orchestra.run.smithi194.stdout:(2/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 813 kB/s | 27 kB 00:00 2021-11-03T16:44:34.960 INFO:teuthology.orchestra.run.smithi194.stdout:(3/13): python3-jsonpointer-1.10-11.el8.noarch. 572 kB/s | 20 kB 00:00 2021-11-03T16:44:34.961 INFO:teuthology.orchestra.run.smithi194.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 29 MB/s | 110 kB 00:00 2021-11-03T16:44:34.964 INFO:teuthology.orchestra.run.smithi194.stdout:(5/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 40 MB/s | 155 kB 00:00 2021-11-03T16:44:34.964 INFO:teuthology.orchestra.run.smithi194.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 17 MB/s | 43 kB 00:00 2021-11-03T16:44:34.976 INFO:teuthology.orchestra.run.smithi194.stdout:(7/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 4.1 MB/s | 126 kB 00:00 2021-11-03T16:44:35.036 INFO:teuthology.orchestra.run.smithi194.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 456 kB/s | 33 kB 00:00 2021-11-03T16:44:35.038 INFO:teuthology.orchestra.run.smithi194.stdout:(9/13): python3-certifi-2018.10.15-7.el8.noarch 220 kB/s | 16 kB 00:00 2021-11-03T16:44:35.070 INFO:teuthology.orchestra.run.smithi194.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 861 kB/s | 81 kB 00:00 2021-11-03T16:44:35.087 INFO:teuthology.orchestra.run.smithi194.stdout:(11/13): python3-rsa-4.7.2-1.el8.noarch.rpm 1.2 MB/s | 61 kB 00:00 2021-11-03T16:44:35.094 INFO:teuthology.orchestra.run.smithi194.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 2.5 MB/s | 61 kB 00:00 2021-11-03T16:44:35.205 INFO:teuthology.orchestra.run.smithi194.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 6.9 MB/s | 1.2 MB 00:00 2021-11-03T16:44:35.208 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2021-11-03T16:44:35.209 INFO:teuthology.orchestra.run.smithi194.stdout:Total 6.7 MB/s | 1.9 MB 00:00 2021-11-03T16:44:35.218 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2021-11-03T16:44:35.232 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2021-11-03T16:44:35.233 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2021-11-03T16:44:35.307 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2021-11-03T16:44:35.309 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2021-11-03T16:44:35.363 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-11-03T16:44:35.783 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2021-11-03T16:44:36.086 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2021-11-03T16:44:36.295 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2021-11-03T16:44:36.509 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rsa-4.7.2-1.el8.noarch 3/13 2021-11-03T16:44:36.720 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2021-11-03T16:44:36.895 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2021-11-03T16:44:37.110 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2021-11-03T16:44:37.383 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2021-11-03T16:44:37.620 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2021-11-03T16:44:37.942 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-scipy-1.0.0-20.module_el8.4.0+790+083e3d81.x 7/8 2021-11-03T16:44:38.115 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 8/8 2021-11-03T16:44:38.427 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 8/8 2021-11-03T16:44:38.427 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 1/8 2021-11-03T16:44:38.427 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 2/8 2021-11-03T16:44:38.428 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 3/8 2021-11-03T16:44:38.428 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 4/8 2021-11-03T16:44:38.428 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 5/8 2021-11-03T16:44:38.428 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.4.0+790+083e3d81.x 6/8 2021-11-03T16:44:38.428 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 7/8 2021-11-03T16:44:38.731 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2021-11-03T16:44:38.754 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 8/8 2021-11-03T16:44:38.755 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:44:38.755 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2021-11-03T16:44:38.755 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 2021-11-03T16:44:38.756 INFO:teuthology.orchestra.run.smithi026.stdout: libgfortran-8.4.1-1.el8.x86_64 2021-11-03T16:44:38.756 INFO:teuthology.orchestra.run.smithi026.stdout: libquadmath-8.4.1-1.el8.x86_64 2021-11-03T16:44:38.756 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-0.3.12-1.el8.x86_64 2021-11-03T16:44:38.756 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-threads-0.3.12-1.el8.x86_64 2021-11-03T16:44:38.756 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2021-11-03T16:44:38.757 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2021-11-03T16:44:38.757 INFO:teuthology.orchestra.run.smithi026.stdout: python3-scipy-1.0.0-20.module_el8.4.0+790+083e3d81.x86_64 2021-11-03T16:44:38.757 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:44:38.757 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2021-11-03T16:44:38.835 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-mgr-rook 2021-11-03T16:44:38.936 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2021-11-03T16:44:39.144 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2021-11-03T16:44:39.312 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:40 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:44:39.319 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2021-11-03T16:44:39.479 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-rook-2:16.2.4-0.el8.noarch 13/13 2021-11-03T16:44:39.714 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.4-0.el8.noarch 13/13 2021-11-03T16:44:39.714 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-rook-2:16.2.4-0.el8.noarch 1/13 2021-11-03T16:44:39.715 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2021-11-03T16:44:39.715 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2021-11-03T16:44:39.715 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2021-11-03T16:44:39.715 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2021-11-03T16:44:39.716 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2021-11-03T16:44:39.716 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2021-11-03T16:44:39.716 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2021-11-03T16:44:39.716 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2021-11-03T16:44:39.716 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2021-11-03T16:44:39.717 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2021-11-03T16:44:39.717 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rsa-4.7.2-1.el8.noarch 12/13 2021-11-03T16:44:40.079 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2021-11-03T16:44:40.079 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:44:40.080 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2021-11-03T16:44:40.080 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-rook-2:16.2.4-0.el8.noarch 2021-11-03T16:44:40.080 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cachetools-3.1.1-4.el8.noarch 2021-11-03T16:44:40.080 INFO:teuthology.orchestra.run.smithi194.stdout: python3-certifi-2018.10.15-7.el8.noarch 2021-11-03T16:44:40.081 INFO:teuthology.orchestra.run.smithi194.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2021-11-03T16:44:40.081 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpatch-1.21-2.el8.noarch 2021-11-03T16:44:40.081 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpointer-1.10-11.el8.noarch 2021-11-03T16:44:40.081 INFO:teuthology.orchestra.run.smithi194.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2021-11-03T16:44:40.082 INFO:teuthology.orchestra.run.smithi194.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2021-11-03T16:44:40.082 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2021-11-03T16:44:40.082 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2021-11-03T16:44:40.082 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2021-11-03T16:44:40.082 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rsa-4.7.2-1.el8.noarch 2021-11-03T16:44:40.083 INFO:teuthology.orchestra.run.smithi194.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2021-11-03T16:44:40.083 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:44:40.083 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2021-11-03T16:44:40.144 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-mgr-cephadm 2021-11-03T16:44:40.374 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2021-11-03T16:44:40.375 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:44:40.376 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2021-11-03T16:44:40.376 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:44:40.376 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2021-11-03T16:44:40.376 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-rook noarch 2:16.2.4-0.el8 ceph-noarch 27 k 2021-11-03T16:44:40.377 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2021-11-03T16:44:40.377 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2021-11-03T16:44:40.377 INFO:teuthology.orchestra.run.smithi026.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2021-11-03T16:44:40.377 INFO:teuthology.orchestra.run.smithi026.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2021-11-03T16:44:40.378 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2021-11-03T16:44:40.378 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2021-11-03T16:44:40.378 INFO:teuthology.orchestra.run.smithi026.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2021-11-03T16:44:40.378 INFO:teuthology.orchestra.run.smithi026.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-Base 155 k 2021-11-03T16:44:40.378 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2021-11-03T16:44:40.379 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2021-11-03T16:44:40.379 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-Base 43 k 2021-11-03T16:44:40.379 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rsa noarch 4.7.2-1.el8 epel 61 k 2021-11-03T16:44:40.379 INFO:teuthology.orchestra.run.smithi026.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2021-11-03T16:44:40.380 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:44:40.380 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2021-11-03T16:44:40.380 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:44:40.380 INFO:teuthology.orchestra.run.smithi026.stdout:Install 13 Packages 2021-11-03T16:44:40.380 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:44:40.381 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 1.9 M 2021-11-03T16:44:40.381 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 24 M 2021-11-03T16:44:40.382 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2021-11-03T16:44:40.398 INFO:teuthology.orchestra.run.smithi026.stdout:(1/13): ceph-mgr-rook-16.2.4-0.el8.noarch.rpm 1.3 MB/s | 27 kB 00:00 2021-11-03T16:44:40.426 INFO:teuthology.orchestra.run.smithi026.stdout:(2/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 560 kB/s | 27 kB 00:00 2021-11-03T16:44:40.431 INFO:teuthology.orchestra.run.smithi026.stdout:(3/13): python3-pyasn1-modules-0.3.7-6.el8.noar 22 MB/s | 110 kB 00:00 2021-11-03T16:44:40.432 INFO:teuthology.orchestra.run.smithi026.stdout:(4/13): python3-jsonpointer-1.10-11.el8.noarch. 377 kB/s | 20 kB 00:00 2021-11-03T16:44:40.432 INFO:teuthology.orchestra.run.smithi026.stdout:(5/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 3.6 MB/s | 126 kB 00:00 2021-11-03T16:44:40.435 INFO:teuthology.orchestra.run.smithi026.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 20 MB/s | 43 kB 00:00 2021-11-03T16:44:40.435 INFO:teuthology.orchestra.run.smithi026.stdout:(7/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 39 MB/s | 155 kB 00:00 2021-11-03T16:44:40.597 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:41 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:44:40.884 INFO:teuthology.orchestra.run.smithi026.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 73 kB/s | 33 kB 00:00 2021-11-03T16:44:41.058 INFO:teuthology.orchestra.run.smithi026.stdout:(9/13): python3-kubernetes-11.0.0-6.el8.noarch. 6.7 MB/s | 1.2 MB 00:00 2021-11-03T16:44:41.083 INFO:teuthology.orchestra.run.smithi026.stdout:(10/13): python3-rsa-4.7.2-1.el8.noarch.rpm 2.4 MB/s | 61 kB 00:00 2021-11-03T16:44:41.109 INFO:teuthology.orchestra.run.smithi026.stdout:(11/13): python3-websocket-client-0.56.0-5.el8. 2.4 MB/s | 61 kB 00:00 2021-11-03T16:44:41.157 INFO:teuthology.orchestra.run.smithi026.stdout:(12/13): python3-certifi-2018.10.15-7.el8.noarc 23 kB/s | 16 kB 00:00 2021-11-03T16:44:41.201 INFO:teuthology.orchestra.run.smithi026.stdout:(13/13): python3-google-auth-1.1.1-10.el8.noarc 106 kB/s | 81 kB 00:00 2021-11-03T16:44:41.204 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2021-11-03T16:44:41.205 INFO:teuthology.orchestra.run.smithi026.stdout:Total 2.3 MB/s | 1.9 MB 00:00 2021-11-03T16:44:41.217 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2021-11-03T16:44:41.234 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2021-11-03T16:44:41.234 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2021-11-03T16:44:41.319 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2021-11-03T16:44:41.323 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2021-11-03T16:44:41.599 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2021-11-03T16:44:41.600 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:44:41.601 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2021-11-03T16:44:41.601 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:44:41.601 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2021-11-03T16:44:41.601 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-cephadm noarch 2:16.2.4-0.el8 ceph-noarch 89 k 2021-11-03T16:44:41.601 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2021-11-03T16:44:41.602 INFO:teuthology.orchestra.run.smithi194.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2021-11-03T16:44:41.602 INFO:teuthology.orchestra.run.smithi194.stdout: python3-babel noarch 2.5.1-5.el8 CentOS-AppStream 4.8 M 2021-11-03T16:44:41.602 INFO:teuthology.orchestra.run.smithi194.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2021-11-03T16:44:41.602 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 CentOS-AppStream 538 k 2021-11-03T16:44:41.603 INFO:teuthology.orchestra.run.smithi194.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2021-11-03T16:44:41.603 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:44:41.603 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2021-11-03T16:44:41.603 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:44:41.604 INFO:teuthology.orchestra.run.smithi194.stdout:Install 6 Packages 2021-11-03T16:44:41.604 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:44:41.605 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 5.8 M 2021-11-03T16:44:41.605 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 24 M 2021-11-03T16:44:41.605 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2021-11-03T16:44:41.622 INFO:teuthology.orchestra.run.smithi194.stdout:(1/6): ceph-mgr-cephadm-16.2.4-0.el8.noarch.rpm 4.4 MB/s | 89 kB 00:00 2021-11-03T16:44:41.679 INFO:teuthology.orchestra.run.smithi194.stdout:(2/6): python3-jinja2-2.10.1-2.el8_0.noarch.rpm 6.9 MB/s | 538 kB 00:00 2021-11-03T16:44:41.717 INFO:teuthology.orchestra.run.smithi194.stdout:(3/6): python3-babel-2.5.1-5.el8.noarch.rpm 42 MB/s | 4.8 MB 00:00 2021-11-03T16:44:41.730 INFO:teuthology.orchestra.run.smithi194.stdout:(4/6): python3-apipkg-1.5-6.el8.noarch.rpm 197 kB/s | 21 kB 00:00 2021-11-03T16:44:41.852 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2021-11-03T16:44:41.862 INFO:teuthology.orchestra.run.smithi194.stdout:(5/6): python3-remoto-1.2.1-1.el8.noarch.rpm 336 kB/s | 49 kB 00:00 2021-11-03T16:44:41.903 INFO:teuthology.orchestra.run.smithi194.stdout:(6/6): python3-execnet-1.7.1-1.el8.noarch.rpm 1.5 MB/s | 355 kB 00:00 2021-11-03T16:44:41.905 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2021-11-03T16:44:41.906 INFO:teuthology.orchestra.run.smithi194.stdout:Total 19 MB/s | 5.8 MB 00:00 2021-11-03T16:44:41.910 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2021-11-03T16:44:41.919 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2021-11-03T16:44:41.919 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2021-11-03T16:44:42.000 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2021-11-03T16:44:42.003 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2021-11-03T16:44:42.336 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2021-11-03T16:44:42.377 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2021-11-03T16:44:42.599 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2021-11-03T16:44:42.633 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2021-11-03T16:44:42.850 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2021-11-03T16:44:42.898 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rsa-4.7.2-1.el8.noarch 3/13 2021-11-03T16:44:43.133 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2021-11-03T16:44:43.318 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2021-11-03T16:44:43.587 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2021-11-03T16:44:43.784 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 3/6 2021-11-03T16:44:43.889 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2021-11-03T16:44:44.097 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 4/6 2021-11-03T16:44:44.108 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2021-11-03T16:44:44.308 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 5/6 2021-11-03T16:44:44.511 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 6/6 2021-11-03T16:44:44.734 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 6/6 2021-11-03T16:44:44.734 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 1/6 2021-11-03T16:44:44.735 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 2/6 2021-11-03T16:44:44.735 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 3/6 2021-11-03T16:44:44.735 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2021-11-03T16:44:44.735 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2021-11-03T16:44:45.034 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 6/6 2021-11-03T16:44:45.035 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:44:45.035 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2021-11-03T16:44:45.035 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-cephadm-2:16.2.4-0.el8.noarch python3-apipkg-1.5-6.el8.noarch 2021-11-03T16:44:45.035 INFO:teuthology.orchestra.run.smithi194.stdout: python3-babel-2.5.1-5.el8.noarch python3-execnet-1.7.1-1.el8.noarch 2021-11-03T16:44:45.036 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jinja2-2.10.1-2.el8_0.noarch python3-remoto-1.2.1-1.el8.noarch 2021-11-03T16:44:45.036 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:44:45.036 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2021-11-03T16:44:45.104 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-fuse 2021-11-03T16:44:45.297 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2021-11-03T16:44:45.559 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:46 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:44:45.563 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2021-11-03T16:44:45.752 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2021-11-03T16:44:45.940 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2021-11-03T16:44:46.122 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-rook-2:16.2.4-0.el8.noarch 13/13 2021-11-03T16:44:46.375 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.4-0.el8.noarch 13/13 2021-11-03T16:44:46.375 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-rook-2:16.2.4-0.el8.noarch 1/13 2021-11-03T16:44:46.376 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2021-11-03T16:44:46.376 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2021-11-03T16:44:46.376 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2021-11-03T16:44:46.376 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2021-11-03T16:44:46.377 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2021-11-03T16:44:46.377 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2021-11-03T16:44:46.377 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2021-11-03T16:44:46.377 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2021-11-03T16:44:46.377 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2021-11-03T16:44:46.378 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2021-11-03T16:44:46.378 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rsa-4.7.2-1.el8.noarch 12/13 2021-11-03T16:44:46.569 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2021-11-03T16:44:46.570 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:44:46.571 INFO:teuthology.orchestra.run.smithi194.stdout: Package Architecture Version Repository Size 2021-11-03T16:44:46.571 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:44:46.571 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2021-11-03T16:44:46.571 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-fuse x86_64 2:16.2.4-0.el8 ceph 885 k 2021-11-03T16:44:46.572 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2021-11-03T16:44:46.572 INFO:teuthology.orchestra.run.smithi194.stdout: fuse x86_64 2.9.7-12.el8 CentOS-Base 82 k 2021-11-03T16:44:46.572 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:44:46.572 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2021-11-03T16:44:46.573 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:44:46.573 INFO:teuthology.orchestra.run.smithi194.stdout:Install 2 Packages 2021-11-03T16:44:46.573 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:44:46.573 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 967 k 2021-11-03T16:44:46.574 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 3.2 M 2021-11-03T16:44:46.574 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2021-11-03T16:44:46.596 INFO:teuthology.orchestra.run.smithi194.stdout:(1/2): ceph-fuse-16.2.4-0.el8.x86_64.rpm 35 MB/s | 885 kB 00:00 2021-11-03T16:44:46.609 INFO:teuthology.orchestra.run.smithi194.stdout:(2/2): fuse-2.9.7-12.el8.x86_64.rpm 2.1 MB/s | 82 kB 00:00 2021-11-03T16:44:46.610 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2021-11-03T16:44:46.611 INFO:teuthology.orchestra.run.smithi194.stdout:Total 23 MB/s | 967 kB 00:00 2021-11-03T16:44:46.613 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2021-11-03T16:44:46.634 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2021-11-03T16:44:46.635 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2021-11-03T16:44:46.713 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2021-11-03T16:44:46.716 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2021-11-03T16:44:46.723 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2021-11-03T16:44:46.724 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:44:46.724 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2021-11-03T16:44:46.724 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-rook-2:16.2.4-0.el8.noarch 2021-11-03T16:44:46.724 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cachetools-3.1.1-4.el8.noarch 2021-11-03T16:44:46.725 INFO:teuthology.orchestra.run.smithi026.stdout: python3-certifi-2018.10.15-7.el8.noarch 2021-11-03T16:44:46.725 INFO:teuthology.orchestra.run.smithi026.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2021-11-03T16:44:46.725 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpatch-1.21-2.el8.noarch 2021-11-03T16:44:46.725 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpointer-1.10-11.el8.noarch 2021-11-03T16:44:46.726 INFO:teuthology.orchestra.run.smithi026.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2021-11-03T16:44:46.726 INFO:teuthology.orchestra.run.smithi026.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2021-11-03T16:44:46.726 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2021-11-03T16:44:46.726 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2021-11-03T16:44:46.727 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2021-11-03T16:44:46.727 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rsa-4.7.2-1.el8.noarch 2021-11-03T16:44:46.727 INFO:teuthology.orchestra.run.smithi026.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2021-11-03T16:44:46.727 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:44:46.728 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2021-11-03T16:44:46.881 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2021-11-03T16:44:46.929 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-mgr-cephadm 2021-11-03T16:44:47.169 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : fuse-2.9.7-12.el8.x86_64 1/2 2021-11-03T16:44:47.351 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-fuse-2:16.2.4-0.el8.x86_64 2/2 2021-11-03T16:44:47.411 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:48 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:44:47.700 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-fuse-2:16.2.4-0.el8.x86_64 2/2 2021-11-03T16:44:47.700 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-fuse-2:16.2.4-0.el8.x86_64 1/2 2021-11-03T16:44:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/2 2021-11-03T16:44:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:44:47.968 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2021-11-03T16:44:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-fuse-2:16.2.4-0.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2021-11-03T16:44:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:44:47.969 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2021-11-03T16:44:48.125 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install librados-devel 2021-11-03T16:44:48.496 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2021-11-03T16:44:48.497 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:44:48.497 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2021-11-03T16:44:48.497 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:44:48.498 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2021-11-03T16:44:48.498 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-cephadm noarch 2:16.2.4-0.el8 ceph-noarch 89 k 2021-11-03T16:44:48.498 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2021-11-03T16:44:48.498 INFO:teuthology.orchestra.run.smithi026.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2021-11-03T16:44:48.499 INFO:teuthology.orchestra.run.smithi026.stdout: python3-babel noarch 2.5.1-5.el8 CentOS-AppStream 4.8 M 2021-11-03T16:44:48.499 INFO:teuthology.orchestra.run.smithi026.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2021-11-03T16:44:48.499 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 CentOS-AppStream 538 k 2021-11-03T16:44:48.499 INFO:teuthology.orchestra.run.smithi026.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2021-11-03T16:44:48.500 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:44:48.500 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2021-11-03T16:44:48.500 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:44:48.500 INFO:teuthology.orchestra.run.smithi026.stdout:Install 6 Packages 2021-11-03T16:44:48.500 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:44:48.501 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 5.8 M 2021-11-03T16:44:48.501 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 24 M 2021-11-03T16:44:48.502 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2021-11-03T16:44:48.520 INFO:teuthology.orchestra.run.smithi026.stdout:(1/6): ceph-mgr-cephadm-16.2.4-0.el8.noarch.rpm 4.2 MB/s | 89 kB 00:00 2021-11-03T16:44:48.550 INFO:teuthology.orchestra.run.smithi026.stdout:(2/6): python3-jinja2-2.10.1-2.el8_0.noarch.rpm 10 MB/s | 538 kB 00:00 2021-11-03T16:44:48.590 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:49 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:44:48.594 INFO:teuthology.orchestra.run.smithi026.stdout:(3/6): python3-apipkg-1.5-6.el8.noarch.rpm 285 kB/s | 21 kB 00:00 2021-11-03T16:44:48.618 INFO:teuthology.orchestra.run.smithi026.stdout:(4/6): python3-babel-2.5.1-5.el8.noarch.rpm 40 MB/s | 4.8 MB 00:00 2021-11-03T16:44:48.643 INFO:teuthology.orchestra.run.smithi026.stdout:(5/6): python3-remoto-1.2.1-1.el8.noarch.rpm 1.0 MB/s | 49 kB 00:00 2021-11-03T16:44:48.697 INFO:teuthology.orchestra.run.smithi026.stdout:(6/6): python3-execnet-1.7.1-1.el8.noarch.rpm 2.4 MB/s | 355 kB 00:00 2021-11-03T16:44:48.699 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2021-11-03T16:44:48.700 INFO:teuthology.orchestra.run.smithi026.stdout:Total 29 MB/s | 5.8 MB 00:00 2021-11-03T16:44:48.705 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2021-11-03T16:44:48.715 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2021-11-03T16:44:48.715 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2021-11-03T16:44:48.802 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2021-11-03T16:44:48.805 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2021-11-03T16:44:49.149 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2021-11-03T16:44:49.450 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2021-11-03T16:44:49.580 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2021-11-03T16:44:49.581 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:44:49.581 INFO:teuthology.orchestra.run.smithi194.stdout: Package Architecture Version Repository Size 2021-11-03T16:44:49.582 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:44:49.582 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2021-11-03T16:44:49.582 INFO:teuthology.orchestra.run.smithi194.stdout: librados-devel x86_64 2:16.2.4-0.el8 ceph 131 k 2021-11-03T16:44:49.582 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:44:49.583 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2021-11-03T16:44:49.583 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:44:49.583 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2021-11-03T16:44:49.583 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:44:49.584 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 131 k 2021-11-03T16:44:49.584 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 439 k 2021-11-03T16:44:49.584 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2021-11-03T16:44:49.595 INFO:teuthology.orchestra.run.smithi194.stdout:librados-devel-16.2.4-0.el8.x86_64.rpm 9.5 MB/s | 131 kB 00:00 2021-11-03T16:44:49.596 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2021-11-03T16:44:49.597 INFO:teuthology.orchestra.run.smithi194.stdout:Total 8.6 MB/s | 131 kB 00:00 2021-11-03T16:44:49.597 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2021-11-03T16:44:49.605 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2021-11-03T16:44:49.605 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2021-11-03T16:44:49.654 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2021-11-03T16:44:49.657 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2021-11-03T16:44:49.729 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2021-11-03T16:44:49.768 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2021-11-03T16:44:49.967 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librados-devel-2:16.2.4-0.el8.x86_64 1/1 2021-11-03T16:44:50.213 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librados-devel-2:16.2.4-0.el8.x86_64 1/1 2021-11-03T16:44:50.523 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados-devel-2:16.2.4-0.el8.x86_64 1/1 2021-11-03T16:44:50.523 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:44:50.524 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2021-11-03T16:44:50.524 INFO:teuthology.orchestra.run.smithi194.stdout: librados-devel-2:16.2.4-0.el8.x86_64 2021-11-03T16:44:50.524 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:44:50.524 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2021-11-03T16:44:50.675 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install libcephfs2 2021-11-03T16:44:50.757 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 3/6 2021-11-03T16:44:51.107 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 4/6 2021-11-03T16:44:51.169 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:52 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:44:51.379 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 5/6 2021-11-03T16:44:51.596 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 6/6 2021-11-03T16:44:51.853 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 6/6 2021-11-03T16:44:51.853 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 1/6 2021-11-03T16:44:51.853 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 2/6 2021-11-03T16:44:51.854 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 3/6 2021-11-03T16:44:51.854 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2021-11-03T16:44:51.854 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2021-11-03T16:44:51.865 INFO:teuthology.orchestra.run.smithi194.stdout:Package libcephfs2-2:16.2.4-0.el8.x86_64 is already installed. 2021-11-03T16:44:52.142 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2021-11-03T16:44:52.143 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2021-11-03T16:44:52.143 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2021-11-03T16:44:52.155 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 6/6 2021-11-03T16:44:52.155 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:44:52.155 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2021-11-03T16:44:52.156 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-cephadm-2:16.2.4-0.el8.noarch python3-apipkg-1.5-6.el8.noarch 2021-11-03T16:44:52.156 INFO:teuthology.orchestra.run.smithi026.stdout: python3-babel-2.5.1-5.el8.noarch python3-execnet-1.7.1-1.el8.noarch 2021-11-03T16:44:52.156 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jinja2-2.10.1-2.el8_0.noarch python3-remoto-1.2.1-1.el8.noarch 2021-11-03T16:44:52.156 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:44:52.157 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2021-11-03T16:44:52.196 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install libcephfs-devel 2021-11-03T16:44:52.209 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-fuse 2021-11-03T16:44:52.653 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:53 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:44:52.695 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:53 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:44:53.641 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2021-11-03T16:44:53.642 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:44:53.642 INFO:teuthology.orchestra.run.smithi194.stdout: Package Architecture Version Repository Size 2021-11-03T16:44:53.642 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:44:53.643 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2021-11-03T16:44:53.643 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs-devel x86_64 2:16.2.4-0.el8 ceph 24 k 2021-11-03T16:44:53.643 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:44:53.643 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2021-11-03T16:44:53.644 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:44:53.644 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2021-11-03T16:44:53.644 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:44:53.644 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 24 k 2021-11-03T16:44:53.645 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 94 k 2021-11-03T16:44:53.645 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2021-11-03T16:44:53.654 INFO:teuthology.orchestra.run.smithi194.stdout:libcephfs-devel-16.2.4-0.el8.x86_64.rpm 2.1 MB/s | 24 kB 00:00 2021-11-03T16:44:53.654 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2021-11-03T16:44:53.655 INFO:teuthology.orchestra.run.smithi194.stdout:Total 1.9 MB/s | 24 kB 00:00 2021-11-03T16:44:53.655 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2021-11-03T16:44:53.659 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2021-11-03T16:44:53.660 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2021-11-03T16:44:53.661 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2021-11-03T16:44:53.665 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2021-11-03T16:44:53.725 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2021-11-03T16:44:53.735 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2021-11-03T16:44:53.735 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:44:53.736 INFO:teuthology.orchestra.run.smithi026.stdout: Package Architecture Version Repository Size 2021-11-03T16:44:53.736 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:44:53.736 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2021-11-03T16:44:53.736 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-fuse x86_64 2:16.2.4-0.el8 ceph 885 k 2021-11-03T16:44:53.737 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2021-11-03T16:44:53.737 INFO:teuthology.orchestra.run.smithi026.stdout: fuse x86_64 2.9.7-12.el8 CentOS-Base 82 k 2021-11-03T16:44:53.737 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:44:53.738 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2021-11-03T16:44:53.738 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:44:53.738 INFO:teuthology.orchestra.run.smithi026.stdout:Install 2 Packages 2021-11-03T16:44:53.738 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:44:53.739 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 967 k 2021-11-03T16:44:53.739 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 3.2 M 2021-11-03T16:44:53.740 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2021-11-03T16:44:53.766 INFO:teuthology.orchestra.run.smithi026.stdout:(1/2): ceph-fuse-16.2.4-0.el8.x86_64.rpm 30 MB/s | 885 kB 00:00 2021-11-03T16:44:53.769 INFO:teuthology.orchestra.run.smithi026.stdout:(2/2): fuse-2.9.7-12.el8.x86_64.rpm 2.5 MB/s | 82 kB 00:00 2021-11-03T16:44:53.771 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2021-11-03T16:44:53.771 INFO:teuthology.orchestra.run.smithi026.stdout:Total 27 MB/s | 967 kB 00:00 2021-11-03T16:44:53.774 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2021-11-03T16:44:53.797 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2021-11-03T16:44:53.797 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2021-11-03T16:44:53.883 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2021-11-03T16:44:53.886 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2021-11-03T16:44:54.030 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2021-11-03T16:44:54.056 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2021-11-03T16:44:54.313 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2021-11-03T16:44:54.418 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : fuse-2.9.7-12.el8.x86_64 1/2 2021-11-03T16:44:54.569 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2021-11-03T16:44:54.569 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:44:54.569 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2021-11-03T16:44:54.570 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs-devel-2:16.2.4-0.el8.x86_64 2021-11-03T16:44:54.570 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:44:54.570 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2021-11-03T16:44:54.612 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-fuse-2:16.2.4-0.el8.x86_64 2/2 2021-11-03T16:44:54.640 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install librados2 2021-11-03T16:44:55.005 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-fuse-2:16.2.4-0.el8.x86_64 2/2 2021-11-03T16:44:55.005 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-fuse-2:16.2.4-0.el8.x86_64 1/2 2021-11-03T16:44:55.097 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:56 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:44:55.278 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/2 2021-11-03T16:44:55.278 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:44:55.278 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2021-11-03T16:44:55.279 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-fuse-2:16.2.4-0.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2021-11-03T16:44:55.279 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:44:55.279 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2021-11-03T16:44:55.415 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install librados-devel 2021-11-03T16:44:55.806 INFO:teuthology.orchestra.run.smithi194.stdout:Package librados2-2:16.2.4-0.el8.x86_64 is already installed. 2021-11-03T16:44:55.907 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:56 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:44:56.089 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2021-11-03T16:44:56.090 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2021-11-03T16:44:56.090 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2021-11-03T16:44:56.145 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install librbd1 2021-11-03T16:44:56.604 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:57 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:44:56.968 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2021-11-03T16:44:56.969 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:44:56.969 INFO:teuthology.orchestra.run.smithi026.stdout: Package Architecture Version Repository Size 2021-11-03T16:44:56.969 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:44:56.969 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2021-11-03T16:44:56.970 INFO:teuthology.orchestra.run.smithi026.stdout: librados-devel x86_64 2:16.2.4-0.el8 ceph 131 k 2021-11-03T16:44:56.970 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:44:56.970 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2021-11-03T16:44:56.970 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:44:56.971 INFO:teuthology.orchestra.run.smithi026.stdout:Install 1 Package 2021-11-03T16:44:56.971 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:44:56.971 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 131 k 2021-11-03T16:44:56.972 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 439 k 2021-11-03T16:44:56.972 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2021-11-03T16:44:56.984 INFO:teuthology.orchestra.run.smithi026.stdout:librados-devel-16.2.4-0.el8.x86_64.rpm 8.5 MB/s | 131 kB 00:00 2021-11-03T16:44:56.985 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2021-11-03T16:44:56.985 INFO:teuthology.orchestra.run.smithi026.stdout:Total 7.8 MB/s | 131 kB 00:00 2021-11-03T16:44:56.986 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2021-11-03T16:44:56.993 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2021-11-03T16:44:56.993 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2021-11-03T16:44:57.048 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2021-11-03T16:44:57.051 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2021-11-03T16:44:57.165 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2021-11-03T16:44:57.356 INFO:teuthology.orchestra.run.smithi194.stdout:Package librbd1-2:16.2.4-0.el8.x86_64 is already installed. 2021-11-03T16:44:57.394 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librados-devel-2:16.2.4-0.el8.x86_64 1/1 2021-11-03T16:44:57.629 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2021-11-03T16:44:57.630 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2021-11-03T16:44:57.631 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2021-11-03T16:44:57.662 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librados-devel-2:16.2.4-0.el8.x86_64 1/1 2021-11-03T16:44:57.687 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install python3-rados 2021-11-03T16:44:58.018 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados-devel-2:16.2.4-0.el8.x86_64 1/1 2021-11-03T16:44:58.019 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:44:58.019 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2021-11-03T16:44:58.019 INFO:teuthology.orchestra.run.smithi026.stdout: librados-devel-2:16.2.4-0.el8.x86_64 2021-11-03T16:44:58.019 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:44:58.020 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2021-11-03T16:44:58.143 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:59 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:44:58.342 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install libcephfs2 2021-11-03T16:44:58.835 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:59 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:44:58.864 INFO:teuthology.orchestra.run.smithi194.stdout:Package python3-rados-2:16.2.4-0.el8.x86_64 is already installed. 2021-11-03T16:44:59.138 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2021-11-03T16:44:59.139 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2021-11-03T16:44:59.139 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2021-11-03T16:44:59.193 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install python3-rgw 2021-11-03T16:44:59.580 INFO:teuthology.orchestra.run.smithi026.stdout:Package libcephfs2-2:16.2.4-0.el8.x86_64 is already installed. 2021-11-03T16:44:59.649 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:02:00 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:44:59.868 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2021-11-03T16:44:59.869 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2021-11-03T16:44:59.869 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2021-11-03T16:44:59.919 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install libcephfs-devel 2021-11-03T16:45:00.401 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:02:01 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:45:00.739 INFO:teuthology.orchestra.run.smithi194.stdout:Package python3-rgw-2:16.2.4-0.el8.x86_64 is already installed. 2021-11-03T16:45:01.014 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2021-11-03T16:45:01.015 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2021-11-03T16:45:01.015 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2021-11-03T16:45:01.069 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install python3-cephfs 2021-11-03T16:45:01.463 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2021-11-03T16:45:01.464 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:45:01.464 INFO:teuthology.orchestra.run.smithi026.stdout: Package Architecture Version Repository Size 2021-11-03T16:45:01.465 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:45:01.465 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2021-11-03T16:45:01.465 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs-devel x86_64 2:16.2.4-0.el8 ceph 24 k 2021-11-03T16:45:01.465 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:45:01.466 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2021-11-03T16:45:01.466 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:45:01.466 INFO:teuthology.orchestra.run.smithi026.stdout:Install 1 Package 2021-11-03T16:45:01.466 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:45:01.467 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 24 k 2021-11-03T16:45:01.467 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 94 k 2021-11-03T16:45:01.467 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2021-11-03T16:45:01.476 INFO:teuthology.orchestra.run.smithi026.stdout:libcephfs-devel-16.2.4-0.el8.x86_64.rpm 2.0 MB/s | 24 kB 00:00 2021-11-03T16:45:01.477 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2021-11-03T16:45:01.478 INFO:teuthology.orchestra.run.smithi026.stdout:Total 1.8 MB/s | 24 kB 00:00 2021-11-03T16:45:01.478 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2021-11-03T16:45:01.482 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2021-11-03T16:45:01.483 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2021-11-03T16:45:01.485 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2021-11-03T16:45:01.488 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2021-11-03T16:45:01.523 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:02:02 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:45:01.552 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2021-11-03T16:45:01.752 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2021-11-03T16:45:01.982 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2021-11-03T16:45:02.280 INFO:teuthology.orchestra.run.smithi194.stdout:Package python3-cephfs-2:16.2.4-0.el8.x86_64 is already installed. 2021-11-03T16:45:02.286 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2021-11-03T16:45:02.286 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:45:02.287 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2021-11-03T16:45:02.287 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs-devel-2:16.2.4-0.el8.x86_64 2021-11-03T16:45:02.287 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:45:02.287 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2021-11-03T16:45:02.363 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install librados2 2021-11-03T16:45:02.555 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2021-11-03T16:45:02.556 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2021-11-03T16:45:02.556 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2021-11-03T16:45:02.616 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install python3-rbd 2021-11-03T16:45:02.847 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:02:03 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:45:03.073 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:02:04 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:45:03.830 INFO:teuthology.orchestra.run.smithi194.stdout:Package python3-rbd-2:16.2.4-0.el8.x86_64 is already installed. 2021-11-03T16:45:04.109 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2021-11-03T16:45:04.110 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2021-11-03T16:45:04.111 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2021-11-03T16:45:04.166 INFO:teuthology.orchestra.run.smithi026.stdout:Package librados2-2:16.2.4-0.el8.x86_64 is already installed. 2021-11-03T16:45:04.169 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install rbd-fuse 2021-11-03T16:45:04.455 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2021-11-03T16:45:04.456 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2021-11-03T16:45:04.456 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2021-11-03T16:45:04.625 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:02:05 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:45:04.771 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install librbd1 2021-11-03T16:45:05.257 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:02:06 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:45:05.654 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2021-11-03T16:45:05.655 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:45:05.656 INFO:teuthology.orchestra.run.smithi194.stdout: Package Architecture Version Repository Size 2021-11-03T16:45:05.656 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:45:05.656 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2021-11-03T16:45:05.656 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-fuse x86_64 2:16.2.4-0.el8 ceph 89 k 2021-11-03T16:45:05.657 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:45:05.657 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2021-11-03T16:45:05.657 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:45:05.657 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2021-11-03T16:45:05.658 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:45:05.658 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 89 k 2021-11-03T16:45:05.658 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 298 k 2021-11-03T16:45:05.658 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2021-11-03T16:45:05.690 INFO:teuthology.orchestra.run.smithi194.stdout:rbd-fuse-16.2.4-0.el8.x86_64.rpm 2.5 MB/s | 89 kB 00:00 2021-11-03T16:45:05.691 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2021-11-03T16:45:05.691 INFO:teuthology.orchestra.run.smithi194.stdout:Total 2.4 MB/s | 89 kB 00:00 2021-11-03T16:45:05.692 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2021-11-03T16:45:05.703 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2021-11-03T16:45:05.703 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2021-11-03T16:45:05.753 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2021-11-03T16:45:05.756 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2021-11-03T16:45:06.050 INFO:teuthology.orchestra.run.smithi026.stdout:Package librbd1-2:16.2.4-0.el8.x86_64 is already installed. 2021-11-03T16:45:06.329 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2021-11-03T16:45:06.349 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2021-11-03T16:45:06.350 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2021-11-03T16:45:06.350 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2021-11-03T16:45:06.395 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install python3-rados 2021-11-03T16:45:06.589 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2021-11-03T16:45:06.845 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2021-11-03T16:45:06.878 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:02:07 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:45:07.178 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2021-11-03T16:45:07.179 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:45:07.179 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2021-11-03T16:45:07.179 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-fuse-2:16.2.4-0.el8.x86_64 2021-11-03T16:45:07.179 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:45:07.180 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2021-11-03T16:45:07.298 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install rbd-mirror 2021-11-03T16:45:07.760 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:02:08 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:45:07.787 INFO:teuthology.orchestra.run.smithi026.stdout:Package python3-rados-2:16.2.4-0.el8.x86_64 is already installed. 2021-11-03T16:45:08.074 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2021-11-03T16:45:08.075 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2021-11-03T16:45:08.076 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2021-11-03T16:45:08.135 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install python3-rgw 2021-11-03T16:45:08.616 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:02:09 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:45:08.771 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2021-11-03T16:45:08.772 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:45:08.772 INFO:teuthology.orchestra.run.smithi194.stdout: Package Architecture Version Repository Size 2021-11-03T16:45:08.773 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:45:08.773 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2021-11-03T16:45:08.773 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-mirror x86_64 2:16.2.4-0.el8 ceph 3.7 M 2021-11-03T16:45:08.773 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:45:08.774 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2021-11-03T16:45:08.774 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:45:08.774 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2021-11-03T16:45:08.774 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:45:08.774 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 3.7 M 2021-11-03T16:45:08.775 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 18 M 2021-11-03T16:45:08.775 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2021-11-03T16:45:08.841 INFO:teuthology.orchestra.run.smithi194.stdout:rbd-mirror-16.2.4-0.el8.x86_64.rpm 55 MB/s | 3.7 MB 00:00 2021-11-03T16:45:08.842 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2021-11-03T16:45:08.842 INFO:teuthology.orchestra.run.smithi194.stdout:Total 53 MB/s | 3.7 MB 00:00 2021-11-03T16:45:08.843 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2021-11-03T16:45:08.856 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2021-11-03T16:45:08.857 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2021-11-03T16:45:08.920 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2021-11-03T16:45:08.923 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2021-11-03T16:45:09.385 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2021-11-03T16:45:09.436 INFO:teuthology.orchestra.run.smithi026.stdout:Package python3-rgw-2:16.2.4-0.el8.x86_64 is already installed. 2021-11-03T16:45:09.565 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2021-11-03T16:45:09.725 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2021-11-03T16:45:09.726 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2021-11-03T16:45:09.726 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2021-11-03T16:45:09.923 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install python3-cephfs 2021-11-03T16:45:09.938 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2021-11-03T16:45:10.223 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2021-11-03T16:45:10.223 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:45:10.224 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2021-11-03T16:45:10.224 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-mirror-2:16.2.4-0.el8.x86_64 2021-11-03T16:45:10.224 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:45:10.224 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2021-11-03T16:45:10.370 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install rbd-nbd 2021-11-03T16:45:10.406 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:02:11 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:45:10.835 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:02:11 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:45:11.170 INFO:teuthology.orchestra.run.smithi026.stdout:Package python3-cephfs-2:16.2.4-0.el8.x86_64 is already installed. 2021-11-03T16:45:11.459 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2021-11-03T16:45:11.460 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2021-11-03T16:45:11.461 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2021-11-03T16:45:11.510 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install python3-rbd 2021-11-03T16:45:11.839 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2021-11-03T16:45:11.841 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:45:11.841 INFO:teuthology.orchestra.run.smithi194.stdout: Package Architecture Version Repository Size 2021-11-03T16:45:11.841 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:45:11.841 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2021-11-03T16:45:11.842 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-nbd x86_64 2:16.2.4-0.el8 ceph 173 k 2021-11-03T16:45:11.842 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:45:11.842 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2021-11-03T16:45:11.842 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2021-11-03T16:45:11.843 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2021-11-03T16:45:11.843 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:45:11.843 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 173 k 2021-11-03T16:45:11.843 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 649 k 2021-11-03T16:45:11.844 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2021-11-03T16:45:11.857 INFO:teuthology.orchestra.run.smithi194.stdout:rbd-nbd-16.2.4-0.el8.x86_64.rpm 11 MB/s | 173 kB 00:00 2021-11-03T16:45:11.858 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2021-11-03T16:45:11.858 INFO:teuthology.orchestra.run.smithi194.stdout:Total 9.7 MB/s | 173 kB 00:00 2021-11-03T16:45:11.859 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2021-11-03T16:45:11.872 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2021-11-03T16:45:11.872 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2021-11-03T16:45:11.922 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2021-11-03T16:45:11.925 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2021-11-03T16:45:11.995 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:02:12 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:45:12.210 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2021-11-03T16:45:12.405 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2021-11-03T16:45:12.649 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2021-11-03T16:45:12.769 INFO:teuthology.orchestra.run.smithi026.stdout:Package python3-rbd-2:16.2.4-0.el8.x86_64 is already installed. 2021-11-03T16:45:12.945 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2021-11-03T16:45:12.946 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:45:12.946 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2021-11-03T16:45:12.946 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-nbd-2:16.2.4-0.el8.x86_64 2021-11-03T16:45:12.946 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:45:12.947 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2021-11-03T16:45:13.057 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2021-11-03T16:45:13.058 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2021-11-03T16:45:13.058 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2021-11-03T16:45:13.072 DEBUG:teuthology.parallel:result is None 2021-11-03T16:45:13.111 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install rbd-fuse 2021-11-03T16:45:13.597 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:02:14 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:45:14.650 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2021-11-03T16:45:14.651 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:45:14.651 INFO:teuthology.orchestra.run.smithi026.stdout: Package Architecture Version Repository Size 2021-11-03T16:45:14.651 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:45:14.651 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2021-11-03T16:45:14.652 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-fuse x86_64 2:16.2.4-0.el8 ceph 89 k 2021-11-03T16:45:14.652 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:45:14.652 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2021-11-03T16:45:14.652 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:45:14.653 INFO:teuthology.orchestra.run.smithi026.stdout:Install 1 Package 2021-11-03T16:45:14.653 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:45:14.653 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 89 k 2021-11-03T16:45:14.653 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 298 k 2021-11-03T16:45:14.654 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2021-11-03T16:45:14.663 INFO:teuthology.orchestra.run.smithi026.stdout:rbd-fuse-16.2.4-0.el8.x86_64.rpm 7.6 MB/s | 89 kB 00:00 2021-11-03T16:45:14.664 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2021-11-03T16:45:14.664 INFO:teuthology.orchestra.run.smithi026.stdout:Total 6.8 MB/s | 89 kB 00:00 2021-11-03T16:45:14.664 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2021-11-03T16:45:14.677 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2021-11-03T16:45:14.677 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2021-11-03T16:45:14.731 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2021-11-03T16:45:14.735 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2021-11-03T16:45:14.857 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2021-11-03T16:45:15.066 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2021-11-03T16:45:15.318 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2021-11-03T16:45:15.643 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2021-11-03T16:45:15.643 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:45:15.644 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2021-11-03T16:45:15.644 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-fuse-2:16.2.4-0.el8.x86_64 2021-11-03T16:45:15.644 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:45:15.644 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2021-11-03T16:45:15.804 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install rbd-mirror 2021-11-03T16:45:16.286 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:02:17 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:45:17.483 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2021-11-03T16:45:17.484 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:45:17.484 INFO:teuthology.orchestra.run.smithi026.stdout: Package Architecture Version Repository Size 2021-11-03T16:45:17.485 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:45:17.485 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2021-11-03T16:45:17.485 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-mirror x86_64 2:16.2.4-0.el8 ceph 3.7 M 2021-11-03T16:45:17.485 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:45:17.486 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2021-11-03T16:45:17.486 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:45:17.486 INFO:teuthology.orchestra.run.smithi026.stdout:Install 1 Package 2021-11-03T16:45:17.486 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:45:17.487 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 3.7 M 2021-11-03T16:45:17.487 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 18 M 2021-11-03T16:45:17.487 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2021-11-03T16:45:17.538 INFO:teuthology.orchestra.run.smithi026.stdout:rbd-mirror-16.2.4-0.el8.x86_64.rpm 69 MB/s | 3.7 MB 00:00 2021-11-03T16:45:17.539 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2021-11-03T16:45:17.540 INFO:teuthology.orchestra.run.smithi026.stdout:Total 67 MB/s | 3.7 MB 00:00 2021-11-03T16:45:17.540 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2021-11-03T16:45:17.556 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2021-11-03T16:45:17.556 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2021-11-03T16:45:17.624 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2021-11-03T16:45:17.628 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2021-11-03T16:45:18.150 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2021-11-03T16:45:18.359 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2021-11-03T16:45:18.768 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2021-11-03T16:45:19.061 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2021-11-03T16:45:19.061 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:45:19.062 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2021-11-03T16:45:19.062 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-mirror-2:16.2.4-0.el8.x86_64 2021-11-03T16:45:19.062 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:45:19.062 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2021-11-03T16:45:19.175 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install rbd-nbd 2021-11-03T16:45:19.664 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:02:20 ago on Wed 03 Nov 2021 04:42:59 PM UTC. 2021-11-03T16:45:20.731 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2021-11-03T16:45:20.732 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:45:20.732 INFO:teuthology.orchestra.run.smithi026.stdout: Package Architecture Version Repository Size 2021-11-03T16:45:20.733 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:45:20.733 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2021-11-03T16:45:20.733 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-nbd x86_64 2:16.2.4-0.el8 ceph 173 k 2021-11-03T16:45:20.733 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:45:20.733 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2021-11-03T16:45:20.734 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2021-11-03T16:45:20.734 INFO:teuthology.orchestra.run.smithi026.stdout:Install 1 Package 2021-11-03T16:45:20.734 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:45:20.734 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 173 k 2021-11-03T16:45:20.735 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 649 k 2021-11-03T16:45:20.735 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2021-11-03T16:45:20.745 INFO:teuthology.orchestra.run.smithi026.stdout:rbd-nbd-16.2.4-0.el8.x86_64.rpm 13 MB/s | 173 kB 00:00 2021-11-03T16:45:20.746 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2021-11-03T16:45:20.746 INFO:teuthology.orchestra.run.smithi026.stdout:Total 12 MB/s | 173 kB 00:00 2021-11-03T16:45:20.747 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2021-11-03T16:45:20.760 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2021-11-03T16:45:20.760 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2021-11-03T16:45:20.813 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2021-11-03T16:45:20.817 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2021-11-03T16:45:20.932 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2021-11-03T16:45:21.141 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2021-11-03T16:45:21.401 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2021-11-03T16:45:21.871 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2021-11-03T16:45:21.871 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:45:21.871 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2021-11-03T16:45:21.872 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-nbd-2:16.2.4-0.el8.x86_64 2021-11-03T16:45:21.872 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:45:21.872 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2021-11-03T16:45:22.036 DEBUG:teuthology.parallel:result is None 2021-11-03T16:45:22.037 DEBUG:teuthology.orchestra.run.smithi026:> sudo lsb_release -is 2021-11-03T16:45:22.072 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS 2021-11-03T16:45:22.074 DEBUG:teuthology.misc:System to be installed: CentOS 2021-11-03T16:45:22.074 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2021-11-03T16:45:22.075 INFO:teuthology.packaging:ref: None 2021-11-03T16:45:22.075 INFO:teuthology.packaging:tag: v16.2.4 2021-11-03T16:45:22.075 INFO:teuthology.packaging:branch: None 2021-11-03T16:45:22.076 INFO:teuthology.packaging:sha1: 6e90212d8510e2d506395a8c82057d0d1787f3a4 2021-11-03T16:45:22.107 DEBUG:teuthology.repo_utils:git ls-remote git://git.ceph.com/ceph-ci v16.2.4^{} -> 3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2021-11-03T16:45:22.108 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2021-11-03T16:45:22.318 DEBUG:teuthology.orchestra.run.smithi026:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2021-11-03T16:45:22.340 INFO:teuthology.orchestra.run.smithi026.stdout:16.2.4-0.el8 2021-11-03T16:45:22.340 INFO:teuthology.packaging:The installed version of ceph is 16.2.4-0.el8 2021-11-03T16:45:22.341 INFO:teuthology.task.install:The correct ceph version 16.2.4-0 is installed. 2021-11-03T16:45:22.341 DEBUG:teuthology.orchestra.run.smithi194:> sudo lsb_release -is 2021-11-03T16:45:22.382 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS 2021-11-03T16:45:22.384 DEBUG:teuthology.misc:System to be installed: CentOS 2021-11-03T16:45:22.384 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2021-11-03T16:45:22.385 INFO:teuthology.packaging:ref: None 2021-11-03T16:45:22.385 INFO:teuthology.packaging:tag: v16.2.4 2021-11-03T16:45:22.386 INFO:teuthology.packaging:branch: None 2021-11-03T16:45:22.386 INFO:teuthology.packaging:sha1: 6e90212d8510e2d506395a8c82057d0d1787f3a4 2021-11-03T16:45:22.417 DEBUG:teuthology.repo_utils:git ls-remote git://git.ceph.com/ceph-ci v16.2.4^{} -> 3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2021-11-03T16:45:22.419 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2021-11-03T16:45:22.625 DEBUG:teuthology.orchestra.run.smithi194:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2021-11-03T16:45:22.649 INFO:teuthology.orchestra.run.smithi194.stdout:16.2.4-0.el8 2021-11-03T16:45:22.650 INFO:teuthology.packaging:The installed version of ceph is 16.2.4-0.el8 2021-11-03T16:45:22.650 INFO:teuthology.task.install:The correct ceph version 16.2.4-0 is installed. 2021-11-03T16:45:22.651 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2021-11-03T16:45:22.651 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2021-11-03T16:45:22.652 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-11-03T16:45:22.679 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2021-11-03T16:45:22.680 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-11-03T16:45:22.718 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2021-11-03T16:45:22.718 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2021-11-03T16:45:22.719 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/daemon-helper 2021-11-03T16:45:22.745 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-11-03T16:45:22.811 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2021-11-03T16:45:22.812 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/daemon-helper 2021-11-03T16:45:22.840 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-11-03T16:45:22.907 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2021-11-03T16:45:22.908 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2021-11-03T16:45:22.908 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/adjust-ulimits 2021-11-03T16:45:22.935 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-11-03T16:45:23.000 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2021-11-03T16:45:23.000 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/adjust-ulimits 2021-11-03T16:45:23.027 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-11-03T16:45:23.094 INFO:teuthology.run_tasks:Running task cephadm... 2021-11-03T16:45:23.169 INFO:tasks.cephadm:Config: {'avoid_pacific_features': True, 'cephadm_branch': 'v16.2.4', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'image': 'docker.io/ceph/ceph:v16.2.4', 'roleless': True, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '6e90212d8510e2d506395a8c82057d0d1787f3a4'} 2021-11-03T16:45:23.170 INFO:tasks.cephadm:Cluster image is docker.io/ceph/ceph:v16.2.4 2021-11-03T16:45:23.171 INFO:tasks.cephadm:Cluster fsid is 70492bc6-3cc5-11ec-8c28-001a4aab830c 2021-11-03T16:45:23.171 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2021-11-03T16:45:23.171 INFO:tasks.cephadm:No mon roles; fabricating mons 2021-11-03T16:45:23.172 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi026': '172.21.15.26', 'mon.smithi194': '172.21.15.194'} 2021-11-03T16:45:23.172 INFO:tasks.cephadm:Normalizing hostnames... 2021-11-03T16:45:23.172 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname $(hostname -s) 2021-11-03T16:45:23.200 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname $(hostname -s) 2021-11-03T16:45:23.228 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref v16.2.4)... 2021-11-03T16:45:23.229 DEBUG:teuthology.orchestra.run.smithi026:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v16.2.4/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2021-11-03T16:45:23.351 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-rw-r--. 1 ubuntu ubuntu 292005 Nov 3 16:45 /home/ubuntu/cephtest/cephadm 2021-11-03T16:45:23.351 DEBUG:teuthology.orchestra.run.smithi194:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v16.2.4/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2021-11-03T16:45:23.459 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-rw-r--. 1 ubuntu ubuntu 292005 Nov 3 16:45 /home/ubuntu/cephtest/cephadm 2021-11-03T16:45:23.459 DEBUG:teuthology.orchestra.run.smithi026:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2021-11-03T16:45:23.477 DEBUG:teuthology.orchestra.run.smithi194:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2021-11-03T16:45:23.504 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /etc/ceph 2021-11-03T16:45:23.545 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /etc/ceph 2021-11-03T16:45:23.570 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 777 /etc/ceph 2021-11-03T16:45:23.612 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 777 /etc/ceph 2021-11-03T16:45:23.637 INFO:tasks.cephadm:Writing seed config... 2021-11-03T16:45:23.638 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2021-11-03T16:45:23.639 INFO:tasks.cephadm: override: [client] debug client = 20 2021-11-03T16:45:23.639 INFO:tasks.cephadm: override: [client] debug ms = 1 2021-11-03T16:45:23.639 INFO:tasks.cephadm: override: [client] rados mon op timeout = 15m 2021-11-03T16:45:23.640 INFO:tasks.cephadm: override: [client] rados osd op timeout = 15m 2021-11-03T16:45:23.640 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2021-11-03T16:45:23.640 INFO:tasks.cephadm: override: [mds] debug mds = 20 2021-11-03T16:45:23.641 INFO:tasks.cephadm: override: [mds] debug ms = 1 2021-11-03T16:45:23.641 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2021-11-03T16:45:23.641 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2021-11-03T16:45:23.642 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2021-11-03T16:45:23.642 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2021-11-03T16:45:23.642 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2021-11-03T16:45:23.642 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 15m 2021-11-03T16:45:23.643 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 15m 2021-11-03T16:45:23.643 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2021-11-03T16:45:23.643 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2021-11-03T16:45:23.644 INFO:tasks.cephadm: override: [mon] debug mon = 20 2021-11-03T16:45:23.644 INFO:tasks.cephadm: override: [mon] debug ms = 1 2021-11-03T16:45:23.644 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2021-11-03T16:45:23.645 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2021-11-03T16:45:23.645 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2021-11-03T16:45:23.645 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2021-11-03T16:45:23.646 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2021-11-03T16:45:23.646 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2021-11-03T16:45:23.646 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2021-11-03T16:45:23.647 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2021-11-03T16:45:23.647 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2021-11-03T16:45:23.647 INFO:tasks.cephadm: override: [osd] debug ms = 1 2021-11-03T16:45:23.647 INFO:tasks.cephadm: override: [osd] debug osd = 20 2021-11-03T16:45:23.648 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2021-11-03T16:45:23.648 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2021-11-03T16:45:23.648 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2021-11-03T16:45:23.649 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2021-11-03T16:45:23.649 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2021-11-03T16:45:23.649 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2021-11-03T16:45:23.650 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2021-11-03T16:45:23.651 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2021-11-03T16:45:23.651 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2021-11-03T16:45:23.668 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 70492bc6-3cc5-11ec-8c28-001a4aab830c mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 15m rados osd op timeout = 15m [mds] debug mds = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 15m rados osd op timeout = 15m 2021-11-03T16:45:23.669 DEBUG:teuthology.orchestra.run.smithi026:mon.smithi026> sudo journalctl -f -n 0 -u ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c@mon.smithi026.service 2021-11-03T16:45:23.710 INFO:tasks.cephadm:Bootstrapping... 2021-11-03T16:45:23.711 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 -v bootstrap --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.26 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2021-11-03T16:45:23.738 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:-- Logs begin at Wed 2021-11-03 16:35:12 UTC. -- 2021-11-03T16:45:23.969 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman version --format {{.Client.Version}} 2021-11-03T16:45:24.995 INFO:teuthology.orchestra.run.smithi026.stderr:/bin/podman: 3.0.2-dev 2021-11-03T16:45:25.016 INFO:teuthology.orchestra.run.smithi026.stderr:Verifying podman|docker is present... 2021-11-03T16:45:25.016 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman version --format {{.Client.Version}} 2021-11-03T16:45:25.070 INFO:teuthology.orchestra.run.smithi026.stderr:/bin/podman: 3.0.2-dev 2021-11-03T16:45:25.083 INFO:teuthology.orchestra.run.smithi026.stderr:Verifying lvm2 is present... 2021-11-03T16:45:25.084 INFO:teuthology.orchestra.run.smithi026.stderr:Verifying time synchronization is in place... 2021-11-03T16:45:25.085 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: systemctl is-enabled chrony.service 2021-11-03T16:45:25.090 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2021-11-03T16:45:25.091 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: systemctl is-active chrony.service 2021-11-03T16:45:25.097 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: inactive 2021-11-03T16:45:25.098 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: systemctl is-enabled chronyd.service 2021-11-03T16:45:25.104 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: enabled 2021-11-03T16:45:25.104 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: systemctl is-active chronyd.service 2021-11-03T16:45:25.110 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: active 2021-11-03T16:45:25.111 INFO:teuthology.orchestra.run.smithi026.stderr:Unit chronyd.service is enabled and running 2021-11-03T16:45:25.111 INFO:teuthology.orchestra.run.smithi026.stderr:Repeating the final host check... 2021-11-03T16:45:25.111 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman version --format {{.Client.Version}} 2021-11-03T16:45:25.157 INFO:teuthology.orchestra.run.smithi026.stderr:/bin/podman: 3.0.2-dev 2021-11-03T16:45:25.176 INFO:teuthology.orchestra.run.smithi026.stderr:podman|docker (/bin/podman) is present 2021-11-03T16:45:25.176 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl is present 2021-11-03T16:45:25.176 INFO:teuthology.orchestra.run.smithi026.stderr:lvcreate is present 2021-11-03T16:45:25.177 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: systemctl is-enabled chrony.service 2021-11-03T16:45:25.182 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2021-11-03T16:45:25.182 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: systemctl is-active chrony.service 2021-11-03T16:45:25.188 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: inactive 2021-11-03T16:45:25.188 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: systemctl is-enabled chronyd.service 2021-11-03T16:45:25.194 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: enabled 2021-11-03T16:45:25.194 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: systemctl is-active chronyd.service 2021-11-03T16:45:25.200 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: active 2021-11-03T16:45:25.200 INFO:teuthology.orchestra.run.smithi026.stderr:Unit chronyd.service is enabled and running 2021-11-03T16:45:25.201 INFO:teuthology.orchestra.run.smithi026.stderr:Host looks OK 2021-11-03T16:45:25.201 INFO:teuthology.orchestra.run.smithi026.stderr:Cluster fsid: 70492bc6-3cc5-11ec-8c28-001a4aab830c 2021-11-03T16:45:25.201 INFO:teuthology.orchestra.run.smithi026.stderr:Acquiring lock 139749268851176 on /run/cephadm/70492bc6-3cc5-11ec-8c28-001a4aab830c.lock 2021-11-03T16:45:25.201 INFO:teuthology.orchestra.run.smithi026.stderr:Lock 139749268851176 acquired on /run/cephadm/70492bc6-3cc5-11ec-8c28-001a4aab830c.lock 2021-11-03T16:45:25.202 INFO:teuthology.orchestra.run.smithi026.stderr:Verifying IP 172.21.15.26 port 3300 ... 2021-11-03T16:45:25.203 INFO:teuthology.orchestra.run.smithi026.stderr:Verifying IP 172.21.15.26 port 6789 ... 2021-11-03T16:45:25.203 INFO:teuthology.orchestra.run.smithi026.stderr:Base mon IP is 172.21.15.26, final addrv is [v2:172.21.15.26:3300,v1:172.21.15.26:6789] 2021-11-03T16:45:25.203 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /sbin/ip route ls 2021-11-03T16:45:25.204 INFO:teuthology.orchestra.run.smithi026.stderr:/sbin/ip: default via 172.21.15.254 dev ens1f0 proto dhcp metric 100 2021-11-03T16:45:25.204 INFO:teuthology.orchestra.run.smithi026.stderr:/sbin/ip: 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.26 metric 100 2021-11-03T16:45:25.205 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /sbin/ip -6 route ls 2021-11-03T16:45:25.206 INFO:teuthology.orchestra.run.smithi026.stderr:/sbin/ip: ::1 dev lo proto kernel metric 256 pref medium 2021-11-03T16:45:25.206 INFO:teuthology.orchestra.run.smithi026.stderr:/sbin/ip: fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2021-11-03T16:45:25.207 INFO:teuthology.orchestra.run.smithi026.stderr:/sbin/ip: default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1784sec hoplimit 64 pref medium 2021-11-03T16:45:25.207 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /sbin/ip -6 addr ls 2021-11-03T16:45:25.208 INFO:teuthology.orchestra.run.smithi026.stderr:/sbin/ip: 1: lo: mtu 65536 state UNKNOWN qlen 1000 2021-11-03T16:45:25.209 INFO:teuthology.orchestra.run.smithi026.stderr:/sbin/ip: inet6 ::1/128 scope host 2021-11-03T16:45:25.209 INFO:teuthology.orchestra.run.smithi026.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2021-11-03T16:45:25.209 INFO:teuthology.orchestra.run.smithi026.stderr:/sbin/ip: 3: ens1f0: mtu 1500 state UP qlen 1000 2021-11-03T16:45:25.209 INFO:teuthology.orchestra.run.smithi026.stderr:/sbin/ip: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2021-11-03T16:45:25.210 INFO:teuthology.orchestra.run.smithi026.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2021-11-03T16:45:25.211 INFO:teuthology.orchestra.run.smithi026.stderr:Mon IP 172.21.15.26 is in CIDR network 172.21.0.0/20 2021-11-03T16:45:25.211 INFO:teuthology.orchestra.run.smithi026.stderr:- internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2021-11-03T16:45:25.211 INFO:teuthology.orchestra.run.smithi026.stderr:Pulling container image docker.io/ceph/ceph:v16.2.4... 2021-11-03T16:45:25.211 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman pull docker.io/ceph/ceph:v16.2.4 2021-11-03T16:45:25.302 INFO:teuthology.orchestra.run.smithi026.stderr:/bin/podman: Trying to pull docker.io/ceph/ceph:v16.2.4... 2021-11-03T16:45:25.680 INFO:teuthology.orchestra.run.smithi026.stderr:/bin/podman: Getting image source signatures 2021-11-03T16:45:25.810 INFO:teuthology.orchestra.run.smithi026.stderr:/bin/podman: Copying blob sha256:7a0437f04f83f084b7ed68ad9c4a4947e12fc4e1b006b38129bac89114ec3621 2021-11-03T16:45:25.902 INFO:teuthology.orchestra.run.smithi026.stderr:/bin/podman: Copying blob sha256:551101690791055467b1840be133b2e6b029d263771bc6c46a96bb7acdacac39 2021-11-03T16:45:32.934 INFO:teuthology.orchestra.run.smithi026.stderr:/bin/podman: Copying config sha256:8d91d370c2b86c07de46146aba8d36718eaefa69b1880c77fa312fda6efd7d29 2021-11-03T16:45:33.001 INFO:teuthology.orchestra.run.smithi026.stderr:/bin/podman: Writing manifest to image destination 2021-11-03T16:45:33.001 INFO:teuthology.orchestra.run.smithi026.stderr:/bin/podman: Storing signatures 2021-11-03T16:45:42.642 INFO:teuthology.orchestra.run.smithi026.stderr:/bin/podman: 8d91d370c2b86c07de46146aba8d36718eaefa69b1880c77fa312fda6efd7d29 2021-11-03T16:45:42.654 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi026 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/ceph:v16.2.4 --version 2021-11-03T16:45:43.393 INFO:teuthology.orchestra.run.smithi026.stderr:ceph: ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable) 2021-11-03T16:45:54.119 INFO:teuthology.orchestra.run.smithi026.stderr:Ceph version: ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable) 2021-11-03T16:45:54.120 INFO:teuthology.orchestra.run.smithi026.stderr:Extracting ceph user uid/gid from container image... 2021-11-03T16:45:54.120 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint stat --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi026 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/ceph:v16.2.4 -c %u %g /var/lib/ceph 2021-11-03T16:45:54.744 INFO:teuthology.orchestra.run.smithi026.stderr:stat: 167 167 2021-11-03T16:45:55.337 INFO:teuthology.orchestra.run.smithi026.stderr:Creating initial keys... 2021-11-03T16:45:55.338 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph-authtool --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi026 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/ceph:v16.2.4 --gen-print-key 2021-11-03T16:45:55.937 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-authtool: AQDDvIJhj05vNRAAAy2hkOX9VHvTR4/pRmfoCQ== 2021-11-03T16:45:56.535 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph-authtool --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi026 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/ceph:v16.2.4 --gen-print-key 2021-11-03T16:45:57.104 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-authtool: AQDFvIJhiQXJAxAAWIl84l7kVkv06grKyIM+ZA== 2021-11-03T16:45:57.703 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph-authtool --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi026 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/ceph:v16.2.4 --gen-print-key 2021-11-03T16:45:58.280 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-authtool: AQDGvIJhgWoqDhAAS/YptKCfSUJreL3nUU/L7A== 2021-11-03T16:45:58.832 INFO:teuthology.orchestra.run.smithi026.stderr:Creating initial monmap... 2021-11-03T16:45:58.833 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/monmaptool --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi026 -e CEPH_USE_RANDOM_NONCE=1 -v /tmp/ceph-tmpatdoxy9c:/tmp/monmap:z docker.io/ceph/ceph:v16.2.4 --create --clobber --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c --addv smithi026 [v2:172.21.15.26:3300,v1:172.21.15.26:6789] /tmp/monmap 2021-11-03T16:45:59.422 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: monmap file /tmp/monmap 2021-11-03T16:45:59.422 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: set fsid to 70492bc6-3cc5-11ec-8c28-001a4aab830c 2021-11-03T16:45:59.422 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2021-11-03T16:46:00.054 INFO:teuthology.orchestra.run.smithi026.stderr:monmaptool for smithi026 [v2:172.21.15.26:3300,v1:172.21.15.26:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2021-11-03T16:46:00.054 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/monmaptool: set fsid to 70492bc6-3cc5-11ec-8c28-001a4aab830c 2021-11-03T16:46:00.054 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2021-11-03T16:46:00.055 INFO:teuthology.orchestra.run.smithi026.stderr: 2021-11-03T16:46:00.055 INFO:teuthology.orchestra.run.smithi026.stderr:Creating mon... 2021-11-03T16:46:00.056 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph-mon --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi026 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c:/var/log/ceph:z -v /var/lib/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c/mon.smithi026:/var/lib/ceph/mon/ceph-smithi026:z -v /tmp/ceph-tmp4jt0fspd:/tmp/keyring:z -v /tmp/ceph-tmpatdoxy9c:/tmp/monmap:z docker.io/ceph/ceph:v16.2.4 --mkfs -i smithi026 --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -c /dev/null --monmap /tmp/monmap --keyring /tmp/keyring --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true 2021-11-03T16:46:00.665 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.594+0000 7fed98aa1700 0 set uid:gid to 167:167 (ceph:ceph) 2021-11-03T16:46:00.666 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 1 imported monmap: 2021-11-03T16:46:00.666 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: epoch 0 2021-11-03T16:46:00.666 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c 2021-11-03T16:46:00.667 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: last_changed 2021-11-03T16:45:59.385154+0000 2021-11-03T16:46:00.667 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: created 2021-11-03T16:45:59.385154+0000 2021-11-03T16:46:00.667 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: min_mon_release 0 (unknown) 2021-11-03T16:46:00.667 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: election_strategy: 1 2021-11-03T16:46:00.667 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: 0: [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] mon.smithi026 2021-11-03T16:46:00.668 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: 2021-11-03T16:46:00.668 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 0 /usr/bin/ceph-mon: set fsid to 70492bc6-3cc5-11ec-8c28-001a4aab830c 2021-11-03T16:46:00.668 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: RocksDB version: 6.8.1 2021-11-03T16:46:00.668 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: 2021-11-03T16:46:00.669 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-11-03T16:46:00.669 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Compile date May 13 2021 2021-11-03T16:46:00.669 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: DB SUMMARY 2021-11-03T16:46:00.669 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: 2021-11-03T16:46:00.670 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi026/store.db dir, Total Num: 0, files: 2021-11-03T16:46:00.670 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: 2021-11-03T16:46:00.670 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi026/store.db: 2021-11-03T16:46:00.670 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: 2021-11-03T16:46:00.671 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.error_if_exists: 0 2021-11-03T16:46:00.671 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.create_if_missing: 1 2021-11-03T16:46:00.671 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.paranoid_checks: 1 2021-11-03T16:46:00.671 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.env: 0x556ea5d6e1c0 2021-11-03T16:46:00.671 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.fs: Posix File System 2021-11-03T16:46:00.672 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.info_log: 0x556ea71f6ec0 2021-11-03T16:46:00.672 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.max_file_opening_threads: 16 2021-11-03T16:46:00.672 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.statistics: (nil) 2021-11-03T16:46:00.672 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.use_fsync: 0 2021-11-03T16:46:00.672 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.max_log_file_size: 0 2021-11-03T16:46:00.673 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-11-03T16:46:00.673 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-11-03T16:46:00.673 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.keep_log_file_num: 1000 2021-11-03T16:46:00.673 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.recycle_log_file_num: 0 2021-11-03T16:46:00.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.allow_fallocate: 1 2021-11-03T16:46:00.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.allow_mmap_reads: 0 2021-11-03T16:46:00.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.allow_mmap_writes: 0 2021-11-03T16:46:00.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.use_direct_reads: 0 2021-11-03T16:46:00.675 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-11-03T16:46:00.675 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.create_missing_column_families: 0 2021-11-03T16:46:00.675 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.db_log_dir: 2021-11-03T16:46:00.676 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi026/store.db 2021-11-03T16:46:00.676 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-11-03T16:46:00.676 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.max_subcompactions: 1 2021-11-03T16:46:00.677 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.max_background_flushes: -1 2021-11-03T16:46:00.677 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-11-03T16:46:00.677 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-11-03T16:46:00.677 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-11-03T16:46:00.678 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-11-03T16:46:00.678 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-11-03T16:46:00.678 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.advise_random_on_open: 1 2021-11-03T16:46:00.678 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.db_write_buffer_size: 0 2021-11-03T16:46:00.679 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.write_buffer_manager: 0x556ea71fd530 2021-11-03T16:46:00.679 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-11-03T16:46:00.679 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-11-03T16:46:00.679 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-11-03T16:46:00.679 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-11-03T16:46:00.680 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.rate_limiter: (nil) 2021-11-03T16:46:00.680 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-11-03T16:46:00.680 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.wal_recovery_mode: 2 2021-11-03T16:46:00.680 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.enable_thread_tracking: 0 2021-11-03T16:46:00.681 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.enable_pipelined_write: 0 2021-11-03T16:46:00.681 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.unordered_write: 0 2021-11-03T16:46:00.681 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-11-03T16:46:00.681 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-11-03T16:46:00.681 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-11-03T16:46:00.682 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-11-03T16:46:00.682 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.row_cache: None 2021-11-03T16:46:00.682 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.wal_filter: None 2021-11-03T16:46:00.682 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-11-03T16:46:00.683 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.allow_ingest_behind: 0 2021-11-03T16:46:00.683 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.preserve_deletes: 0 2021-11-03T16:46:00.683 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.two_write_queues: 0 2021-11-03T16:46:00.684 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.manual_wal_flush: 0 2021-11-03T16:46:00.684 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.atomic_flush: 0 2021-11-03T16:46:00.684 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-11-03T16:46:00.684 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-11-03T16:46:00.685 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-11-03T16:46:00.685 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.595+0000 7fed98aa1700 4 rocksdb: Options.log_readahead_size: 0 2021-11-03T16:46:00.685 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-11-03T16:46:00.685 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.max_background_jobs: 2 2021-11-03T16:46:00.685 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.max_background_compactions: -1 2021-11-03T16:46:00.686 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-11-03T16:46:00.686 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-11-03T16:46:00.686 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-11-03T16:46:00.686 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.max_total_wal_size: 0 2021-11-03T16:46:00.687 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-11-03T16:46:00.687 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-11-03T16:46:00.687 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-11-03T16:46:00.687 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-11-03T16:46:00.687 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.max_open_files: -1 2021-11-03T16:46:00.688 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.bytes_per_sync: 0 2021-11-03T16:46:00.688 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-11-03T16:46:00.688 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-11-03T16:46:00.688 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.compaction_readahead_size: 0 2021-11-03T16:46:00.688 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Compression algorithms supported: 2021-11-03T16:46:00.689 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-11-03T16:46:00.689 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: kZSTD supported: 0 2021-11-03T16:46:00.689 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: kXpressCompression supported: 0 2021-11-03T16:46:00.689 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: kLZ4HCCompression supported: 1 2021-11-03T16:46:00.690 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: kLZ4Compression supported: 1 2021-11-03T16:46:00.690 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: kBZip2Compression supported: 0 2021-11-03T16:46:00.690 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: kZlibCompression supported: 1 2021-11-03T16:46:00.690 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: kSnappyCompression supported: 1 2021-11-03T16:46:00.690 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-11-03T16:46:00.691 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: [db_impl/db_impl_open.cc:273] Creating manifest 1 2021-11-03T16:46:00.691 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: 2021-11-03T16:46:00.691 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi026/store.db/MANIFEST-000001 2021-11-03T16:46:00.691 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: 2021-11-03T16:46:00.692 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-11-03T16:46:00.692 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: 2021-11-03T16:46:00.692 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-11-03T16:46:00.692 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.merge_operator: 2021-11-03T16:46:00.692 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.compaction_filter: None 2021-11-03T16:46:00.693 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.compaction_filter_factory: None 2021-11-03T16:46:00.693 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-11-03T16:46:00.693 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-11-03T16:46:00.693 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556ea7108120) 2021-11-03T16:46:00.694 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks: 1 2021-11-03T16:46:00.694 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks_with_high_priority: 0 2021-11-03T16:46:00.694 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: pin_l0_filter_and_index_blocks_in_cache: 0 2021-11-03T16:46:00.694 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: pin_top_level_index_and_filter: 1 2021-11-03T16:46:00.695 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: index_type: 0 2021-11-03T16:46:00.695 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: data_block_index_type: 0 2021-11-03T16:46:00.695 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: index_shortening: 1 2021-11-03T16:46:00.696 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: data_block_hash_table_util_ratio: 0.750000 2021-11-03T16:46:00.696 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: hash_index_allow_collision: 1 2021-11-03T16:46:00.696 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: checksum: 1 2021-11-03T16:46:00.697 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: no_block_cache: 0 2021-11-03T16:46:00.697 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: block_cache: 0x556ea7142d10 2021-11-03T16:46:00.697 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: block_cache_name: BinnedLRUCache 2021-11-03T16:46:00.697 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: block_cache_options: 2021-11-03T16:46:00.698 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: capacity : 536870912 2021-11-03T16:46:00.698 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: num_shard_bits : 4 2021-11-03T16:46:00.698 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: strict_capacity_limit : 0 2021-11-03T16:46:00.699 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: high_pri_pool_ratio: 0.000 2021-11-03T16:46:00.699 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: block_cache_compressed: (nil) 2021-11-03T16:46:00.699 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: persistent_cache: (nil) 2021-11-03T16:46:00.699 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: block_size: 4096 2021-11-03T16:46:00.700 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: block_size_deviation: 10 2021-11-03T16:46:00.700 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: block_restart_interval: 16 2021-11-03T16:46:00.700 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: index_block_restart_interval: 1 2021-11-03T16:46:00.700 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: metadata_block_size: 4096 2021-11-03T16:46:00.701 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: partition_filters: 0 2021-11-03T16:46:00.701 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: use_delta_encoding: 1 2021-11-03T16:46:00.701 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: filter_policy: rocksdb.BuiltinBloomFilter 2021-11-03T16:46:00.701 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: whole_key_filtering: 1 2021-11-03T16:46:00.702 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: verify_compression: 0 2021-11-03T16:46:00.702 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: read_amp_bytes_per_bit: 0 2021-11-03T16:46:00.702 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: format_version: 2 2021-11-03T16:46:00.702 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: enable_index_compression: 1 2021-11-03T16:46:00.702 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: block_align: 0 2021-11-03T16:46:00.703 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: 2021-11-03T16:46:00.703 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.write_buffer_size: 33554432 2021-11-03T16:46:00.703 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.max_write_buffer_number: 2 2021-11-03T16:46:00.703 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.compression: NoCompression 2021-11-03T16:46:00.704 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.bottommost_compression: Disabled 2021-11-03T16:46:00.704 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.prefix_extractor: nullptr 2021-11-03T16:46:00.704 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-11-03T16:46:00.704 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.num_levels: 7 2021-11-03T16:46:00.704 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-11-03T16:46:00.705 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-11-03T16:46:00.705 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-11-03T16:46:00.705 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-11-03T16:46:00.705 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-11-03T16:46:00.706 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-11-03T16:46:00.706 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-11-03T16:46:00.706 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-11-03T16:46:00.706 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-11-03T16:46:00.707 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-11-03T16:46:00.707 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.compression_opts.level: 32767 2021-11-03T16:46:00.707 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.compression_opts.strategy: 0 2021-11-03T16:46:00.707 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-11-03T16:46:00.707 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-11-03T16:46:00.708 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.compression_opts.enabled: false 2021-11-03T16:46:00.708 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-11-03T16:46:00.708 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-11-03T16:46:00.708 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-11-03T16:46:00.709 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.target_file_size_base: 67108864 2021-11-03T16:46:00.709 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-11-03T16:46:00.709 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-11-03T16:46:00.709 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-11-03T16:46:00.709 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-11-03T16:46:00.710 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-11-03T16:46:00.710 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-11-03T16:46:00.710 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-11-03T16:46:00.710 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-11-03T16:46:00.711 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-11-03T16:46:00.711 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-11-03T16:46:00.711 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-11-03T16:46:00.711 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-11-03T16:46:00.711 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-11-03T16:46:00.712 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.arena_block_size: 4194304 2021-11-03T16:46:00.712 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-11-03T16:46:00.712 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-11-03T16:46:00.712 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-11-03T16:46:00.712 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.disable_auto_compactions: 0 2021-11-03T16:46:00.713 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-11-03T16:46:00.713 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-11-03T16:46:00.713 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-11-03T16:46:00.713 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-11-03T16:46:00.714 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-11-03T16:46:00.714 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-11-03T16:46:00.714 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-11-03T16:46:00.714 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-11-03T16:46:00.714 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-11-03T16:46:00.715 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-11-03T16:46:00.715 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.table_properties_collectors: 2021-11-03T16:46:00.715 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.inplace_update_support: 0 2021-11-03T16:46:00.715 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-11-03T16:46:00.715 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-11-03T16:46:00.716 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-11-03T16:46:00.716 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-11-03T16:46:00.716 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.bloom_locality: 0 2021-11-03T16:46:00.716 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.max_successive_merges: 0 2021-11-03T16:46:00.717 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-11-03T16:46:00.717 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.paranoid_file_checks: 0 2021-11-03T16:46:00.717 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.force_consistency_checks: 0 2021-11-03T16:46:00.717 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.report_bg_io_stats: 0 2021-11-03T16:46:00.717 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.ttl: 2592000 2021-11-03T16:46:00.718 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.596+0000 7fed98aa1700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-11-03T16:46:00.718 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.597+0000 7fed98aa1700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi026/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-11-03T16:46:00.718 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: 2021-11-03T16:46:00.718 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.597+0000 7fed98aa1700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2021-11-03T16:46:00.719 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: 2021-11-03T16:46:00.719 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.597+0000 7fed98aa1700 4 rocksdb: DB pointer 0x556ea7209800 2021-11-03T16:46:00.719 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.598+0000 7fed8193a700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-11-03T16:46:00.719 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.598+0000 7fed8193a700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-11-03T16:46:00.719 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: ** DB Stats ** 2021-11-03T16:46:00.720 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2021-11-03T16:46:00.720 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-11-03T16:46:00.720 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-11-03T16:46:00.720 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-11-03T16:46:00.720 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-11-03T16:46:00.721 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-11-03T16:46:00.721 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-11-03T16:46:00.721 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: 2021-11-03T16:46:00.721 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2021-11-03T16:46:00.722 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-11-03T16:46:00.722 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-11-03T16:46:00.722 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-11-03T16:46:00.722 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-11-03T16:46:00.722 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: 2021-11-03T16:46:00.723 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2021-11-03T16:46:00.723 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-11-03T16:46:00.723 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-11-03T16:46:00.723 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2021-11-03T16:46:00.724 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2021-11-03T16:46:00.724 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2021-11-03T16:46:00.724 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2021-11-03T16:46:00.724 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2021-11-03T16:46:00.725 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2021-11-03T16:46:00.725 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-11-03T16:46:00.725 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-11-03T16:46:00.725 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-11-03T16:46:00.726 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: 2021-11-03T16:46:00.726 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2021-11-03T16:46:00.726 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: 2021-11-03T16:46:00.726 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2021-11-03T16:46:00.727 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-11-03T16:46:00.727 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-11-03T16:46:00.727 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-11-03T16:46:00.727 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-11-03T16:46:00.728 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: 2021-11-03T16:46:00.728 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2021-11-03T16:46:00.728 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-11-03T16:46:00.728 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-11-03T16:46:00.729 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2021-11-03T16:46:00.729 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2021-11-03T16:46:00.729 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2021-11-03T16:46:00.729 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2021-11-03T16:46:00.730 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2021-11-03T16:46:00.730 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2021-11-03T16:46:00.730 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-11-03T16:46:00.730 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-11-03T16:46:00.730 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-11-03T16:46:00.731 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: 2021-11-03T16:46:00.731 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2021-11-03T16:46:00.731 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: 2021-11-03T16:46:00.731 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.599+0000 7fed98aa1700 4 rocksdb: [db_impl/db_impl.cc:397] Shutdown: canceling all background work 2021-11-03T16:46:00.732 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.599+0000 7fed98aa1700 4 rocksdb: [db_impl/db_impl.cc:573] Shutdown complete 2021-11-03T16:46:00.732 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2021-11-03T16:46:00.599+0000 7fed98aa1700 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-smithi026 for mon.smithi026 2021-11-03T16:46:01.251 INFO:teuthology.orchestra.run.smithi026.stderr:create mon.smithi026 on 2021-11-03T16:46:01.251 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: install -d -m0770 -o 167 -g 167 /var/run/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c 2021-11-03T16:46:01.258 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: systemctl disable ceph.target 2021-11-03T16:46:01.265 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2021-11-03T16:46:01.352 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: systemctl enable ceph.target 2021-11-03T16:46:01.359 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2021-11-03T16:46:01.441 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: systemctl start ceph.target 2021-11-03T16:46:01.448 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: systemctl enable ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c.target 2021-11-03T16:46:01.454 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c.target → /etc/systemd/system/ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c.target. 2021-11-03T16:46:01.454 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: Created symlink /etc/systemd/system/ceph.target.wants/ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c.target → /etc/systemd/system/ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c.target. 2021-11-03T16:46:01.533 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: systemctl start ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c.target 2021-11-03T16:46:01.540 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: systemctl daemon-reload 2021-11-03T16:46:01.629 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: systemctl stop ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c@mon.smithi026 2021-11-03T16:46:01.654 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: systemctl reset-failed ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c@mon.smithi026 2021-11-03T16:46:01.660 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: Failed to reset failed state of unit ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c@mon.smithi026.service: Unit ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c@mon.smithi026.service not loaded. 2021-11-03T16:46:01.660 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: systemctl enable ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c@mon.smithi026 2021-11-03T16:46:01.666 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: Created symlink /etc/systemd/system/ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c.target.wants/ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c@mon.smithi026.service → /etc/systemd/system/ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c@.service. 2021-11-03T16:46:01.751 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: systemctl start ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c@mon.smithi026 2021-11-03T16:46:01.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:01 smithi026 systemd[1]: Starting Ceph mon.smithi026 for 70492bc6-3cc5-11ec-8c28-001a4aab830c... 2021-11-03T16:46:02.237 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: systemctl is-enabled firewalld.service 2021-11-03T16:46:02.245 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: disabled 2021-11-03T16:46:02.245 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: systemctl is-active firewalld.service 2021-11-03T16:46:02.252 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: inactive 2021-11-03T16:46:02.253 INFO:teuthology.orchestra.run.smithi026.stderr:firewalld.service is not enabled 2021-11-03T16:46:02.253 INFO:teuthology.orchestra.run.smithi026.stderr:Not possible to enable service . firewalld.service is not available 2021-11-03T16:46:02.253 INFO:teuthology.orchestra.run.smithi026.stderr:Not possible to open ports <[]>. firewalld.service is not available 2021-11-03T16:46:02.254 INFO:teuthology.orchestra.run.smithi026.stderr:Waiting for mon to start... 2021-11-03T16:46:02.254 INFO:teuthology.orchestra.run.smithi026.stderr:Waiting for mon... 2021-11-03T16:46:02.255 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi026 -e CEPH_USE_RANDOM_NONCE=1 -v /var/lib/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c/mon.smithi026:/var/lib/ceph/mon/ceph-smithi026:z -v /tmp/ceph-tmprh0b9ciq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpg6zn56v0:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 status 2021-11-03T16:46:02.505 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:02 smithi026 bash[31279]: dbaae8c69b99a6a96635011632633bf3cc6e0f4ac801ce09baa0fccefb98fe24 2021-11-03T16:46:02.505 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:02 smithi026 conmon[31396]: cluster 2021-11-03T16:46:02.236021+0000 mon.smithi026 (mon.0) 0 : [INF] mkfs 70492bc6-3cc5-11ec-8c28-001a4aab830c 2021-11-03T16:46:02.505 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:02 smithi026 conmon[31396]: cluster 2021-11-03T16:46: 2021-11-03T16:46:02.506 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:02 smithi026 conmon[31396]: 02.232636+0000 mon.smithi026 (mon.0) 1 : cluster [INF] mon.smithi026 is new leader, mons smithi026 in quorum (ranks 0) 2021-11-03T16:46:02.506 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:02 smithi026 systemd[1]: Started Ceph mon.smithi026 for 70492bc6-3cc5-11ec-8c28-001a4aab830c. 2021-11-03T16:46:02.915 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:02.914+0000 7f5154313700 1 Processor -- start 2021-11-03T16:46:02.916 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:02.915+0000 7f5154313700 1 -- start start 2021-11-03T16:46:02.916 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:02.915+0000 7f5154313700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f514c0fc1f0 0x7f514c0fc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:02.916 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:02.915+0000 7f5154313700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514c0fcb00 con 0x7f514c0fc1f0 2021-11-03T16:46:02.917 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:02.915+0000 7f51520af700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f514c0fc1f0 0x7f514c0fc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:02.917 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:02.915+0000 7f51520af700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f514c0fc1f0 0x7f514c0fc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49048/0 (socket says 172.21.15.26:49048) 2021-11-03T16:46:02.917 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:02.915+0000 7f51520af700 1 -- 172.21.15.26:0/4080683075 learned_addr learned my addr 172.21.15.26:0/4080683075 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:02.917 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:02.916+0000 7f51520af700 1 -- 172.21.15.26:0/4080683075 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514c0fcc40 con 0x7f514c0fc1f0 2021-11-03T16:46:02.917 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:02.916+0000 7f51520af700 1 --2- 172.21.15.26:0/4080683075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f514c0fc1f0 0x7f514c0fc610 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f513c00b5f0 tx=0x7f513c006ee0).ready entity=mon.0 client_cookie=68265a4c3b4cb10b server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:02.918 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:02.916+0000 7f51510ad700 1 -- 172.21.15.26:0/4080683075 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f513c00d600 con 0x7f514c0fc1f0 2021-11-03T16:46:02.918 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:02.916+0000 7f51510ad700 1 -- 172.21.15.26:0/4080683075 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513c00d760 con 0x7f514c0fc1f0 2021-11-03T16:46:02.918 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:02.916+0000 7f51510ad700 1 -- 172.21.15.26:0/4080683075 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f513c00da30 con 0x7f514c0fc1f0 2021-11-03T16:46:02.918 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:02.916+0000 7f5154313700 1 -- 172.21.15.26:0/4080683075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f514c0fc1f0 msgr2=0x7f514c0fc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:02.919 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:02.916+0000 7f5154313700 1 --2- 172.21.15.26:0/4080683075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f514c0fc1f0 0x7f514c0fc610 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f513c00b5f0 tx=0x7f513c006ee0).stop 2021-11-03T16:46:02.919 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:02.917+0000 7f5154313700 1 -- 172.21.15.26:0/4080683075 shutdown_connections 2021-11-03T16:46:02.919 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:02.917+0000 7f5154313700 1 --2- 172.21.15.26:0/4080683075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f514c0fc1f0 0x7f514c0fc610 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:02.919 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:02.917+0000 7f5154313700 1 -- 172.21.15.26:0/4080683075 >> 172.21.15.26:0/4080683075 conn(0x7f514c0f5a60 msgr2=0x7f514c0f7e80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:02.920 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:02.917+0000 7f5154313700 1 -- 172.21.15.26:0/4080683075 shutdown_connections 2021-11-03T16:46:02.920 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:02.917+0000 7f5154313700 1 -- 172.21.15.26:0/4080683075 wait complete. 2021-11-03T16:46:02.920 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:02.917+0000 7f5154313700 1 Processor -- start 2021-11-03T16:46:02.920 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:02.917+0000 7f5154313700 1 -- start start 2021-11-03T16:46:02.920 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:02.917+0000 7f5154313700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f514c0fc1f0 0x7f514c10c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:02.921 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:02.917+0000 7f5154313700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514c10c9a0 con 0x7f514c0fc1f0 2021-11-03T16:46:02.921 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:02.917+0000 7f51520af700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f514c0fc1f0 0x7f514c10c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:02.921 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:02.917+0000 7f51520af700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f514c0fc1f0 0x7f514c10c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49050/0 (socket says 172.21.15.26:49050) 2021-11-03T16:46:02.921 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:02.917+0000 7f51520af700 1 -- 172.21.15.26:0/1275455126 learned_addr learned my addr 172.21.15.26:0/1275455126 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:02.922 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:02.918+0000 7f51520af700 1 -- 172.21.15.26:0/1275455126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f513c00b200 con 0x7f514c0fc1f0 2021-11-03T16:46:02.922 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:02.918+0000 7f51520af700 1 --2- 172.21.15.26:0/1275455126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f514c0fc1f0 0x7f514c10c4b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f513c006c70 tx=0x7f513c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:02.922 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:02.918+0000 7f513affd700 1 -- 172.21.15.26:0/1275455126 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f513c011b40 con 0x7f514c0fc1f0 2021-11-03T16:46:02.922 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:02.918+0000 7f513affd700 1 -- 172.21.15.26:0/1275455126 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513c011ca0 con 0x7f514c0fc1f0 2021-11-03T16:46:02.923 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:02.918+0000 7f513affd700 1 -- 172.21.15.26:0/1275455126 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f513c01d430 con 0x7f514c0fc1f0 2021-11-03T16:46:02.923 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:02.918+0000 7f5154313700 1 -- 172.21.15.26:0/1275455126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f514c10cba0 con 0x7f514c0fc1f0 2021-11-03T16:46:02.923 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:02.918+0000 7f5154313700 1 -- 172.21.15.26:0/1275455126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f514c10d030 con 0x7f514c0fc1f0 2021-11-03T16:46:02.923 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:02.918+0000 7f513affd700 1 -- 172.21.15.26:0/1275455126 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f513c00f070 con 0x7f514c0fc1f0 2021-11-03T16:46:02.923 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:02.918+0000 7f513affd700 1 -- 172.21.15.26:0/1275455126 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f513c01dbc0 con 0x7f514c0fc1f0 2021-11-03T16:46:02.924 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:02.919+0000 7f5154313700 1 -- 172.21.15.26:0/1275455126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f514c045ad0 con 0x7f514c0fc1f0 2021-11-03T16:46:02.924 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:02.922+0000 7f513affd700 1 -- 172.21.15.26:0/1275455126 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7f513c016070 con 0x7f514c0fc1f0 2021-11-03T16:46:03.047 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:03.045+0000 7f5154313700 1 -- 172.21.15.26:0/1275455126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f514c101510 con 0x7f514c0fc1f0 2021-11-03T16:46:03.048 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:03.046+0000 7f513affd700 1 -- 172.21.15.26:0/1275455126 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f513c01d6a0 con 0x7f514c0fc1f0 2021-11-03T16:46:03.048 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: cluster: 2021-11-03T16:46:03.049 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: id: 70492bc6-3cc5-11ec-8c28-001a4aab830c 2021-11-03T16:46:03.050 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: health: HEALTH_OK 2021-11-03T16:46:03.050 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:03.051 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: services: 2021-11-03T16:46:03.051 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: mon: 1 daemons, quorum smithi026 (age 0.812025s) 2021-11-03T16:46:03.051 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: mgr: no daemons active 2021-11-03T16:46:03.052 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: osd: 0 osds: 0 up, 0 in 2021-11-03T16:46:03.052 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:03.053 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: data: 2021-11-03T16:46:03.053 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: pools: 0 pools, 0 pgs 2021-11-03T16:46:03.054 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: objects: 0 objects, 0 B 2021-11-03T16:46:03.054 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: usage: 0 B used, 0 B / 0 B avail 2021-11-03T16:46:03.054 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: pgs: 2021-11-03T16:46:03.055 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:03.055 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:03.046+0000 7f5154313700 1 -- 172.21.15.26:0/1275455126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f514c0fc1f0 msgr2=0x7f514c10c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:03.056 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:03.046+0000 7f5154313700 1 --2- 172.21.15.26:0/1275455126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f514c0fc1f0 0x7f514c10c4b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f513c006c70 tx=0x7f513c016000).stop 2021-11-03T16:46:03.056 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:03.046+0000 7f5154313700 1 -- 172.21.15.26:0/1275455126 shutdown_connections 2021-11-03T16:46:03.057 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:03.046+0000 7f5154313700 1 --2- 172.21.15.26:0/1275455126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f514c0fc1f0 0x7f514c10c4b0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:03.057 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:03.046+0000 7f5154313700 1 -- 172.21.15.26:0/1275455126 >> 172.21.15.26:0/1275455126 conn(0x7f514c0f5a60 msgr2=0x7f514c0f7730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:03.058 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:03.047+0000 7f5154313700 1 -- 172.21.15.26:0/1275455126 shutdown_connections 2021-11-03T16:46:03.058 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:03.047+0000 7f5154313700 1 -- 172.21.15.26:0/1275455126 wait complete. 2021-11-03T16:46:03.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:03 smithi026 conmon[31396]: cluster 2021-11-03T16:46:02.235595+0000 2021-11-03T16:46:03.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:03 smithi026 conmon[31396]: mon.smithi026 (mon.0) 2 : cluster [INF] mon.smithi026 is new leader, mons smithi026 in quorum (ranks 0) 2021-11-03T16:46:03.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:03 smithi026 conmon[31396]: cluster 2021-11-03T16:46:02.235718+0000 mon.smithi026 (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {smithi026=[v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0]} 2021-11-03T16:46:03.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:03 smithi026 conmon[31396]: cluster 2021-11-03T16:46:02.237139+0000 mon.smithi026 (mon.0) 4 : cluster [DBG] fsmap 2021-11-03T16:46:03.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:03 smithi026 conmon[31396]: cluster 2021-11-03T16:46:02.238974+0000 mon.smithi026 (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2021-11-03T16:46:03.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:03 smithi026 conmon[31396]: cluster 2021-11-03T16:46:02.239303+0000 mon.smithi026 (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active 2021-11-03T16:46:03.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:03 smithi026 conmon[31396]: audit 2021-11-03T16:46:03.047586+0000 mon.smithi026 (mon.0) 7 : audit [DBG] from='client.? 172.21.15.26:0/1275455126' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2021-11-03T16:46:03.803 INFO:teuthology.orchestra.run.smithi026.stderr:mon is available 2021-11-03T16:46:03.803 INFO:teuthology.orchestra.run.smithi026.stderr:Assimilating anything we can from ceph.conf... 2021-11-03T16:46:03.803 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi026 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprh0b9ciq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpg6zn56v0:/etc/ceph/ceph.conf:z -v /var/lib/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c/mon.smithi026:/var/lib/ceph/mon/ceph-smithi026:z docker.io/ceph/ceph:v16.2.4 config assimilate-conf -i /var/lib/ceph/mon/ceph-smithi026/config 2021-11-03T16:46:04.489 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.488+0000 7f301c2b9700 1 Processor -- start 2021-11-03T16:46:04.490 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.488+0000 7f301c2b9700 1 -- start start 2021-11-03T16:46:04.490 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.488+0000 7f301c2b9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30140fbba0 0x7f30140fbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:04.491 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.489+0000 7f301c2b9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30140fc4b0 con 0x7f30140fbba0 2021-11-03T16:46:04.491 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.489+0000 7f301a055700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30140fbba0 0x7f30140fbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:04.491 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.489+0000 7f301a055700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30140fbba0 0x7f30140fbfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49052/0 (socket says 172.21.15.26:49052) 2021-11-03T16:46:04.491 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.489+0000 7f301a055700 1 -- 172.21.15.26:0/1671995914 learned_addr learned my addr 172.21.15.26:0/1671995914 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:04.492 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.489+0000 7f301a055700 1 -- 172.21.15.26:0/1671995914 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30140fc5f0 con 0x7f30140fbba0 2021-11-03T16:46:04.494 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.489+0000 7f301a055700 1 --2- 172.21.15.26:0/1671995914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30140fbba0 0x7f30140fbfc0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f300c00b5f0 tx=0x7f300c006ee0).ready entity=mon.0 client_cookie=94287127859a4f6f server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:04.494 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.489+0000 7f3019053700 1 -- 172.21.15.26:0/1671995914 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f300c00d600 con 0x7f30140fbba0 2021-11-03T16:46:04.495 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.490+0000 7f3019053700 1 -- 172.21.15.26:0/1671995914 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f300c00d760 con 0x7f30140fbba0 2021-11-03T16:46:04.495 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.490+0000 7f3019053700 1 -- 172.21.15.26:0/1671995914 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f300c00da30 con 0x7f30140fbba0 2021-11-03T16:46:04.496 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.490+0000 7f301c2b9700 1 -- 172.21.15.26:0/1671995914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30140fbba0 msgr2=0x7f30140fbfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:04.496 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.490+0000 7f301c2b9700 1 --2- 172.21.15.26:0/1671995914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30140fbba0 0x7f30140fbfc0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f300c00b5f0 tx=0x7f300c006ee0).stop 2021-11-03T16:46:04.496 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.490+0000 7f301c2b9700 1 -- 172.21.15.26:0/1671995914 shutdown_connections 2021-11-03T16:46:04.496 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.490+0000 7f301c2b9700 1 --2- 172.21.15.26:0/1671995914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30140fbba0 0x7f30140fbfc0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:04.497 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.490+0000 7f301c2b9700 1 -- 172.21.15.26:0/1671995914 >> 172.21.15.26:0/1671995914 conn(0x7f30140f73e0 msgr2=0x7f30140f9800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:04.497 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.490+0000 7f301c2b9700 1 -- 172.21.15.26:0/1671995914 shutdown_connections 2021-11-03T16:46:04.497 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.490+0000 7f301c2b9700 1 -- 172.21.15.26:0/1671995914 wait complete. 2021-11-03T16:46:04.497 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.491+0000 7f301c2b9700 1 Processor -- start 2021-11-03T16:46:04.498 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.491+0000 7f301c2b9700 1 -- start start 2021-11-03T16:46:04.498 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.491+0000 7f301c2b9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30140fbba0 0x7f3014071d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:04.498 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.491+0000 7f301c2b9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3014070180 con 0x7f30140fbba0 2021-11-03T16:46:04.498 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.491+0000 7f301a055700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30140fbba0 0x7f3014071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:04.499 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.491+0000 7f301a055700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30140fbba0 0x7f3014071d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49054/0 (socket says 172.21.15.26:49054) 2021-11-03T16:46:04.499 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.491+0000 7f301a055700 1 -- 172.21.15.26:0/1135422843 learned_addr learned my addr 172.21.15.26:0/1135422843 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:04.499 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.491+0000 7f301a055700 1 -- 172.21.15.26:0/1135422843 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f300c00b200 con 0x7f30140fbba0 2021-11-03T16:46:04.499 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.491+0000 7f301a055700 1 --2- 172.21.15.26:0/1135422843 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30140fbba0 0x7f3014071d00 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f300c006c70 tx=0x7f300c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:04.499 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.492+0000 7f3012ffd700 1 -- 172.21.15.26:0/1135422843 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f300c011b40 con 0x7f30140fbba0 2021-11-03T16:46:04.500 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.492+0000 7f3012ffd700 1 -- 172.21.15.26:0/1135422843 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f300c011ca0 con 0x7f30140fbba0 2021-11-03T16:46:04.500 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.492+0000 7f3012ffd700 1 -- 172.21.15.26:0/1135422843 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f300c01d430 con 0x7f30140fbba0 2021-11-03T16:46:04.501 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.492+0000 7f301c2b9700 1 -- 172.21.15.26:0/1135422843 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3014070320 con 0x7f30140fbba0 2021-11-03T16:46:04.501 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.492+0000 7f301c2b9700 1 -- 172.21.15.26:0/1135422843 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30140707b0 con 0x7f30140fbba0 2021-11-03T16:46:04.501 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.492+0000 7f3012ffd700 1 -- 172.21.15.26:0/1135422843 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f300c00f070 con 0x7f30140fbba0 2021-11-03T16:46:04.501 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.492+0000 7f3012ffd700 1 -- 172.21.15.26:0/1135422843 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f300c01dbc0 con 0x7f30140fbba0 2021-11-03T16:46:04.501 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.493+0000 7f301c2b9700 1 -- 172.21.15.26:0/1135422843 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3014045ad0 con 0x7f30140fbba0 2021-11-03T16:46:04.502 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.495+0000 7f3012ffd700 1 -- 172.21.15.26:0/1135422843 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7f300c016070 con 0x7f30140fbba0 2021-11-03T16:46:04.611 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.614+0000 7f301c2b9700 1 -- 172.21.15.26:0/1135422843 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f30140fcee0 con 0x7f30140fbba0 2021-11-03T16:46:04.618 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.617+0000 7f3012ffd700 1 -- 172.21.15.26:0/1135422843 <== mon.0 v2:172.21.15.26:3300/0 7 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f300c01d680 con 0x7f30140fbba0 2021-11-03T16:46:04.619 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.617+0000 7f3012ffd700 1 -- 172.21.15.26:0/1135422843 <== mon.0 v2:172.21.15.26:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+489 (secure 0 0 0) 0x7f300c035350 con 0x7f30140fbba0 2021-11-03T16:46:04.619 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.619 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: [global] 2021-11-03T16:46:04.620 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: fsid = 70492bc6-3cc5-11ec-8c28-001a4aab830c 2021-11-03T16:46:04.620 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: log_to_journald = false 2021-11-03T16:46:04.620 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: mon_host = [v2:172.21.15.26:3300,v1:172.21.15.26:6789] 2021-11-03T16:46:04.620 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2021-11-03T16:46:04.621 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2021-11-03T16:46:04.621 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2021-11-03T16:46:04.621 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2021-11-03T16:46:04.621 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.622 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: [mgr] 2021-11-03T16:46:04.622 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2021-11-03T16:46:04.622 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.622 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: [osd] 2021-11-03T16:46:04.622 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: mon_osd_backfillfull_ratio = 0.85 2021-11-03T16:46:04.623 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: mon_osd_full_ratio = 0.9 2021-11-03T16:46:04.623 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: mon_osd_nearfull_ratio = 0.8 2021-11-03T16:46:04.623 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2021-11-03T16:46:04.623 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: osd_memory_target_autotune = true 2021-11-03T16:46:04.624 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2021-11-03T16:46:04.624 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.618+0000 7f301c2b9700 1 -- 172.21.15.26:0/1135422843 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30140fbba0 msgr2=0x7f3014071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:04.624 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.618+0000 7f301c2b9700 1 --2- 172.21.15.26:0/1135422843 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30140fbba0 0x7f3014071d00 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f300c006c70 tx=0x7f300c016000).stop 2021-11-03T16:46:04.624 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.618+0000 7f301c2b9700 1 -- 172.21.15.26:0/1135422843 shutdown_connections 2021-11-03T16:46:04.625 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.618+0000 7f301c2b9700 1 --2- 172.21.15.26:0/1135422843 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30140fbba0 0x7f3014071d00 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:04.625 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.618+0000 7f301c2b9700 1 -- 172.21.15.26:0/1135422843 >> 172.21.15.26:0/1135422843 conn(0x7f30140f73e0 msgr2=0x7f30140fe9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:04.625 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.619+0000 7f301c2b9700 1 -- 172.21.15.26:0/1135422843 shutdown_connections 2021-11-03T16:46:04.625 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:04.619+0000 7f301c2b9700 1 -- 172.21.15.26:0/1135422843 wait complete. 2021-11-03T16:46:04.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:04 smithi026 conmon[31396]: audit 2021-11-03T16:46:04. 2021-11-03T16:46:04.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:04 smithi026 conmon[31396]: 616345+0000 mon.smithi026 (mon.0) 8 : audit [INF] from='client.? 172.21.15.26:0/1135422843' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2021-11-03T16:46:04.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:04 smithi026 conmon[31396]: audit 2021-11-03T16:46:04.619384+0000 mon.smithi026 (mon.0) 9 : audit [INF] from='client.? 172.21.15.26:0/1135422843' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2021-11-03T16:46:05.198 INFO:teuthology.orchestra.run.smithi026.stderr:Generating new minimal ceph.conf... 2021-11-03T16:46:05.198 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi026 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprh0b9ciq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpg6zn56v0:/etc/ceph/ceph.conf:z -v /var/lib/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c/mon.smithi026:/var/lib/ceph/mon/ceph-smithi026:z docker.io/ceph/ceph:v16.2.4 config generate-minimal-conf -o /var/lib/ceph/mon/ceph-smithi026/config 2021-11-03T16:46:05.880 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:05.880+0000 7fc20af35700 1 Processor -- start 2021-11-03T16:46:05.880 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:05.880+0000 7fc20af35700 1 -- start start 2021-11-03T16:46:05.881 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:05.880+0000 7fc20af35700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2040fd2a0 0x7fc2040fd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:05.881 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:05.880+0000 7fc20af35700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2040fdbb0 con 0x7fc2040fd2a0 2021-11-03T16:46:05.881 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:05.880+0000 7fc208cd1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2040fd2a0 0x7fc2040fd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:05.881 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:05.880+0000 7fc208cd1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2040fd2a0 0x7fc2040fd6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49056/0 (socket says 172.21.15.26:49056) 2021-11-03T16:46:05.882 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:05.880+0000 7fc208cd1700 1 -- 172.21.15.26:0/2147111455 learned_addr learned my addr 172.21.15.26:0/2147111455 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:05.882 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:05.881+0000 7fc208cd1700 1 -- 172.21.15.26:0/2147111455 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2040fdcf0 con 0x7fc2040fd2a0 2021-11-03T16:46:05.882 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:05.881+0000 7fc208cd1700 1 --2- 172.21.15.26:0/2147111455 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2040fd2a0 0x7fc2040fd6c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fc1f800b5f0 tx=0x7fc1f8006ee0).ready entity=mon.0 client_cookie=d17b58f9ac32cbfc server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:05.882 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:05.881+0000 7fc2037fe700 1 -- 172.21.15.26:0/2147111455 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc1f800d600 con 0x7fc2040fd2a0 2021-11-03T16:46:05.883 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:05.881+0000 7fc2037fe700 1 -- 172.21.15.26:0/2147111455 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7fc1f800dbb0 con 0x7fc2040fd2a0 2021-11-03T16:46:05.883 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:05.881+0000 7fc2037fe700 1 -- 172.21.15.26:0/2147111455 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc1f8011bb0 con 0x7fc2040fd2a0 2021-11-03T16:46:05.883 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:05.881+0000 7fc20af35700 1 -- 172.21.15.26:0/2147111455 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2040fd2a0 msgr2=0x7fc2040fd6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:05.883 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:05.881+0000 7fc20af35700 1 --2- 172.21.15.26:0/2147111455 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2040fd2a0 0x7fc2040fd6c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fc1f800b5f0 tx=0x7fc1f8006ee0).stop 2021-11-03T16:46:05.883 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:05.882+0000 7fc20af35700 1 -- 172.21.15.26:0/2147111455 shutdown_connections 2021-11-03T16:46:05.884 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:05.882+0000 7fc20af35700 1 --2- 172.21.15.26:0/2147111455 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2040fd2a0 0x7fc2040fd6c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:05.884 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:05.882+0000 7fc20af35700 1 -- 172.21.15.26:0/2147111455 >> 172.21.15.26:0/2147111455 conn(0x7fc2040f5a60 msgr2=0x7fc2040f7e80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:05.884 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:05.882+0000 7fc20af35700 1 -- 172.21.15.26:0/2147111455 shutdown_connections 2021-11-03T16:46:05.884 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:05.882+0000 7fc20af35700 1 -- 172.21.15.26:0/2147111455 wait complete. 2021-11-03T16:46:05.885 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:05.882+0000 7fc20af35700 1 Processor -- start 2021-11-03T16:46:05.885 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:05.882+0000 7fc20af35700 1 -- start start 2021-11-03T16:46:05.885 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:05.883+0000 7fc20af35700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2040fd2a0 0x7fc20410a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:05.885 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:05.883+0000 7fc20af35700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20410ae40 con 0x7fc2040fd2a0 2021-11-03T16:46:05.885 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:05.883+0000 7fc208cd1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2040fd2a0 0x7fc20410a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:05.886 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:05.883+0000 7fc208cd1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2040fd2a0 0x7fc20410a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49058/0 (socket says 172.21.15.26:49058) 2021-11-03T16:46:05.886 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:05.883+0000 7fc208cd1700 1 -- 172.21.15.26:0/928277816 learned_addr learned my addr 172.21.15.26:0/928277816 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:05.886 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:05.883+0000 7fc208cd1700 1 -- 172.21.15.26:0/928277816 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f800b200 con 0x7fc2040fd2a0 2021-11-03T16:46:05.886 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:05.883+0000 7fc208cd1700 1 --2- 172.21.15.26:0/928277816 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2040fd2a0 0x7fc20410a950 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fc1f8003000 tx=0x7fc1f8006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:05.887 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:05.883+0000 7fc2017fa700 1 -- 172.21.15.26:0/928277816 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc1f8011e30 con 0x7fc2040fd2a0 2021-11-03T16:46:05.888 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:05.883+0000 7fc2017fa700 1 -- 172.21.15.26:0/928277816 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7fc1f800d9c0 con 0x7fc2040fd2a0 2021-11-03T16:46:05.888 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:05.883+0000 7fc20af35700 1 -- 172.21.15.26:0/928277816 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc20410b040 con 0x7fc2040fd2a0 2021-11-03T16:46:05.888 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:05.883+0000 7fc2017fa700 1 -- 172.21.15.26:0/928277816 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc1f801b740 con 0x7fc2040fd2a0 2021-11-03T16:46:05.888 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:05.883+0000 7fc20af35700 1 -- 172.21.15.26:0/928277816 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc20410b4d0 con 0x7fc2040fd2a0 2021-11-03T16:46:05.889 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:05.884+0000 7fc2017fa700 1 -- 172.21.15.26:0/928277816 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7fc1f800f070 con 0x7fc2040fd2a0 2021-11-03T16:46:05.889 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:05.884+0000 7fc2017fa700 1 -- 172.21.15.26:0/928277816 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fc1f8024b50 con 0x7fc2040fd2a0 2021-11-03T16:46:05.889 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:05.885+0000 7fc20af35700 1 -- 172.21.15.26:0/928277816 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc204045ad0 con 0x7fc2040fd2a0 2021-11-03T16:46:05.889 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:05.887+0000 7fc2017fa700 1 -- 172.21.15.26:0/928277816 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7fc1f8016070 con 0x7fc2040fd2a0 2021-11-03T16:46:06.003 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:06.006+0000 7fc20af35700 1 -- 172.21.15.26:0/928277816 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fc2040fa5f0 con 0x7fc2040fd2a0 2021-11-03T16:46:06.003 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:06.007+0000 7fc2017fa700 1 -- 172.21.15.26:0/928277816 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7fc1f8024d90 con 0x7fc2040fd2a0 2021-11-03T16:46:06.005 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:06.007+0000 7fc20af35700 1 -- 172.21.15.26:0/928277816 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2040fd2a0 msgr2=0x7fc20410a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:06.005 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:06.007+0000 7fc20af35700 1 --2- 172.21.15.26:0/928277816 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2040fd2a0 0x7fc20410a950 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fc1f8003000 tx=0x7fc1f8006ee0).stop 2021-11-03T16:46:06.006 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:06.008+0000 7fc20af35700 1 -- 172.21.15.26:0/928277816 shutdown_connections 2021-11-03T16:46:06.006 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:06.008+0000 7fc20af35700 1 --2- 172.21.15.26:0/928277816 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2040fd2a0 0x7fc20410a950 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:06.006 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:06.008+0000 7fc20af35700 1 -- 172.21.15.26:0/928277816 >> 172.21.15.26:0/928277816 conn(0x7fc2040f5a60 msgr2=0x7fc2040ff1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:06.007 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:06.008+0000 7fc20af35700 1 -- 172.21.15.26:0/928277816 shutdown_connections 2021-11-03T16:46:06.007 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:06.008+0000 7fc20af35700 1 -- 172.21.15.26:0/928277816 wait complete. 2021-11-03T16:46:06.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:06 smithi026 conmon[31396]: audit 2021-11-03T16:46:06.008427+0000 2021-11-03T16:46:06.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:06 smithi026 conmon[31396]: mon.smithi026 (mon.0) 10 : audit [DBG] from='client.? 172.21.15.26:0/928277816' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:46:06.573 INFO:teuthology.orchestra.run.smithi026.stderr:Restarting the monitor... 2021-11-03T16:46:06.573 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: systemctl restart ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c@mon.smithi026 2021-11-03T16:46:06.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:06 smithi026 systemd[1]: Stopping Ceph mon.smithi026 for 70492bc6-3cc5-11ec-8c28-001a4aab830c... 2021-11-03T16:46:06.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:06 smithi026 conmon[31396]: debug 2021-11-03T16:46:06.690+0000 7fad5b4cc700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.smithi026 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2021-11-03T16:46:06.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:06 smithi026 conmon[31396]: debug 2021-11-03T16:46:06.690+0000 7fad5b4cc700 -1 mon.smithi026@0(leader) e1 *** Got Signal Terminated *** 2021-11-03T16:46:06.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:06 smithi026 conmon[31396]: 2021-11-03T16:46:07.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 podman[31900]: dbaae8c69b99a6a96635011632633bf3cc6e0f4ac801ce09baa0fccefb98fe24 2021-11-03T16:46:07.888 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 systemd[1]: ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c@mon.smithi026.service: Succeeded. 2021-11-03T16:46:07.889 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 systemd[1]: Stopped Ceph mon.smithi026 for 70492bc6-3cc5-11ec-8c28-001a4aab830c. 2021-11-03T16:46:07.889 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 systemd[1]: Starting Ceph mon.smithi026 for 70492bc6-3cc5-11ec-8c28-001a4aab830c... 2021-11-03T16:46:07.975 INFO:teuthology.orchestra.run.smithi026.stderr:Setting mon public_network to 172.21.0.0/20 2021-11-03T16:46:07.976 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi026 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprh0b9ciq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpg6zn56v0:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 config set mon public_network 172.21.0.0/20 2021-11-03T16:46:08.205 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.950+0000 7fee6e746700 0 set uid:gid to 167:167 (ceph:ceph) 2021-11-03T16:46:08.205 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.950+0000 7fee6e746700 0 ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable), process ceph-mon, pid 7 2021-11-03T16:46:08.206 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.950+0000 7fee6e746700 0 pidfile_write: ignore empty --pid-file 2021-11-03T16:46:08.206 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.954+0000 7fee6e746700 0 load: jerasure load: lrc load: isa 2021-11-03T16:46:08.206 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: RocksDB version: 6.8.1 2021-11-03T16:46:08.206 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: 2021-11-03T16:46:08.207 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-11-03T16:46:08.207 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:08.207 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Compile date May 13 2021 2021-11-03T16:46:08.207 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: DB SUMMARY 2021-11-03T16:46:08.208 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: 2021-11-03T16:46:08.208 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: CURRENT file: CURRENT 2021-11-03T16:46:08.209 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: 2021-11-03T16:46:08.209 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: IDENTITY file: IDENTITY 2021-11-03T16:46:08.209 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: 2021-11-03T16:46:08.209 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 131 Bytes 2021-11-03T16:46:08.210 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: 2021-11-03T16:46:08.210 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi026/store.db dir, Total Num: 1, files: 000004.sst 2021-11-03T16:46:08.210 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: 2021-11-03T16:46:08.210 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi026/store.db: 000006.log size: 97387 ; 2021-11-03T16:46:08.211 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: 2021-11-03T16:46:08.211 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.error_if_exists: 0 2021-11-03T16:46:08.211 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.create_if_missing: 0 2021-11-03T16:46:08.211 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.paranoid_checks: 1 2021-11-03T16:46:08.212 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.env: 0x55d19b3731c0 2021-11-03T16:46:08.212 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.fs: Posix File System 2021-11-03T16:46:08.212 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.info_log: 0x55d19c375960 2021-11-03T16:46:08.212 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.max_file_opening_threads: 16 2021-11-03T16:46:08.212 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.statistics: (nil) 2021-11-03T16:46:08.213 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.use_fsync: 0 2021-11-03T16:46:08.213 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.max_log_file_size: 0 2021-11-03T16:46:08.213 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-11-03T16:46:08.213 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-11-03T16:46:08.214 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: 2021-11-03T16:46:08.214 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.keep_log_file_num: 1000 2021-11-03T16:46:08.214 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.recycle_log_file_num: 0 2021-11-03T16:46:08.214 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.allow_fallocate: 1 2021-11-03T16:46:08.215 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.allow_mmap_reads: 0 2021-11-03T16:46:08.215 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.allow_mmap_writes: 0 2021-11-03T16:46:08.215 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.use_direct_reads: 0 2021-11-03T16:46:08.215 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-11-03T16:46:08.215 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.create_missing_column_families: 0 2021-11-03T16:46:08.216 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.db_log_dir: 2021-11-03T16:46:08.216 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi026/store.db 2021-11-03T16:46:08.216 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-11-03T16:46:08.216 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: 2021-11-03T16:46:08.217 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.max_subcompactions: 1 2021-11-03T16:46:08.217 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.max_background_flushes: -1 2021-11-03T16:46:08.217 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-11-03T16:46:08.217 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-11-03T16:46:08.217 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-11-03T16:46:08.218 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-11-03T16:46:08.218 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-11-03T16:46:08.218 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.advise_random_on_open: 1 2021-11-03T16:46:08.218 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.db_write_buffer_size: 0 2021-11-03T16:46:08.219 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.write_buffer_manager: 0x55d19cfea030 2021-11-03T16:46:08.219 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-11-03T16:46:08.219 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-11-03T16:46:08.219 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-11-03T16:46:08.220 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-11-03T16:46:08.220 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.rate_limiter: (nil) 2021-11-03T16:46:08.220 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-11-03T16:46:08.220 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.wal_recovery_mode: 2 2021-11-03T16:46:08.220 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.enable_thread_tracking: 0 2021-11-03T16:46:08.221 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.enable_pipelined_write: 0 2021-11-03T16:46:08.221 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.unordered_write: 0 2021-11-03T16:46:08.221 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-11-03T16:46:08.221 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-11-03T16:46:08.222 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-11-03T16:46:08.222 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-11-03T16:46:08.222 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.row_cache: None 2021-11-03T16:46:08.222 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.wal_filter: None 2021-11-03T16:46:08.223 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-11-03T16:46:08.223 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.allow_ingest_behind: 0 2021-11-03T16:46:08.223 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.preserve_deletes: 0 2021-11-03T16:46:08.223 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.two_write_queues: 0 2021-11-03T16:46:08.223 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: 2021-11-03T16:46:08.224 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.manual_wal_flush: 0 2021-11-03T16:46:08.224 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.atomic_flush: 0 2021-11-03T16:46:08.224 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-11-03T16:46:08.224 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-11-03T16:46:08.225 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-11-03T16:46:08.225 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.log_readahead_size: 0 2021-11-03T16:46:08.225 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-11-03T16:46:08.225 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.max_background_jobs: 2 2021-11-03T16:46:08.226 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.max_background_compactions: -1 2021-11-03T16:46:08.226 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-11-03T16:46:08.226 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-11-03T16:46:08.226 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-11-03T16:46:08.226 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.max_total_wal_size: 0 2021-11-03T16:46:08.227 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-11-03T16:46:08.227 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-11-03T16:46:08.227 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-11-03T16:46:08.227 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-11-03T16:46:08.228 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.max_open_files: -1 2021-11-03T16:46:08.228 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.bytes_per_sync: 0 2021-11-03T16:46:08.228 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-11-03T16:46:08.228 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-11-03T16:46:08.228 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.compaction_readahead_size: 0 2021-11-03T16:46:08.229 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Compression algorithms supported: 2021-11-03T16:46:08.229 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-11-03T16:46:08.229 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: kZSTD supported: 0 2021-11-03T16:46:08.229 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: kXpressCompression supported: 0 2021-11-03T16:46:08.230 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: kLZ4HCCompression supported: 1 2021-11-03T16:46:08.230 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: 2021-11-03T16:46:08.230 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: kLZ4Compression supported: 1 2021-11-03T16:46:08.230 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: kBZip2Compression supported: 0 2021-11-03T16:46:08.231 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: kZlibCompression supported: 1 2021-11-03T16:46:08.231 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: kSnappyCompression supported: 1 2021-11-03T16:46:08.231 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-11-03T16:46:08.231 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi026/store.db/MANIFEST-000005 2021-11-03T16:46:08.232 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: 2021-11-03T16:46:08.232 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-11-03T16:46:08.232 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: 2021-11-03T16:46:08.232 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-11-03T16:46:08.232 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.merge_operator: 2021-11-03T16:46:08.233 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.compaction_filter: None 2021-11-03T16:46:08.233 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.compaction_filter_factory: None 2021-11-03T16:46:08.234 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-11-03T16:46:08.235 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-11-03T16:46:08.235 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d19c286128) 2021-11-03T16:46:08.235 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: cache_index_and_filter_blocks: 1 2021-11-03T16:46:08.235 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: cache_index_and_filter_blocks_with_high_priority: 0 2021-11-03T16:46:08.236 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-11-03T16:46:08.236 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: pin_top_level_index_and_filter: 1 2021-11-03T16:46:08.236 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: index_type: 0 2021-11-03T16:46:08.236 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: data_block_index_type: 0 2021-11-03T16:46:08.236 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: index_shortening: 1 2021-11-03T16:46:08.237 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: data_block_hash_table_util_ratio: 0.750000 2021-11-03T16:46:08.237 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: hash_index_allow_collision: 1 2021-11-03T16:46:08.237 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: checksum: 1 2021-11-03T16:46:08.237 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: no_block_cache: 0 2021-11-03T16:46:08.238 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: block_cache: 0x55d19c2c0f10 2021-11-03T16:46:08.238 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: block_cache_name: BinnedLRUCache 2021-11-03T16:46:08.238 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: block_cache_options: 2021-11-03T16:46:08.238 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: capacity : 536870912 2021-11-03T16:46:08.238 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: num_shard_bits : 4 2021-11-03T16:46:08.239 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: strict_capacity_limit : 0 2021-11-03T16:46:08.239 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: high_pri_pool_ratio: 0.000 2021-11-03T16:46:08.239 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: block_cache_compressed: (nil) 2021-11-03T16:46:08.239 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: persistent_cache: (nil) 2021-11-03T16:46:08.240 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: block_size: 4096 2021-11-03T16:46:08.240 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: block_size_deviation: 10 2021-11-03T16:46:08.240 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: block_restart_interval: 16 2021-11-03T16:46:08.240 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: index_block_restart_interval: 1 2021-11-03T16:46:08.240 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: metadata_block_size: 4096 2021-11-03T16:46:08.241 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: partition_filters: 0 2021-11-03T16:46:08.241 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: use_delta_encoding: 1 2021-11-03T16:46:08.241 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: filter_policy: rocksdb.BuiltinBloomFilter 2021-11-03T16:46:08.241 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: whole_key_filtering: 1 2021-11-03T16:46:08.242 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: verify_compression: 0 2021-11-03T16:46:08.242 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: read_amp_bytes_per_bit: 0 2021-11-03T16:46:08.242 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: format_version: 2 2021-11-03T16:46:08.242 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: enable_index_compression: 1 2021-11-03T16:46:08.242 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: block_align: 0 2021-11-03T16:46:08.243 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: 2021-11-03T16:46:08.243 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.write_buffer_size: 33554432 2021-11-03T16:46:08.243 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.max_write_buffer_number: 2 2021-11-03T16:46:08.243 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.compression: NoCompression 2021-11-03T16:46:08.244 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.bottommost_compression: Disabled 2021-11-03T16:46:08.244 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.prefix_extractor: nullptr 2021-11-03T16:46:08.244 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-11-03T16:46:08.244 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.num_levels: 7 2021-11-03T16:46:08.244 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-11-03T16:46:08.245 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-11-03T16:46:08.245 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-11-03T16:46:08.245 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-11-03T16:46:08.245 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-11-03T16:46:08.246 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-11-03T16:46:08.246 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-11-03T16:46:08.246 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-11-03T16:46:08.246 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-11-03T16:46:08.246 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-11-03T16:46:08.247 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.compression_opts.level: 32767 2021-11-03T16:46:08.247 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.compression_opts.strategy: 0 2021-11-03T16:46:08.247 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-11-03T16:46:08.247 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-11-03T16:46:08.248 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.compression_opts.enabled: false 2021-11-03T16:46:08.248 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-11-03T16:46:08.248 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-11-03T16:46:08.248 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-11-03T16:46:08.248 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.target_file_size_base: 67108864 2021-11-03T16:46:08.249 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-11-03T16:46:08.249 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-11-03T16:46:08.249 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-11-03T16:46:08.249 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-11-03T16:46:08.250 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-11-03T16:46:08.250 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-11-03T16:46:08.250 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-11-03T16:46:08.250 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-11-03T16:46:08.250 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:08.251 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-11-03T16:46:08.251 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-11-03T16:46:08.251 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-11-03T16:46:08.251 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-11-03T16:46:08.252 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-11-03T16:46:08.252 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.arena_block_size: 4194304 2021-11-03T16:46:08.252 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-11-03T16:46:08.252 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-11-03T16:46:08.252 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-11-03T16:46:08.253 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.disable_auto_compactions: 0 2021-11-03T16:46:08.253 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-11-03T16:46:08.253 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-11-03T16:46:08.253 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-11-03T16:46:08.254 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-11-03T16:46:08.254 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-11-03T16:46:08.254 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-11-03T16:46:08.254 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-11-03T16:46:08.254 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-11-03T16:46:08.255 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-11-03T16:46:08.255 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-11-03T16:46:08.255 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.table_properties_collectors: 2021-11-03T16:46:08.255 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.inplace_update_support: 0 2021-11-03T16:46:08.256 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-11-03T16:46:08.256 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-11-03T16:46:08.256 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-11-03T16:46:08.256 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-11-03T16:46:08.256 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.bloom_locality: 0 2021-11-03T16:46:08.257 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.max_successive_merges: 0 2021-11-03T16:46:08.257 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-11-03T16:46:08.257 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.paranoid_file_checks: 0 2021-11-03T16:46:08.257 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.force_consistency_checks: 0 2021-11-03T16:46:08.258 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.report_bg_io_stats: 0 2021-11-03T16:46:08.258 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.ttl: 2592000 2021-11-03T16:46:08.258 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.955+0000 7fee6e746700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-11-03T16:46:08.258 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.956+0000 7fee6e746700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi026/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 5, log_number is 4,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-11-03T16:46:08.259 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: 2021-11-03T16:46:08.259 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.956+0000 7fee6e746700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 4 2021-11-03T16:46:08.259 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: 2021-11-03T16:46:08.259 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.956+0000 7fee6e746700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1635957967958071, "job": 1, "event": "recovery_started", "log_files": [6]} 2021-11-03T16:46:08.260 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:08.260 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: 2021-11-03T16:46:07.956+0000 7fee6e746700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #6 mode 2 2021-11-03T16:46:08.260 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.956+0000 7fee6e746700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-11-03T16:46:08.260 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.957+0000 7fee6e746700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1635957967958989, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 93057, "table_properties": {"data_size": 91157, "index_size": 377, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 709, "raw_key_size": 12317, "raw_average_key_size": 49, "raw_value_size": 84313, "raw_average_value_size": 337, "num_data_blocks": 12, "num_entries": 250, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1635957967, "oldest_key_time": 3, "file_creation_time": 0}} 2021-11-03T16:46:08.260 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.957+0000 7fee6e746700 4 rocksdb: [version_set.cc:3826] Creating manifest 8 2021-11-03T16:46:08.261 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: 2021-11-03T16:46:08.261 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.957+0000 7fee6e746700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1635957967959369, "job": 1, "event": "recovery_finished"} 2021-11-03T16:46:08.261 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.958+0000 7fee6e746700 4 rocksdb: DB pointer 0x55d19c387800 2021-11-03T16:46:08.261 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.958+0000 7fee5555e700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-11-03T16:46:08.262 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.958+0000 7fee5555e700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-11-03T16:46:08.262 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: ** DB Stats ** 2021-11-03T16:46:08.262 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: Uptime(secs): 0.0 total, 0.0 interval 2021-11-03T16:46:08.262 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-11-03T16:46:08.262 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-11-03T16:46:08.263 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-11-03T16:46:08.263 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-11-03T16:46:08.263 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-11-03T16:46:08.263 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-11-03T16:46:08.264 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: 2021-11-03T16:46:08.264 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: ** Compaction Stats [default] ** 2021-11-03T16:46:08.264 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-11-03T16:46:08.264 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-11-03T16:46:08.264 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: L0 2/0 92.57 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 147.9 0.00 0.00 1 0.001 0 0 2021-11-03T16:46:08.265 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: Sum 2/0 92.57 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 147.9 0.00 0.00 1 0.001 0 0 2021-11-03T16:46:08.265 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 147.9 0.00 0.00 1 0.001 0 0 2021-11-03T16:46:08.265 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: 2021-11-03T16:46:08.265 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: ** Compaction Stats [default] ** 2021-11-03T16:46:08.266 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-11-03T16:46:08.266 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-11-03T16:46:08.266 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 147.9 0.00 0.00 1 0.001 0 0 2021-11-03T16:46:08.266 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: Uptime(secs): 0.0 total, 0.0 interval 2021-11-03T16:46:08.266 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: Flush(GB): cumulative 0.000, interval 0.000 2021-11-03T16:46:08.267 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: AddFile(GB): cumulative 0.000, interval 0.000 2021-11-03T16:46:08.267 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: AddFile(Total Files): cumulative 0, interval 0 2021-11-03T16:46:08.267 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: AddFile(L0 Files): cumulative 0, interval 0 2021-11-03T16:46:08.267 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: AddFile(Keys): cumulative 0, interval 0 2021-11-03T16:46:08.268 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: Cumulative compaction: 0.00 GB write, 32.18 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-11-03T16:46:08.268 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: Interval compaction: 0.00 GB write, 32.18 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-11-03T16:46:08.268 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-11-03T16:46:08.268 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: 2021-11-03T16:46:08.268 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: ** File Read Latency Histogram By Level [default] ** 2021-11-03T16:46:08.269 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: 2021-11-03T16:46:08.269 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: ** Compaction Stats [default] ** 2021-11-03T16:46:08.269 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-11-03T16:46:08.269 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-11-03T16:46:08.270 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: L0 2/0 92.57 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 147.9 0.00 0.00 1 0.001 0 0 2021-11-03T16:46:08.270 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: Sum 2/0 92.57 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 147.9 0.00 0.00 1 0.001 0 0 2021-11-03T16:46:08.270 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-11-03T16:46:08.270 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: 2021-11-03T16:46:08.270 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: ** Compaction Stats [default] ** 2021-11-03T16:46:08.271 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-11-03T16:46:08.271 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-11-03T16:46:08.271 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 147.9 0.00 0.00 1 0.001 0 0 2021-11-03T16:46:08.271 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: Uptime(secs): 0.0 total, 0.0 interval 2021-11-03T16:46:08.272 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: Flush(GB): cumulative 0.000, interval 0.000 2021-11-03T16:46:08.272 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: AddFile(GB): cumulative 0.000, interval 0.000 2021-11-03T16:46:08.272 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: AddFile(Total Files): cumulative 0, interval 0 2021-11-03T16:46:08.272 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: AddFile(L0 Files): cumulative 0, interval 0 2021-11-03T16:46:08.272 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: AddFile(Keys): cumulative 0, interval 0 2021-11-03T16:46:08.273 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: Cumulative compaction: 0.00 GB write, 31.83 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-11-03T16:46:08.273 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-11-03T16:46:08.273 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-11-03T16:46:08.273 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: 2021-11-03T16:46:08.273 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: ** File Read Latency Histogram By Level [default] ** 2021-11-03T16:46:08.274 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: 2021-11-03T16:46:08.274 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.959+0000 7fee6e746700 0 starting mon.smithi026 rank 0 at public addrs [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] at bind addrs [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi026 fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c 2021-11-03T16:46:08.274 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.960+0000 7fee6e746700 1 mon.smithi026@-1(???) e1 preinit fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c 2021-11-03T16:46:08.274 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.960+0000 7fee6e746700 0 mon.smithi026@-1(???).mds e1 new map 2021-11-03T16:46:08.275 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.960+0000 7fee6e746700 0 mon.smithi026@-1(???).mds e1 print_map 2021-11-03T16:46:08.275 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: e1 2021-11-03T16:46:08.275 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T16:46:08.275 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T16:46:08.276 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: legacy client fscid: -1 2021-11-03T16:46:08.276 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: 2021-11-03T16:46:08.276 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: No filesystems configured 2021-11-03T16:46:08.276 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: 2021-11-03T16:46:08.276 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.960+0000 7fee6e746700 0 mon.smithi026@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2021-11-03T16:46:08.277 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.960+0000 7fee6e746700 0 mon.smithi026@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-11-03T16:46:08.277 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.960+0000 7fee6e746700 0 mon.smithi026@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-11-03T16:46:08.277 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.960+0000 7fee6e746700 0 mon.smithi026@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-11-03T16:46:08.277 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: audit 2021-11-03T16:46:08.277 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: 2021-11-03T16:46:06.008427+0000 mon.smithi026 (mon 2021-11-03T16:46:08.278 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: .0) 10 : audit [DBG] from='client.? 172.21.15.26:0/928277816' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:46:08.278 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 conmon[32119]: debug 2021-11-03T16:46:07.960+0000 7fee6e746700 1 mon.smithi026@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2021-11-03T16:46:08.278 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 bash[32004]: c37e5430889004c4495fb625c638c343510edc02bf9bc8fd957cd7655ecf3619 2021-11-03T16:46:08.278 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:07 smithi026 systemd[1]: Started Ceph mon.smithi026 for 70492bc6-3cc5-11ec-8c28-001a4aab830c. 2021-11-03T16:46:08.279 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:08 smithi026 conmon[32119]: cluster 2021-11-03T16:46:07.965591+0000 mon.smithi026 ( 2021-11-03T16:46:08.279 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:08 smithi026 conmon[32119]: mon.0) 1 : cluster [INF] mon.smithi026 is new leader, mons smithi026 in quorum (ranks 0) 2021-11-03T16:46:08.279 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:08 smithi026 conmon[32119]: cluster 2021-11-03T16:46:07.965644+0000 mon.smithi026 (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {smithi026=[v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0]} 2021-11-03T16:46:08.279 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:08 smithi026 conmon[32119]: cluster 2021-11-03T16:46:07.965680+0000 mon.smithi026 (mon.0) 3 : cluster [DBG] fsmap 2021-11-03T16:46:08.280 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:08 smithi026 conmon[32119]: cluster 2021-11-03T16:46:07.965706+0000 mon.smithi026 (mon.0) 4 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2021-11-03T16:46:08.280 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:08 smithi026 conmon[32119]: cluster 2021-11-03T16:46:07.966031+0000 mon.smithi026 (mon.0) 5 : cluster [DBG] mgrmap e1: no daemons active 2021-11-03T16:46:08.677 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.676+0000 7f503a2b1700 1 Processor -- start 2021-11-03T16:46:08.677 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.676+0000 7f503a2b1700 1 -- start start 2021-11-03T16:46:08.677 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.676+0000 7f503a2b1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f503406fb80 0x7f50340fe860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:08.678 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.676+0000 7f503a2b1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50340fed50 con 0x7f503406fb80 2021-11-03T16:46:08.678 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.677+0000 7f5033fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f503406fb80 0x7f50340fe860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:08.678 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.677+0000 7f5033fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f503406fb80 0x7f50340fe860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49060/0 (socket says 172.21.15.26:49060) 2021-11-03T16:46:08.678 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.677+0000 7f5033fff700 1 -- 172.21.15.26:0/874937085 learned_addr learned my addr 172.21.15.26:0/874937085 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:08.679 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.677+0000 7f5033fff700 1 -- 172.21.15.26:0/874937085 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50340fee90 con 0x7f503406fb80 2021-11-03T16:46:08.679 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.677+0000 7f5033fff700 1 --2- 172.21.15.26:0/874937085 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f503406fb80 0x7f50340fe860 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f502400b5f0 tx=0x7f5024006ee0).ready entity=mon.0 client_cookie=3104520c613cd2b1 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:08.679 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.677+0000 7f5032ffd700 1 -- 172.21.15.26:0/874937085 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f502400d600 con 0x7f503406fb80 2021-11-03T16:46:08.679 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.678+0000 7f5032ffd700 1 -- 172.21.15.26:0/874937085 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f502400dbb0 con 0x7f503406fb80 2021-11-03T16:46:08.680 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.678+0000 7f5032ffd700 1 -- 172.21.15.26:0/874937085 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5024011be0 con 0x7f503406fb80 2021-11-03T16:46:08.680 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.678+0000 7f503a2b1700 1 -- 172.21.15.26:0/874937085 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f503406fb80 msgr2=0x7f50340fe860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:08.680 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.678+0000 7f503a2b1700 1 --2- 172.21.15.26:0/874937085 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f503406fb80 0x7f50340fe860 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f502400b5f0 tx=0x7f5024006ee0).stop 2021-11-03T16:46:08.680 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.678+0000 7f503a2b1700 1 -- 172.21.15.26:0/874937085 shutdown_connections 2021-11-03T16:46:08.680 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.678+0000 7f503a2b1700 1 --2- 172.21.15.26:0/874937085 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f503406fb80 0x7f50340fe860 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:08.681 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.678+0000 7f503a2b1700 1 -- 172.21.15.26:0/874937085 >> 172.21.15.26:0/874937085 conn(0x7f50340f62e0 msgr2=0x7f50340f8700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:08.681 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.678+0000 7f503a2b1700 1 -- 172.21.15.26:0/874937085 shutdown_connections 2021-11-03T16:46:08.681 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.678+0000 7f503a2b1700 1 -- 172.21.15.26:0/874937085 wait complete. 2021-11-03T16:46:08.681 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.679+0000 7f503a2b1700 1 Processor -- start 2021-11-03T16:46:08.682 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.679+0000 7f503a2b1700 1 -- start start 2021-11-03T16:46:08.682 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.679+0000 7f503a2b1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f503406fb80 0x7f503410a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:08.682 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.679+0000 7f503a2b1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503410ae20 con 0x7f503406fb80 2021-11-03T16:46:08.683 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.679+0000 7f5033fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f503406fb80 0x7f503410a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:08.683 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.679+0000 7f5033fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f503406fb80 0x7f503410a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49062/0 (socket says 172.21.15.26:49062) 2021-11-03T16:46:08.683 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.679+0000 7f5033fff700 1 -- 172.21.15.26:0/978726316 learned_addr learned my addr 172.21.15.26:0/978726316 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:08.683 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.679+0000 7f5033fff700 1 -- 172.21.15.26:0/978726316 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f502400b200 con 0x7f503406fb80 2021-11-03T16:46:08.684 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.680+0000 7f5033fff700 1 --2- 172.21.15.26:0/978726316 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f503406fb80 0x7f503410a930 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f502400df80 tx=0x7f5024006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:08.684 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.680+0000 7f5030ff9700 1 -- 172.21.15.26:0/978726316 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5024011ba0 con 0x7f503406fb80 2021-11-03T16:46:08.684 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.680+0000 7f5030ff9700 1 -- 172.21.15.26:0/978726316 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f502401a9d0 con 0x7f503406fb80 2021-11-03T16:46:08.684 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.680+0000 7f503a2b1700 1 -- 172.21.15.26:0/978726316 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f503410b020 con 0x7f503406fb80 2021-11-03T16:46:08.684 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.680+0000 7f5030ff9700 1 -- 172.21.15.26:0/978726316 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f502401b8e0 con 0x7f503406fb80 2021-11-03T16:46:08.685 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.680+0000 7f503a2b1700 1 -- 172.21.15.26:0/978726316 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f503410b4b0 con 0x7f503406fb80 2021-11-03T16:46:08.685 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.680+0000 7f5030ff9700 1 -- 172.21.15.26:0/978726316 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f502400f070 con 0x7f503406fb80 2021-11-03T16:46:08.685 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.680+0000 7f5030ff9700 1 -- 172.21.15.26:0/978726316 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f5024024b20 con 0x7f503406fb80 2021-11-03T16:46:08.686 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.681+0000 7f503a2b1700 1 -- 172.21.15.26:0/978726316 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5034045ad0 con 0x7f503406fb80 2021-11-03T16:46:08.686 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.683+0000 7f5030ff9700 1 -- 172.21.15.26:0/978726316 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7f5024016070 con 0x7f503406fb80 2021-11-03T16:46:08.798 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.802+0000 7f503a2b1700 1 -- 172.21.15.26:0/978726316 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f50340ffb50 con 0x7f503406fb80 2021-11-03T16:46:08.800 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.804+0000 7f5030ff9700 1 -- 172.21.15.26:0/978726316 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f5024024ce0 con 0x7f503406fb80 2021-11-03T16:46:08.802 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.805+0000 7f503a2b1700 1 -- 172.21.15.26:0/978726316 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f503406fb80 msgr2=0x7f503410a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:08.802 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.805+0000 7f503a2b1700 1 --2- 172.21.15.26:0/978726316 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f503406fb80 0x7f503410a930 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f502400df80 tx=0x7f5024006ee0).stop 2021-11-03T16:46:08.802 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.805+0000 7f503a2b1700 1 -- 172.21.15.26:0/978726316 shutdown_connections 2021-11-03T16:46:08.803 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.805+0000 7f503a2b1700 1 --2- 172.21.15.26:0/978726316 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f503406fb80 0x7f503410a930 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:08.803 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.805+0000 7f503a2b1700 1 -- 172.21.15.26:0/978726316 >> 172.21.15.26:0/978726316 conn(0x7f50340f62e0 msgr2=0x7f50340f7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:08.803 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.805+0000 7f503a2b1700 1 -- 172.21.15.26:0/978726316 shutdown_connections 2021-11-03T16:46:08.803 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:08.805+0000 7f503a2b1700 1 -- 172.21.15.26:0/978726316 wait complete. 2021-11-03T16:46:09.448 INFO:teuthology.orchestra.run.smithi026.stderr:Wrote config to /etc/ceph/ceph.conf 2021-11-03T16:46:09.448 INFO:teuthology.orchestra.run.smithi026.stderr:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2021-11-03T16:46:09.448 INFO:teuthology.orchestra.run.smithi026.stderr:Creating mgr... 2021-11-03T16:46:09.449 INFO:teuthology.orchestra.run.smithi026.stderr:Verifying port 9283 ... 2021-11-03T16:46:09.450 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: systemctl daemon-reload 2021-11-03T16:46:09.549 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: systemctl stop ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c@mgr.smithi026.cnrxli 2021-11-03T16:46:09.581 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: systemctl reset-failed ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c@mgr.smithi026.cnrxli 2021-11-03T16:46:09.587 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: Failed to reset failed state of unit ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c@mgr.smithi026.cnrxli.service: Unit ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c@mgr.smithi026.cnrxli.service not loaded. 2021-11-03T16:46:09.587 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: systemctl enable ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c@mgr.smithi026.cnrxli 2021-11-03T16:46:09.593 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: Created symlink /etc/systemd/system/ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c.target.wants/ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c@mgr.smithi026.cnrxli.service → /etc/systemd/system/ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c@.service. 2021-11-03T16:46:09.677 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: systemctl start ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c@mgr.smithi026.cnrxli 2021-11-03T16:46:10.073 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:09 smithi026 conmon[32119]: audit 2021-11-03T16:46:08.805987+0000 mon.smithi026 (mon.0) 6 : audit [INF] from='client.? 172.21.15.26:0/978726316' entity='client.admin' 2021-11-03T16:46:10.417 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: systemctl is-enabled firewalld.service 2021-11-03T16:46:10.425 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: disabled 2021-11-03T16:46:10.426 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: systemctl is-active firewalld.service 2021-11-03T16:46:10.432 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: inactive 2021-11-03T16:46:10.433 INFO:teuthology.orchestra.run.smithi026.stderr:firewalld.service is not enabled 2021-11-03T16:46:10.434 INFO:teuthology.orchestra.run.smithi026.stderr:Not possible to enable service . firewalld.service is not available 2021-11-03T16:46:10.434 INFO:teuthology.orchestra.run.smithi026.stderr:Not possible to open ports <[]>. firewalld.service is not available 2021-11-03T16:46:10.434 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: systemctl is-enabled firewalld.service 2021-11-03T16:46:10.441 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: disabled 2021-11-03T16:46:10.441 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: systemctl is-active firewalld.service 2021-11-03T16:46:10.448 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: inactive 2021-11-03T16:46:10.449 INFO:teuthology.orchestra.run.smithi026.stderr:firewalld.service is not enabled 2021-11-03T16:46:10.449 INFO:teuthology.orchestra.run.smithi026.stderr:Not possible to open ports <[9283]>. firewalld.service is not available 2021-11-03T16:46:10.450 INFO:teuthology.orchestra.run.smithi026.stderr:Waiting for mgr to start... 2021-11-03T16:46:10.450 INFO:teuthology.orchestra.run.smithi026.stderr:Waiting for mgr... 2021-11-03T16:46:10.450 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi026 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprh0b9ciq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpg6zn56v0:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 status -f json-pretty 2021-11-03T16:46:11.152 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.147+0000 7f19c8b6e700 1 Processor -- start 2021-11-03T16:46:11.153 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.147+0000 7f19c8b6e700 1 -- start start 2021-11-03T16:46:11.153 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.148+0000 7f19c8b6e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19c406fb60 0x7f19c40fe840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:11.153 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.148+0000 7f19c8b6e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c40fed30 con 0x7f19c406fb60 2021-11-03T16:46:11.154 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.148+0000 7f19c259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19c406fb60 0x7f19c40fe840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:11.154 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.148+0000 7f19c259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19c406fb60 0x7f19c40fe840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49068/0 (socket says 172.21.15.26:49068) 2021-11-03T16:46:11.155 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.148+0000 7f19c259c700 1 -- 172.21.15.26:0/1487374190 learned_addr learned my addr 172.21.15.26:0/1487374190 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:11.155 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.149+0000 7f19c259c700 1 -- 172.21.15.26:0/1487374190 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c40fee70 con 0x7f19c406fb60 2021-11-03T16:46:11.156 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.149+0000 7f19c259c700 1 --2- 172.21.15.26:0/1487374190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19c406fb60 0x7f19c40fe840 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f19b400b5f0 tx=0x7f19b4006ee0).ready entity=mon.0 client_cookie=ced306f8459491f9 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:11.156 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.149+0000 7f19c159a700 1 -- 172.21.15.26:0/1487374190 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f19b400d600 con 0x7f19c406fb60 2021-11-03T16:46:11.156 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.149+0000 7f19c159a700 1 -- 172.21.15.26:0/1487374190 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f19b400dbb0 con 0x7f19c406fb60 2021-11-03T16:46:11.157 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.149+0000 7f19c159a700 1 -- 172.21.15.26:0/1487374190 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f19b4011bb0 con 0x7f19c406fb60 2021-11-03T16:46:11.157 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.149+0000 7f19c8b6e700 1 -- 172.21.15.26:0/1487374190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19c406fb60 msgr2=0x7f19c40fe840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:11.158 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.149+0000 7f19c8b6e700 1 --2- 172.21.15.26:0/1487374190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19c406fb60 0x7f19c40fe840 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f19b400b5f0 tx=0x7f19b4006ee0).stop 2021-11-03T16:46:11.158 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.150+0000 7f19c8b6e700 1 -- 172.21.15.26:0/1487374190 shutdown_connections 2021-11-03T16:46:11.159 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.150+0000 7f19c8b6e700 1 --2- 172.21.15.26:0/1487374190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19c406fb60 0x7f19c40fe840 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:11.159 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.150+0000 7f19c8b6e700 1 -- 172.21.15.26:0/1487374190 >> 172.21.15.26:0/1487374190 conn(0x7f19c40f6260 msgr2=0x7f19c40f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:11.159 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.150+0000 7f19c8b6e700 1 -- 172.21.15.26:0/1487374190 shutdown_connections 2021-11-03T16:46:11.160 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.150+0000 7f19c8b6e700 1 -- 172.21.15.26:0/1487374190 wait complete. 2021-11-03T16:46:11.160 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.150+0000 7f19c8b6e700 1 Processor -- start 2021-11-03T16:46:11.161 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.150+0000 7f19c8b6e700 1 -- start start 2021-11-03T16:46:11.161 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.150+0000 7f19c8b6e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19c406fb60 0x7f19c410a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:11.162 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.150+0000 7f19c8b6e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c410add0 con 0x7f19c406fb60 2021-11-03T16:46:11.162 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.151+0000 7f19c259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19c406fb60 0x7f19c410a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:11.162 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.151+0000 7f19c259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19c406fb60 0x7f19c410a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49070/0 (socket says 172.21.15.26:49070) 2021-11-03T16:46:11.163 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.151+0000 7f19c259c700 1 -- 172.21.15.26:0/3849816716 learned_addr learned my addr 172.21.15.26:0/3849816716 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:11.163 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.151+0000 7f19c259c700 1 -- 172.21.15.26:0/3849816716 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b400b200 con 0x7f19c406fb60 2021-11-03T16:46:11.164 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.151+0000 7f19c259c700 1 --2- 172.21.15.26:0/3849816716 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19c406fb60 0x7f19c410a8e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f19b4006970 tx=0x7f19b4006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:11.164 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.151+0000 7f19baffd700 1 -- 172.21.15.26:0/3849816716 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f19b401b570 con 0x7f19c406fb60 2021-11-03T16:46:11.165 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.151+0000 7f19baffd700 1 -- 172.21.15.26:0/3849816716 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f19b401bb20 con 0x7f19c406fb60 2021-11-03T16:46:11.165 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.151+0000 7f19c8b6e700 1 -- 172.21.15.26:0/3849816716 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c410afd0 con 0x7f19c406fb60 2021-11-03T16:46:11.166 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.151+0000 7f19baffd700 1 -- 172.21.15.26:0/3849816716 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f19b401a920 con 0x7f19c406fb60 2021-11-03T16:46:11.166 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.151+0000 7f19c8b6e700 1 -- 172.21.15.26:0/3849816716 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c410b460 con 0x7f19c406fb60 2021-11-03T16:46:11.167 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.152+0000 7f19baffd700 1 -- 172.21.15.26:0/3849816716 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f19b400f070 con 0x7f19c406fb60 2021-11-03T16:46:11.167 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.152+0000 7f19baffd700 1 -- 172.21.15.26:0/3849816716 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f19b4025bf0 con 0x7f19c406fb60 2021-11-03T16:46:11.167 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.153+0000 7f19c8b6e700 1 -- 172.21.15.26:0/3849816716 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19c4045ad0 con 0x7f19c406fb60 2021-11-03T16:46:11.168 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.155+0000 7f19baffd700 1 -- 172.21.15.26:0/3849816716 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7f19b4016070 con 0x7f19c406fb60 2021-11-03T16:46:11.292 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.288+0000 7f19c8b6e700 1 -- 172.21.15.26:0/3849816716 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f19c40ffb30 con 0x7f19c406fb60 2021-11-03T16:46:11.293 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.289+0000 7f19baffd700 1 -- 172.21.15.26:0/3849816716 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1230 (secure 0 0 0) 0x7f19b4025db0 con 0x7f19c406fb60 2021-11-03T16:46:11.293 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.293 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: { 2021-11-03T16:46:11.294 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "fsid": "70492bc6-3cc5-11ec-8c28-001a4aab830c", 2021-11-03T16:46:11.294 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "health": { 2021-11-03T16:46:11.294 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2021-11-03T16:46:11.294 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "checks": {}, 2021-11-03T16:46:11.294 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "mutes": [] 2021-11-03T16:46:11.295 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2021-11-03T16:46:11.295 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "election_epoch": 5, 2021-11-03T16:46:11.295 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "quorum": [ 2021-11-03T16:46:11.295 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 0 2021-11-03T16:46:11.296 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: ], 2021-11-03T16:46:11.296 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "quorum_names": [ 2021-11-03T16:46:11.296 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "smithi026" 2021-11-03T16:46:11.296 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: ], 2021-11-03T16:46:11.297 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "quorum_age": 3, 2021-11-03T16:46:11.297 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "monmap": { 2021-11-03T16:46:11.297 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "epoch": 1, 2021-11-03T16:46:11.297 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2021-11-03T16:46:11.298 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_mons": 1 2021-11-03T16:46:11.298 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2021-11-03T16:46:11.298 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "osdmap": { 2021-11-03T16:46:11.298 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "epoch": 1, 2021-11-03T16:46:11.299 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_osds": 0, 2021-11-03T16:46:11.299 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_up_osds": 0, 2021-11-03T16:46:11.299 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "osd_up_since": 0, 2021-11-03T16:46:11.299 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_in_osds": 0, 2021-11-03T16:46:11.300 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "osd_in_since": 0, 2021-11-03T16:46:11.300 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2021-11-03T16:46:11.300 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2021-11-03T16:46:11.300 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "pgmap": { 2021-11-03T16:46:11.301 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "pgs_by_state": [], 2021-11-03T16:46:11.301 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_pgs": 0, 2021-11-03T16:46:11.301 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_pools": 0, 2021-11-03T16:46:11.301 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_objects": 0, 2021-11-03T16:46:11.301 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "data_bytes": 0, 2021-11-03T16:46:11.302 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "bytes_used": 0, 2021-11-03T16:46:11.302 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "bytes_avail": 0, 2021-11-03T16:46:11.302 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "bytes_total": 0 2021-11-03T16:46:11.302 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2021-11-03T16:46:11.303 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "fsmap": { 2021-11-03T16:46:11.303 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "epoch": 1, 2021-11-03T16:46:11.303 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "by_rank": [], 2021-11-03T16:46:11.303 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "up:standby": 0 2021-11-03T16:46:11.304 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2021-11-03T16:46:11.304 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "mgrmap": { 2021-11-03T16:46:11.304 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "available": false, 2021-11-03T16:46:11.304 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_standbys": 0, 2021-11-03T16:46:11.304 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "modules": [ 2021-11-03T16:46:11.305 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "iostat", 2021-11-03T16:46:11.305 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "restful" 2021-11-03T16:46:11.305 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: ], 2021-11-03T16:46:11.305 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "services": {} 2021-11-03T16:46:11.306 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2021-11-03T16:46:11.306 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "servicemap": { 2021-11-03T16:46:11.306 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "epoch": 1, 2021-11-03T16:46:11.306 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "modified": "2021-11-03T16:46:02.236386+0000", 2021-11-03T16:46:11.307 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "services": {} 2021-11-03T16:46:11.307 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2021-11-03T16:46:11.308 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "progress_events": {} 2021-11-03T16:46:11.308 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: } 2021-11-03T16:46:11.308 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.290+0000 7f19c8b6e700 1 -- 172.21.15.26:0/3849816716 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19c406fb60 msgr2=0x7f19c410a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:11.308 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.290+0000 7f19c8b6e700 1 --2- 172.21.15.26:0/3849816716 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19c406fb60 0x7f19c410a8e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f19b4006970 tx=0x7f19b4006ee0).stop 2021-11-03T16:46:11.308 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.290+0000 7f19c8b6e700 1 -- 172.21.15.26:0/3849816716 shutdown_connections 2021-11-03T16:46:11.309 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.290+0000 7f19c8b6e700 1 --2- 172.21.15.26:0/3849816716 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19c406fb60 0x7f19c410a8e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:11.309 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.290+0000 7f19c8b6e700 1 -- 172.21.15.26:0/3849816716 >> 172.21.15.26:0/3849816716 conn(0x7f19c40f6260 msgr2=0x7f19c40f7cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:11.309 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.290+0000 7f19c8b6e700 1 -- 172.21.15.26:0/3849816716 shutdown_connections 2021-11-03T16:46:11.309 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:11.290+0000 7f19c8b6e700 1 -- 172.21.15.26:0/3849816716 wait complete. 2021-11-03T16:46:11.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:11 smithi026 conmon[32119]: audit 2021-11-03T16:46:11.290619+0000 mon.smithi026 (mon.0) 7 : 2021-11-03T16:46:11.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:11 smithi026 conmon[32119]: audit [DBG] from='client.? 172.21.15.26:0/3849816716' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-11-03T16:46:11.949 INFO:teuthology.orchestra.run.smithi026.stderr:mgr not available, waiting (1/15)... 2021-11-03T16:46:13.951 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi026 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprh0b9ciq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpg6zn56v0:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 status -f json-pretty 2021-11-03T16:46:14.611 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.612+0000 7fad91625700 1 Processor -- start 2021-11-03T16:46:14.611 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.612+0000 7fad91625700 1 -- start start 2021-11-03T16:46:14.611 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.612+0000 7fad91625700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad8c06fbc0 0x7fad8c0fe810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:14.612 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.612+0000 7fad91625700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8c0fed00 con 0x7fad8c06fbc0 2021-11-03T16:46:14.612 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.612+0000 7fad8affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad8c06fbc0 0x7fad8c0fe810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:14.612 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.612+0000 7fad8affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad8c06fbc0 0x7fad8c0fe810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49072/0 (socket says 172.21.15.26:49072) 2021-11-03T16:46:14.612 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.612+0000 7fad8affd700 1 -- 172.21.15.26:0/3165870294 learned_addr learned my addr 172.21.15.26:0/3165870294 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:14.612 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.613+0000 7fad8affd700 1 -- 172.21.15.26:0/3165870294 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad8c0fee40 con 0x7fad8c06fbc0 2021-11-03T16:46:14.613 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.613+0000 7fad8affd700 1 --2- 172.21.15.26:0/3165870294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad8c06fbc0 0x7fad8c0fe810 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fad8000b5f0 tx=0x7fad80006ee0).ready entity=mon.0 client_cookie=a371d8d500e0616a server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:14.613 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.613+0000 7fad89ffb700 1 -- 172.21.15.26:0/3165870294 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad8000d600 con 0x7fad8c06fbc0 2021-11-03T16:46:14.613 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.613+0000 7fad89ffb700 1 -- 172.21.15.26:0/3165870294 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7fad8000dbb0 con 0x7fad8c06fbc0 2021-11-03T16:46:14.613 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.613+0000 7fad89ffb700 1 -- 172.21.15.26:0/3165870294 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad80011bb0 con 0x7fad8c06fbc0 2021-11-03T16:46:14.614 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.614+0000 7fad91625700 1 -- 172.21.15.26:0/3165870294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad8c06fbc0 msgr2=0x7fad8c0fe810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:14.614 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.614+0000 7fad91625700 1 --2- 172.21.15.26:0/3165870294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad8c06fbc0 0x7fad8c0fe810 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fad8000b5f0 tx=0x7fad80006ee0).stop 2021-11-03T16:46:14.614 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.614+0000 7fad91625700 1 -- 172.21.15.26:0/3165870294 shutdown_connections 2021-11-03T16:46:14.614 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.614+0000 7fad91625700 1 --2- 172.21.15.26:0/3165870294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad8c06fbc0 0x7fad8c0fe810 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:14.615 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.614+0000 7fad91625700 1 -- 172.21.15.26:0/3165870294 >> 172.21.15.26:0/3165870294 conn(0x7fad8c0f62f0 msgr2=0x7fad8c0f8710 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:14.615 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.614+0000 7fad91625700 1 -- 172.21.15.26:0/3165870294 shutdown_connections 2021-11-03T16:46:14.615 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.614+0000 7fad91625700 1 -- 172.21.15.26:0/3165870294 wait complete. 2021-11-03T16:46:14.617 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.615+0000 7fad91625700 1 Processor -- start 2021-11-03T16:46:14.617 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.615+0000 7fad91625700 1 -- start start 2021-11-03T16:46:14.617 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.615+0000 7fad91625700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad8c06fbc0 0x7fad8c0fc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:14.617 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.615+0000 7fad91625700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8c0fa710 con 0x7fad8c06fbc0 2021-11-03T16:46:14.618 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.615+0000 7fad8affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad8c06fbc0 0x7fad8c0fc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:14.618 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.615+0000 7fad8affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad8c06fbc0 0x7fad8c0fc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49074/0 (socket says 172.21.15.26:49074) 2021-11-03T16:46:14.619 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.615+0000 7fad8affd700 1 -- 172.21.15.26:0/559211437 learned_addr learned my addr 172.21.15.26:0/559211437 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:14.619 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.616+0000 7fad8affd700 1 -- 172.21.15.26:0/559211437 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad8000b200 con 0x7fad8c06fbc0 2021-11-03T16:46:14.620 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.616+0000 7fad8affd700 1 --2- 172.21.15.26:0/559211437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad8c06fbc0 0x7fad8c0fc290 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fad8000db50 tx=0x7fad80006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:14.620 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.616+0000 7fad737fe700 1 -- 172.21.15.26:0/559211437 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad8001b410 con 0x7fad8c06fbc0 2021-11-03T16:46:14.620 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.616+0000 7fad737fe700 1 -- 172.21.15.26:0/559211437 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7fad8001b9c0 con 0x7fad8c06fbc0 2021-11-03T16:46:14.620 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.616+0000 7fad91625700 1 -- 172.21.15.26:0/559211437 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad8c0fa8b0 con 0x7fad8c06fbc0 2021-11-03T16:46:14.620 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.616+0000 7fad737fe700 1 -- 172.21.15.26:0/559211437 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad8001a6d0 con 0x7fad8c06fbc0 2021-11-03T16:46:14.621 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.616+0000 7fad91625700 1 -- 172.21.15.26:0/559211437 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad8c0fad40 con 0x7fad8c06fbc0 2021-11-03T16:46:14.621 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.616+0000 7fad737fe700 1 -- 172.21.15.26:0/559211437 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7fad8000f070 con 0x7fad8c06fbc0 2021-11-03T16:46:14.621 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.616+0000 7fad737fe700 1 -- 172.21.15.26:0/559211437 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fad80025a70 con 0x7fad8c06fbc0 2021-11-03T16:46:14.621 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.617+0000 7fad91625700 1 -- 172.21.15.26:0/559211437 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad8c045ad0 con 0x7fad8c06fbc0 2021-11-03T16:46:14.622 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.619+0000 7fad737fe700 1 -- 172.21.15.26:0/559211437 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7fad80016070 con 0x7fad8c06fbc0 2021-11-03T16:46:14.748 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.744+0000 7fad91625700 1 -- 172.21.15.26:0/559211437 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fad8c104830 con 0x7fad8c06fbc0 2021-11-03T16:46:14.749 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.744+0000 7fad737fe700 1 -- 172.21.15.26:0/559211437 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1230 (secure 0 0 0) 0x7fad8001ace0 con 0x7fad8c06fbc0 2021-11-03T16:46:14.749 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.749 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: { 2021-11-03T16:46:14.749 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "fsid": "70492bc6-3cc5-11ec-8c28-001a4aab830c", 2021-11-03T16:46:14.750 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "health": { 2021-11-03T16:46:14.750 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2021-11-03T16:46:14.750 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "checks": {}, 2021-11-03T16:46:14.750 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "mutes": [] 2021-11-03T16:46:14.750 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2021-11-03T16:46:14.751 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "election_epoch": 5, 2021-11-03T16:46:14.751 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "quorum": [ 2021-11-03T16:46:14.751 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 0 2021-11-03T16:46:14.751 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: ], 2021-11-03T16:46:14.752 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "quorum_names": [ 2021-11-03T16:46:14.752 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "smithi026" 2021-11-03T16:46:14.752 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: ], 2021-11-03T16:46:14.753 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "quorum_age": 6, 2021-11-03T16:46:14.753 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "monmap": { 2021-11-03T16:46:14.753 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "epoch": 1, 2021-11-03T16:46:14.753 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2021-11-03T16:46:14.754 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_mons": 1 2021-11-03T16:46:14.754 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2021-11-03T16:46:14.754 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "osdmap": { 2021-11-03T16:46:14.754 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "epoch": 1, 2021-11-03T16:46:14.755 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_osds": 0, 2021-11-03T16:46:14.755 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_up_osds": 0, 2021-11-03T16:46:14.755 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "osd_up_since": 0, 2021-11-03T16:46:14.755 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_in_osds": 0, 2021-11-03T16:46:14.755 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "osd_in_since": 0, 2021-11-03T16:46:14.756 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2021-11-03T16:46:14.756 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2021-11-03T16:46:14.756 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "pgmap": { 2021-11-03T16:46:14.756 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "pgs_by_state": [], 2021-11-03T16:46:14.757 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_pgs": 0, 2021-11-03T16:46:14.757 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_pools": 0, 2021-11-03T16:46:14.757 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_objects": 0, 2021-11-03T16:46:14.757 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "data_bytes": 0, 2021-11-03T16:46:14.757 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "bytes_used": 0, 2021-11-03T16:46:14.758 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "bytes_avail": 0, 2021-11-03T16:46:14.758 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "bytes_total": 0 2021-11-03T16:46:14.758 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2021-11-03T16:46:14.758 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "fsmap": { 2021-11-03T16:46:14.759 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "epoch": 1, 2021-11-03T16:46:14.759 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "by_rank": [], 2021-11-03T16:46:14.759 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "up:standby": 0 2021-11-03T16:46:14.759 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2021-11-03T16:46:14.760 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "mgrmap": { 2021-11-03T16:46:14.760 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "available": false, 2021-11-03T16:46:14.760 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_standbys": 0, 2021-11-03T16:46:14.760 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "modules": [ 2021-11-03T16:46:14.761 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "iostat", 2021-11-03T16:46:14.761 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "restful" 2021-11-03T16:46:14.761 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: ], 2021-11-03T16:46:14.761 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "services": {} 2021-11-03T16:46:14.762 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2021-11-03T16:46:14.762 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "servicemap": { 2021-11-03T16:46:14.762 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "epoch": 1, 2021-11-03T16:46:14.762 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "modified": "2021-11-03T16:46:02.236386+0000", 2021-11-03T16:46:14.762 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "services": {} 2021-11-03T16:46:14.763 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2021-11-03T16:46:14.763 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "progress_events": {} 2021-11-03T16:46:14.763 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: } 2021-11-03T16:46:14.763 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.745+0000 7fad91625700 1 -- 172.21.15.26:0/559211437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad8c06fbc0 msgr2=0x7fad8c0fc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:14.764 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.745+0000 7fad91625700 1 --2- 172.21.15.26:0/559211437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad8c06fbc0 0x7fad8c0fc290 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fad8000db50 tx=0x7fad80006ee0).stop 2021-11-03T16:46:14.764 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.745+0000 7fad91625700 1 -- 172.21.15.26:0/559211437 shutdown_connections 2021-11-03T16:46:14.764 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.745+0000 7fad91625700 1 --2- 172.21.15.26:0/559211437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad8c06fbc0 0x7fad8c0fc290 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:14.764 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.745+0000 7fad91625700 1 -- 172.21.15.26:0/559211437 >> 172.21.15.26:0/559211437 conn(0x7fad8c0f62f0 msgr2=0x7fad8c0f7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:14.764 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.746+0000 7fad91625700 1 -- 172.21.15.26:0/559211437 shutdown_connections 2021-11-03T16:46:14.765 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:14.746+0000 7fad91625700 1 -- 172.21.15.26:0/559211437 wait complete. 2021-11-03T16:46:15.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:14 smithi026 conmon[32119]: audit 2021-11-03T16:46:14.746284+0000 mon.smithi026 (mon.0) 8 : audit [DBG] from='client.? 172.21.15.26:0/559211437' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-11-03T16:46:15.353 INFO:teuthology.orchestra.run.smithi026.stderr:mgr not available, waiting (2/15)... 2021-11-03T16:46:16.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: cluster 2021-11-03T16:46:16.488772+0000 mon.smithi026 2021-11-03T16:46:16.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: (mon.0) 9 : cluster [INF] Activating manager daemon smithi026.cnrxli 2021-11-03T16:46:16.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: cluster 2021-11-03T16:46:16.491318+0000 mon.smithi026 (mon.0) 10 : cluster [DBG] 2021-11-03T16:46:16.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: mgrmap e2: smithi026.cnrxli(active, starting, since 0.00263845s) 2021-11-03T16:46:16.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: audit 2021-11 2021-11-03T16:46:16.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: -03T16:46:16.492367+0000 mon.smithi026 (mon. 2021-11-03T16:46:16.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: 0) 11 : audit [DBG] from='mgr.14100 172.21.15.26:0/1080205271' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-11-03T16:46:16.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: audit 2021-11- 2021-11-03T16:46:16.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: 03T16:46:16.492484+0000 mon.smithi026 2021-11-03T16:46:16.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: (mon.0) 12 : audit [DBG] 2021-11-03T16:46:16.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: from='mgr.14100 172.21.15.26:0/1080205271' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-11-03T16:46:16.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: audit 2021-11-03T16:46:16.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: 2021-11-03T16:46:16.492728+0000 2021-11-03T16:46:16.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: mon.smithi026 (mon.0) 13 : audit [DBG] 2021-11-03T16:46:16.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: from='mgr.14100 172.21.15.26:0/1080205271' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-11-03T16:46:16.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: audit 2021-11-03T16:46:16.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: 2021-11-03T16:46:16. 2021-11-03T16:46:16.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: 492973+0000 mon.smithi026 (mon.0) 14 : audit 2021-11-03T16:46:16.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: [DBG] from='mgr.14100 172.21.15.26:0/1080205271' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata", "id": "smithi026"}]: dispatch 2021-11-03T16:46:16.928 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: audit 2021-11-03T16: 2021-11-03T16:46:16.928 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: 46:16.493260+0000 mon.smithi026 (mon.0 2021-11-03T16:46:16.928 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: ) 15 : audit [DBG] from='mgr.14100 172.21.15.26:0/1080205271' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mgr metadata", "who": "smithi026.cnrxli", "id": "smithi026.cnrxli"}]: dispatch 2021-11-03T16:46:16.928 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: cluster 2021-11-03 2021-11-03T16:46:16.929 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: T16:46:16.495348+0000 mon.smithi026 ( 2021-11-03T16:46:16.929 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: mon.0) 16 : cluster [INF] Manager daemon smithi026.cnrxli is now available 2021-11-03T16:46:16.929 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: 2021-11-03T16:46:16.929 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: audit 2021-11-03T16:46:16.930 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: 2021-11-03T16:46:16.505741+0000 2021-11-03T16:46:16.930 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: mon.smithi026 (mon.0) 17 : audit 2021-11-03T16:46:16.930 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: [INF] from='mgr.14100 172.21.15.26:0/1080205271' entity='mgr.smithi026.cnrxli' 2021-11-03T16:46:16.930 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: audit 2021-11-03T16 2021-11-03T16:46:16.930 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: :46:16.509119+0000 mon.smithi026 (mon 2021-11-03T16:46:16.931 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: .0) 18 : audit [INF] from='mgr.14100 172.21.15.26:0/1080205271' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T16:46:16.931 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: audit 2021-11-03T16:46:16.932 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: 2021-11-03T16:46:16 2021-11-03T16:46:16.932 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: .510387+0000 mon.smithi026 (mon.0) 19 : 2021-11-03T16:46:16.932 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: audit [INF] from='mgr.14100 172.21.15.26:0/1080205271' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T16:46:16.932 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: audit 2021-11-03T16 2021-11-03T16:46:16.932 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: :46:16.515831+0000 mon.smithi026 (mon 2021-11-03T16:46:16.933 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: .0) 20 : audit [INF] from='mgr.14100 172.21.15.26:0/1080205271' entity='mgr.smithi026.cnrxli' 2021-11-03T16:46:16.933 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: audit 2021-11-03T16:46:16.933 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: 2021-11-03T16:46:16 2021-11-03T16:46:16.933 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: .517457+0000 mon.smithi026 (mon.0) 21 : 2021-11-03T16:46:16.934 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:16 smithi026 conmon[32119]: audit [INF] from='mgr.14100 172.21.15.26:0/1080205271' entity='mgr.smithi026.cnrxli' 2021-11-03T16:46:17.355 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi026 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprh0b9ciq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpg6zn56v0:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 status -f json-pretty 2021-11-03T16:46:18.053 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.052+0000 7ff6247a8700 1 Processor -- start 2021-11-03T16:46:18.053 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.052+0000 7ff6247a8700 1 -- start start 2021-11-03T16:46:18.053 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.052+0000 7ff6247a8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff61c06fb20 0x7ff61c100cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:18.054 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.052+0000 7ff6247a8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61c0fc6a0 con 0x7ff61c06fb20 2021-11-03T16:46:18.054 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.052+0000 7ff622544700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff61c06fb20 0x7ff61c100cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:18.054 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.052+0000 7ff622544700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff61c06fb20 0x7ff61c100cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49094/0 (socket says 172.21.15.26:49094) 2021-11-03T16:46:18.054 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.052+0000 7ff622544700 1 -- 172.21.15.26:0/2671502211 learned_addr learned my addr 172.21.15.26:0/2671502211 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:18.055 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.053+0000 7ff622544700 1 -- 172.21.15.26:0/2671502211 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff61c1011a0 con 0x7ff61c06fb20 2021-11-03T16:46:18.055 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.053+0000 7ff622544700 1 --2- 172.21.15.26:0/2671502211 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff61c06fb20 0x7ff61c100cb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7ff61400b5f0 tx=0x7ff614006ee0).ready entity=mon.0 client_cookie=22015572831cf0c7 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:18.055 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.053+0000 7ff621542700 1 -- 172.21.15.26:0/2671502211 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff61400d600 con 0x7ff61c06fb20 2021-11-03T16:46:18.055 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.053+0000 7ff621542700 1 -- 172.21.15.26:0/2671502211 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7ff61400dbb0 con 0x7ff61c06fb20 2021-11-03T16:46:18.056 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.053+0000 7ff621542700 1 -- 172.21.15.26:0/2671502211 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff614011bb0 con 0x7ff61c06fb20 2021-11-03T16:46:18.056 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.054+0000 7ff6247a8700 1 -- 172.21.15.26:0/2671502211 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff61c06fb20 msgr2=0x7ff61c100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:18.056 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.054+0000 7ff6247a8700 1 --2- 172.21.15.26:0/2671502211 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff61c06fb20 0x7ff61c100cb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7ff61400b5f0 tx=0x7ff614006ee0).stop 2021-11-03T16:46:18.056 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.054+0000 7ff6247a8700 1 -- 172.21.15.26:0/2671502211 shutdown_connections 2021-11-03T16:46:18.057 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.054+0000 7ff6247a8700 1 --2- 172.21.15.26:0/2671502211 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff61c06fb20 0x7ff61c100cb0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:18.057 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.054+0000 7ff6247a8700 1 -- 172.21.15.26:0/2671502211 >> 172.21.15.26:0/2671502211 conn(0x7ff61c0f62f0 msgr2=0x7ff61c0f8710 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:18.057 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.054+0000 7ff6247a8700 1 -- 172.21.15.26:0/2671502211 shutdown_connections 2021-11-03T16:46:18.057 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.054+0000 7ff6247a8700 1 -- 172.21.15.26:0/2671502211 wait complete. 2021-11-03T16:46:18.058 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.054+0000 7ff6247a8700 1 Processor -- start 2021-11-03T16:46:18.058 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.055+0000 7ff6247a8700 1 -- start start 2021-11-03T16:46:18.058 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.055+0000 7ff6247a8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff61c06fb20 0x7ff61c10cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:18.058 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.055+0000 7ff6247a8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61c10d030 con 0x7ff61c06fb20 2021-11-03T16:46:18.059 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.055+0000 7ff622544700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff61c06fb20 0x7ff61c10cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:18.059 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.055+0000 7ff622544700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff61c06fb20 0x7ff61c10cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49096/0 (socket says 172.21.15.26:49096) 2021-11-03T16:46:18.059 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.055+0000 7ff622544700 1 -- 172.21.15.26:0/1332691148 learned_addr learned my addr 172.21.15.26:0/1332691148 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:18.059 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.055+0000 7ff622544700 1 -- 172.21.15.26:0/1332691148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff61400b200 con 0x7ff61c06fb20 2021-11-03T16:46:18.060 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.055+0000 7ff622544700 1 --2- 172.21.15.26:0/1332691148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff61c06fb20 0x7ff61c10cb40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7ff614006cb0 tx=0x7ff614006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:18.060 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.055+0000 7ff61affd700 1 -- 172.21.15.26:0/1332691148 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff61401b410 con 0x7ff61c06fb20 2021-11-03T16:46:18.060 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.055+0000 7ff61affd700 1 -- 172.21.15.26:0/1332691148 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7ff61401b9c0 con 0x7ff61c06fb20 2021-11-03T16:46:18.061 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.055+0000 7ff61affd700 1 -- 172.21.15.26:0/1332691148 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff61401a6f0 con 0x7ff61c06fb20 2021-11-03T16:46:18.061 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.055+0000 7ff6247a8700 1 -- 172.21.15.26:0/1332691148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff61c10d230 con 0x7ff61c06fb20 2021-11-03T16:46:18.062 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.055+0000 7ff6247a8700 1 -- 172.21.15.26:0/1332691148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff61c10d6c0 con 0x7ff61c06fb20 2021-11-03T16:46:18.063 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.056+0000 7ff61affd700 1 -- 172.21.15.26:0/1332691148 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 3) v1 ==== 36029+0+0 (secure 0 0 0) 0x7ff61400f070 con 0x7ff61c06fb20 2021-11-03T16:46:18.063 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.057+0000 7ff6247a8700 1 -- 172.21.15.26:0/1332691148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff61c045ad0 con 0x7ff61c06fb20 2021-11-03T16:46:18.064 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.057+0000 7ff61affd700 1 --2- 172.21.15.26:0/1332691148 >> [v2:172.21.15.26:6800/2267111092,v1:172.21.15.26:6801/2267111092] conn(0x7ff60802fcc0 0x7ff608032180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:18.064 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.057+0000 7ff61affd700 1 -- 172.21.15.26:0/1332691148 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7ff614040d00 con 0x7ff61c06fb20 2021-11-03T16:46:18.064 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.057+0000 7ff621d43700 1 --2- 172.21.15.26:0/1332691148 >> [v2:172.21.15.26:6800/2267111092,v1:172.21.15.26:6801/2267111092] conn(0x7ff60802fcc0 0x7ff608032180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:18.064 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.057+0000 7ff621d43700 1 --2- 172.21.15.26:0/1332691148 >> [v2:172.21.15.26:6800/2267111092,v1:172.21.15.26:6801/2267111092] conn(0x7ff60802fcc0 0x7ff608032180 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7ff6100096a0 tx=0x7ff610006b40).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:18.064 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.061+0000 7ff61affd700 1 -- 172.21.15.26:0/1332691148 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7ff614019c50 con 0x7ff61c06fb20 2021-11-03T16:46:18.465 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.461+0000 7ff6247a8700 1 -- 172.21.15.26:0/1332691148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7ff61c101d40 con 0x7ff61c06fb20 2021-11-03T16:46:18.465 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.461+0000 7ff61affd700 1 -- 172.21.15.26:0/1332691148 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1230 (secure 0 0 0) 0x7ff614016030 con 0x7ff61c06fb20 2021-11-03T16:46:18.466 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.466 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: { 2021-11-03T16:46:18.466 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "fsid": "70492bc6-3cc5-11ec-8c28-001a4aab830c", 2021-11-03T16:46:18.466 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "health": { 2021-11-03T16:46:18.467 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2021-11-03T16:46:18.467 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "checks": {}, 2021-11-03T16:46:18.467 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "mutes": [] 2021-11-03T16:46:18.467 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2021-11-03T16:46:18.468 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "election_epoch": 5, 2021-11-03T16:46:18.468 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "quorum": [ 2021-11-03T16:46:18.468 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 0 2021-11-03T16:46:18.468 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: ], 2021-11-03T16:46:18.469 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "quorum_names": [ 2021-11-03T16:46:18.469 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "smithi026" 2021-11-03T16:46:18.469 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: ], 2021-11-03T16:46:18.469 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "quorum_age": 10, 2021-11-03T16:46:18.469 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "monmap": { 2021-11-03T16:46:18.470 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "epoch": 1, 2021-11-03T16:46:18.470 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2021-11-03T16:46:18.470 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_mons": 1 2021-11-03T16:46:18.470 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2021-11-03T16:46:18.471 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "osdmap": { 2021-11-03T16:46:18.471 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "epoch": 1, 2021-11-03T16:46:18.471 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_osds": 0, 2021-11-03T16:46:18.471 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_up_osds": 0, 2021-11-03T16:46:18.472 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "osd_up_since": 0, 2021-11-03T16:46:18.472 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_in_osds": 0, 2021-11-03T16:46:18.472 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "osd_in_since": 0, 2021-11-03T16:46:18.472 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2021-11-03T16:46:18.472 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2021-11-03T16:46:18.473 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "pgmap": { 2021-11-03T16:46:18.473 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "pgs_by_state": [], 2021-11-03T16:46:18.473 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_pgs": 0, 2021-11-03T16:46:18.473 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_pools": 0, 2021-11-03T16:46:18.474 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_objects": 0, 2021-11-03T16:46:18.474 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "data_bytes": 0, 2021-11-03T16:46:18.474 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "bytes_used": 0, 2021-11-03T16:46:18.474 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "bytes_avail": 0, 2021-11-03T16:46:18.475 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "bytes_total": 0 2021-11-03T16:46:18.475 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2021-11-03T16:46:18.475 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "fsmap": { 2021-11-03T16:46:18.475 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "epoch": 1, 2021-11-03T16:46:18.475 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "by_rank": [], 2021-11-03T16:46:18.476 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "up:standby": 0 2021-11-03T16:46:18.476 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2021-11-03T16:46:18.476 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "mgrmap": { 2021-11-03T16:46:18.476 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "available": true, 2021-11-03T16:46:18.477 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_standbys": 0, 2021-11-03T16:46:18.477 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "modules": [ 2021-11-03T16:46:18.477 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "iostat", 2021-11-03T16:46:18.477 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "restful" 2021-11-03T16:46:18.477 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: ], 2021-11-03T16:46:18.478 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "services": {} 2021-11-03T16:46:18.478 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2021-11-03T16:46:18.478 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "servicemap": { 2021-11-03T16:46:18.478 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "epoch": 1, 2021-11-03T16:46:18.479 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "modified": "2021-11-03T16:46:02.236386+0000", 2021-11-03T16:46:18.479 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "services": {} 2021-11-03T16:46:18.479 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2021-11-03T16:46:18.479 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "progress_events": {} 2021-11-03T16:46:18.479 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: } 2021-11-03T16:46:18.480 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.463+0000 7ff6247a8700 1 -- 172.21.15.26:0/1332691148 >> [v2:172.21.15.26:6800/2267111092,v1:172.21.15.26:6801/2267111092] conn(0x7ff60802fcc0 msgr2=0x7ff608032180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:18.480 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.463+0000 7ff6247a8700 1 --2- 172.21.15.26:0/1332691148 >> [v2:172.21.15.26:6800/2267111092,v1:172.21.15.26:6801/2267111092] conn(0x7ff60802fcc0 0x7ff608032180 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7ff6100096a0 tx=0x7ff610006b40).stop 2021-11-03T16:46:18.480 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.463+0000 7ff6247a8700 1 -- 172.21.15.26:0/1332691148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff61c06fb20 msgr2=0x7ff61c10cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:18.480 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.463+0000 7ff6247a8700 1 --2- 172.21.15.26:0/1332691148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff61c06fb20 0x7ff61c10cb40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7ff614006cb0 tx=0x7ff614006ee0).stop 2021-11-03T16:46:18.481 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.463+0000 7ff6247a8700 1 -- 172.21.15.26:0/1332691148 shutdown_connections 2021-11-03T16:46:18.481 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.463+0000 7ff6247a8700 1 --2- 172.21.15.26:0/1332691148 >> [v2:172.21.15.26:6800/2267111092,v1:172.21.15.26:6801/2267111092] conn(0x7ff60802fcc0 0x7ff608032180 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:18.481 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.463+0000 7ff6247a8700 1 --2- 172.21.15.26:0/1332691148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff61c06fb20 0x7ff61c10cb40 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:18.481 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.463+0000 7ff6247a8700 1 -- 172.21.15.26:0/1332691148 >> 172.21.15.26:0/1332691148 conn(0x7ff61c0f62f0 msgr2=0x7ff61c0f7dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:18.482 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.463+0000 7ff6247a8700 1 -- 172.21.15.26:0/1332691148 shutdown_connections 2021-11-03T16:46:18.482 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:18.463+0000 7ff6247a8700 1 -- 172.21.15.26:0/1332691148 wait complete. 2021-11-03T16:46:18.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:18 smithi026 conmon[32119]: cluster 2021-11-03T16:46:17.494720+0000 mon.smithi026 (mon.0) 22 : cluster [DBG] mgrmap e3: smithi026.cnrxli(active, since 1.00604s) 2021-11-03T16:46:18.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:18 smithi026 conmon[32119]: audit 2021-11-03T16:46:18.463043+0000 mon.smithi026 (mon.0) 23 : audit [DBG] from='client.? 172.21.15.26:0/1332691148' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-11-03T16:46:19.054 INFO:teuthology.orchestra.run.smithi026.stderr:mgr is available 2021-11-03T16:46:19.054 INFO:teuthology.orchestra.run.smithi026.stderr:Enabling cephadm module... 2021-11-03T16:46:19.054 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi026 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprh0b9ciq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpg6zn56v0:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 mgr module enable cephadm 2021-11-03T16:46:19.721 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:19.720+0000 7fd37a2e9700 1 Processor -- start 2021-11-03T16:46:19.722 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:19.720+0000 7fd37a2e9700 1 -- start start 2021-11-03T16:46:19.722 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:19.721+0000 7fd37a2e9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd37406fb80 0x7fd374100c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:19.722 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:19.721+0000 7fd37a2e9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3740fc650 con 0x7fd37406fb80 2021-11-03T16:46:19.723 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:19.721+0000 7fd373fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd37406fb80 0x7fd374100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:19.723 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:19.721+0000 7fd373fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd37406fb80 0x7fd374100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49100/0 (socket says 172.21.15.26:49100) 2021-11-03T16:46:19.723 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:19.721+0000 7fd373fff700 1 -- 172.21.15.26:0/2932559279 learned_addr learned my addr 172.21.15.26:0/2932559279 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:19.723 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:19.721+0000 7fd373fff700 1 -- 172.21.15.26:0/2932559279 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd374101150 con 0x7fd37406fb80 2021-11-03T16:46:19.724 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:19.721+0000 7fd373fff700 1 --2- 172.21.15.26:0/2932559279 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd37406fb80 0x7fd374100c60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fd36800b5f0 tx=0x7fd368006ee0).ready entity=mon.0 client_cookie=a29a3ca6eda16f9b server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:19.724 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:19.721+0000 7fd372ffd700 1 -- 172.21.15.26:0/2932559279 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd36800d600 con 0x7fd37406fb80 2021-11-03T16:46:19.724 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:19.721+0000 7fd372ffd700 1 -- 172.21.15.26:0/2932559279 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7fd36800dbb0 con 0x7fd37406fb80 2021-11-03T16:46:19.724 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:19.721+0000 7fd372ffd700 1 -- 172.21.15.26:0/2932559279 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd368011be0 con 0x7fd37406fb80 2021-11-03T16:46:19.725 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:19.722+0000 7fd37a2e9700 1 -- 172.21.15.26:0/2932559279 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd37406fb80 msgr2=0x7fd374100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:19.725 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:19.722+0000 7fd37a2e9700 1 --2- 172.21.15.26:0/2932559279 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd37406fb80 0x7fd374100c60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fd36800b5f0 tx=0x7fd368006ee0).stop 2021-11-03T16:46:19.725 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:19.722+0000 7fd37a2e9700 1 -- 172.21.15.26:0/2932559279 shutdown_connections 2021-11-03T16:46:19.725 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:19.722+0000 7fd37a2e9700 1 --2- 172.21.15.26:0/2932559279 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd37406fb80 0x7fd374100c60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:19.726 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:19.722+0000 7fd37a2e9700 1 -- 172.21.15.26:0/2932559279 >> 172.21.15.26:0/2932559279 conn(0x7fd3740f62e0 msgr2=0x7fd3740f8700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:19.726 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:19.722+0000 7fd37a2e9700 1 -- 172.21.15.26:0/2932559279 shutdown_connections 2021-11-03T16:46:19.726 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:19.722+0000 7fd37a2e9700 1 -- 172.21.15.26:0/2932559279 wait complete. 2021-11-03T16:46:19.726 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:19.723+0000 7fd37a2e9700 1 Processor -- start 2021-11-03T16:46:19.727 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:19.723+0000 7fd37a2e9700 1 -- start start 2021-11-03T16:46:19.727 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:19.723+0000 7fd37a2e9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd37406fb80 0x7fd37410cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:19.727 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:19.723+0000 7fd37a2e9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37410d020 con 0x7fd37406fb80 2021-11-03T16:46:19.727 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:19.723+0000 7fd373fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd37406fb80 0x7fd37410cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:19.728 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:19.723+0000 7fd373fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd37406fb80 0x7fd37410cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49102/0 (socket says 172.21.15.26:49102) 2021-11-03T16:46:19.728 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:19.723+0000 7fd373fff700 1 -- 172.21.15.26:0/3812093119 learned_addr learned my addr 172.21.15.26:0/3812093119 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:19.728 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:19.723+0000 7fd373fff700 1 -- 172.21.15.26:0/3812093119 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36800b200 con 0x7fd37406fb80 2021-11-03T16:46:19.728 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:19.723+0000 7fd373fff700 1 --2- 172.21.15.26:0/3812093119 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd37406fb80 0x7fd37410cb30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fd368011550 tx=0x7fd368006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:19.729 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:19.724+0000 7fd370ff9700 1 -- 172.21.15.26:0/3812093119 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd36801b570 con 0x7fd37406fb80 2021-11-03T16:46:19.729 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:19.724+0000 7fd370ff9700 1 -- 172.21.15.26:0/3812093119 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7fd36801bb20 con 0x7fd37406fb80 2021-11-03T16:46:19.729 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:19.724+0000 7fd37a2e9700 1 -- 172.21.15.26:0/3812093119 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd37410d220 con 0x7fd37406fb80 2021-11-03T16:46:19.729 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:19.724+0000 7fd370ff9700 1 -- 172.21.15.26:0/3812093119 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd36801a920 con 0x7fd37406fb80 2021-11-03T16:46:19.730 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:19.724+0000 7fd37a2e9700 1 -- 172.21.15.26:0/3812093119 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd37410d6b0 con 0x7fd37406fb80 2021-11-03T16:46:19.730 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:19.725+0000 7fd370ff9700 1 -- 172.21.15.26:0/3812093119 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) v1 ==== 36109+0+0 (secure 0 0 0) 0x7fd36800f070 con 0x7fd37406fb80 2021-11-03T16:46:19.730 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:19.725+0000 7fd370ff9700 1 --2- 172.21.15.26:0/3812093119 >> [v2:172.21.15.26:6800/2267111092,v1:172.21.15.26:6801/2267111092] conn(0x7fd36002fd00 0x7fd3600321c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:19.730 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:19.725+0000 7fd370ff9700 1 -- 172.21.15.26:0/3812093119 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fd3680410e0 con 0x7fd37406fb80 2021-11-03T16:46:19.731 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:19.725+0000 7fd3737fe700 1 --2- 172.21.15.26:0/3812093119 >> [v2:172.21.15.26:6800/2267111092,v1:172.21.15.26:6801/2267111092] conn(0x7fd36002fd00 0x7fd3600321c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:19.731 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:19.725+0000 7fd37a2e9700 1 -- 172.21.15.26:0/3812093119 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd374045ad0 con 0x7fd37406fb80 2021-11-03T16:46:19.732 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:19.725+0000 7fd3737fe700 1 --2- 172.21.15.26:0/3812093119 >> [v2:172.21.15.26:6800/2267111092,v1:172.21.15.26:6801/2267111092] conn(0x7fd36002fd00 0x7fd3600321c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fd3640096a0 tx=0x7fd364006b40).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:19.732 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:19.730+0000 7fd370ff9700 1 -- 172.21.15.26:0/3812093119 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fd368016070 con 0x7fd37406fb80 2021-11-03T16:46:20.087 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:20.090+0000 7fd37a2e9700 1 -- 172.21.15.26:0/3812093119 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7fd374106a80 con 0x7fd37406fb80 2021-11-03T16:46:20.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:19 smithi026 conmon[32119]: cluster 2021-11-03T16:46:18.968830+0000 mon.smithi026 (mon.0) 24 : cluster [DBG] 2021-11-03T16:46:20.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:19 smithi026 conmon[32119]: mgrmap e4: smithi026.cnrxli(active, since 2s) 2021-11-03T16:46:20.967 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:20.970+0000 7fd370ff9700 1 -- 172.21.15.26:0/3812093119 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mgrmap(e 5) v1 ==== 36120+0+0 (secure 0 0 0) 0x7fd368010dd0 con 0x7fd37406fb80 2021-11-03T16:46:20.967 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:20.971+0000 7fd370ff9700 1 -- 172.21.15.26:0/3812093119 <== mon.0 v2:172.21.15.26:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7fd3680058e0 con 0x7fd37406fb80 2021-11-03T16:46:20.970 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:20.973+0000 7fd37a2e9700 1 -- 172.21.15.26:0/3812093119 >> [v2:172.21.15.26:6800/2267111092,v1:172.21.15.26:6801/2267111092] conn(0x7fd36002fd00 msgr2=0x7fd3600321c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:20.971 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:20.973+0000 7fd37a2e9700 1 --2- 172.21.15.26:0/3812093119 >> [v2:172.21.15.26:6800/2267111092,v1:172.21.15.26:6801/2267111092] conn(0x7fd36002fd00 0x7fd3600321c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fd3640096a0 tx=0x7fd364006b40).stop 2021-11-03T16:46:20.971 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:20.973+0000 7fd37a2e9700 1 -- 172.21.15.26:0/3812093119 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd37406fb80 msgr2=0x7fd37410cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:20.971 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:20.973+0000 7fd37a2e9700 1 --2- 172.21.15.26:0/3812093119 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd37406fb80 0x7fd37410cb30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fd368011550 tx=0x7fd368006ee0).stop 2021-11-03T16:46:20.972 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:20.973+0000 7fd37a2e9700 1 -- 172.21.15.26:0/3812093119 shutdown_connections 2021-11-03T16:46:20.972 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:20.973+0000 7fd37a2e9700 1 --2- 172.21.15.26:0/3812093119 >> [v2:172.21.15.26:6800/2267111092,v1:172.21.15.26:6801/2267111092] conn(0x7fd36002fd00 0x7fd3600321c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:20.972 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:20.973+0000 7fd37a2e9700 1 --2- 172.21.15.26:0/3812093119 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd37406fb80 0x7fd37410cb30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:20.972 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:20.973+0000 7fd37a2e9700 1 -- 172.21.15.26:0/3812093119 >> 172.21.15.26:0/3812093119 conn(0x7fd3740f62e0 msgr2=0x7fd3740f7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:20.973 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:20.975+0000 7fd37a2e9700 1 -- 172.21.15.26:0/3812093119 shutdown_connections 2021-11-03T16:46:20.973 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:20.975+0000 7fd37a2e9700 1 -- 172.21.15.26:0/3812093119 wait complete. 2021-11-03T16:46:21.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:20 smithi026 conmon[32119]: audit 2021-11-03T16:46:20.092589+0000 mon.smithi026 (mon.0) 25 : audit [INF] from='client.? 172.21.15.26:0/3812093119' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2021-11-03T16:46:21.611 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi026 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprh0b9ciq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpg6zn56v0:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 mgr stat 2021-11-03T16:46:22.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:21 smithi026 conmon[32119]: audit 2021-11-03T16:46:20.972535+0000 mon.smithi026 (mon.0) 26 : audit [INF] 2021-11-03T16:46:22.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:21 smithi026 conmon[32119]: from='client.? 172.21.15.26:0/3812093119' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2021-11-03T16:46:22.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:21 smithi026 conmon[32119]: cluster 2021-11-03T16:46:20.972615+0000 mon.smithi026 (mon.0) 27 : cluster [DBG] mgrmap e5: smithi026.cnrxli(active, since 4s) 2021-11-03T16:46:22.318 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.320+0000 7feef4642700 1 Processor -- start 2021-11-03T16:46:22.318 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.320+0000 7feef4642700 1 -- start start 2021-11-03T16:46:22.318 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.320+0000 7feef4642700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeec06fb80 0x7feeec0fe820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:22.319 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.320+0000 7feef4642700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeec0fed10 con 0x7feeec06fb80 2021-11-03T16:46:22.319 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.320+0000 7feef23de700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeec06fb80 0x7feeec0fe820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:22.319 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.320+0000 7feef23de700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeec06fb80 0x7feeec0fe820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49116/0 (socket says 172.21.15.26:49116) 2021-11-03T16:46:22.320 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.320+0000 7feef23de700 1 -- 172.21.15.26:0/255553280 learned_addr learned my addr 172.21.15.26:0/255553280 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:22.320 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.321+0000 7feef23de700 1 -- 172.21.15.26:0/255553280 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeec0fee50 con 0x7feeec06fb80 2021-11-03T16:46:22.320 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.321+0000 7feef23de700 1 --2- 172.21.15.26:0/255553280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeec06fb80 0x7feeec0fe820 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7feee800b5f0 tx=0x7feee8006ee0).ready entity=mon.0 client_cookie=486415f6242c8bf6 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:22.320 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.321+0000 7feef13dc700 1 -- 172.21.15.26:0/255553280 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feee800d600 con 0x7feeec06fb80 2021-11-03T16:46:22.321 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.321+0000 7feef13dc700 1 -- 172.21.15.26:0/255553280 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7feee800dbb0 con 0x7feeec06fb80 2021-11-03T16:46:22.321 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.321+0000 7feef13dc700 1 -- 172.21.15.26:0/255553280 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feee8011be0 con 0x7feeec06fb80 2021-11-03T16:46:22.324 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.322+0000 7feef4642700 1 -- 172.21.15.26:0/255553280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeec06fb80 msgr2=0x7feeec0fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:22.324 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.322+0000 7feef4642700 1 --2- 172.21.15.26:0/255553280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeec06fb80 0x7feeec0fe820 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7feee800b5f0 tx=0x7feee8006ee0).stop 2021-11-03T16:46:22.325 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.322+0000 7feef4642700 1 -- 172.21.15.26:0/255553280 shutdown_connections 2021-11-03T16:46:22.325 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.322+0000 7feef4642700 1 --2- 172.21.15.26:0/255553280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeec06fb80 0x7feeec0fe820 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:22.325 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.322+0000 7feef4642700 1 -- 172.21.15.26:0/255553280 >> 172.21.15.26:0/255553280 conn(0x7feeec0f6260 msgr2=0x7feeec0f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:22.325 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.322+0000 7feef4642700 1 -- 172.21.15.26:0/255553280 shutdown_connections 2021-11-03T16:46:22.325 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.322+0000 7feef4642700 1 -- 172.21.15.26:0/255553280 wait complete. 2021-11-03T16:46:22.326 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.323+0000 7feef4642700 1 Processor -- start 2021-11-03T16:46:22.326 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.323+0000 7feef4642700 1 -- start start 2021-11-03T16:46:22.326 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.323+0000 7feef4642700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeec06fb80 0x7feeec10a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:22.326 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.323+0000 7feef4642700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeec10ad80 con 0x7feeec06fb80 2021-11-03T16:46:22.327 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.323+0000 7feef23de700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeec06fb80 0x7feeec10a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:22.327 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.323+0000 7feef23de700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeec06fb80 0x7feeec10a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49118/0 (socket says 172.21.15.26:49118) 2021-11-03T16:46:22.327 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.323+0000 7feef23de700 1 -- 172.21.15.26:0/4163467446 learned_addr learned my addr 172.21.15.26:0/4163467446 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:22.327 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.324+0000 7feef23de700 1 -- 172.21.15.26:0/4163467446 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee800b200 con 0x7feeec06fb80 2021-11-03T16:46:22.328 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.324+0000 7feef23de700 1 --2- 172.21.15.26:0/4163467446 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeec06fb80 0x7feeec10a890 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7feee800df80 tx=0x7feee8006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:22.328 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.324+0000 7feedeffd700 1 -- 172.21.15.26:0/4163467446 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feee801a580 con 0x7feeec06fb80 2021-11-03T16:46:22.328 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.324+0000 7feedeffd700 1 -- 172.21.15.26:0/4163467446 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7feee801ab30 con 0x7feeec06fb80 2021-11-03T16:46:22.328 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.324+0000 7feedeffd700 1 -- 172.21.15.26:0/4163467446 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feee801ba30 con 0x7feeec06fb80 2021-11-03T16:46:22.328 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.324+0000 7feef4642700 1 -- 172.21.15.26:0/4163467446 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeec10af80 con 0x7feeec06fb80 2021-11-03T16:46:22.329 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.324+0000 7feef4642700 1 -- 172.21.15.26:0/4163467446 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeec10b410 con 0x7feeec06fb80 2021-11-03T16:46:22.329 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.325+0000 7feedeffd700 1 -- 172.21.15.26:0/4163467446 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 36120+0+0 (secure 0 0 0) 0x7feee800f070 con 0x7feeec06fb80 2021-11-03T16:46:22.329 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.325+0000 7feedeffd700 1 --2- 172.21.15.26:0/4163467446 >> [v2:172.21.15.26:6800/2267111092,v1:172.21.15.26:6801/2267111092] conn(0x7feed402fd50 0x7feed4032210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:22.329 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.325+0000 7feedeffd700 1 -- 172.21.15.26:0/4163467446 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7feee8041270 con 0x7feeec06fb80 2021-11-03T16:46:22.330 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.325+0000 7feef1bdd700 1 -- 172.21.15.26:0/4163467446 >> [v2:172.21.15.26:6800/2267111092,v1:172.21.15.26:6801/2267111092] conn(0x7feed402fd50 msgr2=0x7feed4032210 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/2267111092 2021-11-03T16:46:22.330 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.325+0000 7feef1bdd700 1 --2- 172.21.15.26:0/4163467446 >> [v2:172.21.15.26:6800/2267111092,v1:172.21.15.26:6801/2267111092] conn(0x7feed402fd50 0x7feed4032210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2021-11-03T16:46:22.330 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.325+0000 7feef4642700 1 -- 172.21.15.26:0/4163467446 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeec045ad0 con 0x7feeec06fb80 2021-11-03T16:46:22.331 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.330+0000 7feedeffd700 1 -- 172.21.15.26:0/4163467446 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7feee8016070 con 0x7feeec06fb80 2021-11-03T16:46:22.524 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.526+0000 7feef1bdd700 1 -- 172.21.15.26:0/4163467446 >> [v2:172.21.15.26:6800/2267111092,v1:172.21.15.26:6801/2267111092] conn(0x7feed402fd50 msgr2=0x7feed4032210 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/2267111092 2021-11-03T16:46:22.524 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.526+0000 7feef1bdd700 1 --2- 172.21.15.26:0/4163467446 >> [v2:172.21.15.26:6800/2267111092,v1:172.21.15.26:6801/2267111092] conn(0x7feed402fd50 0x7feed4032210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2021-11-03T16:46:22.729 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.732+0000 7feef4642700 1 -- 172.21.15.26:0/4163467446 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7feeec104840 con 0x7feeec06fb80 2021-11-03T16:46:22.730 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.732+0000 7feedeffd700 1 -- 172.21.15.26:0/4163467446 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7feee8010bc0 con 0x7feeec06fb80 2021-11-03T16:46:22.730 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: { 2021-11-03T16:46:22.730 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "epoch": 5, 2021-11-03T16:46:22.731 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "available": true, 2021-11-03T16:46:22.731 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "active_name": "smithi026.cnrxli", 2021-11-03T16:46:22.731 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_standby": 0 2021-11-03T16:46:22.731 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: } 2021-11-03T16:46:22.734 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.736+0000 7feef4642700 1 -- 172.21.15.26:0/4163467446 >> [v2:172.21.15.26:6800/2267111092,v1:172.21.15.26:6801/2267111092] conn(0x7feed402fd50 msgr2=0x7feed4032210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-11-03T16:46:22.734 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.736+0000 7feef4642700 1 --2- 172.21.15.26:0/4163467446 >> [v2:172.21.15.26:6800/2267111092,v1:172.21.15.26:6801/2267111092] conn(0x7feed402fd50 0x7feed4032210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T16:46:22.734 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.736+0000 7feef4642700 1 -- 172.21.15.26:0/4163467446 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeec06fb80 msgr2=0x7feeec10a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:22.734 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.736+0000 7feef4642700 1 --2- 172.21.15.26:0/4163467446 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeec06fb80 0x7feeec10a890 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7feee800df80 tx=0x7feee8006ee0).stop 2021-11-03T16:46:22.735 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.736+0000 7feef4642700 1 -- 172.21.15.26:0/4163467446 shutdown_connections 2021-11-03T16:46:22.735 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.736+0000 7feef4642700 1 --2- 172.21.15.26:0/4163467446 >> [v2:172.21.15.26:6800/2267111092,v1:172.21.15.26:6801/2267111092] conn(0x7feed402fd50 0x7feed4032210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T16:46:22.735 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.736+0000 7feef4642700 1 --2- 172.21.15.26:0/4163467446 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeec06fb80 0x7feeec10a890 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:22.735 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.736+0000 7feef4642700 1 -- 172.21.15.26:0/4163467446 >> 172.21.15.26:0/4163467446 conn(0x7feeec0f6260 msgr2=0x7feeec0f7c80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:22.736 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.736+0000 7feef4642700 1 -- 172.21.15.26:0/4163467446 shutdown_connections 2021-11-03T16:46:22.736 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:22.736+0000 7feef4642700 1 -- 172.21.15.26:0/4163467446 wait complete. 2021-11-03T16:46:23.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:22 smithi026 conmon[32119]: audit 2021-11-03T16:46:22.734079+0000 mon.smithi026 ( 2021-11-03T16:46:23.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:22 smithi026 conmon[32119]: mon.0) 28 : audit [DBG] from='client.? 172.21.15.26:0/4163467446' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2021-11-03T16:46:23.312 INFO:teuthology.orchestra.run.smithi026.stderr:Waiting for the mgr to restart... 2021-11-03T16:46:23.312 INFO:teuthology.orchestra.run.smithi026.stderr:Waiting for mgr epoch 5... 2021-11-03T16:46:23.312 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi026 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprh0b9ciq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpg6zn56v0:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 tell mgr mgr_status 2021-11-03T16:46:24.018 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.011+0000 7f5898b8d700 1 Processor -- start 2021-11-03T16:46:24.018 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.011+0000 7f5898b8d700 1 -- start start 2021-11-03T16:46:24.019 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.012+0000 7f5898b8d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58940faa80 0x7f58940faea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:24.019 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.012+0000 7f5898b8d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58940fb390 con 0x7f58940faa80 2021-11-03T16:46:24.019 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.012+0000 7f589259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58940faa80 0x7f58940faea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:24.020 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.012+0000 7f589259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58940faa80 0x7f58940faea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49128/0 (socket says 172.21.15.26:49128) 2021-11-03T16:46:24.020 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.012+0000 7f589259c700 1 -- 172.21.15.26:0/3494551205 learned_addr learned my addr 172.21.15.26:0/3494551205 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:24.021 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.012+0000 7f589259c700 1 -- 172.21.15.26:0/3494551205 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58940fb4d0 con 0x7f58940faa80 2021-11-03T16:46:24.021 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.012+0000 7f589259c700 1 --2- 172.21.15.26:0/3494551205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58940faa80 0x7f58940faea0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f588400b5f0 tx=0x7f5884006ee0).ready entity=mon.0 client_cookie=85711fb3f5ee9a74 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:24.022 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.012+0000 7f589159a700 1 -- 172.21.15.26:0/3494551205 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f588400d600 con 0x7f58940faa80 2021-11-03T16:46:24.022 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.013+0000 7f589159a700 1 -- 172.21.15.26:0/3494551205 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f588400dbb0 con 0x7f58940faa80 2021-11-03T16:46:24.023 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.013+0000 7f589159a700 1 -- 172.21.15.26:0/3494551205 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5884011bb0 con 0x7f58940faa80 2021-11-03T16:46:24.023 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.013+0000 7f5898b8d700 1 -- 172.21.15.26:0/3494551205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58940faa80 msgr2=0x7f58940faea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:24.024 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.013+0000 7f5898b8d700 1 --2- 172.21.15.26:0/3494551205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58940faa80 0x7f58940faea0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f588400b5f0 tx=0x7f5884006ee0).stop 2021-11-03T16:46:24.024 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.013+0000 7f5898b8d700 1 -- 172.21.15.26:0/3494551205 shutdown_connections 2021-11-03T16:46:24.024 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.013+0000 7f5898b8d700 1 --2- 172.21.15.26:0/3494551205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58940faa80 0x7f58940faea0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:24.025 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.013+0000 7f5898b8d700 1 -- 172.21.15.26:0/3494551205 >> 172.21.15.26:0/3494551205 conn(0x7f58940f6260 msgr2=0x7f58940f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:24.025 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.013+0000 7f5898b8d700 1 -- 172.21.15.26:0/3494551205 shutdown_connections 2021-11-03T16:46:24.026 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.013+0000 7f5898b8d700 1 -- 172.21.15.26:0/3494551205 wait complete. 2021-11-03T16:46:24.026 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.014+0000 7f5898b8d700 1 Processor -- start 2021-11-03T16:46:24.026 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.014+0000 7f5898b8d700 1 -- start start 2021-11-03T16:46:24.026 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.014+0000 7f5898b8d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58940faa80 0x7f5894100da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:24.027 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.014+0000 7f5898b8d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58940ff220 con 0x7f58940faa80 2021-11-03T16:46:24.027 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.014+0000 7f589259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58940faa80 0x7f5894100da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:24.027 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.014+0000 7f589259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58940faa80 0x7f5894100da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49130/0 (socket says 172.21.15.26:49130) 2021-11-03T16:46:24.027 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.014+0000 7f589259c700 1 -- 172.21.15.26:0/3966373906 learned_addr learned my addr 172.21.15.26:0/3966373906 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:24.028 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.014+0000 7f589259c700 1 -- 172.21.15.26:0/3966373906 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f588400b200 con 0x7f58940faa80 2021-11-03T16:46:24.028 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.015+0000 7f589259c700 1 --2- 172.21.15.26:0/3966373906 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58940faa80 0x7f5894100da0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f5884003000 tx=0x7f5884006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:24.028 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.015+0000 7f5882ffd700 1 -- 172.21.15.26:0/3966373906 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f588400d9c0 con 0x7f58940faa80 2021-11-03T16:46:24.028 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.015+0000 7f5882ffd700 1 -- 172.21.15.26:0/3966373906 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f588401a9d0 con 0x7f58940faa80 2021-11-03T16:46:24.028 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.015+0000 7f5882ffd700 1 -- 172.21.15.26:0/3966373906 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f588401b880 con 0x7f58940faa80 2021-11-03T16:46:24.029 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.015+0000 7f5898b8d700 1 -- 172.21.15.26:0/3966373906 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58940ff3c0 con 0x7f58940faa80 2021-11-03T16:46:24.029 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.015+0000 7f5898b8d700 1 -- 172.21.15.26:0/3966373906 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58940ff850 con 0x7f58940faa80 2021-11-03T16:46:24.029 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.016+0000 7f5882ffd700 1 -- 172.21.15.26:0/3966373906 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f588400f070 con 0x7f58940faa80 2021-11-03T16:46:24.029 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.016+0000 7f5882ffd700 1 --2- 172.21.15.26:0/3966373906 >> [v2:172.21.15.26:6800/2267111092,v1:172.21.15.26:6801/2267111092] conn(0x7f587802fdb0 0x7f5878032270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:24.029 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.016+0000 7f5882ffd700 1 -- 172.21.15.26:0/3966373906 --> [v2:172.21.15.26:6800/2267111092,v1:172.21.15.26:6801/2267111092] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5878032930 con 0x7f587802fdb0 2021-11-03T16:46:24.030 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.016+0000 7f5882ffd700 1 -- 172.21.15.26:0/3966373906 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f5884040ff0 con 0x7f58940faa80 2021-11-03T16:46:24.030 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.016+0000 7f5891d9b700 1 -- 172.21.15.26:0/3966373906 >> [v2:172.21.15.26:6800/2267111092,v1:172.21.15.26:6801/2267111092] conn(0x7f587802fdb0 msgr2=0x7f5878032270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/2267111092 2021-11-03T16:46:24.030 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.016+0000 7f5891d9b700 1 --2- 172.21.15.26:0/3966373906 >> [v2:172.21.15.26:6800/2267111092,v1:172.21.15.26:6801/2267111092] conn(0x7f587802fdb0 0x7f5878032270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2021-11-03T16:46:24.213 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.217+0000 7f5891d9b700 1 -- 172.21.15.26:0/3966373906 >> [v2:172.21.15.26:6800/2267111092,v1:172.21.15.26:6801/2267111092] conn(0x7f587802fdb0 msgr2=0x7f5878032270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/2267111092 2021-11-03T16:46:24.214 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.217+0000 7f5891d9b700 1 --2- 172.21.15.26:0/3966373906 >> [v2:172.21.15.26:6800/2267111092,v1:172.21.15.26:6801/2267111092] conn(0x7f587802fdb0 0x7f5878032270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2021-11-03T16:46:24.614 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.618+0000 7f5891d9b700 1 -- 172.21.15.26:0/3966373906 >> [v2:172.21.15.26:6800/2267111092,v1:172.21.15.26:6801/2267111092] conn(0x7f587802fdb0 msgr2=0x7f5878032270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/2267111092 2021-11-03T16:46:24.615 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:24.618+0000 7f5891d9b700 1 --2- 172.21.15.26:0/3966373906 >> [v2:172.21.15.26:6800/2267111092,v1:172.21.15.26:6801/2267111092] conn(0x7f587802fdb0 0x7f5878032270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2021-11-03T16:46:25.415 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:25.419+0000 7f5891d9b700 1 -- 172.21.15.26:0/3966373906 >> [v2:172.21.15.26:6800/2267111092,v1:172.21.15.26:6801/2267111092] conn(0x7f587802fdb0 msgr2=0x7f5878032270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/2267111092 2021-11-03T16:46:25.416 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:25.419+0000 7f5891d9b700 1 --2- 172.21.15.26:0/3966373906 >> [v2:172.21.15.26:6800/2267111092,v1:172.21.15.26:6801/2267111092] conn(0x7f587802fdb0 0x7f5878032270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2021-11-03T16:46:27.017 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:27.021+0000 7f5891d9b700 1 -- 172.21.15.26:0/3966373906 >> [v2:172.21.15.26:6800/2267111092,v1:172.21.15.26:6801/2267111092] conn(0x7f587802fdb0 msgr2=0x7f5878032270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/2267111092 2021-11-03T16:46:27.018 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:27.021+0000 7f5891d9b700 1 --2- 172.21.15.26:0/3966373906 >> [v2:172.21.15.26:6800/2267111092,v1:172.21.15.26:6801/2267111092] conn(0x7f587802fdb0 0x7f5878032270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2021-11-03T16:46:27.058 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:27.060+0000 7f5882ffd700 1 -- 172.21.15.26:0/3966373906 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mgrmap(e 6) v1 ==== 35970+0+0 (secure 0 0 0) 0x7f5884024930 con 0x7f58940faa80 2021-11-03T16:46:27.059 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:27.061+0000 7f5882ffd700 1 -- 172.21.15.26:0/3966373906 >> [v2:172.21.15.26:6800/2267111092,v1:172.21.15.26:6801/2267111092] conn(0x7f587802fdb0 msgr2=0x7f5878032270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-11-03T16:46:27.059 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:27.061+0000 7f5882ffd700 1 --2- 172.21.15.26:0/3966373906 >> [v2:172.21.15.26:6800/2267111092,v1:172.21.15.26:6801/2267111092] conn(0x7f587802fdb0 0x7f5878032270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T16:46:27.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:27 smithi026 conmon[32119]: cluster 2021-11-03T16:46:27 2021-11-03T16:46:27.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:27 smithi026 conmon[32119]: .010619+0000 mon.smithi026 (mon.0) 29 : cluster [INF] Active manager daemon smithi026.cnrxli restarted 2021-11-03T16:46:27.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:27 smithi026 conmon[32119]: cluster 2021-11-03T16:46:27.010988+0000 2021-11-03T16:46:27.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:27 smithi026 conmon[32119]: mon.smithi026 (mon.0) 30 : cluster [INF] Activating manager daemon smithi026.cnrxli 2021-11-03T16:46:27.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:27 smithi026 conmon[32119]: cluster 2021-11-03T16:46: 2021-11-03T16:46:27.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:27 smithi026 conmon[32119]: 27.012601+0000 mon.smithi026 (mon.0) 31 : 2021-11-03T16:46:27.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:27 smithi026 conmon[32119]: cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2021-11-03T16:46:28.065 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:28.067+0000 7f5882ffd700 1 -- 172.21.15.26:0/3966373906 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mgrmap(e 7) v1 ==== 36040+0+0 (secure 0 0 0) 0x7f5884042850 con 0x7f58940faa80 2021-11-03T16:46:28.065 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:28.067+0000 7f5882ffd700 1 --2- 172.21.15.26:0/3966373906 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f5878033810 0x7f5878035c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:28.065 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:28.067+0000 7f5882ffd700 1 -- 172.21.15.26:0/3966373906 --> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5878032930 con 0x7f5878033810 2021-11-03T16:46:28.066 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:28.068+0000 7f5891d9b700 1 --2- 172.21.15.26:0/3966373906 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f5878033810 0x7f5878035c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:28.066 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:28.068+0000 7f5891d9b700 1 --2- 172.21.15.26:0/3966373906 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f5878033810 0x7f5878035c00 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f5888006fd0 tx=0x7f5888006d70).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:28.066 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:28.069+0000 7f5882ffd700 1 -- 172.21.15.26:0/3966373906 <== mgr.14114 v2:172.21.15.26:6800/1563027933 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6438 (secure 0 0 0) 0x7f5878032930 con 0x7f5878033810 2021-11-03T16:46:28.076 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:28.079+0000 7f5898b8d700 1 -- 172.21.15.26:0/3966373906 --> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f5894059100 con 0x7f5878033810 2021-11-03T16:46:28.076 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:28.080+0000 7f5882ffd700 1 -- 172.21.15.26:0/3966373906 <== mgr.14114 v2:172.21.15.26:6800/1563027933 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f5894059100 con 0x7f5878033810 2021-11-03T16:46:28.077 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: { 2021-11-03T16:46:28.078 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "mgrmap_epoch": 7, 2021-11-03T16:46:28.079 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "initialized": true 2021-11-03T16:46:28.079 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: } 2021-11-03T16:46:28.080 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:28.080+0000 7f5898b8d700 1 -- 172.21.15.26:0/3966373906 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f5878033810 msgr2=0x7f5878035c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:28.080 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:28.080+0000 7f5898b8d700 1 --2- 172.21.15.26:0/3966373906 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f5878033810 0x7f5878035c00 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f5888006fd0 tx=0x7f5888006d70).stop 2021-11-03T16:46:28.080 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:28.080+0000 7f5898b8d700 1 -- 172.21.15.26:0/3966373906 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58940faa80 msgr2=0x7f5894100da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:28.080 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:28.080+0000 7f5898b8d700 1 --2- 172.21.15.26:0/3966373906 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58940faa80 0x7f5894100da0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f5884003000 tx=0x7f5884006ee0).stop 2021-11-03T16:46:28.080 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:28.080+0000 7f5898b8d700 1 -- 172.21.15.26:0/3966373906 shutdown_connections 2021-11-03T16:46:28.081 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:28.080+0000 7f5898b8d700 1 --2- 172.21.15.26:0/3966373906 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f5878033810 0x7f5878035c00 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:28.081 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:28.080+0000 7f5898b8d700 1 --2- 172.21.15.26:0/3966373906 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58940faa80 0x7f5894100da0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:28.081 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:28.080+0000 7f5898b8d700 1 --2- 172.21.15.26:0/3966373906 >> [v2:172.21.15.26:6800/2267111092,v1:172.21.15.26:6801/2267111092] conn(0x7f587802fdb0 0x7f5878032270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T16:46:28.081 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:28.080+0000 7f5898b8d700 1 -- 172.21.15.26:0/3966373906 >> 172.21.15.26:0/3966373906 conn(0x7f58940f6260 msgr2=0x7f589406f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:28.082 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:28.080+0000 7f5898b8d700 1 -- 172.21.15.26:0/3966373906 shutdown_connections 2021-11-03T16:46:28.082 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:28.080+0000 7f5898b8d700 1 -- 172.21.15.26:0/3966373906 wait complete. 2021-11-03T16:46:28.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:28 smithi026 conmon[32119]: cluster 2021-11-03T16:46:27.063373+0000 mon.smithi026 (mon.0) 32 : cluster [DBG] mgrmap e6: smithi026.cnrxli(active, starting, since 0.0524564s) 2021-11-03T16:46:28.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:28 smithi026 conmon[32119]: audit 2021-11-03T16:46:28.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:28 smithi026 conmon[32119]: 2021-11-03T16:46:27.065904+0000 mon.smithi026 (mon.0) 33 : audit [DBG] from='mgr.14114 172.21.15.26:0/2598049392' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata", "id": "smithi026"}]: dispatch 2021-11-03T16:46:28.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:28 smithi026 conmon[32119]: audit 2021-11-03T16:46:27.066118+0000 mon.smithi026 (mon.0) 34 : audit [DBG] from='mgr.14114 172.21.15.26:0/2598049392' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mgr metadata", "who": "smithi026.cnrxli", "id": "smithi026.cnrxli"}]: dispatch 2021-11-03T16:46:28.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:28 smithi026 conmon[32119]: audit 2021-11- 2021-11-03T16:46:28.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:28 smithi026 conmon[32119]: 03T16:46:27.066300+0000 mon.smithi026 (mon.0) 35 : audit [DBG] from='mgr.14114 172.21.15.26:0/2598049392' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-11-03T16:46:28.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:28 smithi026 conmon[32119]: audit 2021-11-03 2021-11-03T16:46:28.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:28 smithi026 conmon[32119]: T16:46:27.066496+0000 mon.smithi026 (mon.0) 36 : audit [DBG] from='mgr.14114 172.21.15.26:0/2598049392' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-11-03T16:46:28.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:28 smithi026 conmon[32119]: audit 2021-11-03T16:46:27.066632+0000 2021-11-03T16:46:28.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:28 smithi026 conmon[32119]: mon.smithi026 (mon.0) 37 : audit [DBG] from='mgr.14114 172.21.15.26:0/2598049392' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-11-03T16:46:28.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:28 smithi026 conmon[32119]: cluster 2021-11-03T16:46:27.069089+0000 mon.smithi026 (mon. 2021-11-03T16:46:28.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:28 smithi026 conmon[32119]: 0) 38 : cluster [INF] Manager daemon smithi026.cnrxli is now available 2021-11-03T16:46:28.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:28 smithi026 conmon[32119]: audit 2021-11-03T16:46:27.084880+0000 mon.smithi026 (mon. 2021-11-03T16:46:28.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:28 smithi026 conmon[32119]: 0) 39 : audit [INF] from='mgr.14114 172.21.15.26:0/2598049392' entity='mgr.smithi026.cnrxli' 2021-11-03T16:46:28.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:28 smithi026 conmon[32119]: audit 2021-11-03T16:46:28.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:28 smithi026 conmon[32119]: 2021-11-03T16:46:27.087611+0000 mon.smithi026 (mon.0) 40 : audit [INF] from='mgr.14114 172.21.15.26:0/2598049392' entity='mgr.smithi026.cnrxli' 2021-11-03T16:46:28.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:28 smithi026 conmon[32119]: 2021-11-03T16:46:28.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:28 smithi026 conmon[32119]: audit 2021-11-03T16:46:27. 2021-11-03T16:46:28.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:28 smithi026 conmon[32119]: 090069+0000 mon.smithi026 (mon.0) 41 : audit [INF] from='mgr.14114 172.21.15.26:0/2598049392' entity='mgr.smithi026.cnrxli' 2021-11-03T16:46:28.428 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:28 smithi026 conmon[32119]: audit 2021-11-03T16:46:28.428 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:28 smithi026 conmon[32119]: 2021-11-03T16:46:27.211261+0000 mon.smithi026 (mon.0) 42 : audit [INF] 2021-11-03T16:46:28.428 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:28 smithi026 conmon[32119]: from='mgr.14114 172.21.15.26:0/2598049392' entity='mgr.smithi026.cnrxli' 2021-11-03T16:46:28.428 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:28 smithi026 conmon[32119]: audit 2021-11 2021-11-03T16:46:28.428 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:28 smithi026 conmon[32119]: -03T16:46:27.212047+0000 mon.smithi026 (mon.0) 43 : audit [DBG] from='mgr.14114 172.21.15.26:0/2598049392' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:46:28.429 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:28 smithi026 conmon[32119]: audit 2021-11-03T16:46:27.213939+0000 2021-11-03T16:46:28.429 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:28 smithi026 conmon[32119]: mon.smithi026 (mon.0) 44 : audit [DBG] from='mgr.14114 172.21.15.26:0/2598049392' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:46:28.429 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:28 smithi026 conmon[32119]: audit 2021-11-03T16:46:27.215640+0000 2021-11-03T16:46:28.429 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:28 smithi026 conmon[32119]: mon.smithi026 (mon.0) 45 : audit [DBG] from='mgr.14114 172.21.15.26:0/2598049392' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:46:28.430 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:28 smithi026 conmon[32119]: audit 2021-11-03T16:46:27.226941+0000 mon.smithi026 (mon.0) 46 2021-11-03T16:46:28.430 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:28 smithi026 conmon[32119]: : audit [INF] from='mgr.14114 172.21.15.26:0/2598049392' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T16:46:28.430 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:28 smithi026 conmon[32119]: audit 2021 2021-11-03T16:46:28.430 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:28 smithi026 conmon[32119]: -11-03T16:46:27.228235+0000 mon.smithi026 (mon.0) 47 : audit [INF] from='mgr.14114 172.21.15.26:0/2598049392' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T16:46:28.720 INFO:teuthology.orchestra.run.smithi026.stderr:mgr epoch 5 is available 2021-11-03T16:46:28.720 INFO:teuthology.orchestra.run.smithi026.stderr:Setting orchestrator backend to cephadm... 2021-11-03T16:46:28.720 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi026 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprh0b9ciq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpg6zn56v0:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch set backend cephadm 2021-11-03T16:46:29.376 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.379+0000 7fa90ae76700 1 Processor -- start 2021-11-03T16:46:29.377 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.379+0000 7fa90ae76700 1 -- start start 2021-11-03T16:46:29.378 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.379+0000 7fa90ae76700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9040fd280 0x7fa9040fd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:29.378 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.379+0000 7fa90ae76700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9040fdb90 con 0x7fa9040fd280 2021-11-03T16:46:29.379 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.379+0000 7fa908c12700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9040fd280 0x7fa9040fd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:29.379 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.379+0000 7fa908c12700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9040fd280 0x7fa9040fd6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49164/0 (socket says 172.21.15.26:49164) 2021-11-03T16:46:29.380 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.379+0000 7fa908c12700 1 -- 172.21.15.26:0/1086654893 learned_addr learned my addr 172.21.15.26:0/1086654893 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:29.380 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.379+0000 7fa908c12700 1 -- 172.21.15.26:0/1086654893 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9040fdcd0 con 0x7fa9040fd280 2021-11-03T16:46:29.381 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.380+0000 7fa908c12700 1 --2- 172.21.15.26:0/1086654893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9040fd280 0x7fa9040fd6a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fa8f800b5f0 tx=0x7fa8f8006ee0).ready entity=mon.0 client_cookie=49bea96661cdbd5f server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:29.381 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.380+0000 7fa9037fe700 1 -- 172.21.15.26:0/1086654893 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8f800d600 con 0x7fa9040fd280 2021-11-03T16:46:29.381 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.380+0000 7fa9037fe700 1 -- 172.21.15.26:0/1086654893 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7fa8f800dbb0 con 0x7fa9040fd280 2021-11-03T16:46:29.381 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.380+0000 7fa9037fe700 1 -- 172.21.15.26:0/1086654893 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8f8011bb0 con 0x7fa9040fd280 2021-11-03T16:46:29.382 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.381+0000 7fa90ae76700 1 -- 172.21.15.26:0/1086654893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9040fd280 msgr2=0x7fa9040fd6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:29.382 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.381+0000 7fa90ae76700 1 --2- 172.21.15.26:0/1086654893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9040fd280 0x7fa9040fd6a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fa8f800b5f0 tx=0x7fa8f8006ee0).stop 2021-11-03T16:46:29.382 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.381+0000 7fa90ae76700 1 -- 172.21.15.26:0/1086654893 shutdown_connections 2021-11-03T16:46:29.382 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.381+0000 7fa90ae76700 1 --2- 172.21.15.26:0/1086654893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9040fd280 0x7fa9040fd6a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:29.385 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.381+0000 7fa90ae76700 1 -- 172.21.15.26:0/1086654893 >> 172.21.15.26:0/1086654893 conn(0x7fa9040f5a60 msgr2=0x7fa9040f7e80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:29.386 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.381+0000 7fa90ae76700 1 -- 172.21.15.26:0/1086654893 shutdown_connections 2021-11-03T16:46:29.386 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.381+0000 7fa90ae76700 1 -- 172.21.15.26:0/1086654893 wait complete. 2021-11-03T16:46:29.386 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.381+0000 7fa90ae76700 1 Processor -- start 2021-11-03T16:46:29.386 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.381+0000 7fa90ae76700 1 -- start start 2021-11-03T16:46:29.386 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.382+0000 7fa90ae76700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9040fd280 0x7fa90410a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:29.387 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.382+0000 7fa90ae76700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90410adf0 con 0x7fa9040fd280 2021-11-03T16:46:29.387 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.382+0000 7fa908c12700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9040fd280 0x7fa90410a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:29.387 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.382+0000 7fa908c12700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9040fd280 0x7fa90410a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49166/0 (socket says 172.21.15.26:49166) 2021-11-03T16:46:29.387 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.382+0000 7fa908c12700 1 -- 172.21.15.26:0/3735819383 learned_addr learned my addr 172.21.15.26:0/3735819383 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:29.388 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.382+0000 7fa908c12700 1 -- 172.21.15.26:0/3735819383 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f800b200 con 0x7fa9040fd280 2021-11-03T16:46:29.388 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.382+0000 7fa908c12700 1 --2- 172.21.15.26:0/3735819383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9040fd280 0x7fa90410a900 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fa8f8006a30 tx=0x7fa8f8006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:29.388 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.383+0000 7fa9017fa700 1 -- 172.21.15.26:0/3735819383 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8f801b570 con 0x7fa9040fd280 2021-11-03T16:46:29.388 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.383+0000 7fa9017fa700 1 -- 172.21.15.26:0/3735819383 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7fa8f801bb20 con 0x7fa9040fd280 2021-11-03T16:46:29.389 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.383+0000 7fa90ae76700 1 -- 172.21.15.26:0/3735819383 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa90410aff0 con 0x7fa9040fd280 2021-11-03T16:46:29.389 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.383+0000 7fa9017fa700 1 -- 172.21.15.26:0/3735819383 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8f801aa00 con 0x7fa9040fd280 2021-11-03T16:46:29.389 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.383+0000 7fa90ae76700 1 -- 172.21.15.26:0/3735819383 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa90410b480 con 0x7fa9040fd280 2021-11-03T16:46:29.389 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.383+0000 7fa9017fa700 1 -- 172.21.15.26:0/3735819383 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7fa8f800f070 con 0x7fa9040fd280 2021-11-03T16:46:29.389 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.384+0000 7fa9017fa700 1 --2- 172.21.15.26:0/3735819383 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7fa8e802fd50 0x7fa8e8032210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:29.390 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.384+0000 7fa9017fa700 1 -- 172.21.15.26:0/3735819383 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7fa8f8041230 con 0x7fa9040fd280 2021-11-03T16:46:29.390 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.384+0000 7fa90ae76700 1 -- 172.21.15.26:0/3735819383 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa904045ad0 con 0x7fa9040fd280 2021-11-03T16:46:29.390 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.384+0000 7fa903fff700 1 --2- 172.21.15.26:0/3735819383 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7fa8e802fd50 0x7fa8e8032210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:29.390 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.384+0000 7fa903fff700 1 --2- 172.21.15.26:0/3735819383 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7fa8e802fd50 0x7fa8e8032210 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fa8f00096a0 tx=0x7fa8f0006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:29.390 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.388+0000 7fa9017fa700 1 -- 172.21.15.26:0/3735819383 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fa8f801ac70 con 0x7fa9040fd280 2021-11-03T16:46:29.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:29 smithi026 conmon[32119]: audit 2021-11-03T16:46:28.070443+0000 mgr.smithi026.cnrxli ( 2021-11-03T16:46:29.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:29 smithi026 conmon[32119]: mgr.14114) 1 : audit [DBG] from='client.14118 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2021-11-03T16:46:29.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:29 smithi026 conmon[32119]: cluster 2021-11-03T16:46:28.071243+0000 mon.smithi026 (mon.0) 48 : cluster [DBG] mgrmap e7: smithi026.cnrxli(active, since 1.06032s) 2021-11-03T16:46:29.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:29 smithi026 conmon[32119]: audit 2021-11-03T16:46:28.081542+0000 mgr.smithi026.cnrxli (mgr.14114) 2 : audit [DBG] from='client.14118 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2021-11-03T16:46:29.730 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.734+0000 7fa90ae76700 1 -- 172.21.15.26:0/3735819383 --> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7fa90410bce0 con 0x7fa8e802fd50 2021-11-03T16:46:29.735 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.740+0000 7fa9017fa700 1 -- 172.21.15.26:0/3735819383 <== mgr.14114 v2:172.21.15.26:6800/1563027933 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fa90410bce0 con 0x7fa8e802fd50 2021-11-03T16:46:29.738 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.742+0000 7fa90ae76700 1 -- 172.21.15.26:0/3735819383 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7fa8e802fd50 msgr2=0x7fa8e8032210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:29.738 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.742+0000 7fa90ae76700 1 --2- 172.21.15.26:0/3735819383 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7fa8e802fd50 0x7fa8e8032210 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fa8f00096a0 tx=0x7fa8f0006b40).stop 2021-11-03T16:46:29.739 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.742+0000 7fa90ae76700 1 -- 172.21.15.26:0/3735819383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9040fd280 msgr2=0x7fa90410a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:29.739 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.742+0000 7fa90ae76700 1 --2- 172.21.15.26:0/3735819383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9040fd280 0x7fa90410a900 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fa8f8006a30 tx=0x7fa8f8006ee0).stop 2021-11-03T16:46:29.739 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.742+0000 7fa90ae76700 1 -- 172.21.15.26:0/3735819383 shutdown_connections 2021-11-03T16:46:29.739 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.742+0000 7fa90ae76700 1 --2- 172.21.15.26:0/3735819383 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7fa8e802fd50 0x7fa8e8032210 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:29.740 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.742+0000 7fa90ae76700 1 --2- 172.21.15.26:0/3735819383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9040fd280 0x7fa90410a900 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:29.740 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.742+0000 7fa90ae76700 1 -- 172.21.15.26:0/3735819383 >> 172.21.15.26:0/3735819383 conn(0x7fa9040f5a60 msgr2=0x7fa9040ff180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:29.740 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.742+0000 7fa90ae76700 1 -- 172.21.15.26:0/3735819383 shutdown_connections 2021-11-03T16:46:29.740 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:29.742+0000 7fa90ae76700 1 -- 172.21.15.26:0/3735819383 wait complete. 2021-11-03T16:46:30.286 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi026 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprh0b9ciq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpg6zn56v0:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 cephadm set-user root 2021-11-03T16:46:30.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:30 smithi026 conmon[32119]: cluster 2021-11-03T16:46:29.072012+0000 mon.smithi026 2021-11-03T16:46:30.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:30 smithi026 conmon[32119]: (mon.0) 49 : cluster [DBG] mgrmap e8: smithi026.cnrxli(active, since 2s) 2021-11-03T16:46:30.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:30 smithi026 conmon[32119]: audit 2021-11-03T16:46:29.736233+0000 mgr.smithi026.cnrxli (mgr.14114) 3 2021-11-03T16:46:30.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:30 smithi026 conmon[32119]: : audit [DBG] from='client.14124 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:46:30.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:30 smithi026 conmon[32119]: audit 2021-11-03T16:46:30.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:30 smithi026 conmon[32119]: 2021-11-03T16:46:29.740397+0000 mon.smithi026 (mon 2021-11-03T16:46:30.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:30 smithi026 conmon[32119]: .0) 50 : audit [INF] from='mgr.14114 172.21.15.26:0/2598049392' entity='mgr.smithi026.cnrxli' 2021-11-03T16:46:30.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:30 smithi026 conmon[32119]: audit 2021- 2021-11-03T16:46:30.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:30 smithi026 conmon[32119]: 11-03T16:46:29.744392+0000 mon.smithi026 (mon.0) 2021-11-03T16:46:30.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:30 smithi026 conmon[32119]: 51 : audit [DBG] from='mgr.14114 172.21.15.26:0/2598049392' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:46:30.916 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:30.911+0000 7f9607347700 1 Processor -- start 2021-11-03T16:46:30.917 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:30.911+0000 7f9607347700 1 -- start start 2021-11-03T16:46:30.917 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:30.911+0000 7f9607347700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f960006fb40 0x7f9600100ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:30.918 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:30.911+0000 7f9607347700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96000fc4a0 con 0x7f960006fb40 2021-11-03T16:46:30.918 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:30.912+0000 7f9606345700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f960006fb40 0x7f9600100ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:30.919 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:30.912+0000 7f9606345700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f960006fb40 0x7f9600100ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49170/0 (socket says 172.21.15.26:49170) 2021-11-03T16:46:30.919 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:30.912+0000 7f9606345700 1 -- 172.21.15.26:0/2961644219 learned_addr learned my addr 172.21.15.26:0/2961644219 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:30.920 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:30.912+0000 7f9606345700 1 -- 172.21.15.26:0/2961644219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9600100fa0 con 0x7f960006fb40 2021-11-03T16:46:30.920 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:30.912+0000 7f9606345700 1 --2- 172.21.15.26:0/2961644219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f960006fb40 0x7f9600100ab0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f95f8009960 tx=0x7f95f80092d0).ready entity=mon.0 client_cookie=74a37ffae1c22f71 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:30.920 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:30.912+0000 7f9605343700 1 -- 172.21.15.26:0/2961644219 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f95f800b9c0 con 0x7f960006fb40 2021-11-03T16:46:30.920 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:30.913+0000 7f9605343700 1 -- 172.21.15.26:0/2961644219 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f95f8011400 con 0x7f960006fb40 2021-11-03T16:46:30.921 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:30.913+0000 7f9605343700 1 -- 172.21.15.26:0/2961644219 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f95f8010580 con 0x7f960006fb40 2021-11-03T16:46:30.921 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:30.913+0000 7f9607347700 1 -- 172.21.15.26:0/2961644219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f960006fb40 msgr2=0x7f9600100ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:30.921 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:30.913+0000 7f9607347700 1 --2- 172.21.15.26:0/2961644219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f960006fb40 0x7f9600100ab0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f95f8009960 tx=0x7f95f80092d0).stop 2021-11-03T16:46:30.921 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:30.913+0000 7f9607347700 1 -- 172.21.15.26:0/2961644219 shutdown_connections 2021-11-03T16:46:30.922 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:30.913+0000 7f9607347700 1 --2- 172.21.15.26:0/2961644219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f960006fb40 0x7f9600100ab0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:30.922 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:30.913+0000 7f9607347700 1 -- 172.21.15.26:0/2961644219 >> 172.21.15.26:0/2961644219 conn(0x7f96000f6110 msgr2=0x7f96000f8530 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:30.922 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:30.913+0000 7f9607347700 1 -- 172.21.15.26:0/2961644219 shutdown_connections 2021-11-03T16:46:30.922 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:30.913+0000 7f9607347700 1 -- 172.21.15.26:0/2961644219 wait complete. 2021-11-03T16:46:30.923 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:30.914+0000 7f9607347700 1 Processor -- start 2021-11-03T16:46:30.923 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:30.914+0000 7f9607347700 1 -- start start 2021-11-03T16:46:30.923 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:30.914+0000 7f9607347700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f960006fb40 0x7f960010c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:30.923 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:30.914+0000 7f9607347700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960010ce50 con 0x7f960006fb40 2021-11-03T16:46:30.924 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:30.914+0000 7f9606345700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f960006fb40 0x7f960010c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:30.924 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:30.914+0000 7f9606345700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f960006fb40 0x7f960010c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49172/0 (socket says 172.21.15.26:49172) 2021-11-03T16:46:30.924 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:30.914+0000 7f9606345700 1 -- 172.21.15.26:0/4274507616 learned_addr learned my addr 172.21.15.26:0/4274507616 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:30.924 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:30.914+0000 7f9606345700 1 -- 172.21.15.26:0/4274507616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f8009570 con 0x7f960006fb40 2021-11-03T16:46:30.925 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:30.914+0000 7f9606345700 1 --2- 172.21.15.26:0/4274507616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f960006fb40 0x7f960010c960 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f95f800ba90 tx=0x7f95f80092d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:30.925 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:30.915+0000 7f95eeffd700 1 -- 172.21.15.26:0/4274507616 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f95f8010840 con 0x7f960006fb40 2021-11-03T16:46:30.925 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:30.915+0000 7f9607347700 1 -- 172.21.15.26:0/4274507616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f960010d050 con 0x7f960006fb40 2021-11-03T16:46:30.925 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:30.915+0000 7f95eeffd700 1 -- 172.21.15.26:0/4274507616 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f95f8010df0 con 0x7f960006fb40 2021-11-03T16:46:30.926 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:30.915+0000 7f95eeffd700 1 -- 172.21.15.26:0/4274507616 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f95f801ae20 con 0x7f960006fb40 2021-11-03T16:46:30.926 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:30.915+0000 7f9607347700 1 -- 172.21.15.26:0/4274507616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f960010d4e0 con 0x7f960006fb40 2021-11-03T16:46:30.926 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:30.915+0000 7f95eeffd700 1 -- 172.21.15.26:0/4274507616 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f95f800f070 con 0x7f960006fb40 2021-11-03T16:46:30.926 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:30.916+0000 7f95eeffd700 1 --2- 172.21.15.26:0/4274507616 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f95e802fd50 0x7f95e8032210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:30.927 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:30.916+0000 7f95eeffd700 1 -- 172.21.15.26:0/4274507616 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f95f80109a0 con 0x7f960006fb40 2021-11-03T16:46:30.927 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:30.916+0000 7f9607347700 1 -- 172.21.15.26:0/4274507616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9600045ad0 con 0x7f960006fb40 2021-11-03T16:46:30.927 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:30.916+0000 7f9605b44700 1 --2- 172.21.15.26:0/4274507616 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f95e802fd50 0x7f95e8032210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:30.927 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:30.917+0000 7f9605b44700 1 --2- 172.21.15.26:0/4274507616 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f95e802fd50 0x7f95e8032210 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f95f00096a0 tx=0x7f95f0006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:30.928 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:30.920+0000 7f95eeffd700 1 -- 172.21.15.26:0/4274507616 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f95f801e030 con 0x7f960006fb40 2021-11-03T16:46:31.204 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:31.208+0000 7f9607347700 1 -- 172.21.15.26:0/4274507616 --> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f960010dd40 con 0x7f95e802fd50 2021-11-03T16:46:31.205 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:31.209+0000 7f95eeffd700 1 -- 172.21.15.26:0/4274507616 <== mgr.14114 v2:172.21.15.26:6800/1563027933 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f960010dd40 con 0x7f95e802fd50 2021-11-03T16:46:31.205 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: value unchanged 2021-11-03T16:46:31.207 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:31.210+0000 7f9607347700 1 -- 172.21.15.26:0/4274507616 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f95e802fd50 msgr2=0x7f95e8032210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:31.207 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:31.211+0000 7f9607347700 1 --2- 172.21.15.26:0/4274507616 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f95e802fd50 0x7f95e8032210 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f95f00096a0 tx=0x7f95f0006b40).stop 2021-11-03T16:46:31.208 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:31.211+0000 7f9607347700 1 -- 172.21.15.26:0/4274507616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f960006fb40 msgr2=0x7f960010c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:31.208 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:31.211+0000 7f9607347700 1 --2- 172.21.15.26:0/4274507616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f960006fb40 0x7f960010c960 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f95f800ba90 tx=0x7f95f80092d0).stop 2021-11-03T16:46:31.208 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:31.211+0000 7f9607347700 1 -- 172.21.15.26:0/4274507616 shutdown_connections 2021-11-03T16:46:31.209 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:31.211+0000 7f9607347700 1 --2- 172.21.15.26:0/4274507616 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f95e802fd50 0x7f95e8032210 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:31.209 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:31.211+0000 7f9607347700 1 --2- 172.21.15.26:0/4274507616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f960006fb40 0x7f960010c960 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:31.209 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:31.211+0000 7f9607347700 1 -- 172.21.15.26:0/4274507616 >> 172.21.15.26:0/4274507616 conn(0x7f96000f6110 msgr2=0x7f96000f7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:31.209 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:31.211+0000 7f9607347700 1 -- 172.21.15.26:0/4274507616 shutdown_connections 2021-11-03T16:46:31.210 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:31.211+0000 7f9607347700 1 -- 172.21.15.26:0/4274507616 wait complete. 2021-11-03T16:46:31.887 INFO:teuthology.orchestra.run.smithi026.stderr:Generating ssh key... 2021-11-03T16:46:31.887 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi026 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprh0b9ciq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpg6zn56v0:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 cephadm generate-key 2021-11-03T16:46:32.154 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:32 smithi026 conmon[32119]: audit 2021-11-03T16:46:31.209721+0000 mgr.smithi026.cnrxli (mgr.14114) 4 : audit [DBG] from='client.14126 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:46:32.543 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:32.542+0000 7f03917d6700 1 Processor -- start 2021-11-03T16:46:32.543 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:32.542+0000 7f03917d6700 1 -- start start 2021-11-03T16:46:32.544 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:32.542+0000 7f03917d6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f038c0fd260 0x7f038c0fd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:32.544 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:32.542+0000 7f03917d6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038c0fdb70 con 0x7f038c0fd260 2021-11-03T16:46:32.544 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:32.543+0000 7f038affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f038c0fd260 0x7f038c0fd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:32.544 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:32.543+0000 7f038affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f038c0fd260 0x7f038c0fd680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49176/0 (socket says 172.21.15.26:49176) 2021-11-03T16:46:32.544 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:32.543+0000 7f038affd700 1 -- 172.21.15.26:0/431267035 learned_addr learned my addr 172.21.15.26:0/431267035 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:32.545 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:32.543+0000 7f038affd700 1 -- 172.21.15.26:0/431267035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f038c0fdcb0 con 0x7f038c0fd260 2021-11-03T16:46:32.545 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:32.543+0000 7f038affd700 1 --2- 172.21.15.26:0/431267035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f038c0fd260 0x7f038c0fd680 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f0384009960 tx=0x7f03840092d0).ready entity=mon.0 client_cookie=c2f6c2a2a0f0c2f2 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:32.545 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:32.543+0000 7f0389ffb700 1 -- 172.21.15.26:0/431267035 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f038400b9c0 con 0x7f038c0fd260 2021-11-03T16:46:32.545 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:32.543+0000 7f0389ffb700 1 -- 172.21.15.26:0/431267035 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f0384011400 con 0x7f038c0fd260 2021-11-03T16:46:32.546 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:32.543+0000 7f0389ffb700 1 -- 172.21.15.26:0/431267035 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0384010580 con 0x7f038c0fd260 2021-11-03T16:46:32.546 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:32.544+0000 7f03917d6700 1 -- 172.21.15.26:0/431267035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f038c0fd260 msgr2=0x7f038c0fd680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:32.546 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:32.544+0000 7f03917d6700 1 --2- 172.21.15.26:0/431267035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f038c0fd260 0x7f038c0fd680 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f0384009960 tx=0x7f03840092d0).stop 2021-11-03T16:46:32.546 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:32.544+0000 7f03917d6700 1 -- 172.21.15.26:0/431267035 shutdown_connections 2021-11-03T16:46:32.547 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:32.544+0000 7f03917d6700 1 --2- 172.21.15.26:0/431267035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f038c0fd260 0x7f038c0fd680 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:32.547 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:32.544+0000 7f03917d6700 1 -- 172.21.15.26:0/431267035 >> 172.21.15.26:0/431267035 conn(0x7f038c0f5a60 msgr2=0x7f038c0f7e80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:32.547 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:32.544+0000 7f03917d6700 1 -- 172.21.15.26:0/431267035 shutdown_connections 2021-11-03T16:46:32.547 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:32.544+0000 7f03917d6700 1 -- 172.21.15.26:0/431267035 wait complete. 2021-11-03T16:46:32.548 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:32.545+0000 7f03917d6700 1 Processor -- start 2021-11-03T16:46:32.548 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:32.545+0000 7f03917d6700 1 -- start start 2021-11-03T16:46:32.548 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:32.545+0000 7f03917d6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f038c0fd260 0x7f038c10a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:32.548 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:32.545+0000 7f03917d6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038c10aea0 con 0x7f038c0fd260 2021-11-03T16:46:32.549 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:32.545+0000 7f038affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f038c0fd260 0x7f038c10a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:32.549 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:32.545+0000 7f038affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f038c0fd260 0x7f038c10a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49178/0 (socket says 172.21.15.26:49178) 2021-11-03T16:46:32.549 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:32.545+0000 7f038affd700 1 -- 172.21.15.26:0/237087536 learned_addr learned my addr 172.21.15.26:0/237087536 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:32.549 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:32.545+0000 7f038affd700 1 -- 172.21.15.26:0/237087536 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0384009570 con 0x7f038c0fd260 2021-11-03T16:46:32.550 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:32.545+0000 7f038affd700 1 --2- 172.21.15.26:0/237087536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f038c0fd260 0x7f038c10a9b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f0384006f00 tx=0x7f03840092d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:32.550 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:32.545+0000 7f03837fe700 1 -- 172.21.15.26:0/237087536 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f03840107f0 con 0x7f038c0fd260 2021-11-03T16:46:32.550 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:32.546+0000 7f03837fe700 1 -- 172.21.15.26:0/237087536 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f0384010da0 con 0x7f038c0fd260 2021-11-03T16:46:32.550 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:32.546+0000 7f03917d6700 1 -- 172.21.15.26:0/237087536 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f038c10b0a0 con 0x7f038c0fd260 2021-11-03T16:46:32.551 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:32.546+0000 7f03837fe700 1 -- 172.21.15.26:0/237087536 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f038401ac70 con 0x7f038c0fd260 2021-11-03T16:46:32.551 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:32.546+0000 7f03917d6700 1 -- 172.21.15.26:0/237087536 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f038c10b530 con 0x7f038c0fd260 2021-11-03T16:46:32.551 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:32.546+0000 7f03837fe700 1 -- 172.21.15.26:0/237087536 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f038400f070 con 0x7f038c0fd260 2021-11-03T16:46:32.551 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:32.547+0000 7f03837fe700 1 --2- 172.21.15.26:0/237087536 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f036c02fdb0 0x7f036c032270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:32.552 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:32.547+0000 7f03837fe700 1 -- 172.21.15.26:0/237087536 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f0384041950 con 0x7f038c0fd260 2021-11-03T16:46:32.552 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:32.547+0000 7f03917d6700 1 -- 172.21.15.26:0/237087536 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f038c045ad0 con 0x7f038c0fd260 2021-11-03T16:46:32.552 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:32.547+0000 7f038a7fc700 1 --2- 172.21.15.26:0/237087536 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f036c02fdb0 0x7f036c032270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:32.552 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:32.547+0000 7f038a7fc700 1 --2- 172.21.15.26:0/237087536 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f036c02fdb0 0x7f036c032270 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f03740096a0 tx=0x7f0374006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:32.553 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:32.551+0000 7f03837fe700 1 -- 172.21.15.26:0/237087536 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f0384018500 con 0x7f038c0fd260 2021-11-03T16:46:32.834 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:32.838+0000 7f03917d6700 1 -- 172.21.15.26:0/237087536 --> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f038c10bd90 con 0x7f036c02fdb0 2021-11-03T16:46:33.066 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:33.070+0000 7f03837fe700 1 -- 172.21.15.26:0/237087536 <== mgr.14114 v2:172.21.15.26:6800/1563027933 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f038c10bd90 con 0x7f036c02fdb0 2021-11-03T16:46:33.069 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:33.072+0000 7f03917d6700 1 -- 172.21.15.26:0/237087536 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f036c02fdb0 msgr2=0x7f036c032270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:33.069 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:33.072+0000 7f03917d6700 1 --2- 172.21.15.26:0/237087536 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f036c02fdb0 0x7f036c032270 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f03740096a0 tx=0x7f0374006b40).stop 2021-11-03T16:46:33.069 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:33.072+0000 7f03917d6700 1 -- 172.21.15.26:0/237087536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f038c0fd260 msgr2=0x7f038c10a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:33.070 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:33.072+0000 7f03917d6700 1 --2- 172.21.15.26:0/237087536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f038c0fd260 0x7f038c10a9b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f0384006f00 tx=0x7f03840092d0).stop 2021-11-03T16:46:33.070 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:33.072+0000 7f03917d6700 1 -- 172.21.15.26:0/237087536 shutdown_connections 2021-11-03T16:46:33.070 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:33.072+0000 7f03917d6700 1 --2- 172.21.15.26:0/237087536 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f036c02fdb0 0x7f036c032270 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:33.070 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:33.072+0000 7f03917d6700 1 --2- 172.21.15.26:0/237087536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f038c0fd260 0x7f038c10a9b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:33.071 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:33.072+0000 7f03917d6700 1 -- 172.21.15.26:0/237087536 >> 172.21.15.26:0/237087536 conn(0x7f038c0f5a60 msgr2=0x7f038c0ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:33.071 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:33.072+0000 7f03917d6700 1 -- 172.21.15.26:0/237087536 shutdown_connections 2021-11-03T16:46:33.071 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:33.072+0000 7f03917d6700 1 -- 172.21.15.26:0/237087536 wait complete. 2021-11-03T16:46:33.660 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi026 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprh0b9ciq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpg6zn56v0:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 cephadm get-pub-key 2021-11-03T16:46:34.281 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.283+0000 7f9d39ff6700 1 Processor -- start 2021-11-03T16:46:34.281 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.283+0000 7f9d39ff6700 1 -- start start 2021-11-03T16:46:34.281 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.283+0000 7f9d39ff6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d34071c40 0x7f9d340701e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:34.282 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.283+0000 7f9d39ff6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d34072060 con 0x7f9d34071c40 2021-11-03T16:46:34.282 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.284+0000 7f9d337fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d34071c40 0x7f9d340701e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:34.282 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.284+0000 7f9d337fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d34071c40 0x7f9d340701e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49182/0 (socket says 172.21.15.26:49182) 2021-11-03T16:46:34.282 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.284+0000 7f9d337fe700 1 -- 172.21.15.26:0/3823961845 learned_addr learned my addr 172.21.15.26:0/3823961845 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:34.283 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.284+0000 7f9d337fe700 1 -- 172.21.15.26:0/3823961845 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d340706d0 con 0x7f9d34071c40 2021-11-03T16:46:34.283 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.284+0000 7f9d337fe700 1 --2- 172.21.15.26:0/3823961845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d34071c40 0x7f9d340701e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f9d2400b5f0 tx=0x7f9d24006ee0).ready entity=mon.0 client_cookie=e5bca570f1346374 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:34.283 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.284+0000 7f9d327fc700 1 -- 172.21.15.26:0/3823961845 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9d2400d600 con 0x7f9d34071c40 2021-11-03T16:46:34.284 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.284+0000 7f9d327fc700 1 -- 172.21.15.26:0/3823961845 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f9d2400dbb0 con 0x7f9d34071c40 2021-11-03T16:46:34.284 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.284+0000 7f9d327fc700 1 -- 172.21.15.26:0/3823961845 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9d24011bb0 con 0x7f9d34071c40 2021-11-03T16:46:34.284 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.285+0000 7f9d39ff6700 1 -- 172.21.15.26:0/3823961845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d34071c40 msgr2=0x7f9d340701e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:34.284 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.285+0000 7f9d39ff6700 1 --2- 172.21.15.26:0/3823961845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d34071c40 0x7f9d340701e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f9d2400b5f0 tx=0x7f9d24006ee0).stop 2021-11-03T16:46:34.285 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.285+0000 7f9d39ff6700 1 -- 172.21.15.26:0/3823961845 shutdown_connections 2021-11-03T16:46:34.285 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.285+0000 7f9d39ff6700 1 --2- 172.21.15.26:0/3823961845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d34071c40 0x7f9d340701e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:34.285 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.285+0000 7f9d39ff6700 1 -- 172.21.15.26:0/3823961845 >> 172.21.15.26:0/3823961845 conn(0x7f9d340f73e0 msgr2=0x7f9d340f9800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:34.285 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.285+0000 7f9d39ff6700 1 -- 172.21.15.26:0/3823961845 shutdown_connections 2021-11-03T16:46:34.285 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.285+0000 7f9d39ff6700 1 -- 172.21.15.26:0/3823961845 wait complete. 2021-11-03T16:46:34.286 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.285+0000 7f9d39ff6700 1 Processor -- start 2021-11-03T16:46:34.286 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.286+0000 7f9d39ff6700 1 -- start start 2021-11-03T16:46:34.289 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.286+0000 7f9d39ff6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d34071c40 0x7f9d3410cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:34.289 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.286+0000 7f9d39ff6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3410d040 con 0x7f9d34071c40 2021-11-03T16:46:34.289 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.286+0000 7f9d337fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d34071c40 0x7f9d3410cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:34.289 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.286+0000 7f9d337fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d34071c40 0x7f9d3410cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49184/0 (socket says 172.21.15.26:49184) 2021-11-03T16:46:34.290 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.286+0000 7f9d337fe700 1 -- 172.21.15.26:0/2951209901 learned_addr learned my addr 172.21.15.26:0/2951209901 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:34.290 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.286+0000 7f9d337fe700 1 -- 172.21.15.26:0/2951209901 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d2400b200 con 0x7f9d34071c40 2021-11-03T16:46:34.290 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.286+0000 7f9d337fe700 1 --2- 172.21.15.26:0/2951209901 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d34071c40 0x7f9d3410cb50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f9d24006cb0 tx=0x7f9d24006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:34.290 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.287+0000 7f9d1bfff700 1 -- 172.21.15.26:0/2951209901 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9d2401b410 con 0x7f9d34071c40 2021-11-03T16:46:34.291 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.287+0000 7f9d39ff6700 1 -- 172.21.15.26:0/2951209901 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d3410d240 con 0x7f9d34071c40 2021-11-03T16:46:34.291 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.287+0000 7f9d1bfff700 1 -- 172.21.15.26:0/2951209901 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f9d2401b9c0 con 0x7f9d34071c40 2021-11-03T16:46:34.291 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.287+0000 7f9d1bfff700 1 -- 172.21.15.26:0/2951209901 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9d2401a6f0 con 0x7f9d34071c40 2021-11-03T16:46:34.291 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.287+0000 7f9d39ff6700 1 -- 172.21.15.26:0/2951209901 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d3410d6d0 con 0x7f9d34071c40 2021-11-03T16:46:34.292 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.287+0000 7f9d1bfff700 1 -- 172.21.15.26:0/2951209901 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f9d2400f070 con 0x7f9d34071c40 2021-11-03T16:46:34.292 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.287+0000 7f9d1bfff700 1 --2- 172.21.15.26:0/2951209901 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f9d2002fd50 0x7f9d20032210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:34.292 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.287+0000 7f9d1bfff700 1 -- 172.21.15.26:0/2951209901 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f9d24041e60 con 0x7f9d34071c40 2021-11-03T16:46:34.292 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.288+0000 7f9d32ffd700 1 --2- 172.21.15.26:0/2951209901 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f9d2002fd50 0x7f9d20032210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:34.292 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.288+0000 7f9d39ff6700 1 -- 172.21.15.26:0/2951209901 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d34045ad0 con 0x7f9d34071c40 2021-11-03T16:46:34.293 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.288+0000 7f9d32ffd700 1 --2- 172.21.15.26:0/2951209901 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f9d2002fd50 0x7f9d20032210 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f9d280096a0 tx=0x7f9d28006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:34.293 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.292+0000 7f9d1bfff700 1 -- 172.21.15.26:0/2951209901 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f9d24016070 con 0x7f9d34071c40 2021-11-03T16:46:34.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:33 smithi026 conmon[32119]: cephadm 2021-11-03T16:46: 2021-11-03T16:46:34.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:33 smithi026 conmon[32119]: 32.840146+0000 mgr.smithi026.cnrxli (mgr.14114) 6 : cephadm [INF] Generating ssh key... 2021-11-03T16:46:34.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:33 smithi026 conmon[32119]: audit 2021-11 2021-11-03T16:46:34.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:33 smithi026 conmon[32119]: -03T16:46:33.068428+0000 mon.smithi026 (mon 2021-11-03T16:46:34.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:33 smithi026 conmon[32119]: .0) 52 : audit [INF] from='mgr.14114 172.21.15.26:0/2598049392' entity='mgr.smithi026.cnrxli' 2021-11-03T16:46:34.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:33 smithi026 conmon[32119]: audit 2021-11-03T16:46:34.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:33 smithi026 conmon[32119]: 2021-11-03T16:46:33.070105+0000 2021-11-03T16:46:34.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:33 smithi026 conmon[32119]: mon.smithi026 (mon.0) 53 : audit [INF] 2021-11-03T16:46:34.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:33 smithi026 conmon[32119]: from='mgr.14114 172.21.15.26:0/2598049392' entity='mgr.smithi026.cnrxli' 2021-11-03T16:46:34.575 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.579+0000 7f9d39ff6700 1 -- 172.21.15.26:0/2951209901 --> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f9d34106b30 con 0x7f9d2002fd50 2021-11-03T16:46:34.575 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.579+0000 7f9d1bfff700 1 -- 172.21.15.26:0/2951209901 <== mgr.14114 v2:172.21.15.26:6800/1563027933 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f9d34106b30 con 0x7f9d2002fd50 2021-11-03T16:46:34.575 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGaPbf6j1lcS4EXqEnED4gacO8EVouvg0r/r/vY+4wjFP+dwfnHuc1VMIYJjTR0J4X6s7p/iGUtuH17UEdB4W0KIuhkn3HmRQZ5xR9dxkaPL33VyrPlnHEJ91Q+GVj0ljmPmhw6opTHT9HG01/0PyLzF0Blolr1dtppQe2yXTLJxTopb1GklKRlYWZXv8gyNVHdNaaosWzosx5Wl+xzKAfLE8yfMPSu/AuKz8rcTIUIPCrJ5vD8Z3YXKhv7hI1FvKhVtbJswDdHSNaPskGWHVC6UN+EIukmbyEw0jJr7v/uH4XSwIoRItWsVHXZI8JJNgXnZwex2CoAVx3ErC5TLbVbtUBjyncjOeu0PxIukdvGrXZVZbiAZTQHCuSWU7C0qFrPecBDFV4y0YBjCK6C2wabbJWb+FgW9kfnvRdSMNKRhKwDhaJ2w8fEoV3P/bf7IAWrIm1Xb8tULmBp1tW8SsWCCk8GFkP6rJ149KSJb6lEneyyp4gTgYwucS68jJowKU= ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c 2021-11-03T16:46:34.577 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.581+0000 7f9d39ff6700 1 -- 172.21.15.26:0/2951209901 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f9d2002fd50 msgr2=0x7f9d20032210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:34.577 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.581+0000 7f9d39ff6700 1 --2- 172.21.15.26:0/2951209901 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f9d2002fd50 0x7f9d20032210 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f9d280096a0 tx=0x7f9d28006b40).stop 2021-11-03T16:46:34.578 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.581+0000 7f9d39ff6700 1 -- 172.21.15.26:0/2951209901 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d34071c40 msgr2=0x7f9d3410cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:34.578 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.581+0000 7f9d39ff6700 1 --2- 172.21.15.26:0/2951209901 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d34071c40 0x7f9d3410cb50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f9d24006cb0 tx=0x7f9d24006ee0).stop 2021-11-03T16:46:34.578 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.581+0000 7f9d39ff6700 1 -- 172.21.15.26:0/2951209901 shutdown_connections 2021-11-03T16:46:34.578 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.581+0000 7f9d39ff6700 1 --2- 172.21.15.26:0/2951209901 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f9d2002fd50 0x7f9d20032210 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:34.579 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.581+0000 7f9d39ff6700 1 --2- 172.21.15.26:0/2951209901 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d34071c40 0x7f9d3410cb50 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:34.579 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.581+0000 7f9d39ff6700 1 -- 172.21.15.26:0/2951209901 >> 172.21.15.26:0/2951209901 conn(0x7f9d340f73e0 msgr2=0x7f9d340f8f20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:34.580 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.582+0000 7f9d39ff6700 1 -- 172.21.15.26:0/2951209901 shutdown_connections 2021-11-03T16:46:34.580 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:34.582+0000 7f9d39ff6700 1 -- 172.21.15.26:0/2951209901 wait complete. 2021-11-03T16:46:35.183 INFO:teuthology.orchestra.run.smithi026.stderr:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2021-11-03T16:46:35.183 INFO:teuthology.orchestra.run.smithi026.stderr:Adding key to root@localhost authorized_keys... 2021-11-03T16:46:35.184 INFO:teuthology.orchestra.run.smithi026.stderr:Adding host smithi026... 2021-11-03T16:46:35.185 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi026 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprh0b9ciq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpg6zn56v0:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch host add smithi026 172.21.15.26 2021-11-03T16:46:35.407 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:35 smithi026 conmon[32119]: audit 2021-11-03T16:46:34.580221+0000 mgr.smithi026.cnrxli (mgr.14114) 7 : audit [DBG] from='client.14130 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:46:35.970 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:35.971+0000 7f611167b700 1 Processor -- start 2021-11-03T16:46:35.971 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:35.971+0000 7f611167b700 1 -- start start 2021-11-03T16:46:35.971 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:35.971+0000 7f611167b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f610c0fab40 0x7f610c0faf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:35.971 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:35.971+0000 7f611167b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610c0fb4e0 con 0x7f610c0fab40 2021-11-03T16:46:35.971 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:35.971+0000 7f610affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f610c0fab40 0x7f610c0faf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:35.972 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:35.971+0000 7f610affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f610c0fab40 0x7f610c0faf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49188/0 (socket says 172.21.15.26:49188) 2021-11-03T16:46:35.972 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:35.971+0000 7f610affd700 1 -- 172.21.15.26:0/1058776975 learned_addr learned my addr 172.21.15.26:0/1058776975 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:35.972 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:35.972+0000 7f610affd700 1 -- 172.21.15.26:0/1058776975 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610c0fb620 con 0x7f610c0fab40 2021-11-03T16:46:35.972 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:35.972+0000 7f610affd700 1 --2- 172.21.15.26:0/1058776975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f610c0fab40 0x7f610c0faf60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f610400bc00 tx=0x7f610400b570).ready entity=mon.0 client_cookie=b8c35b76e049201c server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:35.973 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:35.972+0000 7f6109ffb700 1 -- 172.21.15.26:0/1058776975 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f610400dd70 con 0x7f610c0fab40 2021-11-03T16:46:35.973 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:35.972+0000 7f6109ffb700 1 -- 172.21.15.26:0/1058776975 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f61040108c0 con 0x7f610c0fab40 2021-11-03T16:46:35.973 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:35.972+0000 7f6109ffb700 1 -- 172.21.15.26:0/1058776975 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f610400f830 con 0x7f610c0fab40 2021-11-03T16:46:35.973 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:35.973+0000 7f611167b700 1 -- 172.21.15.26:0/1058776975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f610c0fab40 msgr2=0x7f610c0faf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:35.973 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:35.973+0000 7f611167b700 1 --2- 172.21.15.26:0/1058776975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f610c0fab40 0x7f610c0faf60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f610400bc00 tx=0x7f610400b570).stop 2021-11-03T16:46:35.974 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:35.973+0000 7f611167b700 1 -- 172.21.15.26:0/1058776975 shutdown_connections 2021-11-03T16:46:35.974 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:35.973+0000 7f611167b700 1 --2- 172.21.15.26:0/1058776975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f610c0fab40 0x7f610c0faf60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:35.974 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:35.973+0000 7f611167b700 1 -- 172.21.15.26:0/1058776975 >> 172.21.15.26:0/1058776975 conn(0x7f610c0f62a0 msgr2=0x7f610c0f86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:35.974 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:35.973+0000 7f611167b700 1 -- 172.21.15.26:0/1058776975 shutdown_connections 2021-11-03T16:46:35.975 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:35.973+0000 7f611167b700 1 -- 172.21.15.26:0/1058776975 wait complete. 2021-11-03T16:46:35.975 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:35.973+0000 7f611167b700 1 Processor -- start 2021-11-03T16:46:35.975 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:35.974+0000 7f611167b700 1 -- start start 2021-11-03T16:46:35.975 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:35.974+0000 7f611167b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f610c0fab40 0x7f610c108770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:35.976 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:35.974+0000 7f611167b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610c108c60 con 0x7f610c0fab40 2021-11-03T16:46:35.976 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:35.974+0000 7f610affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f610c0fab40 0x7f610c108770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:35.976 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:35.974+0000 7f610affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f610c0fab40 0x7f610c108770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49190/0 (socket says 172.21.15.26:49190) 2021-11-03T16:46:35.976 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:35.974+0000 7f610affd700 1 -- 172.21.15.26:0/3375741900 learned_addr learned my addr 172.21.15.26:0/3375741900 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:35.976 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:35.974+0000 7f610affd700 1 -- 172.21.15.26:0/3375741900 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610400b810 con 0x7f610c0fab40 2021-11-03T16:46:35.977 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:35.974+0000 7f610affd700 1 --2- 172.21.15.26:0/3375741900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f610c0fab40 0x7f610c108770 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f610400b710 tx=0x7f610400b570).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:35.977 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:35.974+0000 7f61037fe700 1 -- 172.21.15.26:0/3375741900 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f610400fe10 con 0x7f610c0fab40 2021-11-03T16:46:35.977 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:35.974+0000 7f61037fe700 1 -- 172.21.15.26:0/3375741900 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f61040198a0 con 0x7f610c0fab40 2021-11-03T16:46:35.977 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:35.974+0000 7f61037fe700 1 -- 172.21.15.26:0/3375741900 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6104023600 con 0x7f610c0fab40 2021-11-03T16:46:35.978 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:35.974+0000 7f611167b700 1 -- 172.21.15.26:0/3375741900 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f610c108e60 con 0x7f610c0fab40 2021-11-03T16:46:35.978 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:35.974+0000 7f611167b700 1 -- 172.21.15.26:0/3375741900 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f610c1092f0 con 0x7f610c0fab40 2021-11-03T16:46:35.979 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:35.975+0000 7f61037fe700 1 -- 172.21.15.26:0/3375741900 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f610402a060 con 0x7f610c0fab40 2021-11-03T16:46:35.979 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:35.975+0000 7f61037fe700 1 --2- 172.21.15.26:0/3375741900 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f60ec02fdb0 0x7f60ec032270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:35.979 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:35.975+0000 7f61037fe700 1 -- 172.21.15.26:0/3375741900 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f6104044250 con 0x7f610c0fab40 2021-11-03T16:46:35.980 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:35.976+0000 7f610a7fc700 1 --2- 172.21.15.26:0/3375741900 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f60ec02fdb0 0x7f60ec032270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:35.980 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:35.976+0000 7f611167b700 1 -- 172.21.15.26:0/3375741900 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f610c045ad0 con 0x7f610c0fab40 2021-11-03T16:46:35.980 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:35.976+0000 7f610a7fc700 1 --2- 172.21.15.26:0/3375741900 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f60ec02fdb0 0x7f60ec032270 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f60f40096a0 tx=0x7f60f4006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:35.980 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:35.980+0000 7f61037fe700 1 -- 172.21.15.26:0/3375741900 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f6104014020 con 0x7f610c0fab40 2021-11-03T16:46:36.302 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:36.306+0000 7f611167b700 1 -- 172.21.15.26:0/3375741900 --> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi026", "addr": "172.21.15.26", "target": ["mon-mgr", ""]}) v1 -- 0x7f610c102600 con 0x7f60ec02fdb0 2021-11-03T16:46:36.979 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: Added host 'smithi026' 2021-11-03T16:46:36.979 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:36.982+0000 7f61037fe700 1 -- 172.21.15.26:0/3375741900 <== mgr.14114 v2:172.21.15.26:6800/1563027933 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+23 (secure 0 0 0) 0x7f610c102600 con 0x7f60ec02fdb0 2021-11-03T16:46:36.980 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:36.985+0000 7f611167b700 1 -- 172.21.15.26:0/3375741900 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f60ec02fdb0 msgr2=0x7f60ec032270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:36.981 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:36.985+0000 7f611167b700 1 --2- 172.21.15.26:0/3375741900 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f60ec02fdb0 0x7f60ec032270 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f60f40096a0 tx=0x7f60f4006b40).stop 2021-11-03T16:46:36.981 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:36.985+0000 7f611167b700 1 -- 172.21.15.26:0/3375741900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f610c0fab40 msgr2=0x7f610c108770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:36.981 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:36.985+0000 7f611167b700 1 --2- 172.21.15.26:0/3375741900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f610c0fab40 0x7f610c108770 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f610400b710 tx=0x7f610400b570).stop 2021-11-03T16:46:36.981 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:36.985+0000 7f611167b700 1 -- 172.21.15.26:0/3375741900 shutdown_connections 2021-11-03T16:46:36.982 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:36.985+0000 7f611167b700 1 --2- 172.21.15.26:0/3375741900 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f60ec02fdb0 0x7f60ec032270 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:36.982 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:36.985+0000 7f611167b700 1 --2- 172.21.15.26:0/3375741900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f610c0fab40 0x7f610c108770 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:36.982 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:36.985+0000 7f611167b700 1 -- 172.21.15.26:0/3375741900 >> 172.21.15.26:0/3375741900 conn(0x7f610c0f62a0 msgr2=0x7f610c0ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:36.982 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:36.985+0000 7f611167b700 1 -- 172.21.15.26:0/3375741900 shutdown_connections 2021-11-03T16:46:36.983 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:36.985+0000 7f611167b700 1 -- 172.21.15.26:0/3375741900 wait complete. 2021-11-03T16:46:37.673 INFO:teuthology.orchestra.run.smithi026.stderr:Deploying mon service with default placement... 2021-11-03T16:46:37.673 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi026 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprh0b9ciq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpg6zn56v0:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply mon 2021-11-03T16:46:38.360 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.363+0000 7f3680205700 1 Processor -- start 2021-11-03T16:46:38.361 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.363+0000 7f3680205700 1 -- start start 2021-11-03T16:46:38.361 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.363+0000 7f3680205700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36780fc1f0 0x7f36780fc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:38.361 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.363+0000 7f3680205700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36780fcb00 con 0x7f36780fc1f0 2021-11-03T16:46:38.362 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.363+0000 7f367dfa1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36780fc1f0 0x7f36780fc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:38.362 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.363+0000 7f367dfa1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36780fc1f0 0x7f36780fc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49204/0 (socket says 172.21.15.26:49204) 2021-11-03T16:46:38.362 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.363+0000 7f367dfa1700 1 -- 172.21.15.26:0/2101831338 learned_addr learned my addr 172.21.15.26:0/2101831338 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:38.362 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.364+0000 7f367dfa1700 1 -- 172.21.15.26:0/2101831338 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36780fcc40 con 0x7f36780fc1f0 2021-11-03T16:46:38.362 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.364+0000 7f367dfa1700 1 --2- 172.21.15.26:0/2101831338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36780fc1f0 0x7f36780fc610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f367400b5f0 tx=0x7f3674006ee0).ready entity=mon.0 client_cookie=55859edf18ed67c8 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:38.363 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.364+0000 7f367cf9f700 1 -- 172.21.15.26:0/2101831338 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f367400d600 con 0x7f36780fc1f0 2021-11-03T16:46:38.363 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.364+0000 7f367cf9f700 1 -- 172.21.15.26:0/2101831338 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f367400dbb0 con 0x7f36780fc1f0 2021-11-03T16:46:38.363 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.364+0000 7f367cf9f700 1 -- 172.21.15.26:0/2101831338 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3674011bb0 con 0x7f36780fc1f0 2021-11-03T16:46:38.363 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.364+0000 7f3680205700 1 -- 172.21.15.26:0/2101831338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36780fc1f0 msgr2=0x7f36780fc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:38.364 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.364+0000 7f3680205700 1 --2- 172.21.15.26:0/2101831338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36780fc1f0 0x7f36780fc610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f367400b5f0 tx=0x7f3674006ee0).stop 2021-11-03T16:46:38.364 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.364+0000 7f3680205700 1 -- 172.21.15.26:0/2101831338 shutdown_connections 2021-11-03T16:46:38.364 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.364+0000 7f3680205700 1 --2- 172.21.15.26:0/2101831338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36780fc1f0 0x7f36780fc610 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:38.364 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.364+0000 7f3680205700 1 -- 172.21.15.26:0/2101831338 >> 172.21.15.26:0/2101831338 conn(0x7f36780f5a60 msgr2=0x7f36780f7e80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:38.364 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.365+0000 7f3680205700 1 -- 172.21.15.26:0/2101831338 shutdown_connections 2021-11-03T16:46:38.365 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.365+0000 7f3680205700 1 -- 172.21.15.26:0/2101831338 wait complete. 2021-11-03T16:46:38.369 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.366+0000 7f3680205700 1 Processor -- start 2021-11-03T16:46:38.369 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.366+0000 7f3680205700 1 -- start start 2021-11-03T16:46:38.369 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.366+0000 7f3680205700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36780fc1f0 0x7f367810cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:38.369 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.366+0000 7f3680205700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f367810d050 con 0x7f36780fc1f0 2021-11-03T16:46:38.370 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.366+0000 7f367dfa1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36780fc1f0 0x7f367810cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:38.370 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.366+0000 7f367dfa1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36780fc1f0 0x7f367810cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49206/0 (socket says 172.21.15.26:49206) 2021-11-03T16:46:38.370 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.366+0000 7f367dfa1700 1 -- 172.21.15.26:0/3802406004 learned_addr learned my addr 172.21.15.26:0/3802406004 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:38.370 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.366+0000 7f367dfa1700 1 -- 172.21.15.26:0/3802406004 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f367400b200 con 0x7f36780fc1f0 2021-11-03T16:46:38.371 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.366+0000 7f367dfa1700 1 --2- 172.21.15.26:0/3802406004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36780fc1f0 0x7f367810cb60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f3674003000 tx=0x7f3674006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:38.371 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.366+0000 7f36667fc700 1 -- 172.21.15.26:0/3802406004 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3674011e30 con 0x7f36780fc1f0 2021-11-03T16:46:38.371 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.366+0000 7f36667fc700 1 -- 172.21.15.26:0/3802406004 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f367400d9c0 con 0x7f36780fc1f0 2021-11-03T16:46:38.371 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.366+0000 7f3680205700 1 -- 172.21.15.26:0/3802406004 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f367810d250 con 0x7f36780fc1f0 2021-11-03T16:46:38.371 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.366+0000 7f36667fc700 1 -- 172.21.15.26:0/3802406004 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f367401b740 con 0x7f36780fc1f0 2021-11-03T16:46:38.372 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.367+0000 7f3680205700 1 -- 172.21.15.26:0/3802406004 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f367810d6e0 con 0x7f36780fc1f0 2021-11-03T16:46:38.372 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.367+0000 7f36667fc700 1 -- 172.21.15.26:0/3802406004 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f367400f070 con 0x7f36780fc1f0 2021-11-03T16:46:38.372 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.368+0000 7f36667fc700 1 --2- 172.21.15.26:0/3802406004 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f366002fd50 0x7f3660032210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:38.372 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.368+0000 7f36667fc700 1 -- 172.21.15.26:0/3802406004 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f3674041030 con 0x7f36780fc1f0 2021-11-03T16:46:38.373 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.368+0000 7f3680205700 1 -- 172.21.15.26:0/3802406004 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3678045ad0 con 0x7f36780fc1f0 2021-11-03T16:46:38.373 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.368+0000 7f367d7a0700 1 --2- 172.21.15.26:0/3802406004 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f366002fd50 0x7f3660032210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:38.373 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.368+0000 7f367d7a0700 1 --2- 172.21.15.26:0/3802406004 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f366002fd50 0x7f3660032210 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f36680096a0 tx=0x7f3668006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:38.373 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.372+0000 7f36667fc700 1 -- 172.21.15.26:0/3802406004 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f3674016070 con 0x7f36780fc1f0 2021-11-03T16:46:38.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:37 smithi026 conmon[32119]: audit 2021-11-03T16:46:36.308091+0000 mgr.smithi026.cnrxli (mgr.14114) 8 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi026", "addr": "172.21.15.26", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:46:38.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:37 smithi026 conmon[32119]: audit 2021-11-03T16:46:36.982251+0000 mon.smithi026 (mon.0) 54 : audit [INF] from='mgr.14114 172.21.15.26:0/2598049392' entity='mgr.smithi026.cnrxli' 2021-11-03T16:46:38.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:37 smithi026 conmon[32119]: cephadm 2021-11-03T16:46:36.982603+0000 mgr.smithi026.cnrxli (mgr.14114) 9 : cephadm [INF] Added host smithi026 2021-11-03T16:46:38.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:37 smithi026 conmon[32119]: audit 2021-11-03T16:46:36.982829+0000 mon.smithi026 (mon.0) 55 : audit [DBG] from='mgr.14114 172.21.15.26:0/2598049392' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:46:38.716 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.721+0000 7f3680205700 1 -- 172.21.15.26:0/3802406004 --> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f367810def0 con 0x7f366002fd50 2021-11-03T16:46:38.720 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.725+0000 7f36667fc700 1 -- 172.21.15.26:0/3802406004 <== mgr.14114 v2:172.21.15.26:6800/1563027933 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f367810def0 con 0x7f366002fd50 2021-11-03T16:46:38.720 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: Scheduled mon update... 2021-11-03T16:46:38.723 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.727+0000 7f3680205700 1 -- 172.21.15.26:0/3802406004 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f366002fd50 msgr2=0x7f3660032210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:38.724 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.727+0000 7f3680205700 1 --2- 172.21.15.26:0/3802406004 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f366002fd50 0x7f3660032210 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f36680096a0 tx=0x7f3668006b40).stop 2021-11-03T16:46:38.724 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.727+0000 7f3680205700 1 -- 172.21.15.26:0/3802406004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36780fc1f0 msgr2=0x7f367810cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:38.724 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.727+0000 7f3680205700 1 --2- 172.21.15.26:0/3802406004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36780fc1f0 0x7f367810cb60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f3674003000 tx=0x7f3674006ee0).stop 2021-11-03T16:46:38.724 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.727+0000 7f3680205700 1 -- 172.21.15.26:0/3802406004 shutdown_connections 2021-11-03T16:46:38.724 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.727+0000 7f3680205700 1 --2- 172.21.15.26:0/3802406004 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f366002fd50 0x7f3660032210 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:38.725 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.727+0000 7f3680205700 1 --2- 172.21.15.26:0/3802406004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36780fc1f0 0x7f367810cb60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:38.725 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.727+0000 7f3680205700 1 -- 172.21.15.26:0/3802406004 >> 172.21.15.26:0/3802406004 conn(0x7f36780f5a60 msgr2=0x7f36780f7560 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:38.725 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.728+0000 7f3680205700 1 -- 172.21.15.26:0/3802406004 shutdown_connections 2021-11-03T16:46:38.726 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:38.728+0000 7f3680205700 1 -- 172.21.15.26:0/3802406004 wait complete. 2021-11-03T16:46:39.426 INFO:teuthology.orchestra.run.smithi026.stderr:Deploying mgr service with default placement... 2021-11-03T16:46:39.426 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi026 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprh0b9ciq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpg6zn56v0:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply mgr 2021-11-03T16:46:40.029 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:39 smithi026 conmon[32119]: audit 2021-11-03T16:46:38.722418+0000 mgr.smithi026.cnrxli (mgr.14114) 10 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:46:40.030 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:39 smithi026 conmon[32119]: cephadm 2021-11-03T16:46:38.723235+0000 mgr.smithi026.cnrxli (mgr.14114) 11 : cephadm [INF] Saving service mon spec with placement count:5 2021-11-03T16:46:40.030 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:39 smithi026 conmon[32119]: audit 2021-11-03T16:46:38.725406+0000 mon.smithi026 (mon.0) 56 : audit [INF] from='mgr.14114 172.21.15.26:0/2598049392' entity='mgr.smithi026.cnrxli' 2021-11-03T16:46:40.578 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.578+0000 7f664db16700 1 Processor -- start 2021-11-03T16:46:40.579 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.578+0000 7f664db16700 1 -- start start 2021-11-03T16:46:40.579 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.578+0000 7f664db16700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66480fbb80 0x7f66480fbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:40.579 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.578+0000 7f664db16700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66480fc490 con 0x7f66480fbb80 2021-11-03T16:46:40.579 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.579+0000 7f66477fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66480fbb80 0x7f66480fbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:40.579 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.579+0000 7f66477fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66480fbb80 0x7f66480fbfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49210/0 (socket says 172.21.15.26:49210) 2021-11-03T16:46:40.580 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.579+0000 7f66477fe700 1 -- 172.21.15.26:0/3784280361 learned_addr learned my addr 172.21.15.26:0/3784280361 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:40.580 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.579+0000 7f66477fe700 1 -- 172.21.15.26:0/3784280361 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66480fc5d0 con 0x7f66480fbb80 2021-11-03T16:46:40.580 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.579+0000 7f66477fe700 1 --2- 172.21.15.26:0/3784280361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66480fbb80 0x7f66480fbfa0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f663800b5f0 tx=0x7f6638006ee0).ready entity=mon.0 client_cookie=b36ee1d71ba11264 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:40.580 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.580+0000 7f66467fc700 1 -- 172.21.15.26:0/3784280361 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f663800d600 con 0x7f66480fbb80 2021-11-03T16:46:40.581 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.580+0000 7f66467fc700 1 -- 172.21.15.26:0/3784280361 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f663800dbf0 con 0x7f66480fbb80 2021-11-03T16:46:40.581 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.580+0000 7f66467fc700 1 -- 172.21.15.26:0/3784280361 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6638011bf0 con 0x7f66480fbb80 2021-11-03T16:46:40.581 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.580+0000 7f664db16700 1 -- 172.21.15.26:0/3784280361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66480fbb80 msgr2=0x7f66480fbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:40.581 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.580+0000 7f664db16700 1 --2- 172.21.15.26:0/3784280361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66480fbb80 0x7f66480fbfa0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f663800b5f0 tx=0x7f6638006ee0).stop 2021-11-03T16:46:40.582 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.580+0000 7f664db16700 1 -- 172.21.15.26:0/3784280361 shutdown_connections 2021-11-03T16:46:40.582 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.580+0000 7f664db16700 1 --2- 172.21.15.26:0/3784280361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66480fbb80 0x7f66480fbfa0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:40.582 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.580+0000 7f664db16700 1 -- 172.21.15.26:0/3784280361 >> 172.21.15.26:0/3784280361 conn(0x7f66480f73a0 msgr2=0x7f66480f97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:40.582 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.580+0000 7f664db16700 1 -- 172.21.15.26:0/3784280361 shutdown_connections 2021-11-03T16:46:40.582 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.580+0000 7f664db16700 1 -- 172.21.15.26:0/3784280361 wait complete. 2021-11-03T16:46:40.583 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.581+0000 7f664db16700 1 Processor -- start 2021-11-03T16:46:40.583 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.581+0000 7f664db16700 1 -- start start 2021-11-03T16:46:40.583 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.581+0000 7f664db16700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66480fbb80 0x7f664810a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:40.583 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.581+0000 7f664db16700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664810adc0 con 0x7f66480fbb80 2021-11-03T16:46:40.584 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.582+0000 7f66477fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66480fbb80 0x7f664810a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:40.584 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.582+0000 7f66477fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66480fbb80 0x7f664810a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49212/0 (socket says 172.21.15.26:49212) 2021-11-03T16:46:40.584 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.582+0000 7f66477fe700 1 -- 172.21.15.26:0/2395865530 learned_addr learned my addr 172.21.15.26:0/2395865530 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:40.584 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.582+0000 7f66477fe700 1 -- 172.21.15.26:0/2395865530 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f663800b200 con 0x7f66480fbb80 2021-11-03T16:46:40.584 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.582+0000 7f66477fe700 1 --2- 172.21.15.26:0/2395865530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66480fbb80 0x7f664810a8d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f6638011de0 tx=0x7f6638006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:40.585 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.582+0000 7f662ffff700 1 -- 172.21.15.26:0/2395865530 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f663801b410 con 0x7f66480fbb80 2021-11-03T16:46:40.585 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.582+0000 7f662ffff700 1 -- 172.21.15.26:0/2395865530 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f663801ba00 con 0x7f66480fbb80 2021-11-03T16:46:40.585 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.582+0000 7f662ffff700 1 -- 172.21.15.26:0/2395865530 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f663801a840 con 0x7f66480fbb80 2021-11-03T16:46:40.585 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.583+0000 7f664db16700 1 -- 172.21.15.26:0/2395865530 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f664810afc0 con 0x7f66480fbb80 2021-11-03T16:46:40.587 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.583+0000 7f664db16700 1 -- 172.21.15.26:0/2395865530 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f664810b450 con 0x7f66480fbb80 2021-11-03T16:46:40.587 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.583+0000 7f662ffff700 1 -- 172.21.15.26:0/2395865530 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f663802b070 con 0x7f66480fbb80 2021-11-03T16:46:40.587 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.584+0000 7f664db16700 1 -- 172.21.15.26:0/2395865530 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6648045ad0 con 0x7f66480fbb80 2021-11-03T16:46:40.587 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.584+0000 7f662ffff700 1 --2- 172.21.15.26:0/2395865530 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f663402fdb0 0x7f6634032270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:40.587 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.584+0000 7f662ffff700 1 -- 172.21.15.26:0/2395865530 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f66380416b0 con 0x7f66480fbb80 2021-11-03T16:46:40.588 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.584+0000 7f6646ffd700 1 --2- 172.21.15.26:0/2395865530 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f663402fdb0 0x7f6634032270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:40.588 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.585+0000 7f6646ffd700 1 --2- 172.21.15.26:0/2395865530 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f663402fdb0 0x7f6634032270 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f663c0096a0 tx=0x7f663c006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:40.588 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.589+0000 7f662ffff700 1 -- 172.21.15.26:0/2395865530 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f663802b4e0 con 0x7f66480fbb80 2021-11-03T16:46:40.936 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.941+0000 7f664db16700 1 -- 172.21.15.26:0/2395865530 --> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f664810bd10 con 0x7f663402fdb0 2021-11-03T16:46:40.941 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.946+0000 7f662ffff700 1 -- 172.21.15.26:0/2395865530 <== mgr.14114 v2:172.21.15.26:6800/1563027933 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f664810bd10 con 0x7f663402fdb0 2021-11-03T16:46:40.942 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: Scheduled mgr update... 2021-11-03T16:46:40.944 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.948+0000 7f664db16700 1 -- 172.21.15.26:0/2395865530 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f663402fdb0 msgr2=0x7f6634032270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:40.944 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.948+0000 7f664db16700 1 --2- 172.21.15.26:0/2395865530 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f663402fdb0 0x7f6634032270 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f663c0096a0 tx=0x7f663c006b40).stop 2021-11-03T16:46:40.945 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.948+0000 7f664db16700 1 -- 172.21.15.26:0/2395865530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66480fbb80 msgr2=0x7f664810a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:40.945 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.948+0000 7f664db16700 1 --2- 172.21.15.26:0/2395865530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66480fbb80 0x7f664810a8d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f6638011de0 tx=0x7f6638006ee0).stop 2021-11-03T16:46:40.945 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.948+0000 7f664db16700 1 -- 172.21.15.26:0/2395865530 shutdown_connections 2021-11-03T16:46:40.945 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.948+0000 7f664db16700 1 --2- 172.21.15.26:0/2395865530 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f663402fdb0 0x7f6634032270 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:40.945 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.948+0000 7f664db16700 1 --2- 172.21.15.26:0/2395865530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66480fbb80 0x7f664810a8d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:40.946 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.948+0000 7f664db16700 1 -- 172.21.15.26:0/2395865530 >> 172.21.15.26:0/2395865530 conn(0x7f66480f73a0 msgr2=0x7f66480f8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:40.946 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.949+0000 7f664db16700 1 -- 172.21.15.26:0/2395865530 shutdown_connections 2021-11-03T16:46:40.946 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:40.949+0000 7f664db16700 1 -- 172.21.15.26:0/2395865530 wait complete. 2021-11-03T16:46:41.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:41 smithi026 conmon[32119]: audit 2021-11-03T16:46:40.028026+0000 mon.smithi026 (mon.0) 57 : audit [INF] from='mgr.14114 172.21.15.26:0/2598049392' entity='mgr.smithi026.cnrxli' 2021-11-03T16:46:41.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:41 smithi026 conmon[32119]: audit 2021-11-03T16:46:40.305369+0000 mon.smithi026 (mon.0) 58 : audit [INF] from='mgr.14114 172.21.15.26:0/2598049392' entity='mgr.smithi026.cnrxli' 2021-11-03T16:46:41.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:41 smithi026 conmon[32119]: audit 2021-11-03T16:46:40.942550+0000 mgr.smithi026.cnrxli (mgr.14114) 12 : audit [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:46:41.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:41 smithi026 conmon[32119]: cephadm 2021-11-03T16:46:40.943167+0000 mgr.smithi026.cnrxli (mgr.14114) 13 : cephadm [INF] Saving service mgr spec with placement count:2 2021-11-03T16:46:41.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:41 smithi026 conmon[32119]: audit 2021-11-03T16:46:40.946468+0000 mon.smithi026 (mon.0) 59 : audit [INF] from='mgr.14114 172.21.15.26:0/2598049392' entity='mgr.smithi026.cnrxli' 2021-11-03T16:46:41.659 INFO:teuthology.orchestra.run.smithi026.stderr:Deploying crash service with default placement... 2021-11-03T16:46:41.659 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi026 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprh0b9ciq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpg6zn56v0:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply crash 2021-11-03T16:46:42.298 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.301+0000 7f8b275b8700 1 Processor -- start 2021-11-03T16:46:42.299 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.302+0000 7f8b275b8700 1 -- start start 2021-11-03T16:46:42.299 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.302+0000 7f8b275b8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b2006fba0 0x7f8b200fe800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:42.299 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.302+0000 7f8b275b8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b200fecf0 con 0x7f8b2006fba0 2021-11-03T16:46:42.300 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.302+0000 7f8b25354700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b2006fba0 0x7f8b200fe800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:42.300 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.302+0000 7f8b25354700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b2006fba0 0x7f8b200fe800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49216/0 (socket says 172.21.15.26:49216) 2021-11-03T16:46:42.300 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.302+0000 7f8b25354700 1 -- 172.21.15.26:0/686555234 learned_addr learned my addr 172.21.15.26:0/686555234 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:42.300 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.302+0000 7f8b25354700 1 -- 172.21.15.26:0/686555234 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b200fee30 con 0x7f8b2006fba0 2021-11-03T16:46:42.301 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.303+0000 7f8b25354700 1 --2- 172.21.15.26:0/686555234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b2006fba0 0x7f8b200fe800 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f8b1c00b5f0 tx=0x7f8b1c006ee0).ready entity=mon.0 client_cookie=2b9d464f16716fdf server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:42.301 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.303+0000 7f8b0ffff700 1 -- 172.21.15.26:0/686555234 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b1c00d600 con 0x7f8b2006fba0 2021-11-03T16:46:42.301 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.303+0000 7f8b0ffff700 1 -- 172.21.15.26:0/686555234 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f8b1c00dbf0 con 0x7f8b2006fba0 2021-11-03T16:46:42.301 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.303+0000 7f8b0ffff700 1 -- 172.21.15.26:0/686555234 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b1c011bf0 con 0x7f8b2006fba0 2021-11-03T16:46:42.304 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.304+0000 7f8b275b8700 1 -- 172.21.15.26:0/686555234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b2006fba0 msgr2=0x7f8b200fe800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:42.305 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.304+0000 7f8b275b8700 1 --2- 172.21.15.26:0/686555234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b2006fba0 0x7f8b200fe800 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f8b1c00b5f0 tx=0x7f8b1c006ee0).stop 2021-11-03T16:46:42.305 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.304+0000 7f8b275b8700 1 -- 172.21.15.26:0/686555234 shutdown_connections 2021-11-03T16:46:42.305 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.304+0000 7f8b275b8700 1 --2- 172.21.15.26:0/686555234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b2006fba0 0x7f8b200fe800 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:42.305 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.304+0000 7f8b275b8700 1 -- 172.21.15.26:0/686555234 >> 172.21.15.26:0/686555234 conn(0x7f8b200f6260 msgr2=0x7f8b200f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:42.306 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.304+0000 7f8b275b8700 1 -- 172.21.15.26:0/686555234 shutdown_connections 2021-11-03T16:46:42.306 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.304+0000 7f8b275b8700 1 -- 172.21.15.26:0/686555234 wait complete. 2021-11-03T16:46:42.306 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.304+0000 7f8b275b8700 1 Processor -- start 2021-11-03T16:46:42.306 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.304+0000 7f8b275b8700 1 -- start start 2021-11-03T16:46:42.307 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.304+0000 7f8b275b8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b2006fba0 0x7f8b2010a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:42.307 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.305+0000 7f8b275b8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2010adc0 con 0x7f8b2006fba0 2021-11-03T16:46:42.307 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.305+0000 7f8b25354700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b2006fba0 0x7f8b2010a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:42.307 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.305+0000 7f8b25354700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b2006fba0 0x7f8b2010a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49218/0 (socket says 172.21.15.26:49218) 2021-11-03T16:46:42.308 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.305+0000 7f8b25354700 1 -- 172.21.15.26:0/601393752 learned_addr learned my addr 172.21.15.26:0/601393752 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:42.308 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.305+0000 7f8b25354700 1 -- 172.21.15.26:0/601393752 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b1c00b200 con 0x7f8b2006fba0 2021-11-03T16:46:42.308 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.305+0000 7f8b25354700 1 --2- 172.21.15.26:0/601393752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b2006fba0 0x7f8b2010a8d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f8b1c006800 tx=0x7f8b1c006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:42.308 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.305+0000 7f8b0dffb700 1 -- 172.21.15.26:0/601393752 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b1c01b410 con 0x7f8b2006fba0 2021-11-03T16:46:42.309 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.305+0000 7f8b0dffb700 1 -- 172.21.15.26:0/601393752 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f8b1c01ba00 con 0x7f8b2006fba0 2021-11-03T16:46:42.309 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.305+0000 7f8b275b8700 1 -- 172.21.15.26:0/601393752 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b2010afc0 con 0x7f8b2006fba0 2021-11-03T16:46:42.309 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.305+0000 7f8b0dffb700 1 -- 172.21.15.26:0/601393752 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b1c01a6e0 con 0x7f8b2006fba0 2021-11-03T16:46:42.309 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.306+0000 7f8b275b8700 1 -- 172.21.15.26:0/601393752 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b2010b450 con 0x7f8b2006fba0 2021-11-03T16:46:42.309 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.307+0000 7f8b275b8700 1 -- 172.21.15.26:0/601393752 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b20045ad0 con 0x7f8b2006fba0 2021-11-03T16:46:42.310 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.307+0000 7f8b0dffb700 1 -- 172.21.15.26:0/601393752 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f8b1c02b070 con 0x7f8b2006fba0 2021-11-03T16:46:42.310 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.307+0000 7f8b0dffb700 1 --2- 172.21.15.26:0/601393752 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f8b0802fd50 0x7f8b08032210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:42.310 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.307+0000 7f8b0dffb700 1 -- 172.21.15.26:0/601393752 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f8b1c0416e0 con 0x7f8b2006fba0 2021-11-03T16:46:42.310 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.307+0000 7f8b24b53700 1 --2- 172.21.15.26:0/601393752 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f8b0802fd50 0x7f8b08032210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:42.311 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.307+0000 7f8b24b53700 1 --2- 172.21.15.26:0/601393752 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f8b0802fd50 0x7f8b08032210 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f8b100096a0 tx=0x7f8b10006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:42.311 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.311+0000 7f8b0dffb700 1 -- 172.21.15.26:0/601393752 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f8b1c02b8d0 con 0x7f8b2006fba0 2021-11-03T16:46:42.662 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.666+0000 7f8b275b8700 1 -- 172.21.15.26:0/601393752 --> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b2010bd70 con 0x7f8b0802fd50 2021-11-03T16:46:42.665 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.670+0000 7f8b0dffb700 1 -- 172.21.15.26:0/601393752 <== mgr.14114 v2:172.21.15.26:6800/1563027933 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f8b2010bd70 con 0x7f8b0802fd50 2021-11-03T16:46:42.665 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: Scheduled crash update... 2021-11-03T16:46:42.668 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.672+0000 7f8b275b8700 1 -- 172.21.15.26:0/601393752 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f8b0802fd50 msgr2=0x7f8b08032210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:42.668 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.672+0000 7f8b275b8700 1 --2- 172.21.15.26:0/601393752 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f8b0802fd50 0x7f8b08032210 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f8b100096a0 tx=0x7f8b10006b40).stop 2021-11-03T16:46:42.668 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.672+0000 7f8b275b8700 1 -- 172.21.15.26:0/601393752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b2006fba0 msgr2=0x7f8b2010a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:42.669 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.672+0000 7f8b275b8700 1 --2- 172.21.15.26:0/601393752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b2006fba0 0x7f8b2010a8d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f8b1c006800 tx=0x7f8b1c006ee0).stop 2021-11-03T16:46:42.669 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.672+0000 7f8b275b8700 1 -- 172.21.15.26:0/601393752 shutdown_connections 2021-11-03T16:46:42.669 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.672+0000 7f8b275b8700 1 --2- 172.21.15.26:0/601393752 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f8b0802fd50 0x7f8b08032210 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:42.669 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.672+0000 7f8b275b8700 1 --2- 172.21.15.26:0/601393752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b2006fba0 0x7f8b2010a8d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:42.670 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.672+0000 7f8b275b8700 1 -- 172.21.15.26:0/601393752 >> 172.21.15.26:0/601393752 conn(0x7f8b200f6260 msgr2=0x7f8b200f7cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:42.670 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.672+0000 7f8b275b8700 1 -- 172.21.15.26:0/601393752 shutdown_connections 2021-11-03T16:46:42.670 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:42.672+0000 7f8b275b8700 1 -- 172.21.15.26:0/601393752 wait complete. 2021-11-03T16:46:42.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:42 smithi026 conmon[32119]: audit 2021-11-03T 2021-11-03T16:46:42.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:42 smithi026 conmon[32119]: 16:46:41.545574+0000 mon.smithi026 (mon.0) 60 : audit [INF] from='mgr.14114 172.21.15.26:0/2598049392' entity='mgr.smithi026.cnrxli' 2021-11-03T16:46:43.525 INFO:teuthology.orchestra.run.smithi026.stderr:Enabling mgr prometheus module... 2021-11-03T16:46:43.526 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi026 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprh0b9ciq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpg6zn56v0:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 mgr module enable prometheus 2021-11-03T16:46:43.790 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:43 smithi026 conmon[32119]: audit 2021-11-03T16:46:42.667439+0000 mgr.smithi026.cnrxli (mgr 2021-11-03T16:46:43.791 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:43 smithi026 conmon[32119]: .14114) 14 : audit [DBG] from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:46:43.791 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:43 smithi026 conmon[32119]: cephadm 2021-11-03T16:46:42.668183+0000 mgr.smithi026.cnrxli ( 2021-11-03T16:46:43.791 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:43 smithi026 conmon[32119]: mgr.14114) 15 : cephadm [INF] Saving service crash spec with placement * 2021-11-03T16:46:43.792 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:43 smithi026 conmon[32119]: audit 2021-11 2021-11-03T16:46:43.792 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:43 smithi026 conmon[32119]: -03T16:46:42. 2021-11-03T16:46:43.792 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:43 smithi026 conmon[32119]: 670326+0000 mon.smithi026 (mon.0) 61 2021-11-03T16:46:43.792 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:43 smithi026 conmon[32119]: : audit [INF] from='mgr.14114 172.21.15.26:0/2598049392' entity='mgr.smithi026.cnrxli' 2021-11-03T16:46:44.221 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.217+0000 7faf2f83f700 1 Processor -- start 2021-11-03T16:46:44.222 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.217+0000 7faf2f83f700 1 -- start start 2021-11-03T16:46:44.222 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.218+0000 7faf2f83f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf2806fb80 0x7faf280fe860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:44.222 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.218+0000 7faf2f83f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf280fed50 con 0x7faf2806fb80 2021-11-03T16:46:44.223 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.218+0000 7faf2d5db700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf2806fb80 0x7faf280fe860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:44.223 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.218+0000 7faf2d5db700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf2806fb80 0x7faf280fe860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49222/0 (socket says 172.21.15.26:49222) 2021-11-03T16:46:44.224 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.218+0000 7faf2d5db700 1 -- 172.21.15.26:0/678525312 learned_addr learned my addr 172.21.15.26:0/678525312 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:44.224 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.218+0000 7faf2d5db700 1 -- 172.21.15.26:0/678525312 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf280fee90 con 0x7faf2806fb80 2021-11-03T16:46:44.225 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.219+0000 7faf2d5db700 1 --2- 172.21.15.26:0/678525312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf2806fb80 0x7faf280fe860 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7faf1800b5f0 tx=0x7faf18006ee0).ready entity=mon.0 client_cookie=268325d5be45db04 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:44.225 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.219+0000 7faf17fff700 1 -- 172.21.15.26:0/678525312 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faf1800d600 con 0x7faf2806fb80 2021-11-03T16:46:44.225 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.219+0000 7faf17fff700 1 -- 172.21.15.26:0/678525312 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7faf1800dbf0 con 0x7faf2806fb80 2021-11-03T16:46:44.226 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.219+0000 7faf17fff700 1 -- 172.21.15.26:0/678525312 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faf18011c20 con 0x7faf2806fb80 2021-11-03T16:46:44.226 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.219+0000 7faf2f83f700 1 -- 172.21.15.26:0/678525312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf2806fb80 msgr2=0x7faf280fe860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:44.227 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.219+0000 7faf2f83f700 1 --2- 172.21.15.26:0/678525312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf2806fb80 0x7faf280fe860 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7faf1800b5f0 tx=0x7faf18006ee0).stop 2021-11-03T16:46:44.227 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.219+0000 7faf2f83f700 1 -- 172.21.15.26:0/678525312 shutdown_connections 2021-11-03T16:46:44.228 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.219+0000 7faf2f83f700 1 --2- 172.21.15.26:0/678525312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf2806fb80 0x7faf280fe860 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:44.228 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.219+0000 7faf2f83f700 1 -- 172.21.15.26:0/678525312 >> 172.21.15.26:0/678525312 conn(0x7faf280f62e0 msgr2=0x7faf280f8700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:44.228 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.219+0000 7faf2f83f700 1 -- 172.21.15.26:0/678525312 shutdown_connections 2021-11-03T16:46:44.229 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.220+0000 7faf2f83f700 1 -- 172.21.15.26:0/678525312 wait complete. 2021-11-03T16:46:44.229 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.220+0000 7faf2f83f700 1 Processor -- start 2021-11-03T16:46:44.230 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.220+0000 7faf2f83f700 1 -- start start 2021-11-03T16:46:44.230 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.220+0000 7faf2f83f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf2806fb80 0x7faf2810cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:44.231 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.220+0000 7faf2f83f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2810d080 con 0x7faf2806fb80 2021-11-03T16:46:44.231 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.221+0000 7faf2d5db700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf2806fb80 0x7faf2810cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:44.232 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.221+0000 7faf2d5db700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf2806fb80 0x7faf2810cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49224/0 (socket says 172.21.15.26:49224) 2021-11-03T16:46:44.232 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.221+0000 7faf2d5db700 1 -- 172.21.15.26:0/3285067747 learned_addr learned my addr 172.21.15.26:0/3285067747 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:44.232 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.221+0000 7faf2d5db700 1 -- 172.21.15.26:0/3285067747 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf1800b200 con 0x7faf2806fb80 2021-11-03T16:46:44.233 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.221+0000 7faf2d5db700 1 --2- 172.21.15.26:0/3285067747 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf2806fb80 0x7faf2810cb90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7faf18006800 tx=0x7faf18006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:44.233 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.221+0000 7faf15ffb700 1 -- 172.21.15.26:0/3285067747 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faf1801b410 con 0x7faf2806fb80 2021-11-03T16:46:44.234 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.221+0000 7faf15ffb700 1 -- 172.21.15.26:0/3285067747 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7faf1801ba00 con 0x7faf2806fb80 2021-11-03T16:46:44.234 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.221+0000 7faf2f83f700 1 -- 172.21.15.26:0/3285067747 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf2810d280 con 0x7faf2806fb80 2021-11-03T16:46:44.235 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.221+0000 7faf15ffb700 1 -- 172.21.15.26:0/3285067747 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faf1801a7a0 con 0x7faf2806fb80 2021-11-03T16:46:44.235 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.221+0000 7faf2f83f700 1 -- 172.21.15.26:0/3285067747 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf2810d710 con 0x7faf2806fb80 2021-11-03T16:46:44.236 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.222+0000 7faf15ffb700 1 -- 172.21.15.26:0/3285067747 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7faf1802b070 con 0x7faf2806fb80 2021-11-03T16:46:44.236 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.222+0000 7faf15ffb700 1 --2- 172.21.15.26:0/3285067747 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7faf1002fd50 0x7faf10032210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:44.236 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.223+0000 7faf15ffb700 1 -- 172.21.15.26:0/3285067747 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7faf18041590 con 0x7faf2806fb80 2021-11-03T16:46:44.236 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.223+0000 7faf2f83f700 1 -- 172.21.15.26:0/3285067747 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf28045ad0 con 0x7faf2806fb80 2021-11-03T16:46:44.237 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.223+0000 7faf2cdda700 1 --2- 172.21.15.26:0/3285067747 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7faf1002fd50 0x7faf10032210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:44.237 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.223+0000 7faf2cdda700 1 --2- 172.21.15.26:0/3285067747 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7faf1002fd50 0x7faf10032210 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7faf240096a0 tx=0x7faf24006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:44.237 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.227+0000 7faf15ffb700 1 -- 172.21.15.26:0/3285067747 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7faf1801f020 con 0x7faf2806fb80 2021-11-03T16:46:44.579 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.584+0000 7faf2f83f700 1 -- 172.21.15.26:0/3285067747 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "prometheus"} v 0) v1 -- 0x7faf28106cf0 con 0x7faf2806fb80 2021-11-03T16:46:44.669 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.672+0000 7faf15ffb700 1 -- 172.21.15.26:0/3285067747 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mgrmap(e 9) v1 ==== 36134+0+0 (secure 0 0 0) 0x7faf1800f070 con 0x7faf2806fb80 2021-11-03T16:46:44.670 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.673+0000 7faf15ffb700 1 -- 172.21.15.26:0/3285067747 <== mon.0 v2:172.21.15.26:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "prometheus"}]=0 v9) v1 ==== 89+0+0 (secure 0 0 0) 0x7faf18023750 con 0x7faf2806fb80 2021-11-03T16:46:44.672 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.675+0000 7faf2f83f700 1 -- 172.21.15.26:0/3285067747 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7faf1002fd50 msgr2=0x7faf10032210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:44.672 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.675+0000 7faf2f83f700 1 --2- 172.21.15.26:0/3285067747 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7faf1002fd50 0x7faf10032210 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7faf240096a0 tx=0x7faf24006b40).stop 2021-11-03T16:46:44.673 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.675+0000 7faf2f83f700 1 -- 172.21.15.26:0/3285067747 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf2806fb80 msgr2=0x7faf2810cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:44.673 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.675+0000 7faf2f83f700 1 --2- 172.21.15.26:0/3285067747 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf2806fb80 0x7faf2810cb90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7faf18006800 tx=0x7faf18006ee0).stop 2021-11-03T16:46:44.673 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.676+0000 7faf2f83f700 1 -- 172.21.15.26:0/3285067747 shutdown_connections 2021-11-03T16:46:44.673 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.676+0000 7faf2f83f700 1 --2- 172.21.15.26:0/3285067747 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7faf1002fd50 0x7faf10032210 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:44.673 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.676+0000 7faf2f83f700 1 --2- 172.21.15.26:0/3285067747 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf2806fb80 0x7faf2810cb90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:44.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.676+0000 7faf2f83f700 1 -- 172.21.15.26:0/3285067747 >> 172.21.15.26:0/3285067747 conn(0x7faf280f62e0 msgr2=0x7faf280f7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:44.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.676+0000 7faf2f83f700 1 -- 172.21.15.26:0/3285067747 shutdown_connections 2021-11-03T16:46:44.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:44.676+0000 7faf2f83f700 1 -- 172.21.15.26:0/3285067747 wait complete. 2021-11-03T16:46:44.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:44 smithi026 conmon[32119]: audit 2021-11-03T16:46:44. 2021-11-03T16:46:44.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:44 smithi026 conmon[32119]: 584957+0000 mon.smithi026 (mon.0) 62 : audit [INF] from='client.? 172.21.15.26:0/3285067747' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2021-11-03T16:46:45.246 INFO:teuthology.orchestra.run.smithi026.stderr:Deploying prometheus service with default placement... 2021-11-03T16:46:45.247 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi026 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprh0b9ciq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpg6zn56v0:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply prometheus 2021-11-03T16:46:45.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:45 smithi026 conmon[32119]: audit 2021-11-03T16:46:44.674260+0000 2021-11-03T16:46:45.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:45 smithi026 conmon[32119]: mon.smithi026 (mon.0) 63 : audit [INF] from='client.? 172.21.15.26:0/3285067747' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2021-11-03T16:46:45.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:45 smithi026 conmon[32119]: cluster 2021-11-03T16:46:44.674331+0000 mon.smithi026 (mon.0) 64 : cluster [DBG] mgrmap e9: smithi026.cnrxli(active, since 17s) 2021-11-03T16:46:45.953 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:45.956+0000 7f814b865700 1 Processor -- start 2021-11-03T16:46:45.953 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:45.956+0000 7f814b865700 1 -- start start 2021-11-03T16:46:45.953 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:45.956+0000 7f814b865700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f814406fb40 0x7f8144100c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:45.953 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:45.956+0000 7f814b865700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81440fc650 con 0x7f814406fb40 2021-11-03T16:46:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:45.956+0000 7f8149601700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f814406fb40 0x7f8144100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:45.956+0000 7f8149601700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f814406fb40 0x7f8144100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49238/0 (socket says 172.21.15.26:49238) 2021-11-03T16:46:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:45.956+0000 7f8149601700 1 -- 172.21.15.26:0/3632817275 learned_addr learned my addr 172.21.15.26:0/3632817275 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:45.957+0000 7f8149601700 1 -- 172.21.15.26:0/3632817275 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8144101150 con 0x7f814406fb40 2021-11-03T16:46:45.955 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:45.957+0000 7f8149601700 1 --2- 172.21.15.26:0/3632817275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f814406fb40 0x7f8144100c60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f814000b5f0 tx=0x7f8140006ee0).ready entity=mon.0 client_cookie=cd79d88e3f0ca64d server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:45.955 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:45.957+0000 7f8133fff700 1 -- 172.21.15.26:0/3632817275 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f814000d600 con 0x7f814406fb40 2021-11-03T16:46:45.955 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:45.957+0000 7f8133fff700 1 -- 172.21.15.26:0/3632817275 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f814000dbf0 con 0x7f814406fb40 2021-11-03T16:46:45.955 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:45.957+0000 7f8133fff700 1 -- 172.21.15.26:0/3632817275 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8140011bf0 con 0x7f814406fb40 2021-11-03T16:46:45.959 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:45.958+0000 7f814b865700 1 -- 172.21.15.26:0/3632817275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f814406fb40 msgr2=0x7f8144100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:45.959 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:45.958+0000 7f814b865700 1 --2- 172.21.15.26:0/3632817275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f814406fb40 0x7f8144100c60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f814000b5f0 tx=0x7f8140006ee0).stop 2021-11-03T16:46:45.959 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:45.958+0000 7f814b865700 1 -- 172.21.15.26:0/3632817275 shutdown_connections 2021-11-03T16:46:45.959 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:45.958+0000 7f814b865700 1 --2- 172.21.15.26:0/3632817275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f814406fb40 0x7f8144100c60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:45.960 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:45.958+0000 7f814b865700 1 -- 172.21.15.26:0/3632817275 >> 172.21.15.26:0/3632817275 conn(0x7f81440f6260 msgr2=0x7f81440f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:45.960 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:45.958+0000 7f814b865700 1 -- 172.21.15.26:0/3632817275 shutdown_connections 2021-11-03T16:46:45.960 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:45.959+0000 7f814b865700 1 -- 172.21.15.26:0/3632817275 wait complete. 2021-11-03T16:46:45.960 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:45.959+0000 7f814b865700 1 Processor -- start 2021-11-03T16:46:45.961 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:45.959+0000 7f814b865700 1 -- start start 2021-11-03T16:46:45.961 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:45.959+0000 7f814b865700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f814406fb40 0x7f814410cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:45.961 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:45.959+0000 7f814b865700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814410cfc0 con 0x7f814406fb40 2021-11-03T16:46:45.961 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:45.960+0000 7f8149601700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f814406fb40 0x7f814410cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:45.961 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:45.960+0000 7f8149601700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f814406fb40 0x7f814410cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49240/0 (socket says 172.21.15.26:49240) 2021-11-03T16:46:45.962 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:45.960+0000 7f8149601700 1 -- 172.21.15.26:0/564402459 learned_addr learned my addr 172.21.15.26:0/564402459 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:45.962 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:45.960+0000 7f8149601700 1 -- 172.21.15.26:0/564402459 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f814000b200 con 0x7f814406fb40 2021-11-03T16:46:45.962 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:45.960+0000 7f8149601700 1 --2- 172.21.15.26:0/564402459 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f814406fb40 0x7f814410cad0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f8140011e00 tx=0x7f8140006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:45.962 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:45.960+0000 7f8131ffb700 1 -- 172.21.15.26:0/564402459 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f814001b410 con 0x7f814406fb40 2021-11-03T16:46:45.963 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:45.960+0000 7f8131ffb700 1 -- 172.21.15.26:0/564402459 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f814001ba00 con 0x7f814406fb40 2021-11-03T16:46:45.963 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:45.960+0000 7f814b865700 1 -- 172.21.15.26:0/564402459 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f814410d1c0 con 0x7f814406fb40 2021-11-03T16:46:45.963 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:45.960+0000 7f8131ffb700 1 -- 172.21.15.26:0/564402459 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f814001a730 con 0x7f814406fb40 2021-11-03T16:46:45.963 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:45.961+0000 7f814b865700 1 -- 172.21.15.26:0/564402459 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f814410d650 con 0x7f814406fb40 2021-11-03T16:46:45.964 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:45.962+0000 7f814b865700 1 -- 172.21.15.26:0/564402459 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8144045ad0 con 0x7f814406fb40 2021-11-03T16:46:45.964 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:45.962+0000 7f8131ffb700 1 -- 172.21.15.26:0/564402459 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 36134+0+0 (secure 0 0 0) 0x7f814002b070 con 0x7f814406fb40 2021-11-03T16:46:45.964 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:45.962+0000 7f8131ffb700 1 --2- 172.21.15.26:0/564402459 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f812c02fe50 0x7f812c032310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:45.964 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:45.962+0000 7f8131ffb700 1 -- 172.21.15.26:0/564402459 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f8140041a80 con 0x7f814406fb40 2021-11-03T16:46:45.964 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:45.962+0000 7f8148e00700 1 -- 172.21.15.26:0/564402459 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f812c02fe50 msgr2=0x7f812c032310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/1563027933 2021-11-03T16:46:45.965 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:45.962+0000 7f8148e00700 1 --2- 172.21.15.26:0/564402459 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f812c02fe50 0x7f812c032310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2021-11-03T16:46:45.965 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:45.966+0000 7f8131ffb700 1 -- 172.21.15.26:0/564402459 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f8140023d40 con 0x7f814406fb40 2021-11-03T16:46:46.160 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:46.164+0000 7f8148e00700 1 -- 172.21.15.26:0/564402459 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f812c02fe50 msgr2=0x7f812c032310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/1563027933 2021-11-03T16:46:46.160 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:46.164+0000 7f8148e00700 1 --2- 172.21.15.26:0/564402459 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f812c02fe50 0x7f812c032310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2021-11-03T16:46:46.336 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:46.341+0000 7f814b865700 1 -- 172.21.15.26:0/564402459 --> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f814410df70 con 0x7f812c02fe50 2021-11-03T16:46:46.560 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:46.565+0000 7f8148e00700 1 -- 172.21.15.26:0/564402459 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f812c02fe50 msgr2=0x7f812c032310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/1563027933 2021-11-03T16:46:46.561 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:46.565+0000 7f8148e00700 1 --2- 172.21.15.26:0/564402459 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f812c02fe50 0x7f812c032310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2021-11-03T16:46:47.361 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:47.366+0000 7f8148e00700 1 -- 172.21.15.26:0/564402459 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f812c02fe50 msgr2=0x7f812c032310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/1563027933 2021-11-03T16:46:47.362 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:47.366+0000 7f8148e00700 1 --2- 172.21.15.26:0/564402459 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f812c02fe50 0x7f812c032310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2021-11-03T16:46:48.963 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:48.967+0000 7f8148e00700 1 -- 172.21.15.26:0/564402459 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f812c02fe50 msgr2=0x7f812c032310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/1563027933 2021-11-03T16:46:48.963 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:48.967+0000 7f8148e00700 1 --2- 172.21.15.26:0/564402459 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f812c02fe50 0x7f812c032310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2021-11-03T16:46:50.669 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:50.672+0000 7f8131ffb700 1 -- 172.21.15.26:0/564402459 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mgrmap(e 10) v1 ==== 35984+0+0 (secure 0 0 0) 0x7f814000f070 con 0x7f814406fb40 2021-11-03T16:46:50.670 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:50.673+0000 7f8131ffb700 1 -- 172.21.15.26:0/564402459 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f812c02fe50 msgr2=0x7f812c032310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-11-03T16:46:50.670 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:50.673+0000 7f8131ffb700 1 --2- 172.21.15.26:0/564402459 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f812c02fe50 0x7f812c032310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T16:46:51.671 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:51.674+0000 7f8131ffb700 1 -- 172.21.15.26:0/564402459 <== mon.0 v2:172.21.15.26:3300/0 8 ==== mgrmap(e 11) v1 ==== 36054+0+0 (secure 0 0 0) 0x7f8140043430 con 0x7f814406fb40 2021-11-03T16:46:51.671 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:51.674+0000 7f8131ffb700 1 --2- 172.21.15.26:0/564402459 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7f812c033c00 0x7f812c035ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:51.671 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:51.674+0000 7f8131ffb700 1 -- 172.21.15.26:0/564402459 --> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f814410df70 con 0x7f812c033c00 2021-11-03T16:46:51.672 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:51.675+0000 7f8148e00700 1 --2- 172.21.15.26:0/564402459 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7f812c033c00 0x7f812c035ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:51.672 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:51.675+0000 7f8148e00700 1 --2- 172.21.15.26:0/564402459 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7f812c033c00 0x7f812c035ff0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f8134006fd0 tx=0x7f8134006db0).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:51.675 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:51.680+0000 7f8131ffb700 1 -- 172.21.15.26:0/564402459 <== mgr.14142 v2:172.21.15.26:6800/3020148896 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f814410df70 con 0x7f812c033c00 2021-11-03T16:46:51.676 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: Scheduled prometheus update... 2021-11-03T16:46:51.678 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:51.682+0000 7f814b865700 1 -- 172.21.15.26:0/564402459 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7f812c033c00 msgr2=0x7f812c035ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:51.679 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:51.682+0000 7f814b865700 1 --2- 172.21.15.26:0/564402459 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7f812c033c00 0x7f812c035ff0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f8134006fd0 tx=0x7f8134006db0).stop 2021-11-03T16:46:51.679 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:51.682+0000 7f814b865700 1 -- 172.21.15.26:0/564402459 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f814406fb40 msgr2=0x7f814410cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:51.679 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:51.682+0000 7f814b865700 1 --2- 172.21.15.26:0/564402459 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f814406fb40 0x7f814410cad0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f8140011e00 tx=0x7f8140006ee0).stop 2021-11-03T16:46:51.680 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:51.682+0000 7f814b865700 1 -- 172.21.15.26:0/564402459 shutdown_connections 2021-11-03T16:46:51.680 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:51.682+0000 7f814b865700 1 --2- 172.21.15.26:0/564402459 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7f812c033c00 0x7f812c035ff0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:51.680 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:51.682+0000 7f814b865700 1 --2- 172.21.15.26:0/564402459 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f814406fb40 0x7f814410cad0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:51.680 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:51.682+0000 7f814b865700 1 --2- 172.21.15.26:0/564402459 >> [v2:172.21.15.26:6800/1563027933,v1:172.21.15.26:6801/1563027933] conn(0x7f812c02fe50 0x7f812c032310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T16:46:51.680 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:51.682+0000 7f814b865700 1 -- 172.21.15.26:0/564402459 >> 172.21.15.26:0/564402459 conn(0x7f81440f6260 msgr2=0x7f81440f7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:51.681 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:51.683+0000 7f814b865700 1 -- 172.21.15.26:0/564402459 shutdown_connections 2021-11-03T16:46:51.681 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:51.683+0000 7f814b865700 1 -- 172.21.15.26:0/564402459 wait complete. 2021-11-03T16:46:51.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:51 smithi026 conmon[32119]: cluster 2021-11-03T16:46:50.621576+0000 mon.smithi026 (mon.0) 65 : cluster [INF] Active manager daemon smithi026.cnrxli restarted 2021-11-03T16:46:51.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:51 smithi026 conmon[32119]: cluster 2021-11-03T16:46:50.622007+0000 mon.smithi026 (mon.0) 66 : cluster [INF] Activating manager daemon smithi026.cnrxli 2021-11-03T16:46:51.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:51 smithi026 conmon[32119]: cluster 2021-11-03T16:46:50.623673+0000 mon.smithi026 (mon.0) 67 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2021-11-03T16:46:51.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:51 smithi026 conmon[32119]: cluster 2021-11-03T16:46:50.674351+0000 mon.smithi026 (mon.0) 68 : cluster [DBG] mgrmap e10: smithi026.cnrxli(active, starting, since 0.0524632s) 2021-11-03T16:46:51.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:51 smithi026 conmon[32119]: audit 2021-11-03T16:46:50.675282+0000 mon.smithi026 (mon.0) 69 : audit [DBG] from='mgr.14142 172.21.15.26:0/1648856710' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata", "id": "smithi026"}]: dispatch 2021-11-03T16:46:51.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:51 smithi026 conmon[32119]: audit 2021-11-03T16:46:50.676060+0000 mon.smithi026 (mon.0) 70 : audit [DBG] from='mgr.14142 172.21.15.26:0/1648856710' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mgr metadata", "who": "smithi026.cnrxli", "id": "smithi026.cnrxli"}]: dispatch 2021-11-03T16:46:51.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:51 smithi026 conmon[32119]: audit 2021-11-03T16:46: 2021-11-03T16:46:51.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:51 smithi026 conmon[32119]: 50.676770+0000 mon.smithi026 (mon.0) 71 : audit [DBG] from='mgr.14142 172.21.15.26:0/1648856710' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-11-03T16:46:51.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:51 smithi026 conmon[32119]: audit 2021-11-03T16:46:50.676941+0000 mon.smithi026 (mon.0) 72 : audit [DBG] from='mgr.14142 172.21.15.26:0/1648856710' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-11-03T16:46:51.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:51 smithi026 conmon[32119]: audit 2021-11-03T16:46:50.677092+0000 mon.smithi026 (mon.0) 73 : audit [DBG] from='mgr.14142 172.21.15.26:0/1648856710' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-11-03T16:46:51.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:51 smithi026 conmon[32119]: cluster 2021-11-03T16:46:50.679182+0000 mon.smithi026 (mon.0) 74 : cluster [INF] Manager daemon smithi026.cnrxli is now available 2021-11-03T16:46:51.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:51 smithi026 conmon[32119]: audit 2021-11-03T16:46:50.812063+0000 mon.smithi026 (mon.0) 75 : audit [DBG] from='mgr.14142 172.21.15.26:0/1648856710' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:46:51.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:51 smithi026 conmon[32119]: audit 2021-11-03T16:46:50.813611+0000 mon.smithi026 (mon.0) 76 : audit [DBG] from='mgr.14142 172.21.15.26:0/1648856710' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:46:51.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:51 smithi026 conmon[32119]: audit 2021-11-03T16:46:50.830464+0000 mon.smithi026 (mon.0) 77 : audit [INF] from='mgr.14142 172.21.15.26:0/1648856710' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T16:46:51.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:51 smithi026 conmon[32119]: audit 2021-11-03T16:46:50.833900+0000 mon.smithi026 (mon.0) 78 : audit [INF] from='mgr.14142 172.21.15.26:0/1648856710' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T16:46:52.507 INFO:teuthology.orchestra.run.smithi026.stderr:Deploying grafana service with default placement... 2021-11-03T16:46:52.507 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi026 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprh0b9ciq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpg6zn56v0:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply grafana 2021-11-03T16:46:52.778 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:52 smithi026 conmon[32119]: cluster 2021-11-03T16:46:51.676924+0000 mon.smithi026 2021-11-03T16:46:52.779 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:52 smithi026 conmon[32119]: (mon.0) 79 : cluster [DBG] mgrmap e11: smithi026.cnrxli(active, since 1.05503s) 2021-11-03T16:46:52.779 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:52 smithi026 conmon[32119]: cephadm 2021-11-03T16:46:51.678208+0000 mgr.smithi026.cnrxli (mgr.14142) 2 : cephadm [INF] Saving service prometheus spec with placement count:1 2021-11-03T16:46:52.779 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:52 smithi026 conmon[32119]: audit 2021-11-03T16:46:51.680465+0000 mon.smithi026 (mon.0) 80 : audit [INF] from='mgr.14142 172.21.15.26:0/1648856710' entity='mgr.smithi026.cnrxli' 2021-11-03T16:46:52.779 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:52 smithi026 conmon[32119]: audit 2021-11-03T16:46:51.931027+0000 mon.smithi026 (mon.0) 81 : audit [INF] from='mgr.14142 172.21.15.26:0/1648856710' entity='mgr.smithi026.cnrxli' 2021-11-03T16:46:53.679 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:53.682+0000 7fd3cf39c700 1 Processor -- start 2021-11-03T16:46:53.679 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:53.682+0000 7fd3cf39c700 1 -- start start 2021-11-03T16:46:53.679 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:53.682+0000 7fd3cf39c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3c80faac0 0x7fd3c80faee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:53.679 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:53.682+0000 7fd3cf39c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c80fb3d0 con 0x7fd3c80faac0 2021-11-03T16:46:53.680 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:53.683+0000 7fd3cd138700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3c80faac0 0x7fd3c80faee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:53.680 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:53.683+0000 7fd3cd138700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3c80faac0 0x7fd3c80faee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49284/0 (socket says 172.21.15.26:49284) 2021-11-03T16:46:53.680 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:53.683+0000 7fd3cd138700 1 -- 172.21.15.26:0/144321516 learned_addr learned my addr 172.21.15.26:0/144321516 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:53.680 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:53.683+0000 7fd3cd138700 1 -- 172.21.15.26:0/144321516 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c80fb510 con 0x7fd3c80faac0 2021-11-03T16:46:53.681 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:53.683+0000 7fd3cd138700 1 --2- 172.21.15.26:0/144321516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3c80faac0 0x7fd3c80faee0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fd3c400b5f0 tx=0x7fd3c4006ee0).ready entity=mon.0 client_cookie=970707cc41084d2 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:53.684 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:53.683+0000 7fd3bbfff700 1 -- 172.21.15.26:0/144321516 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd3c400d600 con 0x7fd3c80faac0 2021-11-03T16:46:53.684 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:53.683+0000 7fd3bbfff700 1 -- 172.21.15.26:0/144321516 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fd3c400dbf0 con 0x7fd3c80faac0 2021-11-03T16:46:53.684 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:53.683+0000 7fd3bbfff700 1 -- 172.21.15.26:0/144321516 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd3c4011bf0 con 0x7fd3c80faac0 2021-11-03T16:46:53.685 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:53.684+0000 7fd3cf39c700 1 -- 172.21.15.26:0/144321516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3c80faac0 msgr2=0x7fd3c80faee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:53.685 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:53.684+0000 7fd3cf39c700 1 --2- 172.21.15.26:0/144321516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3c80faac0 0x7fd3c80faee0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fd3c400b5f0 tx=0x7fd3c4006ee0).stop 2021-11-03T16:46:53.685 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:53.684+0000 7fd3cf39c700 1 -- 172.21.15.26:0/144321516 shutdown_connections 2021-11-03T16:46:53.685 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:53.684+0000 7fd3cf39c700 1 --2- 172.21.15.26:0/144321516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3c80faac0 0x7fd3c80faee0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:53.686 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:53.684+0000 7fd3cf39c700 1 -- 172.21.15.26:0/144321516 >> 172.21.15.26:0/144321516 conn(0x7fd3c80f62e0 msgr2=0x7fd3c80f8700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:53.686 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:53.685+0000 7fd3cf39c700 1 -- 172.21.15.26:0/144321516 shutdown_connections 2021-11-03T16:46:53.686 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:53.685+0000 7fd3cf39c700 1 -- 172.21.15.26:0/144321516 wait complete. 2021-11-03T16:46:53.686 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:53.685+0000 7fd3cf39c700 1 Processor -- start 2021-11-03T16:46:53.686 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:53.685+0000 7fd3cf39c700 1 -- start start 2021-11-03T16:46:53.687 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:53.686+0000 7fd3cf39c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3c80faac0 0x7fd3c8108780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:53.687 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:53.686+0000 7fd3cf39c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c8108c70 con 0x7fd3c80faac0 2021-11-03T16:46:53.687 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:53.686+0000 7fd3cd138700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3c80faac0 0x7fd3c8108780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:53.687 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:53.686+0000 7fd3cd138700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3c80faac0 0x7fd3c8108780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49286/0 (socket says 172.21.15.26:49286) 2021-11-03T16:46:53.688 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:53.686+0000 7fd3cd138700 1 -- 172.21.15.26:0/39473182 learned_addr learned my addr 172.21.15.26:0/39473182 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:53.688 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:53.686+0000 7fd3cd138700 1 -- 172.21.15.26:0/39473182 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c400b200 con 0x7fd3c80faac0 2021-11-03T16:46:53.688 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:53.686+0000 7fd3cd138700 1 --2- 172.21.15.26:0/39473182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3c80faac0 0x7fd3c8108780 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fd3c4011e30 tx=0x7fd3c4006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:53.688 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:53.686+0000 7fd3b9ffb700 1 -- 172.21.15.26:0/39473182 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd3c401b410 con 0x7fd3c80faac0 2021-11-03T16:46:53.689 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:53.686+0000 7fd3b9ffb700 1 -- 172.21.15.26:0/39473182 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fd3c401ba00 con 0x7fd3c80faac0 2021-11-03T16:46:53.689 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:53.686+0000 7fd3b9ffb700 1 -- 172.21.15.26:0/39473182 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd3c401a750 con 0x7fd3c80faac0 2021-11-03T16:46:53.689 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:53.686+0000 7fd3cf39c700 1 -- 172.21.15.26:0/39473182 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3c8108e70 con 0x7fd3c80faac0 2021-11-03T16:46:53.689 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:53.687+0000 7fd3cf39c700 1 -- 172.21.15.26:0/39473182 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c8109300 con 0x7fd3c80faac0 2021-11-03T16:46:53.690 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:53.687+0000 7fd3b9ffb700 1 -- 172.21.15.26:0/39473182 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 36195+0+0 (secure 0 0 0) 0x7fd3c402b070 con 0x7fd3c80faac0 2021-11-03T16:46:53.690 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:53.688+0000 7fd3b9ffb700 1 --2- 172.21.15.26:0/39473182 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7fd3b00342b0 0x7fd3b0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:53.690 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:53.688+0000 7fd3b9ffb700 1 -- 172.21.15.26:0/39473182 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7fd3c4041550 con 0x7fd3c80faac0 2021-11-03T16:46:53.690 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:53.688+0000 7fd3cc937700 1 --2- 172.21.15.26:0/39473182 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7fd3b00342b0 0x7fd3b0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:53.690 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:53.688+0000 7fd3cf39c700 1 -- 172.21.15.26:0/39473182 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3c8045ad0 con 0x7fd3c80faac0 2021-11-03T16:46:53.691 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:53.688+0000 7fd3cc937700 1 --2- 172.21.15.26:0/39473182 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7fd3b00342b0 0x7fd3b0036770 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fd3bc0096a0 tx=0x7fd3bc006b40).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:53.691 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:53.692+0000 7fd3b9ffb700 1 -- 172.21.15.26:0/39473182 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fd3c4016020 con 0x7fd3c80faac0 2021-11-03T16:46:54.029 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:54.033+0000 7fd3cf39c700 1 -- 172.21.15.26:0/39473182 --> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3c8102620 con 0x7fd3b00342b0 2021-11-03T16:46:54.032 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:54.037+0000 7fd3b9ffb700 1 -- 172.21.15.26:0/39473182 <== mgr.14142 v2:172.21.15.26:6800/3020148896 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fd3c8102620 con 0x7fd3b00342b0 2021-11-03T16:46:54.033 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: Scheduled grafana update... 2021-11-03T16:46:54.035 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:54.039+0000 7fd3cf39c700 1 -- 172.21.15.26:0/39473182 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7fd3b00342b0 msgr2=0x7fd3b0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:54.036 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:54.039+0000 7fd3cf39c700 1 --2- 172.21.15.26:0/39473182 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7fd3b00342b0 0x7fd3b0036770 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fd3bc0096a0 tx=0x7fd3bc006b40).stop 2021-11-03T16:46:54.036 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:54.039+0000 7fd3cf39c700 1 -- 172.21.15.26:0/39473182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3c80faac0 msgr2=0x7fd3c8108780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:54.036 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:54.039+0000 7fd3cf39c700 1 --2- 172.21.15.26:0/39473182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3c80faac0 0x7fd3c8108780 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fd3c4011e30 tx=0x7fd3c4006ee0).stop 2021-11-03T16:46:54.036 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:54.039+0000 7fd3cf39c700 1 -- 172.21.15.26:0/39473182 shutdown_connections 2021-11-03T16:46:54.037 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:54.039+0000 7fd3cf39c700 1 --2- 172.21.15.26:0/39473182 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7fd3b00342b0 0x7fd3b0036770 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:54.037 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:54.039+0000 7fd3cf39c700 1 --2- 172.21.15.26:0/39473182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3c80faac0 0x7fd3c8108780 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:54.037 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:54.039+0000 7fd3cf39c700 1 -- 172.21.15.26:0/39473182 >> 172.21.15.26:0/39473182 conn(0x7fd3c80f62e0 msgr2=0x7fd3c80ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:54.037 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:54.040+0000 7fd3cf39c700 1 -- 172.21.15.26:0/39473182 shutdown_connections 2021-11-03T16:46:54.038 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:54.040+0000 7fd3cf39c700 1 -- 172.21.15.26:0/39473182 wait complete. 2021-11-03T16:46:54.058 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:53 smithi026 conmon[32119]: cluster 2021-11-03T16:46:52.932284+0000 mon.smithi026 (mon. 2021-11-03T16:46:54.058 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:53 smithi026 conmon[32119]: 0) 82 : cluster [DBG] mgrmap e12: smithi026.cnrxli(active, since 2s) 2021-11-03T16:46:54.565 INFO:teuthology.orchestra.run.smithi026.stderr:Deploying node-exporter service with default placement... 2021-11-03T16:46:54.565 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi026 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprh0b9ciq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpg6zn56v0:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply node-exporter 2021-11-03T16:46:55.241 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.244+0000 7fc5c0752700 1 Processor -- start 2021-11-03T16:46:55.241 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.244+0000 7fc5c0752700 1 -- start start 2021-11-03T16:46:55.242 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.244+0000 7fc5c0752700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5b80fc170 0x7fc5b80fc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:55.242 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.244+0000 7fc5c0752700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b80fca80 con 0x7fc5b80fc170 2021-11-03T16:46:55.242 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.244+0000 7fc5be4ee700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5b80fc170 0x7fc5b80fc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:55.242 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.244+0000 7fc5be4ee700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5b80fc170 0x7fc5b80fc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49290/0 (socket says 172.21.15.26:49290) 2021-11-03T16:46:55.243 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.244+0000 7fc5be4ee700 1 -- 172.21.15.26:0/3549124179 learned_addr learned my addr 172.21.15.26:0/3549124179 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:55.243 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.245+0000 7fc5be4ee700 1 -- 172.21.15.26:0/3549124179 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b80fcbc0 con 0x7fc5b80fc170 2021-11-03T16:46:55.243 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.245+0000 7fc5be4ee700 1 --2- 172.21.15.26:0/3549124179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5b80fc170 0x7fc5b80fc590 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fc5b400b5f0 tx=0x7fc5b4006ee0).ready entity=mon.0 client_cookie=6e3ad672f8c08f8e server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:55.243 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.245+0000 7fc5bd4ec700 1 -- 172.21.15.26:0/3549124179 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc5b400d600 con 0x7fc5b80fc170 2021-11-03T16:46:55.244 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.245+0000 7fc5bd4ec700 1 -- 172.21.15.26:0/3549124179 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fc5b400dbf0 con 0x7fc5b80fc170 2021-11-03T16:46:55.244 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.245+0000 7fc5bd4ec700 1 -- 172.21.15.26:0/3549124179 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc5b4011bf0 con 0x7fc5b80fc170 2021-11-03T16:46:55.244 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.246+0000 7fc5c0752700 1 -- 172.21.15.26:0/3549124179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5b80fc170 msgr2=0x7fc5b80fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:55.244 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.246+0000 7fc5c0752700 1 --2- 172.21.15.26:0/3549124179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5b80fc170 0x7fc5b80fc590 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fc5b400b5f0 tx=0x7fc5b4006ee0).stop 2021-11-03T16:46:55.247 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.246+0000 7fc5c0752700 1 -- 172.21.15.26:0/3549124179 shutdown_connections 2021-11-03T16:46:55.247 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.246+0000 7fc5c0752700 1 --2- 172.21.15.26:0/3549124179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5b80fc170 0x7fc5b80fc590 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:55.248 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.246+0000 7fc5c0752700 1 -- 172.21.15.26:0/3549124179 >> 172.21.15.26:0/3549124179 conn(0x7fc5b80f5a60 msgr2=0x7fc5b80f7e80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:55.248 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.246+0000 7fc5c0752700 1 -- 172.21.15.26:0/3549124179 shutdown_connections 2021-11-03T16:46:55.248 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.246+0000 7fc5c0752700 1 -- 172.21.15.26:0/3549124179 wait complete. 2021-11-03T16:46:55.249 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.247+0000 7fc5c0752700 1 Processor -- start 2021-11-03T16:46:55.249 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.247+0000 7fc5c0752700 1 -- start start 2021-11-03T16:46:55.249 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.247+0000 7fc5c0752700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5b80fc170 0x7fc5b810cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:55.249 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.247+0000 7fc5c0752700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b810d060 con 0x7fc5b80fc170 2021-11-03T16:46:55.250 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.247+0000 7fc5be4ee700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5b80fc170 0x7fc5b810cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:55.250 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.247+0000 7fc5be4ee700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5b80fc170 0x7fc5b810cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49292/0 (socket says 172.21.15.26:49292) 2021-11-03T16:46:55.250 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.247+0000 7fc5be4ee700 1 -- 172.21.15.26:0/1538057671 learned_addr learned my addr 172.21.15.26:0/1538057671 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:55.250 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.247+0000 7fc5be4ee700 1 -- 172.21.15.26:0/1538057671 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b400b200 con 0x7fc5b80fc170 2021-11-03T16:46:55.251 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.248+0000 7fc5be4ee700 1 --2- 172.21.15.26:0/1538057671 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5b80fc170 0x7fc5b810cb70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fc5b4006800 tx=0x7fc5b4006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:55.251 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.248+0000 7fc5a6ffd700 1 -- 172.21.15.26:0/1538057671 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc5b400dec0 con 0x7fc5b80fc170 2021-11-03T16:46:55.251 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.248+0000 7fc5a6ffd700 1 -- 172.21.15.26:0/1538057671 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fc5b401b8a0 con 0x7fc5b80fc170 2021-11-03T16:46:55.251 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.248+0000 7fc5c0752700 1 -- 172.21.15.26:0/1538057671 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5b810d260 con 0x7fc5b80fc170 2021-11-03T16:46:55.251 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.248+0000 7fc5a6ffd700 1 -- 172.21.15.26:0/1538057671 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc5b401a690 con 0x7fc5b80fc170 2021-11-03T16:46:55.252 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.248+0000 7fc5c0752700 1 -- 172.21.15.26:0/1538057671 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5b810d6f0 con 0x7fc5b80fc170 2021-11-03T16:46:55.252 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.249+0000 7fc5a6ffd700 1 -- 172.21.15.26:0/1538057671 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 36195+0+0 (secure 0 0 0) 0x7fc5b402b070 con 0x7fc5b80fc170 2021-11-03T16:46:55.252 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.249+0000 7fc5a6ffd700 1 --2- 172.21.15.26:0/1538057671 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7fc5a002feb0 0x7fc5a0032370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:55.252 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.249+0000 7fc5a6ffd700 1 -- 172.21.15.26:0/1538057671 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7fc5b4042510 con 0x7fc5b80fc170 2021-11-03T16:46:55.253 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.249+0000 7fc5bdced700 1 --2- 172.21.15.26:0/1538057671 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7fc5a002feb0 0x7fc5a0032370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:55.253 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.249+0000 7fc5c0752700 1 -- 172.21.15.26:0/1538057671 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5b8045ad0 con 0x7fc5b80fc170 2021-11-03T16:46:55.253 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.249+0000 7fc5bdced700 1 --2- 172.21.15.26:0/1538057671 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7fc5a002feb0 0x7fc5a0032370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fc5a80096a0 tx=0x7fc5a8006b40).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:55.254 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.253+0000 7fc5a6ffd700 1 -- 172.21.15.26:0/1538057671 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fc5b401f020 con 0x7fc5b80fc170 2021-11-03T16:46:55.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:55 smithi026 conmon[32119]: audit 2021-11-03T16:46:54.034992+0000 mgr.smithi026.cnrxli (mgr.14142) 3 : 2021-11-03T16:46:55.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:55 smithi026 conmon[32119]: audit [DBG] from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:46:55.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:55 smithi026 conmon[32119]: cephadm 2021-11-03T16:46:54.035584+0000 mgr.smithi026.cnrxli (mgr.14142) 4 : cephadm 2021-11-03T16:46:55.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:55 smithi026 conmon[32119]: [INF] Saving service grafana spec with placement count:1 2021-11-03T16:46:55.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:55 smithi026 conmon[32119]: audit 2021-11-03T16:46:55.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:55 smithi026 conmon[32119]: 2021-11-03T16 2021-11-03T16:46:55.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:55 smithi026 conmon[32119]: :46:54.037541+0000 2021-11-03T16:46:55.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:55 smithi026 conmon[32119]: mon.smithi026 (mon.0) 83 : audit 2021-11-03T16:46:55.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:55 smithi026 conmon[32119]: [INF] from='mgr.14142 172.21.15.26:0/1648856710' entity='mgr.smithi026.cnrxli' 2021-11-03T16:46:55.590 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.594+0000 7fc5c0752700 1 -- 172.21.15.26:0/1538057671 --> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5b80008d0 con 0x7fc5a002feb0 2021-11-03T16:46:55.594 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.598+0000 7fc5a6ffd700 1 -- 172.21.15.26:0/1538057671 <== mgr.14142 v2:172.21.15.26:6800/3020148896 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7fc5b80008d0 con 0x7fc5a002feb0 2021-11-03T16:46:55.594 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: Scheduled node-exporter update... 2021-11-03T16:46:55.597 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.600+0000 7fc5c0752700 1 -- 172.21.15.26:0/1538057671 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7fc5a002feb0 msgr2=0x7fc5a0032370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:55.597 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.600+0000 7fc5c0752700 1 --2- 172.21.15.26:0/1538057671 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7fc5a002feb0 0x7fc5a0032370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fc5a80096a0 tx=0x7fc5a8006b40).stop 2021-11-03T16:46:55.597 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.600+0000 7fc5c0752700 1 -- 172.21.15.26:0/1538057671 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5b80fc170 msgr2=0x7fc5b810cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:55.597 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.600+0000 7fc5c0752700 1 --2- 172.21.15.26:0/1538057671 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5b80fc170 0x7fc5b810cb70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fc5b4006800 tx=0x7fc5b4006ee0).stop 2021-11-03T16:46:55.598 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.600+0000 7fc5c0752700 1 -- 172.21.15.26:0/1538057671 shutdown_connections 2021-11-03T16:46:55.598 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.600+0000 7fc5c0752700 1 --2- 172.21.15.26:0/1538057671 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7fc5a002feb0 0x7fc5a0032370 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:55.598 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.600+0000 7fc5c0752700 1 --2- 172.21.15.26:0/1538057671 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5b80fc170 0x7fc5b810cb70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:55.598 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.600+0000 7fc5c0752700 1 -- 172.21.15.26:0/1538057671 >> 172.21.15.26:0/1538057671 conn(0x7fc5b80f5a60 msgr2=0x7fc5b80f7570 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:55.599 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.601+0000 7fc5c0752700 1 -- 172.21.15.26:0/1538057671 shutdown_connections 2021-11-03T16:46:55.599 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:55.601+0000 7fc5c0752700 1 -- 172.21.15.26:0/1538057671 wait complete. 2021-11-03T16:46:56.156 INFO:teuthology.orchestra.run.smithi026.stderr:Deploying alertmanager service with default placement... 2021-11-03T16:46:56.157 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi026 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprh0b9ciq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpg6zn56v0:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply alertmanager 2021-11-03T16:46:56.788 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:56.783+0000 7fec9e55e700 1 Processor -- start 2021-11-03T16:46:56.788 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:56.783+0000 7fec9e55e700 1 -- start start 2021-11-03T16:46:56.789 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:56.783+0000 7fec9e55e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec980fd260 0x7fec980fd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:56.789 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:56.783+0000 7fec9e55e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec980fdb70 con 0x7fec980fd260 2021-11-03T16:46:56.789 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:56.783+0000 7fec97fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec980fd260 0x7fec980fd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:56.790 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:56.783+0000 7fec97fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec980fd260 0x7fec980fd680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49296/0 (socket says 172.21.15.26:49296) 2021-11-03T16:46:56.790 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:56.783+0000 7fec97fff700 1 -- 172.21.15.26:0/167649582 learned_addr learned my addr 172.21.15.26:0/167649582 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:56.791 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:56.783+0000 7fec97fff700 1 -- 172.21.15.26:0/167649582 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec980fdcb0 con 0x7fec980fd260 2021-11-03T16:46:56.791 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:56.784+0000 7fec97fff700 1 --2- 172.21.15.26:0/167649582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec980fd260 0x7fec980fd680 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fec8800b5f0 tx=0x7fec88006ee0).ready entity=mon.0 client_cookie=30b3bf518edcb750 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:56.792 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:56.784+0000 7fec96ffd700 1 -- 172.21.15.26:0/167649582 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec8800d600 con 0x7fec980fd260 2021-11-03T16:46:56.792 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:56.784+0000 7fec96ffd700 1 -- 172.21.15.26:0/167649582 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fec8800dbf0 con 0x7fec980fd260 2021-11-03T16:46:56.793 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:56.784+0000 7fec96ffd700 1 -- 172.21.15.26:0/167649582 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec88011bf0 con 0x7fec980fd260 2021-11-03T16:46:56.793 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:56.784+0000 7fec9e55e700 1 -- 172.21.15.26:0/167649582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec980fd260 msgr2=0x7fec980fd680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:56.793 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:56.784+0000 7fec9e55e700 1 --2- 172.21.15.26:0/167649582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec980fd260 0x7fec980fd680 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fec8800b5f0 tx=0x7fec88006ee0).stop 2021-11-03T16:46:56.794 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:56.784+0000 7fec9e55e700 1 -- 172.21.15.26:0/167649582 shutdown_connections 2021-11-03T16:46:56.794 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:56.784+0000 7fec9e55e700 1 --2- 172.21.15.26:0/167649582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec980fd260 0x7fec980fd680 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:56.795 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:56.784+0000 7fec9e55e700 1 -- 172.21.15.26:0/167649582 >> 172.21.15.26:0/167649582 conn(0x7fec980f5a60 msgr2=0x7fec980f7e80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:56.795 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:56.784+0000 7fec9e55e700 1 -- 172.21.15.26:0/167649582 shutdown_connections 2021-11-03T16:46:56.796 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:56.784+0000 7fec9e55e700 1 -- 172.21.15.26:0/167649582 wait complete. 2021-11-03T16:46:56.796 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:56.785+0000 7fec9e55e700 1 Processor -- start 2021-11-03T16:46:56.797 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:56.785+0000 7fec9e55e700 1 -- start start 2021-11-03T16:46:56.797 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:56.786+0000 7fec9e55e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec980fd260 0x7fec9810a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:56.797 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:56.786+0000 7fec9e55e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9810ae20 con 0x7fec980fd260 2021-11-03T16:46:56.798 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:56.786+0000 7fec97fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec980fd260 0x7fec9810a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:56.798 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:56.786+0000 7fec97fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec980fd260 0x7fec9810a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49298/0 (socket says 172.21.15.26:49298) 2021-11-03T16:46:56.799 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:56.786+0000 7fec97fff700 1 -- 172.21.15.26:0/3580644070 learned_addr learned my addr 172.21.15.26:0/3580644070 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:56.799 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:56.786+0000 7fec97fff700 1 -- 172.21.15.26:0/3580644070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec8800b200 con 0x7fec980fd260 2021-11-03T16:46:56.800 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:56.786+0000 7fec97fff700 1 --2- 172.21.15.26:0/3580644070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec980fd260 0x7fec9810a930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fec88011e30 tx=0x7fec88006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:56.800 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:56.786+0000 7fec94ff9700 1 -- 172.21.15.26:0/3580644070 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec8801b410 con 0x7fec980fd260 2021-11-03T16:46:56.801 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:56.786+0000 7fec9e55e700 1 -- 172.21.15.26:0/3580644070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec9810b020 con 0x7fec980fd260 2021-11-03T16:46:56.801 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:56.786+0000 7fec94ff9700 1 -- 172.21.15.26:0/3580644070 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fec8801ba00 con 0x7fec980fd260 2021-11-03T16:46:56.802 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:56.786+0000 7fec94ff9700 1 -- 172.21.15.26:0/3580644070 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec8801a750 con 0x7fec980fd260 2021-11-03T16:46:56.802 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:56.786+0000 7fec9e55e700 1 -- 172.21.15.26:0/3580644070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec9810b4b0 con 0x7fec980fd260 2021-11-03T16:46:56.802 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:56.787+0000 7fec94ff9700 1 -- 172.21.15.26:0/3580644070 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 36195+0+0 (secure 0 0 0) 0x7fec8802b070 con 0x7fec980fd260 2021-11-03T16:46:56.803 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:56.787+0000 7fec94ff9700 1 --2- 172.21.15.26:0/3580644070 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7fec8402fe60 0x7fec84032320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:56.803 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:56.787+0000 7fec94ff9700 1 -- 172.21.15.26:0/3580644070 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7fec880417d0 con 0x7fec980fd260 2021-11-03T16:46:56.804 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:56.787+0000 7fec977fe700 1 --2- 172.21.15.26:0/3580644070 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7fec8402fe60 0x7fec84032320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:56.804 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:56.788+0000 7fec977fe700 1 --2- 172.21.15.26:0/3580644070 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7fec8402fe60 0x7fec84032320 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fec8c0096a0 tx=0x7fec8c006b40).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:56.805 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:56.788+0000 7fec7e7fc700 1 -- 172.21.15.26:0/3580644070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec70004fa0 con 0x7fec980fd260 2021-11-03T16:46:56.805 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:56.792+0000 7fec94ff9700 1 -- 172.21.15.26:0/3580644070 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fec8801f070 con 0x7fec980fd260 2021-11-03T16:46:56.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:56 smithi026 conmon[32119]: audit 2021-11-03T16:46:55.596084+0000 mgr.smithi026.cnrxli (mgr.14142) 5 : audit [DBG] from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:46:56.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:56 smithi026 conmon[32119]: cephadm 2021-11-03T16:46:55.596818+0000 mgr.smithi026.cnrxli (mgr.14142) 6 : cephadm [INF] Saving service node-exporter spec with placement * 2021-11-03T16:46:56.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:56 smithi026 conmon[32119]: audit 2021-11-03T16:46:55.599109+0000 mon.smithi026 (mon.0) 84 : audit [INF] from='mgr.14142 172.21.15.26:0/1648856710' entity='mgr.smithi026.cnrxli' 2021-11-03T16:46:57.127 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:57.131+0000 7fec7e7fc700 1 -- 172.21.15.26:0/3580644070 --> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7fec70002a50 con 0x7fec8402fe60 2021-11-03T16:46:57.131 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:57.135+0000 7fec94ff9700 1 -- 172.21.15.26:0/3580644070 <== mgr.14142 v2:172.21.15.26:6800/3020148896 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7fec70002a50 con 0x7fec8402fe60 2021-11-03T16:46:57.131 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: Scheduled alertmanager update... 2021-11-03T16:46:57.133 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:57.137+0000 7fec7e7fc700 1 -- 172.21.15.26:0/3580644070 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7fec8402fe60 msgr2=0x7fec84032320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:57.134 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:57.137+0000 7fec7e7fc700 1 --2- 172.21.15.26:0/3580644070 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7fec8402fe60 0x7fec84032320 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fec8c0096a0 tx=0x7fec8c006b40).stop 2021-11-03T16:46:57.134 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:57.137+0000 7fec7e7fc700 1 -- 172.21.15.26:0/3580644070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec980fd260 msgr2=0x7fec9810a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:57.134 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:57.137+0000 7fec7e7fc700 1 --2- 172.21.15.26:0/3580644070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec980fd260 0x7fec9810a930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fec88011e30 tx=0x7fec88006ee0).stop 2021-11-03T16:46:57.135 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:57.137+0000 7fec7e7fc700 1 -- 172.21.15.26:0/3580644070 shutdown_connections 2021-11-03T16:46:57.135 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:57.137+0000 7fec7e7fc700 1 --2- 172.21.15.26:0/3580644070 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7fec8402fe60 0x7fec84032320 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:57.135 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:57.137+0000 7fec7e7fc700 1 --2- 172.21.15.26:0/3580644070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec980fd260 0x7fec9810a930 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:57.135 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:57.137+0000 7fec7e7fc700 1 -- 172.21.15.26:0/3580644070 >> 172.21.15.26:0/3580644070 conn(0x7fec980f5a60 msgr2=0x7fec980ff160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:57.136 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:57.138+0000 7fec7e7fc700 1 -- 172.21.15.26:0/3580644070 shutdown_connections 2021-11-03T16:46:57.136 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:57.138+0000 7fec7e7fc700 1 -- 172.21.15.26:0/3580644070 wait complete. 2021-11-03T16:46:57.706 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi026 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprh0b9ciq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpg6zn56v0:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 config set mgr mgr/cephadm/container_init True --force 2021-11-03T16:46:58.393 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.393+0000 7f1d84979700 1 Processor -- start 2021-11-03T16:46:58.394 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.393+0000 7f1d84979700 1 -- start start 2021-11-03T16:46:58.394 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.393+0000 7f1d84979700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d800faab0 0x7f1d800faed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:58.394 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.393+0000 7f1d84979700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d800fb3c0 con 0x7f1d800faab0 2021-11-03T16:46:58.395 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.393+0000 7f1d7e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d800faab0 0x7f1d800faed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:58.395 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.393+0000 7f1d7e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d800faab0 0x7f1d800faed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49302/0 (socket says 172.21.15.26:49302) 2021-11-03T16:46:58.395 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.393+0000 7f1d7e59c700 1 -- 172.21.15.26:0/2897179597 learned_addr learned my addr 172.21.15.26:0/2897179597 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:58.395 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.393+0000 7f1d7e59c700 1 -- 172.21.15.26:0/2897179597 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d800fb500 con 0x7f1d800faab0 2021-11-03T16:46:58.395 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.394+0000 7f1d7e59c700 1 --2- 172.21.15.26:0/2897179597 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d800faab0 0x7f1d800faed0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f1d7000b5f0 tx=0x7f1d70006ee0).ready entity=mon.0 client_cookie=80dd1ac5e49f1d50 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:58.396 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.394+0000 7f1d7d59a700 1 -- 172.21.15.26:0/2897179597 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d7000d600 con 0x7f1d800faab0 2021-11-03T16:46:58.396 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.394+0000 7f1d7d59a700 1 -- 172.21.15.26:0/2897179597 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f1d7000dbf0 con 0x7f1d800faab0 2021-11-03T16:46:58.396 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.394+0000 7f1d7d59a700 1 -- 172.21.15.26:0/2897179597 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d70011bf0 con 0x7f1d800faab0 2021-11-03T16:46:58.396 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.394+0000 7f1d84979700 1 -- 172.21.15.26:0/2897179597 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d800faab0 msgr2=0x7f1d800faed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:58.397 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.394+0000 7f1d84979700 1 --2- 172.21.15.26:0/2897179597 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d800faab0 0x7f1d800faed0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f1d7000b5f0 tx=0x7f1d70006ee0).stop 2021-11-03T16:46:58.397 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.394+0000 7f1d84979700 1 -- 172.21.15.26:0/2897179597 shutdown_connections 2021-11-03T16:46:58.397 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.394+0000 7f1d84979700 1 --2- 172.21.15.26:0/2897179597 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d800faab0 0x7f1d800faed0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:58.397 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.394+0000 7f1d84979700 1 -- 172.21.15.26:0/2897179597 >> 172.21.15.26:0/2897179597 conn(0x7f1d800f62f0 msgr2=0x7f1d800f8710 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:58.398 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.395+0000 7f1d84979700 1 -- 172.21.15.26:0/2897179597 shutdown_connections 2021-11-03T16:46:58.398 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.395+0000 7f1d84979700 1 -- 172.21.15.26:0/2897179597 wait complete. 2021-11-03T16:46:58.398 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.395+0000 7f1d84979700 1 Processor -- start 2021-11-03T16:46:58.398 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.395+0000 7f1d84979700 1 -- start start 2021-11-03T16:46:58.398 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.395+0000 7f1d84979700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d800faab0 0x7f1d8010a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:58.399 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.395+0000 7f1d84979700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8010ae30 con 0x7f1d800faab0 2021-11-03T16:46:58.399 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.395+0000 7f1d7e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d800faab0 0x7f1d8010a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:58.399 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.395+0000 7f1d7e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d800faab0 0x7f1d8010a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49304/0 (socket says 172.21.15.26:49304) 2021-11-03T16:46:58.399 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.395+0000 7f1d7e59c700 1 -- 172.21.15.26:0/3251250928 learned_addr learned my addr 172.21.15.26:0/3251250928 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:58.400 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.396+0000 7f1d7e59c700 1 -- 172.21.15.26:0/3251250928 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7000b200 con 0x7f1d800faab0 2021-11-03T16:46:58.400 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.396+0000 7f1d7e59c700 1 --2- 172.21.15.26:0/3251250928 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d800faab0 0x7f1d8010a940 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f1d70011e30 tx=0x7f1d70006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:58.400 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.396+0000 7f1d6effd700 1 -- 172.21.15.26:0/3251250928 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d7001b410 con 0x7f1d800faab0 2021-11-03T16:46:58.400 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.396+0000 7f1d6effd700 1 -- 172.21.15.26:0/3251250928 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f1d7001ba00 con 0x7f1d800faab0 2021-11-03T16:46:58.400 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.396+0000 7f1d6effd700 1 -- 172.21.15.26:0/3251250928 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d7001a750 con 0x7f1d800faab0 2021-11-03T16:46:58.401 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.396+0000 7f1d84979700 1 -- 172.21.15.26:0/3251250928 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d8010b030 con 0x7f1d800faab0 2021-11-03T16:46:58.401 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.396+0000 7f1d84979700 1 -- 172.21.15.26:0/3251250928 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d8010b4c0 con 0x7f1d800faab0 2021-11-03T16:46:58.401 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.397+0000 7f1d6effd700 1 -- 172.21.15.26:0/3251250928 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 36195+0+0 (secure 0 0 0) 0x7f1d7002b070 con 0x7f1d800faab0 2021-11-03T16:46:58.401 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.397+0000 7f1d6effd700 1 --2- 172.21.15.26:0/3251250928 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7f1d6402feb0 0x7f1d64032370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:58.402 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.397+0000 7f1d6effd700 1 -- 172.21.15.26:0/3251250928 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f1d70041620 con 0x7f1d800faab0 2021-11-03T16:46:58.402 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.397+0000 7f1d7dd9b700 1 --2- 172.21.15.26:0/3251250928 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7f1d6402feb0 0x7f1d64032370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:58.402 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.397+0000 7f1d84979700 1 -- 172.21.15.26:0/3251250928 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d80045ad0 con 0x7f1d800faab0 2021-11-03T16:46:58.403 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.398+0000 7f1d7dd9b700 1 --2- 172.21.15.26:0/3251250928 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7f1d6402feb0 0x7f1d64032370 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f1d740096a0 tx=0x7f1d74006b40).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:58.403 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.402+0000 7f1d6effd700 1 -- 172.21.15.26:0/3251250928 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f1d70016070 con 0x7f1d800faab0 2021-11-03T16:46:58.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:58 smithi026 conmon[32119]: audit 2021-11-03T16:46:57.133053+0000 mgr.smithi026.cnrxli (mgr.14142) 7 2021-11-03T16:46:58.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:58 smithi026 conmon[32119]: : audit [DBG] from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:46:58.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:58 smithi026 conmon[32119]: cephadm 2021-11-03T16:46:57.133618+0000 mgr.smithi026.cnrxli (mgr.14142) 8 : cephadm [INF] Saving service alertmanager spec with placement count:1 2021-11-03T16:46:58.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:58 smithi026 conmon[32119]: audit 2021-11-03T16:46:57.135772+0000 mon.smithi026 (mon.0) 85 : audit [INF] from='mgr.14142 172.21.15.26:0/1648856710' entity='mgr.smithi026.cnrxli' 2021-11-03T16:46:58.683 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.688+0000 7f1d84979700 1 -- 172.21.15.26:0/3251250928 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f1d80104990 con 0x7f1d800faab0 2021-11-03T16:46:58.686 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.691+0000 7f1d6effd700 1 -- 172.21.15.26:0/3251250928 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v9)=0 v9) v1 ==== 142+0+0 (secure 0 0 0) 0x7f1d7001b570 con 0x7f1d800faab0 2021-11-03T16:46:58.689 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.693+0000 7f1d84979700 1 -- 172.21.15.26:0/3251250928 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7f1d6402feb0 msgr2=0x7f1d64032370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:58.689 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.693+0000 7f1d84979700 1 --2- 172.21.15.26:0/3251250928 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7f1d6402feb0 0x7f1d64032370 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f1d740096a0 tx=0x7f1d74006b40).stop 2021-11-03T16:46:58.689 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.693+0000 7f1d84979700 1 -- 172.21.15.26:0/3251250928 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d800faab0 msgr2=0x7f1d8010a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:58.690 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.693+0000 7f1d84979700 1 --2- 172.21.15.26:0/3251250928 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d800faab0 0x7f1d8010a940 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f1d70011e30 tx=0x7f1d70006ee0).stop 2021-11-03T16:46:58.690 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.693+0000 7f1d84979700 1 -- 172.21.15.26:0/3251250928 shutdown_connections 2021-11-03T16:46:58.690 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.693+0000 7f1d84979700 1 --2- 172.21.15.26:0/3251250928 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7f1d6402feb0 0x7f1d64032370 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:58.690 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.693+0000 7f1d84979700 1 --2- 172.21.15.26:0/3251250928 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d800faab0 0x7f1d8010a940 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:58.691 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.693+0000 7f1d84979700 1 -- 172.21.15.26:0/3251250928 >> 172.21.15.26:0/3251250928 conn(0x7f1d800f62f0 msgr2=0x7f1d8006f820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:58.691 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.694+0000 7f1d84979700 1 -- 172.21.15.26:0/3251250928 shutdown_connections 2021-11-03T16:46:58.691 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:58.694+0000 7f1d84979700 1 -- 172.21.15.26:0/3251250928 wait complete. 2021-11-03T16:46:59.281 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi026 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprh0b9ciq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpg6zn56v0:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 config set mgr mgr/dashboard/ssl_server_port 8443 2021-11-03T16:46:59.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:59 smithi026 conmon[32119]: audit 2021-11-03T16:46:58.691502+0000 2021-11-03T16:46:59.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:46:59 smithi026 conmon[32119]: mon.smithi026 (mon.0) 86 : audit [INF] from='client.? 172.21.15.26:0/3251250928' entity='client.admin' 2021-11-03T16:46:59.967 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:59.966+0000 7fb58278e700 1 Processor -- start 2021-11-03T16:46:59.967 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:59.966+0000 7fb58278e700 1 -- start start 2021-11-03T16:46:59.967 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:59.967+0000 7fb58278e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb57c0fba50 0x7fb57c0fbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:59.968 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:59.967+0000 7fb58278e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c0fc360 con 0x7fb57c0fba50 2021-11-03T16:46:59.968 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:59.967+0000 7fb58178c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb57c0fba50 0x7fb57c0fbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:59.968 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:59.967+0000 7fb58178c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb57c0fba50 0x7fb57c0fbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49308/0 (socket says 172.21.15.26:49308) 2021-11-03T16:46:59.969 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:59.967+0000 7fb58178c700 1 -- 172.21.15.26:0/403291185 learned_addr learned my addr 172.21.15.26:0/403291185 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:59.969 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:59.967+0000 7fb58178c700 1 -- 172.21.15.26:0/403291185 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57c0fc4a0 con 0x7fb57c0fba50 2021-11-03T16:46:59.969 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:59.967+0000 7fb58178c700 1 --2- 172.21.15.26:0/403291185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb57c0fba50 0x7fb57c0fbe70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fb57800b5f0 tx=0x7fb578006ee0).ready entity=mon.0 client_cookie=9f6d43537f0b9fb6 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:59.969 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:59.967+0000 7fb56bfff700 1 -- 172.21.15.26:0/403291185 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb57800d600 con 0x7fb57c0fba50 2021-11-03T16:46:59.970 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:59.968+0000 7fb56bfff700 1 -- 172.21.15.26:0/403291185 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fb57800dbf0 con 0x7fb57c0fba50 2021-11-03T16:46:59.970 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:59.968+0000 7fb56bfff700 1 -- 172.21.15.26:0/403291185 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb578011bf0 con 0x7fb57c0fba50 2021-11-03T16:46:59.970 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:59.968+0000 7fb58278e700 1 -- 172.21.15.26:0/403291185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb57c0fba50 msgr2=0x7fb57c0fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:46:59.970 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:59.968+0000 7fb58278e700 1 --2- 172.21.15.26:0/403291185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb57c0fba50 0x7fb57c0fbe70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fb57800b5f0 tx=0x7fb578006ee0).stop 2021-11-03T16:46:59.971 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:59.968+0000 7fb58278e700 1 -- 172.21.15.26:0/403291185 shutdown_connections 2021-11-03T16:46:59.971 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:59.968+0000 7fb58278e700 1 --2- 172.21.15.26:0/403291185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb57c0fba50 0x7fb57c0fbe70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:46:59.971 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:59.968+0000 7fb58278e700 1 -- 172.21.15.26:0/403291185 >> 172.21.15.26:0/403291185 conn(0x7fb57c0f7270 msgr2=0x7fb57c0f9690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:46:59.971 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:59.968+0000 7fb58278e700 1 -- 172.21.15.26:0/403291185 shutdown_connections 2021-11-03T16:46:59.972 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:59.968+0000 7fb58278e700 1 -- 172.21.15.26:0/403291185 wait complete. 2021-11-03T16:46:59.972 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:59.969+0000 7fb58278e700 1 Processor -- start 2021-11-03T16:46:59.972 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:59.969+0000 7fb58278e700 1 -- start start 2021-11-03T16:46:59.972 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:59.969+0000 7fb58278e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb57c0fba50 0x7fb57c10a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:59.973 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:59.969+0000 7fb58278e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c10ac90 con 0x7fb57c0fba50 2021-11-03T16:46:59.973 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:59.969+0000 7fb58178c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb57c0fba50 0x7fb57c10a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:59.973 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:59.969+0000 7fb58178c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb57c0fba50 0x7fb57c10a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49310/0 (socket says 172.21.15.26:49310) 2021-11-03T16:46:59.973 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:59.969+0000 7fb58178c700 1 -- 172.21.15.26:0/2200604739 learned_addr learned my addr 172.21.15.26:0/2200604739 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:46:59.974 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:59.969+0000 7fb58178c700 1 -- 172.21.15.26:0/2200604739 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57800b200 con 0x7fb57c0fba50 2021-11-03T16:46:59.974 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:59.969+0000 7fb58178c700 1 --2- 172.21.15.26:0/2200604739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb57c0fba50 0x7fb57c10a7a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fb578011e30 tx=0x7fb578006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:59.974 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:59.970+0000 7fb569ffb700 1 -- 172.21.15.26:0/2200604739 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb57801b410 con 0x7fb57c0fba50 2021-11-03T16:46:59.974 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:59.970+0000 7fb569ffb700 1 -- 172.21.15.26:0/2200604739 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fb57801ba00 con 0x7fb57c0fba50 2021-11-03T16:46:59.975 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:59.970+0000 7fb58278e700 1 -- 172.21.15.26:0/2200604739 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb57c10ae90 con 0x7fb57c0fba50 2021-11-03T16:46:59.975 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:59.970+0000 7fb569ffb700 1 -- 172.21.15.26:0/2200604739 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb57801a750 con 0x7fb57c0fba50 2021-11-03T16:46:59.975 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:59.970+0000 7fb58278e700 1 -- 172.21.15.26:0/2200604739 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb57c10b320 con 0x7fb57c0fba50 2021-11-03T16:46:59.975 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:59.971+0000 7fb569ffb700 1 -- 172.21.15.26:0/2200604739 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 36195+0+0 (secure 0 0 0) 0x7fb57802b070 con 0x7fb57c0fba50 2021-11-03T16:46:59.976 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:59.971+0000 7fb569ffb700 1 --2- 172.21.15.26:0/2200604739 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7fb56402feb0 0x7fb564032370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:46:59.976 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:59.971+0000 7fb569ffb700 1 -- 172.21.15.26:0/2200604739 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7fb578041560 con 0x7fb57c0fba50 2021-11-03T16:46:59.976 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:59.971+0000 7fb580f8b700 1 --2- 172.21.15.26:0/2200604739 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7fb56402feb0 0x7fb564032370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:46:59.976 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:59.971+0000 7fb58278e700 1 -- 172.21.15.26:0/2200604739 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb57c045ad0 con 0x7fb57c0fba50 2021-11-03T16:46:59.976 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:59.972+0000 7fb580f8b700 1 --2- 172.21.15.26:0/2200604739 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7fb56402feb0 0x7fb564032370 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fb56c0096a0 tx=0x7fb56c006b40).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:46:59.977 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:46:59.975+0000 7fb569ffb700 1 -- 172.21.15.26:0/2200604739 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fb578016020 con 0x7fb57c0fba50 2021-11-03T16:47:00.256 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:00.260+0000 7fb58278e700 1 -- 172.21.15.26:0/2200604739 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7fb57c0008d0 con 0x7fb57c0fba50 2021-11-03T16:47:00.259 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:00.263+0000 7fb569ffb700 1 -- 172.21.15.26:0/2200604739 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v10)=0 v10) v1 ==== 130+0+0 (secure 0 0 0) 0x7fb57801b570 con 0x7fb57c0fba50 2021-11-03T16:47:00.262 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:00.265+0000 7fb58278e700 1 -- 172.21.15.26:0/2200604739 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7fb56402feb0 msgr2=0x7fb564032370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:47:00.262 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:00.265+0000 7fb58278e700 1 --2- 172.21.15.26:0/2200604739 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7fb56402feb0 0x7fb564032370 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fb56c0096a0 tx=0x7fb56c006b40).stop 2021-11-03T16:47:00.262 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:00.265+0000 7fb58278e700 1 -- 172.21.15.26:0/2200604739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb57c0fba50 msgr2=0x7fb57c10a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:47:00.262 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:00.265+0000 7fb58278e700 1 --2- 172.21.15.26:0/2200604739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb57c0fba50 0x7fb57c10a7a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fb578011e30 tx=0x7fb578006ee0).stop 2021-11-03T16:47:00.263 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:00.265+0000 7fb58278e700 1 -- 172.21.15.26:0/2200604739 shutdown_connections 2021-11-03T16:47:00.263 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:00.265+0000 7fb58278e700 1 --2- 172.21.15.26:0/2200604739 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7fb56402feb0 0x7fb564032370 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:47:00.263 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:00.265+0000 7fb58278e700 1 --2- 172.21.15.26:0/2200604739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb57c0fba50 0x7fb57c10a7a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:47:00.263 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:00.265+0000 7fb58278e700 1 -- 172.21.15.26:0/2200604739 >> 172.21.15.26:0/2200604739 conn(0x7fb57c0f7270 msgr2=0x7fb57c0f8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:47:00.264 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:00.265+0000 7fb58278e700 1 -- 172.21.15.26:0/2200604739 shutdown_connections 2021-11-03T16:47:00.264 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:00.265+0000 7fb58278e700 1 -- 172.21.15.26:0/2200604739 wait complete. 2021-11-03T16:47:00.872 INFO:teuthology.orchestra.run.smithi026.stderr:Enabling the dashboard module... 2021-11-03T16:47:00.872 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi026 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprh0b9ciq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpg6zn56v0:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 mgr module enable dashboard 2021-11-03T16:47:01.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:01 smithi026 conmon[32119]: audit 2021-11-03T16:47:00.264095+0000 2021-11-03T16:47:01.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:01 smithi026 conmon[32119]: mon.smithi026 (mon.0) 87 : audit [INF] from='client.? 172.21.15.26:0/2200604739' entity='client.admin' 2021-11-03T16:47:01.546 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:01.549+0000 7f19b64b4700 1 Processor -- start 2021-11-03T16:47:01.546 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:01.549+0000 7f19b64b4700 1 -- start start 2021-11-03T16:47:01.547 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:01.549+0000 7f19b64b4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19b00fa8d0 0x7f19b00facf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-03T16:47:01.547 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:01.549+0000 7f19b64b4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b00fb1e0 con 0x7f19b00fa8d0 2021-11-03T16:47:01.547 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:01.550+0000 7f19b54b2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19b00fa8d0 0x7f19b00facf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:47:01.547 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:01.550+0000 7f19b54b2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19b00fa8d0 0x7f19b00facf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49314/0 (socket says 172.21.15.26:49314) 2021-11-03T16:47:01.548 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:01.550+0000 7f19b54b2700 1 -- 172.21.15.26:0/2478243033 learned_addr learned my addr 172.21.15.26:0/2478243033 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:47:01.548 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:01.550+0000 7f19b54b2700 1 -- 172.21.15.26:0/2478243033 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b00fb320 con 0x7f19b00fa8d0 2021-11-03T16:47:01.548 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:01.550+0000 7f19b54b2700 1 --2- 172.21.15.26:0/2478243033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19b00fa8d0 0x7f19b00facf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f19a800b870 tx=0x7f19a8006f70).ready entity=mon.0 client_cookie=87efd86307118c99 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:47:01.548 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:01.550+0000 7f19affff700 1 -- 172.21.15.26:0/2478243033 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f19a800da20 con 0x7f19b00fa8d0 2021-11-03T16:47:01.548 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:01.550+0000 7f19affff700 1 -- 172.21.15.26:0/2478243033 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f19a8010470 con 0x7f19b00fa8d0 2021-11-03T16:47:01.549 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:01.550+0000 7f19affff700 1 -- 172.21.15.26:0/2478243033 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f19a800f5b0 con 0x7f19b00fa8d0 2021-11-03T16:47:01.552 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:01.551+0000 7f19b64b4700 1 -- 172.21.15.26:0/2478243033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19b00fa8d0 msgr2=0x7f19b00facf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:47:01.552 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:01.551+0000 7f19b64b4700 1 --2- 172.21.15.26:0/2478243033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19b00fa8d0 0x7f19b00facf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f19a800b870 tx=0x7f19a8006f70).stop 2021-11-03T16:47:01.552 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:01.551+0000 7f19b64b4700 1 -- 172.21.15.26:0/2478243033 shutdown_connections 2021-11-03T16:47:01.552 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:01.551+0000 7f19b64b4700 1 --2- 172.21.15.26:0/2478243033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19b00fa8d0 0x7f19b00facf0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:47:01.553 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:01.551+0000 7f19b64b4700 1 -- 172.21.15.26:0/2478243033 >> 172.21.15.26:0/2478243033 conn(0x7f19b00f6110 msgr2=0x7f19b00f8530 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:47:01.553 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:01.551+0000 7f19b64b4700 1 -- 172.21.15.26:0/2478243033 shutdown_connections 2021-11-03T16:47:01.553 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:01.551+0000 7f19b64b4700 1 -- 172.21.15.26:0/2478243033 wait complete. 2021-11-03T16:47:01.553 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:01.552+0000 7f19b64b4700 1 Processor -- start 2021-11-03T16:47:01.553 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:01.552+0000 7f19b64b4700 1 -- start start 2021-11-03T16:47:01.554 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:01.552+0000 7f19b64b4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19b00fa8d0 0x7f19b010c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:47:01.554 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:01.552+0000 7f19b64b4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b010ceb0 con 0x7f19b00fa8d0 2021-11-03T16:47:01.554 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:01.552+0000 7f19b54b2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19b00fa8d0 0x7f19b010c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:47:01.554 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:01.552+0000 7f19b54b2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19b00fa8d0 0x7f19b010c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49316/0 (socket says 172.21.15.26:49316) 2021-11-03T16:47:01.555 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:01.552+0000 7f19b54b2700 1 -- 172.21.15.26:0/297048767 learned_addr learned my addr 172.21.15.26:0/297048767 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:47:01.555 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:01.552+0000 7f19b54b2700 1 -- 172.21.15.26:0/297048767 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a800b480 con 0x7f19b00fa8d0 2021-11-03T16:47:01.555 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:01.552+0000 7f19b54b2700 1 --2- 172.21.15.26:0/297048767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19b00fa8d0 0x7f19b010c9c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f19a8006a40 tx=0x7f19a8006f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:47:01.555 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:01.553+0000 7f19adffb700 1 -- 172.21.15.26:0/297048767 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f19a800f3d0 con 0x7f19b00fa8d0 2021-11-03T16:47:01.555 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:01.553+0000 7f19adffb700 1 -- 172.21.15.26:0/297048767 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f19a800fd00 con 0x7f19b00fa8d0 2021-11-03T16:47:01.556 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:01.553+0000 7f19b64b4700 1 -- 172.21.15.26:0/297048767 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b010d0b0 con 0x7f19b00fa8d0 2021-11-03T16:47:01.556 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:01.553+0000 7f19adffb700 1 -- 172.21.15.26:0/297048767 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f19a8019dc0 con 0x7f19b00fa8d0 2021-11-03T16:47:01.556 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:01.553+0000 7f19b64b4700 1 -- 172.21.15.26:0/297048767 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b010d540 con 0x7f19b00fa8d0 2021-11-03T16:47:01.556 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:01.554+0000 7f19adffb700 1 -- 172.21.15.26:0/297048767 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 36195+0+0 (secure 0 0 0) 0x7f19a802a070 con 0x7f19b00fa8d0 2021-11-03T16:47:01.557 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:01.554+0000 7f19adffb700 1 --2- 172.21.15.26:0/297048767 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7f199c02ff00 0x7f199c0323c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:47:01.557 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:01.554+0000 7f19adffb700 1 -- 172.21.15.26:0/297048767 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f19a8041910 con 0x7f19b00fa8d0 2021-11-03T16:47:01.557 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:01.554+0000 7f19b64b4700 1 -- 172.21.15.26:0/297048767 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b0045ad0 con 0x7f19b00fa8d0 2021-11-03T16:47:01.557 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:01.554+0000 7f19b4cb1700 1 --2- 172.21.15.26:0/297048767 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7f199c02ff00 0x7f199c0323c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:47:01.557 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:01.554+0000 7f19b4cb1700 1 --2- 172.21.15.26:0/297048767 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7f199c02ff00 0x7f199c0323c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f19a40096a0 tx=0x7f19a4006b40).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:47:01.558 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:01.558+0000 7f19adffb700 1 -- 172.21.15.26:0/297048767 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f19a8014080 con 0x7f19b00fa8d0 2021-11-03T16:47:01.913 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:01.917+0000 7f19b64b4700 1 -- 172.21.15.26:0/297048767 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f19b00fc620 con 0x7f19b00fa8d0 2021-11-03T16:47:02.261 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:02.266+0000 7f19adffb700 1 -- 172.21.15.26:0/297048767 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mgrmap(e 13) v1 ==== 36208+0+0 (secure 0 0 0) 0x7f19a8016030 con 0x7f19b00fa8d0 2021-11-03T16:47:02.262 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:02.267+0000 7f19adffb700 1 -- 172.21.15.26:0/297048767 <== mon.0 v2:172.21.15.26:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v13) v1 ==== 88+0+0 (secure 0 0 0) 0x7f19a802d660 con 0x7f19b00fa8d0 2021-11-03T16:47:02.266 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:02.269+0000 7f19b64b4700 1 -- 172.21.15.26:0/297048767 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7f199c02ff00 msgr2=0x7f199c0323c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:47:02.266 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:02.269+0000 7f19b64b4700 1 --2- 172.21.15.26:0/297048767 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7f199c02ff00 0x7f199c0323c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f19a40096a0 tx=0x7f19a4006b40).stop 2021-11-03T16:47:02.266 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:02.269+0000 7f19b64b4700 1 -- 172.21.15.26:0/297048767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19b00fa8d0 msgr2=0x7f19b010c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:47:02.266 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:02.269+0000 7f19b64b4700 1 --2- 172.21.15.26:0/297048767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19b00fa8d0 0x7f19b010c9c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f19a8006a40 tx=0x7f19a8006f70).stop 2021-11-03T16:47:02.267 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:02.269+0000 7f19b64b4700 1 -- 172.21.15.26:0/297048767 shutdown_connections 2021-11-03T16:47:02.267 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:02.269+0000 7f19b64b4700 1 --2- 172.21.15.26:0/297048767 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7f199c02ff00 0x7f199c0323c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:47:02.267 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:02.269+0000 7f19b64b4700 1 --2- 172.21.15.26:0/297048767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19b00fa8d0 0x7f19b010c9c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:47:02.267 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:02.269+0000 7f19b64b4700 1 -- 172.21.15.26:0/297048767 >> 172.21.15.26:0/297048767 conn(0x7f19b00f6110 msgr2=0x7f19b00ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:47:02.268 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:02.269+0000 7f19b64b4700 1 -- 172.21.15.26:0/297048767 shutdown_connections 2021-11-03T16:47:02.268 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:02.269+0000 7f19b64b4700 1 -- 172.21.15.26:0/297048767 wait complete. 2021-11-03T16:47:02.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:02 smithi026 conmon[32119]: audit 2021-11-03T16:47:01.918334+0000 mon.smithi026 (mon.0) 88 : audit [INF] from='client.? 172.21.15.26:0/297048767' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2021-11-03T16:47:02.847 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi026 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprh0b9ciq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpg6zn56v0:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 mgr stat 2021-11-03T16:47:03.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:03 smithi026 conmon[32119]: audit 2021-11-03T16:47:02.267794+0000 mon.smithi026 (mon.0) 89 : audit [INF] from='client.? 172.21.15.26:0/297048767' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2021-11-03T16:47:03.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:03 smithi026 conmon[32119]: cluster 2021-11-03T16:47:02.267883+0000 mon.smithi026 (mon.0) 90 : cluster [DBG] mgrmap e13: smithi026.cnrxli(active, since 11s) 2021-11-03T16:47:03.503 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.506+0000 7ffb97c5d700 1 Processor -- start 2021-11-03T16:47:03.504 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.507+0000 7ffb97c5d700 1 -- start start 2021-11-03T16:47:03.504 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.507+0000 7ffb97c5d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb900fbbc0 0x7ffb900fbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-03T16:47:03.504 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.507+0000 7ffb97c5d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb900fc4d0 con 0x7ffb900fbbc0 2021-11-03T16:47:03.505 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.507+0000 7ffb959f9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb900fbbc0 0x7ffb900fbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:47:03.505 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.507+0000 7ffb959f9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb900fbbc0 0x7ffb900fbfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49330/0 (socket says 172.21.15.26:49330) 2021-11-03T16:47:03.505 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.507+0000 7ffb959f9700 1 -- 172.21.15.26:0/2338025446 learned_addr learned my addr 172.21.15.26:0/2338025446 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:47:03.505 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.507+0000 7ffb959f9700 1 -- 172.21.15.26:0/2338025446 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb900fc610 con 0x7ffb900fbbc0 2021-11-03T16:47:03.506 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.508+0000 7ffb959f9700 1 --2- 172.21.15.26:0/2338025446 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb900fbbc0 0x7ffb900fbfe0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7ffb8c00b5f0 tx=0x7ffb8c006ee0).ready entity=mon.0 client_cookie=d88659d6d6d26bbd server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:47:03.506 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.508+0000 7ffb949f7700 1 -- 172.21.15.26:0/2338025446 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb8c00d600 con 0x7ffb900fbbc0 2021-11-03T16:47:03.506 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.508+0000 7ffb949f7700 1 -- 172.21.15.26:0/2338025446 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7ffb8c00dbf0 con 0x7ffb900fbbc0 2021-11-03T16:47:03.506 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.508+0000 7ffb949f7700 1 -- 172.21.15.26:0/2338025446 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb8c011bf0 con 0x7ffb900fbbc0 2021-11-03T16:47:03.509 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.508+0000 7ffb97c5d700 1 -- 172.21.15.26:0/2338025446 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb900fbbc0 msgr2=0x7ffb900fbfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:47:03.509 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.508+0000 7ffb97c5d700 1 --2- 172.21.15.26:0/2338025446 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb900fbbc0 0x7ffb900fbfe0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7ffb8c00b5f0 tx=0x7ffb8c006ee0).stop 2021-11-03T16:47:03.509 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.509+0000 7ffb97c5d700 1 -- 172.21.15.26:0/2338025446 shutdown_connections 2021-11-03T16:47:03.510 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.509+0000 7ffb97c5d700 1 --2- 172.21.15.26:0/2338025446 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb900fbbc0 0x7ffb900fbfe0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:47:03.510 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.509+0000 7ffb97c5d700 1 -- 172.21.15.26:0/2338025446 >> 172.21.15.26:0/2338025446 conn(0x7ffb900f73e0 msgr2=0x7ffb900f9800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:47:03.510 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.509+0000 7ffb97c5d700 1 -- 172.21.15.26:0/2338025446 shutdown_connections 2021-11-03T16:47:03.510 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.509+0000 7ffb97c5d700 1 -- 172.21.15.26:0/2338025446 wait complete. 2021-11-03T16:47:03.511 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.509+0000 7ffb97c5d700 1 Processor -- start 2021-11-03T16:47:03.511 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.509+0000 7ffb97c5d700 1 -- start start 2021-11-03T16:47:03.511 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.510+0000 7ffb97c5d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb900fbbc0 0x7ffb9010a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:47:03.511 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.510+0000 7ffb97c5d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9010ae70 con 0x7ffb900fbbc0 2021-11-03T16:47:03.511 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.510+0000 7ffb959f9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb900fbbc0 0x7ffb9010a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:47:03.512 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.510+0000 7ffb959f9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb900fbbc0 0x7ffb9010a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49332/0 (socket says 172.21.15.26:49332) 2021-11-03T16:47:03.512 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.510+0000 7ffb959f9700 1 -- 172.21.15.26:0/2487216205 learned_addr learned my addr 172.21.15.26:0/2487216205 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:47:03.512 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.510+0000 7ffb959f9700 1 -- 172.21.15.26:0/2487216205 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8c00b200 con 0x7ffb900fbbc0 2021-11-03T16:47:03.512 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.510+0000 7ffb959f9700 1 --2- 172.21.15.26:0/2487216205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb900fbbc0 0x7ffb9010a980 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7ffb8c011e30 tx=0x7ffb8c006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:47:03.513 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.510+0000 7ffb827fc700 1 -- 172.21.15.26:0/2487216205 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb8c01b410 con 0x7ffb900fbbc0 2021-11-03T16:47:03.513 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.510+0000 7ffb97c5d700 1 -- 172.21.15.26:0/2487216205 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb9010b070 con 0x7ffb900fbbc0 2021-11-03T16:47:03.513 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.510+0000 7ffb827fc700 1 -- 172.21.15.26:0/2487216205 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7ffb8c01ba00 con 0x7ffb900fbbc0 2021-11-03T16:47:03.513 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.510+0000 7ffb827fc700 1 -- 172.21.15.26:0/2487216205 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb8c01a750 con 0x7ffb900fbbc0 2021-11-03T16:47:03.513 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.510+0000 7ffb97c5d700 1 -- 172.21.15.26:0/2487216205 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb9010b500 con 0x7ffb900fbbc0 2021-11-03T16:47:03.514 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.511+0000 7ffb827fc700 1 -- 172.21.15.26:0/2487216205 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 13) v1 ==== 36208+0+0 (secure 0 0 0) 0x7ffb8c02b070 con 0x7ffb900fbbc0 2021-11-03T16:47:03.514 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.511+0000 7ffb97c5d700 1 -- 172.21.15.26:0/2487216205 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb90045ad0 con 0x7ffb900fbbc0 2021-11-03T16:47:03.514 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.512+0000 7ffb827fc700 1 --2- 172.21.15.26:0/2487216205 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7ffb7802feb0 0x7ffb78032370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:47:03.514 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.512+0000 7ffb827fc700 1 -- 172.21.15.26:0/2487216205 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7ffb8c0415c0 con 0x7ffb900fbbc0 2021-11-03T16:47:03.515 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.512+0000 7ffb951f8700 1 -- 172.21.15.26:0/2487216205 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7ffb7802feb0 msgr2=0x7ffb78032370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/3020148896 2021-11-03T16:47:03.515 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.512+0000 7ffb951f8700 1 --2- 172.21.15.26:0/2487216205 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7ffb7802feb0 0x7ffb78032370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2021-11-03T16:47:03.515 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.516+0000 7ffb827fc700 1 -- 172.21.15.26:0/2487216205 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7ffb8c02b900 con 0x7ffb900fbbc0 2021-11-03T16:47:03.709 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.713+0000 7ffb951f8700 1 -- 172.21.15.26:0/2487216205 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7ffb7802feb0 msgr2=0x7ffb78032370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/3020148896 2021-11-03T16:47:03.709 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.713+0000 7ffb951f8700 1 --2- 172.21.15.26:0/2487216205 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7ffb7802feb0 0x7ffb78032370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2021-11-03T16:47:03.901 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.904+0000 7ffb97c5d700 1 -- 172.21.15.26:0/2487216205 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7ffb9010c530 con 0x7ffb900fbbc0 2021-11-03T16:47:03.901 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.904+0000 7ffb827fc700 1 -- 172.21.15.26:0/2487216205 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v13) v1 ==== 56+0+104 (secure 0 0 0) 0x7ffb8c016020 con 0x7ffb900fbbc0 2021-11-03T16:47:03.901 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: { 2021-11-03T16:47:03.901 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "epoch": 13, 2021-11-03T16:47:03.902 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "available": true, 2021-11-03T16:47:03.902 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "active_name": "smithi026.cnrxli", 2021-11-03T16:47:03.902 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_standby": 0 2021-11-03T16:47:03.903 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: } 2021-11-03T16:47:03.904 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.906+0000 7ffb97c5d700 1 -- 172.21.15.26:0/2487216205 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7ffb7802feb0 msgr2=0x7ffb78032370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-11-03T16:47:03.904 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.906+0000 7ffb97c5d700 1 --2- 172.21.15.26:0/2487216205 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7ffb7802feb0 0x7ffb78032370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T16:47:03.905 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.906+0000 7ffb97c5d700 1 -- 172.21.15.26:0/2487216205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb900fbbc0 msgr2=0x7ffb9010a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:47:03.905 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.906+0000 7ffb97c5d700 1 --2- 172.21.15.26:0/2487216205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb900fbbc0 0x7ffb9010a980 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7ffb8c011e30 tx=0x7ffb8c006ee0).stop 2021-11-03T16:47:03.905 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.906+0000 7ffb97c5d700 1 -- 172.21.15.26:0/2487216205 shutdown_connections 2021-11-03T16:47:03.905 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.906+0000 7ffb97c5d700 1 --2- 172.21.15.26:0/2487216205 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7ffb7802feb0 0x7ffb78032370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T16:47:03.906 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.906+0000 7ffb97c5d700 1 --2- 172.21.15.26:0/2487216205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb900fbbc0 0x7ffb9010a980 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:47:03.906 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.906+0000 7ffb97c5d700 1 -- 172.21.15.26:0/2487216205 >> 172.21.15.26:0/2487216205 conn(0x7ffb900f73e0 msgr2=0x7ffb900f8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:47:03.906 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.906+0000 7ffb97c5d700 1 -- 172.21.15.26:0/2487216205 shutdown_connections 2021-11-03T16:47:03.906 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:03.906+0000 7ffb97c5d700 1 -- 172.21.15.26:0/2487216205 wait complete. 2021-11-03T16:47:04.497 INFO:teuthology.orchestra.run.smithi026.stderr:Waiting for the mgr to restart... 2021-11-03T16:47:04.497 INFO:teuthology.orchestra.run.smithi026.stderr:Waiting for mgr epoch 13... 2021-11-03T16:47:04.497 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi026 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprh0b9ciq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpg6zn56v0:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 tell mgr mgr_status 2021-11-03T16:47:04.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:04 smithi026 conmon[32119]: audit 2021-11-03T16:47: 2021-11-03T16:47:04.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:04 smithi026 conmon[32119]: 03.904950+0000 mon.smithi026 (mon.0) 91 : audit [DBG] from='client.? 172.21.15.26:0/2487216205' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2021-11-03T16:47:05.159 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.160+0000 7efc3154f700 1 Processor -- start 2021-11-03T16:47:05.160 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.160+0000 7efc3154f700 1 -- start start 2021-11-03T16:47:05.160 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.161+0000 7efc3154f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc2c06fae0 0x7efc2c0fe8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-03T16:47:05.160 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.161+0000 7efc3154f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c06ff00 con 0x7efc2c06fae0 2021-11-03T16:47:05.160 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.161+0000 7efc2affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc2c06fae0 0x7efc2c0fe8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:47:05.161 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.161+0000 7efc2affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc2c06fae0 0x7efc2c0fe8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49340/0 (socket says 172.21.15.26:49340) 2021-11-03T16:47:05.161 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.161+0000 7efc2affd700 1 -- 172.21.15.26:0/3202442951 learned_addr learned my addr 172.21.15.26:0/3202442951 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:47:05.161 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.161+0000 7efc2affd700 1 -- 172.21.15.26:0/3202442951 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2c0fedb0 con 0x7efc2c06fae0 2021-11-03T16:47:05.161 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.161+0000 7efc2affd700 1 --2- 172.21.15.26:0/3202442951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc2c06fae0 0x7efc2c0fe8c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7efc1c00b5f0 tx=0x7efc1c006ee0).ready entity=mon.0 client_cookie=4638220285a26ad9 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:47:05.161 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.161+0000 7efc29ffb700 1 -- 172.21.15.26:0/3202442951 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efc1c00d600 con 0x7efc2c06fae0 2021-11-03T16:47:05.162 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.162+0000 7efc29ffb700 1 -- 172.21.15.26:0/3202442951 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7efc1c00dbf0 con 0x7efc2c06fae0 2021-11-03T16:47:05.162 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.162+0000 7efc29ffb700 1 -- 172.21.15.26:0/3202442951 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efc1c011bf0 con 0x7efc2c06fae0 2021-11-03T16:47:05.162 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.162+0000 7efc3154f700 1 -- 172.21.15.26:0/3202442951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc2c06fae0 msgr2=0x7efc2c0fe8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:47:05.162 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.162+0000 7efc3154f700 1 --2- 172.21.15.26:0/3202442951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc2c06fae0 0x7efc2c0fe8c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7efc1c00b5f0 tx=0x7efc1c006ee0).stop 2021-11-03T16:47:05.163 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.162+0000 7efc3154f700 1 -- 172.21.15.26:0/3202442951 shutdown_connections 2021-11-03T16:47:05.163 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.162+0000 7efc3154f700 1 --2- 172.21.15.26:0/3202442951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc2c06fae0 0x7efc2c0fe8c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:47:05.163 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.162+0000 7efc3154f700 1 -- 172.21.15.26:0/3202442951 >> 172.21.15.26:0/3202442951 conn(0x7efc2c0f6260 msgr2=0x7efc2c0f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:47:05.163 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.162+0000 7efc3154f700 1 -- 172.21.15.26:0/3202442951 shutdown_connections 2021-11-03T16:47:05.163 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.162+0000 7efc3154f700 1 -- 172.21.15.26:0/3202442951 wait complete. 2021-11-03T16:47:05.164 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.163+0000 7efc3154f700 1 Processor -- start 2021-11-03T16:47:05.164 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.163+0000 7efc3154f700 1 -- start start 2021-11-03T16:47:05.164 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.163+0000 7efc3154f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc2c06fae0 0x7efc2c10a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:47:05.164 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.163+0000 7efc3154f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c10ade0 con 0x7efc2c06fae0 2021-11-03T16:47:05.165 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.163+0000 7efc2affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc2c06fae0 0x7efc2c10a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:47:05.165 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.163+0000 7efc2affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc2c06fae0 0x7efc2c10a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49342/0 (socket says 172.21.15.26:49342) 2021-11-03T16:47:05.165 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.163+0000 7efc2affd700 1 -- 172.21.15.26:0/4258108418 learned_addr learned my addr 172.21.15.26:0/4258108418 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:47:05.166 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.164+0000 7efc2affd700 1 -- 172.21.15.26:0/4258108418 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc1c00b200 con 0x7efc2c06fae0 2021-11-03T16:47:05.167 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.164+0000 7efc2affd700 1 --2- 172.21.15.26:0/4258108418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc2c06fae0 0x7efc2c10a8f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7efc1c011e00 tx=0x7efc1c006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:47:05.167 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.164+0000 7efc237fe700 1 -- 172.21.15.26:0/4258108418 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efc1c01b410 con 0x7efc2c06fae0 2021-11-03T16:47:05.167 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.164+0000 7efc237fe700 1 -- 172.21.15.26:0/4258108418 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7efc1c01ba00 con 0x7efc2c06fae0 2021-11-03T16:47:05.167 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.164+0000 7efc3154f700 1 -- 172.21.15.26:0/4258108418 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc2c10afe0 con 0x7efc2c06fae0 2021-11-03T16:47:05.168 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.164+0000 7efc237fe700 1 -- 172.21.15.26:0/4258108418 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efc1c01a780 con 0x7efc2c06fae0 2021-11-03T16:47:05.168 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.164+0000 7efc3154f700 1 -- 172.21.15.26:0/4258108418 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc2c10b470 con 0x7efc2c06fae0 2021-11-03T16:47:05.168 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.165+0000 7efc237fe700 1 -- 172.21.15.26:0/4258108418 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 13) v1 ==== 36208+0+0 (secure 0 0 0) 0x7efc1c02b070 con 0x7efc2c06fae0 2021-11-03T16:47:05.168 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.165+0000 7efc237fe700 1 --2- 172.21.15.26:0/4258108418 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7efc0c02feb0 0x7efc0c032370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:47:05.169 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.165+0000 7efc237fe700 1 -- 172.21.15.26:0/4258108418 --> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7efc0c032a30 con 0x7efc0c02feb0 2021-11-03T16:47:05.169 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.165+0000 7efc237fe700 1 -- 172.21.15.26:0/4258108418 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7efc1c0416d0 con 0x7efc2c06fae0 2021-11-03T16:47:05.169 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.165+0000 7efc2a7fc700 1 -- 172.21.15.26:0/4258108418 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7efc0c02feb0 msgr2=0x7efc0c032370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/3020148896 2021-11-03T16:47:05.169 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.166+0000 7efc2a7fc700 1 --2- 172.21.15.26:0/4258108418 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7efc0c02feb0 0x7efc0c032370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2021-11-03T16:47:05.364 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.367+0000 7efc2a7fc700 1 -- 172.21.15.26:0/4258108418 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7efc0c02feb0 msgr2=0x7efc0c032370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/3020148896 2021-11-03T16:47:05.364 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.367+0000 7efc2a7fc700 1 --2- 172.21.15.26:0/4258108418 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7efc0c02feb0 0x7efc0c032370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2021-11-03T16:47:05.763 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.768+0000 7efc2a7fc700 1 -- 172.21.15.26:0/4258108418 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7efc0c02feb0 msgr2=0x7efc0c032370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/3020148896 2021-11-03T16:47:05.764 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:05.768+0000 7efc2a7fc700 1 --2- 172.21.15.26:0/4258108418 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7efc0c02feb0 0x7efc0c032370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2021-11-03T16:47:06.564 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:06.569+0000 7efc2a7fc700 1 -- 172.21.15.26:0/4258108418 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7efc0c02feb0 msgr2=0x7efc0c032370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/3020148896 2021-11-03T16:47:06.565 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:06.569+0000 7efc2a7fc700 1 --2- 172.21.15.26:0/4258108418 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7efc0c02feb0 0x7efc0c032370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2021-11-03T16:47:08.167 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:08.169+0000 7efc2a7fc700 1 -- 172.21.15.26:0/4258108418 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7efc0c02feb0 msgr2=0x7efc0c032370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/3020148896 2021-11-03T16:47:08.167 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:08.169+0000 7efc2a7fc700 1 --2- 172.21.15.26:0/4258108418 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7efc0c02feb0 0x7efc0c032370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2021-11-03T16:47:08.971 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:08.974+0000 7efc237fe700 1 -- 172.21.15.26:0/4258108418 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mgrmap(e 14) v1 ==== 35997+0+0 (secure 0 0 0) 0x7efc1c00f070 con 0x7efc2c06fae0 2021-11-03T16:47:08.972 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:08.974+0000 7efc237fe700 1 -- 172.21.15.26:0/4258108418 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7efc0c02feb0 msgr2=0x7efc0c032370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-11-03T16:47:08.972 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:08.974+0000 7efc237fe700 1 --2- 172.21.15.26:0/4258108418 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7efc0c02feb0 0x7efc0c032370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T16:47:09.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: cluster 2021-11-03T16:47:08.279588+0000 mon.smithi026 (mon. 2021-11-03T16:47:09.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: 0) 92 : cluster [INF] Active manager daemon smithi026.cnrxli restarted 2021-11-03T16:47:09.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: cluster 2021-11-03T16:47:08.279977 2021-11-03T16:47:09.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: +0000 mon.smithi026 (mon.0) 93 : cluster [INF] Activating manager daemon smithi026.cnrxli 2021-11-03T16:47:09.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: cluster 2021-11-03 2021-11-03T16:47:09.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: T16:47:08.281954+0000 mon.smithi026 ( 2021-11-03T16:47:09.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: mon.0) 94 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2021-11-03T16:47:09.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: cluster 2021-11-03T16:47:09.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: 2021-11-03T 2021-11-03T16:47:09.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: 16:47:08.977719+0000 mon.smithi026 ( 2021-11-03T16:47:09.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: mon.0) 95 : cluster [DBG] mgrmap e14: smithi026.cnrxli(active, starting, since 0.697821s) 2021-11-03T16:47:09.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: audit 2021-11-03T16:47:09.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: 2021-11-03T16:47:08. 2021-11-03T16:47:09.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: 978849+0000 mon.smithi026 (mon.0) 96 : audit 2021-11-03T16:47:09.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata", "id": "smithi026"}]: dispatch 2021-11-03T16:47:09.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: audit 2021-11-03T 2021-11-03T16:47:09.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: 16:47:08.979748+0000 mon.smithi026 (mon 2021-11-03T16:47:09.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: .0) 97 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mgr metadata", "who": "smithi026.cnrxli", "id": "smithi026.cnrxli"}]: dispatch 2021-11-03T16:47:09.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: audit 2021 2021-11-03T16:47:09.428 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: -11-03T16:47:08. 2021-11-03T16:47:09.428 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: 980664+0000 mon.smithi026 (mon.0) 98 : audit 2021-11-03T16:47:09.428 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-11-03T16:47:09.429 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: audit 2021- 2021-11-03T16:47:09.429 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: 11-03T16:47:08.980892+0000 2021-11-03T16:47:09.430 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: mon.smithi026 (mon.0) 99 : audit 2021-11-03T16:47:09.430 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-11-03T16:47:09.430 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: audit 2021-11-03T 2021-11-03T16:47:09.430 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: 16:47:08.981101+0000 mon.smithi026 (mon. 2021-11-03T16:47:09.430 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: 0) 100 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-11-03T16:47:09.431 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: cluster 2021-11-03T16:47:09.431 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: 2021-11-03T16:47:08. 2021-11-03T16:47:09.431 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: 983938+0000 mon.smithi026 (mon.0) 101 : 2021-11-03T16:47:09.431 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: cluster [INF] Manager daemon smithi026.cnrxli is now available 2021-11-03T16:47:09.432 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: audit 2021 2021-11-03T16:47:09.432 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: -11-03T16:47:09.127483 2021-11-03T16:47:09.434 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: +0000 mon.smithi026 (mon.0) 102 : audit 2021-11-03T16:47:09.434 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:47:09.434 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: audit 2021-11-03 2021-11-03T16:47:09.435 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: T16:47:09.130073+0000 mon.smithi026 2021-11-03T16:47:09.435 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: (mon.0) 103 : audit [DBG] 2021-11-03T16:47:09.435 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:47:09.435 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: audit 2021-11-03T16:47:09.436 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: 2021-11-03T16:47:09.156456 2021-11-03T16:47:09.436 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: +0000 mon.smithi026 (mon.0) 104 : audit 2021-11-03T16:47:09.436 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T16:47:09.437 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: audit 2021-11-03T16 2021-11-03T16:47:09.437 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: :47:09.160195+0000 mon.smithi026 (mon 2021-11-03T16:47:09.437 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:09 smithi026 conmon[32119]: .0) 105 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T16:47:09.973 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:09.975+0000 7efc237fe700 1 -- 172.21.15.26:0/4258108418 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mgrmap(e 15) v1 ==== 36067+0+0 (secure 0 0 0) 0x7efc1c0407d0 con 0x7efc2c06fae0 2021-11-03T16:47:09.973 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:09.975+0000 7efc237fe700 1 --2- 172.21.15.26:0/4258108418 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7efc0c033ad0 0x7efc0c035ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:47:09.974 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:09.976+0000 7efc237fe700 1 -- 172.21.15.26:0/4258108418 --> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7efc0c032a30 con 0x7efc0c033ad0 2021-11-03T16:47:09.974 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:09.976+0000 7efc2a7fc700 1 --2- 172.21.15.26:0/4258108418 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7efc0c033ad0 0x7efc0c035ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:47:09.974 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:09.977+0000 7efc2a7fc700 1 --2- 172.21.15.26:0/4258108418 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7efc0c033ad0 0x7efc0c035ec0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7efc14006fd0 tx=0x7efc14006cf0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:47:09.975 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:09.977+0000 7efc237fe700 1 -- 172.21.15.26:0/4258108418 <== mgr.14162 v2:172.21.15.26:6800/3029163595 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6438 (secure 0 0 0) 0x7efc0c032a30 con 0x7efc0c033ad0 2021-11-03T16:47:09.984 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:09.987+0000 7efc3154f700 1 -- 172.21.15.26:0/4258108418 --> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7efc2c059100 con 0x7efc0c033ad0 2021-11-03T16:47:09.984 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:09.988+0000 7efc237fe700 1 -- 172.21.15.26:0/4258108418 <== mgr.14162 v2:172.21.15.26:6800/3029163595 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7efc2c059100 con 0x7efc0c033ad0 2021-11-03T16:47:09.987 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: { 2021-11-03T16:47:09.987 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "mgrmap_epoch": 15, 2021-11-03T16:47:09.988 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "initialized": true 2021-11-03T16:47:09.988 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: } 2021-11-03T16:47:09.988 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:09.988+0000 7efc3154f700 1 -- 172.21.15.26:0/4258108418 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7efc0c033ad0 msgr2=0x7efc0c035ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:47:09.988 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:09.988+0000 7efc3154f700 1 --2- 172.21.15.26:0/4258108418 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7efc0c033ad0 0x7efc0c035ec0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7efc14006fd0 tx=0x7efc14006cf0).stop 2021-11-03T16:47:09.989 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:09.988+0000 7efc3154f700 1 -- 172.21.15.26:0/4258108418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc2c06fae0 msgr2=0x7efc2c10a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:47:09.989 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:09.988+0000 7efc3154f700 1 --2- 172.21.15.26:0/4258108418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc2c06fae0 0x7efc2c10a8f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7efc1c011e00 tx=0x7efc1c006ee0).stop 2021-11-03T16:47:09.989 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:09.988+0000 7efc3154f700 1 -- 172.21.15.26:0/4258108418 shutdown_connections 2021-11-03T16:47:09.989 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:09.988+0000 7efc3154f700 1 --2- 172.21.15.26:0/4258108418 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7efc0c033ad0 0x7efc0c035ec0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:47:09.990 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:09.988+0000 7efc3154f700 1 --2- 172.21.15.26:0/4258108418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc2c06fae0 0x7efc2c10a8f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:47:09.990 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:09.988+0000 7efc3154f700 1 --2- 172.21.15.26:0/4258108418 >> [v2:172.21.15.26:6800/3020148896,v1:172.21.15.26:6801/3020148896] conn(0x7efc0c02feb0 0x7efc0c032370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T16:47:09.991 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:09.988+0000 7efc3154f700 1 -- 172.21.15.26:0/4258108418 >> 172.21.15.26:0/4258108418 conn(0x7efc2c0f6260 msgr2=0x7efc2c0f7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:47:09.991 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:09.988+0000 7efc3154f700 1 -- 172.21.15.26:0/4258108418 shutdown_connections 2021-11-03T16:47:09.992 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:09.988+0000 7efc3154f700 1 -- 172.21.15.26:0/4258108418 wait complete. 2021-11-03T16:47:10.688 INFO:teuthology.orchestra.run.smithi026.stderr:mgr epoch 13 is available 2021-11-03T16:47:10.688 INFO:teuthology.orchestra.run.smithi026.stderr:Generating a dashboard self-signed certificate... 2021-11-03T16:47:10.688 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi026 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprh0b9ciq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpg6zn56v0:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 dashboard create-self-signed-cert 2021-11-03T16:47:11.228 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:10 smithi026 conmon[32119]: cluster 2021-11-03T16:47:09.978600+0000 mon.smithi026 (mon 2021-11-03T16:47:11.228 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:10 smithi026 conmon[32119]: .0) 106 : cluster [DBG] mgrmap e15: smithi026.cnrxli(active, since 1.69871s) 2021-11-03T16:47:11.228 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:10 smithi026 conmon[32119]: audit 2021-11-03T16:47:09.978935+0000 mgr.smithi026.cnrxli (mgr.14162) 1 : audit [DBG] from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2021-11-03T16:47:11.229 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:10 smithi026 conmon[32119]: audit 2021-11-03T16:47:09.989502+0000 mgr.smithi026.cnrxli (mgr.14162) 2 : audit [DBG] from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2021-11-03T16:47:11.229 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:10 smithi026 conmon[32119]: audit 2021-11-03T16:47:10.689610+0000 mon.smithi026 (mon.0) 107 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:47:11.411 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.405+0000 7f15b2828700 1 Processor -- start 2021-11-03T16:47:11.412 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.405+0000 7f15b2828700 1 -- start start 2021-11-03T16:47:11.412 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.405+0000 7f15b2828700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15ac0fb9d0 0x7f15ac0fbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-03T16:47:11.412 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.405+0000 7f15b2828700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac0fc370 con 0x7f15ac0fb9d0 2021-11-03T16:47:11.412 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.405+0000 7f15b1826700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15ac0fb9d0 0x7f15ac0fbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:47:11.413 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.406+0000 7f15b1826700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15ac0fb9d0 0x7f15ac0fbdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49390/0 (socket says 172.21.15.26:49390) 2021-11-03T16:47:11.413 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.406+0000 7f15b1826700 1 -- 172.21.15.26:0/1703260412 learned_addr learned my addr 172.21.15.26:0/1703260412 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:47:11.413 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.406+0000 7f15b1826700 1 -- 172.21.15.26:0/1703260412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ac0fc4b0 con 0x7f15ac0fb9d0 2021-11-03T16:47:11.413 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.406+0000 7f15b1826700 1 --2- 172.21.15.26:0/1703260412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15ac0fb9d0 0x7f15ac0fbdf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f15a800b5f0 tx=0x7f15a8006ee0).ready entity=mon.0 client_cookie=1ae066bf19720f14 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:47:11.413 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.406+0000 7f15b0824700 1 -- 172.21.15.26:0/1703260412 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f15a800d600 con 0x7f15ac0fb9d0 2021-11-03T16:47:11.414 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.406+0000 7f15b0824700 1 -- 172.21.15.26:0/1703260412 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f15a800dbf0 con 0x7f15ac0fb9d0 2021-11-03T16:47:11.414 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.406+0000 7f15b0824700 1 -- 172.21.15.26:0/1703260412 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f15a8011bf0 con 0x7f15ac0fb9d0 2021-11-03T16:47:11.414 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.407+0000 7f15b2828700 1 -- 172.21.15.26:0/1703260412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15ac0fb9d0 msgr2=0x7f15ac0fbdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:47:11.414 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.407+0000 7f15b2828700 1 --2- 172.21.15.26:0/1703260412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15ac0fb9d0 0x7f15ac0fbdf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f15a800b5f0 tx=0x7f15a8006ee0).stop 2021-11-03T16:47:11.415 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.407+0000 7f15b2828700 1 -- 172.21.15.26:0/1703260412 shutdown_connections 2021-11-03T16:47:11.415 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.407+0000 7f15b2828700 1 --2- 172.21.15.26:0/1703260412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15ac0fb9d0 0x7f15ac0fbdf0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:47:11.415 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.407+0000 7f15b2828700 1 -- 172.21.15.26:0/1703260412 >> 172.21.15.26:0/1703260412 conn(0x7f15ac0f7130 msgr2=0x7f15ac0f9550 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:47:11.415 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.407+0000 7f15b2828700 1 -- 172.21.15.26:0/1703260412 shutdown_connections 2021-11-03T16:47:11.415 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.407+0000 7f15b2828700 1 -- 172.21.15.26:0/1703260412 wait complete. 2021-11-03T16:47:11.416 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.408+0000 7f15b2828700 1 Processor -- start 2021-11-03T16:47:11.416 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.408+0000 7f15b2828700 1 -- start start 2021-11-03T16:47:11.416 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.408+0000 7f15b2828700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15ac0fb9d0 0x7f15ac071d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:47:11.416 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.408+0000 7f15b2828700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac070180 con 0x7f15ac0fb9d0 2021-11-03T16:47:11.416 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.408+0000 7f15b1826700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15ac0fb9d0 0x7f15ac071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:47:11.417 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.408+0000 7f15b1826700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15ac0fb9d0 0x7f15ac071d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49392/0 (socket says 172.21.15.26:49392) 2021-11-03T16:47:11.417 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.408+0000 7f15b1826700 1 -- 172.21.15.26:0/3941173277 learned_addr learned my addr 172.21.15.26:0/3941173277 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:47:11.417 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.408+0000 7f15b1826700 1 -- 172.21.15.26:0/3941173277 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a800b200 con 0x7f15ac0fb9d0 2021-11-03T16:47:11.417 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.408+0000 7f15b1826700 1 --2- 172.21.15.26:0/3941173277 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15ac0fb9d0 0x7f15ac071d00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f15a8011e00 tx=0x7f15a8006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:47:11.418 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.409+0000 7f159a7fc700 1 -- 172.21.15.26:0/3941173277 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f15a801b410 con 0x7f15ac0fb9d0 2021-11-03T16:47:11.418 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.409+0000 7f15b2828700 1 -- 172.21.15.26:0/3941173277 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15ac070320 con 0x7f15ac0fb9d0 2021-11-03T16:47:11.418 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.409+0000 7f159a7fc700 1 -- 172.21.15.26:0/3941173277 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f15a801ba00 con 0x7f15ac0fb9d0 2021-11-03T16:47:11.418 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.409+0000 7f159a7fc700 1 -- 172.21.15.26:0/3941173277 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f15a801a780 con 0x7f15ac0fb9d0 2021-11-03T16:47:11.418 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.409+0000 7f15b2828700 1 -- 172.21.15.26:0/3941173277 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15ac0707b0 con 0x7f15ac0fb9d0 2021-11-03T16:47:11.419 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.410+0000 7f15b2828700 1 -- 172.21.15.26:0/3941173277 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15ac045ad0 con 0x7f15ac0fb9d0 2021-11-03T16:47:11.419 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.410+0000 7f159a7fc700 1 -- 172.21.15.26:0/3941173277 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) v1 ==== 36208+0+0 (secure 0 0 0) 0x7f15a800f070 con 0x7f15ac0fb9d0 2021-11-03T16:47:11.419 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.410+0000 7f159a7fc700 1 --2- 172.21.15.26:0/3941173277 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f159402feb0 0x7f1594032370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:47:11.419 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.410+0000 7f159a7fc700 1 -- 172.21.15.26:0/3941173277 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f15a8041490 con 0x7f15ac0fb9d0 2021-11-03T16:47:11.420 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.410+0000 7f15b1025700 1 --2- 172.21.15.26:0/3941173277 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f159402feb0 0x7f1594032370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:47:11.420 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.411+0000 7f15b1025700 1 --2- 172.21.15.26:0/3941173277 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f159402feb0 0x7f1594032370 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f159c0096a0 tx=0x7f159c006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:47:11.420 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.415+0000 7f159a7fc700 1 -- 172.21.15.26:0/3941173277 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f15a802baa0 con 0x7f15ac0fb9d0 2021-11-03T16:47:11.712 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.715+0000 7f15b2828700 1 -- 172.21.15.26:0/3941173277 --> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f15ac0fd920 con 0x7f159402feb0 2021-11-03T16:47:11.879 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.882+0000 7f159a7fc700 1 -- 172.21.15.26:0/3941173277 <== mgr.14162 v2:172.21.15.26:6800/3029163595 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f15ac0fd920 con 0x7f159402feb0 2021-11-03T16:47:11.879 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: Self-signed certificate created 2021-11-03T16:47:11.881 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.884+0000 7f15b2828700 1 -- 172.21.15.26:0/3941173277 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f159402feb0 msgr2=0x7f1594032370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:47:11.881 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.884+0000 7f15b2828700 1 --2- 172.21.15.26:0/3941173277 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f159402feb0 0x7f1594032370 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f159c0096a0 tx=0x7f159c006b40).stop 2021-11-03T16:47:11.882 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.884+0000 7f15b2828700 1 -- 172.21.15.26:0/3941173277 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15ac0fb9d0 msgr2=0x7f15ac071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:47:11.882 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.884+0000 7f15b2828700 1 --2- 172.21.15.26:0/3941173277 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15ac0fb9d0 0x7f15ac071d00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f15a8011e00 tx=0x7f15a8006ee0).stop 2021-11-03T16:47:11.882 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.884+0000 7f15b2828700 1 -- 172.21.15.26:0/3941173277 shutdown_connections 2021-11-03T16:47:11.882 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.884+0000 7f15b2828700 1 --2- 172.21.15.26:0/3941173277 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f159402feb0 0x7f1594032370 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:47:11.883 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.884+0000 7f15b2828700 1 --2- 172.21.15.26:0/3941173277 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15ac0fb9d0 0x7f15ac071d00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:47:11.883 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.884+0000 7f15b2828700 1 -- 172.21.15.26:0/3941173277 >> 172.21.15.26:0/3941173277 conn(0x7f15ac0f7130 msgr2=0x7f15ac0f8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:47:11.883 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.884+0000 7f15b2828700 1 -- 172.21.15.26:0/3941173277 shutdown_connections 2021-11-03T16:47:11.883 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:11.884+0000 7f15b2828700 1 -- 172.21.15.26:0/3941173277 wait complete. 2021-11-03T16:47:12.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:11 smithi026 conmon[32119]: cluster 2021-11-03T16:47:10.981531+0000 mon.smithi026 (mon.0) 108 : cluster [DBG] mgrmap e16: smithi026.cnrxli(active, since 2s) 2021-11-03T16:47:12.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:11 smithi026 conmon[32119]: audit 2021-11-03T16:47:11.881797+0000 mon.smithi026 (mon.0) 109 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:47:12.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:11 smithi026 conmon[32119]: audit 2021-11-03T16:47:11.883498+0000 mon.smithi026 (mon.0) 110 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:47:12.664 INFO:teuthology.orchestra.run.smithi026.stderr:Creating initial admin user... 2021-11-03T16:47:12.664 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi026 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprh0b9ciq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpg6zn56v0:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmp5rq16acd:/tmp/dashboard.pw:z docker.io/ceph/ceph:v16.2.4 dashboard ac-user-create admin -i /tmp/dashboard.pw administrator --force-password --pwd-update-required 2021-11-03T16:47:13.351 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.349+0000 7f026ad14700 1 Processor -- start 2021-11-03T16:47:13.351 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.349+0000 7f026ad14700 1 -- start start 2021-11-03T16:47:13.351 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.349+0000 7f026ad14700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02640fd280 0x7f02640fd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-03T16:47:13.352 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.349+0000 7f026ad14700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02640fdb90 con 0x7f02640fd280 2021-11-03T16:47:13.352 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.349+0000 7f0268ab0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02640fd280 0x7f02640fd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:47:13.352 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.349+0000 7f0268ab0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02640fd280 0x7f02640fd6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49396/0 (socket says 172.21.15.26:49396) 2021-11-03T16:47:13.352 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.349+0000 7f0268ab0700 1 -- 172.21.15.26:0/3537144023 learned_addr learned my addr 172.21.15.26:0/3537144023 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:47:13.353 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.349+0000 7f0268ab0700 1 -- 172.21.15.26:0/3537144023 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02640fdcd0 con 0x7f02640fd280 2021-11-03T16:47:13.353 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.350+0000 7f0268ab0700 1 --2- 172.21.15.26:0/3537144023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02640fd280 0x7f02640fd6a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f025800b5f0 tx=0x7f0258006ee0).ready entity=mon.0 client_cookie=672015d43a737d4e server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:47:13.353 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.350+0000 7f02637fe700 1 -- 172.21.15.26:0/3537144023 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f025800d600 con 0x7f02640fd280 2021-11-03T16:47:13.353 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.350+0000 7f02637fe700 1 -- 172.21.15.26:0/3537144023 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f025800dbf0 con 0x7f02640fd280 2021-11-03T16:47:13.354 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.350+0000 7f02637fe700 1 -- 172.21.15.26:0/3537144023 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0258011bf0 con 0x7f02640fd280 2021-11-03T16:47:13.354 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.350+0000 7f026ad14700 1 -- 172.21.15.26:0/3537144023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02640fd280 msgr2=0x7f02640fd6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:47:13.354 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.350+0000 7f026ad14700 1 --2- 172.21.15.26:0/3537144023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02640fd280 0x7f02640fd6a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f025800b5f0 tx=0x7f0258006ee0).stop 2021-11-03T16:47:13.355 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.350+0000 7f026ad14700 1 -- 172.21.15.26:0/3537144023 shutdown_connections 2021-11-03T16:47:13.355 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.350+0000 7f026ad14700 1 --2- 172.21.15.26:0/3537144023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02640fd280 0x7f02640fd6a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:47:13.355 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.350+0000 7f026ad14700 1 -- 172.21.15.26:0/3537144023 >> 172.21.15.26:0/3537144023 conn(0x7f02640f5a60 msgr2=0x7f02640f7e80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:47:13.355 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.351+0000 7f026ad14700 1 -- 172.21.15.26:0/3537144023 shutdown_connections 2021-11-03T16:47:13.356 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.351+0000 7f026ad14700 1 -- 172.21.15.26:0/3537144023 wait complete. 2021-11-03T16:47:13.356 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.351+0000 7f026ad14700 1 Processor -- start 2021-11-03T16:47:13.356 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.351+0000 7f026ad14700 1 -- start start 2021-11-03T16:47:13.356 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.351+0000 7f026ad14700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02640fd280 0x7f02640fcb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:47:13.357 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.351+0000 7f026ad14700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02640fafd0 con 0x7f02640fd280 2021-11-03T16:47:13.357 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.352+0000 7f0268ab0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02640fd280 0x7f02640fcb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:47:13.357 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.352+0000 7f0268ab0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02640fd280 0x7f02640fcb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49398/0 (socket says 172.21.15.26:49398) 2021-11-03T16:47:13.357 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.352+0000 7f0268ab0700 1 -- 172.21.15.26:0/2718870910 learned_addr learned my addr 172.21.15.26:0/2718870910 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:47:13.358 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.352+0000 7f0268ab0700 1 -- 172.21.15.26:0/2718870910 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025800b200 con 0x7f02640fd280 2021-11-03T16:47:13.358 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.352+0000 7f0268ab0700 1 --2- 172.21.15.26:0/2718870910 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02640fd280 0x7f02640fcb50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f0258011e30 tx=0x7f0258006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:47:13.358 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.352+0000 7f02617fa700 1 -- 172.21.15.26:0/2718870910 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f025801b410 con 0x7f02640fd280 2021-11-03T16:47:13.358 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.352+0000 7f02617fa700 1 -- 172.21.15.26:0/2718870910 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f025801ba00 con 0x7f02640fd280 2021-11-03T16:47:13.359 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.352+0000 7f026ad14700 1 -- 172.21.15.26:0/2718870910 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02640fb170 con 0x7f02640fd280 2021-11-03T16:47:13.359 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.352+0000 7f02617fa700 1 -- 172.21.15.26:0/2718870910 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f025801a750 con 0x7f02640fd280 2021-11-03T16:47:13.359 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.352+0000 7f026ad14700 1 -- 172.21.15.26:0/2718870910 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02640fb600 con 0x7f02640fd280 2021-11-03T16:47:13.359 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.353+0000 7f02617fa700 1 -- 172.21.15.26:0/2718870910 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) v1 ==== 36208+0+0 (secure 0 0 0) 0x7f025802b070 con 0x7f02640fd280 2021-11-03T16:47:13.360 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.353+0000 7f02617fa700 1 --2- 172.21.15.26:0/2718870910 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f024802ff00 0x7f02480323c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:47:13.360 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.353+0000 7f02617fa700 1 -- 172.21.15.26:0/2718870910 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f02580416d0 con 0x7f02640fd280 2021-11-03T16:47:13.360 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.353+0000 7f0263fff700 1 --2- 172.21.15.26:0/2718870910 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f024802ff00 0x7f02480323c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:47:13.360 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.354+0000 7f026ad14700 1 -- 172.21.15.26:0/2718870910 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0264059100 con 0x7f02640fd280 2021-11-03T16:47:13.361 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.354+0000 7f0263fff700 1 --2- 172.21.15.26:0/2718870910 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f024802ff00 0x7f02480323c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f02500096a0 tx=0x7f0250006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:47:13.361 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.358+0000 7f02617fa700 1 -- 172.21.15.26:0/2718870910 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f0258016070 con 0x7f02640fd280 2021-11-03T16:47:13.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:12 smithi026 conmon[32119]: audit 2021-11-03T16:47:11.717482+0000 mgr.smithi026.cnrxli ( 2021-11-03T16:47:13.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:12 smithi026 conmon[32119]: mgr.14162) 3 : audit [DBG] from='client.14172 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:47:13.670 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.673+0000 7f026ad14700 1 -- 172.21.15.26:0/2718870910 --> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f0264045ad0 con 0x7f024802ff00 2021-11-03T16:47:13.916 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.919+0000 7f02617fa700 1 -- 172.21.15.26:0/2718870910 <== mgr.14162 v2:172.21.15.26:6800/3029163595 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f0264045ad0 con 0x7f024802ff00 2021-11-03T16:47:13.916 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: {"username": "admin", "password": "$2b$12$VLrx6o0g3o1TH3XPl7O2.elhKOoGBtQn9K1PtsLY36SxstNEurbsa", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1635958033, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2021-11-03T16:47:13.918 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.921+0000 7f026ad14700 1 -- 172.21.15.26:0/2718870910 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f024802ff00 msgr2=0x7f02480323c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:47:13.919 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.921+0000 7f026ad14700 1 --2- 172.21.15.26:0/2718870910 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f024802ff00 0x7f02480323c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f02500096a0 tx=0x7f0250006b40).stop 2021-11-03T16:47:13.919 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.921+0000 7f026ad14700 1 -- 172.21.15.26:0/2718870910 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02640fd280 msgr2=0x7f02640fcb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:47:13.919 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.921+0000 7f026ad14700 1 --2- 172.21.15.26:0/2718870910 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02640fd280 0x7f02640fcb50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f0258011e30 tx=0x7f0258006ee0).stop 2021-11-03T16:47:13.919 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.921+0000 7f026ad14700 1 -- 172.21.15.26:0/2718870910 shutdown_connections 2021-11-03T16:47:13.920 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.921+0000 7f026ad14700 1 --2- 172.21.15.26:0/2718870910 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f024802ff00 0x7f02480323c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:47:13.920 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.921+0000 7f026ad14700 1 --2- 172.21.15.26:0/2718870910 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02640fd280 0x7f02640fcb50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:47:13.920 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.921+0000 7f026ad14700 1 -- 172.21.15.26:0/2718870910 >> 172.21.15.26:0/2718870910 conn(0x7f02640f5a60 msgr2=0x7f02640ff170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:47:13.920 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.921+0000 7f026ad14700 1 -- 172.21.15.26:0/2718870910 shutdown_connections 2021-11-03T16:47:13.921 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:13.921+0000 7f026ad14700 1 -- 172.21.15.26:0/2718870910 wait complete. 2021-11-03T16:47:14.528 INFO:teuthology.orchestra.run.smithi026.stderr:Fetching dashboard port number... 2021-11-03T16:47:14.529 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi026 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprh0b9ciq:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpg6zn56v0:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 config get mgr mgr/dashboard/ssl_server_port 2021-11-03T16:47:15.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:14 smithi026 conmon[32119]: audit 2021-11-03T16:47:13.675892+0000 mgr.smithi026.cnrxli (mgr.14162) 4 : audit [DBG] from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:47:15.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:14 smithi026 conmon[32119]: audit 2021-11-03T16:47:13.920803+0000 mon.smithi026 (mon.0) 111 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:47:15.222 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.221+0000 7ff620429700 1 Processor -- start 2021-11-03T16:47:15.222 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.221+0000 7ff620429700 1 -- start start 2021-11-03T16:47:15.223 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.221+0000 7ff620429700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff618071c20 0x7ff6180701c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-03T16:47:15.223 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.221+0000 7ff620429700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff618072040 con 0x7ff618071c20 2021-11-03T16:47:15.224 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.221+0000 7ff61e1c5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff618071c20 0x7ff6180701c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:47:15.225 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.221+0000 7ff61e1c5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff618071c20 0x7ff6180701c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49406/0 (socket says 172.21.15.26:49406) 2021-11-03T16:47:15.225 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.221+0000 7ff61e1c5700 1 -- 172.21.15.26:0/2105145140 learned_addr learned my addr 172.21.15.26:0/2105145140 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:47:15.225 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.221+0000 7ff61e1c5700 1 -- 172.21.15.26:0/2105145140 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6180706b0 con 0x7ff618071c20 2021-11-03T16:47:15.225 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.222+0000 7ff61e1c5700 1 --2- 172.21.15.26:0/2105145140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff618071c20 0x7ff6180701c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7ff60800b5f0 tx=0x7ff608006ee0).ready entity=mon.0 client_cookie=90081c9e48ffc09a server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:47:15.226 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.222+0000 7ff61d1c3700 1 -- 172.21.15.26:0/2105145140 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff60800d600 con 0x7ff618071c20 2021-11-03T16:47:15.226 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.222+0000 7ff61d1c3700 1 -- 172.21.15.26:0/2105145140 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7ff60800dbf0 con 0x7ff618071c20 2021-11-03T16:47:15.226 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.222+0000 7ff61d1c3700 1 -- 172.21.15.26:0/2105145140 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff608011bf0 con 0x7ff618071c20 2021-11-03T16:47:15.226 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.222+0000 7ff620429700 1 -- 172.21.15.26:0/2105145140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff618071c20 msgr2=0x7ff6180701c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:47:15.227 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.222+0000 7ff620429700 1 --2- 172.21.15.26:0/2105145140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff618071c20 0x7ff6180701c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7ff60800b5f0 tx=0x7ff608006ee0).stop 2021-11-03T16:47:15.227 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.222+0000 7ff620429700 1 -- 172.21.15.26:0/2105145140 shutdown_connections 2021-11-03T16:47:15.227 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.222+0000 7ff620429700 1 --2- 172.21.15.26:0/2105145140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff618071c20 0x7ff6180701c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:47:15.227 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.222+0000 7ff620429700 1 -- 172.21.15.26:0/2105145140 >> 172.21.15.26:0/2105145140 conn(0x7ff6180f73d0 msgr2=0x7ff6180f97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:47:15.227 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.222+0000 7ff620429700 1 -- 172.21.15.26:0/2105145140 shutdown_connections 2021-11-03T16:47:15.228 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.223+0000 7ff620429700 1 -- 172.21.15.26:0/2105145140 wait complete. 2021-11-03T16:47:15.228 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.223+0000 7ff620429700 1 Processor -- start 2021-11-03T16:47:15.228 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.223+0000 7ff620429700 1 -- start start 2021-11-03T16:47:15.228 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.223+0000 7ff620429700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff618071c20 0x7ff61810cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:47:15.229 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.223+0000 7ff620429700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61810d0d0 con 0x7ff618071c20 2021-11-03T16:47:15.229 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.223+0000 7ff61e1c5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff618071c20 0x7ff61810cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:47:15.229 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.223+0000 7ff61e1c5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff618071c20 0x7ff61810cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49408/0 (socket says 172.21.15.26:49408) 2021-11-03T16:47:15.229 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.223+0000 7ff61e1c5700 1 -- 172.21.15.26:0/2621981141 learned_addr learned my addr 172.21.15.26:0/2621981141 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:47:15.229 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.224+0000 7ff61e1c5700 1 -- 172.21.15.26:0/2621981141 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff60800b200 con 0x7ff618071c20 2021-11-03T16:47:15.230 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.224+0000 7ff61e1c5700 1 --2- 172.21.15.26:0/2621981141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff618071c20 0x7ff61810cbe0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7ff608006800 tx=0x7ff608006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:47:15.230 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.224+0000 7ff606ffd700 1 -- 172.21.15.26:0/2621981141 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff60800dec0 con 0x7ff618071c20 2021-11-03T16:47:15.230 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.224+0000 7ff620429700 1 -- 172.21.15.26:0/2621981141 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff61810d2d0 con 0x7ff618071c20 2021-11-03T16:47:15.230 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.224+0000 7ff606ffd700 1 -- 172.21.15.26:0/2621981141 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7ff60801b8a0 con 0x7ff618071c20 2021-11-03T16:47:15.231 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.224+0000 7ff606ffd700 1 -- 172.21.15.26:0/2621981141 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff60801a700 con 0x7ff618071c20 2021-11-03T16:47:15.231 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.224+0000 7ff620429700 1 -- 172.21.15.26:0/2621981141 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff61810d760 con 0x7ff618071c20 2021-11-03T16:47:15.231 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.225+0000 7ff606ffd700 1 -- 172.21.15.26:0/2621981141 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7ff60802b070 con 0x7ff618071c20 2021-11-03T16:47:15.231 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.225+0000 7ff620429700 1 -- 172.21.15.26:0/2621981141 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff618045ad0 con 0x7ff618071c20 2021-11-03T16:47:15.232 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.225+0000 7ff606ffd700 1 --2- 172.21.15.26:0/2621981141 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7ff60002ff60 0x7ff600032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:47:15.232 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.225+0000 7ff606ffd700 1 -- 172.21.15.26:0/2621981141 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1237+0+0 (secure 0 0 0) 0x7ff608041c00 con 0x7ff618071c20 2021-11-03T16:47:15.232 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.225+0000 7ff61d9c4700 1 --2- 172.21.15.26:0/2621981141 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7ff60002ff60 0x7ff600032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:47:15.232 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.226+0000 7ff61d9c4700 1 --2- 172.21.15.26:0/2621981141 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7ff60002ff60 0x7ff600032420 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7ff6140096a0 tx=0x7ff614006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:47:15.233 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.230+0000 7ff606ffd700 1 -- 172.21.15.26:0/2621981141 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7ff60802b6c0 con 0x7ff618071c20 2021-11-03T16:47:15.515 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.518+0000 7ff620429700 1 -- 172.21.15.26:0/2621981141 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7ff618101da0 con 0x7ff618071c20 2021-11-03T16:47:15.515 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.519+0000 7ff606ffd700 1 -- 172.21.15.26:0/2621981141 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v10) v1 ==== 112+0+5 (secure 0 0 0) 0x7ff60801f020 con 0x7ff618071c20 2021-11-03T16:47:15.516 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 8443 2021-11-03T16:47:15.518 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.520+0000 7ff620429700 1 -- 172.21.15.26:0/2621981141 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7ff60002ff60 msgr2=0x7ff600032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:47:15.518 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.520+0000 7ff620429700 1 --2- 172.21.15.26:0/2621981141 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7ff60002ff60 0x7ff600032420 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7ff6140096a0 tx=0x7ff614006b40).stop 2021-11-03T16:47:15.518 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.520+0000 7ff620429700 1 -- 172.21.15.26:0/2621981141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff618071c20 msgr2=0x7ff61810cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:47:15.518 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.520+0000 7ff620429700 1 --2- 172.21.15.26:0/2621981141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff618071c20 0x7ff61810cbe0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7ff608006800 tx=0x7ff608006ee0).stop 2021-11-03T16:47:15.519 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.521+0000 7ff620429700 1 -- 172.21.15.26:0/2621981141 shutdown_connections 2021-11-03T16:47:15.519 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.521+0000 7ff620429700 1 --2- 172.21.15.26:0/2621981141 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7ff60002ff60 0x7ff600032420 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:47:15.519 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.521+0000 7ff620429700 1 --2- 172.21.15.26:0/2621981141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff618071c20 0x7ff61810cbe0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:47:15.519 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.521+0000 7ff620429700 1 -- 172.21.15.26:0/2621981141 >> 172.21.15.26:0/2621981141 conn(0x7ff6180f73d0 msgr2=0x7ff6180f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:47:15.520 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.521+0000 7ff620429700 1 -- 172.21.15.26:0/2621981141 shutdown_connections 2021-11-03T16:47:15.520 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2021-11-03T16:47:15.521+0000 7ff620429700 1 -- 172.21.15.26:0/2621981141 wait complete. 2021-11-03T16:47:16.095 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: systemctl is-enabled firewalld.service 2021-11-03T16:47:16.104 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: disabled 2021-11-03T16:47:16.105 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: systemctl is-active firewalld.service 2021-11-03T16:47:16.112 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: inactive 2021-11-03T16:47:16.113 INFO:teuthology.orchestra.run.smithi026.stderr:firewalld.service is not enabled 2021-11-03T16:47:16.113 INFO:teuthology.orchestra.run.smithi026.stderr:Not possible to open ports <[8443]>. firewalld.service is not available 2021-11-03T16:47:16.116 INFO:teuthology.orchestra.run.smithi026.stderr:Ceph Dashboard is now available at: 2021-11-03T16:47:16.116 INFO:teuthology.orchestra.run.smithi026.stderr: 2021-11-03T16:47:16.116 INFO:teuthology.orchestra.run.smithi026.stderr: URL: https://smithi026.front.sepia.ceph.com:8443/ 2021-11-03T16:47:16.117 INFO:teuthology.orchestra.run.smithi026.stderr: User: admin 2021-11-03T16:47:16.117 INFO:teuthology.orchestra.run.smithi026.stderr: Password: 51iq73d2my 2021-11-03T16:47:16.117 INFO:teuthology.orchestra.run.smithi026.stderr: 2021-11-03T16:47:16.118 INFO:teuthology.orchestra.run.smithi026.stderr:You can access the Ceph CLI with: 2021-11-03T16:47:16.118 INFO:teuthology.orchestra.run.smithi026.stderr: 2021-11-03T16:47:16.118 INFO:teuthology.orchestra.run.smithi026.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2021-11-03T16:47:16.119 INFO:teuthology.orchestra.run.smithi026.stderr: 2021-11-03T16:47:16.119 INFO:teuthology.orchestra.run.smithi026.stderr:Please consider enabling telemetry to help improve Ceph: 2021-11-03T16:47:16.119 INFO:teuthology.orchestra.run.smithi026.stderr: 2021-11-03T16:47:16.119 INFO:teuthology.orchestra.run.smithi026.stderr: ceph telemetry on 2021-11-03T16:47:16.120 INFO:teuthology.orchestra.run.smithi026.stderr: 2021-11-03T16:47:16.120 INFO:teuthology.orchestra.run.smithi026.stderr:For more information see: 2021-11-03T16:47:16.120 INFO:teuthology.orchestra.run.smithi026.stderr: 2021-11-03T16:47:16.120 INFO:teuthology.orchestra.run.smithi026.stderr: https://docs.ceph.com/docs/pacific/mgr/telemetry/ 2021-11-03T16:47:16.121 INFO:teuthology.orchestra.run.smithi026.stderr: 2021-11-03T16:47:16.121 INFO:teuthology.orchestra.run.smithi026.stderr:Bootstrap complete. 2021-11-03T16:47:16.121 INFO:teuthology.orchestra.run.smithi026.stderr:Releasing lock 139749268851176 on /run/cephadm/70492bc6-3cc5-11ec-8c28-001a4aab830c.lock 2021-11-03T16:47:16.121 INFO:teuthology.orchestra.run.smithi026.stderr:Lock 139749268851176 released on /run/cephadm/70492bc6-3cc5-11ec-8c28-001a4aab830c.lock 2021-11-03T16:47:16.155 INFO:tasks.cephadm:Fetching config... 2021-11-03T16:47:16.156 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2021-11-03T16:47:16.156 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2021-11-03T16:47:16.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:15 smithi026 conmon[32119]: cluster 2021-11-03T16:47:14.922371+0000 mon.smithi026 (mon.0) 112 : cluster [DBG] mgrmap e17: smithi026.cnrxli(active, since 6s) 2021-11-03T16:47:16.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:15 smithi026 conmon[32119]: audit 2021-11-03T16:47:15.520369+0000 mon.smithi026 (mon.0) 113 : audit [DBG] from='client.? 172.21.15.26:0/2621981141' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2021-11-03T16:47:16.188 INFO:tasks.cephadm:Fetching client.admin keyring... 2021-11-03T16:47:16.188 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2021-11-03T16:47:16.188 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2021-11-03T16:47:16.243 INFO:tasks.cephadm:Fetching mon keyring... 2021-11-03T16:47:16.244 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2021-11-03T16:47:16.244 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c/mon.smithi026/keyring of=/dev/stdout 2021-11-03T16:47:16.310 INFO:tasks.cephadm:Fetching pub ssh key... 2021-11-03T16:47:16.311 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2021-11-03T16:47:16.311 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2021-11-03T16:47:16.366 INFO:tasks.cephadm:Installing pub ssh key for root users... 2021-11-03T16:47:16.367 DEBUG:teuthology.orchestra.run.smithi026:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGaPbf6j1lcS4EXqEnED4gacO8EVouvg0r/r/vY+4wjFP+dwfnHuc1VMIYJjTR0J4X6s7p/iGUtuH17UEdB4W0KIuhkn3HmRQZ5xR9dxkaPL33VyrPlnHEJ91Q+GVj0ljmPmhw6opTHT9HG01/0PyLzF0Blolr1dtppQe2yXTLJxTopb1GklKRlYWZXv8gyNVHdNaaosWzosx5Wl+xzKAfLE8yfMPSu/AuKz8rcTIUIPCrJ5vD8Z3YXKhv7hI1FvKhVtbJswDdHSNaPskGWHVC6UN+EIukmbyEw0jJr7v/uH4XSwIoRItWsVHXZI8JJNgXnZwex2CoAVx3ErC5TLbVbtUBjyncjOeu0PxIukdvGrXZVZbiAZTQHCuSWU7C0qFrPecBDFV4y0YBjCK6C2wabbJWb+FgW9kfnvRdSMNKRhKwDhaJ2w8fEoV3P/bf7IAWrIm1Xb8tULmBp1tW8SsWCCk8GFkP6rJ149KSJb6lEneyyp4gTgYwucS68jJowKU= ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2021-11-03T16:47:16.441 INFO:teuthology.orchestra.run.smithi026.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGaPbf6j1lcS4EXqEnED4gacO8EVouvg0r/r/vY+4wjFP+dwfnHuc1VMIYJjTR0J4X6s7p/iGUtuH17UEdB4W0KIuhkn3HmRQZ5xR9dxkaPL33VyrPlnHEJ91Q+GVj0ljmPmhw6opTHT9HG01/0PyLzF0Blolr1dtppQe2yXTLJxTopb1GklKRlYWZXv8gyNVHdNaaosWzosx5Wl+xzKAfLE8yfMPSu/AuKz8rcTIUIPCrJ5vD8Z3YXKhv7hI1FvKhVtbJswDdHSNaPskGWHVC6UN+EIukmbyEw0jJr7v/uH4XSwIoRItWsVHXZI8JJNgXnZwex2CoAVx3ErC5TLbVbtUBjyncjOeu0PxIukdvGrXZVZbiAZTQHCuSWU7C0qFrPecBDFV4y0YBjCK6C2wabbJWb+FgW9kfnvRdSMNKRhKwDhaJ2w8fEoV3P/bf7IAWrIm1Xb8tULmBp1tW8SsWCCk8GFkP6rJ149KSJb6lEneyyp4gTgYwucS68jJowKU= ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c 2021-11-03T16:47:16.452 DEBUG:teuthology.orchestra.run.smithi194:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGaPbf6j1lcS4EXqEnED4gacO8EVouvg0r/r/vY+4wjFP+dwfnHuc1VMIYJjTR0J4X6s7p/iGUtuH17UEdB4W0KIuhkn3HmRQZ5xR9dxkaPL33VyrPlnHEJ91Q+GVj0ljmPmhw6opTHT9HG01/0PyLzF0Blolr1dtppQe2yXTLJxTopb1GklKRlYWZXv8gyNVHdNaaosWzosx5Wl+xzKAfLE8yfMPSu/AuKz8rcTIUIPCrJ5vD8Z3YXKhv7hI1FvKhVtbJswDdHSNaPskGWHVC6UN+EIukmbyEw0jJr7v/uH4XSwIoRItWsVHXZI8JJNgXnZwex2CoAVx3ErC5TLbVbtUBjyncjOeu0PxIukdvGrXZVZbiAZTQHCuSWU7C0qFrPecBDFV4y0YBjCK6C2wabbJWb+FgW9kfnvRdSMNKRhKwDhaJ2w8fEoV3P/bf7IAWrIm1Xb8tULmBp1tW8SsWCCk8GFkP6rJ149KSJb6lEneyyp4gTgYwucS68jJowKU= ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2021-11-03T16:47:16.494 INFO:teuthology.orchestra.run.smithi194.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGaPbf6j1lcS4EXqEnED4gacO8EVouvg0r/r/vY+4wjFP+dwfnHuc1VMIYJjTR0J4X6s7p/iGUtuH17UEdB4W0KIuhkn3HmRQZ5xR9dxkaPL33VyrPlnHEJ91Q+GVj0ljmPmhw6opTHT9HG01/0PyLzF0Blolr1dtppQe2yXTLJxTopb1GklKRlYWZXv8gyNVHdNaaosWzosx5Wl+xzKAfLE8yfMPSu/AuKz8rcTIUIPCrJ5vD8Z3YXKhv7hI1FvKhVtbJswDdHSNaPskGWHVC6UN+EIukmbyEw0jJr7v/uH4XSwIoRItWsVHXZI8JJNgXnZwex2CoAVx3ErC5TLbVbtUBjyncjOeu0PxIukdvGrXZVZbiAZTQHCuSWU7C0qFrPecBDFV4y0YBjCK6C2wabbJWb+FgW9kfnvRdSMNKRhKwDhaJ2w8fEoV3P/bf7IAWrIm1Xb8tULmBp1tW8SsWCCk8GFkP6rJ149KSJb6lEneyyp4gTgYwucS68jJowKU= ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c 2021-11-03T16:47:16.507 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph config set mgr mgr/cephadm/allow_ptrace true 2021-11-03T16:47:18.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:18.987+0000 7f3b9b59e700 1 -- 172.21.15.26:0/1046739849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b9c0f51a0 msgr2=0x7f3b9c0f55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:47:18.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:18.987+0000 7f3b9b59e700 1 --2- 172.21.15.26:0/1046739849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b9c0f51a0 0x7f3b9c0f55c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f3b90009fb0 tx=0x7f3b90009b30).stop 2021-11-03T16:47:18.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:18.987+0000 7f3b9b59e700 1 -- 172.21.15.26:0/1046739849 shutdown_connections 2021-11-03T16:47:18.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:18.987+0000 7f3b9b59e700 1 --2- 172.21.15.26:0/1046739849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b9c0f51a0 0x7f3b9c0f55c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:47:18.986 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:18.987+0000 7f3b9b59e700 1 -- 172.21.15.26:0/1046739849 >> 172.21.15.26:0/1046739849 conn(0x7f3b9c0f09a0 msgr2=0x7f3b9c0f2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:47:18.986 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:18.987+0000 7f3b9b59e700 1 -- 172.21.15.26:0/1046739849 shutdown_connections 2021-11-03T16:47:18.986 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:18.987+0000 7f3b9b59e700 1 -- 172.21.15.26:0/1046739849 wait complete. 2021-11-03T16:47:18.986 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:18.988+0000 7f3b9b59e700 1 Processor -- start 2021-11-03T16:47:18.987 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:18.988+0000 7f3b9b59e700 1 -- start start 2021-11-03T16:47:18.987 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:18.988+0000 7f3b9b59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b9c0f51a0 0x7f3b9c1064c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:47:18.987 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:18.988+0000 7f3b9b59e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c1069b0 con 0x7f3b9c0f51a0 2021-11-03T16:47:18.987 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:18.988+0000 7f3b9a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b9c0f51a0 0x7f3b9c1064c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:47:18.988 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:18.988+0000 7f3b9a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b9c0f51a0 0x7f3b9c1064c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49414/0 (socket says 172.21.15.26:49414) 2021-11-03T16:47:18.988 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:18.988+0000 7f3b9a59c700 1 -- 172.21.15.26:0/2892262732 learned_addr learned my addr 172.21.15.26:0/2892262732 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:47:18.988 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:18.988+0000 7f3b9a59c700 1 -- 172.21.15.26:0/2892262732 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b90005040 con 0x7f3b9c0f51a0 2021-11-03T16:47:18.988 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:18.988+0000 7f3b9a59c700 1 --2- 172.21.15.26:0/2892262732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b9c0f51a0 0x7f3b9c1064c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f3b90009f80 tx=0x7f3b9000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:47:18.988 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:18.988+0000 7f3b8affd700 1 -- 172.21.15.26:0/2892262732 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3b90009320 con 0x7f3b9c0f51a0 2021-11-03T16:47:18.989 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:18.988+0000 7f3b8affd700 1 -- 172.21.15.26:0/2892262732 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f3b90013680 con 0x7f3b9c0f51a0 2021-11-03T16:47:18.989 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:18.988+0000 7f3b8affd700 1 -- 172.21.15.26:0/2892262732 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3b9001eda0 con 0x7f3b9c0f51a0 2021-11-03T16:47:18.989 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:18.988+0000 7f3b9b59e700 1 -- 172.21.15.26:0/2892262732 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b9c106bb0 con 0x7f3b9c0f51a0 2021-11-03T16:47:18.990 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:18.989+0000 7f3b9b59e700 1 -- 172.21.15.26:0/2892262732 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b9c107040 con 0x7f3b9c0f51a0 2021-11-03T16:47:18.991 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:18.989+0000 7f3b8affd700 1 -- 172.21.15.26:0/2892262732 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f3b9001e420 con 0x7f3b9c0f51a0 2021-11-03T16:47:18.991 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:18.989+0000 7f3b8affd700 1 --2- 172.21.15.26:0/2892262732 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f3b8402ff60 0x7f3b84032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:47:18.991 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:18.989+0000 7f3b9b59e700 1 -- 172.21.15.26:0/2892262732 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b9c045ad0 con 0x7f3b9c0f51a0 2021-11-03T16:47:18.991 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:18.990+0000 7f3b8affd700 1 -- 172.21.15.26:0/2892262732 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f3b90041070 con 0x7f3b9c0f51a0 2021-11-03T16:47:18.992 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:18.990+0000 7f3b99d9b700 1 --2- 172.21.15.26:0/2892262732 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f3b8402ff60 0x7f3b84032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:47:18.992 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:18.990+0000 7f3b99d9b700 1 --2- 172.21.15.26:0/2892262732 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f3b8402ff60 0x7f3b84032420 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f3b8c0096a0 tx=0x7f3b8c006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:47:18.992 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:18.994+0000 7f3b8affd700 1 -- 172.21.15.26:0/2892262732 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f3b9001e780 con 0x7f3b9c0f51a0 2021-11-03T16:47:19.199 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:19.203+0000 7f3b9b59e700 1 -- 172.21.15.26:0/2892262732 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f3b9c0fac10 con 0x7f3b9c0f51a0 2021-11-03T16:47:19.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:19.205+0000 7f3b8affd700 1 -- 172.21.15.26:0/2892262732 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v11)=0 v11) v1 ==== 125+0+0 (secure 0 0 0) 0x7f3b90035030 con 0x7f3b9c0f51a0 2021-11-03T16:47:19.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:19.207+0000 7f3b9b59e700 1 -- 172.21.15.26:0/2892262732 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f3b8402ff60 msgr2=0x7f3b84032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:47:19.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:19.207+0000 7f3b9b59e700 1 --2- 172.21.15.26:0/2892262732 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f3b8402ff60 0x7f3b84032420 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f3b8c0096a0 tx=0x7f3b8c006b40).stop 2021-11-03T16:47:19.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:19.207+0000 7f3b9b59e700 1 -- 172.21.15.26:0/2892262732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b9c0f51a0 msgr2=0x7f3b9c1064c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:47:19.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:19.207+0000 7f3b9b59e700 1 --2- 172.21.15.26:0/2892262732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b9c0f51a0 0x7f3b9c1064c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f3b90009f80 tx=0x7f3b9000b040).stop 2021-11-03T16:47:19.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:19.207+0000 7f3b9b59e700 1 -- 172.21.15.26:0/2892262732 shutdown_connections 2021-11-03T16:47:19.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:19.207+0000 7f3b9b59e700 1 --2- 172.21.15.26:0/2892262732 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f3b8402ff60 0x7f3b84032420 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:47:19.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:19.207+0000 7f3b9b59e700 1 --2- 172.21.15.26:0/2892262732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b9c0f51a0 0x7f3b9c1064c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:47:19.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:19.207+0000 7f3b9b59e700 1 -- 172.21.15.26:0/2892262732 >> 172.21.15.26:0/2892262732 conn(0x7f3b9c0f09a0 msgr2=0x7f3b9c05fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:47:19.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:19.207+0000 7f3b9b59e700 1 -- 172.21.15.26:0/2892262732 shutdown_connections 2021-11-03T16:47:19.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:19.207+0000 7f3b9b59e700 1 -- 172.21.15.26:0/2892262732 wait complete. 2021-11-03T16:47:19.884 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi194 2021-11-03T16:47:19.884 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2021-11-03T16:47:19.885 DEBUG:teuthology.orchestra.run.smithi194:> dd of=/etc/ceph/ceph.conf 2021-11-03T16:47:19.903 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2021-11-03T16:47:19.903 DEBUG:teuthology.orchestra.run.smithi194:> dd of=/etc/ceph/ceph.client.admin.keyring 2021-11-03T16:47:19.960 INFO:tasks.cephadm:Adding host smithi194 to orchestrator... 2021-11-03T16:47:19.960 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph orch host add smithi194 2021-11-03T16:47:20.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:19 smithi026 conmon[32119]: audit 2021-11-03T16:47:18.840023+0000 mon.smithi026 (mon.0) 114 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:47:20.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:19 smithi026 conmon[32119]: audit 2021-11-03T16:47:19.203768+0000 mon.smithi026 (mon.0) 115 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:47:20.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:19 smithi026 conmon[32119]: audit 2021-11-03T16:47:19.207164+0000 mon.smithi026 (mon.0) 116 : audit [INF] from='client.? 172.21.15.26:0/2892262732' entity='client.admin' 2021-11-03T16:47:20.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:19 smithi026 conmon[32119]: cephadm 2021-11-03T16:47:19.216497+0000 mgr.smithi026.cnrxli (mgr.14162) 5 : cephadm [INF] Deploying daemon alertmanager.smithi026 on smithi026 2021-11-03T16:47:30.267 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:29 smithi026 conmon[32119]: cluster 2021-11-03T16:47:28.981808+0000 mgr.smithi026.cnrxli (mgr.14162) 6 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:47:30.267 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:29 smithi026 conmon[32119]: audit 2021-11-03T16:47:29.706497+0000 mon.smithi026 (mon.0) 117 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:47:30.268 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:29 smithi026 conmon[32119]: audit 2021-11-03T16:47:29.707651+0000 mon.smithi026 (mon.0) 118 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi026", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2021-11-03T16:47:30.268 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:29 smithi026 conmon[32119]: audit 2021-11-03T16:47:29.709333+0000 mon.smithi026 (mon.0) 119 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi026", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2021-11-03T16:47:30.268 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:29 smithi026 conmon[32119]: audit 2021-11-03T16:47:29.710043+0000 mon.smithi026 (mon.0) 120 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:47:31.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:30 smithi026 conmon[32119]: cephadm 2021-11-03T16:47:29.710644+0000 mgr.smithi026.cnrxli (mgr.14162) 7 : cephadm [INF] Deploying daemon crash.smithi026 on smithi026 2021-11-03T16:47:32.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:31 smithi026 conmon[32119]: cluster 2021-11-03T16:47:30.982101+0000 mgr.smithi026.cnrxli (mgr.14162) 8 : cluster 2021-11-03T16:47:32.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:31 smithi026 conmon[32119]: [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:47:33.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:33 smithi026 conmon[32119]: audit 2021-11-03T16:47:32.521862+0000 mon.smithi026 (mon.0) 2021-11-03T16:47:33.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:33 smithi026 conmon[32119]: 121 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:47:33.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:33 smithi026 conmon[32119]: audit 2021-11-03T16:47:32.684240+0000 mon.smithi026 (mon.0) 122 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:47:33.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:33 smithi026 conmon[32119]: audit 2021-11-03T16:47:32.686135+0000 mon.smithi026 (mon.0) 123 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:47:33.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:33 smithi026 conmon[32119]: audit 2021-11-03T16:47:32.686570+0000 mon.smithi026 (mon.0) 124 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-11-03T16:47:33.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:33 smithi026 conmon[32119]: audit 2021-11-03T16:47:32.687049+0000 mgr.smithi026.cnrxli (mgr.14162) 9 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-11-03T16:47:33.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:33 smithi026 conmon[32119]: audit 2021-11-03T16:47:32.689419+0000 2021-11-03T16:47:33.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:33 smithi026 conmon[32119]: mon.smithi026 (mon.0) 125 : 2021-11-03T16:47:33.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:33 smithi026 conmon[32119]: audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:47:33.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:33 smithi026 conmon[32119]: cephadm 2021- 2021-11-03T16:47:33.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:33 smithi026 conmon[32119]: 11-03T16:47:32.693031+0000 2021-11-03T16:47:33.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:33 smithi026 conmon[32119]: mgr.smithi026.cnrxli (mgr.14162) 10 : 2021-11-03T16:47:33.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:33 smithi026 conmon[32119]: cephadm [INF] Deploying daemon grafana.smithi026 on smithi026 2021-11-03T16:47:33.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:33 smithi026 conmon[32119]: cluster 2021- 2021-11-03T16:47:33.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:33 smithi026 conmon[32119]: 11-03T16:47:32.982358 2021-11-03T16:47:33.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:33 smithi026 conmon[32119]: +0000 mgr.smithi026.cnrxli (mgr.14162) 11 2021-11-03T16:47:33.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:33 smithi026 conmon[32119]: : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:47:36.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:36 smithi026 conmon[32119]: cluster 2021-11-03T16:47:34.982599+0000 mgr.smithi026.cnrxli (mgr.14162) 12 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:47:38.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:38 smithi026 conmon[32119]: cluster 2021-11-03T16:47: 2021-11-03T16:47:38.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:38 smithi026 conmon[32119]: 36.982849+0000 mgr.smithi026.cnrxli (mgr.14162) 13 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:47:40.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:40 smithi026 conmon[32119]: cluster 2021-11-03T16:47:38. 2021-11-03T16:47:40.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:40 smithi026 conmon[32119]: 983079+0000 mgr.smithi026.cnrxli (mgr.14162) 14 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:47:42.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:42 smithi026 conmon[32119]: cluster 2021-11-03T16:47:40.983325+0000 mgr.smithi026.cnrxli (mgr.14162) 15 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:47:44.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:43 smithi026 conmon[32119]: cluster 2021-11-03T16:47:42.983588+0000 mgr.smithi026.cnrxli (mgr.14162) 16 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:47:46.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:46 smithi026 conmon[32119]: cluster 2021-11-03T16:47:44.983962+0000 mgr.smithi026.cnrxli (mgr.14162) 17 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:47:48.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:48 smithi026 conmon[32119]: cluster 2021-11-03T16:47:46.984201+0000 mgr.smithi026.cnrxli ( 2021-11-03T16:47:48.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:48 smithi026 conmon[32119]: mgr.14162) 18 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:47:48.828 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:48.831+0000 7f377f3b1700 1 -- 172.21.15.194:0/263361718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37780f4b80 msgr2=0x7f37780f4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:47:48.828 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:48.831+0000 7f377f3b1700 1 --2- 172.21.15.194:0/263361718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37780f4b80 0x7f37780f4fa0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f377400aa70 tx=0x7f3774004d10).stop 2021-11-03T16:47:48.829 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:48.831+0000 7f377f3b1700 1 -- 172.21.15.194:0/263361718 shutdown_connections 2021-11-03T16:47:48.829 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:48.831+0000 7f377f3b1700 1 --2- 172.21.15.194:0/263361718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37780f4b80 0x7f37780f4fa0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:47:48.829 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:48.831+0000 7f377f3b1700 1 -- 172.21.15.194:0/263361718 >> 172.21.15.194:0/263361718 conn(0x7f37780f02e0 msgr2=0x7f37780f2700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:47:48.829 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:48.831+0000 7f377f3b1700 1 -- 172.21.15.194:0/263361718 shutdown_connections 2021-11-03T16:47:48.830 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:48.831+0000 7f377f3b1700 1 -- 172.21.15.194:0/263361718 wait complete. 2021-11-03T16:47:48.830 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:48.832+0000 7f377f3b1700 1 Processor -- start 2021-11-03T16:47:48.830 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:48.832+0000 7f377f3b1700 1 -- start start 2021-11-03T16:47:48.830 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:48.832+0000 7f377f3b1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37780f4b80 0x7f3778105d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:47:48.831 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:48.832+0000 7f377f3b1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3778104210 con 0x7f37780f4b80 2021-11-03T16:47:48.831 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:48.832+0000 7f377d14d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37780f4b80 0x7f3778105d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:47:48.831 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:48.832+0000 7f377d14d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37780f4b80 0x7f3778105d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.194:53178/0 (socket says 172.21.15.194:53178) 2021-11-03T16:47:48.831 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:48.832+0000 7f377d14d700 1 -- 172.21.15.194:0/4209837380 learned_addr learned my addr 172.21.15.194:0/4209837380 (peer_addr_for_me v2:172.21.15.194:0/0) 2021-11-03T16:47:48.833 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:48.833+0000 7f377d14d700 1 -- 172.21.15.194:0/4209837380 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377400a750 con 0x7f37780f4b80 2021-11-03T16:47:48.833 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:48.834+0000 7f377d14d700 1 --2- 172.21.15.194:0/4209837380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37780f4b80 0x7f3778105d90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f3774004a10 tx=0x7f3774004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:47:48.834 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:48.834+0000 7f376dffb700 1 -- 172.21.15.194:0/4209837380 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f377400f040 con 0x7f37780f4b80 2021-11-03T16:47:48.834 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:48.834+0000 7f376dffb700 1 -- 172.21.15.194:0/4209837380 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f3774009f00 con 0x7f37780f4b80 2021-11-03T16:47:48.834 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:48.834+0000 7f377f3b1700 1 -- 172.21.15.194:0/4209837380 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37781043b0 con 0x7f37780f4b80 2021-11-03T16:47:48.834 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:48.834+0000 7f376dffb700 1 -- 172.21.15.194:0/4209837380 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3774007c90 con 0x7f37780f4b80 2021-11-03T16:47:48.835 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:48.835+0000 7f377f3b1700 1 -- 172.21.15.194:0/4209837380 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3778104840 con 0x7f37780f4b80 2021-11-03T16:47:48.835 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:48.835+0000 7f377f3b1700 1 -- 172.21.15.194:0/4209837380 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3778059100 con 0x7f37780f4b80 2021-11-03T16:47:48.835 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:48.836+0000 7f376dffb700 1 -- 172.21.15.194:0/4209837380 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f3774025060 con 0x7f37780f4b80 2021-11-03T16:47:48.835 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:48.836+0000 7f376dffb700 1 --2- 172.21.15.194:0/4209837380 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f376402ff60 0x7f3764032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:47:48.836 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:48.836+0000 7f376dffb700 1 -- 172.21.15.194:0/4209837380 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f3774040f10 con 0x7f37780f4b80 2021-11-03T16:47:48.836 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:48.836+0000 7f377c94c700 1 --2- 172.21.15.194:0/4209837380 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f376402ff60 0x7f3764032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:47:48.836 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:48.837+0000 7f377c94c700 1 --2- 172.21.15.194:0/4209837380 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f376402ff60 0x7f3764032420 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f37680096a0 tx=0x7f3768006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:47:48.837 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:48.841+0000 7f376dffb700 1 -- 172.21.15.194:0/4209837380 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f377401cb50 con 0x7f37780f4b80 2021-11-03T16:47:49.005 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:49.009+0000 7f377f3b1700 1 -- 172.21.15.194:0/4209837380 --> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi194", "target": ["mon-mgr", ""]}) v1 -- 0x7f37780f9ef0 con 0x7f376402ff60 2021-11-03T16:47:49.670 INFO:teuthology.orchestra.run.smithi194.stdout:Added host 'smithi194' 2021-11-03T16:47:49.670 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:49.673+0000 7f376dffb700 1 -- 172.21.15.194:0/4209837380 <== mgr.14162 v2:172.21.15.26:6800/3029163595 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+23 (secure 0 0 0) 0x7f37780f9ef0 con 0x7f376402ff60 2021-11-03T16:47:49.671 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:49.675+0000 7f377f3b1700 1 -- 172.21.15.194:0/4209837380 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f376402ff60 msgr2=0x7f3764032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:47:49.672 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:49.675+0000 7f377f3b1700 1 --2- 172.21.15.194:0/4209837380 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f376402ff60 0x7f3764032420 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f37680096a0 tx=0x7f3768006b40).stop 2021-11-03T16:47:49.672 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:49.676+0000 7f377f3b1700 1 -- 172.21.15.194:0/4209837380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37780f4b80 msgr2=0x7f3778105d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:47:49.672 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:49.676+0000 7f377f3b1700 1 --2- 172.21.15.194:0/4209837380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37780f4b80 0x7f3778105d90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f3774004a10 tx=0x7f3774004d10).stop 2021-11-03T16:47:49.672 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:49.676+0000 7f377f3b1700 1 -- 172.21.15.194:0/4209837380 shutdown_connections 2021-11-03T16:47:49.672 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:49.676+0000 7f377f3b1700 1 --2- 172.21.15.194:0/4209837380 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f376402ff60 0x7f3764032420 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:47:49.673 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:49.676+0000 7f377f3b1700 1 --2- 172.21.15.194:0/4209837380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37780f4b80 0x7f3778105d90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:47:49.673 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:49.676+0000 7f377f3b1700 1 -- 172.21.15.194:0/4209837380 >> 172.21.15.194:0/4209837380 conn(0x7f37780f02e0 msgr2=0x7f37780f0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:47:49.673 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:49.676+0000 7f377f3b1700 1 -- 172.21.15.194:0/4209837380 shutdown_connections 2021-11-03T16:47:49.674 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:49.676+0000 7f377f3b1700 1 -- 172.21.15.194:0/4209837380 wait complete. 2021-11-03T16:47:50.266 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:50 smithi026 conmon[32119]: cluster 2021-11-03T16:47:48.984450+0000 mgr.smithi026.cnrxli (mgr.14162) 19 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:47:50.267 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:50 smithi026 conmon[32119]: audit 2021-11-03T16:47:49.010988+0000 mgr.smithi026.cnrxli (mgr.14162) 20 : audit [DBG] from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi194", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:47:50.267 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:50 smithi026 conmon[32119]: audit 2021-11-03T16:47:49.673534+0000 mon.smithi026 (mon. 2021-11-03T16:47:50.267 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:50 smithi026 conmon[32119]: 0) 126 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:47:50.268 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:50 smithi026 conmon[32119]: audit 2021-11-03T16:47:50.268 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:50 smithi026 conmon[32119]: 2021-11-03T16:47:49.795321+0000 mon.smithi026 ( 2021-11-03T16:47:50.269 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:50 smithi026 conmon[32119]: mon.0) 127 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:47:50.491 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph orch host ls --format=json 2021-11-03T16:47:51.045 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:51 smithi026 conmon[32119]: cephadm 2021-11-03T16:47:49.673897+0000 mgr.smithi026.cnrxli ( 2021-11-03T16:47:51.046 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:51 smithi026 conmon[32119]: mgr.14162) 21 : cephadm [INF] Added host smithi194 2021-11-03T16:47:51.046 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:51 smithi026 conmon[32119]: cephadm 2021-11-03T16:47:49.797022+0000 mgr.smithi026.cnrxli (mgr 2021-11-03T16:47:51.046 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:51 smithi026 conmon[32119]: .14162) 22 : cephadm [INF] Deploying daemon node-exporter.smithi026 on smithi026 2021-11-03T16:47:52.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:52 smithi026 conmon[32119]: cluster 2021-11-03T16:47:50.984849+0000 mgr.smithi026.cnrxli 2021-11-03T16:47:52.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:52 smithi026 conmon[32119]: (mgr.14162) 23 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:47:52.249 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:52.251+0000 7f37bbfff700 1 -- 172.21.15.194:0/2142966333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37bc0f51a0 msgr2=0x7f37bc0f55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:47:52.250 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:52.251+0000 7f37bbfff700 1 --2- 172.21.15.194:0/2142966333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37bc0f51a0 0x7f37bc0f55c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f37ac009fb0 tx=0x7f37ac009b30).stop 2021-11-03T16:47:52.250 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:52.251+0000 7f37bbfff700 1 -- 172.21.15.194:0/2142966333 shutdown_connections 2021-11-03T16:47:52.250 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:52.251+0000 7f37bbfff700 1 --2- 172.21.15.194:0/2142966333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37bc0f51a0 0x7f37bc0f55c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:47:52.251 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:52.251+0000 7f37bbfff700 1 -- 172.21.15.194:0/2142966333 >> 172.21.15.194:0/2142966333 conn(0x7f37bc0f09a0 msgr2=0x7f37bc0f2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:47:52.251 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:52.251+0000 7f37bbfff700 1 -- 172.21.15.194:0/2142966333 shutdown_connections 2021-11-03T16:47:52.251 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:52.251+0000 7f37bbfff700 1 -- 172.21.15.194:0/2142966333 wait complete. 2021-11-03T16:47:52.251 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:52.252+0000 7f37bbfff700 1 Processor -- start 2021-11-03T16:47:52.251 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:52.252+0000 7f37bbfff700 1 -- start start 2021-11-03T16:47:52.252 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:52.252+0000 7f37bbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37bc0f51a0 0x7f37bc109170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:47:52.252 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:52.252+0000 7f37bbfff700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc060280 con 0x7f37bc0f51a0 2021-11-03T16:47:52.252 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:52.252+0000 7f37baffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37bc0f51a0 0x7f37bc109170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:47:52.252 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:52.252+0000 7f37baffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37bc0f51a0 0x7f37bc109170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.194:53184/0 (socket says 172.21.15.194:53184) 2021-11-03T16:47:52.253 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:52.252+0000 7f37baffd700 1 -- 172.21.15.194:0/2074344507 learned_addr learned my addr 172.21.15.194:0/2074344507 (peer_addr_for_me v2:172.21.15.194:0/0) 2021-11-03T16:47:52.253 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:52.253+0000 7f37baffd700 1 -- 172.21.15.194:0/2074344507 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37ac005040 con 0x7f37bc0f51a0 2021-11-03T16:47:52.253 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:52.253+0000 7f37baffd700 1 --2- 172.21.15.194:0/2074344507 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37bc0f51a0 0x7f37bc109170 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f37ac009f80 tx=0x7f37ac00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:47:52.253 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:52.253+0000 7f37a37fe700 1 -- 172.21.15.194:0/2074344507 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f37ac009320 con 0x7f37bc0f51a0 2021-11-03T16:47:52.254 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:52.253+0000 7f37bbfff700 1 -- 172.21.15.194:0/2074344507 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37bc060480 con 0x7f37bc0f51a0 2021-11-03T16:47:52.254 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:52.253+0000 7f37a37fe700 1 -- 172.21.15.194:0/2074344507 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f37ac013680 con 0x7f37bc0f51a0 2021-11-03T16:47:52.254 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:52.253+0000 7f37a37fe700 1 -- 172.21.15.194:0/2074344507 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f37ac01eda0 con 0x7f37bc0f51a0 2021-11-03T16:47:52.254 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:52.253+0000 7f37bbfff700 1 -- 172.21.15.194:0/2074344507 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37bc1098a0 con 0x7f37bc0f51a0 2021-11-03T16:47:52.254 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:52.254+0000 7f37a37fe700 1 -- 172.21.15.194:0/2074344507 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f37ac01e420 con 0x7f37bc0f51a0 2021-11-03T16:47:52.255 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:52.254+0000 7f37bbfff700 1 -- 172.21.15.194:0/2074344507 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37bc045ad0 con 0x7f37bc0f51a0 2021-11-03T16:47:52.255 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:52.254+0000 7f37a37fe700 1 --2- 172.21.15.194:0/2074344507 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f37a402ff60 0x7f37a4032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:47:52.255 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:52.254+0000 7f37a37fe700 1 -- 172.21.15.194:0/2074344507 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f37ac040fe0 con 0x7f37bc0f51a0 2021-11-03T16:47:52.255 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:52.254+0000 7f37ba7fc700 1 --2- 172.21.15.194:0/2074344507 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f37a402ff60 0x7f37a4032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:47:52.256 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:52.254+0000 7f37ba7fc700 1 --2- 172.21.15.194:0/2074344507 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f37a402ff60 0x7f37a4032420 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f37b00096a0 tx=0x7f37b0006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:47:52.256 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:52.258+0000 7f37a37fe700 1 -- 172.21.15.194:0/2074344507 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f37ac01e780 con 0x7f37bc0f51a0 2021-11-03T16:47:52.424 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:52.429+0000 7f37bbfff700 1 -- 172.21.15.194:0/2074344507 --> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f37bc0f1b30 con 0x7f37a402ff60 2021-11-03T16:47:52.426 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:52.431+0000 7f37a37fe700 1 -- 172.21.15.194:0/2074344507 <== mgr.14162 v2:172.21.15.26:6800/3029163595 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+156 (secure 0 0 0) 0x7f37bc0f1b30 con 0x7f37a402ff60 2021-11-03T16:47:52.426 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:47:52.427 INFO:teuthology.orchestra.run.smithi194.stdout:[{"addr": "172.21.15.26", "hostname": "smithi026", "labels": [], "status": ""}, {"addr": "smithi194", "hostname": "smithi194", "labels": [], "status": ""}] 2021-11-03T16:47:52.428 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:52.432+0000 7f37bbfff700 1 -- 172.21.15.194:0/2074344507 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f37a402ff60 msgr2=0x7f37a4032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:47:52.428 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:52.432+0000 7f37bbfff700 1 --2- 172.21.15.194:0/2074344507 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f37a402ff60 0x7f37a4032420 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f37b00096a0 tx=0x7f37b0006b40).stop 2021-11-03T16:47:52.428 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:52.432+0000 7f37bbfff700 1 -- 172.21.15.194:0/2074344507 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37bc0f51a0 msgr2=0x7f37bc109170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:47:52.428 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:52.432+0000 7f37bbfff700 1 --2- 172.21.15.194:0/2074344507 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37bc0f51a0 0x7f37bc109170 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f37ac009f80 tx=0x7f37ac00b040).stop 2021-11-03T16:47:52.429 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:52.432+0000 7f37bbfff700 1 -- 172.21.15.194:0/2074344507 shutdown_connections 2021-11-03T16:47:52.429 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:52.432+0000 7f37bbfff700 1 --2- 172.21.15.194:0/2074344507 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f37a402ff60 0x7f37a4032420 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:47:52.429 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:52.432+0000 7f37bbfff700 1 --2- 172.21.15.194:0/2074344507 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37bc0f51a0 0x7f37bc109170 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:47:52.429 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:52.432+0000 7f37bbfff700 1 -- 172.21.15.194:0/2074344507 >> 172.21.15.194:0/2074344507 conn(0x7f37bc0f09a0 msgr2=0x7f37bc0f1420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:47:52.430 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:52.432+0000 7f37bbfff700 1 -- 172.21.15.194:0/2074344507 shutdown_connections 2021-11-03T16:47:52.430 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:47:52.432+0000 7f37bbfff700 1 -- 172.21.15.194:0/2074344507 wait complete. 2021-11-03T16:47:53.154 INFO:tasks.cephadm:Setting crush tunables to default 2021-11-03T16:47:53.155 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph osd crush tunables default 2021-11-03T16:47:54.105 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:53 smithi026 conmon[32119]: audit 2021-11-03T16:47:52 2021-11-03T16:47:54.106 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:53 smithi026 conmon[32119]: .430854+0000 mgr.smithi026.cnrxli (mgr.14162) 24 : audit [DBG] from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-11-03T16:47:54.106 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:53 smithi026 conmon[32119]: cluster 2021-11-03T16 2021-11-03T16:47:54.106 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:53 smithi026 conmon[32119]: :47:52.985218+0000 mgr.smithi026.cnrxli (mgr.14162) 25 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:47:54.106 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:53 smithi026 conmon[32119]: 2021-11-03T16:47:55.362 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:55 smithi026 conmon[32119]: audit 2021-11-03T16:47:54.062389+0000 mon.smithi026 (mon.0) 128 : 2021-11-03T16:47:55.363 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:55 smithi026 conmon[32119]: audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:47:55.363 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:55 smithi026 conmon[32119]: cephadm 2021-11-03T16:47:54.069559+0000 mgr.smithi026.cnrxli (mgr.14162) 26 : cephadm [INF] Deploying daemon prometheus.smithi026 on smithi026 2021-11-03T16:47:56.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:56.074+0000 7fb0d2f81700 1 -- 172.21.15.26:0/2158962197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0cc0f4860 msgr2=0x7fb0cc0f4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:47:56.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:56.074+0000 7fb0d2f81700 1 --2- 172.21.15.26:0/2158962197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0cc0f4860 0x7fb0cc0f4c80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fb0c0009fb0 tx=0x7fb0c0009b30).stop 2021-11-03T16:47:56.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:56.074+0000 7fb0d2f81700 1 -- 172.21.15.26:0/2158962197 shutdown_connections 2021-11-03T16:47:56.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:56.074+0000 7fb0d2f81700 1 --2- 172.21.15.26:0/2158962197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0cc0f4860 0x7fb0cc0f4c80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:47:56.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:56.074+0000 7fb0d2f81700 1 -- 172.21.15.26:0/2158962197 >> 172.21.15.26:0/2158962197 conn(0x7fb0cc0f02e0 msgr2=0x7fb0cc0f2700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:47:56.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:56.074+0000 7fb0d2f81700 1 -- 172.21.15.26:0/2158962197 shutdown_connections 2021-11-03T16:47:56.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:56.075+0000 7fb0d2f81700 1 -- 172.21.15.26:0/2158962197 wait complete. 2021-11-03T16:47:56.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:56.075+0000 7fb0d2f81700 1 Processor -- start 2021-11-03T16:47:56.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:56.075+0000 7fb0d2f81700 1 -- start start 2021-11-03T16:47:56.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:56.075+0000 7fb0d2f81700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0cc0f4860 0x7fb0cc1068c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:47:56.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:56.075+0000 7fb0d2f81700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0cc106db0 con 0x7fb0cc0f4860 2021-11-03T16:47:56.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:56.075+0000 7fb0d0d1d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0cc0f4860 0x7fb0cc1068c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:47:56.075 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:56.075+0000 7fb0d0d1d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0cc0f4860 0x7fb0cc1068c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49486/0 (socket says 172.21.15.26:49486) 2021-11-03T16:47:56.075 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:56.075+0000 7fb0d0d1d700 1 -- 172.21.15.26:0/2061307618 learned_addr learned my addr 172.21.15.26:0/2061307618 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:47:56.075 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:56.076+0000 7fb0d0d1d700 1 -- 172.21.15.26:0/2061307618 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c0005040 con 0x7fb0cc0f4860 2021-11-03T16:47:56.075 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:56.076+0000 7fb0d0d1d700 1 --2- 172.21.15.26:0/2061307618 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0cc0f4860 0x7fb0cc1068c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fb0c0009f80 tx=0x7fb0c000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:47:56.076 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:56.076+0000 7fb0c97fa700 1 -- 172.21.15.26:0/2061307618 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb0c0009320 con 0x7fb0cc0f4860 2021-11-03T16:47:56.076 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:56.076+0000 7fb0c97fa700 1 -- 172.21.15.26:0/2061307618 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fb0c0013680 con 0x7fb0cc0f4860 2021-11-03T16:47:56.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:56.076+0000 7fb0d2f81700 1 -- 172.21.15.26:0/2061307618 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0cc106fb0 con 0x7fb0cc0f4860 2021-11-03T16:47:56.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:56.076+0000 7fb0c97fa700 1 -- 172.21.15.26:0/2061307618 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb0c001eda0 con 0x7fb0cc0f4860 2021-11-03T16:47:56.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:56.076+0000 7fb0d2f81700 1 -- 172.21.15.26:0/2061307618 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0cc107440 con 0x7fb0cc0f4860 2021-11-03T16:47:56.078 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:56.077+0000 7fb0c97fa700 1 -- 172.21.15.26:0/2061307618 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7fb0c0014420 con 0x7fb0cc0f4860 2021-11-03T16:47:56.078 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:56.077+0000 7fb0c97fa700 1 --2- 172.21.15.26:0/2061307618 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fb0bc02ff60 0x7fb0bc032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:47:56.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:56.077+0000 7fb0c97fa700 1 -- 172.21.15.26:0/2061307618 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1237+0+0 (secure 0 0 0) 0x7fb0c0041270 con 0x7fb0cc0f4860 2021-11-03T16:47:56.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:56.077+0000 7fb0d2f81700 1 -- 172.21.15.26:0/2061307618 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0cc045ad0 con 0x7fb0cc0f4860 2021-11-03T16:47:56.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:56.077+0000 7fb0cbfff700 1 --2- 172.21.15.26:0/2061307618 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fb0bc02ff60 0x7fb0bc032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:47:56.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:56.077+0000 7fb0cbfff700 1 --2- 172.21.15.26:0/2061307618 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fb0bc02ff60 0x7fb0bc032420 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fb0b80096a0 tx=0x7fb0b8006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:47:56.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:56.081+0000 7fb0c97fa700 1 -- 172.21.15.26:0/2061307618 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fb0c001c8f0 con 0x7fb0cc0f4860 2021-11-03T16:47:56.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:56.247+0000 7fb0d2f81700 1 -- 172.21.15.26:0/2061307618 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fb0cc05f370 con 0x7fb0cc0f4860 2021-11-03T16:47:56.248 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:56 smithi026 conmon[32119]: cluster 2021-11-03T16:47:54.985609+0000 mgr.smithi026.cnrxli 2021-11-03T16:47:56.248 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:56 smithi026 conmon[32119]: (mgr.14162) 27 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:47:57.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:57.068+0000 7fb0c97fa700 1 -- 172.21.15.26:0/2061307618 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v5) v1 ==== 124+0+0 (secure 0 0 0) 0x7fb0c001c320 con 0x7fb0cc0f4860 2021-11-03T16:47:57.065 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:57.070+0000 7fb0d2f81700 1 -- 172.21.15.26:0/2061307618 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fb0bc02ff60 msgr2=0x7fb0bc032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:47:57.066 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:57.070+0000 7fb0d2f81700 1 --2- 172.21.15.26:0/2061307618 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fb0bc02ff60 0x7fb0bc032420 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fb0b80096a0 tx=0x7fb0b8006b40).stop 2021-11-03T16:47:57.066 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:57.070+0000 7fb0d2f81700 1 -- 172.21.15.26:0/2061307618 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0cc0f4860 msgr2=0x7fb0cc1068c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:47:57.066 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:57.070+0000 7fb0d2f81700 1 --2- 172.21.15.26:0/2061307618 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0cc0f4860 0x7fb0cc1068c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fb0c0009f80 tx=0x7fb0c000b040).stop 2021-11-03T16:47:57.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:57.070+0000 7fb0d2f81700 1 -- 172.21.15.26:0/2061307618 shutdown_connections 2021-11-03T16:47:57.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:57.070+0000 7fb0d2f81700 1 --2- 172.21.15.26:0/2061307618 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fb0bc02ff60 0x7fb0bc032420 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:47:57.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:57.070+0000 7fb0d2f81700 1 --2- 172.21.15.26:0/2061307618 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0cc0f4860 0x7fb0cc1068c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:47:57.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:57.070+0000 7fb0d2f81700 1 -- 172.21.15.26:0/2061307618 >> 172.21.15.26:0/2061307618 conn(0x7fb0cc0f02e0 msgr2=0x7fb0cc0f0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:47:57.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:57.070+0000 7fb0d2f81700 1 -- 172.21.15.26:0/2061307618 shutdown_connections 2021-11-03T16:47:57.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:47:57.070+0000 7fb0d2f81700 1 -- 172.21.15.26:0/2061307618 wait complete. 2021-11-03T16:47:57.068 INFO:teuthology.orchestra.run.smithi026.stderr:adjusted tunables profile to default 2021-11-03T16:47:57.078 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:57 smithi026 conmon[32119]: audit 2021-11-03T16:47:56.248399+0000 mon.smithi026 (mon.0) 129 : audit 2021-11-03T16:47:57.078 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:57 smithi026 conmon[32119]: [INF] from='client.? 172.21.15.26:0/2061307618' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2021-11-03T16:47:58.346 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:58 smithi026 conmon[32119]: cluster 2021-11-03T16:47:56.985846+0000 mgr.smithi026.cnrxli (mgr.14162 2021-11-03T16:47:58.347 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:58 smithi026 conmon[32119]: ) 28 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:47:58.347 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:58 smithi026 conmon[32119]: audit 2021-11-03T16:47:57.068791+0000 mon.smithi026 (mon.0) 130 : audit [INF] from='client.? 172.21.15.26:0/2061307618' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2021-11-03T16:47:58.347 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:58 smithi026 conmon[32119]: 2021-11-03T16:47:58.347 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:58 smithi026 conmon[32119]: cluster 2021-11-03T16: 2021-11-03T16:47:58.348 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:58 smithi026 conmon[32119]: 47:57.068853+0000 mon.smithi026 (mon.0) 131 : cluster 2021-11-03T16:47:58.348 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:47:58 smithi026 conmon[32119]: [DBG] osdmap e5: 0 total, 0 up, 0 in 2021-11-03T16:47:58.631 INFO:tasks.cephadm:Adding mon.smithi026 on smithi026 2021-11-03T16:47:58.632 INFO:tasks.cephadm:Adding mon.smithi194 on smithi194 2021-11-03T16:47:58.632 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph orch apply mon '2;smithi026:172.21.15.26=smithi026;smithi194:172.21.15.194=smithi194' 2021-11-03T16:48:00.242 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:00 smithi026 conmon[32119]: cluster 2021-11-03T16:47:58.986131+0000 mgr.smithi026.cnrxli (mgr.14162) 29 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:00.391 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:00.393+0000 7f32906a5700 1 -- 172.21.15.194:0/1690651636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32880f6510 msgr2=0x7f32880f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:48:00.392 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:00.393+0000 7f32906a5700 1 --2- 172.21.15.194:0/1690651636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32880f6510 0x7f32880f6930 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f3284009fb0 tx=0x7f3284009b30).stop 2021-11-03T16:48:00.392 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:00.393+0000 7f32906a5700 1 -- 172.21.15.194:0/1690651636 shutdown_connections 2021-11-03T16:48:00.392 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:00.393+0000 7f32906a5700 1 --2- 172.21.15.194:0/1690651636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32880f6510 0x7f32880f6930 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:48:00.393 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:00.393+0000 7f32906a5700 1 -- 172.21.15.194:0/1690651636 >> 172.21.15.194:0/1690651636 conn(0x7f32880f1c70 msgr2=0x7f32880f4090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:48:00.393 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:00.393+0000 7f32906a5700 1 -- 172.21.15.194:0/1690651636 shutdown_connections 2021-11-03T16:48:00.393 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:00.393+0000 7f32906a5700 1 -- 172.21.15.194:0/1690651636 wait complete. 2021-11-03T16:48:00.393 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:00.394+0000 7f32906a5700 1 Processor -- start 2021-11-03T16:48:00.394 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:00.394+0000 7f32906a5700 1 -- start start 2021-11-03T16:48:00.394 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:00.394+0000 7f32906a5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32880f6510 0x7f32881066e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:48:00.394 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:00.394+0000 7f32906a5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3288106bd0 con 0x7f32880f6510 2021-11-03T16:48:00.394 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:00.394+0000 7f328e441700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32880f6510 0x7f32881066e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:48:00.395 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:00.394+0000 7f328e441700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32880f6510 0x7f32881066e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.194:53190/0 (socket says 172.21.15.194:53190) 2021-11-03T16:48:00.395 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:00.394+0000 7f328e441700 1 -- 172.21.15.194:0/3580160702 learned_addr learned my addr 172.21.15.194:0/3580160702 (peer_addr_for_me v2:172.21.15.194:0/0) 2021-11-03T16:48:00.395 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:00.394+0000 7f328e441700 1 -- 172.21.15.194:0/3580160702 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3284005040 con 0x7f32880f6510 2021-11-03T16:48:00.395 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:00.394+0000 7f328e441700 1 --2- 172.21.15.194:0/3580160702 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32880f6510 0x7f32881066e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f32840089f0 tx=0x7f328400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:48:00.396 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:00.395+0000 7f327effd700 1 -- 172.21.15.194:0/3580160702 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3284009320 con 0x7f32880f6510 2021-11-03T16:48:00.396 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:00.395+0000 7f327effd700 1 -- 172.21.15.194:0/3580160702 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f3284013ec0 con 0x7f32880f6510 2021-11-03T16:48:00.396 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:00.395+0000 7f32906a5700 1 -- 172.21.15.194:0/3580160702 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3288106dd0 con 0x7f32880f6510 2021-11-03T16:48:00.396 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:00.395+0000 7f327effd700 1 -- 172.21.15.194:0/3580160702 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3284014d30 con 0x7f32880f6510 2021-11-03T16:48:00.396 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:00.395+0000 7f32906a5700 1 -- 172.21.15.194:0/3580160702 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3288107260 con 0x7f32880f6510 2021-11-03T16:48:00.398 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:00.395+0000 7f327effd700 1 -- 172.21.15.194:0/3580160702 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f3284014420 con 0x7f32880f6510 2021-11-03T16:48:00.398 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:00.395+0000 7f32906a5700 1 -- 172.21.15.194:0/3580160702 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3288045ad0 con 0x7f32880f6510 2021-11-03T16:48:00.398 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:00.396+0000 7f327effd700 1 --2- 172.21.15.194:0/3580160702 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f327402ff60 0x7f3274032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:48:00.398 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:00.396+0000 7f327effd700 1 -- 172.21.15.194:0/3580160702 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f32840410c0 con 0x7f32880f6510 2021-11-03T16:48:00.399 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:00.396+0000 7f328dc40700 1 --2- 172.21.15.194:0/3580160702 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f327402ff60 0x7f3274032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:48:00.399 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:00.396+0000 7f328dc40700 1 --2- 172.21.15.194:0/3580160702 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f327402ff60 0x7f3274032420 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f32780096a0 tx=0x7f3278006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:48:00.399 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:00.400+0000 7f327effd700 1 -- 172.21.15.194:0/3580160702 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f32840095f0 con 0x7f32880f6510 2021-11-03T16:48:00.573 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:00.577+0000 7f32906a5700 1 -- 172.21.15.194:0/3580160702 --> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi026:172.21.15.26=smithi026;smithi194:172.21.15.194=smithi194", "target": ["mon-mgr", ""]}) v1 -- 0x7f32880f2ed0 con 0x7f327402ff60 2021-11-03T16:48:00.578 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:00.582+0000 7f327effd700 1 -- 172.21.15.194:0/3580160702 <== mgr.14162 v2:172.21.15.26:6800/3029163595 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f32880f2ed0 con 0x7f327402ff60 2021-11-03T16:48:00.579 INFO:teuthology.orchestra.run.smithi194.stdout:Scheduled mon update... 2021-11-03T16:48:00.580 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:00.583+0000 7f32906a5700 1 -- 172.21.15.194:0/3580160702 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f327402ff60 msgr2=0x7f3274032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:48:00.580 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:00.583+0000 7f32906a5700 1 --2- 172.21.15.194:0/3580160702 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f327402ff60 0x7f3274032420 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f32780096a0 tx=0x7f3278006b40).stop 2021-11-03T16:48:00.580 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:00.583+0000 7f32906a5700 1 -- 172.21.15.194:0/3580160702 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32880f6510 msgr2=0x7f32881066e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:48:00.581 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:00.583+0000 7f32906a5700 1 --2- 172.21.15.194:0/3580160702 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32880f6510 0x7f32881066e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f32840089f0 tx=0x7f328400b040).stop 2021-11-03T16:48:00.586 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:00.583+0000 7f32906a5700 1 -- 172.21.15.194:0/3580160702 shutdown_connections 2021-11-03T16:48:00.587 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:00.583+0000 7f32906a5700 1 --2- 172.21.15.194:0/3580160702 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f327402ff60 0x7f3274032420 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:48:00.587 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:00.583+0000 7f32906a5700 1 --2- 172.21.15.194:0/3580160702 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32880f6510 0x7f32881066e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:48:00.587 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:00.583+0000 7f32906a5700 1 -- 172.21.15.194:0/3580160702 >> 172.21.15.194:0/3580160702 conn(0x7f32880f1c70 msgr2=0x7f32880f2710 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:48:00.587 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:00.583+0000 7f32906a5700 1 -- 172.21.15.194:0/3580160702 shutdown_connections 2021-11-03T16:48:00.588 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:00.583+0000 7f32906a5700 1 -- 172.21.15.194:0/3580160702 wait complete. 2021-11-03T16:48:01.244 DEBUG:teuthology.orchestra.run.smithi194:mon.smithi194> sudo journalctl -f -n 0 -u ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c@mon.smithi194.service 2021-11-03T16:48:01.247 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2021-11-03T16:48:01.247 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph mon dump -f json 2021-11-03T16:48:01.273 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:-- Logs begin at Wed 2021-11-03 16:35:29 UTC. -- 2021-11-03T16:48:01.697 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:01 smithi026 conmon[32119]: audit 2021-11-03T16:48:00.579757+0000 mgr.smithi026.cnrxli (mgr 2021-11-03T16:48:01.698 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:01 smithi026 conmon[32119]: .14162) 30 : audit [DBG] from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi026:172.21.15.26=smithi026;smithi194:172.21.15.194=smithi194", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:48:01.698 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:01 smithi026 conmon[32119]: cephadm 2021-11-03T16:48:00.581099+0000 mgr.smithi026.cnrxli (mgr.14162) 31 2021-11-03T16:48:01.698 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:01 smithi026 conmon[32119]: : cephadm [INF] Saving service mon spec with placement smithi026:172.21.15.26=smithi026;smithi194:172.21.15.194=smithi194;count:2 2021-11-03T16:48:01.698 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:01 smithi026 conmon[32119]: audit 2021-11-03T16:48:00.583375 2021-11-03T16:48:01.699 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:01 smithi026 conmon[32119]: +0000 mon.smithi026 (mon.0) 132 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:48:01.699 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:01 smithi026 conmon[32119]: cluster 2021-11-03T16:48:00.986379+0000 2021-11-03T16:48:01.699 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:01 smithi026 conmon[32119]: mgr.smithi026.cnrxli (mgr.14162) 32 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:03.045 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:03.048+0000 7f8d73abf700 1 -- 172.21.15.194:0/1929320317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d6c0f5410 msgr2=0x7f8d6c0f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:48:03.046 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:03.048+0000 7f8d73abf700 1 --2- 172.21.15.194:0/1929320317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d6c0f5410 0x7f8d6c0f5830 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f8d5c009960 tx=0x7f8d5c004d10).stop 2021-11-03T16:48:03.046 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:03.048+0000 7f8d73abf700 1 -- 172.21.15.194:0/1929320317 shutdown_connections 2021-11-03T16:48:03.046 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:03.048+0000 7f8d73abf700 1 --2- 172.21.15.194:0/1929320317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d6c0f5410 0x7f8d6c0f5830 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:48:03.047 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:03.048+0000 7f8d73abf700 1 -- 172.21.15.194:0/1929320317 >> 172.21.15.194:0/1929320317 conn(0x7f8d6c0f0b70 msgr2=0x7f8d6c0f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:48:03.047 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:03.048+0000 7f8d73abf700 1 -- 172.21.15.194:0/1929320317 shutdown_connections 2021-11-03T16:48:03.047 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:03.048+0000 7f8d73abf700 1 -- 172.21.15.194:0/1929320317 wait complete. 2021-11-03T16:48:03.047 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:03.048+0000 7f8d73abf700 1 Processor -- start 2021-11-03T16:48:03.047 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:03.048+0000 7f8d73abf700 1 -- start start 2021-11-03T16:48:03.048 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:03.048+0000 7f8d73abf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d6c0f5410 0x7f8d6c1055e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:48:03.048 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:03.048+0000 7f8d73abf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6c105ad0 con 0x7f8d6c0f5410 2021-11-03T16:48:03.048 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:03.048+0000 7f8d7185b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d6c0f5410 0x7f8d6c1055e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:48:03.048 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:03.048+0000 7f8d7185b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d6c0f5410 0x7f8d6c1055e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.194:53196/0 (socket says 172.21.15.194:53196) 2021-11-03T16:48:03.048 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:03.048+0000 7f8d7185b700 1 -- 172.21.15.194:0/928894274 learned_addr learned my addr 172.21.15.194:0/928894274 (peer_addr_for_me v2:172.21.15.194:0/0) 2021-11-03T16:48:03.049 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:03.048+0000 7f8d7185b700 1 -- 172.21.15.194:0/928894274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d5c009640 con 0x7f8d6c0f5410 2021-11-03T16:48:03.049 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:03.049+0000 7f8d7185b700 1 --2- 172.21.15.194:0/928894274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d6c0f5410 0x7f8d6c1055e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f8d5c009610 tx=0x7f8d5c004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:48:03.049 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:03.049+0000 7f8d6a7fc700 1 -- 172.21.15.194:0/928894274 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8d5c018070 con 0x7f8d6c0f5410 2021-11-03T16:48:03.049 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:03.049+0000 7f8d73abf700 1 -- 172.21.15.194:0/928894274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d6c105cd0 con 0x7f8d6c0f5410 2021-11-03T16:48:03.049 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:03.049+0000 7f8d73abf700 1 -- 172.21.15.194:0/928894274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d6c106160 con 0x7f8d6c0f5410 2021-11-03T16:48:03.050 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:03.049+0000 7f8d6a7fc700 1 -- 172.21.15.194:0/928894274 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f8d5c00b7e0 con 0x7f8d6c0f5410 2021-11-03T16:48:03.050 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:03.049+0000 7f8d6a7fc700 1 -- 172.21.15.194:0/928894274 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8d5c01dea0 con 0x7f8d6c0f5410 2021-11-03T16:48:03.051 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:03.049+0000 7f8d73abf700 1 -- 172.21.15.194:0/928894274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d4c004fa0 con 0x7f8d6c0f5410 2021-11-03T16:48:03.051 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:03.050+0000 7f8d6a7fc700 1 -- 172.21.15.194:0/928894274 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f8d5c01d420 con 0x7f8d6c0f5410 2021-11-03T16:48:03.052 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:03.050+0000 7f8d6a7fc700 1 --2- 172.21.15.194:0/928894274 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f8d5402ff10 0x7f8d540323d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:48:03.052 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:03.050+0000 7f8d6a7fc700 1 -- 172.21.15.194:0/928894274 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f8d5c041d90 con 0x7f8d6c0f5410 2021-11-03T16:48:03.052 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:03.050+0000 7f8d7105a700 1 --2- 172.21.15.194:0/928894274 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f8d5402ff10 0x7f8d540323d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:48:03.052 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:03.051+0000 7f8d7105a700 1 --2- 172.21.15.194:0/928894274 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f8d5402ff10 0x7f8d540323d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f8d600096a0 tx=0x7f8d60006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:48:03.052 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:03.055+0000 7f8d6a7fc700 1 -- 172.21.15.194:0/928894274 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f8d5c007e40 con 0x7f8d6c0f5410 2021-11-03T16:48:03.255 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:03.259+0000 7f8d73abf700 1 -- 172.21.15.194:0/928894274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8d4c005670 con 0x7f8d6c0f5410 2021-11-03T16:48:03.256 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:03.259+0000 7f8d6a7fc700 1 -- 172.21.15.194:0/928894274 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7f8d5c025b40 con 0x7f8d6c0f5410 2021-11-03T16:48:03.256 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:48:03.257 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"70492bc6-3cc5-11ec-8c28-001a4aab830c","modified":"2021-11-03T16:45:59.385154Z","created":"2021-11-03T16:45:59.385154Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi026","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:3300","nonce":0},{"type":"v1","addr":"172.21.15.26:6789","nonce":0}]},"addr":"172.21.15.26:6789/0","public_addr":"172.21.15.26:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2021-11-03T16:48:03.258 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:03.260+0000 7f8d73abf700 1 -- 172.21.15.194:0/928894274 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f8d5402ff10 msgr2=0x7f8d540323d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:48:03.258 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:03.260+0000 7f8d73abf700 1 --2- 172.21.15.194:0/928894274 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f8d5402ff10 0x7f8d540323d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f8d600096a0 tx=0x7f8d60006b40).stop 2021-11-03T16:48:03.258 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:03.260+0000 7f8d73abf700 1 -- 172.21.15.194:0/928894274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d6c0f5410 msgr2=0x7f8d6c1055e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:48:03.259 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:03.261+0000 7f8d73abf700 1 --2- 172.21.15.194:0/928894274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d6c0f5410 0x7f8d6c1055e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f8d5c009610 tx=0x7f8d5c004d10).stop 2021-11-03T16:48:03.259 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:03.261+0000 7f8d73abf700 1 -- 172.21.15.194:0/928894274 shutdown_connections 2021-11-03T16:48:03.259 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:03.261+0000 7f8d73abf700 1 --2- 172.21.15.194:0/928894274 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f8d5402ff10 0x7f8d540323d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:48:03.259 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:03.261+0000 7f8d73abf700 1 --2- 172.21.15.194:0/928894274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d6c0f5410 0x7f8d6c1055e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:48:03.259 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:03.261+0000 7f8d73abf700 1 -- 172.21.15.194:0/928894274 >> 172.21.15.194:0/928894274 conn(0x7f8d6c0f0b70 msgr2=0x7f8d6c0f1630 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:48:03.260 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:03.261+0000 7f8d73abf700 1 -- 172.21.15.194:0/928894274 shutdown_connections 2021-11-03T16:48:03.260 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:03.261+0000 7f8d73abf700 1 -- 172.21.15.194:0/928894274 wait complete. 2021-11-03T16:48:03.260 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2021-11-03T16:48:04.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:03 smithi026 conmon[32119]: cluster 2021-11-03T16:48:02.986601+0000 mgr.smithi026.cnrxli 2021-11-03T16:48:04.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:03 smithi026 conmon[32119]: (mgr.14162) 33 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:04.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:03 smithi026 conmon[32119]: audit 2021-11-03T16:48:03.261152+0000 mon.smithi026 (mon.0) 133 : audit [DBG] 2021-11-03T16:48:04.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:03 smithi026 conmon[32119]: from='client.? 172.21.15.194:0/928894274' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-11-03T16:48:04.851 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2021-11-03T16:48:04.852 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph mon dump -f json 2021-11-03T16:48:06.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:06 smithi026 conmon[32119]: cluster 2021-11-03T16:48:04.986938+0000 mgr.smithi026.cnrxli (mgr 2021-11-03T16:48:06.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:06 smithi026 conmon[32119]: .14162) 34 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:06.586 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:06.590+0000 7f225b094700 1 -- 172.21.15.194:0/4192907232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22540f47c0 msgr2=0x7f22540f4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:48:06.586 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:06.590+0000 7f225b094700 1 --2- 172.21.15.194:0/4192907232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22540f47c0 0x7f22540f4be0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f2248009fb0 tx=0x7f2248009b30).stop 2021-11-03T16:48:06.587 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:06.590+0000 7f225b094700 1 -- 172.21.15.194:0/4192907232 shutdown_connections 2021-11-03T16:48:06.587 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:06.590+0000 7f225b094700 1 --2- 172.21.15.194:0/4192907232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22540f47c0 0x7f22540f4be0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:48:06.587 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:06.590+0000 7f225b094700 1 -- 172.21.15.194:0/4192907232 >> 172.21.15.194:0/4192907232 conn(0x7f22540f02e0 msgr2=0x7f22540f2700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:48:06.588 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:06.590+0000 7f225b094700 1 -- 172.21.15.194:0/4192907232 shutdown_connections 2021-11-03T16:48:06.588 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:06.590+0000 7f225b094700 1 -- 172.21.15.194:0/4192907232 wait complete. 2021-11-03T16:48:06.588 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:06.590+0000 7f225b094700 1 Processor -- start 2021-11-03T16:48:06.588 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:06.590+0000 7f225b094700 1 -- start start 2021-11-03T16:48:06.588 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:06.591+0000 7f225b094700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22540f47c0 0x7f22541066e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:48:06.589 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:06.591+0000 7f225b094700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2254106bd0 con 0x7f22540f47c0 2021-11-03T16:48:06.591 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:06.591+0000 7f2258e30700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22540f47c0 0x7f22541066e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:48:06.591 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:06.591+0000 7f2258e30700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22540f47c0 0x7f22541066e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.194:53202/0 (socket says 172.21.15.194:53202) 2021-11-03T16:48:06.591 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:06.591+0000 7f2258e30700 1 -- 172.21.15.194:0/1412156027 learned_addr learned my addr 172.21.15.194:0/1412156027 (peer_addr_for_me v2:172.21.15.194:0/0) 2021-11-03T16:48:06.591 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:06.591+0000 7f2258e30700 1 -- 172.21.15.194:0/1412156027 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2248005040 con 0x7f22540f47c0 2021-11-03T16:48:06.592 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:06.591+0000 7f2258e30700 1 --2- 172.21.15.194:0/1412156027 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22540f47c0 0x7f22541066e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f2248000c00 tx=0x7f224800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:48:06.592 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:06.592+0000 7f22517fa700 1 -- 172.21.15.194:0/1412156027 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22480095f0 con 0x7f22540f47c0 2021-11-03T16:48:06.592 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:06.592+0000 7f22517fa700 1 -- 172.21.15.194:0/1412156027 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f2248007e50 con 0x7f22540f47c0 2021-11-03T16:48:06.592 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:06.592+0000 7f22517fa700 1 -- 172.21.15.194:0/1412156027 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2248014e70 con 0x7f22540f47c0 2021-11-03T16:48:06.593 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:06.592+0000 7f225b094700 1 -- 172.21.15.194:0/1412156027 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2254106dd0 con 0x7f22540f47c0 2021-11-03T16:48:06.593 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:06.592+0000 7f225b094700 1 -- 172.21.15.194:0/1412156027 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2254107260 con 0x7f22540f47c0 2021-11-03T16:48:06.593 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:06.592+0000 7f22517fa700 1 -- 172.21.15.194:0/1412156027 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f2248025070 con 0x7f22540f47c0 2021-11-03T16:48:06.593 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:06.592+0000 7f225b094700 1 -- 172.21.15.194:0/1412156027 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2254045ad0 con 0x7f22540f47c0 2021-11-03T16:48:06.593 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:06.593+0000 7f22517fa700 1 --2- 172.21.15.194:0/1412156027 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f224402ffb0 0x7f2244032470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:48:06.594 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:06.593+0000 7f22517fa700 1 -- 172.21.15.194:0/1412156027 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f2248040ca0 con 0x7f22540f47c0 2021-11-03T16:48:06.594 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:06.593+0000 7f2253fff700 1 --2- 172.21.15.194:0/1412156027 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f224402ffb0 0x7f2244032470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:48:06.594 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:06.593+0000 7f2253fff700 1 --2- 172.21.15.194:0/1412156027 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f224402ffb0 0x7f2244032470 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f22400096a0 tx=0x7f2240006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:48:06.595 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:06.597+0000 7f22517fa700 1 -- 172.21.15.194:0/1412156027 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f2248026350 con 0x7f22540f47c0 2021-11-03T16:48:06.794 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:06.799+0000 7f225b094700 1 -- 172.21.15.194:0/1412156027 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2254108060 con 0x7f22540f47c0 2021-11-03T16:48:06.795 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:06.800+0000 7f22517fa700 1 -- 172.21.15.194:0/1412156027 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7f2248012330 con 0x7f22540f47c0 2021-11-03T16:48:06.796 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:48:06.796 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"70492bc6-3cc5-11ec-8c28-001a4aab830c","modified":"2021-11-03T16:45:59.385154Z","created":"2021-11-03T16:45:59.385154Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi026","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:3300","nonce":0},{"type":"v1","addr":"172.21.15.26:6789","nonce":0}]},"addr":"172.21.15.26:6789/0","public_addr":"172.21.15.26:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2021-11-03T16:48:06.797 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:06.801+0000 7f225b094700 1 -- 172.21.15.194:0/1412156027 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f224402ffb0 msgr2=0x7f2244032470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:48:06.797 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:06.801+0000 7f225b094700 1 --2- 172.21.15.194:0/1412156027 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f224402ffb0 0x7f2244032470 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f22400096a0 tx=0x7f2240006b40).stop 2021-11-03T16:48:06.797 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:06.801+0000 7f225b094700 1 -- 172.21.15.194:0/1412156027 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22540f47c0 msgr2=0x7f22541066e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:48:06.798 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:06.801+0000 7f225b094700 1 --2- 172.21.15.194:0/1412156027 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22540f47c0 0x7f22541066e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f2248000c00 tx=0x7f224800b040).stop 2021-11-03T16:48:06.798 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:06.801+0000 7f225b094700 1 -- 172.21.15.194:0/1412156027 shutdown_connections 2021-11-03T16:48:06.798 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:06.801+0000 7f225b094700 1 --2- 172.21.15.194:0/1412156027 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f224402ffb0 0x7f2244032470 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:48:06.798 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:06.801+0000 7f225b094700 1 --2- 172.21.15.194:0/1412156027 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22540f47c0 0x7f22541066e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:48:06.799 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:06.801+0000 7f225b094700 1 -- 172.21.15.194:0/1412156027 >> 172.21.15.194:0/1412156027 conn(0x7f22540f02e0 msgr2=0x7f22540f0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:48:06.799 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:06.801+0000 7f225b094700 1 -- 172.21.15.194:0/1412156027 shutdown_connections 2021-11-03T16:48:06.799 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:06.801+0000 7f225b094700 1 -- 172.21.15.194:0/1412156027 wait complete. 2021-11-03T16:48:06.800 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2021-11-03T16:48:07.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:07 smithi026 conmon[32119]: audit 2021-11-03T16:48:06.800396+0000 mon.smithi026 (mon.0) 134 : audit [DBG] from='client.? 172.21.15.194:0/1412156027' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-11-03T16:48:08.420 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2021-11-03T16:48:08.421 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph mon dump -f json 2021-11-03T16:48:08.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:08 smithi026 conmon[32119]: cluster 2021-11-03T16:48:06.987204+0000 mgr.smithi026.cnrxli (mgr 2021-11-03T16:48:08.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:08 smithi026 conmon[32119]: .14162) 35 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:09.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:09 smithi026 conmon[32119]: audit 2021-11-03T16 2021-11-03T16:48:09.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:09 smithi026 conmon[32119]: :48:08.576461+0000 mon.smithi026 (mon.0) 135 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:48:09.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:09 smithi026 conmon[32119]: audit 2021-11-03T16:48:08.577053+0000 mon.smithi026 (mon.0) 136 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:48:09.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:09 smithi026 conmon[32119]: audit 2021- 2021-11-03T16:48:09.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:09 smithi026 conmon[32119]: 11-03T16:48:08.843123+0000 mon.smithi026 (mon.0) 2021-11-03T16:48:09.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:09 smithi026 conmon[32119]: 137 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:48:09.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:09 smithi026 conmon[32119]: cluster 2021-11- 2021-11-03T16:48:09.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:09 smithi026 conmon[32119]: 03T16:48:08.987434+0000 2021-11-03T16:48:09.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:09 smithi026 conmon[32119]: mgr.smithi026.cnrxli (mgr.14162) 36 : 2021-11-03T16:48:09.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:09 smithi026 conmon[32119]: cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:09.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:09 smithi026 conmon[32119]: audit 2021 2021-11-03T16:48:09.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:09 smithi026 conmon[32119]: -11-03T16:48: 2021-11-03T16:48:09.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:09 smithi026 conmon[32119]: 09.158741+0000 mon.smithi026 (mon 2021-11-03T16:48:09.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:09 smithi026 conmon[32119]: .0) 138 : audit [INF] 2021-11-03T16:48:09.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:09 smithi026 conmon[32119]: from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T16:48:09.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:09 smithi026 conmon[32119]: audit 2021-11-03T16:48:09.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:09 smithi026 conmon[32119]: 2021-11-03T16:48 2021-11-03T16:48:09.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:09 smithi026 conmon[32119]: :09.161371+0000 mon.smithi026 ( 2021-11-03T16:48:09.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:09 smithi026 conmon[32119]: mon.0) 139 : audit 2021-11-03T16:48:09.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:09 smithi026 conmon[32119]: [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T16:48:09.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:09 smithi026 conmon[32119]: audit 2021 2021-11-03T16:48:09.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:09 smithi026 conmon[32119]: -11-03T16:48: 2021-11-03T16:48:09.928 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:09 smithi026 conmon[32119]: 09.289024+0000 mon.smithi026 (mon. 2021-11-03T16:48:09.928 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:09 smithi026 conmon[32119]: 0) 140 : audit [INF] 2021-11-03T16:48:09.928 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:09 smithi026 conmon[32119]: from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:48:10.297 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:10.300+0000 7f1d2dab1700 1 -- 172.21.15.194:0/572329648 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d280f5410 msgr2=0x7f1d280f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:48:10.297 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:10.300+0000 7f1d2dab1700 1 --2- 172.21.15.194:0/572329648 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d280f5410 0x7f1d280f5830 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f1d18009fb0 tx=0x7f1d18009b30).stop 2021-11-03T16:48:10.297 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:10.300+0000 7f1d2dab1700 1 -- 172.21.15.194:0/572329648 shutdown_connections 2021-11-03T16:48:10.297 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:10.300+0000 7f1d2dab1700 1 --2- 172.21.15.194:0/572329648 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d280f5410 0x7f1d280f5830 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:48:10.298 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:10.301+0000 7f1d2dab1700 1 -- 172.21.15.194:0/572329648 >> 172.21.15.194:0/572329648 conn(0x7f1d280f0b70 msgr2=0x7f1d280f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:48:10.298 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:10.301+0000 7f1d2dab1700 1 -- 172.21.15.194:0/572329648 shutdown_connections 2021-11-03T16:48:10.298 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:10.301+0000 7f1d2dab1700 1 -- 172.21.15.194:0/572329648 wait complete. 2021-11-03T16:48:10.298 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:10.301+0000 7f1d2dab1700 1 Processor -- start 2021-11-03T16:48:10.299 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:10.301+0000 7f1d2dab1700 1 -- start start 2021-11-03T16:48:10.299 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:10.301+0000 7f1d2dab1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d280f5410 0x7f1d2810b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:48:10.299 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:10.301+0000 7f1d2dab1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d281071f0 con 0x7f1d280f5410 2021-11-03T16:48:10.300 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:10.302+0000 7f1d277fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d280f5410 0x7f1d2810b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:48:10.301 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:10.302+0000 7f1d277fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d280f5410 0x7f1d2810b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.194:53208/0 (socket says 172.21.15.194:53208) 2021-11-03T16:48:10.301 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:10.302+0000 7f1d277fe700 1 -- 172.21.15.194:0/645927320 learned_addr learned my addr 172.21.15.194:0/645927320 (peer_addr_for_me v2:172.21.15.194:0/0) 2021-11-03T16:48:10.301 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:10.302+0000 7f1d277fe700 1 -- 172.21.15.194:0/645927320 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d18005040 con 0x7f1d280f5410 2021-11-03T16:48:10.301 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:10.302+0000 7f1d277fe700 1 --2- 172.21.15.194:0/645927320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d280f5410 0x7f1d2810b800 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f1d180089f0 tx=0x7f1d1800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:48:10.302 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:10.302+0000 7f1d0ffff700 1 -- 172.21.15.194:0/645927320 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d18009320 con 0x7f1d280f5410 2021-11-03T16:48:10.302 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:10.302+0000 7f1d2dab1700 1 -- 172.21.15.194:0/645927320 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d28060220 con 0x7f1d280f5410 2021-11-03T16:48:10.302 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:10.302+0000 7f1d0ffff700 1 -- 172.21.15.194:0/645927320 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f1d18013ec0 con 0x7f1d280f5410 2021-11-03T16:48:10.302 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:10.302+0000 7f1d0ffff700 1 -- 172.21.15.194:0/645927320 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d18014d30 con 0x7f1d280f5410 2021-11-03T16:48:10.303 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:10.302+0000 7f1d2dab1700 1 -- 172.21.15.194:0/645927320 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d2810bcf0 con 0x7f1d280f5410 2021-11-03T16:48:10.303 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:10.303+0000 7f1d0ffff700 1 -- 172.21.15.194:0/645927320 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f1d180095f0 con 0x7f1d280f5410 2021-11-03T16:48:10.303 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:10.303+0000 7f1d2dab1700 1 -- 172.21.15.194:0/645927320 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d28045ad0 con 0x7f1d280f5410 2021-11-03T16:48:10.303 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:10.303+0000 7f1d0ffff700 1 --2- 172.21.15.194:0/645927320 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f1d1002ff60 0x7f1d10032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:48:10.304 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:10.303+0000 7f1d0ffff700 1 -- 172.21.15.194:0/645927320 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f1d18040ff0 con 0x7f1d280f5410 2021-11-03T16:48:10.304 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:10.303+0000 7f1d26ffd700 1 --2- 172.21.15.194:0/645927320 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f1d1002ff60 0x7f1d10032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:48:10.304 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:10.304+0000 7f1d26ffd700 1 --2- 172.21.15.194:0/645927320 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f1d1002ff60 0x7f1d10032420 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f1d1c0096a0 tx=0x7f1d1c006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:48:10.305 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:10.309+0000 7f1d0ffff700 1 -- 172.21.15.194:0/645927320 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f1d18014420 con 0x7f1d280f5410 2021-11-03T16:48:10.529 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:10.533+0000 7f1d2dab1700 1 -- 172.21.15.194:0/645927320 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f1d280fae90 con 0x7f1d280f5410 2021-11-03T16:48:10.530 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:10.534+0000 7f1d0ffff700 1 -- 172.21.15.194:0/645927320 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7f1d18010230 con 0x7f1d280f5410 2021-11-03T16:48:10.530 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:48:10.531 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"70492bc6-3cc5-11ec-8c28-001a4aab830c","modified":"2021-11-03T16:45:59.385154Z","created":"2021-11-03T16:45:59.385154Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi026","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:3300","nonce":0},{"type":"v1","addr":"172.21.15.26:6789","nonce":0}]},"addr":"172.21.15.26:6789/0","public_addr":"172.21.15.26:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2021-11-03T16:48:10.531 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:10.536+0000 7f1d2dab1700 1 -- 172.21.15.194:0/645927320 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f1d1002ff60 msgr2=0x7f1d10032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:48:10.532 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:10.536+0000 7f1d2dab1700 1 --2- 172.21.15.194:0/645927320 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f1d1002ff60 0x7f1d10032420 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f1d1c0096a0 tx=0x7f1d1c006b40).stop 2021-11-03T16:48:10.532 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:10.536+0000 7f1d2dab1700 1 -- 172.21.15.194:0/645927320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d280f5410 msgr2=0x7f1d2810b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:48:10.532 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:10.536+0000 7f1d2dab1700 1 --2- 172.21.15.194:0/645927320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d280f5410 0x7f1d2810b800 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f1d180089f0 tx=0x7f1d1800b040).stop 2021-11-03T16:48:10.532 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:10.536+0000 7f1d2dab1700 1 -- 172.21.15.194:0/645927320 shutdown_connections 2021-11-03T16:48:10.532 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:10.536+0000 7f1d2dab1700 1 --2- 172.21.15.194:0/645927320 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f1d1002ff60 0x7f1d10032420 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:48:10.533 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:10.536+0000 7f1d2dab1700 1 --2- 172.21.15.194:0/645927320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d280f5410 0x7f1d2810b800 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:48:10.533 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:10.536+0000 7f1d2dab1700 1 -- 172.21.15.194:0/645927320 >> 172.21.15.194:0/645927320 conn(0x7f1d280f0b70 msgr2=0x7f1d280f1630 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:48:10.533 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:10.536+0000 7f1d2dab1700 1 -- 172.21.15.194:0/645927320 shutdown_connections 2021-11-03T16:48:10.533 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:10.536+0000 7f1d2dab1700 1 -- 172.21.15.194:0/645927320 wait complete. 2021-11-03T16:48:10.534 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2021-11-03T16:48:11.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:10 smithi026 conmon[32119]: audit 2021-11-03T16:48:10 2021-11-03T16:48:11.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:10 smithi026 conmon[32119]: .534939+0000 mon.smithi026 (mon.0) 141 : audit [DBG] from='client.? 172.21.15.194:0/645927320' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-11-03T16:48:12.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:11 smithi026 conmon[32119]: cluster 2021-11-03T16:48:10.987678+0000 mgr.smithi026.cnrxli (mgr.14162) 37 : cluster 2021-11-03T16:48:12.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:11 smithi026 conmon[32119]: [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:12.467 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2021-11-03T16:48:12.467 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph mon dump -f json 2021-11-03T16:48:13.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:13 smithi026 conmon[32119]: audit 2021-11-03T16:48:12.245865+0000 mon.smithi026 (mon.0) 142 : audit [INF] 2021-11-03T16:48:13.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:13 smithi026 conmon[32119]: from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:48:13.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:13 smithi026 conmon[32119]: audit 2021-11-03T16:48:13.181252+0000 mon.smithi026 (mon.0) 143 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:48:14.288 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:14.291+0000 7f9f0fb76700 1 -- 172.21.15.194:0/2807323684 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f080f5410 msgr2=0x7f9f080f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:48:14.288 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:14.291+0000 7f9f0fb76700 1 --2- 172.21.15.194:0/2807323684 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f080f5410 0x7f9f080f5830 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f9f04009fb0 tx=0x7f9f04009b30).stop 2021-11-03T16:48:14.288 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:14.291+0000 7f9f0fb76700 1 -- 172.21.15.194:0/2807323684 shutdown_connections 2021-11-03T16:48:14.289 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:14.291+0000 7f9f0fb76700 1 --2- 172.21.15.194:0/2807323684 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f080f5410 0x7f9f080f5830 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:48:14.289 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:14.291+0000 7f9f0fb76700 1 -- 172.21.15.194:0/2807323684 >> 172.21.15.194:0/2807323684 conn(0x7f9f080f0b70 msgr2=0x7f9f080f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:48:14.289 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:14.291+0000 7f9f0fb76700 1 -- 172.21.15.194:0/2807323684 shutdown_connections 2021-11-03T16:48:14.289 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:14.291+0000 7f9f0fb76700 1 -- 172.21.15.194:0/2807323684 wait complete. 2021-11-03T16:48:14.290 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:14.292+0000 7f9f0fb76700 1 Processor -- start 2021-11-03T16:48:14.290 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:14.292+0000 7f9f0fb76700 1 -- start start 2021-11-03T16:48:14.290 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:14.292+0000 7f9f0fb76700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f080f5410 0x7f9f08105610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:48:14.290 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:14.292+0000 7f9f0fb76700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f08105b00 con 0x7f9f080f5410 2021-11-03T16:48:14.292 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:14.293+0000 7f9f0d912700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f080f5410 0x7f9f08105610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:48:14.292 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:14.293+0000 7f9f0d912700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f080f5410 0x7f9f08105610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.194:53214/0 (socket says 172.21.15.194:53214) 2021-11-03T16:48:14.293 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:14.293+0000 7f9f0d912700 1 -- 172.21.15.194:0/426306484 learned_addr learned my addr 172.21.15.194:0/426306484 (peer_addr_for_me v2:172.21.15.194:0/0) 2021-11-03T16:48:14.293 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:14.293+0000 7f9f0d912700 1 -- 172.21.15.194:0/426306484 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f04005040 con 0x7f9f080f5410 2021-11-03T16:48:14.293 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:14.293+0000 7f9f0d912700 1 --2- 172.21.15.194:0/426306484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f080f5410 0x7f9f08105610 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f9f040089f0 tx=0x7f9f0400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:48:14.293 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:14.293+0000 7f9efe7fc700 1 -- 172.21.15.194:0/426306484 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9f04009320 con 0x7f9f080f5410 2021-11-03T16:48:14.293 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:14.294+0000 7f9efe7fc700 1 -- 172.21.15.194:0/426306484 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f9f04013ec0 con 0x7f9f080f5410 2021-11-03T16:48:14.294 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:14.294+0000 7f9f0fb76700 1 -- 172.21.15.194:0/426306484 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f08105d00 con 0x7f9f080f5410 2021-11-03T16:48:14.294 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:14.294+0000 7f9efe7fc700 1 -- 172.21.15.194:0/426306484 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9f04014d30 con 0x7f9f080f5410 2021-11-03T16:48:14.294 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:14.294+0000 7f9f0fb76700 1 -- 172.21.15.194:0/426306484 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f08106190 con 0x7f9f080f5410 2021-11-03T16:48:14.294 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:14.294+0000 7f9efe7fc700 1 -- 172.21.15.194:0/426306484 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f9f040263a0 con 0x7f9f080f5410 2021-11-03T16:48:14.295 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:14.294+0000 7f9f0fb76700 1 -- 172.21.15.194:0/426306484 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f08045ad0 con 0x7f9f080f5410 2021-11-03T16:48:14.295 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:14.294+0000 7f9efe7fc700 1 --2- 172.21.15.194:0/426306484 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f9ef402ff60 0x7f9ef4032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:48:14.295 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:14.295+0000 7f9efe7fc700 1 -- 172.21.15.194:0/426306484 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f9f04041080 con 0x7f9f080f5410 2021-11-03T16:48:14.295 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:14.295+0000 7f9f0d111700 1 --2- 172.21.15.194:0/426306484 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f9ef402ff60 0x7f9ef4032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:48:14.295 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:14.295+0000 7f9f0d111700 1 --2- 172.21.15.194:0/426306484 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f9ef402ff60 0x7f9ef4032420 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f9ef80096a0 tx=0x7f9ef8006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:48:14.296 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:14.299+0000 7f9efe7fc700 1 -- 172.21.15.194:0/426306484 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f9f04012510 con 0x7f9f080f5410 2021-11-03T16:48:14.541 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:14.546+0000 7f9f0fb76700 1 -- 172.21.15.194:0/426306484 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f9f080fae90 con 0x7f9f080f5410 2021-11-03T16:48:14.542 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:14.547+0000 7f9efe7fc700 1 -- 172.21.15.194:0/426306484 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7f9f04012330 con 0x7f9f080f5410 2021-11-03T16:48:14.543 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:48:14.543 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"70492bc6-3cc5-11ec-8c28-001a4aab830c","modified":"2021-11-03T16:45:59.385154Z","created":"2021-11-03T16:45:59.385154Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi026","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:3300","nonce":0},{"type":"v1","addr":"172.21.15.26:6789","nonce":0}]},"addr":"172.21.15.26:6789/0","public_addr":"172.21.15.26:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2021-11-03T16:48:14.544 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:14.548+0000 7f9f0fb76700 1 -- 172.21.15.194:0/426306484 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f9ef402ff60 msgr2=0x7f9ef4032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:48:14.544 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:14.548+0000 7f9f0fb76700 1 --2- 172.21.15.194:0/426306484 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f9ef402ff60 0x7f9ef4032420 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f9ef80096a0 tx=0x7f9ef8006b40).stop 2021-11-03T16:48:14.545 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:14.548+0000 7f9f0fb76700 1 -- 172.21.15.194:0/426306484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f080f5410 msgr2=0x7f9f08105610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:48:14.545 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:14.548+0000 7f9f0fb76700 1 --2- 172.21.15.194:0/426306484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f080f5410 0x7f9f08105610 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f9f040089f0 tx=0x7f9f0400b040).stop 2021-11-03T16:48:14.545 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:14.548+0000 7f9f0fb76700 1 -- 172.21.15.194:0/426306484 shutdown_connections 2021-11-03T16:48:14.545 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:14.549+0000 7f9f0fb76700 1 --2- 172.21.15.194:0/426306484 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f9ef402ff60 0x7f9ef4032420 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:48:14.546 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:14.549+0000 7f9f0fb76700 1 --2- 172.21.15.194:0/426306484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f080f5410 0x7f9f08105610 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:48:14.546 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:14.549+0000 7f9f0fb76700 1 -- 172.21.15.194:0/426306484 >> 172.21.15.194:0/426306484 conn(0x7f9f080f0b70 msgr2=0x7f9f080f1660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:48:14.546 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:14.549+0000 7f9f0fb76700 1 -- 172.21.15.194:0/426306484 shutdown_connections 2021-11-03T16:48:14.546 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:14.549+0000 7f9f0fb76700 1 -- 172.21.15.194:0/426306484 wait complete. 2021-11-03T16:48:14.547 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2021-11-03T16:48:14.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:14 smithi026 conmon[32119]: cluster 2021-11-03T16:48:12.987891+0000 mgr.smithi026.cnrxli (mgr.14162) 38 : cluster 2021-11-03T16:48:14.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:14 smithi026 conmon[32119]: [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:14.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:14 smithi026 conmon[32119]: audit 2021-11-03T16:48:13.856386+0000 mon.smithi026 (mon.0) 144 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:48:14.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:14 smithi026 conmon[32119]: audit 2021-11-03T16:48:13.859549+0000 mon.smithi026 (mon.0) 145 : 2021-11-03T16:48:14.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:14 smithi026 conmon[32119]: audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:48:14.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:14 smithi026 conmon[32119]: audit 2021-11-03T16:48:13.861208+0000 mon.smithi026 (mon.0) 146 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi194", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2021-11-03T16:48:14.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:14 smithi026 conmon[32119]: 2021-11-03T16:48:14.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:14 smithi026 conmon[32119]: audit 2021-11-03T16:48:13.863245+0000 2021-11-03T16:48:14.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:14 smithi026 conmon[32119]: mon.smithi026 (mon.0) 147 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi194", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2021-11-03T16:48:14.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:14 smithi026 conmon[32119]: audit 2021-11-03T16:48:14.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:14 smithi026 conmon[32119]: 2021-11-03T16:48:13.864194+0000 mon.smithi026 (mon.0) 148 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:48:15.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:15 smithi026 conmon[32119]: cephadm 2021-11-03T16:48:13.865073+0000 mgr.smithi026.cnrxli (mgr. 2021-11-03T16:48:15.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:15 smithi026 conmon[32119]: 14162) 39 : cephadm [INF] Deploying daemon crash.smithi194 on smithi194 2021-11-03T16:48:15.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:15 smithi026 conmon[32119]: audit 2021-11-03T16:48:14.547523+0000 mon.smithi026 (mon.0) 149 : audit [DBG] 2021-11-03T16:48:15.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:15 smithi026 conmon[32119]: from='client.? 172.21.15.194:0/426306484' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-11-03T16:48:16.310 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2021-11-03T16:48:16.311 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph mon dump -f json 2021-11-03T16:48:16.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:16 smithi026 conmon[32119]: cluster 2021-11-03T16:48:14.988195+0000 mgr.smithi026.cnrxli (mgr.14162) 40 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:18.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:17 smithi026 conmon[32119]: audit 2021-11-03T16:48:16.870947+0000 mon.smithi026 (mon.0) 150 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:48:18.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:17 smithi026 conmon[32119]: audit 2021-11-03T16:48:16.872621+0000 mon.smithi026 (mon.0) 151 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi194.wnexas", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-11-03T16:48:18.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:17 smithi026 conmon[32119]: audit 2021-11-03T16:48:16.874733+0000 mon.smithi026 (mon 2021-11-03T16:48:18.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:17 smithi026 conmon[32119]: .0) 152 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi194.wnexas", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-11-03T16:48:18.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:17 smithi026 conmon[32119]: audit 2021- 2021-11-03T16:48:18.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:17 smithi026 conmon[32119]: 11-03T16:48:16.875686+0000 2021-11-03T16:48:18.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:17 smithi026 conmon[32119]: mon.smithi026 (mon.0) 153 : audit 2021-11-03T16:48:18.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:17 smithi026 conmon[32119]: [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mgr services"}]: dispatch 2021-11-03T16:48:18.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:17 smithi026 conmon[32119]: audit 2021 2021-11-03T16:48:18.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:17 smithi026 conmon[32119]: -11-03T16:48:16.876777 2021-11-03T16:48:18.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:17 smithi026 conmon[32119]: +0000 mon.smithi026 (mon.0) 154 2021-11-03T16:48:18.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:17 smithi026 conmon[32119]: : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:48:18.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:17 smithi026 conmon[32119]: cephadm 2021 2021-11-03T16:48:18.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:17 smithi026 conmon[32119]: -11-03T16:48:16 2021-11-03T16:48:18.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:17 smithi026 conmon[32119]: .877594+0000 mgr.smithi026.cnrxli (mgr.14162 2021-11-03T16:48:18.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:17 smithi026 conmon[32119]: ) 41 : cephadm [INF] Deploying daemon mgr.smithi194.wnexas on smithi194 2021-11-03T16:48:18.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:17 smithi026 conmon[32119]: cluster 2021 2021-11-03T16:48:18.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:17 smithi026 conmon[32119]: -11-03T16:48:16. 2021-11-03T16:48:18.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:17 smithi026 conmon[32119]: 988486+0000 mgr.smithi026.cnrxli (mgr.14162 2021-11-03T16:48:18.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:17 smithi026 conmon[32119]: ) 42 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:18.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:17 smithi026 conmon[32119]: 2021-11-03T16:48:18.253 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:18.258+0000 7f855d5cf700 1 -- 172.21.15.194:0/2127668800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85580f62a0 msgr2=0x7f85580f66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:48:18.254 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:18.258+0000 7f855d5cf700 1 --2- 172.21.15.194:0/2127668800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85580f62a0 0x7f85580f66c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f8548009fb0 tx=0x7f8548009b30).stop 2021-11-03T16:48:18.254 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:18.258+0000 7f855d5cf700 1 -- 172.21.15.194:0/2127668800 shutdown_connections 2021-11-03T16:48:18.254 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:18.258+0000 7f855d5cf700 1 --2- 172.21.15.194:0/2127668800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85580f62a0 0x7f85580f66c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:48:18.255 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:18.258+0000 7f855d5cf700 1 -- 172.21.15.194:0/2127668800 >> 172.21.15.194:0/2127668800 conn(0x7f85580f1aa0 msgr2=0x7f85580f3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:48:18.255 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:18.258+0000 7f855d5cf700 1 -- 172.21.15.194:0/2127668800 shutdown_connections 2021-11-03T16:48:18.255 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:18.258+0000 7f855d5cf700 1 -- 172.21.15.194:0/2127668800 wait complete. 2021-11-03T16:48:18.255 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:18.258+0000 7f855d5cf700 1 Processor -- start 2021-11-03T16:48:18.257 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:18.258+0000 7f855d5cf700 1 -- start start 2021-11-03T16:48:18.257 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:18.259+0000 7f855d5cf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85580f62a0 0x7f855806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:48:18.258 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:18.259+0000 7f855d5cf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8558069e20 con 0x7f85580f62a0 2021-11-03T16:48:18.258 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:18.259+0000 7f8557fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85580f62a0 0x7f855806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:48:18.258 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:18.259+0000 7f8557fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85580f62a0 0x7f855806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.194:53220/0 (socket says 172.21.15.194:53220) 2021-11-03T16:48:18.258 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:18.259+0000 7f8557fff700 1 -- 172.21.15.194:0/1223733258 learned_addr learned my addr 172.21.15.194:0/1223733258 (peer_addr_for_me v2:172.21.15.194:0/0) 2021-11-03T16:48:18.259 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:18.259+0000 7f8557fff700 1 -- 172.21.15.194:0/1223733258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8548005040 con 0x7f85580f62a0 2021-11-03T16:48:18.259 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:18.259+0000 7f8557fff700 1 --2- 172.21.15.194:0/1223733258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85580f62a0 0x7f855806b9a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f8548009f80 tx=0x7f854800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:48:18.259 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:18.260+0000 7f8554ff9700 1 -- 172.21.15.194:0/1223733258 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8548009320 con 0x7f85580f62a0 2021-11-03T16:48:18.260 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:18.260+0000 7f855d5cf700 1 -- 172.21.15.194:0/1223733258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8558069fc0 con 0x7f85580f62a0 2021-11-03T16:48:18.260 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:18.260+0000 7f8554ff9700 1 -- 172.21.15.194:0/1223733258 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f8548013680 con 0x7f85580f62a0 2021-11-03T16:48:18.261 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:18.260+0000 7f8554ff9700 1 -- 172.21.15.194:0/1223733258 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f854801eda0 con 0x7f85580f62a0 2021-11-03T16:48:18.261 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:18.260+0000 7f855d5cf700 1 -- 172.21.15.194:0/1223733258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f855806a450 con 0x7f85580f62a0 2021-11-03T16:48:18.262 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:18.260+0000 7f8554ff9700 1 -- 172.21.15.194:0/1223733258 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f854801e420 con 0x7f85580f62a0 2021-11-03T16:48:18.262 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:18.261+0000 7f855d5cf700 1 -- 172.21.15.194:0/1223733258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8558059100 con 0x7f85580f62a0 2021-11-03T16:48:18.262 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:18.261+0000 7f8554ff9700 1 --2- 172.21.15.194:0/1223733258 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f854002ff60 0x7f8540032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:48:18.263 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:18.261+0000 7f8554ff9700 1 -- 172.21.15.194:0/1223733258 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f8548041130 con 0x7f85580f62a0 2021-11-03T16:48:18.263 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:18.261+0000 7f85577fe700 1 --2- 172.21.15.194:0/1223733258 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f854002ff60 0x7f8540032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:48:18.264 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:18.261+0000 7f85577fe700 1 --2- 172.21.15.194:0/1223733258 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f854002ff60 0x7f8540032420 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f854c0096a0 tx=0x7f854c006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:48:18.265 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:18.265+0000 7f8554ff9700 1 -- 172.21.15.194:0/1223733258 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f854801e780 con 0x7f85580f62a0 2021-11-03T16:48:18.480 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:18.485+0000 7f855d5cf700 1 -- 172.21.15.194:0/1223733258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8558045ad0 con 0x7f85580f62a0 2021-11-03T16:48:18.481 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:18.486+0000 7f8554ff9700 1 -- 172.21.15.194:0/1223733258 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7f854801cb10 con 0x7f85580f62a0 2021-11-03T16:48:18.482 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:48:18.482 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"70492bc6-3cc5-11ec-8c28-001a4aab830c","modified":"2021-11-03T16:45:59.385154Z","created":"2021-11-03T16:45:59.385154Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi026","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:3300","nonce":0},{"type":"v1","addr":"172.21.15.26:6789","nonce":0}]},"addr":"172.21.15.26:6789/0","public_addr":"172.21.15.26:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2021-11-03T16:48:18.483 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:18.487+0000 7f855d5cf700 1 -- 172.21.15.194:0/1223733258 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f854002ff60 msgr2=0x7f8540032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:48:18.483 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:18.487+0000 7f855d5cf700 1 --2- 172.21.15.194:0/1223733258 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f854002ff60 0x7f8540032420 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f854c0096a0 tx=0x7f854c006b40).stop 2021-11-03T16:48:18.483 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:18.487+0000 7f855d5cf700 1 -- 172.21.15.194:0/1223733258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85580f62a0 msgr2=0x7f855806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:48:18.484 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:18.487+0000 7f855d5cf700 1 --2- 172.21.15.194:0/1223733258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85580f62a0 0x7f855806b9a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f8548009f80 tx=0x7f854800b040).stop 2021-11-03T16:48:18.484 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:18.487+0000 7f855d5cf700 1 -- 172.21.15.194:0/1223733258 shutdown_connections 2021-11-03T16:48:18.484 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:18.487+0000 7f855d5cf700 1 --2- 172.21.15.194:0/1223733258 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f854002ff60 0x7f8540032420 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:48:18.484 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:18.487+0000 7f855d5cf700 1 --2- 172.21.15.194:0/1223733258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85580f62a0 0x7f855806b9a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:48:18.485 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:18.487+0000 7f855d5cf700 1 -- 172.21.15.194:0/1223733258 >> 172.21.15.194:0/1223733258 conn(0x7f85580f1aa0 msgr2=0x7f85580f2510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:48:18.485 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:18.488+0000 7f855d5cf700 1 -- 172.21.15.194:0/1223733258 shutdown_connections 2021-11-03T16:48:18.485 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:18.488+0000 7f855d5cf700 1 -- 172.21.15.194:0/1223733258 wait complete. 2021-11-03T16:48:18.486 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2021-11-03T16:48:19.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:18 smithi026 conmon[32119]: audit 2021-11-03T16:48:18.486620+0000 mon.smithi026 (mon.0) 155 : audit [DBG] from='client.? 172.21.15.194:0/1223733258' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-11-03T16:48:20.360 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2021-11-03T16:48:20.360 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph mon dump -f json 2021-11-03T16:48:20.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:19 smithi026 conmon[32119]: cluster 2021-11-03T16:48:18.988741+0000 mgr.smithi026.cnrxli (mgr. 2021-11-03T16:48:20.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:19 smithi026 conmon[32119]: 14162) 43 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:21.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:21 smithi026 conmon[32119]: audit 2021-11-03T16:48:20.121798+0000 mon.smithi026 (mon.0) 156 : audit 2021-11-03T16:48:21.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:21 smithi026 conmon[32119]: [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:48:21.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:21 smithi026 conmon[32119]: audit 2021-11-03T16:48:20.123338+0000 mon.smithi026 (mon.0) 2021-11-03T16:48:21.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:21 smithi026 conmon[32119]: 157 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-11-03T16:48:21.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:21 smithi026 conmon[32119]: audit 2021-11 2021-11-03T16:48:21.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:21 smithi026 conmon[32119]: -03T16:48:20.124305 2021-11-03T16:48:21.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:21 smithi026 conmon[32119]: +0000 mon.smithi026 (mon.0) 158 2021-11-03T16:48:21.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:21 smithi026 conmon[32119]: : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:48:21.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:21 smithi026 conmon[32119]: cephadm 2021-11 2021-11-03T16:48:21.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:21 smithi026 conmon[32119]: -03T16:48:20.125124+0000 mgr.smithi026.cnrxli 2021-11-03T16:48:21.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:21 smithi026 conmon[32119]: (mgr.14162) 44 : cephadm [INF] 2021-11-03T16:48:21.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:21 smithi026 conmon[32119]: Deploying daemon mon.smithi194 on smithi194 2021-11-03T16:48:22.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:22 smithi026 conmon[32119]: cluster 2021-11-03T16:48:20.989132+0000 mgr.smithi026.cnrxli (mgr.14162) 45 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:22.688 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:22.692+0000 7fb6d3264700 1 -- 172.21.15.194:0/3723086932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6cc0f5410 msgr2=0x7fb6cc0f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:48:22.689 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:22.692+0000 7fb6d3264700 1 --2- 172.21.15.194:0/3723086932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6cc0f5410 0x7fb6cc0f5830 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fb6c8009fb0 tx=0x7fb6c8009b30).stop 2021-11-03T16:48:22.689 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:22.692+0000 7fb6d3264700 1 -- 172.21.15.194:0/3723086932 shutdown_connections 2021-11-03T16:48:22.689 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:22.692+0000 7fb6d3264700 1 --2- 172.21.15.194:0/3723086932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6cc0f5410 0x7fb6cc0f5830 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:48:22.689 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:22.692+0000 7fb6d3264700 1 -- 172.21.15.194:0/3723086932 >> 172.21.15.194:0/3723086932 conn(0x7fb6cc0f0b70 msgr2=0x7fb6cc0f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:48:22.690 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:22.692+0000 7fb6d3264700 1 -- 172.21.15.194:0/3723086932 shutdown_connections 2021-11-03T16:48:22.690 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:22.692+0000 7fb6d3264700 1 -- 172.21.15.194:0/3723086932 wait complete. 2021-11-03T16:48:22.690 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:22.693+0000 7fb6d3264700 1 Processor -- start 2021-11-03T16:48:22.690 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:22.693+0000 7fb6d3264700 1 -- start start 2021-11-03T16:48:22.691 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:22.693+0000 7fb6d3264700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6cc0f5410 0x7fb6cc1093b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:48:22.691 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:22.693+0000 7fb6d3264700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc060240 con 0x7fb6cc0f5410 2021-11-03T16:48:22.693 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:22.693+0000 7fb6d1000700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6cc0f5410 0x7fb6cc1093b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:48:22.693 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:22.693+0000 7fb6d1000700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6cc0f5410 0x7fb6cc1093b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.194:53230/0 (socket says 172.21.15.194:53230) 2021-11-03T16:48:22.693 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:22.693+0000 7fb6d1000700 1 -- 172.21.15.194:0/1126871662 learned_addr learned my addr 172.21.15.194:0/1126871662 (peer_addr_for_me v2:172.21.15.194:0/0) 2021-11-03T16:48:22.694 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:22.694+0000 7fb6d1000700 1 -- 172.21.15.194:0/1126871662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c8005040 con 0x7fb6cc0f5410 2021-11-03T16:48:22.694 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:22.694+0000 7fb6d1000700 1 --2- 172.21.15.194:0/1126871662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6cc0f5410 0x7fb6cc1093b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fb6c80089f0 tx=0x7fb6c800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:48:22.694 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:22.694+0000 7fb6c17fa700 1 -- 172.21.15.194:0/1126871662 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb6c8009320 con 0x7fb6cc0f5410 2021-11-03T16:48:22.694 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:22.694+0000 7fb6c17fa700 1 -- 172.21.15.194:0/1126871662 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fb6c8013ec0 con 0x7fb6cc0f5410 2021-11-03T16:48:22.695 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:22.694+0000 7fb6d3264700 1 -- 172.21.15.194:0/1126871662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6cc060440 con 0x7fb6cc0f5410 2021-11-03T16:48:22.695 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:22.694+0000 7fb6c17fa700 1 -- 172.21.15.194:0/1126871662 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb6c8014d30 con 0x7fb6cc0f5410 2021-11-03T16:48:22.695 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:22.694+0000 7fb6d3264700 1 -- 172.21.15.194:0/1126871662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6cc109a60 con 0x7fb6cc0f5410 2021-11-03T16:48:22.695 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:22.695+0000 7fb6d3264700 1 -- 172.21.15.194:0/1126871662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6cc045ad0 con 0x7fb6cc0f5410 2021-11-03T16:48:22.696 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:22.695+0000 7fb6c17fa700 1 -- 172.21.15.194:0/1126871662 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7fb6c80263a0 con 0x7fb6cc0f5410 2021-11-03T16:48:22.696 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:22.695+0000 7fb6c17fa700 1 --2- 172.21.15.194:0/1126871662 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fb6b402ff60 0x7fb6b4032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:48:22.696 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:22.695+0000 7fb6c17fa700 1 -- 172.21.15.194:0/1126871662 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7fb6c8040fb0 con 0x7fb6cc0f5410 2021-11-03T16:48:22.696 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:22.696+0000 7fb6c3fff700 1 --2- 172.21.15.194:0/1126871662 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fb6b402ff60 0x7fb6b4032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:48:22.696 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:22.696+0000 7fb6c3fff700 1 --2- 172.21.15.194:0/1126871662 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fb6b402ff60 0x7fb6b4032420 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fb6bc0096a0 tx=0x7fb6bc006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:48:22.697 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:22.700+0000 7fb6c17fa700 1 -- 172.21.15.194:0/1126871662 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fb6c801db70 con 0x7fb6cc0f5410 2021-11-03T16:48:22.917 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:22.921+0000 7fb6d3264700 1 -- 172.21.15.194:0/1126871662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb6cc10a280 con 0x7fb6cc0f5410 2021-11-03T16:48:22.917 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:22.922+0000 7fb6c17fa700 1 -- 172.21.15.194:0/1126871662 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7fb6c801db70 con 0x7fb6cc0f5410 2021-11-03T16:48:22.918 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:48:22.918 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"70492bc6-3cc5-11ec-8c28-001a4aab830c","modified":"2021-11-03T16:45:59.385154Z","created":"2021-11-03T16:45:59.385154Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi026","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:3300","nonce":0},{"type":"v1","addr":"172.21.15.26:6789","nonce":0}]},"addr":"172.21.15.26:6789/0","public_addr":"172.21.15.26:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2021-11-03T16:48:22.919 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:22.923+0000 7fb6d3264700 1 -- 172.21.15.194:0/1126871662 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fb6b402ff60 msgr2=0x7fb6b4032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:48:22.920 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:22.923+0000 7fb6d3264700 1 --2- 172.21.15.194:0/1126871662 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fb6b402ff60 0x7fb6b4032420 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fb6bc0096a0 tx=0x7fb6bc006b40).stop 2021-11-03T16:48:22.920 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:22.923+0000 7fb6d3264700 1 -- 172.21.15.194:0/1126871662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6cc0f5410 msgr2=0x7fb6cc1093b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:48:22.920 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:22.923+0000 7fb6d3264700 1 --2- 172.21.15.194:0/1126871662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6cc0f5410 0x7fb6cc1093b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fb6c80089f0 tx=0x7fb6c800b040).stop 2021-11-03T16:48:22.920 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:22.924+0000 7fb6d3264700 1 -- 172.21.15.194:0/1126871662 shutdown_connections 2021-11-03T16:48:22.921 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:22.924+0000 7fb6d3264700 1 --2- 172.21.15.194:0/1126871662 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fb6b402ff60 0x7fb6b4032420 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:48:22.921 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:22.924+0000 7fb6d3264700 1 --2- 172.21.15.194:0/1126871662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6cc0f5410 0x7fb6cc1093b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:48:22.921 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:22.924+0000 7fb6d3264700 1 -- 172.21.15.194:0/1126871662 >> 172.21.15.194:0/1126871662 conn(0x7fb6cc0f0b70 msgr2=0x7fb6cc0f1610 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:48:22.921 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:22.924+0000 7fb6d3264700 1 -- 172.21.15.194:0/1126871662 shutdown_connections 2021-11-03T16:48:22.922 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:22.924+0000 7fb6d3264700 1 -- 172.21.15.194:0/1126871662 wait complete. 2021-11-03T16:48:22.922 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2021-11-03T16:48:23.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:23 smithi026 conmon[32119]: audit 2021-11-03T16:48:22.922690+0000 mon.smithi026 (mon.0) 159 : audit [DBG] from='client.? 172.21.15.194:0/1126871662' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-11-03T16:48:24.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:24 smithi026 conmon[32119]: cluster 2021-11-03T16:48:22.989363+0000 mgr.smithi026.cnrxli (mgr.14162) 46 2021-11-03T16:48:24.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:24 smithi026 conmon[32119]: : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:24.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:24 smithi194 systemd[1]: Started Ceph mon.smithi194 for 70492bc6-3cc5-11ec-8c28-001a4aab830c. 2021-11-03T16:48:24.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:24 smithi194 conmon[35111]: debug 2021-11-03T16:48:24.293+0000 7f1a05bd4700 0 mon.smithi194@-1(synchronizing).mds e1 new map 2021-11-03T16:48:24.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:24 smithi194 conmon[35111]: debug 2021-11-03T16:48:24.293+0000 7f1a05bd4700 0 mon.smithi194@-1(synchronizing).mds e1 print_map 2021-11-03T16:48:24.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:24 smithi194 conmon[35111]: e1 2021-11-03T16:48:24.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:24 smithi194 conmon[35111]: enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T16:48:24.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:24 smithi194 conmon[35111]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T16:48:24.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:24 smithi194 conmon[35111]: legacy client fscid: -1 2021-11-03T16:48:24.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:24 smithi194 conmon[35111]: 2021-11-03T16:48:24.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:24 smithi194 conmon[35111]: No filesystems configured 2021-11-03T16:48:24.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:24 smithi194 conmon[35111]: 2021-11-03T16:48:24.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:24 smithi194 conmon[35111]: debug 2021-11-03T16:48:24.293+0000 7f1a05bd4700 1 mon.smithi194@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2021-11-03T16:48:24.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:24 smithi194 conmon[35111]: debug 2021-11-03T16:48:24.294+0000 7f1a05bd4700 1 mon.smithi194@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2021-11-03T16:48:24.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:24 smithi194 conmon[35111]: debug 2021-11-03T16:48:24.294+0000 7f1a05bd4700 1 mon.smithi194@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2021-11-03T16:48:24.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:24 smithi194 conmon[35111]: debug 2021-11-03T16:48:24.294+0000 7f1a05bd4700 1 mon.smithi194@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2021-11-03T16:48:24.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:24 smithi194 conmon[35111]: debug 2021-11-03T16:48:24.294+0000 7f1a05bd4700 1 mon.smithi194@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2021-11-03T16:48:24.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:24 smithi194 conmon[35111]: debug 2021-11-03T16:48:24.294+0000 7f1a05bd4700 1 mon.smithi194@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2021-11-03T16:48:24.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:24 smithi194 conmon[35111]: debug 2021-11-03T16:48:24.294+0000 7f1a05bd4700 1 mon.smithi194@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2021-11-03T16:48:24.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:24 smithi194 conmon[35111]: debug 2021-11-03T16:48:24.296+0000 7f1a05bd4700 0 mon.smithi194@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2021-11-03T16:48:24.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:24 smithi194 conmon[35111]: debug 2021-11-03T16:48:24.296+0000 7f1a05bd4700 0 mon.smithi194@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2021-11-03T16:48:24.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:24 smithi194 conmon[35111]: debug 2021-11-03T16:48:24.296+0000 7f1a05bd4700 0 mon.smithi194@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2021-11-03T16:48:24.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:24 smithi194 conmon[35111]: debug 2021-11-03T16:48:24.296+0000 7f1a05bd4700 0 mon.smithi194@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2021-11-03T16:48:24.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:24 smithi194 conmon[35111]: cluster 2021 2021-11-03T16:48:24.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:24 smithi194 conmon[35111]: -11-03T16:48:22.989363+0000 mgr.smithi026.cnrxli (mgr 2021-11-03T16:48:24.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:24 smithi194 conmon[35111]: .14162) 46 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:24.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:24 smithi194 conmon[35111]: debug 2021-11-03T16:48:24.296+0000 7f1a05bd4700 1 mon.smithi194@-1(synchronizing).paxosservice(auth 1..7) refresh upgraded, format 0 -> 3 2021-11-03T16:48:24.876 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2021-11-03T16:48:24.877 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph mon dump -f json 2021-11-03T16:48:29.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: audit 2021-11-03T16:48:24.304252+0000 mon.smithi026 (mon.0) 161 : audit [DBG] 2021-11-03T16:48:29.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata", "id": "smithi026"}]: dispatch 2021-11-03T16:48:29.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: cluster 2021-11-03T16:48:24.304502+0000 mon.smithi026 (mon.0) 162 : cluster [INF] mon.smithi026 calling monitor election 2021-11-03T16:48:29.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: audit 2021-11-03T 2021-11-03T16:48:29.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: 16:48:24.317652+0000 mon.smithi026 (mon.0) 163 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2021-11-03T16:48:29.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: cluster 2021-11-03T16 2021-11-03T16:48:29.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: :48:24.989733+0000 mgr.smithi026.cnrxli (mgr.14162 2021-11-03T16:48:29.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: ) 47 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:29.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: audit 2021-11 2021-11-03T16:48:29.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: -03T16:48:25.295733+0000 2021-11-03T16:48:29.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: mon.smithi026 (mon.0) 164 : audit [DBG] from='mgr.? 172.21.15.194:0/3064840434' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.wnexas/crt"}]: dispatch 2021-11-03T16:48:29.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: 2021-11-03T16:48:29.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: audit 2021-11-03T16:48:29.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: 2021-11-03T16:48:25.301403+0000 mon.smithi026 ( 2021-11-03T16:48:29.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: mon.0) 165 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2021-11-03T16:48:29.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: audit 2021-11-03 2021-11-03T16:48:29.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: T16:48:26.301135+0000 mon.smithi026 (mon 2021-11-03T16:48:29.677 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: .0) 166 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2021-11-03T16:48:29.677 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: cluster 2021- 2021-11-03T16:48:29.677 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: 11-03T16:48:26.302497+0000 2021-11-03T16:48:29.677 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: mon.smithi194 (mon.1) 1 : cluster [INF] 2021-11-03T16:48:29.678 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: mon.smithi194 calling monitor election 2021-11-03T16:48:29.678 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: cluster 2021-11-03T16: 2021-11-03T16:48:29.678 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: 48:26.990048+0000 mgr.smithi026.cnrxli (mgr.14162 2021-11-03T16:48:29.679 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: ) 48 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:29.679 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: audit 2021-11 2021-11-03T16:48:29.679 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: -03T16:48:27.301342+0000 mon.smithi026 2021-11-03T16:48:29.679 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: (mon.0) 167 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2021-11-03T16:48:29.679 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: 2021-11-03T16:48:29.680 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: audit 2021-11-03T16:48:29.680 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: 2021-11-03T16:48:28.301418+0000 2021-11-03T16:48:29.680 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: mon.smithi026 (mon.0) 168 : audit [DBG] 2021-11-03T16:48:29.680 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2021-11-03T16:48:29.681 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: cluster 2021-11-03T16:48 2021-11-03T16:48:29.681 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: :28.990390+0000 mgr.smithi026.cnrxli (mgr.14162) 49 2021-11-03T16:48:29.681 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:29.681 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: audit 2021-11-03 2021-11-03T16:48:29.682 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: T16:48:29.301483+0000 mon.smithi026 2021-11-03T16:48:29.682 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: (mon.0) 169 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2021-11-03T16:48:29.682 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: cluster 2021- 2021-11-03T16:48:29.682 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: 11-03T16:48:29.320130 2021-11-03T16:48:29.683 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: +0000 mon.smithi026 (mon.0) 170 : cluster [INF] 2021-11-03T16:48:29.683 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: mon.smithi026 is new leader, mons smithi026,smithi194 in quorum (ranks 0,1) 2021-11-03T16:48:29.683 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: cluster 2021-11-03T16:48 2021-11-03T16:48:29.683 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: :29.323415+0000 mon.smithi026 (mon.0) 2021-11-03T16:48:29.684 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: 171 : cluster [DBG] monmap e2: 2 mons at {smithi026=[v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0],smithi194=[v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0]} 2021-11-03T16:48:29.684 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: cluster 2021-11-03 2021-11-03T16:48:29.684 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: T16:48:29.323488+0000 mon.smithi026 (mon 2021-11-03T16:48:29.684 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: .0) 172 : cluster [DBG] fsmap 2021-11-03T16:48:29.684 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: cluster 2021 2021-11-03T16:48:29.685 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: -11-03T16:48:29.323534 2021-11-03T16:48:29.685 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: +0000 mon.smithi026 (mon.0) 173 : cluster 2021-11-03T16:48:29.685 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: [DBG] osdmap e5: 0 total, 0 up, 0 in 2021-11-03T16:48:29.686 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: cluster 2021-11-03T16 2021-11-03T16:48:29.686 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: :48:29.323796+0000 mon.smithi026 (mon 2021-11-03T16:48:29.686 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: .0) 174 : cluster [DBG] mgrmap e17: smithi026.cnrxli(active, since 81s) 2021-11-03T16:48:29.686 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: cluster 2021- 2021-11-03T16:48:29.687 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: 11-03T16:48:29.324835+0000 mon.smithi026 (mon.0) 175 : cluster 2021-11-03T16:48:29.687 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: [DBG] Standby manager daemon smithi194.wnexas started 2021-11-03T16:48:29.687 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: cluster 2021-11-03T16:48:29 2021-11-03T16:48:29.687 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: .328201+0000 mon.smithi026 (mon.0) 176 : cluster 2021-11-03T16:48:29.687 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: [INF] overall HEALTH_OK 2021-11-03T16:48:29.688 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: audit 2021-11-03T 2021-11-03T16:48:29.688 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: 16:48:29.328547+0000 mon.smithi026 (mon. 2021-11-03T16:48:29.688 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: 0) 177 : audit [DBG] from='mgr.? 172.21.15.194:0/3064840434' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-11-03T16:48:29.688 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: audit 2021-11 2021-11-03T16:48:29.688 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: -03T16:48:29.330472+0000 2021-11-03T16:48:29.689 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: mon.smithi026 (mon.0) 178 : audit [INF] 2021-11-03T16:48:29.689 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:48:29.689 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: audit 2021-11-03T16:48 2021-11-03T16:48:29.689 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: :29.330809+0000 mon.smithi026 (mon.0 2021-11-03T16:48:29.690 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: ) 179 : audit [DBG] from='mgr.? 172.21.15.194:0/3064840434' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.wnexas/key"}]: dispatch 2021-11-03T16:48:29.690 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: audit 2021-11- 2021-11-03T16:48:29.690 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: 03T16:48:29.331404+0000 mon.smithi026 ( 2021-11-03T16:48:29.690 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: mon.0) 180 : audit [DBG] from='mgr.? 172.21.15.194:0/3064840434' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-11-03T16:48:29.691 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:29 smithi026 conmon[32119]: 2021-11-03T16:48:29.732 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:29 smithi194 conmon[35111]: audit 2021-11-03T16:48:24.304252+0000 mon.smithi026 (mon.0 2021-11-03T16:48:29.732 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:29 smithi194 conmon[35111]: ) 161 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata", "id": "smithi026"}]: dispatch 2021-11-03T16:48:29.732 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:29 smithi194 conmon[35111]: cluster 2021-11-03T16:48:24.304502+0000 mon.smithi026 (mon.0) 162 : cluster [INF] mon.smithi026 calling monitor election 2021-11-03T16:48:29.732 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:29 smithi194 conmon[35111]: audit 2021-11-03T16:48:24.317652+0000 mon.smithi026 (mon.0) 163 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2021-11-03T16:48:29.733 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:29 smithi194 conmon[35111]: cluster 2021-11-03T16:48:24.989733+0000 mgr.smithi026.cnrxli (mgr.14162) 47 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:29.733 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:29 smithi194 conmon[35111]: audit 2021-11-03T16:48:25.295733+0000 mon.smithi026 (mon.0) 164 : audit [DBG] from='mgr.? 172.21.15.194:0/3064840434' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.wnexas/crt"}]: dispatch 2021-11-03T16:48:29.733 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:29 smithi194 conmon[35111]: audit 2021-11-03T16:48:25.301403+0000 mon.smithi026 (mon.0) 165 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2021-11-03T16:48:29.733 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:29 smithi194 conmon[35111]: audit 2021-11-03T16:48:26.301135+0000 mon.smithi026 (mon.0) 166 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2021-11-03T16:48:29.734 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:29 smithi194 conmon[35111]: cluster 2021-11-03T16:48:26.302497+0000 mon.smithi194 (mon.1) 1 : cluster [INF] mon.smithi194 calling monitor election 2021-11-03T16:48:29.734 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:29 smithi194 conmon[35111]: cluster 2021-11-03T16:48:26.990048+0000 mgr.smithi026.cnrxli (mgr.14162) 48 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:29.734 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:29 smithi194 conmon[35111]: audit 2021-11-03T16:48:27.301342+0000 mon.smithi026 (mon.0) 167 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2021-11-03T16:48:29.735 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:29 smithi194 conmon[35111]: audit 2021-11-03T16:48:28.301418+0000 mon.smithi026 (mon.0) 168 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2021-11-03T16:48:29.735 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:29 smithi194 conmon[35111]: cluster 2021-11-03T16:48:28.990390+0000 mgr.smithi026.cnrxli (mgr.14162) 49 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:29.735 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:29 smithi194 conmon[35111]: audit 2021-11-03T16:48:29.301483+0000 mon.smithi026 (mon.0) 169 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2021-11-03T16:48:29.735 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:29 smithi194 conmon[35111]: cluster 2021-11-03T16:48:29.320130+0000 mon.smithi026 (mon.0) 170 : cluster [INF] mon.smithi026 is new leader, mons smithi026,smithi194 in quorum (ranks 0,1) 2021-11-03T16:48:29.736 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:29 smithi194 conmon[35111]: cluster 2021-11-03T16:48:29.323415+0000 mon.smithi026 (mon.0) 171 : cluster [DBG] monmap e2: 2 mons at {smithi026=[v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0],smithi194=[v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0]} 2021-11-03T16:48:29.736 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:29 smithi194 conmon[35111]: cluster 2021-11-03T16:48:29.323488+0000 mon.smithi026 (mon.0) 172 : cluster [DBG] fsmap 2021-11-03T16:48:29.736 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:29 smithi194 conmon[35111]: cluster 2021-11-03T16:48:29.323534+0000 mon.smithi026 (mon.0) 173 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2021-11-03T16:48:29.736 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:29 smithi194 conmon[35111]: cluster 2021-11-03T16:48:29.323796+0000 mon.smithi026 (mon.0) 174 : cluster [DBG] mgrmap e17: smithi026.cnrxli(active, since 81s) 2021-11-03T16:48:29.737 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:29 smithi194 conmon[35111]: cluster 2021-11-03T16:48:29.324835+0000 mon.smithi026 (mon.0) 175 : cluster [DBG] Standby manager daemon smithi194.wnexas started 2021-11-03T16:48:29.737 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:29 smithi194 conmon[35111]: cluster 2021-11-03T16:48:29.328201+0000 mon.smithi026 (mon.0) 176 : cluster [INF] overall HEALTH_OK 2021-11-03T16:48:29.737 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:29 smithi194 conmon[35111]: audit 2021-11-03T16:48:29.737 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:29 smithi194 conmon[35111]: 2021-11-03T16:48:29.328547+0000 mon.smithi026 (mon.0) 177 : audit [DBG] from='mgr.? 172.21.15.194:0/3064840434' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-11-03T16:48:29.737 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:29 smithi194 conmon[35111]: audit 2021-11-03T16:48:29.330472+0000 mon.smithi026 (mon.0) 178 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:48:29.738 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:29 smithi194 conmon[35111]: audit 2021-11-03T16:48:29.330809+0000 mon.smithi026 (mon.0) 179 : audit [DBG] from='mgr.? 172.21.15.194:0/3064840434' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.wnexas/key"}]: dispatch 2021-11-03T16:48:29.738 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:29 smithi194 conmon[35111]: audit 2021-11-03T16:48:29.738 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:29 smithi194 conmon[35111]: 2021-11-03T16:48:29.331404+0000 mon.smithi026 (mon.0) 180 : audit [DBG] from='mgr.? 172.21.15.194:0/3064840434' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-11-03T16:48:29.753 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:29.756+0000 7f9e968a0700 1 -- 172.21.15.194:0/2500389484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e78003250 msgr2=0x7f9e780056e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:48:29.753 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:29.756+0000 7f9e968a0700 1 --2- 172.21.15.194:0/2500389484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e78003250 0x7f9e780056e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f9e900f72c0 tx=0x7f9e8000b040).stop 2021-11-03T16:48:29.753 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:29.756+0000 7f9e968a0700 1 -- 172.21.15.194:0/2500389484 shutdown_connections 2021-11-03T16:48:29.754 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:29.756+0000 7f9e968a0700 1 --2- 172.21.15.194:0/2500389484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e78003250 0x7f9e780056e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:48:29.754 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:29.756+0000 7f9e968a0700 1 -- 172.21.15.194:0/2500389484 >> 172.21.15.194:0/2500389484 conn(0x7f9e900f1c70 msgr2=0x7f9e900f4090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:48:29.754 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:29.756+0000 7f9e968a0700 1 -- 172.21.15.194:0/2500389484 shutdown_connections 2021-11-03T16:48:29.754 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:29.756+0000 7f9e968a0700 1 -- 172.21.15.194:0/2500389484 wait complete. 2021-11-03T16:48:29.757 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:29.758+0000 7f9e968a0700 1 Processor -- start 2021-11-03T16:48:29.757 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:29.758+0000 7f9e968a0700 1 -- start start 2021-11-03T16:48:29.758 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:29.758+0000 7f9e968a0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e78003250 0x7f9e90106680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:48:29.758 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:29.758+0000 7f9e968a0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e90106b70 0x7f9e90107a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:48:29.758 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:29.758+0000 7f9e968a0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e901070d0 con 0x7f9e78003250 2021-11-03T16:48:29.758 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:29.758+0000 7f9e968a0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e90107210 con 0x7f9e90106b70 2021-11-03T16:48:29.759 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:29.758+0000 7f9e8f7fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e90106b70 0x7f9e90107a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:48:29.759 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:29.758+0000 7f9e8f7fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e90106b70 0x7f9e90107a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:34060/0 (socket says 172.21.15.194:34060) 2021-11-03T16:48:29.759 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:29.758+0000 7f9e8f7fe700 1 -- 172.21.15.194:0/3540160884 learned_addr learned my addr 172.21.15.194:0/3540160884 (peer_addr_for_me v2:172.21.15.194:0/0) 2021-11-03T16:48:29.759 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:29.759+0000 7f9e8ffff700 1 --2- 172.21.15.194:0/3540160884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e78003250 0x7f9e90106680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:48:29.760 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:29.759+0000 7f9e8f7fe700 1 -- 172.21.15.194:0/3540160884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e90106b70 msgr2=0x7f9e90107a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2021-11-03T16:48:29.760 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:29.759+0000 7f9e8f7fe700 1 -- 172.21.15.194:0/3540160884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e90106b70 msgr2=0x7f9e90107a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-11-03T16:48:29.760 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:29.759+0000 7f9e8f7fe700 1 --2- 172.21.15.194:0/3540160884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e90106b70 0x7f9e90107a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-11-03T16:48:29.760 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:29.759+0000 7f9e8f7fe700 1 --2- 172.21.15.194:0/3540160884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e90106b70 0x7f9e90107a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-11-03T16:48:29.760 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:29.759+0000 7f9e8ffff700 1 -- 172.21.15.194:0/3540160884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e90106b70 msgr2=0x7f9e90107a60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-11-03T16:48:29.761 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:29.759+0000 7f9e8ffff700 1 --2- 172.21.15.194:0/3540160884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e90106b70 0x7f9e90107a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:48:29.761 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:29.759+0000 7f9e8ffff700 1 -- 172.21.15.194:0/3540160884 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e80005040 con 0x7f9e78003250 2021-11-03T16:48:29.761 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:29.759+0000 7f9e8ffff700 1 --2- 172.21.15.194:0/3540160884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e78003250 0x7f9e90106680 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f9e8000b010 tx=0x7f9e8000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:48:29.761 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:29.759+0000 7f9e8cff9700 1 -- 172.21.15.194:0/3540160884 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e80004c30 con 0x7f9e78003250 2021-11-03T16:48:29.762 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:29.759+0000 7f9e8cff9700 1 -- 172.21.15.194:0/3540160884 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f9e80004d90 con 0x7f9e78003250 2021-11-03T16:48:29.762 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:29.759+0000 7f9e8cff9700 1 -- 172.21.15.194:0/3540160884 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e8001e5f0 con 0x7f9e78003250 2021-11-03T16:48:29.762 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:29.759+0000 7f9e968a0700 1 -- 172.21.15.194:0/3540160884 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e90108010 con 0x7f9e78003250 2021-11-03T16:48:29.762 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:29.759+0000 7f9e968a0700 1 -- 172.21.15.194:0/3540160884 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e901085d0 con 0x7f9e78003250 2021-11-03T16:48:29.762 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:29.761+0000 7f9e968a0700 1 -- 172.21.15.194:0/3540160884 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e90045ad0 con 0x7f9e78003250 2021-11-03T16:48:29.763 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:29.761+0000 7f9e8cff9700 1 -- 172.21.15.194:0/3540160884 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f9e8002f070 con 0x7f9e78003250 2021-11-03T16:48:29.763 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:29.761+0000 7f9e8cff9700 1 --2- 172.21.15.194:0/3540160884 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f9e7c05c400 0x7f9e7c05e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:48:29.763 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:29.761+0000 7f9e8cff9700 1 -- 172.21.15.194:0/3540160884 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f9e800772f0 con 0x7f9e78003250 2021-11-03T16:48:29.763 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:29.761+0000 7f9e8f7fe700 1 --2- 172.21.15.194:0/3540160884 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f9e7c05c400 0x7f9e7c05e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:48:29.764 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:29.762+0000 7f9e8f7fe700 1 --2- 172.21.15.194:0/3540160884 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f9e7c05c400 0x7f9e7c05e8c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f9e84006cf0 tx=0x7f9e84008040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:48:29.764 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:29.766+0000 7f9e8cff9700 1 -- 172.21.15.194:0/3540160884 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f9e8004b060 con 0x7f9e78003250 2021-11-03T16:48:30.003 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:30.007+0000 7f9e968a0700 1 -- 172.21.15.194:0/3540160884 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f9e90108840 con 0x7f9e78003250 2021-11-03T16:48:30.004 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:30.008+0000 7f9e8cff9700 1 -- 172.21.15.194:0/3540160884 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+968 (secure 0 0 0) 0x7f9e80023020 con 0x7f9e78003250 2021-11-03T16:48:30.004 INFO:teuthology.orchestra.run.smithi194.stdout: 2021-11-03T16:48:30.004 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":2,"fsid":"70492bc6-3cc5-11ec-8c28-001a4aab830c","modified":"2021-11-03T16:48:24.301611Z","created":"2021-11-03T16:45:59.385154Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi026","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:3300","nonce":0},{"type":"v1","addr":"172.21.15.26:6789","nonce":0}]},"addr":"172.21.15.26:6789/0","public_addr":"172.21.15.26:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi194","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2021-11-03T16:48:30.005 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:30.009+0000 7f9e968a0700 1 -- 172.21.15.194:0/3540160884 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f9e7c05c400 msgr2=0x7f9e7c05e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:48:30.006 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:30.009+0000 7f9e968a0700 1 --2- 172.21.15.194:0/3540160884 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f9e7c05c400 0x7f9e7c05e8c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f9e84006cf0 tx=0x7f9e84008040).stop 2021-11-03T16:48:30.006 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:30.009+0000 7f9e968a0700 1 -- 172.21.15.194:0/3540160884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e78003250 msgr2=0x7f9e90106680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:48:30.006 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:30.009+0000 7f9e968a0700 1 --2- 172.21.15.194:0/3540160884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e78003250 0x7f9e90106680 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f9e8000b010 tx=0x7f9e8000b040).stop 2021-11-03T16:48:30.006 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:30.010+0000 7f9e968a0700 1 -- 172.21.15.194:0/3540160884 shutdown_connections 2021-11-03T16:48:30.007 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:30.010+0000 7f9e968a0700 1 --2- 172.21.15.194:0/3540160884 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f9e7c05c400 0x7f9e7c05e8c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:48:30.007 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:30.010+0000 7f9e968a0700 1 --2- 172.21.15.194:0/3540160884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e78003250 0x7f9e90106680 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:48:30.007 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:30.010+0000 7f9e968a0700 1 --2- 172.21.15.194:0/3540160884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e90106b70 0x7f9e90107a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:48:30.007 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:30.010+0000 7f9e968a0700 1 -- 172.21.15.194:0/3540160884 >> 172.21.15.194:0/3540160884 conn(0x7f9e900f1c70 msgr2=0x7f9e900fae40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:48:30.008 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:30.010+0000 7f9e968a0700 1 -- 172.21.15.194:0/3540160884 shutdown_connections 2021-11-03T16:48:30.008 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:48:30.010+0000 7f9e968a0700 1 -- 172.21.15.194:0/3540160884 wait complete. 2021-11-03T16:48:30.008 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 2 2021-11-03T16:48:30.629 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:30 smithi194 conmon[35111]: cephadm 2021-11-03T16:48:29.331704+0000 mgr.smithi026.cnrxli (mgr.14162) 50 : cephadm [INF] Deploying daemon node-exporter.smithi194 on smithi194 2021-11-03T16:48:30.629 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:30 smithi194 conmon[35111]: cluster 2021-11-03T16:48:29.384269+0000 mon.smithi026 (mon.0) 181 : cluster [DBG] mgrmap e18: smithi026.cnrxli(active, since 81s), standbys: smithi194.wnexas 2021-11-03T16:48:30.629 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:30 smithi194 conmon[35111]: audit 2021-11-03T16:48:29.384464+0000 mon.smithi026 (mon.0) 182 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mgr metadata", "who": "smithi194.wnexas", "id": "smithi194.wnexas"}]: dispatch 2021-11-03T16:48:30.630 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:30 smithi194 conmon[35111]: audit 2021-11-03T16:48:30.008756+0000 mon.smithi026 (mon.0) 183 : audit [DBG] from='client.? 172.21.15.194:0/3540160884' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-11-03T16:48:30.630 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:30 smithi194 conmon[35111]: audit 2021-11-03T16:48:30.301646+0000 mon.smithi026 (mon.0) 184 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2021-11-03T16:48:30.651 INFO:tasks.cephadm:Generating final ceph.conf file... 2021-11-03T16:48:30.652 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph config generate-minimal-conf 2021-11-03T16:48:30.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:30 smithi026 conmon[32119]: cephadm 2021-11-03T16:48:29.331704+0000 mgr.smithi026.cnrxli (mgr.14162) 50 : cephadm 2021-11-03T16:48:30.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:30 smithi026 conmon[32119]: [INF] Deploying daemon node-exporter.smithi194 on smithi194 2021-11-03T16:48:30.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:30 smithi026 conmon[32119]: cluster 2021-11-03T16:48:29.384269+0000 mon.smithi026 (mon.0) 181 : cluster [DBG] mgrmap e18: smithi026.cnrxli(active, since 81s), standbys: smithi194.wnexas 2021-11-03T16:48:30.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:30 smithi026 conmon[32119]: audit 2021-11-03T16:48:29.384464+0000 mon.smithi026 (mon.0) 182 : audit 2021-11-03T16:48:30.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:30 smithi026 conmon[32119]: [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mgr metadata", "who": "smithi194.wnexas", "id": "smithi194.wnexas"}]: dispatch 2021-11-03T16:48:30.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:30 smithi026 conmon[32119]: audit 2021-11-03T16:48:30.008756+0000 mon.smithi026 (mon.0) 183 : audit [DBG] from='client.? 172.21.15.194:0/3540160884' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-11-03T16:48:30.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:30 smithi026 conmon[32119]: audit 2021-11-03T16:48:30.301646+0000 mon.smithi026 (mon.0) 184 : 2021-11-03T16:48:30.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:30 smithi026 conmon[32119]: audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2021-11-03T16:48:31.640 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:31 smithi026 conmon[32119]: cluster 2021-11-03T16:48:30.990708+0000 mgr.smithi026.cnrxli (mgr.14162) 51 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:31.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:31 smithi194 conmon[35111]: cluster 2021-11-03T16:48:30.990708+0000 mgr.smithi026.cnrxli (mgr.14162) 51 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:32.654 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.654+0000 7efe72470700 1 -- 172.21.15.26:0/2000747089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe6c0f5410 msgr2=0x7efe6c0f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:48:32.654 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.654+0000 7efe72470700 1 --2- 172.21.15.26:0/2000747089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe6c0f5410 0x7efe6c0f5830 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7efe5c009fb0 tx=0x7efe5c009b30).stop 2021-11-03T16:48:32.655 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.655+0000 7efe72470700 1 -- 172.21.15.26:0/2000747089 shutdown_connections 2021-11-03T16:48:32.655 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.655+0000 7efe72470700 1 --2- 172.21.15.26:0/2000747089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe6c0f5410 0x7efe6c0f5830 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:48:32.655 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.655+0000 7efe72470700 1 -- 172.21.15.26:0/2000747089 >> 172.21.15.26:0/2000747089 conn(0x7efe6c0f0b70 msgr2=0x7efe6c0f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:48:32.655 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.655+0000 7efe72470700 1 -- 172.21.15.26:0/2000747089 shutdown_connections 2021-11-03T16:48:32.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.655+0000 7efe72470700 1 -- 172.21.15.26:0/2000747089 wait complete. 2021-11-03T16:48:32.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.655+0000 7efe72470700 1 Processor -- start 2021-11-03T16:48:32.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.656+0000 7efe72470700 1 -- start start 2021-11-03T16:48:32.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.656+0000 7efe72470700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe6c0f5410 0x7efe6c1094a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:48:32.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.656+0000 7efe72470700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe6c060220 0x7efe6c10b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:48:32.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.656+0000 7efe72470700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6c10bf70 con 0x7efe6c060220 2021-11-03T16:48:32.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.656+0000 7efe72470700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6c10c0b0 con 0x7efe6c0f5410 2021-11-03T16:48:32.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.656+0000 7efe6b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe6c060220 0x7efe6c10b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:48:32.658 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.656+0000 7efe6b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe6c060220 0x7efe6c10b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49512/0 (socket says 172.21.15.26:49512) 2021-11-03T16:48:32.658 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.656+0000 7efe6b7fe700 1 -- 172.21.15.26:0/651566252 learned_addr learned my addr 172.21.15.26:0/651566252 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:48:32.658 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.656+0000 7efe6bfff700 1 --2- 172.21.15.26:0/651566252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe6c0f5410 0x7efe6c1094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:48:32.658 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.656+0000 7efe6b7fe700 1 -- 172.21.15.26:0/651566252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe6c0f5410 msgr2=0x7efe6c1094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:48:32.659 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.656+0000 7efe6b7fe700 1 --2- 172.21.15.26:0/651566252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe6c0f5410 0x7efe6c1094a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:48:32.659 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.656+0000 7efe6b7fe700 1 -- 172.21.15.26:0/651566252 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe5c005040 con 0x7efe6c060220 2021-11-03T16:48:32.659 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.656+0000 7efe6b7fe700 1 --2- 172.21.15.26:0/651566252 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe6c060220 0x7efe6c10b9a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7efe600093c0 tx=0x7efe60006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:48:32.659 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.657+0000 7efe68ff9700 1 -- 172.21.15.26:0/651566252 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe6000e650 con 0x7efe6c060220 2021-11-03T16:48:32.660 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.657+0000 7efe68ff9700 1 -- 172.21.15.26:0/651566252 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7efe6000ec40 con 0x7efe6c060220 2021-11-03T16:48:32.660 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.657+0000 7efe72470700 1 -- 172.21.15.26:0/651566252 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe6c10c390 con 0x7efe6c060220 2021-11-03T16:48:32.660 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.657+0000 7efe68ff9700 1 -- 172.21.15.26:0/651566252 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe60011bb0 con 0x7efe6c060220 2021-11-03T16:48:32.661 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.657+0000 7efe72470700 1 -- 172.21.15.26:0/651566252 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe6c10c8d0 con 0x7efe6c060220 2021-11-03T16:48:32.661 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.658+0000 7efe72470700 1 -- 172.21.15.26:0/651566252 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe6c045ad0 con 0x7efe6c060220 2021-11-03T16:48:32.662 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.658+0000 7efe68ff9700 1 -- 172.21.15.26:0/651566252 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7efe60018030 con 0x7efe6c060220 2021-11-03T16:48:32.662 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.658+0000 7efe68ff9700 1 --2- 172.21.15.26:0/651566252 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7efe5405c400 0x7efe5405e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:48:32.663 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.658+0000 7efe68ff9700 1 -- 172.21.15.26:0/651566252 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7efe60074910 con 0x7efe6c060220 2021-11-03T16:48:32.663 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.659+0000 7efe6bfff700 1 --2- 172.21.15.26:0/651566252 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7efe5405c400 0x7efe5405e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:48:32.663 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.659+0000 7efe6bfff700 1 --2- 172.21.15.26:0/651566252 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7efe5405c400 0x7efe5405e8c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7efe5c004dd0 tx=0x7efe5c00b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:48:32.663 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.664+0000 7efe68ff9700 1 -- 172.21.15.26:0/651566252 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7efe600452b0 con 0x7efe6c060220 2021-11-03T16:48:32.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.835+0000 7efe72470700 1 -- 172.21.15.26:0/651566252 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7efe6c10d190 con 0x7efe6c060220 2021-11-03T16:48:32.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.835+0000 7efe68ff9700 1 -- 172.21.15.26:0/651566252 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v12) v1 ==== 76+0+225 (secure 0 0 0) 0x7efe60016020 con 0x7efe6c060220 2021-11-03T16:48:32.832 INFO:teuthology.orchestra.run.smithi026.stdout:# minimal ceph.conf for 70492bc6-3cc5-11ec-8c28-001a4aab830c 2021-11-03T16:48:32.832 INFO:teuthology.orchestra.run.smithi026.stdout:[global] 2021-11-03T16:48:32.833 INFO:teuthology.orchestra.run.smithi026.stdout: fsid = 70492bc6-3cc5-11ec-8c28-001a4aab830c 2021-11-03T16:48:32.833 INFO:teuthology.orchestra.run.smithi026.stdout: mon_host = [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2021-11-03T16:48:32.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.837+0000 7efe72470700 1 -- 172.21.15.26:0/651566252 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7efe5405c400 msgr2=0x7efe5405e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:48:32.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.837+0000 7efe72470700 1 --2- 172.21.15.26:0/651566252 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7efe5405c400 0x7efe5405e8c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7efe5c004dd0 tx=0x7efe5c00b040).stop 2021-11-03T16:48:32.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.837+0000 7efe72470700 1 -- 172.21.15.26:0/651566252 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe6c060220 msgr2=0x7efe6c10b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:48:32.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.837+0000 7efe72470700 1 --2- 172.21.15.26:0/651566252 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe6c060220 0x7efe6c10b9a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7efe600093c0 tx=0x7efe60006ee0).stop 2021-11-03T16:48:32.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.837+0000 7efe72470700 1 -- 172.21.15.26:0/651566252 shutdown_connections 2021-11-03T16:48:32.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.837+0000 7efe72470700 1 --2- 172.21.15.26:0/651566252 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7efe5405c400 0x7efe5405e8c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:48:32.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.837+0000 7efe72470700 1 --2- 172.21.15.26:0/651566252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe6c0f5410 0x7efe6c1094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:48:32.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.837+0000 7efe72470700 1 --2- 172.21.15.26:0/651566252 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe6c060220 0x7efe6c10b9a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:48:32.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.837+0000 7efe72470700 1 -- 172.21.15.26:0/651566252 >> 172.21.15.26:0/651566252 conn(0x7efe6c0f0b70 msgr2=0x7efe6c0f15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:48:32.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.838+0000 7efe72470700 1 -- 172.21.15.26:0/651566252 shutdown_connections 2021-11-03T16:48:32.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:32.838+0000 7efe72470700 1 -- 172.21.15.26:0/651566252 wait complete. 2021-11-03T16:48:33.709 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2021-11-03T16:48:33.710 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2021-11-03T16:48:33.710 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/ceph/ceph.conf 2021-11-03T16:48:33.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:33 smithi194 conmon[35111]: audit 2021-11-03T16:48:32.480034+0000 mon.smithi026 (mon.0 2021-11-03T16:48:33.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:33 smithi194 conmon[35111]: ) 185 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:48:33.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:33 smithi194 conmon[35111]: audit 2021-11-03T16:48:32.481016+0000 mon.smithi026 (mon.0) 186 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:48:33.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:33 smithi194 conmon[35111]: audit 2021-11-03T16:48:32.836914+0000 mon.smithi026 (mon.0) 187 : audit [DBG] from='client.? 172.21.15.26:0/651566252' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:48:33.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:33 smithi194 conmon[35111]: cluster 2021-11-03T16:48:32.991036+0000 mgr.smithi026.cnrxli (mgr.14162) 52 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:33.774 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:33 smithi026 conmon[32119]: audit 2021-11-03T16:48:32.480034+0000 mon.smithi026 2021-11-03T16:48:33.774 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:33 smithi026 conmon[32119]: (mon.0) 185 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:48:33.774 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:33 smithi026 conmon[32119]: audit 2021-11-03T16:48:32.481016+0000 mon.smithi026 (mon.0) 186 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:48:33.775 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:33 smithi026 conmon[32119]: audit 2021-11-03T16:48:32.836914+0000 mon.smithi026 (mon.0) 187 : audit [DBG] from='client.? 172.21.15.26:0/651566252' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:48:33.775 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:33 smithi026 conmon[32119]: cluster 2021-11-03T16:48:32.991036+0000 mgr.smithi026.cnrxli (mgr.14162) 52 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:33.778 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2021-11-03T16:48:33.779 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2021-11-03T16:48:33.845 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2021-11-03T16:48:33.845 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/ceph/ceph.conf 2021-11-03T16:48:33.872 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2021-11-03T16:48:33.873 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2021-11-03T16:48:33.935 INFO:tasks.cephadm:Deploying OSDs... 2021-11-03T16:48:33.936 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2021-11-03T16:48:33.936 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/scratch_devs of=/dev/stdout 2021-11-03T16:48:33.951 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-11-03T16:48:33.952 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-11-03T16:48:34.006 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-11-03T16:48:34.007 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-03T16:48:34.007 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 6h/6d Inode: 111023 Links: 1 2021-11-03T16:48:34.007 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-03T16:48:34.007 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2021-11-03T16:48:34.008 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2021-11-03 16:48:07.763123612 +0000 2021-11-03T16:48:34.008 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2021-11-03 16:41:22.629333289 +0000 2021-11-03T16:48:34.008 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2021-11-03 16:41:22.629333289 +0000 2021-11-03T16:48:34.008 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2021-11-03T16:48:34.017 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2021-11-03T16:48:34.017 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2021-11-03T16:48:34.017 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 9.5458e-05 s, 5.4 MB/s 2021-11-03T16:48:34.020 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-11-03T16:48:34.074 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-11-03T16:48:34.074 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-03T16:48:34.074 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 6h/6d Inode: 109379 Links: 1 2021-11-03T16:48:34.075 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-03T16:48:34.075 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2021-11-03T16:48:34.075 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2021-11-03 16:48:07.763123612 +0000 2021-11-03T16:48:34.075 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2021-11-03 16:41:22.997327837 +0000 2021-11-03T16:48:34.076 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2021-11-03 16:41:22.997327837 +0000 2021-11-03T16:48:34.076 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2021-11-03T16:48:34.084 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2021-11-03T16:48:34.084 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2021-11-03T16:48:34.084 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 7.8591e-05 s, 6.5 MB/s 2021-11-03T16:48:34.087 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-11-03T16:48:34.142 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-11-03T16:48:34.142 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-03T16:48:34.142 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 6h/6d Inode: 111951 Links: 1 2021-11-03T16:48:34.143 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-03T16:48:34.143 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2021-11-03T16:48:34.143 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2021-11-03 16:48:07.763123612 +0000 2021-11-03T16:48:34.143 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2021-11-03 16:41:23.346322666 +0000 2021-11-03T16:48:34.143 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2021-11-03 16:41:23.346322666 +0000 2021-11-03T16:48:34.144 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2021-11-03T16:48:34.152 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2021-11-03T16:48:34.152 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2021-11-03T16:48:34.152 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 9.9023e-05 s, 5.2 MB/s 2021-11-03T16:48:34.154 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-11-03T16:48:34.210 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-11-03T16:48:34.210 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-03T16:48:34.210 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 6h/6d Inode: 110505 Links: 1 2021-11-03T16:48:34.211 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-03T16:48:34.211 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2021-11-03T16:48:34.211 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2021-11-03 16:48:07.763123612 +0000 2021-11-03T16:48:34.211 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2021-11-03 16:41:23.688317599 +0000 2021-11-03T16:48:34.212 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2021-11-03 16:41:23.688317599 +0000 2021-11-03T16:48:34.212 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2021-11-03T16:48:34.220 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2021-11-03T16:48:34.220 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2021-11-03T16:48:34.220 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 9.4631e-05 s, 5.4 MB/s 2021-11-03T16:48:34.223 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2021-11-03T16:48:34.223 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/scratch_devs of=/dev/stdout 2021-11-03T16:48:34.238 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-11-03T16:48:34.238 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-11-03T16:48:34.292 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-11-03T16:48:34.293 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-03T16:48:34.293 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 6h/6d Inode: 110190 Links: 1 2021-11-03T16:48:34.293 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-03T16:48:34.293 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2021-11-03T16:48:34.294 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2021-11-03 16:48:29.789243334 +0000 2021-11-03T16:48:34.294 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2021-11-03 16:41:14.153775902 +0000 2021-11-03T16:48:34.294 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2021-11-03 16:41:14.153775902 +0000 2021-11-03T16:48:34.294 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: - 2021-11-03T16:48:34.302 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2021-11-03T16:48:34.303 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2021-11-03T16:48:34.303 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000308644 s, 1.7 MB/s 2021-11-03T16:48:34.306 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-11-03T16:48:34.360 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-11-03T16:48:34.360 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-03T16:48:34.360 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 6h/6d Inode: 111996 Links: 1 2021-11-03T16:48:34.361 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-03T16:48:34.361 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2021-11-03T16:48:34.361 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2021-11-03 16:48:29.790243313 +0000 2021-11-03T16:48:34.361 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2021-11-03 16:41:14.497768650 +0000 2021-11-03T16:48:34.362 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2021-11-03 16:41:14.497768650 +0000 2021-11-03T16:48:34.362 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: - 2021-11-03T16:48:34.369 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2021-11-03T16:48:34.369 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2021-11-03T16:48:34.369 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.00019227 s, 2.7 MB/s 2021-11-03T16:48:34.372 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-11-03T16:48:34.426 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-11-03T16:48:34.426 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-03T16:48:34.426 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 6h/6d Inode: 108523 Links: 1 2021-11-03T16:48:34.427 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-03T16:48:34.427 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2021-11-03T16:48:34.427 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2021-11-03 16:48:29.790243313 +0000 2021-11-03T16:48:34.427 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2021-11-03 16:41:14.847761272 +0000 2021-11-03T16:48:34.427 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2021-11-03 16:41:14.847761272 +0000 2021-11-03T16:48:34.428 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: - 2021-11-03T16:48:34.435 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2021-11-03T16:48:34.435 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2021-11-03T16:48:34.436 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000193045 s, 2.7 MB/s 2021-11-03T16:48:34.438 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-11-03T16:48:34.492 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-11-03T16:48:34.492 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-03T16:48:34.493 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 6h/6d Inode: 107207 Links: 1 2021-11-03T16:48:34.493 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-03T16:48:34.493 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2021-11-03T16:48:34.493 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2021-11-03 16:48:29.790243313 +0000 2021-11-03T16:48:34.493 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2021-11-03 16:41:15.184754168 +0000 2021-11-03T16:48:34.494 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2021-11-03 16:41:15.184754168 +0000 2021-11-03T16:48:34.494 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: - 2021-11-03T16:48:34.501 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2021-11-03T16:48:34.501 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2021-11-03T16:48:34.502 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000161195 s, 3.2 MB/s 2021-11-03T16:48:34.504 INFO:tasks.cephadm:Deploying osd.0 on smithi026 with /dev/vg_nvme/lv_4... 2021-11-03T16:48:34.504 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2021-11-03T16:48:35.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:35 smithi026 conmon[32119]: audit 2021-11-03T16:48:34.144933+0000 mon.smithi026 (mon.0) 188 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:48:35.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:35 smithi194 conmon[35111]: audit 2021-11-03T16:48:34.144933+0000 mon.smithi026 (mon.0) 188 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:48:36.607 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:36 smithi026 conmon[32119]: cluster 2021-11-03T16:48:34. 2021-11-03T16:48:36.608 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:36 smithi026 conmon[32119]: 991336+0000 mgr.smithi026.cnrxli (mgr.14162) 53 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:36.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:36 smithi194 conmon[35111]: cluster 2021-11-03T16:48:34.991336+0000 mgr.smithi026.cnrxli (mgr.14162 2021-11-03T16:48:36.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:36 smithi194 conmon[35111]: ) 53 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:37.123 INFO:teuthology.orchestra.run.smithi026.stderr:--> Zapping: /dev/vg_nvme/lv_4 2021-11-03T16:48:37.123 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2021-11-03T16:48:37.123 INFO:teuthology.orchestra.run.smithi026.stderr: stderr: 10+0 records in 2021-11-03T16:48:37.124 INFO:teuthology.orchestra.run.smithi026.stderr:10+0 records out 2021-11-03T16:48:37.124 INFO:teuthology.orchestra.run.smithi026.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0130537 s, 803 MB/s 2021-11-03T16:48:37.124 INFO:teuthology.orchestra.run.smithi026.stderr:--> Zapping successful for: 2021-11-03T16:48:38.078 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph orch daemon add osd smithi026:vg_nvme/lv_4 2021-11-03T16:48:38.371 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:38 smithi026 conmon[32119]: cluster 2021-11-03T16:48:36.991552+0000 mgr.smithi026.cnrxli (mgr.14162) 54 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:38.372 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:38 smithi026 conmon[32119]: audit 2021-11-03T16:48:37.564001+0000 mon.smithi026 (mon.0) 189 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:48:38.372 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:38 smithi026 conmon[32119]: audit 2021-11-03T16:48:37.860294+0000 mon.smithi026 (mon.0) 190 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:48:38.372 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:38 smithi026 conmon[32119]: audit 2021-11-03T16:48:37.862503+0000 mon.smithi026 (mon.0) 191 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-11-03T16:48:38.373 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:38 smithi026 conmon[32119]: audit 2021-11-03T16:48:37.863155+0000 mon.smithi026 (mon.0) 192 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-11-03T16:48:38.373 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:38 smithi026 conmon[32119]: audit 2021-11-03T 2021-11-03T16:48:38.373 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:38 smithi026 conmon[32119]: 16:48:37.863818+0000 mon.smithi026 (mon.0) 193 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:48:38.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:38 smithi194 conmon[35111]: cluster 2021-11-03T16:48:36.991552+0000 mgr.smithi026.cnrxli (mgr.14162) 2021-11-03T16:48:38.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:38 smithi194 conmon[35111]: 54 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:38.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:38 smithi194 conmon[35111]: audit 2021-11-03T16:48:37.564001+0000 mon.smithi026 (mon.0) 189 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:48:38.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:38 smithi194 conmon[35111]: audit 2021 2021-11-03T16:48:38.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:38 smithi194 conmon[35111]: -11-03T16:48:37.860294+0000 mon.smithi026 (mon.0) 190 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:48:38.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:38 smithi194 conmon[35111]: audit 2021-11-03T16: 2021-11-03T16:48:38.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:38 smithi194 conmon[35111]: 48:37.862503+0000 mon.smithi026 (mon.0) 191 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-11-03T16:48:38.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:38 smithi194 conmon[35111]: 2021-11-03T16:48:38.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:38 smithi194 conmon[35111]: audit 2021-11-03T16:48:38.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:38 smithi194 conmon[35111]: 2021-11-03 2021-11-03T16:48:38.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:38 smithi194 conmon[35111]: T16:48:37.863155+0000 mon.smithi026 (mon.0 2021-11-03T16:48:38.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:38 smithi194 conmon[35111]: ) 192 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-11-03T16:48:38.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:38 smithi194 conmon[35111]: audit 2021-11-03 2021-11-03T16:48:38.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:38 smithi194 conmon[35111]: T16:48:37.863818+0000 mon.smithi026 (mon.0) 193 : audit 2021-11-03T16:48:38.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:38 smithi194 conmon[35111]: [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:48:39.589 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:39 smithi026 conmon[32119]: cephadm 2021-11-03T16:48:37.862288+0000 mgr.smithi026.cnrxli (mgr.14162) 55 : cephadm [INF] Reconfiguring mon.smithi026 (unknown last config time)... 2021-11-03T16:48:39.589 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:39 smithi026 conmon[32119]: cephadm 2021-11-03T16:48:37.864555+0000 mgr.smithi026.cnrxli (mgr.14162) 56 : cephadm [INF] Reconfiguring daemon mon.smithi026 on smithi026 2021-11-03T16:48:39.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:39 smithi194 conmon[35111]: cephadm 2021-11-03T16:48:37.862288+0000 mgr.smithi026.cnrxli (mgr.14162) 55 : cephadm [INF] 2021-11-03T16:48:39.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:39 smithi194 conmon[35111]: Reconfiguring mon.smithi026 (unknown last config time)... 2021-11-03T16:48:39.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:39 smithi194 conmon[35111]: cephadm 2021-11-03T16:48:37.864555+0000 mgr.smithi026.cnrxli (mgr.14162) 56 : cephadm [INF] Reconfiguring daemon mon.smithi026 on smithi026 2021-11-03T16:48:40.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:40.529+0000 7f4769ccf700 1 -- 172.21.15.26:0/2458828072 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47640f6530 msgr2=0x7f47640f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:48:40.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:40.529+0000 7f4769ccf700 1 --2- 172.21.15.26:0/2458828072 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47640f6530 0x7f47640f6950 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f475c0099e0 tx=0x7f475c004d10).stop 2021-11-03T16:48:40.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:40.529+0000 7f4769ccf700 1 -- 172.21.15.26:0/2458828072 shutdown_connections 2021-11-03T16:48:40.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:40.529+0000 7f4769ccf700 1 --2- 172.21.15.26:0/2458828072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47640f77d0 0x7f47640f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T16:48:40.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:40.529+0000 7f4769ccf700 1 --2- 172.21.15.26:0/2458828072 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47640f6530 0x7f47640f6950 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:48:40.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:40.529+0000 7f4769ccf700 1 -- 172.21.15.26:0/2458828072 >> 172.21.15.26:0/2458828072 conn(0x7f47640f1c90 msgr2=0x7f47640f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:48:40.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:40.529+0000 7f4769ccf700 1 -- 172.21.15.26:0/2458828072 shutdown_connections 2021-11-03T16:48:40.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:40.529+0000 7f4769ccf700 1 -- 172.21.15.26:0/2458828072 wait complete. 2021-11-03T16:48:40.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:40.529+0000 7f4769ccf700 1 Processor -- start 2021-11-03T16:48:40.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:40.529+0000 7f4769ccf700 1 -- start start 2021-11-03T16:48:40.530 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:40.530+0000 7f4769ccf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47640f6530 0x7f4764106f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:48:40.531 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:40.530+0000 7f4769ccf700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47640f77d0 0x7f4764107410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:48:40.531 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:40.530+0000 7f4769ccf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4764107a50 con 0x7f47640f6530 2021-11-03T16:48:40.531 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:40.530+0000 7f4769ccf700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4764108300 con 0x7f47640f77d0 2021-11-03T16:48:40.531 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:40.530+0000 7f4768ccd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47640f6530 0x7f4764106f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:48:40.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:40.530+0000 7f4768ccd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47640f6530 0x7f4764106f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49520/0 (socket says 172.21.15.26:49520) 2021-11-03T16:48:40.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:40.530+0000 7f4768ccd700 1 -- 172.21.15.26:0/20828737 learned_addr learned my addr 172.21.15.26:0/20828737 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:48:40.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:40.530+0000 7f4763fff700 1 --2- 172.21.15.26:0/20828737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47640f77d0 0x7f4764107410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:48:40.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:40.530+0000 7f4768ccd700 1 -- 172.21.15.26:0/20828737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47640f77d0 msgr2=0x7f4764107410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:48:40.533 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:40.530+0000 7f4768ccd700 1 --2- 172.21.15.26:0/20828737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47640f77d0 0x7f4764107410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:48:40.533 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:40.530+0000 7f4768ccd700 1 -- 172.21.15.26:0/20828737 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f475c009640 con 0x7f47640f6530 2021-11-03T16:48:40.533 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:40.530+0000 7f4763fff700 1 --2- 172.21.15.26:0/20828737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47640f77d0 0x7f4764107410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T16:48:40.533 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:40.530+0000 7f4768ccd700 1 --2- 172.21.15.26:0/20828737 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47640f6530 0x7f4764106f20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f475c00b530 tx=0x7f475c004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:48:40.533 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:40.531+0000 7f47617fa700 1 -- 172.21.15.26:0/20828737 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f475c00e030 con 0x7f47640f6530 2021-11-03T16:48:40.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:40.531+0000 7f47617fa700 1 -- 172.21.15.26:0/20828737 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f475c01d8b0 con 0x7f47640f6530 2021-11-03T16:48:40.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:40.531+0000 7f4769ccf700 1 -- 172.21.15.26:0/20828737 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4764108580 con 0x7f47640f6530 2021-11-03T16:48:40.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:40.531+0000 7f47617fa700 1 -- 172.21.15.26:0/20828737 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f475c018070 con 0x7f47640f6530 2021-11-03T16:48:40.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:40.531+0000 7f4769ccf700 1 -- 172.21.15.26:0/20828737 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4764108a60 con 0x7f47640f6530 2021-11-03T16:48:40.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:40.532+0000 7f4769ccf700 1 -- 172.21.15.26:0/20828737 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4764059100 con 0x7f47640f6530 2021-11-03T16:48:40.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:40.532+0000 7f47617fa700 1 -- 172.21.15.26:0/20828737 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f475c01da20 con 0x7f47640f6530 2021-11-03T16:48:40.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:40.532+0000 7f47617fa700 1 --2- 172.21.15.26:0/20828737 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f474c05c300 0x7f474c05e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:48:40.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:40.532+0000 7f47617fa700 1 -- 172.21.15.26:0/20828737 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f475c076d30 con 0x7f47640f6530 2021-11-03T16:48:40.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:40.533+0000 7f4763fff700 1 --2- 172.21.15.26:0/20828737 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f474c05c300 0x7f474c05e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:48:40.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:40.533+0000 7f4763fff700 1 --2- 172.21.15.26:0/20828737 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f474c05c300 0x7f474c05e7c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f475800b830 tx=0x7f4758008040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:48:40.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:40.537+0000 7f47617fa700 1 -- 172.21.15.26:0/20828737 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f475c04aa40 con 0x7f47640f6530 2021-11-03T16:48:40.595 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:40 smithi026 conmon[32119]: cluster 2021-11-03T16:48:38.992078+0000 mgr.smithi026.cnrxli (mgr.14162) 57 : cluster [DBG] 2021-11-03T16:48:40.595 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:40 smithi026 conmon[32119]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:40.595 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:40 smithi026 conmon[32119]: audit 2021-11-03T16:48:39.523302+0000 mon.smithi026 (mon.0) 194 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:48:40.596 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:40 smithi026 conmon[32119]: audit 2021-11-03T16:48:39.524104+0000 mon.smithi026 (mon.0) 195 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi026.cnrxli", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-11-03T16:48:40.596 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:40 smithi026 conmon[32119]: audit 2021-11-03T16:48:39.524846+0000 mon.smithi026 (mon.0) 196 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mgr services"}]: dispatch 2021-11-03T16:48:40.596 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:40 smithi026 conmon[32119]: audit 2021-11 2021-11-03T16:48:40.596 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:40 smithi026 conmon[32119]: -03T16:48:39.525524+0000 mon.smithi026 (mon.0) 197 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:48:40.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:48:40.727+0000 7f4769ccf700 1 -- 172.21.15.26:0/20828737 --> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f47640fede0 con 0x7f474c05c300 2021-11-03T16:48:40.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:40 smithi194 conmon[35111]: cluster 2021-11-03T16:48:38.992078+0000 mgr.smithi026.cnrxli (mgr. 2021-11-03T16:48:40.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:40 smithi194 conmon[35111]: 14162) 57 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:40.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:40 smithi194 conmon[35111]: audit 2021-11-03T16:48:39.523302+0000 mon.smithi026 (mon.0) 194 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:48:40.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:40 smithi194 conmon[35111]: audit 2021-11-03T16:48:39.524104+0000 2021-11-03T16:48:40.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:40 smithi194 conmon[35111]: mon.smithi026 (mon.0) 195 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi026.cnrxli", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-11-03T16:48:40.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:40 smithi194 conmon[35111]: audit 2021-11- 2021-11-03T16:48:40.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:40 smithi194 conmon[35111]: 03T16:48:39.524846+0000 mon.smithi026 (mon.0) 196 : audit 2021-11-03T16:48:40.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:40 smithi194 conmon[35111]: [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mgr services"}]: dispatch 2021-11-03T16:48:40.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:40 smithi194 conmon[35111]: audit 2021-11- 2021-11-03T16:48:40.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:40 smithi194 conmon[35111]: 03T16:48:39.525524+0000 mon.smithi026 (mon.0) 197 : audit 2021-11-03T16:48:40.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:40 smithi194 conmon[35111]: [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:48:41.544 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:41 smithi026 conmon[32119]: cephadm 2021-11-03T16:48:39.523820+0000 mgr.smithi026.cnrxli (mgr.14162) 58 : cephadm [INF] Reconfiguring mgr.smithi026.cnrxli (unknown last config time)... 2021-11-03T16:48:41.544 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:41 smithi026 conmon[32119]: cephadm 2021-11-03T16:48:39.526093+0000 mgr.smithi026.cnrxli (mgr.14162) 59 : cephadm [INF] Reconfiguring daemon mgr.smithi026.cnrxli on smithi026 2021-11-03T16:48:41.544 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:41 smithi026 conmon[32119]: audit 2021-11-03T16:48:40.730778+0000 mon.smithi026 (mon.0) 198 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-11-03T16:48:41.545 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:41 smithi026 conmon[32119]: audit 2021-11-03T16:48:40.732351+0000 mon.smithi026 (mon.0) 199 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-11-03T16:48:41.545 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:41 smithi026 conmon[32119]: audit 2021-11-03T16:48:40.732926+0000 mon.smithi026 (mon.0) 200 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:48:41.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:41 smithi194 conmon[35111]: cephadm 2021-11-03T16:48:39.523820+0000 mgr.smithi026.cnrxli (mgr.14162) 2021-11-03T16:48:41.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:41 smithi194 conmon[35111]: 58 : cephadm [INF] Reconfiguring mgr.smithi026.cnrxli (unknown last config time)... 2021-11-03T16:48:41.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:41 smithi194 conmon[35111]: cephadm 2021-11-03T16:48:39.526093+0000 mgr.smithi026.cnrxli (mgr.14162) 59 : cephadm [INF] Reconfiguring daemon mgr.smithi026.cnrxli on smithi026 2021-11-03T16:48:41.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:41 smithi194 conmon[35111]: audit 2021-11-03T16:48:40.730778+0000 2021-11-03T16:48:41.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:41 smithi194 conmon[35111]: mon.smithi026 (mon.0) 198 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-11-03T16:48:41.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:41 smithi194 conmon[35111]: audit 2021-11- 2021-11-03T16:48:41.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:41 smithi194 conmon[35111]: 03T16:48:40.732351+0000 mon.smithi026 (mon.0) 199 2021-11-03T16:48:41.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:41 smithi194 conmon[35111]: : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-11-03T16:48:41.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:41 smithi194 conmon[35111]: audit 2021-11- 2021-11-03T16:48:41.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:41 smithi194 conmon[35111]: 03T16:48:40.732926+0000 mon.smithi026 (mon.0) 200 : audit 2021-11-03T16:48:41.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:41 smithi194 conmon[35111]: [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:48:42.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:42 smithi026 conmon[32119]: audit 2021-11-03T16:48:40 2021-11-03T16:48:42.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:42 smithi026 conmon[32119]: .729988+0000 mgr.smithi026.cnrxli (mgr.14162) 60 : audit [DBG] from='client.14212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:48:42.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:42 smithi026 conmon[32119]: cephadm 2021-11-03T16:48:40.732115+0000 mgr.smithi026.cnrxli (mgr.14162) 61 : cephadm [INF] Applying service osd.None on host smithi026... 2021-11-03T16:48:42.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:42 smithi026 conmon[32119]: cluster 2021-11-03T16:48:40.992465+0000 mgr.smithi026.cnrxli (mgr.14162) 62 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:42.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:42 smithi026 conmon[32119]: audit 2021-11-03T16:48:41.324844+0000 mon.smithi026 (mon.0) 201 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:48:42.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:42 smithi194 conmon[35111]: audit 2021-11-03T16:48:40.729988+0000 mgr.smithi026.cnrxli (mgr.14162) 60 : audit [DBG] from='client.14212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:48:42.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:42 smithi194 conmon[35111]: 2021-11-03T16:48:42.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:42 smithi194 conmon[35111]: cephadm 2021-11-03T16:48:40.732115+0000 mgr.smithi026.cnrxli (mgr.14162) 61 : cephadm [INF] Applying service osd.None on host smithi026... 2021-11-03T16:48:42.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:42 smithi194 conmon[35111]: cluster 2021-11-03T16:48:40.992465+0000 mgr.smithi026.cnrxli ( 2021-11-03T16:48:42.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:42 smithi194 conmon[35111]: mgr.14162) 62 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:42.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:42 smithi194 conmon[35111]: audit 2021-11 2021-11-03T16:48:42.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:42 smithi194 conmon[35111]: -03T16:48:41.324844+0000 2021-11-03T16:48:42.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:42 smithi194 conmon[35111]: mon.smithi026 (mon.0) 201 : audit 2021-11-03T16:48:42.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:42 smithi194 conmon[35111]: [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:48:43.642 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:43 smithi026 conmon[32119]: cephadm 2021-11-03T16:48:41.325436+0000 mgr.smithi026.cnrxli (mgr. 2021-11-03T16:48:43.642 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:43 smithi026 conmon[32119]: 14162) 63 : cephadm [INF] Reconfiguring alertmanager.smithi026 (dependencies changed)... 2021-11-03T16:48:43.642 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:43 smithi026 conmon[32119]: cephadm 2021-11-03T16:48:41.328022+0000 mgr.smithi026.cnrxli (mgr.14162) 64 : cephadm [INF] Reconfiguring daemon alertmanager.smithi026 on smithi026 2021-11-03T16:48:43.642 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:43 smithi026 conmon[32119]: cluster 2021-11-03T16:48:42.992750+0000 mgr.smithi026.cnrxli (mgr.14162) 65 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:43.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:43 smithi194 conmon[35111]: cephadm 2021-11-03T16:48:41.325436+0000 mgr.smithi026.cnrxli (mgr.14162) 63 : cephadm [INF] Reconfiguring alertmanager.smithi026 (dependencies changed)... 2021-11-03T16:48:43.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:43 smithi194 conmon[35111]: cephadm 2021-11-03T16:48:41.328022+0000 mgr.smithi026.cnrxli (mgr.14162) 64 : cephadm [INF] Reconfiguring daemon alertmanager.smithi026 on smithi026 2021-11-03T16:48:43.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:43 smithi194 conmon[35111]: cluster 2021-11-03T16:48:42 2021-11-03T16:48:43.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:43 smithi194 conmon[35111]: .992750+0000 mgr.smithi026.cnrxli (mgr.14162) 65 2021-11-03T16:48:43.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:43 smithi194 conmon[35111]: : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:46.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:46 smithi026 conmon[32119]: cluster 2021-11-03T16:48:44.993100+0000 mgr.smithi026.cnrxli ( 2021-11-03T16:48:46.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:46 smithi026 conmon[32119]: mgr.14162) 66 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:46.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:46 smithi194 conmon[35111]: cluster 2021-11-03T16:48:44.993100+0000 mgr.smithi026.cnrxli (mgr.14162) 66 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:47.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:47 smithi026 conmon[32119]: audit 2021-11-03T16:48:46.281260+0000 2021-11-03T16:48:47.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:47 smithi026 conmon[32119]: mon.smithi026 (mon.0) 202 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:48:47.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:47 smithi026 conmon[32119]: cephadm 2021-11-03T16:48:46.281883+0000 mgr.smithi026.cnrxli (mgr.14162) 67 : cephadm [INF] Reconfiguring crash.smithi026 (monmap changed)... 2021-11-03T16:48:47.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:47 smithi026 conmon[32119]: audit 2021-11-03T16:48:46.282152+0000 mon.smithi026 (mon.0) 203 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi026", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2021-11-03T16:48:47.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:47 smithi026 conmon[32119]: audit 2021-11-03T16:48:46.282907+0000 mon.smithi026 (mon.0) 204 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:48:47.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:47 smithi026 conmon[32119]: cephadm 2021-11-03T16:48:46.283431+0000 mgr.smithi026.cnrxli (mgr.14162) 68 : cephadm [INF] Reconfiguring daemon crash.smithi026 on smithi026 2021-11-03T16:48:47.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:47 smithi194 conmon[35111]: audit 2021-11-03T16:48:46.281260+0000 mon.smithi026 (mon.0) 202 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:48:47.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:47 smithi194 conmon[35111]: cephadm 2021-11-03T16:48:46.281883+0000 mgr.smithi026.cnrxli (mgr.14162) 67 : cephadm [INF] Reconfiguring crash.smithi026 (monmap changed)... 2021-11-03T16:48:47.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:47 smithi194 conmon[35111]: audit 2021-11-03 2021-11-03T16:48:47.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:47 smithi194 conmon[35111]: T16:48:46.282152+0000 mon.smithi026 (mon.0) 203 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi026", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2021-11-03T16:48:47.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:47 smithi194 conmon[35111]: audit 2021-11- 2021-11-03T16:48:47.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:47 smithi194 conmon[35111]: 03T16:48:46.282907+0000 mon.smithi026 (mon.0) 204 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:48:47.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:47 smithi194 conmon[35111]: 2021-11-03T16:48:47.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:47 smithi194 conmon[35111]: cephadm 2021-11-03T16:48:47.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:47 smithi194 conmon[35111]: 2021-11-03T16: 2021-11-03T16:48:47.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:47 smithi194 conmon[35111]: 48:46.283431+0000 mgr.smithi026.cnrxli (mgr.14162) 2021-11-03T16:48:47.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:47 smithi194 conmon[35111]: 68 : cephadm [INF] Reconfiguring daemon crash.smithi026 on smithi026 2021-11-03T16:48:48.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:48 smithi026 conmon[32119]: cluster 2021-11-03T16:48:46.993380+0000 mgr.smithi026.cnrxli 2021-11-03T16:48:48.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:48 smithi026 conmon[32119]: (mgr.14162) 69 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:48.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:48 smithi026 conmon[32119]: audit 2021-11-03T16:48:47.312343 2021-11-03T16:48:48.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:48 smithi026 conmon[32119]: +0000 mon.smithi026 (mon.0) 205 : audit [INF] from='client.? 172.21.15.26:0/3041261904' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bf72169c-0b6d-4360-8f55-7add81fa314d"}]: dispatch 2021-11-03T16:48:48.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:48 smithi026 conmon[32119]: audit 2021-11-03 2021-11-03T16:48:48.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:48 smithi026 conmon[32119]: T16:48:47.315318+0000 mon.smithi026 ( 2021-11-03T16:48:48.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:48 smithi026 conmon[32119]: mon.0) 206 : audit [INF] from='client.? 172.21.15.26:0/3041261904' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bf72169c-0b6d-4360-8f55-7add81fa314d"}]': finished 2021-11-03T16:48:48.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:48 smithi026 conmon[32119]: cluster 2021- 2021-11-03T16:48:48.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:48 smithi026 conmon[32119]: 11-03T16:48:47.315365+0000 2021-11-03T16:48:48.677 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:48 smithi026 conmon[32119]: mon.smithi026 (mon.0) 207 : cluster [DBG] 2021-11-03T16:48:48.677 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:48 smithi026 conmon[32119]: osdmap e6: 1 total, 0 up, 1 in 2021-11-03T16:48:48.678 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:48 smithi026 conmon[32119]: audit 2021-11-03T16:48:48.678 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:48 smithi026 conmon[32119]: 2021-11-03T16:48:47.315457+0000 mon.smithi026 2021-11-03T16:48:48.678 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:48 smithi026 conmon[32119]: (mon.0) 208 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-11-03T16:48:48.679 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:48 smithi026 conmon[32119]: audit 2021-11 2021-11-03T16:48:48.679 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:48 smithi026 conmon[32119]: -03T16:48:47.846575+0000 2021-11-03T16:48:48.680 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:48 smithi026 conmon[32119]: mon.smithi026 (mon.0) 209 : audit [DBG] 2021-11-03T16:48:48.680 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:48 smithi026 conmon[32119]: from='client.? 172.21.15.26:0/3176356043' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-11-03T16:48:48.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:48 smithi194 conmon[35111]: cluster 2021-11-03T16:48:46.993380+0000 mgr.smithi026.cnrxli (mgr.14162) 69 : cluster [DBG] 2021-11-03T16:48:48.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:48 smithi194 conmon[35111]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:48.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:48 smithi194 conmon[35111]: audit 2021-11-03T16:48:47.312343+0000 mon.smithi026 (mon.0) 205 : audit [INF] from='client.? 172.21.15.26:0/3041261904' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bf72169c-0b6d-4360-8f55-7add81fa314d"}]: dispatch 2021-11-03T16:48:48.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:48 smithi194 conmon[35111]: audit 2021- 2021-11-03T16:48:48.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:48 smithi194 conmon[35111]: 11-03T16:48:47.315318+0000 mon.smithi026 (mon.0) 206 : audit [INF] from='client.? 172.21.15.26:0/3041261904' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bf72169c-0b6d-4360-8f55-7add81fa314d"}]': finished 2021-11-03T16:48:48.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:48 smithi194 conmon[35111]: cluster 2021-11-03T16:48:48.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:48 smithi194 conmon[35111]: 2021-11-03T16:48:47.315365+0000 mon.smithi026 (mon 2021-11-03T16:48:48.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:48 smithi194 conmon[35111]: .0) 207 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2021-11-03T16:48:48.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:48 smithi194 conmon[35111]: audit 2021-11- 2021-11-03T16:48:48.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:48 smithi194 conmon[35111]: 03T16:48:47.315457+0000 mon.smithi026 (mon.0) 208 : audit [DBG] 2021-11-03T16:48:48.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:48 smithi194 conmon[35111]: from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-11-03T16:48:48.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:48 smithi194 conmon[35111]: audit 2021-11-03T 2021-11-03T16:48:48.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:48 smithi194 conmon[35111]: 16:48:47.846575+0000 mon.smithi026 (mon.0) 209 : audit 2021-11-03T16:48:48.754 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:48 smithi194 conmon[35111]: [DBG] from='client.? 172.21.15.26:0/3176356043' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-11-03T16:48:50.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:50 smithi026 conmon[32119]: cluster 2021-11-03T16:48:48.993742+0000 mgr.smithi026.cnrxli (mgr. 2021-11-03T16:48:50.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:50 smithi026 conmon[32119]: 14162) 70 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:50.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:50 smithi194 conmon[35111]: cluster 2021-11-03T16:48:48.993742+0000 mgr.smithi026.cnrxli (mgr.14162) 70 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:52.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:52 smithi026 conmon[32119]: cluster 2021-11-03T16:48:50.994007+0000 mgr.smithi026.cnrxli (mgr.14162) 71 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:52.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:52 smithi194 conmon[35111]: cluster 2021-11-03T16:48:50.994007+0000 mgr.smithi026.cnrxli (mgr.14162) 71 2021-11-03T16:48:52.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:52 smithi194 conmon[35111]: : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:54.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:54 smithi026 conmon[32119]: cluster 2021-11-03T16:48:52.994438+0000 mgr.smithi026.cnrxli (mgr.14162) 2021-11-03T16:48:54.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:54 smithi026 conmon[32119]: 72 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:54.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:54 smithi026 conmon[32119]: audit 2021-11-03T16:48:53.181144+0000 mon.smithi026 (mon.0) 210 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:48:54.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:54 smithi026 conmon[32119]: cephadm 2021-11-03T16:48:53.181711+0000 mgr.smithi026.cnrxli (mgr.14162) 73 : cephadm [INF] Reconfiguring grafana.smithi026 (dependencies changed)... 2021-11-03T16:48:54.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:54 smithi026 conmon[32119]: cephadm 2021-11-03T16:48:53.186019+0000 mgr.smithi026.cnrxli (mgr.14162) 74 : cephadm [INF] Reconfiguring daemon grafana.smithi026 on smithi026 2021-11-03T16:48:54.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:54 smithi194 conmon[35111]: cluster 2021-11-03T16:48:52.994438+0000 mgr.smithi026.cnrxli (mgr.14162) 2021-11-03T16:48:54.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:54 smithi194 conmon[35111]: 72 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:54.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:54 smithi194 conmon[35111]: audit 2021-11-03T16:48:53.181144+0000 mon.smithi026 (mon.0) 210 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:48:54.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:54 smithi194 conmon[35111]: cephadm 2021-11 2021-11-03T16:48:54.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:54 smithi194 conmon[35111]: -03T16:48:53.181711+0000 mgr.smithi026.cnrxli (mgr.14162) 73 : cephadm [INF] Reconfiguring grafana.smithi026 (dependencies changed)... 2021-11-03T16:48:54.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:54 smithi194 conmon[35111]: cephadm 2021-11-03T16:48:53.186019+0000 mgr.smithi026.cnrxli (mgr.14162) 74 : cephadm [INF] 2021-11-03T16:48:54.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:54 smithi194 conmon[35111]: Reconfiguring daemon grafana.smithi026 on smithi026 2021-11-03T16:48:56.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:56 smithi026 conmon[32119]: cluster 2021-11-03T16:48:54.994707+0000 2021-11-03T16:48:56.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:56 smithi026 conmon[32119]: mgr.smithi026.cnrxli (mgr.14162) 75 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:56.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:56 smithi194 conmon[35111]: cluster 2021-11-03T16:48:54.994707+0000 mgr.smithi026.cnrxli (mgr.14162 2021-11-03T16:48:56.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:56 smithi194 conmon[35111]: ) 75 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:58.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:58 smithi026 conmon[32119]: cluster 2021-11-03T16:48:56.994924+0000 mgr.smithi026.cnrxli (mgr.14162) 76 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:58.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:58 smithi026 conmon[32119]: audit 2021-11-03T16:48:57.435430+0000 mon.smithi026 (mon.0) 211 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:48:58.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:58 smithi194 conmon[35111]: cluster 2021-11-03T16:48:56.994924+0000 mgr.smithi026.cnrxli (mgr.14162) 76 : cluster 2021-11-03T16:48:58.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:58 smithi194 conmon[35111]: [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:48:58.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:58 smithi194 conmon[35111]: audit 2021-11-03T16:48:57.435430+0000 mon.smithi026 (mon.0) 211 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:48:59.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:59 smithi194 conmon[35111]: cephadm 2021-11-03T16:48:57.436269+0000 mgr.smithi026.cnrxli (mgr.14162 2021-11-03T16:48:59.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:59 smithi194 conmon[35111]: ) 77 : cephadm [INF] Reconfiguring prometheus.smithi026 (dependencies changed)... 2021-11-03T16:48:59.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:59 smithi194 conmon[35111]: cephadm 2021-11-03T16:48:57.439947+0000 mgr.smithi026.cnrxli (mgr.14162) 78 : cephadm [INF] Reconfiguring daemon prometheus.smithi026 on smithi026 2021-11-03T16:48:59.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:59 smithi194 conmon[35111]: audit 2021-11-03T16:48:58.865488+0000 mon.smithi026 (mon.0) 212 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-11-03T16:48:59.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:59 smithi194 conmon[35111]: audit 2021 2021-11-03T16:48:59.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:48:59 smithi194 conmon[35111]: -11-03T16:48:58.866201+0000 mon.smithi026 (mon.0) 213 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:48:59.610 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:59 smithi026 conmon[32119]: cephadm 2021-11-03T16:48:57.436269+0000 mgr.smithi026.cnrxli (mgr.14162) 77 : cephadm [INF] Reconfiguring prometheus.smithi026 (dependencies changed)... 2021-11-03T16:48:59.610 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:59 smithi026 conmon[32119]: cephadm 2021-11-03T16:48:57.439947+0000 mgr.smithi026.cnrxli (mgr.14162) 78 : cephadm [INF] Reconfiguring daemon prometheus.smithi026 on smithi026 2021-11-03T16:48:59.610 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:59 smithi026 conmon[32119]: audit 2021-11-03T16:48:58.865488+0000 mon.smithi026 (mon.0) 212 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-11-03T16:48:59.611 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:48:59 smithi026 conmon[32119]: audit 2021-11-03T16:48:58.866201+0000 mon.smithi026 (mon.0) 213 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:49:00.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:00 smithi194 conmon[35111]: cephadm 2021-11-03T16:48:58.866789+0000 mgr.smithi026.cnrxli (mgr 2021-11-03T16:49:00.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:00 smithi194 conmon[35111]: .14162) 79 : cephadm [INF] Deploying daemon osd.0 on smithi026 2021-11-03T16:49:00.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:00 smithi194 conmon[35111]: cluster 2021-11-03T16:48:58.995179+0000 mgr.smithi026.cnrxli (mgr.14162) 80 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:49:00.563 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:00 smithi026 conmon[32119]: cephadm 2021-11-03T16:48:58.866789+0000 mgr.smithi026.cnrxli (mgr 2021-11-03T16:49:00.563 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:00 smithi026 conmon[32119]: .14162) 79 : cephadm [INF] Deploying daemon osd.0 on smithi026 2021-11-03T16:49:00.563 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:00 smithi026 conmon[32119]: cluster 2021-11-03T16:48:58.995179+0000 mgr.smithi026.cnrxli (mgr.14162) 80 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:49:02.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:02 smithi026 conmon[32119]: cluster 2021-11-03T16:49:00.995433+0000 mgr.smithi026.cnrxli (mgr. 2021-11-03T16:49:02.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:02 smithi026 conmon[32119]: 14162) 81 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:49:02.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:02 smithi194 conmon[35111]: cluster 2021-11-03T16:49:00.995433+0000 mgr.smithi026.cnrxli (mgr.14162) 81 2021-11-03T16:49:02.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:02 smithi194 conmon[35111]: : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:49:04.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:04 smithi194 conmon[35111]: cluster 2021-11-03T16:49:02.995717+0000 mgr.smithi026.cnrxli (mgr. 2021-11-03T16:49:04.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:04 smithi194 conmon[35111]: 14162) 82 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:49:04.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:04 smithi194 conmon[35111]: audit 2021-11-03T16:49:03.157060+0000 mon.smithi026 (mon.0) 214 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:04.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:04 smithi194 conmon[35111]: cephadm 2021-11-03T16:49:03.157534+0000 mgr.smithi026.cnrxli (mgr.14162) 83 : cephadm [INF] Reconfiguring crash.smithi194 (monmap changed)... 2021-11-03T16:49:04.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:04 smithi194 conmon[35111]: audit 2021-11-03T16:49:03.157772+0000 mon.smithi026 (mon.0) 215 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi194", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2021-11-03T16:49:04.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:04 smithi194 conmon[35111]: audit 2021-11-03T16:49:03.158477+0000 mon.smithi026 (mon.0) 216 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:49:04.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:04 smithi194 conmon[35111]: cephadm 2021-11-03T16:49:03.159010+0000 mgr.smithi026.cnrxli (mgr.14162) 84 : cephadm [INF] Reconfiguring daemon crash.smithi194 on smithi194 2021-11-03T16:49:04.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:04 smithi026 conmon[32119]: cluster 2021-11-03T16:49:02.995717+0000 mgr.smithi026.cnrxli (mgr.14162) 82 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:49:04.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:04 smithi026 conmon[32119]: audit 2021-11-03T16:49:03.157060+0000 mon.smithi026 (mon.0) 214 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:04.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:04 smithi026 conmon[32119]: cephadm 2021-11-03T16:49:03.157534+0000 mgr.smithi026.cnrxli (mgr.14162) 83 : cephadm [INF] Reconfiguring crash.smithi194 (monmap changed)... 2021-11-03T16:49:04.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:04 smithi026 conmon[32119]: audit 2021-11-03T16:49:03.157772+0000 mon.smithi026 (mon.0) 215 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi194", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2021-11-03T16:49:04.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:04 smithi026 conmon[32119]: audit 2021-11-03T16:49:03.158477+0000 mon.smithi026 (mon.0) 216 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:49:04.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:04 smithi026 conmon[32119]: cephadm 2021 2021-11-03T16:49:04.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:04 smithi026 conmon[32119]: -11-03T16:49:03.159010+0000 mgr.smithi026.cnrxli (mgr.14162) 84 : cephadm [INF] Reconfiguring daemon crash.smithi194 on smithi194 2021-11-03T16:49:05.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:05 smithi194 conmon[35111]: audit 2021-11-03T16:49:04.503061+0000 mon.smithi026 (mon.0) 217 : audit 2021-11-03T16:49:05.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:05 smithi194 conmon[35111]: [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:05.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:05 smithi194 conmon[35111]: cephadm 2021-11-03T16:49:04.503584+0000 mgr.smithi026.cnrxli (mgr.14162) 85 : cephadm [INF] Reconfiguring mgr.smithi194.wnexas (monmap changed)... 2021-11-03T16:49:05.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:05 smithi194 conmon[35111]: audit 2021-11-03T16:49:04.503840+0000 mon.smithi026 (mon.0) 218 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi194.wnexas", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-11-03T16:49:05.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:05 smithi194 conmon[35111]: audit 2021-11-03T16:49:04.504597+0000 mon.smithi026 (mon.0) 219 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mgr services"}]: dispatch 2021-11-03T16:49:05.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:05 smithi194 conmon[35111]: audit 2021-11-03T16:49:04.505199+0000 mon.smithi026 (mon.0) 220 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:49:05.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:05 smithi194 conmon[35111]: cephadm 2021-11-03T16:49:04.505732+0000 mgr.smithi026.cnrxli (mgr.14162) 86 : cephadm [INF] Reconfiguring daemon mgr.smithi194.wnexas on smithi194 2021-11-03T16:49:05.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:05 smithi194 conmon[35111]: cluster 2021-11-03T16:49:04.995957+0000 mgr.smithi026.cnrxli (mgr.14162) 87 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:49:05.810 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:05 smithi026 conmon[32119]: audit 2021-11-03T16:49:04.503061+0000 mon.smithi026 2021-11-03T16:49:05.811 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:05 smithi026 conmon[32119]: (mon.0) 217 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:05.811 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:05 smithi026 conmon[32119]: cephadm 2021-11-03T16:49:04.503584+0000 mgr.smithi026.cnrxli (mgr.14162) 85 : cephadm [INF] Reconfiguring mgr.smithi194.wnexas (monmap changed)... 2021-11-03T16:49:05.812 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:05 smithi026 conmon[32119]: audit 2021-11-03T16:49:04.503840+0000 mon.smithi026 (mon.0) 218 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi194.wnexas", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-11-03T16:49:05.812 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:05 smithi026 conmon[32119]: audit 2021-11-03T16:49:04.504597+0000 mon.smithi026 (mon.0) 219 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mgr services"}]: dispatch 2021-11-03T16:49:05.812 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:05 smithi026 conmon[32119]: audit 2021-11-03T16:49:04.505199+0000 mon.smithi026 (mon.0) 220 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:49:05.812 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:05 smithi026 conmon[32119]: cephadm 2021-11-03T16:49:04.505732+0000 mgr.smithi026.cnrxli (mgr.14162) 86 : cephadm [INF] Reconfiguring daemon mgr.smithi194.wnexas on smithi194 2021-11-03T16:49:05.813 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:05 smithi026 conmon[32119]: cluster 2021-11-03T16:49:04.995957+0000 mgr.smithi026.cnrxli (mgr.14162) 87 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:49:06.891 INFO:teuthology.orchestra.run.smithi026.stdout:Created osd(s) 0 on host 'smithi026' 2021-11-03T16:49:06.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:06.895+0000 7f47617fa700 1 -- 172.21.15.26:0/20828737 <== mgr.14162 v2:172.21.15.26:6800/3029163595 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f47640fede0 con 0x7f474c05c300 2021-11-03T16:49:06.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:06.897+0000 7f4769ccf700 1 -- 172.21.15.26:0/20828737 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f474c05c300 msgr2=0x7f474c05e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:49:06.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:06.897+0000 7f4769ccf700 1 --2- 172.21.15.26:0/20828737 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f474c05c300 0x7f474c05e7c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f475800b830 tx=0x7f4758008040).stop 2021-11-03T16:49:06.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:06.897+0000 7f4769ccf700 1 -- 172.21.15.26:0/20828737 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47640f6530 msgr2=0x7f4764106f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:49:06.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:06.897+0000 7f4769ccf700 1 --2- 172.21.15.26:0/20828737 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47640f6530 0x7f4764106f20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f475c00b530 tx=0x7f475c004d10).stop 2021-11-03T16:49:06.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:06.897+0000 7f4769ccf700 1 -- 172.21.15.26:0/20828737 shutdown_connections 2021-11-03T16:49:06.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:06.897+0000 7f4769ccf700 1 --2- 172.21.15.26:0/20828737 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f474c05c300 0x7f474c05e7c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:49:06.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:06.897+0000 7f4769ccf700 1 --2- 172.21.15.26:0/20828737 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47640f6530 0x7f4764106f20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:49:06.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:06.897+0000 7f4769ccf700 1 --2- 172.21.15.26:0/20828737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47640f77d0 0x7f4764107410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:49:06.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:06.897+0000 7f4769ccf700 1 -- 172.21.15.26:0/20828737 >> 172.21.15.26:0/20828737 conn(0x7f47640f1c90 msgr2=0x7f47640fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:49:06.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:06.897+0000 7f4769ccf700 1 -- 172.21.15.26:0/20828737 shutdown_connections 2021-11-03T16:49:06.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:06.897+0000 7f4769ccf700 1 -- 172.21.15.26:0/20828737 wait complete. 2021-11-03T16:49:07.106 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:06 smithi026 conmon[32119]: audit 2021-11-03T16:49:05.868406 2021-11-03T16:49:07.107 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:06 smithi026 conmon[32119]: +0000 mon.smithi026 (mon.0) 221 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:07.107 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:06 smithi026 conmon[32119]: cephadm 2021-11-03T16:49:05.868974+0000 mgr.smithi026.cnrxli (mgr.14162) 88 : cephadm [INF] Reconfiguring mon.smithi194 (monmap changed)... 2021-11-03T16:49:07.107 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:06 smithi026 conmon[32119]: audit 2021-11-03T16:49:05.869231+0000 mon.smithi026 (mon.0) 222 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-11-03T16:49:07.108 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:06 smithi026 conmon[32119]: audit 2021-11-03T16:49:05.869865+0000 mon.smithi026 2021-11-03T16:49:07.108 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:06 smithi026 conmon[32119]: (mon.0) 223 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-11-03T16:49:07.108 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:06 smithi026 conmon[32119]: audit 2021 2021-11-03T16:49:07.108 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:06 smithi026 conmon[32119]: -11-03T16:49:05.870449+0000 2021-11-03T16:49:07.109 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:06 smithi026 conmon[32119]: mon.smithi026 (mon.0) 224 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:49:07.109 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:06 smithi026 conmon[32119]: 2021-11-03T16:49:07.109 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:06 smithi026 conmon[32119]: cephadm 2021-11-03T16:49 2021-11-03T16:49:07.109 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:06 smithi026 conmon[32119]: :05.870976+0000 mgr.smithi026.cnrxli (mgr.14162) 2021-11-03T16:49:07.110 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:06 smithi026 conmon[32119]: 89 : cephadm [INF] Reconfiguring daemon mon.smithi194 on smithi194 2021-11-03T16:49:07.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:06 smithi194 conmon[35111]: audit 2021-11-03T16:49:05.868406+0000 mon.smithi026 (mon.0) 221 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:07.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:06 smithi194 conmon[35111]: cephadm 2021-11-03T16:49:05.868974+0000 mgr.smithi026.cnrxli (mgr.14162) 88 : cephadm [INF] Reconfiguring mon.smithi194 (monmap changed)... 2021-11-03T16:49:07.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:06 smithi194 conmon[35111]: audit 2021-11-03T16:49:05. 2021-11-03T16:49:07.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:06 smithi194 conmon[35111]: 869231+0000 mon.smithi026 (mon.0) 222 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-11-03T16:49:07.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:06 smithi194 conmon[35111]: audit 2021-11-03T16 2021-11-03T16:49:07.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:06 smithi194 conmon[35111]: :49:05.869865+0000 mon.smithi026 (mon.0 2021-11-03T16:49:07.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:06 smithi194 conmon[35111]: ) 223 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-11-03T16:49:07.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:06 smithi194 conmon[35111]: audit 2021-11 2021-11-03T16:49:07.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:06 smithi194 conmon[35111]: -03T16:49:05.870449 2021-11-03T16:49:07.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:06 smithi194 conmon[35111]: +0000 mon.smithi026 (mon.0) 224 : 2021-11-03T16:49:07.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:06 smithi194 conmon[35111]: audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:49:07.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:06 smithi194 conmon[35111]: cephadm 2021-11-03 2021-11-03T16:49:07.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:06 smithi194 conmon[35111]: T16:49:05.870976+0000 mgr.smithi026.cnrxli 2021-11-03T16:49:07.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:06 smithi194 conmon[35111]: (mgr.14162) 89 : cephadm 2021-11-03T16:49:07.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:06 smithi194 conmon[35111]: [INF] Reconfiguring daemon mon.smithi194 on smithi194 2021-11-03T16:49:07.549 DEBUG:teuthology.orchestra.run.smithi026:osd.0> sudo journalctl -f -n 0 -u ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c@osd.0.service 2021-11-03T16:49:07.552 INFO:tasks.cephadm:Deploying osd.1 on smithi026 with /dev/vg_nvme/lv_3... 2021-11-03T16:49:07.553 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2021-11-03T16:49:07.581 INFO:journalctl@ceph.osd.0.smithi026.stdout:-- Logs begin at Wed 2021-11-03 16:35:12 UTC. -- 2021-11-03T16:49:08.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:07 smithi026 conmon[32119]: audit 2021-11-03T16:49:06.891585+0000 mon.smithi026 (mon.0) 225 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:08.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:07 smithi026 conmon[32119]: audit 2021-11-03T16:49:06.894820+0000 mon.smithi026 (mon.0) 226 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:08.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:07 smithi026 conmon[32119]: cluster 2021-11-03T16:49:06.996187+0000 mgr.smithi026.cnrxli (mgr.14162) 90 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:49:08.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:07 smithi026 conmon[32119]: audit 2021-11-03T16:49:07.285386+0000 mon.smithi026 (mon.0) 227 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:08.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:07 smithi026 conmon[32119]: audit 2021-11-03T16:49:07.288032+0000 mon.smithi026 (mon.0) 228 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-11-03T16:49:08.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:07 smithi026 conmon[32119]: audit 2021-11-03T16:49:07.288374+0000 mgr.smithi026.cnrxli (mgr.14162) 91 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-11-03T16:49:08.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:07 smithi026 conmon[32119]: audit 2021-11-03T16:49:07.289294+0000 mon.smithi026 (mon.0) 229 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.26:9093"}]: dispatch 2021-11-03T16:49:08.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:07 smithi026 conmon[32119]: audit 2021-11-03T16:49:07.289606+0000 mgr.smithi026.cnrxli (mgr.14162) 92 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.26:9093"}]: dispatch 2021-11-03T16:49:08.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:07 smithi026 conmon[32119]: audit 2021-11-03T16:49:07.293007+0000 mon.smithi026 (mon.0) 230 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:08.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:07 smithi026 conmon[32119]: audit 2021-11-03T16:49:07.297010+0000 mon.smithi026 (mon.0) 231 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-11-03T16:49:08.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:07 smithi026 conmon[32119]: audit 2021-11-03T16:49:07.297360+0000 mgr.smithi026.cnrxli (mgr.14162) 93 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-11-03T16:49:08.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:07 smithi026 conmon[32119]: audit 2021-11-03T16:49:07.303344+0000 mon.smithi026 (mon.0) 232 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.26:3000"}]: dispatch 2021-11-03T16:49:08.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:07 smithi026 conmon[32119]: audit 2021-11-03T16:49:07.303673+0000 mgr.smithi026.cnrxli (mgr.14162) 94 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.26:3000"}]: dispatch 2021-11-03T16:49:08.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:07 smithi026 conmon[32119]: audit 2021-11-03T16:49:07.306900+0000 mon.smithi026 (mon.0) 233 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:08.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:07 smithi026 conmon[32119]: audit 2021-11-03T16:49:07.309999+0000 mon.smithi026 (mon.0) 234 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-11-03T16:49:08.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:07 smithi026 conmon[32119]: audit 2021-11-03T 2021-11-03T16:49:08.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:07 smithi026 conmon[32119]: 16:49:07.310484+0000 mgr.smithi026.cnrxli 2021-11-03T16:49:08.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:07 smithi026 conmon[32119]: (mgr.14162) 95 : audit 2021-11-03T16:49:08.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:07 smithi026 conmon[32119]: [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-11-03T16:49:08.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:07 smithi026 conmon[32119]: audit 2021-11-03 2021-11-03T16:49:08.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:07 smithi026 conmon[32119]: T16:49:07.316697+0000 mon.smithi026 (mon.0 2021-11-03T16:49:08.178 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:07 smithi026 conmon[32119]: ) 235 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.26:9095"}]: dispatch 2021-11-03T16:49:08.178 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:07 smithi026 conmon[32119]: audit 2021- 2021-11-03T16:49:08.178 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:07 smithi026 conmon[32119]: 11-03T16:49:07. 2021-11-03T16:49:08.178 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:07 smithi026 conmon[32119]: 317088+0000 mgr.smithi026.cnrxli (mgr.14162) 2021-11-03T16:49:08.178 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:07 smithi026 conmon[32119]: 96 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.26:9095"}]: dispatch 2021-11-03T16:49:08.179 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:07 smithi026 conmon[32119]: audit 2021 2021-11-03T16:49:08.179 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:07 smithi026 conmon[32119]: -11-03T16:49:07. 2021-11-03T16:49:08.179 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:07 smithi026 conmon[32119]: 320608+0000 mon.smithi026 (mon.0) 2021-11-03T16:49:08.179 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:07 smithi026 conmon[32119]: 236 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:08.179 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:07 smithi026 conmon[32119]: audit 2021-11-03T16:49:08.180 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:07 smithi026 conmon[32119]: 2021-11-03T16:49:07 2021-11-03T16:49:08.180 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:07 smithi026 conmon[32119]: .323184+0000 mon.smithi026 (mon.0 2021-11-03T16:49:08.180 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:07 smithi026 conmon[32119]: ) 237 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:49:08.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:07 smithi194 conmon[35111]: audit 2021-11-03T16:49:06.891585+0000 mon.smithi026 (mon.0) 225 2021-11-03T16:49:08.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:07 smithi194 conmon[35111]: : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:08.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:07 smithi194 conmon[35111]: audit 2021-11-03T16:49:06.894820+0000 mon.smithi026 (mon.0) 226 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:08.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:07 smithi194 conmon[35111]: cluster 2021-11-03T16:49:06.996187+0000 mgr.smithi026.cnrxli (mgr.14162) 90 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:49:08.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:07 smithi194 conmon[35111]: audit 2021-11-03T16:49:07.285386+0000 mon.smithi026 (mon.0) 227 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:08.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:07 smithi194 conmon[35111]: audit 2021-11-03T16:49:07.288032+0000 mon.smithi026 (mon.0) 228 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-11-03T16:49:08.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:07 smithi194 conmon[35111]: audit 2021-11-03T16:49:07.288374+0000 mgr.smithi026.cnrxli (mgr.14162) 91 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-11-03T16:49:08.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:07 smithi194 conmon[35111]: audit 2021-11-03T16:49:07.289294+0000 mon.smithi026 (mon.0) 229 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.26:9093"}]: dispatch 2021-11-03T16:49:08.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:07 smithi194 conmon[35111]: audit 2021-11-03T16:49:07.289606+0000 mgr.smithi026.cnrxli (mgr.14162) 92 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.26:9093"}]: dispatch 2021-11-03T16:49:08.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:07 smithi194 conmon[35111]: audit 2021-11-03T16:49:07.293007+0000 mon.smithi026 (mon.0) 230 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:08.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:07 smithi194 conmon[35111]: audit 2021-11-03T16:49:07.297010+0000 mon.smithi026 (mon.0) 231 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-11-03T16:49:08.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:07 smithi194 conmon[35111]: audit 2021-11-03T16:49:07.297360+0000 mgr.smithi026.cnrxli (mgr.14162) 93 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-11-03T16:49:08.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:07 smithi194 conmon[35111]: audit 2021-11-03T16:49:07.303344+0000 mon.smithi026 (mon.0) 232 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.26:3000"}]: dispatch 2021-11-03T16:49:08.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:07 smithi194 conmon[35111]: audit 2021-11-03T16:49:07.303673+0000 mgr.smithi026.cnrxli (mgr.14162) 94 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.26:3000"}]: dispatch 2021-11-03T16:49:08.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:07 smithi194 conmon[35111]: audit 2021-11-03T16:49:07.306900+0000 mon.smithi026 (mon.0) 233 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:08.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:07 smithi194 conmon[35111]: audit 2021-11-03T16:49:07.309999 2021-11-03T16:49:08.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:07 smithi194 conmon[35111]: +0000 mon.smithi026 (mon.0) 234 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-11-03T16:49:08.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:07 smithi194 conmon[35111]: audit 2021-11-03T16 2021-11-03T16:49:08.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:07 smithi194 conmon[35111]: :49:07.310484+0000 mgr.smithi026.cnrxli (mgr.14162) 95 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-11-03T16:49:08.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:07 smithi194 conmon[35111]: audit 2021-11-03T16:49: 2021-11-03T16:49:08.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:07 smithi194 conmon[35111]: 07.316697+0000 mon.smithi026 (mon.0) 235 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.26:9095"}]: dispatch 2021-11-03T16:49:08.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:07 smithi194 conmon[35111]: 2021-11-03T16:49:08.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:07 smithi194 conmon[35111]: audit 2021-11 2021-11-03T16:49:08.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:07 smithi194 conmon[35111]: -03T16:49:07.317088+0000 mgr.smithi026.cnrxli (mgr.14162) 96 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.26:9095"}]: dispatch 2021-11-03T16:49:08.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:07 smithi194 conmon[35111]: audit 2021-11-03 2021-11-03T16:49:08.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:07 smithi194 conmon[35111]: T16:49:07.320608+0000 mon.smithi026 (mon.0) 236 : audit [INF] 2021-11-03T16:49:08.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:07 smithi194 conmon[35111]: from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:08.255 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:07 smithi194 conmon[35111]: audit 2021- 2021-11-03T16:49:08.255 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:07 smithi194 conmon[35111]: 11-03T16:49:07.323184+0000 mon.smithi026 (mon.0) 237 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:49:08.255 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:07 smithi194 conmon[35111]: 2021-11-03T16:49:10.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:10 smithi026 conmon[32119]: cluster 2021-11-03T16:49:08.996545+0000 mgr.smithi026.cnrxli (mgr.14162) 97 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:49:10.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:10 smithi026 conmon[32119]: audit 2021-11-03T16:49:09.053927+0000 mon.smithi026 (mon.0) 238 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:10.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:10 smithi026 conmon[32119]: audit 2021-11-03T16:49:09.159751+0000 mon.smithi026 (mon.0) 239 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T16:49:10.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:10 smithi026 conmon[32119]: audit 2021-11-03T16:49:09.162103+0000 mon.smithi026 (mon.0) 240 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T16:49:10.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:10 smithi194 conmon[35111]: cluster 2021-11-03T16:49:08.996545+0000 mgr.smithi026.cnrxli (mgr.14162) 97 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:49:10.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:10 smithi194 conmon[35111]: audit 2021-11-03T16:49:09.053927+0000 2021-11-03T16:49:10.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:10 smithi194 conmon[35111]: mon.smithi026 (mon.0) 238 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:10.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:10 smithi194 conmon[35111]: audit 2021-11-03T16:49:09.159751+0000 mon.smithi026 (mon.0) 239 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T16:49:10.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:10 smithi194 conmon[35111]: audit 2021-11-03T16:49:09.162103+0000 mon.smithi026 (mon.0) 240 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T16:49:10.543 INFO:teuthology.orchestra.run.smithi026.stderr:--> Zapping: /dev/vg_nvme/lv_3 2021-11-03T16:49:10.544 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2021-11-03T16:49:10.544 INFO:teuthology.orchestra.run.smithi026.stderr: stderr: 10+0 records in 2021-11-03T16:49:10.544 INFO:teuthology.orchestra.run.smithi026.stderr:10+0 records out 2021-11-03T16:49:10.544 INFO:teuthology.orchestra.run.smithi026.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.013223 s, 793 MB/s 2021-11-03T16:49:10.545 INFO:teuthology.orchestra.run.smithi026.stderr:--> Zapping successful for: 2021-11-03T16:49:10.884 INFO:journalctl@ceph.osd.0.smithi026.stdout:Nov 03 16:49:10 smithi026 conmon[50142]: debug 2021-11-03T16:49:10.818+0000 7fd7fabf4080 -1 osd.0 0 log_to_monitors {default=true} 2021-11-03T16:49:11.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:11 smithi026 conmon[32119]: audit 2021-11-03T16:49:10.822134+0000 mon.smithi026 ( 2021-11-03T16:49:11.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:11 smithi026 conmon[32119]: mon.0) 241 : audit [INF] from='osd.0 [v2:172.21.15.26:6802/134495914,v1:172.21.15.26:6803/134495914]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-11-03T16:49:11.356 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph orch daemon add osd smithi026:vg_nvme/lv_3 2021-11-03T16:49:11.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:11 smithi194 conmon[35111]: audit 2021-11-03T16:49:10.822134+0000 mon.smithi026 (mon.0) 241 2021-11-03T16:49:11.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:11 smithi194 conmon[35111]: : audit [INF] from='osd.0 [v2:172.21.15.26:6802/134495914,v1:172.21.15.26:6803/134495914]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-11-03T16:49:12.172 INFO:journalctl@ceph.osd.0.smithi026.stdout:Nov 03 16:49:12 smithi026 conmon[50142]: debug 2021-11-03T16:49:12.064+0000 7fd7f1165700 -1 osd.0 0 waiting for initial osdmap 2021-11-03T16:49:12.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:12 smithi026 conmon[32119]: cluster 2021-11-03T16:49:10 2021-11-03T16:49:12.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:12 smithi026 conmon[32119]: .996808+0000 mgr.smithi026.cnrxli (mgr.14162) 98 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:49:12.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:12 smithi026 conmon[32119]: audit 2021-11-03T16:49:11.059467+0000 mon.smithi026 (mon.0) 242 : audit [INF] from='osd.0 [v2:172.21.15.26:6802/134495914,v1:172.21.15.26:6803/134495914]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-11-03T16:49:12.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:12 smithi026 conmon[32119]: cluster 2021-11-03T16:49:11.059530+0000 mon.smithi026 (mon.0) 243 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2021-11-03T16:49:12.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:12 smithi026 conmon[32119]: audit 2021-11-03T16:49:11.059662+0000 mon.smithi026 (mon.0) 244 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-11-03T16:49:12.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:12 smithi026 conmon[32119]: audit 2021-11-03T16:49:11.059982+0000 mon.smithi026 (mon.0) 245 : audit [INF] from='osd.0 [v2:172.21.15.26:6802/134495914,v1:172.21.15.26:6803/134495914]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2021-11-03T16:49:12.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:12 smithi194 conmon[35111]: cluster 2021-11-03T16:49:10.996808+0000 mgr.smithi026.cnrxli (mgr.14162) 98 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:49:12.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:12 smithi194 conmon[35111]: audit 2021-11-03T16:49:11.059467+0000 mon.smithi026 (mon.0) 242 : audit [INF] from='osd.0 [v2:172.21.15.26:6802/134495914,v1:172.21.15.26:6803/134495914]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-11-03T16:49:12.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:12 smithi194 conmon[35111]: cluster 2021-11-03T16:49:11 2021-11-03T16:49:12.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:12 smithi194 conmon[35111]: .059530+0000 mon.smithi026 (mon.0) 243 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2021-11-03T16:49:12.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:12 smithi194 conmon[35111]: audit 2021-11-03T16:49: 2021-11-03T16:49:12.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:12 smithi194 conmon[35111]: 11.059662+0000 mon.smithi026 (mon.0) 244 : 2021-11-03T16:49:12.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:12 smithi194 conmon[35111]: audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-11-03T16:49:12.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:12 smithi194 conmon[35111]: audit 2021-11-03T16:49 2021-11-03T16:49:12.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:12 smithi194 conmon[35111]: :11.059982+0000 mon.smithi026 (mon.0) 245 2021-11-03T16:49:12.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:12 smithi194 conmon[35111]: : audit [INF] from='osd.0 [v2:172.21.15.26:6802/134495914,v1:172.21.15.26:6803/134495914]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2021-11-03T16:49:13.404 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:13 smithi026 conmon[32119]: audit 2021-11-03T16:49:12.061442+0000 mon.smithi026 (mon.0) 246 : audit [INF] from='osd.0 [v2:172.21.15.26:6802/134495914,v1:172.21.15.26:6803/134495914]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]': finished 2021-11-03T16:49:13.405 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:13 smithi026 conmon[32119]: cluster 2021-11-03T16:49:12.061504+0000 mon.smithi026 (mon.0) 247 : cluster [DBG] osdmap e8: 1 total, 0 up, 1 in 2021-11-03T16:49:13.405 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:13 smithi026 conmon[32119]: audit 2021-11-03T16:49:12.061805+0000 mon.smithi026 (mon.0) 248 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-11-03T16:49:13.405 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:13 smithi026 conmon[32119]: audit 2021-11-03T16:49:12.065339+0000 mon.smithi026 (mon.0) 249 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-11-03T16:49:13.473 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:13 smithi194 conmon[35111]: audit 2021-11-03T16:49:12.061442+0000 mon.smithi026 (mon.0) 246 : audit [INF] from='osd.0 [v2:172.21.15.26:6802/134495914,v1:172.21.15.26:6803/134495914]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]': finished 2021-11-03T16:49:13.473 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:13 smithi194 conmon[35111]: cluster 2021-11-03T16:49:13.473 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:13 smithi194 conmon[35111]: 2021-11-03T16:49:12.061504+0000 mon.smithi026 (mon.0) 247 : cluster [DBG] osdmap e8: 1 total, 0 up, 1 in 2021-11-03T16:49:13.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:13 smithi194 conmon[35111]: audit 2021-11-03T16:49:12.061805+0000 mon.smithi026 (mon.0) 248 : audit [DBG] 2021-11-03T16:49:13.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:13 smithi194 conmon[35111]: from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-11-03T16:49:13.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:13 smithi194 conmon[35111]: audit 2021-11-03T 2021-11-03T16:49:13.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:13 smithi194 conmon[35111]: 16:49:12.065339+0000 mon.smithi026 (mon.0) 249 : audit 2021-11-03T16:49:13.475 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:13 smithi194 conmon[35111]: [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-11-03T16:49:13.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:13.771+0000 7f238f206700 1 -- 172.21.15.26:0/3336789697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23880602d0 msgr2=0x7f23880f92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:49:13.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:13.771+0000 7f238f206700 1 --2- 172.21.15.26:0/3336789697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23880602d0 0x7f23880f92e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f237c004660 tx=0x7f237c009b30).stop 2021-11-03T16:49:13.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:13.771+0000 7f238f206700 1 -- 172.21.15.26:0/3336789697 shutdown_connections 2021-11-03T16:49:13.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:13.771+0000 7f238f206700 1 --2- 172.21.15.26:0/3336789697 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23880f9860 0x7f23880fbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:49:13.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:13.771+0000 7f238f206700 1 --2- 172.21.15.26:0/3336789697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23880602d0 0x7f23880f92e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:49:13.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:13.771+0000 7f238f206700 1 -- 172.21.15.26:0/3336789697 >> 172.21.15.26:0/3336789697 conn(0x7f23880f0d40 msgr2=0x7f23880f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:49:13.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:13.771+0000 7f238f206700 1 -- 172.21.15.26:0/3336789697 shutdown_connections 2021-11-03T16:49:13.770 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:13.771+0000 7f238f206700 1 -- 172.21.15.26:0/3336789697 wait complete. 2021-11-03T16:49:13.770 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:13.771+0000 7f238f206700 1 Processor -- start 2021-11-03T16:49:13.770 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:13.771+0000 7f238f206700 1 -- start start 2021-11-03T16:49:13.770 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:13.772+0000 7f238f206700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23880602d0 0x7f23880f6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:49:13.770 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:13.772+0000 7f238f206700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23880f9860 0x7f23880f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:49:13.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:13.772+0000 7f238f206700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23880f5740 con 0x7f23880f9860 2021-11-03T16:49:13.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:13.772+0000 7f238f206700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23880f5880 con 0x7f23880602d0 2021-11-03T16:49:13.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:13.772+0000 7f2387fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23880f9860 0x7f23880f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:49:13.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:13.772+0000 7f2387fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23880f9860 0x7f23880f51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49580/0 (socket says 172.21.15.26:49580) 2021-11-03T16:49:13.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:13.772+0000 7f2387fff700 1 -- 172.21.15.26:0/4223474435 learned_addr learned my addr 172.21.15.26:0/4223474435 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:49:13.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:13.772+0000 7f238cfa2700 1 --2- 172.21.15.26:0/4223474435 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23880602d0 0x7f23880f6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:49:13.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:13.772+0000 7f2387fff700 1 -- 172.21.15.26:0/4223474435 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23880602d0 msgr2=0x7f23880f6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:49:13.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:13.772+0000 7f2387fff700 1 --2- 172.21.15.26:0/4223474435 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23880602d0 0x7f23880f6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:49:13.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:13.772+0000 7f2387fff700 1 -- 172.21.15.26:0/4223474435 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f237c005040 con 0x7f23880f9860 2021-11-03T16:49:13.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:13.772+0000 7f2387fff700 1 --2- 172.21.15.26:0/4223474435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23880f9860 0x7f23880f51e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f2374002700 tx=0x7f2374009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:49:13.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:13.772+0000 7f23857fa700 1 -- 172.21.15.26:0/4223474435 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23740079c0 con 0x7f23880f9860 2021-11-03T16:49:13.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:13.772+0000 7f23857fa700 1 -- 172.21.15.26:0/4223474435 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f237400f040 con 0x7f23880f9860 2021-11-03T16:49:13.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:13.772+0000 7f238f206700 1 -- 172.21.15.26:0/4223474435 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23880f5b60 con 0x7f23880f9860 2021-11-03T16:49:13.774 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:13.772+0000 7f23857fa700 1 -- 172.21.15.26:0/4223474435 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23740146e0 con 0x7f23880f9860 2021-11-03T16:49:13.774 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:13.773+0000 7f238f206700 1 -- 172.21.15.26:0/4223474435 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f238810ef70 con 0x7f23880f9860 2021-11-03T16:49:13.775 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:13.774+0000 7f238f206700 1 -- 172.21.15.26:0/4223474435 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2388045ad0 con 0x7f23880f9860 2021-11-03T16:49:13.775 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:13.774+0000 7f23857fa700 1 -- 172.21.15.26:0/4223474435 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f237401b060 con 0x7f23880f9860 2021-11-03T16:49:13.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:13.775+0000 7f23857fa700 1 --2- 172.21.15.26:0/4223474435 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f237805c2b0 0x7f237805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:49:13.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:13.775+0000 7f23857fa700 1 -- 172.21.15.26:0/4223474435 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1849+0+0 (secure 0 0 0) 0x7f2374075130 con 0x7f23880f9860 2021-11-03T16:49:13.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:13.775+0000 7f238cfa2700 1 --2- 172.21.15.26:0/4223474435 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f237805c2b0 0x7f237805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:49:13.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:13.775+0000 7f238cfa2700 1 --2- 172.21.15.26:0/4223474435 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f237805c2b0 0x7f237805e770 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f237c005010 tx=0x7f237c009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:49:13.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:13.778+0000 7f23857fa700 1 -- 172.21.15.26:0/4223474435 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f2374048c50 con 0x7f23880f9860 2021-11-03T16:49:13.962 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:13.966+0000 7f238f206700 1 -- 172.21.15.26:0/4223474435 --> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f2388057f10 con 0x7f237805c2b0 2021-11-03T16:49:14.315 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:14 smithi026 conmon[32119]: cluster 2021-11-03T16:49:11 2021-11-03T16:49:14.316 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:14 smithi026 conmon[32119]: .853541+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2021-11-03T16:49:14.316 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:14 smithi026 conmon[32119]: cluster 2021-11-03T16:49:11.853658+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2021-11-03T16:49:14.316 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:14 smithi026 conmon[32119]: cluster 2021-11-03T16:49:12.997032+0000 mgr.smithi026.cnrxli (mgr.14162) 99 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:49:14.317 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:14 smithi026 conmon[32119]: cluster 2021-11-03T16:49:13.066438+0000 mon.smithi026 (mon.0) 250 : cluster [INF] osd.0 [v2:172.21.15.26:6802/134495914,v1:172.21.15.26:6803/134495914] boot 2021-11-03T16:49:14.317 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:14 smithi026 conmon[32119]: cluster 2021-11-03T16:49:13.066470+0000 mon.smithi026 (mon.0) 251 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2021-11-03T16:49:14.317 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:14 smithi026 conmon[32119]: audit 2021-11-03T16:49:13.066836+0000 mon.smithi026 (mon.0) 252 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-11-03T16:49:14.317 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:14 smithi026 conmon[32119]: audit 2021-11-03T16:49:13.797568+0000 mon.smithi026 (mon.0) 253 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:14.318 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:14 smithi026 conmon[32119]: audit 2021-11-03T16:49:13.969360+0000 mon.smithi026 (mon.0) 254 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-11-03T16:49:14.318 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:14 smithi026 conmon[32119]: audit 2021-11-03T16:49:13.971054+0000 mon.smithi026 (mon.0) 255 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-11-03T16:49:14.318 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:14 smithi026 conmon[32119]: audit 2021-11-03T16:49:13.971740+0000 mon.smithi026 (mon.0) 256 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:49:14.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:14 smithi194 conmon[35111]: cluster 2021-11-03T16:49:11.853541+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2021-11-03T16:49:14.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:14 smithi194 conmon[35111]: cluster 2021-11-03T16:49:11.853658+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2021-11-03T16:49:14.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:14 smithi194 conmon[35111]: cluster 2021-11-03T16:49: 2021-11-03T16:49:14.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:14 smithi194 conmon[35111]: 12.997032+0000 mgr.smithi026.cnrxli (mgr.14162) 99 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-11-03T16:49:14.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:14 smithi194 conmon[35111]: cluster 2021-11-03 2021-11-03T16:49:14.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:14 smithi194 conmon[35111]: T16:49:13.066438+0000 mon.smithi026 (mon 2021-11-03T16:49:14.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:14 smithi194 conmon[35111]: .0) 250 : cluster [INF] osd.0 [v2:172.21.15.26:6802/134495914,v1:172.21.15.26:6803/134495914] boot 2021-11-03T16:49:14.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:14 smithi194 conmon[35111]: cluster 2021- 2021-11-03T16:49:14.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:14 smithi194 conmon[35111]: 11-03T16:49:13.066470+0000 mon.smithi026 ( 2021-11-03T16:49:14.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:14 smithi194 conmon[35111]: mon.0) 251 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2021-11-03T16:49:14.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:14 smithi194 conmon[35111]: audit 2021-11- 2021-11-03T16:49:14.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:14 smithi194 conmon[35111]: 03T16:49:13.066836+0000 mon.smithi026 ( 2021-11-03T16:49:14.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:14 smithi194 conmon[35111]: mon.0) 252 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-11-03T16:49:14.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:14 smithi194 conmon[35111]: audit 2021 2021-11-03T16:49:14.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:14 smithi194 conmon[35111]: -11-03T16:49:13.797568+0000 2021-11-03T16:49:14.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:14 smithi194 conmon[35111]: mon.smithi026 (mon.0) 253 : audit [INF] 2021-11-03T16:49:14.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:14 smithi194 conmon[35111]: from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:14.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:14 smithi194 conmon[35111]: audit 2021-11-03T16:49: 2021-11-03T16:49:14.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:14 smithi194 conmon[35111]: 13.969360+0000 mon.smithi026 (mon.0) 254 : audit 2021-11-03T16:49:14.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:14 smithi194 conmon[35111]: [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-11-03T16:49:14.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:14 smithi194 conmon[35111]: audit 2021-11-03T16:49 2021-11-03T16:49:14.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:14 smithi194 conmon[35111]: :13.971054+0000 mon.smithi026 (mon.0) 255 : 2021-11-03T16:49:14.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:14 smithi194 conmon[35111]: audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-11-03T16:49:14.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:14 smithi194 conmon[35111]: audit 2021-11-03T16 2021-11-03T16:49:14.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:14 smithi194 conmon[35111]: :49:13.971740+0000 mon.smithi026 (mon.0 2021-11-03T16:49:14.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:14 smithi194 conmon[35111]: ) 256 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:49:15.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:15 smithi026 conmon[32119]: audit 2021-11-03T16:49:13.968428+0000 mgr.smithi026.cnrxli (mgr.14162) 2021-11-03T16:49:15.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:15 smithi026 conmon[32119]: 100 : audit [DBG] from='client.14230 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:49:15.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:15 smithi026 conmon[32119]: cephadm 2021-11-03T16:49:13.970836+0000 mgr.smithi026.cnrxli (mgr.14162) 101 : cephadm [INF] Applying service osd.None on host smithi026... 2021-11-03T16:49:15.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:15 smithi026 conmon[32119]: cluster 2021-11-03T16:49:14.799185+0000 mon.smithi026 (mon.0) 257 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2021-11-03T16:49:15.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:15 smithi194 conmon[35111]: audit 2021-11-03T16:49:13.968428+0000 mgr.smithi026.cnrxli (mgr.14162 2021-11-03T16:49:15.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:15 smithi194 conmon[35111]: ) 100 : audit [DBG] from='client.14230 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:49:15.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:15 smithi194 conmon[35111]: cephadm 2021-11-03T16:49:13.970836+0000 mgr.smithi026.cnrxli (mgr.14162) 101 : cephadm [INF] Applying service osd.None on host smithi026... 2021-11-03T16:49:15.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:15 smithi194 conmon[35111]: cluster 2021-11-03T16:49:14.799185 2021-11-03T16:49:15.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:15 smithi194 conmon[35111]: +0000 mon.smithi026 (mon.0) 257 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2021-11-03T16:49:15.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:15 smithi194 conmon[35111]: 2021-11-03T16:49:16.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:16 smithi026 conmon[32119]: cluster 2021-11-03T16:49:14.997434+0000 2021-11-03T16:49:16.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:16 smithi026 conmon[32119]: mgr.smithi026.cnrxli (mgr.14162) 102 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-11-03T16:49:16.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:16 smithi194 conmon[35111]: cluster 2021-11-03T16:49:14.997434+0000 mgr.smithi026.cnrxli (mgr.14162) 102 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-11-03T16:49:18.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:18 smithi026 conmon[32119]: cluster 2021-11-03T16: 2021-11-03T16:49:18.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:18 smithi026 conmon[32119]: 49:16.997760+0000 mgr.smithi026.cnrxli (mgr.14162) 103 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-11-03T16:49:18.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:18 smithi026 conmon[32119]: audit 2021-11-03T16:49:18.036350+0000 mon.smithi026 (mon.0) 258 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:18.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:18 smithi026 conmon[32119]: audit 2021-11-03T16:49:18.039878+0000 mon.smithi026 (mon.0) 259 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:18.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:18 smithi026 conmon[32119]: audit 2021-11-03T16:49:18.042606+0000 mon.smithi026 (mon.0) 260 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:49:18.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:18 smithi194 conmon[35111]: cluster 2021-11-03T16:49:16.997760+0000 mgr.smithi026.cnrxli (mgr.14162) 103 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-11-03T16:49:18.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:18 smithi194 conmon[35111]: audit 2021-11-03T16:49:18.036350+0000 mon.smithi026 (mon.0) 258 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:18.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:18 smithi194 conmon[35111]: audit 2021-11-03T16:49:18.039878+0000 mon.smithi026 (mon.0) 259 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:18.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:18 smithi194 conmon[35111]: 2021-11-03T16:49:18.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:18 smithi194 conmon[35111]: audit 2021-11-03T16:49 2021-11-03T16:49:18.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:18 smithi194 conmon[35111]: :18.042606+0000 mon.smithi026 (mon.0) 260 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:49:19.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:19 smithi026 conmon[32119]: cephadm 2021-11-03T16:49:18.031660+0000 mgr.smithi026.cnrxli (mgr.14162) 104 : cephadm [INF] Detected new or changed devices on smithi026 2021-11-03T16:49:19.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:19 smithi026 conmon[32119]: audit 2021-11-03T16:49:18.722368+0000 mon.smithi026 (mon.0) 261 : audit [INF] from='client.? 172.21.15.26:0/3611584736' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c8f520a-9e32-4b5f-bd70-9ba30526ccfe"}]: dispatch 2021-11-03T16:49:19.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:19 smithi026 conmon[32119]: audit 2021-11-03T16:49:18.725741+0000 mon.smithi026 (mon.0) 262 : audit [INF] from='client.? 172.21.15.26:0/3611584736' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9c8f520a-9e32-4b5f-bd70-9ba30526ccfe"}]': finished 2021-11-03T16:49:19.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:19 smithi026 conmon[32119]: cluster 2021-11-03T16:49:18.725789+0000 mon.smithi026 (mon.0) 263 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2021-11-03T16:49:19.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:19 smithi026 conmon[32119]: audit 2021-11-03T16:49:18.725879+0000 mon.smithi026 (mon.0) 264 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-11-03T16:49:19.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:19 smithi194 conmon[35111]: cephadm 2021-11-03T16:49:18.031660+0000 mgr.smithi026.cnrxli (mgr.14162) 104 : cephadm [INF] Detected new or changed devices on smithi026 2021-11-03T16:49:19.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:19 smithi194 conmon[35111]: audit 2021-11-03T16:49:18.722368+0000 mon.smithi026 (mon.0) 261 : audit [INF] from='client.? 172.21.15.26:0/3611584736' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c8f520a-9e32-4b5f-bd70-9ba30526ccfe"}]: dispatch 2021-11-03T16:49:19.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:19 smithi194 conmon[35111]: audit 2021-11-03T16:49:18.725741+0000 mon.smithi026 (mon.0) 262 : audit [INF] from='client.? 172.21.15.26:0/3611584736' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9c8f520a-9e32-4b5f-bd70-9ba30526ccfe"}]': finished 2021-11-03T16:49:19.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:19 smithi194 conmon[35111]: cluster 2021-11-03T16:49:18.725789+0000 mon.smithi026 (mon.0) 263 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2021-11-03T16:49:19.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:19 smithi194 conmon[35111]: audit 2021-11-03T16:49:18.725879+0000 mon.smithi026 (mon.0) 264 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-11-03T16:49:20.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:20 smithi026 conmon[32119]: cluster 2021-11-03T16:49:18.998052+0000 mgr.smithi026.cnrxli 2021-11-03T16:49:20.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:20 smithi026 conmon[32119]: (mgr.14162) 105 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-11-03T16:49:20.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:20 smithi026 conmon[32119]: audit 2021-11-03T16:49:19.290404+0000 mon.smithi026 (mon.0) 265 : audit [DBG] from='client.? 172.21.15.26:0/685140667' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-11-03T16:49:20.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:20 smithi026 conmon[32119]: audit 2021-11-03T16:49:19.754969+0000 mon.smithi026 (mon.0) 266 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:20.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:20 smithi194 conmon[35111]: cluster 2021-11-03T16:49:18.998052+0000 mgr.smithi026.cnrxli (mgr.14162) 2021-11-03T16:49:20.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:20 smithi194 conmon[35111]: 105 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-11-03T16:49:20.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:20 smithi194 conmon[35111]: audit 2021-11-03T16:49:19.290404+0000 mon.smithi026 (mon.0) 265 : audit [DBG] from='client.? 172.21.15.26:0/685140667' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-11-03T16:49:20.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:20 smithi194 conmon[35111]: audit 2021-11-03T16:49:19.754969+0000 mon.smithi026 (mon.0) 266 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:22.326 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:22 smithi026 conmon[32119]: cluster 2021-11-03T16:49:20.998418+0000 mgr.smithi026.cnrxli (mgr.14162) 106 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-11-03T16:49:22.327 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:22 smithi026 conmon[32119]: audit 2021-11-03T16:49:21.881719+0000 mon.smithi026 (mon.0) 267 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:22.327 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:22 smithi026 conmon[32119]: audit 2021-11-03T16:49:21.884701+0000 mon.smithi026 (mon.0) 268 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:22.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:22 smithi194 conmon[35111]: cluster 2021-11-03T16:49:20.998418+0000 mgr.smithi026.cnrxli (mgr. 2021-11-03T16:49:22.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:22 smithi194 conmon[35111]: 14162) 106 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-11-03T16:49:22.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:22 smithi194 conmon[35111]: audit 2021-11-03T16:49:21.881719+0000 mon.smithi026 (mon.0) 267 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:22.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:22 smithi194 conmon[35111]: audit 2021-11-03T16:49:21.884701+0000 2021-11-03T16:49:22.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:22 smithi194 conmon[35111]: mon.smithi026 (mon.0) 268 : audit 2021-11-03T16:49:22.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:22 smithi194 conmon[35111]: [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:24.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:24 smithi026 conmon[32119]: cluster 2021-11-03T16:49:22.998793+0000 mgr.smithi026.cnrxli (mgr.14162) 107 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-11-03T16:49:24.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:24 smithi194 conmon[35111]: cluster 2021-11-03T16:49:22.998793+0000 mgr.smithi026.cnrxli (mgr.14162) 107 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-11-03T16:49:26.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:26 smithi026 conmon[32119]: cluster 2021-11-03T16:49: 2021-11-03T16:49:26.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:26 smithi026 conmon[32119]: 24.999048+0000 mgr.smithi026.cnrxli (mgr.14162) 108 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-11-03T16:49:26.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:26 smithi026 conmon[32119]: audit 2021-11-03T 2021-11-03T16:49:26.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:26 smithi026 conmon[32119]: 16:49:25.912593+0000 mon.smithi026 (mon.0) 269 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-11-03T16:49:26.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:26 smithi026 conmon[32119]: audit 2021-11-03T16:49:25.913426+0000 mon.smithi026 (mon.0) 270 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:49:26.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:26 smithi194 conmon[35111]: cluster 2021-11-03T16:49:24.999048+0000 mgr.smithi026.cnrxli (mgr.14162) 108 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-11-03T16:49:26.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:26 smithi194 conmon[35111]: audit 2021-11-03T16:49:25.912593+0000 mon.smithi026 (mon.0) 269 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-11-03T16:49:26.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:26 smithi194 conmon[35111]: audit 2021-11-03T16:49:26.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:26 smithi194 conmon[35111]: 2021-11-03T16:49:25.913426+0000 mon.smithi026 (mon. 2021-11-03T16:49:26.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:26 smithi194 conmon[35111]: 0) 270 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:49:27.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:27 smithi026 conmon[32119]: cephadm 2021-11-03T16:49:25.914105+0000 mgr.smithi026.cnrxli (mgr.14162) 109 : cephadm [INF] Deploying daemon osd.1 on smithi026 2021-11-03T16:49:27.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:27 smithi194 conmon[35111]: cephadm 2021-11-03T16:49:25.914105+0000 mgr.smithi026.cnrxli 2021-11-03T16:49:27.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:27 smithi194 conmon[35111]: (mgr.14162) 109 : cephadm [INF] Deploying daemon osd.1 on smithi026 2021-11-03T16:49:28.359 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:28 smithi026 conmon[32119]: cluster 2021-11-03T16:49:26.999316+0000 mgr.smithi026.cnrxli (mgr.14162) 110 : 2021-11-03T16:49:28.360 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:28 smithi026 conmon[32119]: cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-11-03T16:49:28.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:28 smithi194 conmon[35111]: cluster 2021-11-03T16:49:26.999316+0000 mgr.smithi026.cnrxli (mgr.14162) 110 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-11-03T16:49:29.692 INFO:teuthology.orchestra.run.smithi026.stdout:Created osd(s) 1 on host 'smithi026' 2021-11-03T16:49:29.692 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:29.694+0000 7f23857fa700 1 -- 172.21.15.26:0/4223474435 <== mgr.14162 v2:172.21.15.26:6800/3029163595 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f2388057f10 con 0x7f237805c2b0 2021-11-03T16:49:29.693 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:29.697+0000 7f238f206700 1 -- 172.21.15.26:0/4223474435 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f237805c2b0 msgr2=0x7f237805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:49:29.693 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:29.697+0000 7f238f206700 1 --2- 172.21.15.26:0/4223474435 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f237805c2b0 0x7f237805e770 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f237c005010 tx=0x7f237c009b30).stop 2021-11-03T16:49:29.693 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:29.697+0000 7f238f206700 1 -- 172.21.15.26:0/4223474435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23880f9860 msgr2=0x7f23880f51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:49:29.694 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:29.697+0000 7f238f206700 1 --2- 172.21.15.26:0/4223474435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23880f9860 0x7f23880f51e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f2374002700 tx=0x7f2374009d60).stop 2021-11-03T16:49:29.694 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:29.698+0000 7f238f206700 1 -- 172.21.15.26:0/4223474435 shutdown_connections 2021-11-03T16:49:29.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:29.698+0000 7f238f206700 1 --2- 172.21.15.26:0/4223474435 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f237805c2b0 0x7f237805e770 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:49:29.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:29.698+0000 7f238f206700 1 --2- 172.21.15.26:0/4223474435 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23880602d0 0x7f23880f6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:49:29.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:29.698+0000 7f238f206700 1 --2- 172.21.15.26:0/4223474435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23880f9860 0x7f23880f51e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:49:29.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:29.698+0000 7f238f206700 1 -- 172.21.15.26:0/4223474435 >> 172.21.15.26:0/4223474435 conn(0x7f23880f0d40 msgr2=0x7f23880f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:49:29.696 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:29.698+0000 7f238f206700 1 -- 172.21.15.26:0/4223474435 shutdown_connections 2021-11-03T16:49:29.696 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:29.698+0000 7f238f206700 1 -- 172.21.15.26:0/4223474435 wait complete. 2021-11-03T16:49:30.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:30 smithi026 conmon[32119]: cluster 2021-11-03T16:49:28.999755+0000 mgr.smithi026.cnrxli (mgr.14162) 111 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-11-03T16:49:30.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:30 smithi026 conmon[32119]: audit 2021-11-03T16:49:29.684518+0000 mon.smithi026 (mon.0) 271 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:49:30.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:30 smithi026 conmon[32119]: audit 2021-11-03T16:49:29.688210+0000 mon.smithi026 (mon.0) 272 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:30.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:30 smithi026 conmon[32119]: audit 2021-11-03T16:49:29.695036+0000 mon.smithi026 (mon.0) 273 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:30.388 DEBUG:teuthology.orchestra.run.smithi026:osd.1> sudo journalctl -f -n 0 -u ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c@osd.1.service 2021-11-03T16:49:30.392 INFO:tasks.cephadm:Deploying osd.2 on smithi026 with /dev/vg_nvme/lv_2... 2021-11-03T16:49:30.393 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2021-11-03T16:49:30.434 INFO:journalctl@ceph.osd.1.smithi026.stdout:-- Logs begin at Wed 2021-11-03 16:35:12 UTC. -- 2021-11-03T16:49:30.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:30 smithi194 conmon[35111]: cluster 2021-11-03T16:49: 2021-11-03T16:49:30.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:30 smithi194 conmon[35111]: 28.999755+0000 mgr.smithi026.cnrxli (mgr.14162) 111 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-11-03T16:49:30.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:30 smithi194 conmon[35111]: audit 2021-11-03T16:49:30.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:30 smithi194 conmon[35111]: 2021-11-03T16: 2021-11-03T16:49:30.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:30 smithi194 conmon[35111]: 49:29.684518+0000 mon.smithi026 2021-11-03T16:49:30.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:30 smithi194 conmon[35111]: (mon.0) 271 : audit 2021-11-03T16:49:30.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:30 smithi194 conmon[35111]: [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:49:30.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:30 smithi194 conmon[35111]: audit 2021- 2021-11-03T16:49:30.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:30 smithi194 conmon[35111]: 11-03T16:49:29. 2021-11-03T16:49:30.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:30 smithi194 conmon[35111]: 688210+0000 mon.smithi026 (mon.0 2021-11-03T16:49:30.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:30 smithi194 conmon[35111]: ) 272 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:30.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:30 smithi194 conmon[35111]: audit 2021 2021-11-03T16:49:30.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:30 smithi194 conmon[35111]: -11-03T16:49: 2021-11-03T16:49:30.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:30 smithi194 conmon[35111]: 29.695036+0000 mon.smithi026 (mon 2021-11-03T16:49:30.505 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:30 smithi194 conmon[35111]: .0) 273 : audit 2021-11-03T16:49:30.505 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:30 smithi194 conmon[35111]: [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:32.363 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:32 smithi026 conmon[32119]: cluster 2021-11-03T16:49:31.000017+0000 mgr.smithi026.cnrxli (mgr.14162) 112 : cluster [DBG] pgmap v71: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-11-03T16:49:32.363 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:32 smithi026 conmon[32119]: audit 2021-11-03T16:49:31.390783+0000 mon.smithi026 (mon.0) 274 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:32.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:32 smithi194 conmon[35111]: cluster 2021-11-03T16:49:31.000017+0000 mgr.smithi026.cnrxli (mgr.14162) 112 : cluster [DBG] pgmap v71: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-11-03T16:49:32.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:32 smithi194 conmon[35111]: audit 2021-11-03T16:49:31.390783+0000 mon.smithi026 (mon.0) 274 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:33.096 INFO:teuthology.orchestra.run.smithi026.stderr:--> Zapping: /dev/vg_nvme/lv_2 2021-11-03T16:49:33.097 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2021-11-03T16:49:33.097 INFO:teuthology.orchestra.run.smithi026.stderr: stderr: 10+0 records in 2021-11-03T16:49:33.097 INFO:teuthology.orchestra.run.smithi026.stderr:10+0 records out 2021-11-03T16:49:33.097 INFO:teuthology.orchestra.run.smithi026.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00943843 s, 1.1 GB/s 2021-11-03T16:49:33.098 INFO:teuthology.orchestra.run.smithi026.stderr: stderr: 2021-11-03T16:49:33.098 INFO:teuthology.orchestra.run.smithi026.stderr:--> Zapping successful for: 2021-11-03T16:49:33.922 INFO:journalctl@ceph.osd.1.smithi026.stdout:Nov 03 16:49:33 smithi026 conmon[56412]: debug 2021-11-03T16:49:33.628+0000 7f1afd1e8080 -1 osd.1 0 log_to_monitors {default=true} 2021-11-03T16:49:33.970 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph orch daemon add osd smithi026:vg_nvme/lv_2 2021-11-03T16:49:34.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:34 smithi026 conmon[32119]: cluster 2021-11-03T16:49:33.000330+0000 mgr.smithi026.cnrxli (mgr.14162) 113 : 2021-11-03T16:49:34.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:34 smithi026 conmon[32119]: cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-11-03T16:49:34.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:34 smithi026 conmon[32119]: audit 2021-11-03T16:49:33.633092+0000 mon.smithi026 (mon.0) 275 : audit [INF] from='osd.1 [v2:172.21.15.26:6810/2411537943,v1:172.21.15.26:6811/2411537943]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-11-03T16:49:34.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:34 smithi194 conmon[35111]: cluster 2021-11-03T16:49:33.000330+0000 mgr.smithi026.cnrxli (mgr.14162) 113 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-11-03T16:49:34.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:34 smithi194 conmon[35111]: audit 2021-11-03T16:49:33.633092+0000 mon.smithi026 (mon.0) 275 : audit [INF] from='osd.1 [v2:172.21.15.26:6810/2411537943,v1:172.21.15.26:6811/2411537943]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-11-03T16:49:35.172 INFO:journalctl@ceph.osd.1.smithi026.stdout:Nov 03 16:49:35 smithi026 conmon[56412]: debug 2021-11-03T16:49:35.106+0000 7f1af3759700 -1 osd.1 0 waiting for initial osdmap 2021-11-03T16:49:35.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:35 smithi026 conmon[32119]: audit 2021-11-03T16:49:34. 2021-11-03T16:49:35.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:35 smithi026 conmon[32119]: 103093+0000 mon.smithi026 (mon.0) 276 : audit [INF] from='osd.1 [v2:172.21.15.26:6810/2411537943,v1:172.21.15.26:6811/2411537943]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-11-03T16:49:35.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:35 smithi026 conmon[32119]: cluster 2021-11-03T16:49:34.103171+0000 mon.smithi026 (mon.0) 277 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2021-11-03T16:49:35.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:35 smithi026 conmon[32119]: audit 2021-11-03T16:49:34.103499+0000 mon.smithi026 (mon.0) 278 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-11-03T16:49:35.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:35 smithi026 conmon[32119]: audit 2021-11-03T16:49:34.103806+0000 mon.smithi026 (mon.0) 279 : audit [INF] from='osd.1 [v2:172.21.15.26:6810/2411537943,v1:172.21.15.26:6811/2411537943]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2021-11-03T16:49:35.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:35 smithi194 conmon[35111]: audit 2021-11-03T16:49:34.103093+0000 2021-11-03T16:49:35.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:35 smithi194 conmon[35111]: mon.smithi026 (mon.0) 276 : audit [INF] from='osd.1 [v2:172.21.15.26:6810/2411537943,v1:172.21.15.26:6811/2411537943]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-11-03T16:49:35.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:35 smithi194 conmon[35111]: cluster 2021-11-03T16:49 2021-11-03T16:49:35.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:35 smithi194 conmon[35111]: :34.103171+0000 mon.smithi026 (mon.0) 277 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2021-11-03T16:49:35.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:35 smithi194 conmon[35111]: audit 2021-11-03T16: 2021-11-03T16:49:35.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:35 smithi194 conmon[35111]: 49:34.103499+0000 mon.smithi026 (mon.0) 278 : audit 2021-11-03T16:49:35.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:35 smithi194 conmon[35111]: [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-11-03T16:49:35.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:35 smithi194 conmon[35111]: audit 2021-11-03T16:49:34. 2021-11-03T16:49:35.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:35 smithi194 conmon[35111]: 103806+0000 mon.smithi026 (mon.0) 279 : audit [INF] from='osd.1 [v2:172.21.15.26:6810/2411537943,v1:172.21.15.26:6811/2411537943]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2021-11-03T16:49:35.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:35 smithi194 conmon[35111]: 2021-11-03T16:49:36.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:36.248+0000 7f6301964700 1 -- 172.21.15.26:0/3045586449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62fc0f66e0 msgr2=0x7f62fc0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:49:36.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:36.248+0000 7f6301964700 1 --2- 172.21.15.26:0/3045586449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62fc0f66e0 0x7f62fc0f6b00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f62f0004660 tx=0x7f62f0009b30).stop 2021-11-03T16:49:36.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:36.248+0000 7f6301964700 1 -- 172.21.15.26:0/3045586449 shutdown_connections 2021-11-03T16:49:36.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:36.248+0000 7f6301964700 1 --2- 172.21.15.26:0/3045586449 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62fc0f7980 0x7f62fc0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T16:49:36.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:36.248+0000 7f6301964700 1 --2- 172.21.15.26:0/3045586449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62fc0f66e0 0x7f62fc0f6b00 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:49:36.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:36.248+0000 7f6301964700 1 -- 172.21.15.26:0/3045586449 >> 172.21.15.26:0/3045586449 conn(0x7f62fc0f1e40 msgr2=0x7f62fc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:49:36.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:36.248+0000 7f6301964700 1 -- 172.21.15.26:0/3045586449 shutdown_connections 2021-11-03T16:49:36.247 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:36.248+0000 7f6301964700 1 -- 172.21.15.26:0/3045586449 wait complete. 2021-11-03T16:49:36.249 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:36.249+0000 7f6301964700 1 Processor -- start 2021-11-03T16:49:36.249 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:36.249+0000 7f6301964700 1 -- start start 2021-11-03T16:49:36.250 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:36.249+0000 7f6301964700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62fc0f66e0 0x7f62fc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:49:36.250 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:36.249+0000 7f6301964700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62fc0f7980 0x7f62fc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:49:36.250 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:36.249+0000 7f6301964700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62fc06a410 con 0x7f62fc0f66e0 2021-11-03T16:49:36.250 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:36.249+0000 7f6301964700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62fc06a550 con 0x7f62fc0f7980 2021-11-03T16:49:36.250 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:36.250+0000 7f62faffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62fc0f66e0 0x7f62fc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:49:36.251 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:36.250+0000 7f62faffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62fc0f66e0 0x7f62fc06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49632/0 (socket says 172.21.15.26:49632) 2021-11-03T16:49:36.251 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:36.250+0000 7f62faffd700 1 -- 172.21.15.26:0/2248524569 learned_addr learned my addr 172.21.15.26:0/2248524569 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:49:36.251 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:36.250+0000 7f62fa7fc700 1 --2- 172.21.15.26:0/2248524569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62fc0f7980 0x7f62fc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:49:36.251 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:36.250+0000 7f62faffd700 1 -- 172.21.15.26:0/2248524569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62fc0f7980 msgr2=0x7f62fc069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:49:36.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:36.250+0000 7f62faffd700 1 --2- 172.21.15.26:0/2248524569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62fc0f7980 0x7f62fc069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:49:36.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:36.250+0000 7f62faffd700 1 -- 172.21.15.26:0/2248524569 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f0005040 con 0x7f62fc0f66e0 2021-11-03T16:49:36.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:36.250+0000 7f62fa7fc700 1 --2- 172.21.15.26:0/2248524569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62fc0f7980 0x7f62fc069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T16:49:36.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:36.250+0000 7f62faffd700 1 --2- 172.21.15.26:0/2248524569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62fc0f66e0 0x7f62fc06b9a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f62f0007a60 tx=0x7f62f0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:49:36.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:36.250+0000 7f62e37fe700 1 -- 172.21.15.26:0/2248524569 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62f0018070 con 0x7f62fc0f66e0 2021-11-03T16:49:36.253 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:36.250+0000 7f6301964700 1 -- 172.21.15.26:0/2248524569 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62fc06a7d0 con 0x7f62fc0f66e0 2021-11-03T16:49:36.253 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:36.250+0000 7f62e37fe700 1 -- 172.21.15.26:0/2248524569 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f62f0013410 con 0x7f62fc0f66e0 2021-11-03T16:49:36.253 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:36.250+0000 7f6301964700 1 -- 172.21.15.26:0/2248524569 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62fc10efe0 con 0x7f62fc0f66e0 2021-11-03T16:49:36.253 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:36.250+0000 7f62e37fe700 1 -- 172.21.15.26:0/2248524569 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62f001c620 con 0x7f62fc0f66e0 2021-11-03T16:49:36.254 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:36.252+0000 7f62e37fe700 1 -- 172.21.15.26:0/2248524569 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f62f001d940 con 0x7f62fc0f66e0 2021-11-03T16:49:36.254 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:36.252+0000 7f6301964700 1 -- 172.21.15.26:0/2248524569 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62fc045ad0 con 0x7f62fc0f66e0 2021-11-03T16:49:36.254 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:36.252+0000 7f62e37fe700 1 --2- 172.21.15.26:0/2248524569 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f62e405c2b0 0x7f62e405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:49:36.254 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:36.252+0000 7f62e37fe700 1 -- 172.21.15.26:0/2248524569 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2281+0+0 (secure 0 0 0) 0x7f62f0077280 con 0x7f62fc0f66e0 2021-11-03T16:49:36.255 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:36.252+0000 7f62fa7fc700 1 --2- 172.21.15.26:0/2248524569 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f62e405c2b0 0x7f62e405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:49:36.255 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:36.252+0000 7f62fa7fc700 1 --2- 172.21.15.26:0/2248524569 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f62e405c2b0 0x7f62e405e770 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f62ec00a880 tx=0x7f62ec008040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:49:36.255 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:36.256+0000 7f62e37fe700 1 -- 172.21.15.26:0/2248524569 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f62f004ab60 con 0x7f62fc0f66e0 2021-11-03T16:49:36.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:36 smithi026 conmon[32119]: cluster 2021-11-03T16:49:35. 2021-11-03T16:49:36.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:36 smithi026 conmon[32119]: 000949+0000 mgr.smithi026.cnrxli (mgr.14162) 114 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-11-03T16:49:36.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:36 smithi026 conmon[32119]: audit 2021-11-03T16:49:35.104766+0000 mon.smithi026 (mon.0) 280 : audit [INF] from='osd.1 [v2:172.21.15.26:6810/2411537943,v1:172.21.15.26:6811/2411537943]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]': finished 2021-11-03T16:49:36.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:36 smithi026 conmon[32119]: cluster 2021-11-03T16:49:35.104830+0000 mon.smithi026 (mon.0) 281 : cluster [DBG] osdmap e13: 2 total, 1 up, 2 in 2021-11-03T16:49:36.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:36 smithi026 conmon[32119]: audit 2021-11-03T16:49:35.104943+0000 mon.smithi026 (mon.0) 282 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-11-03T16:49:36.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:36 smithi026 conmon[32119]: audit 2021-11-03T16:49:35.108417+0000 mon.smithi026 (mon.0) 283 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-11-03T16:49:36.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:36 smithi026 conmon[32119]: audit 2021-11-03T16:49:36.102609+0000 mon.smithi026 (mon.0) 284 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:36.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:36 smithi026 conmon[32119]: audit 2021-11-03T16:49:36.107760+0000 mon.smithi026 (mon.0) 285 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-11-03T16:49:36.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:36.463+0000 7f6301964700 1 -- 172.21.15.26:0/2248524569 --> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f62fc0008d0 con 0x7f62e405c2b0 2021-11-03T16:49:36.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:36 smithi194 conmon[35111]: cluster 2021-11-03T16:49:35.000949+0000 mgr.smithi026.cnrxli (mgr 2021-11-03T16:49:36.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:36 smithi194 conmon[35111]: .14162) 114 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-11-03T16:49:36.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:36 smithi194 conmon[35111]: audit 2021-11-03T16:49:35.104766+0000 mon.smithi026 ( 2021-11-03T16:49:36.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:36 smithi194 conmon[35111]: mon.0) 280 : audit [INF] from='osd.1 [v2:172.21.15.26:6810/2411537943,v1:172.21.15.26:6811/2411537943]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]': finished 2021-11-03T16:49:36.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:36 smithi194 conmon[35111]: cluster 2021-11-03T16:49:35.104830+0000 mon.smithi026 ( 2021-11-03T16:49:36.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:36 smithi194 conmon[35111]: mon.0) 281 : cluster [DBG] osdmap e13: 2 total, 1 up, 2 in 2021-11-03T16:49:36.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:36 smithi194 conmon[35111]: audit 2021 2021-11-03T16:49:36.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:36 smithi194 conmon[35111]: -11-03T16:49:35.104943+0000 mon.smithi026 (mon.0 2021-11-03T16:49:36.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:36 smithi194 conmon[35111]: ) 282 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-11-03T16:49:36.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:36 smithi194 conmon[35111]: audit 2021-11-03T16: 2021-11-03T16:49:36.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:36 smithi194 conmon[35111]: 49:35.108417+0000 mon.smithi026 (mon.0) 283 : audit 2021-11-03T16:49:36.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:36 smithi194 conmon[35111]: [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-11-03T16:49:36.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:36 smithi194 conmon[35111]: audit 2021-11-03T16:49 2021-11-03T16:49:36.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:36 smithi194 conmon[35111]: :36.102609+0000 mon.smithi026 (mon.0) 284 : audit 2021-11-03T16:49:36.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:36 smithi194 conmon[35111]: [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:36.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:36 smithi194 conmon[35111]: audit 2021-11-03 2021-11-03T16:49:36.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:36 smithi194 conmon[35111]: T16:49:36.107760+0000 mon.smithi026 (mon.0) 2021-11-03T16:49:36.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:36 smithi194 conmon[35111]: 285 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-11-03T16:49:37.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:37 smithi026 conmon[32119]: cluster 2021-11-03T16:49:34.610622+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2021-11-03T16:49:37.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:37 smithi026 conmon[32119]: cluster 2021-11-03T16:49:34.610761+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2021-11-03T16:49:37.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:37 smithi026 conmon[32119]: cluster 2021-11-03T16:49:36.111930+0000 mon.smithi026 (mon.0) 286 : cluster [INF] osd.1 [v2:172.21.15.26:6810/2411537943,v1:172.21.15.26:6811/2411537943] boot 2021-11-03T16:49:37.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:37 smithi026 conmon[32119]: cluster 2021-11-03T16:49:36.111974+0000 mon.smithi026 (mon.0) 287 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2021-11-03T16:49:37.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:37 smithi026 conmon[32119]: audit 2021-11-03T16:49:36.112415+0000 mon.smithi026 (mon.0) 288 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-11-03T16:49:37.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:37 smithi026 conmon[32119]: audit 2021-11- 2021-11-03T16:49:37.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:37 smithi026 conmon[32119]: 03T16:49:36.466634+0000 mon.smithi026 (mon.0) 289 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-11-03T16:49:37.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:37 smithi026 conmon[32119]: audit 2021-11-03T16:49:36.468075+0000 mon.smithi026 (mon.0) 290 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-11-03T16:49:37.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:37 smithi026 conmon[32119]: audit 2021-11-03T16:49:36.468712+0000 mon.smithi026 (mon.0) 291 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:49:37.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:37 smithi194 conmon[35111]: cluster 2021-11-03T16:49:34.610622+0000 osd.1 2021-11-03T16:49:37.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:37 smithi194 conmon[35111]: (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2021-11-03T16:49:37.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:37 smithi194 conmon[35111]: cluster 2021-11-03T16:49:34.610761 2021-11-03T16:49:37.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:37 smithi194 conmon[35111]: +0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2021-11-03T16:49:37.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:37 smithi194 conmon[35111]: cluster 2021-11-03T16:49:36.111930 2021-11-03T16:49:37.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:37 smithi194 conmon[35111]: +0000 mon.smithi026 (mon.0) 286 : cluster [INF] osd.1 [v2:172.21.15.26:6810/2411537943,v1:172.21.15.26:6811/2411537943] boot 2021-11-03T16:49:37.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:37 smithi194 conmon[35111]: cluster 2021-11-03T16:49:36.111974+0000 mon.smithi026 (mon. 2021-11-03T16:49:37.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:37 smithi194 conmon[35111]: 0) 287 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2021-11-03T16:49:37.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:37 smithi194 conmon[35111]: audit 2021-11-03T16:49:36. 2021-11-03T16:49:37.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:37 smithi194 conmon[35111]: 112415+0000 mon.smithi026 (mon.0) 288 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-11-03T16:49:37.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:37 smithi194 conmon[35111]: 2021-11-03T16:49:37.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:37 smithi194 conmon[35111]: audit 2021-11-03T16:49:36.466634 2021-11-03T16:49:37.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:37 smithi194 conmon[35111]: +0000 mon.smithi026 (mon.0) 289 : audit [DBG] 2021-11-03T16:49:37.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:37 smithi194 conmon[35111]: from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-11-03T16:49:37.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:37 smithi194 conmon[35111]: audit 2021-11-03T16:49 2021-11-03T16:49:37.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:37 smithi194 conmon[35111]: :36.468075+0000 mon.smithi026 (mon.0) 290 : audit 2021-11-03T16:49:37.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:37 smithi194 conmon[35111]: [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-11-03T16:49:37.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:37 smithi194 conmon[35111]: audit 2021-11-03T16: 2021-11-03T16:49:37.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:37 smithi194 conmon[35111]: 49:36.468712+0000 mon.smithi026 (mon.0) 291 : 2021-11-03T16:49:37.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:37 smithi194 conmon[35111]: audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:49:38.376 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:38 smithi026 conmon[32119]: audit 2021-11-03T16:49:36.465845+0000 2021-11-03T16:49:38.376 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:38 smithi026 conmon[32119]: mgr.smithi026.cnrxli (mgr.14162) 115 : audit [DBG] from='client.14248 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:49:38.376 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:38 smithi026 conmon[32119]: cephadm 2021-11-03T16:49:36.467850+0000 mgr.smithi026.cnrxli (mgr.14162) 116 : cephadm [INF] Applying service osd.None on host smithi026... 2021-11-03T16:49:38.376 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:38 smithi026 conmon[32119]: cluster 2021-11-03T16:49:37.001211+0000 mgr.smithi026.cnrxli (mgr.14162) 117 : cluster [DBG] 2021-11-03T16:49:38.377 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:38 smithi026 conmon[32119]: pgmap v77: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-11-03T16:49:38.377 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:38 smithi026 conmon[32119]: cluster 2021-11-03T16:49:37.120143+0000 mon.smithi026 ( 2021-11-03T16:49:38.377 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:38 smithi026 conmon[32119]: mon.0) 292 : cluster [DBG] osdmap e15: 2 total, 2 up, 2 in 2021-11-03T16:49:38.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:38 smithi194 conmon[35111]: audit 2021-11-03T16:49:36.465845+0000 mgr.smithi026.cnrxli 2021-11-03T16:49:38.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:38 smithi194 conmon[35111]: (mgr.14162) 115 : audit [DBG] from='client.14248 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:49:38.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:38 smithi194 conmon[35111]: cephadm 2021-11-03T16:49:36.467850+0000 mgr.smithi026.cnrxli (mgr. 2021-11-03T16:49:38.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:38 smithi194 conmon[35111]: 14162) 116 : cephadm [INF] Applying service osd.None on host smithi026... 2021-11-03T16:49:38.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:38 smithi194 conmon[35111]: cluster 2021-11-03T16:49:38.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:38 smithi194 conmon[35111]: 2021-11-03T16:49:37.001211+0000 mgr.smithi026.cnrxli (mgr.14162) 117 : cluster 2021-11-03T16:49:38.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:38 smithi194 conmon[35111]: [DBG] pgmap v77: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-11-03T16:49:38.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:38 smithi194 conmon[35111]: cluster 2021-11- 2021-11-03T16:49:38.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:38 smithi194 conmon[35111]: 03T16:49:37.120143+0000 mon.smithi026 (mon.0 2021-11-03T16:49:38.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:38 smithi194 conmon[35111]: ) 292 : cluster [DBG] osdmap e15: 2 total, 2 up, 2 in 2021-11-03T16:49:40.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:40 smithi026 conmon[32119]: cluster 2021-11-03T16:49:39.001587+0000 mgr.smithi026.cnrxli (mgr.14162) 2021-11-03T16:49:40.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:40 smithi026 conmon[32119]: 118 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2021-11-03T16:49:40.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:40 smithi194 conmon[35111]: cluster 2021-11-03T16:49:39.001587+0000 mgr.smithi026.cnrxli (mgr.14162) 118 : cluster [DBG] 2021-11-03T16:49:40.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:40 smithi194 conmon[35111]: pgmap v79: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2021-11-03T16:49:41.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:41 smithi194 conmon[35111]: cephadm 2021-11-03T16:49:40.434706+0000 mgr.smithi026.cnrxli (mgr 2021-11-03T16:49:41.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:41 smithi194 conmon[35111]: .14162) 119 : cephadm [INF] Detected new or changed devices on smithi026 2021-11-03T16:49:41.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:41 smithi194 conmon[35111]: audit 2021-11-03T16:49:40.439460+0000 mon.smithi026 2021-11-03T16:49:41.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:41 smithi194 conmon[35111]: (mon.0) 293 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:41.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:41 smithi194 conmon[35111]: audit 2021-11-03T16:49:40.785866+0000 mon.smithi026 (mon. 2021-11-03T16:49:41.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:41 smithi194 conmon[35111]: 0) 294 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:41.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:41 smithi194 conmon[35111]: audit 2021- 2021-11-03T16:49:41.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:41 smithi194 conmon[35111]: 11-03T16:49:40.788598+0000 mon.smithi026 (mon. 2021-11-03T16:49:41.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:41 smithi194 conmon[35111]: 0) 295 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:49:41.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:41 smithi194 conmon[35111]: cluster 2021-11-03 2021-11-03T16:49:41.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:41 smithi194 conmon[35111]: T16:49:41.001839+0000 mgr.smithi026.cnrxli (mgr.14162) 120 : 2021-11-03T16:49:41.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:41 smithi194 conmon[35111]: cluster [DBG] pgmap v80: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-11-03T16:49:41.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:41 smithi194 conmon[35111]: audit 2021 2021-11-03T16:49:41.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:41 smithi194 conmon[35111]: -11-03T16:49:41.275783+0000 mon.smithi026 (mon. 2021-11-03T16:49:41.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:41 smithi194 conmon[35111]: 0) 296 : audit [INF] from='client.? 172.21.15.26:0/2177472427' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dbb31ed5-aa1f-4832-9101-5fd23c08e194"}]: dispatch 2021-11-03T16:49:41.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:41 smithi194 conmon[35111]: audit 2021- 2021-11-03T16:49:41.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:41 smithi194 conmon[35111]: 11-03T16:49:41.279783+0000 mon.smithi026 (mon. 2021-11-03T16:49:41.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:41 smithi194 conmon[35111]: 0) 297 : audit [INF] from='client.? 172.21.15.26:0/2177472427' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dbb31ed5-aa1f-4832-9101-5fd23c08e194"}]': finished 2021-11-03T16:49:41.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:41 smithi194 conmon[35111]: cluster 2021- 2021-11-03T16:49:41.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:41 smithi194 conmon[35111]: 11-03T16:49:41.279850+0000 mon.smithi026 (mon. 2021-11-03T16:49:41.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:41 smithi194 conmon[35111]: 0) 298 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2021-11-03T16:49:41.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:41 smithi194 conmon[35111]: audit 2021 2021-11-03T16:49:41.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:41 smithi194 conmon[35111]: -11-03T16:49:41.279952+0000 mon.smithi026 (mon. 2021-11-03T16:49:41.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:41 smithi194 conmon[35111]: 0) 299 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-11-03T16:49:41.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:41 smithi026 conmon[32119]: cephadm 2021-11-03T16:49:40.434706+0000 2021-11-03T16:49:41.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:41 smithi026 conmon[32119]: mgr.smithi026.cnrxli (mgr.14162) 119 : cephadm [INF] Detected new or changed devices on smithi026 2021-11-03T16:49:41.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:41 smithi026 conmon[32119]: audit 2021-11-03T16:49:40.439460+0000 mon.smithi026 (mon.0) 293 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:41.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:41 smithi026 conmon[32119]: audit 2021-11-03T16:49:40.785866+0000 mon.smithi026 (mon.0) 294 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:41.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:41 smithi026 conmon[32119]: audit 2021-11-03T16:49:40.788598+0000 mon.smithi026 (mon.0) 295 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:49:41.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:41 smithi026 conmon[32119]: cluster 2021-11-03T16:49:41.001839+0000 mgr.smithi026.cnrxli (mgr.14162) 120 : cluster [DBG] pgmap v80: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-11-03T16:49:41.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:41 smithi026 conmon[32119]: audit 2021-11-03T16:49:41.275783+0000 mon.smithi026 (mon.0) 296 : audit [INF] from='client.? 172.21.15.26:0/2177472427' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dbb31ed5-aa1f-4832-9101-5fd23c08e194"}]: dispatch 2021-11-03T16:49:41.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:41 smithi026 conmon[32119]: audit 2021-11-03T16:49:41.279783+0000 mon.smithi026 (mon.0) 297 : audit [INF] from='client.? 172.21.15.26:0/2177472427' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dbb31ed5-aa1f-4832-9101-5fd23c08e194"}]': finished 2021-11-03T16:49:41.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:41 smithi026 conmon[32119]: cluster 2021-11-03T16:49:41.279850+0000 mon.smithi026 (mon.0) 298 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2021-11-03T16:49:41.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:41 smithi026 conmon[32119]: audit 2021-11-03T16:49:41.279952+0000 mon.smithi026 (mon.0) 299 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-11-03T16:49:43.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:42 smithi026 conmon[32119]: audit 2021-11-03T16:49:41 2021-11-03T16:49:43.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:42 smithi026 conmon[32119]: .889401+0000 mon.smithi026 (mon.0) 300 : audit [DBG] from='client.? 172.21.15.26:0/4143305834' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-11-03T16:49:43.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:42 smithi194 conmon[35111]: audit 2021-11-03T16:49:41.889401+0000 mon.smithi026 (mon. 2021-11-03T16:49:43.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:42 smithi194 conmon[35111]: 0) 300 : audit [DBG] from='client.? 172.21.15.26:0/4143305834' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-11-03T16:49:44.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:44 smithi026 conmon[32119]: cluster 2021-11-03T16:49:43.002142+0000 mgr.smithi026.cnrxli (mgr.14162) 121 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-11-03T16:49:44.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:44 smithi194 conmon[35111]: cluster 2021-11-03T16:49:43.002142+0000 mgr.smithi026.cnrxli (mgr. 2021-11-03T16:49:44.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:44 smithi194 conmon[35111]: 14162) 121 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-11-03T16:49:45.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:45 smithi026 conmon[32119]: audit 2021-11-03T16:49:44.551992+0000 2021-11-03T16:49:45.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:45 smithi026 conmon[32119]: mon.smithi026 (mon.0) 301 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:45.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:45 smithi026 conmon[32119]: audit 2021-11-03T16:49:44.554923+0000 mon.smithi026 (mon.0) 302 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:45.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:45 smithi026 conmon[32119]: cluster 2021-11-03T16:49:45.002405+0000 mgr.smithi026.cnrxli (mgr.14162) 122 : cluster [DBG] pgmap v83: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-11-03T16:49:45.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:45 smithi194 conmon[35111]: audit 2021-11-03T16:49:44.551992+0000 mon.smithi026 2021-11-03T16:49:45.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:45 smithi194 conmon[35111]: (mon.0) 301 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:45.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:45 smithi194 conmon[35111]: audit 2021-11-03T16:49: 2021-11-03T16:49:45.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:45 smithi194 conmon[35111]: 44.554923+0000 mon.smithi026 (mon.0) 302 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:45.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:45 smithi194 conmon[35111]: cluster 2021-11-03T16:49:45.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:45 smithi194 conmon[35111]: 2021-11-03T16:49:45.002405+0000 mgr.smithi026.cnrxli (mgr 2021-11-03T16:49:45.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:45 smithi194 conmon[35111]: .14162) 122 : cluster [DBG] pgmap v83: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-11-03T16:49:48.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:48 smithi026 conmon[32119]: cluster 2021-11-03T16:49:47.002914+0000 mgr.smithi026.cnrxli (mgr.14162) 123 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-11-03T16:49:48.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:48 smithi194 conmon[35111]: cluster 2021-11-03T16:49:47.002914+0000 mgr.smithi026.cnrxli (mgr. 2021-11-03T16:49:48.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:48 smithi194 conmon[35111]: 14162) 123 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-11-03T16:49:49.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:49 smithi026 conmon[32119]: audit 2021-11-03T16:49:48.621808+0000 2021-11-03T16:49:49.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:49 smithi026 conmon[32119]: mon.smithi026 (mon.0) 303 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-11-03T16:49:49.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:49 smithi026 conmon[32119]: audit 2021-11-03T16:49:48.622501+0000 mon.smithi026 (mon.0) 304 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:49:49.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:49 smithi194 conmon[35111]: audit 2021-11-03T16:49:48.621808+0000 mon.smithi026 (mon.0) 303 : audit [INF] 2021-11-03T16:49:49.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:49 smithi194 conmon[35111]: from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-11-03T16:49:49.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:49 smithi194 conmon[35111]: audit 2021-11-03T16:49:48.622501+0000 mon.smithi026 (mon.0) 304 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:49:50.317 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:50 smithi026 conmon[32119]: cephadm 2021-11-03T16:49:48.623094+0000 mgr.smithi026.cnrxli (mgr.14162) 124 : cephadm [INF] Deploying daemon osd.2 on smithi026 2021-11-03T16:49:50.317 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:50 smithi026 conmon[32119]: cluster 2021-11-03T16:49:49.003405+0000 mgr.smithi026.cnrxli (mgr.14162) 125 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-11-03T16:49:50.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:50 smithi194 conmon[35111]: cephadm 2021-11-03T16:49:48.623094+0000 2021-11-03T16:49:50.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:50 smithi194 conmon[35111]: mgr.smithi026.cnrxli (mgr.14162) 124 : cephadm [INF] Deploying daemon osd.2 on smithi026 2021-11-03T16:49:50.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:50 smithi194 conmon[35111]: cluster 2021-11-03T 2021-11-03T16:49:50.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:50 smithi194 conmon[35111]: 16:49:49.003405+0000 mgr.smithi026.cnrxli (mgr.14162) 125 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-11-03T16:49:52.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:52 smithi026 conmon[32119]: cluster 2021-11-03T16:49:51.003719+0000 mgr.smithi026.cnrxli (mgr.14162) 126 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-11-03T16:49:52.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:52 smithi194 conmon[35111]: cluster 2021-11-03T16:49:51.003719+0000 mgr.smithi026.cnrxli (mgr.14162) 126 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-11-03T16:49:52.651 INFO:teuthology.orchestra.run.smithi026.stdout:Created osd(s) 2 on host 'smithi026' 2021-11-03T16:49:52.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:52.653+0000 7f62e37fe700 1 -- 172.21.15.26:0/2248524569 <== mgr.14162 v2:172.21.15.26:6800/3029163595 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f62fc0008d0 con 0x7f62e405c2b0 2021-11-03T16:49:52.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:52.656+0000 7f6301964700 1 -- 172.21.15.26:0/2248524569 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f62e405c2b0 msgr2=0x7f62e405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:49:52.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:52.656+0000 7f6301964700 1 --2- 172.21.15.26:0/2248524569 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f62e405c2b0 0x7f62e405e770 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f62ec00a880 tx=0x7f62ec008040).stop 2021-11-03T16:49:52.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:52.656+0000 7f6301964700 1 -- 172.21.15.26:0/2248524569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62fc0f66e0 msgr2=0x7f62fc06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:49:52.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:52.656+0000 7f6301964700 1 --2- 172.21.15.26:0/2248524569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62fc0f66e0 0x7f62fc06b9a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f62f0007a60 tx=0x7f62f0009b30).stop 2021-11-03T16:49:52.654 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:52.656+0000 7f6301964700 1 -- 172.21.15.26:0/2248524569 shutdown_connections 2021-11-03T16:49:52.654 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:52.656+0000 7f6301964700 1 --2- 172.21.15.26:0/2248524569 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f62e405c2b0 0x7f62e405e770 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:49:52.654 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:52.656+0000 7f6301964700 1 --2- 172.21.15.26:0/2248524569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62fc0f66e0 0x7f62fc06b9a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:49:52.654 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:52.656+0000 7f6301964700 1 --2- 172.21.15.26:0/2248524569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62fc0f7980 0x7f62fc069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:49:52.655 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:52.656+0000 7f6301964700 1 -- 172.21.15.26:0/2248524569 >> 172.21.15.26:0/2248524569 conn(0x7f62fc0f1e40 msgr2=0x7f62fc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:49:52.655 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:52.657+0000 7f6301964700 1 -- 172.21.15.26:0/2248524569 shutdown_connections 2021-11-03T16:49:52.655 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:49:52.657+0000 7f6301964700 1 -- 172.21.15.26:0/2248524569 wait complete. 2021-11-03T16:49:53.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:53 smithi026 conmon[32119]: audit 2021-11-03T16:49:52.644507+0000 mon.smithi026 ( 2021-11-03T16:49:53.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:53 smithi026 conmon[32119]: mon.0) 305 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:49:53.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:53 smithi026 conmon[32119]: audit 2021-11-03T16:49:52.648418+0000 mon.smithi026 (mon.0) 306 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:53.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:53 smithi026 conmon[32119]: audit 2021-11-03T16:49:52.654265+0000 mon.smithi026 (mon.0) 307 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:53.316 DEBUG:teuthology.orchestra.run.smithi026:osd.2> sudo journalctl -f -n 0 -u ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c@osd.2.service 2021-11-03T16:49:53.319 INFO:tasks.cephadm:Deploying osd.3 on smithi194 with /dev/vg_nvme/lv_4... 2021-11-03T16:49:53.319 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2021-11-03T16:49:53.347 INFO:journalctl@ceph.osd.2.smithi026.stdout:-- Logs begin at Wed 2021-11-03 16:35:12 UTC. -- 2021-11-03T16:49:53.358 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:53 smithi194 conmon[35111]: audit 2021-11-03T16:49:52.644507+0000 mon.smithi026 (mon.0) 305 : 2021-11-03T16:49:53.358 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:53 smithi194 conmon[35111]: audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:49:53.359 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:53 smithi194 conmon[35111]: audit 2021-11-03T16:49:52.648418+0000 mon.smithi026 (mon.0) 306 : audit 2021-11-03T16:49:53.359 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:53 smithi194 conmon[35111]: [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:53.359 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:53 smithi194 conmon[35111]: audit 2021-11 2021-11-03T16:49:53.359 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:53 smithi194 conmon[35111]: -03T16:49:52.654265+0000 mon.smithi026 ( 2021-11-03T16:49:53.360 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:53 smithi194 conmon[35111]: mon.0) 307 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:54.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:54 smithi026 conmon[32119]: cluster 2021-11-03T16:49:53.004058+0000 mgr.smithi026.cnrxli (mgr.14162) 127 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-11-03T16:49:54.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:54 smithi194 conmon[35111]: cluster 2021-11-03T16:49:53.004058+0000 mgr.smithi026.cnrxli (mgr.14162) 127 : cluster [DBG] 2021-11-03T16:49:54.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:54 smithi194 conmon[35111]: pgmap v87: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-11-03T16:49:55.374 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping: /dev/vg_nvme/lv_4 2021-11-03T16:49:55.374 INFO:teuthology.orchestra.run.smithi194.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2021-11-03T16:49:55.375 INFO:teuthology.orchestra.run.smithi194.stderr: stderr: 10+0 records in 2021-11-03T16:49:55.375 INFO:teuthology.orchestra.run.smithi194.stderr:10+0 records out 2021-11-03T16:49:55.375 INFO:teuthology.orchestra.run.smithi194.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111714 s, 939 MB/s 2021-11-03T16:49:55.375 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping successful for: 2021-11-03T16:49:55.953 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph orch daemon add osd smithi194:vg_nvme/lv_4 2021-11-03T16:49:56.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:56 smithi194 conmon[35111]: cluster 2021-11-03T16:49:55.004335+0000 mgr.smithi026.cnrxli (mgr.14162) 128 : cluster [DBG] pgmap v88: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-11-03T16:49:56.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:56 smithi026 conmon[32119]: cluster 2021-11-03T16:49:55.004335+0000 mgr.smithi026.cnrxli (mgr.14162) 128 : cluster [DBG] pgmap v88: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-11-03T16:49:56.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:56 smithi026 conmon[32119]: 2021-11-03T16:49:56.922 INFO:journalctl@ceph.osd.2.smithi026.stdout:Nov 03 16:49:56 smithi026 conmon[62841]: debug 2021-11-03T16:49:56.609+0000 7f30ed872080 -1 osd.2 0 log_to_monitors {default=true} 2021-11-03T16:49:57.335 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:57 smithi194 conmon[35111]: audit 2021-11-03T16:49:56.612528+0000 mon.smithi026 (mon.0) 308 : audit [INF] from='osd.2 [v2:172.21.15.26:6818/79646117,v1:172.21.15.26:6819/79646117]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-11-03T16:49:57.336 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:57 smithi194 conmon[35111]: audit 2021-11-03T16:49:56.942013+0000 mon.smithi026 (mon.0) 309 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:57.410 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:57 smithi026 conmon[32119]: audit 2021-11-03T16:49:56.612528+0000 mon.smithi026 ( 2021-11-03T16:49:57.410 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:57 smithi026 conmon[32119]: mon.0) 308 : audit [INF] from='osd.2 [v2:172.21.15.26:6818/79646117,v1:172.21.15.26:6819/79646117]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-11-03T16:49:57.411 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:57 smithi026 conmon[32119]: audit 2021-11-03T16:49:56.942013+0000 mon.smithi026 (mon.0) 309 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:49:57.721 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:49:57.723+0000 7fe4d68b2700 1 -- 172.21.15.194:0/2071153746 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4d00f55c0 msgr2=0x7fe4d00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:49:57.722 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:49:57.723+0000 7fe4d68b2700 1 --2- 172.21.15.194:0/2071153746 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4d00f55c0 0x7fe4d00f59e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7fe4c0004660 tx=0x7fe4c0009b30).stop 2021-11-03T16:49:57.722 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:49:57.723+0000 7fe4d68b2700 1 -- 172.21.15.194:0/2071153746 shutdown_connections 2021-11-03T16:49:57.722 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:49:57.723+0000 7fe4d68b2700 1 --2- 172.21.15.194:0/2071153746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4d00f6860 0x7fe4d00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:49:57.723 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:49:57.723+0000 7fe4d68b2700 1 --2- 172.21.15.194:0/2071153746 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4d00f55c0 0x7fe4d00f59e0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:49:57.723 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:49:57.723+0000 7fe4d68b2700 1 -- 172.21.15.194:0/2071153746 >> 172.21.15.194:0/2071153746 conn(0x7fe4d00f0d40 msgr2=0x7fe4d00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:49:57.723 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:49:57.723+0000 7fe4d68b2700 1 -- 172.21.15.194:0/2071153746 shutdown_connections 2021-11-03T16:49:57.723 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:49:57.723+0000 7fe4d68b2700 1 -- 172.21.15.194:0/2071153746 wait complete. 2021-11-03T16:49:57.723 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:49:57.723+0000 7fe4d68b2700 1 Processor -- start 2021-11-03T16:49:57.724 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:49:57.724+0000 7fe4d68b2700 1 -- start start 2021-11-03T16:49:57.724 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:49:57.724+0000 7fe4d68b2700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4d00f55c0 0x7fe4d0106f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:49:57.724 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:49:57.724+0000 7fe4d68b2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4d00f6860 0x7fe4d0107480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:49:57.724 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:49:57.724+0000 7fe4d68b2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d0107a30 con 0x7fe4d00f6860 2021-11-03T16:49:57.725 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:49:57.724+0000 7fe4d68b2700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d0107b70 con 0x7fe4d00f55c0 2021-11-03T16:49:57.725 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:49:57.724+0000 7fe4cffff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4d00f55c0 0x7fe4d0106f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:49:57.726 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:49:57.724+0000 7fe4cffff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4d00f55c0 0x7fe4d0106f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:34088/0 (socket says 172.21.15.194:34088) 2021-11-03T16:49:57.726 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:49:57.724+0000 7fe4cffff700 1 -- 172.21.15.194:0/108596890 learned_addr learned my addr 172.21.15.194:0/108596890 (peer_addr_for_me v2:172.21.15.194:0/0) 2021-11-03T16:49:57.726 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:49:57.724+0000 7fe4cf7fe700 1 --2- 172.21.15.194:0/108596890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4d00f6860 0x7fe4d0107480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:49:57.727 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:49:57.724+0000 7fe4cffff700 1 -- 172.21.15.194:0/108596890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4d00f6860 msgr2=0x7fe4d0107480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:49:57.727 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:49:57.724+0000 7fe4cffff700 1 --2- 172.21.15.194:0/108596890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4d00f6860 0x7fe4d0107480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:49:57.727 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:49:57.724+0000 7fe4cffff700 1 -- 172.21.15.194:0/108596890 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c0005040 con 0x7fe4d00f55c0 2021-11-03T16:49:57.728 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:49:57.724+0000 7fe4cffff700 1 --2- 172.21.15.194:0/108596890 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4d00f55c0 0x7fe4d0106f90 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7fe4c0007a60 tx=0x7fe4c0009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:49:57.728 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:49:57.724+0000 7fe4ccff9700 1 -- 172.21.15.194:0/108596890 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4c0018070 con 0x7fe4d00f55c0 2021-11-03T16:49:57.728 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:49:57.724+0000 7fe4ccff9700 1 -- 172.21.15.194:0/108596890 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fe4c0013410 con 0x7fe4d00f55c0 2021-11-03T16:49:57.728 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:49:57.724+0000 7fe4d68b2700 1 -- 172.21.15.194:0/108596890 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4d01084b0 con 0x7fe4d00f55c0 2021-11-03T16:49:57.728 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:49:57.724+0000 7fe4ccff9700 1 -- 172.21.15.194:0/108596890 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4c001c620 con 0x7fe4d00f55c0 2021-11-03T16:49:57.729 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:49:57.724+0000 7fe4d68b2700 1 -- 172.21.15.194:0/108596890 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4d0108a10 con 0x7fe4d00f55c0 2021-11-03T16:49:57.729 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:49:57.725+0000 7fe4d68b2700 1 -- 172.21.15.194:0/108596890 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4d0045ad0 con 0x7fe4d00f55c0 2021-11-03T16:49:57.729 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:49:57.726+0000 7fe4ccff9700 1 -- 172.21.15.194:0/108596890 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fe4c001c890 con 0x7fe4d00f55c0 2021-11-03T16:49:57.729 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:49:57.726+0000 7fe4ccff9700 1 --2- 172.21.15.194:0/108596890 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe4b805c2b0 0x7fe4b805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:49:57.730 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:49:57.726+0000 7fe4ccff9700 1 -- 172.21.15.194:0/108596890 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 2417+0+0 (secure 0 0 0) 0x7fe4c0077340 con 0x7fe4d00f55c0 2021-11-03T16:49:57.730 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:49:57.726+0000 7fe4cf7fe700 1 --2- 172.21.15.194:0/108596890 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe4b805c2b0 0x7fe4b805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:49:57.731 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:49:57.727+0000 7fe4cf7fe700 1 --2- 172.21.15.194:0/108596890 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe4b805c2b0 0x7fe4b805e770 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fe4c40049e0 tx=0x7fe4c4009040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:49:57.731 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:49:57.730+0000 7fe4ccff9700 1 -- 172.21.15.194:0/108596890 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fe4c004ab90 con 0x7fe4d00f55c0 2021-11-03T16:49:57.900 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:49:57.904+0000 7fe4d68b2700 1 -- 172.21.15.194:0/108596890 --> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4d005fd30 con 0x7fe4b805c2b0 2021-11-03T16:49:58.331 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:58 smithi194 conmon[35111]: cluster 2021-11-03T16:49:57.004637 2021-11-03T16:49:58.723 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:58 smithi194 conmon[35111]: +0000 mgr.smithi026.cnrxli (mgr.14162) 129 : cluster [DBG] pgmap v89: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-11-03T16:49:58.724 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:58 smithi194 conmon[35111]: audit 2021-11-03T16:49:57.076609+0000 mon.smithi026 (mon.0) 310 : audit [INF] from='osd.2 [v2:172.21.15.26:6818/79646117,v1:172.21.15.26:6819/79646117]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-11-03T16:49:58.724 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:58 smithi194 conmon[35111]: cluster 2021-11-03T16:49:57.076687+0000 mon.smithi026 (mon.0) 311 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2021-11-03T16:49:58.724 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:58 smithi194 conmon[35111]: audit 2021-11-03T16:49:57.076800+0000 mon.smithi026 (mon.0) 312 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-11-03T16:49:58.725 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:58 smithi194 conmon[35111]: audit 2021-11-03T16:49:57.077213+0000 mon.smithi026 (mon.0) 313 : audit [INF] from='osd.2 [v2:172.21.15.26:6818/79646117,v1:172.21.15.26:6819/79646117]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2021-11-03T16:49:58.725 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:58 smithi194 conmon[35111]: audit 2021 2021-11-03T16:49:58.725 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:58 smithi194 conmon[35111]: -11-03T16:49:57.907587+0000 mon.smithi026 (mon.0) 314 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-11-03T16:49:58.725 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:58 smithi194 conmon[35111]: audit 2021-11-03T16:49:57 2021-11-03T16:49:58.725 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:58 smithi194 conmon[35111]: .909133+0000 mon.smithi026 (mon.0) 315 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-11-03T16:49:58.726 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:58 smithi194 conmon[35111]: audit 2021- 2021-11-03T16:49:58.726 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:58 smithi194 conmon[35111]: 11-03T16:49:57.909786+0000 mon.smithi026 (mon 2021-11-03T16:49:58.726 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:58 smithi194 conmon[35111]: .0) 316 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:49:58.727 INFO:journalctl@ceph.osd.2.smithi026.stdout:Nov 03 16:49:58 smithi026 conmon[62841]: debug 2021-11-03T16:49:58.080+0000 7f30e3de3700 -1 osd.2 0 waiting for initial osdmap 2021-11-03T16:49:58.727 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:58 smithi026 conmon[32119]: cluster 2021-11-03T16:49:57.004637+0000 mgr.smithi026.cnrxli (mgr.14162) 129 : cluster [DBG] pgmap v89: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-11-03T16:49:58.728 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:58 smithi026 conmon[32119]: audit 2021-11-03T16:49:57.076609+0000 mon.smithi026 (mon.0) 310 : audit [INF] from='osd.2 [v2:172.21.15.26:6818/79646117,v1:172.21.15.26:6819/79646117]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-11-03T16:49:58.728 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:58 smithi026 conmon[32119]: cluster 2021-11-03T16:49:57.076687+0000 mon.smithi026 (mon.0) 311 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2021-11-03T16:49:58.728 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:58 smithi026 conmon[32119]: audit 2021-11-03T16:49:57.076800+0000 mon.smithi026 (mon.0) 312 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-11-03T16:49:58.728 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:58 smithi026 conmon[32119]: audit 2021-11-03T16:49:57.077213+0000 mon.smithi026 (mon.0) 313 : audit [INF] from='osd.2 [v2:172.21.15.26:6818/79646117,v1:172.21.15.26:6819/79646117]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2021-11-03T16:49:58.729 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:58 smithi026 conmon[32119]: audit 2021-11-03T16:49:57.907587+0000 mon.smithi026 (mon.0) 314 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-11-03T16:49:58.729 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:58 smithi026 conmon[32119]: audit 2021-11-03T16:49:57.909133+0000 mon.smithi026 (mon.0) 315 : audit 2021-11-03T16:49:58.729 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:58 smithi026 conmon[32119]: [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-11-03T16:49:58.729 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:58 smithi026 conmon[32119]: audit 2021-11-03T16:49:57.909786+0000 mon.smithi026 (mon.0) 316 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:49:59.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:59 smithi026 conmon[32119]: audit 2021-11-03T16:49:57.906717+0000 2021-11-03T16:49:59.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:59 smithi026 conmon[32119]: mgr.smithi026.cnrxli (mgr.14162) 130 : audit [DBG] from='client.24127 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:49:59.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:59 smithi026 conmon[32119]: cephadm 2021-11-03T16:49:57.908919+0000 mgr.smithi026.cnrxli (mgr.14162) 131 : cephadm [INF] Applying service osd.None on host smithi194... 2021-11-03T16:49:59.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:59 smithi026 conmon[32119]: audit 2021-11-03T16:49:58.077857+0000 mon.smithi026 (mon.0) 317 : audit [INF] from='osd.2 [v2:172.21.15.26:6818/79646117,v1:172.21.15.26:6819/79646117]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]': finished 2021-11-03T16:49:59.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:59 smithi026 conmon[32119]: cluster 2021-11-03T16:49:58.077937+0000 mon.smithi026 (mon.0) 318 : cluster [DBG] osdmap e18: 3 total, 2 up, 3 in 2021-11-03T16:49:59.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:59 smithi026 conmon[32119]: audit 2021-11-03T16:49:58.078219+0000 mon.smithi026 (mon.0) 319 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-11-03T16:49:59.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:49:59 smithi026 conmon[32119]: audit 2021-11-03T16:49:58.083277+0000 mon.smithi026 (mon.0) 320 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-11-03T16:49:59.371 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:59 smithi194 conmon[35111]: audit 2021-11-03T16:49:57.906717+0000 mgr.smithi026.cnrxli (mgr. 2021-11-03T16:49:59.372 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:59 smithi194 conmon[35111]: 14162) 130 : audit [DBG] from='client.24127 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:49:59.372 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:59 smithi194 conmon[35111]: cephadm 2021-11-03T16:49:57.908919+0000 mgr.smithi026.cnrxli (mgr.14162) 131 : cephadm [INF] Applying service osd.None on host smithi194... 2021-11-03T16:49:59.372 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:59 smithi194 conmon[35111]: audit 2021-11-03T16:49:58.077857+0000 mon.smithi026 (mon.0) 317 : audit [INF] from='osd.2 [v2:172.21.15.26:6818/79646117,v1:172.21.15.26:6819/79646117]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]': finished 2021-11-03T16:49:59.372 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:59 smithi194 conmon[35111]: cluster 2021-11-03T16:49:58.077937+0000 mon.smithi026 (mon.0) 318 : cluster [DBG] osdmap e18: 3 total, 2 up, 3 in 2021-11-03T16:49:59.373 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:59 smithi194 conmon[35111]: audit 2021-11-03T16:49:58.078219+0000 mon.smithi026 (mon.0) 319 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-11-03T16:49:59.373 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:49:59 smithi194 conmon[35111]: audit 2021-11-03T16:49:58.083277+0000 mon.smithi026 (mon.0) 320 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-11-03T16:50:00.349 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:00 smithi026 conmon[32119]: cluster 2021-11-03T16:49:57.604189+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2021-11-03T16:50:00.349 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:00 smithi026 conmon[32119]: cluster 2021-11-03T16:49:57.604296+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2021-11-03T16:50:00.350 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:00 smithi026 conmon[32119]: cluster 2021-11-03T16:49:59.004911+0000 mgr.smithi026.cnrxli (mgr.14162) 132 : cluster [DBG] pgmap v92: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-11-03T16:50:00.350 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:00 smithi026 conmon[32119]: audit 2021-11-03T16:49:59.080862+0000 mon.smithi026 (mon.0) 321 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-11-03T16:50:00.350 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:00 smithi026 conmon[32119]: cluster 2021-11-03T16:49:59.086189+0000 mon.smithi026 (mon.0) 322 : cluster [INF] osd.2 [v2:172.21.15.26:6818/79646117,v1:172.21.15.26:6819/79646117] boot 2021-11-03T16:50:00.350 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:00 smithi026 conmon[32119]: cluster 2021-11-03T16:49:59.086215+0000 mon.smithi026 (mon.0) 323 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2021-11-03T16:50:00.351 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:00 smithi026 conmon[32119]: audit 2021-11-03T16:49:59.086312+0000 mon.smithi026 (mon.0) 324 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-11-03T16:50:00.351 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:00 smithi026 conmon[32119]: cluster 2021-11-03T16:50:00.000123+0000 mon.smithi026 (mon.0) 325 : cluster [INF] overall HEALTH_OK 2021-11-03T16:50:00.351 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:00 smithi026 conmon[32119]: audit 2021-11-03T16:50:00.051261+0000 mon.smithi194 (mon.1) 2 : audit [INF] from='client.? 172.21.15.194:0/4222927051' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5e168819-6fae-4e49-9c2d-0e04ee27575e"}]: dispatch 2021-11-03T16:50:00.351 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:00 smithi026 conmon[32119]: audit 2021-11-03T16:50:00.051817+0000 mon.smithi026 (mon.0) 326 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5e168819-6fae-4e49-9c2d-0e04ee27575e"}]: dispatch 2021-11-03T16:50:00.351 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:00 smithi026 conmon[32119]: audit 2021-11-03T16:50:00.055337+0000 mon.smithi026 (mon.0) 327 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5e168819-6fae-4e49-9c2d-0e04ee27575e"}]': finished 2021-11-03T16:50:00.352 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:00 smithi026 conmon[32119]: cluster 2021-11-03T16:50:00.055398+0000 mon.smithi026 (mon.0) 328 : cluster [DBG] osdmap e20: 4 total, 3 up, 4 in 2021-11-03T16:50:00.352 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:00 smithi026 conmon[32119]: audit 2021-11-03T16:50:00.055501+0000 mon.smithi026 (mon.0) 329 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-11-03T16:50:00.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:00 smithi194 conmon[35111]: cluster 2021-11-03T16:49:57.604189+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2021-11-03T16:50:00.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:00 smithi194 conmon[35111]: cluster 2021-11-03T16:49:57.604296+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2021-11-03T16:50:00.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:00 smithi194 conmon[35111]: cluster 2021-11-03T16:49:59.004911+0000 mgr.smithi026.cnrxli (mgr.14162) 132 : cluster [DBG] pgmap v92: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-11-03T16:50:00.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:00 smithi194 conmon[35111]: audit 2021-11-03T16:49:59.080862+0000 mon.smithi026 (mon.0) 321 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-11-03T16:50:00.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:00 smithi194 conmon[35111]: cluster 2021-11-03T16:49:59.086189+0000 mon.smithi026 (mon.0) 322 : cluster [INF] osd.2 [v2:172.21.15.26:6818/79646117,v1:172.21.15.26:6819/79646117] boot 2021-11-03T16:50:00.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:00 smithi194 conmon[35111]: cluster 2021-11-03T16:49:59.086215+0000 mon.smithi026 (mon.0) 323 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2021-11-03T16:50:00.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:00 smithi194 conmon[35111]: audit 2021-11-03T16 2021-11-03T16:50:00.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:00 smithi194 conmon[35111]: :49:59.086312+0000 mon.smithi026 (mon.0) 324 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-11-03T16:50:00.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:00 smithi194 conmon[35111]: cluster 2021-11-03T16:50:00.000123+0000 mon.smithi026 (mon.0) 325 : cluster [INF] overall HEALTH_OK 2021-11-03T16:50:00.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:00 smithi194 conmon[35111]: audit 2021-11-03T16:50:00.051261+0000 mon.smithi194 (mon.1) 2 : audit [INF] from='client.? 172.21.15.194:0/4222927051' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5e168819-6fae-4e49-9c2d-0e04ee27575e"}]: dispatch 2021-11-03T16:50:00.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:00 smithi194 conmon[35111]: audit 2021-11-03T16:50:00.051817+0000 mon.smithi026 (mon.0) 326 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5e168819-6fae-4e49-9c2d-0e04ee27575e"}]: dispatch 2021-11-03T16:50:00.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:00 smithi194 conmon[35111]: audit 2021-11-03T16:50:00.055337+0000 mon.smithi026 (mon.0) 327 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5e168819-6fae-4e49-9c2d-0e04ee27575e"}]': finished 2021-11-03T16:50:00.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:00 smithi194 conmon[35111]: cluster 2021-11-03T16:50:00.055398+0000 mon.smithi026 (mon.0) 328 : cluster [DBG] osdmap e20: 4 total, 3 up, 4 in 2021-11-03T16:50:00.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:00 smithi194 conmon[35111]: audit 2021-11-03T16:50:00.055501+0000 mon.smithi026 (mon.0) 329 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-11-03T16:50:01.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:01 smithi026 conmon[32119]: audit 2021-11-03T16:50:00 2021-11-03T16:50:01.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:01 smithi026 conmon[32119]: .539494+0000 mon.smithi194 (mon.1) 3 : audit [DBG] from='client.? 172.21.15.194:0/4159360466' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-11-03T16:50:01.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:01 smithi026 conmon[32119]: audit 2021-11-03T16:50:00.640828+0000 mon.smithi026 (mon.0) 330 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:01.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:01 smithi026 conmon[32119]: audit 2021-11-03T16:50:00.687672+0000 mon.smithi026 (mon.0) 331 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:01.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:01 smithi026 conmon[32119]: audit 2021-11-03T16:50:00.690465+0000 mon.smithi026 (mon.0) 332 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:50:01.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:01 smithi194 conmon[35111]: audit 2021-11-03T16:50:00.539494+0000 mon.smithi194 (mon.1 2021-11-03T16:50:01.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:01 smithi194 conmon[35111]: ) 3 : audit [DBG] from='client.? 172.21.15.194:0/4159360466' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-11-03T16:50:01.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:01 smithi194 conmon[35111]: audit 2021-11-03T16:50:00.640828+0000 mon.smithi026 (mon.0) 330 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:01.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:01 smithi194 conmon[35111]: audit 2021-11-03T16:50:00.687672+0000 mon.smithi026 (mon.0) 331 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:01.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:01 smithi194 conmon[35111]: audit 2021-11-03T16:50:00.690465+0000 mon.smithi026 (mon.0) 332 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:50:02.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:02 smithi026 conmon[32119]: cephadm 2021-11-03T16:50 2021-11-03T16:50:02.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:02 smithi026 conmon[32119]: :00.612264+0000 mgr.smithi026.cnrxli (mgr.14162) 133 : cephadm [INF] Detected new or changed devices on smithi026 2021-11-03T16:50:02.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:02 smithi026 conmon[32119]: cluster 2021-11-03T16:50:01.005193+0000 mgr.smithi026.cnrxli (mgr.14162) 134 : cluster 2021-11-03T16:50:02.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:02 smithi026 conmon[32119]: [DBG] pgmap v95: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2021-11-03T16:50:02.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:02 smithi194 conmon[35111]: cephadm 2021-11-03T16:50:00.612264+0000 mgr.smithi026.cnrxli (mgr.14162) 133 : cephadm [INF] Detected new or changed devices on smithi026 2021-11-03T16:50:02.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:02 smithi194 conmon[35111]: cluster 2021-11-03T16 2021-11-03T16:50:02.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:02 smithi194 conmon[35111]: :50:01.005193+0000 mgr.smithi026.cnrxli (mgr.14162) 134 : cluster [DBG] pgmap v95: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2021-11-03T16:50:04.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:04 smithi026 conmon[32119]: cluster 2021-11-03T16:50:03.005677+0000 mgr.smithi026.cnrxli (mgr.14162) 135 : cluster [DBG] pgmap v96: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2021-11-03T16:50:04.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:04 smithi194 conmon[35111]: cluster 2021-11-03T16:50:03.005677+0000 mgr.smithi026.cnrxli (mgr.14162) 135 : cluster [DBG] pgmap v96: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2021-11-03T16:50:05.826 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:05 smithi194 conmon[35111]: audit 2021-11-03T16:50:04.651578+0000 mon.smithi026 (mon.0) 333 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:05.826 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:05 smithi194 conmon[35111]: audit 2021-11-03T16:50:04.654420+0000 mon.smithi026 (mon.0) 334 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:05.826 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:05 smithi194 conmon[35111]: cluster 2021-11-03T16:50:05.006042+0000 mgr.smithi026.cnrxli (mgr.14162) 136 : cluster [DBG] pgmap v97: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2021-11-03T16:50:05.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:05 smithi026 conmon[32119]: audit 2021-11-03T16:50:04.651578+0000 mon.smithi026 (mon.0) 333 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:05.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:05 smithi026 conmon[32119]: audit 2021-11-03T16:50:04.654420+0000 mon.smithi026 (mon.0) 334 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:05.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:05 smithi026 conmon[32119]: cluster 2021-11-03T16: 2021-11-03T16:50:05.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:05 smithi026 conmon[32119]: 50:05.006042+0000 mgr.smithi026.cnrxli (mgr. 2021-11-03T16:50:05.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:05 smithi026 conmon[32119]: 14162) 136 : cluster [DBG] pgmap v97: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2021-11-03T16:50:06.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:06 smithi194 conmon[35111]: audit 2021-11-03T16:50:06.697238+0000 mon.smithi026 (mon.0) 335 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-11-03T16:50:06.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:06 smithi194 conmon[35111]: audit 2021-11-03T16:50:06.698246+0000 mon.smithi026 (mon.0) 336 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:50:07.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:06 smithi026 conmon[32119]: audit 2021-11-03T16:50:06.697238+0000 mon.smithi026 (mon.0) 335 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-11-03T16:50:07.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:06 smithi026 conmon[32119]: audit 2021-11-03T16:50:06.698246+0000 mon.smithi026 (mon.0) 336 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:50:07.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:07 smithi194 conmon[35111]: cephadm 2021-11-03T16:50:06.699060+0000 mgr.smithi026.cnrxli (mgr 2021-11-03T16:50:07.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:07 smithi194 conmon[35111]: .14162) 137 : cephadm [INF] Deploying daemon osd.3 on smithi194 2021-11-03T16:50:07.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:07 smithi194 conmon[35111]: cluster 2021-11-03T16:50:07.006428+0000 mgr.smithi026.cnrxli (mgr.14162) 138 : cluster [DBG] pgmap v98: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2021-11-03T16:50:08.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:07 smithi026 conmon[32119]: cephadm 2021-11-03T16:50:06.699060+0000 mgr.smithi026.cnrxli (mgr.14162) 137 : cephadm [INF] Deploying daemon osd.3 on smithi194 2021-11-03T16:50:08.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:07 smithi026 conmon[32119]: cluster 2021-11-03T16:50:07.006428+0000 mgr.smithi026.cnrxli (mgr.14162) 138 : cluster [DBG] pgmap v98: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2021-11-03T16:50:09.888 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:09.891+0000 7fe4ccff9700 1 -- 172.21.15.194:0/108596890 <== mgr.14162 v2:172.21.15.26:6800/3029163595 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe4d005fd30 con 0x7fe4b805c2b0 2021-11-03T16:50:09.889 INFO:teuthology.orchestra.run.smithi194.stdout:Created osd(s) 3 on host 'smithi194' 2021-11-03T16:50:09.890 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:09.894+0000 7fe4d68b2700 1 -- 172.21.15.194:0/108596890 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe4b805c2b0 msgr2=0x7fe4b805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:50:09.890 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:09.894+0000 7fe4d68b2700 1 --2- 172.21.15.194:0/108596890 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe4b805c2b0 0x7fe4b805e770 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fe4c40049e0 tx=0x7fe4c4009040).stop 2021-11-03T16:50:09.891 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:09.894+0000 7fe4d68b2700 1 -- 172.21.15.194:0/108596890 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4d00f55c0 msgr2=0x7fe4d0106f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:50:09.891 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:09.894+0000 7fe4d68b2700 1 --2- 172.21.15.194:0/108596890 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4d00f55c0 0x7fe4d0106f90 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7fe4c0007a60 tx=0x7fe4c0009b30).stop 2021-11-03T16:50:09.891 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:09.894+0000 7fe4d68b2700 1 -- 172.21.15.194:0/108596890 shutdown_connections 2021-11-03T16:50:09.891 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:09.894+0000 7fe4d68b2700 1 --2- 172.21.15.194:0/108596890 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe4b805c2b0 0x7fe4b805e770 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:50:09.892 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:09.894+0000 7fe4d68b2700 1 --2- 172.21.15.194:0/108596890 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4d00f55c0 0x7fe4d0106f90 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:50:09.892 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:09.894+0000 7fe4d68b2700 1 --2- 172.21.15.194:0/108596890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4d00f6860 0x7fe4d0107480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:50:09.892 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:09.894+0000 7fe4d68b2700 1 -- 172.21.15.194:0/108596890 >> 172.21.15.194:0/108596890 conn(0x7fe4d00f0d40 msgr2=0x7fe4d005f620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:50:09.892 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:09.895+0000 7fe4d68b2700 1 -- 172.21.15.194:0/108596890 shutdown_connections 2021-11-03T16:50:09.893 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:09.895+0000 7fe4d68b2700 1 -- 172.21.15.194:0/108596890 wait complete. 2021-11-03T16:50:10.515 DEBUG:teuthology.orchestra.run.smithi194:osd.3> sudo journalctl -f -n 0 -u ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c@osd.3.service 2021-11-03T16:50:10.517 INFO:tasks.cephadm:Deploying osd.4 on smithi194 with /dev/vg_nvme/lv_3... 2021-11-03T16:50:10.518 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2021-11-03T16:50:10.545 INFO:journalctl@ceph.osd.3.smithi194.stdout:-- Logs begin at Wed 2021-11-03 16:35:29 UTC. -- 2021-11-03T16:50:10.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:10 smithi026 conmon[32119]: cluster 2021-11-03T16:50:09.006754+0000 mgr.smithi026.cnrxli (mgr.14162) 139 : cluster [DBG] pgmap v99: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2021-11-03T16:50:10.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:10 smithi026 conmon[32119]: audit 2021-11-03T16:50:09.165965+0000 mon.smithi026 (mon.0) 337 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T16:50:10.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:10 smithi026 conmon[32119]: audit 2021-11-03T16:50:09.166207+0000 mon.smithi026 (mon.0) 338 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T16:50:10.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:10 smithi026 conmon[32119]: audit 2021-11-03T16:50:09.879527+0000 mon.smithi026 (mon.0) 339 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:50:10.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:10 smithi026 conmon[32119]: audit 2021-11-03T16:50:09.884589+0000 mon.smithi026 (mon.0) 340 2021-11-03T16:50:10.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:10 smithi026 conmon[32119]: : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:10.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:10 smithi026 conmon[32119]: audit 2021-11-03T16:50:09.891272+0000 mon.smithi026 (mon.0) 341 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:10.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:10 smithi026 conmon[32119]: audit 2021-11-03T16:50:09.894067+0000 mon.smithi026 (mon.0) 342 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-11-03T16:50:10.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:10 smithi194 conmon[35111]: cluster 2021-11-03T16:50:09. 2021-11-03T16:50:10.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:10 smithi194 conmon[35111]: 006754+0000 mgr.smithi026.cnrxli (mgr.14162) 139 : cluster [DBG] pgmap v99: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2021-11-03T16:50:10.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:10 smithi194 conmon[35111]: audit 2021-11-03T16:50:09.165965+0000 mon.smithi026 (mon.0) 337 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T16:50:10.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:10 smithi194 conmon[35111]: audit 2021-11-03T16:50:09.166207+0000 mon.smithi026 (mon.0) 338 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T16:50:10.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:10 smithi194 conmon[35111]: audit 2021-11-03T16:50:09.879527+0000 mon.smithi026 (mon.0) 339 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:50:10.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:10 smithi194 conmon[35111]: audit 2021-11-03T16:50:09.884589+0000 mon.smithi026 (mon.0) 340 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:10.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:10 smithi194 conmon[35111]: audit 2021-11-03T16:50:09.891272+0000 mon.smithi026 (mon.0) 341 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:10.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:10 smithi194 conmon[35111]: audit 2021-11-03T16:50:09.894067+0000 mon.smithi026 (mon.0) 342 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-11-03T16:50:12.163 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:11 smithi194 conmon[35111]: audit 2021-11-03T16:50:10.892978+0000 mon.smithi026 (mon.0) 343 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]': finished 2021-11-03T16:50:12.163 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:11 smithi194 conmon[35111]: cluster 2021-11-03T16:50:10.893041+0000 mon.smithi026 (mon.0) 344 : cluster [DBG] osdmap e21: 4 total, 3 up, 4 in 2021-11-03T16:50:12.163 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:11 smithi194 conmon[35111]: audit 2021-11-03T16:50:10.893176+0000 mon.smithi026 (mon.0) 345 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-11-03T16:50:12.164 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:11 smithi194 conmon[35111]: audit 2021-11-03T16:50:10.893908+0000 mon.smithi026 (mon.0) 346 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2021-11-03T16:50:12.164 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:11 smithi194 conmon[35111]: cluster 2021-11-03T16:50:11.007210+0000 mgr.smithi026.cnrxli (mgr.14162) 140 : cluster [DBG] pgmap v101: 1 pgs: 1 unknown; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2021-11-03T16:50:12.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:11 smithi026 conmon[32119]: audit 2021-11-03T16:50:10.892978+0000 mon.smithi026 (mon. 2021-11-03T16:50:12.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:11 smithi026 conmon[32119]: 0) 343 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]': finished 2021-11-03T16:50:12.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:11 smithi026 conmon[32119]: cluster 2021-11-03T16:50:10.893041+0000 mon.smithi026 (mon.0) 344 : cluster [DBG] osdmap e21: 4 total, 3 up, 4 in 2021-11-03T16:50:12.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:11 smithi026 conmon[32119]: audit 2021-11-03T16:50:10.893176+0000 mon.smithi026 (mon.0) 345 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-11-03T16:50:12.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:11 smithi026 conmon[32119]: audit 2021-11-03T16:50:10.893908+0000 mon.smithi026 (mon.0) 346 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2021-11-03T16:50:12.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:11 smithi026 conmon[32119]: cluster 2021-11-03T16:50:11.007210+0000 mgr.smithi026.cnrxli (mgr.14162) 140 : cluster [DBG] pgmap v101: 1 pgs: 1 unknown; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2021-11-03T16:50:12.707 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping: /dev/vg_nvme/lv_3 2021-11-03T16:50:12.708 INFO:teuthology.orchestra.run.smithi194.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2021-11-03T16:50:12.708 INFO:teuthology.orchestra.run.smithi194.stderr: stderr: 10+0 records in 2021-11-03T16:50:12.708 INFO:teuthology.orchestra.run.smithi194.stderr:10+0 records out 2021-11-03T16:50:12.708 INFO:teuthology.orchestra.run.smithi194.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0125473 s, 836 MB/s 2021-11-03T16:50:12.709 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping successful for: 2021-11-03T16:50:12.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:12 smithi194 conmon[35111]: audit 2021-11-03T16:50:11.894215+0000 mon.smithi026 (mon.0) 347 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2021-11-03T16:50:12.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:12 smithi194 conmon[35111]: cluster 2021-11-03T16:50:11.894305+0000 mon.smithi026 (mon.0) 348 : cluster [DBG] osdmap e22: 4 total, 3 up, 4 in 2021-11-03T16:50:12.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:12 smithi194 conmon[35111]: audit 2021-11-03T16:50:11.894608+0000 mon.smithi026 (mon.0) 349 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-11-03T16:50:12.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:12 smithi194 conmon[35111]: audit 2021-11-03T16:50:12.643532+0000 mon.smithi026 (mon.0) 350 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:13.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:12 smithi026 conmon[32119]: audit 2021-11-03T16:50:11.894215+0000 mon.smithi026 2021-11-03T16:50:13.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:12 smithi026 conmon[32119]: (mon.0) 347 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2021-11-03T16:50:13.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:12 smithi026 conmon[32119]: cluster 2021-11-03T16:50:11.894305+0000 mon.smithi026 ( 2021-11-03T16:50:13.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:12 smithi026 conmon[32119]: mon.0) 348 : cluster [DBG] osdmap e22: 4 total, 3 up, 4 in 2021-11-03T16:50:13.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:12 smithi026 conmon[32119]: audit 2021-11-03T 2021-11-03T16:50:13.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:12 smithi026 conmon[32119]: 16:50:11.894608+0000 mon.smithi026 (mon 2021-11-03T16:50:13.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:12 smithi026 conmon[32119]: .0) 349 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-11-03T16:50:13.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:12 smithi026 conmon[32119]: audit 2021- 2021-11-03T16:50:13.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:12 smithi026 conmon[32119]: 11-03T16:50:12.643532 2021-11-03T16:50:13.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:12 smithi026 conmon[32119]: +0000 mon.smithi026 (mon.0) 350 : audit 2021-11-03T16:50:13.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:12 smithi026 conmon[32119]: [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:13.299 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph orch daemon add osd smithi194:vg_nvme/lv_3 2021-11-03T16:50:13.985 INFO:journalctl@ceph.osd.3.smithi194.stdout:Nov 03 16:50:13 smithi194 conmon[41435]: debug 2021-11-03T16:50:13.873+0000 7fef02128080 -1 osd.3 0 log_to_monitors {default=true} 2021-11-03T16:50:14.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:14 smithi194 conmon[35111]: cluster 2021-11-03T16:50:13.007578+0000 mgr.smithi026.cnrxli (mgr.14162 2021-11-03T16:50:14.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:14 smithi194 conmon[35111]: ) 141 : cluster [DBG] pgmap v103: 1 pgs: 1 creating+activating; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2021-11-03T16:50:14.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:14 smithi194 conmon[35111]: cluster 2021-11-03T16:50:13.645855+0000 mon.smithi026 (mon.0) 351 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2021-11-03T16:50:14.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:14 smithi194 conmon[35111]: audit 2021-11-03T16:50:13.646017+0000 mon.smithi026 (mon.0) 352 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-11-03T16:50:14.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:14 smithi194 conmon[35111]: audit 2021-11-03T16:50:13.753858+0000 mon.smithi026 (mon.0) 353 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:14.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:14 smithi194 conmon[35111]: audit 2021-11-03T16:50:13.876961+0000 mon.smithi194 (mon.1) 4 : audit [INF] from='osd.3 [v2:172.21.15.194:6800/2165579585,v1:172.21.15.194:6801/2165579585]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-11-03T16:50:14.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:14 smithi194 conmon[35111]: audit 2021-11-03T16:50:13.877246+0000 mon.smithi026 (mon.0) 354 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-11-03T16:50:14.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:14 smithi026 conmon[32119]: cluster 2021-11-03T16:50:13.007578+0000 mgr.smithi026.cnrxli (mgr. 2021-11-03T16:50:14.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:14 smithi026 conmon[32119]: 14162) 141 : cluster [DBG] pgmap v103: 1 pgs: 1 creating+activating; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2021-11-03T16:50:14.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:14 smithi026 conmon[32119]: cluster 2021-11-03T16:50:13.645855+0000 mon.smithi026 (mon.0) 351 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2021-11-03T16:50:14.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:14 smithi026 conmon[32119]: audit 2021-11-03T16:50:13. 2021-11-03T16:50:14.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:14 smithi026 conmon[32119]: 646017+0000 mon.smithi026 (mon.0) 352 : audit 2021-11-03T16:50:14.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:14 smithi026 conmon[32119]: [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-11-03T16:50:14.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:14 smithi026 conmon[32119]: audit 2021-11-03T16:50:13.753858+0000 mon.smithi026 ( 2021-11-03T16:50:14.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:14 smithi026 conmon[32119]: mon.0) 353 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:14.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:14 smithi026 conmon[32119]: audit 2021-11-03T16:50:14.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:14 smithi026 conmon[32119]: 2021-11-03T16:50:13.876961+0000 2021-11-03T16:50:14.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:14 smithi026 conmon[32119]: mon.smithi194 (mon.1) 4 : audit [INF] 2021-11-03T16:50:14.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:14 smithi026 conmon[32119]: from='osd.3 [v2:172.21.15.194:6800/2165579585,v1:172.21.15.194:6801/2165579585]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-11-03T16:50:14.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:14 smithi026 conmon[32119]: audit 2021-11-03T16:50 2021-11-03T16:50:14.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:14 smithi026 conmon[32119]: :13.877246+0000 mon.smithi026 (mon.0) 2021-11-03T16:50:14.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:14 smithi026 conmon[32119]: 354 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-11-03T16:50:15.447 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:15.449+0000 7fcdad7d9700 1 -- 172.21.15.194:0/220935205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcda80f7970 msgr2=0x7fcda80f7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:50:15.447 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:15.449+0000 7fcdad7d9700 1 --2- 172.21.15.194:0/220935205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcda80f7970 0x7fcda80f7dd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fcd90004660 tx=0x7fcd90009b30).stop 2021-11-03T16:50:15.448 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:15.449+0000 7fcdad7d9700 1 -- 172.21.15.194:0/220935205 shutdown_connections 2021-11-03T16:50:15.448 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:15.449+0000 7fcdad7d9700 1 --2- 172.21.15.194:0/220935205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcda80f7970 0x7fcda80f7dd0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:50:15.448 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:15.449+0000 7fcdad7d9700 1 --2- 172.21.15.194:0/220935205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcda80f66d0 0x7fcda80f6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:50:15.448 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:15.449+0000 7fcdad7d9700 1 -- 172.21.15.194:0/220935205 >> 172.21.15.194:0/220935205 conn(0x7fcda80f1e10 msgr2=0x7fcda80f4250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:50:15.449 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:15.449+0000 7fcdad7d9700 1 -- 172.21.15.194:0/220935205 shutdown_connections 2021-11-03T16:50:15.449 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:15.449+0000 7fcdad7d9700 1 -- 172.21.15.194:0/220935205 wait complete. 2021-11-03T16:50:15.450 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:15.450+0000 7fcdad7d9700 1 Processor -- start 2021-11-03T16:50:15.450 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:15.450+0000 7fcdad7d9700 1 -- start start 2021-11-03T16:50:15.450 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:15.450+0000 7fcdad7d9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcda80f66d0 0x7fcda8106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:50:15.450 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:15.450+0000 7fcdad7d9700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcda80f7970 0x7fcda8107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:50:15.451 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:15.450+0000 7fcdad7d9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda8107a10 con 0x7fcda80f66d0 2021-11-03T16:50:15.451 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:15.450+0000 7fcdad7d9700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda8107b50 con 0x7fcda80f7970 2021-11-03T16:50:15.451 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:15.450+0000 7fcd9e7fc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcda80f7970 0x7fcda8107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:50:15.451 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:15.450+0000 7fcd9e7fc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcda80f7970 0x7fcda8107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:34128/0 (socket says 172.21.15.194:34128) 2021-11-03T16:50:15.452 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:15.450+0000 7fcd9e7fc700 1 -- 172.21.15.194:0/2105015246 learned_addr learned my addr 172.21.15.194:0/2105015246 (peer_addr_for_me v2:172.21.15.194:0/0) 2021-11-03T16:50:15.452 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:15.450+0000 7fcda6ffd700 1 --2- 172.21.15.194:0/2105015246 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcda80f66d0 0x7fcda8106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:50:15.452 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:15.451+0000 7fcd9e7fc700 1 -- 172.21.15.194:0/2105015246 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcda80f66d0 msgr2=0x7fcda8106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:50:15.453 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:15.451+0000 7fcd9e7fc700 1 --2- 172.21.15.194:0/2105015246 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcda80f66d0 0x7fcda8106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:50:15.453 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:15.451+0000 7fcd9e7fc700 1 -- 172.21.15.194:0/2105015246 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd90005040 con 0x7fcda80f7970 2021-11-03T16:50:15.453 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:15.451+0000 7fcd9e7fc700 1 --2- 172.21.15.194:0/2105015246 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcda80f7970 0x7fcda8107460 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fcd90009990 tx=0x7fcd90009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:50:15.453 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:15.451+0000 7fcd9ffff700 1 -- 172.21.15.194:0/2105015246 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd90018070 con 0x7fcda80f7970 2021-11-03T16:50:15.453 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:15.451+0000 7fcd9ffff700 1 -- 172.21.15.194:0/2105015246 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fcd90013410 con 0x7fcda80f7970 2021-11-03T16:50:15.454 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:15.451+0000 7fcdad7d9700 1 -- 172.21.15.194:0/2105015246 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcda8108490 con 0x7fcda80f7970 2021-11-03T16:50:15.454 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:15.451+0000 7fcd9ffff700 1 -- 172.21.15.194:0/2105015246 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd9001de80 con 0x7fcda80f7970 2021-11-03T16:50:15.454 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:15.451+0000 7fcdad7d9700 1 -- 172.21.15.194:0/2105015246 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcda81089f0 con 0x7fcda80f7970 2021-11-03T16:50:15.454 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:15.452+0000 7fcdad7d9700 1 -- 172.21.15.194:0/2105015246 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcda8045ad0 con 0x7fcda80f7970 2021-11-03T16:50:15.456 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:15.452+0000 7fcd9ffff700 1 -- 172.21.15.194:0/2105015246 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fcd9001d420 con 0x7fcda80f7970 2021-11-03T16:50:15.456 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:15.453+0000 7fcd9ffff700 1 --2- 172.21.15.194:0/2105015246 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fcd8805c2b0 0x7fcd8805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:50:15.456 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:15.453+0000 7fcd9ffff700 1 -- 172.21.15.194:0/2105015246 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 3249+0+0 (secure 0 0 0) 0x7fcd900771b0 con 0x7fcda80f7970 2021-11-03T16:50:15.456 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:15.453+0000 7fcda6ffd700 1 --2- 172.21.15.194:0/2105015246 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fcd8805c2b0 0x7fcd8805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:50:15.457 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:15.453+0000 7fcda6ffd700 1 --2- 172.21.15.194:0/2105015246 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fcd8805c2b0 0x7fcd8805e770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fcda80f77d0 tx=0x7fcd9800b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:50:15.457 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:15.457+0000 7fcd9ffff700 1 -- 172.21.15.194:0/2105015246 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fcd9004a740 con 0x7fcda80f7970 2021-11-03T16:50:15.634 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:15.639+0000 7fcdad7d9700 1 -- 172.21.15.194:0/2105015246 --> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fcda80fefc0 con 0x7fcd8805c2b0 2021-11-03T16:50:15.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:15 smithi026 conmon[32119]: audit 2021-11-03T16:50:14.756096+0000 mon.smithi026 (mon.0) 355 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-11-03T16:50:15.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:15 smithi026 conmon[32119]: cluster 2021-11-03T16:50:14.756221+0000 mon.smithi026 (mon.0) 356 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2021-11-03T16:50:15.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:15 smithi026 conmon[32119]: audit 2021-11-03T16:50:15.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:15 smithi026 conmon[32119]: 2021-11-03T16:50:14. 2021-11-03T16:50:15.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:15 smithi026 conmon[32119]: 756399+0000 mon.smithi026 (mon.0) 357 : audit 2021-11-03T16:50:15.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:15 smithi026 conmon[32119]: [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-11-03T16:50:15.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:15 smithi026 conmon[32119]: audit 2021 2021-11-03T16:50:15.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:15 smithi026 conmon[32119]: -11-03T16:50:14 2021-11-03T16:50:15.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:15 smithi026 conmon[32119]: .756822+0000 mon.smithi194 (mon.1) 5 2021-11-03T16:50:15.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:15 smithi026 conmon[32119]: : audit [INF] from='osd.3 [v2:172.21.15.194:6800/2165579585,v1:172.21.15.194:6801/2165579585]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2021-11-03T16:50:15.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:15 smithi026 conmon[32119]: audit 2021-11-03T16:50:15.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:15 smithi026 conmon[32119]: 2021-11-03T16:50: 2021-11-03T16:50:15.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:15 smithi026 conmon[32119]: 14.757093+0000 mon.smithi026 (mon. 2021-11-03T16:50:15.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:15 smithi026 conmon[32119]: 0) 358 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2021-11-03T16:50:15.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:15 smithi026 conmon[32119]: cluster 2021-11 2021-11-03T16:50:15.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:15 smithi026 conmon[32119]: -03T16:50:15.008102+0000 2021-11-03T16:50:15.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:15 smithi026 conmon[32119]: mgr.smithi026.cnrxli (mgr.14162) 142 : cluster [DBG] 2021-11-03T16:50:15.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:15 smithi026 conmon[32119]: pgmap v106: 1 pgs: 1 creating+activating; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-11-03T16:50:15.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:15 smithi026 conmon[32119]: audit 2021- 2021-11-03T16:50:15.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:15 smithi026 conmon[32119]: 11-03T16:50:15. 2021-11-03T16:50:15.928 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:15 smithi026 conmon[32119]: 642207+0000 mon.smithi026 (mon.0) 359 : 2021-11-03T16:50:15.928 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:15 smithi026 conmon[32119]: audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-11-03T16:50:15.928 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:15 smithi026 conmon[32119]: audit 2021 2021-11-03T16:50:15.929 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:15 smithi026 conmon[32119]: -11-03T16:50: 2021-11-03T16:50:15.929 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:15 smithi026 conmon[32119]: 15.643875+0000 mon.smithi026 (mon.0) 2021-11-03T16:50:15.929 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:15 smithi026 conmon[32119]: 360 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-11-03T16:50:15.929 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:15 smithi026 conmon[32119]: audit 2021- 2021-11-03T16:50:15.929 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:15 smithi026 conmon[32119]: 11-03T16:50:15.644631+0000 mon.smithi026 (mon. 2021-11-03T16:50:15.930 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:15 smithi026 conmon[32119]: 0) 361 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:50:16.044 INFO:journalctl@ceph.osd.3.smithi194.stdout:Nov 03 16:50:15 smithi194 conmon[41435]: debug 2021-11-03T16:50:15.762+0000 7feef8699700 -1 osd.3 0 waiting for initial osdmap 2021-11-03T16:50:16.044 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:15 smithi194 conmon[35111]: audit 2021-11-03T16:50:14.756096+0000 mon.smithi026 (mon.0) 355 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-11-03T16:50:16.045 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:15 smithi194 conmon[35111]: cluster 2021-11-03T16:50:14.756221+0000 mon.smithi026 (mon.0) 356 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2021-11-03T16:50:16.045 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:15 smithi194 conmon[35111]: audit 2021-11-03T16:50:14.756399+0000 mon.smithi026 (mon.0) 357 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-11-03T16:50:16.045 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:15 smithi194 conmon[35111]: audit 2021-11-03T16:50:14.756822+0000 mon.smithi194 (mon.1) 5 : audit [INF] from='osd.3 [v2:172.21.15.194:6800/2165579585,v1:172.21.15.194:6801/2165579585]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2021-11-03T16:50:16.045 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:15 smithi194 conmon[35111]: audit 2021-11-03T16:50:14.757093+0000 mon.smithi026 (mon.0) 358 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2021-11-03T16:50:16.046 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:15 smithi194 conmon[35111]: cluster 2021-11-03T16:50:15.008102+0000 mgr.smithi026.cnrxli (mgr.14162) 142 : cluster [DBG] pgmap v106: 1 pgs: 1 creating+activating; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-11-03T16:50:16.046 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:15 smithi194 conmon[35111]: audit 2021-11-03T16:50:15.642207+0000 mon.smithi026 (mon.0) 359 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-11-03T16:50:16.046 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:15 smithi194 conmon[35111]: audit 2021-11-03T16:50:15.643875+0000 mon.smithi026 (mon.0) 360 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-11-03T16:50:16.046 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:15 smithi194 conmon[35111]: audit 2021-11-03T16:50:15.644631+0000 mon.smithi026 (mon.0) 361 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:50:17.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:16 smithi026 conmon[32119]: audit 2021-11-03T16:50:15.641188+0000 mgr.smithi026.cnrxli 2021-11-03T16:50:17.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:16 smithi026 conmon[32119]: (mgr.14162) 143 : audit [DBG] from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:50:17.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:16 smithi026 conmon[32119]: cephadm 2021-11-03T16:50:15.643618+0000 2021-11-03T16:50:17.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:16 smithi026 conmon[32119]: mgr.smithi026.cnrxli (mgr.14162) 144 : cephadm [INF] Applying service osd.None on host smithi194... 2021-11-03T16:50:17.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:16 smithi026 conmon[32119]: audit 2021- 2021-11-03T16:50:17.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:16 smithi026 conmon[32119]: 11-03T16:50:15.758370 2021-11-03T16:50:17.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:16 smithi026 conmon[32119]: +0000 mon.smithi026 (mon.0) 362 2021-11-03T16:50:17.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:16 smithi026 conmon[32119]: : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2021-11-03T16:50:17.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:16 smithi026 conmon[32119]: cluster 2021-11-03T16:50:17.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:16 smithi026 conmon[32119]: 2021-11-03T16:50:15. 2021-11-03T16:50:17.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:16 smithi026 conmon[32119]: 758486+0000 mon.smithi026 (mon.0) 363 : 2021-11-03T16:50:17.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:16 smithi026 conmon[32119]: cluster [DBG] osdmap e25: 4 total, 3 up, 4 in 2021-11-03T16:50:17.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:16 smithi026 conmon[32119]: audit 2021-11-03T16:50:15. 2021-11-03T16:50:17.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:16 smithi026 conmon[32119]: 758931+0000 mon.smithi026 (mon.0) 364 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-11-03T16:50:17.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:16 smithi026 conmon[32119]: 2021-11-03T16:50:17.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:16 smithi026 conmon[32119]: audit 2021-11-03T16:50:15.763528+0000 2021-11-03T16:50:17.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:16 smithi026 conmon[32119]: mon.smithi026 (mon.0) 365 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-11-03T16:50:17.223 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:16 smithi194 conmon[35111]: audit 2021-11-03T16:50:15.641188+0000 mgr.smithi026.cnrxli (mgr.14162) 143 : audit [DBG] from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:50:17.223 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:16 smithi194 conmon[35111]: cephadm 2021-11-03T16:50:15.643618+0000 mgr.smithi026.cnrxli (mgr.14162) 144 : cephadm [INF] Applying service osd.None on host smithi194... 2021-11-03T16:50:17.223 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:16 smithi194 conmon[35111]: audit 2021-11-03T16:50:15.758370+0000 mon.smithi026 (mon.0) 362 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2021-11-03T16:50:17.224 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:16 smithi194 conmon[35111]: cluster 2021-11-03T16:50:15.758486+0000 mon.smithi026 (mon.0) 363 : cluster [DBG] osdmap e25: 4 total, 3 up, 4 in 2021-11-03T16:50:17.224 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:16 smithi194 conmon[35111]: audit 2021-11-03T16:50:15.758931+0000 mon.smithi026 (mon.0) 364 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-11-03T16:50:17.224 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:16 smithi194 conmon[35111]: audit 2021-11-03T16:50:15.763528+0000 mon.smithi026 (mon.0) 365 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-11-03T16:50:17.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:17 smithi194 conmon[35111]: cluster 2021-11-03T16:50:14.894313+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2021-11-03T16:50:17.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:17 smithi194 conmon[35111]: cluster 2021-11-03T16:50:14.894437+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2021-11-03T16:50:17.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:17 smithi194 conmon[35111]: cluster 2021-11-03T16:50:16.764489+0000 mon.smithi026 (mon.0) 366 : cluster [INF] osd.3 [v2:172.21.15.194:6800/2165579585,v1:172.21.15.194:6801/2165579585] boot 2021-11-03T16:50:17.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:17 smithi194 conmon[35111]: cluster 2021-11-03T16:50:16.764546+0000 mon.smithi026 (mon.0) 367 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2021-11-03T16:50:17.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:17 smithi194 conmon[35111]: audit 2021-11-03T16:50:16.764997+0000 mon.smithi026 (mon.0) 368 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-11-03T16:50:17.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:17 smithi194 conmon[35111]: cluster 2021-11-03T16:50:17.008577+0000 mgr.smithi026.cnrxli (mgr.14162) 145 : cluster [DBG] pgmap v109: 1 pgs: 1 creating+activating; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-11-03T16:50:17.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:17 smithi194 conmon[35111]: audit 2021-11-03T16:50:17.478149+0000 mon.smithi026 (mon.0) 369 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:18.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:17 smithi194 conmon[35111]: audit 2021-11-03T16:50:17.481990+0000 mon.smithi026 (mon.0) 370 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:18.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:17 smithi194 conmon[35111]: audit 2021-11-03T16:50:17.485573+0000 mon.smithi026 (mon.0) 371 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:50:18.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:17 smithi026 conmon[32119]: cluster 2021-11-03T16:50:14.894313+0000 osd.3 (osd.3) 1 2021-11-03T16:50:18.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:17 smithi026 conmon[32119]: : cluster [DBG] purged_snaps scrub starts 2021-11-03T16:50:18.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:17 smithi026 conmon[32119]: cluster 2021-11-03T16:50:14.894437+0000 osd.3 (osd.3) 2 : cluster [DBG] 2021-11-03T16:50:18.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:17 smithi026 conmon[32119]: purged_snaps scrub ok 2021-11-03T16:50:18.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:17 smithi026 conmon[32119]: cluster 2021-11-03T16:50:16. 2021-11-03T16:50:18.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:17 smithi026 conmon[32119]: 764489+0000 mon.smithi026 (mon.0) 366 : cluster 2021-11-03T16:50:18.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:17 smithi026 conmon[32119]: [INF] osd.3 [v2:172.21.15.194:6800/2165579585,v1:172.21.15.194:6801/2165579585] boot 2021-11-03T16:50:18.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:17 smithi026 conmon[32119]: cluster 2021-11-03T16 2021-11-03T16:50:18.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:17 smithi026 conmon[32119]: :50:16.764546+0000 mon.smithi026 2021-11-03T16:50:18.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:17 smithi026 conmon[32119]: (mon.0) 367 : cluster 2021-11-03T16:50:18.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:17 smithi026 conmon[32119]: [DBG] osdmap e26: 4 total, 4 up, 4 in 2021-11-03T16:50:18.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:17 smithi026 conmon[32119]: audit 2021-11 2021-11-03T16:50:18.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:17 smithi026 conmon[32119]: -03T16:50:16.764997+0000 mon.smithi026 (mon.0) 368 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-11-03T16:50:18.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:17 smithi026 conmon[32119]: 2021-11-03T16:50:18.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:17 smithi026 conmon[32119]: cluster 2021-11-03T16:50:17.008577+0000 mgr.smithi026.cnrxli ( 2021-11-03T16:50:18.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:17 smithi026 conmon[32119]: mgr.14162) 145 : cluster [DBG] pgmap v109: 1 pgs: 1 creating+activating; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-11-03T16:50:18.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:17 smithi026 conmon[32119]: audit 2021-11-03T 2021-11-03T16:50:18.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:17 smithi026 conmon[32119]: 16:50:17.478149+0000 mon.smithi026 (mon.0) 369 : audit 2021-11-03T16:50:18.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:17 smithi026 conmon[32119]: [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:18.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:17 smithi026 conmon[32119]: audit 2021-11-03T16:50:17.481990+0000 mon.smithi026 2021-11-03T16:50:18.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:17 smithi026 conmon[32119]: (mon.0) 370 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:18.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:17 smithi026 conmon[32119]: audit 2021-11-03T16:50:17.485573+0000 mon.smithi026 (mon. 2021-11-03T16:50:18.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:17 smithi026 conmon[32119]: 0) 371 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:50:19.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:18 smithi026 conmon[32119]: cephadm 2021-11-03T16:50:17.473314+0000 mgr.smithi026.cnrxli (mgr 2021-11-03T16:50:19.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:18 smithi026 conmon[32119]: .14162) 146 : cephadm [INF] Detected new or changed devices on smithi194 2021-11-03T16:50:19.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:18 smithi026 conmon[32119]: cluster 2021-11-03T16:50:17.772106+0000 mon.smithi026 (mon 2021-11-03T16:50:19.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:18 smithi026 conmon[32119]: .0) 372 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2021-11-03T16:50:19.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:18 smithi026 conmon[32119]: audit 2021-11-03T16: 2021-11-03T16:50:19.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:18 smithi026 conmon[32119]: 50:18.340768+0000 mon.smithi194 (mon.1) 6 : audit 2021-11-03T16:50:19.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:18 smithi026 conmon[32119]: [INF] from='client.? 172.21.15.194:0/1960067791' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ddecb09f-cc9a-4c46-a537-d53a5249a778"}]: dispatch 2021-11-03T16:50:19.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:18 smithi026 conmon[32119]: audit 2021-11-03T 2021-11-03T16:50:19.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:18 smithi026 conmon[32119]: 16:50:18.341058+0000 mon.smithi026 ( 2021-11-03T16:50:19.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:18 smithi026 conmon[32119]: mon.0) 373 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ddecb09f-cc9a-4c46-a537-d53a5249a778"}]: dispatch 2021-11-03T16:50:19.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:18 smithi026 conmon[32119]: 2021-11-03T16:50:19.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:18 smithi026 conmon[32119]: audit 2021-11- 2021-11-03T16:50:19.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:18 smithi026 conmon[32119]: 03T16:50:18.345027 2021-11-03T16:50:19.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:18 smithi026 conmon[32119]: +0000 mon.smithi026 (mon.0) 374 : 2021-11-03T16:50:19.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:18 smithi026 conmon[32119]: audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ddecb09f-cc9a-4c46-a537-d53a5249a778"}]': finished 2021-11-03T16:50:19.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:18 smithi026 conmon[32119]: cluster 2021-11-03T16:50 2021-11-03T16:50:19.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:18 smithi026 conmon[32119]: :18.345091+0000 mon.smithi026 (mon.0) 375 : 2021-11-03T16:50:19.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:18 smithi026 conmon[32119]: cluster [DBG] osdmap e28: 5 total, 4 up, 5 in 2021-11-03T16:50:19.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:18 smithi026 conmon[32119]: audit 2021-11 2021-11-03T16:50:19.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:18 smithi026 conmon[32119]: -03T16:50:18.345186+0000 2021-11-03T16:50:19.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:18 smithi026 conmon[32119]: mon.smithi026 (mon.0) 376 : audit [DBG] 2021-11-03T16:50:19.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:18 smithi026 conmon[32119]: from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-11-03T16:50:19.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:18 smithi194 conmon[35111]: cephadm 2021-11-03T16:50:17.473314+0000 mgr.smithi026.cnrxli (mgr. 2021-11-03T16:50:19.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:18 smithi194 conmon[35111]: 14162) 146 : cephadm [INF] Detected new or changed devices on smithi194 2021-11-03T16:50:19.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:18 smithi194 conmon[35111]: cluster 2021-11-03T16:50:17.772106+0000 mon.smithi026 (mon.0) 372 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2021-11-03T16:50:19.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:18 smithi194 conmon[35111]: audit 2021-11-03T16:50:18.340768+0000 mon.smithi194 (mon.1) 6 : audit [INF] from='client.? 172.21.15.194:0/1960067791' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ddecb09f-cc9a-4c46-a537-d53a5249a778"}]: dispatch 2021-11-03T16:50:19.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:18 smithi194 conmon[35111]: audit 2021-11-03T16:50:18.341058+0000 mon.smithi026 (mon.0) 373 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ddecb09f-cc9a-4c46-a537-d53a5249a778"}]: dispatch 2021-11-03T16:50:19.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:18 smithi194 conmon[35111]: audit 2021-11-03T16:50:18.345027+0000 mon.smithi026 (mon.0) 374 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ddecb09f-cc9a-4c46-a537-d53a5249a778"}]': finished 2021-11-03T16:50:19.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:18 smithi194 conmon[35111]: cluster 2021-11-03T16:50:18.345091+0000 mon.smithi026 (mon.0) 375 : cluster [DBG] osdmap e28: 5 total, 4 up, 5 in 2021-11-03T16:50:19.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:18 smithi194 conmon[35111]: audit 2021-11-03T16:50:18.345186+0000 mon.smithi026 (mon.0) 376 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-11-03T16:50:20.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:19 smithi026 conmon[32119]: audit 2021-11-03T16:50:18.843063+0000 2021-11-03T16:50:20.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:19 smithi026 conmon[32119]: mon.smithi194 (mon.1) 7 : audit [DBG] from='client.? 172.21.15.194:0/3906452046' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-11-03T16:50:20.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:19 smithi026 conmon[32119]: cluster 2021-11-03T16:50:19.008872+0000 mgr.smithi026.cnrxli (mgr.14162) 147 : cluster [DBG] pgmap v112: 1 pgs: 1 remapped+peering; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-11-03T16:50:20.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:19 smithi194 conmon[35111]: audit 2021-11-03T16:50:18.843063+0000 mon.smithi194 (mon.1) 7 : audit [DBG] from='client.? 172.21.15.194:0/3906452046' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-11-03T16:50:20.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:19 smithi194 conmon[35111]: cluster 2021-11-03T16:50:19.008872+0000 mgr.smithi026.cnrxli (mgr.14162) 147 : cluster [DBG] pgmap v112: 1 pgs: 1 remapped+peering; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-11-03T16:50:22.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:22 smithi194 conmon[35111]: cluster 2021-11-03T16:50:21.009381+0000 mgr.smithi026.cnrxli (mgr.14162) 148 2021-11-03T16:50:22.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:22 smithi194 conmon[35111]: : cluster [DBG] pgmap v113: 1 pgs: 1 remapped+peering; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-11-03T16:50:22.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:22 smithi194 conmon[35111]: audit 2021-11-03T16:50:21.287846+0000 mon.smithi026 (mon.0) 377 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:22.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:22 smithi194 conmon[35111]: audit 2021-11-03T16:50:21.290677+0000 mon.smithi026 (mon.0) 378 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:22.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:22 smithi026 conmon[32119]: cluster 2021-11-03T16:50:21.009381+0000 mgr.smithi026.cnrxli (mgr.14162) 148 2021-11-03T16:50:22.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:22 smithi026 conmon[32119]: : cluster [DBG] pgmap v113: 1 pgs: 1 remapped+peering; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-11-03T16:50:22.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:22 smithi026 conmon[32119]: audit 2021-11-03T16:50:21.287846+0000 mon.smithi026 (mon.0) 377 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:22.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:22 smithi026 conmon[32119]: audit 2021-11-03T16:50:22.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:22 smithi026 conmon[32119]: 2021-11-03T16:50:21.290677+0000 mon.smithi026 (mon.0) 378 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:22.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:22 smithi026 conmon[32119]: 2021-11-03T16:50:24.639 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:24 smithi194 conmon[35111]: cluster 2021-11-03T16:50:23.009942+0000 mgr.smithi026.cnrxli (mgr.14162) 149 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-11-03T16:50:24.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:24 smithi026 conmon[32119]: cluster 2021-11-03T16:50:23.009942+0000 mgr.smithi026.cnrxli (mgr.14162) 149 : cluster 2021-11-03T16:50:24.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:24 smithi026 conmon[32119]: [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-11-03T16:50:25.574 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:25 smithi026 conmon[32119]: audit 2021-11-03T16:50:25.278878+0000 mon.smithi026 (mon.0) 379 : audit [INF] 2021-11-03T16:50:25.575 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:25 smithi026 conmon[32119]: from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-11-03T16:50:25.575 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:25 smithi026 conmon[32119]: audit 2021-11-03T16:50:25.279864+0000 mon.smithi026 (mon.0) 380 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:50:25.739 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:25 smithi194 conmon[35111]: audit 2021-11-03T16:50:25.278878+0000 mon.smithi026 (mon.0) 379 2021-11-03T16:50:25.740 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:25 smithi194 conmon[35111]: : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-11-03T16:50:25.740 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:25 smithi194 conmon[35111]: audit 2021-11-03T16:50:25.279864+0000 mon.smithi026 (mon.0) 380 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:50:26.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:26 smithi194 conmon[35111]: cluster 2021-11-03T16:50:25.010471+0000 mgr.smithi026.cnrxli (mgr.14162) 150 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-11-03T16:50:26.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:26 smithi194 conmon[35111]: cephadm 2021-11-03T16:50:25.280710+0000 mgr.smithi026.cnrxli (mgr.14162) 151 : cephadm [INF] Deploying daemon osd.4 on smithi194 2021-11-03T16:50:26.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:26 smithi026 conmon[32119]: cluster 2021-11-03T16:50:25.010471+0000 mgr.smithi026.cnrxli (mgr.14162 2021-11-03T16:50:26.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:26 smithi026 conmon[32119]: ) 150 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-11-03T16:50:26.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:26 smithi026 conmon[32119]: cephadm 2021-11-03T16:50:25.280710+0000 mgr.smithi026.cnrxli (mgr.14162) 151 : cephadm [INF] 2021-11-03T16:50:26.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:26 smithi026 conmon[32119]: Deploying daemon osd.4 on smithi194 2021-11-03T16:50:28.565 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:28 smithi194 conmon[35111]: cluster 2021-11-03T16:50:27.011020+0000 mgr.smithi026.cnrxli (mgr.14162) 152 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-11-03T16:50:28.616 INFO:teuthology.orchestra.run.smithi194.stdout:Created osd(s) 4 on host 'smithi194' 2021-11-03T16:50:28.617 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:28.618+0000 7fcd9ffff700 1 -- 172.21.15.194:0/2105015246 <== mgr.14162 v2:172.21.15.26:6800/3029163595 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fcda80fefc0 con 0x7fcd8805c2b0 2021-11-03T16:50:28.618 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:28.621+0000 7fcdad7d9700 1 -- 172.21.15.194:0/2105015246 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fcd8805c2b0 msgr2=0x7fcd8805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:50:28.618 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:28.621+0000 7fcdad7d9700 1 --2- 172.21.15.194:0/2105015246 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fcd8805c2b0 0x7fcd8805e770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fcda80f77d0 tx=0x7fcd9800b040).stop 2021-11-03T16:50:28.618 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:28.621+0000 7fcdad7d9700 1 -- 172.21.15.194:0/2105015246 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcda80f7970 msgr2=0x7fcda8107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:50:28.618 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:28.621+0000 7fcdad7d9700 1 --2- 172.21.15.194:0/2105015246 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcda80f7970 0x7fcda8107460 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fcd90009990 tx=0x7fcd90009b30).stop 2021-11-03T16:50:28.619 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:28.621+0000 7fcdad7d9700 1 -- 172.21.15.194:0/2105015246 shutdown_connections 2021-11-03T16:50:28.619 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:28.621+0000 7fcdad7d9700 1 --2- 172.21.15.194:0/2105015246 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fcd8805c2b0 0x7fcd8805e770 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:50:28.621 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:28.621+0000 7fcdad7d9700 1 --2- 172.21.15.194:0/2105015246 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcda80f66d0 0x7fcda8106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:50:28.621 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:28.621+0000 7fcdad7d9700 1 --2- 172.21.15.194:0/2105015246 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcda80f7970 0x7fcda8107460 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:50:28.621 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:28.621+0000 7fcdad7d9700 1 -- 172.21.15.194:0/2105015246 >> 172.21.15.194:0/2105015246 conn(0x7fcda80f1e10 msgr2=0x7fcda80fb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:50:28.622 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:28.621+0000 7fcdad7d9700 1 -- 172.21.15.194:0/2105015246 shutdown_connections 2021-11-03T16:50:28.622 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:28.621+0000 7fcdad7d9700 1 -- 172.21.15.194:0/2105015246 wait complete. 2021-11-03T16:50:28.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:28 smithi026 conmon[32119]: cluster 2021-11-03T16:50:27.011020+0000 mgr.smithi026.cnrxli (mgr.14162) 152 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-11-03T16:50:29.220 DEBUG:teuthology.orchestra.run.smithi194:osd.4> sudo journalctl -f -n 0 -u ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c@osd.4.service 2021-11-03T16:50:29.224 INFO:tasks.cephadm:Deploying osd.5 on smithi194 with /dev/vg_nvme/lv_2... 2021-11-03T16:50:29.225 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2021-11-03T16:50:29.251 INFO:journalctl@ceph.osd.4.smithi194.stdout:-- Logs begin at Wed 2021-11-03 16:35:29 UTC. -- 2021-11-03T16:50:29.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:29 smithi194 conmon[35111]: audit 2021-11-03T16:50:28.609944+0000 mon.smithi026 (mon.0) 381 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:50:29.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:29 smithi194 conmon[35111]: audit 2021-11-03T16:50:28.614390+0000 mon.smithi026 (mon.0) 382 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:29.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:29 smithi194 conmon[35111]: audit 2021-11-03T16:50:28.619393+0000 mon.smithi026 (mon.0) 383 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:29.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:29 smithi026 conmon[32119]: audit 2021-11-03T16:50:28.609944+0000 mon.smithi026 2021-11-03T16:50:29.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:29 smithi026 conmon[32119]: (mon.0) 381 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:50:29.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:29 smithi026 conmon[32119]: audit 2021-11-03T16:50:28.614390+0000 mon.smithi026 ( 2021-11-03T16:50:29.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:29 smithi026 conmon[32119]: mon.0) 382 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:29.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:29 smithi026 conmon[32119]: audit 2021-11-03T16:50:29.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:29 smithi026 conmon[32119]: 2021-11-03T16:50:28.619393+0000 mon.smithi026 ( 2021-11-03T16:50:29.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:29 smithi026 conmon[32119]: mon.0) 383 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:30.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:30 smithi194 conmon[35111]: cluster 2021-11-03T16:50:29.011316+0000 mgr.smithi026.cnrxli (mgr.14162) 153 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-11-03T16:50:30.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:30 smithi026 conmon[32119]: cluster 2021-11-03T16:50:29.011316+0000 mgr.smithi026.cnrxli 2021-11-03T16:50:30.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:30 smithi026 conmon[32119]: (mgr.14162) 153 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-11-03T16:50:31.396 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping: /dev/vg_nvme/lv_2 2021-11-03T16:50:31.396 INFO:teuthology.orchestra.run.smithi194.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2021-11-03T16:50:31.397 INFO:teuthology.orchestra.run.smithi194.stderr: stderr: 10+0 records in 2021-11-03T16:50:31.397 INFO:teuthology.orchestra.run.smithi194.stderr:10+0 records out 2021-11-03T16:50:31.397 INFO:teuthology.orchestra.run.smithi194.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0124797 s, 840 MB/s 2021-11-03T16:50:31.398 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping successful for: 2021-11-03T16:50:32.230 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph orch daemon add osd smithi194:vg_nvme/lv_2 2021-11-03T16:50:32.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:32 smithi194 conmon[35111]: cluster 2021-11-03T16:50:31.011613+0000 mgr.smithi026.cnrxli (mgr.14162) 154 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-11-03T16:50:32.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:32 smithi194 conmon[35111]: audit 2021-11-03T16:50:31.611815+0000 mon.smithi026 (mon.0) 384 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:32.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:32 smithi026 conmon[32119]: cluster 2021-11-03T16:50:31. 2021-11-03T16:50:32.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:32 smithi026 conmon[32119]: 011613+0000 mgr.smithi026.cnrxli (mgr.14162) 154 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-11-03T16:50:32.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:32 smithi026 conmon[32119]: audit 2021-11-03T16:50:32.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:32 smithi026 conmon[32119]: 2021-11-03T16:50:31. 2021-11-03T16:50:32.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:32 smithi026 conmon[32119]: 611815+0000 mon.smithi026 (mon.0) 384 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:32.940 INFO:journalctl@ceph.osd.4.smithi194.stdout:Nov 03 16:50:32 smithi194 conmon[46291]: debug 2021-11-03T16:50:32.614+0000 7fc928b10080 -1 osd.4 0 log_to_monitors {default=true} 2021-11-03T16:50:33.471 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:33 smithi194 conmon[35111]: audit 2021-11-03T16:50:32.431857+0000 mon.smithi026 (mon.0) 385 2021-11-03T16:50:33.471 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:33 smithi194 conmon[35111]: : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:33.472 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:33 smithi194 conmon[35111]: audit 2021-11-03T16:50:32.617827+0000 mon.smithi194 (mon.1) 8 : audit [INF] from='osd.4 [v2:172.21.15.194:6808/3847943561,v1:172.21.15.194:6809/3847943561]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-11-03T16:50:33.472 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:33 smithi194 conmon[35111]: audit 2021 2021-11-03T16:50:33.472 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:33 smithi194 conmon[35111]: -11-03T16:50:32.618090+0000 mon.smithi026 (mon.0) 386 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-11-03T16:50:33.472 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:33 smithi194 conmon[35111]: cluster 2021-11-03 2021-11-03T16:50:33.472 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:33 smithi194 conmon[35111]: T16:50:33.011904+0000 mgr.smithi026.cnrxli (mgr.14162) 155 : cluster 2021-11-03T16:50:33.473 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:33 smithi194 conmon[35111]: [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-11-03T16:50:33.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:33 smithi026 conmon[32119]: audit 2021-11-03T16:50:32.431857+0000 mon.smithi026 ( 2021-11-03T16:50:33.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:33 smithi026 conmon[32119]: mon.0) 385 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:33.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:33 smithi026 conmon[32119]: audit 2021-11-03T16:50:32.617827+0000 mon.smithi194 (mon.1) 8 : audit [INF] from='osd.4 [v2:172.21.15.194:6808/3847943561,v1:172.21.15.194:6809/3847943561]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-11-03T16:50:33.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:33 smithi026 conmon[32119]: 2021-11-03T16:50:33.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:33 smithi026 conmon[32119]: audit 2021-11-03T16:50 2021-11-03T16:50:33.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:33 smithi026 conmon[32119]: :32.618090+0000 mon.smithi026 (mon.0) 386 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-11-03T16:50:33.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:33 smithi026 conmon[32119]: cluster 2021-11-03T16:50:33.011904+0000 mgr.smithi026.cnrxli 2021-11-03T16:50:33.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:33 smithi026 conmon[32119]: (mgr.14162) 155 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-11-03T16:50:34.567 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:34.570+0000 7fefdd64c700 1 -- 172.21.15.194:0/4103114681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefd80f66e0 msgr2=0x7fefd80f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:50:34.568 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:34.570+0000 7fefdd64c700 1 --2- 172.21.15.194:0/4103114681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefd80f66e0 0x7fefd80f6b00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fefc80099e0 tx=0x7fefc8004d10).stop 2021-11-03T16:50:34.568 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:34.570+0000 7fefdd64c700 1 -- 172.21.15.194:0/4103114681 shutdown_connections 2021-11-03T16:50:34.568 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:34.570+0000 7fefdd64c700 1 --2- 172.21.15.194:0/4103114681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefd80f7980 0x7fefd80f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:50:34.568 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:34.570+0000 7fefdd64c700 1 --2- 172.21.15.194:0/4103114681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefd80f66e0 0x7fefd80f6b00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:50:34.569 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:34.570+0000 7fefdd64c700 1 -- 172.21.15.194:0/4103114681 >> 172.21.15.194:0/4103114681 conn(0x7fefd80f1e40 msgr2=0x7fefd80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:50:34.569 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:34.570+0000 7fefdd64c700 1 -- 172.21.15.194:0/4103114681 shutdown_connections 2021-11-03T16:50:34.569 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:34.570+0000 7fefdd64c700 1 -- 172.21.15.194:0/4103114681 wait complete. 2021-11-03T16:50:34.569 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:34.570+0000 7fefdd64c700 1 Processor -- start 2021-11-03T16:50:34.570 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:34.571+0000 7fefdd64c700 1 -- start start 2021-11-03T16:50:34.570 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:34.571+0000 7fefdd64c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefd80f66e0 0x7fefd81070d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:50:34.570 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:34.571+0000 7fefdd64c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefd80f7980 0x7fefd81075c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:50:34.570 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:34.571+0000 7fefdd64c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd8107b70 con 0x7fefd80f66e0 2021-11-03T16:50:34.571 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:34.571+0000 7fefdd64c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd8107cb0 con 0x7fefd80f7980 2021-11-03T16:50:34.571 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:34.571+0000 7fefd67fc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefd80f7980 0x7fefd81075c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:50:34.571 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:34.571+0000 7fefd67fc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefd80f7980 0x7fefd81075c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:34194/0 (socket says 172.21.15.194:34194) 2021-11-03T16:50:34.571 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:34.571+0000 7fefd67fc700 1 -- 172.21.15.194:0/2686370468 learned_addr learned my addr 172.21.15.194:0/2686370468 (peer_addr_for_me v2:172.21.15.194:0/0) 2021-11-03T16:50:34.571 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:34.571+0000 7fefd6ffd700 1 --2- 172.21.15.194:0/2686370468 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefd80f66e0 0x7fefd81070d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:50:34.572 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:34.571+0000 7fefd67fc700 1 -- 172.21.15.194:0/2686370468 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefd80f66e0 msgr2=0x7fefd81070d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:50:34.572 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:34.571+0000 7fefd67fc700 1 --2- 172.21.15.194:0/2686370468 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefd80f66e0 0x7fefd81070d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:50:34.572 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:34.571+0000 7fefd67fc700 1 -- 172.21.15.194:0/2686370468 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc8009640 con 0x7fefd80f7980 2021-11-03T16:50:34.572 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:34.571+0000 7fefd67fc700 1 --2- 172.21.15.194:0/2686370468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefd80f7980 0x7fefd81075c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fefc00026d0 tx=0x7fefc0009de0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:50:34.573 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:34.571+0000 7fefcf7fe700 1 -- 172.21.15.194:0/2686370468 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefc00079c0 con 0x7fefd80f7980 2021-11-03T16:50:34.573 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:34.571+0000 7fefdd64c700 1 -- 172.21.15.194:0/2686370468 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefd8108650 con 0x7fefd80f7980 2021-11-03T16:50:34.573 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:34.571+0000 7fefcf7fe700 1 -- 172.21.15.194:0/2686370468 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fefc000f040 con 0x7fefd80f7980 2021-11-03T16:50:34.573 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:34.571+0000 7fefcf7fe700 1 -- 172.21.15.194:0/2686370468 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefc0014820 con 0x7fefd80f7980 2021-11-03T16:50:34.574 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:34.571+0000 7fefdd64c700 1 -- 172.21.15.194:0/2686370468 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd8108b90 con 0x7fefd80f7980 2021-11-03T16:50:34.575 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:34.573+0000 7fefdd64c700 1 -- 172.21.15.194:0/2686370468 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefd8045ad0 con 0x7fefd80f7980 2021-11-03T16:50:34.575 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:34.573+0000 7fefcf7fe700 1 -- 172.21.15.194:0/2686370468 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fefc0014980 con 0x7fefd80f7980 2021-11-03T16:50:34.575 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:34.573+0000 7fefcf7fe700 1 --2- 172.21.15.194:0/2686370468 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fefc405c2b0 0x7fefc405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:50:34.576 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:34.573+0000 7fefcf7fe700 1 -- 172.21.15.194:0/2686370468 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 3807+0+0 (secure 0 0 0) 0x7fefc0075880 con 0x7fefd80f7980 2021-11-03T16:50:34.576 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:34.574+0000 7fefd6ffd700 1 --2- 172.21.15.194:0/2686370468 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fefc405c2b0 0x7fefc405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:50:34.576 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:34.574+0000 7fefd6ffd700 1 --2- 172.21.15.194:0/2686370468 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fefc405c2b0 0x7fefc405e770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fefc8003380 tx=0x7fefc8004d10).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:50:34.576 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:34.577+0000 7fefcf7fe700 1 -- 172.21.15.194:0/2686370468 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fefc0048b70 con 0x7fefd80f7980 2021-11-03T16:50:34.748 INFO:journalctl@ceph.osd.4.smithi194.stdout:Nov 03 16:50:34 smithi194 conmon[46291]: debug 2021-11-03T16:50:34.446+0000 7fc91f081700 -1 osd.4 0 waiting for initial osdmap 2021-11-03T16:50:34.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:34 smithi194 conmon[35111]: audit 2021-11-03T16:50:33.438078+0000 mon.smithi026 (mon.0) 387 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-11-03T16:50:34.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:34 smithi194 conmon[35111]: cluster 2021-11-03T16:50:33.438227+0000 mon.smithi026 (mon.0) 388 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2021-11-03T16:50:34.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:34 smithi194 conmon[35111]: audit 2021-11-03T16:50:33.438659+0000 mon.smithi026 (mon.0) 389 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-11-03T16:50:34.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:34 smithi194 conmon[35111]: audit 2021-11-03T16:50:33.440656+0000 mon.smithi194 (mon.1) 9 : audit [INF] from='osd.4 [v2:172.21.15.194:6808/3847943561,v1:172.21.15.194:6809/3847943561]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2021-11-03T16:50:34.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:34 smithi194 conmon[35111]: audit 2021-11-03T16:50:33.440919+0000 mon.smithi026 (mon.0) 390 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2021-11-03T16:50:34.757 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:34.761+0000 7fefdd64c700 1 -- 172.21.15.194:0/2686370468 --> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fefd80fefb0 con 0x7fefc405c2b0 2021-11-03T16:50:34.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:34 smithi026 conmon[32119]: audit 2021-11-03T16:50:33.438078+0000 mon.smithi026 (mon.0) 387 : audit 2021-11-03T16:50:34.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:34 smithi026 conmon[32119]: [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-11-03T16:50:34.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:34 smithi026 conmon[32119]: cluster 2021-11-03T16:50:33.438227+0000 mon.smithi026 (mon.0) 388 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2021-11-03T16:50:34.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:34 smithi026 conmon[32119]: audit 2021-11-03T16:50:34.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:34 smithi026 conmon[32119]: 2021-11-03T16:50:33.438659+0000 mon.smithi026 (mon.0) 389 : audit [DBG] 2021-11-03T16:50:34.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:34 smithi026 conmon[32119]: from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-11-03T16:50:34.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:34 smithi026 conmon[32119]: audit 2021-11-03T16:50 2021-11-03T16:50:34.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:34 smithi026 conmon[32119]: :33.440656+0000 mon.smithi194 (mon.1) 9 : audit [INF] 2021-11-03T16:50:34.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:34 smithi026 conmon[32119]: from='osd.4 [v2:172.21.15.194:6808/3847943561,v1:172.21.15.194:6809/3847943561]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2021-11-03T16:50:34.928 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:34 smithi026 conmon[32119]: audit 2021-11-03T16:50 2021-11-03T16:50:34.928 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:34 smithi026 conmon[32119]: :33.440919+0000 mon.smithi026 (mon.0) 390 : audit 2021-11-03T16:50:34.928 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:34 smithi026 conmon[32119]: [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2021-11-03T16:50:35.731 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:35 smithi194 conmon[35111]: audit 2021-11-03T16:50:34.439414+0000 2021-11-03T16:50:35.731 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:35 smithi194 conmon[35111]: mon.smithi026 (mon.0) 391 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2021-11-03T16:50:35.732 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:35 smithi194 conmon[35111]: cluster 2021-11-03T16:50:34.439511+0000 mon.smithi026 (mon.0) 392 : cluster [DBG] osdmap e30: 5 total, 4 up, 5 in 2021-11-03T16:50:35.732 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:35 smithi194 conmon[35111]: audit 2021-11-03T16:50:34.439899+0000 mon.smithi026 (mon.0) 393 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-11-03T16:50:35.732 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:35 smithi194 conmon[35111]: audit 2021-11-03T16:50:34.446934+0000 mon.smithi026 (mon.0) 394 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-11-03T16:50:35.732 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:35 smithi194 conmon[35111]: audit 2021-11-03T16:50:34.763712+0000 mgr.smithi026.cnrxli (mgr.14162) 156 : audit [DBG] from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:50:35.733 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:35 smithi194 conmon[35111]: audit 2021-11-03T16:50:34.764654+0000 mon.smithi026 (mon.0) 395 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-11-03T16:50:35.733 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:35 smithi194 conmon[35111]: cephadm 2021-11-03T16:50:34.766150+0000 mgr.smithi026.cnrxli (mgr.14162) 157 : cephadm [INF] Applying service osd.None on host smithi194... 2021-11-03T16:50:35.733 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:35 smithi194 conmon[35111]: audit 2021-11-03T16:50:34.766430+0000 mon.smithi026 (mon.0) 396 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-11-03T16:50:35.733 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:35 smithi194 conmon[35111]: audit 2021-11-03T16:50:34.767273+0000 mon.smithi026 (mon.0) 397 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:50:35.733 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:35 smithi194 conmon[35111]: cluster 2021-11-03T16:50:35.012371+0000 mgr.smithi026.cnrxli (mgr.14162) 158 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-11-03T16:50:35.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:35 smithi026 conmon[32119]: audit 2021-11-03T16:50:34.439414+0000 mon.smithi026 (mon.0) 391 : audit 2021-11-03T16:50:35.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:35 smithi026 conmon[32119]: [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2021-11-03T16:50:35.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:35 smithi026 conmon[32119]: cluster 2021-11-03T16:50:34.439511+0000 mon.smithi026 (mon.0) 392 : cluster [DBG] osdmap e30: 5 total, 4 up, 5 in 2021-11-03T16:50:35.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:35 smithi026 conmon[32119]: audit 2021-11-03T16: 2021-11-03T16:50:35.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:35 smithi026 conmon[32119]: 50:34.439899+0000 mon.smithi026 (mon.0) 393 : audit [DBG] 2021-11-03T16:50:35.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:35 smithi026 conmon[32119]: from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-11-03T16:50:35.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:35 smithi026 conmon[32119]: audit 2021-11-03T16:50 2021-11-03T16:50:35.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:35 smithi026 conmon[32119]: :34.446934+0000 mon.smithi026 (mon.0) 394 : audit 2021-11-03T16:50:35.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:35 smithi026 conmon[32119]: [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-11-03T16:50:35.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:35 smithi026 conmon[32119]: audit 2021-11-03T16:50:35.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:35 smithi026 conmon[32119]: 2021-11-03T16:50:34 2021-11-03T16:50:35.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:35 smithi026 conmon[32119]: .763712+0000 mgr.smithi026.cnrxli (mgr.14162) 156 : audit 2021-11-03T16:50:35.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:35 smithi026 conmon[32119]: [DBG] from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:50:35.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:35 smithi026 conmon[32119]: audit 2021-11-03T 2021-11-03T16:50:35.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:35 smithi026 conmon[32119]: 16:50:34.764654+0000 mon.smithi026 (mon.0) 395 2021-11-03T16:50:35.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:35 smithi026 conmon[32119]: : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-11-03T16:50:35.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:35 smithi026 conmon[32119]: cephadm 2021-11-03T16:50:35.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:35 smithi026 conmon[32119]: 2021-11-03T16:50:34.766150+0000 mgr.smithi026.cnrxli ( 2021-11-03T16:50:35.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:35 smithi026 conmon[32119]: mgr.14162) 157 : cephadm [INF] Applying service osd.None on host smithi194... 2021-11-03T16:50:35.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:35 smithi026 conmon[32119]: audit 2021-11-03T16:50: 2021-11-03T16:50:35.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:35 smithi026 conmon[32119]: 34.766430+0000 mon.smithi026 (mon.0) 396 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-11-03T16:50:35.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:35 smithi026 conmon[32119]: audit 2021-11-03 2021-11-03T16:50:35.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:35 smithi026 conmon[32119]: T16:50:34.767273+0000 mon.smithi026 (mon.0) 397 : audit [DBG] 2021-11-03T16:50:35.928 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:35 smithi026 conmon[32119]: from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:50:35.928 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:35 smithi026 conmon[32119]: cluster 2021-11-03T16: 2021-11-03T16:50:35.928 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:35 smithi026 conmon[32119]: 50:35.012371+0000 mgr.smithi026.cnrxli (mgr.14162) 158 : cluster 2021-11-03T16:50:35.928 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:35 smithi026 conmon[32119]: [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-11-03T16:50:36.613 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:36 smithi194 conmon[35111]: cluster 2021-11-03T16:50:33.664961+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2021-11-03T16:50:36.614 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:36 smithi194 conmon[35111]: cluster 2021-11-03T16:50:33.665166+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2021-11-03T16:50:36.614 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:36 smithi194 conmon[35111]: audit 2021-11-03T16:50:35.446692+0000 mon.smithi026 (mon.0) 398 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-11-03T16:50:36.614 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:36 smithi194 conmon[35111]: cluster 2021-11-03T16:50:35.450587+0000 mon.smithi026 (mon.0) 399 : cluster [INF] osd.4 [v2:172.21.15.194:6808/3847943561,v1:172.21.15.194:6809/3847943561] boot 2021-11-03T16:50:36.615 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:36 smithi194 conmon[35111]: cluster 2021-11-03T16:50:35.450646+0000 mon.smithi026 (mon.0) 400 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2021-11-03T16:50:36.615 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:36 smithi194 conmon[35111]: audit 2021-11-03T16:50:35.451023+0000 mon.smithi026 (mon.0) 401 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-11-03T16:50:36.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:36 smithi026 conmon[32119]: cluster 2021-11-03T16:50:33.664961+0000 osd.4 (osd.4) 1 2021-11-03T16:50:36.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:36 smithi026 conmon[32119]: : cluster [DBG] purged_snaps scrub starts 2021-11-03T16:50:36.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:36 smithi026 conmon[32119]: cluster 2021-11-03T16:50:33.665166+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2021-11-03T16:50:36.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:36 smithi026 conmon[32119]: audit 2021-11-03T16:50:35.446692 2021-11-03T16:50:36.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:36 smithi026 conmon[32119]: +0000 mon.smithi026 (mon.0) 398 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-11-03T16:50:36.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:36 smithi026 conmon[32119]: cluster 2021-11-03T16 2021-11-03T16:50:36.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:36 smithi026 conmon[32119]: :50:35.450587+0000 mon.smithi026 (mon.0) 399 : cluster [INF] osd.4 [v2:172.21.15.194:6808/3847943561,v1:172.21.15.194:6809/3847943561] boot 2021-11-03T16:50:36.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:36 smithi026 conmon[32119]: cluster 2021-11-03T16: 2021-11-03T16:50:36.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:36 smithi026 conmon[32119]: 50:35.450646+0000 mon.smithi026 (mon.0) 400 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2021-11-03T16:50:36.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:36 smithi026 conmon[32119]: audit 2021-11- 2021-11-03T16:50:36.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:36 smithi026 conmon[32119]: 03T16:50:35.451023+0000 mon.smithi026 (mon.0) 401 : audit [DBG] 2021-11-03T16:50:36.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:36 smithi026 conmon[32119]: from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-11-03T16:50:37.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:37 smithi194 conmon[35111]: cluster 2021-11-03T16:50:36.455008+0000 mon.smithi026 (mon.0) 402 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2021-11-03T16:50:37.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:37 smithi194 conmon[35111]: cephadm 2021-11-03T16 2021-11-03T16:50:37.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:37 smithi194 conmon[35111]: :50:36.458189+0000 mgr.smithi026.cnrxli (mgr.14162) 159 : cephadm [INF] Detected new or changed devices on smithi194 2021-11-03T16:50:37.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:37 smithi194 conmon[35111]: audit 2021-11-03T16:50:36.462736+0000 mon.smithi026 (mon.0) 403 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:37.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:37 smithi194 conmon[35111]: audit 2021-11-03T16:50:36.730199+0000 mon.smithi026 (mon.0) 404 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:37.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:37 smithi194 conmon[35111]: audit 2021-11-03T16:50:36.734905+0000 mon.smithi026 (mon.0) 405 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:50:37.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:37 smithi194 conmon[35111]: audit 2021-11-03T16:50:36.739859+0000 mon.smithi026 (mon.0) 406 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:37.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:37 smithi194 conmon[35111]: cluster 2021-11-03T16:50:37.012905+0000 mgr.smithi026.cnrxli (mgr.14162) 160 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-11-03T16:50:37.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:37 smithi026 conmon[32119]: cluster 2021-11-03T16:50:36.455008+0000 2021-11-03T16:50:37.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:37 smithi026 conmon[32119]: mon.smithi026 (mon.0) 402 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2021-11-03T16:50:37.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:37 smithi026 conmon[32119]: cephadm 2021-11-03T16:50:36.458189+0000 mgr.smithi026.cnrxli (mgr.14162) 159 : cephadm [INF] 2021-11-03T16:50:37.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:37 smithi026 conmon[32119]: Detected new or changed devices on smithi194 2021-11-03T16:50:37.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:37 smithi026 conmon[32119]: audit 2021-11-03T16:50:36.462736+0000 mon.smithi026 2021-11-03T16:50:37.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:37 smithi026 conmon[32119]: (mon.0) 403 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:37.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:37 smithi026 conmon[32119]: audit 2021- 2021-11-03T16:50:37.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:37 smithi026 conmon[32119]: 11-03T16:50:36.730199+0000 mon.smithi026 (mon.0) 404 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:37.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:37 smithi026 conmon[32119]: audit 2021-11-03T16:50 2021-11-03T16:50:37.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:37 smithi026 conmon[32119]: :36.734905+0000 mon.smithi026 (mon.0) 405 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:50:37.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:37 smithi026 conmon[32119]: audit 2021-11-03T16 2021-11-03T16:50:37.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:37 smithi026 conmon[32119]: :50:36.739859+0000 mon.smithi026 (mon.0) 406 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:37.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:37 smithi026 conmon[32119]: 2021-11-03T16:50:37.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:37 smithi026 conmon[32119]: cluster 2021-11 2021-11-03T16:50:37.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:37 smithi026 conmon[32119]: -03T16:50:37.012905+0000 mgr.smithi026.cnrxli (mgr.14162) 160 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-11-03T16:50:38.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:38 smithi194 conmon[35111]: audit 2021-11-03T16:50:37.525620+0000 mon.smithi194 (mon.1) 10 : audit [INF] 2021-11-03T16:50:38.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:38 smithi194 conmon[35111]: from='client.? 172.21.15.194:0/2430116465' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2fd86a44-51f4-46fb-b0d9-bac56ca01747"}]: dispatch 2021-11-03T16:50:38.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:38 smithi194 conmon[35111]: audit 2021-11-03T16:50:37.525964+0000 mon.smithi026 (mon.0) 407 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2fd86a44-51f4-46fb-b0d9-bac56ca01747"}]: dispatch 2021-11-03T16:50:38.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:38 smithi194 conmon[35111]: audit 2021-11-03T16:50:37.530380+0000 mon.smithi026 (mon 2021-11-03T16:50:38.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:38 smithi194 conmon[35111]: .0) 408 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2fd86a44-51f4-46fb-b0d9-bac56ca01747"}]': finished 2021-11-03T16:50:38.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:38 smithi194 conmon[35111]: cluster 2021-11-03T16:50:37.530455+0000 mon.smithi026 (mon.0) 409 : cluster [DBG] osdmap e33: 6 total, 5 up, 6 in 2021-11-03T16:50:38.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:38 smithi194 conmon[35111]: audit 2021-11-03T16:50:37.530622+0000 mon.smithi026 (mon.0) 410 : audit 2021-11-03T16:50:38.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:38 smithi194 conmon[35111]: [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-11-03T16:50:38.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:38 smithi194 conmon[35111]: audit 2021-11 2021-11-03T16:50:38.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:38 smithi194 conmon[35111]: -03T16:50:38.039932+0000 mon.smithi194 (mon.1) 11 : audit [DBG] from='client.? 172.21.15.194:0/2588360959' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-11-03T16:50:38.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:38 smithi026 conmon[32119]: audit 2021-11-03T16:50:37.525620 2021-11-03T16:50:38.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:38 smithi026 conmon[32119]: +0000 mon.smithi194 (mon.1) 10 : audit [INF] from='client.? 172.21.15.194:0/2430116465' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2fd86a44-51f4-46fb-b0d9-bac56ca01747"}]: dispatch 2021-11-03T16:50:38.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:38 smithi026 conmon[32119]: audit 2021-11-03T16:50:37.525964+0000 mon.smithi026 (mon.0) 407 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2fd86a44-51f4-46fb-b0d9-bac56ca01747"}]: dispatch 2021-11-03T16:50:38.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:38 smithi026 conmon[32119]: audit 2021-11-03T16:50:37.530380+0000 mon.smithi026 (mon.0) 408 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2fd86a44-51f4-46fb-b0d9-bac56ca01747"}]': finished 2021-11-03T16:50:38.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:38 smithi026 conmon[32119]: cluster 2021-11-03T16:50:37.530455 2021-11-03T16:50:38.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:38 smithi026 conmon[32119]: +0000 mon.smithi026 (mon.0) 409 : cluster [DBG] osdmap e33: 6 total, 5 up, 6 in 2021-11-03T16:50:38.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:38 smithi026 conmon[32119]: audit 2021-11-03T16:50:37. 2021-11-03T16:50:38.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:38 smithi026 conmon[32119]: 530622+0000 mon.smithi026 (mon.0) 410 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-11-03T16:50:38.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:38 smithi026 conmon[32119]: audit 2021-11-03T16:50:38 2021-11-03T16:50:38.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:38 smithi026 conmon[32119]: .039932+0000 mon.smithi194 (mon.1) 11 : audit [DBG] from='client.? 172.21.15.194:0/2588360959' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-11-03T16:50:39.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:39 smithi194 conmon[35111]: cluster 2021-11-03T16:50:39.013309+0000 mgr.smithi026.cnrxli (mgr.14162 2021-11-03T16:50:39.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:39 smithi194 conmon[35111]: ) 161 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-11-03T16:50:39.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:39 smithi026 conmon[32119]: cluster 2021-11-03T16:50:39.013309+0000 mgr.smithi026.cnrxli (mgr.14162) 161 2021-11-03T16:50:39.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:39 smithi026 conmon[32119]: : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-11-03T16:50:42.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:42 smithi194 conmon[35111]: cluster 2021-11-03T16:50:41.013790+0000 mgr.smithi026.cnrxli (mgr.14162) 162 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-11-03T16:50:42.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:42 smithi026 conmon[32119]: cluster 2021-11-03T16:50:41.013790+0000 mgr.smithi026.cnrxli (mgr.14162) 162 : 2021-11-03T16:50:42.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:42 smithi026 conmon[32119]: cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-11-03T16:50:44.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:44 smithi194 conmon[35111]: cluster 2021-11-03T16:50:43.014293+0000 mgr.smithi026.cnrxli (mgr.14162) 163 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-11-03T16:50:44.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:44 smithi026 conmon[32119]: cluster 2021-11-03T16:50:43.014293+0000 mgr.smithi026.cnrxli (mgr.14162) 163 : cluster 2021-11-03T16:50:44.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:44 smithi026 conmon[32119]: [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-11-03T16:50:45.375 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:45 smithi194 conmon[35111]: audit 2021-11-03T16:50:44.558520+0000 mon.smithi026 (mon.0) 411 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-11-03T16:50:45.376 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:45 smithi194 conmon[35111]: audit 2021-11-03T16:50:44.559464+0000 mon.smithi026 (mon.0) 412 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:50:45.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:45 smithi026 conmon[32119]: audit 2021-11-03T16:50:44.558520+0000 mon.smithi026 (mon.0) 411 : 2021-11-03T16:50:45.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:45 smithi026 conmon[32119]: audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-11-03T16:50:45.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:45 smithi026 conmon[32119]: audit 2021-11-03T16:50:44.559464+0000 mon.smithi026 (mon.0) 412 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:50:46.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:46 smithi194 conmon[35111]: cephadm 2021-11-03T16:50:44.560235+0000 mgr.smithi026.cnrxli (mgr.14162) 164 : 2021-11-03T16:50:46.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:46 smithi194 conmon[35111]: cephadm [INF] Deploying daemon osd.5 on smithi194 2021-11-03T16:50:46.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:46 smithi194 conmon[35111]: cluster 2021-11-03T16:50:45.014755+0000 mgr.smithi026.cnrxli (mgr.14162) 165 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-11-03T16:50:46.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:46 smithi026 conmon[32119]: cephadm 2021-11-03T16:50:44.560235+0000 mgr.smithi026.cnrxli (mgr.14162) 164 2021-11-03T16:50:46.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:46 smithi026 conmon[32119]: : cephadm [INF] Deploying daemon osd.5 on smithi194 2021-11-03T16:50:46.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:46 smithi026 conmon[32119]: cluster 2021-11-03T16:50:45.014755+0000 mgr.smithi026.cnrxli (mgr.14162) 165 : cluster [DBG] 2021-11-03T16:50:46.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:46 smithi026 conmon[32119]: pgmap v130: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-11-03T16:50:47.848 INFO:teuthology.orchestra.run.smithi194.stdout:Created osd(s) 5 on host 'smithi194' 2021-11-03T16:50:47.849 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:47.851+0000 7fefcf7fe700 1 -- 172.21.15.194:0/2686370468 <== mgr.14162 v2:172.21.15.26:6800/3029163595 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fefd80fefb0 con 0x7fefc405c2b0 2021-11-03T16:50:47.849 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:47.854+0000 7fefdd64c700 1 -- 172.21.15.194:0/2686370468 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fefc405c2b0 msgr2=0x7fefc405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:50:47.850 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:47.854+0000 7fefdd64c700 1 --2- 172.21.15.194:0/2686370468 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fefc405c2b0 0x7fefc405e770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fefc8003380 tx=0x7fefc8004d10).stop 2021-11-03T16:50:47.850 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:47.854+0000 7fefdd64c700 1 -- 172.21.15.194:0/2686370468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefd80f7980 msgr2=0x7fefd81075c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:50:47.850 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:47.854+0000 7fefdd64c700 1 --2- 172.21.15.194:0/2686370468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefd80f7980 0x7fefd81075c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fefc00026d0 tx=0x7fefc0009de0).stop 2021-11-03T16:50:47.850 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:47.854+0000 7fefdd64c700 1 -- 172.21.15.194:0/2686370468 shutdown_connections 2021-11-03T16:50:47.851 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:47.854+0000 7fefdd64c700 1 --2- 172.21.15.194:0/2686370468 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fefc405c2b0 0x7fefc405e770 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:50:47.851 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:47.854+0000 7fefdd64c700 1 --2- 172.21.15.194:0/2686370468 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefd80f66e0 0x7fefd81070d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:50:47.851 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:47.854+0000 7fefdd64c700 1 --2- 172.21.15.194:0/2686370468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefd80f7980 0x7fefd81075c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:50:47.851 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:47.854+0000 7fefdd64c700 1 -- 172.21.15.194:0/2686370468 >> 172.21.15.194:0/2686370468 conn(0x7fefd80f1e40 msgr2=0x7fefd80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:50:47.852 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:47.854+0000 7fefdd64c700 1 -- 172.21.15.194:0/2686370468 shutdown_connections 2021-11-03T16:50:47.852 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:47.854+0000 7fefdd64c700 1 -- 172.21.15.194:0/2686370468 wait complete. 2021-11-03T16:50:48.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:48 smithi194 conmon[35111]: cluster 2021-11-03T16:50:47.015155+0000 mgr.smithi026.cnrxli ( 2021-11-03T16:50:48.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:48 smithi194 conmon[35111]: mgr.14162) 166 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-11-03T16:50:48.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:48 smithi194 conmon[35111]: audit 2021-11-03T16:50:47.840358+0000 mon.smithi026 (mon.0) 413 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:50:48.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:48 smithi194 conmon[35111]: audit 2021-11-03T16:50:47.844790+0000 mon.smithi026 (mon.0) 414 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:48.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:48 smithi194 conmon[35111]: audit 2021-11-03T16:50:47.851746+0000 mon.smithi026 (mon.0) 415 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:48.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:48 smithi026 conmon[32119]: cluster 2021-11-03T16:50:47.015155+0000 2021-11-03T16:50:48.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:48 smithi026 conmon[32119]: mgr.smithi026.cnrxli (mgr.14162) 166 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-11-03T16:50:48.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:48 smithi026 conmon[32119]: audit 2021-11-03T16:50:47.840358+0000 mon.smithi026 (mon.0) 413 : 2021-11-03T16:50:48.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:48 smithi026 conmon[32119]: audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:50:48.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:48 smithi026 conmon[32119]: audit 2021-11-03T16:50:47.844790+0000 2021-11-03T16:50:48.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:48 smithi026 conmon[32119]: mon.smithi026 (mon.0) 414 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:48.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:48 smithi026 conmon[32119]: audit 2021-11-03T 2021-11-03T16:50:48.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:48 smithi026 conmon[32119]: 16:50:47.851746+0000 mon.smithi026 (mon 2021-11-03T16:50:48.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:48 smithi026 conmon[32119]: .0) 415 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:48.459 DEBUG:teuthology.orchestra.run.smithi194:osd.5> sudo journalctl -f -n 0 -u ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c@osd.5.service 2021-11-03T16:50:48.461 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2021-11-03T16:50:48.462 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph osd stat -f json 2021-11-03T16:50:48.490 INFO:journalctl@ceph.osd.5.smithi194.stdout:-- Logs begin at Wed 2021-11-03 16:35:29 UTC. -- 2021-11-03T16:50:50.336 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:50 smithi026 conmon[32119]: cluster 2021-11-03T16:50:49.015584+0000 mgr.smithi026.cnrxli (mgr.14162) 167 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-11-03T16:50:50.478 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:50 smithi194 conmon[35111]: cluster 2021-11-03T16:50:49.015584+0000 mgr.smithi026.cnrxli (mgr.14162) 167 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-11-03T16:50:50.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.530+0000 7f4d2cb71700 1 -- 172.21.15.26:0/987242481 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d280f6860 msgr2=0x7f4d280f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:50:50.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.530+0000 7f4d2cb71700 1 --2- 172.21.15.26:0/987242481 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d280f6860 0x7f4d280f6cc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f4d1c004660 tx=0x7f4d1c009b30).stop 2021-11-03T16:50:50.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.530+0000 7f4d2cb71700 1 -- 172.21.15.26:0/987242481 shutdown_connections 2021-11-03T16:50:50.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.530+0000 7f4d2cb71700 1 --2- 172.21.15.26:0/987242481 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d280f6860 0x7f4d280f6cc0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:50:50.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.530+0000 7f4d2cb71700 1 --2- 172.21.15.26:0/987242481 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d280f55c0 0x7f4d280f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:50:50.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.530+0000 7f4d2cb71700 1 -- 172.21.15.26:0/987242481 >> 172.21.15.26:0/987242481 conn(0x7f4d280f0d40 msgr2=0x7f4d280f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:50:50.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.530+0000 7f4d2cb71700 1 -- 172.21.15.26:0/987242481 shutdown_connections 2021-11-03T16:50:50.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.530+0000 7f4d2cb71700 1 -- 172.21.15.26:0/987242481 wait complete. 2021-11-03T16:50:50.531 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.530+0000 7f4d2cb71700 1 Processor -- start 2021-11-03T16:50:50.531 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.531+0000 7f4d2cb71700 1 -- start start 2021-11-03T16:50:50.531 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.531+0000 7f4d2cb71700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d280f55c0 0x7f4d28109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:50:50.531 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.531+0000 7f4d2cb71700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d280f6860 0x7f4d2810c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:50:50.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.531+0000 7f4d2cb71700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d280603c0 con 0x7f4d280f55c0 2021-11-03T16:50:50.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.531+0000 7f4d2cb71700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d28060500 con 0x7f4d280f6860 2021-11-03T16:50:50.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.531+0000 7f4d2659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d280f55c0 0x7f4d28109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:50:50.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.531+0000 7f4d2659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d280f55c0 0x7f4d28109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49748/0 (socket says 172.21.15.26:49748) 2021-11-03T16:50:50.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.531+0000 7f4d2659c700 1 -- 172.21.15.26:0/1276614124 learned_addr learned my addr 172.21.15.26:0/1276614124 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:50:50.533 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.531+0000 7f4d2659c700 1 -- 172.21.15.26:0/1276614124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d280f6860 msgr2=0x7f4d2810c170 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-03T16:50:50.533 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.531+0000 7f4d2659c700 1 --2- 172.21.15.26:0/1276614124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d280f6860 0x7f4d2810c170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T16:50:50.533 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.531+0000 7f4d2659c700 1 -- 172.21.15.26:0/1276614124 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d1c005040 con 0x7f4d280f55c0 2021-11-03T16:50:50.533 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.531+0000 7f4d2659c700 1 --2- 172.21.15.26:0/1276614124 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d280f55c0 0x7f4d28109c70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f4d1800c530 tx=0x7f4d18007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:50:50.533 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.531+0000 7f4d16ffd700 1 -- 172.21.15.26:0/1276614124 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d1800f650 con 0x7f4d280f55c0 2021-11-03T16:50:50.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.531+0000 7f4d16ffd700 1 -- 172.21.15.26:0/1276614124 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f4d1800fc40 con 0x7f4d280f55c0 2021-11-03T16:50:50.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.531+0000 7f4d2cb71700 1 -- 172.21.15.26:0/1276614124 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d2810c720 con 0x7f4d280f55c0 2021-11-03T16:50:50.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.531+0000 7f4d16ffd700 1 -- 172.21.15.26:0/1276614124 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d18012c90 con 0x7f4d280f55c0 2021-11-03T16:50:50.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.532+0000 7f4d2cb71700 1 -- 172.21.15.26:0/1276614124 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d2810ccb0 con 0x7f4d280f55c0 2021-11-03T16:50:50.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.532+0000 7f4d2cb71700 1 -- 172.21.15.26:0/1276614124 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d280f49b0 con 0x7f4d280f55c0 2021-11-03T16:50:50.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.533+0000 7f4d16ffd700 1 -- 172.21.15.26:0/1276614124 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f4d18019030 con 0x7f4d280f55c0 2021-11-03T16:50:50.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.533+0000 7f4d16ffd700 1 --2- 172.21.15.26:0/1276614124 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f4d1005c2b0 0x7f4d1005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:50:50.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.533+0000 7f4d16ffd700 1 -- 172.21.15.26:0/1276614124 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4202+0+0 (secure 0 0 0) 0x7f4d180756b0 con 0x7f4d280f55c0 2021-11-03T16:50:50.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.533+0000 7f4d25d9b700 1 --2- 172.21.15.26:0/1276614124 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f4d1005c2b0 0x7f4d1005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:50:50.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.534+0000 7f4d25d9b700 1 --2- 172.21.15.26:0/1276614124 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f4d1005c2b0 0x7f4d1005e770 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f4d1c004e30 tx=0x7f4d1c009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:50:50.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.537+0000 7f4d16ffd700 1 -- 172.21.15.26:0/1276614124 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f4d18048860 con 0x7f4d280f55c0 2021-11-03T16:50:50.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.694+0000 7f4d2cb71700 1 -- 172.21.15.26:0/1276614124 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f4d280fdf00 con 0x7f4d280f55c0 2021-11-03T16:50:50.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.694+0000 7f4d16ffd700 1 -- 172.21.15.26:0/1276614124 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v33) v1 ==== 74+0+130 (secure 0 0 0) 0x7f4d18017070 con 0x7f4d280f55c0 2021-11-03T16:50:50.692 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:50:50.694 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.695+0000 7f4d2cb71700 1 -- 172.21.15.26:0/1276614124 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f4d1005c2b0 msgr2=0x7f4d1005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:50:50.694 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.695+0000 7f4d2cb71700 1 --2- 172.21.15.26:0/1276614124 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f4d1005c2b0 0x7f4d1005e770 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f4d1c004e30 tx=0x7f4d1c009b30).stop 2021-11-03T16:50:50.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.695+0000 7f4d2cb71700 1 -- 172.21.15.26:0/1276614124 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d280f55c0 msgr2=0x7f4d28109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:50:50.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.695+0000 7f4d2cb71700 1 --2- 172.21.15.26:0/1276614124 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d280f55c0 0x7f4d28109c70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f4d1800c530 tx=0x7f4d18007e10).stop 2021-11-03T16:50:50.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.695+0000 7f4d2cb71700 1 -- 172.21.15.26:0/1276614124 shutdown_connections 2021-11-03T16:50:50.696 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.695+0000 7f4d2cb71700 1 --2- 172.21.15.26:0/1276614124 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f4d1005c2b0 0x7f4d1005e770 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:50:50.696 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.695+0000 7f4d2cb71700 1 --2- 172.21.15.26:0/1276614124 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d280f55c0 0x7f4d28109c70 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:50:50.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.695+0000 7f4d2cb71700 1 --2- 172.21.15.26:0/1276614124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d280f6860 0x7f4d2810c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T16:50:50.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.695+0000 7f4d2cb71700 1 -- 172.21.15.26:0/1276614124 >> 172.21.15.26:0/1276614124 conn(0x7f4d280f0d40 msgr2=0x7f4d280fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:50:50.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.696+0000 7f4d2cb71700 1 -- 172.21.15.26:0/1276614124 shutdown_connections 2021-11-03T16:50:50.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:50.696+0000 7f4d2cb71700 1 -- 172.21.15.26:0/1276614124 wait complete. 2021-11-03T16:50:51.365 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:51 smithi026 conmon[32119]: audit 2021-11-03T16:50:50.104663+0000 mon.smithi026 (mon.0) 2021-11-03T16:50:51.366 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:51 smithi026 conmon[32119]: 416 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:51.366 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:51 smithi026 conmon[32119]: audit 2021-11-03T16:50:50.695852+0000 mon.smithi026 (mon.0) 417 : audit [DBG] from='client.? 172.21.15.26:0/1276614124' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2021-11-03T16:50:51.367 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":33,"num_osds":6,"num_up_osds":5,"osd_up_since":1635958235,"num_in_osds":6,"osd_in_since":1635958237,"num_remapped_pgs":0} 2021-11-03T16:50:51.427 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:51 smithi194 conmon[35111]: audit 2021-11-03T16:50:50.104663+0000 mon.smithi026 (mon.0) 416 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:51.427 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:51 smithi194 conmon[35111]: audit 2021-11-03T16:50:50.695852+0000 mon.smithi026 (mon.0) 417 : audit [DBG] from='client.? 172.21.15.26:0/1276614124' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2021-11-03T16:50:52.107 INFO:journalctl@ceph.osd.5.smithi194.stdout:Nov 03 16:50:51 smithi194 conmon[51246]: debug 2021-11-03T16:50:51.825+0000 7fa2486b4080 -1 osd.5 0 log_to_monitors {default=true} 2021-11-03T16:50:52.369 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph osd stat -f json 2021-11-03T16:50:52.400 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:52 smithi026 conmon[32119]: cluster 2021-11-03T16:50:51.015899+0000 mgr.smithi026.cnrxli (mgr.14162) 168 : cluster [DBG] 2021-11-03T16:50:52.400 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:52 smithi026 conmon[32119]: pgmap v133: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-11-03T16:50:52.401 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:52 smithi026 conmon[32119]: audit 2021-11-03T16:50:51.829264+0000 mon.smithi194 (mon.1) 12 : audit [INF] from='osd.5 [v2:172.21.15.194:6816/89262300,v1:172.21.15.194:6817/89262300]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-11-03T16:50:52.401 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:52 smithi026 conmon[32119]: audit 2021-11-03T16:50:51.829885+0000 mon.smithi026 (mon.0) 418 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-11-03T16:50:52.492 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:52 smithi194 conmon[35111]: cluster 2021-11-03T16:50:51.015899+0000 mgr.smithi026.cnrxli (mgr.14162) 168 2021-11-03T16:50:52.493 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:52 smithi194 conmon[35111]: : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-11-03T16:50:52.493 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:52 smithi194 conmon[35111]: audit 2021-11-03T16:50:51.829264+0000 mon.smithi194 (mon.1) 12 : audit [INF] from='osd.5 [v2:172.21.15.194:6816/89262300,v1:172.21.15.194:6817/89262300]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-11-03T16:50:52.493 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:52 smithi194 conmon[35111]: audit 2021-11-03T16:50:51.829885+0000 mon.smithi026 ( 2021-11-03T16:50:52.493 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:52 smithi194 conmon[35111]: mon.0) 418 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-11-03T16:50:52.494 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:52 smithi194 conmon[35111]: 2021-11-03T16:50:53.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:53 smithi026 conmon[32119]: audit 2021-11-03T16:50:52.110678+0000 mon.smithi026 (mon.0) 419 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-11-03T16:50:53.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:53 smithi026 conmon[32119]: cluster 2021-11-03T16:50:52.110765+0000 mon.smithi026 (mon.0) 420 : cluster [DBG] osdmap e34: 6 total, 5 up, 6 in 2021-11-03T16:50:53.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:53 smithi026 conmon[32119]: audit 2021-11-03T16:50:52.111167+0000 mon.smithi026 (mon.0) 421 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-11-03T16:50:53.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:53 smithi026 conmon[32119]: audit 2021-11-03T16:50:52.111445+0000 mon.smithi194 (mon.1) 13 : audit [INF] from='osd.5 [v2:172.21.15.194:6816/89262300,v1:172.21.15.194:6817/89262300]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2021-11-03T16:50:53.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:53 smithi026 conmon[32119]: audit 2021-11-03T16:50:52.111702+0000 mon.smithi026 (mon.0) 422 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2021-11-03T16:50:53.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:53 smithi026 conmon[32119]: audit 2021-11-03T16:50:53.110941+0000 mon.smithi026 (mon.0) 423 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2021-11-03T16:50:53.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:53 smithi026 conmon[32119]: cluster 2021-11-03T16:50:53.111032+0000 mon.smithi026 (mon.0) 424 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2021-11-03T16:50:53.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:53 smithi026 conmon[32119]: audit 2021-11-03T16:50:53.111156 2021-11-03T16:50:53.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:53 smithi026 conmon[32119]: +0000 mon.smithi026 (mon.0) 425 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-11-03T16:50:53.471 INFO:journalctl@ceph.osd.5.smithi194.stdout:Nov 03 16:50:53 smithi194 conmon[51246]: debug 2021-11-03T16:50:53.114+0000 7fa23ec25700 -1 osd.5 0 waiting for initial osdmap 2021-11-03T16:50:53.471 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:53 smithi194 conmon[35111]: audit 2021-11-03T16:50:52.110678+0000 2021-11-03T16:50:53.472 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:53 smithi194 conmon[35111]: mon.smithi026 (mon.0) 419 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-11-03T16:50:53.472 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:53 smithi194 conmon[35111]: cluster 2021-11-03T16:50:52.110765+0000 mon.smithi026 (mon.0) 420 : cluster [DBG] osdmap e34: 6 total, 5 up, 6 in 2021-11-03T16:50:53.472 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:53 smithi194 conmon[35111]: audit 2021-11- 2021-11-03T16:50:53.472 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:53 smithi194 conmon[35111]: 03T16:50:52.111167+0000 mon.smithi026 (mon.0) 421 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-11-03T16:50:53.473 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:53 smithi194 conmon[35111]: audit 2021-11 2021-11-03T16:50:53.473 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:53 smithi194 conmon[35111]: -03T16:50:52.111445 2021-11-03T16:50:53.473 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:53 smithi194 conmon[35111]: +0000 mon.smithi194 (mon.1) 13 2021-11-03T16:50:53.473 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:53 smithi194 conmon[35111]: : audit [INF] from='osd.5 [v2:172.21.15.194:6816/89262300,v1:172.21.15.194:6817/89262300]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2021-11-03T16:50:53.473 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:53 smithi194 conmon[35111]: audit 2021-11-03T16:50:53.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:53 smithi194 conmon[35111]: 2021-11 2021-11-03T16:50:53.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:53 smithi194 conmon[35111]: -03T16:50:52. 2021-11-03T16:50:53.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:53 smithi194 conmon[35111]: 111702+0000 mon.smithi026 (mon.0 2021-11-03T16:50:53.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:53 smithi194 conmon[35111]: ) 422 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2021-11-03T16:50:53.475 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:53 smithi194 conmon[35111]: audit 2021 2021-11-03T16:50:53.475 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:53 smithi194 conmon[35111]: -11-03T16:50:53 2021-11-03T16:50:53.475 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:53 smithi194 conmon[35111]: .110941+0000 mon.smithi026 (mon.0 2021-11-03T16:50:53.476 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:53 smithi194 conmon[35111]: ) 423 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2021-11-03T16:50:53.476 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:53 smithi194 conmon[35111]: cluster 2021 2021-11-03T16:50:53.476 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:53 smithi194 conmon[35111]: -11-03T16:50:53. 2021-11-03T16:50:53.476 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:53 smithi194 conmon[35111]: 111032+0000 mon.smithi026 (mon.0 2021-11-03T16:50:53.476 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:53 smithi194 conmon[35111]: ) 424 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2021-11-03T16:50:53.477 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:53 smithi194 conmon[35111]: audit 2021 2021-11-03T16:50:53.477 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:53 smithi194 conmon[35111]: -11-03T16:50:53 2021-11-03T16:50:53.477 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:53 smithi194 conmon[35111]: .111156+0000 mon.smithi026 (mon.0 2021-11-03T16:50:53.477 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:53 smithi194 conmon[35111]: ) 425 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-11-03T16:50:54.323 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.322+0000 7f742c39b700 1 -- 172.21.15.26:0/2131170317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74240f55c0 msgr2=0x7f74240f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:50:54.323 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.322+0000 7f742c39b700 1 --2- 172.21.15.26:0/2131170317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74240f55c0 0x7f74240f59e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f741c0099e0 tx=0x7f741c004d10).stop 2021-11-03T16:50:54.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.322+0000 7f742c39b700 1 -- 172.21.15.26:0/2131170317 shutdown_connections 2021-11-03T16:50:54.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.322+0000 7f742c39b700 1 --2- 172.21.15.26:0/2131170317 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74240f6860 0x7f74240f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:50:54.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.322+0000 7f742c39b700 1 --2- 172.21.15.26:0/2131170317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74240f55c0 0x7f74240f59e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:50:54.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.322+0000 7f742c39b700 1 -- 172.21.15.26:0/2131170317 >> 172.21.15.26:0/2131170317 conn(0x7f74240f0d40 msgr2=0x7f74240f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:50:54.325 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.322+0000 7f742c39b700 1 -- 172.21.15.26:0/2131170317 shutdown_connections 2021-11-03T16:50:54.325 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.322+0000 7f742c39b700 1 -- 172.21.15.26:0/2131170317 wait complete. 2021-11-03T16:50:54.325 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.322+0000 7f742c39b700 1 Processor -- start 2021-11-03T16:50:54.325 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.322+0000 7f742c39b700 1 -- start start 2021-11-03T16:50:54.325 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.322+0000 7f742c39b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74240f55c0 0x7f7424105f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:50:54.326 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.322+0000 7f742c39b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74240f6860 0x7f7424106450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:50:54.326 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.322+0000 7f742c39b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7424106a00 con 0x7f74240f6860 2021-11-03T16:50:54.326 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.323+0000 7f742c39b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7424106b40 con 0x7f74240f55c0 2021-11-03T16:50:54.326 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.323+0000 7f7429936700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74240f6860 0x7f7424106450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:50:54.327 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.323+0000 7f7429936700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74240f6860 0x7f7424106450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49768/0 (socket says 172.21.15.26:49768) 2021-11-03T16:50:54.327 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.323+0000 7f7429936700 1 -- 172.21.15.26:0/3260020749 learned_addr learned my addr 172.21.15.26:0/3260020749 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:50:54.327 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.323+0000 7f742a137700 1 --2- 172.21.15.26:0/3260020749 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74240f55c0 0x7f7424105f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:50:54.327 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.323+0000 7f7429936700 1 -- 172.21.15.26:0/3260020749 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74240f55c0 msgr2=0x7f7424105f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:50:54.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.323+0000 7f7429936700 1 --2- 172.21.15.26:0/3260020749 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74240f55c0 0x7f7424105f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:50:54.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.323+0000 7f7429936700 1 -- 172.21.15.26:0/3260020749 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f741c009640 con 0x7f74240f6860 2021-11-03T16:50:54.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.323+0000 7f742a137700 1 --2- 172.21.15.26:0/3260020749 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74240f55c0 0x7f7424105f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T16:50:54.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.323+0000 7f7429936700 1 --2- 172.21.15.26:0/3260020749 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74240f6860 0x7f7424106450 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f7418002700 tx=0x7f7418009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:50:54.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.323+0000 7f7422ffd700 1 -- 172.21.15.26:0/3260020749 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7418009320 con 0x7f74240f6860 2021-11-03T16:50:54.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.323+0000 7f742c39b700 1 -- 172.21.15.26:0/3260020749 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74241074e0 con 0x7f74240f6860 2021-11-03T16:50:54.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.323+0000 7f7422ffd700 1 -- 172.21.15.26:0/3260020749 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f741800f040 con 0x7f74240f6860 2021-11-03T16:50:54.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.323+0000 7f7422ffd700 1 -- 172.21.15.26:0/3260020749 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7418014740 con 0x7f74240f6860 2021-11-03T16:50:54.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.323+0000 7f742c39b700 1 -- 172.21.15.26:0/3260020749 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7424107a20 con 0x7f74240f6860 2021-11-03T16:50:54.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.324+0000 7f742c39b700 1 -- 172.21.15.26:0/3260020749 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7424045ad0 con 0x7f74240f6860 2021-11-03T16:50:54.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.324+0000 7f7422ffd700 1 -- 172.21.15.26:0/3260020749 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f74180077b0 con 0x7f74240f6860 2021-11-03T16:50:54.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.325+0000 7f7422ffd700 1 --2- 172.21.15.26:0/3260020749 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f740c05c2b0 0x7f740c05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:50:54.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.325+0000 7f7422ffd700 1 -- 172.21.15.26:0/3260020749 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f7418075f40 con 0x7f74240f6860 2021-11-03T16:50:54.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.325+0000 7f742a137700 1 --2- 172.21.15.26:0/3260020749 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f740c05c2b0 0x7f740c05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:50:54.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.325+0000 7f742a137700 1 --2- 172.21.15.26:0/3260020749 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f740c05c2b0 0x7f740c05e770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f741c00b3b0 tx=0x7f741c004d10).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:50:54.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.329+0000 7f7422ffd700 1 -- 172.21.15.26:0/3260020749 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f7418048f60 con 0x7f74240f6860 2021-11-03T16:50:54.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:54 smithi026 conmon[32119]: cluster 2021-11-03T16:50:53.016221 2021-11-03T16:50:54.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:54 smithi026 conmon[32119]: +0000 mgr.smithi026.cnrxli (mgr.14162) 169 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-11-03T16:50:54.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:54 smithi026 conmon[32119]: audit 2021-11-03T16:50:53.115148+0000 mon.smithi026 (mon.0) 426 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-11-03T16:50:54.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:54 smithi026 conmon[32119]: cephadm 2021-11-03T16:50:53.267972+0000 mgr.smithi026.cnrxli (mgr.14162) 170 : cephadm [INF] Detected new or changed devices on smithi194 2021-11-03T16:50:54.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:54 smithi026 conmon[32119]: audit 2021-11-03T16:50:53.272523+0000 mon.smithi026 (mon.0) 427 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:54.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:54 smithi026 conmon[32119]: audit 2021-11-03T16:50:53.276483+0000 mon.smithi026 (mon.0) 428 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:54.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:54 smithi026 conmon[32119]: audit 2021-11-03T16:50:53.279583+0000 mon.smithi026 (mon.0) 429 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:50:54.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:54 smithi026 conmon[32119]: audit 2021-11-03T16:50:54.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:54 smithi026 conmon[32119]: 2021-11-03T16:50:53.283883+0000 mon.smithi026 (mon 2021-11-03T16:50:54.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:54 smithi026 conmon[32119]: .0) 430 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:54.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:54 smithi026 conmon[32119]: audit 2021-11-03T 2021-11-03T16:50:54.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:54 smithi026 conmon[32119]: 16:50:54.115341+0000 mon.smithi026 (mon.0) 431 2021-11-03T16:50:54.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:54 smithi026 conmon[32119]: : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-11-03T16:50:54.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.486+0000 7f742c39b700 1 -- 172.21.15.26:0/3260020749 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f7424027a00 con 0x7f74240f6860 2021-11-03T16:50:54.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.487+0000 7f7422ffd700 1 -- 172.21.15.26:0/3260020749 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v36) v1 ==== 74+0+130 (secure 0 0 0) 0x7f741800d2e0 con 0x7f74240f6860 2021-11-03T16:50:54.484 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:50:54.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.488+0000 7f742c39b700 1 -- 172.21.15.26:0/3260020749 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f740c05c2b0 msgr2=0x7f740c05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:50:54.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.488+0000 7f742c39b700 1 --2- 172.21.15.26:0/3260020749 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f740c05c2b0 0x7f740c05e770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f741c00b3b0 tx=0x7f741c004d10).stop 2021-11-03T16:50:54.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.488+0000 7f742c39b700 1 -- 172.21.15.26:0/3260020749 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74240f6860 msgr2=0x7f7424106450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:50:54.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.488+0000 7f742c39b700 1 --2- 172.21.15.26:0/3260020749 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74240f6860 0x7f7424106450 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f7418002700 tx=0x7f7418009e00).stop 2021-11-03T16:50:54.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.488+0000 7f742c39b700 1 -- 172.21.15.26:0/3260020749 shutdown_connections 2021-11-03T16:50:54.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.488+0000 7f742c39b700 1 --2- 172.21.15.26:0/3260020749 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f740c05c2b0 0x7f740c05e770 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:50:54.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.488+0000 7f742c39b700 1 --2- 172.21.15.26:0/3260020749 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74240f55c0 0x7f7424105f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:50:54.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.488+0000 7f742c39b700 1 --2- 172.21.15.26:0/3260020749 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74240f6860 0x7f7424106450 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:50:54.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.489+0000 7f742c39b700 1 -- 172.21.15.26:0/3260020749 >> 172.21.15.26:0/3260020749 conn(0x7f74240f0d40 msgr2=0x7f74240fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:50:54.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.489+0000 7f742c39b700 1 -- 172.21.15.26:0/3260020749 shutdown_connections 2021-11-03T16:50:54.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:54.489+0000 7f742c39b700 1 -- 172.21.15.26:0/3260020749 wait complete. 2021-11-03T16:50:54.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:54 smithi194 conmon[35111]: cluster 2021-11-03T16:50:53.016221+0000 mgr.smithi026.cnrxli (mgr.14162) 169 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-11-03T16:50:54.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:54 smithi194 conmon[35111]: audit 2021-11-03T16:50:53.115148+0000 mon.smithi026 (mon.0) 426 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-11-03T16:50:54.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:54 smithi194 conmon[35111]: cephadm 2021-11-03T16:50:53.267972+0000 2021-11-03T16:50:54.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:54 smithi194 conmon[35111]: mgr.smithi026.cnrxli (mgr.14162) 170 : cephadm [INF] Detected new or changed devices on smithi194 2021-11-03T16:50:54.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:54 smithi194 conmon[35111]: audit 2021- 2021-11-03T16:50:54.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:54 smithi194 conmon[35111]: 11-03T16:50:53.272523+0000 mon.smithi026 (mon.0) 427 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:54.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:54 smithi194 conmon[35111]: audit 2021-11-03T16:50: 2021-11-03T16:50:54.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:54 smithi194 conmon[35111]: 53.276483+0000 mon.smithi026 (mon.0) 428 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:54.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:54 smithi194 conmon[35111]: audit 2021-11-03T16:50:54.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:54 smithi194 conmon[35111]: 2021-11-03T16:50:53.279583+0000 mon.smithi026 (mon.0 2021-11-03T16:50:54.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:54 smithi194 conmon[35111]: ) 429 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:50:54.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:54 smithi194 conmon[35111]: audit 2021-11-03T16:50:53. 2021-11-03T16:50:54.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:54 smithi194 conmon[35111]: 283883+0000 mon.smithi026 (mon.0) 430 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:50:54.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:54 smithi194 conmon[35111]: audit 2021-11-03T16:50 2021-11-03T16:50:54.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:54 smithi194 conmon[35111]: :54.115341+0000 mon.smithi026 (mon.0) 431 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-11-03T16:50:55.248 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":36,"num_osds":6,"num_up_osds":6,"osd_up_since":1635958254,"num_in_osds":6,"osd_in_since":1635958237,"num_remapped_pgs":0} 2021-11-03T16:50:55.249 INFO:tasks.cephadm:Setting up client nodes... 2021-11-03T16:50:55.250 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2021-11-03T16:50:55.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:55 smithi026 conmon[32119]: cluster 2021-11-03T16:50:52.798558+0000 2021-11-03T16:50:55.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:55 smithi026 conmon[32119]: osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2021-11-03T16:50:55.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:55 smithi026 conmon[32119]: cluster 2021-11-03T16:50:52.798666+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2021-11-03T16:50:55.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:55 smithi026 conmon[32119]: cluster 2021-11-03T16:50:54.119126+0000 mon.smithi026 (mon.0) 432 : cluster [INF] osd.5 [v2:172.21.15.194:6816/89262300,v1:172.21.15.194:6817/89262300] boot 2021-11-03T16:50:55.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:55 smithi026 conmon[32119]: cluster 2021-11-03T16:50:55.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:55 smithi026 conmon[32119]: 2021-11-03T16 2021-11-03T16:50:55.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:55 smithi026 conmon[32119]: :50:54.119182+0000 mon.smithi026 (mon.0) 433 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2021-11-03T16:50:55.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:55 smithi026 conmon[32119]: audit 2021- 2021-11-03T16:50:55.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:55 smithi026 conmon[32119]: 11-03T16:50:54.119581+0000 2021-11-03T16:50:55.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:55 smithi026 conmon[32119]: mon.smithi026 (mon.0) 434 : audit [DBG] 2021-11-03T16:50:55.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:55 smithi026 conmon[32119]: from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-11-03T16:50:55.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:55 smithi026 conmon[32119]: audit 2021-11-03T 2021-11-03T16:50:55.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:55 smithi026 conmon[32119]: 16:50:54.488587+0000 mon.smithi026 (mon.0) 435 : audit 2021-11-03T16:50:55.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:55 smithi026 conmon[32119]: [DBG] from='client.? 172.21.15.26:0/3260020749' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2021-11-03T16:50:55.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:55 smithi194 conmon[35111]: cluster 2021-11-03T16:50:52.798558+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2021-11-03T16:50:55.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:55 smithi194 conmon[35111]: cluster 2021-11-03T16:50:52.798666+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2021-11-03T16:50:55.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:55 smithi194 conmon[35111]: cluster 2021-11-03T16:50:54.119126+0000 mon.smithi026 (mon.0) 432 : cluster [INF] osd.5 [v2:172.21.15.194:6816/89262300,v1:172.21.15.194:6817/89262300] boot 2021-11-03T16:50:55.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:55 smithi194 conmon[35111]: cluster 2021-11-03T16:50:54 2021-11-03T16:50:55.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:55 smithi194 conmon[35111]: .119182+0000 mon.smithi026 (mon.0) 433 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2021-11-03T16:50:55.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:55 smithi194 conmon[35111]: audit 2021-11-03T16:50:54.119581+0000 mon.smithi026 (mon.0) 434 2021-11-03T16:50:55.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:55 smithi194 conmon[35111]: : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-11-03T16:50:55.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:55 smithi194 conmon[35111]: audit 2021-11-03T16:50:54 2021-11-03T16:50:55.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:55 smithi194 conmon[35111]: .488587+0000 mon.smithi026 (mon.0) 435 : audit [DBG] from='client.? 172.21.15.26:0/3260020749' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2021-11-03T16:50:56.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:56 smithi026 conmon[32119]: cluster 2021-11-03T16:50:55.016742+0000 mgr.smithi026.cnrxli 2021-11-03T16:50:56.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:56 smithi026 conmon[32119]: (mgr.14162) 171 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-11-03T16:50:56.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:56 smithi026 conmon[32119]: cluster 2021-11-03T16:50:55.129765+0000 mon.smithi026 (mon.0) 436 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2021-11-03T16:50:56.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:56 smithi194 conmon[35111]: cluster 2021-11-03T16:50:55.016742+0000 mgr.smithi026.cnrxli (mgr.14162) 171 2021-11-03T16:50:56.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:56 smithi194 conmon[35111]: : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-11-03T16:50:56.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:56 smithi194 conmon[35111]: cluster 2021-11-03T16:50:55.129765+0000 mon.smithi026 (mon.0) 436 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2021-11-03T16:50:57.229 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.231+0000 7f0b8b2d5700 1 -- 172.21.15.26:0/42559922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b840f51a0 msgr2=0x7f0b840f7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:50:57.229 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.231+0000 7f0b8b2d5700 1 --2- 172.21.15.26:0/42559922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b840f51a0 0x7f0b840f7920 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f0b74004660 tx=0x7f0b74009b30).stop 2021-11-03T16:50:57.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.231+0000 7f0b8b2d5700 1 -- 172.21.15.26:0/42559922 shutdown_connections 2021-11-03T16:50:57.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.231+0000 7f0b8b2d5700 1 --2- 172.21.15.26:0/42559922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b840f51a0 0x7f0b840f7920 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:50:57.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.231+0000 7f0b8b2d5700 1 --2- 172.21.15.26:0/42559922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b840f4800 0x7f0b840f4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:50:57.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.231+0000 7f0b8b2d5700 1 -- 172.21.15.26:0/42559922 >> 172.21.15.26:0/42559922 conn(0x7f0b840f0320 msgr2=0x7f0b840f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:50:57.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.231+0000 7f0b8b2d5700 1 -- 172.21.15.26:0/42559922 shutdown_connections 2021-11-03T16:50:57.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.231+0000 7f0b8b2d5700 1 -- 172.21.15.26:0/42559922 wait complete. 2021-11-03T16:50:57.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.232+0000 7f0b8b2d5700 1 Processor -- start 2021-11-03T16:50:57.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.232+0000 7f0b8b2d5700 1 -- start start 2021-11-03T16:50:57.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.232+0000 7f0b8b2d5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b840f4800 0x7f0b84106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:50:57.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.232+0000 7f0b8b2d5700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b840f51a0 0x7f0b84107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:50:57.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.232+0000 7f0b8b2d5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b84107910 con 0x7f0b840f4800 2021-11-03T16:50:57.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.232+0000 7f0b8b2d5700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b84108120 con 0x7f0b840f51a0 2021-11-03T16:50:57.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.232+0000 7f0b8a2d3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b840f4800 0x7f0b84106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:50:57.233 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.232+0000 7f0b8a2d3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b840f4800 0x7f0b84106e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49784/0 (socket says 172.21.15.26:49784) 2021-11-03T16:50:57.233 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.232+0000 7f0b8a2d3700 1 -- 172.21.15.26:0/3907991090 learned_addr learned my addr 172.21.15.26:0/3907991090 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:50:57.233 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.232+0000 7f0b89ad2700 1 --2- 172.21.15.26:0/3907991090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b840f51a0 0x7f0b84107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:50:57.233 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.232+0000 7f0b8a2d3700 1 -- 172.21.15.26:0/3907991090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b840f51a0 msgr2=0x7f0b84107310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:50:57.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.232+0000 7f0b8a2d3700 1 --2- 172.21.15.26:0/3907991090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b840f51a0 0x7f0b84107310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:50:57.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.232+0000 7f0b8a2d3700 1 -- 172.21.15.26:0/3907991090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b74005040 con 0x7f0b840f4800 2021-11-03T16:50:57.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.232+0000 7f0b8a2d3700 1 --2- 172.21.15.26:0/3907991090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b840f4800 0x7f0b84106e20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f0b8000c790 tx=0x7f0b80007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:50:57.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.232+0000 7f0b7affd700 1 -- 172.21.15.26:0/3907991090 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b80013630 con 0x7f0b840f4800 2021-11-03T16:50:57.235 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.233+0000 7f0b8b2d5700 1 -- 172.21.15.26:0/3907991090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b841083a0 con 0x7f0b840f4800 2021-11-03T16:50:57.235 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.233+0000 7f0b7affd700 1 -- 172.21.15.26:0/3907991090 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f0b80012840 con 0x7f0b840f4800 2021-11-03T16:50:57.235 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.233+0000 7f0b7affd700 1 -- 172.21.15.26:0/3907991090 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b80002760 con 0x7f0b840f4800 2021-11-03T16:50:57.235 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.233+0000 7f0b8b2d5700 1 -- 172.21.15.26:0/3907991090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b84108960 con 0x7f0b840f4800 2021-11-03T16:50:57.236 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.234+0000 7f0b8b2d5700 1 -- 172.21.15.26:0/3907991090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b84059100 con 0x7f0b840f4800 2021-11-03T16:50:57.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.234+0000 7f0b7affd700 1 -- 172.21.15.26:0/3907991090 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f0b80010070 con 0x7f0b840f4800 2021-11-03T16:50:57.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.234+0000 7f0b7affd700 1 --2- 172.21.15.26:0/3907991090 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f0b7005c300 0x7f0b7005e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:50:57.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.234+0000 7f0b7affd700 1 -- 172.21.15.26:0/3907991090 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f0b80075c90 con 0x7f0b840f4800 2021-11-03T16:50:57.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.234+0000 7f0b89ad2700 1 --2- 172.21.15.26:0/3907991090 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f0b7005c300 0x7f0b7005e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:50:57.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.235+0000 7f0b89ad2700 1 --2- 172.21.15.26:0/3907991090 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f0b7005c300 0x7f0b7005e7c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f0b74004630 tx=0x7f0b74009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:50:57.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.238+0000 7f0b7affd700 1 -- 172.21.15.26:0/3907991090 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f0b80048c50 con 0x7f0b840f4800 2021-11-03T16:50:57.453 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.457+0000 7f0b8b2d5700 1 -- 172.21.15.26:0/3907991090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f0b84045ad0 con 0x7f0b840f4800 2021-11-03T16:50:57.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.461+0000 7f0b7affd700 1 -- 172.21.15.26:0/3907991090 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7f0b8004c270 con 0x7f0b840f4800 2021-11-03T16:50:57.457 INFO:teuthology.orchestra.run.smithi026.stdout:[client.0] 2021-11-03T16:50:57.458 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQDxvYJhsVthGxAAz7y9rX9h/J58HWi7mH9tRA== 2021-11-03T16:50:57.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.462+0000 7f0b8b2d5700 1 -- 172.21.15.26:0/3907991090 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f0b7005c300 msgr2=0x7f0b7005e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:50:57.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.462+0000 7f0b8b2d5700 1 --2- 172.21.15.26:0/3907991090 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f0b7005c300 0x7f0b7005e7c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f0b74004630 tx=0x7f0b74009b30).stop 2021-11-03T16:50:57.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.462+0000 7f0b8b2d5700 1 -- 172.21.15.26:0/3907991090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b840f4800 msgr2=0x7f0b84106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:50:57.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.462+0000 7f0b8b2d5700 1 --2- 172.21.15.26:0/3907991090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b840f4800 0x7f0b84106e20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f0b8000c790 tx=0x7f0b80007d90).stop 2021-11-03T16:50:57.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.462+0000 7f0b8b2d5700 1 -- 172.21.15.26:0/3907991090 shutdown_connections 2021-11-03T16:50:57.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.462+0000 7f0b8b2d5700 1 --2- 172.21.15.26:0/3907991090 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f0b7005c300 0x7f0b7005e7c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:50:57.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.462+0000 7f0b8b2d5700 1 --2- 172.21.15.26:0/3907991090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b840f4800 0x7f0b84106e20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:50:57.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.462+0000 7f0b8b2d5700 1 --2- 172.21.15.26:0/3907991090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b840f51a0 0x7f0b84107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:50:57.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.462+0000 7f0b8b2d5700 1 -- 172.21.15.26:0/3907991090 >> 172.21.15.26:0/3907991090 conn(0x7f0b840f0320 msgr2=0x7f0b840fb370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:50:57.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.463+0000 7f0b8b2d5700 1 -- 172.21.15.26:0/3907991090 shutdown_connections 2021-11-03T16:50:57.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:50:57.463+0000 7f0b8b2d5700 1 -- 172.21.15.26:0/3907991090 wait complete. 2021-11-03T16:50:58.208 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2021-11-03T16:50:58.209 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2021-11-03T16:50:58.209 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2021-11-03T16:50:58.250 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2021-11-03T16:50:58.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:58 smithi026 conmon[32119]: cluster 2021-11-03T16:50:57.017067+0000 mgr.smithi026.cnrxli (mgr.14162) 172 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:50:58.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:58 smithi026 conmon[32119]: audit 2021-11-03T16:50:57.459193+0000 mon.smithi026 (mon.0) 437 : audit [INF] from='client.? 172.21.15.26:0/3907991090' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-11-03T16:50:58.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:50:58 smithi026 conmon[32119]: audit 2021-11-03T16:50:57.462514+0000 mon.smithi026 (mon.0) 438 : audit [INF] from='client.? 172.21.15.26:0/3907991090' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-11-03T16:50:58.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:58 smithi194 conmon[35111]: cluster 2021-11-03T16:50:57.017067+0000 mgr.smithi026.cnrxli (mgr.14162) 172 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:50:58.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:58 smithi194 conmon[35111]: 2021-11-03T16:50:58.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:58 smithi194 conmon[35111]: audit 2021-11-03T16:50:57.459193+0000 mon.smithi026 (mon.0) 437 : audit [INF] from='client.? 172.21.15.26:0/3907991090' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-11-03T16:50:58.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:50:58 smithi194 conmon[35111]: audit 2021-11-03T16:50:57.462514+0000 mon.smithi026 (mon.0) 438 : audit [INF] from='client.? 172.21.15.26:0/3907991090' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-11-03T16:50:59.903 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:59.904+0000 7f94dafa2700 1 -- 172.21.15.194:0/3003309951 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94d40f66e0 msgr2=0x7f94d40f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:50:59.903 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:59.904+0000 7f94dafa2700 1 --2- 172.21.15.194:0/3003309951 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94d40f66e0 0x7f94d40f6b40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f94c4004660 tx=0x7f94c4009b30).stop 2021-11-03T16:50:59.904 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:59.905+0000 7f94dafa2700 1 -- 172.21.15.194:0/3003309951 shutdown_connections 2021-11-03T16:50:59.904 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:59.905+0000 7f94dafa2700 1 --2- 172.21.15.194:0/3003309951 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94d40f66e0 0x7f94d40f6b40 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:50:59.904 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:59.905+0000 7f94dafa2700 1 --2- 172.21.15.194:0/3003309951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d40f5440 0x7f94d40f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:50:59.904 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:59.905+0000 7f94dafa2700 1 -- 172.21.15.194:0/3003309951 >> 172.21.15.194:0/3003309951 conn(0x7f94d40f0ba0 msgr2=0x7f94d40f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:50:59.905 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:59.905+0000 7f94dafa2700 1 -- 172.21.15.194:0/3003309951 shutdown_connections 2021-11-03T16:50:59.905 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:59.905+0000 7f94dafa2700 1 -- 172.21.15.194:0/3003309951 wait complete. 2021-11-03T16:50:59.905 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:59.905+0000 7f94dafa2700 1 Processor -- start 2021-11-03T16:50:59.905 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:59.905+0000 7f94dafa2700 1 -- start start 2021-11-03T16:50:59.905 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:59.905+0000 7f94dafa2700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94d40f5440 0x7f94d4106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:50:59.906 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:59.905+0000 7f94dafa2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d40f66e0 0x7f94d41072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:50:59.906 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:59.905+0000 7f94dafa2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d41078f0 con 0x7f94d40f66e0 2021-11-03T16:50:59.906 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:59.905+0000 7f94dafa2700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d4108100 con 0x7f94d40f5440 2021-11-03T16:50:59.906 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:59.905+0000 7f94d9fa0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94d40f5440 0x7f94d4106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:50:59.907 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:59.905+0000 7f94d9fa0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94d40f5440 0x7f94d4106e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:34312/0 (socket says 172.21.15.194:34312) 2021-11-03T16:50:59.907 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:59.905+0000 7f94d9fa0700 1 -- 172.21.15.194:0/4005585096 learned_addr learned my addr 172.21.15.194:0/4005585096 (peer_addr_for_me v2:172.21.15.194:0/0) 2021-11-03T16:50:59.907 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:59.906+0000 7f94d979f700 1 --2- 172.21.15.194:0/4005585096 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d40f66e0 0x7f94d41072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:50:59.907 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:59.906+0000 7f94d9fa0700 1 -- 172.21.15.194:0/4005585096 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d40f66e0 msgr2=0x7f94d41072f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:50:59.908 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:59.906+0000 7f94d9fa0700 1 --2- 172.21.15.194:0/4005585096 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d40f66e0 0x7f94d41072f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:50:59.908 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:59.906+0000 7f94d9fa0700 1 -- 172.21.15.194:0/4005585096 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c4005040 con 0x7f94d40f5440 2021-11-03T16:50:59.908 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:59.906+0000 7f94d9fa0700 1 --2- 172.21.15.194:0/4005585096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94d40f5440 0x7f94d4106e00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f94d0002700 tx=0x7f94d0009d80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:50:59.908 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:59.906+0000 7f94ca7fc700 1 -- 172.21.15.194:0/4005585096 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94d00079c0 con 0x7f94d40f5440 2021-11-03T16:50:59.909 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:59.906+0000 7f94ca7fc700 1 -- 172.21.15.194:0/4005585096 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f94d000f040 con 0x7f94d40f5440 2021-11-03T16:50:59.909 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:59.906+0000 7f94dafa2700 1 -- 172.21.15.194:0/4005585096 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94d4108380 con 0x7f94d40f5440 2021-11-03T16:50:59.909 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:59.906+0000 7f94ca7fc700 1 -- 172.21.15.194:0/4005585096 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94d0014860 con 0x7f94d40f5440 2021-11-03T16:50:59.909 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:59.906+0000 7f94dafa2700 1 -- 172.21.15.194:0/4005585096 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94d4108940 con 0x7f94d40f5440 2021-11-03T16:50:59.910 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:59.907+0000 7f94dafa2700 1 -- 172.21.15.194:0/4005585096 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94d4059100 con 0x7f94d40f5440 2021-11-03T16:50:59.910 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:59.907+0000 7f94ca7fc700 1 -- 172.21.15.194:0/4005585096 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f94d001b060 con 0x7f94d40f5440 2021-11-03T16:50:59.910 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:59.907+0000 7f94ca7fc700 1 --2- 172.21.15.194:0/4005585096 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f94c005c300 0x7f94c005e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:50:59.910 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:59.908+0000 7f94ca7fc700 1 -- 172.21.15.194:0/4005585096 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f94d00759e0 con 0x7f94d40f5440 2021-11-03T16:50:59.910 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:59.908+0000 7f94d979f700 1 --2- 172.21.15.194:0/4005585096 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f94c005c300 0x7f94c005e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:50:59.912 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:59.908+0000 7f94d979f700 1 --2- 172.21.15.194:0/4005585096 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f94c005c300 0x7f94c005e7c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f94c4005010 tx=0x7f94c4009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:50:59.912 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:50:59.911+0000 7f94ca7fc700 1 -- 172.21.15.194:0/4005585096 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f94d0048a00 con 0x7f94d40f5440 2021-11-03T16:51:00.109 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:51:00.114+0000 7f94dafa2700 1 -- 172.21.15.194:0/4005585096 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f94d4045ad0 con 0x7f94d40f5440 2021-11-03T16:51:00.114 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:51:00.119+0000 7f94ca7fc700 1 -- 172.21.15.194:0/4005585096 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) v1 ==== 170+0+59 (secure 0 0 0) 0x7f94d004c020 con 0x7f94d40f5440 2021-11-03T16:51:00.115 INFO:teuthology.orchestra.run.smithi194.stdout:[client.1] 2021-11-03T16:51:00.115 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQD0vYJhyhbvBhAA1njVndpoXmnycPANlYMTNw== 2021-11-03T16:51:00.116 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:51:00.121+0000 7f94dafa2700 1 -- 172.21.15.194:0/4005585096 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f94c005c300 msgr2=0x7f94c005e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:00.117 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:51:00.121+0000 7f94dafa2700 1 --2- 172.21.15.194:0/4005585096 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f94c005c300 0x7f94c005e7c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f94c4005010 tx=0x7f94c4009b30).stop 2021-11-03T16:51:00.117 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:51:00.121+0000 7f94dafa2700 1 -- 172.21.15.194:0/4005585096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94d40f5440 msgr2=0x7f94d4106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:00.117 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:51:00.121+0000 7f94dafa2700 1 --2- 172.21.15.194:0/4005585096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94d40f5440 0x7f94d4106e00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f94d0002700 tx=0x7f94d0009d80).stop 2021-11-03T16:51:00.118 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:51:00.121+0000 7f94dafa2700 1 -- 172.21.15.194:0/4005585096 shutdown_connections 2021-11-03T16:51:00.118 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:51:00.121+0000 7f94dafa2700 1 --2- 172.21.15.194:0/4005585096 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f94c005c300 0x7f94c005e7c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:00.118 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:51:00.121+0000 7f94dafa2700 1 --2- 172.21.15.194:0/4005585096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94d40f5440 0x7f94d4106e00 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:00.118 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:51:00.121+0000 7f94dafa2700 1 --2- 172.21.15.194:0/4005585096 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d40f66e0 0x7f94d41072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:00.119 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:51:00.121+0000 7f94dafa2700 1 -- 172.21.15.194:0/4005585096 >> 172.21.15.194:0/4005585096 conn(0x7f94d40f0ba0 msgr2=0x7f94d40fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:51:00.119 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:51:00.121+0000 7f94dafa2700 1 -- 172.21.15.194:0/4005585096 shutdown_connections 2021-11-03T16:51:00.119 INFO:teuthology.orchestra.run.smithi194.stderr:2021-11-03T16:51:00.121+0000 7f94dafa2700 1 -- 172.21.15.194:0/4005585096 wait complete. 2021-11-03T16:51:00.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:00 smithi026 conmon[32119]: cluster 2021-11-03T16:50:59.017448+0000 mgr.smithi026.cnrxli (mgr 2021-11-03T16:51:00.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:00 smithi026 conmon[32119]: .14162) 173 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:00.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:00 smithi026 conmon[32119]: audit 2021-11-03T16:51:00.115644+0000 mon.smithi194 (mon.1) 14 : audit [INF] from='client.? 172.21.15.194:0/4005585096' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-11-03T16:51:00.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:00 smithi026 conmon[32119]: audit 2021-11-03T16:51:00.116098+0000 mon.smithi026 (mon.0) 439 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-11-03T16:51:00.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:00 smithi026 conmon[32119]: audit 2021-11-03T16:51:00.119910+0000 mon.smithi026 (mon.0) 440 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-11-03T16:51:00.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:00 smithi194 conmon[35111]: cluster 2021-11-03T16:50:59.017448+0000 mgr.smithi026.cnrxli (mgr.14162) 173 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:00.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:00 smithi194 conmon[35111]: audit 2021-11-03T16:51:00.115644+0000 mon.smithi194 (mon.1) 14 : audit [INF] from='client.? 172.21.15.194:0/4005585096' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-11-03T16:51:00.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:00 smithi194 conmon[35111]: audit 2021-11-03T16:51:00.116098+0000 mon.smithi026 (mon.0) 439 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-11-03T16:51:00.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:00 smithi194 conmon[35111]: audit 2021-11-03T16:51:00.119910+0000 mon.smithi026 (mon.0) 440 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-11-03T16:51:00.716 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2021-11-03T16:51:00.717 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2021-11-03T16:51:00.717 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2021-11-03T16:51:00.756 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph osd dump --format=json 2021-11-03T16:51:01.057 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c/mon.smithi026/config 2021-11-03T16:51:02.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:02 smithi026 conmon[32119]: cluster 2021-11-03T16:51:01.017765+0000 mgr.smithi026.cnrxli (mgr.14162) 174 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:02.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:02 smithi194 conmon[35111]: cluster 2021-11-03T16:51:01.017765+0000 mgr.smithi026.cnrxli (mgr.14162) 174 : cluster [DBG] 2021-11-03T16:51:02.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:02 smithi194 conmon[35111]: pgmap v142: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:02.730 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.728+0000 7f4aa5b61700 1 -- 172.21.15.26:0/2157735242 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aa00f7a80 msgr2=0x7f4aa00f7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:02.731 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.728+0000 7f4aa5b61700 1 --2- 172.21.15.26:0/2157735242 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aa00f7a80 0x7f4aa00f7ee0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f4a94004660 tx=0x7f4a94009b30).stop 2021-11-03T16:51:02.731 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.728+0000 7f4aa5b61700 1 -- 172.21.15.26:0/2157735242 shutdown_connections 2021-11-03T16:51:02.731 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.728+0000 7f4aa5b61700 1 --2- 172.21.15.26:0/2157735242 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aa00f7a80 0x7f4aa00f7ee0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:02.732 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.728+0000 7f4aa5b61700 1 --2- 172.21.15.26:0/2157735242 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aa00f67e0 0x7f4aa00f6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:02.732 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.728+0000 7f4aa5b61700 1 -- 172.21.15.26:0/2157735242 >> 172.21.15.26:0/2157735242 conn(0x7f4aa00f1f20 msgr2=0x7f4aa00f4360 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:51:02.733 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.728+0000 7f4aa5b61700 1 -- 172.21.15.26:0/2157735242 shutdown_connections 2021-11-03T16:51:02.733 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.728+0000 7f4aa5b61700 1 -- 172.21.15.26:0/2157735242 wait complete. 2021-11-03T16:51:02.733 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.729+0000 7f4aa5b61700 1 Processor -- start 2021-11-03T16:51:02.734 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.729+0000 7f4aa5b61700 1 -- start start 2021-11-03T16:51:02.734 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.729+0000 7f4aa5b61700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aa00f67e0 0x7f4aa0107030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:02.735 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.729+0000 7f4aa5b61700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aa00f7a80 0x7f4aa0107520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:02.735 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.729+0000 7f4aa5b61700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa0107ad0 con 0x7f4aa00f7a80 2021-11-03T16:51:02.736 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.729+0000 7f4aa5b61700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa0107c10 con 0x7f4aa00f67e0 2021-11-03T16:51:02.736 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.729+0000 7f4a9effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aa00f7a80 0x7f4aa0107520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:02.736 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.729+0000 7f4a9effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aa00f7a80 0x7f4aa0107520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49796/0 (socket says 172.21.15.26:49796) 2021-11-03T16:51:02.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.729+0000 7f4a9effd700 1 -- 172.21.15.26:0/401439374 learned_addr learned my addr 172.21.15.26:0/401439374 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:51:02.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.730+0000 7f4a9f7fe700 1 --2- 172.21.15.26:0/401439374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aa00f67e0 0x7f4aa0107030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:02.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.730+0000 7f4a9effd700 1 -- 172.21.15.26:0/401439374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aa00f67e0 msgr2=0x7f4aa0107030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:02.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.730+0000 7f4a9effd700 1 --2- 172.21.15.26:0/401439374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aa00f67e0 0x7f4aa0107030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:02.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.730+0000 7f4a9effd700 1 -- 172.21.15.26:0/401439374 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a94005040 con 0x7f4aa00f7a80 2021-11-03T16:51:02.739 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.730+0000 7f4a9f7fe700 1 --2- 172.21.15.26:0/401439374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aa00f67e0 0x7f4aa0107030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T16:51:02.739 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.730+0000 7f4a9effd700 1 --2- 172.21.15.26:0/401439374 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aa00f7a80 0x7f4aa0107520 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f4a94009990 tx=0x7f4a94009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:02.740 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.730+0000 7f4a87fff700 1 -- 172.21.15.26:0/401439374 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a94018070 con 0x7f4aa00f7a80 2021-11-03T16:51:02.740 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.730+0000 7f4aa5b61700 1 -- 172.21.15.26:0/401439374 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aa0108550 con 0x7f4aa00f7a80 2021-11-03T16:51:02.740 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.730+0000 7f4a87fff700 1 -- 172.21.15.26:0/401439374 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f4a94013410 con 0x7f4aa00f7a80 2021-11-03T16:51:02.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.730+0000 7f4a87fff700 1 -- 172.21.15.26:0/401439374 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a9401c3c0 con 0x7f4aa00f7a80 2021-11-03T16:51:02.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.730+0000 7f4aa5b61700 1 -- 172.21.15.26:0/401439374 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa0108ab0 con 0x7f4aa00f7a80 2021-11-03T16:51:02.742 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.731+0000 7f4aa5b61700 1 -- 172.21.15.26:0/401439374 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aa0045ad0 con 0x7f4aa00f7a80 2021-11-03T16:51:02.742 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.731+0000 7f4a87fff700 1 -- 172.21.15.26:0/401439374 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f4a9401d420 con 0x7f4aa00f7a80 2021-11-03T16:51:02.742 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.732+0000 7f4a87fff700 1 --2- 172.21.15.26:0/401439374 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f4a8805c2a0 0x7f4a8805e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:02.743 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.732+0000 7f4a87fff700 1 -- 172.21.15.26:0/401439374 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f4a94077850 con 0x7f4aa00f7a80 2021-11-03T16:51:02.743 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.732+0000 7f4a9f7fe700 1 --2- 172.21.15.26:0/401439374 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f4a8805c2a0 0x7f4a8805e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:02.744 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.732+0000 7f4a9f7fe700 1 --2- 172.21.15.26:0/401439374 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f4a8805c2a0 0x7f4a8805e760 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f4aa00f78e0 tx=0x7f4a90004d00).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:02.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.736+0000 7f4a87fff700 1 -- 172.21.15.26:0/401439374 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f4a9404a870 con 0x7f4aa00f7a80 2021-11-03T16:51:02.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.896+0000 7f4aa5b61700 1 -- 172.21.15.26:0/401439374 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4aa00ff0a0 con 0x7f4aa00f7a80 2021-11-03T16:51:02.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.897+0000 7f4a87fff700 1 -- 172.21.15.26:0/401439374 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+10842 (secure 0 0 0) 0x7f4a9401d6b0 con 0x7f4aa00f7a80 2021-11-03T16:51:02.893 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:51:02.894 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":37,"fsid":"70492bc6-3cc5-11ec-8c28-001a4aab830c","created":"2021-11-03T16:46:02.235903+0000","modified":"2021-11-03T16:50:55.123151+0000","last_up_change":"2021-11-03T16:50:54.115835+0000","last_in_change":"2021-11-03T16:50:37.526661+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-03T16:50:10.362172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"bf72169c-0b6d-4360-8f55-7add81fa314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":134495914},{"type":"v1","addr":"172.21.15.26:6803","nonce":134495914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":134495914},{"type":"v1","addr":"172.21.15.26:6805","nonce":134495914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":134495914},{"type":"v1","addr":"172.21.15.26:6809","nonce":134495914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":134495914},{"type":"v1","addr":"172.21.15.26:6807","nonce":134495914}]},"public_addr":"172.21.15.26:6803/134495914","cluster_addr":"172.21.15.26:6805/134495914","heartbeat_back_addr":"172.21.15.26:6809/134495914","heartbeat_front_addr":"172.21.15.26:6807/134495914","state":["exists","up"]},{"osd":1,"uuid":"9c8f520a-9e32-4b5f-bd70-9ba30526ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2411537943},{"type":"v1","addr":"172.21.15.26:6811","nonce":2411537943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":2411537943},{"type":"v1","addr":"172.21.15.26:6813","nonce":2411537943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2411537943},{"type":"v1","addr":"172.21.15.26:6817","nonce":2411537943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2411537943},{"type":"v1","addr":"172.21.15.26:6815","nonce":2411537943}]},"public_addr":"172.21.15.26:6811/2411537943","cluster_addr":"172.21.15.26:6813/2411537943","heartbeat_back_addr":"172.21.15.26:6817/2411537943","heartbeat_front_addr":"172.21.15.26:6815/2411537943","state":["exists","up"]},{"osd":2,"uuid":"dbb31ed5-aa1f-4832-9101-5fd23c08e194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":79646117},{"type":"v1","addr":"172.21.15.26:6819","nonce":79646117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":79646117},{"type":"v1","addr":"172.21.15.26:6821","nonce":79646117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":79646117},{"type":"v1","addr":"172.21.15.26:6825","nonce":79646117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":79646117},{"type":"v1","addr":"172.21.15.26:6823","nonce":79646117}]},"public_addr":"172.21.15.26:6819/79646117","cluster_addr":"172.21.15.26:6821/79646117","heartbeat_back_addr":"172.21.15.26:6825/79646117","heartbeat_front_addr":"172.21.15.26:6823/79646117","state":["exists","up"]},{"osd":3,"uuid":"5e168819-6fae-4e49-9c2d-0e04ee27575e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2165579585},{"type":"v1","addr":"172.21.15.194:6801","nonce":2165579585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2165579585},{"type":"v1","addr":"172.21.15.194:6803","nonce":2165579585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2165579585},{"type":"v1","addr":"172.21.15.194:6807","nonce":2165579585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2165579585},{"type":"v1","addr":"172.21.15.194:6805","nonce":2165579585}]},"public_addr":"172.21.15.194:6801/2165579585","cluster_addr":"172.21.15.194:6803/2165579585","heartbeat_back_addr":"172.21.15.194:6807/2165579585","heartbeat_front_addr":"172.21.15.194:6805/2165579585","state":["exists","up"]},{"osd":4,"uuid":"ddecb09f-cc9a-4c46-a537-d53a5249a778","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3847943561},{"type":"v1","addr":"172.21.15.194:6809","nonce":3847943561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3847943561},{"type":"v1","addr":"172.21.15.194:6811","nonce":3847943561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3847943561},{"type":"v1","addr":"172.21.15.194:6815","nonce":3847943561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3847943561},{"type":"v1","addr":"172.21.15.194:6813","nonce":3847943561}]},"public_addr":"172.21.15.194:6809/3847943561","cluster_addr":"172.21.15.194:6811/3847943561","heartbeat_back_addr":"172.21.15.194:6815/3847943561","heartbeat_front_addr":"172.21.15.194:6813/3847943561","state":["exists","up"]},{"osd":5,"uuid":"2fd86a44-51f4-46fb-b0d9-bac56ca01747","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":89262300},{"type":"v1","addr":"172.21.15.194:6817","nonce":89262300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":89262300},{"type":"v1","addr":"172.21.15.194:6819","nonce":89262300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":89262300},{"type":"v1","addr":"172.21.15.194:6823","nonce":89262300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":89262300},{"type":"v1","addr":"172.21.15.194:6821","nonce":89262300}]},"public_addr":"172.21.15.194:6817/89262300","cluster_addr":"172.21.15.194:6819/89262300","heartbeat_back_addr":"172.21.15.194:6823/89262300","heartbeat_front_addr":"172.21.15.194:6821/89262300","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-11-03T16:49:11.853661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-11-03T16:49:34.610764+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-11-03T16:49:57.604298+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-11-03T16:50:14.894440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-11-03T16:50:33.665171+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-11-03T16:50:52.798669+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:0/98237695":"2021-11-04T16:47:08.279607+0000","172.21.15.26:6800/3020148896":"2021-11-04T16:47:08.279607+0000","172.21.15.26:0/2642113831":"2021-11-04T16:47:08.279607+0000","172.21.15.26:6801/1563027933":"2021-11-04T16:46:50.621601+0000","172.21.15.26:6800/1563027933":"2021-11-04T16:46:50.621601+0000","172.21.15.26:6801/3020148896":"2021-11-04T16:47:08.279607+0000","172.21.15.26:0/4016577399":"2021-11-04T16:46:27.010637+0000","172.21.15.26:0/3941898157":"2021-11-04T16:46:50.621601+0000","172.21.15.26:0/2388202642":"2021-11-04T16:46:27.010637+0000","172.21.15.26:6800/2267111092":"2021-11-04T16:46:27.010637+0000","172.21.15.26:0/141868141":"2021-11-04T16:46:50.621601+0000","172.21.15.26:6801/2267111092":"2021-11-04T16:46:27.010637+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-11-03T16:51:02.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.898+0000 7f4aa5b61700 1 -- 172.21.15.26:0/401439374 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f4a8805c2a0 msgr2=0x7f4a8805e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:02.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.898+0000 7f4aa5b61700 1 --2- 172.21.15.26:0/401439374 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f4a8805c2a0 0x7f4a8805e760 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f4aa00f78e0 tx=0x7f4a90004d00).stop 2021-11-03T16:51:02.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.898+0000 7f4aa5b61700 1 -- 172.21.15.26:0/401439374 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aa00f7a80 msgr2=0x7f4aa0107520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:02.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.898+0000 7f4aa5b61700 1 --2- 172.21.15.26:0/401439374 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aa00f7a80 0x7f4aa0107520 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f4a94009990 tx=0x7f4a94009b30).stop 2021-11-03T16:51:02.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.898+0000 7f4aa5b61700 1 -- 172.21.15.26:0/401439374 shutdown_connections 2021-11-03T16:51:02.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.898+0000 7f4aa5b61700 1 --2- 172.21.15.26:0/401439374 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f4a8805c2a0 0x7f4a8805e760 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:02.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.898+0000 7f4aa5b61700 1 --2- 172.21.15.26:0/401439374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aa00f67e0 0x7f4aa0107030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:02.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.898+0000 7f4aa5b61700 1 --2- 172.21.15.26:0/401439374 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aa00f7a80 0x7f4aa0107520 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:02.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.898+0000 7f4aa5b61700 1 -- 172.21.15.26:0/401439374 >> 172.21.15.26:0/401439374 conn(0x7f4aa00f1f20 msgr2=0x7f4aa00fb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:51:02.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.898+0000 7f4aa5b61700 1 -- 172.21.15.26:0/401439374 shutdown_connections 2021-11-03T16:51:02.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:02.898+0000 7f4aa5b61700 1 -- 172.21.15.26:0/401439374 wait complete. 2021-11-03T16:51:03.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:03 smithi026 conmon[32119]: audit 2021-11-03T16:51:02.898143+0000 mon.smithi026 (mon.0) 441 2021-11-03T16:51:03.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:03 smithi026 conmon[32119]: : audit [DBG] from='client.? 172.21.15.26:0/401439374' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-11-03T16:51:03.471 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:03 smithi194 conmon[35111]: audit 2021-11-03T16:51:02.898143+0000 mon.smithi026 (mon.0) 441 : audit 2021-11-03T16:51:03.471 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:03 smithi194 conmon[35111]: [DBG] from='client.? 172.21.15.26:0/401439374' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-11-03T16:51:03.603 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-03T16:50:10.362172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}] 2021-11-03T16:51:03.604 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph osd pool get device_health_metrics pg_num 2021-11-03T16:51:03.897 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c/mon.smithi026/config 2021-11-03T16:51:04.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:04 smithi026 conmon[32119]: cluster 2021-11-03T16:51:03.018080+0000 mgr.smithi026.cnrxli (mgr.14162) 175 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:04.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:04 smithi194 conmon[35111]: cluster 2021-11-03T16:51:03.018080+0000 mgr.smithi026.cnrxli (mgr.14162) 175 2021-11-03T16:51:04.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:04 smithi194 conmon[35111]: : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:05.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.615+0000 7f7952533700 1 -- 172.21.15.26:0/2266104286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f794c0f6980 msgr2=0x7f794c0f6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:05.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.615+0000 7f7952533700 1 --2- 172.21.15.26:0/2266104286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f794c0f6980 0x7f794c0f6de0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f793c004660 tx=0x7f793c009b30).stop 2021-11-03T16:51:05.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.615+0000 7f7952533700 1 -- 172.21.15.26:0/2266104286 shutdown_connections 2021-11-03T16:51:05.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.615+0000 7f7952533700 1 --2- 172.21.15.26:0/2266104286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f794c0f6980 0x7f794c0f6de0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:05.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.615+0000 7f7952533700 1 --2- 172.21.15.26:0/2266104286 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f794c0f56e0 0x7f794c0f5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:05.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.615+0000 7f7952533700 1 -- 172.21.15.26:0/2266104286 >> 172.21.15.26:0/2266104286 conn(0x7f794c0f0e20 msgr2=0x7f794c0f3260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:51:05.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.616+0000 7f7952533700 1 -- 172.21.15.26:0/2266104286 shutdown_connections 2021-11-03T16:51:05.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.616+0000 7f7952533700 1 -- 172.21.15.26:0/2266104286 wait complete. 2021-11-03T16:51:05.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.616+0000 7f7952533700 1 Processor -- start 2021-11-03T16:51:05.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.616+0000 7f7952533700 1 -- start start 2021-11-03T16:51:05.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.616+0000 7f7952533700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f794c0f56e0 0x7f794c109d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:05.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.616+0000 7f7952533700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f794c0f6980 0x7f794c10c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:05.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.616+0000 7f7952533700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794c060940 con 0x7f794c0f56e0 2021-11-03T16:51:05.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.616+0000 7f7952533700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794c060a80 con 0x7f794c0f6980 2021-11-03T16:51:05.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.616+0000 7f794bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f794c0f56e0 0x7f794c109d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:05.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.616+0000 7f794bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f794c0f56e0 0x7f794c109d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49804/0 (socket says 172.21.15.26:49804) 2021-11-03T16:51:05.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.616+0000 7f794bfff700 1 -- 172.21.15.26:0/3949044588 learned_addr learned my addr 172.21.15.26:0/3949044588 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:51:05.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.617+0000 7f794b7fe700 1 --2- 172.21.15.26:0/3949044588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f794c0f6980 0x7f794c10c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:05.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.617+0000 7f794bfff700 1 -- 172.21.15.26:0/3949044588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f794c0f6980 msgr2=0x7f794c10c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:05.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.617+0000 7f794bfff700 1 --2- 172.21.15.26:0/3949044588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f794c0f6980 0x7f794c10c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:05.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.617+0000 7f794bfff700 1 -- 172.21.15.26:0/3949044588 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793c005040 con 0x7f794c0f56e0 2021-11-03T16:51:05.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.617+0000 7f794bfff700 1 --2- 172.21.15.26:0/3949044588 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f794c0f56e0 0x7f794c109d80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f7940002700 tx=0x7f7940009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:05.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.617+0000 7f7948ff9700 1 -- 172.21.15.26:0/3949044588 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79400079c0 con 0x7f794c0f56e0 2021-11-03T16:51:05.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.617+0000 7f7952533700 1 -- 172.21.15.26:0/3949044588 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f794c10c830 con 0x7f794c0f56e0 2021-11-03T16:51:05.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.617+0000 7f7948ff9700 1 -- 172.21.15.26:0/3949044588 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f794000f040 con 0x7f794c0f56e0 2021-11-03T16:51:05.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.617+0000 7f7948ff9700 1 -- 172.21.15.26:0/3949044588 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7940014860 con 0x7f794c0f56e0 2021-11-03T16:51:05.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.617+0000 7f7952533700 1 -- 172.21.15.26:0/3949044588 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f794c10cdf0 con 0x7f794c0f56e0 2021-11-03T16:51:05.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.618+0000 7f7952533700 1 -- 172.21.15.26:0/3949044588 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f794c045ad0 con 0x7f794c0f56e0 2021-11-03T16:51:05.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.618+0000 7f7948ff9700 1 -- 172.21.15.26:0/3949044588 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f794001b060 con 0x7f794c0f56e0 2021-11-03T16:51:05.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.619+0000 7f7948ff9700 1 --2- 172.21.15.26:0/3949044588 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f793405c2a0 0x7f793405e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:05.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.619+0000 7f7948ff9700 1 -- 172.21.15.26:0/3949044588 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f7940075a10 con 0x7f794c0f56e0 2021-11-03T16:51:05.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.619+0000 7f794b7fe700 1 --2- 172.21.15.26:0/3949044588 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f793405c2a0 0x7f793405e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:05.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.619+0000 7f794b7fe700 1 --2- 172.21.15.26:0/3949044588 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f793405c2a0 0x7f793405e760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f793c004e30 tx=0x7f793c009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:05.622 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.623+0000 7f7948ff9700 1 -- 172.21.15.26:0/3949044588 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f7940048a30 con 0x7f794c0f56e0 2021-11-03T16:51:05.775 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.780+0000 7f7952533700 1 -- 172.21.15.26:0/3949044588 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f794c0fdfe0 con 0x7f794c0f56e0 2021-11-03T16:51:05.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.780+0000 7f7948ff9700 1 -- 172.21.15.26:0/3949044588 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v37) v1 ==== 110+0+10 (secure 0 0 0) 0x7f794004c050 con 0x7f794c0f56e0 2021-11-03T16:51:05.776 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2021-11-03T16:51:05.777 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.782+0000 7f7952533700 1 -- 172.21.15.26:0/3949044588 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f793405c2a0 msgr2=0x7f793405e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:05.777 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.782+0000 7f7952533700 1 --2- 172.21.15.26:0/3949044588 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f793405c2a0 0x7f793405e760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f793c004e30 tx=0x7f793c009b30).stop 2021-11-03T16:51:05.778 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.782+0000 7f7952533700 1 -- 172.21.15.26:0/3949044588 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f794c0f56e0 msgr2=0x7f794c109d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:05.778 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.782+0000 7f7952533700 1 --2- 172.21.15.26:0/3949044588 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f794c0f56e0 0x7f794c109d80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f7940002700 tx=0x7f7940009d80).stop 2021-11-03T16:51:05.778 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.782+0000 7f7952533700 1 -- 172.21.15.26:0/3949044588 shutdown_connections 2021-11-03T16:51:05.778 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.782+0000 7f7952533700 1 --2- 172.21.15.26:0/3949044588 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f793405c2a0 0x7f793405e760 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:05.779 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.782+0000 7f7952533700 1 --2- 172.21.15.26:0/3949044588 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f794c0f56e0 0x7f794c109d80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:05.779 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.782+0000 7f7952533700 1 --2- 172.21.15.26:0/3949044588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f794c0f6980 0x7f794c10c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:05.779 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.782+0000 7f7952533700 1 -- 172.21.15.26:0/3949044588 >> 172.21.15.26:0/3949044588 conn(0x7f794c0f0e20 msgr2=0x7f794c0fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:51:05.779 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.782+0000 7f7952533700 1 -- 172.21.15.26:0/3949044588 shutdown_connections 2021-11-03T16:51:05.780 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:05.782+0000 7f7952533700 1 -- 172.21.15.26:0/3949044588 wait complete. 2021-11-03T16:51:06.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:06 smithi026 conmon[32119]: cluster 2021-11-03T16:51:05.018529+0000 mgr.smithi026.cnrxli (mgr 2021-11-03T16:51:06.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:06 smithi026 conmon[32119]: .14162) 176 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:06.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:06 smithi026 conmon[32119]: audit 2021-11-03T16:51:05.780941+0000 mon.smithi026 (mon.0) 442 : audit [DBG] from='client.? 172.21.15.26:0/3949044588' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2021-11-03T16:51:06.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:06 smithi194 conmon[35111]: cluster 2021-11-03T16:51:05.018529+0000 mgr.smithi026.cnrxli (mgr.14162) 176 : cluster 2021-11-03T16:51:06.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:06 smithi194 conmon[35111]: [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:06.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:06 smithi194 conmon[35111]: audit 2021-11-03T16:51:05.780941+0000 mon.smithi026 (mon.0) 442 : audit [DBG] from='client.? 172.21.15.26:0/3949044588' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2021-11-03T16:51:06.503 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2021-11-03T16:51:06.504 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2021-11-03T16:51:06.505 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph mgr dump --format=json 2021-11-03T16:51:06.795 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c/mon.smithi026/config 2021-11-03T16:51:08.380 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:08 smithi026 conmon[32119]: cluster 2021-11-03T16:51:07.018940+0000 mgr.smithi026.cnrxli (mgr.14162) 177 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:08.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:08 smithi194 conmon[35111]: cluster 2021-11-03T16:51:07.018940+0000 mgr.smithi026.cnrxli (mgr.14162) 177 : 2021-11-03T16:51:08.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:08 smithi194 conmon[35111]: cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:08.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.571+0000 7f207329c700 1 -- 172.21.15.26:0/2094958707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f206c0f7a60 msgr2=0x7f206c0f7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:08.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.571+0000 7f207329c700 1 --2- 172.21.15.26:0/2094958707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f206c0f7a60 0x7f206c0f7ec0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f2068004660 tx=0x7f2068009b30).stop 2021-11-03T16:51:08.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.571+0000 7f207329c700 1 -- 172.21.15.26:0/2094958707 shutdown_connections 2021-11-03T16:51:08.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.571+0000 7f207329c700 1 --2- 172.21.15.26:0/2094958707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f206c0f7a60 0x7f206c0f7ec0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:08.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.571+0000 7f207329c700 1 --2- 172.21.15.26:0/2094958707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f206c0f67c0 0x7f206c0f6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:08.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.571+0000 7f207329c700 1 -- 172.21.15.26:0/2094958707 >> 172.21.15.26:0/2094958707 conn(0x7f206c0f1f20 msgr2=0x7f206c0f4340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:51:08.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.571+0000 7f207329c700 1 -- 172.21.15.26:0/2094958707 shutdown_connections 2021-11-03T16:51:08.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.571+0000 7f207329c700 1 -- 172.21.15.26:0/2094958707 wait complete. 2021-11-03T16:51:08.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.572+0000 7f207329c700 1 Processor -- start 2021-11-03T16:51:08.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.572+0000 7f207329c700 1 -- start start 2021-11-03T16:51:08.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.572+0000 7f207329c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f206c0f67c0 0x7f206c107090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:08.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.572+0000 7f207329c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f206c0f7a60 0x7f206c107580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:08.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.572+0000 7f207329c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206c107b30 con 0x7f206c0f67c0 2021-11-03T16:51:08.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.572+0000 7f207329c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206c107c70 con 0x7f206c0f7a60 2021-11-03T16:51:08.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.572+0000 7f2071038700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f206c0f67c0 0x7f206c107090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:08.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.572+0000 7f2071038700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f206c0f67c0 0x7f206c107090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49814/0 (socket says 172.21.15.26:49814) 2021-11-03T16:51:08.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.572+0000 7f2071038700 1 -- 172.21.15.26:0/3266771992 learned_addr learned my addr 172.21.15.26:0/3266771992 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:51:08.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.572+0000 7f2070837700 1 --2- 172.21.15.26:0/3266771992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f206c0f7a60 0x7f206c107580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:08.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.572+0000 7f2071038700 1 -- 172.21.15.26:0/3266771992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f206c0f7a60 msgr2=0x7f206c107580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:08.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.572+0000 7f2071038700 1 --2- 172.21.15.26:0/3266771992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f206c0f7a60 0x7f206c107580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:08.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.572+0000 7f2071038700 1 -- 172.21.15.26:0/3266771992 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2068005040 con 0x7f206c0f67c0 2021-11-03T16:51:08.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.572+0000 7f2070837700 1 --2- 172.21.15.26:0/3266771992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f206c0f7a60 0x7f206c107580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T16:51:08.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.572+0000 7f2071038700 1 --2- 172.21.15.26:0/3266771992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f206c0f67c0 0x7f206c107090 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f2060002700 tx=0x7f2060009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:08.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.573+0000 7f205dffb700 1 -- 172.21.15.26:0/3266771992 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2060009320 con 0x7f206c0f67c0 2021-11-03T16:51:08.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.573+0000 7f205dffb700 1 -- 172.21.15.26:0/3266771992 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f206000f040 con 0x7f206c0f67c0 2021-11-03T16:51:08.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.573+0000 7f207329c700 1 -- 172.21.15.26:0/3266771992 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f206c108610 con 0x7f206c0f67c0 2021-11-03T16:51:08.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.573+0000 7f205dffb700 1 -- 172.21.15.26:0/3266771992 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2060014860 con 0x7f206c0f67c0 2021-11-03T16:51:08.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.573+0000 7f207329c700 1 -- 172.21.15.26:0/3266771992 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f206c108bd0 con 0x7f206c0f67c0 2021-11-03T16:51:08.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.574+0000 7f207329c700 1 -- 172.21.15.26:0/3266771992 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f206c045ad0 con 0x7f206c0f67c0 2021-11-03T16:51:08.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.574+0000 7f205dffb700 1 -- 172.21.15.26:0/3266771992 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f2060009480 con 0x7f206c0f67c0 2021-11-03T16:51:08.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.575+0000 7f205dffb700 1 --2- 172.21.15.26:0/3266771992 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f205805c2f0 0x7f205805e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:08.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.575+0000 7f205dffb700 1 -- 172.21.15.26:0/3266771992 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f20600761f0 con 0x7f206c0f67c0 2021-11-03T16:51:08.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.575+0000 7f2070837700 1 --2- 172.21.15.26:0/3266771992 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f205805c2f0 0x7f205805e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:08.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.575+0000 7f2070837700 1 --2- 172.21.15.26:0/3266771992 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f205805c2f0 0x7f205805e7b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f2068004e30 tx=0x7f2068009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:08.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.578+0000 7f205dffb700 1 -- 172.21.15.26:0/3266771992 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f20600491d0 con 0x7f206c0f67c0 2021-11-03T16:51:08.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.775+0000 7f207329c700 1 -- 172.21.15.26:0/3266771992 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f206c027a00 con 0x7f206c0f67c0 2021-11-03T16:51:08.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.778+0000 7f205dffb700 1 -- 172.21.15.26:0/3266771992 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v18) v1 ==== 74+0+143499 (secure 0 0 0) 0x7f206004c7f0 con 0x7f206c0f67c0 2021-11-03T16:51:08.776 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:51:08.777 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.780+0000 7f207329c700 1 -- 172.21.15.26:0/3266771992 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f205805c2f0 msgr2=0x7f205805e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:08.778 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.780+0000 7f207329c700 1 --2- 172.21.15.26:0/3266771992 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f205805c2f0 0x7f205805e7b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f2068004e30 tx=0x7f2068009b30).stop 2021-11-03T16:51:08.778 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.780+0000 7f207329c700 1 -- 172.21.15.26:0/3266771992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f206c0f67c0 msgr2=0x7f206c107090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:08.778 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.780+0000 7f207329c700 1 --2- 172.21.15.26:0/3266771992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f206c0f67c0 0x7f206c107090 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f2060002700 tx=0x7f2060009d80).stop 2021-11-03T16:51:08.779 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.780+0000 7f207329c700 1 -- 172.21.15.26:0/3266771992 shutdown_connections 2021-11-03T16:51:08.779 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.780+0000 7f207329c700 1 --2- 172.21.15.26:0/3266771992 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f205805c2f0 0x7f205805e7b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:08.779 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.780+0000 7f207329c700 1 --2- 172.21.15.26:0/3266771992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f206c0f67c0 0x7f206c107090 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:08.779 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.780+0000 7f207329c700 1 --2- 172.21.15.26:0/3266771992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f206c0f7a60 0x7f206c107580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:08.780 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.780+0000 7f207329c700 1 -- 172.21.15.26:0/3266771992 >> 172.21.15.26:0/3266771992 conn(0x7f206c0f1f20 msgr2=0x7f206c0fb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:51:08.780 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.780+0000 7f207329c700 1 -- 172.21.15.26:0/3266771992 shutdown_connections 2021-11-03T16:51:08.780 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:08.780+0000 7f207329c700 1 -- 172.21.15.26:0/3266771992 wait complete. 2021-11-03T16:51:09.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:09 smithi026 conmon[32119]: audit 2021-11-03T16:51:08.776603+0000 mon.smithi026 ( 2021-11-03T16:51:09.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:09 smithi026 conmon[32119]: mon.0) 443 : audit [DBG] from='client.? 172.21.15.26:0/3266771992' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-11-03T16:51:09.481 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":18,"active_gid":14162,"active_name":"smithi026.cnrxli","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3029163595},{"type":"v1","addr":"172.21.15.26:6801","nonce":3029163595}]},"active_addr":"172.21.15.26:6801/3029163595","active_change":"2021-11-03T16:47:08.279882+0000","active_mgr_features":4540138297136906239,"available":true,"standbys":[{"gid":14198,"name":"smithi194.wnexas","mgr_features":4540138297136906239,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"haproxy","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Registry to which we should normalize unqualified image names","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"haproxy","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Registry to which we should normalize unqualified image names","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://smithi026.front.sepia.ceph.com:8443/","prometheus":"http://smithi026.front.sepia.ceph.com:9283/"},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":4,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.26:0","nonce":770936864}]},{"addrvec":[{"type":"v2","addr":"172.21.15.26:0","nonce":2914078877}]}]}} 2021-11-03T16:51:09.486 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2021-11-03T16:51:09.486 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2021-11-03T16:51:09.487 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph osd dump --format=json 2021-11-03T16:51:09.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:09 smithi194 conmon[35111]: audit 2021-11-03T16:51:08.776603+0000 mon.smithi026 (mon.0) 443 : audit [DBG] from='client.? 172.21.15.26:0/3266771992' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-11-03T16:51:09.778 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c/mon.smithi026/config 2021-11-03T16:51:10.408 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:10 smithi026 conmon[32119]: cluster 2021-11-03T16:51:09.019245+0000 mgr.smithi026.cnrxli (mgr.14162) 178 2021-11-03T16:51:10.408 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:10 smithi026 conmon[32119]: : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:10.408 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:10 smithi026 conmon[32119]: audit 2021-11-03T16:51:09.171831+0000 mon.smithi026 (mon.0) 444 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T16:51:10.409 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:10 smithi026 conmon[32119]: audit 2021-11-03T16:51:09.172940+0000 mon.smithi026 (mon.0) 445 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T16:51:10.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:10 smithi194 conmon[35111]: cluster 2021-11-03T16:51:09.019245+0000 mgr.smithi026.cnrxli (mgr.14162) 2021-11-03T16:51:10.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:10 smithi194 conmon[35111]: 178 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:10.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:10 smithi194 conmon[35111]: audit 2021-11-03T16:51:09.171831+0000 mon.smithi026 (mon.0) 444 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T16:51:10.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:10 smithi194 conmon[35111]: audit 2021-11 2021-11-03T16:51:10.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:10 smithi194 conmon[35111]: -03T16:51:09.172940+0000 mon.smithi026 (mon.0) 445 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T16:51:11.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.487+0000 7fe9aefd8700 1 -- 172.21.15.26:0/460164047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9a80f7a80 msgr2=0x7fe9a80f7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:11.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.487+0000 7fe9aefd8700 1 --2- 172.21.15.26:0/460164047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9a80f7a80 0x7fe9a80f7ee0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fe994004660 tx=0x7fe994009b30).stop 2021-11-03T16:51:11.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.487+0000 7fe9aefd8700 1 -- 172.21.15.26:0/460164047 shutdown_connections 2021-11-03T16:51:11.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.487+0000 7fe9aefd8700 1 --2- 172.21.15.26:0/460164047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9a80f7a80 0x7fe9a80f7ee0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:11.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.487+0000 7fe9aefd8700 1 --2- 172.21.15.26:0/460164047 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9a80f67e0 0x7fe9a80f6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:11.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.487+0000 7fe9aefd8700 1 -- 172.21.15.26:0/460164047 >> 172.21.15.26:0/460164047 conn(0x7fe9a80f1f20 msgr2=0x7fe9a80f4360 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:51:11.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.487+0000 7fe9aefd8700 1 -- 172.21.15.26:0/460164047 shutdown_connections 2021-11-03T16:51:11.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.487+0000 7fe9aefd8700 1 -- 172.21.15.26:0/460164047 wait complete. 2021-11-03T16:51:11.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.487+0000 7fe9aefd8700 1 Processor -- start 2021-11-03T16:51:11.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.487+0000 7fe9aefd8700 1 -- start start 2021-11-03T16:51:11.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.488+0000 7fe9aefd8700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9a80f67e0 0x7fe9a806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:11.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.488+0000 7fe9aefd8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9a80f7a80 0x7fe9a8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:11.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.488+0000 7fe9aefd8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a806a380 con 0x7fe9a80f7a80 2021-11-03T16:51:11.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.488+0000 7fe9aefd8700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a806a4c0 con 0x7fe9a80f67e0 2021-11-03T16:51:11.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.488+0000 7fe9a7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9a80f7a80 0x7fe9a8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:11.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.488+0000 7fe9a7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9a80f7a80 0x7fe9a8069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49824/0 (socket says 172.21.15.26:49824) 2021-11-03T16:51:11.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.488+0000 7fe9a7fff700 1 -- 172.21.15.26:0/516255269 learned_addr learned my addr 172.21.15.26:0/516255269 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:51:11.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.488+0000 7fe9acd74700 1 --2- 172.21.15.26:0/516255269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9a80f67e0 0x7fe9a806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:11.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.488+0000 7fe9a7fff700 1 -- 172.21.15.26:0/516255269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9a80f67e0 msgr2=0x7fe9a806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:11.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.488+0000 7fe9a7fff700 1 --2- 172.21.15.26:0/516255269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9a80f67e0 0x7fe9a806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:11.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.488+0000 7fe9a7fff700 1 -- 172.21.15.26:0/516255269 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe994005040 con 0x7fe9a80f7a80 2021-11-03T16:51:11.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.488+0000 7fe9a7fff700 1 --2- 172.21.15.26:0/516255269 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9a80f7a80 0x7fe9a8069e20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fe994009990 tx=0x7fe994009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:11.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.488+0000 7fe9a57fa700 1 -- 172.21.15.26:0/516255269 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe994018070 con 0x7fe9a80f7a80 2021-11-03T16:51:11.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.488+0000 7fe9a57fa700 1 -- 172.21.15.26:0/516255269 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fe994013410 con 0x7fe9a80f7a80 2021-11-03T16:51:11.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.488+0000 7fe9aefd8700 1 -- 172.21.15.26:0/516255269 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9a806a740 con 0x7fe9a80f7a80 2021-11-03T16:51:11.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.488+0000 7fe9a57fa700 1 -- 172.21.15.26:0/516255269 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe99401de80 con 0x7fe9a80f7a80 2021-11-03T16:51:11.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.488+0000 7fe9aefd8700 1 -- 172.21.15.26:0/516255269 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a806aca0 con 0x7fe9a80f7a80 2021-11-03T16:51:11.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.489+0000 7fe9aefd8700 1 -- 172.21.15.26:0/516255269 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9a8045ad0 con 0x7fe9a80f7a80 2021-11-03T16:51:11.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.490+0000 7fe9a57fa700 1 -- 172.21.15.26:0/516255269 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fe99401d420 con 0x7fe9a80f7a80 2021-11-03T16:51:11.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.490+0000 7fe9a57fa700 1 --2- 172.21.15.26:0/516255269 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe99805c2a0 0x7fe99805e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:11.500 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.490+0000 7fe9a57fa700 1 -- 172.21.15.26:0/516255269 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7fe994077790 con 0x7fe9a80f7a80 2021-11-03T16:51:11.500 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.490+0000 7fe9acd74700 1 --2- 172.21.15.26:0/516255269 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe99805c2a0 0x7fe99805e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:11.500 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.491+0000 7fe9acd74700 1 --2- 172.21.15.26:0/516255269 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe99805c2a0 0x7fe99805e760 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fe9a806b730 tx=0x7fe99c00b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:11.501 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.494+0000 7fe9a57fa700 1 -- 172.21.15.26:0/516255269 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fe99404a7b0 con 0x7fe9a80f7a80 2021-11-03T16:51:11.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.653+0000 7fe9aefd8700 1 -- 172.21.15.26:0/516255269 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9a8027a00 con 0x7fe9a80f7a80 2021-11-03T16:51:11.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.654+0000 7fe9a57fa700 1 -- 172.21.15.26:0/516255269 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+10842 (secure 0 0 0) 0x7fe99404ddd0 con 0x7fe9a80f7a80 2021-11-03T16:51:11.649 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:51:11.650 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":37,"fsid":"70492bc6-3cc5-11ec-8c28-001a4aab830c","created":"2021-11-03T16:46:02.235903+0000","modified":"2021-11-03T16:50:55.123151+0000","last_up_change":"2021-11-03T16:50:54.115835+0000","last_in_change":"2021-11-03T16:50:37.526661+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-03T16:50:10.362172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"bf72169c-0b6d-4360-8f55-7add81fa314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":134495914},{"type":"v1","addr":"172.21.15.26:6803","nonce":134495914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":134495914},{"type":"v1","addr":"172.21.15.26:6805","nonce":134495914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":134495914},{"type":"v1","addr":"172.21.15.26:6809","nonce":134495914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":134495914},{"type":"v1","addr":"172.21.15.26:6807","nonce":134495914}]},"public_addr":"172.21.15.26:6803/134495914","cluster_addr":"172.21.15.26:6805/134495914","heartbeat_back_addr":"172.21.15.26:6809/134495914","heartbeat_front_addr":"172.21.15.26:6807/134495914","state":["exists","up"]},{"osd":1,"uuid":"9c8f520a-9e32-4b5f-bd70-9ba30526ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2411537943},{"type":"v1","addr":"172.21.15.26:6811","nonce":2411537943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":2411537943},{"type":"v1","addr":"172.21.15.26:6813","nonce":2411537943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2411537943},{"type":"v1","addr":"172.21.15.26:6817","nonce":2411537943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2411537943},{"type":"v1","addr":"172.21.15.26:6815","nonce":2411537943}]},"public_addr":"172.21.15.26:6811/2411537943","cluster_addr":"172.21.15.26:6813/2411537943","heartbeat_back_addr":"172.21.15.26:6817/2411537943","heartbeat_front_addr":"172.21.15.26:6815/2411537943","state":["exists","up"]},{"osd":2,"uuid":"dbb31ed5-aa1f-4832-9101-5fd23c08e194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":79646117},{"type":"v1","addr":"172.21.15.26:6819","nonce":79646117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":79646117},{"type":"v1","addr":"172.21.15.26:6821","nonce":79646117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":79646117},{"type":"v1","addr":"172.21.15.26:6825","nonce":79646117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":79646117},{"type":"v1","addr":"172.21.15.26:6823","nonce":79646117}]},"public_addr":"172.21.15.26:6819/79646117","cluster_addr":"172.21.15.26:6821/79646117","heartbeat_back_addr":"172.21.15.26:6825/79646117","heartbeat_front_addr":"172.21.15.26:6823/79646117","state":["exists","up"]},{"osd":3,"uuid":"5e168819-6fae-4e49-9c2d-0e04ee27575e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2165579585},{"type":"v1","addr":"172.21.15.194:6801","nonce":2165579585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2165579585},{"type":"v1","addr":"172.21.15.194:6803","nonce":2165579585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2165579585},{"type":"v1","addr":"172.21.15.194:6807","nonce":2165579585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2165579585},{"type":"v1","addr":"172.21.15.194:6805","nonce":2165579585}]},"public_addr":"172.21.15.194:6801/2165579585","cluster_addr":"172.21.15.194:6803/2165579585","heartbeat_back_addr":"172.21.15.194:6807/2165579585","heartbeat_front_addr":"172.21.15.194:6805/2165579585","state":["exists","up"]},{"osd":4,"uuid":"ddecb09f-cc9a-4c46-a537-d53a5249a778","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3847943561},{"type":"v1","addr":"172.21.15.194:6809","nonce":3847943561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3847943561},{"type":"v1","addr":"172.21.15.194:6811","nonce":3847943561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3847943561},{"type":"v1","addr":"172.21.15.194:6815","nonce":3847943561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3847943561},{"type":"v1","addr":"172.21.15.194:6813","nonce":3847943561}]},"public_addr":"172.21.15.194:6809/3847943561","cluster_addr":"172.21.15.194:6811/3847943561","heartbeat_back_addr":"172.21.15.194:6815/3847943561","heartbeat_front_addr":"172.21.15.194:6813/3847943561","state":["exists","up"]},{"osd":5,"uuid":"2fd86a44-51f4-46fb-b0d9-bac56ca01747","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":89262300},{"type":"v1","addr":"172.21.15.194:6817","nonce":89262300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":89262300},{"type":"v1","addr":"172.21.15.194:6819","nonce":89262300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":89262300},{"type":"v1","addr":"172.21.15.194:6823","nonce":89262300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":89262300},{"type":"v1","addr":"172.21.15.194:6821","nonce":89262300}]},"public_addr":"172.21.15.194:6817/89262300","cluster_addr":"172.21.15.194:6819/89262300","heartbeat_back_addr":"172.21.15.194:6823/89262300","heartbeat_front_addr":"172.21.15.194:6821/89262300","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-11-03T16:49:11.853661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-11-03T16:49:34.610764+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-11-03T16:49:57.604298+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-11-03T16:50:14.894440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-11-03T16:50:33.665171+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-11-03T16:50:52.798669+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:0/98237695":"2021-11-04T16:47:08.279607+0000","172.21.15.26:6800/3020148896":"2021-11-04T16:47:08.279607+0000","172.21.15.26:0/2642113831":"2021-11-04T16:47:08.279607+0000","172.21.15.26:6801/1563027933":"2021-11-04T16:46:50.621601+0000","172.21.15.26:6800/1563027933":"2021-11-04T16:46:50.621601+0000","172.21.15.26:6801/3020148896":"2021-11-04T16:47:08.279607+0000","172.21.15.26:0/4016577399":"2021-11-04T16:46:27.010637+0000","172.21.15.26:0/3941898157":"2021-11-04T16:46:50.621601+0000","172.21.15.26:0/2388202642":"2021-11-04T16:46:27.010637+0000","172.21.15.26:6800/2267111092":"2021-11-04T16:46:27.010637+0000","172.21.15.26:0/141868141":"2021-11-04T16:46:50.621601+0000","172.21.15.26:6801/2267111092":"2021-11-04T16:46:27.010637+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-11-03T16:51:11.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.655+0000 7fe9aefd8700 1 -- 172.21.15.26:0/516255269 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe99805c2a0 msgr2=0x7fe99805e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:11.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.655+0000 7fe9aefd8700 1 --2- 172.21.15.26:0/516255269 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe99805c2a0 0x7fe99805e760 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fe9a806b730 tx=0x7fe99c00b040).stop 2021-11-03T16:51:11.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.655+0000 7fe9aefd8700 1 -- 172.21.15.26:0/516255269 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9a80f7a80 msgr2=0x7fe9a8069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:11.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.655+0000 7fe9aefd8700 1 --2- 172.21.15.26:0/516255269 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9a80f7a80 0x7fe9a8069e20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fe994009990 tx=0x7fe994009b30).stop 2021-11-03T16:51:11.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.655+0000 7fe9aefd8700 1 -- 172.21.15.26:0/516255269 shutdown_connections 2021-11-03T16:51:11.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.655+0000 7fe9aefd8700 1 --2- 172.21.15.26:0/516255269 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe99805c2a0 0x7fe99805e760 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:11.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.655+0000 7fe9aefd8700 1 --2- 172.21.15.26:0/516255269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9a80f67e0 0x7fe9a806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:11.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.655+0000 7fe9aefd8700 1 --2- 172.21.15.26:0/516255269 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9a80f7a80 0x7fe9a8069e20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:11.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.655+0000 7fe9aefd8700 1 -- 172.21.15.26:0/516255269 >> 172.21.15.26:0/516255269 conn(0x7fe9a80f1f20 msgr2=0x7fe9a80fb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:51:11.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.656+0000 7fe9aefd8700 1 -- 172.21.15.26:0/516255269 shutdown_connections 2021-11-03T16:51:11.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:11.656+0000 7fe9aefd8700 1 -- 172.21.15.26:0/516255269 wait complete. 2021-11-03T16:51:12.363 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2021-11-03T16:51:12.364 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph osd dump --format=json 2021-11-03T16:51:12.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:12 smithi026 conmon[32119]: cluster 2021-11-03T16:51:11.019647+0000 mgr.smithi026.cnrxli (mgr.14162) 179 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:12.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:12 smithi026 conmon[32119]: audit 2021-11-03T16:51:11.654293+0000 mon.smithi026 (mon.0) 446 : audit [DBG] from='client.? 172.21.15.26:0/516255269' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-11-03T16:51:12.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:12 smithi194 conmon[35111]: cluster 2021-11-03T16:51:11.019647+0000 mgr.smithi026.cnrxli (mgr.14162) 179 : cluster [DBG] 2021-11-03T16:51:12.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:12 smithi194 conmon[35111]: pgmap v147: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:12.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:12 smithi194 conmon[35111]: audit 2021-11-03T16:51:11.654293+0000 mon.smithi026 (mon.0) 446 : audit [DBG] from='client.? 172.21.15.26:0/516255269' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-11-03T16:51:12.660 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c/mon.smithi026/config 2021-11-03T16:51:14.242 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:14 smithi026 conmon[32119]: cluster 2021-11-03T16:51:13.019967+0000 mgr.smithi026.cnrxli (mgr.14162) 180 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:14.432 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.436+0000 7fcf1dc75700 1 -- 172.21.15.26:0/1194079244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf180f56e0 msgr2=0x7fcf180f5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:14.433 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.436+0000 7fcf1dc75700 1 --2- 172.21.15.26:0/1194079244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf180f56e0 0x7fcf180f5b00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fcf08004660 tx=0x7fcf08009b30).stop 2021-11-03T16:51:14.433 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.436+0000 7fcf1dc75700 1 -- 172.21.15.26:0/1194079244 shutdown_connections 2021-11-03T16:51:14.433 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.436+0000 7fcf1dc75700 1 --2- 172.21.15.26:0/1194079244 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf180f6980 0x7fcf180f6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:14.433 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.436+0000 7fcf1dc75700 1 --2- 172.21.15.26:0/1194079244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf180f56e0 0x7fcf180f5b00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:14.434 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.436+0000 7fcf1dc75700 1 -- 172.21.15.26:0/1194079244 >> 172.21.15.26:0/1194079244 conn(0x7fcf180f0e20 msgr2=0x7fcf180f3260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:51:14.434 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.436+0000 7fcf1dc75700 1 -- 172.21.15.26:0/1194079244 shutdown_connections 2021-11-03T16:51:14.434 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.436+0000 7fcf1dc75700 1 -- 172.21.15.26:0/1194079244 wait complete. 2021-11-03T16:51:14.434 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.436+0000 7fcf1dc75700 1 Processor -- start 2021-11-03T16:51:14.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.436+0000 7fcf1dc75700 1 -- start start 2021-11-03T16:51:14.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.437+0000 7fcf1dc75700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf180f56e0 0x7fcf181070e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:14.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.437+0000 7fcf1dc75700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf180f6980 0x7fcf181075d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:14.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.437+0000 7fcf1dc75700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf18107b80 con 0x7fcf180f6980 2021-11-03T16:51:14.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.437+0000 7fcf1dc75700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf18107cc0 con 0x7fcf180f56e0 2021-11-03T16:51:14.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.437+0000 7fcf0ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf180f6980 0x7fcf181075d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:14.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.437+0000 7fcf0ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf180f6980 0x7fcf181075d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49834/0 (socket says 172.21.15.26:49834) 2021-11-03T16:51:14.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.437+0000 7fcf0ffff700 1 -- 172.21.15.26:0/763193711 learned_addr learned my addr 172.21.15.26:0/763193711 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:51:14.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.437+0000 7fcf177fe700 1 --2- 172.21.15.26:0/763193711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf180f56e0 0x7fcf181070e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:14.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.437+0000 7fcf0ffff700 1 -- 172.21.15.26:0/763193711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf180f56e0 msgr2=0x7fcf181070e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:14.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.437+0000 7fcf0ffff700 1 --2- 172.21.15.26:0/763193711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf180f56e0 0x7fcf181070e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:14.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.437+0000 7fcf0ffff700 1 -- 172.21.15.26:0/763193711 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf08005040 con 0x7fcf180f6980 2021-11-03T16:51:14.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.437+0000 7fcf177fe700 1 --2- 172.21.15.26:0/763193711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf180f56e0 0x7fcf181070e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T16:51:14.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.437+0000 7fcf0ffff700 1 --2- 172.21.15.26:0/763193711 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf180f6980 0x7fcf181075d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fcf0000c790 tx=0x7fcf00007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:14.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.437+0000 7fcf14ff9700 1 -- 172.21.15.26:0/763193711 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf0000e680 con 0x7fcf180f6980 2021-11-03T16:51:14.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.437+0000 7fcf1dc75700 1 -- 172.21.15.26:0/763193711 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf18108660 con 0x7fcf180f6980 2021-11-03T16:51:14.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.437+0000 7fcf14ff9700 1 -- 172.21.15.26:0/763193711 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fcf0000ec70 con 0x7fcf180f6980 2021-11-03T16:51:14.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.437+0000 7fcf14ff9700 1 -- 172.21.15.26:0/763193711 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf00013d30 con 0x7fcf180f6980 2021-11-03T16:51:14.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.437+0000 7fcf1dc75700 1 -- 172.21.15.26:0/763193711 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf18108c20 con 0x7fcf180f6980 2021-11-03T16:51:14.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.438+0000 7fcf1dc75700 1 -- 172.21.15.26:0/763193711 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf18045ad0 con 0x7fcf180f6980 2021-11-03T16:51:14.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.439+0000 7fcf14ff9700 1 -- 172.21.15.26:0/763193711 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fcf0001a060 con 0x7fcf180f6980 2021-11-03T16:51:14.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.439+0000 7fcf14ff9700 1 --2- 172.21.15.26:0/763193711 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fcf0405c2a0 0x7fcf0405e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:14.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.439+0000 7fcf14ff9700 1 -- 172.21.15.26:0/763193711 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7fcf00075e00 con 0x7fcf180f6980 2021-11-03T16:51:14.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.439+0000 7fcf177fe700 1 --2- 172.21.15.26:0/763193711 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fcf0405c2a0 0x7fcf0405e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:14.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.439+0000 7fcf177fe700 1 --2- 172.21.15.26:0/763193711 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fcf0405c2a0 0x7fcf0405e760 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fcf08004e30 tx=0x7fcf08009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:14.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.443+0000 7fcf14ff9700 1 -- 172.21.15.26:0/763193711 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fcf0004c850 con 0x7fcf180f6980 2021-11-03T16:51:14.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:14 smithi194 conmon[35111]: cluster 2021-11-03T16:51:13.019967+0000 mgr.smithi026.cnrxli (mgr.14162) 180 : cluster 2021-11-03T16:51:14.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:14 smithi194 conmon[35111]: [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:14.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.600+0000 7fcf1dc75700 1 -- 172.21.15.26:0/763193711 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf180ff070 con 0x7fcf180f6980 2021-11-03T16:51:14.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.600+0000 7fcf14ff9700 1 -- 172.21.15.26:0/763193711 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+10842 (secure 0 0 0) 0x7fcf0004c440 con 0x7fcf180f6980 2021-11-03T16:51:14.596 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:51:14.597 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":37,"fsid":"70492bc6-3cc5-11ec-8c28-001a4aab830c","created":"2021-11-03T16:46:02.235903+0000","modified":"2021-11-03T16:50:55.123151+0000","last_up_change":"2021-11-03T16:50:54.115835+0000","last_in_change":"2021-11-03T16:50:37.526661+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-03T16:50:10.362172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"bf72169c-0b6d-4360-8f55-7add81fa314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":134495914},{"type":"v1","addr":"172.21.15.26:6803","nonce":134495914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":134495914},{"type":"v1","addr":"172.21.15.26:6805","nonce":134495914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":134495914},{"type":"v1","addr":"172.21.15.26:6809","nonce":134495914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":134495914},{"type":"v1","addr":"172.21.15.26:6807","nonce":134495914}]},"public_addr":"172.21.15.26:6803/134495914","cluster_addr":"172.21.15.26:6805/134495914","heartbeat_back_addr":"172.21.15.26:6809/134495914","heartbeat_front_addr":"172.21.15.26:6807/134495914","state":["exists","up"]},{"osd":1,"uuid":"9c8f520a-9e32-4b5f-bd70-9ba30526ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2411537943},{"type":"v1","addr":"172.21.15.26:6811","nonce":2411537943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":2411537943},{"type":"v1","addr":"172.21.15.26:6813","nonce":2411537943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2411537943},{"type":"v1","addr":"172.21.15.26:6817","nonce":2411537943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2411537943},{"type":"v1","addr":"172.21.15.26:6815","nonce":2411537943}]},"public_addr":"172.21.15.26:6811/2411537943","cluster_addr":"172.21.15.26:6813/2411537943","heartbeat_back_addr":"172.21.15.26:6817/2411537943","heartbeat_front_addr":"172.21.15.26:6815/2411537943","state":["exists","up"]},{"osd":2,"uuid":"dbb31ed5-aa1f-4832-9101-5fd23c08e194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":79646117},{"type":"v1","addr":"172.21.15.26:6819","nonce":79646117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":79646117},{"type":"v1","addr":"172.21.15.26:6821","nonce":79646117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":79646117},{"type":"v1","addr":"172.21.15.26:6825","nonce":79646117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":79646117},{"type":"v1","addr":"172.21.15.26:6823","nonce":79646117}]},"public_addr":"172.21.15.26:6819/79646117","cluster_addr":"172.21.15.26:6821/79646117","heartbeat_back_addr":"172.21.15.26:6825/79646117","heartbeat_front_addr":"172.21.15.26:6823/79646117","state":["exists","up"]},{"osd":3,"uuid":"5e168819-6fae-4e49-9c2d-0e04ee27575e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2165579585},{"type":"v1","addr":"172.21.15.194:6801","nonce":2165579585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2165579585},{"type":"v1","addr":"172.21.15.194:6803","nonce":2165579585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2165579585},{"type":"v1","addr":"172.21.15.194:6807","nonce":2165579585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2165579585},{"type":"v1","addr":"172.21.15.194:6805","nonce":2165579585}]},"public_addr":"172.21.15.194:6801/2165579585","cluster_addr":"172.21.15.194:6803/2165579585","heartbeat_back_addr":"172.21.15.194:6807/2165579585","heartbeat_front_addr":"172.21.15.194:6805/2165579585","state":["exists","up"]},{"osd":4,"uuid":"ddecb09f-cc9a-4c46-a537-d53a5249a778","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3847943561},{"type":"v1","addr":"172.21.15.194:6809","nonce":3847943561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3847943561},{"type":"v1","addr":"172.21.15.194:6811","nonce":3847943561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3847943561},{"type":"v1","addr":"172.21.15.194:6815","nonce":3847943561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3847943561},{"type":"v1","addr":"172.21.15.194:6813","nonce":3847943561}]},"public_addr":"172.21.15.194:6809/3847943561","cluster_addr":"172.21.15.194:6811/3847943561","heartbeat_back_addr":"172.21.15.194:6815/3847943561","heartbeat_front_addr":"172.21.15.194:6813/3847943561","state":["exists","up"]},{"osd":5,"uuid":"2fd86a44-51f4-46fb-b0d9-bac56ca01747","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":89262300},{"type":"v1","addr":"172.21.15.194:6817","nonce":89262300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":89262300},{"type":"v1","addr":"172.21.15.194:6819","nonce":89262300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":89262300},{"type":"v1","addr":"172.21.15.194:6823","nonce":89262300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":89262300},{"type":"v1","addr":"172.21.15.194:6821","nonce":89262300}]},"public_addr":"172.21.15.194:6817/89262300","cluster_addr":"172.21.15.194:6819/89262300","heartbeat_back_addr":"172.21.15.194:6823/89262300","heartbeat_front_addr":"172.21.15.194:6821/89262300","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-11-03T16:49:11.853661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-11-03T16:49:34.610764+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-11-03T16:49:57.604298+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-11-03T16:50:14.894440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-11-03T16:50:33.665171+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-11-03T16:50:52.798669+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:0/98237695":"2021-11-04T16:47:08.279607+0000","172.21.15.26:6800/3020148896":"2021-11-04T16:47:08.279607+0000","172.21.15.26:0/2642113831":"2021-11-04T16:47:08.279607+0000","172.21.15.26:6801/1563027933":"2021-11-04T16:46:50.621601+0000","172.21.15.26:6800/1563027933":"2021-11-04T16:46:50.621601+0000","172.21.15.26:6801/3020148896":"2021-11-04T16:47:08.279607+0000","172.21.15.26:0/4016577399":"2021-11-04T16:46:27.010637+0000","172.21.15.26:0/3941898157":"2021-11-04T16:46:50.621601+0000","172.21.15.26:0/2388202642":"2021-11-04T16:46:27.010637+0000","172.21.15.26:6800/2267111092":"2021-11-04T16:46:27.010637+0000","172.21.15.26:0/141868141":"2021-11-04T16:46:50.621601+0000","172.21.15.26:6801/2267111092":"2021-11-04T16:46:27.010637+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-11-03T16:51:14.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.602+0000 7fcf1dc75700 1 -- 172.21.15.26:0/763193711 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fcf0405c2a0 msgr2=0x7fcf0405e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:14.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.602+0000 7fcf1dc75700 1 --2- 172.21.15.26:0/763193711 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fcf0405c2a0 0x7fcf0405e760 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fcf08004e30 tx=0x7fcf08009b30).stop 2021-11-03T16:51:14.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.602+0000 7fcf1dc75700 1 -- 172.21.15.26:0/763193711 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf180f6980 msgr2=0x7fcf181075d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:14.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.602+0000 7fcf1dc75700 1 --2- 172.21.15.26:0/763193711 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf180f6980 0x7fcf181075d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fcf0000c790 tx=0x7fcf00007d70).stop 2021-11-03T16:51:14.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.602+0000 7fcf1dc75700 1 -- 172.21.15.26:0/763193711 shutdown_connections 2021-11-03T16:51:14.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.602+0000 7fcf1dc75700 1 --2- 172.21.15.26:0/763193711 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fcf0405c2a0 0x7fcf0405e760 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:14.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.602+0000 7fcf1dc75700 1 --2- 172.21.15.26:0/763193711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf180f56e0 0x7fcf181070e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:14.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.602+0000 7fcf1dc75700 1 --2- 172.21.15.26:0/763193711 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf180f6980 0x7fcf181075d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:14.600 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.602+0000 7fcf1dc75700 1 -- 172.21.15.26:0/763193711 >> 172.21.15.26:0/763193711 conn(0x7fcf180f0e20 msgr2=0x7fcf180fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:51:14.600 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.602+0000 7fcf1dc75700 1 -- 172.21.15.26:0/763193711 shutdown_connections 2021-11-03T16:51:14.600 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:14.602+0000 7fcf1dc75700 1 -- 172.21.15.26:0/763193711 wait complete. 2021-11-03T16:51:15.255 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph tell osd.0 flush_pg_stats 2021-11-03T16:51:15.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:15 smithi026 conmon[32119]: audit 2021-11-03T16:51:14.600964+0000 mon.smithi026 (mon 2021-11-03T16:51:15.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:15 smithi026 conmon[32119]: .0) 447 : audit [DBG] from='client.? 172.21.15.26:0/763193711' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-11-03T16:51:15.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:15 smithi194 conmon[35111]: audit 2021-11-03T16:51:14.600964+0000 2021-11-03T16:51:15.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:15 smithi194 conmon[35111]: mon.smithi026 (mon.0) 447 : audit [DBG] from='client.? 172.21.15.26:0/763193711' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-11-03T16:51:15.543 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c/mon.smithi026/config 2021-11-03T16:51:16.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:16 smithi026 conmon[32119]: cluster 2021-11-03T16:51:15.020466+0000 2021-11-03T16:51:16.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:16 smithi026 conmon[32119]: mgr.smithi026.cnrxli (mgr.14162) 181 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:16.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:16 smithi194 conmon[35111]: cluster 2021-11-03T16:51:15.020466+0000 mgr.smithi026.cnrxli (mgr.14162) 181 : 2021-11-03T16:51:16.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:16 smithi194 conmon[35111]: cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:17.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.345+0000 7f7cabd1f700 1 -- 172.21.15.26:0/2817572933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ca40f56c0 msgr2=0x7f7ca40f5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:17.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.345+0000 7f7cabd1f700 1 --2- 172.21.15.26:0/2817572933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ca40f56c0 0x7f7ca40f5ae0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f7c98004660 tx=0x7f7c98009b30).stop 2021-11-03T16:51:17.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.345+0000 7f7cabd1f700 1 -- 172.21.15.26:0/2817572933 shutdown_connections 2021-11-03T16:51:17.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.345+0000 7f7cabd1f700 1 --2- 172.21.15.26:0/2817572933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ca40f6960 0x7f7ca40f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:17.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.345+0000 7f7cabd1f700 1 --2- 172.21.15.26:0/2817572933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ca40f56c0 0x7f7ca40f5ae0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:17.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.345+0000 7f7cabd1f700 1 -- 172.21.15.26:0/2817572933 >> 172.21.15.26:0/2817572933 conn(0x7f7ca40f0e20 msgr2=0x7f7ca40f3240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:51:17.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.345+0000 7f7cabd1f700 1 -- 172.21.15.26:0/2817572933 shutdown_connections 2021-11-03T16:51:17.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.345+0000 7f7cabd1f700 1 -- 172.21.15.26:0/2817572933 wait complete. 2021-11-03T16:51:17.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.346+0000 7f7cabd1f700 1 Processor -- start 2021-11-03T16:51:17.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.346+0000 7f7cabd1f700 1 -- start start 2021-11-03T16:51:17.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.346+0000 7f7cabd1f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ca40f56c0 0x7f7ca40f9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:17.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.346+0000 7f7cabd1f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ca40f6960 0x7f7ca40f7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:17.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.346+0000 7f7cabd1f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca40f8200 con 0x7f7ca40f56c0 2021-11-03T16:51:17.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.346+0000 7f7cabd1f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca40f8340 con 0x7f7ca40f6960 2021-11-03T16:51:17.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.346+0000 7f7ca9abb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ca40f56c0 0x7f7ca40f9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:17.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.346+0000 7f7ca9abb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ca40f56c0 0x7f7ca40f9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49842/0 (socket says 172.21.15.26:49842) 2021-11-03T16:51:17.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.346+0000 7f7ca9abb700 1 -- 172.21.15.26:0/722110975 learned_addr learned my addr 172.21.15.26:0/722110975 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:51:17.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.346+0000 7f7ca9abb700 1 -- 172.21.15.26:0/722110975 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ca40f6960 msgr2=0x7f7ca40f7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:17.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.346+0000 7f7ca92ba700 1 --2- 172.21.15.26:0/722110975 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ca40f6960 0x7f7ca40f7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:17.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.346+0000 7f7ca9abb700 1 --2- 172.21.15.26:0/722110975 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ca40f6960 0x7f7ca40f7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:17.347 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.346+0000 7f7ca9abb700 1 -- 172.21.15.26:0/722110975 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c98005040 con 0x7f7ca40f56c0 2021-11-03T16:51:17.347 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.346+0000 7f7ca92ba700 1 --2- 172.21.15.26:0/722110975 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ca40f6960 0x7f7ca40f7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T16:51:17.347 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.346+0000 7f7ca9abb700 1 --2- 172.21.15.26:0/722110975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ca40f56c0 0x7f7ca40f9820 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f7c98000c00 tx=0x7f7c98009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:17.347 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.347+0000 7f7c967fc700 1 -- 172.21.15.26:0/722110975 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c98018070 con 0x7f7ca40f56c0 2021-11-03T16:51:17.348 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.347+0000 7f7cabd1f700 1 -- 172.21.15.26:0/722110975 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca40f85c0 con 0x7f7ca40f56c0 2021-11-03T16:51:17.348 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.347+0000 7f7cabd1f700 1 -- 172.21.15.26:0/722110975 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca40f8b20 con 0x7f7ca40f56c0 2021-11-03T16:51:17.348 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.347+0000 7f7c967fc700 1 -- 172.21.15.26:0/722110975 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f7c98013410 con 0x7f7ca40f56c0 2021-11-03T16:51:17.348 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.347+0000 7f7c967fc700 1 -- 172.21.15.26:0/722110975 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c9801c620 con 0x7f7ca40f56c0 2021-11-03T16:51:17.350 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.347+0000 7f7cabd1f700 1 -- 172.21.15.26:0/722110975 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7ca405dd30 con 0x7f7ca40f56c0 2021-11-03T16:51:17.350 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.348+0000 7f7c967fc700 1 -- 172.21.15.26:0/722110975 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f7c9801d940 con 0x7f7ca40f56c0 2021-11-03T16:51:17.350 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.348+0000 7f7c967fc700 1 --2- 172.21.15.26:0/722110975 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f7c9005c2a0 0x7f7c9005e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:17.351 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.348+0000 7f7c967fc700 1 -- 172.21.15.26:0/722110975 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f7c98077b30 con 0x7f7ca40f56c0 2021-11-03T16:51:17.351 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.348+0000 7f7ca92ba700 1 --2- 172.21.15.26:0/722110975 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f7c9005c2a0 0x7f7c9005e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:17.351 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.348+0000 7f7c967fc700 1 --2- 172.21.15.26:0/722110975 >> [v2:172.21.15.26:6802/134495914,v1:172.21.15.26:6803/134495914] conn(0x7f7c90061fc0 0x7f7c90064400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:17.351 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.348+0000 7f7c967fc700 1 -- 172.21.15.26:0/722110975 --> [v2:172.21.15.26:6802/134495914,v1:172.21.15.26:6803/134495914] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7c90064a80 con 0x7f7c90061fc0 2021-11-03T16:51:17.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.348+0000 7f7c967fc700 1 -- 172.21.15.26:0/722110975 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c9807c1c0 con 0x7f7ca40f56c0 2021-11-03T16:51:17.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.349+0000 7f7caa2bc700 1 --2- 172.21.15.26:0/722110975 >> [v2:172.21.15.26:6802/134495914,v1:172.21.15.26:6803/134495914] conn(0x7f7c90061fc0 0x7f7c90064400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:17.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.349+0000 7f7ca92ba700 1 --2- 172.21.15.26:0/722110975 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f7c9005c2a0 0x7f7c9005e760 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f7ca0004ac0 tx=0x7f7ca0009040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:17.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.349+0000 7f7caa2bc700 1 --2- 172.21.15.26:0/722110975 >> [v2:172.21.15.26:6802/134495914,v1:172.21.15.26:6803/134495914] conn(0x7f7c90061fc0 0x7f7c90064400 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:17.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.349+0000 7f7c967fc700 1 -- 172.21.15.26:0/722110975 <== osd.0 v2:172.21.15.26:6802/134495914 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f7c90064a80 con 0x7f7c90061fc0 2021-11-03T16:51:17.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.364+0000 7f7cabd1f700 1 -- 172.21.15.26:0/722110975 --> [v2:172.21.15.26:6802/134495914,v1:172.21.15.26:6803/134495914] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7ca40fb060 con 0x7f7c90061fc0 2021-11-03T16:51:17.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.364+0000 7f7c967fc700 1 -- 172.21.15.26:0/722110975 <== osd.0 v2:172.21.15.26:6802/134495914 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7ca40fb060 con 0x7f7c90061fc0 2021-11-03T16:51:17.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.364+0000 7f7cabd1f700 1 -- 172.21.15.26:0/722110975 >> [v2:172.21.15.26:6802/134495914,v1:172.21.15.26:6803/134495914] conn(0x7f7c90061fc0 msgr2=0x7f7c90064400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:17.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.364+0000 7f7cabd1f700 1 --2- 172.21.15.26:0/722110975 >> [v2:172.21.15.26:6802/134495914,v1:172.21.15.26:6803/134495914] conn(0x7f7c90061fc0 0x7f7c90064400 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:17.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.364+0000 7f7cabd1f700 1 -- 172.21.15.26:0/722110975 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f7c9005c2a0 msgr2=0x7f7c9005e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:17.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.364+0000 7f7cabd1f700 1 --2- 172.21.15.26:0/722110975 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f7c9005c2a0 0x7f7c9005e760 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f7ca0004ac0 tx=0x7f7ca0009040).stop 2021-11-03T16:51:17.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.364+0000 7f7cabd1f700 1 -- 172.21.15.26:0/722110975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ca40f56c0 msgr2=0x7f7ca40f9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:17.367 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.364+0000 7f7cabd1f700 1 --2- 172.21.15.26:0/722110975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ca40f56c0 0x7f7ca40f9820 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f7c98000c00 tx=0x7f7c98009b30).stop 2021-11-03T16:51:17.367 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.364+0000 7f7cabd1f700 1 -- 172.21.15.26:0/722110975 shutdown_connections 2021-11-03T16:51:17.367 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.364+0000 7f7cabd1f700 1 --2- 172.21.15.26:0/722110975 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f7c9005c2a0 0x7f7c9005e760 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:17.367 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.364+0000 7f7cabd1f700 1 --2- 172.21.15.26:0/722110975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ca40f56c0 0x7f7ca40f9820 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:17.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.364+0000 7f7cabd1f700 1 --2- 172.21.15.26:0/722110975 >> [v2:172.21.15.26:6802/134495914,v1:172.21.15.26:6803/134495914] conn(0x7f7c90061fc0 0x7f7c90064400 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:17.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.364+0000 7f7cabd1f700 1 --2- 172.21.15.26:0/722110975 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ca40f6960 0x7f7ca40f7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:17.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.364+0000 7f7cabd1f700 1 -- 172.21.15.26:0/722110975 >> 172.21.15.26:0/722110975 conn(0x7f7ca40f0e20 msgr2=0x7f7ca40603a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:51:17.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.365+0000 7f7cabd1f700 1 -- 172.21.15.26:0/722110975 shutdown_connections 2021-11-03T16:51:17.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:17.365+0000 7f7cabd1f700 1 -- 172.21.15.26:0/722110975 wait complete. 2021-11-03T16:51:18.100 INFO:teuthology.orchestra.run.smithi026.stdout:38654705690 2021-11-03T16:51:18.101 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph tell osd.1 flush_pg_stats 2021-11-03T16:51:18.390 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c/mon.smithi026/config 2021-11-03T16:51:18.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:18 smithi026 conmon[32119]: cluster 2021-11-03T16:51:17.020796+0000 mgr.smithi026.cnrxli (mgr.14162) 182 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:18.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:18 smithi194 conmon[35111]: cluster 2021-11-03T16:51:17.020796+0000 mgr.smithi026.cnrxli (mgr.14162) 182 : cluster 2021-11-03T16:51:18.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:18 smithi194 conmon[35111]: [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:20.147 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.152+0000 7fd3022c6700 1 -- 172.21.15.26:0/3891382656 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2fc060870 msgr2=0x7fd2fc0f71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:20.148 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.152+0000 7fd3022c6700 1 --2- 172.21.15.26:0/3891382656 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2fc060870 0x7fd2fc0f71b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fd2e4004660 tx=0x7fd2e4009b30).stop 2021-11-03T16:51:20.148 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.152+0000 7fd3022c6700 1 -- 172.21.15.26:0/3891382656 shutdown_connections 2021-11-03T16:51:20.148 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.152+0000 7fd3022c6700 1 --2- 172.21.15.26:0/3891382656 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2fc0f7730 0x7fd2fc0f9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:20.148 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.152+0000 7fd3022c6700 1 --2- 172.21.15.26:0/3891382656 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2fc060870 0x7fd2fc0f71b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:20.149 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.152+0000 7fd3022c6700 1 -- 172.21.15.26:0/3891382656 >> 172.21.15.26:0/3891382656 conn(0x7fd2fc0f0e20 msgr2=0x7fd2fc0f3260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:51:20.149 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.152+0000 7fd3022c6700 1 -- 172.21.15.26:0/3891382656 shutdown_connections 2021-11-03T16:51:20.149 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.152+0000 7fd3022c6700 1 -- 172.21.15.26:0/3891382656 wait complete. 2021-11-03T16:51:20.149 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.152+0000 7fd3022c6700 1 Processor -- start 2021-11-03T16:51:20.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.153+0000 7fd3022c6700 1 -- start start 2021-11-03T16:51:20.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.153+0000 7fd3022c6700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2fc060870 0x7fd2fc10d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:20.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.153+0000 7fd3022c6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2fc0f7730 0x7fd2fc10db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:20.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.153+0000 7fd3022c6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc10e120 con 0x7fd2fc0f7730 2021-11-03T16:51:20.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.153+0000 7fd3022c6700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc10e260 con 0x7fd2fc060870 2021-11-03T16:51:20.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.153+0000 7fd2fb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2fc0f7730 0x7fd2fc10db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:20.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.153+0000 7fd2fb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2fc0f7730 0x7fd2fc10db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49854/0 (socket says 172.21.15.26:49854) 2021-11-03T16:51:20.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.153+0000 7fd2fb7fe700 1 -- 172.21.15.26:0/2918947970 learned_addr learned my addr 172.21.15.26:0/2918947970 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:51:20.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.153+0000 7fd2fbfff700 1 --2- 172.21.15.26:0/2918947970 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2fc060870 0x7fd2fc10d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:20.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.153+0000 7fd2fb7fe700 1 -- 172.21.15.26:0/2918947970 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2fc060870 msgr2=0x7fd2fc10d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:20.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.153+0000 7fd2fb7fe700 1 --2- 172.21.15.26:0/2918947970 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2fc060870 0x7fd2fc10d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:20.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.153+0000 7fd2fb7fe700 1 -- 172.21.15.26:0/2918947970 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e4005040 con 0x7fd2fc0f7730 2021-11-03T16:51:20.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.153+0000 7fd2fb7fe700 1 --2- 172.21.15.26:0/2918947970 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2fc0f7730 0x7fd2fc10db70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fd2ec00c530 tx=0x7fd2ec007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:20.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.153+0000 7fd2f8ff9700 1 -- 172.21.15.26:0/2918947970 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2ec00f650 con 0x7fd2fc0f7730 2021-11-03T16:51:20.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.153+0000 7fd3022c6700 1 -- 172.21.15.26:0/2918947970 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2fc10ec00 con 0x7fd2fc0f7730 2021-11-03T16:51:20.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.153+0000 7fd2f8ff9700 1 -- 172.21.15.26:0/2918947970 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fd2ec00fc40 con 0x7fd2fc0f7730 2021-11-03T16:51:20.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.153+0000 7fd2f8ff9700 1 -- 172.21.15.26:0/2918947970 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2ec012b90 con 0x7fd2fc0f7730 2021-11-03T16:51:20.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.153+0000 7fd3022c6700 1 -- 172.21.15.26:0/2918947970 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2fc10f1c0 con 0x7fd2fc0f7730 2021-11-03T16:51:20.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.154+0000 7fd3022c6700 1 -- 172.21.15.26:0/2918947970 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd2fc05dcf0 con 0x7fd2fc0f7730 2021-11-03T16:51:20.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.155+0000 7fd2f8ff9700 1 -- 172.21.15.26:0/2918947970 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fd2ec022070 con 0x7fd2fc0f7730 2021-11-03T16:51:20.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.155+0000 7fd2f8ff9700 1 --2- 172.21.15.26:0/2918947970 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fd2e805c2a0 0x7fd2e805e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:20.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.155+0000 7fd2f8ff9700 1 -- 172.21.15.26:0/2918947970 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7fd2ec0763f0 con 0x7fd2fc0f7730 2021-11-03T16:51:20.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.155+0000 7fd2fbfff700 1 --2- 172.21.15.26:0/2918947970 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fd2e805c2a0 0x7fd2e805e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:20.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.155+0000 7fd2f8ff9700 1 --2- 172.21.15.26:0/2918947970 >> [v2:172.21.15.26:6810/2411537943,v1:172.21.15.26:6811/2411537943] conn(0x7fd2e8061fc0 0x7fd2e8064400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:20.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.155+0000 7fd2f8ff9700 1 -- 172.21.15.26:0/2918947970 --> [v2:172.21.15.26:6810/2411537943,v1:172.21.15.26:6811/2411537943] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd2e8064a80 con 0x7fd2e8061fc0 2021-11-03T16:51:20.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.155+0000 7fd2f8ff9700 1 -- 172.21.15.26:0/2918947970 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2ec0767f0 con 0x7fd2fc0f7730 2021-11-03T16:51:20.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.155+0000 7fd300863700 1 --2- 172.21.15.26:0/2918947970 >> [v2:172.21.15.26:6810/2411537943,v1:172.21.15.26:6811/2411537943] conn(0x7fd2e8061fc0 0x7fd2e8064400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:20.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.156+0000 7fd2fbfff700 1 --2- 172.21.15.26:0/2918947970 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fd2e805c2a0 0x7fd2e805e760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fd2e4005010 tx=0x7fd2e4009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:20.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.156+0000 7fd300863700 1 --2- 172.21.15.26:0/2918947970 >> [v2:172.21.15.26:6810/2411537943,v1:172.21.15.26:6811/2411537943] conn(0x7fd2e8061fc0 0x7fd2e8064400 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:20.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.156+0000 7fd2f8ff9700 1 -- 172.21.15.26:0/2918947970 <== osd.1 v2:172.21.15.26:6810/2411537943 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fd2e8064a80 con 0x7fd2e8061fc0 2021-11-03T16:51:20.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.171+0000 7fd3022c6700 1 -- 172.21.15.26:0/2918947970 --> [v2:172.21.15.26:6810/2411537943,v1:172.21.15.26:6811/2411537943] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd2fc10f620 con 0x7fd2e8061fc0 2021-11-03T16:51:20.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.171+0000 7fd2f8ff9700 1 -- 172.21.15.26:0/2918947970 <== osd.1 v2:172.21.15.26:6810/2411537943 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd2fc10f620 con 0x7fd2e8061fc0 2021-11-03T16:51:20.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.171+0000 7fd3022c6700 1 -- 172.21.15.26:0/2918947970 >> [v2:172.21.15.26:6810/2411537943,v1:172.21.15.26:6811/2411537943] conn(0x7fd2e8061fc0 msgr2=0x7fd2e8064400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:20.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.171+0000 7fd3022c6700 1 --2- 172.21.15.26:0/2918947970 >> [v2:172.21.15.26:6810/2411537943,v1:172.21.15.26:6811/2411537943] conn(0x7fd2e8061fc0 0x7fd2e8064400 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:20.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.171+0000 7fd3022c6700 1 -- 172.21.15.26:0/2918947970 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fd2e805c2a0 msgr2=0x7fd2e805e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:20.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.171+0000 7fd3022c6700 1 --2- 172.21.15.26:0/2918947970 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fd2e805c2a0 0x7fd2e805e760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fd2e4005010 tx=0x7fd2e4009b30).stop 2021-11-03T16:51:20.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.171+0000 7fd3022c6700 1 -- 172.21.15.26:0/2918947970 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2fc0f7730 msgr2=0x7fd2fc10db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:20.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.171+0000 7fd3022c6700 1 --2- 172.21.15.26:0/2918947970 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2fc0f7730 0x7fd2fc10db70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fd2ec00c530 tx=0x7fd2ec007e20).stop 2021-11-03T16:51:20.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.172+0000 7fd3022c6700 1 -- 172.21.15.26:0/2918947970 shutdown_connections 2021-11-03T16:51:20.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.172+0000 7fd3022c6700 1 --2- 172.21.15.26:0/2918947970 >> [v2:172.21.15.26:6810/2411537943,v1:172.21.15.26:6811/2411537943] conn(0x7fd2e8061fc0 0x7fd2e8064400 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:20.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.172+0000 7fd3022c6700 1 --2- 172.21.15.26:0/2918947970 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fd2e805c2a0 0x7fd2e805e760 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:20.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.172+0000 7fd3022c6700 1 --2- 172.21.15.26:0/2918947970 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2fc060870 0x7fd2fc10d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:20.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.172+0000 7fd3022c6700 1 --2- 172.21.15.26:0/2918947970 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2fc0f7730 0x7fd2fc10db70 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:20.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.172+0000 7fd3022c6700 1 -- 172.21.15.26:0/2918947970 >> 172.21.15.26:0/2918947970 conn(0x7fd2fc0f0e20 msgr2=0x7fd2fc0f3260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:51:20.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.172+0000 7fd3022c6700 1 -- 172.21.15.26:0/2918947970 shutdown_connections 2021-11-03T16:51:20.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:20.172+0000 7fd3022c6700 1 -- 172.21.15.26:0/2918947970 wait complete. 2021-11-03T16:51:20.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:20 smithi026 conmon[32119]: cluster 2021-11-03T16: 2021-11-03T16:51:20.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:20 smithi026 conmon[32119]: 51:19.021359+0000 mgr.smithi026.cnrxli (mgr.14162) 183 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:20.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:20 smithi194 conmon[35111]: cluster 2021-11-03T16:51:19.021359+0000 mgr.smithi026.cnrxli (mgr.14162) 183 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:20.856 INFO:teuthology.orchestra.run.smithi026.stdout:60129542168 2021-11-03T16:51:20.856 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph tell osd.2 flush_pg_stats 2021-11-03T16:51:21.145 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c/mon.smithi026/config 2021-11-03T16:51:22.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:22 smithi026 conmon[32119]: cluster 2021-11-03T16:51:21.021675+0000 mgr.smithi026.cnrxli (mgr.14162) 184 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:22.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:22 smithi194 conmon[35111]: cluster 2021-11-03T16:51:21.021675+0000 mgr.smithi026.cnrxli (mgr.14162) 184 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:22.883 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.885+0000 7f387a970700 1 -- 172.21.15.26:0/2447629607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3874060870 msgr2=0x7f38740f9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:22.883 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.885+0000 7f387a970700 1 --2- 172.21.15.26:0/2447629607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3874060870 0x7f38740f9200 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f386c004660 tx=0x7f386c009b30).stop 2021-11-03T16:51:22.883 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.885+0000 7f387a970700 1 -- 172.21.15.26:0/2447629607 shutdown_connections 2021-11-03T16:51:22.884 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.885+0000 7f387a970700 1 --2- 172.21.15.26:0/2447629607 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38740f9780 0x7f38740fbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T16:51:22.884 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.885+0000 7f387a970700 1 --2- 172.21.15.26:0/2447629607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3874060870 0x7f38740f9200 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:22.884 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.885+0000 7f387a970700 1 -- 172.21.15.26:0/2447629607 >> 172.21.15.26:0/2447629607 conn(0x7f38740f0ca0 msgr2=0x7f38740f30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:51:22.884 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.885+0000 7f387a970700 1 -- 172.21.15.26:0/2447629607 shutdown_connections 2021-11-03T16:51:22.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.885+0000 7f387a970700 1 -- 172.21.15.26:0/2447629607 wait complete. 2021-11-03T16:51:22.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.886+0000 7f387a970700 1 Processor -- start 2021-11-03T16:51:22.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.886+0000 7f387a970700 1 -- start start 2021-11-03T16:51:22.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.886+0000 7f387a970700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3874060870 0x7f3874106ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:22.886 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.886+0000 7f387a970700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38740f9780 0x7f38741073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:22.886 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.886+0000 7f387a970700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3874107a00 con 0x7f38740f9780 2021-11-03T16:51:22.886 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.886+0000 7f387a970700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38741082b0 con 0x7f3874060870 2021-11-03T16:51:22.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.886+0000 7f387916d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38740f9780 0x7f38741073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:22.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.886+0000 7f387916d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38740f9780 0x7f38741073c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49866/0 (socket says 172.21.15.26:49866) 2021-11-03T16:51:22.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.886+0000 7f387916d700 1 -- 172.21.15.26:0/3220536162 learned_addr learned my addr 172.21.15.26:0/3220536162 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:51:22.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.887+0000 7f387996e700 1 --2- 172.21.15.26:0/3220536162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3874060870 0x7f3874106ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:22.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.887+0000 7f387916d700 1 -- 172.21.15.26:0/3220536162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3874060870 msgr2=0x7f3874106ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:22.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.887+0000 7f387916d700 1 --2- 172.21.15.26:0/3220536162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3874060870 0x7f3874106ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:22.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.887+0000 7f387916d700 1 -- 172.21.15.26:0/3220536162 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f386c005040 con 0x7f38740f9780 2021-11-03T16:51:22.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.887+0000 7f387996e700 1 --2- 172.21.15.26:0/3220536162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3874060870 0x7f3874106ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T16:51:22.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.887+0000 7f387916d700 1 --2- 172.21.15.26:0/3220536162 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38740f9780 0x7f38741073c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f38680093f0 tx=0x7f3868006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:22.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.887+0000 7f38727fc700 1 -- 172.21.15.26:0/3220536162 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3868009ea0 con 0x7f38740f9780 2021-11-03T16:51:22.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.887+0000 7f38727fc700 1 -- 172.21.15.26:0/3220536162 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f3868013ad0 con 0x7f38740f9780 2021-11-03T16:51:22.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.887+0000 7f387a970700 1 -- 172.21.15.26:0/3220536162 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3874108590 con 0x7f38740f9780 2021-11-03T16:51:22.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.887+0000 7f38727fc700 1 -- 172.21.15.26:0/3220536162 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f386800da80 con 0x7f38740f9780 2021-11-03T16:51:22.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.887+0000 7f387a970700 1 -- 172.21.15.26:0/3220536162 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3874108b50 con 0x7f38740f9780 2021-11-03T16:51:22.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.888+0000 7f387a970700 1 -- 172.21.15.26:0/3220536162 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f387405db60 con 0x7f38740f9780 2021-11-03T16:51:22.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.888+0000 7f38727fc700 1 -- 172.21.15.26:0/3220536162 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f386801a060 con 0x7f38740f9780 2021-11-03T16:51:22.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.889+0000 7f38727fc700 1 --2- 172.21.15.26:0/3220536162 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f385c05c2b0 0x7f385c05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:22.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.889+0000 7f38727fc700 1 -- 172.21.15.26:0/3220536162 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f3868075c20 con 0x7f38740f9780 2021-11-03T16:51:22.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.889+0000 7f387996e700 1 --2- 172.21.15.26:0/3220536162 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f385c05c2b0 0x7f385c05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:22.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.889+0000 7f38727fc700 1 --2- 172.21.15.26:0/3220536162 >> [v2:172.21.15.26:6818/79646117,v1:172.21.15.26:6819/79646117] conn(0x7f385c061fd0 0x7f385c064410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:22.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.889+0000 7f38727fc700 1 -- 172.21.15.26:0/3220536162 --> [v2:172.21.15.26:6818/79646117,v1:172.21.15.26:6819/79646117] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f385c064a90 con 0x7f385c061fd0 2021-11-03T16:51:22.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.889+0000 7f38727fc700 1 -- 172.21.15.26:0/3220536162 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3868078290 con 0x7f38740f9780 2021-11-03T16:51:22.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.889+0000 7f387a16f700 1 --2- 172.21.15.26:0/3220536162 >> [v2:172.21.15.26:6818/79646117,v1:172.21.15.26:6819/79646117] conn(0x7f385c061fd0 0x7f385c064410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:22.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.889+0000 7f387996e700 1 --2- 172.21.15.26:0/3220536162 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f385c05c2b0 0x7f385c05e770 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f386c004e30 tx=0x7f386c009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:22.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.889+0000 7f387a16f700 1 --2- 172.21.15.26:0/3220536162 >> [v2:172.21.15.26:6818/79646117,v1:172.21.15.26:6819/79646117] conn(0x7f385c061fd0 0x7f385c064410 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:22.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.890+0000 7f38727fc700 1 -- 172.21.15.26:0/3220536162 <== osd.2 v2:172.21.15.26:6818/79646117 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f385c064a90 con 0x7f385c061fd0 2021-11-03T16:51:22.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.904+0000 7f387a970700 1 -- 172.21.15.26:0/3220536162 --> [v2:172.21.15.26:6818/79646117,v1:172.21.15.26:6819/79646117] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3874109010 con 0x7f385c061fd0 2021-11-03T16:51:22.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.905+0000 7f38727fc700 1 -- 172.21.15.26:0/3220536162 <== osd.2 v2:172.21.15.26:6818/79646117 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3874109010 con 0x7f385c061fd0 2021-11-03T16:51:22.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.905+0000 7f387a970700 1 -- 172.21.15.26:0/3220536162 >> [v2:172.21.15.26:6818/79646117,v1:172.21.15.26:6819/79646117] conn(0x7f385c061fd0 msgr2=0x7f385c064410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:22.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.905+0000 7f387a970700 1 --2- 172.21.15.26:0/3220536162 >> [v2:172.21.15.26:6818/79646117,v1:172.21.15.26:6819/79646117] conn(0x7f385c061fd0 0x7f385c064410 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:22.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.905+0000 7f387a970700 1 -- 172.21.15.26:0/3220536162 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f385c05c2b0 msgr2=0x7f385c05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:22.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.905+0000 7f387a970700 1 --2- 172.21.15.26:0/3220536162 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f385c05c2b0 0x7f385c05e770 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f386c004e30 tx=0x7f386c009b30).stop 2021-11-03T16:51:22.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.905+0000 7f387a970700 1 -- 172.21.15.26:0/3220536162 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38740f9780 msgr2=0x7f38741073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:22.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.905+0000 7f387a970700 1 --2- 172.21.15.26:0/3220536162 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38740f9780 0x7f38741073c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f38680093f0 tx=0x7f3868006ec0).stop 2021-11-03T16:51:22.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.905+0000 7f387a970700 1 -- 172.21.15.26:0/3220536162 shutdown_connections 2021-11-03T16:51:22.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.905+0000 7f387a970700 1 --2- 172.21.15.26:0/3220536162 >> [v2:172.21.15.26:6818/79646117,v1:172.21.15.26:6819/79646117] conn(0x7f385c061fd0 0x7f385c064410 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:22.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.905+0000 7f387a970700 1 --2- 172.21.15.26:0/3220536162 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f385c05c2b0 0x7f385c05e770 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:22.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.905+0000 7f387a970700 1 --2- 172.21.15.26:0/3220536162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3874060870 0x7f3874106ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:22.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.905+0000 7f387a970700 1 --2- 172.21.15.26:0/3220536162 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38740f9780 0x7f38741073c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:22.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.905+0000 7f387a970700 1 -- 172.21.15.26:0/3220536162 >> 172.21.15.26:0/3220536162 conn(0x7f38740f0ca0 msgr2=0x7f38740f3090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:51:22.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.905+0000 7f387a970700 1 -- 172.21.15.26:0/3220536162 shutdown_connections 2021-11-03T16:51:22.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:22.905+0000 7f387a970700 1 -- 172.21.15.26:0/3220536162 wait complete. 2021-11-03T16:51:23.647 INFO:teuthology.orchestra.run.smithi026.stdout:81604378643 2021-11-03T16:51:23.648 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph tell osd.3 flush_pg_stats 2021-11-03T16:51:23.938 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c/mon.smithi026/config 2021-11-03T16:51:24.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:24 smithi194 conmon[35111]: cluster 2021-11-03T16:51:23.021961+0000 mgr.smithi026.cnrxli (mgr.14162) 185 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:24.548 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:24 smithi026 conmon[32119]: cluster 2021-11-03T16:51:23.021961+0000 mgr.smithi026.cnrxli (mgr.14162) 185 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:25.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.684+0000 7fdf595f0700 1 -- 172.21.15.26:0/267527636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf540f56e0 msgr2=0x7fdf540f5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:25.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.684+0000 7fdf595f0700 1 --2- 172.21.15.26:0/267527636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf540f56e0 0x7fdf540f5b00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fdf3c004660 tx=0x7fdf3c009b30).stop 2021-11-03T16:51:25.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.684+0000 7fdf595f0700 1 -- 172.21.15.26:0/267527636 shutdown_connections 2021-11-03T16:51:25.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.684+0000 7fdf595f0700 1 --2- 172.21.15.26:0/267527636 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf540f6980 0x7fdf540f6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:25.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.684+0000 7fdf595f0700 1 --2- 172.21.15.26:0/267527636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf540f56e0 0x7fdf540f5b00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:25.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.684+0000 7fdf595f0700 1 -- 172.21.15.26:0/267527636 >> 172.21.15.26:0/267527636 conn(0x7fdf540f0e20 msgr2=0x7fdf540f3260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:51:25.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.684+0000 7fdf595f0700 1 -- 172.21.15.26:0/267527636 shutdown_connections 2021-11-03T16:51:25.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.684+0000 7fdf595f0700 1 -- 172.21.15.26:0/267527636 wait complete. 2021-11-03T16:51:25.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.685+0000 7fdf595f0700 1 Processor -- start 2021-11-03T16:51:25.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.685+0000 7fdf595f0700 1 -- start start 2021-11-03T16:51:25.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.685+0000 7fdf595f0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf540f56e0 0x7fdf54109de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:25.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.685+0000 7fdf595f0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf540f6980 0x7fdf5410c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:25.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.685+0000 7fdf595f0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf54060940 con 0x7fdf540f56e0 2021-11-03T16:51:25.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.685+0000 7fdf595f0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf54060a80 con 0x7fdf540f6980 2021-11-03T16:51:25.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.685+0000 7fdf52ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf540f56e0 0x7fdf54109de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:25.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.685+0000 7fdf52ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf540f56e0 0x7fdf54109de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49876/0 (socket says 172.21.15.26:49876) 2021-11-03T16:51:25.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.685+0000 7fdf52ffd700 1 -- 172.21.15.26:0/85474901 learned_addr learned my addr 172.21.15.26:0/85474901 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:51:25.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.685+0000 7fdf527fc700 1 --2- 172.21.15.26:0/85474901 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf540f6980 0x7fdf5410c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:25.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.685+0000 7fdf52ffd700 1 -- 172.21.15.26:0/85474901 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf540f6980 msgr2=0x7fdf5410c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:25.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.685+0000 7fdf52ffd700 1 --2- 172.21.15.26:0/85474901 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf540f6980 0x7fdf5410c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:25.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.685+0000 7fdf52ffd700 1 -- 172.21.15.26:0/85474901 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf3c005040 con 0x7fdf540f56e0 2021-11-03T16:51:25.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.686+0000 7fdf52ffd700 1 --2- 172.21.15.26:0/85474901 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf540f56e0 0x7fdf54109de0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fdf3c007a60 tx=0x7fdf3c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:25.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.686+0000 7fdf4b7fe700 1 -- 172.21.15.26:0/85474901 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf3c018070 con 0x7fdf540f56e0 2021-11-03T16:51:25.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.686+0000 7fdf4b7fe700 1 -- 172.21.15.26:0/85474901 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fdf3c013410 con 0x7fdf540f56e0 2021-11-03T16:51:25.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.686+0000 7fdf595f0700 1 -- 172.21.15.26:0/85474901 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf5410c830 con 0x7fdf540f56e0 2021-11-03T16:51:25.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.686+0000 7fdf4b7fe700 1 -- 172.21.15.26:0/85474901 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf3c01c620 con 0x7fdf540f56e0 2021-11-03T16:51:25.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.686+0000 7fdf595f0700 1 -- 172.21.15.26:0/85474901 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf5410cd90 con 0x7fdf540f56e0 2021-11-03T16:51:25.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.686+0000 7fdf595f0700 1 -- 172.21.15.26:0/85474901 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdf5405dcf0 con 0x7fdf540f56e0 2021-11-03T16:51:25.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.687+0000 7fdf4b7fe700 1 -- 172.21.15.26:0/85474901 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fdf3c01d940 con 0x7fdf540f56e0 2021-11-03T16:51:25.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.687+0000 7fdf4b7fe700 1 --2- 172.21.15.26:0/85474901 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fdf4005c2a0 0x7fdf4005e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:25.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.688+0000 7fdf4b7fe700 1 -- 172.21.15.26:0/85474901 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7fdf3c0781f0 con 0x7fdf540f56e0 2021-11-03T16:51:25.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.688+0000 7fdf527fc700 1 --2- 172.21.15.26:0/85474901 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fdf4005c2a0 0x7fdf4005e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:25.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.688+0000 7fdf4b7fe700 1 --2- 172.21.15.26:0/85474901 >> [v2:172.21.15.194:6800/2165579585,v1:172.21.15.194:6801/2165579585] conn(0x7fdf40061fc0 0x7fdf40064400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:25.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.688+0000 7fdf4b7fe700 1 -- 172.21.15.26:0/85474901 --> [v2:172.21.15.194:6800/2165579585,v1:172.21.15.194:6801/2165579585] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdf40064a80 con 0x7fdf40061fc0 2021-11-03T16:51:25.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.688+0000 7fdf4b7fe700 1 -- 172.21.15.26:0/85474901 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf3c0785f0 con 0x7fdf540f56e0 2021-11-03T16:51:25.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.688+0000 7fdf527fc700 1 --2- 172.21.15.26:0/85474901 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fdf4005c2a0 0x7fdf4005e760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fdf44007fd0 tx=0x7fdf44009040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:25.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.688+0000 7fdf537fe700 1 --2- 172.21.15.26:0/85474901 >> [v2:172.21.15.194:6800/2165579585,v1:172.21.15.194:6801/2165579585] conn(0x7fdf40061fc0 0x7fdf40064400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:25.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.688+0000 7fdf537fe700 1 --2- 172.21.15.26:0/85474901 >> [v2:172.21.15.194:6800/2165579585,v1:172.21.15.194:6801/2165579585] conn(0x7fdf40061fc0 0x7fdf40064400 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:25.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.689+0000 7fdf4b7fe700 1 -- 172.21.15.26:0/85474901 <== osd.3 v2:172.21.15.194:6800/2165579585 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fdf40064a80 con 0x7fdf40061fc0 2021-11-03T16:51:25.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.703+0000 7fdf595f0700 1 -- 172.21.15.26:0/85474901 --> [v2:172.21.15.194:6800/2165579585,v1:172.21.15.194:6801/2165579585] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdf54058150 con 0x7fdf40061fc0 2021-11-03T16:51:25.699 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.704+0000 7fdf4b7fe700 1 -- 172.21.15.26:0/85474901 <== osd.3 v2:172.21.15.194:6800/2165579585 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fdf54058150 con 0x7fdf40061fc0 2021-11-03T16:51:25.700 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.705+0000 7fdf595f0700 1 -- 172.21.15.26:0/85474901 >> [v2:172.21.15.194:6800/2165579585,v1:172.21.15.194:6801/2165579585] conn(0x7fdf40061fc0 msgr2=0x7fdf40064400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:25.701 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.705+0000 7fdf595f0700 1 --2- 172.21.15.26:0/85474901 >> [v2:172.21.15.194:6800/2165579585,v1:172.21.15.194:6801/2165579585] conn(0x7fdf40061fc0 0x7fdf40064400 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:25.701 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.705+0000 7fdf595f0700 1 -- 172.21.15.26:0/85474901 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fdf4005c2a0 msgr2=0x7fdf4005e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:25.701 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.705+0000 7fdf595f0700 1 --2- 172.21.15.26:0/85474901 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fdf4005c2a0 0x7fdf4005e760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fdf44007fd0 tx=0x7fdf44009040).stop 2021-11-03T16:51:25.702 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.705+0000 7fdf595f0700 1 -- 172.21.15.26:0/85474901 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf540f56e0 msgr2=0x7fdf54109de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:25.702 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.705+0000 7fdf595f0700 1 --2- 172.21.15.26:0/85474901 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf540f56e0 0x7fdf54109de0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fdf3c007a60 tx=0x7fdf3c009b30).stop 2021-11-03T16:51:25.702 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.705+0000 7fdf595f0700 1 -- 172.21.15.26:0/85474901 shutdown_connections 2021-11-03T16:51:25.702 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.705+0000 7fdf595f0700 1 --2- 172.21.15.26:0/85474901 >> [v2:172.21.15.194:6800/2165579585,v1:172.21.15.194:6801/2165579585] conn(0x7fdf40061fc0 0x7fdf40064400 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:25.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.705+0000 7fdf595f0700 1 --2- 172.21.15.26:0/85474901 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fdf4005c2a0 0x7fdf4005e760 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:25.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.705+0000 7fdf595f0700 1 --2- 172.21.15.26:0/85474901 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf540f56e0 0x7fdf54109de0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:25.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.705+0000 7fdf595f0700 1 --2- 172.21.15.26:0/85474901 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf540f6980 0x7fdf5410c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:25.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.705+0000 7fdf595f0700 1 -- 172.21.15.26:0/85474901 >> 172.21.15.26:0/85474901 conn(0x7fdf540f0e20 msgr2=0x7fdf540fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:51:25.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.705+0000 7fdf595f0700 1 -- 172.21.15.26:0/85474901 shutdown_connections 2021-11-03T16:51:25.704 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:25.705+0000 7fdf595f0700 1 -- 172.21.15.26:0/85474901 wait complete. 2021-11-03T16:51:26.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:26 smithi026 conmon[32119]: cluster 2021-11-03T16:51:25.022446+0000 mgr.smithi026.cnrxli (mgr.14162) 186 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:26.437 INFO:teuthology.orchestra.run.smithi026.stdout:111669149712 2021-11-03T16:51:26.437 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph tell osd.4 flush_pg_stats 2021-11-03T16:51:26.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:26 smithi194 conmon[35111]: cluster 2021-11-03T16:51:25.022446+0000 mgr.smithi026.cnrxli (mgr.14162) 186 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:26.725 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c/mon.smithi026/config 2021-11-03T16:51:28.298 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:28 smithi026 conmon[32119]: cluster 2021-11-03T16:51:27.023081+0000 mgr.smithi026.cnrxli (mgr.14162) 187 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:28.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.435+0000 7f68954a7700 1 -- 172.21.15.26:0/700066030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68900f56e0 msgr2=0x7f68900f5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:28.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.435+0000 7f68954a7700 1 --2- 172.21.15.26:0/700066030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68900f56e0 0x7f68900f5b00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f6880004660 tx=0x7f6880009b30).stop 2021-11-03T16:51:28.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.435+0000 7f68954a7700 1 -- 172.21.15.26:0/700066030 shutdown_connections 2021-11-03T16:51:28.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.435+0000 7f68954a7700 1 --2- 172.21.15.26:0/700066030 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68900f6980 0x7f68900f6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:28.432 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.435+0000 7f68954a7700 1 --2- 172.21.15.26:0/700066030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68900f56e0 0x7f68900f5b00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:28.432 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.435+0000 7f68954a7700 1 -- 172.21.15.26:0/700066030 >> 172.21.15.26:0/700066030 conn(0x7f68900f0e20 msgr2=0x7f68900f3260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:51:28.432 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.435+0000 7f68954a7700 1 -- 172.21.15.26:0/700066030 shutdown_connections 2021-11-03T16:51:28.432 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.435+0000 7f68954a7700 1 -- 172.21.15.26:0/700066030 wait complete. 2021-11-03T16:51:28.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.435+0000 7f68954a7700 1 Processor -- start 2021-11-03T16:51:28.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.435+0000 7f68954a7700 1 -- start start 2021-11-03T16:51:28.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.436+0000 7f68954a7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68900f56e0 0x7f6890105fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:28.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.436+0000 7f68954a7700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68900f6980 0x7f68901064d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:28.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.436+0000 7f68954a7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6890106a80 con 0x7f68900f56e0 2021-11-03T16:51:28.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.436+0000 7f68954a7700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6890106bc0 con 0x7f68900f6980 2021-11-03T16:51:28.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.436+0000 7f688effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68900f56e0 0x7f6890105fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:28.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.436+0000 7f688effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68900f56e0 0x7f6890105fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49888/0 (socket says 172.21.15.26:49888) 2021-11-03T16:51:28.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.436+0000 7f688effd700 1 -- 172.21.15.26:0/747344733 learned_addr learned my addr 172.21.15.26:0/747344733 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:51:28.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.436+0000 7f688e7fc700 1 --2- 172.21.15.26:0/747344733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68900f6980 0x7f68901064d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:28.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.436+0000 7f688effd700 1 -- 172.21.15.26:0/747344733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68900f6980 msgr2=0x7f68901064d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:28.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.436+0000 7f688effd700 1 --2- 172.21.15.26:0/747344733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68900f6980 0x7f68901064d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:28.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.436+0000 7f688effd700 1 -- 172.21.15.26:0/747344733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6880005040 con 0x7f68900f56e0 2021-11-03T16:51:28.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.436+0000 7f688effd700 1 --2- 172.21.15.26:0/747344733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68900f56e0 0x7f6890105fe0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f6880004e30 tx=0x7f6880009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:28.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.436+0000 7f68777fe700 1 -- 172.21.15.26:0/747344733 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6880018070 con 0x7f68900f56e0 2021-11-03T16:51:28.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.436+0000 7f68954a7700 1 -- 172.21.15.26:0/747344733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6890107500 con 0x7f68900f56e0 2021-11-03T16:51:28.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.436+0000 7f68777fe700 1 -- 172.21.15.26:0/747344733 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f6880013410 con 0x7f68900f56e0 2021-11-03T16:51:28.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.436+0000 7f68777fe700 1 -- 172.21.15.26:0/747344733 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f688001c3c0 con 0x7f68900f56e0 2021-11-03T16:51:28.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.436+0000 7f68954a7700 1 -- 172.21.15.26:0/747344733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6890107a60 con 0x7f68900f56e0 2021-11-03T16:51:28.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.437+0000 7f68954a7700 1 -- 172.21.15.26:0/747344733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f689005dcf0 con 0x7f68900f56e0 2021-11-03T16:51:28.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.438+0000 7f68777fe700 1 -- 172.21.15.26:0/747344733 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f688001d420 con 0x7f68900f56e0 2021-11-03T16:51:28.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.438+0000 7f68777fe700 1 --2- 172.21.15.26:0/747344733 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f687805c2a0 0x7f687805e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:28.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.438+0000 7f68777fe700 1 -- 172.21.15.26:0/747344733 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f68800777e0 con 0x7f68900f56e0 2021-11-03T16:51:28.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.438+0000 7f688e7fc700 1 --2- 172.21.15.26:0/747344733 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f687805c2a0 0x7f687805e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:28.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.438+0000 7f68777fe700 1 --2- 172.21.15.26:0/747344733 >> [v2:172.21.15.194:6808/3847943561,v1:172.21.15.194:6809/3847943561] conn(0x7f6878061fc0 0x7f6878064400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:28.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.438+0000 7f68777fe700 1 -- 172.21.15.26:0/747344733 --> [v2:172.21.15.194:6808/3847943561,v1:172.21.15.194:6809/3847943561] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6878064a80 con 0x7f6878061fc0 2021-11-03T16:51:28.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.438+0000 7f68777fe700 1 -- 172.21.15.26:0/747344733 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f688007c220 con 0x7f68900f56e0 2021-11-03T16:51:28.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.438+0000 7f688e7fc700 1 --2- 172.21.15.26:0/747344733 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f687805c2a0 0x7f687805e760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f6884004c40 tx=0x7f688400b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:28.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.439+0000 7f688f7fe700 1 --2- 172.21.15.26:0/747344733 >> [v2:172.21.15.194:6808/3847943561,v1:172.21.15.194:6809/3847943561] conn(0x7f6878061fc0 0x7f6878064400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:28.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.439+0000 7f688f7fe700 1 --2- 172.21.15.26:0/747344733 >> [v2:172.21.15.194:6808/3847943561,v1:172.21.15.194:6809/3847943561] conn(0x7f6878061fc0 0x7f6878064400 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:28.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.440+0000 7f68777fe700 1 -- 172.21.15.26:0/747344733 <== osd.4 v2:172.21.15.194:6808/3847943561 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f6878064a80 con 0x7f6878061fc0 2021-11-03T16:51:28.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.454+0000 7f68954a7700 1 -- 172.21.15.26:0/747344733 --> [v2:172.21.15.194:6808/3847943561,v1:172.21.15.194:6809/3847943561] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6890107f40 con 0x7f6878061fc0 2021-11-03T16:51:28.450 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.454+0000 7f68777fe700 1 -- 172.21.15.26:0/747344733 <== osd.4 v2:172.21.15.194:6808/3847943561 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f6890107f40 con 0x7f6878061fc0 2021-11-03T16:51:28.451 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.455+0000 7f68954a7700 1 -- 172.21.15.26:0/747344733 >> [v2:172.21.15.194:6808/3847943561,v1:172.21.15.194:6809/3847943561] conn(0x7f6878061fc0 msgr2=0x7f6878064400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:28.451 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.455+0000 7f68954a7700 1 --2- 172.21.15.26:0/747344733 >> [v2:172.21.15.194:6808/3847943561,v1:172.21.15.194:6809/3847943561] conn(0x7f6878061fc0 0x7f6878064400 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:28.451 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.455+0000 7f68954a7700 1 -- 172.21.15.26:0/747344733 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f687805c2a0 msgr2=0x7f687805e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:28.452 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.455+0000 7f68954a7700 1 --2- 172.21.15.26:0/747344733 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f687805c2a0 0x7f687805e760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f6884004c40 tx=0x7f688400b040).stop 2021-11-03T16:51:28.452 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.455+0000 7f68954a7700 1 -- 172.21.15.26:0/747344733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68900f56e0 msgr2=0x7f6890105fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:28.452 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.455+0000 7f68954a7700 1 --2- 172.21.15.26:0/747344733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68900f56e0 0x7f6890105fe0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f6880004e30 tx=0x7f6880009b30).stop 2021-11-03T16:51:28.452 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.455+0000 7f68954a7700 1 -- 172.21.15.26:0/747344733 shutdown_connections 2021-11-03T16:51:28.453 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.455+0000 7f68954a7700 1 --2- 172.21.15.26:0/747344733 >> [v2:172.21.15.194:6808/3847943561,v1:172.21.15.194:6809/3847943561] conn(0x7f6878061fc0 0x7f6878064400 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:28.453 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.455+0000 7f68954a7700 1 --2- 172.21.15.26:0/747344733 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f687805c2a0 0x7f687805e760 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:28.453 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.455+0000 7f68954a7700 1 --2- 172.21.15.26:0/747344733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68900f56e0 0x7f6890105fe0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:28.453 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.455+0000 7f68954a7700 1 --2- 172.21.15.26:0/747344733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68900f6980 0x7f68901064d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:28.454 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.455+0000 7f68954a7700 1 -- 172.21.15.26:0/747344733 >> 172.21.15.26:0/747344733 conn(0x7f68900f0e20 msgr2=0x7f68900fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:51:28.454 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.455+0000 7f68954a7700 1 -- 172.21.15.26:0/747344733 shutdown_connections 2021-11-03T16:51:28.454 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:28.455+0000 7f68954a7700 1 -- 172.21.15.26:0/747344733 wait complete. 2021-11-03T16:51:28.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:28 smithi194 conmon[35111]: cluster 2021-11-03T16:51:27.023081+0000 mgr.smithi026.cnrxli (mgr.14162) 187 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:29.060 INFO:teuthology.orchestra.run.smithi026.stdout:133143986189 2021-11-03T16:51:29.061 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph tell osd.5 flush_pg_stats 2021-11-03T16:51:29.353 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c/mon.smithi026/config 2021-11-03T16:51:30.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:30 smithi194 conmon[35111]: cluster 2021-11-03T16:51:29.023691+0000 mgr.smithi026.cnrxli (mgr.14162) 188 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:30.562 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:30 smithi026 conmon[32119]: cluster 2021-11-03T16:51:29.023691+0000 mgr.smithi026.cnrxli (mgr.14162) 188 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:31.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.069+0000 7fd6c885e700 1 -- 172.21.15.26:0/496251098 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6c40f7ce0 msgr2=0x7fd6c40f8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:31.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.069+0000 7fd6c885e700 1 --2- 172.21.15.26:0/496251098 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6c40f7ce0 0x7fd6c40f8100 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fd6b8004660 tx=0x7fd6b8009b30).stop 2021-11-03T16:51:31.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.069+0000 7fd6c885e700 1 -- 172.21.15.26:0/496251098 shutdown_connections 2021-11-03T16:51:31.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.069+0000 7fd6c885e700 1 --2- 172.21.15.26:0/496251098 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6c40f62f0 0x7fd6c40f6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:31.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.069+0000 7fd6c885e700 1 --2- 172.21.15.26:0/496251098 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6c40f7ce0 0x7fd6c40f8100 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:31.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.069+0000 7fd6c885e700 1 -- 172.21.15.26:0/496251098 >> 172.21.15.26:0/496251098 conn(0x7fd6c40f1d70 msgr2=0x7fd6c40f41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:51:31.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.069+0000 7fd6c885e700 1 -- 172.21.15.26:0/496251098 shutdown_connections 2021-11-03T16:51:31.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.069+0000 7fd6c885e700 1 -- 172.21.15.26:0/496251098 wait complete. 2021-11-03T16:51:31.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.070+0000 7fd6c885e700 1 Processor -- start 2021-11-03T16:51:31.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.070+0000 7fd6c885e700 1 -- start start 2021-11-03T16:51:31.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.070+0000 7fd6c885e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6c40f62f0 0x7fd6c4106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:31.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.070+0000 7fd6c885e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6c40f7ce0 0x7fd6c41074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:31.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.070+0000 7fd6c885e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c4107a50 con 0x7fd6c40f7ce0 2021-11-03T16:51:31.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.070+0000 7fd6c885e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c4107b90 con 0x7fd6c40f62f0 2021-11-03T16:51:31.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.070+0000 7fd6c2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6c40f7ce0 0x7fd6c41074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:31.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.070+0000 7fd6c2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6c40f7ce0 0x7fd6c41074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49902/0 (socket says 172.21.15.26:49902) 2021-11-03T16:51:31.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.070+0000 7fd6c2ffd700 1 -- 172.21.15.26:0/2085335095 learned_addr learned my addr 172.21.15.26:0/2085335095 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:51:31.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.071+0000 7fd6c37fe700 1 --2- 172.21.15.26:0/2085335095 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6c40f62f0 0x7fd6c4106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:31.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.071+0000 7fd6c2ffd700 1 -- 172.21.15.26:0/2085335095 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6c40f62f0 msgr2=0x7fd6c4106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:31.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.071+0000 7fd6c2ffd700 1 --2- 172.21.15.26:0/2085335095 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6c40f62f0 0x7fd6c4106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:31.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.071+0000 7fd6c2ffd700 1 -- 172.21.15.26:0/2085335095 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b8005040 con 0x7fd6c40f7ce0 2021-11-03T16:51:31.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.071+0000 7fd6c2ffd700 1 --2- 172.21.15.26:0/2085335095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6c40f7ce0 0x7fd6c41074a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fd6b400c530 tx=0x7fd6b4007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:31.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.071+0000 7fd6abfff700 1 -- 172.21.15.26:0/2085335095 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6b400f650 con 0x7fd6c40f7ce0 2021-11-03T16:51:31.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.071+0000 7fd6abfff700 1 -- 172.21.15.26:0/2085335095 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fd6b400fc40 con 0x7fd6c40f7ce0 2021-11-03T16:51:31.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.071+0000 7fd6c885e700 1 -- 172.21.15.26:0/2085335095 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6c4108530 con 0x7fd6c40f7ce0 2021-11-03T16:51:31.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.071+0000 7fd6abfff700 1 -- 172.21.15.26:0/2085335095 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6b4012b90 con 0x7fd6c40f7ce0 2021-11-03T16:51:31.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.071+0000 7fd6c885e700 1 -- 172.21.15.26:0/2085335095 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c4108af0 con 0x7fd6c40f7ce0 2021-11-03T16:51:31.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.072+0000 7fd6c885e700 1 -- 172.21.15.26:0/2085335095 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd6c4059100 con 0x7fd6c40f7ce0 2021-11-03T16:51:31.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.072+0000 7fd6abfff700 1 -- 172.21.15.26:0/2085335095 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fd6b4010070 con 0x7fd6c40f7ce0 2021-11-03T16:51:31.075 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.073+0000 7fd6abfff700 1 --2- 172.21.15.26:0/2085335095 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fd6ac05c2b0 0x7fd6ac05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:31.076 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.073+0000 7fd6abfff700 1 -- 172.21.15.26:0/2085335095 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7fd6b4075840 con 0x7fd6c40f7ce0 2021-11-03T16:51:31.076 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.073+0000 7fd6c37fe700 1 --2- 172.21.15.26:0/2085335095 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fd6ac05c2b0 0x7fd6ac05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:31.076 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.073+0000 7fd6abfff700 1 --2- 172.21.15.26:0/2085335095 >> [v2:172.21.15.194:6816/89262300,v1:172.21.15.194:6817/89262300] conn(0x7fd6ac061fd0 0x7fd6ac064410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:31.076 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.073+0000 7fd6abfff700 1 -- 172.21.15.26:0/2085335095 --> [v2:172.21.15.194:6816/89262300,v1:172.21.15.194:6817/89262300] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd6ac064a90 con 0x7fd6ac061fd0 2021-11-03T16:51:31.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.073+0000 7fd6abfff700 1 -- 172.21.15.26:0/2085335095 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd6b407a220 con 0x7fd6c40f7ce0 2021-11-03T16:51:31.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.073+0000 7fd6c37fe700 1 --2- 172.21.15.26:0/2085335095 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fd6ac05c2b0 0x7fd6ac05e770 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fd6b8004630 tx=0x7fd6b8009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:31.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.073+0000 7fd6c3fff700 1 --2- 172.21.15.26:0/2085335095 >> [v2:172.21.15.194:6816/89262300,v1:172.21.15.194:6817/89262300] conn(0x7fd6ac061fd0 0x7fd6ac064410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:31.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.073+0000 7fd6c3fff700 1 --2- 172.21.15.26:0/2085335095 >> [v2:172.21.15.194:6816/89262300,v1:172.21.15.194:6817/89262300] conn(0x7fd6ac061fd0 0x7fd6ac064410 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:31.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.074+0000 7fd6abfff700 1 -- 172.21.15.26:0/2085335095 <== osd.5 v2:172.21.15.194:6816/89262300 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fd6ac064a90 con 0x7fd6ac061fd0 2021-11-03T16:51:31.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.089+0000 7fd6c885e700 1 -- 172.21.15.26:0/2085335095 --> [v2:172.21.15.194:6816/89262300,v1:172.21.15.194:6817/89262300] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd6c4108f50 con 0x7fd6ac061fd0 2021-11-03T16:51:31.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.089+0000 7fd6abfff700 1 -- 172.21.15.26:0/2085335095 <== osd.5 v2:172.21.15.194:6816/89262300 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fd6c4108f50 con 0x7fd6ac061fd0 2021-11-03T16:51:31.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.089+0000 7fd6c885e700 1 -- 172.21.15.26:0/2085335095 >> [v2:172.21.15.194:6816/89262300,v1:172.21.15.194:6817/89262300] conn(0x7fd6ac061fd0 msgr2=0x7fd6ac064410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:31.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.089+0000 7fd6c885e700 1 --2- 172.21.15.26:0/2085335095 >> [v2:172.21.15.194:6816/89262300,v1:172.21.15.194:6817/89262300] conn(0x7fd6ac061fd0 0x7fd6ac064410 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:31.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.089+0000 7fd6c885e700 1 -- 172.21.15.26:0/2085335095 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fd6ac05c2b0 msgr2=0x7fd6ac05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:31.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.089+0000 7fd6c885e700 1 --2- 172.21.15.26:0/2085335095 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fd6ac05c2b0 0x7fd6ac05e770 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fd6b8004630 tx=0x7fd6b8009b30).stop 2021-11-03T16:51:31.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.090+0000 7fd6c885e700 1 -- 172.21.15.26:0/2085335095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6c40f7ce0 msgr2=0x7fd6c41074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:31.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.090+0000 7fd6c885e700 1 --2- 172.21.15.26:0/2085335095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6c40f7ce0 0x7fd6c41074a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fd6b400c530 tx=0x7fd6b4007e20).stop 2021-11-03T16:51:31.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.090+0000 7fd6c885e700 1 -- 172.21.15.26:0/2085335095 shutdown_connections 2021-11-03T16:51:31.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.090+0000 7fd6c885e700 1 --2- 172.21.15.26:0/2085335095 >> [v2:172.21.15.194:6816/89262300,v1:172.21.15.194:6817/89262300] conn(0x7fd6ac061fd0 0x7fd6ac064410 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:31.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.090+0000 7fd6c885e700 1 --2- 172.21.15.26:0/2085335095 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fd6ac05c2b0 0x7fd6ac05e770 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:31.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.090+0000 7fd6c885e700 1 --2- 172.21.15.26:0/2085335095 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6c40f62f0 0x7fd6c4106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:31.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.090+0000 7fd6c885e700 1 --2- 172.21.15.26:0/2085335095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6c40f7ce0 0x7fd6c41074a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:31.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.090+0000 7fd6c885e700 1 -- 172.21.15.26:0/2085335095 >> 172.21.15.26:0/2085335095 conn(0x7fd6c40f1d70 msgr2=0x7fd6c40fb320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:51:31.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.090+0000 7fd6c885e700 1 -- 172.21.15.26:0/2085335095 shutdown_connections 2021-11-03T16:51:31.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:31.090+0000 7fd6c885e700 1 -- 172.21.15.26:0/2085335095 wait complete. 2021-11-03T16:51:31.752 INFO:teuthology.orchestra.run.smithi026.stdout:154618822667 2021-11-03T16:51:31.816 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph osd last-stat-seq osd.0 2021-11-03T16:51:32.111 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c/mon.smithi026/config 2021-11-03T16:51:32.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:32 smithi194 conmon[35111]: cluster 2021-11-03T16:51:31.023990+0000 mgr.smithi026.cnrxli (mgr.14162) 189 : cluster [DBG] 2021-11-03T16:51:32.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:32 smithi194 conmon[35111]: pgmap v157: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:32.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:32 smithi026 conmon[32119]: cluster 2021-11-03T16:51:31.023990+0000 mgr.smithi026.cnrxli (mgr.14162) 189 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:33.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:33.943+0000 7f588499a700 1 -- 172.21.15.26:0/2602115306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58800f67e0 msgr2=0x7f58800f6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:33.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:33.943+0000 7f588499a700 1 --2- 172.21.15.26:0/2602115306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58800f67e0 0x7f58800f6c00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f5870004660 tx=0x7f5870009b30).stop 2021-11-03T16:51:33.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:33.943+0000 7f588499a700 1 -- 172.21.15.26:0/2602115306 shutdown_connections 2021-11-03T16:51:33.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:33.943+0000 7f588499a700 1 --2- 172.21.15.26:0/2602115306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58800f7a80 0x7f58800f7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:33.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:33.943+0000 7f588499a700 1 --2- 172.21.15.26:0/2602115306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58800f67e0 0x7f58800f6c00 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:33.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:33.943+0000 7f588499a700 1 -- 172.21.15.26:0/2602115306 >> 172.21.15.26:0/2602115306 conn(0x7f58800f1f20 msgr2=0x7f58800f4360 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:51:33.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:33.943+0000 7f588499a700 1 -- 172.21.15.26:0/2602115306 shutdown_connections 2021-11-03T16:51:33.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:33.943+0000 7f588499a700 1 -- 172.21.15.26:0/2602115306 wait complete. 2021-11-03T16:51:33.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:33.943+0000 7f588499a700 1 Processor -- start 2021-11-03T16:51:33.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:33.943+0000 7f588499a700 1 -- start start 2021-11-03T16:51:33.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:33.943+0000 7f588499a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58800f67e0 0x7f588006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:33.943 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:33.944+0000 7f588499a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58800f7a80 0x7f5880069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:33.943 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:33.944+0000 7f588499a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588006a380 con 0x7f58800f7a80 2021-11-03T16:51:33.943 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:33.944+0000 7f588499a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588006a4c0 con 0x7f58800f67e0 2021-11-03T16:51:33.943 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:33.944+0000 7f587dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58800f7a80 0x7f5880069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:33.943 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:33.944+0000 7f587dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58800f7a80 0x7f5880069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49914/0 (socket says 172.21.15.26:49914) 2021-11-03T16:51:33.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:33.944+0000 7f587dd9b700 1 -- 172.21.15.26:0/287580063 learned_addr learned my addr 172.21.15.26:0/287580063 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:51:33.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:33.944+0000 7f587e59c700 1 --2- 172.21.15.26:0/287580063 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58800f67e0 0x7f588006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:33.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:33.944+0000 7f587dd9b700 1 -- 172.21.15.26:0/287580063 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58800f67e0 msgr2=0x7f588006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:33.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:33.944+0000 7f587dd9b700 1 --2- 172.21.15.26:0/287580063 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58800f67e0 0x7f588006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:33.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:33.944+0000 7f587dd9b700 1 -- 172.21.15.26:0/287580063 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5870005040 con 0x7f58800f7a80 2021-11-03T16:51:33.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:33.944+0000 7f587dd9b700 1 --2- 172.21.15.26:0/287580063 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58800f7a80 0x7f5880069e20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f58740026d0 tx=0x7f5874009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:33.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:33.944+0000 7f586effd700 1 -- 172.21.15.26:0/287580063 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5874009320 con 0x7f58800f7a80 2021-11-03T16:51:33.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:33.944+0000 7f586effd700 1 -- 172.21.15.26:0/287580063 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f587400f040 con 0x7f58800f7a80 2021-11-03T16:51:33.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:33.944+0000 7f586effd700 1 -- 172.21.15.26:0/287580063 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5874014770 con 0x7f58800f7a80 2021-11-03T16:51:33.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:33.944+0000 7f588499a700 1 -- 172.21.15.26:0/287580063 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f588006a7a0 con 0x7f58800f7a80 2021-11-03T16:51:33.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:33.944+0000 7f588499a700 1 -- 172.21.15.26:0/287580063 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f588010f0e0 con 0x7f58800f7a80 2021-11-03T16:51:33.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:33.945+0000 7f588499a700 1 -- 172.21.15.26:0/287580063 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5880045ad0 con 0x7f58800f7a80 2021-11-03T16:51:33.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:33.946+0000 7f586effd700 1 -- 172.21.15.26:0/287580063 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f5874009480 con 0x7f58800f7a80 2021-11-03T16:51:33.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:33.947+0000 7f586effd700 1 --2- 172.21.15.26:0/287580063 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f586805c2a0 0x7f586805e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:33.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:33.947+0000 7f586effd700 1 -- 172.21.15.26:0/287580063 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f58740765c0 con 0x7f58800f7a80 2021-11-03T16:51:33.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:33.947+0000 7f587e59c700 1 --2- 172.21.15.26:0/287580063 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f586805c2a0 0x7f586805e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:33.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:33.947+0000 7f587e59c700 1 --2- 172.21.15.26:0/287580063 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f586805c2a0 0x7f586805e760 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f5870009d60 tx=0x7f5870009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:33.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:33.950+0000 7f586effd700 1 -- 172.21.15.26:0/287580063 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f58740495a0 con 0x7f58800f7a80 2021-11-03T16:51:34.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:34.107+0000 7f588499a700 1 -- 172.21.15.26:0/287580063 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5880027a00 con 0x7f58800f7a80 2021-11-03T16:51:34.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:34.108+0000 7f586effd700 1 -- 172.21.15.26:0/287580063 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f587404cbc0 con 0x7f58800f7a80 2021-11-03T16:51:34.104 INFO:teuthology.orchestra.run.smithi026.stdout:38654705693 2021-11-03T16:51:34.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:34.109+0000 7f588499a700 1 -- 172.21.15.26:0/287580063 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f586805c2a0 msgr2=0x7f586805e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:34.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:34.109+0000 7f588499a700 1 --2- 172.21.15.26:0/287580063 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f586805c2a0 0x7f586805e760 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f5870009d60 tx=0x7f5870009b30).stop 2021-11-03T16:51:34.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:34.109+0000 7f588499a700 1 -- 172.21.15.26:0/287580063 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58800f7a80 msgr2=0x7f5880069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:34.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:34.109+0000 7f588499a700 1 --2- 172.21.15.26:0/287580063 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58800f7a80 0x7f5880069e20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f58740026d0 tx=0x7f5874009de0).stop 2021-11-03T16:51:34.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:34.109+0000 7f588499a700 1 -- 172.21.15.26:0/287580063 shutdown_connections 2021-11-03T16:51:34.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:34.109+0000 7f588499a700 1 --2- 172.21.15.26:0/287580063 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f586805c2a0 0x7f586805e760 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:34.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:34.109+0000 7f588499a700 1 --2- 172.21.15.26:0/287580063 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58800f67e0 0x7f588006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:34.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:34.109+0000 7f588499a700 1 --2- 172.21.15.26:0/287580063 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f58800f7a80 0x7f5880069e20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:34.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:34.109+0000 7f588499a700 1 -- 172.21.15.26:0/287580063 >> 172.21.15.26:0/287580063 conn(0x7f58800f1f20 msgr2=0x7f58800fb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:51:34.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:34.109+0000 7f588499a700 1 -- 172.21.15.26:0/287580063 shutdown_connections 2021-11-03T16:51:34.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:34.110+0000 7f588499a700 1 -- 172.21.15.26:0/287580063 wait complete. 2021-11-03T16:51:34.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:34 smithi026 conmon[32119]: cluster 2021-11-03T16:51:33.024315+0000 mgr.smithi026.cnrxli (mgr.14162) 190 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:34.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:34 smithi026 conmon[32119]: audit 2021-11-03T16:51:34.108548+0000 mon.smithi026 (mon.0) 448 : audit [DBG] from='client.? 172.21.15.26:0/287580063' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-11-03T16:51:34.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:34 smithi194 conmon[35111]: cluster 2021-11-03T16:51:33.024315+0000 mgr.smithi026.cnrxli (mgr.14162) 190 : cluster 2021-11-03T16:51:34.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:34 smithi194 conmon[35111]: [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:34.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:34 smithi194 conmon[35111]: audit 2021-11-03T16:51:34.108548+0000 mon.smithi026 (mon.0) 448 : audit [DBG] from='client.? 172.21.15.26:0/287580063' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-11-03T16:51:34.888 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705690 got 38654705693 for osd.0 2021-11-03T16:51:34.889 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph osd last-stat-seq osd.1 2021-11-03T16:51:35.187 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c/mon.smithi026/config 2021-11-03T16:51:36.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:36 smithi194 conmon[35111]: cluster 2021-11-03T16:51:35.024616+0000 mgr.smithi026.cnrxli (mgr.14162) 191 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:36.536 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:36 smithi026 conmon[32119]: cluster 2021-11-03T16:51:35.024616+0000 mgr.smithi026.cnrxli (mgr 2021-11-03T16:51:36.537 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:36 smithi026 conmon[32119]: .14162) 191 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:37.032 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.035+0000 7f2b37fff700 1 -- 172.21.15.26:0/3086426804 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b380f48e0 msgr2=0x7f2b380f4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:37.032 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.035+0000 7f2b37fff700 1 --2- 172.21.15.26:0/3086426804 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b380f48e0 0x7f2b380f4d00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f2b20004660 tx=0x7f2b20009b30).stop 2021-11-03T16:51:37.033 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.035+0000 7f2b37fff700 1 -- 172.21.15.26:0/3086426804 shutdown_connections 2021-11-03T16:51:37.033 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.035+0000 7f2b37fff700 1 --2- 172.21.15.26:0/3086426804 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b380f5280 0x7f2b380f7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T16:51:37.033 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.035+0000 7f2b37fff700 1 --2- 172.21.15.26:0/3086426804 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b380f48e0 0x7f2b380f4d00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:37.033 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.035+0000 7f2b37fff700 1 -- 172.21.15.26:0/3086426804 >> 172.21.15.26:0/3086426804 conn(0x7f2b380f0400 msgr2=0x7f2b380f2820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:51:37.034 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.035+0000 7f2b37fff700 1 -- 172.21.15.26:0/3086426804 shutdown_connections 2021-11-03T16:51:37.034 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.035+0000 7f2b37fff700 1 -- 172.21.15.26:0/3086426804 wait complete. 2021-11-03T16:51:37.034 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.036+0000 7f2b37fff700 1 Processor -- start 2021-11-03T16:51:37.034 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.036+0000 7f2b37fff700 1 -- start start 2021-11-03T16:51:37.034 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.036+0000 7f2b37fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b380f48e0 0x7f2b38106f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:37.035 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.036+0000 7f2b37fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b380f5280 0x7f2b38107440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:37.035 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.036+0000 7f2b37fff700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b38107a80 con 0x7f2b380f48e0 2021-11-03T16:51:37.035 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.036+0000 7f2b37fff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b38108330 con 0x7f2b380f5280 2021-11-03T16:51:37.035 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.036+0000 7f2b36ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b380f48e0 0x7f2b38106f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:37.036 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.036+0000 7f2b36ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b380f48e0 0x7f2b38106f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49922/0 (socket says 172.21.15.26:49922) 2021-11-03T16:51:37.036 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.036+0000 7f2b36ffd700 1 -- 172.21.15.26:0/2970419480 learned_addr learned my addr 172.21.15.26:0/2970419480 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:51:37.036 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.036+0000 7f2b36ffd700 1 -- 172.21.15.26:0/2970419480 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b380f5280 msgr2=0x7f2b38107440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:37.036 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.036+0000 7f2b36ffd700 1 --2- 172.21.15.26:0/2970419480 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b380f5280 0x7f2b38107440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T16:51:37.037 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.037+0000 7f2b36ffd700 1 -- 172.21.15.26:0/2970419480 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b20005040 con 0x7f2b380f48e0 2021-11-03T16:51:37.037 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.037+0000 7f2b36ffd700 1 --2- 172.21.15.26:0/2970419480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b380f48e0 0x7f2b38106f50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f2b20007a60 tx=0x7f2b20009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:37.037 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.037+0000 7f2b2f7fe700 1 -- 172.21.15.26:0/2970419480 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b20018070 con 0x7f2b380f48e0 2021-11-03T16:51:37.037 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.037+0000 7f2b2f7fe700 1 -- 172.21.15.26:0/2970419480 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f2b20013410 con 0x7f2b380f48e0 2021-11-03T16:51:37.038 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.037+0000 7f2b37fff700 1 -- 172.21.15.26:0/2970419480 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b381085b0 con 0x7f2b380f48e0 2021-11-03T16:51:37.038 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.037+0000 7f2b2f7fe700 1 -- 172.21.15.26:0/2970419480 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b2001c620 con 0x7f2b380f48e0 2021-11-03T16:51:37.038 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.037+0000 7f2b37fff700 1 -- 172.21.15.26:0/2970419480 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b38108b10 con 0x7f2b380f48e0 2021-11-03T16:51:37.039 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.038+0000 7f2b37fff700 1 -- 172.21.15.26:0/2970419480 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b38059100 con 0x7f2b380f48e0 2021-11-03T16:51:37.039 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.038+0000 7f2b2f7fe700 1 -- 172.21.15.26:0/2970419480 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f2b2001d940 con 0x7f2b380f48e0 2021-11-03T16:51:37.040 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.038+0000 7f2b2f7fe700 1 --2- 172.21.15.26:0/2970419480 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f2b2405c2b0 0x7f2b2405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:37.040 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.038+0000 7f2b2f7fe700 1 -- 172.21.15.26:0/2970419480 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f2b20077a40 con 0x7f2b380f48e0 2021-11-03T16:51:37.040 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.038+0000 7f2b367fc700 1 --2- 172.21.15.26:0/2970419480 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f2b2405c2b0 0x7f2b2405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:37.040 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.039+0000 7f2b367fc700 1 --2- 172.21.15.26:0/2970419480 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f2b2405c2b0 0x7f2b2405e770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f2b380f56c0 tx=0x7f2b28006ab0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:37.041 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.042+0000 7f2b2f7fe700 1 -- 172.21.15.26:0/2970419480 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f2b2004aae0 con 0x7f2b380f48e0 2021-11-03T16:51:37.195 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.200+0000 7f2b37fff700 1 -- 172.21.15.26:0/2970419480 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2b380ff030 con 0x7f2b380f48e0 2021-11-03T16:51:37.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.200+0000 7f2b2f7fe700 1 -- 172.21.15.26:0/2970419480 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2b380ff030 con 0x7f2b380f48e0 2021-11-03T16:51:37.196 INFO:teuthology.orchestra.run.smithi026.stdout:60129542171 2021-11-03T16:51:37.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.202+0000 7f2b37fff700 1 -- 172.21.15.26:0/2970419480 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f2b2405c2b0 msgr2=0x7f2b2405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:37.198 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.202+0000 7f2b37fff700 1 --2- 172.21.15.26:0/2970419480 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f2b2405c2b0 0x7f2b2405e770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f2b380f56c0 tx=0x7f2b28006ab0).stop 2021-11-03T16:51:37.198 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.202+0000 7f2b37fff700 1 -- 172.21.15.26:0/2970419480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b380f48e0 msgr2=0x7f2b38106f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:37.198 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.202+0000 7f2b37fff700 1 --2- 172.21.15.26:0/2970419480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b380f48e0 0x7f2b38106f50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f2b20007a60 tx=0x7f2b20009b30).stop 2021-11-03T16:51:37.198 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.202+0000 7f2b37fff700 1 -- 172.21.15.26:0/2970419480 shutdown_connections 2021-11-03T16:51:37.199 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.202+0000 7f2b37fff700 1 --2- 172.21.15.26:0/2970419480 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f2b2405c2b0 0x7f2b2405e770 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:37.199 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.202+0000 7f2b37fff700 1 --2- 172.21.15.26:0/2970419480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b380f48e0 0x7f2b38106f50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:37.199 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.202+0000 7f2b37fff700 1 --2- 172.21.15.26:0/2970419480 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b380f5280 0x7f2b38107440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T16:51:37.199 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.202+0000 7f2b37fff700 1 -- 172.21.15.26:0/2970419480 >> 172.21.15.26:0/2970419480 conn(0x7f2b380f0400 msgr2=0x7f2b380fb450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:51:37.200 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.202+0000 7f2b37fff700 1 -- 172.21.15.26:0/2970419480 shutdown_connections 2021-11-03T16:51:37.200 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:37.202+0000 7f2b37fff700 1 -- 172.21.15.26:0/2970419480 wait complete. 2021-11-03T16:51:37.892 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542168 got 60129542171 for osd.1 2021-11-03T16:51:37.892 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph osd last-stat-seq osd.2 2021-11-03T16:51:38.183 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c/mon.smithi026/config 2021-11-03T16:51:38.456 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:38 smithi026 conmon[32119]: cluster 2021-11-03T16:51:37.024932+0000 mgr.smithi026.cnrxli (mgr.14162) 192 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:38.456 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:38 smithi026 conmon[32119]: audit 2021-11-03T16:51:37.201159+0000 mon.smithi026 (mon.0) 449 : audit [DBG] from='client.? 172.21.15.26:0/2970419480' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-11-03T16:51:38.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:38 smithi194 conmon[35111]: cluster 2021-11-03T16:51:37.024932+0000 mgr.smithi026.cnrxli (mgr.14162) 192 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:38.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:38 smithi194 conmon[35111]: audit 2021-11-03T16:51:37.201159+0000 2021-11-03T16:51:38.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:38 smithi194 conmon[35111]: mon.smithi026 (mon.0) 449 : audit [DBG] from='client.? 172.21.15.26:0/2970419480' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-11-03T16:51:39.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:39.959+0000 7f3aebaa6700 1 -- 172.21.15.26:0/3269866323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ae40f7a80 msgr2=0x7f3ae40f7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:39.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:39.959+0000 7f3aebaa6700 1 --2- 172.21.15.26:0/3269866323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ae40f7a80 0x7f3ae40f7ee0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f3ae0004660 tx=0x7f3ae0009b30).stop 2021-11-03T16:51:39.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:39.959+0000 7f3aebaa6700 1 -- 172.21.15.26:0/3269866323 shutdown_connections 2021-11-03T16:51:39.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:39.959+0000 7f3aebaa6700 1 --2- 172.21.15.26:0/3269866323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ae40f7a80 0x7f3ae40f7ee0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:39.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:39.959+0000 7f3aebaa6700 1 --2- 172.21.15.26:0/3269866323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ae40f67e0 0x7f3ae40f6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:39.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:39.959+0000 7f3aebaa6700 1 -- 172.21.15.26:0/3269866323 >> 172.21.15.26:0/3269866323 conn(0x7f3ae40f1f20 msgr2=0x7f3ae40f4360 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:51:39.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:39.960+0000 7f3aebaa6700 1 -- 172.21.15.26:0/3269866323 shutdown_connections 2021-11-03T16:51:39.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:39.960+0000 7f3aebaa6700 1 -- 172.21.15.26:0/3269866323 wait complete. 2021-11-03T16:51:39.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:39.960+0000 7f3aebaa6700 1 Processor -- start 2021-11-03T16:51:39.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:39.960+0000 7f3aebaa6700 1 -- start start 2021-11-03T16:51:39.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:39.960+0000 7f3aebaa6700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ae40f67e0 0x7f3ae406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:39.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:39.960+0000 7f3aebaa6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ae40f7a80 0x7f3ae4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:39.961 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:39.960+0000 7f3aebaa6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae406a380 con 0x7f3ae40f7a80 2021-11-03T16:51:39.961 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:39.960+0000 7f3aebaa6700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae406a4c0 con 0x7f3ae40f67e0 2021-11-03T16:51:39.962 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:39.960+0000 7f3ae9041700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ae40f7a80 0x7f3ae4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:39.962 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:39.960+0000 7f3ae9041700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ae40f7a80 0x7f3ae4069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49934/0 (socket says 172.21.15.26:49934) 2021-11-03T16:51:39.962 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:39.960+0000 7f3ae9041700 1 -- 172.21.15.26:0/2557704039 learned_addr learned my addr 172.21.15.26:0/2557704039 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:51:39.963 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:39.961+0000 7f3ae9842700 1 --2- 172.21.15.26:0/2557704039 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ae40f67e0 0x7f3ae406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:39.963 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:39.961+0000 7f3ae9041700 1 -- 172.21.15.26:0/2557704039 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ae40f67e0 msgr2=0x7f3ae406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:39.963 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:39.961+0000 7f3ae9041700 1 --2- 172.21.15.26:0/2557704039 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ae40f67e0 0x7f3ae406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:39.963 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:39.961+0000 7f3ae9041700 1 -- 172.21.15.26:0/2557704039 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae0005040 con 0x7f3ae40f7a80 2021-11-03T16:51:39.964 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:39.961+0000 7f3ae9041700 1 --2- 172.21.15.26:0/2557704039 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ae40f7a80 0x7f3ae4069e20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f3ae0000c00 tx=0x7f3ae000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:39.964 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:39.961+0000 7f3ada7fc700 1 -- 172.21.15.26:0/2557704039 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ae0019070 con 0x7f3ae40f7a80 2021-11-03T16:51:39.964 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:39.961+0000 7f3ada7fc700 1 -- 172.21.15.26:0/2557704039 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f3ae0007e50 con 0x7f3ae40f7a80 2021-11-03T16:51:39.964 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:39.961+0000 7f3ada7fc700 1 -- 172.21.15.26:0/2557704039 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ae0014d00 con 0x7f3ae40f7a80 2021-11-03T16:51:39.965 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:39.961+0000 7f3aebaa6700 1 -- 172.21.15.26:0/2557704039 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ae406a740 con 0x7f3ae40f7a80 2021-11-03T16:51:39.965 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:39.961+0000 7f3aebaa6700 1 -- 172.21.15.26:0/2557704039 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ae406aca0 con 0x7f3ae40f7a80 2021-11-03T16:51:39.965 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:39.962+0000 7f3aebaa6700 1 -- 172.21.15.26:0/2557704039 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ae4045ad0 con 0x7f3ae40f7a80 2021-11-03T16:51:39.967 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:39.962+0000 7f3ada7fc700 1 -- 172.21.15.26:0/2557704039 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f3ae0025070 con 0x7f3ae40f7a80 2021-11-03T16:51:39.967 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:39.962+0000 7f3ada7fc700 1 --2- 172.21.15.26:0/2557704039 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f3ad005c2a0 0x7f3ad005e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:39.968 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:39.963+0000 7f3ada7fc700 1 -- 172.21.15.26:0/2557704039 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f3ae0076b90 con 0x7f3ae40f7a80 2021-11-03T16:51:39.968 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:39.963+0000 7f3ae9842700 1 --2- 172.21.15.26:0/2557704039 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f3ad005c2a0 0x7f3ad005e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:39.968 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:39.963+0000 7f3ae9842700 1 --2- 172.21.15.26:0/2557704039 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f3ad005c2a0 0x7f3ad005e760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f3ae406b730 tx=0x7f3ad400b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:39.969 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:39.967+0000 7f3ada7fc700 1 -- 172.21.15.26:0/2557704039 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f3ae0049c30 con 0x7f3ae40f7a80 2021-11-03T16:51:40.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:40.125+0000 7f3aebaa6700 1 -- 172.21.15.26:0/2557704039 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3ae40ff0e0 con 0x7f3ae40f7a80 2021-11-03T16:51:40.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:40.125+0000 7f3ada7fc700 1 -- 172.21.15.26:0/2557704039 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3ae0014e60 con 0x7f3ae40f7a80 2021-11-03T16:51:40.121 INFO:teuthology.orchestra.run.smithi026.stdout:81604378646 2021-11-03T16:51:40.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:40.126+0000 7f3aebaa6700 1 -- 172.21.15.26:0/2557704039 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f3ad005c2a0 msgr2=0x7f3ad005e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:40.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:40.126+0000 7f3aebaa6700 1 --2- 172.21.15.26:0/2557704039 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f3ad005c2a0 0x7f3ad005e760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f3ae406b730 tx=0x7f3ad400b040).stop 2021-11-03T16:51:40.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:40.126+0000 7f3aebaa6700 1 -- 172.21.15.26:0/2557704039 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ae40f7a80 msgr2=0x7f3ae4069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:40.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:40.126+0000 7f3aebaa6700 1 --2- 172.21.15.26:0/2557704039 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ae40f7a80 0x7f3ae4069e20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f3ae0000c00 tx=0x7f3ae000b040).stop 2021-11-03T16:51:40.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:40.126+0000 7f3aebaa6700 1 -- 172.21.15.26:0/2557704039 shutdown_connections 2021-11-03T16:51:40.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:40.126+0000 7f3aebaa6700 1 --2- 172.21.15.26:0/2557704039 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f3ad005c2a0 0x7f3ad005e760 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:40.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:40.126+0000 7f3aebaa6700 1 --2- 172.21.15.26:0/2557704039 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ae40f67e0 0x7f3ae406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:40.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:40.126+0000 7f3aebaa6700 1 --2- 172.21.15.26:0/2557704039 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ae40f7a80 0x7f3ae4069e20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:40.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:40.126+0000 7f3aebaa6700 1 -- 172.21.15.26:0/2557704039 >> 172.21.15.26:0/2557704039 conn(0x7f3ae40f1f20 msgr2=0x7f3ae40fb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:51:40.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:40.127+0000 7f3aebaa6700 1 -- 172.21.15.26:0/2557704039 shutdown_connections 2021-11-03T16:51:40.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:40.127+0000 7f3aebaa6700 1 -- 172.21.15.26:0/2557704039 wait complete. 2021-11-03T16:51:40.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:40 smithi026 conmon[32119]: cluster 2021-11-03T16:51:39.025235+0000 mgr.smithi026.cnrxli (mgr.14162) 193 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:40.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:40 smithi026 conmon[32119]: audit 2021-11-03T16:51:40.125805+0000 mon.smithi026 (mon.0) 450 : audit [DBG] from='client.? 172.21.15.26:0/2557704039' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-11-03T16:51:40.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:40 smithi194 conmon[35111]: cluster 2021-11-03T16:51:39.025235+0000 mgr.smithi026.cnrxli (mgr.14162) 193 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:40.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:40 smithi194 conmon[35111]: audit 2021-11- 2021-11-03T16:51:40.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:40 smithi194 conmon[35111]: 03T16:51:40.125805+0000 mon.smithi026 (mon.0) 450 : audit [DBG] from='client.? 172.21.15.26:0/2557704039' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-11-03T16:51:40.868 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378643 got 81604378646 for osd.2 2021-11-03T16:51:40.869 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph osd last-stat-seq osd.3 2021-11-03T16:51:41.160 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c/mon.smithi026/config 2021-11-03T16:51:42.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:42 smithi194 conmon[35111]: cluster 2021-11-03T16:51:41.025542+0000 mgr.smithi026.cnrxli (mgr.14162) 194 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:42.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:42 smithi026 conmon[32119]: cluster 2021-11-03T16:51:41.025542+0000 mgr.smithi026.cnrxli 2021-11-03T16:51:42.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:42 smithi026 conmon[32119]: (mgr.14162) 194 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:42.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:42.907+0000 7f36f7fff700 1 -- 172.21.15.26:0/2584523594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36f80f6af0 msgr2=0x7f36f80f6f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:42.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:42.907+0000 7f36f7fff700 1 --2- 172.21.15.26:0/2584523594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36f80f6af0 0x7f36f80f6f10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f36e8004660 tx=0x7f36e8009b30).stop 2021-11-03T16:51:42.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:42.907+0000 7f36f7fff700 1 -- 172.21.15.26:0/2584523594 shutdown_connections 2021-11-03T16:51:42.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:42.907+0000 7f36f7fff700 1 --2- 172.21.15.26:0/2584523594 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36f80f57f0 0x7f36f80f5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:42.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:42.907+0000 7f36f7fff700 1 --2- 172.21.15.26:0/2584523594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36f80f6af0 0x7f36f80f6f10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:42.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:42.907+0000 7f36f7fff700 1 -- 172.21.15.26:0/2584523594 >> 172.21.15.26:0/2584523594 conn(0x7f36f80f0400 msgr2=0x7f36f80f2820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:51:42.906 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:42.908+0000 7f36f7fff700 1 -- 172.21.15.26:0/2584523594 shutdown_connections 2021-11-03T16:51:42.906 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:42.908+0000 7f36f7fff700 1 -- 172.21.15.26:0/2584523594 wait complete. 2021-11-03T16:51:42.908 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:42.908+0000 7f36f7fff700 1 Processor -- start 2021-11-03T16:51:42.909 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:42.908+0000 7f36f7fff700 1 -- start start 2021-11-03T16:51:42.909 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:42.909+0000 7f36f7fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36f80f57f0 0x7f36f8109b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:42.909 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:42.909+0000 7f36f7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36f80f6af0 0x7f36f810c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:42.909 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:42.909+0000 7f36f7fff700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f80f54a0 con 0x7f36f80f6af0 2021-11-03T16:51:42.910 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:42.909+0000 7f36f7fff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f80f55e0 con 0x7f36f80f57f0 2021-11-03T16:51:42.910 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:42.909+0000 7f36f67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36f80f6af0 0x7f36f810c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:42.910 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:42.909+0000 7f36f67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36f80f6af0 0x7f36f810c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49942/0 (socket says 172.21.15.26:49942) 2021-11-03T16:51:42.910 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:42.909+0000 7f36f67fc700 1 -- 172.21.15.26:0/3502450089 learned_addr learned my addr 172.21.15.26:0/3502450089 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:51:42.910 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:42.909+0000 7f36f6ffd700 1 --2- 172.21.15.26:0/3502450089 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36f80f57f0 0x7f36f8109b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:42.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:42.909+0000 7f36f67fc700 1 -- 172.21.15.26:0/3502450089 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36f80f57f0 msgr2=0x7f36f8109b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:42.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:42.909+0000 7f36f67fc700 1 --2- 172.21.15.26:0/3502450089 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36f80f57f0 0x7f36f8109b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:42.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:42.909+0000 7f36f67fc700 1 -- 172.21.15.26:0/3502450089 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e8005040 con 0x7f36f80f6af0 2021-11-03T16:51:42.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:42.909+0000 7f36f67fc700 1 --2- 172.21.15.26:0/3502450089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36f80f6af0 0x7f36f810c080 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f36ec002700 tx=0x7f36ec009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:42.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:42.909+0000 7f36df7fe700 1 -- 172.21.15.26:0/3502450089 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36ec0079c0 con 0x7f36f80f6af0 2021-11-03T16:51:42.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:42.909+0000 7f36df7fe700 1 -- 172.21.15.26:0/3502450089 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f36ec00f040 con 0x7f36f80f6af0 2021-11-03T16:51:42.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:42.909+0000 7f36f7fff700 1 -- 172.21.15.26:0/3502450089 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36f810c630 con 0x7f36f80f6af0 2021-11-03T16:51:42.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:42.909+0000 7f36df7fe700 1 -- 172.21.15.26:0/3502450089 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36ec0147c0 con 0x7f36f80f6af0 2021-11-03T16:51:42.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:42.909+0000 7f36f7fff700 1 -- 172.21.15.26:0/3502450089 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f810cbf0 con 0x7f36f80f6af0 2021-11-03T16:51:42.913 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:42.910+0000 7f36f7fff700 1 -- 172.21.15.26:0/3502450089 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36f8045ad0 con 0x7f36f80f6af0 2021-11-03T16:51:42.913 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:42.910+0000 7f36df7fe700 1 -- 172.21.15.26:0/3502450089 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f36ec01b060 con 0x7f36f80f6af0 2021-11-03T16:51:42.913 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:42.911+0000 7f36df7fe700 1 --2- 172.21.15.26:0/3502450089 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f36e005c2a0 0x7f36e005e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:42.914 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:42.911+0000 7f36df7fe700 1 -- 172.21.15.26:0/3502450089 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f36ec075a80 con 0x7f36f80f6af0 2021-11-03T16:51:42.914 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:42.911+0000 7f36f6ffd700 1 --2- 172.21.15.26:0/3502450089 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f36e005c2a0 0x7f36e005e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:42.914 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:42.911+0000 7f36f6ffd700 1 --2- 172.21.15.26:0/3502450089 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f36e005c2a0 0x7f36e005e760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f36f80f5120 tx=0x7f36e8009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:42.914 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:42.915+0000 7f36df7fe700 1 -- 172.21.15.26:0/3502450089 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f36ec048aa0 con 0x7f36f80f6af0 2021-11-03T16:51:43.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:43.073+0000 7f36f7fff700 1 -- 172.21.15.26:0/3502450089 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f36f8027a00 con 0x7f36f80f6af0 2021-11-03T16:51:43.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:43.073+0000 7f36df7fe700 1 -- 172.21.15.26:0/3502450089 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f36ec04c0c0 con 0x7f36f80f6af0 2021-11-03T16:51:43.070 INFO:teuthology.orchestra.run.smithi026.stdout:111669149715 2021-11-03T16:51:43.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:43.075+0000 7f36f7fff700 1 -- 172.21.15.26:0/3502450089 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f36e005c2a0 msgr2=0x7f36e005e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:43.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:43.075+0000 7f36f7fff700 1 --2- 172.21.15.26:0/3502450089 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f36e005c2a0 0x7f36e005e760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f36f80f5120 tx=0x7f36e8009b30).stop 2021-11-03T16:51:43.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:43.075+0000 7f36f7fff700 1 -- 172.21.15.26:0/3502450089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36f80f6af0 msgr2=0x7f36f810c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:43.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:43.075+0000 7f36f7fff700 1 --2- 172.21.15.26:0/3502450089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36f80f6af0 0x7f36f810c080 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f36ec002700 tx=0x7f36ec009e00).stop 2021-11-03T16:51:43.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:43.075+0000 7f36f7fff700 1 -- 172.21.15.26:0/3502450089 shutdown_connections 2021-11-03T16:51:43.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:43.075+0000 7f36f7fff700 1 --2- 172.21.15.26:0/3502450089 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f36e005c2a0 0x7f36e005e760 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:43.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:43.075+0000 7f36f7fff700 1 --2- 172.21.15.26:0/3502450089 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36f80f57f0 0x7f36f8109b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:43.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:43.075+0000 7f36f7fff700 1 --2- 172.21.15.26:0/3502450089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36f80f6af0 0x7f36f810c080 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:43.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:43.075+0000 7f36f7fff700 1 -- 172.21.15.26:0/3502450089 >> 172.21.15.26:0/3502450089 conn(0x7f36f80f0400 msgr2=0x7f36f80fa250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:51:43.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:43.075+0000 7f36f7fff700 1 -- 172.21.15.26:0/3502450089 shutdown_connections 2021-11-03T16:51:43.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:43.075+0000 7f36f7fff700 1 -- 172.21.15.26:0/3502450089 wait complete. 2021-11-03T16:51:43.786 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149712 got 111669149715 for osd.3 2021-11-03T16:51:43.787 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph osd last-stat-seq osd.4 2021-11-03T16:51:44.078 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c/mon.smithi026/config 2021-11-03T16:51:44.291 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:44 smithi026 conmon[32119]: cluster 2021-11-03T16:51:43.025870+0000 mgr.smithi026.cnrxli (mgr.14162) 195 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:44.291 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:44 smithi026 conmon[32119]: audit 2021-11-03T16:51:43.075448+0000 mon.smithi026 (mon.0) 451 : audit [DBG] from='client.? 172.21.15.26:0/3502450089' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-11-03T16:51:44.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:44 smithi194 conmon[35111]: cluster 2021-11-03T16:51:43.025870+0000 mgr.smithi026.cnrxli (mgr.14162) 195 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:44.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:44 smithi194 conmon[35111]: audit 2021-11-03T16:51:43 2021-11-03T16:51:44.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:44 smithi194 conmon[35111]: .075448+0000 mon.smithi026 (mon.0) 451 : audit [DBG] from='client.? 172.21.15.26:0/3502450089' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-11-03T16:51:45.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.798+0000 7f061329b700 1 -- 172.21.15.26:0/1736212637 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f060c0f7a80 msgr2=0x7f060c0f7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:45.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.798+0000 7f061329b700 1 --2- 172.21.15.26:0/1736212637 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f060c0f7a80 0x7f060c0f7ee0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f05fc004660 tx=0x7f05fc009b30).stop 2021-11-03T16:51:45.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.798+0000 7f061329b700 1 -- 172.21.15.26:0/1736212637 shutdown_connections 2021-11-03T16:51:45.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.798+0000 7f061329b700 1 --2- 172.21.15.26:0/1736212637 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f060c0f7a80 0x7f060c0f7ee0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:45.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.798+0000 7f061329b700 1 --2- 172.21.15.26:0/1736212637 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f060c0f67e0 0x7f060c0f6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:45.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.798+0000 7f061329b700 1 -- 172.21.15.26:0/1736212637 >> 172.21.15.26:0/1736212637 conn(0x7f060c0f1f20 msgr2=0x7f060c0f4360 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:51:45.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.798+0000 7f061329b700 1 -- 172.21.15.26:0/1736212637 shutdown_connections 2021-11-03T16:51:45.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.798+0000 7f061329b700 1 -- 172.21.15.26:0/1736212637 wait complete. 2021-11-03T16:51:45.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.799+0000 7f061329b700 1 Processor -- start 2021-11-03T16:51:45.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.799+0000 7f061329b700 1 -- start start 2021-11-03T16:51:45.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.799+0000 7f061329b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f060c0f67e0 0x7f060c107030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:45.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.799+0000 7f061329b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f060c0f7a80 0x7f060c107520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:45.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.799+0000 7f061329b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060c107ad0 con 0x7f060c0f67e0 2021-11-03T16:51:45.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.799+0000 7f061329b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060c107c10 con 0x7f060c0f7a80 2021-11-03T16:51:45.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.799+0000 7f0611037700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f060c0f67e0 0x7f060c107030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:45.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.799+0000 7f0611037700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f060c0f67e0 0x7f060c107030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49950/0 (socket says 172.21.15.26:49950) 2021-11-03T16:51:45.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.799+0000 7f0611037700 1 -- 172.21.15.26:0/3677903563 learned_addr learned my addr 172.21.15.26:0/3677903563 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:51:45.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.799+0000 7f0610836700 1 --2- 172.21.15.26:0/3677903563 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f060c0f7a80 0x7f060c107520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:45.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.799+0000 7f0611037700 1 -- 172.21.15.26:0/3677903563 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f060c0f7a80 msgr2=0x7f060c107520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:45.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.799+0000 7f0611037700 1 --2- 172.21.15.26:0/3677903563 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f060c0f7a80 0x7f060c107520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:45.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.799+0000 7f0611037700 1 -- 172.21.15.26:0/3677903563 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05fc005040 con 0x7f060c0f67e0 2021-11-03T16:51:45.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.799+0000 7f0610836700 1 --2- 172.21.15.26:0/3677903563 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f060c0f7a80 0x7f060c107520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T16:51:45.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.799+0000 7f0611037700 1 --2- 172.21.15.26:0/3677903563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f060c0f67e0 0x7f060c107030 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f0608002700 tx=0x7f0608009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:45.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.800+0000 7f0601ffb700 1 -- 172.21.15.26:0/3677903563 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0608009320 con 0x7f060c0f67e0 2021-11-03T16:51:45.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.800+0000 7f0601ffb700 1 -- 172.21.15.26:0/3677903563 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f060800f040 con 0x7f060c0f67e0 2021-11-03T16:51:45.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.800+0000 7f061329b700 1 -- 172.21.15.26:0/3677903563 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f060c1085b0 con 0x7f060c0f67e0 2021-11-03T16:51:45.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.800+0000 7f0601ffb700 1 -- 172.21.15.26:0/3677903563 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0608014860 con 0x7f060c0f67e0 2021-11-03T16:51:45.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.800+0000 7f061329b700 1 -- 172.21.15.26:0/3677903563 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f060c108b70 con 0x7f060c0f67e0 2021-11-03T16:51:45.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.801+0000 7f061329b700 1 -- 172.21.15.26:0/3677903563 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f060c045ad0 con 0x7f060c0f67e0 2021-11-03T16:51:45.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.801+0000 7f0601ffb700 1 -- 172.21.15.26:0/3677903563 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f06080077b0 con 0x7f060c0f67e0 2021-11-03T16:51:45.805 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.801+0000 7f0601ffb700 1 --2- 172.21.15.26:0/3677903563 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f05f805c2a0 0x7f05f805e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:45.805 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.801+0000 7f0601ffb700 1 -- 172.21.15.26:0/3677903563 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f0608075db0 con 0x7f060c0f67e0 2021-11-03T16:51:45.805 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.801+0000 7f0610836700 1 --2- 172.21.15.26:0/3677903563 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f05f805c2a0 0x7f05f805e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:45.805 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.802+0000 7f0610836700 1 --2- 172.21.15.26:0/3677903563 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f05f805c2a0 0x7f05f805e760 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f05fc004e30 tx=0x7f05fc009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:45.806 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.805+0000 7f0601ffb700 1 -- 172.21.15.26:0/3677903563 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f0608048e50 con 0x7f060c0f67e0 2021-11-03T16:51:45.962 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.966+0000 7f061329b700 1 -- 172.21.15.26:0/3677903563 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f060c0ff120 con 0x7f060c0f67e0 2021-11-03T16:51:45.963 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.966+0000 7f0601ffb700 1 -- 172.21.15.26:0/3677903563 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f060804c470 con 0x7f060c0f67e0 2021-11-03T16:51:45.963 INFO:teuthology.orchestra.run.smithi026.stdout:133143986192 2021-11-03T16:51:45.964 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.968+0000 7f061329b700 1 -- 172.21.15.26:0/3677903563 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f05f805c2a0 msgr2=0x7f05f805e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:45.964 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.968+0000 7f061329b700 1 --2- 172.21.15.26:0/3677903563 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f05f805c2a0 0x7f05f805e760 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f05fc004e30 tx=0x7f05fc009b30).stop 2021-11-03T16:51:45.965 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.968+0000 7f061329b700 1 -- 172.21.15.26:0/3677903563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f060c0f67e0 msgr2=0x7f060c107030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:45.965 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.968+0000 7f061329b700 1 --2- 172.21.15.26:0/3677903563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f060c0f67e0 0x7f060c107030 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f0608002700 tx=0x7f0608009d80).stop 2021-11-03T16:51:45.965 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.968+0000 7f061329b700 1 -- 172.21.15.26:0/3677903563 shutdown_connections 2021-11-03T16:51:45.966 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.968+0000 7f061329b700 1 --2- 172.21.15.26:0/3677903563 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f05f805c2a0 0x7f05f805e760 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:45.966 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.968+0000 7f061329b700 1 --2- 172.21.15.26:0/3677903563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f060c0f67e0 0x7f060c107030 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:45.967 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.968+0000 7f061329b700 1 --2- 172.21.15.26:0/3677903563 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f060c0f7a80 0x7f060c107520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:45.967 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.968+0000 7f061329b700 1 -- 172.21.15.26:0/3677903563 >> 172.21.15.26:0/3677903563 conn(0x7f060c0f1f20 msgr2=0x7f060c0fb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:51:45.967 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.968+0000 7f061329b700 1 -- 172.21.15.26:0/3677903563 shutdown_connections 2021-11-03T16:51:45.967 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:45.968+0000 7f061329b700 1 -- 172.21.15.26:0/3677903563 wait complete. 2021-11-03T16:51:46.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:46 smithi026 conmon[32119]: cluster 2021-11-03T16:51:45.026303+0000 2021-11-03T16:51:46.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:46 smithi026 conmon[32119]: mgr.smithi026.cnrxli (mgr.14162) 196 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:46.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:46 smithi026 conmon[32119]: audit 2021-11-03T16:51:45.968108+0000 mon.smithi026 (mon.0) 452 : audit [DBG] from='client.? 172.21.15.26:0/3677903563' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-11-03T16:51:46.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:46 smithi194 conmon[35111]: cluster 2021-11-03T16:51:45.026303+0000 mgr.smithi026.cnrxli (mgr.14162) 196 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:46.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:46 smithi194 conmon[35111]: audit 2021-11-03T16:51:45 2021-11-03T16:51:46.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:46 smithi194 conmon[35111]: .968108+0000 mon.smithi026 (mon.0) 452 : audit [DBG] from='client.? 172.21.15.26:0/3677903563' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-11-03T16:51:46.701 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986189 got 133143986192 for osd.4 2021-11-03T16:51:46.702 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph osd last-stat-seq osd.5 2021-11-03T16:51:46.989 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c/mon.smithi026/config 2021-11-03T16:51:48.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:48 smithi026 conmon[32119]: cluster 2021-11-03T16:51:47.026602+0000 mgr.smithi026.cnrxli (mgr.14162) 197 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:48.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:48 smithi194 conmon[35111]: cluster 2021-11-03T16:51:47.026602+0000 mgr.smithi026.cnrxli (mgr.14162) 197 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:48.701 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.705+0000 7fe806880700 1 -- 172.21.15.26:0/4251639016 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8000f6960 msgr2=0x7fe8000f6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:48.702 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.705+0000 7fe806880700 1 --2- 172.21.15.26:0/4251639016 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8000f6960 0x7fe8000f6dc0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fe7f0004660 tx=0x7fe7f0009b30).stop 2021-11-03T16:51:48.702 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.705+0000 7fe806880700 1 -- 172.21.15.26:0/4251639016 shutdown_connections 2021-11-03T16:51:48.702 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.705+0000 7fe806880700 1 --2- 172.21.15.26:0/4251639016 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8000f6960 0x7fe8000f6dc0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:48.702 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.705+0000 7fe806880700 1 --2- 172.21.15.26:0/4251639016 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8000f56c0 0x7fe8000f5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T16:51:48.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.705+0000 7fe806880700 1 -- 172.21.15.26:0/4251639016 >> 172.21.15.26:0/4251639016 conn(0x7fe8000f0e20 msgr2=0x7fe8000f3240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:51:48.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.705+0000 7fe806880700 1 -- 172.21.15.26:0/4251639016 shutdown_connections 2021-11-03T16:51:48.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.705+0000 7fe806880700 1 -- 172.21.15.26:0/4251639016 wait complete. 2021-11-03T16:51:48.705 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.705+0000 7fe806880700 1 Processor -- start 2021-11-03T16:51:48.706 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.706+0000 7fe806880700 1 -- start start 2021-11-03T16:51:48.706 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.706+0000 7fe806880700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8000f56c0 0x7fe80010c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:48.706 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.706+0000 7fe806880700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8000f6960 0x7fe80010e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:48.707 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.706+0000 7fe806880700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe800060830 con 0x7fe8000f6960 2021-11-03T16:51:48.707 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.706+0000 7fe806880700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe800060970 con 0x7fe8000f56c0 2021-11-03T16:51:48.707 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.706+0000 7fe7ff7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8000f6960 0x7fe80010e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:48.707 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.706+0000 7fe7ff7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8000f6960 0x7fe80010e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49962/0 (socket says 172.21.15.26:49962) 2021-11-03T16:51:48.707 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.706+0000 7fe7ff7fe700 1 -- 172.21.15.26:0/970595781 learned_addr learned my addr 172.21.15.26:0/970595781 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:51:48.708 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.706+0000 7fe7fffff700 1 --2- 172.21.15.26:0/970595781 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8000f56c0 0x7fe80010c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:48.708 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.706+0000 7fe7ff7fe700 1 -- 172.21.15.26:0/970595781 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8000f56c0 msgr2=0x7fe80010c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:48.708 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.706+0000 7fe7ff7fe700 1 --2- 172.21.15.26:0/970595781 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8000f56c0 0x7fe80010c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:48.708 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.706+0000 7fe7ff7fe700 1 -- 172.21.15.26:0/970595781 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f0005040 con 0x7fe8000f6960 2021-11-03T16:51:48.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.706+0000 7fe7fffff700 1 --2- 172.21.15.26:0/970595781 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8000f56c0 0x7fe80010c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T16:51:48.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.706+0000 7fe7ff7fe700 1 --2- 172.21.15.26:0/970595781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8000f6960 0x7fe80010e6b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fe7f0009990 tx=0x7fe7f0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:48.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.706+0000 7fe7fcff9700 1 -- 172.21.15.26:0/970595781 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7f0018070 con 0x7fe8000f6960 2021-11-03T16:51:48.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.707+0000 7fe7fcff9700 1 -- 172.21.15.26:0/970595781 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fe7f0013410 con 0x7fe8000f6960 2021-11-03T16:51:48.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.707+0000 7fe806880700 1 -- 172.21.15.26:0/970595781 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe80010eba0 con 0x7fe8000f6960 2021-11-03T16:51:48.710 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.707+0000 7fe7fcff9700 1 -- 172.21.15.26:0/970595781 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7f001c620 con 0x7fe8000f6960 2021-11-03T16:51:48.710 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.707+0000 7fe806880700 1 -- 172.21.15.26:0/970595781 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe80010efd0 con 0x7fe8000f6960 2021-11-03T16:51:48.710 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.707+0000 7fe806880700 1 -- 172.21.15.26:0/970595781 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe800045ad0 con 0x7fe8000f6960 2021-11-03T16:51:48.711 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.708+0000 7fe7fcff9700 1 -- 172.21.15.26:0/970595781 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fe7f001c8e0 con 0x7fe8000f6960 2021-11-03T16:51:48.711 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.708+0000 7fe7fcff9700 1 --2- 172.21.15.26:0/970595781 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe7e805c2a0 0x7fe7e805e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:48.711 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.708+0000 7fe7fcff9700 1 -- 172.21.15.26:0/970595781 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7fe7f0077b40 con 0x7fe8000f6960 2021-11-03T16:51:48.711 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.708+0000 7fe7fffff700 1 --2- 172.21.15.26:0/970595781 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe7e805c2a0 0x7fe7e805e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:48.711 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.709+0000 7fe7fffff700 1 --2- 172.21.15.26:0/970595781 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe7e805c2a0 0x7fe7e805e760 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fe8000605c0 tx=0x7fe7f4008040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:48.712 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.712+0000 7fe7fcff9700 1 -- 172.21.15.26:0/970595781 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fe7f004ab60 con 0x7fe8000f6960 2021-11-03T16:51:48.867 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.871+0000 7fe806880700 1 -- 172.21.15.26:0/970595781 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fe8000586e0 con 0x7fe8000f6960 2021-11-03T16:51:48.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.871+0000 7fe7fcff9700 1 -- 172.21.15.26:0/970595781 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe7f004e180 con 0x7fe8000f6960 2021-11-03T16:51:48.868 INFO:teuthology.orchestra.run.smithi026.stdout:154618822670 2021-11-03T16:51:48.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.873+0000 7fe806880700 1 -- 172.21.15.26:0/970595781 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe7e805c2a0 msgr2=0x7fe7e805e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:48.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.873+0000 7fe806880700 1 --2- 172.21.15.26:0/970595781 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe7e805c2a0 0x7fe7e805e760 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fe8000605c0 tx=0x7fe7f4008040).stop 2021-11-03T16:51:48.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.873+0000 7fe806880700 1 -- 172.21.15.26:0/970595781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8000f6960 msgr2=0x7fe80010e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:48.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.873+0000 7fe806880700 1 --2- 172.21.15.26:0/970595781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8000f6960 0x7fe80010e6b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fe7f0009990 tx=0x7fe7f0009b30).stop 2021-11-03T16:51:48.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.873+0000 7fe806880700 1 -- 172.21.15.26:0/970595781 shutdown_connections 2021-11-03T16:51:48.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.873+0000 7fe806880700 1 --2- 172.21.15.26:0/970595781 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe7e805c2a0 0x7fe7e805e760 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:48.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.873+0000 7fe806880700 1 --2- 172.21.15.26:0/970595781 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8000f56c0 0x7fe80010c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:48.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.873+0000 7fe806880700 1 --2- 172.21.15.26:0/970595781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8000f6960 0x7fe80010e6b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:48.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.873+0000 7fe806880700 1 -- 172.21.15.26:0/970595781 >> 172.21.15.26:0/970595781 conn(0x7fe8000f0e20 msgr2=0x7fe8000fa3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:51:48.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.873+0000 7fe806880700 1 -- 172.21.15.26:0/970595781 shutdown_connections 2021-11-03T16:51:48.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:48.873+0000 7fe806880700 1 -- 172.21.15.26:0/970595781 wait complete. 2021-11-03T16:51:49.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:49 smithi026 conmon[32119]: audit 2021-11-03T16:51:48.873104+0000 mon.smithi026 (mon 2021-11-03T16:51:49.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:49 smithi026 conmon[32119]: .0) 453 : audit [DBG] from='client.? 172.21.15.26:0/970595781' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-11-03T16:51:49.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:49 smithi194 conmon[35111]: audit 2021-11-03T16:51:48.873104+0000 mon.smithi026 (mon.0) 453 : audit [DBG] from='client.? 172.21.15.26:0/970595781' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-11-03T16:51:49.583 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822667 got 154618822670 for osd.5 2021-11-03T16:51:49.584 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2021-11-03T16:51:49.584 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph pg dump --format=json 2021-11-03T16:51:49.872 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c/mon.smithi026/config 2021-11-03T16:51:50.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:50 smithi026 conmon[32119]: cluster 2021-11-03T16:51:49.026936+0000 mgr.smithi026.cnrxli (mgr.14162) 198 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:50.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:50 smithi194 conmon[35111]: cluster 2021-11-03T16:51:49.026936+0000 mgr.smithi026.cnrxli (mgr.14162) 198 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:51.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.545+0000 7f284b089700 1 -- 172.21.15.26:0/443621855 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28440f62f0 msgr2=0x7f28440f6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:51.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.545+0000 7f284b089700 1 --2- 172.21.15.26:0/443621855 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28440f62f0 0x7f28440f6750 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f2834004660 tx=0x7f2834009b30).stop 2021-11-03T16:51:51.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.545+0000 7f284b089700 1 -- 172.21.15.26:0/443621855 shutdown_connections 2021-11-03T16:51:51.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.545+0000 7f284b089700 1 --2- 172.21.15.26:0/443621855 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28440f62f0 0x7f28440f6750 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:51.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.545+0000 7f284b089700 1 --2- 172.21.15.26:0/443621855 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28440f7ce0 0x7f28440f8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:51.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.545+0000 7f284b089700 1 -- 172.21.15.26:0/443621855 >> 172.21.15.26:0/443621855 conn(0x7f28440f1d70 msgr2=0x7f28440f41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:51:51.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.545+0000 7f284b089700 1 -- 172.21.15.26:0/443621855 shutdown_connections 2021-11-03T16:51:51.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.545+0000 7f284b089700 1 -- 172.21.15.26:0/443621855 wait complete. 2021-11-03T16:51:51.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.546+0000 7f284b089700 1 Processor -- start 2021-11-03T16:51:51.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.546+0000 7f284b089700 1 -- start start 2021-11-03T16:51:51.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.546+0000 7f284b089700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28440f62f0 0x7f284406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:51.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.546+0000 7f284b089700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28440f7ce0 0x7f2844069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:51.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.546+0000 7f284b089700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284410ac10 con 0x7f28440f7ce0 2021-11-03T16:51:51.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.546+0000 7f284b089700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284410ad50 con 0x7f28440f62f0 2021-11-03T16:51:51.548 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.546+0000 7f2849886700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28440f7ce0 0x7f2844069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:51.548 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.546+0000 7f2849886700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28440f7ce0 0x7f2844069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49972/0 (socket says 172.21.15.26:49972) 2021-11-03T16:51:51.548 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.546+0000 7f2849886700 1 -- 172.21.15.26:0/1985193994 learned_addr learned my addr 172.21.15.26:0/1985193994 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:51:51.548 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.546+0000 7f284a087700 1 --2- 172.21.15.26:0/1985193994 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28440f62f0 0x7f284406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:51.549 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.546+0000 7f2849886700 1 -- 172.21.15.26:0/1985193994 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28440f62f0 msgr2=0x7f284406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:51.549 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.547+0000 7f2849886700 1 --2- 172.21.15.26:0/1985193994 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28440f62f0 0x7f284406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:51.549 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.547+0000 7f2849886700 1 -- 172.21.15.26:0/1985193994 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2834005040 con 0x7f28440f7ce0 2021-11-03T16:51:51.549 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.547+0000 7f2849886700 1 --2- 172.21.15.26:0/1985193994 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28440f7ce0 0x7f2844069e20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f2834013fd0 tx=0x7f2834009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:51.550 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.547+0000 7f283affd700 1 -- 172.21.15.26:0/1985193994 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2834018070 con 0x7f28440f7ce0 2021-11-03T16:51:51.550 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.547+0000 7f283affd700 1 -- 172.21.15.26:0/1985193994 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f2834013410 con 0x7f28440f7ce0 2021-11-03T16:51:51.550 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.547+0000 7f284b089700 1 -- 172.21.15.26:0/1985193994 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f284406a370 con 0x7f28440f7ce0 2021-11-03T16:51:51.550 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.547+0000 7f283affd700 1 -- 172.21.15.26:0/1985193994 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f283401c620 con 0x7f28440f7ce0 2021-11-03T16:51:51.551 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.547+0000 7f284b089700 1 -- 172.21.15.26:0/1985193994 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f284406a8d0 con 0x7f28440f7ce0 2021-11-03T16:51:51.551 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.548+0000 7f284b089700 1 -- 172.21.15.26:0/1985193994 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2844045ad0 con 0x7f28440f7ce0 2021-11-03T16:51:51.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.548+0000 7f283affd700 1 -- 172.21.15.26:0/1985193994 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f283401d9b0 con 0x7f28440f7ce0 2021-11-03T16:51:51.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.549+0000 7f283affd700 1 --2- 172.21.15.26:0/1985193994 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f283005c2a0 0x7f283005e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:51.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.549+0000 7f283affd700 1 -- 172.21.15.26:0/1985193994 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f2834077b90 con 0x7f28440f7ce0 2021-11-03T16:51:51.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.549+0000 7f284a087700 1 --2- 172.21.15.26:0/1985193994 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f283005c2a0 0x7f283005e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:51.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.549+0000 7f284a087700 1 --2- 172.21.15.26:0/1985193994 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f283005c2a0 0x7f283005e760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f284406b730 tx=0x7f2840009040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:51.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.553+0000 7f283affd700 1 -- 172.21.15.26:0/1985193994 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f283404abb0 con 0x7f28440f7ce0 2021-11-03T16:51:51.705 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.708+0000 7f284b089700 1 -- 172.21.15.26:0/1985193994 --> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f28440fefe0 con 0x7f283005c2a0 2021-11-03T16:51:51.706 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.710+0000 7f283affd700 1 -- 172.21.15.26:0/1985193994 <== mgr.14162 v2:172.21.15.26:6800/3029163595 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27894 (secure 0 0 0) 0x7f28440fefe0 con 0x7f283005c2a0 2021-11-03T16:51:51.707 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:51:51.708 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.712+0000 7f284b089700 1 -- 172.21.15.26:0/1985193994 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f283005c2a0 msgr2=0x7f283005e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:51.708 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.712+0000 7f284b089700 1 --2- 172.21.15.26:0/1985193994 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f283005c2a0 0x7f283005e760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f284406b730 tx=0x7f2840009040).stop 2021-11-03T16:51:51.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.712+0000 7f284b089700 1 -- 172.21.15.26:0/1985193994 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28440f7ce0 msgr2=0x7f2844069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:51.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.712+0000 7f284b089700 1 --2- 172.21.15.26:0/1985193994 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28440f7ce0 0x7f2844069e20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f2834013fd0 tx=0x7f2834009b30).stop 2021-11-03T16:51:51.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.712+0000 7f284b089700 1 -- 172.21.15.26:0/1985193994 shutdown_connections 2021-11-03T16:51:51.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.712+0000 7f284b089700 1 --2- 172.21.15.26:0/1985193994 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f283005c2a0 0x7f283005e760 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:51.710 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.712+0000 7f284b089700 1 --2- 172.21.15.26:0/1985193994 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28440f62f0 0x7f284406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:51.710 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.712+0000 7f284b089700 1 --2- 172.21.15.26:0/1985193994 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28440f7ce0 0x7f2844069e20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:51.710 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.712+0000 7f284b089700 1 -- 172.21.15.26:0/1985193994 >> 172.21.15.26:0/1985193994 conn(0x7f28440f1d70 msgr2=0x7f28440fb320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:51:51.710 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.712+0000 7f284b089700 1 -- 172.21.15.26:0/1985193994 shutdown_connections 2021-11-03T16:51:51.711 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:51.712+0000 7f284b089700 1 -- 172.21.15.26:0/1985193994 wait complete. 2021-11-03T16:51:51.711 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2021-11-03T16:51:52.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:52 smithi026 conmon[32119]: cluster 2021-11-03T16:51:51.027244 2021-11-03T16:51:52.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:52 smithi026 conmon[32119]: +0000 mgr.smithi026.cnrxli (mgr.14162) 199 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:52.451 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":167,"stamp":"2021-11-03T16:51:51.027122+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":31176,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":29184,"kb_avail":562439736,"statfs":{"total":575970213888,"available":575938289664,"internally_reserved":0,"allocated":1990656,"data_stored":737700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":29884416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":"35","reported_epoch":"36","state":"active+clean","last_fresh":"2021-11-03T16:50:54.121323+0000","last_change":"2021-11-03T16:50:35.540557+0000","last_active":"2021-11-03T16:50:54.121323+0000","last_peered":"2021-11-03T16:50:54.121323+0000","last_clean":"2021-11-03T16:50:54.121323+0000","last_became_active":"2021-11-03T16:50:35.540256+0000","last_became_peered":"2021-11-03T16:50:35.540256+0000","last_unstale":"2021-11-03T16:50:54.121323+0000","last_undegraded":"2021-11-03T16:50:54.121323+0000","last_fullsized":"2021-11-03T16:50:54.121323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-03T16:50:10.889310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-03T16:50:10.889310+0000","last_clean_scrub_stamp":"2021-11-03T16:50:10.889310+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":36,"seq":154618822671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5068,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":93740084,"statfs":{"total":95995035648,"available":95989846016,"internally_reserved":0,"allocated":331776,"data_stored":122950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]}]},{"osd":4,"up_from":31,"seq":133143986193,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5132,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":93740020,"statfs":{"total":95995035648,"available":95989780480,"internally_reserved":0,"allocated":331776,"data_stored":122950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 3 16:51:37 2021","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.46500000000000002}]},{"osd":1,"last update":"Wed Nov 3 16:51:37 2021","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.443},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.41099999999999998}]},{"osd":2,"last update":"Wed Nov 3 16:51:37 2021","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.53900000000000003}]},{"osd":3,"last update":"Wed Nov 3 16:51:37 2021","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.51300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]}]},{"osd":3,"up_from":26,"seq":111669149717,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5196,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":93739956,"statfs":{"total":95995035648,"available":95989714944,"internally_reserved":0,"allocated":331776,"data_stored":122950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 3 16:51:17 2021","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.46100000000000002}]},{"osd":1,"last update":"Wed Nov 3 16:51:17 2021","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.42799999999999999}]},{"osd":2,"last update":"Wed Nov 3 16:51:17 2021","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.44600000000000001}]},{"osd":4,"last update":"Wed Nov 3 16:51:37 2021","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.36899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]}]},{"osd":2,"up_from":19,"seq":81604378649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5196,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":93739956,"statfs":{"total":95995035648,"available":95989714944,"internally_reserved":0,"allocated":331776,"data_stored":122950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 3 16:50:59 2021","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.26200000000000001}]},{"osd":1,"last update":"Wed Nov 3 16:50:59 2021","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.27900000000000003}]},{"osd":3,"last update":"Wed Nov 3 16:51:19 2021","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":3.6040000000000001,"5min":3.6040000000000001,"15min":3.6040000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.47799999999999998}]},{"osd":4,"last update":"Wed Nov 3 16:51:40 2021","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.46200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705697,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5324,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":93739828,"statfs":{"total":95995035648,"available":95989583872,"internally_reserved":0,"allocated":331776,"data_stored":122950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 3 16:51:43 2021","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.314,"15min":0.313},"min":{"1min":0.252,"5min":0.216,"15min":0.216},"max":{"1min":0.44400000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.32000000000000001,"15min":0.316},"min":{"1min":0.25800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"last":0.34799999999999998}]},{"osd":2,"last update":"Wed Nov 3 16:51:05 2021","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.503,"5min":0.503,"15min":0.503},"last":0.30299999999999999}]},{"osd":3,"last update":"Wed Nov 3 16:51:21 2021","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.62}]},{"osd":4,"last update":"Wed Nov 3 16:51:37 2021","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.66200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542174,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5260,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":93739892,"statfs":{"total":95995035648,"available":95989649408,"internally_reserved":0,"allocated":331776,"data_stored":122950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 3 16:51:46 2021","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.29799999999999999,"15min":0.29599999999999999},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.316,"15min":0.312},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.26800000000000002}]},{"osd":2,"last update":"Wed Nov 3 16:51:00 2021","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.254},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.28100000000000003}]},{"osd":3,"last update":"Wed Nov 3 16:51:20 2021","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.67700000000000005}]},{"osd":4,"last update":"Wed Nov 3 16:51:36 2021","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.58499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-11-03T16:51:52.453 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph pg dump --format=json 2021-11-03T16:51:52.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:52 smithi194 conmon[35111]: cluster 2021-11-03T16:51:51.027244+0000 mgr.smithi026.cnrxli (mgr.14162) 199 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:52.746 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c/mon.smithi026/config 2021-11-03T16:51:53.340 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:53 smithi026 conmon[32119]: audit 2021-11-03T16:51:51.710775+0000 mgr.smithi026.cnrxli (mgr.14162) 200 : audit [DBG] from='client.14380 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-11-03T16:51:53.470 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:53 smithi194 conmon[35111]: audit 2021-11-03T16:51:51.710775+0000 mgr.smithi026.cnrxli (mgr.14162) 200 : audit [DBG] 2021-11-03T16:51:53.471 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:53 smithi194 conmon[35111]: from='client.14380 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-11-03T16:51:54.275 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:54 smithi026 conmon[32119]: cluster 2021-11-03T16:51:53. 2021-11-03T16:51:54.275 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:54 smithi026 conmon[32119]: 027869+0000 mgr.smithi026.cnrxli (mgr.14162) 201 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:54.275 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:54 smithi026 conmon[32119]: audit 2021-11-03T16:51:53.287802+0000 mon.smithi026 (mon.0) 454 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:51:54.276 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:54 smithi026 conmon[32119]: audit 2021-11-03T16:51:53.619148+0000 mon.smithi026 (mon.0) 455 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:51:54.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.437+0000 7f8418976700 1 -- 172.21.15.26:0/3074198918 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8414060810 msgr2=0x7f84140f9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:54.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.437+0000 7f8418976700 1 --2- 172.21.15.26:0/3074198918 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8414060810 0x7f84140f9420 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f840c0099e0 tx=0x7f840c004d10).stop 2021-11-03T16:51:54.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.437+0000 7f8418976700 1 -- 172.21.15.26:0/3074198918 shutdown_connections 2021-11-03T16:51:54.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.437+0000 7f8418976700 1 --2- 172.21.15.26:0/3074198918 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84140f99a0 0x7f84140fbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:54.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.437+0000 7f8418976700 1 --2- 172.21.15.26:0/3074198918 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8414060810 0x7f84140f9420 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:54.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.437+0000 7f8418976700 1 -- 172.21.15.26:0/3074198918 >> 172.21.15.26:0/3074198918 conn(0x7f84140f0e20 msgr2=0x7f84140f3260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:51:54.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.437+0000 7f8418976700 1 -- 172.21.15.26:0/3074198918 shutdown_connections 2021-11-03T16:51:54.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.437+0000 7f8418976700 1 -- 172.21.15.26:0/3074198918 wait complete. 2021-11-03T16:51:54.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.437+0000 7f8418976700 1 Processor -- start 2021-11-03T16:51:54.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.437+0000 7f8418976700 1 -- start start 2021-11-03T16:51:54.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.438+0000 7f8418976700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8414060810 0x7f84141071a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:54.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.438+0000 7f8418976700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84140f99a0 0x7f8414107690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:54.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.438+0000 7f8418976700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8414107c40 con 0x7f8414060810 2021-11-03T16:51:54.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.438+0000 7f8418976700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8414107d80 con 0x7f84140f99a0 2021-11-03T16:51:54.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.438+0000 7f841259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8414060810 0x7f84141071a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:54.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.438+0000 7f841259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8414060810 0x7f84141071a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49980/0 (socket says 172.21.15.26:49980) 2021-11-03T16:51:54.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.438+0000 7f841259c700 1 -- 172.21.15.26:0/1273313289 learned_addr learned my addr 172.21.15.26:0/1273313289 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:51:54.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.438+0000 7f8411d9b700 1 --2- 172.21.15.26:0/1273313289 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84140f99a0 0x7f8414107690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:54.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.438+0000 7f841259c700 1 -- 172.21.15.26:0/1273313289 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84140f99a0 msgr2=0x7f8414107690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:54.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.438+0000 7f841259c700 1 --2- 172.21.15.26:0/1273313289 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84140f99a0 0x7f8414107690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:54.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.438+0000 7f841259c700 1 -- 172.21.15.26:0/1273313289 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f840c009640 con 0x7f8414060810 2021-11-03T16:51:54.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.438+0000 7f841259c700 1 --2- 172.21.15.26:0/1273313289 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8414060810 0x7f84141071a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f840c00b3b0 tx=0x7f840c004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:54.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.438+0000 7f840affd700 1 -- 172.21.15.26:0/1273313289 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f840c00e070 con 0x7f8414060810 2021-11-03T16:51:54.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.438+0000 7f840affd700 1 -- 172.21.15.26:0/1273313289 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f840c0049b0 con 0x7f8414060810 2021-11-03T16:51:54.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.438+0000 7f8418976700 1 -- 172.21.15.26:0/1273313289 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84141086c0 con 0x7f8414060810 2021-11-03T16:51:54.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.438+0000 7f840affd700 1 -- 172.21.15.26:0/1273313289 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f840c018070 con 0x7f8414060810 2021-11-03T16:51:54.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.438+0000 7f8418976700 1 -- 172.21.15.26:0/1273313289 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8414108ba0 con 0x7f8414060810 2021-11-03T16:51:54.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.439+0000 7f8418976700 1 -- 172.21.15.26:0/1273313289 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8414045ad0 con 0x7f8414060810 2021-11-03T16:51:54.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.440+0000 7f840affd700 1 -- 172.21.15.26:0/1273313289 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f840c024060 con 0x7f8414060810 2021-11-03T16:51:54.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.440+0000 7f840affd700 1 --2- 172.21.15.26:0/1273313289 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f840005c2a0 0x7f840005e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:54.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.440+0000 7f840affd700 1 -- 172.21.15.26:0/1273313289 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f840c077460 con 0x7f8414060810 2021-11-03T16:51:54.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.440+0000 7f8411d9b700 1 --2- 172.21.15.26:0/1273313289 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f840005c2a0 0x7f840005e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:54.444 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.440+0000 7f8411d9b700 1 --2- 172.21.15.26:0/1273313289 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f840005c2a0 0x7f840005e760 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f84140605e0 tx=0x7f83fc00b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:54.444 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.444+0000 7f840affd700 1 -- 172.21.15.26:0/1273313289 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f840c04a480 con 0x7f8414060810 2021-11-03T16:51:54.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:54 smithi194 conmon[35111]: cluster 2021-11-03T16:51:53.027869+0000 mgr.smithi026.cnrxli (mgr.14162) 201 : cluster [DBG] 2021-11-03T16:51:54.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:54 smithi194 conmon[35111]: pgmap v168: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:54.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:54 smithi194 conmon[35111]: audit 2021-11-03T16:51:53.287802+0000 mon.smithi026 (mon.0) 454 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:51:54.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:54 smithi194 conmon[35111]: audit 2021-11-03T16:51:53.619148+0000 mon.smithi026 (mon.0) 455 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:51:54.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.599+0000 7f8418976700 1 -- 172.21.15.26:0/1273313289 --> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8414100fe0 con 0x7f840005c2a0 2021-11-03T16:51:54.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.600+0000 7f840affd700 1 -- 172.21.15.26:0/1273313289 <== mgr.14162 v2:172.21.15.26:6800/3029163595 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27893 (secure 0 0 0) 0x7f8414100fe0 con 0x7f840005c2a0 2021-11-03T16:51:54.600 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:51:54.601 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.602+0000 7f8418976700 1 -- 172.21.15.26:0/1273313289 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f840005c2a0 msgr2=0x7f840005e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:54.601 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.602+0000 7f8418976700 1 --2- 172.21.15.26:0/1273313289 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f840005c2a0 0x7f840005e760 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f84140605e0 tx=0x7f83fc00b040).stop 2021-11-03T16:51:54.602 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.602+0000 7f8418976700 1 -- 172.21.15.26:0/1273313289 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8414060810 msgr2=0x7f84141071a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:54.602 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.602+0000 7f8418976700 1 --2- 172.21.15.26:0/1273313289 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8414060810 0x7f84141071a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f840c00b3b0 tx=0x7f840c004d10).stop 2021-11-03T16:51:54.602 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.602+0000 7f8418976700 1 -- 172.21.15.26:0/1273313289 shutdown_connections 2021-11-03T16:51:54.602 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.602+0000 7f8418976700 1 --2- 172.21.15.26:0/1273313289 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f840005c2a0 0x7f840005e760 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:54.603 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.602+0000 7f8418976700 1 --2- 172.21.15.26:0/1273313289 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8414060810 0x7f84141071a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:54.603 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.602+0000 7f8418976700 1 --2- 172.21.15.26:0/1273313289 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84140f99a0 0x7f8414107690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:54.603 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.602+0000 7f8418976700 1 -- 172.21.15.26:0/1273313289 >> 172.21.15.26:0/1273313289 conn(0x7f84140f0e20 msgr2=0x7f84140f3260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:51:54.603 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.602+0000 7f8418976700 1 -- 172.21.15.26:0/1273313289 shutdown_connections 2021-11-03T16:51:54.604 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:54.602+0000 7f8418976700 1 -- 172.21.15.26:0/1273313289 wait complete. 2021-11-03T16:51:54.604 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2021-11-03T16:51:55.386 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":168,"stamp":"2021-11-03T16:51:53.027537+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":31176,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":29184,"kb_avail":562439736,"statfs":{"total":575970213888,"available":575938289664,"internally_reserved":0,"allocated":1990656,"data_stored":737700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":29884416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":"35","reported_epoch":"36","state":"active+clean","last_fresh":"2021-11-03T16:50:54.121323+0000","last_change":"2021-11-03T16:50:35.540557+0000","last_active":"2021-11-03T16:50:54.121323+0000","last_peered":"2021-11-03T16:50:54.121323+0000","last_clean":"2021-11-03T16:50:54.121323+0000","last_became_active":"2021-11-03T16:50:35.540256+0000","last_became_peered":"2021-11-03T16:50:35.540256+0000","last_unstale":"2021-11-03T16:50:54.121323+0000","last_undegraded":"2021-11-03T16:50:54.121323+0000","last_fullsized":"2021-11-03T16:50:54.121323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-03T16:50:10.889310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-03T16:50:10.889310+0000","last_clean_scrub_stamp":"2021-11-03T16:50:10.889310+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":36,"seq":154618822671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5068,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":93740084,"statfs":{"total":95995035648,"available":95989846016,"internally_reserved":0,"allocated":331776,"data_stored":122950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]}]},{"osd":4,"up_from":31,"seq":133143986194,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5132,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":93740020,"statfs":{"total":95995035648,"available":95989780480,"internally_reserved":0,"allocated":331776,"data_stored":122950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 3 16:51:37 2021","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.52200000000000002}]},{"osd":1,"last update":"Wed Nov 3 16:51:37 2021","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.47399999999999998}]},{"osd":2,"last update":"Wed Nov 3 16:51:37 2021","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.58099999999999996}]},{"osd":3,"last update":"Wed Nov 3 16:51:37 2021","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.61699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]}]},{"osd":3,"up_from":26,"seq":111669149718,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5196,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":93739956,"statfs":{"total":95995035648,"available":95989714944,"internally_reserved":0,"allocated":331776,"data_stored":122950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 3 16:51:17 2021","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.48499999999999999}]},{"osd":1,"last update":"Wed Nov 3 16:51:17 2021","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.45200000000000001}]},{"osd":2,"last update":"Wed Nov 3 16:51:17 2021","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.44},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.46600000000000003}]},{"osd":4,"last update":"Wed Nov 3 16:51:37 2021","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.51100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]}]},{"osd":2,"up_from":19,"seq":81604378649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5196,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":93739956,"statfs":{"total":95995035648,"available":95989714944,"internally_reserved":0,"allocated":331776,"data_stored":122950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 3 16:50:59 2021","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.26200000000000001}]},{"osd":1,"last update":"Wed Nov 3 16:50:59 2021","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.27900000000000003}]},{"osd":3,"last update":"Wed Nov 3 16:51:19 2021","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":3.6040000000000001,"5min":3.6040000000000001,"15min":3.6040000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.47799999999999998}]},{"osd":4,"last update":"Wed Nov 3 16:51:40 2021","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.46200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705697,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5324,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":93739828,"statfs":{"total":95995035648,"available":95989583872,"internally_reserved":0,"allocated":331776,"data_stored":122950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 3 16:51:43 2021","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.314,"15min":0.313},"min":{"1min":0.252,"5min":0.216,"15min":0.216},"max":{"1min":0.44400000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.32000000000000001,"15min":0.316},"min":{"1min":0.25800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"last":0.34799999999999998}]},{"osd":2,"last update":"Wed Nov 3 16:51:05 2021","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.503,"5min":0.503,"15min":0.503},"last":0.30299999999999999}]},{"osd":3,"last update":"Wed Nov 3 16:51:21 2021","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.62}]},{"osd":4,"last update":"Wed Nov 3 16:51:37 2021","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.66200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542175,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5260,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":93739892,"statfs":{"total":95995035648,"available":95989649408,"internally_reserved":0,"allocated":331776,"data_stored":122950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 3 16:51:46 2021","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.29799999999999999,"15min":0.29599999999999999},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.316,"15min":0.312},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.26800000000000002}]},{"osd":2,"last update":"Wed Nov 3 16:51:00 2021","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.254},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.28100000000000003}]},{"osd":3,"last update":"Wed Nov 3 16:51:20 2021","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.67700000000000005}]},{"osd":4,"last update":"Wed Nov 3 16:51:36 2021","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.58499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-11-03T16:51:55.388 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2021-11-03T16:51:55.388 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2021-11-03T16:51:55.389 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2021-11-03T16:51:55.389 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph health --format=json 2021-11-03T16:51:55.687 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c/mon.smithi026/config 2021-11-03T16:51:56.305 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:56 smithi026 conmon[32119]: audit 2021-11-03T16:51:54.600981+0000 mgr.smithi026.cnrxli ( 2021-11-03T16:51:56.305 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:56 smithi026 conmon[32119]: mgr.14162) 202 : audit [DBG] from='client.14384 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-11-03T16:51:56.306 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:56 smithi026 conmon[32119]: cluster 2021-11-03T16:51:55.028440+0000 mgr.smithi026.cnrxli (mgr.14162) 203 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:56.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:56 smithi194 conmon[35111]: audit 2021-11-03T16:51:54.600981+0000 mgr.smithi026.cnrxli (mgr.14162) 202 : audit [DBG] 2021-11-03T16:51:56.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:56 smithi194 conmon[35111]: from='client.14384 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-11-03T16:51:56.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:56 smithi194 conmon[35111]: cluster 2021-11-03T16:51:55.028440+0000 mgr.smithi026.cnrxli (mgr.14162) 203 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:57.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.495+0000 7fd3d890a700 1 -- 172.21.15.26:0/2893517272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3d40f6960 msgr2=0x7fd3d40f6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:57.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.495+0000 7fd3d890a700 1 --2- 172.21.15.26:0/2893517272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3d40f6960 0x7fd3d40f6dc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fd3bc004660 tx=0x7fd3bc009b30).stop 2021-11-03T16:51:57.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.495+0000 7fd3d890a700 1 -- 172.21.15.26:0/2893517272 shutdown_connections 2021-11-03T16:51:57.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.495+0000 7fd3d890a700 1 --2- 172.21.15.26:0/2893517272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3d40f6960 0x7fd3d40f6dc0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:57.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.495+0000 7fd3d890a700 1 --2- 172.21.15.26:0/2893517272 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3d40f56c0 0x7fd3d40f5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:57.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.495+0000 7fd3d890a700 1 -- 172.21.15.26:0/2893517272 >> 172.21.15.26:0/2893517272 conn(0x7fd3d40f0e20 msgr2=0x7fd3d40f3240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:51:57.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.495+0000 7fd3d890a700 1 -- 172.21.15.26:0/2893517272 shutdown_connections 2021-11-03T16:51:57.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.495+0000 7fd3d890a700 1 -- 172.21.15.26:0/2893517272 wait complete. 2021-11-03T16:51:57.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.496+0000 7fd3d890a700 1 Processor -- start 2021-11-03T16:51:57.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.496+0000 7fd3d890a700 1 -- start start 2021-11-03T16:51:57.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.496+0000 7fd3d890a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3d40f56c0 0x7fd3d41070b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:57.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.496+0000 7fd3d890a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3d40f6960 0x7fd3d41075a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:57.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.496+0000 7fd3d890a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d4107b50 con 0x7fd3d40f6960 2021-11-03T16:51:57.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.496+0000 7fd3d890a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d4107c90 con 0x7fd3d40f56c0 2021-11-03T16:51:57.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.496+0000 7fd3d1d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3d40f6960 0x7fd3d41075a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:57.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.496+0000 7fd3d1d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3d40f6960 0x7fd3d41075a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49992/0 (socket says 172.21.15.26:49992) 2021-11-03T16:51:57.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.496+0000 7fd3d1d9b700 1 -- 172.21.15.26:0/1456993707 learned_addr learned my addr 172.21.15.26:0/1456993707 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:51:57.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.496+0000 7fd3d259c700 1 --2- 172.21.15.26:0/1456993707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3d40f56c0 0x7fd3d41070b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:57.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.496+0000 7fd3d1d9b700 1 -- 172.21.15.26:0/1456993707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3d40f56c0 msgr2=0x7fd3d41070b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:57.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.496+0000 7fd3d1d9b700 1 --2- 172.21.15.26:0/1456993707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3d40f56c0 0x7fd3d41070b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:57.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.496+0000 7fd3d1d9b700 1 -- 172.21.15.26:0/1456993707 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3bc005040 con 0x7fd3d40f6960 2021-11-03T16:51:57.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.496+0000 7fd3d259c700 1 --2- 172.21.15.26:0/1456993707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3d40f56c0 0x7fd3d41070b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T16:51:57.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.496+0000 7fd3d1d9b700 1 --2- 172.21.15.26:0/1456993707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3d40f6960 0x7fd3d41075a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fd3bc009990 tx=0x7fd3bc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:57.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.496+0000 7fd3caffd700 1 -- 172.21.15.26:0/1456993707 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3bc018070 con 0x7fd3d40f6960 2021-11-03T16:51:57.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.496+0000 7fd3caffd700 1 -- 172.21.15.26:0/1456993707 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fd3bc013410 con 0x7fd3d40f6960 2021-11-03T16:51:57.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.497+0000 7fd3d890a700 1 -- 172.21.15.26:0/1456993707 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3d41085d0 con 0x7fd3d40f6960 2021-11-03T16:51:57.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.497+0000 7fd3caffd700 1 -- 172.21.15.26:0/1456993707 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3bc01c620 con 0x7fd3d40f6960 2021-11-03T16:51:57.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.497+0000 7fd3d890a700 1 -- 172.21.15.26:0/1456993707 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3d4108b30 con 0x7fd3d40f6960 2021-11-03T16:51:57.500 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.498+0000 7fd3d890a700 1 -- 172.21.15.26:0/1456993707 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3d4045ad0 con 0x7fd3d40f6960 2021-11-03T16:51:57.501 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.498+0000 7fd3caffd700 1 -- 172.21.15.26:0/1456993707 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fd3bc01d420 con 0x7fd3d40f6960 2021-11-03T16:51:57.501 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.498+0000 7fd3caffd700 1 --2- 172.21.15.26:0/1456993707 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fd3c005c2a0 0x7fd3c005e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:51:57.501 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.498+0000 7fd3caffd700 1 -- 172.21.15.26:0/1456993707 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7fd3bc077a10 con 0x7fd3d40f6960 2021-11-03T16:51:57.501 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.498+0000 7fd3d259c700 1 --2- 172.21.15.26:0/1456993707 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fd3c005c2a0 0x7fd3c005e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:51:57.502 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.499+0000 7fd3d259c700 1 --2- 172.21.15.26:0/1456993707 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fd3c005c2a0 0x7fd3c005e760 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fd3cc004fd0 tx=0x7fd3cc009040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:51:57.502 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.502+0000 7fd3caffd700 1 -- 172.21.15.26:0/1456993707 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fd3bc04aab0 con 0x7fd3d40f6960 2021-11-03T16:51:57.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.717+0000 7fd3d890a700 1 -- 172.21.15.26:0/1456993707 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd3d40fdf30 con 0x7fd3d40f6960 2021-11-03T16:51:57.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.718+0000 7fd3caffd700 1 -- 172.21.15.26:0/1456993707 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7fd3bc04e0d0 con 0x7fd3d40f6960 2021-11-03T16:51:57.714 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:51:57.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.719+0000 7fd3d890a700 1 -- 172.21.15.26:0/1456993707 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fd3c005c2a0 msgr2=0x7fd3c005e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:57.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.719+0000 7fd3d890a700 1 --2- 172.21.15.26:0/1456993707 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fd3c005c2a0 0x7fd3c005e760 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fd3cc004fd0 tx=0x7fd3cc009040).stop 2021-11-03T16:51:57.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.719+0000 7fd3d890a700 1 -- 172.21.15.26:0/1456993707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3d40f6960 msgr2=0x7fd3d41075a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:51:57.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.719+0000 7fd3d890a700 1 --2- 172.21.15.26:0/1456993707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3d40f6960 0x7fd3d41075a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fd3bc009990 tx=0x7fd3bc009b30).stop 2021-11-03T16:51:57.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.719+0000 7fd3d890a700 1 -- 172.21.15.26:0/1456993707 shutdown_connections 2021-11-03T16:51:57.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.719+0000 7fd3d890a700 1 --2- 172.21.15.26:0/1456993707 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fd3c005c2a0 0x7fd3c005e760 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:57.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.719+0000 7fd3d890a700 1 --2- 172.21.15.26:0/1456993707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3d40f56c0 0x7fd3d41070b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:57.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.719+0000 7fd3d890a700 1 --2- 172.21.15.26:0/1456993707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3d40f6960 0x7fd3d41075a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:51:57.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.719+0000 7fd3d890a700 1 -- 172.21.15.26:0/1456993707 >> 172.21.15.26:0/1456993707 conn(0x7fd3d40f0e20 msgr2=0x7fd3d40603a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:51:57.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.719+0000 7fd3d890a700 1 -- 172.21.15.26:0/1456993707 shutdown_connections 2021-11-03T16:51:57.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:51:57.719+0000 7fd3d890a700 1 -- 172.21.15.26:0/1456993707 wait complete. 2021-11-03T16:51:58.405 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:58 smithi026 conmon[32119]: cluster 2021-11-03T16:51:57.028767+0000 mgr.smithi026.cnrxli (mgr.14162) 204 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:58.406 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:51:58 smithi026 conmon[32119]: audit 2021-11-03T16:51:57.719503+0000 mon.smithi026 (mon.0) 456 : audit [DBG] from='client.? 172.21.15.26:0/1456993707' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-11-03T16:51:58.420 INFO:teuthology.orchestra.run.smithi026.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-11-03T16:51:58.420 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2021-11-03T16:51:58.421 INFO:tasks.cephadm:Setup complete, yielding 2021-11-03T16:51:58.421 INFO:teuthology.run_tasks:Running task print... 2021-11-03T16:51:58.435 INFO:teuthology.task.print:**** done starting v16.2.4 2021-11-03T16:51:58.436 INFO:teuthology.run_tasks:Running task cephadm.shell... 2021-11-03T16:51:58.468 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi026.front.sepia.ceph.com 2021-11-03T16:51:58.469 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- bash -c 'ceph orch status' 2021-11-03T16:51:58.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:58 smithi194 conmon[35111]: cluster 2021-11-03T16:51:57.028767+0000 mgr.smithi026.cnrxli (mgr.14162) 204 : cluster [DBG] 2021-11-03T16:51:58.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:58 smithi194 conmon[35111]: pgmap v170: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:51:58.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:51:58 smithi194 conmon[35111]: audit 2021-11-03T16:51:57.719503+0000 mon.smithi026 (mon.0) 456 : audit [DBG] from='client.? 172.21.15.26:0/1456993707' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-11-03T16:52:00.272 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:00 smithi026 conmon[32119]: cluster 2021-11-03T16:51:59.029056+0000 mgr.smithi026.cnrxli (mgr.14162) 205 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:52:00.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.473+0000 7fe944e94700 1 -- 172.21.15.26:0/836988429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9400f5ef0 msgr2=0x7fe9400f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:00.472 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.473+0000 7fe944e94700 1 --2- 172.21.15.26:0/836988429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9400f5ef0 0x7fe9400f6920 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fe934004660 tx=0x7fe934009b30).stop 2021-11-03T16:52:00.472 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.473+0000 7fe944e94700 1 -- 172.21.15.26:0/836988429 shutdown_connections 2021-11-03T16:52:00.472 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.473+0000 7fe944e94700 1 --2- 172.21.15.26:0/836988429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9400f5ef0 0x7fe9400f6920 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:00.472 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.473+0000 7fe944e94700 1 --2- 172.21.15.26:0/836988429 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9400f55e0 0x7fe9400f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:00.473 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.473+0000 7fe944e94700 1 -- 172.21.15.26:0/836988429 >> 172.21.15.26:0/836988429 conn(0x7fe9400f0de0 msgr2=0x7fe9400f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:00.473 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.473+0000 7fe944e94700 1 -- 172.21.15.26:0/836988429 shutdown_connections 2021-11-03T16:52:00.473 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.473+0000 7fe944e94700 1 -- 172.21.15.26:0/836988429 wait complete. 2021-11-03T16:52:00.473 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.473+0000 7fe944e94700 1 Processor -- start 2021-11-03T16:52:00.474 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.473+0000 7fe944e94700 1 -- start start 2021-11-03T16:52:00.474 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.473+0000 7fe944e94700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9400f55e0 0x7fe940109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:00.474 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.474+0000 7fe944e94700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9400f5ef0 0x7fe94010c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:00.474 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.474+0000 7fe944e94700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe940060500 con 0x7fe9400f5ef0 2021-11-03T16:52:00.474 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.474+0000 7fe944e94700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe940060640 con 0x7fe9400f55e0 2021-11-03T16:52:00.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.474+0000 7fe93dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9400f5ef0 0x7fe94010c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:00.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.474+0000 7fe93dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9400f5ef0 0x7fe94010c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50002/0 (socket says 172.21.15.26:50002) 2021-11-03T16:52:00.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.474+0000 7fe93dd9b700 1 -- 172.21.15.26:0/1648433782 learned_addr learned my addr 172.21.15.26:0/1648433782 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:52:00.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.474+0000 7fe93e59c700 1 --2- 172.21.15.26:0/1648433782 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9400f55e0 0x7fe940109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:00.476 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.474+0000 7fe93dd9b700 1 -- 172.21.15.26:0/1648433782 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9400f55e0 msgr2=0x7fe940109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:00.476 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.474+0000 7fe93dd9b700 1 --2- 172.21.15.26:0/1648433782 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9400f55e0 0x7fe940109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:00.476 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.474+0000 7fe93dd9b700 1 -- 172.21.15.26:0/1648433782 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe934005040 con 0x7fe9400f5ef0 2021-11-03T16:52:00.476 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.474+0000 7fe93e59c700 1 --2- 172.21.15.26:0/1648433782 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9400f55e0 0x7fe940109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T16:52:00.476 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.474+0000 7fe93dd9b700 1 --2- 172.21.15.26:0/1648433782 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9400f5ef0 0x7fe94010c190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fe934009990 tx=0x7fe934009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:00.477 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.474+0000 7fe92effd700 1 -- 172.21.15.26:0/1648433782 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe934018070 con 0x7fe9400f5ef0 2021-11-03T16:52:00.477 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.474+0000 7fe944e94700 1 -- 172.21.15.26:0/1648433782 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe94010c6e0 con 0x7fe9400f5ef0 2021-11-03T16:52:00.477 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.474+0000 7fe92effd700 1 -- 172.21.15.26:0/1648433782 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fe934013410 con 0x7fe9400f5ef0 2021-11-03T16:52:00.477 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.474+0000 7fe92effd700 1 -- 172.21.15.26:0/1648433782 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe93401c620 con 0x7fe9400f5ef0 2021-11-03T16:52:00.478 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.474+0000 7fe944e94700 1 -- 172.21.15.26:0/1648433782 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe94010cc40 con 0x7fe9400f5ef0 2021-11-03T16:52:00.478 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.475+0000 7fe944e94700 1 -- 172.21.15.26:0/1648433782 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe940045ad0 con 0x7fe9400f5ef0 2021-11-03T16:52:00.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.475+0000 7fe92effd700 1 -- 172.21.15.26:0/1648433782 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fe93401c8e0 con 0x7fe9400f5ef0 2021-11-03T16:52:00.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.476+0000 7fe92effd700 1 --2- 172.21.15.26:0/1648433782 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe92805c2b0 0x7fe92805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:00.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.476+0000 7fe92effd700 1 -- 172.21.15.26:0/1648433782 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7fe934077b40 con 0x7fe9400f5ef0 2021-11-03T16:52:00.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.476+0000 7fe93e59c700 1 --2- 172.21.15.26:0/1648433782 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe92805c2b0 0x7fe92805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:00.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.476+0000 7fe93e59c700 1 --2- 172.21.15.26:0/1648433782 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe92805c2b0 0x7fe92805e770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fe940060180 tx=0x7fe930009040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:00.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.480+0000 7fe92effd700 1 -- 172.21.15.26:0/1648433782 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fe93404ab60 con 0x7fe9400f5ef0 2021-11-03T16:52:00.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:00 smithi194 conmon[35111]: cluster 2021-11-03T16:51:59.029056+0000 mgr.smithi026.cnrxli (mgr.14162) 205 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:52:00.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:00 smithi194 conmon[35111]: 2021-11-03T16:52:00.667 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.670+0000 7fe944e94700 1 -- 172.21.15.26:0/1648433782 --> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9400fdee0 con 0x7fe92805c2b0 2021-11-03T16:52:00.668 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.671+0000 7fe92effd700 1 -- 172.21.15.26:0/1648433782 <== mgr.14162 v2:172.21.15.26:6800/3029163595 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fe9400fdee0 con 0x7fe92805c2b0 2021-11-03T16:52:00.669 INFO:teuthology.orchestra.run.smithi026.stdout:Backend: cephadm 2021-11-03T16:52:00.669 INFO:teuthology.orchestra.run.smithi026.stdout:Available: Yes 2021-11-03T16:52:00.670 INFO:teuthology.orchestra.run.smithi026.stdout:Paused: No 2021-11-03T16:52:00.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.673+0000 7fe944e94700 1 -- 172.21.15.26:0/1648433782 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe92805c2b0 msgr2=0x7fe92805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:00.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.673+0000 7fe944e94700 1 --2- 172.21.15.26:0/1648433782 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe92805c2b0 0x7fe92805e770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fe940060180 tx=0x7fe930009040).stop 2021-11-03T16:52:00.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.673+0000 7fe944e94700 1 -- 172.21.15.26:0/1648433782 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9400f5ef0 msgr2=0x7fe94010c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:00.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.673+0000 7fe944e94700 1 --2- 172.21.15.26:0/1648433782 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9400f5ef0 0x7fe94010c190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fe934009990 tx=0x7fe934009b30).stop 2021-11-03T16:52:00.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.673+0000 7fe944e94700 1 -- 172.21.15.26:0/1648433782 shutdown_connections 2021-11-03T16:52:00.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.673+0000 7fe944e94700 1 --2- 172.21.15.26:0/1648433782 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe92805c2b0 0x7fe92805e770 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:00.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.673+0000 7fe944e94700 1 --2- 172.21.15.26:0/1648433782 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9400f55e0 0x7fe940109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:00.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.673+0000 7fe944e94700 1 --2- 172.21.15.26:0/1648433782 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9400f5ef0 0x7fe94010c190 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:00.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.673+0000 7fe944e94700 1 -- 172.21.15.26:0/1648433782 >> 172.21.15.26:0/1648433782 conn(0x7fe9400f0de0 msgr2=0x7fe9400fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:00.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.673+0000 7fe944e94700 1 -- 172.21.15.26:0/1648433782 shutdown_connections 2021-11-03T16:52:00.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:00.673+0000 7fe944e94700 1 -- 172.21.15.26:0/1648433782 wait complete. 2021-11-03T16:52:01.430 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- bash -c 'ceph orch ps' 2021-11-03T16:52:02.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:02 smithi026 conmon[32119]: audit 2021-11-03T16:52:00.672762 2021-11-03T16:52:02.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:02 smithi026 conmon[32119]: +0000 mgr.smithi026.cnrxli (mgr.14162) 206 : audit [DBG] from='client.14392 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:52:02.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:02 smithi026 conmon[32119]: cluster 2021-11-03T16:52:01.029402+0000 mgr.smithi026.cnrxli (mgr.14162) 207 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:52:02.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:02 smithi194 conmon[35111]: audit 2021-11-03T16:52:00.672762+0000 mgr.smithi026.cnrxli (mgr.14162) 206 : audit [DBG] from='client.14392 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:52:02.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:02 smithi194 conmon[35111]: cluster 2021-11-03T16:52:01.029402+0000 mgr.smithi026.cnrxli (mgr.14162) 207 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:52:03.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.420+0000 7f8b63206700 1 -- 172.21.15.26:0/3301283967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b5c0f6ff0 msgr2=0x7f8b5c0f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:03.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.420+0000 7f8b63206700 1 --2- 172.21.15.26:0/3301283967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b5c0f6ff0 0x7f8b5c0f7a20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f8b4c0099e0 tx=0x7f8b4c004d10).stop 2021-11-03T16:52:03.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.420+0000 7f8b63206700 1 -- 172.21.15.26:0/3301283967 shutdown_connections 2021-11-03T16:52:03.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.420+0000 7f8b63206700 1 --2- 172.21.15.26:0/3301283967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b5c0f6ff0 0x7f8b5c0f7a20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:03.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.420+0000 7f8b63206700 1 --2- 172.21.15.26:0/3301283967 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b5c0f66e0 0x7f8b5c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:03.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.420+0000 7f8b63206700 1 -- 172.21.15.26:0/3301283967 >> 172.21.15.26:0/3301283967 conn(0x7f8b5c0f1f00 msgr2=0x7f8b5c0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:03.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.420+0000 7f8b63206700 1 -- 172.21.15.26:0/3301283967 shutdown_connections 2021-11-03T16:52:03.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.420+0000 7f8b63206700 1 -- 172.21.15.26:0/3301283967 wait complete. 2021-11-03T16:52:03.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.420+0000 7f8b63206700 1 Processor -- start 2021-11-03T16:52:03.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.420+0000 7f8b63206700 1 -- start start 2021-11-03T16:52:03.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.421+0000 7f8b63206700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b5c0f66e0 0x7f8b5c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:03.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.421+0000 7f8b63206700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b5c0f6ff0 0x7f8b5c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:03.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.421+0000 7f8b63206700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5c06a380 con 0x7f8b5c0f6ff0 2021-11-03T16:52:03.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.421+0000 7f8b63206700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5c06a4c0 con 0x7f8b5c0f66e0 2021-11-03T16:52:03.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.421+0000 7f8b5bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b5c0f6ff0 0x7f8b5c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:03.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.421+0000 7f8b5bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b5c0f6ff0 0x7f8b5c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50012/0 (socket says 172.21.15.26:50012) 2021-11-03T16:52:03.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.421+0000 7f8b5bfff700 1 -- 172.21.15.26:0/2691001432 learned_addr learned my addr 172.21.15.26:0/2691001432 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:52:03.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.421+0000 7f8b60fa2700 1 --2- 172.21.15.26:0/2691001432 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b5c0f66e0 0x7f8b5c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:03.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.421+0000 7f8b5bfff700 1 -- 172.21.15.26:0/2691001432 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b5c0f66e0 msgr2=0x7f8b5c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:03.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.421+0000 7f8b5bfff700 1 --2- 172.21.15.26:0/2691001432 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b5c0f66e0 0x7f8b5c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:03.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.421+0000 7f8b5bfff700 1 -- 172.21.15.26:0/2691001432 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4c009640 con 0x7f8b5c0f6ff0 2021-11-03T16:52:03.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.421+0000 7f8b5bfff700 1 --2- 172.21.15.26:0/2691001432 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b5c0f6ff0 0x7f8b5c069e20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f8b4c004b70 tx=0x7f8b4c004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:03.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.421+0000 7f8b597fa700 1 -- 172.21.15.26:0/2691001432 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b4c00e070 con 0x7f8b5c0f6ff0 2021-11-03T16:52:03.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.421+0000 7f8b597fa700 1 -- 172.21.15.26:0/2691001432 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f8b4c01d8b0 con 0x7f8b5c0f6ff0 2021-11-03T16:52:03.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.421+0000 7f8b63206700 1 -- 172.21.15.26:0/2691001432 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b5c06a740 con 0x7f8b5c0f6ff0 2021-11-03T16:52:03.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.421+0000 7f8b597fa700 1 -- 172.21.15.26:0/2691001432 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b4c018070 con 0x7f8b5c0f6ff0 2021-11-03T16:52:03.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.421+0000 7f8b63206700 1 -- 172.21.15.26:0/2691001432 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b5c06ac20 con 0x7f8b5c0f6ff0 2021-11-03T16:52:03.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.422+0000 7f8b63206700 1 -- 172.21.15.26:0/2691001432 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b5c045ad0 con 0x7f8b5c0f6ff0 2021-11-03T16:52:03.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.423+0000 7f8b597fa700 1 -- 172.21.15.26:0/2691001432 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f8b4c024060 con 0x7f8b5c0f6ff0 2021-11-03T16:52:03.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.423+0000 7f8b597fa700 1 --2- 172.21.15.26:0/2691001432 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f8b4805c2a0 0x7f8b4805e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:03.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.423+0000 7f8b597fa700 1 -- 172.21.15.26:0/2691001432 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f8b4c0775b0 con 0x7f8b5c0f6ff0 2021-11-03T16:52:03.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.423+0000 7f8b60fa2700 1 --2- 172.21.15.26:0/2691001432 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f8b4805c2a0 0x7f8b4805e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:03.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.423+0000 7f8b60fa2700 1 --2- 172.21.15.26:0/2691001432 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f8b4805c2a0 0x7f8b4805e760 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f8b540041d0 tx=0x7f8b54009040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:03.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.427+0000 7f8b597fa700 1 -- 172.21.15.26:0/2691001432 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f8b4c04a5d0 con 0x7f8b5c0f6ff0 2021-11-03T16:52:03.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.612+0000 7f8b63206700 1 -- 172.21.15.26:0/2691001432 --> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b5c0ff000 con 0x7f8b4805c2a0 2021-11-03T16:52:03.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.622+0000 7f8b597fa700 1 -- 172.21.15.26:0/2691001432 <== mgr.14162 v2:172.21.15.26:6800/3029163595 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2160 (secure 0 0 0) 0x7f8b5c0ff000 con 0x7f8b4805c2a0 2021-11-03T16:52:03.619 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE VERSION IMAGE ID CONTAINER ID 2021-11-03T16:52:03.619 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (3m) 91s ago 4m 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T16:52:03.620 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (4m) 91s ago 4m 16.2.4 8d91d370c2b8 83a448d79108 2021-11-03T16:52:03.620 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (3m) 73s ago 3m 16.2.4 8d91d370c2b8 708c0ec0397b 2021-11-03T16:52:03.620 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (3m) 91s ago 4m 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T16:52:03.620 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:9283 running (5m) 91s ago 5m 16.2.4 8d91d370c2b8 65362b14caeb 2021-11-03T16:52:03.620 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8443,9283 running (3m) 73s ago 3m 16.2.4 8d91d370c2b8 e07291aea712 2021-11-03T16:52:03.621 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (5m) 91s ago 6m 16.2.4 8d91d370c2b8 c37e54308890 2021-11-03T16:52:03.621 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (3m) 73s ago 3m 16.2.4 8d91d370c2b8 b688a2953f0a 2021-11-03T16:52:03.621 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (4m) 91s ago 4m 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T16:52:03.621 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (3m) 73s ago 3m 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T16:52:03.622 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (2m) 91s ago 2m 16.2.4 8d91d370c2b8 d7f900ddf0f3 2021-11-03T16:52:03.622 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (2m) 91s ago 2m 16.2.4 8d91d370c2b8 9e5ffa11984b 2021-11-03T16:52:03.622 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (2m) 91s ago 2m 16.2.4 8d91d370c2b8 f65145633c0e 2021-11-03T16:52:03.622 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (114s) 73s ago 113s 16.2.4 8d91d370c2b8 ff6d474a5f9a 2021-11-03T16:52:03.622 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (95s) 73s ago 95s 16.2.4 8d91d370c2b8 e2fc9c0bdf0f 2021-11-03T16:52:03.623 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (76s) 73s ago 75s 16.2.4 8d91d370c2b8 0abc64d8a2bf 2021-11-03T16:52:03.623 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (3m) 91s ago 3m 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T16:52:03.624 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.624+0000 7f8b63206700 1 -- 172.21.15.26:0/2691001432 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f8b4805c2a0 msgr2=0x7f8b4805e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:03.624 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.624+0000 7f8b63206700 1 --2- 172.21.15.26:0/2691001432 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f8b4805c2a0 0x7f8b4805e760 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f8b540041d0 tx=0x7f8b54009040).stop 2021-11-03T16:52:03.624 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.624+0000 7f8b63206700 1 -- 172.21.15.26:0/2691001432 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b5c0f6ff0 msgr2=0x7f8b5c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:03.625 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.624+0000 7f8b63206700 1 --2- 172.21.15.26:0/2691001432 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b5c0f6ff0 0x7f8b5c069e20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f8b4c004b70 tx=0x7f8b4c004d10).stop 2021-11-03T16:52:03.625 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.624+0000 7f8b63206700 1 -- 172.21.15.26:0/2691001432 shutdown_connections 2021-11-03T16:52:03.625 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.624+0000 7f8b63206700 1 --2- 172.21.15.26:0/2691001432 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f8b4805c2a0 0x7f8b4805e760 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:03.625 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.624+0000 7f8b63206700 1 --2- 172.21.15.26:0/2691001432 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b5c0f66e0 0x7f8b5c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:03.626 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.624+0000 7f8b63206700 1 --2- 172.21.15.26:0/2691001432 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b5c0f6ff0 0x7f8b5c069e20 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:03.626 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.624+0000 7f8b63206700 1 -- 172.21.15.26:0/2691001432 >> 172.21.15.26:0/2691001432 conn(0x7f8b5c0f1f00 msgr2=0x7f8b5c0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:03.626 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.624+0000 7f8b63206700 1 -- 172.21.15.26:0/2691001432 shutdown_connections 2021-11-03T16:52:03.626 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:03.624+0000 7f8b63206700 1 -- 172.21.15.26:0/2691001432 wait complete. 2021-11-03T16:52:04.334 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:04 smithi026 conmon[32119]: cluster 2021-11-03T16:52:03.029750+0000 mgr.smithi026.cnrxli (mgr.14162) 208 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:52:04.349 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- bash -c 'ceph orch ls' 2021-11-03T16:52:04.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:04 smithi194 conmon[35111]: cluster 2021-11-03T16:52:03.029750+0000 mgr.smithi026.cnrxli (mgr.14162) 208 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:52:05.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:05 smithi026 conmon[32119]: audit 2021-11-03T16:52:03.614817+0000 mgr.smithi026.cnrxli 2021-11-03T16:52:05.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:05 smithi026 conmon[32119]: (mgr.14162) 209 : audit [DBG] from='client.14396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:52:05.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:05 smithi194 conmon[35111]: audit 2021-11-03T16:52:03.614817+0000 mgr.smithi026.cnrxli (mgr.14162) 209 : audit [DBG] from='client.14396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:52:06.074 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:06 smithi026 conmon[32119]: cluster 2021-11-03T16:52:05.030028+0000 mgr.smithi026.cnrxli (mgr.14162) 210 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:52:06.274 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.278+0000 7f14799f9700 1 -- 172.21.15.26:0/1308722252 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14740f75a0 msgr2=0x7f14740fdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:06.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.278+0000 7f14799f9700 1 --2- 172.21.15.26:0/1308722252 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14740f75a0 0x7f14740fdfc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f1468004690 tx=0x7f1468009b30).stop 2021-11-03T16:52:06.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.278+0000 7f14799f9700 1 -- 172.21.15.26:0/1308722252 shutdown_connections 2021-11-03T16:52:06.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.278+0000 7f14799f9700 1 --2- 172.21.15.26:0/1308722252 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14740f75a0 0x7f14740fdfc0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:06.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.278+0000 7f14799f9700 1 --2- 172.21.15.26:0/1308722252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14740f6c90 0x7f14740f70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T16:52:06.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.278+0000 7f14799f9700 1 -- 172.21.15.26:0/1308722252 >> 172.21.15.26:0/1308722252 conn(0x7f14740f04c0 msgr2=0x7f14740f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:06.276 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.278+0000 7f14799f9700 1 -- 172.21.15.26:0/1308722252 shutdown_connections 2021-11-03T16:52:06.276 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.278+0000 7f14799f9700 1 -- 172.21.15.26:0/1308722252 wait complete. 2021-11-03T16:52:06.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.278+0000 7f14799f9700 1 Processor -- start 2021-11-03T16:52:06.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.278+0000 7f14799f9700 1 -- start start 2021-11-03T16:52:06.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.279+0000 7f14799f9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14740f6c90 0x7f14741091a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:06.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.279+0000 7f14799f9700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14740f75a0 0x7f1474109690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:06.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.279+0000 7f14799f9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1474109cd0 con 0x7f14740f6c90 2021-11-03T16:52:06.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.279+0000 7f14799f9700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147410a580 con 0x7f14740f75a0 2021-11-03T16:52:06.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.279+0000 7f1472ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14740f6c90 0x7f14741091a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:06.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.279+0000 7f1472ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14740f6c90 0x7f14741091a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50020/0 (socket says 172.21.15.26:50020) 2021-11-03T16:52:06.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.279+0000 7f1472ffd700 1 -- 172.21.15.26:0/757283350 learned_addr learned my addr 172.21.15.26:0/757283350 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:52:06.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.279+0000 7f14727fc700 1 --2- 172.21.15.26:0/757283350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14740f75a0 0x7f1474109690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:06.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.279+0000 7f1472ffd700 1 -- 172.21.15.26:0/757283350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14740f75a0 msgr2=0x7f1474109690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:06.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.279+0000 7f1472ffd700 1 --2- 172.21.15.26:0/757283350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14740f75a0 0x7f1474109690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:06.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.279+0000 7f1472ffd700 1 -- 172.21.15.26:0/757283350 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1468005040 con 0x7f14740f6c90 2021-11-03T16:52:06.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.279+0000 7f1472ffd700 1 --2- 172.21.15.26:0/757283350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14740f6c90 0x7f14741091a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f146c00b790 tx=0x7f146c0092d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:06.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.279+0000 7f145b7fe700 1 -- 172.21.15.26:0/757283350 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f146c00d680 con 0x7f14740f6c90 2021-11-03T16:52:06.282 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.279+0000 7f145b7fe700 1 -- 172.21.15.26:0/757283350 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f146c00dc70 con 0x7f14740f6c90 2021-11-03T16:52:06.282 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.279+0000 7f14799f9700 1 -- 172.21.15.26:0/757283350 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f147410a860 con 0x7f14740f6c90 2021-11-03T16:52:06.282 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.279+0000 7f145b7fe700 1 -- 172.21.15.26:0/757283350 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f146c010c90 con 0x7f14740f6c90 2021-11-03T16:52:06.282 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.279+0000 7f14799f9700 1 -- 172.21.15.26:0/757283350 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f147410ada0 con 0x7f14740f6c90 2021-11-03T16:52:06.283 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.280+0000 7f14799f9700 1 -- 172.21.15.26:0/757283350 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14740f4150 con 0x7f14740f6c90 2021-11-03T16:52:06.283 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.281+0000 7f145b7fe700 1 -- 172.21.15.26:0/757283350 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f146c00f070 con 0x7f14740f6c90 2021-11-03T16:52:06.283 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.281+0000 7f145b7fe700 1 --2- 172.21.15.26:0/757283350 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f145c05c2b0 0x7f145c05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:06.283 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.281+0000 7f145b7fe700 1 -- 172.21.15.26:0/757283350 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f146c0758f0 con 0x7f14740f6c90 2021-11-03T16:52:06.284 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.281+0000 7f14727fc700 1 --2- 172.21.15.26:0/757283350 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f145c05c2b0 0x7f145c05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:06.284 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.281+0000 7f14727fc700 1 --2- 172.21.15.26:0/757283350 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f145c05c2b0 0x7f145c05e770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f1468000c00 tx=0x7f1468009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:06.285 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.285+0000 7f145b7fe700 1 -- 172.21.15.26:0/757283350 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f146c048910 con 0x7f14740f6c90 2021-11-03T16:52:06.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.470+0000 7f14799f9700 1 -- 172.21.15.26:0/757283350 --> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f1474101190 con 0x7f145c05c2b0 2021-11-03T16:52:06.472 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.476+0000 7f145b7fe700 1 -- 172.21.15.26:0/757283350 <== mgr.14162 v2:172.21.15.26:6800/3029163595 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1116 (secure 0 0 0) 0x7f1474101190 con 0x7f145c05c2b0 2021-11-03T16:52:06.472 INFO:teuthology.orchestra.run.smithi026.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2021-11-03T16:52:06.472 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager 1/1 94s ago 5m count:1 2021-11-03T16:52:06.473 INFO:teuthology.orchestra.run.smithi026.stdout:crash 2/2 94s ago 5m * 2021-11-03T16:52:06.473 INFO:teuthology.orchestra.run.smithi026.stdout:grafana 1/1 94s ago 5m count:1 2021-11-03T16:52:06.473 INFO:teuthology.orchestra.run.smithi026.stdout:mgr 2/2 94s ago 5m count:2 2021-11-03T16:52:06.473 INFO:teuthology.orchestra.run.smithi026.stdout:mon 2/2 94s ago 4m smithi026:172.21.15.26=smithi026;smithi194:172.21.15.194=smithi194;count:2 2021-11-03T16:52:06.474 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter 2/2 94s ago 5m * 2021-11-03T16:52:06.474 INFO:teuthology.orchestra.run.smithi026.stdout:osd.unmanaged 6/6 94s ago - 2021-11-03T16:52:06.474 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus 1/1 94s ago 5m count:1 2021-11-03T16:52:06.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.478+0000 7f14799f9700 1 -- 172.21.15.26:0/757283350 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f145c05c2b0 msgr2=0x7f145c05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:06.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.478+0000 7f14799f9700 1 --2- 172.21.15.26:0/757283350 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f145c05c2b0 0x7f145c05e770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f1468000c00 tx=0x7f1468009b30).stop 2021-11-03T16:52:06.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.478+0000 7f14799f9700 1 -- 172.21.15.26:0/757283350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14740f6c90 msgr2=0x7f14741091a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:06.476 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.478+0000 7f14799f9700 1 --2- 172.21.15.26:0/757283350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14740f6c90 0x7f14741091a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f146c00b790 tx=0x7f146c0092d0).stop 2021-11-03T16:52:06.476 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.478+0000 7f14799f9700 1 -- 172.21.15.26:0/757283350 shutdown_connections 2021-11-03T16:52:06.476 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.478+0000 7f14799f9700 1 --2- 172.21.15.26:0/757283350 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f145c05c2b0 0x7f145c05e770 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:06.476 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.478+0000 7f14799f9700 1 --2- 172.21.15.26:0/757283350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14740f6c90 0x7f14741091a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:06.476 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.478+0000 7f14799f9700 1 --2- 172.21.15.26:0/757283350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14740f75a0 0x7f1474109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:06.477 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.478+0000 7f14799f9700 1 -- 172.21.15.26:0/757283350 >> 172.21.15.26:0/757283350 conn(0x7f14740f04c0 msgr2=0x7f14740f28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:06.477 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.478+0000 7f14799f9700 1 -- 172.21.15.26:0/757283350 shutdown_connections 2021-11-03T16:52:06.477 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:06.478+0000 7f14799f9700 1 -- 172.21.15.26:0/757283350 wait complete. 2021-11-03T16:52:06.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:06 smithi194 conmon[35111]: cluster 2021-11-03T16:52:05.030028+0000 mgr.smithi026.cnrxli (mgr.14162) 210 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:52:07.196 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- bash -c 'ceph orch host ls' 2021-11-03T16:52:08.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:08 smithi026 conmon[32119]: audit 2021-11-03T16:52:06. 2021-11-03T16:52:08.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:08 smithi026 conmon[32119]: 473216+0000 mgr.smithi026.cnrxli (mgr.14162) 211 : audit [DBG] from='client.14400 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:52:08.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:08 smithi026 conmon[32119]: cluster 2021-11-03T16:52:07.030331+0000 mgr.smithi026.cnrxli (mgr.14162) 212 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:52:08.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:08 smithi194 conmon[35111]: audit 2021-11-03T16:52:06.473216+0000 mgr.smithi026.cnrxli (mgr.14162) 211 : audit [DBG] from='client.14400 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:52:08.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:08 smithi194 conmon[35111]: cluster 2021-11-03T16:52:07.030331+0000 mgr.smithi026.cnrxli (mgr.14162) 212 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:52:09.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.103+0000 7f4b09bbc700 1 -- 172.21.15.26:0/1369219232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b040f6ff0 msgr2=0x7f4b040f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:09.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.103+0000 7f4b09bbc700 1 --2- 172.21.15.26:0/1369219232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b040f6ff0 0x7f4b040f7a20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f4af4004660 tx=0x7f4af4009b30).stop 2021-11-03T16:52:09.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.103+0000 7f4b09bbc700 1 -- 172.21.15.26:0/1369219232 shutdown_connections 2021-11-03T16:52:09.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.103+0000 7f4b09bbc700 1 --2- 172.21.15.26:0/1369219232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b040f6ff0 0x7f4b040f7a20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:09.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.103+0000 7f4b09bbc700 1 --2- 172.21.15.26:0/1369219232 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b040f66e0 0x7f4b040f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:09.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.103+0000 7f4b09bbc700 1 -- 172.21.15.26:0/1369219232 >> 172.21.15.26:0/1369219232 conn(0x7f4b040f1f00 msgr2=0x7f4b040f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:09.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.103+0000 7f4b09bbc700 1 -- 172.21.15.26:0/1369219232 shutdown_connections 2021-11-03T16:52:09.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.103+0000 7f4b09bbc700 1 -- 172.21.15.26:0/1369219232 wait complete. 2021-11-03T16:52:09.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.104+0000 7f4b09bbc700 1 Processor -- start 2021-11-03T16:52:09.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.104+0000 7f4b09bbc700 1 -- start start 2021-11-03T16:52:09.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.104+0000 7f4b09bbc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b040f66e0 0x7f4b04106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:09.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.104+0000 7f4b09bbc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b040f6ff0 0x7f4b04107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:09.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.104+0000 7f4b09bbc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b04107a10 con 0x7f4b040f66e0 2021-11-03T16:52:09.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.104+0000 7f4b09bbc700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b04107b50 con 0x7f4b040f6ff0 2021-11-03T16:52:09.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.104+0000 7f4b037fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b040f66e0 0x7f4b04106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:09.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.104+0000 7f4b037fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b040f66e0 0x7f4b04106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50030/0 (socket says 172.21.15.26:50030) 2021-11-03T16:52:09.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.104+0000 7f4b037fe700 1 -- 172.21.15.26:0/896282405 learned_addr learned my addr 172.21.15.26:0/896282405 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:52:09.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.104+0000 7f4b02ffd700 1 --2- 172.21.15.26:0/896282405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b040f6ff0 0x7f4b04107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:09.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.104+0000 7f4b037fe700 1 -- 172.21.15.26:0/896282405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b040f6ff0 msgr2=0x7f4b04107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:09.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.104+0000 7f4b037fe700 1 --2- 172.21.15.26:0/896282405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b040f6ff0 0x7f4b04107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:09.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.104+0000 7f4b037fe700 1 -- 172.21.15.26:0/896282405 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af4005040 con 0x7f4b040f66e0 2021-11-03T16:52:09.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.105+0000 7f4b037fe700 1 --2- 172.21.15.26:0/896282405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b040f66e0 0x7f4b04106f70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f4aec0026d0 tx=0x7f4aec009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:09.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.105+0000 7f4afbfff700 1 -- 172.21.15.26:0/896282405 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4aec0079c0 con 0x7f4b040f66e0 2021-11-03T16:52:09.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.105+0000 7f4afbfff700 1 -- 172.21.15.26:0/896282405 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f4aec00f040 con 0x7f4b040f66e0 2021-11-03T16:52:09.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.105+0000 7f4b09bbc700 1 -- 172.21.15.26:0/896282405 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b041084f0 con 0x7f4b040f66e0 2021-11-03T16:52:09.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.105+0000 7f4afbfff700 1 -- 172.21.15.26:0/896282405 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4aec014820 con 0x7f4b040f66e0 2021-11-03T16:52:09.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.105+0000 7f4b09bbc700 1 -- 172.21.15.26:0/896282405 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b04108ab0 con 0x7f4b040f66e0 2021-11-03T16:52:09.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.106+0000 7f4b09bbc700 1 -- 172.21.15.26:0/896282405 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b04045ad0 con 0x7f4b040f66e0 2021-11-03T16:52:09.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.106+0000 7f4afbfff700 1 -- 172.21.15.26:0/896282405 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f4aec0090d0 con 0x7f4b040f66e0 2021-11-03T16:52:09.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.106+0000 7f4afbfff700 1 --2- 172.21.15.26:0/896282405 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f4af005c2b0 0x7f4af005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:09.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.106+0000 7f4afbfff700 1 -- 172.21.15.26:0/896282405 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f4aec075bc0 con 0x7f4b040f66e0 2021-11-03T16:52:09.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.106+0000 7f4b02ffd700 1 --2- 172.21.15.26:0/896282405 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f4af005c2b0 0x7f4af005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:09.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.107+0000 7f4b02ffd700 1 --2- 172.21.15.26:0/896282405 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f4af005c2b0 0x7f4af005e770 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f4af4005010 tx=0x7f4af4009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:09.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.110+0000 7f4afbfff700 1 -- 172.21.15.26:0/896282405 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f4aec048c90 con 0x7f4b040f66e0 2021-11-03T16:52:09.291 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.294+0000 7f4b09bbc700 1 -- 172.21.15.26:0/896282405 --> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f4b040ff050 con 0x7f4af005c2b0 2021-11-03T16:52:09.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.296+0000 7f4afbfff700 1 -- 172.21.15.26:0/896282405 <== mgr.14162 v2:172.21.15.26:6800/3029163595 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+126 (secure 0 0 0) 0x7f4b040ff050 con 0x7f4af005c2b0 2021-11-03T16:52:09.293 INFO:teuthology.orchestra.run.smithi026.stdout:HOST ADDR LABELS STATUS 2021-11-03T16:52:09.293 INFO:teuthology.orchestra.run.smithi026.stdout:smithi026 172.21.15.26 2021-11-03T16:52:09.293 INFO:teuthology.orchestra.run.smithi026.stdout:smithi194 smithi194 2021-11-03T16:52:09.294 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.297+0000 7f4b09bbc700 1 -- 172.21.15.26:0/896282405 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f4af005c2b0 msgr2=0x7f4af005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:09.295 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.297+0000 7f4b09bbc700 1 --2- 172.21.15.26:0/896282405 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f4af005c2b0 0x7f4af005e770 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f4af4005010 tx=0x7f4af4009b30).stop 2021-11-03T16:52:09.295 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.297+0000 7f4b09bbc700 1 -- 172.21.15.26:0/896282405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b040f66e0 msgr2=0x7f4b04106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:09.295 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.297+0000 7f4b09bbc700 1 --2- 172.21.15.26:0/896282405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b040f66e0 0x7f4b04106f70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f4aec0026d0 tx=0x7f4aec009de0).stop 2021-11-03T16:52:09.295 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.297+0000 7f4b09bbc700 1 -- 172.21.15.26:0/896282405 shutdown_connections 2021-11-03T16:52:09.296 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.297+0000 7f4b09bbc700 1 --2- 172.21.15.26:0/896282405 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f4af005c2b0 0x7f4af005e770 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:09.296 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.297+0000 7f4b09bbc700 1 --2- 172.21.15.26:0/896282405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b040f66e0 0x7f4b04106f70 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:09.296 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.297+0000 7f4b09bbc700 1 --2- 172.21.15.26:0/896282405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b040f6ff0 0x7f4b04107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:09.296 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.297+0000 7f4b09bbc700 1 -- 172.21.15.26:0/896282405 >> 172.21.15.26:0/896282405 conn(0x7f4b040f1f00 msgr2=0x7f4b040fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:09.296 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.298+0000 7f4b09bbc700 1 -- 172.21.15.26:0/896282405 shutdown_connections 2021-11-03T16:52:09.297 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:09.298+0000 7f4b09bbc700 1 -- 172.21.15.26:0/896282405 wait complete. 2021-11-03T16:52:10.063 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- bash -c 'ceph orch device ls' 2021-11-03T16:52:10.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:10 smithi026 conmon[32119]: cluster 2021-11-03T16:52:09.030670+0000 mgr.smithi026.cnrxli (mgr.14162) 213 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:52:10.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:10 smithi026 conmon[32119]: audit 2021-11-03T16:52:09.173345+0000 mon.smithi026 (mon.0) 457 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T16:52:10.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:10 smithi026 conmon[32119]: audit 2021-11-03T16:52:09.174580+0000 mon.smithi026 (mon.0) 458 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T16:52:10.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:10 smithi026 conmon[32119]: audit 2021-11-03T16:52:09.297205+0000 mgr.smithi026.cnrxli (mgr.14162) 214 : audit [DBG] from='client.14404 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:52:10.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:10 smithi194 conmon[35111]: cluster 2021-11-03T16:52:09.030670+0000 mgr.smithi026.cnrxli (mgr.14162) 213 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:52:10.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:10 smithi194 conmon[35111]: audit 2021-11-03T16:52:09.173345+0000 mon.smithi026 (mon.0) 457 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T16:52:10.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:10 smithi194 conmon[35111]: audit 2021-11-03T16:52:09.174580+0000 mon.smithi026 (mon.0) 458 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T16:52:10.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:10 smithi194 conmon[35111]: audit 2021-11-03T16:52:09 2021-11-03T16:52:10.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:10 smithi194 conmon[35111]: .297205+0000 mgr.smithi026.cnrxli (mgr.14162) 214 2021-11-03T16:52:10.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:10 smithi194 conmon[35111]: : audit [DBG] from='client.14404 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:52:11.966 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:11.970+0000 7efdc59dc700 1 -- 172.21.15.26:0/4051969944 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efdc00f6530 msgr2=0x7efdc00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:11.966 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:11.970+0000 7efdc59dc700 1 --2- 172.21.15.26:0/4051969944 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efdc00f6530 0x7efdc00f6950 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7efdb4004660 tx=0x7efdb4009b30).stop 2021-11-03T16:52:11.967 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:11.970+0000 7efdc59dc700 1 -- 172.21.15.26:0/4051969944 shutdown_connections 2021-11-03T16:52:11.967 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:11.970+0000 7efdc59dc700 1 --2- 172.21.15.26:0/4051969944 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efdc00f77d0 0x7efdc00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T16:52:11.967 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:11.970+0000 7efdc59dc700 1 --2- 172.21.15.26:0/4051969944 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efdc00f6530 0x7efdc00f6950 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:11.967 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:11.970+0000 7efdc59dc700 1 -- 172.21.15.26:0/4051969944 >> 172.21.15.26:0/4051969944 conn(0x7efdc00f1cd0 msgr2=0x7efdc00f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:11.968 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:11.970+0000 7efdc59dc700 1 -- 172.21.15.26:0/4051969944 shutdown_connections 2021-11-03T16:52:11.968 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:11.970+0000 7efdc59dc700 1 -- 172.21.15.26:0/4051969944 wait complete. 2021-11-03T16:52:11.968 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:11.971+0000 7efdc59dc700 1 Processor -- start 2021-11-03T16:52:11.968 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:11.971+0000 7efdc59dc700 1 -- start start 2021-11-03T16:52:11.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:11.971+0000 7efdc59dc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efdc00f6530 0x7efdc0108f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:11.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:11.971+0000 7efdc59dc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efdc00f77d0 0x7efdc0109440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:11.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:11.971+0000 7efdc59dc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc0109a80 con 0x7efdc00f6530 2021-11-03T16:52:11.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:11.971+0000 7efdc59dc700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc010a330 con 0x7efdc00f77d0 2021-11-03T16:52:11.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:11.971+0000 7efdc49da700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efdc00f6530 0x7efdc0108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:11.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:11.971+0000 7efdc49da700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efdc00f6530 0x7efdc0108f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50042/0 (socket says 172.21.15.26:50042) 2021-11-03T16:52:11.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:11.971+0000 7efdc49da700 1 -- 172.21.15.26:0/1704876064 learned_addr learned my addr 172.21.15.26:0/1704876064 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:52:11.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:11.972+0000 7efdc49da700 1 -- 172.21.15.26:0/1704876064 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efdc00f77d0 msgr2=0x7efdc0109440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:11.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:11.972+0000 7efdbffff700 1 --2- 172.21.15.26:0/1704876064 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efdc00f77d0 0x7efdc0109440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:11.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:11.972+0000 7efdc49da700 1 --2- 172.21.15.26:0/1704876064 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efdc00f77d0 0x7efdc0109440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:11.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:11.972+0000 7efdc49da700 1 -- 172.21.15.26:0/1704876064 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb4005040 con 0x7efdc00f6530 2021-11-03T16:52:11.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:11.972+0000 7efdc49da700 1 --2- 172.21.15.26:0/1704876064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efdc00f6530 0x7efdc0108f50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7efdb4007a60 tx=0x7efdb4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:11.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:11.972+0000 7efdbd7fa700 1 -- 172.21.15.26:0/1704876064 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdb4018070 con 0x7efdc00f6530 2021-11-03T16:52:11.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:11.972+0000 7efdbd7fa700 1 -- 172.21.15.26:0/1704876064 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7efdb4013410 con 0x7efdc00f6530 2021-11-03T16:52:11.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:11.972+0000 7efdc59dc700 1 -- 172.21.15.26:0/1704876064 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc010a5b0 con 0x7efdc00f6530 2021-11-03T16:52:11.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:11.972+0000 7efdbd7fa700 1 -- 172.21.15.26:0/1704876064 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdb401c620 con 0x7efdc00f6530 2021-11-03T16:52:11.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:11.972+0000 7efdc59dc700 1 -- 172.21.15.26:0/1704876064 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdc010ab10 con 0x7efdc00f6530 2021-11-03T16:52:11.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:11.973+0000 7efdc59dc700 1 -- 172.21.15.26:0/1704876064 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdc0059100 con 0x7efdc00f6530 2021-11-03T16:52:11.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:11.973+0000 7efdbd7fa700 1 -- 172.21.15.26:0/1704876064 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7efdb401d940 con 0x7efdc00f6530 2021-11-03T16:52:11.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:11.974+0000 7efdbd7fa700 1 --2- 172.21.15.26:0/1704876064 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7efdb005c300 0x7efdb005e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:11.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:11.974+0000 7efdbd7fa700 1 -- 172.21.15.26:0/1704876064 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7efdb4077b10 con 0x7efdc00f6530 2021-11-03T16:52:11.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:11.974+0000 7efdbffff700 1 --2- 172.21.15.26:0/1704876064 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7efdb005c300 0x7efdb005e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:11.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:11.974+0000 7efdbffff700 1 --2- 172.21.15.26:0/1704876064 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7efdb005c300 0x7efdb005e7c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7efdac00a6f0 tx=0x7efdac008040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:11.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:11.978+0000 7efdbd7fa700 1 -- 172.21.15.26:0/1704876064 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7efdb404ab30 con 0x7efdc00f6530 2021-11-03T16:52:12.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:12.163+0000 7efdc59dc700 1 -- 172.21.15.26:0/1704876064 --> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7efdc00fee30 con 0x7efdb005c300 2021-11-03T16:52:12.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:12.164+0000 7efdbd7fa700 1 -- 172.21.15.26:0/1704876064 <== mgr.14162 v2:172.21.15.26:6800/3029163595 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+279 (secure 0 0 0) 0x7efdc00fee30 con 0x7efdb005c300 2021-11-03T16:52:12.160 INFO:teuthology.orchestra.run.smithi026.stdout:Hostname Path Type Serial Size Health Ident Fault Available 2021-11-03T16:52:12.160 INFO:teuthology.orchestra.run.smithi026.stdout:smithi026 /dev/nvme0n1 ssd PHMB74760020480DGN 480G Unknown N/A N/A No 2021-11-03T16:52:12.161 INFO:teuthology.orchestra.run.smithi026.stdout:smithi194 /dev/nvme0n1 ssd CVFT6240002A400BGN 400G Unknown N/A N/A No 2021-11-03T16:52:12.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:12.166+0000 7efdc59dc700 1 -- 172.21.15.26:0/1704876064 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7efdb005c300 msgr2=0x7efdb005e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:12.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:12.166+0000 7efdc59dc700 1 --2- 172.21.15.26:0/1704876064 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7efdb005c300 0x7efdb005e7c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7efdac00a6f0 tx=0x7efdac008040).stop 2021-11-03T16:52:12.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:12.166+0000 7efdc59dc700 1 -- 172.21.15.26:0/1704876064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efdc00f6530 msgr2=0x7efdc0108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:12.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:12.166+0000 7efdc59dc700 1 --2- 172.21.15.26:0/1704876064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efdc00f6530 0x7efdc0108f50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7efdb4007a60 tx=0x7efdb4009b30).stop 2021-11-03T16:52:12.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:12.166+0000 7efdc59dc700 1 -- 172.21.15.26:0/1704876064 shutdown_connections 2021-11-03T16:52:12.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:12.166+0000 7efdc59dc700 1 --2- 172.21.15.26:0/1704876064 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7efdb005c300 0x7efdb005e7c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:12.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:12.166+0000 7efdc59dc700 1 --2- 172.21.15.26:0/1704876064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efdc00f6530 0x7efdc0108f50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:12.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:12.166+0000 7efdc59dc700 1 --2- 172.21.15.26:0/1704876064 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efdc00f77d0 0x7efdc0109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:12.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:12.166+0000 7efdc59dc700 1 -- 172.21.15.26:0/1704876064 >> 172.21.15.26:0/1704876064 conn(0x7efdc00f1cd0 msgr2=0x7efdc006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:12.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:12.166+0000 7efdc59dc700 1 -- 172.21.15.26:0/1704876064 shutdown_connections 2021-11-03T16:52:12.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:12.166+0000 7efdc59dc700 1 -- 172.21.15.26:0/1704876064 wait complete. 2021-11-03T16:52:12.404 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:12 smithi026 conmon[32119]: cluster 2021-11-03T16:52:11.031151+0000 mgr.smithi026.cnrxli 2021-11-03T16:52:12.404 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:12 smithi026 conmon[32119]: (mgr.14162) 215 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:52:12.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:12 smithi194 conmon[35111]: cluster 2021-11-03T16:52:11.031151+0000 mgr.smithi026.cnrxli (mgr.14162) 215 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:52:12.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:12 smithi194 conmon[35111]: 2021-11-03T16:52:12.904 INFO:teuthology.run_tasks:Running task cephadm.shell... 2021-11-03T16:52:12.914 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi026.front.sepia.ceph.com 2021-11-03T16:52:12.915 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- bash -c 'ceph fs volume create cephfs --placement=4' 2021-11-03T16:52:13.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:13 smithi026 conmon[32119]: audit 2021-11-03T16:52:12.164435+0000 mgr.smithi026.cnrxli (mgr.14162) 216 : audit [DBG] 2021-11-03T16:52:13.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:13 smithi026 conmon[32119]: from='client.14408 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:52:13.471 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:13 smithi194 conmon[35111]: audit 2021-11-03T16:52:12.164435+0000 mgr.smithi026.cnrxli (mgr.14162) 2021-11-03T16:52:13.471 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:13 smithi194 conmon[35111]: 216 : audit [DBG] from='client.14408 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:52:14.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:14 smithi026 conmon[32119]: cluster 2021-11-03T16:52:13.031506+0000 mgr.smithi026.cnrxli ( 2021-11-03T16:52:14.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:14 smithi026 conmon[32119]: mgr.14162) 217 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:52:14.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:14 smithi194 conmon[35111]: cluster 2021-11-03T16:52:13.031506+0000 mgr.smithi026.cnrxli (mgr.14162) 217 : cluster 2021-11-03T16:52:14.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:14 smithi194 conmon[35111]: [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:52:15.045 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:15.046+0000 7f4a5abcb700 1 -- 172.21.15.26:0/613036004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a540f51a0 msgr2=0x7f4a540f7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:15.046 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:15.046+0000 7f4a5abcb700 1 --2- 172.21.15.26:0/613036004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a540f51a0 0x7f4a540f7920 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f4a50004660 tx=0x7f4a50009b30).stop 2021-11-03T16:52:15.046 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:15.046+0000 7f4a5abcb700 1 -- 172.21.15.26:0/613036004 shutdown_connections 2021-11-03T16:52:15.046 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:15.046+0000 7f4a5abcb700 1 --2- 172.21.15.26:0/613036004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a540f51a0 0x7f4a540f7920 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:15.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:15.046+0000 7f4a5abcb700 1 --2- 172.21.15.26:0/613036004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a540f4800 0x7f4a540f4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T16:52:15.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:15.046+0000 7f4a5abcb700 1 -- 172.21.15.26:0/613036004 >> 172.21.15.26:0/613036004 conn(0x7f4a540f0320 msgr2=0x7f4a540f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:15.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:15.046+0000 7f4a5abcb700 1 -- 172.21.15.26:0/613036004 shutdown_connections 2021-11-03T16:52:15.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:15.046+0000 7f4a5abcb700 1 -- 172.21.15.26:0/613036004 wait complete. 2021-11-03T16:52:15.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:15.047+0000 7f4a5abcb700 1 Processor -- start 2021-11-03T16:52:15.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:15.047+0000 7f4a5abcb700 1 -- start start 2021-11-03T16:52:15.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:15.047+0000 7f4a5abcb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a540f4800 0x7f4a540f73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:15.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:15.047+0000 7f4a5abcb700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a540f51a0 0x7f4a540f5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:15.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:15.047+0000 7f4a5abcb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5410aac0 con 0x7f4a540f4800 2021-11-03T16:52:15.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:15.047+0000 7f4a5abcb700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5410ac00 con 0x7f4a540f51a0 2021-11-03T16:52:15.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:15.047+0000 7f4a59bc9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a540f4800 0x7f4a540f73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:15.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:15.047+0000 7f4a59bc9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a540f4800 0x7f4a540f73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50050/0 (socket says 172.21.15.26:50050) 2021-11-03T16:52:15.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:15.047+0000 7f4a59bc9700 1 -- 172.21.15.26:0/3262302064 learned_addr learned my addr 172.21.15.26:0/3262302064 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:52:15.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:15.047+0000 7f4a593c8700 1 --2- 172.21.15.26:0/3262302064 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a540f51a0 0x7f4a540f5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:15.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:15.048+0000 7f4a59bc9700 1 -- 172.21.15.26:0/3262302064 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a540f51a0 msgr2=0x7f4a540f5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:15.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:15.048+0000 7f4a59bc9700 1 --2- 172.21.15.26:0/3262302064 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a540f51a0 0x7f4a540f5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:15.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:15.048+0000 7f4a59bc9700 1 -- 172.21.15.26:0/3262302064 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a50005040 con 0x7f4a540f4800 2021-11-03T16:52:15.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:15.048+0000 7f4a59bc9700 1 --2- 172.21.15.26:0/3262302064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a540f4800 0x7f4a540f73b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f4a440093f0 tx=0x7f4a44006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:15.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:15.048+0000 7f4a4a7fc700 1 -- 172.21.15.26:0/3262302064 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a44013640 con 0x7f4a540f4800 2021-11-03T16:52:15.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:15.048+0000 7f4a4a7fc700 1 -- 172.21.15.26:0/3262302064 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f4a44013c30 con 0x7f4a540f4800 2021-11-03T16:52:15.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:15.048+0000 7f4a5abcb700 1 -- 172.21.15.26:0/3262302064 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a540f5e70 con 0x7f4a540f4800 2021-11-03T16:52:15.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:15.048+0000 7f4a5abcb700 1 -- 172.21.15.26:0/3262302064 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a540f6430 con 0x7f4a540f4800 2021-11-03T16:52:15.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:15.048+0000 7f4a4a7fc700 1 -- 172.21.15.26:0/3262302064 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a44012be0 con 0x7f4a540f4800 2021-11-03T16:52:15.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:15.049+0000 7f4a5abcb700 1 -- 172.21.15.26:0/3262302064 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a54059100 con 0x7f4a540f4800 2021-11-03T16:52:15.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:15.049+0000 7f4a4a7fc700 1 -- 172.21.15.26:0/3262302064 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f4a4401a060 con 0x7f4a540f4800 2021-11-03T16:52:15.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:15.050+0000 7f4a4a7fc700 1 --2- 172.21.15.26:0/3262302064 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f4a4005c300 0x7f4a4005e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:15.053 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:15.050+0000 7f4a4a7fc700 1 -- 172.21.15.26:0/3262302064 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f4a44075b30 con 0x7f4a540f4800 2021-11-03T16:52:15.053 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:15.050+0000 7f4a593c8700 1 --2- 172.21.15.26:0/3262302064 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f4a4005c300 0x7f4a4005e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:15.053 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:15.050+0000 7f4a593c8700 1 --2- 172.21.15.26:0/3262302064 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f4a4005c300 0x7f4a4005e7c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f4a50004630 tx=0x7f4a50009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:15.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:15.054+0000 7f4a4a7fc700 1 -- 172.21.15.26:0/3262302064 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f4a44048af0 con 0x7f4a540f4800 2021-11-03T16:52:15.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:15.241+0000 7f4a5abcb700 1 -- 172.21.15.26:0/3262302064 --> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a540fee30 con 0x7f4a4005c300 2021-11-03T16:52:16.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:16 smithi026 conmon[32119]: cluster 2021-11-03T16:52:15.031758+0000 mgr.smithi026.cnrxli 2021-11-03T16:52:16.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:16 smithi026 conmon[32119]: (mgr.14162) 218 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:52:16.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:16 smithi026 conmon[32119]: audit 2021-11-03T16:52:15.243381+0000 mgr.smithi026.cnrxli (mgr. 2021-11-03T16:52:16.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:16 smithi026 conmon[32119]: 14162) 219 : audit [DBG] from='client.14412 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:52:16.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:16 smithi026 conmon[32119]: audit 2021 2021-11-03T16:52:16.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:16 smithi026 conmon[32119]: -11-03T16:52:15.243936+0000 mon.smithi026 (mon 2021-11-03T16:52:16.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:16 smithi026 conmon[32119]: .0) 459 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2021-11-03T16:52:16.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:16 smithi194 conmon[35111]: cluster 2021-11-03T16:52:15.031758+0000 mgr.smithi026.cnrxli (mgr.14162) 218 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:52:16.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:16 smithi194 conmon[35111]: 2021-11-03T16:52:16.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:16 smithi194 conmon[35111]: audit 2021-11-03T16:52:15.243381+0000 mgr.smithi026.cnrxli (mgr.14162) 219 : audit [DBG] from='client.14412 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:52:16.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:16 smithi194 conmon[35111]: audit 2021-11-03T16:52:15.243936+0000 mon.smithi026 (mon.0) 459 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2021-11-03T16:52:16.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:16 smithi194 conmon[35111]: 2021-11-03T16:52:17.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:17.131+0000 7f4a4a7fc700 1 -- 172.21.15.26:0/3262302064 <== mgr.14162 v2:172.21.15.26:6800/3029163595 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f4a540fee30 con 0x7f4a4005c300 2021-11-03T16:52:17.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:17.133+0000 7f4a5abcb700 1 -- 172.21.15.26:0/3262302064 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f4a4005c300 msgr2=0x7f4a4005e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:17.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:17.133+0000 7f4a5abcb700 1 --2- 172.21.15.26:0/3262302064 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f4a4005c300 0x7f4a4005e7c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f4a50004630 tx=0x7f4a50009b30).stop 2021-11-03T16:52:17.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:17.133+0000 7f4a5abcb700 1 -- 172.21.15.26:0/3262302064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a540f4800 msgr2=0x7f4a540f73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:17.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:17.133+0000 7f4a5abcb700 1 --2- 172.21.15.26:0/3262302064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a540f4800 0x7f4a540f73b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f4a440093f0 tx=0x7f4a44006ec0).stop 2021-11-03T16:52:17.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:17.134+0000 7f4a5abcb700 1 -- 172.21.15.26:0/3262302064 shutdown_connections 2021-11-03T16:52:17.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:17.134+0000 7f4a5abcb700 1 --2- 172.21.15.26:0/3262302064 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f4a4005c300 0x7f4a4005e7c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:17.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:17.134+0000 7f4a5abcb700 1 --2- 172.21.15.26:0/3262302064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a540f4800 0x7f4a540f73b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:17.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:17.134+0000 7f4a5abcb700 1 --2- 172.21.15.26:0/3262302064 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a540f51a0 0x7f4a540f5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:17.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:17.134+0000 7f4a5abcb700 1 -- 172.21.15.26:0/3262302064 >> 172.21.15.26:0/3262302064 conn(0x7f4a540f0320 msgr2=0x7f4a540fb370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:17.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:17.134+0000 7f4a5abcb700 1 -- 172.21.15.26:0/3262302064 shutdown_connections 2021-11-03T16:52:17.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:17.134+0000 7f4a5abcb700 1 -- 172.21.15.26:0/3262302064 wait complete. 2021-11-03T16:52:17.404 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:17 smithi026 conmon[32119]: audit 2021-11-03T16:52:16.098243+0000 mon.smithi026 2021-11-03T16:52:17.404 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:17 smithi026 conmon[32119]: (mon.0) 460 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2021-11-03T16:52:17.404 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:17 smithi026 conmon[32119]: cluster 2021-11-03T16:52:16.098311+0000 mon.smithi026 (mon.0) 461 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2021-11-03T16:52:17.404 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:17 smithi026 conmon[32119]: audit 2021-11-03T16:52 2021-11-03T16:52:17.405 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:17 smithi026 conmon[32119]: :16.099596+0000 mon.smithi026 (mon. 2021-11-03T16:52:17.405 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:17 smithi026 conmon[32119]: 0) 462 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2021-11-03T16:52:17.405 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:17 smithi026 conmon[32119]: debug 2021-11-03T16:52:17.109+0000 7fee57d63700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-03T16:52:17.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:17 smithi194 conmon[35111]: audit 2021-11-03T16:52:16.098243+0000 mon.smithi026 (mon.0) 460 : audit [INF] 2021-11-03T16:52:17.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:17 smithi194 conmon[35111]: from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2021-11-03T16:52:17.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:17 smithi194 conmon[35111]: cluster 2021-11-03T16:52:16.098311+0000 mon.smithi026 (mon.0) 461 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2021-11-03T16:52:17.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:17 smithi194 conmon[35111]: audit 2021-11-03T16:52:16.099596+0000 mon.smithi026 (mon.0) 462 : audit [INF] 2021-11-03T16:52:17.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:17 smithi194 conmon[35111]: from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2021-11-03T16:52:17.924 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- bash -c 'ceph fs dump' 2021-11-03T16:52:18.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:18 smithi026 conmon[32119]: cluster 2021-11-03T16:52:17.032163+0000 mgr.smithi026.cnrxli (mgr.14162) 220 : cluster [DBG] pgmap v181: 33 pgs: 3 creating+peering, 1 active+clean, 29 unknown; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:52:18.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:18 smithi026 conmon[32119]: audit 2021-11-03T16:52:17.104825+0000 mon.smithi026 (mon.0) 463 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2021-11-03T16:52:18.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:18 smithi026 conmon[32119]: cluster 2021-11-03T16:52:17.105076+0000 mon.smithi026 (mon.0) 464 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2021-11-03T16:52:18.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:18 smithi026 conmon[32119]: audit 2021-11-03T16:52:17.109130+0000 mon.smithi026 (mon.0) 465 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2021-11-03T16:52:18.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:18 smithi026 conmon[32119]: cluster 2021-11-03T16:52:17.110067+0000 mon.smithi026 (mon.0) 466 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-03T16:52:18.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:18 smithi026 conmon[32119]: cluster 2021-11-03T16:52:17.110100+0000 mon.smithi026 (mon.0) 467 2021-11-03T16:52:18.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:18 smithi026 conmon[32119]: : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2021-11-03T16:52:18.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:18 smithi026 conmon[32119]: cluster 2021-11-03T16:52:17.118185+0000 mon.smithi026 (mon.0) 468 : cluster [DBG] osdmap e40: 6 total, 6 up, 6 in 2021-11-03T16:52:18.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:18 smithi026 conmon[32119]: audit 2021-11-03T16:52:17.118554+0000 mon.smithi026 (mon.0) 469 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2021-11-03T16:52:18.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:18 smithi026 conmon[32119]: cluster 2021-11-03T16:52:17.118659+0000 mon.smithi026 (mon.0) 470 : cluster [DBG] fsmap cephfs:0 2021-11-03T16:52:18.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:18 smithi026 conmon[32119]: cephadm 2021-11-03T16:52:17.124302+0000 mgr.smithi026.cnrxli (mgr.14162) 221 : cephadm [INF] Saving service mds.cephfs spec with placement count:4 2021-11-03T16:52:18.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:18 smithi026 conmon[32119]: audit 2021-11-03T16:52:17.131619+0000 mon.smithi026 (mon.0) 471 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:52:18.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:18 smithi026 conmon[32119]: audit 2021-11-03T16:52:17.132806+0000 mon.smithi026 (mon.0) 472 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:52:18.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:18 smithi026 conmon[32119]: audit 2021-11-03T16:52:17.142962+0000 mon.smithi026 (mon.0) 473 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:52:18.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:18 smithi026 conmon[32119]: audit 2021-11-03T16:52:17.150665+0000 mon.smithi026 (mon.0) 474 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:52:18.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:18 smithi026 conmon[32119]: audit 2021-11-03T16:52:17.151636+0000 mon.smithi026 (mon.0) 475 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi194.kwikhp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2021-11-03T16:52:18.178 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:18 smithi026 conmon[32119]: audit 2021-11-03T16:52:17.154784+0000 mon.smithi026 2021-11-03T16:52:18.178 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:18 smithi026 conmon[32119]: (mon.0) 476 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi194.kwikhp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2021-11-03T16:52:18.178 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:18 smithi026 conmon[32119]: audit 2021 2021-11-03T16:52:18.178 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:18 smithi026 conmon[32119]: -11-03T16:52:17.155535+0000 mon.smithi026 (mon. 2021-11-03T16:52:18.179 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:18 smithi026 conmon[32119]: 0) 477 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:52:18.179 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:18 smithi026 conmon[32119]: cephadm 2021-11-03T16:52:17.156276+0000 mgr.smithi026.cnrxli 2021-11-03T16:52:18.179 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:18 smithi026 conmon[32119]: (mgr.14162) 222 : cephadm [INF] Deploying daemon mds.cephfs.smithi194.kwikhp on smithi194 2021-11-03T16:52:18.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:18 smithi194 conmon[35111]: cluster 2021-11-03T16:52:17.032163+0000 mgr.smithi026.cnrxli (mgr.14162) 220 : cluster [DBG] pgmap v181: 33 pgs: 3 creating+peering, 1 active+clean, 29 unknown; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:52:18.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:18 smithi194 conmon[35111]: audit 2021-11-03T16:52:17.104825+0000 mon.smithi026 (mon.0) 463 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2021-11-03T16:52:18.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:18 smithi194 conmon[35111]: cluster 2021-11-03T16:52:17.105076+0000 mon.smithi026 (mon.0) 464 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2021-11-03T16:52:18.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:18 smithi194 conmon[35111]: audit 2021-11-03T16:52:17.109130+0000 mon.smithi026 (mon.0) 465 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2021-11-03T16:52:18.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:18 smithi194 conmon[35111]: cluster 2021-11-03T16:52:17.110067+0000 mon.smithi026 (mon.0) 466 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-03T16:52:18.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:18 smithi194 conmon[35111]: cluster 2021-11-03T16:52:17.110100+0000 mon.smithi026 (mon.0) 467 : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2021-11-03T16:52:18.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:18 smithi194 conmon[35111]: cluster 2021-11-03T16:52:17.118185+0000 mon.smithi026 (mon.0) 468 : cluster [DBG] osdmap e40: 6 total, 6 up, 6 in 2021-11-03T16:52:18.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:18 smithi194 conmon[35111]: audit 2021-11-03T16:52:17.118554+0000 mon.smithi026 (mon.0) 469 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2021-11-03T16:52:18.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:18 smithi194 conmon[35111]: cluster 2021-11-03T16:52:17.118659+0000 mon.smithi026 (mon.0) 470 : cluster [DBG] fsmap cephfs:0 2021-11-03T16:52:18.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:18 smithi194 conmon[35111]: cephadm 2021-11-03T16:52:17.124302+0000 mgr.smithi026.cnrxli (mgr.14162) 221 : cephadm [INF] Saving service mds.cephfs spec with placement count:4 2021-11-03T16:52:18.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:18 smithi194 conmon[35111]: audit 2021-11-03T16:52:17.131619+0000 mon.smithi026 (mon.0) 471 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:52:18.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:18 smithi194 conmon[35111]: audit 2021-11-03T16:52:17.132806+0000 mon.smithi026 (mon.0) 472 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:52:18.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:18 smithi194 conmon[35111]: audit 2021-11-03T16:52:17.142962+0000 mon.smithi026 (mon.0) 473 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:52:18.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:18 smithi194 conmon[35111]: audit 2021-11-03T16: 2021-11-03T16:52:18.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:18 smithi194 conmon[35111]: 52:17.150665+0000 mon.smithi026 (mon.0) 474 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:52:18.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:18 smithi194 conmon[35111]: audit 2021-11-03T16:52:17.151636+0000 mon.smithi026 ( 2021-11-03T16:52:18.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:18 smithi194 conmon[35111]: mon.0) 475 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi194.kwikhp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2021-11-03T16:52:18.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:18 smithi194 conmon[35111]: audit 2021-11-03T16:52 2021-11-03T16:52:18.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:18 smithi194 conmon[35111]: :17.154784+0000 mon.smithi026 (mon.0) 476 2021-11-03T16:52:18.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:18 smithi194 conmon[35111]: : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi194.kwikhp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2021-11-03T16:52:18.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:18 smithi194 conmon[35111]: audit 2021-11- 2021-11-03T16:52:18.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:18 smithi194 conmon[35111]: 03T16:52:17.155535+0000 mon.smithi026 (mon.0) 2021-11-03T16:52:18.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:18 smithi194 conmon[35111]: 477 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:52:18.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:18 smithi194 conmon[35111]: cephadm 2021-11- 2021-11-03T16:52:18.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:18 smithi194 conmon[35111]: 03T16:52:17.156276+0000 mgr.smithi026.cnrxli ( 2021-11-03T16:52:18.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:18 smithi194 conmon[35111]: mgr.14162) 222 : cephadm [INF] Deploying daemon mds.cephfs.smithi194.kwikhp on smithi194 2021-11-03T16:52:19.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:19 smithi026 conmon[32119]: cluster 2021-11-03T16:52:18. 2021-11-03T16:52:19.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:19 smithi026 conmon[32119]: 116991+0000 mon.smithi026 (mon.0) 478 : cluster [DBG] osdmap e41: 6 total, 6 up, 6 in 2021-11-03T16:52:19.464 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:19 smithi194 conmon[35111]: cluster 2021-11-03T16:52:18.116991+0000 mon.smithi026 (mon.0) 478 : 2021-11-03T16:52:19.465 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:19 smithi194 conmon[35111]: cluster [DBG] osdmap e41: 6 total, 6 up, 6 in 2021-11-03T16:52:19.951 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:19.956+0000 7f1714dce700 1 -- 172.21.15.26:0/136934459 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17100f6530 msgr2=0x7f17100f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:19.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:19.956+0000 7f1714dce700 1 --2- 172.21.15.26:0/136934459 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17100f6530 0x7f17100f6950 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f1700004660 tx=0x7f1700009b30).stop 2021-11-03T16:52:19.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:19.956+0000 7f1714dce700 1 -- 172.21.15.26:0/136934459 shutdown_connections 2021-11-03T16:52:19.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:19.956+0000 7f1714dce700 1 --2- 172.21.15.26:0/136934459 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17100f77d0 0x7f17100f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:19.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:19.956+0000 7f1714dce700 1 --2- 172.21.15.26:0/136934459 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17100f6530 0x7f17100f6950 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:19.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:19.956+0000 7f1714dce700 1 -- 172.21.15.26:0/136934459 >> 172.21.15.26:0/136934459 conn(0x7f17100f1c90 msgr2=0x7f17100f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:19.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:19.956+0000 7f1714dce700 1 -- 172.21.15.26:0/136934459 shutdown_connections 2021-11-03T16:52:19.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:19.956+0000 7f1714dce700 1 -- 172.21.15.26:0/136934459 wait complete. 2021-11-03T16:52:19.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:19.956+0000 7f1714dce700 1 Processor -- start 2021-11-03T16:52:19.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:19.957+0000 7f1714dce700 1 -- start start 2021-11-03T16:52:19.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:19.957+0000 7f1714dce700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17100f6530 0x7f1710106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:19.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:19.957+0000 7f1714dce700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17100f77d0 0x7f1710107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:19.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:19.957+0000 7f1714dce700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1710107880 con 0x7f17100f6530 2021-11-03T16:52:19.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:19.957+0000 7f1714dce700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1710108090 con 0x7f17100f77d0 2021-11-03T16:52:19.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:19.957+0000 7f170f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17100f6530 0x7f1710106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:19.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:19.957+0000 7f170f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17100f6530 0x7f1710106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50060/0 (socket says 172.21.15.26:50060) 2021-11-03T16:52:19.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:19.957+0000 7f170f7fe700 1 -- 172.21.15.26:0/551242405 learned_addr learned my addr 172.21.15.26:0/551242405 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:52:19.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:19.957+0000 7f170effd700 1 --2- 172.21.15.26:0/551242405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17100f77d0 0x7f1710107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:19.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:19.957+0000 7f170f7fe700 1 -- 172.21.15.26:0/551242405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17100f77d0 msgr2=0x7f1710107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:19.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:19.957+0000 7f170f7fe700 1 --2- 172.21.15.26:0/551242405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17100f77d0 0x7f1710107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:19.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:19.957+0000 7f170f7fe700 1 -- 172.21.15.26:0/551242405 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1700005040 con 0x7f17100f6530 2021-11-03T16:52:19.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:19.958+0000 7f170f7fe700 1 --2- 172.21.15.26:0/551242405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17100f6530 0x7f1710106d90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f1700004e30 tx=0x7f1700009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:19.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:19.958+0000 7f16f7fff700 1 -- 172.21.15.26:0/551242405 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1700018070 con 0x7f17100f6530 2021-11-03T16:52:19.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:19.958+0000 7f1714dce700 1 -- 172.21.15.26:0/551242405 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17101082b0 con 0x7f17100f6530 2021-11-03T16:52:19.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:19.958+0000 7f16f7fff700 1 -- 172.21.15.26:0/551242405 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f1700013410 con 0x7f17100f6530 2021-11-03T16:52:19.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:19.958+0000 7f16f7fff700 1 -- 172.21.15.26:0/551242405 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f170001c3c0 con 0x7f17100f6530 2021-11-03T16:52:19.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:19.958+0000 7f1714dce700 1 -- 172.21.15.26:0/551242405 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1710108810 con 0x7f17100f6530 2021-11-03T16:52:19.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:19.959+0000 7f1714dce700 1 -- 172.21.15.26:0/551242405 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1710059100 con 0x7f17100f6530 2021-11-03T16:52:19.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:19.959+0000 7f16f7fff700 1 -- 172.21.15.26:0/551242405 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f170001d420 con 0x7f17100f6530 2021-11-03T16:52:19.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:19.960+0000 7f16f7fff700 1 --2- 172.21.15.26:0/551242405 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f16f805c300 0x7f16f805e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:19.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:19.960+0000 7f16f7fff700 1 -- 172.21.15.26:0/551242405 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f1700077b20 con 0x7f17100f6530 2021-11-03T16:52:19.961 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:19.960+0000 7f170effd700 1 --2- 172.21.15.26:0/551242405 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f16f805c300 0x7f16f805e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:19.961 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:19.960+0000 7f170effd700 1 --2- 172.21.15.26:0/551242405 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f16f805c300 0x7f16f805e7c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f1704004ce0 tx=0x7f170400b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:19.961 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:19.965+0000 7f16f7fff700 1 -- 172.21.15.26:0/551242405 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f170004a800 con 0x7f17100f6530 2021-11-03T16:52:20.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:20.172+0000 7f1714dce700 1 -- 172.21.15.26:0/551242405 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f17100fecf0 con 0x7f17100f6530 2021-11-03T16:52:20.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:20.173+0000 7f16f7fff700 1 -- 172.21.15.26:0/551242405 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1003 (secure 0 0 0) 0x7f170004de20 con 0x7f17100f6530 2021-11-03T16:52:20.169 INFO:teuthology.orchestra.run.smithi026.stdout:e2 2021-11-03T16:52:20.169 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T16:52:20.169 INFO:teuthology.orchestra.run.smithi026.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T16:52:20.170 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T16:52:20.170 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:52:20.170 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T16:52:20.170 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T16:52:20.171 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 2 2021-11-03T16:52:20.171 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 2021-11-03T16:52:20.171 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T16:52:20.171 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:52:17.109969+0000 2021-11-03T16:52:20.172 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T16:52:20.172 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T16:52:20.172 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T16:52:20.172 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T16:52:20.172 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T16:52:20.173 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T16:52:20.173 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T16:52:20.173 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 0 2021-11-03T16:52:20.173 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T16:52:20.174 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T16:52:20.174 INFO:teuthology.orchestra.run.smithi026.stdout:in 2021-11-03T16:52:20.174 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T16:52:20.174 INFO:teuthology.orchestra.run.smithi026.stdout:failed 2021-11-03T16:52:20.174 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T16:52:20.175 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T16:52:20.175 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T16:52:20.175 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T16:52:20.176 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T16:52:20.176 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T16:52:20.176 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 0 2021-11-03T16:52:20.176 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:52:20.176 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:52:20.177 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:20.175+0000 7f1714dce700 1 -- 172.21.15.26:0/551242405 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f16f805c300 msgr2=0x7f16f805e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:20.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:20.175+0000 7f1714dce700 1 --2- 172.21.15.26:0/551242405 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f16f805c300 0x7f16f805e7c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f1704004ce0 tx=0x7f170400b040).stop 2021-11-03T16:52:20.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:20.175+0000 7f1714dce700 1 -- 172.21.15.26:0/551242405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17100f6530 msgr2=0x7f1710106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:20.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:20.175+0000 7f1714dce700 1 --2- 172.21.15.26:0/551242405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17100f6530 0x7f1710106d90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f1700004e30 tx=0x7f1700009b30).stop 2021-11-03T16:52:20.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:20.175+0000 7f1714dce700 1 -- 172.21.15.26:0/551242405 shutdown_connections 2021-11-03T16:52:20.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:20.175+0000 7f1714dce700 1 --2- 172.21.15.26:0/551242405 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f16f805c300 0x7f16f805e7c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:20.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:20.175+0000 7f1714dce700 1 --2- 172.21.15.26:0/551242405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17100f6530 0x7f1710106d90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:20.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:20.175+0000 7f1714dce700 1 --2- 172.21.15.26:0/551242405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17100f77d0 0x7f1710107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:20.180 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:20.175+0000 7f1714dce700 1 -- 172.21.15.26:0/551242405 >> 172.21.15.26:0/551242405 conn(0x7f17100f1c90 msgr2=0x7f17100fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:20.180 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:20.175+0000 7f1714dce700 1 -- 172.21.15.26:0/551242405 shutdown_connections 2021-11-03T16:52:20.181 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:20.175+0000 7f1714dce700 1 -- 172.21.15.26:0/551242405 wait complete. 2021-11-03T16:52:20.181 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 2 2021-11-03T16:52:20.404 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:20 smithi026 conmon[32119]: cluster 2021-11-03T16:52:19.032522+0000 2021-11-03T16:52:20.404 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:20 smithi026 conmon[32119]: mgr.smithi026.cnrxli (mgr.14162) 223 : cluster [DBG] pgmap v185: 65 pgs: 18 active+clean, 1 active, 4 creating+activating, 8 creating+peering, 34 unknown; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:52:20.404 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:20 smithi026 conmon[32119]: cluster 2021-11-03T16:52:19.121310+0000 mon.smithi026 (mon.0) 479 : cluster [DBG] osdmap e42: 6 total, 6 up, 6 in 2021-11-03T16:52:20.405 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:20 smithi026 conmon[32119]: audit 2021-11-03T16:52:19.520393+0000 mon.smithi026 (mon.0) 480 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:52:20.405 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:20 smithi026 conmon[32119]: audit 2021-11-03T16:52:19.521187+0000 mon.smithi026 (mon.0) 481 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi026.ltacyh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2021-11-03T16:52:20.405 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:20 smithi026 conmon[32119]: audit 2021-11-03T16:52:19.524158+0000 mon.smithi026 (mon.0) 482 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi026.ltacyh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2021-11-03T16:52:20.405 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:20 smithi026 conmon[32119]: audit 2021-11-03T16:52:19.524990+0000 mon.smithi026 (mon.0) 483 : audit [DBG] 2021-11-03T16:52:20.406 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:20 smithi026 conmon[32119]: from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:52:20.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:20 smithi194 conmon[35111]: cluster 2021-11-03T16:52:19.032522+0000 mgr.smithi026.cnrxli (mgr.14162 2021-11-03T16:52:20.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:20 smithi194 conmon[35111]: ) 223 : cluster [DBG] pgmap v185: 65 pgs: 18 active+clean, 1 active, 4 creating+activating, 8 creating+peering, 34 unknown; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:52:20.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:20 smithi194 conmon[35111]: cluster 2021-11-03T16:52:19.121310+0000 mon.smithi026 (mon.0) 479 : cluster [DBG] osdmap e42: 6 total, 6 up, 6 in 2021-11-03T16:52:20.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:20 smithi194 conmon[35111]: audit 2021-11-03T16:52:19.520393+0000 mon.smithi026 (mon.0) 480 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:52:20.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:20 smithi194 conmon[35111]: audit 2021-11-03T16:52:19.521187+0000 mon.smithi026 (mon.0) 481 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi026.ltacyh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2021-11-03T16:52:20.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:20 smithi194 conmon[35111]: audit 2021-11-03T16:52 2021-11-03T16:52:20.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:20 smithi194 conmon[35111]: :19.524158+0000 mon.smithi026 (mon.0) 482 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi026.ltacyh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2021-11-03T16:52:20.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:20 smithi194 conmon[35111]: audit 2021-11-03T16:52:19.524990+0000 mon.smithi026 (mon.0) 483 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:52:21.001 INFO:teuthology.run_tasks:Running task cephadm.shell... 2021-11-03T16:52:21.013 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi026.front.sepia.ceph.com 2021-11-03T16:52:21.013 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- bash -c 'ceph fs set cephfs max_mds 1' 2021-11-03T16:52:21.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:21 smithi026 conmon[32119]: cephadm 2021-11-03T16:52:19.525808+0000 mgr.smithi026.cnrxli (mgr.14162) 224 : cephadm [INF] Deploying daemon mds.cephfs.smithi026.ltacyh on smithi026 2021-11-03T16:52:21.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:21 smithi026 conmon[32119]: audit 2021-11-03T16:52:20.173708+0000 mon.smithi026 (mon.0) 484 : audit [DBG] from='client.? 172.21.15.26:0/551242405' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T16:52:21.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:21 smithi194 conmon[35111]: cephadm 2021-11-03T16:52:19.525808+0000 mgr.smithi026.cnrxli (mgr.14162) 224 : cephadm [INF] 2021-11-03T16:52:21.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:21 smithi194 conmon[35111]: Deploying daemon mds.cephfs.smithi026.ltacyh on smithi026 2021-11-03T16:52:21.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:21 smithi194 conmon[35111]: audit 2021-11-03T16:52:20.173708+0000 mon.smithi026 (mon.0) 484 : audit [DBG] from='client.? 172.21.15.26:0/551242405' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T16:52:22.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:22 smithi026 conmon[32119]: cluster 2021-11-03T16:52:21.032912+0000 2021-11-03T16:52:22.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:22 smithi026 conmon[32119]: mgr.smithi026.cnrxli (mgr.14162) 225 : cluster [DBG] pgmap v187: 65 pgs: 49 active+clean, 1 active, 4 creating+activating, 8 creating+peering, 3 unknown; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:52:22.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:22 smithi194 conmon[35111]: cluster 2021-11-03T16:52:21.032912+0000 mgr.smithi026.cnrxli (mgr.14162) 225 : 2021-11-03T16:52:22.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:22 smithi194 conmon[35111]: cluster [DBG] pgmap v187: 65 pgs: 49 active+clean, 1 active, 4 creating+activating, 8 creating+peering, 3 unknown; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:52:23.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:23.722+0000 7fc37ab9f700 1 -- 172.21.15.26:0/3070998276 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3740f7980 msgr2=0x7fc3740f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:23.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:23.722+0000 7fc37ab9f700 1 --2- 172.21.15.26:0/3070998276 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3740f7980 0x7fc3740f7de0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fc368004660 tx=0x7fc368009b30).stop 2021-11-03T16:52:23.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:23.722+0000 7fc37ab9f700 1 -- 172.21.15.26:0/3070998276 shutdown_connections 2021-11-03T16:52:23.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:23.722+0000 7fc37ab9f700 1 --2- 172.21.15.26:0/3070998276 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3740f7980 0x7fc3740f7de0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:23.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:23.722+0000 7fc37ab9f700 1 --2- 172.21.15.26:0/3070998276 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3740f66e0 0x7fc3740f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:23.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:23.722+0000 7fc37ab9f700 1 -- 172.21.15.26:0/3070998276 >> 172.21.15.26:0/3070998276 conn(0x7fc3740f1e40 msgr2=0x7fc3740f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:23.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:23.722+0000 7fc37ab9f700 1 -- 172.21.15.26:0/3070998276 shutdown_connections 2021-11-03T16:52:23.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:23.722+0000 7fc37ab9f700 1 -- 172.21.15.26:0/3070998276 wait complete. 2021-11-03T16:52:23.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:23.722+0000 7fc37ab9f700 1 Processor -- start 2021-11-03T16:52:23.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:23.723+0000 7fc37ab9f700 1 -- start start 2021-11-03T16:52:23.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:23.723+0000 7fc37ab9f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3740f66e0 0x7fc374106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:23.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:23.723+0000 7fc37ab9f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3740f7980 0x7fc374107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:23.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:23.723+0000 7fc37ab9f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3741079b0 con 0x7fc3740f66e0 2021-11-03T16:52:23.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:23.723+0000 7fc37ab9f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc374107af0 con 0x7fc3740f7980 2021-11-03T16:52:23.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:23.723+0000 7fc37893b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3740f66e0 0x7fc374106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:23.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:23.723+0000 7fc37893b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3740f66e0 0x7fc374106f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50090/0 (socket says 172.21.15.26:50090) 2021-11-03T16:52:23.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:23.723+0000 7fc37893b700 1 -- 172.21.15.26:0/1874074019 learned_addr learned my addr 172.21.15.26:0/1874074019 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:52:23.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:23.723+0000 7fc373fff700 1 --2- 172.21.15.26:0/1874074019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3740f7980 0x7fc374107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:23.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:23.723+0000 7fc37893b700 1 -- 172.21.15.26:0/1874074019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3740f7980 msgr2=0x7fc374107400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:23.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:23.723+0000 7fc37893b700 1 --2- 172.21.15.26:0/1874074019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3740f7980 0x7fc374107400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:23.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:23.723+0000 7fc37893b700 1 -- 172.21.15.26:0/1874074019 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc368005040 con 0x7fc3740f66e0 2021-11-03T16:52:23.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:23.723+0000 7fc37893b700 1 --2- 172.21.15.26:0/1874074019 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3740f66e0 0x7fc374106f10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fc36c00eb70 tx=0x7fc36c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:23.726 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:23.724+0000 7fc3717fa700 1 -- 172.21.15.26:0/1874074019 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc36c0092e0 con 0x7fc3740f66e0 2021-11-03T16:52:23.726 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:23.724+0000 7fc3717fa700 1 -- 172.21.15.26:0/1874074019 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fc36c00f040 con 0x7fc3740f66e0 2021-11-03T16:52:23.726 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:23.724+0000 7fc37ab9f700 1 -- 172.21.15.26:0/1874074019 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc374108490 con 0x7fc3740f66e0 2021-11-03T16:52:23.726 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:23.724+0000 7fc3717fa700 1 -- 172.21.15.26:0/1874074019 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc36c00c810 con 0x7fc3740f66e0 2021-11-03T16:52:23.727 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:23.724+0000 7fc37ab9f700 1 -- 172.21.15.26:0/1874074019 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc374108a50 con 0x7fc3740f66e0 2021-11-03T16:52:23.728 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:23.725+0000 7fc37ab9f700 1 -- 172.21.15.26:0/1874074019 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc374045ad0 con 0x7fc3740f66e0 2021-11-03T16:52:23.728 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:23.725+0000 7fc3717fa700 1 -- 172.21.15.26:0/1874074019 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fc36c01b030 con 0x7fc3740f66e0 2021-11-03T16:52:23.729 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:23.725+0000 7fc3717fa700 1 --2- 172.21.15.26:0/1874074019 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fc35c05c2b0 0x7fc35c05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:23.729 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:23.725+0000 7fc3717fa700 1 -- 172.21.15.26:0/1874074019 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fc36c075f00 con 0x7fc3740f66e0 2021-11-03T16:52:23.729 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:23.726+0000 7fc373fff700 1 --2- 172.21.15.26:0/1874074019 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fc35c05c2b0 0x7fc35c05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:23.730 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:23.726+0000 7fc373fff700 1 --2- 172.21.15.26:0/1874074019 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fc35c05c2b0 0x7fc35c05e770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fc368005010 tx=0x7fc368016040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:23.730 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:23.730+0000 7fc3717fa700 1 -- 172.21.15.26:0/1874074019 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fc36c048c60 con 0x7fc3740f66e0 2021-11-03T16:52:23.921 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:23.926+0000 7fc37ab9f700 1 -- 172.21.15.26:0/1874074019 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7fc3740ff020 con 0x7fc3740f66e0 2021-11-03T16:52:23.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:23 smithi194 conmon[35111]: cluster 2021-11-03T16:52:23.033630+0000 mgr.smithi026.cnrxli (mgr.14162) 226 2021-11-03T16:52:23.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:23 smithi194 conmon[35111]: : cluster [DBG] pgmap v188: 65 pgs: 65 active+clean; 0 B data, 32 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:52:23.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:23 smithi194 conmon[35111]: cluster 2021-11-03T16:52:23.041294+0000 mon.smithi026 (mon.0) 485 : cluster [INF] daemon mds.cephfs.smithi026.ltacyh assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2021-11-03T16:52:23.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:23 smithi194 conmon[35111]: cluster 2021-11-03T16:52:23.041359+0000 mon.smithi026 (mon.0) 486 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2021-11-03T16:52:23.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:23 smithi194 conmon[35111]: cluster 2021-11-03T16:52:23.041379+0000 mon.smithi026 (mon.0) 487 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2021-11-03T16:52:23.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:23 smithi194 conmon[35111]: cluster 2021-11-03T16:52:23.041392+0000 mon.smithi026 (mon.0) 488 : cluster [INF] Cluster is now healthy 2021-11-03T16:52:23.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:23 smithi194 conmon[35111]: cluster 2021-11-03T16:52:23.044323+0000 mon.smithi026 (mon.0) 489 : cluster [DBG] mds.? [v2:172.21.15.26:6826/665235785,v1:172.21.15.26:6827/665235785] up:boot 2021-11-03T16:52:23.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:23 smithi194 conmon[35111]: cluster 2021-11-03T16:52:23.044382+0000 mon.smithi026 (mon.0) 490 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi026.ltacyh=up:creating} 2021-11-03T16:52:23.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:23 smithi194 conmon[35111]: audit 2021-11-03T16:52:23.044680+0000 mon.smithi026 (mon.0) 491 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.ltacyh"}]: dispatch 2021-11-03T16:52:24.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:23 smithi194 conmon[35111]: cluster 2021-11-03T16:52:23.057602+0000 mon.smithi026 (mon.0) 492 : cluster [INF] daemon mds.cephfs.smithi026.ltacyh is now active in filesystem cephfs as rank 0 2021-11-03T16:52:24.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:23 smithi194 conmon[35111]: audit 2021-11-03T16 2021-11-03T16:52:24.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:23 smithi194 conmon[35111]: :52:23.227654+0000 mon.smithi026 (mon.0) 493 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:52:24.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:23 smithi194 conmon[35111]: audit 2021-11-03T16:52:23.228521+0000 mon.smithi026 (mon.0) 494 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi194.mpotdl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2021-11-03T16:52:24.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:23 smithi194 conmon[35111]: audit 2021-11-03 2021-11-03T16:52:24.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:23 smithi194 conmon[35111]: T16:52:23.231204+0000 mon.smithi026 2021-11-03T16:52:24.002 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:23 smithi194 conmon[35111]: (mon.0) 495 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi194.mpotdl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2021-11-03T16:52:24.002 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:23 smithi194 conmon[35111]: 2021-11-03T16:52:24.002 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:23 smithi194 conmon[35111]: audit 2021-11-03T16:52:24.002 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:23 smithi194 conmon[35111]: 2021-11-03T16:52:23. 2021-11-03T16:52:24.003 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:23 smithi194 conmon[35111]: 231851+0000 mon.smithi026 (mon.0) 496 : audit 2021-11-03T16:52:24.003 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:23 smithi194 conmon[35111]: [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:52:24.003 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:23 smithi194 conmon[35111]: cephadm 2021- 2021-11-03T16:52:24.003 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:23 smithi194 conmon[35111]: 11-03T16:52:23.232514 2021-11-03T16:52:24.004 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:23 smithi194 conmon[35111]: +0000 mgr.smithi026.cnrxli (mgr.14162) 227 : cephadm 2021-11-03T16:52:24.004 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:23 smithi194 conmon[35111]: [INF] Deploying daemon mds.cephfs.smithi194.mpotdl on smithi194 2021-11-03T16:52:24.004 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:23 smithi194 conmon[35111]: audit 2021-11-03 2021-11-03T16:52:24.004 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:23 smithi194 conmon[35111]: T16:52:23.927209+0000 mon.smithi026 2021-11-03T16:52:24.005 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:23 smithi194 conmon[35111]: (mon.0) 497 : audit [INF] from='client.? 172.21.15.26:0/1874074019' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2021-11-03T16:52:24.005 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:23 smithi194 conmon[35111]: 2021-11-03T16:52:24.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:24.048+0000 7fc3717fa700 1 -- 172.21.15.26:0/1874074019 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v4) v1 ==== 105+0+0 (secure 0 0 0) 0x7fc36c04c280 con 0x7fc3740f66e0 2021-11-03T16:52:24.045 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:24.050+0000 7fc37ab9f700 1 -- 172.21.15.26:0/1874074019 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fc35c05c2b0 msgr2=0x7fc35c05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:24.045 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:24.050+0000 7fc37ab9f700 1 --2- 172.21.15.26:0/1874074019 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fc35c05c2b0 0x7fc35c05e770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fc368005010 tx=0x7fc368016040).stop 2021-11-03T16:52:24.046 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:24.050+0000 7fc37ab9f700 1 -- 172.21.15.26:0/1874074019 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3740f66e0 msgr2=0x7fc374106f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:24.046 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:24.050+0000 7fc37ab9f700 1 --2- 172.21.15.26:0/1874074019 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3740f66e0 0x7fc374106f10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fc36c00eb70 tx=0x7fc36c00b040).stop 2021-11-03T16:52:24.046 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:24.050+0000 7fc37ab9f700 1 -- 172.21.15.26:0/1874074019 shutdown_connections 2021-11-03T16:52:24.046 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:24.050+0000 7fc37ab9f700 1 --2- 172.21.15.26:0/1874074019 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fc35c05c2b0 0x7fc35c05e770 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:24.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:24.050+0000 7fc37ab9f700 1 --2- 172.21.15.26:0/1874074019 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3740f66e0 0x7fc374106f10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:24.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:24.050+0000 7fc37ab9f700 1 --2- 172.21.15.26:0/1874074019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3740f7980 0x7fc374107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:24.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:24.050+0000 7fc37ab9f700 1 -- 172.21.15.26:0/1874074019 >> 172.21.15.26:0/1874074019 conn(0x7fc3740f1e40 msgr2=0x7fc3740fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:24.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:24.050+0000 7fc37ab9f700 1 -- 172.21.15.26:0/1874074019 shutdown_connections 2021-11-03T16:52:24.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:24.050+0000 7fc37ab9f700 1 -- 172.21.15.26:0/1874074019 wait complete. 2021-11-03T16:52:24.286 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:23 smithi026 conmon[32119]: cluster 2021-11-03T16:52:23.033630+0000 mgr.smithi026.cnrxli (mgr.14162) 226 : cluster [DBG] pgmap v188: 65 pgs: 65 active+clean; 0 B data, 32 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:52:24.287 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:23 smithi026 conmon[32119]: cluster 2021-11-03T16:52:23.041294+0000 mon.smithi026 (mon.0) 485 : cluster [INF] daemon mds.cephfs.smithi026.ltacyh assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2021-11-03T16:52:24.287 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:23 smithi026 conmon[32119]: cluster 2021-11-03T16:52:23.041359+0000 mon.smithi026 (mon.0) 486 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2021-11-03T16:52:24.288 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:23 smithi026 conmon[32119]: cluster 2021-11-03T16:52:23.041379+0000 mon.smithi026 (mon.0) 487 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2021-11-03T16:52:24.288 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:23 smithi026 conmon[32119]: cluster 2021-11-03T16:52:23.041392+0000 mon.smithi026 (mon.0) 488 : cluster [INF] Cluster is now healthy 2021-11-03T16:52:24.289 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:23 smithi026 conmon[32119]: cluster 2021-11-03T16:52:23.044323+0000 mon.smithi026 (mon.0) 489 : cluster [DBG] mds.? [v2:172.21.15.26:6826/665235785,v1:172.21.15.26:6827/665235785] up:boot 2021-11-03T16:52:24.289 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:23 smithi026 conmon[32119]: cluster 2021-11-03T16:52:23.044382 2021-11-03T16:52:24.289 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:23 smithi026 conmon[32119]: +0000 mon.smithi026 (mon.0) 490 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi026.ltacyh=up:creating} 2021-11-03T16:52:24.290 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:23 smithi026 conmon[32119]: audit 2021-11-03T16:52:23.044680+0000 mon.smithi026 (mon.0) 491 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.ltacyh"}]: dispatch 2021-11-03T16:52:24.290 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:23 smithi026 conmon[32119]: cluster 2021-11-03T16:52:23.057602+0000 mon.smithi026 (mon.0) 492 : cluster [INF] daemon mds.cephfs.smithi026.ltacyh is now active in filesystem cephfs as rank 0 2021-11-03T16:52:24.290 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:23 smithi026 conmon[32119]: audit 2021-11-03T16:52:23.227654+0000 mon.smithi026 (mon.0) 493 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:52:24.290 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:23 smithi026 conmon[32119]: audit 2021-11-03T16:52:23.228521+0000 mon.smithi026 (mon.0) 494 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi194.mpotdl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2021-11-03T16:52:24.291 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:23 smithi026 conmon[32119]: audit 2021-11-03T16:52:23.231204+0000 mon.smithi026 (mon.0) 495 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi194.mpotdl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2021-11-03T16:52:24.291 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:23 smithi026 conmon[32119]: audit 2021-11-03T16:52:23.231851+0000 mon.smithi026 (mon.0) 496 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:52:24.291 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:23 smithi026 conmon[32119]: cephadm 2021-11-03T16:52:23.232514+0000 mgr.smithi026.cnrxli (mgr.14162) 227 : cephadm [INF] Deploying daemon mds.cephfs.smithi194.mpotdl on smithi194 2021-11-03T16:52:24.292 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:23 smithi026 conmon[32119]: audit 2021-11-03T16:52:23.927209+0000 mon.smithi026 (mon.0) 497 : audit [INF] from='client.? 172.21.15.26:0/1874074019' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2021-11-03T16:52:24.777 INFO:teuthology.run_tasks:Running task cephadm.shell... 2021-11-03T16:52:24.788 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi026.front.sepia.ceph.com 2021-11-03T16:52:24.788 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2021-11-03T16:52:25.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:25 smithi194 conmon[35111]: cluster 2021-11-03T16:52:24.048468+0000 mon.smithi026 (mon.0) 498 : cluster [DBG] mds.? [v2:172.21.15.26:6826/665235785,v1:172.21.15.26:6827/665235785] up:active 2021-11-03T16:52:25.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:25 smithi194 conmon[35111]: cluster 2021-11-03T16:52:24.048515+0000 mon.smithi026 (mon.0) 499 : cluster [DBG] mds.? [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] up:boot 2021-11-03T16:52:25.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:25 smithi194 conmon[35111]: audit 2021-11-03T16:52:24.048592+0000 mon.smithi026 (mon.0) 500 : audit [INF] from='client.? 172.21.15.26:0/1874074019' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2021-11-03T16:52:25.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:25 smithi194 conmon[35111]: cluster 2021-11-03T16:52:24.048818+0000 mon.smithi026 (mon.0) 501 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi026.ltacyh=up:active} 1 up:standby 2021-11-03T16:52:25.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:25 smithi194 conmon[35111]: audit 2021-11-03T16:52:24.048950+0000 mon.smithi026 (mon.0) 502 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.kwikhp"}]: dispatch 2021-11-03T16:52:25.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:25 smithi194 conmon[35111]: cluster 2021-11-03T16:52:24.051472+0000 mon.smithi026 (mon.0) 503 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi026.ltacyh=up:active} 1 up:standby 2021-11-03T16:52:25.298 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:25 smithi026 conmon[32119]: cluster 2021-11-03T16:52:24.048468+0000 2021-11-03T16:52:25.301 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:25 smithi026 conmon[32119]: mon.smithi026 (mon.0) 498 : cluster [DBG] mds.? [v2:172.21.15.26:6826/665235785,v1:172.21.15.26:6827/665235785] up:active 2021-11-03T16:52:25.302 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:25 smithi026 conmon[32119]: cluster 2021-11-03T16:52:24.048515+0000 mon.smithi026 (mon.0) 499 : cluster [DBG] mds.? [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] up:boot 2021-11-03T16:52:25.303 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:25 smithi026 conmon[32119]: audit 2021-11-03T16:52:24.048592+0000 mon.smithi026 (mon.0) 500 : audit [INF] from='client.? 172.21.15.26:0/1874074019' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2021-11-03T16:52:25.303 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:25 smithi026 conmon[32119]: cluster 2021-11-03T16:52:24.048818+0000 mon.smithi026 (mon.0) 501 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi026.ltacyh=up:active} 1 up:standby 2021-11-03T16:52:25.304 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:25 smithi026 conmon[32119]: audit 2021-11-03T16:52:24.048950+0000 mon.smithi026 (mon.0) 502 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.kwikhp"}]: dispatch 2021-11-03T16:52:25.304 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:25 smithi026 conmon[32119]: cluster 2021-11-03T16:52:24.051472+0000 mon.smithi026 (mon.0) 503 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi026.ltacyh=up:active} 1 up:standby 2021-11-03T16:52:26.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:26 smithi026 conmon[32119]: cluster 2021-11-03T16:52:25.033991+0000 mgr.smithi026.cnrxli (mgr.14162) 228 : cluster [DBG] pgmap v189: 65 pgs: 65 active+clean; 588 B data, 32 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:52:26.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:26 smithi026 conmon[32119]: audit 2021-11-03T16:52:25.840056+0000 mon.smithi026 (mon.0) 504 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:52:26.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:26 smithi026 conmon[32119]: audit 2021-11-03T16:52:25.840883+0000 mon.smithi026 (mon.0) 505 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi026.yfxlxl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2021-11-03T16:52:26.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:26 smithi026 conmon[32119]: audit 2021-11-03T16:52:25.844189+0000 mon.smithi026 (mon.0) 506 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi026.yfxlxl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2021-11-03T16:52:26.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:26 smithi026 conmon[32119]: audit 2021-11-03T16:52:25.844994+0000 mon.smithi026 (mon.0) 507 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:52:26.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:26 smithi194 conmon[35111]: cluster 2021-11-03T16:52:25.033991+0000 mgr.smithi026.cnrxli (mgr 2021-11-03T16:52:26.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:26 smithi194 conmon[35111]: .14162) 228 : cluster [DBG] pgmap v189: 65 pgs: 65 active+clean; 588 B data, 32 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:52:26.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:26 smithi194 conmon[35111]: audit 2021-11-03T16:52:25.840056+0000 mon.smithi026 (mon.0) 504 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:52:26.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:26 smithi194 conmon[35111]: audit 2021-11-03T16:52:25.840883+0000 mon.smithi026 (mon.0) 505 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi026.yfxlxl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2021-11-03T16:52:26.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:26 smithi194 conmon[35111]: audit 2021-11-03T16:52:25.844189+0000 mon.smithi026 (mon.0) 506 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi026.yfxlxl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2021-11-03T16:52:26.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:26 smithi194 conmon[35111]: audit 2021-11-03T16:52 2021-11-03T16:52:26.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:26 smithi194 conmon[35111]: :25.844994+0000 mon.smithi026 (mon.0) 507 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:52:26.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:26.839+0000 7f2ddd63f700 1 -- 172.21.15.26:0/767099391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2dd80f66e0 msgr2=0x7f2dd80f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:26.837 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:26.839+0000 7f2ddd63f700 1 --2- 172.21.15.26:0/767099391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2dd80f66e0 0x7f2dd80f6b00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f2dc8004660 tx=0x7f2dc8009b30).stop 2021-11-03T16:52:26.837 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:26.839+0000 7f2ddd63f700 1 -- 172.21.15.26:0/767099391 shutdown_connections 2021-11-03T16:52:26.837 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:26.839+0000 7f2ddd63f700 1 --2- 172.21.15.26:0/767099391 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2dd80f7980 0x7f2dd80f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:26.838 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:26.839+0000 7f2ddd63f700 1 --2- 172.21.15.26:0/767099391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2dd80f66e0 0x7f2dd80f6b00 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:26.838 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:26.839+0000 7f2ddd63f700 1 -- 172.21.15.26:0/767099391 >> 172.21.15.26:0/767099391 conn(0x7f2dd80f1e40 msgr2=0x7f2dd80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:26.838 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:26.839+0000 7f2ddd63f700 1 -- 172.21.15.26:0/767099391 shutdown_connections 2021-11-03T16:52:26.838 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:26.839+0000 7f2ddd63f700 1 -- 172.21.15.26:0/767099391 wait complete. 2021-11-03T16:52:26.839 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:26.840+0000 7f2ddd63f700 1 Processor -- start 2021-11-03T16:52:26.839 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:26.840+0000 7f2ddd63f700 1 -- start start 2021-11-03T16:52:26.839 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:26.840+0000 7f2ddd63f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2dd80f66e0 0x7f2dd806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:26.839 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:26.840+0000 7f2ddd63f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2dd80f7980 0x7f2dd8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:26.839 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:26.840+0000 7f2ddd63f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd806a380 con 0x7f2dd80f7980 2021-11-03T16:52:26.840 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:26.840+0000 7f2ddd63f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd806a4c0 con 0x7f2dd80f66e0 2021-11-03T16:52:26.840 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:26.840+0000 7f2dd67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2dd80f7980 0x7f2dd8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:26.840 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:26.840+0000 7f2dd67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2dd80f7980 0x7f2dd8069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50102/0 (socket says 172.21.15.26:50102) 2021-11-03T16:52:26.840 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:26.840+0000 7f2dd67fc700 1 -- 172.21.15.26:0/3729241620 learned_addr learned my addr 172.21.15.26:0/3729241620 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:52:26.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:26.840+0000 7f2dd6ffd700 1 --2- 172.21.15.26:0/3729241620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2dd80f66e0 0x7f2dd806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:26.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:26.841+0000 7f2dd67fc700 1 -- 172.21.15.26:0/3729241620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2dd80f66e0 msgr2=0x7f2dd806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:26.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:26.841+0000 7f2dd67fc700 1 --2- 172.21.15.26:0/3729241620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2dd80f66e0 0x7f2dd806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:26.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:26.841+0000 7f2dd67fc700 1 -- 172.21.15.26:0/3729241620 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc8005040 con 0x7f2dd80f7980 2021-11-03T16:52:26.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:26.841+0000 7f2dd67fc700 1 --2- 172.21.15.26:0/3729241620 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2dd80f7980 0x7f2dd8069e20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f2dcc0026d0 tx=0x7f2dcc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:26.842 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:26.841+0000 7f2dbf7fe700 1 -- 172.21.15.26:0/3729241620 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2dcc0079c0 con 0x7f2dd80f7980 2021-11-03T16:52:26.842 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:26.841+0000 7f2dbf7fe700 1 -- 172.21.15.26:0/3729241620 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f2dcc00f040 con 0x7f2dd80f7980 2021-11-03T16:52:26.842 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:26.841+0000 7f2ddd63f700 1 -- 172.21.15.26:0/3729241620 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dd806a7a0 con 0x7f2dd80f7980 2021-11-03T16:52:26.842 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:26.841+0000 7f2dbf7fe700 1 -- 172.21.15.26:0/3729241620 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2dcc014820 con 0x7f2dd80f7980 2021-11-03T16:52:26.843 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:26.841+0000 7f2ddd63f700 1 -- 172.21.15.26:0/3729241620 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dd810efe0 con 0x7f2dd80f7980 2021-11-03T16:52:26.844 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:26.842+0000 7f2ddd63f700 1 -- 172.21.15.26:0/3729241620 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dd8045ad0 con 0x7f2dd80f7980 2021-11-03T16:52:26.844 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:26.843+0000 7f2dbf7fe700 1 -- 172.21.15.26:0/3729241620 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f2dcc0090d0 con 0x7f2dd80f7980 2021-11-03T16:52:26.844 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:26.843+0000 7f2dbf7fe700 1 --2- 172.21.15.26:0/3729241620 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f2dc005c2b0 0x7f2dc005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:26.845 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:26.843+0000 7f2dbf7fe700 1 -- 172.21.15.26:0/3729241620 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f2dcc0762e0 con 0x7f2dd80f7980 2021-11-03T16:52:26.845 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:26.843+0000 7f2dd6ffd700 1 --2- 172.21.15.26:0/3729241620 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f2dc005c2b0 0x7f2dc005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:26.845 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:26.844+0000 7f2dd6ffd700 1 --2- 172.21.15.26:0/3729241620 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f2dc005c2b0 0x7f2dc005e770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f2dc8013620 tx=0x7f2dc8009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:26.845 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:26.847+0000 7f2dbf7fe700 1 -- 172.21.15.26:0/3729241620 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f2dcc048ff0 con 0x7f2dd80f7980 2021-11-03T16:52:27.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:27.059+0000 7f2ddd63f700 1 -- 172.21.15.26:0/3729241620 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2dd80feea0 con 0x7f2dd80f7980 2021-11-03T16:52:27.310 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:27 smithi026 conmon[32119]: cephadm 2021-11-03T16:52:25.845771+0000 mgr.smithi026.cnrxli (mgr.14162) 229 : cephadm [INF] Deploying daemon mds.cephfs.smithi026.yfxlxl on smithi026 2021-11-03T16:52:27.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:27 smithi194 conmon[35111]: cephadm 2021-11-03T16:52:25.845771+0000 mgr.smithi026.cnrxli (mgr.14162) 229 : cephadm 2021-11-03T16:52:27.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:27 smithi194 conmon[35111]: [INF] Deploying daemon mds.cephfs.smithi026.yfxlxl on smithi026 2021-11-03T16:52:28.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:28.064+0000 7f2dbf7fe700 1 -- 172.21.15.26:0/3729241620 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2dcc04c610 con 0x7f2dd80f7980 2021-11-03T16:52:28.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:28.066+0000 7f2ddd63f700 1 -- 172.21.15.26:0/3729241620 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f2dc005c2b0 msgr2=0x7f2dc005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:28.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:28.066+0000 7f2ddd63f700 1 --2- 172.21.15.26:0/3729241620 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f2dc005c2b0 0x7f2dc005e770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f2dc8013620 tx=0x7f2dc8009b30).stop 2021-11-03T16:52:28.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:28.066+0000 7f2ddd63f700 1 -- 172.21.15.26:0/3729241620 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2dd80f7980 msgr2=0x7f2dd8069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:28.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:28.066+0000 7f2ddd63f700 1 --2- 172.21.15.26:0/3729241620 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2dd80f7980 0x7f2dd8069e20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f2dcc0026d0 tx=0x7f2dcc009de0).stop 2021-11-03T16:52:28.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:28.066+0000 7f2ddd63f700 1 -- 172.21.15.26:0/3729241620 shutdown_connections 2021-11-03T16:52:28.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:28.066+0000 7f2ddd63f700 1 --2- 172.21.15.26:0/3729241620 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f2dc005c2b0 0x7f2dc005e770 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:28.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:28.066+0000 7f2ddd63f700 1 --2- 172.21.15.26:0/3729241620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2dd80f66e0 0x7f2dd806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:28.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:28.066+0000 7f2ddd63f700 1 --2- 172.21.15.26:0/3729241620 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2dd80f7980 0x7f2dd8069e20 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:28.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:28.066+0000 7f2ddd63f700 1 -- 172.21.15.26:0/3729241620 >> 172.21.15.26:0/3729241620 conn(0x7f2dd80f1e40 msgr2=0x7f2dd80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:28.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:28.066+0000 7f2ddd63f700 1 -- 172.21.15.26:0/3729241620 shutdown_connections 2021-11-03T16:52:28.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:28.066+0000 7f2ddd63f700 1 -- 172.21.15.26:0/3729241620 wait complete. 2021-11-03T16:52:28.270 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:28 smithi026 conmon[32119]: cluster 2021-11-03T16:52:27.034414+0000 2021-11-03T16:52:28.270 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:28 smithi026 conmon[32119]: mgr.smithi026.cnrxli (mgr.14162) 230 : cluster [DBG] pgmap v190: 65 pgs: 65 active+clean; 610 B data, 32 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 9 op/s 2021-11-03T16:52:28.271 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:28 smithi026 conmon[32119]: audit 2021-11-03T16 2021-11-03T16:52:28.271 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:28 smithi026 conmon[32119]: :52:27.060292+0000 mon.smithi026 (mon.0) 508 : audit [INF] from='client.? 172.21.15.26:0/3729241620' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2021-11-03T16:52:28.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:28 smithi194 conmon[35111]: cluster 2021-11-03T16:52:27.034414+0000 mgr.smithi026.cnrxli (mgr.14162) 230 2021-11-03T16:52:28.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:28 smithi194 conmon[35111]: : cluster [DBG] pgmap v190: 65 pgs: 65 active+clean; 610 B data, 32 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 9 op/s 2021-11-03T16:52:28.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:28 smithi194 conmon[35111]: audit 2021-11-03T16:52:27.060292+0000 mon.smithi026 (mon.0) 508 : audit [INF] from='client.? 172.21.15.26:0/3729241620' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2021-11-03T16:52:28.742 INFO:teuthology.run_tasks:Running task cephadm.shell... 2021-11-03T16:52:28.761 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi026.front.sepia.ceph.com 2021-11-03T16:52:28.762 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- bash -c 'ceph fs dump' 2021-11-03T16:52:29.329 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:29 smithi026 conmon[32119]: audit 2021-11-03T16:52:28.064823+0000 mon.smithi026 (mon.0) 2021-11-03T16:52:29.329 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:29 smithi026 conmon[32119]: 509 : audit [INF] from='client.? 172.21.15.26:0/3729241620' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2021-11-03T16:52:29.330 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:29 smithi026 conmon[32119]: cluster 2021-11-03T16:52:28.064881+0000 mon.smithi026 (mon.0) 510 : cluster [DBG] mds.? [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] up:standby 2021-11-03T16:52:29.330 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:29 smithi026 conmon[32119]: cluster 2021-11-03T16:52:28.064939+0000 mon.smithi026 (mon.0) 511 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi026.ltacyh=up:active} 1 up:standby 2021-11-03T16:52:29.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:29 smithi194 conmon[35111]: audit 2021-11-03T16:52:28.064823+0000 mon.smithi026 (mon.0) 509 : audit 2021-11-03T16:52:29.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:29 smithi194 conmon[35111]: [INF] from='client.? 172.21.15.26:0/3729241620' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2021-11-03T16:52:29.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:29 smithi194 conmon[35111]: cluster 2021-11-03T16:52:28.064881+0000 mon.smithi026 (mon.0) 510 : cluster [DBG] mds.? [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] up:standby 2021-11-03T16:52:29.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:29 smithi194 conmon[35111]: cluster 2021-11-03T16:52:28.064939+0000 mon.smithi026 (mon.0) 511 : 2021-11-03T16:52:29.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:29 smithi194 conmon[35111]: cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi026.ltacyh=up:active} 1 up:standby 2021-11-03T16:52:30.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:30 smithi026 conmon[32119]: cluster 2021-11-03T16:52:29.042931+0000 mgr.smithi026.cnrxli (mgr. 2021-11-03T16:52:30.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:30 smithi026 conmon[32119]: 14162) 231 : cluster [DBG] pgmap v191: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s wr, 9 op/s 2021-11-03T16:52:30.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:30 smithi026 conmon[32119]: audit 2021-11-03T16:52:29.477194+0000 mon.smithi026 (mon.0) 512 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:52:30.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:30 smithi026 conmon[32119]: audit 2021-11-03T16:52:29.477960+0000 mon.smithi026 (mon.0) 513 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:52:30.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:30 smithi194 conmon[35111]: cluster 2021-11-03T16:52:29.042931+0000 mgr.smithi026.cnrxli (mgr.14162) 231 : cluster [DBG] pgmap v191: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s wr, 9 op/s 2021-11-03T16:52:30.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:30 smithi194 conmon[35111]: audit 2021-11-03T16:52:29.477194+0000 mon.smithi026 (mon.0) 512 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:52:30.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:30 smithi194 conmon[35111]: audit 2021-11-03T16:52:29.477960+0000 mon.smithi026 (mon.0) 513 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:52:30.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:30.975+0000 7f71cf59e700 1 -- 172.21.15.26:0/2326294230 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71d0060310 msgr2=0x7f71d00f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:30.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:30.975+0000 7f71cf59e700 1 --2- 172.21.15.26:0/2326294230 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71d0060310 0x7f71d00f9110 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f71c0004660 tx=0x7f71c0009b30).stop 2021-11-03T16:52:30.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:30.975+0000 7f71cf59e700 1 -- 172.21.15.26:0/2326294230 shutdown_connections 2021-11-03T16:52:30.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:30.975+0000 7f71cf59e700 1 --2- 172.21.15.26:0/2326294230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71d00f9690 0x7f71d00fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:30.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:30.975+0000 7f71cf59e700 1 --2- 172.21.15.26:0/2326294230 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71d0060310 0x7f71d00f9110 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:30.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:30.975+0000 7f71cf59e700 1 -- 172.21.15.26:0/2326294230 >> 172.21.15.26:0/2326294230 conn(0x7f71d00f0b90 msgr2=0x7f71d00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:30.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:30.975+0000 7f71cf59e700 1 -- 172.21.15.26:0/2326294230 shutdown_connections 2021-11-03T16:52:30.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:30.975+0000 7f71cf59e700 1 -- 172.21.15.26:0/2326294230 wait complete. 2021-11-03T16:52:30.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:30.975+0000 7f71cf59e700 1 Processor -- start 2021-11-03T16:52:30.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:30.975+0000 7f71cf59e700 1 -- start start 2021-11-03T16:52:30.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:30.975+0000 7f71cf59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71d0060310 0x7f71d0106d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:30.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:30.975+0000 7f71cf59e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71d00f9690 0x7f71d0107230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:30.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:30.975+0000 7f71cf59e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d0107830 con 0x7f71d0060310 2021-11-03T16:52:30.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:30.975+0000 7f71cf59e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d0108040 con 0x7f71d00f9690 2021-11-03T16:52:30.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:30.976+0000 7f71cdd9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71d00f9690 0x7f71d0107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:30.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:30.976+0000 7f71ce59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71d0060310 0x7f71d0106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:30.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:30.976+0000 7f71cdd9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71d00f9690 0x7f71d0107230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.26:54326/0 (socket says 172.21.15.26:54326) 2021-11-03T16:52:30.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:30.976+0000 7f71cdd9b700 1 -- 172.21.15.26:0/2141679043 learned_addr learned my addr 172.21.15.26:0/2141679043 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:52:30.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:30.976+0000 7f71ce59c700 1 -- 172.21.15.26:0/2141679043 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71d00f9690 msgr2=0x7f71d0107230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:30.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:30.976+0000 7f71ce59c700 1 --2- 172.21.15.26:0/2141679043 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71d00f9690 0x7f71d0107230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:30.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:30.976+0000 7f71ce59c700 1 -- 172.21.15.26:0/2141679043 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c0005040 con 0x7f71d0060310 2021-11-03T16:52:30.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:30.976+0000 7f71ce59c700 1 --2- 172.21.15.26:0/2141679043 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71d0060310 0x7f71d0106d40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f71c0000c00 tx=0x7f71c0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:30.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:30.976+0000 7f71beffd700 1 -- 172.21.15.26:0/2141679043 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71c0018070 con 0x7f71d0060310 2021-11-03T16:52:30.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:30.976+0000 7f71cf59e700 1 -- 172.21.15.26:0/2141679043 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71d0108260 con 0x7f71d0060310 2021-11-03T16:52:30.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:30.976+0000 7f71beffd700 1 -- 172.21.15.26:0/2141679043 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f71c0013410 con 0x7f71d0060310 2021-11-03T16:52:30.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:30.976+0000 7f71beffd700 1 -- 172.21.15.26:0/2141679043 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71c001de10 con 0x7f71d0060310 2021-11-03T16:52:30.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:30.976+0000 7f71cf59e700 1 -- 172.21.15.26:0/2141679043 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d01087c0 con 0x7f71d0060310 2021-11-03T16:52:30.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:30.977+0000 7f71cf59e700 1 -- 172.21.15.26:0/2141679043 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71d0059100 con 0x7f71d0060310 2021-11-03T16:52:30.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:30.977+0000 7f71beffd700 1 -- 172.21.15.26:0/2141679043 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f71c001d420 con 0x7f71d0060310 2021-11-03T16:52:30.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:30.978+0000 7f71beffd700 1 --2- 172.21.15.26:0/2141679043 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f71b805c300 0x7f71b805e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:30.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:30.978+0000 7f71beffd700 1 -- 172.21.15.26:0/2141679043 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f71c00779b0 con 0x7f71d0060310 2021-11-03T16:52:30.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:30.978+0000 7f71cdd9b700 1 --2- 172.21.15.26:0/2141679043 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f71b805c300 0x7f71b805e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:30.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:30.978+0000 7f71cdd9b700 1 --2- 172.21.15.26:0/2141679043 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f71b805c300 0x7f71b805e7c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f71c40044e0 tx=0x7f71c400b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:30.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:30.982+0000 7f71beffd700 1 -- 172.21.15.26:0/2141679043 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f71c004a690 con 0x7f71d0060310 2021-11-03T16:52:31.177 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:31.182+0000 7f71cf59e700 1 -- 172.21.15.26:0/2141679043 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f71d00fed10 con 0x7f71d0060310 2021-11-03T16:52:31.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:31.182+0000 7f71beffd700 1 -- 172.21.15.26:0/2141679043 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 7 v7) v1 ==== 75+0+1458 (secure 0 0 0) 0x7f71c004dcb0 con 0x7f71d0060310 2021-11-03T16:52:31.179 INFO:teuthology.orchestra.run.smithi026.stdout:e7 2021-11-03T16:52:31.179 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T16:52:31.180 INFO:teuthology.orchestra.run.smithi026.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T16:52:31.180 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T16:52:31.180 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:52:31.180 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T16:52:31.181 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T16:52:31.181 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 6 2021-11-03T16:52:31.181 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 2021-11-03T16:52:31.181 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T16:52:31.182 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:52:28.058778+0000 2021-11-03T16:52:31.182 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T16:52:31.182 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T16:52:31.182 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T16:52:31.182 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T16:52:31.183 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T16:52:31.183 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T16:52:31.183 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T16:52:31.183 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 0 2021-11-03T16:52:31.184 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T16:52:31.184 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T16:52:31.184 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T16:52:31.184 INFO:teuthology.orchestra.run.smithi026.stdout:up {0=14422} 2021-11-03T16:52:31.185 INFO:teuthology.orchestra.run.smithi026.stdout:failed 2021-11-03T16:52:31.185 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T16:52:31.185 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T16:52:31.185 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T16:52:31.185 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T16:52:31.186 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T16:52:31.186 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T16:52:31.186 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T16:52:31.186 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{0:14422} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.26:6826/665235785,v1:172.21.15.26:6827/665235785]] 2021-11-03T16:52:31.187 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:52:31.187 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:52:31.187 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T16:52:31.187 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:52:31.187 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921]] 2021-11-03T16:52:31.188 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 2 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844]] 2021-11-03T16:52:31.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:31.184+0000 7f71cf59e700 1 -- 172.21.15.26:0/2141679043 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f71b805c300 msgr2=0x7f71b805e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:31.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:31.184+0000 7f71cf59e700 1 --2- 172.21.15.26:0/2141679043 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f71b805c300 0x7f71b805e7c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f71c40044e0 tx=0x7f71c400b040).stop 2021-11-03T16:52:31.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:31.184+0000 7f71cf59e700 1 -- 172.21.15.26:0/2141679043 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71d0060310 msgr2=0x7f71d0106d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:31.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:31.184+0000 7f71cf59e700 1 --2- 172.21.15.26:0/2141679043 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71d0060310 0x7f71d0106d40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f71c0000c00 tx=0x7f71c0009b30).stop 2021-11-03T16:52:31.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:31.184+0000 7f71cf59e700 1 -- 172.21.15.26:0/2141679043 shutdown_connections 2021-11-03T16:52:31.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:31.184+0000 7f71cf59e700 1 --2- 172.21.15.26:0/2141679043 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f71b805c300 0x7f71b805e7c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:31.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:31.184+0000 7f71cf59e700 1 --2- 172.21.15.26:0/2141679043 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71d0060310 0x7f71d0106d40 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:31.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:31.184+0000 7f71cf59e700 1 --2- 172.21.15.26:0/2141679043 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71d00f9690 0x7f71d0107230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:31.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:31.184+0000 7f71cf59e700 1 -- 172.21.15.26:0/2141679043 >> 172.21.15.26:0/2141679043 conn(0x7f71d00f0b90 msgr2=0x7f71d00f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:31.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:31.184+0000 7f71cf59e700 1 -- 172.21.15.26:0/2141679043 shutdown_connections 2021-11-03T16:52:31.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:31.184+0000 7f71cf59e700 1 -- 172.21.15.26:0/2141679043 wait complete. 2021-11-03T16:52:31.191 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 7 2021-11-03T16:52:31.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:31 smithi194 conmon[35111]: cluster 2021-11-03T16:52:30.479313+0000 mon.smithi026 (mon.0) 2021-11-03T16:52:31.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:31 smithi194 conmon[35111]: 514 : cluster [DBG] mds.? [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] up:boot 2021-11-03T16:52:31.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:31 smithi194 conmon[35111]: cluster 2021-11-03T16:52:30.479360+0000 mon.smithi026 (mon.0) 515 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi026.ltacyh=up:active} 2 up:standby 2021-11-03T16:52:31.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:31 smithi194 conmon[35111]: audit 2021-11-03T16:52:30.479462+0000 mon.smithi026 2021-11-03T16:52:31.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:31 smithi194 conmon[35111]: (mon.0) 516 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.mpotdl"}]: dispatch 2021-11-03T16:52:31.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:31 smithi194 conmon[35111]: cluster 2021-11-03T16 2021-11-03T16:52:31.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:31 smithi194 conmon[35111]: :52:31.043441+0000 mgr.smithi026.cnrxli ( 2021-11-03T16:52:31.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:31 smithi194 conmon[35111]: mgr.14162) 232 : cluster [DBG] 2021-11-03T16:52:31.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:31 smithi194 conmon[35111]: pgmap v192: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1022 B/s wr, 6 op/s 2021-11-03T16:52:31.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:31 smithi194 conmon[35111]: audit 2021 2021-11-03T16:52:31.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:31 smithi194 conmon[35111]: -11-03T16:52:31. 2021-11-03T16:52:31.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:31 smithi194 conmon[35111]: 183056+0000 mon.smithi026 (mon.0) 517 2021-11-03T16:52:31.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:31 smithi194 conmon[35111]: : audit [DBG] from='client.? 172.21.15.26:0/2141679043' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T16:52:31.834 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:31 smithi026 conmon[32119]: cluster 2021-11-03T16:52:30.479313+0000 mon.smithi026 (mon.0) 514 : cluster [DBG] mds.? [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] up:boot 2021-11-03T16:52:31.834 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:31 smithi026 conmon[32119]: cluster 2021-11-03T16:52:30.479360+0000 mon.smithi026 (mon.0) 515 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi026.ltacyh=up:active} 2 up:standby 2021-11-03T16:52:31.835 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:31 smithi026 conmon[32119]: audit 2021-11-03T16:52:30.479462+0000 mon.smithi026 (mon.0) 516 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.mpotdl"}]: dispatch 2021-11-03T16:52:31.835 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:31 smithi026 conmon[32119]: cluster 2021-11-03T16:52:31.043441+0000 mgr.smithi026.cnrxli (mgr.14162) 232 : cluster [DBG] pgmap v192: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1022 B/s wr, 6 op/s 2021-11-03T16:52:31.835 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:31 smithi026 conmon[32119]: audit 2021-11-03T16:52:31.183056+0000 mon.smithi026 (mon.0) 517 : audit [DBG] from='client.? 172.21.15.26:0/2141679043' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T16:52:31.849 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2021-11-03T16:52:32.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:32 smithi026 conmon[32119]: audit 2021-11-03T16:52:31.558174+0000 mon.smithi026 (mon.0) 518 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:52:32.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:32 smithi194 conmon[35111]: audit 2021-11-03T16:52:31.558174+0000 mon.smithi026 (mon.0) 518 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:52:34.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.182+0000 7f5b4196b700 1 -- 172.21.15.26:0/4008302051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b3c060270 msgr2=0x7f5b3c0f91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:34.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.182+0000 7f5b4196b700 1 --2- 172.21.15.26:0/4008302051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b3c060270 0x7f5b3c0f91e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f5b2c004660 tx=0x7f5b2c009b30).stop 2021-11-03T16:52:34.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.182+0000 7f5b4196b700 1 -- 172.21.15.26:0/4008302051 shutdown_connections 2021-11-03T16:52:34.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.182+0000 7f5b4196b700 1 --2- 172.21.15.26:0/4008302051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b3c0f96d0 0x7f5b3c0fbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:34.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.182+0000 7f5b4196b700 1 --2- 172.21.15.26:0/4008302051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b3c060270 0x7f5b3c0f91e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:34.180 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.182+0000 7f5b4196b700 1 -- 172.21.15.26:0/4008302051 >> 172.21.15.26:0/4008302051 conn(0x7f5b3c0f0bc0 msgr2=0x7f5b3c0f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:34.180 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.182+0000 7f5b4196b700 1 -- 172.21.15.26:0/4008302051 shutdown_connections 2021-11-03T16:52:34.180 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.182+0000 7f5b4196b700 1 -- 172.21.15.26:0/4008302051 wait complete. 2021-11-03T16:52:34.180 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.183+0000 7f5b4196b700 1 Processor -- start 2021-11-03T16:52:34.181 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.183+0000 7f5b4196b700 1 -- start start 2021-11-03T16:52:34.183 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.183+0000 7f5b4196b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b3c060270 0x7f5b3c0f6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:34.183 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.183+0000 7f5b4196b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b3c0f96d0 0x7f5b3c0f50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:34.183 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.183+0000 7f5b4196b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c0f5640 con 0x7f5b3c060270 2021-11-03T16:52:34.184 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.183+0000 7f5b4196b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c0f5780 con 0x7f5b3c0f96d0 2021-11-03T16:52:34.184 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.184+0000 7f5b3affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b3c060270 0x7f5b3c0f6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:34.184 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.184+0000 7f5b3affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b3c060270 0x7f5b3c0f6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50130/0 (socket says 172.21.15.26:50130) 2021-11-03T16:52:34.184 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.184+0000 7f5b3affd700 1 -- 172.21.15.26:0/3079602237 learned_addr learned my addr 172.21.15.26:0/3079602237 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:52:34.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.184+0000 7f5b3a7fc700 1 --2- 172.21.15.26:0/3079602237 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b3c0f96d0 0x7f5b3c0f50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:34.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.184+0000 7f5b3affd700 1 -- 172.21.15.26:0/3079602237 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b3c0f96d0 msgr2=0x7f5b3c0f50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:34.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.184+0000 7f5b3affd700 1 --2- 172.21.15.26:0/3079602237 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b3c0f96d0 0x7f5b3c0f50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:34.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.184+0000 7f5b3affd700 1 -- 172.21.15.26:0/3079602237 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b2c005040 con 0x7f5b3c060270 2021-11-03T16:52:34.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.184+0000 7f5b3affd700 1 --2- 172.21.15.26:0/3079602237 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b3c060270 0x7f5b3c0f6c60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f5b2c009990 tx=0x7f5b2c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:34.186 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.184+0000 7f5b237fe700 1 -- 172.21.15.26:0/3079602237 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b2c018070 con 0x7f5b3c060270 2021-11-03T16:52:34.186 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.184+0000 7f5b237fe700 1 -- 172.21.15.26:0/3079602237 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f5b2c013410 con 0x7f5b3c060270 2021-11-03T16:52:34.186 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.184+0000 7f5b4196b700 1 -- 172.21.15.26:0/3079602237 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b3c0f5a00 con 0x7f5b3c060270 2021-11-03T16:52:34.186 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.184+0000 7f5b237fe700 1 -- 172.21.15.26:0/3079602237 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b2c01c620 con 0x7f5b3c060270 2021-11-03T16:52:34.186 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.184+0000 7f5b4196b700 1 -- 172.21.15.26:0/3079602237 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b3c0f5f60 con 0x7f5b3c060270 2021-11-03T16:52:34.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.186+0000 7f5b4196b700 1 -- 172.21.15.26:0/3079602237 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b3c045ad0 con 0x7f5b3c060270 2021-11-03T16:52:34.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.186+0000 7f5b237fe700 1 -- 172.21.15.26:0/3079602237 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f5b2c01c890 con 0x7f5b3c060270 2021-11-03T16:52:34.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.186+0000 7f5b237fe700 1 --2- 172.21.15.26:0/3079602237 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f5b2405c300 0x7f5b2405e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:34.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.186+0000 7f5b237fe700 1 -- 172.21.15.26:0/3079602237 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f5b2c077e00 con 0x7f5b3c060270 2021-11-03T16:52:34.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.187+0000 7f5b3a7fc700 1 --2- 172.21.15.26:0/3079602237 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f5b2405c300 0x7f5b2405e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:34.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.187+0000 7f5b3a7fc700 1 --2- 172.21.15.26:0/3079602237 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f5b2405c300 0x7f5b2405e7c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f5b3c060040 tx=0x7f5b30009040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:34.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.191+0000 7f5b237fe700 1 -- 172.21.15.26:0/3079602237 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f5b2c04ab60 con 0x7f5b3c060270 2021-11-03T16:52:34.395 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.400+0000 7f5b4196b700 1 -- 172.21.15.26:0/3079602237 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b3c027a00 con 0x7f5b3c060270 2021-11-03T16:52:34.396 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.400+0000 7f5b237fe700 1 -- 172.21.15.26:0/3079602237 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2926 (secure 0 0 0) 0x7f5b2c04e180 con 0x7f5b3c060270 2021-11-03T16:52:34.397 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.402+0000 7f5b4196b700 1 -- 172.21.15.26:0/3079602237 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f5b2405c300 msgr2=0x7f5b2405e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:34.398 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.402+0000 7f5b4196b700 1 --2- 172.21.15.26:0/3079602237 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f5b2405c300 0x7f5b2405e7c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f5b3c060040 tx=0x7f5b30009040).stop 2021-11-03T16:52:34.398 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.402+0000 7f5b4196b700 1 -- 172.21.15.26:0/3079602237 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b3c060270 msgr2=0x7f5b3c0f6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:34.398 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.402+0000 7f5b4196b700 1 --2- 172.21.15.26:0/3079602237 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b3c060270 0x7f5b3c0f6c60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f5b2c009990 tx=0x7f5b2c009b30).stop 2021-11-03T16:52:34.398 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.402+0000 7f5b4196b700 1 -- 172.21.15.26:0/3079602237 shutdown_connections 2021-11-03T16:52:34.399 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.402+0000 7f5b4196b700 1 --2- 172.21.15.26:0/3079602237 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f5b2405c300 0x7f5b2405e7c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:34.399 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.402+0000 7f5b4196b700 1 --2- 172.21.15.26:0/3079602237 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b3c060270 0x7f5b3c0f6c60 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:34.399 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.402+0000 7f5b4196b700 1 --2- 172.21.15.26:0/3079602237 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b3c0f96d0 0x7f5b3c0f50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:34.399 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.402+0000 7f5b4196b700 1 -- 172.21.15.26:0/3079602237 >> 172.21.15.26:0/3079602237 conn(0x7f5b3c0f0bc0 msgr2=0x7f5b3c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:34.400 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.402+0000 7f5b4196b700 1 -- 172.21.15.26:0/3079602237 shutdown_connections 2021-11-03T16:52:34.400 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:34.402+0000 7f5b4196b700 1 -- 172.21.15.26:0/3079602237 wait complete. 2021-11-03T16:52:34.400 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2021-11-03T16:52:34.407 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T16:52:34.420 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:34 smithi026 conmon[32119]: cluster 2021-11-03T16:52:33.044132+0000 2021-11-03T16:52:34.420 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:34 smithi026 conmon[32119]: mgr.smithi026.cnrxli (mgr.14162) 233 : cluster [DBG] pgmap v193: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 4 op/s 2021-11-03T16:52:34.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:34 smithi194 conmon[35111]: cluster 2021-11-03T16:52:33.044132+0000 mgr.smithi026.cnrxli (mgr.14162) 233 2021-11-03T16:52:34.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:34 smithi194 conmon[35111]: : cluster [DBG] pgmap v193: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 4 op/s 2021-11-03T16:52:35.339 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:35 smithi026 conmon[32119]: cluster 2021-11-03T16:52:34.049553+0000 mon.smithi026 ( 2021-11-03T16:52:35.340 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:35 smithi026 conmon[32119]: mon.0) 519 : cluster [DBG] mds.? [v2:172.21.15.26:6828/3059137105,v1:172.21.15.26:6829/3059137105] up:boot 2021-11-03T16:52:35.340 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:35 smithi026 conmon[32119]: cluster 2021-11-03T16:52:34.049608+0000 mon.smithi026 (mon.0) 520 : cluster [DBG] mds.? [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] up:standby 2021-11-03T16:52:35.340 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:35 smithi026 conmon[32119]: cluster 2021-11-03T16:52:34.049674+0000 mon.smithi026 (mon.0) 521 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi026.ltacyh=up:active} 3 up:standby 2021-11-03T16:52:35.340 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:35 smithi026 conmon[32119]: audit 2021-11-03T16:52:34.050023+0000 mon.smithi026 (mon.0) 522 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.yfxlxl"}]: dispatch 2021-11-03T16:52:35.341 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:35 smithi026 conmon[32119]: audit 2021-11-03T16:52:34.401042+0000 mon.smithi026 (mon.0) 523 : audit [DBG] from='client.? 172.21.15.26:0/3079602237' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2021-11-03T16:52:35.356 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- bash -c 'ceph --format=json mds versions | jq -e ". | add == 4"' 2021-11-03T16:52:35.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:35 smithi194 conmon[35111]: cluster 2021-11-03T16:52:34.049553+0000 mon.smithi026 (mon.0) 2021-11-03T16:52:35.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:35 smithi194 conmon[35111]: 519 : cluster [DBG] mds.? [v2:172.21.15.26:6828/3059137105,v1:172.21.15.26:6829/3059137105] up:boot 2021-11-03T16:52:35.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:35 smithi194 conmon[35111]: cluster 2021-11-03T16:52:34.049608+0000 mon.smithi026 (mon.0) 520 : cluster [DBG] mds.? [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] up:standby 2021-11-03T16:52:35.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:35 smithi194 conmon[35111]: cluster 2021-11-03T16:52:34.049674+0000 2021-11-03T16:52:35.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:35 smithi194 conmon[35111]: mon.smithi026 (mon.0) 521 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi026.ltacyh=up:active} 3 up:standby 2021-11-03T16:52:35.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:35 smithi194 conmon[35111]: audit 2021- 2021-11-03T16:52:35.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:35 smithi194 conmon[35111]: 11-03T16:52:34.050023+0000 mon.smithi026 (mon.0 2021-11-03T16:52:35.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:35 smithi194 conmon[35111]: ) 522 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.yfxlxl"}]: dispatch 2021-11-03T16:52:35.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:35 smithi194 conmon[35111]: audit 2021-11- 2021-11-03T16:52:35.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:35 smithi194 conmon[35111]: 03T16:52:34.401042+0000 mon.smithi026 (mon.0) 523 2021-11-03T16:52:35.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:35 smithi194 conmon[35111]: : audit [DBG] from='client.? 172.21.15.26:0/3079602237' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2021-11-03T16:52:36.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:36 smithi026 conmon[32119]: cluster 2021-11-03T16:52:35.044537+0000 mgr.smithi026.cnrxli (mgr 2021-11-03T16:52:36.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:36 smithi026 conmon[32119]: .14162) 234 : cluster [DBG] pgmap v194: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 613 B/s wr, 3 op/s 2021-11-03T16:52:36.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:36 smithi194 conmon[35111]: cluster 2021-11-03T16:52:35.044537+0000 mgr.smithi026.cnrxli ( 2021-11-03T16:52:36.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:36 smithi194 conmon[35111]: mgr.14162) 234 : cluster [DBG] pgmap v194: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 613 B/s wr, 3 op/s 2021-11-03T16:52:37.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.425+0000 7f50f26b8700 1 -- 172.21.15.26:0/2662128623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50ec0f5ef0 msgr2=0x7f50ec0f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:37.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.425+0000 7f50f26b8700 1 --2- 172.21.15.26:0/2662128623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50ec0f5ef0 0x7f50ec0f6920 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f50e0004660 tx=0x7f50e0009b30).stop 2021-11-03T16:52:37.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.425+0000 7f50f26b8700 1 -- 172.21.15.26:0/2662128623 shutdown_connections 2021-11-03T16:52:37.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.425+0000 7f50f26b8700 1 --2- 172.21.15.26:0/2662128623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50ec0f5ef0 0x7f50ec0f6920 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:37.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.425+0000 7f50f26b8700 1 --2- 172.21.15.26:0/2662128623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50ec0f55e0 0x7f50ec0f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:37.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.425+0000 7f50f26b8700 1 -- 172.21.15.26:0/2662128623 >> 172.21.15.26:0/2662128623 conn(0x7f50ec0f0de0 msgr2=0x7f50ec0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:37.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.425+0000 7f50f26b8700 1 -- 172.21.15.26:0/2662128623 shutdown_connections 2021-11-03T16:52:37.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.425+0000 7f50f26b8700 1 -- 172.21.15.26:0/2662128623 wait complete. 2021-11-03T16:52:37.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.426+0000 7f50f26b8700 1 Processor -- start 2021-11-03T16:52:37.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.426+0000 7f50f26b8700 1 -- start start 2021-11-03T16:52:37.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.426+0000 7f50f26b8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50ec0f55e0 0x7f50ec105e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:37.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.426+0000 7f50f26b8700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50ec0f5ef0 0x7f50ec106350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:37.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.426+0000 7f50f26b8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ec106950 con 0x7f50ec0f55e0 2021-11-03T16:52:37.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.426+0000 7f50f26b8700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ec107160 con 0x7f50ec0f5ef0 2021-11-03T16:52:37.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.426+0000 7f50ebfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50ec0f55e0 0x7f50ec105e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:37.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.426+0000 7f50ebfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50ec0f55e0 0x7f50ec105e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50138/0 (socket says 172.21.15.26:50138) 2021-11-03T16:52:37.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.426+0000 7f50ebfff700 1 -- 172.21.15.26:0/3949804992 learned_addr learned my addr 172.21.15.26:0/3949804992 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:52:37.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.427+0000 7f50eb7fe700 1 --2- 172.21.15.26:0/3949804992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50ec0f5ef0 0x7f50ec106350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:37.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.427+0000 7f50ebfff700 1 -- 172.21.15.26:0/3949804992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50ec0f5ef0 msgr2=0x7f50ec106350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:37.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.427+0000 7f50ebfff700 1 --2- 172.21.15.26:0/3949804992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50ec0f5ef0 0x7f50ec106350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:37.428 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.427+0000 7f50ebfff700 1 -- 172.21.15.26:0/3949804992 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e0005040 con 0x7f50ec0f55e0 2021-11-03T16:52:37.428 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.427+0000 7f50ebfff700 1 --2- 172.21.15.26:0/3949804992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50ec0f55e0 0x7f50ec105e60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f50dc002700 tx=0x7f50dc009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:37.428 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.427+0000 7f50e8ff9700 1 -- 172.21.15.26:0/3949804992 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50dc009320 con 0x7f50ec0f55e0 2021-11-03T16:52:37.428 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.427+0000 7f50e8ff9700 1 -- 172.21.15.26:0/3949804992 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f50dc00f040 con 0x7f50ec0f55e0 2021-11-03T16:52:37.428 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.427+0000 7f50f26b8700 1 -- 172.21.15.26:0/3949804992 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50ec1073e0 con 0x7f50ec0f55e0 2021-11-03T16:52:37.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.427+0000 7f50e8ff9700 1 -- 172.21.15.26:0/3949804992 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50dc0147e0 con 0x7f50ec0f55e0 2021-11-03T16:52:37.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.427+0000 7f50f26b8700 1 -- 172.21.15.26:0/3949804992 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50ec1079a0 con 0x7f50ec0f55e0 2021-11-03T16:52:37.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.428+0000 7f50f26b8700 1 -- 172.21.15.26:0/3949804992 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50ec0f4a70 con 0x7f50ec0f55e0 2021-11-03T16:52:37.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.429+0000 7f50e8ff9700 1 -- 172.21.15.26:0/3949804992 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f50dc009480 con 0x7f50ec0f55e0 2021-11-03T16:52:37.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.429+0000 7f50e8ff9700 1 --2- 172.21.15.26:0/3949804992 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f50d405c2b0 0x7f50d405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:37.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.429+0000 7f50e8ff9700 1 -- 172.21.15.26:0/3949804992 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f50dc0764d0 con 0x7f50ec0f55e0 2021-11-03T16:52:37.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.429+0000 7f50eb7fe700 1 --2- 172.21.15.26:0/3949804992 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f50d405c2b0 0x7f50d405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:37.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.430+0000 7f50eb7fe700 1 --2- 172.21.15.26:0/3949804992 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f50d405c2b0 0x7f50d405e770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f50e0005010 tx=0x7f50e0009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:37.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.433+0000 7f50e8ff9700 1 -- 172.21.15.26:0/3949804992 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f50dc049230 con 0x7f50ec0f55e0 2021-11-03T16:52:37.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.680+0000 7f50f26b8700 1 -- 172.21.15.26:0/3949804992 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f50ec045ad0 con 0x7f50ec0f55e0 2021-11-03T16:52:37.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.680+0000 7f50e8ff9700 1 -- 172.21.15.26:0/3949804992 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v8) v1 ==== 78+0+86 (secure 0 0 0) 0x7f50dc04c850 con 0x7f50ec0f55e0 2021-11-03T16:52:37.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.683+0000 7f50f26b8700 1 -- 172.21.15.26:0/3949804992 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f50d405c2b0 msgr2=0x7f50d405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:37.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.683+0000 7f50f26b8700 1 --2- 172.21.15.26:0/3949804992 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f50d405c2b0 0x7f50d405e770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f50e0005010 tx=0x7f50e0009b30).stop 2021-11-03T16:52:37.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.683+0000 7f50f26b8700 1 -- 172.21.15.26:0/3949804992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50ec0f55e0 msgr2=0x7f50ec105e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:37.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.683+0000 7f50f26b8700 1 --2- 172.21.15.26:0/3949804992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50ec0f55e0 0x7f50ec105e60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f50dc002700 tx=0x7f50dc009e00).stop 2021-11-03T16:52:37.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.683+0000 7f50f26b8700 1 -- 172.21.15.26:0/3949804992 shutdown_connections 2021-11-03T16:52:37.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.683+0000 7f50f26b8700 1 --2- 172.21.15.26:0/3949804992 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f50d405c2b0 0x7f50d405e770 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:37.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.683+0000 7f50f26b8700 1 --2- 172.21.15.26:0/3949804992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50ec0f55e0 0x7f50ec105e60 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:37.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.683+0000 7f50f26b8700 1 --2- 172.21.15.26:0/3949804992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50ec0f5ef0 0x7f50ec106350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:37.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.683+0000 7f50f26b8700 1 -- 172.21.15.26:0/3949804992 >> 172.21.15.26:0/3949804992 conn(0x7f50ec0f0de0 msgr2=0x7f50ec0fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:37.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.683+0000 7f50f26b8700 1 -- 172.21.15.26:0/3949804992 shutdown_connections 2021-11-03T16:52:37.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:37.683+0000 7f50f26b8700 1 -- 172.21.15.26:0/3949804992 wait complete. 2021-11-03T16:52:37.691 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T16:52:38.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:38 smithi026 conmon[32119]: cluster 2021-11-03T16:52:37.045720+0000 mgr.smithi026.cnrxli (mgr.14162) 235 : cluster [DBG] pgmap v195: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 3 op/s 2021-11-03T16:52:38.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:38 smithi026 conmon[32119]: audit 2021-11-03T16:52:37.302951+0000 mon.smithi026 (mon.0) 524 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:52:38.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:38 smithi026 conmon[32119]: audit 2021-11-03T16:52:37.306108+0000 mon.smithi026 (mon.0) 525 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:52:38.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:38 smithi026 conmon[32119]: audit 2021-11-03T16:52:37.310455+0000 mon.smithi026 (mon.0) 526 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:52:38.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:38 smithi026 conmon[32119]: audit 2021-11-03T16:52:37.681012+0000 mon.smithi026 (mon.0) 527 : audit [DBG] from='client.? 172.21.15.26:0/3949804992' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2021-11-03T16:52:38.735 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2021-11-03T16:52:38.756 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-03T16:52:38.757 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:38 smithi194 conmon[35111]: cluster 2021-11-03T16:52:37.045720+0000 mgr.smithi026.cnrxli 2021-11-03T16:52:38.757 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:38 smithi194 conmon[35111]: (mgr.14162) 235 : cluster [DBG] pgmap v195: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 3 op/s 2021-11-03T16:52:38.758 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:38 smithi194 conmon[35111]: audit 2021-11-03T16:52:37.302951+0000 mon.smithi026 (mon.0) 524 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:52:38.758 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:38 smithi194 conmon[35111]: audit 2021-11-03T16:52:37.306108+0000 mon.smithi026 (mon.0) 525 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:52:38.758 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:38 smithi194 conmon[35111]: audit 2021-11-03T16:52:37.310455+0000 mon.smithi026 (mon.0) 526 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:52:38.759 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:38 smithi194 conmon[35111]: audit 2021-11-03T16:52:37.681012+0000 mon.smithi026 (mon.0) 527 : audit [DBG] from='client.? 172.21.15.26:0/3949804992' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2021-11-03T16:52:39.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.006+0000 7f6672c65700 1 -- 172.21.15.26:0/201548845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f666c0f55a0 msgr2=0x7f666c0f59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:39.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.006+0000 7f6672c65700 1 --2- 172.21.15.26:0/201548845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f666c0f55a0 0x7f666c0f59c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f6660004660 tx=0x7f6660009b30).stop 2021-11-03T16:52:39.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.006+0000 7f6672c65700 1 -- 172.21.15.26:0/201548845 shutdown_connections 2021-11-03T16:52:39.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.006+0000 7f6672c65700 1 --2- 172.21.15.26:0/201548845 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f666c0f6840 0x7f666c0f6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:39.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.006+0000 7f6672c65700 1 --2- 172.21.15.26:0/201548845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f666c0f55a0 0x7f666c0f59c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:39.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.006+0000 7f6672c65700 1 -- 172.21.15.26:0/201548845 >> 172.21.15.26:0/201548845 conn(0x7f666c0f0ce0 msgr2=0x7f666c0f3120 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:39.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.006+0000 7f6672c65700 1 -- 172.21.15.26:0/201548845 shutdown_connections 2021-11-03T16:52:39.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.006+0000 7f6672c65700 1 -- 172.21.15.26:0/201548845 wait complete. 2021-11-03T16:52:39.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.007+0000 7f6672c65700 1 Processor -- start 2021-11-03T16:52:39.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.007+0000 7f6672c65700 1 -- start start 2021-11-03T16:52:39.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.007+0000 7f6672c65700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f666c0f55a0 0x7f666c106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:39.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.007+0000 7f6672c65700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f666c0f6840 0x7f666c107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:39.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.007+0000 7f6672c65700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f666c1078c0 con 0x7f666c0f55a0 2021-11-03T16:52:39.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.007+0000 7f6672c65700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f666c107a00 con 0x7f666c0f6840 2021-11-03T16:52:39.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.007+0000 7f6670a01700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f666c0f55a0 0x7f666c106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:39.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.007+0000 7f6670a01700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f666c0f55a0 0x7f666c106e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50148/0 (socket says 172.21.15.26:50148) 2021-11-03T16:52:39.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.007+0000 7f6670a01700 1 -- 172.21.15.26:0/2547420706 learned_addr learned my addr 172.21.15.26:0/2547420706 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:52:39.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.007+0000 7f666bfff700 1 --2- 172.21.15.26:0/2547420706 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f666c0f6840 0x7f666c107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:39.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.007+0000 7f6670a01700 1 -- 172.21.15.26:0/2547420706 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f666c0f6840 msgr2=0x7f666c107310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:39.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.007+0000 7f6670a01700 1 --2- 172.21.15.26:0/2547420706 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f666c0f6840 0x7f666c107310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:39.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.007+0000 7f6670a01700 1 -- 172.21.15.26:0/2547420706 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6660005040 con 0x7f666c0f55a0 2021-11-03T16:52:39.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.008+0000 7f6670a01700 1 --2- 172.21.15.26:0/2547420706 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f666c0f55a0 0x7f666c106e20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f6660014040 tx=0x7f666000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:39.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.008+0000 7f66697fa700 1 -- 172.21.15.26:0/2547420706 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6660019070 con 0x7f666c0f55a0 2021-11-03T16:52:39.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.008+0000 7f6672c65700 1 -- 172.21.15.26:0/2547420706 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f666c10c440 con 0x7f666c0f55a0 2021-11-03T16:52:39.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.008+0000 7f66697fa700 1 -- 172.21.15.26:0/2547420706 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f6660007e50 con 0x7f666c0f55a0 2021-11-03T16:52:39.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.008+0000 7f66697fa700 1 -- 172.21.15.26:0/2547420706 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6660014d30 con 0x7f666c0f55a0 2021-11-03T16:52:39.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.008+0000 7f6672c65700 1 -- 172.21.15.26:0/2547420706 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f666c10ca00 con 0x7f666c0f55a0 2021-11-03T16:52:39.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.009+0000 7f6672c65700 1 -- 172.21.15.26:0/2547420706 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f666c0fdd60 con 0x7f666c0f55a0 2021-11-03T16:52:39.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.009+0000 7f66697fa700 1 -- 172.21.15.26:0/2547420706 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f6660025070 con 0x7f666c0f55a0 2021-11-03T16:52:39.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.009+0000 7f66697fa700 1 --2- 172.21.15.26:0/2547420706 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f665c05c2a0 0x7f665c05e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:39.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.010+0000 7f66697fa700 1 -- 172.21.15.26:0/2547420706 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f6660076fa0 con 0x7f666c0f55a0 2021-11-03T16:52:39.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.010+0000 7f666bfff700 1 --2- 172.21.15.26:0/2547420706 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f665c05c2a0 0x7f665c05e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:39.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.010+0000 7f666bfff700 1 --2- 172.21.15.26:0/2547420706 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f665c05c2a0 0x7f665c05e760 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f6658007f80 tx=0x7f665800b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:39.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.017+0000 7f66697fa700 1 -- 172.21.15.26:0/2547420706 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f6660049c80 con 0x7f666c0f55a0 2021-11-03T16:52:39.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.202+0000 7f6672c65700 1 -- 172.21.15.26:0/2547420706 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f666c10d310 con 0x7f666c0f55a0 2021-11-03T16:52:39.198 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.203+0000 7f66697fa700 1 -- 172.21.15.26:0/2547420706 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+14017 (secure 0 0 0) 0x7f666004d2a0 con 0x7f666c0f55a0 2021-11-03T16:52:39.199 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:52:39.199 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":42,"fsid":"70492bc6-3cc5-11ec-8c28-001a4aab830c","created":"2021-11-03T16:46:02.235903+0000","modified":"2021-11-03T16:52:19.114570+0000","last_up_change":"2021-11-03T16:50:54.115835+0000","last_in_change":"2021-11-03T16:50:37.526661+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-03T16:50:10.362172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2021-11-03T16:52:15.682462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2021-11-03T16:52:16.543451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bf72169c-0b6d-4360-8f55-7add81fa314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":134495914},{"type":"v1","addr":"172.21.15.26:6803","nonce":134495914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":134495914},{"type":"v1","addr":"172.21.15.26:6805","nonce":134495914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":134495914},{"type":"v1","addr":"172.21.15.26:6809","nonce":134495914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":134495914},{"type":"v1","addr":"172.21.15.26:6807","nonce":134495914}]},"public_addr":"172.21.15.26:6803/134495914","cluster_addr":"172.21.15.26:6805/134495914","heartbeat_back_addr":"172.21.15.26:6809/134495914","heartbeat_front_addr":"172.21.15.26:6807/134495914","state":["exists","up"]},{"osd":1,"uuid":"9c8f520a-9e32-4b5f-bd70-9ba30526ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2411537943},{"type":"v1","addr":"172.21.15.26:6811","nonce":2411537943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":2411537943},{"type":"v1","addr":"172.21.15.26:6813","nonce":2411537943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2411537943},{"type":"v1","addr":"172.21.15.26:6817","nonce":2411537943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2411537943},{"type":"v1","addr":"172.21.15.26:6815","nonce":2411537943}]},"public_addr":"172.21.15.26:6811/2411537943","cluster_addr":"172.21.15.26:6813/2411537943","heartbeat_back_addr":"172.21.15.26:6817/2411537943","heartbeat_front_addr":"172.21.15.26:6815/2411537943","state":["exists","up"]},{"osd":2,"uuid":"dbb31ed5-aa1f-4832-9101-5fd23c08e194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":79646117},{"type":"v1","addr":"172.21.15.26:6819","nonce":79646117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":79646117},{"type":"v1","addr":"172.21.15.26:6821","nonce":79646117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":79646117},{"type":"v1","addr":"172.21.15.26:6825","nonce":79646117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":79646117},{"type":"v1","addr":"172.21.15.26:6823","nonce":79646117}]},"public_addr":"172.21.15.26:6819/79646117","cluster_addr":"172.21.15.26:6821/79646117","heartbeat_back_addr":"172.21.15.26:6825/79646117","heartbeat_front_addr":"172.21.15.26:6823/79646117","state":["exists","up"]},{"osd":3,"uuid":"5e168819-6fae-4e49-9c2d-0e04ee27575e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2165579585},{"type":"v1","addr":"172.21.15.194:6801","nonce":2165579585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2165579585},{"type":"v1","addr":"172.21.15.194:6803","nonce":2165579585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2165579585},{"type":"v1","addr":"172.21.15.194:6807","nonce":2165579585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2165579585},{"type":"v1","addr":"172.21.15.194:6805","nonce":2165579585}]},"public_addr":"172.21.15.194:6801/2165579585","cluster_addr":"172.21.15.194:6803/2165579585","heartbeat_back_addr":"172.21.15.194:6807/2165579585","heartbeat_front_addr":"172.21.15.194:6805/2165579585","state":["exists","up"]},{"osd":4,"uuid":"ddecb09f-cc9a-4c46-a537-d53a5249a778","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3847943561},{"type":"v1","addr":"172.21.15.194:6809","nonce":3847943561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3847943561},{"type":"v1","addr":"172.21.15.194:6811","nonce":3847943561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3847943561},{"type":"v1","addr":"172.21.15.194:6815","nonce":3847943561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3847943561},{"type":"v1","addr":"172.21.15.194:6813","nonce":3847943561}]},"public_addr":"172.21.15.194:6809/3847943561","cluster_addr":"172.21.15.194:6811/3847943561","heartbeat_back_addr":"172.21.15.194:6815/3847943561","heartbeat_front_addr":"172.21.15.194:6813/3847943561","state":["exists","up"]},{"osd":5,"uuid":"2fd86a44-51f4-46fb-b0d9-bac56ca01747","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":89262300},{"type":"v1","addr":"172.21.15.194:6817","nonce":89262300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":89262300},{"type":"v1","addr":"172.21.15.194:6819","nonce":89262300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":89262300},{"type":"v1","addr":"172.21.15.194:6823","nonce":89262300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":89262300},{"type":"v1","addr":"172.21.15.194:6821","nonce":89262300}]},"public_addr":"172.21.15.194:6817/89262300","cluster_addr":"172.21.15.194:6819/89262300","heartbeat_back_addr":"172.21.15.194:6823/89262300","heartbeat_front_addr":"172.21.15.194:6821/89262300","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-11-03T16:49:11.853661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-11-03T16:49:34.610764+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-11-03T16:49:57.604298+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-11-03T16:50:14.894440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-11-03T16:50:33.665171+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-11-03T16:50:52.798669+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:0/98237695":"2021-11-04T16:47:08.279607+0000","172.21.15.26:6800/3020148896":"2021-11-04T16:47:08.279607+0000","172.21.15.26:0/2642113831":"2021-11-04T16:47:08.279607+0000","172.21.15.26:6801/1563027933":"2021-11-04T16:46:50.621601+0000","172.21.15.26:6800/1563027933":"2021-11-04T16:46:50.621601+0000","172.21.15.26:6801/3020148896":"2021-11-04T16:47:08.279607+0000","172.21.15.26:0/4016577399":"2021-11-04T16:46:27.010637+0000","172.21.15.26:0/3941898157":"2021-11-04T16:46:50.621601+0000","172.21.15.26:0/2388202642":"2021-11-04T16:46:27.010637+0000","172.21.15.26:6800/2267111092":"2021-11-04T16:46:27.010637+0000","172.21.15.26:0/141868141":"2021-11-04T16:46:50.621601+0000","172.21.15.26:6801/2267111092":"2021-11-04T16:46:27.010637+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-11-03T16:52:39.200 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.205+0000 7f6672c65700 1 -- 172.21.15.26:0/2547420706 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f665c05c2a0 msgr2=0x7f665c05e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:39.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.205+0000 7f6672c65700 1 --2- 172.21.15.26:0/2547420706 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f665c05c2a0 0x7f665c05e760 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f6658007f80 tx=0x7f665800b040).stop 2021-11-03T16:52:39.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.205+0000 7f6672c65700 1 -- 172.21.15.26:0/2547420706 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f666c0f55a0 msgr2=0x7f666c106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:39.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.205+0000 7f6672c65700 1 --2- 172.21.15.26:0/2547420706 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f666c0f55a0 0x7f666c106e20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f6660014040 tx=0x7f666000b040).stop 2021-11-03T16:52:39.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.205+0000 7f6672c65700 1 -- 172.21.15.26:0/2547420706 shutdown_connections 2021-11-03T16:52:39.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.205+0000 7f6672c65700 1 --2- 172.21.15.26:0/2547420706 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f665c05c2a0 0x7f665c05e760 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:39.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.205+0000 7f6672c65700 1 --2- 172.21.15.26:0/2547420706 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f666c0f55a0 0x7f666c106e20 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:39.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.205+0000 7f6672c65700 1 --2- 172.21.15.26:0/2547420706 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f666c0f6840 0x7f666c107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:39.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.205+0000 7f6672c65700 1 -- 172.21.15.26:0/2547420706 >> 172.21.15.26:0/2547420706 conn(0x7f666c0f0ce0 msgr2=0x7f666c05fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:39.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.205+0000 7f6672c65700 1 -- 172.21.15.26:0/2547420706 shutdown_connections 2021-11-03T16:52:39.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.205+0000 7f6672c65700 1 -- 172.21.15.26:0/2547420706 wait complete. 2021-11-03T16:52:39.213 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-03T16:50:10.362172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2021-11-03T16:52:15.682462+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2021-11-03T16:52:16.543451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-03T16:52:39.214 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-03T16:52:39.338 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.340+0000 7fe72de91700 1 -- 172.21.15.26:0/3461100997 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7280fbbb0 msgr2=0x7fe7280fdfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:39.339 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.340+0000 7fe72de91700 1 --2- 172.21.15.26:0/3461100997 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7280fbbb0 0x7fe7280fdfa0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fe71c004660 tx=0x7fe71c009b30).stop 2021-11-03T16:52:39.339 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.340+0000 7fe72de91700 1 -- 172.21.15.26:0/3461100997 shutdown_connections 2021-11-03T16:52:39.339 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.340+0000 7fe72de91700 1 --2- 172.21.15.26:0/3461100997 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7280fbbb0 0x7fe7280fdfa0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:39.339 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.340+0000 7fe72de91700 1 --2- 172.21.15.26:0/3461100997 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7280600e0 0x7fe7280fb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:39.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.340+0000 7fe72de91700 1 -- 172.21.15.26:0/3461100997 >> 172.21.15.26:0/3461100997 conn(0x7fe7280f0ce0 msgr2=0x7fe7280f3100 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:39.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.340+0000 7fe72de91700 1 -- 172.21.15.26:0/3461100997 shutdown_connections 2021-11-03T16:52:39.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.340+0000 7fe72de91700 1 -- 172.21.15.26:0/3461100997 wait complete. 2021-11-03T16:52:39.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.340+0000 7fe72de91700 1 Processor -- start 2021-11-03T16:52:39.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.341+0000 7fe72de91700 1 -- start start 2021-11-03T16:52:39.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.341+0000 7fe72de91700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7280600e0 0x7fe728108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:39.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.341+0000 7fe72de91700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7280fbbb0 0x7fe7281094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:39.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.341+0000 7fe72de91700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe728109a70 con 0x7fe7280fbbb0 2021-11-03T16:52:39.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.341+0000 7fe72de91700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe728109bb0 con 0x7fe7280600e0 2021-11-03T16:52:39.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.341+0000 7fe726ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7280fbbb0 0x7fe7281094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:39.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.341+0000 7fe726ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7280fbbb0 0x7fe7281094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50160/0 (socket says 172.21.15.26:50160) 2021-11-03T16:52:39.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.341+0000 7fe726ffd700 1 -- 172.21.15.26:0/1976698284 learned_addr learned my addr 172.21.15.26:0/1976698284 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:52:39.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.341+0000 7fe7277fe700 1 --2- 172.21.15.26:0/1976698284 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7280600e0 0x7fe728108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:39.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.341+0000 7fe726ffd700 1 -- 172.21.15.26:0/1976698284 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7280600e0 msgr2=0x7fe728108fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:39.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.341+0000 7fe726ffd700 1 --2- 172.21.15.26:0/1976698284 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7280600e0 0x7fe728108fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:39.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.341+0000 7fe726ffd700 1 -- 172.21.15.26:0/1976698284 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe71c005040 con 0x7fe7280fbbb0 2021-11-03T16:52:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.341+0000 7fe726ffd700 1 --2- 172.21.15.26:0/1976698284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7280fbbb0 0x7fe7281094c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fe71c014040 tx=0x7fe71c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.341+0000 7fe70ffff700 1 -- 172.21.15.26:0/1976698284 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe71c019070 con 0x7fe7280fbbb0 2021-11-03T16:52:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.342+0000 7fe70ffff700 1 -- 172.21.15.26:0/1976698284 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fe71c007e50 con 0x7fe7280fbbb0 2021-11-03T16:52:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.342+0000 7fe72de91700 1 -- 172.21.15.26:0/1976698284 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe72810e5f0 con 0x7fe7280fbbb0 2021-11-03T16:52:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.342+0000 7fe70ffff700 1 -- 172.21.15.26:0/1976698284 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe71c014c90 con 0x7fe7280fbbb0 2021-11-03T16:52:39.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.342+0000 7fe72de91700 1 -- 172.21.15.26:0/1976698284 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe72810ebb0 con 0x7fe7280fbbb0 2021-11-03T16:52:39.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.343+0000 7fe72de91700 1 -- 172.21.15.26:0/1976698284 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe728027a00 con 0x7fe7280fbbb0 2021-11-03T16:52:39.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.343+0000 7fe70ffff700 1 -- 172.21.15.26:0/1976698284 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fe71c025070 con 0x7fe7280fbbb0 2021-11-03T16:52:39.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.343+0000 7fe70ffff700 1 --2- 172.21.15.26:0/1976698284 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe71005c2a0 0x7fe71005e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:39.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.343+0000 7fe70ffff700 1 -- 172.21.15.26:0/1976698284 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fe71c076f10 con 0x7fe7280fbbb0 2021-11-03T16:52:39.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.343+0000 7fe7277fe700 1 --2- 172.21.15.26:0/1976698284 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe71005c2a0 0x7fe71005e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:39.347 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.344+0000 7fe7277fe700 1 --2- 172.21.15.26:0/1976698284 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe71005c2a0 0x7fe71005e760 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fe718009fd0 tx=0x7fe71800b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:39.348 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.347+0000 7fe70ffff700 1 -- 172.21.15.26:0/1976698284 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fe71c049bf0 con 0x7fe7280fbbb0 2021-11-03T16:52:39.520 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.524+0000 7fe72de91700 1 -- 172.21.15.26:0/1976698284 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe728101040 con 0x7fe7280fbbb0 2021-11-03T16:52:39.521 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.525+0000 7fe70ffff700 1 -- 172.21.15.26:0/1976698284 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v42) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe71c04d210 con 0x7fe7280fbbb0 2021-11-03T16:52:39.521 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2021-11-03T16:52:39.523 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.527+0000 7fe72de91700 1 -- 172.21.15.26:0/1976698284 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe71005c2a0 msgr2=0x7fe71005e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:39.523 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.527+0000 7fe72de91700 1 --2- 172.21.15.26:0/1976698284 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe71005c2a0 0x7fe71005e760 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fe718009fd0 tx=0x7fe71800b040).stop 2021-11-03T16:52:39.523 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.527+0000 7fe72de91700 1 -- 172.21.15.26:0/1976698284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7280fbbb0 msgr2=0x7fe7281094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:39.524 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.527+0000 7fe72de91700 1 --2- 172.21.15.26:0/1976698284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7280fbbb0 0x7fe7281094c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fe71c014040 tx=0x7fe71c00b040).stop 2021-11-03T16:52:39.524 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.527+0000 7fe72de91700 1 -- 172.21.15.26:0/1976698284 shutdown_connections 2021-11-03T16:52:39.524 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.527+0000 7fe72de91700 1 --2- 172.21.15.26:0/1976698284 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe71005c2a0 0x7fe71005e760 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:39.524 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.527+0000 7fe72de91700 1 --2- 172.21.15.26:0/1976698284 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7280600e0 0x7fe728108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:39.525 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.527+0000 7fe72de91700 1 --2- 172.21.15.26:0/1976698284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7280fbbb0 0x7fe7281094c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:39.525 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.527+0000 7fe72de91700 1 -- 172.21.15.26:0/1976698284 >> 172.21.15.26:0/1976698284 conn(0x7fe7280f0ce0 msgr2=0x7fe7280f30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:39.525 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.527+0000 7fe72de91700 1 -- 172.21.15.26:0/1976698284 shutdown_connections 2021-11-03T16:52:39.525 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.527+0000 7fe72de91700 1 -- 172.21.15.26:0/1976698284 wait complete. 2021-11-03T16:52:39.534 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:39 smithi026 conmon[32119]: cluster 2021-11-03T16:52:38.307173+0000 2021-11-03T16:52:39.535 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:39 smithi026 conmon[32119]: mon.smithi026 (mon.0) 528 : cluster [DBG] mds.? [v2:172.21.15.26:6828/3059137105,v1:172.21.15.26:6829/3059137105] up:standby 2021-11-03T16:52:39.535 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:39 smithi026 conmon[32119]: cluster 2021-11-03T16:52:38.307227+0000 mon.smithi026 (mon.0) 529 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi026.ltacyh=up:active} 3 up:standby 2021-11-03T16:52:39.535 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:39 smithi026 conmon[32119]: audit 2021-11-03T16:52:39.203713+0000 mon.smithi026 (mon.0) 530 : audit [DBG] from='client.? 172.21.15.26:0/2547420706' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-11-03T16:52:39.536 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2021-11-03T16:52:39.670 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.673+0000 7f1eff861700 1 -- 172.21.15.26:0/4060728240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ef80f6500 msgr2=0x7f1ef80f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:39.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.673+0000 7f1eff861700 1 --2- 172.21.15.26:0/4060728240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ef80f6500 0x7f1ef80f6920 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f1ef4004660 tx=0x7f1ef4009b30).stop 2021-11-03T16:52:39.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.673+0000 7f1eff861700 1 -- 172.21.15.26:0/4060728240 shutdown_connections 2021-11-03T16:52:39.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.673+0000 7f1eff861700 1 --2- 172.21.15.26:0/4060728240 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ef80f77a0 0x7f1ef80f7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:39.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.673+0000 7f1eff861700 1 --2- 172.21.15.26:0/4060728240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ef80f6500 0x7f1ef80f6920 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:39.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.673+0000 7f1eff861700 1 -- 172.21.15.26:0/4060728240 >> 172.21.15.26:0/4060728240 conn(0x7f1ef80f1c40 msgr2=0x7f1ef80f4080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:39.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.674+0000 7f1eff861700 1 -- 172.21.15.26:0/4060728240 shutdown_connections 2021-11-03T16:52:39.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.674+0000 7f1eff861700 1 -- 172.21.15.26:0/4060728240 wait complete. 2021-11-03T16:52:39.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.674+0000 7f1eff861700 1 Processor -- start 2021-11-03T16:52:39.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.674+0000 7f1eff861700 1 -- start start 2021-11-03T16:52:39.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.674+0000 7f1eff861700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ef80f6500 0x7f1ef806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:39.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.674+0000 7f1eff861700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ef80f77a0 0x7f1ef8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:39.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.674+0000 7f1eff861700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef806a380 con 0x7f1ef80f6500 2021-11-03T16:52:39.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.674+0000 7f1eff861700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef806a4c0 con 0x7f1ef80f77a0 2021-11-03T16:52:39.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.674+0000 7f1efd5fd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ef80f6500 0x7f1ef806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:39.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.674+0000 7f1efd5fd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ef80f6500 0x7f1ef806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50168/0 (socket says 172.21.15.26:50168) 2021-11-03T16:52:39.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.674+0000 7f1efd5fd700 1 -- 172.21.15.26:0/4108508230 learned_addr learned my addr 172.21.15.26:0/4108508230 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:52:39.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.674+0000 7f1efcdfc700 1 --2- 172.21.15.26:0/4108508230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ef80f77a0 0x7f1ef8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:39.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.675+0000 7f1efd5fd700 1 -- 172.21.15.26:0/4108508230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ef80f77a0 msgr2=0x7f1ef8069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:39.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.675+0000 7f1efd5fd700 1 --2- 172.21.15.26:0/4108508230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ef80f77a0 0x7f1ef8069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:39.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.675+0000 7f1efd5fd700 1 -- 172.21.15.26:0/4108508230 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef4005040 con 0x7f1ef80f6500 2021-11-03T16:52:39.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.675+0000 7f1efd5fd700 1 --2- 172.21.15.26:0/4108508230 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ef80f6500 0x7f1ef806b9a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f1ef4014040 tx=0x7f1ef400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:39.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.675+0000 7f1ee9ffb700 1 -- 172.21.15.26:0/4108508230 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ef4019070 con 0x7f1ef80f6500 2021-11-03T16:52:39.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.675+0000 7f1ee9ffb700 1 -- 172.21.15.26:0/4108508230 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f1ef4007e50 con 0x7f1ef80f6500 2021-11-03T16:52:39.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.675+0000 7f1eff861700 1 -- 172.21.15.26:0/4108508230 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ef806a740 con 0x7f1ef80f6500 2021-11-03T16:52:39.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.675+0000 7f1ee9ffb700 1 -- 172.21.15.26:0/4108508230 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ef4014d30 con 0x7f1ef80f6500 2021-11-03T16:52:39.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.675+0000 7f1eff861700 1 -- 172.21.15.26:0/4108508230 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ef806aca0 con 0x7f1ef80f6500 2021-11-03T16:52:39.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.676+0000 7f1eff861700 1 -- 172.21.15.26:0/4108508230 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ef8045ad0 con 0x7f1ef80f6500 2021-11-03T16:52:39.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.676+0000 7f1ee9ffb700 1 -- 172.21.15.26:0/4108508230 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f1ef4025070 con 0x7f1ef80f6500 2021-11-03T16:52:39.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.677+0000 7f1ee9ffb700 1 --2- 172.21.15.26:0/4108508230 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f1ee405c2b0 0x7f1ee405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:39.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.677+0000 7f1ee9ffb700 1 -- 172.21.15.26:0/4108508230 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f1ef4076f80 con 0x7f1ef80f6500 2021-11-03T16:52:39.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.677+0000 7f1efcdfc700 1 --2- 172.21.15.26:0/4108508230 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f1ee405c2b0 0x7f1ee405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:39.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.677+0000 7f1efcdfc700 1 --2- 172.21.15.26:0/4108508230 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f1ee405c2b0 0x7f1ee405e770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f1eec007fd0 tx=0x7f1eec00b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:39.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.681+0000 7f1ee9ffb700 1 -- 172.21.15.26:0/4108508230 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f1ef4049c60 con 0x7f1ef80f6500 2021-11-03T16:52:39.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:39 smithi194 conmon[35111]: cluster 2021-11-03T16:52:38.307173+0000 mon.smithi026 (mon. 2021-11-03T16:52:39.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:39 smithi194 conmon[35111]: 0) 528 : cluster [DBG] mds.? [v2:172.21.15.26:6828/3059137105,v1:172.21.15.26:6829/3059137105] up:standby 2021-11-03T16:52:39.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:39 smithi194 conmon[35111]: cluster 2021-11-03T16:52:38.307227+0000 mon.smithi026 (mon.0) 529 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi026.ltacyh=up:active} 3 up:standby 2021-11-03T16:52:39.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:39 smithi194 conmon[35111]: audit 2021-11-03T16:52:39.203713+0000 mon.smithi026 (mon.0) 530 : audit [DBG] 2021-11-03T16:52:39.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:39 smithi194 conmon[35111]: from='client.? 172.21.15.26:0/2547420706' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-11-03T16:52:39.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.841+0000 7f1eff861700 1 -- 172.21.15.26:0/4108508230 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f1ef8027a00 con 0x7f1ef80f6500 2021-11-03T16:52:39.837 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.842+0000 7f1ee9ffb700 1 -- 172.21.15.26:0/4108508230 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v42) v1 ==== 107+0+11 (secure 0 0 0) 0x7f1ef404d280 con 0x7f1ef80f6500 2021-11-03T16:52:39.837 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2021-11-03T16:52:39.839 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.843+0000 7f1eff861700 1 -- 172.21.15.26:0/4108508230 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f1ee405c2b0 msgr2=0x7f1ee405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:39.839 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.843+0000 7f1eff861700 1 --2- 172.21.15.26:0/4108508230 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f1ee405c2b0 0x7f1ee405e770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f1eec007fd0 tx=0x7f1eec00b040).stop 2021-11-03T16:52:39.840 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.843+0000 7f1eff861700 1 -- 172.21.15.26:0/4108508230 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ef80f6500 msgr2=0x7f1ef806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:39.840 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.843+0000 7f1eff861700 1 --2- 172.21.15.26:0/4108508230 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ef80f6500 0x7f1ef806b9a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f1ef4014040 tx=0x7f1ef400b040).stop 2021-11-03T16:52:39.840 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.844+0000 7f1eff861700 1 -- 172.21.15.26:0/4108508230 shutdown_connections 2021-11-03T16:52:39.840 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.844+0000 7f1eff861700 1 --2- 172.21.15.26:0/4108508230 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f1ee405c2b0 0x7f1ee405e770 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:39.840 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.844+0000 7f1eff861700 1 --2- 172.21.15.26:0/4108508230 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ef80f6500 0x7f1ef806b9a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:39.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.844+0000 7f1eff861700 1 --2- 172.21.15.26:0/4108508230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ef80f77a0 0x7f1ef8069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:39.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.844+0000 7f1eff861700 1 -- 172.21.15.26:0/4108508230 >> 172.21.15.26:0/4108508230 conn(0x7f1ef80f1c40 msgr2=0x7f1ef80fb1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:39.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.844+0000 7f1eff861700 1 -- 172.21.15.26:0/4108508230 shutdown_connections 2021-11-03T16:52:39.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.844+0000 7f1eff861700 1 -- 172.21.15.26:0/4108508230 wait complete. 2021-11-03T16:52:39.851 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2021-11-03T16:52:39.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.976+0000 7f405bd08700 1 -- 172.21.15.26:0/4232991925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40540f5580 msgr2=0x7f40540f59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:39.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.976+0000 7f405bd08700 1 --2- 172.21.15.26:0/4232991925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40540f5580 0x7f40540f59a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f4044004660 tx=0x7f4044009b30).stop 2021-11-03T16:52:39.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.976+0000 7f405bd08700 1 -- 172.21.15.26:0/4232991925 shutdown_connections 2021-11-03T16:52:39.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.976+0000 7f405bd08700 1 --2- 172.21.15.26:0/4232991925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40540f6820 0x7f40540f6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:39.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.976+0000 7f405bd08700 1 --2- 172.21.15.26:0/4232991925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40540f5580 0x7f40540f59a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:39.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.976+0000 7f405bd08700 1 -- 172.21.15.26:0/4232991925 >> 172.21.15.26:0/4232991925 conn(0x7f40540f0ce0 msgr2=0x7f40540f3100 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:39.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.976+0000 7f405bd08700 1 -- 172.21.15.26:0/4232991925 shutdown_connections 2021-11-03T16:52:39.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.976+0000 7f405bd08700 1 -- 172.21.15.26:0/4232991925 wait complete. 2021-11-03T16:52:39.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.976+0000 7f405bd08700 1 Processor -- start 2021-11-03T16:52:39.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.976+0000 7f405bd08700 1 -- start start 2021-11-03T16:52:39.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.977+0000 7f405bd08700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40540f5580 0x7f4054105d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:39.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.977+0000 7f405bd08700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40540f6820 0x7f4054106280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:39.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.977+0000 7f405bd08700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4054106830 con 0x7f40540f6820 2021-11-03T16:52:39.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.977+0000 7f405bd08700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4054106970 con 0x7f40540f5580 2021-11-03T16:52:39.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.977+0000 7f40592a3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40540f6820 0x7f4054106280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:39.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.977+0000 7f40592a3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40540f6820 0x7f4054106280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50180/0 (socket says 172.21.15.26:50180) 2021-11-03T16:52:39.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.977+0000 7f40592a3700 1 -- 172.21.15.26:0/678986319 learned_addr learned my addr 172.21.15.26:0/678986319 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:52:39.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.977+0000 7f4059aa4700 1 --2- 172.21.15.26:0/678986319 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40540f5580 0x7f4054105d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:39.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.977+0000 7f40592a3700 1 -- 172.21.15.26:0/678986319 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40540f5580 msgr2=0x7f4054105d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:39.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.977+0000 7f40592a3700 1 --2- 172.21.15.26:0/678986319 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40540f5580 0x7f4054105d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:39.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.977+0000 7f40592a3700 1 -- 172.21.15.26:0/678986319 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4044005040 con 0x7f40540f6820 2021-11-03T16:52:39.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.977+0000 7f40592a3700 1 --2- 172.21.15.26:0/678986319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40540f6820 0x7f4054106280 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f40500026d0 tx=0x7f4050009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:39.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.977+0000 7f404a7fc700 1 -- 172.21.15.26:0/678986319 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4050009320 con 0x7f40540f6820 2021-11-03T16:52:39.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.977+0000 7f404a7fc700 1 -- 172.21.15.26:0/678986319 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f405000f040 con 0x7f40540f6820 2021-11-03T16:52:39.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.977+0000 7f404a7fc700 1 -- 172.21.15.26:0/678986319 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4050014770 con 0x7f40540f6820 2021-11-03T16:52:39.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.977+0000 7f405bd08700 1 -- 172.21.15.26:0/678986319 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f405410b410 con 0x7f40540f6820 2021-11-03T16:52:39.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.977+0000 7f405bd08700 1 -- 172.21.15.26:0/678986319 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f405410b9d0 con 0x7f40540f6820 2021-11-03T16:52:39.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.978+0000 7f405bd08700 1 -- 172.21.15.26:0/678986319 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4054027a00 con 0x7f40540f6820 2021-11-03T16:52:39.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.979+0000 7f404a7fc700 1 -- 172.21.15.26:0/678986319 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f4050009480 con 0x7f40540f6820 2021-11-03T16:52:39.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.979+0000 7f404a7fc700 1 --2- 172.21.15.26:0/678986319 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f404005c2a0 0x7f404005e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:39.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.979+0000 7f404a7fc700 1 -- 172.21.15.26:0/678986319 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f40500765a0 con 0x7f40540f6820 2021-11-03T16:52:39.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.979+0000 7f4059aa4700 1 --2- 172.21.15.26:0/678986319 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f404005c2a0 0x7f404005e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:39.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.980+0000 7f4059aa4700 1 --2- 172.21.15.26:0/678986319 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f404005c2a0 0x7f404005e760 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f4044004e30 tx=0x7f4044009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:39.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:39.983+0000 7f404a7fc700 1 -- 172.21.15.26:0/678986319 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f4050049240 con 0x7f40540f6820 2021-11-03T16:52:40.140 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.144+0000 7f405bd08700 1 -- 172.21.15.26:0/678986319 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f40540fdd40 con 0x7f40540f6820 2021-11-03T16:52:40.140 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.145+0000 7f404a7fc700 1 -- 172.21.15.26:0/678986319 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v42) v1 ==== 107+0+11 (secure 0 0 0) 0x7f405004c860 con 0x7f40540f6820 2021-11-03T16:52:40.141 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2021-11-03T16:52:40.142 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.147+0000 7f405bd08700 1 -- 172.21.15.26:0/678986319 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f404005c2a0 msgr2=0x7f404005e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:40.142 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.147+0000 7f405bd08700 1 --2- 172.21.15.26:0/678986319 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f404005c2a0 0x7f404005e760 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f4044004e30 tx=0x7f4044009b30).stop 2021-11-03T16:52:40.143 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.147+0000 7f405bd08700 1 -- 172.21.15.26:0/678986319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40540f6820 msgr2=0x7f4054106280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:40.143 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.147+0000 7f405bd08700 1 --2- 172.21.15.26:0/678986319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40540f6820 0x7f4054106280 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f40500026d0 tx=0x7f4050009de0).stop 2021-11-03T16:52:40.143 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.147+0000 7f405bd08700 1 -- 172.21.15.26:0/678986319 shutdown_connections 2021-11-03T16:52:40.143 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.147+0000 7f405bd08700 1 --2- 172.21.15.26:0/678986319 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f404005c2a0 0x7f404005e760 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:40.144 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.147+0000 7f405bd08700 1 --2- 172.21.15.26:0/678986319 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40540f5580 0x7f4054105d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:40.144 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.147+0000 7f405bd08700 1 --2- 172.21.15.26:0/678986319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40540f6820 0x7f4054106280 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:40.144 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.147+0000 7f405bd08700 1 -- 172.21.15.26:0/678986319 >> 172.21.15.26:0/678986319 conn(0x7f40540f0ce0 msgr2=0x7f40540fa270 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:40.145 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.147+0000 7f405bd08700 1 -- 172.21.15.26:0/678986319 shutdown_connections 2021-11-03T16:52:40.145 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.147+0000 7f405bd08700 1 -- 172.21.15.26:0/678986319 wait complete. 2021-11-03T16:52:40.154 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-03T16:52:40.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.289+0000 7f2148cb1700 1 -- 172.21.15.26:0/1756756219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21440f55a0 msgr2=0x7f21440f59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:40.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.289+0000 7f2148cb1700 1 --2- 172.21.15.26:0/1756756219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21440f55a0 0x7f21440f59c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f2134004660 tx=0x7f2134009b30).stop 2021-11-03T16:52:40.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.289+0000 7f2148cb1700 1 -- 172.21.15.26:0/1756756219 shutdown_connections 2021-11-03T16:52:40.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.289+0000 7f2148cb1700 1 --2- 172.21.15.26:0/1756756219 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21440f6840 0x7f21440f6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:40.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.289+0000 7f2148cb1700 1 --2- 172.21.15.26:0/1756756219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21440f55a0 0x7f21440f59c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:40.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.289+0000 7f2148cb1700 1 -- 172.21.15.26:0/1756756219 >> 172.21.15.26:0/1756756219 conn(0x7f21440f0ce0 msgr2=0x7f21440f3120 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:40.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.289+0000 7f2148cb1700 1 -- 172.21.15.26:0/1756756219 shutdown_connections 2021-11-03T16:52:40.290 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.289+0000 7f2148cb1700 1 -- 172.21.15.26:0/1756756219 wait complete. 2021-11-03T16:52:40.290 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.290+0000 7f2148cb1700 1 Processor -- start 2021-11-03T16:52:40.290 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.290+0000 7f2148cb1700 1 -- start start 2021-11-03T16:52:40.290 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.290+0000 7f2148cb1700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21440f55a0 0x7f214405ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:40.291 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.290+0000 7f2148cb1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21440f6840 0x7f214410bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:40.291 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.290+0000 7f2148cb1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214410c120 con 0x7f21440f6840 2021-11-03T16:52:40.291 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.290+0000 7f2148cb1700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214410c260 con 0x7f21440f55a0 2021-11-03T16:52:40.291 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.290+0000 7f2141d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21440f6840 0x7f214410bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:40.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.290+0000 7f2141d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21440f6840 0x7f214410bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50190/0 (socket says 172.21.15.26:50190) 2021-11-03T16:52:40.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.290+0000 7f2141d9b700 1 -- 172.21.15.26:0/782570338 learned_addr learned my addr 172.21.15.26:0/782570338 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:52:40.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.290+0000 7f214259c700 1 --2- 172.21.15.26:0/782570338 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21440f55a0 0x7f214405ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:40.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.290+0000 7f2141d9b700 1 -- 172.21.15.26:0/782570338 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21440f55a0 msgr2=0x7f214405ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:40.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.290+0000 7f2141d9b700 1 --2- 172.21.15.26:0/782570338 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21440f55a0 0x7f214405ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:40.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.290+0000 7f2141d9b700 1 -- 172.21.15.26:0/782570338 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2134005040 con 0x7f21440f6840 2021-11-03T16:52:40.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.290+0000 7f214259c700 1 --2- 172.21.15.26:0/782570338 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21440f55a0 0x7f214405ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T16:52:40.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.290+0000 7f2141d9b700 1 --2- 172.21.15.26:0/782570338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21440f6840 0x7f214410bc30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f213800e7f0 tx=0x7f213800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:40.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.290+0000 7f2132ffd700 1 -- 172.21.15.26:0/782570338 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21380092e0 con 0x7f21440f6840 2021-11-03T16:52:40.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.290+0000 7f2132ffd700 1 -- 172.21.15.26:0/782570338 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f213800f040 con 0x7f21440f6840 2021-11-03T16:52:40.294 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.291+0000 7f2148cb1700 1 -- 172.21.15.26:0/782570338 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f214410c4c0 con 0x7f21440f6840 2021-11-03T16:52:40.294 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.291+0000 7f2148cb1700 1 -- 172.21.15.26:0/782570338 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f214410ca50 con 0x7f21440f6840 2021-11-03T16:52:40.294 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.291+0000 7f2132ffd700 1 -- 172.21.15.26:0/782570338 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21380146c0 con 0x7f21440f6840 2021-11-03T16:52:40.294 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.292+0000 7f2148cb1700 1 -- 172.21.15.26:0/782570338 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2128004fa0 con 0x7f21440f6840 2021-11-03T16:52:40.295 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.292+0000 7f2132ffd700 1 -- 172.21.15.26:0/782570338 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f213801b030 con 0x7f21440f6840 2021-11-03T16:52:40.295 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.292+0000 7f2132ffd700 1 --2- 172.21.15.26:0/782570338 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f212c05c2a0 0x7f212c05e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:40.295 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.292+0000 7f2132ffd700 1 -- 172.21.15.26:0/782570338 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f2138075b60 con 0x7f21440f6840 2021-11-03T16:52:40.295 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.292+0000 7f214259c700 1 --2- 172.21.15.26:0/782570338 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f212c05c2a0 0x7f212c05e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:40.296 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.293+0000 7f214259c700 1 --2- 172.21.15.26:0/782570338 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f212c05c2a0 0x7f212c05e760 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f2134000c00 tx=0x7f213400b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:40.296 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.297+0000 7f2132ffd700 1 -- 172.21.15.26:0/782570338 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f21380488f0 con 0x7f21440f6840 2021-11-03T16:52:40.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:40 smithi026 conmon[32119]: cluster 2021-11-03T16:52:39.046200+0000 mgr.smithi026.cnrxli (mgr 2021-11-03T16:52:40.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:40 smithi026 conmon[32119]: .14162) 236 : cluster [DBG] pgmap v196: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 1 op/s 2021-11-03T16:52:40.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:40 smithi026 conmon[32119]: audit 2021-11-03T16:52:39.366762+0000 mon.smithi026 (mon.0) 531 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:52:40.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:40 smithi026 conmon[32119]: audit 2021-11-03T16:52:39.525790+0000 mon.smithi026 (mon.0) 532 : audit [DBG] from='client.? 172.21.15.26:0/1976698284' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2021-11-03T16:52:40.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:40 smithi026 conmon[32119]: audit 2021- 2021-11-03T16:52:40.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:40 smithi026 conmon[32119]: 11-03T16:52:39.842706+0000 mon.smithi026 (mon.0) 533 : audit [DBG] from='client.? 172.21.15.26:0/4108508230' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2021-11-03T16:52:40.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:40 smithi026 conmon[32119]: audit 2021-11-03T 2021-11-03T16:52:40.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:40 smithi026 conmon[32119]: 16:52:40.145694+0000 mon.smithi026 (mon.0) 534 : audit [DBG] from='client.? 172.21.15.26:0/678986319' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2021-11-03T16:52:40.508 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.512+0000 7f2148cb1700 1 -- 172.21.15.26:0/782570338 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2128005bf0 con 0x7f21440f6840 2021-11-03T16:52:40.508 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.512+0000 7f2132ffd700 1 -- 172.21.15.26:0/782570338 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+2925 (secure 0 0 0) 0x7f2138019070 con 0x7f21440f6840 2021-11-03T16:52:40.509 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:52:40.509 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14436,"name":"cephfs.smithi026.yfxlxl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.26:6829/3059137105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3059137105},{"type":"v1","addr":"172.21.15.26:6829","nonce":3059137105}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":9},{"gid":24249,"name":"cephfs.smithi194.kwikhp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.194:6825/1229057921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1229057921},{"type":"v1","addr":"172.21.15.194:6825","nonce":1229057921}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":6},{"gid":24263,"name":"cephfs.smithi194.mpotdl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.194:6827/1394135844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1394135844},{"type":"v1","addr":"172.21.15.194:6827","nonce":1394135844}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-03T16:52:17.109901+0000","modified":"2021-11-03T16:52:28.058778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14422},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14422":{"gid":14422,"name":"cephfs.smithi026.ltacyh","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.26:6827/665235785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":665235785},{"type":"v1","addr":"172.21.15.26:6827","nonce":665235785}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2021-11-03T16:52:40.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.514+0000 7f2148cb1700 1 -- 172.21.15.26:0/782570338 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f212c05c2a0 msgr2=0x7f212c05e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:40.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.514+0000 7f2148cb1700 1 --2- 172.21.15.26:0/782570338 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f212c05c2a0 0x7f212c05e760 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f2134000c00 tx=0x7f213400b040).stop 2021-11-03T16:52:40.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.514+0000 7f2148cb1700 1 -- 172.21.15.26:0/782570338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21440f6840 msgr2=0x7f214410bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:40.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.514+0000 7f2148cb1700 1 --2- 172.21.15.26:0/782570338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21440f6840 0x7f214410bc30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f213800e7f0 tx=0x7f213800b040).stop 2021-11-03T16:52:40.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.514+0000 7f2148cb1700 1 -- 172.21.15.26:0/782570338 shutdown_connections 2021-11-03T16:52:40.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.514+0000 7f2148cb1700 1 --2- 172.21.15.26:0/782570338 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f212c05c2a0 0x7f212c05e760 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:40.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.514+0000 7f2148cb1700 1 --2- 172.21.15.26:0/782570338 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21440f55a0 0x7f214405ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:40.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.514+0000 7f2148cb1700 1 --2- 172.21.15.26:0/782570338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21440f6840 0x7f214410bc30 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:40.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.514+0000 7f2148cb1700 1 -- 172.21.15.26:0/782570338 >> 172.21.15.26:0/782570338 conn(0x7f21440f0ce0 msgr2=0x7f21440fa290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:40.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.514+0000 7f2148cb1700 1 -- 172.21.15.26:0/782570338 shutdown_connections 2021-11-03T16:52:40.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:40.514+0000 7f2148cb1700 1 -- 172.21.15.26:0/782570338 wait complete. 2021-11-03T16:52:40.513 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 9 2021-11-03T16:52:40.521 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 6, 'max_mds': 1, 'flags': 18} 2021-11-03T16:52:40.522 INFO:teuthology.run_tasks:Running task kclient... 2021-11-03T16:52:40.546 INFO:tasks.kclient:Mounting kernel clients... 2021-11-03T16:52:40.547 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2021-11-03T16:52:40.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-03T16:52:40.548 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2021-11-03T16:52:40.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-03T16:52:40.564 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link delete ceph-brx 2021-11-03T16:52:40.630 INFO:teuthology.orchestra.run.smithi026.stderr:Cannot find device "ceph-brx" 2021-11-03T16:52:40.631 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-03T16:52:40.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-03T16:52:40.633 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2021-11-03T16:52:40.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-03T16:52:40.653 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link delete ceph-brx 2021-11-03T16:52:40.721 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:40 smithi194 conmon[35111]: cluster 2021-11-03T16:52:39.046200+0000 mgr.smithi026.cnrxli (mgr.14162) 236 2021-11-03T16:52:40.722 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:40 smithi194 conmon[35111]: : cluster [DBG] pgmap v196: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 1 op/s 2021-11-03T16:52:40.722 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:40 smithi194 conmon[35111]: audit 2021-11-03T16:52:39.366762+0000 mon.smithi026 (mon.0) 531 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:52:40.722 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:40 smithi194 conmon[35111]: audit 2021-11-03T16:52:39.525790+0000 mon.smithi026 (mon. 2021-11-03T16:52:40.722 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:40 smithi194 conmon[35111]: 0) 532 : audit [DBG] from='client.? 172.21.15.26:0/1976698284' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2021-11-03T16:52:40.723 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:40 smithi194 conmon[35111]: audit 2021-11-03T 2021-11-03T16:52:40.723 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:40 smithi194 conmon[35111]: 16:52:39.842706+0000 mon.smithi026 (mon.0) 533 : audit 2021-11-03T16:52:40.723 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:40 smithi194 conmon[35111]: [DBG] from='client.? 172.21.15.26:0/4108508230' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2021-11-03T16:52:40.723 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:40 smithi194 conmon[35111]: audit 2021-11-03T16:52 2021-11-03T16:52:40.723 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:40 smithi194 conmon[35111]: :40.145694+0000 mon.smithi026 (mon.0) 534 : audit 2021-11-03T16:52:40.724 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:40 smithi194 conmon[35111]: [DBG] from='client.? 172.21.15.26:0/678986319' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2021-11-03T16:52:40.728 INFO:teuthology.orchestra.run.smithi194.stderr:Cannot find device "ceph-brx" 2021-11-03T16:52:40.729 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-03T16:52:40.730 INFO:tasks.kclient:client.0 config is {} 2021-11-03T16:52:40.731 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph fs ls 2021-11-03T16:52:41.378 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c/mon.smithi026/config 2021-11-03T16:52:41.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:41 smithi026 conmon[32119]: audit 2021-11-03T16:52:40.513224 2021-11-03T16:52:41.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:41 smithi026 conmon[32119]: +0000 mon.smithi026 (mon.0) 535 : audit [DBG] from='client.? 172.21.15.26:0/782570338' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2021-11-03T16:52:41.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:41 smithi194 conmon[35111]: audit 2021-11-03T16:52:40.513224+0000 mon.smithi026 (mon.0) 535 : audit [DBG] from='client.? 172.21.15.26:0/782570338' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2021-11-03T16:52:42.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:42 smithi026 conmon[32119]: cluster 2021-11-03T16:52:41.046685+0000 mgr.smithi026.cnrxli (mgr.14162) 237 : cluster [DBG] pgmap v197: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2021-11-03T16:52:42.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:42 smithi026 conmon[32119]: audit 2021-11-03T16:52:42.022068+0000 mon.smithi026 (mon.0) 536 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:52:42.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:42 smithi026 conmon[32119]: audit 2021-11-03T16:52:42.025282+0000 mon.smithi026 (mon.0) 537 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:52:42.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:42 smithi194 conmon[35111]: cluster 2021-11-03T16:52:41.046685+0000 mgr.smithi026.cnrxli (mgr.14162) 237 : cluster [DBG] pgmap v197: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2021-11-03T16:52:42.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:42 smithi194 conmon[35111]: audit 2021-11-03T16:52:42.022068+0000 mon.smithi026 (mon.0) 536 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:52:42.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:42 smithi194 conmon[35111]: audit 2021-11-03T16:52:42.025282+0000 mon.smithi026 (mon.0) 537 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:52:43.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.422+0000 7f4871e7f700 1 -- 172.21.15.26:0/2878395482 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f486c0f5280 msgr2=0x7f486c0f7a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:43.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.422+0000 7f4871e7f700 1 --2- 172.21.15.26:0/2878395482 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f486c0f5280 0x7f486c0f7a00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f4858004660 tx=0x7f4858009b30).stop 2021-11-03T16:52:43.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.422+0000 7f4871e7f700 1 -- 172.21.15.26:0/2878395482 shutdown_connections 2021-11-03T16:52:43.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.422+0000 7f4871e7f700 1 --2- 172.21.15.26:0/2878395482 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f486c0f5280 0x7f486c0f7a00 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:43.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.422+0000 7f4871e7f700 1 --2- 172.21.15.26:0/2878395482 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f486c0f48e0 0x7f486c0f4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:43.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.422+0000 7f4871e7f700 1 -- 172.21.15.26:0/2878395482 >> 172.21.15.26:0/2878395482 conn(0x7f486c0f0400 msgr2=0x7f486c0f2820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:43.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.422+0000 7f4871e7f700 1 -- 172.21.15.26:0/2878395482 shutdown_connections 2021-11-03T16:52:43.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.423+0000 7f4871e7f700 1 -- 172.21.15.26:0/2878395482 wait complete. 2021-11-03T16:52:43.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.423+0000 7f4871e7f700 1 Processor -- start 2021-11-03T16:52:43.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.423+0000 7f4871e7f700 1 -- start start 2021-11-03T16:52:43.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.423+0000 7f4871e7f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f486c0f48e0 0x7f486c106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:43.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.423+0000 7f4871e7f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f486c0f5280 0x7f486c107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:43.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.423+0000 7f4871e7f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486c1079b0 con 0x7f486c0f5280 2021-11-03T16:52:43.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.423+0000 7f4871e7f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486c107af0 con 0x7f486c0f48e0 2021-11-03T16:52:43.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.423+0000 7f486bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f486c0f5280 0x7f486c107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:43.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.424+0000 7f486bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f486c0f5280 0x7f486c107400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50200/0 (socket says 172.21.15.26:50200) 2021-11-03T16:52:43.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.424+0000 7f486bfff700 1 -- 172.21.15.26:0/2774765149 learned_addr learned my addr 172.21.15.26:0/2774765149 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:52:43.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.424+0000 7f4870e7d700 1 --2- 172.21.15.26:0/2774765149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f486c0f48e0 0x7f486c106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:43.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.424+0000 7f486bfff700 1 -- 172.21.15.26:0/2774765149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f486c0f48e0 msgr2=0x7f486c106f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:43.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.424+0000 7f486bfff700 1 --2- 172.21.15.26:0/2774765149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f486c0f48e0 0x7f486c106f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:43.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.424+0000 7f486bfff700 1 -- 172.21.15.26:0/2774765149 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4858005040 con 0x7f486c0f5280 2021-11-03T16:52:43.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.424+0000 7f4870e7d700 1 --2- 172.21.15.26:0/2774765149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f486c0f48e0 0x7f486c106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T16:52:43.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.424+0000 7f486bfff700 1 --2- 172.21.15.26:0/2774765149 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f486c0f5280 0x7f486c107400 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f4858004e30 tx=0x7f4858009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:43.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.424+0000 7f48697fa700 1 -- 172.21.15.26:0/2774765149 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4858018070 con 0x7f486c0f5280 2021-11-03T16:52:43.428 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.424+0000 7f48697fa700 1 -- 172.21.15.26:0/2774765149 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f4858013410 con 0x7f486c0f5280 2021-11-03T16:52:43.428 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.424+0000 7f48697fa700 1 -- 172.21.15.26:0/2774765149 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f485801c3c0 con 0x7f486c0f5280 2021-11-03T16:52:43.428 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.424+0000 7f4871e7f700 1 -- 172.21.15.26:0/2774765149 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f486c108430 con 0x7f486c0f5280 2021-11-03T16:52:43.428 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.424+0000 7f4871e7f700 1 -- 172.21.15.26:0/2774765149 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f486c108990 con 0x7f486c0f5280 2021-11-03T16:52:43.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.425+0000 7f4871e7f700 1 -- 172.21.15.26:0/2774765149 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f486c045ad0 con 0x7f486c0f5280 2021-11-03T16:52:43.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.426+0000 7f48697fa700 1 -- 172.21.15.26:0/2774765149 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f485801d420 con 0x7f486c0f5280 2021-11-03T16:52:43.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.426+0000 7f48697fa700 1 --2- 172.21.15.26:0/2774765149 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f485c05c2b0 0x7f485c05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:43.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.426+0000 7f48697fa700 1 -- 172.21.15.26:0/2774765149 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f4858077b40 con 0x7f486c0f5280 2021-11-03T16:52:43.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.426+0000 7f4870e7d700 1 --2- 172.21.15.26:0/2774765149 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f485c05c2b0 0x7f485c05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:43.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.426+0000 7f4870e7d700 1 --2- 172.21.15.26:0/2774765149 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f485c05c2b0 0x7f485c05e770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f486c05f8e0 tx=0x7f486000b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:43.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.430+0000 7f48697fa700 1 -- 172.21.15.26:0/2774765149 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f485804a8a0 con 0x7f486c0f5280 2021-11-03T16:52:43.624 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.628+0000 7f4871e7f700 1 -- 172.21.15.26:0/2774765149 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f486c027a00 con 0x7f486c0f5280 2021-11-03T16:52:43.624 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.628+0000 7f48697fa700 1 -- 172.21.15.26:0/2774765149 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+83 (secure 0 0 0) 0x7f485801d6b0 con 0x7f486c0f5280 2021-11-03T16:52:43.624 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2021-11-03T16:52:43.626 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.630+0000 7f4871e7f700 1 -- 172.21.15.26:0/2774765149 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f485c05c2b0 msgr2=0x7f485c05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:43.626 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.630+0000 7f4871e7f700 1 --2- 172.21.15.26:0/2774765149 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f485c05c2b0 0x7f485c05e770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f486c05f8e0 tx=0x7f486000b040).stop 2021-11-03T16:52:43.626 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.630+0000 7f4871e7f700 1 -- 172.21.15.26:0/2774765149 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f486c0f5280 msgr2=0x7f486c107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:43.626 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.630+0000 7f4871e7f700 1 --2- 172.21.15.26:0/2774765149 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f486c0f5280 0x7f486c107400 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f4858004e30 tx=0x7f4858009b30).stop 2021-11-03T16:52:43.627 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.630+0000 7f4871e7f700 1 -- 172.21.15.26:0/2774765149 shutdown_connections 2021-11-03T16:52:43.627 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.630+0000 7f4871e7f700 1 --2- 172.21.15.26:0/2774765149 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f485c05c2b0 0x7f485c05e770 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:43.627 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.630+0000 7f4871e7f700 1 --2- 172.21.15.26:0/2774765149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f486c0f48e0 0x7f486c106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:43.627 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.630+0000 7f4871e7f700 1 --2- 172.21.15.26:0/2774765149 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f486c0f5280 0x7f486c107400 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:43.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.630+0000 7f4871e7f700 1 -- 172.21.15.26:0/2774765149 >> 172.21.15.26:0/2774765149 conn(0x7f486c0f0400 msgr2=0x7f486c0fb450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:43.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.630+0000 7f4871e7f700 1 -- 172.21.15.26:0/2774765149 shutdown_connections 2021-11-03T16:52:43.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:43.630+0000 7f4871e7f700 1 -- 172.21.15.26:0/2774765149 wait complete. 2021-11-03T16:52:44.289 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2021-11-03T16:52:44.289 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2021-11-03T16:52:44.290 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2021-11-03T16:52:44.290 INFO:tasks.cephfs.mount:self.client.name = client.0 2021-11-03T16:52:44.290 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2021-11-03T16:52:44.291 INFO:tasks.cephfs.mount:self.cephfs_name = None 2021-11-03T16:52:44.291 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2021-11-03T16:52:44.291 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2021-11-03T16:52:44.291 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2021-11-03T16:52:44.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-03T16:52:44.292 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2021-11-03T16:52:44.309 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2021-11-03T16:52:44.309 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2021-11-03T16:52:44.309 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2021-11-03T16:52:44.309 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2021-11-03T16:52:44.310 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2021-11-03T16:52:44.310 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2021-11-03T16:52:44.310 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-11-03T16:52:44.311 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2021-11-03T16:52:44.311 INFO:teuthology.orchestra.run.smithi026.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2021-11-03T16:52:44.311 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2021-11-03T16:52:44.311 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2021-11-03T16:52:44.312 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 42161sec preferred_lft 42161sec 2021-11-03T16:52:44.312 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2021-11-03T16:52:44.312 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2021-11-03T16:52:44.312 INFO:teuthology.orchestra.run.smithi026.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-11-03T16:52:44.312 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2021-11-03T16:52:44.313 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-11-03T16:52:44.313 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2021-11-03T16:52:44.313 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2021-11-03T16:52:44.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-03T16:52:44.314 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2021-11-03T16:52:44.315 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2021-11-03T16:52:44.315 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link add name ceph-brx type bridge 2021-11-03T16:52:44.315 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip addr flush dev ceph-brx 2021-11-03T16:52:44.316 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set ceph-brx up 2021-11-03T16:52:44.316 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2021-11-03T16:52:44.316 DEBUG:teuthology.orchestra.run.smithi026:> ') 2021-11-03T16:52:44.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-03T16:52:44.476 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2021-11-03T16:52:44.501 INFO:teuthology.orchestra.run.smithi026.stdout:1 2021-11-03T16:52:44.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-03T16:52:44.503 DEBUG:teuthology.orchestra.run.smithi026:> route 2021-11-03T16:52:44.590 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2021-11-03T16:52:44.591 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2021-11-03T16:52:44.591 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2021-11-03T16:52:44.591 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2021-11-03T16:52:44.591 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2021-11-03T16:52:44.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-03T16:52:44.592 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2021-11-03T16:52:44.593 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2021-11-03T16:52:44.593 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2021-11-03T16:52:44.593 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2021-11-03T16:52:44.594 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2021-11-03T16:52:44.594 DEBUG:teuthology.orchestra.run.smithi026:> ') 2021-11-03T16:52:44.628 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:44 smithi026 conmon[32119]: cluster 2021-11-03T16:52:43.047174 2021-11-03T16:52:44.628 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:44 smithi026 conmon[32119]: +0000 mgr.smithi026.cnrxli (mgr.14162) 238 : cluster [DBG] pgmap v198: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2021-11-03T16:52:44.629 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:44 smithi026 conmon[32119]: audit 2021-11-03T16:52:43.629299+0000 mon.smithi026 (mon.0) 538 : audit [DBG] from='client.? 172.21.15.26:0/2774765149' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2021-11-03T16:52:44.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:44 smithi194 conmon[35111]: cluster 2021-11-03T16:52:43.047174+0000 mgr.smithi026.cnrxli (mgr.14162) 238 : cluster [DBG] pgmap v198: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2021-11-03T16:52:44.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:44 smithi194 conmon[35111]: audit 2021-11-03T16:52:43.629299+0000 mon.smithi026 (mon.0) 538 : audit [DBG] from='client.? 172.21.15.26:0/2774765149' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2021-11-03T16:52:44.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-03T16:52:44.790 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2021-11-03T16:52:44.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-03T16:52:44.846 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list-id 2021-11-03T16:52:44.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-03T16:52:44.900 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2021-11-03T16:52:44.900 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2021-11-03T16:52:44.900 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2021-11-03T16:52:44.901 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2021-11-03T16:52:44.901 DEBUG:teuthology.orchestra.run.smithi026:> ') 2021-11-03T16:52:44.989 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2021-11-03T16:52:44.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-03T16:52:44.990 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2021-11-03T16:52:44.991 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2021-11-03T16:52:44.991 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2021-11-03T16:52:44.992 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2021-11-03T16:52:44.992 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2021-11-03T16:52:44.992 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2021-11-03T16:52:44.993 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2021-11-03T16:52:44.993 DEBUG:teuthology.orchestra.run.smithi026:> ') 2021-11-03T16:52:45.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-03T16:52:45.205 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2021-11-03T16:52:45.206 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2021-11-03T16:52:45.206 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.0 up 2021-11-03T16:52:45.206 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set dev brx.0 master ceph-brx 2021-11-03T16:52:45.207 DEBUG:teuthology.orchestra.run.smithi026:> ') 2021-11-03T16:52:45.313 INFO:teuthology.orchestra.run:Running command with timeout 60 2021-11-03T16:52:45.313 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2021-11-03T16:52:45.334 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2021-11-03T16:52:45.335 INFO:teuthology.orchestra.run:Running command with timeout 60 2021-11-03T16:52:45.335 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2021-11-03T16:52:45.389 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-03T16:52:45.390 DEBUG:teuthology.orchestra.run.smithi026:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2021-11-03T16:52:45.476 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2021-11-03T16:52:45.477 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2021-11-03T16:52:45.619 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2021-11-03T16:52:45.619 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2021-11-03T16:52:45.625 INFO:tasks.cephfs.kernel_mount:mount command passed 2021-11-03T16:52:45.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-03T16:52:45.626 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2021-11-03T16:52:45.655 INFO:tasks.kclient:client.1 config is {} 2021-11-03T16:52:45.656 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -- ceph fs ls 2021-11-03T16:52:45.983 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/70492bc6-3cc5-11ec-8c28-001a4aab830c/mon.smithi026/config 2021-11-03T16:52:46.620 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:46 smithi026 conmon[32119]: cluster 2021-11-03T16:52:45.047653+0000 mgr.smithi026.cnrxli (mgr.14162) 239 : cluster [DBG] pgmap v199: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:52:46.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:46 smithi194 conmon[35111]: cluster 2021-11-03T16:52:45.047653+0000 mgr.smithi026.cnrxli (mgr.14162) 239 : cluster [DBG] pgmap v199: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:52:46.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:46 smithi194 conmon[35111]: 2021-11-03T16:52:47.814 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:47.812+0000 7f30f8ee3700 1 -- 172.21.15.26:0/389523978 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30f40f9ae0 msgr2=0x7f30f40f9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:47.815 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:47.812+0000 7f30f8ee3700 1 --2- 172.21.15.26:0/389523978 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30f40f9ae0 0x7f30f40f9f40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f30e4004660 tx=0x7f30e4009b30).stop 2021-11-03T16:52:47.816 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:47.812+0000 7f30f8ee3700 1 -- 172.21.15.26:0/389523978 shutdown_connections 2021-11-03T16:52:47.816 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:47.812+0000 7f30f8ee3700 1 --2- 172.21.15.26:0/389523978 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30f40f9ae0 0x7f30f40f9f40 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:47.817 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:47.812+0000 7f30f8ee3700 1 --2- 172.21.15.26:0/389523978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30f40f8840 0x7f30f40f8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:47.819 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:47.812+0000 7f30f8ee3700 1 -- 172.21.15.26:0/389523978 >> 172.21.15.26:0/389523978 conn(0x7f30f40f40e0 msgr2=0x7f30f40f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:47.820 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:47.812+0000 7f30f8ee3700 1 -- 172.21.15.26:0/389523978 shutdown_connections 2021-11-03T16:52:47.820 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:47.813+0000 7f30f8ee3700 1 -- 172.21.15.26:0/389523978 wait complete. 2021-11-03T16:52:47.821 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:47.813+0000 7f30f8ee3700 1 Processor -- start 2021-11-03T16:52:47.821 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:47.813+0000 7f30f8ee3700 1 -- start start 2021-11-03T16:52:47.822 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:47.813+0000 7f30f8ee3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30f40f8840 0x7f30f4109070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:47.822 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:47.813+0000 7f30f8ee3700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30f40f9ae0 0x7f30f4109560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:47.823 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:47.813+0000 7f30f8ee3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f4109b10 con 0x7f30f40f8840 2021-11-03T16:52:47.824 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:47.813+0000 7f30f8ee3700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f4109c50 con 0x7f30f40f9ae0 2021-11-03T16:52:47.824 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:47.813+0000 7f30f37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30f40f8840 0x7f30f4109070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:47.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:47.813+0000 7f30f37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30f40f8840 0x7f30f4109070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50212/0 (socket says 172.21.15.26:50212) 2021-11-03T16:52:47.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:47.813+0000 7f30f37fe700 1 -- 172.21.15.26:0/1247481371 learned_addr learned my addr 172.21.15.26:0/1247481371 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:52:47.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:47.814+0000 7f30f2ffd700 1 --2- 172.21.15.26:0/1247481371 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30f40f9ae0 0x7f30f4109560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:47.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:47.814+0000 7f30f37fe700 1 -- 172.21.15.26:0/1247481371 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30f40f9ae0 msgr2=0x7f30f4109560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:47.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:47.814+0000 7f30f37fe700 1 --2- 172.21.15.26:0/1247481371 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30f40f9ae0 0x7f30f4109560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:47.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:47.814+0000 7f30f37fe700 1 -- 172.21.15.26:0/1247481371 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e4005040 con 0x7f30f40f8840 2021-11-03T16:52:47.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:47.814+0000 7f30f37fe700 1 --2- 172.21.15.26:0/1247481371 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30f40f8840 0x7f30f4109070 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f30dc00c530 tx=0x7f30dc007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:47.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:47.814+0000 7f30ebfff700 1 -- 172.21.15.26:0/1247481371 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30dc00f650 con 0x7f30f40f8840 2021-11-03T16:52:47.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:47.814+0000 7f30ebfff700 1 -- 172.21.15.26:0/1247481371 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f30dc00fc40 con 0x7f30f40f8840 2021-11-03T16:52:47.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:47.814+0000 7f30f8ee3700 1 -- 172.21.15.26:0/1247481371 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f410a5f0 con 0x7f30f40f8840 2021-11-03T16:52:47.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:47.814+0000 7f30ebfff700 1 -- 172.21.15.26:0/1247481371 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30dc012c20 con 0x7f30f40f8840 2021-11-03T16:52:47.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:47.814+0000 7f30f8ee3700 1 -- 172.21.15.26:0/1247481371 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f410abb0 con 0x7f30f40f8840 2021-11-03T16:52:47.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:47.815+0000 7f30f8ee3700 1 -- 172.21.15.26:0/1247481371 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f4045ad0 con 0x7f30f40f8840 2021-11-03T16:52:47.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:47.815+0000 7f30ebfff700 1 -- 172.21.15.26:0/1247481371 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f30dc019030 con 0x7f30f40f8840 2021-11-03T16:52:47.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:47.816+0000 7f30ebfff700 1 --2- 172.21.15.26:0/1247481371 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f30e005c2b0 0x7f30e005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:47.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:47.816+0000 7f30ebfff700 1 -- 172.21.15.26:0/1247481371 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f30dc075ad0 con 0x7f30f40f8840 2021-11-03T16:52:47.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:47.816+0000 7f30f2ffd700 1 --2- 172.21.15.26:0/1247481371 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f30e005c2b0 0x7f30e005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:47.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:47.816+0000 7f30f2ffd700 1 --2- 172.21.15.26:0/1247481371 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f30e005c2b0 0x7f30e005e770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f30e4005010 tx=0x7f30e4009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:47.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:47.820+0000 7f30ebfff700 1 -- 172.21.15.26:0/1247481371 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f30dc048800 con 0x7f30f40f8840 2021-11-03T16:52:48.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:48.018+0000 7f30f8ee3700 1 -- 172.21.15.26:0/1247481371 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f30f4101180 con 0x7f30f40f8840 2021-11-03T16:52:48.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:48.018+0000 7f30ebfff700 1 -- 172.21.15.26:0/1247481371 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+83 (secure 0 0 0) 0x7f30dc017070 con 0x7f30f40f8840 2021-11-03T16:52:48.014 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2021-11-03T16:52:48.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:48.020+0000 7f30f8ee3700 1 -- 172.21.15.26:0/1247481371 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f30e005c2b0 msgr2=0x7f30e005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:48.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:48.020+0000 7f30f8ee3700 1 --2- 172.21.15.26:0/1247481371 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f30e005c2b0 0x7f30e005e770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f30e4005010 tx=0x7f30e4009b30).stop 2021-11-03T16:52:48.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:48.020+0000 7f30f8ee3700 1 -- 172.21.15.26:0/1247481371 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30f40f8840 msgr2=0x7f30f4109070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:48.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:48.020+0000 7f30f8ee3700 1 --2- 172.21.15.26:0/1247481371 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30f40f8840 0x7f30f4109070 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f30dc00c530 tx=0x7f30dc007e10).stop 2021-11-03T16:52:48.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:48.020+0000 7f30f8ee3700 1 -- 172.21.15.26:0/1247481371 shutdown_connections 2021-11-03T16:52:48.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:48.020+0000 7f30f8ee3700 1 --2- 172.21.15.26:0/1247481371 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f30e005c2b0 0x7f30e005e770 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:48.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:48.020+0000 7f30f8ee3700 1 --2- 172.21.15.26:0/1247481371 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30f40f8840 0x7f30f4109070 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:48.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:48.020+0000 7f30f8ee3700 1 --2- 172.21.15.26:0/1247481371 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30f40f9ae0 0x7f30f4109560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:48.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:48.020+0000 7f30f8ee3700 1 -- 172.21.15.26:0/1247481371 >> 172.21.15.26:0/1247481371 conn(0x7f30f40f40e0 msgr2=0x7f30f40fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:48.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:48.020+0000 7f30f8ee3700 1 -- 172.21.15.26:0/1247481371 shutdown_connections 2021-11-03T16:52:48.018 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:48.020+0000 7f30f8ee3700 1 -- 172.21.15.26:0/1247481371 wait complete. 2021-11-03T16:52:48.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:48 smithi026 conmon[32119]: cluster 2021-11-03T16:52:47.048165+0000 mgr.smithi026.cnrxli (mgr.14162) 240 : cluster [DBG] pgmap v200: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:52:48.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:48 smithi026 conmon[32119]: audit 2021-11-03T16:52:48.019223+0000 mon.smithi026 (mon.0) 539 : audit [DBG] from='client.? 172.21.15.26:0/1247481371' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2021-11-03T16:52:48.689 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2021-11-03T16:52:48.690 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2021-11-03T16:52:48.690 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi194.front.sepia.ceph.com 2021-11-03T16:52:48.690 INFO:tasks.cephfs.mount:self.client.name = client.1 2021-11-03T16:52:48.690 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2021-11-03T16:52:48.691 INFO:tasks.cephfs.mount:self.cephfs_name = None 2021-11-03T16:52:48.691 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2021-11-03T16:52:48.691 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2021-11-03T16:52:48.692 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2021-11-03T16:52:48.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-03T16:52:48.692 DEBUG:teuthology.orchestra.run.smithi194:> ip addr 2021-11-03T16:52:48.711 INFO:teuthology.orchestra.run.smithi194.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2021-11-03T16:52:48.712 INFO:teuthology.orchestra.run.smithi194.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2021-11-03T16:52:48.712 INFO:teuthology.orchestra.run.smithi194.stdout: inet 127.0.0.1/8 scope host lo 2021-11-03T16:52:48.712 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2021-11-03T16:52:48.713 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 ::1/128 scope host 2021-11-03T16:52:48.713 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2021-11-03T16:52:48.713 INFO:teuthology.orchestra.run.smithi194.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-11-03T16:52:48.713 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:fe brd ff:ff:ff:ff:ff:ff 2021-11-03T16:52:48.713 INFO:teuthology.orchestra.run.smithi194.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-11-03T16:52:48.714 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:ff brd ff:ff:ff:ff:ff:ff 2021-11-03T16:52:48.714 INFO:teuthology.orchestra.run.smithi194.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-11-03T16:52:48.714 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a4 brd ff:ff:ff:ff:ff:ff 2021-11-03T16:52:48.714 INFO:teuthology.orchestra.run.smithi194.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2021-11-03T16:52:48.715 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a5 brd ff:ff:ff:ff:ff:ff 2021-11-03T16:52:48.715 INFO:teuthology.orchestra.run.smithi194.stdout: inet 172.21.15.194/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2021-11-03T16:52:48.715 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft 42173sec preferred_lft 42173sec 2021-11-03T16:52:48.715 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::ec4:7aff:fe88:7ea5/64 scope link noprefixroute 2021-11-03T16:52:48.716 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2021-11-03T16:52:48.716 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2021-11-03T16:52:48.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-03T16:52:48.717 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2021-11-03T16:52:48.717 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2021-11-03T16:52:48.717 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link add name ceph-brx type bridge 2021-11-03T16:52:48.718 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip addr flush dev ceph-brx 2021-11-03T16:52:48.718 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set ceph-brx up 2021-11-03T16:52:48.718 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2021-11-03T16:52:48.719 DEBUG:teuthology.orchestra.run.smithi194:> ') 2021-11-03T16:52:48.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:48 smithi194 conmon[35111]: cluster 2021-11-03T16:52:47.048165+0000 mgr.smithi026.cnrxli (mgr.14162) 240 : cluster [DBG] pgmap v200: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:52:48.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:48 smithi194 conmon[35111]: audit 2021-11-03T16:52:48.019223+0000 mon.smithi026 ( 2021-11-03T16:52:48.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:48 smithi194 conmon[35111]: mon.0) 539 : audit [DBG] from='client.? 172.21.15.26:0/1247481371' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2021-11-03T16:52:48.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-03T16:52:48.890 DEBUG:teuthology.orchestra.run.smithi194:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2021-11-03T16:52:48.917 INFO:teuthology.orchestra.run.smithi194.stdout:1 2021-11-03T16:52:48.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-03T16:52:48.918 DEBUG:teuthology.orchestra.run.smithi194:> route 2021-11-03T16:52:48.996 INFO:teuthology.orchestra.run.smithi194.stdout:Kernel IP routing table 2021-11-03T16:52:48.997 INFO:teuthology.orchestra.run.smithi194.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2021-11-03T16:52:48.997 INFO:teuthology.orchestra.run.smithi194.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2021-11-03T16:52:48.997 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2021-11-03T16:52:48.997 INFO:teuthology.orchestra.run.smithi194.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2021-11-03T16:52:48.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-03T16:52:48.998 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2021-11-03T16:52:48.998 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2021-11-03T16:52:48.999 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2021-11-03T16:52:48.999 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2021-11-03T16:52:48.999 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2021-11-03T16:52:49.000 DEBUG:teuthology.orchestra.run.smithi194:> ') 2021-11-03T16:52:49.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-03T16:52:49.207 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2021-11-03T16:52:49.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-03T16:52:49.222 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list-id 2021-11-03T16:52:49.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-03T16:52:49.277 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2021-11-03T16:52:49.277 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2021-11-03T16:52:49.278 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2021-11-03T16:52:49.278 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2021-11-03T16:52:49.278 DEBUG:teuthology.orchestra.run.smithi194:> ') 2021-11-03T16:52:49.364 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2021-11-03T16:52:49.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-03T16:52:49.365 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2021-11-03T16:52:49.365 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2021-11-03T16:52:49.366 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2021-11-03T16:52:49.366 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2021-11-03T16:52:49.366 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2021-11-03T16:52:49.367 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2021-11-03T16:52:49.367 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2021-11-03T16:52:49.367 DEBUG:teuthology.orchestra.run.smithi194:> ') 2021-11-03T16:52:49.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-03T16:52:49.592 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2021-11-03T16:52:49.593 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2021-11-03T16:52:49.593 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set brx.0 up 2021-11-03T16:52:49.593 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set dev brx.0 master ceph-brx 2021-11-03T16:52:49.594 DEBUG:teuthology.orchestra.run.smithi194:> ') 2021-11-03T16:52:49.708 INFO:teuthology.orchestra.run:Running command with timeout 60 2021-11-03T16:52:49.709 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2021-11-03T16:52:49.728 INFO:teuthology.orchestra.run.smithi194.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2021-11-03T16:52:49.728 INFO:teuthology.orchestra.run:Running command with timeout 60 2021-11-03T16:52:49.729 DEBUG:teuthology.orchestra.run.smithi194:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2021-11-03T16:52:49.782 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-03T16:52:49.783 DEBUG:teuthology.orchestra.run.smithi194:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,norbytes 2021-11-03T16:52:49.907 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,norbytes 2021-11-03T16:52:49.907 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,name=1,norbytes" will pass to kernel. 2021-11-03T16:52:50.074 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,norbytes 2021-11-03T16:52:50.075 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,name=1,norbytes" will pass to kernel. 2021-11-03T16:52:50.077 INFO:tasks.cephfs.kernel_mount:mount command passed 2021-11-03T16:52:50.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-03T16:52:50.078 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2021-11-03T16:52:50.101 INFO:teuthology.run_tasks:Running task print... 2021-11-03T16:52:50.114 INFO:teuthology.task.print:**** done kclient client 2021-11-03T16:52:50.115 INFO:teuthology.run_tasks:Running task parallel... 2021-11-03T16:52:50.165 INFO:teuthology.task.parallel:starting parallel... 2021-11-03T16:52:50.166 INFO:teuthology.task.parallel:In parallel, running task sequential... 2021-11-03T16:52:50.166 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2021-11-03T16:52:50.167 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi026.front.sepia.ceph.com 2021-11-03T16:52:50.167 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -e sha1=6e90212d8510e2d506395a8c82057d0d1787f3a4 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2021-11-03T16:52:50.168 INFO:teuthology.task.parallel:In parallel, running task sequential... 2021-11-03T16:52:50.168 INFO:teuthology.task.sequential:In sequential, running task workunit... 2021-11-03T16:52:50.172 INFO:tasks.workunit:Pulling workunits from ref 6e90212d8510e2d506395a8c82057d0d1787f3a4 2021-11-03T16:52:50.174 INFO:tasks.workunit:Making a separate scratch dir for every client... 2021-11-03T16:52:50.174 INFO:tasks.workunit:timeout=3h 2021-11-03T16:52:50.174 INFO:tasks.workunit:cleanup=True 2021-11-03T16:52:50.175 DEBUG:teuthology.orchestra.run.smithi026:> stat -- /home/ubuntu/cephtest/mnt.0 2021-11-03T16:52:50.198 INFO:teuthology.orchestra.run.smithi026.stdout: File: /home/ubuntu/cephtest/mnt.0 2021-11-03T16:52:50.199 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2021-11-03T16:52:50.199 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 99h/153d Inode: 1 Links: 2 2021-11-03T16:52:50.199 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-03T16:52:50.200 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:cephfs_t:s0 2021-11-03T16:52:50.200 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2021-11-03T16:52:50.200 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2021-11-03 16:52:23.043487534 +0000 2021-11-03T16:52:50.200 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2021-11-03 16:52:45.658060307 +0000 2021-11-03T16:52:50.201 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2021-11-03T16:52:50.201 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2021-11-03T16:52:50.202 DEBUG:teuthology.orchestra.run.smithi026:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2021-11-03T16:52:50.272 DEBUG:teuthology.orchestra.run.smithi194:> stat -- /home/ubuntu/cephtest/mnt.1 2021-11-03T16:52:50.290 INFO:teuthology.orchestra.run.smithi194.stdout: File: /home/ubuntu/cephtest/mnt.1 2021-11-03T16:52:50.290 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2021-11-03T16:52:50.291 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 78h/120d Inode: 1 Links: 3 2021-11-03T16:52:50.291 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-03T16:52:50.291 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:cephfs_t:s0 2021-11-03T16:52:50.291 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2021-11-03T16:52:50.291 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2021-11-03 16:52:50.270992647 +0000 2021-11-03T16:52:50.292 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2021-11-03 16:52:50.270992647 +0000 2021-11-03T16:52:50.292 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: - 2021-11-03T16:52:50.292 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2021-11-03T16:52:50.293 DEBUG:teuthology.orchestra.run.smithi194:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2021-11-03T16:52:50.360 DEBUG:teuthology.orchestra.run.smithi026:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6e90212d8510e2d506395a8c82057d0d1787f3a4 2021-11-03T16:52:50.361 DEBUG:teuthology.orchestra.run.smithi194:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone git://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 6e90212d8510e2d506395a8c82057d0d1787f3a4 2021-11-03T16:52:50.377 INFO:tasks.workunit.client.0.smithi026.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2021-11-03T16:52:50.415 INFO:tasks.workunit.client.1.smithi194.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2021-11-03T16:52:50.656 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:50 smithi026 conmon[32119]: cluster 2021-11-03T16:52:49.048731+0000 mgr.smithi026.cnrxli ( 2021-11-03T16:52:50.657 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:50 smithi026 conmon[32119]: mgr.14162) 241 : cluster [DBG] pgmap v201: 65 pgs: 65 active+clean; 2.5 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2021-11-03T16:52:50.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:50 smithi194 conmon[35111]: cluster 2021-11-03T16:52:49.048731+0000 mgr.smithi026.cnrxli (mgr.14162) 241 : cluster [DBG] pgmap v201: 65 pgs: 65 active+clean; 2.5 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2021-11-03T16:52:52.097 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.099+0000 7fae326af700 1 -- 172.21.15.26:0/3628651718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae2c0f66e0 msgr2=0x7fae2c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:52.098 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.099+0000 7fae326af700 1 --2- 172.21.15.26:0/3628651718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae2c0f66e0 0x7fae2c0f6b00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fae1c004660 tx=0x7fae1c009b30).stop 2021-11-03T16:52:52.098 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.099+0000 7fae326af700 1 -- 172.21.15.26:0/3628651718 shutdown_connections 2021-11-03T16:52:52.098 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.099+0000 7fae326af700 1 --2- 172.21.15.26:0/3628651718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae2c0f6ff0 0x7fae2c0f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:52.098 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.099+0000 7fae326af700 1 --2- 172.21.15.26:0/3628651718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae2c0f66e0 0x7fae2c0f6b00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:52.099 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.099+0000 7fae326af700 1 -- 172.21.15.26:0/3628651718 >> 172.21.15.26:0/3628651718 conn(0x7fae2c0f1f00 msgr2=0x7fae2c0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:52.099 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.099+0000 7fae326af700 1 -- 172.21.15.26:0/3628651718 shutdown_connections 2021-11-03T16:52:52.099 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.099+0000 7fae326af700 1 -- 172.21.15.26:0/3628651718 wait complete. 2021-11-03T16:52:52.099 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.100+0000 7fae326af700 1 Processor -- start 2021-11-03T16:52:52.100 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.100+0000 7fae326af700 1 -- start start 2021-11-03T16:52:52.100 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.100+0000 7fae326af700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae2c0f66e0 0x7fae2c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:52.100 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.100+0000 7fae326af700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae2c0f6ff0 0x7fae2c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:52.100 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.100+0000 7fae326af700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c06a380 con 0x7fae2c0f66e0 2021-11-03T16:52:52.100 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.100+0000 7fae326af700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c06a4c0 con 0x7fae2c0f6ff0 2021-11-03T16:52:52.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.100+0000 7fae2bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae2c0f66e0 0x7fae2c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:52.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.100+0000 7fae2bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae2c0f66e0 0x7fae2c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50224/0 (socket says 172.21.15.26:50224) 2021-11-03T16:52:52.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.100+0000 7fae2bfff700 1 -- 172.21.15.26:0/3744516772 learned_addr learned my addr 172.21.15.26:0/3744516772 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:52:52.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.100+0000 7fae2b7fe700 1 --2- 172.21.15.26:0/3744516772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae2c0f6ff0 0x7fae2c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:52.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.100+0000 7fae2bfff700 1 -- 172.21.15.26:0/3744516772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae2c0f6ff0 msgr2=0x7fae2c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:52.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.100+0000 7fae2bfff700 1 --2- 172.21.15.26:0/3744516772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae2c0f6ff0 0x7fae2c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:52.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.100+0000 7fae2bfff700 1 -- 172.21.15.26:0/3744516772 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae1c005040 con 0x7fae2c0f66e0 2021-11-03T16:52:52.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.101+0000 7fae2bfff700 1 --2- 172.21.15.26:0/3744516772 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae2c0f66e0 0x7fae2c06b9a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fae1c009990 tx=0x7fae1c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:52.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.101+0000 7fae28ff9700 1 -- 172.21.15.26:0/3744516772 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae1c018070 con 0x7fae2c0f66e0 2021-11-03T16:52:52.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.101+0000 7fae28ff9700 1 -- 172.21.15.26:0/3744516772 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fae1c013410 con 0x7fae2c0f66e0 2021-11-03T16:52:52.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.101+0000 7fae326af700 1 -- 172.21.15.26:0/3744516772 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae2c06a740 con 0x7fae2c0f66e0 2021-11-03T16:52:52.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.101+0000 7fae28ff9700 1 -- 172.21.15.26:0/3744516772 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae1c01de80 con 0x7fae2c0f66e0 2021-11-03T16:52:52.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.101+0000 7fae326af700 1 -- 172.21.15.26:0/3744516772 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae2c06aca0 con 0x7fae2c0f66e0 2021-11-03T16:52:52.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.102+0000 7fae326af700 1 -- 172.21.15.26:0/3744516772 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae2c045ad0 con 0x7fae2c0f66e0 2021-11-03T16:52:52.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.102+0000 7fae28ff9700 1 -- 172.21.15.26:0/3744516772 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fae1c01d420 con 0x7fae2c0f66e0 2021-11-03T16:52:52.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.102+0000 7fae28ff9700 1 --2- 172.21.15.26:0/3744516772 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fae1405c2b0 0x7fae1405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:52.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.102+0000 7fae28ff9700 1 -- 172.21.15.26:0/3744516772 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fae1c077ad0 con 0x7fae2c0f66e0 2021-11-03T16:52:52.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.102+0000 7fae2b7fe700 1 --2- 172.21.15.26:0/3744516772 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fae1405c2b0 0x7fae1405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:52.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.103+0000 7fae2b7fe700 1 --2- 172.21.15.26:0/3744516772 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fae1405c2b0 0x7fae1405e770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fae20004e20 tx=0x7fae2000b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:52.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.106+0000 7fae28ff9700 1 -- 172.21.15.26:0/3744516772 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fae1c04a7b0 con 0x7fae2c0f66e0 2021-11-03T16:52:52.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.262+0000 7fae326af700 1 -- 172.21.15.26:0/3744516772 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7fae2c027a00 con 0x7fae2c0f66e0 2021-11-03T16:52:52.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.263+0000 7fae28ff9700 1 -- 172.21.15.26:0/3744516772 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v16)=0 v16) v1 ==== 155+0+0 (secure 0 0 0) 0x7fae1c04ddd0 con 0x7fae2c0f66e0 2021-11-03T16:52:52.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.264+0000 7fae326af700 1 -- 172.21.15.26:0/3744516772 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fae1405c2b0 msgr2=0x7fae1405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:52.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.264+0000 7fae326af700 1 --2- 172.21.15.26:0/3744516772 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fae1405c2b0 0x7fae1405e770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fae20004e20 tx=0x7fae2000b040).stop 2021-11-03T16:52:52.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.264+0000 7fae326af700 1 -- 172.21.15.26:0/3744516772 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae2c0f66e0 msgr2=0x7fae2c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:52.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.264+0000 7fae326af700 1 --2- 172.21.15.26:0/3744516772 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae2c0f66e0 0x7fae2c06b9a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fae1c009990 tx=0x7fae1c009b30).stop 2021-11-03T16:52:52.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.264+0000 7fae326af700 1 -- 172.21.15.26:0/3744516772 shutdown_connections 2021-11-03T16:52:52.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.264+0000 7fae326af700 1 --2- 172.21.15.26:0/3744516772 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fae1405c2b0 0x7fae1405e770 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:52.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.264+0000 7fae326af700 1 --2- 172.21.15.26:0/3744516772 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae2c0f66e0 0x7fae2c06b9a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:52.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.264+0000 7fae326af700 1 --2- 172.21.15.26:0/3744516772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae2c0f6ff0 0x7fae2c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:52.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.264+0000 7fae326af700 1 -- 172.21.15.26:0/3744516772 >> 172.21.15.26:0/3744516772 conn(0x7fae2c0f1f00 msgr2=0x7fae2c0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:52.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.265+0000 7fae326af700 1 -- 172.21.15.26:0/3744516772 shutdown_connections 2021-11-03T16:52:52.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:52.265+0000 7fae326af700 1 -- 172.21.15.26:0/3744516772 wait complete. 2021-11-03T16:52:52.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:52 smithi026 conmon[32119]: cluster 2021-11-03T16:52:51.049166+0000 mgr.smithi026.cnrxli (mgr.14162) 242 : cluster [DBG] pgmap v202: 65 pgs: 65 active+clean; 2.5 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2021-11-03T16:52:52.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:52 smithi194 conmon[35111]: cluster 2021-11-03T16:52:51.049166+0000 mgr.smithi026.cnrxli (mgr.14162) 242 : 2021-11-03T16:52:52.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:52 smithi194 conmon[35111]: cluster [DBG] pgmap v202: 65 pgs: 65 active+clean; 2.5 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2021-11-03T16:52:53.040 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -e sha1=6e90212d8510e2d506395a8c82057d0d1787f3a4 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2021-11-03T16:52:54.590 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:54 smithi026 conmon[32119]: cluster 2021-11-03T16:52:53.049623+0000 mgr.smithi026.cnrxli 2021-11-03T16:52:54.591 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:54 smithi026 conmon[32119]: (mgr.14162) 243 : cluster [DBG] pgmap v203: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2021-11-03T16:52:54.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:54 smithi194 conmon[35111]: cluster 2021-11-03T16:52:53.049623+0000 mgr.smithi026.cnrxli (mgr.14162) 243 2021-11-03T16:52:54.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:54 smithi194 conmon[35111]: : cluster [DBG] pgmap v203: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2021-11-03T16:52:55.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.024+0000 7fe11a253700 1 -- 172.21.15.26:0/1693613854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1140f48a0 msgr2=0x7fe1140f4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:55.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.024+0000 7fe11a253700 1 --2- 172.21.15.26:0/1693613854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1140f48a0 0x7fe1140f4cc0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fe110004660 tx=0x7fe110009b30).stop 2021-11-03T16:52:55.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.024+0000 7fe11a253700 1 -- 172.21.15.26:0/1693613854 shutdown_connections 2021-11-03T16:52:55.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.024+0000 7fe11a253700 1 --2- 172.21.15.26:0/1693613854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1140f5240 0x7fe1140f7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:55.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.024+0000 7fe11a253700 1 --2- 172.21.15.26:0/1693613854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1140f48a0 0x7fe1140f4cc0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:55.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.024+0000 7fe11a253700 1 -- 172.21.15.26:0/1693613854 >> 172.21.15.26:0/1693613854 conn(0x7fe1140f0320 msgr2=0x7fe1140f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:55.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.024+0000 7fe11a253700 1 -- 172.21.15.26:0/1693613854 shutdown_connections 2021-11-03T16:52:55.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.024+0000 7fe11a253700 1 -- 172.21.15.26:0/1693613854 wait complete. 2021-11-03T16:52:55.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.025+0000 7fe11a253700 1 Processor -- start 2021-11-03T16:52:55.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.025+0000 7fe11a253700 1 -- start start 2021-11-03T16:52:55.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.025+0000 7fe11a253700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1140f48a0 0x7fe1140f7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:55.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.025+0000 7fe11a253700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1140f5240 0x7fe1140f5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:55.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.025+0000 7fe11a253700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1140f5e70 con 0x7fe1140f5240 2021-11-03T16:52:55.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.025+0000 7fe11a253700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1140f5fb0 con 0x7fe1140f48a0 2021-11-03T16:52:55.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.025+0000 7fe118a50700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1140f5240 0x7fe1140f5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:55.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.025+0000 7fe118a50700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1140f5240 0x7fe1140f5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50236/0 (socket says 172.21.15.26:50236) 2021-11-03T16:52:55.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.025+0000 7fe118a50700 1 -- 172.21.15.26:0/1103771001 learned_addr learned my addr 172.21.15.26:0/1103771001 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:52:55.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.025+0000 7fe119251700 1 --2- 172.21.15.26:0/1103771001 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1140f48a0 0x7fe1140f7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:55.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.026+0000 7fe118a50700 1 -- 172.21.15.26:0/1103771001 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1140f48a0 msgr2=0x7fe1140f7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:55.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.026+0000 7fe118a50700 1 --2- 172.21.15.26:0/1103771001 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1140f48a0 0x7fe1140f7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:55.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.026+0000 7fe118a50700 1 -- 172.21.15.26:0/1103771001 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe110005040 con 0x7fe1140f5240 2021-11-03T16:52:55.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.026+0000 7fe118a50700 1 --2- 172.21.15.26:0/1103771001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1140f5240 0x7fe1140f5910 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fe10400c530 tx=0x7fe104007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:55.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.026+0000 7fe109ffb700 1 -- 172.21.15.26:0/1103771001 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe10400f650 con 0x7fe1140f5240 2021-11-03T16:52:55.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.026+0000 7fe109ffb700 1 -- 172.21.15.26:0/1103771001 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fe10400fc40 con 0x7fe1140f5240 2021-11-03T16:52:55.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.026+0000 7fe11a253700 1 -- 172.21.15.26:0/1103771001 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1140f6290 con 0x7fe1140f5240 2021-11-03T16:52:55.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.026+0000 7fe109ffb700 1 -- 172.21.15.26:0/1103771001 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe104012c20 con 0x7fe1140f5240 2021-11-03T16:52:55.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.026+0000 7fe11a253700 1 -- 172.21.15.26:0/1103771001 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe11410efb0 con 0x7fe1140f5240 2021-11-03T16:52:55.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.027+0000 7fe11a253700 1 -- 172.21.15.26:0/1103771001 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe114045ad0 con 0x7fe1140f5240 2021-11-03T16:52:55.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.027+0000 7fe109ffb700 1 -- 172.21.15.26:0/1103771001 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fe104019030 con 0x7fe1140f5240 2021-11-03T16:52:55.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.028+0000 7fe109ffb700 1 --2- 172.21.15.26:0/1103771001 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe10005c300 0x7fe10005e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:55.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.028+0000 7fe109ffb700 1 -- 172.21.15.26:0/1103771001 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fe104075ac0 con 0x7fe1140f5240 2021-11-03T16:52:55.032 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.028+0000 7fe119251700 1 --2- 172.21.15.26:0/1103771001 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe10005c300 0x7fe10005e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:55.032 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.028+0000 7fe119251700 1 --2- 172.21.15.26:0/1103771001 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe10005c300 0x7fe10005e7c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fe110004630 tx=0x7fe110009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:55.032 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.032+0000 7fe109ffb700 1 -- 172.21.15.26:0/1103771001 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fe1040487f0 con 0x7fe1140f5240 2021-11-03T16:52:55.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.188+0000 7fe11a253700 1 -- 172.21.15.26:0/1103771001 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fe11405f400 con 0x7fe1140f5240 2021-11-03T16:52:55.186 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.189+0000 7fe109ffb700 1 -- 172.21.15.26:0/1103771001 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v16)=0 v16) v1 ==== 163+0+0 (secure 0 0 0) 0x7fe104017070 con 0x7fe1140f5240 2021-11-03T16:52:55.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.190+0000 7fe11a253700 1 -- 172.21.15.26:0/1103771001 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe10005c300 msgr2=0x7fe10005e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:55.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.190+0000 7fe11a253700 1 --2- 172.21.15.26:0/1103771001 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe10005c300 0x7fe10005e7c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fe110004630 tx=0x7fe110009b30).stop 2021-11-03T16:52:55.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.190+0000 7fe11a253700 1 -- 172.21.15.26:0/1103771001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1140f5240 msgr2=0x7fe1140f5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:55.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.190+0000 7fe11a253700 1 --2- 172.21.15.26:0/1103771001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1140f5240 0x7fe1140f5910 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fe10400c530 tx=0x7fe104007e10).stop 2021-11-03T16:52:55.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.190+0000 7fe11a253700 1 -- 172.21.15.26:0/1103771001 shutdown_connections 2021-11-03T16:52:55.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.190+0000 7fe11a253700 1 --2- 172.21.15.26:0/1103771001 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe10005c300 0x7fe10005e7c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:55.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.190+0000 7fe11a253700 1 --2- 172.21.15.26:0/1103771001 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1140f48a0 0x7fe1140f7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:55.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.190+0000 7fe11a253700 1 --2- 172.21.15.26:0/1103771001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1140f5240 0x7fe1140f5910 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:55.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.190+0000 7fe11a253700 1 -- 172.21.15.26:0/1103771001 >> 172.21.15.26:0/1103771001 conn(0x7fe1140f0320 msgr2=0x7fe1140fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:55.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.190+0000 7fe11a253700 1 -- 172.21.15.26:0/1103771001 shutdown_connections 2021-11-03T16:52:55.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:55.190+0000 7fe11a253700 1 -- 172.21.15.26:0/1103771001 wait complete. 2021-11-03T16:52:55.890 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -e sha1=6e90212d8510e2d506395a8c82057d0d1787f3a4 -- bash -c 'ceph config set global log_to_journald false --force' 2021-11-03T16:52:56.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:56 smithi026 conmon[32119]: cluster 2021-11-03T16:52:55.050005+0000 mgr.smithi026.cnrxli 2021-11-03T16:52:56.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:56 smithi026 conmon[32119]: (mgr.14162) 244 : cluster [DBG] pgmap v204: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2021-11-03T16:52:56.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:56 smithi194 conmon[35111]: cluster 2021-11-03T16:52:55.050005+0000 mgr.smithi026.cnrxli (mgr.14162) 244 : cluster 2021-11-03T16:52:56.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:56 smithi194 conmon[35111]: [DBG] pgmap v204: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2021-11-03T16:52:57.858 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:57.857+0000 7f6e2e833700 1 -- 172.21.15.26:0/1929375661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e280f6ff0 msgr2=0x7f6e280f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:57.859 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:57.857+0000 7f6e2e833700 1 --2- 172.21.15.26:0/1929375661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e280f6ff0 0x7f6e280f7a20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f6e1c004660 tx=0x7f6e1c009b30).stop 2021-11-03T16:52:57.859 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:57.857+0000 7f6e2e833700 1 -- 172.21.15.26:0/1929375661 shutdown_connections 2021-11-03T16:52:57.859 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:57.857+0000 7f6e2e833700 1 --2- 172.21.15.26:0/1929375661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e280f6ff0 0x7f6e280f7a20 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:57.859 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:57.857+0000 7f6e2e833700 1 --2- 172.21.15.26:0/1929375661 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e280f66e0 0x7f6e280f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T16:52:57.860 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:57.857+0000 7f6e2e833700 1 -- 172.21.15.26:0/1929375661 >> 172.21.15.26:0/1929375661 conn(0x7f6e280f1f00 msgr2=0x7f6e280f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:57.860 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:57.857+0000 7f6e2e833700 1 -- 172.21.15.26:0/1929375661 shutdown_connections 2021-11-03T16:52:57.860 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:57.857+0000 7f6e2e833700 1 -- 172.21.15.26:0/1929375661 wait complete. 2021-11-03T16:52:57.860 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:57.857+0000 7f6e2e833700 1 Processor -- start 2021-11-03T16:52:57.861 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:57.858+0000 7f6e2e833700 1 -- start start 2021-11-03T16:52:57.861 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:57.858+0000 7f6e2e833700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e280f66e0 0x7f6e2806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:57.861 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:57.858+0000 7f6e2e833700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e280f6ff0 0x7f6e28069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:57.861 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:57.858+0000 7f6e2e833700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2806a410 con 0x7f6e280f6ff0 2021-11-03T16:52:57.861 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:57.858+0000 7f6e2e833700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2806a550 con 0x7f6e280f66e0 2021-11-03T16:52:57.862 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:57.858+0000 7f6e277fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e280f6ff0 0x7f6e28069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:57.862 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:57.858+0000 7f6e277fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e280f6ff0 0x7f6e28069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50246/0 (socket says 172.21.15.26:50246) 2021-11-03T16:52:57.862 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:57.858+0000 7f6e277fe700 1 -- 172.21.15.26:0/1403384130 learned_addr learned my addr 172.21.15.26:0/1403384130 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:52:57.862 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:57.858+0000 7f6e27fff700 1 --2- 172.21.15.26:0/1403384130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e280f66e0 0x7f6e2806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:57.863 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:57.858+0000 7f6e277fe700 1 -- 172.21.15.26:0/1403384130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e280f66e0 msgr2=0x7f6e2806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:57.863 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:57.858+0000 7f6e277fe700 1 --2- 172.21.15.26:0/1403384130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e280f66e0 0x7f6e2806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:57.864 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:57.858+0000 7f6e277fe700 1 -- 172.21.15.26:0/1403384130 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e1c005040 con 0x7f6e280f6ff0 2021-11-03T16:52:57.864 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:57.859+0000 7f6e277fe700 1 --2- 172.21.15.26:0/1403384130 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e280f6ff0 0x7f6e28069e20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f6e1c009990 tx=0x7f6e1c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:57.864 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:57.859+0000 7f6e24ff9700 1 -- 172.21.15.26:0/1403384130 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e1c018070 con 0x7f6e280f6ff0 2021-11-03T16:52:57.864 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:57.859+0000 7f6e2e833700 1 -- 172.21.15.26:0/1403384130 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e2806a7d0 con 0x7f6e280f6ff0 2021-11-03T16:52:57.865 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:57.859+0000 7f6e24ff9700 1 -- 172.21.15.26:0/1403384130 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f6e1c013410 con 0x7f6e280f6ff0 2021-11-03T16:52:57.865 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:57.859+0000 7f6e2e833700 1 -- 172.21.15.26:0/1403384130 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e2810ef60 con 0x7f6e280f6ff0 2021-11-03T16:52:57.865 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:57.859+0000 7f6e24ff9700 1 -- 172.21.15.26:0/1403384130 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e1c027440 con 0x7f6e280f6ff0 2021-11-03T16:52:57.865 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:57.860+0000 7f6e2e833700 1 -- 172.21.15.26:0/1403384130 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e08004fa0 con 0x7f6e280f6ff0 2021-11-03T16:52:57.866 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:57.860+0000 7f6e24ff9700 1 -- 172.21.15.26:0/1403384130 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f6e1c01d420 con 0x7f6e280f6ff0 2021-11-03T16:52:57.866 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:57.861+0000 7f6e24ff9700 1 --2- 172.21.15.26:0/1403384130 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f6e1005c2b0 0x7f6e1005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:52:57.866 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:57.861+0000 7f6e24ff9700 1 -- 172.21.15.26:0/1403384130 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f6e1c077b40 con 0x7f6e280f6ff0 2021-11-03T16:52:57.866 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:57.861+0000 7f6e27fff700 1 --2- 172.21.15.26:0/1403384130 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f6e1005c2b0 0x7f6e1005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:52:57.866 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:57.861+0000 7f6e27fff700 1 --2- 172.21.15.26:0/1403384130 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f6e1005c2b0 0x7f6e1005e770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f6e2806b730 tx=0x7f6e18008040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:52:57.867 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:57.865+0000 7f6e24ff9700 1 -- 172.21.15.26:0/1403384130 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f6e1c04a820 con 0x7f6e280f6ff0 2021-11-03T16:52:58.021 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:58.025+0000 7f6e2e833700 1 -- 172.21.15.26:0/1403384130 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f6e08005bf0 con 0x7f6e280f6ff0 2021-11-03T16:52:58.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:58.029+0000 7f6e24ff9700 1 -- 172.21.15.26:0/1403384130 <== mon.0 v2:172.21.15.26:3300/0 7 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6e1c04a820 con 0x7f6e280f6ff0 2021-11-03T16:52:58.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:58.029+0000 7f6e24ff9700 1 -- 172.21.15.26:0/1403384130 <== mon.0 v2:172.21.15.26:3300/0 8 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v17)=0 v17) v1 ==== 135+0+0 (secure 0 0 0) 0x7f6e1c04de40 con 0x7f6e280f6ff0 2021-11-03T16:52:58.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:58.031+0000 7f6e2e833700 1 -- 172.21.15.26:0/1403384130 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f6e1005c2b0 msgr2=0x7f6e1005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:58.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:58.031+0000 7f6e2e833700 1 --2- 172.21.15.26:0/1403384130 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f6e1005c2b0 0x7f6e1005e770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f6e2806b730 tx=0x7f6e18008040).stop 2021-11-03T16:52:58.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:58.031+0000 7f6e2e833700 1 -- 172.21.15.26:0/1403384130 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e280f6ff0 msgr2=0x7f6e28069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:52:58.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:58.031+0000 7f6e2e833700 1 --2- 172.21.15.26:0/1403384130 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e280f6ff0 0x7f6e28069e20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f6e1c009990 tx=0x7f6e1c009b30).stop 2021-11-03T16:52:58.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:58.032+0000 7f6e2e833700 1 -- 172.21.15.26:0/1403384130 shutdown_connections 2021-11-03T16:52:58.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:58.032+0000 7f6e2e833700 1 --2- 172.21.15.26:0/1403384130 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f6e1005c2b0 0x7f6e1005e770 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:58.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:58.032+0000 7f6e2e833700 1 --2- 172.21.15.26:0/1403384130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e280f66e0 0x7f6e2806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:58.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:58.032+0000 7f6e2e833700 1 --2- 172.21.15.26:0/1403384130 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e280f6ff0 0x7f6e28069e20 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:52:58.030 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:58.032+0000 7f6e2e833700 1 -- 172.21.15.26:0/1403384130 >> 172.21.15.26:0/1403384130 conn(0x7f6e280f1f00 msgr2=0x7f6e280fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:52:58.030 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:58.032+0000 7f6e2e833700 1 -- 172.21.15.26:0/1403384130 shutdown_connections 2021-11-03T16:52:58.030 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:52:58.032+0000 7f6e2e833700 1 -- 172.21.15.26:0/1403384130 wait complete. 2021-11-03T16:52:58.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:58 smithi026 conmon[32119]: cluster 2021-11-03T16:52:57.050455+0000 mgr.smithi026.cnrxli (mgr.14162) 245 : cluster [DBG] pgmap v205: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2021-11-03T16:52:58.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:58 smithi026 conmon[32119]: audit 2021-11-03T16:52:58.031045+0000 mon.smithi026 (mon.0) 540 : audit [INF] from='client.? 172.21.15.26:0/1403384130' entity='client.admin' 2021-11-03T16:52:58.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:58 smithi026 conmon[32119]: audit 2021-11-03T16:52:58.035362+0000 mon.smithi026 (mon.0) 541 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:52:58.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:58 smithi194 conmon[35111]: cluster 2021-11-03T16:52:57.050455+0000 mgr.smithi026.cnrxli (mgr. 2021-11-03T16:52:58.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:58 smithi194 conmon[35111]: 14162) 245 : cluster [DBG] pgmap v205: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2021-11-03T16:52:58.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:58 smithi194 conmon[35111]: audit 2021-11-03T16:52:58.031045+0000 mon.smithi026 (mon.0) 540 : audit [INF] from='client.? 172.21.15.26:0/1403384130' entity='client.admin' 2021-11-03T16:52:58.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:58 smithi194 conmon[35111]: audit 2021-11-03T16:52:58.035362+0000 mon.smithi026 (mon.0) 541 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:52:58.778 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -e sha1=6e90212d8510e2d506395a8c82057d0d1787f3a4 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2021-11-03T16:52:59.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:59 smithi026 conmon[32119]: audit 2021-11-03T16:52:58.588114+0000 2021-11-03T16:52:59.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:59 smithi026 conmon[32119]: mon.smithi026 (mon.0) 542 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:52:59.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:52:59 smithi026 conmon[32119]: cluster 2021-11-03T16:52:59.051041+0000 mgr.smithi026.cnrxli (mgr.14162) 246 : cluster [DBG] pgmap v206: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2021-11-03T16:52:59.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:59 smithi194 conmon[35111]: audit 2021-11-03T16:52:58.588114+0000 mon.smithi026 (mon.0) 542 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:52:59.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:52:59 smithi194 conmon[35111]: cluster 2021-11-03T16:52:59.051041+0000 mgr.smithi026.cnrxli (mgr.14162) 246 : cluster [DBG] pgmap v206: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2021-11-03T16:53:00.662 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.663+0000 7fcfc0ad6700 1 -- 172.21.15.26:0/4160663305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfbc0f51a0 msgr2=0x7fcfbc0f7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:53:00.662 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.663+0000 7fcfc0ad6700 1 --2- 172.21.15.26:0/4160663305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfbc0f51a0 0x7fcfbc0f7920 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7fcfac004660 tx=0x7fcfac009b30).stop 2021-11-03T16:53:00.662 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.663+0000 7fcfc0ad6700 1 -- 172.21.15.26:0/4160663305 shutdown_connections 2021-11-03T16:53:00.663 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.663+0000 7fcfc0ad6700 1 --2- 172.21.15.26:0/4160663305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfbc0f51a0 0x7fcfbc0f7920 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:00.663 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.663+0000 7fcfc0ad6700 1 --2- 172.21.15.26:0/4160663305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfbc0f4800 0x7fcfbc0f4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T16:53:00.663 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.663+0000 7fcfc0ad6700 1 -- 172.21.15.26:0/4160663305 >> 172.21.15.26:0/4160663305 conn(0x7fcfbc0f0320 msgr2=0x7fcfbc0f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:53:00.663 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.664+0000 7fcfc0ad6700 1 -- 172.21.15.26:0/4160663305 shutdown_connections 2021-11-03T16:53:00.664 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.664+0000 7fcfc0ad6700 1 -- 172.21.15.26:0/4160663305 wait complete. 2021-11-03T16:53:00.664 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.664+0000 7fcfc0ad6700 1 Processor -- start 2021-11-03T16:53:00.664 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.664+0000 7fcfc0ad6700 1 -- start start 2021-11-03T16:53:00.664 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.664+0000 7fcfc0ad6700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfbc0f4800 0x7fcfbc106e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:53:00.665 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.664+0000 7fcfc0ad6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfbc0f51a0 0x7fcfbc107300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:53:00.665 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.664+0000 7fcfc0ad6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc107990 con 0x7fcfbc0f51a0 2021-11-03T16:53:00.665 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.664+0000 7fcfc0ad6700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc108110 con 0x7fcfbc0f4800 2021-11-03T16:53:00.665 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.665+0000 7fcfbaffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfbc0f51a0 0x7fcfbc107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:53:00.665 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.665+0000 7fcfbaffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfbc0f51a0 0x7fcfbc107300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50254/0 (socket says 172.21.15.26:50254) 2021-11-03T16:53:00.666 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.665+0000 7fcfbaffd700 1 -- 172.21.15.26:0/3036174209 learned_addr learned my addr 172.21.15.26:0/3036174209 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:53:00.666 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.665+0000 7fcfbb7fe700 1 --2- 172.21.15.26:0/3036174209 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfbc0f4800 0x7fcfbc106e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:53:00.666 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.665+0000 7fcfbaffd700 1 -- 172.21.15.26:0/3036174209 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfbc0f4800 msgr2=0x7fcfbc106e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:53:00.666 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.665+0000 7fcfbaffd700 1 --2- 172.21.15.26:0/3036174209 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfbc0f4800 0x7fcfbc106e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:00.667 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.665+0000 7fcfbaffd700 1 -- 172.21.15.26:0/3036174209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfac005040 con 0x7fcfbc0f51a0 2021-11-03T16:53:00.667 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.665+0000 7fcfbaffd700 1 --2- 172.21.15.26:0/3036174209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfbc0f51a0 0x7fcfbc107300 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fcfac004f60 tx=0x7fcfac009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:53:00.667 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.665+0000 7fcfa3fff700 1 -- 172.21.15.26:0/3036174209 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfac018070 con 0x7fcfbc0f51a0 2021-11-03T16:53:00.667 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.665+0000 7fcfa3fff700 1 -- 172.21.15.26:0/3036174209 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcfac007ba0 con 0x7fcfbc0f51a0 2021-11-03T16:53:00.668 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.665+0000 7fcfc0ad6700 1 -- 172.21.15.26:0/3036174209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfbc108330 con 0x7fcfbc0f51a0 2021-11-03T16:53:00.668 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.665+0000 7fcfa3fff700 1 -- 172.21.15.26:0/3036174209 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfac01c620 con 0x7fcfbc0f51a0 2021-11-03T16:53:00.668 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.665+0000 7fcfc0ad6700 1 -- 172.21.15.26:0/3036174209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfbc108890 con 0x7fcfbc0f51a0 2021-11-03T16:53:00.669 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.666+0000 7fcfc0ad6700 1 -- 172.21.15.26:0/3036174209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfbc045ad0 con 0x7fcfbc0f51a0 2021-11-03T16:53:00.669 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.666+0000 7fcfa3fff700 1 -- 172.21.15.26:0/3036174209 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fcfac01d420 con 0x7fcfbc0f51a0 2021-11-03T16:53:00.670 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.667+0000 7fcfa3fff700 1 --2- 172.21.15.26:0/3036174209 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fcfa405c300 0x7fcfa405e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:53:00.670 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.667+0000 7fcfa3fff700 1 -- 172.21.15.26:0/3036174209 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fcfac077d30 con 0x7fcfbc0f51a0 2021-11-03T16:53:00.670 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.667+0000 7fcfbb7fe700 1 --2- 172.21.15.26:0/3036174209 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fcfa405c300 0x7fcfa405e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:53:00.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.667+0000 7fcfbb7fe700 1 --2- 172.21.15.26:0/3036174209 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fcfa405c300 0x7fcfa405e7c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fcfbc106b80 tx=0x7fcfb0008040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:53:00.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.671+0000 7fcfa3fff700 1 -- 172.21.15.26:0/3036174209 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fcfac04e4c0 con 0x7fcfbc0f51a0 2021-11-03T16:53:00.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.861+0000 7fcfc0ad6700 1 -- 172.21.15.26:0/3036174209 --> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:6e90212d8510e2d506395a8c82057d0d1787f3a4", "target": ["mon-mgr", ""]}) v1 -- 0x7fcfbc108bc0 con 0x7fcfa405c300 2021-11-03T16:53:00.862 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.866+0000 7fcfa3fff700 1 -- 172.21.15.26:0/3036174209 <== mgr.14162 v2:172.21.15.26:6800/3029163595 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7fcfbc108bc0 con 0x7fcfa405c300 2021-11-03T16:53:00.863 INFO:teuthology.orchestra.run.smithi026.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:6e90212d8510e2d506395a8c82057d0d1787f3a4 2021-11-03T16:53:00.864 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.868+0000 7fcfc0ad6700 1 -- 172.21.15.26:0/3036174209 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fcfa405c300 msgr2=0x7fcfa405e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:53:00.865 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.868+0000 7fcfc0ad6700 1 --2- 172.21.15.26:0/3036174209 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fcfa405c300 0x7fcfa405e7c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fcfbc106b80 tx=0x7fcfb0008040).stop 2021-11-03T16:53:00.865 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.868+0000 7fcfc0ad6700 1 -- 172.21.15.26:0/3036174209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfbc0f51a0 msgr2=0x7fcfbc107300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:53:00.865 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.868+0000 7fcfc0ad6700 1 --2- 172.21.15.26:0/3036174209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfbc0f51a0 0x7fcfbc107300 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fcfac004f60 tx=0x7fcfac009b30).stop 2021-11-03T16:53:00.865 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.868+0000 7fcfc0ad6700 1 -- 172.21.15.26:0/3036174209 shutdown_connections 2021-11-03T16:53:00.866 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.868+0000 7fcfc0ad6700 1 --2- 172.21.15.26:0/3036174209 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fcfa405c300 0x7fcfa405e7c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:00.866 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.868+0000 7fcfc0ad6700 1 --2- 172.21.15.26:0/3036174209 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfbc0f4800 0x7fcfbc106e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:00.866 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.868+0000 7fcfc0ad6700 1 --2- 172.21.15.26:0/3036174209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfbc0f51a0 0x7fcfbc107300 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:00.866 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.868+0000 7fcfc0ad6700 1 -- 172.21.15.26:0/3036174209 >> 172.21.15.26:0/3036174209 conn(0x7fcfbc0f0320 msgr2=0x7fcfbc0fb370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:53:00.867 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.869+0000 7fcfc0ad6700 1 -- 172.21.15.26:0/3036174209 shutdown_connections 2021-11-03T16:53:00.867 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:00.869+0000 7fcfc0ad6700 1 -- 172.21.15.26:0/3036174209 wait complete. 2021-11-03T16:53:01.545 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2021-11-03T16:53:01.546 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi026.front.sepia.ceph.com 2021-11-03T16:53:01.546 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c -e sha1=6e90212d8510e2d506395a8c82057d0d1787f3a4 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true ; do ceph orch ps ; ceph versions ; ceph fs dump; sleep 30 ; done' 2021-11-03T16:53:02.115 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:01 smithi026 conmon[32119]: audit 2021-11-03T16:53:00.863813+0000 mgr.smithi026.cnrxli (mgr.14162) 247 : audit [DBG] from='client.14492 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:6e90212d8510e2d506395a8c82057d0d1787f3a4", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:53:02.115 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:01 smithi026 conmon[32119]: cephadm 2021-11-03T16:53:00.864475+0000 mgr.smithi026.cnrxli (mgr.14162) 248 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:6e90212d8510e2d506395a8c82057d0d1787f3a4 2021-11-03T16:53:02.116 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:01 smithi026 conmon[32119]: audit 2021-11-03T16:53:00.867991+0000 mon.smithi026 (mon.0) 543 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:53:02.116 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:01 smithi026 conmon[32119]: audit 2021-11-03T16:53:00.868508+0000 mon.smithi026 (mon.0) 544 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:53:02.116 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:01 smithi026 conmon[32119]: audit 2021-11-03T16:53:00.873538+0000 mon.smithi026 (mon.0) 545 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:53:02.116 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:01 smithi026 conmon[32119]: cephadm 2021-11-03T16:53:00.877829+0000 mgr.smithi026.cnrxli (mgr.14162) 249 : cephadm 2021-11-03T16:53:02.117 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:01 smithi026 conmon[32119]: [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:6e90212d8510e2d506395a8c82057d0d1787f3a4 2021-11-03T16:53:02.117 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:01 smithi026 conmon[32119]: cluster 2021-11-03T16:53:01.051534+0000 mgr.smithi026.cnrxli (mgr.14162) 250 : cluster [DBG] pgmap v207: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2021-11-03T16:53:02.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:01 smithi194 conmon[35111]: audit 2021-11-03T16:53:00.863813+0000 mgr.smithi026.cnrxli (mgr.14162) 247 : audit [DBG] from='client.14492 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:6e90212d8510e2d506395a8c82057d0d1787f3a4", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:53:02.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:01 smithi194 conmon[35111]: cephadm 2021-11-03T16:53:00.864475+0000 mgr.smithi026.cnrxli 2021-11-03T16:53:02.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:01 smithi194 conmon[35111]: (mgr.14162) 248 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:6e90212d8510e2d506395a8c82057d0d1787f3a4 2021-11-03T16:53:02.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:01 smithi194 conmon[35111]: audit 2021-11-03T16:53:00.867991+0000 mon.smithi026 (mon.0) 543 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:53:02.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:01 smithi194 conmon[35111]: audit 2021-11-03T16:53:00.868508+0000 mon.smithi026 (mon.0) 544 : audit [DBG] 2021-11-03T16:53:02.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:01 smithi194 conmon[35111]: from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:53:02.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:01 smithi194 conmon[35111]: audit 2021-11-03T16:53:00.873538 2021-11-03T16:53:02.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:01 smithi194 conmon[35111]: +0000 mon.smithi026 (mon.0) 545 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:53:02.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:01 smithi194 conmon[35111]: cephadm 2021-11 2021-11-03T16:53:02.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:01 smithi194 conmon[35111]: -03T16:53:00.877829+0000 mgr.smithi026.cnrxli ( 2021-11-03T16:53:02.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:01 smithi194 conmon[35111]: mgr.14162) 249 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:6e90212d8510e2d506395a8c82057d0d1787f3a4 2021-11-03T16:53:02.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:01 smithi194 conmon[35111]: cluster 2021- 2021-11-03T16:53:02.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:01 smithi194 conmon[35111]: 11-03T16:53:01.051534+0000 mgr.smithi026.cnrxli 2021-11-03T16:53:02.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:01 smithi194 conmon[35111]: (mgr.14162) 250 : cluster [DBG] pgmap v207: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2021-11-03T16:53:03.998 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.000+0000 7faceda0d700 1 -- 172.21.15.26:0/527374888 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7face80f6700 msgr2=0x7face80f6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:53:03.999 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.000+0000 7faceda0d700 1 --2- 172.21.15.26:0/527374888 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7face80f6700 0x7face80f6b60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7facdc004660 tx=0x7facdc009b30).stop 2021-11-03T16:53:03.999 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.001+0000 7faceda0d700 1 -- 172.21.15.26:0/527374888 shutdown_connections 2021-11-03T16:53:03.999 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.001+0000 7faceda0d700 1 --2- 172.21.15.26:0/527374888 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7face80f6700 0x7face80f6b60 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:03.999 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.001+0000 7faceda0d700 1 --2- 172.21.15.26:0/527374888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7face80f5460 0x7face80f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T16:53:04.000 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.001+0000 7faceda0d700 1 -- 172.21.15.26:0/527374888 >> 172.21.15.26:0/527374888 conn(0x7face80f0bc0 msgr2=0x7face80f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:53:04.000 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.001+0000 7faceda0d700 1 -- 172.21.15.26:0/527374888 shutdown_connections 2021-11-03T16:53:04.000 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.001+0000 7faceda0d700 1 -- 172.21.15.26:0/527374888 wait complete. 2021-11-03T16:53:04.000 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.002+0000 7faceda0d700 1 Processor -- start 2021-11-03T16:53:04.001 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.002+0000 7faceda0d700 1 -- start start 2021-11-03T16:53:04.001 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.002+0000 7faceda0d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7face80f5460 0x7face8105d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:53:04.001 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.002+0000 7faceda0d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7face80f6700 0x7face8106240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:53:04.001 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.002+0000 7faceda0d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face8106880 con 0x7face80f5460 2021-11-03T16:53:04.001 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.002+0000 7faceda0d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face8106ff0 con 0x7face80f6700 2021-11-03T16:53:04.002 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.002+0000 7face6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7face80f5460 0x7face8105d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:53:04.002 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.002+0000 7face6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7face80f5460 0x7face8105d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50274/0 (socket says 172.21.15.26:50274) 2021-11-03T16:53:04.002 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.002+0000 7face6ffd700 1 -- 172.21.15.26:0/1307294300 learned_addr learned my addr 172.21.15.26:0/1307294300 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:53:04.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.002+0000 7face67fc700 1 --2- 172.21.15.26:0/1307294300 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7face80f6700 0x7face8106240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:53:04.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.003+0000 7face6ffd700 1 -- 172.21.15.26:0/1307294300 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7face80f6700 msgr2=0x7face8106240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:53:04.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.003+0000 7face6ffd700 1 --2- 172.21.15.26:0/1307294300 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7face80f6700 0x7face8106240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:04.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.003+0000 7face6ffd700 1 -- 172.21.15.26:0/1307294300 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facdc005040 con 0x7face80f5460 2021-11-03T16:53:04.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.003+0000 7face6ffd700 1 --2- 172.21.15.26:0/1307294300 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7face80f5460 0x7face8105d50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7facd800d9a0 tx=0x7facd8006f50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:53:04.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.003+0000 7faccf7fe700 1 -- 172.21.15.26:0/1307294300 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facd800eb00 con 0x7face80f5460 2021-11-03T16:53:04.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.003+0000 7faccf7fe700 1 -- 172.21.15.26:0/1307294300 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7facd8012070 con 0x7face80f5460 2021-11-03T16:53:04.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.003+0000 7faceda0d700 1 -- 172.21.15.26:0/1307294300 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7face81072d0 con 0x7face80f5460 2021-11-03T16:53:04.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.003+0000 7faceda0d700 1 -- 172.21.15.26:0/1307294300 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7face8107890 con 0x7face80f5460 2021-11-03T16:53:04.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.003+0000 7faccf7fe700 1 -- 172.21.15.26:0/1307294300 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facd8015330 con 0x7face80f5460 2021-11-03T16:53:04.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.004+0000 7faceda0d700 1 -- 172.21.15.26:0/1307294300 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7face8045ad0 con 0x7face80f5460 2021-11-03T16:53:04.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.005+0000 7faccf7fe700 1 -- 172.21.15.26:0/1307294300 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7facd801e070 con 0x7face80f5460 2021-11-03T16:53:04.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.006+0000 7faccf7fe700 1 --2- 172.21.15.26:0/1307294300 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7facd005c300 0x7facd005e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:53:04.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.006+0000 7faccf7fe700 1 -- 172.21.15.26:0/1307294300 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7facd80781b0 con 0x7face80f5460 2021-11-03T16:53:04.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.006+0000 7face67fc700 1 --2- 172.21.15.26:0/1307294300 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7facd005c300 0x7facd005e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:53:04.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.006+0000 7face67fc700 1 --2- 172.21.15.26:0/1307294300 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7facd005c300 0x7facd005e7c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7facdc004e30 tx=0x7facdc009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:53:04.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.012+0000 7faccf7fe700 1 -- 172.21.15.26:0/1307294300 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7facd804ae90 con 0x7face80f5460 2021-11-03T16:53:04.327 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.329+0000 7faceda0d700 1 -- 172.21.15.26:0/1307294300 --> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7face80ff7e0 con 0x7facd005c300 2021-11-03T16:53:04.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.330+0000 7faccf7fe700 1 -- 172.21.15.26:0/1307294300 <== mgr.14162 v2:172.21.15.26:6800/3029163595 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+278 (secure 0 0 0) 0x7face80ff7e0 con 0x7facd005c300 2021-11-03T16:53:04.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.333+0000 7faceda0d700 1 -- 172.21.15.26:0/1307294300 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7facd005c300 msgr2=0x7facd005e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:53:04.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.333+0000 7faceda0d700 1 --2- 172.21.15.26:0/1307294300 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7facd005c300 0x7facd005e7c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7facdc004e30 tx=0x7facdc009b30).stop 2021-11-03T16:53:04.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.333+0000 7faceda0d700 1 -- 172.21.15.26:0/1307294300 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7face80f5460 msgr2=0x7face8105d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:53:04.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.333+0000 7faceda0d700 1 --2- 172.21.15.26:0/1307294300 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7face80f5460 0x7face8105d50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7facd800d9a0 tx=0x7facd8006f50).stop 2021-11-03T16:53:04.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.334+0000 7faceda0d700 1 -- 172.21.15.26:0/1307294300 shutdown_connections 2021-11-03T16:53:04.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.334+0000 7faceda0d700 1 --2- 172.21.15.26:0/1307294300 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7facd005c300 0x7facd005e7c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:04.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.334+0000 7faceda0d700 1 --2- 172.21.15.26:0/1307294300 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7face80f5460 0x7face8105d50 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:04.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.334+0000 7faceda0d700 1 --2- 172.21.15.26:0/1307294300 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7face80f6700 0x7face8106240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:04.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.334+0000 7faceda0d700 1 -- 172.21.15.26:0/1307294300 >> 172.21.15.26:0/1307294300 conn(0x7face80f0bc0 msgr2=0x7face80fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:53:04.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.334+0000 7faceda0d700 1 -- 172.21.15.26:0/1307294300 shutdown_connections 2021-11-03T16:53:04.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.334+0000 7faceda0d700 1 -- 172.21.15.26:0/1307294300 wait complete. 2021-11-03T16:53:04.342 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T16:53:04.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:04 smithi026 conmon[32119]: cluster 2021-11-03T16:53:03.052026+0000 mgr.smithi026.cnrxli (mgr.14162) 251 : cluster [DBG] pgmap v208: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2021-11-03T16:53:04.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.447+0000 7f5c04c12700 1 -- 172.21.15.26:0/1110917583 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c000f6530 msgr2=0x7f5c000f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:53:04.444 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.447+0000 7f5c04c12700 1 --2- 172.21.15.26:0/1110917583 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c000f6530 0x7f5c000f6950 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f5bf0004660 tx=0x7f5bf0009b30).stop 2021-11-03T16:53:04.444 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.448+0000 7f5c04c12700 1 -- 172.21.15.26:0/1110917583 shutdown_connections 2021-11-03T16:53:04.444 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.448+0000 7f5c04c12700 1 --2- 172.21.15.26:0/1110917583 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c000f77d0 0x7f5c000f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:04.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.448+0000 7f5c04c12700 1 --2- 172.21.15.26:0/1110917583 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c000f6530 0x7f5c000f6950 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:04.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.448+0000 7f5c04c12700 1 -- 172.21.15.26:0/1110917583 >> 172.21.15.26:0/1110917583 conn(0x7f5c000f1cd0 msgr2=0x7f5c000f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:53:04.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.448+0000 7f5c04c12700 1 -- 172.21.15.26:0/1110917583 shutdown_connections 2021-11-03T16:53:04.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.448+0000 7f5c04c12700 1 -- 172.21.15.26:0/1110917583 wait complete. 2021-11-03T16:53:04.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.448+0000 7f5c04c12700 1 Processor -- start 2021-11-03T16:53:04.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.449+0000 7f5c04c12700 1 -- start start 2021-11-03T16:53:04.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.449+0000 7f5c04c12700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c000f6530 0x7f5c00106db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:53:04.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.449+0000 7f5c04c12700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c000f77d0 0x7f5c001072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:53:04.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.449+0000 7f5c04c12700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c001078a0 con 0x7f5c000f77d0 2021-11-03T16:53:04.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.449+0000 7f5c04c12700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c001080e0 con 0x7f5c000f6530 2021-11-03T16:53:04.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.449+0000 7f5bfeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c000f77d0 0x7f5c001072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:53:04.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.449+0000 7f5bfeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c000f77d0 0x7f5c001072a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50286/0 (socket says 172.21.15.26:50286) 2021-11-03T16:53:04.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.449+0000 7f5bfeffd700 1 -- 172.21.15.26:0/3176637797 learned_addr learned my addr 172.21.15.26:0/3176637797 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:53:04.450 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.449+0000 7f5bff7fe700 1 --2- 172.21.15.26:0/3176637797 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c000f6530 0x7f5c00106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:53:04.450 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.449+0000 7f5bfeffd700 1 -- 172.21.15.26:0/3176637797 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c000f6530 msgr2=0x7f5c00106db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:53:04.450 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.449+0000 7f5bfeffd700 1 --2- 172.21.15.26:0/3176637797 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c000f6530 0x7f5c00106db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:04.450 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.449+0000 7f5bfeffd700 1 -- 172.21.15.26:0/3176637797 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf0005040 con 0x7f5c000f77d0 2021-11-03T16:53:04.451 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.450+0000 7f5bfeffd700 1 --2- 172.21.15.26:0/3176637797 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c000f77d0 0x7f5c001072a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f5bf40026d0 tx=0x7f5bf4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:53:04.451 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.450+0000 7f5be7fff700 1 -- 172.21.15.26:0/3176637797 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bf40079c0 con 0x7f5c000f77d0 2021-11-03T16:53:04.451 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.450+0000 7f5c04c12700 1 -- 172.21.15.26:0/3176637797 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c001083c0 con 0x7f5c000f77d0 2021-11-03T16:53:04.451 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.450+0000 7f5be7fff700 1 -- 172.21.15.26:0/3176637797 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5bf400f040 con 0x7f5c000f77d0 2021-11-03T16:53:04.451 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.450+0000 7f5be7fff700 1 -- 172.21.15.26:0/3176637797 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bf40148b0 con 0x7f5c000f77d0 2021-11-03T16:53:04.452 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.450+0000 7f5c04c12700 1 -- 172.21.15.26:0/3176637797 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c00108900 con 0x7f5c000f77d0 2021-11-03T16:53:04.452 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.451+0000 7f5c04c12700 1 -- 172.21.15.26:0/3176637797 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c00059100 con 0x7f5c000f77d0 2021-11-03T16:53:04.453 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.452+0000 7f5be7fff700 1 -- 172.21.15.26:0/3176637797 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f5bf4007b20 con 0x7f5c000f77d0 2021-11-03T16:53:04.453 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.453+0000 7f5be7fff700 1 --2- 172.21.15.26:0/3176637797 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f5be805c300 0x7f5be805e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:53:04.453 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.453+0000 7f5be7fff700 1 -- 172.21.15.26:0/3176637797 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f5bf4076280 con 0x7f5c000f77d0 2021-11-03T16:53:04.454 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.453+0000 7f5bff7fe700 1 --2- 172.21.15.26:0/3176637797 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f5be805c300 0x7f5be805e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:53:04.454 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.453+0000 7f5bff7fe700 1 --2- 172.21.15.26:0/3176637797 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f5be805c300 0x7f5be805e7c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f5bf0013690 tx=0x7f5bf0009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:53:04.454 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.457+0000 7f5be7fff700 1 -- 172.21.15.26:0/3176637797 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f5bf4049050 con 0x7f5c000f77d0 2021-11-03T16:53:04.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:04 smithi194 conmon[35111]: cluster 2021-11-03T16:53:03.052026+0000 mgr.smithi026.cnrxli (mgr.14162) 251 : cluster [DBG] pgmap v208: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2021-11-03T16:53:04.740 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.743+0000 7f5c04c12700 1 -- 172.21.15.26:0/3176637797 --> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c000fee60 con 0x7f5be805c300 2021-11-03T16:53:04.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.758+0000 7f5be7fff700 1 -- 172.21.15.26:0/3176637797 <== mgr.14162 v2:172.21.15.26:6800/3029163595 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2684 (secure 0 0 0) 0x7f5c000fee60 con 0x7f5be805c300 2021-11-03T16:53:04.755 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE VERSION IMAGE ID CONTAINER ID 2021-11-03T16:53:04.755 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (4m) 22s ago 5m 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T16:53:04.756 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (5m) 22s ago 5m 16.2.4 8d91d370c2b8 83a448d79108 2021-11-03T16:53:04.756 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (4m) 25s ago 4m 16.2.4 8d91d370c2b8 708c0ec0397b 2021-11-03T16:53:04.756 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (4m) 22s ago 5m 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T16:53:04.756 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (42s) 22s ago 41s 16.2.4 8d91d370c2b8 0500d47c638e 2021-11-03T16:53:04.757 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (35s) 22s ago 35s 16.2.4 8d91d370c2b8 638170268dac 2021-11-03T16:53:04.757 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (45s) 25s ago 45s 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T16:53:04.757 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (39s) 25s ago 38s 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T16:53:04.757 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:9283 running (6m) 22s ago 6m 16.2.4 8d91d370c2b8 65362b14caeb 2021-11-03T16:53:04.757 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8443,9283 running (4m) 25s ago 4m 16.2.4 8d91d370c2b8 e07291aea712 2021-11-03T16:53:04.758 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (6m) 22s ago 7m 16.2.4 8d91d370c2b8 c37e54308890 2021-11-03T16:53:04.758 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (4m) 25s ago 4m 16.2.4 8d91d370c2b8 b688a2953f0a 2021-11-03T16:53:04.758 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (5m) 22s ago 5m 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T16:53:04.758 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (4m) 25s ago 4m 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T16:53:04.759 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (3m) 22s ago 3m 16.2.4 8d91d370c2b8 d7f900ddf0f3 2021-11-03T16:53:04.759 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (3m) 22s ago 3m 16.2.4 8d91d370c2b8 9e5ffa11984b 2021-11-03T16:53:04.759 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (3m) 22s ago 3m 16.2.4 8d91d370c2b8 f65145633c0e 2021-11-03T16:53:04.759 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (2m) 25s ago 2m 16.2.4 8d91d370c2b8 ff6d474a5f9a 2021-11-03T16:53:04.759 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (2m) 25s ago 2m 16.2.4 8d91d370c2b8 e2fc9c0bdf0f 2021-11-03T16:53:04.760 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (2m) 25s ago 2m 16.2.4 8d91d370c2b8 0abc64d8a2bf 2021-11-03T16:53:04.760 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (4m) 22s ago 4m 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T16:53:04.761 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.760+0000 7f5c04c12700 1 -- 172.21.15.26:0/3176637797 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f5be805c300 msgr2=0x7f5be805e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:53:04.761 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.760+0000 7f5c04c12700 1 --2- 172.21.15.26:0/3176637797 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f5be805c300 0x7f5be805e7c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f5bf0013690 tx=0x7f5bf0009b30).stop 2021-11-03T16:53:04.761 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.760+0000 7f5c04c12700 1 -- 172.21.15.26:0/3176637797 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c000f77d0 msgr2=0x7f5c001072a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:53:04.762 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.760+0000 7f5c04c12700 1 --2- 172.21.15.26:0/3176637797 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c000f77d0 0x7f5c001072a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f5bf40026d0 tx=0x7f5bf4009de0).stop 2021-11-03T16:53:04.762 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.760+0000 7f5c04c12700 1 -- 172.21.15.26:0/3176637797 shutdown_connections 2021-11-03T16:53:04.762 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.760+0000 7f5c04c12700 1 --2- 172.21.15.26:0/3176637797 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f5be805c300 0x7f5be805e7c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:04.762 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.760+0000 7f5c04c12700 1 --2- 172.21.15.26:0/3176637797 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c000f6530 0x7f5c00106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:04.763 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.760+0000 7f5c04c12700 1 --2- 172.21.15.26:0/3176637797 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c000f77d0 0x7f5c001072a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:04.763 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.760+0000 7f5c04c12700 1 -- 172.21.15.26:0/3176637797 >> 172.21.15.26:0/3176637797 conn(0x7f5c000f1cd0 msgr2=0x7f5c000fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:53:04.763 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.760+0000 7f5c04c12700 1 -- 172.21.15.26:0/3176637797 shutdown_connections 2021-11-03T16:53:04.763 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.760+0000 7f5c04c12700 1 -- 172.21.15.26:0/3176637797 wait complete. 2021-11-03T16:53:04.884 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.883+0000 7f47c1188700 1 -- 172.21.15.26:0/1242613269 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47bc0f66c0 msgr2=0x7f47bc0f6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:53:04.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.883+0000 7f47c1188700 1 --2- 172.21.15.26:0/1242613269 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47bc0f66c0 0x7f47bc0f6ae0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f47ac004660 tx=0x7f47ac009b30).stop 2021-11-03T16:53:04.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.883+0000 7f47c1188700 1 -- 172.21.15.26:0/1242613269 shutdown_connections 2021-11-03T16:53:04.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.883+0000 7f47c1188700 1 --2- 172.21.15.26:0/1242613269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47bc0f7960 0x7f47bc0f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:04.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.883+0000 7f47c1188700 1 --2- 172.21.15.26:0/1242613269 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47bc0f66c0 0x7f47bc0f6ae0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:04.886 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.883+0000 7f47c1188700 1 -- 172.21.15.26:0/1242613269 >> 172.21.15.26:0/1242613269 conn(0x7f47bc0f1e20 msgr2=0x7f47bc0f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:53:04.886 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.883+0000 7f47c1188700 1 -- 172.21.15.26:0/1242613269 shutdown_connections 2021-11-03T16:53:04.886 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.883+0000 7f47c1188700 1 -- 172.21.15.26:0/1242613269 wait complete. 2021-11-03T16:53:04.886 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.883+0000 7f47c1188700 1 Processor -- start 2021-11-03T16:53:04.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.883+0000 7f47c1188700 1 -- start start 2021-11-03T16:53:04.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.884+0000 7f47c1188700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47bc0f66c0 0x7f47bc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:53:04.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.884+0000 7f47c1188700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47bc0f7960 0x7f47bc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:53:04.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.884+0000 7f47c1188700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc06a380 con 0x7f47bc0f66c0 2021-11-03T16:53:04.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.884+0000 7f47c1188700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc06a4c0 con 0x7f47bc0f7960 2021-11-03T16:53:04.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.884+0000 7f47bad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47bc0f66c0 0x7f47bc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:53:04.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.884+0000 7f47bad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47bc0f66c0 0x7f47bc06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50294/0 (socket says 172.21.15.26:50294) 2021-11-03T16:53:04.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.884+0000 7f47bad9d700 1 -- 172.21.15.26:0/1425283415 learned_addr learned my addr 172.21.15.26:0/1425283415 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:53:04.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.884+0000 7f47ba59c700 1 --2- 172.21.15.26:0/1425283415 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47bc0f7960 0x7f47bc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:53:04.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.884+0000 7f47bad9d700 1 -- 172.21.15.26:0/1425283415 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47bc0f7960 msgr2=0x7f47bc069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:53:04.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.884+0000 7f47bad9d700 1 --2- 172.21.15.26:0/1425283415 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47bc0f7960 0x7f47bc069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:04.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.884+0000 7f47bad9d700 1 -- 172.21.15.26:0/1425283415 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ac005040 con 0x7f47bc0f66c0 2021-11-03T16:53:04.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.884+0000 7f47bad9d700 1 --2- 172.21.15.26:0/1425283415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47bc0f66c0 0x7f47bc06b9a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f47ac000c00 tx=0x7f47ac009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:53:04.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.884+0000 7f47a37fe700 1 -- 172.21.15.26:0/1425283415 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47ac018070 con 0x7f47bc0f66c0 2021-11-03T16:53:04.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.884+0000 7f47a37fe700 1 -- 172.21.15.26:0/1425283415 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f47ac007d70 con 0x7f47bc0f66c0 2021-11-03T16:53:04.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.884+0000 7f47a37fe700 1 -- 172.21.15.26:0/1425283415 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47ac01c620 con 0x7f47bc0f66c0 2021-11-03T16:53:04.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.884+0000 7f47c1188700 1 -- 172.21.15.26:0/1425283415 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47bc06a740 con 0x7f47bc0f66c0 2021-11-03T16:53:04.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.884+0000 7f47c1188700 1 -- 172.21.15.26:0/1425283415 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47bc06ac50 con 0x7f47bc0f66c0 2021-11-03T16:53:04.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.885+0000 7f47c1188700 1 -- 172.21.15.26:0/1425283415 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47bc045ad0 con 0x7f47bc0f66c0 2021-11-03T16:53:04.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.886+0000 7f47a37fe700 1 -- 172.21.15.26:0/1425283415 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f47ac01c860 con 0x7f47bc0f66c0 2021-11-03T16:53:04.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.886+0000 7f47a37fe700 1 --2- 172.21.15.26:0/1425283415 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f47a405c2a0 0x7f47a405e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:53:04.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.886+0000 7f47a37fe700 1 -- 172.21.15.26:0/1425283415 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f47ac077d40 con 0x7f47bc0f66c0 2021-11-03T16:53:04.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.886+0000 7f47ba59c700 1 --2- 172.21.15.26:0/1425283415 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f47a405c2a0 0x7f47a405e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:53:04.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.887+0000 7f47ba59c700 1 --2- 172.21.15.26:0/1425283415 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f47a405c2a0 0x7f47a405e760 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f47b0004a70 tx=0x7f47b0009040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:53:04.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:04.891+0000 7f47a37fe700 1 -- 172.21.15.26:0/1425283415 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f47ac04aa20 con 0x7f47bc0f66c0 2021-11-03T16:53:05.294 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.297+0000 7f47c1188700 1 -- 172.21.15.26:0/1425283415 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f47bc0fef20 con 0x7f47bc0f66c0 2021-11-03T16:53:05.295 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.298+0000 7f47a37fe700 1 -- 172.21.15.26:0/1425283415 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+573 (secure 0 0 0) 0x7f47ac04e040 con 0x7f47bc0f66c0 2021-11-03T16:53:05.295 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T16:53:05.296 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T16:53:05.296 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2021-11-03T16:53:05.296 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:53:05.297 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T16:53:05.297 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2021-11-03T16:53:05.298 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:53:05.298 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T16:53:05.299 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2021-11-03T16:53:05.299 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:53:05.300 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T16:53:05.300 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T16:53:05.301 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:53:05.301 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T16:53:05.301 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 14 2021-11-03T16:53:05.302 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T16:53:05.302 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T16:53:05.303 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.299+0000 7f47c1188700 1 -- 172.21.15.26:0/1425283415 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f47a405c2a0 msgr2=0x7f47a405e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:53:05.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.300+0000 7f47c1188700 1 --2- 172.21.15.26:0/1425283415 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f47a405c2a0 0x7f47a405e760 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f47b0004a70 tx=0x7f47b0009040).stop 2021-11-03T16:53:05.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.300+0000 7f47c1188700 1 -- 172.21.15.26:0/1425283415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47bc0f66c0 msgr2=0x7f47bc06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:53:05.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.300+0000 7f47c1188700 1 --2- 172.21.15.26:0/1425283415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47bc0f66c0 0x7f47bc06b9a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f47ac000c00 tx=0x7f47ac009b30).stop 2021-11-03T16:53:05.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.300+0000 7f47c1188700 1 -- 172.21.15.26:0/1425283415 shutdown_connections 2021-11-03T16:53:05.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.300+0000 7f47c1188700 1 --2- 172.21.15.26:0/1425283415 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f47a405c2a0 0x7f47a405e760 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:05.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.300+0000 7f47c1188700 1 --2- 172.21.15.26:0/1425283415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47bc0f66c0 0x7f47bc06b9a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:05.307 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.300+0000 7f47c1188700 1 --2- 172.21.15.26:0/1425283415 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47bc0f7960 0x7f47bc069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:05.307 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.300+0000 7f47c1188700 1 -- 172.21.15.26:0/1425283415 >> 172.21.15.26:0/1425283415 conn(0x7f47bc0f1e20 msgr2=0x7f47bc0fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:53:05.307 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.300+0000 7f47c1188700 1 -- 172.21.15.26:0/1425283415 shutdown_connections 2021-11-03T16:53:05.308 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.300+0000 7f47c1188700 1 -- 172.21.15.26:0/1425283415 wait complete. 2021-11-03T16:53:05.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:05 smithi026 conmon[32119]: audit 2021-11-03T16:53: 2021-11-03T16:53:05.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:05 smithi026 conmon[32119]: 04.331940+0000 mgr.smithi026.cnrxli (mgr.14162) 252 : audit [DBG] from='client.14496 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:53:05.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.444+0000 7f84c365c700 1 -- 172.21.15.26:0/3528619993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84bc0f7b80 msgr2=0x7f84bc0f7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:53:05.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.444+0000 7f84c365c700 1 --2- 172.21.15.26:0/3528619993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84bc0f7b80 0x7f84bc0f7fe0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f84ac004660 tx=0x7f84ac009b30).stop 2021-11-03T16:53:05.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.445+0000 7f84c365c700 1 -- 172.21.15.26:0/3528619993 shutdown_connections 2021-11-03T16:53:05.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.445+0000 7f84c365c700 1 --2- 172.21.15.26:0/3528619993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84bc0f7b80 0x7f84bc0f7fe0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:05.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.445+0000 7f84c365c700 1 --2- 172.21.15.26:0/3528619993 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84bc0f68e0 0x7f84bc0f6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:05.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.445+0000 7f84c365c700 1 -- 172.21.15.26:0/3528619993 >> 172.21.15.26:0/3528619993 conn(0x7f84bc0f2020 msgr2=0x7f84bc0f4460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:53:05.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.445+0000 7f84c365c700 1 -- 172.21.15.26:0/3528619993 shutdown_connections 2021-11-03T16:53:05.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.445+0000 7f84c365c700 1 -- 172.21.15.26:0/3528619993 wait complete. 2021-11-03T16:53:05.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.446+0000 7f84c365c700 1 Processor -- start 2021-11-03T16:53:05.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.446+0000 7f84c365c700 1 -- start start 2021-11-03T16:53:05.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.446+0000 7f84c365c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84bc0f68e0 0x7f84bc1070f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:53:05.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.446+0000 7f84c365c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84bc0f7b80 0x7f84bc1075e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:53:05.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.446+0000 7f84c365c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc107b90 con 0x7f84bc0f68e0 2021-11-03T16:53:05.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.446+0000 7f84c365c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc107cd0 con 0x7f84bc0f7b80 2021-11-03T16:53:05.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.446+0000 7f84c13f8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84bc0f68e0 0x7f84bc1070f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:53:05.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.446+0000 7f84c13f8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84bc0f68e0 0x7f84bc1070f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50304/0 (socket says 172.21.15.26:50304) 2021-11-03T16:53:05.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.446+0000 7f84c13f8700 1 -- 172.21.15.26:0/332325340 learned_addr learned my addr 172.21.15.26:0/332325340 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:53:05.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.446+0000 7f84c0bf7700 1 --2- 172.21.15.26:0/332325340 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84bc0f7b80 0x7f84bc1075e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:53:05.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.446+0000 7f84c13f8700 1 -- 172.21.15.26:0/332325340 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84bc0f7b80 msgr2=0x7f84bc1075e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:53:05.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.446+0000 7f84c13f8700 1 --2- 172.21.15.26:0/332325340 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84bc0f7b80 0x7f84bc1075e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:05.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.446+0000 7f84c13f8700 1 -- 172.21.15.26:0/332325340 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b8005040 con 0x7f84bc0f68e0 2021-11-03T16:53:05.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.447+0000 7f84c13f8700 1 --2- 172.21.15.26:0/332325340 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84bc0f68e0 0x7f84bc1070f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f84b80048a0 tx=0x7f84b8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:53:05.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.447+0000 7f84b1ffb700 1 -- 172.21.15.26:0/332325340 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84b800e030 con 0x7f84bc0f68e0 2021-11-03T16:53:05.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.447+0000 7f84c365c700 1 -- 172.21.15.26:0/332325340 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84ac005040 con 0x7f84bc0f68e0 2021-11-03T16:53:05.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.447+0000 7f84b1ffb700 1 -- 172.21.15.26:0/332325340 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f84b800f040 con 0x7f84bc0f68e0 2021-11-03T16:53:05.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.447+0000 7f84b1ffb700 1 -- 172.21.15.26:0/332325340 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84b8014730 con 0x7f84bc0f68e0 2021-11-03T16:53:05.450 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.447+0000 7f84c365c700 1 -- 172.21.15.26:0/332325340 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84bc108aa0 con 0x7f84bc0f68e0 2021-11-03T16:53:05.450 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.448+0000 7f84c365c700 1 -- 172.21.15.26:0/332325340 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84bc045ad0 con 0x7f84bc0f68e0 2021-11-03T16:53:05.451 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.449+0000 7f84b1ffb700 1 -- 172.21.15.26:0/332325340 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f84b8010500 con 0x7f84bc0f68e0 2021-11-03T16:53:05.452 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.449+0000 7f84b1ffb700 1 --2- 172.21.15.26:0/332325340 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f84a805c2a0 0x7f84a805e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:53:05.452 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.450+0000 7f84c0bf7700 1 --2- 172.21.15.26:0/332325340 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f84a805c2a0 0x7f84a805e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:53:05.452 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.450+0000 7f84c0bf7700 1 --2- 172.21.15.26:0/332325340 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f84a805c2a0 0x7f84a805e760 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f84ac009720 tx=0x7f84ac016040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:53:05.452 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.454+0000 7f84b1ffb700 1 -- 172.21.15.26:0/332325340 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f84b804c4f0 con 0x7f84bc0f68e0 2021-11-03T16:53:05.452 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.455+0000 7f84b1ffb700 1 -- 172.21.15.26:0/332325340 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f84b807b060 con 0x7f84bc0f68e0 2021-11-03T16:53:05.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:05 smithi194 conmon[35111]: audit 2021-11-03T16:53:04.331940+0000 mgr.smithi026.cnrxli (mgr.14162) 252 : audit [DBG] from='client.14496 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:53:05.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.779+0000 7f84c365c700 1 -- 172.21.15.26:0/332325340 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f84bc0ff0a0 con 0x7f84bc0f68e0 2021-11-03T16:53:05.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.779+0000 7f84b1ffb700 1 -- 172.21.15.26:0/332325340 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 9 v9) v1 ==== 75+0+1618 (secure 0 0 0) 0x7f84b807b020 con 0x7f84bc0f68e0 2021-11-03T16:53:05.776 INFO:teuthology.orchestra.run.smithi026.stdout:e9 2021-11-03T16:53:05.777 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T16:53:05.777 INFO:teuthology.orchestra.run.smithi026.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T16:53:05.777 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T16:53:05.778 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:53:05.778 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T16:53:05.778 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T16:53:05.779 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 6 2021-11-03T16:53:05.779 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 2021-11-03T16:53:05.779 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T16:53:05.779 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:52:28.058778+0000 2021-11-03T16:53:05.780 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T16:53:05.780 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T16:53:05.780 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T16:53:05.780 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T16:53:05.780 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T16:53:05.781 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T16:53:05.781 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T16:53:05.781 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 0 2021-11-03T16:53:05.781 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T16:53:05.782 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T16:53:05.782 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T16:53:05.782 INFO:teuthology.orchestra.run.smithi026.stdout:up {0=14422} 2021-11-03T16:53:05.782 INFO:teuthology.orchestra.run.smithi026.stdout:failed 2021-11-03T16:53:05.782 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T16:53:05.783 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T16:53:05.783 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T16:53:05.783 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T16:53:05.783 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T16:53:05.784 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T16:53:05.784 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T16:53:05.784 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{0:14422} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.26:6826/665235785,v1:172.21.15.26:6827/665235785]] 2021-11-03T16:53:05.784 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:53:05.784 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:53:05.785 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T16:53:05.785 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:53:05.785 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14436} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.26:6828/3059137105,v1:172.21.15.26:6829/3059137105]] 2021-11-03T16:53:05.785 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921]] 2021-11-03T16:53:05.785 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844]] 2021-11-03T16:53:05.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.782+0000 7f84c365c700 1 -- 172.21.15.26:0/332325340 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f84a805c2a0 msgr2=0x7f84a805e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:53:05.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.782+0000 7f84c365c700 1 --2- 172.21.15.26:0/332325340 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f84a805c2a0 0x7f84a805e760 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f84ac009720 tx=0x7f84ac016040).stop 2021-11-03T16:53:05.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.782+0000 7f84c365c700 1 -- 172.21.15.26:0/332325340 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84bc0f68e0 msgr2=0x7f84bc1070f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:53:05.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.782+0000 7f84c365c700 1 --2- 172.21.15.26:0/332325340 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84bc0f68e0 0x7f84bc1070f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f84b80048a0 tx=0x7f84b8009b30).stop 2021-11-03T16:53:05.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.782+0000 7f84c365c700 1 -- 172.21.15.26:0/332325340 shutdown_connections 2021-11-03T16:53:05.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.782+0000 7f84c365c700 1 --2- 172.21.15.26:0/332325340 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f84a805c2a0 0x7f84a805e760 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:05.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.782+0000 7f84c365c700 1 --2- 172.21.15.26:0/332325340 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84bc0f68e0 0x7f84bc1070f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:05.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.782+0000 7f84c365c700 1 --2- 172.21.15.26:0/332325340 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84bc0f7b80 0x7f84bc1075e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:05.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.782+0000 7f84c365c700 1 -- 172.21.15.26:0/332325340 >> 172.21.15.26:0/332325340 conn(0x7f84bc0f2020 msgr2=0x7f84bc0fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:53:05.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.783+0000 7f84c365c700 1 -- 172.21.15.26:0/332325340 shutdown_connections 2021-11-03T16:53:05.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:05.783+0000 7f84c365c700 1 -- 172.21.15.26:0/332325340 wait complete. 2021-11-03T16:53:05.789 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 9 2021-11-03T16:53:06.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:06 smithi026 conmon[32119]: audit 2021-11-03T16:53:04 2021-11-03T16:53:06.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:06 smithi026 conmon[32119]: .746135+0000 mgr.smithi026.cnrxli (mgr.14162) 253 : audit [DBG] from='client.14500 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:53:06.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:06 smithi026 conmon[32119]: cluster 2021-11-03T16:53:06.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:06 smithi026 conmon[32119]: 2021-11-03T 2021-11-03T16:53:06.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:06 smithi026 conmon[32119]: 16:53:05.052413+0000 mgr.smithi026.cnrxli (mgr.14162) 254 : cluster [DBG] pgmap v209: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2021-11-03T16:53:06.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:06 smithi026 conmon[32119]: 2021-11-03T16:53:06.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:06 smithi026 conmon[32119]: audit 2021-11- 2021-11-03T16:53:06.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:06 smithi026 conmon[32119]: 03T16:53:05.299587+0000 mon.smithi026 (mon.0 2021-11-03T16:53:06.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:06 smithi026 conmon[32119]: ) 546 : audit [DBG] from='client.? 172.21.15.26:0/1425283415' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:53:06.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:06 smithi026 conmon[32119]: audit 2021-11-03T16:53:06.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:06 smithi026 conmon[32119]: 2021-11-03T16:53:05.781220+0000 2021-11-03T16:53:06.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:06 smithi026 conmon[32119]: mon.smithi026 (mon.0) 547 : audit [DBG] from='client.? 172.21.15.26:0/332325340' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T16:53:06.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:06 smithi026 conmon[32119]: 2021-11-03T16:53:06.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:06 smithi194 conmon[35111]: audit 2021-11-03T16:53:04.746135+0000 mgr.smithi026.cnrxli (mgr.14162) 253 : audit 2021-11-03T16:53:06.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:06 smithi194 conmon[35111]: [DBG] from='client.14500 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:53:06.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:06 smithi194 conmon[35111]: cluster 2021-11-03T16:53:05.052413+0000 mgr.smithi026.cnrxli (mgr.14162) 254 : cluster [DBG] pgmap v209: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2021-11-03T16:53:06.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:06 smithi194 conmon[35111]: audit 2021-11-03T16:53:05.299587+0000 mon.smithi026 (mon.0) 546 : audit 2021-11-03T16:53:06.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:06 smithi194 conmon[35111]: [DBG] from='client.? 172.21.15.26:0/1425283415' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:53:06.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:06 smithi194 conmon[35111]: audit 2021-11-03T16:53:05.781220+0000 mon.smithi026 2021-11-03T16:53:06.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:06 smithi194 conmon[35111]: (mon.0) 547 : audit [DBG] from='client.? 172.21.15.26:0/332325340' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T16:53:08.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:08 smithi026 conmon[32119]: cluster 2021-11-03T16:53:07.052834+0000 2021-11-03T16:53:08.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:08 smithi026 conmon[32119]: mgr.smithi026.cnrxli (mgr.14162) 255 : cluster [DBG] pgmap v210: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2021-11-03T16:53:08.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:08 smithi194 conmon[35111]: cluster 2021-11-03T16:53:07.052834+0000 mgr.smithi026.cnrxli (mgr.14162) 255 : cluster 2021-11-03T16:53:08.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:08 smithi194 conmon[35111]: [DBG] pgmap v210: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2021-11-03T16:53:10.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:10 smithi026 conmon[32119]: cluster 2021-11-03T16:53:09.053321+0000 2021-11-03T16:53:10.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:10 smithi026 conmon[32119]: mgr.smithi026.cnrxli (mgr.14162) 256 : cluster [DBG] pgmap v211: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2021-11-03T16:53:10.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:10 smithi026 conmon[32119]: audit 2021-11-03T 2021-11-03T16:53:10.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:10 smithi026 conmon[32119]: 16:53:09.184596+0000 mon.smithi026 (mon.0) 548 : audit [INF] 2021-11-03T16:53:10.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:10 smithi026 conmon[32119]: from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T16:53:10.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:10 smithi026 conmon[32119]: audit 2021 2021-11-03T16:53:10.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:10 smithi026 conmon[32119]: -11-03T16:53:09.184899+0000 2021-11-03T16:53:10.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:10 smithi026 conmon[32119]: mon.smithi026 (mon.0) 549 : audit 2021-11-03T16:53:10.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:10 smithi026 conmon[32119]: [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T16:53:10.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:10 smithi194 conmon[35111]: cluster 2021-11-03T16:53:09.053321+0000 mgr.smithi026.cnrxli (mgr.14162) 256 : 2021-11-03T16:53:10.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:10 smithi194 conmon[35111]: cluster [DBG] pgmap v211: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2021-11-03T16:53:10.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:10 smithi194 conmon[35111]: audit 2021-11-03T16:53:09.184596+0000 mon.smithi026 (mon.0) 548 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T16:53:10.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:10 smithi194 conmon[35111]: audit 2021-11-03T16:53:09.184899+0000 mon.smithi026 (mon 2021-11-03T16:53:10.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:10 smithi194 conmon[35111]: .0) 549 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T16:53:12.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:12 smithi026 conmon[32119]: cluster 2021-11-03T16:53:11.053821+0000 mgr.smithi026.cnrxli ( 2021-11-03T16:53:12.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:12 smithi026 conmon[32119]: mgr.14162) 257 : cluster [DBG] pgmap v212: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:53:12.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:12 smithi194 conmon[35111]: cluster 2021-11-03T16:53:11. 2021-11-03T16:53:12.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:12 smithi194 conmon[35111]: 053821+0000 mgr.smithi026.cnrxli (mgr.14162) 257 : cluster [DBG] pgmap v212: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:53:14.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:14 smithi026 conmon[32119]: cluster 2021-11-03T16:53:13 2021-11-03T16:53:14.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:14 smithi026 conmon[32119]: .054252+0000 mgr.smithi026.cnrxli (mgr.14162) 258 : cluster [DBG] pgmap v213: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:53:14.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:14 smithi194 conmon[35111]: cluster 2021-11-03T16:53:13. 2021-11-03T16:53:14.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:14 smithi194 conmon[35111]: 054252+0000 mgr.smithi026.cnrxli (mgr.14162) 258 : cluster [DBG] pgmap v213: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:53:16.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:16 smithi026 conmon[32119]: cluster 2021-11-03T16:53:15.054639+0000 2021-11-03T16:53:16.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:16 smithi026 conmon[32119]: mgr.smithi026.cnrxli (mgr.14162) 259 : cluster [DBG] pgmap v214: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:53:16.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:16 smithi194 conmon[35111]: cluster 2021-11-03T16:53:15.054639+0000 mgr.smithi026.cnrxli (mgr.14162) 2021-11-03T16:53:16.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:16 smithi194 conmon[35111]: 259 : cluster [DBG] pgmap v214: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:53:18.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:18 smithi026 conmon[32119]: cluster 2021-11-03T16:53:17. 2021-11-03T16:53:18.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:18 smithi026 conmon[32119]: 055071+0000 mgr.smithi026.cnrxli (mgr.14162) 260 : cluster [DBG] pgmap v215: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:53:18.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:18 smithi194 conmon[35111]: cluster 2021-11-03T16:53:17.055071 2021-11-03T16:53:18.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:18 smithi194 conmon[35111]: +0000 mgr.smithi026.cnrxli (mgr.14162) 260 : cluster [DBG] pgmap v215: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:53:20.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:20 smithi026 conmon[32119]: cluster 2021-11-03T16:53:19.055466+0000 mgr.smithi026.cnrxli (mgr.14162) 261 : cluster [DBG] pgmap v216: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:53:20.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:20 smithi026 conmon[32119]: 2021-11-03T16:53:20.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:20 smithi194 conmon[35111]: cluster 2021-11-03T16:53:19.055466+0000 mgr.smithi026.cnrxli (mgr.14162) 261 : cluster [DBG] pgmap v216: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:53:22.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:22 smithi026 conmon[32119]: cluster 2021-11-03T16:53:21.056097 2021-11-03T16:53:22.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:22 smithi026 conmon[32119]: +0000 mgr.smithi026.cnrxli (mgr.14162) 262 : cluster [DBG] pgmap v217: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:53:22.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:22 smithi194 conmon[35111]: cluster 2021-11-03T16:53:21.056097+0000 2021-11-03T16:53:22.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:22 smithi194 conmon[35111]: mgr.smithi026.cnrxli (mgr.14162) 262 : cluster [DBG] pgmap v217: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:53:24.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:24 smithi026 conmon[32119]: cluster 2021-11-03T16:53:23.056601+0000 mgr.smithi026.cnrxli (mgr.14162) 263 : cluster [DBG] pgmap v218: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:53:24.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:24 smithi194 conmon[35111]: cluster 2021-11-03T16:53:23.056601+0000 mgr.smithi026.cnrxli 2021-11-03T16:53:24.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:24 smithi194 conmon[35111]: (mgr.14162) 263 : cluster [DBG] pgmap v218: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:53:26.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:26 smithi026 conmon[32119]: cluster 2021-11-03T16:53:25.057040+0000 mgr.smithi026.cnrxli (mgr.14162) 264 : cluster [DBG] pgmap v219: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:53:26.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:26 smithi194 conmon[35111]: cluster 2021-11-03T16:53:25.057040+0000 2021-11-03T16:53:26.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:26 smithi194 conmon[35111]: mgr.smithi026.cnrxli (mgr.14162) 264 : cluster [DBG] pgmap v219: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:53:28.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:28 smithi026 conmon[32119]: cluster 2021-11-03T16:53:27.057528+0000 mgr.smithi026.cnrxli (mgr. 2021-11-03T16:53:28.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:28 smithi026 conmon[32119]: 14162) 265 : cluster [DBG] pgmap v220: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:53:28.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:28 smithi194 conmon[35111]: cluster 2021-11-03T16:53:27.057528+0000 2021-11-03T16:53:28.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:28 smithi194 conmon[35111]: mgr.smithi026.cnrxli (mgr.14162) 265 : cluster [DBG] pgmap v220: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail 2021-11-03T16:53:30.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:30 smithi026 conmon[32119]: cluster 2021-11-03T16:53:29.058015+0000 2021-11-03T16:53:30.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:30 smithi026 conmon[32119]: mgr.smithi026.cnrxli (mgr.14162) 266 : cluster [DBG] pgmap v221: 65 pgs: 65 active+clean; 11 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2021-11-03T16:53:30.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:30 smithi194 conmon[35111]: cluster 2021-11-03T16:53:29.058015+0000 2021-11-03T16:53:30.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:30 smithi194 conmon[35111]: mgr.smithi026.cnrxli (mgr.14162) 266 : cluster [DBG] pgmap v221: 65 pgs: 65 active+clean; 11 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2021-11-03T16:53:32.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:32 smithi026 conmon[32119]: cluster 2021-11-03T16:53:31.058451+0000 2021-11-03T16:53:32.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:32 smithi026 conmon[32119]: mgr.smithi026.cnrxli (mgr.14162) 267 : cluster [DBG] pgmap v222: 65 pgs: 65 active+clean; 11 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2021-11-03T16:53:32.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:32 smithi194 conmon[35111]: cluster 2021-11-03T16:53:31.058451+0000 mgr.smithi026.cnrxli (mgr.14162) 267 : cluster [DBG] pgmap v222: 65 pgs: 65 active+clean; 11 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2021-11-03T16:53:33.962 INFO:tasks.workunit.client.1.smithi194.stderr:Note: switching to '6e90212d8510e2d506395a8c82057d0d1787f3a4'. 2021-11-03T16:53:33.962 INFO:tasks.workunit.client.1.smithi194.stderr: 2021-11-03T16:53:33.963 INFO:tasks.workunit.client.1.smithi194.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2021-11-03T16:53:33.964 INFO:tasks.workunit.client.1.smithi194.stderr:changes and commit them, and you can discard any commits you make in this 2021-11-03T16:53:33.964 INFO:tasks.workunit.client.1.smithi194.stderr:state without impacting any branches by switching back to a branch. 2021-11-03T16:53:33.964 INFO:tasks.workunit.client.1.smithi194.stderr: 2021-11-03T16:53:33.965 INFO:tasks.workunit.client.1.smithi194.stderr:If you want to create a new branch to retain commits you create, you may 2021-11-03T16:53:33.965 INFO:tasks.workunit.client.1.smithi194.stderr:do so (now or later) by using -c with the switch command. Example: 2021-11-03T16:53:33.965 INFO:tasks.workunit.client.1.smithi194.stderr: 2021-11-03T16:53:33.965 INFO:tasks.workunit.client.1.smithi194.stderr: git switch -c 2021-11-03T16:53:33.965 INFO:tasks.workunit.client.1.smithi194.stderr: 2021-11-03T16:53:33.966 INFO:tasks.workunit.client.1.smithi194.stderr:Or undo this operation with: 2021-11-03T16:53:33.966 INFO:tasks.workunit.client.1.smithi194.stderr: 2021-11-03T16:53:33.966 INFO:tasks.workunit.client.1.smithi194.stderr: git switch - 2021-11-03T16:53:33.966 INFO:tasks.workunit.client.1.smithi194.stderr: 2021-11-03T16:53:33.967 INFO:tasks.workunit.client.1.smithi194.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2021-11-03T16:53:33.967 INFO:tasks.workunit.client.1.smithi194.stderr: 2021-11-03T16:53:33.967 INFO:tasks.workunit.client.1.smithi194.stderr:HEAD is now at 6e90212d851 Merge branch 'test-container-tools-3.1' of https://github.com/liewegas/ceph into wip-sage-testing-2021-11-03-1039 2021-11-03T16:53:33.968 DEBUG:teuthology.orchestra.run.smithi194:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2021-11-03T16:53:34.028 INFO:tasks.workunit.client.1.smithi194.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2021-11-03T16:53:34.030 INFO:tasks.workunit.client.1.smithi194.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2021-11-03T16:53:34.030 INFO:tasks.workunit.client.1.smithi194.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2021-11-03T16:53:34.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:34 smithi026 conmon[32119]: cluster 2021-11-03T16:53:33.058916+0000 mgr.smithi026.cnrxli (mgr.14162) 268 : cluster [DBG] pgmap v223: 65 pgs: 65 active+clean; 11 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2021-11-03T16:53:34.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:34 smithi194 conmon[35111]: cluster 2021-11-03T16:53:33.058916+0000 mgr.smithi026.cnrxli (mgr.14162) 268 : cluster 2021-11-03T16:53:34.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:34 smithi194 conmon[35111]: [DBG] pgmap v223: 65 pgs: 65 active+clean; 11 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2021-11-03T16:53:34.536 INFO:tasks.workunit.client.1.smithi194.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2021-11-03T16:53:34.594 INFO:tasks.workunit.client.1.smithi194.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2021-11-03T16:53:34.631 INFO:tasks.workunit.client.1.smithi194.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2021-11-03T16:53:34.632 INFO:tasks.workunit.client.1.smithi194.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2021-11-03T16:53:34.633 INFO:tasks.workunit.client.1.smithi194.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2021-11-03T16:53:34.668 INFO:tasks.workunit.client.1.smithi194.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2021-11-03T16:53:34.671 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2021-11-03T16:53:34.671 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2021-11-03T16:53:34.726 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2021-11-03T16:53:34.728 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2021-11-03T16:53:34.728 DEBUG:teuthology.orchestra.run.smithi194:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6e90212d8510e2d506395a8c82057d0d1787f3a4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2021-11-03T16:53:34.787 INFO:tasks.workunit.client.1.smithi194.stderr:+ mkdir -p fsstress 2021-11-03T16:53:34.790 INFO:tasks.workunit.client.1.smithi194.stderr:+ pushd fsstress 2021-11-03T16:53:34.790 INFO:tasks.workunit.client.1.smithi194.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2021-11-03T16:53:34.791 INFO:tasks.workunit.client.1.smithi194.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2021-11-03T16:53:35.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:35.893+0000 7fa33192b700 1 -- 172.21.15.26:0/2627102640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa32c0f5e60 msgr2=0x7fa32c0f62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:53:35.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:35.893+0000 7fa33192b700 1 --2- 172.21.15.26:0/2627102640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa32c0f5e60 0x7fa32c0f62c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fa318004660 tx=0x7fa318009b30).stop 2021-11-03T16:53:35.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:35.893+0000 7fa33192b700 1 -- 172.21.15.26:0/2627102640 shutdown_connections 2021-11-03T16:53:35.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:35.893+0000 7fa33192b700 1 --2- 172.21.15.26:0/2627102640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa32c0f5e60 0x7fa32c0f62c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:35.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:35.893+0000 7fa33192b700 1 --2- 172.21.15.26:0/2627102640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa32c0f4bc0 0x7fa32c0f4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:35.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:35.893+0000 7fa33192b700 1 -- 172.21.15.26:0/2627102640 >> 172.21.15.26:0/2627102640 conn(0x7fa32c0f0320 msgr2=0x7fa32c0f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:53:35.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:35.893+0000 7fa33192b700 1 -- 172.21.15.26:0/2627102640 shutdown_connections 2021-11-03T16:53:35.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:35.893+0000 7fa33192b700 1 -- 172.21.15.26:0/2627102640 wait complete. 2021-11-03T16:53:35.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:35.893+0000 7fa33192b700 1 Processor -- start 2021-11-03T16:53:35.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:35.894+0000 7fa33192b700 1 -- start start 2021-11-03T16:53:35.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:35.894+0000 7fa33192b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa32c0f4bc0 0x7fa32c104c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:53:35.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:35.894+0000 7fa33192b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa32c0f5e60 0x7fa32c105170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:53:35.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:35.894+0000 7fa33192b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c105770 con 0x7fa32c0f5e60 2021-11-03T16:53:35.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:35.894+0000 7fa33192b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c1058b0 con 0x7fa32c0f4bc0 2021-11-03T16:53:35.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:35.894+0000 7fa32bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa32c0f5e60 0x7fa32c105170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:53:35.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:35.894+0000 7fa32bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa32c0f5e60 0x7fa32c105170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50316/0 (socket says 172.21.15.26:50316) 2021-11-03T16:53:35.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:35.894+0000 7fa32bfff700 1 -- 172.21.15.26:0/2487103634 learned_addr learned my addr 172.21.15.26:0/2487103634 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:53:35.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:35.894+0000 7fa330929700 1 --2- 172.21.15.26:0/2487103634 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa32c0f4bc0 0x7fa32c104c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:53:35.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:35.894+0000 7fa32bfff700 1 -- 172.21.15.26:0/2487103634 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa32c0f4bc0 msgr2=0x7fa32c104c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:53:35.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:35.894+0000 7fa32bfff700 1 --2- 172.21.15.26:0/2487103634 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa32c0f4bc0 0x7fa32c104c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:35.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:35.894+0000 7fa32bfff700 1 -- 172.21.15.26:0/2487103634 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa318005040 con 0x7fa32c0f5e60 2021-11-03T16:53:35.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:35.895+0000 7fa32bfff700 1 --2- 172.21.15.26:0/2487103634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa32c0f5e60 0x7fa32c105170 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fa318009990 tx=0x7fa318009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:53:35.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:35.895+0000 7fa3297fa700 1 -- 172.21.15.26:0/2487103634 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa318018070 con 0x7fa32c0f5e60 2021-11-03T16:53:35.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:35.895+0000 7fa3297fa700 1 -- 172.21.15.26:0/2487103634 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa318007ba0 con 0x7fa32c0f5e60 2021-11-03T16:53:35.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:35.895+0000 7fa33192b700 1 -- 172.21.15.26:0/2487103634 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa32c1061c0 con 0x7fa32c0f5e60 2021-11-03T16:53:35.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:35.895+0000 7fa3297fa700 1 -- 172.21.15.26:0/2487103634 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa31801c620 con 0x7fa32c0f5e60 2021-11-03T16:53:35.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:35.895+0000 7fa33192b700 1 -- 172.21.15.26:0/2487103634 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa32c1066a0 con 0x7fa32c0f5e60 2021-11-03T16:53:35.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:35.896+0000 7fa33192b700 1 -- 172.21.15.26:0/2487103634 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa32c045ad0 con 0x7fa32c0f5e60 2021-11-03T16:53:35.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:35.897+0000 7fa3297fa700 1 -- 172.21.15.26:0/2487103634 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fa31801c890 con 0x7fa32c0f5e60 2021-11-03T16:53:35.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:35.897+0000 7fa3297fa700 1 --2- 172.21.15.26:0/2487103634 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fa31c05c300 0x7fa31c05e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:53:35.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:35.897+0000 7fa3297fa700 1 -- 172.21.15.26:0/2487103634 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fa318077c20 con 0x7fa32c0f5e60 2021-11-03T16:53:35.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:35.898+0000 7fa330929700 1 --2- 172.21.15.26:0/2487103634 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fa31c05c300 0x7fa31c05e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:53:35.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:35.898+0000 7fa330929700 1 --2- 172.21.15.26:0/2487103634 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fa31c05c300 0x7fa31c05e7c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fa32c104a10 tx=0x7fa320009040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:53:35.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:35.905+0000 7fa3297fa700 1 -- 172.21.15.26:0/2487103634 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fa31804a980 con 0x7fa32c0f5e60 2021-11-03T16:53:36.097 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.102+0000 7fa33192b700 1 -- 172.21.15.26:0/2487103634 --> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa32c0fd490 con 0x7fa31c05c300 2021-11-03T16:53:36.098 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.103+0000 7fa3297fa700 1 -- 172.21.15.26:0/2487103634 <== mgr.14162 v2:172.21.15.26:6800/3029163595 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+278 (secure 0 0 0) 0x7fa32c0fd490 con 0x7fa31c05c300 2021-11-03T16:53:36.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.105+0000 7fa33192b700 1 -- 172.21.15.26:0/2487103634 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fa31c05c300 msgr2=0x7fa31c05e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:53:36.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.105+0000 7fa33192b700 1 --2- 172.21.15.26:0/2487103634 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fa31c05c300 0x7fa31c05e7c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fa32c104a10 tx=0x7fa320009040).stop 2021-11-03T16:53:36.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.105+0000 7fa33192b700 1 -- 172.21.15.26:0/2487103634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa32c0f5e60 msgr2=0x7fa32c105170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:53:36.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.105+0000 7fa33192b700 1 --2- 172.21.15.26:0/2487103634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa32c0f5e60 0x7fa32c105170 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fa318009990 tx=0x7fa318009b30).stop 2021-11-03T16:53:36.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.105+0000 7fa33192b700 1 -- 172.21.15.26:0/2487103634 shutdown_connections 2021-11-03T16:53:36.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.105+0000 7fa33192b700 1 --2- 172.21.15.26:0/2487103634 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fa31c05c300 0x7fa31c05e7c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:36.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.105+0000 7fa33192b700 1 --2- 172.21.15.26:0/2487103634 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa32c0f4bc0 0x7fa32c104c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:36.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.105+0000 7fa33192b700 1 --2- 172.21.15.26:0/2487103634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa32c0f5e60 0x7fa32c105170 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:36.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.105+0000 7fa33192b700 1 -- 172.21.15.26:0/2487103634 >> 172.21.15.26:0/2487103634 conn(0x7fa32c0f0320 msgr2=0x7fa32c0f2610 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:53:36.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.105+0000 7fa33192b700 1 -- 172.21.15.26:0/2487103634 shutdown_connections 2021-11-03T16:53:36.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.105+0000 7fa33192b700 1 -- 172.21.15.26:0/2487103634 wait complete. 2021-11-03T16:53:36.111 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T16:53:36.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.208+0000 7fce1f59e700 1 -- 172.21.15.26:0/3535880601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce200f8540 msgr2=0x7fce200f46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:53:36.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.208+0000 7fce1f59e700 1 --2- 172.21.15.26:0/3535880601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce200f8540 0x7fce200f46c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fce14004660 tx=0x7fce14009b30).stop 2021-11-03T16:53:36.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.208+0000 7fce1f59e700 1 -- 172.21.15.26:0/3535880601 shutdown_connections 2021-11-03T16:53:36.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.208+0000 7fce1f59e700 1 --2- 172.21.15.26:0/3535880601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce200f8540 0x7fce200f46c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:36.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.208+0000 7fce1f59e700 1 --2- 172.21.15.26:0/3535880601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce200f7ba0 0x7fce200f7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:36.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.208+0000 7fce1f59e700 1 -- 172.21.15.26:0/3535880601 >> 172.21.15.26:0/3535880601 conn(0x7fce200f0320 msgr2=0x7fce200f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:53:36.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.208+0000 7fce1f59e700 1 -- 172.21.15.26:0/3535880601 shutdown_connections 2021-11-03T16:53:36.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.208+0000 7fce1f59e700 1 -- 172.21.15.26:0/3535880601 wait complete. 2021-11-03T16:53:36.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.209+0000 7fce1f59e700 1 Processor -- start 2021-11-03T16:53:36.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.209+0000 7fce1f59e700 1 -- start start 2021-11-03T16:53:36.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.209+0000 7fce1f59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce200f7ba0 0x7fce200f7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:53:36.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.209+0000 7fce1f59e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce200f8540 0x7fce200f58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:53:36.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.209+0000 7fce1f59e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce200f5e50 con 0x7fce200f7ba0 2021-11-03T16:53:36.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.209+0000 7fce1f59e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce200f5f90 con 0x7fce200f8540 2021-11-03T16:53:36.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.209+0000 7fce1e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce200f7ba0 0x7fce200f7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:53:36.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.209+0000 7fce1e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce200f7ba0 0x7fce200f7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50322/0 (socket says 172.21.15.26:50322) 2021-11-03T16:53:36.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.209+0000 7fce1e59c700 1 -- 172.21.15.26:0/1539595781 learned_addr learned my addr 172.21.15.26:0/1539595781 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:53:36.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.210+0000 7fce1dd9b700 1 --2- 172.21.15.26:0/1539595781 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce200f8540 0x7fce200f58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:53:36.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.210+0000 7fce1e59c700 1 -- 172.21.15.26:0/1539595781 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce200f8540 msgr2=0x7fce200f58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:53:36.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.210+0000 7fce1e59c700 1 --2- 172.21.15.26:0/1539595781 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce200f8540 0x7fce200f58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:36.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.210+0000 7fce1e59c700 1 -- 172.21.15.26:0/1539595781 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce14005040 con 0x7fce200f7ba0 2021-11-03T16:53:36.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.210+0000 7fce1e59c700 1 --2- 172.21.15.26:0/1539595781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce200f7ba0 0x7fce200f7470 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7fce10002700 tx=0x7fce10009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:53:36.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.210+0000 7fce0effd700 1 -- 172.21.15.26:0/1539595781 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce10009320 con 0x7fce200f7ba0 2021-11-03T16:53:36.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.210+0000 7fce1f59e700 1 -- 172.21.15.26:0/1539595781 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce200f6270 con 0x7fce200f7ba0 2021-11-03T16:53:36.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.210+0000 7fce0effd700 1 -- 172.21.15.26:0/1539595781 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fce1000f040 con 0x7fce200f7ba0 2021-11-03T16:53:36.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.210+0000 7fce0effd700 1 -- 172.21.15.26:0/1539595781 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce10014900 con 0x7fce200f7ba0 2021-11-03T16:53:36.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.210+0000 7fce1f59e700 1 -- 172.21.15.26:0/1539595781 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce2010ed80 con 0x7fce200f7ba0 2021-11-03T16:53:36.213 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.211+0000 7fce1f59e700 1 -- 172.21.15.26:0/1539595781 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce20045ad0 con 0x7fce200f7ba0 2021-11-03T16:53:36.213 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.213+0000 7fce0effd700 1 -- 172.21.15.26:0/1539595781 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fce10009480 con 0x7fce200f7ba0 2021-11-03T16:53:36.213 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.213+0000 7fce0effd700 1 --2- 172.21.15.26:0/1539595781 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fce0805c300 0x7fce0805e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:53:36.214 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.213+0000 7fce0effd700 1 -- 172.21.15.26:0/1539595781 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fce10076460 con 0x7fce200f7ba0 2021-11-03T16:53:36.214 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.213+0000 7fce1dd9b700 1 --2- 172.21.15.26:0/1539595781 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fce0805c300 0x7fce0805e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:53:36.214 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.214+0000 7fce1dd9b700 1 --2- 172.21.15.26:0/1539595781 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fce0805c300 0x7fce0805e7c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fce14004630 tx=0x7fce14009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:53:36.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.216+0000 7fce0effd700 1 -- 172.21.15.26:0/1539595781 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fce100491c0 con 0x7fce200f7ba0 2021-11-03T16:53:36.399 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.404+0000 7fce1f59e700 1 -- 172.21.15.26:0/1539595781 --> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fce200feec0 con 0x7fce0805c300 2021-11-03T16:53:36.411 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.416+0000 7fce0effd700 1 -- 172.21.15.26:0/1539595781 <== mgr.14162 v2:172.21.15.26:6800/3029163595 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2684 (secure 0 0 0) 0x7fce14019040 con 0x7fce0805c300 2021-11-03T16:53:36.412 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE VERSION IMAGE ID CONTAINER ID 2021-11-03T16:53:36.412 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (4m) 54s ago 6m 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T16:53:36.412 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (6m) 54s ago 6m 16.2.4 8d91d370c2b8 83a448d79108 2021-11-03T16:53:36.413 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (5m) 57s ago 5m 16.2.4 8d91d370c2b8 708c0ec0397b 2021-11-03T16:53:36.413 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (4m) 54s ago 5m 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T16:53:36.413 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (74s) 54s ago 73s 16.2.4 8d91d370c2b8 0500d47c638e 2021-11-03T16:53:36.413 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (67s) 54s ago 66s 16.2.4 8d91d370c2b8 638170268dac 2021-11-03T16:53:36.413 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (77s) 57s ago 76s 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T16:53:36.414 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (71s) 57s ago 70s 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T16:53:36.414 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:9283 running (7m) 54s ago 7m 16.2.4 8d91d370c2b8 65362b14caeb 2021-11-03T16:53:36.414 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8443,9283 running (5m) 57s ago 5m 16.2.4 8d91d370c2b8 e07291aea712 2021-11-03T16:53:36.414 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (7m) 54s ago 7m 16.2.4 8d91d370c2b8 c37e54308890 2021-11-03T16:53:36.415 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (5m) 57s ago 5m 16.2.4 8d91d370c2b8 b688a2953f0a 2021-11-03T16:53:36.415 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (5m) 54s ago 5m 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T16:53:36.415 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (5m) 57s ago 5m 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T16:53:36.416 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (4m) 54s ago 4m 16.2.4 8d91d370c2b8 d7f900ddf0f3 2021-11-03T16:53:36.416 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (4m) 54s ago 4m 16.2.4 8d91d370c2b8 9e5ffa11984b 2021-11-03T16:53:36.416 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (3m) 54s ago 3m 16.2.4 8d91d370c2b8 f65145633c0e 2021-11-03T16:53:36.416 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (3m) 57s ago 3m 16.2.4 8d91d370c2b8 ff6d474a5f9a 2021-11-03T16:53:36.417 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (3m) 57s ago 3m 16.2.4 8d91d370c2b8 e2fc9c0bdf0f 2021-11-03T16:53:36.417 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (2m) 57s ago 2m 16.2.4 8d91d370c2b8 0abc64d8a2bf 2021-11-03T16:53:36.417 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (4m) 54s ago 5m 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T16:53:36.418 INFO:tasks.workunit.client.1.smithi194.stderr:+ tar xzf ltp-full.tgz 2021-11-03T16:53:36.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.418+0000 7fce1f59e700 1 -- 172.21.15.26:0/1539595781 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fce0805c300 msgr2=0x7fce0805e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:53:36.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.418+0000 7fce1f59e700 1 --2- 172.21.15.26:0/1539595781 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fce0805c300 0x7fce0805e7c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fce14004630 tx=0x7fce14009b30).stop 2021-11-03T16:53:36.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.418+0000 7fce1f59e700 1 -- 172.21.15.26:0/1539595781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce200f7ba0 msgr2=0x7fce200f7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:53:36.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.418+0000 7fce1f59e700 1 --2- 172.21.15.26:0/1539595781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce200f7ba0 0x7fce200f7470 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7fce10002700 tx=0x7fce10009d80).stop 2021-11-03T16:53:36.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.418+0000 7fce1f59e700 1 -- 172.21.15.26:0/1539595781 shutdown_connections 2021-11-03T16:53:36.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.418+0000 7fce1f59e700 1 --2- 172.21.15.26:0/1539595781 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fce0805c300 0x7fce0805e7c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:36.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.418+0000 7fce1f59e700 1 --2- 172.21.15.26:0/1539595781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce200f7ba0 0x7fce200f7470 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:36.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.418+0000 7fce1f59e700 1 --2- 172.21.15.26:0/1539595781 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce200f8540 0x7fce200f58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:36.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.418+0000 7fce1f59e700 1 -- 172.21.15.26:0/1539595781 >> 172.21.15.26:0/1539595781 conn(0x7fce200f0320 msgr2=0x7fce200fb430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:53:36.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.418+0000 7fce1f59e700 1 -- 172.21.15.26:0/1539595781 shutdown_connections 2021-11-03T16:53:36.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.418+0000 7fce1f59e700 1 -- 172.21.15.26:0/1539595781 wait complete. 2021-11-03T16:53:36.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:36 smithi026 conmon[32119]: cluster 2021- 2021-11-03T16:53:36.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:36 smithi026 conmon[32119]: 11-03T16:53:35.059352+0000 mgr.smithi026.cnrxli (mgr.14162) 269 : cluster [DBG] pgmap v224: 65 pgs: 65 active+clean; 11 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2021-11-03T16:53:36.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:36 smithi194 conmon[35111]: cluster 2021-11-03T16:53:35.059352+0000 mgr.smithi026.cnrxli (mgr.14162) 269 : cluster [DBG] 2021-11-03T16:53:36.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:36 smithi194 conmon[35111]: pgmap v224: 65 pgs: 65 active+clean; 11 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2021-11-03T16:53:36.524 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.529+0000 7f6475953700 1 -- 172.21.15.26:0/4254369343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64700f6700 msgr2=0x7f64700f6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:53:36.525 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.529+0000 7f6475953700 1 --2- 172.21.15.26:0/4254369343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64700f6700 0x7f64700f6b60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f6464004660 tx=0x7f6464009b30).stop 2021-11-03T16:53:36.525 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.529+0000 7f6475953700 1 -- 172.21.15.26:0/4254369343 shutdown_connections 2021-11-03T16:53:36.525 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.529+0000 7f6475953700 1 --2- 172.21.15.26:0/4254369343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64700f6700 0x7f64700f6b60 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:36.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.529+0000 7f6475953700 1 --2- 172.21.15.26:0/4254369343 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64700f5460 0x7f64700f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:36.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.529+0000 7f6475953700 1 -- 172.21.15.26:0/4254369343 >> 172.21.15.26:0/4254369343 conn(0x7f64700f0bc0 msgr2=0x7f64700f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:53:36.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.529+0000 7f6475953700 1 -- 172.21.15.26:0/4254369343 shutdown_connections 2021-11-03T16:53:36.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.529+0000 7f6475953700 1 -- 172.21.15.26:0/4254369343 wait complete. 2021-11-03T16:53:36.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.530+0000 7f6475953700 1 Processor -- start 2021-11-03T16:53:36.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.530+0000 7f6475953700 1 -- start start 2021-11-03T16:53:36.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.530+0000 7f6475953700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64700f5460 0x7f647010be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:53:36.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.530+0000 7f6475953700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64700f6700 0x7f647010e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:53:36.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.530+0000 7f6475953700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6470060310 con 0x7f64700f5460 2021-11-03T16:53:36.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.530+0000 7f6475953700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6470060450 con 0x7f64700f6700 2021-11-03T16:53:36.530 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.531+0000 7f646effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64700f5460 0x7f647010be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:53:36.530 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.531+0000 7f646effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64700f5460 0x7f647010be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50332/0 (socket says 172.21.15.26:50332) 2021-11-03T16:53:36.530 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.531+0000 7f646effd700 1 -- 172.21.15.26:0/2382298648 learned_addr learned my addr 172.21.15.26:0/2382298648 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:53:36.530 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.531+0000 7f646e7fc700 1 --2- 172.21.15.26:0/2382298648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64700f6700 0x7f647010e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:53:36.531 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.531+0000 7f646effd700 1 -- 172.21.15.26:0/2382298648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64700f6700 msgr2=0x7f647010e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:53:36.531 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.531+0000 7f646effd700 1 --2- 172.21.15.26:0/2382298648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64700f6700 0x7f647010e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:36.531 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.531+0000 7f646effd700 1 -- 172.21.15.26:0/2382298648 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6464005040 con 0x7f64700f5460 2021-11-03T16:53:36.531 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.531+0000 7f646effd700 1 --2- 172.21.15.26:0/2382298648 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64700f5460 0x7f647010be10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f6460002700 tx=0x7f6460009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:53:36.531 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.532+0000 7f64577fe700 1 -- 172.21.15.26:0/2382298648 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64600079c0 con 0x7f64700f5460 2021-11-03T16:53:36.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.532+0000 7f64577fe700 1 -- 172.21.15.26:0/2382298648 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f646000f040 con 0x7f64700f5460 2021-11-03T16:53:36.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.532+0000 7f64577fe700 1 -- 172.21.15.26:0/2382298648 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6460014860 con 0x7f64700f5460 2021-11-03T16:53:36.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.532+0000 7f6475953700 1 -- 172.21.15.26:0/2382298648 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f647010e800 con 0x7f64700f5460 2021-11-03T16:53:36.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.532+0000 7f6475953700 1 -- 172.21.15.26:0/2382298648 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f647010ece0 con 0x7f64700f5460 2021-11-03T16:53:36.533 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.533+0000 7f6475953700 1 -- 172.21.15.26:0/2382298648 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6470045ad0 con 0x7f64700f5460 2021-11-03T16:53:36.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.534+0000 7f64577fe700 1 -- 172.21.15.26:0/2382298648 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f64600090d0 con 0x7f64700f5460 2021-11-03T16:53:36.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.535+0000 7f64577fe700 1 --2- 172.21.15.26:0/2382298648 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f645805c340 0x7f645805e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:53:36.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.535+0000 7f64577fe700 1 -- 172.21.15.26:0/2382298648 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f6460075ff0 con 0x7f64700f5460 2021-11-03T16:53:36.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.535+0000 7f646e7fc700 1 --2- 172.21.15.26:0/2382298648 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f645805c340 0x7f645805e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:53:36.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.536+0000 7f646e7fc700 1 --2- 172.21.15.26:0/2382298648 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f645805c340 0x7f645805e800 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f6464004e30 tx=0x7f6464009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:53:36.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.539+0000 7f64577fe700 1 -- 172.21.15.26:0/2382298648 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f6460048c90 con 0x7f64700f5460 2021-11-03T16:53:36.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.854+0000 7f6475953700 1 -- 172.21.15.26:0/2382298648 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f64700fdda0 con 0x7f64700f5460 2021-11-03T16:53:36.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.854+0000 7f64577fe700 1 -- 172.21.15.26:0/2382298648 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+573 (secure 0 0 0) 0x7f646004c2b0 con 0x7f64700f5460 2021-11-03T16:53:36.850 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T16:53:36.850 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T16:53:36.850 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2021-11-03T16:53:36.851 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:53:36.851 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T16:53:36.851 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2021-11-03T16:53:36.852 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:53:36.852 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T16:53:36.852 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2021-11-03T16:53:36.852 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:53:36.853 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T16:53:36.853 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T16:53:36.853 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:53:36.853 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T16:53:36.853 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 14 2021-11-03T16:53:36.854 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T16:53:36.854 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T16:53:36.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.856+0000 7f6475953700 1 -- 172.21.15.26:0/2382298648 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f645805c340 msgr2=0x7f645805e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:53:36.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.856+0000 7f6475953700 1 --2- 172.21.15.26:0/2382298648 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f645805c340 0x7f645805e800 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f6464004e30 tx=0x7f6464009b30).stop 2021-11-03T16:53:36.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.856+0000 7f6475953700 1 -- 172.21.15.26:0/2382298648 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64700f5460 msgr2=0x7f647010be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:53:36.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.856+0000 7f6475953700 1 --2- 172.21.15.26:0/2382298648 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64700f5460 0x7f647010be10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f6460002700 tx=0x7f6460009d80).stop 2021-11-03T16:53:36.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.856+0000 7f6475953700 1 -- 172.21.15.26:0/2382298648 shutdown_connections 2021-11-03T16:53:36.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.856+0000 7f6475953700 1 --2- 172.21.15.26:0/2382298648 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f645805c340 0x7f645805e800 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:36.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.856+0000 7f6475953700 1 --2- 172.21.15.26:0/2382298648 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64700f5460 0x7f647010be10 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:36.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.856+0000 7f6475953700 1 --2- 172.21.15.26:0/2382298648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64700f6700 0x7f647010e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:36.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.856+0000 7f6475953700 1 -- 172.21.15.26:0/2382298648 >> 172.21.15.26:0/2382298648 conn(0x7f64700f0bc0 msgr2=0x7f64700fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:53:36.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.859+0000 7f6475953700 1 -- 172.21.15.26:0/2382298648 shutdown_connections 2021-11-03T16:53:36.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.859+0000 7f6475953700 1 -- 172.21.15.26:0/2382298648 wait complete. 2021-11-03T16:53:36.966 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.970+0000 7fe5244fb700 1 -- 172.21.15.26:0/3346264283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe51c0f66e0 msgr2=0x7fe51c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:53:36.966 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.970+0000 7fe5244fb700 1 --2- 172.21.15.26:0/3346264283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe51c0f66e0 0x7fe51c0f6b00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fe518004660 tx=0x7fe518009b30).stop 2021-11-03T16:53:36.966 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.970+0000 7fe5244fb700 1 -- 172.21.15.26:0/3346264283 shutdown_connections 2021-11-03T16:53:36.967 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.970+0000 7fe5244fb700 1 --2- 172.21.15.26:0/3346264283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe51c0f7980 0x7fe51c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:36.967 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.970+0000 7fe5244fb700 1 --2- 172.21.15.26:0/3346264283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe51c0f66e0 0x7fe51c0f6b00 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:36.967 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.970+0000 7fe5244fb700 1 -- 172.21.15.26:0/3346264283 >> 172.21.15.26:0/3346264283 conn(0x7fe51c0f1e40 msgr2=0x7fe51c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:53:36.967 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.970+0000 7fe5244fb700 1 -- 172.21.15.26:0/3346264283 shutdown_connections 2021-11-03T16:53:36.968 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.970+0000 7fe5244fb700 1 -- 172.21.15.26:0/3346264283 wait complete. 2021-11-03T16:53:36.969 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.971+0000 7fe5244fb700 1 Processor -- start 2021-11-03T16:53:36.970 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.971+0000 7fe5244fb700 1 -- start start 2021-11-03T16:53:36.970 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.971+0000 7fe5244fb700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe51c0f66e0 0x7fe51c068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:53:36.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.971+0000 7fe5244fb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe51c0f7980 0x7fe51c069240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:53:36.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.971+0000 7fe5244fb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe51c069840 con 0x7fe51c0f7980 2021-11-03T16:53:36.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.971+0000 7fe5244fb700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe51c110b70 con 0x7fe51c0f66e0 2021-11-03T16:53:36.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.971+0000 7fe521a96700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe51c0f7980 0x7fe51c069240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:53:36.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.971+0000 7fe521a96700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe51c0f7980 0x7fe51c069240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50344/0 (socket says 172.21.15.26:50344) 2021-11-03T16:53:36.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.971+0000 7fe521a96700 1 -- 172.21.15.26:0/894877046 learned_addr learned my addr 172.21.15.26:0/894877046 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:53:36.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.972+0000 7fe522297700 1 --2- 172.21.15.26:0/894877046 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe51c0f66e0 0x7fe51c068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:53:36.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.972+0000 7fe521a96700 1 -- 172.21.15.26:0/894877046 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe51c0f66e0 msgr2=0x7fe51c068d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:53:36.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.972+0000 7fe521a96700 1 --2- 172.21.15.26:0/894877046 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe51c0f66e0 0x7fe51c068d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:36.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.972+0000 7fe521a96700 1 -- 172.21.15.26:0/894877046 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe518005040 con 0x7fe51c0f7980 2021-11-03T16:53:36.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.972+0000 7fe521a96700 1 --2- 172.21.15.26:0/894877046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe51c0f7980 0x7fe51c069240 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fe50c0026d0 tx=0x7fe50c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:53:36.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.972+0000 7fe512ffd700 1 -- 172.21.15.26:0/894877046 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe50c0079c0 con 0x7fe51c0f7980 2021-11-03T16:53:36.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.972+0000 7fe512ffd700 1 -- 172.21.15.26:0/894877046 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe50c00f040 con 0x7fe51c0f7980 2021-11-03T16:53:36.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.972+0000 7fe5244fb700 1 -- 172.21.15.26:0/894877046 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe51c110d90 con 0x7fe51c0f7980 2021-11-03T16:53:36.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.972+0000 7fe512ffd700 1 -- 172.21.15.26:0/894877046 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe50c0148b0 con 0x7fe51c0f7980 2021-11-03T16:53:36.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.972+0000 7fe5244fb700 1 -- 172.21.15.26:0/894877046 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe51c111350 con 0x7fe51c0f7980 2021-11-03T16:53:36.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.973+0000 7fe5244fb700 1 -- 172.21.15.26:0/894877046 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe51c045ad0 con 0x7fe51c0f7980 2021-11-03T16:53:36.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.975+0000 7fe512ffd700 1 -- 172.21.15.26:0/894877046 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fe50c007b20 con 0x7fe51c0f7980 2021-11-03T16:53:36.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.975+0000 7fe512ffd700 1 --2- 172.21.15.26:0/894877046 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe50805c2b0 0x7fe50805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:53:36.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.976+0000 7fe512ffd700 1 -- 172.21.15.26:0/894877046 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fe50c076230 con 0x7fe51c0f7980 2021-11-03T16:53:36.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.977+0000 7fe522297700 1 --2- 172.21.15.26:0/894877046 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe50805c2b0 0x7fe50805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:53:36.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.977+0000 7fe522297700 1 --2- 172.21.15.26:0/894877046 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe50805c2b0 0x7fe50805e770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fe518004630 tx=0x7fe518009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:53:36.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:36.982+0000 7fe512ffd700 1 -- 172.21.15.26:0/894877046 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fe50c049000 con 0x7fe51c0f7980 2021-11-03T16:53:37.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:37.236+0000 7fe5244fb700 1 -- 172.21.15.26:0/894877046 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe51c0feea0 con 0x7fe51c0f7980 2021-11-03T16:53:37.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:37.236+0000 7fe512ffd700 1 -- 172.21.15.26:0/894877046 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 9 v9) v1 ==== 75+0+1618 (secure 0 0 0) 0x7fe50c04c620 con 0x7fe51c0f7980 2021-11-03T16:53:37.232 INFO:teuthology.orchestra.run.smithi026.stdout:e9 2021-11-03T16:53:37.232 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T16:53:37.233 INFO:teuthology.orchestra.run.smithi026.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T16:53:37.233 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T16:53:37.233 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:53:37.233 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T16:53:37.234 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T16:53:37.234 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 6 2021-11-03T16:53:37.235 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 2021-11-03T16:53:37.235 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T16:53:37.235 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:52:28.058778+0000 2021-11-03T16:53:37.235 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T16:53:37.236 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T16:53:37.236 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T16:53:37.236 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T16:53:37.236 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T16:53:37.236 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T16:53:37.237 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T16:53:37.237 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 0 2021-11-03T16:53:37.237 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T16:53:37.237 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T16:53:37.238 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T16:53:37.238 INFO:teuthology.orchestra.run.smithi026.stdout:up {0=14422} 2021-11-03T16:53:37.238 INFO:teuthology.orchestra.run.smithi026.stdout:failed 2021-11-03T16:53:37.238 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T16:53:37.238 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T16:53:37.239 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T16:53:37.239 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T16:53:37.239 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T16:53:37.239 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T16:53:37.239 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T16:53:37.240 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{0:14422} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.26:6826/665235785,v1:172.21.15.26:6827/665235785]] 2021-11-03T16:53:37.240 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:53:37.240 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:53:37.240 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T16:53:37.241 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:53:37.241 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14436} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.26:6828/3059137105,v1:172.21.15.26:6829/3059137105]] 2021-11-03T16:53:37.241 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921]] 2021-11-03T16:53:37.241 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844]] 2021-11-03T16:53:37.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:37.239+0000 7fe5244fb700 1 -- 172.21.15.26:0/894877046 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe50805c2b0 msgr2=0x7fe50805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:53:37.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:37.239+0000 7fe5244fb700 1 --2- 172.21.15.26:0/894877046 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe50805c2b0 0x7fe50805e770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fe518004630 tx=0x7fe518009b30).stop 2021-11-03T16:53:37.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:37.239+0000 7fe5244fb700 1 -- 172.21.15.26:0/894877046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe51c0f7980 msgr2=0x7fe51c069240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:53:37.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:37.239+0000 7fe5244fb700 1 --2- 172.21.15.26:0/894877046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe51c0f7980 0x7fe51c069240 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fe50c0026d0 tx=0x7fe50c009de0).stop 2021-11-03T16:53:37.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:37.239+0000 7fe5244fb700 1 -- 172.21.15.26:0/894877046 shutdown_connections 2021-11-03T16:53:37.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:37.239+0000 7fe5244fb700 1 --2- 172.21.15.26:0/894877046 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fe50805c2b0 0x7fe50805e770 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:37.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:37.239+0000 7fe5244fb700 1 --2- 172.21.15.26:0/894877046 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe51c0f66e0 0x7fe51c068d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:37.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:37.239+0000 7fe5244fb700 1 --2- 172.21.15.26:0/894877046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe51c0f7980 0x7fe51c069240 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:53:37.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:37.239+0000 7fe5244fb700 1 -- 172.21.15.26:0/894877046 >> 172.21.15.26:0/894877046 conn(0x7fe51c0f1e40 msgr2=0x7fe51c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:53:37.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:37.239+0000 7fe5244fb700 1 -- 172.21.15.26:0/894877046 shutdown_connections 2021-11-03T16:53:37.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:53:37.239+0000 7fe5244fb700 1 -- 172.21.15.26:0/894877046 wait complete. 2021-11-03T16:53:37.245 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 9 2021-11-03T16:53:37.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:37 smithi026 conmon[32119]: audit 2021-11-03T16:53 2021-11-03T16:53:37.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:37 smithi026 conmon[32119]: :36.103730+0000 mgr.smithi026.cnrxli (mgr.14162) 270 : audit [DBG] from='client.14512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:53:37.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:37 smithi026 conmon[32119]: audit 2021-11-03T16:53 2021-11-03T16:53:37.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:37 smithi026 conmon[32119]: :36.854997+0000 mon.smithi026 (mon.0) 550 : audit [DBG] from='client.? 172.21.15.26:0/2382298648' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:53:37.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:37 smithi026 conmon[32119]: 2021-11-03T16:53:37.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:37 smithi194 conmon[35111]: audit 2021-11-03T16:53:36.103730+0000 mgr.smithi026.cnrxli (mgr 2021-11-03T16:53:37.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:37 smithi194 conmon[35111]: .14162) 270 : audit [DBG] from='client.14512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:53:37.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:37 smithi194 conmon[35111]: audit 2021-11-03T16:53:36.854997+0000 mon.smithi026 (mon.0) 550 : 2021-11-03T16:53:37.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:37 smithi194 conmon[35111]: audit [DBG] from='client.? 172.21.15.26:0/2382298648' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:53:38.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:38 smithi026 conmon[32119]: audit 2021-11-03T16:53:36.405769+0000 mgr.smithi026.cnrxli (mgr.14162 2021-11-03T16:53:38.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:38 smithi026 conmon[32119]: ) 271 : audit [DBG] from='client.14516 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:53:38.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:38 smithi026 conmon[32119]: cluster 2021-11-03T16:53:37.059838+0000 mgr.smithi026.cnrxli (mgr.14162) 272 : cluster [DBG] pgmap v225: 65 pgs: 65 active+clean; 11 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2021-11-03T16:53:38.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:38 smithi026 conmon[32119]: audit 2021-11-03T16:53:38.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:38 smithi026 conmon[32119]: 2021-11-03T16:53 2021-11-03T16:53:38.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:38 smithi026 conmon[32119]: :37.237286+0000 mon.smithi026 ( 2021-11-03T16:53:38.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:38 smithi026 conmon[32119]: mon.0) 551 : audit [DBG] 2021-11-03T16:53:38.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:38 smithi026 conmon[32119]: from='client.? 172.21.15.26:0/894877046' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T16:53:38.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:38 smithi194 conmon[35111]: audit 2021-11-03T16:53:36.405769+0000 mgr.smithi026.cnrxli (mgr.14162) 271 : audit [DBG] from='client.14516 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:53:38.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:38 smithi194 conmon[35111]: 2021-11-03T16:53:38.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:38 smithi194 conmon[35111]: cluster 2021-11-03T16:53:37.059838+0000 mgr.smithi026.cnrxli (mgr.14162) 272 : cluster [DBG] pgmap v225: 65 pgs: 65 active+clean; 11 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2021-11-03T16:53:38.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:38 smithi194 conmon[35111]: audit 2021-11-03T16:53:37.237286+0000 2021-11-03T16:53:38.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:38 smithi194 conmon[35111]: mon.smithi026 (mon.0) 551 : audit [DBG] from='client.? 172.21.15.26:0/894877046' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T16:53:40.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:40 smithi026 conmon[32119]: cluster 2021-11-03T16:53:39.060255+0000 mgr.smithi026.cnrxli 2021-11-03T16:53:40.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:40 smithi026 conmon[32119]: (mgr.14162) 273 : cluster [DBG] pgmap v226: 65 pgs: 65 active+clean; 1.0 MiB data, 33 MiB used, 536 GiB / 536 GiB avail; 87 KiB/s wr, 0 op/s 2021-11-03T16:53:40.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:40 smithi194 conmon[35111]: cluster 2021-11-03T16:53:39.060255+0000 mgr.smithi026.cnrxli (mgr.14162) 273 : 2021-11-03T16:53:40.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:40 smithi194 conmon[35111]: cluster [DBG] pgmap v226: 65 pgs: 65 active+clean; 1.0 MiB data, 33 MiB used, 536 GiB / 536 GiB avail; 87 KiB/s wr, 0 op/s 2021-11-03T16:53:40.667 INFO:tasks.workunit.client.0.smithi026.stderr:Note: switching to '6e90212d8510e2d506395a8c82057d0d1787f3a4'. 2021-11-03T16:53:40.667 INFO:tasks.workunit.client.0.smithi026.stderr: 2021-11-03T16:53:40.668 INFO:tasks.workunit.client.0.smithi026.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2021-11-03T16:53:40.668 INFO:tasks.workunit.client.0.smithi026.stderr:changes and commit them, and you can discard any commits you make in this 2021-11-03T16:53:40.668 INFO:tasks.workunit.client.0.smithi026.stderr:state without impacting any branches by switching back to a branch. 2021-11-03T16:53:40.668 INFO:tasks.workunit.client.0.smithi026.stderr: 2021-11-03T16:53:40.669 INFO:tasks.workunit.client.0.smithi026.stderr:If you want to create a new branch to retain commits you create, you may 2021-11-03T16:53:40.669 INFO:tasks.workunit.client.0.smithi026.stderr:do so (now or later) by using -c with the switch command. Example: 2021-11-03T16:53:40.669 INFO:tasks.workunit.client.0.smithi026.stderr: 2021-11-03T16:53:40.669 INFO:tasks.workunit.client.0.smithi026.stderr: git switch -c 2021-11-03T16:53:40.669 INFO:tasks.workunit.client.0.smithi026.stderr: 2021-11-03T16:53:40.670 INFO:tasks.workunit.client.0.smithi026.stderr:Or undo this operation with: 2021-11-03T16:53:40.670 INFO:tasks.workunit.client.0.smithi026.stderr: 2021-11-03T16:53:40.670 INFO:tasks.workunit.client.0.smithi026.stderr: git switch - 2021-11-03T16:53:40.670 INFO:tasks.workunit.client.0.smithi026.stderr: 2021-11-03T16:53:40.671 INFO:tasks.workunit.client.0.smithi026.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2021-11-03T16:53:40.671 INFO:tasks.workunit.client.0.smithi026.stderr: 2021-11-03T16:53:40.671 INFO:tasks.workunit.client.0.smithi026.stderr:HEAD is now at 6e90212d851 Merge branch 'test-container-tools-3.1' of https://github.com/liewegas/ceph into wip-sage-testing-2021-11-03-1039 2021-11-03T16:53:40.673 DEBUG:teuthology.orchestra.run.smithi026:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2021-11-03T16:53:40.817 INFO:tasks.workunit.client.0.smithi026.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2021-11-03T16:53:40.819 INFO:tasks.workunit.client.0.smithi026.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2021-11-03T16:53:40.820 INFO:tasks.workunit.client.0.smithi026.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2021-11-03T16:53:42.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:42 smithi026 conmon[32119]: cluster 2021-11 2021-11-03T16:53:42.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:42 smithi026 conmon[32119]: -03T16:53:41.060688+0000 mgr.smithi026.cnrxli (mgr.14162) 274 : cluster [DBG] pgmap v227: 65 pgs: 65 active+clean; 1.0 MiB data, 36 MiB used, 536 GiB / 536 GiB avail; 86 KiB/s wr, 0 op/s 2021-11-03T16:53:42.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:42 smithi194 conmon[35111]: cluster 2021-11-03T16:53:41.060688+0000 mgr.smithi026.cnrxli (mgr.14162) 274 : cluster [DBG] pgmap v227: 65 pgs: 65 active+clean; 1.0 MiB data, 36 MiB used, 536 GiB / 536 GiB avail; 86 KiB/s wr, 0 op/s 2021-11-03T16:53:44.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:44 smithi026 conmon[32119]: cluster 2021-11-03T16:53:43.061191+0000 mgr.smithi026.cnrxli (mgr. 2021-11-03T16:53:44.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:44 smithi026 conmon[32119]: 14162) 275 : cluster [DBG] pgmap v228: 65 pgs: 65 active+clean; 18 MiB data, 87 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s wr, 81 op/s 2021-11-03T16:53:44.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:44 smithi194 conmon[35111]: cluster 2021-11-03T16:53:43.061191+0000 mgr.smithi026.cnrxli (mgr.14162) 275 : cluster 2021-11-03T16:53:44.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:44 smithi194 conmon[35111]: [DBG] pgmap v228: 65 pgs: 65 active+clean; 18 MiB data, 87 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s wr, 81 op/s 2021-11-03T16:53:45.920 INFO:tasks.workunit.client.0.smithi026.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2021-11-03T16:53:46.109 INFO:tasks.workunit.client.0.smithi026.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2021-11-03T16:53:46.228 INFO:tasks.workunit.client.0.smithi026.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2021-11-03T16:53:46.229 INFO:tasks.workunit.client.0.smithi026.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2021-11-03T16:53:46.230 INFO:tasks.workunit.client.0.smithi026.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2021-11-03T16:53:46.303 INFO:tasks.workunit.client.0.smithi026.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2021-11-03T16:53:46.306 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2021-11-03T16:53:46.306 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2021-11-03T16:53:46.322 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2021-11-03T16:53:46.323 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2021-11-03T16:53:46.324 DEBUG:teuthology.orchestra.run.smithi026:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6e90212d8510e2d506395a8c82057d0d1787f3a4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2021-11-03T16:53:46.386 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir -p fsstress 2021-11-03T16:53:46.390 INFO:tasks.workunit.client.0.smithi026.stderr:+ pushd fsstress 2021-11-03T16:53:46.390 INFO:tasks.workunit.client.0.smithi026.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2021-11-03T16:53:46.391 INFO:tasks.workunit.client.0.smithi026.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2021-11-03T16:53:46.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:46 smithi194 conmon[35111]: cluster 2021-11-03T16:53:45.061614+0000 mgr.smithi026.cnrxli (mgr.14162) 276 : cluster [DBG] pgmap v229: 65 pgs: 65 active+clean; 19 MiB data, 101 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s wr, 114 op/s 2021-11-03T16:53:46.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:46 smithi194 conmon[35111]: 2021-11-03T16:53:46.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:46 smithi026 conmon[32119]: cluster 2021-11-03T16:53:45. 2021-11-03T16:53:46.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:46 smithi026 conmon[32119]: 061614+0000 mgr.smithi026.cnrxli (mgr.14162) 276 : cluster [DBG] pgmap v229: 65 pgs: 65 active+clean; 19 MiB data, 101 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s wr, 114 op/s 2021-11-03T16:53:47.887 INFO:tasks.workunit.client.0.smithi026.stderr:+ tar xzf ltp-full.tgz 2021-11-03T16:53:48.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:48 smithi194 conmon[35111]: cluster 2021-11-03T16:53:47.062130+0000 mgr.smithi026.cnrxli (mgr.14162) 277 2021-11-03T16:53:48.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:48 smithi194 conmon[35111]: : cluster [DBG] pgmap v230: 65 pgs: 65 active+clean; 26 MiB data, 138 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s wr, 180 op/s 2021-11-03T16:53:48.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:48 smithi026 conmon[32119]: cluster 2021-11-03T16:53:47.062130+0000 mgr.smithi026.cnrxli 2021-11-03T16:53:48.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:48 smithi026 conmon[32119]: (mgr.14162) 277 : cluster [DBG] pgmap v230: 65 pgs: 65 active+clean; 26 MiB data, 138 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s wr, 180 op/s 2021-11-03T16:53:50.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:50 smithi194 conmon[35111]: cluster 2021-11-03T16:53:49.062609+0000 mgr.smithi026.cnrxli (mgr.14162) 278 : cluster [DBG] pgmap v231: 65 pgs: 65 active+clean; 30 MiB data, 147 MiB used, 536 GiB / 536 GiB avail; 2.6 MiB/s wr, 185 op/s 2021-11-03T16:53:50.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:50 smithi026 conmon[32119]: cluster 2021-11-03T16:53:49.062609+0000 mgr.smithi026.cnrxli (mgr. 2021-11-03T16:53:50.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:50 smithi026 conmon[32119]: 14162) 278 : cluster [DBG] pgmap v231: 65 pgs: 65 active+clean; 30 MiB data, 147 MiB used, 536 GiB / 536 GiB avail; 2.6 MiB/s wr, 185 op/s 2021-11-03T16:53:52.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:52 smithi026 conmon[32119]: cluster 2021-11-03T16:53:51.063056+0000 mgr.smithi026.cnrxli (mgr.14162) 279 : cluster [DBG] pgmap v232: 65 pgs: 65 active+clean; 34 MiB data, 153 MiB used, 536 GiB / 536 GiB avail; 2.9 MiB/s wr, 185 op/s 2021-11-03T16:53:52.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:52 smithi026 conmon[32119]: audit 2021-11-03T16:53:51.993316+0000 mon.smithi026 (mon.0) 552 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:53:52.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:52 smithi026 conmon[32119]: audit 2021-11-03T16:53:52.003791+0000 mon.smithi026 (mon.0) 553 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:53:52.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:52 smithi194 conmon[35111]: cluster 2021-11-03T16:53:51.063056+0000 mgr.smithi026.cnrxli (mgr.14162) 2021-11-03T16:53:52.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:52 smithi194 conmon[35111]: 279 : cluster [DBG] pgmap v232: 65 pgs: 65 active+clean; 34 MiB data, 153 MiB used, 536 GiB / 536 GiB avail; 2.9 MiB/s wr, 185 op/s 2021-11-03T16:53:52.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:52 smithi194 conmon[35111]: audit 2021-11-03T16:53:51.993316+0000 mon.smithi026 (mon.0) 552 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:53:52.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:52 smithi194 conmon[35111]: audit 2021-11-03T16:53:52.003791+0000 mon.smithi026 (mon.0) 553 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:53:53.471 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:53 smithi194 conmon[35111]: cephadm 2021-11-03T16:53:51.998846+0000 mgr.smithi026.cnrxli (mgr.14162) 2021-11-03T16:53:53.471 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:53 smithi194 conmon[35111]: 280 : cephadm [INF] Upgrade: Target is version 17.0.0-8776-g6e90212d (unknown) 2021-11-03T16:53:53.471 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:53 smithi194 conmon[35111]: cephadm 2021-11-03T16:53:51.998952+0000 mgr.smithi026.cnrxli (mgr.14162) 281 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:72989db4ddcdff183d79e135290eb63333fd8eb1af14b7c17a49eac7dfadef2c, digests ['quay.ceph.io/ceph-ci/ceph@sha256:72989db4ddcdff183d79e135290eb63333fd8eb1af14b7c17a49eac7dfadef2c'] 2021-11-03T16:53:53.472 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:53 smithi194 conmon[35111]: cephadm 2021-11-03T16:53:53.472 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:53 smithi194 conmon[35111]: 2021-11-03T16:53:52.011638+0000 mgr.smithi026.cnrxli (mgr.14162) 282 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi026.cnrxli) 2021-11-03T16:53:53.472 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:53 smithi194 conmon[35111]: cephadm 2021-11-03T16:53:53.472 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:53 smithi194 conmon[35111]: 2021-11-03T16:53:52.338496+0000 mgr.smithi026.cnrxli (mgr.14162 2021-11-03T16:53:53.473 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:53 smithi194 conmon[35111]: ) 283 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:72989db4ddcdff183d79e135290eb63333fd8eb1af14b7c17a49eac7dfadef2c on smithi194 2021-11-03T16:53:53.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:53 smithi026 conmon[32119]: cephadm 2021-11-03T16:53:51.998846+0000 mgr.smithi026.cnrxli (mgr 2021-11-03T16:53:53.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:53 smithi026 conmon[32119]: .14162) 280 : cephadm [INF] Upgrade: Target is version 17.0.0-8776-g6e90212d (unknown) 2021-11-03T16:53:53.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:53 smithi026 conmon[32119]: cephadm 2021-11- 2021-11-03T16:53:53.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:53 smithi026 conmon[32119]: 03T16:53:51.998952+0000 mgr.smithi026.cnrxli (mgr.14162) 281 : cephadm 2021-11-03T16:53:53.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:53 smithi026 conmon[32119]: [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:72989db4ddcdff183d79e135290eb63333fd8eb1af14b7c17a49eac7dfadef2c, digests ['quay.ceph.io/ceph-ci/ceph@sha256:72989db4ddcdff183d79e135290eb63333fd8eb1af14b7c17a49eac7dfadef2c'] 2021-11-03T16:53:53.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:53 smithi026 conmon[32119]: cephadm 2021-11-03T16:53:53.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:53 smithi026 conmon[32119]: 2021-11-03T16:53:52 2021-11-03T16:53:53.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:53 smithi026 conmon[32119]: .011638+0000 mgr.smithi026.cnrxli (mgr.14162) 282 : cephadm 2021-11-03T16:53:53.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:53 smithi026 conmon[32119]: [INF] Upgrade: Need to upgrade myself (mgr.smithi026.cnrxli) 2021-11-03T16:53:53.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:53 smithi026 conmon[32119]: cephadm 2021-11-03T16:53:53.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:53 smithi026 conmon[32119]: 2021-11-03T16:53: 2021-11-03T16:53:53.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:53 smithi026 conmon[32119]: 52.338496+0000 mgr.smithi026.cnrxli (mgr.14162) 283 : 2021-11-03T16:53:53.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:53 smithi026 conmon[32119]: cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:72989db4ddcdff183d79e135290eb63333fd8eb1af14b7c17a49eac7dfadef2c on smithi194 2021-11-03T16:53:54.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:54 smithi194 conmon[35111]: cluster 2021-11-03T16:53:53.063533+0000 mgr.smithi026.cnrxli (mgr. 2021-11-03T16:53:54.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:54 smithi194 conmon[35111]: 14162) 284 : cluster [DBG] pgmap v233: 65 pgs: 65 active+clean; 42 MiB data, 176 MiB used, 536 GiB / 536 GiB avail; 3.5 MiB/s wr, 226 op/s 2021-11-03T16:53:54.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:54 smithi026 conmon[32119]: cluster 2021-11-03T16:53:53.063533+0000 mgr.smithi026.cnrxli (mgr.14162) 284 : 2021-11-03T16:53:54.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:54 smithi026 conmon[32119]: cluster [DBG] pgmap v233: 65 pgs: 65 active+clean; 42 MiB data, 176 MiB used, 536 GiB / 536 GiB avail; 3.5 MiB/s wr, 226 op/s 2021-11-03T16:53:56.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:56 smithi194 conmon[35111]: cluster 2021-11-03T16:53:55.063858+0000 mgr.smithi026.cnrxli ( 2021-11-03T16:53:56.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:56 smithi194 conmon[35111]: mgr.14162) 285 : cluster [DBG] pgmap v234: 65 pgs: 65 active+clean; 46 MiB data, 194 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s wr, 166 op/s 2021-11-03T16:53:56.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:56 smithi026 conmon[32119]: cluster 2021-11-03T16:53:55.063858+0000 mgr.smithi026.cnrxli (mgr 2021-11-03T16:53:56.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:56 smithi026 conmon[32119]: .14162) 285 : cluster [DBG] pgmap v234: 65 pgs: 65 active+clean; 46 MiB data, 194 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s wr, 166 op/s 2021-11-03T16:53:58.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:58 smithi194 conmon[35111]: cluster 2021-11-03T16:53:57.064313+0000 mgr.smithi026.cnrxli (mgr.14162 2021-11-03T16:53:58.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:53:58 smithi194 conmon[35111]: ) 286 : cluster [DBG] pgmap v235: 65 pgs: 65 active+clean; 56 MiB data, 230 MiB used, 536 GiB / 536 GiB avail; 3.2 MiB/s wr, 182 op/s 2021-11-03T16:53:58.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:58 smithi026 conmon[32119]: cluster 2021-11-03T16:53 2021-11-03T16:53:58.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:53:58 smithi026 conmon[32119]: :57.064313+0000 mgr.smithi026.cnrxli (mgr.14162) 286 : cluster [DBG] pgmap v235: 65 pgs: 65 active+clean; 56 MiB data, 230 MiB used, 536 GiB / 536 GiB avail; 3.2 MiB/s wr, 182 op/s 2021-11-03T16:54:00.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:00 smithi194 conmon[35111]: cluster 2021-11-03T16:53:59.064795+0000 mgr.smithi026.cnrxli (mgr.14162) 287 : 2021-11-03T16:54:00.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:00 smithi194 conmon[35111]: cluster [DBG] pgmap v236: 65 pgs: 65 active+clean; 64 MiB data, 252 MiB used, 536 GiB / 536 GiB avail; 3.3 MiB/s wr, 123 op/s 2021-11-03T16:54:00.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:00 smithi026 conmon[32119]: cluster 2021-11-03T16:53: 2021-11-03T16:54:00.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:00 smithi026 conmon[32119]: 59.064795+0000 mgr.smithi026.cnrxli (mgr.14162) 287 : cluster [DBG] pgmap v236: 65 pgs: 65 active+clean; 64 MiB data, 252 MiB used, 536 GiB / 536 GiB avail; 3.3 MiB/s wr, 123 op/s 2021-11-03T16:54:02.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:02 smithi194 conmon[35111]: cluster 2021-11-03T16:54:01.065370+0000 mgr.smithi026.cnrxli (mgr.14162) 2021-11-03T16:54:02.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:02 smithi194 conmon[35111]: 288 : cluster [DBG] pgmap v237: 65 pgs: 65 active+clean; 64 MiB data, 265 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s wr, 118 op/s 2021-11-03T16:54:02.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:02 smithi026 conmon[32119]: cluster 2021-11-03T16:54:01.065370+0000 mgr.smithi026.cnrxli (mgr. 2021-11-03T16:54:02.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:02 smithi026 conmon[32119]: 14162) 288 : cluster [DBG] pgmap v237: 65 pgs: 65 active+clean; 64 MiB data, 265 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s wr, 118 op/s 2021-11-03T16:54:04.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:04 smithi194 conmon[35111]: cluster 2021-11-03T16:54:03.065830+0000 mgr.smithi026.cnrxli (mgr.14162 2021-11-03T16:54:04.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:04 smithi194 conmon[35111]: ) 289 : cluster [DBG] pgmap v238: 65 pgs: 65 active+clean; 83 MiB data, 332 MiB used, 536 GiB / 536 GiB avail; 4.4 MiB/s wr, 386 op/s 2021-11-03T16:54:04.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:04 smithi026 conmon[32119]: cluster 2021-11-03T 2021-11-03T16:54:04.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:04 smithi026 conmon[32119]: 16:54:03.065830+0000 mgr.smithi026.cnrxli (mgr.14162) 289 : cluster [DBG] pgmap v238: 65 pgs: 65 active+clean; 83 MiB data, 332 MiB used, 536 GiB / 536 GiB avail; 4.4 MiB/s wr, 386 op/s 2021-11-03T16:54:06.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:06 smithi194 conmon[35111]: cluster 2021-11-03T16:54:06.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:06 smithi194 conmon[35111]: 2021-11-03T16:54:05.066204+0000 mgr.smithi026.cnrxli (mgr.14162) 290 : cluster [DBG] pgmap v239: 65 pgs: 65 active+clean; 95 MiB data, 373 MiB used, 536 GiB / 536 GiB avail; 4.7 MiB/s wr, 460 op/s 2021-11-03T16:54:06.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:06 smithi026 conmon[32119]: cluster 2021-11-03T16:54:05.066204+0000 mgr.smithi026.cnrxli (mgr 2021-11-03T16:54:06.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:06 smithi026 conmon[32119]: .14162) 290 : cluster [DBG] pgmap v239: 65 pgs: 65 active+clean; 95 MiB data, 373 MiB used, 536 GiB / 536 GiB avail; 4.7 MiB/s wr, 460 op/s 2021-11-03T16:54:07.350 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.350+0000 7fb13f4ee700 1 -- 172.21.15.26:0/1121196913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1380f49a0 msgr2=0x7fb1380f4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:54:07.351 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.350+0000 7fb13f4ee700 1 --2- 172.21.15.26:0/1121196913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1380f49a0 0x7fb1380f4dc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fb1300099e0 tx=0x7fb130004d10).stop 2021-11-03T16:54:07.351 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.350+0000 7fb13f4ee700 1 -- 172.21.15.26:0/1121196913 shutdown_connections 2021-11-03T16:54:07.351 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.350+0000 7fb13f4ee700 1 --2- 172.21.15.26:0/1121196913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1380f5340 0x7fb1380f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:07.351 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.350+0000 7fb13f4ee700 1 --2- 172.21.15.26:0/1121196913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1380f49a0 0x7fb1380f4dc0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:07.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.350+0000 7fb13f4ee700 1 -- 172.21.15.26:0/1121196913 >> 172.21.15.26:0/1121196913 conn(0x7fb1380f04c0 msgr2=0x7fb1380f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:54:07.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.350+0000 7fb13f4ee700 1 -- 172.21.15.26:0/1121196913 shutdown_connections 2021-11-03T16:54:07.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.350+0000 7fb13f4ee700 1 -- 172.21.15.26:0/1121196913 wait complete. 2021-11-03T16:54:07.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.350+0000 7fb13f4ee700 1 Processor -- start 2021-11-03T16:54:07.353 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.351+0000 7fb13f4ee700 1 -- start start 2021-11-03T16:54:07.353 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.351+0000 7fb13f4ee700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1380f49a0 0x7fb1380f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:54:07.353 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.351+0000 7fb13f4ee700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1380f5340 0x7fb1380f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:54:07.353 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.351+0000 7fb13f4ee700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1380f5f30 con 0x7fb1380f5340 2021-11-03T16:54:07.354 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.351+0000 7fb13f4ee700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1380f6070 con 0x7fb1380f49a0 2021-11-03T16:54:07.354 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.351+0000 7fb13ca89700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1380f5340 0x7fb1380f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:54:07.354 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.351+0000 7fb13d28a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1380f49a0 0x7fb1380f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:54:07.354 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.351+0000 7fb13ca89700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1380f5340 0x7fb1380f59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50370/0 (socket says 172.21.15.26:50370) 2021-11-03T16:54:07.355 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.351+0000 7fb13d28a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1380f49a0 0x7fb1380f7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.26:54574/0 (socket says 172.21.15.26:54574) 2021-11-03T16:54:07.355 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.351+0000 7fb13ca89700 1 -- 172.21.15.26:0/2534526770 learned_addr learned my addr 172.21.15.26:0/2534526770 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:54:07.355 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.351+0000 7fb13ca89700 1 -- 172.21.15.26:0/2534526770 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1380f49a0 msgr2=0x7fb1380f7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:54:07.355 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.351+0000 7fb13ca89700 1 --2- 172.21.15.26:0/2534526770 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1380f49a0 0x7fb1380f7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:07.355 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.351+0000 7fb13ca89700 1 -- 172.21.15.26:0/2534526770 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb130009640 con 0x7fb1380f5340 2021-11-03T16:54:07.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.351+0000 7fb13ca89700 1 --2- 172.21.15.26:0/2534526770 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1380f5340 0x7fb1380f59d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fb12800e7c0 tx=0x7fb12800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:54:07.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.352+0000 7fb12dffb700 1 -- 172.21.15.26:0/2534526770 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1280092e0 con 0x7fb1380f5340 2021-11-03T16:54:07.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.352+0000 7fb12dffb700 1 -- 172.21.15.26:0/2534526770 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb12800f040 con 0x7fb1380f5340 2021-11-03T16:54:07.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.352+0000 7fb12dffb700 1 -- 172.21.15.26:0/2534526770 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1280147a0 con 0x7fb1380f5340 2021-11-03T16:54:07.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.352+0000 7fb13f4ee700 1 -- 172.21.15.26:0/2534526770 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1380f6350 con 0x7fb1380f5340 2021-11-03T16:54:07.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.352+0000 7fb13f4ee700 1 -- 172.21.15.26:0/2534526770 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb13810f160 con 0x7fb1380f5340 2021-11-03T16:54:07.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.353+0000 7fb13f4ee700 1 -- 172.21.15.26:0/2534526770 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb138045ad0 con 0x7fb1380f5340 2021-11-03T16:54:07.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.353+0000 7fb12dffb700 1 -- 172.21.15.26:0/2534526770 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fb1280077b0 con 0x7fb1380f5340 2021-11-03T16:54:07.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.353+0000 7fb12dffb700 1 --2- 172.21.15.26:0/2534526770 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fb12405c2b0 0x7fb12405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:54:07.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.354+0000 7fb12dffb700 1 -- 172.21.15.26:0/2534526770 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fb128076140 con 0x7fb1380f5340 2021-11-03T16:54:07.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.354+0000 7fb13d28a700 1 --2- 172.21.15.26:0/2534526770 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fb12405c2b0 0x7fb12405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:54:07.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.354+0000 7fb13d28a700 1 --2- 172.21.15.26:0/2534526770 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fb12405c2b0 0x7fb12405e770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fb1300099b0 tx=0x7fb130015040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:54:07.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.361+0000 7fb12dffb700 1 -- 172.21.15.26:0/2534526770 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fb128048e20 con 0x7fb1380f5340 2021-11-03T16:54:07.551 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.555+0000 7fb13f4ee700 1 -- 172.21.15.26:0/2534526770 --> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1380feff0 con 0x7fb12405c2b0 2021-11-03T16:54:07.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.556+0000 7fb12dffb700 1 -- 172.21.15.26:0/2534526770 <== mgr.14162 v2:172.21.15.26:6800/3029163595 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+372 (secure 0 0 0) 0x7fb1380feff0 con 0x7fb12405c2b0 2021-11-03T16:54:07.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.558+0000 7fb13f4ee700 1 -- 172.21.15.26:0/2534526770 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fb12405c2b0 msgr2=0x7fb12405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:54:07.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.558+0000 7fb13f4ee700 1 --2- 172.21.15.26:0/2534526770 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fb12405c2b0 0x7fb12405e770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fb1300099b0 tx=0x7fb130015040).stop 2021-11-03T16:54:07.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.558+0000 7fb13f4ee700 1 -- 172.21.15.26:0/2534526770 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1380f5340 msgr2=0x7fb1380f59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:54:07.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.558+0000 7fb13f4ee700 1 --2- 172.21.15.26:0/2534526770 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1380f5340 0x7fb1380f59d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fb12800e7c0 tx=0x7fb12800b040).stop 2021-11-03T16:54:07.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.558+0000 7fb13f4ee700 1 -- 172.21.15.26:0/2534526770 shutdown_connections 2021-11-03T16:54:07.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.558+0000 7fb13f4ee700 1 --2- 172.21.15.26:0/2534526770 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7fb12405c2b0 0x7fb12405e770 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:07.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.558+0000 7fb13f4ee700 1 --2- 172.21.15.26:0/2534526770 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1380f49a0 0x7fb1380f7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:07.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.558+0000 7fb13f4ee700 1 --2- 172.21.15.26:0/2534526770 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1380f5340 0x7fb1380f59d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:07.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.558+0000 7fb13f4ee700 1 -- 172.21.15.26:0/2534526770 >> 172.21.15.26:0/2534526770 conn(0x7fb1380f04c0 msgr2=0x7fb1380fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:54:07.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.558+0000 7fb13f4ee700 1 -- 172.21.15.26:0/2534526770 shutdown_connections 2021-11-03T16:54:07.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.558+0000 7fb13f4ee700 1 -- 172.21.15.26:0/2534526770 wait complete. 2021-11-03T16:54:07.564 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T16:54:07.666 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.668+0000 7f287e75e700 1 -- 172.21.15.26:0/14710438 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28780f6530 msgr2=0x7f28780f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:54:07.666 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.668+0000 7f287e75e700 1 --2- 172.21.15.26:0/14710438 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28780f6530 0x7f28780f6950 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f2874004660 tx=0x7f2874009b30).stop 2021-11-03T16:54:07.667 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.668+0000 7f287e75e700 1 -- 172.21.15.26:0/14710438 shutdown_connections 2021-11-03T16:54:07.667 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.668+0000 7f287e75e700 1 --2- 172.21.15.26:0/14710438 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28780f77d0 0x7f28780f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:07.667 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.668+0000 7f287e75e700 1 --2- 172.21.15.26:0/14710438 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28780f6530 0x7f28780f6950 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:07.668 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.668+0000 7f287e75e700 1 -- 172.21.15.26:0/14710438 >> 172.21.15.26:0/14710438 conn(0x7f28780f1c90 msgr2=0x7f28780f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:54:07.668 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.668+0000 7f287e75e700 1 -- 172.21.15.26:0/14710438 shutdown_connections 2021-11-03T16:54:07.669 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.668+0000 7f287e75e700 1 -- 172.21.15.26:0/14710438 wait complete. 2021-11-03T16:54:07.669 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.669+0000 7f287e75e700 1 Processor -- start 2021-11-03T16:54:07.670 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.669+0000 7f287e75e700 1 -- start start 2021-11-03T16:54:07.670 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.669+0000 7f287e75e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28780f6530 0x7f287806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:54:07.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.669+0000 7f287e75e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28780f77d0 0x7f2878069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:54:07.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.669+0000 7f287e75e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287810a9b0 con 0x7f28780f77d0 2021-11-03T16:54:07.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.669+0000 7f287e75e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287810aaf0 con 0x7f28780f6530 2021-11-03T16:54:07.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.669+0000 7f287cf5b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28780f77d0 0x7f2878069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:54:07.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.669+0000 7f287cf5b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28780f77d0 0x7f2878069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50380/0 (socket says 172.21.15.26:50380) 2021-11-03T16:54:07.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.669+0000 7f287cf5b700 1 -- 172.21.15.26:0/3674319025 learned_addr learned my addr 172.21.15.26:0/3674319025 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:54:07.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.669+0000 7f287d75c700 1 --2- 172.21.15.26:0/3674319025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28780f6530 0x7f287806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:54:07.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.670+0000 7f287cf5b700 1 -- 172.21.15.26:0/3674319025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28780f6530 msgr2=0x7f287806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:54:07.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.670+0000 7f287cf5b700 1 --2- 172.21.15.26:0/3674319025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28780f6530 0x7f287806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:07.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.670+0000 7f287cf5b700 1 -- 172.21.15.26:0/3674319025 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2874005040 con 0x7f28780f77d0 2021-11-03T16:54:07.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.670+0000 7f287cf5b700 1 --2- 172.21.15.26:0/3674319025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28780f77d0 0x7f2878069e20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f2868002700 tx=0x7f2868009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:54:07.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.670+0000 7f286dffb700 1 -- 172.21.15.26:0/3674319025 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2868009320 con 0x7f28780f77d0 2021-11-03T16:54:07.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.670+0000 7f287e75e700 1 -- 172.21.15.26:0/3674319025 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f287806a3d0 con 0x7f28780f77d0 2021-11-03T16:54:07.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.670+0000 7f286dffb700 1 -- 172.21.15.26:0/3674319025 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f286800f040 con 0x7f28780f77d0 2021-11-03T16:54:07.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.670+0000 7f286dffb700 1 -- 172.21.15.26:0/3674319025 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2868014870 con 0x7f28780f77d0 2021-11-03T16:54:07.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.670+0000 7f287e75e700 1 -- 172.21.15.26:0/3674319025 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f287806a990 con 0x7f28780f77d0 2021-11-03T16:54:07.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.671+0000 7f287e75e700 1 -- 172.21.15.26:0/3674319025 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2878045ad0 con 0x7f28780f77d0 2021-11-03T16:54:07.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.672+0000 7f286dffb700 1 -- 172.21.15.26:0/3674319025 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f2868009480 con 0x7f28780f77d0 2021-11-03T16:54:07.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.672+0000 7f286dffb700 1 --2- 172.21.15.26:0/3674319025 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f286405c300 0x7f286405e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:54:07.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.672+0000 7f286dffb700 1 -- 172.21.15.26:0/3674319025 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f28680761c0 con 0x7f28780f77d0 2021-11-03T16:54:07.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.672+0000 7f287d75c700 1 --2- 172.21.15.26:0/3674319025 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f286405c300 0x7f286405e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:54:07.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.673+0000 7f287d75c700 1 --2- 172.21.15.26:0/3674319025 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f286405c300 0x7f286405e7c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f2874013690 tx=0x7f2874009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:54:07.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.680+0000 7f286dffb700 1 -- 172.21.15.26:0/3674319025 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f2868048ea0 con 0x7f28780f77d0 2021-11-03T16:54:07.883 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.887+0000 7f287e75e700 1 -- 172.21.15.26:0/3674319025 --> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f28780fecf0 con 0x7f286405c300 2021-11-03T16:54:07.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.900+0000 7f286dffb700 1 -- 172.21.15.26:0/3674319025 <== mgr.14162 v2:172.21.15.26:6800/3029163595 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2728 (secure 0 0 0) 0x7f28780fecf0 con 0x7f286405c300 2021-11-03T16:54:07.897 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE VERSION IMAGE ID CONTAINER ID 2021-11-03T16:54:07.898 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (5m) 85s ago 6m 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T16:54:07.898 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (6m) 85s ago 6m 16.2.4 8d91d370c2b8 83a448d79108 2021-11-03T16:54:07.898 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (5m) 88s ago 5m 16.2.4 8d91d370c2b8 708c0ec0397b 2021-11-03T16:54:07.899 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (5m) 85s ago 6m 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T16:54:07.899 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (105s) 85s ago 104s 16.2.4 8d91d370c2b8 0500d47c638e 2021-11-03T16:54:07.899 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (99s) 85s ago 98s 16.2.4 8d91d370c2b8 638170268dac 2021-11-03T16:54:07.899 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (108s) 88s ago 108s 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T16:54:07.900 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (102s) 88s ago 102s 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T16:54:07.900 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:9283 running (7m) 85s ago 7m 16.2.4 8d91d370c2b8 65362b14caeb 2021-11-03T16:54:07.900 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8443,9283 running (5m) 88s ago 5m 16.2.4 8d91d370c2b8 e07291aea712 2021-11-03T16:54:07.900 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (8m) 85s ago 8m 16.2.4 8d91d370c2b8 c37e54308890 2021-11-03T16:54:07.900 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (5m) 88s ago 5m 16.2.4 8d91d370c2b8 b688a2953f0a 2021-11-03T16:54:07.901 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (6m) 85s ago 6m 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T16:54:07.901 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (5m) 88s ago 5m 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T16:54:07.901 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (5m) 85s ago 5m 16.2.4 8d91d370c2b8 d7f900ddf0f3 2021-11-03T16:54:07.902 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (4m) 85s ago 4m 16.2.4 8d91d370c2b8 9e5ffa11984b 2021-11-03T16:54:07.902 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (4m) 85s ago 4m 16.2.4 8d91d370c2b8 f65145633c0e 2021-11-03T16:54:07.902 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (3m) 88s ago 3m 16.2.4 8d91d370c2b8 ff6d474a5f9a 2021-11-03T16:54:07.903 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (3m) 88s ago 3m 16.2.4 8d91d370c2b8 e2fc9c0bdf0f 2021-11-03T16:54:07.903 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (3m) 88s ago 3m 16.2.4 8d91d370c2b8 0abc64d8a2bf 2021-11-03T16:54:07.903 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (5m) 85s ago 5m 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T16:54:07.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.902+0000 7f287e75e700 1 -- 172.21.15.26:0/3674319025 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f286405c300 msgr2=0x7f286405e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:54:07.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.902+0000 7f287e75e700 1 --2- 172.21.15.26:0/3674319025 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f286405c300 0x7f286405e7c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f2874013690 tx=0x7f2874009b30).stop 2021-11-03T16:54:07.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.902+0000 7f287e75e700 1 -- 172.21.15.26:0/3674319025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28780f77d0 msgr2=0x7f2878069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:54:07.906 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.902+0000 7f287e75e700 1 --2- 172.21.15.26:0/3674319025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28780f77d0 0x7f2878069e20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f2868002700 tx=0x7f2868009e00).stop 2021-11-03T16:54:07.906 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.902+0000 7f287e75e700 1 -- 172.21.15.26:0/3674319025 shutdown_connections 2021-11-03T16:54:07.906 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.902+0000 7f287e75e700 1 --2- 172.21.15.26:0/3674319025 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f286405c300 0x7f286405e7c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:07.907 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.902+0000 7f287e75e700 1 --2- 172.21.15.26:0/3674319025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28780f6530 0x7f287806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:07.907 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.902+0000 7f287e75e700 1 --2- 172.21.15.26:0/3674319025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28780f77d0 0x7f2878069e20 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:07.907 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.902+0000 7f287e75e700 1 -- 172.21.15.26:0/3674319025 >> 172.21.15.26:0/3674319025 conn(0x7f28780f1c90 msgr2=0x7f28780fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:54:07.907 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.902+0000 7f287e75e700 1 -- 172.21.15.26:0/3674319025 shutdown_connections 2021-11-03T16:54:07.908 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:07.902+0000 7f287e75e700 1 -- 172.21.15.26:0/3674319025 wait complete. 2021-11-03T16:54:08.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.018+0000 7faab45d6700 1 -- 172.21.15.26:0/1192411195 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faaac0f9820 msgr2=0x7faaac0fbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:54:08.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.018+0000 7faab45d6700 1 --2- 172.21.15.26:0/1192411195 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faaac0f9820 0x7faaac0fbc70 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7faa9c004660 tx=0x7faa9c009b30).stop 2021-11-03T16:54:08.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.018+0000 7faab45d6700 1 -- 172.21.15.26:0/1192411195 shutdown_connections 2021-11-03T16:54:08.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.018+0000 7faab45d6700 1 --2- 172.21.15.26:0/1192411195 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faaac0f9820 0x7faaac0fbc70 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:08.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.018+0000 7faab45d6700 1 --2- 172.21.15.26:0/1192411195 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faaac060310 0x7faaac0f92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:08.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.018+0000 7faab45d6700 1 -- 172.21.15.26:0/1192411195 >> 172.21.15.26:0/1192411195 conn(0x7faaac0f0d40 msgr2=0x7faaac0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:54:08.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.018+0000 7faab45d6700 1 -- 172.21.15.26:0/1192411195 shutdown_connections 2021-11-03T16:54:08.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.018+0000 7faab45d6700 1 -- 172.21.15.26:0/1192411195 wait complete. 2021-11-03T16:54:08.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.019+0000 7faab45d6700 1 Processor -- start 2021-11-03T16:54:08.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.019+0000 7faab45d6700 1 -- start start 2021-11-03T16:54:08.019 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.019+0000 7faab45d6700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faaac060310 0x7faaac106eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:54:08.019 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.019+0000 7faab45d6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faaac0f9820 0x7faaac1073a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:54:08.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.019+0000 7faab45d6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaac107950 con 0x7faaac0f9820 2021-11-03T16:54:08.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.019+0000 7faab45d6700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaac107a90 con 0x7faaac060310 2021-11-03T16:54:08.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.019+0000 7faab1b71700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faaac0f9820 0x7faaac1073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:54:08.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.019+0000 7faab1b71700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faaac0f9820 0x7faaac1073a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50390/0 (socket says 172.21.15.26:50390) 2021-11-03T16:54:08.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.019+0000 7faab1b71700 1 -- 172.21.15.26:0/1831502396 learned_addr learned my addr 172.21.15.26:0/1831502396 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:54:08.021 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.019+0000 7faab2372700 1 --2- 172.21.15.26:0/1831502396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faaac060310 0x7faaac106eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:54:08.021 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.020+0000 7faab1b71700 1 -- 172.21.15.26:0/1831502396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faaac060310 msgr2=0x7faaac106eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:54:08.021 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.020+0000 7faab1b71700 1 --2- 172.21.15.26:0/1831502396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faaac060310 0x7faaac106eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:08.021 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.020+0000 7faab1b71700 1 -- 172.21.15.26:0/1831502396 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa9c005040 con 0x7faaac0f9820 2021-11-03T16:54:08.022 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.020+0000 7faab1b71700 1 --2- 172.21.15.26:0/1831502396 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faaac0f9820 0x7faaac1073a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7faa9c014040 tx=0x7faa9c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:54:08.022 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.020+0000 7faaa2ffd700 1 -- 172.21.15.26:0/1831502396 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa9c019070 con 0x7faaac0f9820 2021-11-03T16:54:08.022 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.020+0000 7faab45d6700 1 -- 172.21.15.26:0/1831502396 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaac1083d0 con 0x7faaac0f9820 2021-11-03T16:54:08.022 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.020+0000 7faaa2ffd700 1 -- 172.21.15.26:0/1831502396 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7faa9c007e70 con 0x7faaac0f9820 2021-11-03T16:54:08.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.020+0000 7faaa2ffd700 1 -- 172.21.15.26:0/1831502396 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa9c014d10 con 0x7faaac0f9820 2021-11-03T16:54:08.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.020+0000 7faab45d6700 1 -- 172.21.15.26:0/1831502396 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaac108930 con 0x7faaac0f9820 2021-11-03T16:54:08.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.021+0000 7faaa2ffd700 1 -- 172.21.15.26:0/1831502396 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7faa9c025070 con 0x7faaac0f9820 2021-11-03T16:54:08.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.021+0000 7faab45d6700 1 -- 172.21.15.26:0/1831502396 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaac045ad0 con 0x7faaac0f9820 2021-11-03T16:54:08.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.022+0000 7faaa2ffd700 1 --2- 172.21.15.26:0/1831502396 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7faa9805c2b0 0x7faa9805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:54:08.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.022+0000 7faaa2ffd700 1 -- 172.21.15.26:0/1831502396 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7faa9c076de0 con 0x7faaac0f9820 2021-11-03T16:54:08.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.022+0000 7faab2372700 1 --2- 172.21.15.26:0/1831502396 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7faa9805c2b0 0x7faa9805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:54:08.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.022+0000 7faab2372700 1 --2- 172.21.15.26:0/1831502396 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7faa9805c2b0 0x7faa9805e770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7faaa8009fd0 tx=0x7faaa800b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:54:08.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.026+0000 7faaa2ffd700 1 -- 172.21.15.26:0/1831502396 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7faa9c049b40 con 0x7faaac0f9820 2021-11-03T16:54:08.295 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.299+0000 7faab45d6700 1 -- 172.21.15.26:0/1831502396 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7faaac027a00 con 0x7faaac0f9820 2021-11-03T16:54:08.296 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.300+0000 7faaa2ffd700 1 -- 172.21.15.26:0/1831502396 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+573 (secure 0 0 0) 0x7faa9c04d160 con 0x7faaac0f9820 2021-11-03T16:54:08.296 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T16:54:08.296 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T16:54:08.297 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2021-11-03T16:54:08.297 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:54:08.297 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T16:54:08.298 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2021-11-03T16:54:08.298 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:54:08.298 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T16:54:08.298 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2021-11-03T16:54:08.299 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:54:08.299 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T16:54:08.299 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T16:54:08.300 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:54:08.300 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T16:54:08.300 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 14 2021-11-03T16:54:08.300 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T16:54:08.301 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T16:54:08.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.302+0000 7faab45d6700 1 -- 172.21.15.26:0/1831502396 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7faa9805c2b0 msgr2=0x7faa9805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:54:08.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.302+0000 7faab45d6700 1 --2- 172.21.15.26:0/1831502396 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7faa9805c2b0 0x7faa9805e770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7faaa8009fd0 tx=0x7faaa800b040).stop 2021-11-03T16:54:08.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.302+0000 7faab45d6700 1 -- 172.21.15.26:0/1831502396 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faaac0f9820 msgr2=0x7faaac1073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:54:08.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.302+0000 7faab45d6700 1 --2- 172.21.15.26:0/1831502396 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faaac0f9820 0x7faaac1073a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7faa9c014040 tx=0x7faa9c00b040).stop 2021-11-03T16:54:08.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.302+0000 7faab45d6700 1 -- 172.21.15.26:0/1831502396 shutdown_connections 2021-11-03T16:54:08.303 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.302+0000 7faab45d6700 1 --2- 172.21.15.26:0/1831502396 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7faa9805c2b0 0x7faa9805e770 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:08.303 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.302+0000 7faab45d6700 1 --2- 172.21.15.26:0/1831502396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faaac060310 0x7faaac106eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:08.303 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.302+0000 7faab45d6700 1 --2- 172.21.15.26:0/1831502396 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faaac0f9820 0x7faaac1073a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:08.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.302+0000 7faab45d6700 1 -- 172.21.15.26:0/1831502396 >> 172.21.15.26:0/1831502396 conn(0x7faaac0f0d40 msgr2=0x7faaac0f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:54:08.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.302+0000 7faab45d6700 1 -- 172.21.15.26:0/1831502396 shutdown_connections 2021-11-03T16:54:08.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.302+0000 7faab45d6700 1 -- 172.21.15.26:0/1831502396 wait complete. 2021-11-03T16:54:08.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.447+0000 7f910b59b700 1 -- 172.21.15.26:0/323224425 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91040f6860 msgr2=0x7f91040f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:54:08.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.447+0000 7f910b59b700 1 --2- 172.21.15.26:0/323224425 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91040f6860 0x7f91040f6cc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f90f4004660 tx=0x7f90f4009b30).stop 2021-11-03T16:54:08.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.447+0000 7f910b59b700 1 -- 172.21.15.26:0/323224425 shutdown_connections 2021-11-03T16:54:08.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.447+0000 7f910b59b700 1 --2- 172.21.15.26:0/323224425 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91040f6860 0x7f91040f6cc0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:08.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.447+0000 7f910b59b700 1 --2- 172.21.15.26:0/323224425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91040f55c0 0x7f91040f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:08.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.447+0000 7f910b59b700 1 -- 172.21.15.26:0/323224425 >> 172.21.15.26:0/323224425 conn(0x7f91040f0d40 msgr2=0x7f91040f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:54:08.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.447+0000 7f910b59b700 1 -- 172.21.15.26:0/323224425 shutdown_connections 2021-11-03T16:54:08.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.447+0000 7f910b59b700 1 -- 172.21.15.26:0/323224425 wait complete. 2021-11-03T16:54:08.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.448+0000 7f910b59b700 1 Processor -- start 2021-11-03T16:54:08.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.448+0000 7f910b59b700 1 -- start start 2021-11-03T16:54:08.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.448+0000 7f910b59b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91040f55c0 0x7f9104106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:54:08.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.448+0000 7f910b59b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91040f6860 0x7f91041073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:54:08.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.448+0000 7f910b59b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9104107990 con 0x7f91040f6860 2021-11-03T16:54:08.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.448+0000 7f910b59b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9104107ad0 con 0x7f91040f55c0 2021-11-03T16:54:08.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.448+0000 7f9108b36700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91040f6860 0x7f91041073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:54:08.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.448+0000 7f9109337700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91040f55c0 0x7f9104106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:54:08.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.448+0000 7f9108b36700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91040f6860 0x7f91041073e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50400/0 (socket says 172.21.15.26:50400) 2021-11-03T16:54:08.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.448+0000 7f9108b36700 1 -- 172.21.15.26:0/81226497 learned_addr learned my addr 172.21.15.26:0/81226497 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:54:08.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.448+0000 7f9109337700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91040f55c0 0x7f9104106ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.26:54604/0 (socket says 172.21.15.26:54604) 2021-11-03T16:54:08.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.449+0000 7f9108b36700 1 -- 172.21.15.26:0/81226497 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91040f55c0 msgr2=0x7f9104106ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:54:08.450 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.449+0000 7f9108b36700 1 --2- 172.21.15.26:0/81226497 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91040f55c0 0x7f9104106ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:08.450 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.449+0000 7f9108b36700 1 -- 172.21.15.26:0/81226497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f4005040 con 0x7f91040f6860 2021-11-03T16:54:08.450 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.449+0000 7f9108b36700 1 --2- 172.21.15.26:0/81226497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91040f6860 0x7f91041073e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f90f4009990 tx=0x7f90f4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:54:08.451 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.449+0000 7f90f9ffb700 1 -- 172.21.15.26:0/81226497 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90f4018070 con 0x7f91040f6860 2021-11-03T16:54:08.452 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.449+0000 7f910b59b700 1 -- 172.21.15.26:0/81226497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9104108410 con 0x7f91040f6860 2021-11-03T16:54:08.452 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.449+0000 7f90f9ffb700 1 -- 172.21.15.26:0/81226497 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f90f4007ba0 con 0x7f91040f6860 2021-11-03T16:54:08.452 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.449+0000 7f90f9ffb700 1 -- 172.21.15.26:0/81226497 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90f401c3c0 con 0x7f91040f6860 2021-11-03T16:54:08.452 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.449+0000 7f910b59b700 1 -- 172.21.15.26:0/81226497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9104108970 con 0x7f91040f6860 2021-11-03T16:54:08.453 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.451+0000 7f90f9ffb700 1 -- 172.21.15.26:0/81226497 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f90f401d420 con 0x7f91040f6860 2021-11-03T16:54:08.453 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.451+0000 7f910b59b700 1 -- 172.21.15.26:0/81226497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9104045ad0 con 0x7f91040f6860 2021-11-03T16:54:08.453 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.451+0000 7f90f9ffb700 1 --2- 172.21.15.26:0/81226497 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f90f005c2b0 0x7f90f005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:54:08.453 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.451+0000 7f90f9ffb700 1 -- 172.21.15.26:0/81226497 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f90f4077b80 con 0x7f91040f6860 2021-11-03T16:54:08.454 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.451+0000 7f9109337700 1 --2- 172.21.15.26:0/81226497 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f90f005c2b0 0x7f90f005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:54:08.454 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.451+0000 7f9109337700 1 --2- 172.21.15.26:0/81226497 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f90f005c2b0 0x7f90f005e770 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f91040f66c0 tx=0x7f910000b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:54:08.455 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.457+0000 7f90f9ffb700 1 -- 172.21.15.26:0/81226497 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f90f404a800 con 0x7f91040f6860 2021-11-03T16:54:08.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:08 smithi194 conmon[35111]: cluster 2021-11-03T16:54:07.066686+0000 mgr.smithi026.cnrxli (mgr. 2021-11-03T16:54:08.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:08 smithi194 conmon[35111]: 14162) 291 : cluster [DBG] pgmap v240: 65 pgs: 65 active+clean; 115 MiB data, 487 MiB used, 536 GiB / 536 GiB avail; 6.1 MiB/s wr, 703 op/s 2021-11-03T16:54:08.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:08 smithi026 conmon[32119]: cluster 2021-11-03T16:54:07.066686+0000 mgr.smithi026.cnrxli (mgr 2021-11-03T16:54:08.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:08 smithi026 conmon[32119]: .14162) 291 : cluster [DBG] pgmap v240: 65 pgs: 65 active+clean; 115 MiB data, 487 MiB used, 536 GiB / 536 GiB avail; 6.1 MiB/s wr, 703 op/s 2021-11-03T16:54:08.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.678+0000 7f910b59b700 1 -- 172.21.15.26:0/81226497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9104109070 con 0x7f91040f6860 2021-11-03T16:54:08.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.678+0000 7f90f9ffb700 1 -- 172.21.15.26:0/81226497 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 9 v9) v1 ==== 75+0+1618 (secure 0 0 0) 0x7f90f404de20 con 0x7f91040f6860 2021-11-03T16:54:08.675 INFO:teuthology.orchestra.run.smithi026.stdout:e9 2021-11-03T16:54:08.675 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T16:54:08.676 INFO:teuthology.orchestra.run.smithi026.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T16:54:08.676 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T16:54:08.676 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:54:08.677 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T16:54:08.677 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T16:54:08.678 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 6 2021-11-03T16:54:08.678 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 2021-11-03T16:54:08.678 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T16:54:08.679 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:52:28.058778+0000 2021-11-03T16:54:08.679 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T16:54:08.679 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T16:54:08.679 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T16:54:08.680 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T16:54:08.680 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T16:54:08.680 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T16:54:08.680 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T16:54:08.681 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 0 2021-11-03T16:54:08.681 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T16:54:08.681 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T16:54:08.681 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T16:54:08.681 INFO:teuthology.orchestra.run.smithi026.stdout:up {0=14422} 2021-11-03T16:54:08.682 INFO:teuthology.orchestra.run.smithi026.stdout:failed 2021-11-03T16:54:08.682 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T16:54:08.682 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T16:54:08.683 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T16:54:08.683 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T16:54:08.683 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T16:54:08.684 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T16:54:08.684 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T16:54:08.684 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{0:14422} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.26:6826/665235785,v1:172.21.15.26:6827/665235785]] 2021-11-03T16:54:08.685 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:54:08.685 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:54:08.685 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T16:54:08.685 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:54:08.686 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14436} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.26:6828/3059137105,v1:172.21.15.26:6829/3059137105]] 2021-11-03T16:54:08.686 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921]] 2021-11-03T16:54:08.686 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844]] 2021-11-03T16:54:08.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.680+0000 7f910b59b700 1 -- 172.21.15.26:0/81226497 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f90f005c2b0 msgr2=0x7f90f005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:54:08.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.680+0000 7f910b59b700 1 --2- 172.21.15.26:0/81226497 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f90f005c2b0 0x7f90f005e770 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f91040f66c0 tx=0x7f910000b040).stop 2021-11-03T16:54:08.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.680+0000 7f910b59b700 1 -- 172.21.15.26:0/81226497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91040f6860 msgr2=0x7f91041073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:54:08.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.680+0000 7f910b59b700 1 --2- 172.21.15.26:0/81226497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91040f6860 0x7f91041073e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f90f4009990 tx=0x7f90f4009b30).stop 2021-11-03T16:54:08.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.680+0000 7f910b59b700 1 -- 172.21.15.26:0/81226497 shutdown_connections 2021-11-03T16:54:08.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.680+0000 7f910b59b700 1 --2- 172.21.15.26:0/81226497 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f90f005c2b0 0x7f90f005e770 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:08.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.680+0000 7f910b59b700 1 --2- 172.21.15.26:0/81226497 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91040f55c0 0x7f9104106ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:08.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.680+0000 7f910b59b700 1 --2- 172.21.15.26:0/81226497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91040f6860 0x7f91041073e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:08.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.680+0000 7f910b59b700 1 -- 172.21.15.26:0/81226497 >> 172.21.15.26:0/81226497 conn(0x7f91040f0d40 msgr2=0x7f910405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:54:08.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.680+0000 7f910b59b700 1 -- 172.21.15.26:0/81226497 shutdown_connections 2021-11-03T16:54:08.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:08.681+0000 7f910b59b700 1 -- 172.21.15.26:0/81226497 wait complete. 2021-11-03T16:54:08.690 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 9 2021-11-03T16:54:09.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:09 smithi194 conmon[35111]: audit 2021-11-03T16:54:07.557579+0000 mgr.smithi026.cnrxli (mgr.14162) 2021-11-03T16:54:09.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:09 smithi194 conmon[35111]: 292 : audit [DBG] from='client.14528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:54:09.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:09 smithi194 conmon[35111]: audit 2021-11-03T16:54:07.890064+0000 mgr.smithi026.cnrxli (mgr.14162) 293 : audit [DBG] from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:54:09.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:09 smithi194 conmon[35111]: audit 2021 2021-11-03T16:54:09.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:09 smithi194 conmon[35111]: -11-03T16:54:08.301219+0000 mon.smithi026 ( 2021-11-03T16:54:09.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:09 smithi194 conmon[35111]: mon.0) 554 : audit [DBG] from='client.? 172.21.15.26:0/1831502396' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:54:09.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:09 smithi194 conmon[35111]: audit 2021 2021-11-03T16:54:09.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:09 smithi194 conmon[35111]: -11-03T16:54:08.680339+0000 mon.smithi026 2021-11-03T16:54:09.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:09 smithi194 conmon[35111]: (mon.0) 555 : audit [DBG] from='client.? 172.21.15.26:0/81226497' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T16:54:09.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:09 smithi194 conmon[35111]: audit 2021-11-03T16: 2021-11-03T16:54:09.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:09 smithi194 conmon[35111]: 54:09.186626+0000 mon.smithi026 (mon.0) 556 : audit [INF] 2021-11-03T16:54:09.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:09 smithi194 conmon[35111]: from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T16:54:09.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:09 smithi194 conmon[35111]: audit 2021-11-03T16:54:09.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:09 smithi194 conmon[35111]: 2021-11-03T16:54:09.186886+0000 mon.smithi026 (mon.0) 2021-11-03T16:54:09.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:09 smithi194 conmon[35111]: 557 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T16:54:09.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:09 smithi026 conmon[32119]: audit 2021-11-03T16:54:07.557579+0000 mgr.smithi026.cnrxli ( 2021-11-03T16:54:09.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:09 smithi026 conmon[32119]: mgr.14162) 292 : audit [DBG] from='client.14528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:54:09.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:09 smithi026 conmon[32119]: audit 2021-11-03T16:54:07.890064+0000 mgr.smithi026.cnrxli (mgr.14162) 293 : audit [DBG] from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:54:09.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:09 smithi026 conmon[32119]: 2021-11-03T16:54:09.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:09 smithi026 conmon[32119]: audit 2021-11-03T16:54:08.301219+0000 mon.smithi026 (mon.0) 554 : audit 2021-11-03T16:54:09.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:09 smithi026 conmon[32119]: [DBG] from='client.? 172.21.15.26:0/1831502396' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:54:09.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:09 smithi026 conmon[32119]: audit 2021-11-03T16 2021-11-03T16:54:09.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:09 smithi026 conmon[32119]: :54:08.680339+0000 mon.smithi026 (mon.0) 555 : audit [DBG] from='client.? 172.21.15.26:0/81226497' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T16:54:09.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:09 smithi026 conmon[32119]: audit 2021-11-03T16 2021-11-03T16:54:09.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:09 smithi026 conmon[32119]: :54:09.186626+0000 mon.smithi026 (mon.0) 556 : audit [INF] 2021-11-03T16:54:09.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:09 smithi026 conmon[32119]: from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T16:54:09.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:09 smithi026 conmon[32119]: audit 2021-11 2021-11-03T16:54:09.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:09 smithi026 conmon[32119]: -03T16:54:09.186886+0000 mon.smithi026 (mon.0) 557 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T16:54:09.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:09 smithi026 conmon[32119]: 2021-11-03T16:54:10.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:10 smithi194 conmon[35111]: cluster 2021-11-03T16:54:09.067102+0000 mgr.smithi026.cnrxli (mgr.14162 2021-11-03T16:54:10.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:10 smithi194 conmon[35111]: ) 294 : cluster [DBG] pgmap v241: 65 pgs: 65 active+clean; 119 MiB data, 522 MiB used, 536 GiB / 536 GiB avail; 5.6 MiB/s wr, 653 op/s 2021-11-03T16:54:10.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:10 smithi026 conmon[32119]: cluster 2021-11-03T16:54:09.067102+0000 mgr.smithi026.cnrxli (mgr.14162 2021-11-03T16:54:10.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:10 smithi026 conmon[32119]: ) 294 : cluster [DBG] pgmap v241: 65 pgs: 65 active+clean; 119 MiB data, 522 MiB used, 536 GiB / 536 GiB avail; 5.6 MiB/s wr, 653 op/s 2021-11-03T16:54:12.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:12 smithi194 conmon[35111]: cluster 2021-11-03T16:54:11.067511+0000 mgr.smithi026.cnrxli (mgr.14162) 295 : cluster 2021-11-03T16:54:12.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:12 smithi194 conmon[35111]: [DBG] pgmap v242: 65 pgs: 65 active+clean; 123 MiB data, 540 MiB used, 536 GiB / 536 GiB avail; 5.3 MiB/s wr, 655 op/s 2021-11-03T16:54:12.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:12 smithi026 conmon[32119]: cluster 2021-11-03T16:54:11.067511 2021-11-03T16:54:12.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:12 smithi026 conmon[32119]: +0000 mgr.smithi026.cnrxli (mgr.14162) 295 : cluster [DBG] pgmap v242: 65 pgs: 65 active+clean; 123 MiB data, 540 MiB used, 536 GiB / 536 GiB avail; 5.3 MiB/s wr, 655 op/s 2021-11-03T16:54:14.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:14 smithi194 conmon[35111]: cluster 2021-11-03T16:54:13.069710+0000 mgr.smithi026.cnrxli (mgr.14162) 2021-11-03T16:54:14.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:14 smithi194 conmon[35111]: 296 : cluster [DBG] pgmap v243: 65 pgs: 65 active+clean; 126 MiB data, 555 MiB used, 536 GiB / 536 GiB avail; 5.5 MiB/s wr, 698 op/s 2021-11-03T16:54:14.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:14 smithi026 conmon[32119]: cluster 2021-11-03T16:54:13.069710+0000 2021-11-03T16:54:14.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:14 smithi026 conmon[32119]: mgr.smithi026.cnrxli (mgr.14162) 296 : cluster [DBG] pgmap v243: 65 pgs: 65 active+clean; 126 MiB data, 555 MiB used, 536 GiB / 536 GiB avail; 5.5 MiB/s wr, 698 op/s 2021-11-03T16:54:16.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:16 smithi194 conmon[35111]: cluster 2021-11-03T16:54:15.070064+0000 mgr.smithi026.cnrxli (mgr. 2021-11-03T16:54:16.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:16 smithi194 conmon[35111]: 14162) 297 : cluster [DBG] pgmap v244: 65 pgs: 65 active+clean; 130 MiB data, 566 MiB used, 536 GiB / 536 GiB avail; 4.2 MiB/s wr, 518 op/s 2021-11-03T16:54:16.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:16 smithi026 conmon[32119]: cluster 2021-11-03T16:54:15. 2021-11-03T16:54:16.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:16 smithi026 conmon[32119]: 070064+0000 mgr.smithi026.cnrxli (mgr.14162) 297 : cluster [DBG] pgmap v244: 65 pgs: 65 active+clean; 130 MiB data, 566 MiB used, 536 GiB / 536 GiB avail; 4.2 MiB/s wr, 518 op/s 2021-11-03T16:54:17.876 INFO:tasks.workunit.client.1.smithi194.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2021-11-03T16:54:17.889 INFO:tasks.workunit.client.1.smithi194.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2021-11-03T16:54:17.890 INFO:tasks.workunit.client.1.smithi194.stderr:+ make 2021-11-03T16:54:18.429 INFO:tasks.workunit.client.1.smithi194.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2021-11-03T16:54:18.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:18 smithi194 conmon[35111]: cluster 2021-11-03T16:54:17.070490+0000 mgr.smithi026.cnrxli (mgr.14162) 2021-11-03T16:54:18.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:18 smithi194 conmon[35111]: 298 : cluster [DBG] pgmap v245: 65 pgs: 65 active+clean; 143 MiB data, 634 MiB used, 536 GiB / 536 GiB avail; 4.3 MiB/s wr, 614 op/s 2021-11-03T16:54:18.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:18 smithi026 conmon[32119]: cluster 2021-11-03T16:54:17. 2021-11-03T16:54:18.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:18 smithi026 conmon[32119]: 070490+0000 mgr.smithi026.cnrxli (mgr.14162) 298 : cluster [DBG] pgmap v245: 65 pgs: 65 active+clean; 143 MiB data, 634 MiB used, 536 GiB / 536 GiB avail; 4.3 MiB/s wr, 614 op/s 2021-11-03T16:54:18.713 INFO:tasks.workunit.client.1.smithi194.stderr:++ readlink -f fsstress 2021-11-03T16:54:18.714 INFO:tasks.workunit.client.1.smithi194.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2021-11-03T16:54:18.714 INFO:tasks.workunit.client.1.smithi194.stderr:+ popd 2021-11-03T16:54:18.715 INFO:tasks.workunit.client.1.smithi194.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2021-11-03T16:54:18.715 INFO:tasks.workunit.client.1.smithi194.stderr:+ popd 2021-11-03T16:54:18.716 INFO:tasks.workunit.client.1.smithi194.stdout:~/cephtest/mnt.1/client.1/tmp 2021-11-03T16:54:18.716 INFO:tasks.workunit.client.1.smithi194.stderr:++ mktemp -d -p . 2021-11-03T16:54:18.717 INFO:tasks.workunit.client.1.smithi194.stderr:+ T=./tmp.caPxiOBPG4 2021-11-03T16:54:18.717 INFO:tasks.workunit.client.1.smithi194.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.caPxiOBPG4 -l 1 -n 1000 -p 10 -v 2021-11-03T16:54:18.720 INFO:tasks.workunit.client.1.smithi194.stdout:seed = 1636412808 2021-11-03T16:54:18.733 INFO:tasks.workunit.client.1.smithi194.stdout:1/0: mkdir d0 0 2021-11-03T16:54:18.733 INFO:tasks.workunit.client.1.smithi194.stdout:1/1: chown d0 77 1 2021-11-03T16:54:18.945 INFO:tasks.workunit.client.1.smithi194.stdout:6/0: link - no file 2021-11-03T16:54:18.945 INFO:tasks.workunit.client.1.smithi194.stdout:4/0: mknod c0 1 2021-11-03T16:54:18.946 INFO:tasks.workunit.client.1.smithi194.stdout:4/1: write - no filename 2021-11-03T16:54:18.946 INFO:tasks.workunit.client.1.smithi194.stdout:4/2: readlink - no filename 2021-11-03T16:54:18.946 INFO:tasks.workunit.client.1.smithi194.stdout:4/3: chown . 13464256 1 2021-11-03T16:54:18.946 INFO:tasks.workunit.client.1.smithi194.stdout:5/0: getdents . 0 2021-11-03T16:54:18.947 INFO:tasks.workunit.client.1.smithi194.stdout:7/0: chown . 13391231 1 2021-11-03T16:54:18.948 INFO:tasks.workunit.client.1.smithi194.stdout:3/0: chown . 54593651 1 2021-11-03T16:54:18.948 INFO:tasks.workunit.client.1.smithi194.stdout:7/1: read - no filename 2021-11-03T16:54:18.948 INFO:tasks.workunit.client.1.smithi194.stdout:7/2: getdents . 0 2021-11-03T16:54:18.948 INFO:tasks.workunit.client.1.smithi194.stdout:7/3: link - no file 2021-11-03T16:54:18.949 INFO:tasks.workunit.client.1.smithi194.stdout:7/4: chown . 96749 1 2021-11-03T16:54:18.949 INFO:tasks.workunit.client.1.smithi194.stdout:7/5: truncate - no filename 2021-11-03T16:54:18.949 INFO:tasks.workunit.client.1.smithi194.stdout:6/1: getdents . 0 2021-11-03T16:54:18.949 INFO:tasks.workunit.client.1.smithi194.stdout:6/2: dread - no filename 2021-11-03T16:54:20.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:20 smithi194 conmon[35111]: cluster 2021-11-03T16:54:19. 2021-11-03T16:54:20.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:20 smithi194 conmon[35111]: 070939+0000 mgr.smithi026.cnrxli (mgr.14162) 299 : cluster [DBG] pgmap v246: 65 pgs: 65 active+clean; 158 MiB data, 694 MiB used, 536 GiB / 536 GiB avail; 3.9 MiB/s wr, 470 op/s 2021-11-03T16:54:20.558 INFO:tasks.workunit.client.1.smithi194.stdout:4/4: creat f1 x:0 0 0 2021-11-03T16:54:20.559 INFO:tasks.workunit.client.1.smithi194.stdout:4/5: mknod c2 1 2021-11-03T16:54:20.559 INFO:tasks.workunit.client.1.smithi194.stdout:4/6: mknod c3 1 2021-11-03T16:54:20.561 INFO:tasks.workunit.client.1.smithi194.stdout:5/1: creat f0 x:0 0 0 2021-11-03T16:54:20.561 INFO:tasks.workunit.client.1.smithi194.stdout:5/2: stat f0 0 2021-11-03T16:54:20.562 INFO:tasks.workunit.client.1.smithi194.stdout:5/3: chown f0 0 1 2021-11-03T16:54:20.563 INFO:tasks.workunit.client.1.smithi194.stdout:3/1: symlink l0 0 2021-11-03T16:54:20.563 INFO:tasks.workunit.client.1.smithi194.stdout:3/2: readlink l0 0 2021-11-03T16:54:20.564 INFO:tasks.workunit.client.1.smithi194.stdout:3/3: dread - no filename 2021-11-03T16:54:20.564 INFO:tasks.workunit.client.1.smithi194.stdout:3/4: mknod c1 1 2021-11-03T16:54:20.564 INFO:tasks.workunit.client.1.smithi194.stdout:3/5: dwrite - no filename 2021-11-03T16:54:20.564 INFO:tasks.workunit.client.1.smithi194.stdout:3/6: dread - no filename 2021-11-03T16:54:20.566 INFO:tasks.workunit.client.1.smithi194.stdout:2/0: symlink l0 0 2021-11-03T16:54:20.566 INFO:tasks.workunit.client.1.smithi194.stdout:2/1: write - no filename 2021-11-03T16:54:20.566 INFO:tasks.workunit.client.1.smithi194.stdout:2/2: write - no filename 2021-11-03T16:54:20.567 INFO:tasks.workunit.client.1.smithi194.stdout:2/3: dread - no filename 2021-11-03T16:54:20.568 INFO:tasks.workunit.client.1.smithi194.stdout:9/0: creat f0 x:0 0 0 2021-11-03T16:54:20.570 INFO:tasks.workunit.client.1.smithi194.stdout:8/0: symlink l0 0 2021-11-03T16:54:20.571 INFO:tasks.workunit.client.1.smithi194.stdout:8/1: chown l0 117332724 1 2021-11-03T16:54:20.582 INFO:tasks.workunit.client.1.smithi194.stdout:5/4: dwrite f0 [0,4194304] 0 2021-11-03T16:54:20.588 INFO:tasks.workunit.client.1.smithi194.stdout:9/1: dwrite f0 [0,4194304] 0 2021-11-03T16:54:20.624 INFO:tasks.workunit.client.1.smithi194.stdout:4/7: creat f4 x:0 0 0 2021-11-03T16:54:20.628 INFO:tasks.workunit.client.1.smithi194.stdout:3/7: mkdir d2 0 2021-11-03T16:54:20.628 INFO:tasks.workunit.client.1.smithi194.stdout:3/8: mknod d2/c3 1 2021-11-03T16:54:20.628 INFO:tasks.workunit.client.1.smithi194.stdout:3/9: dread - no filename 2021-11-03T16:54:20.631 INFO:tasks.workunit.client.1.smithi194.stdout:2/4: unlink l0 0 2021-11-03T16:54:20.631 INFO:tasks.workunit.client.1.smithi194.stdout:2/5: rename - no filename 2021-11-03T16:54:20.631 INFO:tasks.workunit.client.1.smithi194.stdout:2/6: write - no filename 2021-11-03T16:54:20.631 INFO:tasks.workunit.client.1.smithi194.stdout:2/7: dread - no filename 2021-11-03T16:54:20.632 INFO:tasks.workunit.client.1.smithi194.stdout:2/8: dread - no filename 2021-11-03T16:54:20.632 INFO:tasks.workunit.client.1.smithi194.stdout:2/9: chown . 54385300 1 2021-11-03T16:54:20.632 INFO:tasks.workunit.client.1.smithi194.stdout:2/10: chown . 8756287 1 2021-11-03T16:54:20.635 INFO:tasks.workunit.client.1.smithi194.stdout:8/2: rename l0 to l1 0 2021-11-03T16:54:20.635 INFO:tasks.workunit.client.1.smithi194.stdout:8/3: dread - no filename 2021-11-03T16:54:20.641 INFO:tasks.workunit.client.1.smithi194.stdout:5/5: creat f1 x:0 0 0 2021-11-03T16:54:20.647 INFO:tasks.workunit.client.1.smithi194.stdout:4/8: creat f5 x:0 0 0 2021-11-03T16:54:20.659 INFO:tasks.workunit.client.1.smithi194.stdout:3/10: creat d2/f4 x:0 0 0 2021-11-03T16:54:20.662 INFO:tasks.workunit.client.1.smithi194.stdout:4/9: dwrite f1 [0,4194304] 0 2021-11-03T16:54:20.667 INFO:tasks.workunit.client.1.smithi194.stdout:2/11: creat f1 x:0 0 0 2021-11-03T16:54:20.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:20 smithi026 conmon[32119]: cluster 2021-11-03T16:54:19.070939+0000 mgr.smithi026.cnrxli (mgr.14162) 299 : cluster 2021-11-03T16:54:20.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:20 smithi026 conmon[32119]: [DBG] pgmap v246: 65 pgs: 65 active+clean; 158 MiB data, 694 MiB used, 536 GiB / 536 GiB avail; 3.9 MiB/s wr, 470 op/s 2021-11-03T16:54:20.726 INFO:tasks.workunit.client.1.smithi194.stdout:5/6: mkdir d2 0 2021-11-03T16:54:20.733 INFO:tasks.workunit.client.1.smithi194.stdout:5/7: dread f0 [0,4194304] 0 2021-11-03T16:54:20.868 INFO:tasks.workunit.client.1.smithi194.stdout:8/4: rename l1 to l2 0 2021-11-03T16:54:20.868 INFO:tasks.workunit.client.1.smithi194.stdout:8/5: mknod c3 1 2021-11-03T16:54:20.868 INFO:tasks.workunit.client.1.smithi194.stdout:8/6: dwrite - no filename 2021-11-03T16:54:20.869 INFO:tasks.workunit.client.1.smithi194.stdout:8/7: dread - no filename 2021-11-03T16:54:20.869 INFO:tasks.workunit.client.1.smithi194.stdout:8/8: write - no filename 2021-11-03T16:54:20.869 INFO:tasks.workunit.client.1.smithi194.stdout:8/9: truncate - no filename 2021-11-03T16:54:20.872 INFO:tasks.workunit.client.1.smithi194.stdout:9/2: truncate f0 2636307 0 2021-11-03T16:54:20.878 INFO:tasks.workunit.client.1.smithi194.stdout:3/11: symlink d2/l5 0 2021-11-03T16:54:20.878 INFO:tasks.workunit.client.1.smithi194.stdout:3/12: dread - d2/f4 zero size 2021-11-03T16:54:20.885 INFO:tasks.workunit.client.1.smithi194.stdout:2/12: symlink l2 0 2021-11-03T16:54:20.887 INFO:tasks.workunit.client.1.smithi194.stdout:5/8: mkdir d2/d3 0 2021-11-03T16:54:20.890 INFO:tasks.workunit.client.1.smithi194.stdout:8/10: rename l2 to l4 0 2021-11-03T16:54:20.890 INFO:tasks.workunit.client.1.smithi194.stdout:8/11: write - no filename 2021-11-03T16:54:20.891 INFO:tasks.workunit.client.1.smithi194.stdout:9/3: creat f1 x:0 0 0 2021-11-03T16:54:20.892 INFO:tasks.workunit.client.1.smithi194.stdout:9/4: truncate f1 417499 0 2021-11-03T16:54:20.892 INFO:tasks.workunit.client.1.smithi194.stdout:9/5: dread f1 [0,4194304] 0 2021-11-03T16:54:20.893 INFO:tasks.workunit.client.1.smithi194.stdout:3/13: getdents d2 0 2021-11-03T16:54:20.893 INFO:tasks.workunit.client.1.smithi194.stdout:3/14: read - d2/f4 zero size 2021-11-03T16:54:20.893 INFO:tasks.workunit.client.1.smithi194.stdout:3/15: dread - d2/f4 zero size 2021-11-03T16:54:20.895 INFO:tasks.workunit.client.1.smithi194.stdout:2/13: rename l2 to l3 0 2021-11-03T16:54:20.900 INFO:tasks.workunit.client.1.smithi194.stdout:9/6: dread f0 [0,4194304] 0 2021-11-03T16:54:20.902 INFO:tasks.workunit.client.1.smithi194.stdout:5/9: rename f1 to d2/d3/f4 0 2021-11-03T16:54:20.903 INFO:tasks.workunit.client.1.smithi194.stdout:5/10: write f0 [2083657,27849] 0 2021-11-03T16:54:20.904 INFO:tasks.workunit.client.1.smithi194.stdout:8/12: creat f5 x:0 0 0 2021-11-03T16:54:20.905 INFO:tasks.workunit.client.1.smithi194.stdout:8/13: truncate f5 166605 0 2021-11-03T16:54:20.905 INFO:tasks.workunit.client.1.smithi194.stdout:8/14: read f5 [158886,13502] 0 2021-11-03T16:54:20.906 INFO:tasks.workunit.client.1.smithi194.stdout:3/16: creat d2/f6 x:0 0 0 2021-11-03T16:54:20.908 INFO:tasks.workunit.client.1.smithi194.stdout:2/14: creat f4 x:0 0 0 2021-11-03T16:54:20.912 INFO:tasks.workunit.client.1.smithi194.stdout:5/11: creat d2/f5 x:0 0 0 2021-11-03T16:54:20.916 INFO:tasks.workunit.client.1.smithi194.stdout:2/15: creat f5 x:0 0 0 2021-11-03T16:54:20.916 INFO:tasks.workunit.client.1.smithi194.stdout:2/16: write f4 [86333,62404] 0 2021-11-03T16:54:20.919 INFO:tasks.workunit.client.1.smithi194.stdout:5/12: link d2/f5 d2/d3/f6 0 2021-11-03T16:54:20.919 INFO:tasks.workunit.client.1.smithi194.stdout:5/13: chown d2/f5 51 1 2021-11-03T16:54:20.924 INFO:tasks.workunit.client.1.smithi194.stdout:2/17: mkdir d6 0 2021-11-03T16:54:20.924 INFO:tasks.workunit.client.1.smithi194.stdout:2/18: stat f5 0 2021-11-03T16:54:20.925 INFO:tasks.workunit.client.1.smithi194.stdout:2/19: read f4 [82686,4594] 0 2021-11-03T16:54:20.927 INFO:tasks.workunit.client.1.smithi194.stdout:9/7: dwrite f1 [0,4194304] 0 2021-11-03T16:54:20.927 INFO:tasks.workunit.client.1.smithi194.stdout:5/14: symlink d2/l7 0 2021-11-03T16:54:20.928 INFO:tasks.workunit.client.1.smithi194.stdout:5/15: read - d2/d3/f4 zero size 2021-11-03T16:54:20.928 INFO:tasks.workunit.client.1.smithi194.stdout:5/16: mknod d2/d3/c8 1 2021-11-03T16:54:20.930 INFO:tasks.workunit.client.1.smithi194.stdout:2/20: rename f1 to d6/f7 0 2021-11-03T16:54:20.930 INFO:tasks.workunit.client.1.smithi194.stdout:2/21: read - f5 zero size 2021-11-03T16:54:20.933 INFO:tasks.workunit.client.1.smithi194.stdout:3/17: rmdir d2 39 2021-11-03T16:54:20.936 INFO:tasks.workunit.client.1.smithi194.stdout:9/8: dread f1 [0,4194304] 0 2021-11-03T16:54:20.937 INFO:tasks.workunit.client.1.smithi194.stdout:8/15: dwrite f5 [0,4194304] 0 2021-11-03T16:54:20.940 INFO:tasks.workunit.client.1.smithi194.stdout:2/22: symlink d6/l8 0 2021-11-03T16:54:20.940 INFO:tasks.workunit.client.1.smithi194.stdout:2/23: stat f5 0 2021-11-03T16:54:20.940 INFO:tasks.workunit.client.1.smithi194.stdout:2/24: truncate f4 724707 0 2021-11-03T16:54:20.943 INFO:tasks.workunit.client.1.smithi194.stdout:5/17: dwrite d2/d3/f4 [0,4194304] 0 2021-11-03T16:54:20.958 INFO:tasks.workunit.client.1.smithi194.stdout:2/25: mkdir d6/d9 0 2021-11-03T16:54:20.958 INFO:tasks.workunit.client.1.smithi194.stdout:2/26: chown d6 2081 1 2021-11-03T16:54:20.958 INFO:tasks.workunit.client.1.smithi194.stdout:2/27: truncate f4 1637546 0 2021-11-03T16:54:20.958 INFO:tasks.workunit.client.1.smithi194.stdout:2/28: write f5 [598679,130507] 0 2021-11-03T16:54:20.959 INFO:tasks.workunit.client.1.smithi194.stdout:8/16: write f5 [4450503,102371] 0 2021-11-03T16:54:20.964 INFO:tasks.workunit.client.1.smithi194.stdout:3/18: dwrite d2/f4 [0,4194304] 0 2021-11-03T16:54:20.964 INFO:tasks.workunit.client.1.smithi194.stdout:3/19: chown l0 1 1 2021-11-03T16:54:20.964 INFO:tasks.workunit.client.1.smithi194.stdout:3/20: write d2/f6 [87884,62818] 0 2021-11-03T16:54:20.965 INFO:tasks.workunit.client.1.smithi194.stdout:5/18: unlink d2/d3/f4 0 2021-11-03T16:54:20.965 INFO:tasks.workunit.client.1.smithi194.stdout:5/19: mknod d2/d3/c9 1 2021-11-03T16:54:20.965 INFO:tasks.workunit.client.1.smithi194.stdout:5/20: write f0 [952522,22650] 0 2021-11-03T16:54:20.969 INFO:tasks.workunit.client.1.smithi194.stdout:9/9: truncate f1 1884325 0 2021-11-03T16:54:20.971 INFO:tasks.workunit.client.1.smithi194.stdout:2/29: creat d6/fa x:0 0 0 2021-11-03T16:54:20.971 INFO:tasks.workunit.client.1.smithi194.stdout:2/30: chown d6/l8 30904 1 2021-11-03T16:54:20.977 INFO:tasks.workunit.client.1.smithi194.stdout:2/31: dread f5 [0,4194304] 0 2021-11-03T16:54:20.981 INFO:tasks.workunit.client.1.smithi194.stdout:8/17: dwrite f5 [0,4194304] 0 2021-11-03T16:54:20.981 INFO:tasks.workunit.client.1.smithi194.stdout:8/18: chown f5 19212 1 2021-11-03T16:54:20.982 INFO:tasks.workunit.client.1.smithi194.stdout:8/19: write f5 [2630476,46183] 0 2021-11-03T16:54:20.982 INFO:tasks.workunit.client.1.smithi194.stdout:5/21: rename d2/l7 to d2/d3/la 0 2021-11-03T16:54:20.983 INFO:tasks.workunit.client.1.smithi194.stdout:5/22: truncate d2/f5 303321 0 2021-11-03T16:54:20.983 INFO:tasks.workunit.client.1.smithi194.stdout:5/23: chown d2/f5 130592 1 2021-11-03T16:54:20.987 INFO:tasks.workunit.client.1.smithi194.stdout:9/10: link f0 f2 0 2021-11-03T16:54:20.987 INFO:tasks.workunit.client.1.smithi194.stdout:9/11: chown f0 838 1 2021-11-03T16:54:20.987 INFO:tasks.workunit.client.1.smithi194.stdout:9/12: write f2 [2940356,82232] 0 2021-11-03T16:54:20.988 INFO:tasks.workunit.client.1.smithi194.stdout:9/13: write f2 [1659826,46693] 0 2021-11-03T16:54:20.988 INFO:tasks.workunit.client.1.smithi194.stdout:9/14: write f2 [3087482,67603] 0 2021-11-03T16:54:20.989 INFO:tasks.workunit.client.1.smithi194.stdout:9/15: chown f2 5 1 2021-11-03T16:54:20.989 INFO:tasks.workunit.client.1.smithi194.stdout:3/21: symlink d2/l7 0 2021-11-03T16:54:20.994 INFO:tasks.workunit.client.1.smithi194.stdout:2/32: rename f5 to d6/fb 0 2021-11-03T16:54:20.997 INFO:tasks.workunit.client.1.smithi194.stdout:5/24: rename d2/f5 to d2/fb 0 2021-11-03T16:54:21.000 INFO:tasks.workunit.client.1.smithi194.stdout:9/16: creat f3 x:0 0 0 2021-11-03T16:54:21.001 INFO:tasks.workunit.client.1.smithi194.stdout:9/17: write f2 [2787086,22877] 0 2021-11-03T16:54:21.003 INFO:tasks.workunit.client.1.smithi194.stdout:8/20: dwrite f5 [0,4194304] 0 2021-11-03T16:54:21.003 INFO:tasks.workunit.client.1.smithi194.stdout:8/21: fsync f5 0 2021-11-03T16:54:21.003 INFO:tasks.workunit.client.1.smithi194.stdout:8/22: fsync f5 0 2021-11-03T16:54:21.004 INFO:tasks.workunit.client.1.smithi194.stdout:8/23: mknod c6 1 2021-11-03T16:54:21.004 INFO:tasks.workunit.client.1.smithi194.stdout:2/33: symlink d6/lc 0 2021-11-03T16:54:21.006 INFO:tasks.workunit.client.1.smithi194.stdout:5/25: creat d2/d3/fc x:0 0 0 2021-11-03T16:54:21.008 INFO:tasks.workunit.client.1.smithi194.stdout:9/18: creat f4 x:0 0 0 2021-11-03T16:54:21.009 INFO:tasks.workunit.client.1.smithi194.stdout:3/22: symlink d2/l8 0 2021-11-03T16:54:21.014 INFO:tasks.workunit.client.1.smithi194.stdout:2/34: rmdir d6/d9 0 2021-11-03T16:54:21.014 INFO:tasks.workunit.client.1.smithi194.stdout:2/35: chown f4 9952 1 2021-11-03T16:54:21.015 INFO:tasks.workunit.client.1.smithi194.stdout:2/36: write d6/fb [1718055,48798] 0 2021-11-03T16:54:21.015 INFO:tasks.workunit.client.1.smithi194.stdout:2/37: write d6/fa [314627,119409] 0 2021-11-03T16:54:21.015 INFO:tasks.workunit.client.1.smithi194.stdout:2/38: stat f4 0 2021-11-03T16:54:21.030 INFO:tasks.workunit.client.1.smithi194.stdout:5/26: mkdir d2/dd 0 2021-11-03T16:54:21.033 INFO:tasks.workunit.client.1.smithi194.stdout:9/19: creat f5 x:0 0 0 2021-11-03T16:54:21.035 INFO:tasks.workunit.client.1.smithi194.stdout:3/23: creat d2/f9 x:0 0 0 2021-11-03T16:54:21.040 INFO:tasks.workunit.client.1.smithi194.stdout:9/20: symlink l6 0 2021-11-03T16:54:21.042 INFO:tasks.workunit.client.1.smithi194.stdout:3/24: creat d2/fa x:0 0 0 2021-11-03T16:54:21.042 INFO:tasks.workunit.client.1.smithi194.stdout:3/25: fsync d2/f6 0 2021-11-03T16:54:21.045 INFO:tasks.workunit.client.1.smithi194.stdout:2/39: rmdir d6 39 2021-11-03T16:54:21.054 INFO:tasks.workunit.client.1.smithi194.stdout:5/27: dwrite d2/d3/fc [0,4194304] 0 2021-11-03T16:54:21.054 INFO:tasks.workunit.client.1.smithi194.stdout:5/28: write d2/d3/f6 [634897,103062] 0 2021-11-03T16:54:21.055 INFO:tasks.workunit.client.1.smithi194.stdout:9/21: link l6 l7 0 2021-11-03T16:54:21.058 INFO:tasks.workunit.client.1.smithi194.stdout:2/40: creat d6/fd x:0 0 0 2021-11-03T16:54:21.065 INFO:tasks.workunit.client.1.smithi194.stdout:9/22: creat f8 x:0 0 0 2021-11-03T16:54:21.071 INFO:tasks.workunit.client.1.smithi194.stdout:3/26: link l0 d2/lb 0 2021-11-03T16:54:21.071 INFO:tasks.workunit.client.1.smithi194.stdout:3/27: write d2/f9 [581939,43917] 0 2021-11-03T16:54:21.072 INFO:tasks.workunit.client.1.smithi194.stdout:5/29: dread d2/d3/fc [0,4194304] 0 2021-11-03T16:54:21.072 INFO:tasks.workunit.client.1.smithi194.stdout:2/41: mkdir d6/de 0 2021-11-03T16:54:21.073 INFO:tasks.workunit.client.1.smithi194.stdout:2/42: chown d6/fd 283312 1 2021-11-03T16:54:21.074 INFO:tasks.workunit.client.1.smithi194.stdout:9/23: link f8 f9 0 2021-11-03T16:54:21.078 INFO:tasks.workunit.client.1.smithi194.stdout:5/30: link d2/d3/f6 d2/dd/fe 0 2021-11-03T16:54:21.080 INFO:tasks.workunit.client.1.smithi194.stdout:2/43: rename d6/fa to d6/ff 0 2021-11-03T16:54:21.083 INFO:tasks.workunit.client.1.smithi194.stdout:2/44: fdatasync d6/fb 0 2021-11-03T16:54:21.083 INFO:tasks.workunit.client.1.smithi194.stdout:3/28: link d2/lb d2/lc 0 2021-11-03T16:54:21.084 INFO:tasks.workunit.client.1.smithi194.stdout:3/29: stat d2/fa 0 2021-11-03T16:54:21.085 INFO:tasks.workunit.client.1.smithi194.stdout:2/45: fdatasync d6/ff 0 2021-11-03T16:54:21.085 INFO:tasks.workunit.client.1.smithi194.stdout:2/46: write f4 [1969417,86762] 0 2021-11-03T16:54:21.086 INFO:tasks.workunit.client.1.smithi194.stdout:2/47: dread - d6/fd zero size 2021-11-03T16:54:21.086 INFO:tasks.workunit.client.1.smithi194.stdout:2/48: read f4 [1319786,118974] 0 2021-11-03T16:54:21.086 INFO:tasks.workunit.client.1.smithi194.stdout:2/49: stat d6/fb 0 2021-11-03T16:54:21.094 INFO:tasks.workunit.client.1.smithi194.stdout:9/24: getdents . 0 2021-11-03T16:54:21.094 INFO:tasks.workunit.client.1.smithi194.stdout:9/25: chown f3 14 1 2021-11-03T16:54:21.101 INFO:tasks.workunit.client.1.smithi194.stdout:2/50: link f4 d6/f10 0 2021-11-03T16:54:21.101 INFO:tasks.workunit.client.1.smithi194.stdout:2/51: truncate d6/ff 659110 0 2021-11-03T16:54:21.101 INFO:tasks.workunit.client.1.smithi194.stdout:5/31: truncate d2/fb 378766 0 2021-11-03T16:54:21.101 INFO:tasks.workunit.client.1.smithi194.stdout:2/52: write d6/ff [339075,33958] 0 2021-11-03T16:54:21.102 INFO:tasks.workunit.client.1.smithi194.stdout:5/32: readlink d2/d3/la 0 2021-11-03T16:54:21.102 INFO:tasks.workunit.client.1.smithi194.stdout:2/53: chown d6/fd 26 1 2021-11-03T16:54:21.102 INFO:tasks.workunit.client.1.smithi194.stdout:3/30: link d2/l8 d2/ld 0 2021-11-03T16:54:21.103 INFO:tasks.workunit.client.1.smithi194.stdout:3/31: chown d2/f4 880977543 1 2021-11-03T16:54:21.103 INFO:tasks.workunit.client.1.smithi194.stdout:3/32: chown l0 610413908 1 2021-11-03T16:54:21.108 INFO:tasks.workunit.client.1.smithi194.stdout:9/26: dwrite f3 [0,4194304] 0 2021-11-03T16:54:21.108 INFO:tasks.workunit.client.1.smithi194.stdout:9/27: write f9 [521399,60036] 0 2021-11-03T16:54:21.110 INFO:tasks.workunit.client.1.smithi194.stdout:9/28: dread f1 [0,4194304] 0 2021-11-03T16:54:21.117 INFO:tasks.workunit.client.1.smithi194.stdout:2/54: dwrite d6/fd [0,4194304] 0 2021-11-03T16:54:21.117 INFO:tasks.workunit.client.1.smithi194.stdout:2/55: chown d6/f7 3887 1 2021-11-03T16:54:21.122 INFO:tasks.workunit.client.1.smithi194.stdout:2/56: dread f4 [0,4194304] 0 2021-11-03T16:54:21.125 INFO:tasks.workunit.client.1.smithi194.stdout:2/57: dread d6/fb [0,4194304] 0 2021-11-03T16:54:21.127 INFO:tasks.workunit.client.1.smithi194.stdout:5/33: unlink d2/dd/fe 0 2021-11-03T16:54:21.131 INFO:tasks.workunit.client.1.smithi194.stdout:9/29: dwrite f0 [0,4194304] 0 2021-11-03T16:54:21.135 INFO:tasks.workunit.client.1.smithi194.stdout:2/58: mkdir d6/de/d11 0 2021-11-03T16:54:21.135 INFO:tasks.workunit.client.1.smithi194.stdout:2/59: chown d6/l8 18 1 2021-11-03T16:54:21.140 INFO:tasks.workunit.client.1.smithi194.stdout:2/60: unlink d6/f10 0 2021-11-03T16:54:21.141 INFO:tasks.workunit.client.1.smithi194.stdout:5/34: write d2/d3/f6 [353228,43196] 0 2021-11-03T16:54:21.141 INFO:tasks.workunit.client.1.smithi194.stdout:9/30: dread f2 [0,4194304] 0 2021-11-03T16:54:21.141 INFO:tasks.workunit.client.1.smithi194.stdout:9/31: chown f3 1 1 2021-11-03T16:54:21.141 INFO:tasks.workunit.client.1.smithi194.stdout:5/35: write d2/d3/f6 [1037271,37207] 0 2021-11-03T16:54:21.143 INFO:tasks.workunit.client.1.smithi194.stdout:9/32: dread f1 [0,4194304] 0 2021-11-03T16:54:21.143 INFO:tasks.workunit.client.1.smithi194.stdout:2/61: creat d6/de/d11/f12 x:0 0 0 2021-11-03T16:54:21.145 INFO:tasks.workunit.client.1.smithi194.stdout:5/36: dread f0 [0,4194304] 0 2021-11-03T16:54:21.145 INFO:tasks.workunit.client.1.smithi194.stdout:5/37: write d2/d3/f6 [1964533,55612] 0 2021-11-03T16:54:21.145 INFO:tasks.workunit.client.1.smithi194.stdout:5/38: mknod d2/cf 1 2021-11-03T16:54:21.145 INFO:tasks.workunit.client.1.smithi194.stdout:2/62: creat d6/f13 x:0 0 0 2021-11-03T16:54:21.146 INFO:tasks.workunit.client.1.smithi194.stdout:2/63: rename d6 to d6/d14 22 2021-11-03T16:54:21.147 INFO:tasks.workunit.client.1.smithi194.stdout:9/33: creat fa x:0 0 0 2021-11-03T16:54:21.149 INFO:tasks.workunit.client.1.smithi194.stdout:5/39: dread d2/d3/fc [0,4194304] 0 2021-11-03T16:54:21.150 INFO:tasks.workunit.client.1.smithi194.stdout:9/34: rename f4 to fb 0 2021-11-03T16:54:21.151 INFO:tasks.workunit.client.1.smithi194.stdout:5/40: creat d2/f10 x:0 0 0 2021-11-03T16:54:21.152 INFO:tasks.workunit.client.1.smithi194.stdout:5/41: write d2/d3/f6 [2531832,16169] 0 2021-11-03T16:54:21.152 INFO:tasks.workunit.client.1.smithi194.stdout:5/42: read d2/d3/fc [131523,122227] 0 2021-11-03T16:54:21.153 INFO:tasks.workunit.client.1.smithi194.stdout:9/35: symlink lc 0 2021-11-03T16:54:21.153 INFO:tasks.workunit.client.1.smithi194.stdout:9/36: rmdir - no directory 2021-11-03T16:54:21.158 INFO:tasks.workunit.client.1.smithi194.stdout:5/43: symlink d2/d3/l11 0 2021-11-03T16:54:21.160 INFO:tasks.workunit.client.1.smithi194.stdout:9/37: creat fd x:0 0 0 2021-11-03T16:54:21.166 INFO:tasks.workunit.client.1.smithi194.stdout:5/44: rename d2/d3/l11 to d2/d3/l12 0 2021-11-03T16:54:21.166 INFO:tasks.workunit.client.1.smithi194.stdout:5/45: read - d2/f10 zero size 2021-11-03T16:54:21.167 INFO:tasks.workunit.client.1.smithi194.stdout:2/64: dwrite f4 [0,4194304] 0 2021-11-03T16:54:21.178 INFO:tasks.workunit.client.1.smithi194.stdout:9/38: dwrite fa [0,4194304] 0 2021-11-03T16:54:21.178 INFO:tasks.workunit.client.1.smithi194.stdout:9/39: truncate fd 418653 0 2021-11-03T16:54:21.178 INFO:tasks.workunit.client.1.smithi194.stdout:9/40: dread - fb zero size 2021-11-03T16:54:21.184 INFO:tasks.workunit.client.1.smithi194.stdout:2/65: symlink d6/de/d11/l15 0 2021-11-03T16:54:21.194 INFO:tasks.workunit.client.1.smithi194.stdout:2/66: mkdir d6/de/d16 0 2021-11-03T16:54:21.196 INFO:tasks.workunit.client.1.smithi194.stdout:5/46: truncate d2/d3/f6 1010826 0 2021-11-03T16:54:21.201 INFO:tasks.workunit.client.1.smithi194.stdout:5/47: write d2/fb [1147133,58725] 0 2021-11-03T16:54:21.203 INFO:tasks.workunit.client.1.smithi194.stdout:5/48: symlink d2/d3/l13 0 2021-11-03T16:54:21.204 INFO:tasks.workunit.client.1.smithi194.stdout:5/49: write d2/d3/f6 [1154816,70117] 0 2021-11-03T16:54:21.207 INFO:tasks.workunit.client.1.smithi194.stdout:5/50: dread f0 [0,4194304] 0 2021-11-03T16:54:21.211 INFO:tasks.workunit.client.1.smithi194.stdout:5/51: read d2/fb [177894,107089] 0 2021-11-03T16:54:21.211 INFO:tasks.workunit.client.1.smithi194.stdout:2/67: dwrite d6/fd [4194304,4194304] 0 2021-11-03T16:54:21.214 INFO:tasks.workunit.client.1.smithi194.stdout:5/52: rename d2/f10 to d2/dd/f14 0 2021-11-03T16:54:21.214 INFO:tasks.workunit.client.1.smithi194.stdout:5/53: readlink d2/d3/l12 0 2021-11-03T16:54:21.225 INFO:tasks.workunit.client.1.smithi194.stdout:2/68: rmdir d6 39 2021-11-03T16:54:21.225 INFO:tasks.workunit.client.1.smithi194.stdout:2/69: stat d6/fd 0 2021-11-03T16:54:21.227 INFO:tasks.workunit.client.1.smithi194.stdout:5/54: symlink d2/l15 0 2021-11-03T16:54:21.238 INFO:tasks.workunit.client.1.smithi194.stdout:2/70: mkdir d6/d17 0 2021-11-03T16:54:21.238 INFO:tasks.workunit.client.1.smithi194.stdout:5/55: rmdir d2/d3 39 2021-11-03T16:54:21.238 INFO:tasks.workunit.client.1.smithi194.stdout:2/71: mknod d6/de/d11/c18 1 2021-11-03T16:54:21.239 INFO:tasks.workunit.client.1.smithi194.stdout:2/72: write d6/ff [1541824,15469] 0 2021-11-03T16:54:21.240 INFO:tasks.workunit.client.1.smithi194.stdout:2/73: creat d6/de/d16/f19 x:0 0 0 2021-11-03T16:54:21.242 INFO:tasks.workunit.client.1.smithi194.stdout:5/56: dread d2/d3/fc [0,4194304] 0 2021-11-03T16:54:21.243 INFO:tasks.workunit.client.1.smithi194.stdout:2/74: rename d6/de/d11/l15 to d6/l1a 0 2021-11-03T16:54:21.247 INFO:tasks.workunit.client.1.smithi194.stdout:5/57: rename d2/d3/f6 to d2/dd/f16 0 2021-11-03T16:54:21.247 INFO:tasks.workunit.client.1.smithi194.stdout:5/58: write d2/dd/f14 [564239,99028] 0 2021-11-03T16:54:21.247 INFO:tasks.workunit.client.1.smithi194.stdout:5/59: read f0 [749872,125533] 0 2021-11-03T16:54:21.249 INFO:tasks.workunit.client.1.smithi194.stdout:2/75: symlink d6/d17/l1b 0 2021-11-03T16:54:21.249 INFO:tasks.workunit.client.1.smithi194.stdout:2/76: dread - d6/f7 zero size 2021-11-03T16:54:21.250 INFO:tasks.workunit.client.1.smithi194.stdout:2/77: fsync d6/de/d11/f12 0 2021-11-03T16:54:21.250 INFO:tasks.workunit.client.1.smithi194.stdout:2/78: write f4 [3038754,39795] 0 2021-11-03T16:54:21.251 INFO:tasks.workunit.client.1.smithi194.stdout:2/79: dread - d6/f7 zero size 2021-11-03T16:54:21.251 INFO:tasks.workunit.client.1.smithi194.stdout:2/80: chown d6/de/d16 307 1 2021-11-03T16:54:21.251 INFO:tasks.workunit.client.1.smithi194.stdout:2/81: write f4 [1568538,16561] 0 2021-11-03T16:54:21.253 INFO:tasks.workunit.client.1.smithi194.stdout:5/60: dread d2/dd/f16 [0,4194304] 0 2021-11-03T16:54:21.253 INFO:tasks.workunit.client.1.smithi194.stdout:5/61: write d2/fb [235956,15667] 0 2021-11-03T16:54:21.254 INFO:tasks.workunit.client.1.smithi194.stdout:5/62: read d2/fb [283609,62678] 0 2021-11-03T16:54:21.254 INFO:tasks.workunit.client.1.smithi194.stdout:2/82: symlink d6/de/l1c 0 2021-11-03T16:54:21.254 INFO:tasks.workunit.client.1.smithi194.stdout:2/83: mknod d6/d17/c1d 1 2021-11-03T16:54:21.256 INFO:tasks.workunit.client.1.smithi194.stdout:5/63: creat d2/f17 x:0 0 0 2021-11-03T16:54:21.257 INFO:tasks.workunit.client.1.smithi194.stdout:2/84: rmdir d6/d17 39 2021-11-03T16:54:21.260 INFO:tasks.workunit.client.1.smithi194.stdout:5/64: rename d2/fb to d2/d3/f18 0 2021-11-03T16:54:21.260 INFO:tasks.workunit.client.1.smithi194.stdout:5/65: chown f0 106 1 2021-11-03T16:54:21.260 INFO:tasks.workunit.client.1.smithi194.stdout:5/66: rename d2 to d2/d3/d19 22 2021-11-03T16:54:21.263 INFO:tasks.workunit.client.1.smithi194.stdout:5/67: creat d2/d3/f1a x:0 0 0 2021-11-03T16:54:21.264 INFO:tasks.workunit.client.1.smithi194.stdout:5/68: write d2/d3/f1a [177040,77337] 0 2021-11-03T16:54:21.264 INFO:tasks.workunit.client.1.smithi194.stdout:5/69: read f0 [1736819,34992] 0 2021-11-03T16:54:21.265 INFO:tasks.workunit.client.1.smithi194.stdout:5/70: chown d2/d3/la 4605109 1 2021-11-03T16:54:21.266 INFO:tasks.workunit.client.1.smithi194.stdout:5/71: fdatasync d2/d3/f18 0 2021-11-03T16:54:21.266 INFO:tasks.workunit.client.1.smithi194.stdout:5/72: dread - d2/f17 zero size 2021-11-03T16:54:21.272 INFO:tasks.workunit.client.1.smithi194.stdout:2/85: getdents d6/d17 0 2021-11-03T16:54:21.279 INFO:tasks.workunit.client.1.smithi194.stdout:5/73: rename d2/d3/f18 to d2/dd/f1b 0 2021-11-03T16:54:21.280 INFO:tasks.workunit.client.1.smithi194.stdout:5/74: mknod d2/c1c 1 2021-11-03T16:54:21.281 INFO:tasks.workunit.client.1.smithi194.stdout:2/86: creat d6/f1e x:0 0 0 2021-11-03T16:54:21.283 INFO:tasks.workunit.client.1.smithi194.stdout:5/75: symlink d2/dd/l1d 0 2021-11-03T16:54:21.284 INFO:tasks.workunit.client.1.smithi194.stdout:2/87: fdatasync f4 0 2021-11-03T16:54:21.293 INFO:tasks.workunit.client.1.smithi194.stdout:2/88: dread f4 [0,4194304] 0 2021-11-03T16:54:21.293 INFO:tasks.workunit.client.1.smithi194.stdout:2/89: dread - d6/de/d16/f19 zero size 2021-11-03T16:54:21.294 INFO:tasks.workunit.client.1.smithi194.stdout:5/76: getdents d2/d3 0 2021-11-03T16:54:21.303 INFO:tasks.workunit.client.1.smithi194.stdout:2/90: dread d6/fd [4194304,4194304] 0 2021-11-03T16:54:21.305 INFO:tasks.workunit.client.1.smithi194.stdout:2/91: rmdir d6/d17 39 2021-11-03T16:54:21.316 INFO:tasks.workunit.client.1.smithi194.stdout:2/92: truncate d6/fd 278350 0 2021-11-03T16:54:21.326 INFO:tasks.workunit.client.1.smithi194.stdout:2/93: mkdir d6/d1f 0 2021-11-03T16:54:21.326 INFO:tasks.workunit.client.1.smithi194.stdout:2/94: chown d6/d17/l1b 6085 1 2021-11-03T16:54:21.329 INFO:tasks.workunit.client.1.smithi194.stdout:2/95: mkdir d6/de/d16/d20 0 2021-11-03T16:54:21.329 INFO:tasks.workunit.client.1.smithi194.stdout:2/96: readlink d6/l1a 0 2021-11-03T16:54:21.333 INFO:tasks.workunit.client.1.smithi194.stdout:2/97: mkdir d6/d21 0 2021-11-03T16:54:21.334 INFO:tasks.workunit.client.1.smithi194.stdout:2/98: mknod d6/de/d16/c22 1 2021-11-03T16:54:21.334 INFO:tasks.workunit.client.1.smithi194.stdout:2/99: truncate d6/de/d11/f12 92030 0 2021-11-03T16:54:21.336 INFO:tasks.workunit.client.1.smithi194.stdout:2/100: dread d6/ff [0,4194304] 0 2021-11-03T16:54:21.338 INFO:tasks.workunit.client.1.smithi194.stdout:2/101: creat d6/d21/f23 x:0 0 0 2021-11-03T16:54:21.341 INFO:tasks.workunit.client.1.smithi194.stdout:2/102: mkdir d6/de/d16/d24 0 2021-11-03T16:54:21.344 INFO:tasks.workunit.client.1.smithi194.stdout:2/103: link d6/l8 d6/de/l25 0 2021-11-03T16:54:21.344 INFO:tasks.workunit.client.1.smithi194.stdout:2/104: stat d6/d1f 0 2021-11-03T16:54:21.347 INFO:tasks.workunit.client.1.smithi194.stdout:2/105: unlink d6/f13 0 2021-11-03T16:54:21.348 INFO:tasks.workunit.client.1.smithi194.stdout:2/106: dread d6/de/d11/f12 [0,4194304] 0 2021-11-03T16:54:21.350 INFO:tasks.workunit.client.1.smithi194.stdout:2/107: mkdir d6/d17/d26 0 2021-11-03T16:54:21.350 INFO:tasks.workunit.client.1.smithi194.stdout:2/108: fsync d6/fd 0 2021-11-03T16:54:21.350 INFO:tasks.workunit.client.1.smithi194.stdout:2/109: fsync d6/de/d16/f19 0 2021-11-03T16:54:21.351 INFO:tasks.workunit.client.1.smithi194.stdout:2/110: chown d6/de/l25 23316641 1 2021-11-03T16:54:21.352 INFO:tasks.workunit.client.1.smithi194.stdout:2/111: mkdir d6/de/d27 0 2021-11-03T16:54:21.366 INFO:tasks.workunit.client.1.smithi194.stdout:2/112: dwrite d6/de/d11/f12 [0,4194304] 0 2021-11-03T16:54:21.369 INFO:tasks.workunit.client.1.smithi194.stdout:2/113: dread d6/fd [0,4194304] 0 2021-11-03T16:54:21.369 INFO:tasks.workunit.client.1.smithi194.stdout:2/114: dread - d6/f7 zero size 2021-11-03T16:54:21.369 INFO:tasks.workunit.client.1.smithi194.stdout:2/115: dread - d6/d21/f23 zero size 2021-11-03T16:54:21.391 INFO:tasks.workunit.client.1.smithi194.stdout:2/116: unlink d6/de/l1c 0 2021-11-03T16:54:21.392 INFO:tasks.workunit.client.1.smithi194.stdout:2/117: mknod d6/d1f/c28 1 2021-11-03T16:54:21.392 INFO:tasks.workunit.client.1.smithi194.stdout:2/118: chown d6/d1f 66867 1 2021-11-03T16:54:21.392 INFO:tasks.workunit.client.1.smithi194.stdout:2/119: chown d6/lc 121 1 2021-11-03T16:54:21.393 INFO:tasks.workunit.client.1.smithi194.stdout:2/120: dread d6/fd [0,4194304] 0 2021-11-03T16:54:21.393 INFO:tasks.workunit.client.1.smithi194.stdout:2/121: write d6/ff [1434422,97792] 0 2021-11-03T16:54:21.394 INFO:tasks.workunit.client.1.smithi194.stdout:2/122: read d6/fb [1025779,120200] 0 2021-11-03T16:54:21.396 INFO:tasks.workunit.client.1.smithi194.stdout:2/123: creat d6/de/d16/d24/f29 x:0 0 0 2021-11-03T16:54:21.398 INFO:tasks.workunit.client.1.smithi194.stdout:2/124: mkdir d6/d21/d2a 0 2021-11-03T16:54:21.413 INFO:tasks.workunit.client.1.smithi194.stdout:2/125: dwrite d6/fd [0,4194304] 0 2021-11-03T16:54:21.413 INFO:tasks.workunit.client.1.smithi194.stdout:2/126: readlink l3 0 2021-11-03T16:54:21.413 INFO:tasks.workunit.client.1.smithi194.stdout:2/127: dread - d6/de/d16/f19 zero size 2021-11-03T16:54:21.416 INFO:tasks.workunit.client.1.smithi194.stdout:2/128: link d6/de/d16/f19 d6/d21/f2b 0 2021-11-03T16:54:21.999 INFO:tasks.workunit.client.1.smithi194.stdout:2/129: fsync d6/de/d16/d24/f29 0 2021-11-03T16:54:22.024 INFO:tasks.workunit.client.1.smithi194.stdout:2/130: unlink d6/de/d16/f19 0 2021-11-03T16:54:22.064 INFO:tasks.workunit.client.1.smithi194.stdout:2/131: rename d6/de/l25 to d6/d1f/l2c 0 2021-11-03T16:54:22.195 INFO:tasks.workunit.client.1.smithi194.stdout:2/132: symlink d6/de/d27/l2d 0 2021-11-03T16:54:22.257 INFO:tasks.workunit.client.1.smithi194.stdout:2/133: creat d6/d1f/f2e x:0 0 0 2021-11-03T16:54:22.258 INFO:tasks.workunit.client.1.smithi194.stdout:2/134: write d6/de/d11/f12 [1609154,76107] 0 2021-11-03T16:54:22.279 INFO:tasks.workunit.client.1.smithi194.stdout:2/135: dwrite f4 [0,4194304] 0 2021-11-03T16:54:22.283 INFO:tasks.workunit.client.1.smithi194.stdout:2/136: rename f4 to d6/d21/d2a/f2f 0 2021-11-03T16:54:22.284 INFO:tasks.workunit.client.1.smithi194.stdout:2/137: dread - d6/d21/f2b zero size 2021-11-03T16:54:22.285 INFO:tasks.workunit.client.1.smithi194.stdout:2/138: dread - d6/f1e zero size 2021-11-03T16:54:22.285 INFO:tasks.workunit.client.1.smithi194.stdout:2/139: chown d6/fb 7 1 2021-11-03T16:54:22.287 INFO:tasks.workunit.client.1.smithi194.stdout:2/140: write d6/ff [1295346,34288] 0 2021-11-03T16:54:22.287 INFO:tasks.workunit.client.1.smithi194.stdout:2/141: symlink d6/de/d16/d20/l30 0 2021-11-03T16:54:22.287 INFO:tasks.workunit.client.1.smithi194.stdout:2/142: truncate d6/fd 4413216 0 2021-11-03T16:54:22.288 INFO:tasks.workunit.client.1.smithi194.stdout:2/143: write d6/d21/f23 [417736,113133] 0 2021-11-03T16:54:22.288 INFO:tasks.workunit.client.1.smithi194.stdout:2/144: fsync d6/f1e 0 2021-11-03T16:54:22.288 INFO:tasks.workunit.client.1.smithi194.stdout:2/145: fdatasync d6/de/d16/d24/f29 0 2021-11-03T16:54:22.289 INFO:tasks.workunit.client.1.smithi194.stdout:2/146: mkdir d6/d21/d2a/d31 0 2021-11-03T16:54:22.289 INFO:tasks.workunit.client.1.smithi194.stdout:2/147: write d6/de/d16/d24/f29 [670520,71846] 0 2021-11-03T16:54:22.293 INFO:tasks.workunit.client.1.smithi194.stdout:2/148: dread d6/d21/f23 [0,4194304] 0 2021-11-03T16:54:22.294 INFO:tasks.workunit.client.1.smithi194.stdout:2/149: read d6/ff [1258977,35760] 0 2021-11-03T16:54:22.294 INFO:tasks.workunit.client.1.smithi194.stdout:2/150: chown d6/d17/l1b 347916079 1 2021-11-03T16:54:22.295 INFO:tasks.workunit.client.1.smithi194.stdout:2/151: chown d6/de/d16 41 1 2021-11-03T16:54:22.296 INFO:tasks.workunit.client.1.smithi194.stdout:2/152: creat d6/d17/d26/f32 x:0 0 0 2021-11-03T16:54:22.296 INFO:tasks.workunit.client.1.smithi194.stdout:2/153: read d6/d21/f23 [339682,119759] 0 2021-11-03T16:54:22.297 INFO:tasks.workunit.client.1.smithi194.stdout:2/154: write d6/d21/f23 [308991,100831] 0 2021-11-03T16:54:22.297 INFO:tasks.workunit.client.1.smithi194.stdout:2/155: truncate d6/f7 25311 0 2021-11-03T16:54:22.313 INFO:tasks.workunit.client.1.smithi194.stdout:2/156: dwrite d6/d17/d26/f32 [0,4194304] 0 2021-11-03T16:54:22.360 INFO:tasks.workunit.client.1.smithi194.stdout:2/157: truncate d6/d21/f23 120968 0 2021-11-03T16:54:22.363 INFO:tasks.workunit.client.1.smithi194.stdout:2/158: dread d6/fb [0,4194304] 0 2021-11-03T16:54:22.363 INFO:tasks.workunit.client.1.smithi194.stdout:2/159: fsync d6/d1f/f2e 0 2021-11-03T16:54:22.373 INFO:tasks.workunit.client.1.smithi194.stdout:2/160: rename d6/d21/f2b to d6/d21/d2a/d31/f33 0 2021-11-03T16:54:22.394 INFO:tasks.workunit.client.1.smithi194.stdout:2/161: dwrite d6/ff [0,4194304] 0 2021-11-03T16:54:22.394 INFO:tasks.workunit.client.1.smithi194.stdout:2/162: readlink d6/l1a 0 2021-11-03T16:54:22.397 INFO:tasks.workunit.client.1.smithi194.stdout:2/163: creat d6/de/d16/d24/f34 x:0 0 0 2021-11-03T16:54:22.411 INFO:tasks.workunit.client.1.smithi194.stdout:2/164: dwrite d6/d21/d2a/d31/f33 [0,4194304] 0 2021-11-03T16:54:22.420 INFO:tasks.workunit.client.1.smithi194.stdout:2/165: mkdir d6/d21/d2a/d35 0 2021-11-03T16:54:22.438 INFO:tasks.workunit.client.1.smithi194.stdout:2/166: dwrite d6/fd [4194304,4194304] 0 2021-11-03T16:54:22.459 INFO:tasks.workunit.client.1.smithi194.stdout:2/167: dwrite d6/de/d16/d24/f29 [0,4194304] 0 2021-11-03T16:54:22.463 INFO:tasks.workunit.client.1.smithi194.stdout:2/168: creat d6/d21/d2a/d31/f36 x:0 0 0 2021-11-03T16:54:22.464 INFO:tasks.workunit.client.1.smithi194.stdout:2/169: write d6/d17/d26/f32 [2687837,127853] 0 2021-11-03T16:54:22.465 INFO:tasks.workunit.client.1.smithi194.stdout:2/170: readlink d6/d1f/l2c 0 2021-11-03T16:54:22.484 INFO:tasks.workunit.client.1.smithi194.stdout:2/171: rename d6/de/d16/d24/f29 to d6/d21/d2a/d31/f37 0 2021-11-03T16:54:22.487 INFO:tasks.workunit.client.1.smithi194.stdout:2/172: symlink d6/d21/l38 0 2021-11-03T16:54:22.487 INFO:tasks.workunit.client.1.smithi194.stdout:2/173: fsync d6/d21/d2a/f2f 0 2021-11-03T16:54:22.489 INFO:tasks.workunit.client.1.smithi194.stdout:2/174: getdents d6/de 0 2021-11-03T16:54:22.504 INFO:tasks.workunit.client.1.smithi194.stdout:2/175: dwrite d6/de/d16/d24/f34 [0,4194304] 0 2021-11-03T16:54:22.522 INFO:tasks.workunit.client.1.smithi194.stdout:2/176: dwrite d6/d17/d26/f32 [0,4194304] 0 2021-11-03T16:54:22.523 INFO:tasks.workunit.client.1.smithi194.stdout:2/177: rmdir d6/d1f 39 2021-11-03T16:54:22.528 INFO:tasks.workunit.client.1.smithi194.stdout:2/178: creat d6/d1f/f39 x:0 0 0 2021-11-03T16:54:22.528 INFO:tasks.workunit.client.1.smithi194.stdout:2/179: mknod d6/d21/d2a/c3a 1 2021-11-03T16:54:22.529 INFO:tasks.workunit.client.1.smithi194.stdout:2/180: write d6/d17/d26/f32 [1834760,41270] 0 2021-11-03T16:54:22.533 INFO:tasks.workunit.client.1.smithi194.stdout:2/181: creat d6/d21/f3b x:0 0 0 2021-11-03T16:54:22.534 INFO:tasks.workunit.client.1.smithi194.stdout:2/182: mkdir d6/d21/d2a/d35/d3c 0 2021-11-03T16:54:22.536 INFO:tasks.workunit.client.1.smithi194.stdout:2/183: fsync d6/d21/f23 0 2021-11-03T16:54:22.536 INFO:tasks.workunit.client.1.smithi194.stdout:2/184: chown d6/d21/d2a/d31/f33 104 1 2021-11-03T16:54:22.551 INFO:tasks.workunit.client.1.smithi194.stdout:2/185: dwrite d6/d21/f23 [0,4194304] 0 2021-11-03T16:54:22.558 INFO:tasks.workunit.client.1.smithi194.stdout:2/186: creat d6/d21/d2a/d31/f3d x:0 0 0 2021-11-03T16:54:22.566 INFO:tasks.workunit.client.1.smithi194.stdout:2/187: symlink d6/d21/d2a/d35/l3e 0 2021-11-03T16:54:22.568 INFO:tasks.workunit.client.1.smithi194.stdout:2/188: link d6/d21/f3b d6/de/d27/f3f 0 2021-11-03T16:54:22.570 INFO:tasks.workunit.client.1.smithi194.stdout:2/189: creat d6/de/f40 x:0 0 0 2021-11-03T16:54:22.571 INFO:tasks.workunit.client.1.smithi194.stdout:2/190: write d6/d21/d2a/d31/f36 [797322,23063] 0 2021-11-03T16:54:22.590 INFO:tasks.workunit.client.1.smithi194.stdout:2/191: dwrite d6/d17/d26/f32 [4194304,4194304] 0 2021-11-03T16:54:22.591 INFO:tasks.workunit.client.1.smithi194.stdout:2/192: stat d6/de/d16/d20 0 2021-11-03T16:54:22.591 INFO:tasks.workunit.client.1.smithi194.stdout:2/193: fdatasync d6/de/f40 0 2021-11-03T16:54:22.593 INFO:tasks.workunit.client.1.smithi194.stdout:2/194: mkdir d6/de/d11/d41 0 2021-11-03T16:54:22.596 INFO:tasks.workunit.client.1.smithi194.stdout:2/195: creat d6/d1f/f42 x:0 0 0 2021-11-03T16:54:22.611 INFO:tasks.workunit.client.1.smithi194.stdout:2/196: mkdir d6/d21/d43 0 2021-11-03T16:54:22.619 INFO:tasks.workunit.client.1.smithi194.stdout:2/197: dread d6/d21/d2a/f2f [0,4194304] 0 2021-11-03T16:54:22.621 INFO:tasks.workunit.client.1.smithi194.stdout:2/198: rename d6/d21/d2a/d31/f36 to d6/f44 0 2021-11-03T16:54:22.624 INFO:tasks.workunit.client.1.smithi194.stdout:2/199: unlink d6/de/d11/f12 0 2021-11-03T16:54:22.624 INFO:tasks.workunit.client.1.smithi194.stdout:2/200: fdatasync d6/d21/f23 0 2021-11-03T16:54:22.642 INFO:tasks.workunit.client.1.smithi194.stdout:2/201: dwrite d6/d21/d2a/f2f [0,4194304] 0 2021-11-03T16:54:22.656 INFO:tasks.workunit.client.1.smithi194.stdout:2/202: dwrite d6/d21/f23 [0,4194304] 0 2021-11-03T16:54:22.657 INFO:tasks.workunit.client.1.smithi194.stdout:2/203: write d6/f1e [628203,52361] 0 2021-11-03T16:54:22.657 INFO:tasks.workunit.client.1.smithi194.stdout:2/204: dread - d6/d21/d2a/d31/f3d zero size 2021-11-03T16:54:22.665 INFO:tasks.workunit.client.1.smithi194.stdout:2/205: dread d6/d21/d2a/d31/f33 [0,4194304] 0 2021-11-03T16:54:22.667 INFO:tasks.workunit.client.1.smithi194.stdout:2/206: rmdir d6/de/d11/d41 0 2021-11-03T16:54:22.668 INFO:tasks.workunit.client.1.smithi194.stdout:2/207: write d6/f1e [481955,40586] 0 2021-11-03T16:54:22.668 INFO:tasks.workunit.client.1.smithi194.stdout:2/208: readlink d6/lc 0 2021-11-03T16:54:22.669 INFO:tasks.workunit.client.1.smithi194.stdout:2/209: write d6/d21/d2a/f2f [3700828,92965] 0 2021-11-03T16:54:22.670 INFO:tasks.workunit.client.1.smithi194.stdout:2/210: rmdir d6/de/d27 39 2021-11-03T16:54:22.671 INFO:tasks.workunit.client.1.smithi194.stdout:2/211: truncate d6/d1f/f2e 228584 0 2021-11-03T16:54:22.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:22 smithi026 conmon[32119]: cluster 2021-11-03T16:54:21.071371+0000 mgr.smithi026.cnrxli (mgr.14162) 2021-11-03T16:54:22.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:22 smithi026 conmon[32119]: 300 : cluster [DBG] pgmap v247: 65 pgs: 65 active+clean; 170 MiB data, 729 MiB used, 536 GiB / 536 GiB avail; 4.5 MiB/s wr, 520 op/s 2021-11-03T16:54:22.683 INFO:tasks.workunit.client.1.smithi194.stdout:2/212: dwrite d6/fb [0,4194304] 0 2021-11-03T16:54:22.687 INFO:tasks.workunit.client.1.smithi194.stdout:2/213: creat d6/d21/f45 x:0 0 0 2021-11-03T16:54:22.716 INFO:tasks.workunit.client.1.smithi194.stdout:2/214: dwrite d6/f44 [0,4194304] 0 2021-11-03T16:54:22.717 INFO:tasks.workunit.client.1.smithi194.stdout:2/215: write d6/f7 [1015926,2626] 0 2021-11-03T16:54:22.742 INFO:tasks.workunit.client.1.smithi194.stdout:2/216: dwrite d6/de/d27/f3f [0,4194304] 0 2021-11-03T16:54:22.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:22 smithi194 conmon[35111]: cluster 2021-11-03T16:54:21.071371+0000 2021-11-03T16:54:22.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:22 smithi194 conmon[35111]: mgr.smithi026.cnrxli (mgr.14162) 300 : cluster [DBG] pgmap v247: 65 pgs: 65 active+clean; 170 MiB data, 729 MiB used, 536 GiB / 536 GiB avail; 4.5 MiB/s wr, 520 op/s 2021-11-03T16:54:22.757 INFO:tasks.workunit.client.1.smithi194.stdout:2/217: dwrite d6/fb [0,4194304] 0 2021-11-03T16:54:22.757 INFO:tasks.workunit.client.1.smithi194.stdout:2/218: stat d6/d21/d2a 0 2021-11-03T16:54:22.758 INFO:tasks.workunit.client.1.smithi194.stdout:2/219: write d6/d21/d2a/f2f [4140023,105287] 0 2021-11-03T16:54:22.760 INFO:tasks.workunit.client.1.smithi194.stdout:2/220: unlink d6/l8 0 2021-11-03T16:54:22.761 INFO:tasks.workunit.client.1.smithi194.stdout:2/221: write d6/f7 [1704128,98581] 0 2021-11-03T16:54:22.761 INFO:tasks.workunit.client.1.smithi194.stdout:2/222: dread d6/d1f/f2e [0,4194304] 0 2021-11-03T16:54:22.778 INFO:tasks.workunit.client.1.smithi194.stdout:2/223: dwrite d6/d21/f45 [0,4194304] 0 2021-11-03T16:54:22.779 INFO:tasks.workunit.client.1.smithi194.stdout:2/224: mknod d6/d17/c46 1 2021-11-03T16:54:22.782 INFO:tasks.workunit.client.1.smithi194.stdout:2/225: rmdir d6/d17 39 2021-11-03T16:54:22.808 INFO:tasks.workunit.client.1.smithi194.stdout:2/226: dwrite d6/d21/d2a/f2f [0,4194304] 0 2021-11-03T16:54:22.808 INFO:tasks.workunit.client.1.smithi194.stdout:2/227: chown d6/d17/l1b 2571494 1 2021-11-03T16:54:22.813 INFO:tasks.workunit.client.1.smithi194.stdout:2/228: symlink d6/d1f/l47 0 2021-11-03T16:54:22.834 INFO:tasks.workunit.client.1.smithi194.stdout:2/229: dwrite d6/d21/d2a/d31/f33 [0,4194304] 0 2021-11-03T16:54:22.834 INFO:tasks.workunit.client.1.smithi194.stdout:2/230: readlink d6/d17/l1b 0 2021-11-03T16:54:22.834 INFO:tasks.workunit.client.1.smithi194.stdout:2/231: chown d6/d1f/l2c 8 1 2021-11-03T16:54:22.834 INFO:tasks.workunit.client.1.smithi194.stdout:2/232: rename d6/f1e to d6/f48 0 2021-11-03T16:54:22.835 INFO:tasks.workunit.client.1.smithi194.stdout:2/233: stat d6/d21/l38 0 2021-11-03T16:54:22.851 INFO:tasks.workunit.client.1.smithi194.stdout:2/234: dwrite d6/d21/f3b [4194304,4194304] 0 2021-11-03T16:54:22.858 INFO:tasks.workunit.client.1.smithi194.stdout:2/235: dread d6/fd [0,4194304] 0 2021-11-03T16:54:22.867 INFO:tasks.workunit.client.1.smithi194.stdout:2/236: dread d6/d21/d2a/d31/f37 [0,4194304] 0 2021-11-03T16:54:22.867 INFO:tasks.workunit.client.1.smithi194.stdout:2/237: dread - d6/de/f40 zero size 2021-11-03T16:54:22.867 INFO:tasks.workunit.client.1.smithi194.stdout:2/238: readlink d6/d21/l38 0 2021-11-03T16:54:24.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:24 smithi026 conmon[32119]: cluster 2021-11-03T16:54:23.071826+0000 mgr.smithi026.cnrxli 2021-11-03T16:54:24.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:24 smithi026 conmon[32119]: (mgr.14162) 301 : cluster [DBG] pgmap v248: 65 pgs: 65 active+clean; 205 MiB data, 850 MiB used, 536 GiB / 536 GiB avail; 2.8 MiB/s rd, 7.4 MiB/s wr, 550 op/s 2021-11-03T16:54:24.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:24 smithi194 conmon[35111]: cluster 2021-11-03T16:54:23.071826+0000 mgr.smithi026.cnrxli (mgr.14162 2021-11-03T16:54:24.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:24 smithi194 conmon[35111]: ) 301 : cluster [DBG] pgmap v248: 65 pgs: 65 active+clean; 205 MiB data, 850 MiB used, 536 GiB / 536 GiB avail; 2.8 MiB/s rd, 7.4 MiB/s wr, 550 op/s 2021-11-03T16:54:26.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:26 smithi026 conmon[32119]: cluster 2021-11-03T16:54: 2021-11-03T16:54:26.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:26 smithi026 conmon[32119]: 25.072198+0000 mgr.smithi026.cnrxli (mgr.14162) 302 : cluster [DBG] pgmap v249: 65 pgs: 65 active+clean; 223 MiB data, 902 MiB used, 536 GiB / 536 GiB avail; 3.5 MiB/s rd, 8.9 MiB/s wr, 509 op/s 2021-11-03T16:54:26.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:26 smithi194 conmon[35111]: cluster 2021-11-03T16:54:25.072198+0000 mgr.smithi026.cnrxli (mgr.14162) 302 : cluster [DBG] pgmap v249: 65 pgs: 65 active+clean; 223 MiB data, 902 MiB used, 536 GiB / 536 GiB avail; 3.5 MiB/s rd, 8.9 MiB/s wr, 509 op/s 2021-11-03T16:54:28.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:28 smithi026 conmon[32119]: cluster 2021-11-03T16:54:27.072613+0000 mgr.smithi026.cnrxli (mgr.14162) 303 : cluster [DBG] pgmap v250: 65 pgs: 65 active+clean; 280 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 5.7 MiB/s rd, 17 MiB/s wr, 441 op/s 2021-11-03T16:54:28.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:28 smithi194 conmon[35111]: cluster 2021-11-03T16:54:27.072613+0000 mgr.smithi026.cnrxli (mgr.14162 2021-11-03T16:54:28.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:28 smithi194 conmon[35111]: ) 303 : cluster [DBG] pgmap v250: 65 pgs: 65 active+clean; 280 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 5.7 MiB/s rd, 17 MiB/s wr, 441 op/s 2021-11-03T16:54:30.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:30 smithi026 conmon[32119]: cluster 2021-11-03T16:54:29.073012+0000 mgr.smithi026.cnrxli (mgr.14162) 2021-11-03T16:54:30.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:30 smithi026 conmon[32119]: 304 : cluster [DBG] pgmap v251: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 6.1 MiB/s rd, 17 MiB/s wr, 250 op/s 2021-11-03T16:54:30.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:30 smithi194 conmon[35111]: cluster 2021-11-03T16:54:29.073012+0000 mgr.smithi026.cnrxli (mgr.14162) 304 : cluster [DBG] pgmap v251: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 6.1 MiB/s rd, 17 MiB/s wr, 250 op/s 2021-11-03T16:54:32.078 INFO:tasks.workunit.client.0.smithi026.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2021-11-03T16:54:32.079 INFO:tasks.workunit.client.0.smithi026.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2021-11-03T16:54:32.080 INFO:tasks.workunit.client.0.smithi026.stderr:+ make 2021-11-03T16:54:32.135 INFO:tasks.workunit.client.0.smithi026.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2021-11-03T16:54:32.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:32 smithi026 conmon[32119]: cluster 2021-11-03T16:54:31. 2021-11-03T16:54:32.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:32 smithi026 conmon[32119]: 073437+0000 mgr.smithi026.cnrxli (mgr.14162) 305 : cluster [DBG] pgmap v252: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 6.1 MiB/s rd, 17 MiB/s wr, 284 op/s 2021-11-03T16:54:32.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:32 smithi194 conmon[35111]: cluster 2021-11-03T16:54:31.073437+0000 mgr.smithi026.cnrxli (mgr.14162) 305 : cluster [DBG] pgmap v252: 65 pgs: 65 active+clean; 305 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 6.1 MiB/s rd, 17 MiB/s wr, 284 op/s 2021-11-03T16:54:33.089 INFO:tasks.workunit.client.0.smithi026.stderr:++ readlink -f fsstress 2021-11-03T16:54:33.089 INFO:tasks.workunit.client.0.smithi026.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2021-11-03T16:54:33.090 INFO:tasks.workunit.client.0.smithi026.stderr:+ popd 2021-11-03T16:54:33.090 INFO:tasks.workunit.client.0.smithi026.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2021-11-03T16:54:33.091 INFO:tasks.workunit.client.0.smithi026.stderr:+ popd 2021-11-03T16:54:33.091 INFO:tasks.workunit.client.0.smithi026.stdout:~/cephtest/mnt.0/client.0/tmp 2021-11-03T16:54:33.092 INFO:tasks.workunit.client.0.smithi026.stderr:++ mktemp -d -p . 2021-11-03T16:54:33.092 INFO:tasks.workunit.client.0.smithi026.stderr:+ T=./tmp.5YMXmCaLjI 2021-11-03T16:54:33.092 INFO:tasks.workunit.client.0.smithi026.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.5YMXmCaLjI -l 1 -n 1000 -p 10 -v 2021-11-03T16:54:33.094 INFO:tasks.workunit.client.0.smithi026.stdout:seed = 1635989835 2021-11-03T16:54:33.099 INFO:tasks.workunit.client.0.smithi026.stdout:1/0: link - no file 2021-11-03T16:54:33.099 INFO:tasks.workunit.client.0.smithi026.stdout:1/1: dread - no filename 2021-11-03T16:54:33.099 INFO:tasks.workunit.client.0.smithi026.stdout:1/2: chown . 7696546 1 2021-11-03T16:54:33.099 INFO:tasks.workunit.client.0.smithi026.stdout:1/3: dread - no filename 2021-11-03T16:54:33.100 INFO:tasks.workunit.client.0.smithi026.stdout:1/4: dread - no filename 2021-11-03T16:54:33.100 INFO:tasks.workunit.client.0.smithi026.stdout:1/5: dread - no filename 2021-11-03T16:54:33.100 INFO:tasks.workunit.client.0.smithi026.stdout:1/6: mkdir d0 0 2021-11-03T16:54:33.101 INFO:tasks.workunit.client.0.smithi026.stdout:3/0: stat - no entries 2021-11-03T16:54:33.102 INFO:tasks.workunit.client.0.smithi026.stdout:3/1: dread - no filename 2021-11-03T16:54:33.102 INFO:tasks.workunit.client.0.smithi026.stdout:2/0: creat f0 x:0 0 0 2021-11-03T16:54:33.115 INFO:tasks.workunit.client.0.smithi026.stdout:3/2: creat f0 x:0 0 0 2021-11-03T16:54:33.115 INFO:tasks.workunit.client.0.smithi026.stdout:3/3: dread - f0 zero size 2021-11-03T16:54:33.251 INFO:tasks.workunit.client.0.smithi026.stdout:2/1: mknod c1 1 2021-11-03T16:54:33.251 INFO:tasks.workunit.client.0.smithi026.stdout:4/0: mknod c0 1 2021-11-03T16:54:33.251 INFO:tasks.workunit.client.0.smithi026.stdout:4/1: read - no filename 2021-11-03T16:54:33.251 INFO:tasks.workunit.client.0.smithi026.stdout:4/2: unlink - no file 2021-11-03T16:54:33.252 INFO:tasks.workunit.client.0.smithi026.stdout:4/3: mknod c1 1 2021-11-03T16:54:33.252 INFO:tasks.workunit.client.0.smithi026.stdout:1/7: rmdir d0 0 2021-11-03T16:54:33.252 INFO:tasks.workunit.client.0.smithi026.stdout:1/8: dwrite - no filename 2021-11-03T16:54:33.252 INFO:tasks.workunit.client.0.smithi026.stdout:1/9: truncate - no filename 2021-11-03T16:54:33.253 INFO:tasks.workunit.client.0.smithi026.stdout:1/10: unlink - no file 2021-11-03T16:54:33.253 INFO:tasks.workunit.client.0.smithi026.stdout:1/11: fdatasync - no filename 2021-11-03T16:54:33.253 INFO:tasks.workunit.client.0.smithi026.stdout:1/12: truncate - no filename 2021-11-03T16:54:33.253 INFO:tasks.workunit.client.0.smithi026.stdout:1/13: dread - no filename 2021-11-03T16:54:33.253 INFO:tasks.workunit.client.0.smithi026.stdout:1/14: link - no file 2021-11-03T16:54:33.254 INFO:tasks.workunit.client.0.smithi026.stdout:1/15: fsync - no filename 2021-11-03T16:54:33.254 INFO:tasks.workunit.client.0.smithi026.stdout:8/0: mknod c0 1 2021-11-03T16:54:33.254 INFO:tasks.workunit.client.0.smithi026.stdout:8/1: chown . 356 1 2021-11-03T16:54:33.254 INFO:tasks.workunit.client.0.smithi026.stdout:8/2: dread - no filename 2021-11-03T16:54:33.255 INFO:tasks.workunit.client.0.smithi026.stdout:8/3: chown . 20610243 1 2021-11-03T16:54:33.255 INFO:tasks.workunit.client.0.smithi026.stdout:9/0: mknod c0 1 2021-11-03T16:54:33.255 INFO:tasks.workunit.client.0.smithi026.stdout:5/0: dread - no filename 2021-11-03T16:54:33.255 INFO:tasks.workunit.client.0.smithi026.stdout:5/1: dread - no filename 2021-11-03T16:54:33.255 INFO:tasks.workunit.client.0.smithi026.stdout:5/2: fdatasync - no filename 2021-11-03T16:54:33.256 INFO:tasks.workunit.client.0.smithi026.stdout:5/3: write - no filename 2021-11-03T16:54:33.256 INFO:tasks.workunit.client.0.smithi026.stdout:7/0: write - no filename 2021-11-03T16:54:33.256 INFO:tasks.workunit.client.0.smithi026.stdout:7/1: read - no filename 2021-11-03T16:54:33.256 INFO:tasks.workunit.client.0.smithi026.stdout:7/2: write - no filename 2021-11-03T16:54:33.276 INFO:tasks.workunit.client.0.smithi026.stdout:3/4: fsync f0 0 2021-11-03T16:54:33.276 INFO:tasks.workunit.client.0.smithi026.stdout:3/5: read - f0 zero size 2021-11-03T16:54:33.595 INFO:tasks.workunit.client.0.smithi026.stdout:4/4: creat f2 x:0 0 0 2021-11-03T16:54:33.596 INFO:tasks.workunit.client.0.smithi026.stdout:4/5: chown f2 83676495 1 2021-11-03T16:54:33.596 INFO:tasks.workunit.client.0.smithi026.stdout:4/6: mknod c3 1 2021-11-03T16:54:33.596 INFO:tasks.workunit.client.0.smithi026.stdout:4/7: chown f2 11 1 2021-11-03T16:54:33.597 INFO:tasks.workunit.client.0.smithi026.stdout:6/0: creat f0 x:0 0 0 2021-11-03T16:54:33.597 INFO:tasks.workunit.client.0.smithi026.stdout:1/16: creat f1 x:0 0 0 2021-11-03T16:54:33.599 INFO:tasks.workunit.client.0.smithi026.stdout:8/4: creat f1 x:0 0 0 2021-11-03T16:54:33.600 INFO:tasks.workunit.client.0.smithi026.stdout:9/1: creat f1 x:0 0 0 2021-11-03T16:54:33.607 INFO:tasks.workunit.client.0.smithi026.stdout:7/3: creat f0 x:0 0 0 2021-11-03T16:54:33.822 INFO:tasks.workunit.client.0.smithi026.stdout:3/6: rename f0 to f1 0 2021-11-03T16:54:33.823 INFO:tasks.workunit.client.0.smithi026.stdout:3/7: dread - f1 zero size 2021-11-03T16:54:33.842 INFO:tasks.workunit.client.0.smithi026.stdout:3/8: dwrite f1 [0,4194304] 0 2021-11-03T16:54:33.842 INFO:tasks.workunit.client.0.smithi026.stdout:3/9: mknod c2 1 2021-11-03T16:54:33.842 INFO:tasks.workunit.client.0.smithi026.stdout:3/10: mknod c3 1 2021-11-03T16:54:33.868 INFO:tasks.workunit.client.0.smithi026.stdout:6/1: rename f0 to f1 0 2021-11-03T16:54:33.870 INFO:tasks.workunit.client.0.smithi026.stdout:1/17: symlink l2 0 2021-11-03T16:54:33.872 INFO:tasks.workunit.client.0.smithi026.stdout:8/5: mkdir d2 0 2021-11-03T16:54:33.876 INFO:tasks.workunit.client.0.smithi026.stdout:9/2: unlink f1 0 2021-11-03T16:54:33.876 INFO:tasks.workunit.client.0.smithi026.stdout:9/3: read - no filename 2021-11-03T16:54:33.885 INFO:tasks.workunit.client.0.smithi026.stdout:3/11: creat f4 x:0 0 0 2021-11-03T16:54:33.887 INFO:tasks.workunit.client.0.smithi026.stdout:6/2: creat f2 x:0 0 0 2021-11-03T16:54:33.887 INFO:tasks.workunit.client.0.smithi026.stdout:6/3: mknod c3 1 2021-11-03T16:54:33.887 INFO:tasks.workunit.client.0.smithi026.stdout:6/4: stat f1 0 2021-11-03T16:54:33.889 INFO:tasks.workunit.client.0.smithi026.stdout:1/18: rename l2 to l3 0 2021-11-03T16:54:33.891 INFO:tasks.workunit.client.0.smithi026.stdout:9/4: mkdir d2 0 2021-11-03T16:54:33.894 INFO:tasks.workunit.client.0.smithi026.stdout:1/19: symlink l4 0 2021-11-03T16:54:33.894 INFO:tasks.workunit.client.0.smithi026.stdout:1/20: dread - f1 zero size 2021-11-03T16:54:33.894 INFO:tasks.workunit.client.0.smithi026.stdout:1/21: write f1 [706242,22123] 0 2021-11-03T16:54:33.894 INFO:tasks.workunit.client.0.smithi026.stdout:1/22: mknod c5 1 2021-11-03T16:54:33.895 INFO:tasks.workunit.client.0.smithi026.stdout:9/5: symlink d2/l3 0 2021-11-03T16:54:33.895 INFO:tasks.workunit.client.0.smithi026.stdout:9/6: rename d2 to d2/d4 22 2021-11-03T16:54:33.896 INFO:tasks.workunit.client.0.smithi026.stdout:9/7: write - no filename 2021-11-03T16:54:33.896 INFO:tasks.workunit.client.0.smithi026.stdout:9/8: write - no filename 2021-11-03T16:54:33.898 INFO:tasks.workunit.client.0.smithi026.stdout:8/6: dwrite f1 [0,4194304] 0 2021-11-03T16:54:33.899 INFO:tasks.workunit.client.0.smithi026.stdout:9/9: mkdir d2/d5 0 2021-11-03T16:54:33.899 INFO:tasks.workunit.client.0.smithi026.stdout:9/10: write - no filename 2021-11-03T16:54:33.899 INFO:tasks.workunit.client.0.smithi026.stdout:9/11: chown d2 13416828 1 2021-11-03T16:54:33.900 INFO:tasks.workunit.client.0.smithi026.stdout:9/12: dwrite - no filename 2021-11-03T16:54:33.900 INFO:tasks.workunit.client.0.smithi026.stdout:9/13: dread - no filename 2021-11-03T16:54:33.917 INFO:tasks.workunit.client.0.smithi026.stdout:1/23: dwrite f1 [0,4194304] 0 2021-11-03T16:54:33.953 INFO:tasks.workunit.client.0.smithi026.stdout:8/7: symlink d2/l3 0 2021-11-03T16:54:34.026 INFO:tasks.workunit.client.0.smithi026.stdout:9/14: rename d2/l3 to d2/d5/l6 0 2021-11-03T16:54:34.027 INFO:tasks.workunit.client.0.smithi026.stdout:9/15: dread - no filename 2021-11-03T16:54:34.027 INFO:tasks.workunit.client.0.smithi026.stdout:9/16: write - no filename 2021-11-03T16:54:34.027 INFO:tasks.workunit.client.0.smithi026.stdout:9/17: fdatasync - no filename 2021-11-03T16:54:34.027 INFO:tasks.workunit.client.0.smithi026.stdout:9/18: mknod d2/d5/c7 1 2021-11-03T16:54:34.028 INFO:tasks.workunit.client.0.smithi026.stdout:9/19: dwrite - no filename 2021-11-03T16:54:34.028 INFO:tasks.workunit.client.0.smithi026.stdout:9/20: fsync - no filename 2021-11-03T16:54:34.042 INFO:tasks.workunit.client.0.smithi026.stdout:7/4: getdents . 0 2021-11-03T16:54:34.056 INFO:tasks.workunit.client.0.smithi026.stdout:7/5: dwrite f0 [0,4194304] 0 2021-11-03T16:54:34.056 INFO:tasks.workunit.client.0.smithi026.stdout:7/6: rmdir - no directory 2021-11-03T16:54:34.057 INFO:tasks.workunit.client.0.smithi026.stdout:7/7: mknod c1 1 2021-11-03T16:54:34.057 INFO:tasks.workunit.client.0.smithi026.stdout:7/8: write f0 [2379357,52427] 0 2021-11-03T16:54:34.058 INFO:tasks.workunit.client.0.smithi026.stdout:7/9: read f0 [1780098,44848] 0 2021-11-03T16:54:34.058 INFO:tasks.workunit.client.0.smithi026.stdout:7/10: getdents . 0 2021-11-03T16:54:34.059 INFO:tasks.workunit.client.0.smithi026.stdout:7/11: write f0 [2764520,103872] 0 2021-11-03T16:54:34.059 INFO:tasks.workunit.client.0.smithi026.stdout:7/12: mknod c2 1 2021-11-03T16:54:34.059 INFO:tasks.workunit.client.0.smithi026.stdout:7/13: getdents . 0 2021-11-03T16:54:34.068 INFO:tasks.workunit.client.0.smithi026.stdout:7/14: dread f0 [0,4194304] 0 2021-11-03T16:54:34.083 INFO:tasks.workunit.client.0.smithi026.stdout:7/15: dwrite f0 [0,4194304] 0 2021-11-03T16:54:34.083 INFO:tasks.workunit.client.0.smithi026.stdout:7/16: truncate f0 4950947 0 2021-11-03T16:54:34.083 INFO:tasks.workunit.client.0.smithi026.stdout:7/17: mknod c3 1 2021-11-03T16:54:34.083 INFO:tasks.workunit.client.0.smithi026.stdout:7/18: chown f0 6481996 1 2021-11-03T16:54:34.084 INFO:tasks.workunit.client.0.smithi026.stdout:7/19: chown f0 102570767 1 2021-11-03T16:54:34.084 INFO:tasks.workunit.client.0.smithi026.stdout:7/20: fdatasync f0 0 2021-11-03T16:54:34.084 INFO:tasks.workunit.client.0.smithi026.stdout:7/21: mknod c4 1 2021-11-03T16:54:34.084 INFO:tasks.workunit.client.0.smithi026.stdout:7/22: chown f0 65860372 1 2021-11-03T16:54:34.089 INFO:tasks.workunit.client.0.smithi026.stdout:7/23: dread f0 [0,4194304] 0 2021-11-03T16:54:34.090 INFO:tasks.workunit.client.0.smithi026.stdout:7/24: readlink - no filename 2021-11-03T16:54:34.175 INFO:tasks.workunit.client.0.smithi026.stdout:3/12: truncate f1 791786 0 2021-11-03T16:54:34.175 INFO:tasks.workunit.client.0.smithi026.stdout:3/13: mknod c5 1 2021-11-03T16:54:34.178 INFO:tasks.workunit.client.0.smithi026.stdout:1/24: rename l3 to l6 0 2021-11-03T16:54:34.193 INFO:tasks.workunit.client.0.smithi026.stdout:8/8: link f1 d2/f4 0 2021-11-03T16:54:34.194 INFO:tasks.workunit.client.0.smithi026.stdout:8/9: stat f1 0 2021-11-03T16:54:34.195 INFO:tasks.workunit.client.0.smithi026.stdout:1/25: creat f7 x:0 0 0 2021-11-03T16:54:34.196 INFO:tasks.workunit.client.0.smithi026.stdout:1/26: dread - f7 zero size 2021-11-03T16:54:34.201 INFO:tasks.workunit.client.0.smithi026.stdout:7/25: link f0 f5 0 2021-11-03T16:54:34.201 INFO:tasks.workunit.client.0.smithi026.stdout:7/26: rmdir - no directory 2021-11-03T16:54:34.212 INFO:tasks.workunit.client.0.smithi026.stdout:8/10: dwrite f1 [0,4194304] 0 2021-11-03T16:54:34.212 INFO:tasks.workunit.client.0.smithi026.stdout:1/27: getdents . 0 2021-11-03T16:54:34.212 INFO:tasks.workunit.client.0.smithi026.stdout:1/28: readlink l4 0 2021-11-03T16:54:34.213 INFO:tasks.workunit.client.0.smithi026.stdout:8/11: read d2/f4 [1676475,92215] 0 2021-11-03T16:54:34.215 INFO:tasks.workunit.client.0.smithi026.stdout:7/27: fsync f5 0 2021-11-03T16:54:34.219 INFO:tasks.workunit.client.0.smithi026.stdout:8/12: creat d2/f5 x:0 0 0 2021-11-03T16:54:34.219 INFO:tasks.workunit.client.0.smithi026.stdout:8/13: stat d2/f5 0 2021-11-03T16:54:34.226 INFO:tasks.workunit.client.0.smithi026.stdout:8/14: write f1 [1024511,41647] 0 2021-11-03T16:54:34.229 INFO:tasks.workunit.client.0.smithi026.stdout:8/15: unlink f1 0 2021-11-03T16:54:34.229 INFO:tasks.workunit.client.0.smithi026.stdout:8/16: mknod d2/c6 1 2021-11-03T16:54:34.229 INFO:tasks.workunit.client.0.smithi026.stdout:8/17: chown d2/l3 0 1 2021-11-03T16:54:34.242 INFO:tasks.workunit.client.0.smithi026.stdout:7/28: dwrite f0 [0,4194304] 0 2021-11-03T16:54:34.243 INFO:tasks.workunit.client.0.smithi026.stdout:1/29: dwrite f1 [4194304,4194304] 0 2021-11-03T16:54:34.243 INFO:tasks.workunit.client.0.smithi026.stdout:1/30: mknod c8 1 2021-11-03T16:54:34.244 INFO:tasks.workunit.client.0.smithi026.stdout:1/31: fdatasync f7 0 2021-11-03T16:54:34.248 INFO:tasks.workunit.client.0.smithi026.stdout:1/32: creat f9 x:0 0 0 2021-11-03T16:54:34.253 INFO:tasks.workunit.client.0.smithi026.stdout:8/18: dread d2/f4 [0,4194304] 0 2021-11-03T16:54:34.259 INFO:tasks.workunit.client.0.smithi026.stdout:1/33: rename l4 to la 0 2021-11-03T16:54:34.259 INFO:tasks.workunit.client.0.smithi026.stdout:1/34: rmdir - no directory 2021-11-03T16:54:34.260 INFO:tasks.workunit.client.0.smithi026.stdout:1/35: mknod cb 1 2021-11-03T16:54:34.266 INFO:tasks.workunit.client.0.smithi026.stdout:8/19: creat d2/f7 x:0 0 0 2021-11-03T16:54:34.267 INFO:tasks.workunit.client.0.smithi026.stdout:8/20: truncate d2/f7 380588 0 2021-11-03T16:54:34.273 INFO:tasks.workunit.client.0.smithi026.stdout:7/29: truncate f0 4014042 0 2021-11-03T16:54:34.275 INFO:tasks.workunit.client.0.smithi026.stdout:7/30: getdents . 0 2021-11-03T16:54:34.275 INFO:tasks.workunit.client.0.smithi026.stdout:7/31: mknod c6 1 2021-11-03T16:54:34.275 INFO:tasks.workunit.client.0.smithi026.stdout:7/32: chown f5 444603 1 2021-11-03T16:54:34.283 INFO:tasks.workunit.client.0.smithi026.stdout:1/36: dwrite f1 [4194304,4194304] 0 2021-11-03T16:54:34.287 INFO:tasks.workunit.client.0.smithi026.stdout:1/37: mkdir dc 0 2021-11-03T16:54:34.287 INFO:tasks.workunit.client.0.smithi026.stdout:1/38: mknod dc/cd 1 2021-11-03T16:54:34.291 INFO:tasks.workunit.client.0.smithi026.stdout:8/21: read - d2/f5 zero size 2021-11-03T16:54:34.294 INFO:tasks.workunit.client.0.smithi026.stdout:1/39: creat dc/fe x:0 0 0 2021-11-03T16:54:34.296 INFO:tasks.workunit.client.0.smithi026.stdout:7/33: link f5 f7 0 2021-11-03T16:54:34.307 INFO:tasks.workunit.client.0.smithi026.stdout:8/22: readlink d2/l3 0 2021-11-03T16:54:34.309 INFO:tasks.workunit.client.0.smithi026.stdout:7/34: mknod c8 1 2021-11-03T16:54:34.312 INFO:tasks.workunit.client.0.smithi026.stdout:7/35: getdents . 0 2021-11-03T16:54:34.312 INFO:tasks.workunit.client.0.smithi026.stdout:7/36: mknod c9 1 2021-11-03T16:54:34.313 INFO:tasks.workunit.client.0.smithi026.stdout:7/37: unlink f5 0 2021-11-03T16:54:34.316 INFO:tasks.workunit.client.0.smithi026.stdout:7/38: mkdir da 0 2021-11-03T16:54:34.325 INFO:tasks.workunit.client.0.smithi026.stdout:7/39: dread f7 [0,4194304] 0 2021-11-03T16:54:34.327 INFO:tasks.workunit.client.0.smithi026.stdout:7/40: symlink da/lb 0 2021-11-03T16:54:34.328 INFO:tasks.workunit.client.0.smithi026.stdout:7/41: rmdir da 39 2021-11-03T16:54:34.329 INFO:tasks.workunit.client.0.smithi026.stdout:7/42: read f7 [2798875,129652] 0 2021-11-03T16:54:34.331 INFO:tasks.workunit.client.0.smithi026.stdout:7/43: truncate f7 3874545 0 2021-11-03T16:54:34.331 INFO:tasks.workunit.client.0.smithi026.stdout:7/44: stat da 0 2021-11-03T16:54:34.348 INFO:tasks.workunit.client.0.smithi026.stdout:7/45: read f0 [1551740,37329] 0 2021-11-03T16:54:34.351 INFO:tasks.workunit.client.0.smithi026.stdout:7/46: dread f7 [0,4194304] 0 2021-11-03T16:54:34.351 INFO:tasks.workunit.client.0.smithi026.stdout:7/47: chown f7 1121417 1 2021-11-03T16:54:34.356 INFO:tasks.workunit.client.0.smithi026.stdout:7/48: creat da/fc x:0 0 0 2021-11-03T16:54:34.357 INFO:tasks.workunit.client.0.smithi026.stdout:7/49: fdatasync da/fc 0 2021-11-03T16:54:34.357 INFO:tasks.workunit.client.0.smithi026.stdout:7/50: chown f7 1235 1 2021-11-03T16:54:34.372 INFO:tasks.workunit.client.0.smithi026.stdout:7/51: dwrite da/fc [0,4194304] 0 2021-11-03T16:54:34.375 INFO:tasks.workunit.client.0.smithi026.stdout:7/52: dread f0 [0,4194304] 0 2021-11-03T16:54:34.391 INFO:tasks.workunit.client.0.smithi026.stdout:7/53: link da/fc da/fd 0 2021-11-03T16:54:34.405 INFO:tasks.workunit.client.0.smithi026.stdout:7/54: dwrite f7 [0,4194304] 0 2021-11-03T16:54:34.406 INFO:tasks.workunit.client.0.smithi026.stdout:7/55: write f7 [1490999,100131] 0 2021-11-03T16:54:34.412 INFO:tasks.workunit.client.0.smithi026.stdout:7/56: truncate da/fc 1840286 0 2021-11-03T16:54:34.413 INFO:tasks.workunit.client.0.smithi026.stdout:7/57: stat da/fd 0 2021-11-03T16:54:34.420 INFO:tasks.workunit.client.0.smithi026.stdout:7/58: creat da/fe x:0 0 0 2021-11-03T16:54:34.420 INFO:tasks.workunit.client.0.smithi026.stdout:7/59: mknod da/cf 1 2021-11-03T16:54:34.423 INFO:tasks.workunit.client.0.smithi026.stdout:7/60: link f7 da/f10 0 2021-11-03T16:54:34.423 INFO:tasks.workunit.client.0.smithi026.stdout:7/61: stat da/f10 0 2021-11-03T16:54:34.432 INFO:tasks.workunit.client.0.smithi026.stdout:7/62: dread da/f10 [0,4194304] 0 2021-11-03T16:54:34.436 INFO:tasks.workunit.client.0.smithi026.stdout:7/63: dread f7 [0,4194304] 0 2021-11-03T16:54:34.436 INFO:tasks.workunit.client.0.smithi026.stdout:7/64: fsync da/fc 0 2021-11-03T16:54:34.449 INFO:tasks.workunit.client.0.smithi026.stdout:7/65: dwrite da/f10 [0,4194304] 0 2021-11-03T16:54:34.449 INFO:tasks.workunit.client.0.smithi026.stdout:7/66: mknod da/c11 1 2021-11-03T16:54:34.458 INFO:tasks.workunit.client.0.smithi026.stdout:7/67: dread da/fc [0,4194304] 0 2021-11-03T16:54:34.458 INFO:tasks.workunit.client.0.smithi026.stdout:7/68: chown da/lb 1 1 2021-11-03T16:54:34.460 INFO:tasks.workunit.client.0.smithi026.stdout:7/69: creat da/f12 x:0 0 0 2021-11-03T16:54:34.462 INFO:tasks.workunit.client.0.smithi026.stdout:7/70: truncate da/fd 319312 0 2021-11-03T16:54:34.462 INFO:tasks.workunit.client.0.smithi026.stdout:7/71: readlink da/lb 0 2021-11-03T16:54:34.464 INFO:tasks.workunit.client.0.smithi026.stdout:7/72: rename da/fe to da/f13 0 2021-11-03T16:54:34.478 INFO:tasks.workunit.client.0.smithi026.stdout:7/73: dread da/fd [0,4194304] 0 2021-11-03T16:54:34.479 INFO:tasks.workunit.client.0.smithi026.stdout:7/74: chown da/fc 73624 1 2021-11-03T16:54:34.482 INFO:tasks.workunit.client.0.smithi026.stdout:7/75: mkdir da/d14 0 2021-11-03T16:54:34.482 INFO:tasks.workunit.client.0.smithi026.stdout:7/76: readlink da/lb 0 2021-11-03T16:54:34.487 INFO:tasks.workunit.client.0.smithi026.stdout:7/77: mkdir da/d14/d15 0 2021-11-03T16:54:34.490 INFO:tasks.workunit.client.0.smithi026.stdout:7/78: symlink da/l16 0 2021-11-03T16:54:34.490 INFO:tasks.workunit.client.0.smithi026.stdout:7/79: fsync da/f13 0 2021-11-03T16:54:34.511 INFO:tasks.workunit.client.0.smithi026.stdout:7/80: dwrite da/f12 [0,4194304] 0 2021-11-03T16:54:34.515 INFO:tasks.workunit.client.0.smithi026.stdout:7/81: creat da/d14/d15/f17 x:0 0 0 2021-11-03T16:54:34.516 INFO:tasks.workunit.client.0.smithi026.stdout:7/82: chown f0 0 1 2021-11-03T16:54:34.516 INFO:tasks.workunit.client.0.smithi026.stdout:7/83: write f7 [2536283,31406] 0 2021-11-03T16:54:34.517 INFO:tasks.workunit.client.0.smithi026.stdout:7/84: chown da/lb 105029 1 2021-11-03T16:54:34.517 INFO:tasks.workunit.client.0.smithi026.stdout:7/85: truncate da/fd 371309 0 2021-11-03T16:54:34.519 INFO:tasks.workunit.client.0.smithi026.stdout:7/86: fsync da/f10 0 2021-11-03T16:54:34.519 INFO:tasks.workunit.client.0.smithi026.stdout:7/87: truncate da/f13 780710 0 2021-11-03T16:54:34.519 INFO:tasks.workunit.client.0.smithi026.stdout:7/88: stat da/f12 0 2021-11-03T16:54:34.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:34 smithi026 conmon[32119]: cluster 2021-11-03T16:54:33.073964+0000 mgr.smithi026.cnrxli (mgr.14162) 306 : cluster 2021-11-03T16:54:34.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:34 smithi026 conmon[32119]: [DBG] pgmap v253: 65 pgs: 65 active+clean; 319 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 6.1 MiB/s rd, 17 MiB/s wr, 335 op/s 2021-11-03T16:54:34.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:34 smithi194 conmon[35111]: cluster 2021-11-03T16:54:33.073964+0000 mgr.smithi026.cnrxli ( 2021-11-03T16:54:34.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:34 smithi194 conmon[35111]: mgr.14162) 306 : cluster [DBG] pgmap v253: 65 pgs: 65 active+clean; 319 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 6.1 MiB/s rd, 17 MiB/s wr, 335 op/s 2021-11-03T16:54:35.433 INFO:tasks.workunit.client.1.smithi194.stdout:4/10: sync 2021-11-03T16:54:35.434 INFO:tasks.workunit.client.1.smithi194.stdout:2/239: sync 2021-11-03T16:54:35.434 INFO:tasks.workunit.client.1.smithi194.stdout:5/77: sync 2021-11-03T16:54:35.434 INFO:tasks.workunit.client.1.smithi194.stdout:3/33: sync 2021-11-03T16:54:35.435 INFO:tasks.workunit.client.1.smithi194.stdout:7/6: sync 2021-11-03T16:54:35.435 INFO:tasks.workunit.client.1.smithi194.stdout:7/7: write - no filename 2021-11-03T16:54:35.435 INFO:tasks.workunit.client.1.smithi194.stdout:7/8: truncate - no filename 2021-11-03T16:54:35.435 INFO:tasks.workunit.client.1.smithi194.stdout:7/9: write - no filename 2021-11-03T16:54:35.436 INFO:tasks.workunit.client.1.smithi194.stdout:7/10: fsync - no filename 2021-11-03T16:54:35.436 INFO:tasks.workunit.client.1.smithi194.stdout:8/24: sync 2021-11-03T16:54:35.436 INFO:tasks.workunit.client.1.smithi194.stdout:6/3: sync 2021-11-03T16:54:35.436 INFO:tasks.workunit.client.1.smithi194.stdout:0/0: sync 2021-11-03T16:54:35.436 INFO:tasks.workunit.client.1.smithi194.stdout:6/4: write - no filename 2021-11-03T16:54:35.437 INFO:tasks.workunit.client.1.smithi194.stdout:0/1: dwrite - no filename 2021-11-03T16:54:35.437 INFO:tasks.workunit.client.1.smithi194.stdout:7/11: chown . 21320 1 2021-11-03T16:54:35.437 INFO:tasks.workunit.client.1.smithi194.stdout:6/5: chown . 811831272 1 2021-11-03T16:54:35.437 INFO:tasks.workunit.client.1.smithi194.stdout:6/6: truncate - no filename 2021-11-03T16:54:35.438 INFO:tasks.workunit.client.1.smithi194.stdout:6/7: stat - no entries 2021-11-03T16:54:35.438 INFO:tasks.workunit.client.1.smithi194.stdout:6/8: dwrite - no filename 2021-11-03T16:54:35.438 INFO:tasks.workunit.client.1.smithi194.stdout:5/78: chown d2/dd/f1b 9530315 1 2021-11-03T16:54:35.438 INFO:tasks.workunit.client.1.smithi194.stdout:3/34: truncate d2/fa 68376 0 2021-11-03T16:54:35.438 INFO:tasks.workunit.client.1.smithi194.stdout:1/2: sync 2021-11-03T16:54:35.439 INFO:tasks.workunit.client.1.smithi194.stdout:1/3: link - no file 2021-11-03T16:54:35.439 INFO:tasks.workunit.client.1.smithi194.stdout:1/4: dwrite - no filename 2021-11-03T16:54:35.439 INFO:tasks.workunit.client.1.smithi194.stdout:9/41: sync 2021-11-03T16:54:35.439 INFO:tasks.workunit.client.1.smithi194.stdout:9/42: write f8 [1579969,38704] 0 2021-11-03T16:54:35.440 INFO:tasks.workunit.client.1.smithi194.stdout:5/79: write f0 [375460,6961] 0 2021-11-03T16:54:35.440 INFO:tasks.workunit.client.1.smithi194.stdout:5/80: rename d2/dd to d2/dd/d1e 22 2021-11-03T16:54:35.441 INFO:tasks.workunit.client.1.smithi194.stdout:4/11: mkdir d6 0 2021-11-03T16:54:35.442 INFO:tasks.workunit.client.1.smithi194.stdout:4/12: dread - f4 zero size 2021-11-03T16:54:35.442 INFO:tasks.workunit.client.1.smithi194.stdout:2/240: link d6/d21/f23 d6/de/d27/f49 0 2021-11-03T16:54:35.442 INFO:tasks.workunit.client.1.smithi194.stdout:6/9: creat f0 x:0 0 0 2021-11-03T16:54:35.442 INFO:tasks.workunit.client.1.smithi194.stdout:6/10: mknod c1 1 2021-11-03T16:54:35.442 INFO:tasks.workunit.client.1.smithi194.stdout:6/11: write f0 [65624,61880] 0 2021-11-03T16:54:35.443 INFO:tasks.workunit.client.1.smithi194.stdout:7/12: creat f0 x:0 0 0 2021-11-03T16:54:35.443 INFO:tasks.workunit.client.1.smithi194.stdout:7/13: write f0 [153742,28277] 0 2021-11-03T16:54:35.443 INFO:tasks.workunit.client.1.smithi194.stdout:8/25: creat f7 x:0 0 0 2021-11-03T16:54:35.443 INFO:tasks.workunit.client.1.smithi194.stdout:0/2: creat f0 x:0 0 0 2021-11-03T16:54:35.443 INFO:tasks.workunit.client.1.smithi194.stdout:3/35: readlink d2/l5 0 2021-11-03T16:54:35.444 INFO:tasks.workunit.client.1.smithi194.stdout:1/5: mkdir d0/d1 0 2021-11-03T16:54:35.444 INFO:tasks.workunit.client.1.smithi194.stdout:9/43: symlink le 0 2021-11-03T16:54:35.445 INFO:tasks.workunit.client.1.smithi194.stdout:5/81: creat d2/f1f x:0 0 0 2021-11-03T16:54:35.447 INFO:tasks.workunit.client.1.smithi194.stdout:4/13: creat d6/f7 x:0 0 0 2021-11-03T16:54:35.447 INFO:tasks.workunit.client.1.smithi194.stdout:5/82: write d2/d3/fc [675324,26230] 0 2021-11-03T16:54:35.447 INFO:tasks.workunit.client.1.smithi194.stdout:5/83: chown d2/l15 15303 1 2021-11-03T16:54:35.447 INFO:tasks.workunit.client.1.smithi194.stdout:5/84: chown d2/d3 0 1 2021-11-03T16:54:35.447 INFO:tasks.workunit.client.1.smithi194.stdout:5/85: chown d2 0 1 2021-11-03T16:54:35.448 INFO:tasks.workunit.client.1.smithi194.stdout:2/241: creat d6/de/d16/f4a x:0 0 0 2021-11-03T16:54:35.448 INFO:tasks.workunit.client.1.smithi194.stdout:8/26: dread f5 [0,4194304] 0 2021-11-03T16:54:35.449 INFO:tasks.workunit.client.1.smithi194.stdout:6/12: rename f0 to f2 0 2021-11-03T16:54:35.449 INFO:tasks.workunit.client.1.smithi194.stdout:6/13: stat f2 0 2021-11-03T16:54:35.450 INFO:tasks.workunit.client.1.smithi194.stdout:7/14: symlink l1 0 2021-11-03T16:54:35.452 INFO:tasks.workunit.client.1.smithi194.stdout:0/3: creat f1 x:0 0 0 2021-11-03T16:54:35.452 INFO:tasks.workunit.client.1.smithi194.stdout:0/4: write f0 [405674,90193] 0 2021-11-03T16:54:35.452 INFO:tasks.workunit.client.1.smithi194.stdout:3/36: mknod d2/ce 1 2021-11-03T16:54:35.454 INFO:tasks.workunit.client.1.smithi194.stdout:1/6: rmdir d0/d1 0 2021-11-03T16:54:35.456 INFO:tasks.workunit.client.1.smithi194.stdout:9/44: creat ff x:0 0 0 2021-11-03T16:54:35.456 INFO:tasks.workunit.client.1.smithi194.stdout:9/45: chown lc 73 1 2021-11-03T16:54:35.456 INFO:tasks.workunit.client.1.smithi194.stdout:6/14: dread f2 [0,4194304] 0 2021-11-03T16:54:35.459 INFO:tasks.workunit.client.1.smithi194.stdout:4/14: unlink f5 0 2021-11-03T16:54:35.459 INFO:tasks.workunit.client.1.smithi194.stdout:4/15: write f4 [788104,23518] 0 2021-11-03T16:54:35.459 INFO:tasks.workunit.client.1.smithi194.stdout:4/16: stat d6 0 2021-11-03T16:54:35.460 INFO:tasks.workunit.client.1.smithi194.stdout:4/17: write f1 [1892548,18737] 0 2021-11-03T16:54:35.463 INFO:tasks.workunit.client.1.smithi194.stdout:2/242: unlink d6/de/d27/l2d 0 2021-11-03T16:54:35.463 INFO:tasks.workunit.client.1.smithi194.stdout:9/46: dread f9 [0,4194304] 0 2021-11-03T16:54:35.466 INFO:tasks.workunit.client.1.smithi194.stdout:8/27: truncate f5 1920138 0 2021-11-03T16:54:35.470 INFO:tasks.workunit.client.1.smithi194.stdout:6/15: creat f3 x:0 0 0 2021-11-03T16:54:35.472 INFO:tasks.workunit.client.1.smithi194.stdout:6/16: dread f2 [0,4194304] 0 2021-11-03T16:54:35.472 INFO:tasks.workunit.client.1.smithi194.stdout:6/17: mknod c4 1 2021-11-03T16:54:35.473 INFO:tasks.workunit.client.1.smithi194.stdout:3/37: dwrite d2/fa [0,4194304] 0 2021-11-03T16:54:35.475 INFO:tasks.workunit.client.1.smithi194.stdout:0/5: dwrite f0 [0,4194304] 0 2021-11-03T16:54:35.477 INFO:tasks.workunit.client.1.smithi194.stdout:7/15: getdents . 0 2021-11-03T16:54:35.480 INFO:tasks.workunit.client.1.smithi194.stdout:7/16: dread f0 [0,4194304] 0 2021-11-03T16:54:35.481 INFO:tasks.workunit.client.1.smithi194.stdout:7/17: dread f0 [0,4194304] 0 2021-11-03T16:54:35.481 INFO:tasks.workunit.client.1.smithi194.stdout:7/18: write f0 [46073,78462] 0 2021-11-03T16:54:35.484 INFO:tasks.workunit.client.1.smithi194.stdout:4/18: getdents d6 0 2021-11-03T16:54:35.485 INFO:tasks.workunit.client.1.smithi194.stdout:7/19: fdatasync f0 0 2021-11-03T16:54:35.486 INFO:tasks.workunit.client.1.smithi194.stdout:7/20: write f0 [327166,79604] 0 2021-11-03T16:54:35.486 INFO:tasks.workunit.client.1.smithi194.stdout:2/243: symlink d6/d17/l4b 0 2021-11-03T16:54:35.490 INFO:tasks.workunit.client.1.smithi194.stdout:9/47: rename f1 to f10 0 2021-11-03T16:54:35.490 INFO:tasks.workunit.client.1.smithi194.stdout:9/48: rmdir - no directory 2021-11-03T16:54:35.490 INFO:tasks.workunit.client.1.smithi194.stdout:9/49: dread - f5 zero size 2021-11-03T16:54:35.490 INFO:tasks.workunit.client.1.smithi194.stdout:9/50: fsync ff 0 2021-11-03T16:54:35.491 INFO:tasks.workunit.client.1.smithi194.stdout:9/51: write fb [768473,29980] 0 2021-11-03T16:54:35.491 INFO:tasks.workunit.client.1.smithi194.stdout:9/52: write f5 [388449,62262] 0 2021-11-03T16:54:35.492 INFO:tasks.workunit.client.1.smithi194.stdout:8/28: mkdir d8 0 2021-11-03T16:54:35.492 INFO:tasks.workunit.client.1.smithi194.stdout:8/29: fsync f5 0 2021-11-03T16:54:35.493 INFO:tasks.workunit.client.1.smithi194.stdout:6/18: getdents . 0 2021-11-03T16:54:35.494 INFO:tasks.workunit.client.1.smithi194.stdout:6/19: mknod c5 1 2021-11-03T16:54:35.496 INFO:tasks.workunit.client.1.smithi194.stdout:3/38: creat d2/ff x:0 0 0 2021-11-03T16:54:35.500 INFO:tasks.workunit.client.1.smithi194.stdout:5/86: dwrite d2/dd/f16 [0,4194304] 0 2021-11-03T16:54:35.502 INFO:tasks.workunit.client.1.smithi194.stdout:4/19: mkdir d6/d8 0 2021-11-03T16:54:35.503 INFO:tasks.workunit.client.1.smithi194.stdout:5/87: dread d2/d3/f1a [0,4194304] 0 2021-11-03T16:54:35.504 INFO:tasks.workunit.client.1.smithi194.stdout:5/88: truncate d2/f17 65063 0 2021-11-03T16:54:35.505 INFO:tasks.workunit.client.1.smithi194.stdout:7/21: symlink l2 0 2021-11-03T16:54:35.505 INFO:tasks.workunit.client.1.smithi194.stdout:5/89: dread d2/d3/f1a [0,4194304] 0 2021-11-03T16:54:35.507 INFO:tasks.workunit.client.1.smithi194.stdout:2/244: truncate d6/de/d27/f3f 202655 0 2021-11-03T16:54:35.507 INFO:tasks.workunit.client.1.smithi194.stdout:2/245: chown d6/d21/l38 15476 1 2021-11-03T16:54:35.508 INFO:tasks.workunit.client.1.smithi194.stdout:9/53: dwrite f3 [0,4194304] 0 2021-11-03T16:54:35.508 INFO:tasks.workunit.client.1.smithi194.stdout:9/54: chown l7 400673 1 2021-11-03T16:54:35.508 INFO:tasks.workunit.client.1.smithi194.stdout:9/55: chown l7 54306514 1 2021-11-03T16:54:35.508 INFO:tasks.workunit.client.1.smithi194.stdout:9/56: truncate f8 2234576 0 2021-11-03T16:54:35.509 INFO:tasks.workunit.client.1.smithi194.stdout:9/57: mknod c11 1 2021-11-03T16:54:35.509 INFO:tasks.workunit.client.1.smithi194.stdout:8/30: creat d8/f9 x:0 0 0 2021-11-03T16:54:35.510 INFO:tasks.workunit.client.1.smithi194.stdout:6/20: mkdir d6 0 2021-11-03T16:54:35.511 INFO:tasks.workunit.client.1.smithi194.stdout:6/21: write f3 [295847,104580] 0 2021-11-03T16:54:35.511 INFO:tasks.workunit.client.1.smithi194.stdout:3/39: mknod d2/c10 1 2021-11-03T16:54:35.512 INFO:tasks.workunit.client.1.smithi194.stdout:3/40: fdatasync d2/f6 0 2021-11-03T16:54:35.512 INFO:tasks.workunit.client.1.smithi194.stdout:3/41: write d2/f6 [796394,33385] 0 2021-11-03T16:54:35.513 INFO:tasks.workunit.client.1.smithi194.stdout:1/7: rmdir d0 0 2021-11-03T16:54:35.514 INFO:tasks.workunit.client.1.smithi194.stdout:1/8: stat - no entries 2021-11-03T16:54:35.514 INFO:tasks.workunit.client.1.smithi194.stdout:1/9: write - no filename 2021-11-03T16:54:35.514 INFO:tasks.workunit.client.1.smithi194.stdout:1/10: fsync - no filename 2021-11-03T16:54:35.514 INFO:tasks.workunit.client.1.smithi194.stdout:1/11: dread - no filename 2021-11-03T16:54:35.515 INFO:tasks.workunit.client.1.smithi194.stdout:1/12: fsync - no filename 2021-11-03T16:54:35.515 INFO:tasks.workunit.client.1.smithi194.stdout:1/13: stat - no entries 2021-11-03T16:54:35.515 INFO:tasks.workunit.client.1.smithi194.stdout:8/31: dread f5 [0,4194304] 0 2021-11-03T16:54:35.516 INFO:tasks.workunit.client.1.smithi194.stdout:4/20: fsync d6/f7 0 2021-11-03T16:54:35.517 INFO:tasks.workunit.client.1.smithi194.stdout:5/90: dread d2/dd/f1b [0,4194304] 0 2021-11-03T16:54:35.517 INFO:tasks.workunit.client.1.smithi194.stdout:5/91: stat d2/f17 0 2021-11-03T16:54:35.517 INFO:tasks.workunit.client.1.smithi194.stdout:5/92: fsync d2/d3/f1a 0 2021-11-03T16:54:35.518 INFO:tasks.workunit.client.1.smithi194.stdout:5/93: readlink d2/d3/l13 0 2021-11-03T16:54:35.519 INFO:tasks.workunit.client.1.smithi194.stdout:7/22: rename l1 to l3 0 2021-11-03T16:54:35.532 INFO:tasks.workunit.client.1.smithi194.stdout:6/22: rmdir d6 0 2021-11-03T16:54:35.532 INFO:tasks.workunit.client.1.smithi194.stdout:6/23: mknod c7 1 2021-11-03T16:54:35.533 INFO:tasks.workunit.client.1.smithi194.stdout:1/14: getdents . 0 2021-11-03T16:54:35.533 INFO:tasks.workunit.client.1.smithi194.stdout:1/15: dwrite - no filename 2021-11-03T16:54:35.533 INFO:tasks.workunit.client.1.smithi194.stdout:1/16: getdents . 0 2021-11-03T16:54:35.534 INFO:tasks.workunit.client.1.smithi194.stdout:8/32: creat d8/fa x:0 0 0 2021-11-03T16:54:35.535 INFO:tasks.workunit.client.1.smithi194.stdout:5/94: creat d2/dd/f20 x:0 0 0 2021-11-03T16:54:35.537 INFO:tasks.workunit.client.1.smithi194.stdout:3/42: dwrite d2/ff [0,4194304] 0 2021-11-03T16:54:35.537 INFO:tasks.workunit.client.1.smithi194.stdout:4/21: dwrite d6/f7 [0,4194304] 0 2021-11-03T16:54:35.537 INFO:tasks.workunit.client.1.smithi194.stdout:3/43: stat d2/l7 0 2021-11-03T16:54:35.537 INFO:tasks.workunit.client.1.smithi194.stdout:3/44: chown d2/f6 161239 1 2021-11-03T16:54:35.538 INFO:tasks.workunit.client.1.smithi194.stdout:4/22: write f4 [1719098,16503] 0 2021-11-03T16:54:35.538 INFO:tasks.workunit.client.1.smithi194.stdout:4/23: mknod d6/d8/c9 1 2021-11-03T16:54:35.539 INFO:tasks.workunit.client.1.smithi194.stdout:2/246: rename d6/de/d16/d24 to d6/d1f/d4c 0 2021-11-03T16:54:35.542 INFO:tasks.workunit.client.1.smithi194.stdout:6/24: unlink f3 0 2021-11-03T16:54:35.544 INFO:tasks.workunit.client.1.smithi194.stdout:9/58: write f0 [5161143,57732] 0 2021-11-03T16:54:35.546 INFO:tasks.workunit.client.1.smithi194.stdout:7/23: dwrite f0 [0,4194304] 0 2021-11-03T16:54:35.547 INFO:tasks.workunit.client.1.smithi194.stdout:7/24: read f0 [1636323,120125] 0 2021-11-03T16:54:35.549 INFO:tasks.workunit.client.1.smithi194.stdout:5/95: creat d2/f21 x:0 0 0 2021-11-03T16:54:35.554 INFO:tasks.workunit.client.1.smithi194.stdout:3/45: rmdir d2 39 2021-11-03T16:54:35.555 INFO:tasks.workunit.client.1.smithi194.stdout:4/24: mkdir d6/d8/da 0 2021-11-03T16:54:35.563 INFO:tasks.workunit.client.1.smithi194.stdout:2/247: creat d6/de/d11/f4d x:0 0 0 2021-11-03T16:54:35.565 INFO:tasks.workunit.client.1.smithi194.stdout:9/59: dwrite f10 [0,4194304] 0 2021-11-03T16:54:35.570 INFO:tasks.workunit.client.1.smithi194.stdout:6/25: creat f8 x:0 0 0 2021-11-03T16:54:35.570 INFO:tasks.workunit.client.1.smithi194.stdout:6/26: truncate f2 496123 0 2021-11-03T16:54:35.571 INFO:tasks.workunit.client.1.smithi194.stdout:2/248: dread d6/d21/d2a/d31/f37 [0,4194304] 0 2021-11-03T16:54:35.572 INFO:tasks.workunit.client.1.smithi194.stdout:4/25: dwrite d6/f7 [0,4194304] 0 2021-11-03T16:54:35.573 INFO:tasks.workunit.client.1.smithi194.stdout:8/33: rename d8/fa to d8/fb 0 2021-11-03T16:54:35.574 INFO:tasks.workunit.client.1.smithi194.stdout:3/46: dwrite d2/ff [0,4194304] 0 2021-11-03T16:54:35.575 INFO:tasks.workunit.client.1.smithi194.stdout:5/96: creat d2/d3/f22 x:0 0 0 2021-11-03T16:54:35.576 INFO:tasks.workunit.client.1.smithi194.stdout:8/34: dread f5 [0,4194304] 0 2021-11-03T16:54:35.579 INFO:tasks.workunit.client.1.smithi194.stdout:9/60: symlink l12 0 2021-11-03T16:54:35.581 INFO:tasks.workunit.client.1.smithi194.stdout:9/61: dread f5 [0,4194304] 0 2021-11-03T16:54:35.582 INFO:tasks.workunit.client.1.smithi194.stdout:9/62: write f0 [1104729,15923] 0 2021-11-03T16:54:35.582 INFO:tasks.workunit.client.1.smithi194.stdout:6/27: creat f9 x:0 0 0 2021-11-03T16:54:35.583 INFO:tasks.workunit.client.1.smithi194.stdout:6/28: chown f8 51 1 2021-11-03T16:54:35.583 INFO:tasks.workunit.client.1.smithi194.stdout:6/29: readlink - no filename 2021-11-03T16:54:35.583 INFO:tasks.workunit.client.1.smithi194.stdout:6/30: dread - f9 zero size 2021-11-03T16:54:35.583 INFO:tasks.workunit.client.1.smithi194.stdout:6/31: rmdir - no directory 2021-11-03T16:54:35.584 INFO:tasks.workunit.client.1.smithi194.stdout:2/249: truncate d6/f7 219445 0 2021-11-03T16:54:35.584 INFO:tasks.workunit.client.1.smithi194.stdout:2/250: stat d6/de/d16 0 2021-11-03T16:54:35.585 INFO:tasks.workunit.client.1.smithi194.stdout:4/26: symlink d6/d8/da/lb 0 2021-11-03T16:54:35.587 INFO:tasks.workunit.client.1.smithi194.stdout:3/47: creat d2/f11 x:0 0 0 2021-11-03T16:54:35.588 INFO:tasks.workunit.client.1.smithi194.stdout:9/63: stat l7 0 2021-11-03T16:54:35.589 INFO:tasks.workunit.client.1.smithi194.stdout:6/32: mkdir da 0 2021-11-03T16:54:35.590 INFO:tasks.workunit.client.1.smithi194.stdout:6/33: fsync f2 0 2021-11-03T16:54:35.590 INFO:tasks.workunit.client.1.smithi194.stdout:6/34: write f2 [713597,27231] 0 2021-11-03T16:54:35.591 INFO:tasks.workunit.client.1.smithi194.stdout:2/251: creat d6/d21/d2a/d35/d3c/f4e x:0 0 0 2021-11-03T16:54:35.593 INFO:tasks.workunit.client.1.smithi194.stdout:4/27: creat d6/d8/da/fc x:0 0 0 2021-11-03T16:54:35.593 INFO:tasks.workunit.client.1.smithi194.stdout:4/28: rename d6 to d6/d8/dd 22 2021-11-03T16:54:35.594 INFO:tasks.workunit.client.1.smithi194.stdout:8/35: dwrite f5 [0,4194304] 0 2021-11-03T16:54:35.595 INFO:tasks.workunit.client.1.smithi194.stdout:8/36: chown f5 11335 1 2021-11-03T16:54:35.595 INFO:tasks.workunit.client.1.smithi194.stdout:9/64: creat f13 x:0 0 0 2021-11-03T16:54:35.595 INFO:tasks.workunit.client.1.smithi194.stdout:8/37: read f5 [3975687,86862] 0 2021-11-03T16:54:35.596 INFO:tasks.workunit.client.1.smithi194.stdout:9/65: dread fb [0,4194304] 0 2021-11-03T16:54:35.597 INFO:tasks.workunit.client.1.smithi194.stdout:6/35: mkdir da/db 0 2021-11-03T16:54:35.598 INFO:tasks.workunit.client.1.smithi194.stdout:2/252: creat d6/de/d27/f4f x:0 0 0 2021-11-03T16:54:35.598 INFO:tasks.workunit.client.1.smithi194.stdout:4/29: dread f4 [0,4194304] 0 2021-11-03T16:54:35.598 INFO:tasks.workunit.client.1.smithi194.stdout:4/30: chown d6/d8/da 263867 1 2021-11-03T16:54:35.599 INFO:tasks.workunit.client.1.smithi194.stdout:4/31: chown d6 160668643 1 2021-11-03T16:54:35.599 INFO:tasks.workunit.client.1.smithi194.stdout:4/32: stat f1 0 2021-11-03T16:54:35.603 INFO:tasks.workunit.client.1.smithi194.stdout:6/36: dread f2 [0,4194304] 0 2021-11-03T16:54:35.604 INFO:tasks.workunit.client.1.smithi194.stdout:6/37: truncate f9 596658 0 2021-11-03T16:54:35.605 INFO:tasks.workunit.client.1.smithi194.stdout:6/38: write f8 [414704,52859] 0 2021-11-03T16:54:35.605 INFO:tasks.workunit.client.1.smithi194.stdout:6/39: fsync f9 0 2021-11-03T16:54:35.609 INFO:tasks.workunit.client.1.smithi194.stdout:3/48: rmdir d2 39 2021-11-03T16:54:35.613 INFO:tasks.workunit.client.1.smithi194.stdout:8/38: truncate f5 1554545 0 2021-11-03T16:54:35.613 INFO:tasks.workunit.client.1.smithi194.stdout:8/39: fdatasync f5 0 2021-11-03T16:54:35.617 INFO:tasks.workunit.client.1.smithi194.stdout:6/40: rmdir da/db 0 2021-11-03T16:54:35.619 INFO:tasks.workunit.client.1.smithi194.stdout:3/49: creat d2/f12 x:0 0 0 2021-11-03T16:54:35.619 INFO:tasks.workunit.client.1.smithi194.stdout:9/66: dwrite f10 [0,4194304] 0 2021-11-03T16:54:35.620 INFO:tasks.workunit.client.1.smithi194.stdout:4/33: dwrite d6/f7 [0,4194304] 0 2021-11-03T16:54:35.621 INFO:tasks.workunit.client.1.smithi194.stdout:8/40: link d8/fb d8/fc 0 2021-11-03T16:54:35.622 INFO:tasks.workunit.client.1.smithi194.stdout:4/34: write d6/f7 [605697,12475] 0 2021-11-03T16:54:35.622 INFO:tasks.workunit.client.1.smithi194.stdout:4/35: stat f1 0 2021-11-03T16:54:35.622 INFO:tasks.workunit.client.1.smithi194.stdout:4/36: read - d6/d8/da/fc zero size 2021-11-03T16:54:35.627 INFO:tasks.workunit.client.1.smithi194.stdout:3/50: getdents d2 0 2021-11-03T16:54:35.627 INFO:tasks.workunit.client.1.smithi194.stdout:3/51: write d2/f11 [769119,117562] 0 2021-11-03T16:54:35.627 INFO:tasks.workunit.client.1.smithi194.stdout:3/52: dread - d2/f12 zero size 2021-11-03T16:54:35.629 INFO:tasks.workunit.client.1.smithi194.stdout:9/67: symlink l14 0 2021-11-03T16:54:35.631 INFO:tasks.workunit.client.1.smithi194.stdout:8/41: creat d8/fd x:0 0 0 2021-11-03T16:54:35.631 INFO:tasks.workunit.client.1.smithi194.stdout:8/42: dread - f7 zero size 2021-11-03T16:54:35.631 INFO:tasks.workunit.client.1.smithi194.stdout:8/43: readlink l4 0 2021-11-03T16:54:35.636 INFO:tasks.workunit.client.1.smithi194.stdout:4/37: unlink d6/f7 0 2021-11-03T16:54:35.636 INFO:tasks.workunit.client.1.smithi194.stdout:3/53: creat d2/f13 x:0 0 0 2021-11-03T16:54:35.639 INFO:tasks.workunit.client.1.smithi194.stdout:8/44: link f5 d8/fe 0 2021-11-03T16:54:35.639 INFO:tasks.workunit.client.1.smithi194.stdout:8/45: write d8/f9 [565554,38336] 0 2021-11-03T16:54:35.639 INFO:tasks.workunit.client.1.smithi194.stdout:8/46: write d8/fb [744138,108339] 0 2021-11-03T16:54:35.640 INFO:tasks.workunit.client.1.smithi194.stdout:6/41: rmdir da 0 2021-11-03T16:54:35.642 INFO:tasks.workunit.client.1.smithi194.stdout:3/54: creat d2/f14 x:0 0 0 2021-11-03T16:54:35.644 INFO:tasks.workunit.client.1.smithi194.stdout:3/55: link d2/f14 d2/f15 0 2021-11-03T16:54:35.645 INFO:tasks.workunit.client.1.smithi194.stdout:3/56: readlink d2/ld 0 2021-11-03T16:54:35.647 INFO:tasks.workunit.client.1.smithi194.stdout:3/57: creat d2/f16 x:0 0 0 2021-11-03T16:54:35.648 INFO:tasks.workunit.client.1.smithi194.stdout:9/68: dwrite f10 [0,4194304] 0 2021-11-03T16:54:35.649 INFO:tasks.workunit.client.1.smithi194.stdout:9/69: creat f15 x:0 0 0 2021-11-03T16:54:35.650 INFO:tasks.workunit.client.1.smithi194.stdout:6/42: read f8 [157690,83364] 0 2021-11-03T16:54:35.651 INFO:tasks.workunit.client.1.smithi194.stdout:9/70: rename l6 to l16 0 2021-11-03T16:54:35.653 INFO:tasks.workunit.client.1.smithi194.stdout:4/38: dwrite f1 [4194304,4194304] 0 2021-11-03T16:54:35.653 INFO:tasks.workunit.client.1.smithi194.stdout:4/39: chown d6/d8/da/lb 18230 1 2021-11-03T16:54:35.655 INFO:tasks.workunit.client.1.smithi194.stdout:6/43: creat fc x:0 0 0 2021-11-03T16:54:35.655 INFO:tasks.workunit.client.1.smithi194.stdout:6/44: chown f8 139291 1 2021-11-03T16:54:35.656 INFO:tasks.workunit.client.1.smithi194.stdout:4/40: rmdir d6/d8 39 2021-11-03T16:54:35.656 INFO:tasks.workunit.client.1.smithi194.stdout:4/41: mknod d6/d8/da/ce 1 2021-11-03T16:54:35.657 INFO:tasks.workunit.client.1.smithi194.stdout:4/42: read f1 [2651546,98308] 0 2021-11-03T16:54:35.659 INFO:tasks.workunit.client.1.smithi194.stdout:3/58: dread d2/f4 [0,4194304] 0 2021-11-03T16:54:35.664 INFO:tasks.workunit.client.1.smithi194.stdout:3/59: unlink d2/fa 0 2021-11-03T16:54:35.664 INFO:tasks.workunit.client.1.smithi194.stdout:3/60: dread - d2/f12 zero size 2021-11-03T16:54:35.666 INFO:tasks.workunit.client.1.smithi194.stdout:9/71: dread f0 [0,4194304] 0 2021-11-03T16:54:35.667 INFO:tasks.workunit.client.1.smithi194.stdout:3/61: mkdir d2/d17 0 2021-11-03T16:54:35.669 INFO:tasks.workunit.client.1.smithi194.stdout:3/62: creat d2/f18 x:0 0 0 2021-11-03T16:54:35.671 INFO:tasks.workunit.client.1.smithi194.stdout:9/72: write f10 [1951656,38102] 0 2021-11-03T16:54:35.671 INFO:tasks.workunit.client.1.smithi194.stdout:9/73: rmdir - no directory 2021-11-03T16:54:35.672 INFO:tasks.workunit.client.1.smithi194.stdout:6/45: dwrite f9 [0,4194304] 0 2021-11-03T16:54:35.672 INFO:tasks.workunit.client.1.smithi194.stdout:6/46: write fc [397228,60145] 0 2021-11-03T16:54:35.673 INFO:tasks.workunit.client.1.smithi194.stdout:6/47: dread f8 [0,4194304] 0 2021-11-03T16:54:35.673 INFO:tasks.workunit.client.1.smithi194.stdout:3/63: creat d2/d17/f19 x:0 0 0 2021-11-03T16:54:35.674 INFO:tasks.workunit.client.1.smithi194.stdout:3/64: dread - d2/f14 zero size 2021-11-03T16:54:35.677 INFO:tasks.workunit.client.1.smithi194.stdout:4/43: dwrite d6/d8/da/fc [0,4194304] 0 2021-11-03T16:54:35.682 INFO:tasks.workunit.client.1.smithi194.stdout:6/48: dread f9 [0,4194304] 0 2021-11-03T16:54:35.684 INFO:tasks.workunit.client.1.smithi194.stdout:3/65: unlink d2/f9 0 2021-11-03T16:54:35.684 INFO:tasks.workunit.client.1.smithi194.stdout:3/66: dread - d2/f14 zero size 2021-11-03T16:54:35.686 INFO:tasks.workunit.client.1.smithi194.stdout:9/74: dwrite ff [0,4194304] 0 2021-11-03T16:54:35.687 INFO:tasks.workunit.client.1.smithi194.stdout:3/67: rmdir d2/d17 39 2021-11-03T16:54:35.692 INFO:tasks.workunit.client.1.smithi194.stdout:4/44: truncate d6/d8/da/fc 4125050 0 2021-11-03T16:54:35.695 INFO:tasks.workunit.client.1.smithi194.stdout:9/75: creat f17 x:0 0 0 2021-11-03T16:54:35.695 INFO:tasks.workunit.client.1.smithi194.stdout:9/76: mknod c18 1 2021-11-03T16:54:35.699 INFO:tasks.workunit.client.1.smithi194.stdout:3/68: rename d2/lb to d2/l1a 0 2021-11-03T16:54:35.699 INFO:tasks.workunit.client.1.smithi194.stdout:3/69: chown d2/lc 88 1 2021-11-03T16:54:35.700 INFO:tasks.workunit.client.1.smithi194.stdout:3/70: fdatasync d2/f6 0 2021-11-03T16:54:35.700 INFO:tasks.workunit.client.1.smithi194.stdout:3/71: chown d2/f11 668563617 1 2021-11-03T16:54:35.700 INFO:tasks.workunit.client.1.smithi194.stdout:4/45: creat d6/d8/da/ff x:0 0 0 2021-11-03T16:54:35.702 INFO:tasks.workunit.client.1.smithi194.stdout:9/77: mkdir d19 0 2021-11-03T16:54:35.704 INFO:tasks.workunit.client.1.smithi194.stdout:3/72: symlink d2/l1b 0 2021-11-03T16:54:35.704 INFO:tasks.workunit.client.1.smithi194.stdout:3/73: fdatasync d2/f16 0 2021-11-03T16:54:35.705 INFO:tasks.workunit.client.1.smithi194.stdout:3/74: write d2/f14 [855088,24115] 0 2021-11-03T16:54:35.705 INFO:tasks.workunit.client.1.smithi194.stdout:3/75: stat d2 0 2021-11-03T16:54:35.705 INFO:tasks.workunit.client.1.smithi194.stdout:9/78: link f10 d19/f1a 0 2021-11-03T16:54:35.708 INFO:tasks.workunit.client.1.smithi194.stdout:3/76: link d2/f11 d2/d17/f1c 0 2021-11-03T16:54:35.712 INFO:tasks.workunit.client.1.smithi194.stdout:3/77: mkdir d2/d17/d1d 0 2021-11-03T16:54:35.720 INFO:tasks.workunit.client.1.smithi194.stdout:4/46: dwrite d6/d8/da/fc [0,4194304] 0 2021-11-03T16:54:35.727 INFO:tasks.workunit.client.1.smithi194.stdout:4/47: mkdir d6/d10 0 2021-11-03T16:54:35.727 INFO:tasks.workunit.client.1.smithi194.stdout:4/48: fsync d6/d8/da/fc 0 2021-11-03T16:54:35.728 INFO:tasks.workunit.client.1.smithi194.stdout:4/49: truncate d6/d8/da/fc 5142258 0 2021-11-03T16:54:35.730 INFO:tasks.workunit.client.1.smithi194.stdout:4/50: link f1 d6/d8/da/f11 0 2021-11-03T16:54:35.732 INFO:tasks.workunit.client.1.smithi194.stdout:9/79: dwrite f13 [0,4194304] 0 2021-11-03T16:54:35.732 INFO:tasks.workunit.client.1.smithi194.stdout:9/80: stat d19 0 2021-11-03T16:54:35.736 INFO:tasks.workunit.client.1.smithi194.stdout:3/78: dwrite d2/f18 [0,4194304] 0 2021-11-03T16:54:35.736 INFO:tasks.workunit.client.1.smithi194.stdout:3/79: chown d2/f15 878118738 1 2021-11-03T16:54:35.736 INFO:tasks.workunit.client.1.smithi194.stdout:9/81: write fa [3184125,78814] 0 2021-11-03T16:54:35.741 INFO:tasks.workunit.client.1.smithi194.stdout:3/80: dread d2/f6 [0,4194304] 0 2021-11-03T16:54:35.741 INFO:tasks.workunit.client.1.smithi194.stdout:3/81: chown d2/f4 2 1 2021-11-03T16:54:35.742 INFO:tasks.workunit.client.1.smithi194.stdout:3/82: unlink d2/f15 0 2021-11-03T16:54:35.745 INFO:tasks.workunit.client.1.smithi194.stdout:9/82: dread f10 [0,4194304] 0 2021-11-03T16:54:35.745 INFO:tasks.workunit.client.1.smithi194.stdout:9/83: readlink l14 0 2021-11-03T16:54:35.746 INFO:tasks.workunit.client.1.smithi194.stdout:9/84: creat d19/f1b x:0 0 0 2021-11-03T16:54:35.750 INFO:tasks.workunit.client.1.smithi194.stdout:4/51: dwrite d6/d8/da/ff [0,4194304] 0 2021-11-03T16:54:35.752 INFO:tasks.workunit.client.1.smithi194.stdout:9/85: write f3 [1203612,24869] 0 2021-11-03T16:54:35.758 INFO:tasks.workunit.client.1.smithi194.stdout:4/52: mkdir d6/d12 0 2021-11-03T16:54:35.758 INFO:tasks.workunit.client.1.smithi194.stdout:3/83: dwrite d2/f12 [0,4194304] 0 2021-11-03T16:54:35.759 INFO:tasks.workunit.client.1.smithi194.stdout:4/53: creat d6/d10/f13 x:0 0 0 2021-11-03T16:54:35.763 INFO:tasks.workunit.client.1.smithi194.stdout:3/84: creat d2/d17/d1d/f1e x:0 0 0 2021-11-03T16:54:35.765 INFO:tasks.workunit.client.1.smithi194.stdout:4/54: rename d6/d8/da to d6/d10/d14 0 2021-11-03T16:54:35.767 INFO:tasks.workunit.client.1.smithi194.stdout:3/85: rename d2/ld to d2/d17/d1d/l1f 0 2021-11-03T16:54:35.768 INFO:tasks.workunit.client.1.smithi194.stdout:3/86: dread - d2/d17/d1d/f1e zero size 2021-11-03T16:54:35.769 INFO:tasks.workunit.client.1.smithi194.stdout:4/55: creat d6/f15 x:0 0 0 2021-11-03T16:54:35.769 INFO:tasks.workunit.client.1.smithi194.stdout:4/56: chown d6/d10 97189 1 2021-11-03T16:54:35.769 INFO:tasks.workunit.client.1.smithi194.stdout:4/57: rename d6 to d6/d10/d14/d16 22 2021-11-03T16:54:35.770 INFO:tasks.workunit.client.1.smithi194.stdout:3/87: mkdir d2/d20 0 2021-11-03T16:54:35.770 INFO:tasks.workunit.client.1.smithi194.stdout:3/88: fsync d2/f13 0 2021-11-03T16:54:35.771 INFO:tasks.workunit.client.1.smithi194.stdout:9/86: dwrite f15 [0,4194304] 0 2021-11-03T16:54:35.771 INFO:tasks.workunit.client.1.smithi194.stdout:9/87: fsync d19/f1b 0 2021-11-03T16:54:35.771 INFO:tasks.workunit.client.1.smithi194.stdout:3/89: dread d2/f6 [0,4194304] 0 2021-11-03T16:54:35.773 INFO:tasks.workunit.client.1.smithi194.stdout:9/88: creat d19/f1c x:0 0 0 2021-11-03T16:54:35.776 INFO:tasks.workunit.client.1.smithi194.stdout:3/90: symlink d2/d17/l21 0 2021-11-03T16:54:35.776 INFO:tasks.workunit.client.1.smithi194.stdout:3/91: mknod d2/c22 1 2021-11-03T16:54:35.778 INFO:tasks.workunit.client.1.smithi194.stdout:9/89: unlink ff 0 2021-11-03T16:54:35.780 INFO:tasks.workunit.client.1.smithi194.stdout:9/90: symlink d19/l1d 0 2021-11-03T16:54:35.780 INFO:tasks.workunit.client.1.smithi194.stdout:9/91: write d19/f1b [124955,77670] 0 2021-11-03T16:54:35.781 INFO:tasks.workunit.client.1.smithi194.stdout:9/92: write f3 [2660908,64652] 0 2021-11-03T16:54:35.784 INFO:tasks.workunit.client.1.smithi194.stdout:9/93: creat d19/f1e x:0 0 0 2021-11-03T16:54:35.784 INFO:tasks.workunit.client.1.smithi194.stdout:4/58: getdents d6 0 2021-11-03T16:54:35.787 INFO:tasks.workunit.client.1.smithi194.stdout:4/59: write d6/d10/d14/fc [1124839,56807] 0 2021-11-03T16:54:35.789 INFO:tasks.workunit.client.1.smithi194.stdout:3/92: dwrite d2/f6 [0,4194304] 0 2021-11-03T16:54:35.790 INFO:tasks.workunit.client.1.smithi194.stdout:3/93: stat d2/ff 0 2021-11-03T16:54:35.790 INFO:tasks.workunit.client.1.smithi194.stdout:3/94: read d2/d17/f1c [834749,78366] 0 2021-11-03T16:54:35.790 INFO:tasks.workunit.client.1.smithi194.stdout:3/95: fsync d2/f18 0 2021-11-03T16:54:35.790 INFO:tasks.workunit.client.1.smithi194.stdout:3/96: readlink d2/l1a 0 2021-11-03T16:54:35.791 INFO:tasks.workunit.client.1.smithi194.stdout:4/60: unlink d6/d10/f13 0 2021-11-03T16:54:35.796 INFO:tasks.workunit.client.1.smithi194.stdout:4/61: rename d6/d10/d14/ff to d6/f17 0 2021-11-03T16:54:35.797 INFO:tasks.workunit.client.1.smithi194.stdout:9/94: rmdir d19 39 2021-11-03T16:54:35.798 INFO:tasks.workunit.client.1.smithi194.stdout:4/62: write d6/f17 [3135564,119248] 0 2021-11-03T16:54:35.798 INFO:tasks.workunit.client.1.smithi194.stdout:4/63: fsync f4 0 2021-11-03T16:54:35.798 INFO:tasks.workunit.client.1.smithi194.stdout:4/64: write f4 [2397715,70695] 0 2021-11-03T16:54:35.802 INFO:tasks.workunit.client.1.smithi194.stdout:9/95: getdents d19 0 2021-11-03T16:54:35.803 INFO:tasks.workunit.client.1.smithi194.stdout:9/96: symlink d19/l1f 0 2021-11-03T16:54:35.804 INFO:tasks.workunit.client.1.smithi194.stdout:9/97: write d19/f1c [389622,51441] 0 2021-11-03T16:54:35.807 INFO:tasks.workunit.client.1.smithi194.stdout:4/65: dread d6/f17 [0,4194304] 0 2021-11-03T16:54:35.807 INFO:tasks.workunit.client.1.smithi194.stdout:4/66: chown d6/d8 71 1 2021-11-03T16:54:35.812 INFO:tasks.workunit.client.1.smithi194.stdout:9/98: unlink d19/f1b 0 2021-11-03T16:54:35.813 INFO:tasks.workunit.client.1.smithi194.stdout:9/99: write f8 [2325815,85261] 0 2021-11-03T16:54:35.821 INFO:tasks.workunit.client.1.smithi194.stdout:4/67: dwrite d6/f15 [0,4194304] 0 2021-11-03T16:54:35.824 INFO:tasks.workunit.client.1.smithi194.stdout:9/100: dread f8 [0,4194304] 0 2021-11-03T16:54:35.825 INFO:tasks.workunit.client.1.smithi194.stdout:9/101: mknod d19/c20 1 2021-11-03T16:54:35.826 INFO:tasks.workunit.client.1.smithi194.stdout:9/102: write f3 [2702631,47438] 0 2021-11-03T16:54:35.838 INFO:tasks.workunit.client.1.smithi194.stdout:9/103: dwrite f10 [4194304,4194304] 0 2021-11-03T16:54:35.838 INFO:tasks.workunit.client.1.smithi194.stdout:9/104: fsync f3 0 2021-11-03T16:54:35.857 INFO:tasks.workunit.client.1.smithi194.stdout:9/105: dwrite fd [0,4194304] 0 2021-11-03T16:54:35.859 INFO:tasks.workunit.client.1.smithi194.stdout:9/106: symlink d19/l21 0 2021-11-03T16:54:35.861 INFO:tasks.workunit.client.1.smithi194.stdout:9/107: creat d19/f22 x:0 0 0 2021-11-03T16:54:35.866 INFO:tasks.workunit.client.1.smithi194.stdout:9/108: getdents d19 0 2021-11-03T16:54:35.867 INFO:tasks.workunit.client.1.smithi194.stdout:9/109: truncate f3 2970812 0 2021-11-03T16:54:35.868 INFO:tasks.workunit.client.1.smithi194.stdout:9/110: symlink d19/l23 0 2021-11-03T16:54:35.869 INFO:tasks.workunit.client.1.smithi194.stdout:9/111: fsync d19/f1e 0 2021-11-03T16:54:35.869 INFO:tasks.workunit.client.1.smithi194.stdout:9/112: readlink d19/l21 0 2021-11-03T16:54:35.871 INFO:tasks.workunit.client.1.smithi194.stdout:9/113: getdents d19 0 2021-11-03T16:54:35.872 INFO:tasks.workunit.client.1.smithi194.stdout:9/114: symlink d19/l24 0 2021-11-03T16:54:35.875 INFO:tasks.workunit.client.1.smithi194.stdout:9/115: link fa d19/f25 0 2021-11-03T16:54:35.877 INFO:tasks.workunit.client.1.smithi194.stdout:9/116: symlink d19/l26 0 2021-11-03T16:54:36.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:36 smithi194 conmon[35111]: cluster 2021-11-03T16:54:35.074346+0000 mgr.smithi026.cnrxli (mgr.14162) 307 2021-11-03T16:54:36.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:36 smithi194 conmon[35111]: : cluster [DBG] pgmap v254: 65 pgs: 65 active+clean; 320 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 3.2 MiB/s rd, 14 MiB/s wr, 308 op/s 2021-11-03T16:54:36.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:36 smithi194 conmon[35111]: audit 2021-11-03T16:54:36.101918+0000 mon.smithi026 (mon.0) 558 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:54:36.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:36 smithi194 conmon[35111]: audit 2021-11-03T16:54:36.102895+0000 mon.smithi026 (mon.0) 559 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi194.wnexas", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-11-03T16:54:36.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:36 smithi194 conmon[35111]: audit 2021-11-03T16:54:36.103810+0000 mon.smithi026 (mon.0) 560 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mgr services"}]: dispatch 2021-11-03T16:54:36.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:36 smithi194 conmon[35111]: audit 2021-11-03T16:54:36.104648+0000 mon.smithi026 (mon.0) 561 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:54:36.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:36 smithi026 conmon[32119]: cluster 2021-11-03T16:54:35.074346+0000 mgr.smithi026.cnrxli (mgr.14162) 307 : cluster [DBG] pgmap v254: 65 pgs: 65 active+clean; 320 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 3.2 MiB/s rd, 14 MiB/s wr, 308 op/s 2021-11-03T16:54:36.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:36 smithi026 conmon[32119]: audit 2021-11-03T16:54:36.101918+0000 mon.smithi026 (mon.0) 558 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:54:36.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:36 smithi026 conmon[32119]: audit 2021-11-03T16:54:36.102895+0000 mon.smithi026 (mon.0) 559 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi194.wnexas", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-11-03T16:54:36.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:36 smithi026 conmon[32119]: audit 2021-11-03T16:54:36.103810+0000 mon.smithi026 (mon. 2021-11-03T16:54:36.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:36 smithi026 conmon[32119]: 0) 560 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mgr services"}]: dispatch 2021-11-03T16:54:36.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:36 smithi026 conmon[32119]: audit 2021-11-03T16:54:36.104648+0000 mon.smithi026 (mon.0) 561 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:54:37.621 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:37 smithi194 conmon[35111]: cephadm 2021-11-03T16:54:36.097295+0000 mgr.smithi026.cnrxli (mgr.14162) 308 : cephadm [INF] Upgrade: Updating mgr.smithi194.wnexas 2021-11-03T16:54:37.622 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:37 smithi194 conmon[35111]: cephadm 2021-11-03T16:54:36.105469+0000 mgr.smithi026.cnrxli (mgr.14162) 309 : cephadm [INF] Deploying daemon mgr.smithi194.wnexas on smithi194 2021-11-03T16:54:37.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:37 smithi026 conmon[32119]: cephadm 2021-11-03T16:54:36.097295+0000 mgr.smithi026.cnrxli (mgr.14162) 308 : cephadm 2021-11-03T16:54:37.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:37 smithi026 conmon[32119]: [INF] Upgrade: Updating mgr.smithi194.wnexas 2021-11-03T16:54:37.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:37 smithi026 conmon[32119]: cephadm 2021-11-03T16:54:36.105469+0000 mgr.smithi026.cnrxli (mgr.14162) 309 : 2021-11-03T16:54:37.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:37 smithi026 conmon[32119]: cephadm [INF] Deploying daemon mgr.smithi194.wnexas on smithi194 2021-11-03T16:54:38.154 INFO:tasks.workunit.client.1.smithi194.stdout:9/117: sync 2021-11-03T16:54:38.155 INFO:tasks.workunit.client.1.smithi194.stdout:1/17: sync 2021-11-03T16:54:38.155 INFO:tasks.workunit.client.1.smithi194.stdout:0/6: sync 2021-11-03T16:54:38.155 INFO:tasks.workunit.client.1.smithi194.stdout:5/97: sync 2021-11-03T16:54:38.155 INFO:tasks.workunit.client.1.smithi194.stdout:6/49: sync 2021-11-03T16:54:38.156 INFO:tasks.workunit.client.1.smithi194.stdout:8/47: sync 2021-11-03T16:54:38.156 INFO:tasks.workunit.client.1.smithi194.stdout:3/97: sync 2021-11-03T16:54:38.156 INFO:tasks.workunit.client.1.smithi194.stdout:7/25: sync 2021-11-03T16:54:38.156 INFO:tasks.workunit.client.1.smithi194.stdout:8/48: readlink l4 0 2021-11-03T16:54:38.157 INFO:tasks.workunit.client.1.smithi194.stdout:0/7: write f1 [121052,51739] 0 2021-11-03T16:54:38.157 INFO:tasks.workunit.client.1.smithi194.stdout:2/253: sync 2021-11-03T16:54:38.157 INFO:tasks.workunit.client.1.smithi194.stdout:4/68: sync 2021-11-03T16:54:38.157 INFO:tasks.workunit.client.1.smithi194.stdout:2/254: chown d6/d17/d26 8823 1 2021-11-03T16:54:38.172 INFO:tasks.workunit.client.1.smithi194.stdout:6/50: dwrite f8 [0,4194304] 0 2021-11-03T16:54:38.172 INFO:tasks.workunit.client.1.smithi194.stdout:6/51: stat fc 0 2021-11-03T16:54:38.173 INFO:tasks.workunit.client.1.smithi194.stdout:6/52: dread f2 [0,4194304] 0 2021-11-03T16:54:38.173 INFO:tasks.workunit.client.1.smithi194.stdout:6/53: readlink - no filename 2021-11-03T16:54:38.307 INFO:tasks.workunit.client.1.smithi194.stdout:1/18: mkdir d2 0 2021-11-03T16:54:38.307 INFO:tasks.workunit.client.1.smithi194.stdout:1/19: chown d2 643633252 1 2021-11-03T16:54:38.307 INFO:tasks.workunit.client.1.smithi194.stdout:1/20: dwrite - no filename 2021-11-03T16:54:38.308 INFO:tasks.workunit.client.1.smithi194.stdout:1/21: dread - no filename 2021-11-03T16:54:38.341 INFO:tasks.workunit.client.1.smithi194.stdout:7/26: getdents . 0 2021-11-03T16:54:38.370 INFO:tasks.workunit.client.1.smithi194.stdout:5/98: creat d2/f23 x:0 0 0 2021-11-03T16:54:38.380 INFO:tasks.workunit.client.1.smithi194.stdout:3/98: unlink l0 0 2021-11-03T16:54:38.386 INFO:tasks.workunit.client.1.smithi194.stdout:8/49: rename d8/fd to d8/ff 0 2021-11-03T16:54:38.386 INFO:tasks.workunit.client.1.smithi194.stdout:8/50: chown d8/fc 56 1 2021-11-03T16:54:38.386 INFO:tasks.workunit.client.1.smithi194.stdout:8/51: fdatasync d8/ff 0 2021-11-03T16:54:38.387 INFO:tasks.workunit.client.1.smithi194.stdout:8/52: write d8/fc [480298,35372] 0 2021-11-03T16:54:38.387 INFO:tasks.workunit.client.1.smithi194.stdout:8/53: write d8/fe [842779,31687] 0 2021-11-03T16:54:38.388 INFO:tasks.workunit.client.1.smithi194.stdout:0/8: rename f1 to f2 0 2021-11-03T16:54:38.390 INFO:tasks.workunit.client.1.smithi194.stdout:4/69: rename f4 to d6/d10/f18 0 2021-11-03T16:54:38.392 INFO:tasks.workunit.client.1.smithi194.stdout:2/255: truncate d6/d21/f45 1167517 0 2021-11-03T16:54:38.393 INFO:tasks.workunit.client.1.smithi194.stdout:2/256: fsync d6/de/d27/f49 0 2021-11-03T16:54:38.396 INFO:tasks.workunit.client.1.smithi194.stdout:6/54: getdents . 0 2021-11-03T16:54:38.397 INFO:tasks.workunit.client.1.smithi194.stdout:6/55: fdatasync f2 0 2021-11-03T16:54:38.397 INFO:tasks.workunit.client.1.smithi194.stdout:6/56: chown f2 22093 1 2021-11-03T16:54:38.397 INFO:tasks.workunit.client.1.smithi194.stdout:4/70: dread d6/d10/d14/f11 [4194304,4194304] 0 2021-11-03T16:54:38.398 INFO:tasks.workunit.client.1.smithi194.stdout:4/71: write d6/f17 [148423,93452] 0 2021-11-03T16:54:38.398 INFO:tasks.workunit.client.1.smithi194.stdout:4/72: chown d6/d12 831841300 1 2021-11-03T16:54:38.405 INFO:tasks.workunit.client.1.smithi194.stdout:9/118: mkdir d19/d27 0 2021-11-03T16:54:38.408 INFO:tasks.workunit.client.1.smithi194.stdout:1/22: symlink d2/l3 0 2021-11-03T16:54:38.410 INFO:tasks.workunit.client.1.smithi194.stdout:7/27: creat f4 x:0 0 0 2021-11-03T16:54:38.410 INFO:tasks.workunit.client.1.smithi194.stdout:7/28: truncate f4 192263 0 2021-11-03T16:54:38.411 INFO:tasks.workunit.client.1.smithi194.stdout:5/99: creat d2/f24 x:0 0 0 2021-11-03T16:54:38.418 INFO:tasks.workunit.client.1.smithi194.stdout:8/54: rename d8/fe to d8/f10 0 2021-11-03T16:54:38.418 INFO:tasks.workunit.client.1.smithi194.stdout:0/9: rename f0 to f3 0 2021-11-03T16:54:38.424 INFO:tasks.workunit.client.1.smithi194.stdout:2/257: link d6/de/f40 d6/de/d16/f50 0 2021-11-03T16:54:38.426 INFO:tasks.workunit.client.1.smithi194.stdout:6/57: creat fd x:0 0 0 2021-11-03T16:54:38.426 INFO:tasks.workunit.client.1.smithi194.stdout:6/58: write fd [866680,6553] 0 2021-11-03T16:54:38.427 INFO:tasks.workunit.client.1.smithi194.stdout:4/73: getdents d6/d8 0 2021-11-03T16:54:38.428 INFO:tasks.workunit.client.1.smithi194.stdout:5/100: dwrite d2/f24 [0,4194304] 0 2021-11-03T16:54:38.431 INFO:tasks.workunit.client.1.smithi194.stdout:0/10: dread f2 [0,4194304] 0 2021-11-03T16:54:38.431 INFO:tasks.workunit.client.1.smithi194.stdout:0/11: chown f3 14 1 2021-11-03T16:54:38.432 INFO:tasks.workunit.client.1.smithi194.stdout:0/12: dread f2 [0,4194304] 0 2021-11-03T16:54:38.433 INFO:tasks.workunit.client.1.smithi194.stdout:0/13: write f3 [5038918,84624] 0 2021-11-03T16:54:38.434 INFO:tasks.workunit.client.1.smithi194.stdout:0/14: dread f2 [0,4194304] 0 2021-11-03T16:54:38.434 INFO:tasks.workunit.client.1.smithi194.stdout:9/119: mknod d19/c28 1 2021-11-03T16:54:38.437 INFO:tasks.workunit.client.1.smithi194.stdout:1/23: getdents d2 0 2021-11-03T16:54:38.437 INFO:tasks.workunit.client.1.smithi194.stdout:1/24: fsync - no filename 2021-11-03T16:54:38.442 INFO:tasks.workunit.client.1.smithi194.stdout:3/99: rename d2/f18 to d2/d17/f23 0 2021-11-03T16:54:38.443 INFO:tasks.workunit.client.1.smithi194.stdout:7/29: creat f5 x:0 0 0 2021-11-03T16:54:38.445 INFO:tasks.workunit.client.1.smithi194.stdout:8/55: dwrite d8/f10 [0,4194304] 0 2021-11-03T16:54:38.457 INFO:tasks.workunit.client.1.smithi194.stdout:6/59: chown f9 12474 1 2021-11-03T16:54:38.458 INFO:tasks.workunit.client.1.smithi194.stdout:4/74: symlink d6/d8/l19 0 2021-11-03T16:54:38.462 INFO:tasks.workunit.client.1.smithi194.stdout:0/15: creat f4 x:0 0 0 2021-11-03T16:54:38.463 INFO:tasks.workunit.client.1.smithi194.stdout:9/120: dread - d19/f1e zero size 2021-11-03T16:54:38.468 INFO:tasks.workunit.client.1.smithi194.stdout:1/25: link d2/l3 d2/l4 0 2021-11-03T16:54:38.471 INFO:tasks.workunit.client.1.smithi194.stdout:0/16: dread f3 [0,4194304] 0 2021-11-03T16:54:38.471 INFO:tasks.workunit.client.1.smithi194.stdout:5/101: rename d2/d3/l12 to d2/dd/l25 0 2021-11-03T16:54:38.471 INFO:tasks.workunit.client.1.smithi194.stdout:5/102: mknod d2/dd/c26 1 2021-11-03T16:54:38.473 INFO:tasks.workunit.client.1.smithi194.stdout:7/30: fsync f0 0 2021-11-03T16:54:38.474 INFO:tasks.workunit.client.1.smithi194.stdout:3/100: dread d2/f11 [0,4194304] 0 2021-11-03T16:54:38.475 INFO:tasks.workunit.client.1.smithi194.stdout:8/56: symlink d8/l11 0 2021-11-03T16:54:38.477 INFO:tasks.workunit.client.1.smithi194.stdout:5/103: dread d2/d3/fc [0,4194304] 0 2021-11-03T16:54:38.478 INFO:tasks.workunit.client.1.smithi194.stdout:5/104: write d2/dd/f14 [1068385,80603] 0 2021-11-03T16:54:38.478 INFO:tasks.workunit.client.1.smithi194.stdout:2/258: truncate d6/f7 778758 0 2021-11-03T16:54:38.485 INFO:tasks.workunit.client.1.smithi194.stdout:9/121: creat d19/d27/f29 x:0 0 0 2021-11-03T16:54:38.488 INFO:tasks.workunit.client.1.smithi194.stdout:1/26: creat d2/f5 x:0 0 0 2021-11-03T16:54:38.489 INFO:tasks.workunit.client.1.smithi194.stdout:0/17: mkdir d5 0 2021-11-03T16:54:38.497 INFO:tasks.workunit.client.1.smithi194.stdout:6/60: dwrite f2 [0,4194304] 0 2021-11-03T16:54:38.498 INFO:tasks.workunit.client.1.smithi194.stdout:5/105: dwrite d2/f1f [0,4194304] 0 2021-11-03T16:54:38.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:38 smithi194 conmon[35111]: cluster 2021-11-03T16:54:37.074901+0000 mgr.smithi026.cnrxli (mgr 2021-11-03T16:54:38.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:38 smithi194 conmon[35111]: .14162) 310 : cluster [DBG] pgmap v255: 65 pgs: 65 active+clean; 343 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 5.7 MiB/s rd, 18 MiB/s wr, 340 op/s 2021-11-03T16:54:38.500 INFO:tasks.workunit.client.1.smithi194.stdout:8/57: creat d8/f12 x:0 0 0 2021-11-03T16:54:38.500 INFO:tasks.workunit.client.1.smithi194.stdout:5/106: write d2/d3/fc [599506,39078] 0 2021-11-03T16:54:38.501 INFO:tasks.workunit.client.1.smithi194.stdout:5/107: chown d2/f17 0 1 2021-11-03T16:54:38.501 INFO:tasks.workunit.client.1.smithi194.stdout:5/108: write d2/dd/f20 [985323,15602] 0 2021-11-03T16:54:38.501 INFO:tasks.workunit.client.1.smithi194.stdout:2/259: getdents d6/d1f 0 2021-11-03T16:54:38.502 INFO:tasks.workunit.client.1.smithi194.stdout:2/260: stat d6/d21/d2a/d31/f33 0 2021-11-03T16:54:38.502 INFO:tasks.workunit.client.1.smithi194.stdout:2/261: chown d6/d17 9 1 2021-11-03T16:54:38.503 INFO:tasks.workunit.client.1.smithi194.stdout:0/18: mkdir d5/d6 0 2021-11-03T16:54:38.504 INFO:tasks.workunit.client.1.smithi194.stdout:6/61: dread f9 [0,4194304] 0 2021-11-03T16:54:38.508 INFO:tasks.workunit.client.1.smithi194.stdout:0/19: dread f3 [4194304,4194304] 0 2021-11-03T16:54:38.511 INFO:tasks.workunit.client.1.smithi194.stdout:5/109: dread d2/dd/f16 [0,4194304] 0 2021-11-03T16:54:38.515 INFO:tasks.workunit.client.1.smithi194.stdout:1/27: dwrite d2/f5 [0,4194304] 0 2021-11-03T16:54:38.515 INFO:tasks.workunit.client.1.smithi194.stdout:8/58: dread d8/f10 [0,4194304] 0 2021-11-03T16:54:38.521 INFO:tasks.workunit.client.1.smithi194.stdout:8/59: dread d8/fb [0,4194304] 0 2021-11-03T16:54:38.521 INFO:tasks.workunit.client.1.smithi194.stdout:8/60: truncate d8/fb 1723516 0 2021-11-03T16:54:38.521 INFO:tasks.workunit.client.1.smithi194.stdout:8/61: chown d8/f9 102 1 2021-11-03T16:54:38.522 INFO:tasks.workunit.client.1.smithi194.stdout:7/31: mkdir d6 0 2021-11-03T16:54:38.522 INFO:tasks.workunit.client.1.smithi194.stdout:7/32: mknod d6/c7 1 2021-11-03T16:54:38.522 INFO:tasks.workunit.client.1.smithi194.stdout:7/33: mknod d6/c8 1 2021-11-03T16:54:38.522 INFO:tasks.workunit.client.1.smithi194.stdout:7/34: getdents d6 0 2021-11-03T16:54:38.523 INFO:tasks.workunit.client.1.smithi194.stdout:7/35: mknod d6/c9 1 2021-11-03T16:54:38.523 INFO:tasks.workunit.client.1.smithi194.stdout:7/36: write f4 [1034515,106899] 0 2021-11-03T16:54:38.525 INFO:tasks.workunit.client.1.smithi194.stdout:0/20: dwrite f2 [0,4194304] 0 2021-11-03T16:54:38.525 INFO:tasks.workunit.client.1.smithi194.stdout:0/21: dread - f4 zero size 2021-11-03T16:54:38.525 INFO:tasks.workunit.client.1.smithi194.stdout:1/28: dread d2/f5 [0,4194304] 0 2021-11-03T16:54:38.527 INFO:tasks.workunit.client.1.smithi194.stdout:3/101: symlink d2/l24 0 2021-11-03T16:54:38.543 INFO:tasks.workunit.client.1.smithi194.stdout:6/62: getdents . 0 2021-11-03T16:54:38.545 INFO:tasks.workunit.client.1.smithi194.stdout:5/110: creat d2/dd/f27 x:0 0 0 2021-11-03T16:54:38.545 INFO:tasks.workunit.client.1.smithi194.stdout:5/111: mknod d2/d3/c28 1 2021-11-03T16:54:38.549 INFO:tasks.workunit.client.1.smithi194.stdout:8/62: creat d8/f13 x:0 0 0 2021-11-03T16:54:38.549 INFO:tasks.workunit.client.1.smithi194.stdout:8/63: chown l4 0 1 2021-11-03T16:54:38.550 INFO:tasks.workunit.client.1.smithi194.stdout:2/262: dread d6/f44 [0,4194304] 0 2021-11-03T16:54:38.550 INFO:tasks.workunit.client.1.smithi194.stdout:0/22: dwrite f4 [0,4194304] 0 2021-11-03T16:54:38.550 INFO:tasks.workunit.client.1.smithi194.stdout:0/23: chown f3 2 1 2021-11-03T16:54:38.551 INFO:tasks.workunit.client.1.smithi194.stdout:8/64: write d8/fc [205767,40671] 0 2021-11-03T16:54:38.551 INFO:tasks.workunit.client.1.smithi194.stdout:8/65: rename d8 to d8/d14 22 2021-11-03T16:54:38.551 INFO:tasks.workunit.client.1.smithi194.stdout:8/66: dread - d8/f13 zero size 2021-11-03T16:54:38.608 INFO:tasks.workunit.client.1.smithi194.stdout:7/37: mkdir d6/da 0 2021-11-03T16:54:38.608 INFO:tasks.workunit.client.1.smithi194.stdout:7/38: dread - f5 zero size 2021-11-03T16:54:38.609 INFO:tasks.workunit.client.1.smithi194.stdout:7/39: chown d6 215593267 1 2021-11-03T16:54:38.612 INFO:tasks.workunit.client.1.smithi194.stdout:3/102: chown d2/d17/l21 51848843 1 2021-11-03T16:54:38.612 INFO:tasks.workunit.client.1.smithi194.stdout:3/103: chown d2/d17/f19 13 1 2021-11-03T16:54:38.612 INFO:tasks.workunit.client.1.smithi194.stdout:3/104: fdatasync d2/d17/d1d/f1e 0 2021-11-03T16:54:38.613 INFO:tasks.workunit.client.1.smithi194.stdout:6/63: mkdir de 0 2021-11-03T16:54:38.613 INFO:tasks.workunit.client.1.smithi194.stdout:6/64: write fd [516062,123649] 0 2021-11-03T16:54:38.614 INFO:tasks.workunit.client.1.smithi194.stdout:5/112: creat d2/d3/f29 x:0 0 0 2021-11-03T16:54:38.615 INFO:tasks.workunit.client.1.smithi194.stdout:6/65: read fd [579410,82871] 0 2021-11-03T16:54:38.615 INFO:tasks.workunit.client.1.smithi194.stdout:6/66: fsync fc 0 2021-11-03T16:54:38.633 INFO:tasks.workunit.client.1.smithi194.stdout:3/105: dwrite d2/d17/d1d/f1e [0,4194304] 0 2021-11-03T16:54:38.634 INFO:tasks.workunit.client.1.smithi194.stdout:5/113: dwrite d2/d3/f22 [0,4194304] 0 2021-11-03T16:54:38.634 INFO:tasks.workunit.client.1.smithi194.stdout:5/114: chown d2/d3/la 3080400 1 2021-11-03T16:54:38.635 INFO:tasks.workunit.client.1.smithi194.stdout:5/115: readlink d2/dd/l25 0 2021-11-03T16:54:38.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:38 smithi026 conmon[32119]: cluster 2021-11-03T16:54:37. 2021-11-03T16:54:38.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:38 smithi026 conmon[32119]: 074901+0000 mgr.smithi026.cnrxli (mgr.14162) 310 : cluster [DBG] pgmap v255: 65 pgs: 65 active+clean; 343 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 5.7 MiB/s rd, 18 MiB/s wr, 340 op/s 2021-11-03T16:54:38.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.784+0000 7f0ade2f1700 1 -- 172.21.15.26:0/2321792191 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ad80f55e0 msgr2=0x7f0ad80f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:54:38.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.784+0000 7f0ade2f1700 1 --2- 172.21.15.26:0/2321792191 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ad80f55e0 0x7f0ad80f5a00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f0ac8004660 tx=0x7f0ac8009b30).stop 2021-11-03T16:54:38.786 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.784+0000 7f0ade2f1700 1 -- 172.21.15.26:0/2321792191 shutdown_connections 2021-11-03T16:54:38.786 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.784+0000 7f0ade2f1700 1 --2- 172.21.15.26:0/2321792191 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ad80f5ef0 0x7f0ad80f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:38.786 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.784+0000 7f0ade2f1700 1 --2- 172.21.15.26:0/2321792191 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ad80f55e0 0x7f0ad80f5a00 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:38.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.784+0000 7f0ade2f1700 1 -- 172.21.15.26:0/2321792191 >> 172.21.15.26:0/2321792191 conn(0x7f0ad80f0de0 msgr2=0x7f0ad80f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:54:38.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.785+0000 7f0ade2f1700 1 -- 172.21.15.26:0/2321792191 shutdown_connections 2021-11-03T16:54:38.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.785+0000 7f0ade2f1700 1 -- 172.21.15.26:0/2321792191 wait complete. 2021-11-03T16:54:38.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.785+0000 7f0ade2f1700 1 Processor -- start 2021-11-03T16:54:38.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.785+0000 7f0ade2f1700 1 -- start start 2021-11-03T16:54:38.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.785+0000 7f0ade2f1700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ad80f55e0 0x7f0ad8109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:54:38.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.785+0000 7f0ade2f1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ad80f5ef0 0x7f0ad810c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:54:38.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.785+0000 7f0ade2f1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad80604c0 con 0x7f0ad80f5ef0 2021-11-03T16:54:38.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.785+0000 7f0ade2f1700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad8060600 con 0x7f0ad80f55e0 2021-11-03T16:54:38.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.786+0000 7f0ad77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ad80f5ef0 0x7f0ad810c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:54:38.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.786+0000 7f0ad77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ad80f5ef0 0x7f0ad810c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50410/0 (socket says 172.21.15.26:50410) 2021-11-03T16:54:38.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.786+0000 7f0ad77fe700 1 -- 172.21.15.26:0/2135487608 learned_addr learned my addr 172.21.15.26:0/2135487608 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:54:38.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.786+0000 7f0ad7fff700 1 --2- 172.21.15.26:0/2135487608 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ad80f55e0 0x7f0ad8109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:54:38.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.786+0000 7f0ad77fe700 1 -- 172.21.15.26:0/2135487608 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ad80f55e0 msgr2=0x7f0ad8109cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:54:38.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.786+0000 7f0ad77fe700 1 --2- 172.21.15.26:0/2135487608 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ad80f55e0 0x7f0ad8109cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:38.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.786+0000 7f0ad77fe700 1 -- 172.21.15.26:0/2135487608 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac8005040 con 0x7f0ad80f5ef0 2021-11-03T16:54:38.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.786+0000 7f0ad77fe700 1 --2- 172.21.15.26:0/2135487608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ad80f5ef0 0x7f0ad810c1b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f0acc0026d0 tx=0x7f0acc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:54:38.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.786+0000 7f0ad4ff9700 1 -- 172.21.15.26:0/2135487608 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0acc0079c0 con 0x7f0ad80f5ef0 2021-11-03T16:54:38.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.786+0000 7f0ade2f1700 1 -- 172.21.15.26:0/2135487608 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad810c760 con 0x7f0ad80f5ef0 2021-11-03T16:54:38.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.786+0000 7f0ad4ff9700 1 -- 172.21.15.26:0/2135487608 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0acc00f040 con 0x7f0ad80f5ef0 2021-11-03T16:54:38.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.786+0000 7f0ad4ff9700 1 -- 172.21.15.26:0/2135487608 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0acc0148b0 con 0x7f0ad80f5ef0 2021-11-03T16:54:38.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.786+0000 7f0ade2f1700 1 -- 172.21.15.26:0/2135487608 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ad810ccf0 con 0x7f0ad80f5ef0 2021-11-03T16:54:38.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.787+0000 7f0ade2f1700 1 -- 172.21.15.26:0/2135487608 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ad80f4a70 con 0x7f0ad80f5ef0 2021-11-03T16:54:38.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.788+0000 7f0ad4ff9700 1 -- 172.21.15.26:0/2135487608 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f0acc007b20 con 0x7f0ad80f5ef0 2021-11-03T16:54:38.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.788+0000 7f0ad4ff9700 1 --2- 172.21.15.26:0/2135487608 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f0ac005c2b0 0x7f0ac005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:54:38.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.788+0000 7f0ad4ff9700 1 -- 172.21.15.26:0/2135487608 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f0acc075ec0 con 0x7f0ad80f5ef0 2021-11-03T16:54:38.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.788+0000 7f0ad7fff700 1 --2- 172.21.15.26:0/2135487608 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f0ac005c2b0 0x7f0ac005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:54:38.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.788+0000 7f0ad7fff700 1 --2- 172.21.15.26:0/2135487608 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f0ac005c2b0 0x7f0ac005e770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f0ac8004630 tx=0x7f0ac8009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:54:38.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.792+0000 7f0ad4ff9700 1 -- 172.21.15.26:0/2135487608 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f0acc048ba0 con 0x7f0ad80f5ef0 2021-11-03T16:54:38.873 INFO:tasks.workunit.client.1.smithi194.stdout:2/263: mkdir d6/d21/d43/d51 0 2021-11-03T16:54:38.891 INFO:tasks.workunit.client.1.smithi194.stdout:2/264: dwrite d6/d21/d2a/d31/f37 [0,4194304] 0 2021-11-03T16:54:38.892 INFO:tasks.workunit.client.1.smithi194.stdout:2/265: write d6/de/f40 [19989,63774] 0 2021-11-03T16:54:38.905 INFO:tasks.workunit.client.1.smithi194.stdout:8/67: creat d8/f15 x:0 0 0 2021-11-03T16:54:38.915 INFO:tasks.workunit.client.1.smithi194.stdout:1/29: unlink d2/f5 0 2021-11-03T16:54:38.915 INFO:tasks.workunit.client.1.smithi194.stdout:1/30: truncate - no filename 2021-11-03T16:54:38.919 INFO:tasks.workunit.client.1.smithi194.stdout:8/68: dwrite d8/f9 [0,4194304] 0 2021-11-03T16:54:38.920 INFO:tasks.workunit.client.1.smithi194.stdout:8/69: write d8/fb [310174,40849] 0 2021-11-03T16:54:38.920 INFO:tasks.workunit.client.1.smithi194.stdout:8/70: mknod d8/c16 1 2021-11-03T16:54:38.922 INFO:tasks.workunit.client.1.smithi194.stdout:6/67: creat de/ff x:0 0 0 2021-11-03T16:54:38.923 INFO:tasks.workunit.client.1.smithi194.stdout:6/68: dread fd [0,4194304] 0 2021-11-03T16:54:38.926 INFO:tasks.workunit.client.1.smithi194.stdout:3/106: fdatasync d2/f13 0 2021-11-03T16:54:38.935 INFO:tasks.workunit.client.1.smithi194.stdout:5/116: mkdir d2/d2a 0 2021-11-03T16:54:38.935 INFO:tasks.workunit.client.1.smithi194.stdout:5/117: fdatasync f0 0 2021-11-03T16:54:38.937 INFO:tasks.workunit.client.1.smithi194.stdout:5/118: dread d2/dd/f20 [0,4194304] 0 2021-11-03T16:54:38.938 INFO:tasks.workunit.client.1.smithi194.stdout:0/24: truncate f2 3387851 0 2021-11-03T16:54:38.944 INFO:tasks.workunit.client.1.smithi194.stdout:1/31: creat d2/f6 x:0 0 0 2021-11-03T16:54:38.948 INFO:tasks.workunit.client.1.smithi194.stdout:2/266: dread d6/ff [0,4194304] 0 2021-11-03T16:54:38.948 INFO:tasks.workunit.client.1.smithi194.stdout:2/267: stat d6/d21/d2a/d35 0 2021-11-03T16:54:38.949 INFO:tasks.workunit.client.1.smithi194.stdout:8/71: creat d8/f17 x:0 0 0 2021-11-03T16:54:38.952 INFO:tasks.workunit.client.1.smithi194.stdout:0/25: dread f2 [0,4194304] 0 2021-11-03T16:54:38.952 INFO:tasks.workunit.client.1.smithi194.stdout:0/26: chown f3 214 1 2021-11-03T16:54:38.953 INFO:tasks.workunit.client.1.smithi194.stdout:0/27: chown d5/d6 553970 1 2021-11-03T16:54:38.954 INFO:tasks.workunit.client.1.smithi194.stdout:6/69: rename f2 to de/f10 0 2021-11-03T16:54:38.965 INFO:tasks.workunit.client.1.smithi194.stdout:3/107: read d2/f6 [1421675,61884] 0 2021-11-03T16:54:38.965 INFO:tasks.workunit.client.1.smithi194.stdout:0/28: dread f4 [0,4194304] 0 2021-11-03T16:54:38.965 INFO:tasks.workunit.client.1.smithi194.stdout:2/268: creat d6/d21/d2a/d35/f52 x:0 0 0 2021-11-03T16:54:38.966 INFO:tasks.workunit.client.1.smithi194.stdout:8/72: dwrite d8/f13 [0,4194304] 0 2021-11-03T16:54:38.967 INFO:tasks.workunit.client.1.smithi194.stdout:5/119: rename d2/l15 to d2/dd/l2b 0 2021-11-03T16:54:38.969 INFO:tasks.workunit.client.1.smithi194.stdout:6/70: rename de/ff to de/f11 0 2021-11-03T16:54:38.972 INFO:tasks.workunit.client.1.smithi194.stdout:1/32: symlink d2/l7 0 2021-11-03T16:54:38.973 INFO:tasks.workunit.client.1.smithi194.stdout:1/33: dread - d2/f6 zero size 2021-11-03T16:54:38.973 INFO:tasks.workunit.client.1.smithi194.stdout:1/34: write d2/f6 [1030566,71700] 0 2021-11-03T16:54:38.973 INFO:tasks.workunit.client.1.smithi194.stdout:3/108: write d2/f16 [40359,8054] 0 2021-11-03T16:54:38.974 INFO:tasks.workunit.client.1.smithi194.stdout:3/109: chown d2/d17/f1c 977908989 1 2021-11-03T16:54:38.975 INFO:tasks.workunit.client.1.smithi194.stdout:2/269: symlink d6/d1f/l53 0 2021-11-03T16:54:38.981 INFO:tasks.workunit.client.1.smithi194.stdout:8/73: symlink d8/l18 0 2021-11-03T16:54:38.982 INFO:tasks.workunit.client.1.smithi194.stdout:8/74: write d8/fc [1985008,116519] 0 2021-11-03T16:54:38.984 INFO:tasks.workunit.client.1.smithi194.stdout:5/120: dwrite d2/d3/f29 [0,4194304] 0 2021-11-03T16:54:38.984 INFO:tasks.workunit.client.1.smithi194.stdout:0/29: dwrite f3 [4194304,4194304] 0 2021-11-03T16:54:38.988 INFO:tasks.workunit.client.1.smithi194.stdout:6/71: unlink fd 0 2021-11-03T16:54:38.989 INFO:tasks.workunit.client.1.smithi194.stdout:6/72: fsync f8 0 2021-11-03T16:54:38.991 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.996+0000 7f0ade2f1700 1 -- 172.21.15.26:0/2135487608 --> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ad80fdf50 con 0x7f0ac005c2b0 2021-11-03T16:54:38.992 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.997+0000 7f0ad4ff9700 1 -- 172.21.15.26:0/2135487608 <== mgr.14162 v2:172.21.15.26:6800/3029163595 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+274 (secure 0 0 0) 0x7f0ad80fdf50 con 0x7f0ac005c2b0 2021-11-03T16:54:38.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.999+0000 7f0ade2f1700 1 -- 172.21.15.26:0/2135487608 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f0ac005c2b0 msgr2=0x7f0ac005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:54:38.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.999+0000 7f0ade2f1700 1 --2- 172.21.15.26:0/2135487608 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f0ac005c2b0 0x7f0ac005e770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f0ac8004630 tx=0x7f0ac8009b30).stop 2021-11-03T16:54:38.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.999+0000 7f0ade2f1700 1 -- 172.21.15.26:0/2135487608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ad80f5ef0 msgr2=0x7f0ad810c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:54:38.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.999+0000 7f0ade2f1700 1 --2- 172.21.15.26:0/2135487608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ad80f5ef0 0x7f0ad810c1b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f0acc0026d0 tx=0x7f0acc009de0).stop 2021-11-03T16:54:38.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.999+0000 7f0ade2f1700 1 -- 172.21.15.26:0/2135487608 shutdown_connections 2021-11-03T16:54:38.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.999+0000 7f0ade2f1700 1 --2- 172.21.15.26:0/2135487608 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f0ac005c2b0 0x7f0ac005e770 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:38.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.999+0000 7f0ade2f1700 1 --2- 172.21.15.26:0/2135487608 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ad80f55e0 0x7f0ad8109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:38.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.999+0000 7f0ade2f1700 1 --2- 172.21.15.26:0/2135487608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ad80f5ef0 0x7f0ad810c1b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:38.997 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.999+0000 7f0ade2f1700 1 -- 172.21.15.26:0/2135487608 >> 172.21.15.26:0/2135487608 conn(0x7f0ad80f0de0 msgr2=0x7f0ad80fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:54:38.997 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.999+0000 7f0ade2f1700 1 -- 172.21.15.26:0/2135487608 shutdown_connections 2021-11-03T16:54:38.997 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:38.999+0000 7f0ade2f1700 1 -- 172.21.15.26:0/2135487608 wait complete. 2021-11-03T16:54:38.998 INFO:tasks.workunit.client.1.smithi194.stdout:0/30: dwrite f4 [4194304,4194304] 0 2021-11-03T16:54:38.998 INFO:tasks.workunit.client.1.smithi194.stdout:0/31: fsync f2 0 2021-11-03T16:54:39.005 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T16:54:39.013 INFO:tasks.workunit.client.1.smithi194.stdout:0/32: dwrite f2 [0,4194304] 0 2021-11-03T16:54:39.013 INFO:tasks.workunit.client.1.smithi194.stdout:0/33: chown f4 171 1 2021-11-03T16:54:39.056 INFO:tasks.workunit.client.1.smithi194.stdout:1/35: mknod d2/c8 1 2021-11-03T16:54:39.058 INFO:tasks.workunit.client.1.smithi194.stdout:2/270: read d6/fd [1400536,502] 0 2021-11-03T16:54:39.058 INFO:tasks.workunit.client.1.smithi194.stdout:2/271: chown d6/de 383406 1 2021-11-03T16:54:39.063 INFO:tasks.workunit.client.1.smithi194.stdout:8/75: getdents d8 0 2021-11-03T16:54:39.065 INFO:tasks.workunit.client.1.smithi194.stdout:5/121: symlink d2/d3/l2c 0 2021-11-03T16:54:39.069 INFO:tasks.workunit.client.1.smithi194.stdout:6/73: creat de/f12 x:0 0 0 2021-11-03T16:54:39.073 INFO:tasks.workunit.client.1.smithi194.stdout:0/34: unlink f2 0 2021-11-03T16:54:39.073 INFO:tasks.workunit.client.1.smithi194.stdout:0/35: rename d5 to d5/d6/d7 22 2021-11-03T16:54:39.074 INFO:tasks.workunit.client.1.smithi194.stdout:1/36: creat d2/f9 x:0 0 0 2021-11-03T16:54:39.077 INFO:tasks.workunit.client.1.smithi194.stdout:3/110: creat d2/d20/f25 x:0 0 0 2021-11-03T16:54:39.080 INFO:tasks.workunit.client.1.smithi194.stdout:2/272: rmdir d6/d21/d43/d51 0 2021-11-03T16:54:39.085 INFO:tasks.workunit.client.1.smithi194.stdout:8/76: symlink d8/l19 0 2021-11-03T16:54:39.089 INFO:tasks.workunit.client.1.smithi194.stdout:5/122: creat d2/d3/f2d x:0 0 0 2021-11-03T16:54:39.091 INFO:tasks.workunit.client.1.smithi194.stdout:6/74: creat de/f13 x:0 0 0 2021-11-03T16:54:39.091 INFO:tasks.workunit.client.1.smithi194.stdout:6/75: dread - de/f13 zero size 2021-11-03T16:54:39.103 INFO:tasks.workunit.client.1.smithi194.stdout:3/111: dwrite d2/f16 [0,4194304] 0 2021-11-03T16:54:39.106 INFO:tasks.workunit.client.1.smithi194.stdout:3/112: fdatasync d2/f14 0 2021-11-03T16:54:39.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.114+0000 7f7472726700 1 -- 172.21.15.26:0/1188933135 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f746c0f7980 msgr2=0x7f746c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:54:39.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.114+0000 7f7472726700 1 --2- 172.21.15.26:0/1188933135 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f746c0f7980 0x7f746c0f7de0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f7460004660 tx=0x7f7460009b30).stop 2021-11-03T16:54:39.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.114+0000 7f7472726700 1 -- 172.21.15.26:0/1188933135 shutdown_connections 2021-11-03T16:54:39.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.114+0000 7f7472726700 1 --2- 172.21.15.26:0/1188933135 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f746c0f7980 0x7f746c0f7de0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:39.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.114+0000 7f7472726700 1 --2- 172.21.15.26:0/1188933135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f746c0f66e0 0x7f746c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:39.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.114+0000 7f7472726700 1 -- 172.21.15.26:0/1188933135 >> 172.21.15.26:0/1188933135 conn(0x7f746c0f1e40 msgr2=0x7f746c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:54:39.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.114+0000 7f7472726700 1 -- 172.21.15.26:0/1188933135 shutdown_connections 2021-11-03T16:54:39.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.114+0000 7f7472726700 1 -- 172.21.15.26:0/1188933135 wait complete. 2021-11-03T16:54:39.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.115+0000 7f7472726700 1 Processor -- start 2021-11-03T16:54:39.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.115+0000 7f7472726700 1 -- start start 2021-11-03T16:54:39.113 INFO:tasks.workunit.client.1.smithi194.stdout:8/77: dread d8/fb [0,4194304] 0 2021-11-03T16:54:39.114 INFO:tasks.workunit.client.1.smithi194.stdout:8/78: mknod d8/c1a 1 2021-11-03T16:54:39.117 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.115+0000 7f7472726700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f746c0f66e0 0x7f746c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:54:39.117 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.115+0000 7f7472726700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f746c0f7980 0x7f746c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:54:39.117 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.115+0000 7f7472726700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746c06a380 con 0x7f746c0f7980 2021-11-03T16:54:39.118 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.116+0000 7f7472726700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746c06a4c0 con 0x7f746c0f66e0 2021-11-03T16:54:39.118 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.116+0000 7f746b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f746c0f7980 0x7f746c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:54:39.119 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.116+0000 7f746b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f746c0f7980 0x7f746c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50420/0 (socket says 172.21.15.26:50420) 2021-11-03T16:54:39.119 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.116+0000 7f746b7fe700 1 -- 172.21.15.26:0/2161214674 learned_addr learned my addr 172.21.15.26:0/2161214674 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:54:39.119 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.116+0000 7f746bfff700 1 --2- 172.21.15.26:0/2161214674 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f746c0f66e0 0x7f746c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:54:39.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.116+0000 7f746b7fe700 1 -- 172.21.15.26:0/2161214674 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f746c0f66e0 msgr2=0x7f746c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:54:39.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.116+0000 7f746b7fe700 1 --2- 172.21.15.26:0/2161214674 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f746c0f66e0 0x7f746c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:39.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.116+0000 7f746b7fe700 1 -- 172.21.15.26:0/2161214674 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f745c005040 con 0x7f746c0f7980 2021-11-03T16:54:39.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.116+0000 7f746b7fe700 1 --2- 172.21.15.26:0/2161214674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f746c0f7980 0x7f746c069e20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f7460000c00 tx=0x7f746000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:54:39.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.116+0000 7f7468ff9700 1 -- 172.21.15.26:0/2161214674 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7460019070 con 0x7f746c0f7980 2021-11-03T16:54:39.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.116+0000 7f7472726700 1 -- 172.21.15.26:0/2161214674 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7460005040 con 0x7f746c0f7980 2021-11-03T16:54:39.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.116+0000 7f7472726700 1 -- 172.21.15.26:0/2161214674 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f746c06ab10 con 0x7f746c0f7980 2021-11-03T16:54:39.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.117+0000 7f7468ff9700 1 -- 172.21.15.26:0/2161214674 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7460007e70 con 0x7f746c0f7980 2021-11-03T16:54:39.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.117+0000 7f7468ff9700 1 -- 172.21.15.26:0/2161214674 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7460014ce0 con 0x7f746c0f7980 2021-11-03T16:54:39.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.118+0000 7f7472726700 1 -- 172.21.15.26:0/2161214674 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f744c004fa0 con 0x7f746c0f7980 2021-11-03T16:54:39.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.118+0000 7f7468ff9700 1 -- 172.21.15.26:0/2161214674 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f7460025070 con 0x7f746c0f7980 2021-11-03T16:54:39.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.119+0000 7f7468ff9700 1 --2- 172.21.15.26:0/2161214674 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f745405c2b0 0x7f745405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:54:39.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.119+0000 7f7468ff9700 1 -- 172.21.15.26:0/2161214674 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f7460076d20 con 0x7f746c0f7980 2021-11-03T16:54:39.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.119+0000 7f746bfff700 1 --2- 172.21.15.26:0/2161214674 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f745405c2b0 0x7f745405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:54:39.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.120+0000 7f746bfff700 1 --2- 172.21.15.26:0/2161214674 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f745405c2b0 0x7f745405e770 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f746c06b730 tx=0x7f745c00b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:54:39.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.128+0000 7f7468ff9700 1 -- 172.21.15.26:0/2161214674 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f7460049a80 con 0x7f746c0f7980 2021-11-03T16:54:39.126 INFO:tasks.workunit.client.1.smithi194.stdout:8/79: chown d8/l18 25388 1 2021-11-03T16:54:39.127 INFO:tasks.workunit.client.1.smithi194.stdout:3/113: dread d2/ff [0,4194304] 0 2021-11-03T16:54:39.127 INFO:tasks.workunit.client.1.smithi194.stdout:3/114: fdatasync d2/d17/d1d/f1e 0 2021-11-03T16:54:39.127 INFO:tasks.workunit.client.1.smithi194.stdout:6/76: dwrite de/f10 [0,4194304] 0 2021-11-03T16:54:39.127 INFO:tasks.workunit.client.1.smithi194.stdout:6/77: chown fc 0 1 2021-11-03T16:54:39.128 INFO:tasks.workunit.client.1.smithi194.stdout:6/78: chown f9 18439753 1 2021-11-03T16:54:39.128 INFO:tasks.workunit.client.1.smithi194.stdout:6/79: chown de/f11 0 1 2021-11-03T16:54:39.128 INFO:tasks.workunit.client.1.smithi194.stdout:2/273: dwrite d6/de/f40 [0,4194304] 0 2021-11-03T16:54:39.128 INFO:tasks.workunit.client.1.smithi194.stdout:5/123: dwrite d2/dd/f1b [4194304,4194304] 0 2021-11-03T16:54:39.129 INFO:tasks.workunit.client.1.smithi194.stdout:3/115: mkdir d2/d17/d26 0 2021-11-03T16:54:39.130 INFO:tasks.workunit.client.1.smithi194.stdout:3/116: dread d2/f6 [0,4194304] 0 2021-11-03T16:54:39.131 INFO:tasks.workunit.client.1.smithi194.stdout:2/274: symlink d6/de/d11/l54 0 2021-11-03T16:54:39.131 INFO:tasks.workunit.client.1.smithi194.stdout:2/275: write d6/de/f40 [1974866,23572] 0 2021-11-03T16:54:39.134 INFO:tasks.workunit.client.1.smithi194.stdout:0/36: truncate f4 5398931 0 2021-11-03T16:54:39.135 INFO:tasks.workunit.client.1.smithi194.stdout:0/37: mknod d5/d6/c8 1 2021-11-03T16:54:39.138 INFO:tasks.workunit.client.1.smithi194.stdout:5/124: symlink d2/d2a/l2e 0 2021-11-03T16:54:39.138 INFO:tasks.workunit.client.1.smithi194.stdout:5/125: write d2/dd/f27 [157150,87006] 0 2021-11-03T16:54:39.138 INFO:tasks.workunit.client.1.smithi194.stdout:5/126: mknod d2/d2a/c2f 1 2021-11-03T16:54:39.139 INFO:tasks.workunit.client.1.smithi194.stdout:2/276: write d6/d21/f23 [2733872,114979] 0 2021-11-03T16:54:39.139 INFO:tasks.workunit.client.1.smithi194.stdout:2/277: write d6/d1f/f39 [739533,9873] 0 2021-11-03T16:54:39.140 INFO:tasks.workunit.client.1.smithi194.stdout:2/278: dread - d6/de/d11/f4d zero size 2021-11-03T16:54:39.140 INFO:tasks.workunit.client.1.smithi194.stdout:2/279: readlink d6/d17/l4b 0 2021-11-03T16:54:39.144 INFO:tasks.workunit.client.1.smithi194.stdout:6/80: dwrite de/f12 [0,4194304] 0 2021-11-03T16:54:39.145 INFO:tasks.workunit.client.1.smithi194.stdout:6/81: readlink - no filename 2021-11-03T16:54:39.145 INFO:tasks.workunit.client.1.smithi194.stdout:6/82: dread - de/f13 zero size 2021-11-03T16:54:39.145 INFO:tasks.workunit.client.1.smithi194.stdout:8/80: dwrite d8/fb [0,4194304] 0 2021-11-03T16:54:39.151 INFO:tasks.workunit.client.1.smithi194.stdout:3/117: creat d2/f27 x:0 0 0 2021-11-03T16:54:39.151 INFO:tasks.workunit.client.1.smithi194.stdout:3/118: write d2/ff [4843630,51355] 0 2021-11-03T16:54:39.152 INFO:tasks.workunit.client.1.smithi194.stdout:3/119: dread d2/f11 [0,4194304] 0 2021-11-03T16:54:39.152 INFO:tasks.workunit.client.1.smithi194.stdout:2/280: dwrite d6/d21/d2a/d35/f52 [0,4194304] 0 2021-11-03T16:54:39.158 INFO:tasks.workunit.client.1.smithi194.stdout:0/38: mkdir d5/d9 0 2021-11-03T16:54:39.170 INFO:tasks.workunit.client.1.smithi194.stdout:5/127: symlink d2/l30 0 2021-11-03T16:54:39.179 INFO:tasks.workunit.client.1.smithi194.stdout:6/83: creat de/f14 x:0 0 0 2021-11-03T16:54:39.184 INFO:tasks.workunit.client.1.smithi194.stdout:8/81: creat d8/f1b x:0 0 0 2021-11-03T16:54:39.201 INFO:tasks.workunit.client.1.smithi194.stdout:0/39: symlink d5/d6/la 0 2021-11-03T16:54:39.201 INFO:tasks.workunit.client.1.smithi194.stdout:6/84: dwrite de/f14 [0,4194304] 0 2021-11-03T16:54:39.202 INFO:tasks.workunit.client.1.smithi194.stdout:3/120: dread d2/f12 [0,4194304] 0 2021-11-03T16:54:39.202 INFO:tasks.workunit.client.1.smithi194.stdout:6/85: mknod de/c15 1 2021-11-03T16:54:39.202 INFO:tasks.workunit.client.1.smithi194.stdout:3/121: dread - d2/f27 zero size 2021-11-03T16:54:39.205 INFO:tasks.workunit.client.1.smithi194.stdout:5/128: creat d2/dd/f31 x:0 0 0 2021-11-03T16:54:39.211 INFO:tasks.workunit.client.1.smithi194.stdout:0/40: creat d5/d9/fb x:0 0 0 2021-11-03T16:54:39.218 INFO:tasks.workunit.client.1.smithi194.stdout:3/122: readlink d2/l5 0 2021-11-03T16:54:39.218 INFO:tasks.workunit.client.1.smithi194.stdout:0/41: dread f3 [4194304,4194304] 0 2021-11-03T16:54:39.220 INFO:tasks.workunit.client.1.smithi194.stdout:0/42: read f4 [3135590,70752] 0 2021-11-03T16:54:39.221 INFO:tasks.workunit.client.1.smithi194.stdout:0/43: write d5/d9/fb [79928,45373] 0 2021-11-03T16:54:39.221 INFO:tasks.workunit.client.1.smithi194.stdout:0/44: write f3 [564281,104443] 0 2021-11-03T16:54:39.224 INFO:tasks.workunit.client.1.smithi194.stdout:5/129: mkdir d2/dd/d32 0 2021-11-03T16:54:39.226 INFO:tasks.workunit.client.1.smithi194.stdout:8/82: mkdir d8/d1c 0 2021-11-03T16:54:39.231 INFO:tasks.workunit.client.1.smithi194.stdout:3/123: symlink d2/d20/l28 0 2021-11-03T16:54:39.231 INFO:tasks.workunit.client.1.smithi194.stdout:3/124: write d2/d20/f25 [374846,113324] 0 2021-11-03T16:54:39.233 INFO:tasks.workunit.client.1.smithi194.stdout:6/86: dwrite f8 [0,4194304] 0 2021-11-03T16:54:39.233 INFO:tasks.workunit.client.1.smithi194.stdout:6/87: dread - de/f13 zero size 2021-11-03T16:54:39.234 INFO:tasks.workunit.client.1.smithi194.stdout:0/45: unlink f4 0 2021-11-03T16:54:39.235 INFO:tasks.workunit.client.1.smithi194.stdout:0/46: truncate f3 9020439 0 2021-11-03T16:54:39.235 INFO:tasks.workunit.client.1.smithi194.stdout:0/47: stat d5/d9 0 2021-11-03T16:54:39.235 INFO:tasks.workunit.client.1.smithi194.stdout:0/48: write d5/d9/fb [598220,58846] 0 2021-11-03T16:54:39.236 INFO:tasks.workunit.client.1.smithi194.stdout:8/83: fdatasync d8/fc 0 2021-11-03T16:54:39.239 INFO:tasks.workunit.client.1.smithi194.stdout:3/125: truncate d2/f16 4152845 0 2021-11-03T16:54:39.239 INFO:tasks.workunit.client.1.smithi194.stdout:3/126: fdatasync d2/f11 0 2021-11-03T16:54:39.242 INFO:tasks.workunit.client.1.smithi194.stdout:6/88: link fc de/f16 0 2021-11-03T16:54:39.244 INFO:tasks.workunit.client.1.smithi194.stdout:3/127: dread d2/f12 [0,4194304] 0 2021-11-03T16:54:39.244 INFO:tasks.workunit.client.1.smithi194.stdout:3/128: fsync d2/f6 0 2021-11-03T16:54:39.246 INFO:tasks.workunit.client.1.smithi194.stdout:2/281: dwrite d6/d21/f3b [0,4194304] 0 2021-11-03T16:54:39.246 INFO:tasks.workunit.client.1.smithi194.stdout:2/282: chown d6/de/d27/f3f 2 1 2021-11-03T16:54:39.247 INFO:tasks.workunit.client.1.smithi194.stdout:5/130: dwrite d2/d3/f29 [0,4194304] 0 2021-11-03T16:54:39.247 INFO:tasks.workunit.client.1.smithi194.stdout:5/131: read - d2/f23 zero size 2021-11-03T16:54:39.247 INFO:tasks.workunit.client.1.smithi194.stdout:0/49: fdatasync d5/d9/fb 0 2021-11-03T16:54:39.248 INFO:tasks.workunit.client.1.smithi194.stdout:8/84: rmdir d8/d1c 0 2021-11-03T16:54:39.254 INFO:tasks.workunit.client.1.smithi194.stdout:8/85: dread f5 [0,4194304] 0 2021-11-03T16:54:39.256 INFO:tasks.workunit.client.1.smithi194.stdout:6/89: rename de/f13 to de/f17 0 2021-11-03T16:54:39.267 INFO:tasks.workunit.client.1.smithi194.stdout:2/283: dwrite d6/d21/d2a/d35/f52 [0,4194304] 0 2021-11-03T16:54:39.267 INFO:tasks.workunit.client.1.smithi194.stdout:2/284: chown d6/d1f/l2c 770 1 2021-11-03T16:54:39.267 INFO:tasks.workunit.client.1.smithi194.stdout:2/285: fsync d6/d21/d2a/d31/f3d 0 2021-11-03T16:54:39.268 INFO:tasks.workunit.client.1.smithi194.stdout:2/286: mknod d6/de/c55 1 2021-11-03T16:54:39.269 INFO:tasks.workunit.client.1.smithi194.stdout:5/132: dwrite d2/dd/f14 [0,4194304] 0 2021-11-03T16:54:39.269 INFO:tasks.workunit.client.1.smithi194.stdout:5/133: write d2/dd/f14 [2868357,66917] 0 2021-11-03T16:54:39.274 INFO:tasks.workunit.client.1.smithi194.stdout:0/50: creat d5/fc x:0 0 0 2021-11-03T16:54:39.277 INFO:tasks.workunit.client.1.smithi194.stdout:8/86: unlink d8/l18 0 2021-11-03T16:54:39.279 INFO:tasks.workunit.client.1.smithi194.stdout:6/90: rmdir de 39 2021-11-03T16:54:39.281 INFO:tasks.workunit.client.1.smithi194.stdout:3/129: symlink d2/l29 0 2021-11-03T16:54:39.284 INFO:tasks.workunit.client.1.smithi194.stdout:2/287: rename d6/d21/d2a/d35/d3c/f4e to d6/d21/d2a/d31/f56 0 2021-11-03T16:54:39.284 INFO:tasks.workunit.client.1.smithi194.stdout:2/288: write d6/d1f/f39 [620606,87075] 0 2021-11-03T16:54:39.291 INFO:tasks.workunit.client.1.smithi194.stdout:5/134: getdents d2/d3 0 2021-11-03T16:54:39.291 INFO:tasks.workunit.client.1.smithi194.stdout:5/135: chown f0 4365039 1 2021-11-03T16:54:39.291 INFO:tasks.workunit.client.1.smithi194.stdout:5/136: truncate d2/f23 910106 0 2021-11-03T16:54:39.297 INFO:tasks.workunit.client.1.smithi194.stdout:8/87: mknod d8/c1d 1 2021-11-03T16:54:39.300 INFO:tasks.workunit.client.1.smithi194.stdout:6/91: symlink de/l18 0 2021-11-03T16:54:39.301 INFO:tasks.workunit.client.1.smithi194.stdout:3/130: symlink d2/d17/d1d/l2a 0 2021-11-03T16:54:39.302 INFO:tasks.workunit.client.1.smithi194.stdout:5/137: dread d2/dd/f14 [0,4194304] 0 2021-11-03T16:54:39.303 INFO:tasks.workunit.client.1.smithi194.stdout:5/138: dread d2/f23 [0,4194304] 0 2021-11-03T16:54:39.305 INFO:tasks.workunit.client.1.smithi194.stdout:0/51: unlink d5/fc 0 2021-11-03T16:54:39.309 INFO:tasks.workunit.client.1.smithi194.stdout:8/88: creat d8/f1e x:0 0 0 2021-11-03T16:54:39.311 INFO:tasks.workunit.client.1.smithi194.stdout:6/92: creat de/f19 x:0 0 0 2021-11-03T16:54:39.313 INFO:tasks.workunit.client.1.smithi194.stdout:3/131: write d2/f4 [1885731,120026] 0 2021-11-03T16:54:39.315 INFO:tasks.workunit.client.1.smithi194.stdout:5/139: rmdir d2/d2a 39 2021-11-03T16:54:39.316 INFO:tasks.workunit.client.1.smithi194.stdout:5/140: dread d2/d3/f1a [0,4194304] 0 2021-11-03T16:54:39.317 INFO:tasks.workunit.client.1.smithi194.stdout:0/52: symlink d5/d6/ld 0 2021-11-03T16:54:39.320 INFO:tasks.workunit.client.1.smithi194.stdout:8/89: creat d8/f1f x:0 0 0 2021-11-03T16:54:39.321 INFO:tasks.workunit.client.1.smithi194.stdout:6/93: creat de/f1a x:0 0 0 2021-11-03T16:54:39.322 INFO:tasks.workunit.client.1.smithi194.stdout:2/289: dwrite d6/fb [0,4194304] 0 2021-11-03T16:54:39.323 INFO:tasks.workunit.client.1.smithi194.stdout:0/53: fdatasync f3 0 2021-11-03T16:54:39.324 INFO:tasks.workunit.client.1.smithi194.stdout:0/54: mknod d5/ce 1 2021-11-03T16:54:39.324 INFO:tasks.workunit.client.1.smithi194.stdout:3/132: symlink d2/d17/l2b 0 2021-11-03T16:54:39.325 INFO:tasks.workunit.client.1.smithi194.stdout:5/141: creat d2/f33 x:0 0 0 2021-11-03T16:54:39.326 INFO:tasks.workunit.client.1.smithi194.stdout:8/90: mknod d8/c20 1 2021-11-03T16:54:39.327 INFO:tasks.workunit.client.1.smithi194.stdout:8/91: readlink l4 0 2021-11-03T16:54:39.328 INFO:tasks.workunit.client.1.smithi194.stdout:6/94: truncate f9 3729769 0 2021-11-03T16:54:39.329 INFO:tasks.workunit.client.1.smithi194.stdout:3/133: dread d2/d20/f25 [0,4194304] 0 2021-11-03T16:54:39.329 INFO:tasks.workunit.client.1.smithi194.stdout:3/134: write d2/f6 [3483412,9113] 0 2021-11-03T16:54:39.330 INFO:tasks.workunit.client.1.smithi194.stdout:5/142: dread d2/dd/f27 [0,4194304] 0 2021-11-03T16:54:39.331 INFO:tasks.workunit.client.1.smithi194.stdout:0/55: creat d5/d6/ff x:0 0 0 2021-11-03T16:54:39.341 INFO:tasks.workunit.client.1.smithi194.stdout:8/92: mknod d8/c21 1 2021-11-03T16:54:39.345 INFO:tasks.workunit.client.1.smithi194.stdout:6/95: getdents de 0 2021-11-03T16:54:39.345 INFO:tasks.workunit.client.1.smithi194.stdout:6/96: fsync de/f14 0 2021-11-03T16:54:39.361 INFO:tasks.workunit.client.1.smithi194.stdout:2/290: dwrite d6/f44 [4194304,4194304] 0 2021-11-03T16:54:39.362 INFO:tasks.workunit.client.1.smithi194.stdout:2/291: dread - d6/d21/d2a/d31/f56 zero size 2021-11-03T16:54:39.362 INFO:tasks.workunit.client.1.smithi194.stdout:2/292: read d6/d1f/f39 [507944,63624] 0 2021-11-03T16:54:39.363 INFO:tasks.workunit.client.1.smithi194.stdout:6/97: dwrite de/f1a [0,4194304] 0 2021-11-03T16:54:39.363 INFO:tasks.workunit.client.1.smithi194.stdout:6/98: fsync de/f19 0 2021-11-03T16:54:39.364 INFO:tasks.workunit.client.1.smithi194.stdout:6/99: dread de/f16 [0,4194304] 0 2021-11-03T16:54:39.396 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.400+0000 7f7472726700 1 -- 172.21.15.26:0/2161214674 --> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f744c000bc0 con 0x7f745405c2b0 2021-11-03T16:54:39.405 INFO:tasks.workunit.client.1.smithi194.stdout:3/135: rename d2/d17/d1d/l1f to d2/d17/l2c 0 2021-11-03T16:54:39.409 INFO:tasks.workunit.client.1.smithi194.stdout:0/56: symlink d5/d9/l10 0 2021-11-03T16:54:39.409 INFO:tasks.workunit.client.1.smithi194.stdout:0/57: readlink d5/d9/l10 0 2021-11-03T16:54:39.414 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.419+0000 7f7468ff9700 1 -- 172.21.15.26:0/2161214674 <== mgr.14162 v2:172.21.15.26:6800/3029163595 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2662 (secure 0 0 0) 0x7f744c000bc0 con 0x7f745405c2b0 2021-11-03T16:54:39.415 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE VERSION IMAGE ID CONTAINER ID 2021-11-03T16:54:39.415 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (5m) 117s ago 7m 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T16:54:39.415 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (7m) 117s ago 7m 16.2.4 8d91d370c2b8 83a448d79108 2021-11-03T16:54:39.416 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (6m) 2m ago 6m 16.2.4 8d91d370c2b8 708c0ec0397b 2021-11-03T16:54:39.416 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (5m) 117s ago 6m 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T16:54:39.416 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (2m) 117s ago 2m 16.2.4 8d91d370c2b8 0500d47c638e 2021-11-03T16:54:39.417 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (2m) 117s ago 2m 16.2.4 8d91d370c2b8 638170268dac 2021-11-03T16:54:39.417 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (2m) 2m ago 2m 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T16:54:39.417 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (2m) 2m ago 2m 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T16:54:39.418 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:9283 running (8m) 117s ago 8m 16.2.4 8d91d370c2b8 65362b14caeb 2021-11-03T16:54:39.418 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8443,9283 running (6m) 2m ago 6m 16.2.4 8d91d370c2b8 e07291aea712 2021-11-03T16:54:39.418 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (8m) 117s ago 8m 16.2.4 8d91d370c2b8 c37e54308890 2021-11-03T16:54:39.418 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (6m) 2m ago 6m 16.2.4 8d91d370c2b8 b688a2953f0a 2021-11-03T16:54:39.419 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (6m) 117s ago 6m 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T16:54:39.419 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (6m) 2m ago 6m 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T16:54:39.419 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (5m) 117s ago 5m 16.2.4 8d91d370c2b8 d7f900ddf0f3 2021-11-03T16:54:39.419 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (5m) 117s ago 5m 16.2.4 8d91d370c2b8 9e5ffa11984b 2021-11-03T16:54:39.420 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (4m) 117s ago 4m 16.2.4 8d91d370c2b8 f65145633c0e 2021-11-03T16:54:39.420 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (4m) 2m ago 4m 16.2.4 8d91d370c2b8 ff6d474a5f9a 2021-11-03T16:54:39.420 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (4m) 2m ago 4m 16.2.4 8d91d370c2b8 e2fc9c0bdf0f 2021-11-03T16:54:39.420 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (3m) 2m ago 3m 16.2.4 8d91d370c2b8 0abc64d8a2bf 2021-11-03T16:54:39.421 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (5m) 117s ago 6m 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T16:54:39.421 INFO:tasks.workunit.client.1.smithi194.stdout:2/293: creat d6/de/f57 x:0 0 0 2021-11-03T16:54:39.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.422+0000 7f7472726700 1 -- 172.21.15.26:0/2161214674 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f745405c2b0 msgr2=0x7f745405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:54:39.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.422+0000 7f7472726700 1 --2- 172.21.15.26:0/2161214674 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f745405c2b0 0x7f745405e770 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f746c06b730 tx=0x7f745c00b040).stop 2021-11-03T16:54:39.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.422+0000 7f7472726700 1 -- 172.21.15.26:0/2161214674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f746c0f7980 msgr2=0x7f746c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:54:39.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.422+0000 7f7472726700 1 --2- 172.21.15.26:0/2161214674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f746c0f7980 0x7f746c069e20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f7460000c00 tx=0x7f746000b040).stop 2021-11-03T16:54:39.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.422+0000 7f7472726700 1 -- 172.21.15.26:0/2161214674 shutdown_connections 2021-11-03T16:54:39.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.422+0000 7f7472726700 1 --2- 172.21.15.26:0/2161214674 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f745405c2b0 0x7f745405e770 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:39.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.422+0000 7f7472726700 1 --2- 172.21.15.26:0/2161214674 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f746c0f66e0 0x7f746c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:39.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.422+0000 7f7472726700 1 --2- 172.21.15.26:0/2161214674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f746c0f7980 0x7f746c069e20 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:39.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.422+0000 7f7472726700 1 -- 172.21.15.26:0/2161214674 >> 172.21.15.26:0/2161214674 conn(0x7f746c0f1e40 msgr2=0x7f746c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:54:39.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.423+0000 7f7472726700 1 -- 172.21.15.26:0/2161214674 shutdown_connections 2021-11-03T16:54:39.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.423+0000 7f7472726700 1 -- 172.21.15.26:0/2161214674 wait complete. 2021-11-03T16:54:39.425 INFO:tasks.workunit.client.1.smithi194.stdout:6/100: rename de/l18 to de/l1b 0 2021-11-03T16:54:39.425 INFO:tasks.workunit.client.1.smithi194.stdout:6/101: fsync fc 0 2021-11-03T16:54:39.426 INFO:tasks.workunit.client.1.smithi194.stdout:0/58: dwrite d5/d6/ff [0,4194304] 0 2021-11-03T16:54:39.431 INFO:tasks.workunit.client.1.smithi194.stdout:8/93: dwrite d8/f15 [0,4194304] 0 2021-11-03T16:54:39.431 INFO:tasks.workunit.client.1.smithi194.stdout:5/143: rename d2/d3/l13 to d2/dd/d32/l34 0 2021-11-03T16:54:39.433 INFO:tasks.workunit.client.1.smithi194.stdout:3/136: symlink d2/d17/l2d 0 2021-11-03T16:54:39.435 INFO:tasks.workunit.client.1.smithi194.stdout:2/294: creat d6/d21/d43/f58 x:0 0 0 2021-11-03T16:54:39.436 INFO:tasks.workunit.client.1.smithi194.stdout:6/102: rmdir de 39 2021-11-03T16:54:39.446 INFO:tasks.workunit.client.1.smithi194.stdout:0/59: link d5/d6/ld d5/d6/l11 0 2021-11-03T16:54:39.446 INFO:tasks.workunit.client.1.smithi194.stdout:0/60: fdatasync d5/d9/fb 0 2021-11-03T16:54:39.457 INFO:tasks.workunit.client.1.smithi194.stdout:5/144: mkdir d2/dd/d35 0 2021-11-03T16:54:39.458 INFO:tasks.workunit.client.1.smithi194.stdout:3/137: truncate d2/d17/f23 1143147 0 2021-11-03T16:54:39.461 INFO:tasks.workunit.client.1.smithi194.stdout:5/145: dread f0 [0,4194304] 0 2021-11-03T16:54:39.462 INFO:tasks.workunit.client.1.smithi194.stdout:5/146: truncate d2/d3/f2d 863578 0 2021-11-03T16:54:39.462 INFO:tasks.workunit.client.1.smithi194.stdout:5/147: truncate d2/d3/f2d 942920 0 2021-11-03T16:54:39.463 INFO:tasks.workunit.client.1.smithi194.stdout:2/295: unlink d6/d21/d2a/d31/f56 0 2021-11-03T16:54:39.467 INFO:tasks.workunit.client.1.smithi194.stdout:6/103: dread - de/f17 zero size 2021-11-03T16:54:39.469 INFO:tasks.workunit.client.1.smithi194.stdout:0/61: creat d5/d6/f12 x:0 0 0 2021-11-03T16:54:39.469 INFO:tasks.workunit.client.1.smithi194.stdout:0/62: stat d5/d6/la 0 2021-11-03T16:54:39.472 INFO:tasks.workunit.client.1.smithi194.stdout:0/63: dread f3 [4194304,4194304] 0 2021-11-03T16:54:39.472 INFO:tasks.workunit.client.1.smithi194.stdout:8/94: link f5 d8/f22 0 2021-11-03T16:54:39.476 INFO:tasks.workunit.client.1.smithi194.stdout:0/64: write d5/d6/ff [463132,52600] 0 2021-11-03T16:54:39.476 INFO:tasks.workunit.client.1.smithi194.stdout:8/95: mknod d8/c23 1 2021-11-03T16:54:39.477 INFO:tasks.workunit.client.1.smithi194.stdout:3/138: dwrite d2/f13 [0,4194304] 0 2021-11-03T16:54:39.478 INFO:tasks.workunit.client.1.smithi194.stdout:2/296: dread d6/de/d27/f49 [0,4194304] 0 2021-11-03T16:54:39.478 INFO:tasks.workunit.client.1.smithi194.stdout:2/297: fsync d6/d21/d2a/d31/f37 0 2021-11-03T16:54:39.479 INFO:tasks.workunit.client.1.smithi194.stdout:2/298: fdatasync d6/de/d27/f3f 0 2021-11-03T16:54:39.479 INFO:tasks.workunit.client.1.smithi194.stdout:2/299: chown d6/d21/d2a/d31/f3d 1744504 1 2021-11-03T16:54:39.479 INFO:tasks.workunit.client.1.smithi194.stdout:6/104: symlink de/l1c 0 2021-11-03T16:54:39.484 INFO:tasks.workunit.client.1.smithi194.stdout:5/148: dwrite d2/dd/f16 [0,4194304] 0 2021-11-03T16:54:39.488 INFO:tasks.workunit.client.1.smithi194.stdout:3/139: creat d2/d17/f2e x:0 0 0 2021-11-03T16:54:39.489 INFO:tasks.workunit.client.1.smithi194.stdout:0/65: rename d5/d6 to d5/d13 0 2021-11-03T16:54:39.494 INFO:tasks.workunit.client.1.smithi194.stdout:2/300: symlink d6/d21/d43/l59 0 2021-11-03T16:54:39.496 INFO:tasks.workunit.client.1.smithi194.stdout:6/105: rmdir de 39 2021-11-03T16:54:39.498 INFO:tasks.workunit.client.1.smithi194.stdout:8/96: mkdir d8/d24 0 2021-11-03T16:54:39.499 INFO:tasks.workunit.client.1.smithi194.stdout:0/66: dread d5/d13/ff [0,4194304] 0 2021-11-03T16:54:39.500 INFO:tasks.workunit.client.1.smithi194.stdout:5/149: link d2/d3/f29 d2/dd/d35/f36 0 2021-11-03T16:54:39.501 INFO:tasks.workunit.client.1.smithi194.stdout:3/140: mknod d2/c2f 1 2021-11-03T16:54:39.503 INFO:tasks.workunit.client.1.smithi194.stdout:2/301: creat d6/de/d27/f5a x:0 0 0 2021-11-03T16:54:39.503 INFO:tasks.workunit.client.1.smithi194.stdout:2/302: stat d6/d17/d26/f32 0 2021-11-03T16:54:39.510 INFO:tasks.workunit.client.1.smithi194.stdout:0/67: rename d5/d13/ff to d5/f14 0 2021-11-03T16:54:39.510 INFO:tasks.workunit.client.1.smithi194.stdout:0/68: fdatasync f3 0 2021-11-03T16:54:39.511 INFO:tasks.workunit.client.1.smithi194.stdout:5/150: rmdir d2/d3 39 2021-11-03T16:54:39.511 INFO:tasks.workunit.client.1.smithi194.stdout:5/151: truncate d2/dd/f27 1184844 0 2021-11-03T16:54:39.512 INFO:tasks.workunit.client.1.smithi194.stdout:5/152: stat d2/d2a 0 2021-11-03T16:54:39.513 INFO:tasks.workunit.client.1.smithi194.stdout:6/106: unlink de/f14 0 2021-11-03T16:54:39.513 INFO:tasks.workunit.client.1.smithi194.stdout:6/107: write de/f17 [686249,1396] 0 2021-11-03T16:54:39.516 INFO:tasks.workunit.client.1.smithi194.stdout:8/97: rename d8/f15 to d8/f25 0 2021-11-03T16:54:39.516 INFO:tasks.workunit.client.1.smithi194.stdout:3/141: dwrite d2/f13 [4194304,4194304] 0 2021-11-03T16:54:39.516 INFO:tasks.workunit.client.1.smithi194.stdout:3/142: dread - d2/d17/f2e zero size 2021-11-03T16:54:39.522 INFO:tasks.workunit.client.1.smithi194.stdout:0/69: rename d5/d13/ld to d5/l15 0 2021-11-03T16:54:39.524 INFO:tasks.workunit.client.1.smithi194.stdout:5/153: symlink d2/dd/d35/l37 0 2021-11-03T16:54:39.526 INFO:tasks.workunit.client.1.smithi194.stdout:6/108: unlink f8 0 2021-11-03T16:54:39.531 INFO:tasks.workunit.client.1.smithi194.stdout:0/70: dread f3 [0,4194304] 0 2021-11-03T16:54:39.532 INFO:tasks.workunit.client.1.smithi194.stdout:5/154: dread d2/f24 [0,4194304] 0 2021-11-03T16:54:39.533 INFO:tasks.workunit.client.1.smithi194.stdout:3/143: getdents d2 0 2021-11-03T16:54:39.534 INFO:tasks.workunit.client.1.smithi194.stdout:3/144: chown d2/d17 24333264 1 2021-11-03T16:54:39.539 INFO:tasks.workunit.client.1.smithi194.stdout:8/98: symlink d8/l26 0 2021-11-03T16:54:39.540 INFO:tasks.workunit.client.1.smithi194.stdout:5/155: dread d2/dd/d35/f36 [0,4194304] 0 2021-11-03T16:54:39.541 INFO:tasks.workunit.client.1.smithi194.stdout:5/156: dread d2/d3/f2d [0,4194304] 0 2021-11-03T16:54:39.548 INFO:tasks.workunit.client.1.smithi194.stdout:3/145: dwrite d2/f13 [8388608,4194304] 0 2021-11-03T16:54:39.550 INFO:tasks.workunit.client.1.smithi194.stdout:0/71: unlink d5/d9/l10 0 2021-11-03T16:54:39.553 INFO:tasks.workunit.client.1.smithi194.stdout:8/99: mknod d8/c27 1 2021-11-03T16:54:39.558 INFO:tasks.workunit.client.1.smithi194.stdout:6/109: rmdir de 39 2021-11-03T16:54:39.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.565+0000 7f97ab7a7700 1 -- 172.21.15.26:0/3024290652 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97a40f8610 msgr2=0x7f97a40f4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:54:39.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.565+0000 7f97ab7a7700 1 --2- 172.21.15.26:0/3024290652 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97a40f8610 0x7f97a40f4820 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f9794004660 tx=0x7f9794009b30).stop 2021-11-03T16:54:39.562 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.566+0000 7f97ab7a7700 1 -- 172.21.15.26:0/3024290652 shutdown_connections 2021-11-03T16:54:39.562 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.566+0000 7f97ab7a7700 1 --2- 172.21.15.26:0/3024290652 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97a40f8610 0x7f97a40f4820 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:39.562 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.566+0000 7f97ab7a7700 1 --2- 172.21.15.26:0/3024290652 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97a40f7d00 0x7f97a40f8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:39.563 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.566+0000 7f97ab7a7700 1 -- 172.21.15.26:0/3024290652 >> 172.21.15.26:0/3024290652 conn(0x7f97a40f0540 msgr2=0x7f97a40f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:54:39.564 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.566+0000 7f97ab7a7700 1 -- 172.21.15.26:0/3024290652 shutdown_connections 2021-11-03T16:54:39.564 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.566+0000 7f97ab7a7700 1 -- 172.21.15.26:0/3024290652 wait complete. 2021-11-03T16:54:39.566 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.566+0000 7f97ab7a7700 1 Processor -- start 2021-11-03T16:54:39.566 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.566+0000 7f97ab7a7700 1 -- start start 2021-11-03T16:54:39.566 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.567+0000 7f97ab7a7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97a40f7d00 0x7f97a40f75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:54:39.567 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.567+0000 7f97ab7a7700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97a40f8610 0x7f97a40f5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:54:39.567 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.567+0000 7f97ab7a7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a40f5fb0 con 0x7f97a40f7d00 2021-11-03T16:54:39.567 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.567+0000 7f97ab7a7700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a40f60f0 con 0x7f97a40f8610 2021-11-03T16:54:39.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.567+0000 7f97a9543700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97a40f7d00 0x7f97a40f75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:54:39.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.567+0000 7f97a9543700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97a40f7d00 0x7f97a40f75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50428/0 (socket says 172.21.15.26:50428) 2021-11-03T16:54:39.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.567+0000 7f97a8d42700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97a40f8610 0x7f97a40f5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:54:39.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.567+0000 7f97a9543700 1 -- 172.21.15.26:0/2586061156 learned_addr learned my addr 172.21.15.26:0/2586061156 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:54:39.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.567+0000 7f97a9543700 1 -- 172.21.15.26:0/2586061156 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97a40f8610 msgr2=0x7f97a40f5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:54:39.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.567+0000 7f97a9543700 1 --2- 172.21.15.26:0/2586061156 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97a40f8610 0x7f97a40f5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:39.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.567+0000 7f97a9543700 1 -- 172.21.15.26:0/2586061156 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a0005040 con 0x7f97a40f7d00 2021-11-03T16:54:39.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.567+0000 7f97a9543700 1 --2- 172.21.15.26:0/2586061156 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97a40f7d00 0x7f97a40f75d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f97a0004870 tx=0x7f97a0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:54:39.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.567+0000 7f9799ffb700 1 -- 172.21.15.26:0/2586061156 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97a000e030 con 0x7f97a40f7d00 2021-11-03T16:54:39.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.567+0000 7f9799ffb700 1 -- 172.21.15.26:0/2586061156 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f97a000f040 con 0x7f97a40f7d00 2021-11-03T16:54:39.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.567+0000 7f97ab7a7700 1 -- 172.21.15.26:0/2586061156 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9794005040 con 0x7f97a40f7d00 2021-11-03T16:54:39.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.568+0000 7f97ab7a7700 1 -- 172.21.15.26:0/2586061156 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97a40f6800 con 0x7f97a40f7d00 2021-11-03T16:54:39.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.568+0000 7f9799ffb700 1 -- 172.21.15.26:0/2586061156 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97a0014860 con 0x7f97a40f7d00 2021-11-03T16:54:39.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.569+0000 7f97ab7a7700 1 -- 172.21.15.26:0/2586061156 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9784004fa0 con 0x7f97a40f7d00 2021-11-03T16:54:39.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.569+0000 7f9799ffb700 1 -- 172.21.15.26:0/2586061156 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f97a0010500 con 0x7f97a40f7d00 2021-11-03T16:54:39.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.570+0000 7f9799ffb700 1 --2- 172.21.15.26:0/2586061156 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f979005c2b0 0x7f979005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:54:39.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.570+0000 7f9799ffb700 1 -- 172.21.15.26:0/2586061156 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f97a0076480 con 0x7f97a40f7d00 2021-11-03T16:54:39.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.574+0000 7f97a8d42700 1 --2- 172.21.15.26:0/2586061156 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f979005c2b0 0x7f979005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:54:39.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.574+0000 7f97a8d42700 1 --2- 172.21.15.26:0/2586061156 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f979005c2b0 0x7f979005e770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f9794005010 tx=0x7f9794016040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:54:39.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.575+0000 7f9799ffb700 1 -- 172.21.15.26:0/2586061156 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f97a0049160 con 0x7f97a40f7d00 2021-11-03T16:54:39.577 INFO:tasks.workunit.client.1.smithi194.stdout:3/146: stat d2/l1a 0 2021-11-03T16:54:39.578 INFO:tasks.workunit.client.1.smithi194.stdout:5/157: dwrite d2/d3/fc [0,4194304] 0 2021-11-03T16:54:39.579 INFO:tasks.workunit.client.1.smithi194.stdout:5/158: write d2/dd/f27 [356668,49312] 0 2021-11-03T16:54:39.579 INFO:tasks.workunit.client.1.smithi194.stdout:5/159: chown d2/dd/f27 120 1 2021-11-03T16:54:39.580 INFO:tasks.workunit.client.1.smithi194.stdout:5/160: write d2/dd/f14 [3911002,30617] 0 2021-11-03T16:54:39.580 INFO:tasks.workunit.client.1.smithi194.stdout:5/161: write d2/dd/f20 [1059480,88076] 0 2021-11-03T16:54:39.580 INFO:tasks.workunit.client.1.smithi194.stdout:5/162: dread d2/dd/d35/f36 [0,4194304] 0 2021-11-03T16:54:39.581 INFO:tasks.workunit.client.1.smithi194.stdout:0/72: rename d5/f14 to d5/d9/f16 0 2021-11-03T16:54:39.581 INFO:tasks.workunit.client.1.smithi194.stdout:8/100: symlink d8/d24/l28 0 2021-11-03T16:54:39.582 INFO:tasks.workunit.client.1.smithi194.stdout:8/101: truncate d8/f1f 49303 0 2021-11-03T16:54:39.583 INFO:tasks.workunit.client.1.smithi194.stdout:5/163: dread d2/dd/f1b [4194304,4194304] 0 2021-11-03T16:54:39.583 INFO:tasks.workunit.client.1.smithi194.stdout:5/164: chown d2/d2a 0 1 2021-11-03T16:54:39.584 INFO:tasks.workunit.client.1.smithi194.stdout:5/165: write d2/dd/f27 [2113023,78597] 0 2021-11-03T16:54:39.585 INFO:tasks.workunit.client.1.smithi194.stdout:0/73: dwrite d5/d13/f12 [0,4194304] 0 2021-11-03T16:54:39.613 INFO:tasks.workunit.client.1.smithi194.stdout:3/147: creat d2/d17/f30 x:0 0 0 2021-11-03T16:54:39.624 INFO:tasks.workunit.client.1.smithi194.stdout:8/102: creat d8/d24/f29 x:0 0 0 2021-11-03T16:54:39.625 INFO:tasks.workunit.client.1.smithi194.stdout:8/103: dread - f7 zero size 2021-11-03T16:54:39.625 INFO:tasks.workunit.client.1.smithi194.stdout:8/104: chown d8/d24/l28 26 1 2021-11-03T16:54:39.626 INFO:tasks.workunit.client.1.smithi194.stdout:5/166: mkdir d2/dd/d35/d38 0 2021-11-03T16:54:39.636 INFO:tasks.workunit.client.1.smithi194.stdout:0/74: mkdir d5/d17 0 2021-11-03T16:54:39.643 INFO:tasks.workunit.client.1.smithi194.stdout:6/110: symlink de/l1d 0 2021-11-03T16:54:39.644 INFO:tasks.workunit.client.1.smithi194.stdout:6/111: dread de/f17 [0,4194304] 0 2021-11-03T16:54:39.645 INFO:tasks.workunit.client.1.smithi194.stdout:3/148: creat d2/d17/d1d/f31 x:0 0 0 2021-11-03T16:54:39.646 INFO:tasks.workunit.client.1.smithi194.stdout:3/149: fsync d2/d17/f2e 0 2021-11-03T16:54:39.646 INFO:tasks.workunit.client.1.smithi194.stdout:3/150: readlink d2/d17/l2b 0 2021-11-03T16:54:39.649 INFO:tasks.workunit.client.1.smithi194.stdout:5/167: mkdir d2/d2a/d39 0 2021-11-03T16:54:39.651 INFO:tasks.workunit.client.1.smithi194.stdout:0/75: rename d5/d9/f16 to d5/d9/f18 0 2021-11-03T16:54:39.653 INFO:tasks.workunit.client.1.smithi194.stdout:6/112: creat de/f1e x:0 0 0 2021-11-03T16:54:39.655 INFO:tasks.workunit.client.1.smithi194.stdout:8/105: rename d8/f25 to d8/f2a 0 2021-11-03T16:54:39.674 INFO:tasks.workunit.client.1.smithi194.stdout:5/168: symlink d2/d2a/d39/l3a 0 2021-11-03T16:54:39.674 INFO:tasks.workunit.client.1.smithi194.stdout:5/169: stat d2/d3/f22 0 2021-11-03T16:54:39.675 INFO:tasks.workunit.client.1.smithi194.stdout:0/76: rmdir d5/d9 39 2021-11-03T16:54:39.685 INFO:tasks.workunit.client.1.smithi194.stdout:6/113: mkdir de/d1f 0 2021-11-03T16:54:39.685 INFO:tasks.workunit.client.1.smithi194.stdout:6/114: stat de/d1f 0 2021-11-03T16:54:39.687 INFO:tasks.workunit.client.1.smithi194.stdout:8/106: link l4 d8/l2b 0 2021-11-03T16:54:39.690 INFO:tasks.workunit.client.1.smithi194.stdout:6/115: read de/f12 [6015,44971] 0 2021-11-03T16:54:39.690 INFO:tasks.workunit.client.1.smithi194.stdout:5/170: dwrite d2/dd/f1b [0,4194304] 0 2021-11-03T16:54:39.691 INFO:tasks.workunit.client.1.smithi194.stdout:5/171: dread d2/f23 [0,4194304] 0 2021-11-03T16:54:39.693 INFO:tasks.workunit.client.1.smithi194.stdout:8/107: rename f7 to d8/f2c 0 2021-11-03T16:54:39.694 INFO:tasks.workunit.client.1.smithi194.stdout:8/108: write d8/fb [2653107,130608] 0 2021-11-03T16:54:39.695 INFO:tasks.workunit.client.1.smithi194.stdout:8/109: mknod d8/d24/c2d 1 2021-11-03T16:54:39.696 INFO:tasks.workunit.client.1.smithi194.stdout:5/172: symlink d2/dd/d35/d38/l3b 0 2021-11-03T16:54:39.697 INFO:tasks.workunit.client.1.smithi194.stdout:8/110: creat d8/f2e x:0 0 0 2021-11-03T16:54:39.700 INFO:tasks.workunit.client.1.smithi194.stdout:6/116: unlink de/f11 0 2021-11-03T16:54:39.703 INFO:tasks.workunit.client.1.smithi194.stdout:5/173: link d2/f1f d2/dd/f3c 0 2021-11-03T16:54:39.704 INFO:tasks.workunit.client.1.smithi194.stdout:8/111: creat d8/f2f x:0 0 0 2021-11-03T16:54:39.706 INFO:tasks.workunit.client.1.smithi194.stdout:6/117: symlink de/d1f/l20 0 2021-11-03T16:54:39.708 INFO:tasks.workunit.client.1.smithi194.stdout:5/174: link d2/dd/l25 d2/dd/d35/d38/l3d 0 2021-11-03T16:54:39.714 INFO:tasks.workunit.client.1.smithi194.stdout:5/175: creat d2/d2a/d39/f3e x:0 0 0 2021-11-03T16:54:39.714 INFO:tasks.workunit.client.1.smithi194.stdout:5/176: mknod d2/d2a/d39/c3f 1 2021-11-03T16:54:39.714 INFO:tasks.workunit.client.1.smithi194.stdout:5/177: chown d2/d3/f1a 0 1 2021-11-03T16:54:39.715 INFO:tasks.workunit.client.1.smithi194.stdout:8/112: link d8/f9 d8/d24/f30 0 2021-11-03T16:54:39.720 INFO:tasks.workunit.client.1.smithi194.stdout:6/118: dwrite de/f17 [0,4194304] 0 2021-11-03T16:54:39.724 INFO:tasks.workunit.client.1.smithi194.stdout:6/119: dread - de/f19 zero size 2021-11-03T16:54:39.745 INFO:tasks.workunit.client.1.smithi194.stdout:5/178: truncate d2/dd/f16 4918667 0 2021-11-03T16:54:39.751 INFO:tasks.workunit.client.1.smithi194.stdout:5/179: creat d2/d2a/d39/f40 x:0 0 0 2021-11-03T16:54:39.754 INFO:tasks.workunit.client.1.smithi194.stdout:5/180: creat d2/d3/f41 x:0 0 0 2021-11-03T16:54:39.754 INFO:tasks.workunit.client.1.smithi194.stdout:5/181: mknod d2/dd/c42 1 2021-11-03T16:54:39.755 INFO:tasks.workunit.client.1.smithi194.stdout:6/120: dwrite de/f10 [0,4194304] 0 2021-11-03T16:54:39.755 INFO:tasks.workunit.client.1.smithi194.stdout:8/113: dwrite d8/f12 [0,4194304] 0 2021-11-03T16:54:39.761 INFO:tasks.workunit.client.1.smithi194.stdout:6/121: rmdir de/d1f 39 2021-11-03T16:54:39.761 INFO:tasks.workunit.client.1.smithi194.stdout:6/122: stat f9 0 2021-11-03T16:54:39.764 INFO:tasks.workunit.client.1.smithi194.stdout:8/114: creat d8/f31 x:0 0 0 2021-11-03T16:54:39.766 INFO:tasks.workunit.client.1.smithi194.stdout:5/182: fsync d2/d2a/d39/f40 0 2021-11-03T16:54:39.769 INFO:tasks.workunit.client.1.smithi194.stdout:8/115: truncate d8/f17 108127 0 2021-11-03T16:54:39.770 INFO:tasks.workunit.client.1.smithi194.stdout:6/123: dread de/f12 [0,4194304] 0 2021-11-03T16:54:39.770 INFO:tasks.workunit.client.1.smithi194.stdout:6/124: readlink de/d1f/l20 0 2021-11-03T16:54:39.772 INFO:tasks.workunit.client.1.smithi194.stdout:5/183: link d2/dd/d35/d38/l3d d2/d2a/d39/l43 0 2021-11-03T16:54:39.772 INFO:tasks.workunit.client.1.smithi194.stdout:5/184: chown d2/dd/d32/l34 4 1 2021-11-03T16:54:39.772 INFO:tasks.workunit.client.1.smithi194.stdout:5/185: write d2/f21 [486671,121843] 0 2021-11-03T16:54:39.775 INFO:tasks.workunit.client.1.smithi194.stdout:6/125: dread de/f16 [0,4194304] 0 2021-11-03T16:54:39.777 INFO:tasks.workunit.client.1.smithi194.stdout:5/186: rmdir d2/d3 39 2021-11-03T16:54:39.777 INFO:tasks.workunit.client.1.smithi194.stdout:5/187: read d2/d3/f22 [2937458,12381] 0 2021-11-03T16:54:39.779 INFO:tasks.workunit.client.1.smithi194.stdout:8/116: rename d8/f12 to d8/d24/f32 0 2021-11-03T16:54:39.791 INFO:tasks.workunit.client.1.smithi194.stdout:6/126: mkdir de/d21 0 2021-11-03T16:54:39.793 INFO:tasks.workunit.client.1.smithi194.stdout:6/127: symlink de/d1f/l22 0 2021-11-03T16:54:39.794 INFO:tasks.workunit.client.1.smithi194.stdout:6/128: chown de/f16 2506 1 2021-11-03T16:54:39.794 INFO:tasks.workunit.client.1.smithi194.stdout:6/129: dread - de/f1e zero size 2021-11-03T16:54:39.794 INFO:tasks.workunit.client.1.smithi194.stdout:6/130: truncate de/f17 4463116 0 2021-11-03T16:54:39.796 INFO:tasks.workunit.client.1.smithi194.stdout:6/131: creat de/d21/f23 x:0 0 0 2021-11-03T16:54:39.796 INFO:tasks.workunit.client.1.smithi194.stdout:6/132: write de/f19 [854331,1233] 0 2021-11-03T16:54:39.798 INFO:tasks.workunit.client.1.smithi194.stdout:6/133: creat de/f24 x:0 0 0 2021-11-03T16:54:39.798 INFO:tasks.workunit.client.1.smithi194.stdout:6/134: chown de/f16 0 1 2021-11-03T16:54:39.798 INFO:tasks.workunit.client.1.smithi194.stdout:6/135: fsync de/f16 0 2021-11-03T16:54:39.800 INFO:tasks.workunit.client.1.smithi194.stdout:6/136: read de/f1a [2250153,8403] 0 2021-11-03T16:54:39.804 INFO:tasks.workunit.client.1.smithi194.stdout:6/137: rename de/l1b to de/l25 0 2021-11-03T16:54:39.822 INFO:tasks.workunit.client.1.smithi194.stdout:6/138: dread de/f12 [0,4194304] 0 2021-11-03T16:54:39.824 INFO:tasks.workunit.client.1.smithi194.stdout:8/117: dwrite f5 [0,4194304] 0 2021-11-03T16:54:39.824 INFO:tasks.workunit.client.1.smithi194.stdout:8/118: fsync d8/fc 0 2021-11-03T16:54:39.825 INFO:tasks.workunit.client.1.smithi194.stdout:6/139: mkdir de/d1f/d26 0 2021-11-03T16:54:39.826 INFO:tasks.workunit.client.1.smithi194.stdout:6/140: write f9 [3785393,18076] 0 2021-11-03T16:54:39.844 INFO:tasks.workunit.client.1.smithi194.stdout:6/141: creat de/d21/f27 x:0 0 0 2021-11-03T16:54:39.849 INFO:tasks.workunit.client.1.smithi194.stdout:8/119: mkdir d8/d33 0 2021-11-03T16:54:39.852 INFO:tasks.workunit.client.1.smithi194.stdout:6/142: creat de/f28 x:0 0 0 2021-11-03T16:54:39.857 INFO:tasks.workunit.client.1.smithi194.stdout:6/143: truncate de/f12 2958655 0 2021-11-03T16:54:39.864 INFO:tasks.workunit.client.1.smithi194.stdout:6/144: symlink de/d21/l29 0 2021-11-03T16:54:39.869 INFO:tasks.workunit.client.1.smithi194.stdout:8/120: dwrite d8/f13 [0,4194304] 0 2021-11-03T16:54:39.880 INFO:tasks.workunit.client.1.smithi194.stdout:6/145: dwrite de/f19 [0,4194304] 0 2021-11-03T16:54:39.881 INFO:tasks.workunit.client.1.smithi194.stdout:6/146: chown de/f24 32114 1 2021-11-03T16:54:39.895 INFO:tasks.workunit.client.1.smithi194.stdout:8/121: truncate d8/fc 3313499 0 2021-11-03T16:54:39.896 INFO:tasks.workunit.client.1.smithi194.stdout:8/122: mknod d8/d24/c34 1 2021-11-03T16:54:39.898 INFO:tasks.workunit.client.1.smithi194.stdout:6/147: creat de/d21/f2a x:0 0 0 2021-11-03T16:54:39.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.903+0000 7f97ab7a7700 1 -- 172.21.15.26:0/2586061156 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9784005e80 con 0x7f97a40f7d00 2021-11-03T16:54:39.901 INFO:tasks.workunit.client.1.smithi194.stdout:8/123: write d8/f13 [1553089,83578] 0 2021-11-03T16:54:39.901 INFO:tasks.workunit.client.1.smithi194.stdout:6/148: creat de/d21/f2b x:0 0 0 2021-11-03T16:54:39.902 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T16:54:39.902 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T16:54:39.903 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2021-11-03T16:54:39.903 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:54:39.903 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T16:54:39.903 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2021-11-03T16:54:39.904 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:54:39.904 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T16:54:39.904 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2021-11-03T16:54:39.904 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:54:39.905 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T16:54:39.905 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T16:54:39.905 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:54:39.905 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T16:54:39.906 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 14 2021-11-03T16:54:39.906 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T16:54:39.906 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T16:54:39.907 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.905+0000 7f9799ffb700 1 -- 172.21.15.26:0/2586061156 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+573 (secure 0 0 0) 0x7f97a004c780 con 0x7f97a40f7d00 2021-11-03T16:54:39.907 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.907+0000 7f97ab7a7700 1 -- 172.21.15.26:0/2586061156 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f979005c2b0 msgr2=0x7f979005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:54:39.907 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.907+0000 7f97ab7a7700 1 --2- 172.21.15.26:0/2586061156 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f979005c2b0 0x7f979005e770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f9794005010 tx=0x7f9794016040).stop 2021-11-03T16:54:39.907 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.907+0000 7f97ab7a7700 1 -- 172.21.15.26:0/2586061156 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97a40f7d00 msgr2=0x7f97a40f75d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:54:39.908 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.907+0000 7f97ab7a7700 1 --2- 172.21.15.26:0/2586061156 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97a40f7d00 0x7f97a40f75d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f97a0004870 tx=0x7f97a0009b30).stop 2021-11-03T16:54:39.908 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.908+0000 7f97ab7a7700 1 -- 172.21.15.26:0/2586061156 shutdown_connections 2021-11-03T16:54:39.909 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.908+0000 7f97ab7a7700 1 --2- 172.21.15.26:0/2586061156 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f979005c2b0 0x7f979005e770 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:39.909 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.908+0000 7f97ab7a7700 1 --2- 172.21.15.26:0/2586061156 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97a40f7d00 0x7f97a40f75d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:39.909 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.908+0000 7f97ab7a7700 1 --2- 172.21.15.26:0/2586061156 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97a40f8610 0x7f97a40f5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:39.909 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.908+0000 7f97ab7a7700 1 -- 172.21.15.26:0/2586061156 >> 172.21.15.26:0/2586061156 conn(0x7f97a40f0540 msgr2=0x7f97a40fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:54:39.910 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.909+0000 7f97ab7a7700 1 -- 172.21.15.26:0/2586061156 shutdown_connections 2021-11-03T16:54:39.910 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:39.909+0000 7f97ab7a7700 1 -- 172.21.15.26:0/2586061156 wait complete. 2021-11-03T16:54:39.910 INFO:tasks.workunit.client.1.smithi194.stdout:6/149: symlink de/d21/l2c 0 2021-11-03T16:54:39.911 INFO:tasks.workunit.client.1.smithi194.stdout:8/124: mkdir d8/d35 0 2021-11-03T16:54:39.911 INFO:tasks.workunit.client.1.smithi194.stdout:8/125: write d8/f2e [352849,115346] 0 2021-11-03T16:54:39.913 INFO:tasks.workunit.client.1.smithi194.stdout:8/126: symlink d8/d24/l36 0 2021-11-03T16:54:39.913 INFO:tasks.workunit.client.1.smithi194.stdout:8/127: write d8/f2c [455009,114684] 0 2021-11-03T16:54:39.917 INFO:tasks.workunit.client.1.smithi194.stdout:6/150: dread de/f10 [0,4194304] 0 2021-11-03T16:54:39.917 INFO:tasks.workunit.client.1.smithi194.stdout:6/151: truncate de/f1e 276197 0 2021-11-03T16:54:39.934 INFO:tasks.workunit.client.1.smithi194.stdout:6/152: mkdir de/d21/d2d 0 2021-11-03T16:54:39.963 INFO:tasks.workunit.client.1.smithi194.stdout:4/75: sync 2021-11-03T16:54:39.963 INFO:tasks.workunit.client.1.smithi194.stdout:6/153: dwrite de/d21/f2a [0,4194304] 0 2021-11-03T16:54:39.977 INFO:tasks.workunit.client.1.smithi194.stdout:4/76: dwrite d6/d10/d14/f11 [0,4194304] 0 2021-11-03T16:54:40.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.026+0000 7f06b6892700 1 -- 172.21.15.26:0/749304143 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06b00f6860 msgr2=0x7f06b00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:54:40.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.026+0000 7f06b6892700 1 --2- 172.21.15.26:0/749304143 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06b00f6860 0x7f06b00f6cc0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f06a4004660 tx=0x7f06a4009b30).stop 2021-11-03T16:54:40.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.026+0000 7f06b6892700 1 -- 172.21.15.26:0/749304143 shutdown_connections 2021-11-03T16:54:40.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.026+0000 7f06b6892700 1 --2- 172.21.15.26:0/749304143 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06b00f6860 0x7f06b00f6cc0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:40.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.026+0000 7f06b6892700 1 --2- 172.21.15.26:0/749304143 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f06b00f55c0 0x7f06b00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:40.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.026+0000 7f06b6892700 1 -- 172.21.15.26:0/749304143 >> 172.21.15.26:0/749304143 conn(0x7f06b00f0d40 msgr2=0x7f06b00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:54:40.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.026+0000 7f06b6892700 1 -- 172.21.15.26:0/749304143 shutdown_connections 2021-11-03T16:54:40.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.026+0000 7f06b6892700 1 -- 172.21.15.26:0/749304143 wait complete. 2021-11-03T16:54:40.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.026+0000 7f06b6892700 1 Processor -- start 2021-11-03T16:54:40.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.026+0000 7f06b6892700 1 -- start start 2021-11-03T16:54:40.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.027+0000 7f06b6892700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06b00f55c0 0x7f06b00f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:54:40.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.027+0000 7f06b6892700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f06b00f6860 0x7f06b00f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:54:40.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.027+0000 7f06b6892700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b00f8100 con 0x7f06b00f55c0 2021-11-03T16:54:40.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.027+0000 7f06b6892700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b00f8240 con 0x7f06b00f6860 2021-11-03T16:54:40.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.027+0000 7f06affff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06b00f55c0 0x7f06b00f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:54:40.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.027+0000 7f06affff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06b00f55c0 0x7f06b00f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50438/0 (socket says 172.21.15.26:50438) 2021-11-03T16:54:40.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.027+0000 7f06affff700 1 -- 172.21.15.26:0/278507563 learned_addr learned my addr 172.21.15.26:0/278507563 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:54:40.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.027+0000 7f06af7fe700 1 --2- 172.21.15.26:0/278507563 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f06b00f6860 0x7f06b00f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:54:40.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.027+0000 7f06affff700 1 -- 172.21.15.26:0/278507563 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f06b00f6860 msgr2=0x7f06b00f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:54:40.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.027+0000 7f06affff700 1 --2- 172.21.15.26:0/278507563 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f06b00f6860 0x7f06b00f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:40.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.027+0000 7f06affff700 1 -- 172.21.15.26:0/278507563 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a4005040 con 0x7f06b00f55c0 2021-11-03T16:54:40.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.027+0000 7f06affff700 1 --2- 172.21.15.26:0/278507563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06b00f55c0 0x7f06b00f9720 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f06a0002700 tx=0x7f06a0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:54:40.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.027+0000 7f06acff9700 1 -- 172.21.15.26:0/278507563 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06a00079c0 con 0x7f06b00f55c0 2021-11-03T16:54:40.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.027+0000 7f06acff9700 1 -- 172.21.15.26:0/278507563 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f06a000f040 con 0x7f06b00f55c0 2021-11-03T16:54:40.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.027+0000 7f06b6892700 1 -- 172.21.15.26:0/278507563 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06b00f8520 con 0x7f06b00f55c0 2021-11-03T16:54:40.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.027+0000 7f06acff9700 1 -- 172.21.15.26:0/278507563 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06a0014860 con 0x7f06b00f55c0 2021-11-03T16:54:40.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.027+0000 7f06b6892700 1 -- 172.21.15.26:0/278507563 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06b010efa0 con 0x7f06b00f55c0 2021-11-03T16:54:40.030 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.028+0000 7f06b6892700 1 -- 172.21.15.26:0/278507563 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06b0045ad0 con 0x7f06b00f55c0 2021-11-03T16:54:40.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.029+0000 7f06acff9700 1 -- 172.21.15.26:0/278507563 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f06a001b060 con 0x7f06b00f55c0 2021-11-03T16:54:40.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.029+0000 7f06acff9700 1 --2- 172.21.15.26:0/278507563 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f069805c2b0 0x7f069805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:54:40.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.029+0000 7f06acff9700 1 -- 172.21.15.26:0/278507563 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f06a0075d50 con 0x7f06b00f55c0 2021-11-03T16:54:40.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.029+0000 7f06af7fe700 1 --2- 172.21.15.26:0/278507563 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f069805c2b0 0x7f069805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:54:40.032 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.030+0000 7f06af7fe700 1 --2- 172.21.15.26:0/278507563 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f069805c2b0 0x7f069805e770 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f06a4004630 tx=0x7f06a4009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:54:40.032 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.033+0000 7f06acff9700 1 -- 172.21.15.26:0/278507563 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f06a0048a30 con 0x7f06b00f55c0 2021-11-03T16:54:40.047 INFO:tasks.workunit.client.1.smithi194.stdout:6/154: rmdir de 39 2021-11-03T16:54:40.056 INFO:tasks.workunit.client.1.smithi194.stdout:4/77: rename d6/d10 to d6/d8/d1a 0 2021-11-03T16:54:40.057 INFO:tasks.workunit.client.1.smithi194.stdout:4/78: fdatasync d6/d8/d1a/d14/fc 0 2021-11-03T16:54:40.057 INFO:tasks.workunit.client.1.smithi194.stdout:6/155: dread de/f19 [0,4194304] 0 2021-11-03T16:54:40.059 INFO:tasks.workunit.client.1.smithi194.stdout:4/79: rmdir d6/d8 39 2021-11-03T16:54:40.061 INFO:tasks.workunit.client.1.smithi194.stdout:6/156: creat de/d21/d2d/f2e x:0 0 0 2021-11-03T16:54:40.062 INFO:tasks.workunit.client.1.smithi194.stdout:6/157: write de/f1a [1140964,30910] 0 2021-11-03T16:54:40.065 INFO:tasks.workunit.client.1.smithi194.stdout:6/158: rename de/d21/f2a to de/d21/f2f 0 2021-11-03T16:54:40.066 INFO:tasks.workunit.client.1.smithi194.stdout:4/80: rmdir d6/d8/d1a 39 2021-11-03T16:54:40.068 INFO:tasks.workunit.client.1.smithi194.stdout:4/81: dread d6/d8/d1a/f18 [0,4194304] 0 2021-11-03T16:54:40.069 INFO:tasks.workunit.client.1.smithi194.stdout:4/82: fsync d6/f17 0 2021-11-03T16:54:40.070 INFO:tasks.workunit.client.1.smithi194.stdout:6/159: creat de/d21/d2d/f30 x:0 0 0 2021-11-03T16:54:40.070 INFO:tasks.workunit.client.1.smithi194.stdout:6/160: mknod de/d21/c31 1 2021-11-03T16:54:40.071 INFO:tasks.workunit.client.1.smithi194.stdout:4/83: symlink d6/d8/d1a/l1b 0 2021-11-03T16:54:40.072 INFO:tasks.workunit.client.1.smithi194.stdout:4/84: write d6/d8/d1a/f18 [1608716,27354] 0 2021-11-03T16:54:40.073 INFO:tasks.workunit.client.1.smithi194.stdout:4/85: chown d6/d8/d1a/d14/f11 30361272 1 2021-11-03T16:54:40.073 INFO:tasks.workunit.client.1.smithi194.stdout:6/161: mkdir de/d1f/d32 0 2021-11-03T16:54:40.075 INFO:tasks.workunit.client.1.smithi194.stdout:4/86: dread d6/d8/d1a/d14/f11 [4194304,4194304] 0 2021-11-03T16:54:40.076 INFO:tasks.workunit.client.1.smithi194.stdout:6/162: creat de/d21/d2d/f33 x:0 0 0 2021-11-03T16:54:40.078 INFO:tasks.workunit.client.1.smithi194.stdout:6/163: creat de/d1f/d26/f34 x:0 0 0 2021-11-03T16:54:40.082 INFO:tasks.workunit.client.1.smithi194.stdout:6/164: rename de/d1f/l22 to de/d21/l35 0 2021-11-03T16:54:40.084 INFO:tasks.workunit.client.1.smithi194.stdout:6/165: rmdir de/d21 39 2021-11-03T16:54:40.084 INFO:tasks.workunit.client.1.smithi194.stdout:6/166: truncate de/f1e 1256478 0 2021-11-03T16:54:40.088 INFO:tasks.workunit.client.1.smithi194.stdout:6/167: creat de/d1f/f36 x:0 0 0 2021-11-03T16:54:40.088 INFO:tasks.workunit.client.1.smithi194.stdout:6/168: chown de/d1f/d26/f34 1956468 1 2021-11-03T16:54:40.090 INFO:tasks.workunit.client.1.smithi194.stdout:6/169: truncate de/f19 3405809 0 2021-11-03T16:54:40.092 INFO:tasks.workunit.client.1.smithi194.stdout:4/87: dwrite d6/d8/d1a/f18 [0,4194304] 0 2021-11-03T16:54:40.093 INFO:tasks.workunit.client.1.smithi194.stdout:4/88: chown d6/d8/d1a/f18 760 1 2021-11-03T16:54:40.094 INFO:tasks.workunit.client.1.smithi194.stdout:6/170: unlink de/d21/l2c 0 2021-11-03T16:54:40.114 INFO:tasks.workunit.client.1.smithi194.stdout:4/89: dwrite d6/f17 [0,4194304] 0 2021-11-03T16:54:40.115 INFO:tasks.workunit.client.1.smithi194.stdout:6/171: dwrite de/f24 [0,4194304] 0 2021-11-03T16:54:40.116 INFO:tasks.workunit.client.1.smithi194.stdout:6/172: fdatasync de/d21/d2d/f2e 0 2021-11-03T16:54:40.116 INFO:tasks.workunit.client.1.smithi194.stdout:6/173: write de/f16 [241490,35589] 0 2021-11-03T16:54:40.117 INFO:tasks.workunit.client.1.smithi194.stdout:4/90: creat d6/f1c x:0 0 0 2021-11-03T16:54:40.121 INFO:tasks.workunit.client.1.smithi194.stdout:6/174: link de/d21/d2d/f30 de/d21/f37 0 2021-11-03T16:54:40.122 INFO:tasks.workunit.client.1.smithi194.stdout:6/175: chown de/d21 1602 1 2021-11-03T16:54:40.124 INFO:tasks.workunit.client.1.smithi194.stdout:4/91: unlink d6/d8/d1a/l1b 0 2021-11-03T16:54:40.125 INFO:tasks.workunit.client.1.smithi194.stdout:6/176: symlink de/d21/l38 0 2021-11-03T16:54:40.126 INFO:tasks.workunit.client.1.smithi194.stdout:6/177: write de/d21/f2b [193430,81654] 0 2021-11-03T16:54:40.127 INFO:tasks.workunit.client.1.smithi194.stdout:6/178: fdatasync fc 0 2021-11-03T16:54:40.128 INFO:tasks.workunit.client.1.smithi194.stdout:6/179: write de/f16 [411805,73707] 0 2021-11-03T16:54:40.128 INFO:tasks.workunit.client.1.smithi194.stdout:6/180: mknod de/d21/c39 1 2021-11-03T16:54:40.148 INFO:tasks.workunit.client.1.smithi194.stdout:4/92: truncate d6/d8/d1a/d14/fc 1855140 0 2021-11-03T16:54:40.151 INFO:tasks.workunit.client.1.smithi194.stdout:6/181: rename de/d21/d2d/f30 to de/d21/f3a 0 2021-11-03T16:54:40.151 INFO:tasks.workunit.client.1.smithi194.stdout:6/182: readlink de/d21/l35 0 2021-11-03T16:54:40.152 INFO:tasks.workunit.client.1.smithi194.stdout:6/183: chown de/d1f 4063553 1 2021-11-03T16:54:40.152 INFO:tasks.workunit.client.1.smithi194.stdout:6/184: truncate de/f1e 1813517 0 2021-11-03T16:54:40.153 INFO:tasks.workunit.client.1.smithi194.stdout:4/93: creat d6/d12/f1d x:0 0 0 2021-11-03T16:54:40.156 INFO:tasks.workunit.client.1.smithi194.stdout:4/94: mkdir d6/d12/d1e 0 2021-11-03T16:54:40.157 INFO:tasks.workunit.client.1.smithi194.stdout:4/95: fdatasync d6/d12/f1d 0 2021-11-03T16:54:40.157 INFO:tasks.workunit.client.1.smithi194.stdout:4/96: write d6/d12/f1d [26638,115361] 0 2021-11-03T16:54:40.159 INFO:tasks.workunit.client.1.smithi194.stdout:4/97: write d6/d8/d1a/f18 [3139879,38482] 0 2021-11-03T16:54:40.163 INFO:tasks.workunit.client.1.smithi194.stdout:4/98: read d6/f15 [977028,118989] 0 2021-11-03T16:54:40.166 INFO:tasks.workunit.client.1.smithi194.stdout:4/99: write d6/f17 [1731369,128645] 0 2021-11-03T16:54:40.167 INFO:tasks.workunit.client.1.smithi194.stdout:6/185: dwrite fc [0,4194304] 0 2021-11-03T16:54:40.170 INFO:tasks.workunit.client.1.smithi194.stdout:4/100: write d6/d8/d1a/d14/f11 [3835594,78569] 0 2021-11-03T16:54:40.171 INFO:tasks.workunit.client.1.smithi194.stdout:6/186: getdents de/d1f 0 2021-11-03T16:54:40.172 INFO:tasks.workunit.client.1.smithi194.stdout:4/101: write d6/f15 [3551953,56248] 0 2021-11-03T16:54:40.172 INFO:tasks.workunit.client.1.smithi194.stdout:4/102: mknod d6/c1f 1 2021-11-03T16:54:40.173 INFO:tasks.workunit.client.1.smithi194.stdout:4/103: mknod d6/d12/d1e/c20 1 2021-11-03T16:54:40.173 INFO:tasks.workunit.client.1.smithi194.stdout:6/187: creat de/d1f/d26/f3b x:0 0 0 2021-11-03T16:54:40.173 INFO:tasks.workunit.client.1.smithi194.stdout:6/188: truncate de/f28 423238 0 2021-11-03T16:54:40.181 INFO:tasks.workunit.client.1.smithi194.stdout:4/104: rename d6/d8/l19 to d6/d8/d1a/d14/l21 0 2021-11-03T16:54:40.188 INFO:tasks.workunit.client.1.smithi194.stdout:6/189: dwrite de/f10 [4194304,4194304] 0 2021-11-03T16:54:40.199 INFO:tasks.workunit.client.1.smithi194.stdout:4/105: dread d6/d8/d1a/f18 [0,4194304] 0 2021-11-03T16:54:40.201 INFO:tasks.workunit.client.1.smithi194.stdout:6/190: dread de/f1a [0,4194304] 0 2021-11-03T16:54:40.205 INFO:tasks.workunit.client.1.smithi194.stdout:6/191: truncate de/f1a 1234405 0 2021-11-03T16:54:40.205 INFO:tasks.workunit.client.1.smithi194.stdout:6/192: fdatasync de/d21/f23 0 2021-11-03T16:54:40.205 INFO:tasks.workunit.client.1.smithi194.stdout:6/193: write de/d21/d2d/f2e [3023,103060] 0 2021-11-03T16:54:40.208 INFO:tasks.workunit.client.1.smithi194.stdout:6/194: link de/d21/l38 de/d1f/l3c 0 2021-11-03T16:54:40.208 INFO:tasks.workunit.client.1.smithi194.stdout:6/195: dread - de/d1f/d26/f34 zero size 2021-11-03T16:54:40.209 INFO:tasks.workunit.client.1.smithi194.stdout:6/196: write de/d1f/d26/f3b [563590,120064] 0 2021-11-03T16:54:40.209 INFO:tasks.workunit.client.1.smithi194.stdout:6/197: dread - de/d21/d2d/f33 zero size 2021-11-03T16:54:40.212 INFO:tasks.workunit.client.1.smithi194.stdout:4/106: dread f1 [0,4194304] 0 2021-11-03T16:54:40.212 INFO:tasks.workunit.client.1.smithi194.stdout:4/107: chown d6/d12/f1d 29 1 2021-11-03T16:54:40.213 INFO:tasks.workunit.client.1.smithi194.stdout:4/108: chown d6/f15 86655466 1 2021-11-03T16:54:40.213 INFO:tasks.workunit.client.1.smithi194.stdout:4/109: chown d6/d8/d1a/d14/fc 5082 1 2021-11-03T16:54:40.214 INFO:tasks.workunit.client.1.smithi194.stdout:4/110: write d6/f17 [981527,38113] 0 2021-11-03T16:54:40.214 INFO:tasks.workunit.client.1.smithi194.stdout:4/111: readlink d6/d8/d1a/d14/lb 0 2021-11-03T16:54:40.225 INFO:tasks.workunit.client.1.smithi194.stdout:4/112: link d6/d8/d1a/d14/lb d6/d8/d1a/l22 0 2021-11-03T16:54:40.240 INFO:tasks.workunit.client.1.smithi194.stdout:4/113: dwrite d6/f17 [4194304,4194304] 0 2021-11-03T16:54:40.242 INFO:tasks.workunit.client.1.smithi194.stdout:4/114: creat d6/d12/f23 x:0 0 0 2021-11-03T16:54:40.259 INFO:tasks.workunit.client.1.smithi194.stdout:4/115: dwrite d6/f17 [0,4194304] 0 2021-11-03T16:54:40.261 INFO:tasks.workunit.client.1.smithi194.stdout:4/116: creat d6/d12/d1e/f24 x:0 0 0 2021-11-03T16:54:40.289 INFO:tasks.workunit.client.1.smithi194.stdout:4/117: truncate d6/f17 5631981 0 2021-11-03T16:54:40.292 INFO:tasks.workunit.client.1.smithi194.stdout:4/118: creat d6/f25 x:0 0 0 2021-11-03T16:54:40.296 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.301+0000 7f06b6892700 1 -- 172.21.15.26:0/278507563 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f06b010f710 con 0x7f06b00f55c0 2021-11-03T16:54:40.297 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.302+0000 7f06acff9700 1 -- 172.21.15.26:0/278507563 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 9 v9) v1 ==== 75+0+1618 (secure 0 0 0) 0x7f06a004c050 con 0x7f06b00f55c0 2021-11-03T16:54:40.297 INFO:teuthology.orchestra.run.smithi026.stdout:e9 2021-11-03T16:54:40.298 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T16:54:40.298 INFO:teuthology.orchestra.run.smithi026.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T16:54:40.298 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T16:54:40.298 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:54:40.299 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T16:54:40.299 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T16:54:40.299 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 6 2021-11-03T16:54:40.300 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 2021-11-03T16:54:40.300 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T16:54:40.300 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:52:28.058778+0000 2021-11-03T16:54:40.300 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T16:54:40.301 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T16:54:40.301 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T16:54:40.301 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T16:54:40.301 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T16:54:40.302 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T16:54:40.302 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T16:54:40.302 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 0 2021-11-03T16:54:40.302 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T16:54:40.303 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T16:54:40.303 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T16:54:40.303 INFO:teuthology.orchestra.run.smithi026.stdout:up {0=14422} 2021-11-03T16:54:40.303 INFO:teuthology.orchestra.run.smithi026.stdout:failed 2021-11-03T16:54:40.303 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T16:54:40.304 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T16:54:40.304 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T16:54:40.304 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T16:54:40.304 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T16:54:40.305 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T16:54:40.305 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T16:54:40.305 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{0:14422} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.26:6826/665235785,v1:172.21.15.26:6827/665235785]] 2021-11-03T16:54:40.305 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:54:40.305 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:54:40.306 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T16:54:40.306 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:54:40.306 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14436} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.26:6828/3059137105,v1:172.21.15.26:6829/3059137105]] 2021-11-03T16:54:40.306 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921]] 2021-11-03T16:54:40.307 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844]] 2021-11-03T16:54:40.308 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.304+0000 7f06b6892700 1 -- 172.21.15.26:0/278507563 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f069805c2b0 msgr2=0x7f069805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:54:40.308 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.304+0000 7f06b6892700 1 --2- 172.21.15.26:0/278507563 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f069805c2b0 0x7f069805e770 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f06a4004630 tx=0x7f06a4009b30).stop 2021-11-03T16:54:40.308 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.304+0000 7f06b6892700 1 -- 172.21.15.26:0/278507563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06b00f55c0 msgr2=0x7f06b00f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:54:40.308 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.304+0000 7f06b6892700 1 --2- 172.21.15.26:0/278507563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06b00f55c0 0x7f06b00f9720 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f06a0002700 tx=0x7f06a0009d80).stop 2021-11-03T16:54:40.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.304+0000 7f06b6892700 1 -- 172.21.15.26:0/278507563 shutdown_connections 2021-11-03T16:54:40.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.304+0000 7f06b6892700 1 --2- 172.21.15.26:0/278507563 >> [v2:172.21.15.26:6800/3029163595,v1:172.21.15.26:6801/3029163595] conn(0x7f069805c2b0 0x7f069805e770 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:40.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.304+0000 7f06b6892700 1 --2- 172.21.15.26:0/278507563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06b00f55c0 0x7f06b00f9720 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:40.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.304+0000 7f06b6892700 1 --2- 172.21.15.26:0/278507563 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f06b00f6860 0x7f06b00f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:54:40.310 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.304+0000 7f06b6892700 1 -- 172.21.15.26:0/278507563 >> 172.21.15.26:0/278507563 conn(0x7f06b00f0d40 msgr2=0x7f06b005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:54:40.310 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.305+0000 7f06b6892700 1 -- 172.21.15.26:0/278507563 shutdown_connections 2021-11-03T16:54:40.310 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:54:40.305+0000 7f06b6892700 1 -- 172.21.15.26:0/278507563 wait complete. 2021-11-03T16:54:40.311 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 9 2021-11-03T16:54:40.311 INFO:tasks.workunit.client.1.smithi194.stdout:4/119: dwrite d6/d8/d1a/f18 [0,4194304] 0 2021-11-03T16:54:40.312 INFO:tasks.workunit.client.1.smithi194.stdout:4/120: stat d6/d8/d1a/d14/f11 0 2021-11-03T16:54:40.312 INFO:tasks.workunit.client.1.smithi194.stdout:4/121: truncate d6/f1c 385259 0 2021-11-03T16:54:40.312 INFO:tasks.workunit.client.1.smithi194.stdout:4/122: dread - d6/f25 zero size 2021-11-03T16:54:40.312 INFO:tasks.workunit.client.1.smithi194.stdout:4/123: truncate d6/f1c 1055101 0 2021-11-03T16:54:40.313 INFO:tasks.workunit.client.1.smithi194.stdout:4/124: readlink d6/d8/d1a/d14/lb 0 2021-11-03T16:54:40.313 INFO:tasks.workunit.client.1.smithi194.stdout:4/125: dread d6/d8/d1a/d14/f11 [4194304,4194304] 0 2021-11-03T16:54:40.319 INFO:tasks.workunit.client.1.smithi194.stdout:4/126: rename d6/f25 to d6/d12/d1e/f26 0 2021-11-03T16:54:40.329 INFO:tasks.workunit.client.1.smithi194.stdout:4/127: rmdir d6/d8/d1a/d14 39 2021-11-03T16:54:40.329 INFO:tasks.workunit.client.1.smithi194.stdout:4/128: rename d6/d8/d1a to d6/d8/d1a/d27 22 2021-11-03T16:54:40.332 INFO:tasks.workunit.client.1.smithi194.stdout:4/129: dread f1 [0,4194304] 0 2021-11-03T16:54:40.333 INFO:tasks.workunit.client.1.smithi194.stdout:4/130: fdatasync d6/d12/f23 0 2021-11-03T16:54:40.333 INFO:tasks.workunit.client.1.smithi194.stdout:4/131: dread - d6/d12/d1e/f24 zero size 2021-11-03T16:54:40.337 INFO:tasks.workunit.client.1.smithi194.stdout:4/132: symlink d6/d12/l28 0 2021-11-03T16:54:40.354 INFO:tasks.workunit.client.1.smithi194.stdout:4/133: dwrite d6/d12/d1e/f26 [0,4194304] 0 2021-11-03T16:54:40.354 INFO:tasks.workunit.client.1.smithi194.stdout:4/134: chown f1 3075 1 2021-11-03T16:54:40.363 INFO:tasks.workunit.client.1.smithi194.stdout:4/135: getdents d6/d12 0 2021-11-03T16:54:40.376 INFO:tasks.workunit.client.1.smithi194.stdout:4/136: unlink d6/d8/d1a/d14/fc 0 2021-11-03T16:54:40.398 INFO:tasks.workunit.client.1.smithi194.stdout:4/137: dwrite d6/d12/f1d [0,4194304] 0 2021-11-03T16:54:40.404 INFO:tasks.workunit.client.1.smithi194.stdout:4/138: rename d6/d8/d1a/d14/lb to d6/l29 0 2021-11-03T16:54:40.405 INFO:tasks.workunit.client.1.smithi194.stdout:4/139: write f1 [5422532,9099] 0 2021-11-03T16:54:40.405 INFO:tasks.workunit.client.1.smithi194.stdout:4/140: chown d6/f15 19209715 1 2021-11-03T16:54:40.408 INFO:tasks.workunit.client.1.smithi194.stdout:7/40: sync 2021-11-03T16:54:40.409 INFO:tasks.workunit.client.1.smithi194.stdout:9/122: sync 2021-11-03T16:54:40.409 INFO:tasks.workunit.client.1.smithi194.stdout:9/123: stat fd 0 2021-11-03T16:54:40.415 INFO:tasks.workunit.client.1.smithi194.stdout:9/124: dread f15 [0,4194304] 0 2021-11-03T16:54:40.422 INFO:tasks.workunit.client.1.smithi194.stdout:4/141: rmdir d6/d12/d1e 39 2021-11-03T16:54:40.427 INFO:tasks.workunit.client.1.smithi194.stdout:7/41: symlink d6/lb 0 2021-11-03T16:54:40.428 INFO:tasks.workunit.client.1.smithi194.stdout:7/42: chown d6 12 1 2021-11-03T16:54:40.428 INFO:tasks.workunit.client.1.smithi194.stdout:9/125: mknod d19/c2a 1 2021-11-03T16:54:40.430 INFO:tasks.workunit.client.1.smithi194.stdout:4/142: link d6/f15 d6/f2a 0 2021-11-03T16:54:40.431 INFO:tasks.workunit.client.1.smithi194.stdout:4/143: chown f1 8 1 2021-11-03T16:54:40.432 INFO:tasks.workunit.client.1.smithi194.stdout:4/144: write d6/d12/f1d [308781,75913] 0 2021-11-03T16:54:40.432 INFO:tasks.workunit.client.1.smithi194.stdout:7/43: symlink d6/lc 0 2021-11-03T16:54:40.434 INFO:tasks.workunit.client.1.smithi194.stdout:9/126: link d19/l26 d19/d27/l2b 0 2021-11-03T16:54:40.434 INFO:tasks.workunit.client.1.smithi194.stdout:9/127: write d19/d27/f29 [886896,108921] 0 2021-11-03T16:54:40.436 INFO:tasks.workunit.client.1.smithi194.stdout:9/128: creat d19/d27/f2c x:0 0 0 2021-11-03T16:54:40.438 INFO:tasks.workunit.client.1.smithi194.stdout:4/145: dread d6/d8/d1a/d14/f11 [0,4194304] 0 2021-11-03T16:54:40.438 INFO:tasks.workunit.client.1.smithi194.stdout:9/129: truncate f15 3625430 0 2021-11-03T16:54:40.438 INFO:tasks.workunit.client.1.smithi194.stdout:9/130: write fb [836225,72566] 0 2021-11-03T16:54:40.442 INFO:tasks.workunit.client.1.smithi194.stdout:4/146: dread d6/f1c [0,4194304] 0 2021-11-03T16:54:40.443 INFO:tasks.workunit.client.1.smithi194.stdout:4/147: unlink d6/d12/f1d 0 2021-11-03T16:54:40.445 INFO:tasks.workunit.client.1.smithi194.stdout:4/148: mkdir d6/d8/d1a/d2b 0 2021-11-03T16:54:40.451 INFO:tasks.workunit.client.1.smithi194.stdout:4/149: creat d6/d8/d1a/d2b/f2c x:0 0 0 2021-11-03T16:54:40.453 INFO:tasks.workunit.client.1.smithi194.stdout:4/150: unlink d6/d8/d1a/f18 0 2021-11-03T16:54:40.454 INFO:tasks.workunit.client.1.smithi194.stdout:4/151: mknod d6/d12/c2d 1 2021-11-03T16:54:40.461 INFO:tasks.workunit.client.1.smithi194.stdout:9/131: dwrite f9 [0,4194304] 0 2021-11-03T16:54:40.462 INFO:tasks.workunit.client.1.smithi194.stdout:9/132: write d19/f1c [1424889,77999] 0 2021-11-03T16:54:40.462 INFO:tasks.workunit.client.1.smithi194.stdout:9/133: dread - d19/f1e zero size 2021-11-03T16:54:40.465 INFO:tasks.workunit.client.1.smithi194.stdout:7/44: dwrite f0 [0,4194304] 0 2021-11-03T16:54:40.476 INFO:tasks.workunit.client.1.smithi194.stdout:7/45: rename l2 to d6/ld 0 2021-11-03T16:54:40.476 INFO:tasks.workunit.client.1.smithi194.stdout:7/46: mknod d6/da/ce 1 2021-11-03T16:54:40.476 INFO:tasks.workunit.client.1.smithi194.stdout:4/152: dwrite d6/d12/d1e/f24 [0,4194304] 0 2021-11-03T16:54:40.484 INFO:tasks.workunit.client.1.smithi194.stdout:9/134: dwrite f5 [0,4194304] 0 2021-11-03T16:54:40.491 INFO:tasks.workunit.client.1.smithi194.stdout:7/47: truncate f0 3615333 0 2021-11-03T16:54:40.492 INFO:tasks.workunit.client.1.smithi194.stdout:4/153: dwrite d6/d8/d1a/d14/f11 [0,4194304] 0 2021-11-03T16:54:40.492 INFO:tasks.workunit.client.1.smithi194.stdout:4/154: write d6/d8/d1a/d2b/f2c [859433,67909] 0 2021-11-03T16:54:40.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:40 smithi194 conmon[35111]: audit 2021-11-03T16:54:38.997545+0000 mgr.smithi026.cnrxli (mgr.14162) 2021-11-03T16:54:40.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:40 smithi194 conmon[35111]: 311 : audit [DBG] from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:54:40.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:40 smithi194 conmon[35111]: cluster 2021-11-03T16:54:39.075364+0000 mgr.smithi026.cnrxli (mgr.14162) 312 : cluster [DBG] pgmap v256: 65 pgs: 65 active+clean; 377 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 4.3 MiB/s rd, 13 MiB/s wr, 357 op/s 2021-11-03T16:54:40.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:40 smithi194 conmon[35111]: audit 2021-11-03T 2021-11-03T16:54:40.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:40 smithi194 conmon[35111]: 16:54:39.904909+0000 mon.smithi026 (mon.0) 562 : audit [DBG] from='client.? 172.21.15.26:0/2586061156' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:54:40.499 INFO:tasks.workunit.client.1.smithi194.stdout:9/135: link d19/f1a d19/d27/f2d 0 2021-11-03T16:54:40.501 INFO:tasks.workunit.client.1.smithi194.stdout:4/155: creat d6/d12/d1e/f2e x:0 0 0 2021-11-03T16:54:40.502 INFO:tasks.workunit.client.1.smithi194.stdout:9/136: mknod d19/c2e 1 2021-11-03T16:54:40.505 INFO:tasks.workunit.client.1.smithi194.stdout:7/48: write f0 [3012081,82792] 0 2021-11-03T16:54:40.506 INFO:tasks.workunit.client.1.smithi194.stdout:9/137: rename d19/f1c to d19/f2f 0 2021-11-03T16:54:40.513 INFO:tasks.workunit.client.1.smithi194.stdout:9/138: dread d19/d27/f29 [0,4194304] 0 2021-11-03T16:54:40.521 INFO:tasks.workunit.client.1.smithi194.stdout:4/156: dwrite d6/f1c [0,4194304] 0 2021-11-03T16:54:40.525 INFO:tasks.workunit.client.1.smithi194.stdout:4/157: creat d6/d12/f2f x:0 0 0 2021-11-03T16:54:40.528 INFO:tasks.workunit.client.1.smithi194.stdout:4/158: creat d6/f30 x:0 0 0 2021-11-03T16:54:40.528 INFO:tasks.workunit.client.1.smithi194.stdout:4/159: write d6/d12/f2f [697110,43350] 0 2021-11-03T16:54:40.528 INFO:tasks.workunit.client.1.smithi194.stdout:4/160: chown d6/d12/d1e 2 1 2021-11-03T16:54:40.529 INFO:tasks.workunit.client.1.smithi194.stdout:4/161: chown d6/d8/d1a/d2b/f2c 5371 1 2021-11-03T16:54:40.529 INFO:tasks.workunit.client.1.smithi194.stdout:7/49: dwrite f5 [0,4194304] 0 2021-11-03T16:54:40.529 INFO:tasks.workunit.client.1.smithi194.stdout:7/50: fsync f5 0 2021-11-03T16:54:40.538 INFO:tasks.workunit.client.1.smithi194.stdout:7/51: dread f4 [0,4194304] 0 2021-11-03T16:54:40.542 INFO:tasks.workunit.client.1.smithi194.stdout:7/52: stat l3 0 2021-11-03T16:54:40.544 INFO:tasks.workunit.client.1.smithi194.stdout:7/53: rename d6/lb to d6/lf 0 2021-11-03T16:54:40.547 INFO:tasks.workunit.client.1.smithi194.stdout:4/162: dwrite d6/f17 [0,4194304] 0 2021-11-03T16:54:40.547 INFO:tasks.workunit.client.1.smithi194.stdout:4/163: mknod d6/d8/d1a/c31 1 2021-11-03T16:54:40.548 INFO:tasks.workunit.client.1.smithi194.stdout:4/164: creat d6/d8/d1a/d2b/f32 x:0 0 0 2021-11-03T16:54:40.548 INFO:tasks.workunit.client.1.smithi194.stdout:4/165: readlink d6/d8/d1a/d14/l21 0 2021-11-03T16:54:40.549 INFO:tasks.workunit.client.1.smithi194.stdout:4/166: chown d6/f30 0 1 2021-11-03T16:54:40.549 INFO:tasks.workunit.client.1.smithi194.stdout:4/167: chown d6/d8 0 1 2021-11-03T16:54:40.549 INFO:tasks.workunit.client.1.smithi194.stdout:4/168: creat d6/d12/f33 x:0 0 0 2021-11-03T16:54:40.550 INFO:tasks.workunit.client.1.smithi194.stdout:4/169: stat d6/f17 0 2021-11-03T16:54:40.550 INFO:tasks.workunit.client.1.smithi194.stdout:4/170: read d6/d8/d1a/d14/f11 [5106187,73194] 0 2021-11-03T16:54:40.557 INFO:tasks.workunit.client.1.smithi194.stdout:4/171: rmdir d6/d12 39 2021-11-03T16:54:40.557 INFO:tasks.workunit.client.1.smithi194.stdout:4/172: chown d6/l29 1460278786 1 2021-11-03T16:54:40.566 INFO:tasks.workunit.client.1.smithi194.stdout:7/54: dwrite f5 [0,4194304] 0 2021-11-03T16:54:40.577 INFO:tasks.workunit.client.1.smithi194.stdout:4/173: dwrite d6/d12/d1e/f26 [0,4194304] 0 2021-11-03T16:54:40.577 INFO:tasks.workunit.client.1.smithi194.stdout:4/174: fdatasync d6/d12/f23 0 2021-11-03T16:54:40.577 INFO:tasks.workunit.client.1.smithi194.stdout:4/175: mknod d6/c34 1 2021-11-03T16:54:40.578 INFO:tasks.workunit.client.1.smithi194.stdout:4/176: write d6/d8/d1a/d14/f11 [6542630,125844] 0 2021-11-03T16:54:40.583 INFO:tasks.workunit.client.1.smithi194.stdout:7/55: dread f0 [0,4194304] 0 2021-11-03T16:54:40.589 INFO:tasks.workunit.client.1.smithi194.stdout:7/56: write f0 [2045344,129542] 0 2021-11-03T16:54:40.589 INFO:tasks.workunit.client.1.smithi194.stdout:7/57: readlink l3 0 2021-11-03T16:54:40.591 INFO:tasks.workunit.client.1.smithi194.stdout:7/58: creat d6/da/f10 x:0 0 0 2021-11-03T16:54:40.593 INFO:tasks.workunit.client.1.smithi194.stdout:7/59: creat d6/da/f11 x:0 0 0 2021-11-03T16:54:40.614 INFO:tasks.workunit.client.1.smithi194.stdout:7/60: dwrite f4 [0,4194304] 0 2021-11-03T16:54:40.641 INFO:tasks.workunit.client.1.smithi194.stdout:1/37: sync 2021-11-03T16:54:40.642 INFO:tasks.workunit.client.1.smithi194.stdout:1/38: chown d2/l3 1563 1 2021-11-03T16:54:40.643 INFO:tasks.workunit.client.1.smithi194.stdout:1/39: stat d2 0 2021-11-03T16:54:40.651 INFO:tasks.workunit.client.1.smithi194.stdout:1/40: mkdir d2/da 0 2021-11-03T16:54:40.652 INFO:tasks.workunit.client.1.smithi194.stdout:1/41: truncate d2/f9 356558 0 2021-11-03T16:54:40.652 INFO:tasks.workunit.client.1.smithi194.stdout:1/42: fdatasync d2/f6 0 2021-11-03T16:54:40.652 INFO:tasks.workunit.client.1.smithi194.stdout:1/43: mknod d2/da/cb 1 2021-11-03T16:54:40.652 INFO:tasks.workunit.client.1.smithi194.stdout:1/44: getdents d2/da 0 2021-11-03T16:54:40.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:40 smithi026 conmon[32119]: audit 2021-11-03T16:54:38.997545+0000 mgr.smithi026.cnrxli (mgr. 2021-11-03T16:54:40.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:40 smithi026 conmon[32119]: 14162) 311 : audit [DBG] from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:54:40.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:40 smithi026 conmon[32119]: cluster 2021-11-03T16:54:39.075364+0000 mgr.smithi026.cnrxli (mgr.14162) 312 : cluster [DBG] pgmap v256: 65 pgs: 65 active+clean; 377 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 4.3 MiB/s rd, 13 MiB/s wr, 357 op/s 2021-11-03T16:54:40.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:40 smithi026 conmon[32119]: audit 2021-11-03T16 2021-11-03T16:54:40.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:40 smithi026 conmon[32119]: :54:39.904909+0000 mon.smithi026 (mon.0) 562 : audit [DBG] from='client.? 172.21.15.26:0/2586061156' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:54:40.839 INFO:tasks.workunit.client.1.smithi194.stdout:2/303: sync 2021-11-03T16:54:40.853 INFO:tasks.workunit.client.1.smithi194.stdout:2/304: dwrite d6/fb [4194304,4194304] 0 2021-11-03T16:54:40.861 INFO:tasks.workunit.client.1.smithi194.stdout:2/305: creat d6/de/d16/d20/f5b x:0 0 0 2021-11-03T16:54:40.866 INFO:tasks.workunit.client.1.smithi194.stdout:0/77: sync 2021-11-03T16:54:40.866 INFO:tasks.workunit.client.1.smithi194.stdout:3/151: sync 2021-11-03T16:54:40.869 INFO:tasks.workunit.client.1.smithi194.stdout:3/152: symlink d2/d17/l32 0 2021-11-03T16:54:40.871 INFO:tasks.workunit.client.1.smithi194.stdout:3/153: mkdir d2/d33 0 2021-11-03T16:54:40.872 INFO:tasks.workunit.client.1.smithi194.stdout:3/154: creat d2/d17/f34 x:0 0 0 2021-11-03T16:54:40.899 INFO:tasks.workunit.client.1.smithi194.stdout:0/78: dwrite f3 [4194304,4194304] 0 2021-11-03T16:54:40.900 INFO:tasks.workunit.client.1.smithi194.stdout:2/306: dwrite d6/d21/f3b [0,4194304] 0 2021-11-03T16:54:40.900 INFO:tasks.workunit.client.1.smithi194.stdout:2/307: readlink d6/d17/l4b 0 2021-11-03T16:54:40.900 INFO:tasks.workunit.client.1.smithi194.stdout:3/155: dwrite d2/d20/f25 [0,4194304] 0 2021-11-03T16:54:40.901 INFO:tasks.workunit.client.1.smithi194.stdout:2/308: chown d6/de/d16/f50 63605914 1 2021-11-03T16:54:40.901 INFO:tasks.workunit.client.1.smithi194.stdout:2/309: chown d6/d21/d2a/d31/f33 2 1 2021-11-03T16:54:40.901 INFO:tasks.workunit.client.1.smithi194.stdout:0/79: creat d5/d9/f19 x:0 0 0 2021-11-03T16:54:40.906 INFO:tasks.workunit.client.1.smithi194.stdout:3/156: rename d2/d17/l2b to d2/d33/l35 0 2021-11-03T16:54:40.908 INFO:tasks.workunit.client.1.smithi194.stdout:2/310: link d6/f48 d6/de/f5c 0 2021-11-03T16:54:40.909 INFO:tasks.workunit.client.1.smithi194.stdout:2/311: mknod d6/d1f/c5d 1 2021-11-03T16:54:40.909 INFO:tasks.workunit.client.1.smithi194.stdout:3/157: mkdir d2/d20/d36 0 2021-11-03T16:54:40.911 INFO:tasks.workunit.client.1.smithi194.stdout:2/312: link d6/d1f/f39 d6/d21/d43/f5e 0 2021-11-03T16:54:40.911 INFO:tasks.workunit.client.1.smithi194.stdout:2/313: truncate d6/d1f/f2e 253042 0 2021-11-03T16:54:40.912 INFO:tasks.workunit.client.1.smithi194.stdout:2/314: write d6/d1f/d4c/f34 [4959828,30368] 0 2021-11-03T16:54:40.919 INFO:tasks.workunit.client.1.smithi194.stdout:3/158: creat d2/d20/d36/f37 x:0 0 0 2021-11-03T16:54:40.919 INFO:tasks.workunit.client.1.smithi194.stdout:3/159: fsync d2/d17/f1c 0 2021-11-03T16:54:40.920 INFO:tasks.workunit.client.1.smithi194.stdout:0/80: dwrite d5/d13/f12 [0,4194304] 0 2021-11-03T16:54:40.920 INFO:tasks.workunit.client.1.smithi194.stdout:0/81: write d5/d9/f19 [837457,43708] 0 2021-11-03T16:54:40.920 INFO:tasks.workunit.client.1.smithi194.stdout:0/82: chown d5/l15 766091229 1 2021-11-03T16:54:40.920 INFO:tasks.workunit.client.1.smithi194.stdout:3/160: creat d2/f38 x:0 0 0 2021-11-03T16:54:40.921 INFO:tasks.workunit.client.1.smithi194.stdout:0/83: rmdir d5/d17 0 2021-11-03T16:54:40.923 INFO:tasks.workunit.client.1.smithi194.stdout:0/84: dread d5/d9/f19 [0,4194304] 0 2021-11-03T16:54:40.923 INFO:tasks.workunit.client.1.smithi194.stdout:0/85: chown d5/d13/f12 419091084 1 2021-11-03T16:54:40.924 INFO:tasks.workunit.client.1.smithi194.stdout:2/315: link d6/fb d6/d21/f5f 0 2021-11-03T16:54:40.927 INFO:tasks.workunit.client.1.smithi194.stdout:0/86: link d5/d13/f12 d5/d13/f1a 0 2021-11-03T16:54:40.929 INFO:tasks.workunit.client.1.smithi194.stdout:2/316: truncate d6/d21/f3b 2812374 0 2021-11-03T16:54:40.929 INFO:tasks.workunit.client.1.smithi194.stdout:2/317: fdatasync d6/de/f40 0 2021-11-03T16:54:40.929 INFO:tasks.workunit.client.1.smithi194.stdout:2/318: chown d6/de/f57 2 1 2021-11-03T16:54:40.930 INFO:tasks.workunit.client.1.smithi194.stdout:0/87: truncate f3 4657311 0 2021-11-03T16:54:40.930 INFO:tasks.workunit.client.1.smithi194.stdout:0/88: write d5/d9/f19 [781706,89919] 0 2021-11-03T16:54:40.932 INFO:tasks.workunit.client.1.smithi194.stdout:2/319: rename d6/lc to d6/d21/d2a/d35/l60 0 2021-11-03T16:54:40.933 INFO:tasks.workunit.client.1.smithi194.stdout:2/320: getdents d6/d21/d2a/d31 0 2021-11-03T16:54:40.934 INFO:tasks.workunit.client.1.smithi194.stdout:2/321: read - d6/de/d16/d20/f5b zero size 2021-11-03T16:54:40.973 INFO:tasks.workunit.client.1.smithi194.stdout:2/322: symlink d6/de/d27/l61 0 2021-11-03T16:54:40.977 INFO:tasks.workunit.client.1.smithi194.stdout:2/323: mkdir d6/de/d16/d62 0 2021-11-03T16:54:40.985 INFO:tasks.workunit.client.1.smithi194.stdout:2/324: dread d6/de/f40 [0,4194304] 0 2021-11-03T16:54:40.987 INFO:tasks.workunit.client.1.smithi194.stdout:2/325: mkdir d6/d17/d26/d63 0 2021-11-03T16:54:41.010 INFO:tasks.workunit.client.1.smithi194.stdout:2/326: dwrite d6/d1f/f2e [0,4194304] 0 2021-11-03T16:54:41.018 INFO:tasks.workunit.client.1.smithi194.stdout:2/327: dread d6/d21/d2a/d31/f37 [0,4194304] 0 2021-11-03T16:54:41.019 INFO:tasks.workunit.client.1.smithi194.stdout:2/328: getdents d6 0 2021-11-03T16:54:41.024 INFO:tasks.workunit.client.1.smithi194.stdout:2/329: write d6/fd [7840745,104372] 0 2021-11-03T16:54:41.033 INFO:tasks.workunit.client.1.smithi194.stdout:2/330: dread d6/d17/d26/f32 [4194304,4194304] 0 2021-11-03T16:54:41.034 INFO:tasks.workunit.client.1.smithi194.stdout:2/331: stat d6/f44 0 2021-11-03T16:54:41.035 INFO:tasks.workunit.client.1.smithi194.stdout:2/332: symlink d6/d17/d26/d63/l64 0 2021-11-03T16:54:41.054 INFO:tasks.workunit.client.1.smithi194.stdout:2/333: dwrite d6/d1f/f39 [0,4194304] 0 2021-11-03T16:54:41.054 INFO:tasks.workunit.client.1.smithi194.stdout:2/334: mknod d6/de/c65 1 2021-11-03T16:54:41.055 INFO:tasks.workunit.client.1.smithi194.stdout:2/335: chown l3 77424 1 2021-11-03T16:54:41.055 INFO:tasks.workunit.client.1.smithi194.stdout:2/336: fdatasync d6/d21/f5f 0 2021-11-03T16:54:41.055 INFO:tasks.workunit.client.1.smithi194.stdout:2/337: dread - d6/d1f/f42 zero size 2021-11-03T16:54:41.057 INFO:tasks.workunit.client.1.smithi194.stdout:2/338: dread d6/f48 [0,4194304] 0 2021-11-03T16:54:41.059 INFO:tasks.workunit.client.1.smithi194.stdout:2/339: symlink d6/de/d27/l66 0 2021-11-03T16:54:41.075 INFO:tasks.workunit.client.1.smithi194.stdout:8/128: sync 2021-11-03T16:54:41.076 INFO:tasks.workunit.client.1.smithi194.stdout:5/188: sync 2021-11-03T16:54:41.078 INFO:tasks.workunit.client.1.smithi194.stdout:8/129: mknod d8/c37 1 2021-11-03T16:54:41.078 INFO:tasks.workunit.client.1.smithi194.stdout:8/130: chown d8/l19 82281628 1 2021-11-03T16:54:41.080 INFO:tasks.workunit.client.1.smithi194.stdout:8/131: mkdir d8/d33/d38 0 2021-11-03T16:54:41.081 INFO:tasks.workunit.client.1.smithi194.stdout:8/132: truncate d8/d24/f29 897116 0 2021-11-03T16:54:41.082 INFO:tasks.workunit.client.1.smithi194.stdout:8/133: rmdir d8/d24 39 2021-11-03T16:54:41.083 INFO:tasks.workunit.client.1.smithi194.stdout:2/340: dwrite d6/de/d27/f3f [0,4194304] 0 2021-11-03T16:54:41.104 INFO:tasks.workunit.client.1.smithi194.stdout:5/189: dwrite d2/f17 [0,4194304] 0 2021-11-03T16:54:41.104 INFO:tasks.workunit.client.1.smithi194.stdout:5/190: fsync d2/d3/fc 0 2021-11-03T16:54:41.105 INFO:tasks.workunit.client.1.smithi194.stdout:8/134: dwrite d8/f2f [0,4194304] 0 2021-11-03T16:54:41.105 INFO:tasks.workunit.client.1.smithi194.stdout:8/135: mknod d8/d24/c39 1 2021-11-03T16:54:41.120 INFO:tasks.workunit.client.1.smithi194.stdout:8/136: dread d8/d24/f32 [0,4194304] 0 2021-11-03T16:54:41.121 INFO:tasks.workunit.client.1.smithi194.stdout:8/137: mknod d8/d24/c3a 1 2021-11-03T16:54:41.126 INFO:tasks.workunit.client.1.smithi194.stdout:5/191: dwrite d2/dd/f1b [0,4194304] 0 2021-11-03T16:54:41.129 INFO:tasks.workunit.client.1.smithi194.stdout:8/138: dread d8/f22 [0,4194304] 0 2021-11-03T16:54:41.129 INFO:tasks.workunit.client.1.smithi194.stdout:8/139: chown d8/f31 253778882 1 2021-11-03T16:54:41.130 INFO:tasks.workunit.client.1.smithi194.stdout:8/140: fdatasync f5 0 2021-11-03T16:54:41.134 INFO:tasks.workunit.client.1.smithi194.stdout:8/141: dread d8/fc [0,4194304] 0 2021-11-03T16:54:41.140 INFO:tasks.workunit.client.1.smithi194.stdout:8/142: dread d8/d24/f30 [0,4194304] 0 2021-11-03T16:54:41.142 INFO:tasks.workunit.client.1.smithi194.stdout:5/192: unlink d2/dd/l2b 0 2021-11-03T16:54:41.143 INFO:tasks.workunit.client.1.smithi194.stdout:8/143: truncate d8/ff 766302 0 2021-11-03T16:54:41.143 INFO:tasks.workunit.client.1.smithi194.stdout:8/144: chown d8/d24/f30 9369322 1 2021-11-03T16:54:41.143 INFO:tasks.workunit.client.1.smithi194.stdout:5/193: truncate d2/d3/fc 1826203 0 2021-11-03T16:54:41.145 INFO:tasks.workunit.client.1.smithi194.stdout:8/145: creat d8/d33/d38/f3b x:0 0 0 2021-11-03T16:54:41.145 INFO:tasks.workunit.client.1.smithi194.stdout:8/146: dread - d8/f31 zero size 2021-11-03T16:54:41.145 INFO:tasks.workunit.client.1.smithi194.stdout:8/147: write d8/f22 [1354563,119284] 0 2021-11-03T16:54:41.148 INFO:tasks.workunit.client.1.smithi194.stdout:5/194: getdents d2/dd/d35 0 2021-11-03T16:54:41.152 INFO:tasks.workunit.client.1.smithi194.stdout:5/195: creat d2/f44 x:0 0 0 2021-11-03T16:54:41.153 INFO:tasks.workunit.client.1.smithi194.stdout:5/196: dread d2/f23 [0,4194304] 0 2021-11-03T16:54:41.154 INFO:tasks.workunit.client.1.smithi194.stdout:8/148: dread d8/f22 [0,4194304] 0 2021-11-03T16:54:41.159 INFO:tasks.workunit.client.1.smithi194.stdout:8/149: dread d8/f9 [0,4194304] 0 2021-11-03T16:54:41.160 INFO:tasks.workunit.client.1.smithi194.stdout:8/150: creat d8/f3c x:0 0 0 2021-11-03T16:54:41.162 INFO:tasks.workunit.client.1.smithi194.stdout:8/151: creat d8/d35/f3d x:0 0 0 2021-11-03T16:54:41.164 INFO:tasks.workunit.client.1.smithi194.stdout:8/152: truncate d8/f13 716434 0 2021-11-03T16:54:41.173 INFO:tasks.workunit.client.1.smithi194.stdout:5/197: dwrite d2/dd/f20 [0,4194304] 0 2021-11-03T16:54:41.193 INFO:tasks.workunit.client.1.smithi194.stdout:8/153: dwrite d8/f2a [0,4194304] 0 2021-11-03T16:54:41.193 INFO:tasks.workunit.client.1.smithi194.stdout:5/198: dwrite d2/f21 [0,4194304] 0 2021-11-03T16:54:41.194 INFO:tasks.workunit.client.1.smithi194.stdout:5/199: chown d2/l30 8972783 1 2021-11-03T16:54:41.202 INFO:tasks.workunit.client.1.smithi194.stdout:5/200: dread d2/d3/fc [0,4194304] 0 2021-11-03T16:54:41.202 INFO:tasks.workunit.client.1.smithi194.stdout:5/201: read d2/dd/f16 [3916408,7058] 0 2021-11-03T16:54:41.207 INFO:tasks.workunit.client.1.smithi194.stdout:8/154: dwrite d8/d33/d38/f3b [0,4194304] 0 2021-11-03T16:54:41.208 INFO:tasks.workunit.client.1.smithi194.stdout:8/155: fsync d8/d24/f32 0 2021-11-03T16:54:41.208 INFO:tasks.workunit.client.1.smithi194.stdout:8/156: write d8/d35/f3d [68520,66225] 0 2021-11-03T16:54:41.210 INFO:tasks.workunit.client.1.smithi194.stdout:8/157: mkdir d8/d33/d3e 0 2021-11-03T16:54:41.211 INFO:tasks.workunit.client.1.smithi194.stdout:8/158: creat d8/d24/f3f x:0 0 0 2021-11-03T16:54:41.212 INFO:tasks.workunit.client.1.smithi194.stdout:8/159: write d8/d24/f32 [3257235,35490] 0 2021-11-03T16:54:41.213 INFO:tasks.workunit.client.1.smithi194.stdout:8/160: readlink l4 0 2021-11-03T16:54:41.213 INFO:tasks.workunit.client.1.smithi194.stdout:8/161: chown d8/fb 8118105 1 2021-11-03T16:54:41.214 INFO:tasks.workunit.client.1.smithi194.stdout:8/162: creat d8/d33/d3e/f40 x:0 0 0 2021-11-03T16:54:41.216 INFO:tasks.workunit.client.1.smithi194.stdout:8/163: rename d8/d35/f3d to d8/d35/f41 0 2021-11-03T16:54:41.224 INFO:tasks.workunit.client.1.smithi194.stdout:8/164: dread d8/f2a [0,4194304] 0 2021-11-03T16:54:41.225 INFO:tasks.workunit.client.1.smithi194.stdout:8/165: chown d8/f31 120752 1 2021-11-03T16:54:41.225 INFO:tasks.workunit.client.1.smithi194.stdout:8/166: read d8/f2e [79404,24766] 0 2021-11-03T16:54:41.226 INFO:tasks.workunit.client.1.smithi194.stdout:8/167: mkdir d8/d35/d42 0 2021-11-03T16:54:41.228 INFO:tasks.workunit.client.1.smithi194.stdout:8/168: dread d8/f13 [0,4194304] 0 2021-11-03T16:54:41.231 INFO:tasks.workunit.client.1.smithi194.stdout:8/169: link d8/f10 d8/d33/f43 0 2021-11-03T16:54:41.247 INFO:tasks.workunit.client.1.smithi194.stdout:8/170: dwrite d8/f2e [0,4194304] 0 2021-11-03T16:54:41.250 INFO:tasks.workunit.client.1.smithi194.stdout:8/171: link d8/f1b d8/d33/d3e/f44 0 2021-11-03T16:54:41.250 INFO:tasks.workunit.client.1.smithi194.stdout:8/172: stat d8/d35 0 2021-11-03T16:54:41.250 INFO:tasks.workunit.client.1.smithi194.stdout:8/173: write d8/f2f [4388364,69866] 0 2021-11-03T16:54:41.403 INFO:tasks.workunit.client.1.smithi194.stdout:6/198: sync 2021-11-03T16:54:41.404 INFO:tasks.workunit.client.1.smithi194.stdout:6/199: mknod de/d21/c3d 1 2021-11-03T16:54:41.404 INFO:tasks.workunit.client.1.smithi194.stdout:6/200: stat de/d1f 0 2021-11-03T16:54:41.404 INFO:tasks.workunit.client.1.smithi194.stdout:6/201: mkdir de/d21/d3e 0 2021-11-03T16:54:41.405 INFO:tasks.workunit.client.1.smithi194.stdout:6/202: mkdir de/d1f/d26/d3f 0 2021-11-03T16:54:41.406 INFO:tasks.workunit.client.1.smithi194.stdout:6/203: mkdir de/d21/d3e/d40 0 2021-11-03T16:54:41.407 INFO:tasks.workunit.client.1.smithi194.stdout:6/204: getdents de/d1f/d32 0 2021-11-03T16:54:41.409 INFO:tasks.workunit.client.1.smithi194.stdout:6/205: unlink de/d21/f2f 0 2021-11-03T16:54:41.409 INFO:tasks.workunit.client.1.smithi194.stdout:6/206: dread - de/d21/f3a zero size 2021-11-03T16:54:41.410 INFO:tasks.workunit.client.1.smithi194.stdout:6/207: write de/f1e [1896353,63787] 0 2021-11-03T16:54:41.410 INFO:tasks.workunit.client.1.smithi194.stdout:6/208: mkdir de/d21/d41 0 2021-11-03T16:54:41.435 INFO:tasks.workunit.client.1.smithi194.stdout:6/209: dwrite de/d21/f2b [0,4194304] 0 2021-11-03T16:54:41.436 INFO:tasks.workunit.client.1.smithi194.stdout:6/210: mknod de/d21/d3e/c42 1 2021-11-03T16:54:41.541 INFO:tasks.workunit.client.1.smithi194.stdout:9/139: sync 2021-11-03T16:54:41.542 INFO:tasks.workunit.client.1.smithi194.stdout:7/61: sync 2021-11-03T16:54:41.542 INFO:tasks.workunit.client.1.smithi194.stdout:7/62: dread - d6/da/f11 zero size 2021-11-03T16:54:41.542 INFO:tasks.workunit.client.1.smithi194.stdout:7/63: mkdir d6/da/d12 0 2021-11-03T16:54:41.543 INFO:tasks.workunit.client.1.smithi194.stdout:7/64: fdatasync f4 0 2021-11-03T16:54:41.543 INFO:tasks.workunit.client.1.smithi194.stdout:7/65: truncate d6/da/f11 1033837 0 2021-11-03T16:54:41.543 INFO:tasks.workunit.client.1.smithi194.stdout:7/66: rmdir d6/da/d12 0 2021-11-03T16:54:41.544 INFO:tasks.workunit.client.1.smithi194.stdout:7/67: chown d6/ld 62986 1 2021-11-03T16:54:41.566 INFO:tasks.workunit.client.1.smithi194.stdout:7/68: dread f4 [0,4194304] 0 2021-11-03T16:54:41.566 INFO:tasks.workunit.client.1.smithi194.stdout:7/69: write d6/da/f11 [1530935,115084] 0 2021-11-03T16:54:41.567 INFO:tasks.workunit.client.1.smithi194.stdout:9/140: dwrite d19/f2f [0,4194304] 0 2021-11-03T16:54:41.569 INFO:tasks.workunit.client.1.smithi194.stdout:7/70: mkdir d6/d13 0 2021-11-03T16:54:41.571 INFO:tasks.workunit.client.1.smithi194.stdout:7/71: write d6/da/f11 [414386,89580] 0 2021-11-03T16:54:41.574 INFO:tasks.workunit.client.1.smithi194.stdout:9/141: mkdir d19/d27/d30 0 2021-11-03T16:54:41.575 INFO:tasks.workunit.client.1.smithi194.stdout:9/142: chown d19/d27/d30 7237 1 2021-11-03T16:54:41.575 INFO:tasks.workunit.client.1.smithi194.stdout:9/143: readlink d19/d27/l2b 0 2021-11-03T16:54:41.576 INFO:tasks.workunit.client.1.smithi194.stdout:7/72: rename d6/lc to d6/l14 0 2021-11-03T16:54:41.577 INFO:tasks.workunit.client.1.smithi194.stdout:9/144: unlink l12 0 2021-11-03T16:54:41.579 INFO:tasks.workunit.client.1.smithi194.stdout:7/73: mkdir d6/d15 0 2021-11-03T16:54:41.580 INFO:tasks.workunit.client.1.smithi194.stdout:9/145: creat d19/d27/d30/f31 x:0 0 0 2021-11-03T16:54:41.581 INFO:tasks.workunit.client.1.smithi194.stdout:7/74: rmdir d6/d13 0 2021-11-03T16:54:41.582 INFO:tasks.workunit.client.1.smithi194.stdout:7/75: read f0 [2036320,127284] 0 2021-11-03T16:54:41.582 INFO:tasks.workunit.client.1.smithi194.stdout:9/146: creat d19/d27/f32 x:0 0 0 2021-11-03T16:54:41.585 INFO:tasks.workunit.client.1.smithi194.stdout:7/76: getdents d6/da 0 2021-11-03T16:54:41.585 INFO:tasks.workunit.client.1.smithi194.stdout:7/77: chown f4 13821181 1 2021-11-03T16:54:41.585 INFO:tasks.workunit.client.1.smithi194.stdout:7/78: stat f4 0 2021-11-03T16:54:41.585 INFO:tasks.workunit.client.1.smithi194.stdout:7/79: readlink d6/lf 0 2021-11-03T16:54:41.586 INFO:tasks.workunit.client.1.smithi194.stdout:7/80: mknod d6/d15/c16 1 2021-11-03T16:54:41.586 INFO:tasks.workunit.client.1.smithi194.stdout:7/81: chown l3 23133286 1 2021-11-03T16:54:41.588 INFO:tasks.workunit.client.1.smithi194.stdout:7/82: unlink f0 0 2021-11-03T16:54:41.589 INFO:tasks.workunit.client.1.smithi194.stdout:7/83: mknod d6/da/c17 1 2021-11-03T16:54:41.590 INFO:tasks.workunit.client.1.smithi194.stdout:7/84: link d6/ld d6/l18 0 2021-11-03T16:54:41.592 INFO:tasks.workunit.client.1.smithi194.stdout:7/85: creat d6/f19 x:0 0 0 2021-11-03T16:54:41.592 INFO:tasks.workunit.client.1.smithi194.stdout:7/86: chown d6/d15 14863 1 2021-11-03T16:54:41.593 INFO:tasks.workunit.client.1.smithi194.stdout:7/87: link l3 d6/d15/l1a 0 2021-11-03T16:54:41.600 INFO:tasks.workunit.client.1.smithi194.stdout:7/88: rename d6/lf to d6/l1b 0 2021-11-03T16:54:41.600 INFO:tasks.workunit.client.1.smithi194.stdout:7/89: chown f5 17944 1 2021-11-03T16:54:41.600 INFO:tasks.workunit.client.1.smithi194.stdout:7/90: mknod d6/c1c 1 2021-11-03T16:54:41.601 INFO:tasks.workunit.client.1.smithi194.stdout:7/91: write d6/f19 [517513,115524] 0 2021-11-03T16:54:41.601 INFO:tasks.workunit.client.1.smithi194.stdout:9/147: dwrite f15 [0,4194304] 0 2021-11-03T16:54:41.609 INFO:tasks.workunit.client.1.smithi194.stdout:9/148: mkdir d19/d33 0 2021-11-03T16:54:41.621 INFO:tasks.workunit.client.1.smithi194.stdout:7/92: dread f5 [0,4194304] 0 2021-11-03T16:54:41.623 INFO:tasks.workunit.client.1.smithi194.stdout:7/93: stat d6/l1b 0 2021-11-03T16:54:41.625 INFO:tasks.workunit.client.1.smithi194.stdout:7/94: rename f5 to d6/d15/f1d 0 2021-11-03T16:54:41.635 INFO:tasks.workunit.client.1.smithi194.stdout:7/95: rmdir d6 39 2021-11-03T16:54:41.635 INFO:tasks.workunit.client.1.smithi194.stdout:7/96: mknod d6/d15/c1e 1 2021-11-03T16:54:41.636 INFO:tasks.workunit.client.1.smithi194.stdout:7/97: creat d6/d15/f1f x:0 0 0 2021-11-03T16:54:41.637 INFO:tasks.workunit.client.1.smithi194.stdout:7/98: write d6/d15/f1d [1687523,22875] 0 2021-11-03T16:54:41.638 INFO:tasks.workunit.client.1.smithi194.stdout:7/99: creat d6/f20 x:0 0 0 2021-11-03T16:54:41.639 INFO:tasks.workunit.client.1.smithi194.stdout:7/100: truncate d6/d15/f1f 156600 0 2021-11-03T16:54:41.639 INFO:tasks.workunit.client.1.smithi194.stdout:7/101: readlink d6/l1b 0 2021-11-03T16:54:41.640 INFO:tasks.workunit.client.1.smithi194.stdout:7/102: symlink d6/da/l21 0 2021-11-03T16:54:41.641 INFO:tasks.workunit.client.1.smithi194.stdout:7/103: rename l3 to d6/da/l22 0 2021-11-03T16:54:41.641 INFO:tasks.workunit.client.1.smithi194.stdout:7/104: truncate d6/da/f10 802742 0 2021-11-03T16:54:41.643 INFO:tasks.workunit.client.1.smithi194.stdout:7/105: creat d6/f23 x:0 0 0 2021-11-03T16:54:41.643 INFO:tasks.workunit.client.1.smithi194.stdout:7/106: write d6/d15/f1d [61049,46000] 0 2021-11-03T16:54:41.648 INFO:tasks.workunit.client.1.smithi194.stdout:7/107: getdents d6 0 2021-11-03T16:54:41.649 INFO:tasks.workunit.client.1.smithi194.stdout:7/108: fsync d6/f19 0 2021-11-03T16:54:41.649 INFO:tasks.workunit.client.1.smithi194.stdout:7/109: rmdir d6 39 2021-11-03T16:54:41.649 INFO:tasks.workunit.client.1.smithi194.stdout:7/110: fsync d6/da/f10 0 2021-11-03T16:54:41.651 INFO:tasks.workunit.client.1.smithi194.stdout:7/111: mkdir d6/d24 0 2021-11-03T16:54:41.651 INFO:tasks.workunit.client.1.smithi194.stdout:7/112: chown d6/f20 3345 1 2021-11-03T16:54:41.652 INFO:tasks.workunit.client.1.smithi194.stdout:7/113: rmdir d6/da 39 2021-11-03T16:54:41.653 INFO:tasks.workunit.client.1.smithi194.stdout:7/114: mknod d6/da/c25 1 2021-11-03T16:54:41.654 INFO:tasks.workunit.client.1.smithi194.stdout:4/177: sync 2021-11-03T16:54:41.654 INFO:tasks.workunit.client.1.smithi194.stdout:4/178: dread - d6/d12/d1e/f2e zero size 2021-11-03T16:54:41.655 INFO:tasks.workunit.client.1.smithi194.stdout:7/115: link d6/da/l21 d6/l26 0 2021-11-03T16:54:41.656 INFO:tasks.workunit.client.1.smithi194.stdout:7/116: creat d6/da/f27 x:0 0 0 2021-11-03T16:54:41.657 INFO:tasks.workunit.client.1.smithi194.stdout:7/117: creat d6/d15/f28 x:0 0 0 2021-11-03T16:54:41.657 INFO:tasks.workunit.client.1.smithi194.stdout:7/118: write d6/f23 [595441,71874] 0 2021-11-03T16:54:41.657 INFO:tasks.workunit.client.1.smithi194.stdout:7/119: symlink d6/da/l29 0 2021-11-03T16:54:41.659 INFO:tasks.workunit.client.1.smithi194.stdout:7/120: creat d6/f2a x:0 0 0 2021-11-03T16:54:41.660 INFO:tasks.workunit.client.1.smithi194.stdout:4/179: dread d6/d12/d1e/f24 [0,4194304] 0 2021-11-03T16:54:41.662 INFO:tasks.workunit.client.1.smithi194.stdout:7/121: unlink d6/d15/l1a 0 2021-11-03T16:54:41.664 INFO:tasks.workunit.client.1.smithi194.stdout:4/180: creat d6/f35 x:0 0 0 2021-11-03T16:54:41.664 INFO:tasks.workunit.client.1.smithi194.stdout:4/181: chown d6/d12/d1e/f26 199604905 1 2021-11-03T16:54:41.664 INFO:tasks.workunit.client.1.smithi194.stdout:4/182: chown d6/f30 357411233 1 2021-11-03T16:54:41.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:41 smithi026 conmon[32119]: audit 2021-11-03T16:54:39.402148+0000 mgr.smithi026.cnrxli ( 2021-11-03T16:54:41.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:41 smithi026 conmon[32119]: mgr.14162) 313 : audit [DBG] from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:54:41.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:41 smithi026 conmon[32119]: audit 2021-11-03T16:54:40.302570+0000 mon.smithi026 (mon.0) 563 : audit [DBG] from='client.? 172.21.15.26:0/278507563' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T16:54:41.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:41 smithi026 conmon[32119]: audit 2021-11-03T16:54:40.377375+0000 mon.smithi026 (mon.0) 564 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:54:41.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:41 smithi026 conmon[32119]: audit 2021-11-03T 2021-11-03T16:54:41.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:41 smithi026 conmon[32119]: 16:54:40.378108+0000 mon.smithi026 (mon.0) 565 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:54:41.698 INFO:tasks.workunit.client.1.smithi194.stdout:7/122: dwrite d6/f19 [0,4194304] 0 2021-11-03T16:54:41.699 INFO:tasks.workunit.client.1.smithi194.stdout:7/123: write d6/f20 [339656,90307] 0 2021-11-03T16:54:41.699 INFO:tasks.workunit.client.1.smithi194.stdout:4/183: dwrite d6/d12/d1e/f26 [0,4194304] 0 2021-11-03T16:54:41.701 INFO:tasks.workunit.client.1.smithi194.stdout:7/124: mkdir d6/da/d2b 0 2021-11-03T16:54:41.702 INFO:tasks.workunit.client.1.smithi194.stdout:4/184: creat d6/d8/d1a/d14/f36 x:0 0 0 2021-11-03T16:54:41.706 INFO:tasks.workunit.client.1.smithi194.stdout:7/125: rename d6/l14 to d6/da/d2b/l2c 0 2021-11-03T16:54:41.707 INFO:tasks.workunit.client.1.smithi194.stdout:4/185: symlink d6/d8/d1a/d14/l37 0 2021-11-03T16:54:41.709 INFO:tasks.workunit.client.1.smithi194.stdout:7/126: link f4 d6/f2d 0 2021-11-03T16:54:41.710 INFO:tasks.workunit.client.1.smithi194.stdout:4/186: getdents d6/d12 0 2021-11-03T16:54:41.711 INFO:tasks.workunit.client.1.smithi194.stdout:7/127: getdents d6/d15 0 2021-11-03T16:54:41.712 INFO:tasks.workunit.client.1.smithi194.stdout:7/128: truncate d6/f23 1171117 0 2021-11-03T16:54:41.712 INFO:tasks.workunit.client.1.smithi194.stdout:7/129: chown d6/da/l29 2 1 2021-11-03T16:54:41.712 INFO:tasks.workunit.client.1.smithi194.stdout:7/130: dread - d6/da/f27 zero size 2021-11-03T16:54:41.713 INFO:tasks.workunit.client.1.smithi194.stdout:7/131: fsync d6/da/f10 0 2021-11-03T16:54:41.713 INFO:tasks.workunit.client.1.smithi194.stdout:4/187: creat d6/d8/f38 x:0 0 0 2021-11-03T16:54:41.714 INFO:tasks.workunit.client.1.smithi194.stdout:7/132: mkdir d6/d2e 0 2021-11-03T16:54:41.714 INFO:tasks.workunit.client.1.smithi194.stdout:7/133: dread - d6/da/f27 zero size 2021-11-03T16:54:41.718 INFO:tasks.workunit.client.1.smithi194.stdout:4/188: truncate d6/d8/d1a/d2b/f2c 900118 0 2021-11-03T16:54:41.719 INFO:tasks.workunit.client.1.smithi194.stdout:7/134: creat d6/f2f x:0 0 0 2021-11-03T16:54:41.719 INFO:tasks.workunit.client.1.smithi194.stdout:7/135: mknod d6/d15/c30 1 2021-11-03T16:54:41.721 INFO:tasks.workunit.client.1.smithi194.stdout:4/189: link d6/f35 d6/d8/f39 0 2021-11-03T16:54:41.721 INFO:tasks.workunit.client.1.smithi194.stdout:4/190: mknod d6/d12/d1e/c3a 1 2021-11-03T16:54:41.723 INFO:tasks.workunit.client.1.smithi194.stdout:4/191: creat d6/f3b x:0 0 0 2021-11-03T16:54:41.725 INFO:tasks.workunit.client.1.smithi194.stdout:4/192: symlink d6/d8/d1a/d14/l3c 0 2021-11-03T16:54:41.727 INFO:tasks.workunit.client.1.smithi194.stdout:4/193: creat d6/d8/d1a/f3d x:0 0 0 2021-11-03T16:54:41.729 INFO:tasks.workunit.client.1.smithi194.stdout:4/194: creat d6/d8/d1a/d14/f3e x:0 0 0 2021-11-03T16:54:41.744 INFO:tasks.workunit.client.1.smithi194.stdout:7/136: dwrite d6/f19 [0,4194304] 0 2021-11-03T16:54:41.746 INFO:tasks.workunit.client.1.smithi194.stdout:7/137: creat d6/da/d2b/f31 x:0 0 0 2021-11-03T16:54:41.746 INFO:tasks.workunit.client.1.smithi194.stdout:7/138: chown d6/d15/f1f 1462 1 2021-11-03T16:54:41.746 INFO:tasks.workunit.client.1.smithi194.stdout:7/139: chown d6/d2e 424269257 1 2021-11-03T16:54:41.747 INFO:tasks.workunit.client.1.smithi194.stdout:7/140: mkdir d6/d32 0 2021-11-03T16:54:41.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:41 smithi194 conmon[35111]: audit 2021-11-03T16:54:39.402148+0000 mgr.smithi026.cnrxli (mgr.14162) 313 : 2021-11-03T16:54:41.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:41 smithi194 conmon[35111]: audit [DBG] from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:54:41.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:41 smithi194 conmon[35111]: audit 2021-11-03T16:54:40.302570+0000 mon.smithi026 (mon.0) 563 : audit [DBG] from='client.? 172.21.15.26:0/278507563' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T16:54:41.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:41 smithi194 conmon[35111]: audit 2021-11-03T16:54:40.377375+0000 mon.smithi026 (mon.0) 564 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:54:41.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:41 smithi194 conmon[35111]: audit 2021-11-03T16:54:40.378108+0000 mon.smithi026 (mon.0) 565 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:54:41.752 INFO:tasks.workunit.client.1.smithi194.stdout:7/141: rmdir d6/da 39 2021-11-03T16:54:41.754 INFO:tasks.workunit.client.1.smithi194.stdout:7/142: creat d6/d2e/f33 x:0 0 0 2021-11-03T16:54:41.754 INFO:tasks.workunit.client.1.smithi194.stdout:7/143: mknod d6/da/d2b/c34 1 2021-11-03T16:54:41.770 INFO:tasks.workunit.client.1.smithi194.stdout:7/144: dwrite d6/d15/f1d [0,4194304] 0 2021-11-03T16:54:41.770 INFO:tasks.workunit.client.1.smithi194.stdout:7/145: fdatasync d6/da/f27 0 2021-11-03T16:54:41.789 INFO:tasks.workunit.client.1.smithi194.stdout:7/146: dwrite d6/f2d [0,4194304] 0 2021-11-03T16:54:41.789 INFO:tasks.workunit.client.1.smithi194.stdout:7/147: mknod d6/c35 1 2021-11-03T16:54:41.790 INFO:tasks.workunit.client.1.smithi194.stdout:7/148: fsync d6/f19 0 2021-11-03T16:54:41.791 INFO:tasks.workunit.client.1.smithi194.stdout:7/149: creat d6/d2e/f36 x:0 0 0 2021-11-03T16:54:41.791 INFO:tasks.workunit.client.1.smithi194.stdout:7/150: rmdir d6/d15 39 2021-11-03T16:54:41.799 INFO:tasks.workunit.client.1.smithi194.stdout:7/151: dread d6/f2d [0,4194304] 0 2021-11-03T16:54:41.801 INFO:tasks.workunit.client.1.smithi194.stdout:7/152: link d6/da/f27 d6/da/d2b/f37 0 2021-11-03T16:54:41.801 INFO:tasks.workunit.client.1.smithi194.stdout:7/153: chown d6/f23 6870583 1 2021-11-03T16:54:41.801 INFO:tasks.workunit.client.1.smithi194.stdout:7/154: truncate d6/f2f 251374 0 2021-11-03T16:54:41.802 INFO:tasks.workunit.client.1.smithi194.stdout:7/155: creat d6/d15/f38 x:0 0 0 2021-11-03T16:54:41.803 INFO:tasks.workunit.client.1.smithi194.stdout:7/156: symlink d6/d15/l39 0 2021-11-03T16:54:41.803 INFO:tasks.workunit.client.1.smithi194.stdout:7/157: mknod d6/d2e/c3a 1 2021-11-03T16:54:41.803 INFO:tasks.workunit.client.1.smithi194.stdout:7/158: mknod d6/da/c3b 1 2021-11-03T16:54:41.804 INFO:tasks.workunit.client.1.smithi194.stdout:7/159: dread - d6/da/d2b/f31 zero size 2021-11-03T16:54:41.805 INFO:tasks.workunit.client.1.smithi194.stdout:7/160: rename d6/da/d2b/l2c to d6/l3c 0 2021-11-03T16:54:41.806 INFO:tasks.workunit.client.1.smithi194.stdout:7/161: mknod d6/da/d2b/c3d 1 2021-11-03T16:54:41.806 INFO:tasks.workunit.client.1.smithi194.stdout:7/162: readlink d6/da/l29 0 2021-11-03T16:54:41.812 INFO:tasks.workunit.client.1.smithi194.stdout:1/45: sync 2021-11-03T16:54:41.816 INFO:tasks.workunit.client.1.smithi194.stdout:1/46: dread d2/f6 [0,4194304] 0 2021-11-03T16:54:41.816 INFO:tasks.workunit.client.1.smithi194.stdout:1/47: chown d2 1 1 2021-11-03T16:54:41.817 INFO:tasks.workunit.client.1.smithi194.stdout:1/48: chown d2/f6 64768299 1 2021-11-03T16:54:41.817 INFO:tasks.workunit.client.1.smithi194.stdout:1/49: fdatasync d2/f6 0 2021-11-03T16:54:41.818 INFO:tasks.workunit.client.1.smithi194.stdout:1/50: symlink d2/lc 0 2021-11-03T16:54:41.834 INFO:tasks.workunit.client.1.smithi194.stdout:7/163: dwrite d6/da/d2b/f31 [0,4194304] 0 2021-11-03T16:54:41.834 INFO:tasks.workunit.client.1.smithi194.stdout:7/164: mknod d6/d32/c3e 1 2021-11-03T16:54:41.834 INFO:tasks.workunit.client.1.smithi194.stdout:7/165: fdatasync f4 0 2021-11-03T16:54:41.835 INFO:tasks.workunit.client.1.smithi194.stdout:1/51: dwrite d2/f9 [0,4194304] 0 2021-11-03T16:54:41.841 INFO:tasks.workunit.client.1.smithi194.stdout:1/52: dread d2/f9 [0,4194304] 0 2021-11-03T16:54:41.844 INFO:tasks.workunit.client.1.smithi194.stdout:1/53: creat d2/fd x:0 0 0 2021-11-03T16:54:41.845 INFO:tasks.workunit.client.1.smithi194.stdout:1/54: mknod d2/ce 1 2021-11-03T16:54:41.847 INFO:tasks.workunit.client.1.smithi194.stdout:1/55: creat d2/da/ff x:0 0 0 2021-11-03T16:54:41.849 INFO:tasks.workunit.client.1.smithi194.stdout:1/56: unlink d2/lc 0 2021-11-03T16:54:41.850 INFO:tasks.workunit.client.1.smithi194.stdout:1/57: creat d2/f10 x:0 0 0 2021-11-03T16:54:41.850 INFO:tasks.workunit.client.1.smithi194.stdout:1/58: readlink d2/l7 0 2021-11-03T16:54:41.851 INFO:tasks.workunit.client.1.smithi194.stdout:1/59: creat d2/da/f11 x:0 0 0 2021-11-03T16:54:41.852 INFO:tasks.workunit.client.1.smithi194.stdout:7/166: dwrite d6/f2d [0,4194304] 0 2021-11-03T16:54:41.853 INFO:tasks.workunit.client.1.smithi194.stdout:1/60: rename d2/f9 to d2/f12 0 2021-11-03T16:54:41.854 INFO:tasks.workunit.client.1.smithi194.stdout:1/61: dread - d2/fd zero size 2021-11-03T16:54:41.854 INFO:tasks.workunit.client.1.smithi194.stdout:7/167: symlink d6/d32/l3f 0 2021-11-03T16:54:41.859 INFO:tasks.workunit.client.1.smithi194.stdout:1/62: mkdir d2/da/d13 0 2021-11-03T16:54:41.870 INFO:tasks.workunit.client.1.smithi194.stdout:1/63: dwrite d2/f6 [0,4194304] 0 2021-11-03T16:54:41.870 INFO:tasks.workunit.client.1.smithi194.stdout:1/64: fdatasync d2/f6 0 2021-11-03T16:54:41.876 INFO:tasks.workunit.client.1.smithi194.stdout:1/65: creat d2/da/d13/f14 x:0 0 0 2021-11-03T16:54:41.876 INFO:tasks.workunit.client.1.smithi194.stdout:1/66: write d2/da/ff [25734,58795] 0 2021-11-03T16:54:41.876 INFO:tasks.workunit.client.1.smithi194.stdout:1/67: chown d2/l4 1 1 2021-11-03T16:54:41.881 INFO:tasks.workunit.client.1.smithi194.stdout:1/68: creat d2/f15 x:0 0 0 2021-11-03T16:54:41.881 INFO:tasks.workunit.client.1.smithi194.stdout:1/69: rename d2/da to d2/da/d16 22 2021-11-03T16:54:41.882 INFO:tasks.workunit.client.1.smithi194.stdout:1/70: creat d2/da/d13/f17 x:0 0 0 2021-11-03T16:54:41.883 INFO:tasks.workunit.client.1.smithi194.stdout:1/71: truncate d2/f12 3604673 0 2021-11-03T16:54:41.884 INFO:tasks.workunit.client.1.smithi194.stdout:1/72: creat d2/f18 x:0 0 0 2021-11-03T16:54:41.884 INFO:tasks.workunit.client.1.smithi194.stdout:1/73: read - d2/da/d13/f17 zero size 2021-11-03T16:54:41.884 INFO:tasks.workunit.client.1.smithi194.stdout:1/74: mknod d2/da/c19 1 2021-11-03T16:54:41.885 INFO:tasks.workunit.client.1.smithi194.stdout:1/75: mknod d2/c1a 1 2021-11-03T16:54:42.007 INFO:tasks.workunit.client.0.smithi026.stdout:6/5: sync 2021-11-03T16:54:42.008 INFO:tasks.workunit.client.0.smithi026.stdout:6/6: readlink - no filename 2021-11-03T16:54:42.041 INFO:tasks.workunit.client.0.smithi026.stdout:3/14: sync 2021-11-03T16:54:42.042 INFO:tasks.workunit.client.0.smithi026.stdout:4/8: sync 2021-11-03T16:54:42.042 INFO:tasks.workunit.client.0.smithi026.stdout:8/23: sync 2021-11-03T16:54:42.042 INFO:tasks.workunit.client.0.smithi026.stdout:0/0: sync 2021-11-03T16:54:42.043 INFO:tasks.workunit.client.0.smithi026.stdout:0/1: rmdir - no directory 2021-11-03T16:54:42.043 INFO:tasks.workunit.client.0.smithi026.stdout:3/15: chown f1 45886 1 2021-11-03T16:54:42.043 INFO:tasks.workunit.client.0.smithi026.stdout:4/9: dread - f2 zero size 2021-11-03T16:54:42.043 INFO:tasks.workunit.client.0.smithi026.stdout:8/24: truncate d2/f5 377132 0 2021-11-03T16:54:42.044 INFO:tasks.workunit.client.0.smithi026.stdout:3/16: dread f1 [0,4194304] 0 2021-11-03T16:54:42.044 INFO:tasks.workunit.client.0.smithi026.stdout:4/10: creat f4 x:0 0 0 2021-11-03T16:54:42.045 INFO:tasks.workunit.client.0.smithi026.stdout:4/11: dread - f2 zero size 2021-11-03T16:54:42.045 INFO:tasks.workunit.client.0.smithi026.stdout:0/2: creat f0 x:0 0 0 2021-11-03T16:54:42.047 INFO:tasks.workunit.client.0.smithi026.stdout:8/25: unlink d2/f4 0 2021-11-03T16:54:42.049 INFO:tasks.workunit.client.0.smithi026.stdout:3/17: symlink l6 0 2021-11-03T16:54:42.049 INFO:tasks.workunit.client.0.smithi026.stdout:3/18: truncate f4 533803 0 2021-11-03T16:54:42.050 INFO:tasks.workunit.client.0.smithi026.stdout:3/19: write f4 [20243,119630] 0 2021-11-03T16:54:42.050 INFO:tasks.workunit.client.0.smithi026.stdout:3/20: mknod c7 1 2021-11-03T16:54:42.050 INFO:tasks.workunit.client.0.smithi026.stdout:4/12: creat f5 x:0 0 0 2021-11-03T16:54:42.052 INFO:tasks.workunit.client.0.smithi026.stdout:3/21: rename l6 to l8 0 2021-11-03T16:54:42.052 INFO:tasks.workunit.client.0.smithi026.stdout:3/22: write f1 [1168992,76939] 0 2021-11-03T16:54:42.052 INFO:tasks.workunit.client.0.smithi026.stdout:3/23: truncate f1 1463674 0 2021-11-03T16:54:42.053 INFO:tasks.workunit.client.0.smithi026.stdout:4/13: symlink l6 0 2021-11-03T16:54:42.060 INFO:tasks.workunit.client.0.smithi026.stdout:3/24: link l8 l9 0 2021-11-03T16:54:42.060 INFO:tasks.workunit.client.0.smithi026.stdout:3/25: truncate f4 917793 0 2021-11-03T16:54:42.065 INFO:tasks.workunit.client.0.smithi026.stdout:9/21: sync 2021-11-03T16:54:42.066 INFO:tasks.workunit.client.0.smithi026.stdout:1/40: sync 2021-11-03T16:54:42.066 INFO:tasks.workunit.client.0.smithi026.stdout:9/22: dread - no filename 2021-11-03T16:54:42.066 INFO:tasks.workunit.client.0.smithi026.stdout:9/23: write - no filename 2021-11-03T16:54:42.066 INFO:tasks.workunit.client.0.smithi026.stdout:7/89: sync 2021-11-03T16:54:42.067 INFO:tasks.workunit.client.0.smithi026.stdout:2/2: sync 2021-11-03T16:54:42.067 INFO:tasks.workunit.client.0.smithi026.stdout:4/14: dwrite f4 [0,4194304] 0 2021-11-03T16:54:42.068 INFO:tasks.workunit.client.0.smithi026.stdout:1/41: mkdir dc/df 0 2021-11-03T16:54:42.068 INFO:tasks.workunit.client.0.smithi026.stdout:1/42: fdatasync f7 0 2021-11-03T16:54:42.070 INFO:tasks.workunit.client.0.smithi026.stdout:7/90: link f7 da/d14/d15/f18 0 2021-11-03T16:54:42.070 INFO:tasks.workunit.client.0.smithi026.stdout:9/24: getdents d2/d5 0 2021-11-03T16:54:42.074 INFO:tasks.workunit.client.0.smithi026.stdout:1/43: mkdir dc/df/d10 0 2021-11-03T16:54:42.076 INFO:tasks.workunit.client.0.smithi026.stdout:7/91: creat da/d14/f19 x:0 0 0 2021-11-03T16:54:42.080 INFO:tasks.workunit.client.0.smithi026.stdout:9/25: getdents d2 0 2021-11-03T16:54:42.080 INFO:tasks.workunit.client.0.smithi026.stdout:9/26: write - no filename 2021-11-03T16:54:42.080 INFO:tasks.workunit.client.0.smithi026.stdout:9/27: chown d2/d5 1 1 2021-11-03T16:54:42.081 INFO:tasks.workunit.client.0.smithi026.stdout:9/28: readlink d2/d5/l6 0 2021-11-03T16:54:42.081 INFO:tasks.workunit.client.0.smithi026.stdout:9/29: readlink d2/d5/l6 0 2021-11-03T16:54:42.082 INFO:tasks.workunit.client.0.smithi026.stdout:7/92: unlink da/f12 0 2021-11-03T16:54:42.082 INFO:tasks.workunit.client.0.smithi026.stdout:7/93: stat da/lb 0 2021-11-03T16:54:42.083 INFO:tasks.workunit.client.0.smithi026.stdout:9/30: creat d2/f8 x:0 0 0 2021-11-03T16:54:42.093 INFO:tasks.workunit.client.0.smithi026.stdout:3/26: dwrite f1 [0,4194304] 0 2021-11-03T16:54:42.093 INFO:tasks.workunit.client.0.smithi026.stdout:3/27: truncate f1 4944901 0 2021-11-03T16:54:42.095 INFO:tasks.workunit.client.0.smithi026.stdout:3/28: link f4 fa 0 2021-11-03T16:54:42.114 INFO:tasks.workunit.client.0.smithi026.stdout:2/3: dwrite f0 [0,4194304] 0 2021-11-03T16:54:42.115 INFO:tasks.workunit.client.0.smithi026.stdout:4/15: dwrite f2 [0,4194304] 0 2021-11-03T16:54:42.115 INFO:tasks.workunit.client.0.smithi026.stdout:4/16: rmdir - no directory 2021-11-03T16:54:42.115 INFO:tasks.workunit.client.0.smithi026.stdout:4/17: dread - f5 zero size 2021-11-03T16:54:42.116 INFO:tasks.workunit.client.0.smithi026.stdout:4/18: chown f2 12 1 2021-11-03T16:54:42.116 INFO:tasks.workunit.client.0.smithi026.stdout:1/44: dwrite dc/fe [0,4194304] 0 2021-11-03T16:54:42.116 INFO:tasks.workunit.client.0.smithi026.stdout:2/4: creat f2 x:0 0 0 2021-11-03T16:54:42.117 INFO:tasks.workunit.client.0.smithi026.stdout:7/94: dwrite da/d14/d15/f17 [0,4194304] 0 2021-11-03T16:54:42.117 INFO:tasks.workunit.client.0.smithi026.stdout:7/95: write f0 [5073516,14292] 0 2021-11-03T16:54:42.118 INFO:tasks.workunit.client.0.smithi026.stdout:9/31: dwrite d2/f8 [0,4194304] 0 2021-11-03T16:54:42.118 INFO:tasks.workunit.client.0.smithi026.stdout:2/5: write f0 [334947,88445] 0 2021-11-03T16:54:42.120 INFO:tasks.workunit.client.0.smithi026.stdout:7/96: dread da/fd [0,4194304] 0 2021-11-03T16:54:42.121 INFO:tasks.workunit.client.0.smithi026.stdout:2/6: fsync f0 0 2021-11-03T16:54:42.122 INFO:tasks.workunit.client.0.smithi026.stdout:7/97: write da/d14/d15/f17 [1202041,112751] 0 2021-11-03T16:54:42.122 INFO:tasks.workunit.client.0.smithi026.stdout:7/98: truncate da/f10 5701040 0 2021-11-03T16:54:42.122 INFO:tasks.workunit.client.0.smithi026.stdout:7/99: mknod da/d14/c1a 1 2021-11-03T16:54:42.123 INFO:tasks.workunit.client.0.smithi026.stdout:3/29: truncate f4 315070 0 2021-11-03T16:54:42.126 INFO:tasks.workunit.client.0.smithi026.stdout:4/19: creat f7 x:0 0 0 2021-11-03T16:54:42.127 INFO:tasks.workunit.client.0.smithi026.stdout:4/20: mknod c8 1 2021-11-03T16:54:42.127 INFO:tasks.workunit.client.0.smithi026.stdout:4/21: truncate f7 287997 0 2021-11-03T16:54:42.133 INFO:tasks.workunit.client.0.smithi026.stdout:7/100: creat da/d14/f1b x:0 0 0 2021-11-03T16:54:42.134 INFO:tasks.workunit.client.0.smithi026.stdout:3/30: creat fb x:0 0 0 2021-11-03T16:54:42.135 INFO:tasks.workunit.client.0.smithi026.stdout:4/22: creat f9 x:0 0 0 2021-11-03T16:54:42.136 INFO:tasks.workunit.client.0.smithi026.stdout:9/32: symlink d2/l9 0 2021-11-03T16:54:42.136 INFO:tasks.workunit.client.0.smithi026.stdout:9/33: chown d2/f8 236 1 2021-11-03T16:54:42.137 INFO:tasks.workunit.client.0.smithi026.stdout:7/101: mkdir da/d14/d1c 0 2021-11-03T16:54:42.140 INFO:tasks.workunit.client.0.smithi026.stdout:4/23: write f2 [787080,86360] 0 2021-11-03T16:54:42.140 INFO:tasks.workunit.client.0.smithi026.stdout:7/102: symlink da/l1d 0 2021-11-03T16:54:42.140 INFO:tasks.workunit.client.0.smithi026.stdout:7/103: fdatasync da/d14/f1b 0 2021-11-03T16:54:42.141 INFO:tasks.workunit.client.0.smithi026.stdout:1/45: dwrite f1 [4194304,4194304] 0 2021-11-03T16:54:42.141 INFO:tasks.workunit.client.0.smithi026.stdout:9/34: mkdir d2/da 0 2021-11-03T16:54:42.142 INFO:tasks.workunit.client.0.smithi026.stdout:2/7: dwrite f2 [0,4194304] 0 2021-11-03T16:54:42.142 INFO:tasks.workunit.client.0.smithi026.stdout:2/8: chown f2 347908 1 2021-11-03T16:54:42.143 INFO:tasks.workunit.client.0.smithi026.stdout:2/9: readlink - no filename 2021-11-03T16:54:42.143 INFO:tasks.workunit.client.0.smithi026.stdout:4/24: creat fa x:0 0 0 2021-11-03T16:54:42.143 INFO:tasks.workunit.client.0.smithi026.stdout:4/25: write f9 [265155,38094] 0 2021-11-03T16:54:42.144 INFO:tasks.workunit.client.0.smithi026.stdout:3/31: dread fa [0,4194304] 0 2021-11-03T16:54:42.144 INFO:tasks.workunit.client.0.smithi026.stdout:9/35: getdents d2/d5 0 2021-11-03T16:54:42.144 INFO:tasks.workunit.client.0.smithi026.stdout:1/46: write f1 [2413577,91698] 0 2021-11-03T16:54:42.145 INFO:tasks.workunit.client.0.smithi026.stdout:9/36: write d2/f8 [2841696,24237] 0 2021-11-03T16:54:42.149 INFO:tasks.workunit.client.0.smithi026.stdout:2/10: creat f3 x:0 0 0 2021-11-03T16:54:42.149 INFO:tasks.workunit.client.0.smithi026.stdout:3/32: write f1 [3736938,97873] 0 2021-11-03T16:54:42.150 INFO:tasks.workunit.client.0.smithi026.stdout:1/47: mkdir dc/df/d11 0 2021-11-03T16:54:42.150 INFO:tasks.workunit.client.0.smithi026.stdout:1/48: fsync f7 0 2021-11-03T16:54:42.151 INFO:tasks.workunit.client.0.smithi026.stdout:1/49: dread - f9 zero size 2021-11-03T16:54:42.151 INFO:tasks.workunit.client.0.smithi026.stdout:1/50: fsync f7 0 2021-11-03T16:54:42.152 INFO:tasks.workunit.client.0.smithi026.stdout:9/37: rename d2/l9 to d2/da/lb 0 2021-11-03T16:54:42.152 INFO:tasks.workunit.client.0.smithi026.stdout:1/51: rename dc/df/d11 to dc/df/d11/d12 22 2021-11-03T16:54:42.157 INFO:tasks.workunit.client.0.smithi026.stdout:2/11: rename f0 to f4 0 2021-11-03T16:54:42.159 INFO:tasks.workunit.client.0.smithi026.stdout:3/33: mkdir dc 0 2021-11-03T16:54:42.159 INFO:tasks.workunit.client.0.smithi026.stdout:9/38: write d2/f8 [345136,19374] 0 2021-11-03T16:54:42.159 INFO:tasks.workunit.client.0.smithi026.stdout:3/34: mknod dc/cd 1 2021-11-03T16:54:42.160 INFO:tasks.workunit.client.0.smithi026.stdout:1/52: symlink dc/df/d11/l13 0 2021-11-03T16:54:42.160 INFO:tasks.workunit.client.0.smithi026.stdout:1/53: dread - f9 zero size 2021-11-03T16:54:42.161 INFO:tasks.workunit.client.0.smithi026.stdout:3/35: write f1 [408593,31956] 0 2021-11-03T16:54:42.161 INFO:tasks.workunit.client.0.smithi026.stdout:7/104: dwrite da/fd [0,4194304] 0 2021-11-03T16:54:42.161 INFO:tasks.workunit.client.0.smithi026.stdout:3/36: write fb [228596,44258] 0 2021-11-03T16:54:42.162 INFO:tasks.workunit.client.0.smithi026.stdout:3/37: mknod dc/ce 1 2021-11-03T16:54:42.162 INFO:tasks.workunit.client.0.smithi026.stdout:1/54: write dc/fe [3226778,33546] 0 2021-11-03T16:54:42.163 INFO:tasks.workunit.client.0.smithi026.stdout:9/39: creat d2/da/fc x:0 0 0 2021-11-03T16:54:42.163 INFO:tasks.workunit.client.0.smithi026.stdout:9/40: write d2/da/fc [316018,55603] 0 2021-11-03T16:54:42.163 INFO:tasks.workunit.client.0.smithi026.stdout:9/41: mknod d2/d5/cd 1 2021-11-03T16:54:42.164 INFO:tasks.workunit.client.0.smithi026.stdout:7/105: unlink da/f10 0 2021-11-03T16:54:42.166 INFO:tasks.workunit.client.0.smithi026.stdout:3/38: rename l8 to dc/lf 0 2021-11-03T16:54:42.167 INFO:tasks.workunit.client.0.smithi026.stdout:1/55: link dc/fe dc/df/d11/f14 0 2021-11-03T16:54:42.169 INFO:tasks.workunit.client.0.smithi026.stdout:7/106: creat da/f1e x:0 0 0 2021-11-03T16:54:42.171 INFO:tasks.workunit.client.0.smithi026.stdout:4/26: dread f2 [0,4194304] 0 2021-11-03T16:54:42.171 INFO:tasks.workunit.client.0.smithi026.stdout:4/27: dread - fa zero size 2021-11-03T16:54:42.171 INFO:tasks.workunit.client.0.smithi026.stdout:4/28: write f7 [1098415,83942] 0 2021-11-03T16:54:42.173 INFO:tasks.workunit.client.0.smithi026.stdout:2/12: unlink f4 0 2021-11-03T16:54:42.173 INFO:tasks.workunit.client.0.smithi026.stdout:4/29: fdatasync f9 0 2021-11-03T16:54:42.176 INFO:tasks.workunit.client.0.smithi026.stdout:5/4: sync 2021-11-03T16:54:42.176 INFO:tasks.workunit.client.0.smithi026.stdout:5/5: chown . 1837 1 2021-11-03T16:54:42.176 INFO:tasks.workunit.client.0.smithi026.stdout:5/6: dwrite - no filename 2021-11-03T16:54:42.176 INFO:tasks.workunit.client.0.smithi026.stdout:5/7: dread - no filename 2021-11-03T16:54:42.177 INFO:tasks.workunit.client.0.smithi026.stdout:5/8: dwrite - no filename 2021-11-03T16:54:42.177 INFO:tasks.workunit.client.0.smithi026.stdout:5/9: write - no filename 2021-11-03T16:54:42.177 INFO:tasks.workunit.client.0.smithi026.stdout:3/39: symlink dc/l10 0 2021-11-03T16:54:42.177 INFO:tasks.workunit.client.0.smithi026.stdout:3/40: write fa [1322788,57680] 0 2021-11-03T16:54:42.178 INFO:tasks.workunit.client.0.smithi026.stdout:1/56: creat dc/df/d11/f15 x:0 0 0 2021-11-03T16:54:42.180 INFO:tasks.workunit.client.0.smithi026.stdout:4/30: symlink lb 0 2021-11-03T16:54:42.183 INFO:tasks.workunit.client.0.smithi026.stdout:3/41: rename f1 to dc/f11 0 2021-11-03T16:54:42.188 INFO:tasks.workunit.client.0.smithi026.stdout:1/57: rename dc/df/d11/f15 to dc/df/f16 0 2021-11-03T16:54:42.188 INFO:tasks.workunit.client.0.smithi026.stdout:1/58: write dc/fe [4727017,37515] 0 2021-11-03T16:54:42.188 INFO:tasks.workunit.client.0.smithi026.stdout:1/59: readlink la 0 2021-11-03T16:54:42.189 INFO:tasks.workunit.client.0.smithi026.stdout:3/42: mkdir dc/d12 0 2021-11-03T16:54:42.190 INFO:tasks.workunit.client.0.smithi026.stdout:1/60: creat dc/df/d11/f17 x:0 0 0 2021-11-03T16:54:42.199 INFO:tasks.workunit.client.0.smithi026.stdout:1/61: write dc/df/d11/f14 [2189440,58498] 0 2021-11-03T16:54:42.200 INFO:tasks.workunit.client.0.smithi026.stdout:1/62: chown dc/df/d10 2534 1 2021-11-03T16:54:42.200 INFO:tasks.workunit.client.0.smithi026.stdout:1/63: write dc/df/f16 [53275,36951] 0 2021-11-03T16:54:42.200 INFO:tasks.workunit.client.0.smithi026.stdout:7/107: dread da/fd [0,4194304] 0 2021-11-03T16:54:42.200 INFO:tasks.workunit.client.0.smithi026.stdout:4/31: read f7 [708948,60398] 0 2021-11-03T16:54:42.201 INFO:tasks.workunit.client.0.smithi026.stdout:9/42: dwrite d2/da/fc [0,4194304] 0 2021-11-03T16:54:42.201 INFO:tasks.workunit.client.0.smithi026.stdout:1/64: rmdir dc/df/d10 0 2021-11-03T16:54:42.202 INFO:tasks.workunit.client.0.smithi026.stdout:1/65: write f1 [5669549,1607] 0 2021-11-03T16:54:42.211 INFO:tasks.workunit.client.0.smithi026.stdout:3/43: getdents dc 0 2021-11-03T16:54:42.211 INFO:tasks.workunit.client.0.smithi026.stdout:3/44: read fb [89348,10305] 0 2021-11-03T16:54:42.212 INFO:tasks.workunit.client.0.smithi026.stdout:3/45: chown f4 41175 1 2021-11-03T16:54:42.212 INFO:tasks.workunit.client.0.smithi026.stdout:2/13: getdents . 0 2021-11-03T16:54:42.213 INFO:tasks.workunit.client.0.smithi026.stdout:3/46: dread fb [0,4194304] 0 2021-11-03T16:54:42.217 INFO:tasks.workunit.client.0.smithi026.stdout:4/32: creat fc x:0 0 0 2021-11-03T16:54:42.217 INFO:tasks.workunit.client.0.smithi026.stdout:7/108: write f7 [810028,86611] 0 2021-11-03T16:54:42.222 INFO:tasks.workunit.client.0.smithi026.stdout:1/66: symlink dc/df/d11/l18 0 2021-11-03T16:54:42.223 INFO:tasks.workunit.client.0.smithi026.stdout:3/47: stat l9 0 2021-11-03T16:54:42.223 INFO:tasks.workunit.client.0.smithi026.stdout:3/48: chown fb 0 1 2021-11-03T16:54:42.226 INFO:tasks.workunit.client.0.smithi026.stdout:4/33: creat fd x:0 0 0 2021-11-03T16:54:42.227 INFO:tasks.workunit.client.0.smithi026.stdout:7/109: creat da/f1f x:0 0 0 2021-11-03T16:54:42.227 INFO:tasks.workunit.client.0.smithi026.stdout:9/43: symlink d2/le 0 2021-11-03T16:54:42.227 INFO:tasks.workunit.client.0.smithi026.stdout:1/67: creat dc/f19 x:0 0 0 2021-11-03T16:54:42.228 INFO:tasks.workunit.client.0.smithi026.stdout:2/14: dwrite f3 [0,4194304] 0 2021-11-03T16:54:42.228 INFO:tasks.workunit.client.0.smithi026.stdout:3/49: mkdir dc/d12/d13 0 2021-11-03T16:54:42.228 INFO:tasks.workunit.client.0.smithi026.stdout:4/34: creat fe x:0 0 0 2021-11-03T16:54:42.229 INFO:tasks.workunit.client.0.smithi026.stdout:7/110: unlink da/f1e 0 2021-11-03T16:54:42.230 INFO:tasks.workunit.client.0.smithi026.stdout:9/44: creat d2/da/ff x:0 0 0 2021-11-03T16:54:42.233 INFO:tasks.workunit.client.0.smithi026.stdout:1/68: symlink dc/df/d11/l1a 0 2021-11-03T16:54:42.233 INFO:tasks.workunit.client.0.smithi026.stdout:1/69: mknod dc/df/d11/c1b 1 2021-11-03T16:54:42.234 INFO:tasks.workunit.client.0.smithi026.stdout:1/70: mknod dc/df/c1c 1 2021-11-03T16:54:42.235 INFO:tasks.workunit.client.0.smithi026.stdout:2/15: creat f5 x:0 0 0 2021-11-03T16:54:42.236 INFO:tasks.workunit.client.0.smithi026.stdout:3/50: link dc/l10 dc/d12/l14 0 2021-11-03T16:54:42.236 INFO:tasks.workunit.client.0.smithi026.stdout:3/51: chown dc/d12 24843696 1 2021-11-03T16:54:42.237 INFO:tasks.workunit.client.0.smithi026.stdout:7/111: unlink f7 0 2021-11-03T16:54:42.238 INFO:tasks.workunit.client.0.smithi026.stdout:9/45: rmdir d2/d5 39 2021-11-03T16:54:42.239 INFO:tasks.workunit.client.0.smithi026.stdout:4/35: dwrite fd [0,4194304] 0 2021-11-03T16:54:42.240 INFO:tasks.workunit.client.0.smithi026.stdout:4/36: truncate f5 923473 0 2021-11-03T16:54:42.241 INFO:tasks.workunit.client.0.smithi026.stdout:3/52: unlink fb 0 2021-11-03T16:54:42.242 INFO:tasks.workunit.client.0.smithi026.stdout:7/112: mkdir da/d20 0 2021-11-03T16:54:42.245 INFO:tasks.workunit.client.0.smithi026.stdout:9/46: rename d2/f8 to d2/d5/f10 0 2021-11-03T16:54:42.247 INFO:tasks.workunit.client.0.smithi026.stdout:1/71: fsync dc/fe 0 2021-11-03T16:54:42.247 INFO:tasks.workunit.client.0.smithi026.stdout:1/72: write dc/f19 [952531,122604] 0 2021-11-03T16:54:42.250 INFO:tasks.workunit.client.0.smithi026.stdout:4/37: creat ff x:0 0 0 2021-11-03T16:54:42.250 INFO:tasks.workunit.client.0.smithi026.stdout:4/38: readlink l6 0 2021-11-03T16:54:42.261 INFO:tasks.workunit.client.0.smithi026.stdout:1/73: creat dc/f1d x:0 0 0 2021-11-03T16:54:42.261 INFO:tasks.workunit.client.0.smithi026.stdout:2/16: getdents . 0 2021-11-03T16:54:42.262 INFO:tasks.workunit.client.0.smithi026.stdout:4/39: creat f10 x:0 0 0 2021-11-03T16:54:42.265 INFO:tasks.workunit.client.0.smithi026.stdout:1/74: link dc/df/d11/f14 dc/f1e 0 2021-11-03T16:54:42.267 INFO:tasks.workunit.client.0.smithi026.stdout:1/75: creat dc/f1f x:0 0 0 2021-11-03T16:54:42.269 INFO:tasks.workunit.client.0.smithi026.stdout:1/76: rename dc/f19 to dc/df/f20 0 2021-11-03T16:54:42.270 INFO:tasks.workunit.client.0.smithi026.stdout:3/53: dwrite f4 [0,4194304] 0 2021-11-03T16:54:42.271 INFO:tasks.workunit.client.0.smithi026.stdout:3/54: mknod dc/d12/c15 1 2021-11-03T16:54:42.272 INFO:tasks.workunit.client.0.smithi026.stdout:1/77: write dc/f1e [3284547,79786] 0 2021-11-03T16:54:42.272 INFO:tasks.workunit.client.0.smithi026.stdout:1/78: stat dc/df/d11/l18 0 2021-11-03T16:54:42.272 INFO:tasks.workunit.client.0.smithi026.stdout:1/79: dread - f7 zero size 2021-11-03T16:54:42.273 INFO:tasks.workunit.client.0.smithi026.stdout:9/47: dwrite d2/da/ff [0,4194304] 0 2021-11-03T16:54:42.273 INFO:tasks.workunit.client.0.smithi026.stdout:3/55: creat dc/d12/f16 x:0 0 0 2021-11-03T16:54:42.277 INFO:tasks.workunit.client.0.smithi026.stdout:1/80: unlink dc/f1f 0 2021-11-03T16:54:42.282 INFO:tasks.workunit.client.0.smithi026.stdout:3/56: rmdir dc 39 2021-11-03T16:54:42.283 INFO:tasks.workunit.client.0.smithi026.stdout:2/17: dwrite f3 [4194304,4194304] 0 2021-11-03T16:54:42.283 INFO:tasks.workunit.client.0.smithi026.stdout:1/81: fdatasync dc/df/d11/f14 0 2021-11-03T16:54:42.284 INFO:tasks.workunit.client.0.smithi026.stdout:1/82: read - f9 zero size 2021-11-03T16:54:42.287 INFO:tasks.workunit.client.0.smithi026.stdout:9/48: dread d2/da/fc [0,4194304] 0 2021-11-03T16:54:42.288 INFO:tasks.workunit.client.0.smithi026.stdout:7/113: truncate da/d14/d15/f18 4813565 0 2021-11-03T16:54:42.297 INFO:tasks.workunit.client.0.smithi026.stdout:3/57: creat dc/f17 x:0 0 0 2021-11-03T16:54:42.299 INFO:tasks.workunit.client.0.smithi026.stdout:1/83: dwrite dc/f1d [0,4194304] 0 2021-11-03T16:54:42.300 INFO:tasks.workunit.client.0.smithi026.stdout:1/84: write dc/df/f16 [444845,57504] 0 2021-11-03T16:54:42.301 INFO:tasks.workunit.client.0.smithi026.stdout:2/18: creat f6 x:0 0 0 2021-11-03T16:54:42.313 INFO:tasks.workunit.client.0.smithi026.stdout:1/85: dread f1 [0,4194304] 0 2021-11-03T16:54:42.314 INFO:tasks.workunit.client.0.smithi026.stdout:1/86: creat dc/df/d11/f21 x:0 0 0 2021-11-03T16:54:42.317 INFO:tasks.workunit.client.0.smithi026.stdout:2/19: dread f3 [4194304,4194304] 0 2021-11-03T16:54:42.319 INFO:tasks.workunit.client.0.smithi026.stdout:2/20: truncate f2 1490869 0 2021-11-03T16:54:42.320 INFO:tasks.workunit.client.0.smithi026.stdout:2/21: creat f7 x:0 0 0 2021-11-03T16:54:42.321 INFO:tasks.workunit.client.0.smithi026.stdout:2/22: creat f8 x:0 0 0 2021-11-03T16:54:42.322 INFO:tasks.workunit.client.0.smithi026.stdout:2/23: creat f9 x:0 0 0 2021-11-03T16:54:42.324 INFO:tasks.workunit.client.0.smithi026.stdout:9/49: dwrite d2/da/fc [0,4194304] 0 2021-11-03T16:54:42.325 INFO:tasks.workunit.client.0.smithi026.stdout:3/58: dwrite dc/d12/f16 [0,4194304] 0 2021-11-03T16:54:42.326 INFO:tasks.workunit.client.0.smithi026.stdout:7/114: dwrite da/d14/f19 [0,4194304] 0 2021-11-03T16:54:42.326 INFO:tasks.workunit.client.0.smithi026.stdout:7/115: readlink da/l16 0 2021-11-03T16:54:42.327 INFO:tasks.workunit.client.0.smithi026.stdout:1/87: write dc/f1d [5151778,69353] 0 2021-11-03T16:54:42.335 INFO:tasks.workunit.client.0.smithi026.stdout:9/50: unlink d2/d5/f10 0 2021-11-03T16:54:42.338 INFO:tasks.workunit.client.0.smithi026.stdout:7/116: creat da/f21 x:0 0 0 2021-11-03T16:54:42.339 INFO:tasks.workunit.client.0.smithi026.stdout:7/117: readlink da/l1d 0 2021-11-03T16:54:42.339 INFO:tasks.workunit.client.0.smithi026.stdout:7/118: chown da/f13 3001 1 2021-11-03T16:54:42.339 INFO:tasks.workunit.client.0.smithi026.stdout:1/88: creat dc/f22 x:0 0 0 2021-11-03T16:54:42.340 INFO:tasks.workunit.client.0.smithi026.stdout:7/119: creat da/d14/d1c/f22 x:0 0 0 2021-11-03T16:54:42.341 INFO:tasks.workunit.client.0.smithi026.stdout:7/120: creat da/d14/d1c/f23 x:0 0 0 2021-11-03T16:54:42.343 INFO:tasks.workunit.client.0.smithi026.stdout:7/121: getdents da/d14/d15 0 2021-11-03T16:54:42.345 INFO:tasks.workunit.client.0.smithi026.stdout:7/122: rename da/d14/f19 to da/d14/d15/f24 0 2021-11-03T16:54:42.345 INFO:tasks.workunit.client.0.smithi026.stdout:7/123: stat da/lb 0 2021-11-03T16:54:42.345 INFO:tasks.workunit.client.0.smithi026.stdout:7/124: stat da/d14/d15 0 2021-11-03T16:54:42.346 INFO:tasks.workunit.client.0.smithi026.stdout:7/125: write f0 [3394224,76374] 0 2021-11-03T16:54:42.346 INFO:tasks.workunit.client.0.smithi026.stdout:7/126: readlink da/l1d 0 2021-11-03T16:54:42.347 INFO:tasks.workunit.client.0.smithi026.stdout:7/127: chown da/d14/d1c/f23 7 1 2021-11-03T16:54:42.347 INFO:tasks.workunit.client.0.smithi026.stdout:7/128: getdents da/d20 0 2021-11-03T16:54:42.348 INFO:tasks.workunit.client.0.smithi026.stdout:7/129: creat da/f25 x:0 0 0 2021-11-03T16:54:42.348 INFO:tasks.workunit.client.0.smithi026.stdout:7/130: chown da/d14/d15 26 1 2021-11-03T16:54:42.348 INFO:tasks.workunit.client.0.smithi026.stdout:7/131: write da/d14/d15/f24 [1727409,90693] 0 2021-11-03T16:54:42.348 INFO:tasks.workunit.client.0.smithi026.stdout:7/132: chown da/f13 162 1 2021-11-03T16:54:42.349 INFO:tasks.workunit.client.0.smithi026.stdout:2/24: dwrite f3 [4194304,4194304] 0 2021-11-03T16:54:42.349 INFO:tasks.workunit.client.0.smithi026.stdout:2/25: rmdir - no directory 2021-11-03T16:54:42.350 INFO:tasks.workunit.client.0.smithi026.stdout:3/59: dwrite dc/f17 [0,4194304] 0 2021-11-03T16:54:42.350 INFO:tasks.workunit.client.0.smithi026.stdout:9/51: dread d2/da/fc [0,4194304] 0 2021-11-03T16:54:42.350 INFO:tasks.workunit.client.0.smithi026.stdout:9/52: fdatasync d2/da/ff 0 2021-11-03T16:54:42.355 INFO:tasks.workunit.client.0.smithi026.stdout:3/60: dread f4 [0,4194304] 0 2021-11-03T16:54:42.359 INFO:tasks.workunit.client.0.smithi026.stdout:2/26: symlink la 0 2021-11-03T16:54:42.359 INFO:tasks.workunit.client.0.smithi026.stdout:2/27: mknod cb 1 2021-11-03T16:54:42.366 INFO:tasks.workunit.client.0.smithi026.stdout:9/53: link d2/d5/l6 d2/da/l11 0 2021-11-03T16:54:42.367 INFO:tasks.workunit.client.0.smithi026.stdout:9/54: write d2/da/fc [4934970,65376] 0 2021-11-03T16:54:42.367 INFO:tasks.workunit.client.0.smithi026.stdout:7/133: getdents da/d14/d1c 0 2021-11-03T16:54:42.367 INFO:tasks.workunit.client.0.smithi026.stdout:9/55: write d2/da/fc [1370015,59429] 0 2021-11-03T16:54:42.371 INFO:tasks.workunit.client.0.smithi026.stdout:3/61: rename dc/f11 to dc/f18 0 2021-11-03T16:54:42.372 INFO:tasks.workunit.client.0.smithi026.stdout:2/28: rename f9 to fc 0 2021-11-03T16:54:42.375 INFO:tasks.workunit.client.0.smithi026.stdout:7/134: creat da/d14/d1c/f26 x:0 0 0 2021-11-03T16:54:42.377 INFO:tasks.workunit.client.0.smithi026.stdout:3/62: symlink dc/d12/l19 0 2021-11-03T16:54:42.377 INFO:tasks.workunit.client.0.smithi026.stdout:3/63: stat f4 0 2021-11-03T16:54:42.378 INFO:tasks.workunit.client.0.smithi026.stdout:2/29: link f2 fd 0 2021-11-03T16:54:42.379 INFO:tasks.workunit.client.0.smithi026.stdout:2/30: write f5 [68608,101341] 0 2021-11-03T16:54:42.380 INFO:tasks.workunit.client.0.smithi026.stdout:7/135: creat da/d14/f27 x:0 0 0 2021-11-03T16:54:42.384 INFO:tasks.workunit.client.0.smithi026.stdout:3/64: dread dc/f17 [0,4194304] 0 2021-11-03T16:54:42.384 INFO:tasks.workunit.client.0.smithi026.stdout:3/65: write dc/f18 [368150,46172] 0 2021-11-03T16:54:42.385 INFO:tasks.workunit.client.0.smithi026.stdout:3/66: read f4 [124678,92081] 0 2021-11-03T16:54:42.385 INFO:tasks.workunit.client.0.smithi026.stdout:3/67: stat dc/f17 0 2021-11-03T16:54:42.386 INFO:tasks.workunit.client.0.smithi026.stdout:3/68: write dc/d12/f16 [3530713,29330] 0 2021-11-03T16:54:42.388 INFO:tasks.workunit.client.0.smithi026.stdout:9/56: rename d2/da/fc to d2/f12 0 2021-11-03T16:54:42.388 INFO:tasks.workunit.client.0.smithi026.stdout:7/136: write da/d14/d1c/f23 [736901,58674] 0 2021-11-03T16:54:42.389 INFO:tasks.workunit.client.0.smithi026.stdout:7/137: write da/d14/d15/f24 [3269631,126225] 0 2021-11-03T16:54:42.389 INFO:tasks.workunit.client.0.smithi026.stdout:3/69: creat dc/d12/f1a x:0 0 0 2021-11-03T16:54:42.390 INFO:tasks.workunit.client.0.smithi026.stdout:9/57: creat d2/da/f13 x:0 0 0 2021-11-03T16:54:42.392 INFO:tasks.workunit.client.0.smithi026.stdout:7/138: truncate da/d14/d1c/f22 881511 0 2021-11-03T16:54:42.392 INFO:tasks.workunit.client.0.smithi026.stdout:7/139: truncate da/f13 1342953 0 2021-11-03T16:54:42.394 INFO:tasks.workunit.client.0.smithi026.stdout:3/70: link dc/d12/f16 dc/d12/d13/f1b 0 2021-11-03T16:54:42.397 INFO:tasks.workunit.client.0.smithi026.stdout:3/71: rename dc/l10 to dc/d12/l1c 0 2021-11-03T16:54:42.398 INFO:tasks.workunit.client.0.smithi026.stdout:3/72: mkdir dc/d1d 0 2021-11-03T16:54:42.399 INFO:tasks.workunit.client.0.smithi026.stdout:7/140: dread f0 [0,4194304] 0 2021-11-03T16:54:42.399 INFO:tasks.workunit.client.0.smithi026.stdout:3/73: chown dc 27283355 1 2021-11-03T16:54:42.407 INFO:tasks.workunit.client.1.smithi194.stdout:3/161: sync 2021-11-03T16:54:42.407 INFO:tasks.workunit.client.1.smithi194.stdout:0/89: sync 2021-11-03T16:54:42.408 INFO:tasks.workunit.client.1.smithi194.stdout:0/90: chown d5/d9/f19 1047 1 2021-11-03T16:54:42.409 INFO:tasks.workunit.client.0.smithi026.stdout:3/74: fdatasync dc/d12/d13/f1b 0 2021-11-03T16:54:42.409 INFO:tasks.workunit.client.0.smithi026.stdout:2/31: dwrite f8 [0,4194304] 0 2021-11-03T16:54:42.409 INFO:tasks.workunit.client.0.smithi026.stdout:2/32: write f2 [2207221,46721] 0 2021-11-03T16:54:42.409 INFO:tasks.workunit.client.0.smithi026.stdout:2/33: write fc [744325,123070] 0 2021-11-03T16:54:42.410 INFO:tasks.workunit.client.0.smithi026.stdout:2/34: write f7 [1025986,17429] 0 2021-11-03T16:54:42.411 INFO:tasks.workunit.client.0.smithi026.stdout:3/75: read fa [275573,122028] 0 2021-11-03T16:54:42.411 INFO:tasks.workunit.client.0.smithi026.stdout:9/58: dwrite d2/da/ff [4194304,4194304] 0 2021-11-03T16:54:42.411 INFO:tasks.workunit.client.1.smithi194.stdout:0/91: rename d5/d13/l11 to d5/l1b 0 2021-11-03T16:54:42.412 INFO:tasks.workunit.client.1.smithi194.stdout:3/162: dread d2/d17/f23 [0,4194304] 0 2021-11-03T16:54:42.412 INFO:tasks.workunit.client.1.smithi194.stdout:3/163: stat d2/d17/l32 0 2021-11-03T16:54:42.416 INFO:tasks.workunit.client.0.smithi026.stdout:9/59: fsync d2/da/f13 0 2021-11-03T16:54:42.416 INFO:tasks.workunit.client.0.smithi026.stdout:9/60: write d2/f12 [2983404,82180] 0 2021-11-03T16:54:42.417 INFO:tasks.workunit.client.0.smithi026.stdout:7/141: truncate da/d14/d15/f24 1600903 0 2021-11-03T16:54:42.417 INFO:tasks.workunit.client.0.smithi026.stdout:9/61: write d2/f12 [2144376,55981] 0 2021-11-03T16:54:42.417 INFO:tasks.workunit.client.0.smithi026.stdout:9/62: mknod d2/da/c14 1 2021-11-03T16:54:42.418 INFO:tasks.workunit.client.0.smithi026.stdout:9/63: read d2/da/ff [5021822,54483] 0 2021-11-03T16:54:42.420 INFO:tasks.workunit.client.1.smithi194.stdout:3/164: dread d2/f14 [0,4194304] 0 2021-11-03T16:54:42.420 INFO:tasks.workunit.client.1.smithi194.stdout:3/165: write d2/f27 [617765,109902] 0 2021-11-03T16:54:42.420 INFO:tasks.workunit.client.1.smithi194.stdout:3/166: chown d2/f13 16 1 2021-11-03T16:54:42.420 INFO:tasks.workunit.client.1.smithi194.stdout:3/167: write d2/f27 [870749,91649] 0 2021-11-03T16:54:42.421 INFO:tasks.workunit.client.1.smithi194.stdout:0/92: symlink d5/l1c 0 2021-11-03T16:54:42.421 INFO:tasks.workunit.client.1.smithi194.stdout:0/93: chown d5/l1b 384592 1 2021-11-03T16:54:42.423 INFO:tasks.workunit.client.0.smithi026.stdout:2/35: mkdir de 0 2021-11-03T16:54:42.427 INFO:tasks.workunit.client.1.smithi194.stdout:3/168: unlink d2/d20/d36/f37 0 2021-11-03T16:54:42.428 INFO:tasks.workunit.client.0.smithi026.stdout:3/76: mkdir dc/d1d/d1e 0 2021-11-03T16:54:42.432 INFO:tasks.workunit.client.1.smithi194.stdout:3/169: unlink d2/l29 0 2021-11-03T16:54:42.433 INFO:tasks.workunit.client.1.smithi194.stdout:3/170: read - d2/d17/f2e zero size 2021-11-03T16:54:42.433 INFO:tasks.workunit.client.1.smithi194.stdout:3/171: chown d2/l7 2 1 2021-11-03T16:54:42.434 INFO:tasks.workunit.client.0.smithi026.stdout:9/64: creat d2/da/f15 x:0 0 0 2021-11-03T16:54:42.434 INFO:tasks.workunit.client.0.smithi026.stdout:9/65: readlink d2/le 0 2021-11-03T16:54:42.435 INFO:tasks.workunit.client.0.smithi026.stdout:9/66: truncate d2/da/ff 8947683 0 2021-11-03T16:54:42.435 INFO:tasks.workunit.client.0.smithi026.stdout:7/142: dread da/d14/d15/f18 [4194304,4194304] 0 2021-11-03T16:54:42.436 INFO:tasks.workunit.client.0.smithi026.stdout:2/36: truncate f3 6252672 0 2021-11-03T16:54:42.436 INFO:tasks.workunit.client.0.smithi026.stdout:9/67: write d2/da/ff [5991101,39954] 0 2021-11-03T16:54:42.436 INFO:tasks.workunit.client.0.smithi026.stdout:2/37: read f7 [987301,49697] 0 2021-11-03T16:54:42.436 INFO:tasks.workunit.client.0.smithi026.stdout:2/38: chown fc 1 1 2021-11-03T16:54:42.441 INFO:tasks.workunit.client.0.smithi026.stdout:3/77: creat dc/f1f x:0 0 0 2021-11-03T16:54:42.442 INFO:tasks.workunit.client.1.smithi194.stdout:0/94: dwrite d5/d9/fb [0,4194304] 0 2021-11-03T16:54:42.447 INFO:tasks.workunit.client.1.smithi194.stdout:0/95: write d5/d13/f1a [793193,40300] 0 2021-11-03T16:54:42.447 INFO:tasks.workunit.client.1.smithi194.stdout:0/96: write d5/d9/f18 [2343378,40300] 0 2021-11-03T16:54:42.448 INFO:tasks.workunit.client.1.smithi194.stdout:0/97: write d5/d13/f12 [4826236,116094] 0 2021-11-03T16:54:42.450 INFO:tasks.workunit.client.1.smithi194.stdout:0/98: mkdir d5/d9/d1d 0 2021-11-03T16:54:42.455 INFO:tasks.workunit.client.0.smithi026.stdout:7/143: rmdir da/d20 0 2021-11-03T16:54:42.455 INFO:tasks.workunit.client.1.smithi194.stdout:3/172: dwrite d2/d17/d1d/f1e [0,4194304] 0 2021-11-03T16:54:42.456 INFO:tasks.workunit.client.1.smithi194.stdout:3/173: write d2/f11 [945478,121355] 0 2021-11-03T16:54:42.457 INFO:tasks.workunit.client.0.smithi026.stdout:2/39: dread f7 [0,4194304] 0 2021-11-03T16:54:42.457 INFO:tasks.workunit.client.0.smithi026.stdout:2/40: chown f5 117679307 1 2021-11-03T16:54:42.458 INFO:tasks.workunit.client.1.smithi194.stdout:3/174: mkdir d2/d17/d26/d39 0 2021-11-03T16:54:42.459 INFO:tasks.workunit.client.0.smithi026.stdout:3/78: dwrite dc/d12/f16 [0,4194304] 0 2021-11-03T16:54:42.460 INFO:tasks.workunit.client.0.smithi026.stdout:7/144: rename da/l16 to da/d14/d1c/l28 0 2021-11-03T16:54:42.460 INFO:tasks.workunit.client.0.smithi026.stdout:7/145: chown da/f21 2 1 2021-11-03T16:54:42.465 INFO:tasks.workunit.client.1.smithi194.stdout:3/175: creat d2/d17/d26/d39/f3a x:0 0 0 2021-11-03T16:54:42.465 INFO:tasks.workunit.client.1.smithi194.stdout:3/176: write d2/f14 [182395,87350] 0 2021-11-03T16:54:42.469 INFO:tasks.workunit.client.1.smithi194.stdout:0/99: dwrite d5/d9/fb [0,4194304] 0 2021-11-03T16:54:42.469 INFO:tasks.workunit.client.1.smithi194.stdout:0/100: write d5/d13/f1a [5416877,34542] 0 2021-11-03T16:54:42.470 INFO:tasks.workunit.client.0.smithi026.stdout:2/41: rename f8 to de/ff 0 2021-11-03T16:54:42.474 INFO:tasks.workunit.client.1.smithi194.stdout:3/177: dread d2/d17/f1c [0,4194304] 0 2021-11-03T16:54:42.476 INFO:tasks.workunit.client.0.smithi026.stdout:2/42: dread f3 [0,4194304] 0 2021-11-03T16:54:42.477 INFO:tasks.workunit.client.0.smithi026.stdout:2/43: mknod de/c10 1 2021-11-03T16:54:42.481 INFO:tasks.workunit.client.1.smithi194.stdout:3/178: dread d2/f4 [0,4194304] 0 2021-11-03T16:54:42.483 INFO:tasks.workunit.client.1.smithi194.stdout:0/101: dwrite d5/d9/f19 [0,4194304] 0 2021-11-03T16:54:42.492 INFO:tasks.workunit.client.0.smithi026.stdout:7/146: creat da/d14/d1c/f29 x:0 0 0 2021-11-03T16:54:42.494 INFO:tasks.workunit.client.1.smithi194.stdout:3/179: creat d2/d20/f3b x:0 0 0 2021-11-03T16:54:42.498 INFO:tasks.workunit.client.0.smithi026.stdout:7/147: mkdir da/d14/d2a 0 2021-11-03T16:54:42.498 INFO:tasks.workunit.client.0.smithi026.stdout:7/148: stat da/fd 0 2021-11-03T16:54:42.499 INFO:tasks.workunit.client.1.smithi194.stdout:3/180: creat d2/d17/d1d/f3c x:0 0 0 2021-11-03T16:54:42.499 INFO:tasks.workunit.client.0.smithi026.stdout:7/149: read da/fc [1233046,114658] 0 2021-11-03T16:54:42.500 INFO:tasks.workunit.client.0.smithi026.stdout:7/150: creat da/d14/d2a/f2b x:0 0 0 2021-11-03T16:54:42.500 INFO:tasks.workunit.client.1.smithi194.stdout:0/102: dwrite f3 [0,4194304] 0 2021-11-03T16:54:42.501 INFO:tasks.workunit.client.1.smithi194.stdout:0/103: readlink d5/l1c 0 2021-11-03T16:54:42.501 INFO:tasks.workunit.client.1.smithi194.stdout:3/181: mkdir d2/d33/d3d 0 2021-11-03T16:54:42.506 INFO:tasks.workunit.client.0.smithi026.stdout:7/151: mkdir da/d2c 0 2021-11-03T16:54:42.506 INFO:tasks.workunit.client.0.smithi026.stdout:7/152: chown da/f13 40720 1 2021-11-03T16:54:42.507 INFO:tasks.workunit.client.0.smithi026.stdout:7/153: read da/d14/d1c/f22 [756964,42703] 0 2021-11-03T16:54:42.507 INFO:tasks.workunit.client.0.smithi026.stdout:7/154: write da/d14/d15/f18 [5202816,88441] 0 2021-11-03T16:54:42.507 INFO:tasks.workunit.client.0.smithi026.stdout:7/155: dread - da/d14/f1b zero size 2021-11-03T16:54:42.509 INFO:tasks.workunit.client.1.smithi194.stdout:3/182: creat d2/d17/d26/d39/f3e x:0 0 0 2021-11-03T16:54:42.512 INFO:tasks.workunit.client.0.smithi026.stdout:7/156: rename da/f21 to da/d14/d2a/f2d 0 2021-11-03T16:54:42.512 INFO:tasks.workunit.client.0.smithi026.stdout:7/157: fdatasync da/fc 0 2021-11-03T16:54:42.513 INFO:tasks.workunit.client.0.smithi026.stdout:7/158: fdatasync da/d14/d1c/f29 0 2021-11-03T16:54:42.513 INFO:tasks.workunit.client.1.smithi194.stdout:0/104: dwrite f3 [4194304,4194304] 0 2021-11-03T16:54:42.515 INFO:tasks.workunit.client.1.smithi194.stdout:3/183: unlink d2/d17/d1d/l2a 0 2021-11-03T16:54:42.515 INFO:tasks.workunit.client.1.smithi194.stdout:0/105: symlink d5/l1e 0 2021-11-03T16:54:42.516 INFO:tasks.workunit.client.1.smithi194.stdout:0/106: write d5/d9/f19 [36517,1385] 0 2021-11-03T16:54:42.516 INFO:tasks.workunit.client.1.smithi194.stdout:3/184: creat d2/d33/f3f x:0 0 0 2021-11-03T16:54:42.518 INFO:tasks.workunit.client.1.smithi194.stdout:0/107: creat d5/d13/f1f x:0 0 0 2021-11-03T16:54:42.519 INFO:tasks.workunit.client.1.smithi194.stdout:0/108: read d5/d9/f19 [2255761,66570] 0 2021-11-03T16:54:42.519 INFO:tasks.workunit.client.1.smithi194.stdout:3/185: symlink d2/d33/l40 0 2021-11-03T16:54:42.520 INFO:tasks.workunit.client.1.smithi194.stdout:0/109: creat d5/f20 x:0 0 0 2021-11-03T16:54:42.521 INFO:tasks.workunit.client.1.smithi194.stdout:3/186: link d2/d17/l21 d2/d33/l41 0 2021-11-03T16:54:42.522 INFO:tasks.workunit.client.1.smithi194.stdout:3/187: truncate d2/f6 4252067 0 2021-11-03T16:54:42.523 INFO:tasks.workunit.client.1.smithi194.stdout:0/110: mkdir d5/d13/d21 0 2021-11-03T16:54:42.523 INFO:tasks.workunit.client.0.smithi026.stdout:7/159: dwrite da/f1f [0,4194304] 0 2021-11-03T16:54:42.524 INFO:tasks.workunit.client.0.smithi026.stdout:7/160: readlink da/l1d 0 2021-11-03T16:54:42.524 INFO:tasks.workunit.client.1.smithi194.stdout:3/188: creat d2/d17/d26/f42 x:0 0 0 2021-11-03T16:54:42.525 INFO:tasks.workunit.client.0.smithi026.stdout:7/161: write da/fd [208778,101886] 0 2021-11-03T16:54:42.526 INFO:tasks.workunit.client.1.smithi194.stdout:0/111: rename d5/d9/d1d to d5/d9/d22 0 2021-11-03T16:54:42.526 INFO:tasks.workunit.client.1.smithi194.stdout:0/112: rename d5/d9 to d5/d9/d23 22 2021-11-03T16:54:42.527 INFO:tasks.workunit.client.1.smithi194.stdout:3/189: mkdir d2/d20/d36/d43 0 2021-11-03T16:54:42.529 INFO:tasks.workunit.client.0.smithi026.stdout:7/162: creat da/d14/d15/f2e x:0 0 0 2021-11-03T16:54:42.532 INFO:tasks.workunit.client.1.smithi194.stdout:2/341: sync 2021-11-03T16:54:42.540 INFO:tasks.workunit.client.1.smithi194.stdout:2/342: dread d6/de/d16/f50 [0,4194304] 0 2021-11-03T16:54:42.540 INFO:tasks.workunit.client.1.smithi194.stdout:0/113: creat d5/f24 x:0 0 0 2021-11-03T16:54:42.542 INFO:tasks.workunit.client.0.smithi026.stdout:7/163: creat da/d14/f2f x:0 0 0 2021-11-03T16:54:42.543 INFO:tasks.workunit.client.1.smithi194.stdout:3/190: creat d2/d17/f44 x:0 0 0 2021-11-03T16:54:42.547 INFO:tasks.workunit.client.1.smithi194.stdout:0/114: dread d5/d13/f12 [4194304,4194304] 0 2021-11-03T16:54:42.555 INFO:tasks.workunit.client.0.smithi026.stdout:7/164: fsync da/d14/f2f 0 2021-11-03T16:54:42.558 INFO:tasks.workunit.client.1.smithi194.stdout:2/343: mkdir d6/d1f/d67 0 2021-11-03T16:54:42.558 INFO:tasks.workunit.client.1.smithi194.stdout:2/344: chown d6/de/d16/f4a 153 1 2021-11-03T16:54:42.559 INFO:tasks.workunit.client.1.smithi194.stdout:2/345: dread - d6/de/d16/f4a zero size 2021-11-03T16:54:42.559 INFO:tasks.workunit.client.1.smithi194.stdout:3/191: dwrite d2/f4 [0,4194304] 0 2021-11-03T16:54:42.560 INFO:tasks.workunit.client.1.smithi194.stdout:0/115: rename d5/d13/f1a to d5/d9/d22/f25 0 2021-11-03T16:54:42.567 INFO:tasks.workunit.client.1.smithi194.stdout:3/192: creat d2/d20/f45 x:0 0 0 2021-11-03T16:54:42.567 INFO:tasks.workunit.client.1.smithi194.stdout:3/193: read - d2/d17/d1d/f3c zero size 2021-11-03T16:54:42.567 INFO:tasks.workunit.client.1.smithi194.stdout:0/116: creat d5/d13/f26 x:0 0 0 2021-11-03T16:54:42.568 INFO:tasks.workunit.client.1.smithi194.stdout:3/194: rename d2/f14 to d2/d20/f46 0 2021-11-03T16:54:42.569 INFO:tasks.workunit.client.1.smithi194.stdout:0/117: creat d5/d9/d22/f27 x:0 0 0 2021-11-03T16:54:42.580 INFO:tasks.workunit.client.1.smithi194.stdout:3/195: dread d2/d20/f25 [0,4194304] 0 2021-11-03T16:54:42.582 INFO:tasks.workunit.client.0.smithi026.stdout:7/165: dwrite da/d14/d2a/f2d [0,4194304] 0 2021-11-03T16:54:42.582 INFO:tasks.workunit.client.0.smithi026.stdout:7/166: chown da/l1d 3 1 2021-11-03T16:54:42.583 INFO:tasks.workunit.client.1.smithi194.stdout:2/346: dwrite d6/fb [4194304,4194304] 0 2021-11-03T16:54:42.583 INFO:tasks.workunit.client.1.smithi194.stdout:3/196: rename d2/d17/d26/d39/f3e to d2/d17/f47 0 2021-11-03T16:54:42.584 INFO:tasks.workunit.client.1.smithi194.stdout:2/347: getdents d6/de/d27 0 2021-11-03T16:54:42.585 INFO:tasks.workunit.client.1.smithi194.stdout:2/348: write d6/de/d11/f4d [1047045,82529] 0 2021-11-03T16:54:42.587 INFO:tasks.workunit.client.1.smithi194.stdout:3/197: link d2/d17/f1c d2/d17/d1d/f48 0 2021-11-03T16:54:42.590 INFO:tasks.workunit.client.1.smithi194.stdout:3/198: write d2/f4 [3369651,83133] 0 2021-11-03T16:54:42.590 INFO:tasks.workunit.client.1.smithi194.stdout:3/199: dread - d2/d17/f44 zero size 2021-11-03T16:54:42.591 INFO:tasks.workunit.client.1.smithi194.stdout:3/200: dread d2/f11 [0,4194304] 0 2021-11-03T16:54:42.594 INFO:tasks.workunit.client.1.smithi194.stdout:2/349: mkdir d6/d17/d68 0 2021-11-03T16:54:42.596 INFO:tasks.workunit.client.1.smithi194.stdout:3/201: stat d2/d17/l21 0 2021-11-03T16:54:42.596 INFO:tasks.workunit.client.1.smithi194.stdout:3/202: fdatasync d2/d17/f1c 0 2021-11-03T16:54:42.600 INFO:tasks.workunit.client.1.smithi194.stdout:2/350: rename d6/d17/l4b to d6/d21/d43/l69 0 2021-11-03T16:54:42.600 INFO:tasks.workunit.client.1.smithi194.stdout:2/351: chown d6/de/d16/d20/l30 3 1 2021-11-03T16:54:42.601 INFO:tasks.workunit.client.0.smithi026.stdout:7/167: dwrite da/d14/d15/f2e [0,4194304] 0 2021-11-03T16:54:42.602 INFO:tasks.workunit.client.1.smithi194.stdout:3/203: symlink d2/d17/d26/l49 0 2021-11-03T16:54:42.602 INFO:tasks.workunit.client.1.smithi194.stdout:3/204: mknod d2/c4a 1 2021-11-03T16:54:42.606 INFO:tasks.workunit.client.1.smithi194.stdout:3/205: symlink d2/d20/d36/d43/l4b 0 2021-11-03T16:54:42.606 INFO:tasks.workunit.client.1.smithi194.stdout:3/206: dread - d2/d17/f44 zero size 2021-11-03T16:54:42.609 INFO:tasks.workunit.client.1.smithi194.stdout:2/352: dread d6/d21/f3b [0,4194304] 0 2021-11-03T16:54:42.610 INFO:tasks.workunit.client.0.smithi026.stdout:7/168: mkdir da/d14/d15/d30 0 2021-11-03T16:54:42.610 INFO:tasks.workunit.client.0.smithi026.stdout:7/169: read da/fc [233842,59828] 0 2021-11-03T16:54:42.611 INFO:tasks.workunit.client.0.smithi026.stdout:7/170: dread - da/d14/d1c/f26 zero size 2021-11-03T16:54:42.611 INFO:tasks.workunit.client.1.smithi194.stdout:3/207: truncate d2/d17/f1c 138544 0 2021-11-03T16:54:42.612 INFO:tasks.workunit.client.0.smithi026.stdout:7/171: unlink da/d14/d1c/l28 0 2021-11-03T16:54:42.612 INFO:tasks.workunit.client.0.smithi026.stdout:7/172: fdatasync da/f13 0 2021-11-03T16:54:42.613 INFO:tasks.workunit.client.0.smithi026.stdout:7/173: read da/d14/d15/f2e [433314,43812] 0 2021-11-03T16:54:42.616 INFO:tasks.workunit.client.0.smithi026.stdout:7/174: rename da/l1d to da/d14/d1c/l31 0 2021-11-03T16:54:42.631 INFO:tasks.workunit.client.1.smithi194.stdout:3/208: dwrite d2/ff [0,4194304] 0 2021-11-03T16:54:42.632 INFO:tasks.workunit.client.1.smithi194.stdout:3/209: truncate d2/f6 1166765 0 2021-11-03T16:54:42.633 INFO:tasks.workunit.client.0.smithi026.stdout:7/175: dwrite da/d14/d2a/f2b [0,4194304] 0 2021-11-03T16:54:42.633 INFO:tasks.workunit.client.0.smithi026.stdout:7/176: write da/fd [4707601,54118] 0 2021-11-03T16:54:42.634 INFO:tasks.workunit.client.1.smithi194.stdout:3/210: getdents d2/d20/d36 0 2021-11-03T16:54:42.638 INFO:tasks.workunit.client.0.smithi026.stdout:7/177: mkdir da/d14/d32 0 2021-11-03T16:54:42.638 INFO:tasks.workunit.client.0.smithi026.stdout:7/178: mknod da/d14/d2a/c33 1 2021-11-03T16:54:42.641 INFO:tasks.workunit.client.0.smithi026.stdout:7/179: rename da/d14/d1c to da/d14/d32/d34 0 2021-11-03T16:54:42.643 INFO:tasks.workunit.client.0.smithi026.stdout:7/180: rename da/d14/d15/f18 to da/d2c/f35 0 2021-11-03T16:54:42.645 INFO:tasks.workunit.client.0.smithi026.stdout:7/181: link f0 da/f36 0 2021-11-03T16:54:42.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:42 smithi026 conmon[32119]: cluster 2021-11-03T16:54:41.075793+0000 2021-11-03T16:54:42.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:42 smithi026 conmon[32119]: mgr.smithi026.cnrxli (mgr.14162) 314 : cluster [DBG] pgmap v257: 65 pgs: 65 active+clean; 479 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 26 MiB/s wr, 351 op/s 2021-11-03T16:54:42.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:42 smithi194 conmon[35111]: cluster 2021-11-03T16:54:41.075793+0000 mgr.smithi026.cnrxli (mgr.14162 2021-11-03T16:54:42.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:42 smithi194 conmon[35111]: ) 314 : cluster [DBG] pgmap v257: 65 pgs: 65 active+clean; 479 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 26 MiB/s wr, 351 op/s 2021-11-03T16:54:42.760 INFO:tasks.workunit.client.1.smithi194.stdout:6/211: sync 2021-11-03T16:54:42.760 INFO:tasks.workunit.client.1.smithi194.stdout:8/174: sync 2021-11-03T16:54:42.761 INFO:tasks.workunit.client.1.smithi194.stdout:5/202: sync 2021-11-03T16:54:42.762 INFO:tasks.workunit.client.1.smithi194.stdout:6/212: unlink de/f1e 0 2021-11-03T16:54:42.778 INFO:tasks.workunit.client.1.smithi194.stdout:8/175: creat d8/d33/d38/f45 x:0 0 0 2021-11-03T16:54:42.778 INFO:tasks.workunit.client.1.smithi194.stdout:8/176: write d8/f9 [779175,110760] 0 2021-11-03T16:54:42.778 INFO:tasks.workunit.client.1.smithi194.stdout:8/177: write f5 [2426906,87673] 0 2021-11-03T16:54:42.778 INFO:tasks.workunit.client.1.smithi194.stdout:5/203: rename d2/d2a/l2e to d2/d3/l45 0 2021-11-03T16:54:42.779 INFO:tasks.workunit.client.1.smithi194.stdout:6/213: mkdir de/d1f/d43 0 2021-11-03T16:54:42.779 INFO:tasks.workunit.client.1.smithi194.stdout:6/214: fdatasync de/f12 0 2021-11-03T16:54:42.779 INFO:tasks.workunit.client.1.smithi194.stdout:6/215: getdents de/d21/d3e/d40 0 2021-11-03T16:54:42.780 INFO:tasks.workunit.client.1.smithi194.stdout:8/178: creat d8/f46 x:0 0 0 2021-11-03T16:54:42.780 INFO:tasks.workunit.client.1.smithi194.stdout:8/179: mknod d8/d35/d42/c47 1 2021-11-03T16:54:42.780 INFO:tasks.workunit.client.1.smithi194.stdout:8/180: read - d8/d24/f3f zero size 2021-11-03T16:54:42.780 INFO:tasks.workunit.client.1.smithi194.stdout:5/204: creat d2/dd/f46 x:0 0 0 2021-11-03T16:54:42.780 INFO:tasks.workunit.client.1.smithi194.stdout:5/205: mknod d2/dd/d35/d38/c47 1 2021-11-03T16:54:42.781 INFO:tasks.workunit.client.1.smithi194.stdout:6/216: rename de/d21/d2d/f2e to de/d21/f44 0 2021-11-03T16:54:42.781 INFO:tasks.workunit.client.1.smithi194.stdout:6/217: dread - de/d21/d2d/f33 zero size 2021-11-03T16:54:42.782 INFO:tasks.workunit.client.1.smithi194.stdout:5/206: symlink d2/dd/d32/l48 0 2021-11-03T16:54:42.782 INFO:tasks.workunit.client.1.smithi194.stdout:8/181: rename d8/f17 to d8/d24/f48 0 2021-11-03T16:54:42.783 INFO:tasks.workunit.client.1.smithi194.stdout:6/218: symlink de/d21/l45 0 2021-11-03T16:54:42.783 INFO:tasks.workunit.client.1.smithi194.stdout:5/207: truncate d2/dd/f14 1803952 0 2021-11-03T16:54:42.785 INFO:tasks.workunit.client.1.smithi194.stdout:6/219: dread de/d21/f2b [0,4194304] 0 2021-11-03T16:54:42.785 INFO:tasks.workunit.client.1.smithi194.stdout:6/220: dread - de/d1f/d26/f34 zero size 2021-11-03T16:54:42.785 INFO:tasks.workunit.client.1.smithi194.stdout:6/221: write de/d21/d2d/f33 [441120,9473] 0 2021-11-03T16:54:42.786 INFO:tasks.workunit.client.1.smithi194.stdout:5/208: dread d2/f17 [0,4194304] 0 2021-11-03T16:54:42.786 INFO:tasks.workunit.client.1.smithi194.stdout:5/209: stat d2/d2a/d39/f40 0 2021-11-03T16:54:42.787 INFO:tasks.workunit.client.1.smithi194.stdout:5/210: readlink d2/dd/d35/d38/l3b 0 2021-11-03T16:54:42.787 INFO:tasks.workunit.client.1.smithi194.stdout:5/211: truncate d2/dd/f46 496137 0 2021-11-03T16:54:42.791 INFO:tasks.workunit.client.1.smithi194.stdout:5/212: rename d2/dd/d35/d38/l3b to d2/d2a/l49 0 2021-11-03T16:54:42.793 INFO:tasks.workunit.client.1.smithi194.stdout:6/222: write de/f10 [843993,86083] 0 2021-11-03T16:54:42.794 INFO:tasks.workunit.client.1.smithi194.stdout:5/213: unlink d2/f21 0 2021-11-03T16:54:42.794 INFO:tasks.workunit.client.1.smithi194.stdout:6/223: write de/f17 [2718973,75224] 0 2021-11-03T16:54:42.795 INFO:tasks.workunit.client.1.smithi194.stdout:6/224: stat de/d21/d41 0 2021-11-03T16:54:42.796 INFO:tasks.workunit.client.1.smithi194.stdout:8/182: dwrite d8/fc [0,4194304] 0 2021-11-03T16:54:42.796 INFO:tasks.workunit.client.1.smithi194.stdout:5/214: creat d2/d3/f4a x:0 0 0 2021-11-03T16:54:42.796 INFO:tasks.workunit.client.1.smithi194.stdout:5/215: dread d2/dd/f46 [0,4194304] 0 2021-11-03T16:54:42.797 INFO:tasks.workunit.client.1.smithi194.stdout:6/225: rename de/d21/f23 to de/d21/d41/f46 0 2021-11-03T16:54:42.799 INFO:tasks.workunit.client.1.smithi194.stdout:8/183: rename d8/f46 to d8/d33/f49 0 2021-11-03T16:54:42.801 INFO:tasks.workunit.client.1.smithi194.stdout:6/226: symlink de/d1f/d26/d3f/l47 0 2021-11-03T16:54:42.802 INFO:tasks.workunit.client.1.smithi194.stdout:8/184: getdents d8/d24 0 2021-11-03T16:54:42.804 INFO:tasks.workunit.client.1.smithi194.stdout:6/227: creat de/d21/d3e/f48 x:0 0 0 2021-11-03T16:54:42.807 INFO:tasks.workunit.client.1.smithi194.stdout:8/185: unlink d8/f9 0 2021-11-03T16:54:42.809 INFO:tasks.workunit.client.1.smithi194.stdout:6/228: creat de/d1f/f49 x:0 0 0 2021-11-03T16:54:42.809 INFO:tasks.workunit.client.1.smithi194.stdout:6/229: getdents de/d21/d3e/d40 0 2021-11-03T16:54:42.809 INFO:tasks.workunit.client.1.smithi194.stdout:6/230: chown de/d1f/d26/f3b 784510 1 2021-11-03T16:54:42.810 INFO:tasks.workunit.client.1.smithi194.stdout:6/231: symlink de/d21/d2d/l4a 0 2021-11-03T16:54:42.811 INFO:tasks.workunit.client.1.smithi194.stdout:5/216: dwrite d2/d3/f29 [0,4194304] 0 2021-11-03T16:54:42.813 INFO:tasks.workunit.client.1.smithi194.stdout:6/232: rename fc to de/d21/d2d/f4b 0 2021-11-03T16:54:42.813 INFO:tasks.workunit.client.1.smithi194.stdout:6/233: dread - de/d21/f3a zero size 2021-11-03T16:54:42.813 INFO:tasks.workunit.client.1.smithi194.stdout:6/234: chown de/d1f/d26/d3f 28 1 2021-11-03T16:54:42.814 INFO:tasks.workunit.client.1.smithi194.stdout:6/235: truncate de/f1a 1902140 0 2021-11-03T16:54:42.816 INFO:tasks.workunit.client.1.smithi194.stdout:5/217: creat d2/d3/f4b x:0 0 0 2021-11-03T16:54:42.821 INFO:tasks.workunit.client.1.smithi194.stdout:6/236: creat de/d21/d41/f4c x:0 0 0 2021-11-03T16:54:42.821 INFO:tasks.workunit.client.1.smithi194.stdout:6/237: write de/d21/f2b [5085098,16496] 0 2021-11-03T16:54:42.830 INFO:tasks.workunit.client.1.smithi194.stdout:6/238: dread de/d21/d2d/f4b [0,4194304] 0 2021-11-03T16:54:42.831 INFO:tasks.workunit.client.1.smithi194.stdout:6/239: write de/f16 [1167914,97160] 0 2021-11-03T16:54:42.832 INFO:tasks.workunit.client.1.smithi194.stdout:9/149: sync 2021-11-03T16:54:42.834 INFO:tasks.workunit.client.1.smithi194.stdout:8/186: dwrite d8/d33/d3e/f40 [0,4194304] 0 2021-11-03T16:54:42.839 INFO:tasks.workunit.client.1.smithi194.stdout:9/150: unlink lc 0 2021-11-03T16:54:42.840 INFO:tasks.workunit.client.1.smithi194.stdout:9/151: fdatasync d19/d27/f2c 0 2021-11-03T16:54:42.840 INFO:tasks.workunit.client.1.smithi194.stdout:9/152: readlink le 0 2021-11-03T16:54:42.840 INFO:tasks.workunit.client.1.smithi194.stdout:9/153: getdents d19/d33 0 2021-11-03T16:54:42.843 INFO:tasks.workunit.client.1.smithi194.stdout:5/218: dwrite d2/f1f [4194304,4194304] 0 2021-11-03T16:54:42.843 INFO:tasks.workunit.client.1.smithi194.stdout:5/219: chown d2/dd/f16 532993990 1 2021-11-03T16:54:42.844 INFO:tasks.workunit.client.1.smithi194.stdout:9/154: unlink f10 0 2021-11-03T16:54:42.849 INFO:tasks.workunit.client.1.smithi194.stdout:8/187: dread d8/d33/f43 [0,4194304] 0 2021-11-03T16:54:42.856 INFO:tasks.workunit.client.1.smithi194.stdout:8/188: write d8/d24/f32 [2573495,37880] 0 2021-11-03T16:54:42.863 INFO:tasks.workunit.client.1.smithi194.stdout:9/155: dwrite d19/d27/f29 [0,4194304] 0 2021-11-03T16:54:42.864 INFO:tasks.workunit.client.1.smithi194.stdout:9/156: fdatasync d19/d27/f2c 0 2021-11-03T16:54:42.866 INFO:tasks.workunit.client.1.smithi194.stdout:6/240: dwrite de/d21/f2b [0,4194304] 0 2021-11-03T16:54:42.866 INFO:tasks.workunit.client.1.smithi194.stdout:6/241: fdatasync de/d21/d3e/f48 0 2021-11-03T16:54:42.923 INFO:tasks.workunit.client.1.smithi194.stdout:5/220: symlink d2/dd/l4c 0 2021-11-03T16:54:42.932 INFO:tasks.workunit.client.1.smithi194.stdout:8/189: rmdir d8/d33/d3e 39 2021-11-03T16:54:42.937 INFO:tasks.workunit.client.1.smithi194.stdout:9/157: link d19/d27/l2b d19/d27/d30/l34 0 2021-11-03T16:54:42.940 INFO:tasks.workunit.client.1.smithi194.stdout:6/242: symlink de/d21/d2d/l4d 0 2021-11-03T16:54:42.940 INFO:tasks.workunit.client.1.smithi194.stdout:9/158: read f0 [269826,74035] 0 2021-11-03T16:54:42.941 INFO:tasks.workunit.client.1.smithi194.stdout:8/190: dread d8/f2e [0,4194304] 0 2021-11-03T16:54:42.941 INFO:tasks.workunit.client.1.smithi194.stdout:8/191: truncate d8/d35/f41 595973 0 2021-11-03T16:54:42.941 INFO:tasks.workunit.client.1.smithi194.stdout:5/221: creat d2/d2a/d39/f4d x:0 0 0 2021-11-03T16:54:42.942 INFO:tasks.workunit.client.1.smithi194.stdout:6/243: read de/f12 [1049846,65095] 0 2021-11-03T16:54:42.942 INFO:tasks.workunit.client.1.smithi194.stdout:6/244: chown de/d21/f2b 1960049 1 2021-11-03T16:54:42.945 INFO:tasks.workunit.client.1.smithi194.stdout:8/192: symlink d8/d33/d38/l4a 0 2021-11-03T16:54:42.974 INFO:tasks.workunit.client.1.smithi194.stdout:5/222: dwrite d2/dd/f3c [0,4194304] 0 2021-11-03T16:54:42.975 INFO:tasks.workunit.client.1.smithi194.stdout:5/223: mknod d2/d2a/d39/c4e 1 2021-11-03T16:54:42.977 INFO:tasks.workunit.client.1.smithi194.stdout:6/245: dwrite de/d21/d41/f4c [0,4194304] 0 2021-11-03T16:54:42.978 INFO:tasks.workunit.client.1.smithi194.stdout:8/193: dwrite d8/fb [0,4194304] 0 2021-11-03T16:54:42.978 INFO:tasks.workunit.client.1.smithi194.stdout:9/159: dwrite fa [0,4194304] 0 2021-11-03T16:54:42.981 INFO:tasks.workunit.client.1.smithi194.stdout:6/246: creat de/d21/d3e/f4e x:0 0 0 2021-11-03T16:54:42.985 INFO:tasks.workunit.client.1.smithi194.stdout:9/160: readlink d19/l1d 0 2021-11-03T16:54:42.986 INFO:tasks.workunit.client.1.smithi194.stdout:9/161: chown d19/f1a 521183 1 2021-11-03T16:54:42.993 INFO:tasks.workunit.client.1.smithi194.stdout:9/162: creat d19/d33/f35 x:0 0 0 2021-11-03T16:54:42.993 INFO:tasks.workunit.client.1.smithi194.stdout:9/163: write fb [1279554,104694] 0 2021-11-03T16:54:42.994 INFO:tasks.workunit.client.1.smithi194.stdout:9/164: unlink d19/f2f 0 2021-11-03T16:54:42.995 INFO:tasks.workunit.client.1.smithi194.stdout:5/224: dwrite d2/d3/f22 [4194304,4194304] 0 2021-11-03T16:54:42.995 INFO:tasks.workunit.client.1.smithi194.stdout:9/165: symlink d19/l36 0 2021-11-03T16:54:42.999 INFO:tasks.workunit.client.1.smithi194.stdout:5/225: creat d2/d2a/f4f x:0 0 0 2021-11-03T16:54:43.000 INFO:tasks.workunit.client.1.smithi194.stdout:5/226: mknod d2/d3/c50 1 2021-11-03T16:54:43.000 INFO:tasks.workunit.client.1.smithi194.stdout:5/227: write d2/d3/f41 [863494,36529] 0 2021-11-03T16:54:43.000 INFO:tasks.workunit.client.1.smithi194.stdout:8/194: dwrite d8/f31 [0,4194304] 0 2021-11-03T16:54:43.001 INFO:tasks.workunit.client.1.smithi194.stdout:5/228: creat d2/d2a/f51 x:0 0 0 2021-11-03T16:54:43.001 INFO:tasks.workunit.client.1.smithi194.stdout:9/166: dread f2 [0,4194304] 0 2021-11-03T16:54:43.002 INFO:tasks.workunit.client.1.smithi194.stdout:6/247: dwrite de/d1f/f49 [0,4194304] 0 2021-11-03T16:54:43.002 INFO:tasks.workunit.client.1.smithi194.stdout:6/248: chown de/d1f/d26/d3f/l47 1516 1 2021-11-03T16:54:43.004 INFO:tasks.workunit.client.1.smithi194.stdout:8/195: rename d8/d33/d38/l4a to d8/d33/l4b 0 2021-11-03T16:54:43.009 INFO:tasks.workunit.client.1.smithi194.stdout:5/229: rename d2/dd/f27 to d2/f52 0 2021-11-03T16:54:43.015 INFO:tasks.workunit.client.1.smithi194.stdout:9/167: creat d19/d27/f37 x:0 0 0 2021-11-03T16:54:43.017 INFO:tasks.workunit.client.1.smithi194.stdout:8/196: symlink d8/l4c 0 2021-11-03T16:54:43.018 INFO:tasks.workunit.client.1.smithi194.stdout:5/230: creat d2/dd/f53 x:0 0 0 2021-11-03T16:54:43.021 INFO:tasks.workunit.client.1.smithi194.stdout:8/197: creat d8/d24/f4d x:0 0 0 2021-11-03T16:54:43.022 INFO:tasks.workunit.client.1.smithi194.stdout:8/198: getdents d8/d35/d42 0 2021-11-03T16:54:43.022 INFO:tasks.workunit.client.1.smithi194.stdout:9/168: mkdir d19/d38 0 2021-11-03T16:54:43.022 INFO:tasks.workunit.client.1.smithi194.stdout:9/169: write f13 [4375077,116920] 0 2021-11-03T16:54:43.023 INFO:tasks.workunit.client.1.smithi194.stdout:9/170: write d19/d27/d30/f31 [60655,28990] 0 2021-11-03T16:54:43.023 INFO:tasks.workunit.client.1.smithi194.stdout:9/171: chown fd 120931396 1 2021-11-03T16:54:43.024 INFO:tasks.workunit.client.1.smithi194.stdout:8/199: chown d8/d24/f32 1 1 2021-11-03T16:54:43.026 INFO:tasks.workunit.client.1.smithi194.stdout:9/172: readlink d19/l24 0 2021-11-03T16:54:43.027 INFO:tasks.workunit.client.1.smithi194.stdout:8/200: truncate d8/f2f 4231343 0 2021-11-03T16:54:43.027 INFO:tasks.workunit.client.1.smithi194.stdout:9/173: write fa [3566273,72179] 0 2021-11-03T16:54:43.028 INFO:tasks.workunit.client.1.smithi194.stdout:8/201: symlink d8/d35/d42/l4e 0 2021-11-03T16:54:43.030 INFO:tasks.workunit.client.1.smithi194.stdout:8/202: creat d8/d33/f4f x:0 0 0 2021-11-03T16:54:43.030 INFO:tasks.workunit.client.1.smithi194.stdout:8/203: mknod d8/d24/c50 1 2021-11-03T16:54:43.031 INFO:tasks.workunit.client.1.smithi194.stdout:9/174: dread f0 [0,4194304] 0 2021-11-03T16:54:43.031 INFO:tasks.workunit.client.1.smithi194.stdout:8/204: mkdir d8/d33/d51 0 2021-11-03T16:54:43.032 INFO:tasks.workunit.client.1.smithi194.stdout:8/205: chown d8/d33/f4f 2 1 2021-11-03T16:54:43.036 INFO:tasks.workunit.client.1.smithi194.stdout:9/175: symlink d19/d38/l39 0 2021-11-03T16:54:43.036 INFO:tasks.workunit.client.1.smithi194.stdout:8/206: fsync d8/d24/f3f 0 2021-11-03T16:54:43.037 INFO:tasks.workunit.client.1.smithi194.stdout:8/207: chown d8/fc 84 1 2021-11-03T16:54:43.037 INFO:tasks.workunit.client.1.smithi194.stdout:9/176: write d19/f1e [1008929,119743] 0 2021-11-03T16:54:43.038 INFO:tasks.workunit.client.1.smithi194.stdout:5/231: dwrite d2/f17 [0,4194304] 0 2021-11-03T16:54:43.038 INFO:tasks.workunit.client.1.smithi194.stdout:5/232: truncate d2/f24 5065597 0 2021-11-03T16:54:43.039 INFO:tasks.workunit.client.1.smithi194.stdout:9/177: chown d19/l21 6606030 1 2021-11-03T16:54:43.041 INFO:tasks.workunit.client.1.smithi194.stdout:5/233: rmdir d2/dd 39 2021-11-03T16:54:43.041 INFO:tasks.workunit.client.1.smithi194.stdout:5/234: readlink d2/d2a/d39/l3a 0 2021-11-03T16:54:43.042 INFO:tasks.workunit.client.1.smithi194.stdout:9/178: rename fa to d19/d27/f3a 0 2021-11-03T16:54:43.043 INFO:tasks.workunit.client.1.smithi194.stdout:9/179: stat d19/f22 0 2021-11-03T16:54:43.047 INFO:tasks.workunit.client.1.smithi194.stdout:9/180: write d19/d27/f29 [2798755,4833] 0 2021-11-03T16:54:43.049 INFO:tasks.workunit.client.1.smithi194.stdout:9/181: creat d19/d33/f3b x:0 0 0 2021-11-03T16:54:43.054 INFO:tasks.workunit.client.1.smithi194.stdout:8/208: dwrite d8/d33/d38/f45 [0,4194304] 0 2021-11-03T16:54:43.055 INFO:tasks.workunit.client.1.smithi194.stdout:5/235: dwrite d2/d3/f41 [0,4194304] 0 2021-11-03T16:54:43.056 INFO:tasks.workunit.client.1.smithi194.stdout:8/209: creat d8/d24/f52 x:0 0 0 2021-11-03T16:54:43.060 INFO:tasks.workunit.client.1.smithi194.stdout:5/236: creat d2/dd/d35/f54 x:0 0 0 2021-11-03T16:54:43.061 INFO:tasks.workunit.client.1.smithi194.stdout:9/182: dread d19/d27/f3a [0,4194304] 0 2021-11-03T16:54:43.062 INFO:tasks.workunit.client.1.smithi194.stdout:8/210: fdatasync d8/d24/f48 0 2021-11-03T16:54:43.062 INFO:tasks.workunit.client.1.smithi194.stdout:8/211: write d8/f22 [1672072,46929] 0 2021-11-03T16:54:43.063 INFO:tasks.workunit.client.1.smithi194.stdout:8/212: chown f5 44071877 1 2021-11-03T16:54:43.065 INFO:tasks.workunit.client.1.smithi194.stdout:5/237: rename d2/f33 to d2/dd/d32/f55 0 2021-11-03T16:54:43.066 INFO:tasks.workunit.client.1.smithi194.stdout:9/183: rmdir d19/d27/d30 39 2021-11-03T16:54:43.068 INFO:tasks.workunit.client.1.smithi194.stdout:8/213: creat d8/d24/f53 x:0 0 0 2021-11-03T16:54:43.069 INFO:tasks.workunit.client.1.smithi194.stdout:9/184: creat d19/d38/f3c x:0 0 0 2021-11-03T16:54:43.069 INFO:tasks.workunit.client.1.smithi194.stdout:9/185: stat f2 0 2021-11-03T16:54:43.071 INFO:tasks.workunit.client.1.smithi194.stdout:5/238: dread d2/f24 [0,4194304] 0 2021-11-03T16:54:43.071 INFO:tasks.workunit.client.1.smithi194.stdout:8/214: creat d8/d35/d42/f54 x:0 0 0 2021-11-03T16:54:43.072 INFO:tasks.workunit.client.1.smithi194.stdout:8/215: chown d8/l19 72960 1 2021-11-03T16:54:43.073 INFO:tasks.workunit.client.1.smithi194.stdout:9/186: rename l16 to d19/d27/d30/l3d 0 2021-11-03T16:54:43.073 INFO:tasks.workunit.client.1.smithi194.stdout:9/187: write f9 [2278006,121229] 0 2021-11-03T16:54:43.075 INFO:tasks.workunit.client.1.smithi194.stdout:5/239: creat d2/f56 x:0 0 0 2021-11-03T16:54:43.076 INFO:tasks.workunit.client.1.smithi194.stdout:5/240: write d2/d2a/d39/f40 [167480,115501] 0 2021-11-03T16:54:43.077 INFO:tasks.workunit.client.1.smithi194.stdout:4/195: sync 2021-11-03T16:54:43.079 INFO:tasks.workunit.client.1.smithi194.stdout:7/168: sync 2021-11-03T16:54:43.079 INFO:tasks.workunit.client.1.smithi194.stdout:7/169: dread - d6/d15/f28 zero size 2021-11-03T16:54:43.079 INFO:tasks.workunit.client.1.smithi194.stdout:8/216: creat d8/d24/f55 x:0 0 0 2021-11-03T16:54:43.080 INFO:tasks.workunit.client.1.smithi194.stdout:5/241: mkdir d2/d3/d57 0 2021-11-03T16:54:43.080 INFO:tasks.workunit.client.1.smithi194.stdout:8/217: readlink d8/l19 0 2021-11-03T16:54:43.081 INFO:tasks.workunit.client.1.smithi194.stdout:4/196: rename d6/d8/f39 to d6/d12/f3f 0 2021-11-03T16:54:43.082 INFO:tasks.workunit.client.1.smithi194.stdout:7/170: creat d6/d15/f40 x:0 0 0 2021-11-03T16:54:43.082 INFO:tasks.workunit.client.1.smithi194.stdout:7/171: write d6/da/d2b/f37 [329011,91802] 0 2021-11-03T16:54:43.083 INFO:tasks.workunit.client.1.smithi194.stdout:5/242: getdents d2/dd 0 2021-11-03T16:54:43.083 INFO:tasks.workunit.client.1.smithi194.stdout:5/243: dread - d2/d3/f4a zero size 2021-11-03T16:54:43.085 INFO:tasks.workunit.client.1.smithi194.stdout:8/218: rename d8/d24/f53 to d8/d33/d3e/f56 0 2021-11-03T16:54:43.086 INFO:tasks.workunit.client.1.smithi194.stdout:7/172: getdents d6/d2e 0 2021-11-03T16:54:43.090 INFO:tasks.workunit.client.1.smithi194.stdout:8/219: symlink d8/d35/d42/l57 0 2021-11-03T16:54:43.090 INFO:tasks.workunit.client.1.smithi194.stdout:8/220: mknod d8/d33/d51/c58 1 2021-11-03T16:54:43.090 INFO:tasks.workunit.client.1.smithi194.stdout:8/221: fdatasync d8/f1b 0 2021-11-03T16:54:43.091 INFO:tasks.workunit.client.1.smithi194.stdout:8/222: fsync d8/f1e 0 2021-11-03T16:54:43.091 INFO:tasks.workunit.client.1.smithi194.stdout:8/223: write d8/f13 [353640,72567] 0 2021-11-03T16:54:43.094 INFO:tasks.workunit.client.1.smithi194.stdout:9/188: dwrite fb [0,4194304] 0 2021-11-03T16:54:43.094 INFO:tasks.workunit.client.1.smithi194.stdout:4/197: dread d6/d12/d1e/f24 [0,4194304] 0 2021-11-03T16:54:43.095 INFO:tasks.workunit.client.1.smithi194.stdout:4/198: chown d6 335 1 2021-11-03T16:54:43.095 INFO:tasks.workunit.client.1.smithi194.stdout:4/199: chown d6/d8 1009148788 1 2021-11-03T16:54:43.095 INFO:tasks.workunit.client.1.smithi194.stdout:4/200: fsync d6/d8/d1a/d14/f11 0 2021-11-03T16:54:43.096 INFO:tasks.workunit.client.1.smithi194.stdout:8/224: dread d8/f2e [0,4194304] 0 2021-11-03T16:54:43.103 INFO:tasks.workunit.client.1.smithi194.stdout:9/189: unlink f0 0 2021-11-03T16:54:43.113 INFO:tasks.workunit.client.1.smithi194.stdout:4/201: getdents d6/d8 0 2021-11-03T16:54:43.113 INFO:tasks.workunit.client.1.smithi194.stdout:4/202: mkdir d6/d8/d40 0 2021-11-03T16:54:43.113 INFO:tasks.workunit.client.1.smithi194.stdout:4/203: write d6/d12/f33 [264899,128750] 0 2021-11-03T16:54:43.114 INFO:tasks.workunit.client.1.smithi194.stdout:4/204: dread - d6/d12/f3f zero size 2021-11-03T16:54:43.114 INFO:tasks.workunit.client.1.smithi194.stdout:4/205: read - d6/f3b zero size 2021-11-03T16:54:43.115 INFO:tasks.workunit.client.1.smithi194.stdout:8/225: truncate d8/d24/f29 103182 0 2021-11-03T16:54:43.116 INFO:tasks.workunit.client.1.smithi194.stdout:9/190: symlink d19/l3e 0 2021-11-03T16:54:43.116 INFO:tasks.workunit.client.1.smithi194.stdout:9/191: readlink d19/l21 0 2021-11-03T16:54:43.116 INFO:tasks.workunit.client.1.smithi194.stdout:9/192: chown d19/d33 154 1 2021-11-03T16:54:43.117 INFO:tasks.workunit.client.1.smithi194.stdout:9/193: fdatasync d19/d27/d30/f31 0 2021-11-03T16:54:43.117 INFO:tasks.workunit.client.1.smithi194.stdout:9/194: fsync f15 0 2021-11-03T16:54:43.117 INFO:tasks.workunit.client.1.smithi194.stdout:4/206: unlink d6/d8/d1a/d14/l3c 0 2021-11-03T16:54:43.118 INFO:tasks.workunit.client.1.smithi194.stdout:4/207: write d6/d12/f23 [633126,23384] 0 2021-11-03T16:54:43.118 INFO:tasks.workunit.client.1.smithi194.stdout:8/226: symlink d8/d33/l59 0 2021-11-03T16:54:43.118 INFO:tasks.workunit.client.1.smithi194.stdout:9/195: readlink d19/l23 0 2021-11-03T16:54:43.119 INFO:tasks.workunit.client.1.smithi194.stdout:8/227: creat d8/d33/d38/f5a x:0 0 0 2021-11-03T16:54:43.119 INFO:tasks.workunit.client.1.smithi194.stdout:7/173: dwrite d6/da/d2b/f37 [0,4194304] 0 2021-11-03T16:54:43.120 INFO:tasks.workunit.client.1.smithi194.stdout:4/208: dread d6/d12/f23 [0,4194304] 0 2021-11-03T16:54:43.124 INFO:tasks.workunit.client.1.smithi194.stdout:9/196: rename d19/d38/l39 to d19/l3f 0 2021-11-03T16:54:43.124 INFO:tasks.workunit.client.1.smithi194.stdout:9/197: readlink d19/d27/d30/l3d 0 2021-11-03T16:54:43.128 INFO:tasks.workunit.client.1.smithi194.stdout:7/174: getdents d6 0 2021-11-03T16:54:43.129 INFO:tasks.workunit.client.1.smithi194.stdout:7/175: write d6/d2e/f33 [893802,130627] 0 2021-11-03T16:54:43.129 INFO:tasks.workunit.client.1.smithi194.stdout:7/176: mknod d6/da/d2b/c41 1 2021-11-03T16:54:43.129 INFO:tasks.workunit.client.1.smithi194.stdout:7/177: chown d6/f20 0 1 2021-11-03T16:54:43.249 INFO:tasks.workunit.client.1.smithi194.stdout:4/209: creat d6/d8/d1a/d14/f41 x:0 0 0 2021-11-03T16:54:43.249 INFO:tasks.workunit.client.1.smithi194.stdout:4/210: chown d6/f1c 187827 1 2021-11-03T16:54:43.250 INFO:tasks.workunit.client.1.smithi194.stdout:4/211: stat d6/d8/d1a/d2b/f32 0 2021-11-03T16:54:43.250 INFO:tasks.workunit.client.1.smithi194.stdout:8/228: link d8/f13 d8/d24/f5b 0 2021-11-03T16:54:43.251 INFO:tasks.workunit.client.1.smithi194.stdout:9/198: truncate f15 3732432 0 2021-11-03T16:54:43.253 INFO:tasks.workunit.client.1.smithi194.stdout:8/229: write d8/f2f [2185014,129005] 0 2021-11-03T16:54:43.253 INFO:tasks.workunit.client.1.smithi194.stdout:4/212: write f1 [2617680,127908] 0 2021-11-03T16:54:43.253 INFO:tasks.workunit.client.1.smithi194.stdout:4/213: chown d6/d12/d1e/f24 1 1 2021-11-03T16:54:43.254 INFO:tasks.workunit.client.1.smithi194.stdout:4/214: dread d6/d12/f23 [0,4194304] 0 2021-11-03T16:54:43.259 INFO:tasks.workunit.client.1.smithi194.stdout:4/215: fdatasync f1 0 2021-11-03T16:54:43.259 INFO:tasks.workunit.client.1.smithi194.stdout:4/216: dread - d6/f35 zero size 2021-11-03T16:54:43.275 INFO:tasks.workunit.client.1.smithi194.stdout:8/230: dwrite d8/d33/f43 [0,4194304] 0 2021-11-03T16:54:43.276 INFO:tasks.workunit.client.1.smithi194.stdout:7/178: truncate d6/da/f11 1429054 0 2021-11-03T16:54:43.288 INFO:tasks.workunit.client.1.smithi194.stdout:9/199: fsync f17 0 2021-11-03T16:54:43.302 INFO:tasks.workunit.client.1.smithi194.stdout:4/217: creat d6/d12/d1e/f42 x:0 0 0 2021-11-03T16:54:43.307 INFO:tasks.workunit.client.1.smithi194.stdout:8/231: symlink d8/d35/d42/l5c 0 2021-11-03T16:54:43.307 INFO:tasks.workunit.client.1.smithi194.stdout:8/232: write d8/d24/f52 [425432,111593] 0 2021-11-03T16:54:43.309 INFO:tasks.workunit.client.1.smithi194.stdout:9/200: mknod d19/d38/c40 1 2021-11-03T16:54:43.317 INFO:tasks.workunit.client.1.smithi194.stdout:1/76: sync 2021-11-03T16:54:43.319 INFO:tasks.workunit.client.1.smithi194.stdout:1/77: dread d2/da/ff [0,4194304] 0 2021-11-03T16:54:43.323 INFO:tasks.workunit.client.1.smithi194.stdout:1/78: mkdir d2/da/d13/d1b 0 2021-11-03T16:54:43.331 INFO:tasks.workunit.client.1.smithi194.stdout:8/233: dwrite d8/d33/d3e/f40 [4194304,4194304] 0 2021-11-03T16:54:43.334 INFO:tasks.workunit.client.1.smithi194.stdout:9/201: dwrite d19/d27/f29 [0,4194304] 0 2021-11-03T16:54:43.339 INFO:tasks.workunit.client.1.smithi194.stdout:9/202: mkdir d19/d38/d41 0 2021-11-03T16:54:43.339 INFO:tasks.workunit.client.1.smithi194.stdout:9/203: fdatasync d19/f1e 0 2021-11-03T16:54:43.345 INFO:tasks.workunit.client.1.smithi194.stdout:9/204: link d19/d27/f3a d19/d38/d41/f42 0 2021-11-03T16:54:43.345 INFO:tasks.workunit.client.1.smithi194.stdout:9/205: mknod d19/d38/d41/c43 1 2021-11-03T16:54:43.348 INFO:tasks.workunit.client.1.smithi194.stdout:8/234: dwrite d8/f1b [0,4194304] 0 2021-11-03T16:54:43.351 INFO:tasks.workunit.client.1.smithi194.stdout:1/79: dwrite d2/da/d13/f14 [0,4194304] 0 2021-11-03T16:54:43.351 INFO:tasks.workunit.client.1.smithi194.stdout:8/235: read d8/fb [322592,71201] 0 2021-11-03T16:54:43.352 INFO:tasks.workunit.client.1.smithi194.stdout:7/179: write d6/da/f11 [431759,122780] 0 2021-11-03T16:54:43.353 INFO:tasks.workunit.client.1.smithi194.stdout:7/180: write f4 [1575925,1305] 0 2021-11-03T16:54:43.353 INFO:tasks.workunit.client.1.smithi194.stdout:7/181: truncate d6/f20 848058 0 2021-11-03T16:54:43.359 INFO:tasks.workunit.client.1.smithi194.stdout:9/206: dwrite d19/d27/f29 [0,4194304] 0 2021-11-03T16:54:43.359 INFO:tasks.workunit.client.1.smithi194.stdout:8/236: rename d8/d33/d38 to d8/d33/d3e/d5d 0 2021-11-03T16:54:43.360 INFO:tasks.workunit.client.1.smithi194.stdout:8/237: chown d8/d33/d3e 64 1 2021-11-03T16:54:43.364 INFO:tasks.workunit.client.1.smithi194.stdout:4/218: rmdir d6/d8 39 2021-11-03T16:54:43.365 INFO:tasks.workunit.client.1.smithi194.stdout:4/219: truncate d6/f17 5854935 0 2021-11-03T16:54:43.365 INFO:tasks.workunit.client.1.smithi194.stdout:4/220: truncate d6/d8/d1a/d14/f36 757732 0 2021-11-03T16:54:43.371 INFO:tasks.workunit.client.1.smithi194.stdout:1/80: creat d2/f1c x:0 0 0 2021-11-03T16:54:43.373 INFO:tasks.workunit.client.1.smithi194.stdout:7/182: creat d6/da/d2b/f42 x:0 0 0 2021-11-03T16:54:43.375 INFO:tasks.workunit.client.1.smithi194.stdout:9/207: creat d19/d38/d41/f44 x:0 0 0 2021-11-03T16:54:43.376 INFO:tasks.workunit.client.1.smithi194.stdout:8/238: mknod d8/d24/c5e 1 2021-11-03T16:54:43.376 INFO:tasks.workunit.client.1.smithi194.stdout:8/239: write d8/f22 [283073,5209] 0 2021-11-03T16:54:43.377 INFO:tasks.workunit.client.1.smithi194.stdout:4/221: creat d6/d12/f43 x:0 0 0 2021-11-03T16:54:43.377 INFO:tasks.workunit.client.1.smithi194.stdout:1/81: mknod d2/c1d 1 2021-11-03T16:54:43.379 INFO:tasks.workunit.client.1.smithi194.stdout:7/183: rename d6/d2e to d6/d43 0 2021-11-03T16:54:43.380 INFO:tasks.workunit.client.1.smithi194.stdout:9/208: creat d19/d27/d30/f45 x:0 0 0 2021-11-03T16:54:43.381 INFO:tasks.workunit.client.1.smithi194.stdout:9/209: write d19/d27/f3a [2666715,12387] 0 2021-11-03T16:54:43.383 INFO:tasks.workunit.client.1.smithi194.stdout:4/222: rename d6/d12/f33 to d6/d12/f44 0 2021-11-03T16:54:43.384 INFO:tasks.workunit.client.1.smithi194.stdout:4/223: write d6/d8/f38 [177841,33390] 0 2021-11-03T16:54:43.384 INFO:tasks.workunit.client.1.smithi194.stdout:4/224: write d6/d8/d1a/d14/f3e [803752,124468] 0 2021-11-03T16:54:43.385 INFO:tasks.workunit.client.1.smithi194.stdout:4/225: fdatasync d6/d12/f2f 0 2021-11-03T16:54:43.385 INFO:tasks.workunit.client.1.smithi194.stdout:4/226: read - d6/d8/d1a/d2b/f32 zero size 2021-11-03T16:54:43.385 INFO:tasks.workunit.client.1.smithi194.stdout:1/82: rmdir d2/da 39 2021-11-03T16:54:43.386 INFO:tasks.workunit.client.1.smithi194.stdout:7/184: rename d6/d15/f1d to d6/d43/f44 0 2021-11-03T16:54:43.386 INFO:tasks.workunit.client.1.smithi194.stdout:7/185: truncate d6/d15/f38 383325 0 2021-11-03T16:54:43.387 INFO:tasks.workunit.client.1.smithi194.stdout:8/240: symlink d8/d24/l5f 0 2021-11-03T16:54:43.388 INFO:tasks.workunit.client.1.smithi194.stdout:4/227: rmdir d6/d8 39 2021-11-03T16:54:43.391 INFO:tasks.workunit.client.1.smithi194.stdout:7/186: link d6/da/d2b/f31 d6/da/d2b/f45 0 2021-11-03T16:54:43.391 INFO:tasks.workunit.client.1.smithi194.stdout:7/187: read - d6/d15/f40 zero size 2021-11-03T16:54:43.391 INFO:tasks.workunit.client.1.smithi194.stdout:8/241: creat d8/d33/d3e/f60 x:0 0 0 2021-11-03T16:54:43.393 INFO:tasks.workunit.client.1.smithi194.stdout:4/228: creat d6/d8/d40/f45 x:0 0 0 2021-11-03T16:54:43.396 INFO:tasks.workunit.client.1.smithi194.stdout:9/210: write f13 [1509395,51255] 0 2021-11-03T16:54:43.396 INFO:tasks.workunit.client.1.smithi194.stdout:1/83: mkdir d2/d1e 0 2021-11-03T16:54:43.396 INFO:tasks.workunit.client.1.smithi194.stdout:4/229: dread d6/d12/f44 [0,4194304] 0 2021-11-03T16:54:43.397 INFO:tasks.workunit.client.1.smithi194.stdout:4/230: mknod d6/d8/d40/c46 1 2021-11-03T16:54:43.397 INFO:tasks.workunit.client.1.smithi194.stdout:4/231: fsync d6/f15 0 2021-11-03T16:54:43.398 INFO:tasks.workunit.client.1.smithi194.stdout:7/188: mkdir d6/d43/d46 0 2021-11-03T16:54:43.398 INFO:tasks.workunit.client.1.smithi194.stdout:7/189: dread - d6/f2a zero size 2021-11-03T16:54:43.399 INFO:tasks.workunit.client.1.smithi194.stdout:8/242: creat d8/d35/f61 x:0 0 0 2021-11-03T16:54:43.400 INFO:tasks.workunit.client.1.smithi194.stdout:8/243: dread - d8/d33/d3e/f56 zero size 2021-11-03T16:54:43.401 INFO:tasks.workunit.client.1.smithi194.stdout:9/211: creat d19/d27/f46 x:0 0 0 2021-11-03T16:54:43.403 INFO:tasks.workunit.client.1.smithi194.stdout:1/84: rmdir d2/da/d13/d1b 0 2021-11-03T16:54:43.403 INFO:tasks.workunit.client.1.smithi194.stdout:1/85: write d2/da/f11 [414924,48826] 0 2021-11-03T16:54:43.404 INFO:tasks.workunit.client.1.smithi194.stdout:1/86: truncate d2/da/ff 319892 0 2021-11-03T16:54:43.404 INFO:tasks.workunit.client.1.smithi194.stdout:1/87: chown d2/da/d13/f17 8321420 1 2021-11-03T16:54:43.405 INFO:tasks.workunit.client.1.smithi194.stdout:4/232: creat d6/d8/d40/f47 x:0 0 0 2021-11-03T16:54:43.406 INFO:tasks.workunit.client.1.smithi194.stdout:8/244: creat d8/d35/f62 x:0 0 0 2021-11-03T16:54:43.406 INFO:tasks.workunit.client.1.smithi194.stdout:8/245: chown d8/d24/f3f 346791 1 2021-11-03T16:54:43.407 INFO:tasks.workunit.client.1.smithi194.stdout:8/246: write d8/d24/f52 [527547,93909] 0 2021-11-03T16:54:43.407 INFO:tasks.workunit.client.1.smithi194.stdout:9/212: creat d19/d27/d30/f47 x:0 0 0 2021-11-03T16:54:43.408 INFO:tasks.workunit.client.1.smithi194.stdout:9/213: write d19/d27/f46 [656180,94206] 0 2021-11-03T16:54:43.411 INFO:tasks.workunit.client.1.smithi194.stdout:4/233: dread d6/f2a [0,4194304] 0 2021-11-03T16:54:43.416 INFO:tasks.workunit.client.1.smithi194.stdout:7/190: dread d6/da/d2b/f37 [0,4194304] 0 2021-11-03T16:54:43.464 INFO:tasks.workunit.client.1.smithi194.stdout:1/88: truncate d2/f6 2824954 0 2021-11-03T16:54:43.465 INFO:tasks.workunit.client.1.smithi194.stdout:9/214: mkdir d19/d38/d41/d48 0 2021-11-03T16:54:43.481 INFO:tasks.workunit.client.1.smithi194.stdout:4/234: creat d6/d8/d1a/f48 x:0 0 0 2021-11-03T16:54:43.481 INFO:tasks.workunit.client.1.smithi194.stdout:4/235: write d6/d12/d1e/f24 [4577540,22677] 0 2021-11-03T16:54:43.486 INFO:tasks.workunit.client.1.smithi194.stdout:7/191: creat d6/da/f47 x:0 0 0 2021-11-03T16:54:43.496 INFO:tasks.workunit.client.1.smithi194.stdout:1/89: creat d2/f1f x:0 0 0 2021-11-03T16:54:43.498 INFO:tasks.workunit.client.1.smithi194.stdout:7/192: creat d6/d24/f48 x:0 0 0 2021-11-03T16:54:43.500 INFO:tasks.workunit.client.1.smithi194.stdout:9/215: mkdir d19/d49 0 2021-11-03T16:54:43.500 INFO:tasks.workunit.client.1.smithi194.stdout:9/216: mknod d19/d33/c4a 1 2021-11-03T16:54:43.502 INFO:tasks.workunit.client.1.smithi194.stdout:4/236: dwrite d6/f17 [0,4194304] 0 2021-11-03T16:54:43.503 INFO:tasks.workunit.client.1.smithi194.stdout:1/90: link d2/da/f11 d2/f20 0 2021-11-03T16:54:43.503 INFO:tasks.workunit.client.1.smithi194.stdout:1/91: dread - d2/f1f zero size 2021-11-03T16:54:43.503 INFO:tasks.workunit.client.1.smithi194.stdout:7/193: dread d6/f23 [0,4194304] 0 2021-11-03T16:54:43.504 INFO:tasks.workunit.client.1.smithi194.stdout:7/194: dread - d6/d43/f36 zero size 2021-11-03T16:54:43.504 INFO:tasks.workunit.client.1.smithi194.stdout:7/195: stat d6/f2f 0 2021-11-03T16:54:43.504 INFO:tasks.workunit.client.1.smithi194.stdout:9/217: stat f9 0 2021-11-03T16:54:43.509 INFO:tasks.workunit.client.1.smithi194.stdout:4/237: rmdir d6/d8/d40 39 2021-11-03T16:54:43.510 INFO:tasks.workunit.client.1.smithi194.stdout:4/238: read - d6/f3b zero size 2021-11-03T16:54:43.511 INFO:tasks.workunit.client.1.smithi194.stdout:9/218: creat d19/d27/f4b x:0 0 0 2021-11-03T16:54:43.512 INFO:tasks.workunit.client.1.smithi194.stdout:7/196: symlink d6/da/d2b/l49 0 2021-11-03T16:54:43.512 INFO:tasks.workunit.client.1.smithi194.stdout:7/197: mknod d6/d15/c4a 1 2021-11-03T16:54:43.516 INFO:tasks.workunit.client.1.smithi194.stdout:4/239: getdents d6/d12/d1e 0 2021-11-03T16:54:43.516 INFO:tasks.workunit.client.1.smithi194.stdout:4/240: stat d6/d12/d1e/f26 0 2021-11-03T16:54:43.516 INFO:tasks.workunit.client.1.smithi194.stdout:4/241: fdatasync d6/d12/d1e/f26 0 2021-11-03T16:54:43.517 INFO:tasks.workunit.client.1.smithi194.stdout:9/219: creat d19/d27/f4c x:0 0 0 2021-11-03T16:54:43.518 INFO:tasks.workunit.client.1.smithi194.stdout:9/220: mknod d19/d38/d41/c4d 1 2021-11-03T16:54:43.518 INFO:tasks.workunit.client.1.smithi194.stdout:1/92: dwrite d2/f1f [0,4194304] 0 2021-11-03T16:54:43.519 INFO:tasks.workunit.client.1.smithi194.stdout:4/242: symlink d6/d12/l49 0 2021-11-03T16:54:43.526 INFO:tasks.workunit.client.1.smithi194.stdout:1/93: unlink d2/l3 0 2021-11-03T16:54:43.526 INFO:tasks.workunit.client.1.smithi194.stdout:1/94: fdatasync d2/f15 0 2021-11-03T16:54:43.527 INFO:tasks.workunit.client.1.smithi194.stdout:4/243: mkdir d6/d8/d1a/d14/d4a 0 2021-11-03T16:54:43.530 INFO:tasks.workunit.client.1.smithi194.stdout:7/198: dread d6/f2d [0,4194304] 0 2021-11-03T16:54:43.532 INFO:tasks.workunit.client.1.smithi194.stdout:1/95: truncate d2/f1f 4113371 0 2021-11-03T16:54:43.533 INFO:tasks.workunit.client.1.smithi194.stdout:1/96: truncate d2/fd 676071 0 2021-11-03T16:54:43.533 INFO:tasks.workunit.client.1.smithi194.stdout:7/199: creat d6/da/d2b/f4b x:0 0 0 2021-11-03T16:54:43.533 INFO:tasks.workunit.client.1.smithi194.stdout:1/97: dread d2/fd [0,4194304] 0 2021-11-03T16:54:43.534 INFO:tasks.workunit.client.1.smithi194.stdout:1/98: mknod d2/da/c21 1 2021-11-03T16:54:43.534 INFO:tasks.workunit.client.1.smithi194.stdout:7/200: mkdir d6/d4c 0 2021-11-03T16:54:43.535 INFO:tasks.workunit.client.1.smithi194.stdout:7/201: chown d6/ld 13 1 2021-11-03T16:54:43.535 INFO:tasks.workunit.client.1.smithi194.stdout:4/244: dread d6/d12/d1e/f24 [0,4194304] 0 2021-11-03T16:54:43.536 INFO:tasks.workunit.client.1.smithi194.stdout:9/221: dread fd [0,4194304] 0 2021-11-03T16:54:43.536 INFO:tasks.workunit.client.1.smithi194.stdout:1/99: symlink d2/da/d13/l22 0 2021-11-03T16:54:43.538 INFO:tasks.workunit.client.1.smithi194.stdout:7/202: rename d6/da/f47 to d6/f4d 0 2021-11-03T16:54:43.539 INFO:tasks.workunit.client.1.smithi194.stdout:4/245: mkdir d6/d8/d1a/d4b 0 2021-11-03T16:54:43.540 INFO:tasks.workunit.client.1.smithi194.stdout:9/222: chown f5 898160258 1 2021-11-03T16:54:43.540 INFO:tasks.workunit.client.1.smithi194.stdout:7/203: dread d6/d15/f38 [0,4194304] 0 2021-11-03T16:54:43.543 INFO:tasks.workunit.client.1.smithi194.stdout:4/246: creat d6/d8/d1a/d14/f4c x:0 0 0 2021-11-03T16:54:43.549 INFO:tasks.workunit.client.1.smithi194.stdout:7/204: mkdir d6/d43/d46/d4e 0 2021-11-03T16:54:43.549 INFO:tasks.workunit.client.1.smithi194.stdout:1/100: mkdir d2/d1e/d23 0 2021-11-03T16:54:43.549 INFO:tasks.workunit.client.1.smithi194.stdout:7/205: fdatasync d6/da/d2b/f42 0 2021-11-03T16:54:43.555 INFO:tasks.workunit.client.1.smithi194.stdout:1/101: fdatasync d2/da/d13/f14 0 2021-11-03T16:54:43.555 INFO:tasks.workunit.client.1.smithi194.stdout:7/206: symlink d6/l4f 0 2021-11-03T16:54:43.576 INFO:tasks.workunit.client.1.smithi194.stdout:9/223: dwrite d19/f25 [0,4194304] 0 2021-11-03T16:54:43.579 INFO:tasks.workunit.client.1.smithi194.stdout:1/102: dwrite d2/f6 [0,4194304] 0 2021-11-03T16:54:43.580 INFO:tasks.workunit.client.1.smithi194.stdout:4/247: dwrite d6/f30 [0,4194304] 0 2021-11-03T16:54:43.583 INFO:tasks.workunit.client.1.smithi194.stdout:1/103: dread - d2/f10 zero size 2021-11-03T16:54:43.584 INFO:tasks.workunit.client.1.smithi194.stdout:9/224: write d19/d27/f3a [3757995,71049] 0 2021-11-03T16:54:43.584 INFO:tasks.workunit.client.1.smithi194.stdout:1/104: write d2/da/d13/f14 [1856419,21113] 0 2021-11-03T16:54:43.584 INFO:tasks.workunit.client.1.smithi194.stdout:9/225: mkdir d19/d38/d41/d4e 0 2021-11-03T16:54:43.586 INFO:tasks.workunit.client.1.smithi194.stdout:4/248: dread d6/d8/d1a/d14/f36 [0,4194304] 0 2021-11-03T16:54:43.586 INFO:tasks.workunit.client.1.smithi194.stdout:4/249: dread - d6/d12/f3f zero size 2021-11-03T16:54:43.587 INFO:tasks.workunit.client.1.smithi194.stdout:4/250: mknod d6/d8/d1a/d4b/c4d 1 2021-11-03T16:54:43.597 INFO:tasks.workunit.client.1.smithi194.stdout:9/226: write f5 [3256101,71008] 0 2021-11-03T16:54:43.598 INFO:tasks.workunit.client.1.smithi194.stdout:9/227: read - d19/d27/f4c zero size 2021-11-03T16:54:43.603 INFO:tasks.workunit.client.1.smithi194.stdout:9/228: dread f2 [0,4194304] 0 2021-11-03T16:54:43.603 INFO:tasks.workunit.client.1.smithi194.stdout:9/229: stat d19/f1a 0 2021-11-03T16:54:43.605 INFO:tasks.workunit.client.1.smithi194.stdout:9/230: unlink f8 0 2021-11-03T16:54:43.607 INFO:tasks.workunit.client.1.smithi194.stdout:7/207: dwrite d6/d15/f38 [0,4194304] 0 2021-11-03T16:54:43.608 INFO:tasks.workunit.client.1.smithi194.stdout:1/105: dwrite d2/f12 [0,4194304] 0 2021-11-03T16:54:43.608 INFO:tasks.workunit.client.1.smithi194.stdout:4/251: dwrite d6/f17 [0,4194304] 0 2021-11-03T16:54:43.610 INFO:tasks.workunit.client.1.smithi194.stdout:9/231: link d19/d27/d30/l34 d19/d27/d30/l4f 0 2021-11-03T16:54:43.612 INFO:tasks.workunit.client.1.smithi194.stdout:7/208: rmdir d6/d43 39 2021-11-03T16:54:43.617 INFO:tasks.workunit.client.1.smithi194.stdout:1/106: dread d2/fd [0,4194304] 0 2021-11-03T16:54:43.617 INFO:tasks.workunit.client.1.smithi194.stdout:4/252: mkdir d6/d8/d1a/d14/d4a/d4e 0 2021-11-03T16:54:43.621 INFO:tasks.workunit.client.1.smithi194.stdout:9/232: mkdir d19/d50 0 2021-11-03T16:54:43.622 INFO:tasks.workunit.client.1.smithi194.stdout:9/233: chown d19/d27/f2d 31 1 2021-11-03T16:54:43.626 INFO:tasks.workunit.client.1.smithi194.stdout:9/234: creat d19/d27/f51 x:0 0 0 2021-11-03T16:54:43.629 INFO:tasks.workunit.client.1.smithi194.stdout:9/235: mkdir d19/d38/d41/d52 0 2021-11-03T16:54:43.649 INFO:tasks.workunit.client.1.smithi194.stdout:1/107: dwrite d2/f20 [0,4194304] 0 2021-11-03T16:54:43.649 INFO:tasks.workunit.client.1.smithi194.stdout:7/209: dwrite d6/da/d2b/f37 [0,4194304] 0 2021-11-03T16:54:43.651 INFO:tasks.workunit.client.1.smithi194.stdout:1/108: fdatasync d2/f15 0 2021-11-03T16:54:43.661 INFO:tasks.workunit.client.1.smithi194.stdout:7/210: getdents d6 0 2021-11-03T16:54:43.661 INFO:tasks.workunit.client.1.smithi194.stdout:1/109: write d2/f1f [4193921,59491] 0 2021-11-03T16:54:43.662 INFO:tasks.workunit.client.1.smithi194.stdout:9/236: dread f9 [0,4194304] 0 2021-11-03T16:54:43.664 INFO:tasks.workunit.client.1.smithi194.stdout:7/211: mkdir d6/d15/d50 0 2021-11-03T16:54:43.664 INFO:tasks.workunit.client.1.smithi194.stdout:1/110: getdents d2/da/d13 0 2021-11-03T16:54:43.665 INFO:tasks.workunit.client.1.smithi194.stdout:7/212: symlink d6/d24/l51 0 2021-11-03T16:54:43.665 INFO:tasks.workunit.client.1.smithi194.stdout:1/111: dread - d2/f1c zero size 2021-11-03T16:54:43.667 INFO:tasks.workunit.client.1.smithi194.stdout:7/213: rename d6/da/d2b/l49 to d6/da/d2b/l52 0 2021-11-03T16:54:43.668 INFO:tasks.workunit.client.1.smithi194.stdout:1/112: getdents d2/da 0 2021-11-03T16:54:43.668 INFO:tasks.workunit.client.1.smithi194.stdout:1/113: mknod d2/da/c24 1 2021-11-03T16:54:43.668 INFO:tasks.workunit.client.1.smithi194.stdout:7/214: truncate d6/da/d2b/f31 1609716 0 2021-11-03T16:54:43.672 INFO:tasks.workunit.client.1.smithi194.stdout:1/114: write d2/f18 [5686,109792] 0 2021-11-03T16:54:43.672 INFO:tasks.workunit.client.1.smithi194.stdout:1/115: chown d2/f12 1004 1 2021-11-03T16:54:43.672 INFO:tasks.workunit.client.1.smithi194.stdout:7/215: rename d6/f19 to d6/da/d2b/f53 0 2021-11-03T16:54:43.672 INFO:tasks.workunit.client.1.smithi194.stdout:1/116: dread d2/da/ff [0,4194304] 0 2021-11-03T16:54:43.673 INFO:tasks.workunit.client.1.smithi194.stdout:1/117: chown d2/da/ff 225 1 2021-11-03T16:54:43.673 INFO:tasks.workunit.client.1.smithi194.stdout:7/216: mkdir d6/d4c/d54 0 2021-11-03T16:54:43.674 INFO:tasks.workunit.client.1.smithi194.stdout:1/118: write d2/f6 [3223191,45773] 0 2021-11-03T16:54:43.675 INFO:tasks.workunit.client.1.smithi194.stdout:7/217: truncate d6/d43/f44 2490177 0 2021-11-03T16:54:43.675 INFO:tasks.workunit.client.1.smithi194.stdout:7/218: write d6/da/f27 [4420756,105513] 0 2021-11-03T16:54:43.675 INFO:tasks.workunit.client.1.smithi194.stdout:7/219: write d6/f2f [789992,87109] 0 2021-11-03T16:54:43.675 INFO:tasks.workunit.client.1.smithi194.stdout:7/220: stat d6/f2a 0 2021-11-03T16:54:43.676 INFO:tasks.workunit.client.1.smithi194.stdout:9/237: dread fb [0,4194304] 0 2021-11-03T16:54:43.681 INFO:tasks.workunit.client.1.smithi194.stdout:1/119: dread d2/f12 [0,4194304] 0 2021-11-03T16:54:43.681 INFO:tasks.workunit.client.1.smithi194.stdout:1/120: chown d2 379782135 1 2021-11-03T16:54:43.682 INFO:tasks.workunit.client.1.smithi194.stdout:1/121: chown d2/f10 19251 1 2021-11-03T16:54:43.686 INFO:tasks.workunit.client.1.smithi194.stdout:7/221: mkdir d6/d24/d55 0 2021-11-03T16:54:43.686 INFO:tasks.workunit.client.1.smithi194.stdout:7/222: fdatasync d6/f20 0 2021-11-03T16:54:43.686 INFO:tasks.workunit.client.1.smithi194.stdout:7/223: fsync d6/f2a 0 2021-11-03T16:54:43.687 INFO:tasks.workunit.client.1.smithi194.stdout:7/224: chown d6/da/d2b/f37 87235 1 2021-11-03T16:54:43.687 INFO:tasks.workunit.client.1.smithi194.stdout:9/238: rmdir d19/d49 0 2021-11-03T16:54:43.689 INFO:tasks.workunit.client.1.smithi194.stdout:1/122: creat d2/d1e/f25 x:0 0 0 2021-11-03T16:54:43.692 INFO:tasks.workunit.client.1.smithi194.stdout:9/239: mkdir d19/d27/d30/d53 0 2021-11-03T16:54:43.693 INFO:tasks.workunit.client.1.smithi194.stdout:1/123: rmdir d2 39 2021-11-03T16:54:43.694 INFO:tasks.workunit.client.1.smithi194.stdout:1/124: fdatasync d2/da/ff 0 2021-11-03T16:54:43.696 INFO:tasks.workunit.client.1.smithi194.stdout:9/240: rename d19/d38/d41/d48 to d19/d38/d41/d4e/d54 0 2021-11-03T16:54:43.696 INFO:tasks.workunit.client.1.smithi194.stdout:1/125: rename d2 to d2/d1e/d26 22 2021-11-03T16:54:43.698 INFO:tasks.workunit.client.1.smithi194.stdout:9/241: link d19/d38/d41/f44 d19/d50/f55 0 2021-11-03T16:54:43.698 INFO:tasks.workunit.client.1.smithi194.stdout:9/242: dread - d19/d33/f35 zero size 2021-11-03T16:54:43.699 INFO:tasks.workunit.client.1.smithi194.stdout:9/243: stat d19/d38/d41/f44 0 2021-11-03T16:54:43.699 INFO:tasks.workunit.client.1.smithi194.stdout:1/126: rename d2/f12 to d2/f27 0 2021-11-03T16:54:43.701 INFO:tasks.workunit.client.1.smithi194.stdout:9/244: creat d19/d50/f56 x:0 0 0 2021-11-03T16:54:43.701 INFO:tasks.workunit.client.1.smithi194.stdout:9/245: chown d19/d27/f3a 545 1 2021-11-03T16:54:43.702 INFO:tasks.workunit.client.1.smithi194.stdout:9/246: symlink d19/d38/l57 2 2021-11-03T16:54:43.702 INFO:tasks.workunit.client.1.smithi194.stdout:9/247: write d19/d27/f2c [47790,77034] 0 2021-11-03T16:54:43.702 INFO:tasks.workunit.client.1.smithi194.stdout:9/248: mknod d19/d38/d41/d52/c58 1 2021-11-03T16:54:43.702 INFO:tasks.workunit.client.1.smithi194.stdout:9/249: truncate d19/d38/d41/f44 204292 0 2021-11-03T16:54:43.703 INFO:tasks.workunit.client.1.smithi194.stdout:7/225: dwrite f4 [4194304,4194304] 0 2021-11-03T16:54:43.703 INFO:tasks.workunit.client.1.smithi194.stdout:1/127: unlink d2/da/f11 0 2021-11-03T16:54:43.706 INFO:tasks.workunit.client.1.smithi194.stdout:9/250: creat d19/d27/f59 x:0 0 0 2021-11-03T16:54:43.706 INFO:tasks.workunit.client.1.smithi194.stdout:9/251: dread - d19/f22 zero size 2021-11-03T16:54:43.707 INFO:tasks.workunit.client.1.smithi194.stdout:9/252: chown d19/l3e 7274 1 2021-11-03T16:54:43.707 INFO:tasks.workunit.client.1.smithi194.stdout:9/253: creat d19/d50/f5a x:0 0 0 2021-11-03T16:54:43.709 INFO:tasks.workunit.client.1.smithi194.stdout:9/254: write d19/d27/f29 [3897406,14632] 0 2021-11-03T16:54:43.709 INFO:tasks.workunit.client.1.smithi194.stdout:9/255: dread - d19/d27/d30/f47 zero size 2021-11-03T16:54:43.711 INFO:tasks.workunit.client.1.smithi194.stdout:9/256: unlink d19/d27/f2d 0 2021-11-03T16:54:43.716 INFO:tasks.workunit.client.1.smithi194.stdout:1/128: dread d2/f6 [0,4194304] 0 2021-11-03T16:54:43.720 INFO:tasks.workunit.client.1.smithi194.stdout:9/257: rename d19/d27/d30/l3d to d19/d38/d41/l5b 0 2021-11-03T16:54:43.722 INFO:tasks.workunit.client.1.smithi194.stdout:1/129: mknod d2/c28 1 2021-11-03T16:54:43.740 INFO:tasks.workunit.client.1.smithi194.stdout:9/258: dwrite d19/d27/f37 [0,4194304] 0 2021-11-03T16:54:43.742 INFO:tasks.workunit.client.1.smithi194.stdout:9/259: link d19/d27/f4c d19/d38/f5c 0 2021-11-03T16:54:43.746 INFO:tasks.workunit.client.1.smithi194.stdout:9/260: mkdir d19/d38/d41/d4e/d54/d5d 0 2021-11-03T16:54:43.746 INFO:tasks.workunit.client.1.smithi194.stdout:9/261: dread - d19/d27/f51 zero size 2021-11-03T16:54:43.746 INFO:tasks.workunit.client.1.smithi194.stdout:9/262: read - d19/d27/f4b zero size 2021-11-03T16:54:43.746 INFO:tasks.workunit.client.1.smithi194.stdout:9/263: write d19/d27/f2c [897072,114460] 0 2021-11-03T16:54:43.747 INFO:tasks.workunit.client.1.smithi194.stdout:9/264: mknod d19/d38/d41/d52/c5e 1 2021-11-03T16:54:43.747 INFO:tasks.workunit.client.1.smithi194.stdout:9/265: stat d19/l3e 0 2021-11-03T16:54:43.747 INFO:tasks.workunit.client.1.smithi194.stdout:9/266: chown d19/d38/d41/f42 1719 1 2021-11-03T16:54:43.747 INFO:tasks.workunit.client.1.smithi194.stdout:9/267: mkdir d19/d38/d41/d4e/d5f 0 2021-11-03T16:54:43.748 INFO:tasks.workunit.client.1.smithi194.stdout:9/268: dread - d19/d27/f4c zero size 2021-11-03T16:54:43.748 INFO:tasks.workunit.client.1.smithi194.stdout:9/269: read - d19/d27/d30/f47 zero size 2021-11-03T16:54:43.748 INFO:tasks.workunit.client.1.smithi194.stdout:9/270: write d19/d50/f55 [1072410,57173] 0 2021-11-03T16:54:43.749 INFO:tasks.workunit.client.1.smithi194.stdout:9/271: dread - f17 zero size 2021-11-03T16:54:43.749 INFO:tasks.workunit.client.1.smithi194.stdout:9/272: write d19/d38/d41/f42 [5144849,108194] 0 2021-11-03T16:54:43.749 INFO:tasks.workunit.client.1.smithi194.stdout:9/273: chown d19/f1e 197924973 1 2021-11-03T16:54:43.750 INFO:tasks.workunit.client.1.smithi194.stdout:9/274: chown d19/f25 103 1 2021-11-03T16:54:43.751 INFO:tasks.workunit.client.1.smithi194.stdout:9/275: mkdir d19/d50/d60 0 2021-11-03T16:54:43.751 INFO:tasks.workunit.client.1.smithi194.stdout:9/276: dread - d19/d27/d30/f47 zero size 2021-11-03T16:54:43.752 INFO:tasks.workunit.client.1.smithi194.stdout:9/277: dread f3 [0,4194304] 0 2021-11-03T16:54:43.754 INFO:tasks.workunit.client.1.smithi194.stdout:9/278: mkdir d19/d38/d41/d4e/d54/d61 0 2021-11-03T16:54:43.754 INFO:tasks.workunit.client.1.smithi194.stdout:9/279: fdatasync d19/f22 0 2021-11-03T16:54:43.755 INFO:tasks.workunit.client.1.smithi194.stdout:9/280: mkdir d19/d38/d41/d4e/d62 0 2021-11-03T16:54:43.756 INFO:tasks.workunit.client.1.smithi194.stdout:9/281: write f5 [2192314,116189] 0 2021-11-03T16:54:43.757 INFO:tasks.workunit.client.1.smithi194.stdout:9/282: dread - d19/d50/f56 zero size 2021-11-03T16:54:43.757 INFO:tasks.workunit.client.1.smithi194.stdout:9/283: write d19/d27/f37 [3114219,7724] 0 2021-11-03T16:54:43.762 INFO:tasks.workunit.client.1.smithi194.stdout:9/284: dread fd [0,4194304] 0 2021-11-03T16:54:43.763 INFO:tasks.workunit.client.1.smithi194.stdout:9/285: write d19/d38/f3c [941779,5148] 0 2021-11-03T16:54:43.763 INFO:tasks.workunit.client.1.smithi194.stdout:9/286: write d19/d27/f4c [969886,75349] 0 2021-11-03T16:54:43.763 INFO:tasks.workunit.client.1.smithi194.stdout:9/287: truncate d19/d27/f29 4694905 0 2021-11-03T16:54:43.763 INFO:tasks.workunit.client.1.smithi194.stdout:9/288: mknod d19/d38/d41/d4e/d54/d5d/c63 1 2021-11-03T16:54:43.764 INFO:tasks.workunit.client.1.smithi194.stdout:9/289: mknod d19/d38/d41/c64 1 2021-11-03T16:54:43.765 INFO:tasks.workunit.client.1.smithi194.stdout:9/290: getdents d19 0 2021-11-03T16:54:43.770 INFO:tasks.workunit.client.1.smithi194.stdout:9/291: dread d19/d38/f3c [0,4194304] 0 2021-11-03T16:54:43.783 INFO:tasks.workunit.client.1.smithi194.stdout:9/292: dwrite d19/d27/f46 [0,4194304] 0 2021-11-03T16:54:43.785 INFO:tasks.workunit.client.1.smithi194.stdout:9/293: creat d19/d38/d41/d4e/f65 x:0 0 0 2021-11-03T16:54:43.807 INFO:tasks.workunit.client.1.smithi194.stdout:9/294: dwrite d19/d38/d41/f42 [0,4194304] 0 2021-11-03T16:54:43.841 INFO:tasks.workunit.client.1.smithi194.stdout:9/295: dwrite d19/d27/f51 [0,4194304] 0 2021-11-03T16:54:43.841 INFO:tasks.workunit.client.1.smithi194.stdout:9/296: dread - f17 zero size 2021-11-03T16:54:43.848 INFO:tasks.workunit.client.1.smithi194.stdout:9/297: symlink d19/d38/d41/d4e/d54/l66 0 2021-11-03T16:54:43.848 INFO:tasks.workunit.client.1.smithi194.stdout:9/298: chown f5 2782723 1 2021-11-03T16:54:43.848 INFO:tasks.workunit.client.1.smithi194.stdout:9/299: chown d19/f1e 374 1 2021-11-03T16:54:43.849 INFO:tasks.workunit.client.1.smithi194.stdout:9/300: readlink le 0 2021-11-03T16:54:43.849 INFO:tasks.workunit.client.1.smithi194.stdout:9/301: creat d19/d27/d30/f67 x:0 0 0 2021-11-03T16:54:43.876 INFO:tasks.workunit.client.1.smithi194.stdout:9/302: dwrite d19/d50/f5a [0,4194304] 0 2021-11-03T16:54:43.877 INFO:tasks.workunit.client.1.smithi194.stdout:9/303: read d19/d50/f55 [745524,123194] 0 2021-11-03T16:54:43.882 INFO:tasks.workunit.client.1.smithi194.stdout:9/304: rename d19/d38/d41 to d19/d27/d30/d53/d68 0 2021-11-03T16:54:43.883 INFO:tasks.workunit.client.1.smithi194.stdout:9/305: chown d19/d27/f59 24375 1 2021-11-03T16:54:43.886 INFO:tasks.workunit.client.1.smithi194.stdout:9/306: getdents d19/d33 0 2021-11-03T16:54:43.886 INFO:tasks.workunit.client.1.smithi194.stdout:9/307: dread - d19/d27/d30/d53/d68/d4e/f65 zero size 2021-11-03T16:54:43.887 INFO:tasks.workunit.client.1.smithi194.stdout:9/308: chown d19/d27 64107217 1 2021-11-03T16:54:43.910 INFO:tasks.workunit.client.1.smithi194.stdout:9/309: dread f2 [0,4194304] 0 2021-11-03T16:54:43.910 INFO:tasks.workunit.client.1.smithi194.stdout:9/310: write d19/d27/d30/d53/d68/d4e/f65 [34652,97157] 0 2021-11-03T16:54:43.912 INFO:tasks.workunit.client.1.smithi194.stdout:9/311: creat d19/d27/d30/d53/d68/d4e/d54/d5d/f69 x:0 0 0 2021-11-03T16:54:43.912 INFO:tasks.workunit.client.1.smithi194.stdout:9/312: getdents d19/d27/d30/d53/d68/d4e/d54/d61 0 2021-11-03T16:54:43.913 INFO:tasks.workunit.client.1.smithi194.stdout:9/313: creat d19/d50/d60/f6a x:0 0 0 2021-11-03T16:54:43.919 INFO:tasks.workunit.client.1.smithi194.stdout:9/314: rename d19/d27 to d19/d33/d6b 0 2021-11-03T16:54:43.919 INFO:tasks.workunit.client.1.smithi194.stdout:9/315: fdatasync d19/f1a 0 2021-11-03T16:54:43.922 INFO:tasks.workunit.client.1.smithi194.stdout:9/316: rename d19/d33/d6b/d30/l34 to d19/d33/d6b/d30/d53/d68/d4e/d54/l6c 0 2021-11-03T16:54:43.922 INFO:tasks.workunit.client.1.smithi194.stdout:9/317: stat f2 0 2021-11-03T16:54:43.922 INFO:tasks.workunit.client.1.smithi194.stdout:9/318: mknod d19/d33/d6b/d30/d53/d68/d4e/d62/c6d 1 2021-11-03T16:54:43.928 INFO:tasks.workunit.client.1.smithi194.stdout:9/319: dread d19/f1a [0,4194304] 0 2021-11-03T16:54:43.929 INFO:tasks.workunit.client.1.smithi194.stdout:9/320: creat d19/d38/f6e x:0 0 0 2021-11-03T16:54:43.931 INFO:tasks.workunit.client.1.smithi194.stdout:9/321: symlink d19/d33/d6b/d30/d53/d68/d52/l6f 0 2021-11-03T16:54:44.087 INFO:tasks.workunit.client.1.smithi194.stdout:0/118: sync 2021-11-03T16:54:44.088 INFO:tasks.workunit.client.1.smithi194.stdout:0/119: stat d5 0 2021-11-03T16:54:44.088 INFO:tasks.workunit.client.1.smithi194.stdout:0/120: fdatasync d5/f20 0 2021-11-03T16:54:44.088 INFO:tasks.workunit.client.1.smithi194.stdout:0/121: readlink d5/l1e 0 2021-11-03T16:54:44.236 INFO:tasks.workunit.client.1.smithi194.stdout:3/211: sync 2021-11-03T16:54:44.237 INFO:tasks.workunit.client.1.smithi194.stdout:2/353: sync 2021-11-03T16:54:44.238 INFO:tasks.workunit.client.1.smithi194.stdout:2/354: rmdir d6/d21 39 2021-11-03T16:54:44.239 INFO:tasks.workunit.client.1.smithi194.stdout:2/355: readlink d6/d21/d2a/d35/l3e 0 2021-11-03T16:54:44.240 INFO:tasks.workunit.client.1.smithi194.stdout:3/212: unlink d2/d17/f19 0 2021-11-03T16:54:44.241 INFO:tasks.workunit.client.1.smithi194.stdout:3/213: fsync d2/f11 0 2021-11-03T16:54:44.245 INFO:tasks.workunit.client.1.smithi194.stdout:3/214: creat d2/d20/d36/f4c x:0 0 0 2021-11-03T16:54:44.245 INFO:tasks.workunit.client.1.smithi194.stdout:3/215: stat d2/d20/d36/d43/l4b 0 2021-11-03T16:54:44.246 INFO:tasks.workunit.client.1.smithi194.stdout:3/216: creat d2/d20/d36/d43/f4d x:0 0 0 2021-11-03T16:54:44.248 INFO:tasks.workunit.client.1.smithi194.stdout:3/217: mkdir d2/d20/d36/d4e 0 2021-11-03T16:54:44.248 INFO:tasks.workunit.client.1.smithi194.stdout:3/218: fdatasync d2/d20/f46 0 2021-11-03T16:54:44.249 INFO:tasks.workunit.client.1.smithi194.stdout:3/219: creat d2/d17/f4f x:0 0 0 2021-11-03T16:54:44.249 INFO:tasks.workunit.client.1.smithi194.stdout:3/220: write d2/d17/f30 [492477,6345] 0 2021-11-03T16:54:44.250 INFO:tasks.workunit.client.1.smithi194.stdout:3/221: dread d2/d17/f1c [0,4194304] 0 2021-11-03T16:54:44.251 INFO:tasks.workunit.client.1.smithi194.stdout:3/222: write d2/f12 [4042689,35711] 0 2021-11-03T16:54:44.252 INFO:tasks.workunit.client.1.smithi194.stdout:3/223: creat d2/d33/f50 x:0 0 0 2021-11-03T16:54:44.252 INFO:tasks.workunit.client.1.smithi194.stdout:2/356: dwrite d6/de/d27/f49 [0,4194304] 0 2021-11-03T16:54:44.253 INFO:tasks.workunit.client.1.smithi194.stdout:3/224: rmdir d2/d33/d3d 0 2021-11-03T16:54:44.273 INFO:tasks.workunit.client.1.smithi194.stdout:3/225: rename d2/d17/d26/d39 to d2/d20/d36/d51 0 2021-11-03T16:54:44.278 INFO:tasks.workunit.client.1.smithi194.stdout:2/357: write d6/ff [1598059,5081] 0 2021-11-03T16:54:44.279 INFO:tasks.workunit.client.1.smithi194.stdout:3/226: symlink d2/d20/d36/l52 0 2021-11-03T16:54:44.279 INFO:tasks.workunit.client.1.smithi194.stdout:3/227: chown d2/d17/d26/l49 16989 1 2021-11-03T16:54:44.280 INFO:tasks.workunit.client.1.smithi194.stdout:3/228: dread - d2/d17/f47 zero size 2021-11-03T16:54:44.280 INFO:tasks.workunit.client.1.smithi194.stdout:3/229: readlink d2/d20/d36/l52 0 2021-11-03T16:54:44.283 INFO:tasks.workunit.client.1.smithi194.stdout:3/230: creat d2/d20/d36/d51/f53 x:0 0 0 2021-11-03T16:54:44.284 INFO:tasks.workunit.client.1.smithi194.stdout:3/231: creat d2/f54 x:0 0 0 2021-11-03T16:54:44.285 INFO:tasks.workunit.client.1.smithi194.stdout:3/232: dread d2/d20/f46 [0,4194304] 0 2021-11-03T16:54:44.285 INFO:tasks.workunit.client.1.smithi194.stdout:3/233: fdatasync d2/d20/f45 0 2021-11-03T16:54:44.285 INFO:tasks.workunit.client.1.smithi194.stdout:3/234: write d2/d20/d36/d51/f53 [777740,127093] 0 2021-11-03T16:54:44.286 INFO:tasks.workunit.client.1.smithi194.stdout:3/235: write d2/d17/f1c [456233,4541] 0 2021-11-03T16:54:44.286 INFO:tasks.workunit.client.1.smithi194.stdout:3/236: creat d2/d17/d26/f55 x:0 0 0 2021-11-03T16:54:44.288 INFO:tasks.workunit.client.1.smithi194.stdout:2/358: truncate d6/d21/f23 3779950 0 2021-11-03T16:54:44.290 INFO:tasks.workunit.client.1.smithi194.stdout:2/359: mkdir d6/d6a 0 2021-11-03T16:54:44.290 INFO:tasks.workunit.client.1.smithi194.stdout:2/360: mknod d6/de/d16/d20/c6b 1 2021-11-03T16:54:44.291 INFO:tasks.workunit.client.1.smithi194.stdout:2/361: mknod d6/de/c6c 1 2021-11-03T16:54:44.293 INFO:tasks.workunit.client.1.smithi194.stdout:2/362: mkdir d6/d17/d68/d6d 0 2021-11-03T16:54:44.302 INFO:tasks.workunit.client.1.smithi194.stdout:3/237: dwrite d2/d20/f45 [0,4194304] 0 2021-11-03T16:54:44.303 INFO:tasks.workunit.client.1.smithi194.stdout:3/238: chown d2/ff 362136399 1 2021-11-03T16:54:44.307 INFO:tasks.workunit.client.1.smithi194.stdout:3/239: link d2/f38 d2/d20/d36/d51/f56 0 2021-11-03T16:54:44.310 INFO:tasks.workunit.client.1.smithi194.stdout:3/240: rename d2/l8 to d2/d20/d36/d4e/l57 0 2021-11-03T16:54:44.310 INFO:tasks.workunit.client.1.smithi194.stdout:3/241: dread - d2/d20/d36/f4c zero size 2021-11-03T16:54:44.310 INFO:tasks.workunit.client.1.smithi194.stdout:3/242: chown d2/d20/d36/d43/l4b 14263 1 2021-11-03T16:54:44.312 INFO:tasks.workunit.client.1.smithi194.stdout:3/243: creat d2/d17/f58 x:0 0 0 2021-11-03T16:54:44.313 INFO:tasks.workunit.client.1.smithi194.stdout:3/244: link d2/d20/d36/d51/f53 d2/d20/f59 0 2021-11-03T16:54:44.318 INFO:tasks.workunit.client.1.smithi194.stdout:2/363: dwrite d6/de/d16/f50 [0,4194304] 0 2021-11-03T16:54:44.367 INFO:tasks.workunit.client.1.smithi194.stdout:3/245: truncate d2/d20/f45 3362975 0 2021-11-03T16:54:44.373 INFO:tasks.workunit.client.1.smithi194.stdout:2/364: mkdir d6/d1f/d4c/d6e 0 2021-11-03T16:54:44.378 INFO:tasks.workunit.client.1.smithi194.stdout:3/246: creat d2/d20/f5a x:0 0 0 2021-11-03T16:54:44.380 INFO:tasks.workunit.client.1.smithi194.stdout:3/247: write d2/f6 [630365,94675] 0 2021-11-03T16:54:44.380 INFO:tasks.workunit.client.1.smithi194.stdout:2/365: symlink d6/d21/d43/l6f 0 2021-11-03T16:54:44.380 INFO:tasks.workunit.client.1.smithi194.stdout:2/366: mknod d6/d17/d68/c70 1 2021-11-03T16:54:44.380 INFO:tasks.workunit.client.1.smithi194.stdout:2/367: chown d6/d21/d2a/d31/f37 13 1 2021-11-03T16:54:44.384 INFO:tasks.workunit.client.1.smithi194.stdout:3/248: getdents d2/d20/d36/d4e 0 2021-11-03T16:54:44.384 INFO:tasks.workunit.client.1.smithi194.stdout:3/249: write d2/d17/d1d/f3c [322324,81012] 0 2021-11-03T16:54:44.388 INFO:tasks.workunit.client.1.smithi194.stdout:3/250: rename d2/l1a to d2/d17/d26/l5b 0 2021-11-03T16:54:44.388 INFO:tasks.workunit.client.1.smithi194.stdout:3/251: write d2/d17/f1c [898677,423] 0 2021-11-03T16:54:44.394 INFO:tasks.workunit.client.1.smithi194.stdout:2/368: dwrite d6/de/d11/f4d [0,4194304] 0 2021-11-03T16:54:44.395 INFO:tasks.workunit.client.1.smithi194.stdout:2/369: stat d6/de/f5c 0 2021-11-03T16:54:44.406 INFO:tasks.workunit.client.1.smithi194.stdout:3/252: dwrite d2/d17/f34 [0,4194304] 0 2021-11-03T16:54:44.409 INFO:tasks.workunit.client.1.smithi194.stdout:3/253: dread d2/f11 [0,4194304] 0 2021-11-03T16:54:44.409 INFO:tasks.workunit.client.1.smithi194.stdout:3/254: fdatasync d2/d20/d36/d51/f56 0 2021-11-03T16:54:44.409 INFO:tasks.workunit.client.1.smithi194.stdout:3/255: mknod d2/d17/c5c 1 2021-11-03T16:54:44.410 INFO:tasks.workunit.client.1.smithi194.stdout:3/256: readlink d2/d17/l32 0 2021-11-03T16:54:44.439 INFO:tasks.workunit.client.1.smithi194.stdout:3/257: dwrite d2/d17/f30 [0,4194304] 0 2021-11-03T16:54:44.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:44 smithi194 conmon[35111]: cluster 2021-11-03T16:54:43.076296+0000 mgr.smithi026.cnrxli (mgr.14162) 315 : cluster [DBG] pgmap v258: 65 pgs: 65 active+clean; 603 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 22 MiB/s rd, 45 MiB/s wr, 243 op/s 2021-11-03T16:54:44.514 INFO:tasks.workunit.client.1.smithi194.stdout:8/247: sync 2021-11-03T16:54:44.514 INFO:tasks.workunit.client.1.smithi194.stdout:5/244: sync 2021-11-03T16:54:44.514 INFO:tasks.workunit.client.1.smithi194.stdout:6/249: sync 2021-11-03T16:54:44.515 INFO:tasks.workunit.client.1.smithi194.stdout:6/250: chown de/d1f/d43 6 1 2021-11-03T16:54:44.515 INFO:tasks.workunit.client.1.smithi194.stdout:6/251: write de/d21/d3e/f48 [225892,87835] 0 2021-11-03T16:54:44.515 INFO:tasks.workunit.client.1.smithi194.stdout:8/248: readlink d8/l11 0 2021-11-03T16:54:44.517 INFO:tasks.workunit.client.1.smithi194.stdout:5/245: unlink d2/dd/d35/f36 0 2021-11-03T16:54:44.519 INFO:tasks.workunit.client.1.smithi194.stdout:6/252: unlink de/d21/d2d/f33 0 2021-11-03T16:54:44.521 INFO:tasks.workunit.client.1.smithi194.stdout:8/249: creat d8/d35/d42/f63 x:0 0 0 2021-11-03T16:54:44.522 INFO:tasks.workunit.client.1.smithi194.stdout:8/250: fsync d8/f2e 0 2021-11-03T16:54:44.523 INFO:tasks.workunit.client.1.smithi194.stdout:5/246: creat d2/dd/d35/f58 x:0 0 0 2021-11-03T16:54:44.523 INFO:tasks.workunit.client.1.smithi194.stdout:5/247: dread - d2/dd/d35/f54 zero size 2021-11-03T16:54:44.523 INFO:tasks.workunit.client.1.smithi194.stdout:6/253: creat de/d21/d41/f4f x:0 0 0 2021-11-03T16:54:44.523 INFO:tasks.workunit.client.1.smithi194.stdout:5/248: write d2/dd/f20 [1339869,82285] 0 2021-11-03T16:54:44.524 INFO:tasks.workunit.client.1.smithi194.stdout:6/254: symlink de/d1f/d43/l50 0 2021-11-03T16:54:44.530 INFO:tasks.workunit.client.1.smithi194.stdout:5/249: mkdir d2/d59 0 2021-11-03T16:54:44.531 INFO:tasks.workunit.client.1.smithi194.stdout:5/250: chown d2/d2a/d39/f3e 1 1 2021-11-03T16:54:44.531 INFO:tasks.workunit.client.1.smithi194.stdout:5/251: dread - d2/d2a/f4f zero size 2021-11-03T16:54:44.532 INFO:tasks.workunit.client.1.smithi194.stdout:6/255: mkdir de/d21/d51 0 2021-11-03T16:54:44.532 INFO:tasks.workunit.client.1.smithi194.stdout:8/251: symlink d8/d24/l64 0 2021-11-03T16:54:44.532 INFO:tasks.workunit.client.1.smithi194.stdout:8/252: mknod d8/d33/c65 1 2021-11-03T16:54:44.534 INFO:tasks.workunit.client.1.smithi194.stdout:8/253: mknod d8/c66 1 2021-11-03T16:54:44.535 INFO:tasks.workunit.client.1.smithi194.stdout:5/252: write d2/dd/f1b [2696917,45240] 0 2021-11-03T16:54:44.535 INFO:tasks.workunit.client.1.smithi194.stdout:5/253: chown d2/dd 10 1 2021-11-03T16:54:44.535 INFO:tasks.workunit.client.1.smithi194.stdout:8/254: rename d8/d24/l5f to d8/d33/d51/l67 0 2021-11-03T16:54:44.536 INFO:tasks.workunit.client.1.smithi194.stdout:8/255: write d8/f3c [44513,126048] 0 2021-11-03T16:54:44.536 INFO:tasks.workunit.client.1.smithi194.stdout:5/254: link d2/d2a/f4f d2/d2a/f5a 0 2021-11-03T16:54:44.537 INFO:tasks.workunit.client.1.smithi194.stdout:8/256: stat d8/d33/l4b 0 2021-11-03T16:54:44.538 INFO:tasks.workunit.client.1.smithi194.stdout:8/257: read d8/d24/f32 [2806051,99601] 0 2021-11-03T16:54:44.539 INFO:tasks.workunit.client.1.smithi194.stdout:8/258: creat d8/d33/d3e/f68 x:0 0 0 2021-11-03T16:54:44.539 INFO:tasks.workunit.client.1.smithi194.stdout:8/259: dread - d8/d33/d3e/f60 zero size 2021-11-03T16:54:44.540 INFO:tasks.workunit.client.1.smithi194.stdout:8/260: fdatasync d8/d33/d3e/f68 0 2021-11-03T16:54:44.540 INFO:tasks.workunit.client.1.smithi194.stdout:6/256: dread de/f24 [0,4194304] 0 2021-11-03T16:54:44.542 INFO:tasks.workunit.client.1.smithi194.stdout:6/257: creat de/d21/f52 x:0 0 0 2021-11-03T16:54:44.542 INFO:tasks.workunit.client.1.smithi194.stdout:6/258: chown de/d21/d41 0 1 2021-11-03T16:54:44.552 INFO:tasks.workunit.client.1.smithi194.stdout:6/259: dread de/d1f/f49 [0,4194304] 0 2021-11-03T16:54:44.583 INFO:tasks.workunit.client.1.smithi194.stdout:5/255: dwrite f0 [0,4194304] 0 2021-11-03T16:54:44.583 INFO:tasks.workunit.client.1.smithi194.stdout:5/256: dread - d2/f44 zero size 2021-11-03T16:54:44.584 INFO:tasks.workunit.client.1.smithi194.stdout:8/261: dwrite d8/d33/d3e/d5d/f5a [0,4194304] 0 2021-11-03T16:54:44.584 INFO:tasks.workunit.client.1.smithi194.stdout:6/260: dwrite de/d21/d2d/f4b [0,4194304] 0 2021-11-03T16:54:44.585 INFO:tasks.workunit.client.1.smithi194.stdout:5/257: symlink d2/d3/d57/l5b 0 2021-11-03T16:54:44.587 INFO:tasks.workunit.client.1.smithi194.stdout:8/262: mkdir d8/d33/d3e/d5d/d69 0 2021-11-03T16:54:44.588 INFO:tasks.workunit.client.1.smithi194.stdout:6/261: symlink de/d21/d3e/l53 0 2021-11-03T16:54:44.588 INFO:tasks.workunit.client.1.smithi194.stdout:6/262: write de/d21/f2b [5517231,129903] 0 2021-11-03T16:54:44.590 INFO:tasks.workunit.client.1.smithi194.stdout:5/258: rename d2/d3/fc to d2/dd/d35/f5c 0 2021-11-03T16:54:44.590 INFO:tasks.workunit.client.1.smithi194.stdout:5/259: getdents d2/d59 0 2021-11-03T16:54:44.591 INFO:tasks.workunit.client.1.smithi194.stdout:8/263: truncate d8/f2a 225528 0 2021-11-03T16:54:44.594 INFO:tasks.workunit.client.1.smithi194.stdout:5/260: rename d2/d2a/f4f to d2/d3/f5d 0 2021-11-03T16:54:44.594 INFO:tasks.workunit.client.1.smithi194.stdout:5/261: fsync d2/dd/f3c 0 2021-11-03T16:54:44.595 INFO:tasks.workunit.client.1.smithi194.stdout:6/263: dread de/f10 [0,4194304] 0 2021-11-03T16:54:44.595 INFO:tasks.workunit.client.1.smithi194.stdout:6/264: write de/d21/d3e/f48 [555462,87800] 0 2021-11-03T16:54:44.596 INFO:tasks.workunit.client.1.smithi194.stdout:6/265: write de/d21/d2d/f4b [4632277,44105] 0 2021-11-03T16:54:44.604 INFO:tasks.workunit.client.1.smithi194.stdout:8/264: creat d8/d33/f6a x:0 0 0 2021-11-03T16:54:44.604 INFO:tasks.workunit.client.1.smithi194.stdout:8/265: truncate d8/d24/f52 1321679 0 2021-11-03T16:54:44.605 INFO:tasks.workunit.client.1.smithi194.stdout:6/266: unlink de/f28 0 2021-11-03T16:54:44.608 INFO:tasks.workunit.client.1.smithi194.stdout:5/262: getdents d2/dd/d35 0 2021-11-03T16:54:44.608 INFO:tasks.workunit.client.1.smithi194.stdout:5/263: fdatasync d2/d3/f22 0 2021-11-03T16:54:44.612 INFO:tasks.workunit.client.1.smithi194.stdout:8/266: creat d8/d33/d3e/f6b x:0 0 0 2021-11-03T16:54:44.614 INFO:tasks.workunit.client.1.smithi194.stdout:6/267: rename de/d1f/d26/d3f/l47 to de/d21/l54 0 2021-11-03T16:54:44.616 INFO:tasks.workunit.client.1.smithi194.stdout:5/264: mkdir d2/dd/d5e 0 2021-11-03T16:54:44.616 INFO:tasks.workunit.client.1.smithi194.stdout:8/267: stat d8/d24/f30 0 2021-11-03T16:54:44.617 INFO:tasks.workunit.client.1.smithi194.stdout:6/268: mkdir de/d1f/d43/d55 0 2021-11-03T16:54:44.621 INFO:tasks.workunit.client.1.smithi194.stdout:8/268: readlink d8/d24/l36 0 2021-11-03T16:54:44.622 INFO:tasks.workunit.client.1.smithi194.stdout:8/269: truncate d8/f2c 1444548 0 2021-11-03T16:54:44.623 INFO:tasks.workunit.client.1.smithi194.stdout:6/269: rmdir de/d1f/d43 39 2021-11-03T16:54:44.623 INFO:tasks.workunit.client.1.smithi194.stdout:6/270: mknod de/d1f/d43/d55/c56 1 2021-11-03T16:54:44.629 INFO:tasks.workunit.client.1.smithi194.stdout:8/270: creat d8/d33/d3e/d5d/d69/f6c x:0 0 0 2021-11-03T16:54:44.629 INFO:tasks.workunit.client.1.smithi194.stdout:6/271: creat de/d21/d2d/f57 x:0 0 0 2021-11-03T16:54:44.629 INFO:tasks.workunit.client.1.smithi194.stdout:8/271: truncate d8/d33/f4f 806143 0 2021-11-03T16:54:44.631 INFO:tasks.workunit.client.1.smithi194.stdout:5/265: dwrite d2/f24 [4194304,4194304] 0 2021-11-03T16:54:44.639 INFO:tasks.workunit.client.0.smithi026.stdout:6/7: sync 2021-11-03T16:54:44.640 INFO:tasks.workunit.client.1.smithi194.stdout:8/272: dread d8/d24/f32 [0,4194304] 0 2021-11-03T16:54:44.646 INFO:tasks.workunit.client.1.smithi194.stdout:6/272: dwrite de/d21/d41/f46 [0,4194304] 0 2021-11-03T16:54:44.649 INFO:tasks.workunit.client.1.smithi194.stdout:6/273: creat de/d1f/d32/f58 x:0 0 0 2021-11-03T16:54:44.651 INFO:tasks.workunit.client.1.smithi194.stdout:6/274: symlink de/d1f/d26/d3f/l59 0 2021-11-03T16:54:44.653 INFO:tasks.workunit.client.0.smithi026.stdout:6/8: dwrite f2 [0,4194304] 0 2021-11-03T16:54:44.655 INFO:tasks.workunit.client.1.smithi194.stdout:6/275: rmdir de/d21 39 2021-11-03T16:54:44.658 INFO:tasks.workunit.client.1.smithi194.stdout:8/273: dwrite d8/ff [0,4194304] 0 2021-11-03T16:54:44.662 INFO:tasks.workunit.client.0.smithi026.stdout:6/9: link f2 f4 0 2021-11-03T16:54:44.667 INFO:tasks.workunit.client.1.smithi194.stdout:8/274: rename d8/d35/f61 to d8/d24/f6d 0 2021-11-03T16:54:44.669 INFO:tasks.workunit.client.1.smithi194.stdout:8/275: write d8/ff [1299685,62069] 0 2021-11-03T16:54:44.670 INFO:tasks.workunit.client.1.smithi194.stdout:8/276: symlink d8/d33/d51/l6e 0 2021-11-03T16:54:44.671 INFO:tasks.workunit.client.1.smithi194.stdout:8/277: read d8/d24/f32 [3516256,31421] 0 2021-11-03T16:54:44.671 INFO:tasks.workunit.client.1.smithi194.stdout:8/278: mknod d8/d35/c6f 1 2021-11-03T16:54:44.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:44 smithi026 conmon[32119]: cluster 2021-11-03T16:54:43.076296+0000 mgr.smithi026.cnrxli 2021-11-03T16:54:44.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:44 smithi026 conmon[32119]: (mgr.14162) 315 : cluster [DBG] pgmap v258: 65 pgs: 65 active+clean; 603 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 22 MiB/s rd, 45 MiB/s wr, 243 op/s 2021-11-03T16:54:44.673 INFO:tasks.workunit.client.1.smithi194.stdout:8/279: unlink d8/d24/l36 0 2021-11-03T16:54:44.678 INFO:tasks.workunit.client.1.smithi194.stdout:6/276: dwrite de/d21/d41/f4f [0,4194304] 0 2021-11-03T16:54:44.682 INFO:tasks.workunit.client.1.smithi194.stdout:6/277: rename de/d21/l29 to de/d1f/d26/l5a 0 2021-11-03T16:54:44.702 INFO:tasks.workunit.client.1.smithi194.stdout:8/280: dwrite d8/d33/d3e/d5d/f5a [0,4194304] 0 2021-11-03T16:54:44.702 INFO:tasks.workunit.client.0.smithi026.stdout:6/10: dwrite f1 [0,4194304] 0 2021-11-03T16:54:44.703 INFO:tasks.workunit.client.1.smithi194.stdout:6/278: dwrite de/d1f/d26/f3b [0,4194304] 0 2021-11-03T16:54:44.703 INFO:tasks.workunit.client.1.smithi194.stdout:6/279: read - de/d21/f37 zero size 2021-11-03T16:54:44.704 INFO:tasks.workunit.client.1.smithi194.stdout:8/281: rename d8/d24/l64 to d8/d33/d3e/l70 0 2021-11-03T16:54:44.708 INFO:tasks.workunit.client.0.smithi026.stdout:6/11: mkdir d5 0 2021-11-03T16:54:44.709 INFO:tasks.workunit.client.0.smithi026.stdout:6/12: chown f4 10107649 1 2021-11-03T16:54:44.716 INFO:tasks.workunit.client.1.smithi194.stdout:6/280: link de/d1f/d26/l5a de/d1f/d43/d55/l5b 0 2021-11-03T16:54:44.716 INFO:tasks.workunit.client.1.smithi194.stdout:6/281: write de/d21/f27 [846616,46284] 0 2021-11-03T16:54:44.716 INFO:tasks.workunit.client.1.smithi194.stdout:6/282: truncate de/d21/d41/f4c 4618469 0 2021-11-03T16:54:44.716 INFO:tasks.workunit.client.1.smithi194.stdout:6/283: fsync de/f12 0 2021-11-03T16:54:44.717 INFO:tasks.workunit.client.1.smithi194.stdout:6/284: chown de/d1f/d43/d55/l5b 29 1 2021-11-03T16:54:44.717 INFO:tasks.workunit.client.1.smithi194.stdout:6/285: write de/d1f/d26/f34 [120902,121587] 0 2021-11-03T16:54:44.717 INFO:tasks.workunit.client.1.smithi194.stdout:6/286: write de/d21/f52 [786234,63691] 0 2021-11-03T16:54:44.717 INFO:tasks.workunit.client.1.smithi194.stdout:8/282: creat d8/d33/f71 x:0 0 0 2021-11-03T16:54:44.718 INFO:tasks.workunit.client.1.smithi194.stdout:6/287: read de/f12 [1663849,83289] 0 2021-11-03T16:54:44.719 INFO:tasks.workunit.client.1.smithi194.stdout:6/288: mknod de/d21/d2d/c5c 1 2021-11-03T16:54:44.719 INFO:tasks.workunit.client.1.smithi194.stdout:6/289: chown de/d1f/d32/f58 3 1 2021-11-03T16:54:44.719 INFO:tasks.workunit.client.1.smithi194.stdout:6/290: mknod de/d21/c5d 1 2021-11-03T16:54:44.719 INFO:tasks.workunit.client.1.smithi194.stdout:6/291: chown de/d1f/d26/d3f/l59 59683 1 2021-11-03T16:54:44.721 INFO:tasks.workunit.client.1.smithi194.stdout:6/292: rename de/d1f/d26/f3b to de/d1f/d32/f5e 0 2021-11-03T16:54:44.723 INFO:tasks.workunit.client.1.smithi194.stdout:6/293: symlink de/d1f/d43/d55/l5f 0 2021-11-03T16:54:44.723 INFO:tasks.workunit.client.1.smithi194.stdout:6/294: dread - de/d21/d2d/f57 zero size 2021-11-03T16:54:44.725 INFO:tasks.workunit.client.1.smithi194.stdout:6/295: rename de/d21/d2d/f57 to de/d1f/d43/d55/f60 0 2021-11-03T16:54:44.731 INFO:tasks.workunit.client.0.smithi026.stdout:6/13: dwrite f2 [0,4194304] 0 2021-11-03T16:54:44.733 INFO:tasks.workunit.client.0.smithi026.stdout:6/14: rename f1 to d5/f6 0 2021-11-03T16:54:44.733 INFO:tasks.workunit.client.0.smithi026.stdout:6/15: write f4 [4316891,86734] 0 2021-11-03T16:54:44.734 INFO:tasks.workunit.client.1.smithi194.stdout:4/253: sync 2021-11-03T16:54:44.734 INFO:tasks.workunit.client.1.smithi194.stdout:7/226: sync 2021-11-03T16:54:44.735 INFO:tasks.workunit.client.1.smithi194.stdout:4/254: write d6/d12/d1e/f24 [4185279,65444] 0 2021-11-03T16:54:44.737 INFO:tasks.workunit.client.1.smithi194.stdout:7/227: rename d6/d24 to d6/da/d2b/d56 0 2021-11-03T16:54:44.745 INFO:tasks.workunit.client.1.smithi194.stdout:8/283: dwrite d8/f13 [0,4194304] 0 2021-11-03T16:54:44.749 INFO:tasks.workunit.client.1.smithi194.stdout:7/228: dread d6/da/d2b/f53 [0,4194304] 0 2021-11-03T16:54:44.749 INFO:tasks.workunit.client.1.smithi194.stdout:7/229: chown d6/d4c/d54 0 1 2021-11-03T16:54:44.751 INFO:tasks.workunit.client.1.smithi194.stdout:6/296: dwrite de/d21/d3e/f4e [0,4194304] 0 2021-11-03T16:54:44.751 INFO:tasks.workunit.client.1.smithi194.stdout:6/297: fsync de/d21/d41/f46 0 2021-11-03T16:54:44.752 INFO:tasks.workunit.client.1.smithi194.stdout:6/298: fdatasync f9 0 2021-11-03T16:54:44.754 INFO:tasks.workunit.client.1.smithi194.stdout:6/299: read de/d21/d41/f46 [1128,16445] 0 2021-11-03T16:54:44.754 INFO:tasks.workunit.client.1.smithi194.stdout:6/300: chown de/d1f/d26/l5a 52926907 1 2021-11-03T16:54:44.755 INFO:tasks.workunit.client.1.smithi194.stdout:4/255: dwrite d6/d8/d1a/f48 [0,4194304] 0 2021-11-03T16:54:44.755 INFO:tasks.workunit.client.1.smithi194.stdout:7/230: rmdir d6/da/d2b/d56/d55 0 2021-11-03T16:54:44.761 INFO:tasks.workunit.client.0.smithi026.stdout:6/16: dread f2 [4194304,4194304] 0 2021-11-03T16:54:44.763 INFO:tasks.workunit.client.1.smithi194.stdout:8/284: dwrite d8/fc [0,4194304] 0 2021-11-03T16:54:44.771 INFO:tasks.workunit.client.1.smithi194.stdout:6/301: dwrite de/d21/d3e/f48 [0,4194304] 0 2021-11-03T16:54:44.810 INFO:tasks.workunit.client.0.smithi026.stdout:6/17: creat d5/f7 x:0 0 0 2021-11-03T16:54:44.810 INFO:tasks.workunit.client.0.smithi026.stdout:6/18: write d5/f7 [171774,43631] 0 2021-11-03T16:54:44.812 INFO:tasks.workunit.client.0.smithi026.stdout:6/19: creat d5/f8 x:0 0 0 2021-11-03T16:54:44.813 INFO:tasks.workunit.client.0.smithi026.stdout:6/20: truncate d5/f7 275383 0 2021-11-03T16:54:44.815 INFO:tasks.workunit.client.1.smithi194.stdout:4/256: mkdir d6/d8/d4f 0 2021-11-03T16:54:44.816 INFO:tasks.workunit.client.1.smithi194.stdout:4/257: read d6/d8/d1a/d2b/f2c [196024,59142] 0 2021-11-03T16:54:44.816 INFO:tasks.workunit.client.1.smithi194.stdout:4/258: mknod d6/d8/d1a/d14/d4a/c50 1 2021-11-03T16:54:44.817 INFO:tasks.workunit.client.1.smithi194.stdout:4/259: write d6/d8/d1a/f48 [2898171,69517] 0 2021-11-03T16:54:44.822 INFO:tasks.workunit.client.1.smithi194.stdout:7/231: creat d6/f57 x:0 0 0 2021-11-03T16:54:44.823 INFO:tasks.workunit.client.1.smithi194.stdout:7/232: truncate d6/da/f27 4802635 0 2021-11-03T16:54:44.824 INFO:tasks.workunit.client.1.smithi194.stdout:7/233: write d6/f2d [492518,111155] 0 2021-11-03T16:54:44.824 INFO:tasks.workunit.client.1.smithi194.stdout:8/285: getdents d8/d33/d51 0 2021-11-03T16:54:44.828 INFO:tasks.workunit.client.1.smithi194.stdout:4/260: dread d6/d8/d1a/f48 [0,4194304] 0 2021-11-03T16:54:44.829 INFO:tasks.workunit.client.1.smithi194.stdout:6/302: mkdir de/d21/d61 0 2021-11-03T16:54:44.829 INFO:tasks.workunit.client.1.smithi194.stdout:6/303: fdatasync de/d1f/f49 0 2021-11-03T16:54:44.829 INFO:tasks.workunit.client.1.smithi194.stdout:7/234: rmdir d6/da/d2b/d56 39 2021-11-03T16:54:44.829 INFO:tasks.workunit.client.1.smithi194.stdout:7/235: chown d6/da/d2b/f4b 115071 1 2021-11-03T16:54:44.830 INFO:tasks.workunit.client.1.smithi194.stdout:7/236: dread d6/d15/f1f [0,4194304] 0 2021-11-03T16:54:44.831 INFO:tasks.workunit.client.1.smithi194.stdout:6/304: rename de/l1c to de/d21/d3e/l62 0 2021-11-03T16:54:44.836 INFO:tasks.workunit.client.1.smithi194.stdout:6/305: rmdir de/d21/d3e/d40 0 2021-11-03T16:54:44.837 INFO:tasks.workunit.client.1.smithi194.stdout:6/306: getdents de/d1f/d26/d3f 0 2021-11-03T16:54:44.838 INFO:tasks.workunit.client.1.smithi194.stdout:6/307: mknod de/d1f/d26/c63 1 2021-11-03T16:54:44.839 INFO:tasks.workunit.client.1.smithi194.stdout:6/308: rename de to de/d1f/d32/d64 22 2021-11-03T16:54:44.850 INFO:tasks.workunit.client.1.smithi194.stdout:4/261: dwrite d6/d12/f43 [0,4194304] 0 2021-11-03T16:54:44.851 INFO:tasks.workunit.client.1.smithi194.stdout:7/237: dwrite d6/f20 [0,4194304] 0 2021-11-03T16:54:44.852 INFO:tasks.workunit.client.1.smithi194.stdout:7/238: write d6/d43/f44 [1613663,72716] 0 2021-11-03T16:54:44.853 INFO:tasks.workunit.client.1.smithi194.stdout:4/262: unlink d6/d8/d1a/d14/f11 0 2021-11-03T16:54:44.855 INFO:tasks.workunit.client.1.smithi194.stdout:4/263: write d6/f15 [3001985,90213] 0 2021-11-03T16:54:44.855 INFO:tasks.workunit.client.1.smithi194.stdout:4/264: symlink d6/d8/d40/l51 0 2021-11-03T16:54:44.864 INFO:tasks.workunit.client.1.smithi194.stdout:4/265: dread d6/f30 [0,4194304] 0 2021-11-03T16:54:44.868 INFO:tasks.workunit.client.1.smithi194.stdout:8/286: dread d8/d24/f29 [0,4194304] 0 2021-11-03T16:54:44.869 INFO:tasks.workunit.client.0.smithi026.stdout:6/21: dwrite f2 [0,4194304] 0 2021-11-03T16:54:44.869 INFO:tasks.workunit.client.0.smithi026.stdout:6/22: chown d5/f6 1305965151 1 2021-11-03T16:54:44.871 INFO:tasks.workunit.client.1.smithi194.stdout:8/287: getdents d8/d24 0 2021-11-03T16:54:44.873 INFO:tasks.workunit.client.1.smithi194.stdout:8/288: unlink d8/l2b 0 2021-11-03T16:54:44.876 INFO:tasks.workunit.client.1.smithi194.stdout:8/289: write d8/d33/d3e/f40 [6549394,24332] 0 2021-11-03T16:54:44.882 INFO:tasks.workunit.client.1.smithi194.stdout:6/309: dwrite de/d21/f52 [0,4194304] 0 2021-11-03T16:54:44.884 INFO:tasks.workunit.client.1.smithi194.stdout:7/239: dwrite d6/d43/f36 [0,4194304] 0 2021-11-03T16:54:44.884 INFO:tasks.workunit.client.1.smithi194.stdout:7/240: stat d6/d15/f40 0 2021-11-03T16:54:44.884 INFO:tasks.workunit.client.1.smithi194.stdout:7/241: write d6/da/d2b/f45 [2562293,22199] 0 2021-11-03T16:54:44.885 INFO:tasks.workunit.client.0.smithi026.stdout:6/23: dread d5/f6 [0,4194304] 0 2021-11-03T16:54:44.885 INFO:tasks.workunit.client.0.smithi026.stdout:6/24: chown f2 981519 1 2021-11-03T16:54:44.891 INFO:tasks.workunit.client.1.smithi194.stdout:6/310: mkdir de/d21/d41/d65 0 2021-11-03T16:54:44.892 INFO:tasks.workunit.client.1.smithi194.stdout:6/311: chown de/d21/f27 845827 1 2021-11-03T16:54:44.893 INFO:tasks.workunit.client.0.smithi026.stdout:6/25: mkdir d5/d9 0 2021-11-03T16:54:44.893 INFO:tasks.workunit.client.1.smithi194.stdout:4/266: dwrite d6/d8/d1a/d14/f41 [0,4194304] 0 2021-11-03T16:54:44.893 INFO:tasks.workunit.client.1.smithi194.stdout:6/312: write de/d21/f2b [5050078,70679] 0 2021-11-03T16:54:44.894 INFO:tasks.workunit.client.1.smithi194.stdout:8/290: dwrite d8/d33/d3e/f60 [0,4194304] 0 2021-11-03T16:54:44.900 INFO:tasks.workunit.client.1.smithi194.stdout:4/267: link d6/d8/d1a/d14/l37 d6/d12/l52 0 2021-11-03T16:54:44.904 INFO:tasks.workunit.client.1.smithi194.stdout:4/268: dread d6/d8/d1a/d14/f3e [0,4194304] 0 2021-11-03T16:54:44.904 INFO:tasks.workunit.client.1.smithi194.stdout:6/313: mkdir de/d21/d41/d65/d66 0 2021-11-03T16:54:44.908 INFO:tasks.workunit.client.0.smithi026.stdout:6/26: dread d5/f6 [0,4194304] 0 2021-11-03T16:54:44.908 INFO:tasks.workunit.client.0.smithi026.stdout:6/27: mknod d5/d9/ca 1 2021-11-03T16:54:44.909 INFO:tasks.workunit.client.0.smithi026.stdout:6/28: read d5/f6 [3704292,105385] 0 2021-11-03T16:54:44.909 INFO:tasks.workunit.client.0.smithi026.stdout:6/29: fsync f4 0 2021-11-03T16:54:44.909 INFO:tasks.workunit.client.0.smithi026.stdout:6/30: write d5/f7 [645631,11568] 0 2021-11-03T16:54:44.912 INFO:tasks.workunit.client.1.smithi194.stdout:4/269: write f1 [1086524,114010] 0 2021-11-03T16:54:44.912 INFO:tasks.workunit.client.1.smithi194.stdout:4/270: chown d6/l29 170691 1 2021-11-03T16:54:44.913 INFO:tasks.workunit.client.1.smithi194.stdout:8/291: dwrite d8/f1e [0,4194304] 0 2021-11-03T16:54:44.914 INFO:tasks.workunit.client.0.smithi026.stdout:6/31: dread d5/f7 [0,4194304] 0 2021-11-03T16:54:44.914 INFO:tasks.workunit.client.0.smithi026.stdout:0/3: sync 2021-11-03T16:54:44.915 INFO:tasks.workunit.client.0.smithi026.stdout:0/4: readlink - no filename 2021-11-03T16:54:44.915 INFO:tasks.workunit.client.0.smithi026.stdout:0/5: mknod c1 1 2021-11-03T16:54:44.919 INFO:tasks.workunit.client.1.smithi194.stdout:6/314: rename de/d21/d41/f4f to de/f67 0 2021-11-03T16:54:44.920 INFO:tasks.workunit.client.0.smithi026.stdout:6/32: dread f4 [0,4194304] 0 2021-11-03T16:54:44.921 INFO:tasks.workunit.client.1.smithi194.stdout:4/271: symlink d6/d8/d1a/d14/l53 0 2021-11-03T16:54:44.921 INFO:tasks.workunit.client.1.smithi194.stdout:4/272: dread - d6/d8/d40/f45 zero size 2021-11-03T16:54:44.941 INFO:tasks.workunit.client.1.smithi194.stdout:6/315: dwrite de/f67 [4194304,4194304] 0 2021-11-03T16:54:44.942 INFO:tasks.workunit.client.1.smithi194.stdout:6/316: write de/d21/f44 [520041,18378] 0 2021-11-03T16:54:44.942 INFO:tasks.workunit.client.1.smithi194.stdout:6/317: mknod de/d1f/d43/d55/c68 1 2021-11-03T16:54:44.943 INFO:tasks.workunit.client.1.smithi194.stdout:6/318: fdatasync de/d21/d3e/f4e 0 2021-11-03T16:54:44.943 INFO:tasks.workunit.client.1.smithi194.stdout:4/273: dwrite d6/f17 [4194304,4194304] 0 2021-11-03T16:54:44.943 INFO:tasks.workunit.client.1.smithi194.stdout:4/274: readlink d6/d12/l28 0 2021-11-03T16:54:44.943 INFO:tasks.workunit.client.1.smithi194.stdout:6/319: write de/d21/f44 [241931,25182] 0 2021-11-03T16:54:44.944 INFO:tasks.workunit.client.1.smithi194.stdout:4/275: dread d6/d8/d1a/d14/f36 [0,4194304] 0 2021-11-03T16:54:44.953 INFO:tasks.workunit.client.1.smithi194.stdout:6/320: dwrite de/d21/f37 [0,4194304] 0 2021-11-03T16:54:44.961 INFO:tasks.workunit.client.0.smithi026.stdout:0/6: symlink l2 0 2021-11-03T16:54:44.963 INFO:tasks.workunit.client.0.smithi026.stdout:6/33: rename d5/f7 to d5/fb 0 2021-11-03T16:54:44.963 INFO:tasks.workunit.client.0.smithi026.stdout:6/34: fsync f4 0 2021-11-03T16:54:44.963 INFO:tasks.workunit.client.0.smithi026.stdout:6/35: fsync d5/f6 0 2021-11-03T16:54:44.964 INFO:tasks.workunit.client.0.smithi026.stdout:6/36: mknod d5/d9/cc 1 2021-11-03T16:54:44.964 INFO:tasks.workunit.client.1.smithi194.stdout:8/292: mkdir d8/d33/d3e/d5d/d72 0 2021-11-03T16:54:44.989 INFO:tasks.workunit.client.0.smithi026.stdout:1/89: sync 2021-11-03T16:54:44.989 INFO:tasks.workunit.client.0.smithi026.stdout:1/90: stat dc/df/f16 0 2021-11-03T16:54:44.992 INFO:tasks.workunit.client.0.smithi026.stdout:0/7: symlink l3 0 2021-11-03T16:54:44.993 INFO:tasks.workunit.client.0.smithi026.stdout:0/8: read - f0 zero size 2021-11-03T16:54:44.993 INFO:tasks.workunit.client.0.smithi026.stdout:0/9: chown f0 4 1 2021-11-03T16:54:44.993 INFO:tasks.workunit.client.0.smithi026.stdout:0/10: mknod c4 1 2021-11-03T16:54:44.993 INFO:tasks.workunit.client.0.smithi026.stdout:0/11: fsync f0 0 2021-11-03T16:54:44.993 INFO:tasks.workunit.client.0.smithi026.stdout:0/12: mknod c5 1 2021-11-03T16:54:44.994 INFO:tasks.workunit.client.0.smithi026.stdout:0/13: mknod c6 1 2021-11-03T16:54:44.994 INFO:tasks.workunit.client.0.smithi026.stdout:0/14: chown l2 0 1 2021-11-03T16:54:44.995 INFO:tasks.workunit.client.0.smithi026.stdout:0/15: rmdir - no directory 2021-11-03T16:54:44.995 INFO:tasks.workunit.client.0.smithi026.stdout:0/16: write f0 [1034996,55165] 0 2021-11-03T16:54:44.997 INFO:tasks.workunit.client.1.smithi194.stdout:4/276: creat d6/d8/f54 x:0 0 0 2021-11-03T16:54:44.997 INFO:tasks.workunit.client.1.smithi194.stdout:4/277: fdatasync d6/f1c 0 2021-11-03T16:54:44.997 INFO:tasks.workunit.client.0.smithi026.stdout:6/37: mkdir d5/dd 0 2021-11-03T16:54:44.998 INFO:tasks.workunit.client.0.smithi026.stdout:6/38: readlink - no filename 2021-11-03T16:54:44.998 INFO:tasks.workunit.client.0.smithi026.stdout:6/39: getdents d5/dd 0 2021-11-03T16:54:44.998 INFO:tasks.workunit.client.0.smithi026.stdout:6/40: dread - d5/f8 zero size 2021-11-03T16:54:44.998 INFO:tasks.workunit.client.0.smithi026.stdout:6/41: write f4 [4521112,119304] 0 2021-11-03T16:54:44.999 INFO:tasks.workunit.client.0.smithi026.stdout:1/91: creat dc/df/f23 x:0 0 0 2021-11-03T16:54:44.999 INFO:tasks.workunit.client.0.smithi026.stdout:1/92: fsync dc/df/d11/f14 0 2021-11-03T16:54:45.001 INFO:tasks.workunit.client.0.smithi026.stdout:0/17: symlink l7 0 2021-11-03T16:54:45.009 INFO:tasks.workunit.client.1.smithi194.stdout:6/321: symlink de/d21/d61/l69 0 2021-11-03T16:54:45.010 INFO:tasks.workunit.client.1.smithi194.stdout:8/293: creat d8/d33/d3e/d5d/d72/f73 x:0 0 0 2021-11-03T16:54:45.010 INFO:tasks.workunit.client.1.smithi194.stdout:8/294: fdatasync d8/f31 0 2021-11-03T16:54:45.010 INFO:tasks.workunit.client.1.smithi194.stdout:6/322: write de/f1a [215314,128048] 0 2021-11-03T16:54:45.010 INFO:tasks.workunit.client.1.smithi194.stdout:4/278: symlink d6/d8/d1a/d4b/l55 0 2021-11-03T16:54:45.011 INFO:tasks.workunit.client.1.smithi194.stdout:4/279: write d6/f15 [4180281,51061] 0 2021-11-03T16:54:45.011 INFO:tasks.workunit.client.1.smithi194.stdout:8/295: creat d8/d33/d3e/d5d/d72/f74 x:0 0 0 2021-11-03T16:54:45.012 INFO:tasks.workunit.client.1.smithi194.stdout:8/296: dread - d8/d24/f3f zero size 2021-11-03T16:54:45.014 INFO:tasks.workunit.client.1.smithi194.stdout:4/280: symlink d6/d8/d1a/d14/d4a/d4e/l56 0 2021-11-03T16:54:45.017 INFO:tasks.workunit.client.0.smithi026.stdout:6/42: truncate f2 1758626 0 2021-11-03T16:54:45.020 INFO:tasks.workunit.client.0.smithi026.stdout:1/93: dwrite dc/df/d11/f14 [4194304,4194304] 0 2021-11-03T16:54:45.020 INFO:tasks.workunit.client.0.smithi026.stdout:0/18: dread f0 [0,4194304] 0 2021-11-03T16:54:45.020 INFO:tasks.workunit.client.0.smithi026.stdout:1/94: mknod dc/df/c24 1 2021-11-03T16:54:45.021 INFO:tasks.workunit.client.0.smithi026.stdout:1/95: write dc/df/d11/f17 [925726,946] 0 2021-11-03T16:54:45.021 INFO:tasks.workunit.client.0.smithi026.stdout:0/19: write f0 [1156880,90488] 0 2021-11-03T16:54:45.021 INFO:tasks.workunit.client.0.smithi026.stdout:6/43: creat d5/d9/fe x:0 0 0 2021-11-03T16:54:45.022 INFO:tasks.workunit.client.0.smithi026.stdout:0/20: rename f0 to f8 0 2021-11-03T16:54:45.026 INFO:tasks.workunit.client.0.smithi026.stdout:6/44: link d5/fb d5/d9/ff 0 2021-11-03T16:54:45.026 INFO:tasks.workunit.client.0.smithi026.stdout:6/45: truncate d5/d9/fe 659114 0 2021-11-03T16:54:45.037 INFO:tasks.workunit.client.1.smithi194.stdout:8/297: dwrite d8/f31 [0,4194304] 0 2021-11-03T16:54:45.037 INFO:tasks.workunit.client.1.smithi194.stdout:8/298: mknod d8/d33/d3e/d5d/c75 1 2021-11-03T16:54:45.037 INFO:tasks.workunit.client.1.smithi194.stdout:6/323: dwrite de/d1f/d43/d55/f60 [0,4194304] 0 2021-11-03T16:54:45.041 INFO:tasks.workunit.client.0.smithi026.stdout:6/46: dwrite d5/d9/fe [0,4194304] 0 2021-11-03T16:54:45.041 INFO:tasks.workunit.client.0.smithi026.stdout:3/79: sync 2021-11-03T16:54:45.042 INFO:tasks.workunit.client.0.smithi026.stdout:9/68: sync 2021-11-03T16:54:45.042 INFO:tasks.workunit.client.0.smithi026.stdout:8/26: sync 2021-11-03T16:54:45.049 INFO:tasks.workunit.client.0.smithi026.stdout:1/96: dwrite f7 [0,4194304] 0 2021-11-03T16:54:45.050 INFO:tasks.workunit.client.1.smithi194.stdout:4/281: dwrite d6/d12/f23 [0,4194304] 0 2021-11-03T16:54:45.051 INFO:tasks.workunit.client.0.smithi026.stdout:1/97: write dc/df/f16 [381020,112289] 0 2021-11-03T16:54:45.051 INFO:tasks.workunit.client.0.smithi026.stdout:1/98: fsync dc/df/d11/f21 0 2021-11-03T16:54:45.052 INFO:tasks.workunit.client.0.smithi026.stdout:3/80: rename dc/f18 to dc/f20 0 2021-11-03T16:54:45.053 INFO:tasks.workunit.client.0.smithi026.stdout:8/27: mknod d2/c8 1 2021-11-03T16:54:45.054 INFO:tasks.workunit.client.0.smithi026.stdout:8/28: dread d2/f7 [0,4194304] 0 2021-11-03T16:54:45.055 INFO:tasks.workunit.client.0.smithi026.stdout:8/29: write d2/f7 [892462,29794] 0 2021-11-03T16:54:45.055 INFO:tasks.workunit.client.0.smithi026.stdout:0/21: dread f8 [0,4194304] 0 2021-11-03T16:54:45.056 INFO:tasks.workunit.client.0.smithi026.stdout:0/22: mknod c9 1 2021-11-03T16:54:45.056 INFO:tasks.workunit.client.0.smithi026.stdout:0/23: write f8 [817306,10610] 0 2021-11-03T16:54:45.057 INFO:tasks.workunit.client.1.smithi194.stdout:8/299: symlink d8/d33/d3e/l76 0 2021-11-03T16:54:45.065 INFO:tasks.workunit.client.1.smithi194.stdout:6/324: dwrite de/d1f/f49 [4194304,4194304] 0 2021-11-03T16:54:45.065 INFO:tasks.workunit.client.1.smithi194.stdout:1/130: sync 2021-11-03T16:54:45.066 INFO:tasks.workunit.client.0.smithi026.stdout:8/30: fsync d2/f7 0 2021-11-03T16:54:45.066 INFO:tasks.workunit.client.0.smithi026.stdout:8/31: fdatasync d2/f7 0 2021-11-03T16:54:45.067 INFO:tasks.workunit.client.0.smithi026.stdout:9/69: dwrite d2/da/f15 [0,4194304] 0 2021-11-03T16:54:45.067 INFO:tasks.workunit.client.0.smithi026.stdout:9/70: chown d2/f12 1996 1 2021-11-03T16:54:45.067 INFO:tasks.workunit.client.1.smithi194.stdout:4/282: unlink d6/d8/f54 0 2021-11-03T16:54:45.068 INFO:tasks.workunit.client.1.smithi194.stdout:4/283: mknod d6/d8/c57 1 2021-11-03T16:54:45.068 INFO:tasks.workunit.client.1.smithi194.stdout:4/284: mknod d6/d12/d1e/c58 1 2021-11-03T16:54:45.068 INFO:tasks.workunit.client.1.smithi194.stdout:4/285: fdatasync d6/d12/f2f 0 2021-11-03T16:54:45.069 INFO:tasks.workunit.client.0.smithi026.stdout:6/47: rmdir d5/d9 39 2021-11-03T16:54:45.072 INFO:tasks.workunit.client.0.smithi026.stdout:1/99: dread dc/df/f16 [0,4194304] 0 2021-11-03T16:54:45.072 INFO:tasks.workunit.client.0.smithi026.stdout:1/100: write dc/df/d11/f17 [1901019,39477] 0 2021-11-03T16:54:45.072 INFO:tasks.workunit.client.0.smithi026.stdout:0/24: dread f8 [0,4194304] 0 2021-11-03T16:54:45.073 INFO:tasks.workunit.client.1.smithi194.stdout:8/300: dwrite d8/d24/f3f [0,4194304] 0 2021-11-03T16:54:45.077 INFO:tasks.workunit.client.1.smithi194.stdout:6/325: creat de/d21/d51/f6a x:0 0 0 2021-11-03T16:54:45.082 INFO:tasks.workunit.client.0.smithi026.stdout:3/81: creat dc/d12/d13/f21 x:0 0 0 2021-11-03T16:54:45.082 INFO:tasks.workunit.client.0.smithi026.stdout:3/82: write dc/d12/f1a [286840,76255] 0 2021-11-03T16:54:45.084 INFO:tasks.workunit.client.1.smithi194.stdout:6/326: dread de/f12 [0,4194304] 0 2021-11-03T16:54:45.085 INFO:tasks.workunit.client.1.smithi194.stdout:4/286: truncate d6/d12/f43 3560014 0 2021-11-03T16:54:45.092 INFO:tasks.workunit.client.0.smithi026.stdout:6/48: symlink d5/dd/l10 0 2021-11-03T16:54:45.092 INFO:tasks.workunit.client.0.smithi026.stdout:6/49: dread - d5/f8 zero size 2021-11-03T16:54:45.093 INFO:tasks.workunit.client.0.smithi026.stdout:1/101: dwrite dc/df/f20 [0,4194304] 0 2021-11-03T16:54:45.093 INFO:tasks.workunit.client.1.smithi194.stdout:6/327: dread de/d21/f2b [4194304,4194304] 0 2021-11-03T16:54:45.094 INFO:tasks.workunit.client.1.smithi194.stdout:6/328: chown de/d1f/d26/d3f 6334128 1 2021-11-03T16:54:45.094 INFO:tasks.workunit.client.0.smithi026.stdout:0/25: mkdir da 0 2021-11-03T16:54:45.097 INFO:tasks.workunit.client.0.smithi026.stdout:8/32: symlink d2/l9 0 2021-11-03T16:54:45.098 INFO:tasks.workunit.client.0.smithi026.stdout:8/33: fdatasync d2/f5 0 2021-11-03T16:54:45.098 INFO:tasks.workunit.client.0.smithi026.stdout:8/34: fsync d2/f7 0 2021-11-03T16:54:45.098 INFO:tasks.workunit.client.0.smithi026.stdout:8/35: write d2/f7 [1217140,63041] 0 2021-11-03T16:54:45.099 INFO:tasks.workunit.client.0.smithi026.stdout:9/71: link d2/da/ff d2/f16 0 2021-11-03T16:54:45.099 INFO:tasks.workunit.client.0.smithi026.stdout:9/72: readlink d2/da/lb 0 2021-11-03T16:54:45.102 INFO:tasks.workunit.client.0.smithi026.stdout:1/102: dread dc/df/f20 [0,4194304] 0 2021-11-03T16:54:45.102 INFO:tasks.workunit.client.0.smithi026.stdout:1/103: mknod dc/df/c25 1 2021-11-03T16:54:45.102 INFO:tasks.workunit.client.0.smithi026.stdout:1/104: mknod dc/df/c26 1 2021-11-03T16:54:45.103 INFO:tasks.workunit.client.0.smithi026.stdout:6/50: rename f2 to d5/d9/f11 0 2021-11-03T16:54:45.107 INFO:tasks.workunit.client.0.smithi026.stdout:0/26: symlink da/lb 0 2021-11-03T16:54:45.110 INFO:tasks.workunit.client.0.smithi026.stdout:0/27: dread f8 [0,4194304] 0 2021-11-03T16:54:45.110 INFO:tasks.workunit.client.0.smithi026.stdout:0/28: chown f8 1067226668 1 2021-11-03T16:54:45.111 INFO:tasks.workunit.client.0.smithi026.stdout:9/73: unlink d2/da/l11 0 2021-11-03T16:54:45.111 INFO:tasks.workunit.client.0.smithi026.stdout:1/105: creat dc/df/d11/f27 x:0 0 0 2021-11-03T16:54:45.112 INFO:tasks.workunit.client.0.smithi026.stdout:8/36: mkdir d2/da 0 2021-11-03T16:54:45.113 INFO:tasks.workunit.client.0.smithi026.stdout:6/51: dread d5/d9/fe [0,4194304] 0 2021-11-03T16:54:45.113 INFO:tasks.workunit.client.0.smithi026.stdout:0/29: creat da/fc x:0 0 0 2021-11-03T16:54:45.114 INFO:tasks.workunit.client.1.smithi194.stdout:8/301: dwrite d8/d33/d3e/f6b [0,4194304] 0 2021-11-03T16:54:45.114 INFO:tasks.workunit.client.1.smithi194.stdout:8/302: write d8/d33/f4f [1039662,59752] 0 2021-11-03T16:54:45.115 INFO:tasks.workunit.client.0.smithi026.stdout:9/74: rmdir d2 39 2021-11-03T16:54:45.116 INFO:tasks.workunit.client.1.smithi194.stdout:1/131: dwrite d2/f1f [0,4194304] 0 2021-11-03T16:54:45.116 INFO:tasks.workunit.client.1.smithi194.stdout:1/132: getdents d2/d1e/d23 0 2021-11-03T16:54:45.117 INFO:tasks.workunit.client.0.smithi026.stdout:6/52: creat d5/f12 x:0 0 0 2021-11-03T16:54:45.117 INFO:tasks.workunit.client.0.smithi026.stdout:1/106: write dc/df/d11/f14 [5191395,92420] 0 2021-11-03T16:54:45.118 INFO:tasks.workunit.client.1.smithi194.stdout:4/287: dwrite d6/d12/f23 [0,4194304] 0 2021-11-03T16:54:45.119 INFO:tasks.workunit.client.0.smithi026.stdout:0/30: creat da/fd x:0 0 0 2021-11-03T16:54:45.119 INFO:tasks.workunit.client.0.smithi026.stdout:0/31: truncate da/fd 697998 0 2021-11-03T16:54:45.119 INFO:tasks.workunit.client.0.smithi026.stdout:3/83: dwrite dc/f1f [0,4194304] 0 2021-11-03T16:54:45.119 INFO:tasks.workunit.client.0.smithi026.stdout:3/84: fdatasync fa 0 2021-11-03T16:54:45.120 INFO:tasks.workunit.client.0.smithi026.stdout:3/85: mknod dc/d1d/d1e/c22 1 2021-11-03T16:54:45.120 INFO:tasks.workunit.client.0.smithi026.stdout:3/86: write fa [2427319,47298] 0 2021-11-03T16:54:45.121 INFO:tasks.workunit.client.0.smithi026.stdout:9/75: write d2/da/f15 [1029006,18919] 0 2021-11-03T16:54:45.123 INFO:tasks.workunit.client.0.smithi026.stdout:8/37: rename d2/f7 to d2/fb 0 2021-11-03T16:54:45.123 INFO:tasks.workunit.client.0.smithi026.stdout:8/38: read d2/fb [1226181,111760] 0 2021-11-03T16:54:45.128 INFO:tasks.workunit.client.0.smithi026.stdout:3/87: write dc/f1f [4187443,4040] 0 2021-11-03T16:54:45.129 INFO:tasks.workunit.client.1.smithi194.stdout:1/133: creat d2/d1e/d23/f29 x:0 0 0 2021-11-03T16:54:45.129 INFO:tasks.workunit.client.1.smithi194.stdout:8/303: dread d8/d24/f30 [0,4194304] 0 2021-11-03T16:54:45.129 INFO:tasks.workunit.client.1.smithi194.stdout:8/304: readlink d8/d35/d42/l5c 0 2021-11-03T16:54:45.133 INFO:tasks.workunit.client.0.smithi026.stdout:6/53: creat d5/d9/f13 x:0 0 0 2021-11-03T16:54:45.133 INFO:tasks.workunit.client.0.smithi026.stdout:6/54: mknod d5/dd/c14 1 2021-11-03T16:54:45.136 INFO:tasks.workunit.client.0.smithi026.stdout:1/107: dread dc/df/d11/f17 [0,4194304] 0 2021-11-03T16:54:45.137 INFO:tasks.workunit.client.1.smithi194.stdout:4/288: mkdir d6/d8/d1a/d4b/d59 0 2021-11-03T16:54:45.140 INFO:tasks.workunit.client.1.smithi194.stdout:6/329: dwrite de/d21/f44 [0,4194304] 0 2021-11-03T16:54:45.144 INFO:tasks.workunit.client.0.smithi026.stdout:9/76: creat d2/da/f17 x:0 0 0 2021-11-03T16:54:45.149 INFO:tasks.workunit.client.0.smithi026.stdout:6/55: rmdir d5/dd 39 2021-11-03T16:54:45.150 INFO:tasks.workunit.client.0.smithi026.stdout:6/56: mknod d5/c15 1 2021-11-03T16:54:45.150 INFO:tasks.workunit.client.0.smithi026.stdout:6/57: fsync d5/f6 0 2021-11-03T16:54:45.150 INFO:tasks.workunit.client.0.smithi026.stdout:6/58: mknod d5/dd/c16 1 2021-11-03T16:54:45.151 INFO:tasks.workunit.client.0.smithi026.stdout:1/108: rmdir dc/df 39 2021-11-03T16:54:45.154 INFO:tasks.workunit.client.1.smithi194.stdout:4/289: dread d6/d12/d1e/f26 [0,4194304] 0 2021-11-03T16:54:45.155 INFO:tasks.workunit.client.0.smithi026.stdout:6/59: unlink d5/f8 0 2021-11-03T16:54:45.155 INFO:tasks.workunit.client.0.smithi026.stdout:6/60: chown f4 2802481 1 2021-11-03T16:54:45.155 INFO:tasks.workunit.client.0.smithi026.stdout:6/61: mknod d5/dd/c17 1 2021-11-03T16:54:45.157 INFO:tasks.workunit.client.0.smithi026.stdout:0/32: dwrite f8 [0,4194304] 0 2021-11-03T16:54:45.161 INFO:tasks.workunit.client.0.smithi026.stdout:0/33: mkdir da/de 0 2021-11-03T16:54:45.162 INFO:tasks.workunit.client.0.smithi026.stdout:0/34: write da/fc [627825,85411] 0 2021-11-03T16:54:45.170 INFO:tasks.workunit.client.1.smithi194.stdout:6/330: dwrite f9 [0,4194304] 0 2021-11-03T16:54:45.171 INFO:tasks.workunit.client.1.smithi194.stdout:6/331: rmdir de/d21/d41 39 2021-11-03T16:54:45.171 INFO:tasks.workunit.client.1.smithi194.stdout:6/332: mknod de/d21/d41/d65/c6b 1 2021-11-03T16:54:45.173 INFO:tasks.workunit.client.0.smithi026.stdout:1/109: dread f7 [0,4194304] 0 2021-11-03T16:54:45.174 INFO:tasks.workunit.client.0.smithi026.stdout:8/39: dwrite d2/f5 [0,4194304] 0 2021-11-03T16:54:45.174 INFO:tasks.workunit.client.0.smithi026.stdout:8/40: stat d2/l9 0 2021-11-03T16:54:45.174 INFO:tasks.workunit.client.1.smithi194.stdout:6/333: creat de/d21/d41/d65/f6c x:0 0 0 2021-11-03T16:54:45.180 INFO:tasks.workunit.client.0.smithi026.stdout:8/41: creat d2/da/fc x:0 0 0 2021-11-03T16:54:45.181 INFO:tasks.workunit.client.1.smithi194.stdout:8/305: dwrite d8/d24/f6d [0,4194304] 0 2021-11-03T16:54:45.182 INFO:tasks.workunit.client.1.smithi194.stdout:6/334: rename de/d1f/d26/f34 to de/f6d 0 2021-11-03T16:54:45.186 INFO:tasks.workunit.client.1.smithi194.stdout:8/306: truncate d8/f10 776936 0 2021-11-03T16:54:45.186 INFO:tasks.workunit.client.1.smithi194.stdout:8/307: write d8/d35/f41 [1378941,8321] 0 2021-11-03T16:54:45.187 INFO:tasks.workunit.client.0.smithi026.stdout:6/62: dwrite f4 [0,4194304] 0 2021-11-03T16:54:45.188 INFO:tasks.workunit.client.1.smithi194.stdout:6/335: creat de/d21/d41/f6e x:0 0 0 2021-11-03T16:54:45.190 INFO:tasks.workunit.client.0.smithi026.stdout:6/63: unlink d5/f12 0 2021-11-03T16:54:45.191 INFO:tasks.workunit.client.0.smithi026.stdout:6/64: write d5/d9/ff [1019318,113002] 0 2021-11-03T16:54:45.191 INFO:tasks.workunit.client.1.smithi194.stdout:1/134: dwrite d2/fd [0,4194304] 0 2021-11-03T16:54:45.193 INFO:tasks.workunit.client.1.smithi194.stdout:6/336: rename de/d21/d3e to de/d21/d61/d6f 0 2021-11-03T16:54:45.194 INFO:tasks.workunit.client.0.smithi026.stdout:3/88: truncate dc/d12/f1a 56830 0 2021-11-03T16:54:45.196 INFO:tasks.workunit.client.1.smithi194.stdout:4/290: dwrite d6/d12/f2f [0,4194304] 0 2021-11-03T16:54:45.200 INFO:tasks.workunit.client.0.smithi026.stdout:9/77: dread d2/da/f15 [0,4194304] 0 2021-11-03T16:54:45.200 INFO:tasks.workunit.client.0.smithi026.stdout:9/78: chown d2/da/lb 784 1 2021-11-03T16:54:45.200 INFO:tasks.workunit.client.0.smithi026.stdout:0/35: dwrite da/fd [0,4194304] 0 2021-11-03T16:54:45.201 INFO:tasks.workunit.client.0.smithi026.stdout:3/89: mkdir dc/d23 0 2021-11-03T16:54:45.201 INFO:tasks.workunit.client.0.smithi026.stdout:3/90: write dc/d12/f16 [113628,92797] 0 2021-11-03T16:54:45.201 INFO:tasks.workunit.client.0.smithi026.stdout:3/91: mknod dc/d23/c24 1 2021-11-03T16:54:45.202 INFO:tasks.workunit.client.0.smithi026.stdout:1/110: dwrite f9 [0,4194304] 0 2021-11-03T16:54:45.203 INFO:tasks.workunit.client.0.smithi026.stdout:0/36: fsync da/fc 0 2021-11-03T16:54:45.212 INFO:tasks.workunit.client.0.smithi026.stdout:8/42: rmdir d2/da 39 2021-11-03T16:54:45.212 INFO:tasks.workunit.client.0.smithi026.stdout:8/43: readlink d2/l9 0 2021-11-03T16:54:45.213 INFO:tasks.workunit.client.1.smithi194.stdout:6/337: getdents de/d21/d41 0 2021-11-03T16:54:45.214 INFO:tasks.workunit.client.0.smithi026.stdout:8/44: write d2/f5 [4034389,124867] 0 2021-11-03T16:54:45.214 INFO:tasks.workunit.client.0.smithi026.stdout:6/65: rmdir d5 39 2021-11-03T16:54:45.214 INFO:tasks.workunit.client.0.smithi026.stdout:6/66: stat d5/d9/f11 0 2021-11-03T16:54:45.217 INFO:tasks.workunit.client.0.smithi026.stdout:3/92: unlink dc/d12/d13/f21 0 2021-11-03T16:54:45.218 INFO:tasks.workunit.client.0.smithi026.stdout:3/93: write f4 [1927978,72398] 0 2021-11-03T16:54:45.224 INFO:tasks.workunit.client.0.smithi026.stdout:9/79: rename d2/da to d2/d18 0 2021-11-03T16:54:45.224 INFO:tasks.workunit.client.0.smithi026.stdout:9/80: mknod d2/d18/c19 1 2021-11-03T16:54:45.225 INFO:tasks.workunit.client.0.smithi026.stdout:9/81: write d2/f12 [1109316,102004] 0 2021-11-03T16:54:45.226 INFO:tasks.workunit.client.0.smithi026.stdout:9/82: write d2/d18/f17 [4901,120139] 0 2021-11-03T16:54:45.226 INFO:tasks.workunit.client.0.smithi026.stdout:9/83: readlink d2/le 0 2021-11-03T16:54:45.228 INFO:tasks.workunit.client.1.smithi194.stdout:4/291: link d6/f1c d6/d8/d1a/f5a 0 2021-11-03T16:54:45.229 INFO:tasks.workunit.client.1.smithi194.stdout:4/292: fsync d6/f30 0 2021-11-03T16:54:45.229 INFO:tasks.workunit.client.1.smithi194.stdout:4/293: write d6/d12/d1e/f2e [257875,107947] 0 2021-11-03T16:54:45.230 INFO:tasks.workunit.client.0.smithi026.stdout:1/111: rmdir dc/df 39 2021-11-03T16:54:45.233 INFO:tasks.workunit.client.0.smithi026.stdout:0/37: symlink da/lf 0 2021-11-03T16:54:45.235 INFO:tasks.workunit.client.0.smithi026.stdout:8/45: symlink d2/da/ld 0 2021-11-03T16:54:45.235 INFO:tasks.workunit.client.0.smithi026.stdout:8/46: dread - d2/da/fc zero size 2021-11-03T16:54:45.237 INFO:tasks.workunit.client.0.smithi026.stdout:6/67: creat d5/dd/f18 x:0 0 0 2021-11-03T16:54:45.238 INFO:tasks.workunit.client.0.smithi026.stdout:6/68: write d5/d9/f11 [3044666,130675] 0 2021-11-03T16:54:45.238 INFO:tasks.workunit.client.0.smithi026.stdout:6/69: dread - d5/d9/f13 zero size 2021-11-03T16:54:45.239 INFO:tasks.workunit.client.1.smithi194.stdout:1/135: link d2/f20 d2/da/f2a 0 2021-11-03T16:54:45.240 INFO:tasks.workunit.client.0.smithi026.stdout:3/94: symlink dc/l25 0 2021-11-03T16:54:45.240 INFO:tasks.workunit.client.0.smithi026.stdout:3/95: fdatasync dc/d12/f1a 0 2021-11-03T16:54:45.241 INFO:tasks.workunit.client.0.smithi026.stdout:3/96: readlink dc/d12/l14 0 2021-11-03T16:54:45.241 INFO:tasks.workunit.client.0.smithi026.stdout:3/97: chown dc 3017172 1 2021-11-03T16:54:45.242 INFO:tasks.workunit.client.1.smithi194.stdout:4/294: dread d6/f30 [0,4194304] 0 2021-11-03T16:54:45.242 INFO:tasks.workunit.client.1.smithi194.stdout:9/322: sync 2021-11-03T16:54:45.243 INFO:tasks.workunit.client.0.smithi026.stdout:8/47: dread d2/fb [0,4194304] 0 2021-11-03T16:54:45.243 INFO:tasks.workunit.client.0.smithi026.stdout:1/112: mkdir dc/d28 0 2021-11-03T16:54:45.243 INFO:tasks.workunit.client.0.smithi026.stdout:9/84: dread d2/d18/ff [0,4194304] 0 2021-11-03T16:54:45.244 INFO:tasks.workunit.client.1.smithi194.stdout:1/136: truncate d2/f6 3483003 0 2021-11-03T16:54:45.245 INFO:tasks.workunit.client.1.smithi194.stdout:6/338: dwrite de/d21/d41/f6e [0,4194304] 0 2021-11-03T16:54:45.245 INFO:tasks.workunit.client.1.smithi194.stdout:6/339: fsync de/f16 0 2021-11-03T16:54:45.251 INFO:tasks.workunit.client.0.smithi026.stdout:0/38: mkdir da/d10 0 2021-11-03T16:54:45.251 INFO:tasks.workunit.client.0.smithi026.stdout:0/39: fsync da/fd 0 2021-11-03T16:54:45.251 INFO:tasks.workunit.client.0.smithi026.stdout:0/40: getdents da/de 0 2021-11-03T16:54:45.255 INFO:tasks.workunit.client.1.smithi194.stdout:9/323: mkdir d19/d33/d6b/d30/d53/d68/d4e/d54/d61/d70 0 2021-11-03T16:54:45.255 INFO:tasks.workunit.client.1.smithi194.stdout:9/324: read - d19/d33/d6b/f4b zero size 2021-11-03T16:54:45.258 INFO:tasks.workunit.client.0.smithi026.stdout:6/70: unlink d5/fb 0 2021-11-03T16:54:45.258 INFO:tasks.workunit.client.0.smithi026.stdout:6/71: mknod d5/dd/c19 1 2021-11-03T16:54:45.265 INFO:tasks.workunit.client.0.smithi026.stdout:3/98: creat dc/d12/d13/f26 x:0 0 0 2021-11-03T16:54:45.267 INFO:tasks.workunit.client.1.smithi194.stdout:1/137: mkdir d2/da/d2b 0 2021-11-03T16:54:45.269 INFO:tasks.workunit.client.0.smithi026.stdout:3/99: rmdir dc/d1d 39 2021-11-03T16:54:45.271 INFO:tasks.workunit.client.0.smithi026.stdout:6/72: link d5/dd/f18 d5/d9/f1a 0 2021-11-03T16:54:45.272 INFO:tasks.workunit.client.1.smithi194.stdout:6/340: mkdir de/d1f/d70 0 2021-11-03T16:54:45.273 INFO:tasks.workunit.client.0.smithi026.stdout:3/100: mkdir dc/d1d/d1e/d27 0 2021-11-03T16:54:45.273 INFO:tasks.workunit.client.0.smithi026.stdout:3/101: readlink dc/l25 0 2021-11-03T16:54:45.276 INFO:tasks.workunit.client.1.smithi194.stdout:6/341: write de/d21/d41/f6e [2429477,39237] 0 2021-11-03T16:54:45.276 INFO:tasks.workunit.client.1.smithi194.stdout:9/325: rename d19/d33/d6b/d30/f67 to d19/d33/d6b/d30/d53/d68/d4e/d54/d61/f71 0 2021-11-03T16:54:45.277 INFO:tasks.workunit.client.1.smithi194.stdout:9/326: chown d19/d38 90078 1 2021-11-03T16:54:45.277 INFO:tasks.workunit.client.1.smithi194.stdout:4/295: dwrite d6/d8/d1a/d14/f4c [0,4194304] 0 2021-11-03T16:54:45.278 INFO:tasks.workunit.client.0.smithi026.stdout:6/73: creat d5/d9/f1b x:0 0 0 2021-11-03T16:54:45.278 INFO:tasks.workunit.client.0.smithi026.stdout:6/74: fdatasync d5/d9/f13 0 2021-11-03T16:54:45.281 INFO:tasks.workunit.client.1.smithi194.stdout:1/138: creat d2/da/f2c x:0 0 0 2021-11-03T16:54:45.282 INFO:tasks.workunit.client.0.smithi026.stdout:0/41: write da/fd [2206198,35615] 0 2021-11-03T16:54:45.283 INFO:tasks.workunit.client.0.smithi026.stdout:9/85: dwrite d2/f16 [4194304,4194304] 0 2021-11-03T16:54:45.284 INFO:tasks.workunit.client.0.smithi026.stdout:9/86: fdatasync d2/f16 0 2021-11-03T16:54:45.284 INFO:tasks.workunit.client.0.smithi026.stdout:9/87: truncate d2/d18/f13 564831 0 2021-11-03T16:54:45.284 INFO:tasks.workunit.client.0.smithi026.stdout:8/48: dwrite d2/da/fc [0,4194304] 0 2021-11-03T16:54:45.286 INFO:tasks.workunit.client.0.smithi026.stdout:1/113: dwrite dc/f1e [0,4194304] 0 2021-11-03T16:54:45.286 INFO:tasks.workunit.client.0.smithi026.stdout:1/114: dread - dc/df/f23 zero size 2021-11-03T16:54:45.287 INFO:tasks.workunit.client.1.smithi194.stdout:9/327: link d19/d33/d6b/f46 d19/d33/d6b/d30/d53/d68/d52/f72 0 2021-11-03T16:54:45.287 INFO:tasks.workunit.client.1.smithi194.stdout:6/342: dread de/d21/d41/f4c [0,4194304] 0 2021-11-03T16:54:45.287 INFO:tasks.workunit.client.1.smithi194.stdout:6/343: write de/d21/d41/f4c [1701548,52859] 0 2021-11-03T16:54:45.289 INFO:tasks.workunit.client.0.smithi026.stdout:3/102: rmdir dc/d12 39 2021-11-03T16:54:45.290 INFO:tasks.workunit.client.0.smithi026.stdout:3/103: write dc/f17 [1352042,10709] 0 2021-11-03T16:54:45.299 INFO:tasks.workunit.client.0.smithi026.stdout:9/88: link d2/f12 d2/d5/f1a 0 2021-11-03T16:54:45.302 INFO:tasks.workunit.client.0.smithi026.stdout:0/42: dread da/fd [0,4194304] 0 2021-11-03T16:54:45.303 INFO:tasks.workunit.client.0.smithi026.stdout:0/43: read da/fd [3016013,83000] 0 2021-11-03T16:54:45.305 INFO:tasks.workunit.client.1.smithi194.stdout:4/296: creat d6/d8/d1a/d2b/f5b x:0 0 0 2021-11-03T16:54:45.306 INFO:tasks.workunit.client.0.smithi026.stdout:8/49: creat d2/da/fe x:0 0 0 2021-11-03T16:54:45.307 INFO:tasks.workunit.client.1.smithi194.stdout:6/344: dwrite de/d1f/d32/f5e [0,4194304] 0 2021-11-03T16:54:45.307 INFO:tasks.workunit.client.1.smithi194.stdout:6/345: readlink de/d1f/d26/l5a 0 2021-11-03T16:54:45.308 INFO:tasks.workunit.client.1.smithi194.stdout:1/139: rename d2/da/d13/l22 to d2/da/d2b/l2d 0 2021-11-03T16:54:45.312 INFO:tasks.workunit.client.1.smithi194.stdout:1/140: write d2/da/d13/f14 [371189,124673] 0 2021-11-03T16:54:45.315 INFO:tasks.workunit.client.0.smithi026.stdout:4/40: sync 2021-11-03T16:54:45.315 INFO:tasks.workunit.client.0.smithi026.stdout:5/10: sync 2021-11-03T16:54:45.315 INFO:tasks.workunit.client.0.smithi026.stdout:5/11: mknod c0 1 2021-11-03T16:54:45.316 INFO:tasks.workunit.client.1.smithi194.stdout:9/328: rmdir d19/d33/d6b/d30/d53/d68/d4e/d62 0 2021-11-03T16:54:45.316 INFO:tasks.workunit.client.1.smithi194.stdout:4/297: unlink d6/d12/d1e/f42 0 2021-11-03T16:54:45.317 INFO:tasks.workunit.client.1.smithi194.stdout:4/298: fsync d6/f35 0 2021-11-03T16:54:45.317 INFO:tasks.workunit.client.0.smithi026.stdout:4/41: write f2 [3280781,32579] 0 2021-11-03T16:54:45.318 INFO:tasks.workunit.client.1.smithi194.stdout:1/141: rmdir d2/da/d13 39 2021-11-03T16:54:45.323 INFO:tasks.workunit.client.1.smithi194.stdout:9/329: link d19/l1f d19/d50/d60/l73 0 2021-11-03T16:54:45.323 INFO:tasks.workunit.client.1.smithi194.stdout:9/330: fsync d19/d33/d6b/d30/d53/d68/f42 0 2021-11-03T16:54:45.323 INFO:tasks.workunit.client.1.smithi194.stdout:9/331: chown d19/d38/f3c 2018988684 1 2021-11-03T16:54:45.324 INFO:tasks.workunit.client.1.smithi194.stdout:9/332: mknod d19/d33/d6b/c74 1 2021-11-03T16:54:45.324 INFO:tasks.workunit.client.1.smithi194.stdout:9/333: fdatasync d19/d33/d6b/d30/d53/d68/f42 0 2021-11-03T16:54:45.324 INFO:tasks.workunit.client.1.smithi194.stdout:1/142: write d2/f20 [3288452,126703] 0 2021-11-03T16:54:45.325 INFO:tasks.workunit.client.1.smithi194.stdout:4/299: truncate d6/f30 3480743 0 2021-11-03T16:54:45.328 INFO:tasks.workunit.client.1.smithi194.stdout:9/334: rename d19/d50/f5a to d19/d33/d6b/d30/d53/d68/d4e/d54/d5d/f75 0 2021-11-03T16:54:45.328 INFO:tasks.workunit.client.1.smithi194.stdout:9/335: chown d19/d33/d6b/d30/d53/d68/d4e/d5f 12141032 1 2021-11-03T16:54:45.328 INFO:tasks.workunit.client.1.smithi194.stdout:9/336: mknod d19/d33/c76 1 2021-11-03T16:54:45.329 INFO:tasks.workunit.client.0.smithi026.stdout:0/44: dwrite da/fd [0,4194304] 0 2021-11-03T16:54:45.330 INFO:tasks.workunit.client.1.smithi194.stdout:1/143: fdatasync d2/f1c 0 2021-11-03T16:54:45.334 INFO:tasks.workunit.client.1.smithi194.stdout:1/144: mkdir d2/da/d2e 0 2021-11-03T16:54:45.335 INFO:tasks.workunit.client.1.smithi194.stdout:6/346: dwrite de/f24 [4194304,4194304] 0 2021-11-03T16:54:45.337 INFO:tasks.workunit.client.0.smithi026.stdout:0/45: dread da/fc [0,4194304] 0 2021-11-03T16:54:45.337 INFO:tasks.workunit.client.0.smithi026.stdout:0/46: chown l7 35928894 1 2021-11-03T16:54:45.343 INFO:tasks.workunit.client.1.smithi194.stdout:9/337: dwrite f3 [0,4194304] 0 2021-11-03T16:54:45.347 INFO:tasks.workunit.client.1.smithi194.stdout:6/347: link de/d21/l45 de/d1f/d26/l71 0 2021-11-03T16:54:45.356 INFO:tasks.workunit.client.1.smithi194.stdout:6/348: dread de/f17 [0,4194304] 0 2021-11-03T16:54:45.359 INFO:tasks.workunit.client.1.smithi194.stdout:9/338: rename f17 to d19/d33/d6b/d30/d53/d68/d52/f77 0 2021-11-03T16:54:45.361 INFO:tasks.workunit.client.1.smithi194.stdout:1/145: dwrite d2/f15 [0,4194304] 0 2021-11-03T16:54:45.362 INFO:tasks.workunit.client.1.smithi194.stdout:1/146: write d2/f1c [80768,48375] 0 2021-11-03T16:54:45.362 INFO:tasks.workunit.client.0.smithi026.stdout:1/115: mkdir dc/d28/d29 0 2021-11-03T16:54:45.367 INFO:tasks.workunit.client.0.smithi026.stdout:6/75: symlink d5/d9/l1c 0 2021-11-03T16:54:45.369 INFO:tasks.workunit.client.1.smithi194.stdout:6/349: dread de/d21/f52 [0,4194304] 0 2021-11-03T16:54:45.369 INFO:tasks.workunit.client.1.smithi194.stdout:6/350: fsync de/f16 0 2021-11-03T16:54:45.372 INFO:tasks.workunit.client.0.smithi026.stdout:3/104: rename dc/d12/f16 to dc/d23/f28 0 2021-11-03T16:54:45.373 INFO:tasks.workunit.client.1.smithi194.stdout:9/339: dread d19/d33/d6b/f51 [0,4194304] 0 2021-11-03T16:54:45.381 INFO:tasks.workunit.client.0.smithi026.stdout:9/89: creat d2/f1b x:0 0 0 2021-11-03T16:54:45.382 INFO:tasks.workunit.client.1.smithi194.stdout:1/147: chown d2/f18 475058 1 2021-11-03T16:54:45.382 INFO:tasks.workunit.client.1.smithi194.stdout:6/351: getdents de/d1f/d43/d55 0 2021-11-03T16:54:45.384 INFO:tasks.workunit.client.0.smithi026.stdout:5/12: creat f1 x:0 0 0 2021-11-03T16:54:45.385 INFO:tasks.workunit.client.1.smithi194.stdout:9/340: creat d19/f78 x:0 0 0 2021-11-03T16:54:45.386 INFO:tasks.workunit.client.1.smithi194.stdout:9/341: fdatasync d19/d33/d6b/f59 0 2021-11-03T16:54:45.387 INFO:tasks.workunit.client.0.smithi026.stdout:4/42: rename f2 to f11 0 2021-11-03T16:54:45.388 INFO:tasks.workunit.client.1.smithi194.stdout:1/148: mkdir d2/da/d2e/d2f 0 2021-11-03T16:54:45.390 INFO:tasks.workunit.client.0.smithi026.stdout:0/47: symlink da/de/l11 0 2021-11-03T16:54:45.391 INFO:tasks.workunit.client.1.smithi194.stdout:0/122: sync 2021-11-03T16:54:45.391 INFO:tasks.workunit.client.0.smithi026.stdout:6/76: fdatasync d5/d9/fe 0 2021-11-03T16:54:45.391 INFO:tasks.workunit.client.0.smithi026.stdout:6/77: fsync d5/f6 0 2021-11-03T16:54:45.392 INFO:tasks.workunit.client.0.smithi026.stdout:3/105: creat dc/d1d/f29 x:0 0 0 2021-11-03T16:54:45.393 INFO:tasks.workunit.client.0.smithi026.stdout:3/106: mknod dc/d12/c2a 1 2021-11-03T16:54:45.394 INFO:tasks.workunit.client.0.smithi026.stdout:9/90: mkdir d2/d5/d1c 0 2021-11-03T16:54:45.394 INFO:tasks.workunit.client.0.smithi026.stdout:0/48: read da/fd [693849,515] 0 2021-11-03T16:54:45.397 INFO:tasks.workunit.client.1.smithi194.stdout:0/123: creat d5/d9/d22/f28 x:0 0 0 2021-11-03T16:54:45.397 INFO:tasks.workunit.client.1.smithi194.stdout:0/124: mknod d5/d13/d21/c29 1 2021-11-03T16:54:45.398 INFO:tasks.workunit.client.0.smithi026.stdout:8/50: truncate d2/da/fc 139768 0 2021-11-03T16:54:45.400 INFO:tasks.workunit.client.0.smithi026.stdout:0/49: dread da/fc [0,4194304] 0 2021-11-03T16:54:45.400 INFO:tasks.workunit.client.0.smithi026.stdout:0/50: stat l2 0 2021-11-03T16:54:45.400 INFO:tasks.workunit.client.0.smithi026.stdout:3/107: read dc/f1f [2916871,90676] 0 2021-11-03T16:54:45.404 INFO:tasks.workunit.client.1.smithi194.stdout:0/125: unlink d5/d9/d22/f27 0 2021-11-03T16:54:45.406 INFO:tasks.workunit.client.0.smithi026.stdout:5/13: creat f2 x:0 0 0 2021-11-03T16:54:45.408 INFO:tasks.workunit.client.0.smithi026.stdout:4/43: link fd f12 0 2021-11-03T16:54:45.410 INFO:tasks.workunit.client.1.smithi194.stdout:0/126: rename d5/d13/f26 to d5/d13/f2a 0 2021-11-03T16:54:45.410 INFO:tasks.workunit.client.1.smithi194.stdout:0/127: read - d5/f24 zero size 2021-11-03T16:54:45.411 INFO:tasks.workunit.client.1.smithi194.stdout:0/128: truncate d5/d9/d22/f28 130575 0 2021-11-03T16:54:45.411 INFO:tasks.workunit.client.1.smithi194.stdout:9/342: dwrite d19/d38/f5c [0,4194304] 0 2021-11-03T16:54:45.412 INFO:tasks.workunit.client.1.smithi194.stdout:9/343: rename d19 to d19/d33/d6b/d30/d53/d68/d4e/d54/d61/d70/d79 22 2021-11-03T16:54:45.413 INFO:tasks.workunit.client.0.smithi026.stdout:6/78: rename f4 to d5/f1d 0 2021-11-03T16:54:45.419 INFO:tasks.workunit.client.0.smithi026.stdout:0/51: truncate f8 3055882 0 2021-11-03T16:54:45.421 INFO:tasks.workunit.client.0.smithi026.stdout:3/108: getdents dc/d12 0 2021-11-03T16:54:45.421 INFO:tasks.workunit.client.0.smithi026.stdout:3/109: rename dc/d12 to dc/d12/d13/d2b 22 2021-11-03T16:54:45.422 INFO:tasks.workunit.client.0.smithi026.stdout:3/110: write dc/f17 [3589848,12336] 0 2021-11-03T16:54:45.424 INFO:tasks.workunit.client.1.smithi194.stdout:6/352: dwrite de/f24 [0,4194304] 0 2021-11-03T16:54:45.424 INFO:tasks.workunit.client.1.smithi194.stdout:1/149: dwrite d2/f20 [4194304,4194304] 0 2021-11-03T16:54:45.424 INFO:tasks.workunit.client.1.smithi194.stdout:1/150: mknod d2/d1e/c30 1 2021-11-03T16:54:45.424 INFO:tasks.workunit.client.1.smithi194.stdout:1/151: fdatasync d2/da/f2a 0 2021-11-03T16:54:45.425 INFO:tasks.workunit.client.1.smithi194.stdout:9/344: rename d19/l1f to d19/d50/d60/l7a 0 2021-11-03T16:54:45.425 INFO:tasks.workunit.client.1.smithi194.stdout:9/345: chown d19/l26 12293008 1 2021-11-03T16:54:45.425 INFO:tasks.workunit.client.0.smithi026.stdout:5/14: mkdir d3 0 2021-11-03T16:54:45.426 INFO:tasks.workunit.client.0.smithi026.stdout:9/91: dwrite d2/d18/f13 [0,4194304] 0 2021-11-03T16:54:45.426 INFO:tasks.workunit.client.0.smithi026.stdout:9/92: fdatasync d2/d18/f13 0 2021-11-03T16:54:45.427 INFO:tasks.workunit.client.0.smithi026.stdout:9/93: getdents d2/d5/d1c 0 2021-11-03T16:54:45.427 INFO:tasks.workunit.client.0.smithi026.stdout:9/94: stat d2 0 2021-11-03T16:54:45.428 INFO:tasks.workunit.client.1.smithi194.stdout:9/346: write f5 [3604811,69740] 0 2021-11-03T16:54:45.428 INFO:tasks.workunit.client.0.smithi026.stdout:0/52: creat da/de/f12 x:0 0 0 2021-11-03T16:54:45.428 INFO:tasks.workunit.client.0.smithi026.stdout:8/51: dread d2/da/fc [0,4194304] 0 2021-11-03T16:54:45.429 INFO:tasks.workunit.client.1.smithi194.stdout:6/353: symlink de/d1f/d26/l72 0 2021-11-03T16:54:45.432 INFO:tasks.workunit.client.0.smithi026.stdout:3/111: symlink dc/d1d/l2c 0 2021-11-03T16:54:45.435 INFO:tasks.workunit.client.1.smithi194.stdout:1/152: dread d2/f27 [0,4194304] 0 2021-11-03T16:54:45.435 INFO:tasks.workunit.client.0.smithi026.stdout:4/44: dwrite f7 [0,4194304] 0 2021-11-03T16:54:45.435 INFO:tasks.workunit.client.0.smithi026.stdout:4/45: stat f11 0 2021-11-03T16:54:45.436 INFO:tasks.workunit.client.1.smithi194.stdout:9/347: mkdir d19/d33/d7b 0 2021-11-03T16:54:45.437 INFO:tasks.workunit.client.1.smithi194.stdout:9/348: read d19/d33/d6b/d30/d53/d68/d4e/f65 [1387,60656] 0 2021-11-03T16:54:45.446 INFO:tasks.workunit.client.1.smithi194.stdout:6/354: symlink de/d1f/d43/l73 0 2021-11-03T16:54:45.447 INFO:tasks.workunit.client.1.smithi194.stdout:6/355: chown de/d1f/d32/f58 16726857 1 2021-11-03T16:54:45.447 INFO:tasks.workunit.client.0.smithi026.stdout:5/15: dwrite f2 [0,4194304] 0 2021-11-03T16:54:45.448 INFO:tasks.workunit.client.0.smithi026.stdout:5/16: fdatasync f2 0 2021-11-03T16:54:45.448 INFO:tasks.workunit.client.0.smithi026.stdout:5/17: mknod d3/c4 1 2021-11-03T16:54:45.448 INFO:tasks.workunit.client.0.smithi026.stdout:5/18: dread - f1 zero size 2021-11-03T16:54:45.449 INFO:tasks.workunit.client.0.smithi026.stdout:9/95: symlink d2/d18/l1d 0 2021-11-03T16:54:45.450 INFO:tasks.workunit.client.1.smithi194.stdout:1/153: truncate d2/f10 1026761 0 2021-11-03T16:54:45.451 INFO:tasks.workunit.client.1.smithi194.stdout:1/154: truncate d2/fd 4609695 0 2021-11-03T16:54:45.453 INFO:tasks.workunit.client.0.smithi026.stdout:5/19: read f2 [1249409,122996] 0 2021-11-03T16:54:45.454 INFO:tasks.workunit.client.0.smithi026.stdout:5/20: stat f1 0 2021-11-03T16:54:45.457 INFO:tasks.workunit.client.0.smithi026.stdout:0/53: rmdir da 39 2021-11-03T16:54:45.460 INFO:tasks.workunit.client.0.smithi026.stdout:3/112: rename dc/lf to dc/d1d/d1e/l2d 0 2021-11-03T16:54:45.463 INFO:tasks.workunit.client.1.smithi194.stdout:9/349: dwrite d19/d33/d6b/d30/f45 [0,4194304] 0 2021-11-03T16:54:45.465 INFO:tasks.workunit.client.1.smithi194.stdout:6/356: mkdir de/d1f/d43/d55/d74 0 2021-11-03T16:54:45.465 INFO:tasks.workunit.client.1.smithi194.stdout:6/357: fsync de/d21/d51/f6a 0 2021-11-03T16:54:45.467 INFO:tasks.workunit.client.1.smithi194.stdout:1/155: truncate d2/f27 3958299 0 2021-11-03T16:54:45.469 INFO:tasks.workunit.client.0.smithi026.stdout:0/54: creat da/de/f13 x:0 0 0 2021-11-03T16:54:45.472 INFO:tasks.workunit.client.0.smithi026.stdout:8/52: rename d2/fb to d2/ff 0 2021-11-03T16:54:45.473 INFO:tasks.workunit.client.0.smithi026.stdout:8/53: dread - d2/da/fe zero size 2021-11-03T16:54:45.473 INFO:tasks.workunit.client.1.smithi194.stdout:9/350: truncate d19/d33/d6b/f3a 3137788 0 2021-11-03T16:54:45.474 INFO:tasks.workunit.client.1.smithi194.stdout:6/358: creat de/d1f/d32/f75 x:0 0 0 2021-11-03T16:54:45.477 INFO:tasks.workunit.client.1.smithi194.stdout:1/156: rename d2/d1e/f25 to d2/da/d2e/f31 0 2021-11-03T16:54:45.477 INFO:tasks.workunit.client.1.smithi194.stdout:1/157: write d2/f18 [12256,101920] 0 2021-11-03T16:54:45.477 INFO:tasks.workunit.client.1.smithi194.stdout:1/158: chown d2/f1f 5 1 2021-11-03T16:54:45.478 INFO:tasks.workunit.client.1.smithi194.stdout:6/359: symlink de/d21/d41/l76 0 2021-11-03T16:54:45.478 INFO:tasks.workunit.client.1.smithi194.stdout:6/360: read - de/d21/d41/d65/f6c zero size 2021-11-03T16:54:45.479 INFO:tasks.workunit.client.1.smithi194.stdout:1/159: creat d2/d1e/f32 x:0 0 0 2021-11-03T16:54:45.480 INFO:tasks.workunit.client.1.smithi194.stdout:6/361: link de/d21/d41/f6e de/d1f/d32/f77 0 2021-11-03T16:54:45.481 INFO:tasks.workunit.client.1.smithi194.stdout:6/362: readlink de/d1f/d26/l5a 0 2021-11-03T16:54:45.481 INFO:tasks.workunit.client.1.smithi194.stdout:6/363: readlink de/d21/d61/l69 0 2021-11-03T16:54:45.482 INFO:tasks.workunit.client.0.smithi026.stdout:9/96: dwrite d2/d18/ff [0,4194304] 0 2021-11-03T16:54:45.483 INFO:tasks.workunit.client.0.smithi026.stdout:3/113: dwrite dc/d12/d13/f26 [0,4194304] 0 2021-11-03T16:54:45.484 INFO:tasks.workunit.client.0.smithi026.stdout:3/114: mknod dc/d1d/c2e 1 2021-11-03T16:54:45.484 INFO:tasks.workunit.client.0.smithi026.stdout:9/97: creat d2/d5/f1e x:0 0 0 2021-11-03T16:54:45.485 INFO:tasks.workunit.client.1.smithi194.stdout:6/364: symlink de/d1f/d26/d3f/l78 0 2021-11-03T16:54:45.485 INFO:tasks.workunit.client.1.smithi194.stdout:6/365: mknod de/d21/d41/c79 1 2021-11-03T16:54:45.486 INFO:tasks.workunit.client.1.smithi194.stdout:9/351: dread d19/d33/d6b/f4c [0,4194304] 0 2021-11-03T16:54:45.486 INFO:tasks.workunit.client.1.smithi194.stdout:9/352: dread - d19/d33/d6b/d30/f47 zero size 2021-11-03T16:54:45.486 INFO:tasks.workunit.client.1.smithi194.stdout:9/353: write d19/d33/d6b/f29 [5384442,47155] 0 2021-11-03T16:54:45.487 INFO:tasks.workunit.client.1.smithi194.stdout:9/354: creat d19/d33/d6b/d30/d53/d68/d4e/d54/d61/f7c x:0 0 0 2021-11-03T16:54:45.488 INFO:tasks.workunit.client.0.smithi026.stdout:3/115: rmdir dc/d1d/d1e 39 2021-11-03T16:54:45.490 INFO:tasks.workunit.client.1.smithi194.stdout:9/355: truncate d19/d33/d6b/f3a 3653066 0 2021-11-03T16:54:45.496 INFO:tasks.workunit.client.1.smithi194.stdout:9/356: unlink d19/f1a 0 2021-11-03T16:54:45.505 INFO:tasks.workunit.client.0.smithi026.stdout:3/116: dwrite dc/d1d/f29 [0,4194304] 0 2021-11-03T16:54:45.533 INFO:tasks.workunit.client.0.smithi026.stdout:4/46: dwrite fd [4194304,4194304] 0 2021-11-03T16:54:45.533 INFO:tasks.workunit.client.0.smithi026.stdout:3/117: dread dc/d12/d13/f1b [0,4194304] 0 2021-11-03T16:54:45.535 INFO:tasks.workunit.client.0.smithi026.stdout:5/21: dwrite f1 [0,4194304] 0 2021-11-03T16:54:45.535 INFO:tasks.workunit.client.0.smithi026.stdout:5/22: chown f1 1651 1 2021-11-03T16:54:45.535 INFO:tasks.workunit.client.1.smithi194.stdout:6/366: dwrite f9 [0,4194304] 0 2021-11-03T16:54:45.539 INFO:tasks.workunit.client.0.smithi026.stdout:4/47: creat f13 x:0 0 0 2021-11-03T16:54:45.539 INFO:tasks.workunit.client.0.smithi026.stdout:4/48: write fc [114350,118755] 0 2021-11-03T16:54:45.541 INFO:tasks.workunit.client.0.smithi026.stdout:0/55: dread f8 [0,4194304] 0 2021-11-03T16:54:45.542 INFO:tasks.workunit.client.0.smithi026.stdout:0/56: fsync da/fc 0 2021-11-03T16:54:45.546 INFO:tasks.workunit.client.0.smithi026.stdout:8/54: rmdir d2 39 2021-11-03T16:54:45.550 INFO:tasks.workunit.client.0.smithi026.stdout:3/118: dread dc/f1f [0,4194304] 0 2021-11-03T16:54:45.555 INFO:tasks.workunit.client.0.smithi026.stdout:5/23: rename f1 to d3/f5 0 2021-11-03T16:54:45.561 INFO:tasks.workunit.client.0.smithi026.stdout:4/49: unlink f13 0 2021-11-03T16:54:45.564 INFO:tasks.workunit.client.1.smithi194.stdout:6/367: dwrite de/d21/f44 [0,4194304] 0 2021-11-03T16:54:45.565 INFO:tasks.workunit.client.0.smithi026.stdout:9/98: rename d2/d5 to d2/d1f 0 2021-11-03T16:54:45.565 INFO:tasks.workunit.client.0.smithi026.stdout:9/99: truncate d2/d1f/f1e 343351 0 2021-11-03T16:54:45.566 INFO:tasks.workunit.client.0.smithi026.stdout:4/50: write f4 [218772,87161] 0 2021-11-03T16:54:45.567 INFO:tasks.workunit.client.1.smithi194.stdout:1/160: dwrite d2/f27 [0,4194304] 0 2021-11-03T16:54:45.568 INFO:tasks.workunit.client.0.smithi026.stdout:3/119: dwrite f4 [0,4194304] 0 2021-11-03T16:54:45.569 INFO:tasks.workunit.client.0.smithi026.stdout:3/120: read dc/d23/f28 [56575,118046] 0 2021-11-03T16:54:45.569 INFO:tasks.workunit.client.0.smithi026.stdout:3/121: truncate dc/d12/d13/f1b 5024254 0 2021-11-03T16:54:45.569 INFO:tasks.workunit.client.0.smithi026.stdout:8/55: creat d2/da/f10 x:0 0 0 2021-11-03T16:54:45.574 INFO:tasks.workunit.client.1.smithi194.stdout:6/368: getdents de/d1f 0 2021-11-03T16:54:45.579 INFO:tasks.workunit.client.0.smithi026.stdout:5/24: rename f2 to d3/f6 0 2021-11-03T16:54:45.584 INFO:tasks.workunit.client.0.smithi026.stdout:9/100: mknod d2/c20 1 2021-11-03T16:54:45.586 INFO:tasks.workunit.client.1.smithi194.stdout:1/161: rmdir d2/da/d13 39 2021-11-03T16:54:45.591 INFO:tasks.workunit.client.1.smithi194.stdout:6/369: mkdir de/d21/d61/d7a 0 2021-11-03T16:54:45.594 INFO:tasks.workunit.client.0.smithi026.stdout:4/51: creat f14 x:0 0 0 2021-11-03T16:54:45.595 INFO:tasks.workunit.client.0.smithi026.stdout:3/122: link dc/f17 dc/d1d/d1e/f2f 0 2021-11-03T16:54:45.599 INFO:tasks.workunit.client.0.smithi026.stdout:8/56: rename d2/f5 to d2/da/f11 0 2021-11-03T16:54:45.601 INFO:tasks.workunit.client.0.smithi026.stdout:5/25: creat d3/f7 x:0 0 0 2021-11-03T16:54:45.602 INFO:tasks.workunit.client.0.smithi026.stdout:5/26: readlink - no filename 2021-11-03T16:54:45.607 INFO:tasks.workunit.client.0.smithi026.stdout:9/101: getdents d2/d18 0 2021-11-03T16:54:45.609 INFO:tasks.workunit.client.0.smithi026.stdout:3/123: mkdir dc/d12/d30 0 2021-11-03T16:54:45.611 INFO:tasks.workunit.client.0.smithi026.stdout:5/27: mkdir d3/d8 0 2021-11-03T16:54:45.612 INFO:tasks.workunit.client.0.smithi026.stdout:3/124: unlink dc/d12/f1a 0 2021-11-03T16:54:45.614 INFO:tasks.workunit.client.0.smithi026.stdout:5/28: rmdir d3/d8 0 2021-11-03T16:54:45.615 INFO:tasks.workunit.client.1.smithi194.stdout:6/370: dwrite de/f17 [4194304,4194304] 0 2021-11-03T16:54:45.617 INFO:tasks.workunit.client.0.smithi026.stdout:3/125: unlink fa 0 2021-11-03T16:54:45.618 INFO:tasks.workunit.client.0.smithi026.stdout:5/29: unlink d3/f5 0 2021-11-03T16:54:45.618 INFO:tasks.workunit.client.0.smithi026.stdout:5/30: readlink - no filename 2021-11-03T16:54:45.620 INFO:tasks.workunit.client.1.smithi194.stdout:6/371: creat de/d21/d2d/f7b x:0 0 0 2021-11-03T16:54:45.621 INFO:tasks.workunit.client.0.smithi026.stdout:5/31: creat d3/f9 x:0 0 0 2021-11-03T16:54:45.621 INFO:tasks.workunit.client.0.smithi026.stdout:5/32: chown d3/f9 0 1 2021-11-03T16:54:45.622 INFO:tasks.workunit.client.0.smithi026.stdout:5/33: write d3/f7 [313359,66637] 0 2021-11-03T16:54:45.631 INFO:tasks.workunit.client.0.smithi026.stdout:9/102: dread d2/d18/f17 [0,4194304] 0 2021-11-03T16:54:45.632 INFO:tasks.workunit.client.0.smithi026.stdout:9/103: write d2/d1f/f1e [1100983,93781] 0 2021-11-03T16:54:45.632 INFO:tasks.workunit.client.0.smithi026.stdout:9/104: chown d2/d18/lb 2886212 1 2021-11-03T16:54:45.633 INFO:tasks.workunit.client.1.smithi194.stdout:1/162: dwrite d2/f15 [0,4194304] 0 2021-11-03T16:54:45.634 INFO:tasks.workunit.client.1.smithi194.stdout:1/163: dread - d2/da/d13/f17 zero size 2021-11-03T16:54:45.635 INFO:tasks.workunit.client.1.smithi194.stdout:1/164: creat d2/d1e/f33 x:0 0 0 2021-11-03T16:54:45.635 INFO:tasks.workunit.client.1.smithi194.stdout:1/165: read d2/f1c [34933,10103] 0 2021-11-03T16:54:45.636 INFO:tasks.workunit.client.0.smithi026.stdout:3/126: dread dc/d1d/f29 [0,4194304] 0 2021-11-03T16:54:45.636 INFO:tasks.workunit.client.0.smithi026.stdout:3/127: truncate dc/d1d/f29 4439798 0 2021-11-03T16:54:45.637 INFO:tasks.workunit.client.0.smithi026.stdout:3/128: mkdir dc/d1d/d1e/d27/d31 0 2021-11-03T16:54:45.638 INFO:tasks.workunit.client.0.smithi026.stdout:3/129: getdents dc 0 2021-11-03T16:54:45.640 INFO:tasks.workunit.client.0.smithi026.stdout:4/52: dwrite f10 [0,4194304] 0 2021-11-03T16:54:45.641 INFO:tasks.workunit.client.1.smithi194.stdout:1/166: write d2/f1f [1075019,16452] 0 2021-11-03T16:54:45.643 INFO:tasks.workunit.client.0.smithi026.stdout:8/57: dwrite d2/da/fc [0,4194304] 0 2021-11-03T16:54:45.644 INFO:tasks.workunit.client.0.smithi026.stdout:5/34: dwrite d3/f9 [0,4194304] 0 2021-11-03T16:54:45.646 INFO:tasks.workunit.client.1.smithi194.stdout:1/167: unlink d2/da/ff 0 2021-11-03T16:54:45.646 INFO:tasks.workunit.client.1.smithi194.stdout:1/168: fsync d2/f20 0 2021-11-03T16:54:45.646 INFO:tasks.workunit.client.1.smithi194.stdout:1/169: chown d2/da/d13 14 1 2021-11-03T16:54:45.648 INFO:tasks.workunit.client.0.smithi026.stdout:3/130: dread dc/d12/d13/f26 [0,4194304] 0 2021-11-03T16:54:45.649 INFO:tasks.workunit.client.0.smithi026.stdout:5/35: write d3/f7 [39302,333] 0 2021-11-03T16:54:45.650 INFO:tasks.workunit.client.0.smithi026.stdout:4/53: symlink l15 0 2021-11-03T16:54:45.657 INFO:tasks.workunit.client.0.smithi026.stdout:9/105: dwrite d2/f1b [0,4194304] 0 2021-11-03T16:54:45.658 INFO:tasks.workunit.client.0.smithi026.stdout:4/54: dread f4 [0,4194304] 0 2021-11-03T16:54:45.658 INFO:tasks.workunit.client.0.smithi026.stdout:4/55: mknod c16 1 2021-11-03T16:54:45.661 INFO:tasks.workunit.client.1.smithi194.stdout:1/170: symlink d2/da/d2e/d2f/l34 0 2021-11-03T16:54:45.661 INFO:tasks.workunit.client.1.smithi194.stdout:1/171: dread - d2/da/f2c zero size 2021-11-03T16:54:45.662 INFO:tasks.workunit.client.1.smithi194.stdout:1/172: stat d2/f10 0 2021-11-03T16:54:45.663 INFO:tasks.workunit.client.1.smithi194.stdout:1/173: write d2/da/d13/f14 [3107741,16580] 0 2021-11-03T16:54:45.663 INFO:tasks.workunit.client.1.smithi194.stdout:1/174: fdatasync d2/f1c 0 2021-11-03T16:54:45.663 INFO:tasks.workunit.client.1.smithi194.stdout:1/175: write d2/da/d2e/f31 [166319,57420] 0 2021-11-03T16:54:45.664 INFO:tasks.workunit.client.1.smithi194.stdout:1/176: fsync d2/da/d13/f17 0 2021-11-03T16:54:45.664 INFO:tasks.workunit.client.1.smithi194.stdout:1/177: readlink d2/da/d2e/d2f/l34 0 2021-11-03T16:54:45.664 INFO:tasks.workunit.client.1.smithi194.stdout:1/178: chown d2/d1e/f33 790 1 2021-11-03T16:54:45.665 INFO:tasks.workunit.client.0.smithi026.stdout:3/131: rmdir dc/d1d/d1e/d27/d31 0 2021-11-03T16:54:45.669 INFO:tasks.workunit.client.0.smithi026.stdout:8/58: dwrite d2/da/f10 [0,4194304] 0 2021-11-03T16:54:45.669 INFO:tasks.workunit.client.0.smithi026.stdout:8/59: dread - d2/da/fe zero size 2021-11-03T16:54:45.670 INFO:tasks.workunit.client.0.smithi026.stdout:8/60: write d2/da/fe [514740,8472] 0 2021-11-03T16:54:45.670 INFO:tasks.workunit.client.0.smithi026.stdout:5/36: dread d3/f9 [0,4194304] 0 2021-11-03T16:54:45.672 INFO:tasks.workunit.client.0.smithi026.stdout:4/56: getdents . 0 2021-11-03T16:54:45.675 INFO:tasks.workunit.client.0.smithi026.stdout:3/132: creat dc/d1d/d1e/d27/f32 x:0 0 0 2021-11-03T16:54:45.677 INFO:tasks.workunit.client.0.smithi026.stdout:9/106: dread d2/d1f/f1a [0,4194304] 0 2021-11-03T16:54:45.683 INFO:tasks.workunit.client.0.smithi026.stdout:4/57: creat f17 x:0 0 0 2021-11-03T16:54:45.683 INFO:tasks.workunit.client.0.smithi026.stdout:4/58: truncate f11 4377580 0 2021-11-03T16:54:45.684 INFO:tasks.workunit.client.0.smithi026.stdout:3/133: mkdir dc/d12/d33 0 2021-11-03T16:54:45.687 INFO:tasks.workunit.client.0.smithi026.stdout:8/61: dwrite d2/ff [0,4194304] 0 2021-11-03T16:54:45.688 INFO:tasks.workunit.client.1.smithi194.stdout:1/179: dwrite d2/da/d2e/f31 [0,4194304] 0 2021-11-03T16:54:45.688 INFO:tasks.workunit.client.1.smithi194.stdout:1/180: write d2/d1e/f32 [47149,55775] 0 2021-11-03T16:54:45.689 INFO:tasks.workunit.client.0.smithi026.stdout:9/107: unlink d2/d18/f17 0 2021-11-03T16:54:45.694 INFO:tasks.workunit.client.0.smithi026.stdout:4/59: creat f18 x:0 0 0 2021-11-03T16:54:45.694 INFO:tasks.workunit.client.0.smithi026.stdout:4/60: write fc [457284,110545] 0 2021-11-03T16:54:45.695 INFO:tasks.workunit.client.0.smithi026.stdout:3/134: mkdir dc/d12/d33/d34 0 2021-11-03T16:54:45.696 INFO:tasks.workunit.client.0.smithi026.stdout:8/62: dread d2/ff [0,4194304] 0 2021-11-03T16:54:45.696 INFO:tasks.workunit.client.0.smithi026.stdout:3/135: write dc/d12/d13/f1b [2196076,121088] 0 2021-11-03T16:54:45.697 INFO:tasks.workunit.client.0.smithi026.stdout:4/61: write f12 [3159276,102643] 0 2021-11-03T16:54:45.699 INFO:tasks.workunit.client.0.smithi026.stdout:9/108: mkdir d2/d1f/d21 0 2021-11-03T16:54:45.705 INFO:tasks.workunit.client.0.smithi026.stdout:8/63: creat d2/da/f12 x:0 0 0 2021-11-03T16:54:45.707 INFO:tasks.workunit.client.0.smithi026.stdout:8/64: creat d2/f13 x:0 0 0 2021-11-03T16:54:45.708 INFO:tasks.workunit.client.0.smithi026.stdout:9/109: dread d2/d1f/f1a [0,4194304] 0 2021-11-03T16:54:45.708 INFO:tasks.workunit.client.0.smithi026.stdout:9/110: rename d2 to d2/d1f/d22 22 2021-11-03T16:54:45.708 INFO:tasks.workunit.client.0.smithi026.stdout:8/65: mkdir d2/da/d14 0 2021-11-03T16:54:45.711 INFO:tasks.workunit.client.0.smithi026.stdout:4/62: dread fd [0,4194304] 0 2021-11-03T16:54:45.713 INFO:tasks.workunit.client.0.smithi026.stdout:9/111: rename d2/d18/f13 to d2/d1f/d21/f23 0 2021-11-03T16:54:45.713 INFO:tasks.workunit.client.0.smithi026.stdout:9/112: chown d2/d18/lb 25703795 1 2021-11-03T16:54:45.713 INFO:tasks.workunit.client.0.smithi026.stdout:9/113: readlink d2/d18/lb 0 2021-11-03T16:54:45.714 INFO:tasks.workunit.client.0.smithi026.stdout:9/114: readlink d2/d18/lb 0 2021-11-03T16:54:45.714 INFO:tasks.workunit.client.0.smithi026.stdout:9/115: write d2/d1f/f1a [6033513,34434] 0 2021-11-03T16:54:45.715 INFO:tasks.workunit.client.1.smithi194.stdout:1/181: dwrite d2/f1c [0,4194304] 0 2021-11-03T16:54:45.715 INFO:tasks.workunit.client.1.smithi194.stdout:1/182: rename d2 to d2/da/d2e/d2f/d35 22 2021-11-03T16:54:45.715 INFO:tasks.workunit.client.1.smithi194.stdout:1/183: mknod d2/da/d2e/c36 1 2021-11-03T16:54:45.715 INFO:tasks.workunit.client.0.smithi026.stdout:4/63: creat f19 x:0 0 0 2021-11-03T16:54:45.718 INFO:tasks.workunit.client.0.smithi026.stdout:9/116: write d2/d18/ff [5417361,24976] 0 2021-11-03T16:54:45.719 INFO:tasks.workunit.client.0.smithi026.stdout:3/136: dwrite dc/d12/d13/f1b [0,4194304] 0 2021-11-03T16:54:45.721 INFO:tasks.workunit.client.1.smithi194.stdout:1/184: symlink d2/da/d2b/l37 0 2021-11-03T16:54:45.721 INFO:tasks.workunit.client.1.smithi194.stdout:1/185: write d2/d1e/d23/f29 [790562,119356] 0 2021-11-03T16:54:45.722 INFO:tasks.workunit.client.0.smithi026.stdout:9/117: write d2/d18/f15 [3181709,101841] 0 2021-11-03T16:54:45.724 INFO:tasks.workunit.client.0.smithi026.stdout:3/137: rename dc/d12/d13 to dc/d1d/d35 0 2021-11-03T16:54:45.724 INFO:tasks.workunit.client.0.smithi026.stdout:8/66: dwrite d2/da/fe [0,4194304] 0 2021-11-03T16:54:45.725 INFO:tasks.workunit.client.1.smithi194.stdout:1/186: link d2/da/d2e/d2f/l34 d2/da/l38 0 2021-11-03T16:54:45.734 INFO:tasks.workunit.client.0.smithi026.stdout:3/138: mkdir dc/d1d/d35/d36 0 2021-11-03T16:54:45.734 INFO:tasks.workunit.client.0.smithi026.stdout:3/139: truncate dc/d1d/d1e/d27/f32 1852 0 2021-11-03T16:54:45.736 INFO:tasks.workunit.client.0.smithi026.stdout:7/182: sync 2021-11-03T16:54:45.736 INFO:tasks.workunit.client.1.smithi194.stdout:1/187: link d2/da/d13/f14 d2/d1e/d23/f39 0 2021-11-03T16:54:45.737 INFO:tasks.workunit.client.1.smithi194.stdout:1/188: chown d2/f27 7 1 2021-11-03T16:54:45.741 INFO:tasks.workunit.client.1.smithi194.stdout:1/189: rename d2/da/d2b/l2d to d2/da/d13/l3a 0 2021-11-03T16:54:45.742 INFO:tasks.workunit.client.1.smithi194.stdout:1/190: chown d2/f1f 1324 1 2021-11-03T16:54:45.743 INFO:tasks.workunit.client.0.smithi026.stdout:8/67: creat d2/da/d14/f15 x:0 0 0 2021-11-03T16:54:45.743 INFO:tasks.workunit.client.0.smithi026.stdout:8/68: dread - d2/da/f12 zero size 2021-11-03T16:54:45.743 INFO:tasks.workunit.client.0.smithi026.stdout:8/69: truncate d2/da/f12 986607 0 2021-11-03T16:54:45.744 INFO:tasks.workunit.client.0.smithi026.stdout:8/70: chown d2/da/d14/f15 7 1 2021-11-03T16:54:45.744 INFO:tasks.workunit.client.0.smithi026.stdout:9/118: dwrite d2/f16 [0,4194304] 0 2021-11-03T16:54:45.745 INFO:tasks.workunit.client.0.smithi026.stdout:3/140: creat dc/d1d/f37 x:0 0 0 2021-11-03T16:54:45.745 INFO:tasks.workunit.client.0.smithi026.stdout:3/141: readlink dc/d1d/l2c 0 2021-11-03T16:54:45.746 INFO:tasks.workunit.client.1.smithi194.stdout:1/191: rmdir d2/da/d13 39 2021-11-03T16:54:45.746 INFO:tasks.workunit.client.1.smithi194.stdout:1/192: fdatasync d2/f18 0 2021-11-03T16:54:45.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:45 smithi194 conmon[35111]: cluster 2021-11-03T16:54:45.076920+0000 mgr.smithi026.cnrxli (mgr.14162) 316 : cluster [DBG] pgmap v259: 65 pgs: 65 active+clean; 671 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 26 MiB/s rd, 53 MiB/s wr, 150 op/s 2021-11-03T16:54:45.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:45 smithi194 conmon[35111]: 2021-11-03T16:54:45.750 INFO:tasks.workunit.client.0.smithi026.stdout:7/183: rmdir da/d14/d32 39 2021-11-03T16:54:45.751 INFO:tasks.workunit.client.0.smithi026.stdout:3/142: dread dc/f17 [0,4194304] 0 2021-11-03T16:54:45.751 INFO:tasks.workunit.client.0.smithi026.stdout:3/143: chown dc/d12/d30 30982 1 2021-11-03T16:54:45.752 INFO:tasks.workunit.client.0.smithi026.stdout:3/144: write dc/f20 [2754442,12849] 0 2021-11-03T16:54:45.753 INFO:tasks.workunit.client.0.smithi026.stdout:3/145: write dc/d1d/d1e/d27/f32 [781265,24212] 0 2021-11-03T16:54:45.753 INFO:tasks.workunit.client.1.smithi194.stdout:1/193: creat d2/d1e/d23/f3b x:0 0 0 2021-11-03T16:54:45.754 INFO:tasks.workunit.client.1.smithi194.stdout:1/194: stat d2/f1c 0 2021-11-03T16:54:45.754 INFO:tasks.workunit.client.1.smithi194.stdout:1/195: fdatasync d2/da/f2c 0 2021-11-03T16:54:45.768 INFO:tasks.workunit.client.0.smithi026.stdout:9/119: dwrite d2/d1f/d21/f23 [0,4194304] 0 2021-11-03T16:54:45.768 INFO:tasks.workunit.client.0.smithi026.stdout:7/184: dwrite da/f13 [0,4194304] 0 2021-11-03T16:54:45.793 INFO:tasks.workunit.client.1.smithi194.stdout:2/370: sync 2021-11-03T16:54:45.793 INFO:tasks.workunit.client.1.smithi194.stdout:3/258: sync 2021-11-03T16:54:45.794 INFO:tasks.workunit.client.1.smithi194.stdout:2/371: write d6/de/f57 [94993,8057] 0 2021-11-03T16:54:45.795 INFO:tasks.workunit.client.1.smithi194.stdout:3/259: write d2/d17/f23 [749115,74125] 0 2021-11-03T16:54:45.808 INFO:tasks.workunit.client.1.smithi194.stdout:3/260: dwrite d2/d17/f1c [0,4194304] 0 2021-11-03T16:54:45.850 INFO:tasks.workunit.client.0.smithi026.stdout:8/71: link d2/l9 d2/l16 0 2021-11-03T16:54:45.852 INFO:tasks.workunit.client.0.smithi026.stdout:3/146: rmdir dc/d12/d33/d34 0 2021-11-03T16:54:45.852 INFO:tasks.workunit.client.0.smithi026.stdout:3/147: stat dc/d12/l19 0 2021-11-03T16:54:45.854 INFO:tasks.workunit.client.1.smithi194.stdout:1/196: symlink d2/d1e/d23/l3c 0 2021-11-03T16:54:45.856 INFO:tasks.workunit.client.1.smithi194.stdout:2/372: creat d6/d21/f71 x:0 0 0 2021-11-03T16:54:45.857 INFO:tasks.workunit.client.0.smithi026.stdout:9/120: creat d2/d18/f24 x:0 0 0 2021-11-03T16:54:45.858 INFO:tasks.workunit.client.0.smithi026.stdout:9/121: chown d2/f12 109 1 2021-11-03T16:54:45.865 INFO:tasks.workunit.client.1.smithi194.stdout:3/261: creat d2/d17/d1d/f5d x:0 0 0 2021-11-03T16:54:45.865 INFO:tasks.workunit.client.0.smithi026.stdout:7/185: symlink da/d2c/l37 0 2021-11-03T16:54:45.867 INFO:tasks.workunit.client.1.smithi194.stdout:1/197: unlink d2/d1e/f33 0 2021-11-03T16:54:45.867 INFO:tasks.workunit.client.1.smithi194.stdout:1/198: fsync d2/f15 0 2021-11-03T16:54:45.870 INFO:tasks.workunit.client.1.smithi194.stdout:3/262: getdents d2/d33 0 2021-11-03T16:54:45.871 INFO:tasks.workunit.client.1.smithi194.stdout:1/199: write d2/da/f2a [3768353,38726] 0 2021-11-03T16:54:45.871 INFO:tasks.workunit.client.0.smithi026.stdout:8/72: dwrite d2/da/fc [0,4194304] 0 2021-11-03T16:54:45.872 INFO:tasks.workunit.client.1.smithi194.stdout:2/373: dread d6/d21/d2a/d31/f37 [0,4194304] 0 2021-11-03T16:54:45.877 INFO:tasks.workunit.client.1.smithi194.stdout:3/263: mkdir d2/d17/d5e 0 2021-11-03T16:54:45.877 INFO:tasks.workunit.client.1.smithi194.stdout:3/264: chown d2/d17/d26/l5b 4 1 2021-11-03T16:54:45.877 INFO:tasks.workunit.client.1.smithi194.stdout:3/265: read - d2/d17/d26/f55 zero size 2021-11-03T16:54:45.879 INFO:tasks.workunit.client.1.smithi194.stdout:3/266: dread d2/f27 [0,4194304] 0 2021-11-03T16:54:45.880 INFO:tasks.workunit.client.1.smithi194.stdout:1/200: symlink d2/da/d2b/l3d 0 2021-11-03T16:54:45.880 INFO:tasks.workunit.client.1.smithi194.stdout:1/201: write d2/f18 [35856,4148] 0 2021-11-03T16:54:45.882 INFO:tasks.workunit.client.1.smithi194.stdout:2/374: symlink d6/d21/d2a/l72 0 2021-11-03T16:54:45.887 INFO:tasks.workunit.client.1.smithi194.stdout:3/267: creat d2/d20/d36/f5f x:0 0 0 2021-11-03T16:54:45.888 INFO:tasks.workunit.client.1.smithi194.stdout:1/202: creat d2/d1e/d23/f3e x:0 0 0 2021-11-03T16:54:45.893 INFO:tasks.workunit.client.0.smithi026.stdout:3/148: symlink dc/d1d/d35/d36/l38 0 2021-11-03T16:54:45.895 INFO:tasks.workunit.client.1.smithi194.stdout:2/375: rename d6/d21/f45 to d6/d21/d2a/d31/f73 0 2021-11-03T16:54:45.895 INFO:tasks.workunit.client.1.smithi194.stdout:2/376: fsync d6/f7 0 2021-11-03T16:54:45.896 INFO:tasks.workunit.client.0.smithi026.stdout:9/122: rename d2/d18/ff to d2/d18/f25 0 2021-11-03T16:54:45.897 INFO:tasks.workunit.client.0.smithi026.stdout:9/123: mknod d2/d18/c26 1 2021-11-03T16:54:45.897 INFO:tasks.workunit.client.0.smithi026.stdout:2/44: sync 2021-11-03T16:54:45.898 INFO:tasks.workunit.client.1.smithi194.stdout:3/268: mkdir d2/d20/d36/d60 0 2021-11-03T16:54:45.899 INFO:tasks.workunit.client.1.smithi194.stdout:1/203: creat d2/da/f3f x:0 0 0 2021-11-03T16:54:45.901 INFO:tasks.workunit.client.0.smithi026.stdout:7/186: truncate da/d14/d2a/f2b 88677 0 2021-11-03T16:54:45.901 INFO:tasks.workunit.client.0.smithi026.stdout:7/187: chown f0 98432 1 2021-11-03T16:54:45.904 INFO:tasks.workunit.client.1.smithi194.stdout:3/269: dread d2/d20/f25 [0,4194304] 0 2021-11-03T16:54:45.905 INFO:tasks.workunit.client.0.smithi026.stdout:8/73: rename d2/da/f10 to d2/da/d14/f17 0 2021-11-03T16:54:45.906 INFO:tasks.workunit.client.1.smithi194.stdout:3/270: write d2/d20/d36/d51/f53 [547400,37984] 0 2021-11-03T16:54:45.906 INFO:tasks.workunit.client.1.smithi194.stdout:3/271: chown d2/d20/d36/d51/f56 0 1 2021-11-03T16:54:45.906 INFO:tasks.workunit.client.1.smithi194.stdout:3/272: dread - d2/d20/f5a zero size 2021-11-03T16:54:45.906 INFO:tasks.workunit.client.1.smithi194.stdout:1/204: unlink d2/d1e/d23/l3c 0 2021-11-03T16:54:45.907 INFO:tasks.workunit.client.1.smithi194.stdout:1/205: stat d2/f27 0 2021-11-03T16:54:45.907 INFO:tasks.workunit.client.0.smithi026.stdout:7/188: dread f0 [0,4194304] 0 2021-11-03T16:54:45.909 INFO:tasks.workunit.client.0.smithi026.stdout:3/149: unlink dc/f17 0 2021-11-03T16:54:45.910 INFO:tasks.workunit.client.1.smithi194.stdout:3/273: truncate d2/f12 3391419 0 2021-11-03T16:54:45.910 INFO:tasks.workunit.client.1.smithi194.stdout:3/274: readlink d2/d17/d26/l49 0 2021-11-03T16:54:45.912 INFO:tasks.workunit.client.1.smithi194.stdout:1/206: unlink d2/da/f3f 0 2021-11-03T16:54:45.914 INFO:tasks.workunit.client.0.smithi026.stdout:2/45: dwrite f5 [0,4194304] 0 2021-11-03T16:54:45.915 INFO:tasks.workunit.client.0.smithi026.stdout:2/46: read fc [204286,82945] 0 2021-11-03T16:54:45.916 INFO:tasks.workunit.client.1.smithi194.stdout:3/275: getdents d2/d17 0 2021-11-03T16:54:45.916 INFO:tasks.workunit.client.1.smithi194.stdout:2/377: dwrite d6/de/d27/f5a [0,4194304] 0 2021-11-03T16:54:45.916 INFO:tasks.workunit.client.1.smithi194.stdout:2/378: read d6/d1f/f2e [2769288,9989] 0 2021-11-03T16:54:45.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:45 smithi026 conmon[32119]: cluster 2021-11-03T16:54:45.076920+0000 2021-11-03T16:54:45.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:45 smithi026 conmon[32119]: mgr.smithi026.cnrxli (mgr.14162) 316 : cluster [DBG] pgmap v259: 65 pgs: 65 active+clean; 671 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 26 MiB/s rd, 53 MiB/s wr, 150 op/s 2021-11-03T16:54:45.926 INFO:tasks.workunit.client.0.smithi026.stdout:8/74: creat d2/f18 x:0 0 0 2021-11-03T16:54:45.927 INFO:tasks.workunit.client.0.smithi026.stdout:8/75: write d2/f18 [490307,115504] 0 2021-11-03T16:54:45.927 INFO:tasks.workunit.client.1.smithi194.stdout:1/207: rmdir d2 39 2021-11-03T16:54:45.927 INFO:tasks.workunit.client.1.smithi194.stdout:1/208: fdatasync d2/f18 0 2021-11-03T16:54:45.928 INFO:tasks.workunit.client.1.smithi194.stdout:1/209: write d2/d1e/d23/f3e [972361,86161] 0 2021-11-03T16:54:45.930 INFO:tasks.workunit.client.0.smithi026.stdout:7/189: creat da/d2c/f38 x:0 0 0 2021-11-03T16:54:45.933 INFO:tasks.workunit.client.1.smithi194.stdout:3/276: truncate d2/d17/f34 2775084 0 2021-11-03T16:54:45.933 INFO:tasks.workunit.client.1.smithi194.stdout:3/277: chown d2/d17/d1d/f31 9 1 2021-11-03T16:54:45.933 INFO:tasks.workunit.client.1.smithi194.stdout:3/278: chown d2/d20/d36/d43 2042640044 1 2021-11-03T16:54:45.933 INFO:tasks.workunit.client.1.smithi194.stdout:3/279: write d2/d20/d36/d43/f4d [221979,32436] 0 2021-11-03T16:54:45.934 INFO:tasks.workunit.client.1.smithi194.stdout:3/280: stat d2/d17/d26/l49 0 2021-11-03T16:54:45.935 INFO:tasks.workunit.client.0.smithi026.stdout:3/150: rename dc/d1d/f37 to dc/d1d/d1e/d27/f39 0 2021-11-03T16:54:45.937 INFO:tasks.workunit.client.0.smithi026.stdout:9/124: mkdir d2/d27 0 2021-11-03T16:54:45.941 INFO:tasks.workunit.client.1.smithi194.stdout:1/210: creat d2/da/d2e/d2f/f40 x:0 0 0 2021-11-03T16:54:45.942 INFO:tasks.workunit.client.1.smithi194.stdout:2/379: dwrite d6/de/d16/f50 [0,4194304] 0 2021-11-03T16:54:45.944 INFO:tasks.workunit.client.1.smithi194.stdout:3/281: rmdir d2/d17/d1d 39 2021-11-03T16:54:45.944 INFO:tasks.workunit.client.1.smithi194.stdout:3/282: write d2/d17/f2e [40543,72569] 0 2021-11-03T16:54:45.949 INFO:tasks.workunit.client.0.smithi026.stdout:2/47: truncate fd 471845 0 2021-11-03T16:54:45.955 INFO:tasks.workunit.client.1.smithi194.stdout:1/211: mkdir d2/d1e/d41 0 2021-11-03T16:54:45.956 INFO:tasks.workunit.client.0.smithi026.stdout:8/76: creat d2/da/f19 x:0 0 0 2021-11-03T16:54:45.956 INFO:tasks.workunit.client.0.smithi026.stdout:8/77: stat d2/da/ld 0 2021-11-03T16:54:45.962 INFO:tasks.workunit.client.1.smithi194.stdout:3/283: dwrite d2/d20/d36/d51/f56 [0,4194304] 0 2021-11-03T16:54:45.971 INFO:tasks.workunit.client.0.smithi026.stdout:3/151: rename dc/d12/l14 to dc/d1d/d35/d36/l3a 0 2021-11-03T16:54:45.973 INFO:tasks.workunit.client.0.smithi026.stdout:9/125: creat d2/d27/f28 x:0 0 0 2021-11-03T16:54:45.973 INFO:tasks.workunit.client.0.smithi026.stdout:3/152: write dc/f1f [3762574,38490] 0 2021-11-03T16:54:45.978 INFO:tasks.workunit.client.0.smithi026.stdout:2/48: mkdir de/d11 0 2021-11-03T16:54:45.980 INFO:tasks.workunit.client.0.smithi026.stdout:2/49: write fd [332515,118102] 0 2021-11-03T16:54:45.981 INFO:tasks.workunit.client.1.smithi194.stdout:3/284: dwrite d2/d17/f34 [0,4194304] 0 2021-11-03T16:54:45.981 INFO:tasks.workunit.client.1.smithi194.stdout:1/212: dwrite d2/da/d2e/f31 [0,4194304] 0 2021-11-03T16:54:45.985 INFO:tasks.workunit.client.0.smithi026.stdout:8/78: creat d2/da/f1a x:0 0 0 2021-11-03T16:54:45.986 INFO:tasks.workunit.client.0.smithi026.stdout:8/79: write d2/da/d14/f15 [490940,100515] 0 2021-11-03T16:54:45.989 INFO:tasks.workunit.client.0.smithi026.stdout:2/50: truncate de/ff 2792713 0 2021-11-03T16:54:45.994 INFO:tasks.workunit.client.0.smithi026.stdout:8/80: mkdir d2/da/d14/d1b 0 2021-11-03T16:54:45.994 INFO:tasks.workunit.client.0.smithi026.stdout:8/81: fdatasync d2/f13 0 2021-11-03T16:54:45.996 INFO:tasks.workunit.client.0.smithi026.stdout:3/153: dread dc/f1f [0,4194304] 0 2021-11-03T16:54:45.997 INFO:tasks.workunit.client.0.smithi026.stdout:3/154: stat dc/f1f 0 2021-11-03T16:54:45.998 INFO:tasks.workunit.client.1.smithi194.stdout:3/285: creat d2/d20/d36/d4e/f61 x:0 0 0 2021-11-03T16:54:45.999 INFO:tasks.workunit.client.1.smithi194.stdout:3/286: read d2/d20/f59 [878038,79111] 0 2021-11-03T16:54:45.999 INFO:tasks.workunit.client.1.smithi194.stdout:3/287: readlink d2/d17/l32 0 2021-11-03T16:54:45.999 INFO:tasks.workunit.client.1.smithi194.stdout:3/288: chown d2/d17/f4f 6 1 2021-11-03T16:54:46.002 INFO:tasks.workunit.client.1.smithi194.stdout:3/289: creat d2/d20/d36/d4e/f62 x:0 0 0 2021-11-03T16:54:46.003 INFO:tasks.workunit.client.1.smithi194.stdout:3/290: chown d2/d17/d26/l49 805817838 1 2021-11-03T16:54:46.006 INFO:tasks.workunit.client.1.smithi194.stdout:3/291: symlink d2/d17/d5e/l63 0 2021-11-03T16:54:46.022 INFO:tasks.workunit.client.1.smithi194.stdout:2/380: write d6/d21/d2a/d31/f73 [1761170,34483] 0 2021-11-03T16:54:46.026 INFO:tasks.workunit.client.1.smithi194.stdout:2/381: write d6/d21/d2a/d35/f52 [1191769,94224] 0 2021-11-03T16:54:46.027 INFO:tasks.workunit.client.1.smithi194.stdout:2/382: mknod d6/de/d11/c74 1 2021-11-03T16:54:46.027 INFO:tasks.workunit.client.1.smithi194.stdout:2/383: mkdir d6/d1f/d75 0 2021-11-03T16:54:46.029 INFO:tasks.workunit.client.1.smithi194.stdout:2/384: mkdir d6/d17/d26/d63/d76 0 2021-11-03T16:54:46.030 INFO:tasks.workunit.client.1.smithi194.stdout:2/385: dread - d6/d1f/f42 zero size 2021-11-03T16:54:46.032 INFO:tasks.workunit.client.0.smithi026.stdout:8/82: dwrite d2/da/d14/f17 [0,4194304] 0 2021-11-03T16:54:46.034 INFO:tasks.workunit.client.0.smithi026.stdout:3/155: dwrite dc/f20 [0,4194304] 0 2021-11-03T16:54:46.036 INFO:tasks.workunit.client.1.smithi194.stdout:3/292: dwrite d2/d17/f23 [0,4194304] 0 2021-11-03T16:54:46.036 INFO:tasks.workunit.client.1.smithi194.stdout:2/386: dread d6/d21/d2a/d31/f37 [0,4194304] 0 2021-11-03T16:54:46.037 INFO:tasks.workunit.client.1.smithi194.stdout:3/293: fsync d2/d17/d1d/f5d 0 2021-11-03T16:54:46.037 INFO:tasks.workunit.client.1.smithi194.stdout:3/294: readlink d2/l7 0 2021-11-03T16:54:46.037 INFO:tasks.workunit.client.0.smithi026.stdout:3/156: unlink l9 0 2021-11-03T16:54:46.039 INFO:tasks.workunit.client.0.smithi026.stdout:8/83: mkdir d2/d1c 0 2021-11-03T16:54:46.039 INFO:tasks.workunit.client.0.smithi026.stdout:8/84: readlink d2/l16 0 2021-11-03T16:54:46.040 INFO:tasks.workunit.client.0.smithi026.stdout:3/157: link dc/d1d/d35/d36/l3a dc/d1d/d35/d36/l3b 0 2021-11-03T16:54:46.041 INFO:tasks.workunit.client.0.smithi026.stdout:3/158: readlink dc/d1d/d35/d36/l38 0 2021-11-03T16:54:46.041 INFO:tasks.workunit.client.0.smithi026.stdout:3/159: chown dc 120448562 1 2021-11-03T16:54:46.043 INFO:tasks.workunit.client.1.smithi194.stdout:2/387: creat d6/d17/d26/f77 x:0 0 0 2021-11-03T16:54:46.044 INFO:tasks.workunit.client.1.smithi194.stdout:2/388: truncate d6/de/d16/d20/f5b 838840 0 2021-11-03T16:54:46.044 INFO:tasks.workunit.client.1.smithi194.stdout:2/389: chown d6/d17/d26/f32 30 1 2021-11-03T16:54:46.044 INFO:tasks.workunit.client.1.smithi194.stdout:3/295: creat d2/d20/f64 x:0 0 0 2021-11-03T16:54:46.045 INFO:tasks.workunit.client.0.smithi026.stdout:2/51: dread de/ff [0,4194304] 0 2021-11-03T16:54:46.045 INFO:tasks.workunit.client.1.smithi194.stdout:2/390: truncate d6/de/d27/f49 1545977 0 2021-11-03T16:54:46.048 INFO:tasks.workunit.client.0.smithi026.stdout:2/52: link f2 de/d11/f12 0 2021-11-03T16:54:46.049 INFO:tasks.workunit.client.0.smithi026.stdout:2/53: read fc [32300,118475] 0 2021-11-03T16:54:46.051 INFO:tasks.workunit.client.1.smithi194.stdout:3/296: rename d2/f27 to d2/d17/d26/f65 0 2021-11-03T16:54:46.055 INFO:tasks.workunit.client.0.smithi026.stdout:2/54: creat de/d11/f13 x:0 0 0 2021-11-03T16:54:46.055 INFO:tasks.workunit.client.0.smithi026.stdout:2/55: stat de/ff 0 2021-11-03T16:54:46.057 INFO:tasks.workunit.client.1.smithi194.stdout:3/297: getdents d2/d20/d36/d51 0 2021-11-03T16:54:46.058 INFO:tasks.workunit.client.0.smithi026.stdout:8/85: dwrite d2/da/fe [0,4194304] 0 2021-11-03T16:54:46.061 INFO:tasks.workunit.client.0.smithi026.stdout:3/160: rename dc/d1d/d35 to dc/d12/d30/d3c 0 2021-11-03T16:54:46.061 INFO:tasks.workunit.client.0.smithi026.stdout:3/161: mknod dc/d12/d30/d3c/c3d 1 2021-11-03T16:54:46.062 INFO:tasks.workunit.client.0.smithi026.stdout:3/162: chown dc/d12/d30/d3c/d36/l3b 3216 1 2021-11-03T16:54:46.072 INFO:tasks.workunit.client.0.smithi026.stdout:8/86: getdents d2/da/d14 0 2021-11-03T16:54:46.075 INFO:tasks.workunit.client.0.smithi026.stdout:8/87: read d2/da/fc [372039,72431] 0 2021-11-03T16:54:46.076 INFO:tasks.workunit.client.1.smithi194.stdout:3/298: creat d2/d17/d26/f66 x:0 0 0 2021-11-03T16:54:46.076 INFO:tasks.workunit.client.1.smithi194.stdout:3/299: readlink d2/d33/l40 0 2021-11-03T16:54:46.077 INFO:tasks.workunit.client.0.smithi026.stdout:8/88: rmdir d2/da/d14 39 2021-11-03T16:54:46.077 INFO:tasks.workunit.client.0.smithi026.stdout:8/89: truncate d2/da/f19 368483 0 2021-11-03T16:54:46.078 INFO:tasks.workunit.client.1.smithi194.stdout:3/300: symlink d2/d17/l67 0 2021-11-03T16:54:46.078 INFO:tasks.workunit.client.0.smithi026.stdout:8/90: symlink d2/da/d14/d1b/l1d 0 2021-11-03T16:54:46.079 INFO:tasks.workunit.client.0.smithi026.stdout:8/91: fsync d2/da/fc 0 2021-11-03T16:54:46.079 INFO:tasks.workunit.client.0.smithi026.stdout:8/92: rename d2/da/d14 to d2/da/d14/d1b/d1e 22 2021-11-03T16:54:46.081 INFO:tasks.workunit.client.1.smithi194.stdout:3/301: creat d2/d17/d5e/f68 x:0 0 0 2021-11-03T16:54:46.086 INFO:tasks.workunit.client.1.smithi194.stdout:2/391: dread d6/de/d27/f49 [0,4194304] 0 2021-11-03T16:54:46.101 INFO:tasks.workunit.client.0.smithi026.stdout:8/93: dread d2/da/d14/f17 [0,4194304] 0 2021-11-03T16:54:46.101 INFO:tasks.workunit.client.0.smithi026.stdout:2/56: dwrite de/ff [0,4194304] 0 2021-11-03T16:54:46.101 INFO:tasks.workunit.client.0.smithi026.stdout:3/163: dwrite dc/d1d/d1e/d27/f32 [0,4194304] 0 2021-11-03T16:54:46.101 INFO:tasks.workunit.client.0.smithi026.stdout:3/164: fdatasync dc/d12/d30/d3c/f1b 0 2021-11-03T16:54:46.102 INFO:tasks.workunit.client.0.smithi026.stdout:2/57: getdents de 0 2021-11-03T16:54:46.102 INFO:tasks.workunit.client.0.smithi026.stdout:2/58: rename de/d11 to de/d11/d14 22 2021-11-03T16:54:46.103 INFO:tasks.workunit.client.0.smithi026.stdout:8/94: write d2/ff [1215201,35763] 0 2021-11-03T16:54:46.105 INFO:tasks.workunit.client.0.smithi026.stdout:2/59: mkdir de/d11/d15 0 2021-11-03T16:54:46.107 INFO:tasks.workunit.client.1.smithi194.stdout:3/302: dwrite d2/ff [0,4194304] 0 2021-11-03T16:54:46.109 INFO:tasks.workunit.client.0.smithi026.stdout:8/95: rename d2/da/d14/f15 to d2/da/d14/d1b/f1f 0 2021-11-03T16:54:46.110 INFO:tasks.workunit.client.0.smithi026.stdout:8/96: write d2/da/fe [2042722,9284] 0 2021-11-03T16:54:46.111 INFO:tasks.workunit.client.0.smithi026.stdout:2/60: creat de/d11/f16 x:0 0 0 2021-11-03T16:54:46.113 INFO:tasks.workunit.client.0.smithi026.stdout:8/97: getdents d2/da 0 2021-11-03T16:54:46.113 INFO:tasks.workunit.client.0.smithi026.stdout:8/98: chown d2/da/d14/f17 6 1 2021-11-03T16:54:46.115 INFO:tasks.workunit.client.0.smithi026.stdout:8/99: creat d2/da/d14/d1b/f20 x:0 0 0 2021-11-03T16:54:46.115 INFO:tasks.workunit.client.0.smithi026.stdout:8/100: write d2/da/f19 [882123,3480] 0 2021-11-03T16:54:46.116 INFO:tasks.workunit.client.0.smithi026.stdout:8/101: creat d2/da/d14/f21 x:0 0 0 2021-11-03T16:54:46.118 INFO:tasks.workunit.client.0.smithi026.stdout:8/102: mkdir d2/da/d14/d22 0 2021-11-03T16:54:46.120 INFO:tasks.workunit.client.0.smithi026.stdout:8/103: unlink d2/l9 0 2021-11-03T16:54:46.121 INFO:tasks.workunit.client.0.smithi026.stdout:8/104: readlink d2/da/ld 0 2021-11-03T16:54:46.123 INFO:tasks.workunit.client.0.smithi026.stdout:2/61: dread de/ff [0,4194304] 0 2021-11-03T16:54:46.124 INFO:tasks.workunit.client.0.smithi026.stdout:2/62: fdatasync de/d11/f16 0 2021-11-03T16:54:46.124 INFO:tasks.workunit.client.0.smithi026.stdout:2/63: fdatasync de/d11/f12 0 2021-11-03T16:54:46.125 INFO:tasks.workunit.client.0.smithi026.stdout:2/64: symlink de/d11/d15/l17 0 2021-11-03T16:54:46.126 INFO:tasks.workunit.client.0.smithi026.stdout:2/65: symlink de/d11/d15/l18 0 2021-11-03T16:54:46.127 INFO:tasks.workunit.client.0.smithi026.stdout:2/66: dread fd [0,4194304] 0 2021-11-03T16:54:46.128 INFO:tasks.workunit.client.0.smithi026.stdout:2/67: write f3 [3050942,16393] 0 2021-11-03T16:54:46.128 INFO:tasks.workunit.client.0.smithi026.stdout:2/68: chown fd 3291747 1 2021-11-03T16:54:46.130 INFO:tasks.workunit.client.1.smithi194.stdout:3/303: dwrite d2/d17/d1d/f3c [0,4194304] 0 2021-11-03T16:54:46.131 INFO:tasks.workunit.client.1.smithi194.stdout:3/304: write d2/d17/d5e/f68 [846672,126816] 0 2021-11-03T16:54:46.131 INFO:tasks.workunit.client.0.smithi026.stdout:3/165: dwrite dc/d12/d30/d3c/f26 [4194304,4194304] 0 2021-11-03T16:54:46.132 INFO:tasks.workunit.client.0.smithi026.stdout:3/166: rename dc/d12/d30 to dc/d12/d30/d3e 22 2021-11-03T16:54:46.135 INFO:tasks.workunit.client.1.smithi194.stdout:3/305: rmdir d2/d20 39 2021-11-03T16:54:46.139 INFO:tasks.workunit.client.0.smithi026.stdout:8/105: getdents d2/da/d14 0 2021-11-03T16:54:46.142 INFO:tasks.workunit.client.1.smithi194.stdout:3/306: rmdir d2 39 2021-11-03T16:54:46.143 INFO:tasks.workunit.client.1.smithi194.stdout:3/307: read d2/ff [2856022,83260] 0 2021-11-03T16:54:46.144 INFO:tasks.workunit.client.1.smithi194.stdout:3/308: write d2/d20/f45 [3516143,109257] 0 2021-11-03T16:54:46.144 INFO:tasks.workunit.client.1.smithi194.stdout:3/309: chown d2/d17/f4f 300577937 1 2021-11-03T16:54:46.145 INFO:tasks.workunit.client.0.smithi026.stdout:3/167: getdents dc/d1d 0 2021-11-03T16:54:46.147 INFO:tasks.workunit.client.1.smithi194.stdout:3/310: creat d2/f69 x:0 0 0 2021-11-03T16:54:46.147 INFO:tasks.workunit.client.1.smithi194.stdout:3/311: chown d2/d33 49813 1 2021-11-03T16:54:46.148 INFO:tasks.workunit.client.1.smithi194.stdout:3/312: chown d2/d20/d36/d4e/f62 216446 1 2021-11-03T16:54:46.148 INFO:tasks.workunit.client.1.smithi194.stdout:3/313: write d2/d17/d1d/f31 [333583,26703] 0 2021-11-03T16:54:46.149 INFO:tasks.workunit.client.1.smithi194.stdout:3/314: link d2/d17/l2d d2/d17/d5e/l6a 0 2021-11-03T16:54:46.150 INFO:tasks.workunit.client.0.smithi026.stdout:8/106: symlink d2/da/l23 0 2021-11-03T16:54:46.155 INFO:tasks.workunit.client.0.smithi026.stdout:8/107: fdatasync d2/da/f19 0 2021-11-03T16:54:46.155 INFO:tasks.workunit.client.0.smithi026.stdout:8/108: stat d2/da/d14/f17 0 2021-11-03T16:54:46.156 INFO:tasks.workunit.client.0.smithi026.stdout:3/168: truncate f4 875700 0 2021-11-03T16:54:46.158 INFO:tasks.workunit.client.0.smithi026.stdout:8/109: fdatasync d2/f18 0 2021-11-03T16:54:46.161 INFO:tasks.workunit.client.0.smithi026.stdout:8/110: rename d2/da/l23 to d2/da/d14/l24 0 2021-11-03T16:54:46.161 INFO:tasks.workunit.client.0.smithi026.stdout:8/111: stat d2/f18 0 2021-11-03T16:54:46.162 INFO:tasks.workunit.client.1.smithi194.stdout:5/266: sync 2021-11-03T16:54:46.163 INFO:tasks.workunit.client.1.smithi194.stdout:3/315: dwrite d2/d33/f50 [0,4194304] 0 2021-11-03T16:54:46.164 INFO:tasks.workunit.client.1.smithi194.stdout:3/316: write d2/d20/d36/d51/f53 [1091297,90474] 0 2021-11-03T16:54:46.164 INFO:tasks.workunit.client.1.smithi194.stdout:3/317: chown d2/d17/f34 1896 1 2021-11-03T16:54:46.164 INFO:tasks.workunit.client.1.smithi194.stdout:3/318: dread - d2/d17/f58 zero size 2021-11-03T16:54:46.164 INFO:tasks.workunit.client.1.smithi194.stdout:3/319: dread - d2/f69 zero size 2021-11-03T16:54:46.166 INFO:tasks.workunit.client.0.smithi026.stdout:8/112: unlink d2/da/fe 0 2021-11-03T16:54:46.166 INFO:tasks.workunit.client.0.smithi026.stdout:8/113: readlink d2/da/d14/l24 0 2021-11-03T16:54:46.167 INFO:tasks.workunit.client.1.smithi194.stdout:5/267: symlink d2/d3/l5f 0 2021-11-03T16:54:46.167 INFO:tasks.workunit.client.1.smithi194.stdout:5/268: stat d2/dd/d35/l37 0 2021-11-03T16:54:46.173 INFO:tasks.workunit.client.1.smithi194.stdout:3/320: creat d2/d17/d1d/f6b x:0 0 0 2021-11-03T16:54:46.180 INFO:tasks.workunit.client.1.smithi194.stdout:5/269: rename d2/d3/f1a to d2/dd/d35/d38/f60 0 2021-11-03T16:54:46.180 INFO:tasks.workunit.client.1.smithi194.stdout:5/270: chown d2/d3/l2c 31929573 1 2021-11-03T16:54:46.180 INFO:tasks.workunit.client.1.smithi194.stdout:3/321: creat d2/d20/d36/d51/f6c x:0 0 0 2021-11-03T16:54:46.186 INFO:tasks.workunit.client.1.smithi194.stdout:3/322: rmdir d2/d20/d36/d51 39 2021-11-03T16:54:46.187 INFO:tasks.workunit.client.1.smithi194.stdout:5/271: dread d2/f24 [4194304,4194304] 0 2021-11-03T16:54:46.188 INFO:tasks.workunit.client.1.smithi194.stdout:5/272: getdents d2/d2a/d39 0 2021-11-03T16:54:46.188 INFO:tasks.workunit.client.1.smithi194.stdout:5/273: readlink d2/l30 0 2021-11-03T16:54:46.189 INFO:tasks.workunit.client.1.smithi194.stdout:5/274: dread - d2/dd/f53 zero size 2021-11-03T16:54:46.189 INFO:tasks.workunit.client.1.smithi194.stdout:5/275: mknod d2/c61 1 2021-11-03T16:54:46.189 INFO:tasks.workunit.client.1.smithi194.stdout:5/276: chown d2/d3/l2c 6326 1 2021-11-03T16:54:46.189 INFO:tasks.workunit.client.1.smithi194.stdout:5/277: mknod d2/dd/d5e/c62 1 2021-11-03T16:54:46.190 INFO:tasks.workunit.client.1.smithi194.stdout:5/278: dread - d2/dd/d35/f54 zero size 2021-11-03T16:54:46.191 INFO:tasks.workunit.client.1.smithi194.stdout:5/279: symlink d2/d2a/d39/l63 0 2021-11-03T16:54:46.191 INFO:tasks.workunit.client.1.smithi194.stdout:5/280: fsync d2/dd/d35/f58 0 2021-11-03T16:54:46.191 INFO:tasks.workunit.client.1.smithi194.stdout:5/281: symlink d2/dd/l64 0 2021-11-03T16:54:46.191 INFO:tasks.workunit.client.1.smithi194.stdout:5/282: write d2/d3/f2d [684558,89277] 0 2021-11-03T16:54:46.195 INFO:tasks.workunit.client.1.smithi194.stdout:3/323: dread d2/d17/f34 [0,4194304] 0 2021-11-03T16:54:46.235 INFO:tasks.workunit.client.1.smithi194.stdout:7/242: sync 2021-11-03T16:54:46.247 INFO:tasks.workunit.client.1.smithi194.stdout:5/283: creat d2/dd/d35/d38/f65 x:0 0 0 2021-11-03T16:54:46.248 INFO:tasks.workunit.client.1.smithi194.stdout:3/324: creat d2/d20/d36/d4e/f6d x:0 0 0 2021-11-03T16:54:46.248 INFO:tasks.workunit.client.1.smithi194.stdout:3/325: chown d2/d20/f64 479566 1 2021-11-03T16:54:46.252 INFO:tasks.workunit.client.1.smithi194.stdout:7/243: dwrite d6/da/d2b/d56/f48 [0,4194304] 0 2021-11-03T16:54:46.255 INFO:tasks.workunit.client.1.smithi194.stdout:5/284: creat d2/d3/d57/f66 x:0 0 0 2021-11-03T16:54:46.255 INFO:tasks.workunit.client.1.smithi194.stdout:5/285: dread - d2/d3/f5d zero size 2021-11-03T16:54:46.263 INFO:tasks.workunit.client.1.smithi194.stdout:7/244: link d6/da/d2b/f53 d6/da/d2b/d56/f58 0 2021-11-03T16:54:46.263 INFO:tasks.workunit.client.1.smithi194.stdout:7/245: chown d6/d32/l3f 11640092 1 2021-11-03T16:54:46.268 INFO:tasks.workunit.client.1.smithi194.stdout:5/286: dread f0 [0,4194304] 0 2021-11-03T16:54:46.268 INFO:tasks.workunit.client.1.smithi194.stdout:3/326: dwrite d2/d20/d36/d51/f6c [0,4194304] 0 2021-11-03T16:54:46.268 INFO:tasks.workunit.client.1.smithi194.stdout:3/327: mknod d2/d17/d5e/c6e 1 2021-11-03T16:54:46.269 INFO:tasks.workunit.client.1.smithi194.stdout:3/328: dread - d2/d20/d36/f5f zero size 2021-11-03T16:54:46.270 INFO:tasks.workunit.client.1.smithi194.stdout:5/287: write d2/dd/d35/f5c [395296,122571] 0 2021-11-03T16:54:46.272 INFO:tasks.workunit.client.1.smithi194.stdout:5/288: creat d2/d3/d57/f67 x:0 0 0 2021-11-03T16:54:46.273 INFO:tasks.workunit.client.1.smithi194.stdout:5/289: getdents d2/d2a/d39 0 2021-11-03T16:54:46.277 INFO:tasks.workunit.client.1.smithi194.stdout:5/290: creat d2/d2a/f68 x:0 0 0 2021-11-03T16:54:46.280 INFO:tasks.workunit.client.1.smithi194.stdout:5/291: mkdir d2/dd/d32/d69 0 2021-11-03T16:54:46.283 INFO:tasks.workunit.client.1.smithi194.stdout:7/246: dwrite d6/f2d [0,4194304] 0 2021-11-03T16:54:46.284 INFO:tasks.workunit.client.1.smithi194.stdout:7/247: mknod d6/d4c/c59 1 2021-11-03T16:54:46.285 INFO:tasks.workunit.client.1.smithi194.stdout:7/248: creat d6/da/f5a x:0 0 0 2021-11-03T16:54:46.286 INFO:tasks.workunit.client.1.smithi194.stdout:7/249: write d6/da/f10 [224633,94637] 0 2021-11-03T16:54:46.286 INFO:tasks.workunit.client.1.smithi194.stdout:7/250: fsync d6/da/d2b/f42 0 2021-11-03T16:54:46.287 INFO:tasks.workunit.client.1.smithi194.stdout:7/251: truncate d6/f2f 980365 0 2021-11-03T16:54:46.287 INFO:tasks.workunit.client.1.smithi194.stdout:7/252: readlink d6/d15/l39 0 2021-11-03T16:54:46.287 INFO:tasks.workunit.client.1.smithi194.stdout:7/253: fsync d6/da/d2b/d56/f48 0 2021-11-03T16:54:46.287 INFO:tasks.workunit.client.1.smithi194.stdout:7/254: fdatasync d6/da/d2b/d56/f58 0 2021-11-03T16:54:46.288 INFO:tasks.workunit.client.1.smithi194.stdout:7/255: mkdir d6/d4c/d54/d5b 0 2021-11-03T16:54:46.288 INFO:tasks.workunit.client.1.smithi194.stdout:7/256: fsync d6/d43/f36 0 2021-11-03T16:54:46.289 INFO:tasks.workunit.client.1.smithi194.stdout:7/257: symlink d6/da/d2b/l5c 0 2021-11-03T16:54:46.290 INFO:tasks.workunit.client.1.smithi194.stdout:7/258: creat d6/d43/d46/d4e/f5d x:0 0 0 2021-11-03T16:54:46.294 INFO:tasks.workunit.client.1.smithi194.stdout:7/259: read d6/d43/f36 [827250,123338] 0 2021-11-03T16:54:46.294 INFO:tasks.workunit.client.1.smithi194.stdout:3/329: dwrite d2/d17/d1d/f3c [4194304,4194304] 0 2021-11-03T16:54:46.296 INFO:tasks.workunit.client.1.smithi194.stdout:7/260: mkdir d6/d15/d50/d5e 0 2021-11-03T16:54:46.297 INFO:tasks.workunit.client.1.smithi194.stdout:7/261: chown d6/da/d2b/d56/f58 2095530 1 2021-11-03T16:54:46.297 INFO:tasks.workunit.client.1.smithi194.stdout:7/262: chown d6/da/d2b/f53 0 1 2021-11-03T16:54:46.298 INFO:tasks.workunit.client.1.smithi194.stdout:7/263: mkdir d6/d43/d46/d4e/d5f 0 2021-11-03T16:54:46.312 INFO:tasks.workunit.client.1.smithi194.stdout:7/264: dread d6/d15/f38 [0,4194304] 0 2021-11-03T16:54:46.313 INFO:tasks.workunit.client.1.smithi194.stdout:7/265: read d6/da/f11 [1411958,11668] 0 2021-11-03T16:54:46.314 INFO:tasks.workunit.client.1.smithi194.stdout:7/266: mkdir d6/d43/d46/d60 0 2021-11-03T16:54:46.315 INFO:tasks.workunit.client.1.smithi194.stdout:3/330: dwrite d2/d17/f23 [0,4194304] 0 2021-11-03T16:54:46.315 INFO:tasks.workunit.client.1.smithi194.stdout:3/331: truncate d2/f69 374773 0 2021-11-03T16:54:46.317 INFO:tasks.workunit.client.1.smithi194.stdout:7/267: rename d6/l3c to d6/d43/d46/l61 0 2021-11-03T16:54:46.317 INFO:tasks.workunit.client.1.smithi194.stdout:7/268: chown d6/da/d2b/f37 234169 1 2021-11-03T16:54:46.318 INFO:tasks.workunit.client.1.smithi194.stdout:7/269: write d6/da/f27 [3660241,5219] 0 2021-11-03T16:54:46.320 INFO:tasks.workunit.client.1.smithi194.stdout:7/270: rmdir d6/da/d2b 39 2021-11-03T16:54:46.321 INFO:tasks.workunit.client.1.smithi194.stdout:7/271: dread - d6/d43/d46/d4e/f5d zero size 2021-11-03T16:54:46.321 INFO:tasks.workunit.client.1.smithi194.stdout:7/272: write d6/d15/f28 [571629,117043] 0 2021-11-03T16:54:46.327 INFO:tasks.workunit.client.1.smithi194.stdout:7/273: dread d6/d15/f28 [0,4194304] 0 2021-11-03T16:54:46.333 INFO:tasks.workunit.client.1.smithi194.stdout:3/332: dwrite d2/f54 [0,4194304] 0 2021-11-03T16:54:46.334 INFO:tasks.workunit.client.1.smithi194.stdout:7/274: link d6/f2d d6/da/f62 0 2021-11-03T16:54:46.335 INFO:tasks.workunit.client.1.smithi194.stdout:7/275: stat d6/da/f10 0 2021-11-03T16:54:46.342 INFO:tasks.workunit.client.1.smithi194.stdout:7/276: rename d6/da/d2b/d56/l51 to d6/d4c/d54/d5b/l63 0 2021-11-03T16:54:46.342 INFO:tasks.workunit.client.1.smithi194.stdout:7/277: fsync d6/da/d2b/f4b 0 2021-11-03T16:54:46.343 INFO:tasks.workunit.client.1.smithi194.stdout:7/278: creat d6/d32/f64 x:0 0 0 2021-11-03T16:54:46.344 INFO:tasks.workunit.client.1.smithi194.stdout:7/279: write d6/da/d2b/f31 [1520471,128721] 0 2021-11-03T16:54:46.344 INFO:tasks.workunit.client.1.smithi194.stdout:7/280: truncate d6/d15/f1f 358092 0 2021-11-03T16:54:46.344 INFO:tasks.workunit.client.1.smithi194.stdout:7/281: dread - d6/d15/f40 zero size 2021-11-03T16:54:46.345 INFO:tasks.workunit.client.1.smithi194.stdout:7/282: truncate d6/da/f62 9083064 0 2021-11-03T16:54:46.346 INFO:tasks.workunit.client.1.smithi194.stdout:7/283: rename d6/da/f27 to d6/d43/d46/d4e/f65 0 2021-11-03T16:54:46.346 INFO:tasks.workunit.client.1.smithi194.stdout:7/284: chown d6/l1b 757 1 2021-11-03T16:54:46.347 INFO:tasks.workunit.client.1.smithi194.stdout:7/285: rename d6/d15/f28 to d6/da/d2b/f66 0 2021-11-03T16:54:46.349 INFO:tasks.workunit.client.1.smithi194.stdout:7/286: dread d6/f23 [0,4194304] 0 2021-11-03T16:54:46.350 INFO:tasks.workunit.client.1.smithi194.stdout:7/287: fsync d6/d43/f33 0 2021-11-03T16:54:46.362 INFO:tasks.workunit.client.1.smithi194.stdout:7/288: dwrite d6/d15/f40 [0,4194304] 0 2021-11-03T16:54:46.363 INFO:tasks.workunit.client.1.smithi194.stdout:7/289: readlink d6/da/d2b/l5c 0 2021-11-03T16:54:46.366 INFO:tasks.workunit.client.1.smithi194.stdout:7/290: link d6/ld d6/d4c/d54/d5b/l67 0 2021-11-03T16:54:46.381 INFO:tasks.workunit.client.1.smithi194.stdout:7/291: dwrite d6/f20 [0,4194304] 0 2021-11-03T16:54:46.383 INFO:tasks.workunit.client.1.smithi194.stdout:7/292: write d6/d43/f36 [2513686,50479] 0 2021-11-03T16:54:46.387 INFO:tasks.workunit.client.1.smithi194.stdout:7/293: creat d6/da/d2b/f68 x:0 0 0 2021-11-03T16:54:46.400 INFO:tasks.workunit.client.1.smithi194.stdout:7/294: dwrite d6/f23 [0,4194304] 0 2021-11-03T16:54:46.403 INFO:tasks.workunit.client.1.smithi194.stdout:7/295: rmdir d6/d4c 39 2021-11-03T16:54:46.403 INFO:tasks.workunit.client.1.smithi194.stdout:7/296: write d6/da/d2b/f53 [775340,84632] 0 2021-11-03T16:54:46.405 INFO:tasks.workunit.client.1.smithi194.stdout:7/297: creat d6/d43/d46/d60/f69 x:0 0 0 2021-11-03T16:54:46.406 INFO:tasks.workunit.client.1.smithi194.stdout:7/298: mknod d6/da/c6a 1 2021-11-03T16:54:46.406 INFO:tasks.workunit.client.1.smithi194.stdout:7/299: symlink d6/d15/l6b 0 2021-11-03T16:54:46.408 INFO:tasks.workunit.client.1.smithi194.stdout:7/300: symlink d6/d4c/d54/d5b/l6c 0 2021-11-03T16:54:46.408 INFO:tasks.workunit.client.1.smithi194.stdout:7/301: mknod d6/da/c6d 1 2021-11-03T16:54:46.409 INFO:tasks.workunit.client.1.smithi194.stdout:7/302: fdatasync d6/d43/f36 0 2021-11-03T16:54:46.424 INFO:tasks.workunit.client.1.smithi194.stdout:7/303: dwrite d6/f20 [0,4194304] 0 2021-11-03T16:54:46.425 INFO:tasks.workunit.client.1.smithi194.stdout:7/304: symlink d6/d32/l6e 0 2021-11-03T16:54:46.435 INFO:tasks.workunit.client.1.smithi194.stdout:8/308: sync 2021-11-03T16:54:46.455 INFO:tasks.workunit.client.1.smithi194.stdout:8/309: dwrite f5 [0,4194304] 0 2021-11-03T16:54:46.455 INFO:tasks.workunit.client.1.smithi194.stdout:8/310: stat d8/l4c 0 2021-11-03T16:54:46.456 INFO:tasks.workunit.client.1.smithi194.stdout:8/311: getdents d8 0 2021-11-03T16:54:46.463 INFO:tasks.workunit.client.1.smithi194.stdout:8/312: dread d8/f31 [0,4194304] 0 2021-11-03T16:54:46.463 INFO:tasks.workunit.client.1.smithi194.stdout:8/313: fsync d8/f31 0 2021-11-03T16:54:46.464 INFO:tasks.workunit.client.1.smithi194.stdout:8/314: write d8/fc [2274188,27901] 0 2021-11-03T16:54:46.464 INFO:tasks.workunit.client.1.smithi194.stdout:8/315: dread - d8/d33/d3e/d5d/d69/f6c zero size 2021-11-03T16:54:46.563 INFO:tasks.workunit.client.1.smithi194.stdout:0/129: sync 2021-11-03T16:54:46.620 INFO:tasks.workunit.client.1.smithi194.stdout:4/300: sync 2021-11-03T16:54:46.620 INFO:tasks.workunit.client.1.smithi194.stdout:0/130: fsync d5/d9/d22/f25 0 2021-11-03T16:54:46.623 INFO:tasks.workunit.client.1.smithi194.stdout:0/131: mkdir d5/d13/d21/d2b 0 2021-11-03T16:54:46.624 INFO:tasks.workunit.client.1.smithi194.stdout:0/132: chown d5/l1c 42420 1 2021-11-03T16:54:46.624 INFO:tasks.workunit.client.1.smithi194.stdout:0/133: dread - d5/d13/f1f zero size 2021-11-03T16:54:46.624 INFO:tasks.workunit.client.1.smithi194.stdout:0/134: unlink d5/d9/f18 0 2021-11-03T16:54:46.625 INFO:tasks.workunit.client.1.smithi194.stdout:0/135: mknod d5/d9/d22/c2c 1 2021-11-03T16:54:46.625 INFO:tasks.workunit.client.1.smithi194.stdout:0/136: read - d5/d13/f2a zero size 2021-11-03T16:54:46.625 INFO:tasks.workunit.client.1.smithi194.stdout:0/137: write d5/d9/fb [1822885,56284] 0 2021-11-03T16:54:46.626 INFO:tasks.workunit.client.1.smithi194.stdout:0/138: chown d5/f24 62109068 1 2021-11-03T16:54:46.626 INFO:tasks.workunit.client.1.smithi194.stdout:0/139: chown d5/l15 4641 1 2021-11-03T16:54:46.626 INFO:tasks.workunit.client.1.smithi194.stdout:4/301: dwrite d6/d8/d1a/d14/f36 [0,4194304] 0 2021-11-03T16:54:46.626 INFO:tasks.workunit.client.1.smithi194.stdout:4/302: truncate d6/d8/d40/f47 686991 0 2021-11-03T16:54:46.627 INFO:tasks.workunit.client.1.smithi194.stdout:0/140: dwrite d5/d13/f2a [0,4194304] 0 2021-11-03T16:54:46.627 INFO:tasks.workunit.client.1.smithi194.stdout:4/303: link d6/d8/d1a/l22 d6/d12/l5c 0 2021-11-03T16:54:46.627 INFO:tasks.workunit.client.1.smithi194.stdout:0/141: rename f3 to d5/d13/d21/d2b/f2d 0 2021-11-03T16:54:46.628 INFO:tasks.workunit.client.1.smithi194.stdout:4/304: creat d6/d8/d40/f5d x:0 0 0 2021-11-03T16:54:46.628 INFO:tasks.workunit.client.1.smithi194.stdout:0/142: rename d5/d13/f12 to d5/d13/f2e 0 2021-11-03T16:54:46.628 INFO:tasks.workunit.client.1.smithi194.stdout:0/143: creat d5/d9/f2f x:0 0 0 2021-11-03T16:54:46.628 INFO:tasks.workunit.client.1.smithi194.stdout:0/144: dread - d5/d9/f2f zero size 2021-11-03T16:54:46.629 INFO:tasks.workunit.client.1.smithi194.stdout:0/145: getdents d5 0 2021-11-03T16:54:46.629 INFO:tasks.workunit.client.1.smithi194.stdout:0/146: creat d5/d9/d22/f30 x:0 0 0 2021-11-03T16:54:46.629 INFO:tasks.workunit.client.1.smithi194.stdout:0/147: readlink d5/l15 0 2021-11-03T16:54:46.629 INFO:tasks.workunit.client.1.smithi194.stdout:0/148: mkdir d5/d9/d22/d31 0 2021-11-03T16:54:46.630 INFO:tasks.workunit.client.1.smithi194.stdout:0/149: mknod d5/d13/c32 1 2021-11-03T16:54:46.630 INFO:tasks.workunit.client.1.smithi194.stdout:0/150: truncate d5/d9/d22/f28 456692 0 2021-11-03T16:54:46.631 INFO:tasks.workunit.client.1.smithi194.stdout:0/151: write d5/d13/f2e [204197,15095] 0 2021-11-03T16:54:46.631 INFO:tasks.workunit.client.1.smithi194.stdout:4/305: dwrite d6/d12/d1e/f2e [0,4194304] 0 2021-11-03T16:54:46.632 INFO:tasks.workunit.client.1.smithi194.stdout:9/357: sync 2021-11-03T16:54:46.632 INFO:tasks.workunit.client.1.smithi194.stdout:9/358: fsync d19/d33/d6b/d30/d53/d68/f42 0 2021-11-03T16:54:46.632 INFO:tasks.workunit.client.1.smithi194.stdout:0/152: rmdir d5/d13 39 2021-11-03T16:54:46.633 INFO:tasks.workunit.client.1.smithi194.stdout:4/306: unlink d6/f35 0 2021-11-03T16:54:46.633 INFO:tasks.workunit.client.1.smithi194.stdout:9/359: dread d19/f25 [0,4194304] 0 2021-11-03T16:54:46.635 INFO:tasks.workunit.client.1.smithi194.stdout:4/307: dread d6/d8/d1a/d2b/f2c [0,4194304] 0 2021-11-03T16:54:46.635 INFO:tasks.workunit.client.1.smithi194.stdout:0/153: mkdir d5/d9/d22/d31/d33 0 2021-11-03T16:54:46.639 INFO:tasks.workunit.client.1.smithi194.stdout:9/360: creat d19/d33/d6b/d30/d53/d68/d52/f7d x:0 0 0 2021-11-03T16:54:46.640 INFO:tasks.workunit.client.1.smithi194.stdout:4/308: creat d6/d12/f5e x:0 0 0 2021-11-03T16:54:46.642 INFO:tasks.workunit.client.1.smithi194.stdout:0/154: rename d5/d9/f2f to d5/d9/d22/d31/f34 0 2021-11-03T16:54:46.645 INFO:tasks.workunit.client.1.smithi194.stdout:0/155: link d5/d13/f2a d5/d13/d21/d2b/f35 0 2021-11-03T16:54:46.646 INFO:tasks.workunit.client.1.smithi194.stdout:0/156: stat d5 0 2021-11-03T16:54:46.646 INFO:tasks.workunit.client.1.smithi194.stdout:0/157: write d5/d9/d22/d31/f34 [723786,37914] 0 2021-11-03T16:54:46.646 INFO:tasks.workunit.client.1.smithi194.stdout:0/158: chown d5/l1b 0 1 2021-11-03T16:54:46.647 INFO:tasks.workunit.client.1.smithi194.stdout:0/159: chown d5/f24 308654 1 2021-11-03T16:54:46.647 INFO:tasks.workunit.client.1.smithi194.stdout:9/361: dread d19/d33/d6b/f46 [0,4194304] 0 2021-11-03T16:54:46.647 INFO:tasks.workunit.client.1.smithi194.stdout:0/160: creat d5/d13/d21/d2b/f36 x:0 0 0 2021-11-03T16:54:46.649 INFO:tasks.workunit.client.1.smithi194.stdout:9/362: creat d19/d33/d6b/d30/d53/d68/d4e/d54/d5d/f7e x:0 0 0 2021-11-03T16:54:46.651 INFO:tasks.workunit.client.1.smithi194.stdout:0/161: creat d5/f37 x:0 0 0 2021-11-03T16:54:46.651 INFO:tasks.workunit.client.1.smithi194.stdout:9/363: write d19/d33/d6b/d30/f45 [4102340,13385] 0 2021-11-03T16:54:46.652 INFO:tasks.workunit.client.1.smithi194.stdout:0/162: creat d5/d9/d22/f38 x:0 0 0 2021-11-03T16:54:46.652 INFO:tasks.workunit.client.1.smithi194.stdout:0/163: write d5/d13/f2a [3420343,4022] 0 2021-11-03T16:54:46.654 INFO:tasks.workunit.client.1.smithi194.stdout:0/164: creat d5/d13/d21/d2b/f39 x:0 0 0 2021-11-03T16:54:46.655 INFO:tasks.workunit.client.1.smithi194.stdout:0/165: creat d5/d9/d22/d31/f3a x:0 0 0 2021-11-03T16:54:46.666 INFO:tasks.workunit.client.1.smithi194.stdout:9/364: getdents d19/d33/d6b/d30/d53/d68/d4e/d54/d5d 0 2021-11-03T16:54:46.666 INFO:tasks.workunit.client.1.smithi194.stdout:9/365: chown d19/d33/d6b/d30/d53/d68/d4e/d54/d5d/f69 0 1 2021-11-03T16:54:46.682 INFO:tasks.workunit.client.1.smithi194.stdout:9/366: dwrite d19/d33/d6b/f4c [0,4194304] 0 2021-11-03T16:54:46.682 INFO:tasks.workunit.client.1.smithi194.stdout:9/367: read d19/f25 [2857524,46608] 0 2021-11-03T16:54:46.684 INFO:tasks.workunit.client.1.smithi194.stdout:9/368: creat d19/d33/d6b/d30/d53/d68/d4e/d54/f7f x:0 0 0 2021-11-03T16:54:46.684 INFO:tasks.workunit.client.1.smithi194.stdout:9/369: read - d19/d50/f56 zero size 2021-11-03T16:54:46.697 INFO:tasks.workunit.client.1.smithi194.stdout:9/370: dwrite d19/d50/d60/f6a [0,4194304] 0 2021-11-03T16:54:46.702 INFO:tasks.workunit.client.1.smithi194.stdout:9/371: link l7 d19/d33/d6b/d30/d53/d68/d4e/l80 0 2021-11-03T16:54:46.703 INFO:tasks.workunit.client.1.smithi194.stdout:9/372: truncate fb 2305643 0 2021-11-03T16:54:46.703 INFO:tasks.workunit.client.1.smithi194.stdout:9/373: read d19/d33/d6b/d30/d53/d68/f44 [469516,78613] 0 2021-11-03T16:54:46.705 INFO:tasks.workunit.client.1.smithi194.stdout:9/374: symlink d19/d33/d6b/d30/l81 0 2021-11-03T16:54:46.854 INFO:tasks.workunit.client.1.smithi194.stdout:6/372: sync 2021-11-03T16:54:46.855 INFO:tasks.workunit.client.1.smithi194.stdout:6/373: getdents de/d21/d41/d65 0 2021-11-03T16:54:46.857 INFO:tasks.workunit.client.1.smithi194.stdout:6/374: creat de/d1f/d70/f7c x:0 0 0 2021-11-03T16:54:46.866 INFO:tasks.workunit.client.1.smithi194.stdout:6/375: dread f9 [0,4194304] 0 2021-11-03T16:54:46.868 INFO:tasks.workunit.client.1.smithi194.stdout:6/376: link de/d21/d41/f4c de/d1f/d43/f7d 0 2021-11-03T16:54:46.869 INFO:tasks.workunit.client.1.smithi194.stdout:6/377: mknod de/d21/d51/c7e 1 2021-11-03T16:54:46.870 INFO:tasks.workunit.client.1.smithi194.stdout:6/378: symlink de/d1f/d43/d55/d74/l7f 0 2021-11-03T16:54:46.871 INFO:tasks.workunit.client.1.smithi194.stdout:6/379: creat de/d21/d41/f80 x:0 0 0 2021-11-03T16:54:46.872 INFO:tasks.workunit.client.1.smithi194.stdout:6/380: rmdir de/d21 39 2021-11-03T16:54:46.872 INFO:tasks.workunit.client.1.smithi194.stdout:6/381: truncate de/d21/d41/f4c 4888994 0 2021-11-03T16:54:46.873 INFO:tasks.workunit.client.1.smithi194.stdout:6/382: read de/d21/d61/d6f/f48 [2440054,113855] 0 2021-11-03T16:54:46.874 INFO:tasks.workunit.client.1.smithi194.stdout:6/383: symlink de/d21/d41/d65/l81 0 2021-11-03T16:54:46.874 INFO:tasks.workunit.client.1.smithi194.stdout:6/384: truncate de/d1f/d32/f75 346968 0 2021-11-03T16:54:46.882 INFO:tasks.workunit.client.1.smithi194.stdout:6/385: dread de/f10 [4194304,4194304] 0 2021-11-03T16:54:46.883 INFO:tasks.workunit.client.1.smithi194.stdout:6/386: symlink de/d1f/d43/d55/d74/l82 0 2021-11-03T16:54:46.885 INFO:tasks.workunit.client.1.smithi194.stdout:6/387: mkdir de/d21/d61/d6f/d83 0 2021-11-03T16:54:46.886 INFO:tasks.workunit.client.1.smithi194.stdout:6/388: creat de/d21/d51/f84 x:0 0 0 2021-11-03T16:54:46.887 INFO:tasks.workunit.client.1.smithi194.stdout:6/389: mknod de/d1f/d43/c85 1 2021-11-03T16:54:46.887 INFO:tasks.workunit.client.1.smithi194.stdout:6/390: stat de/d1f/d43/d55 0 2021-11-03T16:54:46.889 INFO:tasks.workunit.client.1.smithi194.stdout:6/391: link de/d21/l35 de/d21/d51/l86 0 2021-11-03T16:54:46.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:46 smithi026 conmon[32119]: audit 2021-11-03T16:54:45. 2021-11-03T16:54:46.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:46 smithi026 conmon[32119]: 583177+0000 mon.smithi026 (mon.0) 566 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:54:46.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:46 smithi026 conmon[32119]: audit 2021-11-03T16:54:45.956527+0000 mon.smithi026 (mon.0) 567 : audit 2021-11-03T16:54:46.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:46 smithi026 conmon[32119]: [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:54:46.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:46 smithi026 conmon[32119]: audit 2021-11-03T16:54:45 2021-11-03T16:54:46.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:46 smithi026 conmon[32119]: .963835+0000 mon.smithi026 (mon.0) 568 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:54:46.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:46 smithi026 conmon[32119]: cephadm 2021-11-03T16:54:45.966133 2021-11-03T16:54:46.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:46 smithi026 conmon[32119]: +0000 mgr.smithi026.cnrxli (mgr.14162) 317 : cephadm [INF] 2021-11-03T16:54:46.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:46 smithi026 conmon[32119]: Upgrade: Need to upgrade myself (mgr.smithi026.cnrxli) 2021-11-03T16:54:46.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:46 smithi026 conmon[32119]: cephadm 2021-11-03T16:54:46.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:46 smithi026 conmon[32119]: 2021-11-03T16:54:45.969681+0000 mgr.smithi026.cnrxli (mgr.14162) 318 : cephadm 2021-11-03T16:54:46.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:46 smithi026 conmon[32119]: [INF] Failing over to other MGR 2021-11-03T16:54:46.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:46 smithi026 conmon[32119]: audit 2021 2021-11-03T16:54:46.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:46 smithi026 conmon[32119]: -11-03T16:54:45.970212+0000 mon.smithi026 (mon. 2021-11-03T16:54:46.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:46 smithi026 conmon[32119]: 0) 569 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mgr fail", "who": "smithi026.cnrxli"}]: dispatch 2021-11-03T16:54:46.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:46 smithi026 conmon[32119]: cluster 2021-11-03T16:54:45.984249 2021-11-03T16:54:46.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:46 smithi026 conmon[32119]: +0000 mon.smithi026 (mon.0) 570 : cluster [DBG] osdmap e43: 6 total, 6 up, 6 in 2021-11-03T16:54:46.979 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:46 smithi194 conmon[35111]: audit 2021-11-03T16:54:45.583177+0000 mon.smithi026 (mon.0) 566 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:54:46.979 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:46 smithi194 conmon[35111]: audit 2021-11-03T16:54:45.956527+0000 mon.smithi026 (mon.0) 567 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' 2021-11-03T16:54:46.980 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:46 smithi194 conmon[35111]: audit 2021-11-03T16:54:45.963835+0000 mon.smithi026 (mon.0) 568 : audit [DBG] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:54:46.980 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:46 smithi194 conmon[35111]: cephadm 2021-11-03T16:54:45.966133+0000 mgr.smithi026.cnrxli (mgr.14162) 317 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi026.cnrxli) 2021-11-03T16:54:46.981 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:46 smithi194 conmon[35111]: cephadm 2021-11-03T16:54:45.969681+0000 mgr.smithi026.cnrxli (mgr.14162) 318 : cephadm [INF] Failing over to other MGR 2021-11-03T16:54:46.981 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:46 smithi194 conmon[35111]: audit 2021-11-03T16:54:45.970212+0000 mon.smithi026 (mon.0) 569 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mgr fail", "who": "smithi026.cnrxli"}]: dispatch 2021-11-03T16:54:46.982 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:46 smithi194 conmon[35111]: cluster 2021-11-03T16:54:45.984249+0000 mon.smithi026 (mon.0) 570 : cluster [DBG] osdmap e43: 6 total, 6 up, 6 in 2021-11-03T16:54:47.081 INFO:tasks.workunit.client.1.smithi194.stdout:2/392: sync 2021-11-03T16:54:47.081 INFO:tasks.workunit.client.1.smithi194.stdout:1/213: sync 2021-11-03T16:54:47.083 INFO:tasks.workunit.client.1.smithi194.stdout:2/393: symlink d6/d21/d2a/d35/d3c/l78 0 2021-11-03T16:54:47.084 INFO:tasks.workunit.client.1.smithi194.stdout:2/394: stat d6/de/d11/l54 0 2021-11-03T16:54:47.084 INFO:tasks.workunit.client.1.smithi194.stdout:1/214: dread d2/d1e/d23/f29 [0,4194304] 0 2021-11-03T16:54:47.084 INFO:tasks.workunit.client.1.smithi194.stdout:2/395: write d6/de/d16/f50 [1597732,80435] 0 2021-11-03T16:54:47.085 INFO:tasks.workunit.client.1.smithi194.stdout:2/396: chown d6/d1f/f2e 125 1 2021-11-03T16:54:47.085 INFO:tasks.workunit.client.1.smithi194.stdout:1/215: symlink d2/da/l42 0 2021-11-03T16:54:47.086 INFO:tasks.workunit.client.1.smithi194.stdout:1/216: chown d2/f6 10630325 1 2021-11-03T16:54:47.086 INFO:tasks.workunit.client.1.smithi194.stdout:2/397: creat d6/de/d16/d62/f79 x:0 0 0 2021-11-03T16:54:47.088 INFO:tasks.workunit.client.1.smithi194.stdout:1/217: creat d2/da/d2b/f43 x:0 0 0 2021-11-03T16:54:47.088 INFO:tasks.workunit.client.1.smithi194.stdout:2/398: creat d6/d21/f7a x:0 0 0 2021-11-03T16:54:47.090 INFO:tasks.workunit.client.1.smithi194.stdout:1/218: truncate d2/da/f2a 8092613 0 2021-11-03T16:54:47.090 INFO:tasks.workunit.client.1.smithi194.stdout:2/399: write d6/f44 [5715093,114591] 0 2021-11-03T16:54:47.090 INFO:tasks.workunit.client.1.smithi194.stdout:2/400: stat d6/d21/d2a/l72 0 2021-11-03T16:54:47.091 INFO:tasks.workunit.client.1.smithi194.stdout:2/401: getdents d6/d17/d26/d63 0 2021-11-03T16:54:47.091 INFO:tasks.workunit.client.1.smithi194.stdout:2/402: chown d6/de/d27/f4f 18065 1 2021-11-03T16:54:47.093 INFO:tasks.workunit.client.1.smithi194.stdout:1/219: unlink d2/f1c 0 2021-11-03T16:54:47.094 INFO:tasks.workunit.client.1.smithi194.stdout:1/220: truncate d2/da/d13/f14 5012390 0 2021-11-03T16:54:47.097 INFO:tasks.workunit.client.1.smithi194.stdout:2/403: mkdir d6/d7b 0 2021-11-03T16:54:47.098 INFO:tasks.workunit.client.1.smithi194.stdout:2/404: readlink d6/d17/l1b 0 2021-11-03T16:54:47.117 INFO:tasks.workunit.client.1.smithi194.stdout:2/405: dwrite d6/d1f/f39 [0,4194304] 0 2021-11-03T16:54:47.121 INFO:tasks.workunit.client.1.smithi194.stdout:2/406: symlink d6/d21/d2a/l7c 0 2021-11-03T16:54:47.121 INFO:tasks.workunit.client.1.smithi194.stdout:2/407: chown d6/fd 0 1 2021-11-03T16:54:47.121 INFO:tasks.workunit.client.1.smithi194.stdout:2/408: dread - d6/d21/f7a zero size 2021-11-03T16:54:47.140 INFO:tasks.workunit.client.1.smithi194.stdout:2/409: dwrite d6/de/d27/f5a [0,4194304] 0 2021-11-03T16:54:47.141 INFO:tasks.workunit.client.1.smithi194.stdout:2/410: mknod d6/d17/d68/c7d 1 2021-11-03T16:54:47.154 INFO:tasks.workunit.client.1.smithi194.stdout:2/411: dwrite d6/f48 [0,4194304] 0 2021-11-03T16:54:47.158 INFO:tasks.workunit.client.1.smithi194.stdout:2/412: truncate d6/d21/f3b 51381 0 2021-11-03T16:54:47.158 INFO:tasks.workunit.client.1.smithi194.stdout:2/413: mknod d6/de/d16/d20/c7e 1 2021-11-03T16:54:47.160 INFO:tasks.workunit.client.1.smithi194.stdout:2/414: creat d6/d21/d2a/d31/f7f x:0 0 0 2021-11-03T16:54:47.175 INFO:tasks.workunit.client.1.smithi194.stdout:2/415: dwrite d6/d21/d2a/d31/f3d [0,4194304] 0 2021-11-03T16:54:47.179 INFO:tasks.workunit.client.1.smithi194.stdout:2/416: unlink d6/d1f/l47 0 2021-11-03T16:54:47.196 INFO:tasks.workunit.client.1.smithi194.stdout:2/417: dwrite d6/de/f57 [0,4194304] 0 2021-11-03T16:54:47.212 INFO:tasks.workunit.client.1.smithi194.stdout:2/418: dwrite d6/f7 [0,4194304] 0 2021-11-03T16:54:47.213 INFO:tasks.workunit.client.1.smithi194.stdout:2/419: write d6/fd [4468188,130348] 0 2021-11-03T16:54:47.229 INFO:tasks.workunit.client.1.smithi194.stdout:2/420: dwrite d6/d21/f5f [4194304,4194304] 0 2021-11-03T16:54:47.230 INFO:tasks.workunit.client.1.smithi194.stdout:2/421: mknod d6/d21/d2a/d31/c80 1 2021-11-03T16:54:47.232 INFO:tasks.workunit.client.1.smithi194.stdout:2/422: symlink d6/d1f/d4c/d6e/l81 0 2021-11-03T16:54:47.232 INFO:tasks.workunit.client.1.smithi194.stdout:2/423: chown l3 248372180 1 2021-11-03T16:54:47.233 INFO:tasks.workunit.client.1.smithi194.stdout:2/424: readlink d6/d1f/d4c/d6e/l81 0 2021-11-03T16:54:47.233 INFO:tasks.workunit.client.1.smithi194.stdout:2/425: readlink d6/d1f/d4c/d6e/l81 0 2021-11-03T16:54:47.235 INFO:tasks.workunit.client.1.smithi194.stdout:2/426: unlink d6/f44 0 2021-11-03T16:54:47.245 INFO:tasks.workunit.client.1.smithi194.stdout:2/427: dread d6/de/d16/f50 [0,4194304] 0 2021-11-03T16:54:47.248 INFO:tasks.workunit.client.1.smithi194.stdout:2/428: mkdir d6/de/d16/d20/d82 0 2021-11-03T16:54:47.499 INFO:tasks.workunit.client.1.smithi194.stdout:5/292: sync 2021-11-03T16:54:47.499 INFO:tasks.workunit.client.1.smithi194.stdout:3/333: sync 2021-11-03T16:54:47.499 INFO:tasks.workunit.client.1.smithi194.stdout:3/334: write d2/d17/d1d/f6b [886622,113079] 0 2021-11-03T16:54:47.500 INFO:tasks.workunit.client.0.smithi026.stdout:5/37: sync 2021-11-03T16:54:47.500 INFO:tasks.workunit.client.0.smithi026.stdout:6/79: sync 2021-11-03T16:54:47.501 INFO:tasks.workunit.client.0.smithi026.stdout:1/116: sync 2021-11-03T16:54:47.501 INFO:tasks.workunit.client.0.smithi026.stdout:0/57: sync 2021-11-03T16:54:47.501 INFO:tasks.workunit.client.0.smithi026.stdout:6/80: chown d5/f1d 0 1 2021-11-03T16:54:47.502 INFO:tasks.workunit.client.0.smithi026.stdout:5/38: mkdir d3/da 0 2021-11-03T16:54:47.504 INFO:tasks.workunit.client.0.smithi026.stdout:1/117: link dc/f22 dc/df/d11/f2a 0 2021-11-03T16:54:47.504 INFO:tasks.workunit.client.0.smithi026.stdout:1/118: mknod dc/df/c2b 1 2021-11-03T16:54:47.507 INFO:tasks.workunit.client.1.smithi194.stdout:5/293: link d2/d2a/l49 d2/l6a 0 2021-11-03T16:54:47.509 INFO:tasks.workunit.client.0.smithi026.stdout:5/39: read d3/f9 [2459476,104026] 0 2021-11-03T16:54:47.510 INFO:tasks.workunit.client.0.smithi026.stdout:6/81: rename d5/d9/ff to d5/dd/f1e 0 2021-11-03T16:54:47.511 INFO:tasks.workunit.client.1.smithi194.stdout:5/294: creat d2/d3/d57/f6b x:0 0 0 2021-11-03T16:54:47.512 INFO:tasks.workunit.client.0.smithi026.stdout:1/119: read dc/df/d11/f14 [3428937,48501] 0 2021-11-03T16:54:47.512 INFO:tasks.workunit.client.0.smithi026.stdout:5/40: mkdir d3/da/db 0 2021-11-03T16:54:47.512 INFO:tasks.workunit.client.0.smithi026.stdout:5/41: chown d3/f6 63 1 2021-11-03T16:54:47.513 INFO:tasks.workunit.client.0.smithi026.stdout:1/120: getdents dc 0 2021-11-03T16:54:47.513 INFO:tasks.workunit.client.0.smithi026.stdout:1/121: dread - dc/df/d11/f27 zero size 2021-11-03T16:54:47.516 INFO:tasks.workunit.client.0.smithi026.stdout:5/42: rename d3/f7 to d3/da/fc 0 2021-11-03T16:54:47.518 INFO:tasks.workunit.client.0.smithi026.stdout:1/122: rename dc/df/d11/f21 to dc/d28/d29/f2c 0 2021-11-03T16:54:47.520 INFO:tasks.workunit.client.0.smithi026.stdout:5/43: unlink d3/f9 0 2021-11-03T16:54:47.521 INFO:tasks.workunit.client.1.smithi194.stdout:3/335: dwrite d2/d20/d36/d4e/f61 [0,4194304] 0 2021-11-03T16:54:47.522 INFO:tasks.workunit.client.0.smithi026.stdout:1/123: symlink dc/df/l2d 0 2021-11-03T16:54:47.523 INFO:tasks.workunit.client.0.smithi026.stdout:1/124: truncate dc/df/f20 4668424 0 2021-11-03T16:54:47.526 INFO:tasks.workunit.client.1.smithi194.stdout:3/336: write d2/f13 [6765043,8328] 0 2021-11-03T16:54:47.528 INFO:tasks.workunit.client.0.smithi026.stdout:1/125: creat dc/d28/f2e x:0 0 0 2021-11-03T16:54:47.528 INFO:tasks.workunit.client.0.smithi026.stdout:0/58: dwrite da/fd [0,4194304] 0 2021-11-03T16:54:47.530 INFO:tasks.workunit.client.1.smithi194.stdout:5/295: dwrite d2/dd/d35/f54 [0,4194304] 0 2021-11-03T16:54:47.534 INFO:tasks.workunit.client.1.smithi194.stdout:5/296: read d2/dd/f1b [3261768,105399] 0 2021-11-03T16:54:47.534 INFO:tasks.workunit.client.0.smithi026.stdout:0/59: creat da/d10/f14 x:0 0 0 2021-11-03T16:54:47.535 INFO:tasks.workunit.client.0.smithi026.stdout:0/60: write da/d10/f14 [660212,9012] 0 2021-11-03T16:54:47.535 INFO:tasks.workunit.client.0.smithi026.stdout:0/61: chown da 25 1 2021-11-03T16:54:47.538 INFO:tasks.workunit.client.1.smithi194.stdout:5/297: creat d2/dd/d35/f6c x:0 0 0 2021-11-03T16:54:47.538 INFO:tasks.workunit.client.1.smithi194.stdout:5/298: truncate d2/f23 1368952 0 2021-11-03T16:54:47.539 INFO:tasks.workunit.client.1.smithi194.stdout:5/299: dread - d2/f44 zero size 2021-11-03T16:54:47.539 INFO:tasks.workunit.client.1.smithi194.stdout:5/300: write d2/dd/f14 [2501767,32026] 0 2021-11-03T16:54:47.539 INFO:tasks.workunit.client.1.smithi194.stdout:5/301: write d2/d2a/f5a [528180,71555] 0 2021-11-03T16:54:47.545 INFO:tasks.workunit.client.1.smithi194.stdout:5/302: symlink d2/dd/d35/l6d 0 2021-11-03T16:54:47.546 INFO:tasks.workunit.client.1.smithi194.stdout:5/303: creat d2/d59/f6e x:0 0 0 2021-11-03T16:54:47.547 INFO:tasks.workunit.client.0.smithi026.stdout:5/44: dwrite d3/f6 [0,4194304] 0 2021-11-03T16:54:47.548 INFO:tasks.workunit.client.1.smithi194.stdout:3/337: dwrite d2/d20/f59 [0,4194304] 0 2021-11-03T16:54:47.548 INFO:tasks.workunit.client.0.smithi026.stdout:1/126: dwrite dc/f1d [4194304,4194304] 0 2021-11-03T16:54:47.549 INFO:tasks.workunit.client.1.smithi194.stdout:5/304: creat d2/dd/d5e/f6f x:0 0 0 2021-11-03T16:54:47.553 INFO:tasks.workunit.client.0.smithi026.stdout:5/45: dread d3/da/fc [0,4194304] 0 2021-11-03T16:54:47.553 INFO:tasks.workunit.client.0.smithi026.stdout:5/46: mknod d3/cd 1 2021-11-03T16:54:47.563 INFO:tasks.workunit.client.0.smithi026.stdout:5/47: mkdir d3/de 0 2021-11-03T16:54:47.564 INFO:tasks.workunit.client.0.smithi026.stdout:1/127: dread f1 [4194304,4194304] 0 2021-11-03T16:54:47.564 INFO:tasks.workunit.client.0.smithi026.stdout:5/48: link d3/da/fc d3/da/ff 0 2021-11-03T16:54:47.565 INFO:tasks.workunit.client.0.smithi026.stdout:5/49: readlink - no filename 2021-11-03T16:54:47.566 INFO:tasks.workunit.client.0.smithi026.stdout:5/50: creat d3/f10 x:0 0 0 2021-11-03T16:54:47.566 INFO:tasks.workunit.client.0.smithi026.stdout:5/51: chown d3/da/db 470 1 2021-11-03T16:54:47.567 INFO:tasks.workunit.client.0.smithi026.stdout:5/52: rename d3 to d3/de/d11 22 2021-11-03T16:54:47.567 INFO:tasks.workunit.client.0.smithi026.stdout:5/53: chown d3/f6 7 1 2021-11-03T16:54:47.568 INFO:tasks.workunit.client.0.smithi026.stdout:5/54: creat d3/de/f12 x:0 0 0 2021-11-03T16:54:47.568 INFO:tasks.workunit.client.0.smithi026.stdout:5/55: chown d3/de 52562388 1 2021-11-03T16:54:47.568 INFO:tasks.workunit.client.0.smithi026.stdout:5/56: mknod d3/de/c13 1 2021-11-03T16:54:47.569 INFO:tasks.workunit.client.1.smithi194.stdout:3/338: dwrite d2/d20/d36/d51/f56 [0,4194304] 0 2021-11-03T16:54:47.570 INFO:tasks.workunit.client.1.smithi194.stdout:5/305: dwrite d2/d2a/d39/f3e [0,4194304] 0 2021-11-03T16:54:47.570 INFO:tasks.workunit.client.0.smithi026.stdout:5/57: symlink d3/da/l14 0 2021-11-03T16:54:47.571 INFO:tasks.workunit.client.0.smithi026.stdout:5/58: dread - d3/f10 zero size 2021-11-03T16:54:47.571 INFO:tasks.workunit.client.0.smithi026.stdout:5/59: dread - d3/de/f12 zero size 2021-11-03T16:54:47.573 INFO:tasks.workunit.client.0.smithi026.stdout:1/128: dread dc/f1d [0,4194304] 0 2021-11-03T16:54:47.573 INFO:tasks.workunit.client.1.smithi194.stdout:7/305: sync 2021-11-03T16:54:47.574 INFO:tasks.workunit.client.1.smithi194.stdout:8/316: sync 2021-11-03T16:54:47.574 INFO:tasks.workunit.client.1.smithi194.stdout:3/339: creat d2/d20/d36/d51/f6f x:0 0 0 2021-11-03T16:54:47.574 INFO:tasks.workunit.client.1.smithi194.stdout:7/306: write d6/f2f [7889,79982] 0 2021-11-03T16:54:47.576 INFO:tasks.workunit.client.1.smithi194.stdout:7/307: dread d6/d43/f33 [0,4194304] 0 2021-11-03T16:54:47.578 INFO:tasks.workunit.client.0.smithi026.stdout:1/129: creat dc/f2f x:0 0 0 2021-11-03T16:54:47.578 INFO:tasks.workunit.client.0.smithi026.stdout:1/130: chown dc/df/l2d 0 1 2021-11-03T16:54:47.579 INFO:tasks.workunit.client.1.smithi194.stdout:5/306: mkdir d2/dd/d70 0 2021-11-03T16:54:47.580 INFO:tasks.workunit.client.1.smithi194.stdout:5/307: write d2/d59/f6e [324314,71526] 0 2021-11-03T16:54:47.580 INFO:tasks.workunit.client.1.smithi194.stdout:5/308: write d2/dd/f16 [4186660,79676] 0 2021-11-03T16:54:47.581 INFO:tasks.workunit.client.1.smithi194.stdout:5/309: mknod d2/dd/d70/c71 1 2021-11-03T16:54:47.581 INFO:tasks.workunit.client.1.smithi194.stdout:5/310: chown d2/dd/f3c 0 1 2021-11-03T16:54:47.581 INFO:tasks.workunit.client.1.smithi194.stdout:5/311: write d2/dd/d35/d38/f60 [1063369,112575] 0 2021-11-03T16:54:47.581 INFO:tasks.workunit.client.1.smithi194.stdout:5/312: mknod d2/dd/d35/d38/c72 1 2021-11-03T16:54:47.582 INFO:tasks.workunit.client.1.smithi194.stdout:5/313: write d2/dd/f20 [3717297,12340] 0 2021-11-03T16:54:47.583 INFO:tasks.workunit.client.0.smithi026.stdout:5/60: rmdir d3/de 39 2021-11-03T16:54:47.585 INFO:tasks.workunit.client.0.smithi026.stdout:1/131: unlink dc/f22 0 2021-11-03T16:54:47.588 INFO:tasks.workunit.client.1.smithi194.stdout:5/314: dread d2/d3/f22 [4194304,4194304] 0 2021-11-03T16:54:47.589 INFO:tasks.workunit.client.1.smithi194.stdout:8/317: rename d8/d24/f29 to d8/d33/d51/f77 0 2021-11-03T16:54:47.590 INFO:tasks.workunit.client.1.smithi194.stdout:3/340: getdents d2/d20 0 2021-11-03T16:54:47.590 INFO:tasks.workunit.client.1.smithi194.stdout:3/341: write d2/d17/f2e [390373,29455] 0 2021-11-03T16:54:47.590 INFO:tasks.workunit.client.1.smithi194.stdout:3/342: mknod d2/d20/d36/d60/c70 1 2021-11-03T16:54:47.590 INFO:tasks.workunit.client.1.smithi194.stdout:3/343: dread - d2/d20/f3b zero size 2021-11-03T16:54:47.591 INFO:tasks.workunit.client.0.smithi026.stdout:1/132: rmdir dc/d28/d29 39 2021-11-03T16:54:47.591 INFO:tasks.workunit.client.0.smithi026.stdout:1/133: mknod dc/df/d11/c30 1 2021-11-03T16:54:47.592 INFO:tasks.workunit.client.1.smithi194.stdout:7/308: truncate d6/f23 1232886 0 2021-11-03T16:54:47.592 INFO:tasks.workunit.client.0.smithi026.stdout:5/61: dread d3/f6 [0,4194304] 0 2021-11-03T16:54:47.593 INFO:tasks.workunit.client.0.smithi026.stdout:1/134: mkdir dc/df/d31 0 2021-11-03T16:54:47.594 INFO:tasks.workunit.client.0.smithi026.stdout:1/135: chown f9 359149 1 2021-11-03T16:54:47.594 INFO:tasks.workunit.client.0.smithi026.stdout:1/136: dread - dc/df/d11/f27 zero size 2021-11-03T16:54:47.596 INFO:tasks.workunit.client.0.smithi026.stdout:5/62: unlink d3/de/f12 0 2021-11-03T16:54:47.598 INFO:tasks.workunit.client.1.smithi194.stdout:5/315: link d2/dd/d35/f54 d2/dd/d70/f73 0 2021-11-03T16:54:47.605 INFO:tasks.workunit.client.0.smithi026.stdout:1/137: dread f9 [0,4194304] 0 2021-11-03T16:54:47.605 INFO:tasks.workunit.client.0.smithi026.stdout:1/138: mknod dc/c32 1 2021-11-03T16:54:47.606 INFO:tasks.workunit.client.0.smithi026.stdout:1/139: mknod dc/d28/c33 1 2021-11-03T16:54:47.607 INFO:tasks.workunit.client.1.smithi194.stdout:8/318: unlink d8/f10 0 2021-11-03T16:54:47.607 INFO:tasks.workunit.client.1.smithi194.stdout:8/319: read d8/ff [1021948,69908] 0 2021-11-03T16:54:47.607 INFO:tasks.workunit.client.1.smithi194.stdout:3/344: mkdir d2/d33/d71 0 2021-11-03T16:54:47.609 INFO:tasks.workunit.client.0.smithi026.stdout:1/140: write dc/df/d11/f14 [4085704,41135] 0 2021-11-03T16:54:47.609 INFO:tasks.workunit.client.0.smithi026.stdout:1/141: mknod dc/d28/d29/c34 1 2021-11-03T16:54:47.609 INFO:tasks.workunit.client.0.smithi026.stdout:1/142: chown dc/d28 897888 1 2021-11-03T16:54:47.610 INFO:tasks.workunit.client.1.smithi194.stdout:7/309: link d6/ld d6/d43/d46/l6f 0 2021-11-03T16:54:47.611 INFO:tasks.workunit.client.1.smithi194.stdout:7/310: chown d6/d32 268279 1 2021-11-03T16:54:47.611 INFO:tasks.workunit.client.1.smithi194.stdout:5/316: creat d2/d59/f74 x:0 0 0 2021-11-03T16:54:47.612 INFO:tasks.workunit.client.1.smithi194.stdout:7/311: dread d6/da/d2b/f66 [0,4194304] 0 2021-11-03T16:54:47.612 INFO:tasks.workunit.client.1.smithi194.stdout:7/312: read - d6/da/d2b/f4b zero size 2021-11-03T16:54:47.617 INFO:tasks.workunit.client.1.smithi194.stdout:8/320: dread d8/d33/d3e/f44 [0,4194304] 0 2021-11-03T16:54:47.617 INFO:tasks.workunit.client.1.smithi194.stdout:8/321: readlink d8/l4c 0 2021-11-03T16:54:47.618 INFO:tasks.workunit.client.1.smithi194.stdout:5/317: write d2/dd/f20 [37512,58937] 0 2021-11-03T16:54:47.619 INFO:tasks.workunit.client.1.smithi194.stdout:3/345: dread d2/d33/f50 [0,4194304] 0 2021-11-03T16:54:47.619 INFO:tasks.workunit.client.1.smithi194.stdout:3/346: readlink d2/d20/d36/d43/l4b 0 2021-11-03T16:54:47.620 INFO:tasks.workunit.client.1.smithi194.stdout:3/347: write d2/d17/d1d/f6b [1535012,49984] 0 2021-11-03T16:54:47.620 INFO:tasks.workunit.client.1.smithi194.stdout:3/348: fsync d2/d20/d36/d4e/f62 0 2021-11-03T16:54:47.620 INFO:tasks.workunit.client.1.smithi194.stdout:3/349: chown d2/f4 187638 1 2021-11-03T16:54:47.624 INFO:tasks.workunit.client.1.smithi194.stdout:8/322: rename d8/f13 to d8/d35/d42/f78 0 2021-11-03T16:54:47.628 INFO:tasks.workunit.client.1.smithi194.stdout:5/318: rmdir d2/dd 39 2021-11-03T16:54:47.628 INFO:tasks.workunit.client.1.smithi194.stdout:5/319: write d2/d3/d57/f6b [383793,127630] 0 2021-11-03T16:54:47.629 INFO:tasks.workunit.client.1.smithi194.stdout:7/313: dwrite d6/da/f5a [0,4194304] 0 2021-11-03T16:54:47.631 INFO:tasks.workunit.client.1.smithi194.stdout:5/320: symlink d2/dd/d70/l75 0 2021-11-03T16:54:47.631 INFO:tasks.workunit.client.1.smithi194.stdout:5/321: readlink d2/dd/d35/l37 0 2021-11-03T16:54:47.632 INFO:tasks.workunit.client.1.smithi194.stdout:5/322: readlink d2/d2a/l49 0 2021-11-03T16:54:47.632 INFO:tasks.workunit.client.1.smithi194.stdout:5/323: truncate d2/d2a/d39/f40 1001724 0 2021-11-03T16:54:47.632 INFO:tasks.workunit.client.1.smithi194.stdout:5/324: mknod d2/dd/d35/c76 1 2021-11-03T16:54:47.632 INFO:tasks.workunit.client.1.smithi194.stdout:5/325: write d2/f44 [750209,74733] 0 2021-11-03T16:54:47.634 INFO:tasks.workunit.client.1.smithi194.stdout:3/350: dread d2/d17/d1d/f1e [0,4194304] 0 2021-11-03T16:54:47.634 INFO:tasks.workunit.client.1.smithi194.stdout:3/351: fsync d2/d17/f4f 0 2021-11-03T16:54:47.634 INFO:tasks.workunit.client.0.smithi026.stdout:1/143: getdents dc/df/d11 0 2021-11-03T16:54:47.635 INFO:tasks.workunit.client.0.smithi026.stdout:1/144: fdatasync dc/df/d11/f14 0 2021-11-03T16:54:47.635 INFO:tasks.workunit.client.0.smithi026.stdout:1/145: write dc/d28/f2e [374009,90483] 0 2021-11-03T16:54:47.635 INFO:tasks.workunit.client.0.smithi026.stdout:1/146: mknod dc/d28/d29/c35 1 2021-11-03T16:54:47.635 INFO:tasks.workunit.client.0.smithi026.stdout:1/147: rmdir dc/df/d11 39 2021-11-03T16:54:47.636 INFO:tasks.workunit.client.1.smithi194.stdout:3/352: write d2/d17/f23 [1900390,44444] 0 2021-11-03T16:54:47.636 INFO:tasks.workunit.client.1.smithi194.stdout:3/353: readlink d2/d20/d36/l52 0 2021-11-03T16:54:47.637 INFO:tasks.workunit.client.1.smithi194.stdout:7/314: rmdir d6/d4c/d54 39 2021-11-03T16:54:47.637 INFO:tasks.workunit.client.1.smithi194.stdout:7/315: write d6/f20 [1339674,98112] 0 2021-11-03T16:54:47.638 INFO:tasks.workunit.client.0.smithi026.stdout:1/148: unlink dc/df/f16 0 2021-11-03T16:54:47.641 INFO:tasks.workunit.client.1.smithi194.stdout:5/326: rename d2/f1f to d2/dd/f77 0 2021-11-03T16:54:47.650 INFO:tasks.workunit.client.0.smithi026.stdout:1/149: dread dc/f1e [0,4194304] 0 2021-11-03T16:54:47.658 INFO:tasks.workunit.client.1.smithi194.stdout:7/316: creat d6/d15/f70 x:0 0 0 2021-11-03T16:54:47.659 INFO:tasks.workunit.client.1.smithi194.stdout:3/354: rename d2/d17/d26/f66 to d2/d20/d36/d60/f72 0 2021-11-03T16:54:47.662 INFO:tasks.workunit.client.1.smithi194.stdout:5/327: dwrite d2/dd/d35/f6c [0,4194304] 0 2021-11-03T16:54:47.662 INFO:tasks.workunit.client.1.smithi194.stdout:3/355: rmdir d2/d17/d5e 39 2021-11-03T16:54:47.663 INFO:tasks.workunit.client.1.smithi194.stdout:3/356: write d2/ff [5232300,96055] 0 2021-11-03T16:54:47.677 INFO:tasks.workunit.client.1.smithi194.stdout:5/328: truncate d2/f23 2362883 0 2021-11-03T16:54:47.679 INFO:tasks.workunit.client.1.smithi194.stdout:7/317: dwrite d6/d32/f64 [0,4194304] 0 2021-11-03T16:54:47.679 INFO:tasks.workunit.client.1.smithi194.stdout:3/357: dwrite d2/d20/d36/f4c [0,4194304] 0 2021-11-03T16:54:47.680 INFO:tasks.workunit.client.1.smithi194.stdout:5/329: creat d2/dd/d35/d38/f78 x:0 0 0 2021-11-03T16:54:47.680 INFO:tasks.workunit.client.1.smithi194.stdout:5/330: stat d2/dd/d32 0 2021-11-03T16:54:47.688 INFO:tasks.workunit.client.1.smithi194.stdout:7/318: dread d6/f2d [4194304,4194304] 0 2021-11-03T16:54:47.688 INFO:tasks.workunit.client.1.smithi194.stdout:3/358: rename d2/d20/d36/d43 to d2/d17/d26/d73 0 2021-11-03T16:54:47.690 INFO:tasks.workunit.client.1.smithi194.stdout:5/331: getdents d2/dd 0 2021-11-03T16:54:47.691 INFO:tasks.workunit.client.1.smithi194.stdout:5/332: stat d2/dd/d70/f73 0 2021-11-03T16:54:47.691 INFO:tasks.workunit.client.1.smithi194.stdout:5/333: mknod d2/dd/d5e/c79 1 2021-11-03T16:54:47.695 INFO:tasks.workunit.client.1.smithi194.stdout:7/319: dread d6/f2d [4194304,4194304] 0 2021-11-03T16:54:47.698 INFO:tasks.workunit.client.1.smithi194.stdout:7/320: rename d6/d43/d46/d4e/f65 to d6/d4c/d54/d5b/f71 0 2021-11-03T16:54:47.699 INFO:tasks.workunit.client.1.smithi194.stdout:7/321: symlink d6/d32/l72 0 2021-11-03T16:54:47.704 INFO:tasks.workunit.client.1.smithi194.stdout:3/359: dread d2/d17/f23 [0,4194304] 0 2021-11-03T16:54:47.706 INFO:tasks.workunit.client.1.smithi194.stdout:5/334: dwrite d2/d2a/f68 [0,4194304] 0 2021-11-03T16:54:47.706 INFO:tasks.workunit.client.1.smithi194.stdout:3/360: creat d2/d20/d36/d4e/f74 x:0 0 0 2021-11-03T16:54:47.706 INFO:tasks.workunit.client.1.smithi194.stdout:3/361: mknod d2/d17/d26/d73/c75 1 2021-11-03T16:54:47.716 INFO:tasks.workunit.client.1.smithi194.stdout:7/322: dwrite d6/d43/f33 [0,4194304] 0 2021-11-03T16:54:47.728 INFO:tasks.workunit.client.1.smithi194.stdout:5/335: dwrite f0 [4194304,4194304] 0 2021-11-03T16:54:47.729 INFO:tasks.workunit.client.1.smithi194.stdout:3/362: dwrite d2/d17/d26/f65 [0,4194304] 0 2021-11-03T16:54:47.730 INFO:tasks.workunit.client.0.smithi026.stdout:4/64: sync 2021-11-03T16:54:47.731 INFO:tasks.workunit.client.0.smithi026.stdout:7/190: sync 2021-11-03T16:54:47.731 INFO:tasks.workunit.client.0.smithi026.stdout:9/126: sync 2021-11-03T16:54:47.731 INFO:tasks.workunit.client.0.smithi026.stdout:9/127: write d2/d18/f24 [59730,79373] 0 2021-11-03T16:54:47.732 INFO:tasks.workunit.client.1.smithi194.stdout:5/336: creat d2/dd/d32/d69/f7a x:0 0 0 2021-11-03T16:54:47.734 INFO:tasks.workunit.client.0.smithi026.stdout:4/65: getdents . 0 2021-11-03T16:54:47.734 INFO:tasks.workunit.client.0.smithi026.stdout:4/66: write f14 [51890,33215] 0 2021-11-03T16:54:47.736 INFO:tasks.workunit.client.0.smithi026.stdout:7/191: fdatasync da/d14/d15/f17 0 2021-11-03T16:54:47.739 INFO:tasks.workunit.client.1.smithi194.stdout:3/363: rename d2/d20/f46 to d2/d33/f76 0 2021-11-03T16:54:47.739 INFO:tasks.workunit.client.1.smithi194.stdout:3/364: mknod d2/d17/d26/d73/c77 1 2021-11-03T16:54:47.740 INFO:tasks.workunit.client.1.smithi194.stdout:3/365: mknod d2/d20/d36/d4e/c78 1 2021-11-03T16:54:47.740 INFO:tasks.workunit.client.0.smithi026.stdout:4/67: symlink l1a 0 2021-11-03T16:54:47.742 INFO:tasks.workunit.client.1.smithi194.stdout:7/323: dwrite d6/f2d [0,4194304] 0 2021-11-03T16:54:47.743 INFO:tasks.workunit.client.1.smithi194.stdout:7/324: mknod d6/c73 1 2021-11-03T16:54:47.743 INFO:tasks.workunit.client.1.smithi194.stdout:7/325: mknod d6/da/d2b/c74 1 2021-11-03T16:54:47.744 INFO:tasks.workunit.client.0.smithi026.stdout:7/192: creat da/d14/f39 x:0 0 0 2021-11-03T16:54:47.744 INFO:tasks.workunit.client.0.smithi026.stdout:7/193: chown da/d14/d32/d34 3269 1 2021-11-03T16:54:47.744 INFO:tasks.workunit.client.0.smithi026.stdout:7/194: write da/d14/f2f [171884,122775] 0 2021-11-03T16:54:47.745 INFO:tasks.workunit.client.0.smithi026.stdout:7/195: mknod da/d14/d15/d30/c3a 1 2021-11-03T16:54:47.745 INFO:tasks.workunit.client.1.smithi194.stdout:3/366: symlink d2/d17/d5e/l79 0 2021-11-03T16:54:47.745 INFO:tasks.workunit.client.1.smithi194.stdout:3/367: dread - d2/d17/f58 zero size 2021-11-03T16:54:47.746 INFO:tasks.workunit.client.1.smithi194.stdout:3/368: write d2/d17/d26/f42 [10746,116558] 0 2021-11-03T16:54:47.747 INFO:tasks.workunit.client.0.smithi026.stdout:4/68: rename f9 to f1b 0 2021-11-03T16:54:47.747 INFO:tasks.workunit.client.0.smithi026.stdout:4/69: write f17 [355048,125231] 0 2021-11-03T16:54:47.748 INFO:tasks.workunit.client.1.smithi194.stdout:3/369: dread d2/d33/f50 [0,4194304] 0 2021-11-03T16:54:47.748 INFO:tasks.workunit.client.0.smithi026.stdout:9/128: dread d2/d1f/d21/f23 [0,4194304] 0 2021-11-03T16:54:47.749 INFO:tasks.workunit.client.1.smithi194.stdout:7/326: symlink d6/d15/d50/l75 0 2021-11-03T16:54:47.750 INFO:tasks.workunit.client.0.smithi026.stdout:4/70: read f11 [3143103,107082] 0 2021-11-03T16:54:47.750 INFO:tasks.workunit.client.0.smithi026.stdout:7/196: mkdir da/d2c/d3b 0 2021-11-03T16:54:47.751 INFO:tasks.workunit.client.0.smithi026.stdout:7/197: truncate da/d14/f1b 373604 0 2021-11-03T16:54:47.753 INFO:tasks.workunit.client.1.smithi194.stdout:5/337: dwrite d2/dd/f20 [0,4194304] 0 2021-11-03T16:54:47.753 INFO:tasks.workunit.client.1.smithi194.stdout:5/338: stat d2/d3/la 0 2021-11-03T16:54:47.757 INFO:tasks.workunit.client.0.smithi026.stdout:9/129: creat d2/d1f/d21/f29 x:0 0 0 2021-11-03T16:54:47.758 INFO:tasks.workunit.client.0.smithi026.stdout:9/130: write d2/d18/f25 [4888295,125731] 0 2021-11-03T16:54:47.759 INFO:tasks.workunit.client.1.smithi194.stdout:5/339: mkdir d2/dd/d35/d7b 0 2021-11-03T16:54:47.759 INFO:tasks.workunit.client.0.smithi026.stdout:9/131: read d2/f12 [5314578,94165] 0 2021-11-03T16:54:47.760 INFO:tasks.workunit.client.0.smithi026.stdout:7/198: dread da/fc [0,4194304] 0 2021-11-03T16:54:47.760 INFO:tasks.workunit.client.0.smithi026.stdout:7/199: mknod da/d14/d15/d30/c3c 1 2021-11-03T16:54:47.762 INFO:tasks.workunit.client.0.smithi026.stdout:4/71: symlink l1c 0 2021-11-03T16:54:47.763 INFO:tasks.workunit.client.1.smithi194.stdout:7/327: rmdir d6 39 2021-11-03T16:54:47.766 INFO:tasks.workunit.client.1.smithi194.stdout:5/340: mkdir d2/d3/d57/d7c 0 2021-11-03T16:54:47.767 INFO:tasks.workunit.client.0.smithi026.stdout:9/132: creat d2/d27/f2a x:0 0 0 2021-11-03T16:54:47.767 INFO:tasks.workunit.client.1.smithi194.stdout:5/341: read d2/f44 [524328,52399] 0 2021-11-03T16:54:47.768 INFO:tasks.workunit.client.1.smithi194.stdout:5/342: read d2/dd/f20 [2256231,100827] 0 2021-11-03T16:54:47.768 INFO:tasks.workunit.client.1.smithi194.stdout:7/328: mkdir d6/d43/d46/d4e/d76 0 2021-11-03T16:54:47.769 INFO:tasks.workunit.client.1.smithi194.stdout:7/329: readlink d6/d43/d46/l6f 0 2021-11-03T16:54:47.769 INFO:tasks.workunit.client.0.smithi026.stdout:7/200: creat da/f3d x:0 0 0 2021-11-03T16:54:47.770 INFO:tasks.workunit.client.0.smithi026.stdout:7/201: mknod da/d14/d15/d30/c3e 1 2021-11-03T16:54:47.771 INFO:tasks.workunit.client.1.smithi194.stdout:5/343: mkdir d2/d2a/d39/d7d 0 2021-11-03T16:54:47.772 INFO:tasks.workunit.client.1.smithi194.stdout:5/344: chown d2/f44 98 1 2021-11-03T16:54:47.772 INFO:tasks.workunit.client.0.smithi026.stdout:4/72: mkdir d1d 0 2021-11-03T16:54:47.773 INFO:tasks.workunit.client.0.smithi026.stdout:7/202: fsync da/d14/f2f 0 2021-11-03T16:54:47.773 INFO:tasks.workunit.client.1.smithi194.stdout:7/330: mkdir d6/d4c/d54/d5b/d77 0 2021-11-03T16:54:47.774 INFO:tasks.workunit.client.0.smithi026.stdout:9/133: mkdir d2/d27/d2b 0 2021-11-03T16:54:47.775 INFO:tasks.workunit.client.1.smithi194.stdout:5/345: symlink d2/d2a/l7e 0 2021-11-03T16:54:47.778 INFO:tasks.workunit.client.1.smithi194.stdout:7/331: rmdir d6/d15/d50/d5e 0 2021-11-03T16:54:47.778 INFO:tasks.workunit.client.1.smithi194.stdout:7/332: chown d6/da/d2b/l52 39977860 1 2021-11-03T16:54:47.779 INFO:tasks.workunit.client.1.smithi194.stdout:7/333: mknod d6/d4c/d54/d5b/d77/c78 1 2021-11-03T16:54:47.781 INFO:tasks.workunit.client.0.smithi026.stdout:7/203: rename da/d14/d32/d34/l31 to da/d14/l3f 0 2021-11-03T16:54:47.783 INFO:tasks.workunit.client.1.smithi194.stdout:5/346: symlink d2/dd/d32/d69/l7f 0 2021-11-03T16:54:47.783 INFO:tasks.workunit.client.1.smithi194.stdout:5/347: write d2/dd/d32/d69/f7a [645211,123913] 0 2021-11-03T16:54:47.788 INFO:tasks.workunit.client.1.smithi194.stdout:7/334: truncate d6/d15/f40 3938634 0 2021-11-03T16:54:47.791 INFO:tasks.workunit.client.0.smithi026.stdout:9/134: rename d2/f16 to d2/d18/f2c 0 2021-11-03T16:54:47.793 INFO:tasks.workunit.client.0.smithi026.stdout:7/204: symlink da/d2c/l40 0 2021-11-03T16:54:47.798 INFO:tasks.workunit.client.0.smithi026.stdout:9/135: link d2/d18/f24 d2/d1f/d1c/f2d 0 2021-11-03T16:54:47.798 INFO:tasks.workunit.client.0.smithi026.stdout:9/136: mknod d2/d1f/c2e 1 2021-11-03T16:54:47.798 INFO:tasks.workunit.client.0.smithi026.stdout:9/137: write d2/d18/f2c [9338004,85732] 0 2021-11-03T16:54:47.800 INFO:tasks.workunit.client.0.smithi026.stdout:7/205: symlink da/d2c/l41 0 2021-11-03T16:54:47.800 INFO:tasks.workunit.client.0.smithi026.stdout:7/206: chown da/d14/d15/d30 19 1 2021-11-03T16:54:47.800 INFO:tasks.workunit.client.0.smithi026.stdout:7/207: chown da/f3d 2 1 2021-11-03T16:54:47.801 INFO:tasks.workunit.client.0.smithi026.stdout:7/208: read da/d2c/f35 [183166,14609] 0 2021-11-03T16:54:47.802 INFO:tasks.workunit.client.1.smithi194.stdout:5/348: rename d2/dd/d35/l37 to d2/d2a/d39/l80 0 2021-11-03T16:54:47.803 INFO:tasks.workunit.client.0.smithi026.stdout:9/138: symlink d2/d18/l2f 0 2021-11-03T16:54:47.805 INFO:tasks.workunit.client.0.smithi026.stdout:4/73: dwrite f14 [0,4194304] 0 2021-11-03T16:54:47.805 INFO:tasks.workunit.client.1.smithi194.stdout:7/335: dwrite d6/f2a [0,4194304] 0 2021-11-03T16:54:47.806 INFO:tasks.workunit.client.1.smithi194.stdout:7/336: write d6/f4d [377616,128331] 0 2021-11-03T16:54:47.807 INFO:tasks.workunit.client.1.smithi194.stdout:5/349: rename d2/d59 to d2/dd/d5e/d81 0 2021-11-03T16:54:47.809 INFO:tasks.workunit.client.0.smithi026.stdout:9/139: mkdir d2/d1f/d1c/d30 0 2021-11-03T16:54:47.811 INFO:tasks.workunit.client.1.smithi194.stdout:7/337: dread d6/da/d2b/d56/f58 [0,4194304] 0 2021-11-03T16:54:47.812 INFO:tasks.workunit.client.1.smithi194.stdout:7/338: truncate d6/f23 2056200 0 2021-11-03T16:54:47.819 INFO:tasks.workunit.client.0.smithi026.stdout:7/209: rename da/d2c/l37 to da/d14/d15/l42 0 2021-11-03T16:54:47.825 INFO:tasks.workunit.client.1.smithi194.stdout:5/350: creat d2/d2a/f82 x:0 0 0 2021-11-03T16:54:47.826 INFO:tasks.workunit.client.1.smithi194.stdout:5/351: read d2/d3/f41 [3827626,4182] 0 2021-11-03T16:54:47.826 INFO:tasks.workunit.client.0.smithi026.stdout:4/74: symlink d1d/l1e 0 2021-11-03T16:54:47.829 INFO:tasks.workunit.client.1.smithi194.stdout:5/352: dread d2/d3/d57/f6b [0,4194304] 0 2021-11-03T16:54:47.831 INFO:tasks.workunit.client.1.smithi194.stdout:7/339: creat d6/d4c/d54/d5b/f79 x:0 0 0 2021-11-03T16:54:47.832 INFO:tasks.workunit.client.1.smithi194.stdout:5/353: truncate d2/dd/f20 3475205 0 2021-11-03T16:54:47.833 INFO:tasks.workunit.client.1.smithi194.stdout:5/354: write d2/f24 [9297067,57000] 0 2021-11-03T16:54:47.833 INFO:tasks.workunit.client.1.smithi194.stdout:7/340: dread d6/da/f10 [0,4194304] 0 2021-11-03T16:54:47.833 INFO:tasks.workunit.client.1.smithi194.stdout:5/355: write d2/dd/f3c [2052865,101348] 0 2021-11-03T16:54:47.834 INFO:tasks.workunit.client.0.smithi026.stdout:9/140: symlink d2/d1f/d21/l31 0 2021-11-03T16:54:47.834 INFO:tasks.workunit.client.0.smithi026.stdout:9/141: chown d2/d1f/d21 226756985 1 2021-11-03T16:54:47.835 INFO:tasks.workunit.client.0.smithi026.stdout:9/142: fdatasync d2/d18/f2c 0 2021-11-03T16:54:47.837 INFO:tasks.workunit.client.1.smithi194.stdout:7/341: creat d6/da/d2b/d56/f7a x:0 0 0 2021-11-03T16:54:47.840 INFO:tasks.workunit.client.1.smithi194.stdout:7/342: dread d6/da/d2b/f66 [0,4194304] 0 2021-11-03T16:54:47.841 INFO:tasks.workunit.client.1.smithi194.stdout:7/343: chown d6/f2d 24 1 2021-11-03T16:54:47.841 INFO:tasks.workunit.client.1.smithi194.stdout:7/344: fsync d6/d15/f70 0 2021-11-03T16:54:47.841 INFO:tasks.workunit.client.1.smithi194.stdout:5/356: unlink d2/dd/l1d 0 2021-11-03T16:54:47.843 INFO:tasks.workunit.client.1.smithi194.stdout:7/345: creat d6/da/d2b/f7b x:0 0 0 2021-11-03T16:54:47.845 INFO:tasks.workunit.client.1.smithi194.stdout:5/357: truncate d2/d2a/d39/f3e 2915620 0 2021-11-03T16:54:47.848 INFO:tasks.workunit.client.1.smithi194.stdout:7/346: creat d6/d4c/f7c x:0 0 0 2021-11-03T16:54:47.850 INFO:tasks.workunit.client.1.smithi194.stdout:9/375: sync 2021-11-03T16:54:47.850 INFO:tasks.workunit.client.1.smithi194.stdout:0/166: sync 2021-11-03T16:54:47.850 INFO:tasks.workunit.client.1.smithi194.stdout:9/376: chown d19/d33/d6b/f46 26318520 1 2021-11-03T16:54:47.850 INFO:tasks.workunit.client.1.smithi194.stdout:4/309: sync 2021-11-03T16:54:47.851 INFO:tasks.workunit.client.0.smithi026.stdout:9/143: dwrite d2/d1f/d1c/f2d [0,4194304] 0 2021-11-03T16:54:47.852 INFO:tasks.workunit.client.0.smithi026.stdout:4/75: dwrite fd [0,4194304] 0 2021-11-03T16:54:47.852 INFO:tasks.workunit.client.0.smithi026.stdout:9/144: creat d2/d1f/d21/f32 x:0 0 0 2021-11-03T16:54:47.854 INFO:tasks.workunit.client.0.smithi026.stdout:9/145: write d2/f1b [577226,100478] 0 2021-11-03T16:54:47.856 INFO:tasks.workunit.client.1.smithi194.stdout:7/347: dread d6/d43/f36 [0,4194304] 0 2021-11-03T16:54:47.857 INFO:tasks.workunit.client.1.smithi194.stdout:9/377: link d19/d33/d6b/f29 d19/d33/d6b/d30/d53/f82 0 2021-11-03T16:54:47.857 INFO:tasks.workunit.client.1.smithi194.stdout:9/378: chown d19/d33/d6b/d30/d53/d68/d52/f72 39657376 1 2021-11-03T16:54:47.858 INFO:tasks.workunit.client.0.smithi026.stdout:9/146: write d2/f1b [4111958,21122] 0 2021-11-03T16:54:47.858 INFO:tasks.workunit.client.0.smithi026.stdout:9/147: write d2/f1b [4922291,108117] 0 2021-11-03T16:54:47.859 INFO:tasks.workunit.client.1.smithi194.stdout:4/310: link d6/d8/d1a/d14/l21 d6/d8/d1a/d14/d4a/l5f 0 2021-11-03T16:54:47.866 INFO:tasks.workunit.client.0.smithi026.stdout:4/76: dwrite f12 [4194304,4194304] 0 2021-11-03T16:54:47.867 INFO:tasks.workunit.client.1.smithi194.stdout:7/348: creat d6/d32/f7d x:0 0 0 2021-11-03T16:54:47.867 INFO:tasks.workunit.client.1.smithi194.stdout:7/349: truncate d6/f57 918704 0 2021-11-03T16:54:47.868 INFO:tasks.workunit.client.1.smithi194.stdout:7/350: fdatasync d6/da/d2b/d56/f58 0 2021-11-03T16:54:47.871 INFO:tasks.workunit.client.0.smithi026.stdout:9/148: symlink d2/d1f/d1c/d30/l33 0 2021-11-03T16:54:47.875 INFO:tasks.workunit.client.1.smithi194.stdout:9/379: creat d19/d33/d6b/d30/d53/d68/d4e/d54/d61/d70/f83 x:0 0 0 2021-11-03T16:54:47.876 INFO:tasks.workunit.client.1.smithi194.stdout:5/358: dwrite d2/dd/f53 [0,4194304] 0 2021-11-03T16:54:47.876 INFO:tasks.workunit.client.1.smithi194.stdout:5/359: mknod d2/d2a/d39/d7d/c83 1 2021-11-03T16:54:47.877 INFO:tasks.workunit.client.0.smithi026.stdout:4/77: rename d1d/l1e to d1d/l1f 0 2021-11-03T16:54:47.877 INFO:tasks.workunit.client.0.smithi026.stdout:4/78: write fc [896234,30976] 0 2021-11-03T16:54:47.878 INFO:tasks.workunit.client.1.smithi194.stdout:4/311: dwrite d6/d8/f38 [0,4194304] 0 2021-11-03T16:54:47.878 INFO:tasks.workunit.client.0.smithi026.stdout:4/79: write f10 [4042969,55739] 0 2021-11-03T16:54:47.878 INFO:tasks.workunit.client.0.smithi026.stdout:4/80: stat fa 0 2021-11-03T16:54:47.880 INFO:tasks.workunit.client.1.smithi194.stdout:7/351: symlink d6/d43/d46/d60/l7e 0 2021-11-03T16:54:47.880 INFO:tasks.workunit.client.0.smithi026.stdout:9/149: truncate d2/d18/f2c 6330509 0 2021-11-03T16:54:47.884 INFO:tasks.workunit.client.0.smithi026.stdout:4/81: creat d1d/f20 x:0 0 0 2021-11-03T16:54:47.887 INFO:tasks.workunit.client.0.smithi026.stdout:9/150: truncate d2/f12 629891 0 2021-11-03T16:54:47.889 INFO:tasks.workunit.client.0.smithi026.stdout:9/151: creat d2/d1f/d21/f34 x:0 0 0 2021-11-03T16:54:47.893 INFO:tasks.workunit.client.0.smithi026.stdout:9/152: truncate d2/d18/f15 2516619 0 2021-11-03T16:54:47.895 INFO:tasks.workunit.client.1.smithi194.stdout:7/352: rename d6/da/d2b/f66 to d6/d4c/d54/d5b/f7f 0 2021-11-03T16:54:47.897 INFO:tasks.workunit.client.0.smithi026.stdout:9/153: link d2/d1f/d1c/d30/l33 d2/d27/l35 0 2021-11-03T16:54:47.897 INFO:tasks.workunit.client.0.smithi026.stdout:9/154: dread - d2/d1f/d21/f34 zero size 2021-11-03T16:54:47.898 INFO:tasks.workunit.client.0.smithi026.stdout:9/155: stat d2/d18/l2f 0 2021-11-03T16:54:47.901 INFO:tasks.workunit.client.1.smithi194.stdout:7/353: dread d6/d15/f38 [0,4194304] 0 2021-11-03T16:54:47.901 INFO:tasks.workunit.client.1.smithi194.stdout:5/360: dwrite d2/dd/f31 [0,4194304] 0 2021-11-03T16:54:47.901 INFO:tasks.workunit.client.1.smithi194.stdout:7/354: mknod d6/d32/c80 1 2021-11-03T16:54:47.902 INFO:tasks.workunit.client.1.smithi194.stdout:4/312: dwrite d6/d8/d1a/d2b/f2c [0,4194304] 0 2021-11-03T16:54:47.904 INFO:tasks.workunit.client.1.smithi194.stdout:7/355: creat d6/da/d2b/d56/f81 x:0 0 0 2021-11-03T16:54:47.925 INFO:tasks.workunit.client.1.smithi194.stdout:7/356: dwrite f4 [4194304,4194304] 0 2021-11-03T16:54:47.930 INFO:tasks.workunit.client.1.smithi194.stdout:7/357: dread d6/da/d2b/d56/f58 [0,4194304] 0 2021-11-03T16:54:47.931 INFO:tasks.workunit.client.1.smithi194.stdout:7/358: creat d6/d15/f82 x:0 0 0 2021-11-03T16:54:47.931 INFO:tasks.workunit.client.1.smithi194.stdout:7/359: fdatasync d6/d15/f38 0 2021-11-03T16:54:47.932 INFO:tasks.workunit.client.1.smithi194.stdout:7/360: chown d6/d4c 3576628 1 2021-11-03T16:54:47.935 INFO:tasks.workunit.client.1.smithi194.stdout:4/313: dwrite d6/d12/d1e/f2e [0,4194304] 0 2021-11-03T16:54:47.937 INFO:tasks.workunit.client.1.smithi194.stdout:4/314: creat d6/f60 x:0 0 0 2021-11-03T16:54:47.938 INFO:tasks.workunit.client.1.smithi194.stdout:4/315: write d6/d8/d40/f47 [1548753,119629] 0 2021-11-03T16:54:47.960 INFO:tasks.workunit.client.0.smithi026.stdout:4/82: write f14 [1507419,129231] 0 2021-11-03T16:54:47.976 INFO:tasks.workunit.client.0.smithi026.stdout:4/83: dwrite fd [0,4194304] 0 2021-11-03T16:54:47.976 INFO:tasks.workunit.client.0.smithi026.stdout:4/84: chown fe 77367605 1 2021-11-03T16:54:47.976 INFO:tasks.workunit.client.0.smithi026.stdout:4/85: read f17 [397647,15720] 0 2021-11-03T16:54:47.977 INFO:tasks.workunit.client.0.smithi026.stdout:4/86: chown d1d/f20 2 1 2021-11-03T16:54:47.989 INFO:tasks.workunit.client.0.smithi026.stdout:4/87: dwrite fd [0,4194304] 0 2021-11-03T16:54:47.991 INFO:tasks.workunit.client.0.smithi026.stdout:2/69: sync 2021-11-03T16:54:47.991 INFO:tasks.workunit.client.0.smithi026.stdout:3/169: sync 2021-11-03T16:54:47.991 INFO:tasks.workunit.client.0.smithi026.stdout:3/170: fdatasync dc/d12/d30/d3c/f26 0 2021-11-03T16:54:47.991 INFO:tasks.workunit.client.0.smithi026.stdout:3/171: truncate dc/d12/d30/d3c/f26 9298886 0 2021-11-03T16:54:47.992 INFO:tasks.workunit.client.0.smithi026.stdout:3/172: chown dc/d12/d30 2031 1 2021-11-03T16:54:47.992 INFO:tasks.workunit.client.0.smithi026.stdout:3/173: mknod dc/c3f 1 2021-11-03T16:54:47.992 INFO:tasks.workunit.client.0.smithi026.stdout:4/88: link f18 d1d/f21 0 2021-11-03T16:54:47.992 INFO:tasks.workunit.client.0.smithi026.stdout:4/89: fdatasync ff 0 2021-11-03T16:54:47.993 INFO:tasks.workunit.client.0.smithi026.stdout:8/114: sync 2021-11-03T16:54:47.993 INFO:tasks.workunit.client.0.smithi026.stdout:2/70: creat de/f19 x:0 0 0 2021-11-03T16:54:47.999 INFO:tasks.workunit.client.1.smithi194.stdout:9/380: dwrite d19/d33/d6b/f3a [0,4194304] 0 2021-11-03T16:54:47.999 INFO:tasks.workunit.client.0.smithi026.stdout:3/174: symlink dc/d1d/l40 0 2021-11-03T16:54:48.000 INFO:tasks.workunit.client.0.smithi026.stdout:8/115: getdents d2/da 0 2021-11-03T16:54:48.000 INFO:tasks.workunit.client.0.smithi026.stdout:3/175: truncate dc/f20 4982509 0 2021-11-03T16:54:48.001 INFO:tasks.workunit.client.0.smithi026.stdout:8/116: write d2/ff [4669970,34359] 0 2021-11-03T16:54:48.001 INFO:tasks.workunit.client.0.smithi026.stdout:8/117: fsync d2/f18 0 2021-11-03T16:54:48.004 INFO:tasks.workunit.client.0.smithi026.stdout:3/176: rename dc/f1f to dc/d12/f41 0 2021-11-03T16:54:48.008 INFO:tasks.workunit.client.0.smithi026.stdout:8/118: dread d2/da/d14/d1b/f1f [0,4194304] 0 2021-11-03T16:54:48.010 INFO:tasks.workunit.client.1.smithi194.stdout:7/361: dwrite d6/da/f5a [0,4194304] 0 2021-11-03T16:54:48.010 INFO:tasks.workunit.client.0.smithi026.stdout:9/156: dwrite d2/d1f/d1c/f2d [0,4194304] 0 2021-11-03T16:54:48.012 INFO:tasks.workunit.client.0.smithi026.stdout:8/119: dread d2/da/f12 [0,4194304] 0 2021-11-03T16:54:48.012 INFO:tasks.workunit.client.1.smithi194.stdout:5/361: dwrite d2/dd/d32/d69/f7a [0,4194304] 0 2021-11-03T16:54:48.013 INFO:tasks.workunit.client.1.smithi194.stdout:7/362: read f4 [6026152,99548] 0 2021-11-03T16:54:48.023 INFO:tasks.workunit.client.1.smithi194.stdout:5/362: rmdir d2/d2a/d39 39 2021-11-03T16:54:48.024 INFO:tasks.workunit.client.1.smithi194.stdout:7/363: link d6/da/d2b/d56/f7a d6/d43/d46/d4e/d5f/f83 0 2021-11-03T16:54:48.024 INFO:tasks.workunit.client.1.smithi194.stdout:7/364: mknod d6/d32/c84 1 2021-11-03T16:54:48.025 INFO:tasks.workunit.client.1.smithi194.stdout:7/365: chown d6/d4c 2 1 2021-11-03T16:54:48.026 INFO:tasks.workunit.client.1.smithi194.stdout:5/363: read d2/dd/f31 [2288203,57773] 0 2021-11-03T16:54:48.026 INFO:tasks.workunit.client.1.smithi194.stdout:5/364: write d2/dd/d5e/d81/f6e [968281,51348] 0 2021-11-03T16:54:48.028 INFO:tasks.workunit.client.0.smithi026.stdout:3/177: dread dc/d1d/d1e/d27/f32 [0,4194304] 0 2021-11-03T16:54:48.029 INFO:tasks.workunit.client.1.smithi194.stdout:7/366: mkdir d6/d15/d85 0 2021-11-03T16:54:48.030 INFO:tasks.workunit.client.1.smithi194.stdout:7/367: fsync d6/d32/f64 0 2021-11-03T16:54:48.030 INFO:tasks.workunit.client.1.smithi194.stdout:7/368: write d6/d15/f82 [317751,68532] 0 2021-11-03T16:54:48.031 INFO:tasks.workunit.client.1.smithi194.stdout:9/381: dwrite d19/d33/d6b/d30/f31 [0,4194304] 0 2021-11-03T16:54:48.032 INFO:tasks.workunit.client.1.smithi194.stdout:9/382: truncate d19/d33/d6b/d30/d53/d68/d4e/d54/f7f 793916 0 2021-11-03T16:54:48.032 INFO:tasks.workunit.client.0.smithi026.stdout:2/71: dwrite fc [0,4194304] 0 2021-11-03T16:54:48.033 INFO:tasks.workunit.client.0.smithi026.stdout:4/90: dwrite f12 [0,4194304] 0 2021-11-03T16:54:48.034 INFO:tasks.workunit.client.0.smithi026.stdout:4/91: dread f17 [0,4194304] 0 2021-11-03T16:54:48.035 INFO:tasks.workunit.client.0.smithi026.stdout:4/92: chown fc 23699 1 2021-11-03T16:54:48.037 INFO:tasks.workunit.client.1.smithi194.stdout:5/365: creat d2/dd/d35/d7b/f84 x:0 0 0 2021-11-03T16:54:48.037 INFO:tasks.workunit.client.1.smithi194.stdout:5/366: chown d2/d3/d57/f66 527 1 2021-11-03T16:54:48.040 INFO:tasks.workunit.client.1.smithi194.stdout:7/369: mkdir d6/d15/d85/d86 0 2021-11-03T16:54:48.040 INFO:tasks.workunit.client.1.smithi194.stdout:7/370: truncate d6/d43/f36 4476106 0 2021-11-03T16:54:48.041 INFO:tasks.workunit.client.1.smithi194.stdout:7/371: write d6/f57 [1405200,62649] 0 2021-11-03T16:54:48.041 INFO:tasks.workunit.client.1.smithi194.stdout:7/372: fsync d6/d4c/f7c 0 2021-11-03T16:54:48.042 INFO:tasks.workunit.client.0.smithi026.stdout:8/120: dwrite d2/da/d14/d1b/f20 [0,4194304] 0 2021-11-03T16:54:48.043 INFO:tasks.workunit.client.0.smithi026.stdout:8/121: write d2/da/d14/f21 [321413,3966] 0 2021-11-03T16:54:48.043 INFO:tasks.workunit.client.0.smithi026.stdout:8/122: rename d2/da/d14/d1b to d2/da/d14/d1b/d25 22 2021-11-03T16:54:48.044 INFO:tasks.workunit.client.0.smithi026.stdout:2/72: creat de/d11/f1a x:0 0 0 2021-11-03T16:54:48.045 INFO:tasks.workunit.client.0.smithi026.stdout:2/73: mknod de/c1b 1 2021-11-03T16:54:48.045 INFO:tasks.workunit.client.0.smithi026.stdout:2/74: readlink de/d11/d15/l18 0 2021-11-03T16:54:48.046 INFO:tasks.workunit.client.0.smithi026.stdout:2/75: fdatasync de/f19 0 2021-11-03T16:54:48.047 INFO:tasks.workunit.client.1.smithi194.stdout:9/383: truncate d19/d33/d6b/f29 1899941 0 2021-11-03T16:54:48.056 INFO:tasks.workunit.client.0.smithi026.stdout:2/76: dread f3 [0,4194304] 0 2021-11-03T16:54:48.058 INFO:tasks.workunit.client.0.smithi026.stdout:4/93: dwrite f10 [0,4194304] 0 2021-11-03T16:54:48.073 INFO:tasks.workunit.client.1.smithi194.stdout:5/367: rmdir d2/d2a/d39 39 2021-11-03T16:54:48.078 INFO:tasks.workunit.client.0.smithi026.stdout:8/123: dwrite d2/da/d14/f21 [0,4194304] 0 2021-11-03T16:54:48.081 INFO:tasks.workunit.client.0.smithi026.stdout:2/77: unlink f2 0 2021-11-03T16:54:48.084 INFO:tasks.workunit.client.0.smithi026.stdout:4/94: symlink d1d/l22 0 2021-11-03T16:54:48.085 INFO:tasks.workunit.client.1.smithi194.stdout:7/373: truncate d6/da/d2b/f31 2190306 0 2021-11-03T16:54:48.087 INFO:tasks.workunit.client.0.smithi026.stdout:9/157: truncate d2/d18/f25 5162462 0 2021-11-03T16:54:48.087 INFO:tasks.workunit.client.0.smithi026.stdout:9/158: fsync d2/d18/f24 0 2021-11-03T16:54:48.087 INFO:tasks.workunit.client.0.smithi026.stdout:9/159: mknod d2/d1f/d1c/d30/c36 1 2021-11-03T16:54:48.087 INFO:tasks.workunit.client.0.smithi026.stdout:9/160: write d2/d1f/d21/f34 [489893,96163] 0 2021-11-03T16:54:48.088 INFO:tasks.workunit.client.1.smithi194.stdout:7/374: dread d6/da/f10 [0,4194304] 0 2021-11-03T16:54:48.090 INFO:tasks.workunit.client.1.smithi194.stdout:9/384: rename d19/d33/d6b/d30/d53/d68/f42 to d19/d33/d6b/d30/d53/f84 0 2021-11-03T16:54:48.091 INFO:tasks.workunit.client.1.smithi194.stdout:5/368: dwrite d2/dd/d35/d38/f60 [0,4194304] 0 2021-11-03T16:54:48.091 INFO:tasks.workunit.client.1.smithi194.stdout:5/369: mknod d2/dd/d32/c85 1 2021-11-03T16:54:48.092 INFO:tasks.workunit.client.0.smithi026.stdout:9/161: dread d2/d1f/d21/f34 [0,4194304] 0 2021-11-03T16:54:48.094 INFO:tasks.workunit.client.1.smithi194.stdout:7/375: symlink d6/d15/l87 0 2021-11-03T16:54:48.094 INFO:tasks.workunit.client.1.smithi194.stdout:7/376: mknod d6/d43/d46/d4e/d5f/c88 1 2021-11-03T16:54:48.095 INFO:tasks.workunit.client.1.smithi194.stdout:5/370: dread d2/d3/f22 [4194304,4194304] 0 2021-11-03T16:54:48.098 INFO:tasks.workunit.client.1.smithi194.stdout:7/377: dread d6/d43/f36 [0,4194304] 0 2021-11-03T16:54:48.103 INFO:tasks.workunit.client.0.smithi026.stdout:2/78: creat de/d11/f1c x:0 0 0 2021-11-03T16:54:48.105 INFO:tasks.workunit.client.0.smithi026.stdout:4/95: creat d1d/f23 x:0 0 0 2021-11-03T16:54:48.107 INFO:tasks.workunit.client.0.smithi026.stdout:4/96: write f1b [648646,72861] 0 2021-11-03T16:54:48.109 INFO:tasks.workunit.client.0.smithi026.stdout:9/162: mknod d2/c37 1 2021-11-03T16:54:48.109 INFO:tasks.workunit.client.1.smithi194.stdout:5/371: symlink d2/dd/d5e/d81/l86 0 2021-11-03T16:54:48.110 INFO:tasks.workunit.client.1.smithi194.stdout:5/372: dread - d2/dd/d35/d38/f65 zero size 2021-11-03T16:54:48.111 INFO:tasks.workunit.client.0.smithi026.stdout:8/124: rename d2/f13 to d2/da/f26 0 2021-11-03T16:54:48.116 INFO:tasks.workunit.client.1.smithi194.stdout:7/378: dwrite d6/da/f5a [0,4194304] 0 2021-11-03T16:54:48.117 INFO:tasks.workunit.client.1.smithi194.stdout:7/379: write d6/f20 [4115923,100153] 0 2021-11-03T16:54:48.122 INFO:tasks.workunit.client.1.smithi194.stdout:7/380: truncate d6/f57 632688 0 2021-11-03T16:54:48.122 INFO:tasks.workunit.client.1.smithi194.stdout:5/373: unlink d2/d3/f22 0 2021-11-03T16:54:48.123 INFO:tasks.workunit.client.1.smithi194.stdout:5/374: fsync d2/d2a/f68 0 2021-11-03T16:54:48.125 INFO:tasks.workunit.client.0.smithi026.stdout:8/125: write d2/da/d14/f17 [75810,129975] 0 2021-11-03T16:54:48.126 INFO:tasks.workunit.client.0.smithi026.stdout:4/97: dwrite f7 [4194304,4194304] 0 2021-11-03T16:54:48.127 INFO:tasks.workunit.client.1.smithi194.stdout:7/381: write d6/f23 [1620530,79388] 0 2021-11-03T16:54:48.127 INFO:tasks.workunit.client.1.smithi194.stdout:7/382: write d6/d4c/d54/d5b/f79 [1016534,3023] 0 2021-11-03T16:54:48.129 INFO:tasks.workunit.client.0.smithi026.stdout:8/126: creat d2/da/f27 x:0 0 0 2021-11-03T16:54:48.135 INFO:tasks.workunit.client.0.smithi026.stdout:8/127: rename d2/da/f11 to d2/da/f28 0 2021-11-03T16:54:48.135 INFO:tasks.workunit.client.0.smithi026.stdout:8/128: write d2/da/f1a [728014,21065] 0 2021-11-03T16:54:48.135 INFO:tasks.workunit.client.0.smithi026.stdout:8/129: truncate d2/da/d14/f17 5242196 0 2021-11-03T16:54:48.155 INFO:tasks.workunit.client.0.smithi026.stdout:9/163: dwrite d2/d18/f2c [0,4194304] 0 2021-11-03T16:54:48.156 INFO:tasks.workunit.client.0.smithi026.stdout:8/130: dwrite d2/da/f27 [0,4194304] 0 2021-11-03T16:54:48.156 INFO:tasks.workunit.client.0.smithi026.stdout:8/131: readlink d2/da/d14/l24 0 2021-11-03T16:54:48.157 INFO:tasks.workunit.client.0.smithi026.stdout:8/132: mknod d2/da/d14/d1b/c29 1 2021-11-03T16:54:48.159 INFO:tasks.workunit.client.1.smithi194.stdout:7/383: dwrite d6/d15/f82 [0,4194304] 0 2021-11-03T16:54:48.164 INFO:tasks.workunit.client.0.smithi026.stdout:4/98: dwrite f1b [0,4194304] 0 2021-11-03T16:54:48.165 INFO:tasks.workunit.client.1.smithi194.stdout:5/375: dwrite d2/dd/d5e/d81/f74 [0,4194304] 0 2021-11-03T16:54:48.165 INFO:tasks.workunit.client.1.smithi194.stdout:5/376: chown d2/d3/d57 70 1 2021-11-03T16:54:48.165 INFO:tasks.workunit.client.1.smithi194.stdout:5/377: fdatasync d2/f52 0 2021-11-03T16:54:48.166 INFO:tasks.workunit.client.1.smithi194.stdout:5/378: dread - d2/d2a/d39/f4d zero size 2021-11-03T16:54:48.168 INFO:tasks.workunit.client.1.smithi194.stdout:6/392: sync 2021-11-03T16:54:48.169 INFO:tasks.workunit.client.1.smithi194.stdout:6/393: mknod de/d1f/d70/c87 1 2021-11-03T16:54:48.170 INFO:tasks.workunit.client.1.smithi194.stdout:6/394: write de/d21/d2d/f4b [1297782,66265] 0 2021-11-03T16:54:48.170 INFO:tasks.workunit.client.1.smithi194.stdout:6/395: chown de/d21/d2d/l4a 3632 1 2021-11-03T16:54:48.172 INFO:tasks.workunit.client.1.smithi194.stdout:6/396: write de/f24 [3585931,56678] 0 2021-11-03T16:54:48.176 INFO:tasks.workunit.client.0.smithi026.stdout:8/133: dwrite d2/da/f27 [0,4194304] 0 2021-11-03T16:54:48.176 INFO:tasks.workunit.client.0.smithi026.stdout:8/134: mknod d2/da/d14/d1b/c2a 1 2021-11-03T16:54:48.211 INFO:tasks.workunit.client.1.smithi194.stdout:9/385: truncate d19/d33/d6b/d30/d53/f84 3857190 0 2021-11-03T16:54:48.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:47 smithi194 conmon[35111]: audit 2021-11-03T16:54:46.958740+0000 mon.smithi026 (mon.0) 2021-11-03T16:54:48.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:47 smithi194 conmon[35111]: 571 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "mgr fail", "who": "smithi026.cnrxli"}]': finished 2021-11-03T16:54:48.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:47 smithi194 conmon[35111]: cluster 2021-11-03T16:54:46.958788+0000 mon.smithi026 (mon.0) 572 : cluster [DBG] mgrmap e19: smithi194.wnexas(active, starting, since 0.987847s) 2021-11-03T16:54:48.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:47 smithi194 conmon[35111]: cluster 2021-11-03T16:54:47 2021-11-03T16:54:48.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:47 smithi194 conmon[35111]: .276364+0000 mon.smithi026 (mon.0) 2021-11-03T16:54:48.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:47 smithi194 conmon[35111]: 573 : cluster [INF] Active manager daemon smithi194.wnexas restarted 2021-11-03T16:54:48.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:47 smithi194 conmon[35111]: cluster 2021-11 2021-11-03T16:54:48.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:47 smithi194 conmon[35111]: -03T16:54:47.276920+0000 mon.smithi026 2021-11-03T16:54:48.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:47 smithi194 conmon[35111]: (mon.0) 574 : cluster [INF] 2021-11-03T16:54:48.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:47 smithi194 conmon[35111]: Activating manager daemon smithi194.wnexas 2021-11-03T16:54:48.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:47 smithi194 conmon[35111]: cluster 2021-11 2021-11-03T16:54:48.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:47 smithi194 conmon[35111]: -03T16:54:47.280424 2021-11-03T16:54:48.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:47 smithi194 conmon[35111]: +0000 mon.smithi026 (mon.0) 575 : cluster 2021-11-03T16:54:48.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:47 smithi194 conmon[35111]: [DBG] osdmap e44: 6 total, 6 up, 6 in 2021-11-03T16:54:48.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:47 smithi194 conmon[35111]: audit 2021-11 2021-11-03T16:54:48.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:47 smithi194 conmon[35111]: -03T16:54:47. 2021-11-03T16:54:48.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:47 smithi194 conmon[35111]: 282908+0000 mon.smithi194 (mon.1) 15 : audit [DBG] 2021-11-03T16:54:48.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:47 smithi194 conmon[35111]: from='mgr.? 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.wnexas/crt"}]: dispatch 2021-11-03T16:54:48.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:47 smithi194 conmon[35111]: audit 2021-11-03 2021-11-03T16:54:48.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:47 smithi194 conmon[35111]: T16:54:47.283339+0000 2021-11-03T16:54:48.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:47 smithi194 conmon[35111]: mon.smithi194 (mon.1) 16 : audit [DBG] from='mgr.? 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-11-03T16:54:48.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:47 smithi194 conmon[35111]: 2021-11-03T16:54:48.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:47 smithi194 conmon[35111]: audit 2021-11-03 2021-11-03T16:54:48.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:47 smithi194 conmon[35111]: T16:54:47.284604+0000 mon.smithi194 ( 2021-11-03T16:54:48.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:47 smithi194 conmon[35111]: mon.1) 17 : audit [DBG] 2021-11-03T16:54:48.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:47 smithi194 conmon[35111]: from='mgr.? 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.wnexas/key"}]: dispatch 2021-11-03T16:54:48.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:47 smithi194 conmon[35111]: audit 2021-11- 2021-11-03T16:54:48.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:47 smithi194 conmon[35111]: 03T16:54:47.284911+0000 mon.smithi194 ( 2021-11-03T16:54:48.255 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:47 smithi194 conmon[35111]: mon.1) 18 : audit [DBG] 2021-11-03T16:54:48.255 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:47 smithi194 conmon[35111]: from='mgr.? 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-11-03T16:54:48.256 INFO:tasks.workunit.client.0.smithi026.stdout:9/164: rename d2/d18/l2f to d2/d18/l38 0 2021-11-03T16:54:48.256 INFO:tasks.workunit.client.1.smithi194.stdout:7/384: mkdir d6/d4c/d54/d89 0 2021-11-03T16:54:48.256 INFO:tasks.workunit.client.1.smithi194.stdout:7/385: chown d6/d15/d50 8962533 1 2021-11-03T16:54:48.257 INFO:tasks.workunit.client.1.smithi194.stdout:7/386: readlink d6/da/l22 0 2021-11-03T16:54:48.271 INFO:tasks.workunit.client.0.smithi026.stdout:9/165: dwrite d2/d18/f25 [0,4194304] 0 2021-11-03T16:54:48.326 INFO:tasks.workunit.client.1.smithi194.stdout:5/379: creat d2/dd/d70/f87 x:0 0 0 2021-11-03T16:54:48.327 INFO:tasks.workunit.client.1.smithi194.stdout:5/380: write f0 [2982624,42221] 0 2021-11-03T16:54:48.327 INFO:tasks.workunit.client.0.smithi026.stdout:4/99: mkdir d1d/d24 0 2021-11-03T16:54:48.328 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:47 smithi026 conmon[32119]: audit 2021-11-03T16:54:46.958740+0000 mon.smithi026 (mon.0) 571 : audit [INF] from='mgr.14162 172.21.15.26:0/42533857' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "mgr fail", "who": "smithi026.cnrxli"}]': finished 2021-11-03T16:54:48.328 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:47 smithi026 conmon[32119]: cluster 2021-11-03T16:54:46.958788+0000 mon.smithi026 (mon.0) 572 : cluster [DBG] mgrmap e19: smithi194.wnexas(active, starting, since 0.987847s) 2021-11-03T16:54:48.328 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:47 smithi026 conmon[32119]: cluster 2021-11-03T16:54:47.276364+0000 mon.smithi026 (mon.0) 573 : cluster [INF] Active manager daemon smithi194.wnexas restarted 2021-11-03T16:54:48.328 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:47 smithi026 conmon[32119]: cluster 2021-11-03T16:54:47.276920+0000 mon.smithi026 (mon.0) 574 : cluster [INF] Activating manager daemon smithi194.wnexas 2021-11-03T16:54:48.329 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:47 smithi026 conmon[32119]: cluster 2021-11-03T16:54:47.280424+0000 mon.smithi026 (mon.0) 575 : cluster [DBG] osdmap e44: 6 total, 6 up, 6 in 2021-11-03T16:54:48.329 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:47 smithi026 conmon[32119]: audit 2021-11-03T16:54:47.282908+0000 mon.smithi194 (mon.1) 15 : audit [DBG] from='mgr.? 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.wnexas/crt"}]: dispatch 2021-11-03T16:54:48.329 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:47 smithi026 conmon[32119]: audit 2021-11-03T16:54:47.283339+0000 mon.smithi194 (mon.1) 16 : audit [DBG] from='mgr.? 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-11-03T16:54:48.329 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:47 smithi026 conmon[32119]: audit 2021-11-03T16:54:47.284604+0000 mon.smithi194 (mon.1) 17 : audit [DBG] from='mgr.? 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.wnexas/key"}]: dispatch 2021-11-03T16:54:48.330 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:47 smithi026 conmon[32119]: audit 2021-11-03T16:54:47.284911+0000 mon.smithi194 (mon.1) 18 : audit [DBG] from='mgr.? 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-11-03T16:54:48.333 INFO:tasks.workunit.client.0.smithi026.stdout:4/100: creat d1d/d24/f25 x:0 0 0 2021-11-03T16:54:48.338 INFO:tasks.workunit.client.0.smithi026.stdout:9/166: rename d2/d1f/d21 to d2/d39 0 2021-11-03T16:54:48.338 INFO:tasks.workunit.client.0.smithi026.stdout:9/167: dread - d2/d27/f28 zero size 2021-11-03T16:54:48.341 INFO:tasks.workunit.client.0.smithi026.stdout:4/101: dread f1b [0,4194304] 0 2021-11-03T16:54:48.342 INFO:tasks.workunit.client.0.smithi026.stdout:4/102: write f12 [6109812,130445] 0 2021-11-03T16:54:48.342 INFO:tasks.workunit.client.0.smithi026.stdout:4/103: mknod d1d/c26 1 2021-11-03T16:54:48.347 INFO:tasks.workunit.client.0.smithi026.stdout:9/168: creat d2/d1f/f3a x:0 0 0 2021-11-03T16:54:48.347 INFO:tasks.workunit.client.0.smithi026.stdout:9/169: readlink d2/le 0 2021-11-03T16:54:48.347 INFO:tasks.workunit.client.0.smithi026.stdout:9/170: readlink d2/d39/l31 0 2021-11-03T16:54:48.348 INFO:tasks.workunit.client.0.smithi026.stdout:8/135: rename d2/l16 to d2/d1c/l2b 0 2021-11-03T16:54:48.349 INFO:tasks.workunit.client.0.smithi026.stdout:9/171: dread d2/f12 [0,4194304] 0 2021-11-03T16:54:48.351 INFO:tasks.workunit.client.1.smithi194.stdout:6/397: rename de/d1f/d26/l71 to de/d1f/d43/d55/d74/l88 0 2021-11-03T16:54:48.352 INFO:tasks.workunit.client.1.smithi194.stdout:6/398: dread - de/d21/d41/f80 zero size 2021-11-03T16:54:48.352 INFO:tasks.workunit.client.1.smithi194.stdout:6/399: truncate de/f12 3685707 0 2021-11-03T16:54:48.357 INFO:tasks.workunit.client.1.smithi194.stdout:9/386: creat d19/d33/d6b/d30/d53/d68/d4e/d5f/f85 x:0 0 0 2021-11-03T16:54:48.357 INFO:tasks.workunit.client.1.smithi194.stdout:9/387: stat d19/d33/f35 0 2021-11-03T16:54:48.358 INFO:tasks.workunit.client.1.smithi194.stdout:9/388: write d19/f22 [417306,89001] 0 2021-11-03T16:54:48.359 INFO:tasks.workunit.client.0.smithi026.stdout:9/172: link d2/d39/f34 d2/d1f/f3b 0 2021-11-03T16:54:48.359 INFO:tasks.workunit.client.0.smithi026.stdout:9/173: readlink d2/d39/l31 0 2021-11-03T16:54:48.361 INFO:tasks.workunit.client.0.smithi026.stdout:9/174: write d2/d1f/d1c/f2d [2846286,112642] 0 2021-11-03T16:54:48.361 INFO:tasks.workunit.client.1.smithi194.stdout:7/387: rmdir d6/d43/d46/d4e/d76 0 2021-11-03T16:54:48.362 INFO:tasks.workunit.client.1.smithi194.stdout:7/388: chown d6/d4c/d54/d5b/f79 1615666 1 2021-11-03T16:54:48.362 INFO:tasks.workunit.client.1.smithi194.stdout:7/389: truncate d6/f57 863126 0 2021-11-03T16:54:48.362 INFO:tasks.workunit.client.1.smithi194.stdout:7/390: dread - d6/da/d2b/f4b zero size 2021-11-03T16:54:48.363 INFO:tasks.workunit.client.1.smithi194.stdout:5/381: symlink d2/dd/d32/d69/l88 0 2021-11-03T16:54:48.363 INFO:tasks.workunit.client.1.smithi194.stdout:5/382: stat d2/dd/f16 0 2021-11-03T16:54:48.363 INFO:tasks.workunit.client.0.smithi026.stdout:9/175: symlink d2/d27/d2b/l3c 0 2021-11-03T16:54:48.364 INFO:tasks.workunit.client.0.smithi026.stdout:9/176: write d2/f12 [1110974,76981] 0 2021-11-03T16:54:48.364 INFO:tasks.workunit.client.0.smithi026.stdout:9/177: write d2/d1f/f3a [660969,130250] 0 2021-11-03T16:54:48.365 INFO:tasks.workunit.client.1.smithi194.stdout:9/389: truncate d19/d33/d6b/d30/d53/d68/f44 934272 0 2021-11-03T16:54:48.365 INFO:tasks.workunit.client.1.smithi194.stdout:9/390: mknod d19/d33/d6b/d30/d53/c86 1 2021-11-03T16:54:48.365 INFO:tasks.workunit.client.1.smithi194.stdout:9/391: fdatasync d19/d33/d6b/d30/d53/d68/d4e/d54/d61/f7c 0 2021-11-03T16:54:48.366 INFO:tasks.workunit.client.0.smithi026.stdout:8/136: dwrite d2/da/f26 [0,4194304] 0 2021-11-03T16:54:48.366 INFO:tasks.workunit.client.0.smithi026.stdout:9/178: write d2/d18/f25 [1248811,105483] 0 2021-11-03T16:54:48.367 INFO:tasks.workunit.client.0.smithi026.stdout:9/179: chown d2/d39 28 1 2021-11-03T16:54:48.367 INFO:tasks.workunit.client.1.smithi194.stdout:7/391: truncate d6/da/d2b/f31 1699568 0 2021-11-03T16:54:48.368 INFO:tasks.workunit.client.1.smithi194.stdout:7/392: readlink d6/l18 0 2021-11-03T16:54:48.368 INFO:tasks.workunit.client.1.smithi194.stdout:7/393: write d6/da/d2b/d56/f7a [827805,6285] 0 2021-11-03T16:54:48.373 INFO:tasks.workunit.client.1.smithi194.stdout:6/400: mkdir de/d89 0 2021-11-03T16:54:48.373 INFO:tasks.workunit.client.1.smithi194.stdout:5/383: getdents d2/dd 0 2021-11-03T16:54:48.373 INFO:tasks.workunit.client.1.smithi194.stdout:6/401: write de/d21/d2d/f7b [197322,3631] 0 2021-11-03T16:54:48.373 INFO:tasks.workunit.client.1.smithi194.stdout:6/402: readlink de/d21/d61/d6f/l62 0 2021-11-03T16:54:48.374 INFO:tasks.workunit.client.0.smithi026.stdout:8/137: unlink d2/da/f1a 0 2021-11-03T16:54:48.374 INFO:tasks.workunit.client.0.smithi026.stdout:8/138: mknod d2/d1c/c2c 1 2021-11-03T16:54:48.376 INFO:tasks.workunit.client.1.smithi194.stdout:9/392: creat d19/d38/f87 x:0 0 0 2021-11-03T16:54:48.376 INFO:tasks.workunit.client.1.smithi194.stdout:9/393: write d19/d33/d6b/d30/d53/d68/d4e/d54/d5d/f69 [414781,52127] 0 2021-11-03T16:54:48.376 INFO:tasks.workunit.client.1.smithi194.stdout:9/394: write d19/d33/d6b/d30/d53/d68/d4e/d5f/f85 [954165,23315] 0 2021-11-03T16:54:48.376 INFO:tasks.workunit.client.1.smithi194.stdout:9/395: truncate d19/d33/f3b 625634 0 2021-11-03T16:54:48.377 INFO:tasks.workunit.client.1.smithi194.stdout:7/394: mkdir d6/da/d2b/d56/d8a 0 2021-11-03T16:54:48.378 INFO:tasks.workunit.client.1.smithi194.stdout:7/395: readlink d6/l18 0 2021-11-03T16:54:48.378 INFO:tasks.workunit.client.0.smithi026.stdout:9/180: mknod d2/c3d 1 2021-11-03T16:54:48.380 INFO:tasks.workunit.client.0.smithi026.stdout:8/139: mkdir d2/da/d14/d22/d2d 0 2021-11-03T16:54:48.390 INFO:tasks.workunit.client.1.smithi194.stdout:6/403: creat de/d1f/d70/f8a x:0 0 0 2021-11-03T16:54:48.393 INFO:tasks.workunit.client.1.smithi194.stdout:9/396: unlink fd 0 2021-11-03T16:54:48.393 INFO:tasks.workunit.client.1.smithi194.stdout:5/384: dwrite d2/dd/d35/d38/f65 [0,4194304] 0 2021-11-03T16:54:48.394 INFO:tasks.workunit.client.1.smithi194.stdout:5/385: mknod d2/dd/d35/d38/c89 1 2021-11-03T16:54:48.395 INFO:tasks.workunit.client.0.smithi026.stdout:9/181: truncate d2/d1f/f3b 51871 0 2021-11-03T16:54:48.396 INFO:tasks.workunit.client.1.smithi194.stdout:7/396: rmdir d6/d43/d46 39 2021-11-03T16:54:48.397 INFO:tasks.workunit.client.0.smithi026.stdout:8/140: truncate d2/ff 3099264 0 2021-11-03T16:54:48.399 INFO:tasks.workunit.client.1.smithi194.stdout:6/404: link de/d21/f37 de/d1f/d43/d55/f8b 0 2021-11-03T16:54:48.400 INFO:tasks.workunit.client.1.smithi194.stdout:9/397: dread f3 [0,4194304] 0 2021-11-03T16:54:48.400 INFO:tasks.workunit.client.0.smithi026.stdout:9/182: creat d2/d27/d2b/f3e x:0 0 0 2021-11-03T16:54:48.403 INFO:tasks.workunit.client.0.smithi026.stdout:8/141: rename d2/da/f27 to d2/da/d14/d22/d2d/f2e 0 2021-11-03T16:54:48.407 INFO:tasks.workunit.client.1.smithi194.stdout:9/398: dread f2 [0,4194304] 0 2021-11-03T16:54:48.407 INFO:tasks.workunit.client.1.smithi194.stdout:9/399: write d19/d33/d6b/d30/d53/d68/d52/f77 [106197,33977] 0 2021-11-03T16:54:48.412 INFO:tasks.workunit.client.0.smithi026.stdout:8/142: rename d2/da/d14/d1b to d2/da/d14/d2f 0 2021-11-03T16:54:48.413 INFO:tasks.workunit.client.0.smithi026.stdout:8/143: stat d2/da/d14/d2f/f20 0 2021-11-03T16:54:48.414 INFO:tasks.workunit.client.1.smithi194.stdout:5/386: read d2/f23 [429463,6129] 0 2021-11-03T16:54:48.414 INFO:tasks.workunit.client.1.smithi194.stdout:5/387: chown d2/dd/d70/f87 156 1 2021-11-03T16:54:48.414 INFO:tasks.workunit.client.1.smithi194.stdout:5/388: chown d2/dd/f53 1028 1 2021-11-03T16:54:48.418 INFO:tasks.workunit.client.0.smithi026.stdout:9/183: rename d2/d39/f29 to d2/d1f/d1c/d30/f3f 0 2021-11-03T16:54:48.418 INFO:tasks.workunit.client.0.smithi026.stdout:9/184: write d2/d1f/f3b [665478,33957] 0 2021-11-03T16:54:48.420 INFO:tasks.workunit.client.1.smithi194.stdout:7/397: rename d6/d4c/d54/d89 to d6/da/d2b/d56/d8b 0 2021-11-03T16:54:48.427 INFO:tasks.workunit.client.0.smithi026.stdout:8/144: creat d2/da/d14/d22/f30 x:0 0 0 2021-11-03T16:54:48.429 INFO:tasks.workunit.client.0.smithi026.stdout:9/185: mknod d2/c40 1 2021-11-03T16:54:48.431 INFO:tasks.workunit.client.1.smithi194.stdout:9/400: mkdir d19/d33/d6b/d30/d53/d68/d4e/d88 0 2021-11-03T16:54:48.432 INFO:tasks.workunit.client.0.smithi026.stdout:8/145: symlink d2/da/d14/l31 0 2021-11-03T16:54:48.434 INFO:tasks.workunit.client.1.smithi194.stdout:5/389: mkdir d2/dd/d35/d8a 0 2021-11-03T16:54:48.441 INFO:tasks.workunit.client.0.smithi026.stdout:8/146: getdents d2/da/d14/d22 0 2021-11-03T16:54:48.443 INFO:tasks.workunit.client.1.smithi194.stdout:7/398: getdents d6/d4c 0 2021-11-03T16:54:48.446 INFO:tasks.workunit.client.1.smithi194.stdout:6/405: symlink de/l8c 0 2021-11-03T16:54:48.454 INFO:tasks.workunit.client.1.smithi194.stdout:9/401: mkdir d19/d50/d60/d89 0 2021-11-03T16:54:48.454 INFO:tasks.workunit.client.1.smithi194.stdout:9/402: mknod d19/d50/d60/d89/c8a 1 2021-11-03T16:54:48.454 INFO:tasks.workunit.client.1.smithi194.stdout:9/403: readlink l7 0 2021-11-03T16:54:48.455 INFO:tasks.workunit.client.1.smithi194.stdout:9/404: chown d19/d33/d6b/f46 3 1 2021-11-03T16:54:48.455 INFO:tasks.workunit.client.0.smithi026.stdout:8/147: mkdir d2/da/d14/d32 0 2021-11-03T16:54:48.458 INFO:tasks.workunit.client.1.smithi194.stdout:7/399: truncate d6/da/d2b/d56/f48 2006647 0 2021-11-03T16:54:48.461 INFO:tasks.workunit.client.1.smithi194.stdout:6/406: getdents de/d1f/d70 0 2021-11-03T16:54:48.475 INFO:tasks.workunit.client.1.smithi194.stdout:7/400: rmdir d6/d43/d46 39 2021-11-03T16:54:48.475 INFO:tasks.workunit.client.1.smithi194.stdout:9/405: creat d19/d33/d6b/d30/f8b x:0 0 0 2021-11-03T16:54:48.475 INFO:tasks.workunit.client.1.smithi194.stdout:7/401: write d6/da/d2b/f7b [795615,43209] 0 2021-11-03T16:54:48.476 INFO:tasks.workunit.client.1.smithi194.stdout:9/406: creat d19/d33/d6b/d30/d53/d68/d4e/f8c x:0 0 0 2021-11-03T16:54:48.477 INFO:tasks.workunit.client.1.smithi194.stdout:9/407: write d19/d33/d6b/f4b [826781,9237] 0 2021-11-03T16:54:48.487 INFO:tasks.workunit.client.1.smithi194.stdout:6/407: dwrite de/d1f/d32/f77 [0,4194304] 0 2021-11-03T16:54:48.488 INFO:tasks.workunit.client.1.smithi194.stdout:6/408: creat de/f8d x:0 0 0 2021-11-03T16:54:48.488 INFO:tasks.workunit.client.1.smithi194.stdout:6/409: mknod de/d21/d61/d7a/c8e 1 2021-11-03T16:54:48.512 INFO:tasks.workunit.client.1.smithi194.stdout:1/221: sync 2021-11-03T16:54:48.514 INFO:tasks.workunit.client.1.smithi194.stdout:1/222: creat d2/da/d2e/d2f/f44 x:0 0 0 2021-11-03T16:54:48.518 INFO:tasks.workunit.client.1.smithi194.stdout:1/223: creat d2/d1e/d41/f45 x:0 0 0 2021-11-03T16:54:48.519 INFO:tasks.workunit.client.1.smithi194.stdout:6/410: dwrite de/d21/d41/f6e [4194304,4194304] 0 2021-11-03T16:54:48.523 INFO:tasks.workunit.client.1.smithi194.stdout:7/402: dread d6/f20 [0,4194304] 0 2021-11-03T16:54:48.523 INFO:tasks.workunit.client.1.smithi194.stdout:9/408: dread f13 [0,4194304] 0 2021-11-03T16:54:48.524 INFO:tasks.workunit.client.1.smithi194.stdout:9/409: fsync d19/d33/d6b/f37 0 2021-11-03T16:54:48.524 INFO:tasks.workunit.client.1.smithi194.stdout:9/410: chown d19/f1e 108890 1 2021-11-03T16:54:48.524 INFO:tasks.workunit.client.1.smithi194.stdout:9/411: write d19/d33/d6b/d30/d53/d68/d4e/d54/d61/f71 [367584,99905] 0 2021-11-03T16:54:48.529 INFO:tasks.workunit.client.1.smithi194.stdout:6/411: creat de/d21/d2d/f8f x:0 0 0 2021-11-03T16:54:48.536 INFO:tasks.workunit.client.1.smithi194.stdout:7/403: dwrite d6/f57 [0,4194304] 0 2021-11-03T16:54:48.536 INFO:tasks.workunit.client.1.smithi194.stdout:7/404: chown d6/da/f11 4465 1 2021-11-03T16:54:48.536 INFO:tasks.workunit.client.1.smithi194.stdout:7/405: getdents d6/d4c 0 2021-11-03T16:54:48.546 INFO:tasks.workunit.client.1.smithi194.stdout:9/412: creat d19/d50/d60/d89/f8d x:0 0 0 2021-11-03T16:54:48.549 INFO:tasks.workunit.client.1.smithi194.stdout:1/224: symlink d2/l46 0 2021-11-03T16:54:48.549 INFO:tasks.workunit.client.1.smithi194.stdout:6/412: mkdir de/d21/d61/d6f/d83/d90 0 2021-11-03T16:54:48.549 INFO:tasks.workunit.client.1.smithi194.stdout:6/413: dread - de/d21/d41/d65/f6c zero size 2021-11-03T16:54:48.550 INFO:tasks.workunit.client.1.smithi194.stdout:6/414: chown de/d1f/d43/l50 1 1 2021-11-03T16:54:48.550 INFO:tasks.workunit.client.1.smithi194.stdout:1/225: write d2/da/d2e/d2f/f44 [831888,45772] 0 2021-11-03T16:54:48.550 INFO:tasks.workunit.client.1.smithi194.stdout:1/226: write d2/da/d13/f17 [514492,87319] 0 2021-11-03T16:54:48.557 INFO:tasks.workunit.client.1.smithi194.stdout:9/413: creat d19/d33/d6b/d30/d53/d68/d52/f8e x:0 0 0 2021-11-03T16:54:48.557 INFO:tasks.workunit.client.1.smithi194.stdout:1/227: creat d2/da/d13/f47 x:0 0 0 2021-11-03T16:54:48.557 INFO:tasks.workunit.client.1.smithi194.stdout:1/228: stat d2/f27 0 2021-11-03T16:54:48.558 INFO:tasks.workunit.client.1.smithi194.stdout:7/406: dwrite d6/d15/f70 [0,4194304] 0 2021-11-03T16:54:48.558 INFO:tasks.workunit.client.1.smithi194.stdout:7/407: write d6/da/d2b/f53 [4596567,70452] 0 2021-11-03T16:54:48.559 INFO:tasks.workunit.client.1.smithi194.stdout:1/229: creat d2/d1e/f48 x:0 0 0 2021-11-03T16:54:48.560 INFO:tasks.workunit.client.1.smithi194.stdout:9/414: mkdir d19/d33/d6b/d30/d53/d68/d4e/d5f/d8f 0 2021-11-03T16:54:48.561 INFO:tasks.workunit.client.1.smithi194.stdout:9/415: write d19/d38/f87 [335864,23575] 0 2021-11-03T16:54:48.562 INFO:tasks.workunit.client.1.smithi194.stdout:7/408: write d6/da/f5a [408919,116842] 0 2021-11-03T16:54:48.564 INFO:tasks.workunit.client.1.smithi194.stdout:7/409: read d6/da/d2b/f45 [854982,63603] 0 2021-11-03T16:54:48.565 INFO:tasks.workunit.client.1.smithi194.stdout:6/415: dwrite de/d1f/d43/d55/f8b [0,4194304] 0 2021-11-03T16:54:48.565 INFO:tasks.workunit.client.1.smithi194.stdout:9/416: truncate d19/d33/d6b/d30/d53/f84 825538 0 2021-11-03T16:54:48.566 INFO:tasks.workunit.client.1.smithi194.stdout:1/230: symlink d2/l49 0 2021-11-03T16:54:48.567 INFO:tasks.workunit.client.1.smithi194.stdout:6/416: write de/f67 [2896548,106490] 0 2021-11-03T16:54:48.569 INFO:tasks.workunit.client.1.smithi194.stdout:7/410: mkdir d6/d4c/d54/d8c 0 2021-11-03T16:54:48.569 INFO:tasks.workunit.client.1.smithi194.stdout:1/231: dread d2/d1e/d23/f29 [0,4194304] 0 2021-11-03T16:54:48.569 INFO:tasks.workunit.client.1.smithi194.stdout:1/232: readlink d2/da/d2b/l3d 0 2021-11-03T16:54:48.570 INFO:tasks.workunit.client.1.smithi194.stdout:7/411: read d6/d43/f36 [3784458,16218] 0 2021-11-03T16:54:48.570 INFO:tasks.workunit.client.1.smithi194.stdout:7/412: chown d6/d15/d50 89 1 2021-11-03T16:54:48.570 INFO:tasks.workunit.client.1.smithi194.stdout:9/417: truncate d19/f1e 224530 0 2021-11-03T16:54:48.571 INFO:tasks.workunit.client.1.smithi194.stdout:6/417: creat de/d1f/d43/d55/d74/f91 x:0 0 0 2021-11-03T16:54:48.573 INFO:tasks.workunit.client.1.smithi194.stdout:1/233: mknod d2/c4a 1 2021-11-03T16:54:48.573 INFO:tasks.workunit.client.1.smithi194.stdout:1/234: write d2/f18 [425976,13256] 0 2021-11-03T16:54:48.574 INFO:tasks.workunit.client.1.smithi194.stdout:1/235: dread - d2/da/d2b/f43 zero size 2021-11-03T16:54:48.575 INFO:tasks.workunit.client.1.smithi194.stdout:7/413: truncate d6/f23 618429 0 2021-11-03T16:54:48.576 INFO:tasks.workunit.client.1.smithi194.stdout:7/414: truncate d6/d32/f7d 228318 0 2021-11-03T16:54:48.576 INFO:tasks.workunit.client.1.smithi194.stdout:9/418: dread d19/d33/f3b [0,4194304] 0 2021-11-03T16:54:48.577 INFO:tasks.workunit.client.1.smithi194.stdout:7/415: write d6/da/f11 [261644,20915] 0 2021-11-03T16:54:48.578 INFO:tasks.workunit.client.1.smithi194.stdout:7/416: chown d6/d32/f7d 984904580 1 2021-11-03T16:54:48.578 INFO:tasks.workunit.client.1.smithi194.stdout:7/417: fdatasync d6/da/d2b/f45 0 2021-11-03T16:54:48.581 INFO:tasks.workunit.client.1.smithi194.stdout:1/236: creat d2/d1e/d41/f4b x:0 0 0 2021-11-03T16:54:48.581 INFO:tasks.workunit.client.1.smithi194.stdout:1/237: fsync d2/da/d2e/d2f/f44 0 2021-11-03T16:54:48.583 INFO:tasks.workunit.client.1.smithi194.stdout:9/419: link d19/d33/d6b/f2c d19/d33/d7b/f90 0 2021-11-03T16:54:48.583 INFO:tasks.workunit.client.1.smithi194.stdout:9/420: chown d19/d33/d6b/d30/d53/d68/d52 50044280 1 2021-11-03T16:54:48.586 INFO:tasks.workunit.client.1.smithi194.stdout:7/418: creat d6/d15/d85/d86/f8d x:0 0 0 2021-11-03T16:54:48.586 INFO:tasks.workunit.client.1.smithi194.stdout:7/419: fdatasync d6/da/f10 0 2021-11-03T16:54:48.598 INFO:tasks.workunit.client.1.smithi194.stdout:1/238: mkdir d2/da/d4c 0 2021-11-03T16:54:48.602 INFO:tasks.workunit.client.1.smithi194.stdout:7/420: symlink d6/d43/d46/d4e/l8e 0 2021-11-03T16:54:48.602 INFO:tasks.workunit.client.1.smithi194.stdout:9/421: mkdir d19/d38/d91 0 2021-11-03T16:54:48.603 INFO:tasks.workunit.client.1.smithi194.stdout:1/239: creat d2/d1e/f4d x:0 0 0 2021-11-03T16:54:48.603 INFO:tasks.workunit.client.1.smithi194.stdout:1/240: chown d2/l49 3 1 2021-11-03T16:54:48.605 INFO:tasks.workunit.client.1.smithi194.stdout:7/421: link d6/da/f62 d6/d4c/d54/f8f 0 2021-11-03T16:54:48.606 INFO:tasks.workunit.client.1.smithi194.stdout:9/422: symlink d19/d50/d60/l92 0 2021-11-03T16:54:48.607 INFO:tasks.workunit.client.1.smithi194.stdout:1/241: link d2/f6 d2/da/d2e/f4e 0 2021-11-03T16:54:48.609 INFO:tasks.workunit.client.1.smithi194.stdout:9/423: unlink d19/d50/f56 0 2021-11-03T16:54:48.612 INFO:tasks.workunit.client.1.smithi194.stdout:1/242: rename d2/d1e/d23/f3b to d2/da/d13/f4f 0 2021-11-03T16:54:48.613 INFO:tasks.workunit.client.1.smithi194.stdout:9/424: creat d19/d50/f93 x:0 0 0 2021-11-03T16:54:48.621 INFO:tasks.workunit.client.1.smithi194.stdout:7/422: dwrite d6/da/d2b/f7b [0,4194304] 0 2021-11-03T16:54:48.621 INFO:tasks.workunit.client.1.smithi194.stdout:7/423: write d6/d4c/d54/d5b/f7f [873421,45602] 0 2021-11-03T16:54:48.621 INFO:tasks.workunit.client.1.smithi194.stdout:7/424: chown d6/d15/l39 411511 1 2021-11-03T16:54:48.627 INFO:tasks.workunit.client.1.smithi194.stdout:7/425: link f4 d6/d15/d85/f90 0 2021-11-03T16:54:48.627 INFO:tasks.workunit.client.1.smithi194.stdout:7/426: chown d6/d32/l3f 2498 1 2021-11-03T16:54:48.632 INFO:tasks.workunit.client.1.smithi194.stdout:1/243: dwrite d2/da/f2c [0,4194304] 0 2021-11-03T16:54:48.632 INFO:tasks.workunit.client.1.smithi194.stdout:1/244: fsync d2/d1e/f48 0 2021-11-03T16:54:48.633 INFO:tasks.workunit.client.1.smithi194.stdout:1/245: dread - d2/da/d13/f47 zero size 2021-11-03T16:54:48.634 INFO:tasks.workunit.client.1.smithi194.stdout:1/246: write d2/da/f2a [5379779,105094] 0 2021-11-03T16:54:48.634 INFO:tasks.workunit.client.1.smithi194.stdout:7/427: dread d6/d15/f82 [0,4194304] 0 2021-11-03T16:54:48.649 INFO:tasks.workunit.client.1.smithi194.stdout:1/247: dwrite d2/f18 [0,4194304] 0 2021-11-03T16:54:48.651 INFO:tasks.workunit.client.1.smithi194.stdout:7/428: rename d6/d4c/d54/d5b/f71 to d6/d43/f91 0 2021-11-03T16:54:48.655 INFO:tasks.workunit.client.1.smithi194.stdout:1/248: truncate d2/f1f 463218 0 2021-11-03T16:54:48.656 INFO:tasks.workunit.client.1.smithi194.stdout:1/249: chown d2/da/d2e/f4e 4459872 1 2021-11-03T16:54:48.657 INFO:tasks.workunit.client.1.smithi194.stdout:1/250: write d2/f20 [6127707,90715] 0 2021-11-03T16:54:48.657 INFO:tasks.workunit.client.1.smithi194.stdout:7/429: symlink d6/d43/d46/d60/l92 0 2021-11-03T16:54:48.657 INFO:tasks.workunit.client.1.smithi194.stdout:7/430: fdatasync d6/d43/f91 0 2021-11-03T16:54:48.669 INFO:tasks.workunit.client.1.smithi194.stdout:7/431: dread d6/da/d2b/f37 [0,4194304] 0 2021-11-03T16:54:48.674 INFO:tasks.workunit.client.1.smithi194.stdout:1/251: dwrite d2/da/d2e/f4e [0,4194304] 0 2021-11-03T16:54:48.676 INFO:tasks.workunit.client.1.smithi194.stdout:1/252: symlink d2/da/d2e/l50 0 2021-11-03T16:54:48.679 INFO:tasks.workunit.client.1.smithi194.stdout:1/253: rename d2/f15 to d2/d1e/d23/f51 0 2021-11-03T16:54:48.679 INFO:tasks.workunit.client.1.smithi194.stdout:1/254: mknod d2/da/d2e/d2f/c52 1 2021-11-03T16:54:48.679 INFO:tasks.workunit.client.1.smithi194.stdout:1/255: truncate d2/da/f2a 8679786 0 2021-11-03T16:54:48.680 INFO:tasks.workunit.client.1.smithi194.stdout:1/256: mknod d2/da/c53 1 2021-11-03T16:54:48.680 INFO:tasks.workunit.client.1.smithi194.stdout:1/257: write d2/da/f2c [2407815,86077] 0 2021-11-03T16:54:48.681 INFO:tasks.workunit.client.1.smithi194.stdout:1/258: mknod d2/da/d2e/d2f/c54 1 2021-11-03T16:54:48.681 INFO:tasks.workunit.client.1.smithi194.stdout:1/259: fdatasync d2/d1e/d23/f51 0 2021-11-03T16:54:48.682 INFO:tasks.workunit.client.1.smithi194.stdout:1/260: truncate d2/da/d13/f14 2716597 0 2021-11-03T16:54:48.685 INFO:tasks.workunit.client.1.smithi194.stdout:7/432: dwrite d6/d15/d85/f90 [8388608,4194304] 0 2021-11-03T16:54:48.685 INFO:tasks.workunit.client.1.smithi194.stdout:1/261: rename d2/da/d4c to d2/d1e/d55 0 2021-11-03T16:54:48.685 INFO:tasks.workunit.client.1.smithi194.stdout:1/262: chown d2/da/f2c 6222769 1 2021-11-03T16:54:48.686 INFO:tasks.workunit.client.1.smithi194.stdout:7/433: write d6/da/d2b/f37 [755523,109098] 0 2021-11-03T16:54:48.687 INFO:tasks.workunit.client.1.smithi194.stdout:1/263: symlink d2/da/d2e/l56 0 2021-11-03T16:54:48.691 INFO:tasks.workunit.client.1.smithi194.stdout:7/434: symlink d6/d4c/d54/d5b/d77/l93 0 2021-11-03T16:54:48.691 INFO:tasks.workunit.client.1.smithi194.stdout:7/435: chown d6/d43/d46/d4e/d5f 8672 1 2021-11-03T16:54:48.691 INFO:tasks.workunit.client.1.smithi194.stdout:7/436: mknod d6/d4c/d54/d5b/c94 1 2021-11-03T16:54:48.691 INFO:tasks.workunit.client.1.smithi194.stdout:7/437: chown d6/d43/d46/l61 1 1 2021-11-03T16:54:48.708 INFO:tasks.workunit.client.1.smithi194.stdout:1/264: dwrite d2/d1e/d41/f4b [0,4194304] 0 2021-11-03T16:54:48.708 INFO:tasks.workunit.client.1.smithi194.stdout:1/265: readlink d2/da/l42 0 2021-11-03T16:54:48.708 INFO:tasks.workunit.client.1.smithi194.stdout:1/266: fdatasync d2/d1e/d23/f51 0 2021-11-03T16:54:48.709 INFO:tasks.workunit.client.1.smithi194.stdout:7/438: dwrite d6/d43/d46/d4e/f5d [0,4194304] 0 2021-11-03T16:54:48.709 INFO:tasks.workunit.client.1.smithi194.stdout:7/439: chown d6/d15/f70 6 1 2021-11-03T16:54:48.710 INFO:tasks.workunit.client.1.smithi194.stdout:7/440: readlink d6/l18 0 2021-11-03T16:54:48.714 INFO:tasks.workunit.client.1.smithi194.stdout:7/441: dread d6/da/d2b/f45 [0,4194304] 0 2021-11-03T16:54:48.716 INFO:tasks.workunit.client.1.smithi194.stdout:7/442: dread d6/d4c/d54/d5b/f7f [0,4194304] 0 2021-11-03T16:54:48.717 INFO:tasks.workunit.client.1.smithi194.stdout:1/267: dread d2/f27 [0,4194304] 0 2021-11-03T16:54:48.718 INFO:tasks.workunit.client.1.smithi194.stdout:1/268: fsync d2/da/d13/f14 0 2021-11-03T16:54:48.718 INFO:tasks.workunit.client.1.smithi194.stdout:1/269: dread d2/f10 [0,4194304] 0 2021-11-03T16:54:48.719 INFO:tasks.workunit.client.1.smithi194.stdout:1/270: write d2/d1e/d41/f45 [756920,61894] 0 2021-11-03T16:54:48.719 INFO:tasks.workunit.client.1.smithi194.stdout:7/443: creat d6/da/d2b/d56/d8b/f95 x:0 0 0 2021-11-03T16:54:48.719 INFO:tasks.workunit.client.1.smithi194.stdout:7/444: fsync d6/d4c/f7c 0 2021-11-03T16:54:48.720 INFO:tasks.workunit.client.1.smithi194.stdout:7/445: read d6/d15/f70 [205332,62689] 0 2021-11-03T16:54:48.721 INFO:tasks.workunit.client.1.smithi194.stdout:1/271: link d2/f1f d2/da/d2e/f57 0 2021-11-03T16:54:48.723 INFO:tasks.workunit.client.1.smithi194.stdout:1/272: creat d2/da/f58 x:0 0 0 2021-11-03T16:54:48.723 INFO:tasks.workunit.client.1.smithi194.stdout:1/273: write d2/d1e/f32 [653025,114510] 0 2021-11-03T16:54:48.726 INFO:tasks.workunit.client.1.smithi194.stdout:1/274: unlink d2/da/l42 0 2021-11-03T16:54:48.742 INFO:tasks.workunit.client.1.smithi194.stdout:7/446: dwrite d6/d15/f40 [0,4194304] 0 2021-11-03T16:54:48.742 INFO:tasks.workunit.client.1.smithi194.stdout:1/275: dwrite d2/d1e/f4d [0,4194304] 0 2021-11-03T16:54:48.765 INFO:tasks.workunit.client.1.smithi194.stdout:2/429: sync 2021-11-03T16:54:48.767 INFO:tasks.workunit.client.1.smithi194.stdout:7/447: dwrite d6/d43/f36 [4194304,4194304] 0 2021-11-03T16:54:48.767 INFO:tasks.workunit.client.1.smithi194.stdout:7/448: mknod d6/da/d2b/c96 1 2021-11-03T16:54:48.767 INFO:tasks.workunit.client.1.smithi194.stdout:1/276: dwrite d2/da/d2b/f43 [0,4194304] 0 2021-11-03T16:54:48.768 INFO:tasks.workunit.client.1.smithi194.stdout:2/430: creat d6/de/d16/d20/f83 x:0 0 0 2021-11-03T16:54:48.768 INFO:tasks.workunit.client.1.smithi194.stdout:1/277: write d2/fd [1137709,22805] 0 2021-11-03T16:54:48.770 INFO:tasks.workunit.client.1.smithi194.stdout:7/449: mkdir d6/d15/d97 0 2021-11-03T16:54:48.770 INFO:tasks.workunit.client.1.smithi194.stdout:1/278: creat d2/d1e/f59 x:0 0 0 2021-11-03T16:54:48.772 INFO:tasks.workunit.client.1.smithi194.stdout:7/450: symlink d6/da/d2b/d56/l98 0 2021-11-03T16:54:48.777 INFO:tasks.workunit.client.1.smithi194.stdout:7/451: symlink d6/d15/d85/d86/l99 0 2021-11-03T16:54:48.795 INFO:tasks.workunit.client.1.smithi194.stdout:1/279: dwrite d2/da/d13/f4f [0,4194304] 0 2021-11-03T16:54:48.799 INFO:tasks.workunit.client.1.smithi194.stdout:1/280: creat d2/d1e/d55/f5a x:0 0 0 2021-11-03T16:54:48.804 INFO:tasks.workunit.client.1.smithi194.stdout:2/431: dwrite d6/de/d16/f50 [0,4194304] 0 2021-11-03T16:54:48.804 INFO:tasks.workunit.client.1.smithi194.stdout:2/432: stat d6/d17/l1b 0 2021-11-03T16:54:48.806 INFO:tasks.workunit.client.1.smithi194.stdout:7/452: dwrite d6/da/d2b/f45 [0,4194304] 0 2021-11-03T16:54:48.806 INFO:tasks.workunit.client.1.smithi194.stdout:7/453: mknod d6/d15/d50/c9a 1 2021-11-03T16:54:48.806 INFO:tasks.workunit.client.1.smithi194.stdout:2/433: unlink d6/de/f57 0 2021-11-03T16:54:48.807 INFO:tasks.workunit.client.1.smithi194.stdout:7/454: symlink d6/d43/d46/d60/l9b 0 2021-11-03T16:54:48.814 INFO:tasks.workunit.client.1.smithi194.stdout:2/434: write d6/f48 [2236393,45417] 0 2021-11-03T16:54:48.814 INFO:tasks.workunit.client.1.smithi194.stdout:2/435: chown d6/de/d16/d20/f5b 126107 1 2021-11-03T16:54:48.821 INFO:tasks.workunit.client.1.smithi194.stdout:1/281: dwrite d2/d1e/d23/f29 [0,4194304] 0 2021-11-03T16:54:48.821 INFO:tasks.workunit.client.1.smithi194.stdout:7/455: dread d6/f57 [0,4194304] 0 2021-11-03T16:54:48.822 INFO:tasks.workunit.client.1.smithi194.stdout:7/456: dread - d6/d4c/f7c zero size 2021-11-03T16:54:48.822 INFO:tasks.workunit.client.1.smithi194.stdout:7/457: stat d6/d15/d85/d86/l99 0 2021-11-03T16:54:48.829 INFO:tasks.workunit.client.1.smithi194.stdout:1/282: creat d2/da/d2e/f5b x:0 0 0 2021-11-03T16:54:48.842 INFO:tasks.workunit.client.1.smithi194.stdout:7/458: dwrite d6/d43/d46/d4e/d5f/f83 [0,4194304] 0 2021-11-03T16:54:48.843 INFO:tasks.workunit.client.1.smithi194.stdout:7/459: fdatasync d6/da/d2b/f42 0 2021-11-03T16:54:48.849 INFO:tasks.workunit.client.1.smithi194.stdout:7/460: rename d6/d43/d46 to d6/d32/d9c 0 2021-11-03T16:54:48.849 INFO:tasks.workunit.client.1.smithi194.stdout:7/461: chown d6/d15/d85 0 1 2021-11-03T16:54:48.857 INFO:tasks.workunit.client.1.smithi194.stdout:7/462: creat d6/d15/d97/f9d x:0 0 0 2021-11-03T16:54:48.860 INFO:tasks.workunit.client.1.smithi194.stdout:7/463: creat d6/da/d2b/d56/d8a/f9e x:0 0 0 2021-11-03T16:54:48.881 INFO:tasks.workunit.client.1.smithi194.stdout:7/464: dwrite d6/f2a [0,4194304] 0 2021-11-03T16:54:48.884 INFO:tasks.workunit.client.1.smithi194.stdout:7/465: chown d6/d4c/d54/d5b/l6c 0 1 2021-11-03T16:54:48.884 INFO:tasks.workunit.client.1.smithi194.stdout:7/466: write d6/da/d2b/f4b [431768,77976] 0 2021-11-03T16:54:48.884 INFO:tasks.workunit.client.1.smithi194.stdout:7/467: write d6/d4c/f7c [133299,102277] 0 2021-11-03T16:54:49.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:48 smithi194 conmon[35111]: cluster 2021-11-03T16:54:47.960241+0000 mon.smithi026 (mon.0) 576 : cluster [DBG] mgrmap e20: smithi194.wnexas(active, starting, since 0.68349s) 2021-11-03T16:54:49.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:48 smithi194 conmon[35111]: audit 2021-11-03T16:54:47.964656+0000 mon.smithi194 (mon.1) 19 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "mon metadata", "id": "smithi026"}]: dispatch 2021-11-03T16:54:49.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:48 smithi194 conmon[35111]: audit 2021-11-03T16:54:47.964883+0000 mon.smithi194 (mon.1) 20 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2021-11-03T16:54:49.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:48 smithi194 conmon[35111]: audit 2021-11-03T16:54:47.965233+0000 mon.smithi194 (mon.1) 21 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.ltacyh"}]: dispatch 2021-11-03T16:54:49.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:48 smithi194 conmon[35111]: audit 2021-11-03T16:54:47.965333+0000 mon.smithi194 (mon.1) 22 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.yfxlxl"}]: dispatch 2021-11-03T16:54:49.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:48 smithi194 conmon[35111]: audit 2021-11-03T16:54:47.965414+0000 mon.smithi194 (mon.1) 23 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.kwikhp"}]: dispatch 2021-11-03T16:54:49.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:48 smithi194 conmon[35111]: audit 2021-11-03T 2021-11-03T16:54:49.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:48 smithi194 conmon[35111]: 16:54:47.965491+0000 mon.smithi194 (mon.1) 24 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.mpotdl"}]: dispatch 2021-11-03T16:54:49.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:48 smithi194 conmon[35111]: audit 2021-11-03T16:54:47.966031+0000 mon.smithi194 (mon.1) 25 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "mgr metadata", "who": "smithi194.wnexas", "id": "smithi194.wnexas"}]: dispatch 2021-11-03T16:54:49.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:48 smithi194 conmon[35111]: audit 2021-11-03T16:54:47.966265+0000 mon.smithi194 (mon.1) 26 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-11-03T16:54:49.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:48 smithi194 conmon[35111]: audit 2021-11-03T16:54:47.966354+0000 mon.smithi194 (mon.1) 27 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-11-03T16:54:49.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:48 smithi194 conmon[35111]: audit 2021-11-03T16:54:47.966436+0000 mon.smithi194 (mon.1) 28 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-11-03T16:54:49.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:48 smithi194 conmon[35111]: audit 2021-11-03T16:54:47.966551+0000 mon.smithi194 (mon.1) 29 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-11-03T16:54:49.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:48 smithi194 conmon[35111]: audit 2021-11-03T16:54:47.966637+0000 mon.smithi194 (mon.1) 30 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-11-03T16:54:49.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:48 smithi194 conmon[35111]: audit 2021-11-03T16:54:47.966722+0000 mon.smithi194 (mon.1) 31 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-11-03T16:54:49.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:48 smithi194 conmon[35111]: audit 2021-11-03T16:54:47.968686+0000 mon.smithi194 (mon.1) 32 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-11-03T16:54:49.255 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:48 smithi194 conmon[35111]: audit 2021-11-03T16:54:47.968814+0000 mon.smithi194 (mon.1) 33 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-11-03T16:54:49.255 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:48 smithi194 conmon[35111]: audit 2021-11-03T16:54:47.973939+0000 mon.smithi194 (mon.1) 34 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-11-03T16:54:49.255 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:48 smithi194 conmon[35111]: cluster 2021-11-03T16:54:47.994145+0000 mon.smithi026 (mon.0) 577 : cluster [INF] Manager daemon smithi194.wnexas is now available 2021-11-03T16:54:49.255 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:48 smithi194 conmon[35111]: audit 2021-11-03T16:54:48.019902+0000 mon.smithi194 (mon.1) 35 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:54:49.255 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:48 smithi194 conmon[35111]: audit 2021-11-03T16:54:48.022283+0000 mon.smithi194 (mon.1) 36 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:54:49.256 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:48 smithi194 conmon[35111]: audit 2021-11-03T16:54:48.028792+0000 mon.smithi194 (mon.1) 37 : audit [INF] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr"}]: dispatch 2021-11-03T16:54:49.256 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:48 smithi194 conmon[35111]: audit 2021-11-03T16:54:48.029525+0000 mon.smithi026 (mon.0) 578 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr"}]: dispatch 2021-11-03T16:54:49.256 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:48 smithi194 conmon[35111]: audit 2021-11-03T16:54:48.042979+0000 mon.smithi026 (mon.0) 579 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' 2021-11-03T16:54:49.256 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:48 smithi194 conmon[35111]: audit 2021-11-03T16:54:48.068339+0000 mon.smithi194 (mon.1) 38 : audit [INF] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi194.wnexas/mirror_snapshot_schedule"}]: dispatch 2021-11-03T16:54:49.257 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:48 smithi194 conmon[35111]: audit 2021-11-03T16:54:48.068615+0000 mon.smithi026 (mon.0) 580 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi194.wnexas/mirror_snapshot_schedule"}]: dispatch 2021-11-03T16:54:49.257 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:48 smithi194 conmon[35111]: audit 2021-11-03T16:54:48.076900+0000 mon.smithi194 (mon.1) 39 : audit [INF] 2021-11-03T16:54:49.257 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:48 smithi194 conmon[35111]: from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi194.wnexas/trash_purge_schedule"}]: dispatch 2021-11-03T16:54:49.257 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:48 smithi194 conmon[35111]: audit 2021-11-03T16:54:48.078164+0000 mon.smithi026 (mon.0) 581 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi194.wnexas/trash_purge_schedule"}]: dispatch 2021-11-03T16:54:49.318 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:48 smithi026 conmon[32119]: cluster 2021-11-03T16:54:47.960241+0000 mon.smithi026 (mon.0) 576 : cluster [DBG] mgrmap e20: smithi194.wnexas(active, starting, since 0.68349s) 2021-11-03T16:54:49.319 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:48 smithi026 conmon[32119]: audit 2021-11-03T16:54:47.964656+0000 mon.smithi194 (mon.1) 19 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "mon metadata", "id": "smithi026"}]: dispatch 2021-11-03T16:54:49.319 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:48 smithi026 conmon[32119]: audit 2021-11-03T16:54:47.964883+0000 mon.smithi194 (mon.1) 20 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2021-11-03T16:54:49.319 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:48 smithi026 conmon[32119]: audit 2021-11-03T16:54:47.965233+0000 mon.smithi194 (mon.1) 21 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.ltacyh"}]: dispatch 2021-11-03T16:54:49.319 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:48 smithi026 conmon[32119]: audit 2021-11-03T16:54:47.965333+0000 mon.smithi194 (mon.1) 22 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.yfxlxl"}]: dispatch 2021-11-03T16:54:49.320 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:48 smithi026 conmon[32119]: audit 2021-11-03T16:54:47.965414+0000 mon.smithi194 (mon.1) 23 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.kwikhp"}]: dispatch 2021-11-03T16:54:49.320 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:48 smithi026 conmon[32119]: audit 2021-11-03T16:54:47.965491+0000 mon.smithi194 (mon.1) 24 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.mpotdl"}]: dispatch 2021-11-03T16:54:49.320 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:48 smithi026 conmon[32119]: audit 2021-11-03T16:54:47.966031+0000 mon.smithi194 (mon.1) 25 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "mgr metadata", "who": "smithi194.wnexas", "id": "smithi194.wnexas"}]: dispatch 2021-11-03T16:54:49.320 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:48 smithi026 conmon[32119]: audit 2021-11-03T16:54:47.966265+0000 mon.smithi194 (mon.1) 26 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-11-03T16:54:49.320 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:48 smithi026 conmon[32119]: audit 2021-11-03T16:54:47.966354+0000 mon.smithi194 (mon.1) 27 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-11-03T16:54:49.321 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:48 smithi026 conmon[32119]: audit 2021-11-03T16:54:47.966436+0000 mon.smithi194 (mon.1) 28 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-11-03T16:54:49.321 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:48 smithi026 conmon[32119]: audit 2021-11-03T16:54:47.966551+0000 mon.smithi194 (mon.1) 29 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-11-03T16:54:49.321 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:48 smithi026 conmon[32119]: audit 2021-11-03T16:54:47.966637+0000 mon.smithi194 (mon.1) 30 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-11-03T16:54:49.321 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:48 smithi026 conmon[32119]: audit 2021-11-03T16:54:47.966722+0000 mon.smithi194 (mon.1) 31 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-11-03T16:54:49.322 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:48 smithi026 conmon[32119]: audit 2021-11-03T16:54:47.968686+0000 mon.smithi194 (mon.1) 32 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-11-03T16:54:49.322 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:48 smithi026 conmon[32119]: audit 2021-11-03T16:54:47.968814+0000 mon.smithi194 (mon.1) 33 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-11-03T16:54:49.322 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:48 smithi026 conmon[32119]: audit 2021-11-03T16:54:47.973939+0000 mon.smithi194 (mon.1) 34 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-11-03T16:54:49.323 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:48 smithi026 conmon[32119]: cluster 2021-11-03T16:54:47.994145+0000 mon.smithi026 (mon.0) 577 : cluster [INF] Manager daemon smithi194.wnexas is now available 2021-11-03T16:54:49.323 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:48 smithi026 conmon[32119]: audit 2021-11-03T16:54:48.019902+0000 mon.smithi194 (mon.1) 35 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:54:49.323 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:48 smithi026 conmon[32119]: audit 2021-11-03T16:54:48.022283+0000 mon.smithi194 (mon.1) 36 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:54:49.323 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:48 smithi026 conmon[32119]: audit 2021-11-03T16:54:48.028792+0000 mon.smithi194 (mon.1) 37 : audit [INF] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr"}]: dispatch 2021-11-03T16:54:49.324 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:48 smithi026 conmon[32119]: audit 2021-11-03T16:54:48.029525+0000 mon.smithi026 (mon.0) 578 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr"}]: dispatch 2021-11-03T16:54:49.324 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:48 smithi026 conmon[32119]: audit 2021-11-03T16:54:48.042979+0000 mon.smithi026 (mon.0) 579 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' 2021-11-03T16:54:49.324 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:48 smithi026 conmon[32119]: audit 2021-11-03T16:54:48.068339+0000 mon.smithi194 (mon.1) 38 : audit [INF] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi194.wnexas/mirror_snapshot_schedule"}]: dispatch 2021-11-03T16:54:49.324 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:48 smithi026 conmon[32119]: audit 2021-11-03T16:54:48.068615+0000 mon.smithi026 (mon.0) 580 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi194.wnexas/mirror_snapshot_schedule"}]: dispatch 2021-11-03T16:54:49.324 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:48 smithi026 conmon[32119]: audit 2021-11-03T16:54:48.076900+0000 mon.smithi194 (mon.1) 39 : audit [INF] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi194.wnexas/trash_purge_schedule"}]: dispatch 2021-11-03T16:54:49.325 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:48 smithi026 conmon[32119]: audit 2021-11-03T16:54:48.078164+0000 mon.smithi026 (mon.0) 581 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi194.wnexas/trash_purge_schedule"}]: dispatch 2021-11-03T16:54:49.325 INFO:tasks.workunit.client.1.smithi194.stdout:8/323: sync 2021-11-03T16:54:49.475 INFO:tasks.workunit.client.1.smithi194.stdout:3/370: sync 2021-11-03T16:54:49.475 INFO:tasks.workunit.client.1.smithi194.stdout:3/371: read - d2/d17/d1d/f5d zero size 2021-11-03T16:54:49.475 INFO:tasks.workunit.client.1.smithi194.stdout:3/372: mknod d2/c7a 1 2021-11-03T16:54:49.475 INFO:tasks.workunit.client.1.smithi194.stdout:3/373: truncate d2/d17/d26/f42 513564 0 2021-11-03T16:54:49.476 INFO:tasks.workunit.client.1.smithi194.stdout:3/374: chown d2/d17/l67 20190792 1 2021-11-03T16:54:50.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:49 smithi194 conmon[35111]: cephadm 2021-11-03T16:54:48.596650+0000 mgr.smithi194.wnexas (mgr. 2021-11-03T16:54:50.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:49 smithi194 conmon[35111]: 24377) 1 : cephadm [INF] Deploying cephadm binary to smithi194 2021-11-03T16:54:50.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:49 smithi194 conmon[35111]: cephadm 2021-11-03T16:54:48.672241+0000 mgr.smithi194.wnexas (mgr.24377) 2 : cephadm [INF] Deploying cephadm binary to smithi026 2021-11-03T16:54:50.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:49 smithi194 conmon[35111]: audit 2021-11-03T16:54:48.976486+0000 mon.smithi026 (mon.0) 582 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' cmd='[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr"}]': finished 2021-11-03T16:54:50.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:49 smithi194 conmon[35111]: cluster 2021-11-03T16:54:48.976580+0000 mon.smithi026 (mon.0) 583 : cluster [DBG] osdmap e45: 6 total, 6 up, 6 in 2021-11-03T16:54:50.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:49 smithi194 conmon[35111]: cluster 2021-11-03T16:54:48.976818+0000 2021-11-03T16:54:50.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:49 smithi194 conmon[35111]: mon.smithi026 (mon.0) 584 : cluster [DBG] mgrmap e21: smithi194.wnexas(active, since 1.70008s) 2021-11-03T16:54:50.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:49 smithi194 conmon[35111]: audit 2021-11-03T 2021-11-03T16:54:50.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:49 smithi194 conmon[35111]: 16:54:48.990679+0000 mon.smithi194 (mon.1) 40 : audit [INF] 2021-11-03T16:54:50.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:49 smithi194 conmon[35111]: from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2021-11-03T16:54:50.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:49 smithi194 conmon[35111]: audit 2021-11-03T16:54: 2021-11-03T16:54:50.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:49 smithi194 conmon[35111]: 48.990909+0000 mon.smithi026 (mon.0) 585 : audit [INF] 2021-11-03T16:54:50.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:49 smithi194 conmon[35111]: from='mgr.24377 ' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2021-11-03T16:54:50.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:49 smithi194 conmon[35111]: cluster 2021-11-03T16:54:48.992477 2021-11-03T16:54:50.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:49 smithi194 conmon[35111]: +0000 mgr.smithi194.wnexas (mgr.24377) 3 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 1.3 GiB data, 3.9 GiB used, 533 GiB / 536 GiB avail 2021-11-03T16:54:50.402 INFO:tasks.workunit.client.0.smithi026.stdout:5/63: sync 2021-11-03T16:54:50.403 INFO:tasks.workunit.client.0.smithi026.stdout:6/82: sync 2021-11-03T16:54:50.403 INFO:tasks.workunit.client.0.smithi026.stdout:1/150: sync 2021-11-03T16:54:50.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:49 smithi026 conmon[32119]: cephadm 2021-11-03T16:54:48.596650+0000 mgr.smithi194.wnexas ( 2021-11-03T16:54:50.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:49 smithi026 conmon[32119]: mgr.24377) 1 : cephadm [INF] Deploying cephadm binary to smithi194 2021-11-03T16:54:50.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:49 smithi026 conmon[32119]: cephadm 2021-11-03T16:54:48.672241+0000 mgr.smithi194.wnexas (mgr.24377) 2 : cephadm [INF] Deploying cephadm binary to smithi026 2021-11-03T16:54:50.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:49 smithi026 conmon[32119]: audit 2021-11-03T16:54:48.976486+0000 mon.smithi026 (mon.0) 582 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' cmd='[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr"}]': finished 2021-11-03T16:54:50.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:49 smithi026 conmon[32119]: cluster 2021-11-03T16:54:48.976580+0000 mon.smithi026 (mon.0) 583 : cluster [DBG] osdmap e45: 6 total, 6 up, 6 in 2021-11-03T16:54:50.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:49 smithi026 conmon[32119]: cluster 2021-11-03T16:54:48.976818+0000 mon.smithi026 (mon.0) 584 : cluster [DBG] mgrmap e21: smithi194.wnexas(active, since 1.70008s) 2021-11-03T16:54:50.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:49 smithi026 conmon[32119]: audit 2021-11-03T16:54:48.990679+0000 mon.smithi194 (mon.1) 40 : audit [INF] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2021-11-03T16:54:50.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:49 smithi026 conmon[32119]: audit 2021-11-03T16:54:48.990909+0000 mon.smithi026 (mon.0) 585 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2021-11-03T16:54:50.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:49 smithi026 conmon[32119]: cluster 2021-11-03T16:54:48.992477+0000 mgr.smithi194.wnexas (mgr.24377) 3 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 1.3 GiB data, 3.9 GiB used, 533 GiB / 536 GiB avail 2021-11-03T16:54:50.539 INFO:tasks.workunit.client.0.smithi026.stdout:0/62: sync 2021-11-03T16:54:50.539 INFO:tasks.workunit.client.0.smithi026.stdout:0/63: fdatasync da/fd 0 2021-11-03T16:54:51.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:50 smithi194 conmon[35111]: cephadm 2021-11-03T16:54:49.282660 2021-11-03T16:54:51.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:50 smithi194 conmon[35111]: +0000 mgr.smithi194.wnexas (mgr.24377) 4 : cephadm [INF] Starting cherrypy engine... 2021-11-03T16:54:51.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:50 smithi194 conmon[35111]: cephadm 2021-11-03T16:54:49.282830 2021-11-03T16:54:51.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:50 smithi194 conmon[35111]: +0000 mgr.smithi194.wnexas (mgr.24377) 5 : cephadm [INF] [03/Nov/2021:16:54:49] ENGINE Bus STARTING 2021-11-03T16:54:51.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:50 smithi194 conmon[35111]: cephadm 2021- 2021-11-03T16:54:51.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:50 smithi194 conmon[35111]: 11-03T16:54:49. 2021-11-03T16:54:51.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:50 smithi194 conmon[35111]: 397066+0000 mgr.smithi194.wnexas (mgr. 2021-11-03T16:54:51.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:50 smithi194 conmon[35111]: 24377) 6 : cephadm [INF] [03/Nov/2021:16:54:49] ENGINE Serving on https://172.21.15.194:8499 2021-11-03T16:54:51.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:50 smithi194 conmon[35111]: 2021-11-03T16:54:51.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:50 smithi194 conmon[35111]: cephadm 2021-11-03T16:54:51.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:50 smithi194 conmon[35111]: 2021-11-03T16 2021-11-03T16:54:51.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:50 smithi194 conmon[35111]: :54:49.397178+0000 2021-11-03T16:54:51.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:50 smithi194 conmon[35111]: mgr.smithi194.wnexas (mgr.24377) 7 : 2021-11-03T16:54:51.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:50 smithi194 conmon[35111]: cephadm [INF] [03/Nov/2021:16:54:49] ENGINE Bus STARTED 2021-11-03T16:54:51.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:50 smithi194 conmon[35111]: cephadm 2021 2021-11-03T16:54:51.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:50 smithi194 conmon[35111]: -11-03T16:54:49 2021-11-03T16:54:51.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:50 smithi194 conmon[35111]: .397256+0000 mgr.smithi194.wnexas (mgr.24377 2021-11-03T16:54:51.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:50 smithi194 conmon[35111]: ) 8 : cephadm [INF] Cherrypy engine started. 2021-11-03T16:54:51.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:50 smithi194 conmon[35111]: cluster 2021 2021-11-03T16:54:51.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:50 smithi194 conmon[35111]: -11-03T16:54:49 2021-11-03T16:54:51.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:50 smithi194 conmon[35111]: .968800+0000 mgr.smithi194.wnexas (mgr. 2021-11-03T16:54:51.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:50 smithi194 conmon[35111]: 24377) 9 : cluster [DBG] pgmap v5: 65 pgs: 65 active+clean; 1.3 GiB data, 3.9 GiB used, 533 GiB / 536 GiB avail 2021-11-03T16:54:51.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:50 smithi194 conmon[35111]: 2021-11-03T16:54:51.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:50 smithi194 conmon[35111]: audit 2021 2021-11-03T16:54:51.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:50 smithi194 conmon[35111]: -11-03T16:54:49 2021-11-03T16:54:51.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:50 smithi194 conmon[35111]: .980047+0000 mon.smithi026 (mon.0 2021-11-03T16:54:51.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:50 smithi194 conmon[35111]: ) 586 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2021-11-03T16:54:51.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:50 smithi194 conmon[35111]: cluster 2021- 2021-11-03T16:54:51.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:50 smithi194 conmon[35111]: 11-03T16:54:49. 2021-11-03T16:54:51.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:50 smithi194 conmon[35111]: 980158+0000 mon.smithi026 (mon.0) 2021-11-03T16:54:51.255 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:50 smithi194 conmon[35111]: 587 : cluster [DBG] osdmap e46: 6 total, 6 up, 6 in 2021-11-03T16:54:51.255 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:50 smithi194 conmon[35111]: cluster 2021- 2021-11-03T16:54:51.255 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:50 smithi194 conmon[35111]: 11-03T16:54:49.980363 2021-11-03T16:54:51.255 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:50 smithi194 conmon[35111]: +0000 mon.smithi026 (mon.0) 588 2021-11-03T16:54:51.255 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:50 smithi194 conmon[35111]: : cluster [DBG] mgrmap e22: smithi194.wnexas(active, since 2s) 2021-11-03T16:54:51.300 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:50 smithi026 conmon[32119]: cephadm 2021-11-03T16:54:49.282660+0000 mgr.smithi194.wnexas (mgr.24377) 4 : cephadm [INF] Starting cherrypy engine... 2021-11-03T16:54:51.301 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:50 smithi026 conmon[32119]: cephadm 2021-11-03T16:54:49.282830+0000 mgr.smithi194.wnexas (mgr.24377) 5 : cephadm [INF] [03/Nov/2021:16:54:49] ENGINE Bus STARTING 2021-11-03T16:54:51.301 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:50 smithi026 conmon[32119]: cephadm 2021-11-03T16:54:49.397066+0000 mgr.smithi194.wnexas (mgr.24377) 6 : cephadm [INF] [03/Nov/2021:16:54:49] ENGINE Serving on https://172.21.15.194:8499 2021-11-03T16:54:51.302 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:50 smithi026 conmon[32119]: cephadm 2021-11-03T16:54:49.397178+0000 mgr.smithi194.wnexas (mgr.24377) 7 : cephadm [INF] [03/Nov/2021:16:54:49] ENGINE Bus STARTED 2021-11-03T16:54:51.302 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:50 smithi026 conmon[32119]: cephadm 2021-11-03T16:54:49.397256+0000 mgr.smithi194.wnexas (mgr.24377) 8 : cephadm [INF] Cherrypy engine started. 2021-11-03T16:54:51.302 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:50 smithi026 conmon[32119]: cluster 2021-11-03T16:54:49.968800+0000 mgr.smithi194.wnexas (mgr.24377) 9 : cluster [DBG] pgmap v5: 65 pgs: 65 active+clean; 1.3 GiB data, 3.9 GiB used, 533 GiB / 536 GiB avail 2021-11-03T16:54:51.302 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:50 smithi026 conmon[32119]: audit 2021-11-03T16:54:49.980047+0000 mon.smithi026 (mon.0) 586 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2021-11-03T16:54:51.303 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:50 smithi026 conmon[32119]: cluster 2021-11-03T16:54:49.980158+0000 mon.smithi026 (mon.0) 587 : cluster [DBG] osdmap e46: 6 total, 6 up, 6 in 2021-11-03T16:54:51.303 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:50 smithi026 conmon[32119]: cluster 2021-11-03T16:54:49.980363+0000 mon.smithi026 (mon.0) 588 : cluster [DBG] mgrmap e22: smithi194.wnexas(active, since 2s) 2021-11-03T16:54:52.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:52 smithi026 conmon[32119]: audit 2021-11-03T16:54:51.150078+0000 mon.smithi026 ( 2021-11-03T16:54:52.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:52 smithi026 conmon[32119]: mon.0) 589 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' 2021-11-03T16:54:52.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:52 smithi194 conmon[35111]: audit 2021-11-03T16:54:51.150078+0000 2021-11-03T16:54:52.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:52 smithi194 conmon[35111]: mon.smithi026 (mon.0) 589 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' 2021-11-03T16:54:53.399 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:53 smithi194 conmon[35111]: cluster 2021-11-03T16:54:51.969136+0000 mgr.smithi194.wnexas (mgr.24377) 10 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 1.3 GiB data, 3.9 GiB used, 533 GiB / 536 GiB avail 2021-11-03T16:54:53.400 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:53 smithi194 conmon[35111]: cluster 2021-11-03T16:54:52.156007+0000 mon.smithi026 (mon.0) 590 : cluster [DBG] mgrmap e23: smithi194.wnexas(active, since 4s) 2021-11-03T16:54:53.400 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:53 smithi194 conmon[35111]: audit 2021-11-03T16:54:52.791362+0000 mon.smithi026 (mon.0) 591 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' 2021-11-03T16:54:53.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:53 smithi026 conmon[32119]: cluster 2021-11-03T16:54 2021-11-03T16:54:53.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:53 smithi026 conmon[32119]: :51.969136+0000 mgr.smithi194.wnexas (mgr.24377) 10 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 1.3 GiB data, 3.9 GiB used, 533 GiB / 536 GiB avail 2021-11-03T16:54:53.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:53 smithi026 conmon[32119]: cluster 2021-11-03T16:54:52.156007+0000 mon.smithi026 (mon.0) 590 : cluster [DBG] mgrmap e23: smithi194.wnexas(active, since 4s) 2021-11-03T16:54:53.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:53 smithi026 conmon[32119]: audit 2021-11-03T16:54:52.791362+0000 mon.smithi026 (mon.0) 591 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' 2021-11-03T16:54:54.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: cephadm 2021-11-03T16:54:52.758651+0000 mgr.smithi194.wnexas (mgr.24377 2021-11-03T16:54:54.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: ) 11 : cephadm [INF] poll took 3581.279 ms: 1 events 2021-11-03T16:54:54.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: audit 2021-11-03T16:54:53. 2021-11-03T16:54:54.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: 414050+0000 mon.smithi026 (mon.0) 592 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' 2021-11-03T16:54:54.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: audit 2021-11-03T16:54:54.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: 2021-11-03T16:54:53 2021-11-03T16:54:54.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: .415720+0000 mon.smithi194 (mon.1) 41 : 2021-11-03T16:54:54.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: audit [INF] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2021-11-03T16:54:54.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: audit 2021-11-03 2021-11-03T16:54:54.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: T16:54:53.415779+0000 mon.smithi026 (mon. 2021-11-03T16:54:54.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: 0) 593 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2021-11-03T16:54:54.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: audit 2021- 2021-11-03T16:54:54.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: 11-03T16:54:53.652971 2021-11-03T16:54:54.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: +0000 mon.smithi026 (mon.0) 2021-11-03T16:54:54.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: 594 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' 2021-11-03T16:54:54.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: cluster 2021- 2021-11-03T16:54:54.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: 11-03T16:54:53 2021-11-03T16:54:54.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: .722661+0000 mon.smithi026 (mon. 2021-11-03T16:54:54.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: 0) 595 : cluster [DBG] Standby manager daemon smithi026.cnrxli started 2021-11-03T16:54:54.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: 2021-11-03T16:54:54.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: audit 2021-11-03T16:54:54.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: 2021-11- 2021-11-03T16:54:54.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: 03T16:54:53.725148+0000 2021-11-03T16:54:54.428 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: mon.smithi026 (mon.0) 596 : audit [DBG] 2021-11-03T16:54:54.428 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: from='mgr.? 172.21.15.26:0/969022106' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi026.cnrxli/crt"}]: dispatch 2021-11-03T16:54:54.428 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: audit 2021- 2021-11-03T16:54:54.428 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: 11-03T16:54:53.726553+0000 2021-11-03T16:54:54.428 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: mon.smithi026 (mon.0) 597 : audit [DBG] from='mgr.? 172.21.15.26:0/969022106' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-11-03T16:54:54.429 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: audit 2021-11-03T16:54:54.429 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: 2021-11-03T16: 2021-11-03T16:54:54.429 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: 54:53.729380+0000 mon.smithi026 ( 2021-11-03T16:54:54.429 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: mon.0) 598 : audit [DBG] from='mgr.? 172.21.15.26:0/969022106' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi026.cnrxli/key"}]: dispatch 2021-11-03T16:54:54.430 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: 2021-11-03T16:54:54.430 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: audit 2021-11- 2021-11-03T16:54:54.430 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: 03T16:54:53.729860 2021-11-03T16:54:54.430 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: +0000 mon.smithi026 (mon.0) 2021-11-03T16:54:54.430 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: 599 : audit [DBG] from='mgr.? 172.21.15.26:0/969022106' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-11-03T16:54:54.431 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: cluster 2021-11-03T16:54:54.431 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: 2021-11-03T 2021-11-03T16:54:54.431 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: 16:54:53.969467+0000 mgr.smithi194.wnexas 2021-11-03T16:54:54.432 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: (mgr.24377) 12 : cluster 2021-11-03T16:54:54.432 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:54 smithi026 conmon[32119]: [DBG] pgmap v8: 65 pgs: 65 active+clean; 1.3 GiB data, 3.9 GiB used, 533 GiB / 536 GiB avail 2021-11-03T16:54:54.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:54 smithi194 conmon[35111]: cephadm 2021-11-03T16:54:52.758651+0000 mgr.smithi194.wnexas (mgr.24377) 11 : cephadm 2021-11-03T16:54:54.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:54 smithi194 conmon[35111]: [INF] poll took 3581.279 ms: 1 events 2021-11-03T16:54:54.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:54 smithi194 conmon[35111]: audit 2021-11-03T16:54:53.414050+0000 mon.smithi026 (mon.0) 592 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' 2021-11-03T16:54:54.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:54 smithi194 conmon[35111]: audit 2021-11-03T16: 2021-11-03T16:54:54.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:54 smithi194 conmon[35111]: 54:53.415720+0000 mon.smithi194 (mon.1) 41 : audit [INF] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2021-11-03T16:54:54.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:54 smithi194 conmon[35111]: audit 2021-11-03T16:54:53. 2021-11-03T16:54:54.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:54 smithi194 conmon[35111]: 415779+0000 mon.smithi026 (mon.0) 593 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2021-11-03T16:54:54.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:54 smithi194 conmon[35111]: audit 2021- 2021-11-03T16:54:54.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:54 smithi194 conmon[35111]: 11-03T16:54:53.652971+0000 mon.smithi026 (mon.0) 594 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' 2021-11-03T16:54:54.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:54 smithi194 conmon[35111]: cluster 2021-11-03T16:54: 2021-11-03T16:54:54.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:54 smithi194 conmon[35111]: 53.722661+0000 mon.smithi026 (mon.0) 595 : cluster [DBG] Standby manager daemon smithi026.cnrxli started 2021-11-03T16:54:54.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:54 smithi194 conmon[35111]: audit 2021-11- 2021-11-03T16:54:54.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:54 smithi194 conmon[35111]: 03T16:54:53.725148+0000 mon.smithi026 (mon.0) 596 : audit 2021-11-03T16:54:54.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:54 smithi194 conmon[35111]: [DBG] from='mgr.? 172.21.15.26:0/969022106' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi026.cnrxli/crt"}]: dispatch 2021-11-03T16:54:54.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:54 smithi194 conmon[35111]: audit 2021-11-03T16:54:54.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:54 smithi194 conmon[35111]: 2021-11-03T16:54:53.726553+0000 mon.smithi026 (mon.0) 597 : audit [DBG] 2021-11-03T16:54:54.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:54 smithi194 conmon[35111]: from='mgr.? 172.21.15.26:0/969022106' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-11-03T16:54:54.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:54 smithi194 conmon[35111]: audit 2021 2021-11-03T16:54:54.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:54 smithi194 conmon[35111]: -11-03T16:54:53.729380+0000 mon.smithi026 (mon.0) 598 : audit [DBG] from='mgr.? 172.21.15.26:0/969022106' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi026.cnrxli/key"}]: dispatch 2021-11-03T16:54:54.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:54 smithi194 conmon[35111]: 2021-11-03T16:54:54.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:54 smithi194 conmon[35111]: audit 2021-11- 2021-11-03T16:54:54.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:54 smithi194 conmon[35111]: 03T16:54:53.729860+0000 mon.smithi026 (mon.0) 599 : audit [DBG] from='mgr.? 172.21.15.26:0/969022106' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-11-03T16:54:54.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:54 smithi194 conmon[35111]: cluster 2021-11- 2021-11-03T16:54:54.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:54 smithi194 conmon[35111]: 03T16:54:53.969467+0000 mgr.smithi194.wnexas (mgr.24377) 12 : cluster 2021-11-03T16:54:54.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:54 smithi194 conmon[35111]: [DBG] pgmap v8: 65 pgs: 65 active+clean; 1.3 GiB data, 3.9 GiB used, 533 GiB / 536 GiB avail 2021-11-03T16:54:56.165 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:56 smithi026 conmon[32119]: cluster 2021-11-03T16:54:54.657855+0000 mon.smithi026 (mon.0) 600 : cluster [DBG] 2021-11-03T16:54:56.165 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:56 smithi026 conmon[32119]: mgrmap e24: smithi194.wnexas(active, since 7s), standbys: smithi026.cnrxli 2021-11-03T16:54:56.166 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:56 smithi026 conmon[32119]: audit 2021-11-03T16:54:54.659860+0000 mon.smithi194 (mon.1) 42 2021-11-03T16:54:56.166 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:56 smithi026 conmon[32119]: : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "mgr metadata", "who": "smithi026.cnrxli", "id": "smithi026.cnrxli"}]: dispatch 2021-11-03T16:54:56.166 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:56 smithi026 conmon[32119]: audit 2021-11-03T16:54:54.692724+0000 mon.smithi026 ( 2021-11-03T16:54:56.167 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:56 smithi026 conmon[32119]: mon.0) 601 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-11-03T16:54:56.167 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:56 smithi026 conmon[32119]: audit 2021-11- 2021-11-03T16:54:56.168 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:56 smithi026 conmon[32119]: 03T16:54:54.693181+0000 mon.smithi194 (mon.1) 43 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "mon metadata", "id": "smithi026"}]: dispatch 2021-11-03T16:54:56.169 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:56 smithi026 conmon[32119]: audit 2021-11-03T16: 2021-11-03T16:54:56.169 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:56 smithi026 conmon[32119]: 54:54.693382+0000 mon.smithi194 (mon.1) 44 : audit [DBG] 2021-11-03T16:54:56.170 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:56 smithi026 conmon[32119]: from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2021-11-03T16:54:56.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:56 smithi026 conmon[32119]: audit 2021-11- 2021-11-03T16:54:56.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:56 smithi026 conmon[32119]: 03T16:54:55.634014+0000 mon.smithi026 (mon.0) 602 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-11-03T16:54:56.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:56 smithi194 conmon[35111]: cluster 2021-11-03T16:54:54.657855+0000 mon.smithi026 ( 2021-11-03T16:54:56.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:56 smithi194 conmon[35111]: mon.0) 600 : cluster [DBG] mgrmap e24: smithi194.wnexas(active, since 7s), standbys: smithi026.cnrxli 2021-11-03T16:54:56.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:56 smithi194 conmon[35111]: audit 2021-11-03T16:54:54.659860+0000 mon.smithi194 (mon 2021-11-03T16:54:56.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:56 smithi194 conmon[35111]: .1) 42 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "mgr metadata", "who": "smithi026.cnrxli", "id": "smithi026.cnrxli"}]: dispatch 2021-11-03T16:54:56.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:56 smithi194 conmon[35111]: audit 2021-11- 2021-11-03T16:54:56.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:56 smithi194 conmon[35111]: 03T16:54:54.692724+0000 mon.smithi026 2021-11-03T16:54:56.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:56 smithi194 conmon[35111]: (mon.0) 601 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-11-03T16:54:56.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:56 smithi194 conmon[35111]: audit 2021-11-03T16:54:56.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:56 smithi194 conmon[35111]: 2021-11-03T16:54:54.693181+0000 2021-11-03T16:54:56.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:56 smithi194 conmon[35111]: mon.smithi194 (mon.1) 43 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "mon metadata", "id": "smithi026"}]: dispatch 2021-11-03T16:54:56.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:56 smithi194 conmon[35111]: 2021-11-03T16:54:56.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:56 smithi194 conmon[35111]: audit 2021-11-03T16:54:56.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:56 smithi194 conmon[35111]: 2021-11-03T16:54:54.693382+0000 mon.smithi194 2021-11-03T16:54:56.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:56 smithi194 conmon[35111]: (mon.1) 44 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2021-11-03T16:54:56.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:56 smithi194 conmon[35111]: audit 2021-11-03 2021-11-03T16:54:56.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:56 smithi194 conmon[35111]: T16:54:55.634014+0000 mon.smithi026 (mon. 2021-11-03T16:54:56.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:56 smithi194 conmon[35111]: 0) 602 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-11-03T16:54:57.399 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:57 smithi026 conmon[32119]: audit 2021-11-03T16:54:55.636495+0000 mon.smithi194 (mon.1) 45 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-11-03T16:54:57.399 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:57 smithi026 conmon[32119]: cephadm 2021-11-03T16:54:55.890159+0000 mgr.smithi194.wnexas (mgr.24377) 13 : cephadm [INF] poll took 2481.749 ms: 1 events 2021-11-03T16:54:57.400 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:57 smithi026 conmon[32119]: cluster 2021-11-03T16:54:55.969925+0000 mgr.smithi194.wnexas (mgr.24377) 14 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 13 KiB/s rd, 309 KiB/s wr, 35 op/s 2021-11-03T16:54:57.400 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:57 smithi026 conmon[32119]: audit 2021-11-03T16:54:56.134691+0000 mon.smithi194 (mon.1) 46 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-11-03T16:54:57.400 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:57 smithi026 conmon[32119]: audit 2021-11-03T16:54:56.135306+0000 mon.smithi194 (mon.1) 47 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "mon metadata", "id": "smithi026"}]: dispatch 2021-11-03T16:54:57.400 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:57 smithi026 conmon[32119]: audit 2021-11-03T16:54:56.135438+0000 mon.smithi194 (mon.1) 48 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2021-11-03T16:54:57.400 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:57 smithi026 conmon[32119]: audit 2021-11-03T16:54 2021-11-03T16:54:57.401 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:57 smithi026 conmon[32119]: :56.142745+0000 mon.smithi026 (mon.0) 603 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' 2021-11-03T16:54:57.401 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:57 smithi026 conmon[32119]: audit 2021-11-03T16:54:56.769850+0000 mon.smithi026 (mon.0) 604 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' 2021-11-03T16:54:57.401 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:57 smithi026 conmon[32119]: audit 2021-11-03T16:54:56.772111+0000 mon.smithi194 (mon.1) 49 : audit [INF] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config rm", "who": "osd/host:smithi026", "name": "osd_memory_target"}]: dispatch 2021-11-03T16:54:57.401 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:57 smithi026 conmon[32119]: audit 2021-11-03T16:54:56.772396+0000 mon.smithi026 (mon.0) 605 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config rm", "who": "osd/host:smithi026", "name": "osd_memory_target"}]: dispatch 2021-11-03T16:54:57.402 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:57 smithi026 conmon[32119]: audit 2021-11-03T16:54:56.776597+0000 mon.smithi026 (mon.0) 606 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' 2021-11-03T16:54:57.402 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:57 smithi026 conmon[32119]: audit 2021-11-03T16:54:56.780755+0000 mon.smithi026 (mon.0) 607 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' 2021-11-03T16:54:57.402 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:57 smithi026 conmon[32119]: audit 2021-11-03T16:54:56.788421+0000 mon.smithi194 (mon.1) 50 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:54:57.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:57 smithi194 conmon[35111]: audit 2021-11-03T16:54:55.636495+0000 mon.smithi194 (mon.1) 45 : audit [INF] 2021-11-03T16:54:57.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:57 smithi194 conmon[35111]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-11-03T16:54:57.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:57 smithi194 conmon[35111]: cephadm 2021-11-03T16:54:55.890159+0000 mgr.smithi194.wnexas (mgr.24377) 13 : cephadm [INF] poll took 2481.749 ms: 1 events 2021-11-03T16:54:57.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:57 smithi194 conmon[35111]: cluster 2021-11-03T16:54:55.969925+0000 mgr.smithi194.wnexas (mgr.24377) 14 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 13 KiB/s rd, 309 KiB/s wr, 35 op/s 2021-11-03T16:54:57.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:57 smithi194 conmon[35111]: audit 2021-11-03T16:54:56.134691+0000 mon.smithi194 (mon.1) 46 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-11-03T16:54:57.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:57 smithi194 conmon[35111]: audit 2021-11-03T16:54:56.135306+0000 mon.smithi194 (mon.1) 47 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "mon metadata", "id": "smithi026"}]: dispatch 2021-11-03T16:54:57.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:57 smithi194 conmon[35111]: audit 2021-11-03T16 2021-11-03T16:54:57.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:57 smithi194 conmon[35111]: :54:56.135438+0000 mon.smithi194 (mon.1) 48 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2021-11-03T16:54:57.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:57 smithi194 conmon[35111]: audit 2021-11-03T16:54 2021-11-03T16:54:57.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:57 smithi194 conmon[35111]: :56.142745+0000 mon.smithi026 (mon.0) 603 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' 2021-11-03T16:54:57.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:57 smithi194 conmon[35111]: audit 2021-11-03T16:54:56. 2021-11-03T16:54:57.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:57 smithi194 conmon[35111]: 769850+0000 mon.smithi026 (mon.0) 604 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' 2021-11-03T16:54:57.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:57 smithi194 conmon[35111]: audit 2021-11-03T16:54:56.772111 2021-11-03T16:54:57.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:57 smithi194 conmon[35111]: +0000 mon.smithi194 (mon.1) 49 : audit [INF] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config rm", "who": "osd/host:smithi026", "name": "osd_memory_target"}]: dispatch 2021-11-03T16:54:57.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:57 smithi194 conmon[35111]: audit 2021-11-03T16:54:56.772396+0000 mon.smithi026 ( 2021-11-03T16:54:57.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:57 smithi194 conmon[35111]: mon.0) 605 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config rm", "who": "osd/host:smithi026", "name": "osd_memory_target"}]: dispatch 2021-11-03T16:54:57.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:57 smithi194 conmon[35111]: audit 2021- 2021-11-03T16:54:57.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:57 smithi194 conmon[35111]: 11-03T16:54:56.776597+0000 mon.smithi026 (mon.0) 606 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' 2021-11-03T16:54:57.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:57 smithi194 conmon[35111]: audit 2021-11-03T16:54:56.780755+0000 mon.smithi026 (mon.0 2021-11-03T16:54:57.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:57 smithi194 conmon[35111]: ) 607 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' 2021-11-03T16:54:57.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:57 smithi194 conmon[35111]: audit 2021-11-03T16:54:57.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:57 smithi194 conmon[35111]: 2021-11-03T16:54:56.788421+0000 mon.smithi194 (mon.1) 50 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:54:58.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:58 smithi026 conmon[32119]: cluster 2021-11-03T16:54:56.773846+0000 mgr.smithi194.wnexas (mgr. 2021-11-03T16:54:58.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:58 smithi026 conmon[32119]: 24377) 15 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 12 KiB/s rd, 277 KiB/s wr, 32 op/s 2021-11-03T16:54:58.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:58 smithi026 conmon[32119]: cephadm 2021-11-03T16:54:56.789653+0000 mgr.smithi194.wnexas (mgr.24377) 16 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi194.wnexas) 2021-11-03T16:54:58.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:58 smithi026 conmon[32119]: cluster 2021-11-03T16:54:57.135887+0000 mon.smithi026 (mon.0) 608 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2021-11-03T16:54:58.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:58 smithi194 conmon[35111]: cluster 2021-11-03T16:54:56.773846+0000 mgr.smithi194.wnexas (mgr.24377) 15 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 12 KiB/s rd, 277 KiB/s wr, 32 op/s 2021-11-03T16:54:58.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:58 smithi194 conmon[35111]: 2021-11-03T16:54:58.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:58 smithi194 conmon[35111]: cephadm 2021-11-03T16:54:56.789653+0000 mgr.smithi194.wnexas (mgr.24377) 16 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi194.wnexas) 2021-11-03T16:54:58.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:58 smithi194 conmon[35111]: cluster 2021-11-03T16:54:57.135887+0000 mon.smithi026 (mon.0) 608 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2021-11-03T16:54:59.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:59 smithi026 conmon[32119]: cephadm 2021-11-03T16:54:58.645134+0000 mgr.smithi194.wnexas (mgr.24377) 17 : cephadm [INF] poll took 1818.458 ms: 1 events 2021-11-03T16:54:59.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:59 smithi026 conmon[32119]: cephadm 2021-11-03T16:54:58.671679+0000 mgr.smithi194.wnexas (mgr.24377) 18 : cephadm [INF] Upgrade: Updating mgr.smithi026.cnrxli 2021-11-03T16:54:59.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:59 smithi026 conmon[32119]: audit 2021-11-03T16:54:58.676480+0000 mon.smithi026 (mon.0) 609 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' 2021-11-03T16:54:59.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:59 smithi026 conmon[32119]: audit 2021-11-03T16:54:58.678718+0000 mon.smithi194 (mon.1) 51 : audit [INF] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi026.cnrxli", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-11-03T16:54:59.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:59 smithi026 conmon[32119]: audit 2021-11-03T16:54:58.679057+0000 mon.smithi026 (mon.0) 610 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi026.cnrxli", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-11-03T16:54:59.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:59 smithi026 conmon[32119]: audit 2021-11-03T16:54:58.680324+0000 mon.smithi194 (mon.1) 52 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "mgr services"}]: dispatch 2021-11-03T16:54:59.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:59 smithi026 conmon[32119]: audit 2021-11-03T16:54:58.681239+0000 mon.smithi194 (mon.1) 53 : audit [DBG] 2021-11-03T16:54:59.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:59 smithi026 conmon[32119]: from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:54:59.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:59 smithi026 conmon[32119]: cephadm 2021-11-03T16:54:58.682201+0000 mgr.smithi194.wnexas (mgr.24377) 19 : cephadm [INF] Deploying daemon mgr.smithi026.cnrxli on smithi026 2021-11-03T16:54:59.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:54:59 smithi026 conmon[32119]: cluster 2021-11-03T16:54:58.774262+0000 mgr.smithi194.wnexas (mgr.24377) 20 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 10 KiB/s rd, 245 KiB/s wr, 28 op/s 2021-11-03T16:54:59.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:59 smithi194 conmon[35111]: cephadm 2021-11-03T16:54:58.645134+0000 mgr.smithi194.wnexas (mgr.24377) 17 2021-11-03T16:54:59.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:59 smithi194 conmon[35111]: : cephadm [INF] poll took 1818.458 ms: 1 events 2021-11-03T16:54:59.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:59 smithi194 conmon[35111]: cephadm 2021-11-03T16:54:58.671679+0000 mgr.smithi194.wnexas (mgr.24377) 18 : cephadm [INF] Upgrade: Updating mgr.smithi026.cnrxli 2021-11-03T16:54:59.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:59 smithi194 conmon[35111]: audit 2021-11-03T16:54:58.676480+0000 mon.smithi026 (mon.0) 609 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' 2021-11-03T16:54:59.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:59 smithi194 conmon[35111]: audit 2021 2021-11-03T16:54:59.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:59 smithi194 conmon[35111]: -11-03T16:54:58.678718+0000 mon.smithi194 (mon.1 2021-11-03T16:54:59.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:59 smithi194 conmon[35111]: ) 51 : audit [INF] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi026.cnrxli", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-11-03T16:55:00.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:59 smithi194 conmon[35111]: audit 2021-11 2021-11-03T16:55:00.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:59 smithi194 conmon[35111]: -03T16:54:58.679057+0000 mon.smithi026 (mon. 2021-11-03T16:55:00.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:59 smithi194 conmon[35111]: 0) 610 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi026.cnrxli", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-11-03T16:55:00.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:59 smithi194 conmon[35111]: audit 2021-11-03T16:55:00.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:59 smithi194 conmon[35111]: 2021-11-03 2021-11-03T16:55:00.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:59 smithi194 conmon[35111]: T16:54:58.680324+0000 mon.smithi194 (mon. 2021-11-03T16:55:00.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:59 smithi194 conmon[35111]: 1) 52 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "mgr services"}]: dispatch 2021-11-03T16:55:00.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:59 smithi194 conmon[35111]: audit 2021-11-03T16:55:00.002 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:59 smithi194 conmon[35111]: 2021-11-03T16:54:58.681239+0000 mon.smithi194 (mon.1) 2021-11-03T16:55:00.002 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:59 smithi194 conmon[35111]: 53 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:55:00.002 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:59 smithi194 conmon[35111]: cephadm 2021-11 2021-11-03T16:55:00.002 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:59 smithi194 conmon[35111]: -03T16:54:58.682201+0000 mgr.smithi194.wnexas (mgr.24377 2021-11-03T16:55:00.002 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:59 smithi194 conmon[35111]: ) 19 : cephadm [INF] Deploying daemon mgr.smithi026.cnrxli on smithi026 2021-11-03T16:55:00.003 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:59 smithi194 conmon[35111]: cluster 2021 2021-11-03T16:55:00.003 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:59 smithi194 conmon[35111]: -11-03T16:54:58.774262+0000 mgr.smithi194.wnexas (mgr 2021-11-03T16:55:00.004 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:54:59 smithi194 conmon[35111]: .24377) 20 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 10 KiB/s rd, 245 KiB/s wr, 28 op/s 2021-11-03T16:55:02.118 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:01 smithi026 conmon[32119]: cluster 2021-11-03T16:55:00.774892+0000 2021-11-03T16:55:02.119 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:01 smithi026 conmon[32119]: mgr.smithi194.wnexas (mgr.24377) 21 : cluster [DBG] pgmap v12: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 9.3 KiB/s rd, 224 KiB/s wr, 25 op/s 2021-11-03T16:55:02.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:01 smithi194 conmon[35111]: cluster 2021-11-03T16:55:00.774892+0000 mgr.smithi194.wnexas (mgr.24377) 21 : cluster 2021-11-03T16:55:02.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:01 smithi194 conmon[35111]: [DBG] pgmap v12: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 9.3 KiB/s rd, 224 KiB/s wr, 25 op/s 2021-11-03T16:55:03.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:02 smithi026 conmon[32119]: debug 2021-11-03T16:55:02.829+0000 7fee5a568700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-03T16:55:03.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:02 smithi026 conmon[32119]: cluster 2021-11-03T16:55:01.954979+0000 mon.smithi026 (mon.0) 611 : cluster [INF] daemon mds.cephfs.smithi026.ltacyh restarted 2021-11-03T16:55:03.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:02 smithi026 conmon[32119]: cluster 2021-11-03T16:55:01.958141+0000 mon.smithi026 (mon.0) 612 : cluster [DBG] osdmap e47: 6 total, 6 up, 6 in 2021-11-03T16:55:03.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:02 smithi026 conmon[32119]: audit 2021-11-03T16:55:02.502436+0000 mon.smithi026 (mon.0) 613 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' 2021-11-03T16:55:03.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:02 smithi026 conmon[32119]: audit 2021-11 2021-11-03T16:55:03.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:02 smithi026 conmon[32119]: -03T16:55:02.504608+0000 mon.smithi194 2021-11-03T16:55:03.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:02 smithi026 conmon[32119]: (mon.1) 54 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:55:03.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:02 smithi194 conmon[35111]: cluster 2021-11-03T16:55:01.954979+0000 mon.smithi026 (mon.0) 611 : cluster [INF] daemon mds.cephfs.smithi026.ltacyh restarted 2021-11-03T16:55:03.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:02 smithi194 conmon[35111]: 2021-11-03T16:55:03.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:02 smithi194 conmon[35111]: cluster 2021-11-03T16:55:01.958141+0000 mon.smithi026 (mon.0) 612 : cluster [DBG] osdmap e47: 6 total, 6 up, 6 in 2021-11-03T16:55:03.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:02 smithi194 conmon[35111]: audit 2021-11-03 2021-11-03T16:55:03.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:02 smithi194 conmon[35111]: T16:55:02.502436+0000 mon.smithi026 (mon.0) 613 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' 2021-11-03T16:55:03.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:02 smithi194 conmon[35111]: audit 2021-11-03 2021-11-03T16:55:03.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:02 smithi194 conmon[35111]: T16:55:02.504608+0000 mon.smithi194 (mon. 2021-11-03T16:55:03.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:02 smithi194 conmon[35111]: 1) 54 : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:55:04.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:03 smithi026 conmon[32119]: cephadm 2021-11-03T16:55:02.492334 2021-11-03T16:55:04.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:03 smithi026 conmon[32119]: +0000 mgr.smithi194.wnexas (mgr.24377) 22 : cephadm [INF] poll took 3537.616 ms: 1 events 2021-11-03T16:55:04.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:03 smithi026 conmon[32119]: cluster 2021-11-03T16:55:02.775379+0000 mgr.smithi194.wnexas (mgr.24377) 23 : cluster [DBG] pgmap v14: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 11 KiB/s rd, 274 KiB/s wr, 31 op/s 2021-11-03T16:55:04.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:03 smithi026 conmon[32119]: cluster 2021-11-03T16:55:02.829572+0000 2021-11-03T16:55:04.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:03 smithi026 conmon[32119]: mon.smithi026 (mon.0) 614 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2021-11-03T16:55:04.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:03 smithi026 conmon[32119]: cluster 2021-11-03T16:55:04.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:03 smithi026 conmon[32119]: 2021-11-03T16:55:02.829623+0000 mon.smithi026 (mon. 2021-11-03T16:55:04.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:03 smithi026 conmon[32119]: 0) 615 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-03T16:55:04.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:03 smithi026 conmon[32119]: cluster 2021 2021-11-03T16:55:04.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:03 smithi026 conmon[32119]: -11-03T16:55:02.835935+0000 mon.smithi026 ( 2021-11-03T16:55:04.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:03 smithi026 conmon[32119]: mon.0) 616 : cluster [DBG] mds.? [v2:172.21.15.26:6800/1006134959,v1:172.21.15.26:6801/1006134959] up:boot 2021-11-03T16:55:04.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:03 smithi026 conmon[32119]: cluster 2021-11-03T16 2021-11-03T16:55:04.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:03 smithi026 conmon[32119]: :55:02.836004+0000 mon.smithi026 (mon.0) 617 : 2021-11-03T16:55:04.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:03 smithi026 conmon[32119]: cluster [INF] Standby daemon mds.cephfs.smithi026.yfxlxl assigned to filesystem cephfs as rank 0 2021-11-03T16:55:04.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:03 smithi026 conmon[32119]: cluster 2021-11-03T16:55:04.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:03 smithi026 conmon[32119]: 2021-11-03T16:55:02.836135+0000 mon.smithi026 (mon. 2021-11-03T16:55:04.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:03 smithi026 conmon[32119]: 0) 618 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2021-11-03T16:55:04.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:03 smithi026 conmon[32119]: cluster 2021-11-03T16:55: 2021-11-03T16:55:04.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:03 smithi026 conmon[32119]: 02.836353+0000 mon.smithi026 (mon.0) 619 : cluster [DBG] 2021-11-03T16:55:04.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:03 smithi026 conmon[32119]: fsmap cephfs:0/1 4 up:standby, 1 failed 2021-11-03T16:55:04.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:03 smithi026 conmon[32119]: audit 2021 2021-11-03T16:55:04.178 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:03 smithi026 conmon[32119]: -11-03T16:55:02.839729+0000 mon.smithi194 (mon.1) 55 2021-11-03T16:55:04.178 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:03 smithi026 conmon[32119]: : audit [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.ltacyh"}]: dispatch 2021-11-03T16:55:04.178 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:03 smithi026 conmon[32119]: cluster 2021-11-03T16:55:04.178 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:03 smithi026 conmon[32119]: 2021-11-03T16:55:02.841913+0000 mon.smithi026 (mon. 2021-11-03T16:55:04.179 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:03 smithi026 conmon[32119]: 0) 620 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi026.yfxlxl=up:replay} 3 up:standby 2021-11-03T16:55:04.179 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:03 smithi026 conmon[32119]: audit 2021-11-03T16:55:03.061210 2021-11-03T16:55:04.179 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:03 smithi026 conmon[32119]: +0000 mon.smithi026 (mon.0) 621 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' 2021-11-03T16:55:04.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:03 smithi194 conmon[35111]: cephadm 2021-11-03T16:55:02.492334+0000 mgr.smithi194.wnexas (mgr.24377) 22 : cephadm [INF] poll took 3537.616 ms: 1 events 2021-11-03T16:55:04.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:03 smithi194 conmon[35111]: cluster 2021-11-03T16:55:02.775379+0000 mgr.smithi194.wnexas (mgr.24377) 23 : cluster [DBG] pgmap v14: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 11 KiB/s rd, 274 KiB/s wr, 31 op/s 2021-11-03T16:55:04.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:03 smithi194 conmon[35111]: cluster 2021-11-03T16:55:02.829572+0000 mon.smithi026 (mon.0) 614 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2021-11-03T16:55:04.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:03 smithi194 conmon[35111]: cluster 2021-11-03T16:55:02.829623+0000 mon.smithi026 (mon.0) 615 : 2021-11-03T16:55:04.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:03 smithi194 conmon[35111]: cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-03T16:55:04.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:03 smithi194 conmon[35111]: cluster 2021-11-03T 2021-11-03T16:55:04.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:03 smithi194 conmon[35111]: 16:55:02.835935+0000 mon.smithi026 (mon.0 2021-11-03T16:55:04.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:03 smithi194 conmon[35111]: ) 616 : cluster [DBG] mds.? [v2:172.21.15.26:6800/1006134959,v1:172.21.15.26:6801/1006134959] up:boot 2021-11-03T16:55:04.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:03 smithi194 conmon[35111]: cluster 2021-11-03 2021-11-03T16:55:04.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:03 smithi194 conmon[35111]: T16:55:02.836004+0000 mon.smithi026 (mon 2021-11-03T16:55:04.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:03 smithi194 conmon[35111]: .0) 617 : cluster [INF] Standby daemon mds.cephfs.smithi026.yfxlxl assigned to filesystem cephfs as rank 0 2021-11-03T16:55:04.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:03 smithi194 conmon[35111]: cluster 2021- 2021-11-03T16:55:04.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:03 smithi194 conmon[35111]: 11-03T16:55:02.836135+0000 mon.smithi026 2021-11-03T16:55:04.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:03 smithi194 conmon[35111]: (mon.0) 618 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2021-11-03T16:55:04.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:03 smithi194 conmon[35111]: cluster 2021 2021-11-03T16:55:04.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:03 smithi194 conmon[35111]: -11-03T16:55:02.836353+0000 2021-11-03T16:55:04.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:03 smithi194 conmon[35111]: mon.smithi026 (mon.0) 619 : cluster [DBG] fsmap cephfs:0/1 4 up:standby, 1 failed 2021-11-03T16:55:04.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:03 smithi194 conmon[35111]: 2021-11-03T16:55:04.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:03 smithi194 conmon[35111]: audit 2021-11-03T16:55:02 2021-11-03T16:55:04.255 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:03 smithi194 conmon[35111]: .839729+0000 mon.smithi194 (mon.1) 55 : audit 2021-11-03T16:55:04.255 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:03 smithi194 conmon[35111]: [DBG] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.ltacyh"}]: dispatch 2021-11-03T16:55:04.255 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:03 smithi194 conmon[35111]: cluster 2021-11-03T16:55 2021-11-03T16:55:04.255 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:03 smithi194 conmon[35111]: :02.841913+0000 mon.smithi026 (mon.0) 620 : 2021-11-03T16:55:04.255 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:03 smithi194 conmon[35111]: cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi026.yfxlxl=up:replay} 3 up:standby 2021-11-03T16:55:04.256 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:03 smithi194 conmon[35111]: audit 2021-11-03T16 2021-11-03T16:55:04.257 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:03 smithi194 conmon[35111]: :55:03.061210+0000 mon.smithi026 (mon.0) 621 2021-11-03T16:55:04.257 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:03 smithi194 conmon[35111]: : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' 2021-11-03T16:55:06.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:05 smithi026 conmon[32119]: cluster 2021-11-03T16:55:04.775996+0000 mgr.smithi194.wnexas (mgr.24377) 24 : 2021-11-03T16:55:06.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:05 smithi026 conmon[32119]: cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 6.5 MiB/s rd, 30 KiB/s wr, 7 op/s 2021-11-03T16:55:06.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:05 smithi194 conmon[35111]: cluster 2021-11-03T16:55:04.775996+0000 mgr.smithi194.wnexas (mgr.24377) 24 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 6.5 MiB/s rd, 30 KiB/s wr, 7 op/s 2021-11-03T16:55:06.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:05 smithi194 conmon[35111]: 2021-11-03T16:55:08.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:07 smithi026 conmon[32119]: cluster 2021-11-03T16:55:06. 2021-11-03T16:55:08.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:07 smithi026 conmon[32119]: 776469+0000 mgr.smithi194.wnexas (mgr.24377) 25 : cluster [DBG] pgmap v16: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 5.7 MiB/s rd, 26 KiB/s wr, 6 op/s 2021-11-03T16:55:08.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:07 smithi026 conmon[32119]: cluster 2021-11-03T16:55 2021-11-03T16:55:08.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:07 smithi026 conmon[32119]: :06.842844+0000 mon.smithi026 (mon.0) 622 : cluster [DBG] mds.? [v2:172.21.15.26:6800/1006134959,v1:172.21.15.26:6801/1006134959] up:standby 2021-11-03T16:55:08.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:07 smithi026 conmon[32119]: cluster 2021-11-03T 2021-11-03T16:55:08.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:07 smithi026 conmon[32119]: 16:55:06.842916+0000 mon.smithi026 (mon. 2021-11-03T16:55:08.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:07 smithi026 conmon[32119]: 0) 623 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi026.yfxlxl=up:replay} 3 up:standby 2021-11-03T16:55:08.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:07 smithi194 conmon[35111]: cluster 2021-11-03T16:55:06.776469+0000 mgr.smithi194.wnexas (mgr.24377) 25 : cluster [DBG] 2021-11-03T16:55:08.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:07 smithi194 conmon[35111]: pgmap v16: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 5.7 MiB/s rd, 26 KiB/s wr, 6 op/s 2021-11-03T16:55:08.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:07 smithi194 conmon[35111]: cluster 2021-11-03T16:55:06.842844+0000 mon.smithi026 (mon.0) 622 : cluster [DBG] mds.? [v2:172.21.15.26:6800/1006134959,v1:172.21.15.26:6801/1006134959] up:standby 2021-11-03T16:55:08.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:07 smithi194 conmon[35111]: cluster 2021-11-03T16:55:06.842916+0000 mon.smithi026 (mon.0) 623 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi026.yfxlxl=up:replay} 3 up:standby 2021-11-03T16:55:08.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:07 smithi194 conmon[35111]: 2021-11-03T16:55:10.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:10 smithi194 conmon[35111]: cluster 2021-11-03T16:55:08.777084+0000 mgr.smithi194.wnexas (mgr.24377) 26 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 5.7 MiB/s rd, 26 KiB/s wr, 6 op/s 2021-11-03T16:55:10.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:10 smithi194 conmon[35111]: cephadm 2021-11-03T16:55:08.969295+0000 mgr.smithi194.wnexas (mgr.24377) 27 : cephadm [INF] poll took 6427.717 ms: 1 events 2021-11-03T16:55:10.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:10 smithi194 conmon[35111]: audit 2021-11-03T16:55:09.000970+0000 mon.smithi026 (mon.0) 624 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' 2021-11-03T16:55:10.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:10 smithi194 conmon[35111]: cluster 2021-11-03T16:55:09.003449+0000 mgr.smithi194.wnexas (mgr 2021-11-03T16:55:10.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:10 smithi194 conmon[35111]: .24377) 28 : cluster [DBG] pgmap v18: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 13 MiB/s rd, 6 op/s 2021-11-03T16:55:10.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:10 smithi194 conmon[35111]: audit 2021 2021-11-03T16:55:10.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:10 smithi194 conmon[35111]: -11-03T16:55:09.006580+0000 2021-11-03T16:55:10.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:10 smithi194 conmon[35111]: mon.smithi026 (mon.0) 625 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' 2021-11-03T16:55:10.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:10 smithi194 conmon[35111]: audit 2021-11-03T16: 2021-11-03T16:55:10.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:10 smithi194 conmon[35111]: 55:09.012527+0000 mon.smithi194 (mon.1) 56 : audit [DBG] 2021-11-03T16:55:10.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:10 smithi194 conmon[35111]: from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:55:10.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:10 smithi194 conmon[35111]: cephadm 2021-11-03T16:55:09.013637+0000 mgr.smithi194.wnexas (mgr.24377) 29 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi194.wnexas) 2021-11-03T16:55:10.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:10 smithi194 conmon[35111]: cephadm 2021-11-03T16 2021-11-03T16:55:10.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:10 smithi194 conmon[35111]: :55:09.015902+0000 mgr.smithi194.wnexas (mgr.24377) 2021-11-03T16:55:10.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:10 smithi194 conmon[35111]: 30 : cephadm [INF] Failing over to other MGR 2021-11-03T16:55:10.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:10 smithi194 conmon[35111]: audit 2021-11-03 2021-11-03T16:55:10.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:10 smithi194 conmon[35111]: T16:55:09.016225+0000 mon.smithi194 (mon.1 2021-11-03T16:55:10.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:10 smithi194 conmon[35111]: ) 57 : audit [INF] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "mgr fail", "who": "smithi194.wnexas"}]: dispatch 2021-11-03T16:55:10.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:10 smithi194 conmon[35111]: audit 2021-11-03 2021-11-03T16:55:10.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:10 smithi194 conmon[35111]: T16:55:09.016373+0000 mon.smithi026 (mon. 2021-11-03T16:55:10.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:10 smithi194 conmon[35111]: 0) 626 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "mgr fail", "who": "smithi194.wnexas"}]: dispatch 2021-11-03T16:55:10.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:10 smithi194 conmon[35111]: cluster 2021-11-03T 2021-11-03T16:55:10.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:10 smithi194 conmon[35111]: 16:55:09.020798+0000 mon.smithi026 (mon.0 2021-11-03T16:55:10.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:10 smithi194 conmon[35111]: ) 627 : cluster [DBG] osdmap e48: 6 total, 6 up, 6 in 2021-11-03T16:55:10.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:10 smithi194 conmon[35111]: cluster 2021-11 2021-11-03T16:55:10.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:10 smithi194 conmon[35111]: -03T16:55:09.083153+0000 mon.smithi026 (mon 2021-11-03T16:55:10.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:10 smithi194 conmon[35111]: .0) 628 : cluster [INF] Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2021-11-03T16:55:10.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:10 smithi194 conmon[35111]: cluster 2021 2021-11-03T16:55:10.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:10 smithi194 conmon[35111]: -11-03T16:55:09.366666+0000 2021-11-03T16:55:10.255 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:10 smithi194 conmon[35111]: mon.smithi026 (mon.0) 629 : cluster [DBG] Standby manager daemon smithi194.wnexas started 2021-11-03T16:55:10.255 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:10 smithi194 conmon[35111]: 2021-11-03T16:55:10.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:10.414+0000 7fc5aecdf700 1 -- 172.21.15.26:0/564231268 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5a80f7980 msgr2=0x7fc5a80f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:55:10.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:10.414+0000 7fc5aecdf700 1 --2- 172.21.15.26:0/564231268 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5a80f7980 0x7fc5a80f7de0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fc594004660 tx=0x7fc594009b30).stop 2021-11-03T16:55:10.413 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:10.414+0000 7fc5aecdf700 1 -- 172.21.15.26:0/564231268 shutdown_connections 2021-11-03T16:55:10.413 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:10.414+0000 7fc5aecdf700 1 --2- 172.21.15.26:0/564231268 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5a80f7980 0x7fc5a80f7de0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:10.413 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:10.414+0000 7fc5aecdf700 1 --2- 172.21.15.26:0/564231268 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5a80f66e0 0x7fc5a80f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:10.413 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:10.414+0000 7fc5aecdf700 1 -- 172.21.15.26:0/564231268 >> 172.21.15.26:0/564231268 conn(0x7fc5a80f1e40 msgr2=0x7fc5a80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:55:10.413 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:10.414+0000 7fc5aecdf700 1 -- 172.21.15.26:0/564231268 shutdown_connections 2021-11-03T16:55:10.414 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:10.414+0000 7fc5aecdf700 1 -- 172.21.15.26:0/564231268 wait complete. 2021-11-03T16:55:10.414 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:10.415+0000 7fc5aecdf700 1 Processor -- start 2021-11-03T16:55:10.414 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:10.415+0000 7fc5aecdf700 1 -- start start 2021-11-03T16:55:10.414 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:10.415+0000 7fc5aecdf700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5a80f66e0 0x7fc5a8069ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:55:10.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:10.415+0000 7fc5aecdf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5a80f7980 0x7fc5a806a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:55:10.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:10.415+0000 7fc5aecdf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a810aba0 con 0x7fc5a80f7980 2021-11-03T16:55:10.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:10.415+0000 7fc5aecdf700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a810ace0 con 0x7fc5a80f66e0 2021-11-03T16:55:10.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:10.415+0000 7fc5a7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5a80f7980 0x7fc5a806a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:55:10.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:10.415+0000 7fc5a7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5a80f7980 0x7fc5a806a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50538/0 (socket says 172.21.15.26:50538) 2021-11-03T16:55:10.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:10.415+0000 7fc5aca7b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5a80f66e0 0x7fc5a8069ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:55:10.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:10.415+0000 7fc5a7fff700 1 -- 172.21.15.26:0/1059995613 learned_addr learned my addr 172.21.15.26:0/1059995613 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:55:10.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:10.415+0000 7fc5a7fff700 1 -- 172.21.15.26:0/1059995613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5a80f66e0 msgr2=0x7fc5a8069ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:55:10.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:10.415+0000 7fc5a7fff700 1 --2- 172.21.15.26:0/1059995613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5a80f66e0 0x7fc5a8069ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:10.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:10.415+0000 7fc5a7fff700 1 -- 172.21.15.26:0/1059995613 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc594005040 con 0x7fc5a80f7980 2021-11-03T16:55:10.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:10.416+0000 7fc5a7fff700 1 --2- 172.21.15.26:0/1059995613 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5a80f7980 0x7fc5a806a3b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7fc594000c00 tx=0x7fc59400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:55:10.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:10.416+0000 7fc5a57fa700 1 -- 172.21.15.26:0/1059995613 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc594019070 con 0x7fc5a80f7980 2021-11-03T16:55:10.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:10.416+0000 7fc5aecdf700 1 -- 172.21.15.26:0/1059995613 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5a806bb00 con 0x7fc5a80f7980 2021-11-03T16:55:10.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:10.416+0000 7fc5a57fa700 1 -- 172.21.15.26:0/1059995613 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc594007e70 con 0x7fc5a80f7980 2021-11-03T16:55:10.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:10.416+0000 7fc5a57fa700 1 -- 172.21.15.26:0/1059995613 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc594014ce0 con 0x7fc5a80f7980 2021-11-03T16:55:10.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:10.416+0000 7fc5aecdf700 1 -- 172.21.15.26:0/1059995613 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5a806aae0 con 0x7fc5a80f7980 2021-11-03T16:55:10.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:10.417+0000 7fc5aecdf700 1 -- 172.21.15.26:0/1059995613 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5a80f5ad0 con 0x7fc5a80f7980 2021-11-03T16:55:10.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:10.417+0000 7fc5a57fa700 1 -- 172.21.15.26:0/1059995613 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 25) v1 ==== 76740+0+0 (secure 0 0 0) 0x7fc594025070 con 0x7fc5a80f7980 2021-11-03T16:55:10.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:10.418+0000 7fc5a57fa700 1 -- 172.21.15.26:0/1059995613 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5945+0+0 (secure 0 0 0) 0x7fc59407bf00 con 0x7fc5a80f7980 2021-11-03T16:55:10.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: cluster 2021-11-03T16 2021-11-03T16:55:10.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: :55:08.777084+0000 mgr.smithi194.wnexas (mgr.24377) 26 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 5.7 MiB/s rd, 26 KiB/s wr, 6 op/s 2021-11-03T16:55:10.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: cephadm 2021-11-03T16:55 2021-11-03T16:55:10.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: :08.969295+0000 mgr.smithi194.wnexas (mgr. 2021-11-03T16:55:10.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: 24377) 27 : cephadm [INF] poll took 6427.717 ms: 1 events 2021-11-03T16:55:10.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: 2021-11-03T16:55:10.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: audit 2021-11-03T16:55:10.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: 2021-11-03T16:55:09 2021-11-03T16:55:10.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: .000970+0000 mon.smithi026 (mon.0 2021-11-03T16:55:10.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: ) 624 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' 2021-11-03T16:55:10.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: 2021-11-03T16:55:10.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: cluster 2021-11-03T16:55:10.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: 2021-11-03T16:55: 2021-11-03T16:55:10.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: 09.003449+0000 mgr.smithi194.wnexas (mgr 2021-11-03T16:55:10.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: .24377) 28 : cluster [DBG] 2021-11-03T16:55:10.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: pgmap v18: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 13 MiB/s rd, 6 op/s 2021-11-03T16:55:10.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: audit 2021-11-03T16:55:10.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: 2021-11-03T16:55 2021-11-03T16:55:10.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: :09.006580+0000 mon.smithi026 ( 2021-11-03T16:55:10.428 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: mon.0) 625 : audit [INF] 2021-11-03T16:55:10.428 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: from='mgr.24377 ' entity='mgr.smithi194.wnexas' 2021-11-03T16:55:10.428 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: audit 2021-11-03T16:55:10.428 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: 2021-11-03T16:55 2021-11-03T16:55:10.429 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: :09.012527+0000 mon.smithi194 (mon 2021-11-03T16:55:10.429 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: .1) 56 : audit [DBG] 2021-11-03T16:55:10.429 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:55:10.429 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: cephadm 2021 2021-11-03T16:55:10.430 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: -11-03T16:55 2021-11-03T16:55:10.430 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: :09.013637+0000 mgr.smithi194.wnexas (mgr 2021-11-03T16:55:10.430 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: .24377) 29 : cephadm [INF] 2021-11-03T16:55:10.430 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: Upgrade: Need to upgrade myself (mgr.smithi194.wnexas) 2021-11-03T16:55:10.430 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: cephadm 2021-11-03T16:55:10.431 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: 2021-11-03T16: 2021-11-03T16:55:10.431 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: 55:09.015902+0000 mgr.smithi194.wnexas ( 2021-11-03T16:55:10.431 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: mgr.24377) 30 : cephadm [INF] 2021-11-03T16:55:10.431 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: Failing over to other MGR 2021-11-03T16:55:10.432 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: audit 2021-11 2021-11-03T16:55:10.432 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: -03T16:55:09.016225 2021-11-03T16:55:10.432 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: +0000 mon.smithi194 (mon.1) 57 2021-11-03T16:55:10.432 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: : audit [INF] from='mgr.24377 172.21.15.194:0/2569685122' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "mgr fail", "who": "smithi194.wnexas"}]: dispatch 2021-11-03T16:55:10.433 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: audit 2021- 2021-11-03T16:55:10.433 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: 11-03T16:55:09. 2021-11-03T16:55:10.433 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: 016373+0000 mon.smithi026 (mon.0 2021-11-03T16:55:10.434 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: ) 626 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "mgr fail", "who": "smithi194.wnexas"}]: dispatch 2021-11-03T16:55:10.434 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: cluster 2021 2021-11-03T16:55:10.434 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: -11-03T16:55:09 2021-11-03T16:55:10.434 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: .020798+0000 mon.smithi026 (mon. 2021-11-03T16:55:10.434 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: 0) 627 : cluster [DBG] osdmap e48: 6 total, 6 up, 6 in 2021-11-03T16:55:10.435 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: 2021-11-03T16:55:10.435 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: cluster 2021-11-03T16:55:10.435 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: 2021-11-03T16: 2021-11-03T16:55:10.435 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: 55:09.083153+0000 mon.smithi026 ( 2021-11-03T16:55:10.436 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: mon.0) 628 : cluster [INF] 2021-11-03T16:55:10.436 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2021-11-03T16:55:10.436 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: cluster 2021-11-03T16:55:10.436 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: 2021-11-03T16 2021-11-03T16:55:10.436 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: :55:09.366666+0000 2021-11-03T16:55:10.437 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: mon.smithi026 (mon.0) 629 : cluster 2021-11-03T16:55:10.437 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:10 smithi026 conmon[32119]: [DBG] Standby manager daemon smithi194.wnexas started 2021-11-03T16:55:10.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:10.426+0000 7fc5a57fa700 1 -- 172.21.15.26:0/1059995613 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156383 (secure 0 0 0) 0x7fc59404e970 con 0x7fc5a80f7980 2021-11-03T16:55:11.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:11.092+0000 7fc5a57fa700 1 -- 172.21.15.26:0/1059995613 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mgrmap(e 26) v1 ==== 81534+0+0 (secure 0 0 0) 0x7fc594079f00 con 0x7fc5a80f7980 2021-11-03T16:55:11.272 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:11 smithi026 conmon[32119]: audit 2021-11-03T16:55:10.013349+0000 mon.smithi026 (mon.0) 630 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' cmd='[{"prefix": "mgr fail", "who": "smithi194.wnexas"}]': finished 2021-11-03T16:55:11.272 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:11 smithi026 conmon[32119]: cluster 2021-11-03T16:55:10.013448+0000 mon.smithi026 (mon.0) 631 : cluster [DBG] mgrmap e25: smithi026.cnrxli(active, starting, since 0.996178s), standbys: smithi194.wnexas 2021-11-03T16:55:11.272 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:11 smithi026 conmon[32119]: cluster 2021-11-03 2021-11-03T16:55:11.273 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:11 smithi026 conmon[32119]: T16:55:10.088327+0000 mon.smithi026 (mon.0) 632 : 2021-11-03T16:55:11.273 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:11 smithi026 conmon[32119]: cluster [DBG] mds.? [v2:172.21.15.26:6828/3059137105,v1:172.21.15.26:6829/3059137105] up:reconnect 2021-11-03T16:55:11.273 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:11 smithi026 conmon[32119]: cluster 2021-11-03T16:55:11.273 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:11 smithi026 conmon[32119]: 2021-11-03T16: 2021-11-03T16:55:11.274 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:11 smithi026 conmon[32119]: 55:10.088395+0000 mon.smithi026 (mon.0) 2021-11-03T16:55:11.274 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:11 smithi026 conmon[32119]: 633 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi026.yfxlxl=up:reconnect} 3 up:standby 2021-11-03T16:55:11.274 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:11 smithi026 conmon[32119]: cluster 2021 2021-11-03T16:55:11.274 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:11 smithi026 conmon[32119]: -11-03T16:55:10. 2021-11-03T16:55:11.275 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:11 smithi026 conmon[32119]: 141810+0000 mds.cephfs.smithi026.yfxlxl (mds.0) 1 : cluster 2021-11-03T16:55:11.275 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:11 smithi026 conmon[32119]: [DBG] reconnect by client.24305 v1:192.168.0.1:0/1370096456 after 0.0559992 2021-11-03T16:55:11.275 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:11 smithi026 conmon[32119]: cluster 2021-11-03T 2021-11-03T16:55:11.275 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:11 smithi026 conmon[32119]: 16:55:10.143990+0000 mds.cephfs.smithi026.yfxlxl (mds 2021-11-03T16:55:11.275 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:11 smithi026 conmon[32119]: .0) 2 : cluster [DBG] reconnect by client.24301 v1:172.21.15.26:0/553539211 after 0.0579991 2021-11-03T16:55:11.276 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:11 smithi026 conmon[32119]: cluster 2021 2021-11-03T16:55:11.276 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:11 smithi026 conmon[32119]: -11-03T16:55:10.470327 2021-11-03T16:55:11.276 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:11 smithi026 conmon[32119]: +0000 mon.smithi026 (mon.0) 634 : cluster 2021-11-03T16:55:11.277 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:11 smithi026 conmon[32119]: [INF] Active manager daemon smithi026.cnrxli restarted 2021-11-03T16:55:11.277 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:11 smithi026 conmon[32119]: cluster 2021-11-03T16:55 2021-11-03T16:55:11.277 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:11 smithi026 conmon[32119]: :10.470898+0000 mon.smithi026 (mon.0) 2021-11-03T16:55:11.277 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:11 smithi026 conmon[32119]: 635 : cluster [INF] Activating manager daemon smithi026.cnrxli 2021-11-03T16:55:11.277 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:11 smithi026 conmon[32119]: cluster 2021-11-03 2021-11-03T16:55:11.278 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:11 smithi026 conmon[32119]: T16:55:10.474538+0000 mon.smithi026 ( 2021-11-03T16:55:11.278 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:11 smithi026 conmon[32119]: mon.0) 636 : cluster [DBG] osdmap e49: 6 total, 6 up, 6 in 2021-11-03T16:55:11.279 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:11 smithi026 conmon[32119]: audit 2021- 2021-11-03T16:55:11.279 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:11 smithi026 conmon[32119]: 11-03T16:55:10.475032+0000 2021-11-03T16:55:11.279 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:11 smithi026 conmon[32119]: mon.smithi026 (mon.0) 637 : audit [DBG] 2021-11-03T16:55:11.279 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:11 smithi026 conmon[32119]: from='mgr.? 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi026.cnrxli/crt"}]: dispatch 2021-11-03T16:55:11.280 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:11 smithi026 conmon[32119]: audit 2021-11-03T16:55 2021-11-03T16:55:11.280 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:11 smithi026 conmon[32119]: :10.475613+0000 mon.smithi026 (mon.0) 2021-11-03T16:55:11.281 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:11 smithi026 conmon[32119]: 638 : audit [DBG] from='mgr.? 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-11-03T16:55:11.281 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:11 smithi026 conmon[32119]: audit 2021-11-03 2021-11-03T16:55:11.281 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:11 smithi026 conmon[32119]: T16:55:10.478638+0000 mon.smithi026 ( 2021-11-03T16:55:11.281 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:11 smithi026 conmon[32119]: mon.0) 639 : audit [DBG] from='mgr.? 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi026.cnrxli/key"}]: dispatch 2021-11-03T16:55:11.282 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:11 smithi026 conmon[32119]: 2021-11-03T16:55:11.282 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:11 smithi026 conmon[32119]: audit 2021-11-03T16:55:11.282 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:11 smithi026 conmon[32119]: 2021-11-03T16:55:10.479058+0000 mon.smithi026 ( 2021-11-03T16:55:11.283 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:11 smithi026 conmon[32119]: mon.0) 640 : audit [DBG] from='mgr.? 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-11-03T16:55:11.283 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:11 smithi194 conmon[35111]: audit 2021-11-03T16:55:10.013349+0000 mon.smithi026 (mon.0) 630 : audit [INF] from='mgr.24377 ' entity='mgr.smithi194.wnexas' cmd='[{"prefix": "mgr fail", "who": "smithi194.wnexas"}]': finished 2021-11-03T16:55:11.284 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:11 smithi194 conmon[35111]: cluster 2021-11-03T16:55:10 2021-11-03T16:55:11.284 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:11 smithi194 conmon[35111]: .013448+0000 mon.smithi026 (mon.0) 631 : cluster [DBG] mgrmap e25: smithi026.cnrxli(active, starting, since 0.996178s), standbys: smithi194.wnexas 2021-11-03T16:55:11.284 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:11 smithi194 conmon[35111]: cluster 2021-11-03T16:55:10.088327+0000 mon.smithi026 (mon.0) 632 : cluster [DBG] mds.? [v2:172.21.15.26:6828/3059137105,v1:172.21.15.26:6829/3059137105] up:reconnect 2021-11-03T16:55:11.284 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:11 smithi194 conmon[35111]: cluster 2021-11-03T16:55:10.088395+0000 mon.smithi026 (mon.0) 633 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi026.yfxlxl=up:reconnect} 3 up:standby 2021-11-03T16:55:11.284 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:11 smithi194 conmon[35111]: cluster 2021-11-03T16:55:10.141810+0000 mds.cephfs.smithi026.yfxlxl (mds.0) 1 : cluster [DBG] reconnect by client.24305 v1:192.168.0.1:0/1370096456 after 0.0559992 2021-11-03T16:55:11.285 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:11 smithi194 conmon[35111]: cluster 2021-11-03T16:55:10.143990+0000 mds.cephfs.smithi026.yfxlxl (mds.0) 2 : cluster [DBG] reconnect by client.24301 v1:172.21.15.26:0/553539211 after 0.0579991 2021-11-03T16:55:11.285 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:11 smithi194 conmon[35111]: cluster 2021-11-03T16:55:10. 2021-11-03T16:55:11.285 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:11 smithi194 conmon[35111]: 470327+0000 mon.smithi026 (mon.0) 634 : cluster [INF] Active manager daemon smithi026.cnrxli restarted 2021-11-03T16:55:11.285 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:11 smithi194 conmon[35111]: cluster 2021-11-03T16:55:10.470898+0000 mon.smithi026 (mon.0) 635 : cluster [INF] Activating manager daemon smithi026.cnrxli 2021-11-03T16:55:11.286 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:11 smithi194 conmon[35111]: cluster 2021-11-03T16:55:11.286 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:11 smithi194 conmon[35111]: 2021-11-03T16:55:10.474538+0000 mon.smithi026 (mon.0) 636 : cluster [DBG] osdmap e49: 6 total, 6 up, 6 in 2021-11-03T16:55:11.286 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:11 smithi194 conmon[35111]: audit 2021-11-03T16: 2021-11-03T16:55:11.286 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:11 smithi194 conmon[35111]: 55:10.475032+0000 mon.smithi026 (mon.0) 637 : audit 2021-11-03T16:55:11.287 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:11 smithi194 conmon[35111]: [DBG] from='mgr.? 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi026.cnrxli/crt"}]: dispatch 2021-11-03T16:55:11.287 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:11 smithi194 conmon[35111]: audit 2021-11-03T16:55:11.287 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:11 smithi194 conmon[35111]: 2021-11-03T16:55:10.475613+0000 mon.smithi026 (mon.0) 2021-11-03T16:55:11.287 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:11 smithi194 conmon[35111]: 638 : audit [DBG] from='mgr.? 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-11-03T16:55:11.288 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:11 smithi194 conmon[35111]: audit 2021-11-03T16:55:10.478638 2021-11-03T16:55:11.288 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:11 smithi194 conmon[35111]: +0000 mon.smithi026 (mon.0) 639 : audit [DBG] from='mgr.? 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi026.cnrxli/key"}]: dispatch 2021-11-03T16:55:11.288 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:11 smithi194 conmon[35111]: audit 2021-11- 2021-11-03T16:55:11.288 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:11 smithi194 conmon[35111]: 03T16:55:10.479058+0000 mon.smithi026 (mon. 2021-11-03T16:55:11.288 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:11 smithi194 conmon[35111]: 0) 640 : audit [DBG] from='mgr.? 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-11-03T16:55:12.095 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.097+0000 7fc5a57fa700 1 -- 172.21.15.26:0/1059995613 <== mon.0 v2:172.21.15.26:3300/0 8 ==== mgrmap(e 27) v1 ==== 81644+0+0 (secure 0 0 0) 0x7fc59407a280 con 0x7fc5a80f7980 2021-11-03T16:55:12.096 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.097+0000 7fc5a57fa700 1 --2- 172.21.15.26:0/1059995613 >> [v2:172.21.15.26:6826/818617424,v1:172.21.15.26:6827/818617424] conn(0x7fc598012390 0x7fc5980147a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:55:12.096 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.098+0000 7fc5a57fa700 1 -- 172.21.15.26:0/1059995613 --> [v2:172.21.15.26:6826/818617424,v1:172.21.15.26:6827/818617424] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc598007830 con 0x7fc598012390 2021-11-03T16:55:12.096 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.098+0000 7fc5aca7b700 1 --2- 172.21.15.26:0/1059995613 >> [v2:172.21.15.26:6826/818617424,v1:172.21.15.26:6827/818617424] conn(0x7fc598012390 0x7fc5980147a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:55:12.096 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.099+0000 7fc5aca7b700 1 --2- 172.21.15.26:0/1059995613 >> [v2:172.21.15.26:6826/818617424,v1:172.21.15.26:6827/818617424] conn(0x7fc598012390 0x7fc5980147a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7fc5a806b7d0 tx=0x7fc59c00b040).ready entity=mgr.14594 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:55:12.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.106+0000 7fc5a57fa700 1 -- 172.21.15.26:0/1059995613 <== mgr.14594 v2:172.21.15.26:6826/818617424 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+257 (secure 0 0 0) 0x7fc59c00f040 con 0x7fc598012390 2021-11-03T16:55:12.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.110+0000 7fc5aecdf700 1 -- 172.21.15.26:0/1059995613 >> [v2:172.21.15.26:6826/818617424,v1:172.21.15.26:6827/818617424] conn(0x7fc598012390 msgr2=0x7fc5980147a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:55:12.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.110+0000 7fc5aecdf700 1 --2- 172.21.15.26:0/1059995613 >> [v2:172.21.15.26:6826/818617424,v1:172.21.15.26:6827/818617424] conn(0x7fc598012390 0x7fc5980147a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7fc5a806b7d0 tx=0x7fc59c00b040).stop 2021-11-03T16:55:12.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.110+0000 7fc5aecdf700 1 -- 172.21.15.26:0/1059995613 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5a80f7980 msgr2=0x7fc5a806a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:55:12.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.110+0000 7fc5aecdf700 1 --2- 172.21.15.26:0/1059995613 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5a80f7980 0x7fc5a806a3b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7fc594000c00 tx=0x7fc59400b040).stop 2021-11-03T16:55:12.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.110+0000 7fc5aecdf700 1 -- 172.21.15.26:0/1059995613 shutdown_connections 2021-11-03T16:55:12.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.110+0000 7fc5aecdf700 1 --2- 172.21.15.26:0/1059995613 >> [v2:172.21.15.26:6826/818617424,v1:172.21.15.26:6827/818617424] conn(0x7fc598012390 0x7fc5980147a0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:12.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.110+0000 7fc5aecdf700 1 --2- 172.21.15.26:0/1059995613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5a80f66e0 0x7fc5a8069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:12.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.110+0000 7fc5aecdf700 1 --2- 172.21.15.26:0/1059995613 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5a80f7980 0x7fc5a806a3b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:12.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.110+0000 7fc5aecdf700 1 -- 172.21.15.26:0/1059995613 >> 172.21.15.26:0/1059995613 conn(0x7fc5a80f1e40 msgr2=0x7fc5a80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:55:12.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.110+0000 7fc5aecdf700 1 -- 172.21.15.26:0/1059995613 shutdown_connections 2021-11-03T16:55:12.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.110+0000 7fc5aecdf700 1 -- 172.21.15.26:0/1059995613 wait complete. 2021-11-03T16:55:12.121 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T16:55:12.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.265+0000 7fa9fde33700 1 -- 172.21.15.26:0/1603564029 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9f80f6860 msgr2=0x7fa9f80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:55:12.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.265+0000 7fa9fde33700 1 --2- 172.21.15.26:0/1603564029 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9f80f6860 0x7fa9f80f6cc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7fa9ec004660 tx=0x7fa9ec009b30).stop 2021-11-03T16:55:12.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.266+0000 7fa9fde33700 1 -- 172.21.15.26:0/1603564029 shutdown_connections 2021-11-03T16:55:12.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.266+0000 7fa9fde33700 1 --2- 172.21.15.26:0/1603564029 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9f80f6860 0x7fa9f80f6cc0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:12.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.266+0000 7fa9fde33700 1 --2- 172.21.15.26:0/1603564029 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9f80f55c0 0x7fa9f80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:12.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.266+0000 7fa9fde33700 1 -- 172.21.15.26:0/1603564029 >> 172.21.15.26:0/1603564029 conn(0x7fa9f80f0d40 msgr2=0x7fa9f80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:55:12.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.266+0000 7fa9fde33700 1 -- 172.21.15.26:0/1603564029 shutdown_connections 2021-11-03T16:55:12.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.266+0000 7fa9fde33700 1 -- 172.21.15.26:0/1603564029 wait complete. 2021-11-03T16:55:12.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.266+0000 7fa9fde33700 1 Processor -- start 2021-11-03T16:55:12.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.267+0000 7fa9fde33700 1 -- start start 2021-11-03T16:55:12.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.267+0000 7fa9fde33700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9f80f55c0 0x7fa9f810c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:55:12.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.267+0000 7fa9fde33700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9f80f6860 0x7fa9f810e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:55:12.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.267+0000 7fa9fde33700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f80603d0 con 0x7fa9f80f6860 2021-11-03T16:55:12.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.267+0000 7fa9fde33700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f8060510 con 0x7fa9f80f55c0 2021-11-03T16:55:12.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.267+0000 7fa9f6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9f80f6860 0x7fa9f810e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:55:12.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.267+0000 7fa9f77fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9f80f55c0 0x7fa9f810c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:55:12.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.267+0000 7fa9f6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9f80f6860 0x7fa9f810e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50660/0 (socket says 172.21.15.26:50660) 2021-11-03T16:55:12.268 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.267+0000 7fa9f6ffd700 1 -- 172.21.15.26:0/1033480934 learned_addr learned my addr 172.21.15.26:0/1033480934 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:55:12.268 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.268+0000 7fa9f6ffd700 1 -- 172.21.15.26:0/1033480934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9f80f55c0 msgr2=0x7fa9f810c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:55:12.268 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.268+0000 7fa9f6ffd700 1 --2- 172.21.15.26:0/1033480934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9f80f55c0 0x7fa9f810c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:12.268 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.268+0000 7fa9f6ffd700 1 -- 172.21.15.26:0/1033480934 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9ec005040 con 0x7fa9f80f6860 2021-11-03T16:55:12.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.268+0000 7fa9f6ffd700 1 --2- 172.21.15.26:0/1033480934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9f80f6860 0x7fa9f810e510 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7fa9ec009990 tx=0x7fa9ec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:55:12.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.268+0000 7fa9dffff700 1 -- 172.21.15.26:0/1033480934 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9ec018070 con 0x7fa9f80f6860 2021-11-03T16:55:12.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.268+0000 7fa9fde33700 1 -- 172.21.15.26:0/1033480934 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f810ea00 con 0x7fa9f80f6860 2021-11-03T16:55:12.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.268+0000 7fa9fde33700 1 -- 172.21.15.26:0/1033480934 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f810edd0 con 0x7fa9f80f6860 2021-11-03T16:55:12.270 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.268+0000 7fa9dffff700 1 -- 172.21.15.26:0/1033480934 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa9ec007ba0 con 0x7fa9f80f6860 2021-11-03T16:55:12.270 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.268+0000 7fa9dffff700 1 -- 172.21.15.26:0/1033480934 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9ec01dd00 con 0x7fa9f80f6860 2021-11-03T16:55:12.270 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.270+0000 7fa9dffff700 1 -- 172.21.15.26:0/1033480934 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 27) v1 ==== 81644+0+0 (secure 0 0 0) 0x7fa9ec01d420 con 0x7fa9f80f6860 2021-11-03T16:55:12.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.270+0000 7fa9dffff700 1 --2- 172.21.15.26:0/1033480934 >> [v2:172.21.15.26:6826/818617424,v1:172.21.15.26:6827/818617424] conn(0x7fa9e0063d60 0x7fa9e0066220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:55:12.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.270+0000 7fa9fde33700 1 -- 172.21.15.26:0/1033480934 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9d8004fa0 con 0x7fa9f80f6860 2021-11-03T16:55:12.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.270+0000 7fa9dffff700 1 -- 172.21.15.26:0/1033480934 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5945+0+0 (secure 0 0 0) 0x7fa9ec081a20 con 0x7fa9f80f6860 2021-11-03T16:55:12.272 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.270+0000 7fa9f77fe700 1 --2- 172.21.15.26:0/1033480934 >> [v2:172.21.15.26:6826/818617424,v1:172.21.15.26:6827/818617424] conn(0x7fa9e0063d60 0x7fa9e0066220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:55:12.272 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.271+0000 7fa9f77fe700 1 --2- 172.21.15.26:0/1033480934 >> [v2:172.21.15.26:6826/818617424,v1:172.21.15.26:6827/818617424] conn(0x7fa9e0063d60 0x7fa9e0066220 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fa9f8060160 tx=0x7fa9e800b040).ready entity=mgr.14594 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:55:12.272 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.276+0000 7fa9dffff700 1 -- 172.21.15.26:0/1033480934 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156383 (secure 0 0 0) 0x7fa9ec0506a0 con 0x7fa9f80f6860 2021-11-03T16:55:12.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:12 smithi026 conmon[32119]: cluster 2021-11-03T16:55:11.088647+0000 mon.smithi026 (mon.0) 641 : cluster [DBG] mds.? [v2:172.21.15.26:6828/3059137105,v1:172.21.15.26:6829/3059137105] up:rejoin 2021-11-03T16:55:12.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:12 smithi026 conmon[32119]: cluster 2021-11-03T16:55:11.088697+0000 mon.smithi026 (mon.0) 642 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi026.yfxlxl=up:rejoin} 3 up:standby 2021-11-03T16:55:12.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:12 smithi026 conmon[32119]: cluster 2021-11-03T16:55:11.095237+0000 mon.smithi026 (mon.0) 643 : cluster [DBG] mgrmap e26: smithi026.cnrxli(active, starting, since 0.624489s), standbys: smithi194.wnexas 2021-11-03T16:55:12.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:12 smithi026 conmon[32119]: audit 2021-11-03T16:55:11.096812+0000 mon.smithi026 (mon.0) 644 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata", "id": "smithi026"}]: dispatch 2021-11-03T16:55:12.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:12 smithi026 conmon[32119]: audit 2021-11-03T16:55:11.097034+0000 mon.smithi026 (mon.0) 645 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2021-11-03T16:55:12.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:12 smithi026 conmon[32119]: audit 2021-11-03T16:55:11.097299+0000 mon.smithi026 (mon.0) 646 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.yfxlxl"}]: dispatch 2021-11-03T16:55:12.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:12 smithi026 conmon[32119]: audit 2021-11-03T16:55:11.097544+0000 mon.smithi026 (mon.0) 647 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.ltacyh"}]: dispatch 2021-11-03T16:55:12.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:12 smithi026 conmon[32119]: audit 2021-11-03T16:55:11.097785+0000 mon.smithi026 (mon.0) 648 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.kwikhp"}]: dispatch 2021-11-03T16:55:12.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:12 smithi026 conmon[32119]: audit 2021-11-03T16:55:11.098217+0000 mon.smithi026 (mon.0) 649 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.mpotdl"}]: dispatch 2021-11-03T16:55:12.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:12 smithi026 conmon[32119]: audit 2021-11-03T16:55:11.099037+0000 mon.smithi026 (mon.0) 650 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mgr metadata", "who": "smithi026.cnrxli", "id": "smithi026.cnrxli"}]: dispatch 2021-11-03T16:55:12.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:12 smithi026 conmon[32119]: audit 2021-11-03T16:55:11.099254+0000 mon.smithi026 (mon.0) 651 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mgr metadata", "who": "smithi194.wnexas", "id": "smithi194.wnexas"}]: dispatch 2021-11-03T16:55:12.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:12 smithi026 conmon[32119]: audit 2021-11-03T16:55:11.099531+0000 mon.smithi026 (mon.0) 652 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-11-03T16:55:12.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:12 smithi026 conmon[32119]: audit 2021-11-03T16:55:11.099829+0000 mon.smithi026 (mon.0) 653 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-11-03T16:55:12.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:12 smithi026 conmon[32119]: audit 2021-11-03T16:55:11.100051+0000 mon.smithi026 (mon.0) 654 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-11-03T16:55:12.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:12 smithi026 conmon[32119]: audit 2021-11-03T16:55:11.100277+0000 mon.smithi026 (mon.0) 655 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-11-03T16:55:12.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:12 smithi026 conmon[32119]: audit 2021-11-03T16:55:11.100526+0000 mon.smithi026 (mon.0) 656 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-11-03T16:55:12.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:12 smithi026 conmon[32119]: audit 2021-11-03T16:55:11.100786+0000 mon.smithi026 (mon.0) 657 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-11-03T16:55:12.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:12 smithi026 conmon[32119]: audit 2021-11-03T16:55:11.102171+0000 mon.smithi026 (mon.0) 658 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-11-03T16:55:12.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:12 smithi026 conmon[32119]: audit 2021-11-03T16:55:11.102736+0000 mon.smithi026 (mon.0) 659 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-11-03T16:55:12.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:12 smithi026 conmon[32119]: audit 2021-11-03T16:55:11.103141+0000 mon.smithi026 (mon.0) 660 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-11-03T16:55:12.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:12 smithi026 conmon[32119]: cluster 2021-11-03T16:55:11.123969+0000 mon.smithi026 (mon.0) 661 : cluster [INF] Manager daemon smithi026.cnrxli is now available 2021-11-03T16:55:12.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:12 smithi026 conmon[32119]: cephadm 2021-11-03T16:55:11.136862+0000 mgr.smithi026.cnrxli (mgr.14594) 1 : cephadm [INF] inventory: adjusted host smithi194 addr 'smithi194' -> '172.21.15.194' 2021-11-03T16:55:12.428 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:12 smithi026 conmon[32119]: audit 2021-11-03T16:55:11.140405+0000 mon.smithi026 (mon.0) 662 : audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' 2021-11-03T16:55:12.428 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:12 smithi026 conmon[32119]: audit 2021-11-03T16:55:11.149961+0000 mon.smithi026 (mon.0) 663 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:55:12.428 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:12 smithi026 conmon[32119]: audit 2021-11-03T16:55:11.151987+0000 mon.smithi026 (mon.0) 664 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:55:12.428 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:12 smithi026 conmon[32119]: audit 2021-11-03T16:55:11.175754+0000 mon.smithi026 (mon.0) 665 : audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' 2021-11-03T16:55:12.429 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:12 smithi026 conmon[32119]: audit 2021-11-03T16:55:11.190780+0000 mon.smithi026 (mon.0) 666 : audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T16:55:12.429 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:12 smithi026 conmon[32119]: audit 2021-11-03T16:55:11.196194+0000 mon.smithi026 (mon.0) 667 : audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T16:55:12.429 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:12 smithi026 conmon[32119]: cluster 2021-11-03T16:55:12.022260+0000 mon.smithi026 (mon.0) 668 : cluster [INF] daemon mds.cephfs.smithi026.yfxlxl is now active in filesystem cephfs as rank 0 2021-11-03T16:55:12.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.497+0000 7fa9fde33700 1 -- 172.21.15.26:0/1033480934 --> [v2:172.21.15.26:6826/818617424,v1:172.21.15.26:6827/818617424] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa9d80029f0 con 0x7fa9e0063d60 2021-11-03T16:55:12.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:12 smithi194 conmon[35111]: cluster 2021-11-03T16:55:11.088647+0000 mon.smithi026 (mon.0) 641 : cluster [DBG] mds.? [v2:172.21.15.26:6828/3059137105,v1:172.21.15.26:6829/3059137105] up:rejoin 2021-11-03T16:55:12.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:12 smithi194 conmon[35111]: cluster 2021-11-03T16:55:11.088697+0000 mon.smithi026 (mon.0) 642 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi026.yfxlxl=up:rejoin} 3 up:standby 2021-11-03T16:55:12.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:12 smithi194 conmon[35111]: cluster 2021-11-03T16:55:11.095237+0000 mon.smithi026 (mon.0) 643 : cluster [DBG] mgrmap e26: smithi026.cnrxli(active, starting, since 0.624489s), standbys: smithi194.wnexas 2021-11-03T16:55:12.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:12 smithi194 conmon[35111]: audit 2021-11-03T16:55:11.096812+0000 mon.smithi026 (mon.0) 644 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata", "id": "smithi026"}]: dispatch 2021-11-03T16:55:12.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:12 smithi194 conmon[35111]: audit 2021-11-03T16:55:11.097034+0000 mon.smithi026 (mon.0) 645 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2021-11-03T16:55:12.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:12 smithi194 conmon[35111]: audit 2021-11-03T16:55:11.097299+0000 mon.smithi026 (mon.0) 646 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.yfxlxl"}]: dispatch 2021-11-03T16:55:12.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:12 smithi194 conmon[35111]: audit 2021-11-03T16:55:11.097544+0000 mon.smithi026 (mon.0) 647 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.ltacyh"}]: dispatch 2021-11-03T16:55:12.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:12 smithi194 conmon[35111]: audit 2021-11-03T16:55:11.097785+0000 mon.smithi026 (mon.0) 648 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.kwikhp"}]: dispatch 2021-11-03T16:55:12.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:12 smithi194 conmon[35111]: audit 2021-11-03T16:55:11.098217+0000 mon.smithi026 (mon.0) 649 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.mpotdl"}]: dispatch 2021-11-03T16:55:12.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:12 smithi194 conmon[35111]: audit 2021-11-03T16:55:11.099037+0000 mon.smithi026 (mon.0) 650 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mgr metadata", "who": "smithi026.cnrxli", "id": "smithi026.cnrxli"}]: dispatch 2021-11-03T16:55:12.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:12 smithi194 conmon[35111]: audit 2021-11-03T16:55:11.099254+0000 mon.smithi026 (mon.0) 651 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mgr metadata", "who": "smithi194.wnexas", "id": "smithi194.wnexas"}]: dispatch 2021-11-03T16:55:12.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:12 smithi194 conmon[35111]: audit 2021-11-03T16:55:11.099531+0000 mon.smithi026 (mon.0) 652 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-11-03T16:55:12.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:12 smithi194 conmon[35111]: audit 2021-11-03T16:55:11.099829+0000 mon.smithi026 (mon.0) 653 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-11-03T16:55:12.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:12 smithi194 conmon[35111]: audit 2021-11-03T16:55:11.100051+0000 mon.smithi026 (mon.0) 654 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-11-03T16:55:12.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:12 smithi194 conmon[35111]: audit 2021-11-03T16:55:12.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:12 smithi194 conmon[35111]: 2021-11-03T16:55:11.100277+0000 mon.smithi026 (mon.0) 655 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-11-03T16:55:12.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:12 smithi194 conmon[35111]: audit 2021-11-03T16:55:11.100526+0000 mon.smithi026 (mon.0) 656 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-11-03T16:55:12.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:12 smithi194 conmon[35111]: audit 2021-11-03T16:55:11.100786+0000 mon.smithi026 (mon.0) 657 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-11-03T16:55:12.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:12 smithi194 conmon[35111]: audit 2021-11-03T16:55:11.102171+0000 mon.smithi026 (mon.0) 658 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-11-03T16:55:12.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:12 smithi194 conmon[35111]: audit 2021-11-03T16:55:11.102736+0000 mon.smithi026 (mon.0) 659 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-11-03T16:55:12.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:12 smithi194 conmon[35111]: audit 2021-11-03T16:55:11.103141+0000 mon.smithi026 (mon.0) 660 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-11-03T16:55:12.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:12 smithi194 conmon[35111]: cluster 2021-11-03T16:55:11.123969+0000 mon.smithi026 (mon.0) 661 : cluster [INF] Manager daemon smithi026.cnrxli is now available 2021-11-03T16:55:12.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:12 smithi194 conmon[35111]: cephadm 2021-11-03T16:55:11.136862+0000 mgr.smithi026.cnrxli (mgr.14594) 1 : cephadm [INF] inventory: adjusted host smithi194 addr 'smithi194' -> '172.21.15.194' 2021-11-03T16:55:12.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:12 smithi194 conmon[35111]: audit 2021-11-03T16:55:11.140405+0000 mon.smithi026 (mon.0) 662 : audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' 2021-11-03T16:55:12.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:12 smithi194 conmon[35111]: audit 2021-11-03T16:55:11.149961+0000 mon.smithi026 (mon.0) 663 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:55:12.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:12 smithi194 conmon[35111]: audit 2021-11-03T16:55:11.151987+0000 mon.smithi026 (mon.0) 664 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:55:12.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:12 smithi194 conmon[35111]: audit 2021-11-03T16:55:11.175754+0000 mon.smithi026 (mon.0) 665 : audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' 2021-11-03T16:55:12.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:12 smithi194 conmon[35111]: audit 2021-11-03T16:55:11.190780+0000 mon.smithi026 (mon.0) 666 : audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T16:55:12.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:12 smithi194 conmon[35111]: audit 2021-11-03T16:55:11.196194+0000 mon.smithi026 (mon.0) 667 : audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T16:55:12.505 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:12 smithi194 conmon[35111]: cluster 2021-11-03T16:55:12.022260+0000 mon.smithi026 (mon.0) 668 : cluster [INF] daemon mds.cephfs.smithi026.yfxlxl is now active in filesystem cephfs as rank 0 2021-11-03T16:55:12.508 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.512+0000 7fa9dffff700 1 -- 172.21.15.26:0/1033480934 <== mgr.14594 v2:172.21.15.26:6826/818617424 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fa9d80029f0 con 0x7fa9e0063d60 2021-11-03T16:55:12.508 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T16:55:12.508 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (6m) 3s ago 7m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T16:55:12.509 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (7m) 3s ago 7m 7017k - 16.2.4 8d91d370c2b8 83a448d79108 2021-11-03T16:55:12.509 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (6m) 19s ago 6m 7130k - 16.2.4 8d91d370c2b8 708c0ec0397b 2021-11-03T16:55:12.509 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (6m) 3s ago 7m 38.5M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T16:55:12.509 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (11s) 3s ago 2m 12.0M - 16.2.4 8d91d370c2b8 00b9cec565b4 2021-11-03T16:55:12.510 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (2m) 3s ago 2m 14.4M - 16.2.4 8d91d370c2b8 638170268dac 2021-11-03T16:55:12.510 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (2m) 19s ago 2m 13.4M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T16:55:12.510 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (2m) 19s ago 2m 14.2M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T16:55:12.510 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (10s) 3s ago 9m 42.1M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T16:55:12.511 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8443,9283 running (33s) 19s ago 6m 440M - 17.0.0-8776-g6e90212d 50416d063274 aab20c78983c 2021-11-03T16:55:12.511 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (9m) 3s ago 9m 98.8M 2048M 16.2.4 8d91d370c2b8 c37e54308890 2021-11-03T16:55:12.511 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (6m) 19s ago 6m 74.2M 2048M 16.2.4 8d91d370c2b8 b688a2953f0a 2021-11-03T16:55:12.511 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (7m) 3s ago 7m 18.1M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T16:55:12.511 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (6m) 19s ago 6m 18.2M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T16:55:12.512 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (6m) 3s ago 6m 403M 4096M 16.2.4 8d91d370c2b8 d7f900ddf0f3 2021-11-03T16:55:12.512 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (5m) 3s ago 5m 400M 4096M 16.2.4 8d91d370c2b8 9e5ffa11984b 2021-11-03T16:55:12.512 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (5m) 3s ago 5m 344M 4096M 16.2.4 8d91d370c2b8 f65145633c0e 2021-11-03T16:55:12.512 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (5m) 19s ago 5m 499M 4096M 16.2.4 8d91d370c2b8 ff6d474a5f9a 2021-11-03T16:55:12.513 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (4m) 19s ago 4m 442M 4096M 16.2.4 8d91d370c2b8 e2fc9c0bdf0f 2021-11-03T16:55:12.513 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (4m) 19s ago 4m 491M 4096M 16.2.4 8d91d370c2b8 0abc64d8a2bf 2021-11-03T16:55:12.513 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (6m) 3s ago 7m 42.6M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T16:55:12.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.515+0000 7fa9fde33700 1 -- 172.21.15.26:0/1033480934 >> [v2:172.21.15.26:6826/818617424,v1:172.21.15.26:6827/818617424] conn(0x7fa9e0063d60 msgr2=0x7fa9e0066220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:55:12.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.515+0000 7fa9fde33700 1 --2- 172.21.15.26:0/1033480934 >> [v2:172.21.15.26:6826/818617424,v1:172.21.15.26:6827/818617424] conn(0x7fa9e0063d60 0x7fa9e0066220 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fa9f8060160 tx=0x7fa9e800b040).stop 2021-11-03T16:55:12.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.515+0000 7fa9fde33700 1 -- 172.21.15.26:0/1033480934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9f80f6860 msgr2=0x7fa9f810e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:55:12.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.515+0000 7fa9fde33700 1 --2- 172.21.15.26:0/1033480934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9f80f6860 0x7fa9f810e510 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7fa9ec009990 tx=0x7fa9ec009b30).stop 2021-11-03T16:55:12.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.515+0000 7fa9fde33700 1 -- 172.21.15.26:0/1033480934 shutdown_connections 2021-11-03T16:55:12.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.515+0000 7fa9fde33700 1 --2- 172.21.15.26:0/1033480934 >> [v2:172.21.15.26:6826/818617424,v1:172.21.15.26:6827/818617424] conn(0x7fa9e0063d60 0x7fa9e0066220 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:12.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.515+0000 7fa9fde33700 1 --2- 172.21.15.26:0/1033480934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9f80f55c0 0x7fa9f810c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:12.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.515+0000 7fa9fde33700 1 --2- 172.21.15.26:0/1033480934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9f80f6860 0x7fa9f810e510 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:12.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.515+0000 7fa9fde33700 1 -- 172.21.15.26:0/1033480934 >> 172.21.15.26:0/1033480934 conn(0x7fa9f80f0d40 msgr2=0x7fa9f80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:55:12.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.515+0000 7fa9fde33700 1 -- 172.21.15.26:0/1033480934 shutdown_connections 2021-11-03T16:55:12.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.515+0000 7fa9fde33700 1 -- 172.21.15.26:0/1033480934 wait complete. 2021-11-03T16:55:12.622 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.626+0000 7f4cade2c700 1 -- 172.21.15.26:0/1823847719 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ca80f55c0 msgr2=0x7f4ca80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:55:12.622 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.626+0000 7f4cade2c700 1 --2- 172.21.15.26:0/1823847719 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ca80f55c0 0x7f4ca80f59e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f4c98004660 tx=0x7f4c98009b30).stop 2021-11-03T16:55:12.623 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.626+0000 7f4cade2c700 1 -- 172.21.15.26:0/1823847719 shutdown_connections 2021-11-03T16:55:12.623 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.626+0000 7f4cade2c700 1 --2- 172.21.15.26:0/1823847719 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ca80f6860 0x7f4ca80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:12.623 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.626+0000 7f4cade2c700 1 --2- 172.21.15.26:0/1823847719 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ca80f55c0 0x7f4ca80f59e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:12.624 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.626+0000 7f4cade2c700 1 -- 172.21.15.26:0/1823847719 >> 172.21.15.26:0/1823847719 conn(0x7f4ca80f0d40 msgr2=0x7f4ca80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:55:12.624 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.626+0000 7f4cade2c700 1 -- 172.21.15.26:0/1823847719 shutdown_connections 2021-11-03T16:55:12.624 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.626+0000 7f4cade2c700 1 -- 172.21.15.26:0/1823847719 wait complete. 2021-11-03T16:55:12.626 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.627+0000 7f4cade2c700 1 Processor -- start 2021-11-03T16:55:12.626 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.627+0000 7f4cade2c700 1 -- start start 2021-11-03T16:55:12.627 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.627+0000 7f4cade2c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ca80f55c0 0x7f4ca8105e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:55:12.627 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.627+0000 7f4cade2c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ca80f6860 0x7f4ca8106350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:55:12.627 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.627+0000 7f4cade2c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca8106950 con 0x7f4ca80f6860 2021-11-03T16:55:12.627 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.627+0000 7f4cade2c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca8107160 con 0x7f4ca80f55c0 2021-11-03T16:55:12.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.627+0000 7f4ca6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ca80f6860 0x7f4ca8106350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:55:12.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.627+0000 7f4ca6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ca80f6860 0x7f4ca8106350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50670/0 (socket says 172.21.15.26:50670) 2021-11-03T16:55:12.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.627+0000 7f4ca6ffd700 1 -- 172.21.15.26:0/177930756 learned_addr learned my addr 172.21.15.26:0/177930756 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:55:12.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.627+0000 7f4ca77fe700 1 --2- 172.21.15.26:0/177930756 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ca80f55c0 0x7f4ca8105e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:55:12.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.628+0000 7f4ca6ffd700 1 -- 172.21.15.26:0/177930756 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ca80f55c0 msgr2=0x7f4ca8105e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:55:12.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.628+0000 7f4ca6ffd700 1 --2- 172.21.15.26:0/177930756 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ca80f55c0 0x7f4ca8105e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:12.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.628+0000 7f4ca6ffd700 1 -- 172.21.15.26:0/177930756 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c98005040 con 0x7f4ca80f6860 2021-11-03T16:55:12.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.628+0000 7f4ca77fe700 1 --2- 172.21.15.26:0/177930756 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ca80f55c0 0x7f4ca8105e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-03T16:55:12.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.628+0000 7f4ca6ffd700 1 --2- 172.21.15.26:0/177930756 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ca80f6860 0x7f4ca8106350 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f4c9c004c20 tx=0x7f4c9c009c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:55:12.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.628+0000 7f4c8ffff700 1 -- 172.21.15.26:0/177930756 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c9c009320 con 0x7f4ca80f6860 2021-11-03T16:55:12.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.628+0000 7f4c8ffff700 1 -- 172.21.15.26:0/177930756 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4c9c009480 con 0x7f4ca80f6860 2021-11-03T16:55:12.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.628+0000 7f4cade2c700 1 -- 172.21.15.26:0/177930756 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ca8107380 con 0x7f4ca80f6860 2021-11-03T16:55:12.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.628+0000 7f4c8ffff700 1 -- 172.21.15.26:0/177930756 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c9c002af0 con 0x7f4ca80f6860 2021-11-03T16:55:12.631 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.628+0000 7f4cade2c700 1 -- 172.21.15.26:0/177930756 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca8107910 con 0x7f4ca80f6860 2021-11-03T16:55:12.631 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.629+0000 7f4cade2c700 1 -- 172.21.15.26:0/177930756 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ca8045ad0 con 0x7f4ca80f6860 2021-11-03T16:55:12.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.631+0000 7f4c8ffff700 1 -- 172.21.15.26:0/177930756 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 27) v1 ==== 81644+0+0 (secure 0 0 0) 0x7f4c9c0077b0 con 0x7f4ca80f6860 2021-11-03T16:55:12.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.631+0000 7f4c8ffff700 1 --2- 172.21.15.26:0/177930756 >> [v2:172.21.15.26:6826/818617424,v1:172.21.15.26:6827/818617424] conn(0x7f4c90063d60 0x7f4c90066220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:55:12.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.631+0000 7f4c8ffff700 1 -- 172.21.15.26:0/177930756 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5945+0+0 (secure 0 0 0) 0x7f4c9c084660 con 0x7f4ca80f6860 2021-11-03T16:55:12.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.632+0000 7f4ca77fe700 1 --2- 172.21.15.26:0/177930756 >> [v2:172.21.15.26:6826/818617424,v1:172.21.15.26:6827/818617424] conn(0x7f4c90063d60 0x7f4c90066220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:55:12.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.632+0000 7f4ca77fe700 1 --2- 172.21.15.26:0/177930756 >> [v2:172.21.15.26:6826/818617424,v1:172.21.15.26:6827/818617424] conn(0x7f4c90063d60 0x7f4c90066220 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f4c98013690 tx=0x7f4c98009b30).ready entity=mgr.14594 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:55:12.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.635+0000 7f4c8ffff700 1 -- 172.21.15.26:0/177930756 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156383 (secure 0 0 0) 0x7f4c9c053190 con 0x7f4ca80f6860 2021-11-03T16:55:12.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.890+0000 7f4cade2c700 1 -- 172.21.15.26:0/177930756 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4ca80ff830 con 0x7f4ca80f6860 2021-11-03T16:55:12.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.890+0000 7f4c8ffff700 1 -- 172.21.15.26:0/177930756 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+689 (secure 0 0 0) 0x7f4c9c01f2d0 con 0x7f4ca80f6860 2021-11-03T16:55:12.888 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T16:55:12.888 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T16:55:12.888 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2021-11-03T16:55:12.888 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:55:12.889 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T16:55:12.889 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T16:55:12.889 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:55:12.889 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T16:55:12.889 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2021-11-03T16:55:12.890 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:55:12.890 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T16:55:12.890 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T16:55:12.890 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:55:12.891 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T16:55:12.891 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 12, 2021-11-03T16:55:12.891 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T16:55:12.891 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T16:55:12.891 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T16:55:12.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.894+0000 7f4cade2c700 1 -- 172.21.15.26:0/177930756 >> [v2:172.21.15.26:6826/818617424,v1:172.21.15.26:6827/818617424] conn(0x7f4c90063d60 msgr2=0x7f4c90066220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:55:12.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.894+0000 7f4cade2c700 1 --2- 172.21.15.26:0/177930756 >> [v2:172.21.15.26:6826/818617424,v1:172.21.15.26:6827/818617424] conn(0x7f4c90063d60 0x7f4c90066220 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f4c98013690 tx=0x7f4c98009b30).stop 2021-11-03T16:55:12.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.894+0000 7f4cade2c700 1 -- 172.21.15.26:0/177930756 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ca80f6860 msgr2=0x7f4ca8106350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:55:12.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.894+0000 7f4cade2c700 1 --2- 172.21.15.26:0/177930756 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ca80f6860 0x7f4ca8106350 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f4c9c004c20 tx=0x7f4c9c009c80).stop 2021-11-03T16:55:12.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.894+0000 7f4cade2c700 1 -- 172.21.15.26:0/177930756 shutdown_connections 2021-11-03T16:55:12.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.894+0000 7f4cade2c700 1 --2- 172.21.15.26:0/177930756 >> [v2:172.21.15.26:6826/818617424,v1:172.21.15.26:6827/818617424] conn(0x7f4c90063d60 0x7f4c90066220 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:12.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.894+0000 7f4cade2c700 1 --2- 172.21.15.26:0/177930756 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ca80f55c0 0x7f4ca8105e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:12.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.894+0000 7f4cade2c700 1 --2- 172.21.15.26:0/177930756 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ca80f6860 0x7f4ca8106350 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:12.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.894+0000 7f4cade2c700 1 -- 172.21.15.26:0/177930756 >> 172.21.15.26:0/177930756 conn(0x7f4ca80f0d40 msgr2=0x7f4ca80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:55:12.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.895+0000 7f4cade2c700 1 -- 172.21.15.26:0/177930756 shutdown_connections 2021-11-03T16:55:12.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:12.895+0000 7f4cade2c700 1 -- 172.21.15.26:0/177930756 wait complete. 2021-11-03T16:55:12.982 INFO:tasks.workunit.client.1.smithi194.stdout:8/324: unlink d8/d33/f49 0 2021-11-03T16:55:12.983 INFO:tasks.workunit.client.1.smithi194.stdout:3/375: mkdir d2/d17/d26/d73/d7b 0 2021-11-03T16:55:12.985 INFO:tasks.workunit.client.0.smithi026.stdout:5/64: rename d3/da/l14 to d3/da/db/l15 0 2021-11-03T16:55:12.987 INFO:tasks.workunit.client.0.smithi026.stdout:1/151: creat dc/df/f36 x:0 0 0 2021-11-03T16:55:12.991 INFO:tasks.workunit.client.0.smithi026.stdout:5/65: mknod d3/de/c16 1 2021-11-03T16:55:13.025 INFO:tasks.workunit.client.0.smithi026.stdout:1/152: write dc/df/d11/f17 [1055986,48439] 0 2021-11-03T16:55:13.027 INFO:tasks.workunit.client.0.smithi026.stdout:1/153: chown dc/df/d11/f2a 2636425 1 2021-11-03T16:55:13.039 INFO:tasks.workunit.client.0.smithi026.stdout:0/64: truncate da/fd 1574618 0 2021-11-03T16:55:13.044 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.046+0000 7f9d8380d700 1 -- 172.21.15.26:0/47996582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d7c0f55c0 msgr2=0x7f9d7c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:55:13.044 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.046+0000 7f9d8380d700 1 --2- 172.21.15.26:0/47996582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d7c0f55c0 0x7f9d7c0f59e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f9d78004660 tx=0x7f9d78009b30).stop 2021-11-03T16:55:13.044 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.046+0000 7f9d8380d700 1 -- 172.21.15.26:0/47996582 shutdown_connections 2021-11-03T16:55:13.045 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.046+0000 7f9d8380d700 1 --2- 172.21.15.26:0/47996582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d7c0f6860 0x7f9d7c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:13.045 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.046+0000 7f9d8380d700 1 --2- 172.21.15.26:0/47996582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d7c0f55c0 0x7f9d7c0f59e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:13.045 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.046+0000 7f9d8380d700 1 -- 172.21.15.26:0/47996582 >> 172.21.15.26:0/47996582 conn(0x7f9d7c0f0d40 msgr2=0x7f9d7c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:55:13.045 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.046+0000 7f9d8380d700 1 -- 172.21.15.26:0/47996582 shutdown_connections 2021-11-03T16:55:13.046 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.047+0000 7f9d8380d700 1 -- 172.21.15.26:0/47996582 wait complete. 2021-11-03T16:55:13.046 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.047+0000 7f9d8380d700 1 Processor -- start 2021-11-03T16:55:13.046 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.047+0000 7f9d8380d700 1 -- start start 2021-11-03T16:55:13.046 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.047+0000 7f9d8380d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d7c0f55c0 0x7f9d7c109ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:55:13.046 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.047+0000 7f9d8380d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d7c0f6860 0x7f9d7c10c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:55:13.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.047+0000 7f9d8380d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c0603c0 con 0x7f9d7c0f6860 2021-11-03T16:55:13.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.047+0000 7f9d8380d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c060500 con 0x7f9d7c0f55c0 2021-11-03T16:55:13.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.047+0000 7f9d80da8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d7c0f6860 0x7f9d7c10c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:55:13.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.047+0000 7f9d80da8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d7c0f6860 0x7f9d7c10c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50680/0 (socket says 172.21.15.26:50680) 2021-11-03T16:55:13.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.047+0000 7f9d80da8700 1 -- 172.21.15.26:0/4259536285 learned_addr learned my addr 172.21.15.26:0/4259536285 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:55:13.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.048+0000 7f9d815a9700 1 --2- 172.21.15.26:0/4259536285 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d7c0f55c0 0x7f9d7c109ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:55:13.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.048+0000 7f9d80da8700 1 -- 172.21.15.26:0/4259536285 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d7c0f55c0 msgr2=0x7f9d7c109ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:55:13.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.048+0000 7f9d80da8700 1 --2- 172.21.15.26:0/4259536285 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d7c0f55c0 0x7f9d7c109ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:13.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.048+0000 7f9d80da8700 1 -- 172.21.15.26:0/4259536285 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d78005040 con 0x7f9d7c0f6860 2021-11-03T16:55:13.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.048+0000 7f9d80da8700 1 --2- 172.21.15.26:0/4259536285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d7c0f6860 0x7f9d7c10c0a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f9d6c00e7f0 tx=0x7f9d6c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:55:13.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.048+0000 7f9d71ffb700 1 -- 172.21.15.26:0/4259536285 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d6c0092e0 con 0x7f9d7c0f6860 2021-11-03T16:55:13.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.048+0000 7f9d71ffb700 1 -- 172.21.15.26:0/4259536285 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9d6c00f040 con 0x7f9d7c0f6860 2021-11-03T16:55:13.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.048+0000 7f9d8380d700 1 -- 172.21.15.26:0/4259536285 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d7c10c650 con 0x7f9d7c0f6860 2021-11-03T16:55:13.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.048+0000 7f9d71ffb700 1 -- 172.21.15.26:0/4259536285 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d6c0147c0 con 0x7f9d7c0f6860 2021-11-03T16:55:13.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.048+0000 7f9d8380d700 1 -- 172.21.15.26:0/4259536285 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d7c10cbe0 con 0x7f9d7c0f6860 2021-11-03T16:55:13.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.049+0000 7f9d8380d700 1 -- 172.21.15.26:0/4259536285 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d7c0f49b0 con 0x7f9d7c0f6860 2021-11-03T16:55:13.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.050+0000 7f9d71ffb700 1 -- 172.21.15.26:0/4259536285 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 27) v1 ==== 81644+0+0 (secure 0 0 0) 0x7f9d6c01b030 con 0x7f9d7c0f6860 2021-11-03T16:55:13.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.050+0000 7f9d71ffb700 1 --2- 172.21.15.26:0/4259536285 >> [v2:172.21.15.26:6826/818617424,v1:172.21.15.26:6827/818617424] conn(0x7f9d68063da0 0x7f9d68066260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:55:13.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.050+0000 7f9d71ffb700 1 -- 172.21.15.26:0/4259536285 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5945+0+0 (secure 0 0 0) 0x7f9d6c07fec0 con 0x7f9d7c0f6860 2021-11-03T16:55:13.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.050+0000 7f9d815a9700 1 --2- 172.21.15.26:0/4259536285 >> [v2:172.21.15.26:6826/818617424,v1:172.21.15.26:6827/818617424] conn(0x7f9d68063da0 0x7f9d68066260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:55:13.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.051+0000 7f9d815a9700 1 --2- 172.21.15.26:0/4259536285 >> [v2:172.21.15.26:6826/818617424,v1:172.21.15.26:6827/818617424] conn(0x7f9d68063da0 0x7f9d68066260 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f9d78000c00 tx=0x7f9d78016040).ready entity=mgr.14594 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:55:13.053 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.054+0000 7f9d71ffb700 1 -- 172.21.15.26:0/4259536285 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156383 (secure 0 0 0) 0x7f9d6c04eaa0 con 0x7f9d7c0f6860 2021-11-03T16:55:13.053 INFO:tasks.workunit.client.0.smithi026.stdout:0/65: creat da/f15 x:0 0 0 2021-11-03T16:55:13.056 INFO:tasks.workunit.client.0.smithi026.stdout:5/66: rename d3/da/db/l15 to d3/de/l17 0 2021-11-03T16:55:13.058 INFO:tasks.workunit.client.0.smithi026.stdout:6/83: creat d5/d9/f1f x:0 0 0 2021-11-03T16:55:13.060 INFO:tasks.workunit.client.0.smithi026.stdout:1/154: dread - dc/df/d11/f27 zero size 2021-11-03T16:55:13.066 INFO:tasks.workunit.client.0.smithi026.stdout:0/66: creat da/de/f16 x:0 0 0 2021-11-03T16:55:13.076 INFO:tasks.workunit.client.0.smithi026.stdout:0/67: chown l2 79 1 2021-11-03T16:55:13.099 INFO:tasks.workunit.client.1.smithi194.stdout:3/376: dread - d2/d20/d36/d4e/f74 zero size 2021-11-03T16:55:13.100 INFO:tasks.workunit.client.1.smithi194.stdout:8/325: dread d8/d33/d51/f77 [0,4194304] 0 2021-11-03T16:55:13.119 INFO:tasks.workunit.client.0.smithi026.stdout:5/67: unlink d3/f6 0 2021-11-03T16:55:13.122 INFO:tasks.workunit.client.0.smithi026.stdout:1/155: write dc/f2f [736670,19806] 0 2021-11-03T16:55:13.126 INFO:tasks.workunit.client.0.smithi026.stdout:0/68: write da/fc [123442,20786] 0 2021-11-03T16:55:13.126 INFO:tasks.workunit.client.0.smithi026.stdout:0/69: write da/f15 [277487,115988] 0 2021-11-03T16:55:13.126 INFO:tasks.workunit.client.0.smithi026.stdout:0/70: fsync da/de/f16 0 2021-11-03T16:55:13.127 INFO:tasks.workunit.client.0.smithi026.stdout:5/68: rename d3/de to d3/da/db/d18 0 2021-11-03T16:55:13.132 INFO:tasks.workunit.client.0.smithi026.stdout:0/71: creat da/f17 x:0 0 0 2021-11-03T16:55:13.134 INFO:tasks.workunit.client.0.smithi026.stdout:5/69: fsync d3/da/fc 0 2021-11-03T16:55:13.134 INFO:tasks.workunit.client.0.smithi026.stdout:5/70: fsync d3/da/fc 0 2021-11-03T16:55:13.139 INFO:tasks.workunit.client.0.smithi026.stdout:0/72: unlink da/de/l11 0 2021-11-03T16:55:13.145 INFO:tasks.workunit.client.0.smithi026.stdout:0/73: link l3 da/l18 0 2021-11-03T16:55:13.155 INFO:tasks.workunit.client.0.smithi026.stdout:6/84: mkdir d5/dd/d20 0 2021-11-03T16:55:13.162 INFO:tasks.workunit.client.0.smithi026.stdout:6/85: mkdir d5/d9/d21 0 2021-11-03T16:55:13.162 INFO:tasks.workunit.client.0.smithi026.stdout:6/86: fsync d5/d9/f1f 0 2021-11-03T16:55:13.163 INFO:tasks.workunit.client.0.smithi026.stdout:6/87: symlink d5/d9/d21/l22 0 2021-11-03T16:55:13.166 INFO:tasks.workunit.client.0.smithi026.stdout:6/88: chown d5/d9/f11 9361 1 2021-11-03T16:55:13.167 INFO:tasks.workunit.client.1.smithi194.stdout:3/377: write d2/d20/d36/d60/f72 [163106,94464] 0 2021-11-03T16:55:13.168 INFO:tasks.workunit.client.0.smithi026.stdout:6/89: dread - d5/d9/f13 zero size 2021-11-03T16:55:13.175 INFO:tasks.workunit.client.1.smithi194.stdout:8/326: rename d8/d33/d51/l67 to d8/d33/l79 0 2021-11-03T16:55:13.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.181+0000 7f9d71ffb700 1 -- 172.21.15.26:0/4259536285 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mgrmap(e 28) v1 ==== 81891+0+0 (secure 0 0 0) 0x7f9d6c009440 con 0x7f9d7c0f6860 2021-11-03T16:55:13.179 INFO:tasks.workunit.client.0.smithi026.stdout:6/90: creat d5/f23 x:0 0 0 2021-11-03T16:55:13.184 INFO:tasks.workunit.client.0.smithi026.stdout:6/91: readlink d5/dd/l10 0 2021-11-03T16:55:13.185 INFO:tasks.workunit.client.0.smithi026.stdout:6/92: dread - d5/d9/f1f zero size 2021-11-03T16:55:13.186 INFO:tasks.workunit.client.1.smithi194.stdout:8/327: chown d8/d33/f71 0 1 2021-11-03T16:55:13.188 INFO:tasks.workunit.client.0.smithi026.stdout:6/93: creat d5/d9/f24 x:0 0 0 2021-11-03T16:55:13.198 INFO:tasks.workunit.client.0.smithi026.stdout:5/71: dwrite d3/da/ff [0,4194304] 0 2021-11-03T16:55:13.199 INFO:tasks.workunit.client.0.smithi026.stdout:6/94: rmdir d5/dd 39 2021-11-03T16:55:13.204 INFO:tasks.workunit.client.1.smithi194.stdout:8/328: chown d8/d33/d3e/f40 20181 1 2021-11-03T16:55:13.208 INFO:tasks.workunit.client.0.smithi026.stdout:0/74: dwrite da/fd [0,4194304] 0 2021-11-03T16:55:13.208 INFO:tasks.workunit.client.0.smithi026.stdout:0/75: readlink l3 0 2021-11-03T16:55:13.210 INFO:tasks.workunit.client.0.smithi026.stdout:5/72: getdents d3 0 2021-11-03T16:55:13.210 INFO:tasks.workunit.client.0.smithi026.stdout:5/73: dread - d3/f10 zero size 2021-11-03T16:55:13.210 INFO:tasks.workunit.client.0.smithi026.stdout:5/74: chown d3/da/db/d18 11502356 1 2021-11-03T16:55:13.211 INFO:tasks.workunit.client.0.smithi026.stdout:5/75: fsync d3/da/fc 0 2021-11-03T16:55:13.211 INFO:tasks.workunit.client.0.smithi026.stdout:5/76: chown d3/da/db/d18 694378618 1 2021-11-03T16:55:13.212 INFO:tasks.workunit.client.0.smithi026.stdout:6/95: dread - d5/d9/f1b zero size 2021-11-03T16:55:13.232 INFO:tasks.workunit.client.0.smithi026.stdout:5/77: dwrite d3/da/ff [0,4194304] 0 2021-11-03T16:55:13.232 INFO:tasks.workunit.client.0.smithi026.stdout:5/78: getdents d3/da/db/d18 0 2021-11-03T16:55:13.234 INFO:tasks.workunit.client.0.smithi026.stdout:5/79: write d3/da/fc [1445678,21099] 0 2021-11-03T16:55:13.235 INFO:tasks.workunit.client.0.smithi026.stdout:5/80: creat d3/da/db/d18/f19 x:0 0 0 2021-11-03T16:55:13.236 INFO:tasks.workunit.client.0.smithi026.stdout:5/81: creat d3/f1a x:0 0 0 2021-11-03T16:55:13.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.367+0000 7f9d8380d700 1 -- 172.21.15.26:0/4259536285 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9d7c045ad0 con 0x7f9d7c0f6860 2021-11-03T16:55:13.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.368+0000 7f9d71ffb700 1 -- 172.21.15.26:0/4259536285 <== mon.0 v2:172.21.15.26:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1624 (secure 0 0 0) 0x7f9d6c04d250 con 0x7f9d7c0f6860 2021-11-03T16:55:13.366 INFO:teuthology.orchestra.run.smithi026.stdout:e15 2021-11-03T16:55:13.366 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T16:55:13.367 INFO:teuthology.orchestra.run.smithi026.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T16:55:13.367 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T16:55:13.367 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:55:13.367 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T16:55:13.368 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T16:55:13.368 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 15 2021-11-03T16:55:13.368 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 2021-11-03T16:55:13.368 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T16:55:13.369 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:12.172724+0000 2021-11-03T16:55:13.369 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T16:55:13.369 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T16:55:13.369 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T16:55:13.369 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T16:55:13.370 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T16:55:13.370 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T16:55:13.370 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T16:55:13.370 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 47 2021-11-03T16:55:13.371 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T16:55:13.371 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T16:55:13.371 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T16:55:13.371 INFO:teuthology.orchestra.run.smithi026.stdout:up {0=14436} 2021-11-03T16:55:13.371 INFO:teuthology.orchestra.run.smithi026.stdout:failed 2021-11-03T16:55:13.372 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T16:55:13.372 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T16:55:13.372 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T16:55:13.372 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T16:55:13.373 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T16:55:13.373 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T16:55:13.373 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T16:55:13.373 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{0:14436} state up:active seq 44 join_fscid=1 addr [v2:172.21.15.26:6828/3059137105,v1:172.21.15.26:6829/3059137105]] 2021-11-03T16:55:13.374 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:55:13.374 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:55:13.374 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T16:55:13.374 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:55:13.375 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:14590} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6800/1006134959,v1:172.21.15.26:6801/1006134959]] 2021-11-03T16:55:13.375 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921]] 2021-11-03T16:55:13.375 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844]] 2021-11-03T16:55:13.376 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.370+0000 7f9d8380d700 1 -- 172.21.15.26:0/4259536285 >> [v2:172.21.15.26:6826/818617424,v1:172.21.15.26:6827/818617424] conn(0x7f9d68063da0 msgr2=0x7f9d68066260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:55:13.377 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.370+0000 7f9d8380d700 1 --2- 172.21.15.26:0/4259536285 >> [v2:172.21.15.26:6826/818617424,v1:172.21.15.26:6827/818617424] conn(0x7f9d68063da0 0x7f9d68066260 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f9d78000c00 tx=0x7f9d78016040).stop 2021-11-03T16:55:13.377 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.370+0000 7f9d8380d700 1 -- 172.21.15.26:0/4259536285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d7c0f6860 msgr2=0x7f9d7c10c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:55:13.377 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.370+0000 7f9d8380d700 1 --2- 172.21.15.26:0/4259536285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d7c0f6860 0x7f9d7c10c0a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f9d6c00e7f0 tx=0x7f9d6c00b040).stop 2021-11-03T16:55:13.377 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.370+0000 7f9d8380d700 1 -- 172.21.15.26:0/4259536285 shutdown_connections 2021-11-03T16:55:13.378 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.370+0000 7f9d8380d700 1 --2- 172.21.15.26:0/4259536285 >> [v2:172.21.15.26:6826/818617424,v1:172.21.15.26:6827/818617424] conn(0x7f9d68063da0 0x7f9d68066260 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:13.378 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.370+0000 7f9d8380d700 1 --2- 172.21.15.26:0/4259536285 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d7c0f55c0 0x7f9d7c109ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:13.378 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.370+0000 7f9d8380d700 1 --2- 172.21.15.26:0/4259536285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d7c0f6860 0x7f9d7c10c0a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:13.378 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.370+0000 7f9d8380d700 1 -- 172.21.15.26:0/4259536285 >> 172.21.15.26:0/4259536285 conn(0x7f9d7c0f0d40 msgr2=0x7f9d7c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:55:13.379 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.370+0000 7f9d8380d700 1 -- 172.21.15.26:0/4259536285 shutdown_connections 2021-11-03T16:55:13.379 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:13.370+0000 7f9d8380d700 1 -- 172.21.15.26:0/4259536285 wait complete. 2021-11-03T16:55:13.379 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 15 2021-11-03T16:55:13.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:13 smithi026 conmon[32119]: audit 2021-11-03T16:55:12.102708+0000 mgr.smithi026.cnrxli (mgr.14594) 2 : audit [DBG] from='client.14602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:55:13.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:13 smithi026 conmon[32119]: cluster 2021-11-03T16:55:12.102957+0000 mon.smithi026 (mon.0) 669 : cluster [DBG] mgrmap e27: smithi026.cnrxli(active, since 1.63221s), standbys: smithi194.wnexas 2021-11-03T16:55:13.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:13 smithi026 conmon[32119]: cluster 2021-11-03T16:55:12.111251+0000 mgr.smithi026.cnrxli (mgr.14594) 3 : cluster [DBG] pgmap v3: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:55:13.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:13 smithi026 conmon[32119]: cluster 2021-11-03T16:55:12.172779+0000 mon.smithi026 (mon.0) 670 : cluster [INF] Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2021-11-03T16:55:13.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:13 smithi026 conmon[32119]: cluster 2021-11-03T16:55:12.172808+0000 mon.smithi026 (mon.0) 671 : cluster [INF] Cluster is now healthy 2021-11-03T16:55:13.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:13 smithi026 conmon[32119]: cluster 2021-11-03T16:55:12.177281+0000 mon.smithi026 (mon.0) 672 : cluster [DBG] mds.? [v2:172.21.15.26:6828/3059137105,v1:172.21.15.26:6829/3059137105] up:active 2021-11-03T16:55:13.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:13 smithi026 conmon[32119]: cluster 2021-11-03T16:55:12.177359+0000 mon.smithi026 (mon.0) 673 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi026.yfxlxl=up:active} 3 up:standby 2021-11-03T16:55:13.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:13 smithi026 conmon[32119]: cephadm 2021-11-03T16:55:12.194847+0000 mgr.smithi026.cnrxli (mgr.14594) 4 : cephadm [INF] Starting cherrypy engine... 2021-11-03T16:55:13.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:13 smithi026 conmon[32119]: cephadm 2021-11-03T16:55:12.195241+0000 mgr.smithi026.cnrxli (mgr.14594) 5 : cephadm [INF] [03/Nov/2021:16:55:12] ENGINE Bus STARTING 2021-11-03T16:55:13.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:13 smithi026 conmon[32119]: cephadm 2021-11-03T16:55:12.317912+0000 mgr.smithi026.cnrxli (mgr.14594) 6 : cephadm [INF] [03/Nov/2021:16:55:12] ENGINE Serving on https://172.21.15.26:8499 2021-11-03T16:55:13.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:13 smithi026 conmon[32119]: cephadm 2021-11-03T16:55:12.318153+0000 mgr.smithi026.cnrxli (mgr.14594) 7 : cephadm [INF] [03/Nov/2021:16:55:12] ENGINE Bus STARTED 2021-11-03T16:55:13.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:13 smithi026 conmon[32119]: cephadm 2021-11-03T16:55:12.318257+0000 mgr.smithi026.cnrxli (mgr.14594) 8 : cephadm [INF] Cherrypy engine started. 2021-11-03T16:55:13.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:13 smithi026 conmon[32119]: audit 2021-11-03T16:55:12.892267+0000 mon.smithi026 (mon.0) 674 : audit [DBG] from='client.? 172.21.15.26:0/177930756' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:55:13.475 INFO:tasks.workunit.client.1.smithi194.stdout:0/167: sync 2021-11-03T16:55:13.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:13 smithi194 conmon[35111]: audit 2021-11-03T16:55:12.102708+0000 mgr.smithi026.cnrxli (mgr.14594) 2021-11-03T16:55:13.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:13 smithi194 conmon[35111]: 2 : audit [DBG] from='client.14602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:55:13.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:13 smithi194 conmon[35111]: cluster 2021-11-03T16:55:12.102957+0000 mon.smithi026 (mon.0) 669 : cluster [DBG] mgrmap e27: smithi026.cnrxli(active, since 1.63221s), standbys: smithi194.wnexas 2021-11-03T16:55:13.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:13 smithi194 conmon[35111]: cluster 2021-11-03T16:55:12.111251+0000 mgr.smithi026.cnrxli (mgr.14594) 3 : cluster [DBG] pgmap v3: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:55:13.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:13 smithi194 conmon[35111]: cluster 2021-11-03T16:55:12.172779+0000 mon.smithi026 (mon.0) 670 : cluster [INF] Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2021-11-03T16:55:13.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:13 smithi194 conmon[35111]: cluster 2021-11-03T16:55:12.172808+0000 mon.smithi026 (mon.0) 671 : cluster [INF] Cluster is now healthy 2021-11-03T16:55:13.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:13 smithi194 conmon[35111]: cluster 2021-11-03T16:55:12.177281+0000 mon.smithi026 (mon.0) 672 : cluster 2021-11-03T16:55:13.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:13 smithi194 conmon[35111]: [DBG] mds.? [v2:172.21.15.26:6828/3059137105,v1:172.21.15.26:6829/3059137105] up:active 2021-11-03T16:55:13.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:13 smithi194 conmon[35111]: cluster 2021-11-03T16:55:13.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:13 smithi194 conmon[35111]: 2021-11 2021-11-03T16:55:13.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:13 smithi194 conmon[35111]: -03T16:55:12.177359 2021-11-03T16:55:13.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:13 smithi194 conmon[35111]: +0000 mon.smithi026 (mon.0) 673 : 2021-11-03T16:55:13.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:13 smithi194 conmon[35111]: cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi026.yfxlxl=up:active} 3 up:standby 2021-11-03T16:55:13.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:13 smithi194 conmon[35111]: cephadm 2021-11-03T16:55:13.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:13 smithi194 conmon[35111]: 2021-11-03T16 2021-11-03T16:55:13.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:13 smithi194 conmon[35111]: :55:12.194847+0000 mgr.smithi026.cnrxli 2021-11-03T16:55:13.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:13 smithi194 conmon[35111]: (mgr.14594) 4 : cephadm [INF] 2021-11-03T16:55:13.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:13 smithi194 conmon[35111]: Starting cherrypy engine... 2021-11-03T16:55:13.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:13 smithi194 conmon[35111]: cephadm 2021-11-03T16:55:13.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:13 smithi194 conmon[35111]: 2021-11-03T16: 2021-11-03T16:55:13.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:13 smithi194 conmon[35111]: 55:12.195241+0000 mgr.smithi026.cnrxli 2021-11-03T16:55:13.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:13 smithi194 conmon[35111]: (mgr.14594) 5 : cephadm 2021-11-03T16:55:13.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:13 smithi194 conmon[35111]: [INF] [03/Nov/2021:16:55:12] ENGINE Bus STARTING 2021-11-03T16:55:13.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:13 smithi194 conmon[35111]: cephadm 2021-11-03T16:55:13.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:13 smithi194 conmon[35111]: 2021-11-03T16:55 2021-11-03T16:55:13.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:13 smithi194 conmon[35111]: :12.317912+0000 mgr.smithi026.cnrxli ( 2021-11-03T16:55:13.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:13 smithi194 conmon[35111]: mgr.14594) 6 : cephadm [INF] 2021-11-03T16:55:13.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:13 smithi194 conmon[35111]: [03/Nov/2021:16:55:12] ENGINE Serving on https://172.21.15.26:8499 2021-11-03T16:55:13.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:13 smithi194 conmon[35111]: cephadm 2021-11-03T16:55:13.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:13 smithi194 conmon[35111]: 2021-11-03T 2021-11-03T16:55:13.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:13 smithi194 conmon[35111]: 16:55:12.318153+0000 mgr.smithi026.cnrxli 2021-11-03T16:55:13.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:13 smithi194 conmon[35111]: (mgr.14594) 7 : cephadm [INF] 2021-11-03T16:55:13.505 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:13 smithi194 conmon[35111]: [03/Nov/2021:16:55:12] ENGINE Bus STARTED 2021-11-03T16:55:13.505 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:13 smithi194 conmon[35111]: cephadm 2021-11-03T16: 2021-11-03T16:55:13.505 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:13 smithi194 conmon[35111]: 55:12.318257+0000 mgr.smithi026.cnrxli (mgr.14594) 8 : cephadm 2021-11-03T16:55:13.505 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:13 smithi194 conmon[35111]: [INF] Cherrypy engine started. 2021-11-03T16:55:13.506 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:13 smithi194 conmon[35111]: audit 2021 2021-11-03T16:55:13.506 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:13 smithi194 conmon[35111]: -11-03T16:55:12 2021-11-03T16:55:13.506 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:13 smithi194 conmon[35111]: .892267+0000 mon.smithi026 (mon.0 2021-11-03T16:55:13.506 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:13 smithi194 conmon[35111]: ) 674 : audit [DBG] from='client.? 172.21.15.26:0/177930756' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:55:13.511 INFO:tasks.workunit.client.1.smithi194.stdout:5/390: sync 2021-11-03T16:55:13.512 INFO:tasks.workunit.client.1.smithi194.stdout:9/425: sync 2021-11-03T16:55:13.512 INFO:tasks.workunit.client.1.smithi194.stdout:4/316: sync 2021-11-03T16:55:13.512 INFO:tasks.workunit.client.1.smithi194.stdout:2/436: sync 2021-11-03T16:55:13.512 INFO:tasks.workunit.client.1.smithi194.stdout:7/468: sync 2021-11-03T16:55:13.512 INFO:tasks.workunit.client.1.smithi194.stdout:6/418: sync 2021-11-03T16:55:13.513 INFO:tasks.workunit.client.1.smithi194.stdout:1/283: sync 2021-11-03T16:55:14.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:14 smithi026 conmon[32119]: audit 2021-11-03T16:55:12.499694+0000 mgr.smithi026.cnrxli (mgr.14594) 9 : audit 2021-11-03T16:55:14.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:14 smithi026 conmon[32119]: [DBG] from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:55:14.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:14 smithi026 conmon[32119]: cluster 2021-11-03T16:55:13.103866+0000 mgr.smithi026.cnrxli (mgr.14594) 10 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:55:14.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:14 smithi026 conmon[32119]: cluster 2021-11-03T16:55:13.182414+0000 mon.smithi026 (mon.0) 675 : cluster [DBG] mgrmap e28: smithi026.cnrxli(active, since 2s), standbys: smithi194.wnexas 2021-11-03T16:55:14.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:14 smithi026 conmon[32119]: audit 2021-11-03T16:55:13.369880+0000 mon.smithi026 (mon.0) 676 : audit [DBG] from='client.? 172.21.15.26:0/4259536285' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T16:55:14.436 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:14 smithi194 conmon[35111]: audit 2021-11-03T16:55:12.499694+0000 mgr.smithi026.cnrxli (mgr.14594) 9 : audit [DBG] 2021-11-03T16:55:14.436 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:14 smithi194 conmon[35111]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:55:14.436 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:14 smithi194 conmon[35111]: cluster 2021-11-03T16:55:13.103866+0000 mgr.smithi026.cnrxli (mgr.14594) 10 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:55:14.436 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:14 smithi194 conmon[35111]: cluster 2021-11-03T16:55:13.182414+0000 mon.smithi026 (mon.0) 675 : cluster [DBG] mgrmap e28: smithi026.cnrxli(active, since 2s), standbys: smithi194.wnexas 2021-11-03T16:55:14.437 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:14 smithi194 conmon[35111]: audit 2021-11-03T16:55:13.369880+0000 mon.smithi026 (mon.0) 676 : audit [DBG] from='client.? 172.21.15.26:0/4259536285' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T16:55:16.335 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:16 smithi194 conmon[35111]: cluster 2021-11-03T16:55:15.104393+0000 mgr.smithi026.cnrxli (mgr.14594) 11 : cluster [DBG] pgmap v5: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:55:16.336 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:16 smithi194 conmon[35111]: cluster 2021-11-03T16:55:15.189608+0000 mon.smithi026 (mon.0) 677 : cluster [DBG] mgrmap e29: smithi026.cnrxli(active, since 4s), standbys: smithi194.wnexas 2021-11-03T16:55:16.336 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:16 smithi194 conmon[35111]: audit 2021-11-03T16:55:15.701929+0000 mon.smithi026 (mon.0) 678 : audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' 2021-11-03T16:55:16.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:16 smithi026 conmon[32119]: cluster 2021-11-03T16:55:15.104393+0000 mgr.smithi026.cnrxli (mgr.14594) 11 : cluster [DBG] pgmap v5: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:55:16.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:16 smithi026 conmon[32119]: cluster 2021-11-03T16:55:15.189608+0000 mon.smithi026 (mon.0) 677 : cluster [DBG] mgrmap e29: smithi026.cnrxli(active, since 4s), standbys: smithi194.wnexas 2021-11-03T16:55:16.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:16 smithi026 conmon[32119]: audit 2021-11-03T16:55:15.701929+0000 mon.smithi026 (mon.0) 678 : audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' 2021-11-03T16:55:17.132 INFO:tasks.workunit.client.0.smithi026.stdout:8/148: sync 2021-11-03T16:55:17.132 INFO:tasks.workunit.client.0.smithi026.stdout:2/79: sync 2021-11-03T16:55:17.133 INFO:tasks.workunit.client.0.smithi026.stdout:7/210: sync 2021-11-03T16:55:17.133 INFO:tasks.workunit.client.0.smithi026.stdout:3/178: sync 2021-11-03T16:55:17.133 INFO:tasks.workunit.client.0.smithi026.stdout:9/186: sync 2021-11-03T16:55:17.133 INFO:tasks.workunit.client.0.smithi026.stdout:4/104: sync 2021-11-03T16:55:17.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:17 smithi194 conmon[35111]: cephadm 2021-11-03T16:55:15.671437+0000 mgr.smithi026.cnrxli (mgr. 2021-11-03T16:55:17.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:17 smithi194 conmon[35111]: 14594) 12 : cephadm [INF] poll took 3989.073 ms: 1 events 2021-11-03T16:55:17.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:17 smithi194 conmon[35111]: cluster 2021-11-03T16:55:16.297372+0000 mon.smithi026 (mon.0) 679 : 2021-11-03T16:55:17.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:17 smithi194 conmon[35111]: cluster [DBG] Standby manager daemon smithi194.wnexas restarted 2021-11-03T16:55:17.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:17 smithi194 conmon[35111]: cluster 2021- 2021-11-03T16:55:17.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:17 smithi194 conmon[35111]: 11-03T16:55:16 2021-11-03T16:55:17.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:17 smithi194 conmon[35111]: .297518+0000 mon.smithi026 (mon.0 2021-11-03T16:55:17.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:17 smithi194 conmon[35111]: ) 680 : cluster [DBG] Standby manager daemon smithi194.wnexas started 2021-11-03T16:55:17.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:17 smithi194 conmon[35111]: audit 2021- 2021-11-03T16:55:17.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:17 smithi194 conmon[35111]: 11-03T16:55:16.298100 2021-11-03T16:55:17.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:17 smithi194 conmon[35111]: +0000 mon.smithi194 (mon.1) 58 2021-11-03T16:55:17.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:17 smithi194 conmon[35111]: : audit [DBG] from='mgr.? 172.21.15.194:0/1454265542' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.wnexas/crt"}]: dispatch 2021-11-03T16:55:17.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:17 smithi194 conmon[35111]: audit 2021 2021-11-03T16:55:17.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:17 smithi194 conmon[35111]: -11-03T16:55:16.300926+0000 mon.smithi194 ( 2021-11-03T16:55:17.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:17 smithi194 conmon[35111]: mon.1) 59 : audit [DBG] 2021-11-03T16:55:17.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:17 smithi194 conmon[35111]: from='mgr.? 172.21.15.194:0/1454265542' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-11-03T16:55:17.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:17 smithi194 conmon[35111]: audit 2021-11 2021-11-03T16:55:17.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:17 smithi194 conmon[35111]: -03T16:55:16.303146 2021-11-03T16:55:17.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:17 smithi194 conmon[35111]: +0000 mon.smithi194 (mon.1) 60 : 2021-11-03T16:55:17.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:17 smithi194 conmon[35111]: audit [DBG] from='mgr.? 172.21.15.194:0/1454265542' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.wnexas/key"}]: dispatch 2021-11-03T16:55:17.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:17 smithi194 conmon[35111]: audit 2021- 2021-11-03T16:55:17.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:17 smithi194 conmon[35111]: 11-03T16:55:16.303638 2021-11-03T16:55:17.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:17 smithi194 conmon[35111]: +0000 mon.smithi194 (mon.1) 61 2021-11-03T16:55:17.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:17 smithi194 conmon[35111]: : audit [DBG] from='mgr.? 172.21.15.194:0/1454265542' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-11-03T16:55:17.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:17 smithi194 conmon[35111]: audit 2021- 2021-11-03T16:55:17.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:17 smithi194 conmon[35111]: 11-03T16:55:16.350364 2021-11-03T16:55:17.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:17 smithi194 conmon[35111]: +0000 mon.smithi026 (mon.0) 681 2021-11-03T16:55:17.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:17 smithi194 conmon[35111]: : audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' 2021-11-03T16:55:17.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:17 smithi194 conmon[35111]: audit 2021- 2021-11-03T16:55:17.505 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:17 smithi194 conmon[35111]: 11-03T16:55:16. 2021-11-03T16:55:17.505 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:17 smithi194 conmon[35111]: 351790+0000 mon.smithi026 (mon.0) 682 2021-11-03T16:55:17.505 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:17 smithi194 conmon[35111]: : audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2021-11-03T16:55:17.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:17 smithi026 conmon[32119]: cephadm 2021-11-03T16:55:15.671437+0000 mgr.smithi026.cnrxli (mgr.14594) 12 : cephadm [INF] poll took 3989.073 ms: 1 events 2021-11-03T16:55:17.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:17 smithi026 conmon[32119]: cluster 2021-11-03T16:55:16.297372+0000 mon.smithi026 (mon.0) 679 : cluster [DBG] Standby manager daemon smithi194.wnexas restarted 2021-11-03T16:55:17.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:17 smithi026 conmon[32119]: cluster 2021-11-03T16:55:16.297518+0000 mon.smithi026 (mon.0) 680 : cluster [DBG] Standby manager daemon smithi194.wnexas started 2021-11-03T16:55:17.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:17 smithi026 conmon[32119]: audit 2021-11-03T16:55:16.298100+0000 mon.smithi194 (mon.1) 58 : audit [DBG] from='mgr.? 172.21.15.194:0/1454265542' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.wnexas/crt"}]: dispatch 2021-11-03T16:55:17.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:17 smithi026 conmon[32119]: audit 2021-11-03T16:55:16.300926+0000 mon.smithi194 (mon.1) 59 : audit [DBG] from='mgr.? 172.21.15.194:0/1454265542' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-11-03T16:55:17.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:17 smithi026 conmon[32119]: audit 2021-11-03T16:55:16.303146+0000 mon.smithi194 (mon.1) 60 : audit [DBG] from='mgr.? 172.21.15.194:0/1454265542' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.wnexas/key"}]: dispatch 2021-11-03T16:55:17.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:17 smithi026 conmon[32119]: audit 2021-11-03T16:55:16.303638+0000 mon.smithi194 (mon.1) 61 : audit [DBG] from='mgr.? 172.21.15.194:0/1454265542' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-11-03T16:55:17.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:17 smithi026 conmon[32119]: audit 2021-11-03T16:55:16.350364+0000 mon.smithi026 (mon.0) 681 : audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' 2021-11-03T16:55:17.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:17 smithi026 conmon[32119]: audit 2021-11-03T16:55:16.351790+0000 mon.smithi026 (mon.0) 682 : audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2021-11-03T16:55:18.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:18 smithi194 conmon[35111]: cluster 2021-11-03T16:55:17.105048+0000 mgr.smithi026.cnrxli (mgr.14594) 13 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 4.0 KiB/s rd, 126 KiB/s wr, 18 op/s 2021-11-03T16:55:18.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:18 smithi194 conmon[35111]: cluster 2021-11-03T16:55:17.200836+0000 mon.smithi026 (mon.0) 683 : cluster [DBG] mgrmap e30: smithi026.cnrxli(active, since 6s), standbys: smithi194.wnexas 2021-11-03T16:55:18.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:18 smithi026 conmon[32119]: cluster 2021-11-03T16:55:17.105048+0000 mgr.smithi026.cnrxli (mgr.14594) 13 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 4.0 KiB/s rd, 126 KiB/s wr, 18 op/s 2021-11-03T16:55:18.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:18 smithi026 conmon[32119]: cluster 2021-11-03T16:55:17.200836+0000 mon.smithi026 (mon.0) 683 : cluster [DBG] mgrmap e30: smithi026.cnrxli(active, since 6s), standbys: smithi194.wnexas 2021-11-03T16:55:20.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:20 smithi194 conmon[35111]: cluster 2021-11-03T16:55:19.105528+0000 mgr.smithi026.cnrxli (mgr.14594) 14 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 8.4 KiB/s rd, 1.8 MiB/s wr, 32 op/s 2021-11-03T16:55:20.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:20 smithi026 conmon[32119]: cluster 2021-11-03T16:55:19.105528+0000 2021-11-03T16:55:20.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:20 smithi026 conmon[32119]: mgr.smithi026.cnrxli (mgr.14594) 14 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 8.4 KiB/s rd, 1.8 MiB/s wr, 32 op/s 2021-11-03T16:55:22.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:22 smithi026 conmon[32119]: cluster 2021-11-03T16:55:21.105861+0000 mgr.smithi026.cnrxli (mgr.14594) 15 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 6.6 KiB/s rd, 1.4 MiB/s wr, 25 op/s 2021-11-03T16:55:22.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:22 smithi026 conmon[32119]: audit 2021-11-03T16:55:21.516513+0000 mon.smithi026 (mon.0) 684 : audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' 2021-11-03T16:55:22.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:22 smithi026 conmon[32119]: audit 2021-11-03T16:55:22.155575+0000 mon.smithi026 (mon.0) 685 : audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' 2021-11-03T16:55:22.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:22 smithi026 conmon[32119]: audit 2021-11-03T16:55:22.156743+0000 mon.smithi026 (mon.0) 686 : audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi026", "name": "osd_memory_target"}]: dispatch 2021-11-03T16:55:22.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:22 smithi026 conmon[32119]: audit 2021-11-03T16:55:22.160509+0000 mon.smithi026 (mon.0) 2021-11-03T16:55:22.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:22 smithi026 conmon[32119]: 687 : audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' 2021-11-03T16:55:22.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:22 smithi026 conmon[32119]: audit 2021-11-03 2021-11-03T16:55:22.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:22 smithi026 conmon[32119]: T16:55:22.166052+0000 mon.smithi026 ( 2021-11-03T16:55:22.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:22 smithi026 conmon[32119]: mon.0) 688 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:55:22.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:22 smithi194 conmon[35111]: cluster 2021-11-03T16:55:21.105861+0000 mgr.smithi026.cnrxli (mgr.14594) 15 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 6.6 KiB/s rd, 1.4 MiB/s wr, 25 op/s 2021-11-03T16:55:22.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:22 smithi194 conmon[35111]: audit 2021-11-03T16:55:21.516513+0000 mon.smithi026 (mon.0) 684 : audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' 2021-11-03T16:55:22.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:22 smithi194 conmon[35111]: audit 2021-11-03T16:55:22.155575+0000 mon.smithi026 (mon.0) 685 : audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' 2021-11-03T16:55:22.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:22 smithi194 conmon[35111]: audit 2021-11-03T16:55:22.156743+0000 2021-11-03T16:55:22.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:22 smithi194 conmon[35111]: mon.smithi026 (mon.0) 686 : audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi026", "name": "osd_memory_target"}]: dispatch 2021-11-03T16:55:22.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:22 smithi194 conmon[35111]: audit 2021 2021-11-03T16:55:22.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:22 smithi194 conmon[35111]: -11-03T16:55:22 2021-11-03T16:55:22.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:22 smithi194 conmon[35111]: .160509+0000 mon.smithi026 (mon.0 2021-11-03T16:55:22.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:22 smithi194 conmon[35111]: ) 687 : audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' 2021-11-03T16:55:22.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:22 smithi194 conmon[35111]: audit 2021-11 2021-11-03T16:55:22.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:22 smithi194 conmon[35111]: -03T16:55:22.166052+0000 mon.smithi026 2021-11-03T16:55:22.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:22 smithi194 conmon[35111]: (mon.0) 688 : audit 2021-11-03T16:55:22.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:22 smithi194 conmon[35111]: [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:55:23.475 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:23 smithi194 conmon[35111]: cephadm 2021-11-03T16:55:21.488322+0000 mgr.smithi026.cnrxli (mgr. 2021-11-03T16:55:23.475 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:23 smithi194 conmon[35111]: 14594) 16 : cephadm [INF] poll took 5143.585 ms: 1 events 2021-11-03T16:55:23.476 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:23 smithi194 conmon[35111]: cluster 2021-11-03T16:55:22.157941+0000 mgr.smithi026.cnrxli (mgr.14594) 17 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 5.9 KiB/s rd, 1.3 MiB/s wr, 22 op/s 2021-11-03T16:55:23.476 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:23 smithi194 conmon[35111]: cluster 2021-11-03T16:55:23.153644+0000 mon.smithi026 (mon.0) 689 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2021-11-03T16:55:23.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:23 smithi026 conmon[32119]: cephadm 2021-11-03T16:55:21.488322+0000 mgr.smithi026.cnrxli (mgr.14594) 16 : cephadm [INF] 2021-11-03T16:55:23.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:23 smithi026 conmon[32119]: poll took 5143.585 ms: 1 events 2021-11-03T16:55:23.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:23 smithi026 conmon[32119]: cluster 2021-11-03T16:55:22.157941+0000 mgr.smithi026.cnrxli (mgr.14594) 17 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 5.9 KiB/s rd, 1.3 MiB/s wr, 22 op/s 2021-11-03T16:55:23.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:23 smithi026 conmon[32119]: cluster 2021-11-03T16:55:23.153644+0000 mon.smithi026 (mon.0) 689 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2021-11-03T16:55:24.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:24 smithi194 conmon[35111]: audit 2021-11-03T16:55:23.731839+0000 mon.smithi026 (mon. 2021-11-03T16:55:24.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:24 smithi194 conmon[35111]: 0) 690 : audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi194.wnexas", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-11-03T16:55:24.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:24 smithi194 conmon[35111]: audit 2021-11-03T16:55:23.732961+0000 mon.smithi026 (mon.0) 691 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mgr services"}]: dispatch 2021-11-03T16:55:24.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:24 smithi194 conmon[35111]: audit 2021-11-03T16:55:23.734043+0000 mon.smithi026 (mon.0) 692 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:55:24.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:24 smithi026 conmon[32119]: audit 2021-11-03T16:55:23.731839+0000 mon.smithi026 (mon.0) 690 2021-11-03T16:55:24.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:24 smithi026 conmon[32119]: : audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi194.wnexas", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-11-03T16:55:24.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:24 smithi026 conmon[32119]: audit 2021-11-03T16:55:23.732961+0000 mon.smithi026 (mon.0) 691 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mgr services"}]: dispatch 2021-11-03T16:55:24.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:24 smithi026 conmon[32119]: audit 2021-11- 2021-11-03T16:55:24.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:24 smithi026 conmon[32119]: 03T16:55:23.734043+0000 mon.smithi026 (mon.0) 692 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:55:25.408 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:25 smithi194 conmon[35111]: cephadm 2021-11-03T16:55:23.706865+0000 mgr.smithi026.cnrxli (mgr.14594) 18 : cephadm [INF] poll took 1498.813 ms: 1 events 2021-11-03T16:55:25.409 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:25 smithi194 conmon[35111]: cephadm 2021-11-03T16:55:23.731340+0000 mgr.smithi026.cnrxli (mgr.14594) 19 : cephadm [INF] Upgrade: Updating mgr.smithi194.wnexas 2021-11-03T16:55:25.409 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:25 smithi194 conmon[35111]: cephadm 2021-11-03T16:55:23.734914+0000 mgr.smithi026.cnrxli (mgr.14594) 20 : cephadm [INF] Deploying daemon mgr.smithi194.wnexas on smithi194 2021-11-03T16:55:25.409 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:25 smithi194 conmon[35111]: cluster 2021-11-03T16:55:24.158385+0000 mgr.smithi026.cnrxli (mgr.14594) 21 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 5.3 KiB/s rd, 1.1 MiB/s wr, 20 op/s 2021-11-03T16:55:25.574 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:25 smithi026 conmon[32119]: cephadm 2021-11-03T16:55:23.706865+0000 mgr.smithi026.cnrxli (mgr.14594) 18 : cephadm [INF] poll took 1498.813 ms: 1 events 2021-11-03T16:55:25.575 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:25 smithi026 conmon[32119]: cephadm 2021-11-03T16:55:23.731340+0000 mgr.smithi026.cnrxli (mgr.14594) 19 : cephadm [INF] Upgrade: Updating mgr.smithi194.wnexas 2021-11-03T16:55:25.575 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:25 smithi026 conmon[32119]: cephadm 2021-11- 2021-11-03T16:55:25.575 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:25 smithi026 conmon[32119]: 03T16:55:23.734914+0000 mgr.smithi026.cnrxli (mgr.14594) 20 : cephadm [INF] 2021-11-03T16:55:25.575 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:25 smithi026 conmon[32119]: Deploying daemon mgr.smithi194.wnexas on smithi194 2021-11-03T16:55:25.576 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:25 smithi026 conmon[32119]: cluster 2021-11-03T16:55: 2021-11-03T16:55:25.576 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:25 smithi026 conmon[32119]: 24.158385+0000 mgr.smithi026.cnrxli (mgr.14594) 21 2021-11-03T16:55:25.576 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:25 smithi026 conmon[32119]: : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 5.3 KiB/s rd, 1.1 MiB/s wr, 20 op/s 2021-11-03T16:55:27.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:27 smithi026 conmon[32119]: cluster 2021-11-03T16:55:26.158864+0000 mgr.smithi026.cnrxli (mgr.14594) 22 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 5.3 KiB/s rd, 1.1 MiB/s wr, 20 op/s 2021-11-03T16:55:27.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:27 smithi026 conmon[32119]: 2021-11-03T16:55:27.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:27 smithi026 conmon[32119]: audit 2021-11-03T16:55:26.175299+0000 mon.smithi026 (mon.0) 693 : audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' 2021-11-03T16:55:27.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:27 smithi026 conmon[32119]: audit 2021-11-03T16:55:26.782014+0000 mon.smithi026 (mon.0) 694 : 2021-11-03T16:55:27.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:27 smithi026 conmon[32119]: audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' 2021-11-03T16:55:27.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:27 smithi026 conmon[32119]: audit 2021-11-03T16:55:26.782946+0000 mon.smithi026 (mon. 2021-11-03T16:55:27.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:27 smithi026 conmon[32119]: 0) 695 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:55:27.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:27 smithi194 conmon[35111]: cluster 2021-11-03T16:55:26.158864+0000 mgr.smithi026.cnrxli (mgr.14594) 22 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 5.3 KiB/s rd, 1.1 MiB/s wr, 20 op/s 2021-11-03T16:55:27.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:27 smithi194 conmon[35111]: audit 2021-11-03T16:55:26.175299+0000 mon.smithi026 (mon.0) 693 : audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' 2021-11-03T16:55:27.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:27 smithi194 conmon[35111]: audit 2021-11-03T16:55:26.782014+0000 mon.smithi026 (mon.0) 694 : audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' 2021-11-03T16:55:27.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:27 smithi194 conmon[35111]: audit 2021-11-03T16:55:26.782946+0000 mon.smithi026 (mon.0) 695 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:55:28.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:28 smithi026 conmon[32119]: cephadm 2021-11-03T16:55:26.773027+0000 mgr.smithi026.cnrxli (mgr.14594) 23 : cephadm [INF] poll took 2781.697 ms: 1 events 2021-11-03T16:55:28.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:28 smithi026 conmon[32119]: cluster 2021-11-03T16:55:28.086902+0000 mon.smithi026 (mon.0) 696 : cluster [WRN] Replacing daemon mds.cephfs.smithi026.yfxlxl as rank 0 with standby daemon mds.cephfs.smithi026.ltacyh 2021-11-03T16:55:28.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:28 smithi026 conmon[32119]: cluster 2021-11-03T16:55:28.086963+0000 mon.smithi026 (mon.0) 697 : cluster [INF] MDS daemon mds.cephfs.smithi026.yfxlxl is removed because it is dead or otherwise unavailable. 2021-11-03T16:55:28.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:28 smithi026 conmon[32119]: cluster 2021-11-03T16:55:28.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:28 smithi026 conmon[32119]: 2021-11-03T16:55:28.087480+0000 mon.smithi026 (mon.0) 698 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2021-11-03T16:55:28.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:28 smithi026 conmon[32119]: cluster 2021-11-03T16:55:28.090722+0000 mon.smithi026 (mon.0) 699 : cluster [DBG] osdmap e50: 6 total, 6 up, 6 in 2021-11-03T16:55:28.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:28 smithi026 conmon[32119]: cluster 2021-11-03T16:55:28.096211+0000 mon.smithi026 (mon.0) 700 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi026.ltacyh=up:replay} 2 up:standby 2021-11-03T16:55:28.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:28 smithi194 conmon[35111]: cephadm 2021-11-03T16:55:26.773027+0000 mgr.smithi026.cnrxli (mgr.14594) 2021-11-03T16:55:28.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:28 smithi194 conmon[35111]: 23 : cephadm [INF] poll took 2781.697 ms: 1 events 2021-11-03T16:55:28.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:28 smithi194 conmon[35111]: cluster 2021-11-03T16:55:28.086902+0000 mon.smithi026 (mon.0) 696 : cluster [WRN] Replacing daemon mds.cephfs.smithi026.yfxlxl as rank 0 with standby daemon mds.cephfs.smithi026.ltacyh 2021-11-03T16:55:28.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:28 smithi194 conmon[35111]: cluster 2021-11-03T16:55:28.086963+0000 mon.smithi026 (mon.0) 697 : cluster [INF] MDS daemon mds.cephfs.smithi026.yfxlxl is removed because it is dead or otherwise unavailable. 2021-11-03T16:55:28.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:28 smithi194 conmon[35111]: cluster 2021-11-03T16:55:28.087480+0000 mon.smithi026 (mon.0) 698 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2021-11-03T16:55:28.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:28 smithi194 conmon[35111]: cluster 2021-11-03T16:55:28.090722+0000 mon.smithi026 (mon.0) 699 : cluster [DBG] osdmap e50: 6 total, 6 up, 6 in 2021-11-03T16:55:28.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:28 smithi194 conmon[35111]: cluster 2021-11-03T16:55:28.096211+0000 mon.smithi026 (mon 2021-11-03T16:55:28.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:28 smithi194 conmon[35111]: .0) 700 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi026.ltacyh=up:replay} 2 up:standby 2021-11-03T16:55:29.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:29 smithi194 conmon[35111]: cluster 2021-11-03T16:55:28.159288+0000 mgr.smithi026.cnrxli (mgr.14594) 24 : cluster [DBG] pgmap v13: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:55:29.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:29 smithi194 conmon[35111]: 2021-11-03T16:55:29.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:29 smithi194 conmon[35111]: cluster 2021-11-03T16:55:29.179122+0000 mon.smithi026 (mon.0) 701 : cluster [DBG] mds.? [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] up:boot 2021-11-03T16:55:29.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:29 smithi194 conmon[35111]: cluster 2021-11-03T16:55:29.179189+0000 mon.smithi026 (mon.0) 702 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi026.ltacyh=up:replay} 3 up:standby 2021-11-03T16:55:29.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:29 smithi194 conmon[35111]: audit 2021-11-03T16:55:29.179296+0000 mon.smithi026 (mon.0) 703 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.yfxlxl"}]: dispatch 2021-11-03T16:55:29.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:29 smithi026 conmon[32119]: cluster 2021-11-03T16:55:28.159288+0000 2021-11-03T16:55:29.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:29 smithi026 conmon[32119]: mgr.smithi026.cnrxli (mgr.14594) 24 : cluster [DBG] pgmap v13: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:55:29.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:29 smithi026 conmon[32119]: cluster 2021-11-03T16:55:29.179122+0000 mon.smithi026 (mon.0) 701 : cluster [DBG] mds.? [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] up:boot 2021-11-03T16:55:29.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:29 smithi026 conmon[32119]: cluster 2021-11-03T16:55:29.179189+0000 mon.smithi026 (mon.0) 702 : cluster 2021-11-03T16:55:29.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:29 smithi026 conmon[32119]: [DBG] fsmap cephfs:1/1 {0=cephfs.smithi026.ltacyh=up:replay} 3 up:standby 2021-11-03T16:55:29.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:29 smithi026 conmon[32119]: audit 2021-11-03T16:55:29.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:29 smithi026 conmon[32119]: 2021-11-03T16:55:29.179296+0000 mon.smithi026 (mon.0) 703 : audit 2021-11-03T16:55:29.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:29 smithi026 conmon[32119]: [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.yfxlxl"}]: dispatch 2021-11-03T16:55:31.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:31 smithi026 conmon[32119]: cluster 2021-11-03T16:55:30.159636+0000 mgr.smithi026.cnrxli (mgr.14594) 2021-11-03T16:55:31.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:31 smithi026 conmon[32119]: 25 : cluster [DBG] pgmap v14: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:55:31.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:31 smithi026 conmon[32119]: audit 2021-11-03T16:55:30.487884+0000 mon.smithi026 (mon.0) 704 : audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' 2021-11-03T16:55:31.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:31 smithi026 conmon[32119]: audit 2021-11-03T16:55:30.492778+0000 mon.smithi026 (mon.0) 705 : audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' 2021-11-03T16:55:31.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:31 smithi026 conmon[32119]: audit 2021-11-03T16:55:30.498143+0000 mon.smithi026 (mon.0) 706 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:55:31.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:31 smithi026 conmon[32119]: audit 2021-11-03T16:55:30.499374+0000 mon.smithi026 (mon.0) 707 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:55:31.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:31 smithi026 conmon[32119]: audit 2021-11-03T16:55:30.503873+0000 mon.smithi026 (mon.0) 708 : audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' 2021-11-03T16:55:31.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:31 smithi026 conmon[32119]: audit 2021-11-03T16:55:30.504670+0000 mon.smithi026 (mon.0) 2021-11-03T16:55:31.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:31 smithi026 conmon[32119]: 709 : audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi026.cnrxli"}]: dispatch 2021-11-03T16:55:31.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:31 smithi026 conmon[32119]: audit 2021-11-03T16:55:30.508220+0000 mon.smithi026 (mon.0) 710 : audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi026.cnrxli"}]': finished 2021-11-03T16:55:31.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:31 smithi026 conmon[32119]: audit 2021-11-03T16:55:30.509030 2021-11-03T16:55:31.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:31 smithi026 conmon[32119]: +0000 mon.smithi026 (mon.0) 711 : audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi194.wnexas"}]: dispatch 2021-11-03T16:55:31.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:31 smithi026 conmon[32119]: audit 2021-11-03T16:55:31.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:31 smithi026 conmon[32119]: 2021-11-03T16:55:30.512202+0000 mon.smithi026 2021-11-03T16:55:31.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:31 smithi026 conmon[32119]: (mon.0) 712 : audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi194.wnexas"}]': finished 2021-11-03T16:55:31.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:31 smithi026 conmon[32119]: audit 2021-11-03T16:55:31.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:31 smithi026 conmon[32119]: 2021-11-03T16:55 2021-11-03T16:55:31.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:31 smithi026 conmon[32119]: :30.513153+0000 mon.smithi026 (mon.0) 713 2021-11-03T16:55:31.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:31 smithi026 conmon[32119]: : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "quorum_status"}]: dispatch 2021-11-03T16:55:31.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:31 smithi194 conmon[35111]: cluster 2021-11-03T16:55:30.159636+0000 mgr.smithi026.cnrxli (mgr.14594) 25 : cluster [DBG] pgmap v14: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:55:31.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:31 smithi194 conmon[35111]: 2021-11-03T16:55:31.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:31 smithi194 conmon[35111]: audit 2021-11-03T16:55:30.487884+0000 mon.smithi026 (mon.0) 704 : audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' 2021-11-03T16:55:31.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:31 smithi194 conmon[35111]: audit 2021-11-03T16 2021-11-03T16:55:31.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:31 smithi194 conmon[35111]: :55:30.492778+0000 mon.smithi026 (mon.0) 705 : audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' 2021-11-03T16:55:31.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:31 smithi194 conmon[35111]: audit 2021-11-03T16:55 2021-11-03T16:55:31.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:31 smithi194 conmon[35111]: :30.498143+0000 mon.smithi026 (mon.0) 706 2021-11-03T16:55:31.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:31 smithi194 conmon[35111]: : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:55:31.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:31 smithi194 conmon[35111]: audit 2021-11-03T 2021-11-03T16:55:31.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:31 smithi194 conmon[35111]: 16:55:30.499374+0000 mon.smithi026 (mon 2021-11-03T16:55:31.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:31 smithi194 conmon[35111]: .0) 707 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:55:31.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:31 smithi194 conmon[35111]: audit 2021-11 2021-11-03T16:55:31.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:31 smithi194 conmon[35111]: -03T16:55:30.503873+0000 2021-11-03T16:55:31.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:31 smithi194 conmon[35111]: mon.smithi026 (mon.0) 708 : audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' 2021-11-03T16:55:31.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:31 smithi194 conmon[35111]: 2021-11-03T16:55:31.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:31 smithi194 conmon[35111]: audit 2021-11-03T16:55:31.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:31 smithi194 conmon[35111]: 2021-11-03T16:55:30.504670+0000 mon.smithi026 ( 2021-11-03T16:55:31.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:31 smithi194 conmon[35111]: mon.0) 709 : audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi026.cnrxli"}]: dispatch 2021-11-03T16:55:31.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:31 smithi194 conmon[35111]: audit 2021 2021-11-03T16:55:31.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:31 smithi194 conmon[35111]: -11-03T16:55:30.508220 2021-11-03T16:55:31.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:31 smithi194 conmon[35111]: +0000 mon.smithi026 (mon.0) 710 : audit [INF] 2021-11-03T16:55:31.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:31 smithi194 conmon[35111]: from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi026.cnrxli"}]': finished 2021-11-03T16:55:31.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:31 smithi194 conmon[35111]: audit 2021-11-03T16:55: 2021-11-03T16:55:31.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:31 smithi194 conmon[35111]: 30.509030+0000 mon.smithi026 (mon.0) 711 : 2021-11-03T16:55:31.505 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:31 smithi194 conmon[35111]: audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi194.wnexas"}]: dispatch 2021-11-03T16:55:31.505 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:31 smithi194 conmon[35111]: audit 2021-11-03T16:55 2021-11-03T16:55:31.505 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:31 smithi194 conmon[35111]: :30.512202+0000 mon.smithi026 (mon.0) 2021-11-03T16:55:31.505 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:31 smithi194 conmon[35111]: 712 : audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi194.wnexas"}]': finished 2021-11-03T16:55:31.505 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:31 smithi194 conmon[35111]: audit 2021-11- 2021-11-03T16:55:31.506 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:31 smithi194 conmon[35111]: 03T16:55:30.513153+0000 mon.smithi026 ( 2021-11-03T16:55:31.506 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:31 smithi194 conmon[35111]: mon.0) 713 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "quorum_status"}]: dispatch 2021-11-03T16:55:31.506 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:31 smithi194 conmon[35111]: 2021-11-03T16:55:32.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:32 smithi194 conmon[35111]: cephadm 2021-11-03T16:55:30.457347+0000 mgr.smithi026.cnrxli (mgr.14594) 26 2021-11-03T16:55:32.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:32 smithi194 conmon[35111]: : cephadm [INF] poll took 3633.872 ms: 1 events 2021-11-03T16:55:32.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:32 smithi194 conmon[35111]: cluster 2021-11-03T16:55:30.488745+0000 mgr.smithi026.cnrxli (mgr.14594) 27 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:55:32.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:32 smithi194 conmon[35111]: cluster 2021-11-03T16:55 2021-11-03T16:55:32.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:32 smithi194 conmon[35111]: :30.488956+0000 mgr.smithi026.cnrxli (mgr.14594) 28 : cluster [DBG] pgmap v16: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:55:32.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:32 smithi194 conmon[35111]: cephadm 2021-11-03 2021-11-03T16:55:32.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:32 smithi194 conmon[35111]: T16:55:30.500008+0000 mgr.smithi026.cnrxli (mgr.14594) 29 : cephadm [INF] Upgrade: Setting container_image for all mgr 2021-11-03T16:55:32.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:32 smithi026 conmon[32119]: cephadm 2021-11-03T16:55:30.457347+0000 mgr.smithi026.cnrxli (mgr.14594) 26 : cephadm [INF] 2021-11-03T16:55:32.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:32 smithi026 conmon[32119]: poll took 3633.872 ms: 1 events 2021-11-03T16:55:32.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:32 smithi026 conmon[32119]: cluster 2021-11-03T16:55:30.488745+0000 mgr.smithi026.cnrxli (mgr.14594) 27 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:55:32.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:32 smithi026 conmon[32119]: cluster 2021-11-03T16:55:30.488956+0000 mgr.smithi026.cnrxli (mgr.14594) 28 : cluster [DBG] pgmap v16: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:55:32.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:32 smithi026 conmon[32119]: cephadm 2021-11-03T16:55:30.500008+0000 mgr.smithi026.cnrxli (mgr.14594) 29 : cephadm [INF] Upgrade: Setting container_image for all mgr 2021-11-03T16:55:33.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:33 smithi194 conmon[35111]: cluster 2021-11-03T16:55:32.488825+0000 mon.smithi026 (mon.0) 2021-11-03T16:55:33.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:33 smithi194 conmon[35111]: 714 : cluster [DBG] mds.? [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] up:standby 2021-11-03T16:55:33.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:33 smithi194 conmon[35111]: cluster 2021-11-03T16:55:32.488876+0000 mon.smithi026 (mon.0) 715 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi026.ltacyh=up:replay} 3 up:standby 2021-11-03T16:55:33.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:33 smithi194 conmon[35111]: cluster 2021-11-03T16:55:32.489396+0000 mgr.smithi026.cnrxli (mgr. 2021-11-03T16:55:33.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:33 smithi194 conmon[35111]: 14594) 30 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 17 MiB/s rd, 8 op/s 2021-11-03T16:55:33.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:33 smithi194 conmon[35111]: cluster 2021-11- 2021-11-03T16:55:33.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:33 smithi194 conmon[35111]: 03T16:55:32.871419+0000 mon.smithi026 ( 2021-11-03T16:55:33.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:33 smithi194 conmon[35111]: mon.0) 716 : cluster [DBG] Standby manager daemon smithi194.wnexas restarted 2021-11-03T16:55:33.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:33 smithi194 conmon[35111]: cluster 2021- 2021-11-03T16:55:33.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:33 smithi194 conmon[35111]: 11-03T16:55:32.871560+0000 mon.smithi026 2021-11-03T16:55:33.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:33 smithi194 conmon[35111]: (mon.0) 717 : cluster [DBG] Standby manager daemon smithi194.wnexas started 2021-11-03T16:55:33.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:33 smithi194 conmon[35111]: audit 2021 2021-11-03T16:55:33.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:33 smithi194 conmon[35111]: -11-03T16:55:32.873411+0000 2021-11-03T16:55:33.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:33 smithi194 conmon[35111]: mon.smithi194 (mon.1) 62 : audit [DBG] from='mgr.? 172.21.15.194:0/1495245634' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.wnexas/crt"}]: dispatch 2021-11-03T16:55:33.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:33 smithi194 conmon[35111]: 2021-11-03T16:55:33.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:33 smithi194 conmon[35111]: audit 2021-11-03T16:55:33.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:33 smithi194 conmon[35111]: 2021-11-03T16:55:32.873771+0000 mon.smithi194 (mon 2021-11-03T16:55:33.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:33 smithi194 conmon[35111]: .1) 63 : audit [DBG] from='mgr.? 172.21.15.194:0/1495245634' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-11-03T16:55:33.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:33 smithi194 conmon[35111]: audit 2021-11-03 2021-11-03T16:55:33.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:33 smithi194 conmon[35111]: T16:55:32.875449+0000 mon.smithi194 (mon 2021-11-03T16:55:33.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:33 smithi194 conmon[35111]: .1) 64 : audit [DBG] from='mgr.? 172.21.15.194:0/1495245634' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.wnexas/key"}]: dispatch 2021-11-03T16:55:33.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:33 smithi194 conmon[35111]: audit 2021-11- 2021-11-03T16:55:33.754 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:33 smithi194 conmon[35111]: 03T16:55:32.876250+0000 mon.smithi194 ( 2021-11-03T16:55:33.754 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:33 smithi194 conmon[35111]: mon.1) 65 : audit [DBG] from='mgr.? 172.21.15.194:0/1495245634' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-11-03T16:55:33.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:33 smithi026 conmon[32119]: cluster 2021-11-03T16:55:32. 2021-11-03T16:55:33.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:33 smithi026 conmon[32119]: 488825+0000 mon.smithi026 (mon.0) 714 : cluster [DBG] mds.? [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] up:standby 2021-11-03T16:55:33.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:33 smithi026 conmon[32119]: cluster 2021-11 2021-11-03T16:55:33.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:33 smithi026 conmon[32119]: -03T16:55:32.488876+0000 mon.smithi026 (mon.0) 715 : cluster [DBG] 2021-11-03T16:55:33.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:33 smithi026 conmon[32119]: fsmap cephfs:1/1 {0=cephfs.smithi026.ltacyh=up:replay} 3 up:standby 2021-11-03T16:55:33.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:33 smithi026 conmon[32119]: cluster 2021-11-03T16:55 2021-11-03T16:55:33.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:33 smithi026 conmon[32119]: :32.489396+0000 mgr.smithi026.cnrxli (mgr. 2021-11-03T16:55:33.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:33 smithi026 conmon[32119]: 14594) 30 : cluster [DBG] 2021-11-03T16:55:33.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:33 smithi026 conmon[32119]: pgmap v17: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 17 MiB/s rd, 8 op/s 2021-11-03T16:55:33.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:33 smithi026 conmon[32119]: cluster 2021- 2021-11-03T16:55:33.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:33 smithi026 conmon[32119]: 11-03T16:55:32.871419+0000 2021-11-03T16:55:33.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:33 smithi026 conmon[32119]: mon.smithi026 (mon.0) 716 : cluster [DBG] Standby manager daemon smithi194.wnexas restarted 2021-11-03T16:55:33.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:33 smithi026 conmon[32119]: cluster 2021 2021-11-03T16:55:33.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:33 smithi026 conmon[32119]: -11-03T16:55:32.871560+0000 mon.smithi026 (mon. 2021-11-03T16:55:33.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:33 smithi026 conmon[32119]: 0) 717 : cluster [DBG] Standby manager daemon smithi194.wnexas started 2021-11-03T16:55:33.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:33 smithi026 conmon[32119]: audit 2021 2021-11-03T16:55:33.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:33 smithi026 conmon[32119]: -11-03T16:55: 2021-11-03T16:55:33.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:33 smithi026 conmon[32119]: 32.873411+0000 mon.smithi194 ( 2021-11-03T16:55:33.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:33 smithi026 conmon[32119]: mon.1) 62 : audit [DBG] 2021-11-03T16:55:33.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:33 smithi026 conmon[32119]: from='mgr.? 172.21.15.194:0/1495245634' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.wnexas/crt"}]: dispatch 2021-11-03T16:55:33.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:33 smithi026 conmon[32119]: audit 2021 2021-11-03T16:55:33.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:33 smithi026 conmon[32119]: -11-03T16:55 2021-11-03T16:55:33.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:33 smithi026 conmon[32119]: :32.873771+0000 mon.smithi194 ( 2021-11-03T16:55:33.928 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:33 smithi026 conmon[32119]: mon.1) 63 : audit 2021-11-03T16:55:33.928 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:33 smithi026 conmon[32119]: [DBG] from='mgr.? 172.21.15.194:0/1495245634' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-11-03T16:55:33.928 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:33 smithi026 conmon[32119]: audit 2021-11-03T16:55:33.928 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:33 smithi026 conmon[32119]: 2021- 2021-11-03T16:55:33.929 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:33 smithi026 conmon[32119]: 11-03T16:55: 2021-11-03T16:55:33.929 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:33 smithi026 conmon[32119]: 32.875449+0000 mon.smithi194 ( 2021-11-03T16:55:33.929 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:33 smithi026 conmon[32119]: mon.1) 64 : audit 2021-11-03T16:55:33.929 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:33 smithi026 conmon[32119]: [DBG] from='mgr.? 172.21.15.194:0/1495245634' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.wnexas/key"}]: dispatch 2021-11-03T16:55:33.930 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:33 smithi026 conmon[32119]: audit 2021 2021-11-03T16:55:33.930 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:33 smithi026 conmon[32119]: -11-03T16:55: 2021-11-03T16:55:33.930 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:33 smithi026 conmon[32119]: 32.876250+0000 mon.smithi194 (mon 2021-11-03T16:55:33.930 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:33 smithi026 conmon[32119]: .1) 65 : audit [DBG] 2021-11-03T16:55:33.931 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:33 smithi026 conmon[32119]: from='mgr.? 172.21.15.194:0/1495245634' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-11-03T16:55:34.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:34 smithi194 conmon[35111]: cluster 2021-11-03T16:55:33.499511+0000 mon.smithi026 (mon.0) 718 : cluster [DBG] mgrmap e31: smithi026.cnrxli(active, since 23s), standbys: smithi194.wnexas 2021-11-03T16:55:34.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:34 smithi194 conmon[35111]: cephadm 2021-11-03T16:55:34.022289+0000 mgr.smithi026.cnrxli (mgr.14594) 31 : cephadm [INF] poll took 3467.215 ms: 1 events 2021-11-03T16:55:34.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:34 smithi194 conmon[35111]: cephadm 2021-11-03T16:55:34.052320+0000 mgr.smithi026.cnrxli (mgr.14594 2021-11-03T16:55:34.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:34 smithi194 conmon[35111]: ) 32 : cephadm [INF] Upgrade: Updating mon.smithi026 2021-11-03T16:55:34.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:34 smithi194 conmon[35111]: audit 2021-11 2021-11-03T16:55:34.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:34 smithi194 conmon[35111]: -03T16:55:34.056841+0000 mon.smithi026 (mon.0) 719 : audit 2021-11-03T16:55:34.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:34 smithi194 conmon[35111]: [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' 2021-11-03T16:55:34.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:34 smithi194 conmon[35111]: audit 2021-11-03T16:55 2021-11-03T16:55:34.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:34 smithi194 conmon[35111]: :34.057645+0000 mon.smithi026 (mon.0) 720 : audit 2021-11-03T16:55:34.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:34 smithi194 conmon[35111]: [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-11-03T16:55:34.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:34 smithi194 conmon[35111]: audit 2021-11 2021-11-03T16:55:34.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:34 smithi194 conmon[35111]: -03T16:55:34.058381+0000 mon.smithi026 ( 2021-11-03T16:55:34.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:34 smithi194 conmon[35111]: mon.0) 721 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-11-03T16:55:34.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:34 smithi194 conmon[35111]: audit 2021-11 2021-11-03T16:55:34.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:34 smithi194 conmon[35111]: -03T16:55:34.059144+0000 mon.smithi026 2021-11-03T16:55:34.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:34 smithi194 conmon[35111]: (mon.0) 722 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:55:34.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:34 smithi194 conmon[35111]: cephadm 2021-11 2021-11-03T16:55:34.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:34 smithi194 conmon[35111]: -03T16:55:34.059988+0000 mgr.smithi026.cnrxli (mgr 2021-11-03T16:55:34.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:34 smithi194 conmon[35111]: .14594) 33 : cephadm [INF] Deploying daemon mon.smithi026 on smithi026 2021-11-03T16:55:34.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:34 smithi026 conmon[32119]: cluster 2021-11-03T16:55:33.499511+0000 mon.smithi026 (mon.0) 718 : cluster [DBG] mgrmap e31: smithi026.cnrxli(active, since 23s), standbys: smithi194.wnexas 2021-11-03T16:55:34.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:34 smithi026 conmon[32119]: cephadm 2021-11-03T16:55:34.022289+0000 mgr.smithi026.cnrxli (mgr.14594) 31 : cephadm [INF] poll took 3467.215 ms: 1 events 2021-11-03T16:55:34.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:34 smithi026 conmon[32119]: cephadm 2021-11-03T16:55:34.052320+0000 mgr.smithi026.cnrxli (mgr.14594) 32 : cephadm [INF] Upgrade: Updating mon.smithi026 2021-11-03T16:55:34.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:34 smithi026 conmon[32119]: audit 2021-11-03T16:55:34.056841+0000 mon.smithi026 (mon.0) 719 : audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' 2021-11-03T16:55:34.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:34 smithi026 conmon[32119]: audit 2021-11-03T16:55:34.057645+0000 mon.smithi026 (mon.0) 720 : audit [INF] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-11-03T16:55:34.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:34 smithi026 conmon[32119]: audit 2021-11-03T16:55:34.058381+0000 mon.smithi026 (mon.0) 721 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-11-03T16:55:34.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:34 smithi026 conmon[32119]: audit 2021-11-03T16:55:34. 2021-11-03T16:55:34.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:34 smithi026 conmon[32119]: 059144+0000 mon.smithi026 (mon.0) 722 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:55:34.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:34 smithi026 conmon[32119]: cephadm 2021-11-03T16:55:34.059988+0000 mgr.smithi026.cnrxli (mgr.14594) 33 : cephadm [INF] Deploying daemon mon.smithi026 on smithi026 2021-11-03T16:55:36.378 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:36 smithi026 conmon[32119]: cluster 2021-11-03T16:55:34.489762+0000 mgr.smithi026.cnrxli (mgr.14594) 34 : cluster [DBG] 2021-11-03T16:55:36.379 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:36 smithi026 conmon[32119]: pgmap v18: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 16 MiB/s rd, 8 op/s 2021-11-03T16:55:36.379 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:36 smithi026 conmon[32119]: cluster 2021-11-03T16:55:35.495707+0000 mds.cephfs.smithi026.ltacyh (mds 2021-11-03T16:55:36.379 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:36 smithi026 conmon[32119]: .0) 1 : cluster [DBG] reconnect by client.14622 172.21.15.26:0/1183226442 after 0.000999985 2021-11-03T16:55:36.379 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:36 smithi026 conmon[32119]: cluster 2021-11 2021-11-03T16:55:36.380 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:36 smithi026 conmon[32119]: -03T16:55:35.495833+0000 2021-11-03T16:55:36.380 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:36 smithi026 conmon[32119]: mds.cephfs.smithi026.ltacyh (mds.0) 2 : cluster [DBG] reconnect by client.14624 172.21.15.26:0/1663235844 after 0.000999985 2021-11-03T16:55:36.380 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:36 smithi026 conmon[32119]: 2021-11-03T16:55:36.380 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:36 smithi026 conmon[32119]: cluster 2021-11-03T16: 2021-11-03T16:55:36.381 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:36 smithi026 conmon[32119]: 55:35.497529+0000 mon.smithi026 (mon.0) 723 : cluster [DBG] mds.? [v2:172.21.15.26:6800/1006134959,v1:172.21.15.26:6801/1006134959] up:reconnect 2021-11-03T16:55:36.381 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:36 smithi026 conmon[32119]: cluster 2021-11-03T16:55:35 2021-11-03T16:55:36.381 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:36 smithi026 conmon[32119]: .497610+0000 mon.smithi026 (mon.0) 724 : cluster 2021-11-03T16:55:36.381 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:36 smithi026 conmon[32119]: [DBG] fsmap cephfs:1/1 {0=cephfs.smithi026.ltacyh=up:reconnect} 3 up:standby 2021-11-03T16:55:36.381 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:36 smithi026 conmon[32119]: cluster 2021-11-03T16 2021-11-03T16:55:36.382 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:36 smithi026 conmon[32119]: :55:35.516278+0000 mds.cephfs.smithi026.ltacyh (mds. 2021-11-03T16:55:36.382 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:36 smithi026 conmon[32119]: 0) 3 : cluster [DBG] reconnect by client.24301 v1:172.21.15.26:0/553539211 after 0.0209997 2021-11-03T16:55:36.382 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:36 smithi026 conmon[32119]: cluster 2021- 2021-11-03T16:55:36.382 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:36 smithi026 conmon[32119]: 11-03T16:55:35.518179+0000 2021-11-03T16:55:36.383 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:36 smithi026 conmon[32119]: mds.cephfs.smithi026.ltacyh (mds.0) 4 : cluster [DBG] 2021-11-03T16:55:36.383 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:36 smithi026 conmon[32119]: reconnect by client.24305 v1:192.168.0.1:0/1370096456 after 0.0229997 2021-11-03T16:55:36.383 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:36 smithi026 systemd[1]: Stopping Ceph mon.smithi026 for 70492bc6-3cc5-11ec-8c28-001a4aab830c... 2021-11-03T16:55:36.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:36 smithi194 conmon[35111]: cluster 2021-11-03T16:55:34.489762+0000 mgr.smithi026.cnrxli (mgr.14594) 34 : cluster [DBG] pgmap v18: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 16 MiB/s rd, 8 op/s 2021-11-03T16:55:36.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:36 smithi194 conmon[35111]: cluster 2021-11-03T16:55:35.495707+0000 mds.cephfs.smithi026.ltacyh (mds.0) 1 : cluster [DBG] reconnect by client.14622 172.21.15.26:0/1183226442 after 0.000999985 2021-11-03T16:55:36.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:36 smithi194 conmon[35111]: cluster 2021-11-03T16:55:35.495833+0000 mds.cephfs.smithi026.ltacyh (mds.0) 2 : cluster [DBG] reconnect by client.14624 172.21.15.26:0/1663235844 after 0.000999985 2021-11-03T16:55:36.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:36 smithi194 conmon[35111]: cluster 2021-11-03T16:55:35.497529+0000 2021-11-03T16:55:36.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:36 smithi194 conmon[35111]: mon.smithi026 (mon.0) 723 : cluster [DBG] mds.? [v2:172.21.15.26:6800/1006134959,v1:172.21.15.26:6801/1006134959] up:reconnect 2021-11-03T16:55:36.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:36 smithi194 conmon[35111]: cluster 2021-11 2021-11-03T16:55:36.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:36 smithi194 conmon[35111]: -03T16:55:35.497610+0000 mon.smithi026 (mon 2021-11-03T16:55:36.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:36 smithi194 conmon[35111]: .0) 724 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi026.ltacyh=up:reconnect} 3 up:standby 2021-11-03T16:55:36.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:36 smithi194 conmon[35111]: cluster 2021- 2021-11-03T16:55:36.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:36 smithi194 conmon[35111]: 11-03T16:55:35.516278+0000 mds.cephfs.smithi026.ltacyh 2021-11-03T16:55:36.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:36 smithi194 conmon[35111]: (mds.0) 3 : cluster [DBG] reconnect by client.24301 v1:172.21.15.26:0/553539211 after 0.0209997 2021-11-03T16:55:36.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:36 smithi194 conmon[35111]: cluster 2021- 2021-11-03T16:55:36.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:36 smithi194 conmon[35111]: 11-03T16:55:35.518179+0000 mds.cephfs.smithi026.ltacyh 2021-11-03T16:55:36.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:36 smithi194 conmon[35111]: (mds.0) 4 : cluster [DBG] reconnect by client.24305 v1:192.168.0.1:0/1370096456 after 0.0229997 2021-11-03T16:55:37.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:36 smithi026 conmon[32119]: debug 2021-11-03T16:55:36.895+0000 7fee5e570700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.smithi026 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2021-11-03T16:55:37.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:36 smithi026 conmon[32119]: debug 2021-11-03T16:55:36.895+0000 7fee5e570700 -1 mon.smithi026@0(leader) e2 *** Got Signal Terminated *** 2021-11-03T16:55:37.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:37 smithi026 bash[96322]: c37e5430889004c4495fb625c638c343510edc02bf9bc8fd957cd7655ecf3619 2021-11-03T16:55:37.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:37 smithi026 bash[96322]: Error: no container with name or ID ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c-mon-smithi026 found: no such container 2021-11-03T16:55:38.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:37 smithi026 bash[96322]: Error: container c37e5430889004c4495fb625c638c343510edc02bf9bc8fd957cd7655ecf3619 does not exist in database: no such container 2021-11-03T16:55:38.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:37 smithi026 systemd[1]: ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c@mon.smithi026.service: Succeeded. 2021-11-03T16:55:38.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:37 smithi026 systemd[1]: Stopped Ceph mon.smithi026 for 70492bc6-3cc5-11ec-8c28-001a4aab830c. 2021-11-03T16:55:38.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 systemd[1]: Starting Ceph mon.smithi026 for 70492bc6-3cc5-11ec-8c28-001a4aab830c... 2021-11-03T16:55:38.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: set uid:gid to 167:167 (ceph:ceph) 2021-11-03T16:55:38.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev), process ceph-mon, pid 7 2021-11-03T16:55:38.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: pidfile_write: ignore empty --pid-file 2021-11-03T16:55:38.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: load: jerasure load: lrc 2021-11-03T16:55:38.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: RocksDB version: 6.15.5 2021-11-03T16:55:38.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-11-03T16:55:38.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Compile date Nov 3 2021 2021-11-03T16:55:38.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: DB SUMMARY 2021-11-03T16:55:38.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: DB Session ID: 56XTJR8CD4EMLAYM5DZN 2021-11-03T16:55:38.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: CURRENT file: CURRENT 2021-11-03T16:55:38.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: IDENTITY file: IDENTITY 2021-11-03T16:55:38.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: MANIFEST file: MANIFEST-000008 size: 392 Bytes 2021-11-03T16:55:38.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi026/store.db dir, Total Num: 1, files: 000014.sst 2021-11-03T16:55:38.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi026/store.db: 000012.log size: 9323407 ; 2021-11-03T16:55:38.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.error_if_exists: 0 2021-11-03T16:55:38.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.create_if_missing: 0 2021-11-03T16:55:38.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.paranoid_checks: 1 2021-11-03T16:55:38.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2021-11-03T16:55:38.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.env: 0x55f7bd66bc00 2021-11-03T16:55:38.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.fs: Posix File System 2021-11-03T16:55:38.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.info_log: 0x55f7bf58a460 2021-11-03T16:55:38.928 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.max_file_opening_threads: 16 2021-11-03T16:55:38.929 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.statistics: (nil) 2021-11-03T16:55:38.929 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.use_fsync: 0 2021-11-03T16:55:38.929 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.max_log_file_size: 0 2021-11-03T16:55:38.929 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.max_manifest_file_size: 1073741824 2021-11-03T16:55:38.930 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.log_file_time_to_roll: 0 2021-11-03T16:55:38.930 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.keep_log_file_num: 1000 2021-11-03T16:55:38.930 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.recycle_log_file_num: 0 2021-11-03T16:55:38.930 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.allow_fallocate: 1 2021-11-03T16:55:38.930 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.allow_mmap_reads: 0 2021-11-03T16:55:38.931 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.allow_mmap_writes: 0 2021-11-03T16:55:38.931 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.use_direct_reads: 0 2021-11-03T16:55:38.931 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-11-03T16:55:38.931 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.create_missing_column_families: 0 2021-11-03T16:55:38.932 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.db_log_dir: 2021-11-03T16:55:38.932 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi026/store.db 2021-11-03T16:55:38.932 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.table_cache_numshardbits: 6 2021-11-03T16:55:38.932 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.WAL_ttl_seconds: 0 2021-11-03T16:55:38.933 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.WAL_size_limit_MB: 0 2021-11-03T16:55:38.933 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-11-03T16:55:38.933 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.manifest_preallocation_size: 4194304 2021-11-03T16:55:38.933 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.is_fd_close_on_exec: 1 2021-11-03T16:55:38.933 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.advise_random_on_open: 1 2021-11-03T16:55:38.934 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.db_write_buffer_size: 0 2021-11-03T16:55:38.934 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.write_buffer_manager: 0x55f7bf5fff20 2021-11-03T16:55:38.934 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.access_hint_on_compaction_start: 1 2021-11-03T16:55:38.934 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-11-03T16:55:38.935 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.random_access_max_buffer_size: 1048576 2021-11-03T16:55:38.935 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.use_adaptive_mutex: 0 2021-11-03T16:55:38.935 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.rate_limiter: (nil) 2021-11-03T16:55:38.935 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-11-03T16:55:38.936 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.wal_recovery_mode: 2 2021-11-03T16:55:38.936 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.enable_thread_tracking: 0 2021-11-03T16:55:38.936 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.enable_pipelined_write: 0 2021-11-03T16:55:38.936 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.unordered_write: 0 2021-11-03T16:55:38.936 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.allow_concurrent_memtable_write: 1 2021-11-03T16:55:38.937 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-11-03T16:55:38.937 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.write_thread_max_yield_usec: 100 2021-11-03T16:55:38.937 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.write_thread_slow_yield_usec: 3 2021-11-03T16:55:38.937 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.row_cache: None 2021-11-03T16:55:38.938 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.wal_filter: None 2021-11-03T16:55:38.938 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.avoid_flush_during_recovery: 0 2021-11-03T16:55:38.938 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.allow_ingest_behind: 0 2021-11-03T16:55:38.938 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.preserve_deletes: 0 2021-11-03T16:55:38.938 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.two_write_queues: 0 2021-11-03T16:55:38.939 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.manual_wal_flush: 0 2021-11-03T16:55:38.939 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.atomic_flush: 0 2021-11-03T16:55:38.939 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-11-03T16:55:38.939 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.persist_stats_to_disk: 0 2021-11-03T16:55:38.940 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.write_dbid_to_manifest: 0 2021-11-03T16:55:38.940 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.log_readahead_size: 0 2021-11-03T16:55:38.940 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.file_checksum_gen_factory: Unknown 2021-11-03T16:55:38.940 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.best_efforts_recovery: 0 2021-11-03T16:55:38.941 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2021-11-03T16:55:38.941 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2021-11-03T16:55:38.941 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.allow_data_in_errors: 0 2021-11-03T16:55:38.941 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.db_host_id: __hostname__ 2021-11-03T16:55:38.941 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.max_background_jobs: 2 2021-11-03T16:55:38.942 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.max_background_compactions: -1 2021-11-03T16:55:38.942 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.max_subcompactions: 1 2021-11-03T16:55:38.942 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.avoid_flush_during_shutdown: 0 2021-11-03T16:55:38.942 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-11-03T16:55:38.943 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.delayed_write_rate : 16777216 2021-11-03T16:55:38.943 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.max_total_wal_size: 0 2021-11-03T16:55:38.944 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-11-03T16:55:38.944 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.stats_dump_period_sec: 600 2021-11-03T16:55:38.944 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.stats_persist_period_sec: 600 2021-11-03T16:55:38.944 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.stats_history_buffer_size: 1048576 2021-11-03T16:55:38.945 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.max_open_files: -1 2021-11-03T16:55:38.945 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.bytes_per_sync: 0 2021-11-03T16:55:38.945 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.wal_bytes_per_sync: 0 2021-11-03T16:55:38.945 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.strict_bytes_per_sync: 0 2021-11-03T16:55:38.945 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.compaction_readahead_size: 0 2021-11-03T16:55:38.946 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.max_background_flushes: -1 2021-11-03T16:55:38.946 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Compression algorithms supported: 2021-11-03T16:55:38.946 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: kZSTDNotFinalCompression supported: 0 2021-11-03T16:55:38.946 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: kZSTD supported: 0 2021-11-03T16:55:38.947 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: kXpressCompression supported: 0 2021-11-03T16:55:38.947 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: kLZ4HCCompression supported: 1 2021-11-03T16:55:38.947 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: kLZ4Compression supported: 1 2021-11-03T16:55:38.947 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: kBZip2Compression supported: 0 2021-11-03T16:55:38.948 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: kZlibCompression supported: 1 2021-11-03T16:55:38.948 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: kSnappyCompression supported: 1 2021-11-03T16:55:38.948 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Fast CRC32 supported: Supported on x86 2021-11-03T16:55:38.948 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: [db/version_set.cc:4725] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi026/store.db/MANIFEST-000008 2021-11-03T16:55:38.949 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: [db/column_family.cc:597] --------------- Options for column family [default]: 2021-11-03T16:55:38.949 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-11-03T16:55:38.949 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.merge_operator: 2021-11-03T16:55:38.949 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.compaction_filter: None 2021-11-03T16:55:38.949 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.compaction_filter_factory: None 2021-11-03T16:55:38.950 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.sst_partitioner_factory: None 2021-11-03T16:55:38.950 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.memtable_factory: SkipListFactory 2021-11-03T16:55:38.950 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.table_factory: BlockBasedTable 2021-11-03T16:55:38.950 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f7bf553bc0) 2021-11-03T16:55:38.951 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: cache_index_and_filter_blocks: 1 2021-11-03T16:55:38.951 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2021-11-03T16:55:38.951 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2021-11-03T16:55:38.951 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: pin_top_level_index_and_filter: 1 2021-11-03T16:55:38.951 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: index_type: 0 2021-11-03T16:55:38.952 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: data_block_index_type: 0 2021-11-03T16:55:38.952 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: index_shortening: 1 2021-11-03T16:55:38.952 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: data_block_hash_table_util_ratio: 0.750000 2021-11-03T16:55:38.952 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: hash_index_allow_collision: 1 2021-11-03T16:55:38.953 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: checksum: 1 2021-11-03T16:55:38.953 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: no_block_cache: 0 2021-11-03T16:55:38.953 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: block_cache: 0x55f7bf588d10 2021-11-03T16:55:38.953 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: block_cache_name: BinnedLRUCache 2021-11-03T16:55:38.953 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: block_cache_options: 2021-11-03T16:55:38.954 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: capacity : 536870912 2021-11-03T16:55:38.954 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: num_shard_bits : 4 2021-11-03T16:55:38.954 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: strict_capacity_limit : 0 2021-11-03T16:55:38.954 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: high_pri_pool_ratio: 0.000 2021-11-03T16:55:38.955 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: block_cache_compressed: (nil) 2021-11-03T16:55:38.955 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: persistent_cache: (nil) 2021-11-03T16:55:38.955 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: block_size: 4096 2021-11-03T16:55:38.955 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: block_size_deviation: 10 2021-11-03T16:55:38.956 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: block_restart_interval: 16 2021-11-03T16:55:38.956 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: index_block_restart_interval: 1 2021-11-03T16:55:38.956 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: metadata_block_size: 4096 2021-11-03T16:55:38.956 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: partition_filters: 0 2021-11-03T16:55:38.956 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: use_delta_encoding: 1 2021-11-03T16:55:38.957 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2021-11-03T16:55:38.957 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: whole_key_filtering: 1 2021-11-03T16:55:38.957 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: verify_compression: 0 2021-11-03T16:55:38.957 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: read_amp_bytes_per_bit: 0 2021-11-03T16:55:38.957 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: format_version: 4 2021-11-03T16:55:38.958 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: enable_index_compression: 1 2021-11-03T16:55:38.958 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: block_align: 0 2021-11-03T16:55:38.958 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.write_buffer_size: 33554432 2021-11-03T16:55:38.958 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.max_write_buffer_number: 2 2021-11-03T16:55:38.959 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.compression: NoCompression 2021-11-03T16:55:38.959 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.bottommost_compression: Disabled 2021-11-03T16:55:38.959 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.prefix_extractor: nullptr 2021-11-03T16:55:38.959 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-11-03T16:55:38.960 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.num_levels: 7 2021-11-03T16:55:38.960 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-11-03T16:55:38.960 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-11-03T16:55:38.960 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-11-03T16:55:38.960 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-11-03T16:55:38.961 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.bottommost_compression_opts.level: 32767 2021-11-03T16:55:38.961 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-11-03T16:55:38.961 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-11-03T16:55:38.961 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-11-03T16:55:38.962 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2021-11-03T16:55:38.962 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.bottommost_compression_opts.enabled: false 2021-11-03T16:55:38.962 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.compression_opts.window_bits: -14 2021-11-03T16:55:38.962 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.compression_opts.level: 32767 2021-11-03T16:55:38.962 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.compression_opts.strategy: 0 2021-11-03T16:55:38.963 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-11-03T16:55:38.963 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-11-03T16:55:38.963 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.compression_opts.parallel_threads: 1 2021-11-03T16:55:38.963 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.compression_opts.enabled: false 2021-11-03T16:55:38.964 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-11-03T16:55:38.964 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-11-03T16:55:38.964 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.level0_stop_writes_trigger: 36 2021-11-03T16:55:38.964 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.target_file_size_base: 67108864 2021-11-03T16:55:38.965 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.target_file_size_multiplier: 1 2021-11-03T16:55:38.965 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.max_bytes_for_level_base: 268435456 2021-11-03T16:55:38.965 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-11-03T16:55:38.965 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-11-03T16:55:38.966 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-11-03T16:55:38.966 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-11-03T16:55:38.966 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-11-03T16:55:38.966 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-11-03T16:55:38.966 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-11-03T16:55:38.967 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-11-03T16:55:38.967 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-11-03T16:55:38.967 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-11-03T16:55:38.967 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.max_compaction_bytes: 1677721600 2021-11-03T16:55:38.968 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.arena_block_size: 4194304 2021-11-03T16:55:38.968 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-11-03T16:55:38.968 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-11-03T16:55:38.968 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-11-03T16:55:38.969 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.disable_auto_compactions: 0 2021-11-03T16:55:38.969 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-11-03T16:55:38.969 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-11-03T16:55:38.969 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-11-03T16:55:38.969 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-11-03T16:55:38.970 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-11-03T16:55:38.970 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-11-03T16:55:38.970 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-11-03T16:55:38.970 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-11-03T16:55:38.971 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-11-03T16:55:38.971 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-11-03T16:55:38.971 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.table_properties_collectors: 2021-11-03T16:55:38.972 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.inplace_update_support: 0 2021-11-03T16:55:38.973 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.inplace_update_num_locks: 10000 2021-11-03T16:55:38.973 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-11-03T16:55:38.973 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.memtable_whole_key_filtering: 0 2021-11-03T16:55:38.974 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.memtable_huge_page_size: 0 2021-11-03T16:55:38.974 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.bloom_locality: 0 2021-11-03T16:55:38.974 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.max_successive_merges: 0 2021-11-03T16:55:38.974 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.optimize_filters_for_hits: 0 2021-11-03T16:55:38.974 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.paranoid_file_checks: 0 2021-11-03T16:55:38.975 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.force_consistency_checks: 1 2021-11-03T16:55:38.975 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.report_bg_io_stats: 0 2021-11-03T16:55:38.975 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.ttl: 2592000 2021-11-03T16:55:38.975 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.periodic_compaction_seconds: 0 2021-11-03T16:55:38.976 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.enable_blob_files: false 2021-11-03T16:55:38.976 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.min_blob_size: 0 2021-11-03T16:55:38.976 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.blob_file_size: 268435456 2021-11-03T16:55:38.976 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.blob_compression_type: NoCompression 2021-11-03T16:55:38.977 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.enable_blob_garbage_collection: false 2021-11-03T16:55:38.977 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2021-11-03T16:55:38.977 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: [db/version_set.cc:3459] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2021-11-03T16:55:38.977 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: [db/version_set.cc:4773] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi026/store.db/MANIFEST-000008 succeeded,manifest_file_number is 8, next_file_number is 16, last_sequence is 6543, log_number is 12,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-11-03T16:55:38.978 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: [db/version_set.cc:4782] Column family [default] (ID 0), log number is 12 2021-11-03T16:55:38.978 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: [db/version_set.cc:4083] Creating manifest 16 2021-11-03T16:55:38.978 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: [db/version_set.cc:3459] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2021-11-03T16:55:38.978 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: EVENT_LOG_v1 {"time_micros": 1635958538635048, "job": 1, "event": "recovery_started", "wal_files": [12]} 2021-11-03T16:55:38.978 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: [db/db_impl/db_impl_open.cc:847] Recovering log #12 mode 2 2021-11-03T16:55:38.979 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: [table/block_based/filter_policy.cc:996] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-11-03T16:55:38.979 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: EVENT_LOG_v1 {"time_micros": 1635958538652504, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 17, "file_size": 9061867, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 9050602, "index_size": 8724, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1605, "raw_key_size": 12101, "raw_average_key_size": 19, "raw_value_size": 9032853, "raw_average_value_size": 14832, "num_data_blocks": 390, "num_entries": 609, "num_deletions": 4, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1635958538, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "eb7f880b-12a4-4173-80a7-3eae153e9670", "db_session_id": "56XTJR8CD4EMLAYM5DZN"}} 2021-11-03T16:55:38.979 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: [db/version_set.cc:4083] Creating manifest 18 2021-11-03T16:55:38.979 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: [db/version_set.cc:3459] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2021-11-03T16:55:38.980 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: EVENT_LOG_v1 {"time_micros": 1635958538652925, "job": 1, "event": "recovery_finished"} 2021-11-03T16:55:38.980 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: [file/delete_scheduler.cc:73] Deleted file /var/lib/ceph/mon/ceph-smithi026/store.db/000012.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2021-11-03T16:55:38.980 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: [db/db_impl/db_impl_open.cc:1701] SstFileManager instance 0x55f7bf5a4a80 2021-11-03T16:55:38.980 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: DB pointer 0x55f7bf5b4000 2021-11-03T16:55:38.981 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: [db/db_impl/db_impl.cc:902] ------- DUMPING STATS ------- 2021-11-03T16:55:38.981 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: rocksdb: [db/db_impl/db_impl.cc:903] 2021-11-03T16:55:38.981 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: ** DB Stats ** 2021-11-03T16:55:38.981 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Uptime(secs): 0.0 total, 0.0 interval 2021-11-03T16:55:38.981 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-11-03T16:55:38.982 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-11-03T16:55:38.982 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-11-03T16:55:38.982 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-11-03T16:55:38.982 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-11-03T16:55:38.983 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-11-03T16:55:38.983 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: 2021-11-03T16:55:38.983 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: ** Compaction Stats [default] ** 2021-11-03T16:55:38.983 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-11-03T16:55:38.984 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-11-03T16:55:38.984 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: L0 1/0 8.64 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 881.7 0.01 0.00 1 0.010 0 0 2021-11-03T16:55:38.984 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: L6 1/0 16.75 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-11-03T16:55:38.984 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Sum 2/0 25.39 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 881.7 0.01 0.00 1 0.010 0 0 2021-11-03T16:55:38.984 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 881.7 0.01 0.00 1 0.010 0 0 2021-11-03T16:55:38.985 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: 2021-11-03T16:55:38.985 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: ** Compaction Stats [default] ** 2021-11-03T16:55:38.985 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-11-03T16:55:38.985 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-11-03T16:55:38.986 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 881.7 0.01 0.00 1 0.010 0 0 2021-11-03T16:55:38.986 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Uptime(secs): 0.0 total, 0.0 interval 2021-11-03T16:55:38.986 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Flush(GB): cumulative 0.008, interval 0.008 2021-11-03T16:55:38.986 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2021-11-03T16:55:38.987 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: AddFile(Total Files): cumulative 0, interval 0 2021-11-03T16:55:38.987 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: AddFile(L0 Files): cumulative 0, interval 0 2021-11-03T16:55:38.987 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: AddFile(Keys): cumulative 0, interval 0 2021-11-03T16:55:38.987 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Cumulative compaction: 0.01 GB write, 421.81 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-11-03T16:55:38.987 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Interval compaction: 0.01 GB write, 421.81 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-11-03T16:55:38.988 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-11-03T16:55:38.988 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: 2021-11-03T16:55:38.988 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: ** File Read Latency Histogram By Level [default] ** 2021-11-03T16:55:38.988 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: 2021-11-03T16:55:38.989 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: ** Compaction Stats [default] ** 2021-11-03T16:55:38.989 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-11-03T16:55:38.989 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-11-03T16:55:38.989 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: L0 1/0 8.64 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 881.7 0.01 0.00 1 0.010 0 0 2021-11-03T16:55:38.989 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: L6 1/0 16.75 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-11-03T16:55:38.990 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Sum 2/0 25.39 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 881.7 0.01 0.00 1 0.010 0 0 2021-11-03T16:55:38.990 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-11-03T16:55:38.990 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: 2021-11-03T16:55:38.990 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: ** Compaction Stats [default] ** 2021-11-03T16:55:38.991 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-11-03T16:55:38.991 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-11-03T16:55:38.991 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 881.7 0.01 0.00 1 0.010 0 0 2021-11-03T16:55:38.991 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Uptime(secs): 0.0 total, 0.0 interval 2021-11-03T16:55:38.992 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Flush(GB): cumulative 0.008, interval 0.000 2021-11-03T16:55:38.992 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2021-11-03T16:55:38.992 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: AddFile(Total Files): cumulative 0, interval 0 2021-11-03T16:55:38.992 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: AddFile(L0 Files): cumulative 0, interval 0 2021-11-03T16:55:38.992 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: AddFile(Keys): cumulative 0, interval 0 2021-11-03T16:55:38.993 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Cumulative compaction: 0.01 GB write, 420.93 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-11-03T16:55:38.993 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-11-03T16:55:38.993 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-11-03T16:55:38.993 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: 2021-11-03T16:55:38.994 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: ** File Read Latency Histogram By Level [default] ** 2021-11-03T16:55:38.994 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: starting mon.smithi026 rank 0 at public addrs [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] at bind addrs [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi026 fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c 2021-11-03T16:55:38.994 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: mon.smithi026@-1(???) e2 preinit fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c 2021-11-03T16:55:38.994 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: mon.smithi026@-1(???).mds e20 new map 2021-11-03T16:55:38.994 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: mon.smithi026@-1(???).mds e20 print_map 2021-11-03T16:55:38.995 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: e20 2021-11-03T16:55:38.995 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T16:55:38.995 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T16:55:38.995 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: legacy client fscid: 1 2021-11-03T16:55:38.996 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: 2021-11-03T16:55:38.996 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Filesystem 'cephfs' (1) 2021-11-03T16:55:38.996 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: fs_name cephfs 2021-11-03T16:55:38.996 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: epoch 20 2021-11-03T16:55:38.997 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T16:55:38.997 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: created 2021-11-03T16:52:17.109901+0000 2021-11-03T16:55:38.997 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: modified 2021-11-03T16:55:36.494279+0000 2021-11-03T16:55:38.997 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: tableserver 0 2021-11-03T16:55:38.998 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: root 0 2021-11-03T16:55:38.998 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: session_timeout 60 2021-11-03T16:55:38.998 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: session_autoclose 300 2021-11-03T16:55:38.998 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: max_file_size 1099511627776 2021-11-03T16:55:38.998 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: required_client_features {} 2021-11-03T16:55:38.999 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: last_failure 0 2021-11-03T16:55:38.999 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: last_failure_osd_epoch 50 2021-11-03T16:55:38.999 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T16:55:38.999 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: max_mds 1 2021-11-03T16:55:39.000 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: in 0 2021-11-03T16:55:39.000 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: up {0=14590} 2021-11-03T16:55:39.000 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: failed 2021-11-03T16:55:39.000 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: damaged 2021-11-03T16:55:39.001 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: stopped 2021-11-03T16:55:39.001 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: data_pools [3] 2021-11-03T16:55:39.001 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: metadata_pool 2 2021-11-03T16:55:39.001 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: inline_data disabled 2021-11-03T16:55:39.001 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: balancer 2021-11-03T16:55:39.002 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: standby_count_wanted 1 2021-11-03T16:55:39.002 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: [mds.cephfs.smithi026.ltacyh{0:14590} state up:rejoin seq 11 join_fscid=1 addr [v2:172.21.15.26:6800/1006134959,v1:172.21.15.26:6801/1006134959] compat {c=[1],r=[1],i=[77f]}] 2021-11-03T16:55:39.002 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: 2021-11-03T16:55:39.002 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: 2021-11-03T16:55:39.003 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Standby daemons: 2021-11-03T16:55:39.003 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: 2021-11-03T16:55:39.003 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: [mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T16:55:39.003 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: [mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T16:55:39.003 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: [mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T16:55:39.004 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: mon.smithi026@-1(???).osd e50 crush map has features 3314933000852226048, adjusting msgr requires 2021-11-03T16:55:39.004 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: mon.smithi026@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2021-11-03T16:55:39.004 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: mon.smithi026@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2021-11-03T16:55:39.004 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: mon.smithi026@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2021-11-03T16:55:39.005 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 ceph-mon[96795]: mon.smithi026@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2021-11-03T16:55:39.005 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 bash[96575]: bcdc30249f1b501dce11799cf4369e407e46bfe446b2d5aab768966c9c9bb637 2021-11-03T16:55:39.005 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:38 smithi026 systemd[1]: Started Ceph mon.smithi026 for 70492bc6-3cc5-11ec-8c28-001a4aab830c. 2021-11-03T16:55:40.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: audit 2021-11-03T16:55:36.902575+0000 mon.smithi194 (mon. 2021-11-03T16:55:40.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: 1) 66 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata", "id": "smithi026"}]: dispatch 2021-11-03T16:55:40.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: audit 2021-11-03T16:55:36.902813 2021-11-03T16:55:40.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: +0000 mon.smithi194 (mon.1) 67 : audit [DBG] from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2021-11-03T16:55:40.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: cluster 2021-11-03T16:55 2021-11-03T16:55:40.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: :38.490657+0000 mgr.smithi026.cnrxli (mgr.14594) 36 2021-11-03T16:55:40.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: : cluster [DBG] pgmap v20: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 13 MiB/s rd, 6 op/s 2021-11-03T16:55:40.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: cephadm 2021-11- 2021-11-03T16:55:40.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: 03T16:55:38.724162+0000 mgr.smithi026.cnrxli ( 2021-11-03T16:55:40.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: mgr.14594) 37 : cephadm [INF] poll took 4389.929 ms: 1 events 2021-11-03T16:55:40.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: cluster 2021 2021-11-03T16:55:40.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: -11-03T16:55:40.067017+0000 2021-11-03T16:55:40.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: mon.smithi026 (mon.0) 1 : cluster [INF] 2021-11-03T16:55:40.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: mon.smithi026 calling monitor election 2021-11-03T16:55:40.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: cluster 2021 2021-11-03T16:55:40.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: -11-03T16:55:40.080913+0000 mon.smithi026 (mon 2021-11-03T16:55:40.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: .0) 2 : cluster [INF] mon.smithi026 is new leader, mons smithi026,smithi194 in quorum (ranks 0,1) 2021-11-03T16:55:40.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: cluster 2021-11-03 2021-11-03T16:55:40.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: T16:55:40.085414+0000 mon.smithi026 (mon.0 2021-11-03T16:55:40.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: ) 3 : cluster [DBG] monmap e2: 2 mons at {smithi026=[v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0],smithi194=[v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0]} 2021-11-03T16:55:40.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: cluster 2021-11- 2021-11-03T16:55:40.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: 03T16:55:40.085539+0000 mon.smithi026 (mon 2021-11-03T16:55:40.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: .0) 4 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi026.ltacyh=up:rejoin} 3 up:standby 2021-11-03T16:55:40.505 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: cluster 2021 2021-11-03T16:55:40.505 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: -11-03T16:55:40.085616+0000 2021-11-03T16:55:40.505 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: mon.smithi026 (mon.0) 5 : cluster [DBG] osdmap e50: 6 total, 6 up, 6 in 2021-11-03T16:55:40.505 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: 2021-11-03T16:55:40.506 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: cluster 2021-11-03T16:55:40.506 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: 2021-11-03T16:55:40.086576+0000 mon.smithi026 (mon.0) 6 : cluster [DBG] 2021-11-03T16:55:40.506 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: mgrmap e31: smithi026.cnrxli(active, since 29s), standbys: smithi194.wnexas 2021-11-03T16:55:40.506 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: cluster 2021-11-03T16:55:40 2021-11-03T16:55:40.507 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: .094932+0000 mon.smithi026 (mon.0) 7 : cluster 2021-11-03T16:55:40.507 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: [DBG] mgrmap e32: smithi026.cnrxli(active, since 29s), standbys: smithi194.wnexas 2021-11-03T16:55:40.507 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: cluster 2021-11-03T 2021-11-03T16:55:40.507 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: 16:55:40.094977+0000 mon.smithi026 (mon.0) 8 : cluster [WRN] Health detail: HEALTH_WARN 1 failed cephadm daemon(s); 1 filesystem is degraded 2021-11-03T16:55:40.507 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: cluster 2021-11-03T 2021-11-03T16:55:40.508 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: 16:55:40.094994+0000 mon.smithi026 (mon.0) 9 : cluster [WRN] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-11-03T16:55:40.508 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: 2021-11-03T16:55:40.508 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: cluster 2021-11 2021-11-03T16:55:40.508 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: -03T16:55:40.095004+0000 mon.smithi026 (mon.0) 10 : cluster [WRN] 2021-11-03T16:55:40.509 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: daemon mds.cephfs.smithi026.yfxlxl on smithi026 is in unknown state 2021-11-03T16:55:40.509 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: cluster 2021-11 2021-11-03T16:55:40.509 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: -03T16:55:40.095017+0000 mon.smithi026 (mon.0) 11 : 2021-11-03T16:55:40.509 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: cluster [WRN] [WRN] FS_DEGRADED: 1 filesystem is degraded 2021-11-03T16:55:40.509 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: cluster 2021-11-03T16:55: 2021-11-03T16:55:40.510 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: 40.095032+0000 mon.smithi026 (mon.0) 12 : cluster [WRN] fs cephfs is degraded 2021-11-03T16:55:40.510 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: 2021-11-03T16:55:40.510 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: audit 2021-11-03T16:55:40.095193+0000 mon.smithi026 2021-11-03T16:55:40.510 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:40 smithi194 conmon[35111]: (mon.0) 13 : audit [INF] from='mgr.14594 ' entity='' 2021-11-03T16:55:43.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:43.481+0000 7f224241c700 1 -- 172.21.15.26:0/1875822207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f223c0f6860 msgr2=0x7f223c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:55:43.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:43.481+0000 7f224241c700 1 --2- 172.21.15.26:0/1875822207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f223c0f6860 0x7f223c0f6cc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f222c004660 tx=0x7f222c009b30).stop 2021-11-03T16:55:43.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:43.481+0000 7f224241c700 1 -- 172.21.15.26:0/1875822207 shutdown_connections 2021-11-03T16:55:43.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:43.481+0000 7f224241c700 1 --2- 172.21.15.26:0/1875822207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f223c0f6860 0x7f223c0f6cc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:43.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:43.481+0000 7f224241c700 1 --2- 172.21.15.26:0/1875822207 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f223c0f55c0 0x7f223c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:43.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:43.481+0000 7f224241c700 1 -- 172.21.15.26:0/1875822207 >> 172.21.15.26:0/1875822207 conn(0x7f223c0f0d40 msgr2=0x7f223c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:55:43.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:43.481+0000 7f224241c700 1 -- 172.21.15.26:0/1875822207 shutdown_connections 2021-11-03T16:55:43.481 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:43.481+0000 7f224241c700 1 -- 172.21.15.26:0/1875822207 wait complete. 2021-11-03T16:55:43.481 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:43.482+0000 7f224241c700 1 Processor -- start 2021-11-03T16:55:43.481 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:43.482+0000 7f224241c700 1 -- start start 2021-11-03T16:55:43.481 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:43.482+0000 7f224241c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f223c0f55c0 0x7f223c105e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:55:43.481 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:43.482+0000 7f224241c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f223c0f6860 0x7f223c106340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:55:43.482 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:43.482+0000 7f224241c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c106940 con 0x7f223c0f6860 2021-11-03T16:55:43.482 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:43.482+0000 7f224241c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c107150 con 0x7f223c0f55c0 2021-11-03T16:55:43.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:43.482+0000 7f223b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f223c0f6860 0x7f223c106340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:55:43.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:43.482+0000 7f223bfff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f223c0f55c0 0x7f223c105e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:55:43.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:43.482+0000 7f223bfff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f223c0f55c0 0x7f223c105e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.26:55138/0 (socket says 172.21.15.26:55138) 2021-11-03T16:55:43.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:43.482+0000 7f223bfff700 1 -- 172.21.15.26:0/1646590561 learned_addr learned my addr 172.21.15.26:0/1646590561 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:55:43.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:43.483+0000 7f223bfff700 1 -- 172.21.15.26:0/1646590561 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f223c0f6860 msgr2=0x7f223c106340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:55:43.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:43.483+0000 7f223bfff700 1 --2- 172.21.15.26:0/1646590561 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f223c0f6860 0x7f223c106340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:43.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:43.483+0000 7f223bfff700 1 -- 172.21.15.26:0/1646590561 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f222c005040 con 0x7f223c0f55c0 2021-11-03T16:55:43.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:43.483+0000 7f223b7fe700 1 --2- 172.21.15.26:0/1646590561 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f223c0f6860 0x7f223c106340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-03T16:55:43.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:43.483+0000 7f223bfff700 1 --2- 172.21.15.26:0/1646590561 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f223c0f55c0 0x7f223c105e50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f223000e7c0 tx=0x7f223000b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:55:43.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:43.483+0000 7f2238ff9700 1 -- 172.21.15.26:0/1646590561 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22300092e0 con 0x7f223c0f55c0 2021-11-03T16:55:43.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:43.483+0000 7f224241c700 1 -- 172.21.15.26:0/1646590561 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f223c1073d0 con 0x7f223c0f55c0 2021-11-03T16:55:43.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:43.483+0000 7f2238ff9700 1 -- 172.21.15.26:0/1646590561 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f223000f040 con 0x7f223c0f55c0 2021-11-03T16:55:43.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:43.483+0000 7f2238ff9700 1 -- 172.21.15.26:0/1646590561 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22300148a0 con 0x7f223c0f55c0 2021-11-03T16:55:43.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:43.483+0000 7f224241c700 1 -- 172.21.15.26:0/1646590561 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f223c107990 con 0x7f223c0f55c0 2021-11-03T16:55:43.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:43.484+0000 7f224241c700 1 -- 172.21.15.26:0/1646590561 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f223c0f49b0 con 0x7f223c0f55c0 2021-11-03T16:55:43.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:43.484+0000 7f2238ff9700 1 -- 172.21.15.26:0/1646590561 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 32) v1 ==== 81997+0+0 (secure 0 0 0) 0x7f2230014ae0 con 0x7f223c0f55c0 2021-11-03T16:55:43.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:43.485+0000 7f2238ff9700 1 --2- 172.21.15.26:0/1646590561 >> [v2:172.21.15.26:6826/818617424,v1:172.21.15.26:6827/818617424] conn(0x7f2224064120 0x7f22240665e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:55:43.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:43.485+0000 7f223b7fe700 1 -- 172.21.15.26:0/1646590561 >> [v2:172.21.15.26:6826/818617424,v1:172.21.15.26:6827/818617424] conn(0x7f2224064120 msgr2=0x7f22240665e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6826/818617424 2021-11-03T16:55:43.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:43.485+0000 7f2238ff9700 1 -- 172.21.15.26:0/1646590561 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f22300807b0 con 0x7f223c0f55c0 2021-11-03T16:55:43.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:43.485+0000 7f223b7fe700 1 --2- 172.21.15.26:0/1646590561 >> [v2:172.21.15.26:6826/818617424,v1:172.21.15.26:6827/818617424] conn(0x7f2224064120 0x7f22240665e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2021-11-03T16:55:43.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:43.489+0000 7f2238ff9700 1 -- 172.21.15.26:0/1646590561 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f2230052d30 con 0x7f223c0f55c0 2021-11-03T16:55:43.665 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:43.670+0000 7f224241c700 1 -- 172.21.15.26:0/1646590561 --> [v2:172.21.15.26:6826/818617424,v1:172.21.15.26:6827/818617424] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f223c0008d0 con 0x7f2224064120 2021-11-03T16:55:43.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:43.686+0000 7f223b7fe700 1 -- 172.21.15.26:0/1646590561 >> [v2:172.21.15.26:6826/818617424,v1:172.21.15.26:6827/818617424] conn(0x7f2224064120 msgr2=0x7f22240665e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6826/818617424 2021-11-03T16:55:43.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:43.686+0000 7f223b7fe700 1 --2- 172.21.15.26:0/1646590561 >> [v2:172.21.15.26:6826/818617424,v1:172.21.15.26:6827/818617424] conn(0x7f2224064120 0x7f22240665e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2021-11-03T16:55:44.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:44.087+0000 7f223b7fe700 1 -- 172.21.15.26:0/1646590561 >> [v2:172.21.15.26:6826/818617424,v1:172.21.15.26:6827/818617424] conn(0x7f2224064120 msgr2=0x7f22240665e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6826/818617424 2021-11-03T16:55:44.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:44.087+0000 7f223b7fe700 1 --2- 172.21.15.26:0/1646590561 >> [v2:172.21.15.26:6826/818617424,v1:172.21.15.26:6827/818617424] conn(0x7f2224064120 0x7f22240665e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2021-11-03T16:55:44.883 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:44.888+0000 7f223b7fe700 1 -- 172.21.15.26:0/1646590561 >> [v2:172.21.15.26:6826/818617424,v1:172.21.15.26:6827/818617424] conn(0x7f2224064120 msgr2=0x7f22240665e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6826/818617424 2021-11-03T16:55:44.883 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:44.888+0000 7f223b7fe700 1 --2- 172.21.15.26:0/1646590561 >> [v2:172.21.15.26:6826/818617424,v1:172.21.15.26:6827/818617424] conn(0x7f2224064120 0x7f22240665e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2021-11-03T16:55:45.943 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:45.948+0000 7f2238ff9700 1 -- 172.21.15.26:0/1646590561 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mgrmap(e 33) v1 ==== 81997+0+0 (secure 0 0 0) 0x7f2230009440 con 0x7f223c0f55c0 2021-11-03T16:55:46.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:45 smithi194 conmon[35111]: cluster 2021-11-03T16:55:45.891096+0000 mon.smithi026 (mon.0) 14 : cluster 2021-11-03T16:55:46.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:45 smithi194 conmon[35111]: [DBG] Standby manager daemon smithi194.wnexas restarted 2021-11-03T16:55:46.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:45 smithi194 conmon[35111]: cluster 2021-11-03T16:55:45.891197+0000 mon.smithi026 (mon.0) 15 : cluster [DBG] Standby manager daemon smithi194.wnexas started 2021-11-03T16:55:46.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:45 smithi194 conmon[35111]: audit 2021-11-03T16:55: 2021-11-03T16:55:46.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:45 smithi194 conmon[35111]: 45.892916+0000 mon.smithi194 (mon.1) 68 : audit [DBG] from='mgr.? 172.21.15.194:0/2478594282' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.wnexas/crt"}]: dispatch 2021-11-03T16:55:46.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:45 smithi194 conmon[35111]: audit 2021-11-03T16:55:46.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:45 smithi194 conmon[35111]: 2021-11-03T16:55:45 2021-11-03T16:55:46.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:45 smithi194 conmon[35111]: .893380+0000 mon.smithi194 (mon.1 2021-11-03T16:55:46.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:45 smithi194 conmon[35111]: ) 69 : audit [DBG] from='mgr.? 172.21.15.194:0/2478594282' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-11-03T16:55:46.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:45 smithi194 conmon[35111]: audit 2021-11-03 2021-11-03T16:55:46.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:45 smithi194 conmon[35111]: T16:55:45.895365+0000 mon.smithi194 ( 2021-11-03T16:55:46.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:45 smithi194 conmon[35111]: mon.1) 70 : audit [DBG] 2021-11-03T16:55:46.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:45 smithi194 conmon[35111]: from='mgr.? 172.21.15.194:0/2478594282' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.wnexas/key"}]: dispatch 2021-11-03T16:55:46.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:45 smithi194 conmon[35111]: audit 2021-11-03T16:55:46.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:45 smithi194 conmon[35111]: 2021-11-03T16:55 2021-11-03T16:55:46.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:45 smithi194 conmon[35111]: :45.896410+0000 mon.smithi194 (mon 2021-11-03T16:55:46.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:45 smithi194 conmon[35111]: .1) 71 : audit [DBG] 2021-11-03T16:55:46.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:45 smithi194 conmon[35111]: from='mgr.? 172.21.15.194:0/2478594282' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-11-03T16:55:46.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:46.489+0000 7f223b7fe700 1 -- 172.21.15.26:0/1646590561 >> [v2:172.21.15.26:6826/818617424,v1:172.21.15.26:6827/818617424] conn(0x7f2224064120 msgr2=0x7f22240665e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6826/818617424 2021-11-03T16:55:46.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:46.489+0000 7f223b7fe700 1 --2- 172.21.15.26:0/1646590561 >> [v2:172.21.15.26:6826/818617424,v1:172.21.15.26:6827/818617424] conn(0x7f2224064120 0x7f22240665e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2021-11-03T16:55:47.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:46 smithi194 conmon[35111]: cluster 2021-11-03T16:55:45.946099+0000 mon.smithi026 (mon.0) 16 : cluster [DBG] mgrmap e33: smithi026.cnrxli(active, since 35s), standbys: smithi194.wnexas 2021-11-03T16:55:47.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:47.962+0000 7f2238ff9700 1 -- 172.21.15.26:0/1646590561 <== mon.1 v2:172.21.15.194:3300/0 8 ==== mgrmap(e 34) v1 ==== 81560+0+0 (secure 0 0 0) 0x7f223007e9c0 con 0x7f223c0f55c0 2021-11-03T16:55:47.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:47.962+0000 7f2238ff9700 1 -- 172.21.15.26:0/1646590561 >> [v2:172.21.15.26:6826/818617424,v1:172.21.15.26:6827/818617424] conn(0x7f2224064120 msgr2=0x7f22240665e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-11-03T16:55:47.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:47.962+0000 7f2238ff9700 1 --2- 172.21.15.26:0/1646590561 >> [v2:172.21.15.26:6826/818617424,v1:172.21.15.26:6827/818617424] conn(0x7f2224064120 0x7f22240665e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T16:55:48.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:47 smithi194 conmon[35111]: cluster 2021-11-03T16:55:47.259823+0000 mon.smithi026 (mon.0) 17 : cluster 2021-11-03T16:55:48.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:47 smithi194 conmon[35111]: [INF] Active manager daemon smithi026.cnrxli restarted 2021-11-03T16:55:48.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:47 smithi194 conmon[35111]: cluster 2021-11-03T16:55:47.260377+0000 mon.smithi026 (mon.0) 18 : cluster [INF] Activating manager daemon smithi026.cnrxli 2021-11-03T16:55:48.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:47 smithi194 conmon[35111]: cluster 2021-11-03T16:55: 2021-11-03T16:55:48.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:47 smithi194 conmon[35111]: 47.263950+0000 mon.smithi026 (mon.0) 19 : cluster [DBG] osdmap e51: 6 total, 6 up, 6 in 2021-11-03T16:55:48.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:47 smithi194 conmon[35111]: cluster 2021-11-03T16:55:48.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:47 smithi194 conmon[35111]: 2021-11-03T16:55:47.930152+0000 mon.smithi026 (mon.0 2021-11-03T16:55:48.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:47 smithi194 conmon[35111]: ) 20 : cluster [INF] daemon mds.cephfs.smithi026.ltacyh restarted 2021-11-03T16:55:48.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:47 smithi194 conmon[35111]: cluster 2021-11-03 2021-11-03T16:55:48.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:47 smithi194 conmon[35111]: T16:55:47.933075+0000 mon.smithi026 (mon. 2021-11-03T16:55:48.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:47 smithi194 conmon[35111]: 0) 21 : cluster [DBG] osdmap e52: 6 total, 6 up, 6 in 2021-11-03T16:55:48.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:55:48 smithi026 conmon[96772]: 2021-11-03T16:55:48.260+0000 7f27986f6700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-03T16:55:48.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:48.975+0000 7f2238ff9700 1 -- 172.21.15.26:0/1646590561 <== mon.1 v2:172.21.15.194:3300/0 9 ==== mgrmap(e 35) v1 ==== 81670+0+0 (secure 0 0 0) 0x7f223004ffa0 con 0x7f223c0f55c0 2021-11-03T16:55:48.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:48.975+0000 7f2238ff9700 1 --2- 172.21.15.26:0/1646590561 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f222406bbe0 0x7f222406dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:55:48.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:48.976+0000 7f2238ff9700 1 -- 172.21.15.26:0/1646590561 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f223c0008d0 con 0x7f222406bbe0 2021-11-03T16:55:48.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:48.976+0000 7f223b7fe700 1 --2- 172.21.15.26:0/1646590561 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f222406bbe0 0x7f222406dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:55:48.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:48.977+0000 7f223b7fe700 1 --2- 172.21.15.26:0/1646590561 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f222406bbe0 0x7f222406dfd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f222c004f00 tx=0x7f222c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:55:48.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:48.979+0000 7f2238ff9700 1 -- 172.21.15.26:0/1646590561 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+257 (secure 0 0 0) 0x7f223c0008d0 con 0x7f222406bbe0 2021-11-03T16:55:48.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:48.981+0000 7f224241c700 1 -- 172.21.15.26:0/1646590561 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f222406bbe0 msgr2=0x7f222406dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:55:48.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:48.981+0000 7f224241c700 1 --2- 172.21.15.26:0/1646590561 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f222406bbe0 0x7f222406dfd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f222c004f00 tx=0x7f222c00b040).stop 2021-11-03T16:55:48.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:48.981+0000 7f224241c700 1 -- 172.21.15.26:0/1646590561 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f223c0f55c0 msgr2=0x7f223c105e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:55:48.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:48.981+0000 7f224241c700 1 --2- 172.21.15.26:0/1646590561 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f223c0f55c0 0x7f223c105e50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f223000e7c0 tx=0x7f223000b040).stop 2021-11-03T16:55:48.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:48.981+0000 7f224241c700 1 -- 172.21.15.26:0/1646590561 shutdown_connections 2021-11-03T16:55:48.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:48.981+0000 7f224241c700 1 --2- 172.21.15.26:0/1646590561 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f222406bbe0 0x7f222406dfd0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:48.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:48.981+0000 7f224241c700 1 --2- 172.21.15.26:0/1646590561 >> [v2:172.21.15.26:6826/818617424,v1:172.21.15.26:6827/818617424] conn(0x7f2224064120 0x7f22240665e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T16:55:48.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:48.981+0000 7f224241c700 1 --2- 172.21.15.26:0/1646590561 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f223c0f55c0 0x7f223c105e50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:48.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:48.981+0000 7f224241c700 1 --2- 172.21.15.26:0/1646590561 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f223c0f6860 0x7f223c106340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:48.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:48.981+0000 7f224241c700 1 -- 172.21.15.26:0/1646590561 >> 172.21.15.26:0/1646590561 conn(0x7f223c0f0d40 msgr2=0x7f223c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:55:48.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:48.981+0000 7f224241c700 1 -- 172.21.15.26:0/1646590561 shutdown_connections 2021-11-03T16:55:48.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:48.981+0000 7f224241c700 1 -- 172.21.15.26:0/1646590561 wait complete. 2021-11-03T16:55:48.986 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T16:55:49.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.086+0000 7f9d2619f700 1 -- 172.21.15.26:0/3661466682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d200f6530 msgr2=0x7f9d200f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:55:49.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.086+0000 7f9d2619f700 1 --2- 172.21.15.26:0/3661466682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d200f6530 0x7f9d200f6950 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f9d1c004660 tx=0x7f9d1c009b30).stop 2021-11-03T16:55:49.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.086+0000 7f9d2619f700 1 -- 172.21.15.26:0/3661466682 shutdown_connections 2021-11-03T16:55:49.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.086+0000 7f9d2619f700 1 --2- 172.21.15.26:0/3661466682 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d200f77d0 0x7f9d200f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:49.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.086+0000 7f9d2619f700 1 --2- 172.21.15.26:0/3661466682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d200f6530 0x7f9d200f6950 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:49.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.086+0000 7f9d2619f700 1 -- 172.21.15.26:0/3661466682 >> 172.21.15.26:0/3661466682 conn(0x7f9d200f1c90 msgr2=0x7f9d200f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:55:49.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.086+0000 7f9d2619f700 1 -- 172.21.15.26:0/3661466682 shutdown_connections 2021-11-03T16:55:49.085 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.086+0000 7f9d2619f700 1 -- 172.21.15.26:0/3661466682 wait complete. 2021-11-03T16:55:49.085 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.087+0000 7f9d2619f700 1 Processor -- start 2021-11-03T16:55:49.085 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.087+0000 7f9d2619f700 1 -- start start 2021-11-03T16:55:49.085 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.087+0000 7f9d2619f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d200f6530 0x7f9d2006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:55:49.085 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.087+0000 7f9d2619f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d200f77d0 0x7f9d20069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:55:49.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.087+0000 7f9d2619f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2006a380 con 0x7f9d200f77d0 2021-11-03T16:55:49.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.087+0000 7f9d2619f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2006a4c0 con 0x7f9d200f6530 2021-11-03T16:55:49.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.087+0000 7f9d2499c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d200f77d0 0x7f9d20069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:55:49.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.087+0000 7f9d2499c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d200f77d0 0x7f9d20069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51080/0 (socket says 172.21.15.26:51080) 2021-11-03T16:55:49.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.087+0000 7f9d2499c700 1 -- 172.21.15.26:0/3537615800 learned_addr learned my addr 172.21.15.26:0/3537615800 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:55:49.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.087+0000 7f9d2519d700 1 --2- 172.21.15.26:0/3537615800 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d200f6530 0x7f9d2006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:55:49.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.087+0000 7f9d2499c700 1 -- 172.21.15.26:0/3537615800 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d200f6530 msgr2=0x7f9d2006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:55:49.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.087+0000 7f9d2499c700 1 --2- 172.21.15.26:0/3537615800 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d200f6530 0x7f9d2006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:49.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.087+0000 7f9d2499c700 1 -- 172.21.15.26:0/3537615800 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d1c005040 con 0x7f9d200f77d0 2021-11-03T16:55:49.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.087+0000 7f9d2499c700 1 --2- 172.21.15.26:0/3537615800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d200f77d0 0x7f9d20069e20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f9d1000e7f0 tx=0x7f9d1000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:55:49.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.088+0000 7f9d15ffb700 1 -- 172.21.15.26:0/3537615800 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d100092e0 con 0x7f9d200f77d0 2021-11-03T16:55:49.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.088+0000 7f9d2619f700 1 -- 172.21.15.26:0/3537615800 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d2006a7a0 con 0x7f9d200f77d0 2021-11-03T16:55:49.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.088+0000 7f9d15ffb700 1 -- 172.21.15.26:0/3537615800 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9d1000f040 con 0x7f9d200f77d0 2021-11-03T16:55:49.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.088+0000 7f9d15ffb700 1 -- 172.21.15.26:0/3537615800 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d10014750 con 0x7f9d200f77d0 2021-11-03T16:55:49.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.088+0000 7f9d2619f700 1 -- 172.21.15.26:0/3537615800 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d2010ed50 con 0x7f9d200f77d0 2021-11-03T16:55:49.090 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.089+0000 7f9d2619f700 1 -- 172.21.15.26:0/3537615800 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d20045ad0 con 0x7f9d200f77d0 2021-11-03T16:55:49.090 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.089+0000 7f9d15ffb700 1 -- 172.21.15.26:0/3537615800 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 35) v1 ==== 81670+0+0 (secure 0 0 0) 0x7f9d1001b030 con 0x7f9d200f77d0 2021-11-03T16:55:49.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.090+0000 7f9d15ffb700 1 --2- 172.21.15.26:0/3537615800 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9d0c063e30 0x7f9d0c0662f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:55:49.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.090+0000 7f9d15ffb700 1 -- 172.21.15.26:0/3537615800 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f9d100802d0 con 0x7f9d200f77d0 2021-11-03T16:55:49.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.090+0000 7f9d2519d700 1 --2- 172.21.15.26:0/3537615800 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9d0c063e30 0x7f9d0c0662f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:55:49.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.090+0000 7f9d2519d700 1 --2- 172.21.15.26:0/3537615800 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9d0c063e30 0x7f9d0c0662f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f9d1c000c00 tx=0x7f9d1c016040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:55:49.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.094+0000 7f9d15ffb700 1 -- 172.21.15.26:0/3537615800 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f9d1004eca0 con 0x7f9d200f77d0 2021-11-03T16:55:49.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:48 smithi194 conmon[35111]: cluster 2021-11-03T16:55:47.958862+0000 mon.smithi026 (mon.0) 22 : cluster [DBG] mgrmap e34: smithi026.cnrxli(active, starting, since 0.698576s), standbys: smithi194.wnexas 2021-11-03T16:55:49.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:48 smithi194 conmon[35111]: audit 2021-11-03T16:55:47.960535+0000 mon.smithi026 (mon.0) 23 : audit [DBG] from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata", "id": "smithi026"}]: dispatch 2021-11-03T16:55:49.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:48 smithi194 conmon[35111]: audit 2021-11-03T16:55:47.960707+0000 mon.smithi026 (mon.0) 24 : audit [DBG] from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2021-11-03T16:55:49.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:48 smithi194 conmon[35111]: audit 2021-11-03T16:55:47.961942+0000 mon.smithi026 (mon.0) 25 : audit [DBG] from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.ltacyh"}]: dispatch 2021-11-03T16:55:49.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:48 smithi194 conmon[35111]: audit 2021-11-03T16:55:47.962178+0000 mon.smithi026 (mon.0) 26 : audit [DBG] from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.yfxlxl"}]: dispatch 2021-11-03T16:55:49.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:48 smithi194 conmon[35111]: audit 2021-11-03T16:55:47.962529+0000 mon.smithi026 (mon.0) 27 : audit [DBG] from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.kwikhp"}]: dispatch 2021-11-03T16:55:49.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:48 smithi194 conmon[35111]: audit 2021-11-03T16:55:47.962858+0000 mon.smithi026 (mon.0) 28 : audit [DBG] from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.mpotdl"}]: dispatch 2021-11-03T16:55:49.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:48 smithi194 conmon[35111]: audit 2021-11-03T16:55:47.963406+0000 mon.smithi026 (mon.0) 29 : audit [DBG] from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mgr metadata", "who": "smithi026.cnrxli", "id": "smithi026.cnrxli"}]: dispatch 2021-11-03T16:55:49.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:48 smithi194 conmon[35111]: audit 2021-11-03T16:55:47.963650+0000 mon.smithi026 (mon.0) 30 : audit [DBG] from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mgr metadata", "who": "smithi194.wnexas", "id": "smithi194.wnexas"}]: dispatch 2021-11-03T16:55:49.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:48 smithi194 conmon[35111]: audit 2021-11-03T16:55:47.963861+0000 mon.smithi026 (mon.0) 31 : audit [DBG] from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-11-03T16:55:49.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:48 smithi194 conmon[35111]: audit 2021-11-03T16:55:47.964089+0000 mon.smithi026 (mon.0) 32 : audit [DBG] from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-11-03T16:55:49.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:48 smithi194 conmon[35111]: audit 2021-11-03T16:55:47.964287+0000 mon.smithi026 (mon.0) 33 : audit [DBG] from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-11-03T16:55:49.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:48 smithi194 conmon[35111]: audit 2021-11-03T16:55:47.964476+0000 mon.smithi026 (mon.0) 34 : audit [DBG] from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-11-03T16:55:49.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:48 smithi194 conmon[35111]: audit 2021-11-03T16:55:47.964740+0000 mon.smithi026 (mon.0) 35 : audit [DBG] from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-11-03T16:55:49.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:48 smithi194 conmon[35111]: audit 2021-11-03T16:55:47.964920+0000 mon.smithi026 (mon.0) 36 : audit [DBG] from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-11-03T16:55:49.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:48 smithi194 conmon[35111]: audit 2021-11-03T16:55:47.965327+0000 mon.smithi026 (mon.0) 37 : audit [DBG] from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-11-03T16:55:49.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:48 smithi194 conmon[35111]: audit 2021-11-03T16:55:47.967690+0000 mon.smithi026 (mon.0) 38 : audit [DBG] from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-11-03T16:55:49.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:48 smithi194 conmon[35111]: audit 2021-11-03T16:55:47.968127+0000 mon.smithi026 (mon.0) 39 : audit [DBG] from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-11-03T16:55:49.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:48 smithi194 conmon[35111]: cluster 2021-11-03T16:55:47.975224+0000 mon.smithi026 (mon.0) 40 : cluster [INF] Manager daemon smithi026.cnrxli is now available 2021-11-03T16:55:49.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:48 smithi194 conmon[35111]: audit 2021-11-03T16:55:47.997126+0000 mon.smithi026 (mon.0) 41 : audit [DBG] from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:55:49.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:48 smithi194 conmon[35111]: audit 2021-11-03T16:55:47.999531+0000 mon.smithi026 (mon.0) 42 : audit [DBG] from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:55:49.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:48 smithi194 conmon[35111]: audit 2021-11-03T16:55:48.029034+0000 mon.smithi026 (mon.0) 43 : audit [INF] from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:55:49.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:48 smithi194 conmon[35111]: audit 2021-11-03T16:55:48.035466+0000 mon.smithi026 (mon.0) 44 : audit [INF] from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T16:55:49.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:48 smithi194 conmon[35111]: audit 2021-11-03T16:55:48.043030+0000 mon.smithi026 (mon.0) 45 : audit [INF] from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T16:55:49.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:48 smithi194 conmon[35111]: cluster 2021-11-03T16:55:48.261299+0000 mon.smithi026 (mon.0) 46 : cluster [WRN] Health check failed: 1 filesystem has a failed mds daemon (FS_WITH_FAILED_MDS) 2021-11-03T16:55:49.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:48 smithi194 conmon[35111]: cluster 2021-11-03T16:55:48.261329+0000 mon.smithi026 (mon.0) 47 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-03T16:55:49.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:48 smithi194 conmon[35111]: cluster 2021-11-03T16:55:48.264479+0000 mon.smithi026 (mon.0) 48 : cluster [DBG] mds.? [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] up:boot 2021-11-03T16:55:49.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:48 smithi194 conmon[35111]: cluster 2021-11-03T16:55:48.264528+0000 mon.smithi026 (mon.0) 49 : cluster [DBG] fsmap cephfs:0/1 4 up:standby, 1 failed 2021-11-03T16:55:49.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:48 smithi194 conmon[35111]: audit 2021-11-03T16:55:48.264678+0000 mon.smithi026 (mon.0) 50 : audit [DBG] from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.ltacyh"}]: dispatch 2021-11-03T16:55:49.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.269+0000 7f9d2619f700 1 -- 172.21.15.26:0/3537615800 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9d200fee00 con 0x7f9d0c063e30 2021-11-03T16:55:49.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.283+0000 7f9d15ffb700 1 -- 172.21.15.26:0/3537615800 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f9d200fee00 con 0x7f9d0c063e30 2021-11-03T16:55:49.279 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T16:55:49.279 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (7m) 27s ago 8m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T16:55:49.280 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (8m) 27s ago 8m 7017k - 16.2.4 8d91d370c2b8 83a448d79108 2021-11-03T16:55:49.280 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (7m) 18s ago 7m 7134k - 16.2.4 8d91d370c2b8 708c0ec0397b 2021-11-03T16:55:49.280 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (6m) 27s ago 7m 38.5M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T16:55:49.280 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (47s) 27s ago 3m 13.4M - 16.2.4 8d91d370c2b8 00b9cec565b4 2021-11-03T16:55:49.281 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 unknown 27s ago 3m - - 2021-11-03T16:55:49.281 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (3m) 18s ago 3m 14.4M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T16:55:49.281 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (3m) 18s ago 3m 15.2M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T16:55:49.281 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (47s) 27s ago 9m 435M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T16:55:49.282 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (23s) 18s ago 7m 49.8M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T16:55:49.282 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 starting - - - 2048M 2021-11-03T16:55:49.282 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (7m) 18s ago 7m 90.8M 2048M 16.2.4 8d91d370c2b8 b688a2953f0a 2021-11-03T16:55:49.282 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (7m) 27s ago 7m 18.1M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T16:55:49.283 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (7m) 18s ago 7m 18.3M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T16:55:49.283 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (6m) 27s ago 6m 402M 4096M 16.2.4 8d91d370c2b8 d7f900ddf0f3 2021-11-03T16:55:49.283 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (6m) 27s ago 6m 403M 4096M 16.2.4 8d91d370c2b8 9e5ffa11984b 2021-11-03T16:55:49.283 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (5m) 27s ago 5m 345M 4096M 16.2.4 8d91d370c2b8 f65145633c0e 2021-11-03T16:55:49.283 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (5m) 18s ago 5m 490M 4096M 16.2.4 8d91d370c2b8 ff6d474a5f9a 2021-11-03T16:55:49.284 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (5m) 18s ago 5m 421M 4096M 16.2.4 8d91d370c2b8 e2fc9c0bdf0f 2021-11-03T16:55:49.284 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (5m) 18s ago 5m 467M 4096M 16.2.4 8d91d370c2b8 0abc64d8a2bf 2021-11-03T16:55:49.284 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (6m) 27s ago 7m 42.7M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T16:55:49.285 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.285+0000 7f9d2619f700 1 -- 172.21.15.26:0/3537615800 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9d0c063e30 msgr2=0x7f9d0c0662f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:55:49.285 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.285+0000 7f9d2619f700 1 --2- 172.21.15.26:0/3537615800 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9d0c063e30 0x7f9d0c0662f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f9d1c000c00 tx=0x7f9d1c016040).stop 2021-11-03T16:55:49.286 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.285+0000 7f9d2619f700 1 -- 172.21.15.26:0/3537615800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d200f77d0 msgr2=0x7f9d20069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:55:49.286 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.285+0000 7f9d2619f700 1 --2- 172.21.15.26:0/3537615800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d200f77d0 0x7f9d20069e20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f9d1000e7f0 tx=0x7f9d1000b040).stop 2021-11-03T16:55:49.286 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.285+0000 7f9d2619f700 1 -- 172.21.15.26:0/3537615800 shutdown_connections 2021-11-03T16:55:49.286 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.285+0000 7f9d2619f700 1 --2- 172.21.15.26:0/3537615800 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9d0c063e30 0x7f9d0c0662f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:49.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.285+0000 7f9d2619f700 1 --2- 172.21.15.26:0/3537615800 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d200f6530 0x7f9d2006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:49.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.285+0000 7f9d2619f700 1 --2- 172.21.15.26:0/3537615800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d200f77d0 0x7f9d20069e20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:49.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.285+0000 7f9d2619f700 1 -- 172.21.15.26:0/3537615800 >> 172.21.15.26:0/3537615800 conn(0x7f9d200f1c90 msgr2=0x7f9d200fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:55:49.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.286+0000 7f9d2619f700 1 -- 172.21.15.26:0/3537615800 shutdown_connections 2021-11-03T16:55:49.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.286+0000 7f9d2619f700 1 -- 172.21.15.26:0/3537615800 wait complete. 2021-11-03T16:55:49.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.384+0000 7f27d49e2700 1 -- 172.21.15.26:0/2577917779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27d006a3b0 msgr2=0x7f27d006a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:55:49.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.384+0000 7f27d49e2700 1 --2- 172.21.15.26:0/2577917779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27d006a3b0 0x7f27d006a830 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f27c4004660 tx=0x7f27c4009b30).stop 2021-11-03T16:55:49.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.385+0000 7f27d49e2700 1 -- 172.21.15.26:0/2577917779 shutdown_connections 2021-11-03T16:55:49.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.385+0000 7f27d49e2700 1 --2- 172.21.15.26:0/2577917779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27d006a3b0 0x7f27d006a830 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:49.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.385+0000 7f27d49e2700 1 --2- 172.21.15.26:0/2577917779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27d006b9c0 0x7f27d0069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:49.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.385+0000 7f27d49e2700 1 -- 172.21.15.26:0/2577917779 >> 172.21.15.26:0/2577917779 conn(0x7f27d00f1e20 msgr2=0x7f27d00f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:55:49.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.385+0000 7f27d49e2700 1 -- 172.21.15.26:0/2577917779 shutdown_connections 2021-11-03T16:55:49.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.385+0000 7f27d49e2700 1 -- 172.21.15.26:0/2577917779 wait complete. 2021-11-03T16:55:49.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.385+0000 7f27d49e2700 1 Processor -- start 2021-11-03T16:55:49.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.385+0000 7f27d49e2700 1 -- start start 2021-11-03T16:55:49.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.385+0000 7f27d49e2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27d006a3b0 0x7f27d010d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:55:49.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.385+0000 7f27d49e2700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27d006b9c0 0x7f27d010d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:55:49.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.385+0000 7f27d49e2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d010df60 con 0x7f27d006a3b0 2021-11-03T16:55:49.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.385+0000 7f27d49e2700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d010e0a0 con 0x7f27d006b9c0 2021-11-03T16:55:49.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.385+0000 7f27ce59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27d006a3b0 0x7f27d010d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:55:49.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.385+0000 7f27ce59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27d006a3b0 0x7f27d010d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51088/0 (socket says 172.21.15.26:51088) 2021-11-03T16:55:49.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.385+0000 7f27ce59c700 1 -- 172.21.15.26:0/4014225020 learned_addr learned my addr 172.21.15.26:0/4014225020 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:55:49.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.386+0000 7f27cdd9b700 1 --2- 172.21.15.26:0/4014225020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27d006b9c0 0x7f27d010d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:55:49.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.386+0000 7f27ce59c700 1 -- 172.21.15.26:0/4014225020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27d006b9c0 msgr2=0x7f27d010d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:55:49.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.386+0000 7f27ce59c700 1 --2- 172.21.15.26:0/4014225020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27d006b9c0 0x7f27d010d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:49.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.386+0000 7f27ce59c700 1 -- 172.21.15.26:0/4014225020 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c4005040 con 0x7f27d006a3b0 2021-11-03T16:55:49.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.386+0000 7f27ce59c700 1 --2- 172.21.15.26:0/4014225020 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27d006a3b0 0x7f27d010d4c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f27c0002700 tx=0x7f27c0009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:55:49.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.386+0000 7f27beffd700 1 -- 172.21.15.26:0/4014225020 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27c0009320 con 0x7f27d006a3b0 2021-11-03T16:55:49.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.386+0000 7f27beffd700 1 -- 172.21.15.26:0/4014225020 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f27c000f040 con 0x7f27d006a3b0 2021-11-03T16:55:49.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.386+0000 7f27beffd700 1 -- 172.21.15.26:0/4014225020 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27c0014870 con 0x7f27d006a3b0 2021-11-03T16:55:49.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.386+0000 7f27d49e2700 1 -- 172.21.15.26:0/4014225020 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d010ea40 con 0x7f27d006a3b0 2021-11-03T16:55:49.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.386+0000 7f27d49e2700 1 -- 172.21.15.26:0/4014225020 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d010efb0 con 0x7f27d006a3b0 2021-11-03T16:55:49.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.387+0000 7f27d49e2700 1 -- 172.21.15.26:0/4014225020 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d0045ad0 con 0x7f27d006a3b0 2021-11-03T16:55:49.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.387+0000 7f27beffd700 1 -- 172.21.15.26:0/4014225020 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 35) v1 ==== 81670+0+0 (secure 0 0 0) 0x7f27c0009480 con 0x7f27d006a3b0 2021-11-03T16:55:49.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.388+0000 7f27beffd700 1 --2- 172.21.15.26:0/4014225020 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f27b8063de0 0x7f27b80662a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:55:49.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.388+0000 7f27beffd700 1 -- 172.21.15.26:0/4014225020 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f27c00806c0 con 0x7f27d006a3b0 2021-11-03T16:55:49.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.388+0000 7f27cdd9b700 1 --2- 172.21.15.26:0/4014225020 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f27b8063de0 0x7f27b80662a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:55:49.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.388+0000 7f27cdd9b700 1 --2- 172.21.15.26:0/4014225020 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f27b8063de0 0x7f27b80662a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f27c4004630 tx=0x7f27c4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:55:49.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.392+0000 7f27beffd700 1 -- 172.21.15.26:0/4014225020 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f27c004f0d0 con 0x7f27d006a3b0 2021-11-03T16:55:49.636 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.641+0000 7f27d49e2700 1 -- 172.21.15.26:0/4014225020 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f27d0105580 con 0x7f27d006a3b0 2021-11-03T16:55:49.637 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.642+0000 7f27beffd700 1 -- 172.21.15.26:0/4014225020 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+794 (secure 0 0 0) 0x7f27c00526f0 con 0x7f27d006a3b0 2021-11-03T16:55:49.637 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T16:55:49.638 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T16:55:49.638 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 1, 2021-11-03T16:55:49.638 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 1 2021-11-03T16:55:49.638 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:55:49.639 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T16:55:49.639 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T16:55:49.639 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:55:49.639 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T16:55:49.640 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2021-11-03T16:55:49.640 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:55:49.640 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T16:55:49.640 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T16:55:49.640 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:55:49.641 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T16:55:49.641 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 11, 2021-11-03T16:55:49.641 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 3 2021-11-03T16:55:49.641 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T16:55:49.642 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T16:55:49.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.644+0000 7f27d49e2700 1 -- 172.21.15.26:0/4014225020 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f27b8063de0 msgr2=0x7f27b80662a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:55:49.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.644+0000 7f27d49e2700 1 --2- 172.21.15.26:0/4014225020 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f27b8063de0 0x7f27b80662a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f27c4004630 tx=0x7f27c4009b30).stop 2021-11-03T16:55:49.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.644+0000 7f27d49e2700 1 -- 172.21.15.26:0/4014225020 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27d006a3b0 msgr2=0x7f27d010d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:55:49.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.644+0000 7f27d49e2700 1 --2- 172.21.15.26:0/4014225020 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27d006a3b0 0x7f27d010d4c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f27c0002700 tx=0x7f27c0009e00).stop 2021-11-03T16:55:49.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.644+0000 7f27d49e2700 1 -- 172.21.15.26:0/4014225020 shutdown_connections 2021-11-03T16:55:49.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.644+0000 7f27d49e2700 1 --2- 172.21.15.26:0/4014225020 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f27b8063de0 0x7f27b80662a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:49.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.644+0000 7f27d49e2700 1 --2- 172.21.15.26:0/4014225020 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27d006a3b0 0x7f27d010d4c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:49.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.644+0000 7f27d49e2700 1 --2- 172.21.15.26:0/4014225020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27d006b9c0 0x7f27d010d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:49.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.644+0000 7f27d49e2700 1 -- 172.21.15.26:0/4014225020 >> 172.21.15.26:0/4014225020 conn(0x7f27d00f1e20 msgr2=0x7f27d00f88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:55:49.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.644+0000 7f27d49e2700 1 -- 172.21.15.26:0/4014225020 shutdown_connections 2021-11-03T16:55:49.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.644+0000 7f27d49e2700 1 -- 172.21.15.26:0/4014225020 wait complete. 2021-11-03T16:55:49.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.755+0000 7fad20014700 1 -- 172.21.15.26:0/1616114268 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad1806b9c0 msgr2=0x7fad18069ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:55:49.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.755+0000 7fad20014700 1 --2- 172.21.15.26:0/1616114268 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad1806b9c0 0x7fad18069ec0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fad14004660 tx=0x7fad14009b30).stop 2021-11-03T16:55:49.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.755+0000 7fad20014700 1 -- 172.21.15.26:0/1616114268 shutdown_connections 2021-11-03T16:55:49.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.755+0000 7fad20014700 1 --2- 172.21.15.26:0/1616114268 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad1806a3b0 0x7fad1806a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:49.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.755+0000 7fad20014700 1 --2- 172.21.15.26:0/1616114268 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad1806b9c0 0x7fad18069ec0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:49.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.755+0000 7fad20014700 1 -- 172.21.15.26:0/1616114268 >> 172.21.15.26:0/1616114268 conn(0x7fad180f1e40 msgr2=0x7fad180f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:55:49.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.755+0000 7fad20014700 1 -- 172.21.15.26:0/1616114268 shutdown_connections 2021-11-03T16:55:49.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.755+0000 7fad20014700 1 -- 172.21.15.26:0/1616114268 wait complete. 2021-11-03T16:55:49.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.755+0000 7fad20014700 1 Processor -- start 2021-11-03T16:55:49.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.755+0000 7fad20014700 1 -- start start 2021-11-03T16:55:49.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.756+0000 7fad20014700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad1806a3b0 0x7fad18109100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:55:49.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.756+0000 7fad20014700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad1806b9c0 0x7fad181095f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:55:49.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.756+0000 7fad20014700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad18109ba0 con 0x7fad1806b9c0 2021-11-03T16:55:49.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.756+0000 7fad20014700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad18109ce0 con 0x7fad1806a3b0 2021-11-03T16:55:49.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.756+0000 7fad1d5af700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad1806b9c0 0x7fad181095f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:55:49.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.756+0000 7fad1ddb0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad1806a3b0 0x7fad18109100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-03T16:55:49.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.756+0000 7fad1d5af700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad1806b9c0 0x7fad181095f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51100/0 (socket says 172.21.15.26:51100) 2021-11-03T16:55:49.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.756+0000 7fad1d5af700 1 -- 172.21.15.26:0/3955773212 learned_addr learned my addr 172.21.15.26:0/3955773212 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:55:49.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.756+0000 7fad1d5af700 1 -- 172.21.15.26:0/3955773212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad1806a3b0 msgr2=0x7fad18109100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:55:49.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.756+0000 7fad1d5af700 1 --2- 172.21.15.26:0/3955773212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad1806a3b0 0x7fad18109100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:49.757 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.756+0000 7fad1d5af700 1 -- 172.21.15.26:0/3955773212 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad14005040 con 0x7fad1806b9c0 2021-11-03T16:55:49.757 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.756+0000 7fad1d5af700 1 --2- 172.21.15.26:0/3955773212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad1806b9c0 0x7fad181095f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fad0c002700 tx=0x7fad0c009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:55:49.757 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.756+0000 7fad0a7fc700 1 -- 172.21.15.26:0/3955773212 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad0c009320 con 0x7fad1806b9c0 2021-11-03T16:55:49.757 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.756+0000 7fad0a7fc700 1 -- 172.21.15.26:0/3955773212 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fad0c00f040 con 0x7fad1806b9c0 2021-11-03T16:55:49.758 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.756+0000 7fad20014700 1 -- 172.21.15.26:0/3955773212 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad1810a680 con 0x7fad1806b9c0 2021-11-03T16:55:49.758 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.756+0000 7fad0a7fc700 1 -- 172.21.15.26:0/3955773212 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad0c014870 con 0x7fad1806b9c0 2021-11-03T16:55:49.758 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.756+0000 7fad20014700 1 -- 172.21.15.26:0/3955773212 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad1810ac40 con 0x7fad1806b9c0 2021-11-03T16:55:49.759 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.757+0000 7fad20014700 1 -- 172.21.15.26:0/3955773212 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad18045ad0 con 0x7fad1806b9c0 2021-11-03T16:55:49.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.758+0000 7fad0a7fc700 1 -- 172.21.15.26:0/3955773212 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 35) v1 ==== 81670+0+0 (secure 0 0 0) 0x7fad0c009480 con 0x7fad1806b9c0 2021-11-03T16:55:49.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.758+0000 7fad0a7fc700 1 --2- 172.21.15.26:0/3955773212 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fad04063de0 0x7fad040662a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:55:49.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.758+0000 7fad0a7fc700 1 -- 172.21.15.26:0/3955773212 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fad0c0806c0 con 0x7fad1806b9c0 2021-11-03T16:55:49.761 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.758+0000 7fad1ddb0700 1 --2- 172.21.15.26:0/3955773212 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fad04063de0 0x7fad040662a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:55:49.761 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.759+0000 7fad1ddb0700 1 --2- 172.21.15.26:0/3955773212 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fad04063de0 0x7fad040662a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fad14004630 tx=0x7fad14009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:55:49.761 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.762+0000 7fad0a7fc700 1 -- 172.21.15.26:0/3955773212 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fad0c04f0d0 con 0x7fad1806b9c0 2021-11-03T16:55:49.963 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.968+0000 7fad20014700 1 -- 172.21.15.26:0/3955773212 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fad18027a00 con 0x7fad1806b9c0 2021-11-03T16:55:49.964 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.968+0000 7fad0a7fc700 1 -- 172.21.15.26:0/3955773212 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fad0c0526f0 con 0x7fad1806b9c0 2021-11-03T16:55:49.964 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T16:55:49.964 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T16:55:49.965 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T16:55:49.965 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T16:55:49.965 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:55:49.965 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T16:55:49.966 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T16:55:49.966 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T16:55:49.966 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T16:55:49.966 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T16:55:49.967 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T16:55:49.967 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T16:55:49.967 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T16:55:49.967 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T16:55:49.968 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T16:55:49.968 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T16:55:49.968 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T16:55:49.968 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T16:55:49.968 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T16:55:49.969 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T16:55:49.969 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T16:55:49.969 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T16:55:49.969 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T16:55:49.970 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T16:55:49.970 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T16:55:49.970 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T16:55:49.970 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T16:55:49.971 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T16:55:49.971 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T16:55:49.971 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T16:55:49.971 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T16:55:49.971 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:55:49.972 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:55:49.972 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T16:55:49.972 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:55:49.973 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T16:55:49.973 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T16:55:49.973 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T16:55:49.973 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T16:55:49.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.970+0000 7fad20014700 1 -- 172.21.15.26:0/3955773212 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fad04063de0 msgr2=0x7fad040662a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:55:49.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.970+0000 7fad20014700 1 --2- 172.21.15.26:0/3955773212 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fad04063de0 0x7fad040662a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fad14004630 tx=0x7fad14009b30).stop 2021-11-03T16:55:49.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.970+0000 7fad20014700 1 -- 172.21.15.26:0/3955773212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad1806b9c0 msgr2=0x7fad181095f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:55:49.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.970+0000 7fad20014700 1 --2- 172.21.15.26:0/3955773212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad1806b9c0 0x7fad181095f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fad0c002700 tx=0x7fad0c009e00).stop 2021-11-03T16:55:49.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.970+0000 7fad20014700 1 -- 172.21.15.26:0/3955773212 shutdown_connections 2021-11-03T16:55:49.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.970+0000 7fad20014700 1 --2- 172.21.15.26:0/3955773212 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fad04063de0 0x7fad040662a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:49.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.970+0000 7fad20014700 1 --2- 172.21.15.26:0/3955773212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad1806a3b0 0x7fad18109100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:49.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.970+0000 7fad20014700 1 --2- 172.21.15.26:0/3955773212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad1806b9c0 0x7fad181095f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:55:49.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.971+0000 7fad20014700 1 -- 172.21.15.26:0/3955773212 >> 172.21.15.26:0/3955773212 conn(0x7fad180f1e40 msgr2=0x7fad180fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:55:49.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.971+0000 7fad20014700 1 -- 172.21.15.26:0/3955773212 shutdown_connections 2021-11-03T16:55:49.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:55:49.971+0000 7fad20014700 1 -- 172.21.15.26:0/3955773212 wait complete. 2021-11-03T16:55:49.977 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T16:55:50.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:49 smithi194 conmon[35111]: cephadm 2021-11-03T16:55:48.265991+0000 mgr.smithi026.cnrxli (mgr.34104) 1 : cephadm [WRN] Executing result=None created at /lib/python3.6/site-packages/asyncssh/connection.py:841> took 0.101 seconds 2021-11-03T16:55:50.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:49 smithi194 conmon[35111]: cephadm 2021-11-03T16:55:48. 2021-11-03T16:55:50.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:49 smithi194 conmon[35111]: 900440+0000 mgr.smithi026.cnrxli (mgr.34104) 2 : cephadm [INF] Starting cherrypy engine... 2021-11-03T16:55:50.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:49 smithi194 conmon[35111]: cephadm 2021-11-03T16:55:48.901054+0000 mgr.smithi026.cnrxli (mgr.34104) 3 : cephadm [INF] [03/Nov/2021:16:55:48] ENGINE Bus STARTING 2021-11-03T16:55:50.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:49 smithi194 conmon[35111]: cluster 2021-11-03T16:55:48.972697+0000 mon.smithi026 (mon.0) 51 : cluster [DBG] mgrmap e35: smithi026.cnrxli(active, since 1.71241s), standbys: smithi194.wnexas 2021-11-03T16:55:50.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:49 smithi194 conmon[35111]: audit 2021-11-03T16:55:48.978934+0000 mgr.smithi026.cnrxli (mgr.34104) 4 : audit [DBG] from='client.24471 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:55:50.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:49 smithi194 conmon[35111]: cluster 2021-11-03T16:55:48.980683+0000 mgr.smithi026.cnrxli (mgr.34104) 5 : cluster [DBG] pgmap v3: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:55:50.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:49 smithi194 conmon[35111]: cephadm 2021-11-03T16:55:49.018995+0000 mgr.smithi026.cnrxli (mgr.34104) 6 : cephadm [INF] [03/Nov/2021:16:55:49] ENGINE Serving on https://172.21.15.26:8499 2021-11-03T16:55:50.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:49 smithi194 conmon[35111]: cephadm 2021-11-03T16:55:49.019264+0000 mgr.smithi026.cnrxli (mgr.34104) 7 : cephadm [INF] [03/Nov/2021:16:55:49] ENGINE Bus STARTED 2021-11-03T16:55:50.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:49 smithi194 conmon[35111]: cephadm 2021-11-03T16:55:49.019394+0000 mgr.smithi026.cnrxli (mgr.34104) 8 : cephadm [INF] Cherrypy engine started. 2021-11-03T16:55:50.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:49 smithi194 conmon[35111]: audit 2021-11-03T16:55:49.642497+0000 mon.smithi026 (mon.0) 52 : audit [DBG] from='client.? 172.21.15.26:0/4014225020' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:55:51.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:50 smithi194 conmon[35111]: audit 2021-11-03T16:55:49.270830+0000 mgr.smithi026.cnrxli (mgr.34104) 9 : audit [DBG] from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:55:51.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:50 smithi194 conmon[35111]: cluster 2021-11-03T16:55:49.965328+0000 mgr.smithi026.cnrxli (mgr.34104) 10 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:55:51.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:50 smithi194 conmon[35111]: cluster 2021-11 2021-11-03T16:55:51.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:50 smithi194 conmon[35111]: -03T16:55:49.968286+0000 mon.smithi026 (mon.0) 53 : cluster [INF] 2021-11-03T16:55:51.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:50 smithi194 conmon[35111]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2021-11-03T16:55:51.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:50 smithi194 conmon[35111]: audit 2021 2021-11-03T16:55:51.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:50 smithi194 conmon[35111]: -11-03T16:55:49.969193+0000 mon.smithi026 (mon. 2021-11-03T16:55:51.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:50 smithi194 conmon[35111]: 0) 54 : audit [DBG] from='client.? 172.21.15.26:0/3955773212' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T16:55:51.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:50 smithi194 conmon[35111]: cluster 2021- 2021-11-03T16:55:51.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:50 smithi194 conmon[35111]: 11-03T16:55:49.981037+0000 2021-11-03T16:55:51.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:50 smithi194 conmon[35111]: mon.smithi026 (mon.0) 55 : cluster [DBG] 2021-11-03T16:55:51.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:50 smithi194 conmon[35111]: mgrmap e36: smithi026.cnrxli(active, since 2s), standbys: smithi194.wnexas 2021-11-03T16:55:53.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:52 smithi194 conmon[35111]: cephadm 2021-11-03T16:55:51.876675+0000 mgr.smithi026.cnrxli (mgr.34104) 11 : cephadm [INF] poll took 3381.398 ms: 1 events 2021-11-03T16:55:53.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:52 smithi194 conmon[35111]: audit 2021-11-03T16:55:51.902950+0000 mon.smithi026 (mon.0) 56 : audit [INF] from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:55:53.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:52 smithi194 conmon[35111]: cluster 2021-11-03T16:55:51.965988+0000 mgr.smithi026.cnrxli (mgr.34104) 12 : cluster [DBG] pgmap v5: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:55:53.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:52 smithi194 conmon[35111]: audit 2021-11-03T16:55:52.499766+0000 mon.smithi026 (mon.0) 57 : audit [INF] from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:55:53.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:52 smithi194 conmon[35111]: audit 2021-11-03T16:55:52.501043+0000 mon.smithi026 (mon.0) 58 : audit [INF] from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2021-11-03T16:55:54.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:54 smithi194 conmon[35111]: cluster 2021-11-03T16:55:53.966371+0000 mgr.smithi026.cnrxli (mgr.34104) 13 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:55:54.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:54 smithi194 conmon[35111]: audit 2021-11-03T16:55:54.470944+0000 mon.smithi026 2021-11-03T16:55:54.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:54 smithi194 conmon[35111]: (mon.0) 59 : audit [INF] from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:55:56.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:56 smithi194 conmon[35111]: cephadm 2021-11-03T16:55:54.440210+0000 mgr.smithi026.cnrxli (mgr.34104) 14 : cephadm [INF] poll took 1945.219 ms: 1 events 2021-11-03T16:55:56.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:56 smithi194 conmon[35111]: audit 2021-11-03T16:55:55.111667+0000 mon.smithi026 (mon.0) 60 : audit [INF] from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:55:56.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:56 smithi194 conmon[35111]: audit 2021-11-03T16:55:55.112799+0000 mon.smithi026 (mon.0) 61 : audit [INF] from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi026", "name": "osd_memory_target"}]: dispatch 2021-11-03T16:55:56.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:56 smithi194 conmon[35111]: audit 2021-11-03T16:55:55.116285+0000 mon.smithi026 (mon.0) 62 : audit [INF] from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:55:56.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:56 smithi194 conmon[35111]: audit 2021-11-03T16:55:55.121545+0000 mon.smithi026 (mon.0) 63 : audit [DBG] from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:55:56.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:56 smithi194 conmon[35111]: audit 2021-11-03T16:55:55.122717+0000 mon.smithi026 (mon.0) 64 : audit [DBG] from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:55:56.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:56 smithi194 conmon[35111]: audit 2021-11-03T16:55:55.123583+0000 mon.smithi026 (mon.0) 65 : audit [DBG] from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "quorum_status"}]: dispatch 2021-11-03T16:55:57.471 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:57 smithi194 conmon[35111]: cluster 2021-11-03T16:55:55.967044+0000 mgr.smithi026.cnrxli (mgr.34104) 15 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:55:57.472 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:57 smithi194 conmon[35111]: audit 2021-11-03T16:55:56.680287+0000 mon.smithi026 (mon.0) 66 : audit [INF] from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:55:57.472 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:57 smithi194 conmon[35111]: audit 2021-11-03T16:55:56.681338+0000 mon.smithi026 (mon.0) 67 : audit [INF] from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-11-03T16:55:57.472 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:57 smithi194 conmon[35111]: audit 2021-11-03T16:55:56.682225+0000 mon.smithi026 (mon.0) 68 : audit [DBG] from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-11-03T16:55:57.473 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:57 smithi194 conmon[35111]: audit 2021-11-03T16:55:56.683144+0000 mon.smithi026 (mon.0) 69 : audit [DBG] from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:55:58.388 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:58 smithi194 systemd[1]: Stopping Ceph mon.smithi194 for 70492bc6-3cc5-11ec-8c28-001a4aab830c... 2021-11-03T16:55:58.388 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:58 smithi194 conmon[35111]: cephadm 2021-11-03T16:55:56.651613+0000 mgr.smithi026.cnrxli (mgr.34104) 16 : cephadm [INF] poll took 1490.483 ms: 1 events 2021-11-03T16:55:58.388 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:58 smithi194 conmon[35111]: cephadm 2021-11-03T16:55:56.675554+0000 mgr.smithi026.cnrxli (mgr.34104) 17 : cephadm [INF] Upgrade: Updating mon.smithi194 2021-11-03T16:55:58.389 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:58 smithi194 conmon[35111]: cephadm 2021-11-03T16:55:56.684121+0000 mgr.smithi026.cnrxli (mgr.34104) 18 : cephadm [INF] Deploying daemon mon.smithi194 on smithi194 2021-11-03T16:55:58.389 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:58 smithi194 conmon[35111]: debug 2021-11-03T16:55:58.213+0000 7f1a0c3e1700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.smithi194 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2021-11-03T16:55:58.389 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:58 smithi194 conmon[35111]: debug 2021-11-03T16:55:58.213+0000 7f1a0c3e1700 -1 mon.smithi194@1(peon) e2 *** Got Signal Terminated *** 2021-11-03T16:55:58.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:58 smithi194 bash[65198]: b688a2953f0a143c68c82e78a809f45ea6c8e4a1fedc4b9ac01ea1e0e6b701a7 2021-11-03T16:55:58.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:58 smithi194 bash[65198]: Error: no container with name or ID ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c-mon-smithi194 found: no such container 2021-11-03T16:55:59.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:58 smithi194 bash[65198]: Error: container b688a2953f0a143c68c82e78a809f45ea6c8e4a1fedc4b9ac01ea1e0e6b701a7 does not exist in database: no such container 2021-11-03T16:55:59.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:58 smithi194 systemd[1]: ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c@mon.smithi194.service: Succeeded. 2021-11-03T16:55:59.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:58 smithi194 systemd[1]: Stopped Ceph mon.smithi194 for 70492bc6-3cc5-11ec-8c28-001a4aab830c. 2021-11-03T16:55:59.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 systemd[1]: Starting Ceph mon.smithi194 for 70492bc6-3cc5-11ec-8c28-001a4aab830c... 2021-11-03T16:55:59.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: set uid:gid to 167:167 (ceph:ceph) 2021-11-03T16:55:59.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev), process ceph-mon, pid 7 2021-11-03T16:55:59.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: pidfile_write: ignore empty --pid-file 2021-11-03T16:55:59.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: load: jerasure load: lrc 2021-11-03T16:55:59.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: RocksDB version: 6.15.5 2021-11-03T16:55:59.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-11-03T16:55:59.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Compile date Nov 3 2021 2021-11-03T16:55:59.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: DB SUMMARY 2021-11-03T16:55:59.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: DB Session ID: 6SDC8C8LRNFQ3GSJFJ2Y 2021-11-03T16:55:59.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: CURRENT file: CURRENT 2021-11-03T16:55:59.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: IDENTITY file: IDENTITY 2021-11-03T16:55:59.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: MANIFEST file: MANIFEST-000005 size: 503 Bytes 2021-11-03T16:55:59.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi194/store.db dir, Total Num: 1, files: 000014.sst 2021-11-03T16:55:59.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi194/store.db: 000012.log size: 1976882 ; 2021-11-03T16:55:59.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.error_if_exists: 0 2021-11-03T16:55:59.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.create_if_missing: 0 2021-11-03T16:55:59.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.paranoid_checks: 1 2021-11-03T16:55:59.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2021-11-03T16:55:59.754 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.env: 0x557df77b5c00 2021-11-03T16:55:59.755 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.fs: Posix File System 2021-11-03T16:55:59.755 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.info_log: 0x557df8194460 2021-11-03T16:55:59.755 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.max_file_opening_threads: 16 2021-11-03T16:55:59.755 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.statistics: (nil) 2021-11-03T16:55:59.756 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.use_fsync: 0 2021-11-03T16:55:59.756 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.max_log_file_size: 0 2021-11-03T16:55:59.756 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.max_manifest_file_size: 1073741824 2021-11-03T16:55:59.756 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.log_file_time_to_roll: 0 2021-11-03T16:55:59.757 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.keep_log_file_num: 1000 2021-11-03T16:55:59.757 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.recycle_log_file_num: 0 2021-11-03T16:55:59.757 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.allow_fallocate: 1 2021-11-03T16:55:59.757 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.allow_mmap_reads: 0 2021-11-03T16:55:59.758 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.allow_mmap_writes: 0 2021-11-03T16:55:59.758 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.use_direct_reads: 0 2021-11-03T16:55:59.758 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-11-03T16:55:59.759 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.create_missing_column_families: 0 2021-11-03T16:55:59.759 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.db_log_dir: 2021-11-03T16:55:59.759 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi194/store.db 2021-11-03T16:55:59.759 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.table_cache_numshardbits: 6 2021-11-03T16:55:59.760 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.WAL_ttl_seconds: 0 2021-11-03T16:55:59.760 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.WAL_size_limit_MB: 0 2021-11-03T16:55:59.760 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-11-03T16:55:59.760 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.manifest_preallocation_size: 4194304 2021-11-03T16:55:59.761 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.is_fd_close_on_exec: 1 2021-11-03T16:55:59.761 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.advise_random_on_open: 1 2021-11-03T16:55:59.761 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.db_write_buffer_size: 0 2021-11-03T16:55:59.761 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.write_buffer_manager: 0x557df8209f20 2021-11-03T16:55:59.761 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.access_hint_on_compaction_start: 1 2021-11-03T16:55:59.762 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-11-03T16:55:59.762 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.random_access_max_buffer_size: 1048576 2021-11-03T16:55:59.762 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.use_adaptive_mutex: 0 2021-11-03T16:55:59.762 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.rate_limiter: (nil) 2021-11-03T16:55:59.763 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-11-03T16:55:59.763 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 bash[65406]: 5493b248c16b817665bcb7517ac0d1a3a60dc7a086395f5efa2522e7676ff58d 2021-11-03T16:55:59.763 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.wal_recovery_mode: 2 2021-11-03T16:55:59.763 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.enable_thread_tracking: 0 2021-11-03T16:55:59.764 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.enable_pipelined_write: 0 2021-11-03T16:55:59.764 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.unordered_write: 0 2021-11-03T16:55:59.764 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.allow_concurrent_memtable_write: 1 2021-11-03T16:55:59.764 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-11-03T16:55:59.765 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.write_thread_max_yield_usec: 100 2021-11-03T16:55:59.765 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.write_thread_slow_yield_usec: 3 2021-11-03T16:55:59.765 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.row_cache: None 2021-11-03T16:55:59.765 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.wal_filter: None 2021-11-03T16:55:59.765 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.avoid_flush_during_recovery: 0 2021-11-03T16:55:59.766 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.allow_ingest_behind: 0 2021-11-03T16:55:59.766 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.preserve_deletes: 0 2021-11-03T16:55:59.766 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.two_write_queues: 0 2021-11-03T16:55:59.766 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.manual_wal_flush: 0 2021-11-03T16:55:59.767 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.atomic_flush: 0 2021-11-03T16:55:59.767 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-11-03T16:55:59.767 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.persist_stats_to_disk: 0 2021-11-03T16:55:59.767 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.write_dbid_to_manifest: 0 2021-11-03T16:55:59.768 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.log_readahead_size: 0 2021-11-03T16:55:59.768 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.file_checksum_gen_factory: Unknown 2021-11-03T16:55:59.768 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.best_efforts_recovery: 0 2021-11-03T16:55:59.768 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2021-11-03T16:55:59.769 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2021-11-03T16:55:59.769 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.allow_data_in_errors: 0 2021-11-03T16:55:59.769 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.db_host_id: __hostname__ 2021-11-03T16:55:59.769 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.max_background_jobs: 2 2021-11-03T16:55:59.770 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.max_background_compactions: -1 2021-11-03T16:55:59.770 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.max_subcompactions: 1 2021-11-03T16:55:59.770 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.avoid_flush_during_shutdown: 0 2021-11-03T16:55:59.770 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-11-03T16:55:59.771 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.delayed_write_rate : 16777216 2021-11-03T16:55:59.771 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.max_total_wal_size: 0 2021-11-03T16:55:59.771 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-11-03T16:55:59.771 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.stats_dump_period_sec: 600 2021-11-03T16:55:59.772 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.stats_persist_period_sec: 600 2021-11-03T16:55:59.772 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.stats_history_buffer_size: 1048576 2021-11-03T16:55:59.772 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.max_open_files: -1 2021-11-03T16:55:59.772 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.bytes_per_sync: 0 2021-11-03T16:55:59.773 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.wal_bytes_per_sync: 0 2021-11-03T16:55:59.773 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.strict_bytes_per_sync: 0 2021-11-03T16:55:59.773 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.compaction_readahead_size: 0 2021-11-03T16:55:59.773 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.max_background_flushes: -1 2021-11-03T16:55:59.773 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Compression algorithms supported: 2021-11-03T16:55:59.774 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: kZSTDNotFinalCompression supported: 0 2021-11-03T16:55:59.774 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: kZSTD supported: 0 2021-11-03T16:55:59.774 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: kXpressCompression supported: 0 2021-11-03T16:55:59.774 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: kLZ4HCCompression supported: 1 2021-11-03T16:55:59.775 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: kLZ4Compression supported: 1 2021-11-03T16:55:59.775 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: kBZip2Compression supported: 0 2021-11-03T16:55:59.775 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: kZlibCompression supported: 1 2021-11-03T16:55:59.775 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: kSnappyCompression supported: 1 2021-11-03T16:55:59.776 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Fast CRC32 supported: Supported on x86 2021-11-03T16:55:59.776 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: [db/version_set.cc:4725] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi194/store.db/MANIFEST-000005 2021-11-03T16:55:59.776 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: [db/column_family.cc:597] --------------- Options for column family [default]: 2021-11-03T16:55:59.776 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-11-03T16:55:59.777 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.merge_operator: 2021-11-03T16:55:59.777 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.compaction_filter: None 2021-11-03T16:55:59.777 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.compaction_filter_factory: None 2021-11-03T16:55:59.777 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.sst_partitioner_factory: None 2021-11-03T16:55:59.777 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.memtable_factory: SkipListFactory 2021-11-03T16:55:59.778 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.table_factory: BlockBasedTable 2021-11-03T16:55:59.778 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x557df815dbc0) 2021-11-03T16:55:59.778 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: cache_index_and_filter_blocks: 1 2021-11-03T16:55:59.778 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2021-11-03T16:55:59.779 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2021-11-03T16:55:59.779 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: pin_top_level_index_and_filter: 1 2021-11-03T16:55:59.779 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: index_type: 0 2021-11-03T16:55:59.779 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: data_block_index_type: 0 2021-11-03T16:55:59.780 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: index_shortening: 1 2021-11-03T16:55:59.780 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: data_block_hash_table_util_ratio: 0.750000 2021-11-03T16:55:59.780 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: hash_index_allow_collision: 1 2021-11-03T16:55:59.780 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: checksum: 1 2021-11-03T16:55:59.781 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: no_block_cache: 0 2021-11-03T16:55:59.781 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: block_cache: 0x557df8192d10 2021-11-03T16:55:59.781 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: block_cache_name: BinnedLRUCache 2021-11-03T16:55:59.781 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: block_cache_options: 2021-11-03T16:55:59.782 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: capacity : 536870912 2021-11-03T16:55:59.782 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: num_shard_bits : 4 2021-11-03T16:55:59.782 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: strict_capacity_limit : 0 2021-11-03T16:55:59.782 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: high_pri_pool_ratio: 0.000 2021-11-03T16:55:59.783 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: block_cache_compressed: (nil) 2021-11-03T16:55:59.783 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: persistent_cache: (nil) 2021-11-03T16:55:59.783 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: block_size: 4096 2021-11-03T16:55:59.783 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: block_size_deviation: 10 2021-11-03T16:55:59.784 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: block_restart_interval: 16 2021-11-03T16:55:59.784 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: index_block_restart_interval: 1 2021-11-03T16:55:59.784 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: metadata_block_size: 4096 2021-11-03T16:55:59.784 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: partition_filters: 0 2021-11-03T16:55:59.784 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: use_delta_encoding: 1 2021-11-03T16:55:59.785 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2021-11-03T16:55:59.785 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: whole_key_filtering: 1 2021-11-03T16:55:59.785 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: verify_compression: 0 2021-11-03T16:55:59.785 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: read_amp_bytes_per_bit: 0 2021-11-03T16:55:59.786 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: format_version: 4 2021-11-03T16:55:59.786 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: enable_index_compression: 1 2021-11-03T16:55:59.786 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: block_align: 0 2021-11-03T16:55:59.786 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.write_buffer_size: 33554432 2021-11-03T16:55:59.787 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.max_write_buffer_number: 2 2021-11-03T16:55:59.787 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.compression: NoCompression 2021-11-03T16:55:59.787 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.bottommost_compression: Disabled 2021-11-03T16:55:59.788 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.prefix_extractor: nullptr 2021-11-03T16:55:59.788 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-11-03T16:55:59.788 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.num_levels: 7 2021-11-03T16:55:59.788 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-11-03T16:55:59.789 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-11-03T16:55:59.789 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-11-03T16:55:59.789 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-11-03T16:55:59.789 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.bottommost_compression_opts.level: 32767 2021-11-03T16:55:59.790 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-11-03T16:55:59.790 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-11-03T16:55:59.790 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-11-03T16:55:59.790 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2021-11-03T16:55:59.791 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.bottommost_compression_opts.enabled: false 2021-11-03T16:55:59.791 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.compression_opts.window_bits: -14 2021-11-03T16:55:59.791 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.compression_opts.level: 32767 2021-11-03T16:55:59.791 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.compression_opts.strategy: 0 2021-11-03T16:55:59.792 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-11-03T16:55:59.792 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-11-03T16:55:59.792 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.compression_opts.parallel_threads: 1 2021-11-03T16:55:59.792 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.compression_opts.enabled: false 2021-11-03T16:55:59.793 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-11-03T16:55:59.793 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-11-03T16:55:59.793 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.level0_stop_writes_trigger: 36 2021-11-03T16:55:59.793 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.target_file_size_base: 67108864 2021-11-03T16:55:59.794 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.target_file_size_multiplier: 1 2021-11-03T16:55:59.794 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.max_bytes_for_level_base: 268435456 2021-11-03T16:55:59.794 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-11-03T16:55:59.794 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-11-03T16:55:59.795 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-11-03T16:55:59.795 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-11-03T16:55:59.795 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-11-03T16:55:59.795 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-11-03T16:55:59.796 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-11-03T16:55:59.796 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-11-03T16:55:59.796 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-11-03T16:55:59.796 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-11-03T16:55:59.797 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.max_compaction_bytes: 1677721600 2021-11-03T16:55:59.797 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.arena_block_size: 4194304 2021-11-03T16:55:59.797 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-11-03T16:55:59.797 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-11-03T16:55:59.798 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-11-03T16:55:59.798 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.disable_auto_compactions: 0 2021-11-03T16:55:59.798 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-11-03T16:55:59.798 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-11-03T16:55:59.799 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-11-03T16:55:59.799 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-11-03T16:55:59.799 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-11-03T16:55:59.799 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-11-03T16:55:59.800 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-11-03T16:55:59.800 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-11-03T16:55:59.800 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-11-03T16:55:59.800 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-11-03T16:55:59.801 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.table_properties_collectors: 2021-11-03T16:55:59.801 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.inplace_update_support: 0 2021-11-03T16:55:59.801 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.inplace_update_num_locks: 10000 2021-11-03T16:55:59.801 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-11-03T16:55:59.802 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.memtable_whole_key_filtering: 0 2021-11-03T16:55:59.802 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.memtable_huge_page_size: 0 2021-11-03T16:55:59.802 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.bloom_locality: 0 2021-11-03T16:55:59.802 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.max_successive_merges: 0 2021-11-03T16:55:59.803 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.optimize_filters_for_hits: 0 2021-11-03T16:55:59.803 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.paranoid_file_checks: 0 2021-11-03T16:55:59.803 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.force_consistency_checks: 1 2021-11-03T16:55:59.803 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.report_bg_io_stats: 0 2021-11-03T16:55:59.804 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.ttl: 2592000 2021-11-03T16:55:59.804 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.periodic_compaction_seconds: 0 2021-11-03T16:55:59.804 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.enable_blob_files: false 2021-11-03T16:55:59.805 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.min_blob_size: 0 2021-11-03T16:55:59.805 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.blob_file_size: 268435456 2021-11-03T16:55:59.805 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.blob_compression_type: NoCompression 2021-11-03T16:55:59.805 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.enable_blob_garbage_collection: false 2021-11-03T16:55:59.805 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2021-11-03T16:55:59.806 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: [db/version_set.cc:3459] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2021-11-03T16:55:59.806 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: [db/version_set.cc:4773] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi194/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 16, last_sequence is 8976, log_number is 12,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-11-03T16:55:59.806 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: [db/version_set.cc:4782] Column family [default] (ID 0), log number is 12 2021-11-03T16:55:59.806 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: [db/version_set.cc:4083] Creating manifest 16 2021-11-03T16:55:59.807 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: [db/version_set.cc:3459] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2021-11-03T16:55:59.807 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: EVENT_LOG_v1 {"time_micros": 1635958559506350, "job": 1, "event": "recovery_started", "wal_files": [12]} 2021-11-03T16:55:59.807 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: [db/db_impl/db_impl_open.cc:847] Recovering log #12 mode 2 2021-11-03T16:55:59.807 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: [table/block_based/filter_policy.cc:996] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-11-03T16:55:59.808 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: EVENT_LOG_v1 {"time_micros": 1635958559510223, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 17, "file_size": 1292667, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 1290388, "index_size": 1024, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 325, "raw_key_size": 1998, "raw_average_key_size": 22, "raw_value_size": 1287758, "raw_average_value_size": 14633, "num_data_blocks": 46, "num_entries": 88, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1635958559, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "d3d8103b-b48e-494b-a7f4-5fa281d62342", "db_session_id": "6SDC8C8LRNFQ3GSJFJ2Y"}} 2021-11-03T16:55:59.808 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: [db/version_set.cc:4083] Creating manifest 18 2021-11-03T16:55:59.808 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: [db/version_set.cc:3459] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2021-11-03T16:55:59.809 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: EVENT_LOG_v1 {"time_micros": 1635958559510590, "job": 1, "event": "recovery_finished"} 2021-11-03T16:55:59.809 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: [file/delete_scheduler.cc:73] Deleted file /var/lib/ceph/mon/ceph-smithi194/store.db/000012.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2021-11-03T16:55:59.809 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 systemd[1]: Started Ceph mon.smithi194 for 70492bc6-3cc5-11ec-8c28-001a4aab830c. 2021-11-03T16:55:59.809 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: [db/db_impl/db_impl_open.cc:1701] SstFileManager instance 0x557df81aea80 2021-11-03T16:55:59.809 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: DB pointer 0x557df81be000 2021-11-03T16:55:59.810 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: [db/db_impl/db_impl.cc:902] ------- DUMPING STATS ------- 2021-11-03T16:55:59.810 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: rocksdb: [db/db_impl/db_impl.cc:903] 2021-11-03T16:55:59.810 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: ** DB Stats ** 2021-11-03T16:55:59.811 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Uptime(secs): 0.0 total, 0.0 interval 2021-11-03T16:55:59.811 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-11-03T16:55:59.811 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-11-03T16:55:59.811 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-11-03T16:55:59.811 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-11-03T16:55:59.812 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-11-03T16:55:59.812 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-11-03T16:55:59.812 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: 2021-11-03T16:55:59.812 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: ** Compaction Stats [default] ** 2021-11-03T16:55:59.812 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-11-03T16:55:59.813 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-11-03T16:55:59.813 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: L0 1/0 1.23 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 646.1 0.00 0.00 1 0.002 0 0 2021-11-03T16:55:59.813 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: L6 1/0 22.62 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-11-03T16:55:59.813 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Sum 2/0 23.86 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 646.1 0.00 0.00 1 0.002 0 0 2021-11-03T16:55:59.814 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 646.1 0.00 0.00 1 0.002 0 0 2021-11-03T16:55:59.814 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: 2021-11-03T16:55:59.814 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: ** Compaction Stats [default] ** 2021-11-03T16:55:59.814 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-11-03T16:55:59.814 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-11-03T16:55:59.815 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 646.1 0.00 0.00 1 0.002 0 0 2021-11-03T16:55:59.815 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Uptime(secs): 0.0 total, 0.0 interval 2021-11-03T16:55:59.815 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Flush(GB): cumulative 0.001, interval 0.001 2021-11-03T16:55:59.815 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2021-11-03T16:55:59.816 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: AddFile(Total Files): cumulative 0, interval 0 2021-11-03T16:55:59.816 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: AddFile(L0 Files): cumulative 0, interval 0 2021-11-03T16:55:59.816 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: AddFile(Keys): cumulative 0, interval 0 2021-11-03T16:55:59.816 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Cumulative compaction: 0.00 GB write, 192.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-11-03T16:55:59.817 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Interval compaction: 0.00 GB write, 192.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-11-03T16:55:59.817 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-11-03T16:55:59.817 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: 2021-11-03T16:55:59.817 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: ** File Read Latency Histogram By Level [default] ** 2021-11-03T16:55:59.817 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: 2021-11-03T16:55:59.818 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: ** Compaction Stats [default] ** 2021-11-03T16:55:59.818 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-11-03T16:55:59.818 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-11-03T16:55:59.818 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: L0 1/0 1.23 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 646.1 0.00 0.00 1 0.002 0 0 2021-11-03T16:55:59.819 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: L6 1/0 22.62 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-11-03T16:55:59.819 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Sum 2/0 23.86 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 646.1 0.00 0.00 1 0.002 0 0 2021-11-03T16:55:59.819 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-11-03T16:55:59.819 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: 2021-11-03T16:55:59.820 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: ** Compaction Stats [default] ** 2021-11-03T16:55:59.820 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-11-03T16:55:59.820 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-11-03T16:55:59.820 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 646.1 0.00 0.00 1 0.002 0 0 2021-11-03T16:55:59.821 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Uptime(secs): 0.0 total, 0.0 interval 2021-11-03T16:55:59.821 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Flush(GB): cumulative 0.001, interval 0.000 2021-11-03T16:55:59.821 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2021-11-03T16:55:59.821 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: AddFile(Total Files): cumulative 0, interval 0 2021-11-03T16:55:59.822 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: AddFile(L0 Files): cumulative 0, interval 0 2021-11-03T16:55:59.822 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: AddFile(Keys): cumulative 0, interval 0 2021-11-03T16:55:59.822 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Cumulative compaction: 0.00 GB write, 191.57 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-11-03T16:55:59.822 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-11-03T16:55:59.823 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-11-03T16:55:59.823 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: 2021-11-03T16:55:59.823 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: ** File Read Latency Histogram By Level [default] ** 2021-11-03T16:55:59.823 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: starting mon.smithi194 rank 1 at public addrs [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] at bind addrs [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi194 fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c 2021-11-03T16:55:59.823 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: mon.smithi194@-1(???) e2 preinit fsid 70492bc6-3cc5-11ec-8c28-001a4aab830c 2021-11-03T16:55:59.824 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: mon.smithi194@-1(???).mds e21 new map 2021-11-03T16:55:59.824 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: mon.smithi194@-1(???).mds e21 print_map 2021-11-03T16:55:59.824 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: e21 2021-11-03T16:55:59.824 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T16:55:59.825 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T16:55:59.825 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: legacy client fscid: 1 2021-11-03T16:55:59.825 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: 2021-11-03T16:55:59.825 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Filesystem 'cephfs' (1) 2021-11-03T16:55:59.826 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: fs_name cephfs 2021-11-03T16:55:59.826 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: epoch 21 2021-11-03T16:55:59.826 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T16:55:59.826 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: created 2021-11-03T16:52:17.109901+0000 2021-11-03T16:55:59.827 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: modified 2021-11-03T16:55:48.261162+0000 2021-11-03T16:55:59.827 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: tableserver 0 2021-11-03T16:55:59.827 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: root 0 2021-11-03T16:55:59.827 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: session_timeout 60 2021-11-03T16:55:59.827 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: session_autoclose 300 2021-11-03T16:55:59.828 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: max_file_size 1099511627776 2021-11-03T16:55:59.828 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: required_client_features {} 2021-11-03T16:55:59.828 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: last_failure 0 2021-11-03T16:55:59.828 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: last_failure_osd_epoch 52 2021-11-03T16:55:59.829 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T16:55:59.829 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: max_mds 1 2021-11-03T16:55:59.829 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: in 0 2021-11-03T16:55:59.829 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: up {} 2021-11-03T16:55:59.830 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: failed 0 2021-11-03T16:55:59.830 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: damaged 2021-11-03T16:55:59.830 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: stopped 2021-11-03T16:55:59.830 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: data_pools [3] 2021-11-03T16:55:59.831 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: metadata_pool 2 2021-11-03T16:55:59.831 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: inline_data disabled 2021-11-03T16:55:59.831 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: balancer 2021-11-03T16:55:59.831 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: standby_count_wanted 1 2021-11-03T16:55:59.831 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: 2021-11-03T16:55:59.832 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: 2021-11-03T16:55:59.832 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Standby daemons: 2021-11-03T16:55:59.832 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: 2021-11-03T16:55:59.832 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: [mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T16:55:59.833 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: [mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T16:55:59.833 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: [mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T16:55:59.833 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: [mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T16:55:59.833 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: mon.smithi194@-1(???).osd e52 crush map has features 3314933000852226048, adjusting msgr requires 2021-11-03T16:55:59.834 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: mon.smithi194@-1(???).osd e52 crush map has features 288514051259236352, adjusting msgr requires 2021-11-03T16:55:59.834 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: mon.smithi194@-1(???).osd e52 crush map has features 288514051259236352, adjusting msgr requires 2021-11-03T16:55:59.834 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: mon.smithi194@-1(???).osd e52 crush map has features 288514051259236352, adjusting msgr requires 2021-11-03T16:55:59.834 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:55:59 smithi194 ceph-mon[65619]: mon.smithi194@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2021-11-03T16:56:00.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:00 smithi026 conmon[96772]: 2021-11-03T16:56:00.086+0000 7f27936ec700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline 2021-11-03T16:56:00.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:00 smithi026 conmon[96772]: 2021-11-03T16:56:00.086+0000 7f27936ec700 -1 log_channel(cluster) log [ERR] : [WRN] FS_DEGRADED: 1 filesystem is degraded 2021-11-03T16:56:00.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:00 smithi026 conmon[96772]: 2021-11-03T16:56:00.086+0000 7f27936ec700 -1 log_channel(cluster) log [ERR] : fs cephfs is degraded 2021-11-03T16:56:00.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:00 smithi026 conmon[96772]: 2021-11-03T16:56:00.086+0000 7f27936ec700 -1 log_channel(cluster) log [ERR] : [WRN] FS_WITH_FAILED_MDS: 1 filesystem has a failed mds daemon 2021-11-03T16:56:00.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:00 smithi026 conmon[96772]: 2021-11-03T16:56:00.086+0000 7f27936ec700 -1 log_channel(cluster) log [ERR] : fs cephfs has 1 failed mds 2021-11-03T16:56:00.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:00 smithi026 conmon[96772]: 2021-11-03T16:56:00.086+0000 7f27936ec700 -1 log_channel(cluster) log [ERR] : [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2021-11-03T16:56:00.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:00 smithi026 conmon[96772]: 2021-11-03T16:56:00.086+0000 7f27936ec700 -1 log_channel(cluster) log [ERR] : fs cephfs is offline because no MDS is active for it. 2021-11-03T16:56:00.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:00 smithi026 conmon[96772]: 2021-11-03T16:56:00.106+0000 7f27936ec700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline 2021-11-03T16:56:00.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:00 smithi026 conmon[96772]: 2021-11-03T16:56:00.106+0000 7f27936ec700 -1 log_channel(cluster) log [ERR] : [WRN] FS_DEGRADED: 1 filesystem is degraded 2021-11-03T16:56:00.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:00 smithi026 conmon[96772]: 2021-11-03T16:56:00.106+0000 7f27936ec700 -1 log_channel(cluster) log [ERR] : fs cephfs is degraded 2021-11-03T16:56:00.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:00 smithi026 conmon[96772]: 2021-11-03T16:56:00.106+0000 7f27936ec700 -1 log_channel(cluster) log [ERR] : [WRN] FS_WITH_FAILED_MDS: 1 filesystem has a failed mds daemon 2021-11-03T16:56:00.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:00 smithi026 conmon[96772]: 2021-11-03T16:56:00.106+0000 7f27936ec700 -1 log_channel(cluster) log [ERR] : fs cephfs has 1 failed mds 2021-11-03T16:56:00.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:00 smithi026 conmon[96772]: 2021-11-03T16:56:00.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:00 smithi026 conmon[96772]: 2021-11-03T16:56:00.106+0000 7f27936ec700 -1 log_channel(cluster) log [ERR] : [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2021-11-03T16:56:00.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:00 smithi026 conmon[96772]: 2021-11-03T16:56:00.106+0000 7f27936ec700 -1 log_channel(cluster) log [ERR] : fs cephfs is offline because no MDS is active for it. 2021-11-03T16:56:00.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:00 smithi026 conmon[96772]: 2021-11-03T16:56:01.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: mkfs 70492bc6-3cc5-11ec-8c28-001a4aab830c 2021-11-03T16:56:01.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: Upgrade: Updating mgr.smithi194.wnexas 2021-11-03T16:56:01.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: Deploying daemon mgr.smithi194.wnexas on smithi194 2021-11-03T16:56:01.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: Upgrade: Need to upgrade myself (mgr.smithi026.cnrxli) 2021-11-03T16:56:01.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: Failing over to other MGR 2021-11-03T16:56:01.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: Deploying cephadm binary to smithi194 2021-11-03T16:56:01.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: Deploying cephadm binary to smithi026 2021-11-03T16:56:01.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: Starting cherrypy engine... 2021-11-03T16:56:01.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: [03/Nov/2021:16:54:49] ENGINE Bus STARTING 2021-11-03T16:56:01.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: [03/Nov/2021:16:54:49] ENGINE Serving on https://172.21.15.194:8499 2021-11-03T16:56:01.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: [03/Nov/2021:16:54:49] ENGINE Bus STARTED 2021-11-03T16:56:01.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: Cherrypy engine started. 2021-11-03T16:56:01.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: poll took 3581.279 ms: 1 events 2021-11-03T16:56:01.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: poll took 2481.749 ms: 1 events 2021-11-03T16:56:01.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: Upgrade: Need to upgrade myself (mgr.smithi194.wnexas) 2021-11-03T16:56:01.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: poll took 1818.458 ms: 1 events 2021-11-03T16:56:01.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: Upgrade: Updating mgr.smithi026.cnrxli 2021-11-03T16:56:01.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: Deploying daemon mgr.smithi026.cnrxli on smithi026 2021-11-03T16:56:01.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: poll took 3537.616 ms: 1 events 2021-11-03T16:56:01.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: poll took 6427.717 ms: 1 events 2021-11-03T16:56:01.428 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: Upgrade: Need to upgrade myself (mgr.smithi194.wnexas) 2021-11-03T16:56:01.428 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: Failing over to other MGR 2021-11-03T16:56:01.428 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: inventory: adjusted host smithi194 addr 'smithi194' -> '172.21.15.194' 2021-11-03T16:56:01.428 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: Starting cherrypy engine... 2021-11-03T16:56:01.428 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: [03/Nov/2021:16:55:12] ENGINE Bus STARTING 2021-11-03T16:56:01.429 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: [03/Nov/2021:16:55:12] ENGINE Serving on https://172.21.15.26:8499 2021-11-03T16:56:01.429 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: [03/Nov/2021:16:55:12] ENGINE Bus STARTED 2021-11-03T16:56:01.429 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: Cherrypy engine started. 2021-11-03T16:56:01.429 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: poll took 3989.073 ms: 1 events 2021-11-03T16:56:01.430 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: poll took 5143.585 ms: 1 events 2021-11-03T16:56:01.430 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: poll took 1498.813 ms: 1 events 2021-11-03T16:56:01.430 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: Upgrade: Updating mgr.smithi194.wnexas 2021-11-03T16:56:01.430 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: Deploying daemon mgr.smithi194.wnexas on smithi194 2021-11-03T16:56:01.430 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: poll took 2781.697 ms: 1 events 2021-11-03T16:56:01.431 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: poll took 3633.872 ms: 1 events 2021-11-03T16:56:01.431 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: pgmap v15: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:01.431 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: pgmap v16: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:01.431 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: Upgrade: Setting container_image for all mgr 2021-11-03T16:56:01.432 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: mds.? [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] up:standby 2021-11-03T16:56:01.432 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: fsmap cephfs:1/1 {0=cephfs.smithi026.ltacyh=up:replay} 3 up:standby 2021-11-03T16:56:01.432 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: pgmap v17: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 17 MiB/s rd, 8 op/s 2021-11-03T16:56:01.432 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: Standby manager daemon smithi194.wnexas restarted 2021-11-03T16:56:01.432 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: Standby manager daemon smithi194.wnexas started 2021-11-03T16:56:01.433 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: mgrmap e31: smithi026.cnrxli(active, since 23s), standbys: smithi194.wnexas 2021-11-03T16:56:01.433 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: poll took 3467.215 ms: 1 events 2021-11-03T16:56:01.433 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: Upgrade: Updating mon.smithi026 2021-11-03T16:56:01.433 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-11-03T16:56:01.433 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:56:01.434 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: Deploying daemon mon.smithi026 on smithi026 2021-11-03T16:56:01.434 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: pgmap v18: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 16 MiB/s rd, 8 op/s 2021-11-03T16:56:01.434 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: reconnect by client.14622 172.21.15.26:0/1183226442 after 0.000999985 2021-11-03T16:56:01.434 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: reconnect by client.14624 172.21.15.26:0/1663235844 after 0.000999985 2021-11-03T16:56:01.435 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: mds.? [v2:172.21.15.26:6800/1006134959,v1:172.21.15.26:6801/1006134959] up:reconnect 2021-11-03T16:56:01.435 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: fsmap cephfs:1/1 {0=cephfs.smithi026.ltacyh=up:reconnect} 3 up:standby 2021-11-03T16:56:01.435 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: reconnect by client.24301 v1:172.21.15.26:0/553539211 after 0.0209997 2021-11-03T16:56:01.435 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: reconnect by client.24305 v1:192.168.0.1:0/1370096456 after 0.0229997 2021-11-03T16:56:01.435 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata", "id": "smithi026"}]: dispatch 2021-11-03T16:56:01.436 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2021-11-03T16:56:01.436 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: pgmap v20: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 13 MiB/s rd, 6 op/s 2021-11-03T16:56:01.436 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: poll took 4389.929 ms: 1 events 2021-11-03T16:56:01.436 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: mon.smithi026 calling monitor election 2021-11-03T16:56:01.436 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: mon.smithi026 is new leader, mons smithi026,smithi194 in quorum (ranks 0,1) 2021-11-03T16:56:01.437 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: monmap e2: 2 mons at {smithi026=[v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0],smithi194=[v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0]} 2021-11-03T16:56:01.437 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: fsmap cephfs:1/1 {0=cephfs.smithi026.ltacyh=up:rejoin} 3 up:standby 2021-11-03T16:56:01.437 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: osdmap e50: 6 total, 6 up, 6 in 2021-11-03T16:56:01.437 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: mgrmap e31: smithi026.cnrxli(active, since 29s), standbys: smithi194.wnexas 2021-11-03T16:56:01.438 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: mgrmap e32: smithi026.cnrxli(active, since 29s), standbys: smithi194.wnexas 2021-11-03T16:56:01.438 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: Health detail: HEALTH_WARN 1 failed cephadm daemon(s); 1 filesystem is degraded 2021-11-03T16:56:01.438 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-11-03T16:56:01.438 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: daemon mds.cephfs.smithi026.yfxlxl on smithi026 is in unknown state 2021-11-03T16:56:01.438 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2021-11-03T16:56:01.439 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: fs cephfs is degraded 2021-11-03T16:56:01.439 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.14594 ' entity='' 2021-11-03T16:56:01.439 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: Standby manager daemon smithi194.wnexas restarted 2021-11-03T16:56:01.439 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: Standby manager daemon smithi194.wnexas started 2021-11-03T16:56:01.440 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.? 172.21.15.194:0/2478594282' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.wnexas/crt"}]: dispatch 2021-11-03T16:56:01.440 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.? 172.21.15.194:0/2478594282' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-11-03T16:56:01.440 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.? 172.21.15.194:0/2478594282' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.wnexas/key"}]: dispatch 2021-11-03T16:56:01.440 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.? 172.21.15.194:0/2478594282' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-11-03T16:56:01.440 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: mgrmap e33: smithi026.cnrxli(active, since 35s), standbys: smithi194.wnexas 2021-11-03T16:56:01.441 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: Active manager daemon smithi026.cnrxli restarted 2021-11-03T16:56:01.441 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: Activating manager daemon smithi026.cnrxli 2021-11-03T16:56:01.441 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: osdmap e51: 6 total, 6 up, 6 in 2021-11-03T16:56:01.441 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: daemon mds.cephfs.smithi026.ltacyh restarted 2021-11-03T16:56:01.442 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: osdmap e52: 6 total, 6 up, 6 in 2021-11-03T16:56:01.442 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: mgrmap e34: smithi026.cnrxli(active, starting, since 0.698576s), standbys: smithi194.wnexas 2021-11-03T16:56:01.442 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata", "id": "smithi026"}]: dispatch 2021-11-03T16:56:01.442 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2021-11-03T16:56:01.443 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.ltacyh"}]: dispatch 2021-11-03T16:56:01.443 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.yfxlxl"}]: dispatch 2021-11-03T16:56:01.443 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.kwikhp"}]: dispatch 2021-11-03T16:56:01.443 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.mpotdl"}]: dispatch 2021-11-03T16:56:01.443 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mgr metadata", "who": "smithi026.cnrxli", "id": "smithi026.cnrxli"}]: dispatch 2021-11-03T16:56:01.444 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mgr metadata", "who": "smithi194.wnexas", "id": "smithi194.wnexas"}]: dispatch 2021-11-03T16:56:01.444 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-11-03T16:56:01.444 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-11-03T16:56:01.444 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-11-03T16:56:01.445 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-11-03T16:56:01.445 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-11-03T16:56:01.445 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-11-03T16:56:01.445 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-11-03T16:56:01.445 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-11-03T16:56:01.446 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-11-03T16:56:01.446 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: Manager daemon smithi026.cnrxli is now available 2021-11-03T16:56:01.446 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:56:01.446 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:56:01.447 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:01.447 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T16:56:01.447 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T16:56:01.447 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: Health check failed: 1 filesystem has a failed mds daemon (FS_WITH_FAILED_MDS) 2021-11-03T16:56:01.447 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-03T16:56:01.448 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: mds.? [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] up:boot 2021-11-03T16:56:01.448 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: fsmap cephfs:0/1 4 up:standby, 1 failed 2021-11-03T16:56:01.448 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.ltacyh"}]: dispatch 2021-11-03T16:56:01.448 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: Executing result=None created at /lib/python3.6/site-packages/asyncssh/connection.py:841> took 0.101 seconds 2021-11-03T16:56:01.449 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: Starting cherrypy engine... 2021-11-03T16:56:01.449 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: [03/Nov/2021:16:55:48] ENGINE Bus STARTING 2021-11-03T16:56:01.449 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: mgrmap e35: smithi026.cnrxli(active, since 1.71241s), standbys: smithi194.wnexas 2021-11-03T16:56:01.449 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='client.24471 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:56:01.449 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: pgmap v3: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:01.450 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: [03/Nov/2021:16:55:49] ENGINE Serving on https://172.21.15.26:8499 2021-11-03T16:56:01.450 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: [03/Nov/2021:16:55:49] ENGINE Bus STARTED 2021-11-03T16:56:01.450 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: Cherrypy engine started. 2021-11-03T16:56:01.450 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:56:01.450 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/4014225020' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:56:01.451 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: pgmap v4: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:01.451 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2021-11-03T16:56:01.451 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3955773212' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T16:56:01.451 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: mgrmap e36: smithi026.cnrxli(active, since 2s), standbys: smithi194.wnexas 2021-11-03T16:56:01.452 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: poll took 3381.398 ms: 1 events 2021-11-03T16:56:01.452 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:01.452 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: pgmap v5: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:01.452 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:01.452 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2021-11-03T16:56:01.453 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: pgmap v6: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:01.453 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: poll took 1945.219 ms: 1 events 2021-11-03T16:56:01.453 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:01.453 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:01.454 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi026", "name": "osd_memory_target"}]: dispatch 2021-11-03T16:56:01.454 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:01.454 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:56:01.454 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:56:01.454 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "quorum_status"}]: dispatch 2021-11-03T16:56:01.455 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: pgmap v7: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:01.455 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: poll took 1490.483 ms: 1 events 2021-11-03T16:56:01.455 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: Upgrade: Updating mon.smithi194 2021-11-03T16:56:01.455 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:01.456 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-11-03T16:56:01.456 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-11-03T16:56:01.456 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:56:01.456 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: Deploying daemon mon.smithi194 on smithi194 2021-11-03T16:56:01.456 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: poll took 2609.622 ms: 1 events 2021-11-03T16:56:01.457 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: pgmap v9: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:01.457 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline 2021-11-03T16:56:01.457 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2021-11-03T16:56:01.457 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: fs cephfs is degraded 2021-11-03T16:56:01.458 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: [WRN] FS_WITH_FAILED_MDS: 1 filesystem has a failed mds daemon 2021-11-03T16:56:01.458 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: fs cephfs has 1 failed mds 2021-11-03T16:56:01.458 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2021-11-03T16:56:01.458 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: fs cephfs is offline because no MDS is active for it. 2021-11-03T16:56:01.458 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata", "id": "smithi026"}]: dispatch 2021-11-03T16:56:01.459 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2021-11-03T16:56:01.459 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: mon.smithi026 calling monitor election 2021-11-03T16:56:01.459 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: mon.smithi194 calling monitor election 2021-11-03T16:56:01.459 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: mon.smithi026 is new leader, mons smithi026,smithi194 in quorum (ranks 0,1) 2021-11-03T16:56:01.459 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: monmap e3: 2 mons at {smithi026=[v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0],smithi194=[v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0]} 2021-11-03T16:56:01.460 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: fsmap cephfs:0/1 4 up:standby, 1 failed 2021-11-03T16:56:01.460 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: osdmap e52: 6 total, 6 up, 6 in 2021-11-03T16:56:01.460 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: mgrmap e36: smithi026.cnrxli(active, since 12s), standbys: smithi194.wnexas 2021-11-03T16:56:01.460 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline 2021-11-03T16:56:01.461 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2021-11-03T16:56:01.461 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: fs cephfs is degraded 2021-11-03T16:56:01.461 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: [WRN] FS_WITH_FAILED_MDS: 1 filesystem has a failed mds daemon 2021-11-03T16:56:01.461 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: fs cephfs has 1 failed mds 2021-11-03T16:56:01.461 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2021-11-03T16:56:01.462 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: fs cephfs is offline because no MDS is active for it. 2021-11-03T16:56:01.462 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:01.462 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:56:01.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: mkfs 70492bc6-3cc5-11ec-8c28-001a4aab830c 2021-11-03T16:56:01.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: Upgrade: Updating mgr.smithi194.wnexas 2021-11-03T16:56:01.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: Deploying daemon mgr.smithi194.wnexas on smithi194 2021-11-03T16:56:01.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: Upgrade: Need to upgrade myself (mgr.smithi026.cnrxli) 2021-11-03T16:56:01.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: Failing over to other MGR 2021-11-03T16:56:01.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: Deploying cephadm binary to smithi194 2021-11-03T16:56:01.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: Deploying cephadm binary to smithi026 2021-11-03T16:56:01.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: Starting cherrypy engine... 2021-11-03T16:56:01.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: [03/Nov/2021:16:54:49] ENGINE Bus STARTING 2021-11-03T16:56:01.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: [03/Nov/2021:16:54:49] ENGINE Serving on https://172.21.15.194:8499 2021-11-03T16:56:01.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: [03/Nov/2021:16:54:49] ENGINE Bus STARTED 2021-11-03T16:56:01.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: Cherrypy engine started. 2021-11-03T16:56:01.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: poll took 3581.279 ms: 1 events 2021-11-03T16:56:01.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: poll took 2481.749 ms: 1 events 2021-11-03T16:56:01.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: Upgrade: Need to upgrade myself (mgr.smithi194.wnexas) 2021-11-03T16:56:01.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: poll took 1818.458 ms: 1 events 2021-11-03T16:56:01.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: Upgrade: Updating mgr.smithi026.cnrxli 2021-11-03T16:56:01.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: Deploying daemon mgr.smithi026.cnrxli on smithi026 2021-11-03T16:56:01.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: poll took 3537.616 ms: 1 events 2021-11-03T16:56:01.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: poll took 6427.717 ms: 1 events 2021-11-03T16:56:01.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: Upgrade: Need to upgrade myself (mgr.smithi194.wnexas) 2021-11-03T16:56:01.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: Failing over to other MGR 2021-11-03T16:56:01.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: inventory: adjusted host smithi194 addr 'smithi194' -> '172.21.15.194' 2021-11-03T16:56:01.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: Starting cherrypy engine... 2021-11-03T16:56:01.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: [03/Nov/2021:16:55:12] ENGINE Bus STARTING 2021-11-03T16:56:01.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: [03/Nov/2021:16:55:12] ENGINE Serving on https://172.21.15.26:8499 2021-11-03T16:56:01.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: [03/Nov/2021:16:55:12] ENGINE Bus STARTED 2021-11-03T16:56:01.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: Cherrypy engine started. 2021-11-03T16:56:01.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: poll took 3989.073 ms: 1 events 2021-11-03T16:56:01.505 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: poll took 5143.585 ms: 1 events 2021-11-03T16:56:01.505 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: poll took 1498.813 ms: 1 events 2021-11-03T16:56:01.505 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: Upgrade: Updating mgr.smithi194.wnexas 2021-11-03T16:56:01.505 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: Deploying daemon mgr.smithi194.wnexas on smithi194 2021-11-03T16:56:01.505 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: poll took 2781.697 ms: 1 events 2021-11-03T16:56:01.506 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: poll took 3633.872 ms: 1 events 2021-11-03T16:56:01.506 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: pgmap v15: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:01.506 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: pgmap v16: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:01.506 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: Upgrade: Setting container_image for all mgr 2021-11-03T16:56:01.507 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: mds.? [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] up:standby 2021-11-03T16:56:01.507 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: fsmap cephfs:1/1 {0=cephfs.smithi026.ltacyh=up:replay} 3 up:standby 2021-11-03T16:56:01.507 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: pgmap v17: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 17 MiB/s rd, 8 op/s 2021-11-03T16:56:01.507 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: Standby manager daemon smithi194.wnexas restarted 2021-11-03T16:56:01.508 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: Standby manager daemon smithi194.wnexas started 2021-11-03T16:56:01.508 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: mgrmap e31: smithi026.cnrxli(active, since 23s), standbys: smithi194.wnexas 2021-11-03T16:56:01.508 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: poll took 3467.215 ms: 1 events 2021-11-03T16:56:01.508 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: Upgrade: Updating mon.smithi026 2021-11-03T16:56:01.508 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-11-03T16:56:01.509 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:56:01.509 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: Deploying daemon mon.smithi026 on smithi026 2021-11-03T16:56:01.509 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: pgmap v18: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 16 MiB/s rd, 8 op/s 2021-11-03T16:56:01.509 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: reconnect by client.14622 172.21.15.26:0/1183226442 after 0.000999985 2021-11-03T16:56:01.510 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: reconnect by client.14624 172.21.15.26:0/1663235844 after 0.000999985 2021-11-03T16:56:01.510 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: mds.? [v2:172.21.15.26:6800/1006134959,v1:172.21.15.26:6801/1006134959] up:reconnect 2021-11-03T16:56:01.510 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: fsmap cephfs:1/1 {0=cephfs.smithi026.ltacyh=up:reconnect} 3 up:standby 2021-11-03T16:56:01.510 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: reconnect by client.24301 v1:172.21.15.26:0/553539211 after 0.0209997 2021-11-03T16:56:01.511 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: reconnect by client.24305 v1:192.168.0.1:0/1370096456 after 0.0229997 2021-11-03T16:56:01.511 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata", "id": "smithi026"}]: dispatch 2021-11-03T16:56:01.511 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.14594 172.21.15.26:0/641181076' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2021-11-03T16:56:01.511 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: pgmap v20: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 13 MiB/s rd, 6 op/s 2021-11-03T16:56:01.512 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: poll took 4389.929 ms: 1 events 2021-11-03T16:56:01.512 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: mon.smithi026 calling monitor election 2021-11-03T16:56:01.512 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: mon.smithi026 is new leader, mons smithi026,smithi194 in quorum (ranks 0,1) 2021-11-03T16:56:01.512 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: monmap e2: 2 mons at {smithi026=[v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0],smithi194=[v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0]} 2021-11-03T16:56:01.512 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: fsmap cephfs:1/1 {0=cephfs.smithi026.ltacyh=up:rejoin} 3 up:standby 2021-11-03T16:56:01.513 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: osdmap e50: 6 total, 6 up, 6 in 2021-11-03T16:56:01.513 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: mgrmap e31: smithi026.cnrxli(active, since 29s), standbys: smithi194.wnexas 2021-11-03T16:56:01.513 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: mgrmap e32: smithi026.cnrxli(active, since 29s), standbys: smithi194.wnexas 2021-11-03T16:56:01.513 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: Health detail: HEALTH_WARN 1 failed cephadm daemon(s); 1 filesystem is degraded 2021-11-03T16:56:01.513 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-11-03T16:56:01.514 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: daemon mds.cephfs.smithi026.yfxlxl on smithi026 is in unknown state 2021-11-03T16:56:01.514 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2021-11-03T16:56:01.514 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: fs cephfs is degraded 2021-11-03T16:56:01.514 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.14594 ' entity='' 2021-11-03T16:56:01.515 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: Standby manager daemon smithi194.wnexas restarted 2021-11-03T16:56:01.515 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: Standby manager daemon smithi194.wnexas started 2021-11-03T16:56:01.515 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.? 172.21.15.194:0/2478594282' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.wnexas/crt"}]: dispatch 2021-11-03T16:56:01.515 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.? 172.21.15.194:0/2478594282' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-11-03T16:56:01.515 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.? 172.21.15.194:0/2478594282' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.wnexas/key"}]: dispatch 2021-11-03T16:56:01.516 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.? 172.21.15.194:0/2478594282' entity='mgr.smithi194.wnexas' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-11-03T16:56:01.517 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: mgrmap e33: smithi026.cnrxli(active, since 35s), standbys: smithi194.wnexas 2021-11-03T16:56:01.517 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: Active manager daemon smithi026.cnrxli restarted 2021-11-03T16:56:01.517 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: Activating manager daemon smithi026.cnrxli 2021-11-03T16:56:01.517 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: osdmap e51: 6 total, 6 up, 6 in 2021-11-03T16:56:01.518 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: daemon mds.cephfs.smithi026.ltacyh restarted 2021-11-03T16:56:01.518 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: osdmap e52: 6 total, 6 up, 6 in 2021-11-03T16:56:01.518 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: mgrmap e34: smithi026.cnrxli(active, starting, since 0.698576s), standbys: smithi194.wnexas 2021-11-03T16:56:01.518 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata", "id": "smithi026"}]: dispatch 2021-11-03T16:56:01.519 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2021-11-03T16:56:01.519 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.ltacyh"}]: dispatch 2021-11-03T16:56:01.519 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.yfxlxl"}]: dispatch 2021-11-03T16:56:01.519 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.kwikhp"}]: dispatch 2021-11-03T16:56:01.520 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.mpotdl"}]: dispatch 2021-11-03T16:56:01.520 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mgr metadata", "who": "smithi026.cnrxli", "id": "smithi026.cnrxli"}]: dispatch 2021-11-03T16:56:01.520 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mgr metadata", "who": "smithi194.wnexas", "id": "smithi194.wnexas"}]: dispatch 2021-11-03T16:56:01.521 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-11-03T16:56:01.521 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-11-03T16:56:01.521 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-11-03T16:56:01.521 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-11-03T16:56:01.521 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-11-03T16:56:01.522 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-11-03T16:56:01.522 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-11-03T16:56:01.522 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-11-03T16:56:01.522 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-11-03T16:56:01.523 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: Manager daemon smithi026.cnrxli is now available 2021-11-03T16:56:01.523 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:56:01.523 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:56:01.523 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:01.523 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T16:56:01.524 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T16:56:01.524 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: Health check failed: 1 filesystem has a failed mds daemon (FS_WITH_FAILED_MDS) 2021-11-03T16:56:01.524 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-03T16:56:01.524 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: mds.? [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] up:boot 2021-11-03T16:56:01.525 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: fsmap cephfs:0/1 4 up:standby, 1 failed 2021-11-03T16:56:01.525 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.ltacyh"}]: dispatch 2021-11-03T16:56:01.525 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: Executing result=None created at /lib/python3.6/site-packages/asyncssh/connection.py:841> took 0.101 seconds 2021-11-03T16:56:01.525 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: Starting cherrypy engine... 2021-11-03T16:56:01.525 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: [03/Nov/2021:16:55:48] ENGINE Bus STARTING 2021-11-03T16:56:01.526 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: mgrmap e35: smithi026.cnrxli(active, since 1.71241s), standbys: smithi194.wnexas 2021-11-03T16:56:01.526 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='client.24471 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:56:01.526 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: pgmap v3: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:01.526 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: [03/Nov/2021:16:55:49] ENGINE Serving on https://172.21.15.26:8499 2021-11-03T16:56:01.527 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: [03/Nov/2021:16:55:49] ENGINE Bus STARTED 2021-11-03T16:56:01.527 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: Cherrypy engine started. 2021-11-03T16:56:01.527 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:56:01.527 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/4014225020' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:56:01.527 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: pgmap v4: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:01.528 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2021-11-03T16:56:01.528 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3955773212' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T16:56:01.528 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: mgrmap e36: smithi026.cnrxli(active, since 2s), standbys: smithi194.wnexas 2021-11-03T16:56:01.528 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: poll took 3381.398 ms: 1 events 2021-11-03T16:56:01.528 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:01.529 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: pgmap v5: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:01.529 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:01.529 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2021-11-03T16:56:01.529 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: pgmap v6: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:01.530 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: poll took 1945.219 ms: 1 events 2021-11-03T16:56:01.530 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:01.530 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:01.530 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi026", "name": "osd_memory_target"}]: dispatch 2021-11-03T16:56:01.530 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:01.531 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:56:01.531 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:56:01.531 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "quorum_status"}]: dispatch 2021-11-03T16:56:01.531 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: pgmap v7: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:01.532 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: poll took 1490.483 ms: 1 events 2021-11-03T16:56:01.532 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: Upgrade: Updating mon.smithi194 2021-11-03T16:56:01.532 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:01.533 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-11-03T16:56:01.533 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-11-03T16:56:01.533 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:56:01.533 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: Deploying daemon mon.smithi194 on smithi194 2021-11-03T16:56:01.533 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: poll took 2609.622 ms: 1 events 2021-11-03T16:56:01.534 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: pgmap v9: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:01.534 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline 2021-11-03T16:56:01.534 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2021-11-03T16:56:01.534 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: fs cephfs is degraded 2021-11-03T16:56:01.535 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: [WRN] FS_WITH_FAILED_MDS: 1 filesystem has a failed mds daemon 2021-11-03T16:56:01.535 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: fs cephfs has 1 failed mds 2021-11-03T16:56:01.535 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2021-11-03T16:56:01.535 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: fs cephfs is offline because no MDS is active for it. 2021-11-03T16:56:01.536 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata", "id": "smithi026"}]: dispatch 2021-11-03T16:56:01.536 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2021-11-03T16:56:01.536 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: mon.smithi026 calling monitor election 2021-11-03T16:56:01.536 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: mon.smithi194 calling monitor election 2021-11-03T16:56:01.536 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: mon.smithi026 is new leader, mons smithi026,smithi194 in quorum (ranks 0,1) 2021-11-03T16:56:01.537 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: monmap e3: 2 mons at {smithi026=[v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0],smithi194=[v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0]} 2021-11-03T16:56:01.537 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: fsmap cephfs:0/1 4 up:standby, 1 failed 2021-11-03T16:56:01.537 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: osdmap e52: 6 total, 6 up, 6 in 2021-11-03T16:56:01.537 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: mgrmap e36: smithi026.cnrxli(active, since 12s), standbys: smithi194.wnexas 2021-11-03T16:56:01.537 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline 2021-11-03T16:56:01.538 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2021-11-03T16:56:01.538 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: fs cephfs is degraded 2021-11-03T16:56:01.538 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: [WRN] FS_WITH_FAILED_MDS: 1 filesystem has a failed mds daemon 2021-11-03T16:56:01.538 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: fs cephfs has 1 failed mds 2021-11-03T16:56:01.539 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2021-11-03T16:56:01.539 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: fs cephfs is offline because no MDS is active for it. 2021-11-03T16:56:01.539 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:01.539 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:56:03.341 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:03 smithi194 ceph-mon[65619]: pgmap v10: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:03.342 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:03 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:03.392 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:03 smithi026 ceph-mon[96795]: pgmap v10: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:03.392 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:03 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:04.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:04 smithi026 ceph-mon[96795]: poll took 3179.273 ms: 1 events 2021-11-03T16:56:04.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:04 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:04.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:04 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:04.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:04 smithi026 ceph-mon[96795]: Reconfiguring mon.smithi026 (monmap changed)... 2021-11-03T16:56:04.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:04 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-11-03T16:56:04.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:04 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-11-03T16:56:04.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:04 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:56:04.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:04 smithi026 ceph-mon[96795]: Reconfiguring daemon mon.smithi026 on smithi026 2021-11-03T16:56:04.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:04 smithi026 ceph-mon[96795]: pgmap v11: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:04.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:04 smithi194 ceph-mon[65619]: poll took 3179.273 ms: 1 events 2021-11-03T16:56:04.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:04 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:04.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:04 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:04.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:04 smithi194 ceph-mon[65619]: Reconfiguring mon.smithi026 (monmap changed)... 2021-11-03T16:56:04.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:04 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-11-03T16:56:04.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:04 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-11-03T16:56:04.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:04 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:56:04.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:04 smithi194 ceph-mon[65619]: Reconfiguring daemon mon.smithi026 on smithi026 2021-11-03T16:56:04.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:04 smithi194 ceph-mon[65619]: pgmap v11: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:06.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:06 smithi026 ceph-mon[96795]: poll took 1555.691 ms: 1 events 2021-11-03T16:56:06.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:06 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:06.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:06 smithi026 ceph-mon[96795]: Reconfiguring mgr.smithi026.cnrxli (monmap changed)... 2021-11-03T16:56:06.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:06 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi026.cnrxli", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-11-03T16:56:06.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:06 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mgr services"}]: dispatch 2021-11-03T16:56:06.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:06 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:56:06.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:06 smithi026 ceph-mon[96795]: Reconfiguring daemon mgr.smithi026.cnrxli on smithi026 2021-11-03T16:56:06.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:06 smithi026 ceph-mon[96795]: pgmap v12: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:06.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:06 smithi194 ceph-mon[65619]: poll took 1555.691 ms: 1 events 2021-11-03T16:56:06.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:06 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:06.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:06 smithi194 ceph-mon[65619]: Reconfiguring mgr.smithi026.cnrxli (monmap changed)... 2021-11-03T16:56:06.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:06 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi026.cnrxli", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-11-03T16:56:06.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:06 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mgr services"}]: dispatch 2021-11-03T16:56:06.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:06 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:56:06.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:06 smithi194 ceph-mon[65619]: Reconfiguring daemon mgr.smithi026.cnrxli on smithi026 2021-11-03T16:56:06.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:06 smithi194 ceph-mon[65619]: pgmap v12: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:08.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:07 smithi026 ceph-mon[96795]: poll took 1414.194 ms: 1 events 2021-11-03T16:56:08.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:07 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:08.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:07 smithi026 ceph-mon[96795]: Reconfiguring crash.smithi026 (monmap changed)... 2021-11-03T16:56:08.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:07 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi026", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2021-11-03T16:56:08.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:07 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:56:08.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:07 smithi026 ceph-mon[96795]: Reconfiguring daemon crash.smithi026 on smithi026 2021-11-03T16:56:08.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:07 smithi194 ceph-mon[65619]: poll took 1414.194 ms: 1 events 2021-11-03T16:56:08.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:07 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:08.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:07 smithi194 ceph-mon[65619]: Reconfiguring crash.smithi026 (monmap changed)... 2021-11-03T16:56:08.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:07 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi026", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2021-11-03T16:56:08.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:07 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:56:08.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:07 smithi194 ceph-mon[65619]: Reconfiguring daemon crash.smithi026 on smithi026 2021-11-03T16:56:09.161 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:08 smithi026 ceph-mon[96795]: pgmap v13: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:09.162 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:08 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:09.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:08 smithi194 ceph-mon[65619]: pgmap v13: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:09.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:08 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:10.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:09 smithi026 ceph-mon[96795]: poll took 1419.521 ms: 1 events 2021-11-03T16:56:10.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:09 smithi026 ceph-mon[96795]: Reconfiguring osd.0 (monmap changed)... 2021-11-03T16:56:10.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:09 smithi026 ceph-mon[96795]: Reconfiguring daemon osd.0 on smithi026 2021-11-03T16:56:10.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:09 smithi194 ceph-mon[65619]: poll took 1419.521 ms: 1 events 2021-11-03T16:56:10.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:09 smithi194 ceph-mon[65619]: Reconfiguring osd.0 (monmap changed)... 2021-11-03T16:56:10.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:09 smithi194 ceph-mon[65619]: Reconfiguring daemon osd.0 on smithi026 2021-11-03T16:56:11.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:10 smithi026 ceph-mon[96795]: pgmap v14: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:11.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:10 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:11.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:10 smithi194 ceph-mon[65619]: pgmap v14: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:11.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:10 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:12.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:11 smithi026 ceph-mon[96795]: poll took 1445.087 ms: 1 events 2021-11-03T16:56:12.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:11 smithi026 ceph-mon[96795]: Reconfiguring osd.1 (monmap changed)... 2021-11-03T16:56:12.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:11 smithi026 ceph-mon[96795]: Reconfiguring daemon osd.1 on smithi026 2021-11-03T16:56:12.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:11 smithi194 ceph-mon[65619]: poll took 1445.087 ms: 1 events 2021-11-03T16:56:12.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:11 smithi194 ceph-mon[65619]: Reconfiguring osd.1 (monmap changed)... 2021-11-03T16:56:12.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:11 smithi194 ceph-mon[65619]: Reconfiguring daemon osd.1 on smithi026 2021-11-03T16:56:13.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:13 smithi026 ceph-mon[96795]: pgmap v15: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:13.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:13 smithi026 ceph-mon[96795]: poll took 1427.203 ms: 1 events 2021-11-03T16:56:13.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:13 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:13.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:13 smithi026 ceph-mon[96795]: Reconfiguring osd.2 (monmap changed)... 2021-11-03T16:56:13.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:13 smithi026 ceph-mon[96795]: Reconfiguring daemon osd.2 on smithi026 2021-11-03T16:56:13.471 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:13 smithi194 ceph-mon[65619]: pgmap v15: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:13.472 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:13 smithi194 ceph-mon[65619]: poll took 1427.203 ms: 1 events 2021-11-03T16:56:13.472 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:13 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:13.472 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:13 smithi194 ceph-mon[65619]: Reconfiguring osd.2 (monmap changed)... 2021-11-03T16:56:13.473 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:13 smithi194 ceph-mon[65619]: Reconfiguring daemon osd.2 on smithi026 2021-11-03T16:56:14.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:14 smithi026 ceph-mon[96795]: poll took 1375.096 ms: 1 events 2021-11-03T16:56:14.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:14 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:14.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:14 smithi026 ceph-mon[96795]: Reconfiguring mds.cephfs.smithi026.ltacyh (monmap changed)... 2021-11-03T16:56:14.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:14 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi026.ltacyh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2021-11-03T16:56:14.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:14 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:56:14.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:14 smithi026 ceph-mon[96795]: Reconfiguring daemon mds.cephfs.smithi026.ltacyh on smithi026 2021-11-03T16:56:14.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:14 smithi026 ceph-mon[96795]: pgmap v16: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:14.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:14 smithi194 ceph-mon[65619]: poll took 1375.096 ms: 1 events 2021-11-03T16:56:14.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:14 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:14.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:14 smithi194 ceph-mon[65619]: Reconfiguring mds.cephfs.smithi026.ltacyh (monmap changed)... 2021-11-03T16:56:14.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:14 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi026.ltacyh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2021-11-03T16:56:14.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:14 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:56:14.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:14 smithi194 ceph-mon[65619]: Reconfiguring daemon mds.cephfs.smithi026.ltacyh on smithi026 2021-11-03T16:56:14.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:14 smithi194 ceph-mon[65619]: pgmap v16: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:16.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:16 smithi026 ceph-mon[96795]: poll took 1379.000 ms: 1 events 2021-11-03T16:56:16.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:16 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:16.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:16 smithi026 ceph-mon[96795]: Reconfiguring mds.cephfs.smithi026.yfxlxl (monmap changed)... 2021-11-03T16:56:16.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:16 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi026.yfxlxl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2021-11-03T16:56:16.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:16 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:56:16.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:16 smithi026 ceph-mon[96795]: Reconfiguring daemon mds.cephfs.smithi026.yfxlxl on smithi026 2021-11-03T16:56:16.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:16 smithi026 ceph-mon[96795]: pgmap v17: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:16.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:16 smithi194 ceph-mon[65619]: poll took 1379.000 ms: 1 events 2021-11-03T16:56:16.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:16 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:16.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:16 smithi194 ceph-mon[65619]: Reconfiguring mds.cephfs.smithi026.yfxlxl (monmap changed)... 2021-11-03T16:56:16.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:16 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi026.yfxlxl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2021-11-03T16:56:16.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:16 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:56:16.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:16 smithi194 ceph-mon[65619]: Reconfiguring daemon mds.cephfs.smithi026.yfxlxl on smithi026 2021-11-03T16:56:16.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:16 smithi194 ceph-mon[65619]: pgmap v17: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:18.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:17 smithi194 ceph-mon[65619]: poll took 1393.765 ms: 1 events 2021-11-03T16:56:18.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:17 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:18.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:17 smithi194 ceph-mon[65619]: Reconfiguring crash.smithi194 (monmap changed)... 2021-11-03T16:56:18.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:17 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi194", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2021-11-03T16:56:18.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:17 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:56:18.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:17 smithi194 ceph-mon[65619]: Reconfiguring daemon crash.smithi194 on smithi194 2021-11-03T16:56:18.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:17 smithi026 ceph-mon[96795]: poll took 1393.765 ms: 1 events 2021-11-03T16:56:18.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:17 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:18.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:17 smithi026 ceph-mon[96795]: Reconfiguring crash.smithi194 (monmap changed)... 2021-11-03T16:56:18.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:17 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi194", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2021-11-03T16:56:18.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:17 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:56:18.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:17 smithi026 ceph-mon[96795]: Reconfiguring daemon crash.smithi194 on smithi194 2021-11-03T16:56:19.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:18 smithi194 ceph-mon[65619]: pgmap v18: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:19.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:18 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:19.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:18 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi194.wnexas", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-11-03T16:56:19.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:18 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mgr services"}]: dispatch 2021-11-03T16:56:19.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:18 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:56:19.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:18 smithi026 ceph-mon[96795]: pgmap v18: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:19.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:18 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:19.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:18 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi194.wnexas", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-11-03T16:56:19.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:18 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mgr services"}]: dispatch 2021-11-03T16:56:19.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:18 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:56:20.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.091+0000 7f2ff109b700 1 -- 172.21.15.26:0/2120137014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fec0f6860 msgr2=0x7f2fec0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:56:20.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.091+0000 7f2ff109b700 1 --2- 172.21.15.26:0/2120137014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fec0f6860 0x7f2fec0f6cc0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f2fd4004660 tx=0x7f2fd4009b30).stop 2021-11-03T16:56:20.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.091+0000 7f2ff109b700 1 -- 172.21.15.26:0/2120137014 shutdown_connections 2021-11-03T16:56:20.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.091+0000 7f2ff109b700 1 --2- 172.21.15.26:0/2120137014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fec0f6860 0x7f2fec0f6cc0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:20.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.091+0000 7f2ff109b700 1 --2- 172.21.15.26:0/2120137014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2fec0f55c0 0x7f2fec0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:20.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.091+0000 7f2ff109b700 1 -- 172.21.15.26:0/2120137014 >> 172.21.15.26:0/2120137014 conn(0x7f2fec0f0d40 msgr2=0x7f2fec0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:56:20.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.091+0000 7f2ff109b700 1 -- 172.21.15.26:0/2120137014 shutdown_connections 2021-11-03T16:56:20.090 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.091+0000 7f2ff109b700 1 -- 172.21.15.26:0/2120137014 wait complete. 2021-11-03T16:56:20.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.092+0000 7f2ff109b700 1 Processor -- start 2021-11-03T16:56:20.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.092+0000 7f2ff109b700 1 -- start start 2021-11-03T16:56:20.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.092+0000 7f2ff109b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2fec0f55c0 0x7f2fec106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:56:20.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.092+0000 7f2ff109b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fec0f6860 0x7f2fec1073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:56:20.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.092+0000 7f2ff109b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec107990 con 0x7f2fec0f6860 2021-11-03T16:56:20.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.092+0000 7f2ff109b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec107ad0 con 0x7f2fec0f55c0 2021-11-03T16:56:20.094 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.092+0000 7f2fea59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fec0f6860 0x7f2fec1073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:56:20.094 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.092+0000 7f2fea59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fec0f6860 0x7f2fec1073e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51148/0 (socket says 172.21.15.26:51148) 2021-11-03T16:56:20.094 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.092+0000 7f2fea59c700 1 -- 172.21.15.26:0/107105807 learned_addr learned my addr 172.21.15.26:0/107105807 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:56:20.094 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.092+0000 7f2fead9d700 1 --2- 172.21.15.26:0/107105807 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2fec0f55c0 0x7f2fec106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:56:20.094 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.093+0000 7f2fea59c700 1 -- 172.21.15.26:0/107105807 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2fec0f55c0 msgr2=0x7f2fec106ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:56:20.095 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.093+0000 7f2fea59c700 1 --2- 172.21.15.26:0/107105807 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2fec0f55c0 0x7f2fec106ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:20.095 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.093+0000 7f2fea59c700 1 -- 172.21.15.26:0/107105807 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd4005040 con 0x7f2fec0f6860 2021-11-03T16:56:20.095 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.093+0000 7f2fea59c700 1 --2- 172.21.15.26:0/107105807 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fec0f6860 0x7f2fec1073e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f2fd4009830 tx=0x7f2fd4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:56:20.095 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.093+0000 7f2fe37fe700 1 -- 172.21.15.26:0/107105807 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fd4018070 con 0x7f2fec0f6860 2021-11-03T16:56:20.096 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.093+0000 7f2fe37fe700 1 -- 172.21.15.26:0/107105807 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2fd4007ba0 con 0x7f2fec0f6860 2021-11-03T16:56:20.096 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.093+0000 7f2ff109b700 1 -- 172.21.15.26:0/107105807 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fec108410 con 0x7f2fec0f6860 2021-11-03T16:56:20.096 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.093+0000 7f2fe37fe700 1 -- 172.21.15.26:0/107105807 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fd401c3c0 con 0x7f2fec0f6860 2021-11-03T16:56:20.097 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.093+0000 7f2ff109b700 1 -- 172.21.15.26:0/107105807 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fec108970 con 0x7f2fec0f6860 2021-11-03T16:56:20.098 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.094+0000 7f2ff109b700 1 -- 172.21.15.26:0/107105807 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fec045ad0 con 0x7f2fec0f6860 2021-11-03T16:56:20.098 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.094+0000 7f2fe37fe700 1 -- 172.21.15.26:0/107105807 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f2fd4007d10 con 0x7f2fec0f6860 2021-11-03T16:56:20.098 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.095+0000 7f2fe37fe700 1 --2- 172.21.15.26:0/107105807 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2fd8064090 0x7f2fd8066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:56:20.098 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.095+0000 7f2fe37fe700 1 -- 172.21.15.26:0/107105807 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f2fd4082420 con 0x7f2fec0f6860 2021-11-03T16:56:20.099 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.095+0000 7f2fead9d700 1 --2- 172.21.15.26:0/107105807 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2fd8064090 0x7f2fd8066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:56:20.099 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.095+0000 7f2fead9d700 1 --2- 172.21.15.26:0/107105807 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2fd8064090 0x7f2fd8066550 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f2fec0f66c0 tx=0x7f2fe4009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:56:20.099 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.099+0000 7f2fe37fe700 1 -- 172.21.15.26:0/107105807 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f2fd4054780 con 0x7f2fec0f6860 2021-11-03T16:56:20.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:19 smithi194 ceph-mon[65619]: poll took 1199.130 ms: 1 events 2021-11-03T16:56:20.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:19 smithi194 ceph-mon[65619]: Reconfiguring mgr.smithi194.wnexas (monmap changed)... 2021-11-03T16:56:20.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:19 smithi194 ceph-mon[65619]: Reconfiguring daemon mgr.smithi194.wnexas on smithi194 2021-11-03T16:56:20.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:19 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:20.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:19 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-11-03T16:56:20.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:19 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-11-03T16:56:20.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:19 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:56:20.277 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.280+0000 7f2ff109b700 1 -- 172.21.15.26:0/107105807 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2fec0faca0 con 0x7f2fd8064090 2021-11-03T16:56:20.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.282+0000 7f2fe37fe700 1 -- 172.21.15.26:0/107105807 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+303 (secure 0 0 0) 0x7f2fec0faca0 con 0x7f2fd8064090 2021-11-03T16:56:20.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.284+0000 7f2ff109b700 1 -- 172.21.15.26:0/107105807 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2fd8064090 msgr2=0x7f2fd8066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:56:20.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.284+0000 7f2ff109b700 1 --2- 172.21.15.26:0/107105807 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2fd8064090 0x7f2fd8066550 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f2fec0f66c0 tx=0x7f2fe4009040).stop 2021-11-03T16:56:20.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.284+0000 7f2ff109b700 1 -- 172.21.15.26:0/107105807 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fec0f6860 msgr2=0x7f2fec1073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:56:20.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.284+0000 7f2ff109b700 1 --2- 172.21.15.26:0/107105807 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fec0f6860 0x7f2fec1073e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f2fd4009830 tx=0x7f2fd4009b30).stop 2021-11-03T16:56:20.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.284+0000 7f2ff109b700 1 -- 172.21.15.26:0/107105807 shutdown_connections 2021-11-03T16:56:20.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.284+0000 7f2ff109b700 1 --2- 172.21.15.26:0/107105807 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2fd8064090 0x7f2fd8066550 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:20.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.284+0000 7f2ff109b700 1 --2- 172.21.15.26:0/107105807 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2fec0f55c0 0x7f2fec106ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:20.282 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.284+0000 7f2ff109b700 1 --2- 172.21.15.26:0/107105807 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fec0f6860 0x7f2fec1073e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:20.282 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.284+0000 7f2ff109b700 1 -- 172.21.15.26:0/107105807 >> 172.21.15.26:0/107105807 conn(0x7f2fec0f0d40 msgr2=0x7f2fec05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:56:20.282 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.284+0000 7f2ff109b700 1 -- 172.21.15.26:0/107105807 shutdown_connections 2021-11-03T16:56:20.282 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.284+0000 7f2ff109b700 1 -- 172.21.15.26:0/107105807 wait complete. 2021-11-03T16:56:20.290 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T16:56:20.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.385+0000 7fe2be448700 1 -- 172.21.15.26:0/2026054342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2b80f6ff0 msgr2=0x7fe2b80f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:56:20.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.385+0000 7fe2be448700 1 --2- 172.21.15.26:0/2026054342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2b80f6ff0 0x7fe2b80f7a20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fe2a8004660 tx=0x7fe2a8009b30).stop 2021-11-03T16:56:20.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.385+0000 7fe2be448700 1 -- 172.21.15.26:0/2026054342 shutdown_connections 2021-11-03T16:56:20.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.385+0000 7fe2be448700 1 --2- 172.21.15.26:0/2026054342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2b80f6ff0 0x7fe2b80f7a20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:20.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.385+0000 7fe2be448700 1 --2- 172.21.15.26:0/2026054342 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2b80f66e0 0x7fe2b80f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:20.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.385+0000 7fe2be448700 1 -- 172.21.15.26:0/2026054342 >> 172.21.15.26:0/2026054342 conn(0x7fe2b80f1f00 msgr2=0x7fe2b80f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:56:20.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.385+0000 7fe2be448700 1 -- 172.21.15.26:0/2026054342 shutdown_connections 2021-11-03T16:56:20.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.385+0000 7fe2be448700 1 -- 172.21.15.26:0/2026054342 wait complete. 2021-11-03T16:56:20.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.386+0000 7fe2be448700 1 Processor -- start 2021-11-03T16:56:20.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.386+0000 7fe2be448700 1 -- start start 2021-11-03T16:56:20.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.386+0000 7fe2be448700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2b80f66e0 0x7fe2b8107070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:56:20.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.386+0000 7fe2be448700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2b8107560 0x7fe2b8108450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:56:20.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.386+0000 7fe2be448700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b8107a30 con 0x7fe2b80f66e0 2021-11-03T16:56:20.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.386+0000 7fe2be448700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b8107b70 con 0x7fe2b8107560 2021-11-03T16:56:20.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.386+0000 7fe2b7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2b80f66e0 0x7fe2b8107070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:56:20.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.386+0000 7fe2b7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2b80f66e0 0x7fe2b8107070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51154/0 (socket says 172.21.15.26:51154) 2021-11-03T16:56:20.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.386+0000 7fe2b7fff700 1 -- 172.21.15.26:0/4090740818 learned_addr learned my addr 172.21.15.26:0/4090740818 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:56:20.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.386+0000 7fe2b77fe700 1 --2- 172.21.15.26:0/4090740818 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2b8107560 0x7fe2b8108450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:56:20.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.386+0000 7fe2b7fff700 1 -- 172.21.15.26:0/4090740818 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2b8107560 msgr2=0x7fe2b8108450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:56:20.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.386+0000 7fe2b7fff700 1 --2- 172.21.15.26:0/4090740818 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2b8107560 0x7fe2b8108450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:20.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.386+0000 7fe2b7fff700 1 -- 172.21.15.26:0/4090740818 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a8005040 con 0x7fe2b80f66e0 2021-11-03T16:56:20.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.387+0000 7fe2b7fff700 1 --2- 172.21.15.26:0/4090740818 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2b80f66e0 0x7fe2b8107070 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fe2ac00e7f0 tx=0x7fe2ac00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:56:20.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.387+0000 7fe2b4ff9700 1 -- 172.21.15.26:0/4090740818 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2ac0092e0 con 0x7fe2b80f66e0 2021-11-03T16:56:20.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.387+0000 7fe2b4ff9700 1 -- 172.21.15.26:0/4090740818 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe2ac00f040 con 0x7fe2b80f66e0 2021-11-03T16:56:20.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.387+0000 7fe2be448700 1 -- 172.21.15.26:0/4090740818 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b8108a00 con 0x7fe2b80f66e0 2021-11-03T16:56:20.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.387+0000 7fe2b4ff9700 1 -- 172.21.15.26:0/4090740818 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2ac014750 con 0x7fe2b80f66e0 2021-11-03T16:56:20.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.387+0000 7fe2be448700 1 -- 172.21.15.26:0/4090740818 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b8108fc0 con 0x7fe2b80f66e0 2021-11-03T16:56:20.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.388+0000 7fe2be448700 1 -- 172.21.15.26:0/4090740818 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2b8045ad0 con 0x7fe2b80f66e0 2021-11-03T16:56:20.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.388+0000 7fe2b4ff9700 1 -- 172.21.15.26:0/4090740818 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fe2ac01b030 con 0x7fe2b80f66e0 2021-11-03T16:56:20.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.388+0000 7fe2b4ff9700 1 --2- 172.21.15.26:0/4090740818 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe2a00640b0 0x7fe2a0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:56:20.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.389+0000 7fe2b4ff9700 1 -- 172.21.15.26:0/4090740818 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fe2ac080650 con 0x7fe2b80f66e0 2021-11-03T16:56:20.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.389+0000 7fe2b77fe700 1 --2- 172.21.15.26:0/4090740818 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe2a00640b0 0x7fe2a0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:56:20.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.389+0000 7fe2b77fe700 1 --2- 172.21.15.26:0/4090740818 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe2a00640b0 0x7fe2a0066570 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fe2a8004630 tx=0x7fe2a8009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:56:20.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.393+0000 7fe2b4ff9700 1 -- 172.21.15.26:0/4090740818 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fe2ac0528f0 con 0x7fe2b80f66e0 2021-11-03T16:56:20.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:19 smithi026 ceph-mon[96795]: poll took 1199.130 ms: 1 events 2021-11-03T16:56:20.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:19 smithi026 ceph-mon[96795]: Reconfiguring mgr.smithi194.wnexas (monmap changed)... 2021-11-03T16:56:20.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:19 smithi026 ceph-mon[96795]: Reconfiguring daemon mgr.smithi194.wnexas on smithi194 2021-11-03T16:56:20.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:19 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:20.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:19 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-11-03T16:56:20.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:19 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-11-03T16:56:20.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:19 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:56:20.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.564+0000 7fe2be448700 1 -- 172.21.15.26:0/4090740818 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe2b80feed0 con 0x7fe2a00640b0 2021-11-03T16:56:20.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.579+0000 7fe2b4ff9700 1 -- 172.21.15.26:0/4090740818 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fe2b80feed0 con 0x7fe2a00640b0 2021-11-03T16:56:20.575 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T16:56:20.575 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (7m) 26s ago 8m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T16:56:20.576 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (8m) 26s ago 8m 7017k - 16.2.4 8d91d370c2b8 83a448d79108 2021-11-03T16:56:20.576 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (8m) 17s ago 8m 7138k - 16.2.4 8d91d370c2b8 708c0ec0397b 2021-11-03T16:56:20.576 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (7m) 26s ago 8m 38.5M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T16:56:20.576 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (33s) 26s ago 3m 12.2M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T16:56:20.577 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (52s) 26s ago 3m 13.4M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T16:56:20.577 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (4m) 17s ago 4m 15.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T16:56:20.577 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (3m) 17s ago 3m 15.5M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T16:56:20.577 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (78s) 26s ago 10m 436M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T16:56:20.578 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (54s) 17s ago 8m 409M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T16:56:20.578 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (42s) 26s ago 10m 54.9M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T16:56:20.578 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (21s) 17s ago 7m 21.1M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T16:56:20.579 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (8m) 26s ago 8m 18.1M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T16:56:20.579 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (7m) 17s ago 7m 18.3M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T16:56:20.579 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (7m) 26s ago 7m 406M 4096M 16.2.4 8d91d370c2b8 d7f900ddf0f3 2021-11-03T16:56:20.579 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (6m) 26s ago 6m 409M 4096M 16.2.4 8d91d370c2b8 9e5ffa11984b 2021-11-03T16:56:20.579 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (6m) 26s ago 6m 348M 4096M 16.2.4 8d91d370c2b8 f65145633c0e 2021-11-03T16:56:20.580 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (6m) 17s ago 6m 494M 4096M 16.2.4 8d91d370c2b8 ff6d474a5f9a 2021-11-03T16:56:20.580 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (5m) 17s ago 5m 422M 4096M 16.2.4 8d91d370c2b8 e2fc9c0bdf0f 2021-11-03T16:56:20.580 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (5m) 17s ago 5m 470M 4096M 16.2.4 8d91d370c2b8 0abc64d8a2bf 2021-11-03T16:56:20.580 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (7m) 26s ago 8m 42.9M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T16:56:20.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.581+0000 7fe2be448700 1 -- 172.21.15.26:0/4090740818 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe2a00640b0 msgr2=0x7fe2a0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:56:20.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.581+0000 7fe2be448700 1 --2- 172.21.15.26:0/4090740818 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe2a00640b0 0x7fe2a0066570 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fe2a8004630 tx=0x7fe2a8009b30).stop 2021-11-03T16:56:20.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.581+0000 7fe2be448700 1 -- 172.21.15.26:0/4090740818 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2b80f66e0 msgr2=0x7fe2b8107070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:56:20.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.581+0000 7fe2be448700 1 --2- 172.21.15.26:0/4090740818 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2b80f66e0 0x7fe2b8107070 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fe2ac00e7f0 tx=0x7fe2ac00b040).stop 2021-11-03T16:56:20.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.581+0000 7fe2be448700 1 -- 172.21.15.26:0/4090740818 shutdown_connections 2021-11-03T16:56:20.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.581+0000 7fe2be448700 1 --2- 172.21.15.26:0/4090740818 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe2a00640b0 0x7fe2a0066570 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:20.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.581+0000 7fe2be448700 1 --2- 172.21.15.26:0/4090740818 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2b80f66e0 0x7fe2b8107070 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:20.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.581+0000 7fe2be448700 1 --2- 172.21.15.26:0/4090740818 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2b8107560 0x7fe2b8108450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:20.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.581+0000 7fe2be448700 1 -- 172.21.15.26:0/4090740818 >> 172.21.15.26:0/4090740818 conn(0x7fe2b80f1f00 msgr2=0x7fe2b80fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:56:20.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.581+0000 7fe2be448700 1 -- 172.21.15.26:0/4090740818 shutdown_connections 2021-11-03T16:56:20.584 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.581+0000 7fe2be448700 1 -- 172.21.15.26:0/4090740818 wait complete. 2021-11-03T16:56:20.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.680+0000 7f437d468700 1 -- 172.21.15.26:0/3104344314 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43780f6860 msgr2=0x7f43780f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:56:20.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.680+0000 7f437d468700 1 --2- 172.21.15.26:0/3104344314 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43780f6860 0x7f43780f6cc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f436c004660 tx=0x7f436c009b30).stop 2021-11-03T16:56:20.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.680+0000 7f437d468700 1 -- 172.21.15.26:0/3104344314 shutdown_connections 2021-11-03T16:56:20.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.680+0000 7f437d468700 1 --2- 172.21.15.26:0/3104344314 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43780f6860 0x7f43780f6cc0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:20.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.680+0000 7f437d468700 1 --2- 172.21.15.26:0/3104344314 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43780f55c0 0x7f43780f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:20.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.680+0000 7f437d468700 1 -- 172.21.15.26:0/3104344314 >> 172.21.15.26:0/3104344314 conn(0x7f43780f0d40 msgr2=0x7f43780f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:56:20.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.680+0000 7f437d468700 1 -- 172.21.15.26:0/3104344314 shutdown_connections 2021-11-03T16:56:20.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.680+0000 7f437d468700 1 -- 172.21.15.26:0/3104344314 wait complete. 2021-11-03T16:56:20.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.681+0000 7f437d468700 1 Processor -- start 2021-11-03T16:56:20.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.681+0000 7f437d468700 1 -- start start 2021-11-03T16:56:20.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.681+0000 7f437d468700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43780f55c0 0x7f4378109be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:56:20.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.681+0000 7f437d468700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43780f6860 0x7f437810c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:56:20.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.681+0000 7f437d468700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43780604e0 con 0x7f43780f55c0 2021-11-03T16:56:20.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.681+0000 7f437d468700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4378060620 con 0x7f43780f6860 2021-11-03T16:56:20.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.681+0000 7f4376ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43780f55c0 0x7f4378109be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:56:20.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.681+0000 7f4376ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43780f55c0 0x7f4378109be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51164/0 (socket says 172.21.15.26:51164) 2021-11-03T16:56:20.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.681+0000 7f4376ffd700 1 -- 172.21.15.26:0/2159971033 learned_addr learned my addr 172.21.15.26:0/2159971033 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:56:20.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.681+0000 7f43767fc700 1 --2- 172.21.15.26:0/2159971033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43780f6860 0x7f437810c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:56:20.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.682+0000 7f4376ffd700 1 -- 172.21.15.26:0/2159971033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43780f6860 msgr2=0x7f437810c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:56:20.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.682+0000 7f4376ffd700 1 --2- 172.21.15.26:0/2159971033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43780f6860 0x7f437810c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:20.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.682+0000 7f4376ffd700 1 -- 172.21.15.26:0/2159971033 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f436c005040 con 0x7f43780f55c0 2021-11-03T16:56:20.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.682+0000 7f4376ffd700 1 --2- 172.21.15.26:0/2159971033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43780f55c0 0x7f4378109be0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f436800e7c0 tx=0x7f436800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:56:20.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.682+0000 7f435f7fe700 1 -- 172.21.15.26:0/2159971033 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43680092e0 con 0x7f43780f55c0 2021-11-03T16:56:20.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.682+0000 7f435f7fe700 1 -- 172.21.15.26:0/2159971033 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f436800f040 con 0x7f43780f55c0 2021-11-03T16:56:20.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.682+0000 7f437d468700 1 -- 172.21.15.26:0/2159971033 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f437810c690 con 0x7f43780f55c0 2021-11-03T16:56:20.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.682+0000 7f435f7fe700 1 -- 172.21.15.26:0/2159971033 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43680147e0 con 0x7f43780f55c0 2021-11-03T16:56:20.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.682+0000 7f437d468700 1 -- 172.21.15.26:0/2159971033 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f437810cc20 con 0x7f43780f55c0 2021-11-03T16:56:20.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.683+0000 7f437d468700 1 -- 172.21.15.26:0/2159971033 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43780f49b0 con 0x7f43780f55c0 2021-11-03T16:56:20.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.683+0000 7f435f7fe700 1 -- 172.21.15.26:0/2159971033 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f436801b030 con 0x7f43780f55c0 2021-11-03T16:56:20.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.684+0000 7f435f7fe700 1 --2- 172.21.15.26:0/2159971033 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f43600640b0 0x7f4360066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:56:20.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.684+0000 7f435f7fe700 1 -- 172.21.15.26:0/2159971033 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f4368080810 con 0x7f43780f55c0 2021-11-03T16:56:20.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.684+0000 7f43767fc700 1 --2- 172.21.15.26:0/2159971033 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f43600640b0 0x7f4360066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:56:20.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.684+0000 7f43767fc700 1 --2- 172.21.15.26:0/2159971033 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f43600640b0 0x7f4360066570 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f436c005010 tx=0x7f436c016040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:56:20.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.688+0000 7f435f7fe700 1 -- 172.21.15.26:0/2159971033 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f4368052a80 con 0x7f43780f55c0 2021-11-03T16:56:20.915 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.918+0000 7f437d468700 1 -- 172.21.15.26:0/2159971033 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f43780fdf10 con 0x7f43780f55c0 2021-11-03T16:56:20.915 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.919+0000 7f435f7fe700 1 -- 172.21.15.26:0/2159971033 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+700 (secure 0 0 0) 0x7f43780fdf10 con 0x7f43780f55c0 2021-11-03T16:56:20.916 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T16:56:20.916 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T16:56:20.916 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T16:56:20.917 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:56:20.917 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T16:56:20.917 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T16:56:20.918 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:56:20.918 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T16:56:20.918 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2021-11-03T16:56:20.918 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:56:20.919 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T16:56:20.919 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T16:56:20.919 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:56:20.919 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T16:56:20.919 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 10, 2021-11-03T16:56:20.920 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 4 2021-11-03T16:56:20.920 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T16:56:20.920 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T16:56:20.921 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.921+0000 7f437d468700 1 -- 172.21.15.26:0/2159971033 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f43600640b0 msgr2=0x7f4360066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:56:20.921 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.921+0000 7f437d468700 1 --2- 172.21.15.26:0/2159971033 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f43600640b0 0x7f4360066570 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f436c005010 tx=0x7f436c016040).stop 2021-11-03T16:56:20.922 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.921+0000 7f437d468700 1 -- 172.21.15.26:0/2159971033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43780f55c0 msgr2=0x7f4378109be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:56:20.922 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.921+0000 7f437d468700 1 --2- 172.21.15.26:0/2159971033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43780f55c0 0x7f4378109be0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f436800e7c0 tx=0x7f436800b040).stop 2021-11-03T16:56:20.922 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.921+0000 7f437d468700 1 -- 172.21.15.26:0/2159971033 shutdown_connections 2021-11-03T16:56:20.922 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.921+0000 7f437d468700 1 --2- 172.21.15.26:0/2159971033 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f43600640b0 0x7f4360066570 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:20.923 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.921+0000 7f437d468700 1 --2- 172.21.15.26:0/2159971033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43780f55c0 0x7f4378109be0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:20.923 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.921+0000 7f437d468700 1 --2- 172.21.15.26:0/2159971033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43780f6860 0x7f437810c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:20.923 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.921+0000 7f437d468700 1 -- 172.21.15.26:0/2159971033 >> 172.21.15.26:0/2159971033 conn(0x7f43780f0d40 msgr2=0x7f43780fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:56:20.923 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.921+0000 7f437d468700 1 -- 172.21.15.26:0/2159971033 shutdown_connections 2021-11-03T16:56:20.923 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:20.921+0000 7f437d468700 1 -- 172.21.15.26:0/2159971033 wait complete. 2021-11-03T16:56:21.018 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.022+0000 7f2065d9d700 1 -- 172.21.15.26:0/2682145297 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20600f66e0 msgr2=0x7f20600f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:56:21.019 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.022+0000 7f2065d9d700 1 --2- 172.21.15.26:0/2682145297 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20600f66e0 0x7f20600f6b40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f204c004660 tx=0x7f204c009b30).stop 2021-11-03T16:56:21.019 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.022+0000 7f2065d9d700 1 -- 172.21.15.26:0/2682145297 shutdown_connections 2021-11-03T16:56:21.019 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.022+0000 7f2065d9d700 1 --2- 172.21.15.26:0/2682145297 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20600f66e0 0x7f20600f6b40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:21.019 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.022+0000 7f2065d9d700 1 --2- 172.21.15.26:0/2682145297 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20600f5440 0x7f20600f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:21.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.022+0000 7f2065d9d700 1 -- 172.21.15.26:0/2682145297 >> 172.21.15.26:0/2682145297 conn(0x7f20600f0ba0 msgr2=0x7f20600f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:56:21.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.022+0000 7f2065d9d700 1 -- 172.21.15.26:0/2682145297 shutdown_connections 2021-11-03T16:56:21.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.022+0000 7f2065d9d700 1 -- 172.21.15.26:0/2682145297 wait complete. 2021-11-03T16:56:21.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.022+0000 7f2065d9d700 1 Processor -- start 2021-11-03T16:56:21.021 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.022+0000 7f2065d9d700 1 -- start start 2021-11-03T16:56:21.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.023+0000 7f2065d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20600f5440 0x7f2060106dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:56:21.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.023+0000 7f2065d9d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20600f66e0 0x7f20601072c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:56:21.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.023+0000 7f2065d9d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20601078c0 con 0x7f20600f5440 2021-11-03T16:56:21.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.023+0000 7f2065d9d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2060108100 con 0x7f20600f66e0 2021-11-03T16:56:21.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.023+0000 7f2064d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20600f5440 0x7f2060106dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:56:21.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.023+0000 7f2064d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20600f5440 0x7f2060106dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51174/0 (socket says 172.21.15.26:51174) 2021-11-03T16:56:21.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.023+0000 7f2064d9b700 1 -- 172.21.15.26:0/100420890 learned_addr learned my addr 172.21.15.26:0/100420890 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:56:21.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.023+0000 7f205ffff700 1 --2- 172.21.15.26:0/100420890 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20600f66e0 0x7f20601072c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:56:21.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.023+0000 7f2064d9b700 1 -- 172.21.15.26:0/100420890 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20600f66e0 msgr2=0x7f20601072c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:56:21.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.023+0000 7f2064d9b700 1 --2- 172.21.15.26:0/100420890 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20600f66e0 0x7f20601072c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:21.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.023+0000 7f2064d9b700 1 -- 172.21.15.26:0/100420890 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f204c005040 con 0x7f20600f5440 2021-11-03T16:56:21.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.023+0000 7f2064d9b700 1 --2- 172.21.15.26:0/100420890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20600f5440 0x7f2060106dd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f20540026d0 tx=0x7f2054009dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:56:21.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.023+0000 7f205d7fa700 1 -- 172.21.15.26:0/100420890 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20540079c0 con 0x7f20600f5440 2021-11-03T16:56:21.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.023+0000 7f205d7fa700 1 -- 172.21.15.26:0/100420890 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f205400f040 con 0x7f20600f5440 2021-11-03T16:56:21.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.023+0000 7f2065d9d700 1 -- 172.21.15.26:0/100420890 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20601083e0 con 0x7f20600f5440 2021-11-03T16:56:21.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.023+0000 7f205d7fa700 1 -- 172.21.15.26:0/100420890 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2054014840 con 0x7f20600f5440 2021-11-03T16:56:21.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.023+0000 7f2065d9d700 1 -- 172.21.15.26:0/100420890 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2060108920 con 0x7f20600f5440 2021-11-03T16:56:21.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.024+0000 7f2065d9d700 1 -- 172.21.15.26:0/100420890 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2060059100 con 0x7f20600f5440 2021-11-03T16:56:21.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.025+0000 7f205d7fa700 1 -- 172.21.15.26:0/100420890 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f205401b060 con 0x7f20600f5440 2021-11-03T16:56:21.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.025+0000 7f205d7fa700 1 --2- 172.21.15.26:0/100420890 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2050064100 0x7f20500665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:56:21.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.025+0000 7f205d7fa700 1 -- 172.21.15.26:0/100420890 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f2054080740 con 0x7f20600f5440 2021-11-03T16:56:21.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.025+0000 7f205ffff700 1 --2- 172.21.15.26:0/100420890 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2050064100 0x7f20500665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:56:21.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.026+0000 7f205ffff700 1 --2- 172.21.15.26:0/100420890 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2050064100 0x7f20500665c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f204c009da0 tx=0x7f204c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:56:21.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.029+0000 7f205d7fa700 1 -- 172.21.15.26:0/100420890 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f2054052aa0 con 0x7f20600f5440 2021-11-03T16:56:21.229 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.232+0000 7f2065d9d700 1 -- 172.21.15.26:0/100420890 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2060045b50 con 0x7f20600f5440 2021-11-03T16:56:21.229 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.233+0000 7f205d7fa700 1 -- 172.21.15.26:0/100420890 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f2060045b50 con 0x7f20600f5440 2021-11-03T16:56:21.230 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T16:56:21.230 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T16:56:21.230 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T16:56:21.230 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T16:56:21.231 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:56:21.231 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T16:56:21.231 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T16:56:21.231 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T16:56:21.232 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T16:56:21.232 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T16:56:21.232 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T16:56:21.232 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T16:56:21.233 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T16:56:21.233 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T16:56:21.233 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T16:56:21.233 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T16:56:21.233 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T16:56:21.234 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T16:56:21.234 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T16:56:21.234 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T16:56:21.234 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T16:56:21.235 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T16:56:21.235 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T16:56:21.235 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T16:56:21.236 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T16:56:21.236 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T16:56:21.236 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T16:56:21.236 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T16:56:21.237 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T16:56:21.237 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T16:56:21.238 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T16:56:21.238 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:56:21.238 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:56:21.238 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T16:56:21.239 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:56:21.239 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T16:56:21.239 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T16:56:21.239 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T16:56:21.240 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T16:56:21.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.235+0000 7f2065d9d700 1 -- 172.21.15.26:0/100420890 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2050064100 msgr2=0x7f20500665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:56:21.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.235+0000 7f2065d9d700 1 --2- 172.21.15.26:0/100420890 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2050064100 0x7f20500665c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f204c009da0 tx=0x7f204c009b30).stop 2021-11-03T16:56:21.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.235+0000 7f2065d9d700 1 -- 172.21.15.26:0/100420890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20600f5440 msgr2=0x7f2060106dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:56:21.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.235+0000 7f2065d9d700 1 --2- 172.21.15.26:0/100420890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20600f5440 0x7f2060106dd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f20540026d0 tx=0x7f2054009dc0).stop 2021-11-03T16:56:21.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.235+0000 7f2065d9d700 1 -- 172.21.15.26:0/100420890 shutdown_connections 2021-11-03T16:56:21.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.235+0000 7f2065d9d700 1 --2- 172.21.15.26:0/100420890 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2050064100 0x7f20500665c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:21.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.235+0000 7f2065d9d700 1 --2- 172.21.15.26:0/100420890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20600f5440 0x7f2060106dd0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:21.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.235+0000 7f2065d9d700 1 --2- 172.21.15.26:0/100420890 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20600f66e0 0x7f20601072c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:21.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.235+0000 7f2065d9d700 1 -- 172.21.15.26:0/100420890 >> 172.21.15.26:0/100420890 conn(0x7f20600f0ba0 msgr2=0x7f206005f620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:56:21.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.235+0000 7f2065d9d700 1 -- 172.21.15.26:0/100420890 shutdown_connections 2021-11-03T16:56:21.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:21.235+0000 7f2065d9d700 1 -- 172.21.15.26:0/100420890 wait complete. 2021-11-03T16:56:21.244 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T16:56:21.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:20 smithi194 ceph-mon[65619]: poll took 1106.520 ms: 1 events 2021-11-03T16:56:21.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:20 smithi194 ceph-mon[65619]: Reconfiguring mon.smithi194 (monmap changed)... 2021-11-03T16:56:21.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:20 smithi194 ceph-mon[65619]: Reconfiguring daemon mon.smithi194 on smithi194 2021-11-03T16:56:21.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:20 smithi194 ceph-mon[65619]: pgmap v19: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:21.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:20 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2159971033' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:56:21.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:20 smithi026 ceph-mon[96795]: poll took 1106.520 ms: 1 events 2021-11-03T16:56:21.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:20 smithi026 ceph-mon[96795]: Reconfiguring mon.smithi194 (monmap changed)... 2021-11-03T16:56:21.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:20 smithi026 ceph-mon[96795]: Reconfiguring daemon mon.smithi194 on smithi194 2021-11-03T16:56:21.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:20 smithi026 ceph-mon[96795]: pgmap v19: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:21.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:20 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2159971033' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:56:22.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:21 smithi194 ceph-mon[65619]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:56:22.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:21 smithi194 ceph-mon[65619]: from='client.34154 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:56:22.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:21 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:22.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:21 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/100420890' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T16:56:22.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:21 smithi026 ceph-mon[96795]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:56:22.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:21 smithi026 ceph-mon[96795]: from='client.34154 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:56:22.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:21 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:22.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:21 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/100420890' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T16:56:23.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:22 smithi194 ceph-mon[65619]: poll took 1088.431 ms: 1 events 2021-11-03T16:56:23.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:22 smithi194 ceph-mon[65619]: Reconfiguring osd.3 (monmap changed)... 2021-11-03T16:56:23.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:22 smithi194 ceph-mon[65619]: Reconfiguring daemon osd.3 on smithi194 2021-11-03T16:56:23.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:22 smithi194 ceph-mon[65619]: pgmap v20: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:23.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:22 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:23.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:22 smithi026 ceph-mon[96795]: poll took 1088.431 ms: 1 events 2021-11-03T16:56:23.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:22 smithi026 ceph-mon[96795]: Reconfiguring osd.3 (monmap changed)... 2021-11-03T16:56:23.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:22 smithi026 ceph-mon[96795]: Reconfiguring daemon osd.3 on smithi194 2021-11-03T16:56:23.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:22 smithi026 ceph-mon[96795]: pgmap v20: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:23.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:22 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:24.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:24 smithi194 ceph-mon[65619]: poll took 1075.696 ms: 1 events 2021-11-03T16:56:24.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:24 smithi194 ceph-mon[65619]: Reconfiguring osd.4 (monmap changed)... 2021-11-03T16:56:24.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:24 smithi194 ceph-mon[65619]: Reconfiguring daemon osd.4 on smithi194 2021-11-03T16:56:24.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:24.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:24 smithi026 ceph-mon[96795]: poll took 1075.696 ms: 1 events 2021-11-03T16:56:24.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:24 smithi026 ceph-mon[96795]: Reconfiguring osd.4 (monmap changed)... 2021-11-03T16:56:24.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:24 smithi026 ceph-mon[96795]: Reconfiguring daemon osd.4 on smithi194 2021-11-03T16:56:24.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:25.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:25 smithi194 ceph-mon[65619]: poll took 1077.935 ms: 1 events 2021-11-03T16:56:25.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:25 smithi194 ceph-mon[65619]: Reconfiguring osd.5 (monmap changed)... 2021-11-03T16:56:25.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:25 smithi194 ceph-mon[65619]: Reconfiguring daemon osd.5 on smithi194 2021-11-03T16:56:25.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:25 smithi194 ceph-mon[65619]: pgmap v21: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:25.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:25 smithi026 ceph-mon[96795]: poll took 1077.935 ms: 1 events 2021-11-03T16:56:25.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:25 smithi026 ceph-mon[96795]: Reconfiguring osd.5 (monmap changed)... 2021-11-03T16:56:25.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:25 smithi026 ceph-mon[96795]: Reconfiguring daemon osd.5 on smithi194 2021-11-03T16:56:25.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:25 smithi026 ceph-mon[96795]: pgmap v21: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:26.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:26 smithi194 ceph-mon[65619]: poll took 1075.585 ms: 1 events 2021-11-03T16:56:26.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:26 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:26.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:26 smithi194 ceph-mon[65619]: Reconfiguring mds.cephfs.smithi194.kwikhp (monmap changed)... 2021-11-03T16:56:26.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:26 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi194.kwikhp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2021-11-03T16:56:26.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:26 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:56:26.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:26 smithi194 ceph-mon[65619]: Reconfiguring daemon mds.cephfs.smithi194.kwikhp on smithi194 2021-11-03T16:56:26.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:26 smithi194 ceph-mon[65619]: pgmap v22: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:26.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:26 smithi026 ceph-mon[96795]: poll took 1075.585 ms: 1 events 2021-11-03T16:56:26.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:26 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:26.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:26 smithi026 ceph-mon[96795]: Reconfiguring mds.cephfs.smithi194.kwikhp (monmap changed)... 2021-11-03T16:56:26.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:26 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi194.kwikhp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2021-11-03T16:56:26.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:26 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:56:26.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:26 smithi026 ceph-mon[96795]: Reconfiguring daemon mds.cephfs.smithi194.kwikhp on smithi194 2021-11-03T16:56:26.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:26 smithi026 ceph-mon[96795]: pgmap v22: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:27.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:27 smithi194 ceph-mon[65619]: poll took 1085.810 ms: 1 events 2021-11-03T16:56:27.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:27 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:27.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:27 smithi194 ceph-mon[65619]: Reconfiguring mds.cephfs.smithi194.mpotdl (monmap changed)... 2021-11-03T16:56:27.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:27 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi194.mpotdl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2021-11-03T16:56:27.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:27 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:56:27.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:27 smithi194 ceph-mon[65619]: Reconfiguring daemon mds.cephfs.smithi194.mpotdl on smithi194 2021-11-03T16:56:27.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:27 smithi026 ceph-mon[96795]: poll took 1085.810 ms: 1 events 2021-11-03T16:56:27.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:27 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:27.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:27 smithi026 ceph-mon[96795]: Reconfiguring mds.cephfs.smithi194.mpotdl (monmap changed)... 2021-11-03T16:56:27.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:27 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi194.mpotdl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2021-11-03T16:56:27.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:27 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:56:27.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:27 smithi026 ceph-mon[96795]: Reconfiguring daemon mds.cephfs.smithi194.mpotdl on smithi194 2021-11-03T16:56:29.246 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:28 smithi026 ceph-mon[96795]: poll took 1115.564 ms: 1 events 2021-11-03T16:56:29.247 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:29.247 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:56:29.247 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:56:29.247 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:56:29.248 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:28 smithi026 ceph-mon[96795]: Upgrade: Setting container_image for all mon 2021-11-03T16:56:29.248 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:28 smithi026 ceph-mon[96795]: pgmap v23: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:29.248 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:29.248 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi026"}]: dispatch 2021-11-03T16:56:29.249 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi026"}]': finished 2021-11-03T16:56:29.249 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi194"}]: dispatch 2021-11-03T16:56:29.249 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi194"}]': finished 2021-11-03T16:56:29.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:28 smithi194 ceph-mon[65619]: poll took 1115.564 ms: 1 events 2021-11-03T16:56:29.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:29.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:56:29.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:56:29.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:56:29.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:28 smithi194 ceph-mon[65619]: Upgrade: Setting container_image for all mon 2021-11-03T16:56:29.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:28 smithi194 ceph-mon[65619]: pgmap v23: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:29.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:29.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi026"}]: dispatch 2021-11-03T16:56:29.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi026"}]': finished 2021-11-03T16:56:29.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi194"}]: dispatch 2021-11-03T16:56:29.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi194"}]': finished 2021-11-03T16:56:31.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:30 smithi026 ceph-mon[96795]: poll took 1756.700 ms: 1 events 2021-11-03T16:56:31.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:30 smithi026 ceph-mon[96795]: Upgrade: Updating crash.smithi026 2021-11-03T16:56:31.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:30 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:31.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:30 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi026", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2021-11-03T16:56:31.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:30 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:56:31.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:30 smithi026 ceph-mon[96795]: Deploying daemon crash.smithi026 on smithi026 2021-11-03T16:56:31.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:30 smithi026 ceph-mon[96795]: pgmap v24: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:31.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:30 smithi194 ceph-mon[65619]: poll took 1756.700 ms: 1 events 2021-11-03T16:56:31.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:30 smithi194 ceph-mon[65619]: Upgrade: Updating crash.smithi026 2021-11-03T16:56:31.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:30 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:31.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:30 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi026", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2021-11-03T16:56:31.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:30 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:56:31.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:30 smithi194 ceph-mon[65619]: Deploying daemon crash.smithi026 on smithi026 2021-11-03T16:56:31.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:30 smithi194 ceph-mon[65619]: pgmap v24: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:33.328 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:33 smithi026 ceph-mon[96795]: pgmap v25: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:33.472 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:33 smithi194 ceph-mon[65619]: pgmap v25: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:34.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:34 smithi026 ceph-mon[96795]: poll took 3300.118 ms: 1 events 2021-11-03T16:56:34.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:34 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:34.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:34 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:56:34.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:34 smithi026 ceph-mon[96795]: from='client.34166 -' entity='client.crash.smithi026' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:56:34.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:34 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:34.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:34 smithi026 ceph-mon[96795]: pgmap v26: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:34.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:34 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:34.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:34 smithi194 ceph-mon[65619]: poll took 3300.118 ms: 1 events 2021-11-03T16:56:34.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:34 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:34.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:34 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:56:34.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:34 smithi194 ceph-mon[65619]: from='client.34166 -' entity='client.crash.smithi026' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:56:34.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:34 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:34.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:34 smithi194 ceph-mon[65619]: pgmap v26: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:34.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:34 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:35.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:35 smithi026 ceph-mon[96795]: from='client.34170 -' entity='client.crash.smithi026' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:56:35.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:35 smithi026 ceph-mon[96795]: pgmap v27: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:35.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:35 smithi026 ceph-mon[96795]: Health check failed: 2 daemons have recently crashed (RECENT_CRASH) 2021-11-03T16:56:35.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:35 smithi194 ceph-mon[65619]: from='client.34170 -' entity='client.crash.smithi026' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:56:35.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:35 smithi194 ceph-mon[65619]: pgmap v27: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:35.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:35 smithi194 ceph-mon[65619]: Health check failed: 2 daemons have recently crashed (RECENT_CRASH) 2021-11-03T16:56:37.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:37 smithi026 ceph-mon[96795]: pgmap v28: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:37.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:37 smithi194 ceph-mon[65619]: pgmap v28: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:39.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:39 smithi194 ceph-mon[65619]: pgmap v29: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:39.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:39 smithi194 ceph-mon[65619]: poll took 5303.836 ms: 1 events 2021-11-03T16:56:39.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:39.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:39.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:56:39.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:56:39.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:56:40.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:39 smithi026 ceph-mon[96795]: pgmap v29: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:40.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:39 smithi026 ceph-mon[96795]: poll took 5303.836 ms: 1 events 2021-11-03T16:56:40.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:40.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:40.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:56:40.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:56:40.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:56:41.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:41 smithi194 ceph-mon[65619]: pgmap v30: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:41.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:41 smithi194 ceph-mon[65619]: poll took 1479.126 ms: 1 events 2021-11-03T16:56:41.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:41 smithi194 ceph-mon[65619]: Upgrade: Updating crash.smithi194 2021-11-03T16:56:41.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:41.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi194", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2021-11-03T16:56:41.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:56:41.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:41 smithi194 ceph-mon[65619]: Deploying daemon crash.smithi194 on smithi194 2021-11-03T16:56:41.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:41 smithi026 ceph-mon[96795]: pgmap v30: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:41.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:41 smithi026 ceph-mon[96795]: poll took 1479.126 ms: 1 events 2021-11-03T16:56:41.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:41 smithi026 ceph-mon[96795]: Upgrade: Updating crash.smithi194 2021-11-03T16:56:41.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:41.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi194", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2021-11-03T16:56:41.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-11-03T16:56:41.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:41 smithi026 ceph-mon[96795]: Deploying daemon crash.smithi194 on smithi194 2021-11-03T16:56:43.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:43 smithi026 ceph-mon[96795]: pgmap v31: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:43.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:43 smithi194 ceph-mon[65619]: pgmap v31: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:44.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:44 smithi026 ceph-mon[96795]: poll took 2824.836 ms: 1 events 2021-11-03T16:56:44.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:44 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:44.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:44 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:56:44.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:44 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:44.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:44 smithi194 ceph-mon[65619]: poll took 2824.836 ms: 1 events 2021-11-03T16:56:44.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:44 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:44.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:44 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:56:44.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:44 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:45.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:45 smithi026 ceph-mon[96795]: pgmap v32: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:45.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:45 smithi194 ceph-mon[65619]: pgmap v32: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:47.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:47 smithi194 ceph-mon[65619]: pgmap v33: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:47.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:47 smithi194 ceph-mon[65619]: poll took 2730.929 ms: 1 events 2021-11-03T16:56:47.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:47 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:47.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:47 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:47.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:47 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:56:47.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:47 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:56:47.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:47 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:56:47.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:47 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:56:47.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:47 smithi194 ceph-mon[65619]: Upgrade: Setting container_image for all crash 2021-11-03T16:56:47.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:47 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:47.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:47 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi026"}]: dispatch 2021-11-03T16:56:47.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:47 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi026"}]': finished 2021-11-03T16:56:47.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:47 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi194"}]: dispatch 2021-11-03T16:56:47.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:47 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi194"}]': finished 2021-11-03T16:56:47.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:47 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2021-11-03T16:56:47.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:47 smithi194 ceph-mon[65619]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2021-11-03T16:56:47.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:47 smithi194 ceph-mon[65619]: Upgrade: osd.0 is safe to restart 2021-11-03T16:56:47.772 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:47 smithi026 ceph-mon[96795]: pgmap v33: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:47.773 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:47 smithi026 ceph-mon[96795]: poll took 2730.929 ms: 1 events 2021-11-03T16:56:47.773 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:47 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:47.773 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:47 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:47.773 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:47 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:56:47.774 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:47 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:56:47.774 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:47 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:56:47.774 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:47 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:56:47.774 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:47 smithi026 ceph-mon[96795]: Upgrade: Setting container_image for all crash 2021-11-03T16:56:47.775 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:47 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:47.775 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:47 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi026"}]: dispatch 2021-11-03T16:56:47.775 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:47 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi026"}]': finished 2021-11-03T16:56:47.775 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:47 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi194"}]: dispatch 2021-11-03T16:56:47.776 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:47 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi194"}]': finished 2021-11-03T16:56:47.776 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:47 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2021-11-03T16:56:47.776 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:47 smithi026 ceph-mon[96795]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2021-11-03T16:56:47.776 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:47 smithi026 ceph-mon[96795]: Upgrade: osd.0 is safe to restart 2021-11-03T16:56:49.278 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:49.279 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T16:56:49.279 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T16:56:49.279 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:49.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:49.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T16:56:49.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T16:56:49.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:50.281 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:50 smithi026 ceph-mon[96795]: pgmap v34: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:50.281 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:50 smithi026 ceph-mon[96795]: poll took 2020.610 ms: 1 events 2021-11-03T16:56:50.282 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:50 smithi026 ceph-mon[96795]: Upgrade: Updating osd.0 2021-11-03T16:56:50.282 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:50 smithi026 ceph-mon[96795]: Deploying daemon osd.0 on smithi026 2021-11-03T16:56:50.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:50 smithi194 ceph-mon[65619]: pgmap v34: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:50.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:50 smithi194 ceph-mon[65619]: poll took 2020.610 ms: 1 events 2021-11-03T16:56:50.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:50 smithi194 ceph-mon[65619]: Upgrade: Updating osd.0 2021-11-03T16:56:50.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:50 smithi194 ceph-mon[65619]: Deploying daemon osd.0 on smithi026 2021-11-03T16:56:51.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.339+0000 7f76fd252700 1 -- 172.21.15.26:0/2151483807 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76f80f66e0 msgr2=0x7f76f80f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:56:51.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.339+0000 7f76fd252700 1 --2- 172.21.15.26:0/2151483807 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76f80f66e0 0x7f76f80f6b00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f76e8004660 tx=0x7f76e8009b30).stop 2021-11-03T16:56:51.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.339+0000 7f76fd252700 1 -- 172.21.15.26:0/2151483807 shutdown_connections 2021-11-03T16:56:51.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.339+0000 7f76fd252700 1 --2- 172.21.15.26:0/2151483807 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76f80f6ff0 0x7f76f80f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:51.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.339+0000 7f76fd252700 1 --2- 172.21.15.26:0/2151483807 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76f80f66e0 0x7f76f80f6b00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:51.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.339+0000 7f76fd252700 1 -- 172.21.15.26:0/2151483807 >> 172.21.15.26:0/2151483807 conn(0x7f76f80f1f00 msgr2=0x7f76f80f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:56:51.338 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.339+0000 7f76fd252700 1 -- 172.21.15.26:0/2151483807 shutdown_connections 2021-11-03T16:56:51.338 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.339+0000 7f76fd252700 1 -- 172.21.15.26:0/2151483807 wait complete. 2021-11-03T16:56:51.338 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.340+0000 7f76fd252700 1 Processor -- start 2021-11-03T16:56:51.338 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.340+0000 7f76fd252700 1 -- start start 2021-11-03T16:56:51.339 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.340+0000 7f76fd252700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76f80f66e0 0x7f76f8106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:56:51.339 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.340+0000 7f76fd252700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76f80f6ff0 0x7f76f81074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:56:51.339 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.340+0000 7f76fd252700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f8107a50 con 0x7f76f80f6ff0 2021-11-03T16:56:51.339 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.340+0000 7f76fd252700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f8107b90 con 0x7f76f80f66e0 2021-11-03T16:56:51.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.340+0000 7f76effff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76f80f6ff0 0x7f76f81074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:56:51.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.340+0000 7f76effff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76f80f6ff0 0x7f76f81074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51206/0 (socket says 172.21.15.26:51206) 2021-11-03T16:56:51.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.340+0000 7f76effff700 1 -- 172.21.15.26:0/1524131096 learned_addr learned my addr 172.21.15.26:0/1524131096 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:56:51.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.340+0000 7f76f6d9d700 1 --2- 172.21.15.26:0/1524131096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76f80f66e0 0x7f76f8106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:56:51.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.340+0000 7f76effff700 1 -- 172.21.15.26:0/1524131096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76f80f66e0 msgr2=0x7f76f8106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:56:51.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.340+0000 7f76effff700 1 --2- 172.21.15.26:0/1524131096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76f80f66e0 0x7f76f8106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:51.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.340+0000 7f76effff700 1 -- 172.21.15.26:0/1524131096 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e8005040 con 0x7f76f80f6ff0 2021-11-03T16:56:51.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.340+0000 7f76effff700 1 --2- 172.21.15.26:0/1524131096 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76f80f6ff0 0x7f76f81074a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f76e000c510 tx=0x7f76e0007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:56:51.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.341+0000 7f76ef7fe700 1 -- 172.21.15.26:0/1524131096 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76e000f650 con 0x7f76f80f6ff0 2021-11-03T16:56:51.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.341+0000 7f76fd252700 1 -- 172.21.15.26:0/1524131096 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f8108530 con 0x7f76f80f6ff0 2021-11-03T16:56:51.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.341+0000 7f76ef7fe700 1 -- 172.21.15.26:0/1524131096 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f76e000fc60 con 0x7f76f80f6ff0 2021-11-03T16:56:51.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.341+0000 7f76ef7fe700 1 -- 172.21.15.26:0/1524131096 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76e0012c50 con 0x7f76f80f6ff0 2021-11-03T16:56:51.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.341+0000 7f76fd252700 1 -- 172.21.15.26:0/1524131096 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f8108af0 con 0x7f76f80f6ff0 2021-11-03T16:56:51.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.342+0000 7f76fd252700 1 -- 172.21.15.26:0/1524131096 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76f8045ad0 con 0x7f76f80f6ff0 2021-11-03T16:56:51.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.342+0000 7f76ef7fe700 1 -- 172.21.15.26:0/1524131096 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f76e0010070 con 0x7f76f80f6ff0 2021-11-03T16:56:51.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.342+0000 7f76ef7fe700 1 --2- 172.21.15.26:0/1524131096 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f76e40640b0 0x7f76e4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:56:51.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.342+0000 7f76ef7fe700 1 -- 172.21.15.26:0/1524131096 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f76e00806a0 con 0x7f76f80f6ff0 2021-11-03T16:56:51.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.342+0000 7f76f6d9d700 1 --2- 172.21.15.26:0/1524131096 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f76e40640b0 0x7f76e4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:56:51.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.343+0000 7f76f6d9d700 1 --2- 172.21.15.26:0/1524131096 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f76e40640b0 0x7f76e4066570 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f76e8004630 tx=0x7f76e8009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:56:51.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.347+0000 7f76ef7fe700 1 -- 172.21.15.26:0/1524131096 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f76e0052910 con 0x7f76f80f6ff0 2021-11-03T16:56:51.521 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.526+0000 7f76fd252700 1 -- 172.21.15.26:0/1524131096 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f76f80fef60 con 0x7f76e40640b0 2021-11-03T16:56:51.522 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.527+0000 7f76ef7fe700 1 -- 172.21.15.26:0/1524131096 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+320 (secure 0 0 0) 0x7f76f80fef60 con 0x7f76e40640b0 2021-11-03T16:56:51.524 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.529+0000 7f76fd252700 1 -- 172.21.15.26:0/1524131096 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f76e40640b0 msgr2=0x7f76e4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:56:51.525 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.529+0000 7f76fd252700 1 --2- 172.21.15.26:0/1524131096 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f76e40640b0 0x7f76e4066570 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f76e8004630 tx=0x7f76e8009b30).stop 2021-11-03T16:56:51.525 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.529+0000 7f76fd252700 1 -- 172.21.15.26:0/1524131096 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76f80f6ff0 msgr2=0x7f76f81074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:56:51.525 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.529+0000 7f76fd252700 1 --2- 172.21.15.26:0/1524131096 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76f80f6ff0 0x7f76f81074a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f76e000c510 tx=0x7f76e0007e00).stop 2021-11-03T16:56:51.525 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.529+0000 7f76fd252700 1 -- 172.21.15.26:0/1524131096 shutdown_connections 2021-11-03T16:56:51.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.529+0000 7f76fd252700 1 --2- 172.21.15.26:0/1524131096 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f76e40640b0 0x7f76e4066570 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:51.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.529+0000 7f76fd252700 1 --2- 172.21.15.26:0/1524131096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76f80f66e0 0x7f76f8106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:51.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.529+0000 7f76fd252700 1 --2- 172.21.15.26:0/1524131096 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76f80f6ff0 0x7f76f81074a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:51.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.529+0000 7f76fd252700 1 -- 172.21.15.26:0/1524131096 >> 172.21.15.26:0/1524131096 conn(0x7f76f80f1f00 msgr2=0x7f76f80fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:56:51.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.529+0000 7f76fd252700 1 -- 172.21.15.26:0/1524131096 shutdown_connections 2021-11-03T16:56:51.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.529+0000 7f76fd252700 1 -- 172.21.15.26:0/1524131096 wait complete. 2021-11-03T16:56:51.534 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T16:56:51.627 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.630+0000 7fc96d392700 1 -- 172.21.15.26:0/2443463542 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9680f5ef0 msgr2=0x7fc9680f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:56:51.627 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.630+0000 7fc96d392700 1 --2- 172.21.15.26:0/2443463542 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9680f5ef0 0x7fc9680f6920 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fc950004660 tx=0x7fc950009b30).stop 2021-11-03T16:56:51.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.630+0000 7fc96d392700 1 -- 172.21.15.26:0/2443463542 shutdown_connections 2021-11-03T16:56:51.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.630+0000 7fc96d392700 1 --2- 172.21.15.26:0/2443463542 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9680f5ef0 0x7fc9680f6920 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:51.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.630+0000 7fc96d392700 1 --2- 172.21.15.26:0/2443463542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9680f55e0 0x7fc9680f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:51.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.630+0000 7fc96d392700 1 -- 172.21.15.26:0/2443463542 >> 172.21.15.26:0/2443463542 conn(0x7fc9680f0de0 msgr2=0x7fc9680f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:56:51.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.630+0000 7fc96d392700 1 -- 172.21.15.26:0/2443463542 shutdown_connections 2021-11-03T16:56:51.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.630+0000 7fc96d392700 1 -- 172.21.15.26:0/2443463542 wait complete. 2021-11-03T16:56:51.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.631+0000 7fc96d392700 1 Processor -- start 2021-11-03T16:56:51.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.631+0000 7fc96d392700 1 -- start start 2021-11-03T16:56:51.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.631+0000 7fc96d392700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9680f55e0 0x7fc968109e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:56:51.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.631+0000 7fc96d392700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9680603f0 0x7fc96810c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:56:51.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.631+0000 7fc96d392700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96810c860 con 0x7fc9680f55e0 2021-11-03T16:56:51.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.631+0000 7fc96d392700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96810c9a0 con 0x7fc9680603f0 2021-11-03T16:56:51.631 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.631+0000 7fc966ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9680f55e0 0x7fc968109e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:56:51.631 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.631+0000 7fc966ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9680f55e0 0x7fc968109e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51214/0 (socket says 172.21.15.26:51214) 2021-11-03T16:56:51.631 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.631+0000 7fc966ffd700 1 -- 172.21.15.26:0/2704376112 learned_addr learned my addr 172.21.15.26:0/2704376112 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:56:51.631 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.631+0000 7fc9667fc700 1 --2- 172.21.15.26:0/2704376112 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9680603f0 0x7fc96810c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:56:51.631 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.631+0000 7fc966ffd700 1 -- 172.21.15.26:0/2704376112 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9680603f0 msgr2=0x7fc96810c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:56:51.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.631+0000 7fc966ffd700 1 --2- 172.21.15.26:0/2704376112 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9680603f0 0x7fc96810c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:51.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.631+0000 7fc966ffd700 1 -- 172.21.15.26:0/2704376112 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc950005040 con 0x7fc9680f55e0 2021-11-03T16:56:51.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.632+0000 7fc966ffd700 1 --2- 172.21.15.26:0/2704376112 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9680f55e0 0x7fc968109e00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fc958002700 tx=0x7fc958009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:56:51.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.632+0000 7fc95f7fe700 1 -- 172.21.15.26:0/2704376112 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc958009320 con 0x7fc9680f55e0 2021-11-03T16:56:51.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.632+0000 7fc95f7fe700 1 -- 172.21.15.26:0/2704376112 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc95800f040 con 0x7fc9680f55e0 2021-11-03T16:56:51.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.632+0000 7fc96d392700 1 -- 172.21.15.26:0/2704376112 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc96810cc80 con 0x7fc9680f55e0 2021-11-03T16:56:51.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.632+0000 7fc95f7fe700 1 -- 172.21.15.26:0/2704376112 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc958013850 con 0x7fc9680f55e0 2021-11-03T16:56:51.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.632+0000 7fc96d392700 1 -- 172.21.15.26:0/2704376112 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc96810d1f0 con 0x7fc9680f55e0 2021-11-03T16:56:51.634 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.633+0000 7fc96d392700 1 -- 172.21.15.26:0/2704376112 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc968045ad0 con 0x7fc9680f55e0 2021-11-03T16:56:51.635 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.633+0000 7fc95f7fe700 1 -- 172.21.15.26:0/2704376112 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc958009480 con 0x7fc9680f55e0 2021-11-03T16:56:51.635 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.634+0000 7fc95f7fe700 1 --2- 172.21.15.26:0/2704376112 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc954064090 0x7fc954066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:56:51.635 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.634+0000 7fc95f7fe700 1 -- 172.21.15.26:0/2704376112 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc9580809c0 con 0x7fc9680f55e0 2021-11-03T16:56:51.635 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.634+0000 7fc9667fc700 1 --2- 172.21.15.26:0/2704376112 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc954064090 0x7fc954066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:56:51.636 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.634+0000 7fc9667fc700 1 --2- 172.21.15.26:0/2704376112 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc954064090 0x7fc954066550 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fc950000c00 tx=0x7fc950009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:56:51.636 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.638+0000 7fc95f7fe700 1 -- 172.21.15.26:0/2704376112 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc958052c30 con 0x7fc9680f55e0 2021-11-03T16:56:51.815 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.819+0000 7fc96d392700 1 -- 172.21.15.26:0/2704376112 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc968057f10 con 0x7fc954064090 2021-11-03T16:56:51.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.834+0000 7fc95f7fe700 1 -- 172.21.15.26:0/2704376112 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fc968057f10 con 0x7fc954064090 2021-11-03T16:56:51.829 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T16:56:51.830 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (8m) 13s ago 9m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T16:56:51.830 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (19s) 13s ago 9m 35.6M - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T16:56:51.830 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (9s) 5s ago 8m 7000k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T16:56:51.830 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (7m) 13s ago 9m 38.7M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T16:56:51.830 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (64s) 13s ago 4m 13.0M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T16:56:51.831 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (84s) 13s ago 4m 14.2M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T16:56:51.831 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (4m) 5s ago 4m 15.3M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T16:56:51.831 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (4m) 5s ago 4m 15.7M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T16:56:51.831 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (110s) 13s ago 10m 460M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T16:56:51.832 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (85s) 5s ago 8m 410M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T16:56:51.832 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (73s) 13s ago 10m 72.1M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T16:56:51.832 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (52s) 5s ago 8m 61.4M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T16:56:51.832 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (8m) 13s ago 8m 18.1M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T16:56:51.833 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (8m) 5s ago 8m 18.3M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T16:56:51.833 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (7m) 13s ago 7m 408M 4096M 16.2.4 8d91d370c2b8 d7f900ddf0f3 2021-11-03T16:56:51.833 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (7m) 13s ago 7m 411M 4096M 16.2.4 8d91d370c2b8 9e5ffa11984b 2021-11-03T16:56:51.834 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (6m) 13s ago 6m 348M 4096M 16.2.4 8d91d370c2b8 f65145633c0e 2021-11-03T16:56:51.834 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (6m) 5s ago 6m 495M 4096M 16.2.4 8d91d370c2b8 ff6d474a5f9a 2021-11-03T16:56:51.834 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (6m) 5s ago 6m 424M 4096M 16.2.4 8d91d370c2b8 e2fc9c0bdf0f 2021-11-03T16:56:51.834 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (6m) 5s ago 6m 471M 4096M 16.2.4 8d91d370c2b8 0abc64d8a2bf 2021-11-03T16:56:51.835 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (7m) 13s ago 8m 47.2M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T16:56:51.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.836+0000 7fc96d392700 1 -- 172.21.15.26:0/2704376112 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc954064090 msgr2=0x7fc954066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:56:51.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.836+0000 7fc96d392700 1 --2- 172.21.15.26:0/2704376112 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc954064090 0x7fc954066550 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fc950000c00 tx=0x7fc950009b30).stop 2021-11-03T16:56:51.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.836+0000 7fc96d392700 1 -- 172.21.15.26:0/2704376112 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9680f55e0 msgr2=0x7fc968109e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:56:51.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.836+0000 7fc96d392700 1 --2- 172.21.15.26:0/2704376112 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9680f55e0 0x7fc968109e00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fc958002700 tx=0x7fc958009de0).stop 2021-11-03T16:56:51.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.836+0000 7fc96d392700 1 -- 172.21.15.26:0/2704376112 shutdown_connections 2021-11-03T16:56:51.837 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.836+0000 7fc96d392700 1 --2- 172.21.15.26:0/2704376112 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc954064090 0x7fc954066550 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:51.837 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.836+0000 7fc96d392700 1 --2- 172.21.15.26:0/2704376112 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9680f55e0 0x7fc968109e00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:51.837 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.836+0000 7fc96d392700 1 --2- 172.21.15.26:0/2704376112 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9680603f0 0x7fc96810c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:51.837 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.836+0000 7fc96d392700 1 -- 172.21.15.26:0/2704376112 >> 172.21.15.26:0/2704376112 conn(0x7fc9680f0de0 msgr2=0x7fc9680fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:56:51.838 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.836+0000 7fc96d392700 1 -- 172.21.15.26:0/2704376112 shutdown_connections 2021-11-03T16:56:51.838 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.836+0000 7fc96d392700 1 -- 172.21.15.26:0/2704376112 wait complete. 2021-11-03T16:56:51.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.943+0000 7f6858d65700 1 -- 172.21.15.26:0/232496261 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68540f4800 msgr2=0x7f68540f4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:56:51.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.943+0000 7f6858d65700 1 --2- 172.21.15.26:0/232496261 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68540f4800 0x7f68540f4c20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f6844004660 tx=0x7f6844009b30).stop 2021-11-03T16:56:51.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.943+0000 7f6858d65700 1 -- 172.21.15.26:0/232496261 shutdown_connections 2021-11-03T16:56:51.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.943+0000 7f6858d65700 1 --2- 172.21.15.26:0/232496261 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68540f51a0 0x7f68540f7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:51.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.943+0000 7f6858d65700 1 --2- 172.21.15.26:0/232496261 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68540f4800 0x7f68540f4c20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:51.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.943+0000 7f6858d65700 1 -- 172.21.15.26:0/232496261 >> 172.21.15.26:0/232496261 conn(0x7f68540f0320 msgr2=0x7f68540f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:56:51.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.943+0000 7f6858d65700 1 -- 172.21.15.26:0/232496261 shutdown_connections 2021-11-03T16:56:51.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.943+0000 7f6858d65700 1 -- 172.21.15.26:0/232496261 wait complete. 2021-11-03T16:56:51.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.944+0000 7f6858d65700 1 Processor -- start 2021-11-03T16:56:51.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.944+0000 7f6858d65700 1 -- start start 2021-11-03T16:56:51.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.944+0000 7f6858d65700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68540f4800 0x7f6854106d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:56:51.943 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.944+0000 7f6858d65700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68540f51a0 0x7f6854107260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:56:51.943 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.944+0000 7f6858d65700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6854107860 con 0x7f68540f4800 2021-11-03T16:56:51.943 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.944+0000 7f6858d65700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6854108070 con 0x7f68540f51a0 2021-11-03T16:56:51.943 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.944+0000 7f68537fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68540f4800 0x7f6854106d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:56:51.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.944+0000 7f68537fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68540f4800 0x7f6854106d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51224/0 (socket says 172.21.15.26:51224) 2021-11-03T16:56:51.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.944+0000 7f68537fe700 1 -- 172.21.15.26:0/1435407295 learned_addr learned my addr 172.21.15.26:0/1435407295 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:56:51.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.945+0000 7f6852ffd700 1 --2- 172.21.15.26:0/1435407295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68540f51a0 0x7f6854107260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:56:51.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.945+0000 7f68537fe700 1 -- 172.21.15.26:0/1435407295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68540f51a0 msgr2=0x7f6854107260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:56:51.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.945+0000 7f68537fe700 1 --2- 172.21.15.26:0/1435407295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68540f51a0 0x7f6854107260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:51.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.945+0000 7f68537fe700 1 -- 172.21.15.26:0/1435407295 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6844005040 con 0x7f68540f4800 2021-11-03T16:56:51.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.945+0000 7f6852ffd700 1 --2- 172.21.15.26:0/1435407295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68540f51a0 0x7f6854107260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T16:56:51.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.945+0000 7f68537fe700 1 --2- 172.21.15.26:0/1435407295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68540f4800 0x7f6854106d70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f6844013a70 tx=0x7f6844009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:56:51.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.945+0000 7f683bfff700 1 -- 172.21.15.26:0/1435407295 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6844018070 con 0x7f68540f4800 2021-11-03T16:56:51.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.945+0000 7f683bfff700 1 -- 172.21.15.26:0/1435407295 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f68440097d0 con 0x7f68540f4800 2021-11-03T16:56:51.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.945+0000 7f6858d65700 1 -- 172.21.15.26:0/1435407295 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6854108290 con 0x7f68540f4800 2021-11-03T16:56:51.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.945+0000 7f683bfff700 1 -- 172.21.15.26:0/1435407295 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f684401c3c0 con 0x7f68540f4800 2021-11-03T16:56:51.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.945+0000 7f6858d65700 1 -- 172.21.15.26:0/1435407295 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68541087f0 con 0x7f68540f4800 2021-11-03T16:56:51.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.946+0000 7f6858d65700 1 -- 172.21.15.26:0/1435407295 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6854059100 con 0x7f68540f4800 2021-11-03T16:56:51.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.946+0000 7f683bfff700 1 -- 172.21.15.26:0/1435407295 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f6844007ba0 con 0x7f68540f4800 2021-11-03T16:56:51.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.947+0000 7f683bfff700 1 --2- 172.21.15.26:0/1435407295 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f683c064100 0x7f683c0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:56:51.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.947+0000 7f683bfff700 1 -- 172.21.15.26:0/1435407295 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f6844082480 con 0x7f68540f4800 2021-11-03T16:56:51.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.947+0000 7f6852ffd700 1 --2- 172.21.15.26:0/1435407295 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f683c064100 0x7f683c0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:56:51.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.947+0000 7f6852ffd700 1 --2- 172.21.15.26:0/1435407295 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f683c064100 0x7f683c0665c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f6848009880 tx=0x7f684800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:56:51.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:51.951+0000 7f683bfff700 1 -- 172.21.15.26:0/1435407295 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f68440547e0 con 0x7f68540f4800 2021-11-03T16:56:51.984 INFO:journalctl@ceph.osd.0.smithi026.stdout:Nov 03 16:56:51 smithi026 systemd[1]: Stopping Ceph osd.0 for 70492bc6-3cc5-11ec-8c28-001a4aab830c... 2021-11-03T16:56:52.181 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.185+0000 7f6858d65700 1 -- 172.21.15.26:0/1435407295 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f68540008d0 con 0x7f68540f4800 2021-11-03T16:56:52.181 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.185+0000 7f683bfff700 1 -- 172.21.15.26:0/1435407295 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+700 (secure 0 0 0) 0x7f68440543d0 con 0x7f68540f4800 2021-11-03T16:56:52.182 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T16:56:52.182 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T16:56:52.182 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T16:56:52.183 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:56:52.183 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T16:56:52.183 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T16:56:52.183 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:56:52.183 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T16:56:52.184 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2021-11-03T16:56:52.184 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:56:52.184 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T16:56:52.184 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T16:56:52.185 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:56:52.185 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T16:56:52.185 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 10, 2021-11-03T16:56:52.186 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 4 2021-11-03T16:56:52.186 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T16:56:52.186 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T16:56:52.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.187+0000 7f6858d65700 1 -- 172.21.15.26:0/1435407295 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f683c064100 msgr2=0x7f683c0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:56:52.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.187+0000 7f6858d65700 1 --2- 172.21.15.26:0/1435407295 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f683c064100 0x7f683c0665c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f6848009880 tx=0x7f684800b040).stop 2021-11-03T16:56:52.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.187+0000 7f6858d65700 1 -- 172.21.15.26:0/1435407295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68540f4800 msgr2=0x7f6854106d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:56:52.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.187+0000 7f6858d65700 1 --2- 172.21.15.26:0/1435407295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68540f4800 0x7f6854106d70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f6844013a70 tx=0x7f6844009b30).stop 2021-11-03T16:56:52.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.187+0000 7f6858d65700 1 -- 172.21.15.26:0/1435407295 shutdown_connections 2021-11-03T16:56:52.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.187+0000 7f6858d65700 1 --2- 172.21.15.26:0/1435407295 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f683c064100 0x7f683c0665c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:52.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.187+0000 7f6858d65700 1 --2- 172.21.15.26:0/1435407295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68540f4800 0x7f6854106d70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:52.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.187+0000 7f6858d65700 1 --2- 172.21.15.26:0/1435407295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68540f51a0 0x7f6854107260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:52.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.187+0000 7f6858d65700 1 -- 172.21.15.26:0/1435407295 >> 172.21.15.26:0/1435407295 conn(0x7f68540f0320 msgr2=0x7f68540fb370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:56:52.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.188+0000 7f6858d65700 1 -- 172.21.15.26:0/1435407295 shutdown_connections 2021-11-03T16:56:52.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.188+0000 7f6858d65700 1 -- 172.21.15.26:0/1435407295 wait complete. 2021-11-03T16:56:52.244 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:52 smithi026 ceph-mon[96795]: pgmap v35: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:52.245 INFO:journalctl@ceph.osd.0.smithi026.stdout:Nov 03 16:56:51 smithi026 conmon[50142]: debug 2021-11-03T16:56:51.987+0000 7fd7f2167700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2021-11-03T16:56:52.245 INFO:journalctl@ceph.osd.0.smithi026.stdout:Nov 03 16:56:51 smithi026 conmon[50142]: debug 2021-11-03T16:56:51.988+0000 7fd7f2167700 -1 osd.0 52 *** Got signal Terminated *** 2021-11-03T16:56:52.245 INFO:journalctl@ceph.osd.0.smithi026.stdout:Nov 03 16:56:51 smithi026 conmon[50142]: debug 2021-11-03T16:56:51.988+0000 7fd7f2167700 -1 osd.0 52 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-11-03T16:56:52.291 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.294+0000 7fb0285d3700 1 -- 172.21.15.26:0/2767351225 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0200f6bf0 msgr2=0x7fb0200f7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:56:52.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.294+0000 7fb0285d3700 1 --2- 172.21.15.26:0/2767351225 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0200f6bf0 0x7fb0200f7010 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fb01c004660 tx=0x7fb01c009b30).stop 2021-11-03T16:56:52.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.294+0000 7fb0285d3700 1 -- 172.21.15.26:0/2767351225 shutdown_connections 2021-11-03T16:56:52.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.294+0000 7fb0285d3700 1 --2- 172.21.15.26:0/2767351225 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0200f7590 0x7fb0200f59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:52.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.294+0000 7fb0285d3700 1 --2- 172.21.15.26:0/2767351225 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0200f6bf0 0x7fb0200f7010 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:52.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.294+0000 7fb0285d3700 1 -- 172.21.15.26:0/2767351225 >> 172.21.15.26:0/2767351225 conn(0x7fb0200f04c0 msgr2=0x7fb0200f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:56:52.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.295+0000 7fb0285d3700 1 -- 172.21.15.26:0/2767351225 shutdown_connections 2021-11-03T16:56:52.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.295+0000 7fb0285d3700 1 -- 172.21.15.26:0/2767351225 wait complete. 2021-11-03T16:56:52.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.295+0000 7fb0285d3700 1 Processor -- start 2021-11-03T16:56:52.294 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.295+0000 7fb0285d3700 1 -- start start 2021-11-03T16:56:52.294 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.295+0000 7fb0285d3700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0200f6bf0 0x7fb020105ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:56:52.294 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.295+0000 7fb0285d3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0200f7590 0x7fb0201063c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:56:52.295 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.295+0000 7fb0285d3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb020106970 con 0x7fb0200f7590 2021-11-03T16:56:52.295 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.295+0000 7fb0285d3700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb020106ab0 con 0x7fb0200f6bf0 2021-11-03T16:56:52.295 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.296+0000 7fb025b6e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0200f7590 0x7fb0201063c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:56:52.295 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.296+0000 7fb025b6e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0200f7590 0x7fb0201063c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51254/0 (socket says 172.21.15.26:51254) 2021-11-03T16:56:52.296 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.296+0000 7fb025b6e700 1 -- 172.21.15.26:0/3706833643 learned_addr learned my addr 172.21.15.26:0/3706833643 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:56:52.296 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.296+0000 7fb02636f700 1 --2- 172.21.15.26:0/3706833643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0200f6bf0 0x7fb020105ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:56:52.296 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.296+0000 7fb025b6e700 1 -- 172.21.15.26:0/3706833643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0200f6bf0 msgr2=0x7fb020105ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:56:52.296 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.296+0000 7fb025b6e700 1 --2- 172.21.15.26:0/3706833643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0200f6bf0 0x7fb020105ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:52.297 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.296+0000 7fb025b6e700 1 -- 172.21.15.26:0/3706833643 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01c005040 con 0x7fb0200f7590 2021-11-03T16:56:52.297 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.296+0000 7fb025b6e700 1 --2- 172.21.15.26:0/3706833643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0200f7590 0x7fb0201063c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fb010010a00 tx=0x7fb01000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:56:52.297 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.296+0000 7fb016ffd700 1 -- 172.21.15.26:0/3706833643 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0100094c0 con 0x7fb0200f7590 2021-11-03T16:56:52.297 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.296+0000 7fb016ffd700 1 -- 172.21.15.26:0/3706833643 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb010009620 con 0x7fb0200f7590 2021-11-03T16:56:52.297 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.296+0000 7fb0285d3700 1 -- 172.21.15.26:0/3706833643 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb020107450 con 0x7fb0200f7590 2021-11-03T16:56:52.298 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.296+0000 7fb016ffd700 1 -- 172.21.15.26:0/3706833643 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb010007e50 con 0x7fb0200f7590 2021-11-03T16:56:52.299 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.296+0000 7fb0285d3700 1 -- 172.21.15.26:0/3706833643 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb020107a10 con 0x7fb0200f7590 2021-11-03T16:56:52.299 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.297+0000 7fb0285d3700 1 -- 172.21.15.26:0/3706833643 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb020045ad0 con 0x7fb0200f7590 2021-11-03T16:56:52.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.298+0000 7fb016ffd700 1 -- 172.21.15.26:0/3706833643 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fb010022070 con 0x7fb0200f7590 2021-11-03T16:56:52.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.298+0000 7fb016ffd700 1 --2- 172.21.15.26:0/3706833643 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb00c0640b0 0x7fb00c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:56:52.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.298+0000 7fb016ffd700 1 -- 172.21.15.26:0/3706833643 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fb0100831b0 con 0x7fb0200f7590 2021-11-03T16:56:52.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.298+0000 7fb02636f700 1 --2- 172.21.15.26:0/3706833643 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb00c0640b0 0x7fb00c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:56:52.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.299+0000 7fb02636f700 1 --2- 172.21.15.26:0/3706833643 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb00c0640b0 0x7fb00c066570 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fb01c004d80 tx=0x7fb01c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:56:52.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.302+0000 7fb016ffd700 1 -- 172.21.15.26:0/3706833643 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fb010055420 con 0x7fb0200f7590 2021-11-03T16:56:52.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:52 smithi194 ceph-mon[65619]: pgmap v35: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:52.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.518+0000 7fb0285d3700 1 -- 172.21.15.26:0/3706833643 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb020108050 con 0x7fb0200f7590 2021-11-03T16:56:52.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.518+0000 7fb016ffd700 1 -- 172.21.15.26:0/3706833643 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fb010016710 con 0x7fb0200f7590 2021-11-03T16:56:52.514 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T16:56:52.515 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T16:56:52.515 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T16:56:52.516 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T16:56:52.516 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:56:52.516 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T16:56:52.516 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T16:56:52.516 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T16:56:52.517 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T16:56:52.517 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T16:56:52.517 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T16:56:52.517 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T16:56:52.518 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T16:56:52.518 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T16:56:52.518 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T16:56:52.518 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T16:56:52.518 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T16:56:52.519 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T16:56:52.519 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T16:56:52.519 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T16:56:52.519 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T16:56:52.520 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T16:56:52.520 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T16:56:52.520 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T16:56:52.521 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T16:56:52.521 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T16:56:52.521 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T16:56:52.522 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T16:56:52.522 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T16:56:52.522 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T16:56:52.522 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T16:56:52.523 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:56:52.523 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:56:52.523 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T16:56:52.523 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:56:52.524 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T16:56:52.524 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T16:56:52.524 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T16:56:52.524 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T16:56:52.525 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.520+0000 7fb0285d3700 1 -- 172.21.15.26:0/3706833643 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb00c0640b0 msgr2=0x7fb00c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:56:52.525 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.520+0000 7fb0285d3700 1 --2- 172.21.15.26:0/3706833643 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb00c0640b0 0x7fb00c066570 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fb01c004d80 tx=0x7fb01c00b040).stop 2021-11-03T16:56:52.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.520+0000 7fb0285d3700 1 -- 172.21.15.26:0/3706833643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0200f7590 msgr2=0x7fb0201063c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:56:52.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.520+0000 7fb0285d3700 1 --2- 172.21.15.26:0/3706833643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0200f7590 0x7fb0201063c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fb010010a00 tx=0x7fb01000b040).stop 2021-11-03T16:56:52.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.521+0000 7fb0285d3700 1 -- 172.21.15.26:0/3706833643 shutdown_connections 2021-11-03T16:56:52.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.521+0000 7fb0285d3700 1 --2- 172.21.15.26:0/3706833643 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb00c0640b0 0x7fb00c066570 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:52.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.521+0000 7fb0285d3700 1 --2- 172.21.15.26:0/3706833643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0200f6bf0 0x7fb020105ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:52.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.521+0000 7fb0285d3700 1 --2- 172.21.15.26:0/3706833643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0200f7590 0x7fb0201063c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:56:52.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.521+0000 7fb0285d3700 1 -- 172.21.15.26:0/3706833643 >> 172.21.15.26:0/3706833643 conn(0x7fb0200f04c0 msgr2=0x7fb0200fa3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:56:52.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.521+0000 7fb0285d3700 1 -- 172.21.15.26:0/3706833643 shutdown_connections 2021-11-03T16:56:52.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:56:52.521+0000 7fb0285d3700 1 -- 172.21.15.26:0/3706833643 wait complete. 2021-11-03T16:56:52.528 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T16:56:52.672 INFO:journalctl@ceph.osd.0.smithi026.stdout:Nov 03 16:56:52 smithi026 bash[104125]: d7f900ddf0f3c93f20c447335f718d36f8c6a0c6b7d17a89de35a6c5074bd2c1 2021-11-03T16:56:52.672 INFO:journalctl@ceph.osd.0.smithi026.stdout:Nov 03 16:56:52 smithi026 bash[104125]: Error: no container with name or ID ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c-osd-0 found: no such container 2021-11-03T16:56:53.172 INFO:journalctl@ceph.osd.0.smithi026.stdout:Nov 03 16:56:52 smithi026 bash[104125]: Error: container d7f900ddf0f3c93f20c447335f718d36f8c6a0c6b7d17a89de35a6c5074bd2c1 does not exist in database: no such container 2021-11-03T16:56:53.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:53 smithi026 ceph-mon[96795]: from='client.34174 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:56:53.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:53 smithi026 ceph-mon[96795]: from='client.34178 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:56:53.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:53 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1435407295' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:56:53.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:53 smithi026 ceph-mon[96795]: osd.0 reported immediately failed by osd.3 2021-11-03T16:56:53.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:53 smithi026 ceph-mon[96795]: osd.0 failed (root=default,host=smithi026) (connection refused reported by osd.3) 2021-11-03T16:56:53.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:53 smithi026 ceph-mon[96795]: osd.0 reported immediately failed by osd.3 2021-11-03T16:56:53.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:53 smithi026 ceph-mon[96795]: osd.0 reported immediately failed by osd.1 2021-11-03T16:56:53.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:53 smithi026 ceph-mon[96795]: osd.0 reported immediately failed by osd.5 2021-11-03T16:56:53.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:53 smithi026 ceph-mon[96795]: osd.0 reported immediately failed by osd.2 2021-11-03T16:56:53.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:53 smithi026 ceph-mon[96795]: osd.0 reported immediately failed by osd.4 2021-11-03T16:56:53.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:53 smithi026 ceph-mon[96795]: osd.0 reported immediately failed by osd.1 2021-11-03T16:56:53.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:53 smithi026 ceph-mon[96795]: osd.0 reported immediately failed by osd.5 2021-11-03T16:56:53.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:53 smithi026 ceph-mon[96795]: osd.0 reported immediately failed by osd.2 2021-11-03T16:56:53.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:53 smithi026 ceph-mon[96795]: osd.0 reported immediately failed by osd.4 2021-11-03T16:56:53.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:53 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3706833643' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T16:56:53.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:53 smithi026 ceph-mon[96795]: osd.0 reported immediately failed by osd.3 2021-11-03T16:56:53.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:53 smithi026 ceph-mon[96795]: osd.0 reported immediately failed by osd.3 2021-11-03T16:56:53.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:53 smithi026 ceph-mon[96795]: osd.0 reported immediately failed by osd.5 2021-11-03T16:56:53.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:53 smithi026 ceph-mon[96795]: osd.0 reported immediately failed by osd.4 2021-11-03T16:56:53.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:53 smithi026 ceph-mon[96795]: osd.0 reported immediately failed by osd.5 2021-11-03T16:56:53.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:53 smithi026 ceph-mon[96795]: osd.0 reported immediately failed by osd.4 2021-11-03T16:56:53.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:53 smithi026 ceph-mon[96795]: osd.0 reported immediately failed by osd.1 2021-11-03T16:56:53.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:53 smithi026 ceph-mon[96795]: osd.0 reported immediately failed by osd.1 2021-11-03T16:56:53.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:53 smithi026 ceph-mon[96795]: osd.0 reported immediately failed by osd.2 2021-11-03T16:56:53.178 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:53 smithi026 ceph-mon[96795]: osd.0 reported immediately failed by osd.2 2021-11-03T16:56:53.472 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:53 smithi194 ceph-mon[65619]: from='client.34174 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:56:53.473 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:53 smithi194 ceph-mon[65619]: from='client.34178 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:56:53.473 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:53 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1435407295' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:56:53.473 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:53 smithi194 ceph-mon[65619]: osd.0 reported immediately failed by osd.3 2021-11-03T16:56:53.473 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:53 smithi194 ceph-mon[65619]: osd.0 failed (root=default,host=smithi026) (connection refused reported by osd.3) 2021-11-03T16:56:53.473 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:53 smithi194 ceph-mon[65619]: osd.0 reported immediately failed by osd.3 2021-11-03T16:56:53.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:53 smithi194 ceph-mon[65619]: osd.0 reported immediately failed by osd.1 2021-11-03T16:56:53.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:53 smithi194 ceph-mon[65619]: osd.0 reported immediately failed by osd.5 2021-11-03T16:56:53.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:53 smithi194 ceph-mon[65619]: osd.0 reported immediately failed by osd.2 2021-11-03T16:56:53.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:53 smithi194 ceph-mon[65619]: osd.0 reported immediately failed by osd.4 2021-11-03T16:56:53.475 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:53 smithi194 ceph-mon[65619]: osd.0 reported immediately failed by osd.1 2021-11-03T16:56:53.475 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:53 smithi194 ceph-mon[65619]: osd.0 reported immediately failed by osd.5 2021-11-03T16:56:53.475 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:53 smithi194 ceph-mon[65619]: osd.0 reported immediately failed by osd.2 2021-11-03T16:56:53.475 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:53 smithi194 ceph-mon[65619]: osd.0 reported immediately failed by osd.4 2021-11-03T16:56:53.475 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:53 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3706833643' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T16:56:53.476 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:53 smithi194 ceph-mon[65619]: osd.0 reported immediately failed by osd.3 2021-11-03T16:56:53.476 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:53 smithi194 ceph-mon[65619]: osd.0 reported immediately failed by osd.3 2021-11-03T16:56:53.476 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:53 smithi194 ceph-mon[65619]: osd.0 reported immediately failed by osd.5 2021-11-03T16:56:53.476 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:53 smithi194 ceph-mon[65619]: osd.0 reported immediately failed by osd.4 2021-11-03T16:56:53.477 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:53 smithi194 ceph-mon[65619]: osd.0 reported immediately failed by osd.5 2021-11-03T16:56:53.477 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:53 smithi194 ceph-mon[65619]: osd.0 reported immediately failed by osd.4 2021-11-03T16:56:53.477 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:53 smithi194 ceph-mon[65619]: osd.0 reported immediately failed by osd.1 2021-11-03T16:56:53.477 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:53 smithi194 ceph-mon[65619]: osd.0 reported immediately failed by osd.1 2021-11-03T16:56:53.477 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:53 smithi194 ceph-mon[65619]: osd.0 reported immediately failed by osd.2 2021-11-03T16:56:53.478 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:53 smithi194 ceph-mon[65619]: osd.0 reported immediately failed by osd.2 2021-11-03T16:56:54.288 INFO:journalctl@ceph.osd.0.smithi026.stdout:Nov 03 16:56:54 smithi026 systemd[1]: ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c@osd.0.service: Succeeded. 2021-11-03T16:56:54.289 INFO:journalctl@ceph.osd.0.smithi026.stdout:Nov 03 16:56:54 smithi026 systemd[1]: Stopped Ceph osd.0 for 70492bc6-3cc5-11ec-8c28-001a4aab830c. 2021-11-03T16:56:54.289 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:54 smithi026 ceph-mon[96795]: pgmap v36: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:54.289 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:54 smithi026 ceph-mon[96795]: Health check failed: 1 osds down (OSD_DOWN) 2021-11-03T16:56:54.290 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:54 smithi026 ceph-mon[96795]: osdmap e53: 6 total, 5 up, 6 in 2021-11-03T16:56:54.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:54 smithi194 ceph-mon[65619]: pgmap v36: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:54.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:54 smithi194 ceph-mon[65619]: Health check failed: 1 osds down (OSD_DOWN) 2021-11-03T16:56:54.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:54 smithi194 ceph-mon[65619]: osdmap e53: 6 total, 5 up, 6 in 2021-11-03T16:56:54.672 INFO:journalctl@ceph.osd.0.smithi026.stdout:Nov 03 16:56:54 smithi026 systemd[1]: Starting Ceph osd.0 for 70492bc6-3cc5-11ec-8c28-001a4aab830c... 2021-11-03T16:56:55.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:55 smithi026 ceph-mon[96795]: osdmap e54: 6 total, 5 up, 6 in 2021-11-03T16:56:55.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:55 smithi194 ceph-mon[65619]: osdmap e54: 6 total, 5 up, 6 in 2021-11-03T16:56:55.672 INFO:journalctl@ceph.osd.0.smithi026.stdout:Nov 03 16:56:55 smithi026 bash[104654]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-11-03T16:56:55.672 INFO:journalctl@ceph.osd.0.smithi026.stdout:Nov 03 16:56:55 smithi026 bash[104654]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --dev /dev/mapper/vg_nvme-lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2021-11-03T16:56:55.672 INFO:journalctl@ceph.osd.0.smithi026.stdout:Nov 03 16:56:55 smithi026 bash[104654]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2021-11-03T16:56:55.673 INFO:journalctl@ceph.osd.0.smithi026.stdout:Nov 03 16:56:55 smithi026 bash[104654]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2021-11-03T16:56:55.673 INFO:journalctl@ceph.osd.0.smithi026.stdout:Nov 03 16:56:55 smithi026 bash[104654]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2021-11-03T16:56:55.673 INFO:journalctl@ceph.osd.0.smithi026.stdout:Nov 03 16:56:55 smithi026 bash[104654]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-11-03T16:56:55.673 INFO:journalctl@ceph.osd.0.smithi026.stdout:Nov 03 16:56:55 smithi026 bash[104654]: --> ceph-volume raw activate successful for osd ID: 0 2021-11-03T16:56:56.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:56 smithi026 ceph-mon[96795]: pgmap v39: 65 pgs: 34 peering, 31 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:56.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:56 smithi026 ceph-mon[96795]: Health check failed: Reduced data availability: 34 pgs peering (PG_AVAILABILITY) 2021-11-03T16:56:56.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:56 smithi194 ceph-mon[65619]: pgmap v39: 65 pgs: 34 peering, 31 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:56.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:56 smithi194 ceph-mon[65619]: Health check failed: Reduced data availability: 34 pgs peering (PG_AVAILABILITY) 2021-11-03T16:56:57.172 INFO:journalctl@ceph.osd.0.smithi026.stdout:Nov 03 16:56:56 smithi026 bash[104654]: 21671cfb3b98e04d830eb47a68d1eba79aeb7c5bea17df2ecf0302c9bd0e0fc2 2021-11-03T16:56:57.172 INFO:journalctl@ceph.osd.0.smithi026.stdout:Nov 03 16:56:56 smithi026 ceph-osd[105199]: -- 172.21.15.26:0/4073645233 <== mon.0 v2:172.21.15.26:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c22f472340 con 0x55c22f439000 2021-11-03T16:56:57.172 INFO:journalctl@ceph.osd.0.smithi026.stdout:Nov 03 16:56:56 smithi026 systemd[1]: Started Ceph osd.0 for 70492bc6-3cc5-11ec-8c28-001a4aab830c. 2021-11-03T16:56:57.672 INFO:journalctl@ceph.osd.0.smithi026.stdout:Nov 03 16:56:57 smithi026 conmon[105167]: 2021-11-03T16:56:57.317+0000 7f81486ec0c0 -1 Falling back to public interface 2021-11-03T16:56:58.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:57 smithi026 ceph-mon[96795]: pgmap v40: 65 pgs: 34 peering, 31 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:58.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:57 smithi026 ceph-mon[96795]: poll took 7952.429 ms: 1 events 2021-11-03T16:56:58.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:57 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:58.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:57 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:56:58.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:57 smithi194 ceph-mon[65619]: pgmap v40: 65 pgs: 34 peering, 31 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:56:58.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:57 smithi194 ceph-mon[65619]: poll took 7952.429 ms: 1 events 2021-11-03T16:56:58.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:57 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:56:58.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:57 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:57:00.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:56:59 smithi026 ceph-mon[96795]: pgmap v41: 65 pgs: 34 peering, 31 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:57:00.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:56:59 smithi194 ceph-mon[65619]: pgmap v41: 65 pgs: 34 peering, 31 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:57:01.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:00 smithi026 ceph-mon[96795]: Health check failed: Degraded data redundancy: 9588/65073 objects degraded (14.734%), 29 pgs degraded (PG_DEGRADED) 2021-11-03T16:57:01.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:00 smithi026 ceph-mon[96795]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 34 pgs peering) 2021-11-03T16:57:01.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:00 smithi194 ceph-mon[65619]: Health check failed: Degraded data redundancy: 9588/65073 objects degraded (14.734%), 29 pgs degraded (PG_DEGRADED) 2021-11-03T16:57:01.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:00 smithi194 ceph-mon[65619]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 34 pgs peering) 2021-11-03T16:57:02.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:01 smithi026 ceph-mon[96795]: pgmap v42: 65 pgs: 29 active+undersized+degraded, 5 active+undersized, 31 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 9588/65073 objects degraded (14.734%) 2021-11-03T16:57:02.172 INFO:journalctl@ceph.osd.0.smithi026.stdout:Nov 03 16:57:01 smithi026 conmon[105167]: 2021-11-03T16:57:01.971+0000 7f81486ec0c0 -1 osd.0 52 log_to_monitors {default=true} 2021-11-03T16:57:02.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:01 smithi194 ceph-mon[65619]: pgmap v42: 65 pgs: 29 active+undersized+degraded, 5 active+undersized, 31 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 9588/65073 objects degraded (14.734%) 2021-11-03T16:57:03.172 INFO:journalctl@ceph.osd.0.smithi026.stdout:Nov 03 16:57:02 smithi026 conmon[105167]: 2021-11-03T16:57:02.915+0000 7f813b82f700 -1 osd.0 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-03T16:57:03.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:02 smithi026 ceph-mon[96795]: from='osd.0 [v2:172.21.15.26:6802/3697885964,v1:172.21.15.26:6803/3697885964]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-11-03T16:57:03.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:02 smithi026 ceph-mon[96795]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-11-03T16:57:03.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:02 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:57:03.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:02 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:57:03.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:02 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:57:03.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:02 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:57:03.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:02 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:57:03.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:02 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:57:03.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:02 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-11-03T16:57:03.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:02 smithi194 ceph-mon[65619]: from='osd.0 [v2:172.21.15.26:6802/3697885964,v1:172.21.15.26:6803/3697885964]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-11-03T16:57:03.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:02 smithi194 ceph-mon[65619]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-11-03T16:57:03.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:02 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:57:03.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:02 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:57:03.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:02 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:57:03.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:02 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:57:03.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:02 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:57:03.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:02 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:57:03.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:02 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-11-03T16:57:04.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:03 smithi026 ceph-mon[96795]: poll took 5037.070 ms: 1 events 2021-11-03T16:57:04.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:03 smithi026 ceph-mon[96795]: pgmap v43: 65 pgs: 29 active+undersized+degraded, 5 active+undersized, 31 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 9588/65073 objects degraded (14.734%) 2021-11-03T16:57:04.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:03 smithi026 ceph-mon[96795]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-11-03T16:57:04.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:03 smithi026 ceph-mon[96795]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2021-11-03T16:57:04.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:03 smithi026 ceph-mon[96795]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-11-03T16:57:04.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:03 smithi026 ceph-mon[96795]: osdmap e55: 6 total, 5 up, 6 in 2021-11-03T16:57:04.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:03 smithi026 ceph-mon[96795]: from='osd.0 [v2:172.21.15.26:6802/3697885964,v1:172.21.15.26:6803/3697885964]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2021-11-03T16:57:04.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:03 smithi026 ceph-mon[96795]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2021-11-03T16:57:04.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:03 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:57:04.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:03 smithi194 ceph-mon[65619]: poll took 5037.070 ms: 1 events 2021-11-03T16:57:04.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:03 smithi194 ceph-mon[65619]: pgmap v43: 65 pgs: 29 active+undersized+degraded, 5 active+undersized, 31 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 9588/65073 objects degraded (14.734%) 2021-11-03T16:57:04.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:03 smithi194 ceph-mon[65619]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-11-03T16:57:04.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:03 smithi194 ceph-mon[65619]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2021-11-03T16:57:04.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:03 smithi194 ceph-mon[65619]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-11-03T16:57:04.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:03 smithi194 ceph-mon[65619]: osdmap e55: 6 total, 5 up, 6 in 2021-11-03T16:57:04.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:03 smithi194 ceph-mon[65619]: from='osd.0 [v2:172.21.15.26:6802/3697885964,v1:172.21.15.26:6803/3697885964]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2021-11-03T16:57:04.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:03 smithi194 ceph-mon[65619]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2021-11-03T16:57:04.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:03 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:57:05.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:04 smithi194 ceph-mon[65619]: Health check cleared: OSD_DOWN (was: 1 osds down) 2021-11-03T16:57:05.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:04 smithi194 ceph-mon[65619]: osd.0 [v2:172.21.15.26:6802/3697885964,v1:172.21.15.26:6803/3697885964] boot 2021-11-03T16:57:05.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:04 smithi194 ceph-mon[65619]: osdmap e56: 6 total, 6 up, 6 in 2021-11-03T16:57:05.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:04 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-11-03T16:57:05.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:04 smithi194 ceph-mon[65619]: osdmap e57: 6 total, 6 up, 6 in 2021-11-03T16:57:05.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:04 smithi026 ceph-mon[96795]: Health check cleared: OSD_DOWN (was: 1 osds down) 2021-11-03T16:57:05.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:04 smithi026 ceph-mon[96795]: osd.0 [v2:172.21.15.26:6802/3697885964,v1:172.21.15.26:6803/3697885964] boot 2021-11-03T16:57:05.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:04 smithi026 ceph-mon[96795]: osdmap e56: 6 total, 6 up, 6 in 2021-11-03T16:57:05.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:04 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-11-03T16:57:05.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:04 smithi026 ceph-mon[96795]: osdmap e57: 6 total, 6 up, 6 in 2021-11-03T16:57:06.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:05 smithi194 ceph-mon[65619]: pgmap v46: 65 pgs: 25 peering, 9 active+undersized+degraded, 31 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 4089/65073 objects degraded (6.284%) 2021-11-03T16:57:06.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:05 smithi026 ceph-mon[96795]: pgmap v46: 65 pgs: 25 peering, 9 active+undersized+degraded, 31 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 4089/65073 objects degraded (6.284%) 2021-11-03T16:57:08.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:07 smithi194 ceph-mon[65619]: pgmap v48: 65 pgs: 25 peering, 9 active+undersized+degraded, 31 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 4089/65073 objects degraded (6.284%) 2021-11-03T16:57:08.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:07 smithi026 ceph-mon[96795]: pgmap v48: 65 pgs: 25 peering, 9 active+undersized+degraded, 31 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 4089/65073 objects degraded (6.284%) 2021-11-03T16:57:09.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:08 smithi194 ceph-mon[65619]: Health check update: Degraded data redundancy: 4089/65073 objects degraded (6.284%), 9 pgs degraded (PG_DEGRADED) 2021-11-03T16:57:09.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:08 smithi026 ceph-mon[96795]: Health check update: Degraded data redundancy: 4089/65073 objects degraded (6.284%), 9 pgs degraded (PG_DEGRADED) 2021-11-03T16:57:10.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:09 smithi194 ceph-mon[65619]: pgmap v49: 65 pgs: 9 active+clean+wait, 25 peering, 31 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:57:10.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:09 smithi194 ceph-mon[65619]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4089/65073 objects degraded (6.284%), 9 pgs degraded) 2021-11-03T16:57:10.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:09 smithi026 ceph-mon[96795]: pgmap v49: 65 pgs: 9 active+clean+wait, 25 peering, 31 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:57:10.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:09 smithi026 ceph-mon[96795]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4089/65073 objects degraded (6.284%), 9 pgs degraded) 2021-11-03T16:57:12.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:11 smithi194 ceph-mon[65619]: pgmap v50: 65 pgs: 9 active+clean+wait, 56 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:57:12.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:11 smithi026 ceph-mon[96795]: pgmap v50: 65 pgs: 9 active+clean+wait, 56 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:57:14.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:13 smithi194 ceph-mon[65619]: pgmap v51: 65 pgs: 9 active+clean+wait, 56 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:57:14.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:13 smithi026 ceph-mon[96795]: pgmap v51: 65 pgs: 9 active+clean+wait, 56 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:57:16.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:15 smithi194 ceph-mon[65619]: pgmap v52: 65 pgs: 9 active+clean+wait, 56 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:57:16.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:15 smithi026 ceph-mon[96795]: pgmap v52: 65 pgs: 9 active+clean+wait, 56 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:57:18.205 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:17 smithi026 ceph-mon[96795]: pgmap v53: 65 pgs: 9 active+clean+wait, 56 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:57:18.205 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:17 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-11-03T16:57:18.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:17 smithi194 ceph-mon[65619]: pgmap v53: 65 pgs: 9 active+clean+wait, 56 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:57:18.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:17 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-11-03T16:57:19.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:19 smithi026 ceph-mon[96795]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-11-03T16:57:19.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:19 smithi026 ceph-mon[96795]: Upgrade: osd.1 is safe to restart 2021-11-03T16:57:19.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:19 smithi026 ceph-mon[96795]: poll took 15022.778 ms: 1 events 2021-11-03T16:57:19.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:19 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:57:19.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:19 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:57:19.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:19 smithi194 ceph-mon[65619]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-11-03T16:57:19.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:19 smithi194 ceph-mon[65619]: Upgrade: osd.1 is safe to restart 2021-11-03T16:57:19.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:19 smithi194 ceph-mon[65619]: poll took 15022.778 ms: 1 events 2021-11-03T16:57:19.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:19 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:57:19.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:19 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:57:20.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:20 smithi026 ceph-mon[96795]: pgmap v54: 65 pgs: 9 active+clean+wait, 56 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:57:20.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:20 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:57:20.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:20 smithi194 ceph-mon[65619]: pgmap v54: 65 pgs: 9 active+clean+wait, 56 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:57:20.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:20 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:57:21.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:21 smithi026 ceph-mon[96795]: poll took 1852.898 ms: 1 events 2021-11-03T16:57:21.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:21 smithi026 ceph-mon[96795]: Upgrade: Updating osd.1 2021-11-03T16:57:21.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:21 smithi026 ceph-mon[96795]: Deploying daemon osd.1 on smithi026 2021-11-03T16:57:21.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:21 smithi194 ceph-mon[65619]: poll took 1852.898 ms: 1 events 2021-11-03T16:57:21.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:21 smithi194 ceph-mon[65619]: Upgrade: Updating osd.1 2021-11-03T16:57:21.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:21 smithi194 ceph-mon[65619]: Deploying daemon osd.1 on smithi026 2021-11-03T16:57:22.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:22 smithi026 ceph-mon[96795]: pgmap v55: 65 pgs: 9 active+clean+wait, 56 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:57:22.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:22 smithi194 ceph-mon[65619]: pgmap v55: 65 pgs: 9 active+clean+wait, 56 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:57:22.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.630+0000 7f7ebf08c700 1 -- 172.21.15.26:0/2769393582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7eb80f6530 msgr2=0x7f7eb80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:57:22.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.630+0000 7f7ebf08c700 1 --2- 172.21.15.26:0/2769393582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7eb80f6530 0x7f7eb80f6950 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f7eb4004660 tx=0x7f7eb4009b30).stop 2021-11-03T16:57:22.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.630+0000 7f7ebf08c700 1 -- 172.21.15.26:0/2769393582 shutdown_connections 2021-11-03T16:57:22.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.630+0000 7f7ebf08c700 1 --2- 172.21.15.26:0/2769393582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7eb80f77d0 0x7f7eb80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:22.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.630+0000 7f7ebf08c700 1 --2- 172.21.15.26:0/2769393582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7eb80f6530 0x7f7eb80f6950 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:22.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.630+0000 7f7ebf08c700 1 -- 172.21.15.26:0/2769393582 >> 172.21.15.26:0/2769393582 conn(0x7f7eb80f1c90 msgr2=0x7f7eb80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:57:22.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.630+0000 7f7ebf08c700 1 -- 172.21.15.26:0/2769393582 shutdown_connections 2021-11-03T16:57:22.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.630+0000 7f7ebf08c700 1 -- 172.21.15.26:0/2769393582 wait complete. 2021-11-03T16:57:22.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.630+0000 7f7ebf08c700 1 Processor -- start 2021-11-03T16:57:22.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.630+0000 7f7ebf08c700 1 -- start start 2021-11-03T16:57:22.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.631+0000 7f7ebf08c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7eb80f6530 0x7f7eb8106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:57:22.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.631+0000 7f7ebf08c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7eb80f77d0 0x7f7eb81072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:57:22.631 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.631+0000 7f7ebf08c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb81078f0 con 0x7f7eb80f6530 2021-11-03T16:57:22.631 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.631+0000 7f7ebf08c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb8108100 con 0x7f7eb80f77d0 2021-11-03T16:57:22.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.631+0000 7f7ebe08a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7eb80f6530 0x7f7eb8106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:57:22.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.631+0000 7f7ebe08a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7eb80f6530 0x7f7eb8106e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51320/0 (socket says 172.21.15.26:51320) 2021-11-03T16:57:22.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.631+0000 7f7ebe08a700 1 -- 172.21.15.26:0/2648905333 learned_addr learned my addr 172.21.15.26:0/2648905333 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:57:22.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.631+0000 7f7ebd889700 1 --2- 172.21.15.26:0/2648905333 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7eb80f77d0 0x7f7eb81072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:57:22.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.631+0000 7f7ebe08a700 1 -- 172.21.15.26:0/2648905333 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7eb80f77d0 msgr2=0x7f7eb81072f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:57:22.634 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.631+0000 7f7ebe08a700 1 --2- 172.21.15.26:0/2648905333 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7eb80f77d0 0x7f7eb81072f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:22.634 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.631+0000 7f7ebe08a700 1 -- 172.21.15.26:0/2648905333 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb4005040 con 0x7f7eb80f6530 2021-11-03T16:57:22.634 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.631+0000 7f7ebe08a700 1 --2- 172.21.15.26:0/2648905333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7eb80f6530 0x7f7eb8106e00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f7eb4004f60 tx=0x7f7eb4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:57:22.634 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.631+0000 7f7eaeffd700 1 -- 172.21.15.26:0/2648905333 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7eb4018070 con 0x7f7eb80f6530 2021-11-03T16:57:22.636 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.631+0000 7f7ebf08c700 1 -- 172.21.15.26:0/2648905333 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eb8108320 con 0x7f7eb80f6530 2021-11-03T16:57:22.636 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.631+0000 7f7eaeffd700 1 -- 172.21.15.26:0/2648905333 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7eb4007ba0 con 0x7f7eb80f6530 2021-11-03T16:57:22.636 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.631+0000 7f7eaeffd700 1 -- 172.21.15.26:0/2648905333 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7eb401c620 con 0x7f7eb80f6530 2021-11-03T16:57:22.637 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.632+0000 7f7ebf08c700 1 -- 172.21.15.26:0/2648905333 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb8108880 con 0x7f7eb80f6530 2021-11-03T16:57:22.637 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.633+0000 7f7ebf08c700 1 -- 172.21.15.26:0/2648905333 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eb8059100 con 0x7f7eb80f6530 2021-11-03T16:57:22.637 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.633+0000 7f7eaeffd700 1 -- 172.21.15.26:0/2648905333 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f7eb401c8e0 con 0x7f7eb80f6530 2021-11-03T16:57:22.637 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.633+0000 7f7eaeffd700 1 --2- 172.21.15.26:0/2648905333 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7ea4064100 0x7f7ea40665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:57:22.637 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.633+0000 7f7eaeffd700 1 -- 172.21.15.26:0/2648905333 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f7eb40826e0 con 0x7f7eb80f6530 2021-11-03T16:57:22.638 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.633+0000 7f7ebd889700 1 --2- 172.21.15.26:0/2648905333 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7ea4064100 0x7f7ea40665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:57:22.638 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.634+0000 7f7ebd889700 1 --2- 172.21.15.26:0/2648905333 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7ea4064100 0x7f7ea40665c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f7ea80041d0 tx=0x7f7ea8009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:57:22.639 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.638+0000 7f7eaeffd700 1 -- 172.21.15.26:0/2648905333 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f7eb4054b90 con 0x7f7eb80f6530 2021-11-03T16:57:22.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.831+0000 7f7ebf08c700 1 -- 172.21.15.26:0/2648905333 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7eb80008d0 con 0x7f7ea4064100 2021-11-03T16:57:22.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.832+0000 7f7eaeffd700 1 -- 172.21.15.26:0/2648905333 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+320 (secure 0 0 0) 0x7f7eb80008d0 con 0x7f7ea4064100 2021-11-03T16:57:22.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.834+0000 7f7ebf08c700 1 -- 172.21.15.26:0/2648905333 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7ea4064100 msgr2=0x7f7ea40665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:57:22.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.834+0000 7f7ebf08c700 1 --2- 172.21.15.26:0/2648905333 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7ea4064100 0x7f7ea40665c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f7ea80041d0 tx=0x7f7ea8009040).stop 2021-11-03T16:57:22.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.834+0000 7f7ebf08c700 1 -- 172.21.15.26:0/2648905333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7eb80f6530 msgr2=0x7f7eb8106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:57:22.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.834+0000 7f7ebf08c700 1 --2- 172.21.15.26:0/2648905333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7eb80f6530 0x7f7eb8106e00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f7eb4004f60 tx=0x7f7eb4009b30).stop 2021-11-03T16:57:22.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.834+0000 7f7ebf08c700 1 -- 172.21.15.26:0/2648905333 shutdown_connections 2021-11-03T16:57:22.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.834+0000 7f7ebf08c700 1 --2- 172.21.15.26:0/2648905333 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7ea4064100 0x7f7ea40665c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:22.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.834+0000 7f7ebf08c700 1 --2- 172.21.15.26:0/2648905333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7eb80f6530 0x7f7eb8106e00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:22.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.834+0000 7f7ebf08c700 1 --2- 172.21.15.26:0/2648905333 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7eb80f77d0 0x7f7eb81072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:22.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.834+0000 7f7ebf08c700 1 -- 172.21.15.26:0/2648905333 >> 172.21.15.26:0/2648905333 conn(0x7f7eb80f1c90 msgr2=0x7f7eb80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:57:22.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.835+0000 7f7ebf08c700 1 -- 172.21.15.26:0/2648905333 shutdown_connections 2021-11-03T16:57:22.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.835+0000 7f7ebf08c700 1 -- 172.21.15.26:0/2648905333 wait complete. 2021-11-03T16:57:22.840 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T16:57:22.891 INFO:journalctl@ceph.osd.1.smithi026.stdout:Nov 03 16:57:22 smithi026 systemd[1]: Stopping Ceph osd.1 for 70492bc6-3cc5-11ec-8c28-001a4aab830c... 2021-11-03T16:57:22.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.940+0000 7f96a2b62700 1 -- 172.21.15.26:0/2368483885 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f969c0f6810 msgr2=0x7f969c0f6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:57:22.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.940+0000 7f96a2b62700 1 --2- 172.21.15.26:0/2368483885 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f969c0f6810 0x7f969c0f6c70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f9688004660 tx=0x7f9688009b30).stop 2021-11-03T16:57:22.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.940+0000 7f96a2b62700 1 -- 172.21.15.26:0/2368483885 shutdown_connections 2021-11-03T16:57:22.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.940+0000 7f96a2b62700 1 --2- 172.21.15.26:0/2368483885 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f969c0f6810 0x7f969c0f6c70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:22.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.940+0000 7f96a2b62700 1 --2- 172.21.15.26:0/2368483885 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f969c0f5570 0x7f969c0f5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:22.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.940+0000 7f96a2b62700 1 -- 172.21.15.26:0/2368483885 >> 172.21.15.26:0/2368483885 conn(0x7f969c0f0cd0 msgr2=0x7f969c0f30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:57:22.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.940+0000 7f96a2b62700 1 -- 172.21.15.26:0/2368483885 shutdown_connections 2021-11-03T16:57:22.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.940+0000 7f96a2b62700 1 -- 172.21.15.26:0/2368483885 wait complete. 2021-11-03T16:57:22.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.940+0000 7f96a2b62700 1 Processor -- start 2021-11-03T16:57:22.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.940+0000 7f96a2b62700 1 -- start start 2021-11-03T16:57:22.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.941+0000 7f96a2b62700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f969c0f5570 0x7f969c106ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:57:22.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.941+0000 7f96a2b62700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f969c0f6810 0x7f969c1073b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:57:22.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.941+0000 7f96a2b62700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969c107960 con 0x7f969c0f6810 2021-11-03T16:57:22.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.941+0000 7f96a2b62700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969c107aa0 con 0x7f969c0f5570 2021-11-03T16:57:22.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.941+0000 7f969bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f969c0f6810 0x7f969c1073b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:57:22.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.941+0000 7f969bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f969c0f6810 0x7f969c1073b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51340/0 (socket says 172.21.15.26:51340) 2021-11-03T16:57:22.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.941+0000 7f969bfff700 1 -- 172.21.15.26:0/3281265645 learned_addr learned my addr 172.21.15.26:0/3281265645 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:57:22.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.941+0000 7f96a08fe700 1 --2- 172.21.15.26:0/3281265645 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f969c0f5570 0x7f969c106ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:57:22.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.941+0000 7f969bfff700 1 -- 172.21.15.26:0/3281265645 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f969c0f5570 msgr2=0x7f969c106ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:57:22.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.941+0000 7f969bfff700 1 --2- 172.21.15.26:0/3281265645 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f969c0f5570 0x7f969c106ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:22.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.941+0000 7f969bfff700 1 -- 172.21.15.26:0/3281265645 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9688005040 con 0x7f969c0f6810 2021-11-03T16:57:22.943 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.941+0000 7f969bfff700 1 --2- 172.21.15.26:0/3281265645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f969c0f6810 0x7f969c1073b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f9688009990 tx=0x7f9688009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:57:22.943 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.942+0000 7f96997fa700 1 -- 172.21.15.26:0/3281265645 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9688018070 con 0x7f969c0f6810 2021-11-03T16:57:22.943 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.942+0000 7f96a2b62700 1 -- 172.21.15.26:0/3281265645 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f969c1083e0 con 0x7f969c0f6810 2021-11-03T16:57:22.943 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.942+0000 7f96997fa700 1 -- 172.21.15.26:0/3281265645 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9688007ba0 con 0x7f969c0f6810 2021-11-03T16:57:22.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.942+0000 7f96997fa700 1 -- 172.21.15.26:0/3281265645 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f968801c3c0 con 0x7f969c0f6810 2021-11-03T16:57:22.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.942+0000 7f96a2b62700 1 -- 172.21.15.26:0/3281265645 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f969c108940 con 0x7f969c0f6810 2021-11-03T16:57:22.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.943+0000 7f96a2b62700 1 -- 172.21.15.26:0/3281265645 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f969c045ad0 con 0x7f969c0f6810 2021-11-03T16:57:22.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.944+0000 7f96997fa700 1 -- 172.21.15.26:0/3281265645 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f968801d420 con 0x7f969c0f6810 2021-11-03T16:57:22.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.944+0000 7f96997fa700 1 --2- 172.21.15.26:0/3281265645 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f968c064100 0x7f968c0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:57:22.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.944+0000 7f96997fa700 1 -- 172.21.15.26:0/3281265645 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f9688082520 con 0x7f969c0f6810 2021-11-03T16:57:22.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.944+0000 7f96a08fe700 1 --2- 172.21.15.26:0/3281265645 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f968c064100 0x7f968c0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:57:22.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.945+0000 7f96a08fe700 1 --2- 172.21.15.26:0/3281265645 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f968c064100 0x7f968c0665c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f969c0f6670 tx=0x7f969000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:57:22.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:22.952+0000 7f96997fa700 1 -- 172.21.15.26:0/3281265645 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f9688054940 con 0x7f969c0f6810 2021-11-03T16:57:23.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.133+0000 7f96a2b62700 1 -- 172.21.15.26:0/3281265645 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f969c0fac50 con 0x7f968c064100 2021-11-03T16:57:23.144 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.147+0000 7f96997fa700 1 -- 172.21.15.26:0/3281265645 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f969c0fac50 con 0x7f968c064100 2021-11-03T16:57:23.144 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T16:57:23.144 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (8m) 20s ago 9m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T16:57:23.145 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (50s) 20s ago 9m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T16:57:23.145 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (40s) 36s ago 9m 7000k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T16:57:23.145 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (8m) 20s ago 9m 38.7M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T16:57:23.145 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (95s) 20s ago 4m 13.0M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T16:57:23.145 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (115s) 20s ago 4m 14.4M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T16:57:23.146 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (5m) 36s ago 5m 15.3M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T16:57:23.146 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (4m) 36s ago 4m 15.7M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T16:57:23.146 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (2m) 20s ago 11m 463M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T16:57:23.146 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (116s) 36s ago 9m 410M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T16:57:23.147 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (104s) 20s ago 11m 75.0M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T16:57:23.147 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (83s) 36s ago 8m 61.4M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T16:57:23.147 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (9m) 20s ago 9m 18.1M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T16:57:23.147 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (8m) 36s ago 8m 18.3M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T16:57:23.147 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (26s) 20s ago 8m 11.6M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T16:57:23.148 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (7m) 20s ago 7m 414M 4096M 16.2.4 8d91d370c2b8 9e5ffa11984b 2021-11-03T16:57:23.148 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (7m) 20s ago 7m 351M 4096M 16.2.4 8d91d370c2b8 f65145633c0e 2021-11-03T16:57:23.148 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (7m) 36s ago 7m 495M 4096M 16.2.4 8d91d370c2b8 ff6d474a5f9a 2021-11-03T16:57:23.148 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (6m) 36s ago 6m 424M 4096M 16.2.4 8d91d370c2b8 e2fc9c0bdf0f 2021-11-03T16:57:23.149 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (6m) 36s ago 6m 471M 4096M 16.2.4 8d91d370c2b8 0abc64d8a2bf 2021-11-03T16:57:23.149 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (8m) 20s ago 9m 47.3M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T16:57:23.150 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.149+0000 7f96a2b62700 1 -- 172.21.15.26:0/3281265645 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f968c064100 msgr2=0x7f968c0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:57:23.150 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.149+0000 7f96a2b62700 1 --2- 172.21.15.26:0/3281265645 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f968c064100 0x7f968c0665c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f969c0f6670 tx=0x7f969000b040).stop 2021-11-03T16:57:23.150 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.149+0000 7f96a2b62700 1 -- 172.21.15.26:0/3281265645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f969c0f6810 msgr2=0x7f969c1073b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:57:23.150 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.149+0000 7f96a2b62700 1 --2- 172.21.15.26:0/3281265645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f969c0f6810 0x7f969c1073b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f9688009990 tx=0x7f9688009b30).stop 2021-11-03T16:57:23.151 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.150+0000 7f96a2b62700 1 -- 172.21.15.26:0/3281265645 shutdown_connections 2021-11-03T16:57:23.151 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.150+0000 7f96a2b62700 1 --2- 172.21.15.26:0/3281265645 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f968c064100 0x7f968c0665c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:23.151 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.150+0000 7f96a2b62700 1 --2- 172.21.15.26:0/3281265645 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f969c0f5570 0x7f969c106ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:23.151 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.150+0000 7f96a2b62700 1 --2- 172.21.15.26:0/3281265645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f969c0f6810 0x7f969c1073b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:23.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.150+0000 7f96a2b62700 1 -- 172.21.15.26:0/3281265645 >> 172.21.15.26:0/3281265645 conn(0x7f969c0f0cd0 msgr2=0x7f969c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:57:23.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.150+0000 7f96a2b62700 1 -- 172.21.15.26:0/3281265645 shutdown_connections 2021-11-03T16:57:23.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.150+0000 7f96a2b62700 1 -- 172.21.15.26:0/3281265645 wait complete. 2021-11-03T16:57:23.152 INFO:journalctl@ceph.osd.1.smithi026.stdout:Nov 03 16:57:22 smithi026 conmon[56412]: debug 2021-11-03T16:57:22.894+0000 7f1af475b700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2021-11-03T16:57:23.153 INFO:journalctl@ceph.osd.1.smithi026.stdout:Nov 03 16:57:22 smithi026 conmon[56412]: debug 2021-11-03T16:57:22.894+0000 7f1af475b700 -1 osd.1 57 *** Got signal Terminated *** 2021-11-03T16:57:23.153 INFO:journalctl@ceph.osd.1.smithi026.stdout:Nov 03 16:57:22 smithi026 conmon[56412]: debug 2021-11-03T16:57:22.894+0000 7f1af475b700 -1 osd.1 57 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-11-03T16:57:23.153 INFO:journalctl@ceph.osd.1.smithi026.stdout:Nov 03 16:57:22 smithi026 conmon[56412]: 2021-11-03T16:57:23.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.264+0000 7f57d5d3f700 1 -- 172.21.15.26:0/49613330 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57d00f6860 msgr2=0x7f57d00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:57:23.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.264+0000 7f57d5d3f700 1 --2- 172.21.15.26:0/49613330 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57d00f6860 0x7f57d00f6cc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f57c4004660 tx=0x7f57c4009b30).stop 2021-11-03T16:57:23.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.264+0000 7f57d5d3f700 1 -- 172.21.15.26:0/49613330 shutdown_connections 2021-11-03T16:57:23.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.264+0000 7f57d5d3f700 1 --2- 172.21.15.26:0/49613330 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57d00f6860 0x7f57d00f6cc0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:23.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.264+0000 7f57d5d3f700 1 --2- 172.21.15.26:0/49613330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57d00f55c0 0x7f57d00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:23.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.264+0000 7f57d5d3f700 1 -- 172.21.15.26:0/49613330 >> 172.21.15.26:0/49613330 conn(0x7f57d00f0d40 msgr2=0x7f57d00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:57:23.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.264+0000 7f57d5d3f700 1 -- 172.21.15.26:0/49613330 shutdown_connections 2021-11-03T16:57:23.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.264+0000 7f57d5d3f700 1 -- 172.21.15.26:0/49613330 wait complete. 2021-11-03T16:57:23.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.265+0000 7f57d5d3f700 1 Processor -- start 2021-11-03T16:57:23.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.265+0000 7f57d5d3f700 1 -- start start 2021-11-03T16:57:23.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.265+0000 7f57d5d3f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57d00f55c0 0x7f57d010c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:57:23.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.265+0000 7f57d5d3f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57d00f6860 0x7f57d010e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:57:23.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.265+0000 7f57d5d3f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d00602b0 con 0x7f57d00f55c0 2021-11-03T16:57:23.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.265+0000 7f57d5d3f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d00603f0 con 0x7f57d00f6860 2021-11-03T16:57:23.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.266+0000 7f57cf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57d00f55c0 0x7f57d010c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:57:23.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.266+0000 7f57cf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57d00f55c0 0x7f57d010c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51358/0 (socket says 172.21.15.26:51358) 2021-11-03T16:57:23.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.266+0000 7f57cf7fe700 1 -- 172.21.15.26:0/3836919673 learned_addr learned my addr 172.21.15.26:0/3836919673 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:57:23.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.266+0000 7f57ceffd700 1 --2- 172.21.15.26:0/3836919673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57d00f6860 0x7f57d010e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:57:23.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.266+0000 7f57cf7fe700 1 -- 172.21.15.26:0/3836919673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57d00f6860 msgr2=0x7f57d010e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:57:23.268 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.266+0000 7f57cf7fe700 1 --2- 172.21.15.26:0/3836919673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57d00f6860 0x7f57d010e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:23.268 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.266+0000 7f57cf7fe700 1 -- 172.21.15.26:0/3836919673 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c4005040 con 0x7f57d00f55c0 2021-11-03T16:57:23.268 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.266+0000 7f57cf7fe700 1 --2- 172.21.15.26:0/3836919673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57d00f55c0 0x7f57d010c080 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f57c0002700 tx=0x7f57c0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:57:23.268 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.266+0000 7f57b7fff700 1 -- 172.21.15.26:0/3836919673 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57c00079c0 con 0x7f57d00f55c0 2021-11-03T16:57:23.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.266+0000 7f57d5d3f700 1 -- 172.21.15.26:0/3836919673 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57d010ea70 con 0x7f57d00f55c0 2021-11-03T16:57:23.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.266+0000 7f57b7fff700 1 -- 172.21.15.26:0/3836919673 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f57c000f040 con 0x7f57d00f55c0 2021-11-03T16:57:23.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.266+0000 7f57b7fff700 1 -- 172.21.15.26:0/3836919673 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57c0014860 con 0x7f57d00f55c0 2021-11-03T16:57:23.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.266+0000 7f57d5d3f700 1 -- 172.21.15.26:0/3836919673 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57d010eef0 con 0x7f57d00f55c0 2021-11-03T16:57:23.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.268+0000 7f57d5d3f700 1 -- 172.21.15.26:0/3836919673 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57d0045ad0 con 0x7f57d00f55c0 2021-11-03T16:57:23.270 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.268+0000 7f57b7fff700 1 -- 172.21.15.26:0/3836919673 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f57c001b060 con 0x7f57d00f55c0 2021-11-03T16:57:23.270 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.268+0000 7f57b7fff700 1 --2- 172.21.15.26:0/3836919673 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f57b80640b0 0x7f57b8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:57:23.270 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.268+0000 7f57b7fff700 1 -- 172.21.15.26:0/3836919673 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f57c0080610 con 0x7f57d00f55c0 2021-11-03T16:57:23.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.268+0000 7f57ceffd700 1 --2- 172.21.15.26:0/3836919673 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f57b80640b0 0x7f57b8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:57:23.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.269+0000 7f57ceffd700 1 --2- 172.21.15.26:0/3836919673 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f57b80640b0 0x7f57b8066570 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f57c4004630 tx=0x7f57c4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:57:23.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.273+0000 7f57b7fff700 1 -- 172.21.15.26:0/3836919673 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f57c0052970 con 0x7f57d00f55c0 2021-11-03T16:57:23.422 INFO:journalctl@ceph.osd.1.smithi026.stdout:Nov 03 16:57:23 smithi026 bash[108334]: 9e5ffa11984b325ce6c1182d829915c1c21eaa29e550e4c6e6323ea946f2a5a2 2021-11-03T16:57:23.422 INFO:journalctl@ceph.osd.1.smithi026.stdout:Nov 03 16:57:23 smithi026 bash[108334]: Error: no container with name or ID ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c-osd-1 found: no such container 2021-11-03T16:57:23.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.513+0000 7f57d5d3f700 1 -- 172.21.15.26:0/3836919673 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f57d00fde50 con 0x7f57d00f55c0 2021-11-03T16:57:23.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.514+0000 7f57b7fff700 1 -- 172.21.15.26:0/3836919673 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+804 (secure 0 0 0) 0x7f57c0019340 con 0x7f57d00f55c0 2021-11-03T16:57:23.510 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T16:57:23.511 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T16:57:23.511 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T16:57:23.511 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:57:23.511 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T16:57:23.512 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T16:57:23.512 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:57:23.512 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T16:57:23.512 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5, 2021-11-03T16:57:23.513 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 1 2021-11-03T16:57:23.513 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:57:23.513 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T16:57:23.513 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T16:57:23.513 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:57:23.514 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T16:57:23.514 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2021-11-03T16:57:23.514 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 5 2021-11-03T16:57:23.515 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T16:57:23.515 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T16:57:23.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.516+0000 7f57d5d3f700 1 -- 172.21.15.26:0/3836919673 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f57b80640b0 msgr2=0x7f57b8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:57:23.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.516+0000 7f57d5d3f700 1 --2- 172.21.15.26:0/3836919673 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f57b80640b0 0x7f57b8066570 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f57c4004630 tx=0x7f57c4009b30).stop 2021-11-03T16:57:23.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.516+0000 7f57d5d3f700 1 -- 172.21.15.26:0/3836919673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57d00f55c0 msgr2=0x7f57d010c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:57:23.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.516+0000 7f57d5d3f700 1 --2- 172.21.15.26:0/3836919673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57d00f55c0 0x7f57d010c080 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f57c0002700 tx=0x7f57c0009d80).stop 2021-11-03T16:57:23.517 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.516+0000 7f57d5d3f700 1 -- 172.21.15.26:0/3836919673 shutdown_connections 2021-11-03T16:57:23.517 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.516+0000 7f57d5d3f700 1 --2- 172.21.15.26:0/3836919673 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f57b80640b0 0x7f57b8066570 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:23.517 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.516+0000 7f57d5d3f700 1 --2- 172.21.15.26:0/3836919673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57d00f55c0 0x7f57d010c080 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:23.518 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.516+0000 7f57d5d3f700 1 --2- 172.21.15.26:0/3836919673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57d00f6860 0x7f57d010e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:23.518 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.516+0000 7f57d5d3f700 1 -- 172.21.15.26:0/3836919673 >> 172.21.15.26:0/3836919673 conn(0x7f57d00f0d40 msgr2=0x7f57d00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:57:23.518 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.516+0000 7f57d5d3f700 1 -- 172.21.15.26:0/3836919673 shutdown_connections 2021-11-03T16:57:23.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.516+0000 7f57d5d3f700 1 -- 172.21.15.26:0/3836919673 wait complete. 2021-11-03T16:57:23.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.617+0000 7fe052766700 1 -- 172.21.15.26:0/1074140621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe04c0f55c0 msgr2=0x7fe04c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:57:23.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.617+0000 7fe052766700 1 --2- 172.21.15.26:0/1074140621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe04c0f55c0 0x7fe04c0f59e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fe034004660 tx=0x7fe034009b30).stop 2021-11-03T16:57:23.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.618+0000 7fe052766700 1 -- 172.21.15.26:0/1074140621 shutdown_connections 2021-11-03T16:57:23.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.618+0000 7fe052766700 1 --2- 172.21.15.26:0/1074140621 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe04c0f5ed0 0x7fe04c0f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:23.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.618+0000 7fe052766700 1 --2- 172.21.15.26:0/1074140621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe04c0f55c0 0x7fe04c0f59e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:23.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.618+0000 7fe052766700 1 -- 172.21.15.26:0/1074140621 >> 172.21.15.26:0/1074140621 conn(0x7fe04c0f0de0 msgr2=0x7fe04c0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:57:23.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.618+0000 7fe052766700 1 -- 172.21.15.26:0/1074140621 shutdown_connections 2021-11-03T16:57:23.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.618+0000 7fe052766700 1 -- 172.21.15.26:0/1074140621 wait complete. 2021-11-03T16:57:23.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.618+0000 7fe052766700 1 Processor -- start 2021-11-03T16:57:23.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.618+0000 7fe052766700 1 -- start start 2021-11-03T16:57:23.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.618+0000 7fe052766700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe04c0f55c0 0x7fe04c106f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:57:23.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.618+0000 7fe052766700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe04c0f5ed0 0x7fe04c107430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:57:23.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.618+0000 7fe052766700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c1079e0 con 0x7fe04c0f5ed0 2021-11-03T16:57:23.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.618+0000 7fe052766700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c107b20 con 0x7fe04c0f55c0 2021-11-03T16:57:23.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.619+0000 7fe04b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe04c0f5ed0 0x7fe04c107430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:57:23.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.619+0000 7fe04b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe04c0f5ed0 0x7fe04c107430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51380/0 (socket says 172.21.15.26:51380) 2021-11-03T16:57:23.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.619+0000 7fe04b7fe700 1 -- 172.21.15.26:0/1030461746 learned_addr learned my addr 172.21.15.26:0/1030461746 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:57:23.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.619+0000 7fe04bfff700 1 --2- 172.21.15.26:0/1030461746 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe04c0f55c0 0x7fe04c106f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:57:23.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.619+0000 7fe04b7fe700 1 -- 172.21.15.26:0/1030461746 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe04c0f55c0 msgr2=0x7fe04c106f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:57:23.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.619+0000 7fe04b7fe700 1 --2- 172.21.15.26:0/1030461746 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe04c0f55c0 0x7fe04c106f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:23.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.619+0000 7fe04b7fe700 1 -- 172.21.15.26:0/1030461746 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe034005040 con 0x7fe04c0f5ed0 2021-11-03T16:57:23.622 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.619+0000 7fe04b7fe700 1 --2- 172.21.15.26:0/1030461746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe04c0f5ed0 0x7fe04c107430 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fe03c0026d0 tx=0x7fe03c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:57:23.622 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.619+0000 7fe048ff9700 1 -- 172.21.15.26:0/1030461746 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe03c0079c0 con 0x7fe04c0f5ed0 2021-11-03T16:57:23.622 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.619+0000 7fe048ff9700 1 -- 172.21.15.26:0/1030461746 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe03c00f040 con 0x7fe04c0f5ed0 2021-11-03T16:57:23.623 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.619+0000 7fe052766700 1 -- 172.21.15.26:0/1030461746 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe04c1084c0 con 0x7fe04c0f5ed0 2021-11-03T16:57:23.623 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.619+0000 7fe048ff9700 1 -- 172.21.15.26:0/1030461746 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe03c0148b0 con 0x7fe04c0f5ed0 2021-11-03T16:57:23.623 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.619+0000 7fe052766700 1 -- 172.21.15.26:0/1030461746 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe04c108a80 con 0x7fe04c0f5ed0 2021-11-03T16:57:23.624 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.620+0000 7fe052766700 1 -- 172.21.15.26:0/1030461746 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe04c045ad0 con 0x7fe04c0f5ed0 2021-11-03T16:57:23.625 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.621+0000 7fe048ff9700 1 -- 172.21.15.26:0/1030461746 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fe03c007b20 con 0x7fe04c0f5ed0 2021-11-03T16:57:23.625 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.621+0000 7fe048ff9700 1 --2- 172.21.15.26:0/1030461746 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe038064090 0x7fe038066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:57:23.625 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.621+0000 7fe048ff9700 1 -- 172.21.15.26:0/1030461746 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fe03c080660 con 0x7fe04c0f5ed0 2021-11-03T16:57:23.625 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.621+0000 7fe04bfff700 1 --2- 172.21.15.26:0/1030461746 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe038064090 0x7fe038066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:57:23.626 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.622+0000 7fe04bfff700 1 --2- 172.21.15.26:0/1030461746 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe038064090 0x7fe038066550 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fe034004e30 tx=0x7fe034009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:57:23.626 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.625+0000 7fe048ff9700 1 -- 172.21.15.26:0/1030461746 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fe03c0529c0 con 0x7fe04c0f5ed0 2021-11-03T16:57:23.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.844+0000 7fe052766700 1 -- 172.21.15.26:0/1030461746 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe04c10d620 con 0x7fe04c0f5ed0 2021-11-03T16:57:23.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.845+0000 7fe048ff9700 1 -- 172.21.15.26:0/1030461746 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fe03c0525b0 con 0x7fe04c0f5ed0 2021-11-03T16:57:23.841 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T16:57:23.842 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T16:57:23.842 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T16:57:23.842 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T16:57:23.842 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:57:23.843 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T16:57:23.843 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T16:57:23.843 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T16:57:23.843 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T16:57:23.844 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T16:57:23.844 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T16:57:23.844 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T16:57:23.844 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T16:57:23.844 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T16:57:23.845 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T16:57:23.845 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T16:57:23.845 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T16:57:23.845 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T16:57:23.846 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T16:57:23.846 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T16:57:23.846 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T16:57:23.846 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T16:57:23.846 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T16:57:23.847 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T16:57:23.847 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T16:57:23.847 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T16:57:23.847 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T16:57:23.848 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T16:57:23.848 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T16:57:23.848 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T16:57:23.848 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T16:57:23.848 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:57:23.849 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:57:23.849 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T16:57:23.849 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:57:23.849 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T16:57:23.850 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T16:57:23.850 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T16:57:23.850 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T16:57:23.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.848+0000 7fe052766700 1 -- 172.21.15.26:0/1030461746 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe038064090 msgr2=0x7fe038066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:57:23.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.848+0000 7fe052766700 1 --2- 172.21.15.26:0/1030461746 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe038064090 0x7fe038066550 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fe034004e30 tx=0x7fe034009b30).stop 2021-11-03T16:57:23.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.848+0000 7fe052766700 1 -- 172.21.15.26:0/1030461746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe04c0f5ed0 msgr2=0x7fe04c107430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:57:23.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.848+0000 7fe052766700 1 --2- 172.21.15.26:0/1030461746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe04c0f5ed0 0x7fe04c107430 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fe03c0026d0 tx=0x7fe03c009de0).stop 2021-11-03T16:57:23.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.848+0000 7fe052766700 1 -- 172.21.15.26:0/1030461746 shutdown_connections 2021-11-03T16:57:23.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.848+0000 7fe052766700 1 --2- 172.21.15.26:0/1030461746 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe038064090 0x7fe038066550 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:23.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.848+0000 7fe052766700 1 --2- 172.21.15.26:0/1030461746 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe04c0f55c0 0x7fe04c106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:23.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.848+0000 7fe052766700 1 --2- 172.21.15.26:0/1030461746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe04c0f5ed0 0x7fe04c107430 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:23.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.848+0000 7fe052766700 1 -- 172.21.15.26:0/1030461746 >> 172.21.15.26:0/1030461746 conn(0x7fe04c0f0de0 msgr2=0x7fe04c05ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:57:23.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.848+0000 7fe052766700 1 -- 172.21.15.26:0/1030461746 shutdown_connections 2021-11-03T16:57:23.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:23.848+0000 7fe052766700 1 -- 172.21.15.26:0/1030461746 wait complete. 2021-11-03T16:57:23.855 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T16:57:24.105 INFO:journalctl@ceph.osd.1.smithi026.stdout:Nov 03 16:57:23 smithi026 bash[108334]: Error: container 9e5ffa11984b325ce6c1182d829915c1c21eaa29e550e4c6e6323ea946f2a5a2 does not exist in database: no such container 2021-11-03T16:57:24.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:24 smithi026 ceph-mon[96795]: pgmap v56: 65 pgs: 9 active+clean+wait, 56 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:57:24.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:24 smithi026 ceph-mon[96795]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:57:24.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:24 smithi026 ceph-mon[96795]: osd.1 reported immediately failed by osd.3 2021-11-03T16:57:24.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:24 smithi026 ceph-mon[96795]: osd.1 failed (root=default,host=smithi026) (connection refused reported by osd.3) 2021-11-03T16:57:24.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:24 smithi026 ceph-mon[96795]: osd.1 reported immediately failed by osd.2 2021-11-03T16:57:24.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:24 smithi026 ceph-mon[96795]: osd.1 reported immediately failed by osd.4 2021-11-03T16:57:24.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:24 smithi026 ceph-mon[96795]: osd.1 reported immediately failed by osd.3 2021-11-03T16:57:24.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:24 smithi026 ceph-mon[96795]: osd.1 reported immediately failed by osd.5 2021-11-03T16:57:24.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:24 smithi026 ceph-mon[96795]: osd.1 reported immediately failed by osd.0 2021-11-03T16:57:24.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:24 smithi026 ceph-mon[96795]: osd.1 reported immediately failed by osd.2 2021-11-03T16:57:24.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:24 smithi026 ceph-mon[96795]: osd.1 reported immediately failed by osd.4 2021-11-03T16:57:24.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:24 smithi026 ceph-mon[96795]: osd.1 reported immediately failed by osd.5 2021-11-03T16:57:24.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:24 smithi026 ceph-mon[96795]: osd.1 reported immediately failed by osd.0 2021-11-03T16:57:24.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:24 smithi026 ceph-mon[96795]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:57:24.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:24 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3836919673' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:57:24.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:24 smithi026 ceph-mon[96795]: osd.1 reported immediately failed by osd.5 2021-11-03T16:57:24.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:24 smithi026 ceph-mon[96795]: osd.1 reported immediately failed by osd.3 2021-11-03T16:57:24.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:24 smithi026 ceph-mon[96795]: osd.1 reported immediately failed by osd.5 2021-11-03T16:57:24.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:24 smithi026 ceph-mon[96795]: osd.1 reported immediately failed by osd.4 2021-11-03T16:57:24.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:24 smithi026 ceph-mon[96795]: osd.1 reported immediately failed by osd.3 2021-11-03T16:57:24.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:24 smithi026 ceph-mon[96795]: osd.1 reported immediately failed by osd.2 2021-11-03T16:57:24.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:24 smithi026 ceph-mon[96795]: osd.1 reported immediately failed by osd.4 2021-11-03T16:57:24.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:24 smithi026 ceph-mon[96795]: osd.1 reported immediately failed by osd.0 2021-11-03T16:57:24.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:24 smithi026 ceph-mon[96795]: osd.1 reported immediately failed by osd.2 2021-11-03T16:57:24.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:24 smithi026 ceph-mon[96795]: osd.1 reported immediately failed by osd.0 2021-11-03T16:57:24.428 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:24 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1030461746' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T16:57:24.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:24 smithi194 ceph-mon[65619]: pgmap v56: 65 pgs: 9 active+clean+wait, 56 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:57:24.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:24 smithi194 ceph-mon[65619]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:57:24.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:24 smithi194 ceph-mon[65619]: osd.1 reported immediately failed by osd.3 2021-11-03T16:57:24.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:24 smithi194 ceph-mon[65619]: osd.1 failed (root=default,host=smithi026) (connection refused reported by osd.3) 2021-11-03T16:57:24.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:24 smithi194 ceph-mon[65619]: osd.1 reported immediately failed by osd.2 2021-11-03T16:57:24.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:24 smithi194 ceph-mon[65619]: osd.1 reported immediately failed by osd.4 2021-11-03T16:57:24.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:24 smithi194 ceph-mon[65619]: osd.1 reported immediately failed by osd.3 2021-11-03T16:57:24.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:24 smithi194 ceph-mon[65619]: osd.1 reported immediately failed by osd.5 2021-11-03T16:57:24.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:24 smithi194 ceph-mon[65619]: osd.1 reported immediately failed by osd.0 2021-11-03T16:57:24.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:24 smithi194 ceph-mon[65619]: osd.1 reported immediately failed by osd.2 2021-11-03T16:57:24.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:24 smithi194 ceph-mon[65619]: osd.1 reported immediately failed by osd.4 2021-11-03T16:57:24.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:24 smithi194 ceph-mon[65619]: osd.1 reported immediately failed by osd.5 2021-11-03T16:57:24.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:24 smithi194 ceph-mon[65619]: osd.1 reported immediately failed by osd.0 2021-11-03T16:57:24.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:24 smithi194 ceph-mon[65619]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:57:24.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:24 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3836919673' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:57:24.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:24 smithi194 ceph-mon[65619]: osd.1 reported immediately failed by osd.5 2021-11-03T16:57:24.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:24 smithi194 ceph-mon[65619]: osd.1 reported immediately failed by osd.3 2021-11-03T16:57:24.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:24 smithi194 ceph-mon[65619]: osd.1 reported immediately failed by osd.5 2021-11-03T16:57:24.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:24 smithi194 ceph-mon[65619]: osd.1 reported immediately failed by osd.4 2021-11-03T16:57:24.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:24 smithi194 ceph-mon[65619]: osd.1 reported immediately failed by osd.3 2021-11-03T16:57:24.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:24 smithi194 ceph-mon[65619]: osd.1 reported immediately failed by osd.2 2021-11-03T16:57:24.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:24 smithi194 ceph-mon[65619]: osd.1 reported immediately failed by osd.4 2021-11-03T16:57:24.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:24 smithi194 ceph-mon[65619]: osd.1 reported immediately failed by osd.0 2021-11-03T16:57:24.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:24 smithi194 ceph-mon[65619]: osd.1 reported immediately failed by osd.2 2021-11-03T16:57:24.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:24 smithi194 ceph-mon[65619]: osd.1 reported immediately failed by osd.0 2021-11-03T16:57:24.505 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:24 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1030461746' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T16:57:25.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:25 smithi026 ceph-mon[96795]: Health check failed: 1 osds down (OSD_DOWN) 2021-11-03T16:57:25.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:25 smithi026 ceph-mon[96795]: osdmap e58: 6 total, 5 up, 6 in 2021-11-03T16:57:25.423 INFO:journalctl@ceph.osd.1.smithi026.stdout:Nov 03 16:57:25 smithi026 systemd[1]: ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c@osd.1.service: Succeeded. 2021-11-03T16:57:25.423 INFO:journalctl@ceph.osd.1.smithi026.stdout:Nov 03 16:57:25 smithi026 systemd[1]: Stopped Ceph osd.1 for 70492bc6-3cc5-11ec-8c28-001a4aab830c. 2021-11-03T16:57:25.423 INFO:journalctl@ceph.osd.1.smithi026.stdout:Nov 03 16:57:25 smithi026 systemd[1]: Starting Ceph osd.1 for 70492bc6-3cc5-11ec-8c28-001a4aab830c... 2021-11-03T16:57:25.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:25 smithi194 ceph-mon[65619]: Health check failed: 1 osds down (OSD_DOWN) 2021-11-03T16:57:25.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:25 smithi194 ceph-mon[65619]: osdmap e58: 6 total, 5 up, 6 in 2021-11-03T16:57:26.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:26 smithi026 ceph-mon[96795]: pgmap v58: 65 pgs: 12 stale+active+clean, 53 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:57:26.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:26 smithi026 ceph-mon[96795]: osdmap e59: 6 total, 5 up, 6 in 2021-11-03T16:57:26.423 INFO:journalctl@ceph.osd.1.smithi026.stdout:Nov 03 16:57:26 smithi026 bash[108883]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-11-03T16:57:26.423 INFO:journalctl@ceph.osd.1.smithi026.stdout:Nov 03 16:57:26 smithi026 bash[108883]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --dev /dev/mapper/vg_nvme-lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2021-11-03T16:57:26.424 INFO:journalctl@ceph.osd.1.smithi026.stdout:Nov 03 16:57:26 smithi026 bash[108883]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2021-11-03T16:57:26.424 INFO:journalctl@ceph.osd.1.smithi026.stdout:Nov 03 16:57:26 smithi026 bash[108883]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2021-11-03T16:57:26.424 INFO:journalctl@ceph.osd.1.smithi026.stdout:Nov 03 16:57:26 smithi026 bash[108883]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2021-11-03T16:57:26.424 INFO:journalctl@ceph.osd.1.smithi026.stdout:Nov 03 16:57:26 smithi026 bash[108883]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-11-03T16:57:26.424 INFO:journalctl@ceph.osd.1.smithi026.stdout:Nov 03 16:57:26 smithi026 bash[108883]: --> ceph-volume raw activate successful for osd ID: 1 2021-11-03T16:57:26.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:26 smithi194 ceph-mon[65619]: pgmap v58: 65 pgs: 12 stale+active+clean, 53 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:57:26.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:26 smithi194 ceph-mon[65619]: osdmap e59: 6 total, 5 up, 6 in 2021-11-03T16:57:27.922 INFO:journalctl@ceph.osd.1.smithi026.stdout:Nov 03 16:57:27 smithi026 ceph-osd[109417]: -- 172.21.15.26:0/901317551 <== mon.0 v2:172.21.15.26:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55fbe1990340 con 0x55fbe1957000 2021-11-03T16:57:27.923 INFO:journalctl@ceph.osd.1.smithi026.stdout:Nov 03 16:57:27 smithi026 bash[108883]: bb29e0ca66f82e3fca55473ce4d20fea8e6d3ac9750c8b465d8f0b30e593ec5e 2021-11-03T16:57:27.923 INFO:journalctl@ceph.osd.1.smithi026.stdout:Nov 03 16:57:27 smithi026 systemd[1]: Started Ceph osd.1 for 70492bc6-3cc5-11ec-8c28-001a4aab830c. 2021-11-03T16:57:28.422 INFO:journalctl@ceph.osd.1.smithi026.stdout:Nov 03 16:57:28 smithi026 conmon[109393]: 2021-11-03T16:57:28.141+0000 7f1195fac0c0 -1 Falling back to public interface 2021-11-03T16:57:28.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:28 smithi026 ceph-mon[96795]: pgmap v60: 65 pgs: 12 stale+active+clean, 53 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:57:28.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:57:28.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:57:28.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:28 smithi194 ceph-mon[65619]: pgmap v60: 65 pgs: 12 stale+active+clean, 53 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:57:28.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:57:28.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:57:29.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:29 smithi026 ceph-mon[96795]: poll took 7823.664 ms: 1 events 2021-11-03T16:57:29.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:29 smithi194 ceph-mon[65619]: poll took 7823.664 ms: 1 events 2021-11-03T16:57:30.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:30 smithi026 ceph-mon[96795]: pgmap v61: 65 pgs: 4 active+undersized+degraded, 9 stale+active+clean, 1 active+undersized, 51 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 2017/65073 objects degraded (3.100%) 2021-11-03T16:57:30.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:30 smithi026 ceph-mon[96795]: Health check failed: Degraded data redundancy: 2017/65073 objects degraded (3.100%), 4 pgs degraded (PG_DEGRADED) 2021-11-03T16:57:30.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:30 smithi194 ceph-mon[65619]: pgmap v61: 65 pgs: 4 active+undersized+degraded, 9 stale+active+clean, 1 active+undersized, 51 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 2017/65073 objects degraded (3.100%) 2021-11-03T16:57:30.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:30 smithi194 ceph-mon[65619]: Health check failed: Degraded data redundancy: 2017/65073 objects degraded (3.100%), 4 pgs degraded (PG_DEGRADED) 2021-11-03T16:57:32.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:32 smithi026 ceph-mon[96795]: pgmap v62: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 12169/65073 objects degraded (18.701%) 2021-11-03T16:57:32.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:32 smithi194 ceph-mon[65619]: pgmap v62: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 12169/65073 objects degraded (18.701%) 2021-11-03T16:57:33.172 INFO:journalctl@ceph.osd.1.smithi026.stdout:Nov 03 16:57:32 smithi026 conmon[109393]: 2021-11-03T16:57:32.918+0000 7f1195fac0c0 -1 osd.1 57 log_to_monitors {default=true} 2021-11-03T16:57:34.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:33 smithi194 ceph-mon[65619]: pgmap v63: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 12169/65073 objects degraded (18.701%) 2021-11-03T16:57:34.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:33 smithi194 ceph-mon[65619]: poll took 5172.362 ms: 1 events 2021-11-03T16:57:34.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:33 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:57:34.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:33 smithi194 ceph-mon[65619]: from='osd.1 [v2:172.21.15.26:6810/1648812112,v1:172.21.15.26:6811/1648812112]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-11-03T16:57:34.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:33 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:57:34.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:33 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:57:34.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:33 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:57:34.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:33 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:57:34.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:33 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:57:34.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:33 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-11-03T16:57:34.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:33 smithi194 ceph-mon[65619]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-11-03T16:57:34.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:33 smithi194 ceph-mon[65619]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2021-11-03T16:57:34.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:33 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:57:34.423 INFO:journalctl@ceph.osd.1.smithi026.stdout:Nov 03 16:57:33 smithi026 conmon[109393]: 2021-11-03T16:57:33.935+0000 7f11850e7700 -1 osd.1 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-03T16:57:34.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:33 smithi026 ceph-mon[96795]: pgmap v63: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 12169/65073 objects degraded (18.701%) 2021-11-03T16:57:34.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:33 smithi026 ceph-mon[96795]: poll took 5172.362 ms: 1 events 2021-11-03T16:57:34.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:33 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:57:34.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:33 smithi026 ceph-mon[96795]: from='osd.1 [v2:172.21.15.26:6810/1648812112,v1:172.21.15.26:6811/1648812112]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-11-03T16:57:34.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:33 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:57:34.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:33 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:57:34.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:33 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:57:34.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:33 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:57:34.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:33 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:57:34.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:33 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-11-03T16:57:34.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:33 smithi026 ceph-mon[96795]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-11-03T16:57:34.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:33 smithi026 ceph-mon[96795]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2021-11-03T16:57:34.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:33 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:57:35.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:34 smithi194 ceph-mon[65619]: from='osd.1 [v2:172.21.15.26:6810/1648812112,v1:172.21.15.26:6811/1648812112]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-11-03T16:57:35.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:34 smithi194 ceph-mon[65619]: osdmap e60: 6 total, 5 up, 6 in 2021-11-03T16:57:35.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:34 smithi194 ceph-mon[65619]: from='osd.1 [v2:172.21.15.26:6810/1648812112,v1:172.21.15.26:6811/1648812112]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2021-11-03T16:57:35.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:34 smithi026 ceph-mon[96795]: from='osd.1 [v2:172.21.15.26:6810/1648812112,v1:172.21.15.26:6811/1648812112]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-11-03T16:57:35.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:34 smithi026 ceph-mon[96795]: osdmap e60: 6 total, 5 up, 6 in 2021-11-03T16:57:35.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:34 smithi026 ceph-mon[96795]: from='osd.1 [v2:172.21.15.26:6810/1648812112,v1:172.21.15.26:6811/1648812112]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2021-11-03T16:57:36.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:35 smithi194 ceph-mon[65619]: pgmap v65: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 12169/65073 objects degraded (18.701%) 2021-11-03T16:57:36.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:35 smithi194 ceph-mon[65619]: Health check cleared: OSD_DOWN (was: 1 osds down) 2021-11-03T16:57:36.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:35 smithi194 ceph-mon[65619]: osd.1 [v2:172.21.15.26:6810/1648812112,v1:172.21.15.26:6811/1648812112] boot 2021-11-03T16:57:36.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:35 smithi194 ceph-mon[65619]: osdmap e61: 6 total, 6 up, 6 in 2021-11-03T16:57:36.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:35 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-11-03T16:57:36.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:35 smithi194 ceph-mon[65619]: osdmap e62: 6 total, 6 up, 6 in 2021-11-03T16:57:36.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:35 smithi026 ceph-mon[96795]: pgmap v65: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 12169/65073 objects degraded (18.701%) 2021-11-03T16:57:36.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:35 smithi026 ceph-mon[96795]: Health check cleared: OSD_DOWN (was: 1 osds down) 2021-11-03T16:57:36.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:35 smithi026 ceph-mon[96795]: osd.1 [v2:172.21.15.26:6810/1648812112,v1:172.21.15.26:6811/1648812112] boot 2021-11-03T16:57:36.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:35 smithi026 ceph-mon[96795]: osdmap e61: 6 total, 6 up, 6 in 2021-11-03T16:57:36.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:35 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-11-03T16:57:36.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:35 smithi026 ceph-mon[96795]: osdmap e62: 6 total, 6 up, 6 in 2021-11-03T16:57:38.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:37 smithi194 ceph-mon[65619]: pgmap v68: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 12169/65073 objects degraded (18.701%) 2021-11-03T16:57:38.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:37 smithi026 ceph-mon[96795]: pgmap v68: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 12169/65073 objects degraded (18.701%) 2021-11-03T16:57:39.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:38 smithi194 ceph-mon[65619]: Health check update: Degraded data redundancy: 12169/65073 objects degraded (18.701%), 28 pgs degraded (PG_DEGRADED) 2021-11-03T16:57:39.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:38 smithi026 ceph-mon[96795]: Health check update: Degraded data redundancy: 12169/65073 objects degraded (18.701%), 28 pgs degraded (PG_DEGRADED) 2021-11-03T16:57:40.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:39 smithi194 ceph-mon[65619]: pgmap v69: 65 pgs: 26 active+undersized+degraded, 6 active+undersized, 33 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 10807/65073 objects degraded (16.608%) 2021-11-03T16:57:40.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:39 smithi026 ceph-mon[96795]: pgmap v69: 65 pgs: 26 active+undersized+degraded, 6 active+undersized, 33 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 10807/65073 objects degraded (16.608%) 2021-11-03T16:57:41.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:41 smithi026 ceph-mon[96795]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 10807/65073 objects degraded (16.608%), 26 pgs degraded) 2021-11-03T16:57:41.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:41 smithi194 ceph-mon[65619]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 10807/65073 objects degraded (16.608%), 26 pgs degraded) 2021-11-03T16:57:42.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:42 smithi026 ceph-mon[96795]: pgmap v70: 65 pgs: 12 active+clean+wait, 53 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:57:42.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:42 smithi194 ceph-mon[65619]: pgmap v70: 65 pgs: 12 active+clean+wait, 53 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:57:44.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:44 smithi026 ceph-mon[96795]: pgmap v71: 65 pgs: 12 active+clean+wait, 53 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:57:44.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:44 smithi194 ceph-mon[65619]: pgmap v71: 65 pgs: 12 active+clean+wait, 53 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:57:46.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:46 smithi026 ceph-mon[96795]: pgmap v72: 65 pgs: 12 active+clean+wait, 53 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:57:46.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:46 smithi194 ceph-mon[65619]: pgmap v72: 65 pgs: 12 active+clean+wait, 53 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:57:48.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:48 smithi026 ceph-mon[96795]: pgmap v73: 65 pgs: 12 active+clean+wait, 53 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:57:48.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-11-03T16:57:48.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:48 smithi194 ceph-mon[65619]: pgmap v73: 65 pgs: 12 active+clean+wait, 53 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:57:48.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-11-03T16:57:49.304 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:49 smithi026 ceph-mon[96795]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-11-03T16:57:49.304 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:49 smithi026 ceph-mon[96795]: Upgrade: osd.2 is safe to restart 2021-11-03T16:57:49.304 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:49 smithi026 ceph-mon[96795]: poll took 15039.899 ms: 1 events 2021-11-03T16:57:49.304 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:57:49.305 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T16:57:49.305 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T16:57:49.305 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:57:49.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:49 smithi194 ceph-mon[65619]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-11-03T16:57:49.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:49 smithi194 ceph-mon[65619]: Upgrade: osd.2 is safe to restart 2021-11-03T16:57:49.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:49 smithi194 ceph-mon[65619]: poll took 15039.899 ms: 1 events 2021-11-03T16:57:49.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:57:49.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T16:57:49.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T16:57:49.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:57:50.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:50 smithi026 ceph-mon[96795]: pgmap v74: 65 pgs: 12 active+clean+wait, 53 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:57:50.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:50 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:57:50.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:50 smithi194 ceph-mon[65619]: pgmap v74: 65 pgs: 12 active+clean+wait, 53 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:57:50.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:50 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:57:51.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:51 smithi026 ceph-mon[96795]: poll took 2099.987 ms: 1 events 2021-11-03T16:57:51.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:51 smithi026 ceph-mon[96795]: Upgrade: Updating osd.2 2021-11-03T16:57:51.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:51 smithi026 ceph-mon[96795]: Deploying daemon osd.2 on smithi026 2021-11-03T16:57:51.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:51 smithi194 ceph-mon[65619]: poll took 2099.987 ms: 1 events 2021-11-03T16:57:51.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:51 smithi194 ceph-mon[65619]: Upgrade: Updating osd.2 2021-11-03T16:57:51.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:51 smithi194 ceph-mon[65619]: Deploying daemon osd.2 on smithi026 2021-11-03T16:57:52.382 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:52 smithi026 ceph-mon[96795]: pgmap v75: 65 pgs: 12 active+clean+wait, 53 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:57:52.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:52 smithi194 ceph-mon[65619]: pgmap v75: 65 pgs: 12 active+clean+wait, 53 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:57:53.374 INFO:journalctl@ceph.osd.2.smithi026.stdout:Nov 03 16:57:53 smithi026 systemd[1]: Stopping Ceph osd.2 for 70492bc6-3cc5-11ec-8c28-001a4aab830c... 2021-11-03T16:57:53.652 INFO:journalctl@ceph.osd.2.smithi026.stdout:Nov 03 16:57:53 smithi026 conmon[62841]: debug 2021-11-03T16:57:53.377+0000 7f30e4de5700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2021-11-03T16:57:53.652 INFO:journalctl@ceph.osd.2.smithi026.stdout:Nov 03 16:57:53 smithi026 conmon[62841]: debug 2021-11-03T16:57:53.377+0000 7f30e4de5700 -1 osd.2 62 *** Got signal Terminated *** 2021-11-03T16:57:53.652 INFO:journalctl@ceph.osd.2.smithi026.stdout:Nov 03 16:57:53 smithi026 conmon[62841]: debug 2021-11-03T16:57:53.377+0000 7f30e4de5700 -1 osd.2 62 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-11-03T16:57:53.922 INFO:journalctl@ceph.osd.2.smithi026.stdout:Nov 03 16:57:53 smithi026 bash[112418]: f65145633c0ee96492c003b0f15b69e7bce07aeff91aac527d1abce8583d441a 2021-11-03T16:57:53.922 INFO:journalctl@ceph.osd.2.smithi026.stdout:Nov 03 16:57:53 smithi026 bash[112418]: Error: no container with name or ID ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c-osd-2 found: no such container 2021-11-03T16:57:53.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:53.957+0000 7fadd31f2700 1 -- 172.21.15.26:0/4036137510 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadcc0f77d0 msgr2=0x7fadcc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:57:53.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:53.957+0000 7fadd31f2700 1 --2- 172.21.15.26:0/4036137510 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadcc0f77d0 0x7fadcc0f7c30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fadbc004660 tx=0x7fadbc009b30).stop 2021-11-03T16:57:53.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:53.957+0000 7fadd31f2700 1 -- 172.21.15.26:0/4036137510 shutdown_connections 2021-11-03T16:57:53.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:53.957+0000 7fadd31f2700 1 --2- 172.21.15.26:0/4036137510 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadcc0f77d0 0x7fadcc0f7c30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:53.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:53.957+0000 7fadd31f2700 1 --2- 172.21.15.26:0/4036137510 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fadcc0f6530 0x7fadcc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:53.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:53.957+0000 7fadd31f2700 1 -- 172.21.15.26:0/4036137510 >> 172.21.15.26:0/4036137510 conn(0x7fadcc0f1cd0 msgr2=0x7fadcc0f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:57:53.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:53.957+0000 7fadd31f2700 1 -- 172.21.15.26:0/4036137510 shutdown_connections 2021-11-03T16:57:53.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:53.957+0000 7fadd31f2700 1 -- 172.21.15.26:0/4036137510 wait complete. 2021-11-03T16:57:53.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:53.957+0000 7fadd31f2700 1 Processor -- start 2021-11-03T16:57:53.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:53.958+0000 7fadd31f2700 1 -- start start 2021-11-03T16:57:53.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:53.958+0000 7fadd31f2700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fadcc0f6530 0x7fadcc106d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:57:53.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:53.958+0000 7fadd31f2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadcc0f77d0 0x7fadcc107230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:57:53.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:53.958+0000 7fadd31f2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadcc1077e0 con 0x7fadcc0f77d0 2021-11-03T16:57:53.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:53.958+0000 7fadd31f2700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadcc107fe0 con 0x7fadcc0f6530 2021-11-03T16:57:53.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:53.958+0000 7fadd19ef700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadcc0f77d0 0x7fadcc107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:57:53.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:53.958+0000 7fadd19ef700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadcc0f77d0 0x7fadcc107230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51454/0 (socket says 172.21.15.26:51454) 2021-11-03T16:57:53.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:53.958+0000 7fadd19ef700 1 -- 172.21.15.26:0/811258967 learned_addr learned my addr 172.21.15.26:0/811258967 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:57:53.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:53.958+0000 7fadd21f0700 1 --2- 172.21.15.26:0/811258967 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fadcc0f6530 0x7fadcc106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:57:53.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:53.958+0000 7fadd19ef700 1 -- 172.21.15.26:0/811258967 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fadcc0f6530 msgr2=0x7fadcc106d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:57:53.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:53.958+0000 7fadd19ef700 1 --2- 172.21.15.26:0/811258967 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fadcc0f6530 0x7fadcc106d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:53.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:53.958+0000 7fadd19ef700 1 -- 172.21.15.26:0/811258967 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadbc005040 con 0x7fadcc0f77d0 2021-11-03T16:57:53.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:53.958+0000 7fadd19ef700 1 --2- 172.21.15.26:0/811258967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadcc0f77d0 0x7fadcc107230 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fadbc009990 tx=0x7fadbc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:57:53.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:53.958+0000 7fadc2ffd700 1 -- 172.21.15.26:0/811258967 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadbc018070 con 0x7fadcc0f77d0 2021-11-03T16:57:53.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:53.959+0000 7fadd31f2700 1 -- 172.21.15.26:0/811258967 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadcc108260 con 0x7fadcc0f77d0 2021-11-03T16:57:53.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:53.959+0000 7fadc2ffd700 1 -- 172.21.15.26:0/811258967 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fadbc007ca0 con 0x7fadcc0f77d0 2021-11-03T16:57:53.961 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:53.959+0000 7fadc2ffd700 1 -- 172.21.15.26:0/811258967 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadbc01c620 con 0x7fadcc0f77d0 2021-11-03T16:57:53.961 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:53.959+0000 7fadd31f2700 1 -- 172.21.15.26:0/811258967 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadcc1087c0 con 0x7fadcc0f77d0 2021-11-03T16:57:53.962 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:53.960+0000 7fadd31f2700 1 -- 172.21.15.26:0/811258967 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadcc059100 con 0x7fadcc0f77d0 2021-11-03T16:57:53.963 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:53.960+0000 7fadc2ffd700 1 -- 172.21.15.26:0/811258967 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fadbc01d960 con 0x7fadcc0f77d0 2021-11-03T16:57:53.963 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:53.960+0000 7fadc2ffd700 1 --2- 172.21.15.26:0/811258967 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fadb8064100 0x7fadb80665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:57:53.963 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:53.960+0000 7fadc2ffd700 1 -- 172.21.15.26:0/811258967 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fadbc0825e0 con 0x7fadcc0f77d0 2021-11-03T16:57:53.964 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:53.960+0000 7fadd21f0700 1 --2- 172.21.15.26:0/811258967 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fadb8064100 0x7fadb80665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:57:53.964 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:53.961+0000 7fadd21f0700 1 --2- 172.21.15.26:0/811258967 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fadb8064100 0x7fadb80665c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fadcc0f7630 tx=0x7fadc8009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:57:53.964 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:53.965+0000 7fadc2ffd700 1 -- 172.21.15.26:0/811258967 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fadbc054940 con 0x7fadcc0f77d0 2021-11-03T16:57:54.144 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.149+0000 7fadd31f2700 1 -- 172.21.15.26:0/811258967 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fadcc0fecf0 con 0x7fadb8064100 2021-11-03T16:57:54.145 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.150+0000 7fadc2ffd700 1 -- 172.21.15.26:0/811258967 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+320 (secure 0 0 0) 0x7fadcc0fecf0 con 0x7fadb8064100 2021-11-03T16:57:54.148 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.153+0000 7fadd31f2700 1 -- 172.21.15.26:0/811258967 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fadb8064100 msgr2=0x7fadb80665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:57:54.149 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.153+0000 7fadd31f2700 1 --2- 172.21.15.26:0/811258967 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fadb8064100 0x7fadb80665c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fadcc0f7630 tx=0x7fadc8009040).stop 2021-11-03T16:57:54.149 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.153+0000 7fadd31f2700 1 -- 172.21.15.26:0/811258967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadcc0f77d0 msgr2=0x7fadcc107230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:57:54.150 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.153+0000 7fadd31f2700 1 --2- 172.21.15.26:0/811258967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadcc0f77d0 0x7fadcc107230 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fadbc009990 tx=0x7fadbc009b30).stop 2021-11-03T16:57:54.150 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.153+0000 7fadd31f2700 1 -- 172.21.15.26:0/811258967 shutdown_connections 2021-11-03T16:57:54.150 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.153+0000 7fadd31f2700 1 --2- 172.21.15.26:0/811258967 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fadb8064100 0x7fadb80665c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:54.151 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.153+0000 7fadd31f2700 1 --2- 172.21.15.26:0/811258967 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fadcc0f6530 0x7fadcc106d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:54.151 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.153+0000 7fadd31f2700 1 --2- 172.21.15.26:0/811258967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadcc0f77d0 0x7fadcc107230 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:54.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.153+0000 7fadd31f2700 1 -- 172.21.15.26:0/811258967 >> 172.21.15.26:0/811258967 conn(0x7fadcc0f1cd0 msgr2=0x7fadcc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:57:54.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.153+0000 7fadd31f2700 1 -- 172.21.15.26:0/811258967 shutdown_connections 2021-11-03T16:57:54.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.153+0000 7fadd31f2700 1 -- 172.21.15.26:0/811258967 wait complete. 2021-11-03T16:57:54.163 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T16:57:54.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.264+0000 7f61f7d2e700 1 -- 172.21.15.26:0/3484860469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61f00f66e0 msgr2=0x7f61f00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:57:54.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.264+0000 7f61f7d2e700 1 --2- 172.21.15.26:0/3484860469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61f00f66e0 0x7f61f00f6b00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f61ec004660 tx=0x7f61ec009b30).stop 2021-11-03T16:57:54.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.264+0000 7f61f7d2e700 1 -- 172.21.15.26:0/3484860469 shutdown_connections 2021-11-03T16:57:54.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.264+0000 7f61f7d2e700 1 --2- 172.21.15.26:0/3484860469 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61f00f7980 0x7f61f00f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T16:57:54.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.264+0000 7f61f7d2e700 1 --2- 172.21.15.26:0/3484860469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61f00f66e0 0x7f61f00f6b00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:54.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.264+0000 7f61f7d2e700 1 -- 172.21.15.26:0/3484860469 >> 172.21.15.26:0/3484860469 conn(0x7f61f00f1e40 msgr2=0x7f61f00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:57:54.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.265+0000 7f61f7d2e700 1 -- 172.21.15.26:0/3484860469 shutdown_connections 2021-11-03T16:57:54.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.265+0000 7f61f7d2e700 1 -- 172.21.15.26:0/3484860469 wait complete. 2021-11-03T16:57:54.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.265+0000 7f61f7d2e700 1 Processor -- start 2021-11-03T16:57:54.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.265+0000 7f61f7d2e700 1 -- start start 2021-11-03T16:57:54.268 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.265+0000 7f61f7d2e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61f00f66e0 0x7f61f006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:57:54.268 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.265+0000 7f61f7d2e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61f00f7980 0x7f61f0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:57:54.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.265+0000 7f61f7d2e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f006a410 con 0x7f61f00f7980 2021-11-03T16:57:54.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.265+0000 7f61f7d2e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f006a550 con 0x7f61f00f66e0 2021-11-03T16:57:54.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.265+0000 7f61f52c9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61f00f7980 0x7f61f0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:57:54.270 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.265+0000 7f61f52c9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61f00f7980 0x7f61f0069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51470/0 (socket says 172.21.15.26:51470) 2021-11-03T16:57:54.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.265+0000 7f61f52c9700 1 -- 172.21.15.26:0/1943483643 learned_addr learned my addr 172.21.15.26:0/1943483643 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:57:54.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.266+0000 7f61f5aca700 1 --2- 172.21.15.26:0/1943483643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61f00f66e0 0x7f61f006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:57:54.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.266+0000 7f61f52c9700 1 -- 172.21.15.26:0/1943483643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61f00f66e0 msgr2=0x7f61f006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:57:54.272 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.266+0000 7f61f52c9700 1 --2- 172.21.15.26:0/1943483643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61f00f66e0 0x7f61f006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:54.272 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.266+0000 7f61f52c9700 1 -- 172.21.15.26:0/1943483643 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ec005040 con 0x7f61f00f7980 2021-11-03T16:57:54.273 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.266+0000 7f61f52c9700 1 --2- 172.21.15.26:0/1943483643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61f00f7980 0x7f61f0069e20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f61e000b410 tx=0x7f61e0006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:57:54.273 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.266+0000 7f61e67fc700 1 -- 172.21.15.26:0/1943483643 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61e00125f0 con 0x7f61f00f7980 2021-11-03T16:57:54.274 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.266+0000 7f61e67fc700 1 -- 172.21.15.26:0/1943483643 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f61e0012c00 con 0x7f61f00f7980 2021-11-03T16:57:54.274 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.266+0000 7f61f7d2e700 1 -- 172.21.15.26:0/1943483643 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f006a830 con 0x7f61f00f7980 2021-11-03T16:57:54.274 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.266+0000 7f61e67fc700 1 -- 172.21.15.26:0/1943483643 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61e0002ae0 con 0x7f61f00f7980 2021-11-03T16:57:54.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.266+0000 7f61f7d2e700 1 -- 172.21.15.26:0/1943483643 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f010efe0 con 0x7f61f00f7980 2021-11-03T16:57:54.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.267+0000 7f61f7d2e700 1 -- 172.21.15.26:0/1943483643 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f0045ad0 con 0x7f61f00f7980 2021-11-03T16:57:54.277 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.268+0000 7f61e67fc700 1 -- 172.21.15.26:0/1943483643 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f61e000f030 con 0x7f61f00f7980 2021-11-03T16:57:54.277 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.268+0000 7f61e67fc700 1 --2- 172.21.15.26:0/1943483643 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f61dc0640b0 0x7f61dc066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:57:54.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.268+0000 7f61e67fc700 1 -- 172.21.15.26:0/1943483643 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f61e0080c60 con 0x7f61f00f7980 2021-11-03T16:57:54.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.268+0000 7f61f5aca700 1 --2- 172.21.15.26:0/1943483643 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f61dc0640b0 0x7f61dc066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:57:54.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.269+0000 7f61f5aca700 1 --2- 172.21.15.26:0/1943483643 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f61dc0640b0 0x7f61dc066570 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f61ec009da0 tx=0x7f61ec009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:57:54.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.272+0000 7f61e67fc700 1 -- 172.21.15.26:0/1943483643 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f61e0052fc0 con 0x7f61f00f7980 2021-11-03T16:57:54.422 INFO:journalctl@ceph.osd.2.smithi026.stdout:Nov 03 16:57:54 smithi026 bash[112418]: Error: container f65145633c0ee96492c003b0f15b69e7bce07aeff91aac527d1abce8583d441a does not exist in database: no such container 2021-11-03T16:57:54.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:54 smithi026 ceph-mon[96795]: pgmap v76: 65 pgs: 12 active+clean+wait, 53 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:57:54.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:54 smithi026 ceph-mon[96795]: osd.2 reported immediately failed by osd.3 2021-11-03T16:57:54.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:54 smithi026 ceph-mon[96795]: osd.2 failed (root=default,host=smithi026) (connection refused reported by osd.3) 2021-11-03T16:57:54.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:54 smithi026 ceph-mon[96795]: osd.2 reported immediately failed by osd.3 2021-11-03T16:57:54.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:54 smithi026 ceph-mon[96795]: osd.2 reported immediately failed by osd.3 2021-11-03T16:57:54.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:54 smithi026 ceph-mon[96795]: osd.2 reported immediately failed by osd.5 2021-11-03T16:57:54.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:54 smithi026 ceph-mon[96795]: osd.2 reported immediately failed by osd.1 2021-11-03T16:57:54.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:54 smithi026 ceph-mon[96795]: osd.2 reported immediately failed by osd.0 2021-11-03T16:57:54.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:54 smithi026 ceph-mon[96795]: osd.2 reported immediately failed by osd.4 2021-11-03T16:57:54.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:54 smithi026 ceph-mon[96795]: osd.2 reported immediately failed by osd.5 2021-11-03T16:57:54.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:54 smithi026 ceph-mon[96795]: osd.2 reported immediately failed by osd.1 2021-11-03T16:57:54.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:54 smithi026 ceph-mon[96795]: osd.2 reported immediately failed by osd.0 2021-11-03T16:57:54.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:54 smithi026 ceph-mon[96795]: osd.2 reported immediately failed by osd.4 2021-11-03T16:57:54.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:54 smithi026 ceph-mon[96795]: osd.2 reported immediately failed by osd.3 2021-11-03T16:57:54.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:54 smithi026 ceph-mon[96795]: osd.2 reported immediately failed by osd.1 2021-11-03T16:57:54.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:54 smithi026 ceph-mon[96795]: osd.2 reported immediately failed by osd.4 2021-11-03T16:57:54.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:54 smithi026 ceph-mon[96795]: osd.2 reported immediately failed by osd.3 2021-11-03T16:57:54.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:54 smithi026 ceph-mon[96795]: osd.2 reported immediately failed by osd.5 2021-11-03T16:57:54.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:54 smithi026 ceph-mon[96795]: osd.2 reported immediately failed by osd.1 2021-11-03T16:57:54.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:54 smithi026 ceph-mon[96795]: osd.2 reported immediately failed by osd.0 2021-11-03T16:57:54.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:54 smithi026 ceph-mon[96795]: osd.2 reported immediately failed by osd.4 2021-11-03T16:57:54.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:54 smithi026 ceph-mon[96795]: osd.2 reported immediately failed by osd.3 2021-11-03T16:57:54.428 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:54 smithi026 ceph-mon[96795]: osd.2 reported immediately failed by osd.5 2021-11-03T16:57:54.428 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:54 smithi026 ceph-mon[96795]: osd.2 reported immediately failed by osd.0 2021-11-03T16:57:54.428 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:54 smithi026 ceph-mon[96795]: osd.2 reported immediately failed by osd.3 2021-11-03T16:57:54.428 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:54 smithi026 ceph-mon[96795]: osd.2 reported immediately failed by osd.4 2021-11-03T16:57:54.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.467+0000 7f61f7d2e700 1 -- 172.21.15.26:0/1943483643 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f61f00ff0d0 con 0x7f61dc0640b0 2021-11-03T16:57:54.477 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.482+0000 7f61e67fc700 1 -- 172.21.15.26:0/1943483643 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f61ec009630 con 0x7f61dc0640b0 2021-11-03T16:57:54.478 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T16:57:54.478 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (9m) 21s ago 10m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T16:57:54.479 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (81s) 21s ago 10m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T16:57:54.479 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (71s) 67s ago 9m 7000k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T16:57:54.480 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (8m) 21s ago 10m 38.9M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T16:57:54.480 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (2m) 21s ago 5m 13.2M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T16:57:54.480 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (2m) 21s ago 5m 14.5M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T16:57:54.481 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (5m) 67s ago 5m 15.3M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T16:57:54.481 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (5m) 67s ago 5m 15.7M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T16:57:54.481 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (2m) 21s ago 11m 466M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T16:57:54.482 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (2m) 67s ago 9m 410M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T16:57:54.482 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (2m) 21s ago 11m 77.9M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T16:57:54.482 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (115s) 67s ago 9m 61.4M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T16:57:54.483 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (10m) 21s ago 10m 18.1M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T16:57:54.483 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (9m) 67s ago 9m 18.3M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T16:57:54.483 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (57s) 21s ago 8m 149M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T16:57:54.483 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (27s) 21s ago 8m 11.9M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T16:57:54.483 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (8m) 21s ago 8m 357M 4096M 16.2.4 8d91d370c2b8 f65145633c0e 2021-11-03T16:57:54.484 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (7m) 67s ago 7m 495M 4096M 16.2.4 8d91d370c2b8 ff6d474a5f9a 2021-11-03T16:57:54.484 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (7m) 67s ago 7m 424M 4096M 16.2.4 8d91d370c2b8 e2fc9c0bdf0f 2021-11-03T16:57:54.484 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (7m) 67s ago 7m 471M 4096M 16.2.4 8d91d370c2b8 0abc64d8a2bf 2021-11-03T16:57:54.484 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (8m) 21s ago 9m 47.4M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T16:57:54.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.484+0000 7f61f7d2e700 1 -- 172.21.15.26:0/1943483643 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f61dc0640b0 msgr2=0x7f61dc066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:57:54.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.484+0000 7f61f7d2e700 1 --2- 172.21.15.26:0/1943483643 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f61dc0640b0 0x7f61dc066570 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f61ec009da0 tx=0x7f61ec009b30).stop 2021-11-03T16:57:54.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.484+0000 7f61f7d2e700 1 -- 172.21.15.26:0/1943483643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61f00f7980 msgr2=0x7f61f0069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:57:54.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.484+0000 7f61f7d2e700 1 --2- 172.21.15.26:0/1943483643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61f00f7980 0x7f61f0069e20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f61e000b410 tx=0x7f61e0006ef0).stop 2021-11-03T16:57:54.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.484+0000 7f61f7d2e700 1 -- 172.21.15.26:0/1943483643 shutdown_connections 2021-11-03T16:57:54.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.484+0000 7f61f7d2e700 1 --2- 172.21.15.26:0/1943483643 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f61dc0640b0 0x7f61dc066570 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:54.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.484+0000 7f61f7d2e700 1 --2- 172.21.15.26:0/1943483643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61f00f66e0 0x7f61f006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:54.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.484+0000 7f61f7d2e700 1 --2- 172.21.15.26:0/1943483643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61f00f7980 0x7f61f0069e20 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0x7f61e000b410 tx=0x7f61e0006ef0).stop 2021-11-03T16:57:54.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.484+0000 7f61f7d2e700 1 -- 172.21.15.26:0/1943483643 >> 172.21.15.26:0/1943483643 conn(0x7f61f00f1e40 msgr2=0x7f61f00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:57:54.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.485+0000 7f61f7d2e700 1 -- 172.21.15.26:0/1943483643 shutdown_connections 2021-11-03T16:57:54.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.485+0000 7f61f7d2e700 1 -- 172.21.15.26:0/1943483643 wait complete. 2021-11-03T16:57:54.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:54 smithi194 ceph-mon[65619]: pgmap v76: 65 pgs: 12 active+clean+wait, 53 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:57:54.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:54 smithi194 ceph-mon[65619]: osd.2 reported immediately failed by osd.3 2021-11-03T16:57:54.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:54 smithi194 ceph-mon[65619]: osd.2 failed (root=default,host=smithi026) (connection refused reported by osd.3) 2021-11-03T16:57:54.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:54 smithi194 ceph-mon[65619]: osd.2 reported immediately failed by osd.3 2021-11-03T16:57:54.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:54 smithi194 ceph-mon[65619]: osd.2 reported immediately failed by osd.3 2021-11-03T16:57:54.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:54 smithi194 ceph-mon[65619]: osd.2 reported immediately failed by osd.5 2021-11-03T16:57:54.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:54 smithi194 ceph-mon[65619]: osd.2 reported immediately failed by osd.1 2021-11-03T16:57:54.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:54 smithi194 ceph-mon[65619]: osd.2 reported immediately failed by osd.0 2021-11-03T16:57:54.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:54 smithi194 ceph-mon[65619]: osd.2 reported immediately failed by osd.4 2021-11-03T16:57:54.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:54 smithi194 ceph-mon[65619]: osd.2 reported immediately failed by osd.5 2021-11-03T16:57:54.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:54 smithi194 ceph-mon[65619]: osd.2 reported immediately failed by osd.1 2021-11-03T16:57:54.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:54 smithi194 ceph-mon[65619]: osd.2 reported immediately failed by osd.0 2021-11-03T16:57:54.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:54 smithi194 ceph-mon[65619]: osd.2 reported immediately failed by osd.4 2021-11-03T16:57:54.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:54 smithi194 ceph-mon[65619]: osd.2 reported immediately failed by osd.3 2021-11-03T16:57:54.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:54 smithi194 ceph-mon[65619]: osd.2 reported immediately failed by osd.1 2021-11-03T16:57:54.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:54 smithi194 ceph-mon[65619]: osd.2 reported immediately failed by osd.4 2021-11-03T16:57:54.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:54 smithi194 ceph-mon[65619]: osd.2 reported immediately failed by osd.3 2021-11-03T16:57:54.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:54 smithi194 ceph-mon[65619]: osd.2 reported immediately failed by osd.5 2021-11-03T16:57:54.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:54 smithi194 ceph-mon[65619]: osd.2 reported immediately failed by osd.1 2021-11-03T16:57:54.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:54 smithi194 ceph-mon[65619]: osd.2 reported immediately failed by osd.0 2021-11-03T16:57:54.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:54 smithi194 ceph-mon[65619]: osd.2 reported immediately failed by osd.4 2021-11-03T16:57:54.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:54 smithi194 ceph-mon[65619]: osd.2 reported immediately failed by osd.3 2021-11-03T16:57:54.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:54 smithi194 ceph-mon[65619]: osd.2 reported immediately failed by osd.5 2021-11-03T16:57:54.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:54 smithi194 ceph-mon[65619]: osd.2 reported immediately failed by osd.0 2021-11-03T16:57:54.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:54 smithi194 ceph-mon[65619]: osd.2 reported immediately failed by osd.3 2021-11-03T16:57:54.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:54 smithi194 ceph-mon[65619]: osd.2 reported immediately failed by osd.4 2021-11-03T16:57:54.589 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.593+0000 7fa0e5f9f700 1 -- 172.21.15.26:0/1606833615 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0e00f55e0 msgr2=0x7fa0e00f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:57:54.590 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.593+0000 7fa0e5f9f700 1 --2- 172.21.15.26:0/1606833615 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0e00f55e0 0x7fa0e00f5a00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fa0d0004660 tx=0x7fa0d0009b30).stop 2021-11-03T16:57:54.590 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.594+0000 7fa0e5f9f700 1 -- 172.21.15.26:0/1606833615 shutdown_connections 2021-11-03T16:57:54.590 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.594+0000 7fa0e5f9f700 1 --2- 172.21.15.26:0/1606833615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0e00f5ef0 0x7fa0e00f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:54.590 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.594+0000 7fa0e5f9f700 1 --2- 172.21.15.26:0/1606833615 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0e00f55e0 0x7fa0e00f5a00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:54.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.594+0000 7fa0e5f9f700 1 -- 172.21.15.26:0/1606833615 >> 172.21.15.26:0/1606833615 conn(0x7fa0e00f0de0 msgr2=0x7fa0e00f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:57:54.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.594+0000 7fa0e5f9f700 1 -- 172.21.15.26:0/1606833615 shutdown_connections 2021-11-03T16:57:54.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.594+0000 7fa0e5f9f700 1 -- 172.21.15.26:0/1606833615 wait complete. 2021-11-03T16:57:54.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.594+0000 7fa0e5f9f700 1 Processor -- start 2021-11-03T16:57:54.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.594+0000 7fa0e5f9f700 1 -- start start 2021-11-03T16:57:54.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.594+0000 7fa0e5f9f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0e00f55e0 0x7fa0e0106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:57:54.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.595+0000 7fa0e5f9f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0e00f5ef0 0x7fa0e0107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:57:54.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.595+0000 7fa0e5f9f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e0107a10 con 0x7fa0e00f55e0 2021-11-03T16:57:54.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.595+0000 7fa0e5f9f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e0107b50 con 0x7fa0e00f5ef0 2021-11-03T16:57:54.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.595+0000 7fa0df7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0e00f55e0 0x7fa0e0106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:57:54.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.595+0000 7fa0df7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0e00f55e0 0x7fa0e0106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51478/0 (socket says 172.21.15.26:51478) 2021-11-03T16:57:54.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.595+0000 7fa0df7fe700 1 -- 172.21.15.26:0/1235741715 learned_addr learned my addr 172.21.15.26:0/1235741715 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:57:54.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.595+0000 7fa0deffd700 1 --2- 172.21.15.26:0/1235741715 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0e00f5ef0 0x7fa0e0107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:57:54.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.595+0000 7fa0df7fe700 1 -- 172.21.15.26:0/1235741715 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0e00f5ef0 msgr2=0x7fa0e0107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:57:54.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.595+0000 7fa0df7fe700 1 --2- 172.21.15.26:0/1235741715 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0e00f5ef0 0x7fa0e0107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:54.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.595+0000 7fa0df7fe700 1 -- 172.21.15.26:0/1235741715 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d0005040 con 0x7fa0e00f55e0 2021-11-03T16:57:54.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.595+0000 7fa0df7fe700 1 --2- 172.21.15.26:0/1235741715 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0e00f55e0 0x7fa0e0106f70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fa0d0009830 tx=0x7fa0d0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:57:54.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.595+0000 7fa0c7fff700 1 -- 172.21.15.26:0/1235741715 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0d0018070 con 0x7fa0e00f55e0 2021-11-03T16:57:54.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.595+0000 7fa0e5f9f700 1 -- 172.21.15.26:0/1235741715 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0e0108490 con 0x7fa0e00f55e0 2021-11-03T16:57:54.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.595+0000 7fa0c7fff700 1 -- 172.21.15.26:0/1235741715 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa0d0007ba0 con 0x7fa0e00f55e0 2021-11-03T16:57:54.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.595+0000 7fa0c7fff700 1 -- 172.21.15.26:0/1235741715 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0d001c3c0 con 0x7fa0e00f55e0 2021-11-03T16:57:54.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.595+0000 7fa0e5f9f700 1 -- 172.21.15.26:0/1235741715 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0e01089f0 con 0x7fa0e00f55e0 2021-11-03T16:57:54.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.597+0000 7fa0c7fff700 1 -- 172.21.15.26:0/1235741715 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fa0d0007d10 con 0x7fa0e00f55e0 2021-11-03T16:57:54.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.597+0000 7fa0e5f9f700 1 -- 172.21.15.26:0/1235741715 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0e0045ad0 con 0x7fa0e00f55e0 2021-11-03T16:57:54.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.597+0000 7fa0c7fff700 1 --2- 172.21.15.26:0/1235741715 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa0c8064090 0x7fa0c8066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:57:54.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.597+0000 7fa0c7fff700 1 -- 172.21.15.26:0/1235741715 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fa0d0082360 con 0x7fa0e00f55e0 2021-11-03T16:57:54.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.597+0000 7fa0deffd700 1 --2- 172.21.15.26:0/1235741715 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa0c8064090 0x7fa0c8066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:57:54.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.598+0000 7fa0deffd700 1 --2- 172.21.15.26:0/1235741715 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa0c8064090 0x7fa0c8066550 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fa0d4004c40 tx=0x7fa0d400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:57:54.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.603+0000 7fa0c7fff700 1 -- 172.21.15.26:0/1235741715 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fa0d0054780 con 0x7fa0e00f55e0 2021-11-03T16:57:54.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.838+0000 7fa0e5f9f700 1 -- 172.21.15.26:0/1235741715 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa0e010d590 con 0x7fa0e00f55e0 2021-11-03T16:57:54.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.838+0000 7fa0c7fff700 1 -- 172.21.15.26:0/1235741715 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+804 (secure 0 0 0) 0x7fa0d0054370 con 0x7fa0e00f55e0 2021-11-03T16:57:54.836 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T16:57:54.836 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T16:57:54.836 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T16:57:54.836 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:57:54.837 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T16:57:54.837 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T16:57:54.837 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:57:54.837 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T16:57:54.838 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 3, 2021-11-03T16:57:54.838 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T16:57:54.838 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:57:54.838 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T16:57:54.839 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T16:57:54.839 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:57:54.839 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T16:57:54.839 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2021-11-03T16:57:54.840 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T16:57:54.840 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T16:57:54.840 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T16:57:54.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.840+0000 7fa0e5f9f700 1 -- 172.21.15.26:0/1235741715 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa0c8064090 msgr2=0x7fa0c8066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:57:54.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.840+0000 7fa0e5f9f700 1 --2- 172.21.15.26:0/1235741715 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa0c8064090 0x7fa0c8066550 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fa0d4004c40 tx=0x7fa0d400b040).stop 2021-11-03T16:57:54.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.840+0000 7fa0e5f9f700 1 -- 172.21.15.26:0/1235741715 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0e00f55e0 msgr2=0x7fa0e0106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:57:54.842 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.840+0000 7fa0e5f9f700 1 --2- 172.21.15.26:0/1235741715 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0e00f55e0 0x7fa0e0106f70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fa0d0009830 tx=0x7fa0d0009b30).stop 2021-11-03T16:57:54.842 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.840+0000 7fa0e5f9f700 1 -- 172.21.15.26:0/1235741715 shutdown_connections 2021-11-03T16:57:54.842 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.840+0000 7fa0e5f9f700 1 --2- 172.21.15.26:0/1235741715 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa0c8064090 0x7fa0c8066550 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:54.842 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.840+0000 7fa0e5f9f700 1 --2- 172.21.15.26:0/1235741715 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0e00f55e0 0x7fa0e0106f70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:54.843 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.840+0000 7fa0e5f9f700 1 --2- 172.21.15.26:0/1235741715 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0e00f5ef0 0x7fa0e0107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:54.843 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.840+0000 7fa0e5f9f700 1 -- 172.21.15.26:0/1235741715 >> 172.21.15.26:0/1235741715 conn(0x7fa0e00f0de0 msgr2=0x7fa0e005f740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:57:54.843 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.840+0000 7fa0e5f9f700 1 -- 172.21.15.26:0/1235741715 shutdown_connections 2021-11-03T16:57:54.843 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.840+0000 7fa0e5f9f700 1 -- 172.21.15.26:0/1235741715 wait complete. 2021-11-03T16:57:54.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.944+0000 7f31f8ece700 1 -- 172.21.15.26:0/965228909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31f40f77d0 msgr2=0x7f31f40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:57:54.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.944+0000 7f31f8ece700 1 --2- 172.21.15.26:0/965228909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31f40f77d0 0x7f31f40f7c30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f31dc004660 tx=0x7f31dc009b30).stop 2021-11-03T16:57:54.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.944+0000 7f31f8ece700 1 -- 172.21.15.26:0/965228909 shutdown_connections 2021-11-03T16:57:54.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.944+0000 7f31f8ece700 1 --2- 172.21.15.26:0/965228909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31f40f77d0 0x7f31f40f7c30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:54.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.944+0000 7f31f8ece700 1 --2- 172.21.15.26:0/965228909 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31f40f6530 0x7f31f40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:54.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.944+0000 7f31f8ece700 1 -- 172.21.15.26:0/965228909 >> 172.21.15.26:0/965228909 conn(0x7f31f40f1c90 msgr2=0x7f31f40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:57:54.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.944+0000 7f31f8ece700 1 -- 172.21.15.26:0/965228909 shutdown_connections 2021-11-03T16:57:54.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.944+0000 7f31f8ece700 1 -- 172.21.15.26:0/965228909 wait complete. 2021-11-03T16:57:54.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.944+0000 7f31f8ece700 1 Processor -- start 2021-11-03T16:57:54.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.944+0000 7f31f8ece700 1 -- start start 2021-11-03T16:57:54.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.945+0000 7f31f8ece700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31f40f6530 0x7f31f4106d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:57:54.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.945+0000 7f31f8ece700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31f40f77d0 0x7f31f4107230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:57:54.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.945+0000 7f31f8ece700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f4107830 con 0x7f31f40f77d0 2021-11-03T16:57:54.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.945+0000 7f31f8ece700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f4108040 con 0x7f31f40f6530 2021-11-03T16:57:54.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.945+0000 7f31f2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31f40f77d0 0x7f31f4107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:57:54.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.945+0000 7f31f2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31f40f77d0 0x7f31f4107230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51490/0 (socket says 172.21.15.26:51490) 2021-11-03T16:57:54.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.945+0000 7f31f2ffd700 1 -- 172.21.15.26:0/1985150052 learned_addr learned my addr 172.21.15.26:0/1985150052 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:57:54.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.945+0000 7f31f37fe700 1 --2- 172.21.15.26:0/1985150052 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31f40f6530 0x7f31f4106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:57:54.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.945+0000 7f31f2ffd700 1 -- 172.21.15.26:0/1985150052 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31f40f6530 msgr2=0x7f31f4106d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:57:54.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.945+0000 7f31f2ffd700 1 --2- 172.21.15.26:0/1985150052 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31f40f6530 0x7f31f4106d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:54.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.945+0000 7f31f2ffd700 1 -- 172.21.15.26:0/1985150052 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31dc005040 con 0x7f31f40f77d0 2021-11-03T16:57:54.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.945+0000 7f31f2ffd700 1 --2- 172.21.15.26:0/1985150052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31f40f77d0 0x7f31f4107230 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f31dc002040 tx=0x7f31dc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:57:54.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.945+0000 7f31ebfff700 1 -- 172.21.15.26:0/1985150052 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31dc019070 con 0x7f31f40f77d0 2021-11-03T16:57:54.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.945+0000 7f31f8ece700 1 -- 172.21.15.26:0/1985150052 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31f4108260 con 0x7f31f40f77d0 2021-11-03T16:57:54.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.945+0000 7f31ebfff700 1 -- 172.21.15.26:0/1985150052 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f31dc007e70 con 0x7f31f40f77d0 2021-11-03T16:57:54.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.945+0000 7f31f8ece700 1 -- 172.21.15.26:0/1985150052 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f41087c0 con 0x7f31f40f77d0 2021-11-03T16:57:54.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.945+0000 7f31ebfff700 1 -- 172.21.15.26:0/1985150052 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31dc014db0 con 0x7f31f40f77d0 2021-11-03T16:57:54.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.947+0000 7f31f8ece700 1 -- 172.21.15.26:0/1985150052 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31f4059100 con 0x7f31f40f77d0 2021-11-03T16:57:54.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.947+0000 7f31ebfff700 1 -- 172.21.15.26:0/1985150052 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f31dc025070 con 0x7f31f40f77d0 2021-11-03T16:57:54.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.947+0000 7f31ebfff700 1 --2- 172.21.15.26:0/1985150052 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f31e00640a0 0x7f31e0066560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:57:54.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.947+0000 7f31ebfff700 1 -- 172.21.15.26:0/1985150052 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f31dc081750 con 0x7f31f40f77d0 2021-11-03T16:57:54.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.947+0000 7f31f37fe700 1 --2- 172.21.15.26:0/1985150052 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f31e00640a0 0x7f31e0066560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:57:54.950 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.948+0000 7f31f37fe700 1 --2- 172.21.15.26:0/1985150052 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f31e00640a0 0x7f31e0066560 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f31f4106ab0 tx=0x7f31e400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:57:54.950 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:54.951+0000 7f31ebfff700 1 -- 172.21.15.26:0/1985150052 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f31dc053a50 con 0x7f31f40f77d0 2021-11-03T16:57:55.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:55.170+0000 7f31f8ece700 1 -- 172.21.15.26:0/1985150052 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f31f40fee80 con 0x7f31f40f77d0 2021-11-03T16:57:55.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:55.171+0000 7f31ebfff700 1 -- 172.21.15.26:0/1985150052 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f31f40fee80 con 0x7f31f40f77d0 2021-11-03T16:57:55.167 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T16:57:55.168 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T16:57:55.168 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T16:57:55.168 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T16:57:55.168 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:57:55.169 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T16:57:55.169 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T16:57:55.169 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T16:57:55.169 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T16:57:55.170 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T16:57:55.170 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T16:57:55.170 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T16:57:55.170 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T16:57:55.171 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T16:57:55.171 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T16:57:55.171 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T16:57:55.171 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T16:57:55.171 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T16:57:55.172 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T16:57:55.172 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T16:57:55.172 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T16:57:55.172 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T16:57:55.172 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T16:57:55.173 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T16:57:55.173 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T16:57:55.173 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T16:57:55.173 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T16:57:55.174 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T16:57:55.174 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T16:57:55.174 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T16:57:55.174 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T16:57:55.175 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:57:55.175 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:57:55.175 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T16:57:55.175 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:57:55.176 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T16:57:55.176 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T16:57:55.176 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T16:57:55.176 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T16:57:55.177 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:55.173+0000 7f31f8ece700 1 -- 172.21.15.26:0/1985150052 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f31e00640a0 msgr2=0x7f31e0066560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:57:55.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:55.173+0000 7f31f8ece700 1 --2- 172.21.15.26:0/1985150052 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f31e00640a0 0x7f31e0066560 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f31f4106ab0 tx=0x7f31e400b040).stop 2021-11-03T16:57:55.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:55.173+0000 7f31f8ece700 1 -- 172.21.15.26:0/1985150052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31f40f77d0 msgr2=0x7f31f4107230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:57:55.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:55.173+0000 7f31f8ece700 1 --2- 172.21.15.26:0/1985150052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31f40f77d0 0x7f31f4107230 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f31dc002040 tx=0x7f31dc00b040).stop 2021-11-03T16:57:55.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:55.173+0000 7f31f8ece700 1 -- 172.21.15.26:0/1985150052 shutdown_connections 2021-11-03T16:57:55.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:55.173+0000 7f31f8ece700 1 --2- 172.21.15.26:0/1985150052 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f31e00640a0 0x7f31e0066560 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:55.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:55.173+0000 7f31f8ece700 1 --2- 172.21.15.26:0/1985150052 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31f40f6530 0x7f31f4106d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:55.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:55.173+0000 7f31f8ece700 1 --2- 172.21.15.26:0/1985150052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31f40f77d0 0x7f31f4107230 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:57:55.180 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:55.173+0000 7f31f8ece700 1 -- 172.21.15.26:0/1985150052 >> 172.21.15.26:0/1985150052 conn(0x7f31f40f1c90 msgr2=0x7f31f40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:57:55.180 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:55.174+0000 7f31f8ece700 1 -- 172.21.15.26:0/1985150052 shutdown_connections 2021-11-03T16:57:55.180 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:57:55.174+0000 7f31f8ece700 1 -- 172.21.15.26:0/1985150052 wait complete. 2021-11-03T16:57:55.180 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T16:57:55.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:55 smithi026 ceph-mon[96795]: Health check failed: 1 osds down (OSD_DOWN) 2021-11-03T16:57:55.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:55 smithi026 ceph-mon[96795]: from='client.34214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:57:55.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:55 smithi026 ceph-mon[96795]: osdmap e63: 6 total, 5 up, 6 in 2021-11-03T16:57:55.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:55 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1235741715' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:57:55.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:55 smithi026 ceph-mon[96795]: osdmap e64: 6 total, 5 up, 6 in 2021-11-03T16:57:55.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:55 smithi194 ceph-mon[65619]: Health check failed: 1 osds down (OSD_DOWN) 2021-11-03T16:57:55.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:55 smithi194 ceph-mon[65619]: from='client.34214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:57:55.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:55 smithi194 ceph-mon[65619]: osdmap e63: 6 total, 5 up, 6 in 2021-11-03T16:57:55.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:55 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1235741715' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:57:55.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:55 smithi194 ceph-mon[65619]: osdmap e64: 6 total, 5 up, 6 in 2021-11-03T16:57:55.913 INFO:journalctl@ceph.osd.2.smithi026.stdout:Nov 03 16:57:55 smithi026 systemd[1]: ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c@osd.2.service: Succeeded. 2021-11-03T16:57:55.913 INFO:journalctl@ceph.osd.2.smithi026.stdout:Nov 03 16:57:55 smithi026 systemd[1]: Stopped Ceph osd.2 for 70492bc6-3cc5-11ec-8c28-001a4aab830c. 2021-11-03T16:57:56.165 INFO:journalctl@ceph.osd.2.smithi026.stdout:Nov 03 16:57:55 smithi026 systemd[1]: Starting Ceph osd.2 for 70492bc6-3cc5-11ec-8c28-001a4aab830c... 2021-11-03T16:57:56.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:56 smithi026 ceph-mon[96795]: pgmap v78: 65 pgs: 9 stale+active+clean, 56 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:57:56.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:56 smithi026 ceph-mon[96795]: from='client.34218 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:57:56.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:56 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1985150052' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T16:57:56.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:56 smithi194 ceph-mon[65619]: pgmap v78: 65 pgs: 9 stale+active+clean, 56 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:57:56.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:56 smithi194 ceph-mon[65619]: from='client.34218 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:57:56.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:56 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1985150052' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T16:57:57.172 INFO:journalctl@ceph.osd.2.smithi026.stdout:Nov 03 16:57:56 smithi026 bash[113003]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-11-03T16:57:57.172 INFO:journalctl@ceph.osd.2.smithi026.stdout:Nov 03 16:57:56 smithi026 bash[113003]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --dev /dev/mapper/vg_nvme-lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2021-11-03T16:57:57.172 INFO:journalctl@ceph.osd.2.smithi026.stdout:Nov 03 16:57:56 smithi026 bash[113003]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2021-11-03T16:57:57.173 INFO:journalctl@ceph.osd.2.smithi026.stdout:Nov 03 16:57:56 smithi026 bash[113003]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2021-11-03T16:57:57.173 INFO:journalctl@ceph.osd.2.smithi026.stdout:Nov 03 16:57:56 smithi026 bash[113003]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2021-11-03T16:57:57.173 INFO:journalctl@ceph.osd.2.smithi026.stdout:Nov 03 16:57:56 smithi026 bash[113003]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-11-03T16:57:57.174 INFO:journalctl@ceph.osd.2.smithi026.stdout:Nov 03 16:57:56 smithi026 bash[113003]: --> ceph-volume raw activate successful for osd ID: 2 2021-11-03T16:57:58.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:58 smithi026 ceph-mon[96795]: pgmap v80: 65 pgs: 9 stale+active+clean, 56 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:57:58.422 INFO:journalctl@ceph.osd.2.smithi026.stdout:Nov 03 16:57:58 smithi026 ceph-osd[113537]: -- 172.21.15.26:0/601221966 <== mon.0 v2:172.21.15.26:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5585f18e2340 con 0x5585f18a9000 2021-11-03T16:57:58.423 INFO:journalctl@ceph.osd.2.smithi026.stdout:Nov 03 16:57:58 smithi026 bash[113003]: 7a89d0afe62003a321bef9395bf5f629da46dab93947c37e3acbde46c51c0fce 2021-11-03T16:57:58.423 INFO:journalctl@ceph.osd.2.smithi026.stdout:Nov 03 16:57:58 smithi026 systemd[1]: Started Ceph osd.2 for 70492bc6-3cc5-11ec-8c28-001a4aab830c. 2021-11-03T16:57:58.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:58 smithi194 ceph-mon[65619]: pgmap v80: 65 pgs: 9 stale+active+clean, 56 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:57:59.172 INFO:journalctl@ceph.osd.2.smithi026.stdout:Nov 03 16:57:58 smithi026 conmon[113514]: 2021-11-03T16:57:58.778+0000 7fa6d75830c0 -1 Falling back to public interface 2021-11-03T16:57:59.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:59 smithi026 ceph-mon[96795]: pgmap v81: 65 pgs: 8 active+undersized+degraded, 6 stale+active+clean, 51 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 2757/65073 objects degraded (4.237%) 2021-11-03T16:57:59.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:59 smithi026 ceph-mon[96795]: poll took 7899.218 ms: 1 events 2021-11-03T16:57:59.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:59 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:57:59.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:59 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:57:59.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:57:59 smithi026 ceph-mon[96795]: Health check failed: Degraded data redundancy: 2757/65073 objects degraded (4.237%), 8 pgs degraded (PG_DEGRADED) 2021-11-03T16:57:59.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:59 smithi194 ceph-mon[65619]: pgmap v81: 65 pgs: 8 active+undersized+degraded, 6 stale+active+clean, 51 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 2757/65073 objects degraded (4.237%) 2021-11-03T16:57:59.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:59 smithi194 ceph-mon[65619]: poll took 7899.218 ms: 1 events 2021-11-03T16:57:59.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:59 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:57:59.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:59 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:57:59.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:57:59 smithi194 ceph-mon[65619]: Health check failed: Degraded data redundancy: 2757/65073 objects degraded (4.237%), 8 pgs degraded (PG_DEGRADED) 2021-11-03T16:58:01.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:01 smithi026 ceph-mon[96795]: pgmap v82: 65 pgs: 23 active+undersized+degraded, 4 active+undersized, 38 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 9484/65073 objects degraded (14.574%) 2021-11-03T16:58:01.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:01 smithi194 ceph-mon[65619]: pgmap v82: 65 pgs: 23 active+undersized+degraded, 4 active+undersized, 38 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 9484/65073 objects degraded (14.574%) 2021-11-03T16:58:03.672 INFO:journalctl@ceph.osd.2.smithi026.stdout:Nov 03 16:58:03 smithi026 conmon[113514]: 2021-11-03T16:58:03.372+0000 7fa6d75830c0 -1 osd.2 62 log_to_monitors {default=true} 2021-11-03T16:58:04.172 INFO:journalctl@ceph.osd.2.smithi026.stdout:Nov 03 16:58:04 smithi026 conmon[113514]: 2021-11-03T16:58:04.032+0000 7fa6c6ebf700 -1 osd.2 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-03T16:58:04.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:04 smithi026 ceph-mon[96795]: pgmap v83: 65 pgs: 23 active+undersized+degraded, 4 active+undersized, 38 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 9484/65073 objects degraded (14.574%) 2021-11-03T16:58:04.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:04 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:58:04.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:04 smithi026 ceph-mon[96795]: from='osd.2 [v2:172.21.15.26:6818/3858017470,v1:172.21.15.26:6819/3858017470]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-11-03T16:58:04.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:04 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:58:04.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:04 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:58:04.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:04 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:58:04.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:04 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:58:04.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:04 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:58:04.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:04 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:58:04.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:04 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-11-03T16:58:04.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:04 smithi194 ceph-mon[65619]: pgmap v83: 65 pgs: 23 active+undersized+degraded, 4 active+undersized, 38 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 9484/65073 objects degraded (14.574%) 2021-11-03T16:58:04.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:04 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:58:04.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:04 smithi194 ceph-mon[65619]: from='osd.2 [v2:172.21.15.26:6818/3858017470,v1:172.21.15.26:6819/3858017470]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-11-03T16:58:04.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:04 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:58:04.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:04 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:58:04.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:04 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:58:04.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:04 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:58:04.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:04 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:58:04.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:04 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:58:04.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:04 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-11-03T16:58:05.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:05 smithi026 ceph-mon[96795]: poll took 4772.839 ms: 1 events 2021-11-03T16:58:05.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:05 smithi026 ceph-mon[96795]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-11-03T16:58:05.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:05 smithi026 ceph-mon[96795]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2021-11-03T16:58:05.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:05 smithi026 ceph-mon[96795]: from='osd.2 [v2:172.21.15.26:6818/3858017470,v1:172.21.15.26:6819/3858017470]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-11-03T16:58:05.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:05 smithi026 ceph-mon[96795]: osdmap e65: 6 total, 5 up, 6 in 2021-11-03T16:58:05.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:05 smithi026 ceph-mon[96795]: from='osd.2 [v2:172.21.15.26:6818/3858017470,v1:172.21.15.26:6819/3858017470]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2021-11-03T16:58:05.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:05 smithi194 ceph-mon[65619]: poll took 4772.839 ms: 1 events 2021-11-03T16:58:05.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:05 smithi194 ceph-mon[65619]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-11-03T16:58:05.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:05 smithi194 ceph-mon[65619]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2021-11-03T16:58:05.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:05 smithi194 ceph-mon[65619]: from='osd.2 [v2:172.21.15.26:6818/3858017470,v1:172.21.15.26:6819/3858017470]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-11-03T16:58:05.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:05 smithi194 ceph-mon[65619]: osdmap e65: 6 total, 5 up, 6 in 2021-11-03T16:58:05.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:05 smithi194 ceph-mon[65619]: from='osd.2 [v2:172.21.15.26:6818/3858017470,v1:172.21.15.26:6819/3858017470]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2021-11-03T16:58:06.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:06 smithi026 ceph-mon[96795]: pgmap v85: 65 pgs: 23 active+undersized+degraded, 4 active+undersized, 38 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 9484/65073 objects degraded (14.574%) 2021-11-03T16:58:06.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:06 smithi026 ceph-mon[96795]: Health check cleared: OSD_DOWN (was: 1 osds down) 2021-11-03T16:58:06.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:06 smithi026 ceph-mon[96795]: osd.2 [v2:172.21.15.26:6818/3858017470,v1:172.21.15.26:6819/3858017470] boot 2021-11-03T16:58:06.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:06 smithi026 ceph-mon[96795]: osdmap e66: 6 total, 6 up, 6 in 2021-11-03T16:58:06.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:06 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-11-03T16:58:06.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:06 smithi194 ceph-mon[65619]: pgmap v85: 65 pgs: 23 active+undersized+degraded, 4 active+undersized, 38 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 9484/65073 objects degraded (14.574%) 2021-11-03T16:58:06.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:06 smithi194 ceph-mon[65619]: Health check cleared: OSD_DOWN (was: 1 osds down) 2021-11-03T16:58:06.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:06 smithi194 ceph-mon[65619]: osd.2 [v2:172.21.15.26:6818/3858017470,v1:172.21.15.26:6819/3858017470] boot 2021-11-03T16:58:06.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:06 smithi194 ceph-mon[65619]: osdmap e66: 6 total, 6 up, 6 in 2021-11-03T16:58:06.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:06 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-11-03T16:58:07.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:07 smithi026 ceph-mon[96795]: osdmap e67: 6 total, 6 up, 6 in 2021-11-03T16:58:07.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:07 smithi194 ceph-mon[65619]: osdmap e67: 6 total, 6 up, 6 in 2021-11-03T16:58:08.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:08 smithi026 ceph-mon[96795]: pgmap v88: 65 pgs: 23 active+undersized+degraded, 4 active+undersized, 38 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 9484/65073 objects degraded (14.574%) 2021-11-03T16:58:08.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:08 smithi194 ceph-mon[65619]: pgmap v88: 65 pgs: 23 active+undersized+degraded, 4 active+undersized, 38 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 9484/65073 objects degraded (14.574%) 2021-11-03T16:58:09.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:09 smithi026 ceph-mon[96795]: Health check update: Degraded data redundancy: 9484/65073 objects degraded (14.574%), 23 pgs degraded (PG_DEGRADED) 2021-11-03T16:58:09.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:09 smithi194 ceph-mon[65619]: Health check update: Degraded data redundancy: 9484/65073 objects degraded (14.574%), 23 pgs degraded (PG_DEGRADED) 2021-11-03T16:58:10.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:10 smithi026 ceph-mon[96795]: pgmap v89: 65 pgs: 18 active+undersized+degraded, 4 active+undersized, 43 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 7434/65073 objects degraded (11.424%) 2021-11-03T16:58:10.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:10 smithi194 ceph-mon[65619]: pgmap v89: 65 pgs: 18 active+undersized+degraded, 4 active+undersized, 43 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 7434/65073 objects degraded (11.424%) 2021-11-03T16:58:11.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:11 smithi026 ceph-mon[96795]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7434/65073 objects degraded (11.424%), 18 pgs degraded) 2021-11-03T16:58:11.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:11 smithi194 ceph-mon[65619]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7434/65073 objects degraded (11.424%), 18 pgs degraded) 2021-11-03T16:58:12.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:12 smithi026 ceph-mon[96795]: pgmap v90: 65 pgs: 9 active+clean+wait, 56 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:58:12.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:12 smithi194 ceph-mon[65619]: pgmap v90: 65 pgs: 9 active+clean+wait, 56 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:58:14.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:14 smithi026 ceph-mon[96795]: pgmap v91: 65 pgs: 9 active+clean+wait, 56 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:58:14.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:14 smithi194 ceph-mon[65619]: pgmap v91: 65 pgs: 9 active+clean+wait, 56 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:58:16.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:16 smithi026 ceph-mon[96795]: pgmap v92: 65 pgs: 9 active+clean+wait, 56 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:58:16.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:16 smithi194 ceph-mon[65619]: pgmap v92: 65 pgs: 9 active+clean+wait, 56 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:58:18.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:18 smithi026 ceph-mon[96795]: pgmap v93: 65 pgs: 9 active+clean+wait, 56 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:58:18.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:18 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:58:18.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:18 smithi194 ceph-mon[65619]: pgmap v93: 65 pgs: 9 active+clean+wait, 56 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:58:18.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:18 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:58:19.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:19 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:58:19.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:19 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-11-03T16:58:19.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:19 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:58:19.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:19 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-11-03T16:58:20.403 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:20 smithi194 ceph-mon[65619]: pgmap v94: 65 pgs: 9 active+clean+wait, 56 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:58:20.403 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:20 smithi194 ceph-mon[65619]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-11-03T16:58:20.403 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:20 smithi194 ceph-mon[65619]: Upgrade: osd.3 is safe to restart 2021-11-03T16:58:20.404 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:20 smithi194 ceph-mon[65619]: poll took 15017.762 ms: 1 events 2021-11-03T16:58:20.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:20 smithi026 ceph-mon[96795]: pgmap v94: 65 pgs: 9 active+clean+wait, 56 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:58:20.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:20 smithi026 ceph-mon[96795]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-11-03T16:58:20.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:20 smithi026 ceph-mon[96795]: Upgrade: osd.3 is safe to restart 2021-11-03T16:58:20.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:20 smithi026 ceph-mon[96795]: poll took 15017.762 ms: 1 events 2021-11-03T16:58:21.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:21 smithi194 ceph-mon[65619]: pgmap v95: 65 pgs: 9 active+clean+wait, 56 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:58:21.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:21 smithi194 ceph-mon[65619]: poll took 1539.441 ms: 1 events 2021-11-03T16:58:21.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:21 smithi194 ceph-mon[65619]: Upgrade: Updating osd.3 2021-11-03T16:58:21.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:21 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:58:21.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:21 smithi194 ceph-mon[65619]: Deploying daemon osd.3 on smithi194 2021-11-03T16:58:21.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:21 smithi026 ceph-mon[96795]: pgmap v95: 65 pgs: 9 active+clean+wait, 56 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:58:21.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:21 smithi026 ceph-mon[96795]: poll took 1539.441 ms: 1 events 2021-11-03T16:58:21.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:21 smithi026 ceph-mon[96795]: Upgrade: Updating osd.3 2021-11-03T16:58:21.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:21 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:58:21.928 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:21 smithi026 ceph-mon[96795]: Deploying daemon osd.3 on smithi194 2021-11-03T16:58:23.247 INFO:journalctl@ceph.osd.3.smithi194.stdout:Nov 03 16:58:22 smithi194 systemd[1]: Stopping Ceph osd.3 for 70492bc6-3cc5-11ec-8c28-001a4aab830c... 2021-11-03T16:58:23.248 INFO:journalctl@ceph.osd.3.smithi194.stdout:Nov 03 16:58:23 smithi194 conmon[41435]: debug 2021-11-03T16:58:23.055+0000 7feef969b700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2021-11-03T16:58:23.248 INFO:journalctl@ceph.osd.3.smithi194.stdout:Nov 03 16:58:23 smithi194 conmon[41435]: debug 2021-11-03T16:58:23.055+0000 7feef969b700 -1 osd.3 67 *** Got signal Terminated *** 2021-11-03T16:58:23.248 INFO:journalctl@ceph.osd.3.smithi194.stdout:Nov 03 16:58:23 smithi194 conmon[41435]: debug 2021-11-03T16:58:23.055+0000 7feef969b700 -1 osd.3 67 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-11-03T16:58:23.743 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:23 smithi194 ceph-mon[65619]: pgmap v96: 65 pgs: 9 active+clean+wait, 56 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:58:23.744 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:23 smithi194 ceph-mon[65619]: osd.3 reported immediately failed by osd.4 2021-11-03T16:58:23.744 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:23 smithi194 ceph-mon[65619]: osd.3 failed (root=default,host=smithi194) (connection refused reported by osd.4) 2021-11-03T16:58:23.744 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:23 smithi194 ceph-mon[65619]: osd.3 reported immediately failed by osd.5 2021-11-03T16:58:23.744 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:23 smithi194 ceph-mon[65619]: osd.3 reported immediately failed by osd.1 2021-11-03T16:58:23.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:23 smithi194 ceph-mon[65619]: osd.3 reported immediately failed by osd.2 2021-11-03T16:58:23.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:23 smithi194 ceph-mon[65619]: osd.3 reported immediately failed by osd.0 2021-11-03T16:58:23.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:23 smithi194 ceph-mon[65619]: osd.3 reported immediately failed by osd.4 2021-11-03T16:58:23.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:23 smithi194 ceph-mon[65619]: osd.3 reported immediately failed by osd.5 2021-11-03T16:58:23.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:23 smithi194 ceph-mon[65619]: osd.3 reported immediately failed by osd.1 2021-11-03T16:58:23.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:23 smithi194 ceph-mon[65619]: osd.3 reported immediately failed by osd.2 2021-11-03T16:58:23.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:23 smithi194 ceph-mon[65619]: osd.3 reported immediately failed by osd.0 2021-11-03T16:58:23.746 INFO:journalctl@ceph.osd.3.smithi194.stdout:Nov 03 16:58:23 smithi194 bash[71029]: ff6d474a5f9abdbeb7e7c6c6540e2e430cacd48d404901d7c26a429de775bd84 2021-11-03T16:58:23.747 INFO:journalctl@ceph.osd.3.smithi194.stdout:Nov 03 16:58:23 smithi194 bash[71029]: Error: no container with name or ID ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c-osd-3 found: no such container 2021-11-03T16:58:23.747 INFO:journalctl@ceph.osd.3.smithi194.stdout:Nov 03 16:58:23 smithi194 bash[71029]: Error: container ff6d474a5f9abdbeb7e7c6c6540e2e430cacd48d404901d7c26a429de775bd84 does not exist in database: no such container 2021-11-03T16:58:23.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:23 smithi026 ceph-mon[96795]: pgmap v96: 65 pgs: 9 active+clean+wait, 56 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:58:23.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:23 smithi026 ceph-mon[96795]: osd.3 reported immediately failed by osd.4 2021-11-03T16:58:23.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:23 smithi026 ceph-mon[96795]: osd.3 failed (root=default,host=smithi194) (connection refused reported by osd.4) 2021-11-03T16:58:23.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:23 smithi026 ceph-mon[96795]: osd.3 reported immediately failed by osd.5 2021-11-03T16:58:23.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:23 smithi026 ceph-mon[96795]: osd.3 reported immediately failed by osd.1 2021-11-03T16:58:23.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:23 smithi026 ceph-mon[96795]: osd.3 reported immediately failed by osd.2 2021-11-03T16:58:23.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:23 smithi026 ceph-mon[96795]: osd.3 reported immediately failed by osd.0 2021-11-03T16:58:23.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:23 smithi026 ceph-mon[96795]: osd.3 reported immediately failed by osd.4 2021-11-03T16:58:23.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:23 smithi026 ceph-mon[96795]: osd.3 reported immediately failed by osd.5 2021-11-03T16:58:23.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:23 smithi026 ceph-mon[96795]: osd.3 reported immediately failed by osd.1 2021-11-03T16:58:23.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:23 smithi026 ceph-mon[96795]: osd.3 reported immediately failed by osd.2 2021-11-03T16:58:23.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:23 smithi026 ceph-mon[96795]: osd.3 reported immediately failed by osd.0 2021-11-03T16:58:24.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:24 smithi194 ceph-mon[65619]: Health check failed: 1 osds down (OSD_DOWN) 2021-11-03T16:58:24.754 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:24 smithi194 ceph-mon[65619]: osdmap e68: 6 total, 5 up, 6 in 2021-11-03T16:58:24.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:24 smithi026 ceph-mon[96795]: Health check failed: 1 osds down (OSD_DOWN) 2021-11-03T16:58:24.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:24 smithi026 ceph-mon[96795]: osdmap e68: 6 total, 5 up, 6 in 2021-11-03T16:58:25.291 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.290+0000 7ffbdd970700 1 -- 172.21.15.26:0/421991397 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbd80f8610 msgr2=0x7ffbd80f4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:58:25.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.290+0000 7ffbdd970700 1 --2- 172.21.15.26:0/421991397 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbd80f8610 0x7ffbd80f4820 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7ffbcc004660 tx=0x7ffbcc009b30).stop 2021-11-03T16:58:25.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.290+0000 7ffbdd970700 1 -- 172.21.15.26:0/421991397 shutdown_connections 2021-11-03T16:58:25.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.290+0000 7ffbdd970700 1 --2- 172.21.15.26:0/421991397 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbd80f8610 0x7ffbd80f4820 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:25.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.290+0000 7ffbdd970700 1 --2- 172.21.15.26:0/421991397 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffbd80f7d00 0x7ffbd80f8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:25.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.290+0000 7ffbdd970700 1 -- 172.21.15.26:0/421991397 >> 172.21.15.26:0/421991397 conn(0x7ffbd80f0540 msgr2=0x7ffbd80f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:58:25.294 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.290+0000 7ffbdd970700 1 -- 172.21.15.26:0/421991397 shutdown_connections 2021-11-03T16:58:25.294 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.290+0000 7ffbdd970700 1 -- 172.21.15.26:0/421991397 wait complete. 2021-11-03T16:58:25.295 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.291+0000 7ffbdd970700 1 Processor -- start 2021-11-03T16:58:25.295 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.291+0000 7ffbdd970700 1 -- start start 2021-11-03T16:58:25.296 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.291+0000 7ffbdd970700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffbd80f7d00 0x7ffbd8106ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:58:25.296 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.291+0000 7ffbdd970700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbd80f8610 0x7ffbd81073b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:58:25.296 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.291+0000 7ffbdd970700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd8107960 con 0x7ffbd80f8610 2021-11-03T16:58:25.297 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.291+0000 7ffbdd970700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd8107aa0 con 0x7ffbd80f7d00 2021-11-03T16:58:25.297 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.292+0000 7ffbd67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbd80f8610 0x7ffbd81073b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:58:25.298 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.292+0000 7ffbd6ffd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffbd80f7d00 0x7ffbd8106ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:58:25.298 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.292+0000 7ffbd67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbd80f8610 0x7ffbd81073b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51596/0 (socket says 172.21.15.26:51596) 2021-11-03T16:58:25.299 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.292+0000 7ffbd67fc700 1 -- 172.21.15.26:0/4257400376 learned_addr learned my addr 172.21.15.26:0/4257400376 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:58:25.299 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.292+0000 7ffbd67fc700 1 -- 172.21.15.26:0/4257400376 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffbd80f7d00 msgr2=0x7ffbd8106ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:58:25.299 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.292+0000 7ffbd67fc700 1 --2- 172.21.15.26:0/4257400376 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffbd80f7d00 0x7ffbd8106ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:25.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.292+0000 7ffbd67fc700 1 -- 172.21.15.26:0/4257400376 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbcc005040 con 0x7ffbd80f8610 2021-11-03T16:58:25.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.292+0000 7ffbd6ffd700 1 --2- 172.21.15.26:0/4257400376 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffbd80f7d00 0x7ffbd8106ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-03T16:58:25.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.292+0000 7ffbd67fc700 1 --2- 172.21.15.26:0/4257400376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbd80f8610 0x7ffbd81073b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7ffbcc000c00 tx=0x7ffbcc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:58:25.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.292+0000 7ffbbf7fe700 1 -- 172.21.15.26:0/4257400376 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbcc019070 con 0x7ffbd80f8610 2021-11-03T16:58:25.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.292+0000 7ffbbf7fe700 1 -- 172.21.15.26:0/4257400376 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ffbcc007e70 con 0x7ffbd80f8610 2021-11-03T16:58:25.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.292+0000 7ffbdd970700 1 -- 172.21.15.26:0/4257400376 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbd81083e0 con 0x7ffbd80f8610 2021-11-03T16:58:25.303 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.292+0000 7ffbbf7fe700 1 -- 172.21.15.26:0/4257400376 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbcc014ce0 con 0x7ffbd80f8610 2021-11-03T16:58:25.303 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.292+0000 7ffbdd970700 1 -- 172.21.15.26:0/4257400376 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd8108940 con 0x7ffbd80f8610 2021-11-03T16:58:25.303 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.293+0000 7ffbdd970700 1 -- 172.21.15.26:0/4257400376 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbd8045ad0 con 0x7ffbd80f8610 2021-11-03T16:58:25.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.294+0000 7ffbbf7fe700 1 -- 172.21.15.26:0/4257400376 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ffbcc025070 con 0x7ffbd80f8610 2021-11-03T16:58:25.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.294+0000 7ffbbf7fe700 1 --2- 172.21.15.26:0/4257400376 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffbc00640b0 0x7ffbc0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:58:25.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.294+0000 7ffbbf7fe700 1 -- 172.21.15.26:0/4257400376 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ffbcc081750 con 0x7ffbd80f8610 2021-11-03T16:58:25.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.294+0000 7ffbd6ffd700 1 --2- 172.21.15.26:0/4257400376 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffbc00640b0 0x7ffbc0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:58:25.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.295+0000 7ffbd6ffd700 1 --2- 172.21.15.26:0/4257400376 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffbc00640b0 0x7ffbc0066570 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7ffbc8009fd0 tx=0x7ffbc800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:58:25.307 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.298+0000 7ffbbf7fe700 1 -- 172.21.15.26:0/4257400376 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ffbcc053ab0 con 0x7ffbd80f8610 2021-11-03T16:58:25.433 INFO:journalctl@ceph.osd.3.smithi194.stdout:Nov 03 16:58:25 smithi194 systemd[1]: ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c@osd.3.service: Succeeded. 2021-11-03T16:58:25.434 INFO:journalctl@ceph.osd.3.smithi194.stdout:Nov 03 16:58:25 smithi194 systemd[1]: Stopped Ceph osd.3 for 70492bc6-3cc5-11ec-8c28-001a4aab830c. 2021-11-03T16:58:25.434 INFO:journalctl@ceph.osd.3.smithi194.stdout:Nov 03 16:58:25 smithi194 systemd[1]: Starting Ceph osd.3 for 70492bc6-3cc5-11ec-8c28-001a4aab830c... 2021-11-03T16:58:25.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.479+0000 7ffbdd970700 1 -- 172.21.15.26:0/4257400376 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffbd8108b60 con 0x7ffbc00640b0 2021-11-03T16:58:25.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.481+0000 7ffbbf7fe700 1 -- 172.21.15.26:0/4257400376 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+320 (secure 0 0 0) 0x7ffbd8108b60 con 0x7ffbc00640b0 2021-11-03T16:58:25.478 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.483+0000 7ffbdd970700 1 -- 172.21.15.26:0/4257400376 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffbc00640b0 msgr2=0x7ffbc0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:58:25.478 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.483+0000 7ffbdd970700 1 --2- 172.21.15.26:0/4257400376 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffbc00640b0 0x7ffbc0066570 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7ffbc8009fd0 tx=0x7ffbc800b040).stop 2021-11-03T16:58:25.478 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.483+0000 7ffbdd970700 1 -- 172.21.15.26:0/4257400376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbd80f8610 msgr2=0x7ffbd81073b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:58:25.478 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.483+0000 7ffbdd970700 1 --2- 172.21.15.26:0/4257400376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbd80f8610 0x7ffbd81073b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7ffbcc000c00 tx=0x7ffbcc00b040).stop 2021-11-03T16:58:25.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.483+0000 7ffbdd970700 1 -- 172.21.15.26:0/4257400376 shutdown_connections 2021-11-03T16:58:25.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.483+0000 7ffbdd970700 1 --2- 172.21.15.26:0/4257400376 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffbc00640b0 0x7ffbc0066570 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:25.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.483+0000 7ffbdd970700 1 --2- 172.21.15.26:0/4257400376 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffbd80f7d00 0x7ffbd8106ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:25.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.483+0000 7ffbdd970700 1 --2- 172.21.15.26:0/4257400376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbd80f8610 0x7ffbd81073b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:25.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.483+0000 7ffbdd970700 1 -- 172.21.15.26:0/4257400376 >> 172.21.15.26:0/4257400376 conn(0x7ffbd80f0540 msgr2=0x7ffbd80fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:58:25.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.483+0000 7ffbdd970700 1 -- 172.21.15.26:0/4257400376 shutdown_connections 2021-11-03T16:58:25.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.483+0000 7ffbdd970700 1 -- 172.21.15.26:0/4257400376 wait complete. 2021-11-03T16:58:25.488 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T16:58:25.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.583+0000 7f4ab0ba4700 1 -- 172.21.15.26:0/2829450520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aac0f66e0 msgr2=0x7f4aac0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:58:25.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.583+0000 7f4ab0ba4700 1 --2- 172.21.15.26:0/2829450520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aac0f66e0 0x7f4aac0f6b00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f4a9c004660 tx=0x7f4a9c009b30).stop 2021-11-03T16:58:25.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.583+0000 7f4ab0ba4700 1 -- 172.21.15.26:0/2829450520 shutdown_connections 2021-11-03T16:58:25.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.583+0000 7f4ab0ba4700 1 --2- 172.21.15.26:0/2829450520 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aac0f7980 0x7f4aac0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:25.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.583+0000 7f4ab0ba4700 1 --2- 172.21.15.26:0/2829450520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aac0f66e0 0x7f4aac0f6b00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:25.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.583+0000 7f4ab0ba4700 1 -- 172.21.15.26:0/2829450520 >> 172.21.15.26:0/2829450520 conn(0x7f4aac0f1e40 msgr2=0x7f4aac0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:58:25.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.583+0000 7f4ab0ba4700 1 -- 172.21.15.26:0/2829450520 shutdown_connections 2021-11-03T16:58:25.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.583+0000 7f4ab0ba4700 1 -- 172.21.15.26:0/2829450520 wait complete. 2021-11-03T16:58:25.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.584+0000 7f4ab0ba4700 1 Processor -- start 2021-11-03T16:58:25.584 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.584+0000 7f4ab0ba4700 1 -- start start 2021-11-03T16:58:25.584 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.584+0000 7f4ab0ba4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aac0f66e0 0x7f4aac106f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:58:25.585 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.584+0000 7f4ab0ba4700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aac0f7980 0x7f4aac107430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:58:25.586 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.584+0000 7f4ab0ba4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aac1079e0 con 0x7f4aac0f66e0 2021-11-03T16:58:25.586 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.584+0000 7f4ab0ba4700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aac107b20 con 0x7f4aac0f7980 2021-11-03T16:58:25.587 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.584+0000 7f4aaa59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aac0f66e0 0x7f4aac106f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:58:25.587 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.584+0000 7f4aaa59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aac0f66e0 0x7f4aac106f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51604/0 (socket says 172.21.15.26:51604) 2021-11-03T16:58:25.587 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.584+0000 7f4aaa59c700 1 -- 172.21.15.26:0/474657872 learned_addr learned my addr 172.21.15.26:0/474657872 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:58:25.588 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.584+0000 7f4aa9d9b700 1 --2- 172.21.15.26:0/474657872 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aac0f7980 0x7f4aac107430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:58:25.588 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.584+0000 7f4aaa59c700 1 -- 172.21.15.26:0/474657872 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aac0f7980 msgr2=0x7f4aac107430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:58:25.589 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.584+0000 7f4aaa59c700 1 --2- 172.21.15.26:0/474657872 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aac0f7980 0x7f4aac107430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:25.589 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.584+0000 7f4aaa59c700 1 -- 172.21.15.26:0/474657872 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a9c005040 con 0x7f4aac0f66e0 2021-11-03T16:58:25.590 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.585+0000 7f4aa9d9b700 1 --2- 172.21.15.26:0/474657872 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aac0f7980 0x7f4aac107430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T16:58:25.590 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.585+0000 7f4aaa59c700 1 --2- 172.21.15.26:0/474657872 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aac0f66e0 0x7f4aac106f40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f4a9c013a70 tx=0x7f4a9c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:58:25.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.585+0000 7f4a9affd700 1 -- 172.21.15.26:0/474657872 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a9c018070 con 0x7f4aac0f66e0 2021-11-03T16:58:25.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.585+0000 7f4a9affd700 1 -- 172.21.15.26:0/474657872 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4a9c0097d0 con 0x7f4aac0f66e0 2021-11-03T16:58:25.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.585+0000 7f4ab0ba4700 1 -- 172.21.15.26:0/474657872 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aac108460 con 0x7f4aac0f66e0 2021-11-03T16:58:25.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.585+0000 7f4a9affd700 1 -- 172.21.15.26:0/474657872 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a9c01c3c0 con 0x7f4aac0f66e0 2021-11-03T16:58:25.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.585+0000 7f4ab0ba4700 1 -- 172.21.15.26:0/474657872 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aac1089c0 con 0x7f4aac0f66e0 2021-11-03T16:58:25.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.586+0000 7f4ab0ba4700 1 -- 172.21.15.26:0/474657872 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aac045ad0 con 0x7f4aac0f66e0 2021-11-03T16:58:25.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.586+0000 7f4a9affd700 1 -- 172.21.15.26:0/474657872 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f4a9c007ba0 con 0x7f4aac0f66e0 2021-11-03T16:58:25.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.587+0000 7f4a9affd700 1 --2- 172.21.15.26:0/474657872 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4a940640b0 0x7f4a94066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:58:25.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.587+0000 7f4a9affd700 1 -- 172.21.15.26:0/474657872 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f4a9c0823a0 con 0x7f4aac0f66e0 2021-11-03T16:58:25.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.587+0000 7f4aa9d9b700 1 --2- 172.21.15.26:0/474657872 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4a940640b0 0x7f4a94066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:58:25.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.587+0000 7f4aa9d9b700 1 --2- 172.21.15.26:0/474657872 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4a940640b0 0x7f4a94066570 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f4aa0009740 tx=0x7f4aa0009be0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:58:25.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.591+0000 7f4a9affd700 1 -- 172.21.15.26:0/474657872 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f4a9c0547c0 con 0x7f4aac0f66e0 2021-11-03T16:58:25.724 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:25 smithi194 ceph-mon[65619]: pgmap v98: 65 pgs: 3 stale+active+clean, 31 peering, 31 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:58:25.724 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:25 smithi194 ceph-mon[65619]: osdmap e69: 6 total, 5 up, 6 in 2021-11-03T16:58:25.725 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:25 smithi194 ceph-mon[65619]: Health check failed: Reduced data availability: 1 pg inactive, 13 pgs peering (PG_AVAILABILITY) 2021-11-03T16:58:25.758 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.763+0000 7f4ab0ba4700 1 -- 172.21.15.26:0/474657872 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4aac0ff020 con 0x7f4a940640b0 2021-11-03T16:58:25.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.777+0000 7f4a9affd700 1 -- 172.21.15.26:0/474657872 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f4aac0ff020 con 0x7f4a940640b0 2021-11-03T16:58:25.773 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T16:58:25.773 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (9m) 22s ago 10m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T16:58:25.774 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (112s) 22s ago 10m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T16:58:25.774 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (102s) 99s ago 10m 7000k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T16:58:25.774 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (9m) 22s ago 10m 38.9M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T16:58:25.774 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (2m) 22s ago 6m 13.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T16:58:25.775 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (2m) 22s ago 5m 14.7M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T16:58:25.775 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (6m) 99s ago 6m 15.3M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T16:58:25.775 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (6m) 99s ago 5m 15.7M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T16:58:25.776 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (3m) 22s ago 12m 468M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T16:58:25.776 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (2m) 99s ago 10m 410M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T16:58:25.776 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (2m) 22s ago 12m 75.8M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T16:58:25.776 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (2m) 99s ago 10m 61.4M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T16:58:25.776 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (10m) 22s ago 10m 18.1M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T16:58:25.777 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (9m) 99s ago 9m 18.3M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T16:58:25.777 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (89s) 22s ago 9m 153M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T16:58:25.777 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (58s) 22s ago 8m 166M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T16:58:25.777 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (27s) 22s ago 8m 11.2M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T16:58:25.778 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (8m) 99s ago 8m 495M 4096M 16.2.4 8d91d370c2b8 ff6d474a5f9a 2021-11-03T16:58:25.778 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (7m) 99s ago 7m 424M 4096M 16.2.4 8d91d370c2b8 e2fc9c0bdf0f 2021-11-03T16:58:25.778 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (7m) 99s ago 7m 471M 4096M 16.2.4 8d91d370c2b8 0abc64d8a2bf 2021-11-03T16:58:25.778 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (9m) 22s ago 10m 47.5M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T16:58:25.779 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.779+0000 7f4ab0ba4700 1 -- 172.21.15.26:0/474657872 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4a940640b0 msgr2=0x7f4a94066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:58:25.780 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.779+0000 7f4ab0ba4700 1 --2- 172.21.15.26:0/474657872 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4a940640b0 0x7f4a94066570 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f4aa0009740 tx=0x7f4aa0009be0).stop 2021-11-03T16:58:25.780 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.779+0000 7f4ab0ba4700 1 -- 172.21.15.26:0/474657872 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aac0f66e0 msgr2=0x7f4aac106f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:58:25.780 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.779+0000 7f4ab0ba4700 1 --2- 172.21.15.26:0/474657872 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aac0f66e0 0x7f4aac106f40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f4a9c013a70 tx=0x7f4a9c009b30).stop 2021-11-03T16:58:25.780 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.780+0000 7f4ab0ba4700 1 -- 172.21.15.26:0/474657872 shutdown_connections 2021-11-03T16:58:25.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.780+0000 7f4ab0ba4700 1 --2- 172.21.15.26:0/474657872 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4a940640b0 0x7f4a94066570 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:25.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.780+0000 7f4ab0ba4700 1 --2- 172.21.15.26:0/474657872 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aac0f66e0 0x7f4aac106f40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:25.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.780+0000 7f4ab0ba4700 1 --2- 172.21.15.26:0/474657872 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aac0f7980 0x7f4aac107430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:25.782 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.780+0000 7f4ab0ba4700 1 -- 172.21.15.26:0/474657872 >> 172.21.15.26:0/474657872 conn(0x7f4aac0f1e40 msgr2=0x7f4aac0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:58:25.782 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.780+0000 7f4ab0ba4700 1 -- 172.21.15.26:0/474657872 shutdown_connections 2021-11-03T16:58:25.782 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.780+0000 7f4ab0ba4700 1 -- 172.21.15.26:0/474657872 wait complete. 2021-11-03T16:58:25.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.879+0000 7f6c75451700 1 -- 172.21.15.26:0/1946660064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c700f5460 msgr2=0x7f6c700f5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:58:25.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.879+0000 7f6c75451700 1 --2- 172.21.15.26:0/1946660064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c700f5460 0x7f6c700f5880 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f6c60004660 tx=0x7f6c60009b30).stop 2021-11-03T16:58:25.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.879+0000 7f6c75451700 1 -- 172.21.15.26:0/1946660064 shutdown_connections 2021-11-03T16:58:25.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.879+0000 7f6c75451700 1 --2- 172.21.15.26:0/1946660064 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c700f6700 0x7f6c700f6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:25.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.879+0000 7f6c75451700 1 --2- 172.21.15.26:0/1946660064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c700f5460 0x7f6c700f5880 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:25.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.879+0000 7f6c75451700 1 -- 172.21.15.26:0/1946660064 >> 172.21.15.26:0/1946660064 conn(0x7f6c700f0bc0 msgr2=0x7f6c700f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:58:25.879 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.880+0000 7f6c75451700 1 -- 172.21.15.26:0/1946660064 shutdown_connections 2021-11-03T16:58:25.879 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.880+0000 7f6c75451700 1 -- 172.21.15.26:0/1946660064 wait complete. 2021-11-03T16:58:25.879 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.880+0000 7f6c75451700 1 Processor -- start 2021-11-03T16:58:25.879 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.880+0000 7f6c75451700 1 -- start start 2021-11-03T16:58:25.879 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.880+0000 7f6c75451700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c700f5460 0x7f6c70109a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:58:25.880 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.880+0000 7f6c75451700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c700f6700 0x7f6c7010bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:58:25.880 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.880+0000 7f6c75451700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c700603e0 con 0x7f6c700f5460 2021-11-03T16:58:25.880 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.880+0000 7f6c75451700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c70060520 con 0x7f6c700f6700 2021-11-03T16:58:25.880 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.881+0000 7f6c6effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c700f5460 0x7f6c70109a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:58:25.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.881+0000 7f6c6effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c700f5460 0x7f6c70109a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51614/0 (socket says 172.21.15.26:51614) 2021-11-03T16:58:25.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.881+0000 7f6c6effd700 1 -- 172.21.15.26:0/2751513055 learned_addr learned my addr 172.21.15.26:0/2751513055 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:58:25.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.881+0000 7f6c6e7fc700 1 --2- 172.21.15.26:0/2751513055 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c700f6700 0x7f6c7010bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:58:25.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.881+0000 7f6c6effd700 1 -- 172.21.15.26:0/2751513055 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c700f6700 msgr2=0x7f6c7010bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:58:25.882 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.881+0000 7f6c6effd700 1 --2- 172.21.15.26:0/2751513055 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c700f6700 0x7f6c7010bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:25.882 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.881+0000 7f6c6effd700 1 -- 172.21.15.26:0/2751513055 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c60005040 con 0x7f6c700f5460 2021-11-03T16:58:25.882 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.881+0000 7f6c6effd700 1 --2- 172.21.15.26:0/2751513055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c700f5460 0x7f6c70109a50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f6c60014040 tx=0x7f6c6000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:58:25.882 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.881+0000 7f6c577fe700 1 -- 172.21.15.26:0/2751513055 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c60019070 con 0x7f6c700f5460 2021-11-03T16:58:25.882 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.881+0000 7f6c577fe700 1 -- 172.21.15.26:0/2751513055 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6c60007e70 con 0x7f6c700f5460 2021-11-03T16:58:25.883 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.881+0000 7f6c75451700 1 -- 172.21.15.26:0/2751513055 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c7010c4a0 con 0x7f6c700f5460 2021-11-03T16:58:25.883 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.881+0000 7f6c577fe700 1 -- 172.21.15.26:0/2751513055 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c60014d10 con 0x7f6c700f5460 2021-11-03T16:58:25.883 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.882+0000 7f6c75451700 1 -- 172.21.15.26:0/2751513055 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c7010ca00 con 0x7f6c700f5460 2021-11-03T16:58:25.884 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.883+0000 7f6c577fe700 1 -- 172.21.15.26:0/2751513055 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f6c60014420 con 0x7f6c700f5460 2021-11-03T16:58:25.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.883+0000 7f6c75451700 1 -- 172.21.15.26:0/2751513055 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c70045ad0 con 0x7f6c700f5460 2021-11-03T16:58:25.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.883+0000 7f6c577fe700 1 --2- 172.21.15.26:0/2751513055 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6c58064100 0x7f6c580665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:58:25.886 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.883+0000 7f6c577fe700 1 -- 172.21.15.26:0/2751513055 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f6c60081680 con 0x7f6c700f5460 2021-11-03T16:58:25.886 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.883+0000 7f6c6e7fc700 1 --2- 172.21.15.26:0/2751513055 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6c58064100 0x7f6c580665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:58:25.886 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.883+0000 7f6c6e7fc700 1 --2- 172.21.15.26:0/2751513055 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6c58064100 0x7f6c580665c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f6c64009fd0 tx=0x7f6c6400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:58:25.886 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:25.887+0000 7f6c577fe700 1 -- 172.21.15.26:0/2751513055 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f6c60053aa0 con 0x7f6c700f5460 2021-11-03T16:58:25.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:25 smithi026 ceph-mon[96795]: pgmap v98: 65 pgs: 3 stale+active+clean, 31 peering, 31 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:58:25.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:25 smithi026 ceph-mon[96795]: osdmap e69: 6 total, 5 up, 6 in 2021-11-03T16:58:25.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:25 smithi026 ceph-mon[96795]: Health check failed: Reduced data availability: 1 pg inactive, 13 pgs peering (PG_AVAILABILITY) 2021-11-03T16:58:26.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.115+0000 7f6c75451700 1 -- 172.21.15.26:0/2751513055 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6c700fdd60 con 0x7f6c700f5460 2021-11-03T16:58:26.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.115+0000 7f6c577fe700 1 -- 172.21.15.26:0/2751513055 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+804 (secure 0 0 0) 0x7f6c60023340 con 0x7f6c700f5460 2021-11-03T16:58:26.112 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T16:58:26.112 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T16:58:26.113 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T16:58:26.119 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:58:26.120 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T16:58:26.120 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T16:58:26.121 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:58:26.121 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T16:58:26.121 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2, 2021-11-03T16:58:26.121 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 3 2021-11-03T16:58:26.122 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:58:26.122 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T16:58:26.122 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T16:58:26.122 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:58:26.123 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T16:58:26.123 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6, 2021-11-03T16:58:26.123 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 7 2021-11-03T16:58:26.123 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T16:58:26.123 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T16:58:26.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.117+0000 7f6c75451700 1 -- 172.21.15.26:0/2751513055 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6c58064100 msgr2=0x7f6c580665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:58:26.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.117+0000 7f6c75451700 1 --2- 172.21.15.26:0/2751513055 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6c58064100 0x7f6c580665c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f6c64009fd0 tx=0x7f6c6400b040).stop 2021-11-03T16:58:26.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.117+0000 7f6c75451700 1 -- 172.21.15.26:0/2751513055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c700f5460 msgr2=0x7f6c70109a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:58:26.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.117+0000 7f6c75451700 1 --2- 172.21.15.26:0/2751513055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c700f5460 0x7f6c70109a50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f6c60014040 tx=0x7f6c6000b040).stop 2021-11-03T16:58:26.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.117+0000 7f6c75451700 1 -- 172.21.15.26:0/2751513055 shutdown_connections 2021-11-03T16:58:26.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.117+0000 7f6c75451700 1 --2- 172.21.15.26:0/2751513055 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6c58064100 0x7f6c580665c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:26.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.117+0000 7f6c75451700 1 --2- 172.21.15.26:0/2751513055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c700f5460 0x7f6c70109a50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:26.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.117+0000 7f6c75451700 1 --2- 172.21.15.26:0/2751513055 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c700f6700 0x7f6c7010bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:26.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.117+0000 7f6c75451700 1 -- 172.21.15.26:0/2751513055 >> 172.21.15.26:0/2751513055 conn(0x7f6c700f0bc0 msgr2=0x7f6c700fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:58:26.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.117+0000 7f6c75451700 1 -- 172.21.15.26:0/2751513055 shutdown_connections 2021-11-03T16:58:26.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.117+0000 7f6c75451700 1 -- 172.21.15.26:0/2751513055 wait complete. 2021-11-03T16:58:26.214 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.217+0000 7f95131b1700 1 -- 172.21.15.26:0/631393787 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f950c0f5440 msgr2=0x7f950c0f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:58:26.214 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.217+0000 7f95131b1700 1 --2- 172.21.15.26:0/631393787 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f950c0f5440 0x7f950c0f5860 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f94fc004660 tx=0x7f94fc009b30).stop 2021-11-03T16:58:26.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.217+0000 7f95131b1700 1 -- 172.21.15.26:0/631393787 shutdown_connections 2021-11-03T16:58:26.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.217+0000 7f95131b1700 1 --2- 172.21.15.26:0/631393787 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f950c0f66e0 0x7f950c0f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:26.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.217+0000 7f95131b1700 1 --2- 172.21.15.26:0/631393787 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f950c0f5440 0x7f950c0f5860 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:26.216 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.217+0000 7f95131b1700 1 -- 172.21.15.26:0/631393787 >> 172.21.15.26:0/631393787 conn(0x7f950c0f0ba0 msgr2=0x7f950c0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:58:26.216 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.217+0000 7f95131b1700 1 -- 172.21.15.26:0/631393787 shutdown_connections 2021-11-03T16:58:26.216 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.217+0000 7f95131b1700 1 -- 172.21.15.26:0/631393787 wait complete. 2021-11-03T16:58:26.216 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.218+0000 7f95131b1700 1 Processor -- start 2021-11-03T16:58:26.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.218+0000 7f95131b1700 1 -- start start 2021-11-03T16:58:26.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.218+0000 7f95131b1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f950c0f5440 0x7f950c106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:58:26.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.218+0000 7f95131b1700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f950c0f66e0 0x7f950c107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:58:26.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.218+0000 7f95131b1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950c107870 con 0x7f950c0f5440 2021-11-03T16:58:26.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.218+0000 7f95131b1700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950c1080b0 con 0x7f950c0f66e0 2021-11-03T16:58:26.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.218+0000 7f95121af700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f950c0f5440 0x7f950c106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:58:26.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.218+0000 7f95121af700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f950c0f5440 0x7f950c106d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51628/0 (socket says 172.21.15.26:51628) 2021-11-03T16:58:26.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.218+0000 7f95121af700 1 -- 172.21.15.26:0/2367540292 learned_addr learned my addr 172.21.15.26:0/2367540292 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:58:26.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.218+0000 7f95119ae700 1 --2- 172.21.15.26:0/2367540292 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f950c0f66e0 0x7f950c107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:58:26.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.219+0000 7f95121af700 1 -- 172.21.15.26:0/2367540292 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f950c0f66e0 msgr2=0x7f950c107270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:58:26.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.219+0000 7f95121af700 1 --2- 172.21.15.26:0/2367540292 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f950c0f66e0 0x7f950c107270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:26.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.219+0000 7f95121af700 1 -- 172.21.15.26:0/2367540292 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94fc005040 con 0x7f950c0f5440 2021-11-03T16:58:26.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.219+0000 7f95121af700 1 --2- 172.21.15.26:0/2367540292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f950c0f5440 0x7f950c106d80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f94fc014040 tx=0x7f94fc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:58:26.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.219+0000 7f9502ffd700 1 -- 172.21.15.26:0/2367540292 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94fc019070 con 0x7f950c0f5440 2021-11-03T16:58:26.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.219+0000 7f95131b1700 1 -- 172.21.15.26:0/2367540292 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f950c108330 con 0x7f950c0f5440 2021-11-03T16:58:26.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.219+0000 7f9502ffd700 1 -- 172.21.15.26:0/2367540292 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f94fc007e70 con 0x7f950c0f5440 2021-11-03T16:58:26.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.219+0000 7f95131b1700 1 -- 172.21.15.26:0/2367540292 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f950c108810 con 0x7f950c0f5440 2021-11-03T16:58:26.221 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.219+0000 7f9502ffd700 1 -- 172.21.15.26:0/2367540292 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94fc014d10 con 0x7f950c0f5440 2021-11-03T16:58:26.222 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.220+0000 7f95131b1700 1 -- 172.21.15.26:0/2367540292 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f950c059100 con 0x7f950c0f5440 2021-11-03T16:58:26.222 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.220+0000 7f9502ffd700 1 -- 172.21.15.26:0/2367540292 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f94fc025070 con 0x7f950c0f5440 2021-11-03T16:58:26.223 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.221+0000 7f9502ffd700 1 --2- 172.21.15.26:0/2367540292 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f94f8064100 0x7f94f80665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:58:26.223 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.221+0000 7f9502ffd700 1 -- 172.21.15.26:0/2367540292 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f94fc0817b0 con 0x7f950c0f5440 2021-11-03T16:58:26.223 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.221+0000 7f95119ae700 1 --2- 172.21.15.26:0/2367540292 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f94f8064100 0x7f94f80665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:58:26.223 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.221+0000 7f95119ae700 1 --2- 172.21.15.26:0/2367540292 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f94f8064100 0x7f94f80665c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f950c106b10 tx=0x7f950800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:58:26.224 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.225+0000 7f9502ffd700 1 -- 172.21.15.26:0/2367540292 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f94fc053b10 con 0x7f950c0f5440 2021-11-03T16:58:26.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.433+0000 7f95131b1700 1 -- 172.21.15.26:0/2367540292 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f950c10d2f0 con 0x7f950c0f5440 2021-11-03T16:58:26.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.434+0000 7f9502ffd700 1 -- 172.21.15.26:0/2367540292 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f94fc023070 con 0x7f950c0f5440 2021-11-03T16:58:26.430 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T16:58:26.430 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T16:58:26.430 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T16:58:26.431 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T16:58:26.431 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:58:26.431 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T16:58:26.432 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T16:58:26.432 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T16:58:26.432 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T16:58:26.432 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T16:58:26.433 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T16:58:26.433 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T16:58:26.433 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T16:58:26.433 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T16:58:26.433 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T16:58:26.434 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T16:58:26.434 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T16:58:26.434 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T16:58:26.434 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T16:58:26.435 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T16:58:26.435 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T16:58:26.435 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T16:58:26.435 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T16:58:26.436 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T16:58:26.436 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T16:58:26.436 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T16:58:26.437 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T16:58:26.437 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T16:58:26.437 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T16:58:26.437 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T16:58:26.437 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T16:58:26.438 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:58:26.438 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:58:26.438 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T16:58:26.438 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:58:26.439 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T16:58:26.439 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T16:58:26.439 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T16:58:26.439 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T16:58:26.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.436+0000 7f95131b1700 1 -- 172.21.15.26:0/2367540292 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f94f8064100 msgr2=0x7f94f80665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:58:26.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.436+0000 7f95131b1700 1 --2- 172.21.15.26:0/2367540292 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f94f8064100 0x7f94f80665c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f950c106b10 tx=0x7f950800b040).stop 2021-11-03T16:58:26.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.436+0000 7f95131b1700 1 -- 172.21.15.26:0/2367540292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f950c0f5440 msgr2=0x7f950c106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:58:26.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.436+0000 7f95131b1700 1 --2- 172.21.15.26:0/2367540292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f950c0f5440 0x7f950c106d80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f94fc014040 tx=0x7f94fc00b040).stop 2021-11-03T16:58:26.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.436+0000 7f95131b1700 1 -- 172.21.15.26:0/2367540292 shutdown_connections 2021-11-03T16:58:26.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.436+0000 7f95131b1700 1 --2- 172.21.15.26:0/2367540292 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f94f8064100 0x7f94f80665c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:26.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.436+0000 7f95131b1700 1 --2- 172.21.15.26:0/2367540292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f950c0f5440 0x7f950c106d80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:26.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.436+0000 7f95131b1700 1 --2- 172.21.15.26:0/2367540292 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f950c0f66e0 0x7f950c107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:26.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.436+0000 7f95131b1700 1 -- 172.21.15.26:0/2367540292 >> 172.21.15.26:0/2367540292 conn(0x7f950c0f0ba0 msgr2=0x7f950c05f620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:58:26.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.436+0000 7f95131b1700 1 -- 172.21.15.26:0/2367540292 shutdown_connections 2021-11-03T16:58:26.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:26.436+0000 7f95131b1700 1 -- 172.21.15.26:0/2367540292 wait complete. 2021-11-03T16:58:26.443 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T16:58:26.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:26 smithi194 ceph-mon[65619]: from='client.34234 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:58:26.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:26 smithi194 ceph-mon[65619]: from='client.34238 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:58:26.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:26 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2751513055' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:58:26.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:26 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2367540292' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T16:58:26.499 INFO:journalctl@ceph.osd.3.smithi194.stdout:Nov 03 16:58:26 smithi194 bash[71508]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-11-03T16:58:26.499 INFO:journalctl@ceph.osd.3.smithi194.stdout:Nov 03 16:58:26 smithi194 bash[71508]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --dev /dev/mapper/vg_nvme-lv_4 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2021-11-03T16:58:26.499 INFO:journalctl@ceph.osd.3.smithi194.stdout:Nov 03 16:58:26 smithi194 bash[71508]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2021-11-03T16:58:26.500 INFO:journalctl@ceph.osd.3.smithi194.stdout:Nov 03 16:58:26 smithi194 bash[71508]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2021-11-03T16:58:26.500 INFO:journalctl@ceph.osd.3.smithi194.stdout:Nov 03 16:58:26 smithi194 bash[71508]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2021-11-03T16:58:26.500 INFO:journalctl@ceph.osd.3.smithi194.stdout:Nov 03 16:58:26 smithi194 bash[71508]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-11-03T16:58:26.500 INFO:journalctl@ceph.osd.3.smithi194.stdout:Nov 03 16:58:26 smithi194 bash[71508]: --> ceph-volume raw activate successful for osd ID: 3 2021-11-03T16:58:26.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:26 smithi026 ceph-mon[96795]: from='client.34234 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:58:26.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:26 smithi026 ceph-mon[96795]: from='client.34238 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:58:26.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:26 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2751513055' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:58:26.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:26 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2367540292' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T16:58:27.439 INFO:journalctl@ceph.osd.3.smithi194.stdout:Nov 03 16:58:27 smithi194 ceph-osd[72028]: -- 172.21.15.194:0/4146204577 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562f34b8c340 con 0x562f34b52c00 2021-11-03T16:58:27.440 INFO:journalctl@ceph.osd.3.smithi194.stdout:Nov 03 16:58:27 smithi194 bash[71508]: 76d9dbfc8845fc155409a7bf1c7db0ca7482a162d6fa718bcba599ddd3c2f5d7 2021-11-03T16:58:27.440 INFO:journalctl@ceph.osd.3.smithi194.stdout:Nov 03 16:58:27 smithi194 systemd[1]: Started Ceph osd.3 for 70492bc6-3cc5-11ec-8c28-001a4aab830c. 2021-11-03T16:58:27.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:27 smithi194 ceph-mon[65619]: pgmap v100: 65 pgs: 3 stale+active+clean, 31 peering, 31 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:58:27.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:27 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:58:27.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:27 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:58:27.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:27 smithi026 ceph-mon[96795]: pgmap v100: 65 pgs: 3 stale+active+clean, 31 peering, 31 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:58:27.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:27 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:58:27.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:27 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:58:28.247 INFO:journalctl@ceph.osd.3.smithi194.stdout:Nov 03 16:58:27 smithi194 conmon[72005]: 2021-11-03T16:58:27.779+0000 7f12f81f40c0 -1 Falling back to public interface 2021-11-03T16:58:28.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:28 smithi026 ceph-mon[96795]: poll took 6608.898 ms: 1 events 2021-11-03T16:58:28.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:58:28.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:28 smithi194 ceph-mon[65619]: poll took 6608.898 ms: 1 events 2021-11-03T16:58:28.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:58:29.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:29 smithi026 ceph-mon[96795]: pgmap v101: 65 pgs: 6 active+undersized+degraded, 31 peering, 1 active+undersized, 27 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 2627/65073 objects degraded (4.037%) 2021-11-03T16:58:29.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:29 smithi026 ceph-mon[96795]: Health check failed: Degraded data redundancy: 2627/65073 objects degraded (4.037%), 6 pgs degraded (PG_DEGRADED) 2021-11-03T16:58:29.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:29 smithi194 ceph-mon[65619]: pgmap v101: 65 pgs: 6 active+undersized+degraded, 31 peering, 1 active+undersized, 27 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 2627/65073 objects degraded (4.037%) 2021-11-03T16:58:29.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:29 smithi194 ceph-mon[65619]: Health check failed: Degraded data redundancy: 2627/65073 objects degraded (4.037%), 6 pgs degraded (PG_DEGRADED) 2021-11-03T16:58:31.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:31 smithi026 ceph-mon[96795]: pgmap v102: 65 pgs: 33 active+undersized+degraded, 5 active+undersized, 27 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 12143/65073 objects degraded (18.661%) 2021-11-03T16:58:31.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:31 smithi026 ceph-mon[96795]: poll took 2940.428 ms: 1 events 2021-11-03T16:58:31.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:31 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:58:31.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:31 smithi026 ceph-mon[96795]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 13 pgs peering) 2021-11-03T16:58:31.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:31 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:58:31.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:31 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:58:31.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:31 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:58:31.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:31 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:58:31.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:31 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:58:31.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:31 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-11-03T16:58:31.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:31 smithi026 ceph-mon[96795]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-11-03T16:58:31.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:31 smithi026 ceph-mon[96795]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2021-11-03T16:58:31.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:31 smithi194 ceph-mon[65619]: pgmap v102: 65 pgs: 33 active+undersized+degraded, 5 active+undersized, 27 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 12143/65073 objects degraded (18.661%) 2021-11-03T16:58:31.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:31 smithi194 ceph-mon[65619]: poll took 2940.428 ms: 1 events 2021-11-03T16:58:31.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:31 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:58:31.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:31 smithi194 ceph-mon[65619]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 13 pgs peering) 2021-11-03T16:58:31.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:31 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:58:31.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:31 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:58:31.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:31 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:58:31.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:31 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:58:31.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:31 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:58:31.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:31 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-11-03T16:58:31.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:31 smithi194 ceph-mon[65619]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-11-03T16:58:32.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:31 smithi194 ceph-mon[65619]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2021-11-03T16:58:33.471 INFO:journalctl@ceph.osd.3.smithi194.stdout:Nov 03 16:58:33 smithi194 conmon[72005]: 2021-11-03T16:58:33.033+0000 7f12f81f40c0 -1 osd.3 67 log_to_monitors {default=true} 2021-11-03T16:58:34.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:34 smithi026 ceph-mon[96795]: pgmap v103: 65 pgs: 33 active+undersized+degraded, 5 active+undersized, 27 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 12143/65073 objects degraded (18.661%) 2021-11-03T16:58:34.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:34 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:58:34.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:34 smithi026 ceph-mon[96795]: from='osd.3 [v2:172.21.15.194:6800/3773074066,v1:172.21.15.194:6801/3773074066]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-11-03T16:58:34.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:34 smithi026 ceph-mon[96795]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-11-03T16:58:34.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:34 smithi026 ceph-mon[96795]: Health check update: Degraded data redundancy: 12143/65073 objects degraded (18.661%), 33 pgs degraded (PG_DEGRADED) 2021-11-03T16:58:34.497 INFO:journalctl@ceph.osd.3.smithi194.stdout:Nov 03 16:58:34 smithi194 conmon[72005]: 2021-11-03T16:58:34.046+0000 7f12e7b30700 -1 osd.3 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-03T16:58:34.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:34 smithi194 ceph-mon[65619]: pgmap v103: 65 pgs: 33 active+undersized+degraded, 5 active+undersized, 27 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 12143/65073 objects degraded (18.661%) 2021-11-03T16:58:34.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:34 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:58:34.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:34 smithi194 ceph-mon[65619]: from='osd.3 [v2:172.21.15.194:6800/3773074066,v1:172.21.15.194:6801/3773074066]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-11-03T16:58:34.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:34 smithi194 ceph-mon[65619]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-11-03T16:58:34.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:34 smithi194 ceph-mon[65619]: Health check update: Degraded data redundancy: 12143/65073 objects degraded (18.661%), 33 pgs degraded (PG_DEGRADED) 2021-11-03T16:58:35.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:35 smithi026 ceph-mon[96795]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-11-03T16:58:35.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:35 smithi026 ceph-mon[96795]: osdmap e70: 6 total, 5 up, 6 in 2021-11-03T16:58:35.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:35 smithi026 ceph-mon[96795]: from='osd.3 [v2:172.21.15.194:6800/3773074066,v1:172.21.15.194:6801/3773074066]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2021-11-03T16:58:35.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:35 smithi026 ceph-mon[96795]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2021-11-03T16:58:35.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:35 smithi194 ceph-mon[65619]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-11-03T16:58:35.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:35 smithi194 ceph-mon[65619]: osdmap e70: 6 total, 5 up, 6 in 2021-11-03T16:58:35.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:35 smithi194 ceph-mon[65619]: from='osd.3 [v2:172.21.15.194:6800/3773074066,v1:172.21.15.194:6801/3773074066]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2021-11-03T16:58:35.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:35 smithi194 ceph-mon[65619]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2021-11-03T16:58:36.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:36 smithi026 ceph-mon[96795]: pgmap v105: 65 pgs: 33 active+undersized+degraded, 5 active+undersized, 27 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 12143/65073 objects degraded (18.661%) 2021-11-03T16:58:36.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:36 smithi026 ceph-mon[96795]: Health check cleared: OSD_DOWN (was: 1 osds down) 2021-11-03T16:58:36.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:36 smithi026 ceph-mon[96795]: osd.3 [v2:172.21.15.194:6800/3773074066,v1:172.21.15.194:6801/3773074066] boot 2021-11-03T16:58:36.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:36 smithi026 ceph-mon[96795]: osdmap e71: 6 total, 6 up, 6 in 2021-11-03T16:58:36.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:36 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-11-03T16:58:36.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:36 smithi194 ceph-mon[65619]: pgmap v105: 65 pgs: 33 active+undersized+degraded, 5 active+undersized, 27 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 12143/65073 objects degraded (18.661%) 2021-11-03T16:58:36.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:36 smithi194 ceph-mon[65619]: Health check cleared: OSD_DOWN (was: 1 osds down) 2021-11-03T16:58:36.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:36 smithi194 ceph-mon[65619]: osd.3 [v2:172.21.15.194:6800/3773074066,v1:172.21.15.194:6801/3773074066] boot 2021-11-03T16:58:36.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:36 smithi194 ceph-mon[65619]: osdmap e71: 6 total, 6 up, 6 in 2021-11-03T16:58:36.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:36 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-11-03T16:58:37.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:37 smithi026 ceph-mon[96795]: osdmap e72: 6 total, 6 up, 6 in 2021-11-03T16:58:37.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:37 smithi194 ceph-mon[65619]: osdmap e72: 6 total, 6 up, 6 in 2021-11-03T16:58:38.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:38 smithi026 ceph-mon[96795]: pgmap v108: 65 pgs: 33 active+undersized+degraded, 5 active+undersized, 27 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 12143/65073 objects degraded (18.661%) 2021-11-03T16:58:38.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:38 smithi194 ceph-mon[65619]: pgmap v108: 65 pgs: 33 active+undersized+degraded, 5 active+undersized, 27 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 12143/65073 objects degraded (18.661%) 2021-11-03T16:58:39.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:39 smithi194 ceph-mon[65619]: pgmap v109: 65 pgs: 29 active+undersized+degraded, 5 active+undersized, 31 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 10148/65073 objects degraded (15.595%) 2021-11-03T16:58:39.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:39 smithi194 ceph-mon[65619]: Health check update: Degraded data redundancy: 10148/65073 objects degraded (15.595%), 29 pgs degraded (PG_DEGRADED) 2021-11-03T16:58:40.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:39 smithi026 ceph-mon[96795]: pgmap v109: 65 pgs: 29 active+undersized+degraded, 5 active+undersized, 31 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 10148/65073 objects degraded (15.595%) 2021-11-03T16:58:40.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:39 smithi026 ceph-mon[96795]: Health check update: Degraded data redundancy: 10148/65073 objects degraded (15.595%), 29 pgs degraded (PG_DEGRADED) 2021-11-03T16:58:41.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:40 smithi026 ceph-mon[96795]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 10148/65073 objects degraded (15.595%), 29 pgs degraded) 2021-11-03T16:58:41.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:40 smithi194 ceph-mon[65619]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 10148/65073 objects degraded (15.595%), 29 pgs degraded) 2021-11-03T16:58:42.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:41 smithi026 ceph-mon[96795]: pgmap v110: 65 pgs: 16 active+clean+wait, 49 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:58:42.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:41 smithi194 ceph-mon[65619]: pgmap v110: 65 pgs: 16 active+clean+wait, 49 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:58:44.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:43 smithi026 ceph-mon[96795]: pgmap v111: 65 pgs: 16 active+clean+wait, 49 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:58:44.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:43 smithi194 ceph-mon[65619]: pgmap v111: 65 pgs: 16 active+clean+wait, 49 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:58:45.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:45 smithi026 ceph-mon[96795]: pgmap v112: 65 pgs: 16 active+clean+wait, 49 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:58:45.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:45 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-11-03T16:58:45.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:45 smithi194 ceph-mon[65619]: pgmap v112: 65 pgs: 16 active+clean+wait, 49 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:58:45.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:45 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-11-03T16:58:46.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:46 smithi194 ceph-mon[65619]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-11-03T16:58:46.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:46 smithi194 ceph-mon[65619]: Upgrade: osd.4 is safe to restart 2021-11-03T16:58:46.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:46 smithi194 ceph-mon[65619]: poll took 15044.361 ms: 1 events 2021-11-03T16:58:47.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:46 smithi026 ceph-mon[96795]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-11-03T16:58:47.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:46 smithi026 ceph-mon[96795]: Upgrade: osd.4 is safe to restart 2021-11-03T16:58:47.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:46 smithi026 ceph-mon[96795]: poll took 15044.361 ms: 1 events 2021-11-03T16:58:48.168 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:47 smithi194 ceph-mon[65619]: pgmap v113: 65 pgs: 16 active+clean+wait, 49 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:58:48.169 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:47 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:58:48.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:47 smithi026 ceph-mon[96795]: pgmap v113: 65 pgs: 16 active+clean+wait, 49 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:58:48.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:47 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:58:49.373 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:49 smithi194 ceph-mon[65619]: poll took 1652.485 ms: 1 events 2021-11-03T16:58:49.374 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:49 smithi194 ceph-mon[65619]: Upgrade: Updating osd.4 2021-11-03T16:58:49.374 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:49 smithi194 ceph-mon[65619]: Deploying daemon osd.4 on smithi194 2021-11-03T16:58:49.374 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:58:49.375 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T16:58:49.375 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T16:58:49.375 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:58:49.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:49 smithi026 ceph-mon[96795]: poll took 1652.485 ms: 1 events 2021-11-03T16:58:49.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:49 smithi026 ceph-mon[96795]: Upgrade: Updating osd.4 2021-11-03T16:58:49.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:49 smithi026 ceph-mon[96795]: Deploying daemon osd.4 on smithi194 2021-11-03T16:58:49.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:58:49.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T16:58:49.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T16:58:49.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:58:49.997 INFO:journalctl@ceph.osd.4.smithi194.stdout:Nov 03 16:58:49 smithi194 systemd[1]: Stopping Ceph osd.4 for 70492bc6-3cc5-11ec-8c28-001a4aab830c... 2021-11-03T16:58:49.997 INFO:journalctl@ceph.osd.4.smithi194.stdout:Nov 03 16:58:49 smithi194 conmon[46291]: debug 2021-11-03T16:58:49.951+0000 7fc920083700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2021-11-03T16:58:49.998 INFO:journalctl@ceph.osd.4.smithi194.stdout:Nov 03 16:58:49 smithi194 conmon[46291]: debug 2021-11-03T16:58:49.951+0000 7fc920083700 -1 osd.4 72 *** Got signal Terminated *** 2021-11-03T16:58:49.998 INFO:journalctl@ceph.osd.4.smithi194.stdout:Nov 03 16:58:49 smithi194 conmon[46291]: debug 2021-11-03T16:58:49.951+0000 7fc920083700 -1 osd.4 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-11-03T16:58:50.276 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:50 smithi194 ceph-mon[65619]: pgmap v114: 65 pgs: 16 active+clean+wait, 49 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:58:50.276 INFO:journalctl@ceph.osd.4.smithi194.stdout:Nov 03 16:58:50 smithi194 bash[74566]: e2fc9c0bdf0f740e85cdb24617c78663d9f887f026fad8cf454eb8feb9f2625e 2021-11-03T16:58:50.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:50 smithi026 ceph-mon[96795]: pgmap v114: 65 pgs: 16 active+clean+wait, 49 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:58:50.622 INFO:journalctl@ceph.osd.4.smithi194.stdout:Nov 03 16:58:50 smithi194 bash[74566]: Error: no container with name or ID ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c-osd-4 found: no such container 2021-11-03T16:58:50.622 INFO:journalctl@ceph.osd.4.smithi194.stdout:Nov 03 16:58:50 smithi194 bash[74566]: Error: container e2fc9c0bdf0f740e85cdb24617c78663d9f887f026fad8cf454eb8feb9f2625e does not exist in database: no such container 2021-11-03T16:58:51.397 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:51 smithi194 ceph-mon[65619]: osd.4 reported immediately failed by osd.5 2021-11-03T16:58:51.398 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:51 smithi194 ceph-mon[65619]: osd.4 failed (root=default,host=smithi194) (connection refused reported by osd.5) 2021-11-03T16:58:51.398 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:51 smithi194 ceph-mon[65619]: osd.4 reported immediately failed by osd.5 2021-11-03T16:58:51.398 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:51 smithi194 ceph-mon[65619]: osd.4 reported immediately failed by osd.1 2021-11-03T16:58:51.400 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:51 smithi194 ceph-mon[65619]: osd.4 reported immediately failed by osd.2 2021-11-03T16:58:51.400 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:51 smithi194 ceph-mon[65619]: osd.4 reported immediately failed by osd.3 2021-11-03T16:58:51.400 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:51 smithi194 ceph-mon[65619]: osd.4 reported immediately failed by osd.1 2021-11-03T16:58:51.401 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:51 smithi194 ceph-mon[65619]: osd.4 reported immediately failed by osd.2 2021-11-03T16:58:51.401 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:51 smithi194 ceph-mon[65619]: osd.4 reported immediately failed by osd.3 2021-11-03T16:58:51.401 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:51 smithi194 ceph-mon[65619]: osd.4 reported immediately failed by osd.0 2021-11-03T16:58:51.401 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:51 smithi194 ceph-mon[65619]: osd.4 reported immediately failed by osd.0 2021-11-03T16:58:51.401 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:51 smithi194 ceph-mon[65619]: osd.4 reported immediately failed by osd.5 2021-11-03T16:58:51.402 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:51 smithi194 ceph-mon[65619]: osd.4 reported immediately failed by osd.5 2021-11-03T16:58:51.402 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:51 smithi194 ceph-mon[65619]: osd.4 reported immediately failed by osd.1 2021-11-03T16:58:51.402 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:51 smithi194 ceph-mon[65619]: osd.4 reported immediately failed by osd.2 2021-11-03T16:58:51.402 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:51 smithi194 ceph-mon[65619]: osd.4 reported immediately failed by osd.3 2021-11-03T16:58:51.403 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:51 smithi194 ceph-mon[65619]: osd.4 reported immediately failed by osd.1 2021-11-03T16:58:51.403 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:51 smithi194 ceph-mon[65619]: osd.4 reported immediately failed by osd.2 2021-11-03T16:58:51.403 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:51 smithi194 ceph-mon[65619]: osd.4 reported immediately failed by osd.3 2021-11-03T16:58:51.403 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:51 smithi194 ceph-mon[65619]: osd.4 reported immediately failed by osd.0 2021-11-03T16:58:51.403 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:51 smithi194 ceph-mon[65619]: osd.4 reported immediately failed by osd.0 2021-11-03T16:58:51.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:51 smithi026 ceph-mon[96795]: osd.4 reported immediately failed by osd.5 2021-11-03T16:58:51.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:51 smithi026 ceph-mon[96795]: osd.4 failed (root=default,host=smithi194) (connection refused reported by osd.5) 2021-11-03T16:58:51.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:51 smithi026 ceph-mon[96795]: osd.4 reported immediately failed by osd.5 2021-11-03T16:58:51.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:51 smithi026 ceph-mon[96795]: osd.4 reported immediately failed by osd.1 2021-11-03T16:58:51.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:51 smithi026 ceph-mon[96795]: osd.4 reported immediately failed by osd.2 2021-11-03T16:58:51.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:51 smithi026 ceph-mon[96795]: osd.4 reported immediately failed by osd.3 2021-11-03T16:58:51.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:51 smithi026 ceph-mon[96795]: osd.4 reported immediately failed by osd.1 2021-11-03T16:58:51.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:51 smithi026 ceph-mon[96795]: osd.4 reported immediately failed by osd.2 2021-11-03T16:58:51.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:51 smithi026 ceph-mon[96795]: osd.4 reported immediately failed by osd.3 2021-11-03T16:58:51.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:51 smithi026 ceph-mon[96795]: osd.4 reported immediately failed by osd.0 2021-11-03T16:58:51.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:51 smithi026 ceph-mon[96795]: osd.4 reported immediately failed by osd.0 2021-11-03T16:58:51.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:51 smithi026 ceph-mon[96795]: osd.4 reported immediately failed by osd.5 2021-11-03T16:58:51.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:51 smithi026 ceph-mon[96795]: osd.4 reported immediately failed by osd.5 2021-11-03T16:58:51.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:51 smithi026 ceph-mon[96795]: osd.4 reported immediately failed by osd.1 2021-11-03T16:58:51.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:51 smithi026 ceph-mon[96795]: osd.4 reported immediately failed by osd.2 2021-11-03T16:58:51.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:51 smithi026 ceph-mon[96795]: osd.4 reported immediately failed by osd.3 2021-11-03T16:58:51.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:51 smithi026 ceph-mon[96795]: osd.4 reported immediately failed by osd.1 2021-11-03T16:58:51.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:51 smithi026 ceph-mon[96795]: osd.4 reported immediately failed by osd.2 2021-11-03T16:58:51.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:51 smithi026 ceph-mon[96795]: osd.4 reported immediately failed by osd.3 2021-11-03T16:58:51.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:51 smithi026 ceph-mon[96795]: osd.4 reported immediately failed by osd.0 2021-11-03T16:58:51.428 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:51 smithi026 ceph-mon[96795]: osd.4 reported immediately failed by osd.0 2021-11-03T16:58:52.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:52 smithi194 ceph-mon[65619]: pgmap v115: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:58:52.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:52 smithi194 ceph-mon[65619]: Health check failed: 1 osds down (OSD_DOWN) 2021-11-03T16:58:52.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:52 smithi194 ceph-mon[65619]: osdmap e73: 6 total, 5 up, 6 in 2021-11-03T16:58:52.249 INFO:journalctl@ceph.osd.4.smithi194.stdout:Nov 03 16:58:51 smithi194 systemd[1]: ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c@osd.4.service: Succeeded. 2021-11-03T16:58:52.249 INFO:journalctl@ceph.osd.4.smithi194.stdout:Nov 03 16:58:51 smithi194 systemd[1]: Stopped Ceph osd.4 for 70492bc6-3cc5-11ec-8c28-001a4aab830c. 2021-11-03T16:58:52.250 INFO:journalctl@ceph.osd.4.smithi194.stdout:Nov 03 16:58:52 smithi194 systemd[1]: Starting Ceph osd.4 for 70492bc6-3cc5-11ec-8c28-001a4aab830c... 2021-11-03T16:58:52.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:52 smithi026 ceph-mon[96795]: pgmap v115: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:58:52.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:52 smithi026 ceph-mon[96795]: Health check failed: 1 osds down (OSD_DOWN) 2021-11-03T16:58:52.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:52 smithi026 ceph-mon[96795]: osdmap e73: 6 total, 5 up, 6 in 2021-11-03T16:58:53.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:53 smithi194 ceph-mon[65619]: osdmap e74: 6 total, 5 up, 6 in 2021-11-03T16:58:53.248 INFO:journalctl@ceph.osd.4.smithi194.stdout:Nov 03 16:58:52 smithi194 bash[75048]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-11-03T16:58:53.248 INFO:journalctl@ceph.osd.4.smithi194.stdout:Nov 03 16:58:52 smithi194 bash[75048]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --dev /dev/mapper/vg_nvme-lv_3 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2021-11-03T16:58:53.248 INFO:journalctl@ceph.osd.4.smithi194.stdout:Nov 03 16:58:52 smithi194 bash[75048]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2021-11-03T16:58:53.248 INFO:journalctl@ceph.osd.4.smithi194.stdout:Nov 03 16:58:52 smithi194 bash[75048]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2021-11-03T16:58:53.249 INFO:journalctl@ceph.osd.4.smithi194.stdout:Nov 03 16:58:52 smithi194 bash[75048]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2021-11-03T16:58:53.249 INFO:journalctl@ceph.osd.4.smithi194.stdout:Nov 03 16:58:52 smithi194 bash[75048]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-11-03T16:58:53.249 INFO:journalctl@ceph.osd.4.smithi194.stdout:Nov 03 16:58:52 smithi194 bash[75048]: --> ceph-volume raw activate successful for osd ID: 4 2021-11-03T16:58:53.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:53 smithi026 ceph-mon[96795]: osdmap e74: 6 total, 5 up, 6 in 2021-11-03T16:58:54.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:54 smithi194 ceph-mon[65619]: pgmap v118: 65 pgs: 6 stale+active+clean, 59 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:58:54.248 INFO:journalctl@ceph.osd.4.smithi194.stdout:Nov 03 16:58:54 smithi194 bash[75048]: 6fda828ba5141a39c7f4c9502ea607b6ba8236c04c23d095c56349380c0aa028 2021-11-03T16:58:54.248 INFO:journalctl@ceph.osd.4.smithi194.stdout:Nov 03 16:58:54 smithi194 ceph-osd[75569]: -- 172.21.15.194:0/3628943729 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ae389a0340 con 0x55ae38966c00 2021-11-03T16:58:54.249 INFO:journalctl@ceph.osd.4.smithi194.stdout:Nov 03 16:58:54 smithi194 systemd[1]: Started Ceph osd.4 for 70492bc6-3cc5-11ec-8c28-001a4aab830c. 2021-11-03T16:58:54.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:54 smithi026 ceph-mon[96795]: pgmap v118: 65 pgs: 6 stale+active+clean, 59 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:58:54.997 INFO:journalctl@ceph.osd.4.smithi194.stdout:Nov 03 16:58:54 smithi194 conmon[75545]: 2021-11-03T16:58:54.567+0000 7f4a3a7200c0 -1 Falling back to public interface 2021-11-03T16:58:55.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:55 smithi026 ceph-mon[96795]: poll took 6442.511 ms: 1 events 2021-11-03T16:58:55.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:58:55.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:58:55.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:55 smithi194 ceph-mon[65619]: poll took 6442.511 ms: 1 events 2021-11-03T16:58:55.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:58:55.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:58:56.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:56 smithi026 ceph-mon[96795]: pgmap v119: 65 pgs: 30 active+undersized+degraded, 4 active+undersized, 31 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 12209/65073 objects degraded (18.762%) 2021-11-03T16:58:56.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:56 smithi026 ceph-mon[96795]: Health check failed: Degraded data redundancy: 12209/65073 objects degraded (18.762%), 30 pgs degraded (PG_DEGRADED) 2021-11-03T16:58:56.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:56 smithi194 ceph-mon[65619]: pgmap v119: 65 pgs: 30 active+undersized+degraded, 4 active+undersized, 31 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 12209/65073 objects degraded (18.762%) 2021-11-03T16:58:56.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:56 smithi194 ceph-mon[65619]: Health check failed: Degraded data redundancy: 12209/65073 objects degraded (18.762%), 30 pgs degraded (PG_DEGRADED) 2021-11-03T16:58:56.549 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.552+0000 7f8c8f9e8700 1 -- 172.21.15.26:0/3566424700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c880f55c0 msgr2=0x7f8c880f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:58:56.549 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.552+0000 7f8c8f9e8700 1 --2- 172.21.15.26:0/3566424700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c880f55c0 0x7f8c880f59e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f8c78004660 tx=0x7f8c78009b30).stop 2021-11-03T16:58:56.549 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.552+0000 7f8c8f9e8700 1 -- 172.21.15.26:0/3566424700 shutdown_connections 2021-11-03T16:58:56.550 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.552+0000 7f8c8f9e8700 1 --2- 172.21.15.26:0/3566424700 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c880f6860 0x7f8c880f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:56.550 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.552+0000 7f8c8f9e8700 1 --2- 172.21.15.26:0/3566424700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c880f55c0 0x7f8c880f59e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:56.550 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.552+0000 7f8c8f9e8700 1 -- 172.21.15.26:0/3566424700 >> 172.21.15.26:0/3566424700 conn(0x7f8c880f0d20 msgr2=0x7f8c880f3140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:58:56.550 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.553+0000 7f8c8f9e8700 1 -- 172.21.15.26:0/3566424700 shutdown_connections 2021-11-03T16:58:56.551 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.553+0000 7f8c8f9e8700 1 -- 172.21.15.26:0/3566424700 wait complete. 2021-11-03T16:58:56.551 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.553+0000 7f8c8f9e8700 1 Processor -- start 2021-11-03T16:58:56.551 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.553+0000 7f8c8f9e8700 1 -- start start 2021-11-03T16:58:56.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.553+0000 7f8c8f9e8700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c880f55c0 0x7f8c88109c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:58:56.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.553+0000 7f8c8f9e8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c880f6860 0x7f8c8810c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:58:56.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.553+0000 7f8c8f9e8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c88060520 con 0x7f8c880f6860 2021-11-03T16:58:56.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.553+0000 7f8c8f9e8700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c88060660 con 0x7f8c880f55c0 2021-11-03T16:58:56.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.553+0000 7f8c8cf83700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c880f6860 0x7f8c8810c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:58:56.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.553+0000 7f8c8cf83700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c880f6860 0x7f8c8810c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51710/0 (socket says 172.21.15.26:51710) 2021-11-03T16:58:56.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.553+0000 7f8c8cf83700 1 -- 172.21.15.26:0/2183162115 learned_addr learned my addr 172.21.15.26:0/2183162115 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:58:56.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.553+0000 7f8c8d784700 1 --2- 172.21.15.26:0/2183162115 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c880f55c0 0x7f8c88109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:58:56.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.554+0000 7f8c8cf83700 1 -- 172.21.15.26:0/2183162115 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c880f55c0 msgr2=0x7f8c88109c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:58:56.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.554+0000 7f8c8cf83700 1 --2- 172.21.15.26:0/2183162115 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c880f55c0 0x7f8c88109c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:56.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.554+0000 7f8c8cf83700 1 -- 172.21.15.26:0/2183162115 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c78005040 con 0x7f8c880f6860 2021-11-03T16:58:56.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.554+0000 7f8c8cf83700 1 --2- 172.21.15.26:0/2183162115 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c880f6860 0x7f8c8810c180 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f8c7c00e7f0 tx=0x7f8c7c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:58:56.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.554+0000 7f8c85ffb700 1 -- 172.21.15.26:0/2183162115 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c7c0092e0 con 0x7f8c880f6860 2021-11-03T16:58:56.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.554+0000 7f8c8f9e8700 1 -- 172.21.15.26:0/2183162115 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c8810c730 con 0x7f8c880f6860 2021-11-03T16:58:56.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.554+0000 7f8c85ffb700 1 -- 172.21.15.26:0/2183162115 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8c7c00f040 con 0x7f8c880f6860 2021-11-03T16:58:56.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.554+0000 7f8c85ffb700 1 -- 172.21.15.26:0/2183162115 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c7c014750 con 0x7f8c880f6860 2021-11-03T16:58:56.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.554+0000 7f8c8f9e8700 1 -- 172.21.15.26:0/2183162115 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c8810ccc0 con 0x7f8c880f6860 2021-11-03T16:58:56.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.555+0000 7f8c8f9e8700 1 -- 172.21.15.26:0/2183162115 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c88045ad0 con 0x7f8c880f6860 2021-11-03T16:58:56.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.556+0000 7f8c85ffb700 1 -- 172.21.15.26:0/2183162115 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f8c7c01b030 con 0x7f8c880f6860 2021-11-03T16:58:56.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.556+0000 7f8c85ffb700 1 --2- 172.21.15.26:0/2183162115 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8c700640b0 0x7f8c70066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:58:56.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.556+0000 7f8c85ffb700 1 -- 172.21.15.26:0/2183162115 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f8c7c080680 con 0x7f8c880f6860 2021-11-03T16:58:56.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.556+0000 7f8c8d784700 1 --2- 172.21.15.26:0/2183162115 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8c700640b0 0x7f8c70066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:58:56.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.557+0000 7f8c8d784700 1 --2- 172.21.15.26:0/2183162115 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8c700640b0 0x7f8c70066570 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f8c78000c00 tx=0x7f8c78016040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:58:56.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.560+0000 7f8c85ffb700 1 -- 172.21.15.26:0/2183162115 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f8c7c0529a0 con 0x7f8c880f6860 2021-11-03T16:58:56.735 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.738+0000 7f8c8f9e8700 1 -- 172.21.15.26:0/2183162115 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c88057f10 con 0x7f8c700640b0 2021-11-03T16:58:56.736 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.740+0000 7f8c85ffb700 1 -- 172.21.15.26:0/2183162115 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f8c88057f10 con 0x7f8c700640b0 2021-11-03T16:58:56.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.742+0000 7f8c8f9e8700 1 -- 172.21.15.26:0/2183162115 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8c700640b0 msgr2=0x7f8c70066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:58:56.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.742+0000 7f8c8f9e8700 1 --2- 172.21.15.26:0/2183162115 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8c700640b0 0x7f8c70066570 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f8c78000c00 tx=0x7f8c78016040).stop 2021-11-03T16:58:56.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.742+0000 7f8c8f9e8700 1 -- 172.21.15.26:0/2183162115 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c880f6860 msgr2=0x7f8c8810c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:58:56.739 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.742+0000 7f8c8f9e8700 1 --2- 172.21.15.26:0/2183162115 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c880f6860 0x7f8c8810c180 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f8c7c00e7f0 tx=0x7f8c7c00b040).stop 2021-11-03T16:58:56.739 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.742+0000 7f8c8f9e8700 1 -- 172.21.15.26:0/2183162115 shutdown_connections 2021-11-03T16:58:56.739 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.742+0000 7f8c8f9e8700 1 --2- 172.21.15.26:0/2183162115 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8c700640b0 0x7f8c70066570 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:56.740 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.742+0000 7f8c8f9e8700 1 --2- 172.21.15.26:0/2183162115 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c880f55c0 0x7f8c88109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:56.740 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.742+0000 7f8c8f9e8700 1 --2- 172.21.15.26:0/2183162115 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c880f6860 0x7f8c8810c180 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:56.740 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.742+0000 7f8c8f9e8700 1 -- 172.21.15.26:0/2183162115 >> 172.21.15.26:0/2183162115 conn(0x7f8c880f0d20 msgr2=0x7f8c880fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:58:56.740 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.742+0000 7f8c8f9e8700 1 -- 172.21.15.26:0/2183162115 shutdown_connections 2021-11-03T16:58:56.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.742+0000 7f8c8f9e8700 1 -- 172.21.15.26:0/2183162115 wait complete. 2021-11-03T16:58:56.748 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T16:58:56.842 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.843+0000 7f56c34b9700 1 -- 172.21.15.26:0/4160351172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56bc0f5ed0 msgr2=0x7f56bc0f6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:58:56.842 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.843+0000 7f56c34b9700 1 --2- 172.21.15.26:0/4160351172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56bc0f5ed0 0x7f56bc0f6900 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f56b8004660 tx=0x7f56b8009b30).stop 2021-11-03T16:58:56.843 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.843+0000 7f56c34b9700 1 -- 172.21.15.26:0/4160351172 shutdown_connections 2021-11-03T16:58:56.843 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.843+0000 7f56c34b9700 1 --2- 172.21.15.26:0/4160351172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56bc0f5ed0 0x7f56bc0f6900 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:56.843 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.843+0000 7f56c34b9700 1 --2- 172.21.15.26:0/4160351172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56bc0f55c0 0x7f56bc0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:56.843 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.843+0000 7f56c34b9700 1 -- 172.21.15.26:0/4160351172 >> 172.21.15.26:0/4160351172 conn(0x7f56bc0f0de0 msgr2=0x7f56bc0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:58:56.844 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.843+0000 7f56c34b9700 1 -- 172.21.15.26:0/4160351172 shutdown_connections 2021-11-03T16:58:56.844 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.843+0000 7f56c34b9700 1 -- 172.21.15.26:0/4160351172 wait complete. 2021-11-03T16:58:56.844 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.844+0000 7f56c34b9700 1 Processor -- start 2021-11-03T16:58:56.844 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.844+0000 7f56c34b9700 1 -- start start 2021-11-03T16:58:56.845 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.844+0000 7f56c34b9700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56bc0f55c0 0x7f56bc10c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:58:56.845 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.844+0000 7f56c34b9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56bc0f5ed0 0x7f56bc10e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:58:56.845 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.844+0000 7f56c34b9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56bc0603f0 con 0x7f56bc0f5ed0 2021-11-03T16:58:56.845 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.844+0000 7f56c34b9700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56bc060530 con 0x7f56bc0f55c0 2021-11-03T16:58:56.845 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.844+0000 7f56c0a54700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56bc0f5ed0 0x7f56bc10e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:58:56.846 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.844+0000 7f56c0a54700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56bc0f5ed0 0x7f56bc10e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51718/0 (socket says 172.21.15.26:51718) 2021-11-03T16:58:56.846 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.844+0000 7f56c0a54700 1 -- 172.21.15.26:0/922267495 learned_addr learned my addr 172.21.15.26:0/922267495 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:58:56.846 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.844+0000 7f56c1255700 1 --2- 172.21.15.26:0/922267495 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56bc0f55c0 0x7f56bc10c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:58:56.846 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.844+0000 7f56c0a54700 1 -- 172.21.15.26:0/922267495 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56bc0f55c0 msgr2=0x7f56bc10c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:58:56.847 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.844+0000 7f56c0a54700 1 --2- 172.21.15.26:0/922267495 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56bc0f55c0 0x7f56bc10c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:56.847 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.844+0000 7f56c0a54700 1 -- 172.21.15.26:0/922267495 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b8005040 con 0x7f56bc0f5ed0 2021-11-03T16:58:56.847 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.845+0000 7f56c0a54700 1 --2- 172.21.15.26:0/922267495 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56bc0f5ed0 0x7f56bc10e590 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f56b8009990 tx=0x7f56b8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:58:56.847 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.845+0000 7f56adffb700 1 -- 172.21.15.26:0/922267495 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56b8018070 con 0x7f56bc0f5ed0 2021-11-03T16:58:56.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.845+0000 7f56adffb700 1 -- 172.21.15.26:0/922267495 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f56b8007ba0 con 0x7f56bc0f5ed0 2021-11-03T16:58:56.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.845+0000 7f56c34b9700 1 -- 172.21.15.26:0/922267495 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56bc10ea80 con 0x7f56bc0f5ed0 2021-11-03T16:58:56.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.845+0000 7f56adffb700 1 -- 172.21.15.26:0/922267495 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56b801c3c0 con 0x7f56bc0f5ed0 2021-11-03T16:58:56.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.845+0000 7f56c34b9700 1 -- 172.21.15.26:0/922267495 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56bc10ee50 con 0x7f56bc0f5ed0 2021-11-03T16:58:56.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.846+0000 7f56c34b9700 1 -- 172.21.15.26:0/922267495 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56bc0f4a50 con 0x7f56bc0f5ed0 2021-11-03T16:58:56.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.847+0000 7f56adffb700 1 -- 172.21.15.26:0/922267495 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f56b801d420 con 0x7f56bc0f5ed0 2021-11-03T16:58:56.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.847+0000 7f56adffb700 1 --2- 172.21.15.26:0/922267495 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f56a80640b0 0x7f56a8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:58:56.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.847+0000 7f56adffb700 1 -- 172.21.15.26:0/922267495 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f56b80823f0 con 0x7f56bc0f5ed0 2021-11-03T16:58:56.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.847+0000 7f56c1255700 1 --2- 172.21.15.26:0/922267495 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f56a80640b0 0x7f56a8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:58:56.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.848+0000 7f56c1255700 1 --2- 172.21.15.26:0/922267495 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f56a80640b0 0x7f56a8066570 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f56bc060180 tx=0x7f56b000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:58:56.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:56.851+0000 7f56adffb700 1 -- 172.21.15.26:0/922267495 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f56b80546f0 con 0x7f56bc0f5ed0 2021-11-03T16:58:57.021 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.024+0000 7f56c34b9700 1 -- 172.21.15.26:0/922267495 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f56bc0fdeb0 con 0x7f56a80640b0 2021-11-03T16:58:57.035 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.039+0000 7f56adffb700 1 -- 172.21.15.26:0/922267495 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f56bc0fdeb0 con 0x7f56a80640b0 2021-11-03T16:58:57.035 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T16:58:57.036 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (10m) 53s ago 11m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T16:58:57.036 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (2m) 53s ago 11m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T16:58:57.036 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (2m) 0s ago 10m 7151k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T16:58:57.037 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (10m) 53s ago 11m 38.9M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T16:58:57.037 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (3m) 53s ago 6m 13.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T16:58:57.037 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (3m) 53s ago 6m 14.7M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T16:58:57.037 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (6m) 0s ago 6m 15.9M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T16:58:57.037 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (6m) 0s ago 6m 16.4M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T16:58:57.038 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (3m) 53s ago 12m 468M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T16:58:57.038 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (3m) 0s ago 10m 412M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T16:58:57.038 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (3m) 53s ago 12m 75.8M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T16:58:57.038 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (2m) 0s ago 10m 64.7M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T16:58:57.039 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (11m) 53s ago 11m 18.1M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T16:58:57.039 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (10m) 0s ago 10m 18.3M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T16:58:57.039 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (2m) 53s ago 9m 153M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T16:58:57.039 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (89s) 53s ago 9m 166M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T16:58:57.040 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (59s) 53s ago 9m 11.2M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T16:58:57.040 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (30s) 0s ago 8m 176M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T16:58:57.040 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (3s) 0s ago 8m 11.9M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T16:58:57.040 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (8m) 0s ago 8m 491M 4096M 16.2.4 8d91d370c2b8 0abc64d8a2bf 2021-11-03T16:58:57.040 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (9m) 53s ago 10m 47.5M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T16:58:57.041 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.041+0000 7f56c34b9700 1 -- 172.21.15.26:0/922267495 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f56a80640b0 msgr2=0x7f56a8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:58:57.042 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.041+0000 7f56c34b9700 1 --2- 172.21.15.26:0/922267495 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f56a80640b0 0x7f56a8066570 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f56bc060180 tx=0x7f56b000b040).stop 2021-11-03T16:58:57.042 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.041+0000 7f56c34b9700 1 -- 172.21.15.26:0/922267495 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56bc0f5ed0 msgr2=0x7f56bc10e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:58:57.042 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.041+0000 7f56c34b9700 1 --2- 172.21.15.26:0/922267495 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56bc0f5ed0 0x7f56bc10e590 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f56b8009990 tx=0x7f56b8009b30).stop 2021-11-03T16:58:57.042 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.041+0000 7f56c34b9700 1 -- 172.21.15.26:0/922267495 shutdown_connections 2021-11-03T16:58:57.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.041+0000 7f56c34b9700 1 --2- 172.21.15.26:0/922267495 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f56a80640b0 0x7f56a8066570 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:57.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.041+0000 7f56c34b9700 1 --2- 172.21.15.26:0/922267495 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56bc0f55c0 0x7f56bc10c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:57.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.041+0000 7f56c34b9700 1 --2- 172.21.15.26:0/922267495 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56bc0f5ed0 0x7f56bc10e590 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:57.044 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.041+0000 7f56c34b9700 1 -- 172.21.15.26:0/922267495 >> 172.21.15.26:0/922267495 conn(0x7f56bc0f0de0 msgr2=0x7f56bc0fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:58:57.044 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.041+0000 7f56c34b9700 1 -- 172.21.15.26:0/922267495 shutdown_connections 2021-11-03T16:58:57.044 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.041+0000 7f56c34b9700 1 -- 172.21.15.26:0/922267495 wait complete. 2021-11-03T16:58:57.139 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.141+0000 7fa55c93c700 1 -- 172.21.15.26:0/3691711874 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5580f66c0 msgr2=0x7fa5580f6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:58:57.140 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.141+0000 7fa55c93c700 1 --2- 172.21.15.26:0/3691711874 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5580f66c0 0x7fa5580f6ae0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fa5500099e0 tx=0x7fa550004d10).stop 2021-11-03T16:58:57.140 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.141+0000 7fa55c93c700 1 -- 172.21.15.26:0/3691711874 shutdown_connections 2021-11-03T16:58:57.140 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.141+0000 7fa55c93c700 1 --2- 172.21.15.26:0/3691711874 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5580f7960 0x7fa5580f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:57.140 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.141+0000 7fa55c93c700 1 --2- 172.21.15.26:0/3691711874 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5580f66c0 0x7fa5580f6ae0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:57.141 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.141+0000 7fa55c93c700 1 -- 172.21.15.26:0/3691711874 >> 172.21.15.26:0/3691711874 conn(0x7fa5580f1e20 msgr2=0x7fa5580f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:58:57.141 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.141+0000 7fa55c93c700 1 -- 172.21.15.26:0/3691711874 shutdown_connections 2021-11-03T16:58:57.141 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.141+0000 7fa55c93c700 1 -- 172.21.15.26:0/3691711874 wait complete. 2021-11-03T16:58:57.141 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.141+0000 7fa55c93c700 1 Processor -- start 2021-11-03T16:58:57.142 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.141+0000 7fa55c93c700 1 -- start start 2021-11-03T16:58:57.142 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.142+0000 7fa55c93c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5580f66c0 0x7fa558107080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:58:57.142 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.142+0000 7fa55c93c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5580f7960 0x7fa558107570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:58:57.142 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.142+0000 7fa55c93c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa558107b20 con 0x7fa5580f66c0 2021-11-03T16:58:57.143 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.142+0000 7fa55c93c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa558107c60 con 0x7fa5580f7960 2021-11-03T16:58:57.143 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.142+0000 7fa55659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5580f66c0 0x7fa558107080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:58:57.143 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.142+0000 7fa55659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5580f66c0 0x7fa558107080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51726/0 (socket says 172.21.15.26:51726) 2021-11-03T16:58:57.143 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.142+0000 7fa55659c700 1 -- 172.21.15.26:0/1585237954 learned_addr learned my addr 172.21.15.26:0/1585237954 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:58:57.143 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.142+0000 7fa555d9b700 1 --2- 172.21.15.26:0/1585237954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5580f7960 0x7fa558107570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:58:57.144 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.142+0000 7fa55659c700 1 -- 172.21.15.26:0/1585237954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5580f7960 msgr2=0x7fa558107570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:58:57.144 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.142+0000 7fa55659c700 1 --2- 172.21.15.26:0/1585237954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5580f7960 0x7fa558107570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:57.144 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.142+0000 7fa55659c700 1 -- 172.21.15.26:0/1585237954 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa550009640 con 0x7fa5580f66c0 2021-11-03T16:58:57.144 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.142+0000 7fa55659c700 1 --2- 172.21.15.26:0/1585237954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5580f66c0 0x7fa558107080 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fa55000c010 tx=0x7fa550004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:58:57.145 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.142+0000 7fa54effd700 1 -- 172.21.15.26:0/1585237954 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa55000e070 con 0x7fa5580f66c0 2021-11-03T16:58:57.145 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.142+0000 7fa54effd700 1 -- 172.21.15.26:0/1585237954 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa550007d10 con 0x7fa5580f66c0 2021-11-03T16:58:57.145 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.142+0000 7fa55c93c700 1 -- 172.21.15.26:0/1585237954 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5581085a0 con 0x7fa5580f66c0 2021-11-03T16:58:57.145 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.142+0000 7fa54effd700 1 -- 172.21.15.26:0/1585237954 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa550018070 con 0x7fa5580f66c0 2021-11-03T16:58:57.146 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.142+0000 7fa55c93c700 1 -- 172.21.15.26:0/1585237954 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa558108a80 con 0x7fa5580f66c0 2021-11-03T16:58:57.146 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.143+0000 7fa55c93c700 1 -- 172.21.15.26:0/1585237954 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa558045ad0 con 0x7fa5580f66c0 2021-11-03T16:58:57.147 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.144+0000 7fa54effd700 1 -- 172.21.15.26:0/1585237954 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fa550024060 con 0x7fa5580f66c0 2021-11-03T16:58:57.148 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.144+0000 7fa54effd700 1 --2- 172.21.15.26:0/1585237954 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa5440640b0 0x7fa544066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:58:57.148 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.144+0000 7fa54effd700 1 -- 172.21.15.26:0/1585237954 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fa550082020 con 0x7fa5580f66c0 2021-11-03T16:58:57.148 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.144+0000 7fa555d9b700 1 --2- 172.21.15.26:0/1585237954 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa5440640b0 0x7fa544066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:58:57.149 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.145+0000 7fa555d9b700 1 --2- 172.21.15.26:0/1585237954 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa5440640b0 0x7fa544066570 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fa540004c40 tx=0x7fa54000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:58:57.149 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.148+0000 7fa54effd700 1 -- 172.21.15.26:0/1585237954 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fa550054380 con 0x7fa5580f66c0 2021-11-03T16:58:57.375 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.379+0000 7fa55c93c700 1 -- 172.21.15.26:0/1585237954 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa558100e30 con 0x7fa5580f66c0 2021-11-03T16:58:57.376 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.379+0000 7fa54effd700 1 -- 172.21.15.26:0/1585237954 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+804 (secure 0 0 0) 0x7fa550022340 con 0x7fa5580f66c0 2021-11-03T16:58:57.377 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T16:58:57.377 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T16:58:57.377 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T16:58:57.377 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:58:57.378 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T16:58:57.378 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T16:58:57.378 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:58:57.378 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T16:58:57.379 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 1, 2021-11-03T16:58:57.379 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 4 2021-11-03T16:58:57.379 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:58:57.379 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T16:58:57.380 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T16:58:57.380 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:58:57.380 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T16:58:57.380 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5, 2021-11-03T16:58:57.381 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 8 2021-11-03T16:58:57.381 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T16:58:57.381 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T16:58:57.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.381+0000 7fa55c93c700 1 -- 172.21.15.26:0/1585237954 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa5440640b0 msgr2=0x7fa544066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:58:57.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.381+0000 7fa55c93c700 1 --2- 172.21.15.26:0/1585237954 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa5440640b0 0x7fa544066570 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fa540004c40 tx=0x7fa54000b040).stop 2021-11-03T16:58:57.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.381+0000 7fa55c93c700 1 -- 172.21.15.26:0/1585237954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5580f66c0 msgr2=0x7fa558107080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:58:57.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.381+0000 7fa55c93c700 1 --2- 172.21.15.26:0/1585237954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5580f66c0 0x7fa558107080 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fa55000c010 tx=0x7fa550004d10).stop 2021-11-03T16:58:57.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.381+0000 7fa55c93c700 1 -- 172.21.15.26:0/1585237954 shutdown_connections 2021-11-03T16:58:57.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.381+0000 7fa55c93c700 1 --2- 172.21.15.26:0/1585237954 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa5440640b0 0x7fa544066570 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:57.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.381+0000 7fa55c93c700 1 --2- 172.21.15.26:0/1585237954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5580f66c0 0x7fa558107080 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:57.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.381+0000 7fa55c93c700 1 --2- 172.21.15.26:0/1585237954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5580f7960 0x7fa558107570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:57.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.381+0000 7fa55c93c700 1 -- 172.21.15.26:0/1585237954 >> 172.21.15.26:0/1585237954 conn(0x7fa5580f1e20 msgr2=0x7fa5580fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:58:57.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.381+0000 7fa55c93c700 1 -- 172.21.15.26:0/1585237954 shutdown_connections 2021-11-03T16:58:57.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.381+0000 7fa55c93c700 1 -- 172.21.15.26:0/1585237954 wait complete. 2021-11-03T16:58:57.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.482+0000 7ff2d527b700 1 -- 172.21.15.26:0/873702835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2d00f66e0 msgr2=0x7ff2d00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:58:57.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.482+0000 7ff2d527b700 1 --2- 172.21.15.26:0/873702835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2d00f66e0 0x7ff2d00f6b00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7ff2c0004660 tx=0x7ff2c0009b30).stop 2021-11-03T16:58:57.481 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.482+0000 7ff2d527b700 1 -- 172.21.15.26:0/873702835 shutdown_connections 2021-11-03T16:58:57.481 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.482+0000 7ff2d527b700 1 --2- 172.21.15.26:0/873702835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2d00f6ff0 0x7ff2d00f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:57.482 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.482+0000 7ff2d527b700 1 --2- 172.21.15.26:0/873702835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2d00f66e0 0x7ff2d00f6b00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:57.482 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.482+0000 7ff2d527b700 1 -- 172.21.15.26:0/873702835 >> 172.21.15.26:0/873702835 conn(0x7ff2d00f1f00 msgr2=0x7ff2d00f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:58:57.482 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.482+0000 7ff2d527b700 1 -- 172.21.15.26:0/873702835 shutdown_connections 2021-11-03T16:58:57.482 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.482+0000 7ff2d527b700 1 -- 172.21.15.26:0/873702835 wait complete. 2021-11-03T16:58:57.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.483+0000 7ff2d527b700 1 Processor -- start 2021-11-03T16:58:57.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.483+0000 7ff2d527b700 1 -- start start 2021-11-03T16:58:57.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.483+0000 7ff2d527b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2d00f66e0 0x7ff2d006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:58:57.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.483+0000 7ff2d527b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2d00f6ff0 0x7ff2d0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:58:57.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.483+0000 7ff2d527b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d006a380 con 0x7ff2d00f6ff0 2021-11-03T16:58:57.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.483+0000 7ff2d527b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d006a4c0 con 0x7ff2d00f66e0 2021-11-03T16:58:57.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.483+0000 7ff2ce7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2d00f6ff0 0x7ff2d0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:58:57.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.483+0000 7ff2ce7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2d00f6ff0 0x7ff2d0069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51738/0 (socket says 172.21.15.26:51738) 2021-11-03T16:58:57.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.483+0000 7ff2ce7fc700 1 -- 172.21.15.26:0/3407703799 learned_addr learned my addr 172.21.15.26:0/3407703799 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:58:57.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.483+0000 7ff2ceffd700 1 --2- 172.21.15.26:0/3407703799 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2d00f66e0 0x7ff2d006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:58:57.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.484+0000 7ff2ce7fc700 1 -- 172.21.15.26:0/3407703799 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2d00f66e0 msgr2=0x7ff2d006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:58:57.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.484+0000 7ff2ce7fc700 1 --2- 172.21.15.26:0/3407703799 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2d00f66e0 0x7ff2d006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:57.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.484+0000 7ff2ce7fc700 1 -- 172.21.15.26:0/3407703799 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c0005040 con 0x7ff2d00f6ff0 2021-11-03T16:58:57.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.484+0000 7ff2ce7fc700 1 --2- 172.21.15.26:0/3407703799 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2d00f6ff0 0x7ff2d0069e20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7ff2c40026d0 tx=0x7ff2c4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:58:57.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.484+0000 7ff2b77fe700 1 -- 172.21.15.26:0/3407703799 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2c40079c0 con 0x7ff2d00f6ff0 2021-11-03T16:58:57.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.484+0000 7ff2d527b700 1 -- 172.21.15.26:0/3407703799 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d006a7a0 con 0x7ff2d00f6ff0 2021-11-03T16:58:57.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.484+0000 7ff2b77fe700 1 -- 172.21.15.26:0/3407703799 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff2c400f040 con 0x7ff2d00f6ff0 2021-11-03T16:58:57.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.484+0000 7ff2b77fe700 1 -- 172.21.15.26:0/3407703799 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2c40148b0 con 0x7ff2d00f6ff0 2021-11-03T16:58:57.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.484+0000 7ff2d527b700 1 -- 172.21.15.26:0/3407703799 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d010ef90 con 0x7ff2d00f6ff0 2021-11-03T16:58:57.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.485+0000 7ff2d527b700 1 -- 172.21.15.26:0/3407703799 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d0045ad0 con 0x7ff2d00f6ff0 2021-11-03T16:58:57.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.485+0000 7ff2b77fe700 1 -- 172.21.15.26:0/3407703799 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ff2c4007b20 con 0x7ff2d00f6ff0 2021-11-03T16:58:57.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.486+0000 7ff2b77fe700 1 --2- 172.21.15.26:0/3407703799 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff2b80640b0 0x7ff2b8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:58:57.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.486+0000 7ff2b77fe700 1 -- 172.21.15.26:0/3407703799 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ff2c4080730 con 0x7ff2d00f6ff0 2021-11-03T16:58:57.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.486+0000 7ff2ceffd700 1 --2- 172.21.15.26:0/3407703799 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff2b80640b0 0x7ff2b8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:58:57.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.486+0000 7ff2ceffd700 1 --2- 172.21.15.26:0/3407703799 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff2b80640b0 0x7ff2b8066570 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7ff2c0004630 tx=0x7ff2c0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:58:57.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.490+0000 7ff2b77fe700 1 -- 172.21.15.26:0/3407703799 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ff2c4052a90 con 0x7ff2d00f6ff0 2021-11-03T16:58:57.693 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.697+0000 7ff2d527b700 1 -- 172.21.15.26:0/3407703799 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff2d00fef70 con 0x7ff2d00f6ff0 2021-11-03T16:58:57.818 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.697+0000 7ff2b77fe700 1 -- 172.21.15.26:0/3407703799 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7ff2c4052680 con 0x7ff2d00f6ff0 2021-11-03T16:58:57.819 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T16:58:57.820 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T16:58:57.820 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T16:58:57.820 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T16:58:57.820 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:58:57.821 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T16:58:57.821 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T16:58:57.821 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T16:58:57.821 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T16:58:57.822 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T16:58:57.822 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T16:58:57.822 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T16:58:57.822 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T16:58:57.823 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T16:58:57.823 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T16:58:57.823 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T16:58:57.823 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T16:58:57.823 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T16:58:57.824 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T16:58:57.824 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T16:58:57.824 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T16:58:57.824 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T16:58:57.824 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T16:58:57.825 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T16:58:57.825 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T16:58:57.825 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T16:58:57.825 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T16:58:57.826 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T16:58:57.826 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T16:58:57.826 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T16:58:57.826 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T16:58:57.827 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:58:57.827 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:58:57.828 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T16:58:57.828 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:58:57.828 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T16:58:57.829 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T16:58:57.829 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T16:58:57.829 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T16:58:57.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.699+0000 7ff2d527b700 1 -- 172.21.15.26:0/3407703799 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff2b80640b0 msgr2=0x7ff2b8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:58:57.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.699+0000 7ff2d527b700 1 --2- 172.21.15.26:0/3407703799 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff2b80640b0 0x7ff2b8066570 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7ff2c0004630 tx=0x7ff2c0009b30).stop 2021-11-03T16:58:57.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.699+0000 7ff2d527b700 1 -- 172.21.15.26:0/3407703799 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2d00f6ff0 msgr2=0x7ff2d0069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:58:57.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.699+0000 7ff2d527b700 1 --2- 172.21.15.26:0/3407703799 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2d00f6ff0 0x7ff2d0069e20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7ff2c40026d0 tx=0x7ff2c4009de0).stop 2021-11-03T16:58:57.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.699+0000 7ff2d527b700 1 -- 172.21.15.26:0/3407703799 shutdown_connections 2021-11-03T16:58:57.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.699+0000 7ff2d527b700 1 --2- 172.21.15.26:0/3407703799 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff2b80640b0 0x7ff2b8066570 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:57.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.699+0000 7ff2d527b700 1 --2- 172.21.15.26:0/3407703799 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2d00f66e0 0x7ff2d006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:57.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.699+0000 7ff2d527b700 1 --2- 172.21.15.26:0/3407703799 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2d00f6ff0 0x7ff2d0069e20 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:58:57.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.699+0000 7ff2d527b700 1 -- 172.21.15.26:0/3407703799 >> 172.21.15.26:0/3407703799 conn(0x7ff2d00f1f00 msgr2=0x7ff2d00fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:58:57.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.699+0000 7ff2d527b700 1 -- 172.21.15.26:0/3407703799 shutdown_connections 2021-11-03T16:58:57.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:58:57.699+0000 7ff2d527b700 1 -- 172.21.15.26:0/3407703799 wait complete. 2021-11-03T16:58:57.833 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T16:58:58.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:57 smithi026 ceph-mon[96795]: pgmap v120: 65 pgs: 30 active+undersized+degraded, 4 active+undersized, 31 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 12209/65073 objects degraded (18.762%) 2021-11-03T16:58:58.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:57 smithi026 ceph-mon[96795]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:58:58.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:57 smithi026 ceph-mon[96795]: poll took 2713.429 ms: 1 events 2021-11-03T16:58:58.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:57 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:58:58.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:57 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:58:58.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:57 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:58:58.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:57 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:58:58.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:57 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:58:58.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:57 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:58:58.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:57 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-11-03T16:58:58.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:57 smithi026 ceph-mon[96795]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-11-03T16:58:58.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:57 smithi026 ceph-mon[96795]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2021-11-03T16:58:58.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:57 smithi026 ceph-mon[96795]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:58:58.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:57 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1585237954' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:58:58.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:57 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3407703799' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T16:58:58.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:57 smithi194 ceph-mon[65619]: pgmap v120: 65 pgs: 30 active+undersized+degraded, 4 active+undersized, 31 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 12209/65073 objects degraded (18.762%) 2021-11-03T16:58:58.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:57 smithi194 ceph-mon[65619]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:58:58.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:57 smithi194 ceph-mon[65619]: poll took 2713.429 ms: 1 events 2021-11-03T16:58:58.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:57 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:58:58.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:57 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:58:58.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:57 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:58:58.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:57 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:58:58.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:57 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:58:58.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:57 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:58:58.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:57 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-11-03T16:58:58.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:57 smithi194 ceph-mon[65619]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-11-03T16:58:58.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:57 smithi194 ceph-mon[65619]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2021-11-03T16:58:58.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:57 smithi194 ceph-mon[65619]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:58:58.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:57 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1585237954' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:58:58.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:57 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3407703799' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T16:59:00.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:59 smithi026 ceph-mon[96795]: pgmap v121: 65 pgs: 30 active+undersized+degraded, 4 active+undersized, 31 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 12209/65073 objects degraded (18.762%) 2021-11-03T16:59:00.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:59 smithi026 ceph-mon[96795]: from='osd.4 [v2:172.21.15.194:6808/48612852,v1:172.21.15.194:6809/48612852]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-11-03T16:59:00.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:58:59 smithi026 ceph-mon[96795]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-11-03T16:59:00.247 INFO:journalctl@ceph.osd.4.smithi194.stdout:Nov 03 16:58:59 smithi194 conmon[75545]: 2021-11-03T16:58:59.837+0000 7f4a3a7200c0 -1 osd.4 72 log_to_monitors {default=true} 2021-11-03T16:59:00.247 INFO:journalctl@ceph.osd.4.smithi194.stdout:Nov 03 16:58:59 smithi194 conmon[75545]: 2021-11-03T16:58:59.893+0000 7f4a2d062700 -1 osd.4 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-03T16:59:00.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:59 smithi194 ceph-mon[65619]: pgmap v121: 65 pgs: 30 active+undersized+degraded, 4 active+undersized, 31 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 12209/65073 objects degraded (18.762%) 2021-11-03T16:59:00.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:59 smithi194 ceph-mon[65619]: from='osd.4 [v2:172.21.15.194:6808/48612852,v1:172.21.15.194:6809/48612852]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-11-03T16:59:00.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:58:59 smithi194 ceph-mon[65619]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-11-03T16:59:01.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:00 smithi026 ceph-mon[96795]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-11-03T16:59:01.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:00 smithi026 ceph-mon[96795]: osdmap e75: 6 total, 5 up, 6 in 2021-11-03T16:59:01.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:00 smithi026 ceph-mon[96795]: from='osd.4 [v2:172.21.15.194:6808/48612852,v1:172.21.15.194:6809/48612852]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2021-11-03T16:59:01.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:00 smithi026 ceph-mon[96795]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2021-11-03T16:59:01.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:00 smithi194 ceph-mon[65619]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-11-03T16:59:01.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:00 smithi194 ceph-mon[65619]: osdmap e75: 6 total, 5 up, 6 in 2021-11-03T16:59:01.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:00 smithi194 ceph-mon[65619]: from='osd.4 [v2:172.21.15.194:6808/48612852,v1:172.21.15.194:6809/48612852]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2021-11-03T16:59:01.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:00 smithi194 ceph-mon[65619]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2021-11-03T16:59:02.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:01 smithi026 ceph-mon[96795]: pgmap v123: 65 pgs: 30 active+undersized+degraded, 4 active+undersized, 31 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 12209/65073 objects degraded (18.762%) 2021-11-03T16:59:02.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:01 smithi026 ceph-mon[96795]: Health check cleared: OSD_DOWN (was: 1 osds down) 2021-11-03T16:59:02.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:01 smithi026 ceph-mon[96795]: osd.4 [v2:172.21.15.194:6808/48612852,v1:172.21.15.194:6809/48612852] boot 2021-11-03T16:59:02.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:01 smithi026 ceph-mon[96795]: osdmap e76: 6 total, 6 up, 6 in 2021-11-03T16:59:02.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-11-03T16:59:02.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:01 smithi194 ceph-mon[65619]: pgmap v123: 65 pgs: 30 active+undersized+degraded, 4 active+undersized, 31 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 12209/65073 objects degraded (18.762%) 2021-11-03T16:59:02.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:01 smithi194 ceph-mon[65619]: Health check cleared: OSD_DOWN (was: 1 osds down) 2021-11-03T16:59:02.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:01 smithi194 ceph-mon[65619]: osd.4 [v2:172.21.15.194:6808/48612852,v1:172.21.15.194:6809/48612852] boot 2021-11-03T16:59:02.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:01 smithi194 ceph-mon[65619]: osdmap e76: 6 total, 6 up, 6 in 2021-11-03T16:59:02.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-11-03T16:59:03.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:02 smithi026 ceph-mon[96795]: osdmap e77: 6 total, 6 up, 6 in 2021-11-03T16:59:03.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:02 smithi194 ceph-mon[65619]: osdmap e77: 6 total, 6 up, 6 in 2021-11-03T16:59:04.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:04 smithi026 ceph-mon[96795]: pgmap v126: 65 pgs: 30 active+undersized+degraded, 4 active+undersized, 31 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 12209/65073 objects degraded (18.762%) 2021-11-03T16:59:04.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:04 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:59:04.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:04 smithi194 ceph-mon[65619]: pgmap v126: 65 pgs: 30 active+undersized+degraded, 4 active+undersized, 31 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 12209/65073 objects degraded (18.762%) 2021-11-03T16:59:04.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:04 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:59:05.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:05 smithi026 ceph-mon[96795]: Health check update: Degraded data redundancy: 2027/65073 objects degraded (3.115%), 5 pgs degraded (PG_DEGRADED) 2021-11-03T16:59:05.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:05 smithi194 ceph-mon[65619]: Health check update: Degraded data redundancy: 2027/65073 objects degraded (3.115%), 5 pgs degraded (PG_DEGRADED) 2021-11-03T16:59:06.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:06 smithi026 ceph-mon[96795]: pgmap v127: 65 pgs: 5 active+undersized+degraded, 1 active+undersized, 59 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 2027/65073 objects degraded (3.115%) 2021-11-03T16:59:06.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:06 smithi194 ceph-mon[65619]: pgmap v127: 65 pgs: 5 active+undersized+degraded, 1 active+undersized, 59 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 2027/65073 objects degraded (3.115%) 2021-11-03T16:59:07.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:07 smithi026 ceph-mon[96795]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2027/65073 objects degraded (3.115%), 5 pgs degraded) 2021-11-03T16:59:07.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:07 smithi194 ceph-mon[65619]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2027/65073 objects degraded (3.115%), 5 pgs degraded) 2021-11-03T16:59:08.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:08 smithi026 ceph-mon[96795]: pgmap v128: 65 pgs: 6 active+clean+wait, 59 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:59:08.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:08 smithi194 ceph-mon[65619]: pgmap v128: 65 pgs: 6 active+clean+wait, 59 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:59:10.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:10 smithi026 ceph-mon[96795]: pgmap v129: 65 pgs: 6 active+clean+wait, 59 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:59:10.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:10 smithi194 ceph-mon[65619]: pgmap v129: 65 pgs: 6 active+clean+wait, 59 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:59:12.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:12 smithi194 ceph-mon[65619]: pgmap v130: 65 pgs: 6 active+clean+wait, 59 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:59:12.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:12 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-11-03T16:59:12.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:12 smithi026 ceph-mon[96795]: pgmap v130: 65 pgs: 6 active+clean+wait, 59 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:59:12.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:12 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-11-03T16:59:13.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:13 smithi026 ceph-mon[96795]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-11-03T16:59:13.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:13 smithi026 ceph-mon[96795]: Upgrade: osd.5 is safe to restart 2021-11-03T16:59:13.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:13 smithi026 ceph-mon[96795]: poll took 15026.294 ms: 1 events 2021-11-03T16:59:13.473 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:13 smithi194 ceph-mon[65619]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-11-03T16:59:13.473 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:13 smithi194 ceph-mon[65619]: Upgrade: osd.5 is safe to restart 2021-11-03T16:59:13.473 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:13 smithi194 ceph-mon[65619]: poll took 15026.294 ms: 1 events 2021-11-03T16:59:14.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:14 smithi194 ceph-mon[65619]: pgmap v131: 65 pgs: 6 active+clean+wait, 59 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:59:14.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:14 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:59:14.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:14 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:59:14.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:14 smithi026 ceph-mon[96795]: pgmap v131: 65 pgs: 6 active+clean+wait, 59 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:59:14.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:14 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:59:14.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:14 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:59:15.175 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:15 smithi194 ceph-mon[65619]: poll took 1563.936 ms: 1 events 2021-11-03T16:59:15.175 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:15 smithi194 ceph-mon[65619]: Upgrade: Updating osd.5 2021-11-03T16:59:15.176 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:15 smithi194 ceph-mon[65619]: Deploying daemon osd.5 on smithi194 2021-11-03T16:59:15.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:15 smithi026 ceph-mon[96795]: poll took 1563.936 ms: 1 events 2021-11-03T16:59:15.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:15 smithi026 ceph-mon[96795]: Upgrade: Updating osd.5 2021-11-03T16:59:15.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:15 smithi026 ceph-mon[96795]: Deploying daemon osd.5 on smithi194 2021-11-03T16:59:16.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:16 smithi026 ceph-mon[96795]: pgmap v132: 65 pgs: 6 active+clean+wait, 59 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:59:16.471 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:16 smithi194 ceph-mon[65619]: pgmap v132: 65 pgs: 6 active+clean+wait, 59 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:59:16.471 INFO:journalctl@ceph.osd.5.smithi194.stdout:Nov 03 16:59:16 smithi194 systemd[1]: Stopping Ceph osd.5 for 70492bc6-3cc5-11ec-8c28-001a4aab830c... 2021-11-03T16:59:16.472 INFO:journalctl@ceph.osd.5.smithi194.stdout:Nov 03 16:59:16 smithi194 conmon[51246]: debug 2021-11-03T16:59:16.238+0000 7fa23fc27700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2021-11-03T16:59:16.472 INFO:journalctl@ceph.osd.5.smithi194.stdout:Nov 03 16:59:16 smithi194 conmon[51246]: debug 2021-11-03T16:59:16.238+0000 7fa23fc27700 -1 osd.5 77 *** Got signal Terminated *** 2021-11-03T16:59:16.472 INFO:journalctl@ceph.osd.5.smithi194.stdout:Nov 03 16:59:16 smithi194 conmon[51246]: debug 2021-11-03T16:59:16.238+0000 7fa23fc27700 -1 osd.5 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-11-03T16:59:16.747 INFO:journalctl@ceph.osd.5.smithi194.stdout:Nov 03 16:59:16 smithi194 bash[77976]: 0abc64d8a2bff033b7682d5a0ce78ac462c4ce905be9263c35cdbaff43caae8d 2021-11-03T16:59:16.747 INFO:journalctl@ceph.osd.5.smithi194.stdout:Nov 03 16:59:16 smithi194 bash[77976]: Error: no container with name or ID ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c-osd-5 found: no such container 2021-11-03T16:59:17.247 INFO:journalctl@ceph.osd.5.smithi194.stdout:Nov 03 16:59:16 smithi194 bash[77976]: Error: container 0abc64d8a2bff033b7682d5a0ce78ac462c4ce905be9263c35cdbaff43caae8d does not exist in database: no such container 2021-11-03T16:59:17.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:17 smithi194 ceph-mon[65619]: osd.5 reported immediately failed by osd.2 2021-11-03T16:59:17.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:17 smithi194 ceph-mon[65619]: osd.5 failed (root=default,host=smithi194) (connection refused reported by osd.2) 2021-11-03T16:59:17.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:17 smithi194 ceph-mon[65619]: osd.5 reported immediately failed by osd.1 2021-11-03T16:59:17.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:17 smithi194 ceph-mon[65619]: osd.5 reported immediately failed by osd.2 2021-11-03T16:59:17.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:17 smithi194 ceph-mon[65619]: osd.5 reported immediately failed by osd.4 2021-11-03T16:59:17.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:17 smithi194 ceph-mon[65619]: osd.5 reported immediately failed by osd.1 2021-11-03T16:59:17.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:17 smithi194 ceph-mon[65619]: osd.5 reported immediately failed by osd.4 2021-11-03T16:59:17.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:17 smithi194 ceph-mon[65619]: osd.5 reported immediately failed by osd.0 2021-11-03T16:59:17.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:17 smithi194 ceph-mon[65619]: osd.5 reported immediately failed by osd.3 2021-11-03T16:59:17.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:17 smithi194 ceph-mon[65619]: osd.5 reported immediately failed by osd.0 2021-11-03T16:59:17.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:17 smithi194 ceph-mon[65619]: osd.5 reported immediately failed by osd.3 2021-11-03T16:59:17.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:17 smithi194 ceph-mon[65619]: osd.5 reported immediately failed by osd.2 2021-11-03T16:59:17.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:17 smithi194 ceph-mon[65619]: osd.5 reported immediately failed by osd.4 2021-11-03T16:59:17.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:17 smithi194 ceph-mon[65619]: osd.5 reported immediately failed by osd.1 2021-11-03T16:59:17.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:17 smithi194 ceph-mon[65619]: osd.5 reported immediately failed by osd.2 2021-11-03T16:59:17.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:17 smithi194 ceph-mon[65619]: osd.5 reported immediately failed by osd.4 2021-11-03T16:59:17.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:17 smithi194 ceph-mon[65619]: osd.5 reported immediately failed by osd.1 2021-11-03T16:59:17.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:17 smithi194 ceph-mon[65619]: osd.5 reported immediately failed by osd.3 2021-11-03T16:59:17.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:17 smithi194 ceph-mon[65619]: osd.5 reported immediately failed by osd.3 2021-11-03T16:59:17.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:17 smithi194 ceph-mon[65619]: osd.5 reported immediately failed by osd.0 2021-11-03T16:59:17.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:17 smithi194 ceph-mon[65619]: osd.5 reported immediately failed by osd.0 2021-11-03T16:59:17.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:17 smithi026 ceph-mon[96795]: osd.5 reported immediately failed by osd.2 2021-11-03T16:59:17.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:17 smithi026 ceph-mon[96795]: osd.5 failed (root=default,host=smithi194) (connection refused reported by osd.2) 2021-11-03T16:59:17.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:17 smithi026 ceph-mon[96795]: osd.5 reported immediately failed by osd.1 2021-11-03T16:59:17.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:17 smithi026 ceph-mon[96795]: osd.5 reported immediately failed by osd.2 2021-11-03T16:59:17.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:17 smithi026 ceph-mon[96795]: osd.5 reported immediately failed by osd.4 2021-11-03T16:59:17.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:17 smithi026 ceph-mon[96795]: osd.5 reported immediately failed by osd.1 2021-11-03T16:59:17.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:17 smithi026 ceph-mon[96795]: osd.5 reported immediately failed by osd.4 2021-11-03T16:59:17.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:17 smithi026 ceph-mon[96795]: osd.5 reported immediately failed by osd.0 2021-11-03T16:59:17.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:17 smithi026 ceph-mon[96795]: osd.5 reported immediately failed by osd.3 2021-11-03T16:59:17.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:17 smithi026 ceph-mon[96795]: osd.5 reported immediately failed by osd.0 2021-11-03T16:59:17.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:17 smithi026 ceph-mon[96795]: osd.5 reported immediately failed by osd.3 2021-11-03T16:59:17.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:17 smithi026 ceph-mon[96795]: osd.5 reported immediately failed by osd.2 2021-11-03T16:59:17.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:17 smithi026 ceph-mon[96795]: osd.5 reported immediately failed by osd.4 2021-11-03T16:59:17.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:17 smithi026 ceph-mon[96795]: osd.5 reported immediately failed by osd.1 2021-11-03T16:59:17.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:17 smithi026 ceph-mon[96795]: osd.5 reported immediately failed by osd.2 2021-11-03T16:59:17.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:17 smithi026 ceph-mon[96795]: osd.5 reported immediately failed by osd.4 2021-11-03T16:59:17.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:17 smithi026 ceph-mon[96795]: osd.5 reported immediately failed by osd.1 2021-11-03T16:59:17.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:17 smithi026 ceph-mon[96795]: osd.5 reported immediately failed by osd.3 2021-11-03T16:59:17.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:17 smithi026 ceph-mon[96795]: osd.5 reported immediately failed by osd.3 2021-11-03T16:59:17.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:17 smithi026 ceph-mon[96795]: osd.5 reported immediately failed by osd.0 2021-11-03T16:59:17.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:17 smithi026 ceph-mon[96795]: osd.5 reported immediately failed by osd.0 2021-11-03T16:59:18.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:18 smithi026 ceph-mon[96795]: pgmap v133: 65 pgs: 6 active+clean+wait, 59 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:59:18.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:18 smithi026 ceph-mon[96795]: Health check failed: 1 osds down (OSD_DOWN) 2021-11-03T16:59:18.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:18 smithi026 ceph-mon[96795]: osdmap e78: 6 total, 5 up, 6 in 2021-11-03T16:59:18.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:18 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:59:18.480 INFO:journalctl@ceph.osd.5.smithi194.stdout:Nov 03 16:59:18 smithi194 systemd[1]: ceph-70492bc6-3cc5-11ec-8c28-001a4aab830c@osd.5.service: Succeeded. 2021-11-03T16:59:18.481 INFO:journalctl@ceph.osd.5.smithi194.stdout:Nov 03 16:59:18 smithi194 systemd[1]: Stopped Ceph osd.5 for 70492bc6-3cc5-11ec-8c28-001a4aab830c. 2021-11-03T16:59:18.481 INFO:journalctl@ceph.osd.5.smithi194.stdout:Nov 03 16:59:18 smithi194 systemd[1]: Starting Ceph osd.5 for 70492bc6-3cc5-11ec-8c28-001a4aab830c... 2021-11-03T16:59:18.481 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:18 smithi194 ceph-mon[65619]: pgmap v133: 65 pgs: 6 active+clean+wait, 59 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:59:18.482 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:18 smithi194 ceph-mon[65619]: Health check failed: 1 osds down (OSD_DOWN) 2021-11-03T16:59:18.482 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:18 smithi194 ceph-mon[65619]: osdmap e78: 6 total, 5 up, 6 in 2021-11-03T16:59:18.482 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:18 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:59:19.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:19 smithi026 ceph-mon[96795]: osdmap e79: 6 total, 5 up, 6 in 2021-11-03T16:59:19.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:19 smithi194 ceph-mon[65619]: osdmap e79: 6 total, 5 up, 6 in 2021-11-03T16:59:19.498 INFO:journalctl@ceph.osd.5.smithi194.stdout:Nov 03 16:59:19 smithi194 bash[78461]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-11-03T16:59:19.498 INFO:journalctl@ceph.osd.5.smithi194.stdout:Nov 03 16:59:19 smithi194 bash[78461]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --dev /dev/mapper/vg_nvme-lv_2 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2021-11-03T16:59:19.498 INFO:journalctl@ceph.osd.5.smithi194.stdout:Nov 03 16:59:19 smithi194 bash[78461]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2021-11-03T16:59:19.499 INFO:journalctl@ceph.osd.5.smithi194.stdout:Nov 03 16:59:19 smithi194 bash[78461]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2021-11-03T16:59:19.499 INFO:journalctl@ceph.osd.5.smithi194.stdout:Nov 03 16:59:19 smithi194 bash[78461]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2021-11-03T16:59:19.499 INFO:journalctl@ceph.osd.5.smithi194.stdout:Nov 03 16:59:19 smithi194 bash[78461]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-11-03T16:59:19.499 INFO:journalctl@ceph.osd.5.smithi194.stdout:Nov 03 16:59:19 smithi194 bash[78461]: --> ceph-volume raw activate successful for osd ID: 5 2021-11-03T16:59:20.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:20 smithi026 ceph-mon[96795]: pgmap v136: 65 pgs: 11 stale+active+clean, 3 peering, 6 active+clean+wait, 45 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:59:20.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:20 smithi026 ceph-mon[96795]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2021-11-03T16:59:20.458 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:20 smithi194 ceph-mon[65619]: pgmap v136: 65 pgs: 11 stale+active+clean, 3 peering, 6 active+clean+wait, 45 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:59:20.458 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:20 smithi194 ceph-mon[65619]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2021-11-03T16:59:20.997 INFO:journalctl@ceph.osd.5.smithi194.stdout:Nov 03 16:59:20 smithi194 ceph-osd[78983]: -- 172.21.15.194:0/270007031 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56110f8aa340 con 0x56110f871000 2021-11-03T16:59:20.997 INFO:journalctl@ceph.osd.5.smithi194.stdout:Nov 03 16:59:20 smithi194 bash[78461]: 8b9b1a31c8900138a61caa1db3fbd289c5d2f78be01b3d95e71dba9fb944c1c8 2021-11-03T16:59:20.998 INFO:journalctl@ceph.osd.5.smithi194.stdout:Nov 03 16:59:20 smithi194 systemd[1]: Started Ceph osd.5 for 70492bc6-3cc5-11ec-8c28-001a4aab830c. 2021-11-03T16:59:21.497 INFO:journalctl@ceph.osd.5.smithi194.stdout:Nov 03 16:59:21 smithi194 conmon[78960]: 2021-11-03T16:59:21.040+0000 7fa8671650c0 -1 Falling back to public interface 2021-11-03T16:59:21.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:21 smithi026 ceph-mon[96795]: pgmap v137: 65 pgs: 22 active+undersized+degraded, 3 peering, 3 active+undersized, 37 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 7412/65073 objects degraded (11.390%) 2021-11-03T16:59:21.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:21 smithi026 ceph-mon[96795]: poll took 6771.960 ms: 1 events 2021-11-03T16:59:21.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:21 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:59:21.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:21 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:59:21.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:21 smithi026 ceph-mon[96795]: Health check failed: Degraded data redundancy: 7412/65073 objects degraded (11.390%), 22 pgs degraded (PG_DEGRADED) 2021-11-03T16:59:21.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:21 smithi194 ceph-mon[65619]: pgmap v137: 65 pgs: 22 active+undersized+degraded, 3 peering, 3 active+undersized, 37 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 7412/65073 objects degraded (11.390%) 2021-11-03T16:59:21.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:21 smithi194 ceph-mon[65619]: poll took 6771.960 ms: 1 events 2021-11-03T16:59:21.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:21 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:59:21.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:21 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:59:21.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:21 smithi194 ceph-mon[65619]: Health check failed: Degraded data redundancy: 7412/65073 objects degraded (11.390%), 22 pgs degraded (PG_DEGRADED) 2021-11-03T16:59:23.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:23 smithi194 ceph-mon[65619]: pgmap v138: 65 pgs: 22 active+undersized+degraded, 3 peering, 3 active+undersized, 37 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 7412/65073 objects degraded (11.390%) 2021-11-03T16:59:23.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:23 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:59:23.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:23 smithi026 ceph-mon[96795]: pgmap v138: 65 pgs: 22 active+undersized+degraded, 3 peering, 3 active+undersized, 37 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 7412/65073 objects degraded (11.390%) 2021-11-03T16:59:23.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:23 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:59:25.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:24 smithi026 ceph-mon[96795]: poll took 2488.690 ms: 1 events 2021-11-03T16:59:25.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:59:25.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:59:25.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:59:25.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:59:25.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:59:25.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:59:25.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:24 smithi026 ceph-mon[96795]: Upgrade: Setting container_image for all osd 2021-11-03T16:59:25.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:59:25.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2021-11-03T16:59:25.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2021-11-03T16:59:25.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2021-11-03T16:59:25.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2021-11-03T16:59:25.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2021-11-03T16:59:25.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2021-11-03T16:59:25.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2021-11-03T16:59:25.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2021-11-03T16:59:25.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2021-11-03T16:59:25.178 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2021-11-03T16:59:25.178 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2021-11-03T16:59:25.178 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2021-11-03T16:59:25.178 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:24 smithi026 ceph-mon[96795]: Upgrade: Setting require_osd_release to 17 quincy 2021-11-03T16:59:25.179 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd require-osd-release", "release": "quincy"}]: dispatch 2021-11-03T16:59:25.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:24 smithi194 ceph-mon[65619]: poll took 2488.690 ms: 1 events 2021-11-03T16:59:25.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:59:25.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T16:59:25.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:59:25.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:59:25.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:59:25.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:59:25.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:24 smithi194 ceph-mon[65619]: Upgrade: Setting container_image for all osd 2021-11-03T16:59:25.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:59:25.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2021-11-03T16:59:25.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2021-11-03T16:59:25.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2021-11-03T16:59:25.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2021-11-03T16:59:25.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2021-11-03T16:59:25.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2021-11-03T16:59:25.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2021-11-03T16:59:25.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2021-11-03T16:59:25.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2021-11-03T16:59:25.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2021-11-03T16:59:25.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2021-11-03T16:59:25.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2021-11-03T16:59:25.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:24 smithi194 ceph-mon[65619]: Upgrade: Setting require_osd_release to 17 quincy 2021-11-03T16:59:25.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd require-osd-release", "release": "quincy"}]: dispatch 2021-11-03T16:59:25.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:25 smithi026 ceph-mon[96795]: pgmap v139: 65 pgs: 25 active+undersized+degraded, 3 active+undersized, 37 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 9480/65073 objects degraded (14.568%) 2021-11-03T16:59:25.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:25 smithi026 ceph-mon[96795]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2021-11-03T16:59:25.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "osd require-osd-release", "release": "quincy"}]': finished 2021-11-03T16:59:25.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:25 smithi026 ceph-mon[96795]: osdmap e80: 6 total, 5 up, 6 in 2021-11-03T16:59:25.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:25 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T16:59:25.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T16:59:25.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:25 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T16:59:26.165 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:25 smithi194 ceph-mon[65619]: pgmap v139: 65 pgs: 25 active+undersized+degraded, 3 active+undersized, 37 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 9480/65073 objects degraded (14.568%) 2021-11-03T16:59:26.165 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:25 smithi194 ceph-mon[65619]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2021-11-03T16:59:26.165 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd='[{"prefix": "osd require-osd-release", "release": "quincy"}]': finished 2021-11-03T16:59:26.166 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:25 smithi194 ceph-mon[65619]: osdmap e80: 6 total, 5 up, 6 in 2021-11-03T16:59:26.166 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:25 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T16:59:26.170 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T16:59:26.170 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:25 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T16:59:26.497 INFO:journalctl@ceph.osd.5.smithi194.stdout:Nov 03 16:59:26 smithi194 conmon[78960]: 2021-11-03T16:59:26.168+0000 7fa8671650c0 -1 osd.5 77 log_to_monitors {default=true} 2021-11-03T16:59:27.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:26 smithi026 ceph-mon[96795]: from='osd.5 [v2:172.21.15.194:6816/1880449894,v1:172.21.15.194:6817/1880449894]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-11-03T16:59:27.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:26 smithi026 ceph-mon[96795]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-11-03T16:59:27.247 INFO:journalctl@ceph.osd.5.smithi194.stdout:Nov 03 16:59:26 smithi194 conmon[78960]: 2021-11-03T16:59:26.822+0000 7fa8572a2700 -1 osd.5 77 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-03T16:59:27.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:26 smithi194 ceph-mon[65619]: from='osd.5 [v2:172.21.15.194:6816/1880449894,v1:172.21.15.194:6817/1880449894]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-11-03T16:59:27.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:26 smithi194 ceph-mon[65619]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-11-03T16:59:27.818 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:27.823+0000 7f77dabd5700 1 -- 172.21.15.26:0/2483419058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77d406a3b0 msgr2=0x7f77d406a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:59:27.819 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:27.823+0000 7f77dabd5700 1 --2- 172.21.15.26:0/2483419058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77d406a3b0 0x7f77d406a830 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f77c0004660 tx=0x7f77c0009b30).stop 2021-11-03T16:59:27.820 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:27.823+0000 7f77dabd5700 1 -- 172.21.15.26:0/2483419058 shutdown_connections 2021-11-03T16:59:27.820 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:27.823+0000 7f77dabd5700 1 --2- 172.21.15.26:0/2483419058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77d406a3b0 0x7f77d406a830 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:59:27.820 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:27.823+0000 7f77dabd5700 1 --2- 172.21.15.26:0/2483419058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77d406b920 0x7f77d4069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:59:27.821 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:27.823+0000 7f77dabd5700 1 -- 172.21.15.26:0/2483419058 >> 172.21.15.26:0/2483419058 conn(0x7f77d40f1f00 msgr2=0x7f77d40f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:59:27.821 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:27.823+0000 7f77dabd5700 1 -- 172.21.15.26:0/2483419058 shutdown_connections 2021-11-03T16:59:27.821 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:27.823+0000 7f77dabd5700 1 -- 172.21.15.26:0/2483419058 wait complete. 2021-11-03T16:59:27.821 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:27.824+0000 7f77dabd5700 1 Processor -- start 2021-11-03T16:59:27.822 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:27.824+0000 7f77dabd5700 1 -- start start 2021-11-03T16:59:27.822 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:27.825+0000 7f77dabd5700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77d406a3b0 0x7f77d410d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:59:27.822 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:27.825+0000 7f77dabd5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77d406b920 0x7f77d410da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:59:27.822 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:27.825+0000 7f77dabd5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d410e030 con 0x7f77d406b920 2021-11-03T16:59:27.822 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:27.825+0000 7f77dabd5700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d410e170 con 0x7f77d406a3b0 2021-11-03T16:59:27.823 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:27.825+0000 7f77d3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77d406b920 0x7f77d410da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:59:27.823 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:27.825+0000 7f77d3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77d406b920 0x7f77d410da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51828/0 (socket says 172.21.15.26:51828) 2021-11-03T16:59:27.823 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:27.825+0000 7f77d3fff700 1 -- 172.21.15.26:0/426404245 learned_addr learned my addr 172.21.15.26:0/426404245 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:59:27.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:27.825+0000 7f77d3fff700 1 -- 172.21.15.26:0/426404245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77d406a3b0 msgr2=0x7f77d410d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:59:27.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:27.825+0000 7f77d3fff700 1 --2- 172.21.15.26:0/426404245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77d406a3b0 0x7f77d410d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T16:59:27.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:27.825+0000 7f77d3fff700 1 -- 172.21.15.26:0/426404245 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c0005040 con 0x7f77d406b920 2021-11-03T16:59:27.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:27.826+0000 7f77d3fff700 1 --2- 172.21.15.26:0/426404245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77d406b920 0x7f77d410da80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f77c0009990 tx=0x7f77c0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:59:27.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:27.826+0000 7f77d17fa700 1 -- 172.21.15.26:0/426404245 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77c0018070 con 0x7f77d406b920 2021-11-03T16:59:27.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:27.826+0000 7f77d17fa700 1 -- 172.21.15.26:0/426404245 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f77c0007ba0 con 0x7f77d406b920 2021-11-03T16:59:27.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:27.826+0000 7f77d17fa700 1 -- 172.21.15.26:0/426404245 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77c001c3c0 con 0x7f77d406b920 2021-11-03T16:59:27.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:27.827+0000 7f77dabd5700 1 -- 172.21.15.26:0/426404245 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d410eab0 con 0x7f77d406b920 2021-11-03T16:59:27.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:27.827+0000 7f77dabd5700 1 -- 172.21.15.26:0/426404245 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d410f010 con 0x7f77d406b920 2021-11-03T16:59:27.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:27.828+0000 7f77dabd5700 1 -- 172.21.15.26:0/426404245 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77d4045ad0 con 0x7f77d406b920 2021-11-03T16:59:27.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:27.829+0000 7f77d17fa700 1 -- 172.21.15.26:0/426404245 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f77c001d420 con 0x7f77d406b920 2021-11-03T16:59:27.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:27.829+0000 7f77d17fa700 1 --2- 172.21.15.26:0/426404245 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f77c40640b0 0x7f77c4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:59:27.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:27.829+0000 7f77d17fa700 1 -- 172.21.15.26:0/426404245 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f77c00825b0 con 0x7f77d406b920 2021-11-03T16:59:27.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:27.829+0000 7f77d8971700 1 --2- 172.21.15.26:0/426404245 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f77c40640b0 0x7f77c4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:59:27.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:27.830+0000 7f77d8971700 1 --2- 172.21.15.26:0/426404245 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f77c40640b0 0x7f77c4066570 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f77d406b6f0 tx=0x7f77c80099e0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:59:27.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:27.834+0000 7f77d17fa700 1 -- 172.21.15.26:0/426404245 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f77c0054910 con 0x7f77d406b920 2021-11-03T16:59:28.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.013+0000 7f77dabd5700 1 -- 172.21.15.26:0/426404245 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f77d410f280 con 0x7f77c40640b0 2021-11-03T16:59:28.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.014+0000 7f77d17fa700 1 -- 172.21.15.26:0/426404245 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f77d410f280 con 0x7f77c40640b0 2021-11-03T16:59:28.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.016+0000 7f77dabd5700 1 -- 172.21.15.26:0/426404245 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f77c40640b0 msgr2=0x7f77c4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:59:28.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.016+0000 7f77dabd5700 1 --2- 172.21.15.26:0/426404245 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f77c40640b0 0x7f77c4066570 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f77d406b6f0 tx=0x7f77c80099e0).stop 2021-11-03T16:59:28.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.016+0000 7f77dabd5700 1 -- 172.21.15.26:0/426404245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77d406b920 msgr2=0x7f77d410da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:59:28.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.016+0000 7f77dabd5700 1 --2- 172.21.15.26:0/426404245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77d406b920 0x7f77d410da80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f77c0009990 tx=0x7f77c0009b30).stop 2021-11-03T16:59:28.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.016+0000 7f77dabd5700 1 -- 172.21.15.26:0/426404245 shutdown_connections 2021-11-03T16:59:28.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.016+0000 7f77dabd5700 1 --2- 172.21.15.26:0/426404245 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f77c40640b0 0x7f77c4066570 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:59:28.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.016+0000 7f77dabd5700 1 --2- 172.21.15.26:0/426404245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77d406a3b0 0x7f77d410d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T16:59:28.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.016+0000 7f77dabd5700 1 --2- 172.21.15.26:0/426404245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77d406b920 0x7f77d410da80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:59:28.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.016+0000 7f77dabd5700 1 -- 172.21.15.26:0/426404245 >> 172.21.15.26:0/426404245 conn(0x7f77d40f1f00 msgr2=0x7f77d40f8960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:59:28.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.016+0000 7f77dabd5700 1 -- 172.21.15.26:0/426404245 shutdown_connections 2021-11-03T16:59:28.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.016+0000 7f77dabd5700 1 -- 172.21.15.26:0/426404245 wait complete. 2021-11-03T16:59:28.021 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T16:59:28.114 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.117+0000 7f4c7e81e700 1 -- 172.21.15.26:0/817260957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c780f55e0 msgr2=0x7f4c780f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:59:28.114 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.117+0000 7f4c7e81e700 1 --2- 172.21.15.26:0/817260957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c780f55e0 0x7f4c780f5a00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f4c68004660 tx=0x7f4c68009b30).stop 2021-11-03T16:59:28.115 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.117+0000 7f4c7e81e700 1 -- 172.21.15.26:0/817260957 shutdown_connections 2021-11-03T16:59:28.115 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.117+0000 7f4c7e81e700 1 --2- 172.21.15.26:0/817260957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c780f5ef0 0x7f4c780f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:59:28.115 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.117+0000 7f4c7e81e700 1 --2- 172.21.15.26:0/817260957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c780f55e0 0x7f4c780f5a00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:59:28.115 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.117+0000 7f4c7e81e700 1 -- 172.21.15.26:0/817260957 >> 172.21.15.26:0/817260957 conn(0x7f4c780f0de0 msgr2=0x7f4c780f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:59:28.116 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.117+0000 7f4c7e81e700 1 -- 172.21.15.26:0/817260957 shutdown_connections 2021-11-03T16:59:28.116 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.117+0000 7f4c7e81e700 1 -- 172.21.15.26:0/817260957 wait complete. 2021-11-03T16:59:28.116 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.117+0000 7f4c7e81e700 1 Processor -- start 2021-11-03T16:59:28.116 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.118+0000 7f4c7e81e700 1 -- start start 2021-11-03T16:59:28.117 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.118+0000 7f4c7e81e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c780f55e0 0x7f4c78109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:59:28.117 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.118+0000 7f4c7e81e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c780f5ef0 0x7f4c7810c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:59:28.117 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.118+0000 7f4c7e81e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c780604e0 con 0x7f4c780f5ef0 2021-11-03T16:59:28.117 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.118+0000 7f4c7e81e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c78060620 con 0x7f4c780f55e0 2021-11-03T16:59:28.117 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.118+0000 7f4c777fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c780f5ef0 0x7f4c7810c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:59:28.118 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.118+0000 7f4c777fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c780f5ef0 0x7f4c7810c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51838/0 (socket says 172.21.15.26:51838) 2021-11-03T16:59:28.118 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.118+0000 7f4c777fe700 1 -- 172.21.15.26:0/4058393588 learned_addr learned my addr 172.21.15.26:0/4058393588 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:59:28.118 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.118+0000 7f4c77fff700 1 --2- 172.21.15.26:0/4058393588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c780f55e0 0x7f4c78109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:59:28.118 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.118+0000 7f4c777fe700 1 -- 172.21.15.26:0/4058393588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c780f55e0 msgr2=0x7f4c78109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:59:28.119 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.118+0000 7f4c777fe700 1 --2- 172.21.15.26:0/4058393588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c780f55e0 0x7f4c78109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:59:28.119 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.118+0000 7f4c777fe700 1 -- 172.21.15.26:0/4058393588 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c68005040 con 0x7f4c780f5ef0 2021-11-03T16:59:28.119 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.118+0000 7f4c777fe700 1 --2- 172.21.15.26:0/4058393588 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c780f5ef0 0x7f4c7810c190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f4c6000c530 tx=0x7f4c60007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:59:28.119 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.119+0000 7f4c74ff9700 1 -- 172.21.15.26:0/4058393588 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c6000f650 con 0x7f4c780f5ef0 2021-11-03T16:59:28.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.119+0000 7f4c74ff9700 1 -- 172.21.15.26:0/4058393588 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4c6000fc60 con 0x7f4c780f5ef0 2021-11-03T16:59:28.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.119+0000 7f4c7e81e700 1 -- 172.21.15.26:0/4058393588 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c7810c740 con 0x7f4c780f5ef0 2021-11-03T16:59:28.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.119+0000 7f4c74ff9700 1 -- 172.21.15.26:0/4058393588 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c60012cd0 con 0x7f4c780f5ef0 2021-11-03T16:59:28.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.119+0000 7f4c7e81e700 1 -- 172.21.15.26:0/4058393588 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c7810cd00 con 0x7f4c780f5ef0 2021-11-03T16:59:28.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.120+0000 7f4c7e81e700 1 -- 172.21.15.26:0/4058393588 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c78045ad0 con 0x7f4c780f5ef0 2021-11-03T16:59:28.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.120+0000 7f4c74ff9700 1 -- 172.21.15.26:0/4058393588 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f4c60010070 con 0x7f4c780f5ef0 2021-11-03T16:59:28.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.120+0000 7f4c74ff9700 1 --2- 172.21.15.26:0/4058393588 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4c64064090 0x7f4c64066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:59:28.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.120+0000 7f4c74ff9700 1 -- 172.21.15.26:0/4058393588 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f4c600806e0 con 0x7f4c780f5ef0 2021-11-03T16:59:28.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.120+0000 7f4c77fff700 1 --2- 172.21.15.26:0/4058393588 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4c64064090 0x7f4c64066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:59:28.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.121+0000 7f4c77fff700 1 --2- 172.21.15.26:0/4058393588 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4c64064090 0x7f4c64066550 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f4c68013690 tx=0x7f4c68009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:59:28.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.124+0000 7f4c74ff9700 1 -- 172.21.15.26:0/4058393588 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f4c60052950 con 0x7f4c780f5ef0 2021-11-03T16:59:28.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:27 smithi026 ceph-mon[96795]: pgmap v141: 65 pgs: 25 active+undersized+degraded, 3 active+undersized, 37 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 9480/65073 objects degraded (14.568%) 2021-11-03T16:59:28.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:27 smithi026 ceph-mon[96795]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-11-03T16:59:28.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:27 smithi026 ceph-mon[96795]: osdmap e81: 6 total, 5 up, 6 in 2021-11-03T16:59:28.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:27 smithi026 ceph-mon[96795]: from='osd.5 [v2:172.21.15.194:6816/1880449894,v1:172.21.15.194:6817/1880449894]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2021-11-03T16:59:28.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:27 smithi026 ceph-mon[96795]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2021-11-03T16:59:28.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:27 smithi194 ceph-mon[65619]: pgmap v141: 65 pgs: 25 active+undersized+degraded, 3 active+undersized, 37 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 9480/65073 objects degraded (14.568%) 2021-11-03T16:59:28.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:27 smithi194 ceph-mon[65619]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-11-03T16:59:28.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:27 smithi194 ceph-mon[65619]: osdmap e81: 6 total, 5 up, 6 in 2021-11-03T16:59:28.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:27 smithi194 ceph-mon[65619]: from='osd.5 [v2:172.21.15.194:6816/1880449894,v1:172.21.15.194:6817/1880449894]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2021-11-03T16:59:28.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:27 smithi194 ceph-mon[65619]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2021-11-03T16:59:28.294 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.299+0000 7f4c7e81e700 1 -- 172.21.15.26:0/4058393588 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c780fdf40 con 0x7f4c64064090 2021-11-03T16:59:28.308 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.314+0000 7f4c74ff9700 1 -- 172.21.15.26:0/4058393588 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f4c780fdf40 con 0x7f4c64064090 2021-11-03T16:59:28.309 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T16:59:28.309 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (10m) 84s ago 11m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T16:59:28.309 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (2m) 84s ago 11m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T16:59:28.310 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (2m) 4s ago 11m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T16:59:28.310 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (10m) 84s ago 11m 38.9M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T16:59:28.310 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (3m) 84s ago 7m 13.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T16:59:28.310 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (4m) 84s ago 6m 14.7M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T16:59:28.311 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (7m) 4s ago 7m 16.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T16:59:28.311 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (7m) 4s ago 7m 16.5M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T16:59:28.311 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (4m) 84s ago 13m 468M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T16:59:28.311 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (4m) 4s ago 11m 412M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T16:59:28.311 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (3m) 84s ago 13m 75.8M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T16:59:28.312 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (3m) 4s ago 11m 66.4M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T16:59:28.312 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (11m) 84s ago 11m 18.1M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T16:59:28.312 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (10m) 4s ago 10m 18.3M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T16:59:28.312 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (2m) 84s ago 10m 153M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T16:59:28.313 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (2m) 84s ago 9m 166M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T16:59:28.313 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (90s) 84s ago 9m 11.2M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T16:59:28.313 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (61s) 4s ago 9m 181M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T16:59:28.313 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (34s) 4s ago 8m 185M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T16:59:28.314 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (8s) 4s ago 8m 13.5M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T16:59:28.314 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (10m) 84s ago 11m 47.5M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T16:59:28.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.315+0000 7f4c7e81e700 1 -- 172.21.15.26:0/4058393588 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4c64064090 msgr2=0x7f4c64066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:59:28.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.315+0000 7f4c7e81e700 1 --2- 172.21.15.26:0/4058393588 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4c64064090 0x7f4c64066550 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f4c68013690 tx=0x7f4c68009b30).stop 2021-11-03T16:59:28.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.315+0000 7f4c7e81e700 1 -- 172.21.15.26:0/4058393588 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c780f5ef0 msgr2=0x7f4c7810c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:59:28.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.315+0000 7f4c7e81e700 1 --2- 172.21.15.26:0/4058393588 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c780f5ef0 0x7f4c7810c190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f4c6000c530 tx=0x7f4c60007e20).stop 2021-11-03T16:59:28.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.315+0000 7f4c7e81e700 1 -- 172.21.15.26:0/4058393588 shutdown_connections 2021-11-03T16:59:28.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.315+0000 7f4c7e81e700 1 --2- 172.21.15.26:0/4058393588 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4c64064090 0x7f4c64066550 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:59:28.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.315+0000 7f4c7e81e700 1 --2- 172.21.15.26:0/4058393588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c780f55e0 0x7f4c78109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:59:28.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.315+0000 7f4c7e81e700 1 --2- 172.21.15.26:0/4058393588 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c780f5ef0 0x7f4c7810c190 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:59:28.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.315+0000 7f4c7e81e700 1 -- 172.21.15.26:0/4058393588 >> 172.21.15.26:0/4058393588 conn(0x7f4c780f0de0 msgr2=0x7f4c780fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:59:28.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.316+0000 7f4c7e81e700 1 -- 172.21.15.26:0/4058393588 shutdown_connections 2021-11-03T16:59:28.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.316+0000 7f4c7e81e700 1 -- 172.21.15.26:0/4058393588 wait complete. 2021-11-03T16:59:28.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.415+0000 7fb11d8a3700 1 -- 172.21.15.26:0/1430906100 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1180f77f0 msgr2=0x7fb1180f7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:59:28.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.415+0000 7fb11d8a3700 1 --2- 172.21.15.26:0/1430906100 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1180f77f0 0x7fb1180f7c50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fb10c004660 tx=0x7fb10c009b30).stop 2021-11-03T16:59:28.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.415+0000 7fb11d8a3700 1 -- 172.21.15.26:0/1430906100 shutdown_connections 2021-11-03T16:59:28.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.415+0000 7fb11d8a3700 1 --2- 172.21.15.26:0/1430906100 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1180f77f0 0x7fb1180f7c50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:59:28.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.415+0000 7fb11d8a3700 1 --2- 172.21.15.26:0/1430906100 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1180f6550 0x7fb1180f6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T16:59:28.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.415+0000 7fb11d8a3700 1 -- 172.21.15.26:0/1430906100 >> 172.21.15.26:0/1430906100 conn(0x7fb1180f1cd0 msgr2=0x7fb1180f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:59:28.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.415+0000 7fb11d8a3700 1 -- 172.21.15.26:0/1430906100 shutdown_connections 2021-11-03T16:59:28.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.415+0000 7fb11d8a3700 1 -- 172.21.15.26:0/1430906100 wait complete. 2021-11-03T16:59:28.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.416+0000 7fb11d8a3700 1 Processor -- start 2021-11-03T16:59:28.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.416+0000 7fb11d8a3700 1 -- start start 2021-11-03T16:59:28.600 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.416+0000 7fb11d8a3700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1180f6550 0x7fb118106e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:59:28.600 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.416+0000 7fb11d8a3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1180f77f0 0x7fb118107300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:59:28.600 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.416+0000 7fb11d8a3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb118107990 con 0x7fb1180f77f0 2021-11-03T16:59:28.600 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.416+0000 7fb11d8a3700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb118108110 con 0x7fb1180f6550 2021-11-03T16:59:28.601 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.416+0000 7fb1167fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1180f77f0 0x7fb118107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:59:28.602 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.416+0000 7fb1167fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1180f77f0 0x7fb118107300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51848/0 (socket says 172.21.15.26:51848) 2021-11-03T16:59:28.603 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.416+0000 7fb1167fc700 1 -- 172.21.15.26:0/2550580303 learned_addr learned my addr 172.21.15.26:0/2550580303 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:59:28.603 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.416+0000 7fb116ffd700 1 --2- 172.21.15.26:0/2550580303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1180f6550 0x7fb118106e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:59:28.603 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.417+0000 7fb1167fc700 1 -- 172.21.15.26:0/2550580303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1180f6550 msgr2=0x7fb118106e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:59:28.603 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.417+0000 7fb1167fc700 1 --2- 172.21.15.26:0/2550580303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1180f6550 0x7fb118106e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:59:28.604 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.417+0000 7fb1167fc700 1 -- 172.21.15.26:0/2550580303 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb10c005040 con 0x7fb1180f77f0 2021-11-03T16:59:28.604 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.417+0000 7fb1167fc700 1 --2- 172.21.15.26:0/2550580303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1180f77f0 0x7fb118107300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fb10c009990 tx=0x7fb10c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:59:28.604 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.417+0000 7fb0ff7fe700 1 -- 172.21.15.26:0/2550580303 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb10c018070 con 0x7fb1180f77f0 2021-11-03T16:59:28.604 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.417+0000 7fb0ff7fe700 1 -- 172.21.15.26:0/2550580303 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb10c007ca0 con 0x7fb1180f77f0 2021-11-03T16:59:28.605 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.417+0000 7fb11d8a3700 1 -- 172.21.15.26:0/2550580303 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb118108330 con 0x7fb1180f77f0 2021-11-03T16:59:28.605 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.417+0000 7fb0ff7fe700 1 -- 172.21.15.26:0/2550580303 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb10c01c620 con 0x7fb1180f77f0 2021-11-03T16:59:28.605 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.417+0000 7fb11d8a3700 1 -- 172.21.15.26:0/2550580303 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb118108890 con 0x7fb1180f77f0 2021-11-03T16:59:28.605 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.418+0000 7fb11d8a3700 1 -- 172.21.15.26:0/2550580303 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb118045ad0 con 0x7fb1180f77f0 2021-11-03T16:59:28.605 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.418+0000 7fb0ff7fe700 1 -- 172.21.15.26:0/2550580303 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fb10c01d960 con 0x7fb1180f77f0 2021-11-03T16:59:28.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.419+0000 7fb0ff7fe700 1 --2- 172.21.15.26:0/2550580303 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb100064100 0x7fb1000665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:59:28.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.419+0000 7fb0ff7fe700 1 -- 172.21.15.26:0/2550580303 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fb10c082480 con 0x7fb1180f77f0 2021-11-03T16:59:28.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.419+0000 7fb116ffd700 1 --2- 172.21.15.26:0/2550580303 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb100064100 0x7fb1000665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:59:28.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.419+0000 7fb116ffd700 1 --2- 172.21.15.26:0/2550580303 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb100064100 0x7fb1000665c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fb118106b80 tx=0x7fb108008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:59:28.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.423+0000 7fb0ff7fe700 1 -- 172.21.15.26:0/2550580303 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fb10c0548a0 con 0x7fb1180f77f0 2021-11-03T16:59:28.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.653+0000 7fb11d8a3700 1 -- 172.21.15.26:0/2550580303 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb118027a00 con 0x7fb1180f77f0 2021-11-03T16:59:28.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.654+0000 7fb0ff7fe700 1 -- 172.21.15.26:0/2550580303 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fb10c054490 con 0x7fb1180f77f0 2021-11-03T16:59:28.650 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T16:59:28.650 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T16:59:28.650 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T16:59:28.651 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:59:28.651 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T16:59:28.652 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T16:59:28.652 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:59:28.652 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T16:59:28.653 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T16:59:28.653 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:59:28.653 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T16:59:28.653 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T16:59:28.653 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:59:28.654 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T16:59:28.654 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T16:59:28.654 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T16:59:28.655 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T16:59:28.655 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T16:59:28.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.656+0000 7fb11d8a3700 1 -- 172.21.15.26:0/2550580303 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb100064100 msgr2=0x7fb1000665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:59:28.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.656+0000 7fb11d8a3700 1 --2- 172.21.15.26:0/2550580303 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb100064100 0x7fb1000665c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fb118106b80 tx=0x7fb108008040).stop 2021-11-03T16:59:28.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.656+0000 7fb11d8a3700 1 -- 172.21.15.26:0/2550580303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1180f77f0 msgr2=0x7fb118107300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:59:28.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.656+0000 7fb11d8a3700 1 --2- 172.21.15.26:0/2550580303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1180f77f0 0x7fb118107300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fb10c009990 tx=0x7fb10c009b30).stop 2021-11-03T16:59:28.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.656+0000 7fb11d8a3700 1 -- 172.21.15.26:0/2550580303 shutdown_connections 2021-11-03T16:59:28.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.656+0000 7fb11d8a3700 1 --2- 172.21.15.26:0/2550580303 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb100064100 0x7fb1000665c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:59:28.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.656+0000 7fb11d8a3700 1 --2- 172.21.15.26:0/2550580303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1180f6550 0x7fb118106e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:59:28.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.656+0000 7fb11d8a3700 1 --2- 172.21.15.26:0/2550580303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1180f77f0 0x7fb118107300 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:59:28.658 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.656+0000 7fb11d8a3700 1 -- 172.21.15.26:0/2550580303 >> 172.21.15.26:0/2550580303 conn(0x7fb1180f1cd0 msgr2=0x7fb1180fb240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:59:28.658 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.656+0000 7fb11d8a3700 1 -- 172.21.15.26:0/2550580303 shutdown_connections 2021-11-03T16:59:28.658 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.656+0000 7fb11d8a3700 1 -- 172.21.15.26:0/2550580303 wait complete. 2021-11-03T16:59:28.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.757+0000 7f6985b55700 1 -- 172.21.15.26:0/1016276651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69800f5440 msgr2=0x7f69800f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:59:28.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.757+0000 7f6985b55700 1 --2- 172.21.15.26:0/1016276651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69800f5440 0x7f69800f5860 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f6974004660 tx=0x7f6974009b30).stop 2021-11-03T16:59:28.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.757+0000 7f6985b55700 1 -- 172.21.15.26:0/1016276651 shutdown_connections 2021-11-03T16:59:28.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.757+0000 7f6985b55700 1 --2- 172.21.15.26:0/1016276651 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69800f66e0 0x7f69800f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T16:59:28.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.757+0000 7f6985b55700 1 --2- 172.21.15.26:0/1016276651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69800f5440 0x7f69800f5860 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:59:28.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.757+0000 7f6985b55700 1 -- 172.21.15.26:0/1016276651 >> 172.21.15.26:0/1016276651 conn(0x7f69800f0ba0 msgr2=0x7f69800f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:59:28.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.757+0000 7f6985b55700 1 -- 172.21.15.26:0/1016276651 shutdown_connections 2021-11-03T16:59:28.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.757+0000 7f6985b55700 1 -- 172.21.15.26:0/1016276651 wait complete. 2021-11-03T16:59:28.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.758+0000 7f6985b55700 1 Processor -- start 2021-11-03T16:59:28.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.758+0000 7f6985b55700 1 -- start start 2021-11-03T16:59:28.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.758+0000 7f6985b55700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69800f5440 0x7f6980108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:59:28.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.758+0000 7f6985b55700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69800f66e0 0x7f6980109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:59:28.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.758+0000 7f6985b55700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6980109a90 con 0x7f69800f66e0 2021-11-03T16:59:28.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.758+0000 7f6985b55700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698010a340 con 0x7f69800f5440 2021-11-03T16:59:28.757 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.758+0000 7f697ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69800f66e0 0x7f6980109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:59:28.757 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.758+0000 7f697ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69800f66e0 0x7f6980109450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51860/0 (socket says 172.21.15.26:51860) 2021-11-03T16:59:28.757 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.758+0000 7f697ffff700 1 -- 172.21.15.26:0/2161411784 learned_addr learned my addr 172.21.15.26:0/2161411784 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:59:28.759 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.759+0000 7f697ffff700 1 -- 172.21.15.26:0/2161411784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69800f5440 msgr2=0x7f6980108f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:59:28.759 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.759+0000 7f697ffff700 1 --2- 172.21.15.26:0/2161411784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69800f5440 0x7f6980108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T16:59:28.759 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.759+0000 7f697ffff700 1 -- 172.21.15.26:0/2161411784 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6974005040 con 0x7f69800f66e0 2021-11-03T16:59:28.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.759+0000 7f697ffff700 1 --2- 172.21.15.26:0/2161411784 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69800f66e0 0x7f6980109450 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f696c00b410 tx=0x7f696c006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:59:28.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.759+0000 7f697d7fa700 1 -- 172.21.15.26:0/2161411784 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f696c0125f0 con 0x7f69800f66e0 2021-11-03T16:59:28.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.759+0000 7f6985b55700 1 -- 172.21.15.26:0/2161411784 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f698010a620 con 0x7f69800f66e0 2021-11-03T16:59:28.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.759+0000 7f697d7fa700 1 -- 172.21.15.26:0/2161411784 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f696c012c00 con 0x7f69800f66e0 2021-11-03T16:59:28.761 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.759+0000 7f697d7fa700 1 -- 172.21.15.26:0/2161411784 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f696c002ae0 con 0x7f69800f66e0 2021-11-03T16:59:28.761 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.759+0000 7f6985b55700 1 -- 172.21.15.26:0/2161411784 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f698010abe0 con 0x7f69800f66e0 2021-11-03T16:59:28.761 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.760+0000 7f6985b55700 1 -- 172.21.15.26:0/2161411784 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6980059100 con 0x7f69800f66e0 2021-11-03T16:59:28.761 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.760+0000 7f697d7fa700 1 -- 172.21.15.26:0/2161411784 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f696c00f030 con 0x7f69800f66e0 2021-11-03T16:59:28.762 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.761+0000 7f697d7fa700 1 --2- 172.21.15.26:0/2161411784 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6970064100 0x7f69700665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:59:28.762 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.761+0000 7f697d7fa700 1 -- 172.21.15.26:0/2161411784 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f696c080c80 con 0x7f69800f66e0 2021-11-03T16:59:28.762 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.761+0000 7f6984b53700 1 --2- 172.21.15.26:0/2161411784 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6970064100 0x7f69700665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:59:28.762 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.761+0000 7f6984b53700 1 --2- 172.21.15.26:0/2161411784 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6970064100 0x7f69700665c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f6974009f50 tx=0x7f6974009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:59:28.763 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.765+0000 7f697d7fa700 1 -- 172.21.15.26:0/2161411784 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f696c052fe0 con 0x7f69800f66e0 2021-11-03T16:59:28.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.978+0000 7f6985b55700 1 -- 172.21.15.26:0/2161411784 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f698010f580 con 0x7f69800f66e0 2021-11-03T16:59:28.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.978+0000 7f697d7fa700 1 -- 172.21.15.26:0/2161411784 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f696c002d50 con 0x7f69800f66e0 2021-11-03T16:59:28.974 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T16:59:28.974 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T16:59:28.975 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T16:59:28.975 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T16:59:28.975 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:59:28.975 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T16:59:28.975 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T16:59:28.976 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T16:59:28.976 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T16:59:28.976 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T16:59:28.976 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T16:59:28.977 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T16:59:28.977 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T16:59:28.977 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T16:59:28.977 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T16:59:28.978 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T16:59:28.978 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T16:59:28.978 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T16:59:28.978 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T16:59:28.979 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T16:59:28.979 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T16:59:28.979 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T16:59:28.979 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T16:59:28.980 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T16:59:28.980 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T16:59:28.980 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T16:59:28.980 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T16:59:28.981 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T16:59:28.981 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T16:59:28.981 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T16:59:28.981 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T16:59:28.981 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:59:28.982 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:59:28.982 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T16:59:28.982 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T16:59:28.982 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T16:59:28.983 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T16:59:28.983 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T16:59:28.983 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T16:59:28.984 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.980+0000 7f6985b55700 1 -- 172.21.15.26:0/2161411784 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6970064100 msgr2=0x7f69700665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:59:28.984 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.980+0000 7f6985b55700 1 --2- 172.21.15.26:0/2161411784 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6970064100 0x7f69700665c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f6974009f50 tx=0x7f6974009b30).stop 2021-11-03T16:59:28.984 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.980+0000 7f6985b55700 1 -- 172.21.15.26:0/2161411784 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69800f66e0 msgr2=0x7f6980109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:59:28.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.980+0000 7f6985b55700 1 --2- 172.21.15.26:0/2161411784 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69800f66e0 0x7f6980109450 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f696c00b410 tx=0x7f696c006ef0).stop 2021-11-03T16:59:28.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.980+0000 7f6985b55700 1 -- 172.21.15.26:0/2161411784 shutdown_connections 2021-11-03T16:59:28.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.980+0000 7f6985b55700 1 --2- 172.21.15.26:0/2161411784 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6970064100 0x7f69700665c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:59:28.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.980+0000 7f6985b55700 1 --2- 172.21.15.26:0/2161411784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69800f5440 0x7f6980108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T16:59:28.986 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.980+0000 7f6985b55700 1 --2- 172.21.15.26:0/2161411784 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69800f66e0 0x7f6980109450 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:59:28.986 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.980+0000 7f6985b55700 1 -- 172.21.15.26:0/2161411784 >> 172.21.15.26:0/2161411784 conn(0x7f69800f0ba0 msgr2=0x7f698005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:59:28.986 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.980+0000 7f6985b55700 1 -- 172.21.15.26:0/2161411784 shutdown_connections 2021-11-03T16:59:28.986 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:28.980+0000 7f6985b55700 1 -- 172.21.15.26:0/2161411784 wait complete. 2021-11-03T16:59:28.986 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T16:59:29.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:28 smithi026 ceph-mon[96795]: Health check cleared: OSD_DOWN (was: 1 osds down) 2021-11-03T16:59:29.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:28 smithi026 ceph-mon[96795]: osd.5 [v2:172.21.15.194:6816/1880449894,v1:172.21.15.194:6817/1880449894] boot 2021-11-03T16:59:29.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:28 smithi026 ceph-mon[96795]: osdmap e82: 6 total, 6 up, 6 in 2021-11-03T16:59:29.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-11-03T16:59:29.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:28 smithi026 ceph-mon[96795]: from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:59:29.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:59:29.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:28 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2550580303' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:59:29.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:28 smithi026 ceph-mon[96795]: Health check update: Degraded data redundancy: 9480/65073 objects degraded (14.568%), 25 pgs degraded (PG_DEGRADED) 2021-11-03T16:59:29.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:28 smithi026 ceph-mon[96795]: osdmap e83: 6 total, 6 up, 6 in 2021-11-03T16:59:29.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:28 smithi194 ceph-mon[65619]: Health check cleared: OSD_DOWN (was: 1 osds down) 2021-11-03T16:59:29.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:28 smithi194 ceph-mon[65619]: osd.5 [v2:172.21.15.194:6816/1880449894,v1:172.21.15.194:6817/1880449894] boot 2021-11-03T16:59:29.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:28 smithi194 ceph-mon[65619]: osdmap e82: 6 total, 6 up, 6 in 2021-11-03T16:59:29.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-11-03T16:59:29.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:28 smithi194 ceph-mon[65619]: from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:59:29.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:59:29.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:28 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2550580303' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T16:59:29.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:28 smithi194 ceph-mon[65619]: Health check update: Degraded data redundancy: 9480/65073 objects degraded (14.568%), 25 pgs degraded (PG_DEGRADED) 2021-11-03T16:59:29.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:28 smithi194 ceph-mon[65619]: osdmap e83: 6 total, 6 up, 6 in 2021-11-03T16:59:30.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:29 smithi026 ceph-mon[96795]: from='client.34280 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:59:30.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:29 smithi026 ceph-mon[96795]: pgmap v144: 65 pgs: 1 peering, 24 active+undersized+degraded, 3 active+undersized, 37 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 8811/65073 objects degraded (13.540%) 2021-11-03T16:59:30.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:29 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2161411784' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T16:59:30.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:29 smithi194 ceph-mon[65619]: from='client.34280 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T16:59:30.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:29 smithi194 ceph-mon[65619]: pgmap v144: 65 pgs: 1 peering, 24 active+undersized+degraded, 3 active+undersized, 37 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 8811/65073 objects degraded (13.540%) 2021-11-03T16:59:30.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:29 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2161411784' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T16:59:32.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:31 smithi026 ceph-mon[96795]: pgmap v146: 65 pgs: 1 peering, 10 active+undersized+degraded, 3 active+undersized, 51 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 5430/65073 objects degraded (8.344%) 2021-11-03T16:59:32.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:31 smithi194 ceph-mon[65619]: pgmap v146: 65 pgs: 1 peering, 10 active+undersized+degraded, 3 active+undersized, 51 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 5430/65073 objects degraded (8.344%) 2021-11-03T16:59:33.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:32 smithi026 ceph-mon[96795]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 5430/65073 objects degraded (8.344%), 10 pgs degraded) 2021-11-03T16:59:33.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:32 smithi194 ceph-mon[65619]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 5430/65073 objects degraded (8.344%), 10 pgs degraded) 2021-11-03T16:59:34.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:34 smithi026 ceph-mon[96795]: pgmap v147: 65 pgs: 13 active+clean+wait, 1 peering, 51 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:59:34.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:34 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:59:34.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:34 smithi194 ceph-mon[65619]: pgmap v147: 65 pgs: 13 active+clean+wait, 1 peering, 51 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:59:34.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:34 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:59:36.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:36 smithi026 ceph-mon[96795]: pgmap v148: 65 pgs: 13 active+clean+wait, 52 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:59:36.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:36 smithi194 ceph-mon[65619]: pgmap v148: 65 pgs: 13 active+clean+wait, 52 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:59:38.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:38 smithi026 ceph-mon[96795]: pgmap v149: 65 pgs: 13 active+clean+wait, 52 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:59:38.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:38 smithi194 ceph-mon[65619]: pgmap v149: 65 pgs: 13 active+clean+wait, 52 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:59:39.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:59:39.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:39 smithi026 ceph-mon[96795]: pgmap v150: 65 pgs: 13 active+clean+wait, 52 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:59:39.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T16:59:39.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:39 smithi194 ceph-mon[65619]: pgmap v150: 65 pgs: 13 active+clean+wait, 52 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:59:40.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T16:59:40.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:40 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T16:59:40.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T16:59:40.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:40 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T16:59:41.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:41 smithi026 ceph-mon[96795]: pgmap v151: 65 pgs: 13 active+clean+wait, 52 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:59:41.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:41 smithi194 ceph-mon[65619]: pgmap v151: 65 pgs: 13 active+clean+wait, 52 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:59:43.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:43 smithi026 ceph-mon[96795]: pgmap v152: 65 pgs: 13 active+clean+wait, 52 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:59:43.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:43 smithi194 ceph-mon[65619]: pgmap v152: 65 pgs: 13 active+clean+wait, 52 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:59:45.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:45 smithi026 ceph-mon[96795]: pgmap v153: 65 pgs: 13 active+clean+wait, 52 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:59:45.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:45 smithi194 ceph-mon[65619]: pgmap v153: 65 pgs: 13 active+clean+wait, 52 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:59:47.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:47 smithi194 ceph-mon[65619]: pgmap v154: 65 pgs: 13 active+clean+wait, 52 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:59:48.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:47 smithi026 ceph-mon[96795]: pgmap v154: 65 pgs: 13 active+clean+wait, 52 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:59:48.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T16:59:48.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T16:59:49.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T16:59:49.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T16:59:49.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:49 smithi194 ceph-mon[65619]: pgmap v155: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:59:50.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:49 smithi026 ceph-mon[96795]: pgmap v155: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:59:51.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:51 smithi194 ceph-mon[65619]: pgmap v156: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:59:52.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:51 smithi026 ceph-mon[96795]: pgmap v156: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:59:53.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:53 smithi194 ceph-mon[65619]: pgmap v157: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:59:54.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:53 smithi026 ceph-mon[96795]: pgmap v157: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:59:55.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:55 smithi026 ceph-mon[96795]: pgmap v158: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:59:55.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T16:59:55.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:55 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T16:59:55.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:55 smithi194 ceph-mon[65619]: pgmap v158: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:59:55.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T16:59:55.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:55 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T16:59:57.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:57 smithi194 ceph-mon[65619]: pgmap v159: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:59:58.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:57 smithi026 ceph-mon[96795]: pgmap v159: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:59:59.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.095+0000 7f12064b4700 1 -- 172.21.15.26:0/2486199754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12000f66e0 msgr2=0x7f12000f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:59:59.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.095+0000 7f12064b4700 1 --2- 172.21.15.26:0/2486199754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12000f66e0 0x7f12000f6b00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f11f4004660 tx=0x7f11f4009b30).stop 2021-11-03T16:59:59.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.095+0000 7f12064b4700 1 -- 172.21.15.26:0/2486199754 shutdown_connections 2021-11-03T16:59:59.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.095+0000 7f12064b4700 1 --2- 172.21.15.26:0/2486199754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12000f6ff0 0x7f12000f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:59:59.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.095+0000 7f12064b4700 1 --2- 172.21.15.26:0/2486199754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12000f66e0 0x7f12000f6b00 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:59:59.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.095+0000 7f12064b4700 1 -- 172.21.15.26:0/2486199754 >> 172.21.15.26:0/2486199754 conn(0x7f12000f1f00 msgr2=0x7f12000f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:59:59.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.095+0000 7f12064b4700 1 -- 172.21.15.26:0/2486199754 shutdown_connections 2021-11-03T16:59:59.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.095+0000 7f12064b4700 1 -- 172.21.15.26:0/2486199754 wait complete. 2021-11-03T16:59:59.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.095+0000 7f12064b4700 1 Processor -- start 2021-11-03T16:59:59.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.096+0000 7f12064b4700 1 -- start start 2021-11-03T16:59:59.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.096+0000 7f12064b4700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12000f66e0 0x7f1200106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:59:59.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.096+0000 7f12064b4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12000f6ff0 0x7f1200107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:59:59.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.096+0000 7f12064b4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1200107a00 con 0x7f12000f6ff0 2021-11-03T16:59:59.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.096+0000 7f12064b4700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1200107b40 con 0x7f12000f66e0 2021-11-03T16:59:59.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.096+0000 7f11ff7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12000f6ff0 0x7f1200107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:59:59.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.096+0000 7f11ff7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12000f6ff0 0x7f1200107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51878/0 (socket says 172.21.15.26:51878) 2021-11-03T16:59:59.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.096+0000 7f11ff7fe700 1 -- 172.21.15.26:0/3449565536 learned_addr learned my addr 172.21.15.26:0/3449565536 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:59:59.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.096+0000 7f11fffff700 1 --2- 172.21.15.26:0/3449565536 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12000f66e0 0x7f1200106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:59:59.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.096+0000 7f11ff7fe700 1 -- 172.21.15.26:0/3449565536 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12000f66e0 msgr2=0x7f1200106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:59:59.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.096+0000 7f11ff7fe700 1 --2- 172.21.15.26:0/3449565536 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12000f66e0 0x7f1200106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:59:59.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.096+0000 7f11ff7fe700 1 -- 172.21.15.26:0/3449565536 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f4005040 con 0x7f12000f6ff0 2021-11-03T16:59:59.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.097+0000 7f11ff7fe700 1 --2- 172.21.15.26:0/3449565536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12000f6ff0 0x7f1200107450 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f11f000c530 tx=0x7f11f0007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:59:59.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.097+0000 7f11fcff9700 1 -- 172.21.15.26:0/3449565536 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11f000f650 con 0x7f12000f6ff0 2021-11-03T16:59:59.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.097+0000 7f11fcff9700 1 -- 172.21.15.26:0/3449565536 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f11f000fc60 con 0x7f12000f6ff0 2021-11-03T16:59:59.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.097+0000 7f12064b4700 1 -- 172.21.15.26:0/3449565536 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12001084e0 con 0x7f12000f6ff0 2021-11-03T16:59:59.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.097+0000 7f11fcff9700 1 -- 172.21.15.26:0/3449565536 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11f0012c20 con 0x7f12000f6ff0 2021-11-03T16:59:59.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.097+0000 7f12064b4700 1 -- 172.21.15.26:0/3449565536 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1200108aa0 con 0x7f12000f6ff0 2021-11-03T16:59:59.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.098+0000 7f12064b4700 1 -- 172.21.15.26:0/3449565536 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1200045ad0 con 0x7f12000f6ff0 2021-11-03T16:59:59.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.098+0000 7f11fcff9700 1 -- 172.21.15.26:0/3449565536 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f11f0010070 con 0x7f12000f6ff0 2021-11-03T16:59:59.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.099+0000 7f11fcff9700 1 --2- 172.21.15.26:0/3449565536 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f11e80640b0 0x7f11e8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:59:59.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.099+0000 7f11fcff9700 1 -- 172.21.15.26:0/3449565536 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f11f0080720 con 0x7f12000f6ff0 2021-11-03T16:59:59.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.099+0000 7f11fffff700 1 --2- 172.21.15.26:0/3449565536 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f11e80640b0 0x7f11e8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:59:59.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.099+0000 7f11fffff700 1 --2- 172.21.15.26:0/3449565536 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f11e80640b0 0x7f11e8066570 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f11f4004630 tx=0x7f11f4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:59:59.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.103+0000 7f11fcff9700 1 -- 172.21.15.26:0/3449565536 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f11f00528d0 con 0x7f12000f6ff0 2021-11-03T16:59:59.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.282+0000 7f12064b4700 1 -- 172.21.15.26:0/3449565536 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f12000ff080 con 0x7f11e80640b0 2021-11-03T16:59:59.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.283+0000 7f11fcff9700 1 -- 172.21.15.26:0/3449565536 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f11f4019040 con 0x7f11e80640b0 2021-11-03T16:59:59.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.285+0000 7f12064b4700 1 -- 172.21.15.26:0/3449565536 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f11e80640b0 msgr2=0x7f11e8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:59:59.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.285+0000 7f12064b4700 1 --2- 172.21.15.26:0/3449565536 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f11e80640b0 0x7f11e8066570 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f11f4004630 tx=0x7f11f4009b30).stop 2021-11-03T16:59:59.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.285+0000 7f12064b4700 1 -- 172.21.15.26:0/3449565536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12000f6ff0 msgr2=0x7f1200107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:59:59.282 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.285+0000 7f12064b4700 1 --2- 172.21.15.26:0/3449565536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12000f6ff0 0x7f1200107450 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f11f000c530 tx=0x7f11f0007e20).stop 2021-11-03T16:59:59.282 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.285+0000 7f12064b4700 1 -- 172.21.15.26:0/3449565536 shutdown_connections 2021-11-03T16:59:59.282 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.285+0000 7f12064b4700 1 --2- 172.21.15.26:0/3449565536 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f11e80640b0 0x7f11e8066570 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:59:59.282 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.285+0000 7f12064b4700 1 --2- 172.21.15.26:0/3449565536 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12000f66e0 0x7f1200106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:59:59.283 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.285+0000 7f12064b4700 1 --2- 172.21.15.26:0/3449565536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12000f6ff0 0x7f1200107450 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:59:59.283 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.285+0000 7f12064b4700 1 -- 172.21.15.26:0/3449565536 >> 172.21.15.26:0/3449565536 conn(0x7f12000f1f00 msgr2=0x7f12000fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:59:59.283 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.285+0000 7f12064b4700 1 -- 172.21.15.26:0/3449565536 shutdown_connections 2021-11-03T16:59:59.283 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.285+0000 7f12064b4700 1 -- 172.21.15.26:0/3449565536 wait complete. 2021-11-03T16:59:59.291 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T16:59:59.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.385+0000 7fbfb407c700 1 -- 172.21.15.26:0/1574884873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfac0f55c0 msgr2=0x7fbfac0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:59:59.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.385+0000 7fbfb407c700 1 --2- 172.21.15.26:0/1574884873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfac0f55c0 0x7fbfac0f59e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fbf9c004660 tx=0x7fbf9c009b30).stop 2021-11-03T16:59:59.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.385+0000 7fbfb407c700 1 -- 172.21.15.26:0/1574884873 shutdown_connections 2021-11-03T16:59:59.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.385+0000 7fbfb407c700 1 --2- 172.21.15.26:0/1574884873 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfac0f6860 0x7fbfac0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:59:59.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.385+0000 7fbfb407c700 1 --2- 172.21.15.26:0/1574884873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfac0f55c0 0x7fbfac0f59e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:59:59.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.385+0000 7fbfb407c700 1 -- 172.21.15.26:0/1574884873 >> 172.21.15.26:0/1574884873 conn(0x7fbfac0f0d40 msgr2=0x7fbfac0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:59:59.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.385+0000 7fbfb407c700 1 -- 172.21.15.26:0/1574884873 shutdown_connections 2021-11-03T16:59:59.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.385+0000 7fbfb407c700 1 -- 172.21.15.26:0/1574884873 wait complete. 2021-11-03T16:59:59.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.385+0000 7fbfb407c700 1 Processor -- start 2021-11-03T16:59:59.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.385+0000 7fbfb407c700 1 -- start start 2021-11-03T16:59:59.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.386+0000 7fbfb407c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfac0f6860 0x7fbfac0f9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:59:59.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.386+0000 7fbfb407c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfac0f83c0 0x7fbfac0f8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:59:59.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.386+0000 7fbfb407c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac0f8d30 con 0x7fbfac0f6860 2021-11-03T16:59:59.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.386+0000 7fbfb407c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac0f8e70 con 0x7fbfac0f83c0 2021-11-03T16:59:59.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.386+0000 7fbfb1e18700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfac0f6860 0x7fbfac0f9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:59:59.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.386+0000 7fbfb1e18700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfac0f6860 0x7fbfac0f9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51886/0 (socket says 172.21.15.26:51886) 2021-11-03T16:59:59.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.386+0000 7fbfb1e18700 1 -- 172.21.15.26:0/702647566 learned_addr learned my addr 172.21.15.26:0/702647566 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:59:59.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.386+0000 7fbfb1617700 1 --2- 172.21.15.26:0/702647566 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfac0f83c0 0x7fbfac0f8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:59:59.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.386+0000 7fbfb1e18700 1 -- 172.21.15.26:0/702647566 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfac0f83c0 msgr2=0x7fbfac0f8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:59:59.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.386+0000 7fbfb1e18700 1 --2- 172.21.15.26:0/702647566 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfac0f83c0 0x7fbfac0f8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:59:59.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.386+0000 7fbfb1e18700 1 -- 172.21.15.26:0/702647566 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf9c005040 con 0x7fbfac0f6860 2021-11-03T16:59:59.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.386+0000 7fbfb1e18700 1 --2- 172.21.15.26:0/702647566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfac0f6860 0x7fbfac0f9f40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fbf9c000c00 tx=0x7fbf9c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:59:59.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.386+0000 7fbfa27fc700 1 -- 172.21.15.26:0/702647566 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf9c019070 con 0x7fbfac0f6860 2021-11-03T16:59:59.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.386+0000 7fbfa27fc700 1 -- 172.21.15.26:0/702647566 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbf9c0097a0 con 0x7fbfac0f6860 2021-11-03T16:59:59.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.386+0000 7fbfb407c700 1 -- 172.21.15.26:0/702647566 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfac0f90c0 con 0x7fbfac0f6860 2021-11-03T16:59:59.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.387+0000 7fbfa27fc700 1 -- 172.21.15.26:0/702647566 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf9c014490 con 0x7fbfac0f6860 2021-11-03T16:59:59.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.387+0000 7fbfb407c700 1 -- 172.21.15.26:0/702647566 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfac10f390 con 0x7fbfac0f6860 2021-11-03T16:59:59.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.387+0000 7fbfb407c700 1 -- 172.21.15.26:0/702647566 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfac045ad0 con 0x7fbfac0f6860 2021-11-03T16:59:59.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.388+0000 7fbfa27fc700 1 -- 172.21.15.26:0/702647566 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fbf9c013c60 con 0x7fbfac0f6860 2021-11-03T16:59:59.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.388+0000 7fbfa27fc700 1 --2- 172.21.15.26:0/702647566 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbf980640b0 0x7fbf98066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:59:59.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.388+0000 7fbfa27fc700 1 -- 172.21.15.26:0/702647566 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fbf9c081bb0 con 0x7fbfac0f6860 2021-11-03T16:59:59.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.388+0000 7fbfb1617700 1 --2- 172.21.15.26:0/702647566 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbf980640b0 0x7fbf98066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:59:59.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.389+0000 7fbfb1617700 1 --2- 172.21.15.26:0/702647566 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbf980640b0 0x7fbf98066570 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fbfa80041d0 tx=0x7fbfa8009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:59:59.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.392+0000 7fbfa27fc700 1 -- 172.21.15.26:0/702647566 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fbf9c053e50 con 0x7fbfac0f6860 2021-11-03T16:59:59.563 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.567+0000 7fbfb407c700 1 -- 172.21.15.26:0/702647566 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbfac05fd30 con 0x7fbf980640b0 2021-11-03T16:59:59.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.581+0000 7fbfa27fc700 1 -- 172.21.15.26:0/702647566 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fbfac05fd30 con 0x7fbf980640b0 2021-11-03T16:59:59.578 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T16:59:59.578 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (11m) 116s ago 12m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T16:59:59.579 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (3m) 116s ago 12m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T16:59:59.579 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (3m) 36s ago 11m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T16:59:59.579 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (11m) 116s ago 12m 38.9M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T16:59:59.579 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (4m) 116s ago 7m 13.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T16:59:59.580 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (4m) 116s ago 7m 14.7M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T16:59:59.580 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (7m) 36s ago 7m 16.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T16:59:59.580 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (7m) 36s ago 7m 16.5M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T16:59:59.580 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (4m) 116s ago 13m 468M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T16:59:59.580 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (4m) 36s ago 11m 412M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T16:59:59.581 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (4m) 116s ago 13m 75.8M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T16:59:59.581 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (4m) 36s ago 11m 66.4M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T16:59:59.581 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (12m) 116s ago 12m 18.1M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T16:59:59.581 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (11m) 36s ago 11m 18.3M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T16:59:59.581 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (3m) 116s ago 10m 153M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T16:59:59.582 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (2m) 116s ago 10m 166M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T16:59:59.582 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (2m) 116s ago 10m 11.2M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T16:59:59.582 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (92s) 36s ago 9m 181M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T16:59:59.582 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (65s) 36s ago 9m 185M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T16:59:59.583 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (39s) 36s ago 9m 13.5M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T16:59:59.583 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (10m) 116s ago 11m 47.5M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T16:59:59.584 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.583+0000 7fbfb407c700 1 -- 172.21.15.26:0/702647566 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbf980640b0 msgr2=0x7fbf98066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:59:59.584 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.583+0000 7fbfb407c700 1 --2- 172.21.15.26:0/702647566 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbf980640b0 0x7fbf98066570 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fbfa80041d0 tx=0x7fbfa8009040).stop 2021-11-03T16:59:59.584 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.583+0000 7fbfb407c700 1 -- 172.21.15.26:0/702647566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfac0f6860 msgr2=0x7fbfac0f9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:59:59.584 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.583+0000 7fbfb407c700 1 --2- 172.21.15.26:0/702647566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfac0f6860 0x7fbfac0f9f40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fbf9c000c00 tx=0x7fbf9c009b30).stop 2021-11-03T16:59:59.584 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.583+0000 7fbfb407c700 1 -- 172.21.15.26:0/702647566 shutdown_connections 2021-11-03T16:59:59.585 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.583+0000 7fbfb407c700 1 --2- 172.21.15.26:0/702647566 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbf980640b0 0x7fbf98066570 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:59:59.585 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.583+0000 7fbfb407c700 1 --2- 172.21.15.26:0/702647566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfac0f6860 0x7fbfac0f9f40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:59:59.585 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.583+0000 7fbfb407c700 1 --2- 172.21.15.26:0/702647566 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfac0f83c0 0x7fbfac0f8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:59:59.585 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.583+0000 7fbfb407c700 1 -- 172.21.15.26:0/702647566 >> 172.21.15.26:0/702647566 conn(0x7fbfac0f0d40 msgr2=0x7fbfac05f620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:59:59.585 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.583+0000 7fbfb407c700 1 -- 172.21.15.26:0/702647566 shutdown_connections 2021-11-03T16:59:59.586 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.583+0000 7fbfb407c700 1 -- 172.21.15.26:0/702647566 wait complete. 2021-11-03T16:59:59.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.683+0000 7f2c4c838700 1 -- 172.21.15.26:0/925590435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c480f66e0 msgr2=0x7f2c480f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:59:59.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.683+0000 7f2c4c838700 1 --2- 172.21.15.26:0/925590435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c480f66e0 0x7f2c480f6b00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f2c400099e0 tx=0x7f2c40004d10).stop 2021-11-03T16:59:59.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.683+0000 7f2c4c838700 1 -- 172.21.15.26:0/925590435 shutdown_connections 2021-11-03T16:59:59.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.683+0000 7f2c4c838700 1 --2- 172.21.15.26:0/925590435 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c480f6ff0 0x7f2c480f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T16:59:59.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.683+0000 7f2c4c838700 1 --2- 172.21.15.26:0/925590435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c480f66e0 0x7f2c480f6b00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:59:59.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.683+0000 7f2c4c838700 1 -- 172.21.15.26:0/925590435 >> 172.21.15.26:0/925590435 conn(0x7f2c480f1f00 msgr2=0x7f2c480f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:59:59.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.683+0000 7f2c4c838700 1 -- 172.21.15.26:0/925590435 shutdown_connections 2021-11-03T16:59:59.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.683+0000 7f2c4c838700 1 -- 172.21.15.26:0/925590435 wait complete. 2021-11-03T16:59:59.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.684+0000 7f2c4c838700 1 Processor -- start 2021-11-03T16:59:59.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.684+0000 7f2c4c838700 1 -- start start 2021-11-03T16:59:59.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.684+0000 7f2c4c838700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c480f66e0 0x7f2c48107070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:59:59.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.684+0000 7f2c4c838700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c480f6ff0 0x7f2c48107560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:59:59.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.684+0000 7f2c4c838700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c48107b10 con 0x7f2c480f66e0 2021-11-03T16:59:59.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.684+0000 7f2c4c838700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c48107c50 con 0x7f2c480f6ff0 2021-11-03T16:59:59.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.684+0000 7f2c4659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c480f66e0 0x7f2c48107070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:59:59.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.684+0000 7f2c4659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c480f66e0 0x7f2c48107070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51896/0 (socket says 172.21.15.26:51896) 2021-11-03T16:59:59.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.684+0000 7f2c4659c700 1 -- 172.21.15.26:0/221643161 learned_addr learned my addr 172.21.15.26:0/221643161 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T16:59:59.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.684+0000 7f2c4659c700 1 -- 172.21.15.26:0/221643161 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c480f6ff0 msgr2=0x7f2c48107560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:59:59.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.684+0000 7f2c4659c700 1 --2- 172.21.15.26:0/221643161 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c480f6ff0 0x7f2c48107560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T16:59:59.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.684+0000 7f2c4659c700 1 -- 172.21.15.26:0/221643161 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c40009640 con 0x7f2c480f66e0 2021-11-03T16:59:59.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.685+0000 7f2c4659c700 1 --2- 172.21.15.26:0/221643161 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c480f66e0 0x7f2c48107070 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f2c40004b70 tx=0x7f2c40004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:59:59.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.685+0000 7f2c3effd700 1 -- 172.21.15.26:0/221643161 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c4000e030 con 0x7f2c480f66e0 2021-11-03T16:59:59.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.685+0000 7f2c3effd700 1 -- 172.21.15.26:0/221643161 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2c400049b0 con 0x7f2c480f66e0 2021-11-03T16:59:59.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.685+0000 7f2c4c838700 1 -- 172.21.15.26:0/221643161 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c48108590 con 0x7f2c480f66e0 2021-11-03T16:59:59.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.685+0000 7f2c3effd700 1 -- 172.21.15.26:0/221643161 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c40018070 con 0x7f2c480f66e0 2021-11-03T16:59:59.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.685+0000 7f2c4c838700 1 -- 172.21.15.26:0/221643161 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c48108a70 con 0x7f2c480f66e0 2021-11-03T16:59:59.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.686+0000 7f2c4c838700 1 -- 172.21.15.26:0/221643161 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c48045ad0 con 0x7f2c480f66e0 2021-11-03T16:59:59.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.686+0000 7f2c3effd700 1 -- 172.21.15.26:0/221643161 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f2c4001db40 con 0x7f2c480f66e0 2021-11-03T16:59:59.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.687+0000 7f2c3effd700 1 --2- 172.21.15.26:0/221643161 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2c340640b0 0x7f2c34066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T16:59:59.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.687+0000 7f2c3effd700 1 -- 172.21.15.26:0/221643161 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f2c40082330 con 0x7f2c480f66e0 2021-11-03T16:59:59.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.687+0000 7f2c45d9b700 1 --2- 172.21.15.26:0/221643161 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2c340640b0 0x7f2c34066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T16:59:59.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.687+0000 7f2c45d9b700 1 --2- 172.21.15.26:0/221643161 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2c340640b0 0x7f2c34066570 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f2c300047d0 tx=0x7f2c30007a40).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T16:59:59.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.691+0000 7f2c3effd700 1 -- 172.21.15.26:0/221643161 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f2c40054690 con 0x7f2c480f66e0 2021-11-03T16:59:59.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.922+0000 7f2c4c838700 1 -- 172.21.15.26:0/221643161 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2c48108ce0 con 0x7f2c480f66e0 2021-11-03T16:59:59.919 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.922+0000 7f2c3effd700 1 -- 172.21.15.26:0/221643161 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f2c40054280 con 0x7f2c480f66e0 2021-11-03T16:59:59.919 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T16:59:59.919 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T16:59:59.920 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T16:59:59.920 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:59:59.920 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T16:59:59.920 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T16:59:59.920 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:59:59.921 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T16:59:59.921 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T16:59:59.921 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:59:59.921 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T16:59:59.922 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T16:59:59.922 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T16:59:59.922 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T16:59:59.922 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T16:59:59.922 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T16:59:59.923 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T16:59:59.923 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T16:59:59.924 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.924+0000 7f2c4c838700 1 -- 172.21.15.26:0/221643161 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2c340640b0 msgr2=0x7f2c34066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:59:59.924 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.924+0000 7f2c4c838700 1 --2- 172.21.15.26:0/221643161 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2c340640b0 0x7f2c34066570 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f2c300047d0 tx=0x7f2c30007a40).stop 2021-11-03T16:59:59.924 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.924+0000 7f2c4c838700 1 -- 172.21.15.26:0/221643161 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c480f66e0 msgr2=0x7f2c48107070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T16:59:59.925 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.924+0000 7f2c4c838700 1 --2- 172.21.15.26:0/221643161 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c480f66e0 0x7f2c48107070 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f2c40004b70 tx=0x7f2c40004d10).stop 2021-11-03T16:59:59.925 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.924+0000 7f2c4c838700 1 -- 172.21.15.26:0/221643161 shutdown_connections 2021-11-03T16:59:59.925 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.924+0000 7f2c4c838700 1 --2- 172.21.15.26:0/221643161 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2c340640b0 0x7f2c34066570 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:59:59.925 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.924+0000 7f2c4c838700 1 --2- 172.21.15.26:0/221643161 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c480f66e0 0x7f2c48107070 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T16:59:59.925 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.924+0000 7f2c4c838700 1 --2- 172.21.15.26:0/221643161 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c480f6ff0 0x7f2c48107560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T16:59:59.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.924+0000 7f2c4c838700 1 -- 172.21.15.26:0/221643161 >> 172.21.15.26:0/221643161 conn(0x7f2c480f1f00 msgr2=0x7f2c480fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T16:59:59.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.924+0000 7f2c4c838700 1 -- 172.21.15.26:0/221643161 shutdown_connections 2021-11-03T16:59:59.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T16:59:59.924+0000 7f2c4c838700 1 -- 172.21.15.26:0/221643161 wait complete. 2021-11-03T16:59:59.995 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 16:59:59 smithi026 ceph-mon[96795]: pgmap v160: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T16:59:59.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 16:59:59 smithi194 ceph-mon[65619]: pgmap v160: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:00.022 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.024+0000 7faf12080700 1 -- 172.21.15.26:0/681886144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf0c0f6530 msgr2=0x7faf0c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:00:00.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.024+0000 7faf12080700 1 --2- 172.21.15.26:0/681886144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf0c0f6530 0x7faf0c0f6950 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7faf08004660 tx=0x7faf08009b30).stop 2021-11-03T17:00:00.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.024+0000 7faf12080700 1 -- 172.21.15.26:0/681886144 shutdown_connections 2021-11-03T17:00:00.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.024+0000 7faf12080700 1 --2- 172.21.15.26:0/681886144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf0c0f77d0 0x7faf0c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:00:00.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.024+0000 7faf12080700 1 --2- 172.21.15.26:0/681886144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf0c0f6530 0x7faf0c0f6950 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:00:00.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.024+0000 7faf12080700 1 -- 172.21.15.26:0/681886144 >> 172.21.15.26:0/681886144 conn(0x7faf0c0f1cd0 msgr2=0x7faf0c0f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:00:00.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.025+0000 7faf12080700 1 -- 172.21.15.26:0/681886144 shutdown_connections 2021-11-03T17:00:00.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.025+0000 7faf12080700 1 -- 172.21.15.26:0/681886144 wait complete. 2021-11-03T17:00:00.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.025+0000 7faf12080700 1 Processor -- start 2021-11-03T17:00:00.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.025+0000 7faf12080700 1 -- start start 2021-11-03T17:00:00.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.025+0000 7faf12080700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf0c0f6530 0x7faf0c106db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:00:00.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.025+0000 7faf12080700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf0c0f77d0 0x7faf0c1072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:00:00.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.025+0000 7faf12080700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c1078a0 con 0x7faf0c0f6530 2021-11-03T17:00:00.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.025+0000 7faf12080700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c1080e0 con 0x7faf0c0f77d0 2021-11-03T17:00:00.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.025+0000 7faf1107e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf0c0f6530 0x7faf0c106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:00:00.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.025+0000 7faf1107e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf0c0f6530 0x7faf0c106db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51906/0 (socket says 172.21.15.26:51906) 2021-11-03T17:00:00.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.025+0000 7faf1107e700 1 -- 172.21.15.26:0/1630846788 learned_addr learned my addr 172.21.15.26:0/1630846788 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:00:00.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.026+0000 7faf1087d700 1 --2- 172.21.15.26:0/1630846788 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf0c0f77d0 0x7faf0c1072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:00:00.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.026+0000 7faf1107e700 1 -- 172.21.15.26:0/1630846788 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf0c0f77d0 msgr2=0x7faf0c1072a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:00:00.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.026+0000 7faf1107e700 1 --2- 172.21.15.26:0/1630846788 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf0c0f77d0 0x7faf0c1072a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:00:00.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.026+0000 7faf1107e700 1 -- 172.21.15.26:0/1630846788 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf08005040 con 0x7faf0c0f6530 2021-11-03T17:00:00.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.026+0000 7faf1087d700 1 --2- 172.21.15.26:0/1630846788 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf0c0f77d0 0x7faf0c1072a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:00:00.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.026+0000 7faf1107e700 1 --2- 172.21.15.26:0/1630846788 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf0c0f6530 0x7faf0c106db0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7faf08013a70 tx=0x7faf08009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:00:00.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.026+0000 7faf01ffb700 1 -- 172.21.15.26:0/1630846788 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf08018070 con 0x7faf0c0f6530 2021-11-03T17:00:00.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.026+0000 7faf01ffb700 1 -- 172.21.15.26:0/1630846788 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7faf080097d0 con 0x7faf0c0f6530 2021-11-03T17:00:00.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.026+0000 7faf12080700 1 -- 172.21.15.26:0/1630846788 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf0c108360 con 0x7faf0c0f6530 2021-11-03T17:00:00.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.026+0000 7faf01ffb700 1 -- 172.21.15.26:0/1630846788 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf0801c3c0 con 0x7faf0c0f6530 2021-11-03T17:00:00.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.026+0000 7faf12080700 1 -- 172.21.15.26:0/1630846788 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf0c108840 con 0x7faf0c0f6530 2021-11-03T17:00:00.030 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.027+0000 7faf12080700 1 -- 172.21.15.26:0/1630846788 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf0c059100 con 0x7faf0c0f6530 2021-11-03T17:00:00.030 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.028+0000 7faf01ffb700 1 -- 172.21.15.26:0/1630846788 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7faf08007ba0 con 0x7faf0c0f6530 2021-11-03T17:00:00.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.028+0000 7faf01ffb700 1 --2- 172.21.15.26:0/1630846788 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faef8064100 0x7faef80665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:00:00.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.028+0000 7faf01ffb700 1 -- 172.21.15.26:0/1630846788 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7faf08082470 con 0x7faf0c0f6530 2021-11-03T17:00:00.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.028+0000 7faf1087d700 1 --2- 172.21.15.26:0/1630846788 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faef8064100 0x7faef80665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:00:00.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.028+0000 7faf1087d700 1 --2- 172.21.15.26:0/1630846788 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faef8064100 0x7faef80665c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7faf0c106b40 tx=0x7faefc009be0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:00:00.032 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.032+0000 7faf01ffb700 1 -- 172.21.15.26:0/1630846788 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7faf080547d0 con 0x7faf0c0f6530 2021-11-03T17:00:00.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.240+0000 7faf12080700 1 -- 172.21.15.26:0/1630846788 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7faf0c0fecf0 con 0x7faf0c0f6530 2021-11-03T17:00:00.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.241+0000 7faf01ffb700 1 -- 172.21.15.26:0/1630846788 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7faf080543c0 con 0x7faf0c0f6530 2021-11-03T17:00:00.238 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:00:00.238 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:00:00.238 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:00:00.239 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:00:00.239 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:00:00.239 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:00:00.239 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:00:00.240 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:00:00.240 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:00:00.240 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:00:00.240 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:00:00.240 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:00:00.241 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:00:00.241 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:00:00.241 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:00:00.241 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:00:00.242 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:00:00.242 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:00:00.242 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:00:00.242 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:00:00.243 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:00:00.243 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:00:00.243 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:00:00.243 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:00:00.244 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:00:00.244 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:00:00.244 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:00:00.244 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:00:00.245 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:00:00.245 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:00:00.245 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:00:00.245 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:00:00.246 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:00:00.246 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:00:00.246 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:00:00.247 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:00:00.247 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:00:00.247 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:00:00.247 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:00:00.249 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.243+0000 7faf12080700 1 -- 172.21.15.26:0/1630846788 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faef8064100 msgr2=0x7faef80665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:00:00.249 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.243+0000 7faf12080700 1 --2- 172.21.15.26:0/1630846788 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faef8064100 0x7faef80665c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7faf0c106b40 tx=0x7faefc009be0).stop 2021-11-03T17:00:00.249 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.243+0000 7faf12080700 1 -- 172.21.15.26:0/1630846788 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf0c0f6530 msgr2=0x7faf0c106db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:00:00.250 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.243+0000 7faf12080700 1 --2- 172.21.15.26:0/1630846788 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf0c0f6530 0x7faf0c106db0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7faf08013a70 tx=0x7faf08009b30).stop 2021-11-03T17:00:00.250 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.243+0000 7faf12080700 1 -- 172.21.15.26:0/1630846788 shutdown_connections 2021-11-03T17:00:00.250 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.243+0000 7faf12080700 1 --2- 172.21.15.26:0/1630846788 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faef8064100 0x7faef80665c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:00:00.251 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.243+0000 7faf12080700 1 --2- 172.21.15.26:0/1630846788 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf0c0f6530 0x7faf0c106db0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:00:00.251 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.243+0000 7faf12080700 1 --2- 172.21.15.26:0/1630846788 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf0c0f77d0 0x7faf0c1072a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:00:00.251 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.243+0000 7faf12080700 1 -- 172.21.15.26:0/1630846788 >> 172.21.15.26:0/1630846788 conn(0x7faf0c0f1cd0 msgr2=0x7faf0c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:00:00.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.243+0000 7faf12080700 1 -- 172.21.15.26:0/1630846788 shutdown_connections 2021-11-03T17:00:00.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:00.243+0000 7faf12080700 1 -- 172.21.15.26:0/1630846788 wait complete. 2021-11-03T17:00:00.252 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:00:00.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:00 smithi026 conmon[96772]: 2021-11-03T16:59:59.998+0000 7f27986f6700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 2 daemons have recently crashed 2021-11-03T17:00:00.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:00 smithi026 conmon[96772]: 2021-11-03T16:59:59.998+0000 7f27986f6700 -1 log_channel(cluster) log [ERR] : [WRN] FS_DEGRADED: 1 filesystem is degraded 2021-11-03T17:00:00.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:00 smithi026 conmon[96772]: 2021-11-03T16:59:59.998+0000 7f27986f6700 -1 log_channel(cluster) log [ERR] : fs cephfs is degraded 2021-11-03T17:00:00.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:00 smithi026 conmon[96772]: 2021-11-03T16:59:59.998+0000 7f27986f6700 -1 log_channel(cluster) log [ERR] : [WRN] FS_WITH_FAILED_MDS: 1 filesystem has a failed mds daemon 2021-11-03T17:00:00.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:00 smithi026 conmon[96772]: 2021-11-03T16:59:59.998+0000 7f27986f6700 -1 log_channel(cluster) log [ERR] : fs cephfs has 1 failed mds 2021-11-03T17:00:00.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:00 smithi026 conmon[96772]: 2021-11-03T16:59:59.998+0000 7f27986f6700 -1 log_channel(cluster) log [ERR] : [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2021-11-03T17:00:00.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:00 smithi026 conmon[96772]: 2021-11-03T16:59:59.998+0000 7f27986f6700 -1 log_channel(cluster) log [ERR] : fs cephfs is offline because no MDS is active for it. 2021-11-03T17:00:00.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:00 smithi026 conmon[96772]: 2021-11-03T16:59:59.998+0000 7f27986f6700 -1 log_channel(cluster) log [ERR] : [WRN] RECENT_CRASH: 2 daemons have recently crashed 2021-11-03T17:00:00.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:00 smithi026 conmon[96772]: 2021-11-03T16:59:59.998+0000 7f27986f6700 -1 log_channel(cluster) log [ERR] : mds.cephfs.smithi026.ltacyh crashed on host smithi026 at 2021-11-03T16:54:49.137789Z 2021-11-03T17:00:00.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:00 smithi026 conmon[96772]: 2021-11-03T16:59:59.998+0000 7f27986f6700 -1 log_channel(cluster) log [ERR] : mds.cephfs.smithi026.ltacyh crashed on host smithi026 at 2021-11-03T16:55:36.247141Z 2021-11-03T17:00:00.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:00 smithi194 ceph-mon[65619]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:00:00.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:00 smithi194 ceph-mon[65619]: from='client.34296 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:00:00.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:00 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/221643161' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:00:00.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:00 smithi194 ceph-mon[65619]: Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 2 daemons have recently crashed 2021-11-03T17:00:00.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:00 smithi194 ceph-mon[65619]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2021-11-03T17:00:00.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:00 smithi194 ceph-mon[65619]: fs cephfs is degraded 2021-11-03T17:00:00.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:00 smithi194 ceph-mon[65619]: [WRN] FS_WITH_FAILED_MDS: 1 filesystem has a failed mds daemon 2021-11-03T17:00:00.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:00 smithi194 ceph-mon[65619]: fs cephfs has 1 failed mds 2021-11-03T17:00:00.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:00 smithi194 ceph-mon[65619]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2021-11-03T17:00:00.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:00 smithi194 ceph-mon[65619]: fs cephfs is offline because no MDS is active for it. 2021-11-03T17:00:01.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:00 smithi194 ceph-mon[65619]: [WRN] RECENT_CRASH: 2 daemons have recently crashed 2021-11-03T17:00:01.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:00 smithi194 ceph-mon[65619]: mds.cephfs.smithi026.ltacyh crashed on host smithi026 at 2021-11-03T16:54:49.137789Z 2021-11-03T17:00:01.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:00 smithi194 ceph-mon[65619]: mds.cephfs.smithi026.ltacyh crashed on host smithi026 at 2021-11-03T16:55:36.247141Z 2021-11-03T17:00:01.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:00 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1630846788' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:00:01.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:00 smithi026 ceph-mon[96795]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:00:01.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:00 smithi026 ceph-mon[96795]: from='client.34296 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:00:01.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:00 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/221643161' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:00:01.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:00 smithi026 ceph-mon[96795]: Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 2 daemons have recently crashed 2021-11-03T17:00:01.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:00 smithi026 ceph-mon[96795]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2021-11-03T17:00:01.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:00 smithi026 ceph-mon[96795]: fs cephfs is degraded 2021-11-03T17:00:01.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:00 smithi026 ceph-mon[96795]: [WRN] FS_WITH_FAILED_MDS: 1 filesystem has a failed mds daemon 2021-11-03T17:00:01.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:00 smithi026 ceph-mon[96795]: fs cephfs has 1 failed mds 2021-11-03T17:00:01.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:00 smithi026 ceph-mon[96795]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2021-11-03T17:00:01.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:00 smithi026 ceph-mon[96795]: fs cephfs is offline because no MDS is active for it. 2021-11-03T17:00:01.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:00 smithi026 ceph-mon[96795]: [WRN] RECENT_CRASH: 2 daemons have recently crashed 2021-11-03T17:00:01.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:00 smithi026 ceph-mon[96795]: mds.cephfs.smithi026.ltacyh crashed on host smithi026 at 2021-11-03T16:54:49.137789Z 2021-11-03T17:00:01.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:00 smithi026 ceph-mon[96795]: mds.cephfs.smithi026.ltacyh crashed on host smithi026 at 2021-11-03T16:55:36.247141Z 2021-11-03T17:00:01.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:00 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1630846788' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:00:01.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:01 smithi194 ceph-mon[65619]: pgmap v161: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:02.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:01 smithi026 ceph-mon[96795]: pgmap v161: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:03.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:03 smithi194 ceph-mon[65619]: pgmap v162: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:04.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:03 smithi026 ceph-mon[96795]: pgmap v162: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:05.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:05 smithi026 ceph-mon[96795]: pgmap v163: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:05.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:05 smithi194 ceph-mon[65619]: pgmap v163: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:08.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:07 smithi026 ceph-mon[96795]: pgmap v164: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:08.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:07 smithi194 ceph-mon[65619]: pgmap v164: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:10.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:09 smithi026 ceph-mon[96795]: pgmap v165: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:10.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:09 smithi194 ceph-mon[65619]: pgmap v165: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:11.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:10 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:00:11.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:10 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:00:11.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:10 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:00:11.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:10 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:00:12.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:11 smithi026 ceph-mon[96795]: pgmap v166: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:12.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:11 smithi194 ceph-mon[65619]: pgmap v166: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:14.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:13 smithi026 ceph-mon[96795]: pgmap v167: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:14.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:13 smithi194 ceph-mon[65619]: pgmap v167: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:15.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:15 smithi026 ceph-mon[96795]: pgmap v168: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:16.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:15 smithi194 ceph-mon[65619]: pgmap v168: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:18.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:17 smithi026 ceph-mon[96795]: pgmap v169: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:18.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:17 smithi194 ceph-mon[65619]: pgmap v169: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:20.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:19 smithi026 ceph-mon[96795]: pgmap v170: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:20.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:19 smithi194 ceph-mon[65619]: pgmap v170: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:22.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:21 smithi026 ceph-mon[96795]: pgmap v171: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:22.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:21 smithi194 ceph-mon[65619]: pgmap v171: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:24.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:23 smithi026 ceph-mon[96795]: pgmap v172: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:24.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:23 smithi194 ceph-mon[65619]: pgmap v172: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:25.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:25 smithi026 ceph-mon[96795]: pgmap v173: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:25.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:00:25.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:25 smithi026 ceph-mon[96795]: poll took 61126.971 ms: 1 events 2021-11-03T17:00:25.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:00:25.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:00:25.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:00:25.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:00:25.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:00:25.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:00:25.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:00:26.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:25 smithi194 ceph-mon[65619]: pgmap v173: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:26.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:00:26.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:25 smithi194 ceph-mon[65619]: poll took 61126.971 ms: 1 events 2021-11-03T17:00:26.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:00:26.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:00:26.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:00:26.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:00:26.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:00:26.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:00:26.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:00:27.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:26 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:00:27.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:26 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:00:27.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:26 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:00:27.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:26 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:00:28.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:27 smithi026 ceph-mon[96795]: pgmap v174: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:28.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:27 smithi194 ceph-mon[65619]: pgmap v174: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:30.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:29 smithi026 ceph-mon[96795]: pgmap v175: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:30.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:29 smithi194 ceph-mon[65619]: pgmap v175: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:30.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.360+0000 7fb0c757a700 1 -- 172.21.15.26:0/906328433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0c00f55e0 msgr2=0x7fb0c00f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:00:30.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.360+0000 7fb0c757a700 1 --2- 172.21.15.26:0/906328433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0c00f55e0 0x7fb0c00f5a00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fb0b80099e0 tx=0x7fb0b8004d10).stop 2021-11-03T17:00:30.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.360+0000 7fb0c757a700 1 -- 172.21.15.26:0/906328433 shutdown_connections 2021-11-03T17:00:30.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.360+0000 7fb0c757a700 1 --2- 172.21.15.26:0/906328433 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0c00f5ef0 0x7fb0c00f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:00:30.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.360+0000 7fb0c757a700 1 --2- 172.21.15.26:0/906328433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0c00f55e0 0x7fb0c00f5a00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:00:30.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.360+0000 7fb0c757a700 1 -- 172.21.15.26:0/906328433 >> 172.21.15.26:0/906328433 conn(0x7fb0c00f0de0 msgr2=0x7fb0c00f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:00:30.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.360+0000 7fb0c757a700 1 -- 172.21.15.26:0/906328433 shutdown_connections 2021-11-03T17:00:30.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.360+0000 7fb0c757a700 1 -- 172.21.15.26:0/906328433 wait complete. 2021-11-03T17:00:30.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.360+0000 7fb0c757a700 1 Processor -- start 2021-11-03T17:00:30.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.361+0000 7fb0c757a700 1 -- start start 2021-11-03T17:00:30.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.361+0000 7fb0c757a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0c00f55e0 0x7fb0c010c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:00:30.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.361+0000 7fb0c757a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0c00f5ef0 0x7fb0c010e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:00:30.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.361+0000 7fb0c757a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c00603b0 con 0x7fb0c00f55e0 2021-11-03T17:00:30.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.361+0000 7fb0c757a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c00604f0 con 0x7fb0c00f5ef0 2021-11-03T17:00:30.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.361+0000 7fb0c5316700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0c00f55e0 0x7fb0c010c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:00:30.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.361+0000 7fb0c5316700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0c00f55e0 0x7fb0c010c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51924/0 (socket says 172.21.15.26:51924) 2021-11-03T17:00:30.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.361+0000 7fb0c5316700 1 -- 172.21.15.26:0/161987633 learned_addr learned my addr 172.21.15.26:0/161987633 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:00:30.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.361+0000 7fb0c4b15700 1 --2- 172.21.15.26:0/161987633 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0c00f5ef0 0x7fb0c010e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:00:30.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.361+0000 7fb0c5316700 1 -- 172.21.15.26:0/161987633 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0c00f5ef0 msgr2=0x7fb0c010e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:00:30.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.361+0000 7fb0c5316700 1 --2- 172.21.15.26:0/161987633 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0c00f5ef0 0x7fb0c010e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:00:30.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.361+0000 7fb0c5316700 1 -- 172.21.15.26:0/161987633 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b8009640 con 0x7fb0c00f55e0 2021-11-03T17:00:30.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.361+0000 7fb0c5316700 1 --2- 172.21.15.26:0/161987633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0c00f55e0 0x7fb0c010c180 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fb0b800c010 tx=0x7fb0b8004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:00:30.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.361+0000 7fb0bdffb700 1 -- 172.21.15.26:0/161987633 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0b800e070 con 0x7fb0c00f55e0 2021-11-03T17:00:30.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.361+0000 7fb0bdffb700 1 -- 172.21.15.26:0/161987633 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb0b8007dc0 con 0x7fb0c00f55e0 2021-11-03T17:00:30.363 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.362+0000 7fb0c757a700 1 -- 172.21.15.26:0/161987633 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0c010eb70 con 0x7fb0c00f55e0 2021-11-03T17:00:30.363 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.362+0000 7fb0bdffb700 1 -- 172.21.15.26:0/161987633 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0b8018070 con 0x7fb0c00f55e0 2021-11-03T17:00:30.363 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.362+0000 7fb0c757a700 1 -- 172.21.15.26:0/161987633 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0c010eec0 con 0x7fb0c00f55e0 2021-11-03T17:00:30.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.363+0000 7fb0c757a700 1 -- 172.21.15.26:0/161987633 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0c00f4a70 con 0x7fb0c00f55e0 2021-11-03T17:00:30.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.363+0000 7fb0bdffb700 1 -- 172.21.15.26:0/161987633 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fb0b8013420 con 0x7fb0c00f55e0 2021-11-03T17:00:30.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.364+0000 7fb0bdffb700 1 --2- 172.21.15.26:0/161987633 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb0a8064090 0x7fb0a8066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:00:30.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.364+0000 7fb0bdffb700 1 -- 172.21.15.26:0/161987633 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fb0b8082140 con 0x7fb0c00f55e0 2021-11-03T17:00:30.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.364+0000 7fb0c4b15700 1 --2- 172.21.15.26:0/161987633 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb0a8064090 0x7fb0a8066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:00:30.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.364+0000 7fb0c4b15700 1 --2- 172.21.15.26:0/161987633 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb0a8064090 0x7fb0a8066550 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fb0b40096c0 tx=0x7fb0b4009be0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:00:30.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.368+0000 7fb0bdffb700 1 -- 172.21.15.26:0/161987633 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fb0b80544a0 con 0x7fb0c00f55e0 2021-11-03T17:00:30.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.547+0000 7fb0c757a700 1 -- 172.21.15.26:0/161987633 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0c00fdea0 con 0x7fb0a8064090 2021-11-03T17:00:30.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.548+0000 7fb0bdffb700 1 -- 172.21.15.26:0/161987633 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fb0c00fdea0 con 0x7fb0a8064090 2021-11-03T17:00:30.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.550+0000 7fb0c757a700 1 -- 172.21.15.26:0/161987633 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb0a8064090 msgr2=0x7fb0a8066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:00:30.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.550+0000 7fb0c757a700 1 --2- 172.21.15.26:0/161987633 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb0a8064090 0x7fb0a8066550 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fb0b40096c0 tx=0x7fb0b4009be0).stop 2021-11-03T17:00:30.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.550+0000 7fb0c757a700 1 -- 172.21.15.26:0/161987633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0c00f55e0 msgr2=0x7fb0c010c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:00:30.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.550+0000 7fb0c757a700 1 --2- 172.21.15.26:0/161987633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0c00f55e0 0x7fb0c010c180 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fb0b800c010 tx=0x7fb0b8004d10).stop 2021-11-03T17:00:30.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.550+0000 7fb0c757a700 1 -- 172.21.15.26:0/161987633 shutdown_connections 2021-11-03T17:00:30.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.550+0000 7fb0c757a700 1 --2- 172.21.15.26:0/161987633 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb0a8064090 0x7fb0a8066550 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:00:30.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.550+0000 7fb0c757a700 1 --2- 172.21.15.26:0/161987633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0c00f55e0 0x7fb0c010c180 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:00:30.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.550+0000 7fb0c757a700 1 --2- 172.21.15.26:0/161987633 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0c00f5ef0 0x7fb0c010e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:00:30.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.550+0000 7fb0c757a700 1 -- 172.21.15.26:0/161987633 >> 172.21.15.26:0/161987633 conn(0x7fb0c00f0de0 msgr2=0x7fb0c00fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:00:30.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.550+0000 7fb0c757a700 1 -- 172.21.15.26:0/161987633 shutdown_connections 2021-11-03T17:00:30.548 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.550+0000 7fb0c757a700 1 -- 172.21.15.26:0/161987633 wait complete. 2021-11-03T17:00:30.555 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:00:30.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.651+0000 7f1302085700 1 -- 172.21.15.26:0/1522548409 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12fc0f6860 msgr2=0x7f12fc0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:00:30.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.651+0000 7f1302085700 1 --2- 172.21.15.26:0/1522548409 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12fc0f6860 0x7f12fc0f6cc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f12f0004660 tx=0x7f12f0009b30).stop 2021-11-03T17:00:30.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.651+0000 7f1302085700 1 -- 172.21.15.26:0/1522548409 shutdown_connections 2021-11-03T17:00:30.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.651+0000 7f1302085700 1 --2- 172.21.15.26:0/1522548409 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12fc0f6860 0x7f12fc0f6cc0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:00:30.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.651+0000 7f1302085700 1 --2- 172.21.15.26:0/1522548409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12fc0f55c0 0x7f12fc0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:00:30.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.651+0000 7f1302085700 1 -- 172.21.15.26:0/1522548409 >> 172.21.15.26:0/1522548409 conn(0x7f12fc0f0d40 msgr2=0x7f12fc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:00:30.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.651+0000 7f1302085700 1 -- 172.21.15.26:0/1522548409 shutdown_connections 2021-11-03T17:00:30.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.651+0000 7f1302085700 1 -- 172.21.15.26:0/1522548409 wait complete. 2021-11-03T17:00:30.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.651+0000 7f1302085700 1 Processor -- start 2021-11-03T17:00:30.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.652+0000 7f1302085700 1 -- start start 2021-11-03T17:00:30.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.652+0000 7f1302085700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12fc0f55c0 0x7f12fc105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:00:30.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.652+0000 7f1302085700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12fc0f6860 0x7f12fc1063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:00:30.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.652+0000 7f1302085700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc1069b0 con 0x7f12fc0f55c0 2021-11-03T17:00:30.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.652+0000 7f1302085700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc1071c0 con 0x7f12fc0f6860 2021-11-03T17:00:30.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.652+0000 7f12fb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12fc0f55c0 0x7f12fc105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:00:30.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.652+0000 7f12fb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12fc0f55c0 0x7f12fc105ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51934/0 (socket says 172.21.15.26:51934) 2021-11-03T17:00:30.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.652+0000 7f12fb7fe700 1 -- 172.21.15.26:0/1826956628 learned_addr learned my addr 172.21.15.26:0/1826956628 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:00:30.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.652+0000 7f12faffd700 1 --2- 172.21.15.26:0/1826956628 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12fc0f6860 0x7f12fc1063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:00:30.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.652+0000 7f12fb7fe700 1 -- 172.21.15.26:0/1826956628 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12fc0f6860 msgr2=0x7f12fc1063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:00:30.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.652+0000 7f12fb7fe700 1 --2- 172.21.15.26:0/1826956628 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12fc0f6860 0x7f12fc1063b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:00:30.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.652+0000 7f12fb7fe700 1 -- 172.21.15.26:0/1826956628 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f0005040 con 0x7f12fc0f55c0 2021-11-03T17:00:30.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.652+0000 7f12fb7fe700 1 --2- 172.21.15.26:0/1826956628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12fc0f55c0 0x7f12fc105ec0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f12f400ea40 tx=0x7f12f4004e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:00:30.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.652+0000 7f12e3fff700 1 -- 172.21.15.26:0/1826956628 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12f400cb90 con 0x7f12fc0f55c0 2021-11-03T17:00:30.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.652+0000 7f1302085700 1 -- 172.21.15.26:0/1826956628 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12fc1073e0 con 0x7f12fc0f55c0 2021-11-03T17:00:30.654 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.652+0000 7f12e3fff700 1 -- 172.21.15.26:0/1826956628 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f12f400ccf0 con 0x7f12fc0f55c0 2021-11-03T17:00:30.654 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.653+0000 7f12e3fff700 1 -- 172.21.15.26:0/1826956628 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12f4010750 con 0x7f12fc0f55c0 2021-11-03T17:00:30.654 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.653+0000 7f1302085700 1 -- 172.21.15.26:0/1826956628 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12fc107970 con 0x7f12fc0f55c0 2021-11-03T17:00:30.655 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.653+0000 7f1302085700 1 -- 172.21.15.26:0/1826956628 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12fc0f49b0 con 0x7f12fc0f55c0 2021-11-03T17:00:30.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.654+0000 7f12e3fff700 1 -- 172.21.15.26:0/1826956628 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f12f4021070 con 0x7f12fc0f55c0 2021-11-03T17:00:30.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.654+0000 7f12e3fff700 1 --2- 172.21.15.26:0/1826956628 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f12e40640b0 0x7f12e4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:00:30.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.654+0000 7f12e3fff700 1 -- 172.21.15.26:0/1826956628 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f12f4083bc0 con 0x7f12fc0f55c0 2021-11-03T17:00:30.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.654+0000 7f12faffd700 1 --2- 172.21.15.26:0/1826956628 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f12e40640b0 0x7f12e4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:00:30.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.655+0000 7f12faffd700 1 --2- 172.21.15.26:0/1826956628 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f12e40640b0 0x7f12e4066570 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f12f0004630 tx=0x7f12f0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:00:30.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.658+0000 7f12e3fff700 1 -- 172.21.15.26:0/1826956628 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f12f4055ef0 con 0x7f12fc0f55c0 2021-11-03T17:00:30.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.831+0000 7f1302085700 1 -- 172.21.15.26:0/1826956628 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f12fc05f620 con 0x7f12e40640b0 2021-11-03T17:00:30.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.846+0000 7f12e3fff700 1 -- 172.21.15.26:0/1826956628 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f12fc05f620 con 0x7f12e40640b0 2021-11-03T17:00:30.841 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:00:30.841 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (11m) 2m ago 13m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:00:30.842 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (3m) 2m ago 12m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:00:30.842 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (3m) 67s ago 12m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:00:30.842 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (11m) 2m ago 12m 38.9M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:00:30.842 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (4m) 2m ago 8m 13.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:00:30.843 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (5m) 2m ago 8m 14.7M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:00:30.843 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (8m) 67s ago 8m 16.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:00:30.843 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (8m) 67s ago 8m 16.5M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:00:30.843 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (5m) 2m ago 14m 468M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:00:30.844 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (5m) 67s ago 12m 412M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:00:30.844 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (4m) 2m ago 14m 75.8M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:00:30.844 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (4m) 67s ago 12m 66.4M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:00:30.844 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (12m) 2m ago 12m 18.1M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:00:30.845 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (11m) 67s ago 11m 18.3M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:00:30.845 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (3m) 2m ago 11m 153M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:00:30.845 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (3m) 2m ago 11m 166M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:00:30.846 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (2m) 2m ago 10m 11.2M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:00:30.846 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (2m) 67s ago 10m 181M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:00:30.846 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (97s) 67s ago 10m 185M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:00:30.846 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (70s) 67s ago 9m 13.5M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:00:30.846 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (11m) 2m ago 12m 47.5M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:00:30.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.848+0000 7f1302085700 1 -- 172.21.15.26:0/1826956628 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f12e40640b0 msgr2=0x7f12e4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:00:30.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.848+0000 7f1302085700 1 --2- 172.21.15.26:0/1826956628 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f12e40640b0 0x7f12e4066570 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f12f0004630 tx=0x7f12f0009b30).stop 2021-11-03T17:00:30.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.848+0000 7f1302085700 1 -- 172.21.15.26:0/1826956628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12fc0f55c0 msgr2=0x7f12fc105ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:00:30.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.848+0000 7f1302085700 1 --2- 172.21.15.26:0/1826956628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12fc0f55c0 0x7f12fc105ec0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f12f400ea40 tx=0x7f12f4004e20).stop 2021-11-03T17:00:30.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.848+0000 7f1302085700 1 -- 172.21.15.26:0/1826956628 shutdown_connections 2021-11-03T17:00:30.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.848+0000 7f1302085700 1 --2- 172.21.15.26:0/1826956628 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f12e40640b0 0x7f12e4066570 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:00:30.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.848+0000 7f1302085700 1 --2- 172.21.15.26:0/1826956628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12fc0f55c0 0x7f12fc105ec0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:00:30.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.848+0000 7f1302085700 1 --2- 172.21.15.26:0/1826956628 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12fc0f6860 0x7f12fc1063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:00:30.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.848+0000 7f1302085700 1 -- 172.21.15.26:0/1826956628 >> 172.21.15.26:0/1826956628 conn(0x7f12fc0f0d40 msgr2=0x7f12fc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:00:30.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.848+0000 7f1302085700 1 -- 172.21.15.26:0/1826956628 shutdown_connections 2021-11-03T17:00:30.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.848+0000 7f1302085700 1 -- 172.21.15.26:0/1826956628 wait complete. 2021-11-03T17:00:30.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.947+0000 7ff403ab6700 1 -- 172.21.15.26:0/2035805054 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3fc0f98b0 msgr2=0x7ff3fc0fbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:00:30.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.947+0000 7ff403ab6700 1 --2- 172.21.15.26:0/2035805054 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3fc0f98b0 0x7ff3fc0fbca0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7ff3f0004660 tx=0x7ff3f0009b30).stop 2021-11-03T17:00:30.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.947+0000 7ff403ab6700 1 -- 172.21.15.26:0/2035805054 shutdown_connections 2021-11-03T17:00:30.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.947+0000 7ff403ab6700 1 --2- 172.21.15.26:0/2035805054 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3fc0f98b0 0x7ff3fc0fbca0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:00:30.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.947+0000 7ff403ab6700 1 --2- 172.21.15.26:0/2035805054 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3fc060330 0x7ff3fc0f93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:00:30.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.947+0000 7ff403ab6700 1 -- 172.21.15.26:0/2035805054 >> 172.21.15.26:0/2035805054 conn(0x7ff3fc0f0de0 msgr2=0x7ff3fc0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:00:30.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.947+0000 7ff403ab6700 1 -- 172.21.15.26:0/2035805054 shutdown_connections 2021-11-03T17:00:30.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.947+0000 7ff403ab6700 1 -- 172.21.15.26:0/2035805054 wait complete. 2021-11-03T17:00:30.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.948+0000 7ff403ab6700 1 Processor -- start 2021-11-03T17:00:30.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.948+0000 7ff403ab6700 1 -- start start 2021-11-03T17:00:30.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.948+0000 7ff403ab6700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3fc060330 0x7ff3fc106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:00:30.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.948+0000 7ff403ab6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3fc0f98b0 0x7ff3fc107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:00:30.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.948+0000 7ff403ab6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3fc107a10 con 0x7ff3fc0f98b0 2021-11-03T17:00:30.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.948+0000 7ff403ab6700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3fc107b50 con 0x7ff3fc060330 2021-11-03T17:00:30.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.948+0000 7ff401051700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3fc0f98b0 0x7ff3fc107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:00:30.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.948+0000 7ff401051700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3fc0f98b0 0x7ff3fc107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51946/0 (socket says 172.21.15.26:51946) 2021-11-03T17:00:30.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.948+0000 7ff401051700 1 -- 172.21.15.26:0/433017763 learned_addr learned my addr 172.21.15.26:0/433017763 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:00:30.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.948+0000 7ff401852700 1 --2- 172.21.15.26:0/433017763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3fc060330 0x7ff3fc106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:00:30.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.948+0000 7ff401051700 1 -- 172.21.15.26:0/433017763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3fc060330 msgr2=0x7ff3fc106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:00:30.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.948+0000 7ff401051700 1 --2- 172.21.15.26:0/433017763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3fc060330 0x7ff3fc106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:00:30.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.948+0000 7ff401051700 1 -- 172.21.15.26:0/433017763 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f0005040 con 0x7ff3fc0f98b0 2021-11-03T17:00:30.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.948+0000 7ff401051700 1 --2- 172.21.15.26:0/433017763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3fc0f98b0 0x7ff3fc107460 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7ff3f0009990 tx=0x7ff3f0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:00:30.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.949+0000 7ff3fa7fc700 1 -- 172.21.15.26:0/433017763 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3f0018070 con 0x7ff3fc0f98b0 2021-11-03T17:00:30.950 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.949+0000 7ff3fa7fc700 1 -- 172.21.15.26:0/433017763 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff3f0007ba0 con 0x7ff3fc0f98b0 2021-11-03T17:00:30.950 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.949+0000 7ff403ab6700 1 -- 172.21.15.26:0/433017763 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3fc108490 con 0x7ff3fc0f98b0 2021-11-03T17:00:30.950 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.949+0000 7ff3fa7fc700 1 -- 172.21.15.26:0/433017763 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3f001c3c0 con 0x7ff3fc0f98b0 2021-11-03T17:00:30.950 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.949+0000 7ff403ab6700 1 -- 172.21.15.26:0/433017763 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3fc1089f0 con 0x7ff3fc0f98b0 2021-11-03T17:00:30.951 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.949+0000 7ff403ab6700 1 -- 172.21.15.26:0/433017763 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3fc045ad0 con 0x7ff3fc0f98b0 2021-11-03T17:00:30.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.950+0000 7ff3fa7fc700 1 -- 172.21.15.26:0/433017763 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ff3f001d420 con 0x7ff3fc0f98b0 2021-11-03T17:00:30.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.950+0000 7ff3fa7fc700 1 --2- 172.21.15.26:0/433017763 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff3e40640b0 0x7ff3e4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:00:30.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.950+0000 7ff3fa7fc700 1 -- 172.21.15.26:0/433017763 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ff3f0082500 con 0x7ff3fc0f98b0 2021-11-03T17:00:30.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.951+0000 7ff401852700 1 --2- 172.21.15.26:0/433017763 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff3e40640b0 0x7ff3e4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:00:30.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.951+0000 7ff401852700 1 --2- 172.21.15.26:0/433017763 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff3e40640b0 0x7ff3e4066570 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7ff3fc060100 tx=0x7ff3f4004d00).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:00:30.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:30.954+0000 7ff3fa7fc700 1 -- 172.21.15.26:0/433017763 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ff3f00548c0 con 0x7ff3fc0f98b0 2021-11-03T17:00:31.177 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.182+0000 7ff403ab6700 1 -- 172.21.15.26:0/433017763 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff3fc027a00 con 0x7ff3fc0f98b0 2021-11-03T17:00:31.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.183+0000 7ff3fa7fc700 1 -- 172.21.15.26:0/433017763 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7ff3f00544b0 con 0x7ff3fc0f98b0 2021-11-03T17:00:31.179 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:00:31.179 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:00:31.179 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:00:31.179 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:00:31.180 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:00:31.180 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:00:31.180 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:00:31.180 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:00:31.181 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:00:31.181 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:00:31.181 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:00:31.182 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:00:31.182 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:00:31.182 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:00:31.182 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:00:31.183 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:00:31.183 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:00:31.183 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:00:31.184 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.185+0000 7ff403ab6700 1 -- 172.21.15.26:0/433017763 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff3e40640b0 msgr2=0x7ff3e4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:00:31.184 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.185+0000 7ff403ab6700 1 --2- 172.21.15.26:0/433017763 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff3e40640b0 0x7ff3e4066570 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7ff3fc060100 tx=0x7ff3f4004d00).stop 2021-11-03T17:00:31.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.185+0000 7ff403ab6700 1 -- 172.21.15.26:0/433017763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3fc0f98b0 msgr2=0x7ff3fc107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:00:31.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.185+0000 7ff403ab6700 1 --2- 172.21.15.26:0/433017763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3fc0f98b0 0x7ff3fc107460 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7ff3f0009990 tx=0x7ff3f0009b30).stop 2021-11-03T17:00:31.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.185+0000 7ff403ab6700 1 -- 172.21.15.26:0/433017763 shutdown_connections 2021-11-03T17:00:31.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.185+0000 7ff403ab6700 1 --2- 172.21.15.26:0/433017763 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff3e40640b0 0x7ff3e4066570 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:00:31.186 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.185+0000 7ff403ab6700 1 --2- 172.21.15.26:0/433017763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3fc060330 0x7ff3fc106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:00:31.186 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.185+0000 7ff403ab6700 1 --2- 172.21.15.26:0/433017763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3fc0f98b0 0x7ff3fc107460 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:00:31.186 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.185+0000 7ff403ab6700 1 -- 172.21.15.26:0/433017763 >> 172.21.15.26:0/433017763 conn(0x7ff3fc0f0de0 msgr2=0x7ff3fc0f31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:00:31.186 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.185+0000 7ff403ab6700 1 -- 172.21.15.26:0/433017763 shutdown_connections 2021-11-03T17:00:31.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.185+0000 7ff403ab6700 1 -- 172.21.15.26:0/433017763 wait complete. 2021-11-03T17:00:31.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.285+0000 7f3a56a19700 1 -- 172.21.15.26:0/1228805067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a500f66c0 msgr2=0x7f3a500f6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:00:31.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.285+0000 7f3a56a19700 1 --2- 172.21.15.26:0/1228805067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a500f66c0 0x7f3a500f6ae0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f3a40004660 tx=0x7f3a40009b30).stop 2021-11-03T17:00:31.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.285+0000 7f3a56a19700 1 -- 172.21.15.26:0/1228805067 shutdown_connections 2021-11-03T17:00:31.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.285+0000 7f3a56a19700 1 --2- 172.21.15.26:0/1228805067 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a500f7960 0x7f3a500f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:00:31.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.285+0000 7f3a56a19700 1 --2- 172.21.15.26:0/1228805067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a500f66c0 0x7f3a500f6ae0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:00:31.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.285+0000 7f3a56a19700 1 -- 172.21.15.26:0/1228805067 >> 172.21.15.26:0/1228805067 conn(0x7f3a500f1e20 msgr2=0x7f3a500f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:00:31.282 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.285+0000 7f3a56a19700 1 -- 172.21.15.26:0/1228805067 shutdown_connections 2021-11-03T17:00:31.282 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.285+0000 7f3a56a19700 1 -- 172.21.15.26:0/1228805067 wait complete. 2021-11-03T17:00:31.282 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.285+0000 7f3a56a19700 1 Processor -- start 2021-11-03T17:00:31.284 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.286+0000 7f3a56a19700 1 -- start start 2021-11-03T17:00:31.284 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.286+0000 7f3a56a19700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a500f66c0 0x7f3a5006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:00:31.285 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.286+0000 7f3a56a19700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a500f7960 0x7f3a50069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:00:31.285 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.286+0000 7f3a56a19700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5006a380 con 0x7f3a500f66c0 2021-11-03T17:00:31.285 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.286+0000 7f3a56a19700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5006a4c0 con 0x7f3a500f7960 2021-11-03T17:00:31.285 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.286+0000 7f3a4ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a500f66c0 0x7f3a5006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:00:31.286 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.286+0000 7f3a4ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a500f66c0 0x7f3a5006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51952/0 (socket says 172.21.15.26:51952) 2021-11-03T17:00:31.286 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.286+0000 7f3a4ffff700 1 -- 172.21.15.26:0/2119458736 learned_addr learned my addr 172.21.15.26:0/2119458736 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:00:31.286 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.286+0000 7f3a4ffff700 1 -- 172.21.15.26:0/2119458736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a500f7960 msgr2=0x7f3a50069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:00:31.286 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.286+0000 7f3a4ffff700 1 --2- 172.21.15.26:0/2119458736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a500f7960 0x7f3a50069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:00:31.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.286+0000 7f3a4ffff700 1 -- 172.21.15.26:0/2119458736 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a40005040 con 0x7f3a500f66c0 2021-11-03T17:00:31.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.286+0000 7f3a4ffff700 1 --2- 172.21.15.26:0/2119458736 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a500f66c0 0x7f3a5006b9a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f3a40004f60 tx=0x7f3a40009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:00:31.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.286+0000 7f3a4cff9700 1 -- 172.21.15.26:0/2119458736 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a40018070 con 0x7f3a500f66c0 2021-11-03T17:00:31.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.287+0000 7f3a4cff9700 1 -- 172.21.15.26:0/2119458736 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3a40007ba0 con 0x7f3a500f66c0 2021-11-03T17:00:31.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.287+0000 7f3a4cff9700 1 -- 172.21.15.26:0/2119458736 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a4001c620 con 0x7f3a500f66c0 2021-11-03T17:00:31.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.287+0000 7f3a56a19700 1 -- 172.21.15.26:0/2119458736 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a5006a740 con 0x7f3a500f66c0 2021-11-03T17:00:31.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.287+0000 7f3a56a19700 1 -- 172.21.15.26:0/2119458736 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a5006ac50 con 0x7f3a500f66c0 2021-11-03T17:00:31.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.288+0000 7f3a56a19700 1 -- 172.21.15.26:0/2119458736 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a50045ad0 con 0x7f3a500f66c0 2021-11-03T17:00:31.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.288+0000 7f3a4cff9700 1 -- 172.21.15.26:0/2119458736 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f3a4001c8e0 con 0x7f3a500f66c0 2021-11-03T17:00:31.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.288+0000 7f3a4cff9700 1 --2- 172.21.15.26:0/2119458736 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3a3c0640b0 0x7f3a3c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:00:31.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.288+0000 7f3a4cff9700 1 -- 172.21.15.26:0/2119458736 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f3a400826c0 con 0x7f3a500f66c0 2021-11-03T17:00:31.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.288+0000 7f3a4f7fe700 1 --2- 172.21.15.26:0/2119458736 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3a3c0640b0 0x7f3a3c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:00:31.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.289+0000 7f3a4f7fe700 1 --2- 172.21.15.26:0/2119458736 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3a3c0640b0 0x7f3a3c066570 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f3a38004970 tx=0x7f3a38007a60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:00:31.290 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.292+0000 7f3a4cff9700 1 -- 172.21.15.26:0/2119458736 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f3a40054a20 con 0x7f3a500f66c0 2021-11-03T17:00:31.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.494+0000 7f3a56a19700 1 -- 172.21.15.26:0/2119458736 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3a500fef20 con 0x7f3a500f66c0 2021-11-03T17:00:31.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.495+0000 7f3a4cff9700 1 -- 172.21.15.26:0/2119458736 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f3a40054610 con 0x7f3a500f66c0 2021-11-03T17:00:31.491 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:00:31.491 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:00:31.491 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:00:31.491 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:00:31.492 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:00:31.492 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:00:31.492 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:00:31.492 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:00:31.493 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:00:31.493 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:00:31.493 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:00:31.494 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:00:31.494 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:00:31.494 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:00:31.494 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:00:31.495 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:00:31.495 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:00:31.495 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:00:31.495 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:00:31.495 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:00:31.496 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:00:31.496 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:00:31.496 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:00:31.496 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:00:31.497 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:00:31.497 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:00:31.497 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:00:31.497 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:00:31.498 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:00:31.498 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:00:31.498 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:00:31.498 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:00:31.499 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:00:31.499 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:00:31.499 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:00:31.499 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:00:31.499 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:00:31.500 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:00:31.500 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:00:31.501 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.496+0000 7f3a56a19700 1 -- 172.21.15.26:0/2119458736 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3a3c0640b0 msgr2=0x7f3a3c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:00:31.501 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.496+0000 7f3a56a19700 1 --2- 172.21.15.26:0/2119458736 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3a3c0640b0 0x7f3a3c066570 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f3a38004970 tx=0x7f3a38007a60).stop 2021-11-03T17:00:31.502 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.496+0000 7f3a56a19700 1 -- 172.21.15.26:0/2119458736 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a500f66c0 msgr2=0x7f3a5006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:00:31.502 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.496+0000 7f3a56a19700 1 --2- 172.21.15.26:0/2119458736 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a500f66c0 0x7f3a5006b9a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f3a40004f60 tx=0x7f3a40009b30).stop 2021-11-03T17:00:31.502 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.496+0000 7f3a56a19700 1 -- 172.21.15.26:0/2119458736 shutdown_connections 2021-11-03T17:00:31.502 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.496+0000 7f3a56a19700 1 --2- 172.21.15.26:0/2119458736 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3a3c0640b0 0x7f3a3c066570 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:00:31.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.496+0000 7f3a56a19700 1 --2- 172.21.15.26:0/2119458736 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a500f66c0 0x7f3a5006b9a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:00:31.504 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.497+0000 7f3a56a19700 1 --2- 172.21.15.26:0/2119458736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a500f7960 0x7f3a50069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:00:31.504 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.497+0000 7f3a56a19700 1 -- 172.21.15.26:0/2119458736 >> 172.21.15.26:0/2119458736 conn(0x7f3a500f1e20 msgr2=0x7f3a500fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:00:31.504 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.497+0000 7f3a56a19700 1 -- 172.21.15.26:0/2119458736 shutdown_connections 2021-11-03T17:00:31.504 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:00:31.497+0000 7f3a56a19700 1 -- 172.21.15.26:0/2119458736 wait complete. 2021-11-03T17:00:31.505 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:00:32.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:31 smithi026 ceph-mon[96795]: pgmap v176: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:32.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:31 smithi026 ceph-mon[96795]: from='client.34308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:00:32.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:31 smithi026 ceph-mon[96795]: from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:00:32.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:31 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/433017763' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:00:32.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:31 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2119458736' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:00:32.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:31 smithi194 ceph-mon[65619]: pgmap v176: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:32.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:31 smithi194 ceph-mon[65619]: from='client.34308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:00:32.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:31 smithi194 ceph-mon[65619]: from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:00:32.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:31 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/433017763' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:00:32.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:31 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2119458736' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:00:34.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:33 smithi026 ceph-mon[96795]: pgmap v177: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:34.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:33 smithi194 ceph-mon[65619]: pgmap v177: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:35.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:35 smithi026 ceph-mon[96795]: pgmap v178: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:36.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:35 smithi194 ceph-mon[65619]: pgmap v178: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:38.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:37 smithi026 ceph-mon[96795]: pgmap v179: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:38.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:37 smithi194 ceph-mon[65619]: pgmap v179: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:40.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:39 smithi026 ceph-mon[96795]: pgmap v180: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:40.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:39 smithi194 ceph-mon[65619]: pgmap v180: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:41.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:00:41.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:00:42.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:41 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:00:42.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:41 smithi026 ceph-mon[96795]: pgmap v181: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:42.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:41 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:00:42.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:41 smithi194 ceph-mon[65619]: pgmap v181: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:44.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:43 smithi026 ceph-mon[96795]: pgmap v182: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:44.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:43 smithi194 ceph-mon[65619]: pgmap v182: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:45.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:45 smithi026 ceph-mon[96795]: pgmap v183: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:46.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:45 smithi194 ceph-mon[65619]: pgmap v183: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:48.122 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:47 smithi026 ceph-mon[96795]: pgmap v184: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:48.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:47 smithi194 ceph-mon[65619]: pgmap v184: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:49.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:00:49.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:00:49.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:00:49.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:00:50.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:49 smithi026 ceph-mon[96795]: pgmap v185: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:50.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:49 smithi194 ceph-mon[65619]: pgmap v185: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:52.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:51 smithi026 ceph-mon[96795]: pgmap v186: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:52.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:51 smithi194 ceph-mon[65619]: pgmap v186: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:54.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:53 smithi026 ceph-mon[96795]: pgmap v187: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:54.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:53 smithi194 ceph-mon[65619]: pgmap v187: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:56.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:55 smithi026 ceph-mon[96795]: pgmap v188: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:56.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:00:56.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:55 smithi194 ceph-mon[65619]: pgmap v188: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:56.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:00:57.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:56 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:00:57.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:56 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:00:58.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:57 smithi026 ceph-mon[96795]: pgmap v189: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:00:58.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:57 smithi194 ceph-mon[65619]: pgmap v189: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:00.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:00:59 smithi026 ceph-mon[96795]: pgmap v190: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:00.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:00:59 smithi194 ceph-mon[65619]: pgmap v190: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:01.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.611+0000 7fbe049fd700 1 -- 172.21.15.26:0/4181724232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe000f66c0 msgr2=0x7fbe000f6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:01:01.610 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.611+0000 7fbe049fd700 1 --2- 172.21.15.26:0/4181724232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe000f66c0 0x7fbe000f6b20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fbde8004660 tx=0x7fbde8009b30).stop 2021-11-03T17:01:01.610 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.611+0000 7fbe049fd700 1 -- 172.21.15.26:0/4181724232 shutdown_connections 2021-11-03T17:01:01.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.611+0000 7fbe049fd700 1 --2- 172.21.15.26:0/4181724232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe000f66c0 0x7fbe000f6b20 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:01.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.611+0000 7fbe049fd700 1 --2- 172.21.15.26:0/4181724232 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe000f5420 0x7fbe000f5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:01.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.611+0000 7fbe049fd700 1 -- 172.21.15.26:0/4181724232 >> 172.21.15.26:0/4181724232 conn(0x7fbe000f0b60 msgr2=0x7fbe000f2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:01:01.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.611+0000 7fbe049fd700 1 -- 172.21.15.26:0/4181724232 shutdown_connections 2021-11-03T17:01:01.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.611+0000 7fbe049fd700 1 -- 172.21.15.26:0/4181724232 wait complete. 2021-11-03T17:01:01.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.612+0000 7fbe049fd700 1 Processor -- start 2021-11-03T17:01:01.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.612+0000 7fbe049fd700 1 -- start start 2021-11-03T17:01:01.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.612+0000 7fbe049fd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe000f5420 0x7fbe00109980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:01:01.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.612+0000 7fbe049fd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe000f66c0 0x7fbe0010be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:01:01.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.612+0000 7fbe049fd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe00060420 con 0x7fbe000f5420 2021-11-03T17:01:01.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.612+0000 7fbe049fd700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe00060560 con 0x7fbe000f66c0 2021-11-03T17:01:01.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.612+0000 7fbdfed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe000f5420 0x7fbe00109980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:01:01.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.612+0000 7fbdfed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe000f5420 0x7fbe00109980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51986/0 (socket says 172.21.15.26:51986) 2021-11-03T17:01:01.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.612+0000 7fbdfed9d700 1 -- 172.21.15.26:0/825325021 learned_addr learned my addr 172.21.15.26:0/825325021 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:01:01.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.612+0000 7fbdfe59c700 1 --2- 172.21.15.26:0/825325021 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe000f66c0 0x7fbe0010be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:01:01.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.612+0000 7fbdfed9d700 1 -- 172.21.15.26:0/825325021 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe000f66c0 msgr2=0x7fbe0010be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:01:01.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.612+0000 7fbdfed9d700 1 --2- 172.21.15.26:0/825325021 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe000f66c0 0x7fbe0010be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:01.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.612+0000 7fbdfed9d700 1 -- 172.21.15.26:0/825325021 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde8005040 con 0x7fbe000f5420 2021-11-03T17:01:01.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.612+0000 7fbdfed9d700 1 --2- 172.21.15.26:0/825325021 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe000f5420 0x7fbe00109980 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fbdf800eb70 tx=0x7fbdf800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:01:01.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.613+0000 7fbdf77fe700 1 -- 172.21.15.26:0/825325021 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdf80092e0 con 0x7fbe000f5420 2021-11-03T17:01:01.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.613+0000 7fbe049fd700 1 -- 172.21.15.26:0/825325021 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe0010c490 con 0x7fbe000f5420 2021-11-03T17:01:01.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.613+0000 7fbdf77fe700 1 -- 172.21.15.26:0/825325021 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbdf800f040 con 0x7fbe000f5420 2021-11-03T17:01:01.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.613+0000 7fbdf77fe700 1 -- 172.21.15.26:0/825325021 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdf800c8a0 con 0x7fbe000f5420 2021-11-03T17:01:01.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.613+0000 7fbe049fd700 1 -- 172.21.15.26:0/825325021 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe0010ca20 con 0x7fbe000f5420 2021-11-03T17:01:01.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.614+0000 7fbe049fd700 1 -- 172.21.15.26:0/825325021 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe00059100 con 0x7fbe000f5420 2021-11-03T17:01:01.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.614+0000 7fbdf77fe700 1 -- 172.21.15.26:0/825325021 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fbdf801b030 con 0x7fbe000f5420 2021-11-03T17:01:01.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.615+0000 7fbdf77fe700 1 --2- 172.21.15.26:0/825325021 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbdec064100 0x7fbdec0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:01:01.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.615+0000 7fbdf77fe700 1 -- 172.21.15.26:0/825325021 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fbdf80809f0 con 0x7fbe000f5420 2021-11-03T17:01:01.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.615+0000 7fbdfe59c700 1 --2- 172.21.15.26:0/825325021 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbdec064100 0x7fbdec0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:01:01.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.615+0000 7fbdfe59c700 1 --2- 172.21.15.26:0/825325021 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbdec064100 0x7fbdec0665c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fbde8005010 tx=0x7fbde8016040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:01:01.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.619+0000 7fbdf77fe700 1 -- 172.21.15.26:0/825325021 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fbdf8082e60 con 0x7fbe000f5420 2021-11-03T17:01:01.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.796+0000 7fbe049fd700 1 -- 172.21.15.26:0/825325021 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbe00057f10 con 0x7fbdec064100 2021-11-03T17:01:01.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.797+0000 7fbdf77fe700 1 -- 172.21.15.26:0/825325021 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fbe00057f10 con 0x7fbdec064100 2021-11-03T17:01:01.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.799+0000 7fbe049fd700 1 -- 172.21.15.26:0/825325021 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbdec064100 msgr2=0x7fbdec0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:01:01.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.799+0000 7fbe049fd700 1 --2- 172.21.15.26:0/825325021 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbdec064100 0x7fbdec0665c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fbde8005010 tx=0x7fbde8016040).stop 2021-11-03T17:01:01.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.799+0000 7fbe049fd700 1 -- 172.21.15.26:0/825325021 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe000f5420 msgr2=0x7fbe00109980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:01:01.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.799+0000 7fbe049fd700 1 --2- 172.21.15.26:0/825325021 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe000f5420 0x7fbe00109980 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fbdf800eb70 tx=0x7fbdf800b040).stop 2021-11-03T17:01:01.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.799+0000 7fbe049fd700 1 -- 172.21.15.26:0/825325021 shutdown_connections 2021-11-03T17:01:01.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.799+0000 7fbe049fd700 1 --2- 172.21.15.26:0/825325021 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbdec064100 0x7fbdec0665c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:01.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.799+0000 7fbe049fd700 1 --2- 172.21.15.26:0/825325021 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe000f5420 0x7fbe00109980 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:01.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.799+0000 7fbe049fd700 1 --2- 172.21.15.26:0/825325021 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe000f66c0 0x7fbe0010be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:01.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.799+0000 7fbe049fd700 1 -- 172.21.15.26:0/825325021 >> 172.21.15.26:0/825325021 conn(0x7fbe000f0b60 msgr2=0x7fbe000fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:01:01.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.799+0000 7fbe049fd700 1 -- 172.21.15.26:0/825325021 shutdown_connections 2021-11-03T17:01:01.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.799+0000 7fbe049fd700 1 -- 172.21.15.26:0/825325021 wait complete. 2021-11-03T17:01:01.805 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:01:01.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.900+0000 7fe103d8f700 1 -- 172.21.15.26:0/2292850940 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0fc0f6860 msgr2=0x7fe0fc0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:01:01.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.900+0000 7fe103d8f700 1 --2- 172.21.15.26:0/2292850940 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0fc0f6860 0x7fe0fc0f6cc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fe0f8004660 tx=0x7fe0f8009b30).stop 2021-11-03T17:01:01.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.900+0000 7fe103d8f700 1 -- 172.21.15.26:0/2292850940 shutdown_connections 2021-11-03T17:01:01.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.900+0000 7fe103d8f700 1 --2- 172.21.15.26:0/2292850940 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0fc0f6860 0x7fe0fc0f6cc0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:01.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.900+0000 7fe103d8f700 1 --2- 172.21.15.26:0/2292850940 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0fc0f55c0 0x7fe0fc0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:01.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.900+0000 7fe103d8f700 1 -- 172.21.15.26:0/2292850940 >> 172.21.15.26:0/2292850940 conn(0x7fe0fc0f0d40 msgr2=0x7fe0fc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:01:01.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.900+0000 7fe103d8f700 1 -- 172.21.15.26:0/2292850940 shutdown_connections 2021-11-03T17:01:01.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.900+0000 7fe103d8f700 1 -- 172.21.15.26:0/2292850940 wait complete. 2021-11-03T17:01:01.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.900+0000 7fe103d8f700 1 Processor -- start 2021-11-03T17:01:01.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.901+0000 7fe103d8f700 1 -- start start 2021-11-03T17:01:01.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.901+0000 7fe103d8f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0fc0f55c0 0x7fe0fc10c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:01:01.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.901+0000 7fe103d8f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0fc0f6860 0x7fe0fc10e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:01:01.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.901+0000 7fe103d8f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0fc0602b0 con 0x7fe0fc0f55c0 2021-11-03T17:01:01.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.901+0000 7fe103d8f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0fc0603f0 con 0x7fe0fc0f6860 2021-11-03T17:01:01.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.901+0000 7fe101b2b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0fc0f55c0 0x7fe0fc10c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:01:01.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.901+0000 7fe101b2b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0fc0f55c0 0x7fe0fc10c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51996/0 (socket says 172.21.15.26:51996) 2021-11-03T17:01:01.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.901+0000 7fe101b2b700 1 -- 172.21.15.26:0/3619391037 learned_addr learned my addr 172.21.15.26:0/3619391037 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:01:01.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.901+0000 7fe10132a700 1 --2- 172.21.15.26:0/3619391037 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0fc0f6860 0x7fe0fc10e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:01:01.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.901+0000 7fe101b2b700 1 -- 172.21.15.26:0/3619391037 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0fc0f6860 msgr2=0x7fe0fc10e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:01:01.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.901+0000 7fe101b2b700 1 --2- 172.21.15.26:0/3619391037 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0fc0f6860 0x7fe0fc10e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:01.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.901+0000 7fe101b2b700 1 -- 172.21.15.26:0/3619391037 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f8005040 con 0x7fe0fc0f55c0 2021-11-03T17:01:01.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.901+0000 7fe10132a700 1 --2- 172.21.15.26:0/3619391037 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0fc0f6860 0x7fe0fc10e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:01:01.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.901+0000 7fe101b2b700 1 --2- 172.21.15.26:0/3619391037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0fc0f55c0 0x7fe0fc10c070 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fe0ec00c790 tx=0x7fe0ec007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:01:01.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.901+0000 7fe0f27fc700 1 -- 172.21.15.26:0/3619391037 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0ec00e680 con 0x7fe0fc0f55c0 2021-11-03T17:01:01.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.901+0000 7fe0f27fc700 1 -- 172.21.15.26:0/3619391037 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe0ec00ec90 con 0x7fe0fc0f55c0 2021-11-03T17:01:01.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.901+0000 7fe103d8f700 1 -- 172.21.15.26:0/3619391037 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0fc10ea60 con 0x7fe0fc0f55c0 2021-11-03T17:01:01.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.901+0000 7fe0f27fc700 1 -- 172.21.15.26:0/3619391037 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0ec012d00 con 0x7fe0fc0f55c0 2021-11-03T17:01:01.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.902+0000 7fe103d8f700 1 -- 172.21.15.26:0/3619391037 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0fc10eee0 con 0x7fe0fc0f55c0 2021-11-03T17:01:01.906 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.903+0000 7fe103d8f700 1 -- 172.21.15.26:0/3619391037 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0fc045ad0 con 0x7fe0fc0f55c0 2021-11-03T17:01:01.906 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.903+0000 7fe0f27fc700 1 -- 172.21.15.26:0/3619391037 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fe0ec010070 con 0x7fe0fc0f55c0 2021-11-03T17:01:01.906 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.903+0000 7fe0f27fc700 1 --2- 172.21.15.26:0/3619391037 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe0e80640b0 0x7fe0e8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:01:01.907 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.903+0000 7fe0f27fc700 1 -- 172.21.15.26:0/3619391037 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fe0ec080900 con 0x7fe0fc0f55c0 2021-11-03T17:01:01.907 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.903+0000 7fe10132a700 1 --2- 172.21.15.26:0/3619391037 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe0e80640b0 0x7fe0e8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:01:01.907 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.904+0000 7fe10132a700 1 --2- 172.21.15.26:0/3619391037 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe0e80640b0 0x7fe0e8066570 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fe0f8009da0 tx=0x7fe0f8009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:01:01.907 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:01.908+0000 7fe0f27fc700 1 -- 172.21.15.26:0/3619391037 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fe0ec052b10 con 0x7fe0fc0f55c0 2021-11-03T17:01:02.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.083+0000 7fe103d8f700 1 -- 172.21.15.26:0/3619391037 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0fc0fde90 con 0x7fe0e80640b0 2021-11-03T17:01:02.094 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.098+0000 7fe0f27fc700 1 -- 172.21.15.26:0/3619391037 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fe0fc0fde90 con 0x7fe0e80640b0 2021-11-03T17:01:02.094 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:01:02.094 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (12m) 2m ago 13m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:01:02.095 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (4m) 2m ago 13m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:01:02.095 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (4m) 98s ago 12m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:01:02.095 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (12m) 2m ago 13m 38.9M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:01:02.095 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (5m) 2m ago 8m 13.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:01:02.096 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (5m) 2m ago 8m 14.7M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:01:02.096 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (8m) 98s ago 8m 16.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:01:02.096 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (8m) 98s ago 8m 16.5M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:01:02.096 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (6m) 2m ago 14m 468M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:01:02.096 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (5m) 98s ago 12m 412M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:01:02.097 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (5m) 2m ago 14m 75.8M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:01:02.097 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (5m) 98s ago 12m 66.4M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:01:02.097 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (13m) 2m ago 13m 18.1M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:01:02.097 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (12m) 98s ago 12m 18.3M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:01:02.098 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (4m) 2m ago 11m 153M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:01:02.098 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (3m) 2m ago 11m 166M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:01:02.098 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (3m) 2m ago 11m 11.2M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:01:02.098 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (2m) 98s ago 10m 181M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:01:02.099 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (2m) 98s ago 10m 185M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:01:02.099 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (101s) 98s ago 10m 13.5M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:01:02.099 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (11m) 2m ago 12m 47.5M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:01:02.100 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.100+0000 7fe103d8f700 1 -- 172.21.15.26:0/3619391037 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe0e80640b0 msgr2=0x7fe0e8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:01:02.100 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.100+0000 7fe103d8f700 1 --2- 172.21.15.26:0/3619391037 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe0e80640b0 0x7fe0e8066570 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fe0f8009da0 tx=0x7fe0f8009b30).stop 2021-11-03T17:01:02.100 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.100+0000 7fe103d8f700 1 -- 172.21.15.26:0/3619391037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0fc0f55c0 msgr2=0x7fe0fc10c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:01:02.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.100+0000 7fe103d8f700 1 --2- 172.21.15.26:0/3619391037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0fc0f55c0 0x7fe0fc10c070 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fe0ec00c790 tx=0x7fe0ec007d90).stop 2021-11-03T17:01:02.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.100+0000 7fe103d8f700 1 -- 172.21.15.26:0/3619391037 shutdown_connections 2021-11-03T17:01:02.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.100+0000 7fe103d8f700 1 --2- 172.21.15.26:0/3619391037 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe0e80640b0 0x7fe0e8066570 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:02.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.100+0000 7fe103d8f700 1 --2- 172.21.15.26:0/3619391037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0fc0f55c0 0x7fe0fc10c070 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:02.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.100+0000 7fe103d8f700 1 --2- 172.21.15.26:0/3619391037 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0fc0f6860 0x7fe0fc10e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:02.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.100+0000 7fe103d8f700 1 -- 172.21.15.26:0/3619391037 >> 172.21.15.26:0/3619391037 conn(0x7fe0fc0f0d40 msgr2=0x7fe0fc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:01:02.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.100+0000 7fe103d8f700 1 -- 172.21.15.26:0/3619391037 shutdown_connections 2021-11-03T17:01:02.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.100+0000 7fe103d8f700 1 -- 172.21.15.26:0/3619391037 wait complete. 2021-11-03T17:01:02.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:01 smithi026 ceph-mon[96795]: pgmap v191: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:02.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.199+0000 7f3adb59e700 1 -- 172.21.15.26:0/2157114785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3adc0f7480 msgr2=0x7f3adc0f9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:01:02.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.199+0000 7f3adb59e700 1 --2- 172.21.15.26:0/2157114785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3adc0f7480 0x7f3adc0f9910 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f3ad0004660 tx=0x7f3ad0009b30).stop 2021-11-03T17:01:02.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.200+0000 7f3adb59e700 1 -- 172.21.15.26:0/2157114785 shutdown_connections 2021-11-03T17:01:02.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.200+0000 7f3adb59e700 1 --2- 172.21.15.26:0/2157114785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3adc0f7480 0x7f3adc0f9910 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:02.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.200+0000 7f3adb59e700 1 --2- 172.21.15.26:0/2157114785 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3adc060310 0x7f3adc0f6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:02.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.200+0000 7f3adb59e700 1 -- 172.21.15.26:0/2157114785 >> 172.21.15.26:0/2157114785 conn(0x7f3adc0f0b90 msgr2=0x7f3adc0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:01:02.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.200+0000 7f3adb59e700 1 -- 172.21.15.26:0/2157114785 shutdown_connections 2021-11-03T17:01:02.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.200+0000 7f3adb59e700 1 -- 172.21.15.26:0/2157114785 wait complete. 2021-11-03T17:01:02.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.200+0000 7f3adb59e700 1 Processor -- start 2021-11-03T17:01:02.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.200+0000 7f3adb59e700 1 -- start start 2021-11-03T17:01:02.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.200+0000 7f3adb59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3adc060310 0x7f3adc10d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:01:02.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.200+0000 7f3adb59e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3adc0f7480 0x7f3adc10d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:01:02.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.200+0000 7f3adb59e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc10ddd0 con 0x7f3adc060310 2021-11-03T17:01:02.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.200+0000 7f3adb59e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc10df10 con 0x7f3adc0f7480 2021-11-03T17:01:02.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.200+0000 7f3ada59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3adc060310 0x7f3adc10d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:01:02.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.200+0000 7f3ada59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3adc060310 0x7f3adc10d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52006/0 (socket says 172.21.15.26:52006) 2021-11-03T17:01:02.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.200+0000 7f3ada59c700 1 -- 172.21.15.26:0/1235966201 learned_addr learned my addr 172.21.15.26:0/1235966201 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:01:02.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.201+0000 7f3ad9d9b700 1 --2- 172.21.15.26:0/1235966201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3adc0f7480 0x7f3adc10d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:01:02.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.201+0000 7f3ada59c700 1 -- 172.21.15.26:0/1235966201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3adc0f7480 msgr2=0x7f3adc10d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:01:02.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.201+0000 7f3ada59c700 1 --2- 172.21.15.26:0/1235966201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3adc0f7480 0x7f3adc10d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:02.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.201+0000 7f3ada59c700 1 -- 172.21.15.26:0/1235966201 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad0005040 con 0x7f3adc060310 2021-11-03T17:01:02.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.201+0000 7f3ada59c700 1 --2- 172.21.15.26:0/1235966201 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3adc060310 0x7f3adc10d330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f3acc0026d0 tx=0x7f3acc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:01:02.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.201+0000 7f3acaffd700 1 -- 172.21.15.26:0/1235966201 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3acc009320 con 0x7f3adc060310 2021-11-03T17:01:02.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.201+0000 7f3adb59e700 1 -- 172.21.15.26:0/1235966201 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3adc10e8b0 con 0x7f3adc060310 2021-11-03T17:01:02.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.201+0000 7f3acaffd700 1 -- 172.21.15.26:0/1235966201 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3acc00f040 con 0x7f3adc060310 2021-11-03T17:01:02.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.201+0000 7f3acaffd700 1 -- 172.21.15.26:0/1235966201 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3acc0147e0 con 0x7f3adc060310 2021-11-03T17:01:02.213 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.201+0000 7f3adb59e700 1 -- 172.21.15.26:0/1235966201 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3adc10ee70 con 0x7f3adc060310 2021-11-03T17:01:02.213 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.202+0000 7f3adb59e700 1 -- 172.21.15.26:0/1235966201 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3adc045ad0 con 0x7f3adc060310 2021-11-03T17:01:02.213 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.202+0000 7f3acaffd700 1 -- 172.21.15.26:0/1235966201 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f3acc009480 con 0x7f3adc060310 2021-11-03T17:01:02.214 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.203+0000 7f3acaffd700 1 --2- 172.21.15.26:0/1235966201 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3ac4064100 0x7f3ac40665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:01:02.214 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.203+0000 7f3acaffd700 1 -- 172.21.15.26:0/1235966201 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f3acc080a10 con 0x7f3adc060310 2021-11-03T17:01:02.214 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.203+0000 7f3ad9d9b700 1 --2- 172.21.15.26:0/1235966201 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3ac4064100 0x7f3ac40665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:01:02.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.203+0000 7f3ad9d9b700 1 --2- 172.21.15.26:0/1235966201 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3ac4064100 0x7f3ac40665c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f3ad0000c00 tx=0x7f3ad0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:01:02.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.207+0000 7f3acaffd700 1 -- 172.21.15.26:0/1235966201 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f3acc052c80 con 0x7f3adc060310 2021-11-03T17:01:02.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:01 smithi194 ceph-mon[65619]: pgmap v191: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:02.433 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.437+0000 7f3adb59e700 1 -- 172.21.15.26:0/1235966201 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3adc105460 con 0x7f3adc060310 2021-11-03T17:01:02.434 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.438+0000 7f3acaffd700 1 -- 172.21.15.26:0/1235966201 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f3acc052870 con 0x7f3adc060310 2021-11-03T17:01:02.434 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:01:02.435 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:01:02.435 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:01:02.435 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:01:02.435 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:01:02.436 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:01:02.436 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:01:02.436 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:01:02.436 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:01:02.436 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:01:02.437 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:01:02.437 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:01:02.437 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:01:02.437 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:01:02.438 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:01:02.438 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:01:02.438 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:01:02.438 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:01:02.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.439+0000 7f3adb59e700 1 -- 172.21.15.26:0/1235966201 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3ac4064100 msgr2=0x7f3ac40665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:01:02.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.439+0000 7f3adb59e700 1 --2- 172.21.15.26:0/1235966201 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3ac4064100 0x7f3ac40665c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f3ad0000c00 tx=0x7f3ad0009b30).stop 2021-11-03T17:01:02.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.439+0000 7f3adb59e700 1 -- 172.21.15.26:0/1235966201 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3adc060310 msgr2=0x7f3adc10d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:01:02.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.439+0000 7f3adb59e700 1 --2- 172.21.15.26:0/1235966201 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3adc060310 0x7f3adc10d330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f3acc0026d0 tx=0x7f3acc009de0).stop 2021-11-03T17:01:02.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.440+0000 7f3adb59e700 1 -- 172.21.15.26:0/1235966201 shutdown_connections 2021-11-03T17:01:02.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.440+0000 7f3adb59e700 1 --2- 172.21.15.26:0/1235966201 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3ac4064100 0x7f3ac40665c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:02.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.440+0000 7f3adb59e700 1 --2- 172.21.15.26:0/1235966201 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3adc060310 0x7f3adc10d330 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:02.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.440+0000 7f3adb59e700 1 --2- 172.21.15.26:0/1235966201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3adc0f7480 0x7f3adc10d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:02.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.440+0000 7f3adb59e700 1 -- 172.21.15.26:0/1235966201 >> 172.21.15.26:0/1235966201 conn(0x7f3adc0f0b90 msgr2=0x7f3adc0f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:01:02.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.440+0000 7f3adb59e700 1 -- 172.21.15.26:0/1235966201 shutdown_connections 2021-11-03T17:01:02.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.440+0000 7f3adb59e700 1 -- 172.21.15.26:0/1235966201 wait complete. 2021-11-03T17:01:02.538 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.540+0000 7f7e80c3c700 1 -- 172.21.15.26:0/433429983 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e7c0f55e0 msgr2=0x7f7e7c0f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:01:02.539 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.540+0000 7f7e80c3c700 1 --2- 172.21.15.26:0/433429983 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e7c0f55e0 0x7f7e7c0f5a00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f7e6c004660 tx=0x7f7e6c009b30).stop 2021-11-03T17:01:02.539 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.541+0000 7f7e80c3c700 1 -- 172.21.15.26:0/433429983 shutdown_connections 2021-11-03T17:01:02.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.541+0000 7f7e80c3c700 1 --2- 172.21.15.26:0/433429983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e7c0f5ef0 0x7f7e7c0f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:02.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.541+0000 7f7e80c3c700 1 --2- 172.21.15.26:0/433429983 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e7c0f55e0 0x7f7e7c0f5a00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:02.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.541+0000 7f7e80c3c700 1 -- 172.21.15.26:0/433429983 >> 172.21.15.26:0/433429983 conn(0x7f7e7c0f0de0 msgr2=0x7f7e7c0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:01:02.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.541+0000 7f7e80c3c700 1 -- 172.21.15.26:0/433429983 shutdown_connections 2021-11-03T17:01:02.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.541+0000 7f7e80c3c700 1 -- 172.21.15.26:0/433429983 wait complete. 2021-11-03T17:01:02.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.541+0000 7f7e80c3c700 1 Processor -- start 2021-11-03T17:01:02.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.541+0000 7f7e80c3c700 1 -- start start 2021-11-03T17:01:02.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.541+0000 7f7e80c3c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e7c0f55e0 0x7f7e7c109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:01:02.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.541+0000 7f7e80c3c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e7c0f5ef0 0x7f7e7c10c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:01:02.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.541+0000 7f7e80c3c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7c060500 con 0x7f7e7c0f5ef0 2021-11-03T17:01:02.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.541+0000 7f7e80c3c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7c060640 con 0x7f7e7c0f55e0 2021-11-03T17:01:02.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.541+0000 7f7e79d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e7c0f5ef0 0x7f7e7c10c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:01:02.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.541+0000 7f7e79d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e7c0f5ef0 0x7f7e7c10c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52018/0 (socket says 172.21.15.26:52018) 2021-11-03T17:01:02.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.542+0000 7f7e79d9b700 1 -- 172.21.15.26:0/2428446639 learned_addr learned my addr 172.21.15.26:0/2428446639 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:01:02.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.542+0000 7f7e7a59c700 1 --2- 172.21.15.26:0/2428446639 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e7c0f55e0 0x7f7e7c109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:01:02.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.542+0000 7f7e79d9b700 1 -- 172.21.15.26:0/2428446639 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e7c0f55e0 msgr2=0x7f7e7c109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:01:02.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.542+0000 7f7e79d9b700 1 --2- 172.21.15.26:0/2428446639 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e7c0f55e0 0x7f7e7c109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:02.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.542+0000 7f7e79d9b700 1 -- 172.21.15.26:0/2428446639 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e6c005040 con 0x7f7e7c0f5ef0 2021-11-03T17:01:02.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.542+0000 7f7e79d9b700 1 --2- 172.21.15.26:0/2428446639 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e7c0f5ef0 0x7f7e7c10c190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f7e700026d0 tx=0x7f7e70009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:01:02.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.542+0000 7f7e6affd700 1 -- 172.21.15.26:0/2428446639 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e700079c0 con 0x7f7e7c0f5ef0 2021-11-03T17:01:02.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.542+0000 7f7e6affd700 1 -- 172.21.15.26:0/2428446639 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7e7000f040 con 0x7f7e7c0f5ef0 2021-11-03T17:01:02.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.542+0000 7f7e80c3c700 1 -- 172.21.15.26:0/2428446639 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e7c10c740 con 0x7f7e7c0f5ef0 2021-11-03T17:01:02.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.542+0000 7f7e6affd700 1 -- 172.21.15.26:0/2428446639 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e700148b0 con 0x7f7e7c0f5ef0 2021-11-03T17:01:02.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.542+0000 7f7e80c3c700 1 -- 172.21.15.26:0/2428446639 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e7c10cd00 con 0x7f7e7c0f5ef0 2021-11-03T17:01:02.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.543+0000 7f7e80c3c700 1 -- 172.21.15.26:0/2428446639 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e7c045ad0 con 0x7f7e7c0f5ef0 2021-11-03T17:01:02.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.543+0000 7f7e6affd700 1 -- 172.21.15.26:0/2428446639 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f7e70007b20 con 0x7f7e7c0f5ef0 2021-11-03T17:01:02.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.544+0000 7f7e6affd700 1 --2- 172.21.15.26:0/2428446639 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7e640640b0 0x7f7e64066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:01:02.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.544+0000 7f7e6affd700 1 -- 172.21.15.26:0/2428446639 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f7e70080730 con 0x7f7e7c0f5ef0 2021-11-03T17:01:02.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.544+0000 7f7e7a59c700 1 --2- 172.21.15.26:0/2428446639 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7e640640b0 0x7f7e64066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:01:02.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.544+0000 7f7e7a59c700 1 --2- 172.21.15.26:0/2428446639 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7e640640b0 0x7f7e64066570 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f7e6c004630 tx=0x7f7e6c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:01:02.548 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.548+0000 7f7e6affd700 1 -- 172.21.15.26:0/2428446639 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f7e70052a90 con 0x7f7e7c0f5ef0 2021-11-03T17:01:02.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.752+0000 7f7e80c3c700 1 -- 172.21.15.26:0/2428446639 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7e7c027a00 con 0x7f7e7c0f5ef0 2021-11-03T17:01:02.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.753+0000 7f7e6affd700 1 -- 172.21.15.26:0/2428446639 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f7e70052680 con 0x7f7e7c0f5ef0 2021-11-03T17:01:02.749 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:01:02.750 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:01:02.750 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:01:02.750 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:01:02.750 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:01:02.751 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:01:02.751 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:01:02.751 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:01:02.752 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:01:02.752 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:01:02.752 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:01:02.752 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:01:02.753 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:01:02.753 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:01:02.753 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:01:02.753 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:01:02.754 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:01:02.754 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:01:02.754 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:01:02.754 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:01:02.755 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:01:02.755 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:01:02.755 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:01:02.756 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:01:02.756 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:01:02.756 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:01:02.756 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:01:02.756 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:01:02.757 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:01:02.757 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:01:02.757 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:01:02.758 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:01:02.758 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:01:02.758 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:01:02.758 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:01:02.759 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:01:02.759 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:01:02.759 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:01:02.759 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:01:02.761 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.755+0000 7f7e80c3c700 1 -- 172.21.15.26:0/2428446639 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7e640640b0 msgr2=0x7f7e64066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:01:02.761 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.755+0000 7f7e80c3c700 1 --2- 172.21.15.26:0/2428446639 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7e640640b0 0x7f7e64066570 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f7e6c004630 tx=0x7f7e6c009b30).stop 2021-11-03T17:01:02.761 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.755+0000 7f7e80c3c700 1 -- 172.21.15.26:0/2428446639 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e7c0f5ef0 msgr2=0x7f7e7c10c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:01:02.761 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.755+0000 7f7e80c3c700 1 --2- 172.21.15.26:0/2428446639 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e7c0f5ef0 0x7f7e7c10c190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f7e700026d0 tx=0x7f7e70009de0).stop 2021-11-03T17:01:02.762 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.755+0000 7f7e80c3c700 1 -- 172.21.15.26:0/2428446639 shutdown_connections 2021-11-03T17:01:02.762 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.755+0000 7f7e80c3c700 1 --2- 172.21.15.26:0/2428446639 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7e640640b0 0x7f7e64066570 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:02.762 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.755+0000 7f7e80c3c700 1 --2- 172.21.15.26:0/2428446639 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e7c0f55e0 0x7f7e7c109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:02.763 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.755+0000 7f7e80c3c700 1 --2- 172.21.15.26:0/2428446639 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e7c0f5ef0 0x7f7e7c10c190 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:02.763 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.755+0000 7f7e80c3c700 1 -- 172.21.15.26:0/2428446639 >> 172.21.15.26:0/2428446639 conn(0x7f7e7c0f0de0 msgr2=0x7f7e7c0fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:01:02.763 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.755+0000 7f7e80c3c700 1 -- 172.21.15.26:0/2428446639 shutdown_connections 2021-11-03T17:01:02.763 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:02.755+0000 7f7e80c3c700 1 -- 172.21.15.26:0/2428446639 wait complete. 2021-11-03T17:01:02.764 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:01:03.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:02 smithi026 ceph-mon[96795]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:01:03.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:02 smithi026 ceph-mon[96795]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:01:03.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:02 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1235966201' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:01:03.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:02 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2428446639' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:01:03.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:02 smithi194 ceph-mon[65619]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:01:03.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:02 smithi194 ceph-mon[65619]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:01:03.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:02 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1235966201' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:01:03.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:02 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2428446639' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:01:04.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:03 smithi026 ceph-mon[96795]: pgmap v192: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:04.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:03 smithi194 ceph-mon[65619]: pgmap v192: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:06.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:05 smithi026 ceph-mon[96795]: pgmap v193: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:06.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:05 smithi194 ceph-mon[65619]: pgmap v193: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:08.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:07 smithi026 ceph-mon[96795]: pgmap v194: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:08.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:07 smithi194 ceph-mon[65619]: pgmap v194: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:10.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:09 smithi026 ceph-mon[96795]: pgmap v195: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:10.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:09 smithi194 ceph-mon[65619]: pgmap v195: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:11.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:10 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:01:11.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:10 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:01:12.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:11 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:01:12.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:11 smithi026 ceph-mon[96795]: pgmap v196: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:12.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:11 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:01:12.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:11 smithi194 ceph-mon[65619]: pgmap v196: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:14.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:13 smithi026 ceph-mon[96795]: pgmap v197: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:14.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:13 smithi194 ceph-mon[65619]: pgmap v197: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:16.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:15 smithi026 ceph-mon[96795]: pgmap v198: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:16.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:15 smithi194 ceph-mon[65619]: pgmap v198: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:18.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:17 smithi026 ceph-mon[96795]: pgmap v199: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:18.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:17 smithi194 ceph-mon[65619]: pgmap v199: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:20.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:19 smithi026 ceph-mon[96795]: pgmap v200: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:20.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:19 smithi194 ceph-mon[65619]: pgmap v200: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:22.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:21 smithi026 ceph-mon[96795]: pgmap v201: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:22.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:21 smithi194 ceph-mon[65619]: pgmap v201: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:24.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:23 smithi026 ceph-mon[96795]: pgmap v202: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:24.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:23 smithi194 ceph-mon[65619]: pgmap v202: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:25.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:25 smithi194 ceph-mon[65619]: pgmap v203: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:25.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:01:25.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:01:25.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:01:25.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:01:25.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:01:25.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:01:25.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:01:25.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:01:26.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:25 smithi026 ceph-mon[96795]: pgmap v203: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:26.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:01:26.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:01:26.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:01:26.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:01:26.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:01:26.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:01:26.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:01:26.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:01:27.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:26 smithi026 ceph-mon[96795]: poll took 60065.292 ms: 1 events 2021-11-03T17:01:27.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:26 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:01:27.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:26 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:01:27.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:26 smithi194 ceph-mon[65619]: poll took 60065.292 ms: 1 events 2021-11-03T17:01:27.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:26 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:01:27.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:26 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:01:28.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:27 smithi026 ceph-mon[96795]: pgmap v204: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:28.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:27 smithi194 ceph-mon[65619]: pgmap v204: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:30.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:29 smithi026 ceph-mon[96795]: pgmap v205: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:30.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:29 smithi194 ceph-mon[65619]: pgmap v205: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:32.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:31 smithi026 ceph-mon[96795]: pgmap v206: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:32.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:31 smithi194 ceph-mon[65619]: pgmap v206: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:32.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:32.872+0000 7fbe245b7700 1 -- 172.21.15.26:0/3971430566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe1c0f66e0 msgr2=0x7fbe1c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:01:32.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:32.872+0000 7fbe245b7700 1 --2- 172.21.15.26:0/3971430566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe1c0f66e0 0x7fbe1c0f6b00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fbe18004660 tx=0x7fbe18009b30).stop 2021-11-03T17:01:32.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:32.872+0000 7fbe245b7700 1 -- 172.21.15.26:0/3971430566 shutdown_connections 2021-11-03T17:01:32.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:32.872+0000 7fbe245b7700 1 --2- 172.21.15.26:0/3971430566 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe1c0f7980 0x7fbe1c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:32.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:32.872+0000 7fbe245b7700 1 --2- 172.21.15.26:0/3971430566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe1c0f66e0 0x7fbe1c0f6b00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:32.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:32.872+0000 7fbe245b7700 1 -- 172.21.15.26:0/3971430566 >> 172.21.15.26:0/3971430566 conn(0x7fbe1c0f1e40 msgr2=0x7fbe1c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:01:32.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:32.872+0000 7fbe245b7700 1 -- 172.21.15.26:0/3971430566 shutdown_connections 2021-11-03T17:01:32.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:32.872+0000 7fbe245b7700 1 -- 172.21.15.26:0/3971430566 wait complete. 2021-11-03T17:01:32.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:32.873+0000 7fbe245b7700 1 Processor -- start 2021-11-03T17:01:32.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:32.873+0000 7fbe245b7700 1 -- start start 2021-11-03T17:01:32.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:32.873+0000 7fbe245b7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe1c0f66e0 0x7fbe1c106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:01:32.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:32.873+0000 7fbe245b7700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe1c0f7980 0x7fbe1c1074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:01:32.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:32.873+0000 7fbe245b7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c107a50 con 0x7fbe1c0f66e0 2021-11-03T17:01:32.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:32.873+0000 7fbe245b7700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c107b90 con 0x7fbe1c0f7980 2021-11-03T17:01:32.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:32.873+0000 7fbe22353700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe1c0f66e0 0x7fbe1c106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:01:32.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:32.873+0000 7fbe22353700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe1c0f66e0 0x7fbe1c106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52034/0 (socket says 172.21.15.26:52034) 2021-11-03T17:01:32.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:32.873+0000 7fbe22353700 1 -- 172.21.15.26:0/2061433304 learned_addr learned my addr 172.21.15.26:0/2061433304 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:01:32.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:32.873+0000 7fbe21b52700 1 --2- 172.21.15.26:0/2061433304 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe1c0f7980 0x7fbe1c1074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:01:32.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:32.873+0000 7fbe22353700 1 -- 172.21.15.26:0/2061433304 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe1c0f7980 msgr2=0x7fbe1c1074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:01:32.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:32.873+0000 7fbe22353700 1 --2- 172.21.15.26:0/2061433304 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe1c0f7980 0x7fbe1c1074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:32.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:32.873+0000 7fbe22353700 1 -- 172.21.15.26:0/2061433304 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe18005040 con 0x7fbe1c0f66e0 2021-11-03T17:01:32.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:32.873+0000 7fbe21b52700 1 --2- 172.21.15.26:0/2061433304 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe1c0f7980 0x7fbe1c1074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:01:32.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:32.874+0000 7fbe22353700 1 --2- 172.21.15.26:0/2061433304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe1c0f66e0 0x7fbe1c106fb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fbe18013a70 tx=0x7fbe18009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:01:32.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:32.874+0000 7fbe0effd700 1 -- 172.21.15.26:0/2061433304 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe18018070 con 0x7fbe1c0f66e0 2021-11-03T17:01:32.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:32.874+0000 7fbe0effd700 1 -- 172.21.15.26:0/2061433304 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbe180097d0 con 0x7fbe1c0f66e0 2021-11-03T17:01:32.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:32.874+0000 7fbe245b7700 1 -- 172.21.15.26:0/2061433304 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe1c1084d0 con 0x7fbe1c0f66e0 2021-11-03T17:01:32.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:32.874+0000 7fbe0effd700 1 -- 172.21.15.26:0/2061433304 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe1801c3c0 con 0x7fbe1c0f66e0 2021-11-03T17:01:32.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:32.874+0000 7fbe245b7700 1 -- 172.21.15.26:0/2061433304 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe1c108a30 con 0x7fbe1c0f66e0 2021-11-03T17:01:32.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:32.875+0000 7fbe245b7700 1 -- 172.21.15.26:0/2061433304 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe1c045ad0 con 0x7fbe1c0f66e0 2021-11-03T17:01:32.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:32.875+0000 7fbe0effd700 1 -- 172.21.15.26:0/2061433304 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fbe18007ba0 con 0x7fbe1c0f66e0 2021-11-03T17:01:32.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:32.875+0000 7fbe0effd700 1 --2- 172.21.15.26:0/2061433304 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbe080640b0 0x7fbe08066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:01:32.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:32.876+0000 7fbe0effd700 1 -- 172.21.15.26:0/2061433304 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fbe180824b0 con 0x7fbe1c0f66e0 2021-11-03T17:01:32.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:32.876+0000 7fbe21b52700 1 --2- 172.21.15.26:0/2061433304 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbe080640b0 0x7fbe08066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:01:32.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:32.876+0000 7fbe21b52700 1 --2- 172.21.15.26:0/2061433304 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbe080640b0 0x7fbe08066570 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fbe10009740 tx=0x7fbe10009be0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:01:32.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:32.880+0000 7fbe0effd700 1 -- 172.21.15.26:0/2061433304 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fbe18054810 con 0x7fbe1c0f66e0 2021-11-03T17:01:33.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.061+0000 7fbe245b7700 1 -- 172.21.15.26:0/2061433304 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbe1c0ff020 con 0x7fbe080640b0 2021-11-03T17:01:33.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.062+0000 7fbe0effd700 1 -- 172.21.15.26:0/2061433304 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fbe1c0ff020 con 0x7fbe080640b0 2021-11-03T17:01:33.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.064+0000 7fbe245b7700 1 -- 172.21.15.26:0/2061433304 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbe080640b0 msgr2=0x7fbe08066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:01:33.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.064+0000 7fbe245b7700 1 --2- 172.21.15.26:0/2061433304 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbe080640b0 0x7fbe08066570 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fbe10009740 tx=0x7fbe10009be0).stop 2021-11-03T17:01:33.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.064+0000 7fbe245b7700 1 -- 172.21.15.26:0/2061433304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe1c0f66e0 msgr2=0x7fbe1c106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:01:33.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.064+0000 7fbe245b7700 1 --2- 172.21.15.26:0/2061433304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe1c0f66e0 0x7fbe1c106fb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fbe18013a70 tx=0x7fbe18009b30).stop 2021-11-03T17:01:33.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.064+0000 7fbe245b7700 1 -- 172.21.15.26:0/2061433304 shutdown_connections 2021-11-03T17:01:33.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.064+0000 7fbe245b7700 1 --2- 172.21.15.26:0/2061433304 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbe080640b0 0x7fbe08066570 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:33.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.064+0000 7fbe245b7700 1 --2- 172.21.15.26:0/2061433304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe1c0f66e0 0x7fbe1c106fb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:33.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.064+0000 7fbe245b7700 1 --2- 172.21.15.26:0/2061433304 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe1c0f7980 0x7fbe1c1074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:33.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.064+0000 7fbe245b7700 1 -- 172.21.15.26:0/2061433304 >> 172.21.15.26:0/2061433304 conn(0x7fbe1c0f1e40 msgr2=0x7fbe1c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:01:33.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.064+0000 7fbe245b7700 1 -- 172.21.15.26:0/2061433304 shutdown_connections 2021-11-03T17:01:33.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.064+0000 7fbe245b7700 1 -- 172.21.15.26:0/2061433304 wait complete. 2021-11-03T17:01:33.069 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:01:33.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.164+0000 7fea6eb4c700 1 -- 172.21.15.26:0/4095704545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea680f96d0 msgr2=0x7fea680fbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:01:33.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.164+0000 7fea6eb4c700 1 --2- 172.21.15.26:0/4095704545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea680f96d0 0x7fea680fbb00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fea58004660 tx=0x7fea58009b30).stop 2021-11-03T17:01:33.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.164+0000 7fea6eb4c700 1 -- 172.21.15.26:0/4095704545 shutdown_connections 2021-11-03T17:01:33.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.164+0000 7fea6eb4c700 1 --2- 172.21.15.26:0/4095704545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea680f96d0 0x7fea680fbb00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:33.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.164+0000 7fea6eb4c700 1 --2- 172.21.15.26:0/4095704545 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea68060250 0x7fea680f91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:33.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.164+0000 7fea6eb4c700 1 -- 172.21.15.26:0/4095704545 >> 172.21.15.26:0/4095704545 conn(0x7fea680f0ba0 msgr2=0x7fea680f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:01:33.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.165+0000 7fea6eb4c700 1 -- 172.21.15.26:0/4095704545 shutdown_connections 2021-11-03T17:01:33.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.165+0000 7fea6eb4c700 1 -- 172.21.15.26:0/4095704545 wait complete. 2021-11-03T17:01:33.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.165+0000 7fea6eb4c700 1 Processor -- start 2021-11-03T17:01:33.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.165+0000 7fea6eb4c700 1 -- start start 2021-11-03T17:01:33.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.165+0000 7fea6eb4c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea68060250 0x7fea68106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:01:33.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.165+0000 7fea6eb4c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea680f96d0 0x7fea68107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:01:33.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.165+0000 7fea6eb4c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea68107910 con 0x7fea680f96d0 2021-11-03T17:01:33.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.165+0000 7fea6eb4c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea68108120 con 0x7fea68060250 2021-11-03T17:01:33.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.165+0000 7fea6d349700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea680f96d0 0x7fea68107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:01:33.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.165+0000 7fea6d349700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea680f96d0 0x7fea68107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52046/0 (socket says 172.21.15.26:52046) 2021-11-03T17:01:33.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.165+0000 7fea6d349700 1 -- 172.21.15.26:0/61693828 learned_addr learned my addr 172.21.15.26:0/61693828 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:01:33.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.166+0000 7fea6db4a700 1 --2- 172.21.15.26:0/61693828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea68060250 0x7fea68106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:01:33.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.166+0000 7fea6d349700 1 -- 172.21.15.26:0/61693828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea68060250 msgr2=0x7fea68106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:01:33.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.166+0000 7fea6d349700 1 --2- 172.21.15.26:0/61693828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea68060250 0x7fea68106e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:33.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.166+0000 7fea6d349700 1 -- 172.21.15.26:0/61693828 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea58005040 con 0x7fea680f96d0 2021-11-03T17:01:33.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.166+0000 7fea6db4a700 1 --2- 172.21.15.26:0/61693828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea68060250 0x7fea68106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:01:33.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.166+0000 7fea6d349700 1 --2- 172.21.15.26:0/61693828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea680f96d0 0x7fea68107310 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fea58000c00 tx=0x7fea58009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:01:33.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.166+0000 7fea5e7fc700 1 -- 172.21.15.26:0/61693828 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea58018070 con 0x7fea680f96d0 2021-11-03T17:01:33.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.166+0000 7fea6eb4c700 1 -- 172.21.15.26:0/61693828 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea68108340 con 0x7fea680f96d0 2021-11-03T17:01:33.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.166+0000 7fea5e7fc700 1 -- 172.21.15.26:0/61693828 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fea580097d0 con 0x7fea680f96d0 2021-11-03T17:01:33.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.166+0000 7fea5e7fc700 1 -- 172.21.15.26:0/61693828 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea5801c3c0 con 0x7fea680f96d0 2021-11-03T17:01:33.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.166+0000 7fea6eb4c700 1 -- 172.21.15.26:0/61693828 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea681088a0 con 0x7fea680f96d0 2021-11-03T17:01:33.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.167+0000 7fea6eb4c700 1 -- 172.21.15.26:0/61693828 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea68059100 con 0x7fea680f96d0 2021-11-03T17:01:33.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.167+0000 7fea5e7fc700 1 -- 172.21.15.26:0/61693828 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fea5801d420 con 0x7fea680f96d0 2021-11-03T17:01:33.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.168+0000 7fea5e7fc700 1 --2- 172.21.15.26:0/61693828 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fea54064100 0x7fea540665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:01:33.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.168+0000 7fea5e7fc700 1 -- 172.21.15.26:0/61693828 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fea58082530 con 0x7fea680f96d0 2021-11-03T17:01:33.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.168+0000 7fea6db4a700 1 --2- 172.21.15.26:0/61693828 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fea54064100 0x7fea540665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:01:33.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.168+0000 7fea6db4a700 1 --2- 172.21.15.26:0/61693828 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fea54064100 0x7fea540665c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fea68106b90 tx=0x7fea6400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:01:33.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.172+0000 7fea5e7fc700 1 -- 172.21.15.26:0/61693828 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fea580548d0 con 0x7fea680f96d0 2021-11-03T17:01:33.339 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.344+0000 7fea6eb4c700 1 -- 172.21.15.26:0/61693828 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fea680feea0 con 0x7fea54064100 2021-11-03T17:01:33.354 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.359+0000 7fea5e7fc700 1 -- 172.21.15.26:0/61693828 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fea680feea0 con 0x7fea54064100 2021-11-03T17:01:33.354 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:01:33.355 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (12m) 3m ago 14m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:01:33.355 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (5m) 3m ago 14m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:01:33.356 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (4m) 2m ago 13m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:01:33.356 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (12m) 3m ago 13m 38.9M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:01:33.356 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (5m) 3m ago 9m 13.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:01:33.357 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (6m) 3m ago 9m 14.7M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:01:33.357 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (9m) 2m ago 9m 16.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:01:33.357 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (9m) 2m ago 9m 16.5M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:01:33.357 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (6m) 3m ago 15m 468M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:01:33.358 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (6m) 2m ago 13m 412M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:01:33.358 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (5m) 3m ago 15m 75.8M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:01:33.358 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (5m) 2m ago 13m 66.4M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:01:33.358 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (13m) 3m ago 13m 18.1M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:01:33.358 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (13m) 2m ago 13m 18.3M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:01:33.359 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (4m) 3m ago 12m 153M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:01:33.359 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (4m) 3m ago 12m 166M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:01:33.359 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (3m) 3m ago 11m 11.2M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:01:33.359 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (3m) 2m ago 11m 181M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:01:33.360 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (2m) 2m ago 11m 185M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:01:33.360 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (2m) 2m ago 10m 13.5M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:01:33.360 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (12m) 3m ago 13m 47.5M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:01:33.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.360+0000 7fea6eb4c700 1 -- 172.21.15.26:0/61693828 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fea54064100 msgr2=0x7fea540665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:01:33.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.360+0000 7fea6eb4c700 1 --2- 172.21.15.26:0/61693828 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fea54064100 0x7fea540665c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fea68106b90 tx=0x7fea6400b040).stop 2021-11-03T17:01:33.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.360+0000 7fea6eb4c700 1 -- 172.21.15.26:0/61693828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea680f96d0 msgr2=0x7fea68107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:01:33.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.361+0000 7fea6eb4c700 1 --2- 172.21.15.26:0/61693828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea680f96d0 0x7fea68107310 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fea58000c00 tx=0x7fea58009b30).stop 2021-11-03T17:01:33.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.361+0000 7fea6eb4c700 1 -- 172.21.15.26:0/61693828 shutdown_connections 2021-11-03T17:01:33.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.361+0000 7fea6eb4c700 1 --2- 172.21.15.26:0/61693828 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fea54064100 0x7fea540665c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:33.363 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.361+0000 7fea6eb4c700 1 --2- 172.21.15.26:0/61693828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea68060250 0x7fea68106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:33.363 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.361+0000 7fea6eb4c700 1 --2- 172.21.15.26:0/61693828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea680f96d0 0x7fea68107310 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:33.363 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.361+0000 7fea6eb4c700 1 -- 172.21.15.26:0/61693828 >> 172.21.15.26:0/61693828 conn(0x7fea680f0ba0 msgr2=0x7fea680f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:01:33.363 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.361+0000 7fea6eb4c700 1 -- 172.21.15.26:0/61693828 shutdown_connections 2021-11-03T17:01:33.363 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.361+0000 7fea6eb4c700 1 -- 172.21.15.26:0/61693828 wait complete. 2021-11-03T17:01:33.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.460+0000 7f456b6b3700 1 -- 172.21.15.26:0/2429996663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45640f6860 msgr2=0x7f45640f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:01:33.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.460+0000 7f456b6b3700 1 --2- 172.21.15.26:0/2429996663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45640f6860 0x7f45640f6cc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f4554004660 tx=0x7f4554009b30).stop 2021-11-03T17:01:33.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.460+0000 7f456b6b3700 1 -- 172.21.15.26:0/2429996663 shutdown_connections 2021-11-03T17:01:33.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.460+0000 7f456b6b3700 1 --2- 172.21.15.26:0/2429996663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45640f6860 0x7f45640f6cc0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:33.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.460+0000 7f456b6b3700 1 --2- 172.21.15.26:0/2429996663 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45640f55c0 0x7f45640f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:33.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.460+0000 7f456b6b3700 1 -- 172.21.15.26:0/2429996663 >> 172.21.15.26:0/2429996663 conn(0x7f45640f0d40 msgr2=0x7f45640f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:01:33.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.461+0000 7f456b6b3700 1 -- 172.21.15.26:0/2429996663 shutdown_connections 2021-11-03T17:01:33.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.461+0000 7f456b6b3700 1 -- 172.21.15.26:0/2429996663 wait complete. 2021-11-03T17:01:33.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.461+0000 7f456b6b3700 1 Processor -- start 2021-11-03T17:01:33.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.461+0000 7f456b6b3700 1 -- start start 2021-11-03T17:01:33.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.461+0000 7f456b6b3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45640f55c0 0x7f4564105e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:01:33.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.461+0000 7f456b6b3700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45640f6860 0x7f4564106320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:01:33.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.461+0000 7f456b6b3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4564106920 con 0x7f45640f55c0 2021-11-03T17:01:33.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.461+0000 7f456b6b3700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4564107130 con 0x7f45640f6860 2021-11-03T17:01:33.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.461+0000 7f456944f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45640f55c0 0x7f4564105e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:01:33.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.461+0000 7f456944f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45640f55c0 0x7f4564105e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52054/0 (socket says 172.21.15.26:52054) 2021-11-03T17:01:33.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.461+0000 7f456944f700 1 -- 172.21.15.26:0/4225732287 learned_addr learned my addr 172.21.15.26:0/4225732287 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:01:33.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.461+0000 7f4568c4e700 1 --2- 172.21.15.26:0/4225732287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45640f6860 0x7f4564106320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:01:33.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.462+0000 7f456944f700 1 -- 172.21.15.26:0/4225732287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45640f6860 msgr2=0x7f4564106320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:01:33.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.462+0000 7f456944f700 1 --2- 172.21.15.26:0/4225732287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45640f6860 0x7f4564106320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:33.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.462+0000 7f456944f700 1 -- 172.21.15.26:0/4225732287 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4554005040 con 0x7f45640f55c0 2021-11-03T17:01:33.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.462+0000 7f456944f700 1 --2- 172.21.15.26:0/4225732287 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45640f55c0 0x7f4564105e30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f45600109d0 tx=0x7f456000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:01:33.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.462+0000 7f4559ffb700 1 -- 172.21.15.26:0/4225732287 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45600092e0 con 0x7f45640f55c0 2021-11-03T17:01:33.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.462+0000 7f4559ffb700 1 -- 172.21.15.26:0/4225732287 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4560009440 con 0x7f45640f55c0 2021-11-03T17:01:33.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.462+0000 7f456b6b3700 1 -- 172.21.15.26:0/4225732287 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4564107350 con 0x7f45640f55c0 2021-11-03T17:01:33.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.462+0000 7f4559ffb700 1 -- 172.21.15.26:0/4225732287 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4560007dc0 con 0x7f45640f55c0 2021-11-03T17:01:33.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.462+0000 7f456b6b3700 1 -- 172.21.15.26:0/4225732287 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45641078e0 con 0x7f45640f55c0 2021-11-03T17:01:33.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.463+0000 7f456b6b3700 1 -- 172.21.15.26:0/4225732287 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45640f49b0 con 0x7f45640f55c0 2021-11-03T17:01:33.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.463+0000 7f4559ffb700 1 -- 172.21.15.26:0/4225732287 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f4560022070 con 0x7f45640f55c0 2021-11-03T17:01:33.466 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.464+0000 7f4559ffb700 1 --2- 172.21.15.26:0/4225732287 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4550064050 0x7f4550066510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:01:33.466 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.464+0000 7f4559ffb700 1 -- 172.21.15.26:0/4225732287 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f4560083280 con 0x7f45640f55c0 2021-11-03T17:01:33.466 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.464+0000 7f4568c4e700 1 --2- 172.21.15.26:0/4225732287 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4550064050 0x7f4550066510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:01:33.466 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.464+0000 7f4568c4e700 1 --2- 172.21.15.26:0/4225732287 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4550064050 0x7f4550066510 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f4554005010 tx=0x7f4554016040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:01:33.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.468+0000 7f4559ffb700 1 -- 172.21.15.26:0/4225732287 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f45600553d0 con 0x7f45640f55c0 2021-11-03T17:01:33.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.696+0000 7f456b6b3700 1 -- 172.21.15.26:0/4225732287 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f45640ff830 con 0x7f45640f55c0 2021-11-03T17:01:33.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.696+0000 7f4559ffb700 1 -- 172.21.15.26:0/4225732287 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f4560054fc0 con 0x7f45640f55c0 2021-11-03T17:01:33.692 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:01:33.692 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:01:33.692 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:01:33.693 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:01:33.693 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:01:33.693 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:01:33.693 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:01:33.694 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:01:33.694 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:01:33.694 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:01:33.694 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:01:33.694 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:01:33.695 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:01:33.695 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:01:33.695 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:01:33.695 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:01:33.696 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:01:33.696 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:01:33.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.698+0000 7f456b6b3700 1 -- 172.21.15.26:0/4225732287 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4550064050 msgr2=0x7f4550066510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:01:33.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.698+0000 7f456b6b3700 1 --2- 172.21.15.26:0/4225732287 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4550064050 0x7f4550066510 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f4554005010 tx=0x7f4554016040).stop 2021-11-03T17:01:33.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.698+0000 7f456b6b3700 1 -- 172.21.15.26:0/4225732287 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45640f55c0 msgr2=0x7f4564105e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:01:33.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.698+0000 7f456b6b3700 1 --2- 172.21.15.26:0/4225732287 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45640f55c0 0x7f4564105e30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f45600109d0 tx=0x7f456000b040).stop 2021-11-03T17:01:33.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.698+0000 7f456b6b3700 1 -- 172.21.15.26:0/4225732287 shutdown_connections 2021-11-03T17:01:33.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.698+0000 7f456b6b3700 1 --2- 172.21.15.26:0/4225732287 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4550064050 0x7f4550066510 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:33.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.698+0000 7f456b6b3700 1 --2- 172.21.15.26:0/4225732287 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45640f55c0 0x7f4564105e30 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:33.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.698+0000 7f456b6b3700 1 --2- 172.21.15.26:0/4225732287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45640f6860 0x7f4564106320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:33.699 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.698+0000 7f456b6b3700 1 -- 172.21.15.26:0/4225732287 >> 172.21.15.26:0/4225732287 conn(0x7f45640f0d40 msgr2=0x7f45640fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:01:33.699 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.698+0000 7f456b6b3700 1 -- 172.21.15.26:0/4225732287 shutdown_connections 2021-11-03T17:01:33.699 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.698+0000 7f456b6b3700 1 -- 172.21.15.26:0/4225732287 wait complete. 2021-11-03T17:01:33.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.799+0000 7f76cd588700 1 -- 172.21.15.26:0/3040084775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76c80f6ff0 msgr2=0x7f76c80f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:01:33.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.799+0000 7f76cd588700 1 --2- 172.21.15.26:0/3040084775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76c80f6ff0 0x7f76c80f7a20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f76b8004660 tx=0x7f76b8009b30).stop 2021-11-03T17:01:33.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.799+0000 7f76cd588700 1 -- 172.21.15.26:0/3040084775 shutdown_connections 2021-11-03T17:01:33.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.799+0000 7f76cd588700 1 --2- 172.21.15.26:0/3040084775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76c80f6ff0 0x7f76c80f7a20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:33.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.799+0000 7f76cd588700 1 --2- 172.21.15.26:0/3040084775 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76c80f66e0 0x7f76c80f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:01:33.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.799+0000 7f76cd588700 1 -- 172.21.15.26:0/3040084775 >> 172.21.15.26:0/3040084775 conn(0x7f76c80f1f00 msgr2=0x7f76c80f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:01:33.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.799+0000 7f76cd588700 1 -- 172.21.15.26:0/3040084775 shutdown_connections 2021-11-03T17:01:33.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.799+0000 7f76cd588700 1 -- 172.21.15.26:0/3040084775 wait complete. 2021-11-03T17:01:33.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.800+0000 7f76cd588700 1 Processor -- start 2021-11-03T17:01:33.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.800+0000 7f76cd588700 1 -- start start 2021-11-03T17:01:33.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.800+0000 7f76cd588700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76c80f66e0 0x7f76c8106fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:01:33.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.800+0000 7f76cd588700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76c80f6ff0 0x7f76c8107490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:01:33.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.800+0000 7f76cd588700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c8107ad0 con 0x7f76c80f66e0 2021-11-03T17:01:33.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.800+0000 7f76cd588700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c8108380 con 0x7f76c80f6ff0 2021-11-03T17:01:33.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.800+0000 7f76c6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76c80f66e0 0x7f76c8106fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:01:33.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.800+0000 7f76c6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76c80f66e0 0x7f76c8106fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52064/0 (socket says 172.21.15.26:52064) 2021-11-03T17:01:33.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.800+0000 7f76c6ffd700 1 -- 172.21.15.26:0/2868212640 learned_addr learned my addr 172.21.15.26:0/2868212640 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:01:33.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.800+0000 7f76c67fc700 1 --2- 172.21.15.26:0/2868212640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76c80f6ff0 0x7f76c8107490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:01:33.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.800+0000 7f76c6ffd700 1 -- 172.21.15.26:0/2868212640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76c80f6ff0 msgr2=0x7f76c8107490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:01:33.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.800+0000 7f76c6ffd700 1 --2- 172.21.15.26:0/2868212640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76c80f6ff0 0x7f76c8107490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:33.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.800+0000 7f76c6ffd700 1 -- 172.21.15.26:0/2868212640 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b8005040 con 0x7f76c80f66e0 2021-11-03T17:01:33.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.800+0000 7f76c6ffd700 1 --2- 172.21.15.26:0/2868212640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76c80f66e0 0x7f76c8106fa0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f76b000b410 tx=0x7f76b0006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:01:33.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.801+0000 7f76bf7fe700 1 -- 172.21.15.26:0/2868212640 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76b00125f0 con 0x7f76c80f66e0 2021-11-03T17:01:33.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.801+0000 7f76bf7fe700 1 -- 172.21.15.26:0/2868212640 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f76b0012c00 con 0x7f76c80f66e0 2021-11-03T17:01:33.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.801+0000 7f76cd588700 1 -- 172.21.15.26:0/2868212640 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76c8108660 con 0x7f76c80f66e0 2021-11-03T17:01:33.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.801+0000 7f76bf7fe700 1 -- 172.21.15.26:0/2868212640 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76b0002ae0 con 0x7f76c80f66e0 2021-11-03T17:01:33.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.801+0000 7f76cd588700 1 -- 172.21.15.26:0/2868212640 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c8108c20 con 0x7f76c80f66e0 2021-11-03T17:01:33.805 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.802+0000 7f76cd588700 1 -- 172.21.15.26:0/2868212640 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76c80f5b70 con 0x7f76c80f66e0 2021-11-03T17:01:33.806 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.802+0000 7f76bf7fe700 1 -- 172.21.15.26:0/2868212640 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f76b000f030 con 0x7f76c80f66e0 2021-11-03T17:01:33.807 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.802+0000 7f76bf7fe700 1 --2- 172.21.15.26:0/2868212640 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f76b4064090 0x7f76b4066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:01:33.807 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.803+0000 7f76bf7fe700 1 -- 172.21.15.26:0/2868212640 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f76b0080d40 con 0x7f76c80f66e0 2021-11-03T17:01:33.807 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.803+0000 7f76c67fc700 1 --2- 172.21.15.26:0/2868212640 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f76b4064090 0x7f76b4066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:01:33.807 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.803+0000 7f76c67fc700 1 --2- 172.21.15.26:0/2868212640 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f76b4064090 0x7f76b4066550 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f76b8000c00 tx=0x7f76b8009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:01:33.808 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:33.807+0000 7f76bf7fe700 1 -- 172.21.15.26:0/2868212640 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f76b0052fe0 con 0x7f76c80f66e0 2021-11-03T17:01:34.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:34.012+0000 7f76cd588700 1 -- 172.21.15.26:0/2868212640 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f76c8045ad0 con 0x7f76c80f66e0 2021-11-03T17:01:34.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:34.013+0000 7f76bf7fe700 1 -- 172.21.15.26:0/2868212640 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f76b0002d50 con 0x7f76c80f66e0 2021-11-03T17:01:34.008 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:01:34.009 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:01:34.009 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:01:34.009 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:01:34.009 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:01:34.009 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:01:34.010 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:01:34.010 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:01:34.010 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:01:34.010 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:01:34.011 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:01:34.011 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:01:34.011 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:01:34.011 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:01:34.011 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:01:34.012 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:01:34.012 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:01:34.012 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:01:34.012 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:01:34.013 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:01:34.013 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:01:34.013 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:01:34.013 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:01:34.013 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:01:34.014 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:01:34.014 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:01:34.014 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:01:34.014 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:01:34.015 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:01:34.015 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:01:34.015 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:01:34.015 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:01:34.015 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:01:34.016 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:01:34.016 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:01:34.016 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:01:34.016 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:01:34.017 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:01:34.017 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:01:34.018 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:34.014+0000 7f76cd588700 1 -- 172.21.15.26:0/2868212640 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f76b4064090 msgr2=0x7f76b4066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:01:34.018 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:34.014+0000 7f76cd588700 1 --2- 172.21.15.26:0/2868212640 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f76b4064090 0x7f76b4066550 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f76b8000c00 tx=0x7f76b8009b30).stop 2021-11-03T17:01:34.018 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:34.014+0000 7f76cd588700 1 -- 172.21.15.26:0/2868212640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76c80f66e0 msgr2=0x7f76c8106fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:01:34.019 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:34.014+0000 7f76cd588700 1 --2- 172.21.15.26:0/2868212640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76c80f66e0 0x7f76c8106fa0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f76b000b410 tx=0x7f76b0006ef0).stop 2021-11-03T17:01:34.019 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:34.015+0000 7f76cd588700 1 -- 172.21.15.26:0/2868212640 shutdown_connections 2021-11-03T17:01:34.019 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:34.015+0000 7f76cd588700 1 --2- 172.21.15.26:0/2868212640 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f76b4064090 0x7f76b4066550 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:34.019 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:34.015+0000 7f76cd588700 1 --2- 172.21.15.26:0/2868212640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76c80f66e0 0x7f76c8106fa0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:34.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:34.015+0000 7f76cd588700 1 --2- 172.21.15.26:0/2868212640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76c80f6ff0 0x7f76c8107490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:01:34.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:34.015+0000 7f76cd588700 1 -- 172.21.15.26:0/2868212640 >> 172.21.15.26:0/2868212640 conn(0x7f76c80f1f00 msgr2=0x7f76c80fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:01:34.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:34.015+0000 7f76cd588700 1 -- 172.21.15.26:0/2868212640 shutdown_connections 2021-11-03T17:01:34.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:01:34.015+0000 7f76cd588700 1 -- 172.21.15.26:0/2868212640 wait complete. 2021-11-03T17:01:34.021 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:01:34.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:33 smithi026 ceph-mon[96795]: pgmap v207: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:34.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:33 smithi026 ceph-mon[96795]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:01:34.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:33 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/4225732287' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:01:34.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:33 smithi194 ceph-mon[65619]: pgmap v207: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:34.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:33 smithi194 ceph-mon[65619]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:01:34.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:33 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/4225732287' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:01:35.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:34 smithi026 ceph-mon[96795]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:01:35.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:34 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2868212640' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:01:35.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:34 smithi194 ceph-mon[65619]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:01:35.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:34 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2868212640' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:01:36.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:35 smithi026 ceph-mon[96795]: pgmap v208: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:36.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:35 smithi194 ceph-mon[65619]: pgmap v208: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:38.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:37 smithi026 ceph-mon[96795]: pgmap v209: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:38.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:37 smithi194 ceph-mon[65619]: pgmap v209: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:40.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:39 smithi026 ceph-mon[96795]: pgmap v210: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:40.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:39 smithi194 ceph-mon[65619]: pgmap v210: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:41.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:01:41.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:01:42.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:41 smithi026 ceph-mon[96795]: pgmap v211: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:42.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:41 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:01:42.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:41 smithi194 ceph-mon[65619]: pgmap v211: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:42.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:41 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:01:44.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:43 smithi194 ceph-mon[65619]: pgmap v212: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:44.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:43 smithi026 ceph-mon[96795]: pgmap v212: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:46.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:45 smithi194 ceph-mon[65619]: pgmap v213: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:46.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:45 smithi026 ceph-mon[96795]: pgmap v213: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:48.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:47 smithi194 ceph-mon[65619]: pgmap v214: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:48.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:47 smithi026 ceph-mon[96795]: pgmap v214: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:49.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:01:49.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:01:49.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:01:49.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:01:50.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:49 smithi194 ceph-mon[65619]: pgmap v215: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:50.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:49 smithi026 ceph-mon[96795]: pgmap v215: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:52.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:51 smithi194 ceph-mon[65619]: pgmap v216: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:52.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:51 smithi026 ceph-mon[96795]: pgmap v216: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:54.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:53 smithi194 ceph-mon[65619]: pgmap v217: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:54.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:53 smithi026 ceph-mon[96795]: pgmap v217: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:56.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:55 smithi194 ceph-mon[65619]: pgmap v218: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:56.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:01:56.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:55 smithi026 ceph-mon[96795]: pgmap v218: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:56.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:01:57.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:56 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:01:57.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:56 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:01:58.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:57 smithi194 ceph-mon[65619]: pgmap v219: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:01:58.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:57 smithi026 ceph-mon[96795]: pgmap v219: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:00.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:01:59 smithi194 ceph-mon[65619]: pgmap v220: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:00.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:01:59 smithi026 ceph-mon[96795]: pgmap v220: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:02.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:01 smithi194 ceph-mon[65619]: pgmap v221: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:02.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:01 smithi026 ceph-mon[96795]: pgmap v221: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:04.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.129+0000 7f11eebac700 1 -- 172.21.15.26:0/2686543734 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11e80f6ff0 msgr2=0x7f11e80f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:02:04.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.129+0000 7f11eebac700 1 --2- 172.21.15.26:0/2686543734 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11e80f6ff0 0x7f11e80f7a20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f11d4004660 tx=0x7f11d4009b30).stop 2021-11-03T17:02:04.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.129+0000 7f11eebac700 1 -- 172.21.15.26:0/2686543734 shutdown_connections 2021-11-03T17:02:04.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.129+0000 7f11eebac700 1 --2- 172.21.15.26:0/2686543734 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11e80f6ff0 0x7f11e80f7a20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:04.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.129+0000 7f11eebac700 1 --2- 172.21.15.26:0/2686543734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11e80f66e0 0x7f11e80f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:04.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.129+0000 7f11eebac700 1 -- 172.21.15.26:0/2686543734 >> 172.21.15.26:0/2686543734 conn(0x7f11e80f1f00 msgr2=0x7f11e80f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:02:04.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.129+0000 7f11eebac700 1 -- 172.21.15.26:0/2686543734 shutdown_connections 2021-11-03T17:02:04.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.129+0000 7f11eebac700 1 -- 172.21.15.26:0/2686543734 wait complete. 2021-11-03T17:02:04.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.130+0000 7f11eebac700 1 Processor -- start 2021-11-03T17:02:04.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.130+0000 7f11eebac700 1 -- start start 2021-11-03T17:02:04.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.130+0000 7f11eebac700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11e80f66e0 0x7f11e8106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:02:04.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.130+0000 7f11eebac700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11e80f6ff0 0x7f11e8107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:02:04.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.130+0000 7f11eebac700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e8107a10 con 0x7f11e80f6ff0 2021-11-03T17:02:04.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.130+0000 7f11eebac700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e8107b50 con 0x7f11e80f66e0 2021-11-03T17:02:04.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.131+0000 7f11e7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11e80f6ff0 0x7f11e8107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:02:04.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.131+0000 7f11e7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11e80f6ff0 0x7f11e8107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52084/0 (socket says 172.21.15.26:52084) 2021-11-03T17:02:04.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.131+0000 7f11e7fff700 1 -- 172.21.15.26:0/1914293285 learned_addr learned my addr 172.21.15.26:0/1914293285 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:02:04.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.131+0000 7f11ec948700 1 --2- 172.21.15.26:0/1914293285 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11e80f66e0 0x7f11e8106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:02:04.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.131+0000 7f11e7fff700 1 -- 172.21.15.26:0/1914293285 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11e80f66e0 msgr2=0x7f11e8106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:02:04.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.131+0000 7f11e7fff700 1 --2- 172.21.15.26:0/1914293285 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11e80f66e0 0x7f11e8106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:04.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.131+0000 7f11e7fff700 1 -- 172.21.15.26:0/1914293285 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d4005040 con 0x7f11e80f6ff0 2021-11-03T17:02:04.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.131+0000 7f11e7fff700 1 --2- 172.21.15.26:0/1914293285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11e80f6ff0 0x7f11e8107460 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f11d4009da0 tx=0x7f11d4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:02:04.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.131+0000 7f11e57fa700 1 -- 172.21.15.26:0/1914293285 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11d4018070 con 0x7f11e80f6ff0 2021-11-03T17:02:04.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.131+0000 7f11e57fa700 1 -- 172.21.15.26:0/1914293285 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f11d4007cf0 con 0x7f11e80f6ff0 2021-11-03T17:02:04.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.131+0000 7f11eebac700 1 -- 172.21.15.26:0/1914293285 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11e8108490 con 0x7f11e80f6ff0 2021-11-03T17:02:04.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.131+0000 7f11e57fa700 1 -- 172.21.15.26:0/1914293285 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11d401c620 con 0x7f11e80f6ff0 2021-11-03T17:02:04.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.131+0000 7f11eebac700 1 -- 172.21.15.26:0/1914293285 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e81089f0 con 0x7f11e80f6ff0 2021-11-03T17:02:04.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.132+0000 7f11eebac700 1 -- 172.21.15.26:0/1914293285 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11e8045ad0 con 0x7f11e80f6ff0 2021-11-03T17:02:04.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.133+0000 7f11e57fa700 1 -- 172.21.15.26:0/1914293285 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f11d401d420 con 0x7f11e80f6ff0 2021-11-03T17:02:04.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.133+0000 7f11e57fa700 1 --2- 172.21.15.26:0/1914293285 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f11d8064090 0x7f11d8066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:02:04.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.133+0000 7f11e57fa700 1 -- 172.21.15.26:0/1914293285 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f11d40826f0 con 0x7f11e80f6ff0 2021-11-03T17:02:04.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.133+0000 7f11ec948700 1 --2- 172.21.15.26:0/1914293285 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f11d8064090 0x7f11d8066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:02:04.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.134+0000 7f11ec948700 1 --2- 172.21.15.26:0/1914293285 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f11d8064090 0x7f11d8066550 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f11dc0041d0 tx=0x7f11dc009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:02:04.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.137+0000 7f11e57fa700 1 -- 172.21.15.26:0/1914293285 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f11d4054b10 con 0x7f11e80f6ff0 2021-11-03T17:02:04.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:03 smithi194 ceph-mon[65619]: pgmap v222: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:04.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.316+0000 7f11eebac700 1 -- 172.21.15.26:0/1914293285 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f11e80ff040 con 0x7f11d8064090 2021-11-03T17:02:04.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.318+0000 7f11e57fa700 1 -- 172.21.15.26:0/1914293285 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f11e80ff040 con 0x7f11d8064090 2021-11-03T17:02:04.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.319+0000 7f11eebac700 1 -- 172.21.15.26:0/1914293285 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f11d8064090 msgr2=0x7f11d8066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:02:04.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.319+0000 7f11eebac700 1 --2- 172.21.15.26:0/1914293285 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f11d8064090 0x7f11d8066550 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f11dc0041d0 tx=0x7f11dc009040).stop 2021-11-03T17:02:04.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.320+0000 7f11eebac700 1 -- 172.21.15.26:0/1914293285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11e80f6ff0 msgr2=0x7f11e8107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:02:04.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.320+0000 7f11eebac700 1 --2- 172.21.15.26:0/1914293285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11e80f6ff0 0x7f11e8107460 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f11d4009da0 tx=0x7f11d4009b30).stop 2021-11-03T17:02:04.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.320+0000 7f11eebac700 1 -- 172.21.15.26:0/1914293285 shutdown_connections 2021-11-03T17:02:04.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.320+0000 7f11eebac700 1 --2- 172.21.15.26:0/1914293285 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f11d8064090 0x7f11d8066550 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:04.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.320+0000 7f11eebac700 1 --2- 172.21.15.26:0/1914293285 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11e80f66e0 0x7f11e8106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:04.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.320+0000 7f11eebac700 1 --2- 172.21.15.26:0/1914293285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11e80f6ff0 0x7f11e8107460 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:04.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.320+0000 7f11eebac700 1 -- 172.21.15.26:0/1914293285 >> 172.21.15.26:0/1914293285 conn(0x7f11e80f1f00 msgr2=0x7f11e80fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:02:04.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.320+0000 7f11eebac700 1 -- 172.21.15.26:0/1914293285 shutdown_connections 2021-11-03T17:02:04.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.320+0000 7f11eebac700 1 -- 172.21.15.26:0/1914293285 wait complete. 2021-11-03T17:02:04.326 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:02:04.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.420+0000 7f65f4aed700 1 -- 172.21.15.26:0/1767440114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f00f66e0 msgr2=0x7f65f00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:02:04.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.420+0000 7f65f4aed700 1 --2- 172.21.15.26:0/1767440114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f00f66e0 0x7f65f00f6b00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f65e0004660 tx=0x7f65e0009b30).stop 2021-11-03T17:02:04.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.420+0000 7f65f4aed700 1 -- 172.21.15.26:0/1767440114 shutdown_connections 2021-11-03T17:02:04.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.420+0000 7f65f4aed700 1 --2- 172.21.15.26:0/1767440114 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65f00f6ff0 0x7f65f00f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:04.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.420+0000 7f65f4aed700 1 --2- 172.21.15.26:0/1767440114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f00f66e0 0x7f65f00f6b00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:04.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.420+0000 7f65f4aed700 1 -- 172.21.15.26:0/1767440114 >> 172.21.15.26:0/1767440114 conn(0x7f65f00f1f00 msgr2=0x7f65f00f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:02:04.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.420+0000 7f65f4aed700 1 -- 172.21.15.26:0/1767440114 shutdown_connections 2021-11-03T17:02:04.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.420+0000 7f65f4aed700 1 -- 172.21.15.26:0/1767440114 wait complete. 2021-11-03T17:02:04.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.420+0000 7f65f4aed700 1 Processor -- start 2021-11-03T17:02:04.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.421+0000 7f65f4aed700 1 -- start start 2021-11-03T17:02:04.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.421+0000 7f65f4aed700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65f00f66e0 0x7f65f006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:02:04.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.421+0000 7f65f4aed700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f00f6ff0 0x7f65f0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:02:04.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.421+0000 7f65f4aed700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f006a380 con 0x7f65f00f6ff0 2021-11-03T17:02:04.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.421+0000 7f65f4aed700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f006a4c0 con 0x7f65f00f66e0 2021-11-03T17:02:04.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.421+0000 7f65edd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f00f6ff0 0x7f65f0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:02:04.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.421+0000 7f65edd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f00f6ff0 0x7f65f0069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52094/0 (socket says 172.21.15.26:52094) 2021-11-03T17:02:04.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.421+0000 7f65edd9b700 1 -- 172.21.15.26:0/3146743074 learned_addr learned my addr 172.21.15.26:0/3146743074 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:02:04.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.421+0000 7f65ee59c700 1 --2- 172.21.15.26:0/3146743074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65f00f66e0 0x7f65f006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:02:04.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.421+0000 7f65edd9b700 1 -- 172.21.15.26:0/3146743074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65f00f66e0 msgr2=0x7f65f006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:02:04.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.421+0000 7f65edd9b700 1 --2- 172.21.15.26:0/3146743074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65f00f66e0 0x7f65f006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:04.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.421+0000 7f65edd9b700 1 -- 172.21.15.26:0/3146743074 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e0005040 con 0x7f65f00f6ff0 2021-11-03T17:02:04.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.421+0000 7f65edd9b700 1 --2- 172.21.15.26:0/3146743074 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f00f6ff0 0x7f65f0069e20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f65d800c530 tx=0x7f65d8007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:02:04.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.421+0000 7f65e6ffd700 1 -- 172.21.15.26:0/3146743074 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65d800f650 con 0x7f65f00f6ff0 2021-11-03T17:02:04.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.421+0000 7f65e6ffd700 1 -- 172.21.15.26:0/3146743074 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f65d800fc60 con 0x7f65f00f6ff0 2021-11-03T17:02:04.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.421+0000 7f65e6ffd700 1 -- 172.21.15.26:0/3146743074 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65d8012cd0 con 0x7f65f00f6ff0 2021-11-03T17:02:04.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.421+0000 7f65f4aed700 1 -- 172.21.15.26:0/3146743074 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f006a7a0 con 0x7f65f00f6ff0 2021-11-03T17:02:04.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.422+0000 7f65f4aed700 1 -- 172.21.15.26:0/3146743074 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f010ef90 con 0x7f65f00f6ff0 2021-11-03T17:02:04.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.422+0000 7f65f4aed700 1 -- 172.21.15.26:0/3146743074 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65f0045ad0 con 0x7f65f00f6ff0 2021-11-03T17:02:04.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.423+0000 7f65e6ffd700 1 -- 172.21.15.26:0/3146743074 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f65d8010070 con 0x7f65f00f6ff0 2021-11-03T17:02:04.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.423+0000 7f65e6ffd700 1 --2- 172.21.15.26:0/3146743074 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f65dc0640b0 0x7f65dc066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:02:04.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.423+0000 7f65e6ffd700 1 -- 172.21.15.26:0/3146743074 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f65d80806e0 con 0x7f65f00f6ff0 2021-11-03T17:02:04.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.423+0000 7f65ee59c700 1 --2- 172.21.15.26:0/3146743074 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f65dc0640b0 0x7f65dc066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:02:04.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.424+0000 7f65ee59c700 1 --2- 172.21.15.26:0/3146743074 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f65dc0640b0 0x7f65dc066570 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f65e0004e30 tx=0x7f65e0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:02:04.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:03 smithi026 ceph-mon[96795]: pgmap v222: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:04.428 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.428+0000 7f65e6ffd700 1 -- 172.21.15.26:0/3146743074 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f65d8052950 con 0x7f65f00f6ff0 2021-11-03T17:02:04.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.602+0000 7f65f4aed700 1 -- 172.21.15.26:0/3146743074 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f65f00ff010 con 0x7f65dc0640b0 2021-11-03T17:02:04.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.616+0000 7f65e6ffd700 1 -- 172.21.15.26:0/3146743074 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f65f00ff010 con 0x7f65dc0640b0 2021-11-03T17:02:04.612 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:02:04.613 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (13m) 4m ago 14m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:02:04.613 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (5m) 4m ago 14m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:02:04.613 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (5m) 2m ago 13m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:02:04.613 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (13m) 4m ago 14m 38.9M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:02:04.614 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (6m) 4m ago 9m 13.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:02:04.614 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (6m) 4m ago 9m 14.7M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:02:04.614 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (9m) 2m ago 9m 16.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:02:04.614 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (9m) 2m ago 9m 16.5M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:02:04.615 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (7m) 4m ago 15m 468M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:02:04.615 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (6m) 2m ago 13m 412M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:02:04.615 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (6m) 4m ago 16m 75.8M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:02:04.615 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (6m) 2m ago 13m 66.4M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:02:04.616 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (14m) 4m ago 14m 18.1M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:02:04.616 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (13m) 2m ago 13m 18.3M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:02:04.616 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (5m) 4m ago 12m 153M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:02:04.616 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (4m) 4m ago 12m 166M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:02:04.617 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (4m) 4m ago 12m 11.2M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:02:04.617 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (3m) 2m ago 11m 181M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:02:04.617 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (3m) 2m ago 11m 185M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:02:04.617 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (2m) 2m ago 11m 13.5M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:02:04.617 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (13m) 4m ago 13m 47.5M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:02:04.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.618+0000 7f65f4aed700 1 -- 172.21.15.26:0/3146743074 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f65dc0640b0 msgr2=0x7f65dc066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:02:04.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.618+0000 7f65f4aed700 1 --2- 172.21.15.26:0/3146743074 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f65dc0640b0 0x7f65dc066570 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f65e0004e30 tx=0x7f65e0009b30).stop 2021-11-03T17:02:04.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.618+0000 7f65f4aed700 1 -- 172.21.15.26:0/3146743074 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f00f6ff0 msgr2=0x7f65f0069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:02:04.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.618+0000 7f65f4aed700 1 --2- 172.21.15.26:0/3146743074 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f00f6ff0 0x7f65f0069e20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f65d800c530 tx=0x7f65d8007e20).stop 2021-11-03T17:02:04.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.618+0000 7f65f4aed700 1 -- 172.21.15.26:0/3146743074 shutdown_connections 2021-11-03T17:02:04.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.618+0000 7f65f4aed700 1 --2- 172.21.15.26:0/3146743074 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f65dc0640b0 0x7f65dc066570 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:04.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.618+0000 7f65f4aed700 1 --2- 172.21.15.26:0/3146743074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65f00f66e0 0x7f65f006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:04.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.618+0000 7f65f4aed700 1 --2- 172.21.15.26:0/3146743074 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f00f6ff0 0x7f65f0069e20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:04.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.618+0000 7f65f4aed700 1 -- 172.21.15.26:0/3146743074 >> 172.21.15.26:0/3146743074 conn(0x7f65f00f1f00 msgr2=0x7f65f00fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:02:04.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.618+0000 7f65f4aed700 1 -- 172.21.15.26:0/3146743074 shutdown_connections 2021-11-03T17:02:04.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.618+0000 7f65f4aed700 1 -- 172.21.15.26:0/3146743074 wait complete. 2021-11-03T17:02:04.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.718+0000 7fb9745bf700 1 -- 172.21.15.26:0/886675806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb96c0f66d0 msgr2=0x7fb96c0f6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:02:04.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.718+0000 7fb9745bf700 1 --2- 172.21.15.26:0/886675806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb96c0f66d0 0x7fb96c0f6af0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fb9640099e0 tx=0x7fb964004d10).stop 2021-11-03T17:02:04.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.718+0000 7fb9745bf700 1 -- 172.21.15.26:0/886675806 shutdown_connections 2021-11-03T17:02:04.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.718+0000 7fb9745bf700 1 --2- 172.21.15.26:0/886675806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb96c0f7970 0x7fb96c0f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:04.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.718+0000 7fb9745bf700 1 --2- 172.21.15.26:0/886675806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb96c0f66d0 0x7fb96c0f6af0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:04.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.718+0000 7fb9745bf700 1 -- 172.21.15.26:0/886675806 >> 172.21.15.26:0/886675806 conn(0x7fb96c0f1e50 msgr2=0x7fb96c0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:02:04.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.718+0000 7fb9745bf700 1 -- 172.21.15.26:0/886675806 shutdown_connections 2021-11-03T17:02:04.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.718+0000 7fb9745bf700 1 -- 172.21.15.26:0/886675806 wait complete. 2021-11-03T17:02:04.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.718+0000 7fb9745bf700 1 Processor -- start 2021-11-03T17:02:04.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.718+0000 7fb9745bf700 1 -- start start 2021-11-03T17:02:04.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.718+0000 7fb9745bf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb96c0f66d0 0x7fb96c107070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:02:04.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.718+0000 7fb9745bf700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb96c0f7970 0x7fb96c107560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:02:04.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.719+0000 7fb9745bf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c107b10 con 0x7fb96c0f66d0 2021-11-03T17:02:04.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.719+0000 7fb9745bf700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c107c50 con 0x7fb96c0f7970 2021-11-03T17:02:04.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.719+0000 7fb97235b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb96c0f66d0 0x7fb96c107070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:02:04.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.719+0000 7fb97235b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb96c0f66d0 0x7fb96c107070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52102/0 (socket says 172.21.15.26:52102) 2021-11-03T17:02:04.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.719+0000 7fb97235b700 1 -- 172.21.15.26:0/2833745236 learned_addr learned my addr 172.21.15.26:0/2833745236 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:02:04.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.719+0000 7fb971b5a700 1 --2- 172.21.15.26:0/2833745236 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb96c0f7970 0x7fb96c107560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:02:04.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.719+0000 7fb97235b700 1 -- 172.21.15.26:0/2833745236 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb96c0f7970 msgr2=0x7fb96c107560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:02:04.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.719+0000 7fb97235b700 1 --2- 172.21.15.26:0/2833745236 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb96c0f7970 0x7fb96c107560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:04.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.719+0000 7fb97235b700 1 -- 172.21.15.26:0/2833745236 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb964009640 con 0x7fb96c0f66d0 2021-11-03T17:02:04.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.719+0000 7fb97235b700 1 --2- 172.21.15.26:0/2833745236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb96c0f66d0 0x7fb96c107070 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fb96400c010 tx=0x7fb964004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:02:04.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.719+0000 7fb96affd700 1 -- 172.21.15.26:0/2833745236 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb96400e070 con 0x7fb96c0f66d0 2021-11-03T17:02:04.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.719+0000 7fb96affd700 1 -- 172.21.15.26:0/2833745236 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb964007dc0 con 0x7fb96c0f66d0 2021-11-03T17:02:04.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.719+0000 7fb96affd700 1 -- 172.21.15.26:0/2833745236 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb964018070 con 0x7fb96c0f66d0 2021-11-03T17:02:04.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.719+0000 7fb9745bf700 1 -- 172.21.15.26:0/2833745236 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb96c108590 con 0x7fb96c0f66d0 2021-11-03T17:02:04.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.719+0000 7fb9745bf700 1 -- 172.21.15.26:0/2833745236 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb96c108a70 con 0x7fb96c0f66d0 2021-11-03T17:02:04.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.720+0000 7fb9745bf700 1 -- 172.21.15.26:0/2833745236 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb96c045ad0 con 0x7fb96c0f66d0 2021-11-03T17:02:04.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.721+0000 7fb96affd700 1 -- 172.21.15.26:0/2833745236 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fb964024060 con 0x7fb96c0f66d0 2021-11-03T17:02:04.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.721+0000 7fb96affd700 1 --2- 172.21.15.26:0/2833745236 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb9540640b0 0x7fb954066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:02:04.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.721+0000 7fb96affd700 1 -- 172.21.15.26:0/2833745236 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fb964081ff0 con 0x7fb96c0f66d0 2021-11-03T17:02:04.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.721+0000 7fb971b5a700 1 --2- 172.21.15.26:0/2833745236 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb9540640b0 0x7fb954066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:02:04.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.722+0000 7fb971b5a700 1 --2- 172.21.15.26:0/2833745236 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb9540640b0 0x7fb954066570 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fb9600096c0 tx=0x7fb960009be0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:02:04.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.725+0000 7fb96affd700 1 -- 172.21.15.26:0/2833745236 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fb964054350 con 0x7fb96c0f66d0 2021-11-03T17:02:04.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.953+0000 7fb9745bf700 1 -- 172.21.15.26:0/2833745236 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb96c0fef60 con 0x7fb96c0f66d0 2021-11-03T17:02:04.950 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.953+0000 7fb96affd700 1 -- 172.21.15.26:0/2833745236 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fb964022070 con 0x7fb96c0f66d0 2021-11-03T17:02:04.950 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:02:04.951 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:02:04.951 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:02:04.951 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:02:04.951 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:02:04.952 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:02:04.952 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:02:04.952 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:02:04.953 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:02:04.953 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:02:04.953 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:02:04.953 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:02:04.954 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:02:04.954 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:02:04.954 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:02:04.954 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:02:04.955 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:02:04.955 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:02:04.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.955+0000 7fb9745bf700 1 -- 172.21.15.26:0/2833745236 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb9540640b0 msgr2=0x7fb954066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:02:04.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.955+0000 7fb9745bf700 1 --2- 172.21.15.26:0/2833745236 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb9540640b0 0x7fb954066570 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fb9600096c0 tx=0x7fb960009be0).stop 2021-11-03T17:02:04.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.955+0000 7fb9745bf700 1 -- 172.21.15.26:0/2833745236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb96c0f66d0 msgr2=0x7fb96c107070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:02:04.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.955+0000 7fb9745bf700 1 --2- 172.21.15.26:0/2833745236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb96c0f66d0 0x7fb96c107070 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fb96400c010 tx=0x7fb964004d10).stop 2021-11-03T17:02:04.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.955+0000 7fb9745bf700 1 -- 172.21.15.26:0/2833745236 shutdown_connections 2021-11-03T17:02:04.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.955+0000 7fb9745bf700 1 --2- 172.21.15.26:0/2833745236 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb9540640b0 0x7fb954066570 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:04.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.955+0000 7fb9745bf700 1 --2- 172.21.15.26:0/2833745236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb96c0f66d0 0x7fb96c107070 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:04.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.955+0000 7fb9745bf700 1 --2- 172.21.15.26:0/2833745236 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb96c0f7970 0x7fb96c107560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:04.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.955+0000 7fb9745bf700 1 -- 172.21.15.26:0/2833745236 >> 172.21.15.26:0/2833745236 conn(0x7fb96c0f1e50 msgr2=0x7fb96c0fb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:02:04.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.955+0000 7fb9745bf700 1 -- 172.21.15.26:0/2833745236 shutdown_connections 2021-11-03T17:02:04.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:04.955+0000 7fb9745bf700 1 -- 172.21.15.26:0/2833745236 wait complete. 2021-11-03T17:02:05.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.056+0000 7f246a106700 1 -- 172.21.15.26:0/935113404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24640f66e0 msgr2=0x7f24640f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:02:05.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.056+0000 7f246a106700 1 --2- 172.21.15.26:0/935113404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24640f66e0 0x7f24640f6b00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f2454004660 tx=0x7f2454009b30).stop 2021-11-03T17:02:05.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.056+0000 7f246a106700 1 -- 172.21.15.26:0/935113404 shutdown_connections 2021-11-03T17:02:05.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.056+0000 7f246a106700 1 --2- 172.21.15.26:0/935113404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24640f6ff0 0x7f24640f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:05.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.056+0000 7f246a106700 1 --2- 172.21.15.26:0/935113404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24640f66e0 0x7f24640f6b00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:05.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.056+0000 7f246a106700 1 -- 172.21.15.26:0/935113404 >> 172.21.15.26:0/935113404 conn(0x7f24640f1f00 msgr2=0x7f24640f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:02:05.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.057+0000 7f246a106700 1 -- 172.21.15.26:0/935113404 shutdown_connections 2021-11-03T17:02:05.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.057+0000 7f246a106700 1 -- 172.21.15.26:0/935113404 wait complete. 2021-11-03T17:02:05.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.057+0000 7f246a106700 1 Processor -- start 2021-11-03T17:02:05.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.057+0000 7f246a106700 1 -- start start 2021-11-03T17:02:05.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.057+0000 7f246a106700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24640f66e0 0x7f2464106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:02:05.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.057+0000 7f246a106700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24640f6ff0 0x7f2464107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:02:05.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.057+0000 7f246a106700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2464107a00 con 0x7f24640f66e0 2021-11-03T17:02:05.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.057+0000 7f246a106700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2464107b40 con 0x7f24640f6ff0 2021-11-03T17:02:05.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.057+0000 7f24637fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24640f66e0 0x7f2464106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:02:05.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.057+0000 7f24637fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24640f66e0 0x7f2464106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52112/0 (socket says 172.21.15.26:52112) 2021-11-03T17:02:05.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.057+0000 7f24637fe700 1 -- 172.21.15.26:0/2352450407 learned_addr learned my addr 172.21.15.26:0/2352450407 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:02:05.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.058+0000 7f2462ffd700 1 --2- 172.21.15.26:0/2352450407 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24640f6ff0 0x7f2464107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:02:05.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.058+0000 7f24637fe700 1 -- 172.21.15.26:0/2352450407 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24640f6ff0 msgr2=0x7f2464107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:02:05.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.058+0000 7f24637fe700 1 --2- 172.21.15.26:0/2352450407 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24640f6ff0 0x7f2464107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:05.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.058+0000 7f24637fe700 1 -- 172.21.15.26:0/2352450407 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2454005040 con 0x7f24640f66e0 2021-11-03T17:02:05.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.058+0000 7f2462ffd700 1 --2- 172.21.15.26:0/2352450407 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24640f6ff0 0x7f2464107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:02:05.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.058+0000 7f24637fe700 1 --2- 172.21.15.26:0/2352450407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24640f66e0 0x7f2464106f60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f2454009da0 tx=0x7f2454009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:02:05.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.058+0000 7f244bfff700 1 -- 172.21.15.26:0/2352450407 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2454018070 con 0x7f24640f66e0 2021-11-03T17:02:05.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.058+0000 7f246a106700 1 -- 172.21.15.26:0/2352450407 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2464108480 con 0x7f24640f66e0 2021-11-03T17:02:05.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.058+0000 7f244bfff700 1 -- 172.21.15.26:0/2352450407 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2454007d70 con 0x7f24640f66e0 2021-11-03T17:02:05.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.058+0000 7f244bfff700 1 -- 172.21.15.26:0/2352450407 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f245401dea0 con 0x7f24640f66e0 2021-11-03T17:02:05.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.058+0000 7f246a106700 1 -- 172.21.15.26:0/2352450407 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24641089e0 con 0x7f24640f66e0 2021-11-03T17:02:05.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.059+0000 7f246a106700 1 -- 172.21.15.26:0/2352450407 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2464045ad0 con 0x7f24640f66e0 2021-11-03T17:02:05.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.059+0000 7f244bfff700 1 -- 172.21.15.26:0/2352450407 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f245401d420 con 0x7f24640f66e0 2021-11-03T17:02:05.065 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.060+0000 7f244bfff700 1 --2- 172.21.15.26:0/2352450407 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f244c064090 0x7f244c066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:02:05.065 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.060+0000 7f244bfff700 1 -- 172.21.15.26:0/2352450407 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f2454082690 con 0x7f24640f66e0 2021-11-03T17:02:05.065 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.060+0000 7f2462ffd700 1 --2- 172.21.15.26:0/2352450407 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f244c064090 0x7f244c066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:02:05.065 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.060+0000 7f2462ffd700 1 --2- 172.21.15.26:0/2352450407 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f244c064090 0x7f244c066550 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f24580041d0 tx=0x7f2458009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:02:05.066 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.064+0000 7f244bfff700 1 -- 172.21.15.26:0/2352450407 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f2454054ab0 con 0x7f24640f66e0 2021-11-03T17:02:05.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:04 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2833745236' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:02:05.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.269+0000 7f246a106700 1 -- 172.21.15.26:0/2352450407 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f24640feed0 con 0x7f24640f66e0 2021-11-03T17:02:05.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.270+0000 7f244bfff700 1 -- 172.21.15.26:0/2352450407 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f24540546a0 con 0x7f24640f66e0 2021-11-03T17:02:05.266 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:02:05.267 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:02:05.267 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:02:05.267 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:02:05.267 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:02:05.268 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:02:05.268 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:02:05.268 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:02:05.269 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:02:05.269 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:02:05.269 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:02:05.269 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:02:05.270 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:02:05.270 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:02:05.270 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:02:05.270 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:02:05.271 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:02:05.271 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:02:05.271 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:02:05.271 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:02:05.272 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:02:05.272 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:02:05.272 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:02:05.272 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:02:05.273 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:02:05.273 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:02:05.273 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:02:05.273 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:02:05.273 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:02:05.274 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:02:05.274 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:02:05.274 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:02:05.274 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:02:05.275 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:02:05.275 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:02:05.275 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:02:05.275 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:02:05.276 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:02:05.276 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:02:05.277 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.272+0000 7f246a106700 1 -- 172.21.15.26:0/2352450407 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f244c064090 msgr2=0x7f244c066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:02:05.277 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.272+0000 7f246a106700 1 --2- 172.21.15.26:0/2352450407 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f244c064090 0x7f244c066550 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f24580041d0 tx=0x7f2458009040).stop 2021-11-03T17:02:05.277 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.272+0000 7f246a106700 1 -- 172.21.15.26:0/2352450407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24640f66e0 msgr2=0x7f2464106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:02:05.277 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.272+0000 7f246a106700 1 --2- 172.21.15.26:0/2352450407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24640f66e0 0x7f2464106f60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f2454009da0 tx=0x7f2454009b30).stop 2021-11-03T17:02:05.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.272+0000 7f246a106700 1 -- 172.21.15.26:0/2352450407 shutdown_connections 2021-11-03T17:02:05.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.272+0000 7f246a106700 1 --2- 172.21.15.26:0/2352450407 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f244c064090 0x7f244c066550 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:05.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.272+0000 7f246a106700 1 --2- 172.21.15.26:0/2352450407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24640f66e0 0x7f2464106f60 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:05.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.272+0000 7f246a106700 1 --2- 172.21.15.26:0/2352450407 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24640f6ff0 0x7f2464107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:05.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.272+0000 7f246a106700 1 -- 172.21.15.26:0/2352450407 >> 172.21.15.26:0/2352450407 conn(0x7f24640f1f00 msgr2=0x7f24640fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:02:05.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.272+0000 7f246a106700 1 -- 172.21.15.26:0/2352450407 shutdown_connections 2021-11-03T17:02:05.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:05.272+0000 7f246a106700 1 -- 172.21.15.26:0/2352450407 wait complete. 2021-11-03T17:02:05.279 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:02:05.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:04 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2833745236' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:02:06.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:05 smithi194 ceph-mon[65619]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:02:06.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:05 smithi194 ceph-mon[65619]: pgmap v223: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:06.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:05 smithi194 ceph-mon[65619]: from='client.34368 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:02:06.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:05 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2352450407' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:02:06.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:05 smithi026 ceph-mon[96795]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:02:06.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:05 smithi026 ceph-mon[96795]: pgmap v223: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:06.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:05 smithi026 ceph-mon[96795]: from='client.34368 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:02:06.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:05 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2352450407' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:02:08.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:07 smithi194 ceph-mon[65619]: pgmap v224: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:08.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:07 smithi026 ceph-mon[96795]: pgmap v224: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:10.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:09 smithi194 ceph-mon[65619]: pgmap v225: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:10.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:09 smithi026 ceph-mon[96795]: pgmap v225: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:11.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:10 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:02:11.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:10 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:02:12.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:11 smithi194 ceph-mon[65619]: pgmap v226: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:12.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:11 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:02:12.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:11 smithi026 ceph-mon[96795]: pgmap v226: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:12.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:11 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:02:14.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:13 smithi194 ceph-mon[65619]: pgmap v227: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:14.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:13 smithi026 ceph-mon[96795]: pgmap v227: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:16.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:15 smithi194 ceph-mon[65619]: pgmap v228: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:16.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:15 smithi026 ceph-mon[96795]: pgmap v228: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:18.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:17 smithi194 ceph-mon[65619]: pgmap v229: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:18.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:17 smithi026 ceph-mon[96795]: pgmap v229: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:20.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:19 smithi194 ceph-mon[65619]: pgmap v230: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:20.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:19 smithi026 ceph-mon[96795]: pgmap v230: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:22.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:21 smithi194 ceph-mon[65619]: pgmap v231: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:22.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:21 smithi026 ceph-mon[96795]: pgmap v231: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:24.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:23 smithi194 ceph-mon[65619]: pgmap v232: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:24.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:23 smithi026 ceph-mon[96795]: pgmap v232: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:26.141 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:26 smithi194 ceph-mon[65619]: pgmap v233: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:26.141 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:26 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:02:26.163 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:26 smithi026 ceph-mon[96795]: pgmap v233: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:26.164 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:26 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:02:27.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:27 smithi194 ceph-mon[65619]: poll took 60061.424 ms: 1 events 2021-11-03T17:02:27.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:27 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:02:27.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:27 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:02:27.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:27 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:02:27.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:27 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:02:27.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:27 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:02:27.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:27 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:02:27.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:27 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:02:27.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:27 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:02:27.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:27 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:02:27.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:27 smithi026 ceph-mon[96795]: poll took 60061.424 ms: 1 events 2021-11-03T17:02:27.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:27 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:02:27.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:27 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:02:27.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:27 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:02:27.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:27 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:02:27.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:27 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:02:27.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:27 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:02:27.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:27 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:02:27.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:27 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:02:27.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:27 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:02:28.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:28 smithi194 ceph-mon[65619]: pgmap v234: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:28.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:28 smithi026 ceph-mon[96795]: pgmap v234: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:30.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:30 smithi194 ceph-mon[65619]: pgmap v235: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:30.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:30 smithi026 ceph-mon[96795]: pgmap v235: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:32.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:32 smithi194 ceph-mon[65619]: pgmap v236: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:32.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:32 smithi026 ceph-mon[96795]: pgmap v236: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:34.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:34 smithi194 ceph-mon[65619]: pgmap v237: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:34.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:34 smithi026 ceph-mon[96795]: pgmap v237: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:35.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.388+0000 7f8a1f5d4700 1 -- 172.21.15.26:0/499585718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a180f5ef0 msgr2=0x7f8a180f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:02:35.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.388+0000 7f8a1f5d4700 1 --2- 172.21.15.26:0/499585718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a180f5ef0 0x7f8a180f6920 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f8a0c004660 tx=0x7f8a0c009b30).stop 2021-11-03T17:02:35.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.388+0000 7f8a1f5d4700 1 -- 172.21.15.26:0/499585718 shutdown_connections 2021-11-03T17:02:35.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.388+0000 7f8a1f5d4700 1 --2- 172.21.15.26:0/499585718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a180f5ef0 0x7f8a180f6920 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:35.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.388+0000 7f8a1f5d4700 1 --2- 172.21.15.26:0/499585718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a180f55e0 0x7f8a180f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:35.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.388+0000 7f8a1f5d4700 1 -- 172.21.15.26:0/499585718 >> 172.21.15.26:0/499585718 conn(0x7f8a180f0de0 msgr2=0x7f8a180f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:02:35.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.388+0000 7f8a1f5d4700 1 -- 172.21.15.26:0/499585718 shutdown_connections 2021-11-03T17:02:35.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.388+0000 7f8a1f5d4700 1 -- 172.21.15.26:0/499585718 wait complete. 2021-11-03T17:02:35.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.389+0000 7f8a1f5d4700 1 Processor -- start 2021-11-03T17:02:35.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.389+0000 7f8a1f5d4700 1 -- start start 2021-11-03T17:02:35.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.389+0000 7f8a1f5d4700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a180f55e0 0x7f8a18106f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:02:35.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.389+0000 7f8a1f5d4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a180f5ef0 0x7f8a18107410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:02:35.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.389+0000 7f8a1f5d4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a181079c0 con 0x7f8a180f5ef0 2021-11-03T17:02:35.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.389+0000 7f8a1f5d4700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a18107b00 con 0x7f8a180f55e0 2021-11-03T17:02:35.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.389+0000 7f8a1cb6f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a180f5ef0 0x7f8a18107410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:02:35.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.389+0000 7f8a1cb6f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a180f5ef0 0x7f8a18107410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52132/0 (socket says 172.21.15.26:52132) 2021-11-03T17:02:35.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.389+0000 7f8a1cb6f700 1 -- 172.21.15.26:0/1364511983 learned_addr learned my addr 172.21.15.26:0/1364511983 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:02:35.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.389+0000 7f8a1d370700 1 --2- 172.21.15.26:0/1364511983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a180f55e0 0x7f8a18106f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:02:35.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.389+0000 7f8a1cb6f700 1 -- 172.21.15.26:0/1364511983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a180f55e0 msgr2=0x7f8a18106f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:02:35.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.389+0000 7f8a1cb6f700 1 --2- 172.21.15.26:0/1364511983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a180f55e0 0x7f8a18106f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:35.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.389+0000 7f8a1cb6f700 1 -- 172.21.15.26:0/1364511983 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a0c005040 con 0x7f8a180f5ef0 2021-11-03T17:02:35.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.389+0000 7f8a1cb6f700 1 --2- 172.21.15.26:0/1364511983 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a180f5ef0 0x7f8a18107410 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f8a0c009990 tx=0x7f8a0c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:02:35.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.390+0000 7f8a15ffb700 1 -- 172.21.15.26:0/1364511983 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a0c018070 con 0x7f8a180f5ef0 2021-11-03T17:02:35.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.390+0000 7f8a15ffb700 1 -- 172.21.15.26:0/1364511983 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8a0c007ba0 con 0x7f8a180f5ef0 2021-11-03T17:02:35.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.390+0000 7f8a15ffb700 1 -- 172.21.15.26:0/1364511983 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a0c01c3c0 con 0x7f8a180f5ef0 2021-11-03T17:02:35.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.390+0000 7f8a1f5d4700 1 -- 172.21.15.26:0/1364511983 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a18108440 con 0x7f8a180f5ef0 2021-11-03T17:02:35.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.390+0000 7f8a1f5d4700 1 -- 172.21.15.26:0/1364511983 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a181089a0 con 0x7f8a180f5ef0 2021-11-03T17:02:35.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.391+0000 7f8a1f5d4700 1 -- 172.21.15.26:0/1364511983 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a18045ad0 con 0x7f8a180f5ef0 2021-11-03T17:02:35.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.391+0000 7f8a15ffb700 1 -- 172.21.15.26:0/1364511983 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f8a0c01d420 con 0x7f8a180f5ef0 2021-11-03T17:02:35.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.392+0000 7f8a15ffb700 1 --2- 172.21.15.26:0/1364511983 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8a000640b0 0x7f8a00066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:02:35.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.392+0000 7f8a15ffb700 1 -- 172.21.15.26:0/1364511983 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f8a0c082430 con 0x7f8a180f5ef0 2021-11-03T17:02:35.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.392+0000 7f8a1d370700 1 --2- 172.21.15.26:0/1364511983 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8a000640b0 0x7f8a00066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:02:35.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.392+0000 7f8a1d370700 1 --2- 172.21.15.26:0/1364511983 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8a000640b0 0x7f8a00066570 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f8a10009740 tx=0x7f8a10009c60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:02:35.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.396+0000 7f8a15ffb700 1 -- 172.21.15.26:0/1364511983 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f8a0c0547f0 con 0x7f8a180f5ef0 2021-11-03T17:02:35.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.576+0000 7f8a1f5d4700 1 -- 172.21.15.26:0/1364511983 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a1805fe30 con 0x7f8a000640b0 2021-11-03T17:02:35.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.578+0000 7f8a15ffb700 1 -- 172.21.15.26:0/1364511983 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f8a1805fe30 con 0x7f8a000640b0 2021-11-03T17:02:35.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.580+0000 7f8a1f5d4700 1 -- 172.21.15.26:0/1364511983 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8a000640b0 msgr2=0x7f8a00066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:02:35.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.580+0000 7f8a1f5d4700 1 --2- 172.21.15.26:0/1364511983 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8a000640b0 0x7f8a00066570 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f8a10009740 tx=0x7f8a10009c60).stop 2021-11-03T17:02:35.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.580+0000 7f8a1f5d4700 1 -- 172.21.15.26:0/1364511983 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a180f5ef0 msgr2=0x7f8a18107410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:02:35.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.580+0000 7f8a1f5d4700 1 --2- 172.21.15.26:0/1364511983 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a180f5ef0 0x7f8a18107410 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f8a0c009990 tx=0x7f8a0c009b30).stop 2021-11-03T17:02:35.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.580+0000 7f8a1f5d4700 1 -- 172.21.15.26:0/1364511983 shutdown_connections 2021-11-03T17:02:35.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.580+0000 7f8a1f5d4700 1 --2- 172.21.15.26:0/1364511983 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8a000640b0 0x7f8a00066570 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:35.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.580+0000 7f8a1f5d4700 1 --2- 172.21.15.26:0/1364511983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a180f55e0 0x7f8a18106f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:35.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.580+0000 7f8a1f5d4700 1 --2- 172.21.15.26:0/1364511983 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a180f5ef0 0x7f8a18107410 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:35.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.580+0000 7f8a1f5d4700 1 -- 172.21.15.26:0/1364511983 >> 172.21.15.26:0/1364511983 conn(0x7f8a180f0de0 msgr2=0x7f8a1805f720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:02:35.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.580+0000 7f8a1f5d4700 1 -- 172.21.15.26:0/1364511983 shutdown_connections 2021-11-03T17:02:35.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.580+0000 7f8a1f5d4700 1 -- 172.21.15.26:0/1364511983 wait complete. 2021-11-03T17:02:35.584 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:02:35.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.680+0000 7fba1359e700 1 -- 172.21.15.26:0/3360317813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba140f77d0 msgr2=0x7fba140f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:02:35.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.680+0000 7fba1359e700 1 --2- 172.21.15.26:0/3360317813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba140f77d0 0x7fba140f7c30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fba08004660 tx=0x7fba08009b30).stop 2021-11-03T17:02:35.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.680+0000 7fba1359e700 1 -- 172.21.15.26:0/3360317813 shutdown_connections 2021-11-03T17:02:35.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.680+0000 7fba1359e700 1 --2- 172.21.15.26:0/3360317813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba140f77d0 0x7fba140f7c30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:35.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.680+0000 7fba1359e700 1 --2- 172.21.15.26:0/3360317813 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba140f6530 0x7fba140f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:35.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.680+0000 7fba1359e700 1 -- 172.21.15.26:0/3360317813 >> 172.21.15.26:0/3360317813 conn(0x7fba140f1cd0 msgr2=0x7fba140f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:02:35.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.680+0000 7fba1359e700 1 -- 172.21.15.26:0/3360317813 shutdown_connections 2021-11-03T17:02:35.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.680+0000 7fba1359e700 1 -- 172.21.15.26:0/3360317813 wait complete. 2021-11-03T17:02:35.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.681+0000 7fba1359e700 1 Processor -- start 2021-11-03T17:02:35.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.681+0000 7fba1359e700 1 -- start start 2021-11-03T17:02:35.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.681+0000 7fba1359e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba140f6530 0x7fba14106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:02:35.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.681+0000 7fba1359e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba140f77d0 0x7fba14107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:02:35.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.681+0000 7fba1359e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba14107870 con 0x7fba140f77d0 2021-11-03T17:02:35.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.681+0000 7fba1359e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba14108080 con 0x7fba140f6530 2021-11-03T17:02:35.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.681+0000 7fba11d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba140f77d0 0x7fba14107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:02:35.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.681+0000 7fba11d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba140f77d0 0x7fba14107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52142/0 (socket says 172.21.15.26:52142) 2021-11-03T17:02:35.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.681+0000 7fba11d9b700 1 -- 172.21.15.26:0/3082701141 learned_addr learned my addr 172.21.15.26:0/3082701141 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:02:35.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.681+0000 7fba1259c700 1 --2- 172.21.15.26:0/3082701141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba140f6530 0x7fba14106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:02:35.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.681+0000 7fba11d9b700 1 -- 172.21.15.26:0/3082701141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba140f6530 msgr2=0x7fba14106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:02:35.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.681+0000 7fba11d9b700 1 --2- 172.21.15.26:0/3082701141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba140f6530 0x7fba14106d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:35.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.681+0000 7fba11d9b700 1 -- 172.21.15.26:0/3082701141 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba08005040 con 0x7fba140f77d0 2021-11-03T17:02:35.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.682+0000 7fba11d9b700 1 --2- 172.21.15.26:0/3082701141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba140f77d0 0x7fba14107270 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fba08009990 tx=0x7fba08009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:02:35.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.682+0000 7fba02ffd700 1 -- 172.21.15.26:0/3082701141 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba08018070 con 0x7fba140f77d0 2021-11-03T17:02:35.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.682+0000 7fba02ffd700 1 -- 172.21.15.26:0/3082701141 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fba08007ba0 con 0x7fba140f77d0 2021-11-03T17:02:35.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.682+0000 7fba1359e700 1 -- 172.21.15.26:0/3082701141 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba141082a0 con 0x7fba140f77d0 2021-11-03T17:02:35.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.682+0000 7fba02ffd700 1 -- 172.21.15.26:0/3082701141 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba0801c3c0 con 0x7fba140f77d0 2021-11-03T17:02:35.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.682+0000 7fba1359e700 1 -- 172.21.15.26:0/3082701141 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba14108800 con 0x7fba140f77d0 2021-11-03T17:02:35.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.683+0000 7fba1359e700 1 -- 172.21.15.26:0/3082701141 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba14059100 con 0x7fba140f77d0 2021-11-03T17:02:35.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.683+0000 7fba02ffd700 1 -- 172.21.15.26:0/3082701141 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fba0801d420 con 0x7fba140f77d0 2021-11-03T17:02:35.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.684+0000 7fba02ffd700 1 --2- 172.21.15.26:0/3082701141 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb9fc064100 0x7fb9fc0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:02:35.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.684+0000 7fba02ffd700 1 -- 172.21.15.26:0/3082701141 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fba080823e0 con 0x7fba140f77d0 2021-11-03T17:02:35.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.684+0000 7fba1259c700 1 --2- 172.21.15.26:0/3082701141 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb9fc064100 0x7fb9fc0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:02:35.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.684+0000 7fba1259c700 1 --2- 172.21.15.26:0/3082701141 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb9fc064100 0x7fb9fc0665c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fba14106af0 tx=0x7fba04009c00).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:02:35.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.688+0000 7fba02ffd700 1 -- 172.21.15.26:0/3082701141 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fba080547a0 con 0x7fba140f77d0 2021-11-03T17:02:35.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.859+0000 7fba1359e700 1 -- 172.21.15.26:0/3082701141 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fba140fee80 con 0x7fb9fc064100 2021-11-03T17:02:35.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.874+0000 7fba02ffd700 1 -- 172.21.15.26:0/3082701141 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fba140fee80 con 0x7fb9fc064100 2021-11-03T17:02:35.869 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:02:35.870 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (13m) 4m ago 15m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:02:35.870 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (6m) 4m ago 15m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:02:35.870 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (5m) 3m ago 14m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:02:35.871 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (13m) 4m ago 14m 38.9M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:02:35.871 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (6m) 4m ago 10m 13.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:02:35.871 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (7m) 4m ago 10m 14.7M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:02:35.871 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (10m) 3m ago 10m 16.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:02:35.871 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (10m) 3m ago 10m 16.5M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:02:35.872 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (7m) 4m ago 16m 468M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:02:35.872 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (7m) 3m ago 14m 412M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:02:35.872 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (6m) 4m ago 16m 75.8M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:02:35.872 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (6m) 3m ago 14m 66.4M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:02:35.872 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (14m) 4m ago 14m 18.1M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:02:35.873 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (14m) 3m ago 14m 18.3M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:02:35.873 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (5m) 4m ago 13m 153M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:02:35.873 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (5m) 4m ago 13m 166M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:02:35.873 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (4m) 4m ago 12m 11.2M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:02:35.874 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (4m) 3m ago 12m 181M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:02:35.874 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (3m) 3m ago 12m 185M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:02:35.874 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (3m) 3m ago 11m 13.5M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:02:35.874 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (13m) 4m ago 14m 47.5M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:02:35.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.876+0000 7fba1359e700 1 -- 172.21.15.26:0/3082701141 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb9fc064100 msgr2=0x7fb9fc0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:02:35.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.876+0000 7fba1359e700 1 --2- 172.21.15.26:0/3082701141 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb9fc064100 0x7fb9fc0665c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fba14106af0 tx=0x7fba04009c00).stop 2021-11-03T17:02:35.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.876+0000 7fba1359e700 1 -- 172.21.15.26:0/3082701141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba140f77d0 msgr2=0x7fba14107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:02:35.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.876+0000 7fba1359e700 1 --2- 172.21.15.26:0/3082701141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba140f77d0 0x7fba14107270 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fba08009990 tx=0x7fba08009b30).stop 2021-11-03T17:02:35.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.876+0000 7fba1359e700 1 -- 172.21.15.26:0/3082701141 shutdown_connections 2021-11-03T17:02:35.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.876+0000 7fba1359e700 1 --2- 172.21.15.26:0/3082701141 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb9fc064100 0x7fb9fc0665c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:35.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.876+0000 7fba1359e700 1 --2- 172.21.15.26:0/3082701141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba140f6530 0x7fba14106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:35.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.876+0000 7fba1359e700 1 --2- 172.21.15.26:0/3082701141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba140f77d0 0x7fba14107270 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:35.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.876+0000 7fba1359e700 1 -- 172.21.15.26:0/3082701141 >> 172.21.15.26:0/3082701141 conn(0x7fba140f1cd0 msgr2=0x7fba140fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:02:35.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.876+0000 7fba1359e700 1 -- 172.21.15.26:0/3082701141 shutdown_connections 2021-11-03T17:02:35.879 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.876+0000 7fba1359e700 1 -- 172.21.15.26:0/3082701141 wait complete. 2021-11-03T17:02:35.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.975+0000 7fc517ba5700 1 -- 172.21.15.26:0/2118918969 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5100f66e0 msgr2=0x7fc5100f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:02:35.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.975+0000 7fc517ba5700 1 --2- 172.21.15.26:0/2118918969 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5100f66e0 0x7fc5100f6b00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fc5080099e0 tx=0x7fc508004d10).stop 2021-11-03T17:02:35.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.975+0000 7fc517ba5700 1 -- 172.21.15.26:0/2118918969 shutdown_connections 2021-11-03T17:02:35.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.975+0000 7fc517ba5700 1 --2- 172.21.15.26:0/2118918969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5100f6ff0 0x7fc5100f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:35.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.975+0000 7fc517ba5700 1 --2- 172.21.15.26:0/2118918969 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5100f66e0 0x7fc5100f6b00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:35.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.975+0000 7fc517ba5700 1 -- 172.21.15.26:0/2118918969 >> 172.21.15.26:0/2118918969 conn(0x7fc5100f1f00 msgr2=0x7fc5100f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:02:35.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.975+0000 7fc517ba5700 1 -- 172.21.15.26:0/2118918969 shutdown_connections 2021-11-03T17:02:35.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.975+0000 7fc517ba5700 1 -- 172.21.15.26:0/2118918969 wait complete. 2021-11-03T17:02:35.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.976+0000 7fc517ba5700 1 Processor -- start 2021-11-03T17:02:35.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.976+0000 7fc517ba5700 1 -- start start 2021-11-03T17:02:35.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.976+0000 7fc517ba5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5100f66e0 0x7fc510107070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:02:35.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.976+0000 7fc517ba5700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5100f6ff0 0x7fc510107560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:02:35.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.976+0000 7fc517ba5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc510107b10 con 0x7fc5100f66e0 2021-11-03T17:02:35.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.976+0000 7fc517ba5700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc510107c50 con 0x7fc5100f6ff0 2021-11-03T17:02:35.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.976+0000 7fc515941700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5100f66e0 0x7fc510107070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:02:35.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.976+0000 7fc515941700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5100f66e0 0x7fc510107070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52150/0 (socket says 172.21.15.26:52150) 2021-11-03T17:02:35.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.976+0000 7fc515941700 1 -- 172.21.15.26:0/4171127917 learned_addr learned my addr 172.21.15.26:0/4171127917 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:02:35.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.976+0000 7fc515941700 1 -- 172.21.15.26:0/4171127917 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5100f6ff0 msgr2=0x7fc510107560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:02:35.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.976+0000 7fc515140700 1 --2- 172.21.15.26:0/4171127917 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5100f6ff0 0x7fc510107560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:02:35.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.976+0000 7fc515941700 1 --2- 172.21.15.26:0/4171127917 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5100f6ff0 0x7fc510107560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:35.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.976+0000 7fc515941700 1 -- 172.21.15.26:0/4171127917 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc508009640 con 0x7fc5100f66e0 2021-11-03T17:02:35.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.977+0000 7fc515941700 1 --2- 172.21.15.26:0/4171127917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5100f66e0 0x7fc510107070 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fc50800b3b0 tx=0x7fc508004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:02:35.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.977+0000 7fc50e7fc700 1 -- 172.21.15.26:0/4171127917 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc50800e030 con 0x7fc5100f66e0 2021-11-03T17:02:35.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.977+0000 7fc50e7fc700 1 -- 172.21.15.26:0/4171127917 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc5080049b0 con 0x7fc5100f66e0 2021-11-03T17:02:35.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.977+0000 7fc517ba5700 1 -- 172.21.15.26:0/4171127917 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc510108590 con 0x7fc5100f66e0 2021-11-03T17:02:35.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.977+0000 7fc50e7fc700 1 -- 172.21.15.26:0/4171127917 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc508018070 con 0x7fc5100f66e0 2021-11-03T17:02:35.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.977+0000 7fc517ba5700 1 -- 172.21.15.26:0/4171127917 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc510108a70 con 0x7fc5100f66e0 2021-11-03T17:02:35.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.978+0000 7fc517ba5700 1 -- 172.21.15.26:0/4171127917 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc510045ad0 con 0x7fc5100f66e0 2021-11-03T17:02:35.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.978+0000 7fc50e7fc700 1 -- 172.21.15.26:0/4171127917 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc508007d40 con 0x7fc5100f66e0 2021-11-03T17:02:35.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.979+0000 7fc50e7fc700 1 --2- 172.21.15.26:0/4171127917 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc4f80640b0 0x7fc4f8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:02:35.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.979+0000 7fc50e7fc700 1 -- 172.21.15.26:0/4171127917 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc508082550 con 0x7fc5100f66e0 2021-11-03T17:02:35.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.979+0000 7fc515140700 1 --2- 172.21.15.26:0/4171127917 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc4f80640b0 0x7fc4f8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:02:35.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.979+0000 7fc515140700 1 --2- 172.21.15.26:0/4171127917 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc4f80640b0 0x7fc4f8066570 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fc504004a70 tx=0x7fc50400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:02:35.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:35.983+0000 7fc50e7fc700 1 -- 172.21.15.26:0/4171127917 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc508054850 con 0x7fc5100f66e0 2021-11-03T17:02:36.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.211+0000 7fc517ba5700 1 -- 172.21.15.26:0/4171127917 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc5100fefa0 con 0x7fc5100f66e0 2021-11-03T17:02:36.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.211+0000 7fc50e7fc700 1 -- 172.21.15.26:0/4171127917 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fc508054440 con 0x7fc5100f66e0 2021-11-03T17:02:36.207 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:02:36.207 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:02:36.207 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:02:36.208 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:02:36.208 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:02:36.208 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:02:36.208 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:02:36.209 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:02:36.209 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:02:36.209 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:02:36.209 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:02:36.210 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:02:36.210 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:02:36.210 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:02:36.210 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:02:36.211 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:02:36.211 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:02:36.211 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:02:36.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.213+0000 7fc517ba5700 1 -- 172.21.15.26:0/4171127917 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc4f80640b0 msgr2=0x7fc4f8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:02:36.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.213+0000 7fc517ba5700 1 --2- 172.21.15.26:0/4171127917 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc4f80640b0 0x7fc4f8066570 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fc504004a70 tx=0x7fc50400b040).stop 2021-11-03T17:02:36.213 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.213+0000 7fc517ba5700 1 -- 172.21.15.26:0/4171127917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5100f66e0 msgr2=0x7fc510107070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:02:36.213 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.213+0000 7fc517ba5700 1 --2- 172.21.15.26:0/4171127917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5100f66e0 0x7fc510107070 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fc50800b3b0 tx=0x7fc508004d10).stop 2021-11-03T17:02:36.213 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.213+0000 7fc517ba5700 1 -- 172.21.15.26:0/4171127917 shutdown_connections 2021-11-03T17:02:36.213 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.213+0000 7fc517ba5700 1 --2- 172.21.15.26:0/4171127917 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc4f80640b0 0x7fc4f8066570 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:36.214 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.213+0000 7fc517ba5700 1 --2- 172.21.15.26:0/4171127917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5100f66e0 0x7fc510107070 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:36.214 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.213+0000 7fc517ba5700 1 --2- 172.21.15.26:0/4171127917 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5100f6ff0 0x7fc510107560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:36.214 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.213+0000 7fc517ba5700 1 -- 172.21.15.26:0/4171127917 >> 172.21.15.26:0/4171127917 conn(0x7fc5100f1f00 msgr2=0x7fc5100fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:02:36.214 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.213+0000 7fc517ba5700 1 -- 172.21.15.26:0/4171127917 shutdown_connections 2021-11-03T17:02:36.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.213+0000 7fc517ba5700 1 -- 172.21.15.26:0/4171127917 wait complete. 2021-11-03T17:02:36.308 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.313+0000 7fb4c52fe700 1 -- 172.21.15.26:0/2223666136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4c0060270 msgr2=0x7fb4c00f91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:02:36.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.313+0000 7fb4c52fe700 1 --2- 172.21.15.26:0/2223666136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4c0060270 0x7fb4c00f91e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fb4b0004660 tx=0x7fb4b0009b30).stop 2021-11-03T17:02:36.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.313+0000 7fb4c52fe700 1 -- 172.21.15.26:0/2223666136 shutdown_connections 2021-11-03T17:02:36.310 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.313+0000 7fb4c52fe700 1 --2- 172.21.15.26:0/2223666136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4c00f96d0 0x7fb4c00fbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:02:36.310 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.313+0000 7fb4c52fe700 1 --2- 172.21.15.26:0/2223666136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4c0060270 0x7fb4c00f91e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:36.310 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.313+0000 7fb4c52fe700 1 -- 172.21.15.26:0/2223666136 >> 172.21.15.26:0/2223666136 conn(0x7fb4c00f0bc0 msgr2=0x7fb4c00f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:02:36.310 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.313+0000 7fb4c52fe700 1 -- 172.21.15.26:0/2223666136 shutdown_connections 2021-11-03T17:02:36.311 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.313+0000 7fb4c52fe700 1 -- 172.21.15.26:0/2223666136 wait complete. 2021-11-03T17:02:36.311 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.314+0000 7fb4c52fe700 1 Processor -- start 2021-11-03T17:02:36.311 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.314+0000 7fb4c52fe700 1 -- start start 2021-11-03T17:02:36.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.314+0000 7fb4c52fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4c0060270 0x7fb4c00f6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:02:36.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.314+0000 7fb4c52fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4c00f96d0 0x7fb4c00f50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:02:36.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.314+0000 7fb4c52fe700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c00f56d0 con 0x7fb4c0060270 2021-11-03T17:02:36.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.314+0000 7fb4c52fe700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c00f5810 con 0x7fb4c00f96d0 2021-11-03T17:02:36.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.314+0000 7fb4beffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4c0060270 0x7fb4c00f6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:02:36.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.314+0000 7fb4beffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4c0060270 0x7fb4c00f6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52160/0 (socket says 172.21.15.26:52160) 2021-11-03T17:02:36.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.314+0000 7fb4beffd700 1 -- 172.21.15.26:0/1840881657 learned_addr learned my addr 172.21.15.26:0/1840881657 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:02:36.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.314+0000 7fb4be7fc700 1 --2- 172.21.15.26:0/1840881657 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4c00f96d0 0x7fb4c00f50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:02:36.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.315+0000 7fb4beffd700 1 -- 172.21.15.26:0/1840881657 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4c00f96d0 msgr2=0x7fb4c00f50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:02:36.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.315+0000 7fb4beffd700 1 --2- 172.21.15.26:0/1840881657 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4c00f96d0 0x7fb4c00f50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:36.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.315+0000 7fb4beffd700 1 -- 172.21.15.26:0/1840881657 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b0005040 con 0x7fb4c0060270 2021-11-03T17:02:36.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.315+0000 7fb4beffd700 1 --2- 172.21.15.26:0/1840881657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4c0060270 0x7fb4c00f6c60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fb4b0009990 tx=0x7fb4b0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:02:36.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.315+0000 7fb4a77fe700 1 -- 172.21.15.26:0/1840881657 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4b0018070 con 0x7fb4c0060270 2021-11-03T17:02:36.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.315+0000 7fb4a77fe700 1 -- 172.21.15.26:0/1840881657 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb4b0007ca0 con 0x7fb4c0060270 2021-11-03T17:02:36.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.315+0000 7fb4c52fe700 1 -- 172.21.15.26:0/1840881657 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4c00f5a90 con 0x7fb4c0060270 2021-11-03T17:02:36.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.315+0000 7fb4a77fe700 1 -- 172.21.15.26:0/1840881657 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4b001c600 con 0x7fb4c0060270 2021-11-03T17:02:36.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.315+0000 7fb4c52fe700 1 -- 172.21.15.26:0/1840881657 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4c010ede0 con 0x7fb4c0060270 2021-11-03T17:02:36.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.316+0000 7fb4c52fe700 1 -- 172.21.15.26:0/1840881657 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4c0045ad0 con 0x7fb4c0060270 2021-11-03T17:02:36.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.316+0000 7fb4a77fe700 1 -- 172.21.15.26:0/1840881657 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fb4b001d9d0 con 0x7fb4c0060270 2021-11-03T17:02:36.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.317+0000 7fb4a77fe700 1 --2- 172.21.15.26:0/1840881657 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb4a8064100 0x7fb4a80665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:02:36.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.317+0000 7fb4a77fe700 1 -- 172.21.15.26:0/1840881657 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fb4b0082630 con 0x7fb4c0060270 2021-11-03T17:02:36.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.317+0000 7fb4be7fc700 1 --2- 172.21.15.26:0/1840881657 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb4a8064100 0x7fb4a80665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:02:36.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.317+0000 7fb4be7fc700 1 --2- 172.21.15.26:0/1840881657 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb4a8064100 0x7fb4a80665c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fb4c0060040 tx=0x7fb4b4008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:02:36.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.321+0000 7fb4a77fe700 1 -- 172.21.15.26:0/1840881657 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fb4b0054990 con 0x7fb4c0060270 2021-11-03T17:02:36.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:36 smithi194 ceph-mon[65619]: pgmap v238: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:36.524 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.529+0000 7fb4c52fe700 1 -- 172.21.15.26:0/1840881657 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb4c00008d0 con 0x7fb4c0060270 2021-11-03T17:02:36.525 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.530+0000 7fb4a77fe700 1 -- 172.21.15.26:0/1840881657 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fb4b0054580 con 0x7fb4c0060270 2021-11-03T17:02:36.525 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:02:36.526 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:02:36.526 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:02:36.526 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:02:36.526 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:02:36.527 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:02:36.527 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:02:36.527 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:02:36.527 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:02:36.528 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:02:36.528 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:02:36.528 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:02:36.528 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:02:36.528 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:02:36.529 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:02:36.529 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:02:36.529 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:02:36.529 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:02:36.530 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:02:36.530 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:02:36.530 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:02:36.530 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:02:36.531 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:02:36.531 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:02:36.531 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:02:36.531 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:02:36.531 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:02:36.532 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:02:36.532 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:02:36.532 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:02:36.532 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:02:36.533 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:02:36.533 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:02:36.533 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:02:36.533 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:02:36.533 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:02:36.534 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:02:36.534 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:02:36.534 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:02:36.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.532+0000 7fb4c52fe700 1 -- 172.21.15.26:0/1840881657 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb4a8064100 msgr2=0x7fb4a80665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:02:36.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.532+0000 7fb4c52fe700 1 --2- 172.21.15.26:0/1840881657 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb4a8064100 0x7fb4a80665c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fb4c0060040 tx=0x7fb4b4008040).stop 2021-11-03T17:02:36.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.532+0000 7fb4c52fe700 1 -- 172.21.15.26:0/1840881657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4c0060270 msgr2=0x7fb4c00f6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:02:36.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.532+0000 7fb4c52fe700 1 --2- 172.21.15.26:0/1840881657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4c0060270 0x7fb4c00f6c60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fb4b0009990 tx=0x7fb4b0009b30).stop 2021-11-03T17:02:36.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.532+0000 7fb4c52fe700 1 -- 172.21.15.26:0/1840881657 shutdown_connections 2021-11-03T17:02:36.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.532+0000 7fb4c52fe700 1 --2- 172.21.15.26:0/1840881657 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb4a8064100 0x7fb4a80665c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:36.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.532+0000 7fb4c52fe700 1 --2- 172.21.15.26:0/1840881657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4c0060270 0x7fb4c00f6c60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:36.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.532+0000 7fb4c52fe700 1 --2- 172.21.15.26:0/1840881657 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4c00f96d0 0x7fb4c00f50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:02:36.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.532+0000 7fb4c52fe700 1 -- 172.21.15.26:0/1840881657 >> 172.21.15.26:0/1840881657 conn(0x7fb4c00f0bc0 msgr2=0x7fb4c00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:02:36.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.532+0000 7fb4c52fe700 1 -- 172.21.15.26:0/1840881657 shutdown_connections 2021-11-03T17:02:36.538 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:02:36.532+0000 7fb4c52fe700 1 -- 172.21.15.26:0/1840881657 wait complete. 2021-11-03T17:02:36.538 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:02:36.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:36 smithi026 ceph-mon[96795]: pgmap v238: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:37.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:37 smithi194 ceph-mon[65619]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:02:37.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:37 smithi194 ceph-mon[65619]: from='client.34384 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:02:37.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:37 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/4171127917' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:02:37.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:37 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1840881657' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:02:37.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:37 smithi026 ceph-mon[96795]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:02:37.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:37 smithi026 ceph-mon[96795]: from='client.34384 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:02:37.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:37 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/4171127917' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:02:37.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:37 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1840881657' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:02:38.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:38 smithi194 ceph-mon[65619]: pgmap v239: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:38.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:38 smithi026 ceph-mon[96795]: pgmap v239: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:40.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:40 smithi194 ceph-mon[65619]: pgmap v240: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:40.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:40 smithi026 ceph-mon[96795]: pgmap v240: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:41.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:02:41.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:02:42.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:42 smithi194 ceph-mon[65619]: pgmap v241: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:42.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:42 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:02:42.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:42 smithi026 ceph-mon[96795]: pgmap v241: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:42.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:42 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:02:44.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:44 smithi194 ceph-mon[65619]: pgmap v242: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:44.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:44 smithi026 ceph-mon[96795]: pgmap v242: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:46.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:46 smithi194 ceph-mon[65619]: pgmap v243: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:46.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:46 smithi026 ceph-mon[96795]: pgmap v243: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:48.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:48 smithi194 ceph-mon[65619]: pgmap v244: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:48.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:02:48.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:02:48.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:48 smithi026 ceph-mon[96795]: pgmap v244: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:48.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:02:48.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:02:50.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:50 smithi194 ceph-mon[65619]: pgmap v245: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:50.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:50 smithi026 ceph-mon[96795]: pgmap v245: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:52.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:52 smithi194 ceph-mon[65619]: pgmap v246: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:52.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:52 smithi026 ceph-mon[96795]: pgmap v246: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:54.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:54 smithi194 ceph-mon[65619]: pgmap v247: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:54.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:54 smithi026 ceph-mon[96795]: pgmap v247: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:56.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:56 smithi194 ceph-mon[65619]: pgmap v248: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:56.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:56 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:02:56.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:56 smithi026 ceph-mon[96795]: pgmap v248: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:56.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:56 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:02:57.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:57 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:02:57.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:57 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:02:58.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:58 smithi194 ceph-mon[65619]: pgmap v249: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:02:58.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:58 smithi026 ceph-mon[96795]: pgmap v249: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:00.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:02:59 smithi026 ceph-mon[96795]: pgmap v250: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:00.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:02:59 smithi194 ceph-mon[65619]: pgmap v250: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:02.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:01 smithi026 ceph-mon[96795]: pgmap v251: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:02.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:01 smithi194 ceph-mon[65619]: pgmap v251: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:04.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:03 smithi026 ceph-mon[96795]: pgmap v252: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:04.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:03 smithi194 ceph-mon[65619]: pgmap v252: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:05.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:05 smithi026 ceph-mon[96795]: pgmap v253: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:06.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:05 smithi194 ceph-mon[65619]: pgmap v253: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:06.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.642+0000 7f49c62be700 1 -- 172.21.15.26:0/647213911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49c00f66e0 msgr2=0x7f49c00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:03:06.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.642+0000 7f49c62be700 1 --2- 172.21.15.26:0/647213911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49c00f66e0 0x7f49c00f6b00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f49b4004660 tx=0x7f49b4009b30).stop 2021-11-03T17:03:06.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.642+0000 7f49c62be700 1 -- 172.21.15.26:0/647213911 shutdown_connections 2021-11-03T17:03:06.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.642+0000 7f49c62be700 1 --2- 172.21.15.26:0/647213911 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49c00f7980 0x7f49c00f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:03:06.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.642+0000 7f49c62be700 1 --2- 172.21.15.26:0/647213911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49c00f66e0 0x7f49c00f6b00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:03:06.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.642+0000 7f49c62be700 1 -- 172.21.15.26:0/647213911 >> 172.21.15.26:0/647213911 conn(0x7f49c00f1e40 msgr2=0x7f49c00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:03:06.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.642+0000 7f49c62be700 1 -- 172.21.15.26:0/647213911 shutdown_connections 2021-11-03T17:03:06.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.642+0000 7f49c62be700 1 -- 172.21.15.26:0/647213911 wait complete. 2021-11-03T17:03:06.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.643+0000 7f49c62be700 1 Processor -- start 2021-11-03T17:03:06.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.643+0000 7f49c62be700 1 -- start start 2021-11-03T17:03:06.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.643+0000 7f49c62be700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49c00f66e0 0x7f49c0106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:03:06.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.643+0000 7f49c62be700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49c00f7980 0x7f49c01074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:03:06.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.643+0000 7f49c62be700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c0107ae0 con 0x7f49c00f7980 2021-11-03T17:03:06.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.643+0000 7f49c62be700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c0108390 con 0x7f49c00f66e0 2021-11-03T17:03:06.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.643+0000 7f49bf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49c00f7980 0x7f49c01074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:03:06.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.643+0000 7f49bf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49c00f7980 0x7f49c01074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52180/0 (socket says 172.21.15.26:52180) 2021-11-03T17:03:06.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.643+0000 7f49bf7fe700 1 -- 172.21.15.26:0/2136010154 learned_addr learned my addr 172.21.15.26:0/2136010154 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:03:06.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.643+0000 7f49bffff700 1 --2- 172.21.15.26:0/2136010154 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49c00f66e0 0x7f49c0106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:03:06.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.643+0000 7f49bf7fe700 1 -- 172.21.15.26:0/2136010154 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49c00f66e0 msgr2=0x7f49c0106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:03:06.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.643+0000 7f49bf7fe700 1 --2- 172.21.15.26:0/2136010154 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49c00f66e0 0x7f49c0106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:03:06.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.644+0000 7f49bf7fe700 1 -- 172.21.15.26:0/2136010154 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b4005040 con 0x7f49c00f7980 2021-11-03T17:03:06.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.644+0000 7f49bf7fe700 1 --2- 172.21.15.26:0/2136010154 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49c00f7980 0x7f49c01074a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f49b000b410 tx=0x7f49b0006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:03:06.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.644+0000 7f49bcff9700 1 -- 172.21.15.26:0/2136010154 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49b00125f0 con 0x7f49c00f7980 2021-11-03T17:03:06.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.644+0000 7f49bcff9700 1 -- 172.21.15.26:0/2136010154 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f49b0012c00 con 0x7f49c00f7980 2021-11-03T17:03:06.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.644+0000 7f49c62be700 1 -- 172.21.15.26:0/2136010154 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c0108670 con 0x7f49c00f7980 2021-11-03T17:03:06.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.644+0000 7f49bcff9700 1 -- 172.21.15.26:0/2136010154 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49b0002ae0 con 0x7f49c00f7980 2021-11-03T17:03:06.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.644+0000 7f49c62be700 1 -- 172.21.15.26:0/2136010154 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c0108c30 con 0x7f49c00f7980 2021-11-03T17:03:06.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.645+0000 7f49c62be700 1 -- 172.21.15.26:0/2136010154 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49c00f5ad0 con 0x7f49c00f7980 2021-11-03T17:03:06.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.645+0000 7f49bcff9700 1 -- 172.21.15.26:0/2136010154 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f49b000f030 con 0x7f49c00f7980 2021-11-03T17:03:06.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.646+0000 7f49bcff9700 1 --2- 172.21.15.26:0/2136010154 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f49a8064090 0x7f49a8066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:03:06.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.646+0000 7f49bcff9700 1 -- 172.21.15.26:0/2136010154 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f49b0080c70 con 0x7f49c00f7980 2021-11-03T17:03:06.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.646+0000 7f49bffff700 1 --2- 172.21.15.26:0/2136010154 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f49a8064090 0x7f49a8066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:03:06.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.646+0000 7f49bffff700 1 --2- 172.21.15.26:0/2136010154 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f49a8064090 0x7f49a8066550 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f49b4013690 tx=0x7f49b4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:03:06.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.650+0000 7f49bcff9700 1 -- 172.21.15.26:0/2136010154 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f49b0052fd0 con 0x7f49c00f7980 2021-11-03T17:03:06.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.829+0000 7f49c62be700 1 -- 172.21.15.26:0/2136010154 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f49c00fef90 con 0x7f49a8064090 2021-11-03T17:03:06.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.831+0000 7f49bcff9700 1 -- 172.21.15.26:0/2136010154 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f49c00fef90 con 0x7f49a8064090 2021-11-03T17:03:06.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.832+0000 7f49c62be700 1 -- 172.21.15.26:0/2136010154 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f49a8064090 msgr2=0x7f49a8066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:03:06.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.832+0000 7f49c62be700 1 --2- 172.21.15.26:0/2136010154 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f49a8064090 0x7f49a8066550 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f49b4013690 tx=0x7f49b4009b30).stop 2021-11-03T17:03:06.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.832+0000 7f49c62be700 1 -- 172.21.15.26:0/2136010154 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49c00f7980 msgr2=0x7f49c01074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:03:06.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.832+0000 7f49c62be700 1 --2- 172.21.15.26:0/2136010154 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49c00f7980 0x7f49c01074a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f49b000b410 tx=0x7f49b0006ef0).stop 2021-11-03T17:03:06.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.832+0000 7f49c62be700 1 -- 172.21.15.26:0/2136010154 shutdown_connections 2021-11-03T17:03:06.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.832+0000 7f49c62be700 1 --2- 172.21.15.26:0/2136010154 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f49a8064090 0x7f49a8066550 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:03:06.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.832+0000 7f49c62be700 1 --2- 172.21.15.26:0/2136010154 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49c00f66e0 0x7f49c0106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:03:06.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.832+0000 7f49c62be700 1 --2- 172.21.15.26:0/2136010154 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49c00f7980 0x7f49c01074a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:03:06.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.832+0000 7f49c62be700 1 -- 172.21.15.26:0/2136010154 >> 172.21.15.26:0/2136010154 conn(0x7f49c00f1e40 msgr2=0x7f49c00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:03:06.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.832+0000 7f49c62be700 1 -- 172.21.15.26:0/2136010154 shutdown_connections 2021-11-03T17:03:06.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.833+0000 7f49c62be700 1 -- 172.21.15.26:0/2136010154 wait complete. 2021-11-03T17:03:06.838 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:03:06.929 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.933+0000 7ff7eaa3a700 1 -- 172.21.15.26:0/2860466695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7e40f55e0 msgr2=0x7ff7e40f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:03:06.929 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.933+0000 7ff7eaa3a700 1 --2- 172.21.15.26:0/2860466695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7e40f55e0 0x7ff7e40f5a00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7ff7cc004660 tx=0x7ff7cc009b30).stop 2021-11-03T17:03:06.930 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.933+0000 7ff7eaa3a700 1 -- 172.21.15.26:0/2860466695 shutdown_connections 2021-11-03T17:03:06.930 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.933+0000 7ff7eaa3a700 1 --2- 172.21.15.26:0/2860466695 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7e40f5ef0 0x7ff7e40f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:03:06.930 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.933+0000 7ff7eaa3a700 1 --2- 172.21.15.26:0/2860466695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7e40f55e0 0x7ff7e40f5a00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:03:06.930 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.933+0000 7ff7eaa3a700 1 -- 172.21.15.26:0/2860466695 >> 172.21.15.26:0/2860466695 conn(0x7ff7e40f0de0 msgr2=0x7ff7e40f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:03:06.931 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.933+0000 7ff7eaa3a700 1 -- 172.21.15.26:0/2860466695 shutdown_connections 2021-11-03T17:03:06.931 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.933+0000 7ff7eaa3a700 1 -- 172.21.15.26:0/2860466695 wait complete. 2021-11-03T17:03:06.931 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.933+0000 7ff7eaa3a700 1 Processor -- start 2021-11-03T17:03:06.934 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.934+0000 7ff7eaa3a700 1 -- start start 2021-11-03T17:03:06.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.934+0000 7ff7eaa3a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7e40f55e0 0x7ff7e4109c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:03:06.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.934+0000 7ff7eaa3a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7e40f5ef0 0x7ff7e410c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:03:06.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.934+0000 7ff7eaa3a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e40605b0 con 0x7ff7e40f5ef0 2021-11-03T17:03:06.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.934+0000 7ff7eaa3a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e40606f0 con 0x7ff7e40f55e0 2021-11-03T17:03:06.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.934+0000 7ff7e37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7e40f5ef0 0x7ff7e410c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:03:06.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.934+0000 7ff7e37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7e40f5ef0 0x7ff7e410c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52190/0 (socket says 172.21.15.26:52190) 2021-11-03T17:03:06.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.934+0000 7ff7e37fe700 1 -- 172.21.15.26:0/2512566408 learned_addr learned my addr 172.21.15.26:0/2512566408 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:03:06.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.934+0000 7ff7e3fff700 1 --2- 172.21.15.26:0/2512566408 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7e40f55e0 0x7ff7e4109c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:03:06.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.934+0000 7ff7e37fe700 1 -- 172.21.15.26:0/2512566408 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7e40f55e0 msgr2=0x7ff7e4109c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:03:06.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.934+0000 7ff7e37fe700 1 --2- 172.21.15.26:0/2512566408 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7e40f55e0 0x7ff7e4109c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:03:06.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.934+0000 7ff7e37fe700 1 -- 172.21.15.26:0/2512566408 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7cc005040 con 0x7ff7e40f5ef0 2021-11-03T17:03:06.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.934+0000 7ff7e3fff700 1 --2- 172.21.15.26:0/2512566408 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7e40f55e0 0x7ff7e4109c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:03:06.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.934+0000 7ff7e37fe700 1 --2- 172.21.15.26:0/2512566408 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7e40f5ef0 0x7ff7e410c130 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7ff7d400b410 tx=0x7ff7d4006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:03:06.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.935+0000 7ff7e0ff9700 1 -- 172.21.15.26:0/2512566408 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7d40125f0 con 0x7ff7e40f5ef0 2021-11-03T17:03:06.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.935+0000 7ff7eaa3a700 1 -- 172.21.15.26:0/2512566408 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7e410c790 con 0x7ff7e40f5ef0 2021-11-03T17:03:06.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.935+0000 7ff7e0ff9700 1 -- 172.21.15.26:0/2512566408 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff7d4012c00 con 0x7ff7e40f5ef0 2021-11-03T17:03:06.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.935+0000 7ff7e0ff9700 1 -- 172.21.15.26:0/2512566408 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7d4002ae0 con 0x7ff7e40f5ef0 2021-11-03T17:03:06.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.935+0000 7ff7eaa3a700 1 -- 172.21.15.26:0/2512566408 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7e410cd50 con 0x7ff7e40f5ef0 2021-11-03T17:03:06.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.936+0000 7ff7eaa3a700 1 -- 172.21.15.26:0/2512566408 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7e4045ad0 con 0x7ff7e40f5ef0 2021-11-03T17:03:06.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.936+0000 7ff7e0ff9700 1 -- 172.21.15.26:0/2512566408 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ff7d400f030 con 0x7ff7e40f5ef0 2021-11-03T17:03:06.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.936+0000 7ff7e0ff9700 1 --2- 172.21.15.26:0/2512566408 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff7d00640b0 0x7ff7d0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:03:06.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.937+0000 7ff7e0ff9700 1 -- 172.21.15.26:0/2512566408 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ff7d4080c80 con 0x7ff7e40f5ef0 2021-11-03T17:03:06.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.937+0000 7ff7e3fff700 1 --2- 172.21.15.26:0/2512566408 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff7d00640b0 0x7ff7d0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:03:06.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.937+0000 7ff7e3fff700 1 --2- 172.21.15.26:0/2512566408 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff7d00640b0 0x7ff7d0066570 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7ff7cc004e30 tx=0x7ff7cc009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:03:06.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:06.941+0000 7ff7e0ff9700 1 -- 172.21.15.26:0/2512566408 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ff7d4052fe0 con 0x7ff7e40f5ef0 2021-11-03T17:03:07.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.111+0000 7ff7eaa3a700 1 -- 172.21.15.26:0/2512566408 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff7e40fdfc0 con 0x7ff7d00640b0 2021-11-03T17:03:07.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.126+0000 7ff7e0ff9700 1 -- 172.21.15.26:0/2512566408 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7ff7e40fdfc0 con 0x7ff7d00640b0 2021-11-03T17:03:07.122 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:03:07.123 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (14m) 5m ago 15m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:03:07.123 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (6m) 5m ago 15m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:03:07.123 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (6m) 3m ago 14m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:03:07.123 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (14m) 5m ago 15m 38.9M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:03:07.124 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (7m) 5m ago 10m 13.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:03:07.124 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (7m) 5m ago 10m 14.7M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:03:07.124 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (10m) 3m ago 10m 16.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:03:07.124 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (10m) 3m ago 10m 16.5M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:03:07.125 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (8m) 5m ago 16m 468M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:03:07.125 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (7m) 3m ago 14m 412M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:03:07.125 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (7m) 5m ago 17m 75.8M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:03:07.125 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (7m) 3m ago 14m 66.4M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:03:07.125 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (15m) 5m ago 15m 18.1M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:03:07.126 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (14m) 3m ago 14m 18.3M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:03:07.126 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (6m) 5m ago 14m 153M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:03:07.126 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (5m) 5m ago 13m 166M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:03:07.126 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (5m) 5m ago 13m 11.2M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:03:07.127 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (4m) 3m ago 12m 181M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:03:07.127 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (4m) 3m ago 12m 185M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:03:07.127 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (3m) 3m ago 12m 13.5M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:03:07.127 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (14m) 5m ago 14m 47.5M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:03:07.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.127+0000 7ff7eaa3a700 1 -- 172.21.15.26:0/2512566408 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff7d00640b0 msgr2=0x7ff7d0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:03:07.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.127+0000 7ff7eaa3a700 1 --2- 172.21.15.26:0/2512566408 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff7d00640b0 0x7ff7d0066570 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7ff7cc004e30 tx=0x7ff7cc009b30).stop 2021-11-03T17:03:07.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.127+0000 7ff7eaa3a700 1 -- 172.21.15.26:0/2512566408 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7e40f5ef0 msgr2=0x7ff7e410c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:03:07.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.127+0000 7ff7eaa3a700 1 --2- 172.21.15.26:0/2512566408 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7e40f5ef0 0x7ff7e410c130 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7ff7d400b410 tx=0x7ff7d4006ef0).stop 2021-11-03T17:03:07.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.127+0000 7ff7eaa3a700 1 -- 172.21.15.26:0/2512566408 shutdown_connections 2021-11-03T17:03:07.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.127+0000 7ff7eaa3a700 1 --2- 172.21.15.26:0/2512566408 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff7d00640b0 0x7ff7d0066570 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:03:07.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.127+0000 7ff7eaa3a700 1 --2- 172.21.15.26:0/2512566408 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7e40f55e0 0x7ff7e4109c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:03:07.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.127+0000 7ff7eaa3a700 1 --2- 172.21.15.26:0/2512566408 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7e40f5ef0 0x7ff7e410c130 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:03:07.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.127+0000 7ff7eaa3a700 1 -- 172.21.15.26:0/2512566408 >> 172.21.15.26:0/2512566408 conn(0x7ff7e40f0de0 msgr2=0x7ff7e40fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:03:07.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.128+0000 7ff7eaa3a700 1 -- 172.21.15.26:0/2512566408 shutdown_connections 2021-11-03T17:03:07.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.128+0000 7ff7eaa3a700 1 -- 172.21.15.26:0/2512566408 wait complete. 2021-11-03T17:03:07.225 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.227+0000 7f858cca7700 1 -- 172.21.15.26:0/1511500741 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85880f66e0 msgr2=0x7f85880f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:03:07.225 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.227+0000 7f858cca7700 1 --2- 172.21.15.26:0/1511500741 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85880f66e0 0x7f85880f6b00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f85800099e0 tx=0x7f8580004d10).stop 2021-11-03T17:03:07.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.227+0000 7f858cca7700 1 -- 172.21.15.26:0/1511500741 shutdown_connections 2021-11-03T17:03:07.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.227+0000 7f858cca7700 1 --2- 172.21.15.26:0/1511500741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85880f6ff0 0x7f85880f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:03:07.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.227+0000 7f858cca7700 1 --2- 172.21.15.26:0/1511500741 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85880f66e0 0x7f85880f6b00 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:03:07.227 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.227+0000 7f858cca7700 1 -- 172.21.15.26:0/1511500741 >> 172.21.15.26:0/1511500741 conn(0x7f85880f1f00 msgr2=0x7f85880f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:03:07.227 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.227+0000 7f858cca7700 1 -- 172.21.15.26:0/1511500741 shutdown_connections 2021-11-03T17:03:07.227 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.227+0000 7f858cca7700 1 -- 172.21.15.26:0/1511500741 wait complete. 2021-11-03T17:03:07.227 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.228+0000 7f858cca7700 1 Processor -- start 2021-11-03T17:03:07.227 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.228+0000 7f858cca7700 1 -- start start 2021-11-03T17:03:07.228 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.228+0000 7f858cca7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85880f66e0 0x7f8588107070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:03:07.228 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.228+0000 7f858cca7700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85880f6ff0 0x7f8588107560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:03:07.228 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.228+0000 7f858cca7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8588107b10 con 0x7f85880f66e0 2021-11-03T17:03:07.228 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.228+0000 7f858cca7700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8588107c50 con 0x7f85880f6ff0 2021-11-03T17:03:07.229 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.228+0000 7f858659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85880f66e0 0x7f8588107070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:03:07.229 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.228+0000 7f858659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85880f66e0 0x7f8588107070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52198/0 (socket says 172.21.15.26:52198) 2021-11-03T17:03:07.229 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.228+0000 7f858659c700 1 -- 172.21.15.26:0/240731243 learned_addr learned my addr 172.21.15.26:0/240731243 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:03:07.229 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.228+0000 7f8585d9b700 1 --2- 172.21.15.26:0/240731243 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85880f6ff0 0x7f8588107560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:03:07.229 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.228+0000 7f858659c700 1 -- 172.21.15.26:0/240731243 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85880f6ff0 msgr2=0x7f8588107560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:03:07.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.228+0000 7f858659c700 1 --2- 172.21.15.26:0/240731243 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85880f6ff0 0x7f8588107560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:03:07.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.228+0000 7f858659c700 1 -- 172.21.15.26:0/240731243 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8580009640 con 0x7f85880f66e0 2021-11-03T17:03:07.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.229+0000 7f858659c700 1 --2- 172.21.15.26:0/240731243 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85880f66e0 0x7f8588107070 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f8580004b70 tx=0x7f8580004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:03:07.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.229+0000 7f857effd700 1 -- 172.21.15.26:0/240731243 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f858000e030 con 0x7f85880f66e0 2021-11-03T17:03:07.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.229+0000 7f857effd700 1 -- 172.21.15.26:0/240731243 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f85800049b0 con 0x7f85880f66e0 2021-11-03T17:03:07.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.229+0000 7f858cca7700 1 -- 172.21.15.26:0/240731243 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8588108590 con 0x7f85880f66e0 2021-11-03T17:03:07.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.229+0000 7f857effd700 1 -- 172.21.15.26:0/240731243 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8580018070 con 0x7f85880f66e0 2021-11-03T17:03:07.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.229+0000 7f858cca7700 1 -- 172.21.15.26:0/240731243 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8588108a70 con 0x7f85880f66e0 2021-11-03T17:03:07.233 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.230+0000 7f858cca7700 1 -- 172.21.15.26:0/240731243 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8588045ad0 con 0x7f85880f66e0 2021-11-03T17:03:07.233 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.230+0000 7f857effd700 1 -- 172.21.15.26:0/240731243 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f858001db40 con 0x7f85880f66e0 2021-11-03T17:03:07.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.231+0000 7f857effd700 1 --2- 172.21.15.26:0/240731243 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85740640b0 0x7f8574066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:03:07.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.231+0000 7f857effd700 1 -- 172.21.15.26:0/240731243 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f8580082a10 con 0x7f85880f66e0 2021-11-03T17:03:07.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.231+0000 7f8585d9b700 1 --2- 172.21.15.26:0/240731243 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85740640b0 0x7f8574066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:03:07.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.231+0000 7f8585d9b700 1 --2- 172.21.15.26:0/240731243 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85740640b0 0x7f8574066570 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f8570007fd0 tx=0x7f8570009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:03:07.235 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.235+0000 7f857effd700 1 -- 172.21.15.26:0/240731243 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f8580054d90 con 0x7f85880f66e0 2021-11-03T17:03:07.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.465+0000 7f858cca7700 1 -- 172.21.15.26:0/240731243 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f85880fef30 con 0x7f85880f66e0 2021-11-03T17:03:07.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.466+0000 7f857effd700 1 -- 172.21.15.26:0/240731243 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f8580054980 con 0x7f85880f66e0 2021-11-03T17:03:07.462 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:03:07.463 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:03:07.463 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:03:07.463 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:03:07.464 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:03:07.464 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:03:07.464 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:03:07.464 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:03:07.464 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:03:07.465 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:03:07.465 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:03:07.465 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:03:07.465 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:03:07.466 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:03:07.466 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:03:07.466 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:03:07.466 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:03:07.466 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:03:07.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.467+0000 7f858cca7700 1 -- 172.21.15.26:0/240731243 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85740640b0 msgr2=0x7f8574066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:03:07.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.467+0000 7f858cca7700 1 --2- 172.21.15.26:0/240731243 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85740640b0 0x7f8574066570 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f8570007fd0 tx=0x7f8570009040).stop 2021-11-03T17:03:07.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.467+0000 7f858cca7700 1 -- 172.21.15.26:0/240731243 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85880f66e0 msgr2=0x7f8588107070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:03:07.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.467+0000 7f858cca7700 1 --2- 172.21.15.26:0/240731243 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85880f66e0 0x7f8588107070 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f8580004b70 tx=0x7f8580004d10).stop 2021-11-03T17:03:07.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.467+0000 7f858cca7700 1 -- 172.21.15.26:0/240731243 shutdown_connections 2021-11-03T17:03:07.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.467+0000 7f858cca7700 1 --2- 172.21.15.26:0/240731243 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85740640b0 0x7f8574066570 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:03:07.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.467+0000 7f858cca7700 1 --2- 172.21.15.26:0/240731243 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85880f66e0 0x7f8588107070 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:03:07.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.467+0000 7f858cca7700 1 --2- 172.21.15.26:0/240731243 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85880f6ff0 0x7f8588107560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:03:07.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.467+0000 7f858cca7700 1 -- 172.21.15.26:0/240731243 >> 172.21.15.26:0/240731243 conn(0x7f85880f1f00 msgr2=0x7f85880fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:03:07.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.468+0000 7f858cca7700 1 -- 172.21.15.26:0/240731243 shutdown_connections 2021-11-03T17:03:07.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.468+0000 7f858cca7700 1 -- 172.21.15.26:0/240731243 wait complete. 2021-11-03T17:03:07.565 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.568+0000 7f2bef725700 1 -- 172.21.15.26:0/3381668423 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2be80f55e0 msgr2=0x7f2be80f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:03:07.565 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.568+0000 7f2bef725700 1 --2- 172.21.15.26:0/3381668423 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2be80f55e0 0x7f2be80f5a00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f2be00099e0 tx=0x7f2be0004d10).stop 2021-11-03T17:03:07.565 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.568+0000 7f2bef725700 1 -- 172.21.15.26:0/3381668423 shutdown_connections 2021-11-03T17:03:07.566 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.568+0000 7f2bef725700 1 --2- 172.21.15.26:0/3381668423 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2be80f5ef0 0x7f2be80f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:03:07.566 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.568+0000 7f2bef725700 1 --2- 172.21.15.26:0/3381668423 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2be80f55e0 0x7f2be80f5a00 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:03:07.566 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.568+0000 7f2bef725700 1 -- 172.21.15.26:0/3381668423 >> 172.21.15.26:0/3381668423 conn(0x7f2be80f0de0 msgr2=0x7f2be80f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:03:07.566 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.568+0000 7f2bef725700 1 -- 172.21.15.26:0/3381668423 shutdown_connections 2021-11-03T17:03:07.567 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.568+0000 7f2bef725700 1 -- 172.21.15.26:0/3381668423 wait complete. 2021-11-03T17:03:07.567 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.569+0000 7f2bef725700 1 Processor -- start 2021-11-03T17:03:07.567 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.569+0000 7f2bef725700 1 -- start start 2021-11-03T17:03:07.567 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.569+0000 7f2bef725700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2be80f55e0 0x7f2be8107090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:03:07.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.569+0000 7f2bef725700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2be80f5ef0 0x7f2be8107580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:03:07.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.569+0000 7f2bef725700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be8107b30 con 0x7f2be80f55e0 2021-11-03T17:03:07.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.569+0000 7f2bef725700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be8107c70 con 0x7f2be80f5ef0 2021-11-03T17:03:07.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.569+0000 7f2bed4c1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2be80f55e0 0x7f2be8107090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:03:07.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.569+0000 7f2bed4c1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2be80f55e0 0x7f2be8107090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52210/0 (socket says 172.21.15.26:52210) 2021-11-03T17:03:07.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.569+0000 7f2bed4c1700 1 -- 172.21.15.26:0/3879373964 learned_addr learned my addr 172.21.15.26:0/3879373964 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:03:07.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.569+0000 7f2bed4c1700 1 -- 172.21.15.26:0/3879373964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2be80f5ef0 msgr2=0x7f2be8107580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:03:07.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.569+0000 7f2bed4c1700 1 --2- 172.21.15.26:0/3879373964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2be80f5ef0 0x7f2be8107580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:03:07.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.569+0000 7f2bed4c1700 1 -- 172.21.15.26:0/3879373964 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be0009640 con 0x7f2be80f55e0 2021-11-03T17:03:07.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.569+0000 7f2bed4c1700 1 --2- 172.21.15.26:0/3879373964 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2be80f55e0 0x7f2be8107090 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f2be0004b70 tx=0x7f2be0004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:03:07.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.569+0000 7f2be5ffb700 1 -- 172.21.15.26:0/3879373964 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2be000e030 con 0x7f2be80f55e0 2021-11-03T17:03:07.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.569+0000 7f2be5ffb700 1 -- 172.21.15.26:0/3879373964 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2be00049b0 con 0x7f2be80f55e0 2021-11-03T17:03:07.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.570+0000 7f2be5ffb700 1 -- 172.21.15.26:0/3879373964 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2be0018070 con 0x7f2be80f55e0 2021-11-03T17:03:07.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.570+0000 7f2bef725700 1 -- 172.21.15.26:0/3879373964 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2be81085b0 con 0x7f2be80f55e0 2021-11-03T17:03:07.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.570+0000 7f2bef725700 1 -- 172.21.15.26:0/3879373964 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2be8108a90 con 0x7f2be80f55e0 2021-11-03T17:03:07.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.571+0000 7f2bef725700 1 -- 172.21.15.26:0/3879373964 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2be8045ad0 con 0x7f2be80f55e0 2021-11-03T17:03:07.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.571+0000 7f2be5ffb700 1 -- 172.21.15.26:0/3879373964 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f2be001db40 con 0x7f2be80f55e0 2021-11-03T17:03:07.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.571+0000 7f2be5ffb700 1 --2- 172.21.15.26:0/3879373964 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2bd00640b0 0x7f2bd0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:03:07.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.572+0000 7f2be5ffb700 1 -- 172.21.15.26:0/3879373964 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f2be00826b0 con 0x7f2be80f55e0 2021-11-03T17:03:07.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.572+0000 7f2beccc0700 1 --2- 172.21.15.26:0/3879373964 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2bd00640b0 0x7f2bd0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:03:07.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.572+0000 7f2beccc0700 1 --2- 172.21.15.26:0/3879373964 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2bd00640b0 0x7f2bd0066570 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f2bdc004870 tx=0x7f2bdc0079c0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:03:07.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.576+0000 7f2be5ffb700 1 -- 172.21.15.26:0/3879373964 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f2be0054a70 con 0x7f2be80f55e0 2021-11-03T17:03:07.778 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.782+0000 7f2bef725700 1 -- 172.21.15.26:0/3879373964 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2be80fdf60 con 0x7f2be80f55e0 2021-11-03T17:03:07.779 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.782+0000 7f2be5ffb700 1 -- 172.21.15.26:0/3879373964 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f2be80fdf60 con 0x7f2be80f55e0 2021-11-03T17:03:07.779 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:03:07.779 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:03:07.779 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:03:07.780 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:03:07.781 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:03:07.781 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:03:07.781 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:03:07.781 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:03:07.782 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:03:07.782 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:03:07.782 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:03:07.782 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:03:07.782 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:03:07.783 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:03:07.783 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:03:07.783 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:03:07.783 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:03:07.784 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:03:07.784 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:03:07.784 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:03:07.784 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:03:07.785 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:03:07.785 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:03:07.785 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:03:07.786 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:03:07.787 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:03:07.787 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:03:07.787 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:03:07.787 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:03:07.788 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:03:07.788 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:03:07.788 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:03:07.788 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:03:07.788 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:03:07.789 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:03:07.789 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:03:07.789 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:03:07.789 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:03:07.790 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:03:07.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.784+0000 7f2bef725700 1 -- 172.21.15.26:0/3879373964 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2bd00640b0 msgr2=0x7f2bd0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:03:07.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.784+0000 7f2bef725700 1 --2- 172.21.15.26:0/3879373964 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2bd00640b0 0x7f2bd0066570 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f2bdc004870 tx=0x7f2bdc0079c0).stop 2021-11-03T17:03:07.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.784+0000 7f2bef725700 1 -- 172.21.15.26:0/3879373964 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2be80f55e0 msgr2=0x7f2be8107090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:03:07.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.784+0000 7f2bef725700 1 --2- 172.21.15.26:0/3879373964 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2be80f55e0 0x7f2be8107090 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f2be0004b70 tx=0x7f2be0004d10).stop 2021-11-03T17:03:07.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.784+0000 7f2bef725700 1 -- 172.21.15.26:0/3879373964 shutdown_connections 2021-11-03T17:03:07.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.784+0000 7f2bef725700 1 --2- 172.21.15.26:0/3879373964 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2bd00640b0 0x7f2bd0066570 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:03:07.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.784+0000 7f2bef725700 1 --2- 172.21.15.26:0/3879373964 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2be80f55e0 0x7f2be8107090 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:03:07.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.784+0000 7f2bef725700 1 --2- 172.21.15.26:0/3879373964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2be80f5ef0 0x7f2be8107580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:03:07.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.784+0000 7f2bef725700 1 -- 172.21.15.26:0/3879373964 >> 172.21.15.26:0/3879373964 conn(0x7f2be80f0de0 msgr2=0x7f2be805f720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:03:07.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.784+0000 7f2bef725700 1 -- 172.21.15.26:0/3879373964 shutdown_connections 2021-11-03T17:03:07.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:07.784+0000 7f2bef725700 1 -- 172.21.15.26:0/3879373964 wait complete. 2021-11-03T17:03:07.795 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:03:08.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:07 smithi026 ceph-mon[96795]: pgmap v254: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:08.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:07 smithi026 ceph-mon[96795]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:03:08.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:07 smithi026 ceph-mon[96795]: from='client.34400 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:03:08.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:07 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/240731243' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:03:08.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:07 smithi194 ceph-mon[65619]: pgmap v254: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:08.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:07 smithi194 ceph-mon[65619]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:03:08.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:07 smithi194 ceph-mon[65619]: from='client.34400 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:03:08.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:07 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/240731243' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:03:09.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:08 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3879373964' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:03:09.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:08 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3879373964' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:03:10.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:09 smithi026 ceph-mon[96795]: pgmap v255: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:10.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:09 smithi194 ceph-mon[65619]: pgmap v255: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:12.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:11 smithi026 ceph-mon[96795]: pgmap v256: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:12.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:11 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:03:12.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:11 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:03:12.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:11 smithi194 ceph-mon[65619]: pgmap v256: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:12.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:11 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:03:12.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:11 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:03:14.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:13 smithi026 ceph-mon[96795]: pgmap v257: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:14.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:13 smithi194 ceph-mon[65619]: pgmap v257: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:15.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:15 smithi026 ceph-mon[96795]: pgmap v258: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:16.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:15 smithi194 ceph-mon[65619]: pgmap v258: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:18.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:17 smithi026 ceph-mon[96795]: pgmap v259: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:18.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:17 smithi194 ceph-mon[65619]: pgmap v259: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:20.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:19 smithi026 ceph-mon[96795]: pgmap v260: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:20.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:19 smithi194 ceph-mon[65619]: pgmap v260: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:22.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:21 smithi026 ceph-mon[96795]: pgmap v261: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:22.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:21 smithi194 ceph-mon[65619]: pgmap v261: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:24.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:23 smithi026 ceph-mon[96795]: pgmap v262: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:24.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:23 smithi194 ceph-mon[65619]: pgmap v262: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:25.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:25 smithi026 ceph-mon[96795]: pgmap v263: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:26.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:25 smithi194 ceph-mon[65619]: pgmap v263: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:26.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:26 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:03:26.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:26 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:03:26.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:26 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:03:26.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:26 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:03:26.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:26 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:03:26.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:26 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:03:26.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:26 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:03:26.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:26 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:03:26.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:26 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:03:26.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:26 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:03:26.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:26 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:03:26.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:26 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:03:26.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:26 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:03:26.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:26 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:03:26.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:26 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:03:26.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:26 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:03:28.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:27 smithi026 ceph-mon[96795]: poll took 60070.193 ms: 1 events 2021-11-03T17:03:28.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:27 smithi026 ceph-mon[96795]: pgmap v264: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:28.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:27 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:03:28.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:27 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:03:28.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:27 smithi194 ceph-mon[65619]: poll took 60070.193 ms: 1 events 2021-11-03T17:03:28.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:27 smithi194 ceph-mon[65619]: pgmap v264: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:28.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:27 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:03:28.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:27 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:03:30.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:29 smithi026 ceph-mon[96795]: pgmap v265: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:30.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:29 smithi194 ceph-mon[65619]: pgmap v265: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:32.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:31 smithi026 ceph-mon[96795]: pgmap v266: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:32.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:31 smithi194 ceph-mon[65619]: pgmap v266: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:34.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:33 smithi026 ceph-mon[96795]: pgmap v267: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:34.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:33 smithi194 ceph-mon[65619]: pgmap v267: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:35.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:35 smithi026 ceph-mon[96795]: pgmap v268: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:36.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:35 smithi194 ceph-mon[65619]: pgmap v268: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:37.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:37.901+0000 7f5643b16700 1 -- 172.21.15.26:0/623081608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f563c0f5340 msgr2=0x7f563c0f7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:03:37.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:37.901+0000 7f5643b16700 1 --2- 172.21.15.26:0/623081608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f563c0f5340 0x7f563c0f7ac0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f5630004660 tx=0x7f5630009b30).stop 2021-11-03T17:03:37.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:37.901+0000 7f5643b16700 1 -- 172.21.15.26:0/623081608 shutdown_connections 2021-11-03T17:03:37.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:37.901+0000 7f5643b16700 1 --2- 172.21.15.26:0/623081608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f563c0f5340 0x7f563c0f7ac0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:03:37.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:37.901+0000 7f5643b16700 1 --2- 172.21.15.26:0/623081608 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f563c0f49a0 0x7f563c0f4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:03:37.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:37.901+0000 7f5643b16700 1 -- 172.21.15.26:0/623081608 >> 172.21.15.26:0/623081608 conn(0x7f563c0f04c0 msgr2=0x7f563c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:03:37.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:37.901+0000 7f5643b16700 1 -- 172.21.15.26:0/623081608 shutdown_connections 2021-11-03T17:03:37.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:37.901+0000 7f5643b16700 1 -- 172.21.15.26:0/623081608 wait complete. 2021-11-03T17:03:37.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:37.901+0000 7f5643b16700 1 Processor -- start 2021-11-03T17:03:37.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:37.901+0000 7f5643b16700 1 -- start start 2021-11-03T17:03:37.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:37.902+0000 7f5643b16700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f563c0f49a0 0x7f563c0f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:03:37.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:37.902+0000 7f5643b16700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f563c0f5340 0x7f563c0f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:03:37.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:37.902+0000 7f5643b16700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563c0f5f30 con 0x7f563c0f5340 2021-11-03T17:03:37.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:37.902+0000 7f5643b16700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563c0f6070 con 0x7f563c0f49a0 2021-11-03T17:03:37.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:37.902+0000 7f56410b1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f563c0f5340 0x7f563c0f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:03:37.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:37.902+0000 7f56410b1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f563c0f5340 0x7f563c0f59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52230/0 (socket says 172.21.15.26:52230) 2021-11-03T17:03:37.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:37.902+0000 7f56410b1700 1 -- 172.21.15.26:0/1311223824 learned_addr learned my addr 172.21.15.26:0/1311223824 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:03:37.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:37.902+0000 7f56418b2700 1 --2- 172.21.15.26:0/1311223824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f563c0f49a0 0x7f563c0f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:03:37.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:37.902+0000 7f56410b1700 1 -- 172.21.15.26:0/1311223824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f563c0f49a0 msgr2=0x7f563c0f7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:03:37.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:37.902+0000 7f56410b1700 1 --2- 172.21.15.26:0/1311223824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f563c0f49a0 0x7f563c0f7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:03:37.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:37.902+0000 7f56410b1700 1 -- 172.21.15.26:0/1311223824 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5630005040 con 0x7f563c0f5340 2021-11-03T17:03:37.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:37.902+0000 7f56410b1700 1 --2- 172.21.15.26:0/1311223824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f563c0f5340 0x7f563c0f59d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f5630013a70 tx=0x7f5630009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:03:37.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:37.902+0000 7f562e7fc700 1 -- 172.21.15.26:0/1311223824 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5630018070 con 0x7f563c0f5340 2021-11-03T17:03:37.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:37.903+0000 7f5643b16700 1 -- 172.21.15.26:0/1311223824 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f563c0f62f0 con 0x7f563c0f5340 2021-11-03T17:03:37.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:37.903+0000 7f562e7fc700 1 -- 172.21.15.26:0/1311223824 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f56300097d0 con 0x7f563c0f5340 2021-11-03T17:03:37.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:37.903+0000 7f562e7fc700 1 -- 172.21.15.26:0/1311223824 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f563001c3c0 con 0x7f563c0f5340 2021-11-03T17:03:37.906 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:37.903+0000 7f5643b16700 1 -- 172.21.15.26:0/1311223824 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f563c0f6850 con 0x7f563c0f5340 2021-11-03T17:03:37.908 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:37.903+0000 7f5643b16700 1 -- 172.21.15.26:0/1311223824 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f563c045ad0 con 0x7f563c0f5340 2021-11-03T17:03:37.908 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:37.904+0000 7f562e7fc700 1 -- 172.21.15.26:0/1311223824 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f5630007ba0 con 0x7f563c0f5340 2021-11-03T17:03:37.908 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:37.904+0000 7f562e7fc700 1 --2- 172.21.15.26:0/1311223824 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f56280640b0 0x7f5628066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:03:37.908 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:37.904+0000 7f562e7fc700 1 -- 172.21.15.26:0/1311223824 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f5630082470 con 0x7f563c0f5340 2021-11-03T17:03:37.909 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:37.904+0000 7f56418b2700 1 --2- 172.21.15.26:0/1311223824 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f56280640b0 0x7f5628066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:03:37.910 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:37.905+0000 7f56418b2700 1 --2- 172.21.15.26:0/1311223824 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f56280640b0 0x7f5628066570 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f563c0f72e0 tx=0x7f5638009c80).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:03:37.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:37.909+0000 7f562e7fc700 1 -- 172.21.15.26:0/1311223824 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f56300547d0 con 0x7f563c0f5340 2021-11-03T17:03:38.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.088+0000 7f5643b16700 1 -- 172.21.15.26:0/1311223824 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f563c0fefd0 con 0x7f56280640b0 2021-11-03T17:03:38.085 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.089+0000 7f562e7fc700 1 -- 172.21.15.26:0/1311223824 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f563c0fefd0 con 0x7f56280640b0 2021-11-03T17:03:38.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.091+0000 7f5643b16700 1 -- 172.21.15.26:0/1311223824 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f56280640b0 msgr2=0x7f5628066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:03:38.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.091+0000 7f5643b16700 1 --2- 172.21.15.26:0/1311223824 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f56280640b0 0x7f5628066570 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f563c0f72e0 tx=0x7f5638009c80).stop 2021-11-03T17:03:38.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.091+0000 7f5643b16700 1 -- 172.21.15.26:0/1311223824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f563c0f5340 msgr2=0x7f563c0f59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:03:38.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.091+0000 7f5643b16700 1 --2- 172.21.15.26:0/1311223824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f563c0f5340 0x7f563c0f59d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f5630013a70 tx=0x7f5630009b30).stop 2021-11-03T17:03:38.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.091+0000 7f5643b16700 1 -- 172.21.15.26:0/1311223824 shutdown_connections 2021-11-03T17:03:38.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.091+0000 7f5643b16700 1 --2- 172.21.15.26:0/1311223824 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f56280640b0 0x7f5628066570 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:03:38.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.091+0000 7f5643b16700 1 --2- 172.21.15.26:0/1311223824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f563c0f49a0 0x7f563c0f7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:03:38.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.091+0000 7f5643b16700 1 --2- 172.21.15.26:0/1311223824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f563c0f5340 0x7f563c0f59d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:03:38.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.091+0000 7f5643b16700 1 -- 172.21.15.26:0/1311223824 >> 172.21.15.26:0/1311223824 conn(0x7f563c0f04c0 msgr2=0x7f563c0fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:03:38.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.091+0000 7f5643b16700 1 -- 172.21.15.26:0/1311223824 shutdown_connections 2021-11-03T17:03:38.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.092+0000 7f5643b16700 1 -- 172.21.15.26:0/1311223824 wait complete. 2021-11-03T17:03:38.096 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:03:38.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:37 smithi026 ceph-mon[96795]: pgmap v269: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:38.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.191+0000 7f7293fff700 1 -- 172.21.15.26:0/3873172710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72940f77d0 msgr2=0x7f72940f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:03:38.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.191+0000 7f7293fff700 1 --2- 172.21.15.26:0/3873172710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72940f77d0 0x7f72940f7c30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f7288004660 tx=0x7f7288009b30).stop 2021-11-03T17:03:38.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.191+0000 7f7293fff700 1 -- 172.21.15.26:0/3873172710 shutdown_connections 2021-11-03T17:03:38.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.191+0000 7f7293fff700 1 --2- 172.21.15.26:0/3873172710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72940f77d0 0x7f72940f7c30 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:03:38.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.191+0000 7f7293fff700 1 --2- 172.21.15.26:0/3873172710 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72940f6530 0x7f72940f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:03:38.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.191+0000 7f7293fff700 1 -- 172.21.15.26:0/3873172710 >> 172.21.15.26:0/3873172710 conn(0x7f72940f1cd0 msgr2=0x7f72940f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:03:38.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.191+0000 7f7293fff700 1 -- 172.21.15.26:0/3873172710 shutdown_connections 2021-11-03T17:03:38.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.191+0000 7f7293fff700 1 -- 172.21.15.26:0/3873172710 wait complete. 2021-11-03T17:03:38.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.192+0000 7f7293fff700 1 Processor -- start 2021-11-03T17:03:38.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.192+0000 7f7293fff700 1 -- start start 2021-11-03T17:03:38.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.192+0000 7f7293fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72940f6530 0x7f729406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:03:38.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.192+0000 7f7293fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72940f77d0 0x7f7294069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:03:38.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.192+0000 7f7293fff700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f729410aa50 con 0x7f72940f6530 2021-11-03T17:03:38.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.192+0000 7f7293fff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f729410ab90 con 0x7f72940f77d0 2021-11-03T17:03:38.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.192+0000 7f7292ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72940f6530 0x7f729406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:03:38.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.192+0000 7f7292ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72940f6530 0x7f729406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52238/0 (socket says 172.21.15.26:52238) 2021-11-03T17:03:38.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.192+0000 7f7292ffd700 1 -- 172.21.15.26:0/884156426 learned_addr learned my addr 172.21.15.26:0/884156426 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:03:38.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.192+0000 7f72927fc700 1 --2- 172.21.15.26:0/884156426 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72940f77d0 0x7f7294069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:03:38.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.193+0000 7f7292ffd700 1 -- 172.21.15.26:0/884156426 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72940f77d0 msgr2=0x7f7294069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:03:38.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.193+0000 7f7292ffd700 1 --2- 172.21.15.26:0/884156426 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72940f77d0 0x7f7294069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:03:38.193 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.193+0000 7f7292ffd700 1 -- 172.21.15.26:0/884156426 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7288005040 con 0x7f72940f6530 2021-11-03T17:03:38.193 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.193+0000 7f7292ffd700 1 --2- 172.21.15.26:0/884156426 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72940f6530 0x7f729406b9a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f72840093f0 tx=0x7f7284006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:03:38.193 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.193+0000 7f727b7fe700 1 -- 172.21.15.26:0/884156426 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7284013640 con 0x7f72940f6530 2021-11-03T17:03:38.193 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.193+0000 7f727b7fe700 1 -- 172.21.15.26:0/884156426 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7284013c50 con 0x7f72940f6530 2021-11-03T17:03:38.194 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.193+0000 7f7293fff700 1 -- 172.21.15.26:0/884156426 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f729406a460 con 0x7f72940f6530 2021-11-03T17:03:38.195 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.193+0000 7f727b7fe700 1 -- 172.21.15.26:0/884156426 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7284012c70 con 0x7f72940f6530 2021-11-03T17:03:38.195 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.193+0000 7f7293fff700 1 -- 172.21.15.26:0/884156426 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f729406aa20 con 0x7f72940f6530 2021-11-03T17:03:38.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.194+0000 7f7293fff700 1 -- 172.21.15.26:0/884156426 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7294059100 con 0x7f72940f6530 2021-11-03T17:03:38.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.195+0000 7f727b7fe700 1 -- 172.21.15.26:0/884156426 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f728401a060 con 0x7f72940f6530 2021-11-03T17:03:38.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.195+0000 7f727b7fe700 1 --2- 172.21.15.26:0/884156426 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f727c064100 0x7f727c0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:03:38.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.196+0000 7f727b7fe700 1 -- 172.21.15.26:0/884156426 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f7284080cc0 con 0x7f72940f6530 2021-11-03T17:03:38.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.196+0000 7f72927fc700 1 --2- 172.21.15.26:0/884156426 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f727c064100 0x7f727c0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:03:38.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.196+0000 7f72927fc700 1 --2- 172.21.15.26:0/884156426 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f727c064100 0x7f727c0665c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f7288004630 tx=0x7f7288009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:03:38.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.199+0000 7f727b7fe700 1 -- 172.21.15.26:0/884156426 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f7284052ed0 con 0x7f72940f6530 2021-11-03T17:03:38.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:37 smithi194 ceph-mon[65619]: pgmap v269: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:38.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.373+0000 7f7293fff700 1 -- 172.21.15.26:0/884156426 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f72940fee00 con 0x7f727c064100 2021-11-03T17:03:38.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.388+0000 7f727b7fe700 1 -- 172.21.15.26:0/884156426 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f72940fee00 con 0x7f727c064100 2021-11-03T17:03:38.384 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:03:38.384 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (14m) 5m ago 16m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:03:38.384 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (7m) 5m ago 16m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:03:38.384 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (6m) 4m ago 15m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:03:38.385 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (14m) 5m ago 15m 38.9M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:03:38.385 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (7m) 5m ago 11m 13.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:03:38.385 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (8m) 5m ago 11m 14.7M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:03:38.385 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (11m) 4m ago 11m 16.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:03:38.386 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (11m) 4m ago 11m 16.5M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:03:38.386 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (8m) 5m ago 17m 468M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:03:38.386 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (8m) 4m ago 15m 412M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:03:38.387 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (8m) 5m ago 17m 75.8M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:03:38.388 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (7m) 4m ago 15m 66.4M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:03:38.388 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (15m) 5m ago 15m 18.1M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:03:38.388 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (15m) 4m ago 15m 18.3M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:03:38.388 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (6m) 5m ago 14m 153M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:03:38.389 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (6m) 5m ago 14m 166M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:03:38.389 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (5m) 5m ago 13m 11.2M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:03:38.389 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (5m) 4m ago 13m 181M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:03:38.389 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (4m) 4m ago 13m 185M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:03:38.390 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (4m) 4m ago 12m 13.5M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:03:38.390 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (14m) 5m ago 15m 47.5M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:03:38.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.390+0000 7f7293fff700 1 -- 172.21.15.26:0/884156426 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f727c064100 msgr2=0x7f727c0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:03:38.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.390+0000 7f7293fff700 1 --2- 172.21.15.26:0/884156426 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f727c064100 0x7f727c0665c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f7288004630 tx=0x7f7288009b30).stop 2021-11-03T17:03:38.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.390+0000 7f7293fff700 1 -- 172.21.15.26:0/884156426 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72940f6530 msgr2=0x7f729406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:03:38.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.390+0000 7f7293fff700 1 --2- 172.21.15.26:0/884156426 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72940f6530 0x7f729406b9a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f72840093f0 tx=0x7f7284006ec0).stop 2021-11-03T17:03:38.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.390+0000 7f7293fff700 1 -- 172.21.15.26:0/884156426 shutdown_connections 2021-11-03T17:03:38.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.390+0000 7f7293fff700 1 --2- 172.21.15.26:0/884156426 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f727c064100 0x7f727c0665c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:03:38.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.390+0000 7f7293fff700 1 --2- 172.21.15.26:0/884156426 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72940f6530 0x7f729406b9a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:03:38.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.390+0000 7f7293fff700 1 --2- 172.21.15.26:0/884156426 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72940f77d0 0x7f7294069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:03:38.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.390+0000 7f7293fff700 1 -- 172.21.15.26:0/884156426 >> 172.21.15.26:0/884156426 conn(0x7f72940f1cd0 msgr2=0x7f72940fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:03:38.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.390+0000 7f7293fff700 1 -- 172.21.15.26:0/884156426 shutdown_connections 2021-11-03T17:03:38.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.390+0000 7f7293fff700 1 -- 172.21.15.26:0/884156426 wait complete. 2021-11-03T17:03:38.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.490+0000 7f1e657f8700 1 -- 172.21.15.26:0/544073800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e600f5ef0 msgr2=0x7f1e600f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:03:38.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.490+0000 7f1e657f8700 1 --2- 172.21.15.26:0/544073800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e600f5ef0 0x7f1e600f6920 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f1e48004660 tx=0x7f1e48009b30).stop 2021-11-03T17:03:38.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.490+0000 7f1e657f8700 1 -- 172.21.15.26:0/544073800 shutdown_connections 2021-11-03T17:03:38.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.490+0000 7f1e657f8700 1 --2- 172.21.15.26:0/544073800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e600f5ef0 0x7f1e600f6920 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:03:38.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.490+0000 7f1e657f8700 1 --2- 172.21.15.26:0/544073800 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e600f55e0 0x7f1e600f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:03:38.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.490+0000 7f1e657f8700 1 -- 172.21.15.26:0/544073800 >> 172.21.15.26:0/544073800 conn(0x7f1e600f0de0 msgr2=0x7f1e600f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:03:38.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.490+0000 7f1e657f8700 1 -- 172.21.15.26:0/544073800 shutdown_connections 2021-11-03T17:03:38.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.490+0000 7f1e657f8700 1 -- 172.21.15.26:0/544073800 wait complete. 2021-11-03T17:03:38.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.491+0000 7f1e657f8700 1 Processor -- start 2021-11-03T17:03:38.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.491+0000 7f1e657f8700 1 -- start start 2021-11-03T17:03:38.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.491+0000 7f1e657f8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e600f55e0 0x7f1e60105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:03:38.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.491+0000 7f1e657f8700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e600f5ef0 0x7f1e601063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:03:38.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.491+0000 7f1e657f8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e601069f0 con 0x7f1e600f55e0 2021-11-03T17:03:38.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.491+0000 7f1e657f8700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e60107160 con 0x7f1e600f5ef0 2021-11-03T17:03:38.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.491+0000 7f1e5effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e600f55e0 0x7f1e60105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:03:38.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.491+0000 7f1e5effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e600f55e0 0x7f1e60105ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52248/0 (socket says 172.21.15.26:52248) 2021-11-03T17:03:38.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.491+0000 7f1e5effd700 1 -- 172.21.15.26:0/2413786405 learned_addr learned my addr 172.21.15.26:0/2413786405 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:03:38.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.491+0000 7f1e5effd700 1 -- 172.21.15.26:0/2413786405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e600f5ef0 msgr2=0x7f1e601063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:03:38.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.491+0000 7f1e5effd700 1 --2- 172.21.15.26:0/2413786405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e600f5ef0 0x7f1e601063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:03:38.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.491+0000 7f1e5effd700 1 -- 172.21.15.26:0/2413786405 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e48005040 con 0x7f1e600f55e0 2021-11-03T17:03:38.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.491+0000 7f1e5effd700 1 --2- 172.21.15.26:0/2413786405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e600f55e0 0x7f1e60105ec0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f1e5800d770 tx=0x7f1e5800db30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:03:38.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.492+0000 7f1e577fe700 1 -- 172.21.15.26:0/2413786405 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e5800ea60 con 0x7f1e600f55e0 2021-11-03T17:03:38.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.492+0000 7f1e577fe700 1 -- 172.21.15.26:0/2413786405 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1e58012070 con 0x7f1e600f55e0 2021-11-03T17:03:38.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.492+0000 7f1e577fe700 1 -- 172.21.15.26:0/2413786405 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e58015330 con 0x7f1e600f55e0 2021-11-03T17:03:38.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.492+0000 7f1e657f8700 1 -- 172.21.15.26:0/2413786405 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e60107440 con 0x7f1e600f55e0 2021-11-03T17:03:38.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.492+0000 7f1e657f8700 1 -- 172.21.15.26:0/2413786405 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e60107a00 con 0x7f1e600f55e0 2021-11-03T17:03:38.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.493+0000 7f1e657f8700 1 -- 172.21.15.26:0/2413786405 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e600f4a70 con 0x7f1e600f55e0 2021-11-03T17:03:38.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.493+0000 7f1e577fe700 1 -- 172.21.15.26:0/2413786405 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f1e5801e070 con 0x7f1e600f55e0 2021-11-03T17:03:38.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.493+0000 7f1e577fe700 1 --2- 172.21.15.26:0/2413786405 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1e4c0640b0 0x7f1e4c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:03:38.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.494+0000 7f1e577fe700 1 -- 172.21.15.26:0/2413786405 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f1e58082cd0 con 0x7f1e600f55e0 2021-11-03T17:03:38.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.494+0000 7f1e5e7fc700 1 --2- 172.21.15.26:0/2413786405 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1e4c0640b0 0x7f1e4c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:03:38.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.494+0000 7f1e5e7fc700 1 --2- 172.21.15.26:0/2413786405 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1e4c0640b0 0x7f1e4c066570 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f1e48004e30 tx=0x7f1e48009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:03:38.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.498+0000 7f1e577fe700 1 -- 172.21.15.26:0/2413786405 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f1e58054e20 con 0x7f1e600f55e0 2021-11-03T17:03:38.728 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.733+0000 7f1e657f8700 1 -- 172.21.15.26:0/2413786405 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1e601075d0 con 0x7f1e600f55e0 2021-11-03T17:03:38.729 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.734+0000 7f1e577fe700 1 -- 172.21.15.26:0/2413786405 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f1e601075d0 con 0x7f1e600f55e0 2021-11-03T17:03:38.729 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:03:38.730 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:03:38.730 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:03:38.731 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:03:38.731 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:03:38.731 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:03:38.731 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:03:38.732 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:03:38.732 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:03:38.732 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:03:38.732 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:03:38.733 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:03:38.733 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:03:38.733 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:03:38.733 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:03:38.733 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:03:38.734 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:03:38.734 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:03:38.735 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.735+0000 7f1e657f8700 1 -- 172.21.15.26:0/2413786405 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1e4c0640b0 msgr2=0x7f1e4c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:03:38.735 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.735+0000 7f1e657f8700 1 --2- 172.21.15.26:0/2413786405 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1e4c0640b0 0x7f1e4c066570 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f1e48004e30 tx=0x7f1e48009b30).stop 2021-11-03T17:03:38.735 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.735+0000 7f1e657f8700 1 -- 172.21.15.26:0/2413786405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e600f55e0 msgr2=0x7f1e60105ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:03:38.736 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.735+0000 7f1e657f8700 1 --2- 172.21.15.26:0/2413786405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e600f55e0 0x7f1e60105ec0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f1e5800d770 tx=0x7f1e5800db30).stop 2021-11-03T17:03:38.736 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.735+0000 7f1e657f8700 1 -- 172.21.15.26:0/2413786405 shutdown_connections 2021-11-03T17:03:38.736 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.735+0000 7f1e657f8700 1 --2- 172.21.15.26:0/2413786405 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1e4c0640b0 0x7f1e4c066570 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:03:38.736 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.735+0000 7f1e657f8700 1 --2- 172.21.15.26:0/2413786405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e600f55e0 0x7f1e60105ec0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:03:38.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.735+0000 7f1e657f8700 1 --2- 172.21.15.26:0/2413786405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e600f5ef0 0x7f1e601063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:03:38.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.735+0000 7f1e657f8700 1 -- 172.21.15.26:0/2413786405 >> 172.21.15.26:0/2413786405 conn(0x7f1e600f0de0 msgr2=0x7f1e600fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:03:38.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.736+0000 7f1e657f8700 1 -- 172.21.15.26:0/2413786405 shutdown_connections 2021-11-03T17:03:38.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.736+0000 7f1e657f8700 1 -- 172.21.15.26:0/2413786405 wait complete. 2021-11-03T17:03:38.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.836+0000 7f55694fe700 1 -- 172.21.15.26:0/2103507216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55640f5c00 msgr2=0x7f55640f7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:03:38.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.836+0000 7f55694fe700 1 --2- 172.21.15.26:0/2103507216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55640f5c00 0x7f55640f7ff0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f5554004660 tx=0x7f5554009b30).stop 2021-11-03T17:03:38.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.836+0000 7f55694fe700 1 -- 172.21.15.26:0/2103507216 shutdown_connections 2021-11-03T17:03:38.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.836+0000 7f55694fe700 1 --2- 172.21.15.26:0/2103507216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55640f8570 0x7f55640faa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:03:38.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.836+0000 7f55694fe700 1 --2- 172.21.15.26:0/2103507216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55640f5c00 0x7f55640f7ff0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:03:38.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.836+0000 7f55694fe700 1 -- 172.21.15.26:0/2103507216 >> 172.21.15.26:0/2103507216 conn(0x7f55640efec0 msgr2=0x7f55640f2300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:03:38.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.836+0000 7f55694fe700 1 -- 172.21.15.26:0/2103507216 shutdown_connections 2021-11-03T17:03:38.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.836+0000 7f55694fe700 1 -- 172.21.15.26:0/2103507216 wait complete. 2021-11-03T17:03:38.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.837+0000 7f55694fe700 1 Processor -- start 2021-11-03T17:03:38.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.837+0000 7f55694fe700 1 -- start start 2021-11-03T17:03:38.837 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.837+0000 7f55694fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55640f5c00 0x7f5564109ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:03:38.837 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.837+0000 7f55694fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55640f8570 0x7f556410bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:03:38.837 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.837+0000 7f55694fe700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55640f5890 con 0x7f55640f8570 2021-11-03T17:03:38.837 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.837+0000 7f55694fe700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55640f59d0 con 0x7f55640f5c00 2021-11-03T17:03:38.838 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.837+0000 7f55637fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55640f8570 0x7f556410bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:03:38.838 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.837+0000 7f55637fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55640f8570 0x7f556410bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52260/0 (socket says 172.21.15.26:52260) 2021-11-03T17:03:38.838 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.837+0000 7f55637fe700 1 -- 172.21.15.26:0/898596048 learned_addr learned my addr 172.21.15.26:0/898596048 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:03:38.839 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.837+0000 7f5563fff700 1 --2- 172.21.15.26:0/898596048 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55640f5c00 0x7f5564109ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:03:38.839 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.838+0000 7f55637fe700 1 -- 172.21.15.26:0/898596048 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55640f5c00 msgr2=0x7f5564109ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:03:38.839 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.838+0000 7f55637fe700 1 --2- 172.21.15.26:0/898596048 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55640f5c00 0x7f5564109ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:03:38.840 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.838+0000 7f55637fe700 1 -- 172.21.15.26:0/898596048 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5554005040 con 0x7f55640f8570 2021-11-03T17:03:38.840 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.838+0000 7f55637fe700 1 --2- 172.21.15.26:0/898596048 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55640f8570 0x7f556410bfb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f55580026d0 tx=0x7f5558009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:03:38.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.838+0000 7f5560ff9700 1 -- 172.21.15.26:0/898596048 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55580079c0 con 0x7f55640f8570 2021-11-03T17:03:38.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.838+0000 7f5560ff9700 1 -- 172.21.15.26:0/898596048 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f555800f040 con 0x7f55640f8570 2021-11-03T17:03:38.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.838+0000 7f55694fe700 1 -- 172.21.15.26:0/898596048 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f556410c560 con 0x7f55640f8570 2021-11-03T17:03:38.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.838+0000 7f5560ff9700 1 -- 172.21.15.26:0/898596048 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55580148b0 con 0x7f55640f8570 2021-11-03T17:03:38.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.838+0000 7f55694fe700 1 -- 172.21.15.26:0/898596048 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f556410caf0 con 0x7f55640f8570 2021-11-03T17:03:38.842 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.839+0000 7f55694fe700 1 -- 172.21.15.26:0/898596048 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5564059100 con 0x7f55640f8570 2021-11-03T17:03:38.842 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.839+0000 7f5560ff9700 1 -- 172.21.15.26:0/898596048 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f5558007b20 con 0x7f55640f8570 2021-11-03T17:03:38.842 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.840+0000 7f5560ff9700 1 --2- 172.21.15.26:0/898596048 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f554c064100 0x7f554c0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:03:38.842 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.840+0000 7f5560ff9700 1 -- 172.21.15.26:0/898596048 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f5558080690 con 0x7f55640f8570 2021-11-03T17:03:38.843 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.840+0000 7f5563fff700 1 --2- 172.21.15.26:0/898596048 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f554c064100 0x7f554c0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:03:38.843 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.840+0000 7f5563fff700 1 --2- 172.21.15.26:0/898596048 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f554c064100 0x7f554c0665c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f5554004630 tx=0x7f5554009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:03:38.844 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:38.844+0000 7f5560ff9700 1 -- 172.21.15.26:0/898596048 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f55580529f0 con 0x7f55640f8570 2021-11-03T17:03:39.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:39.048+0000 7f55694fe700 1 -- 172.21.15.26:0/898596048 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5564045ad0 con 0x7f55640f8570 2021-11-03T17:03:39.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:39.048+0000 7f5560ff9700 1 -- 172.21.15.26:0/898596048 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f55580525e0 con 0x7f55640f8570 2021-11-03T17:03:39.044 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:03:39.044 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:03:39.044 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:03:39.045 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:03:39.045 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:03:39.045 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:03:39.045 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:03:39.045 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:03:39.046 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:03:39.046 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:03:39.046 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:03:39.046 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:03:39.047 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:03:39.047 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:03:39.047 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:03:39.047 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:03:39.047 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:03:39.048 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:03:39.048 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:03:39.048 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:03:39.048 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:03:39.049 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:03:39.049 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:03:39.049 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:03:39.049 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:03:39.049 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:03:39.050 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:03:39.050 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:03:39.050 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:03:39.050 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:03:39.051 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:03:39.051 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:03:39.051 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:03:39.051 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:03:39.052 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:03:39.052 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:03:39.052 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:03:39.052 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:03:39.052 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:03:39.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:39.050+0000 7f55694fe700 1 -- 172.21.15.26:0/898596048 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f554c064100 msgr2=0x7f554c0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:03:39.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:39.050+0000 7f55694fe700 1 --2- 172.21.15.26:0/898596048 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f554c064100 0x7f554c0665c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f5554004630 tx=0x7f5554009b30).stop 2021-11-03T17:03:39.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:39.050+0000 7f55694fe700 1 -- 172.21.15.26:0/898596048 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55640f8570 msgr2=0x7f556410bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:03:39.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:39.050+0000 7f55694fe700 1 --2- 172.21.15.26:0/898596048 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55640f8570 0x7f556410bfb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f55580026d0 tx=0x7f5558009de0).stop 2021-11-03T17:03:39.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:39.050+0000 7f55694fe700 1 -- 172.21.15.26:0/898596048 shutdown_connections 2021-11-03T17:03:39.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:39.050+0000 7f55694fe700 1 --2- 172.21.15.26:0/898596048 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f554c064100 0x7f554c0665c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:03:39.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:39.050+0000 7f55694fe700 1 --2- 172.21.15.26:0/898596048 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55640f5c00 0x7f5564109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:03:39.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:39.050+0000 7f55694fe700 1 --2- 172.21.15.26:0/898596048 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55640f8570 0x7f556410bfb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:03:39.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:39.050+0000 7f55694fe700 1 -- 172.21.15.26:0/898596048 >> 172.21.15.26:0/898596048 conn(0x7f55640efec0 msgr2=0x7f55640f2300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:03:39.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:39.050+0000 7f55694fe700 1 -- 172.21.15.26:0/898596048 shutdown_connections 2021-11-03T17:03:39.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:03:39.050+0000 7f55694fe700 1 -- 172.21.15.26:0/898596048 wait complete. 2021-11-03T17:03:39.056 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:03:39.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:38 smithi026 ceph-mon[96795]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:03:39.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:38 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2413786405' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:03:39.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:38 smithi194 ceph-mon[65619]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:03:39.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:38 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2413786405' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:03:40.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:39 smithi026 ceph-mon[96795]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:03:40.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:39 smithi026 ceph-mon[96795]: pgmap v270: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:40.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:39 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/898596048' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:03:40.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:39 smithi194 ceph-mon[65619]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:03:40.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:39 smithi194 ceph-mon[65619]: pgmap v270: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:40.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:39 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/898596048' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:03:42.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:41 smithi026 ceph-mon[96795]: pgmap v271: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:42.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:03:42.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:41 smithi194 ceph-mon[65619]: pgmap v271: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:42.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:03:43.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:42 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:03:43.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:42 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:03:44.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:43 smithi026 ceph-mon[96795]: pgmap v272: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:44.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:43 smithi194 ceph-mon[65619]: pgmap v272: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:46.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:45 smithi026 ceph-mon[96795]: pgmap v273: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:46.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:45 smithi194 ceph-mon[65619]: pgmap v273: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:48.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:47 smithi026 ceph-mon[96795]: pgmap v274: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:48.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:47 smithi194 ceph-mon[65619]: pgmap v274: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:49.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:03:49.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:03:49.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:03:49.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:03:50.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:49 smithi026 ceph-mon[96795]: pgmap v275: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:50.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:49 smithi194 ceph-mon[65619]: pgmap v275: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:52.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:51 smithi026 ceph-mon[96795]: pgmap v276: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:52.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:51 smithi194 ceph-mon[65619]: pgmap v276: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:54.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:53 smithi026 ceph-mon[96795]: pgmap v277: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:54.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:53 smithi194 ceph-mon[65619]: pgmap v277: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:56.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:55 smithi026 ceph-mon[96795]: pgmap v278: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:56.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:55 smithi194 ceph-mon[65619]: pgmap v278: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:57.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:56 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:03:57.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:56 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:03:58.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:57 smithi026 ceph-mon[96795]: pgmap v279: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:58.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:57 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:03:58.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:57 smithi194 ceph-mon[65619]: pgmap v279: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:03:58.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:57 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:04:00.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:03:59 smithi026 ceph-mon[96795]: pgmap v280: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:00.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:03:59 smithi194 ceph-mon[65619]: pgmap v280: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:02.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:01 smithi026 ceph-mon[96795]: pgmap v281: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:02.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:01 smithi194 ceph-mon[65619]: pgmap v281: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:04.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:03 smithi026 ceph-mon[96795]: pgmap v282: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:04.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:03 smithi194 ceph-mon[65619]: pgmap v282: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:06.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:05 smithi026 ceph-mon[96795]: pgmap v283: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:06.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:05 smithi194 ceph-mon[65619]: pgmap v283: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:08.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:07 smithi026 ceph-mon[96795]: pgmap v284: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:08.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:07 smithi194 ceph-mon[65619]: pgmap v284: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:09.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.165+0000 7efbf1b37700 1 -- 172.21.15.26:0/1113645199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efbec0f5440 msgr2=0x7efbec0f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:04:09.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.165+0000 7efbf1b37700 1 --2- 172.21.15.26:0/1113645199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efbec0f5440 0x7efbec0f5860 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7efbe0004660 tx=0x7efbe0009b30).stop 2021-11-03T17:04:09.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.165+0000 7efbf1b37700 1 -- 172.21.15.26:0/1113645199 shutdown_connections 2021-11-03T17:04:09.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.165+0000 7efbf1b37700 1 --2- 172.21.15.26:0/1113645199 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efbec0f66e0 0x7efbec0f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:09.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.165+0000 7efbf1b37700 1 --2- 172.21.15.26:0/1113645199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efbec0f5440 0x7efbec0f5860 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:09.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.165+0000 7efbf1b37700 1 -- 172.21.15.26:0/1113645199 >> 172.21.15.26:0/1113645199 conn(0x7efbec0f0ba0 msgr2=0x7efbec0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:04:09.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.165+0000 7efbf1b37700 1 -- 172.21.15.26:0/1113645199 shutdown_connections 2021-11-03T17:04:09.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.165+0000 7efbf1b37700 1 -- 172.21.15.26:0/1113645199 wait complete. 2021-11-03T17:04:09.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.166+0000 7efbf1b37700 1 Processor -- start 2021-11-03T17:04:09.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.166+0000 7efbf1b37700 1 -- start start 2021-11-03T17:04:09.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.166+0000 7efbf1b37700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efbec0f5440 0x7efbec105d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:04:09.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.166+0000 7efbf1b37700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efbec0f66e0 0x7efbec106230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:04:09.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.166+0000 7efbf1b37700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbec1067e0 con 0x7efbec0f66e0 2021-11-03T17:04:09.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.166+0000 7efbf1b37700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbec106fe0 con 0x7efbec0f5440 2021-11-03T17:04:09.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.166+0000 7efbebfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efbec0f66e0 0x7efbec106230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:04:09.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.166+0000 7efbebfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efbec0f66e0 0x7efbec106230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52276/0 (socket says 172.21.15.26:52276) 2021-11-03T17:04:09.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.166+0000 7efbebfff700 1 -- 172.21.15.26:0/716508577 learned_addr learned my addr 172.21.15.26:0/716508577 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:04:09.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.166+0000 7efbf0b35700 1 --2- 172.21.15.26:0/716508577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efbec0f5440 0x7efbec105d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:04:09.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.167+0000 7efbebfff700 1 -- 172.21.15.26:0/716508577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efbec0f5440 msgr2=0x7efbec105d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:04:09.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.167+0000 7efbebfff700 1 --2- 172.21.15.26:0/716508577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efbec0f5440 0x7efbec105d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:09.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.167+0000 7efbebfff700 1 -- 172.21.15.26:0/716508577 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbe0005040 con 0x7efbec0f66e0 2021-11-03T17:04:09.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.167+0000 7efbf0b35700 1 --2- 172.21.15.26:0/716508577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efbec0f5440 0x7efbec105d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:04:09.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.167+0000 7efbebfff700 1 --2- 172.21.15.26:0/716508577 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efbec0f66e0 0x7efbec106230 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7efbd800e9a0 tx=0x7efbd8007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:04:09.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.167+0000 7efbe97fa700 1 -- 172.21.15.26:0/716508577 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efbd800cb90 con 0x7efbec0f66e0 2021-11-03T17:04:09.175 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.167+0000 7efbe97fa700 1 -- 172.21.15.26:0/716508577 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efbd800ccf0 con 0x7efbec0f66e0 2021-11-03T17:04:09.175 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.167+0000 7efbf1b37700 1 -- 172.21.15.26:0/716508577 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbec107260 con 0x7efbec0f66e0 2021-11-03T17:04:09.175 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.167+0000 7efbe97fa700 1 -- 172.21.15.26:0/716508577 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efbd80106c0 con 0x7efbec0f66e0 2021-11-03T17:04:09.175 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.167+0000 7efbf1b37700 1 -- 172.21.15.26:0/716508577 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbec1077d0 con 0x7efbec0f66e0 2021-11-03T17:04:09.176 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.168+0000 7efbf1b37700 1 -- 172.21.15.26:0/716508577 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbec059100 con 0x7efbec0f66e0 2021-11-03T17:04:09.176 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.168+0000 7efbe97fa700 1 -- 172.21.15.26:0/716508577 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7efbd8011470 con 0x7efbec0f66e0 2021-11-03T17:04:09.176 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.169+0000 7efbe97fa700 1 --2- 172.21.15.26:0/716508577 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efbdc064100 0x7efbdc0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:04:09.176 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.169+0000 7efbe97fa700 1 -- 172.21.15.26:0/716508577 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7efbd8083a20 con 0x7efbec0f66e0 2021-11-03T17:04:09.177 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.169+0000 7efbf0b35700 1 --2- 172.21.15.26:0/716508577 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efbdc064100 0x7efbdc0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:04:09.177 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.169+0000 7efbf0b35700 1 --2- 172.21.15.26:0/716508577 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efbdc064100 0x7efbdc0665c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7efbe0004e30 tx=0x7efbe0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:04:09.177 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.173+0000 7efbe97fa700 1 -- 172.21.15.26:0/716508577 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7efbd8055c90 con 0x7efbec0f66e0 2021-11-03T17:04:09.347 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.352+0000 7efbf1b37700 1 -- 172.21.15.26:0/716508577 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efbec05f620 con 0x7efbdc064100 2021-11-03T17:04:09.348 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.353+0000 7efbe97fa700 1 -- 172.21.15.26:0/716508577 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7efbec05f620 con 0x7efbdc064100 2021-11-03T17:04:09.350 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.355+0000 7efbf1b37700 1 -- 172.21.15.26:0/716508577 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efbdc064100 msgr2=0x7efbdc0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:04:09.350 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.355+0000 7efbf1b37700 1 --2- 172.21.15.26:0/716508577 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efbdc064100 0x7efbdc0665c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7efbe0004e30 tx=0x7efbe0009b30).stop 2021-11-03T17:04:09.351 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.355+0000 7efbf1b37700 1 -- 172.21.15.26:0/716508577 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efbec0f66e0 msgr2=0x7efbec106230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:04:09.351 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.355+0000 7efbf1b37700 1 --2- 172.21.15.26:0/716508577 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efbec0f66e0 0x7efbec106230 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7efbd800e9a0 tx=0x7efbd8007e00).stop 2021-11-03T17:04:09.351 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.355+0000 7efbf1b37700 1 -- 172.21.15.26:0/716508577 shutdown_connections 2021-11-03T17:04:09.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.355+0000 7efbf1b37700 1 --2- 172.21.15.26:0/716508577 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efbdc064100 0x7efbdc0665c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:09.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.355+0000 7efbf1b37700 1 --2- 172.21.15.26:0/716508577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efbec0f5440 0x7efbec105d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:09.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.355+0000 7efbf1b37700 1 --2- 172.21.15.26:0/716508577 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efbec0f66e0 0x7efbec106230 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:09.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.355+0000 7efbf1b37700 1 -- 172.21.15.26:0/716508577 >> 172.21.15.26:0/716508577 conn(0x7efbec0f0ba0 msgr2=0x7efbec0fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:04:09.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.355+0000 7efbf1b37700 1 -- 172.21.15.26:0/716508577 shutdown_connections 2021-11-03T17:04:09.353 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.355+0000 7efbf1b37700 1 -- 172.21.15.26:0/716508577 wait complete. 2021-11-03T17:04:09.360 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:04:09.453 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.456+0000 7ff32a1ea700 1 -- 172.21.15.26:0/2093868755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff324060310 msgr2=0x7ff3240f92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:04:09.453 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.456+0000 7ff32a1ea700 1 --2- 172.21.15.26:0/2093868755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff324060310 0x7ff3240f92a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7ff314004660 tx=0x7ff314009b30).stop 2021-11-03T17:04:09.453 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.456+0000 7ff32a1ea700 1 -- 172.21.15.26:0/2093868755 shutdown_connections 2021-11-03T17:04:09.454 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.456+0000 7ff32a1ea700 1 --2- 172.21.15.26:0/2093868755 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3240f9820 0x7ff3240fbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:09.454 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.456+0000 7ff32a1ea700 1 --2- 172.21.15.26:0/2093868755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff324060310 0x7ff3240f92a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:09.454 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.456+0000 7ff32a1ea700 1 -- 172.21.15.26:0/2093868755 >> 172.21.15.26:0/2093868755 conn(0x7ff3240f0d40 msgr2=0x7ff3240f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:04:09.454 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.456+0000 7ff32a1ea700 1 -- 172.21.15.26:0/2093868755 shutdown_connections 2021-11-03T17:04:09.454 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.456+0000 7ff32a1ea700 1 -- 172.21.15.26:0/2093868755 wait complete. 2021-11-03T17:04:09.455 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.457+0000 7ff32a1ea700 1 Processor -- start 2021-11-03T17:04:09.455 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.457+0000 7ff32a1ea700 1 -- start start 2021-11-03T17:04:09.455 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.457+0000 7ff32a1ea700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff324060310 0x7ff324106f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:04:09.455 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.457+0000 7ff32a1ea700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3240f9820 0x7ff324107440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:04:09.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.457+0000 7ff32a1ea700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3241079f0 con 0x7ff324060310 2021-11-03T17:04:09.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.457+0000 7ff32a1ea700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff324107b30 con 0x7ff3240f9820 2021-11-03T17:04:09.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.457+0000 7ff3237fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff324060310 0x7ff324106f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:04:09.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.457+0000 7ff3237fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff324060310 0x7ff324106f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52286/0 (socket says 172.21.15.26:52286) 2021-11-03T17:04:09.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.457+0000 7ff3237fe700 1 -- 172.21.15.26:0/1502883938 learned_addr learned my addr 172.21.15.26:0/1502883938 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:04:09.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.457+0000 7ff322ffd700 1 --2- 172.21.15.26:0/1502883938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3240f9820 0x7ff324107440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:04:09.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.457+0000 7ff3237fe700 1 -- 172.21.15.26:0/1502883938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3240f9820 msgr2=0x7ff324107440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:04:09.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.457+0000 7ff3237fe700 1 --2- 172.21.15.26:0/1502883938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3240f9820 0x7ff324107440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:09.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.457+0000 7ff3237fe700 1 -- 172.21.15.26:0/1502883938 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff314005040 con 0x7ff324060310 2021-11-03T17:04:09.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.458+0000 7ff3237fe700 1 --2- 172.21.15.26:0/1502883938 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff324060310 0x7ff324106f50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7ff314009990 tx=0x7ff314009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:04:09.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.458+0000 7ff30bfff700 1 -- 172.21.15.26:0/1502883938 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff314018070 con 0x7ff324060310 2021-11-03T17:04:09.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.458+0000 7ff32a1ea700 1 -- 172.21.15.26:0/1502883938 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff324108470 con 0x7ff324060310 2021-11-03T17:04:09.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.458+0000 7ff32a1ea700 1 -- 172.21.15.26:0/1502883938 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3241089d0 con 0x7ff324060310 2021-11-03T17:04:09.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.458+0000 7ff30bfff700 1 -- 172.21.15.26:0/1502883938 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff314007ba0 con 0x7ff324060310 2021-11-03T17:04:09.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.458+0000 7ff30bfff700 1 -- 172.21.15.26:0/1502883938 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff31401dea0 con 0x7ff324060310 2021-11-03T17:04:09.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.459+0000 7ff32a1ea700 1 -- 172.21.15.26:0/1502883938 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff304004fa0 con 0x7ff324060310 2021-11-03T17:04:09.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.460+0000 7ff30bfff700 1 -- 172.21.15.26:0/1502883938 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ff31401d420 con 0x7ff324060310 2021-11-03T17:04:09.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.460+0000 7ff30bfff700 1 --2- 172.21.15.26:0/1502883938 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff30c0640b0 0x7ff30c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:04:09.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.460+0000 7ff30bfff700 1 -- 172.21.15.26:0/1502883938 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ff3140827a0 con 0x7ff324060310 2021-11-03T17:04:09.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.462+0000 7ff322ffd700 1 --2- 172.21.15.26:0/1502883938 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff30c0640b0 0x7ff30c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:04:09.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.462+0000 7ff322ffd700 1 --2- 172.21.15.26:0/1502883938 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff30c0640b0 0x7ff30c066570 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7ff3240600e0 tx=0x7ff318009be0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:04:09.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.465+0000 7ff30bfff700 1 -- 172.21.15.26:0/1502883938 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ff314054b00 con 0x7ff324060310 2021-11-03T17:04:09.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.637+0000 7ff32a1ea700 1 -- 172.21.15.26:0/1502883938 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff304000bc0 con 0x7ff30c0640b0 2021-11-03T17:04:09.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.652+0000 7ff30bfff700 1 -- 172.21.15.26:0/1502883938 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7ff304000bc0 con 0x7ff30c0640b0 2021-11-03T17:04:09.648 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:04:09.648 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (15m) 6m ago 16m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:04:09.649 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (7m) 6m ago 16m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:04:09.649 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (7m) 4m ago 15m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:04:09.649 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (15m) 6m ago 16m 38.9M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:04:09.650 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (8m) 6m ago 11m 13.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:04:09.650 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (8m) 6m ago 11m 14.7M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:04:09.650 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (11m) 4m ago 11m 16.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:04:09.651 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (11m) 4m ago 11m 16.5M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:04:09.651 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (9m) 6m ago 17m 468M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:04:09.651 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (8m) 4m ago 15m 412M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:04:09.652 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (8m) 6m ago 18m 75.8M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:04:09.652 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (8m) 4m ago 15m 66.4M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:04:09.652 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (16m) 6m ago 16m 18.1M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:04:09.653 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (15m) 4m ago 15m 18.3M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:04:09.653 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (7m) 6m ago 15m 153M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:04:09.653 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (6m) 6m ago 14m 166M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:04:09.654 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (6m) 6m ago 14m 11.2M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:04:09.654 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (5m) 4m ago 13m 181M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:04:09.655 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (5m) 4m ago 13m 185M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:04:09.655 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (4m) 4m ago 13m 13.5M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:04:09.656 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (15m) 6m ago 16m 47.5M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:04:09.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.653+0000 7ff32a1ea700 1 -- 172.21.15.26:0/1502883938 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff30c0640b0 msgr2=0x7ff30c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:04:09.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.653+0000 7ff32a1ea700 1 --2- 172.21.15.26:0/1502883938 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff30c0640b0 0x7ff30c066570 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7ff3240600e0 tx=0x7ff318009be0).stop 2021-11-03T17:04:09.658 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.653+0000 7ff32a1ea700 1 -- 172.21.15.26:0/1502883938 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff324060310 msgr2=0x7ff324106f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:04:09.658 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.653+0000 7ff32a1ea700 1 --2- 172.21.15.26:0/1502883938 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff324060310 0x7ff324106f50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7ff314009990 tx=0x7ff314009b30).stop 2021-11-03T17:04:09.658 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.653+0000 7ff32a1ea700 1 -- 172.21.15.26:0/1502883938 shutdown_connections 2021-11-03T17:04:09.658 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.654+0000 7ff32a1ea700 1 --2- 172.21.15.26:0/1502883938 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff30c0640b0 0x7ff30c066570 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:09.659 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.654+0000 7ff32a1ea700 1 --2- 172.21.15.26:0/1502883938 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff324060310 0x7ff324106f50 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:09.659 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.654+0000 7ff32a1ea700 1 --2- 172.21.15.26:0/1502883938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3240f9820 0x7ff324107440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:09.659 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.654+0000 7ff32a1ea700 1 -- 172.21.15.26:0/1502883938 >> 172.21.15.26:0/1502883938 conn(0x7ff3240f0d40 msgr2=0x7ff3240f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:04:09.659 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.654+0000 7ff32a1ea700 1 -- 172.21.15.26:0/1502883938 shutdown_connections 2021-11-03T17:04:09.660 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.654+0000 7ff32a1ea700 1 -- 172.21.15.26:0/1502883938 wait complete. 2021-11-03T17:04:09.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.753+0000 7f90b9876700 1 -- 172.21.15.26:0/3031759669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90b40f66e0 msgr2=0x7f90b40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:04:09.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.753+0000 7f90b9876700 1 --2- 172.21.15.26:0/3031759669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90b40f66e0 0x7f90b40f6b00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f90ac004660 tx=0x7f90ac009b30).stop 2021-11-03T17:04:09.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.753+0000 7f90b9876700 1 -- 172.21.15.26:0/3031759669 shutdown_connections 2021-11-03T17:04:09.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.753+0000 7f90b9876700 1 --2- 172.21.15.26:0/3031759669 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90b40f6ff0 0x7f90b40f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:09.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.753+0000 7f90b9876700 1 --2- 172.21.15.26:0/3031759669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90b40f66e0 0x7f90b40f6b00 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:09.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.753+0000 7f90b9876700 1 -- 172.21.15.26:0/3031759669 >> 172.21.15.26:0/3031759669 conn(0x7f90b40f1f00 msgr2=0x7f90b40f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:04:09.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.753+0000 7f90b9876700 1 -- 172.21.15.26:0/3031759669 shutdown_connections 2021-11-03T17:04:09.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.753+0000 7f90b9876700 1 -- 172.21.15.26:0/3031759669 wait complete. 2021-11-03T17:04:09.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.754+0000 7f90b9876700 1 Processor -- start 2021-11-03T17:04:09.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.754+0000 7f90b9876700 1 -- start start 2021-11-03T17:04:09.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.754+0000 7f90b9876700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90b40f66e0 0x7f90b406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:04:09.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.754+0000 7f90b9876700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90b40f6ff0 0x7f90b4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:04:09.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.754+0000 7f90b9876700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b406a380 con 0x7f90b40f66e0 2021-11-03T17:04:09.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.754+0000 7f90b9876700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b406a4c0 con 0x7f90b40f6ff0 2021-11-03T17:04:09.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.754+0000 7f90b2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90b40f66e0 0x7f90b406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:04:09.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.754+0000 7f90b2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90b40f66e0 0x7f90b406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52296/0 (socket says 172.21.15.26:52296) 2021-11-03T17:04:09.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.754+0000 7f90b2ffd700 1 -- 172.21.15.26:0/3095921 learned_addr learned my addr 172.21.15.26:0/3095921 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:04:09.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.754+0000 7f90b27fc700 1 --2- 172.21.15.26:0/3095921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90b40f6ff0 0x7f90b4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:04:09.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.755+0000 7f90b2ffd700 1 -- 172.21.15.26:0/3095921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90b40f6ff0 msgr2=0x7f90b4069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:04:09.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.755+0000 7f90b2ffd700 1 --2- 172.21.15.26:0/3095921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90b40f6ff0 0x7f90b4069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:09.757 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.755+0000 7f90b2ffd700 1 -- 172.21.15.26:0/3095921 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ac005040 con 0x7f90b40f66e0 2021-11-03T17:04:09.757 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.755+0000 7f90b2ffd700 1 --2- 172.21.15.26:0/3095921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90b40f66e0 0x7f90b406b9a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f90ac009990 tx=0x7f90ac009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:04:09.757 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.755+0000 7f90ab7fe700 1 -- 172.21.15.26:0/3095921 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90ac018070 con 0x7f90b40f66e0 2021-11-03T17:04:09.757 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.755+0000 7f90ab7fe700 1 -- 172.21.15.26:0/3095921 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f90ac007ca0 con 0x7f90b40f66e0 2021-11-03T17:04:09.758 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.755+0000 7f90b9876700 1 -- 172.21.15.26:0/3095921 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90b406a740 con 0x7f90b40f66e0 2021-11-03T17:04:09.758 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.755+0000 7f90ab7fe700 1 -- 172.21.15.26:0/3095921 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90ac01c620 con 0x7f90b40f66e0 2021-11-03T17:04:09.758 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.755+0000 7f90b9876700 1 -- 172.21.15.26:0/3095921 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90b406aca0 con 0x7f90b40f66e0 2021-11-03T17:04:09.758 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.756+0000 7f90b9876700 1 -- 172.21.15.26:0/3095921 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90b4045ad0 con 0x7f90b40f66e0 2021-11-03T17:04:09.759 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.756+0000 7f90ab7fe700 1 -- 172.21.15.26:0/3095921 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f90ac01d960 con 0x7f90b40f66e0 2021-11-03T17:04:09.759 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.757+0000 7f90ab7fe700 1 --2- 172.21.15.26:0/3095921 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f90a00640b0 0x7f90a0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:04:09.759 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.757+0000 7f90ab7fe700 1 -- 172.21.15.26:0/3095921 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f90ac082540 con 0x7f90b40f66e0 2021-11-03T17:04:09.759 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.757+0000 7f90b27fc700 1 --2- 172.21.15.26:0/3095921 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f90a00640b0 0x7f90a0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:04:09.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.757+0000 7f90b27fc700 1 --2- 172.21.15.26:0/3095921 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f90a00640b0 0x7f90a0066570 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f909c004a70 tx=0x7f909c009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:04:09.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.761+0000 7f90ab7fe700 1 -- 172.21.15.26:0/3095921 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f90ac054960 con 0x7f90b40f66e0 2021-11-03T17:04:09.988 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.993+0000 7f90b9876700 1 -- 172.21.15.26:0/3095921 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f90b40fefe0 con 0x7f90b40f66e0 2021-11-03T17:04:09.989 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.994+0000 7f90ab7fe700 1 -- 172.21.15.26:0/3095921 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f90ac054550 con 0x7f90b40f66e0 2021-11-03T17:04:09.989 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:04:09.989 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:04:09.990 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:04:09.990 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:04:09.990 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:04:09.990 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:04:09.991 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:04:09.991 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:04:09.991 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:04:09.991 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:04:09.992 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:04:09.992 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:04:09.992 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:04:09.993 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:04:09.994 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:04:09.994 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:04:09.994 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:04:09.995 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:04:09.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.995+0000 7f90b9876700 1 -- 172.21.15.26:0/3095921 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f90a00640b0 msgr2=0x7f90a0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:04:09.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.995+0000 7f90b9876700 1 --2- 172.21.15.26:0/3095921 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f90a00640b0 0x7f90a0066570 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f909c004a70 tx=0x7f909c009040).stop 2021-11-03T17:04:09.997 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.995+0000 7f90b9876700 1 -- 172.21.15.26:0/3095921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90b40f66e0 msgr2=0x7f90b406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:04:09.998 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.995+0000 7f90b9876700 1 --2- 172.21.15.26:0/3095921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90b40f66e0 0x7f90b406b9a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f90ac009990 tx=0x7f90ac009b30).stop 2021-11-03T17:04:09.998 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.995+0000 7f90b9876700 1 -- 172.21.15.26:0/3095921 shutdown_connections 2021-11-03T17:04:09.999 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.995+0000 7f90b9876700 1 --2- 172.21.15.26:0/3095921 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f90a00640b0 0x7f90a0066570 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:09.999 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.995+0000 7f90b9876700 1 --2- 172.21.15.26:0/3095921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90b40f66e0 0x7f90b406b9a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:09.999 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.995+0000 7f90b9876700 1 --2- 172.21.15.26:0/3095921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90b40f6ff0 0x7f90b4069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:09.999 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.995+0000 7f90b9876700 1 -- 172.21.15.26:0/3095921 >> 172.21.15.26:0/3095921 conn(0x7f90b40f1f00 msgr2=0x7f90b40fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:04:10.000 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.996+0000 7f90b9876700 1 -- 172.21.15.26:0/3095921 shutdown_connections 2021-11-03T17:04:10.000 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:09.996+0000 7f90b9876700 1 -- 172.21.15.26:0/3095921 wait complete. 2021-11-03T17:04:10.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.096+0000 7fe425e88700 1 -- 172.21.15.26:0/3961119584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4200f55c0 msgr2=0x7fe4200f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:04:10.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.096+0000 7fe425e88700 1 --2- 172.21.15.26:0/3961119584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4200f55c0 0x7fe4200f59e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fe410004660 tx=0x7fe410009b30).stop 2021-11-03T17:04:10.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.096+0000 7fe425e88700 1 -- 172.21.15.26:0/3961119584 shutdown_connections 2021-11-03T17:04:10.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.096+0000 7fe425e88700 1 --2- 172.21.15.26:0/3961119584 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4200f6860 0x7fe4200f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:10.094 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.096+0000 7fe425e88700 1 --2- 172.21.15.26:0/3961119584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4200f55c0 0x7fe4200f59e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:10.094 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.096+0000 7fe425e88700 1 -- 172.21.15.26:0/3961119584 >> 172.21.15.26:0/3961119584 conn(0x7fe4200f0d40 msgr2=0x7fe4200f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:04:10.094 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.096+0000 7fe425e88700 1 -- 172.21.15.26:0/3961119584 shutdown_connections 2021-11-03T17:04:10.094 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.096+0000 7fe425e88700 1 -- 172.21.15.26:0/3961119584 wait complete. 2021-11-03T17:04:10.095 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.096+0000 7fe425e88700 1 Processor -- start 2021-11-03T17:04:10.095 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.097+0000 7fe425e88700 1 -- start start 2021-11-03T17:04:10.095 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.097+0000 7fe425e88700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4200f55c0 0x7fe420105e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:04:10.095 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.097+0000 7fe425e88700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4200f6860 0x7fe420106350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:04:10.096 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.097+0000 7fe425e88700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe420106950 con 0x7fe4200f6860 2021-11-03T17:04:10.096 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.097+0000 7fe425e88700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe420107160 con 0x7fe4200f55c0 2021-11-03T17:04:10.096 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.097+0000 7fe41effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4200f6860 0x7fe420106350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:04:10.096 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.097+0000 7fe41effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4200f6860 0x7fe420106350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52308/0 (socket says 172.21.15.26:52308) 2021-11-03T17:04:10.096 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.097+0000 7fe41effd700 1 -- 172.21.15.26:0/3074532649 learned_addr learned my addr 172.21.15.26:0/3074532649 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:04:10.097 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.097+0000 7fe41f7fe700 1 --2- 172.21.15.26:0/3074532649 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4200f55c0 0x7fe420105e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:04:10.097 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.097+0000 7fe41effd700 1 -- 172.21.15.26:0/3074532649 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4200f55c0 msgr2=0x7fe420105e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:04:10.097 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.097+0000 7fe41effd700 1 --2- 172.21.15.26:0/3074532649 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4200f55c0 0x7fe420105e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:10.098 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.097+0000 7fe41effd700 1 -- 172.21.15.26:0/3074532649 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe410005040 con 0x7fe4200f6860 2021-11-03T17:04:10.098 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.097+0000 7fe41effd700 1 --2- 172.21.15.26:0/3074532649 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4200f6860 0x7fe420106350 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fe41400e7f0 tx=0x7fe41400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:04:10.098 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.097+0000 7fe407fff700 1 -- 172.21.15.26:0/3074532649 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4140092e0 con 0x7fe4200f6860 2021-11-03T17:04:10.098 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.098+0000 7fe425e88700 1 -- 172.21.15.26:0/3074532649 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe420107360 con 0x7fe4200f6860 2021-11-03T17:04:10.099 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.098+0000 7fe407fff700 1 -- 172.21.15.26:0/3074532649 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe41400f040 con 0x7fe4200f6860 2021-11-03T17:04:10.099 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.098+0000 7fe407fff700 1 -- 172.21.15.26:0/3074532649 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe414014750 con 0x7fe4200f6860 2021-11-03T17:04:10.099 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.098+0000 7fe425e88700 1 -- 172.21.15.26:0/3074532649 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe420107920 con 0x7fe4200f6860 2021-11-03T17:04:10.100 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.099+0000 7fe425e88700 1 -- 172.21.15.26:0/3074532649 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe420045ad0 con 0x7fe4200f6860 2021-11-03T17:04:10.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.099+0000 7fe407fff700 1 -- 172.21.15.26:0/3074532649 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fe41401b030 con 0x7fe4200f6860 2021-11-03T17:04:10.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.099+0000 7fe407fff700 1 --2- 172.21.15.26:0/3074532649 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe4080640a0 0x7fe408066560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:04:10.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.100+0000 7fe407fff700 1 -- 172.21.15.26:0/3074532649 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fe4140806d0 con 0x7fe4200f6860 2021-11-03T17:04:10.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.100+0000 7fe41f7fe700 1 --2- 172.21.15.26:0/3074532649 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe4080640a0 0x7fe408066560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:04:10.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.100+0000 7fe41f7fe700 1 --2- 172.21.15.26:0/3074532649 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe4080640a0 0x7fe408066560 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fe410000c00 tx=0x7fe410016040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:04:10.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.104+0000 7fe407fff700 1 -- 172.21.15.26:0/3074532649 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fe4140529f0 con 0x7fe4200f6860 2021-11-03T17:04:10.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:09 smithi026 ceph-mon[96795]: pgmap v285: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:10.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:09 smithi194 ceph-mon[65619]: pgmap v285: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:10.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.314+0000 7fe425e88700 1 -- 172.21.15.26:0/3074532649 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe4200ff790 con 0x7fe4200f6860 2021-11-03T17:04:10.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.314+0000 7fe407fff700 1 -- 172.21.15.26:0/3074532649 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fe414019710 con 0x7fe4200f6860 2021-11-03T17:04:10.309 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:04:10.310 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:04:10.310 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:04:10.310 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:04:10.310 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:04:10.311 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:04:10.311 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:04:10.311 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:04:10.311 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:04:10.312 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:04:10.312 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:04:10.312 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:04:10.312 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:04:10.313 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:04:10.313 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:04:10.313 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:04:10.313 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:04:10.313 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:04:10.314 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:04:10.314 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:04:10.314 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:04:10.314 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:04:10.315 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:04:10.315 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:04:10.315 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:04:10.315 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:04:10.316 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:04:10.316 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:04:10.316 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:04:10.316 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:04:10.317 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:04:10.317 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:04:10.317 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:04:10.317 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:04:10.317 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:04:10.318 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:04:10.318 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:04:10.318 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:04:10.318 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:04:10.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.316+0000 7fe425e88700 1 -- 172.21.15.26:0/3074532649 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe4080640a0 msgr2=0x7fe408066560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:04:10.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.316+0000 7fe425e88700 1 --2- 172.21.15.26:0/3074532649 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe4080640a0 0x7fe408066560 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fe410000c00 tx=0x7fe410016040).stop 2021-11-03T17:04:10.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.316+0000 7fe425e88700 1 -- 172.21.15.26:0/3074532649 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4200f6860 msgr2=0x7fe420106350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:04:10.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.316+0000 7fe425e88700 1 --2- 172.21.15.26:0/3074532649 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4200f6860 0x7fe420106350 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fe41400e7f0 tx=0x7fe41400b040).stop 2021-11-03T17:04:10.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.316+0000 7fe425e88700 1 -- 172.21.15.26:0/3074532649 shutdown_connections 2021-11-03T17:04:10.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.316+0000 7fe425e88700 1 --2- 172.21.15.26:0/3074532649 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe4080640a0 0x7fe408066560 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:10.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.316+0000 7fe425e88700 1 --2- 172.21.15.26:0/3074532649 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4200f55c0 0x7fe420105e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:10.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.316+0000 7fe425e88700 1 --2- 172.21.15.26:0/3074532649 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4200f6860 0x7fe420106350 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:10.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.316+0000 7fe425e88700 1 -- 172.21.15.26:0/3074532649 >> 172.21.15.26:0/3074532649 conn(0x7fe4200f0d40 msgr2=0x7fe4200fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:04:10.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.316+0000 7fe425e88700 1 -- 172.21.15.26:0/3074532649 shutdown_connections 2021-11-03T17:04:10.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:10.316+0000 7fe425e88700 1 -- 172.21.15.26:0/3074532649 wait complete. 2021-11-03T17:04:10.322 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:04:11.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:10 smithi026 ceph-mon[96795]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:04:11.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:10 smithi026 ceph-mon[96795]: from='client.34432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:04:11.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:10 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3095921' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:04:11.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:10 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3074532649' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:04:11.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:10 smithi194 ceph-mon[65619]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:04:11.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:10 smithi194 ceph-mon[65619]: from='client.34432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:04:11.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:10 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3095921' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:04:11.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:10 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3074532649' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:04:12.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:11 smithi026 ceph-mon[96795]: pgmap v286: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:12.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:11 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:04:12.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:11 smithi194 ceph-mon[65619]: pgmap v286: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:12.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:11 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:04:13.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:12 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:04:13.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:12 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:04:14.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:13 smithi026 ceph-mon[96795]: pgmap v287: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:14.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:13 smithi194 ceph-mon[65619]: pgmap v287: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:16.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:15 smithi026 ceph-mon[96795]: pgmap v288: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:16.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:15 smithi194 ceph-mon[65619]: pgmap v288: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:18.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:17 smithi026 ceph-mon[96795]: pgmap v289: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:18.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:17 smithi194 ceph-mon[65619]: pgmap v289: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:20.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:19 smithi026 ceph-mon[96795]: pgmap v290: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:20.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:19 smithi194 ceph-mon[65619]: pgmap v290: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:22.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:21 smithi026 ceph-mon[96795]: pgmap v291: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:22.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:21 smithi194 ceph-mon[65619]: pgmap v291: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:24.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:23 smithi026 ceph-mon[96795]: pgmap v292: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:24.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:23 smithi194 ceph-mon[65619]: pgmap v292: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:26.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:25 smithi026 ceph-mon[96795]: pgmap v293: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:26.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:25 smithi194 ceph-mon[65619]: pgmap v293: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:26.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:26 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:04:27.038 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:26 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:04:28.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:28 smithi026 ceph-mon[96795]: pgmap v294: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:28.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:28 smithi026 ceph-mon[96795]: poll took 60059.301 ms: 1 events 2021-11-03T17:04:28.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:04:28.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:04:28.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:04:28.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:04:28.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:04:28.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:04:28.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:28 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:04:28.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:04:28.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:28 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:04:28.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:28 smithi194 ceph-mon[65619]: pgmap v294: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:28.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:28 smithi194 ceph-mon[65619]: poll took 60059.301 ms: 1 events 2021-11-03T17:04:28.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:04:28.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:04:28.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:04:28.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:04:28.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:04:28.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:04:28.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:28 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:04:28.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:04:28.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:28 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:04:30.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:30 smithi026 ceph-mon[96795]: pgmap v295: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:30.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:30 smithi194 ceph-mon[65619]: pgmap v295: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:32.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:32 smithi026 ceph-mon[96795]: pgmap v296: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:32.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:32 smithi194 ceph-mon[65619]: pgmap v296: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:34.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:34 smithi026 ceph-mon[96795]: pgmap v297: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:34.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:34 smithi194 ceph-mon[65619]: pgmap v297: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:36.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:36 smithi026 ceph-mon[96795]: pgmap v298: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:36.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:36 smithi194 ceph-mon[65619]: pgmap v298: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:38.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:38 smithi026 ceph-mon[96795]: pgmap v299: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:38.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:38 smithi194 ceph-mon[65619]: pgmap v299: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:40.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:40 smithi026 ceph-mon[96795]: pgmap v300: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:40.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.430+0000 7f0146d12700 1 -- 172.21.15.26:0/1808233972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01400f49a0 msgr2=0x7f01400f4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:04:40.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.430+0000 7f0146d12700 1 --2- 172.21.15.26:0/1808233972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01400f49a0 0x7f01400f4dc0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f0134004660 tx=0x7f0134009b30).stop 2021-11-03T17:04:40.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.430+0000 7f0146d12700 1 -- 172.21.15.26:0/1808233972 shutdown_connections 2021-11-03T17:04:40.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.430+0000 7f0146d12700 1 --2- 172.21.15.26:0/1808233972 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01400f5340 0x7f01400f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:40.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.430+0000 7f0146d12700 1 --2- 172.21.15.26:0/1808233972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01400f49a0 0x7f01400f4dc0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:40.428 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.430+0000 7f0146d12700 1 -- 172.21.15.26:0/1808233972 >> 172.21.15.26:0/1808233972 conn(0x7f01400f04c0 msgr2=0x7f01400f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:04:40.428 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.430+0000 7f0146d12700 1 -- 172.21.15.26:0/1808233972 shutdown_connections 2021-11-03T17:04:40.428 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.430+0000 7f0146d12700 1 -- 172.21.15.26:0/1808233972 wait complete. 2021-11-03T17:04:40.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.431+0000 7f0146d12700 1 Processor -- start 2021-11-03T17:04:40.432 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.431+0000 7f0146d12700 1 -- start start 2021-11-03T17:04:40.432 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.431+0000 7f0146d12700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01400f49a0 0x7f01400f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:04:40.432 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.431+0000 7f0146d12700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01400f5340 0x7f01400f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:04:40.433 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.431+0000 7f0146d12700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014010ace0 con 0x7f01400f5340 2021-11-03T17:04:40.433 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.431+0000 7f0146d12700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014010ae20 con 0x7f01400f49a0 2021-11-03T17:04:40.433 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.431+0000 7f013ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01400f5340 0x7f01400f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:04:40.434 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.431+0000 7f013ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01400f5340 0x7f01400f59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52326/0 (socket says 172.21.15.26:52326) 2021-11-03T17:04:40.434 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.431+0000 7f013ffff700 1 -- 172.21.15.26:0/3710481179 learned_addr learned my addr 172.21.15.26:0/3710481179 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:04:40.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.432+0000 7f0144aae700 1 --2- 172.21.15.26:0/3710481179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01400f49a0 0x7f01400f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:04:40.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.432+0000 7f013ffff700 1 -- 172.21.15.26:0/3710481179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01400f49a0 msgr2=0x7f01400f7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:04:40.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.432+0000 7f013ffff700 1 --2- 172.21.15.26:0/3710481179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01400f49a0 0x7f01400f7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:40.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.432+0000 7f013ffff700 1 -- 172.21.15.26:0/3710481179 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0134005040 con 0x7f01400f5340 2021-11-03T17:04:40.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.432+0000 7f013ffff700 1 --2- 172.21.15.26:0/3710481179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01400f5340 0x7f01400f59d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f012c00c510 tx=0x7f012c007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:04:40.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.432+0000 7f013d7fa700 1 -- 172.21.15.26:0/3710481179 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f012c00f650 con 0x7f01400f5340 2021-11-03T17:04:40.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.432+0000 7f0146d12700 1 -- 172.21.15.26:0/3710481179 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01400f5f80 con 0x7f01400f5340 2021-11-03T17:04:40.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.432+0000 7f013d7fa700 1 -- 172.21.15.26:0/3710481179 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f012c00fc60 con 0x7f01400f5340 2021-11-03T17:04:40.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.432+0000 7f013d7fa700 1 -- 172.21.15.26:0/3710481179 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f012c012c20 con 0x7f01400f5340 2021-11-03T17:04:40.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.432+0000 7f0146d12700 1 -- 172.21.15.26:0/3710481179 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01400f6540 con 0x7f01400f5340 2021-11-03T17:04:40.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.433+0000 7f0146d12700 1 -- 172.21.15.26:0/3710481179 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0140045ad0 con 0x7f01400f5340 2021-11-03T17:04:40.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.434+0000 7f013d7fa700 1 -- 172.21.15.26:0/3710481179 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f012c010070 con 0x7f01400f5340 2021-11-03T17:04:40.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.434+0000 7f013d7fa700 1 --2- 172.21.15.26:0/3710481179 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f01300640b0 0x7f0130066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:04:40.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.434+0000 7f013d7fa700 1 -- 172.21.15.26:0/3710481179 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f012c080510 con 0x7f01400f5340 2021-11-03T17:04:40.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.434+0000 7f0144aae700 1 --2- 172.21.15.26:0/3710481179 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f01300640b0 0x7f0130066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:04:40.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.435+0000 7f0144aae700 1 --2- 172.21.15.26:0/3710481179 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f01300640b0 0x7f0130066570 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f0134004630 tx=0x7f0134009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:04:40.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.440+0000 7f013d7fa700 1 -- 172.21.15.26:0/3710481179 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f012c052780 con 0x7f01400f5340 2021-11-03T17:04:40.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:40 smithi194 ceph-mon[65619]: pgmap v300: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:40.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.616+0000 7f0146d12700 1 -- 172.21.15.26:0/3710481179 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f01400feee0 con 0x7f01300640b0 2021-11-03T17:04:40.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.617+0000 7f013d7fa700 1 -- 172.21.15.26:0/3710481179 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f01400feee0 con 0x7f01300640b0 2021-11-03T17:04:40.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.619+0000 7f0146d12700 1 -- 172.21.15.26:0/3710481179 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f01300640b0 msgr2=0x7f0130066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:04:40.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.619+0000 7f0146d12700 1 --2- 172.21.15.26:0/3710481179 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f01300640b0 0x7f0130066570 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f0134004630 tx=0x7f0134009b30).stop 2021-11-03T17:04:40.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.619+0000 7f0146d12700 1 -- 172.21.15.26:0/3710481179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01400f5340 msgr2=0x7f01400f59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:04:40.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.619+0000 7f0146d12700 1 --2- 172.21.15.26:0/3710481179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01400f5340 0x7f01400f59d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f012c00c510 tx=0x7f012c007df0).stop 2021-11-03T17:04:40.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.619+0000 7f0146d12700 1 -- 172.21.15.26:0/3710481179 shutdown_connections 2021-11-03T17:04:40.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.619+0000 7f0146d12700 1 --2- 172.21.15.26:0/3710481179 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f01300640b0 0x7f0130066570 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:40.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.619+0000 7f0146d12700 1 --2- 172.21.15.26:0/3710481179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01400f49a0 0x7f01400f7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:40.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.619+0000 7f0146d12700 1 --2- 172.21.15.26:0/3710481179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01400f5340 0x7f01400f59d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:40.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.619+0000 7f0146d12700 1 -- 172.21.15.26:0/3710481179 >> 172.21.15.26:0/3710481179 conn(0x7f01400f04c0 msgr2=0x7f01400fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:04:40.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.619+0000 7f0146d12700 1 -- 172.21.15.26:0/3710481179 shutdown_connections 2021-11-03T17:04:40.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.619+0000 7f0146d12700 1 -- 172.21.15.26:0/3710481179 wait complete. 2021-11-03T17:04:40.625 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:04:40.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.719+0000 7f0d657bd700 1 -- 172.21.15.26:0/1740855681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d600f6530 msgr2=0x7f0d600f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:04:40.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.719+0000 7f0d657bd700 1 --2- 172.21.15.26:0/1740855681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d600f6530 0x7f0d600f6950 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f0d50004660 tx=0x7f0d50009b30).stop 2021-11-03T17:04:40.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.719+0000 7f0d657bd700 1 -- 172.21.15.26:0/1740855681 shutdown_connections 2021-11-03T17:04:40.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.719+0000 7f0d657bd700 1 --2- 172.21.15.26:0/1740855681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d600f77d0 0x7f0d600f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:40.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.719+0000 7f0d657bd700 1 --2- 172.21.15.26:0/1740855681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d600f6530 0x7f0d600f6950 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:40.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.719+0000 7f0d657bd700 1 -- 172.21.15.26:0/1740855681 >> 172.21.15.26:0/1740855681 conn(0x7f0d600f1cd0 msgr2=0x7f0d600f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:04:40.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.719+0000 7f0d657bd700 1 -- 172.21.15.26:0/1740855681 shutdown_connections 2021-11-03T17:04:40.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.719+0000 7f0d657bd700 1 -- 172.21.15.26:0/1740855681 wait complete. 2021-11-03T17:04:40.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.720+0000 7f0d657bd700 1 Processor -- start 2021-11-03T17:04:40.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.720+0000 7f0d657bd700 1 -- start start 2021-11-03T17:04:40.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.720+0000 7f0d657bd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d600f6530 0x7f0d60106db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:04:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.720+0000 7f0d657bd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d600f77d0 0x7f0d601072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:04:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.720+0000 7f0d657bd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d601078a0 con 0x7f0d600f77d0 2021-11-03T17:04:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.720+0000 7f0d657bd700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d601080e0 con 0x7f0d600f6530 2021-11-03T17:04:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.720+0000 7f0d5f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d600f77d0 0x7f0d601072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:04:40.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.720+0000 7f0d5f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d600f77d0 0x7f0d601072a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52336/0 (socket says 172.21.15.26:52336) 2021-11-03T17:04:40.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.720+0000 7f0d5f7fe700 1 -- 172.21.15.26:0/3012874789 learned_addr learned my addr 172.21.15.26:0/3012874789 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:04:40.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.720+0000 7f0d5ffff700 1 --2- 172.21.15.26:0/3012874789 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d600f6530 0x7f0d60106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:04:40.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.721+0000 7f0d5f7fe700 1 -- 172.21.15.26:0/3012874789 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d600f6530 msgr2=0x7f0d60106db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:04:40.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.721+0000 7f0d5f7fe700 1 --2- 172.21.15.26:0/3012874789 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d600f6530 0x7f0d60106db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:40.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.721+0000 7f0d5f7fe700 1 -- 172.21.15.26:0/3012874789 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d50005040 con 0x7f0d600f77d0 2021-11-03T17:04:40.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.721+0000 7f0d5f7fe700 1 --2- 172.21.15.26:0/3012874789 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d600f77d0 0x7f0d601072a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f0d5400c530 tx=0x7f0d54007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:04:40.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.721+0000 7f0d5cff9700 1 -- 172.21.15.26:0/3012874789 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d5400f650 con 0x7f0d600f77d0 2021-11-03T17:04:40.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.721+0000 7f0d5cff9700 1 -- 172.21.15.26:0/3012874789 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0d5400fc60 con 0x7f0d600f77d0 2021-11-03T17:04:40.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.721+0000 7f0d5cff9700 1 -- 172.21.15.26:0/3012874789 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d54012c20 con 0x7f0d600f77d0 2021-11-03T17:04:40.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.721+0000 7f0d657bd700 1 -- 172.21.15.26:0/3012874789 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d601083c0 con 0x7f0d600f77d0 2021-11-03T17:04:40.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.721+0000 7f0d657bd700 1 -- 172.21.15.26:0/3012874789 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d60108900 con 0x7f0d600f77d0 2021-11-03T17:04:40.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.722+0000 7f0d657bd700 1 -- 172.21.15.26:0/3012874789 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d60059100 con 0x7f0d600f77d0 2021-11-03T17:04:40.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.723+0000 7f0d5cff9700 1 -- 172.21.15.26:0/3012874789 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f0d54010070 con 0x7f0d600f77d0 2021-11-03T17:04:40.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.723+0000 7f0d5cff9700 1 --2- 172.21.15.26:0/3012874789 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0d48064100 0x7f0d480665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:04:40.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.723+0000 7f0d5cff9700 1 -- 172.21.15.26:0/3012874789 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f0d54080550 con 0x7f0d600f77d0 2021-11-03T17:04:40.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.723+0000 7f0d5ffff700 1 --2- 172.21.15.26:0/3012874789 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0d48064100 0x7f0d480665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:04:40.726 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.724+0000 7f0d5ffff700 1 --2- 172.21.15.26:0/3012874789 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0d48064100 0x7f0d480665c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f0d50013690 tx=0x7f0d50009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:04:40.726 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.728+0000 7f0d5cff9700 1 -- 172.21.15.26:0/3012874789 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f0d540527c0 con 0x7f0d600f77d0 2021-11-03T17:04:40.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.901+0000 7f0d657bd700 1 -- 172.21.15.26:0/3012874789 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d600fee80 con 0x7f0d48064100 2021-11-03T17:04:40.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.915+0000 7f0d5cff9700 1 -- 172.21.15.26:0/3012874789 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f0d600fee80 con 0x7f0d48064100 2021-11-03T17:04:40.912 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:04:40.912 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (15m) 6m ago 17m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:04:40.913 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (8m) 6m ago 17m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:04:40.913 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (7m) 5m ago 16m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:04:40.913 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (15m) 6m ago 16m 38.9M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:04:40.913 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (8m) 6m ago 12m 13.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:04:40.914 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (9m) 6m ago 12m 14.7M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:04:40.914 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (12m) 5m ago 12m 16.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:04:40.914 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (12m) 5m ago 12m 16.5M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:04:40.914 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (9m) 6m ago 18m 468M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:04:40.914 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (9m) 5m ago 16m 412M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:04:40.915 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (9m) 6m ago 18m 75.8M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:04:40.915 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (8m) 5m ago 16m 66.4M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:04:40.915 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (16m) 6m ago 16m 18.1M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:04:40.915 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (16m) 5m ago 16m 18.3M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:04:40.915 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (7m) 6m ago 15m 153M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:04:40.916 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (7m) 6m ago 15m 166M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:04:40.916 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (6m) 6m ago 14m 11.2M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:04:40.916 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (6m) 5m ago 14m 181M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:04:40.916 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (5m) 5m ago 14m 185M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:04:40.917 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (5m) 5m ago 13m 13.5M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:04:40.917 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (15m) 6m ago 16m 47.5M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:04:40.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.917+0000 7f0d657bd700 1 -- 172.21.15.26:0/3012874789 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0d48064100 msgr2=0x7f0d480665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:04:40.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.917+0000 7f0d657bd700 1 --2- 172.21.15.26:0/3012874789 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0d48064100 0x7f0d480665c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f0d50013690 tx=0x7f0d50009b30).stop 2021-11-03T17:04:40.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.917+0000 7f0d657bd700 1 -- 172.21.15.26:0/3012874789 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d600f77d0 msgr2=0x7f0d601072a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:04:40.919 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.917+0000 7f0d657bd700 1 --2- 172.21.15.26:0/3012874789 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d600f77d0 0x7f0d601072a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f0d5400c530 tx=0x7f0d54007e20).stop 2021-11-03T17:04:40.919 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.917+0000 7f0d657bd700 1 -- 172.21.15.26:0/3012874789 shutdown_connections 2021-11-03T17:04:40.919 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.917+0000 7f0d657bd700 1 --2- 172.21.15.26:0/3012874789 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0d48064100 0x7f0d480665c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:40.919 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.917+0000 7f0d657bd700 1 --2- 172.21.15.26:0/3012874789 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d600f6530 0x7f0d60106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:40.919 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.917+0000 7f0d657bd700 1 --2- 172.21.15.26:0/3012874789 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d600f77d0 0x7f0d601072a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:40.920 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.917+0000 7f0d657bd700 1 -- 172.21.15.26:0/3012874789 >> 172.21.15.26:0/3012874789 conn(0x7f0d600f1cd0 msgr2=0x7f0d600fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:04:40.920 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.917+0000 7f0d657bd700 1 -- 172.21.15.26:0/3012874789 shutdown_connections 2021-11-03T17:04:40.920 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:40.918+0000 7f0d657bd700 1 -- 172.21.15.26:0/3012874789 wait complete. 2021-11-03T17:04:41.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.017+0000 7f55a17e3700 1 -- 172.21.15.26:0/328493409 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f559c0f6ff0 msgr2=0x7f559c0f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:04:41.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.017+0000 7f55a17e3700 1 --2- 172.21.15.26:0/328493409 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f559c0f6ff0 0x7f559c0f7a20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f5590004660 tx=0x7f5590009b30).stop 2021-11-03T17:04:41.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.017+0000 7f55a17e3700 1 -- 172.21.15.26:0/328493409 shutdown_connections 2021-11-03T17:04:41.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.017+0000 7f55a17e3700 1 --2- 172.21.15.26:0/328493409 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f559c0f6ff0 0x7f559c0f7a20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:41.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.017+0000 7f55a17e3700 1 --2- 172.21.15.26:0/328493409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f559c0f66e0 0x7f559c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:04:41.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.017+0000 7f55a17e3700 1 -- 172.21.15.26:0/328493409 >> 172.21.15.26:0/328493409 conn(0x7f559c0f1f00 msgr2=0x7f559c0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:04:41.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.017+0000 7f55a17e3700 1 -- 172.21.15.26:0/328493409 shutdown_connections 2021-11-03T17:04:41.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.017+0000 7f55a17e3700 1 -- 172.21.15.26:0/328493409 wait complete. 2021-11-03T17:04:41.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.017+0000 7f55a17e3700 1 Processor -- start 2021-11-03T17:04:41.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.017+0000 7f55a17e3700 1 -- start start 2021-11-03T17:04:41.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.017+0000 7f55a17e3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f559c0f66e0 0x7f559c106fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:04:41.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.018+0000 7f55a17e3700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f559c0f6ff0 0x7f559c107490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:04:41.018 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.018+0000 7f55a17e3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559c107ad0 con 0x7f559c0f66e0 2021-11-03T17:04:41.018 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.018+0000 7f55a17e3700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559c108380 con 0x7f559c0f6ff0 2021-11-03T17:04:41.018 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.018+0000 7f559affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f559c0f66e0 0x7f559c106fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:04:41.018 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.018+0000 7f559affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f559c0f66e0 0x7f559c106fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52342/0 (socket says 172.21.15.26:52342) 2021-11-03T17:04:41.019 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.018+0000 7f559affd700 1 -- 172.21.15.26:0/1207518218 learned_addr learned my addr 172.21.15.26:0/1207518218 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:04:41.019 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.018+0000 7f559a7fc700 1 --2- 172.21.15.26:0/1207518218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f559c0f6ff0 0x7f559c107490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:04:41.019 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.018+0000 7f559affd700 1 -- 172.21.15.26:0/1207518218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f559c0f6ff0 msgr2=0x7f559c107490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:04:41.019 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.018+0000 7f559affd700 1 --2- 172.21.15.26:0/1207518218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f559c0f6ff0 0x7f559c107490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:41.019 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.018+0000 7f559affd700 1 -- 172.21.15.26:0/1207518218 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5590005040 con 0x7f559c0f66e0 2021-11-03T17:04:41.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.018+0000 7f559affd700 1 --2- 172.21.15.26:0/1207518218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f559c0f66e0 0x7f559c106fa0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f558c00b410 tx=0x7f558c006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:04:41.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.018+0000 7f55837fe700 1 -- 172.21.15.26:0/1207518218 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f558c0125f0 con 0x7f559c0f66e0 2021-11-03T17:04:41.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.018+0000 7f55a17e3700 1 -- 172.21.15.26:0/1207518218 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f559c108660 con 0x7f559c0f66e0 2021-11-03T17:04:41.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.018+0000 7f55837fe700 1 -- 172.21.15.26:0/1207518218 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f558c00be30 con 0x7f559c0f66e0 2021-11-03T17:04:41.021 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.018+0000 7f55837fe700 1 -- 172.21.15.26:0/1207518218 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f558c002a70 con 0x7f559c0f66e0 2021-11-03T17:04:41.021 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.018+0000 7f55a17e3700 1 -- 172.21.15.26:0/1207518218 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f559c108c20 con 0x7f559c0f66e0 2021-11-03T17:04:41.022 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.019+0000 7f55a17e3700 1 -- 172.21.15.26:0/1207518218 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f559c0f5b70 con 0x7f559c0f66e0 2021-11-03T17:04:41.022 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.020+0000 7f55837fe700 1 -- 172.21.15.26:0/1207518218 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f558c00f030 con 0x7f559c0f66e0 2021-11-03T17:04:41.022 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.020+0000 7f55837fe700 1 --2- 172.21.15.26:0/1207518218 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f55840640b0 0x7f5584066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:04:41.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.020+0000 7f55837fe700 1 -- 172.21.15.26:0/1207518218 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f558c080800 con 0x7f559c0f66e0 2021-11-03T17:04:41.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.020+0000 7f559a7fc700 1 --2- 172.21.15.26:0/1207518218 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f55840640b0 0x7f5584066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:04:41.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.021+0000 7f559a7fc700 1 --2- 172.21.15.26:0/1207518218 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f55840640b0 0x7f5584066570 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f5590004630 tx=0x7f5590009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:04:41.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.024+0000 7f55837fe700 1 -- 172.21.15.26:0/1207518218 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f558c052b60 con 0x7f559c0f66e0 2021-11-03T17:04:41.251 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.255+0000 7f55a17e3700 1 -- 172.21.15.26:0/1207518218 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f559c0fef50 con 0x7f559c0f66e0 2021-11-03T17:04:41.251 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.255+0000 7f55837fe700 1 -- 172.21.15.26:0/1207518218 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f558c052750 con 0x7f559c0f66e0 2021-11-03T17:04:41.252 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:04:41.252 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:04:41.252 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:04:41.253 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:04:41.253 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:04:41.253 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:04:41.253 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:04:41.254 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:04:41.254 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:04:41.254 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:04:41.254 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:04:41.254 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:04:41.255 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:04:41.255 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:04:41.255 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:04:41.256 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:04:41.256 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:04:41.256 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:04:41.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.257+0000 7f55a17e3700 1 -- 172.21.15.26:0/1207518218 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f55840640b0 msgr2=0x7f5584066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:04:41.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.257+0000 7f55a17e3700 1 --2- 172.21.15.26:0/1207518218 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f55840640b0 0x7f5584066570 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f5590004630 tx=0x7f5590009b30).stop 2021-11-03T17:04:41.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.257+0000 7f55a17e3700 1 -- 172.21.15.26:0/1207518218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f559c0f66e0 msgr2=0x7f559c106fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:04:41.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.257+0000 7f55a17e3700 1 --2- 172.21.15.26:0/1207518218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f559c0f66e0 0x7f559c106fa0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f558c00b410 tx=0x7f558c006ef0).stop 2021-11-03T17:04:41.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.257+0000 7f55a17e3700 1 -- 172.21.15.26:0/1207518218 shutdown_connections 2021-11-03T17:04:41.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.257+0000 7f55a17e3700 1 --2- 172.21.15.26:0/1207518218 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f55840640b0 0x7f5584066570 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:41.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.257+0000 7f55a17e3700 1 --2- 172.21.15.26:0/1207518218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f559c0f66e0 0x7f559c106fa0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:41.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.257+0000 7f55a17e3700 1 --2- 172.21.15.26:0/1207518218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f559c0f6ff0 0x7f559c107490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:41.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.257+0000 7f55a17e3700 1 -- 172.21.15.26:0/1207518218 >> 172.21.15.26:0/1207518218 conn(0x7f559c0f1f00 msgr2=0x7f559c0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:04:41.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.257+0000 7f55a17e3700 1 -- 172.21.15.26:0/1207518218 shutdown_connections 2021-11-03T17:04:41.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.257+0000 7f55a17e3700 1 -- 172.21.15.26:0/1207518218 wait complete. 2021-11-03T17:04:41.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.359+0000 7fe7e2b7b700 1 -- 172.21.15.26:0/1320462268 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7dc0f66e0 msgr2=0x7fe7dc0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:04:41.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.359+0000 7fe7e2b7b700 1 --2- 172.21.15.26:0/1320462268 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7dc0f66e0 0x7fe7dc0f6b00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fe7d40099e0 tx=0x7fe7d4004d10).stop 2021-11-03T17:04:41.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.359+0000 7fe7e2b7b700 1 -- 172.21.15.26:0/1320462268 shutdown_connections 2021-11-03T17:04:41.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.359+0000 7fe7e2b7b700 1 --2- 172.21.15.26:0/1320462268 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7dc0f7980 0x7fe7dc0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:41.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.359+0000 7fe7e2b7b700 1 --2- 172.21.15.26:0/1320462268 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7dc0f66e0 0x7fe7dc0f6b00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:41.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.359+0000 7fe7e2b7b700 1 -- 172.21.15.26:0/1320462268 >> 172.21.15.26:0/1320462268 conn(0x7fe7dc0f1e40 msgr2=0x7fe7dc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:04:41.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.359+0000 7fe7e2b7b700 1 -- 172.21.15.26:0/1320462268 shutdown_connections 2021-11-03T17:04:41.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.359+0000 7fe7e2b7b700 1 -- 172.21.15.26:0/1320462268 wait complete. 2021-11-03T17:04:41.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.359+0000 7fe7e2b7b700 1 Processor -- start 2021-11-03T17:04:41.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.359+0000 7fe7e2b7b700 1 -- start start 2021-11-03T17:04:41.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.360+0000 7fe7e2b7b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7dc0f66e0 0x7fe7dc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:04:41.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.360+0000 7fe7e2b7b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7dc0f7980 0x7fe7dc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:04:41.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.360+0000 7fe7e2b7b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc06a380 con 0x7fe7dc0f7980 2021-11-03T17:04:41.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.360+0000 7fe7e2b7b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc06a4c0 con 0x7fe7dc0f66e0 2021-11-03T17:04:41.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.360+0000 7fe7dbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7dc0f7980 0x7fe7dc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:04:41.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.360+0000 7fe7dbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7dc0f7980 0x7fe7dc069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52354/0 (socket says 172.21.15.26:52354) 2021-11-03T17:04:41.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.360+0000 7fe7dbfff700 1 -- 172.21.15.26:0/1938041925 learned_addr learned my addr 172.21.15.26:0/1938041925 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:04:41.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.360+0000 7fe7e0917700 1 --2- 172.21.15.26:0/1938041925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7dc0f66e0 0x7fe7dc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:04:41.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.360+0000 7fe7dbfff700 1 -- 172.21.15.26:0/1938041925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7dc0f66e0 msgr2=0x7fe7dc06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:04:41.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.360+0000 7fe7dbfff700 1 --2- 172.21.15.26:0/1938041925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7dc0f66e0 0x7fe7dc06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:41.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.360+0000 7fe7dbfff700 1 -- 172.21.15.26:0/1938041925 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d4009640 con 0x7fe7dc0f7980 2021-11-03T17:04:41.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.360+0000 7fe7dbfff700 1 --2- 172.21.15.26:0/1938041925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7dc0f7980 0x7fe7dc069e20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fe7d00026d0 tx=0x7fe7d0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:04:41.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.360+0000 7fe7d97fa700 1 -- 172.21.15.26:0/1938041925 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7d00079c0 con 0x7fe7dc0f7980 2021-11-03T17:04:41.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.360+0000 7fe7e2b7b700 1 -- 172.21.15.26:0/1938041925 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7dc06a7a0 con 0x7fe7dc0f7980 2021-11-03T17:04:41.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.360+0000 7fe7d97fa700 1 -- 172.21.15.26:0/1938041925 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe7d000f040 con 0x7fe7dc0f7980 2021-11-03T17:04:41.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.361+0000 7fe7d97fa700 1 -- 172.21.15.26:0/1938041925 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7d00148b0 con 0x7fe7dc0f7980 2021-11-03T17:04:41.363 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.361+0000 7fe7e2b7b700 1 -- 172.21.15.26:0/1938041925 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7dc10f100 con 0x7fe7dc0f7980 2021-11-03T17:04:41.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.362+0000 7fe7e2b7b700 1 -- 172.21.15.26:0/1938041925 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7dc045ad0 con 0x7fe7dc0f7980 2021-11-03T17:04:41.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.362+0000 7fe7d97fa700 1 -- 172.21.15.26:0/1938041925 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fe7d0007b20 con 0x7fe7dc0f7980 2021-11-03T17:04:41.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.362+0000 7fe7d97fa700 1 --2- 172.21.15.26:0/1938041925 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe7c40640b0 0x7fe7c4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:04:41.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.362+0000 7fe7d97fa700 1 -- 172.21.15.26:0/1938041925 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fe7d0080740 con 0x7fe7dc0f7980 2021-11-03T17:04:41.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.362+0000 7fe7e0917700 1 --2- 172.21.15.26:0/1938041925 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe7c40640b0 0x7fe7c4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:04:41.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.363+0000 7fe7e0917700 1 --2- 172.21.15.26:0/1938041925 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe7c40640b0 0x7fe7c4066570 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fe7d40099b0 tx=0x7fe7d4004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:04:41.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.366+0000 7fe7d97fa700 1 -- 172.21.15.26:0/1938041925 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fe7d0052aa0 con 0x7fe7dc0f7980 2021-11-03T17:04:41.563 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.568+0000 7fe7e2b7b700 1 -- 172.21.15.26:0/1938041925 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe7dc027a00 con 0x7fe7dc0f7980 2021-11-03T17:04:41.564 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.569+0000 7fe7d97fa700 1 -- 172.21.15.26:0/1938041925 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fe7d0052690 con 0x7fe7dc0f7980 2021-11-03T17:04:41.564 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:04:41.565 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:04:41.565 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:04:41.565 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:04:41.565 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:04:41.565 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:04:41.566 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:04:41.566 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:04:41.566 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:04:41.566 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:04:41.567 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:04:41.567 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:04:41.567 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:04:41.567 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:04:41.568 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:04:41.568 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:04:41.568 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:04:41.568 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:04:41.568 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:04:41.569 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:04:41.569 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:04:41.569 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:04:41.569 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:04:41.570 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:04:41.570 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:04:41.570 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:04:41.570 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:04:41.571 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:04:41.571 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:04:41.571 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:04:41.571 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:04:41.571 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:04:41.572 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:04:41.572 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:04:41.572 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:04:41.572 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:04:41.573 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:04:41.573 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:04:41.573 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:04:41.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.570+0000 7fe7e2b7b700 1 -- 172.21.15.26:0/1938041925 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe7c40640b0 msgr2=0x7fe7c4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:04:41.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.570+0000 7fe7e2b7b700 1 --2- 172.21.15.26:0/1938041925 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe7c40640b0 0x7fe7c4066570 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fe7d40099b0 tx=0x7fe7d4004d10).stop 2021-11-03T17:04:41.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.570+0000 7fe7e2b7b700 1 -- 172.21.15.26:0/1938041925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7dc0f7980 msgr2=0x7fe7dc069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:04:41.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.570+0000 7fe7e2b7b700 1 --2- 172.21.15.26:0/1938041925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7dc0f7980 0x7fe7dc069e20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fe7d00026d0 tx=0x7fe7d0009de0).stop 2021-11-03T17:04:41.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.570+0000 7fe7e2b7b700 1 -- 172.21.15.26:0/1938041925 shutdown_connections 2021-11-03T17:04:41.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.570+0000 7fe7e2b7b700 1 --2- 172.21.15.26:0/1938041925 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe7c40640b0 0x7fe7c4066570 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:41.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.570+0000 7fe7e2b7b700 1 --2- 172.21.15.26:0/1938041925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7dc0f66e0 0x7fe7dc06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:41.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.571+0000 7fe7e2b7b700 1 --2- 172.21.15.26:0/1938041925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7dc0f7980 0x7fe7dc069e20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:04:41.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.571+0000 7fe7e2b7b700 1 -- 172.21.15.26:0/1938041925 >> 172.21.15.26:0/1938041925 conn(0x7fe7dc0f1e40 msgr2=0x7fe7dc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:04:41.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.571+0000 7fe7e2b7b700 1 -- 172.21.15.26:0/1938041925 shutdown_connections 2021-11-03T17:04:41.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:04:41.571+0000 7fe7e2b7b700 1 -- 172.21.15.26:0/1938041925 wait complete. 2021-11-03T17:04:41.577 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:04:42.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:42 smithi026 ceph-mon[96795]: pgmap v301: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:42.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:42 smithi026 ceph-mon[96795]: from='client.34444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:04:42.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:42 smithi026 ceph-mon[96795]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:04:42.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:42 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1207518218' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:04:42.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:42 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1938041925' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:04:42.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:42 smithi194 ceph-mon[65619]: pgmap v301: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:42.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:42 smithi194 ceph-mon[65619]: from='client.34444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:04:42.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:42 smithi194 ceph-mon[65619]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:04:42.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:42 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1207518218' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:04:42.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:42 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1938041925' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:04:43.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:43 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:04:43.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:43 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:04:43.471 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:43 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:04:43.471 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:43 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:04:44.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:44 smithi026 ceph-mon[96795]: pgmap v302: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:44.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:44 smithi194 ceph-mon[65619]: pgmap v302: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:46.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:46 smithi026 ceph-mon[96795]: pgmap v303: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:46.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:46 smithi194 ceph-mon[65619]: pgmap v303: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:48.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:48 smithi026 ceph-mon[96795]: pgmap v304: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:48.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:04:48.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:04:48.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:48 smithi194 ceph-mon[65619]: pgmap v304: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:48.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:04:48.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:04:50.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:50 smithi026 ceph-mon[96795]: pgmap v305: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:50.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:50 smithi194 ceph-mon[65619]: pgmap v305: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:52.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:52 smithi026 ceph-mon[96795]: pgmap v306: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:52.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:52 smithi194 ceph-mon[65619]: pgmap v306: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:54.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:54 smithi026 ceph-mon[96795]: pgmap v307: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:54.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:54 smithi194 ceph-mon[65619]: pgmap v307: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:56.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:56 smithi026 ceph-mon[96795]: pgmap v308: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:56.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:56 smithi194 ceph-mon[65619]: pgmap v308: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:57.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:57 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:04:57.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:57 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:04:58.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:58 smithi026 ceph-mon[96795]: pgmap v309: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:58.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:04:58 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:04:58.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:58 smithi194 ceph-mon[65619]: pgmap v309: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:04:58.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:04:58 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:05:00.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:00 smithi026 ceph-mon[96795]: pgmap v310: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:00.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:00 smithi194 ceph-mon[65619]: pgmap v310: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:02.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:02 smithi026 ceph-mon[96795]: pgmap v311: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:02.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:02 smithi194 ceph-mon[65619]: pgmap v311: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:04.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:04 smithi026 ceph-mon[96795]: pgmap v312: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:04.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:04 smithi194 ceph-mon[65619]: pgmap v312: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:06.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:06 smithi026 ceph-mon[96795]: pgmap v313: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:06.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:06 smithi194 ceph-mon[65619]: pgmap v313: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:08.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:08 smithi026 ceph-mon[96795]: pgmap v314: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:08.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:08 smithi194 ceph-mon[65619]: pgmap v314: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:10.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:10 smithi026 ceph-mon[96795]: pgmap v315: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:10.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:10 smithi194 ceph-mon[65619]: pgmap v315: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:11.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.685+0000 7f85426a5700 1 -- 172.21.15.26:0/1506599340 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f853c0f55e0 msgr2=0x7f853c0f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:05:11.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.685+0000 7f85426a5700 1 --2- 172.21.15.26:0/1506599340 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f853c0f55e0 0x7f853c0f5a00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f852c004660 tx=0x7f852c009b30).stop 2021-11-03T17:05:11.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.685+0000 7f85426a5700 1 -- 172.21.15.26:0/1506599340 shutdown_connections 2021-11-03T17:05:11.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.685+0000 7f85426a5700 1 --2- 172.21.15.26:0/1506599340 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f853c0f5ef0 0x7f853c0f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:11.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.685+0000 7f85426a5700 1 --2- 172.21.15.26:0/1506599340 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f853c0f55e0 0x7f853c0f5a00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:11.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.685+0000 7f85426a5700 1 -- 172.21.15.26:0/1506599340 >> 172.21.15.26:0/1506599340 conn(0x7f853c0f0de0 msgr2=0x7f853c0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:05:11.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.685+0000 7f85426a5700 1 -- 172.21.15.26:0/1506599340 shutdown_connections 2021-11-03T17:05:11.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.685+0000 7f85426a5700 1 -- 172.21.15.26:0/1506599340 wait complete. 2021-11-03T17:05:11.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.686+0000 7f85426a5700 1 Processor -- start 2021-11-03T17:05:11.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.686+0000 7f85426a5700 1 -- start start 2021-11-03T17:05:11.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.686+0000 7f85426a5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f853c0f55e0 0x7f853c109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:05:11.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.686+0000 7f85426a5700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f853c0f5ef0 0x7f853c10c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:05:11.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.686+0000 7f85426a5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853c060500 con 0x7f853c0f55e0 2021-11-03T17:05:11.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.686+0000 7f85426a5700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853c060640 con 0x7f853c0f5ef0 2021-11-03T17:05:11.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.686+0000 7f853bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f853c0f55e0 0x7f853c109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:05:11.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.686+0000 7f853bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f853c0f55e0 0x7f853c109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52370/0 (socket says 172.21.15.26:52370) 2021-11-03T17:05:11.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.686+0000 7f853bfff700 1 -- 172.21.15.26:0/2450386016 learned_addr learned my addr 172.21.15.26:0/2450386016 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:05:11.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.687+0000 7f853b7fe700 1 --2- 172.21.15.26:0/2450386016 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f853c0f5ef0 0x7f853c10c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:05:11.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.687+0000 7f853bfff700 1 -- 172.21.15.26:0/2450386016 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f853c0f5ef0 msgr2=0x7f853c10c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:05:11.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.687+0000 7f853bfff700 1 --2- 172.21.15.26:0/2450386016 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f853c0f5ef0 0x7f853c10c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:11.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.687+0000 7f853bfff700 1 -- 172.21.15.26:0/2450386016 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f852c005040 con 0x7f853c0f55e0 2021-11-03T17:05:11.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.687+0000 7f853bfff700 1 --2- 172.21.15.26:0/2450386016 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f853c0f55e0 0x7f853c109c90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f852c009990 tx=0x7f852c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:05:11.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.687+0000 7f8538ff9700 1 -- 172.21.15.26:0/2450386016 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f852c018070 con 0x7f853c0f55e0 2021-11-03T17:05:11.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.687+0000 7f85426a5700 1 -- 172.21.15.26:0/2450386016 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f853c10c6e0 con 0x7f853c0f55e0 2021-11-03T17:05:11.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.687+0000 7f8538ff9700 1 -- 172.21.15.26:0/2450386016 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f852c007ca0 con 0x7f853c0f55e0 2021-11-03T17:05:11.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.687+0000 7f8538ff9700 1 -- 172.21.15.26:0/2450386016 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f852c01c620 con 0x7f853c0f55e0 2021-11-03T17:05:11.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.687+0000 7f85426a5700 1 -- 172.21.15.26:0/2450386016 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f853c10cc40 con 0x7f853c0f55e0 2021-11-03T17:05:11.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.688+0000 7f85426a5700 1 -- 172.21.15.26:0/2450386016 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f853c045ad0 con 0x7f853c0f55e0 2021-11-03T17:05:11.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.689+0000 7f8538ff9700 1 -- 172.21.15.26:0/2450386016 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f852c01d960 con 0x7f853c0f55e0 2021-11-03T17:05:11.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.689+0000 7f8538ff9700 1 --2- 172.21.15.26:0/2450386016 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85240640b0 0x7f8524066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:05:11.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.689+0000 7f8538ff9700 1 -- 172.21.15.26:0/2450386016 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f852c0825e0 con 0x7f853c0f55e0 2021-11-03T17:05:11.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.689+0000 7f853b7fe700 1 --2- 172.21.15.26:0/2450386016 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85240640b0 0x7f8524066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:05:11.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.690+0000 7f853b7fe700 1 --2- 172.21.15.26:0/2450386016 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85240640b0 0x7f8524066570 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f8530007fd0 tx=0x7f8530009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:05:11.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.693+0000 7f8538ff9700 1 -- 172.21.15.26:0/2450386016 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f852c054940 con 0x7f853c0f55e0 2021-11-03T17:05:11.866 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.871+0000 7f85426a5700 1 -- 172.21.15.26:0/2450386016 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f853c0fdeb0 con 0x7f85240640b0 2021-11-03T17:05:11.867 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.872+0000 7f8538ff9700 1 -- 172.21.15.26:0/2450386016 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f853c0fdeb0 con 0x7f85240640b0 2021-11-03T17:05:11.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.874+0000 7f85426a5700 1 -- 172.21.15.26:0/2450386016 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85240640b0 msgr2=0x7f8524066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:05:11.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.874+0000 7f85426a5700 1 --2- 172.21.15.26:0/2450386016 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85240640b0 0x7f8524066570 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f8530007fd0 tx=0x7f8530009040).stop 2021-11-03T17:05:11.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.874+0000 7f85426a5700 1 -- 172.21.15.26:0/2450386016 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f853c0f55e0 msgr2=0x7f853c109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:05:11.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.874+0000 7f85426a5700 1 --2- 172.21.15.26:0/2450386016 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f853c0f55e0 0x7f853c109c90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f852c009990 tx=0x7f852c009b30).stop 2021-11-03T17:05:11.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.874+0000 7f85426a5700 1 -- 172.21.15.26:0/2450386016 shutdown_connections 2021-11-03T17:05:11.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.874+0000 7f85426a5700 1 --2- 172.21.15.26:0/2450386016 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85240640b0 0x7f8524066570 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:11.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.874+0000 7f85426a5700 1 --2- 172.21.15.26:0/2450386016 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f853c0f55e0 0x7f853c109c90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:11.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.874+0000 7f85426a5700 1 --2- 172.21.15.26:0/2450386016 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f853c0f5ef0 0x7f853c10c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:11.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.874+0000 7f85426a5700 1 -- 172.21.15.26:0/2450386016 >> 172.21.15.26:0/2450386016 conn(0x7f853c0f0de0 msgr2=0x7f853c0fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:05:11.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.874+0000 7f85426a5700 1 -- 172.21.15.26:0/2450386016 shutdown_connections 2021-11-03T17:05:11.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.874+0000 7f85426a5700 1 -- 172.21.15.26:0/2450386016 wait complete. 2021-11-03T17:05:11.879 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:05:11.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.975+0000 7f9c95287700 1 -- 172.21.15.26:0/362351097 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c900f6860 msgr2=0x7f9c900f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:05:11.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.975+0000 7f9c95287700 1 --2- 172.21.15.26:0/362351097 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c900f6860 0x7f9c900f6cc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f9c84004660 tx=0x7f9c84009b30).stop 2021-11-03T17:05:11.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.975+0000 7f9c95287700 1 -- 172.21.15.26:0/362351097 shutdown_connections 2021-11-03T17:05:11.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.975+0000 7f9c95287700 1 --2- 172.21.15.26:0/362351097 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c900f6860 0x7f9c900f6cc0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:11.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.975+0000 7f9c95287700 1 --2- 172.21.15.26:0/362351097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c900f55c0 0x7f9c900f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:05:11.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.975+0000 7f9c95287700 1 -- 172.21.15.26:0/362351097 >> 172.21.15.26:0/362351097 conn(0x7f9c900f0d20 msgr2=0x7f9c900f3140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:05:11.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.975+0000 7f9c95287700 1 -- 172.21.15.26:0/362351097 shutdown_connections 2021-11-03T17:05:11.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.975+0000 7f9c95287700 1 -- 172.21.15.26:0/362351097 wait complete. 2021-11-03T17:05:11.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.975+0000 7f9c95287700 1 Processor -- start 2021-11-03T17:05:11.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.975+0000 7f9c95287700 1 -- start start 2021-11-03T17:05:11.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.976+0000 7f9c95287700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c900f55c0 0x7f9c900f9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:05:11.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.976+0000 7f9c95287700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c900f6860 0x7f9c900f83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:05:11.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.976+0000 7f9c95287700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c900f89b0 con 0x7f9c900f6860 2021-11-03T17:05:11.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.976+0000 7f9c95287700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c900f8af0 con 0x7f9c900f55c0 2021-11-03T17:05:11.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.976+0000 7f9c8e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c900f6860 0x7f9c900f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:05:11.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.976+0000 7f9c8e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c900f6860 0x7f9c900f83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52382/0 (socket says 172.21.15.26:52382) 2021-11-03T17:05:11.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.976+0000 7f9c8e7fc700 1 -- 172.21.15.26:0/3427299812 learned_addr learned my addr 172.21.15.26:0/3427299812 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:05:11.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.976+0000 7f9c8effd700 1 --2- 172.21.15.26:0/3427299812 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c900f55c0 0x7f9c900f9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:05:11.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.976+0000 7f9c8e7fc700 1 -- 172.21.15.26:0/3427299812 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c900f55c0 msgr2=0x7f9c900f9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:05:11.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.976+0000 7f9c8e7fc700 1 --2- 172.21.15.26:0/3427299812 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c900f55c0 0x7f9c900f9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:11.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.976+0000 7f9c8e7fc700 1 -- 172.21.15.26:0/3427299812 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c84005040 con 0x7f9c900f6860 2021-11-03T17:05:11.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.976+0000 7f9c8e7fc700 1 --2- 172.21.15.26:0/3427299812 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c900f6860 0x7f9c900f83c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f9c84009990 tx=0x7f9c84009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:05:11.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.976+0000 7f9c777fe700 1 -- 172.21.15.26:0/3427299812 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c84018070 con 0x7f9c900f6860 2021-11-03T17:05:11.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.976+0000 7f9c95287700 1 -- 172.21.15.26:0/3427299812 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c900f8d70 con 0x7f9c900f6860 2021-11-03T17:05:11.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.976+0000 7f9c777fe700 1 -- 172.21.15.26:0/3427299812 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9c84007ba0 con 0x7f9c900f6860 2021-11-03T17:05:11.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.976+0000 7f9c777fe700 1 -- 172.21.15.26:0/3427299812 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c8401c620 con 0x7f9c900f6860 2021-11-03T17:05:11.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.976+0000 7f9c95287700 1 -- 172.21.15.26:0/3427299812 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c9010efe0 con 0x7f9c900f6860 2021-11-03T17:05:11.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.977+0000 7f9c95287700 1 -- 172.21.15.26:0/3427299812 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c90045ad0 con 0x7f9c900f6860 2021-11-03T17:05:11.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.978+0000 7f9c777fe700 1 -- 172.21.15.26:0/3427299812 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f9c8401c8e0 con 0x7f9c900f6860 2021-11-03T17:05:11.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.978+0000 7f9c777fe700 1 --2- 172.21.15.26:0/3427299812 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9c780640b0 0x7f9c78066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:05:11.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.978+0000 7f9c777fe700 1 -- 172.21.15.26:0/3427299812 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f9c84082600 con 0x7f9c900f6860 2021-11-03T17:05:11.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.978+0000 7f9c8effd700 1 --2- 172.21.15.26:0/3427299812 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9c780640b0 0x7f9c78066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:05:11.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.978+0000 7f9c8effd700 1 --2- 172.21.15.26:0/3427299812 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9c780640b0 0x7f9c78066570 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f9c900f9cd0 tx=0x7f9c88009220).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:05:11.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:11.982+0000 7f9c777fe700 1 -- 172.21.15.26:0/3427299812 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f9c84054a20 con 0x7f9c900f6860 2021-11-03T17:05:12.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.158+0000 7f9c95287700 1 -- 172.21.15.26:0/3427299812 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c9005fe70 con 0x7f9c780640b0 2021-11-03T17:05:12.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.172+0000 7f9c777fe700 1 -- 172.21.15.26:0/3427299812 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f9c9005fe70 con 0x7f9c780640b0 2021-11-03T17:05:12.168 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:05:12.168 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (16m) 7m ago 17m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:05:12.168 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (8m) 7m ago 17m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:05:12.169 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (8m) 5m ago 16m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:05:12.169 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (16m) 7m ago 17m 38.9M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:05:12.169 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (9m) 7m ago 12m 13.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:05:12.169 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (9m) 7m ago 12m 14.7M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:05:12.170 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (12m) 5m ago 12m 16.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:05:12.170 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (12m) 5m ago 12m 16.5M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:05:12.170 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (10m) 7m ago 19m 468M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:05:12.170 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (9m) 5m ago 16m 412M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:05:12.170 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (9m) 7m ago 19m 75.8M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:05:12.171 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (9m) 5m ago 16m 66.4M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:05:12.171 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (17m) 7m ago 17m 18.1M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:05:12.171 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (16m) 5m ago 16m 18.3M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:05:12.171 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (8m) 7m ago 16m 153M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:05:12.172 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (7m) 7m ago 15m 166M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:05:12.172 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (7m) 7m ago 15m 11.2M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:05:12.172 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (6m) 5m ago 15m 181M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:05:12.172 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (6m) 5m ago 14m 185M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:05:12.172 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (5m) 5m ago 14m 13.5M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:05:12.173 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (16m) 7m ago 17m 47.5M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:05:12.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.174+0000 7f9c95287700 1 -- 172.21.15.26:0/3427299812 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9c780640b0 msgr2=0x7f9c78066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:05:12.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.174+0000 7f9c95287700 1 --2- 172.21.15.26:0/3427299812 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9c780640b0 0x7f9c78066570 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f9c900f9cd0 tx=0x7f9c88009220).stop 2021-11-03T17:05:12.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.174+0000 7f9c95287700 1 -- 172.21.15.26:0/3427299812 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c900f6860 msgr2=0x7f9c900f83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:05:12.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.174+0000 7f9c95287700 1 --2- 172.21.15.26:0/3427299812 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c900f6860 0x7f9c900f83c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f9c84009990 tx=0x7f9c84009b30).stop 2021-11-03T17:05:12.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.174+0000 7f9c95287700 1 -- 172.21.15.26:0/3427299812 shutdown_connections 2021-11-03T17:05:12.175 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.174+0000 7f9c95287700 1 --2- 172.21.15.26:0/3427299812 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9c780640b0 0x7f9c78066570 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:12.175 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.174+0000 7f9c95287700 1 --2- 172.21.15.26:0/3427299812 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c900f55c0 0x7f9c900f9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:12.176 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.174+0000 7f9c95287700 1 --2- 172.21.15.26:0/3427299812 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c900f6860 0x7f9c900f83c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:12.176 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.174+0000 7f9c95287700 1 -- 172.21.15.26:0/3427299812 >> 172.21.15.26:0/3427299812 conn(0x7f9c900f0d20 msgr2=0x7f9c9005f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:05:12.176 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.174+0000 7f9c95287700 1 -- 172.21.15.26:0/3427299812 shutdown_connections 2021-11-03T17:05:12.176 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.174+0000 7f9c95287700 1 -- 172.21.15.26:0/3427299812 wait complete. 2021-11-03T17:05:12.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.274+0000 7f49bbfff700 1 -- 172.21.15.26:0/3748359977 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49bc0f66e0 msgr2=0x7f49bc0f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:05:12.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.274+0000 7f49bbfff700 1 --2- 172.21.15.26:0/3748359977 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49bc0f66e0 0x7f49bc0f6b40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f49a4004660 tx=0x7f49a4009b30).stop 2021-11-03T17:05:12.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.274+0000 7f49bbfff700 1 -- 172.21.15.26:0/3748359977 shutdown_connections 2021-11-03T17:05:12.270 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.274+0000 7f49bbfff700 1 --2- 172.21.15.26:0/3748359977 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49bc0f66e0 0x7f49bc0f6b40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:12.270 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.274+0000 7f49bbfff700 1 --2- 172.21.15.26:0/3748359977 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49bc0f5440 0x7f49bc0f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:12.270 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.274+0000 7f49bbfff700 1 -- 172.21.15.26:0/3748359977 >> 172.21.15.26:0/3748359977 conn(0x7f49bc0f0ba0 msgr2=0x7f49bc0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:05:12.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.274+0000 7f49bbfff700 1 -- 172.21.15.26:0/3748359977 shutdown_connections 2021-11-03T17:05:12.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.274+0000 7f49bbfff700 1 -- 172.21.15.26:0/3748359977 wait complete. 2021-11-03T17:05:12.274 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.274+0000 7f49bbfff700 1 Processor -- start 2021-11-03T17:05:12.274 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.274+0000 7f49bbfff700 1 -- start start 2021-11-03T17:05:12.274 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.275+0000 7f49bbfff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49bc0f5440 0x7f49bc109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:05:12.274 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.275+0000 7f49bbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49bc0f66e0 0x7f49bc10bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:05:12.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.275+0000 7f49bbfff700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49bc0603e0 con 0x7f49bc0f66e0 2021-11-03T17:05:12.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.275+0000 7f49bbfff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49bc060520 con 0x7f49bc0f5440 2021-11-03T17:05:12.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.275+0000 7f49ba7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49bc0f66e0 0x7f49bc10bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:05:12.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.275+0000 7f49ba7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49bc0f66e0 0x7f49bc10bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52392/0 (socket says 172.21.15.26:52392) 2021-11-03T17:05:12.276 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.275+0000 7f49ba7fc700 1 -- 172.21.15.26:0/1744602395 learned_addr learned my addr 172.21.15.26:0/1744602395 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:05:12.276 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.275+0000 7f49baffd700 1 --2- 172.21.15.26:0/1744602395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49bc0f5440 0x7f49bc109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:05:12.276 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.275+0000 7f49ba7fc700 1 -- 172.21.15.26:0/1744602395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49bc0f5440 msgr2=0x7f49bc109a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:05:12.276 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.275+0000 7f49ba7fc700 1 --2- 172.21.15.26:0/1744602395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49bc0f5440 0x7f49bc109a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:12.277 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.275+0000 7f49ba7fc700 1 -- 172.21.15.26:0/1744602395 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a4005040 con 0x7f49bc0f66e0 2021-11-03T17:05:12.277 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.275+0000 7f49ba7fc700 1 --2- 172.21.15.26:0/1744602395 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49bc0f66e0 0x7f49bc10bf90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f49a4009990 tx=0x7f49a4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:05:12.277 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.275+0000 7f49b37fe700 1 -- 172.21.15.26:0/1744602395 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49a4018070 con 0x7f49bc0f66e0 2021-11-03T17:05:12.277 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.275+0000 7f49b37fe700 1 -- 172.21.15.26:0/1744602395 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f49a4007ba0 con 0x7f49bc0f66e0 2021-11-03T17:05:12.277 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.275+0000 7f49bbfff700 1 -- 172.21.15.26:0/1744602395 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49bc10c4e0 con 0x7f49bc0f66e0 2021-11-03T17:05:12.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.275+0000 7f49b37fe700 1 -- 172.21.15.26:0/1744602395 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49a401c3c0 con 0x7f49bc0f66e0 2021-11-03T17:05:12.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.275+0000 7f49bbfff700 1 -- 172.21.15.26:0/1744602395 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49bc10ca40 con 0x7f49bc0f66e0 2021-11-03T17:05:12.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.276+0000 7f49bbfff700 1 -- 172.21.15.26:0/1744602395 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49bc045ad0 con 0x7f49bc0f66e0 2021-11-03T17:05:12.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.277+0000 7f49b37fe700 1 -- 172.21.15.26:0/1744602395 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f49a401d420 con 0x7f49bc0f66e0 2021-11-03T17:05:12.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.278+0000 7f49b37fe700 1 --2- 172.21.15.26:0/1744602395 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f49a8064100 0x7f49a80665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:05:12.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.278+0000 7f49b37fe700 1 -- 172.21.15.26:0/1744602395 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f49a4082560 con 0x7f49bc0f66e0 2021-11-03T17:05:12.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.278+0000 7f49baffd700 1 --2- 172.21.15.26:0/1744602395 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f49a8064100 0x7f49a80665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:05:12.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.278+0000 7f49baffd700 1 --2- 172.21.15.26:0/1744602395 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f49a8064100 0x7f49a80665c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f49bc060060 tx=0x7f49b400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:05:12.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.281+0000 7f49b37fe700 1 -- 172.21.15.26:0/1744602395 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f49a40549c0 con 0x7f49bc0f66e0 2021-11-03T17:05:12.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:12 smithi026 ceph-mon[96795]: pgmap v316: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:12.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:12 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:05:12.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:12 smithi194 ceph-mon[65619]: pgmap v316: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:12.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:12 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:05:12.504 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.509+0000 7f49bbfff700 1 -- 172.21.15.26:0/1744602395 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f49bc0fdd10 con 0x7f49bc0f66e0 2021-11-03T17:05:12.505 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.510+0000 7f49b37fe700 1 -- 172.21.15.26:0/1744602395 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f49a40545b0 con 0x7f49bc0f66e0 2021-11-03T17:05:12.505 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:05:12.505 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:05:12.506 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:05:12.506 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:05:12.506 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:05:12.506 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:05:12.507 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:05:12.507 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:05:12.507 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:05:12.508 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:05:12.508 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:05:12.508 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:05:12.509 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:05:12.509 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:05:12.509 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:05:12.509 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:05:12.510 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:05:12.510 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:05:12.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.512+0000 7f49bbfff700 1 -- 172.21.15.26:0/1744602395 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f49a8064100 msgr2=0x7f49a80665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:05:12.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.512+0000 7f49bbfff700 1 --2- 172.21.15.26:0/1744602395 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f49a8064100 0x7f49a80665c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f49bc060060 tx=0x7f49b400b040).stop 2021-11-03T17:05:12.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.512+0000 7f49bbfff700 1 -- 172.21.15.26:0/1744602395 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49bc0f66e0 msgr2=0x7f49bc10bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:05:12.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.512+0000 7f49bbfff700 1 --2- 172.21.15.26:0/1744602395 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49bc0f66e0 0x7f49bc10bf90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f49a4009990 tx=0x7f49a4009b30).stop 2021-11-03T17:05:12.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.512+0000 7f49bbfff700 1 -- 172.21.15.26:0/1744602395 shutdown_connections 2021-11-03T17:05:12.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.512+0000 7f49bbfff700 1 --2- 172.21.15.26:0/1744602395 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f49a8064100 0x7f49a80665c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:12.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.512+0000 7f49bbfff700 1 --2- 172.21.15.26:0/1744602395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49bc0f5440 0x7f49bc109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:12.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.512+0000 7f49bbfff700 1 --2- 172.21.15.26:0/1744602395 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49bc0f66e0 0x7f49bc10bf90 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:12.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.512+0000 7f49bbfff700 1 -- 172.21.15.26:0/1744602395 >> 172.21.15.26:0/1744602395 conn(0x7f49bc0f0ba0 msgr2=0x7f49bc0fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:05:12.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.512+0000 7f49bbfff700 1 -- 172.21.15.26:0/1744602395 shutdown_connections 2021-11-03T17:05:12.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.512+0000 7f49bbfff700 1 -- 172.21.15.26:0/1744602395 wait complete. 2021-11-03T17:05:12.607 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.612+0000 7fe311254700 1 -- 172.21.15.26:0/4211893324 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe30c0f49a0 msgr2=0x7fe30c0f4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:05:12.607 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.612+0000 7fe311254700 1 --2- 172.21.15.26:0/4211893324 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe30c0f49a0 0x7fe30c0f4dc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fe2fc004660 tx=0x7fe2fc009b30).stop 2021-11-03T17:05:12.607 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.612+0000 7fe311254700 1 -- 172.21.15.26:0/4211893324 shutdown_connections 2021-11-03T17:05:12.608 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.612+0000 7fe311254700 1 --2- 172.21.15.26:0/4211893324 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe30c0f5340 0x7fe30c0f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:12.608 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.612+0000 7fe311254700 1 --2- 172.21.15.26:0/4211893324 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe30c0f49a0 0x7fe30c0f4dc0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:12.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.612+0000 7fe311254700 1 -- 172.21.15.26:0/4211893324 >> 172.21.15.26:0/4211893324 conn(0x7fe30c0f04c0 msgr2=0x7fe30c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:05:12.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.612+0000 7fe311254700 1 -- 172.21.15.26:0/4211893324 shutdown_connections 2021-11-03T17:05:12.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.612+0000 7fe311254700 1 -- 172.21.15.26:0/4211893324 wait complete. 2021-11-03T17:05:12.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.612+0000 7fe311254700 1 Processor -- start 2021-11-03T17:05:12.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.612+0000 7fe311254700 1 -- start start 2021-11-03T17:05:12.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.613+0000 7fe311254700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe30c0f49a0 0x7fe30c0f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:05:12.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.613+0000 7fe311254700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe30c0f5340 0x7fe30c0f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:05:12.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.613+0000 7fe311254700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c0f5f30 con 0x7fe30c0f5340 2021-11-03T17:05:12.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.613+0000 7fe311254700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c0f6070 con 0x7fe30c0f49a0 2021-11-03T17:05:12.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.613+0000 7fe30a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe30c0f5340 0x7fe30c0f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:05:12.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.613+0000 7fe30a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe30c0f5340 0x7fe30c0f59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52402/0 (socket says 172.21.15.26:52402) 2021-11-03T17:05:12.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.613+0000 7fe30a59c700 1 -- 172.21.15.26:0/1761947918 learned_addr learned my addr 172.21.15.26:0/1761947918 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:05:12.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.613+0000 7fe30ad9d700 1 --2- 172.21.15.26:0/1761947918 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe30c0f49a0 0x7fe30c0f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:05:12.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.613+0000 7fe30a59c700 1 -- 172.21.15.26:0/1761947918 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe30c0f49a0 msgr2=0x7fe30c0f7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:05:12.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.613+0000 7fe30a59c700 1 --2- 172.21.15.26:0/1761947918 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe30c0f49a0 0x7fe30c0f7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:12.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.613+0000 7fe30a59c700 1 -- 172.21.15.26:0/1761947918 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2fc005040 con 0x7fe30c0f5340 2021-11-03T17:05:12.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.613+0000 7fe30ad9d700 1 --2- 172.21.15.26:0/1761947918 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe30c0f49a0 0x7fe30c0f7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:05:12.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.613+0000 7fe30a59c700 1 --2- 172.21.15.26:0/1761947918 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe30c0f5340 0x7fe30c0f59d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7fe2f400c510 tx=0x7fe2f4007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:05:12.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.613+0000 7fe3037fe700 1 -- 172.21.15.26:0/1761947918 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2f400f650 con 0x7fe30c0f5340 2021-11-03T17:05:12.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.613+0000 7fe3037fe700 1 -- 172.21.15.26:0/1761947918 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe2f400fc60 con 0x7fe30c0f5340 2021-11-03T17:05:12.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.613+0000 7fe311254700 1 -- 172.21.15.26:0/1761947918 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe30c0f6350 con 0x7fe30c0f5340 2021-11-03T17:05:12.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.614+0000 7fe3037fe700 1 -- 172.21.15.26:0/1761947918 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2f4012cd0 con 0x7fe30c0f5340 2021-11-03T17:05:12.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.614+0000 7fe311254700 1 -- 172.21.15.26:0/1761947918 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe30c10f080 con 0x7fe30c0f5340 2021-11-03T17:05:12.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.614+0000 7fe311254700 1 -- 172.21.15.26:0/1761947918 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe30c045ad0 con 0x7fe30c0f5340 2021-11-03T17:05:12.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.615+0000 7fe3037fe700 1 -- 172.21.15.26:0/1761947918 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fe2f4010070 con 0x7fe30c0f5340 2021-11-03T17:05:12.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.616+0000 7fe3037fe700 1 --2- 172.21.15.26:0/1761947918 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe2f80640b0 0x7fe2f8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:05:12.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.616+0000 7fe30ad9d700 1 --2- 172.21.15.26:0/1761947918 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe2f80640b0 0x7fe2f8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:05:12.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.616+0000 7fe3037fe700 1 -- 172.21.15.26:0/1761947918 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fe2f40806c0 con 0x7fe30c0f5340 2021-11-03T17:05:12.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.616+0000 7fe30ad9d700 1 --2- 172.21.15.26:0/1761947918 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe2f80640b0 0x7fe2f8066570 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fe2fc009da0 tx=0x7fe2fc009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:05:12.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.620+0000 7fe3037fe700 1 -- 172.21.15.26:0/1761947918 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fe2f4052930 con 0x7fe30c0f5340 2021-11-03T17:05:12.822 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.827+0000 7fe311254700 1 -- 172.21.15.26:0/1761947918 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe30c0586e0 con 0x7fe30c0f5340 2021-11-03T17:05:12.822 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.827+0000 7fe3037fe700 1 -- 172.21.15.26:0/1761947918 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fe2f4052520 con 0x7fe30c0f5340 2021-11-03T17:05:12.823 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:05:12.823 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:05:12.823 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:05:12.824 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:05:12.824 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:05:12.824 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:05:12.824 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:05:12.825 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:05:12.825 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:05:12.826 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:05:12.826 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:05:12.826 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:05:12.827 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:05:12.827 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:05:12.827 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:05:12.827 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:05:12.827 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:05:12.828 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:05:12.828 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:05:12.828 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:05:12.828 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:05:12.829 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:05:12.829 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:05:12.829 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:05:12.829 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:05:12.830 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:05:12.830 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:05:12.830 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:05:12.830 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:05:12.830 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:05:12.831 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:05:12.831 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:05:12.831 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:05:12.831 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:05:12.832 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:05:12.832 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:05:12.832 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:05:12.832 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:05:12.832 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:05:12.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.829+0000 7fe311254700 1 -- 172.21.15.26:0/1761947918 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe2f80640b0 msgr2=0x7fe2f8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:05:12.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.829+0000 7fe311254700 1 --2- 172.21.15.26:0/1761947918 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe2f80640b0 0x7fe2f8066570 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fe2fc009da0 tx=0x7fe2fc009b30).stop 2021-11-03T17:05:12.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.829+0000 7fe311254700 1 -- 172.21.15.26:0/1761947918 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe30c0f5340 msgr2=0x7fe30c0f59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:05:12.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.829+0000 7fe311254700 1 --2- 172.21.15.26:0/1761947918 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe30c0f5340 0x7fe30c0f59d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7fe2f400c510 tx=0x7fe2f4007df0).stop 2021-11-03T17:05:12.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.829+0000 7fe311254700 1 -- 172.21.15.26:0/1761947918 shutdown_connections 2021-11-03T17:05:12.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.829+0000 7fe311254700 1 --2- 172.21.15.26:0/1761947918 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe2f80640b0 0x7fe2f8066570 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:12.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.829+0000 7fe311254700 1 --2- 172.21.15.26:0/1761947918 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe30c0f49a0 0x7fe30c0f7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:12.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.829+0000 7fe311254700 1 --2- 172.21.15.26:0/1761947918 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe30c0f5340 0x7fe30c0f59d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:12.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.829+0000 7fe311254700 1 -- 172.21.15.26:0/1761947918 >> 172.21.15.26:0/1761947918 conn(0x7fe30c0f04c0 msgr2=0x7fe30c0fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:05:12.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.829+0000 7fe311254700 1 -- 172.21.15.26:0/1761947918 shutdown_connections 2021-11-03T17:05:12.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:12.829+0000 7fe311254700 1 -- 172.21.15.26:0/1761947918 wait complete. 2021-11-03T17:05:12.836 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:05:13.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:13 smithi026 ceph-mon[96795]: from='client.34460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:05:13.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:13 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:05:13.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:13 smithi026 ceph-mon[96795]: from='client.34464 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:05:13.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:13 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1744602395' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:05:13.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:13 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1761947918' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:05:13.471 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:13 smithi194 ceph-mon[65619]: from='client.34460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:05:13.471 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:13 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:05:13.471 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:13 smithi194 ceph-mon[65619]: from='client.34464 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:05:13.471 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:13 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1744602395' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:05:13.472 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:13 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1761947918' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:05:14.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:14 smithi026 ceph-mon[96795]: pgmap v317: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:14.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:14 smithi194 ceph-mon[65619]: pgmap v317: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:16.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:16 smithi026 ceph-mon[96795]: pgmap v318: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:16.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:16 smithi194 ceph-mon[65619]: pgmap v318: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:18.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:18 smithi026 ceph-mon[96795]: pgmap v319: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:18.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:18 smithi194 ceph-mon[65619]: pgmap v319: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:20.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:20 smithi026 ceph-mon[96795]: pgmap v320: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:20.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:20 smithi194 ceph-mon[65619]: pgmap v320: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:22.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:22 smithi026 ceph-mon[96795]: pgmap v321: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:22.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:22 smithi194 ceph-mon[65619]: pgmap v321: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:24.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:24 smithi026 ceph-mon[96795]: pgmap v322: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:24.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:24 smithi194 ceph-mon[65619]: pgmap v322: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:26.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:26 smithi026 ceph-mon[96795]: pgmap v323: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:26.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:26 smithi194 ceph-mon[65619]: pgmap v323: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:27.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:27 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:05:27.460 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:27 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:05:28.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:28 smithi026 ceph-mon[96795]: pgmap v324: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:28.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:28 smithi026 ceph-mon[96795]: poll took 60067.669 ms: 1 events 2021-11-03T17:05:28.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:05:28.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:05:28.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:05:28.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:05:28.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:05:28.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:05:28.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:05:28.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:28 smithi194 ceph-mon[65619]: pgmap v324: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:28.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:28 smithi194 ceph-mon[65619]: poll took 60067.669 ms: 1 events 2021-11-03T17:05:28.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:05:28.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:05:28.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:05:28.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:05:28.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:05:28.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:05:28.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:05:29.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:29 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:05:29.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:29 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:05:29.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:29 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:05:29.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:29 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:05:30.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:30 smithi026 ceph-mon[96795]: pgmap v325: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:30.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:30 smithi194 ceph-mon[65619]: pgmap v325: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:32.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:32 smithi026 ceph-mon[96795]: pgmap v326: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:32.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:32 smithi194 ceph-mon[65619]: pgmap v326: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:34.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:34 smithi026 ceph-mon[96795]: pgmap v327: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:34.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:34 smithi194 ceph-mon[65619]: pgmap v327: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:36.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:36 smithi026 ceph-mon[96795]: pgmap v328: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:36.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:36 smithi194 ceph-mon[65619]: pgmap v328: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:38.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:38 smithi026 ceph-mon[96795]: pgmap v329: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:38.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:38 smithi194 ceph-mon[65619]: pgmap v329: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:40.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:40 smithi026 ceph-mon[96795]: pgmap v330: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:40.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:40 smithi194 ceph-mon[65619]: pgmap v330: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:42.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:42 smithi026 ceph-mon[96795]: pgmap v331: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:42.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:42 smithi194 ceph-mon[65619]: pgmap v331: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:42.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:42.943+0000 7f59e5fd0700 1 -- 172.21.15.26:0/2781062789 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59e00f55c0 msgr2=0x7f59e00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:05:42.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:42.943+0000 7f59e5fd0700 1 --2- 172.21.15.26:0/2781062789 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59e00f55c0 0x7f59e00f59e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f59d0004660 tx=0x7f59d0009b30).stop 2021-11-03T17:05:42.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:42.943+0000 7f59e5fd0700 1 -- 172.21.15.26:0/2781062789 shutdown_connections 2021-11-03T17:05:42.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:42.943+0000 7f59e5fd0700 1 --2- 172.21.15.26:0/2781062789 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59e00f6860 0x7f59e00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:42.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:42.943+0000 7f59e5fd0700 1 --2- 172.21.15.26:0/2781062789 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59e00f55c0 0x7f59e00f59e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:42.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:42.943+0000 7f59e5fd0700 1 -- 172.21.15.26:0/2781062789 >> 172.21.15.26:0/2781062789 conn(0x7f59e00f0d40 msgr2=0x7f59e00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:05:42.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:42.943+0000 7f59e5fd0700 1 -- 172.21.15.26:0/2781062789 shutdown_connections 2021-11-03T17:05:42.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:42.943+0000 7f59e5fd0700 1 -- 172.21.15.26:0/2781062789 wait complete. 2021-11-03T17:05:42.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:42.944+0000 7f59e5fd0700 1 Processor -- start 2021-11-03T17:05:42.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:42.944+0000 7f59e5fd0700 1 -- start start 2021-11-03T17:05:42.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:42.944+0000 7f59e5fd0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59e00f55c0 0x7f59e0106f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:05:42.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:42.944+0000 7f59e5fd0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59e00f6860 0x7f59e0107420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:05:42.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:42.944+0000 7f59e5fd0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e01079d0 con 0x7f59e00f55c0 2021-11-03T17:05:42.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:42.944+0000 7f59e5fd0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e0107b10 con 0x7f59e00f6860 2021-11-03T17:05:42.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:42.945+0000 7f59df7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59e00f55c0 0x7f59e0106f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:05:42.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:42.945+0000 7f59df7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59e00f55c0 0x7f59e0106f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52418/0 (socket says 172.21.15.26:52418) 2021-11-03T17:05:42.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:42.945+0000 7f59df7fe700 1 -- 172.21.15.26:0/3135641267 learned_addr learned my addr 172.21.15.26:0/3135641267 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:05:42.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:42.945+0000 7f59deffd700 1 --2- 172.21.15.26:0/3135641267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59e00f6860 0x7f59e0107420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:05:42.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:42.945+0000 7f59df7fe700 1 -- 172.21.15.26:0/3135641267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59e00f6860 msgr2=0x7f59e0107420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:05:42.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:42.945+0000 7f59df7fe700 1 --2- 172.21.15.26:0/3135641267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59e00f6860 0x7f59e0107420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:42.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:42.945+0000 7f59df7fe700 1 -- 172.21.15.26:0/3135641267 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d0005040 con 0x7f59e00f55c0 2021-11-03T17:05:42.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:42.945+0000 7f59df7fe700 1 --2- 172.21.15.26:0/3135641267 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59e00f55c0 0x7f59e0106f30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f59d0013a70 tx=0x7f59d0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:05:42.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:42.945+0000 7f59c7fff700 1 -- 172.21.15.26:0/3135641267 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59d0018070 con 0x7f59e00f55c0 2021-11-03T17:05:42.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:42.945+0000 7f59c7fff700 1 -- 172.21.15.26:0/3135641267 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f59d00097d0 con 0x7f59e00f55c0 2021-11-03T17:05:42.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:42.945+0000 7f59e5fd0700 1 -- 172.21.15.26:0/3135641267 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59e0108450 con 0x7f59e00f55c0 2021-11-03T17:05:42.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:42.945+0000 7f59c7fff700 1 -- 172.21.15.26:0/3135641267 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59d001c3c0 con 0x7f59e00f55c0 2021-11-03T17:05:42.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:42.945+0000 7f59e5fd0700 1 -- 172.21.15.26:0/3135641267 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59e01089b0 con 0x7f59e00f55c0 2021-11-03T17:05:42.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:42.946+0000 7f59e5fd0700 1 -- 172.21.15.26:0/3135641267 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59e0045ad0 con 0x7f59e00f55c0 2021-11-03T17:05:42.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:42.947+0000 7f59c7fff700 1 -- 172.21.15.26:0/3135641267 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f59d0007ba0 con 0x7f59e00f55c0 2021-11-03T17:05:42.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:42.947+0000 7f59c7fff700 1 --2- 172.21.15.26:0/3135641267 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f59c80640b0 0x7f59c8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:05:42.950 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:42.947+0000 7f59c7fff700 1 -- 172.21.15.26:0/3135641267 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f59d0082470 con 0x7f59e00f55c0 2021-11-03T17:05:42.950 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:42.947+0000 7f59deffd700 1 --2- 172.21.15.26:0/3135641267 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f59c80640b0 0x7f59c8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:05:42.950 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:42.948+0000 7f59deffd700 1 --2- 172.21.15.26:0/3135641267 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f59c80640b0 0x7f59c8066570 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f59d4009740 tx=0x7f59d4009c60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:05:42.951 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:42.952+0000 7f59c7fff700 1 -- 172.21.15.26:0/3135641267 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f59d00547d0 con 0x7f59e00f55c0 2021-11-03T17:05:43.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.129+0000 7f59e5fd0700 1 -- 172.21.15.26:0/3135641267 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f59e00faca0 con 0x7f59c80640b0 2021-11-03T17:05:43.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.130+0000 7f59c7fff700 1 -- 172.21.15.26:0/3135641267 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f59e00faca0 con 0x7f59c80640b0 2021-11-03T17:05:43.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.132+0000 7f59e5fd0700 1 -- 172.21.15.26:0/3135641267 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f59c80640b0 msgr2=0x7f59c8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:05:43.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.132+0000 7f59e5fd0700 1 --2- 172.21.15.26:0/3135641267 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f59c80640b0 0x7f59c8066570 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f59d4009740 tx=0x7f59d4009c60).stop 2021-11-03T17:05:43.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.132+0000 7f59e5fd0700 1 -- 172.21.15.26:0/3135641267 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59e00f55c0 msgr2=0x7f59e0106f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:05:43.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.132+0000 7f59e5fd0700 1 --2- 172.21.15.26:0/3135641267 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59e00f55c0 0x7f59e0106f30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f59d0013a70 tx=0x7f59d0009b30).stop 2021-11-03T17:05:43.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.132+0000 7f59e5fd0700 1 -- 172.21.15.26:0/3135641267 shutdown_connections 2021-11-03T17:05:43.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.132+0000 7f59e5fd0700 1 --2- 172.21.15.26:0/3135641267 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f59c80640b0 0x7f59c8066570 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:43.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.132+0000 7f59e5fd0700 1 --2- 172.21.15.26:0/3135641267 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59e00f55c0 0x7f59e0106f30 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:43.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.132+0000 7f59e5fd0700 1 --2- 172.21.15.26:0/3135641267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59e00f6860 0x7f59e0107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:43.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.132+0000 7f59e5fd0700 1 -- 172.21.15.26:0/3135641267 >> 172.21.15.26:0/3135641267 conn(0x7f59e00f0d40 msgr2=0x7f59e005ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:05:43.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.132+0000 7f59e5fd0700 1 -- 172.21.15.26:0/3135641267 shutdown_connections 2021-11-03T17:05:43.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.132+0000 7f59e5fd0700 1 -- 172.21.15.26:0/3135641267 wait complete. 2021-11-03T17:05:43.138 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:05:43.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.234+0000 7f976fc17700 1 -- 172.21.15.26:0/2342954411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97680f5fe0 msgr2=0x7f97680f6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:05:43.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.234+0000 7f976fc17700 1 --2- 172.21.15.26:0/2342954411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97680f5fe0 0x7f97680f6460 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f9764004660 tx=0x7f9764009b30).stop 2021-11-03T17:05:43.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.234+0000 7f976fc17700 1 -- 172.21.15.26:0/2342954411 shutdown_connections 2021-11-03T17:05:43.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.234+0000 7f976fc17700 1 --2- 172.21.15.26:0/2342954411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97680f5fe0 0x7f97680f6460 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:43.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.234+0000 7f976fc17700 1 --2- 172.21.15.26:0/2342954411 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97680f4de0 0x7f97680f5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:43.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.234+0000 7f976fc17700 1 -- 172.21.15.26:0/2342954411 >> 172.21.15.26:0/2342954411 conn(0x7f97680f0540 msgr2=0x7f97680f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:05:43.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.234+0000 7f976fc17700 1 -- 172.21.15.26:0/2342954411 shutdown_connections 2021-11-03T17:05:43.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.234+0000 7f976fc17700 1 -- 172.21.15.26:0/2342954411 wait complete. 2021-11-03T17:05:43.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.234+0000 7f976fc17700 1 Processor -- start 2021-11-03T17:05:43.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.235+0000 7f976fc17700 1 -- start start 2021-11-03T17:05:43.235 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.235+0000 7f976fc17700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97680f4de0 0x7f9768106f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:05:43.235 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.235+0000 7f976fc17700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97680f5fe0 0x7f9768107420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:05:43.235 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.235+0000 7f976fc17700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97681079d0 con 0x7f97680f5fe0 2021-11-03T17:05:43.235 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.235+0000 7f976fc17700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9768107b10 con 0x7f97680f4de0 2021-11-03T17:05:43.236 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.235+0000 7f976d1b2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97680f5fe0 0x7f9768107420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:05:43.236 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.235+0000 7f976d1b2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97680f5fe0 0x7f9768107420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52430/0 (socket says 172.21.15.26:52430) 2021-11-03T17:05:43.236 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.235+0000 7f976d1b2700 1 -- 172.21.15.26:0/2363775323 learned_addr learned my addr 172.21.15.26:0/2363775323 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:05:43.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.235+0000 7f976d9b3700 1 --2- 172.21.15.26:0/2363775323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97680f4de0 0x7f9768106f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:05:43.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.235+0000 7f976d1b2700 1 -- 172.21.15.26:0/2363775323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97680f4de0 msgr2=0x7f9768106f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:05:43.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.235+0000 7f976d1b2700 1 --2- 172.21.15.26:0/2363775323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97680f4de0 0x7f9768106f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:43.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.235+0000 7f976d1b2700 1 -- 172.21.15.26:0/2363775323 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9764005040 con 0x7f97680f5fe0 2021-11-03T17:05:43.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.235+0000 7f976d9b3700 1 --2- 172.21.15.26:0/2363775323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97680f4de0 0x7f9768106f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:05:43.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.235+0000 7f976d1b2700 1 --2- 172.21.15.26:0/2363775323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97680f5fe0 0x7f9768107420 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f9764009990 tx=0x7f9764009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:05:43.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.235+0000 7f975e7fc700 1 -- 172.21.15.26:0/2363775323 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9764018070 con 0x7f97680f5fe0 2021-11-03T17:05:43.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.235+0000 7f975e7fc700 1 -- 172.21.15.26:0/2363775323 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9764007ba0 con 0x7f97680f5fe0 2021-11-03T17:05:43.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.235+0000 7f976fc17700 1 -- 172.21.15.26:0/2363775323 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9768108450 con 0x7f97680f5fe0 2021-11-03T17:05:43.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.235+0000 7f975e7fc700 1 -- 172.21.15.26:0/2363775323 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f976401c3c0 con 0x7f97680f5fe0 2021-11-03T17:05:43.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.236+0000 7f976fc17700 1 -- 172.21.15.26:0/2363775323 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97681089b0 con 0x7f97680f5fe0 2021-11-03T17:05:43.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.237+0000 7f976fc17700 1 -- 172.21.15.26:0/2363775323 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9768045ad0 con 0x7f97680f5fe0 2021-11-03T17:05:43.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.237+0000 7f975e7fc700 1 -- 172.21.15.26:0/2363775323 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f976401d420 con 0x7f97680f5fe0 2021-11-03T17:05:43.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.237+0000 7f975e7fc700 1 --2- 172.21.15.26:0/2363775323 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f97540640b0 0x7f9754066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:05:43.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.237+0000 7f975e7fc700 1 -- 172.21.15.26:0/2363775323 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f97640823e0 con 0x7f97680f5fe0 2021-11-03T17:05:43.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.237+0000 7f976d9b3700 1 --2- 172.21.15.26:0/2363775323 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f97540640b0 0x7f9754066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:05:43.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.238+0000 7f976d9b3700 1 --2- 172.21.15.26:0/2363775323 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f97540640b0 0x7f9754066570 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f975800a700 tx=0x7f9758009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:05:43.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.241+0000 7f975e7fc700 1 -- 172.21.15.26:0/2363775323 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f97640547a0 con 0x7f97680f5fe0 2021-11-03T17:05:43.409 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.413+0000 7f976fc17700 1 -- 172.21.15.26:0/2363775323 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9768108c20 con 0x7f97540640b0 2021-11-03T17:05:43.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:43 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:05:43.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.428+0000 7f975e7fc700 1 -- 172.21.15.26:0/2363775323 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f9768108c20 con 0x7f97540640b0 2021-11-03T17:05:43.424 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:05:43.424 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (16m) 7m ago 18m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:05:43.424 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (9m) 7m ago 18m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:05:43.425 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (9m) 6m ago 17m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:05:43.425 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (16m) 7m ago 17m 38.9M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:05:43.425 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (9m) 7m ago 13m 13.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:05:43.425 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (10m) 7m ago 13m 14.7M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:05:43.425 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (13m) 6m ago 13m 16.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:05:43.426 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (13m) 6m ago 13m 16.5M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:05:43.426 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (10m) 7m ago 19m 468M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:05:43.426 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (10m) 6m ago 17m 412M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:05:43.426 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (10m) 7m ago 19m 75.8M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:05:43.427 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (9m) 6m ago 17m 66.4M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:05:43.427 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (17m) 7m ago 17m 18.1M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:05:43.427 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (17m) 6m ago 17m 18.3M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:05:43.427 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (8m) 7m ago 16m 153M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:05:43.428 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (8m) 7m ago 16m 166M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:05:43.428 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (7m) 7m ago 15m 11.2M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:05:43.428 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (7m) 6m ago 15m 181M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:05:43.428 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (6m) 6m ago 15m 185M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:05:43.428 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (6m) 6m ago 14m 13.5M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:05:43.429 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (16m) 7m ago 17m 47.5M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:05:43.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.430+0000 7f976fc17700 1 -- 172.21.15.26:0/2363775323 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f97540640b0 msgr2=0x7f9754066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:05:43.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.430+0000 7f976fc17700 1 --2- 172.21.15.26:0/2363775323 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f97540640b0 0x7f9754066570 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f975800a700 tx=0x7f9758009040).stop 2021-11-03T17:05:43.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.430+0000 7f976fc17700 1 -- 172.21.15.26:0/2363775323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97680f5fe0 msgr2=0x7f9768107420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:05:43.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.430+0000 7f976fc17700 1 --2- 172.21.15.26:0/2363775323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97680f5fe0 0x7f9768107420 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f9764009990 tx=0x7f9764009b30).stop 2021-11-03T17:05:43.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.430+0000 7f976fc17700 1 -- 172.21.15.26:0/2363775323 shutdown_connections 2021-11-03T17:05:43.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.430+0000 7f976fc17700 1 --2- 172.21.15.26:0/2363775323 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f97540640b0 0x7f9754066570 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:43.432 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.430+0000 7f976fc17700 1 --2- 172.21.15.26:0/2363775323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97680f4de0 0x7f9768106f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:43.432 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.430+0000 7f976fc17700 1 --2- 172.21.15.26:0/2363775323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97680f5fe0 0x7f9768107420 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:43.432 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.430+0000 7f976fc17700 1 -- 172.21.15.26:0/2363775323 >> 172.21.15.26:0/2363775323 conn(0x7f97680f0540 msgr2=0x7f97680f9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:05:43.433 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.430+0000 7f976fc17700 1 -- 172.21.15.26:0/2363775323 shutdown_connections 2021-11-03T17:05:43.433 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.430+0000 7f976fc17700 1 -- 172.21.15.26:0/2363775323 wait complete. 2021-11-03T17:05:43.470 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:43 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:05:43.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.529+0000 7f63e4506700 1 -- 172.21.15.26:0/3868349335 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63dc0f5ef0 msgr2=0x7f63dc0f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:05:43.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.529+0000 7f63e4506700 1 --2- 172.21.15.26:0/3868349335 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63dc0f5ef0 0x7f63dc0f6920 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f63d0004660 tx=0x7f63d0009b30).stop 2021-11-03T17:05:43.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.529+0000 7f63e4506700 1 -- 172.21.15.26:0/3868349335 shutdown_connections 2021-11-03T17:05:43.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.529+0000 7f63e4506700 1 --2- 172.21.15.26:0/3868349335 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63dc0f5ef0 0x7f63dc0f6920 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:43.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.529+0000 7f63e4506700 1 --2- 172.21.15.26:0/3868349335 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63dc0f55e0 0x7f63dc0f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:05:43.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.529+0000 7f63e4506700 1 -- 172.21.15.26:0/3868349335 >> 172.21.15.26:0/3868349335 conn(0x7f63dc0f0de0 msgr2=0x7f63dc0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:05:43.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.529+0000 7f63e4506700 1 -- 172.21.15.26:0/3868349335 shutdown_connections 2021-11-03T17:05:43.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.529+0000 7f63e4506700 1 -- 172.21.15.26:0/3868349335 wait complete. 2021-11-03T17:05:43.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.529+0000 7f63e4506700 1 Processor -- start 2021-11-03T17:05:43.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.529+0000 7f63e4506700 1 -- start start 2021-11-03T17:05:43.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.530+0000 7f63e4506700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63dc0f55e0 0x7f63dc109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:05:43.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.530+0000 7f63e4506700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63dc0f5ef0 0x7f63dc10c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:05:43.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.530+0000 7f63e4506700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63dc0605b0 con 0x7f63dc0f55e0 2021-11-03T17:05:43.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.530+0000 7f63e4506700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63dc0606f0 con 0x7f63dc0f5ef0 2021-11-03T17:05:43.530 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.530+0000 7f63e22a2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63dc0f55e0 0x7f63dc109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:05:43.530 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.530+0000 7f63e22a2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63dc0f55e0 0x7f63dc109c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52438/0 (socket says 172.21.15.26:52438) 2021-11-03T17:05:43.530 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.530+0000 7f63e22a2700 1 -- 172.21.15.26:0/2795030912 learned_addr learned my addr 172.21.15.26:0/2795030912 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:05:43.530 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.530+0000 7f63e22a2700 1 -- 172.21.15.26:0/2795030912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63dc0f5ef0 msgr2=0x7f63dc10c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:05:43.531 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.530+0000 7f63e22a2700 1 --2- 172.21.15.26:0/2795030912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63dc0f5ef0 0x7f63dc10c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:05:43.531 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.530+0000 7f63e22a2700 1 -- 172.21.15.26:0/2795030912 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d0005040 con 0x7f63dc0f55e0 2021-11-03T17:05:43.531 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.530+0000 7f63e22a2700 1 --2- 172.21.15.26:0/2795030912 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63dc0f55e0 0x7f63dc109c50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f63d400b790 tx=0x7f63d40092d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:05:43.531 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.530+0000 7f63daffd700 1 -- 172.21.15.26:0/2795030912 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63d400d780 con 0x7f63dc0f55e0 2021-11-03T17:05:43.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.530+0000 7f63e4506700 1 -- 172.21.15.26:0/2795030912 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63dc10c7b0 con 0x7f63dc0f55e0 2021-11-03T17:05:43.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.530+0000 7f63daffd700 1 -- 172.21.15.26:0/2795030912 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f63d400dd90 con 0x7f63dc0f55e0 2021-11-03T17:05:43.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.530+0000 7f63daffd700 1 -- 172.21.15.26:0/2795030912 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63d400e360 con 0x7f63dc0f55e0 2021-11-03T17:05:43.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.530+0000 7f63e4506700 1 -- 172.21.15.26:0/2795030912 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63dc10cd70 con 0x7f63dc0f55e0 2021-11-03T17:05:43.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.531+0000 7f63e4506700 1 -- 172.21.15.26:0/2795030912 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63dc045ad0 con 0x7f63dc0f55e0 2021-11-03T17:05:43.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.532+0000 7f63daffd700 1 -- 172.21.15.26:0/2795030912 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f63d400d8e0 con 0x7f63dc0f55e0 2021-11-03T17:05:43.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.532+0000 7f63daffd700 1 --2- 172.21.15.26:0/2795030912 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f63c40640b0 0x7f63c4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:05:43.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.532+0000 7f63daffd700 1 -- 172.21.15.26:0/2795030912 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f63d40812f0 con 0x7f63dc0f55e0 2021-11-03T17:05:43.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.532+0000 7f63e1aa1700 1 --2- 172.21.15.26:0/2795030912 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f63c40640b0 0x7f63c4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:05:43.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.533+0000 7f63e1aa1700 1 --2- 172.21.15.26:0/2795030912 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f63c40640b0 0x7f63c4066570 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f63d0004e30 tx=0x7f63d0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:05:43.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.536+0000 7f63daffd700 1 -- 172.21.15.26:0/2795030912 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f63d4053560 con 0x7f63dc0f55e0 2021-11-03T17:05:43.763 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.767+0000 7f63e4506700 1 -- 172.21.15.26:0/2795030912 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f63dc0586e0 con 0x7f63dc0f55e0 2021-11-03T17:05:43.764 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.767+0000 7f63daffd700 1 -- 172.21.15.26:0/2795030912 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f63d4053150 con 0x7f63dc0f55e0 2021-11-03T17:05:43.764 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:05:43.764 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:05:43.764 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:05:43.765 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:05:43.765 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:05:43.765 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:05:43.765 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:05:43.766 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:05:43.766 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:05:43.766 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:05:43.766 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:05:43.767 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:05:43.767 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:05:43.767 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:05:43.767 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:05:43.767 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:05:43.768 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:05:43.768 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:05:43.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.769+0000 7f63e4506700 1 -- 172.21.15.26:0/2795030912 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f63c40640b0 msgr2=0x7f63c4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:05:43.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.769+0000 7f63e4506700 1 --2- 172.21.15.26:0/2795030912 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f63c40640b0 0x7f63c4066570 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f63d0004e30 tx=0x7f63d0009b30).stop 2021-11-03T17:05:43.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.769+0000 7f63e4506700 1 -- 172.21.15.26:0/2795030912 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63dc0f55e0 msgr2=0x7f63dc109c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:05:43.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.769+0000 7f63e4506700 1 --2- 172.21.15.26:0/2795030912 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63dc0f55e0 0x7f63dc109c50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f63d400b790 tx=0x7f63d40092d0).stop 2021-11-03T17:05:43.770 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.770+0000 7f63e4506700 1 -- 172.21.15.26:0/2795030912 shutdown_connections 2021-11-03T17:05:43.770 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.770+0000 7f63e4506700 1 --2- 172.21.15.26:0/2795030912 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f63c40640b0 0x7f63c4066570 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:43.770 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.770+0000 7f63e4506700 1 --2- 172.21.15.26:0/2795030912 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63dc0f55e0 0x7f63dc109c50 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:43.770 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.770+0000 7f63e4506700 1 --2- 172.21.15.26:0/2795030912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63dc0f5ef0 0x7f63dc10c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:05:43.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.770+0000 7f63e4506700 1 -- 172.21.15.26:0/2795030912 >> 172.21.15.26:0/2795030912 conn(0x7f63dc0f0de0 msgr2=0x7f63dc0fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:05:43.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.770+0000 7f63e4506700 1 -- 172.21.15.26:0/2795030912 shutdown_connections 2021-11-03T17:05:43.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.770+0000 7f63e4506700 1 -- 172.21.15.26:0/2795030912 wait complete. 2021-11-03T17:05:43.867 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.870+0000 7fb35fc51700 1 -- 172.21.15.26:0/2094338521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3580f74a0 msgr2=0x7fb3580f5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:05:43.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.870+0000 7fb35fc51700 1 --2- 172.21.15.26:0/2094338521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3580f74a0 0x7fb3580f5930 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7fb34c004660 tx=0x7fb34c009b30).stop 2021-11-03T17:05:43.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.870+0000 7fb35fc51700 1 -- 172.21.15.26:0/2094338521 shutdown_connections 2021-11-03T17:05:43.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.870+0000 7fb35fc51700 1 --2- 172.21.15.26:0/2094338521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3580f74a0 0x7fb3580f5930 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:43.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.870+0000 7fb35fc51700 1 --2- 172.21.15.26:0/2094338521 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3580f6b90 0x7fb3580f6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:43.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.870+0000 7fb35fc51700 1 -- 172.21.15.26:0/2094338521 >> 172.21.15.26:0/2094338521 conn(0x7fb3580f0540 msgr2=0x7fb3580f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:05:43.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.870+0000 7fb35fc51700 1 -- 172.21.15.26:0/2094338521 shutdown_connections 2021-11-03T17:05:43.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.870+0000 7fb35fc51700 1 -- 172.21.15.26:0/2094338521 wait complete. 2021-11-03T17:05:43.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.871+0000 7fb35fc51700 1 Processor -- start 2021-11-03T17:05:43.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.871+0000 7fb35fc51700 1 -- start start 2021-11-03T17:05:43.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.871+0000 7fb35fc51700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3580f6b90 0x7fb358105e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:05:43.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.871+0000 7fb35fc51700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3580f74a0 0x7fb358106370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:05:43.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.871+0000 7fb35fc51700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb358106920 con 0x7fb3580f74a0 2021-11-03T17:05:43.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.871+0000 7fb35fc51700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb358106a60 con 0x7fb3580f6b90 2021-11-03T17:05:43.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.871+0000 7fb35d1ec700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3580f74a0 0x7fb358106370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:05:43.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.871+0000 7fb35d1ec700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3580f74a0 0x7fb358106370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52452/0 (socket says 172.21.15.26:52452) 2021-11-03T17:05:43.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.871+0000 7fb35d1ec700 1 -- 172.21.15.26:0/2090626610 learned_addr learned my addr 172.21.15.26:0/2090626610 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:05:43.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.871+0000 7fb35d9ed700 1 --2- 172.21.15.26:0/2090626610 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3580f6b90 0x7fb358105e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:05:43.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.872+0000 7fb35d1ec700 1 -- 172.21.15.26:0/2090626610 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3580f6b90 msgr2=0x7fb358105e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:05:43.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.872+0000 7fb35d1ec700 1 --2- 172.21.15.26:0/2090626610 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3580f6b90 0x7fb358105e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:43.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.872+0000 7fb35d1ec700 1 -- 172.21.15.26:0/2090626610 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb34c005040 con 0x7fb3580f74a0 2021-11-03T17:05:43.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.872+0000 7fb35d1ec700 1 --2- 172.21.15.26:0/2090626610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3580f74a0 0x7fb358106370 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fb34c009830 tx=0x7fb34c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:05:43.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.872+0000 7fb34a7fc700 1 -- 172.21.15.26:0/2090626610 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb34c018070 con 0x7fb3580f74a0 2021-11-03T17:05:43.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.872+0000 7fb34a7fc700 1 -- 172.21.15.26:0/2090626610 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb34c007ba0 con 0x7fb3580f74a0 2021-11-03T17:05:43.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.872+0000 7fb35fc51700 1 -- 172.21.15.26:0/2090626610 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3581073a0 con 0x7fb3580f74a0 2021-11-03T17:05:43.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.872+0000 7fb34a7fc700 1 -- 172.21.15.26:0/2090626610 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb34c01c3c0 con 0x7fb3580f74a0 2021-11-03T17:05:43.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.872+0000 7fb35fc51700 1 -- 172.21.15.26:0/2090626610 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb358107900 con 0x7fb3580f74a0 2021-11-03T17:05:43.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.873+0000 7fb35fc51700 1 -- 172.21.15.26:0/2090626610 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb358045ad0 con 0x7fb3580f74a0 2021-11-03T17:05:43.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.873+0000 7fb34a7fc700 1 -- 172.21.15.26:0/2090626610 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fb34c01d420 con 0x7fb3580f74a0 2021-11-03T17:05:43.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.874+0000 7fb34a7fc700 1 --2- 172.21.15.26:0/2090626610 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb344064090 0x7fb344066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:05:43.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.874+0000 7fb34a7fc700 1 -- 172.21.15.26:0/2090626610 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fb34c0822f0 con 0x7fb3580f74a0 2021-11-03T17:05:43.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.874+0000 7fb35d9ed700 1 --2- 172.21.15.26:0/2090626610 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb344064090 0x7fb344066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:05:43.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.874+0000 7fb35d9ed700 1 --2- 172.21.15.26:0/2090626610 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb344064090 0x7fb344066550 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fb35805f250 tx=0x7fb35400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:05:43.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:43.878+0000 7fb34a7fc700 1 -- 172.21.15.26:0/2090626610 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fb34c054650 con 0x7fb3580f74a0 2021-11-03T17:05:44.075 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:44.079+0000 7fb35fc51700 1 -- 172.21.15.26:0/2090626610 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb358027a00 con 0x7fb3580f74a0 2021-11-03T17:05:44.076 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:44.080+0000 7fb34a7fc700 1 -- 172.21.15.26:0/2090626610 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fb34c054240 con 0x7fb3580f74a0 2021-11-03T17:05:44.076 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:05:44.076 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:05:44.077 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:05:44.077 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:05:44.078 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:05:44.078 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:05:44.078 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:05:44.079 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:05:44.079 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:05:44.079 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:05:44.079 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:05:44.080 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:05:44.080 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:05:44.080 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:05:44.080 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:05:44.081 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:05:44.081 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:05:44.081 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:05:44.081 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:05:44.082 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:05:44.082 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:05:44.082 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:05:44.082 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:05:44.083 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:05:44.084 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:05:44.084 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:05:44.085 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:05:44.085 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:05:44.085 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:05:44.085 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:05:44.086 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:05:44.086 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:05:44.086 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:05:44.086 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:05:44.087 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:05:44.087 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:05:44.087 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:05:44.088 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:05:44.088 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:05:44.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:44.082+0000 7fb35fc51700 1 -- 172.21.15.26:0/2090626610 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb344064090 msgr2=0x7fb344066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:05:44.090 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:44.082+0000 7fb35fc51700 1 --2- 172.21.15.26:0/2090626610 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb344064090 0x7fb344066550 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fb35805f250 tx=0x7fb35400b040).stop 2021-11-03T17:05:44.090 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:44.082+0000 7fb35fc51700 1 -- 172.21.15.26:0/2090626610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3580f74a0 msgr2=0x7fb358106370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:05:44.090 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:44.082+0000 7fb35fc51700 1 --2- 172.21.15.26:0/2090626610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3580f74a0 0x7fb358106370 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fb34c009830 tx=0x7fb34c009b30).stop 2021-11-03T17:05:44.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:44.082+0000 7fb35fc51700 1 -- 172.21.15.26:0/2090626610 shutdown_connections 2021-11-03T17:05:44.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:44.082+0000 7fb35fc51700 1 --2- 172.21.15.26:0/2090626610 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb344064090 0x7fb344066550 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:44.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:44.082+0000 7fb35fc51700 1 --2- 172.21.15.26:0/2090626610 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3580f6b90 0x7fb358105e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:44.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:44.082+0000 7fb35fc51700 1 --2- 172.21.15.26:0/2090626610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3580f74a0 0x7fb358106370 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:05:44.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:44.082+0000 7fb35fc51700 1 -- 172.21.15.26:0/2090626610 >> 172.21.15.26:0/2090626610 conn(0x7fb3580f0540 msgr2=0x7fb3580fa390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:05:44.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:44.082+0000 7fb35fc51700 1 -- 172.21.15.26:0/2090626610 shutdown_connections 2021-11-03T17:05:44.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:05:44.082+0000 7fb35fc51700 1 -- 172.21.15.26:0/2090626610 wait complete. 2021-11-03T17:05:44.092 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:05:44.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:44 smithi194 ceph-mon[65619]: pgmap v332: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:44.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:44 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:05:44.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:44 smithi194 ceph-mon[65619]: from='client.34476 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:05:44.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:44 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2795030912' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:05:44.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:44 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2090626610' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:05:44.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:44 smithi026 ceph-mon[96795]: pgmap v332: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:44.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:44 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:05:44.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:44 smithi026 ceph-mon[96795]: from='client.34476 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:05:44.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:44 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2795030912' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:05:44.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:44 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2090626610' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:05:45.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:45 smithi194 ceph-mon[65619]: from='client.34480 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:05:45.574 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:45 smithi026 ceph-mon[96795]: from='client.34480 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:05:46.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:46 smithi194 ceph-mon[65619]: pgmap v333: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:46.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:46 smithi026 ceph-mon[96795]: pgmap v333: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:48.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:48 smithi194 ceph-mon[65619]: pgmap v334: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:48.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:05:48.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:05:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:48 smithi026 ceph-mon[96795]: pgmap v334: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:48.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:05:48.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:05:50.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:50 smithi194 ceph-mon[65619]: pgmap v335: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:50.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:50 smithi026 ceph-mon[96795]: pgmap v335: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:52.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:52 smithi194 ceph-mon[65619]: pgmap v336: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:52.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:52 smithi026 ceph-mon[96795]: pgmap v336: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:54.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:54 smithi194 ceph-mon[65619]: pgmap v337: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:54.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:54 smithi026 ceph-mon[96795]: pgmap v337: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:56.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:56 smithi194 ceph-mon[65619]: pgmap v338: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:56.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:56 smithi026 ceph-mon[96795]: pgmap v338: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:58.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:58 smithi194 ceph-mon[65619]: pgmap v339: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:58.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:58 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:05:58.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:58 smithi026 ceph-mon[96795]: pgmap v339: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:05:58.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:58 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:05:59.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:05:59 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:05:59.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:05:59 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:06:00.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:00 smithi194 ceph-mon[65619]: pgmap v340: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:00.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:00 smithi026 ceph-mon[96795]: pgmap v340: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:02.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:02 smithi194 ceph-mon[65619]: pgmap v341: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:02.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:02 smithi026 ceph-mon[96795]: pgmap v341: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:04.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:04 smithi194 ceph-mon[65619]: pgmap v342: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:04.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:04 smithi026 ceph-mon[96795]: pgmap v342: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:06.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:06 smithi194 ceph-mon[65619]: pgmap v343: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:06.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:06 smithi026 ceph-mon[96795]: pgmap v343: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:08.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:08 smithi194 ceph-mon[65619]: pgmap v344: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:08.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:08 smithi026 ceph-mon[96795]: pgmap v344: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:10.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:10 smithi194 ceph-mon[65619]: pgmap v345: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:10.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:10 smithi026 ceph-mon[96795]: pgmap v345: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:12.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:12 smithi194 ceph-mon[65619]: pgmap v346: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:12.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:12 smithi026 ceph-mon[96795]: pgmap v346: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:13.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:13 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:06:13.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:13 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:06:14.195 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.198+0000 7f692c7c5700 1 -- 172.21.15.26:0/3183935874 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69240f66e0 msgr2=0x7f69240f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:06:14.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.198+0000 7f692c7c5700 1 --2- 172.21.15.26:0/3183935874 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69240f66e0 0x7f69240f6b00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f6920004660 tx=0x7f6920009b30).stop 2021-11-03T17:06:14.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.199+0000 7f692c7c5700 1 -- 172.21.15.26:0/3183935874 shutdown_connections 2021-11-03T17:06:14.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.199+0000 7f692c7c5700 1 --2- 172.21.15.26:0/3183935874 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69240f7980 0x7f69240f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:06:14.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.199+0000 7f692c7c5700 1 --2- 172.21.15.26:0/3183935874 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69240f66e0 0x7f69240f6b00 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:14.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.199+0000 7f692c7c5700 1 -- 172.21.15.26:0/3183935874 >> 172.21.15.26:0/3183935874 conn(0x7f69240f1e40 msgr2=0x7f69240f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:06:14.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.199+0000 7f692c7c5700 1 -- 172.21.15.26:0/3183935874 shutdown_connections 2021-11-03T17:06:14.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.199+0000 7f692c7c5700 1 -- 172.21.15.26:0/3183935874 wait complete. 2021-11-03T17:06:14.198 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.199+0000 7f692c7c5700 1 Processor -- start 2021-11-03T17:06:14.198 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.199+0000 7f692c7c5700 1 -- start start 2021-11-03T17:06:14.198 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.199+0000 7f692c7c5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69240f66e0 0x7f692406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:06:14.198 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.199+0000 7f692c7c5700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69240f7980 0x7f6924069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:06:14.198 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.199+0000 7f692c7c5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692406a410 con 0x7f69240f66e0 2021-11-03T17:06:14.199 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.199+0000 7f692c7c5700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692406a550 con 0x7f69240f7980 2021-11-03T17:06:14.199 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.200+0000 7f692a561700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69240f66e0 0x7f692406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:06:14.199 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.200+0000 7f692a561700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69240f66e0 0x7f692406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52484/0 (socket says 172.21.15.26:52484) 2021-11-03T17:06:14.199 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.200+0000 7f692a561700 1 -- 172.21.15.26:0/3410236000 learned_addr learned my addr 172.21.15.26:0/3410236000 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:06:14.200 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.200+0000 7f6929d60700 1 --2- 172.21.15.26:0/3410236000 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69240f7980 0x7f6924069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:06:14.200 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.200+0000 7f692a561700 1 -- 172.21.15.26:0/3410236000 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69240f7980 msgr2=0x7f6924069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:06:14.200 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.200+0000 7f692a561700 1 --2- 172.21.15.26:0/3410236000 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69240f7980 0x7f6924069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:14.200 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.200+0000 7f692a561700 1 -- 172.21.15.26:0/3410236000 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6920005040 con 0x7f69240f66e0 2021-11-03T17:06:14.200 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.200+0000 7f6929d60700 1 --2- 172.21.15.26:0/3410236000 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69240f7980 0x7f6924069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:06:14.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.200+0000 7f692a561700 1 --2- 172.21.15.26:0/3410236000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69240f66e0 0x7f692406b9a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f6920000c00 tx=0x7f6920009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:06:14.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.200+0000 7f691affd700 1 -- 172.21.15.26:0/3410236000 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6920018070 con 0x7f69240f66e0 2021-11-03T17:06:14.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.200+0000 7f692c7c5700 1 -- 172.21.15.26:0/3410236000 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f692406a7d0 con 0x7f69240f66e0 2021-11-03T17:06:14.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.200+0000 7f691affd700 1 -- 172.21.15.26:0/3410236000 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6920007d70 con 0x7f69240f66e0 2021-11-03T17:06:14.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.200+0000 7f691affd700 1 -- 172.21.15.26:0/3410236000 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f692001c620 con 0x7f69240f66e0 2021-11-03T17:06:14.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.200+0000 7f692c7c5700 1 -- 172.21.15.26:0/3410236000 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f692410efe0 con 0x7f69240f66e0 2021-11-03T17:06:14.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.201+0000 7f692c7c5700 1 -- 172.21.15.26:0/3410236000 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6924045ad0 con 0x7f69240f66e0 2021-11-03T17:06:14.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.202+0000 7f691affd700 1 -- 172.21.15.26:0/3410236000 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f692001c860 con 0x7f69240f66e0 2021-11-03T17:06:14.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.202+0000 7f691affd700 1 --2- 172.21.15.26:0/3410236000 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6910064090 0x7f6910066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:06:14.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.202+0000 7f691affd700 1 -- 172.21.15.26:0/3410236000 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f6920082690 con 0x7f69240f66e0 2021-11-03T17:06:14.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.202+0000 7f6929d60700 1 --2- 172.21.15.26:0/3410236000 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6910064090 0x7f6910066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:06:14.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.203+0000 7f6929d60700 1 --2- 172.21.15.26:0/3410236000 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6910064090 0x7f6910066550 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f691400a880 tx=0x7f6914008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:06:14.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.207+0000 7f691affd700 1 -- 172.21.15.26:0/3410236000 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f6920054ab0 con 0x7f69240f66e0 2021-11-03T17:06:14.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.389+0000 7f692c7c5700 1 -- 172.21.15.26:0/3410236000 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f69240ff060 con 0x7f6910064090 2021-11-03T17:06:14.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.390+0000 7f691affd700 1 -- 172.21.15.26:0/3410236000 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f69240ff060 con 0x7f6910064090 2021-11-03T17:06:14.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.392+0000 7f692c7c5700 1 -- 172.21.15.26:0/3410236000 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6910064090 msgr2=0x7f6910066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:06:14.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.392+0000 7f692c7c5700 1 --2- 172.21.15.26:0/3410236000 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6910064090 0x7f6910066550 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f691400a880 tx=0x7f6914008040).stop 2021-11-03T17:06:14.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.392+0000 7f692c7c5700 1 -- 172.21.15.26:0/3410236000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69240f66e0 msgr2=0x7f692406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:06:14.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.392+0000 7f692c7c5700 1 --2- 172.21.15.26:0/3410236000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69240f66e0 0x7f692406b9a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f6920000c00 tx=0x7f6920009b30).stop 2021-11-03T17:06:14.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.392+0000 7f692c7c5700 1 -- 172.21.15.26:0/3410236000 shutdown_connections 2021-11-03T17:06:14.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.392+0000 7f692c7c5700 1 --2- 172.21.15.26:0/3410236000 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6910064090 0x7f6910066550 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:14.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.392+0000 7f692c7c5700 1 --2- 172.21.15.26:0/3410236000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69240f66e0 0x7f692406b9a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:14.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.392+0000 7f692c7c5700 1 --2- 172.21.15.26:0/3410236000 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69240f7980 0x7f6924069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:14.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.392+0000 7f692c7c5700 1 -- 172.21.15.26:0/3410236000 >> 172.21.15.26:0/3410236000 conn(0x7f69240f1e40 msgr2=0x7f69240fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:06:14.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.392+0000 7f692c7c5700 1 -- 172.21.15.26:0/3410236000 shutdown_connections 2021-11-03T17:06:14.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.392+0000 7f692c7c5700 1 -- 172.21.15.26:0/3410236000 wait complete. 2021-11-03T17:06:14.396 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:06:14.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.492+0000 7f8283ded700 1 -- 172.21.15.26:0/1454197292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f827c0f6ff0 msgr2=0x7f827c0f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:06:14.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.492+0000 7f8283ded700 1 --2- 172.21.15.26:0/1454197292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f827c0f6ff0 0x7f827c0f7a20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f8278004660 tx=0x7f8278009b30).stop 2021-11-03T17:06:14.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.492+0000 7f8283ded700 1 -- 172.21.15.26:0/1454197292 shutdown_connections 2021-11-03T17:06:14.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.492+0000 7f8283ded700 1 --2- 172.21.15.26:0/1454197292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f827c0f6ff0 0x7f827c0f7a20 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:14.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.492+0000 7f8283ded700 1 --2- 172.21.15.26:0/1454197292 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f827c0f66e0 0x7f827c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:14.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.492+0000 7f8283ded700 1 -- 172.21.15.26:0/1454197292 >> 172.21.15.26:0/1454197292 conn(0x7f827c0f1f00 msgr2=0x7f827c0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:06:14.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.492+0000 7f8283ded700 1 -- 172.21.15.26:0/1454197292 shutdown_connections 2021-11-03T17:06:14.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.492+0000 7f8283ded700 1 -- 172.21.15.26:0/1454197292 wait complete. 2021-11-03T17:06:14.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.493+0000 7f8283ded700 1 Processor -- start 2021-11-03T17:06:14.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.493+0000 7f8283ded700 1 -- start start 2021-11-03T17:06:14.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.493+0000 7f8283ded700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f827c0f66e0 0x7f827c106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:06:14.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.493+0000 7f8283ded700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f827c0f6ff0 0x7f827c107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:06:14.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.493+0000 7f8283ded700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827c107a10 con 0x7f827c0f6ff0 2021-11-03T17:06:14.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.493+0000 7f8283ded700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827c107b50 con 0x7f827c0f66e0 2021-11-03T17:06:14.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.493+0000 7f8281388700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f827c0f6ff0 0x7f827c107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:06:14.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.493+0000 7f8281388700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f827c0f6ff0 0x7f827c107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52496/0 (socket says 172.21.15.26:52496) 2021-11-03T17:06:14.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.493+0000 7f8281388700 1 -- 172.21.15.26:0/2244434539 learned_addr learned my addr 172.21.15.26:0/2244434539 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:06:14.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.493+0000 7f8281b89700 1 --2- 172.21.15.26:0/2244434539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f827c0f66e0 0x7f827c106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:06:14.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.493+0000 7f8281388700 1 -- 172.21.15.26:0/2244434539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f827c0f66e0 msgr2=0x7f827c106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:06:14.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.493+0000 7f8281388700 1 --2- 172.21.15.26:0/2244434539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f827c0f66e0 0x7f827c106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:14.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.493+0000 7f8281388700 1 -- 172.21.15.26:0/2244434539 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8278005040 con 0x7f827c0f6ff0 2021-11-03T17:06:14.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.493+0000 7f8281b89700 1 --2- 172.21.15.26:0/2244434539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f827c0f66e0 0x7f827c106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:06:14.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.493+0000 7f8281388700 1 --2- 172.21.15.26:0/2244434539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f827c0f6ff0 0x7f827c107460 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f8278009990 tx=0x7f8278009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:06:14.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.494+0000 7f82727fc700 1 -- 172.21.15.26:0/2244434539 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8278018070 con 0x7f827c0f6ff0 2021-11-03T17:06:14.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.494+0000 7f82727fc700 1 -- 172.21.15.26:0/2244434539 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8278007ca0 con 0x7f827c0f6ff0 2021-11-03T17:06:14.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.494+0000 7f8283ded700 1 -- 172.21.15.26:0/2244434539 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f827c108490 con 0x7f827c0f6ff0 2021-11-03T17:06:14.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.494+0000 7f82727fc700 1 -- 172.21.15.26:0/2244434539 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f827801c620 con 0x7f827c0f6ff0 2021-11-03T17:06:14.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.494+0000 7f8283ded700 1 -- 172.21.15.26:0/2244434539 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f827c1089f0 con 0x7f827c0f6ff0 2021-11-03T17:06:14.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.495+0000 7f8283ded700 1 -- 172.21.15.26:0/2244434539 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f827c045ad0 con 0x7f827c0f6ff0 2021-11-03T17:06:14.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:14 smithi194 ceph-mon[65619]: pgmap v347: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:14.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:14 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:06:14.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.495+0000 7f82727fc700 1 -- 172.21.15.26:0/2244434539 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f827801d960 con 0x7f827c0f6ff0 2021-11-03T17:06:14.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.495+0000 7f82727fc700 1 --2- 172.21.15.26:0/2244434539 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f82680640b0 0x7f8268066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:06:14.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.496+0000 7f82727fc700 1 -- 172.21.15.26:0/2244434539 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f8278082470 con 0x7f827c0f6ff0 2021-11-03T17:06:14.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.496+0000 7f8281b89700 1 --2- 172.21.15.26:0/2244434539 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f82680640b0 0x7f8268066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:06:14.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.496+0000 7f8281b89700 1 --2- 172.21.15.26:0/2244434539 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f82680640b0 0x7f8268066570 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f826c0041d0 tx=0x7f826c009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:06:14.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.500+0000 7f82727fc700 1 -- 172.21.15.26:0/2244434539 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f8278054890 con 0x7f827c0f6ff0 2021-11-03T17:06:14.666 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.671+0000 7f8283ded700 1 -- 172.21.15.26:0/2244434539 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f827c0ff040 con 0x7f82680640b0 2021-11-03T17:06:14.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:14 smithi026 ceph-mon[96795]: pgmap v347: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:14.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:14 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:06:14.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.686+0000 7f82727fc700 1 -- 172.21.15.26:0/2244434539 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f827c0ff040 con 0x7f82680640b0 2021-11-03T17:06:14.681 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:06:14.681 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (17m) 8m ago 18m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:06:14.681 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (9m) 8m ago 18m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:06:14.681 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (9m) 6m ago 17m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:06:14.682 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (17m) 8m ago 18m 38.9M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:06:14.682 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (10m) 8m ago 13m 13.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:06:14.682 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (10m) 8m ago 13m 14.7M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:06:14.682 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (13m) 6m ago 13m 16.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:06:14.683 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (13m) 6m ago 13m 16.5M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:06:14.683 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (11m) 8m ago 20m 468M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:06:14.683 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (10m) 6m ago 17m 412M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:06:14.683 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (10m) 8m ago 20m 75.8M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:06:14.684 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (10m) 6m ago 17m 66.4M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:06:14.684 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (18m) 8m ago 18m 18.1M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:06:14.684 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (17m) 6m ago 17m 18.3M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:06:14.684 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (9m) 8m ago 17m 153M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:06:14.685 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (8m) 8m ago 16m 166M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:06:14.685 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (8m) 8m ago 16m 11.2M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:06:14.685 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (7m) 6m ago 16m 181M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:06:14.685 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (7m) 6m ago 15m 185M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:06:14.686 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (6m) 6m ago 15m 13.5M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:06:14.686 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (17m) 8m ago 18m 47.5M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:06:14.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.688+0000 7f8283ded700 1 -- 172.21.15.26:0/2244434539 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f82680640b0 msgr2=0x7f8268066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:06:14.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.688+0000 7f8283ded700 1 --2- 172.21.15.26:0/2244434539 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f82680640b0 0x7f8268066570 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f826c0041d0 tx=0x7f826c009040).stop 2021-11-03T17:06:14.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.688+0000 7f8283ded700 1 -- 172.21.15.26:0/2244434539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f827c0f6ff0 msgr2=0x7f827c107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:06:14.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.688+0000 7f8283ded700 1 --2- 172.21.15.26:0/2244434539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f827c0f6ff0 0x7f827c107460 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f8278009990 tx=0x7f8278009b30).stop 2021-11-03T17:06:14.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.688+0000 7f8283ded700 1 -- 172.21.15.26:0/2244434539 shutdown_connections 2021-11-03T17:06:14.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.688+0000 7f8283ded700 1 --2- 172.21.15.26:0/2244434539 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f82680640b0 0x7f8268066570 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:14.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.688+0000 7f8283ded700 1 --2- 172.21.15.26:0/2244434539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f827c0f66e0 0x7f827c106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:14.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.688+0000 7f8283ded700 1 --2- 172.21.15.26:0/2244434539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f827c0f6ff0 0x7f827c107460 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:14.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.688+0000 7f8283ded700 1 -- 172.21.15.26:0/2244434539 >> 172.21.15.26:0/2244434539 conn(0x7f827c0f1f00 msgr2=0x7f827c0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:06:14.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.688+0000 7f8283ded700 1 -- 172.21.15.26:0/2244434539 shutdown_connections 2021-11-03T17:06:14.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.688+0000 7f8283ded700 1 -- 172.21.15.26:0/2244434539 wait complete. 2021-11-03T17:06:14.782 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.787+0000 7fcfcabb0700 1 -- 172.21.15.26:0/986466781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfc40f66e0 msgr2=0x7fcfc40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:06:14.783 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.787+0000 7fcfcabb0700 1 --2- 172.21.15.26:0/986466781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfc40f66e0 0x7fcfc40f6b00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fcfbc0099e0 tx=0x7fcfbc004d10).stop 2021-11-03T17:06:14.783 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.787+0000 7fcfcabb0700 1 -- 172.21.15.26:0/986466781 shutdown_connections 2021-11-03T17:06:14.783 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.787+0000 7fcfcabb0700 1 --2- 172.21.15.26:0/986466781 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfc40f7980 0x7fcfc40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:14.783 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.787+0000 7fcfcabb0700 1 --2- 172.21.15.26:0/986466781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfc40f66e0 0x7fcfc40f6b00 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:14.783 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.787+0000 7fcfcabb0700 1 -- 172.21.15.26:0/986466781 >> 172.21.15.26:0/986466781 conn(0x7fcfc40f1e40 msgr2=0x7fcfc40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:06:14.784 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.787+0000 7fcfcabb0700 1 -- 172.21.15.26:0/986466781 shutdown_connections 2021-11-03T17:06:14.784 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.787+0000 7fcfcabb0700 1 -- 172.21.15.26:0/986466781 wait complete. 2021-11-03T17:06:14.784 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.787+0000 7fcfcabb0700 1 Processor -- start 2021-11-03T17:06:14.784 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.788+0000 7fcfcabb0700 1 -- start start 2021-11-03T17:06:14.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.788+0000 7fcfcabb0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfc40f7980 0x7fcfc41071a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:06:14.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.788+0000 7fcfcabb0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfc4107690 0x7fcfc4108580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:06:14.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.788+0000 7fcfcabb0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc4107b60 con 0x7fcfc4107690 2021-11-03T17:06:14.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.788+0000 7fcfcabb0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc4107ca0 con 0x7fcfc40f7980 2021-11-03T17:06:14.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.788+0000 7fcfc3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfc4107690 0x7fcfc4108580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:06:14.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.788+0000 7fcfc3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfc4107690 0x7fcfc4108580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52506/0 (socket says 172.21.15.26:52506) 2021-11-03T17:06:14.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.788+0000 7fcfc3fff700 1 -- 172.21.15.26:0/721874618 learned_addr learned my addr 172.21.15.26:0/721874618 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:06:14.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.788+0000 7fcfc894c700 1 --2- 172.21.15.26:0/721874618 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfc40f7980 0x7fcfc41071a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:06:14.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.788+0000 7fcfc3fff700 1 -- 172.21.15.26:0/721874618 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfc40f7980 msgr2=0x7fcfc41071a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:06:14.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.788+0000 7fcfc3fff700 1 --2- 172.21.15.26:0/721874618 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfc40f7980 0x7fcfc41071a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:14.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.788+0000 7fcfc3fff700 1 -- 172.21.15.26:0/721874618 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfbc009640 con 0x7fcfc4107690 2021-11-03T17:06:14.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.788+0000 7fcfc3fff700 1 --2- 172.21.15.26:0/721874618 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfc4107690 0x7fcfc4108580 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7fcfb40026d0 tx=0x7fcfb4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:06:14.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.789+0000 7fcfc17fa700 1 -- 172.21.15.26:0/721874618 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfb40079c0 con 0x7fcfc4107690 2021-11-03T17:06:14.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.789+0000 7fcfcabb0700 1 -- 172.21.15.26:0/721874618 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfc4108b30 con 0x7fcfc4107690 2021-11-03T17:06:14.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.789+0000 7fcfc17fa700 1 -- 172.21.15.26:0/721874618 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcfb400f040 con 0x7fcfc4107690 2021-11-03T17:06:14.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.789+0000 7fcfc17fa700 1 -- 172.21.15.26:0/721874618 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfb40148b0 con 0x7fcfc4107690 2021-11-03T17:06:14.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.789+0000 7fcfcabb0700 1 -- 172.21.15.26:0/721874618 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfc4109070 con 0x7fcfc4107690 2021-11-03T17:06:14.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.790+0000 7fcfcabb0700 1 -- 172.21.15.26:0/721874618 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfc4045ad0 con 0x7fcfc4107690 2021-11-03T17:06:14.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.790+0000 7fcfc17fa700 1 -- 172.21.15.26:0/721874618 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fcfb4007b20 con 0x7fcfc4107690 2021-11-03T17:06:14.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.790+0000 7fcfc17fa700 1 --2- 172.21.15.26:0/721874618 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcfb00640b0 0x7fcfb0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:06:14.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.791+0000 7fcfc17fa700 1 -- 172.21.15.26:0/721874618 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fcfb4080730 con 0x7fcfc4107690 2021-11-03T17:06:14.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.791+0000 7fcfc894c700 1 --2- 172.21.15.26:0/721874618 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcfb00640b0 0x7fcfb0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:06:14.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.791+0000 7fcfc894c700 1 --2- 172.21.15.26:0/721874618 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcfb00640b0 0x7fcfb0066570 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fcfbc000f80 tx=0x7fcfbc004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:06:14.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:14.795+0000 7fcfc17fa700 1 -- 172.21.15.26:0/721874618 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fcfb4052a90 con 0x7fcfc4107690 2021-11-03T17:06:15.019 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.024+0000 7fcfcabb0700 1 -- 172.21.15.26:0/721874618 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcfc41092f0 con 0x7fcfc4107690 2021-11-03T17:06:15.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.024+0000 7fcfc17fa700 1 -- 172.21.15.26:0/721874618 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fcfb4052680 con 0x7fcfc4107690 2021-11-03T17:06:15.020 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:06:15.020 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:06:15.021 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:06:15.021 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:06:15.021 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:06:15.021 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:06:15.022 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:06:15.022 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:06:15.022 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:06:15.022 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:06:15.022 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:06:15.023 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:06:15.023 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:06:15.023 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:06:15.023 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:06:15.024 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:06:15.024 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:06:15.024 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:06:15.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.026+0000 7fcfcabb0700 1 -- 172.21.15.26:0/721874618 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcfb00640b0 msgr2=0x7fcfb0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:06:15.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.026+0000 7fcfcabb0700 1 --2- 172.21.15.26:0/721874618 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcfb00640b0 0x7fcfb0066570 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fcfbc000f80 tx=0x7fcfbc004d10).stop 2021-11-03T17:06:15.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.026+0000 7fcfcabb0700 1 -- 172.21.15.26:0/721874618 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfc4107690 msgr2=0x7fcfc4108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:06:15.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.026+0000 7fcfcabb0700 1 --2- 172.21.15.26:0/721874618 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfc4107690 0x7fcfc4108580 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7fcfb40026d0 tx=0x7fcfb4009de0).stop 2021-11-03T17:06:15.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.027+0000 7fcfcabb0700 1 -- 172.21.15.26:0/721874618 shutdown_connections 2021-11-03T17:06:15.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.027+0000 7fcfcabb0700 1 --2- 172.21.15.26:0/721874618 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcfb00640b0 0x7fcfb0066570 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:15.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.027+0000 7fcfcabb0700 1 --2- 172.21.15.26:0/721874618 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfc40f7980 0x7fcfc41071a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:15.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.027+0000 7fcfcabb0700 1 --2- 172.21.15.26:0/721874618 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfc4107690 0x7fcfc4108580 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:15.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.027+0000 7fcfcabb0700 1 -- 172.21.15.26:0/721874618 >> 172.21.15.26:0/721874618 conn(0x7fcfc40f1e40 msgr2=0x7fcfc40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:06:15.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.027+0000 7fcfcabb0700 1 -- 172.21.15.26:0/721874618 shutdown_connections 2021-11-03T17:06:15.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.027+0000 7fcfcabb0700 1 -- 172.21.15.26:0/721874618 wait complete. 2021-11-03T17:06:15.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.127+0000 7f3982bb4700 1 -- 172.21.15.26:0/2002436421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f397c0f5ed0 msgr2=0x7f397c0f6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:06:15.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.127+0000 7f3982bb4700 1 --2- 172.21.15.26:0/2002436421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f397c0f5ed0 0x7f397c0f6900 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f3968004660 tx=0x7f3968009b30).stop 2021-11-03T17:06:15.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.127+0000 7f3982bb4700 1 -- 172.21.15.26:0/2002436421 shutdown_connections 2021-11-03T17:06:15.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.127+0000 7f3982bb4700 1 --2- 172.21.15.26:0/2002436421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f397c0f5ed0 0x7f397c0f6900 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:15.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.127+0000 7f3982bb4700 1 --2- 172.21.15.26:0/2002436421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f397c0f55c0 0x7f397c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:06:15.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.127+0000 7f3982bb4700 1 -- 172.21.15.26:0/2002436421 >> 172.21.15.26:0/2002436421 conn(0x7f397c0f0de0 msgr2=0x7f397c0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:06:15.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.127+0000 7f3982bb4700 1 -- 172.21.15.26:0/2002436421 shutdown_connections 2021-11-03T17:06:15.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.127+0000 7f3982bb4700 1 -- 172.21.15.26:0/2002436421 wait complete. 2021-11-03T17:06:15.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.127+0000 7f3982bb4700 1 Processor -- start 2021-11-03T17:06:15.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.127+0000 7f3982bb4700 1 -- start start 2021-11-03T17:06:15.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.127+0000 7f3982bb4700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f397c0f55c0 0x7f397c109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:06:15.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.127+0000 7f3982bb4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f397c0f5ed0 0x7f397c10c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:06:15.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.127+0000 7f3982bb4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f397c060530 con 0x7f397c0f5ed0 2021-11-03T17:06:15.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.128+0000 7f3982bb4700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f397c060670 con 0x7f397c0f55c0 2021-11-03T17:06:15.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.128+0000 7f397bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f397c0f5ed0 0x7f397c10c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:06:15.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.128+0000 7f397bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f397c0f5ed0 0x7f397c10c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52516/0 (socket says 172.21.15.26:52516) 2021-11-03T17:06:15.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.128+0000 7f397bfff700 1 -- 172.21.15.26:0/1569154209 learned_addr learned my addr 172.21.15.26:0/1569154209 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:06:15.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.128+0000 7f3980950700 1 --2- 172.21.15.26:0/1569154209 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f397c0f55c0 0x7f397c109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:06:15.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.128+0000 7f397bfff700 1 -- 172.21.15.26:0/1569154209 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f397c0f55c0 msgr2=0x7f397c109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:06:15.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.128+0000 7f397bfff700 1 --2- 172.21.15.26:0/1569154209 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f397c0f55c0 0x7f397c109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:15.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.128+0000 7f397bfff700 1 -- 172.21.15.26:0/1569154209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3968005040 con 0x7f397c0f5ed0 2021-11-03T17:06:15.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.128+0000 7f3980950700 1 --2- 172.21.15.26:0/1569154209 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f397c0f55c0 0x7f397c109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:06:15.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.128+0000 7f397bfff700 1 --2- 172.21.15.26:0/1569154209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f397c0f5ed0 0x7f397c10c190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f3968009990 tx=0x7f3968009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:06:15.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.128+0000 7f39797fa700 1 -- 172.21.15.26:0/1569154209 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3968018070 con 0x7f397c0f5ed0 2021-11-03T17:06:15.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.128+0000 7f3982bb4700 1 -- 172.21.15.26:0/1569154209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f397c10c740 con 0x7f397c0f5ed0 2021-11-03T17:06:15.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.128+0000 7f39797fa700 1 -- 172.21.15.26:0/1569154209 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3968007ca0 con 0x7f397c0f5ed0 2021-11-03T17:06:15.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.128+0000 7f39797fa700 1 -- 172.21.15.26:0/1569154209 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f396801c620 con 0x7f397c0f5ed0 2021-11-03T17:06:15.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.128+0000 7f3982bb4700 1 -- 172.21.15.26:0/1569154209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f397c10cca0 con 0x7f397c0f5ed0 2021-11-03T17:06:15.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.129+0000 7f3982bb4700 1 -- 172.21.15.26:0/1569154209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f397c045ad0 con 0x7f397c0f5ed0 2021-11-03T17:06:15.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.130+0000 7f39797fa700 1 -- 172.21.15.26:0/1569154209 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f396801d960 con 0x7f397c0f5ed0 2021-11-03T17:06:15.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.130+0000 7f39797fa700 1 --2- 172.21.15.26:0/1569154209 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f396c0640b0 0x7f396c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:06:15.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.130+0000 7f39797fa700 1 -- 172.21.15.26:0/1569154209 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f39680826d0 con 0x7f397c0f5ed0 2021-11-03T17:06:15.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.130+0000 7f3980950700 1 --2- 172.21.15.26:0/1569154209 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f396c0640b0 0x7f396c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:06:15.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.131+0000 7f3980950700 1 --2- 172.21.15.26:0/1569154209 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f396c0640b0 0x7f396c066570 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f397c060120 tx=0x7f3970008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:06:15.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.134+0000 7f39797fa700 1 -- 172.21.15.26:0/1569154209 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f3968054a30 con 0x7f397c0f5ed0 2021-11-03T17:06:15.334 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.339+0000 7f3982bb4700 1 -- 172.21.15.26:0/1569154209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f397c027a00 con 0x7f397c0f5ed0 2021-11-03T17:06:15.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.340+0000 7f39797fa700 1 -- 172.21.15.26:0/1569154209 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f3968054620 con 0x7f397c0f5ed0 2021-11-03T17:06:15.335 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:06:15.335 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:06:15.335 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:06:15.336 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:06:15.336 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:06:15.336 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:06:15.336 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:06:15.337 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:06:15.337 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:06:15.337 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:06:15.337 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:06:15.337 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:06:15.338 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:06:15.338 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:06:15.338 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:06:15.338 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:06:15.338 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:06:15.339 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:06:15.339 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:06:15.339 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:06:15.339 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:06:15.340 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:06:15.340 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:06:15.340 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:06:15.340 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:06:15.341 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:06:15.341 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:06:15.341 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:06:15.341 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:06:15.341 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:06:15.342 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:06:15.342 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:06:15.342 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:06:15.342 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:06:15.342 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:06:15.343 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:06:15.343 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:06:15.343 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:06:15.343 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:06:15.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.341+0000 7f3982bb4700 1 -- 172.21.15.26:0/1569154209 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f396c0640b0 msgr2=0x7f396c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:06:15.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.341+0000 7f3982bb4700 1 --2- 172.21.15.26:0/1569154209 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f396c0640b0 0x7f396c066570 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f397c060120 tx=0x7f3970008040).stop 2021-11-03T17:06:15.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.341+0000 7f3982bb4700 1 -- 172.21.15.26:0/1569154209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f397c0f5ed0 msgr2=0x7f397c10c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:06:15.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.341+0000 7f3982bb4700 1 --2- 172.21.15.26:0/1569154209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f397c0f5ed0 0x7f397c10c190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f3968009990 tx=0x7f3968009b30).stop 2021-11-03T17:06:15.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.342+0000 7f3982bb4700 1 -- 172.21.15.26:0/1569154209 shutdown_connections 2021-11-03T17:06:15.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.342+0000 7f3982bb4700 1 --2- 172.21.15.26:0/1569154209 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f396c0640b0 0x7f396c066570 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:15.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.342+0000 7f3982bb4700 1 --2- 172.21.15.26:0/1569154209 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f397c0f55c0 0x7f397c109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:15.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.342+0000 7f3982bb4700 1 --2- 172.21.15.26:0/1569154209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f397c0f5ed0 0x7f397c10c190 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:15.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.342+0000 7f3982bb4700 1 -- 172.21.15.26:0/1569154209 >> 172.21.15.26:0/1569154209 conn(0x7f397c0f0de0 msgr2=0x7f397c0fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:06:15.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.342+0000 7f3982bb4700 1 -- 172.21.15.26:0/1569154209 shutdown_connections 2021-11-03T17:06:15.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:15.342+0000 7f3982bb4700 1 -- 172.21.15.26:0/1569154209 wait complete. 2021-11-03T17:06:15.347 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:06:15.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:15 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/721874618' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:06:15.573 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:15 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/721874618' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:06:16.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:16 smithi194 ceph-mon[65619]: from='client.34500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:06:16.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:16 smithi194 ceph-mon[65619]: pgmap v348: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:16.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:16 smithi194 ceph-mon[65619]: from='client.34504 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:06:16.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:16 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1569154209' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:06:16.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:16 smithi026 ceph-mon[96795]: from='client.34500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:06:16.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:16 smithi026 ceph-mon[96795]: pgmap v348: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:16.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:16 smithi026 ceph-mon[96795]: from='client.34504 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:06:16.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:16 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1569154209' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:06:18.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:18 smithi194 ceph-mon[65619]: pgmap v349: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:18.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:18 smithi026 ceph-mon[96795]: pgmap v349: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:20.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:20 smithi194 ceph-mon[65619]: pgmap v350: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:20.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:20 smithi026 ceph-mon[96795]: pgmap v350: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:22.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:22 smithi194 ceph-mon[65619]: pgmap v351: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:22.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:22 smithi026 ceph-mon[96795]: pgmap v351: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:24.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:24 smithi194 ceph-mon[65619]: pgmap v352: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:24.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:24 smithi026 ceph-mon[96795]: pgmap v352: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:26.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:26 smithi194 ceph-mon[65619]: pgmap v353: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:26.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:26 smithi026 ceph-mon[96795]: pgmap v353: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:28.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:28 smithi026 ceph-mon[96795]: pgmap v354: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:28.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:06:28.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2021-11-03T17:06:28.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi026", "name": "osd_memory_target"}]: dispatch 2021-11-03T17:06:28.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:06:28.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:06:28.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:06:28.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:06:28.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:06:28.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:06:28.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:06:28.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:28 smithi194 ceph-mon[65619]: pgmap v354: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:28.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:06:28.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2021-11-03T17:06:28.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi026", "name": "osd_memory_target"}]: dispatch 2021-11-03T17:06:28.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:06:28.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:06:28.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:06:28.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:06:28.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:06:28.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:06:28.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:06:29.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:29 smithi026 ceph-mon[96795]: poll took 60062.365 ms: 1 events 2021-11-03T17:06:29.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:29 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:06:29.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:29 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:06:29.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:29 smithi194 ceph-mon[65619]: poll took 60062.365 ms: 1 events 2021-11-03T17:06:29.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:29 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:06:29.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:29 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:06:30.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:30 smithi026 ceph-mon[96795]: pgmap v355: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:30.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:30 smithi194 ceph-mon[65619]: pgmap v355: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:32.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:32 smithi026 ceph-mon[96795]: pgmap v356: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:32.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:32 smithi194 ceph-mon[65619]: pgmap v356: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:34.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:34 smithi026 ceph-mon[96795]: pgmap v357: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:34.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:34 smithi194 ceph-mon[65619]: pgmap v357: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:36.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:36 smithi026 ceph-mon[96795]: pgmap v358: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:36.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:36 smithi194 ceph-mon[65619]: pgmap v358: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:38.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:38 smithi026 ceph-mon[96795]: pgmap v359: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:38.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:38 smithi194 ceph-mon[65619]: pgmap v359: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:40.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:40 smithi026 ceph-mon[96795]: pgmap v360: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:40.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:40 smithi194 ceph-mon[65619]: pgmap v360: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:42.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:42 smithi026 ceph-mon[96795]: pgmap v361: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:42.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:42 smithi194 ceph-mon[65619]: pgmap v361: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:43.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:43 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:06:43.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:43 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:06:44.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:44 smithi026 ceph-mon[96795]: pgmap v362: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:44.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:44 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:06:44.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:44 smithi194 ceph-mon[65619]: pgmap v362: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:44.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:44 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:06:45.451 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.455+0000 7fc151b67700 1 -- 172.21.15.26:0/3585544367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc14c0f66e0 msgr2=0x7fc14c0f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:06:45.451 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.455+0000 7fc151b67700 1 --2- 172.21.15.26:0/3585544367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc14c0f66e0 0x7fc14c0f6b40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fc138004660 tx=0x7fc138009b30).stop 2021-11-03T17:06:45.452 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.455+0000 7fc151b67700 1 -- 172.21.15.26:0/3585544367 shutdown_connections 2021-11-03T17:06:45.452 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.455+0000 7fc151b67700 1 --2- 172.21.15.26:0/3585544367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc14c0f66e0 0x7fc14c0f6b40 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:45.452 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.455+0000 7fc151b67700 1 --2- 172.21.15.26:0/3585544367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc14c0f5440 0x7fc14c0f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:45.452 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.455+0000 7fc151b67700 1 -- 172.21.15.26:0/3585544367 >> 172.21.15.26:0/3585544367 conn(0x7fc14c0f0ba0 msgr2=0x7fc14c0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:06:45.453 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.455+0000 7fc151b67700 1 -- 172.21.15.26:0/3585544367 shutdown_connections 2021-11-03T17:06:45.453 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.455+0000 7fc151b67700 1 -- 172.21.15.26:0/3585544367 wait complete. 2021-11-03T17:06:45.453 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.456+0000 7fc151b67700 1 Processor -- start 2021-11-03T17:06:45.453 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.456+0000 7fc151b67700 1 -- start start 2021-11-03T17:06:45.455 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.456+0000 7fc151b67700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc14c0f5440 0x7fc14c109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:06:45.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.456+0000 7fc151b67700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc14c0f66e0 0x7fc14c10bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:06:45.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.456+0000 7fc151b67700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c0603e0 con 0x7fc14c0f66e0 2021-11-03T17:06:45.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.456+0000 7fc151b67700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c060520 con 0x7fc14c0f5440 2021-11-03T17:06:45.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.456+0000 7fc14bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc14c0f66e0 0x7fc14c10bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:06:45.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.456+0000 7fc14bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc14c0f66e0 0x7fc14c10bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52534/0 (socket says 172.21.15.26:52534) 2021-11-03T17:06:45.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.456+0000 7fc14bfff700 1 -- 172.21.15.26:0/724865141 learned_addr learned my addr 172.21.15.26:0/724865141 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:06:45.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.456+0000 7fc150b65700 1 --2- 172.21.15.26:0/724865141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc14c0f5440 0x7fc14c109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:06:45.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.457+0000 7fc14bfff700 1 -- 172.21.15.26:0/724865141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc14c0f5440 msgr2=0x7fc14c109a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:06:45.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.457+0000 7fc14bfff700 1 --2- 172.21.15.26:0/724865141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc14c0f5440 0x7fc14c109a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:45.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.457+0000 7fc14bfff700 1 -- 172.21.15.26:0/724865141 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc138005040 con 0x7fc14c0f66e0 2021-11-03T17:06:45.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.457+0000 7fc14bfff700 1 --2- 172.21.15.26:0/724865141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc14c0f66e0 0x7fc14c10bf90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fc138009830 tx=0x7fc138009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:06:45.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.457+0000 7fc1497fa700 1 -- 172.21.15.26:0/724865141 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc138018070 con 0x7fc14c0f66e0 2021-11-03T17:06:45.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.457+0000 7fc1497fa700 1 -- 172.21.15.26:0/724865141 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc138007ba0 con 0x7fc14c0f66e0 2021-11-03T17:06:45.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.457+0000 7fc151b67700 1 -- 172.21.15.26:0/724865141 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc14c10c4e0 con 0x7fc14c0f66e0 2021-11-03T17:06:45.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.457+0000 7fc1497fa700 1 -- 172.21.15.26:0/724865141 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc13801c3c0 con 0x7fc14c0f66e0 2021-11-03T17:06:45.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.457+0000 7fc151b67700 1 -- 172.21.15.26:0/724865141 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc14c10ca40 con 0x7fc14c0f66e0 2021-11-03T17:06:45.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.459+0000 7fc151b67700 1 -- 172.21.15.26:0/724865141 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc14c045ad0 con 0x7fc14c0f66e0 2021-11-03T17:06:45.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.460+0000 7fc1497fa700 1 -- 172.21.15.26:0/724865141 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc138007d10 con 0x7fc14c0f66e0 2021-11-03T17:06:45.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.460+0000 7fc1497fa700 1 --2- 172.21.15.26:0/724865141 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc13c064100 0x7fc13c0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:06:45.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.461+0000 7fc1497fa700 1 -- 172.21.15.26:0/724865141 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc138082800 con 0x7fc14c0f66e0 2021-11-03T17:06:45.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.461+0000 7fc150b65700 1 --2- 172.21.15.26:0/724865141 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc13c064100 0x7fc13c0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:06:45.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.461+0000 7fc150b65700 1 --2- 172.21.15.26:0/724865141 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc13c064100 0x7fc13c0665c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fc14c060060 tx=0x7fc14000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:06:45.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.464+0000 7fc1497fa700 1 -- 172.21.15.26:0/724865141 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc138054aa0 con 0x7fc14c0f66e0 2021-11-03T17:06:45.573 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:45 smithi026 ceph-mon[96795]: pgmap v363: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:45.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.645+0000 7fc151b67700 1 -- 172.21.15.26:0/724865141 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc14c057f10 con 0x7fc13c064100 2021-11-03T17:06:45.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.646+0000 7fc1497fa700 1 -- 172.21.15.26:0/724865141 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fc14c057f10 con 0x7fc13c064100 2021-11-03T17:06:45.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.648+0000 7fc151b67700 1 -- 172.21.15.26:0/724865141 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc13c064100 msgr2=0x7fc13c0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:06:45.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.648+0000 7fc151b67700 1 --2- 172.21.15.26:0/724865141 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc13c064100 0x7fc13c0665c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fc14c060060 tx=0x7fc14000b040).stop 2021-11-03T17:06:45.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.648+0000 7fc151b67700 1 -- 172.21.15.26:0/724865141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc14c0f66e0 msgr2=0x7fc14c10bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:06:45.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.648+0000 7fc151b67700 1 --2- 172.21.15.26:0/724865141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc14c0f66e0 0x7fc14c10bf90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fc138009830 tx=0x7fc138009b30).stop 2021-11-03T17:06:45.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.648+0000 7fc151b67700 1 -- 172.21.15.26:0/724865141 shutdown_connections 2021-11-03T17:06:45.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.648+0000 7fc151b67700 1 --2- 172.21.15.26:0/724865141 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc13c064100 0x7fc13c0665c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:45.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.648+0000 7fc151b67700 1 --2- 172.21.15.26:0/724865141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc14c0f5440 0x7fc14c109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:45.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.648+0000 7fc151b67700 1 --2- 172.21.15.26:0/724865141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc14c0f66e0 0x7fc14c10bf90 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:45.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.648+0000 7fc151b67700 1 -- 172.21.15.26:0/724865141 >> 172.21.15.26:0/724865141 conn(0x7fc14c0f0ba0 msgr2=0x7fc14c0fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:06:45.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.648+0000 7fc151b67700 1 -- 172.21.15.26:0/724865141 shutdown_connections 2021-11-03T17:06:45.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.648+0000 7fc151b67700 1 -- 172.21.15.26:0/724865141 wait complete. 2021-11-03T17:06:45.654 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:06:45.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.748+0000 7f3d792d2700 1 -- 172.21.15.26:0/1176544572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d740f66e0 msgr2=0x7f3d740f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:06:45.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.748+0000 7f3d792d2700 1 --2- 172.21.15.26:0/1176544572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d740f66e0 0x7f3d740f6b00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f3d68004660 tx=0x7f3d68009b30).stop 2021-11-03T17:06:45.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.748+0000 7f3d792d2700 1 -- 172.21.15.26:0/1176544572 shutdown_connections 2021-11-03T17:06:45.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.748+0000 7f3d792d2700 1 --2- 172.21.15.26:0/1176544572 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d740f6ff0 0x7f3d740f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:45.747 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.748+0000 7f3d792d2700 1 --2- 172.21.15.26:0/1176544572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d740f66e0 0x7f3d740f6b00 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:45.747 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.748+0000 7f3d792d2700 1 -- 172.21.15.26:0/1176544572 >> 172.21.15.26:0/1176544572 conn(0x7f3d740f1f00 msgr2=0x7f3d740f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:06:45.747 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.748+0000 7f3d792d2700 1 -- 172.21.15.26:0/1176544572 shutdown_connections 2021-11-03T17:06:45.748 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.748+0000 7f3d792d2700 1 -- 172.21.15.26:0/1176544572 wait complete. 2021-11-03T17:06:45.748 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.749+0000 7f3d792d2700 1 Processor -- start 2021-11-03T17:06:45.748 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.749+0000 7f3d792d2700 1 -- start start 2021-11-03T17:06:45.748 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.749+0000 7f3d792d2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d740f66e0 0x7f3d74106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:06:45.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.749+0000 7f3d792d2700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d740f6ff0 0x7f3d74107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:06:45.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.749+0000 7f3d792d2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d74107a00 con 0x7f3d740f66e0 2021-11-03T17:06:45.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.749+0000 7f3d792d2700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d74107b40 con 0x7f3d740f6ff0 2021-11-03T17:06:45.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.749+0000 7f3d72ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d740f66e0 0x7f3d74106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:06:45.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.749+0000 7f3d72ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d740f66e0 0x7f3d74106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52542/0 (socket says 172.21.15.26:52542) 2021-11-03T17:06:45.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.749+0000 7f3d72ffd700 1 -- 172.21.15.26:0/1866690579 learned_addr learned my addr 172.21.15.26:0/1866690579 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:06:45.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.749+0000 7f3d727fc700 1 --2- 172.21.15.26:0/1866690579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d740f6ff0 0x7f3d74107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:06:45.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.750+0000 7f3d72ffd700 1 -- 172.21.15.26:0/1866690579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d740f6ff0 msgr2=0x7f3d74107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:06:45.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.750+0000 7f3d72ffd700 1 --2- 172.21.15.26:0/1866690579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d740f6ff0 0x7f3d74107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:45.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.750+0000 7f3d72ffd700 1 -- 172.21.15.26:0/1866690579 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d68005040 con 0x7f3d740f66e0 2021-11-03T17:06:45.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.750+0000 7f3d72ffd700 1 --2- 172.21.15.26:0/1866690579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d740f66e0 0x7f3d74106f60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f3d68009990 tx=0x7f3d68009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:06:45.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.750+0000 7f3d5b7fe700 1 -- 172.21.15.26:0/1866690579 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d68018070 con 0x7f3d740f66e0 2021-11-03T17:06:45.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.750+0000 7f3d5b7fe700 1 -- 172.21.15.26:0/1866690579 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3d68007ba0 con 0x7f3d740f66e0 2021-11-03T17:06:45.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.750+0000 7f3d792d2700 1 -- 172.21.15.26:0/1866690579 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d74108480 con 0x7f3d740f66e0 2021-11-03T17:06:45.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.750+0000 7f3d792d2700 1 -- 172.21.15.26:0/1866690579 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d741089e0 con 0x7f3d740f66e0 2021-11-03T17:06:45.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.750+0000 7f3d5b7fe700 1 -- 172.21.15.26:0/1866690579 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d6801c3c0 con 0x7f3d740f66e0 2021-11-03T17:06:45.754 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:45 smithi194 ceph-mon[65619]: pgmap v363: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:45.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.751+0000 7f3d792d2700 1 -- 172.21.15.26:0/1866690579 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d54004fa0 con 0x7f3d740f66e0 2021-11-03T17:06:45.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.751+0000 7f3d5b7fe700 1 -- 172.21.15.26:0/1866690579 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f3d6801d420 con 0x7f3d740f66e0 2021-11-03T17:06:45.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.751+0000 7f3d5b7fe700 1 --2- 172.21.15.26:0/1866690579 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3d5c0640b0 0x7f3d5c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:06:45.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.752+0000 7f3d5b7fe700 1 -- 172.21.15.26:0/1866690579 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f3d68082330 con 0x7f3d740f66e0 2021-11-03T17:06:45.757 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.752+0000 7f3d727fc700 1 --2- 172.21.15.26:0/1866690579 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3d5c0640b0 0x7f3d5c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:06:45.757 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.752+0000 7f3d727fc700 1 --2- 172.21.15.26:0/1866690579 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3d5c0640b0 0x7f3d5c066570 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f3d64004c40 tx=0x7f3d6400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:06:45.757 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.756+0000 7f3d5b7fe700 1 -- 172.21.15.26:0/1866690579 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f3d680546f0 con 0x7f3d740f66e0 2021-11-03T17:06:45.925 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.929+0000 7f3d792d2700 1 -- 172.21.15.26:0/1866690579 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3d54000bc0 con 0x7f3d5c0640b0 2021-11-03T17:06:45.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.944+0000 7f3d5b7fe700 1 -- 172.21.15.26:0/1866690579 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f3d54000bc0 con 0x7f3d5c0640b0 2021-11-03T17:06:45.940 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:06:45.941 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (18m) 8m ago 19m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:06:45.941 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (10m) 8m ago 19m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:06:45.941 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (10m) 7m ago 18m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:06:45.942 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (17m) 8m ago 18m 38.9M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:06:45.942 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (10m) 8m ago 14m 13.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:06:45.942 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (11m) 8m ago 14m 14.7M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:06:45.942 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (14m) 7m ago 14m 16.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:06:45.942 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (14m) 7m ago 14m 16.5M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:06:45.943 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (11m) 8m ago 20m 468M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:06:45.943 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (11m) 7m ago 18m 412M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:06:45.943 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (11m) 8m ago 20m 75.8M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:06:45.943 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (10m) 7m ago 18m 66.4M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:06:45.944 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (18m) 8m ago 18m 18.1M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:06:45.944 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (18m) 7m ago 18m 18.3M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:06:45.944 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (9m) 8m ago 17m 153M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:06:45.945 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (9m) 8m ago 17m 166M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:06:45.945 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (8m) 8m ago 16m 11.2M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:06:45.945 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (8m) 7m ago 16m 181M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:06:45.945 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (7m) 7m ago 16m 185M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:06:45.945 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (7m) 7m ago 15m 13.5M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:06:45.946 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (17m) 8m ago 18m 47.5M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:06:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.946+0000 7f3d792d2700 1 -- 172.21.15.26:0/1866690579 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3d5c0640b0 msgr2=0x7f3d5c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:06:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.946+0000 7f3d792d2700 1 --2- 172.21.15.26:0/1866690579 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3d5c0640b0 0x7f3d5c066570 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f3d64004c40 tx=0x7f3d6400b040).stop 2021-11-03T17:06:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.946+0000 7f3d792d2700 1 -- 172.21.15.26:0/1866690579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d740f66e0 msgr2=0x7f3d74106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:06:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.946+0000 7f3d792d2700 1 --2- 172.21.15.26:0/1866690579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d740f66e0 0x7f3d74106f60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f3d68009990 tx=0x7f3d68009b30).stop 2021-11-03T17:06:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.946+0000 7f3d792d2700 1 -- 172.21.15.26:0/1866690579 shutdown_connections 2021-11-03T17:06:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.946+0000 7f3d792d2700 1 --2- 172.21.15.26:0/1866690579 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3d5c0640b0 0x7f3d5c066570 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.946+0000 7f3d792d2700 1 --2- 172.21.15.26:0/1866690579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d740f66e0 0x7f3d74106f60 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.946+0000 7f3d792d2700 1 --2- 172.21.15.26:0/1866690579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d740f6ff0 0x7f3d74107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.946+0000 7f3d792d2700 1 -- 172.21.15.26:0/1866690579 >> 172.21.15.26:0/1866690579 conn(0x7f3d740f1f00 msgr2=0x7f3d740fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:06:45.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.946+0000 7f3d792d2700 1 -- 172.21.15.26:0/1866690579 shutdown_connections 2021-11-03T17:06:45.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:45.946+0000 7f3d792d2700 1 -- 172.21.15.26:0/1866690579 wait complete. 2021-11-03T17:06:46.041 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.045+0000 7fe339e88700 1 -- 172.21.15.26:0/3221117610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3340f77d0 msgr2=0x7fe3340f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:06:46.042 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.045+0000 7fe339e88700 1 --2- 172.21.15.26:0/3221117610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3340f77d0 0x7fe3340f7c30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fe320004660 tx=0x7fe320009b30).stop 2021-11-03T17:06:46.042 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.045+0000 7fe339e88700 1 -- 172.21.15.26:0/3221117610 shutdown_connections 2021-11-03T17:06:46.042 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.045+0000 7fe339e88700 1 --2- 172.21.15.26:0/3221117610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3340f77d0 0x7fe3340f7c30 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:46.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.045+0000 7fe339e88700 1 --2- 172.21.15.26:0/3221117610 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3340f6530 0x7fe3340f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:46.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.045+0000 7fe339e88700 1 -- 172.21.15.26:0/3221117610 >> 172.21.15.26:0/3221117610 conn(0x7fe3340f1cd0 msgr2=0x7fe3340f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:06:46.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.045+0000 7fe339e88700 1 -- 172.21.15.26:0/3221117610 shutdown_connections 2021-11-03T17:06:46.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.045+0000 7fe339e88700 1 -- 172.21.15.26:0/3221117610 wait complete. 2021-11-03T17:06:46.044 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.046+0000 7fe339e88700 1 Processor -- start 2021-11-03T17:06:46.044 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.046+0000 7fe339e88700 1 -- start start 2021-11-03T17:06:46.046 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.046+0000 7fe339e88700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3340f6530 0x7fe334106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:06:46.046 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.046+0000 7fe339e88700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3340f77d0 0x7fe334107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:06:46.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.046+0000 7fe339e88700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe334107870 con 0x7fe3340f6530 2021-11-03T17:06:46.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.046+0000 7fe339e88700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe334108080 con 0x7fe3340f77d0 2021-11-03T17:06:46.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.046+0000 7fe338e86700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3340f6530 0x7fe334106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:06:46.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.046+0000 7fe338e86700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3340f6530 0x7fe334106d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52552/0 (socket says 172.21.15.26:52552) 2021-11-03T17:06:46.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.046+0000 7fe338e86700 1 -- 172.21.15.26:0/569790591 learned_addr learned my addr 172.21.15.26:0/569790591 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:06:46.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.047+0000 7fe333fff700 1 --2- 172.21.15.26:0/569790591 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3340f77d0 0x7fe334107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:06:46.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.047+0000 7fe338e86700 1 -- 172.21.15.26:0/569790591 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3340f77d0 msgr2=0x7fe334107270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:06:46.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.047+0000 7fe338e86700 1 --2- 172.21.15.26:0/569790591 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3340f77d0 0x7fe334107270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:46.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.047+0000 7fe338e86700 1 -- 172.21.15.26:0/569790591 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe320005040 con 0x7fe3340f6530 2021-11-03T17:06:46.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.047+0000 7fe338e86700 1 --2- 172.21.15.26:0/569790591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3340f6530 0x7fe334106d80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7fe328002700 tx=0x7fe328009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:06:46.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.047+0000 7fe3317fa700 1 -- 172.21.15.26:0/569790591 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe328009320 con 0x7fe3340f6530 2021-11-03T17:06:46.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.047+0000 7fe339e88700 1 -- 172.21.15.26:0/569790591 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe334108300 con 0x7fe3340f6530 2021-11-03T17:06:46.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.047+0000 7fe3317fa700 1 -- 172.21.15.26:0/569790591 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe32800f040 con 0x7fe3340f6530 2021-11-03T17:06:46.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.047+0000 7fe3317fa700 1 -- 172.21.15.26:0/569790591 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe328014900 con 0x7fe3340f6530 2021-11-03T17:06:46.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.047+0000 7fe339e88700 1 -- 172.21.15.26:0/569790591 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3341088c0 con 0x7fe3340f6530 2021-11-03T17:06:46.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.048+0000 7fe339e88700 1 -- 172.21.15.26:0/569790591 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe334059100 con 0x7fe3340f6530 2021-11-03T17:06:46.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.049+0000 7fe3317fa700 1 -- 172.21.15.26:0/569790591 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fe328009480 con 0x7fe3340f6530 2021-11-03T17:06:46.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.049+0000 7fe3317fa700 1 --2- 172.21.15.26:0/569790591 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe324064100 0x7fe3240665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:06:46.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.049+0000 7fe3317fa700 1 -- 172.21.15.26:0/569790591 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fe328080a50 con 0x7fe3340f6530 2021-11-03T17:06:46.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.049+0000 7fe333fff700 1 --2- 172.21.15.26:0/569790591 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe324064100 0x7fe3240665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:06:46.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.049+0000 7fe333fff700 1 --2- 172.21.15.26:0/569790591 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe324064100 0x7fe3240665c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fe320004630 tx=0x7fe320009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:06:46.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.053+0000 7fe3317fa700 1 -- 172.21.15.26:0/569790591 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fe328052db0 con 0x7fe3340f6530 2021-11-03T17:06:46.277 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.281+0000 7fe339e88700 1 -- 172.21.15.26:0/569790591 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe3340fee00 con 0x7fe3340f6530 2021-11-03T17:06:46.277 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.281+0000 7fe3317fa700 1 -- 172.21.15.26:0/569790591 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fe3280529a0 con 0x7fe3340f6530 2021-11-03T17:06:46.278 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:06:46.278 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:06:46.279 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:06:46.279 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:06:46.279 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:06:46.280 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:06:46.280 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:06:46.280 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:06:46.280 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:06:46.281 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:06:46.281 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:06:46.281 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:06:46.281 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:06:46.281 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:06:46.282 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:06:46.282 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:06:46.282 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:06:46.283 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:06:46.283 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.283+0000 7fe339e88700 1 -- 172.21.15.26:0/569790591 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe324064100 msgr2=0x7fe3240665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:06:46.284 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.283+0000 7fe339e88700 1 --2- 172.21.15.26:0/569790591 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe324064100 0x7fe3240665c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fe320004630 tx=0x7fe320009b30).stop 2021-11-03T17:06:46.284 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.283+0000 7fe339e88700 1 -- 172.21.15.26:0/569790591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3340f6530 msgr2=0x7fe334106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:06:46.284 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.283+0000 7fe339e88700 1 --2- 172.21.15.26:0/569790591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3340f6530 0x7fe334106d80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7fe328002700 tx=0x7fe328009d80).stop 2021-11-03T17:06:46.284 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.283+0000 7fe339e88700 1 -- 172.21.15.26:0/569790591 shutdown_connections 2021-11-03T17:06:46.285 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.283+0000 7fe339e88700 1 --2- 172.21.15.26:0/569790591 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe324064100 0x7fe3240665c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:46.285 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.283+0000 7fe339e88700 1 --2- 172.21.15.26:0/569790591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3340f6530 0x7fe334106d80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:46.286 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.283+0000 7fe339e88700 1 --2- 172.21.15.26:0/569790591 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3340f77d0 0x7fe334107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:46.286 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.283+0000 7fe339e88700 1 -- 172.21.15.26:0/569790591 >> 172.21.15.26:0/569790591 conn(0x7fe3340f1cd0 msgr2=0x7fe3340fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:06:46.286 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.283+0000 7fe339e88700 1 -- 172.21.15.26:0/569790591 shutdown_connections 2021-11-03T17:06:46.286 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.283+0000 7fe339e88700 1 -- 172.21.15.26:0/569790591 wait complete. 2021-11-03T17:06:46.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.385+0000 7f39fd9e6700 1 -- 172.21.15.26:0/88572725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39f80f66e0 msgr2=0x7f39f80f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:06:46.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.385+0000 7f39fd9e6700 1 --2- 172.21.15.26:0/88572725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39f80f66e0 0x7f39f80f6b00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f39e0004660 tx=0x7f39e0009b30).stop 2021-11-03T17:06:46.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.385+0000 7f39fd9e6700 1 -- 172.21.15.26:0/88572725 shutdown_connections 2021-11-03T17:06:46.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.385+0000 7f39fd9e6700 1 --2- 172.21.15.26:0/88572725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39f80f6ff0 0x7f39f80f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:46.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.385+0000 7f39fd9e6700 1 --2- 172.21.15.26:0/88572725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39f80f66e0 0x7f39f80f6b00 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:46.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.385+0000 7f39fd9e6700 1 -- 172.21.15.26:0/88572725 >> 172.21.15.26:0/88572725 conn(0x7f39f80f1f00 msgr2=0x7f39f80f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:06:46.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.385+0000 7f39fd9e6700 1 -- 172.21.15.26:0/88572725 shutdown_connections 2021-11-03T17:06:46.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.385+0000 7f39fd9e6700 1 -- 172.21.15.26:0/88572725 wait complete. 2021-11-03T17:06:46.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.386+0000 7f39fd9e6700 1 Processor -- start 2021-11-03T17:06:46.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.386+0000 7f39fd9e6700 1 -- start start 2021-11-03T17:06:46.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.386+0000 7f39fd9e6700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39f80f66e0 0x7f39f806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:06:46.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.386+0000 7f39fd9e6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39f80f6ff0 0x7f39f8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:06:46.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.386+0000 7f39fd9e6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f806a380 con 0x7f39f80f6ff0 2021-11-03T17:06:46.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.386+0000 7f39fd9e6700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f806a4c0 con 0x7f39f80f66e0 2021-11-03T17:06:46.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.386+0000 7f39f67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39f80f6ff0 0x7f39f8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:06:46.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.386+0000 7f39f67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39f80f6ff0 0x7f39f8069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52564/0 (socket says 172.21.15.26:52564) 2021-11-03T17:06:46.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.386+0000 7f39f67fc700 1 -- 172.21.15.26:0/2024611729 learned_addr learned my addr 172.21.15.26:0/2024611729 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:06:46.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.386+0000 7f39f6ffd700 1 --2- 172.21.15.26:0/2024611729 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39f80f66e0 0x7f39f806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:06:46.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.386+0000 7f39f67fc700 1 -- 172.21.15.26:0/2024611729 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39f80f66e0 msgr2=0x7f39f806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:06:46.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.386+0000 7f39f67fc700 1 --2- 172.21.15.26:0/2024611729 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39f80f66e0 0x7f39f806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:46.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.386+0000 7f39f67fc700 1 -- 172.21.15.26:0/2024611729 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e0005040 con 0x7f39f80f6ff0 2021-11-03T17:06:46.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.386+0000 7f39f6ffd700 1 --2- 172.21.15.26:0/2024611729 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39f80f66e0 0x7f39f806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:06:46.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.387+0000 7f39f67fc700 1 --2- 172.21.15.26:0/2024611729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39f80f6ff0 0x7f39f8069e20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f39e80026d0 tx=0x7f39e8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:06:46.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.387+0000 7f39ef7fe700 1 -- 172.21.15.26:0/2024611729 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39e8009320 con 0x7f39f80f6ff0 2021-11-03T17:06:46.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.387+0000 7f39fd9e6700 1 -- 172.21.15.26:0/2024611729 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39f806a7a0 con 0x7f39f80f6ff0 2021-11-03T17:06:46.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.387+0000 7f39ef7fe700 1 -- 172.21.15.26:0/2024611729 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f39e800f040 con 0x7f39f80f6ff0 2021-11-03T17:06:46.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.387+0000 7f39ef7fe700 1 -- 172.21.15.26:0/2024611729 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39e80147e0 con 0x7f39f80f6ff0 2021-11-03T17:06:46.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.387+0000 7f39fd9e6700 1 -- 172.21.15.26:0/2024611729 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39f810ef90 con 0x7f39f80f6ff0 2021-11-03T17:06:46.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.388+0000 7f39fd9e6700 1 -- 172.21.15.26:0/2024611729 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39f8045ad0 con 0x7f39f80f6ff0 2021-11-03T17:06:46.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.388+0000 7f39ef7fe700 1 -- 172.21.15.26:0/2024611729 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f39e8009480 con 0x7f39f80f6ff0 2021-11-03T17:06:46.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.389+0000 7f39ef7fe700 1 --2- 172.21.15.26:0/2024611729 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f39e40640b0 0x7f39e4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:06:46.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.389+0000 7f39ef7fe700 1 -- 172.21.15.26:0/2024611729 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f39e8080eb0 con 0x7f39f80f6ff0 2021-11-03T17:06:46.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.389+0000 7f39f6ffd700 1 --2- 172.21.15.26:0/2024611729 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f39e40640b0 0x7f39e4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:06:46.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.389+0000 7f39f6ffd700 1 --2- 172.21.15.26:0/2024611729 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f39e40640b0 0x7f39e4066570 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f39e0005010 tx=0x7f39e0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:06:46.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.393+0000 7f39ef7fe700 1 -- 172.21.15.26:0/2024611729 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f39e8053210 con 0x7f39f80f6ff0 2021-11-03T17:06:46.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.599+0000 7f39fd9e6700 1 -- 172.21.15.26:0/2024611729 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f39f8027a00 con 0x7f39f80f6ff0 2021-11-03T17:06:46.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.599+0000 7f39ef7fe700 1 -- 172.21.15.26:0/2024611729 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f39e8052e00 con 0x7f39f80f6ff0 2021-11-03T17:06:46.595 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:06:46.596 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:06:46.596 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:06:46.596 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:06:46.596 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:06:46.597 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:06:46.597 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:06:46.597 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:06:46.597 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:06:46.597 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:06:46.598 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:06:46.598 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:06:46.598 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:06:46.598 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:06:46.599 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:06:46.599 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:06:46.599 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:06:46.600 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:06:46.600 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:06:46.601 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:06:46.601 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:06:46.601 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:06:46.601 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:06:46.601 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:06:46.602 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:06:46.602 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:06:46.602 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:06:46.602 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:06:46.603 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:06:46.603 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:06:46.603 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:06:46.604 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:06:46.604 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:06:46.604 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:06:46.604 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:06:46.604 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:06:46.605 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:06:46.605 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:06:46.605 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:06:46.607 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.601+0000 7f39fd9e6700 1 -- 172.21.15.26:0/2024611729 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f39e40640b0 msgr2=0x7f39e4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:06:46.607 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.601+0000 7f39fd9e6700 1 --2- 172.21.15.26:0/2024611729 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f39e40640b0 0x7f39e4066570 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f39e0005010 tx=0x7f39e0009b30).stop 2021-11-03T17:06:46.607 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.601+0000 7f39fd9e6700 1 -- 172.21.15.26:0/2024611729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39f80f6ff0 msgr2=0x7f39f8069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:06:46.608 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.601+0000 7f39fd9e6700 1 --2- 172.21.15.26:0/2024611729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39f80f6ff0 0x7f39f8069e20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f39e80026d0 tx=0x7f39e8009de0).stop 2021-11-03T17:06:46.608 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.601+0000 7f39fd9e6700 1 -- 172.21.15.26:0/2024611729 shutdown_connections 2021-11-03T17:06:46.608 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.601+0000 7f39fd9e6700 1 --2- 172.21.15.26:0/2024611729 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f39e40640b0 0x7f39e4066570 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:46.608 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.601+0000 7f39fd9e6700 1 --2- 172.21.15.26:0/2024611729 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39f80f66e0 0x7f39f806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:46.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.601+0000 7f39fd9e6700 1 --2- 172.21.15.26:0/2024611729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39f80f6ff0 0x7f39f8069e20 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:06:46.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.601+0000 7f39fd9e6700 1 -- 172.21.15.26:0/2024611729 >> 172.21.15.26:0/2024611729 conn(0x7f39f80f1f00 msgr2=0x7f39f80fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:06:46.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.601+0000 7f39fd9e6700 1 -- 172.21.15.26:0/2024611729 shutdown_connections 2021-11-03T17:06:46.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:06:46.601+0000 7f39fd9e6700 1 -- 172.21.15.26:0/2024611729 wait complete. 2021-11-03T17:06:46.610 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:06:46.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:46 smithi026 ceph-mon[96795]: from='client.34516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:06:46.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:46 smithi026 ceph-mon[96795]: from='client.34520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:06:46.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:46 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/569790591' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:06:46.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:46 smithi194 ceph-mon[65619]: from='client.34516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:06:46.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:46 smithi194 ceph-mon[65619]: from='client.34520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:06:46.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:46 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/569790591' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:06:47.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:47 smithi026 ceph-mon[96795]: pgmap v364: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:47.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:47 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2024611729' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:06:47.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:47 smithi194 ceph-mon[65619]: pgmap v364: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:47.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:47 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2024611729' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:06:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:06:48.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:06:48.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:06:48.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:06:50.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:49 smithi026 ceph-mon[96795]: pgmap v365: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:50.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:49 smithi194 ceph-mon[65619]: pgmap v365: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:52.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:51 smithi026 ceph-mon[96795]: pgmap v366: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:52.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:51 smithi194 ceph-mon[65619]: pgmap v366: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:54.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:53 smithi026 ceph-mon[96795]: pgmap v367: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:54.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:53 smithi194 ceph-mon[65619]: pgmap v367: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:56.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:55 smithi026 ceph-mon[96795]: pgmap v368: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:56.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:55 smithi194 ceph-mon[65619]: pgmap v368: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:58.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:57 smithi026 ceph-mon[96795]: pgmap v369: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:58.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:57 smithi194 ceph-mon[65619]: pgmap v369: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:06:59.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:58 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:06:59.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:58 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:06:59.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:58 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:06:59.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:58 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:07:00.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:06:59 smithi026 ceph-mon[96795]: pgmap v370: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:00.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:06:59 smithi194 ceph-mon[65619]: pgmap v370: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:02.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:01 smithi026 ceph-mon[96795]: pgmap v371: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:02.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:01 smithi194 ceph-mon[65619]: pgmap v371: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:04.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:03 smithi026 ceph-mon[96795]: pgmap v372: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:04.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:03 smithi194 ceph-mon[65619]: pgmap v372: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:06.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:05 smithi026 ceph-mon[96795]: pgmap v373: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:06.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:05 smithi194 ceph-mon[65619]: pgmap v373: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:08.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:07 smithi026 ceph-mon[96795]: pgmap v374: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:08.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:07 smithi194 ceph-mon[65619]: pgmap v374: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:10.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:09 smithi026 ceph-mon[96795]: pgmap v375: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:10.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:09 smithi194 ceph-mon[65619]: pgmap v375: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:12.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:11 smithi026 ceph-mon[96795]: pgmap v376: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:12.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:11 smithi194 ceph-mon[65619]: pgmap v376: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:14.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:13 smithi026 ceph-mon[96795]: pgmap v377: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:14.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:13 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:07:14.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:13 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:07:14.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:13 smithi194 ceph-mon[65619]: pgmap v377: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:14.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:13 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:07:14.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:13 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:07:16.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:15 smithi026 ceph-mon[96795]: pgmap v378: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:16.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:15 smithi194 ceph-mon[65619]: pgmap v378: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:16.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.717+0000 7f186484b700 1 -- 172.21.15.26:0/313605644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18600f55c0 msgr2=0x7f18600f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:07:16.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.717+0000 7f186484b700 1 --2- 172.21.15.26:0/313605644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18600f55c0 0x7f18600f59e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f1850004660 tx=0x7f1850009b30).stop 2021-11-03T17:07:16.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.717+0000 7f186484b700 1 -- 172.21.15.26:0/313605644 shutdown_connections 2021-11-03T17:07:16.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.717+0000 7f186484b700 1 --2- 172.21.15.26:0/313605644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18600f5ed0 0x7f18600f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:16.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.717+0000 7f186484b700 1 --2- 172.21.15.26:0/313605644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18600f55c0 0x7f18600f59e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:16.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.717+0000 7f186484b700 1 -- 172.21.15.26:0/313605644 >> 172.21.15.26:0/313605644 conn(0x7f18600f0de0 msgr2=0x7f18600f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:07:16.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.717+0000 7f186484b700 1 -- 172.21.15.26:0/313605644 shutdown_connections 2021-11-03T17:07:16.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.717+0000 7f186484b700 1 -- 172.21.15.26:0/313605644 wait complete. 2021-11-03T17:07:16.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.717+0000 7f186484b700 1 Processor -- start 2021-11-03T17:07:16.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.717+0000 7f186484b700 1 -- start start 2021-11-03T17:07:16.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.718+0000 7f186484b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18600f55c0 0x7f1860109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:07:16.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.718+0000 7f186484b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18600f5ed0 0x7f186010c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:07:16.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.718+0000 7f186484b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18600604a0 con 0x7f18600f5ed0 2021-11-03T17:07:16.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.718+0000 7f186484b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18600605e0 con 0x7f18600f55c0 2021-11-03T17:07:16.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.718+0000 7f1857fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18600f5ed0 0x7f186010c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:07:16.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.718+0000 7f1857fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18600f5ed0 0x7f186010c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52582/0 (socket says 172.21.15.26:52582) 2021-11-03T17:07:16.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.718+0000 7f1857fff700 1 -- 172.21.15.26:0/259303654 learned_addr learned my addr 172.21.15.26:0/259303654 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:07:16.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.718+0000 7f185e59c700 1 --2- 172.21.15.26:0/259303654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18600f55c0 0x7f1860109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:07:16.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.718+0000 7f1857fff700 1 -- 172.21.15.26:0/259303654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18600f55c0 msgr2=0x7f1860109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:07:16.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.718+0000 7f1857fff700 1 --2- 172.21.15.26:0/259303654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18600f55c0 0x7f1860109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:16.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.718+0000 7f1857fff700 1 -- 172.21.15.26:0/259303654 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1850005040 con 0x7f18600f5ed0 2021-11-03T17:07:16.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.718+0000 7f1857fff700 1 --2- 172.21.15.26:0/259303654 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18600f5ed0 0x7f186010c190 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f18480026d0 tx=0x7f1848009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:07:16.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.718+0000 7f1856ffd700 1 -- 172.21.15.26:0/259303654 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1848009320 con 0x7f18600f5ed0 2021-11-03T17:07:16.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.718+0000 7f1856ffd700 1 -- 172.21.15.26:0/259303654 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f184800f040 con 0x7f18600f5ed0 2021-11-03T17:07:16.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.718+0000 7f186484b700 1 -- 172.21.15.26:0/259303654 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f186010c740 con 0x7f18600f5ed0 2021-11-03T17:07:16.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.718+0000 7f1856ffd700 1 -- 172.21.15.26:0/259303654 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18480147e0 con 0x7f18600f5ed0 2021-11-03T17:07:16.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.718+0000 7f186484b700 1 -- 172.21.15.26:0/259303654 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f186010ccd0 con 0x7f18600f5ed0 2021-11-03T17:07:16.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.719+0000 7f186484b700 1 -- 172.21.15.26:0/259303654 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18600f4a50 con 0x7f18600f5ed0 2021-11-03T17:07:16.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.720+0000 7f1856ffd700 1 -- 172.21.15.26:0/259303654 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f1848009480 con 0x7f18600f5ed0 2021-11-03T17:07:16.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.720+0000 7f1856ffd700 1 --2- 172.21.15.26:0/259303654 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f184c0640b0 0x7f184c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:07:16.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.720+0000 7f1856ffd700 1 -- 172.21.15.26:0/259303654 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f1848080f30 con 0x7f18600f5ed0 2021-11-03T17:07:16.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.720+0000 7f185e59c700 1 --2- 172.21.15.26:0/259303654 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f184c0640b0 0x7f184c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:07:16.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.721+0000 7f185e59c700 1 --2- 172.21.15.26:0/259303654 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f184c0640b0 0x7f184c066570 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f1850009da0 tx=0x7f1850009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:07:16.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.724+0000 7f1856ffd700 1 -- 172.21.15.26:0/259303654 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f1848053210 con 0x7f18600f5ed0 2021-11-03T17:07:16.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.905+0000 7f186484b700 1 -- 172.21.15.26:0/259303654 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f18600fdf60 con 0x7f184c0640b0 2021-11-03T17:07:16.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.906+0000 7f1856ffd700 1 -- 172.21.15.26:0/259303654 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f18500092e0 con 0x7f184c0640b0 2021-11-03T17:07:16.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.908+0000 7f186484b700 1 -- 172.21.15.26:0/259303654 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f184c0640b0 msgr2=0x7f184c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:07:16.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.908+0000 7f186484b700 1 --2- 172.21.15.26:0/259303654 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f184c0640b0 0x7f184c066570 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f1850009da0 tx=0x7f1850009b30).stop 2021-11-03T17:07:16.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.908+0000 7f186484b700 1 -- 172.21.15.26:0/259303654 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18600f5ed0 msgr2=0x7f186010c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:07:16.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.908+0000 7f186484b700 1 --2- 172.21.15.26:0/259303654 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18600f5ed0 0x7f186010c190 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f18480026d0 tx=0x7f1848009de0).stop 2021-11-03T17:07:16.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.908+0000 7f186484b700 1 -- 172.21.15.26:0/259303654 shutdown_connections 2021-11-03T17:07:16.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.908+0000 7f186484b700 1 --2- 172.21.15.26:0/259303654 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f184c0640b0 0x7f184c066570 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:16.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.908+0000 7f186484b700 1 --2- 172.21.15.26:0/259303654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18600f55c0 0x7f1860109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:16.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.908+0000 7f186484b700 1 --2- 172.21.15.26:0/259303654 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18600f5ed0 0x7f186010c190 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:16.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.908+0000 7f186484b700 1 -- 172.21.15.26:0/259303654 >> 172.21.15.26:0/259303654 conn(0x7f18600f0de0 msgr2=0x7f18600fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:07:16.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.908+0000 7f186484b700 1 -- 172.21.15.26:0/259303654 shutdown_connections 2021-11-03T17:07:16.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:16.908+0000 7f186484b700 1 -- 172.21.15.26:0/259303654 wait complete. 2021-11-03T17:07:16.912 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:07:17.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.008+0000 7fd298fde700 1 -- 172.21.15.26:0/1835595963 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2940f6860 msgr2=0x7fd2940f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:07:17.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.008+0000 7fd298fde700 1 --2- 172.21.15.26:0/1835595963 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2940f6860 0x7fd2940f6cc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7fd284004660 tx=0x7fd284009b30).stop 2021-11-03T17:07:17.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.008+0000 7fd298fde700 1 -- 172.21.15.26:0/1835595963 shutdown_connections 2021-11-03T17:07:17.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.008+0000 7fd298fde700 1 --2- 172.21.15.26:0/1835595963 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2940f6860 0x7fd2940f6cc0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:17.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.008+0000 7fd298fde700 1 --2- 172.21.15.26:0/1835595963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2940f55c0 0x7fd2940f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:17.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.008+0000 7fd298fde700 1 -- 172.21.15.26:0/1835595963 >> 172.21.15.26:0/1835595963 conn(0x7fd2940f0d40 msgr2=0x7fd2940f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:07:17.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.008+0000 7fd298fde700 1 -- 172.21.15.26:0/1835595963 shutdown_connections 2021-11-03T17:07:17.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.008+0000 7fd298fde700 1 -- 172.21.15.26:0/1835595963 wait complete. 2021-11-03T17:07:17.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.008+0000 7fd298fde700 1 Processor -- start 2021-11-03T17:07:17.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.009+0000 7fd298fde700 1 -- start start 2021-11-03T17:07:17.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.009+0000 7fd298fde700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2940f55c0 0x7fd294109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:07:17.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.009+0000 7fd298fde700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2940f6860 0x7fd29410c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:07:17.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.009+0000 7fd298fde700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2940603e0 con 0x7fd2940f55c0 2021-11-03T17:07:17.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.009+0000 7fd298fde700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd294060520 con 0x7fd2940f6860 2021-11-03T17:07:17.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.009+0000 7fd29259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2940f55c0 0x7fd294109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:07:17.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.009+0000 7fd29259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2940f55c0 0x7fd294109c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52590/0 (socket says 172.21.15.26:52590) 2021-11-03T17:07:17.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.009+0000 7fd29259c700 1 -- 172.21.15.26:0/1092822997 learned_addr learned my addr 172.21.15.26:0/1092822997 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:07:17.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.009+0000 7fd291d9b700 1 --2- 172.21.15.26:0/1092822997 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2940f6860 0x7fd29410c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:07:17.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.009+0000 7fd29259c700 1 -- 172.21.15.26:0/1092822997 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2940f6860 msgr2=0x7fd29410c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:07:17.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.009+0000 7fd29259c700 1 --2- 172.21.15.26:0/1092822997 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2940f6860 0x7fd29410c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:17.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.009+0000 7fd29259c700 1 -- 172.21.15.26:0/1092822997 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd284005040 con 0x7fd2940f55c0 2021-11-03T17:07:17.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.009+0000 7fd291d9b700 1 --2- 172.21.15.26:0/1092822997 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2940f6860 0x7fd29410c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:07:17.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.009+0000 7fd29259c700 1 --2- 172.21.15.26:0/1092822997 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2940f55c0 0x7fd294109c50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fd288002700 tx=0x7fd288009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:07:17.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.009+0000 7fd282ffd700 1 -- 172.21.15.26:0/1092822997 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd288009320 con 0x7fd2940f55c0 2021-11-03T17:07:17.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.009+0000 7fd282ffd700 1 -- 172.21.15.26:0/1092822997 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd28800f040 con 0x7fd2940f55c0 2021-11-03T17:07:17.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.009+0000 7fd298fde700 1 -- 172.21.15.26:0/1092822997 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd29410c700 con 0x7fd2940f55c0 2021-11-03T17:07:17.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.010+0000 7fd282ffd700 1 -- 172.21.15.26:0/1092822997 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd288014900 con 0x7fd2940f55c0 2021-11-03T17:07:17.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.010+0000 7fd298fde700 1 -- 172.21.15.26:0/1092822997 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd29410ccc0 con 0x7fd2940f55c0 2021-11-03T17:07:17.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.011+0000 7fd298fde700 1 -- 172.21.15.26:0/1092822997 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd294045ad0 con 0x7fd2940f55c0 2021-11-03T17:07:17.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.011+0000 7fd282ffd700 1 -- 172.21.15.26:0/1092822997 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fd288009480 con 0x7fd2940f55c0 2021-11-03T17:07:17.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.011+0000 7fd282ffd700 1 --2- 172.21.15.26:0/1092822997 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd27c0640b0 0x7fd27c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:07:17.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.011+0000 7fd282ffd700 1 -- 172.21.15.26:0/1092822997 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fd288080970 con 0x7fd2940f55c0 2021-11-03T17:07:17.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.011+0000 7fd291d9b700 1 --2- 172.21.15.26:0/1092822997 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd27c0640b0 0x7fd27c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:07:17.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.012+0000 7fd291d9b700 1 --2- 172.21.15.26:0/1092822997 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd27c0640b0 0x7fd27c066570 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fd284004630 tx=0x7fd284009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:07:17.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.015+0000 7fd282ffd700 1 -- 172.21.15.26:0/1092822997 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fd288052cd0 con 0x7fd2940f55c0 2021-11-03T17:07:17.182 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.187+0000 7fd298fde700 1 -- 172.21.15.26:0/1092822997 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2940fdf30 con 0x7fd27c0640b0 2021-11-03T17:07:17.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.202+0000 7fd282ffd700 1 -- 172.21.15.26:0/1092822997 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fd284019040 con 0x7fd27c0640b0 2021-11-03T17:07:17.197 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:07:17.198 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (18m) 9m ago 19m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:07:17.199 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (10m) 9m ago 19m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:07:17.199 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (10m) 7m ago 19m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:07:17.199 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (18m) 9m ago 19m 38.9M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:07:17.200 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (11m) 9m ago 14m 13.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:07:17.200 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (11m) 9m ago 14m 14.7M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:07:17.200 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (14m) 7m ago 14m 16.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:07:17.200 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (14m) 7m ago 14m 16.5M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:07:17.201 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (12m) 9m ago 21m 468M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:07:17.201 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (11m) 7m ago 18m 412M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:07:17.201 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (11m) 9m ago 21m 75.8M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:07:17.201 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (11m) 7m ago 18m 66.4M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:07:17.201 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (19m) 9m ago 19m 18.1M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:07:17.202 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (18m) 7m ago 18m 18.3M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:07:17.202 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (10m) 9m ago 18m 153M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:07:17.202 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (9m) 9m ago 17m 166M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:07:17.202 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (9m) 9m ago 17m 11.2M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:07:17.203 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (8m) 7m ago 17m 181M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:07:17.203 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (8m) 7m ago 16m 185M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:07:17.203 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (7m) 7m ago 16m 13.5M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:07:17.203 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (18m) 9m ago 19m 47.5M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:07:17.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.204+0000 7fd298fde700 1 -- 172.21.15.26:0/1092822997 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd27c0640b0 msgr2=0x7fd27c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:07:17.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.204+0000 7fd298fde700 1 --2- 172.21.15.26:0/1092822997 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd27c0640b0 0x7fd27c066570 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fd284004630 tx=0x7fd284009b30).stop 2021-11-03T17:07:17.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.204+0000 7fd298fde700 1 -- 172.21.15.26:0/1092822997 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2940f55c0 msgr2=0x7fd294109c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:07:17.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.204+0000 7fd298fde700 1 --2- 172.21.15.26:0/1092822997 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2940f55c0 0x7fd294109c50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fd288002700 tx=0x7fd288009d80).stop 2021-11-03T17:07:17.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.204+0000 7fd298fde700 1 -- 172.21.15.26:0/1092822997 shutdown_connections 2021-11-03T17:07:17.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.204+0000 7fd298fde700 1 --2- 172.21.15.26:0/1092822997 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd27c0640b0 0x7fd27c066570 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:17.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.204+0000 7fd298fde700 1 --2- 172.21.15.26:0/1092822997 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2940f55c0 0x7fd294109c50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:17.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.204+0000 7fd298fde700 1 --2- 172.21.15.26:0/1092822997 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2940f6860 0x7fd29410c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:17.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.204+0000 7fd298fde700 1 -- 172.21.15.26:0/1092822997 >> 172.21.15.26:0/1092822997 conn(0x7fd2940f0d40 msgr2=0x7fd2940fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:07:17.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.204+0000 7fd298fde700 1 -- 172.21.15.26:0/1092822997 shutdown_connections 2021-11-03T17:07:17.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.204+0000 7fd298fde700 1 -- 172.21.15.26:0/1092822997 wait complete. 2021-11-03T17:07:17.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.304+0000 7f9eeb59e700 1 -- 172.21.15.26:0/4092094666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9eec0f9720 msgr2=0x7f9eec0fbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:07:17.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.304+0000 7f9eeb59e700 1 --2- 172.21.15.26:0/4092094666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9eec0f9720 0x7f9eec0fbb10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f9ee0004660 tx=0x7f9ee0009b30).stop 2021-11-03T17:07:17.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.304+0000 7f9eeb59e700 1 -- 172.21.15.26:0/4092094666 shutdown_connections 2021-11-03T17:07:17.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.304+0000 7f9eeb59e700 1 --2- 172.21.15.26:0/4092094666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9eec0f9720 0x7f9eec0fbb10 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:17.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.304+0000 7f9eeb59e700 1 --2- 172.21.15.26:0/4092094666 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9eec060290 0x7f9eec0f91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:17.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.304+0000 7f9eeb59e700 1 -- 172.21.15.26:0/4092094666 >> 172.21.15.26:0/4092094666 conn(0x7f9eec0f0ba0 msgr2=0x7f9eec0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:07:17.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.304+0000 7f9eeb59e700 1 -- 172.21.15.26:0/4092094666 shutdown_connections 2021-11-03T17:07:17.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.304+0000 7f9eeb59e700 1 -- 172.21.15.26:0/4092094666 wait complete. 2021-11-03T17:07:17.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.304+0000 7f9eeb59e700 1 Processor -- start 2021-11-03T17:07:17.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.304+0000 7f9eeb59e700 1 -- start start 2021-11-03T17:07:17.303 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.304+0000 7f9eeb59e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9eec060290 0x7f9eec106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:07:17.303 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.304+0000 7f9eeb59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9eec0f9720 0x7f9eec107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:07:17.303 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.304+0000 7f9eeb59e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec107850 con 0x7f9eec0f9720 2021-11-03T17:07:17.303 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.304+0000 7f9eeb59e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec108060 con 0x7f9eec060290 2021-11-03T17:07:17.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.305+0000 7f9ee9d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9eec0f9720 0x7f9eec107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:07:17.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.305+0000 7f9ee9d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9eec0f9720 0x7f9eec107250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52602/0 (socket says 172.21.15.26:52602) 2021-11-03T17:07:17.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.305+0000 7f9ee9d9b700 1 -- 172.21.15.26:0/1096643249 learned_addr learned my addr 172.21.15.26:0/1096643249 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:07:17.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.305+0000 7f9eea59c700 1 --2- 172.21.15.26:0/1096643249 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9eec060290 0x7f9eec106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:07:17.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.305+0000 7f9ee9d9b700 1 -- 172.21.15.26:0/1096643249 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9eec060290 msgr2=0x7f9eec106d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:07:17.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.305+0000 7f9ee9d9b700 1 --2- 172.21.15.26:0/1096643249 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9eec060290 0x7f9eec106d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:17.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.305+0000 7f9ee9d9b700 1 -- 172.21.15.26:0/1096643249 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee0005040 con 0x7f9eec0f9720 2021-11-03T17:07:17.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.305+0000 7f9ee9d9b700 1 --2- 172.21.15.26:0/1096643249 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9eec0f9720 0x7f9eec107250 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f9ee0014040 tx=0x7f9ee000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:07:17.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.305+0000 7f9edaffd700 1 -- 172.21.15.26:0/1096643249 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ee0019070 con 0x7f9eec0f9720 2021-11-03T17:07:17.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.305+0000 7f9edaffd700 1 -- 172.21.15.26:0/1096643249 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9ee0007e70 con 0x7f9eec0f9720 2021-11-03T17:07:17.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.305+0000 7f9eeb59e700 1 -- 172.21.15.26:0/1096643249 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eec108280 con 0x7f9eec0f9720 2021-11-03T17:07:17.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.305+0000 7f9edaffd700 1 -- 172.21.15.26:0/1096643249 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ee0014d10 con 0x7f9eec0f9720 2021-11-03T17:07:17.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.305+0000 7f9eeb59e700 1 -- 172.21.15.26:0/1096643249 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eec1087e0 con 0x7f9eec0f9720 2021-11-03T17:07:17.307 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.306+0000 7f9eeb59e700 1 -- 172.21.15.26:0/1096643249 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eec059100 con 0x7f9eec0f9720 2021-11-03T17:07:17.308 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.306+0000 7f9edaffd700 1 -- 172.21.15.26:0/1096643249 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f9ee0025070 con 0x7f9eec0f9720 2021-11-03T17:07:17.308 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.307+0000 7f9edaffd700 1 --2- 172.21.15.26:0/1096643249 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9ed4064100 0x7f9ed40665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:07:17.308 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.307+0000 7f9edaffd700 1 -- 172.21.15.26:0/1096643249 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f9ee0081760 con 0x7f9eec0f9720 2021-11-03T17:07:17.308 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.307+0000 7f9eea59c700 1 --2- 172.21.15.26:0/1096643249 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9ed4064100 0x7f9ed40665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:07:17.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.307+0000 7f9eea59c700 1 --2- 172.21.15.26:0/1096643249 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9ed4064100 0x7f9ed40665c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f9eec106ad0 tx=0x7f9edc00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:07:17.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.311+0000 7f9edaffd700 1 -- 172.21.15.26:0/1096643249 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f9ee0053a40 con 0x7f9eec0f9720 2021-11-03T17:07:17.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.541+0000 7f9eeb59e700 1 -- 172.21.15.26:0/1096643249 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9eec045ad0 con 0x7f9eec0f9720 2021-11-03T17:07:17.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.542+0000 7f9edaffd700 1 -- 172.21.15.26:0/1096643249 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f9ee0023070 con 0x7f9eec0f9720 2021-11-03T17:07:17.537 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:07:17.537 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:07:17.538 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:07:17.538 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:07:17.538 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:07:17.538 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:07:17.539 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:07:17.539 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:07:17.539 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:07:17.539 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:07:17.540 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:07:17.540 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:07:17.540 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:07:17.540 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:07:17.540 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:07:17.541 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:07:17.541 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:07:17.541 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:07:17.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.544+0000 7f9eeb59e700 1 -- 172.21.15.26:0/1096643249 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9ed4064100 msgr2=0x7f9ed40665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:07:17.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.544+0000 7f9eeb59e700 1 --2- 172.21.15.26:0/1096643249 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9ed4064100 0x7f9ed40665c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f9eec106ad0 tx=0x7f9edc00b040).stop 2021-11-03T17:07:17.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.544+0000 7f9eeb59e700 1 -- 172.21.15.26:0/1096643249 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9eec0f9720 msgr2=0x7f9eec107250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:07:17.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.544+0000 7f9eeb59e700 1 --2- 172.21.15.26:0/1096643249 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9eec0f9720 0x7f9eec107250 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f9ee0014040 tx=0x7f9ee000b040).stop 2021-11-03T17:07:17.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.544+0000 7f9eeb59e700 1 -- 172.21.15.26:0/1096643249 shutdown_connections 2021-11-03T17:07:17.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.544+0000 7f9eeb59e700 1 --2- 172.21.15.26:0/1096643249 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9ed4064100 0x7f9ed40665c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:17.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.544+0000 7f9eeb59e700 1 --2- 172.21.15.26:0/1096643249 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9eec060290 0x7f9eec106d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:17.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.544+0000 7f9eeb59e700 1 --2- 172.21.15.26:0/1096643249 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9eec0f9720 0x7f9eec107250 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:17.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.544+0000 7f9eeb59e700 1 -- 172.21.15.26:0/1096643249 >> 172.21.15.26:0/1096643249 conn(0x7f9eec0f0ba0 msgr2=0x7f9eec0f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:07:17.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.544+0000 7f9eeb59e700 1 -- 172.21.15.26:0/1096643249 shutdown_connections 2021-11-03T17:07:17.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.544+0000 7f9eeb59e700 1 -- 172.21.15.26:0/1096643249 wait complete. 2021-11-03T17:07:17.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.644+0000 7fb0980fe700 1 -- 172.21.15.26:0/4103183353 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0900f7980 msgr2=0x7fb0900f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:07:17.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.644+0000 7fb0980fe700 1 --2- 172.21.15.26:0/4103183353 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0900f7980 0x7fb0900f7de0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fb08c004660 tx=0x7fb08c009b30).stop 2021-11-03T17:07:17.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.644+0000 7fb0980fe700 1 -- 172.21.15.26:0/4103183353 shutdown_connections 2021-11-03T17:07:17.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.644+0000 7fb0980fe700 1 --2- 172.21.15.26:0/4103183353 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0900f7980 0x7fb0900f7de0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:17.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.644+0000 7fb0980fe700 1 --2- 172.21.15.26:0/4103183353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0900f66e0 0x7fb0900f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:17.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.644+0000 7fb0980fe700 1 -- 172.21.15.26:0/4103183353 >> 172.21.15.26:0/4103183353 conn(0x7fb0900f1e40 msgr2=0x7fb0900f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:07:17.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.644+0000 7fb0980fe700 1 -- 172.21.15.26:0/4103183353 shutdown_connections 2021-11-03T17:07:17.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.644+0000 7fb0980fe700 1 -- 172.21.15.26:0/4103183353 wait complete. 2021-11-03T17:07:17.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.644+0000 7fb0980fe700 1 Processor -- start 2021-11-03T17:07:17.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.644+0000 7fb0980fe700 1 -- start start 2021-11-03T17:07:17.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.645+0000 7fb0980fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0900f66e0 0x7fb09006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:07:17.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.645+0000 7fb0980fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0900f7980 0x7fb090069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:07:17.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.645+0000 7fb0980fe700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09006a380 con 0x7fb0900f7980 2021-11-03T17:07:17.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.645+0000 7fb0980fe700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09006a4c0 con 0x7fb0900f66e0 2021-11-03T17:07:17.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.645+0000 7fb095699700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0900f7980 0x7fb090069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:07:17.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.645+0000 7fb095699700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0900f7980 0x7fb090069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52612/0 (socket says 172.21.15.26:52612) 2021-11-03T17:07:17.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.645+0000 7fb095699700 1 -- 172.21.15.26:0/2485074983 learned_addr learned my addr 172.21.15.26:0/2485074983 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:07:17.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.645+0000 7fb095e9a700 1 --2- 172.21.15.26:0/2485074983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0900f66e0 0x7fb09006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:07:17.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.645+0000 7fb095699700 1 -- 172.21.15.26:0/2485074983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0900f66e0 msgr2=0x7fb09006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:07:17.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.645+0000 7fb095699700 1 --2- 172.21.15.26:0/2485074983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0900f66e0 0x7fb09006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:17.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.645+0000 7fb095699700 1 -- 172.21.15.26:0/2485074983 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08c005040 con 0x7fb0900f7980 2021-11-03T17:07:17.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.645+0000 7fb095699700 1 --2- 172.21.15.26:0/2485074983 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0900f7980 0x7fb090069e20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fb08c009990 tx=0x7fb08c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:07:17.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.645+0000 7fb0867fc700 1 -- 172.21.15.26:0/2485074983 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb08c018070 con 0x7fb0900f7980 2021-11-03T17:07:17.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.645+0000 7fb0867fc700 1 -- 172.21.15.26:0/2485074983 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb08c007ca0 con 0x7fb0900f7980 2021-11-03T17:07:17.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.645+0000 7fb0980fe700 1 -- 172.21.15.26:0/2485074983 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb09006a740 con 0x7fb0900f7980 2021-11-03T17:07:17.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.645+0000 7fb0867fc700 1 -- 172.21.15.26:0/2485074983 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb08c01c620 con 0x7fb0900f7980 2021-11-03T17:07:17.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.645+0000 7fb0980fe700 1 -- 172.21.15.26:0/2485074983 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb09006aca0 con 0x7fb0900f7980 2021-11-03T17:07:17.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.646+0000 7fb0980fe700 1 -- 172.21.15.26:0/2485074983 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb090045ad0 con 0x7fb0900f7980 2021-11-03T17:07:17.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.647+0000 7fb0867fc700 1 -- 172.21.15.26:0/2485074983 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fb08c01d960 con 0x7fb0900f7980 2021-11-03T17:07:17.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.647+0000 7fb0867fc700 1 --2- 172.21.15.26:0/2485074983 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb07c0640b0 0x7fb07c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:07:17.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.647+0000 7fb0867fc700 1 -- 172.21.15.26:0/2485074983 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fb08c0825c0 con 0x7fb0900f7980 2021-11-03T17:07:17.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.648+0000 7fb095e9a700 1 --2- 172.21.15.26:0/2485074983 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb07c0640b0 0x7fb07c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:07:17.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.648+0000 7fb095e9a700 1 --2- 172.21.15.26:0/2485074983 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb07c0640b0 0x7fb07c066570 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fb09006b730 tx=0x7fb080009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:07:17.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.651+0000 7fb0867fc700 1 -- 172.21.15.26:0/2485074983 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fb08c0549a0 con 0x7fb0900f7980 2021-11-03T17:07:17.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.855+0000 7fb0980fe700 1 -- 172.21.15.26:0/2485074983 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb090027a00 con 0x7fb0900f7980 2021-11-03T17:07:17.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.856+0000 7fb0867fc700 1 -- 172.21.15.26:0/2485074983 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fb08c054590 con 0x7fb0900f7980 2021-11-03T17:07:17.851 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:07:17.851 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:07:17.852 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:07:17.852 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:07:17.852 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:07:17.852 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:07:17.852 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:07:17.853 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:07:17.853 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:07:17.853 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:07:17.853 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:07:17.854 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:07:17.854 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:07:17.854 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:07:17.854 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:07:17.854 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:07:17.855 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:07:17.855 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:07:17.855 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:07:17.855 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:07:17.855 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:07:17.856 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:07:17.856 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:07:17.856 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:07:17.856 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:07:17.857 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:07:17.857 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:07:17.857 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:07:17.857 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:07:17.857 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:07:17.859 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:07:17.859 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:07:17.859 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:07:17.859 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:07:17.859 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:07:17.860 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:07:17.860 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:07:17.860 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:07:17.861 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:07:17.862 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.857+0000 7fb0980fe700 1 -- 172.21.15.26:0/2485074983 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb07c0640b0 msgr2=0x7fb07c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:07:17.862 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.857+0000 7fb0980fe700 1 --2- 172.21.15.26:0/2485074983 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb07c0640b0 0x7fb07c066570 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fb09006b730 tx=0x7fb080009040).stop 2021-11-03T17:07:17.863 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.857+0000 7fb0980fe700 1 -- 172.21.15.26:0/2485074983 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0900f7980 msgr2=0x7fb090069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:07:17.863 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.857+0000 7fb0980fe700 1 --2- 172.21.15.26:0/2485074983 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0900f7980 0x7fb090069e20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fb08c009990 tx=0x7fb08c009b30).stop 2021-11-03T17:07:17.863 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.857+0000 7fb0980fe700 1 -- 172.21.15.26:0/2485074983 shutdown_connections 2021-11-03T17:07:17.864 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.857+0000 7fb0980fe700 1 --2- 172.21.15.26:0/2485074983 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb07c0640b0 0x7fb07c066570 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:17.864 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.857+0000 7fb0980fe700 1 --2- 172.21.15.26:0/2485074983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0900f66e0 0x7fb09006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:17.864 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.857+0000 7fb0980fe700 1 --2- 172.21.15.26:0/2485074983 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0900f7980 0x7fb090069e20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:17.865 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.858+0000 7fb0980fe700 1 -- 172.21.15.26:0/2485074983 >> 172.21.15.26:0/2485074983 conn(0x7fb0900f1e40 msgr2=0x7fb0900fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:07:17.865 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.858+0000 7fb0980fe700 1 -- 172.21.15.26:0/2485074983 shutdown_connections 2021-11-03T17:07:17.865 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:17.858+0000 7fb0980fe700 1 -- 172.21.15.26:0/2485074983 wait complete. 2021-11-03T17:07:17.865 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:07:18.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:17 smithi026 ceph-mon[96795]: pgmap v379: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:18.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:17 smithi026 ceph-mon[96795]: from='client.34532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:07:18.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:17 smithi026 ceph-mon[96795]: from='client.34536 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:07:18.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:17 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1096643249' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:07:18.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:17 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2485074983' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:07:18.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:17 smithi194 ceph-mon[65619]: pgmap v379: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:18.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:17 smithi194 ceph-mon[65619]: from='client.34532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:07:18.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:17 smithi194 ceph-mon[65619]: from='client.34536 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:07:18.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:17 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1096643249' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:07:18.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:17 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2485074983' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:07:20.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:19 smithi026 ceph-mon[96795]: pgmap v380: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:20.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:19 smithi194 ceph-mon[65619]: pgmap v380: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:22.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:21 smithi026 ceph-mon[96795]: pgmap v381: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:22.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:21 smithi194 ceph-mon[65619]: pgmap v381: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:24.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:23 smithi026 ceph-mon[96795]: pgmap v382: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:24.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:23 smithi194 ceph-mon[65619]: pgmap v382: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:26.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:25 smithi026 ceph-mon[96795]: pgmap v383: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:26.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:25 smithi194 ceph-mon[65619]: pgmap v383: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:28.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:27 smithi026 ceph-mon[96795]: pgmap v384: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:28.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:27 smithi194 ceph-mon[65619]: pgmap v384: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:28.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:07:28.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:28 smithi026 ceph-mon[96795]: poll took 60063.771 ms: 1 events 2021-11-03T17:07:28.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:07:28.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:07:28.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:07:28.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:07:28.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:07:28.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:07:28.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:07:28.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:07:29.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:07:29.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:28 smithi194 ceph-mon[65619]: poll took 60063.771 ms: 1 events 2021-11-03T17:07:29.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:07:29.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:07:29.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:07:29.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:07:29.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:07:29.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:07:29.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:07:29.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:07:30.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:29 smithi026 ceph-mon[96795]: pgmap v385: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:30.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:29 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:07:30.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:29 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:07:30.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:29 smithi194 ceph-mon[65619]: pgmap v385: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:30.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:29 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:07:30.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:29 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:07:32.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:31 smithi026 ceph-mon[96795]: pgmap v386: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:32.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:31 smithi194 ceph-mon[65619]: pgmap v386: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:34.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:33 smithi026 ceph-mon[96795]: pgmap v387: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:34.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:33 smithi194 ceph-mon[65619]: pgmap v387: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:36.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:35 smithi026 ceph-mon[96795]: pgmap v388: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:36.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:35 smithi194 ceph-mon[65619]: pgmap v388: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:38.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:37 smithi026 ceph-mon[96795]: pgmap v389: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:38.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:37 smithi194 ceph-mon[65619]: pgmap v389: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:40.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:39 smithi026 ceph-mon[96795]: pgmap v390: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:40.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:39 smithi194 ceph-mon[65619]: pgmap v390: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:42.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:41 smithi026 ceph-mon[96795]: pgmap v391: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:42.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:41 smithi194 ceph-mon[65619]: pgmap v391: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:44.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:43 smithi026 ceph-mon[96795]: pgmap v392: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:44.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:43 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:07:44.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:43 smithi194 ceph-mon[65619]: pgmap v392: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:44.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:43 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:07:45.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:44 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:07:45.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:44 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:07:46.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:45 smithi026 ceph-mon[96795]: pgmap v393: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:46.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:45 smithi194 ceph-mon[65619]: pgmap v393: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:47.970 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:47.972+0000 7f7ffda6e700 1 -- 172.21.15.26:0/3190413719 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ff80f6860 msgr2=0x7f7ff80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:07:47.970 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:47.972+0000 7f7ffda6e700 1 --2- 172.21.15.26:0/3190413719 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ff80f6860 0x7f7ff80f6cc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f7fec004660 tx=0x7f7fec009b30).stop 2021-11-03T17:07:47.970 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:47.972+0000 7f7ffda6e700 1 -- 172.21.15.26:0/3190413719 shutdown_connections 2021-11-03T17:07:47.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:47.972+0000 7f7ffda6e700 1 --2- 172.21.15.26:0/3190413719 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ff80f6860 0x7f7ff80f6cc0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:47.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:47.972+0000 7f7ffda6e700 1 --2- 172.21.15.26:0/3190413719 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ff80f55c0 0x7f7ff80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:47.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:47.972+0000 7f7ffda6e700 1 -- 172.21.15.26:0/3190413719 >> 172.21.15.26:0/3190413719 conn(0x7f7ff80f0d40 msgr2=0x7f7ff80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:07:47.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:47.972+0000 7f7ffda6e700 1 -- 172.21.15.26:0/3190413719 shutdown_connections 2021-11-03T17:07:47.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:47.972+0000 7f7ffda6e700 1 -- 172.21.15.26:0/3190413719 wait complete. 2021-11-03T17:07:47.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:47.973+0000 7f7ffda6e700 1 Processor -- start 2021-11-03T17:07:47.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:47.973+0000 7f7ffda6e700 1 -- start start 2021-11-03T17:07:47.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:47.973+0000 7f7ffda6e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ff80f55c0 0x7f7ff8109180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:07:47.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:47.973+0000 7f7ffda6e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ff80f6860 0x7f7ff8109670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:07:47.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:47.973+0000 7f7ffda6e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff8109c20 con 0x7f7ff80f55c0 2021-11-03T17:07:47.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:47.973+0000 7f7ffda6e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff8109d60 con 0x7f7ff80f6860 2021-11-03T17:07:47.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:47.973+0000 7f7ff77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ff80f55c0 0x7f7ff8109180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:07:47.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:47.973+0000 7f7ff77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ff80f55c0 0x7f7ff8109180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52626/0 (socket says 172.21.15.26:52626) 2021-11-03T17:07:47.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:47.973+0000 7f7ff77fe700 1 -- 172.21.15.26:0/1126131801 learned_addr learned my addr 172.21.15.26:0/1126131801 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:07:47.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:47.974+0000 7f7ff6ffd700 1 --2- 172.21.15.26:0/1126131801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ff80f6860 0x7f7ff8109670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:07:47.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:47.974+0000 7f7ff77fe700 1 -- 172.21.15.26:0/1126131801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ff80f6860 msgr2=0x7f7ff8109670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:07:47.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:47.974+0000 7f7ff77fe700 1 --2- 172.21.15.26:0/1126131801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ff80f6860 0x7f7ff8109670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:47.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:47.974+0000 7f7ff77fe700 1 -- 172.21.15.26:0/1126131801 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fec005040 con 0x7f7ff80f55c0 2021-11-03T17:07:47.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:47.974+0000 7f7ff6ffd700 1 --2- 172.21.15.26:0/1126131801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ff80f6860 0x7f7ff8109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:07:47.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:47.974+0000 7f7ff77fe700 1 --2- 172.21.15.26:0/1126131801 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ff80f55c0 0x7f7ff8109180 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f7fe8002700 tx=0x7f7fe8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:07:47.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:47.974+0000 7f7fdffff700 1 -- 172.21.15.26:0/1126131801 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fe8009320 con 0x7f7ff80f55c0 2021-11-03T17:07:47.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:47.974+0000 7f7ffda6e700 1 -- 172.21.15.26:0/1126131801 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ff810a700 con 0x7f7ff80f55c0 2021-11-03T17:07:47.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:47.974+0000 7f7fdffff700 1 -- 172.21.15.26:0/1126131801 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7fe800f040 con 0x7f7ff80f55c0 2021-11-03T17:07:47.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:47.974+0000 7f7fdffff700 1 -- 172.21.15.26:0/1126131801 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fe8014900 con 0x7f7ff80f55c0 2021-11-03T17:07:47.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:47.974+0000 7f7ffda6e700 1 -- 172.21.15.26:0/1126131801 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ff810acc0 con 0x7f7ff80f55c0 2021-11-03T17:07:47.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:47.975+0000 7f7ffda6e700 1 -- 172.21.15.26:0/1126131801 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ff8045ad0 con 0x7f7ff80f55c0 2021-11-03T17:07:47.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:47.976+0000 7f7fdffff700 1 -- 172.21.15.26:0/1126131801 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f7fe8009480 con 0x7f7ff80f55c0 2021-11-03T17:07:47.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:47.976+0000 7f7fdffff700 1 --2- 172.21.15.26:0/1126131801 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7fe00640b0 0x7f7fe0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:07:47.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:47.976+0000 7f7fdffff700 1 -- 172.21.15.26:0/1126131801 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f7fe8080a80 con 0x7f7ff80f55c0 2021-11-03T17:07:47.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:47.976+0000 7f7ff6ffd700 1 --2- 172.21.15.26:0/1126131801 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7fe00640b0 0x7f7fe0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:07:47.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:47.977+0000 7f7ff6ffd700 1 --2- 172.21.15.26:0/1126131801 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7fe00640b0 0x7f7fe0066570 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f7fec004630 tx=0x7f7fec009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:07:47.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:47.980+0000 7f7fdffff700 1 -- 172.21.15.26:0/1126131801 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f7fe8052de0 con 0x7f7ff80f55c0 2021-11-03T17:07:48.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.168+0000 7f7ffda6e700 1 -- 172.21.15.26:0/1126131801 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ff80faaa0 con 0x7f7fe00640b0 2021-11-03T17:07:48.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.169+0000 7f7fdffff700 1 -- 172.21.15.26:0/1126131801 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f7ff80faaa0 con 0x7f7fe00640b0 2021-11-03T17:07:48.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.171+0000 7f7ffda6e700 1 -- 172.21.15.26:0/1126131801 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7fe00640b0 msgr2=0x7f7fe0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:07:48.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.171+0000 7f7ffda6e700 1 --2- 172.21.15.26:0/1126131801 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7fe00640b0 0x7f7fe0066570 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f7fec004630 tx=0x7f7fec009b30).stop 2021-11-03T17:07:48.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.171+0000 7f7ffda6e700 1 -- 172.21.15.26:0/1126131801 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ff80f55c0 msgr2=0x7f7ff8109180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:07:48.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.171+0000 7f7ffda6e700 1 --2- 172.21.15.26:0/1126131801 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ff80f55c0 0x7f7ff8109180 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f7fe8002700 tx=0x7f7fe8009d80).stop 2021-11-03T17:07:48.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.171+0000 7f7ffda6e700 1 -- 172.21.15.26:0/1126131801 shutdown_connections 2021-11-03T17:07:48.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.171+0000 7f7ffda6e700 1 --2- 172.21.15.26:0/1126131801 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7fe00640b0 0x7f7fe0066570 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:48.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.171+0000 7f7ffda6e700 1 --2- 172.21.15.26:0/1126131801 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ff80f55c0 0x7f7ff8109180 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:48.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.171+0000 7f7ffda6e700 1 --2- 172.21.15.26:0/1126131801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ff80f6860 0x7f7ff8109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:48.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.171+0000 7f7ffda6e700 1 -- 172.21.15.26:0/1126131801 >> 172.21.15.26:0/1126131801 conn(0x7f7ff80f0d40 msgr2=0x7f7ff805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:07:48.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.171+0000 7f7ffda6e700 1 -- 172.21.15.26:0/1126131801 shutdown_connections 2021-11-03T17:07:48.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.171+0000 7f7ffda6e700 1 -- 172.21.15.26:0/1126131801 wait complete. 2021-11-03T17:07:48.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:47 smithi026 ceph-mon[96795]: pgmap v394: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:48.176 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:07:48.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:47 smithi194 ceph-mon[65619]: pgmap v394: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:48.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.272+0000 7f29cb59e700 1 -- 172.21.15.26:0/3389053514 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29cc0f66d0 msgr2=0x7f29cc0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:07:48.270 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.272+0000 7f29cb59e700 1 --2- 172.21.15.26:0/3389053514 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29cc0f66d0 0x7f29cc0f6b30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f29c0004660 tx=0x7f29c0009b30).stop 2021-11-03T17:07:48.270 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.272+0000 7f29cb59e700 1 -- 172.21.15.26:0/3389053514 shutdown_connections 2021-11-03T17:07:48.270 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.272+0000 7f29cb59e700 1 --2- 172.21.15.26:0/3389053514 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29cc0f66d0 0x7f29cc0f6b30 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:48.270 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.272+0000 7f29cb59e700 1 --2- 172.21.15.26:0/3389053514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29cc0f5430 0x7f29cc0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:48.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.272+0000 7f29cb59e700 1 -- 172.21.15.26:0/3389053514 >> 172.21.15.26:0/3389053514 conn(0x7f29cc0f0b90 msgr2=0x7f29cc0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:07:48.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.272+0000 7f29cb59e700 1 -- 172.21.15.26:0/3389053514 shutdown_connections 2021-11-03T17:07:48.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.272+0000 7f29cb59e700 1 -- 172.21.15.26:0/3389053514 wait complete. 2021-11-03T17:07:48.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.273+0000 7f29cb59e700 1 Processor -- start 2021-11-03T17:07:48.272 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.273+0000 7f29cb59e700 1 -- start start 2021-11-03T17:07:48.272 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.273+0000 7f29cb59e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29cc0f5430 0x7f29cc10be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:07:48.272 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.273+0000 7f29cb59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29cc0f66d0 0x7f29cc10e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:07:48.272 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.273+0000 7f29cb59e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc0602b0 con 0x7f29cc0f66d0 2021-11-03T17:07:48.273 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.273+0000 7f29cb59e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc0603f0 con 0x7f29cc0f5430 2021-11-03T17:07:48.273 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.273+0000 7f29c9d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29cc0f66d0 0x7f29cc10e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:07:48.273 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.273+0000 7f29c9d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29cc0f66d0 0x7f29cc10e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52638/0 (socket says 172.21.15.26:52638) 2021-11-03T17:07:48.273 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.273+0000 7f29c9d9b700 1 -- 172.21.15.26:0/151442713 learned_addr learned my addr 172.21.15.26:0/151442713 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:07:48.274 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.273+0000 7f29ca59c700 1 --2- 172.21.15.26:0/151442713 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29cc0f5430 0x7f29cc10be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:07:48.274 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.273+0000 7f29c9d9b700 1 -- 172.21.15.26:0/151442713 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29cc0f5430 msgr2=0x7f29cc10be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:07:48.274 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.273+0000 7f29c9d9b700 1 --2- 172.21.15.26:0/151442713 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29cc0f5430 0x7f29cc10be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:48.274 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.273+0000 7f29c9d9b700 1 -- 172.21.15.26:0/151442713 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c0005040 con 0x7f29cc0f66d0 2021-11-03T17:07:48.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.273+0000 7f29ca59c700 1 --2- 172.21.15.26:0/151442713 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29cc0f5430 0x7f29cc10be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:07:48.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.273+0000 7f29c9d9b700 1 --2- 172.21.15.26:0/151442713 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29cc0f66d0 0x7f29cc10e340 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f29c0009da0 tx=0x7f29c0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:07:48.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.273+0000 7f29baffd700 1 -- 172.21.15.26:0/151442713 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29c0018070 con 0x7f29cc0f66d0 2021-11-03T17:07:48.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.273+0000 7f29baffd700 1 -- 172.21.15.26:0/151442713 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f29c0007d70 con 0x7f29cc0f66d0 2021-11-03T17:07:48.276 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.273+0000 7f29cb59e700 1 -- 172.21.15.26:0/151442713 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29cc10e830 con 0x7f29cc0f66d0 2021-11-03T17:07:48.276 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.274+0000 7f29baffd700 1 -- 172.21.15.26:0/151442713 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29c001dea0 con 0x7f29cc0f66d0 2021-11-03T17:07:48.276 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.274+0000 7f29cb59e700 1 -- 172.21.15.26:0/151442713 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29cc10ec00 con 0x7f29cc0f66d0 2021-11-03T17:07:48.277 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.274+0000 7f29cb59e700 1 -- 172.21.15.26:0/151442713 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29cc059100 con 0x7f29cc0f66d0 2021-11-03T17:07:48.277 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.275+0000 7f29baffd700 1 -- 172.21.15.26:0/151442713 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f29c001d420 con 0x7f29cc0f66d0 2021-11-03T17:07:48.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.275+0000 7f29baffd700 1 --2- 172.21.15.26:0/151442713 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f29b4064100 0x7f29b40665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:07:48.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.275+0000 7f29baffd700 1 -- 172.21.15.26:0/151442713 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f29c0082670 con 0x7f29cc0f66d0 2021-11-03T17:07:48.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.276+0000 7f29ca59c700 1 --2- 172.21.15.26:0/151442713 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f29b4064100 0x7f29b40665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:07:48.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.276+0000 7f29ca59c700 1 --2- 172.21.15.26:0/151442713 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f29b4064100 0x7f29b40665c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f29cc060040 tx=0x7f29bc009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:07:48.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.279+0000 7f29baffd700 1 -- 172.21.15.26:0/151442713 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f29c0054a90 con 0x7f29cc0f66d0 2021-11-03T17:07:48.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.453+0000 7f29cb59e700 1 -- 172.21.15.26:0/151442713 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f29cc0fdc60 con 0x7f29b4064100 2021-11-03T17:07:48.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.471+0000 7f29baffd700 1 -- 172.21.15.26:0/151442713 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f29cc0fdc60 con 0x7f29b4064100 2021-11-03T17:07:48.467 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:07:48.468 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (19m) 9m ago 20m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:07:48.468 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (11m) 9m ago 20m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:07:48.468 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (11m) 8m ago 19m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:07:48.468 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (18m) 9m ago 19m 38.9M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:07:48.469 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (12m) 9m ago 15m 13.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:07:48.469 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (12m) 9m ago 15m 14.7M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:07:48.469 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (15m) 8m ago 15m 16.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:07:48.470 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (15m) 8m ago 15m 16.5M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:07:48.470 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (12m) 9m ago 21m 468M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:07:48.470 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (12m) 8m ago 19m 412M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:07:48.470 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (12m) 9m ago 21m 75.8M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:07:48.470 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (11m) 8m ago 19m 66.4M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:07:48.471 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (19m) 9m ago 19m 18.1M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:07:48.471 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (19m) 8m ago 19m 18.3M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:07:48.471 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (10m) 9m ago 18m 153M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:07:48.471 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (10m) 9m ago 18m 166M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:07:48.472 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (9m) 9m ago 17m 11.2M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:07:48.472 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (9m) 8m ago 17m 181M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:07:48.472 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (8m) 8m ago 17m 185M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:07:48.472 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (8m) 8m ago 17m 13.5M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:07:48.472 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (18m) 9m ago 19m 47.5M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:07:48.473 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.473+0000 7f29cb59e700 1 -- 172.21.15.26:0/151442713 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f29b4064100 msgr2=0x7f29b40665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:07:48.474 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.473+0000 7f29cb59e700 1 --2- 172.21.15.26:0/151442713 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f29b4064100 0x7f29b40665c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f29cc060040 tx=0x7f29bc009040).stop 2021-11-03T17:07:48.474 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.473+0000 7f29cb59e700 1 -- 172.21.15.26:0/151442713 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29cc0f66d0 msgr2=0x7f29cc10e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:07:48.474 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.473+0000 7f29cb59e700 1 --2- 172.21.15.26:0/151442713 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29cc0f66d0 0x7f29cc10e340 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f29c0009da0 tx=0x7f29c0009b30).stop 2021-11-03T17:07:48.474 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.473+0000 7f29cb59e700 1 -- 172.21.15.26:0/151442713 shutdown_connections 2021-11-03T17:07:48.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.473+0000 7f29cb59e700 1 --2- 172.21.15.26:0/151442713 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f29b4064100 0x7f29b40665c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:48.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.473+0000 7f29cb59e700 1 --2- 172.21.15.26:0/151442713 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29cc0f5430 0x7f29cc10be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:48.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.473+0000 7f29cb59e700 1 --2- 172.21.15.26:0/151442713 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29cc0f66d0 0x7f29cc10e340 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:48.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.473+0000 7f29cb59e700 1 -- 172.21.15.26:0/151442713 >> 172.21.15.26:0/151442713 conn(0x7f29cc0f0b90 msgr2=0x7f29cc0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:07:48.476 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.473+0000 7f29cb59e700 1 -- 172.21.15.26:0/151442713 shutdown_connections 2021-11-03T17:07:48.476 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.473+0000 7f29cb59e700 1 -- 172.21.15.26:0/151442713 wait complete. 2021-11-03T17:07:48.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.573+0000 7fcef0abc700 1 -- 172.21.15.26:0/1397039673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fceec060350 msgr2=0x7fceec0f9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:07:48.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.573+0000 7fcef0abc700 1 --2- 172.21.15.26:0/1397039673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fceec060350 0x7fceec0f9350 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7fcee4004660 tx=0x7fcee4009b30).stop 2021-11-03T17:07:48.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.573+0000 7fcef0abc700 1 -- 172.21.15.26:0/1397039673 shutdown_connections 2021-11-03T17:07:48.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.573+0000 7fcef0abc700 1 --2- 172.21.15.26:0/1397039673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fceec0f9840 0x7fceec0fbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:07:48.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.573+0000 7fcef0abc700 1 --2- 172.21.15.26:0/1397039673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fceec060350 0x7fceec0f9350 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:48.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.573+0000 7fcef0abc700 1 -- 172.21.15.26:0/1397039673 >> 172.21.15.26:0/1397039673 conn(0x7fceec0f0d70 msgr2=0x7fceec0f3190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:07:48.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.573+0000 7fcef0abc700 1 -- 172.21.15.26:0/1397039673 shutdown_connections 2021-11-03T17:07:48.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.573+0000 7fcef0abc700 1 -- 172.21.15.26:0/1397039673 wait complete. 2021-11-03T17:07:48.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.573+0000 7fcef0abc700 1 Processor -- start 2021-11-03T17:07:48.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.574+0000 7fcef0abc700 1 -- start start 2021-11-03T17:07:48.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.574+0000 7fcef0abc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fceec060350 0x7fceec106f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:07:48.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.574+0000 7fcef0abc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fceec0f9840 0x7fceec107440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:07:48.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.574+0000 7fcef0abc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceec107a80 con 0x7fceec0f9840 2021-11-03T17:07:48.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.574+0000 7fcef0abc700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceec108330 con 0x7fceec060350 2021-11-03T17:07:48.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.574+0000 7fcee9d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fceec0f9840 0x7fceec107440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:07:48.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.574+0000 7fcee9d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fceec0f9840 0x7fceec107440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52648/0 (socket says 172.21.15.26:52648) 2021-11-03T17:07:48.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.574+0000 7fcee9d9b700 1 -- 172.21.15.26:0/2082184889 learned_addr learned my addr 172.21.15.26:0/2082184889 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:07:48.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.574+0000 7fcee9d9b700 1 -- 172.21.15.26:0/2082184889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fceec060350 msgr2=0x7fceec106f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:07:48.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.574+0000 7fcee9d9b700 1 --2- 172.21.15.26:0/2082184889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fceec060350 0x7fceec106f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:07:48.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.574+0000 7fcee9d9b700 1 -- 172.21.15.26:0/2082184889 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee4005040 con 0x7fceec0f9840 2021-11-03T17:07:48.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.574+0000 7fcee9d9b700 1 --2- 172.21.15.26:0/2082184889 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fceec0f9840 0x7fceec107440 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fced40093f0 tx=0x7fced4006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:07:48.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.574+0000 7fcee2ffd700 1 -- 172.21.15.26:0/2082184889 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fced4009ea0 con 0x7fceec0f9840 2021-11-03T17:07:48.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.574+0000 7fcee2ffd700 1 -- 172.21.15.26:0/2082184889 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fced4013af0 con 0x7fceec0f9840 2021-11-03T17:07:48.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.574+0000 7fcef0abc700 1 -- 172.21.15.26:0/2082184889 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceec108610 con 0x7fceec0f9840 2021-11-03T17:07:48.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.574+0000 7fcee2ffd700 1 -- 172.21.15.26:0/2082184889 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fced400db10 con 0x7fceec0f9840 2021-11-03T17:07:48.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.575+0000 7fcef0abc700 1 -- 172.21.15.26:0/2082184889 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceec108bd0 con 0x7fceec0f9840 2021-11-03T17:07:48.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.575+0000 7fcef0abc700 1 -- 172.21.15.26:0/2082184889 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceec0f49c0 con 0x7fceec0f9840 2021-11-03T17:07:48.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.576+0000 7fcee2ffd700 1 -- 172.21.15.26:0/2082184889 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fced401a060 con 0x7fceec0f9840 2021-11-03T17:07:48.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.576+0000 7fcee2ffd700 1 --2- 172.21.15.26:0/2082184889 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fced80640b0 0x7fced8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:07:48.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.576+0000 7fcee2ffd700 1 -- 172.21.15.26:0/2082184889 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fced4080810 con 0x7fceec0f9840 2021-11-03T17:07:48.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.576+0000 7fceea59c700 1 --2- 172.21.15.26:0/2082184889 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fced80640b0 0x7fced8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:07:48.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.577+0000 7fceea59c700 1 --2- 172.21.15.26:0/2082184889 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fced80640b0 0x7fced8066570 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fcee4004e30 tx=0x7fcee4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:07:48.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.580+0000 7fcee2ffd700 1 -- 172.21.15.26:0/2082184889 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fced4052a80 con 0x7fceec0f9840 2021-11-03T17:07:48.806 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.810+0000 7fcef0abc700 1 -- 172.21.15.26:0/2082184889 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fceec045ad0 con 0x7fceec0f9840 2021-11-03T17:07:48.807 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.811+0000 7fcee2ffd700 1 -- 172.21.15.26:0/2082184889 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fced407ee60 con 0x7fceec0f9840 2021-11-03T17:07:48.807 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:07:48.807 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:07:48.807 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:07:48.808 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:07:48.808 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:07:48.808 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:07:48.808 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:07:48.809 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:07:48.809 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:07:48.809 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:07:48.809 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:07:48.810 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:07:48.810 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:07:48.810 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:07:48.810 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:07:48.810 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:07:48.811 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:07:48.811 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:07:48.812 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.812+0000 7fcef0abc700 1 -- 172.21.15.26:0/2082184889 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fced80640b0 msgr2=0x7fced8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:07:48.812 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.812+0000 7fcef0abc700 1 --2- 172.21.15.26:0/2082184889 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fced80640b0 0x7fced8066570 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fcee4004e30 tx=0x7fcee4009b30).stop 2021-11-03T17:07:48.812 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.812+0000 7fcef0abc700 1 -- 172.21.15.26:0/2082184889 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fceec0f9840 msgr2=0x7fceec107440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:07:48.813 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.812+0000 7fcef0abc700 1 --2- 172.21.15.26:0/2082184889 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fceec0f9840 0x7fceec107440 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fced40093f0 tx=0x7fced4006ec0).stop 2021-11-03T17:07:48.813 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.812+0000 7fcef0abc700 1 -- 172.21.15.26:0/2082184889 shutdown_connections 2021-11-03T17:07:48.813 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.812+0000 7fcef0abc700 1 --2- 172.21.15.26:0/2082184889 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fced80640b0 0x7fced8066570 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:48.813 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.812+0000 7fcef0abc700 1 --2- 172.21.15.26:0/2082184889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fceec060350 0x7fceec106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:07:48.813 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.812+0000 7fcef0abc700 1 --2- 172.21.15.26:0/2082184889 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fceec0f9840 0x7fceec107440 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:48.814 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.812+0000 7fcef0abc700 1 -- 172.21.15.26:0/2082184889 >> 172.21.15.26:0/2082184889 conn(0x7fceec0f0d70 msgr2=0x7fceec0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:07:48.814 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.813+0000 7fcef0abc700 1 -- 172.21.15.26:0/2082184889 shutdown_connections 2021-11-03T17:07:48.814 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.813+0000 7fcef0abc700 1 -- 172.21.15.26:0/2082184889 wait complete. 2021-11-03T17:07:48.910 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.914+0000 7fe13683f700 1 -- 172.21.15.26:0/3583502599 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1300f66e0 msgr2=0x7fe1300f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:07:48.910 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.914+0000 7fe13683f700 1 --2- 172.21.15.26:0/3583502599 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1300f66e0 0x7fe1300f6b00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fe120004660 tx=0x7fe120009b30).stop 2021-11-03T17:07:48.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.914+0000 7fe13683f700 1 -- 172.21.15.26:0/3583502599 shutdown_connections 2021-11-03T17:07:48.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.914+0000 7fe13683f700 1 --2- 172.21.15.26:0/3583502599 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1300f7980 0x7fe1300f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:48.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.914+0000 7fe13683f700 1 --2- 172.21.15.26:0/3583502599 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1300f66e0 0x7fe1300f6b00 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:48.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.914+0000 7fe13683f700 1 -- 172.21.15.26:0/3583502599 >> 172.21.15.26:0/3583502599 conn(0x7fe1300f1e40 msgr2=0x7fe1300f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:07:48.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.914+0000 7fe13683f700 1 -- 172.21.15.26:0/3583502599 shutdown_connections 2021-11-03T17:07:48.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.914+0000 7fe13683f700 1 -- 172.21.15.26:0/3583502599 wait complete. 2021-11-03T17:07:48.914 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.915+0000 7fe13683f700 1 Processor -- start 2021-11-03T17:07:48.914 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.915+0000 7fe13683f700 1 -- start start 2021-11-03T17:07:48.915 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.915+0000 7fe13683f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1300f66e0 0x7fe130106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:07:48.915 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.915+0000 7fe13683f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1300f7980 0x7fe130107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:07:48.915 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.915+0000 7fe13683f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe130107a10 con 0x7fe1300f7980 2021-11-03T17:07:48.915 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.915+0000 7fe13683f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe130107b50 con 0x7fe1300f66e0 2021-11-03T17:07:48.916 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.916+0000 7fe12f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1300f7980 0x7fe130107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:07:48.916 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.916+0000 7fe12f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1300f7980 0x7fe130107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52656/0 (socket says 172.21.15.26:52656) 2021-11-03T17:07:48.916 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.916+0000 7fe12f7fe700 1 -- 172.21.15.26:0/3371665557 learned_addr learned my addr 172.21.15.26:0/3371665557 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:07:48.916 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.916+0000 7fe12ffff700 1 --2- 172.21.15.26:0/3371665557 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1300f66e0 0x7fe130106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:07:48.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.916+0000 7fe12f7fe700 1 -- 172.21.15.26:0/3371665557 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1300f66e0 msgr2=0x7fe130106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:07:48.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.916+0000 7fe12f7fe700 1 --2- 172.21.15.26:0/3371665557 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1300f66e0 0x7fe130106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:48.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.916+0000 7fe12f7fe700 1 -- 172.21.15.26:0/3371665557 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe120005040 con 0x7fe1300f7980 2021-11-03T17:07:48.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.916+0000 7fe12f7fe700 1 --2- 172.21.15.26:0/3371665557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1300f7980 0x7fe130107460 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fe1240026d0 tx=0x7fe124009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:07:48.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.917+0000 7fe12cff9700 1 -- 172.21.15.26:0/3371665557 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1240079c0 con 0x7fe1300f7980 2021-11-03T17:07:48.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.917+0000 7fe13683f700 1 -- 172.21.15.26:0/3371665557 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1301084f0 con 0x7fe1300f7980 2021-11-03T17:07:48.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.917+0000 7fe12cff9700 1 -- 172.21.15.26:0/3371665557 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe12400f040 con 0x7fe1300f7980 2021-11-03T17:07:48.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.917+0000 7fe13683f700 1 -- 172.21.15.26:0/3371665557 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe130108ab0 con 0x7fe1300f7980 2021-11-03T17:07:48.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.917+0000 7fe12cff9700 1 -- 172.21.15.26:0/3371665557 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1240148b0 con 0x7fe1300f7980 2021-11-03T17:07:48.919 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.918+0000 7fe13683f700 1 -- 172.21.15.26:0/3371665557 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe130045ad0 con 0x7fe1300f7980 2021-11-03T17:07:48.919 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.918+0000 7fe12cff9700 1 -- 172.21.15.26:0/3371665557 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fe124014a10 con 0x7fe1300f7980 2021-11-03T17:07:48.919 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.918+0000 7fe12cff9700 1 --2- 172.21.15.26:0/3371665557 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe118064090 0x7fe118066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:07:48.919 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.919+0000 7fe12cff9700 1 -- 172.21.15.26:0/3371665557 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fe124080680 con 0x7fe1300f7980 2021-11-03T17:07:48.920 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.919+0000 7fe12ffff700 1 --2- 172.21.15.26:0/3371665557 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe118064090 0x7fe118066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:07:48.920 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.919+0000 7fe12ffff700 1 --2- 172.21.15.26:0/3371665557 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe118064090 0x7fe118066550 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fe120013690 tx=0x7fe120009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:07:48.920 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:48.923+0000 7fe12cff9700 1 -- 172.21.15.26:0/3371665557 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fe1240529e0 con 0x7fe1300f7980 2021-11-03T17:07:49.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:49.127+0000 7fe13683f700 1 -- 172.21.15.26:0/3371665557 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe130108680 con 0x7fe1300f7980 2021-11-03T17:07:49.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:49.127+0000 7fe12cff9700 1 -- 172.21.15.26:0/3371665557 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fe130108680 con 0x7fe1300f7980 2021-11-03T17:07:49.124 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:07:49.124 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:07:49.124 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:07:49.124 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:07:49.125 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:07:49.125 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:07:49.125 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:07:49.125 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:07:49.126 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:07:49.126 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:07:49.126 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:07:49.126 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:07:49.127 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:07:49.127 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:07:49.127 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:07:49.127 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:07:49.128 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:07:49.128 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:07:49.128 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:07:49.128 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:07:49.129 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:07:49.129 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:07:49.129 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:07:49.129 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:07:49.129 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:07:49.130 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:07:49.130 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:07:49.130 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:07:49.131 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:07:49.131 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:07:49.131 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:07:49.131 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:07:49.131 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:07:49.132 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:07:49.132 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:07:49.132 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:07:49.132 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:07:49.133 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:07:49.133 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:07:49.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:49.129+0000 7fe13683f700 1 -- 172.21.15.26:0/3371665557 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe118064090 msgr2=0x7fe118066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:07:49.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:49.129+0000 7fe13683f700 1 --2- 172.21.15.26:0/3371665557 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe118064090 0x7fe118066550 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fe120013690 tx=0x7fe120009b30).stop 2021-11-03T17:07:49.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:49.129+0000 7fe13683f700 1 -- 172.21.15.26:0/3371665557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1300f7980 msgr2=0x7fe130107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:07:49.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:49.129+0000 7fe13683f700 1 --2- 172.21.15.26:0/3371665557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1300f7980 0x7fe130107460 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fe1240026d0 tx=0x7fe124009de0).stop 2021-11-03T17:07:49.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:49.129+0000 7fe13683f700 1 -- 172.21.15.26:0/3371665557 shutdown_connections 2021-11-03T17:07:49.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:49.129+0000 7fe13683f700 1 --2- 172.21.15.26:0/3371665557 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe118064090 0x7fe118066550 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:49.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:49.129+0000 7fe13683f700 1 --2- 172.21.15.26:0/3371665557 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1300f66e0 0x7fe130106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:49.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:49.129+0000 7fe13683f700 1 --2- 172.21.15.26:0/3371665557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1300f7980 0x7fe130107460 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:07:49.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:49.129+0000 7fe13683f700 1 -- 172.21.15.26:0/3371665557 >> 172.21.15.26:0/3371665557 conn(0x7fe1300f1e40 msgr2=0x7fe1300fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:07:49.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:49.130+0000 7fe13683f700 1 -- 172.21.15.26:0/3371665557 shutdown_connections 2021-11-03T17:07:49.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:07:49.130+0000 7fe13683f700 1 -- 172.21.15.26:0/3371665557 wait complete. 2021-11-03T17:07:49.137 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:07:49.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:07:49.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:07:49.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:48 smithi026 ceph-mon[96795]: from='client.34548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:07:49.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:48 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2082184889' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:07:49.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:07:49.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:07:49.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:48 smithi194 ceph-mon[65619]: from='client.34548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:07:49.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:48 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2082184889' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:07:50.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:49 smithi026 ceph-mon[96795]: from='client.34552 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:07:50.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:49 smithi026 ceph-mon[96795]: pgmap v395: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:50.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:49 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3371665557' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:07:50.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:49 smithi194 ceph-mon[65619]: from='client.34552 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:07:50.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:49 smithi194 ceph-mon[65619]: pgmap v395: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:50.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:49 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3371665557' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:07:52.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:51 smithi026 ceph-mon[96795]: pgmap v396: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:52.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:51 smithi194 ceph-mon[65619]: pgmap v396: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:54.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:53 smithi026 ceph-mon[96795]: pgmap v397: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:54.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:53 smithi194 ceph-mon[65619]: pgmap v397: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:56.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:55 smithi026 ceph-mon[96795]: pgmap v398: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:56.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:55 smithi194 ceph-mon[65619]: pgmap v398: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:58.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:57 smithi194 ceph-mon[65619]: pgmap v399: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:58.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:57 smithi026 ceph-mon[96795]: pgmap v399: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:07:59.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:58 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:07:59.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:58 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:08:00.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:59 smithi194 ceph-mon[65619]: pgmap v400: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:00.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:07:59 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:08:00.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:59 smithi026 ceph-mon[96795]: pgmap v400: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:00.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:07:59 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:08:02.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:01 smithi194 ceph-mon[65619]: pgmap v401: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:02.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:01 smithi026 ceph-mon[96795]: pgmap v401: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:04.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:03 smithi194 ceph-mon[65619]: pgmap v402: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:04.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:03 smithi026 ceph-mon[96795]: pgmap v402: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:06.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:05 smithi194 ceph-mon[65619]: pgmap v403: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:06.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:05 smithi026 ceph-mon[96795]: pgmap v403: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:08.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:07 smithi194 ceph-mon[65619]: pgmap v404: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:08.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:07 smithi026 ceph-mon[96795]: pgmap v404: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:10.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:09 smithi194 ceph-mon[65619]: pgmap v405: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:10.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:09 smithi026 ceph-mon[96795]: pgmap v405: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:12.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:11 smithi194 ceph-mon[65619]: pgmap v406: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:12.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:11 smithi026 ceph-mon[96795]: pgmap v406: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:14.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:13 smithi194 ceph-mon[65619]: pgmap v407: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:14.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:13 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:08:14.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:13 smithi026 ceph-mon[96795]: pgmap v407: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:14.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:13 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:08:15.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:14 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:08:15.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:14 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:08:16.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:15 smithi194 ceph-mon[65619]: pgmap v408: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:16.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:15 smithi026 ceph-mon[96795]: pgmap v408: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:18.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:17 smithi194 ceph-mon[65619]: pgmap v409: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:18.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:17 smithi026 ceph-mon[96795]: pgmap v409: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:19.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.245+0000 7fab67226700 1 -- 172.21.15.26:0/2928222484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab600f6530 msgr2=0x7fab600f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:08:19.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.245+0000 7fab67226700 1 --2- 172.21.15.26:0/2928222484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab600f6530 0x7fab600f6950 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fab5c004660 tx=0x7fab5c009b30).stop 2021-11-03T17:08:19.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.245+0000 7fab67226700 1 -- 172.21.15.26:0/2928222484 shutdown_connections 2021-11-03T17:08:19.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.245+0000 7fab67226700 1 --2- 172.21.15.26:0/2928222484 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab600f77d0 0x7fab600f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:19.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.245+0000 7fab67226700 1 --2- 172.21.15.26:0/2928222484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab600f6530 0x7fab600f6950 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:19.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.245+0000 7fab67226700 1 -- 172.21.15.26:0/2928222484 >> 172.21.15.26:0/2928222484 conn(0x7fab600f1c90 msgr2=0x7fab600f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:08:19.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.245+0000 7fab67226700 1 -- 172.21.15.26:0/2928222484 shutdown_connections 2021-11-03T17:08:19.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.245+0000 7fab67226700 1 -- 172.21.15.26:0/2928222484 wait complete. 2021-11-03T17:08:19.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.245+0000 7fab67226700 1 Processor -- start 2021-11-03T17:08:19.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.245+0000 7fab67226700 1 -- start start 2021-11-03T17:08:19.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.246+0000 7fab67226700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab600f6530 0x7fab60106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:08:19.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.246+0000 7fab67226700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab600f77d0 0x7fab601072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:08:19.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.246+0000 7fab67226700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab601078f0 con 0x7fab600f77d0 2021-11-03T17:08:19.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.246+0000 7fab67226700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab60108100 con 0x7fab600f6530 2021-11-03T17:08:19.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.246+0000 7fab65a23700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab600f77d0 0x7fab601072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:08:19.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.246+0000 7fab65a23700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab600f77d0 0x7fab601072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52674/0 (socket says 172.21.15.26:52674) 2021-11-03T17:08:19.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.246+0000 7fab65a23700 1 -- 172.21.15.26:0/1939362470 learned_addr learned my addr 172.21.15.26:0/1939362470 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:08:19.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.246+0000 7fab66224700 1 --2- 172.21.15.26:0/1939362470 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab600f6530 0x7fab60106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:08:19.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.246+0000 7fab65a23700 1 -- 172.21.15.26:0/1939362470 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab600f6530 msgr2=0x7fab60106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:08:19.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.246+0000 7fab65a23700 1 --2- 172.21.15.26:0/1939362470 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab600f6530 0x7fab60106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:19.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.246+0000 7fab65a23700 1 -- 172.21.15.26:0/1939362470 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab5c005040 con 0x7fab600f77d0 2021-11-03T17:08:19.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.246+0000 7fab65a23700 1 --2- 172.21.15.26:0/1939362470 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab600f77d0 0x7fab601072f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7fab500026d0 tx=0x7fab50009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:08:19.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.246+0000 7fab56ffd700 1 -- 172.21.15.26:0/1939362470 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab500079c0 con 0x7fab600f77d0 2021-11-03T17:08:19.247 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.246+0000 7fab56ffd700 1 -- 172.21.15.26:0/1939362470 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fab5000f040 con 0x7fab600f77d0 2021-11-03T17:08:19.247 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.246+0000 7fab67226700 1 -- 172.21.15.26:0/1939362470 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab60108380 con 0x7fab600f77d0 2021-11-03T17:08:19.247 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.246+0000 7fab56ffd700 1 -- 172.21.15.26:0/1939362470 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab500148b0 con 0x7fab600f77d0 2021-11-03T17:08:19.247 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.246+0000 7fab67226700 1 -- 172.21.15.26:0/1939362470 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab60108940 con 0x7fab600f77d0 2021-11-03T17:08:19.248 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.247+0000 7fab67226700 1 -- 172.21.15.26:0/1939362470 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab60059100 con 0x7fab600f77d0 2021-11-03T17:08:19.249 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.248+0000 7fab56ffd700 1 -- 172.21.15.26:0/1939362470 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fab50007b20 con 0x7fab600f77d0 2021-11-03T17:08:19.249 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.248+0000 7fab56ffd700 1 --2- 172.21.15.26:0/1939362470 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fab4c064100 0x7fab4c0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:08:19.249 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.248+0000 7fab56ffd700 1 -- 172.21.15.26:0/1939362470 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fab50080730 con 0x7fab600f77d0 2021-11-03T17:08:19.249 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.248+0000 7fab66224700 1 --2- 172.21.15.26:0/1939362470 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fab4c064100 0x7fab4c0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:08:19.250 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.249+0000 7fab66224700 1 --2- 172.21.15.26:0/1939362470 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fab4c064100 0x7fab4c0665c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fab5c013690 tx=0x7fab5c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:08:19.250 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.252+0000 7fab56ffd700 1 -- 172.21.15.26:0/1939362470 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fab50052a90 con 0x7fab600f77d0 2021-11-03T17:08:19.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.431+0000 7fab67226700 1 -- 172.21.15.26:0/1939362470 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fab600fee80 con 0x7fab4c064100 2021-11-03T17:08:19.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.433+0000 7fab56ffd700 1 -- 172.21.15.26:0/1939362470 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fab600fee80 con 0x7fab4c064100 2021-11-03T17:08:19.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.434+0000 7fab67226700 1 -- 172.21.15.26:0/1939362470 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fab4c064100 msgr2=0x7fab4c0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:08:19.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.434+0000 7fab67226700 1 --2- 172.21.15.26:0/1939362470 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fab4c064100 0x7fab4c0665c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fab5c013690 tx=0x7fab5c009b30).stop 2021-11-03T17:08:19.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.434+0000 7fab67226700 1 -- 172.21.15.26:0/1939362470 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab600f77d0 msgr2=0x7fab601072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:08:19.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.435+0000 7fab67226700 1 --2- 172.21.15.26:0/1939362470 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab600f77d0 0x7fab601072f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7fab500026d0 tx=0x7fab50009de0).stop 2021-11-03T17:08:19.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.435+0000 7fab67226700 1 -- 172.21.15.26:0/1939362470 shutdown_connections 2021-11-03T17:08:19.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.435+0000 7fab67226700 1 --2- 172.21.15.26:0/1939362470 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fab4c064100 0x7fab4c0665c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:19.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.435+0000 7fab67226700 1 --2- 172.21.15.26:0/1939362470 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab600f6530 0x7fab60106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:19.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.435+0000 7fab67226700 1 --2- 172.21.15.26:0/1939362470 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab600f77d0 0x7fab601072f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:19.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.435+0000 7fab67226700 1 -- 172.21.15.26:0/1939362470 >> 172.21.15.26:0/1939362470 conn(0x7fab600f1c90 msgr2=0x7fab600fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:08:19.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.435+0000 7fab67226700 1 -- 172.21.15.26:0/1939362470 shutdown_connections 2021-11-03T17:08:19.432 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.435+0000 7fab67226700 1 -- 172.21.15.26:0/1939362470 wait complete. 2021-11-03T17:08:19.439 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:08:19.531 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.535+0000 7f66e71f1700 1 -- 172.21.15.26:0/1116797690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66e00f6690 msgr2=0x7f66e00f6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:08:19.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.535+0000 7f66e71f1700 1 --2- 172.21.15.26:0/1116797690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66e00f6690 0x7f66e00f6ab0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f66d4004660 tx=0x7f66d4009b30).stop 2021-11-03T17:08:19.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.535+0000 7f66e71f1700 1 -- 172.21.15.26:0/1116797690 shutdown_connections 2021-11-03T17:08:19.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.535+0000 7f66e71f1700 1 --2- 172.21.15.26:0/1116797690 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66e00f6fa0 0x7f66e00f79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:08:19.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.535+0000 7f66e71f1700 1 --2- 172.21.15.26:0/1116797690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66e00f6690 0x7f66e00f6ab0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:19.533 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.535+0000 7f66e71f1700 1 -- 172.21.15.26:0/1116797690 >> 172.21.15.26:0/1116797690 conn(0x7f66e00f1eb0 msgr2=0x7f66e00f42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:08:19.533 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.535+0000 7f66e71f1700 1 -- 172.21.15.26:0/1116797690 shutdown_connections 2021-11-03T17:08:19.533 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.535+0000 7f66e71f1700 1 -- 172.21.15.26:0/1116797690 wait complete. 2021-11-03T17:08:19.533 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.535+0000 7f66e71f1700 1 Processor -- start 2021-11-03T17:08:19.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.535+0000 7f66e71f1700 1 -- start start 2021-11-03T17:08:19.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.536+0000 7f66e71f1700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66e00f6690 0x7f66e006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:08:19.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.536+0000 7f66e71f1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66e00f6fa0 0x7f66e0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:08:19.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.536+0000 7f66e71f1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e006a410 con 0x7f66e00f6fa0 2021-11-03T17:08:19.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.536+0000 7f66e71f1700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e006a550 con 0x7f66e00f6690 2021-11-03T17:08:19.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.536+0000 7f66dffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66e00f6fa0 0x7f66e0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:08:19.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.536+0000 7f66dffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66e00f6fa0 0x7f66e0069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52684/0 (socket says 172.21.15.26:52684) 2021-11-03T17:08:19.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.536+0000 7f66dffff700 1 -- 172.21.15.26:0/2292353527 learned_addr learned my addr 172.21.15.26:0/2292353527 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:08:19.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.536+0000 7f66e4f8d700 1 --2- 172.21.15.26:0/2292353527 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66e00f6690 0x7f66e006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:08:19.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.536+0000 7f66dffff700 1 -- 172.21.15.26:0/2292353527 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66e00f6690 msgr2=0x7f66e006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:08:19.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.536+0000 7f66dffff700 1 --2- 172.21.15.26:0/2292353527 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66e00f6690 0x7f66e006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:19.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.536+0000 7f66dffff700 1 -- 172.21.15.26:0/2292353527 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d4005040 con 0x7f66e00f6fa0 2021-11-03T17:08:19.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.536+0000 7f66dffff700 1 --2- 172.21.15.26:0/2292353527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66e00f6fa0 0x7f66e0069e20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f66cc00b410 tx=0x7f66cc006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:08:19.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.536+0000 7f66dd7fa700 1 -- 172.21.15.26:0/2292353527 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66cc0125f0 con 0x7f66e00f6fa0 2021-11-03T17:08:19.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.536+0000 7f66dd7fa700 1 -- 172.21.15.26:0/2292353527 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f66cc012c00 con 0x7f66e00f6fa0 2021-11-03T17:08:19.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.536+0000 7f66e71f1700 1 -- 172.21.15.26:0/2292353527 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66e006a830 con 0x7f66e00f6fa0 2021-11-03T17:08:19.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.536+0000 7f66dd7fa700 1 -- 172.21.15.26:0/2292353527 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66cc002ae0 con 0x7f66e00f6fa0 2021-11-03T17:08:19.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.536+0000 7f66e71f1700 1 -- 172.21.15.26:0/2292353527 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66e010ef00 con 0x7f66e00f6fa0 2021-11-03T17:08:19.539 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.537+0000 7f66e71f1700 1 -- 172.21.15.26:0/2292353527 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66e0045ad0 con 0x7f66e00f6fa0 2021-11-03T17:08:19.539 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.538+0000 7f66dd7fa700 1 -- 172.21.15.26:0/2292353527 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f66cc00f030 con 0x7f66e00f6fa0 2021-11-03T17:08:19.539 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.538+0000 7f66dd7fa700 1 --2- 172.21.15.26:0/2292353527 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f66d0064100 0x7f66d00665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:08:19.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.538+0000 7f66dd7fa700 1 -- 172.21.15.26:0/2292353527 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f66cc080be0 con 0x7f66e00f6fa0 2021-11-03T17:08:19.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.538+0000 7f66e4f8d700 1 --2- 172.21.15.26:0/2292353527 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f66d0064100 0x7f66d00665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:08:19.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.539+0000 7f66e4f8d700 1 --2- 172.21.15.26:0/2292353527 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f66d0064100 0x7f66d00665c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f66d4009da0 tx=0x7f66d4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:08:19.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.542+0000 7f66dd7fa700 1 -- 172.21.15.26:0/2292353527 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f66cc052f40 con 0x7f66e00f6fa0 2021-11-03T17:08:19.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.714+0000 7f66e71f1700 1 -- 172.21.15.26:0/2292353527 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f66e00ff010 con 0x7f66d0064100 2021-11-03T17:08:19.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.729+0000 7f66dd7fa700 1 -- 172.21.15.26:0/2292353527 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f66e00ff010 con 0x7f66d0064100 2021-11-03T17:08:19.725 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:08:19.725 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (19m) 10m ago 20m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:08:19.725 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (11m) 10m ago 20m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:08:19.725 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (11m) 8m ago 20m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:08:19.726 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (19m) 10m ago 20m 38.9M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:08:19.726 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (12m) 10m ago 15m 13.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:08:19.726 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (12m) 10m ago 15m 14.7M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:08:19.726 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (16m) 8m ago 16m 16.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:08:19.726 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (15m) 8m ago 15m 16.5M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:08:19.727 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (13m) 10m ago 22m 468M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:08:19.727 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (12m) 8m ago 19m 412M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:08:19.727 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (12m) 10m ago 22m 75.8M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:08:19.728 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (12m) 8m ago 19m 66.4M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:08:19.728 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (20m) 10m ago 20m 18.1M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:08:19.728 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (19m) 8m ago 19m 18.3M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:08:19.728 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (11m) 10m ago 19m 153M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:08:19.729 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (10m) 10m ago 18m 166M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:08:19.729 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (10m) 10m ago 18m 11.2M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:08:19.729 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (9m) 8m ago 18m 181M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:08:19.729 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (9m) 8m ago 17m 185M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:08:19.729 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (8m) 8m ago 17m 13.5M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:08:19.730 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (19m) 10m ago 20m 47.5M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:08:19.731 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.731+0000 7f66e71f1700 1 -- 172.21.15.26:0/2292353527 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f66d0064100 msgr2=0x7f66d00665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:08:19.731 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.731+0000 7f66e71f1700 1 --2- 172.21.15.26:0/2292353527 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f66d0064100 0x7f66d00665c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f66d4009da0 tx=0x7f66d4009b30).stop 2021-11-03T17:08:19.731 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.731+0000 7f66e71f1700 1 -- 172.21.15.26:0/2292353527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66e00f6fa0 msgr2=0x7f66e0069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:08:19.731 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.731+0000 7f66e71f1700 1 --2- 172.21.15.26:0/2292353527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66e00f6fa0 0x7f66e0069e20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f66cc00b410 tx=0x7f66cc006ef0).stop 2021-11-03T17:08:19.732 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.731+0000 7f66e71f1700 1 -- 172.21.15.26:0/2292353527 shutdown_connections 2021-11-03T17:08:19.732 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.731+0000 7f66e71f1700 1 --2- 172.21.15.26:0/2292353527 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f66d0064100 0x7f66d00665c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:19.732 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.731+0000 7f66e71f1700 1 --2- 172.21.15.26:0/2292353527 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66e00f6690 0x7f66e006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:19.732 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.731+0000 7f66e71f1700 1 --2- 172.21.15.26:0/2292353527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66e00f6fa0 0x7f66e0069e20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:19.732 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.731+0000 7f66e71f1700 1 -- 172.21.15.26:0/2292353527 >> 172.21.15.26:0/2292353527 conn(0x7f66e00f1eb0 msgr2=0x7f66e00fb420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:08:19.733 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.731+0000 7f66e71f1700 1 -- 172.21.15.26:0/2292353527 shutdown_connections 2021-11-03T17:08:19.733 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.731+0000 7f66e71f1700 1 -- 172.21.15.26:0/2292353527 wait complete. 2021-11-03T17:08:19.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.830+0000 7f19ea0dc700 1 -- 172.21.15.26:0/4100655893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19e40f8610 msgr2=0x7f19e40f4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:08:19.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.830+0000 7f19ea0dc700 1 --2- 172.21.15.26:0/4100655893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19e40f8610 0x7f19e40f4820 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f19d4004660 tx=0x7f19d4009b30).stop 2021-11-03T17:08:19.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.830+0000 7f19ea0dc700 1 -- 172.21.15.26:0/4100655893 shutdown_connections 2021-11-03T17:08:19.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.830+0000 7f19ea0dc700 1 --2- 172.21.15.26:0/4100655893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19e40f8610 0x7f19e40f4820 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:19.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.830+0000 7f19ea0dc700 1 --2- 172.21.15.26:0/4100655893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19e40f7d00 0x7f19e40f8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:19.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.830+0000 7f19ea0dc700 1 -- 172.21.15.26:0/4100655893 >> 172.21.15.26:0/4100655893 conn(0x7f19e40f0540 msgr2=0x7f19e40f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:08:19.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.830+0000 7f19ea0dc700 1 -- 172.21.15.26:0/4100655893 shutdown_connections 2021-11-03T17:08:19.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.830+0000 7f19ea0dc700 1 -- 172.21.15.26:0/4100655893 wait complete. 2021-11-03T17:08:19.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.830+0000 7f19ea0dc700 1 Processor -- start 2021-11-03T17:08:19.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.831+0000 7f19ea0dc700 1 -- start start 2021-11-03T17:08:19.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.831+0000 7f19ea0dc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19e40f7d00 0x7f19e4106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:08:19.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.831+0000 7f19ea0dc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19e40f8610 0x7f19e4107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:08:19.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.831+0000 7f19ea0dc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e41079b0 con 0x7f19e40f8610 2021-11-03T17:08:19.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.831+0000 7f19ea0dc700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e4107af0 con 0x7f19e40f7d00 2021-11-03T17:08:19.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.831+0000 7f19e2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19e40f8610 0x7f19e4107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:08:19.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.831+0000 7f19e2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19e40f8610 0x7f19e4107400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52694/0 (socket says 172.21.15.26:52694) 2021-11-03T17:08:19.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.831+0000 7f19e2ffd700 1 -- 172.21.15.26:0/2521065987 learned_addr learned my addr 172.21.15.26:0/2521065987 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:08:19.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.831+0000 7f19e37fe700 1 --2- 172.21.15.26:0/2521065987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19e40f7d00 0x7f19e4106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:08:19.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.831+0000 7f19e2ffd700 1 -- 172.21.15.26:0/2521065987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19e40f7d00 msgr2=0x7f19e4106f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:08:19.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.831+0000 7f19e2ffd700 1 --2- 172.21.15.26:0/2521065987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19e40f7d00 0x7f19e4106f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:19.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.831+0000 7f19e2ffd700 1 -- 172.21.15.26:0/2521065987 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d4005040 con 0x7f19e40f8610 2021-11-03T17:08:19.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.832+0000 7f19e2ffd700 1 --2- 172.21.15.26:0/2521065987 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19e40f8610 0x7f19e4107400 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f19d4009da0 tx=0x7f19d4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:08:19.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.832+0000 7f19cbfff700 1 -- 172.21.15.26:0/2521065987 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19d4018070 con 0x7f19e40f8610 2021-11-03T17:08:19.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.832+0000 7f19cbfff700 1 -- 172.21.15.26:0/2521065987 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f19d4007cf0 con 0x7f19e40f8610 2021-11-03T17:08:19.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.832+0000 7f19ea0dc700 1 -- 172.21.15.26:0/2521065987 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19e4108430 con 0x7f19e40f8610 2021-11-03T17:08:19.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.832+0000 7f19cbfff700 1 -- 172.21.15.26:0/2521065987 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19d401c620 con 0x7f19e40f8610 2021-11-03T17:08:19.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.832+0000 7f19ea0dc700 1 -- 172.21.15.26:0/2521065987 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19e4108990 con 0x7f19e40f8610 2021-11-03T17:08:19.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.833+0000 7f19ea0dc700 1 -- 172.21.15.26:0/2521065987 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19e4045ad0 con 0x7f19e40f8610 2021-11-03T17:08:19.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.833+0000 7f19cbfff700 1 -- 172.21.15.26:0/2521065987 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f19d401d420 con 0x7f19e40f8610 2021-11-03T17:08:19.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.834+0000 7f19cbfff700 1 --2- 172.21.15.26:0/2521065987 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f19cc064090 0x7f19cc066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:08:19.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.834+0000 7f19cbfff700 1 -- 172.21.15.26:0/2521065987 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f19d40827d0 con 0x7f19e40f8610 2021-11-03T17:08:19.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.834+0000 7f19e37fe700 1 --2- 172.21.15.26:0/2521065987 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f19cc064090 0x7f19cc066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:08:19.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.834+0000 7f19e37fe700 1 --2- 172.21.15.26:0/2521065987 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f19cc064090 0x7f19cc066550 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f19d80041d0 tx=0x7f19d8009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:08:19.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:19.838+0000 7f19cbfff700 1 -- 172.21.15.26:0/2521065987 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f19d4054b30 con 0x7f19e40f8610 2021-11-03T17:08:20.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.068+0000 7f19ea0dc700 1 -- 172.21.15.26:0/2521065987 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f19e4027a00 con 0x7f19e40f8610 2021-11-03T17:08:20.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.068+0000 7f19cbfff700 1 -- 172.21.15.26:0/2521065987 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f19d4054720 con 0x7f19e40f8610 2021-11-03T17:08:20.063 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:08:20.064 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:08:20.064 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:08:20.064 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:08:20.064 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:08:20.065 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:08:20.065 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:08:20.065 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:08:20.065 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:08:20.066 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:08:20.066 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:08:20.066 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:08:20.066 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:08:20.066 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:08:20.067 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:08:20.067 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:08:20.067 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:08:20.067 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:08:20.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.070+0000 7f19ea0dc700 1 -- 172.21.15.26:0/2521065987 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f19cc064090 msgr2=0x7f19cc066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:08:20.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.070+0000 7f19ea0dc700 1 --2- 172.21.15.26:0/2521065987 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f19cc064090 0x7f19cc066550 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f19d80041d0 tx=0x7f19d8009040).stop 2021-11-03T17:08:20.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.070+0000 7f19ea0dc700 1 -- 172.21.15.26:0/2521065987 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19e40f8610 msgr2=0x7f19e4107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:08:20.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.070+0000 7f19ea0dc700 1 --2- 172.21.15.26:0/2521065987 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19e40f8610 0x7f19e4107400 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f19d4009da0 tx=0x7f19d4009b30).stop 2021-11-03T17:08:20.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.070+0000 7f19ea0dc700 1 -- 172.21.15.26:0/2521065987 shutdown_connections 2021-11-03T17:08:20.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.070+0000 7f19ea0dc700 1 --2- 172.21.15.26:0/2521065987 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f19cc064090 0x7f19cc066550 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:20.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.070+0000 7f19ea0dc700 1 --2- 172.21.15.26:0/2521065987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19e40f7d00 0x7f19e4106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:20.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.070+0000 7f19ea0dc700 1 --2- 172.21.15.26:0/2521065987 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19e40f8610 0x7f19e4107400 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:20.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.070+0000 7f19ea0dc700 1 -- 172.21.15.26:0/2521065987 >> 172.21.15.26:0/2521065987 conn(0x7f19e40f0540 msgr2=0x7f19e40fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:08:20.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.070+0000 7f19ea0dc700 1 -- 172.21.15.26:0/2521065987 shutdown_connections 2021-11-03T17:08:20.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.070+0000 7f19ea0dc700 1 -- 172.21.15.26:0/2521065987 wait complete. 2021-11-03T17:08:20.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.171+0000 7f2cfa52f700 1 -- 172.21.15.26:0/368630206 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cf40f5f60 msgr2=0x7f2cf40f63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:08:20.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.171+0000 7f2cfa52f700 1 --2- 172.21.15.26:0/368630206 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cf40f5f60 0x7f2cf40f63e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f2ce8004770 tx=0x7f2ce800ac40).stop 2021-11-03T17:08:20.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.171+0000 7f2cfa52f700 1 -- 172.21.15.26:0/368630206 shutdown_connections 2021-11-03T17:08:20.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.171+0000 7f2cfa52f700 1 --2- 172.21.15.26:0/368630206 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cf40f5f60 0x7f2cf40f63e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:20.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.171+0000 7f2cfa52f700 1 --2- 172.21.15.26:0/368630206 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cf40f4d60 0x7f2cf40f5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:20.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.171+0000 7f2cfa52f700 1 -- 172.21.15.26:0/368630206 >> 172.21.15.26:0/368630206 conn(0x7f2cf40f04c0 msgr2=0x7f2cf40f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:08:20.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.171+0000 7f2cfa52f700 1 -- 172.21.15.26:0/368630206 shutdown_connections 2021-11-03T17:08:20.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.171+0000 7f2cfa52f700 1 -- 172.21.15.26:0/368630206 wait complete. 2021-11-03T17:08:20.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.171+0000 7f2cfa52f700 1 Processor -- start 2021-11-03T17:08:20.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.172+0000 7f2cfa52f700 1 -- start start 2021-11-03T17:08:20.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.172+0000 7f2cfa52f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cf40f4d60 0x7f2cf4106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:08:20.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.172+0000 7f2cfa52f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cf40f5f60 0x7f2cf4107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:08:20.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.172+0000 7f2cfa52f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf4107a00 con 0x7f2cf40f5f60 2021-11-03T17:08:20.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.172+0000 7f2cfa52f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf4107b40 con 0x7f2cf40f4d60 2021-11-03T17:08:20.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.172+0000 7f2cf37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cf40f5f60 0x7f2cf4107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:08:20.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.172+0000 7f2cf37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cf40f5f60 0x7f2cf4107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52704/0 (socket says 172.21.15.26:52704) 2021-11-03T17:08:20.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.172+0000 7f2cf37fe700 1 -- 172.21.15.26:0/3331444558 learned_addr learned my addr 172.21.15.26:0/3331444558 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:08:20.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.172+0000 7f2cf3fff700 1 --2- 172.21.15.26:0/3331444558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cf40f4d60 0x7f2cf4106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:08:20.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.172+0000 7f2cf37fe700 1 -- 172.21.15.26:0/3331444558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cf40f4d60 msgr2=0x7f2cf4106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:08:20.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.172+0000 7f2cf37fe700 1 --2- 172.21.15.26:0/3331444558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cf40f4d60 0x7f2cf4106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:20.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.172+0000 7f2cf37fe700 1 -- 172.21.15.26:0/3331444558 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce8005040 con 0x7f2cf40f5f60 2021-11-03T17:08:20.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.172+0000 7f2cf37fe700 1 --2- 172.21.15.26:0/3331444558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cf40f5f60 0x7f2cf4107450 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f2ce800adc0 tx=0x7f2ce800ac40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:08:20.175 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.173+0000 7f2cf0ff9700 1 -- 172.21.15.26:0/3331444558 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ce800f030 con 0x7f2cf40f5f60 2021-11-03T17:08:20.175 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.173+0000 7f2cf0ff9700 1 -- 172.21.15.26:0/3331444558 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2ce800a590 con 0x7f2cf40f5f60 2021-11-03T17:08:20.175 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.173+0000 7f2cf0ff9700 1 -- 172.21.15.26:0/3331444558 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ce8019070 con 0x7f2cf40f5f60 2021-11-03T17:08:20.176 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.173+0000 7f2cfa52f700 1 -- 172.21.15.26:0/3331444558 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cf4108480 con 0x7f2cf40f5f60 2021-11-03T17:08:20.176 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.173+0000 7f2cfa52f700 1 -- 172.21.15.26:0/3331444558 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cf4108990 con 0x7f2cf40f5f60 2021-11-03T17:08:20.177 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.174+0000 7f2cfa52f700 1 -- 172.21.15.26:0/3331444558 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cf4045ad0 con 0x7f2cf40f5f60 2021-11-03T17:08:20.177 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.174+0000 7f2cf0ff9700 1 -- 172.21.15.26:0/3331444558 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f2ce8008560 con 0x7f2cf40f5f60 2021-11-03T17:08:20.177 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.175+0000 7f2cf0ff9700 1 --2- 172.21.15.26:0/3331444558 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2cdc0640b0 0x7f2cdc066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:08:20.177 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.175+0000 7f2cf0ff9700 1 -- 172.21.15.26:0/3331444558 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f2ce80824c0 con 0x7f2cf40f5f60 2021-11-03T17:08:20.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.175+0000 7f2cf3fff700 1 --2- 172.21.15.26:0/3331444558 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2cdc0640b0 0x7f2cdc066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:08:20.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.175+0000 7f2cf3fff700 1 --2- 172.21.15.26:0/3331444558 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2cdc0640b0 0x7f2cdc066570 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f2ce40041d0 tx=0x7f2ce4009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:08:20.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.179+0000 7f2cf0ff9700 1 -- 172.21.15.26:0/3331444558 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f2ce8054760 con 0x7f2cf40f5f60 2021-11-03T17:08:20.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:19 smithi194 ceph-mon[65619]: pgmap v410: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:20.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.387+0000 7f2cfa52f700 1 -- 172.21.15.26:0/3331444558 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2cf4109090 con 0x7f2cf40f5f60 2021-11-03T17:08:20.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.388+0000 7f2cf0ff9700 1 -- 172.21.15.26:0/3331444558 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f2ce8054350 con 0x7f2cf40f5f60 2021-11-03T17:08:20.383 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:08:20.383 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:08:20.383 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:08:20.384 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:08:20.384 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:08:20.384 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:08:20.384 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:08:20.384 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:08:20.385 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:08:20.385 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:08:20.385 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:08:20.385 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:08:20.386 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:08:20.386 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:08:20.386 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:08:20.386 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:08:20.386 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:08:20.387 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:08:20.387 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:08:20.387 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:08:20.387 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:08:20.388 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:08:20.388 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:08:20.388 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:08:20.388 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:08:20.388 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:08:20.389 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:08:20.389 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:08:20.389 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:08:20.389 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:08:20.389 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:08:20.390 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:08:20.390 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:08:20.390 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:08:20.390 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:08:20.391 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:08:20.391 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:08:20.391 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:08:20.391 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:08:20.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.389+0000 7f2cfa52f700 1 -- 172.21.15.26:0/3331444558 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2cdc0640b0 msgr2=0x7f2cdc066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:08:20.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.389+0000 7f2cfa52f700 1 --2- 172.21.15.26:0/3331444558 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2cdc0640b0 0x7f2cdc066570 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f2ce40041d0 tx=0x7f2ce4009040).stop 2021-11-03T17:08:20.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.389+0000 7f2cfa52f700 1 -- 172.21.15.26:0/3331444558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cf40f5f60 msgr2=0x7f2cf4107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:08:20.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.389+0000 7f2cfa52f700 1 --2- 172.21.15.26:0/3331444558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cf40f5f60 0x7f2cf4107450 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f2ce800adc0 tx=0x7f2ce800ac40).stop 2021-11-03T17:08:20.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.389+0000 7f2cfa52f700 1 -- 172.21.15.26:0/3331444558 shutdown_connections 2021-11-03T17:08:20.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.389+0000 7f2cfa52f700 1 --2- 172.21.15.26:0/3331444558 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2cdc0640b0 0x7f2cdc066570 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:20.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.389+0000 7f2cfa52f700 1 --2- 172.21.15.26:0/3331444558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cf40f4d60 0x7f2cf4106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:20.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.389+0000 7f2cfa52f700 1 --2- 172.21.15.26:0/3331444558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cf40f5f60 0x7f2cf4107450 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:20.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.389+0000 7f2cfa52f700 1 -- 172.21.15.26:0/3331444558 >> 172.21.15.26:0/3331444558 conn(0x7f2cf40f04c0 msgr2=0x7f2cf40f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:08:20.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.390+0000 7f2cfa52f700 1 -- 172.21.15.26:0/3331444558 shutdown_connections 2021-11-03T17:08:20.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:20.390+0000 7f2cfa52f700 1 -- 172.21.15.26:0/3331444558 wait complete. 2021-11-03T17:08:20.395 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:08:20.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:19 smithi026 ceph-mon[96795]: pgmap v410: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:21.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:20 smithi194 ceph-mon[65619]: from='client.34564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:08:21.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:20 smithi194 ceph-mon[65619]: from='client.34568 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:08:21.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:20 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2521065987' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:08:21.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:20 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3331444558' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:08:21.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:20 smithi026 ceph-mon[96795]: from='client.34564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:08:21.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:20 smithi026 ceph-mon[96795]: from='client.34568 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:08:21.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:20 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2521065987' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:08:21.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:20 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3331444558' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:08:22.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:21 smithi194 ceph-mon[65619]: pgmap v411: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:22.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:21 smithi026 ceph-mon[96795]: pgmap v411: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:24.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:23 smithi194 ceph-mon[65619]: pgmap v412: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:24.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:23 smithi026 ceph-mon[96795]: pgmap v412: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:26.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:25 smithi194 ceph-mon[65619]: pgmap v413: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:26.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:25 smithi026 ceph-mon[96795]: pgmap v413: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:28.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:27 smithi194 ceph-mon[65619]: pgmap v414: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:28.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:27 smithi026 ceph-mon[96795]: pgmap v414: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:29.047 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:08:29.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:08:30.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:30 smithi026 ceph-mon[96795]: pgmap v415: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:30.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:30 smithi026 ceph-mon[96795]: poll took 60081.127 ms: 1 events 2021-11-03T17:08:30.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:30 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:08:30.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:30 smithi194 ceph-mon[65619]: pgmap v415: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:30.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:30 smithi194 ceph-mon[65619]: poll took 60081.127 ms: 1 events 2021-11-03T17:08:30.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:30 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:08:32.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:32 smithi026 ceph-mon[96795]: pgmap v416: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:32.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:32 smithi194 ceph-mon[65619]: pgmap v416: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:34.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:34 smithi026 ceph-mon[96795]: pgmap v417: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:34.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:34 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:08:34.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:34 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:08:34.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:34 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:08:34.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:34 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:08:34.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:34 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:08:34.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:34 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:08:34.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:34 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:08:34.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:34 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:08:34.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:34 smithi194 ceph-mon[65619]: pgmap v417: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:34.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:34 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:08:34.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:34 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:08:34.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:34 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:08:34.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:34 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:08:34.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:34 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:08:34.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:34 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:08:34.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:34 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:08:34.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:34 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:08:35.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:35 smithi026 ceph-mon[96795]: poll took 4278.401 ms: 1 events 2021-11-03T17:08:35.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:35 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:08:35.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:35 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:08:35.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:35 smithi194 ceph-mon[65619]: poll took 4278.401 ms: 1 events 2021-11-03T17:08:35.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:35 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:08:35.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:35 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:08:36.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:36 smithi026 ceph-mon[96795]: pgmap v418: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:36.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:36 smithi194 ceph-mon[65619]: pgmap v418: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:38.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:38 smithi026 ceph-mon[96795]: pgmap v419: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:38.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:38 smithi194 ceph-mon[65619]: pgmap v419: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:40.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:40 smithi026 ceph-mon[96795]: pgmap v420: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:40.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:40 smithi194 ceph-mon[65619]: pgmap v420: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:42.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:42 smithi026 ceph-mon[96795]: pgmap v421: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:42.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:42 smithi194 ceph-mon[65619]: pgmap v421: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:44.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:44 smithi026 ceph-mon[96795]: pgmap v422: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:44.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:44 smithi194 ceph-mon[65619]: pgmap v422: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:46.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:46 smithi026 ceph-mon[96795]: pgmap v423: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:46.614 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:46 smithi194 ceph-mon[65619]: pgmap v423: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:48.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:48 smithi026 ceph-mon[96795]: pgmap v424: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:48.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:08:48.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:08:48.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:48 smithi194 ceph-mon[65619]: pgmap v424: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:48.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:08:48.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:08:50.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:49 smithi026 ceph-mon[96795]: pgmap v425: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:50.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:08:50.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:49 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:08:50.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:49 smithi194 ceph-mon[65619]: pgmap v425: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:50.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:08:50.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:49 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:08:50.501 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.504+0000 7fc75ae67700 1 -- 172.21.15.26:0/2121547643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7540f5340 msgr2=0x7fc7540f7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:08:50.502 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.504+0000 7fc75ae67700 1 --2- 172.21.15.26:0/2121547643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7540f5340 0x7fc7540f7ac0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7fc748004660 tx=0x7fc748009b30).stop 2021-11-03T17:08:50.502 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.504+0000 7fc75ae67700 1 -- 172.21.15.26:0/2121547643 shutdown_connections 2021-11-03T17:08:50.502 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.504+0000 7fc75ae67700 1 --2- 172.21.15.26:0/2121547643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7540f5340 0x7fc7540f7ac0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:50.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.504+0000 7fc75ae67700 1 --2- 172.21.15.26:0/2121547643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7540f49a0 0x7fc7540f4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:50.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.504+0000 7fc75ae67700 1 -- 172.21.15.26:0/2121547643 >> 172.21.15.26:0/2121547643 conn(0x7fc7540f04c0 msgr2=0x7fc7540f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:08:50.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.504+0000 7fc75ae67700 1 -- 172.21.15.26:0/2121547643 shutdown_connections 2021-11-03T17:08:50.504 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.504+0000 7fc75ae67700 1 -- 172.21.15.26:0/2121547643 wait complete. 2021-11-03T17:08:50.504 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.505+0000 7fc75ae67700 1 Processor -- start 2021-11-03T17:08:50.504 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.505+0000 7fc75ae67700 1 -- start start 2021-11-03T17:08:50.504 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.505+0000 7fc75ae67700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7540f49a0 0x7fc7540f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:08:50.504 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.505+0000 7fc75ae67700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7540f5340 0x7fc7540f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:08:50.505 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.505+0000 7fc75ae67700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7540f5f30 con 0x7fc7540f5340 2021-11-03T17:08:50.505 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.505+0000 7fc75ae67700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7540f6070 con 0x7fc7540f49a0 2021-11-03T17:08:50.505 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.505+0000 7fc753fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7540f5340 0x7fc7540f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:08:50.505 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.505+0000 7fc753fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7540f5340 0x7fc7540f59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52722/0 (socket says 172.21.15.26:52722) 2021-11-03T17:08:50.506 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.505+0000 7fc753fff700 1 -- 172.21.15.26:0/3881568964 learned_addr learned my addr 172.21.15.26:0/3881568964 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:08:50.506 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.505+0000 7fc758c03700 1 --2- 172.21.15.26:0/3881568964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7540f49a0 0x7fc7540f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:08:50.506 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.506+0000 7fc753fff700 1 -- 172.21.15.26:0/3881568964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7540f49a0 msgr2=0x7fc7540f7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:08:50.506 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.506+0000 7fc753fff700 1 --2- 172.21.15.26:0/3881568964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7540f49a0 0x7fc7540f7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:50.507 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.506+0000 7fc753fff700 1 -- 172.21.15.26:0/3881568964 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc748005040 con 0x7fc7540f5340 2021-11-03T17:08:50.507 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.506+0000 7fc753fff700 1 --2- 172.21.15.26:0/3881568964 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7540f5340 0x7fc7540f59d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fc748004f60 tx=0x7fc748009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:08:50.507 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.506+0000 7fc7517fa700 1 -- 172.21.15.26:0/3881568964 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc748018070 con 0x7fc7540f5340 2021-11-03T17:08:50.507 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.506+0000 7fc75ae67700 1 -- 172.21.15.26:0/3881568964 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7540f62f0 con 0x7fc7540f5340 2021-11-03T17:08:50.508 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.506+0000 7fc7517fa700 1 -- 172.21.15.26:0/3881568964 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc748009770 con 0x7fc7540f5340 2021-11-03T17:08:50.508 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.506+0000 7fc7517fa700 1 -- 172.21.15.26:0/3881568964 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc74801c3c0 con 0x7fc7540f5340 2021-11-03T17:08:50.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.506+0000 7fc75ae67700 1 -- 172.21.15.26:0/3881568964 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7540f6850 con 0x7fc7540f5340 2021-11-03T17:08:50.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.507+0000 7fc75ae67700 1 -- 172.21.15.26:0/3881568964 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc754045ad0 con 0x7fc7540f5340 2021-11-03T17:08:50.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.508+0000 7fc7517fa700 1 -- 172.21.15.26:0/3881568964 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc74801d420 con 0x7fc7540f5340 2021-11-03T17:08:50.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.508+0000 7fc7517fa700 1 --2- 172.21.15.26:0/3881568964 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc73c0640b0 0x7fc73c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:08:50.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.508+0000 7fc7517fa700 1 -- 172.21.15.26:0/3881568964 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc748082580 con 0x7fc7540f5340 2021-11-03T17:08:50.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.508+0000 7fc758c03700 1 --2- 172.21.15.26:0/3881568964 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc73c0640b0 0x7fc73c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:08:50.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.508+0000 7fc758c03700 1 --2- 172.21.15.26:0/3881568964 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc73c0640b0 0x7fc73c066570 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fc7540f72e0 tx=0x7fc744009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:08:50.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.512+0000 7fc7517fa700 1 -- 172.21.15.26:0/3881568964 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc7480549a0 con 0x7fc7540f5340 2021-11-03T17:08:50.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.689+0000 7fc75ae67700 1 -- 172.21.15.26:0/3881568964 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc7540fefd0 con 0x7fc73c0640b0 2021-11-03T17:08:50.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.691+0000 7fc7517fa700 1 -- 172.21.15.26:0/3881568964 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fc7540fefd0 con 0x7fc73c0640b0 2021-11-03T17:08:50.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.693+0000 7fc75ae67700 1 -- 172.21.15.26:0/3881568964 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc73c0640b0 msgr2=0x7fc73c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:08:50.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.693+0000 7fc75ae67700 1 --2- 172.21.15.26:0/3881568964 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc73c0640b0 0x7fc73c066570 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fc7540f72e0 tx=0x7fc744009040).stop 2021-11-03T17:08:50.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.693+0000 7fc75ae67700 1 -- 172.21.15.26:0/3881568964 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7540f5340 msgr2=0x7fc7540f59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:08:50.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.693+0000 7fc75ae67700 1 --2- 172.21.15.26:0/3881568964 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7540f5340 0x7fc7540f59d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fc748004f60 tx=0x7fc748009b30).stop 2021-11-03T17:08:50.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.693+0000 7fc75ae67700 1 -- 172.21.15.26:0/3881568964 shutdown_connections 2021-11-03T17:08:50.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.693+0000 7fc75ae67700 1 --2- 172.21.15.26:0/3881568964 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc73c0640b0 0x7fc73c066570 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:50.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.693+0000 7fc75ae67700 1 --2- 172.21.15.26:0/3881568964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7540f49a0 0x7fc7540f7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:50.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.693+0000 7fc75ae67700 1 --2- 172.21.15.26:0/3881568964 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7540f5340 0x7fc7540f59d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:50.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.693+0000 7fc75ae67700 1 -- 172.21.15.26:0/3881568964 >> 172.21.15.26:0/3881568964 conn(0x7fc7540f04c0 msgr2=0x7fc7540fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:08:50.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.693+0000 7fc75ae67700 1 -- 172.21.15.26:0/3881568964 shutdown_connections 2021-11-03T17:08:50.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.693+0000 7fc75ae67700 1 -- 172.21.15.26:0/3881568964 wait complete. 2021-11-03T17:08:50.698 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:08:50.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.793+0000 7fab3c675700 1 -- 172.21.15.26:0/809858093 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab340f6860 msgr2=0x7fab340f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:08:50.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.793+0000 7fab3c675700 1 --2- 172.21.15.26:0/809858093 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab340f6860 0x7fab340f6cc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fab28004660 tx=0x7fab28009b30).stop 2021-11-03T17:08:50.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.793+0000 7fab3c675700 1 -- 172.21.15.26:0/809858093 shutdown_connections 2021-11-03T17:08:50.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.793+0000 7fab3c675700 1 --2- 172.21.15.26:0/809858093 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab340f6860 0x7fab340f6cc0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:50.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.793+0000 7fab3c675700 1 --2- 172.21.15.26:0/809858093 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab340f55c0 0x7fab340f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:50.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.793+0000 7fab3c675700 1 -- 172.21.15.26:0/809858093 >> 172.21.15.26:0/809858093 conn(0x7fab340f0d40 msgr2=0x7fab340f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:08:50.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.793+0000 7fab3c675700 1 -- 172.21.15.26:0/809858093 shutdown_connections 2021-11-03T17:08:50.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.793+0000 7fab3c675700 1 -- 172.21.15.26:0/809858093 wait complete. 2021-11-03T17:08:50.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.793+0000 7fab3c675700 1 Processor -- start 2021-11-03T17:08:50.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.793+0000 7fab3c675700 1 -- start start 2021-11-03T17:08:50.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.793+0000 7fab3c675700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab340f55c0 0x7fab3410bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:08:50.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.793+0000 7fab3c675700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab340f6860 0x7fab3410e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:08:50.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.793+0000 7fab3c675700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab340602b0 con 0x7fab340f55c0 2021-11-03T17:08:50.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.793+0000 7fab3c675700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab340603f0 con 0x7fab340f6860 2021-11-03T17:08:50.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.794+0000 7fab3a411700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab340f55c0 0x7fab3410bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:08:50.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.794+0000 7fab3a411700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab340f55c0 0x7fab3410bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52730/0 (socket says 172.21.15.26:52730) 2021-11-03T17:08:50.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.794+0000 7fab3a411700 1 -- 172.21.15.26:0/649491673 learned_addr learned my addr 172.21.15.26:0/649491673 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:08:50.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.794+0000 7fab39c10700 1 --2- 172.21.15.26:0/649491673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab340f6860 0x7fab3410e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:08:50.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.794+0000 7fab3a411700 1 -- 172.21.15.26:0/649491673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab340f6860 msgr2=0x7fab3410e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:08:50.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.794+0000 7fab3a411700 1 --2- 172.21.15.26:0/649491673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab340f6860 0x7fab3410e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:50.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.794+0000 7fab3a411700 1 -- 172.21.15.26:0/649491673 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab28005040 con 0x7fab340f55c0 2021-11-03T17:08:50.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.794+0000 7fab3a411700 1 --2- 172.21.15.26:0/649491673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab340f55c0 0x7fab3410bfe0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fab2c00d8d0 tx=0x7fab2c004f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:08:50.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.794+0000 7fab32ffd700 1 -- 172.21.15.26:0/649491673 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab2c00de70 con 0x7fab340f55c0 2021-11-03T17:08:50.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.794+0000 7fab32ffd700 1 -- 172.21.15.26:0/649491673 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fab2c00f040 con 0x7fab340f55c0 2021-11-03T17:08:50.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.794+0000 7fab3c675700 1 -- 172.21.15.26:0/649491673 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab3410e9d0 con 0x7fab340f55c0 2021-11-03T17:08:50.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.794+0000 7fab32ffd700 1 -- 172.21.15.26:0/649491673 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab2c013a90 con 0x7fab340f55c0 2021-11-03T17:08:50.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.794+0000 7fab3c675700 1 -- 172.21.15.26:0/649491673 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab3410ee50 con 0x7fab340f55c0 2021-11-03T17:08:50.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.795+0000 7fab3c675700 1 -- 172.21.15.26:0/649491673 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab34045ad0 con 0x7fab340f55c0 2021-11-03T17:08:50.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.795+0000 7fab32ffd700 1 -- 172.21.15.26:0/649491673 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fab2c01a030 con 0x7fab340f55c0 2021-11-03T17:08:50.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.796+0000 7fab32ffd700 1 --2- 172.21.15.26:0/649491673 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fab1c0640b0 0x7fab1c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:08:50.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.796+0000 7fab32ffd700 1 -- 172.21.15.26:0/649491673 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fab2c0807f0 con 0x7fab340f55c0 2021-11-03T17:08:50.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.796+0000 7fab39c10700 1 --2- 172.21.15.26:0/649491673 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fab1c0640b0 0x7fab1c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:08:50.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.796+0000 7fab39c10700 1 --2- 172.21.15.26:0/649491673 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fab1c0640b0 0x7fab1c066570 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fab28004630 tx=0x7fab28009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:08:50.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.800+0000 7fab32ffd700 1 -- 172.21.15.26:0/649491673 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fab2c052a60 con 0x7fab340f55c0 2021-11-03T17:08:50.970 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.975+0000 7fab3c675700 1 -- 172.21.15.26:0/649491673 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fab340fdef0 con 0x7fab1c0640b0 2021-11-03T17:08:50.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.989+0000 7fab32ffd700 1 -- 172.21.15.26:0/649491673 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fab340fdef0 con 0x7fab1c0640b0 2021-11-03T17:08:50.985 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:08:50.986 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (20m) 17s ago 21m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:08:50.986 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (12m) 17s ago 21m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:08:50.986 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (12m) 9m ago 20m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:08:50.986 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (19m) 17s ago 21m 39.5M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:08:50.987 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (13m) 17s ago 16m 16.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:08:50.987 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (13m) 17s ago 16m 17.8M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:08:50.987 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (16m) 9m ago 16m 16.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:08:50.987 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (16m) 9m ago 16m 16.5M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:08:50.988 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (13m) 17s ago 22m 491M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:08:50.988 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (13m) 9m ago 20m 412M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:08:50.988 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (13m) 17s ago 22m 113M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:08:50.988 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (12m) 9m ago 20m 66.4M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:08:50.989 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (20m) 17s ago 20m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:08:50.989 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (20m) 9m ago 20m 18.3M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:08:50.989 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (11m) 17s ago 19m 190M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:08:50.989 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (11m) 17s ago 19m 204M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:08:50.990 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (10m) 17s ago 18m 170M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:08:50.990 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (10m) 9m ago 18m 181M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:08:50.990 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (9m) 9m ago 18m 185M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:08:50.990 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (9m) 9m ago 18m 13.5M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:08:50.991 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (19m) 17s ago 20m 49.9M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:08:50.992 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.991+0000 7fab3c675700 1 -- 172.21.15.26:0/649491673 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fab1c0640b0 msgr2=0x7fab1c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:08:50.992 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.991+0000 7fab3c675700 1 --2- 172.21.15.26:0/649491673 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fab1c0640b0 0x7fab1c066570 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fab28004630 tx=0x7fab28009b30).stop 2021-11-03T17:08:50.992 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.991+0000 7fab3c675700 1 -- 172.21.15.26:0/649491673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab340f55c0 msgr2=0x7fab3410bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:08:50.992 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.991+0000 7fab3c675700 1 --2- 172.21.15.26:0/649491673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab340f55c0 0x7fab3410bfe0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fab2c00d8d0 tx=0x7fab2c004f00).stop 2021-11-03T17:08:50.993 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.991+0000 7fab3c675700 1 -- 172.21.15.26:0/649491673 shutdown_connections 2021-11-03T17:08:50.993 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.991+0000 7fab3c675700 1 --2- 172.21.15.26:0/649491673 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fab1c0640b0 0x7fab1c066570 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:50.993 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.991+0000 7fab3c675700 1 --2- 172.21.15.26:0/649491673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab340f55c0 0x7fab3410bfe0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:50.993 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.991+0000 7fab3c675700 1 --2- 172.21.15.26:0/649491673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab340f6860 0x7fab3410e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:50.994 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.991+0000 7fab3c675700 1 -- 172.21.15.26:0/649491673 >> 172.21.15.26:0/649491673 conn(0x7fab340f0d40 msgr2=0x7fab340fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:08:50.994 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.991+0000 7fab3c675700 1 -- 172.21.15.26:0/649491673 shutdown_connections 2021-11-03T17:08:50.994 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:50.991+0000 7fab3c675700 1 -- 172.21.15.26:0/649491673 wait complete. 2021-11-03T17:08:51.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.090+0000 7ff615f27700 1 -- 172.21.15.26:0/1879390981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6100f5440 msgr2=0x7ff6100f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:08:51.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.090+0000 7ff615f27700 1 --2- 172.21.15.26:0/1879390981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6100f5440 0x7ff6100f5860 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7ff604004660 tx=0x7ff604009b30).stop 2021-11-03T17:08:51.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.090+0000 7ff615f27700 1 -- 172.21.15.26:0/1879390981 shutdown_connections 2021-11-03T17:08:51.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.090+0000 7ff615f27700 1 --2- 172.21.15.26:0/1879390981 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6100f66e0 0x7ff6100f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:08:51.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.090+0000 7ff615f27700 1 --2- 172.21.15.26:0/1879390981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6100f5440 0x7ff6100f5860 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:51.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.090+0000 7ff615f27700 1 -- 172.21.15.26:0/1879390981 >> 172.21.15.26:0/1879390981 conn(0x7ff6100f0ba0 msgr2=0x7ff6100f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:08:51.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.090+0000 7ff615f27700 1 -- 172.21.15.26:0/1879390981 shutdown_connections 2021-11-03T17:08:51.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.090+0000 7ff615f27700 1 -- 172.21.15.26:0/1879390981 wait complete. 2021-11-03T17:08:51.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.091+0000 7ff615f27700 1 Processor -- start 2021-11-03T17:08:51.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.091+0000 7ff615f27700 1 -- start start 2021-11-03T17:08:51.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.091+0000 7ff615f27700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6100f5440 0x7ff610105d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:08:51.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.091+0000 7ff615f27700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6100f66e0 0x7ff610106210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:08:51.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.091+0000 7ff615f27700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff610106850 con 0x7ff6100f66e0 2021-11-03T17:08:51.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.091+0000 7ff615f27700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff610106fc0 con 0x7ff6100f5440 2021-11-03T17:08:51.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.091+0000 7ff60ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6100f66e0 0x7ff610106210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:08:51.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.091+0000 7ff60ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6100f66e0 0x7ff610106210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52742/0 (socket says 172.21.15.26:52742) 2021-11-03T17:08:51.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.091+0000 7ff60ffff700 1 -- 172.21.15.26:0/371281349 learned_addr learned my addr 172.21.15.26:0/371281349 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:08:51.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.092+0000 7ff614f25700 1 --2- 172.21.15.26:0/371281349 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6100f5440 0x7ff610105d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:08:51.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.092+0000 7ff60ffff700 1 -- 172.21.15.26:0/371281349 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6100f5440 msgr2=0x7ff610105d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:08:51.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.092+0000 7ff60ffff700 1 --2- 172.21.15.26:0/371281349 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6100f5440 0x7ff610105d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:51.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.092+0000 7ff60ffff700 1 -- 172.21.15.26:0/371281349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff604005040 con 0x7ff6100f66e0 2021-11-03T17:08:51.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.092+0000 7ff60ffff700 1 --2- 172.21.15.26:0/371281349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6100f66e0 0x7ff610106210 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7ff5fc00b410 tx=0x7ff5fc006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:08:51.094 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.092+0000 7ff60d7fa700 1 -- 172.21.15.26:0/371281349 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5fc0125f0 con 0x7ff6100f66e0 2021-11-03T17:08:51.094 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.092+0000 7ff60d7fa700 1 -- 172.21.15.26:0/371281349 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff5fc012c00 con 0x7ff6100f66e0 2021-11-03T17:08:51.094 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.092+0000 7ff615f27700 1 -- 172.21.15.26:0/371281349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6101072a0 con 0x7ff6100f66e0 2021-11-03T17:08:51.094 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.092+0000 7ff60d7fa700 1 -- 172.21.15.26:0/371281349 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5fc002ae0 con 0x7ff6100f66e0 2021-11-03T17:08:51.095 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.092+0000 7ff615f27700 1 -- 172.21.15.26:0/371281349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff610107860 con 0x7ff6100f66e0 2021-11-03T17:08:51.095 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.093+0000 7ff615f27700 1 -- 172.21.15.26:0/371281349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff610045ad0 con 0x7ff6100f66e0 2021-11-03T17:08:51.095 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.093+0000 7ff60d7fa700 1 -- 172.21.15.26:0/371281349 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ff5fc00f030 con 0x7ff6100f66e0 2021-11-03T17:08:51.095 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.094+0000 7ff60d7fa700 1 --2- 172.21.15.26:0/371281349 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff600064100 0x7ff6000665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:08:51.096 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.094+0000 7ff60d7fa700 1 -- 172.21.15.26:0/371281349 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ff5fc080d70 con 0x7ff6100f66e0 2021-11-03T17:08:51.096 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.094+0000 7ff614f25700 1 --2- 172.21.15.26:0/371281349 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff600064100 0x7ff6000665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:08:51.096 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.094+0000 7ff614f25700 1 --2- 172.21.15.26:0/371281349 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff600064100 0x7ff6000665c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7ff604009da0 tx=0x7ff604009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:08:51.097 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.098+0000 7ff60d7fa700 1 -- 172.21.15.26:0/371281349 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ff5fc053010 con 0x7ff6100f66e0 2021-11-03T17:08:51.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.333+0000 7ff615f27700 1 -- 172.21.15.26:0/371281349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff610027a00 con 0x7ff6100f66e0 2021-11-03T17:08:51.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.333+0000 7ff60d7fa700 1 -- 172.21.15.26:0/371281349 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7ff5fc052c00 con 0x7ff6100f66e0 2021-11-03T17:08:51.329 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:08:51.330 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:08:51.330 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:08:51.330 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:08:51.330 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:08:51.331 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:08:51.331 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:08:51.331 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:08:51.332 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:08:51.332 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:08:51.332 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:08:51.332 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:08:51.332 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:08:51.333 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:08:51.333 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:08:51.333 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:08:51.333 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:08:51.334 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:08:51.334 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.335+0000 7ff615f27700 1 -- 172.21.15.26:0/371281349 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff600064100 msgr2=0x7ff6000665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:08:51.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.335+0000 7ff615f27700 1 --2- 172.21.15.26:0/371281349 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff600064100 0x7ff6000665c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7ff604009da0 tx=0x7ff604009b30).stop 2021-11-03T17:08:51.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.335+0000 7ff615f27700 1 -- 172.21.15.26:0/371281349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6100f66e0 msgr2=0x7ff610106210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:08:51.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.335+0000 7ff615f27700 1 --2- 172.21.15.26:0/371281349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6100f66e0 0x7ff610106210 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7ff5fc00b410 tx=0x7ff5fc006ef0).stop 2021-11-03T17:08:51.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.335+0000 7ff615f27700 1 -- 172.21.15.26:0/371281349 shutdown_connections 2021-11-03T17:08:51.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.335+0000 7ff615f27700 1 --2- 172.21.15.26:0/371281349 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff600064100 0x7ff6000665c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:51.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.335+0000 7ff615f27700 1 --2- 172.21.15.26:0/371281349 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6100f5440 0x7ff610105d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:51.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.335+0000 7ff615f27700 1 --2- 172.21.15.26:0/371281349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6100f66e0 0x7ff610106210 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:51.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.335+0000 7ff615f27700 1 -- 172.21.15.26:0/371281349 >> 172.21.15.26:0/371281349 conn(0x7ff6100f0ba0 msgr2=0x7ff6100fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:08:51.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.335+0000 7ff615f27700 1 -- 172.21.15.26:0/371281349 shutdown_connections 2021-11-03T17:08:51.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.335+0000 7ff615f27700 1 -- 172.21.15.26:0/371281349 wait complete. 2021-11-03T17:08:51.432 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.435+0000 7f32c7736700 1 -- 172.21.15.26:0/1955680772 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32c00f98b0 msgr2=0x7f32c00fbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:08:51.433 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.435+0000 7f32c7736700 1 --2- 172.21.15.26:0/1955680772 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32c00f98b0 0x7f32c00fbca0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f32b4004660 tx=0x7f32b4009b30).stop 2021-11-03T17:08:51.433 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.435+0000 7f32c7736700 1 -- 172.21.15.26:0/1955680772 shutdown_connections 2021-11-03T17:08:51.433 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.435+0000 7f32c7736700 1 --2- 172.21.15.26:0/1955680772 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32c00f98b0 0x7f32c00fbca0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:51.434 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.435+0000 7f32c7736700 1 --2- 172.21.15.26:0/1955680772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32c0060310 0x7f32c00f93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:51.434 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.435+0000 7f32c7736700 1 -- 172.21.15.26:0/1955680772 >> 172.21.15.26:0/1955680772 conn(0x7f32c00f0de0 msgr2=0x7f32c00f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:08:51.434 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.435+0000 7f32c7736700 1 -- 172.21.15.26:0/1955680772 shutdown_connections 2021-11-03T17:08:51.434 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.435+0000 7f32c7736700 1 -- 172.21.15.26:0/1955680772 wait complete. 2021-11-03T17:08:51.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.435+0000 7f32c7736700 1 Processor -- start 2021-11-03T17:08:51.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.435+0000 7f32c7736700 1 -- start start 2021-11-03T17:08:51.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.435+0000 7f32c7736700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32c0060310 0x7f32c0106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:08:51.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.435+0000 7f32c7736700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32c00f98b0 0x7f32c0107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:08:51.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.435+0000 7f32c7736700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c0107a10 con 0x7f32c0060310 2021-11-03T17:08:51.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.435+0000 7f32c7736700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c0107b50 con 0x7f32c00f98b0 2021-11-03T17:08:51.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.436+0000 7f32c54d2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32c0060310 0x7f32c0106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:08:51.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.436+0000 7f32c54d2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32c0060310 0x7f32c0106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52750/0 (socket says 172.21.15.26:52750) 2021-11-03T17:08:51.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.436+0000 7f32c54d2700 1 -- 172.21.15.26:0/2704147505 learned_addr learned my addr 172.21.15.26:0/2704147505 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:08:51.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.436+0000 7f32c4cd1700 1 --2- 172.21.15.26:0/2704147505 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32c00f98b0 0x7f32c0107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:08:51.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.436+0000 7f32c54d2700 1 -- 172.21.15.26:0/2704147505 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32c00f98b0 msgr2=0x7f32c0107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:08:51.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.436+0000 7f32c54d2700 1 --2- 172.21.15.26:0/2704147505 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32c00f98b0 0x7f32c0107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:51.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.436+0000 7f32c54d2700 1 -- 172.21.15.26:0/2704147505 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b4005040 con 0x7f32c0060310 2021-11-03T17:08:51.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.436+0000 7f32c4cd1700 1 --2- 172.21.15.26:0/2704147505 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32c00f98b0 0x7f32c0107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:08:51.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.436+0000 7f32c54d2700 1 --2- 172.21.15.26:0/2704147505 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32c0060310 0x7f32c0106f70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f32b800d7f0 tx=0x7f32b8004e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:08:51.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.436+0000 7f32bdffb700 1 -- 172.21.15.26:0/2704147505 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32b800b4f0 con 0x7f32c0060310 2021-11-03T17:08:51.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.436+0000 7f32bdffb700 1 -- 172.21.15.26:0/2704147505 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f32b800f040 con 0x7f32c0060310 2021-11-03T17:08:51.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.436+0000 7f32bdffb700 1 -- 172.21.15.26:0/2704147505 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32b8013980 con 0x7f32c0060310 2021-11-03T17:08:51.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.436+0000 7f32c7736700 1 -- 172.21.15.26:0/2704147505 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c01084f0 con 0x7f32c0060310 2021-11-03T17:08:51.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.437+0000 7f32c7736700 1 -- 172.21.15.26:0/2704147505 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c0108a60 con 0x7f32c0060310 2021-11-03T17:08:51.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.437+0000 7f32c7736700 1 -- 172.21.15.26:0/2704147505 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32c0045ad0 con 0x7f32c0060310 2021-11-03T17:08:51.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.438+0000 7f32bdffb700 1 -- 172.21.15.26:0/2704147505 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f32b801a030 con 0x7f32c0060310 2021-11-03T17:08:51.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.438+0000 7f32bdffb700 1 --2- 172.21.15.26:0/2704147505 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f32a80640b0 0x7f32a8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:08:51.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.438+0000 7f32bdffb700 1 -- 172.21.15.26:0/2704147505 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f32b8080830 con 0x7f32c0060310 2021-11-03T17:08:51.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.438+0000 7f32c4cd1700 1 --2- 172.21.15.26:0/2704147505 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f32a80640b0 0x7f32a8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:08:51.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.439+0000 7f32c4cd1700 1 --2- 172.21.15.26:0/2704147505 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f32a80640b0 0x7f32a8066570 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f32b4004630 tx=0x7f32b4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:08:51.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.442+0000 7f32bdffb700 1 -- 172.21.15.26:0/2704147505 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f32b8052aa0 con 0x7f32c0060310 2021-11-03T17:08:51.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.649+0000 7f32c7736700 1 -- 172.21.15.26:0/2704147505 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f32c0027a00 con 0x7f32c0060310 2021-11-03T17:08:51.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.650+0000 7f32bdffb700 1 -- 172.21.15.26:0/2704147505 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f32b8018070 con 0x7f32c0060310 2021-11-03T17:08:51.646 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:08:51.647 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:08:51.647 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:08:51.647 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:08:51.647 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:08:51.647 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:08:51.648 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:08:51.648 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:08:51.648 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:08:51.648 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:08:51.649 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:08:51.649 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:08:51.649 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:08:51.649 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:08:51.650 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:08:51.650 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:08:51.650 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:08:51.650 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:08:51.650 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:08:51.651 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:08:51.651 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:08:51.651 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:08:51.651 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:08:51.652 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:08:51.652 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:08:51.652 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:08:51.652 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:08:51.653 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:08:51.653 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:08:51.653 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:08:51.653 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:08:51.653 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:08:51.654 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:08:51.654 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:08:51.654 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:08:51.654 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:08:51.655 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:08:51.655 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:08:51.655 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:08:51.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.651+0000 7f32c7736700 1 -- 172.21.15.26:0/2704147505 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f32a80640b0 msgr2=0x7f32a8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:08:51.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.651+0000 7f32c7736700 1 --2- 172.21.15.26:0/2704147505 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f32a80640b0 0x7f32a8066570 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f32b4004630 tx=0x7f32b4009b30).stop 2021-11-03T17:08:51.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.651+0000 7f32c7736700 1 -- 172.21.15.26:0/2704147505 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32c0060310 msgr2=0x7f32c0106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:08:51.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.651+0000 7f32c7736700 1 --2- 172.21.15.26:0/2704147505 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32c0060310 0x7f32c0106f70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f32b800d7f0 tx=0x7f32b8004e80).stop 2021-11-03T17:08:51.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.652+0000 7f32c7736700 1 -- 172.21.15.26:0/2704147505 shutdown_connections 2021-11-03T17:08:51.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.652+0000 7f32c7736700 1 --2- 172.21.15.26:0/2704147505 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f32a80640b0 0x7f32a8066570 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:51.658 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.652+0000 7f32c7736700 1 --2- 172.21.15.26:0/2704147505 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32c0060310 0x7f32c0106f70 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:51.658 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.652+0000 7f32c7736700 1 --2- 172.21.15.26:0/2704147505 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32c00f98b0 0x7f32c0107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:08:51.658 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.652+0000 7f32c7736700 1 -- 172.21.15.26:0/2704147505 >> 172.21.15.26:0/2704147505 conn(0x7f32c00f0de0 msgr2=0x7f32c00f31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:08:51.658 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.652+0000 7f32c7736700 1 -- 172.21.15.26:0/2704147505 shutdown_connections 2021-11-03T17:08:51.659 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:08:51.652+0000 7f32c7736700 1 -- 172.21.15.26:0/2704147505 wait complete. 2021-11-03T17:08:51.659 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:08:52.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:51 smithi026 ceph-mon[96795]: pgmap v426: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:52.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:51 smithi026 ceph-mon[96795]: from='client.34580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:08:52.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:51 smithi026 ceph-mon[96795]: from='client.34584 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:08:52.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:51 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/371281349' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:08:52.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:51 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2704147505' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:08:52.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:51 smithi194 ceph-mon[65619]: pgmap v426: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:52.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:51 smithi194 ceph-mon[65619]: from='client.34580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:08:52.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:51 smithi194 ceph-mon[65619]: from='client.34584 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:08:52.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:51 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/371281349' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:08:52.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:51 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2704147505' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:08:54.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:53 smithi026 ceph-mon[96795]: pgmap v427: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:54.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:53 smithi194 ceph-mon[65619]: pgmap v427: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:56.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:55 smithi026 ceph-mon[96795]: pgmap v428: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:56.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:55 smithi194 ceph-mon[65619]: pgmap v428: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:58.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:57 smithi026 ceph-mon[96795]: pgmap v429: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:08:58.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:57 smithi194 ceph-mon[65619]: pgmap v429: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:00.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:08:59 smithi026 ceph-mon[96795]: pgmap v430: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:00.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:08:59 smithi194 ceph-mon[65619]: pgmap v430: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:02.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:01 smithi026 ceph-mon[96795]: pgmap v431: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:02.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:01 smithi194 ceph-mon[65619]: pgmap v431: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:04.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:03 smithi026 ceph-mon[96795]: pgmap v432: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:04.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:03 smithi194 ceph-mon[65619]: pgmap v432: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:05.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:04 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:09:05.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:04 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:09:05.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:04 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:09:05.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:04 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:09:06.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:05 smithi026 ceph-mon[96795]: pgmap v433: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:06.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:05 smithi194 ceph-mon[65619]: pgmap v433: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:08.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:07 smithi026 ceph-mon[96795]: pgmap v434: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:08.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:07 smithi194 ceph-mon[65619]: pgmap v434: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:10.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:09 smithi026 ceph-mon[96795]: pgmap v435: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:10.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:09 smithi194 ceph-mon[65619]: pgmap v435: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:12.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:11 smithi026 ceph-mon[96795]: pgmap v436: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:12.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:11 smithi194 ceph-mon[65619]: pgmap v436: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:14.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:13 smithi026 ceph-mon[96795]: pgmap v437: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:14.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:13 smithi194 ceph-mon[65619]: pgmap v437: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:16.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:15 smithi026 ceph-mon[96795]: pgmap v438: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:16.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:15 smithi194 ceph-mon[65619]: pgmap v438: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:18.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:17 smithi026 ceph-mon[96795]: pgmap v439: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:18.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:17 smithi194 ceph-mon[65619]: pgmap v439: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:20.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:19 smithi026 ceph-mon[96795]: pgmap v440: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:20.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:19 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:09:20.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:19 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:09:20.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:19 smithi194 ceph-mon[65619]: pgmap v440: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:20.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:19 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:09:20.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:19 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:09:21.764 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.768+0000 7fd754c32700 1 -- 172.21.15.26:0/248794380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd75006b940 msgr2=0x7fd750069e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:09:21.765 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.768+0000 7fd754c32700 1 --2- 172.21.15.26:0/248794380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd75006b940 0x7fd750069e40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7fd7480099e0 tx=0x7fd748004d10).stop 2021-11-03T17:09:21.765 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.768+0000 7fd754c32700 1 -- 172.21.15.26:0/248794380 shutdown_connections 2021-11-03T17:09:21.765 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.768+0000 7fd754c32700 1 --2- 172.21.15.26:0/248794380 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd75006a330 0x7fd75006a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:21.766 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.768+0000 7fd754c32700 1 --2- 172.21.15.26:0/248794380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd75006b940 0x7fd750069e40 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:21.766 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.768+0000 7fd754c32700 1 -- 172.21.15.26:0/248794380 >> 172.21.15.26:0/248794380 conn(0x7fd7500f1e40 msgr2=0x7fd7500f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:09:21.766 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.768+0000 7fd754c32700 1 -- 172.21.15.26:0/248794380 shutdown_connections 2021-11-03T17:09:21.766 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.768+0000 7fd754c32700 1 -- 172.21.15.26:0/248794380 wait complete. 2021-11-03T17:09:21.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.768+0000 7fd754c32700 1 Processor -- start 2021-11-03T17:09:21.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.769+0000 7fd754c32700 1 -- start start 2021-11-03T17:09:21.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.769+0000 7fd754c32700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd75006a330 0x7fd750109260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:09:21.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.769+0000 7fd754c32700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd75006b940 0x7fd750109750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:09:21.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.769+0000 7fd754c32700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd750109d00 con 0x7fd75006a330 2021-11-03T17:09:21.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.769+0000 7fd754c32700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd750109e40 con 0x7fd75006b940 2021-11-03T17:09:21.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.769+0000 7fd74e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd75006a330 0x7fd750109260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:09:21.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.769+0000 7fd74e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd75006a330 0x7fd750109260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52772/0 (socket says 172.21.15.26:52772) 2021-11-03T17:09:21.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.769+0000 7fd74e59c700 1 -- 172.21.15.26:0/3993816288 learned_addr learned my addr 172.21.15.26:0/3993816288 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:09:21.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.769+0000 7fd74dd9b700 1 --2- 172.21.15.26:0/3993816288 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd75006b940 0x7fd750109750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:09:21.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.769+0000 7fd74e59c700 1 -- 172.21.15.26:0/3993816288 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd75006b940 msgr2=0x7fd750109750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:09:21.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.769+0000 7fd74e59c700 1 --2- 172.21.15.26:0/3993816288 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd75006b940 0x7fd750109750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:21.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.769+0000 7fd74e59c700 1 -- 172.21.15.26:0/3993816288 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd748009640 con 0x7fd75006a330 2021-11-03T17:09:21.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.769+0000 7fd74e59c700 1 --2- 172.21.15.26:0/3993816288 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd75006a330 0x7fd750109260 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7fd74800c010 tx=0x7fd748004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:09:21.770 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.769+0000 7fd73effd700 1 -- 172.21.15.26:0/3993816288 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd74800e070 con 0x7fd75006a330 2021-11-03T17:09:21.770 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.770+0000 7fd73effd700 1 -- 172.21.15.26:0/3993816288 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd748007dc0 con 0x7fd75006a330 2021-11-03T17:09:21.770 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.770+0000 7fd73effd700 1 -- 172.21.15.26:0/3993816288 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd748018070 con 0x7fd75006a330 2021-11-03T17:09:21.770 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.770+0000 7fd754c32700 1 -- 172.21.15.26:0/3993816288 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd75010a780 con 0x7fd75006a330 2021-11-03T17:09:21.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.770+0000 7fd754c32700 1 -- 172.21.15.26:0/3993816288 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd75010ac60 con 0x7fd75006a330 2021-11-03T17:09:21.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.771+0000 7fd754c32700 1 -- 172.21.15.26:0/3993816288 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd750045ad0 con 0x7fd75006a330 2021-11-03T17:09:21.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.771+0000 7fd73effd700 1 -- 172.21.15.26:0/3993816288 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fd748013420 con 0x7fd75006a330 2021-11-03T17:09:21.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.772+0000 7fd73effd700 1 --2- 172.21.15.26:0/3993816288 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd738064090 0x7fd738066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:09:21.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.772+0000 7fd73effd700 1 -- 172.21.15.26:0/3993816288 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fd748082160 con 0x7fd75006a330 2021-11-03T17:09:21.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.772+0000 7fd74dd9b700 1 --2- 172.21.15.26:0/3993816288 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd738064090 0x7fd738066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:09:21.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.772+0000 7fd74dd9b700 1 --2- 172.21.15.26:0/3993816288 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd738064090 0x7fd738066550 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fd7440096c0 tx=0x7fd744009be0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:09:21.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.776+0000 7fd73effd700 1 -- 172.21.15.26:0/3993816288 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fd7480544c0 con 0x7fd75006a330 2021-11-03T17:09:21.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.957+0000 7fd754c32700 1 -- 172.21.15.26:0/3993816288 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd750103070 con 0x7fd738064090 2021-11-03T17:09:21.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.958+0000 7fd73effd700 1 -- 172.21.15.26:0/3993816288 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fd750103070 con 0x7fd738064090 2021-11-03T17:09:21.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.960+0000 7fd754c32700 1 -- 172.21.15.26:0/3993816288 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd738064090 msgr2=0x7fd738066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:09:21.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.960+0000 7fd754c32700 1 --2- 172.21.15.26:0/3993816288 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd738064090 0x7fd738066550 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fd7440096c0 tx=0x7fd744009be0).stop 2021-11-03T17:09:21.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.960+0000 7fd754c32700 1 -- 172.21.15.26:0/3993816288 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd75006a330 msgr2=0x7fd750109260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:09:21.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.960+0000 7fd754c32700 1 --2- 172.21.15.26:0/3993816288 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd75006a330 0x7fd750109260 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7fd74800c010 tx=0x7fd748004d10).stop 2021-11-03T17:09:21.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.960+0000 7fd754c32700 1 -- 172.21.15.26:0/3993816288 shutdown_connections 2021-11-03T17:09:21.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.960+0000 7fd754c32700 1 --2- 172.21.15.26:0/3993816288 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd738064090 0x7fd738066550 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:21.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.960+0000 7fd754c32700 1 --2- 172.21.15.26:0/3993816288 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd75006a330 0x7fd750109260 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:21.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.960+0000 7fd754c32700 1 --2- 172.21.15.26:0/3993816288 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd75006b940 0x7fd750109750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:21.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.960+0000 7fd754c32700 1 -- 172.21.15.26:0/3993816288 >> 172.21.15.26:0/3993816288 conn(0x7fd7500f1e40 msgr2=0x7fd7500fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:09:21.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.960+0000 7fd754c32700 1 -- 172.21.15.26:0/3993816288 shutdown_connections 2021-11-03T17:09:21.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:21.960+0000 7fd754c32700 1 -- 172.21.15.26:0/3993816288 wait complete. 2021-11-03T17:09:21.968 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:09:22.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.060+0000 7f8889ae1700 1 -- 172.21.15.26:0/1378418454 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88840f96f0 msgr2=0x7f88840fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:09:22.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.060+0000 7f8889ae1700 1 --2- 172.21.15.26:0/1378418454 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88840f96f0 0x7f88840fbae0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f8870004660 tx=0x7f8870009b30).stop 2021-11-03T17:09:22.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.060+0000 7f8889ae1700 1 -- 172.21.15.26:0/1378418454 shutdown_connections 2021-11-03T17:09:22.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.060+0000 7f8889ae1700 1 --2- 172.21.15.26:0/1378418454 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88840f96f0 0x7f88840fbae0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:22.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.060+0000 7f8889ae1700 1 --2- 172.21.15.26:0/1378418454 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88840602b0 0x7f88840f9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:22.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.060+0000 7f8889ae1700 1 -- 172.21.15.26:0/1378418454 >> 172.21.15.26:0/1378418454 conn(0x7f88840f0b90 msgr2=0x7f88840f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:09:22.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.060+0000 7f8889ae1700 1 -- 172.21.15.26:0/1378418454 shutdown_connections 2021-11-03T17:09:22.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.060+0000 7f8889ae1700 1 -- 172.21.15.26:0/1378418454 wait complete. 2021-11-03T17:09:22.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.061+0000 7f8889ae1700 1 Processor -- start 2021-11-03T17:09:22.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.061+0000 7f8889ae1700 1 -- start start 2021-11-03T17:09:22.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.061+0000 7f8889ae1700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88840602b0 0x7f88840f6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:09:22.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.061+0000 7f8889ae1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88840f96f0 0x7f88840f5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:09:22.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.061+0000 7f8889ae1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88840f55d0 con 0x7f88840f96f0 2021-11-03T17:09:22.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.061+0000 7f8889ae1700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88840f5710 con 0x7f88840602b0 2021-11-03T17:09:22.065 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.061+0000 7f8883fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88840f96f0 0x7f88840f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:09:22.065 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.061+0000 7f8883fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88840f96f0 0x7f88840f5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52784/0 (socket says 172.21.15.26:52784) 2021-11-03T17:09:22.065 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.061+0000 7f8883fff700 1 -- 172.21.15.26:0/3023358232 learned_addr learned my addr 172.21.15.26:0/3023358232 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:09:22.066 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.062+0000 7f8888adf700 1 --2- 172.21.15.26:0/3023358232 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88840602b0 0x7f88840f6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:09:22.066 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.062+0000 7f8883fff700 1 -- 172.21.15.26:0/3023358232 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88840602b0 msgr2=0x7f88840f6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:09:22.066 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.062+0000 7f8883fff700 1 --2- 172.21.15.26:0/3023358232 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88840602b0 0x7f88840f6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:22.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.062+0000 7f8883fff700 1 -- 172.21.15.26:0/3023358232 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8870005040 con 0x7f88840f96f0 2021-11-03T17:09:22.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.062+0000 7f8883fff700 1 --2- 172.21.15.26:0/3023358232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88840f96f0 0x7f88840f5070 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f8870013a70 tx=0x7f8870009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:09:22.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.062+0000 7f88817fa700 1 -- 172.21.15.26:0/3023358232 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8870018070 con 0x7f88840f96f0 2021-11-03T17:09:22.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.062+0000 7f88817fa700 1 -- 172.21.15.26:0/3023358232 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f88700097d0 con 0x7f88840f96f0 2021-11-03T17:09:22.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.062+0000 7f88817fa700 1 -- 172.21.15.26:0/3023358232 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f887001c3c0 con 0x7f88840f96f0 2021-11-03T17:09:22.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.062+0000 7f8889ae1700 1 -- 172.21.15.26:0/3023358232 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88840f5990 con 0x7f88840f96f0 2021-11-03T17:09:22.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.062+0000 7f8889ae1700 1 -- 172.21.15.26:0/3023358232 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88840f5ef0 con 0x7f88840f96f0 2021-11-03T17:09:22.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.063+0000 7f8889ae1700 1 -- 172.21.15.26:0/3023358232 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8884045ad0 con 0x7f88840f96f0 2021-11-03T17:09:22.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.063+0000 7f88817fa700 1 -- 172.21.15.26:0/3023358232 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f8870007ba0 con 0x7f88840f96f0 2021-11-03T17:09:22.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.064+0000 7f88817fa700 1 --2- 172.21.15.26:0/3023358232 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8874064100 0x7f88740665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:09:22.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.064+0000 7f88817fa700 1 -- 172.21.15.26:0/3023358232 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f8870082450 con 0x7f88840f96f0 2021-11-03T17:09:22.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.064+0000 7f8888adf700 1 --2- 172.21.15.26:0/3023358232 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8874064100 0x7f88740665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:09:22.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.064+0000 7f8888adf700 1 --2- 172.21.15.26:0/3023358232 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8874064100 0x7f88740665c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f88840f6980 tx=0x7f887800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:09:22.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.068+0000 7f88817fa700 1 -- 172.21.15.26:0/3023358232 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f88700547b0 con 0x7f88840f96f0 2021-11-03T17:09:22.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:21 smithi026 ceph-mon[96795]: pgmap v441: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:22.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.240+0000 7f8889ae1700 1 -- 172.21.15.26:0/3023358232 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8884057f10 con 0x7f8874064100 2021-11-03T17:09:22.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:21 smithi194 ceph-mon[65619]: pgmap v441: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:22.248 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.254+0000 7f88817fa700 1 -- 172.21.15.26:0/3023358232 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f8884057f10 con 0x7f8874064100 2021-11-03T17:09:22.249 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:09:22.249 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (20m) 48s ago 21m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:09:22.249 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (12m) 48s ago 21m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:09:22.250 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (12m) 9m ago 21m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:09:22.250 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (20m) 48s ago 21m 39.5M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:09:22.250 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (13m) 48s ago 16m 16.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:09:22.250 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (13m) 48s ago 16m 17.8M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:09:22.251 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (17m) 9m ago 17m 16.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:09:22.251 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (16m) 9m ago 16m 16.5M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:09:22.251 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (14m) 48s ago 23m 491M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:09:22.251 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (13m) 9m ago 21m 412M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:09:22.252 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (13m) 48s ago 23m 113M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:09:22.252 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (13m) 9m ago 20m 66.4M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:09:22.252 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (21m) 48s ago 21m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:09:22.253 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (20m) 9m ago 20m 18.3M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:09:22.253 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (12m) 48s ago 20m 190M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:09:22.253 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (11m) 48s ago 19m 204M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:09:22.253 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (11m) 48s ago 19m 170M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:09:22.254 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (10m) 9m ago 19m 181M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:09:22.254 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (10m) 9m ago 18m 185M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:09:22.254 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (10m) 9m ago 18m 13.5M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:09:22.254 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (20m) 48s ago 21m 49.9M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:09:22.255 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.256+0000 7f8889ae1700 1 -- 172.21.15.26:0/3023358232 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8874064100 msgr2=0x7f88740665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:09:22.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.256+0000 7f8889ae1700 1 --2- 172.21.15.26:0/3023358232 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8874064100 0x7f88740665c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f88840f6980 tx=0x7f887800b040).stop 2021-11-03T17:09:22.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.256+0000 7f8889ae1700 1 -- 172.21.15.26:0/3023358232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88840f96f0 msgr2=0x7f88840f5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:09:22.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.256+0000 7f8889ae1700 1 --2- 172.21.15.26:0/3023358232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88840f96f0 0x7f88840f5070 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f8870013a70 tx=0x7f8870009b30).stop 2021-11-03T17:09:22.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.256+0000 7f8889ae1700 1 -- 172.21.15.26:0/3023358232 shutdown_connections 2021-11-03T17:09:22.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.256+0000 7f8889ae1700 1 --2- 172.21.15.26:0/3023358232 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8874064100 0x7f88740665c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:22.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.256+0000 7f8889ae1700 1 --2- 172.21.15.26:0/3023358232 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88840602b0 0x7f88840f6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:22.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.256+0000 7f8889ae1700 1 --2- 172.21.15.26:0/3023358232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88840f96f0 0x7f88840f5070 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:22.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.256+0000 7f8889ae1700 1 -- 172.21.15.26:0/3023358232 >> 172.21.15.26:0/3023358232 conn(0x7f88840f0b90 msgr2=0x7f88840f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:09:22.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.256+0000 7f8889ae1700 1 -- 172.21.15.26:0/3023358232 shutdown_connections 2021-11-03T17:09:22.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.256+0000 7f8889ae1700 1 -- 172.21.15.26:0/3023358232 wait complete. 2021-11-03T17:09:22.351 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.355+0000 7f5273778700 1 -- 172.21.15.26:0/1955949961 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f526c0f74a0 msgr2=0x7f526c0f5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:09:22.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.355+0000 7f5273778700 1 --2- 172.21.15.26:0/1955949961 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f526c0f74a0 0x7f526c0f5930 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f5260004660 tx=0x7f5260009b30).stop 2021-11-03T17:09:22.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.355+0000 7f5273778700 1 -- 172.21.15.26:0/1955949961 shutdown_connections 2021-11-03T17:09:22.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.355+0000 7f5273778700 1 --2- 172.21.15.26:0/1955949961 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f526c0f74a0 0x7f526c0f5930 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:22.353 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.355+0000 7f5273778700 1 --2- 172.21.15.26:0/1955949961 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f526c0f6b90 0x7f526c0f6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:09:22.353 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.355+0000 7f5273778700 1 -- 172.21.15.26:0/1955949961 >> 172.21.15.26:0/1955949961 conn(0x7f526c0f0540 msgr2=0x7f526c0f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:09:22.353 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.355+0000 7f5273778700 1 -- 172.21.15.26:0/1955949961 shutdown_connections 2021-11-03T17:09:22.353 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.355+0000 7f5273778700 1 -- 172.21.15.26:0/1955949961 wait complete. 2021-11-03T17:09:22.353 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.356+0000 7f5273778700 1 Processor -- start 2021-11-03T17:09:22.354 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.356+0000 7f5273778700 1 -- start start 2021-11-03T17:09:22.354 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.356+0000 7f5273778700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f526c0f6b90 0x7f526c109c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:09:22.354 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.356+0000 7f5273778700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f526c0f74a0 0x7f526c10c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:09:22.354 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.356+0000 7f5273778700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526c0f5650 con 0x7f526c0f74a0 2021-11-03T17:09:22.355 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.356+0000 7f5273778700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526c0f5790 con 0x7f526c0f6b90 2021-11-03T17:09:22.355 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.356+0000 7f5270d13700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f526c0f74a0 0x7f526c10c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:09:22.355 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.356+0000 7f5270d13700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f526c0f74a0 0x7f526c10c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52796/0 (socket says 172.21.15.26:52796) 2021-11-03T17:09:22.355 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.356+0000 7f5270d13700 1 -- 172.21.15.26:0/2554497135 learned_addr learned my addr 172.21.15.26:0/2554497135 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:09:22.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.356+0000 7f5271514700 1 --2- 172.21.15.26:0/2554497135 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f526c0f6b90 0x7f526c109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:09:22.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.356+0000 7f5270d13700 1 -- 172.21.15.26:0/2554497135 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f526c0f6b90 msgr2=0x7f526c109c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:09:22.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.356+0000 7f5270d13700 1 --2- 172.21.15.26:0/2554497135 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f526c0f6b90 0x7f526c109c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:22.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.356+0000 7f5270d13700 1 -- 172.21.15.26:0/2554497135 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5260005040 con 0x7f526c0f74a0 2021-11-03T17:09:22.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.357+0000 7f5270d13700 1 --2- 172.21.15.26:0/2554497135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f526c0f74a0 0x7f526c10c180 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f5260009990 tx=0x7f5260009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:09:22.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.357+0000 7f5269ffb700 1 -- 172.21.15.26:0/2554497135 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5260018070 con 0x7f526c0f74a0 2021-11-03T17:09:22.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.357+0000 7f5269ffb700 1 -- 172.21.15.26:0/2554497135 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5260007ba0 con 0x7f526c0f74a0 2021-11-03T17:09:22.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.357+0000 7f5273778700 1 -- 172.21.15.26:0/2554497135 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f526c10c730 con 0x7f526c0f74a0 2021-11-03T17:09:22.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.357+0000 7f5269ffb700 1 -- 172.21.15.26:0/2554497135 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f526001c620 con 0x7f526c0f74a0 2021-11-03T17:09:22.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.357+0000 7f5273778700 1 -- 172.21.15.26:0/2554497135 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f526c10cc90 con 0x7f526c0f74a0 2021-11-03T17:09:22.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.358+0000 7f5273778700 1 -- 172.21.15.26:0/2554497135 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f526c045ad0 con 0x7f526c0f74a0 2021-11-03T17:09:22.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.358+0000 7f5269ffb700 1 -- 172.21.15.26:0/2554497135 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f526001c890 con 0x7f526c0f74a0 2021-11-03T17:09:22.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.359+0000 7f5269ffb700 1 --2- 172.21.15.26:0/2554497135 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f52540640b0 0x7f5254066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:09:22.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.359+0000 7f5269ffb700 1 -- 172.21.15.26:0/2554497135 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f52600825f0 con 0x7f526c0f74a0 2021-11-03T17:09:22.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.359+0000 7f5271514700 1 --2- 172.21.15.26:0/2554497135 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f52540640b0 0x7f5254066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:09:22.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.359+0000 7f5271514700 1 --2- 172.21.15.26:0/2554497135 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f52540640b0 0x7f5254066570 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f526c0f5240 tx=0x7f525c009220).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:09:22.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.363+0000 7f5269ffb700 1 -- 172.21.15.26:0/2554497135 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f5260054a10 con 0x7f526c0f74a0 2021-11-03T17:09:22.588 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.593+0000 7f5273778700 1 -- 172.21.15.26:0/2554497135 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f526c027a00 con 0x7f526c0f74a0 2021-11-03T17:09:22.589 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.594+0000 7f5269ffb700 1 -- 172.21.15.26:0/2554497135 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f5260054600 con 0x7f526c0f74a0 2021-11-03T17:09:22.590 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:09:22.590 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:09:22.590 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:09:22.591 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:09:22.591 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:09:22.591 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:09:22.591 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:09:22.591 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:09:22.592 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:09:22.592 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:09:22.592 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:09:22.592 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:09:22.593 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:09:22.593 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:09:22.593 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:09:22.593 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:09:22.594 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:09:22.594 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:09:22.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.595+0000 7f5273778700 1 -- 172.21.15.26:0/2554497135 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f52540640b0 msgr2=0x7f5254066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:09:22.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.595+0000 7f5273778700 1 --2- 172.21.15.26:0/2554497135 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f52540640b0 0x7f5254066570 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f526c0f5240 tx=0x7f525c009220).stop 2021-11-03T17:09:22.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.595+0000 7f5273778700 1 -- 172.21.15.26:0/2554497135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f526c0f74a0 msgr2=0x7f526c10c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:09:22.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.595+0000 7f5273778700 1 --2- 172.21.15.26:0/2554497135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f526c0f74a0 0x7f526c10c180 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f5260009990 tx=0x7f5260009b30).stop 2021-11-03T17:09:22.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.595+0000 7f5273778700 1 -- 172.21.15.26:0/2554497135 shutdown_connections 2021-11-03T17:09:22.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.595+0000 7f5273778700 1 --2- 172.21.15.26:0/2554497135 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f52540640b0 0x7f5254066570 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:22.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.595+0000 7f5273778700 1 --2- 172.21.15.26:0/2554497135 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f526c0f6b90 0x7f526c109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:22.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.595+0000 7f5273778700 1 --2- 172.21.15.26:0/2554497135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f526c0f74a0 0x7f526c10c180 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:22.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.595+0000 7f5273778700 1 -- 172.21.15.26:0/2554497135 >> 172.21.15.26:0/2554497135 conn(0x7f526c0f0540 msgr2=0x7f526c0fa390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:09:22.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.596+0000 7f5273778700 1 -- 172.21.15.26:0/2554497135 shutdown_connections 2021-11-03T17:09:22.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.596+0000 7f5273778700 1 -- 172.21.15.26:0/2554497135 wait complete. 2021-11-03T17:09:22.692 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.696+0000 7f4853ed8700 1 -- 172.21.15.26:0/4199225223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f484c0f6ff0 msgr2=0x7f484c0f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:09:22.693 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.696+0000 7f4853ed8700 1 --2- 172.21.15.26:0/4199225223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f484c0f6ff0 0x7f484c0f7a20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f4840004660 tx=0x7f4840009b30).stop 2021-11-03T17:09:22.693 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.696+0000 7f4853ed8700 1 -- 172.21.15.26:0/4199225223 shutdown_connections 2021-11-03T17:09:22.693 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.696+0000 7f4853ed8700 1 --2- 172.21.15.26:0/4199225223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f484c0f6ff0 0x7f484c0f7a20 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:22.693 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.696+0000 7f4853ed8700 1 --2- 172.21.15.26:0/4199225223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f484c0f66e0 0x7f484c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:22.694 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.696+0000 7f4853ed8700 1 -- 172.21.15.26:0/4199225223 >> 172.21.15.26:0/4199225223 conn(0x7f484c0f1f00 msgr2=0x7f484c0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:09:22.694 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.696+0000 7f4853ed8700 1 -- 172.21.15.26:0/4199225223 shutdown_connections 2021-11-03T17:09:22.694 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.696+0000 7f4853ed8700 1 -- 172.21.15.26:0/4199225223 wait complete. 2021-11-03T17:09:22.694 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.696+0000 7f4853ed8700 1 Processor -- start 2021-11-03T17:09:22.694 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.696+0000 7f4853ed8700 1 -- start start 2021-11-03T17:09:22.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.697+0000 7f4853ed8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f484c0f66e0 0x7f484c106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:09:22.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.697+0000 7f4853ed8700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f484c0f6ff0 0x7f484c1073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:09:22.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.697+0000 7f4853ed8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484c107990 con 0x7f484c0f66e0 2021-11-03T17:09:22.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.697+0000 7f4853ed8700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484c107ad0 con 0x7f484c0f6ff0 2021-11-03T17:09:22.696 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.697+0000 7f4851c74700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f484c0f66e0 0x7f484c106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:09:22.696 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.697+0000 7f4851c74700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f484c0f66e0 0x7f484c106ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52804/0 (socket says 172.21.15.26:52804) 2021-11-03T17:09:22.696 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.697+0000 7f4851c74700 1 -- 172.21.15.26:0/1288145691 learned_addr learned my addr 172.21.15.26:0/1288145691 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:09:22.696 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.697+0000 7f4851473700 1 --2- 172.21.15.26:0/1288145691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f484c0f6ff0 0x7f484c1073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:09:22.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.697+0000 7f4851c74700 1 -- 172.21.15.26:0/1288145691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f484c0f6ff0 msgr2=0x7f484c1073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:09:22.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.697+0000 7f4851c74700 1 --2- 172.21.15.26:0/1288145691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f484c0f6ff0 0x7f484c1073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:22.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.697+0000 7f4851c74700 1 -- 172.21.15.26:0/1288145691 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4840005040 con 0x7f484c0f66e0 2021-11-03T17:09:22.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.697+0000 7f4851c74700 1 --2- 172.21.15.26:0/1288145691 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f484c0f66e0 0x7f484c106ef0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f484400d8a0 tx=0x7f4844004f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:09:22.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.697+0000 7f484a7fc700 1 -- 172.21.15.26:0/1288145691 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f484400b5a0 con 0x7f484c0f66e0 2021-11-03T17:09:22.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.697+0000 7f484a7fc700 1 -- 172.21.15.26:0/1288145691 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f484400f040 con 0x7f484c0f66e0 2021-11-03T17:09:22.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.697+0000 7f484a7fc700 1 -- 172.21.15.26:0/1288145691 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4844013b40 con 0x7f484c0f66e0 2021-11-03T17:09:22.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.697+0000 7f4853ed8700 1 -- 172.21.15.26:0/1288145691 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f484c108470 con 0x7f484c0f66e0 2021-11-03T17:09:22.699 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.697+0000 7f4853ed8700 1 -- 172.21.15.26:0/1288145691 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f484c108a30 con 0x7f484c0f66e0 2021-11-03T17:09:22.701 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.698+0000 7f4853ed8700 1 -- 172.21.15.26:0/1288145691 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f484c045ad0 con 0x7f484c0f66e0 2021-11-03T17:09:22.701 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.699+0000 7f484a7fc700 1 -- 172.21.15.26:0/1288145691 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f484401a030 con 0x7f484c0f66e0 2021-11-03T17:09:22.701 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.699+0000 7f484a7fc700 1 --2- 172.21.15.26:0/1288145691 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f48340640b0 0x7f4834066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:09:22.701 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.699+0000 7f484a7fc700 1 -- 172.21.15.26:0/1288145691 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f4844080700 con 0x7f484c0f66e0 2021-11-03T17:09:22.702 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.699+0000 7f4851473700 1 --2- 172.21.15.26:0/1288145691 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f48340640b0 0x7f4834066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:09:22.702 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.700+0000 7f4851473700 1 --2- 172.21.15.26:0/1288145691 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f48340640b0 0x7f4834066570 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f4840004630 tx=0x7f4840009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:09:22.702 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.703+0000 7f484a7fc700 1 -- 172.21.15.26:0/1288145691 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f4844052a20 con 0x7f484c0f66e0 2021-11-03T17:09:22.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.910+0000 7f4853ed8700 1 -- 172.21.15.26:0/1288145691 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f484c0fefa0 con 0x7f484c0f66e0 2021-11-03T17:09:22.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.910+0000 7f484a7fc700 1 -- 172.21.15.26:0/1288145691 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f4844018070 con 0x7f484c0f66e0 2021-11-03T17:09:22.906 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:09:22.906 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:09:22.906 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:09:22.906 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:09:22.907 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:09:22.907 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:09:22.907 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:09:22.907 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:09:22.908 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:09:22.908 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:09:22.908 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:09:22.908 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:09:22.909 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:09:22.909 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:09:22.909 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:09:22.909 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:09:22.910 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:09:22.910 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:09:22.910 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:09:22.910 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:09:22.911 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:09:22.911 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:09:22.911 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:09:22.911 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:09:22.911 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:09:22.912 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:09:22.912 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:09:22.912 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:09:22.912 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:09:22.913 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:09:22.913 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:09:22.913 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:09:22.913 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:09:22.914 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:09:22.914 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:09:22.914 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:09:22.914 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:09:22.915 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:09:22.915 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:09:22.916 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.912+0000 7f4853ed8700 1 -- 172.21.15.26:0/1288145691 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f48340640b0 msgr2=0x7f4834066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:09:22.916 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.912+0000 7f4853ed8700 1 --2- 172.21.15.26:0/1288145691 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f48340640b0 0x7f4834066570 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f4840004630 tx=0x7f4840009b30).stop 2021-11-03T17:09:22.916 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.912+0000 7f4853ed8700 1 -- 172.21.15.26:0/1288145691 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f484c0f66e0 msgr2=0x7f484c106ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:09:22.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.912+0000 7f4853ed8700 1 --2- 172.21.15.26:0/1288145691 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f484c0f66e0 0x7f484c106ef0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f484400d8a0 tx=0x7f4844004f00).stop 2021-11-03T17:09:22.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.912+0000 7f4853ed8700 1 -- 172.21.15.26:0/1288145691 shutdown_connections 2021-11-03T17:09:22.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.912+0000 7f4853ed8700 1 --2- 172.21.15.26:0/1288145691 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f48340640b0 0x7f4834066570 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:22.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.912+0000 7f4853ed8700 1 --2- 172.21.15.26:0/1288145691 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f484c0f66e0 0x7f484c106ef0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:22.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.912+0000 7f4853ed8700 1 --2- 172.21.15.26:0/1288145691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f484c0f6ff0 0x7f484c1073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:22.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.912+0000 7f4853ed8700 1 -- 172.21.15.26:0/1288145691 >> 172.21.15.26:0/1288145691 conn(0x7f484c0f1f00 msgr2=0x7f484c0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:09:22.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.912+0000 7f4853ed8700 1 -- 172.21.15.26:0/1288145691 shutdown_connections 2021-11-03T17:09:22.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:22.912+0000 7f4853ed8700 1 -- 172.21.15.26:0/1288145691 wait complete. 2021-11-03T17:09:22.919 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:09:23.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:22 smithi026 ceph-mon[96795]: from='client.34596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:09:23.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:22 smithi026 ceph-mon[96795]: from='client.34600 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:09:23.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:22 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2554497135' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:09:23.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:22 smithi194 ceph-mon[65619]: from='client.34596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:09:23.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:22 smithi194 ceph-mon[65619]: from='client.34600 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:09:23.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:22 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2554497135' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:09:24.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:23 smithi026 ceph-mon[96795]: pgmap v442: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:24.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:23 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1288145691' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:09:24.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:23 smithi194 ceph-mon[65619]: pgmap v442: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:24.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:23 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1288145691' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:09:26.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:25 smithi026 ceph-mon[96795]: pgmap v443: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:26.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:25 smithi194 ceph-mon[65619]: pgmap v443: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:28.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:27 smithi026 ceph-mon[96795]: pgmap v444: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:28.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:27 smithi194 ceph-mon[65619]: pgmap v444: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:30.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:29 smithi026 ceph-mon[96795]: pgmap v445: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:30.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:29 smithi194 ceph-mon[65619]: pgmap v445: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:32.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:31 smithi026 ceph-mon[96795]: pgmap v446: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:32.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:31 smithi194 ceph-mon[65619]: pgmap v446: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:34.163 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:33 smithi194 ceph-mon[65619]: pgmap v447: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:34.165 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:33 smithi026 ceph-mon[96795]: pgmap v447: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:35.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:34 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:09:35.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:34 smithi026 ceph-mon[96795]: poll took 60065.033 ms: 1 events 2021-11-03T17:09:35.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:34 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:09:35.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:34 smithi194 ceph-mon[65619]: poll took 60065.033 ms: 1 events 2021-11-03T17:09:36.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:35 smithi026 ceph-mon[96795]: pgmap v448: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:36.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:35 smithi194 ceph-mon[65619]: pgmap v448: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:38.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:37 smithi194 ceph-mon[65619]: pgmap v449: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:38.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:37 smithi194 ceph-mon[65619]: poll took 2445.806 ms: 1 events 2021-11-03T17:09:38.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:37 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:09:38.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:37 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:09:38.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:37 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:09:38.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:37 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:09:38.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:37 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:09:38.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:37 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:09:38.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:37 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:09:38.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:37 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:09:38.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:37 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:09:38.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:37 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:09:38.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:37 smithi026 ceph-mon[96795]: pgmap v449: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:38.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:37 smithi026 ceph-mon[96795]: poll took 2445.806 ms: 1 events 2021-11-03T17:09:38.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:37 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:09:38.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:37 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:09:38.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:37 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:09:38.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:37 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:09:38.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:37 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:09:38.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:37 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:09:38.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:37 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:09:38.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:37 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:09:38.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:37 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:09:38.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:37 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:09:40.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:39 smithi194 ceph-mon[65619]: pgmap v450: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:40.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:39 smithi026 ceph-mon[96795]: pgmap v450: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:42.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:41 smithi194 ceph-mon[65619]: pgmap v451: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:42.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:41 smithi026 ceph-mon[96795]: pgmap v451: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:44.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:43 smithi194 ceph-mon[65619]: pgmap v452: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:44.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:43 smithi026 ceph-mon[96795]: pgmap v452: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:46.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:45 smithi194 ceph-mon[65619]: pgmap v453: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:46.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:45 smithi026 ceph-mon[96795]: pgmap v453: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:48.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:47 smithi194 ceph-mon[65619]: pgmap v454: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:48.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:47 smithi026 ceph-mon[96795]: pgmap v454: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:49.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:09:49.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:09:49.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:09:49.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:09:50.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:49 smithi194 ceph-mon[65619]: pgmap v455: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:50.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:49 smithi026 ceph-mon[96795]: pgmap v455: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:52.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:51 smithi194 ceph-mon[65619]: pgmap v456: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:52.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:51 smithi026 ceph-mon[96795]: pgmap v456: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:53.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.028+0000 7fe9e04c9700 1 -- 172.21.15.26:0/3194224113 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9d80f6860 msgr2=0x7fe9d80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:09:53.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.028+0000 7fe9e04c9700 1 --2- 172.21.15.26:0/3194224113 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9d80f6860 0x7fe9d80f6cc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fe9cc004660 tx=0x7fe9cc009b30).stop 2021-11-03T17:09:53.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.028+0000 7fe9e04c9700 1 -- 172.21.15.26:0/3194224113 shutdown_connections 2021-11-03T17:09:53.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.028+0000 7fe9e04c9700 1 --2- 172.21.15.26:0/3194224113 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9d80f6860 0x7fe9d80f6cc0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:53.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.028+0000 7fe9e04c9700 1 --2- 172.21.15.26:0/3194224113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9d80f55c0 0x7fe9d80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:53.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.028+0000 7fe9e04c9700 1 -- 172.21.15.26:0/3194224113 >> 172.21.15.26:0/3194224113 conn(0x7fe9d80f0d40 msgr2=0x7fe9d80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:09:53.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.028+0000 7fe9e04c9700 1 -- 172.21.15.26:0/3194224113 shutdown_connections 2021-11-03T17:09:53.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.028+0000 7fe9e04c9700 1 -- 172.21.15.26:0/3194224113 wait complete. 2021-11-03T17:09:53.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.029+0000 7fe9e04c9700 1 Processor -- start 2021-11-03T17:09:53.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.029+0000 7fe9e04c9700 1 -- start start 2021-11-03T17:09:53.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.029+0000 7fe9e04c9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9d80f55c0 0x7fe9d8106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:09:53.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.029+0000 7fe9e04c9700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9d80f6860 0x7fe9d8107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:09:53.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.029+0000 7fe9e04c9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d8107a10 con 0x7fe9d80f55c0 2021-11-03T17:09:53.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.029+0000 7fe9e04c9700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d8107b50 con 0x7fe9d80f6860 2021-11-03T17:09:53.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.029+0000 7fe9de265700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9d80f55c0 0x7fe9d8106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:09:53.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.029+0000 7fe9de265700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9d80f55c0 0x7fe9d8106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52822/0 (socket says 172.21.15.26:52822) 2021-11-03T17:09:53.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.029+0000 7fe9de265700 1 -- 172.21.15.26:0/1621029499 learned_addr learned my addr 172.21.15.26:0/1621029499 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:09:53.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.030+0000 7fe9dda64700 1 --2- 172.21.15.26:0/1621029499 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9d80f6860 0x7fe9d8107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:09:53.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.030+0000 7fe9de265700 1 -- 172.21.15.26:0/1621029499 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9d80f6860 msgr2=0x7fe9d8107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:09:53.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.030+0000 7fe9de265700 1 --2- 172.21.15.26:0/1621029499 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9d80f6860 0x7fe9d8107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:53.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.030+0000 7fe9de265700 1 -- 172.21.15.26:0/1621029499 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9cc005040 con 0x7fe9d80f55c0 2021-11-03T17:09:53.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.030+0000 7fe9dda64700 1 --2- 172.21.15.26:0/1621029499 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9d80f6860 0x7fe9d8107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:09:53.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.030+0000 7fe9de265700 1 --2- 172.21.15.26:0/1621029499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9d80f55c0 0x7fe9d8106f70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fe9d000d7f0 tx=0x7fe9d0004e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:09:53.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.030+0000 7fe9d6ffd700 1 -- 172.21.15.26:0/1621029499 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9d000b4f0 con 0x7fe9d80f55c0 2021-11-03T17:09:53.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.030+0000 7fe9e04c9700 1 -- 172.21.15.26:0/1621029499 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9d81084f0 con 0x7fe9d80f55c0 2021-11-03T17:09:53.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.030+0000 7fe9d6ffd700 1 -- 172.21.15.26:0/1621029499 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe9d000f040 con 0x7fe9d80f55c0 2021-11-03T17:09:53.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.030+0000 7fe9d6ffd700 1 -- 172.21.15.26:0/1621029499 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9d0013980 con 0x7fe9d80f55c0 2021-11-03T17:09:53.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.030+0000 7fe9e04c9700 1 -- 172.21.15.26:0/1621029499 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d8108ab0 con 0x7fe9d80f55c0 2021-11-03T17:09:53.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.031+0000 7fe9e04c9700 1 -- 172.21.15.26:0/1621029499 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9d8045ad0 con 0x7fe9d80f55c0 2021-11-03T17:09:53.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.032+0000 7fe9d6ffd700 1 -- 172.21.15.26:0/1621029499 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fe9d001a030 con 0x7fe9d80f55c0 2021-11-03T17:09:53.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.032+0000 7fe9d6ffd700 1 --2- 172.21.15.26:0/1621029499 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe9c00640b0 0x7fe9c0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:09:53.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.032+0000 7fe9d6ffd700 1 -- 172.21.15.26:0/1621029499 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fe9d00808b0 con 0x7fe9d80f55c0 2021-11-03T17:09:53.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.032+0000 7fe9dda64700 1 --2- 172.21.15.26:0/1621029499 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe9c00640b0 0x7fe9c0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:09:53.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.033+0000 7fe9dda64700 1 --2- 172.21.15.26:0/1621029499 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe9c00640b0 0x7fe9c0066570 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fe9cc004630 tx=0x7fe9cc009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:09:53.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.036+0000 7fe9d6ffd700 1 -- 172.21.15.26:0/1621029499 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fe9d0052b20 con 0x7fe9d80f55c0 2021-11-03T17:09:53.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.215+0000 7fe9e04c9700 1 -- 172.21.15.26:0/1621029499 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9d805fd30 con 0x7fe9c00640b0 2021-11-03T17:09:53.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.217+0000 7fe9d6ffd700 1 -- 172.21.15.26:0/1621029499 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fe9d805fd30 con 0x7fe9c00640b0 2021-11-03T17:09:53.213 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.218+0000 7fe9e04c9700 1 -- 172.21.15.26:0/1621029499 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe9c00640b0 msgr2=0x7fe9c0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:09:53.214 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.218+0000 7fe9e04c9700 1 --2- 172.21.15.26:0/1621029499 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe9c00640b0 0x7fe9c0066570 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fe9cc004630 tx=0x7fe9cc009b30).stop 2021-11-03T17:09:53.214 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.218+0000 7fe9e04c9700 1 -- 172.21.15.26:0/1621029499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9d80f55c0 msgr2=0x7fe9d8106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:09:53.214 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.218+0000 7fe9e04c9700 1 --2- 172.21.15.26:0/1621029499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9d80f55c0 0x7fe9d8106f70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fe9d000d7f0 tx=0x7fe9d0004e80).stop 2021-11-03T17:09:53.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.218+0000 7fe9e04c9700 1 -- 172.21.15.26:0/1621029499 shutdown_connections 2021-11-03T17:09:53.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.218+0000 7fe9e04c9700 1 --2- 172.21.15.26:0/1621029499 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe9c00640b0 0x7fe9c0066570 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:53.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.218+0000 7fe9e04c9700 1 --2- 172.21.15.26:0/1621029499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9d80f55c0 0x7fe9d8106f70 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:53.216 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.218+0000 7fe9e04c9700 1 --2- 172.21.15.26:0/1621029499 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9d80f6860 0x7fe9d8107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:53.216 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.219+0000 7fe9e04c9700 1 -- 172.21.15.26:0/1621029499 >> 172.21.15.26:0/1621029499 conn(0x7fe9d80f0d40 msgr2=0x7fe9d805f620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:09:53.216 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.219+0000 7fe9e04c9700 1 -- 172.21.15.26:0/1621029499 shutdown_connections 2021-11-03T17:09:53.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.219+0000 7fe9e04c9700 1 -- 172.21.15.26:0/1621029499 wait complete. 2021-11-03T17:09:53.223 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:09:53.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:52 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:09:53.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.319+0000 7f0d9ce07700 1 -- 172.21.15.26:0/900827585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d980f7980 msgr2=0x7f0d980f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:09:53.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.319+0000 7f0d9ce07700 1 --2- 172.21.15.26:0/900827585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d980f7980 0x7f0d980f7de0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f0d88004660 tx=0x7f0d88009b30).stop 2021-11-03T17:09:53.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.319+0000 7f0d9ce07700 1 -- 172.21.15.26:0/900827585 shutdown_connections 2021-11-03T17:09:53.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.319+0000 7f0d9ce07700 1 --2- 172.21.15.26:0/900827585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d980f7980 0x7f0d980f7de0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:53.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.319+0000 7f0d9ce07700 1 --2- 172.21.15.26:0/900827585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d980f66e0 0x7f0d980f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:09:53.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.319+0000 7f0d9ce07700 1 -- 172.21.15.26:0/900827585 >> 172.21.15.26:0/900827585 conn(0x7f0d980f1e40 msgr2=0x7f0d980f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:09:53.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.319+0000 7f0d9ce07700 1 -- 172.21.15.26:0/900827585 shutdown_connections 2021-11-03T17:09:53.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.319+0000 7f0d9ce07700 1 -- 172.21.15.26:0/900827585 wait complete. 2021-11-03T17:09:53.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.319+0000 7f0d9ce07700 1 Processor -- start 2021-11-03T17:09:53.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.320+0000 7f0d9ce07700 1 -- start start 2021-11-03T17:09:53.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.320+0000 7f0d9ce07700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d980f66e0 0x7f0d9806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:09:53.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.320+0000 7f0d9ce07700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d980f7980 0x7f0d98069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:09:53.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.320+0000 7f0d9ce07700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9806a410 con 0x7f0d980f66e0 2021-11-03T17:09:53.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.320+0000 7f0d9ce07700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9806a550 con 0x7f0d980f7980 2021-11-03T17:09:53.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.320+0000 7f0d9659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d980f66e0 0x7f0d9806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:09:53.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.320+0000 7f0d9659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d980f66e0 0x7f0d9806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52832/0 (socket says 172.21.15.26:52832) 2021-11-03T17:09:53.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.320+0000 7f0d9659c700 1 -- 172.21.15.26:0/829754880 learned_addr learned my addr 172.21.15.26:0/829754880 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:09:53.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.320+0000 7f0d95d9b700 1 --2- 172.21.15.26:0/829754880 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d980f7980 0x7f0d98069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:09:53.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.320+0000 7f0d9659c700 1 -- 172.21.15.26:0/829754880 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d980f7980 msgr2=0x7f0d98069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:09:53.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.320+0000 7f0d9659c700 1 --2- 172.21.15.26:0/829754880 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d980f7980 0x7f0d98069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:53.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.320+0000 7f0d9659c700 1 -- 172.21.15.26:0/829754880 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d88005040 con 0x7f0d980f66e0 2021-11-03T17:09:53.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.320+0000 7f0d95d9b700 1 --2- 172.21.15.26:0/829754880 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d980f7980 0x7f0d98069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:09:53.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.320+0000 7f0d9659c700 1 --2- 172.21.15.26:0/829754880 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d980f66e0 0x7f0d9806b9a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f0d800093f0 tx=0x7f0d80006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:09:53.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.320+0000 7f0d8effd700 1 -- 172.21.15.26:0/829754880 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d80009ea0 con 0x7f0d980f66e0 2021-11-03T17:09:53.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.320+0000 7f0d8effd700 1 -- 172.21.15.26:0/829754880 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0d80013af0 con 0x7f0d980f66e0 2021-11-03T17:09:53.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.320+0000 7f0d9ce07700 1 -- 172.21.15.26:0/829754880 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d9806a830 con 0x7f0d980f66e0 2021-11-03T17:09:53.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.321+0000 7f0d8effd700 1 -- 172.21.15.26:0/829754880 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d8000db10 con 0x7f0d980f66e0 2021-11-03T17:09:53.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.321+0000 7f0d9ce07700 1 -- 172.21.15.26:0/829754880 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d9810efe0 con 0x7f0d980f66e0 2021-11-03T17:09:53.323 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.321+0000 7f0d9ce07700 1 -- 172.21.15.26:0/829754880 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d98045ad0 con 0x7f0d980f66e0 2021-11-03T17:09:53.323 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.322+0000 7f0d8effd700 1 -- 172.21.15.26:0/829754880 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f0d8001a060 con 0x7f0d980f66e0 2021-11-03T17:09:53.323 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.322+0000 7f0d8effd700 1 --2- 172.21.15.26:0/829754880 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0d840640b0 0x7f0d84066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:09:53.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.322+0000 7f0d8effd700 1 -- 172.21.15.26:0/829754880 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f0d800808f0 con 0x7f0d980f66e0 2021-11-03T17:09:53.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.322+0000 7f0d95d9b700 1 --2- 172.21.15.26:0/829754880 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0d840640b0 0x7f0d84066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:09:53.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.323+0000 7f0d95d9b700 1 --2- 172.21.15.26:0/829754880 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0d840640b0 0x7f0d84066570 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f0d88009da0 tx=0x7f0d88009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:09:53.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.327+0000 7f0d8effd700 1 -- 172.21.15.26:0/829754880 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f0d80052c10 con 0x7f0d980f66e0 2021-11-03T17:09:53.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:52 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:09:53.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.498+0000 7f0d9ce07700 1 -- 172.21.15.26:0/829754880 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d98057f10 con 0x7f0d840640b0 2021-11-03T17:09:53.507 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.513+0000 7f0d8effd700 1 -- 172.21.15.26:0/829754880 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f0d98057f10 con 0x7f0d840640b0 2021-11-03T17:09:53.508 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:09:53.508 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (21m) 79s ago 22m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:09:53.508 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (13m) 79s ago 22m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:09:53.509 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (13m) 16s ago 21m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:09:53.509 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (20m) 79s ago 22m 39.5M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:09:53.509 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (14m) 79s ago 17m 16.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:09:53.509 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (14m) 79s ago 17m 17.8M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:09:53.509 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (17m) 16s ago 17m 19.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:09:53.510 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (17m) 16s ago 17m 19.4M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:09:53.510 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (14m) 79s ago 23m 491M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:09:53.510 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (14m) 16s ago 21m 415M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:09:53.510 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (14m) 79s ago 23m 113M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:09:53.511 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (13m) 16s ago 21m 70.2M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:09:53.511 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (22m) 79s ago 21m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:09:53.511 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (21m) 16s ago 21m 18.4M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:09:53.512 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (12m) 79s ago 20m 190M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:09:53.512 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (12m) 79s ago 20m 204M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:09:53.512 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (11m) 79s ago 20m 170M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:09:53.512 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (11m) 16s ago 19m 211M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:09:53.513 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (10m) 16s ago 19m 189M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:09:53.513 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (10m) 16s ago 19m 174M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:09:53.513 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (20m) 79s ago 21m 49.9M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:09:53.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.515+0000 7f0d9ce07700 1 -- 172.21.15.26:0/829754880 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0d840640b0 msgr2=0x7f0d84066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:09:53.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.515+0000 7f0d9ce07700 1 --2- 172.21.15.26:0/829754880 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0d840640b0 0x7f0d84066570 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f0d88009da0 tx=0x7f0d88009b30).stop 2021-11-03T17:09:53.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.515+0000 7f0d9ce07700 1 -- 172.21.15.26:0/829754880 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d980f66e0 msgr2=0x7f0d9806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:09:53.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.515+0000 7f0d9ce07700 1 --2- 172.21.15.26:0/829754880 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d980f66e0 0x7f0d9806b9a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f0d800093f0 tx=0x7f0d80006ec0).stop 2021-11-03T17:09:53.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.515+0000 7f0d9ce07700 1 -- 172.21.15.26:0/829754880 shutdown_connections 2021-11-03T17:09:53.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.515+0000 7f0d9ce07700 1 --2- 172.21.15.26:0/829754880 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0d840640b0 0x7f0d84066570 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:53.517 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.515+0000 7f0d9ce07700 1 --2- 172.21.15.26:0/829754880 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d980f66e0 0x7f0d9806b9a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:53.517 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.515+0000 7f0d9ce07700 1 --2- 172.21.15.26:0/829754880 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d980f7980 0x7f0d98069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:53.517 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.515+0000 7f0d9ce07700 1 -- 172.21.15.26:0/829754880 >> 172.21.15.26:0/829754880 conn(0x7f0d980f1e40 msgr2=0x7f0d980fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:09:53.517 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.515+0000 7f0d9ce07700 1 -- 172.21.15.26:0/829754880 shutdown_connections 2021-11-03T17:09:53.518 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.515+0000 7f0d9ce07700 1 -- 172.21.15.26:0/829754880 wait complete. 2021-11-03T17:09:53.610 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.614+0000 7fb349c34700 1 -- 172.21.15.26:0/2291324421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3440f7980 msgr2=0x7fb3440f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:09:53.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.614+0000 7fb349c34700 1 --2- 172.21.15.26:0/2291324421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3440f7980 0x7fb3440f7de0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7fb32c004660 tx=0x7fb32c009b30).stop 2021-11-03T17:09:53.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.614+0000 7fb349c34700 1 -- 172.21.15.26:0/2291324421 shutdown_connections 2021-11-03T17:09:53.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.614+0000 7fb349c34700 1 --2- 172.21.15.26:0/2291324421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3440f7980 0x7fb3440f7de0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:53.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.614+0000 7fb349c34700 1 --2- 172.21.15.26:0/2291324421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3440f66e0 0x7fb3440f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:53.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.614+0000 7fb349c34700 1 -- 172.21.15.26:0/2291324421 >> 172.21.15.26:0/2291324421 conn(0x7fb3440f1e40 msgr2=0x7fb3440f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:09:53.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.614+0000 7fb349c34700 1 -- 172.21.15.26:0/2291324421 shutdown_connections 2021-11-03T17:09:53.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.614+0000 7fb349c34700 1 -- 172.21.15.26:0/2291324421 wait complete. 2021-11-03T17:09:53.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.614+0000 7fb349c34700 1 Processor -- start 2021-11-03T17:09:53.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.615+0000 7fb349c34700 1 -- start start 2021-11-03T17:09:53.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.615+0000 7fb349c34700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3440f66e0 0x7fb34406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:09:53.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.615+0000 7fb349c34700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3440f7980 0x7fb344069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:09:53.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.615+0000 7fb349c34700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34406a380 con 0x7fb3440f66e0 2021-11-03T17:09:53.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.615+0000 7fb349c34700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34406a4c0 con 0x7fb3440f7980 2021-11-03T17:09:53.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.615+0000 7fb3437fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3440f66e0 0x7fb34406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:09:53.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.615+0000 7fb3437fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3440f66e0 0x7fb34406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52842/0 (socket says 172.21.15.26:52842) 2021-11-03T17:09:53.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.615+0000 7fb3437fe700 1 -- 172.21.15.26:0/2348951342 learned_addr learned my addr 172.21.15.26:0/2348951342 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:09:53.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.615+0000 7fb342ffd700 1 --2- 172.21.15.26:0/2348951342 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3440f7980 0x7fb344069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:09:53.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.615+0000 7fb3437fe700 1 -- 172.21.15.26:0/2348951342 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3440f7980 msgr2=0x7fb344069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:09:53.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.615+0000 7fb3437fe700 1 --2- 172.21.15.26:0/2348951342 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3440f7980 0x7fb344069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:53.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.615+0000 7fb3437fe700 1 -- 172.21.15.26:0/2348951342 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb32c005040 con 0x7fb3440f66e0 2021-11-03T17:09:53.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.615+0000 7fb342ffd700 1 --2- 172.21.15.26:0/2348951342 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3440f7980 0x7fb344069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:09:53.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.616+0000 7fb3437fe700 1 --2- 172.21.15.26:0/2348951342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3440f66e0 0x7fb34406b9a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7fb33c00c710 tx=0x7fb33c004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:09:53.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.616+0000 7fb33bfff700 1 -- 172.21.15.26:0/2348951342 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb33c0106f0 con 0x7fb3440f66e0 2021-11-03T17:09:53.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.616+0000 7fb349c34700 1 -- 172.21.15.26:0/2348951342 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb34406a7a0 con 0x7fb3440f66e0 2021-11-03T17:09:53.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.616+0000 7fb33bfff700 1 -- 172.21.15.26:0/2348951342 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb33c010d00 con 0x7fb3440f66e0 2021-11-03T17:09:53.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.616+0000 7fb33bfff700 1 -- 172.21.15.26:0/2348951342 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb33c012d90 con 0x7fb3440f66e0 2021-11-03T17:09:53.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.616+0000 7fb349c34700 1 -- 172.21.15.26:0/2348951342 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb34410ef90 con 0x7fb3440f66e0 2021-11-03T17:09:53.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.617+0000 7fb349c34700 1 -- 172.21.15.26:0/2348951342 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb344045ad0 con 0x7fb3440f66e0 2021-11-03T17:09:53.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.617+0000 7fb33bfff700 1 -- 172.21.15.26:0/2348951342 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fb33c010070 con 0x7fb3440f66e0 2021-11-03T17:09:53.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.617+0000 7fb33bfff700 1 --2- 172.21.15.26:0/2348951342 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb3300640b0 0x7fb330066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:09:53.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.618+0000 7fb33bfff700 1 -- 172.21.15.26:0/2348951342 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fb33c080d80 con 0x7fb3440f66e0 2021-11-03T17:09:53.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.618+0000 7fb342ffd700 1 --2- 172.21.15.26:0/2348951342 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb3300640b0 0x7fb330066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:09:53.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.618+0000 7fb342ffd700 1 --2- 172.21.15.26:0/2348951342 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb3300640b0 0x7fb330066570 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fb32c004e30 tx=0x7fb32c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:09:53.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.622+0000 7fb33bfff700 1 -- 172.21.15.26:0/2348951342 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fb33c0530b0 con 0x7fb3440f66e0 2021-11-03T17:09:53.846 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.851+0000 7fb349c34700 1 -- 172.21.15.26:0/2348951342 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb3440ff020 con 0x7fb3440f66e0 2021-11-03T17:09:53.846 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.851+0000 7fb33bfff700 1 -- 172.21.15.26:0/2348951342 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fb33c052ca0 con 0x7fb3440f66e0 2021-11-03T17:09:53.846 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:09:53.847 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:09:53.847 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:09:53.847 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:09:53.847 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:09:53.848 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:09:53.848 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:09:53.848 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:09:53.849 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:09:53.849 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:09:53.849 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:09:53.850 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:09:53.850 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:09:53.850 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:09:53.850 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:09:53.851 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:09:53.851 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:09:53.851 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:09:53.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.853+0000 7fb349c34700 1 -- 172.21.15.26:0/2348951342 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb3300640b0 msgr2=0x7fb330066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:09:53.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.853+0000 7fb349c34700 1 --2- 172.21.15.26:0/2348951342 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb3300640b0 0x7fb330066570 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fb32c004e30 tx=0x7fb32c009b30).stop 2021-11-03T17:09:53.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.853+0000 7fb349c34700 1 -- 172.21.15.26:0/2348951342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3440f66e0 msgr2=0x7fb34406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:09:53.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.853+0000 7fb349c34700 1 --2- 172.21.15.26:0/2348951342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3440f66e0 0x7fb34406b9a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7fb33c00c710 tx=0x7fb33c004d10).stop 2021-11-03T17:09:53.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.853+0000 7fb349c34700 1 -- 172.21.15.26:0/2348951342 shutdown_connections 2021-11-03T17:09:53.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.853+0000 7fb349c34700 1 --2- 172.21.15.26:0/2348951342 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb3300640b0 0x7fb330066570 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:53.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.853+0000 7fb349c34700 1 --2- 172.21.15.26:0/2348951342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3440f66e0 0x7fb34406b9a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:53.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.853+0000 7fb349c34700 1 --2- 172.21.15.26:0/2348951342 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3440f7980 0x7fb344069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:53.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.853+0000 7fb349c34700 1 -- 172.21.15.26:0/2348951342 >> 172.21.15.26:0/2348951342 conn(0x7fb3440f1e40 msgr2=0x7fb3440fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:09:53.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.853+0000 7fb349c34700 1 -- 172.21.15.26:0/2348951342 shutdown_connections 2021-11-03T17:09:53.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.853+0000 7fb349c34700 1 -- 172.21.15.26:0/2348951342 wait complete. 2021-11-03T17:09:53.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.954+0000 7f6a22835700 1 -- 172.21.15.26:0/30695385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a1c0f6860 msgr2=0x7f6a1c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:09:53.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.954+0000 7f6a22835700 1 --2- 172.21.15.26:0/30695385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a1c0f6860 0x7f6a1c0f6cc0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f6a04004660 tx=0x7f6a04009b30).stop 2021-11-03T17:09:53.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.954+0000 7f6a22835700 1 -- 172.21.15.26:0/30695385 shutdown_connections 2021-11-03T17:09:53.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.954+0000 7f6a22835700 1 --2- 172.21.15.26:0/30695385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a1c0f6860 0x7f6a1c0f6cc0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:53.950 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.954+0000 7f6a22835700 1 --2- 172.21.15.26:0/30695385 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a1c0f55c0 0x7f6a1c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:53.950 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.954+0000 7f6a22835700 1 -- 172.21.15.26:0/30695385 >> 172.21.15.26:0/30695385 conn(0x7f6a1c0f0d40 msgr2=0x7f6a1c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:09:53.950 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.954+0000 7f6a22835700 1 -- 172.21.15.26:0/30695385 shutdown_connections 2021-11-03T17:09:53.950 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.954+0000 7f6a22835700 1 -- 172.21.15.26:0/30695385 wait complete. 2021-11-03T17:09:53.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.954+0000 7f6a22835700 1 Processor -- start 2021-11-03T17:09:53.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.955+0000 7f6a22835700 1 -- start start 2021-11-03T17:09:53.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.955+0000 7f6a22835700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a1c0f55c0 0x7f6a1c1070f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:09:53.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.955+0000 7f6a22835700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a1c1075e0 0x7f6a1c1084d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:09:53.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.955+0000 7f6a22835700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c107ab0 con 0x7f6a1c0f55c0 2021-11-03T17:09:53.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.955+0000 7f6a22835700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c107bf0 con 0x7f6a1c1075e0 2021-11-03T17:09:53.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.955+0000 7f6a1bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a1c0f55c0 0x7f6a1c1070f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:09:53.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.955+0000 7f6a1bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a1c0f55c0 0x7f6a1c1070f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52852/0 (socket says 172.21.15.26:52852) 2021-11-03T17:09:53.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.955+0000 7f6a1bfff700 1 -- 172.21.15.26:0/1062572731 learned_addr learned my addr 172.21.15.26:0/1062572731 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:09:53.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.955+0000 7f6a1b7fe700 1 --2- 172.21.15.26:0/1062572731 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a1c1075e0 0x7f6a1c1084d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:09:53.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.955+0000 7f6a1bfff700 1 -- 172.21.15.26:0/1062572731 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a1c1075e0 msgr2=0x7f6a1c1084d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:09:53.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.955+0000 7f6a1bfff700 1 --2- 172.21.15.26:0/1062572731 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a1c1075e0 0x7f6a1c1084d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:53.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.955+0000 7f6a1bfff700 1 -- 172.21.15.26:0/1062572731 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a04005040 con 0x7f6a1c0f55c0 2021-11-03T17:09:53.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.955+0000 7f6a1bfff700 1 --2- 172.21.15.26:0/1062572731 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a1c0f55c0 0x7f6a1c1070f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f6a0c00c790 tx=0x7f6a0c007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:09:53.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.956+0000 7f6a18ff9700 1 -- 172.21.15.26:0/1062572731 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a0c00e680 con 0x7f6a1c0f55c0 2021-11-03T17:09:53.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.956+0000 7f6a18ff9700 1 -- 172.21.15.26:0/1062572731 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6a0c00ec90 con 0x7f6a1c0f55c0 2021-11-03T17:09:53.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.956+0000 7f6a22835700 1 -- 172.21.15.26:0/1062572731 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a1c108a80 con 0x7f6a1c0f55c0 2021-11-03T17:09:53.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.956+0000 7f6a18ff9700 1 -- 172.21.15.26:0/1062572731 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a0c012d00 con 0x7f6a1c0f55c0 2021-11-03T17:09:53.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.956+0000 7f6a22835700 1 -- 172.21.15.26:0/1062572731 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a1c109040 con 0x7f6a1c0f55c0 2021-11-03T17:09:53.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.957+0000 7f6a22835700 1 -- 172.21.15.26:0/1062572731 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a1c045ad0 con 0x7f6a1c0f55c0 2021-11-03T17:09:53.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.958+0000 7f6a18ff9700 1 -- 172.21.15.26:0/1062572731 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f6a0c010070 con 0x7f6a1c0f55c0 2021-11-03T17:09:53.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.958+0000 7f6a18ff9700 1 --2- 172.21.15.26:0/1062572731 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6a080640b0 0x7f6a08066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:09:53.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.958+0000 7f6a18ff9700 1 -- 172.21.15.26:0/1062572731 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f6a0c0809a0 con 0x7f6a1c0f55c0 2021-11-03T17:09:53.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.959+0000 7f6a1b7fe700 1 --2- 172.21.15.26:0/1062572731 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6a080640b0 0x7f6a08066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:09:53.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.959+0000 7f6a1b7fe700 1 --2- 172.21.15.26:0/1062572731 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6a080640b0 0x7f6a08066570 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f6a04000c00 tx=0x7f6a04009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:09:53.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:53.962+0000 7f6a18ff9700 1 -- 172.21.15.26:0/1062572731 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f6a0c052c10 con 0x7f6a1c0f55c0 2021-11-03T17:09:54.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:54.167+0000 7f6a22835700 1 -- 172.21.15.26:0/1062572731 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6a1c027a00 con 0x7f6a1c0f55c0 2021-11-03T17:09:54.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:54.167+0000 7f6a18ff9700 1 -- 172.21.15.26:0/1062572731 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f6a0c052800 con 0x7f6a1c0f55c0 2021-11-03T17:09:54.163 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:09:54.163 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:09:54.163 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:09:54.163 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:09:54.164 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:09:54.164 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:09:54.164 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:09:54.164 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:09:54.164 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:09:54.165 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:09:54.165 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:09:54.165 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:09:54.165 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:09:54.166 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:09:54.166 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:09:54.166 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:09:54.166 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:09:54.167 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:09:54.167 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:09:54.167 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:09:54.167 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:09:54.167 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:09:54.168 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:09:54.168 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:09:54.168 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:09:54.168 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:09:54.169 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:09:54.169 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:09:54.169 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:09:54.169 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:09:54.170 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:09:54.170 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:09:54.170 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:09:54.170 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:09:54.170 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:09:54.171 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:09:54.171 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:09:54.171 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:09:54.171 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:09:54.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:54.169+0000 7f6a22835700 1 -- 172.21.15.26:0/1062572731 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6a080640b0 msgr2=0x7f6a08066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:09:54.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:54.169+0000 7f6a22835700 1 --2- 172.21.15.26:0/1062572731 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6a080640b0 0x7f6a08066570 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f6a04000c00 tx=0x7f6a04009b30).stop 2021-11-03T17:09:54.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:54.169+0000 7f6a22835700 1 -- 172.21.15.26:0/1062572731 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a1c0f55c0 msgr2=0x7f6a1c1070f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:09:54.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:54.169+0000 7f6a22835700 1 --2- 172.21.15.26:0/1062572731 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a1c0f55c0 0x7f6a1c1070f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f6a0c00c790 tx=0x7f6a0c007d90).stop 2021-11-03T17:09:54.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:54.169+0000 7f6a22835700 1 -- 172.21.15.26:0/1062572731 shutdown_connections 2021-11-03T17:09:54.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:54.169+0000 7f6a22835700 1 --2- 172.21.15.26:0/1062572731 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6a080640b0 0x7f6a08066570 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:54.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:54.169+0000 7f6a22835700 1 --2- 172.21.15.26:0/1062572731 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a1c0f55c0 0x7f6a1c1070f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:54.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:54.169+0000 7f6a22835700 1 --2- 172.21.15.26:0/1062572731 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a1c1075e0 0x7f6a1c1084d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:09:54.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:54.169+0000 7f6a22835700 1 -- 172.21.15.26:0/1062572731 >> 172.21.15.26:0/1062572731 conn(0x7f6a1c0f0d40 msgr2=0x7f6a1c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:09:54.175 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:54.169+0000 7f6a22835700 1 -- 172.21.15.26:0/1062572731 shutdown_connections 2021-11-03T17:09:54.175 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:09:54.169+0000 7f6a22835700 1 -- 172.21.15.26:0/1062572731 wait complete. 2021-11-03T17:09:54.175 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:09:54.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:53 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:09:54.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:53 smithi194 ceph-mon[65619]: pgmap v457: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:54.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:53 smithi194 ceph-mon[65619]: from='client.34612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:09:54.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:53 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2348951342' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:09:54.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:53 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:09:54.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:53 smithi026 ceph-mon[96795]: pgmap v457: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:54.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:53 smithi026 ceph-mon[96795]: from='client.34612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:09:54.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:53 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2348951342' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:09:55.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:54 smithi194 ceph-mon[65619]: from='client.34616 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:09:55.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:54 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1062572731' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:09:55.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:54 smithi026 ceph-mon[96795]: from='client.34616 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:09:55.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:54 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1062572731' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:09:56.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:55 smithi194 ceph-mon[65619]: pgmap v458: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:56.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:55 smithi026 ceph-mon[96795]: pgmap v458: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:58.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:57 smithi194 ceph-mon[65619]: pgmap v459: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:09:58.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:57 smithi026 ceph-mon[96795]: pgmap v459: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:00.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:09:59 smithi194 ceph-mon[65619]: pgmap v460: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:00.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:09:59 smithi026 ceph-mon[96795]: pgmap v460: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:00.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:00 smithi026 conmon[96772]: 2021-11-03T17:09:59.998+0000 7f27986f6700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 2 daemons have recently crashed 2021-11-03T17:10:01.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:01 smithi194 ceph-mon[65619]: overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 2 daemons have recently crashed 2021-11-03T17:10:01.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:00 smithi026 ceph-mon[96795]: overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 2 daemons have recently crashed 2021-11-03T17:10:02.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:02 smithi194 ceph-mon[65619]: pgmap v461: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:02.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:02 smithi026 ceph-mon[96795]: pgmap v461: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:04.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:04 smithi026 ceph-mon[96795]: pgmap v462: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:04.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:04 smithi194 ceph-mon[65619]: pgmap v462: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:06.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:06 smithi026 ceph-mon[96795]: pgmap v463: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:06.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:06 smithi194 ceph-mon[65619]: pgmap v463: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:08.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:08 smithi026 ceph-mon[96795]: pgmap v464: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:08.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:08 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:10:08.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:08 smithi194 ceph-mon[65619]: pgmap v464: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:08.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:08 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:10:09.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:09 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:10:09.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:09 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:10:10.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:10 smithi026 ceph-mon[96795]: pgmap v465: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:10.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:10 smithi194 ceph-mon[65619]: pgmap v465: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:12.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:12 smithi026 ceph-mon[96795]: pgmap v466: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:12.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:12 smithi194 ceph-mon[65619]: pgmap v466: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:14.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:14 smithi026 ceph-mon[96795]: pgmap v467: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:14.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:14 smithi194 ceph-mon[65619]: pgmap v467: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:16.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:16 smithi026 ceph-mon[96795]: pgmap v468: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:16.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:16 smithi194 ceph-mon[65619]: pgmap v468: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:18.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:18 smithi026 ceph-mon[96795]: pgmap v469: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:18.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:18 smithi194 ceph-mon[65619]: pgmap v469: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:20.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:20 smithi026 ceph-mon[96795]: pgmap v470: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:20.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:20 smithi194 ceph-mon[65619]: pgmap v470: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:22.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:22 smithi026 ceph-mon[96795]: pgmap v471: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:22.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:22 smithi194 ceph-mon[65619]: pgmap v471: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:23.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:23 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:10:23.470 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:23 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:10:24.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.284+0000 7fed0e37b700 1 -- 172.21.15.26:0/1799592775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed080fbbf0 msgr2=0x7fed080fdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:10:24.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.284+0000 7fed0e37b700 1 --2- 172.21.15.26:0/1799592775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed080fbbf0 0x7fed080fdfe0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7fecf8004660 tx=0x7fecf8009b30).stop 2021-11-03T17:10:24.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.284+0000 7fed0e37b700 1 -- 172.21.15.26:0/1799592775 shutdown_connections 2021-11-03T17:10:24.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.284+0000 7fed0e37b700 1 --2- 172.21.15.26:0/1799592775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed080fbbf0 0x7fed080fdfe0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:24.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.284+0000 7fed0e37b700 1 --2- 172.21.15.26:0/1799592775 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed08060430 0x7fed080fb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:24.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.284+0000 7fed0e37b700 1 -- 172.21.15.26:0/1799592775 >> 172.21.15.26:0/1799592775 conn(0x7fed080f0d20 msgr2=0x7fed080f3140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:10:24.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.284+0000 7fed0e37b700 1 -- 172.21.15.26:0/1799592775 shutdown_connections 2021-11-03T17:10:24.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.284+0000 7fed0e37b700 1 -- 172.21.15.26:0/1799592775 wait complete. 2021-11-03T17:10:24.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.284+0000 7fed0e37b700 1 Processor -- start 2021-11-03T17:10:24.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.284+0000 7fed0e37b700 1 -- start start 2021-11-03T17:10:24.284 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.284+0000 7fed0e37b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed08060430 0x7fed08109190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:10:24.284 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.284+0000 7fed0e37b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed080fbbf0 0x7fed08109680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:10:24.285 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.284+0000 7fed0e37b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed08109c30 con 0x7fed080fbbf0 2021-11-03T17:10:24.285 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.284+0000 7fed0e37b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed08109d70 con 0x7fed08060430 2021-11-03T17:10:24.285 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.284+0000 7fed077fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed080fbbf0 0x7fed08109680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:10:24.285 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.284+0000 7fed077fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed080fbbf0 0x7fed08109680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52872/0 (socket says 172.21.15.26:52872) 2021-11-03T17:10:24.286 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.284+0000 7fed077fe700 1 -- 172.21.15.26:0/134257023 learned_addr learned my addr 172.21.15.26:0/134257023 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:10:24.286 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.284+0000 7fed07fff700 1 --2- 172.21.15.26:0/134257023 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed08060430 0x7fed08109190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:10:24.286 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.284+0000 7fed077fe700 1 -- 172.21.15.26:0/134257023 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed08060430 msgr2=0x7fed08109190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:10:24.286 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.284+0000 7fed077fe700 1 --2- 172.21.15.26:0/134257023 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed08060430 0x7fed08109190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:24.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.284+0000 7fed077fe700 1 -- 172.21.15.26:0/134257023 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf8005040 con 0x7fed080fbbf0 2021-11-03T17:10:24.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.284+0000 7fed07fff700 1 --2- 172.21.15.26:0/134257023 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed08060430 0x7fed08109190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:10:24.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.284+0000 7fed077fe700 1 --2- 172.21.15.26:0/134257023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed080fbbf0 0x7fed08109680 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7fecf8013a70 tx=0x7fecf8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:10:24.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.285+0000 7fed04ff9700 1 -- 172.21.15.26:0/134257023 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecf8018070 con 0x7fed080fbbf0 2021-11-03T17:10:24.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.285+0000 7fed04ff9700 1 -- 172.21.15.26:0/134257023 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fecf80097d0 con 0x7fed080fbbf0 2021-11-03T17:10:24.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.285+0000 7fed0e37b700 1 -- 172.21.15.26:0/134257023 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed0810a6b0 con 0x7fed080fbbf0 2021-11-03T17:10:24.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.285+0000 7fed04ff9700 1 -- 172.21.15.26:0/134257023 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecf801c3c0 con 0x7fed080fbbf0 2021-11-03T17:10:24.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.285+0000 7fed0e37b700 1 -- 172.21.15.26:0/134257023 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed0810ac10 con 0x7fed080fbbf0 2021-11-03T17:10:24.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.286+0000 7fed0e37b700 1 -- 172.21.15.26:0/134257023 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed08045ad0 con 0x7fed080fbbf0 2021-11-03T17:10:24.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.286+0000 7fed04ff9700 1 -- 172.21.15.26:0/134257023 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fecf8007ba0 con 0x7fed080fbbf0 2021-11-03T17:10:24.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.287+0000 7fed04ff9700 1 --2- 172.21.15.26:0/134257023 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fecf00640b0 0x7fecf0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:10:24.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.287+0000 7fed04ff9700 1 -- 172.21.15.26:0/134257023 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fecf80823a0 con 0x7fed080fbbf0 2021-11-03T17:10:24.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.287+0000 7fed07fff700 1 --2- 172.21.15.26:0/134257023 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fecf00640b0 0x7fecf0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:10:24.290 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.287+0000 7fed07fff700 1 --2- 172.21.15.26:0/134257023 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fecf00640b0 0x7fecf0066570 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fecfc009740 tx=0x7fecfc009be0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:10:24.290 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.292+0000 7fed04ff9700 1 -- 172.21.15.26:0/134257023 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fecf80547c0 con 0x7fed080fbbf0 2021-11-03T17:10:24.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:24 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:10:24.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:24 smithi026 ceph-mon[96795]: pgmap v472: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:24.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.470+0000 7fed0e37b700 1 -- 172.21.15.26:0/134257023 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fed08101190 con 0x7fecf00640b0 2021-11-03T17:10:24.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.471+0000 7fed04ff9700 1 -- 172.21.15.26:0/134257023 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fed08101190 con 0x7fecf00640b0 2021-11-03T17:10:24.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.473+0000 7fed0e37b700 1 -- 172.21.15.26:0/134257023 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fecf00640b0 msgr2=0x7fecf0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:10:24.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.473+0000 7fed0e37b700 1 --2- 172.21.15.26:0/134257023 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fecf00640b0 0x7fecf0066570 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fecfc009740 tx=0x7fecfc009be0).stop 2021-11-03T17:10:24.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.473+0000 7fed0e37b700 1 -- 172.21.15.26:0/134257023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed080fbbf0 msgr2=0x7fed08109680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:10:24.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.473+0000 7fed0e37b700 1 --2- 172.21.15.26:0/134257023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed080fbbf0 0x7fed08109680 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7fecf8013a70 tx=0x7fecf8009b30).stop 2021-11-03T17:10:24.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.473+0000 7fed0e37b700 1 -- 172.21.15.26:0/134257023 shutdown_connections 2021-11-03T17:10:24.472 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.473+0000 7fed0e37b700 1 --2- 172.21.15.26:0/134257023 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fecf00640b0 0x7fecf0066570 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:24.472 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.473+0000 7fed0e37b700 1 --2- 172.21.15.26:0/134257023 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed08060430 0x7fed08109190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:24.472 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.473+0000 7fed0e37b700 1 --2- 172.21.15.26:0/134257023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed080fbbf0 0x7fed08109680 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:24.472 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.473+0000 7fed0e37b700 1 -- 172.21.15.26:0/134257023 >> 172.21.15.26:0/134257023 conn(0x7fed080f0d20 msgr2=0x7fed080f3110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:10:24.473 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.473+0000 7fed0e37b700 1 -- 172.21.15.26:0/134257023 shutdown_connections 2021-11-03T17:10:24.473 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.473+0000 7fed0e37b700 1 -- 172.21.15.26:0/134257023 wait complete. 2021-11-03T17:10:24.478 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:10:24.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:24 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:10:24.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:24 smithi194 ceph-mon[65619]: pgmap v472: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:24.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.573+0000 7fd05993c700 1 -- 172.21.15.26:0/363591889 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd054060390 msgr2=0x7fd0540f9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:10:24.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.573+0000 7fd05993c700 1 --2- 172.21.15.26:0/363591889 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd054060390 0x7fd0540f9360 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fd044004660 tx=0x7fd044009b30).stop 2021-11-03T17:10:24.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.573+0000 7fd05993c700 1 -- 172.21.15.26:0/363591889 shutdown_connections 2021-11-03T17:10:24.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.573+0000 7fd05993c700 1 --2- 172.21.15.26:0/363591889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0540f9850 0x7fd0540fbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:24.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.573+0000 7fd05993c700 1 --2- 172.21.15.26:0/363591889 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd054060390 0x7fd0540f9360 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:24.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.573+0000 7fd05993c700 1 -- 172.21.15.26:0/363591889 >> 172.21.15.26:0/363591889 conn(0x7fd0540f0de0 msgr2=0x7fd0540f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:10:24.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.573+0000 7fd05993c700 1 -- 172.21.15.26:0/363591889 shutdown_connections 2021-11-03T17:10:24.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.573+0000 7fd05993c700 1 -- 172.21.15.26:0/363591889 wait complete. 2021-11-03T17:10:24.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.575+0000 7fd05993c700 1 Processor -- start 2021-11-03T17:10:24.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.575+0000 7fd05993c700 1 -- start start 2021-11-03T17:10:24.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.575+0000 7fd05993c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd054060390 0x7fd0540f6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:10:24.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.575+0000 7fd05993c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0540f9850 0x7fd0540f5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:10:24.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.575+0000 7fd05993c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0540f57c0 con 0x7fd0540f9850 2021-11-03T17:10:24.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.575+0000 7fd05993c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0540f5900 con 0x7fd054060390 2021-11-03T17:10:24.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.575+0000 7fd0527fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0540f9850 0x7fd0540f5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:10:24.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.575+0000 7fd0527fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0540f9850 0x7fd0540f5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52882/0 (socket says 172.21.15.26:52882) 2021-11-03T17:10:24.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.575+0000 7fd0527fc700 1 -- 172.21.15.26:0/1936415703 learned_addr learned my addr 172.21.15.26:0/1936415703 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:10:24.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.575+0000 7fd052ffd700 1 --2- 172.21.15.26:0/1936415703 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd054060390 0x7fd0540f6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:10:24.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.575+0000 7fd0527fc700 1 -- 172.21.15.26:0/1936415703 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd054060390 msgr2=0x7fd0540f6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:10:24.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.576+0000 7fd0527fc700 1 --2- 172.21.15.26:0/1936415703 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd054060390 0x7fd0540f6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:24.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.576+0000 7fd0527fc700 1 -- 172.21.15.26:0/1936415703 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd044005040 con 0x7fd0540f9850 2021-11-03T17:10:24.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.576+0000 7fd0527fc700 1 --2- 172.21.15.26:0/1936415703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0540f9850 0x7fd0540f5260 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fd0480026d0 tx=0x7fd048009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:10:24.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.576+0000 7fd03b7fe700 1 -- 172.21.15.26:0/1936415703 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0480079c0 con 0x7fd0540f9850 2021-11-03T17:10:24.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.576+0000 7fd03b7fe700 1 -- 172.21.15.26:0/1936415703 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd04800f040 con 0x7fd0540f9850 2021-11-03T17:10:24.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.576+0000 7fd05993c700 1 -- 172.21.15.26:0/1936415703 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0540f5be0 con 0x7fd0540f9850 2021-11-03T17:10:24.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.576+0000 7fd03b7fe700 1 -- 172.21.15.26:0/1936415703 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0480148b0 con 0x7fd0540f9850 2021-11-03T17:10:24.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.576+0000 7fd05993c700 1 -- 172.21.15.26:0/1936415703 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd05410efb0 con 0x7fd0540f9850 2021-11-03T17:10:24.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.577+0000 7fd05993c700 1 -- 172.21.15.26:0/1936415703 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd054045ad0 con 0x7fd0540f9850 2021-11-03T17:10:24.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.577+0000 7fd03b7fe700 1 -- 172.21.15.26:0/1936415703 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fd048007b20 con 0x7fd0540f9850 2021-11-03T17:10:24.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.577+0000 7fd03b7fe700 1 --2- 172.21.15.26:0/1936415703 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd03c0640b0 0x7fd03c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:10:24.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.577+0000 7fd03b7fe700 1 -- 172.21.15.26:0/1936415703 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fd048080660 con 0x7fd0540f9850 2021-11-03T17:10:24.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.577+0000 7fd052ffd700 1 --2- 172.21.15.26:0/1936415703 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd03c0640b0 0x7fd03c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:10:24.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.577+0000 7fd052ffd700 1 --2- 172.21.15.26:0/1936415703 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd03c0640b0 0x7fd03c066570 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fd044013690 tx=0x7fd044009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:10:24.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.582+0000 7fd03b7fe700 1 -- 172.21.15.26:0/1936415703 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fd0480529c0 con 0x7fd0540f9850 2021-11-03T17:10:24.748 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.753+0000 7fd05993c700 1 -- 172.21.15.26:0/1936415703 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd0540fefc0 con 0x7fd03c0640b0 2021-11-03T17:10:24.763 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.768+0000 7fd03b7fe700 1 -- 172.21.15.26:0/1936415703 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fd0540fefc0 con 0x7fd03c0640b0 2021-11-03T17:10:24.763 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:10:24.764 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (21m) 111s ago 22m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:10:24.764 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (13m) 111s ago 22m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:10:24.764 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (13m) 47s ago 22m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:10:24.764 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (21m) 111s ago 22m 39.5M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:10:24.765 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (14m) 111s ago 18m 16.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:10:24.765 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (14m) 111s ago 17m 17.8M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:10:24.765 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (18m) 47s ago 18m 19.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:10:24.765 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (17m) 47s ago 17m 19.4M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:10:24.766 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (15m) 111s ago 24m 491M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:10:24.766 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (14m) 47s ago 22m 415M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:10:24.766 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (14m) 111s ago 24m 113M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:10:24.766 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (14m) 47s ago 22m 70.2M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:10:24.767 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (22m) 111s ago 22m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:10:24.767 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (21m) 47s ago 21m 18.4M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:10:24.767 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (13m) 111s ago 21m 190M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:10:24.767 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (12m) 111s ago 20m 204M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:10:24.767 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (12m) 111s ago 20m 170M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:10:24.768 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (11m) 47s ago 20m 211M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:10:24.768 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (11m) 47s ago 19m 189M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:10:24.768 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (11m) 47s ago 19m 174M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:10:24.768 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (21m) 111s ago 22m 49.9M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:10:24.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.770+0000 7fd05993c700 1 -- 172.21.15.26:0/1936415703 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd03c0640b0 msgr2=0x7fd03c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:10:24.770 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.770+0000 7fd05993c700 1 --2- 172.21.15.26:0/1936415703 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd03c0640b0 0x7fd03c066570 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fd044013690 tx=0x7fd044009b30).stop 2021-11-03T17:10:24.770 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.770+0000 7fd05993c700 1 -- 172.21.15.26:0/1936415703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0540f9850 msgr2=0x7fd0540f5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:10:24.770 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.770+0000 7fd05993c700 1 --2- 172.21.15.26:0/1936415703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0540f9850 0x7fd0540f5260 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fd0480026d0 tx=0x7fd048009de0).stop 2021-11-03T17:10:24.770 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.770+0000 7fd05993c700 1 -- 172.21.15.26:0/1936415703 shutdown_connections 2021-11-03T17:10:24.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.770+0000 7fd05993c700 1 --2- 172.21.15.26:0/1936415703 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd03c0640b0 0x7fd03c066570 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:24.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.770+0000 7fd05993c700 1 --2- 172.21.15.26:0/1936415703 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd054060390 0x7fd0540f6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:24.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.770+0000 7fd05993c700 1 --2- 172.21.15.26:0/1936415703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0540f9850 0x7fd0540f5260 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:24.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.770+0000 7fd05993c700 1 -- 172.21.15.26:0/1936415703 >> 172.21.15.26:0/1936415703 conn(0x7fd0540f0de0 msgr2=0x7fd0540f31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:10:24.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.770+0000 7fd05993c700 1 -- 172.21.15.26:0/1936415703 shutdown_connections 2021-11-03T17:10:24.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.770+0000 7fd05993c700 1 -- 172.21.15.26:0/1936415703 wait complete. 2021-11-03T17:10:24.866 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.870+0000 7f50aa78d700 1 -- 172.21.15.26:0/4029530486 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50a40f7970 msgr2=0x7f50a40f7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:10:24.867 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.870+0000 7f50aa78d700 1 --2- 172.21.15.26:0/4029530486 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50a40f7970 0x7f50a40f7dd0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f5098004660 tx=0x7f5098009b30).stop 2021-11-03T17:10:24.867 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.870+0000 7f50aa78d700 1 -- 172.21.15.26:0/4029530486 shutdown_connections 2021-11-03T17:10:24.867 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.870+0000 7f50aa78d700 1 --2- 172.21.15.26:0/4029530486 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50a40f7970 0x7f50a40f7dd0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:24.867 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.870+0000 7f50aa78d700 1 --2- 172.21.15.26:0/4029530486 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50a40f66d0 0x7f50a40f6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:24.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.870+0000 7f50aa78d700 1 -- 172.21.15.26:0/4029530486 >> 172.21.15.26:0/4029530486 conn(0x7f50a40f1e10 msgr2=0x7f50a40f4250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:10:24.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.870+0000 7f50aa78d700 1 -- 172.21.15.26:0/4029530486 shutdown_connections 2021-11-03T17:10:24.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.870+0000 7f50aa78d700 1 -- 172.21.15.26:0/4029530486 wait complete. 2021-11-03T17:10:24.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.871+0000 7f50aa78d700 1 Processor -- start 2021-11-03T17:10:24.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.871+0000 7f50aa78d700 1 -- start start 2021-11-03T17:10:24.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.871+0000 7f50aa78d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50a40f66d0 0x7f50a406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:10:24.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.871+0000 7f50aa78d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50a40f7970 0x7f50a4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:10:24.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.871+0000 7f50aa78d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a406a380 con 0x7f50a40f66d0 2021-11-03T17:10:24.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.871+0000 7f50aa78d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a406a4c0 con 0x7f50a40f7970 2021-11-03T17:10:24.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.871+0000 7f50a3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50a40f66d0 0x7f50a406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:10:24.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.871+0000 7f50a3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50a40f66d0 0x7f50a406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52890/0 (socket says 172.21.15.26:52890) 2021-11-03T17:10:24.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.871+0000 7f50a3fff700 1 -- 172.21.15.26:0/4084348255 learned_addr learned my addr 172.21.15.26:0/4084348255 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:10:24.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.871+0000 7f50a37fe700 1 --2- 172.21.15.26:0/4084348255 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50a40f7970 0x7f50a4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:10:24.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.872+0000 7f50a3fff700 1 -- 172.21.15.26:0/4084348255 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50a40f7970 msgr2=0x7f50a4069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:10:24.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.872+0000 7f50a3fff700 1 --2- 172.21.15.26:0/4084348255 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50a40f7970 0x7f50a4069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:24.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.872+0000 7f50a3fff700 1 -- 172.21.15.26:0/4084348255 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5098005040 con 0x7f50a40f66d0 2021-11-03T17:10:24.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.872+0000 7f50a3fff700 1 --2- 172.21.15.26:0/4084348255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50a40f66d0 0x7f50a406b9a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f5094002700 tx=0x7f5094009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:10:24.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.872+0000 7f50a0ff9700 1 -- 172.21.15.26:0/4084348255 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50940079c0 con 0x7f50a40f66d0 2021-11-03T17:10:24.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.872+0000 7f50aa78d700 1 -- 172.21.15.26:0/4084348255 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50a406a7a0 con 0x7f50a40f66d0 2021-11-03T17:10:24.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.872+0000 7f50a0ff9700 1 -- 172.21.15.26:0/4084348255 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f509400f040 con 0x7f50a40f66d0 2021-11-03T17:10:24.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.872+0000 7f50a0ff9700 1 -- 172.21.15.26:0/4084348255 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5094014860 con 0x7f50a40f66d0 2021-11-03T17:10:24.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.872+0000 7f50aa78d700 1 -- 172.21.15.26:0/4084348255 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a410ef80 con 0x7f50a40f66d0 2021-11-03T17:10:24.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.873+0000 7f50aa78d700 1 -- 172.21.15.26:0/4084348255 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50a4045ad0 con 0x7f50a40f66d0 2021-11-03T17:10:24.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.873+0000 7f50a0ff9700 1 -- 172.21.15.26:0/4084348255 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f509401b060 con 0x7f50a40f66d0 2021-11-03T17:10:24.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.874+0000 7f50a0ff9700 1 --2- 172.21.15.26:0/4084348255 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f508c0640b0 0x7f508c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:10:24.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.874+0000 7f50a0ff9700 1 -- 172.21.15.26:0/4084348255 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f50940806f0 con 0x7f50a40f66d0 2021-11-03T17:10:24.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.874+0000 7f50a37fe700 1 --2- 172.21.15.26:0/4084348255 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f508c0640b0 0x7f508c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:10:24.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.874+0000 7f50a37fe700 1 --2- 172.21.15.26:0/4084348255 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f508c0640b0 0x7f508c066570 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f5098004630 tx=0x7f5098009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:10:24.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:24.878+0000 7f50a0ff9700 1 -- 172.21.15.26:0/4084348255 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f50940529d0 con 0x7f50a40f66d0 2021-11-03T17:10:25.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.106+0000 7f50aa78d700 1 -- 172.21.15.26:0/4084348255 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f50a40fefd0 con 0x7f50a40f66d0 2021-11-03T17:10:25.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.106+0000 7f50a0ff9700 1 -- 172.21.15.26:0/4084348255 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f50940192e0 con 0x7f50a40f66d0 2021-11-03T17:10:25.102 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:10:25.102 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:10:25.103 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:10:25.103 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:10:25.103 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:10:25.103 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:10:25.104 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:10:25.104 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:10:25.104 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:10:25.104 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:10:25.105 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:10:25.106 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:10:25.106 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:10:25.106 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:10:25.107 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:10:25.107 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:10:25.107 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:10:25.107 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:10:25.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.108+0000 7f50aa78d700 1 -- 172.21.15.26:0/4084348255 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f508c0640b0 msgr2=0x7f508c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:10:25.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.108+0000 7f50aa78d700 1 --2- 172.21.15.26:0/4084348255 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f508c0640b0 0x7f508c066570 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f5098004630 tx=0x7f5098009b30).stop 2021-11-03T17:10:25.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.108+0000 7f50aa78d700 1 -- 172.21.15.26:0/4084348255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50a40f66d0 msgr2=0x7f50a406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:10:25.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.108+0000 7f50aa78d700 1 --2- 172.21.15.26:0/4084348255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50a40f66d0 0x7f50a406b9a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f5094002700 tx=0x7f5094009d80).stop 2021-11-03T17:10:25.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.108+0000 7f50aa78d700 1 -- 172.21.15.26:0/4084348255 shutdown_connections 2021-11-03T17:10:25.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.108+0000 7f50aa78d700 1 --2- 172.21.15.26:0/4084348255 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f508c0640b0 0x7f508c066570 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:25.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.108+0000 7f50aa78d700 1 --2- 172.21.15.26:0/4084348255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50a40f66d0 0x7f50a406b9a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:25.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.108+0000 7f50aa78d700 1 --2- 172.21.15.26:0/4084348255 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50a40f7970 0x7f50a4069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:25.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.108+0000 7f50aa78d700 1 -- 172.21.15.26:0/4084348255 >> 172.21.15.26:0/4084348255 conn(0x7f50a40f1e10 msgr2=0x7f50a40fb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:10:25.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.108+0000 7f50aa78d700 1 -- 172.21.15.26:0/4084348255 shutdown_connections 2021-11-03T17:10:25.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.108+0000 7f50aa78d700 1 -- 172.21.15.26:0/4084348255 wait complete. 2021-11-03T17:10:25.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.208+0000 7faf62595700 1 -- 172.21.15.26:0/2486985141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf5c0f55c0 msgr2=0x7faf5c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:10:25.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.208+0000 7faf62595700 1 --2- 172.21.15.26:0/2486985141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf5c0f55c0 0x7faf5c0f59e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7faf4c004660 tx=0x7faf4c009b30).stop 2021-11-03T17:10:25.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.209+0000 7faf62595700 1 -- 172.21.15.26:0/2486985141 shutdown_connections 2021-11-03T17:10:25.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.209+0000 7faf62595700 1 --2- 172.21.15.26:0/2486985141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf5c0f6860 0x7faf5c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:25.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.209+0000 7faf62595700 1 --2- 172.21.15.26:0/2486985141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf5c0f55c0 0x7faf5c0f59e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:25.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.209+0000 7faf62595700 1 -- 172.21.15.26:0/2486985141 >> 172.21.15.26:0/2486985141 conn(0x7faf5c0f0d20 msgr2=0x7faf5c0f3140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:10:25.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.209+0000 7faf62595700 1 -- 172.21.15.26:0/2486985141 shutdown_connections 2021-11-03T17:10:25.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.209+0000 7faf62595700 1 -- 172.21.15.26:0/2486985141 wait complete. 2021-11-03T17:10:25.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.209+0000 7faf62595700 1 Processor -- start 2021-11-03T17:10:25.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.209+0000 7faf62595700 1 -- start start 2021-11-03T17:10:25.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.209+0000 7faf62595700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf5c0f55c0 0x7faf5c0f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:10:25.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.209+0000 7faf62595700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf5c0f6860 0x7faf5c0f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:10:25.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.209+0000 7faf62595700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c0f8100 con 0x7faf5c0f55c0 2021-11-03T17:10:25.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.209+0000 7faf62595700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c0f8240 con 0x7faf5c0f6860 2021-11-03T17:10:25.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.210+0000 7faf5bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf5c0f55c0 0x7faf5c0f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:10:25.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.210+0000 7faf5bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf5c0f55c0 0x7faf5c0f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52900/0 (socket says 172.21.15.26:52900) 2021-11-03T17:10:25.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.210+0000 7faf5bfff700 1 -- 172.21.15.26:0/2632671528 learned_addr learned my addr 172.21.15.26:0/2632671528 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:10:25.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.210+0000 7faf5b7fe700 1 --2- 172.21.15.26:0/2632671528 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf5c0f6860 0x7faf5c0f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:10:25.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.210+0000 7faf5bfff700 1 -- 172.21.15.26:0/2632671528 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf5c0f6860 msgr2=0x7faf5c0f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:10:25.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.210+0000 7faf5bfff700 1 --2- 172.21.15.26:0/2632671528 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf5c0f6860 0x7faf5c0f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:25.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.210+0000 7faf5bfff700 1 -- 172.21.15.26:0/2632671528 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4c005040 con 0x7faf5c0f55c0 2021-11-03T17:10:25.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.210+0000 7faf5b7fe700 1 --2- 172.21.15.26:0/2632671528 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf5c0f6860 0x7faf5c0f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:10:25.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.210+0000 7faf5bfff700 1 --2- 172.21.15.26:0/2632671528 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf5c0f55c0 0x7faf5c0f9720 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7faf4c004f60 tx=0x7faf4c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:10:25.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.210+0000 7faf58ff9700 1 -- 172.21.15.26:0/2632671528 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf4c018070 con 0x7faf5c0f55c0 2021-11-03T17:10:25.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.210+0000 7faf58ff9700 1 -- 172.21.15.26:0/2632671528 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7faf4c007ba0 con 0x7faf5c0f55c0 2021-11-03T17:10:25.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.210+0000 7faf58ff9700 1 -- 172.21.15.26:0/2632671528 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf4c01c620 con 0x7faf5c0f55c0 2021-11-03T17:10:25.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.210+0000 7faf62595700 1 -- 172.21.15.26:0/2632671528 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf5c0f84c0 con 0x7faf5c0f55c0 2021-11-03T17:10:25.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.210+0000 7faf62595700 1 -- 172.21.15.26:0/2632671528 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf5c0f8a20 con 0x7faf5c0f55c0 2021-11-03T17:10:25.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.211+0000 7faf62595700 1 -- 172.21.15.26:0/2632671528 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf5c045ad0 con 0x7faf5c0f55c0 2021-11-03T17:10:25.213 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.212+0000 7faf58ff9700 1 -- 172.21.15.26:0/2632671528 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7faf4c01c8e0 con 0x7faf5c0f55c0 2021-11-03T17:10:25.213 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.212+0000 7faf58ff9700 1 --2- 172.21.15.26:0/2632671528 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faf480640b0 0x7faf48066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:10:25.213 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.212+0000 7faf58ff9700 1 -- 172.21.15.26:0/2632671528 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7faf4c0826c0 con 0x7faf5c0f55c0 2021-11-03T17:10:25.213 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.212+0000 7faf5b7fe700 1 --2- 172.21.15.26:0/2632671528 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faf480640b0 0x7faf48066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:10:25.214 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.213+0000 7faf5b7fe700 1 --2- 172.21.15.26:0/2632671528 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faf480640b0 0x7faf48066570 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7faf440041d0 tx=0x7faf44009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:10:25.214 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.216+0000 7faf58ff9700 1 -- 172.21.15.26:0/2632671528 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7faf4c054a20 con 0x7faf5c0f55c0 2021-11-03T17:10:25.413 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.419+0000 7faf62595700 1 -- 172.21.15.26:0/2632671528 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7faf5c0fdd80 con 0x7faf5c0f55c0 2021-11-03T17:10:25.414 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.419+0000 7faf58ff9700 1 -- 172.21.15.26:0/2632671528 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7faf4c054610 con 0x7faf5c0f55c0 2021-11-03T17:10:25.415 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:10:25.415 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:10:25.415 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:10:25.415 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:10:25.416 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:10:25.416 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:10:25.416 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:10:25.416 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:10:25.417 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:10:25.417 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:10:25.417 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:10:25.417 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:10:25.418 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:10:25.418 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:10:25.418 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:10:25.418 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:10:25.418 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:10:25.419 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:10:25.419 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:10:25.419 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:10:25.419 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:10:25.420 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:10:25.420 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:10:25.420 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:10:25.420 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:10:25.421 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:10:25.421 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:10:25.421 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:10:25.421 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:10:25.421 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:10:25.422 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:10:25.422 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:10:25.422 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:10:25.422 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:10:25.423 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:10:25.423 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:10:25.423 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:10:25.423 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:10:25.424 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:10:25.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.421+0000 7faf62595700 1 -- 172.21.15.26:0/2632671528 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faf480640b0 msgr2=0x7faf48066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:10:25.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.421+0000 7faf62595700 1 --2- 172.21.15.26:0/2632671528 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faf480640b0 0x7faf48066570 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7faf440041d0 tx=0x7faf44009040).stop 2021-11-03T17:10:25.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.421+0000 7faf62595700 1 -- 172.21.15.26:0/2632671528 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf5c0f55c0 msgr2=0x7faf5c0f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:10:25.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.421+0000 7faf62595700 1 --2- 172.21.15.26:0/2632671528 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf5c0f55c0 0x7faf5c0f9720 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7faf4c004f60 tx=0x7faf4c009b30).stop 2021-11-03T17:10:25.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.421+0000 7faf62595700 1 -- 172.21.15.26:0/2632671528 shutdown_connections 2021-11-03T17:10:25.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.421+0000 7faf62595700 1 --2- 172.21.15.26:0/2632671528 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faf480640b0 0x7faf48066570 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:25.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.421+0000 7faf62595700 1 --2- 172.21.15.26:0/2632671528 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf5c0f55c0 0x7faf5c0f9720 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:25.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.421+0000 7faf62595700 1 --2- 172.21.15.26:0/2632671528 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf5c0f6860 0x7faf5c0f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:25.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.421+0000 7faf62595700 1 -- 172.21.15.26:0/2632671528 >> 172.21.15.26:0/2632671528 conn(0x7faf5c0f0d20 msgr2=0x7faf5c05ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:10:25.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.421+0000 7faf62595700 1 -- 172.21.15.26:0/2632671528 shutdown_connections 2021-11-03T17:10:25.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:25.421+0000 7faf62595700 1 -- 172.21.15.26:0/2632671528 wait complete. 2021-11-03T17:10:25.427 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:10:26.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:26 smithi026 ceph-mon[96795]: from='client.34628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:10:26.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:26 smithi026 ceph-mon[96795]: pgmap v473: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:26.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:26 smithi026 ceph-mon[96795]: from='client.34632 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:10:26.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:26 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/4084348255' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:10:26.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:26 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2632671528' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:10:26.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:26 smithi194 ceph-mon[65619]: from='client.34628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:10:26.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:26 smithi194 ceph-mon[65619]: pgmap v473: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:26.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:26 smithi194 ceph-mon[65619]: from='client.34632 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:10:26.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:26 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/4084348255' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:10:26.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:26 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2632671528' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:10:28.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:28 smithi026 ceph-mon[96795]: pgmap v474: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:28.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:28 smithi194 ceph-mon[65619]: pgmap v474: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:30.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:30 smithi026 ceph-mon[96795]: pgmap v475: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:30.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:30 smithi194 ceph-mon[65619]: pgmap v475: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:32.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:32 smithi026 ceph-mon[96795]: pgmap v476: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:32.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:32 smithi194 ceph-mon[65619]: pgmap v476: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:34.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:34 smithi026 ceph-mon[96795]: pgmap v477: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:34.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:34 smithi194 ceph-mon[65619]: pgmap v477: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:36.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:36 smithi026 ceph-mon[96795]: pgmap v478: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:36.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:36 smithi194 ceph-mon[65619]: pgmap v478: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:38.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:38 smithi026 ceph-mon[96795]: pgmap v479: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:38.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:38 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:10:38.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:38 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:10:38.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:38 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:10:38.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:38 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:10:38.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:38 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:10:38.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:38 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:10:38.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:38 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:10:38.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:38 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:10:38.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:38 smithi194 ceph-mon[65619]: pgmap v479: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:38.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:38 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:10:38.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:38 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:10:38.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:38 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:10:38.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:38 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:10:38.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:38 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:10:38.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:38 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:10:38.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:38 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:10:38.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:38 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:10:39.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:39 smithi026 ceph-mon[96795]: poll took 60075.702 ms: 1 events 2021-11-03T17:10:39.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:39 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:10:39.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:39 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:10:39.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:39 smithi194 ceph-mon[65619]: poll took 60075.702 ms: 1 events 2021-11-03T17:10:39.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:39 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:10:39.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:39 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:10:40.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:40 smithi026 ceph-mon[96795]: pgmap v480: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:40.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:40 smithi194 ceph-mon[65619]: pgmap v480: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:42.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:42 smithi026 ceph-mon[96795]: pgmap v481: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:42.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:42 smithi194 ceph-mon[65619]: pgmap v481: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:44.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:44 smithi026 ceph-mon[96795]: pgmap v482: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:44.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:44 smithi194 ceph-mon[65619]: pgmap v482: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:46.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:46 smithi026 ceph-mon[96795]: pgmap v483: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:46.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:46 smithi194 ceph-mon[65619]: pgmap v483: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:48.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:48 smithi026 ceph-mon[96795]: pgmap v484: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:48.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:48 smithi194 ceph-mon[65619]: pgmap v484: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:49.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:10:49.523 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:10:49.524 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:10:49.524 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:10:50.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:50 smithi026 ceph-mon[96795]: pgmap v485: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:50.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:50 smithi194 ceph-mon[65619]: pgmap v485: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:52.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:52 smithi026 ceph-mon[96795]: pgmap v486: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:52.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:52 smithi194 ceph-mon[65619]: pgmap v486: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:53.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:53 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:10:53.470 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:53 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:10:54.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:54 smithi026 ceph-mon[96795]: pgmap v487: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:54.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:54 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:10:54.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:54 smithi194 ceph-mon[65619]: pgmap v487: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:54.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:54 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:10:55.533 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.537+0000 7fcc17cc5700 1 -- 172.21.15.26:0/100682309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc100f7d00 msgr2=0x7fcc100f8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:10:55.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.537+0000 7fcc17cc5700 1 --2- 172.21.15.26:0/100682309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc100f7d00 0x7fcc100f8120 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7fcc0c004660 tx=0x7fcc0c009b30).stop 2021-11-03T17:10:55.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.537+0000 7fcc17cc5700 1 -- 172.21.15.26:0/100682309 shutdown_connections 2021-11-03T17:10:55.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.537+0000 7fcc17cc5700 1 --2- 172.21.15.26:0/100682309 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc100f8610 0x7fcc100f4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:55.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.537+0000 7fcc17cc5700 1 --2- 172.21.15.26:0/100682309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc100f7d00 0x7fcc100f8120 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:55.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.537+0000 7fcc17cc5700 1 -- 172.21.15.26:0/100682309 >> 172.21.15.26:0/100682309 conn(0x7fcc100f0540 msgr2=0x7fcc100f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:10:55.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.537+0000 7fcc17cc5700 1 -- 172.21.15.26:0/100682309 shutdown_connections 2021-11-03T17:10:55.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.537+0000 7fcc17cc5700 1 -- 172.21.15.26:0/100682309 wait complete. 2021-11-03T17:10:55.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.538+0000 7fcc17cc5700 1 Processor -- start 2021-11-03T17:10:55.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.538+0000 7fcc17cc5700 1 -- start start 2021-11-03T17:10:55.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.538+0000 7fcc17cc5700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc100f7d00 0x7fcc10106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:10:55.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.538+0000 7fcc17cc5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc100f8610 0x7fcc10107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:10:55.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.538+0000 7fcc17cc5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc10107a10 con 0x7fcc100f8610 2021-11-03T17:10:55.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.538+0000 7fcc17cc5700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc10107b50 con 0x7fcc100f7d00 2021-11-03T17:10:55.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.538+0000 7fcc15260700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc100f8610 0x7fcc10107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:10:55.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.538+0000 7fcc15260700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc100f8610 0x7fcc10107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52950/0 (socket says 172.21.15.26:52950) 2021-11-03T17:10:55.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.538+0000 7fcc15260700 1 -- 172.21.15.26:0/2046144722 learned_addr learned my addr 172.21.15.26:0/2046144722 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:10:55.538 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.538+0000 7fcc15a61700 1 --2- 172.21.15.26:0/2046144722 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc100f7d00 0x7fcc10106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:10:55.538 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.539+0000 7fcc15260700 1 -- 172.21.15.26:0/2046144722 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc100f7d00 msgr2=0x7fcc10106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:10:55.538 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.539+0000 7fcc15260700 1 --2- 172.21.15.26:0/2046144722 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc100f7d00 0x7fcc10106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:55.538 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.539+0000 7fcc15260700 1 -- 172.21.15.26:0/2046144722 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc0c005040 con 0x7fcc100f8610 2021-11-03T17:10:55.538 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.539+0000 7fcc15260700 1 --2- 172.21.15.26:0/2046144722 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc100f8610 0x7fcc10107460 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7fcc0400c790 tx=0x7fcc04007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:10:55.539 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.539+0000 7fcc027fc700 1 -- 172.21.15.26:0/2046144722 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc04002590 con 0x7fcc100f8610 2021-11-03T17:10:55.539 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.539+0000 7fcc027fc700 1 -- 172.21.15.26:0/2046144722 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcc04002ba0 con 0x7fcc100f8610 2021-11-03T17:10:55.539 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.539+0000 7fcc17cc5700 1 -- 172.21.15.26:0/2046144722 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc101084f0 con 0x7fcc100f8610 2021-11-03T17:10:55.539 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.539+0000 7fcc027fc700 1 -- 172.21.15.26:0/2046144722 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc04013d90 con 0x7fcc100f8610 2021-11-03T17:10:55.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.539+0000 7fcc17cc5700 1 -- 172.21.15.26:0/2046144722 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc10108ab0 con 0x7fcc100f8610 2021-11-03T17:10:55.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.540+0000 7fcc17cc5700 1 -- 172.21.15.26:0/2046144722 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc10045ad0 con 0x7fcc100f8610 2021-11-03T17:10:55.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.540+0000 7fcc027fc700 1 -- 172.21.15.26:0/2046144722 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fcc0401a060 con 0x7fcc100f8610 2021-11-03T17:10:55.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.541+0000 7fcc027fc700 1 --2- 172.21.15.26:0/2046144722 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcbfc0640b0 0x7fcbfc066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:10:55.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.541+0000 7fcc027fc700 1 -- 172.21.15.26:0/2046144722 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fcc04080b30 con 0x7fcc100f8610 2021-11-03T17:10:55.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.541+0000 7fcc15a61700 1 --2- 172.21.15.26:0/2046144722 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcbfc0640b0 0x7fcbfc066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:10:55.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.541+0000 7fcc15a61700 1 --2- 172.21.15.26:0/2046144722 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcbfc0640b0 0x7fcbfc066570 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fcc0c004630 tx=0x7fcc0c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:10:55.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.545+0000 7fcc027fc700 1 -- 172.21.15.26:0/2046144722 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fcc04052d40 con 0x7fcc100f8610 2021-11-03T17:10:55.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.724+0000 7fcc17cc5700 1 -- 172.21.15.26:0/2046144722 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc100ff020 con 0x7fcbfc0640b0 2021-11-03T17:10:55.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.726+0000 7fcc027fc700 1 -- 172.21.15.26:0/2046144722 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fcc100ff020 con 0x7fcbfc0640b0 2021-11-03T17:10:55.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.728+0000 7fcc17cc5700 1 -- 172.21.15.26:0/2046144722 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcbfc0640b0 msgr2=0x7fcbfc066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:10:55.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.728+0000 7fcc17cc5700 1 --2- 172.21.15.26:0/2046144722 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcbfc0640b0 0x7fcbfc066570 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fcc0c004630 tx=0x7fcc0c009b30).stop 2021-11-03T17:10:55.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.728+0000 7fcc17cc5700 1 -- 172.21.15.26:0/2046144722 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc100f8610 msgr2=0x7fcc10107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:10:55.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.728+0000 7fcc17cc5700 1 --2- 172.21.15.26:0/2046144722 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc100f8610 0x7fcc10107460 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7fcc0400c790 tx=0x7fcc04007d70).stop 2021-11-03T17:10:55.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.728+0000 7fcc17cc5700 1 -- 172.21.15.26:0/2046144722 shutdown_connections 2021-11-03T17:10:55.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.728+0000 7fcc17cc5700 1 --2- 172.21.15.26:0/2046144722 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcbfc0640b0 0x7fcbfc066570 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:55.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.728+0000 7fcc17cc5700 1 --2- 172.21.15.26:0/2046144722 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc100f7d00 0x7fcc10106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:55.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.728+0000 7fcc17cc5700 1 --2- 172.21.15.26:0/2046144722 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc100f8610 0x7fcc10107460 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:55.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.728+0000 7fcc17cc5700 1 -- 172.21.15.26:0/2046144722 >> 172.21.15.26:0/2046144722 conn(0x7fcc100f0540 msgr2=0x7fcc100fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:10:55.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.728+0000 7fcc17cc5700 1 -- 172.21.15.26:0/2046144722 shutdown_connections 2021-11-03T17:10:55.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.728+0000 7fcc17cc5700 1 -- 172.21.15.26:0/2046144722 wait complete. 2021-11-03T17:10:55.732 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:10:55.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.828+0000 7f1fe5137700 1 -- 172.21.15.26:0/2037722531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fe00f6530 msgr2=0x7f1fe00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:10:55.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.828+0000 7f1fe5137700 1 --2- 172.21.15.26:0/2037722531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fe00f6530 0x7f1fe00f6950 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f1fd0004660 tx=0x7f1fd0009b30).stop 2021-11-03T17:10:55.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.828+0000 7f1fe5137700 1 -- 172.21.15.26:0/2037722531 shutdown_connections 2021-11-03T17:10:55.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.828+0000 7f1fe5137700 1 --2- 172.21.15.26:0/2037722531 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fe00f77d0 0x7f1fe00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:55.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.828+0000 7f1fe5137700 1 --2- 172.21.15.26:0/2037722531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fe00f6530 0x7f1fe00f6950 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:55.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.828+0000 7f1fe5137700 1 -- 172.21.15.26:0/2037722531 >> 172.21.15.26:0/2037722531 conn(0x7f1fe00f1cd0 msgr2=0x7f1fe00f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:10:55.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.828+0000 7f1fe5137700 1 -- 172.21.15.26:0/2037722531 shutdown_connections 2021-11-03T17:10:55.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.828+0000 7f1fe5137700 1 -- 172.21.15.26:0/2037722531 wait complete. 2021-11-03T17:10:55.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.829+0000 7f1fe5137700 1 Processor -- start 2021-11-03T17:10:55.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.829+0000 7f1fe5137700 1 -- start start 2021-11-03T17:10:55.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.829+0000 7f1fe5137700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fe00f6530 0x7f1fe0106db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:10:55.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.829+0000 7f1fe5137700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fe00f77d0 0x7f1fe01072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:10:55.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.829+0000 7f1fe5137700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe01078a0 con 0x7f1fe00f6530 2021-11-03T17:10:55.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.829+0000 7f1fe5137700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe01080e0 con 0x7f1fe00f77d0 2021-11-03T17:10:55.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.829+0000 7f1fdffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fe00f6530 0x7f1fe0106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:10:55.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.829+0000 7f1fdffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fe00f6530 0x7f1fe0106db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52958/0 (socket says 172.21.15.26:52958) 2021-11-03T17:10:55.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.829+0000 7f1fdffff700 1 -- 172.21.15.26:0/3702332025 learned_addr learned my addr 172.21.15.26:0/3702332025 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:10:55.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.830+0000 7f1fdffff700 1 -- 172.21.15.26:0/3702332025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fe00f77d0 msgr2=0x7f1fe01072a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:10:55.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.830+0000 7f1fdf7fe700 1 --2- 172.21.15.26:0/3702332025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fe00f77d0 0x7f1fe01072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:10:55.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.830+0000 7f1fdffff700 1 --2- 172.21.15.26:0/3702332025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fe00f77d0 0x7f1fe01072a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:55.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.830+0000 7f1fdffff700 1 -- 172.21.15.26:0/3702332025 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd0005040 con 0x7f1fe00f6530 2021-11-03T17:10:55.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.830+0000 7f1fdffff700 1 --2- 172.21.15.26:0/3702332025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fe00f6530 0x7f1fe0106db0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f1fd0004f60 tx=0x7f1fd0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:10:55.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.830+0000 7f1fdcff9700 1 -- 172.21.15.26:0/3702332025 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fd0018070 con 0x7f1fe00f6530 2021-11-03T17:10:55.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.830+0000 7f1fdcff9700 1 -- 172.21.15.26:0/3702332025 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1fd0007ba0 con 0x7f1fe00f6530 2021-11-03T17:10:55.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.830+0000 7f1fdcff9700 1 -- 172.21.15.26:0/3702332025 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fd001c620 con 0x7f1fe00f6530 2021-11-03T17:10:55.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.830+0000 7f1fe5137700 1 -- 172.21.15.26:0/3702332025 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe0108360 con 0x7f1fe00f6530 2021-11-03T17:10:55.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.830+0000 7f1fe5137700 1 -- 172.21.15.26:0/3702332025 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fe0108840 con 0x7f1fe00f6530 2021-11-03T17:10:55.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.831+0000 7f1fe5137700 1 -- 172.21.15.26:0/3702332025 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fe0059100 con 0x7f1fe00f6530 2021-11-03T17:10:55.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.831+0000 7f1fdcff9700 1 -- 172.21.15.26:0/3702332025 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f1fd001d420 con 0x7f1fe00f6530 2021-11-03T17:10:55.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.832+0000 7f1fdcff9700 1 --2- 172.21.15.26:0/3702332025 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1fc8064100 0x7f1fc80665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:10:55.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.832+0000 7f1fdcff9700 1 -- 172.21.15.26:0/3702332025 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f1fd0082620 con 0x7f1fe00f6530 2021-11-03T17:10:55.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.832+0000 7f1fdf7fe700 1 --2- 172.21.15.26:0/3702332025 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1fc8064100 0x7f1fc80665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:10:55.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.832+0000 7f1fdf7fe700 1 --2- 172.21.15.26:0/3702332025 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1fc8064100 0x7f1fc80665c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f1fe0106b40 tx=0x7f1fd4009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:10:55.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:55.836+0000 7f1fdcff9700 1 -- 172.21.15.26:0/3702332025 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f1fd0054a40 con 0x7f1fe00f6530 2021-11-03T17:10:56.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.009+0000 7f1fe5137700 1 -- 172.21.15.26:0/3702332025 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1fe00fee00 con 0x7f1fc8064100 2021-11-03T17:10:56.018 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.024+0000 7f1fdcff9700 1 -- 172.21.15.26:0/3702332025 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f1fe00fee00 con 0x7f1fc8064100 2021-11-03T17:10:56.019 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:10:56.019 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (22m) 2m ago 23m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:10:56.019 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (14m) 2m ago 23m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:10:56.020 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (14m) 79s ago 22m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:10:56.020 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (21m) 2m ago 23m 39.5M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:10:56.020 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (15m) 2m ago 18m 16.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:10:56.020 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (15m) 2m ago 18m 17.8M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:10:56.020 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (18m) 79s ago 18m 19.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:10:56.021 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (18m) 79s ago 18m 19.4M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:10:56.021 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (15m) 2m ago 24m 491M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:10:56.021 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (15m) 79s ago 22m 415M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:10:56.021 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (15m) 2m ago 24m 113M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:10:56.022 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (14m) 79s ago 22m 70.2M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:10:56.022 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (23m) 2m ago 23m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:10:56.022 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (22m) 79s ago 22m 18.4M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:10:56.022 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (13m) 2m ago 21m 190M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:10:56.022 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (13m) 2m ago 21m 204M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:10:56.023 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (12m) 2m ago 21m 170M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:10:56.023 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (12m) 79s ago 20m 211M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:10:56.023 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (12m) 79s ago 20m 189M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:10:56.023 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (11m) 79s ago 20m 174M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:10:56.024 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (21m) 2m ago 22m 49.9M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:10:56.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.026+0000 7f1fe5137700 1 -- 172.21.15.26:0/3702332025 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1fc8064100 msgr2=0x7f1fc80665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:10:56.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.026+0000 7f1fe5137700 1 --2- 172.21.15.26:0/3702332025 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1fc8064100 0x7f1fc80665c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f1fe0106b40 tx=0x7f1fd4009040).stop 2021-11-03T17:10:56.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.026+0000 7f1fe5137700 1 -- 172.21.15.26:0/3702332025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fe00f6530 msgr2=0x7f1fe0106db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:10:56.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.026+0000 7f1fe5137700 1 --2- 172.21.15.26:0/3702332025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fe00f6530 0x7f1fe0106db0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f1fd0004f60 tx=0x7f1fd0009b30).stop 2021-11-03T17:10:56.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.026+0000 7f1fe5137700 1 -- 172.21.15.26:0/3702332025 shutdown_connections 2021-11-03T17:10:56.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.026+0000 7f1fe5137700 1 --2- 172.21.15.26:0/3702332025 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1fc8064100 0x7f1fc80665c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:56.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.026+0000 7f1fe5137700 1 --2- 172.21.15.26:0/3702332025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fe00f6530 0x7f1fe0106db0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:56.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.026+0000 7f1fe5137700 1 --2- 172.21.15.26:0/3702332025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fe00f77d0 0x7f1fe01072a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:56.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.026+0000 7f1fe5137700 1 -- 172.21.15.26:0/3702332025 >> 172.21.15.26:0/3702332025 conn(0x7f1fe00f1cd0 msgr2=0x7f1fe00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:10:56.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.026+0000 7f1fe5137700 1 -- 172.21.15.26:0/3702332025 shutdown_connections 2021-11-03T17:10:56.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.026+0000 7f1fe5137700 1 -- 172.21.15.26:0/3702332025 wait complete. 2021-11-03T17:10:56.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.126+0000 7f14ee17b700 1 -- 172.21.15.26:0/829561343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14e80f6ff0 msgr2=0x7f14e80f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:10:56.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.126+0000 7f14ee17b700 1 --2- 172.21.15.26:0/829561343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14e80f6ff0 0x7f14e80f7a20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f14d0004660 tx=0x7f14d0009b30).stop 2021-11-03T17:10:56.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.126+0000 7f14ee17b700 1 -- 172.21.15.26:0/829561343 shutdown_connections 2021-11-03T17:10:56.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.126+0000 7f14ee17b700 1 --2- 172.21.15.26:0/829561343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14e80f6ff0 0x7f14e80f7a20 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:56.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.126+0000 7f14ee17b700 1 --2- 172.21.15.26:0/829561343 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14e80f66e0 0x7f14e80f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:10:56.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.126+0000 7f14ee17b700 1 -- 172.21.15.26:0/829561343 >> 172.21.15.26:0/829561343 conn(0x7f14e80f1f00 msgr2=0x7f14e80f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:10:56.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.126+0000 7f14ee17b700 1 -- 172.21.15.26:0/829561343 shutdown_connections 2021-11-03T17:10:56.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.126+0000 7f14ee17b700 1 -- 172.21.15.26:0/829561343 wait complete. 2021-11-03T17:10:56.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.126+0000 7f14ee17b700 1 Processor -- start 2021-11-03T17:10:56.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.127+0000 7f14ee17b700 1 -- start start 2021-11-03T17:10:56.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.127+0000 7f14ee17b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14e80f66e0 0x7f14e806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:10:56.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.127+0000 7f14ee17b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14e80f6ff0 0x7f14e8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:10:56.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.127+0000 7f14ee17b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e806a410 con 0x7f14e80f66e0 2021-11-03T17:10:56.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.127+0000 7f14ee17b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e806a550 con 0x7f14e80f6ff0 2021-11-03T17:10:56.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.127+0000 7f14e77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14e80f66e0 0x7f14e806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:10:56.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.127+0000 7f14e77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14e80f66e0 0x7f14e806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52968/0 (socket says 172.21.15.26:52968) 2021-11-03T17:10:56.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.127+0000 7f14e77fe700 1 -- 172.21.15.26:0/3402488429 learned_addr learned my addr 172.21.15.26:0/3402488429 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:10:56.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.127+0000 7f14e77fe700 1 -- 172.21.15.26:0/3402488429 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14e80f6ff0 msgr2=0x7f14e8069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:10:56.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.127+0000 7f14e77fe700 1 --2- 172.21.15.26:0/3402488429 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14e80f6ff0 0x7f14e8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:10:56.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.127+0000 7f14e77fe700 1 -- 172.21.15.26:0/3402488429 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d0005040 con 0x7f14e80f66e0 2021-11-03T17:10:56.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.127+0000 7f14e77fe700 1 --2- 172.21.15.26:0/3402488429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14e80f66e0 0x7f14e806b9a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f14d800b410 tx=0x7f14d8006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:10:56.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.127+0000 7f14e4ff9700 1 -- 172.21.15.26:0/3402488429 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14d80125f0 con 0x7f14e80f66e0 2021-11-03T17:10:56.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.127+0000 7f14e4ff9700 1 -- 172.21.15.26:0/3402488429 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f14d8012c00 con 0x7f14e80f66e0 2021-11-03T17:10:56.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.127+0000 7f14ee17b700 1 -- 172.21.15.26:0/3402488429 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14e806a830 con 0x7f14e80f66e0 2021-11-03T17:10:56.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.127+0000 7f14e4ff9700 1 -- 172.21.15.26:0/3402488429 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14d8002ae0 con 0x7f14e80f66e0 2021-11-03T17:10:56.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.128+0000 7f14ee17b700 1 -- 172.21.15.26:0/3402488429 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14e810efd0 con 0x7f14e80f66e0 2021-11-03T17:10:56.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.128+0000 7f14ee17b700 1 -- 172.21.15.26:0/3402488429 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14e8045ad0 con 0x7f14e80f66e0 2021-11-03T17:10:56.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.129+0000 7f14e4ff9700 1 -- 172.21.15.26:0/3402488429 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f14d800f030 con 0x7f14e80f66e0 2021-11-03T17:10:56.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.129+0000 7f14e4ff9700 1 --2- 172.21.15.26:0/3402488429 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f14d40640b0 0x7f14d4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:10:56.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.129+0000 7f14e4ff9700 1 -- 172.21.15.26:0/3402488429 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f14d8080be0 con 0x7f14e80f66e0 2021-11-03T17:10:56.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.129+0000 7f14dffff700 1 --2- 172.21.15.26:0/3402488429 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f14d40640b0 0x7f14d4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:10:56.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.130+0000 7f14dffff700 1 --2- 172.21.15.26:0/3402488429 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f14d40640b0 0x7f14d4066570 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f14d0004e30 tx=0x7f14d0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:10:56.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.133+0000 7f14e4ff9700 1 -- 172.21.15.26:0/3402488429 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f14d8052f40 con 0x7f14e80f66e0 2021-11-03T17:10:56.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.364+0000 7f14ee17b700 1 -- 172.21.15.26:0/3402488429 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f14e8027a00 con 0x7f14e80f66e0 2021-11-03T17:10:56.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.364+0000 7f14e4ff9700 1 -- 172.21.15.26:0/3402488429 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f14d804de60 con 0x7f14e80f66e0 2021-11-03T17:10:56.359 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:10:56.359 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:10:56.360 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:10:56.360 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:10:56.360 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:10:56.360 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:10:56.361 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:10:56.361 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:10:56.361 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:10:56.361 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:10:56.362 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:10:56.362 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:10:56.362 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:10:56.362 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:10:56.362 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:10:56.363 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:10:56.363 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:10:56.363 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:10:56.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.366+0000 7f14ee17b700 1 -- 172.21.15.26:0/3402488429 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f14d40640b0 msgr2=0x7f14d4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:10:56.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.366+0000 7f14ee17b700 1 --2- 172.21.15.26:0/3402488429 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f14d40640b0 0x7f14d4066570 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f14d0004e30 tx=0x7f14d0009b30).stop 2021-11-03T17:10:56.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.366+0000 7f14ee17b700 1 -- 172.21.15.26:0/3402488429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14e80f66e0 msgr2=0x7f14e806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:10:56.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.366+0000 7f14ee17b700 1 --2- 172.21.15.26:0/3402488429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14e80f66e0 0x7f14e806b9a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f14d800b410 tx=0x7f14d8006ef0).stop 2021-11-03T17:10:56.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.366+0000 7f14ee17b700 1 -- 172.21.15.26:0/3402488429 shutdown_connections 2021-11-03T17:10:56.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.366+0000 7f14ee17b700 1 --2- 172.21.15.26:0/3402488429 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f14d40640b0 0x7f14d4066570 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:56.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.366+0000 7f14ee17b700 1 --2- 172.21.15.26:0/3402488429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14e80f66e0 0x7f14e806b9a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:56.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.366+0000 7f14ee17b700 1 --2- 172.21.15.26:0/3402488429 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14e80f6ff0 0x7f14e8069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:10:56.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.366+0000 7f14ee17b700 1 -- 172.21.15.26:0/3402488429 >> 172.21.15.26:0/3402488429 conn(0x7f14e80f1f00 msgr2=0x7f14e80fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:10:56.367 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.366+0000 7f14ee17b700 1 -- 172.21.15.26:0/3402488429 shutdown_connections 2021-11-03T17:10:56.367 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.366+0000 7f14ee17b700 1 -- 172.21.15.26:0/3402488429 wait complete. 2021-11-03T17:10:56.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:56 smithi026 ceph-mon[96795]: pgmap v488: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:56.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.466+0000 7f0ff368d700 1 -- 172.21.15.26:0/1613115979 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fec0f6860 msgr2=0x7f0fec0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:10:56.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.466+0000 7f0ff368d700 1 --2- 172.21.15.26:0/1613115979 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fec0f6860 0x7f0fec0f6cc0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f0fe8004660 tx=0x7f0fe8009b30).stop 2021-11-03T17:10:56.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.466+0000 7f0ff368d700 1 -- 172.21.15.26:0/1613115979 shutdown_connections 2021-11-03T17:10:56.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.466+0000 7f0ff368d700 1 --2- 172.21.15.26:0/1613115979 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fec0f6860 0x7f0fec0f6cc0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:56.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.466+0000 7f0ff368d700 1 --2- 172.21.15.26:0/1613115979 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0fec0f55c0 0x7f0fec0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:56.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.466+0000 7f0ff368d700 1 -- 172.21.15.26:0/1613115979 >> 172.21.15.26:0/1613115979 conn(0x7f0fec0f0d40 msgr2=0x7f0fec0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:10:56.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.466+0000 7f0ff368d700 1 -- 172.21.15.26:0/1613115979 shutdown_connections 2021-11-03T17:10:56.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.466+0000 7f0ff368d700 1 -- 172.21.15.26:0/1613115979 wait complete. 2021-11-03T17:10:56.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.467+0000 7f0ff368d700 1 Processor -- start 2021-11-03T17:10:56.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.467+0000 7f0ff368d700 1 -- start start 2021-11-03T17:10:56.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.467+0000 7f0ff368d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0fec0f55c0 0x7f0fec106f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:10:56.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.467+0000 7f0ff368d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fec0f6860 0x7f0fec107430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:10:56.466 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.467+0000 7f0ff368d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec1079e0 con 0x7f0fec0f6860 2021-11-03T17:10:56.466 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.467+0000 7f0ff368d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec107b20 con 0x7f0fec0f55c0 2021-11-03T17:10:56.466 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.467+0000 7f0ff0c28700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fec0f6860 0x7f0fec107430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:10:56.466 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.467+0000 7f0ff0c28700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fec0f6860 0x7f0fec107430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52980/0 (socket says 172.21.15.26:52980) 2021-11-03T17:10:56.466 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.467+0000 7f0ff0c28700 1 -- 172.21.15.26:0/1061282630 learned_addr learned my addr 172.21.15.26:0/1061282630 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:10:56.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.467+0000 7f0ff1429700 1 --2- 172.21.15.26:0/1061282630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0fec0f55c0 0x7f0fec106f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:10:56.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.467+0000 7f0ff0c28700 1 -- 172.21.15.26:0/1061282630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0fec0f55c0 msgr2=0x7f0fec106f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:10:56.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.467+0000 7f0ff0c28700 1 --2- 172.21.15.26:0/1061282630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0fec0f55c0 0x7f0fec106f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:56.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.467+0000 7f0ff0c28700 1 -- 172.21.15.26:0/1061282630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe8005040 con 0x7f0fec0f6860 2021-11-03T17:10:56.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.467+0000 7f0ff1429700 1 --2- 172.21.15.26:0/1061282630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0fec0f55c0 0x7f0fec106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:10:56.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.467+0000 7f0ff0c28700 1 --2- 172.21.15.26:0/1061282630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fec0f6860 0x7f0fec107430 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f0fe8009990 tx=0x7f0fe8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:10:56.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.468+0000 7f0fe1ffb700 1 -- 172.21.15.26:0/1061282630 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fe8018070 con 0x7f0fec0f6860 2021-11-03T17:10:56.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.468+0000 7f0fe1ffb700 1 -- 172.21.15.26:0/1061282630 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0fe8007ba0 con 0x7f0fec0f6860 2021-11-03T17:10:56.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.468+0000 7f0fe1ffb700 1 -- 172.21.15.26:0/1061282630 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fe801c3c0 con 0x7f0fec0f6860 2021-11-03T17:10:56.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.468+0000 7f0ff368d700 1 -- 172.21.15.26:0/1061282630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fec108460 con 0x7f0fec0f6860 2021-11-03T17:10:56.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.468+0000 7f0ff368d700 1 -- 172.21.15.26:0/1061282630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fec1089c0 con 0x7f0fec0f6860 2021-11-03T17:10:56.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.469+0000 7f0ff368d700 1 -- 172.21.15.26:0/1061282630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fec045ad0 con 0x7f0fec0f6860 2021-11-03T17:10:56.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.469+0000 7f0fe1ffb700 1 -- 172.21.15.26:0/1061282630 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f0fe801d420 con 0x7f0fec0f6860 2021-11-03T17:10:56.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.470+0000 7f0fe1ffb700 1 --2- 172.21.15.26:0/1061282630 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0fd80640b0 0x7f0fd8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:10:56.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.470+0000 7f0fe1ffb700 1 -- 172.21.15.26:0/1061282630 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f0fe80825c0 con 0x7f0fec0f6860 2021-11-03T17:10:56.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.470+0000 7f0ff1429700 1 --2- 172.21.15.26:0/1061282630 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0fd80640b0 0x7f0fd8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:10:56.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.470+0000 7f0ff1429700 1 --2- 172.21.15.26:0/1061282630 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0fd80640b0 0x7f0fd8066570 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f0fec0f66c0 tx=0x7f0fdc009c00).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:10:56.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.474+0000 7f0fe1ffb700 1 -- 172.21.15.26:0/1061282630 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f0fe80548c0 con 0x7f0fec0f6860 2021-11-03T17:10:56.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:56 smithi194 ceph-mon[65619]: pgmap v488: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:56.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.679+0000 7f0ff368d700 1 -- 172.21.15.26:0/1061282630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0fec1090c0 con 0x7f0fec0f6860 2021-11-03T17:10:56.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.680+0000 7f0fe1ffb700 1 -- 172.21.15.26:0/1061282630 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f0fe80544b0 con 0x7f0fec0f6860 2021-11-03T17:10:56.675 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:10:56.675 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:10:56.676 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:10:56.676 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:10:56.676 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:10:56.676 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:10:56.677 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:10:56.677 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:10:56.677 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:10:56.677 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:10:56.677 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:10:56.678 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:10:56.678 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:10:56.678 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:10:56.678 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:10:56.679 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:10:56.679 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:10:56.679 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:10:56.680 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:10:56.680 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:10:56.680 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:10:56.680 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:10:56.680 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:10:56.681 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:10:56.681 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:10:56.681 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:10:56.681 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:10:56.682 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:10:56.682 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:10:56.682 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:10:56.682 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:10:56.683 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:10:56.683 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:10:56.683 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:10:56.683 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:10:56.683 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:10:56.684 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:10:56.684 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:10:56.684 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:10:56.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.682+0000 7f0ff368d700 1 -- 172.21.15.26:0/1061282630 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0fd80640b0 msgr2=0x7f0fd8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:10:56.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.682+0000 7f0ff368d700 1 --2- 172.21.15.26:0/1061282630 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0fd80640b0 0x7f0fd8066570 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f0fec0f66c0 tx=0x7f0fdc009c00).stop 2021-11-03T17:10:56.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.682+0000 7f0ff368d700 1 -- 172.21.15.26:0/1061282630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fec0f6860 msgr2=0x7f0fec107430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:10:56.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.682+0000 7f0ff368d700 1 --2- 172.21.15.26:0/1061282630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fec0f6860 0x7f0fec107430 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f0fe8009990 tx=0x7f0fe8009b30).stop 2021-11-03T17:10:56.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.682+0000 7f0ff368d700 1 -- 172.21.15.26:0/1061282630 shutdown_connections 2021-11-03T17:10:56.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.682+0000 7f0ff368d700 1 --2- 172.21.15.26:0/1061282630 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0fd80640b0 0x7f0fd8066570 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:56.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.682+0000 7f0ff368d700 1 --2- 172.21.15.26:0/1061282630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0fec0f55c0 0x7f0fec106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:56.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.682+0000 7f0ff368d700 1 --2- 172.21.15.26:0/1061282630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fec0f6860 0x7f0fec107430 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:10:56.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.682+0000 7f0ff368d700 1 -- 172.21.15.26:0/1061282630 >> 172.21.15.26:0/1061282630 conn(0x7f0fec0f0d40 msgr2=0x7f0fec05f740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:10:56.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.682+0000 7f0ff368d700 1 -- 172.21.15.26:0/1061282630 shutdown_connections 2021-11-03T17:10:56.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:10:56.682+0000 7f0ff368d700 1 -- 172.21.15.26:0/1061282630 wait complete. 2021-11-03T17:10:56.687 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:10:57.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:57 smithi026 ceph-mon[96795]: from='client.34652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:10:57.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:57 smithi026 ceph-mon[96795]: from='client.34656 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:10:57.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:57 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3402488429' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:10:57.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:57 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1061282630' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:10:57.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:57 smithi194 ceph-mon[65619]: from='client.34652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:10:57.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:57 smithi194 ceph-mon[65619]: from='client.34656 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:10:57.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:57 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3402488429' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:10:57.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:57 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1061282630' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:10:58.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:10:58 smithi026 ceph-mon[96795]: pgmap v489: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:10:58.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:10:58 smithi194 ceph-mon[65619]: pgmap v489: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:00.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:00 smithi026 ceph-mon[96795]: pgmap v490: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:00.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:00 smithi194 ceph-mon[65619]: pgmap v490: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:02.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:02 smithi026 ceph-mon[96795]: pgmap v491: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:02.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:02 smithi194 ceph-mon[65619]: pgmap v491: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:04.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:04 smithi026 ceph-mon[96795]: pgmap v492: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:04.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:04 smithi194 ceph-mon[65619]: pgmap v492: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:06.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:06 smithi026 ceph-mon[96795]: pgmap v493: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:06.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:06 smithi194 ceph-mon[65619]: pgmap v493: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:08.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:08 smithi026 ceph-mon[96795]: pgmap v494: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:08.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:08 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:11:08.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:08 smithi194 ceph-mon[65619]: pgmap v494: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:08.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:08 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:11:09.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:09 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:11:09.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:09 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:11:10.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:10 smithi026 ceph-mon[96795]: pgmap v495: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:10.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:10 smithi194 ceph-mon[65619]: pgmap v495: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:12.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:12 smithi026 ceph-mon[96795]: pgmap v496: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:12.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:12 smithi194 ceph-mon[65619]: pgmap v496: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:14.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:14 smithi026 ceph-mon[96795]: pgmap v497: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:14.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:14 smithi194 ceph-mon[65619]: pgmap v497: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:16.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:16 smithi026 ceph-mon[96795]: pgmap v498: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:16.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:16 smithi194 ceph-mon[65619]: pgmap v498: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:18.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:18 smithi026 ceph-mon[96795]: pgmap v499: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:18.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:18 smithi194 ceph-mon[65619]: pgmap v499: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:20.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:20 smithi026 ceph-mon[96795]: pgmap v500: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:20.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:20 smithi194 ceph-mon[65619]: pgmap v500: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:22.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:22 smithi026 ceph-mon[96795]: pgmap v501: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:22.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:22 smithi194 ceph-mon[65619]: pgmap v501: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:23.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:23 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:11:23.470 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:23 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:11:24.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:24 smithi026 ceph-mon[96795]: pgmap v502: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:24.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:24 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:11:24.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:24 smithi194 ceph-mon[65619]: pgmap v502: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:24.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:24 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:11:26.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:26 smithi026 ceph-mon[96795]: pgmap v503: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:26.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:26 smithi194 ceph-mon[65619]: pgmap v503: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:26.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.796+0000 7fbd11e45700 1 -- 172.21.15.26:0/3950340803 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd0c0f5ef0 msgr2=0x7fbd0c0f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:11:26.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.796+0000 7fbd11e45700 1 --2- 172.21.15.26:0/3950340803 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd0c0f5ef0 0x7fbd0c0f6920 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7fbd00004660 tx=0x7fbd00009b30).stop 2021-11-03T17:11:26.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.796+0000 7fbd11e45700 1 -- 172.21.15.26:0/3950340803 shutdown_connections 2021-11-03T17:11:26.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.796+0000 7fbd11e45700 1 --2- 172.21.15.26:0/3950340803 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd0c0f5ef0 0x7fbd0c0f6920 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:26.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.796+0000 7fbd11e45700 1 --2- 172.21.15.26:0/3950340803 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd0c0f55e0 0x7fbd0c0f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:26.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.796+0000 7fbd11e45700 1 -- 172.21.15.26:0/3950340803 >> 172.21.15.26:0/3950340803 conn(0x7fbd0c0f0de0 msgr2=0x7fbd0c0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:11:26.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.796+0000 7fbd11e45700 1 -- 172.21.15.26:0/3950340803 shutdown_connections 2021-11-03T17:11:26.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.796+0000 7fbd11e45700 1 -- 172.21.15.26:0/3950340803 wait complete. 2021-11-03T17:11:26.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.796+0000 7fbd11e45700 1 Processor -- start 2021-11-03T17:11:26.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.797+0000 7fbd11e45700 1 -- start start 2021-11-03T17:11:26.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.797+0000 7fbd11e45700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd0c0f55e0 0x7fbd0c106f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:11:26.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.797+0000 7fbd11e45700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd0c0f5ef0 0x7fbd0c107480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:11:26.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.797+0000 7fbd11e45700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c107a30 con 0x7fbd0c0f5ef0 2021-11-03T17:11:26.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.797+0000 7fbd11e45700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c107b70 con 0x7fbd0c0f55e0 2021-11-03T17:11:26.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.797+0000 7fbd0affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd0c0f5ef0 0x7fbd0c107480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:11:26.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.797+0000 7fbd0affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd0c0f5ef0 0x7fbd0c107480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52998/0 (socket says 172.21.15.26:52998) 2021-11-03T17:11:26.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.797+0000 7fbd0affd700 1 -- 172.21.15.26:0/253768873 learned_addr learned my addr 172.21.15.26:0/253768873 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:11:26.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.797+0000 7fbd0b7fe700 1 --2- 172.21.15.26:0/253768873 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd0c0f55e0 0x7fbd0c106f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:11:26.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.797+0000 7fbd0affd700 1 -- 172.21.15.26:0/253768873 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd0c0f55e0 msgr2=0x7fbd0c106f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:11:26.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.797+0000 7fbd0affd700 1 --2- 172.21.15.26:0/253768873 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd0c0f55e0 0x7fbd0c106f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:26.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.797+0000 7fbd0affd700 1 -- 172.21.15.26:0/253768873 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd00005040 con 0x7fbd0c0f5ef0 2021-11-03T17:11:26.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.797+0000 7fbd0affd700 1 --2- 172.21.15.26:0/253768873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd0c0f5ef0 0x7fbd0c107480 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7fbd00009990 tx=0x7fbd00009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:11:26.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.798+0000 7fbcf3fff700 1 -- 172.21.15.26:0/253768873 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd00018070 con 0x7fbd0c0f5ef0 2021-11-03T17:11:26.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.798+0000 7fbcf3fff700 1 -- 172.21.15.26:0/253768873 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbd00007ba0 con 0x7fbd0c0f5ef0 2021-11-03T17:11:26.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.798+0000 7fbd11e45700 1 -- 172.21.15.26:0/253768873 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd0c1084b0 con 0x7fbd0c0f5ef0 2021-11-03T17:11:26.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.798+0000 7fbcf3fff700 1 -- 172.21.15.26:0/253768873 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd0001c3c0 con 0x7fbd0c0f5ef0 2021-11-03T17:11:26.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.798+0000 7fbd11e45700 1 -- 172.21.15.26:0/253768873 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd0c108a10 con 0x7fbd0c0f5ef0 2021-11-03T17:11:26.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.799+0000 7fbd11e45700 1 -- 172.21.15.26:0/253768873 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd0c045ad0 con 0x7fbd0c0f5ef0 2021-11-03T17:11:26.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.799+0000 7fbcf3fff700 1 -- 172.21.15.26:0/253768873 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fbd0001d420 con 0x7fbd0c0f5ef0 2021-11-03T17:11:26.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.800+0000 7fbcf3fff700 1 --2- 172.21.15.26:0/253768873 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbcf40640b0 0x7fbcf4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:11:26.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.800+0000 7fbcf3fff700 1 -- 172.21.15.26:0/253768873 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fbd00082410 con 0x7fbd0c0f5ef0 2021-11-03T17:11:26.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.800+0000 7fbd0b7fe700 1 --2- 172.21.15.26:0/253768873 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbcf40640b0 0x7fbcf4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:11:26.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.800+0000 7fbd0b7fe700 1 --2- 172.21.15.26:0/253768873 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbcf40640b0 0x7fbcf4066570 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fbcfc004c40 tx=0x7fbcfc00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:11:26.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.804+0000 7fbcf3fff700 1 -- 172.21.15.26:0/253768873 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fbd00054830 con 0x7fbd0c0f5ef0 2021-11-03T17:11:26.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.982+0000 7fbd11e45700 1 -- 172.21.15.26:0/253768873 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd0c0ff040 con 0x7fbcf40640b0 2021-11-03T17:11:26.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.984+0000 7fbcf3fff700 1 -- 172.21.15.26:0/253768873 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fbd0c0ff040 con 0x7fbcf40640b0 2021-11-03T17:11:26.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.985+0000 7fbd11e45700 1 -- 172.21.15.26:0/253768873 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbcf40640b0 msgr2=0x7fbcf4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:11:26.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.985+0000 7fbd11e45700 1 --2- 172.21.15.26:0/253768873 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbcf40640b0 0x7fbcf4066570 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fbcfc004c40 tx=0x7fbcfc00b040).stop 2021-11-03T17:11:26.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.986+0000 7fbd11e45700 1 -- 172.21.15.26:0/253768873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd0c0f5ef0 msgr2=0x7fbd0c107480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:11:26.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.986+0000 7fbd11e45700 1 --2- 172.21.15.26:0/253768873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd0c0f5ef0 0x7fbd0c107480 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7fbd00009990 tx=0x7fbd00009b30).stop 2021-11-03T17:11:26.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.986+0000 7fbd11e45700 1 -- 172.21.15.26:0/253768873 shutdown_connections 2021-11-03T17:11:26.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.986+0000 7fbd11e45700 1 --2- 172.21.15.26:0/253768873 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbcf40640b0 0x7fbcf4066570 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:26.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.986+0000 7fbd11e45700 1 --2- 172.21.15.26:0/253768873 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd0c0f55e0 0x7fbd0c106f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:26.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.986+0000 7fbd11e45700 1 --2- 172.21.15.26:0/253768873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd0c0f5ef0 0x7fbd0c107480 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:26.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.986+0000 7fbd11e45700 1 -- 172.21.15.26:0/253768873 >> 172.21.15.26:0/253768873 conn(0x7fbd0c0f0de0 msgr2=0x7fbd0c0fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:11:26.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.986+0000 7fbd11e45700 1 -- 172.21.15.26:0/253768873 shutdown_connections 2021-11-03T17:11:26.984 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:26.986+0000 7fbd11e45700 1 -- 172.21.15.26:0/253768873 wait complete. 2021-11-03T17:11:26.991 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:11:27.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.086+0000 7f0e7074a700 1 -- 172.21.15.26:0/231158154 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e680f55c0 msgr2=0x7f0e680f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:11:27.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.086+0000 7f0e7074a700 1 --2- 172.21.15.26:0/231158154 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e680f55c0 0x7f0e680f59e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f0e58004660 tx=0x7f0e58009b30).stop 2021-11-03T17:11:27.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.086+0000 7f0e7074a700 1 -- 172.21.15.26:0/231158154 shutdown_connections 2021-11-03T17:11:27.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.086+0000 7f0e7074a700 1 --2- 172.21.15.26:0/231158154 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e680f6860 0x7f0e680f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:27.085 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.086+0000 7f0e7074a700 1 --2- 172.21.15.26:0/231158154 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e680f55c0 0x7f0e680f59e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:27.085 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.086+0000 7f0e7074a700 1 -- 172.21.15.26:0/231158154 >> 172.21.15.26:0/231158154 conn(0x7f0e680f0d40 msgr2=0x7f0e680f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:11:27.085 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.086+0000 7f0e7074a700 1 -- 172.21.15.26:0/231158154 shutdown_connections 2021-11-03T17:11:27.085 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.086+0000 7f0e7074a700 1 -- 172.21.15.26:0/231158154 wait complete. 2021-11-03T17:11:27.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.087+0000 7f0e7074a700 1 Processor -- start 2021-11-03T17:11:27.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.087+0000 7f0e7074a700 1 -- start start 2021-11-03T17:11:27.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.087+0000 7f0e7074a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e680f55c0 0x7f0e68109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:11:27.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.087+0000 7f0e7074a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e680f6860 0x7f0e6810c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:11:27.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.087+0000 7f0e7074a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e680603e0 con 0x7f0e680f55c0 2021-11-03T17:11:27.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.087+0000 7f0e7074a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e68060520 con 0x7f0e680f6860 2021-11-03T17:11:27.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.087+0000 7f0e6e4e6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e680f55c0 0x7f0e68109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:11:27.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.087+0000 7f0e6e4e6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e680f55c0 0x7f0e68109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53006/0 (socket says 172.21.15.26:53006) 2021-11-03T17:11:27.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.087+0000 7f0e6e4e6700 1 -- 172.21.15.26:0/2546706635 learned_addr learned my addr 172.21.15.26:0/2546706635 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:11:27.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.087+0000 7f0e6dce5700 1 --2- 172.21.15.26:0/2546706635 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e680f6860 0x7f0e6810c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:11:27.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.087+0000 7f0e6e4e6700 1 -- 172.21.15.26:0/2546706635 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e680f6860 msgr2=0x7f0e6810c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:11:27.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.087+0000 7f0e6e4e6700 1 --2- 172.21.15.26:0/2546706635 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e680f6860 0x7f0e6810c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:27.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.087+0000 7f0e6e4e6700 1 -- 172.21.15.26:0/2546706635 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e58005040 con 0x7f0e680f55c0 2021-11-03T17:11:27.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.087+0000 7f0e6dce5700 1 --2- 172.21.15.26:0/2546706635 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e680f6860 0x7f0e6810c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:11:27.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.087+0000 7f0e6e4e6700 1 --2- 172.21.15.26:0/2546706635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e680f55c0 0x7f0e68109c70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f0e58013a70 tx=0x7f0e58009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:11:27.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.088+0000 7f0e5effd700 1 -- 172.21.15.26:0/2546706635 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e58018070 con 0x7f0e680f55c0 2021-11-03T17:11:27.090 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.088+0000 7f0e5effd700 1 -- 172.21.15.26:0/2546706635 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0e580097d0 con 0x7f0e680f55c0 2021-11-03T17:11:27.090 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.088+0000 7f0e5effd700 1 -- 172.21.15.26:0/2546706635 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e5801c3c0 con 0x7f0e680f55c0 2021-11-03T17:11:27.090 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.088+0000 7f0e7074a700 1 -- 172.21.15.26:0/2546706635 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e6810c6c0 con 0x7f0e680f55c0 2021-11-03T17:11:27.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.088+0000 7f0e7074a700 1 -- 172.21.15.26:0/2546706635 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e6810cc20 con 0x7f0e680f55c0 2021-11-03T17:11:27.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.088+0000 7f0e7074a700 1 -- 172.21.15.26:0/2546706635 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e68045ad0 con 0x7f0e680f55c0 2021-11-03T17:11:27.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.089+0000 7f0e5effd700 1 -- 172.21.15.26:0/2546706635 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f0e58007ba0 con 0x7f0e680f55c0 2021-11-03T17:11:27.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.089+0000 7f0e5effd700 1 --2- 172.21.15.26:0/2546706635 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0e540640b0 0x7f0e54066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:11:27.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.089+0000 7f0e5effd700 1 -- 172.21.15.26:0/2546706635 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f0e580823a0 con 0x7f0e680f55c0 2021-11-03T17:11:27.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.090+0000 7f0e6dce5700 1 --2- 172.21.15.26:0/2546706635 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0e540640b0 0x7f0e54066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:11:27.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.090+0000 7f0e6dce5700 1 --2- 172.21.15.26:0/2546706635 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0e540640b0 0x7f0e54066570 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f0e64009740 tx=0x7f0e64009be0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:11:27.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.094+0000 7f0e5effd700 1 -- 172.21.15.26:0/2546706635 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f0e580547c0 con 0x7f0e680f55c0 2021-11-03T17:11:27.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.266+0000 7f0e7074a700 1 -- 172.21.15.26:0/2546706635 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e680008d0 con 0x7f0e540640b0 2021-11-03T17:11:27.276 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.280+0000 7f0e5effd700 1 -- 172.21.15.26:0/2546706635 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f0e680008d0 con 0x7f0e540640b0 2021-11-03T17:11:27.276 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:11:27.277 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (22m) 2m ago 23m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:11:27.277 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (14m) 2m ago 23m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:11:27.278 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (14m) 110s ago 23m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:11:27.278 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (22m) 2m ago 23m 39.5M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:11:27.279 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (15m) 2m ago 19m 16.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:11:27.279 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (15m) 2m ago 18m 17.8M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:11:27.279 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (19m) 110s ago 19m 19.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:11:27.280 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (19m) 110s ago 19m 19.4M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:11:27.280 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (16m) 2m ago 25m 491M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:11:27.281 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (16m) 110s ago 23m 415M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:11:27.281 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (15m) 2m ago 25m 113M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:11:27.282 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (15m) 110s ago 23m 70.2M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:11:27.282 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (23m) 2m ago 23m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:11:27.282 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (22m) 110s ago 22m 18.4M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:11:27.283 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (14m) 2m ago 22m 190M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:11:27.283 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (13m) 2m ago 21m 204M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:11:27.284 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (13m) 2m ago 21m 170M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:11:27.284 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (13m) 110s ago 21m 211M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:11:27.285 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (12m) 110s ago 20m 189M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:11:27.285 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (12m) 110s ago 20m 174M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:11:27.286 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (22m) 2m ago 23m 49.9M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:11:27.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.282+0000 7f0e7074a700 1 -- 172.21.15.26:0/2546706635 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0e540640b0 msgr2=0x7f0e54066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:11:27.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.282+0000 7f0e7074a700 1 --2- 172.21.15.26:0/2546706635 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0e540640b0 0x7f0e54066570 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f0e64009740 tx=0x7f0e64009be0).stop 2021-11-03T17:11:27.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.282+0000 7f0e7074a700 1 -- 172.21.15.26:0/2546706635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e680f55c0 msgr2=0x7f0e68109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:11:27.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.282+0000 7f0e7074a700 1 --2- 172.21.15.26:0/2546706635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e680f55c0 0x7f0e68109c70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f0e58013a70 tx=0x7f0e58009b30).stop 2021-11-03T17:11:27.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.282+0000 7f0e7074a700 1 -- 172.21.15.26:0/2546706635 shutdown_connections 2021-11-03T17:11:27.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.282+0000 7f0e7074a700 1 --2- 172.21.15.26:0/2546706635 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0e540640b0 0x7f0e54066570 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:27.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.282+0000 7f0e7074a700 1 --2- 172.21.15.26:0/2546706635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e680f55c0 0x7f0e68109c70 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:27.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.282+0000 7f0e7074a700 1 --2- 172.21.15.26:0/2546706635 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e680f6860 0x7f0e6810c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:27.290 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.282+0000 7f0e7074a700 1 -- 172.21.15.26:0/2546706635 >> 172.21.15.26:0/2546706635 conn(0x7f0e680f0d40 msgr2=0x7f0e680fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:11:27.290 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.282+0000 7f0e7074a700 1 -- 172.21.15.26:0/2546706635 shutdown_connections 2021-11-03T17:11:27.290 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.282+0000 7f0e7074a700 1 -- 172.21.15.26:0/2546706635 wait complete. 2021-11-03T17:11:27.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.382+0000 7f39423ec700 1 -- 172.21.15.26:0/2623304434 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f393c0f7550 msgr2=0x7f393c0f47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:11:27.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.382+0000 7f39423ec700 1 --2- 172.21.15.26:0/2623304434 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f393c0f7550 0x7f393c0f47e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f3924004660 tx=0x7f3924009b30).stop 2021-11-03T17:11:27.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.382+0000 7f39423ec700 1 -- 172.21.15.26:0/2623304434 shutdown_connections 2021-11-03T17:11:27.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.382+0000 7f39423ec700 1 --2- 172.21.15.26:0/2623304434 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f393c0f7550 0x7f393c0f47e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:27.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.382+0000 7f39423ec700 1 --2- 172.21.15.26:0/2623304434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f393c0f6bb0 0x7f393c0f6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:27.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.382+0000 7f39423ec700 1 -- 172.21.15.26:0/2623304434 >> 172.21.15.26:0/2623304434 conn(0x7f393c0f04c0 msgr2=0x7f393c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:11:27.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.382+0000 7f39423ec700 1 -- 172.21.15.26:0/2623304434 shutdown_connections 2021-11-03T17:11:27.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.382+0000 7f39423ec700 1 -- 172.21.15.26:0/2623304434 wait complete. 2021-11-03T17:11:27.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.382+0000 7f39423ec700 1 Processor -- start 2021-11-03T17:11:27.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.382+0000 7f39423ec700 1 -- start start 2021-11-03T17:11:27.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.383+0000 7f39423ec700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f393c0f6bb0 0x7f393c1090f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:11:27.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.383+0000 7f39423ec700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f393c0f7550 0x7f393c1095e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:11:27.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.383+0000 7f39423ec700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393c109b90 con 0x7f393c0f7550 2021-11-03T17:11:27.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.383+0000 7f39423ec700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393c109cd0 con 0x7f393c0f6bb0 2021-11-03T17:11:27.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.383+0000 7f393b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f393c0f7550 0x7f393c1095e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:11:27.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.383+0000 7f393b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f393c0f7550 0x7f393c1095e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53018/0 (socket says 172.21.15.26:53018) 2021-11-03T17:11:27.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.383+0000 7f393b7fe700 1 -- 172.21.15.26:0/1721021987 learned_addr learned my addr 172.21.15.26:0/1721021987 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:11:27.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.383+0000 7f393bfff700 1 --2- 172.21.15.26:0/1721021987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f393c0f6bb0 0x7f393c1090f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:11:27.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.383+0000 7f393b7fe700 1 -- 172.21.15.26:0/1721021987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f393c0f6bb0 msgr2=0x7f393c1090f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:11:27.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.383+0000 7f393b7fe700 1 --2- 172.21.15.26:0/1721021987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f393c0f6bb0 0x7f393c1090f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:27.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.383+0000 7f393b7fe700 1 -- 172.21.15.26:0/1721021987 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3924005040 con 0x7f393c0f7550 2021-11-03T17:11:27.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.383+0000 7f393b7fe700 1 --2- 172.21.15.26:0/1721021987 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f393c0f7550 0x7f393c1095e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f3924009990 tx=0x7f3924009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:11:27.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.383+0000 7f3938ff9700 1 -- 172.21.15.26:0/1721021987 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3924018070 con 0x7f393c0f7550 2021-11-03T17:11:27.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.383+0000 7f3938ff9700 1 -- 172.21.15.26:0/1721021987 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3924007ba0 con 0x7f393c0f7550 2021-11-03T17:11:27.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.383+0000 7f3938ff9700 1 -- 172.21.15.26:0/1721021987 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f392401c3c0 con 0x7f393c0f7550 2021-11-03T17:11:27.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.383+0000 7f39423ec700 1 -- 172.21.15.26:0/1721021987 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f393c10a610 con 0x7f393c0f7550 2021-11-03T17:11:27.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.383+0000 7f39423ec700 1 -- 172.21.15.26:0/1721021987 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f393c10ab70 con 0x7f393c0f7550 2021-11-03T17:11:27.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.384+0000 7f39423ec700 1 -- 172.21.15.26:0/1721021987 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f393c045ad0 con 0x7f393c0f7550 2021-11-03T17:11:27.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.385+0000 7f3938ff9700 1 -- 172.21.15.26:0/1721021987 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f392401d420 con 0x7f393c0f7550 2021-11-03T17:11:27.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.385+0000 7f3938ff9700 1 --2- 172.21.15.26:0/1721021987 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f39280640b0 0x7f3928066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:11:27.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.385+0000 7f3938ff9700 1 -- 172.21.15.26:0/1721021987 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f3924082340 con 0x7f393c0f7550 2021-11-03T17:11:27.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.385+0000 7f393bfff700 1 --2- 172.21.15.26:0/1721021987 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f39280640b0 0x7f3928066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:11:27.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.386+0000 7f393bfff700 1 --2- 172.21.15.26:0/1721021987 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f39280640b0 0x7f3928066570 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f392c004ce0 tx=0x7f392c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:11:27.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.389+0000 7f3938ff9700 1 -- 172.21.15.26:0/1721021987 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f3924054760 con 0x7f393c0f7550 2021-11-03T17:11:27.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.618+0000 7f39423ec700 1 -- 172.21.15.26:0/1721021987 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f393c027a00 con 0x7f393c0f7550 2021-11-03T17:11:27.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.618+0000 7f3938ff9700 1 -- 172.21.15.26:0/1721021987 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f3924054350 con 0x7f393c0f7550 2021-11-03T17:11:27.614 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:11:27.614 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:11:27.615 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:11:27.615 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:11:27.615 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:11:27.615 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:11:27.616 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:11:27.616 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:11:27.616 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:11:27.616 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:11:27.616 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:11:27.617 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:11:27.617 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:11:27.617 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:11:27.617 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:11:27.618 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:11:27.618 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:11:27.618 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:11:27.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.620+0000 7f39423ec700 1 -- 172.21.15.26:0/1721021987 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f39280640b0 msgr2=0x7f3928066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:11:27.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.620+0000 7f39423ec700 1 --2- 172.21.15.26:0/1721021987 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f39280640b0 0x7f3928066570 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f392c004ce0 tx=0x7f392c00b040).stop 2021-11-03T17:11:27.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.620+0000 7f39423ec700 1 -- 172.21.15.26:0/1721021987 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f393c0f7550 msgr2=0x7f393c1095e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:11:27.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.620+0000 7f39423ec700 1 --2- 172.21.15.26:0/1721021987 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f393c0f7550 0x7f393c1095e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f3924009990 tx=0x7f3924009b30).stop 2021-11-03T17:11:27.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.620+0000 7f39423ec700 1 -- 172.21.15.26:0/1721021987 shutdown_connections 2021-11-03T17:11:27.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.620+0000 7f39423ec700 1 --2- 172.21.15.26:0/1721021987 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f39280640b0 0x7f3928066570 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:27.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.620+0000 7f39423ec700 1 --2- 172.21.15.26:0/1721021987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f393c0f6bb0 0x7f393c1090f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:27.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.620+0000 7f39423ec700 1 --2- 172.21.15.26:0/1721021987 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f393c0f7550 0x7f393c1095e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:27.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.620+0000 7f39423ec700 1 -- 172.21.15.26:0/1721021987 >> 172.21.15.26:0/1721021987 conn(0x7f393c0f04c0 msgr2=0x7f393c0fe700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:11:27.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.620+0000 7f39423ec700 1 -- 172.21.15.26:0/1721021987 shutdown_connections 2021-11-03T17:11:27.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.620+0000 7f39423ec700 1 -- 172.21.15.26:0/1721021987 wait complete. 2021-11-03T17:11:27.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.720+0000 7f929537c700 1 -- 172.21.15.26:0/2764248769 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92900f66e0 msgr2=0x7f92900f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:11:27.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.720+0000 7f929537c700 1 --2- 172.21.15.26:0/2764248769 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92900f66e0 0x7f92900f6b00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f9278004660 tx=0x7f9278009b30).stop 2021-11-03T17:11:27.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.720+0000 7f929537c700 1 -- 172.21.15.26:0/2764248769 shutdown_connections 2021-11-03T17:11:27.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.720+0000 7f929537c700 1 --2- 172.21.15.26:0/2764248769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92900f6ff0 0x7f92900f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:27.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.720+0000 7f929537c700 1 --2- 172.21.15.26:0/2764248769 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92900f66e0 0x7f92900f6b00 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:27.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.720+0000 7f929537c700 1 -- 172.21.15.26:0/2764248769 >> 172.21.15.26:0/2764248769 conn(0x7f92900f1f00 msgr2=0x7f92900f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:11:27.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.720+0000 7f929537c700 1 -- 172.21.15.26:0/2764248769 shutdown_connections 2021-11-03T17:11:27.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.720+0000 7f929537c700 1 -- 172.21.15.26:0/2764248769 wait complete. 2021-11-03T17:11:27.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.721+0000 7f929537c700 1 Processor -- start 2021-11-03T17:11:27.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.721+0000 7f929537c700 1 -- start start 2021-11-03T17:11:27.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.721+0000 7f929537c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92900f66e0 0x7f9290106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:11:27.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.721+0000 7f929537c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92900f6ff0 0x7f9290107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:11:27.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.721+0000 7f929537c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9290107a00 con 0x7f92900f66e0 2021-11-03T17:11:27.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.721+0000 7f929537c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9290107b40 con 0x7f92900f6ff0 2021-11-03T17:11:27.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.721+0000 7f928effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92900f66e0 0x7f9290106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:11:27.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.721+0000 7f928effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92900f66e0 0x7f9290106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53026/0 (socket says 172.21.15.26:53026) 2021-11-03T17:11:27.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.721+0000 7f928effd700 1 -- 172.21.15.26:0/1514078386 learned_addr learned my addr 172.21.15.26:0/1514078386 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:11:27.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.721+0000 7f928e7fc700 1 --2- 172.21.15.26:0/1514078386 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92900f6ff0 0x7f9290107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:11:27.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.721+0000 7f928effd700 1 -- 172.21.15.26:0/1514078386 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92900f6ff0 msgr2=0x7f9290107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:11:27.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.721+0000 7f928effd700 1 --2- 172.21.15.26:0/1514078386 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92900f6ff0 0x7f9290107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:27.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.721+0000 7f928effd700 1 -- 172.21.15.26:0/1514078386 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9278005040 con 0x7f92900f66e0 2021-11-03T17:11:27.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.721+0000 7f928e7fc700 1 --2- 172.21.15.26:0/1514078386 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92900f6ff0 0x7f9290107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:11:27.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.721+0000 7f928effd700 1 --2- 172.21.15.26:0/1514078386 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92900f66e0 0x7f9290106f60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f9278009da0 tx=0x7f9278009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:11:27.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.722+0000 7f92877fe700 1 -- 172.21.15.26:0/1514078386 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9278018070 con 0x7f92900f66e0 2021-11-03T17:11:27.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.722+0000 7f92877fe700 1 -- 172.21.15.26:0/1514078386 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9278007d70 con 0x7f92900f66e0 2021-11-03T17:11:27.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.722+0000 7f929537c700 1 -- 172.21.15.26:0/1514078386 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9290108480 con 0x7f92900f66e0 2021-11-03T17:11:27.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.722+0000 7f92877fe700 1 -- 172.21.15.26:0/1514078386 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f927801dea0 con 0x7f92900f66e0 2021-11-03T17:11:27.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.722+0000 7f929537c700 1 -- 172.21.15.26:0/1514078386 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92901089e0 con 0x7f92900f66e0 2021-11-03T17:11:27.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.723+0000 7f929537c700 1 -- 172.21.15.26:0/1514078386 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9290045ad0 con 0x7f92900f66e0 2021-11-03T17:11:27.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.723+0000 7f92877fe700 1 -- 172.21.15.26:0/1514078386 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f927801d420 con 0x7f92900f66e0 2021-11-03T17:11:27.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.723+0000 7f92877fe700 1 --2- 172.21.15.26:0/1514078386 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f927c064090 0x7f927c066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:11:27.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.724+0000 7f92877fe700 1 -- 172.21.15.26:0/1514078386 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f9278082680 con 0x7f92900f66e0 2021-11-03T17:11:27.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.724+0000 7f928e7fc700 1 --2- 172.21.15.26:0/1514078386 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f927c064090 0x7f927c066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:11:27.726 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.724+0000 7f928e7fc700 1 --2- 172.21.15.26:0/1514078386 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f927c064090 0x7f927c066550 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f9280004a90 tx=0x7f9280009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:11:27.726 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.728+0000 7f92877fe700 1 -- 172.21.15.26:0/1514078386 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f9278054aa0 con 0x7f92900f66e0 2021-11-03T17:11:27.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.930+0000 7f929537c700 1 -- 172.21.15.26:0/1514078386 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f92900fef70 con 0x7f92900f66e0 2021-11-03T17:11:27.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.930+0000 7f92877fe700 1 -- 172.21.15.26:0/1514078386 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f9278054690 con 0x7f92900f66e0 2021-11-03T17:11:27.927 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:11:27.927 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:11:27.927 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:11:27.927 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:11:27.928 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:11:27.928 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:11:27.928 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:11:27.928 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:11:27.928 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:11:27.929 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:11:27.929 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:11:27.929 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:11:27.929 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:11:27.929 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:11:27.930 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:11:27.930 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:11:27.930 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:11:27.930 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:11:27.931 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:11:27.931 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:11:27.931 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:11:27.931 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:11:27.932 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:11:27.932 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:11:27.932 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:11:27.932 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:11:27.932 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:11:27.933 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:11:27.933 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:11:27.933 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:11:27.933 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:11:27.934 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:11:27.934 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:11:27.934 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:11:27.935 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:11:27.935 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:11:27.935 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:11:27.935 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:11:27.935 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:11:27.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.932+0000 7f929537c700 1 -- 172.21.15.26:0/1514078386 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f927c064090 msgr2=0x7f927c066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:11:27.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.932+0000 7f929537c700 1 --2- 172.21.15.26:0/1514078386 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f927c064090 0x7f927c066550 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f9280004a90 tx=0x7f9280009040).stop 2021-11-03T17:11:27.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.932+0000 7f929537c700 1 -- 172.21.15.26:0/1514078386 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92900f66e0 msgr2=0x7f9290106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:11:27.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.932+0000 7f929537c700 1 --2- 172.21.15.26:0/1514078386 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92900f66e0 0x7f9290106f60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f9278009da0 tx=0x7f9278009b30).stop 2021-11-03T17:11:27.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.932+0000 7f929537c700 1 -- 172.21.15.26:0/1514078386 shutdown_connections 2021-11-03T17:11:27.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.932+0000 7f929537c700 1 --2- 172.21.15.26:0/1514078386 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f927c064090 0x7f927c066550 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:27.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.932+0000 7f929537c700 1 --2- 172.21.15.26:0/1514078386 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92900f66e0 0x7f9290106f60 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:27.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.932+0000 7f929537c700 1 --2- 172.21.15.26:0/1514078386 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92900f6ff0 0x7f9290107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:27.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.932+0000 7f929537c700 1 -- 172.21.15.26:0/1514078386 >> 172.21.15.26:0/1514078386 conn(0x7f92900f1f00 msgr2=0x7f92900fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:11:27.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.932+0000 7f929537c700 1 -- 172.21.15.26:0/1514078386 shutdown_connections 2021-11-03T17:11:27.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:27.932+0000 7f929537c700 1 -- 172.21.15.26:0/1514078386 wait complete. 2021-11-03T17:11:27.939 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:11:28.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:28 smithi026 ceph-mon[96795]: pgmap v504: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:28.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:28 smithi026 ceph-mon[96795]: from='client.34668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:11:28.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:28 smithi026 ceph-mon[96795]: from='client.34672 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:11:28.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:28 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1721021987' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:11:28.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:28 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1514078386' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:11:28.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:28 smithi194 ceph-mon[65619]: pgmap v504: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:28.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:28 smithi194 ceph-mon[65619]: from='client.34668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:11:28.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:28 smithi194 ceph-mon[65619]: from='client.34672 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:11:28.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:28 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1721021987' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:11:28.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:28 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1514078386' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:11:30.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:30 smithi026 ceph-mon[96795]: pgmap v505: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:30.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:30 smithi194 ceph-mon[65619]: pgmap v505: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:32.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:32 smithi026 ceph-mon[96795]: pgmap v506: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:32.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:32 smithi194 ceph-mon[65619]: pgmap v506: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:34.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:34 smithi026 ceph-mon[96795]: pgmap v507: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:34.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:34 smithi194 ceph-mon[65619]: pgmap v507: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:36.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:36 smithi026 ceph-mon[96795]: pgmap v508: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:36.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:36 smithi194 ceph-mon[65619]: pgmap v508: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:38.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:38 smithi026 ceph-mon[96795]: pgmap v509: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:38.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:38 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:11:38.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:38 smithi194 ceph-mon[65619]: pgmap v509: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:38.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:38 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:11:39.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:39 smithi194 ceph-mon[65619]: poll took 60071.455 ms: 1 events 2021-11-03T17:11:39.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:11:39.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:11:39.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:11:39.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:11:39.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:11:39.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:11:39.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:39 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:11:39.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:11:39.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:39 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:11:39.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:39 smithi026 ceph-mon[96795]: poll took 60071.455 ms: 1 events 2021-11-03T17:11:39.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:11:39.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:11:39.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:11:39.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:11:39.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:11:39.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:11:39.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:39 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:11:39.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:11:39.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:39 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:11:40.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:40 smithi194 ceph-mon[65619]: pgmap v510: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:40.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:40 smithi026 ceph-mon[96795]: pgmap v510: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:42.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:42 smithi194 ceph-mon[65619]: pgmap v511: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:42.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:42 smithi026 ceph-mon[96795]: pgmap v511: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:44.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:44 smithi194 ceph-mon[65619]: pgmap v512: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:44.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:44 smithi026 ceph-mon[96795]: pgmap v512: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:46.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:46 smithi194 ceph-mon[65619]: pgmap v513: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:46.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:46 smithi026 ceph-mon[96795]: pgmap v513: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:48.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:48 smithi194 ceph-mon[65619]: pgmap v514: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:48.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:11:48.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:11:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:48 smithi026 ceph-mon[96795]: pgmap v514: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:48.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:11:48.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:11:50.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:50 smithi194 ceph-mon[65619]: pgmap v515: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:50.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:50 smithi026 ceph-mon[96795]: pgmap v515: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:52.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:52 smithi194 ceph-mon[65619]: pgmap v516: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:52.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:52 smithi026 ceph-mon[96795]: pgmap v516: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:54.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:54 smithi194 ceph-mon[65619]: pgmap v517: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:54.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:11:54.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:54 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:11:54.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:54 smithi026 ceph-mon[96795]: pgmap v517: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:54.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:11:54.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:54 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:11:56.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:56 smithi194 ceph-mon[65619]: pgmap v518: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:56.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:56 smithi026 ceph-mon[96795]: pgmap v518: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:58.045 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.048+0000 7f1b9d2c9700 1 -- 172.21.15.26:0/2101002518 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b980f55c0 msgr2=0x7f1b980f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:11:58.045 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.048+0000 7f1b9d2c9700 1 --2- 172.21.15.26:0/2101002518 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b980f55c0 0x7f1b980f59e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f1b900099e0 tx=0x7f1b90004d10).stop 2021-11-03T17:11:58.046 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.048+0000 7f1b9d2c9700 1 -- 172.21.15.26:0/2101002518 shutdown_connections 2021-11-03T17:11:58.046 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.048+0000 7f1b9d2c9700 1 --2- 172.21.15.26:0/2101002518 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b980f6860 0x7f1b980f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:58.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.048+0000 7f1b9d2c9700 1 --2- 172.21.15.26:0/2101002518 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b980f55c0 0x7f1b980f59e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:58.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.048+0000 7f1b9d2c9700 1 -- 172.21.15.26:0/2101002518 >> 172.21.15.26:0/2101002518 conn(0x7f1b980f0d40 msgr2=0x7f1b980f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:11:58.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.048+0000 7f1b9d2c9700 1 -- 172.21.15.26:0/2101002518 shutdown_connections 2021-11-03T17:11:58.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.048+0000 7f1b9d2c9700 1 -- 172.21.15.26:0/2101002518 wait complete. 2021-11-03T17:11:58.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.049+0000 7f1b9d2c9700 1 Processor -- start 2021-11-03T17:11:58.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.049+0000 7f1b9d2c9700 1 -- start start 2021-11-03T17:11:58.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.049+0000 7f1b9d2c9700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b980f55c0 0x7f1b98107090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:11:58.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.049+0000 7f1b9d2c9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b980f6860 0x7f1b98107580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:11:58.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.049+0000 7f1b9d2c9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b98107b30 con 0x7f1b980f6860 2021-11-03T17:11:58.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.049+0000 7f1b9d2c9700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b98107c70 con 0x7f1b980f55c0 2021-11-03T17:11:58.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.049+0000 7f1b967fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b980f6860 0x7f1b98107580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:11:58.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.049+0000 7f1b967fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b980f6860 0x7f1b98107580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53046/0 (socket says 172.21.15.26:53046) 2021-11-03T17:11:58.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.049+0000 7f1b967fc700 1 -- 172.21.15.26:0/2602505945 learned_addr learned my addr 172.21.15.26:0/2602505945 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:11:58.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.049+0000 7f1b96ffd700 1 --2- 172.21.15.26:0/2602505945 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b980f55c0 0x7f1b98107090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:11:58.053 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.049+0000 7f1b967fc700 1 -- 172.21.15.26:0/2602505945 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b980f55c0 msgr2=0x7f1b98107090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:11:58.053 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.049+0000 7f1b967fc700 1 --2- 172.21.15.26:0/2602505945 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b980f55c0 0x7f1b98107090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:58.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.049+0000 7f1b967fc700 1 -- 172.21.15.26:0/2602505945 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b90009640 con 0x7f1b980f6860 2021-11-03T17:11:58.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.050+0000 7f1b967fc700 1 --2- 172.21.15.26:0/2602505945 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b980f6860 0x7f1b98107580 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f1b8c0026d0 tx=0x7f1b8c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:11:58.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.050+0000 7f1b7f7fe700 1 -- 172.21.15.26:0/2602505945 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b8c009320 con 0x7f1b980f6860 2021-11-03T17:11:58.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.050+0000 7f1b7f7fe700 1 -- 172.21.15.26:0/2602505945 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1b8c00f040 con 0x7f1b980f6860 2021-11-03T17:11:58.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.050+0000 7f1b9d2c9700 1 -- 172.21.15.26:0/2602505945 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b98108610 con 0x7f1b980f6860 2021-11-03T17:11:58.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.050+0000 7f1b7f7fe700 1 -- 172.21.15.26:0/2602505945 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b8c0147e0 con 0x7f1b980f6860 2021-11-03T17:11:58.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.050+0000 7f1b9d2c9700 1 -- 172.21.15.26:0/2602505945 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b98108b50 con 0x7f1b980f6860 2021-11-03T17:11:58.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.051+0000 7f1b9d2c9700 1 -- 172.21.15.26:0/2602505945 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b98045ad0 con 0x7f1b980f6860 2021-11-03T17:11:58.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.051+0000 7f1b7f7fe700 1 -- 172.21.15.26:0/2602505945 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f1b8c009480 con 0x7f1b980f6860 2021-11-03T17:11:58.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.052+0000 7f1b7f7fe700 1 --2- 172.21.15.26:0/2602505945 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1b80064090 0x7f1b80066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:11:58.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.052+0000 7f1b7f7fe700 1 -- 172.21.15.26:0/2602505945 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f1b8c080df0 con 0x7f1b980f6860 2021-11-03T17:11:58.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.052+0000 7f1b96ffd700 1 --2- 172.21.15.26:0/2602505945 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1b80064090 0x7f1b80066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:11:58.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.052+0000 7f1b96ffd700 1 --2- 172.21.15.26:0/2602505945 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1b80064090 0x7f1b80066550 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f1b9000b3b0 tx=0x7f1b90004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:11:58.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.056+0000 7f1b7f7fe700 1 -- 172.21.15.26:0/2602505945 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f1b8c053210 con 0x7f1b980f6860 2021-11-03T17:11:58.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.236+0000 7f1b9d2c9700 1 -- 172.21.15.26:0/2602505945 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b9805fd30 con 0x7f1b80064090 2021-11-03T17:11:58.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.237+0000 7f1b7f7fe700 1 -- 172.21.15.26:0/2602505945 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f1b9805fd30 con 0x7f1b80064090 2021-11-03T17:11:58.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.239+0000 7f1b9d2c9700 1 -- 172.21.15.26:0/2602505945 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1b80064090 msgr2=0x7f1b80066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:11:58.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.239+0000 7f1b9d2c9700 1 --2- 172.21.15.26:0/2602505945 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1b80064090 0x7f1b80066550 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f1b9000b3b0 tx=0x7f1b90004d10).stop 2021-11-03T17:11:58.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.239+0000 7f1b9d2c9700 1 -- 172.21.15.26:0/2602505945 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b980f6860 msgr2=0x7f1b98107580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:11:58.235 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.239+0000 7f1b9d2c9700 1 --2- 172.21.15.26:0/2602505945 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b980f6860 0x7f1b98107580 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f1b8c0026d0 tx=0x7f1b8c009de0).stop 2021-11-03T17:11:58.235 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.239+0000 7f1b9d2c9700 1 -- 172.21.15.26:0/2602505945 shutdown_connections 2021-11-03T17:11:58.236 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.239+0000 7f1b9d2c9700 1 --2- 172.21.15.26:0/2602505945 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1b80064090 0x7f1b80066550 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:58.236 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.239+0000 7f1b9d2c9700 1 --2- 172.21.15.26:0/2602505945 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b980f55c0 0x7f1b98107090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:58.236 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.239+0000 7f1b9d2c9700 1 --2- 172.21.15.26:0/2602505945 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b980f6860 0x7f1b98107580 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:58.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.239+0000 7f1b9d2c9700 1 -- 172.21.15.26:0/2602505945 >> 172.21.15.26:0/2602505945 conn(0x7f1b980f0d40 msgr2=0x7f1b9805f620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:11:58.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.239+0000 7f1b9d2c9700 1 -- 172.21.15.26:0/2602505945 shutdown_connections 2021-11-03T17:11:58.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.239+0000 7f1b9d2c9700 1 -- 172.21.15.26:0/2602505945 wait complete. 2021-11-03T17:11:58.243 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:11:58.338 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.340+0000 7f49d07e9700 1 -- 172.21.15.26:0/783380861 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49c80f55c0 msgr2=0x7f49c80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:11:58.338 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.340+0000 7f49d07e9700 1 --2- 172.21.15.26:0/783380861 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49c80f55c0 0x7f49c80f59e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f49c4004660 tx=0x7f49c4009b30).stop 2021-11-03T17:11:58.338 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.340+0000 7f49d07e9700 1 -- 172.21.15.26:0/783380861 shutdown_connections 2021-11-03T17:11:58.339 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.340+0000 7f49d07e9700 1 --2- 172.21.15.26:0/783380861 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49c80f6860 0x7f49c80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:58.339 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.340+0000 7f49d07e9700 1 --2- 172.21.15.26:0/783380861 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49c80f55c0 0x7f49c80f59e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:58.339 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.340+0000 7f49d07e9700 1 -- 172.21.15.26:0/783380861 >> 172.21.15.26:0/783380861 conn(0x7f49c80f0d40 msgr2=0x7f49c80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:11:58.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.340+0000 7f49d07e9700 1 -- 172.21.15.26:0/783380861 shutdown_connections 2021-11-03T17:11:58.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.340+0000 7f49d07e9700 1 -- 172.21.15.26:0/783380861 wait complete. 2021-11-03T17:11:58.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.341+0000 7f49d07e9700 1 Processor -- start 2021-11-03T17:11:58.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.341+0000 7f49d07e9700 1 -- start start 2021-11-03T17:11:58.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.341+0000 7f49d07e9700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49c80f55c0 0x7f49c810c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:11:58.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.341+0000 7f49d07e9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49c80f6860 0x7f49c810e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:11:58.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.341+0000 7f49d07e9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c80602b0 con 0x7f49c80f6860 2021-11-03T17:11:58.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.341+0000 7f49d07e9700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c80603f0 con 0x7f49c80f55c0 2021-11-03T17:11:58.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.341+0000 7f49cdd84700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49c80f6860 0x7f49c810e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:11:58.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.341+0000 7f49cdd84700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49c80f6860 0x7f49c810e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53056/0 (socket says 172.21.15.26:53056) 2021-11-03T17:11:58.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.341+0000 7f49cdd84700 1 -- 172.21.15.26:0/2264432067 learned_addr learned my addr 172.21.15.26:0/2264432067 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:11:58.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.341+0000 7f49ce585700 1 --2- 172.21.15.26:0/2264432067 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49c80f55c0 0x7f49c810c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:11:58.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.341+0000 7f49cdd84700 1 -- 172.21.15.26:0/2264432067 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49c80f55c0 msgr2=0x7f49c810c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:11:58.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.341+0000 7f49cdd84700 1 --2- 172.21.15.26:0/2264432067 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49c80f55c0 0x7f49c810c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:58.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.341+0000 7f49cdd84700 1 -- 172.21.15.26:0/2264432067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c4005040 con 0x7f49c80f6860 2021-11-03T17:11:58.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.342+0000 7f49cdd84700 1 --2- 172.21.15.26:0/2264432067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49c80f6860 0x7f49c810e590 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f49b800c530 tx=0x7f49b8007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:11:58.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.342+0000 7f49beffd700 1 -- 172.21.15.26:0/2264432067 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49b800f650 con 0x7f49c80f6860 2021-11-03T17:11:58.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.342+0000 7f49d07e9700 1 -- 172.21.15.26:0/2264432067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c810ea80 con 0x7f49c80f6860 2021-11-03T17:11:58.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.342+0000 7f49beffd700 1 -- 172.21.15.26:0/2264432067 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f49b800fc60 con 0x7f49c80f6860 2021-11-03T17:11:58.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.342+0000 7f49beffd700 1 -- 172.21.15.26:0/2264432067 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49b8012cd0 con 0x7f49c80f6860 2021-11-03T17:11:58.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.342+0000 7f49d07e9700 1 -- 172.21.15.26:0/2264432067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c810ef00 con 0x7f49c80f6860 2021-11-03T17:11:58.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.343+0000 7f49d07e9700 1 -- 172.21.15.26:0/2264432067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49c8045ad0 con 0x7f49c80f6860 2021-11-03T17:11:58.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.343+0000 7f49beffd700 1 -- 172.21.15.26:0/2264432067 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f49b8010070 con 0x7f49c80f6860 2021-11-03T17:11:58.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.343+0000 7f49beffd700 1 --2- 172.21.15.26:0/2264432067 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f49b40640b0 0x7f49b4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:11:58.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.344+0000 7f49beffd700 1 -- 172.21.15.26:0/2264432067 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f49b8080710 con 0x7f49c80f6860 2021-11-03T17:11:58.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.344+0000 7f49ce585700 1 --2- 172.21.15.26:0/2264432067 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f49b40640b0 0x7f49b4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:11:58.347 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.344+0000 7f49ce585700 1 --2- 172.21.15.26:0/2264432067 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f49b40640b0 0x7f49b4066570 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f49c4004e30 tx=0x7f49c4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:11:58.347 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.348+0000 7f49beffd700 1 -- 172.21.15.26:0/2264432067 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f49b8052980 con 0x7f49c80f6860 2021-11-03T17:11:58.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:58 smithi194 ceph-mon[65619]: pgmap v519: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:58.518 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.524+0000 7f49d07e9700 1 -- 172.21.15.26:0/2264432067 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f49c8057f10 con 0x7f49b40640b0 2021-11-03T17:11:58.533 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.538+0000 7f49beffd700 1 -- 172.21.15.26:0/2264432067 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f49c8057f10 con 0x7f49b40640b0 2021-11-03T17:11:58.534 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:11:58.534 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (23m) 3m ago 24m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:11:58.534 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (15m) 3m ago 24m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:11:58.535 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (15m) 2m ago 23m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:11:58.535 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (23m) 3m ago 24m 39.5M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:11:58.535 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (16m) 3m ago 19m 16.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:11:58.535 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (16m) 3m ago 19m 17.8M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:11:58.536 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (19m) 2m ago 19m 19.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:11:58.536 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (19m) 2m ago 19m 19.4M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:11:58.536 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (16m) 3m ago 25m 491M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:11:58.536 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (16m) 2m ago 23m 415M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:11:58.537 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (16m) 3m ago 25m 113M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:11:58.537 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (15m) 2m ago 23m 70.2M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:11:58.537 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (24m) 3m ago 24m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:11:58.537 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (23m) 2m ago 23m 18.4M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:11:58.538 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (15m) 3m ago 22m 190M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:11:58.538 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (14m) 3m ago 22m 204M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:11:58.538 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (14m) 3m ago 22m 170M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:11:58.538 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (13m) 2m ago 21m 211M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:11:58.538 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (13m) 2m ago 21m 189M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:11:58.539 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (12m) 2m ago 21m 174M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:11:58.539 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (22m) 3m ago 23m 49.9M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:11:58.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.541+0000 7f49d07e9700 1 -- 172.21.15.26:0/2264432067 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f49b40640b0 msgr2=0x7f49b4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:11:58.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.541+0000 7f49d07e9700 1 --2- 172.21.15.26:0/2264432067 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f49b40640b0 0x7f49b4066570 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f49c4004e30 tx=0x7f49c4009b30).stop 2021-11-03T17:11:58.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.541+0000 7f49d07e9700 1 -- 172.21.15.26:0/2264432067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49c80f6860 msgr2=0x7f49c810e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:11:58.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.541+0000 7f49d07e9700 1 --2- 172.21.15.26:0/2264432067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49c80f6860 0x7f49c810e590 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f49b800c530 tx=0x7f49b8007e20).stop 2021-11-03T17:11:58.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.541+0000 7f49d07e9700 1 -- 172.21.15.26:0/2264432067 shutdown_connections 2021-11-03T17:11:58.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.541+0000 7f49d07e9700 1 --2- 172.21.15.26:0/2264432067 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f49b40640b0 0x7f49b4066570 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:58.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.541+0000 7f49d07e9700 1 --2- 172.21.15.26:0/2264432067 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49c80f55c0 0x7f49c810c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:58.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.541+0000 7f49d07e9700 1 --2- 172.21.15.26:0/2264432067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49c80f6860 0x7f49c810e590 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:58.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.541+0000 7f49d07e9700 1 -- 172.21.15.26:0/2264432067 >> 172.21.15.26:0/2264432067 conn(0x7f49c80f0d40 msgr2=0x7f49c80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:11:58.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.541+0000 7f49d07e9700 1 -- 172.21.15.26:0/2264432067 shutdown_connections 2021-11-03T17:11:58.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.541+0000 7f49d07e9700 1 -- 172.21.15.26:0/2264432067 wait complete. 2021-11-03T17:11:58.636 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.639+0000 7f3ce582e700 1 -- 172.21.15.26:0/2737387068 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ce00f6ff0 msgr2=0x7f3ce00f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:11:58.636 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.639+0000 7f3ce582e700 1 --2- 172.21.15.26:0/2737387068 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ce00f6ff0 0x7f3ce00f7a20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f3cc8004660 tx=0x7f3cc8009b30).stop 2021-11-03T17:11:58.636 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.640+0000 7f3ce582e700 1 -- 172.21.15.26:0/2737387068 shutdown_connections 2021-11-03T17:11:58.637 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.640+0000 7f3ce582e700 1 --2- 172.21.15.26:0/2737387068 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ce00f6ff0 0x7f3ce00f7a20 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:58.637 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.640+0000 7f3ce582e700 1 --2- 172.21.15.26:0/2737387068 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ce00f66e0 0x7f3ce00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:58.637 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.640+0000 7f3ce582e700 1 -- 172.21.15.26:0/2737387068 >> 172.21.15.26:0/2737387068 conn(0x7f3ce00f1f00 msgr2=0x7f3ce00f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:11:58.637 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.640+0000 7f3ce582e700 1 -- 172.21.15.26:0/2737387068 shutdown_connections 2021-11-03T17:11:58.637 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.640+0000 7f3ce582e700 1 -- 172.21.15.26:0/2737387068 wait complete. 2021-11-03T17:11:58.638 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.640+0000 7f3ce582e700 1 Processor -- start 2021-11-03T17:11:58.638 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.640+0000 7f3ce582e700 1 -- start start 2021-11-03T17:11:58.638 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.640+0000 7f3ce582e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ce00f66e0 0x7f3ce0106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:11:58.638 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.640+0000 7f3ce582e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ce00f6ff0 0x7f3ce0107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:11:58.639 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.640+0000 7f3ce582e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce0107a10 con 0x7f3ce00f6ff0 2021-11-03T17:11:58.639 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.640+0000 7f3ce582e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce0107b50 con 0x7f3ce00f66e0 2021-11-03T17:11:58.639 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.641+0000 7f3cde7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ce00f6ff0 0x7f3ce0107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:11:58.639 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.641+0000 7f3cde7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ce00f6ff0 0x7f3ce0107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53068/0 (socket says 172.21.15.26:53068) 2021-11-03T17:11:58.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.641+0000 7f3cde7fc700 1 -- 172.21.15.26:0/856786227 learned_addr learned my addr 172.21.15.26:0/856786227 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:11:58.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.641+0000 7f3cdeffd700 1 --2- 172.21.15.26:0/856786227 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ce00f66e0 0x7f3ce0106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:11:58.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.641+0000 7f3cde7fc700 1 -- 172.21.15.26:0/856786227 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ce00f66e0 msgr2=0x7f3ce0106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:11:58.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.641+0000 7f3cde7fc700 1 --2- 172.21.15.26:0/856786227 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ce00f66e0 0x7f3ce0106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:58.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.641+0000 7f3cde7fc700 1 -- 172.21.15.26:0/856786227 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc8005040 con 0x7f3ce00f6ff0 2021-11-03T17:11:58.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.641+0000 7f3cdeffd700 1 --2- 172.21.15.26:0/856786227 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ce00f66e0 0x7f3ce0106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:11:58.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.641+0000 7f3cde7fc700 1 --2- 172.21.15.26:0/856786227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ce00f6ff0 0x7f3ce0107460 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f3cc8009da0 tx=0x7f3cc8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:11:58.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.641+0000 7f3cd77fe700 1 -- 172.21.15.26:0/856786227 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cc8018070 con 0x7f3ce00f6ff0 2021-11-03T17:11:58.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.641+0000 7f3ce582e700 1 -- 172.21.15.26:0/856786227 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ce0108490 con 0x7f3ce00f6ff0 2021-11-03T17:11:58.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.641+0000 7f3cd77fe700 1 -- 172.21.15.26:0/856786227 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3cc8007d70 con 0x7f3ce00f6ff0 2021-11-03T17:11:58.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.641+0000 7f3cd77fe700 1 -- 172.21.15.26:0/856786227 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cc801dea0 con 0x7f3ce00f6ff0 2021-11-03T17:11:58.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.641+0000 7f3ce582e700 1 -- 172.21.15.26:0/856786227 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ce01089f0 con 0x7f3ce00f6ff0 2021-11-03T17:11:58.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.642+0000 7f3ce582e700 1 -- 172.21.15.26:0/856786227 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ce0045ad0 con 0x7f3ce00f6ff0 2021-11-03T17:11:58.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.643+0000 7f3cd77fe700 1 -- 172.21.15.26:0/856786227 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f3cc801d420 con 0x7f3ce00f6ff0 2021-11-03T17:11:58.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.643+0000 7f3cd77fe700 1 --2- 172.21.15.26:0/856786227 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3ccc064090 0x7f3ccc066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:11:58.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.643+0000 7f3cd77fe700 1 -- 172.21.15.26:0/856786227 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f3cc8082670 con 0x7f3ce00f6ff0 2021-11-03T17:11:58.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.644+0000 7f3cdeffd700 1 --2- 172.21.15.26:0/856786227 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3ccc064090 0x7f3ccc066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:11:58.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.644+0000 7f3cdeffd700 1 --2- 172.21.15.26:0/856786227 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3ccc064090 0x7f3ccc066550 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f3cd8004550 tx=0x7f3cd8009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:11:58.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.647+0000 7f3cd77fe700 1 -- 172.21.15.26:0/856786227 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f3cc8054a90 con 0x7f3ce00f6ff0 2021-11-03T17:11:58.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:58 smithi026 ceph-mon[96795]: pgmap v519: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:11:58.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.880+0000 7f3ce582e700 1 -- 172.21.15.26:0/856786227 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3ce0027a00 con 0x7f3ce00f6ff0 2021-11-03T17:11:58.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.881+0000 7f3cd77fe700 1 -- 172.21.15.26:0/856786227 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f3cc8054680 con 0x7f3ce00f6ff0 2021-11-03T17:11:58.876 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:11:58.876 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:11:58.877 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:11:58.877 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:11:58.877 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:11:58.878 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:11:58.878 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:11:58.878 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:11:58.878 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:11:58.878 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:11:58.879 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:11:58.879 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:11:58.879 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:11:58.879 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:11:58.880 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:11:58.880 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:11:58.880 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:11:58.880 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:11:58.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.883+0000 7f3ce582e700 1 -- 172.21.15.26:0/856786227 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3ccc064090 msgr2=0x7f3ccc066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:11:58.882 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.883+0000 7f3ce582e700 1 --2- 172.21.15.26:0/856786227 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3ccc064090 0x7f3ccc066550 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f3cd8004550 tx=0x7f3cd8009040).stop 2021-11-03T17:11:58.882 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.883+0000 7f3ce582e700 1 -- 172.21.15.26:0/856786227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ce00f6ff0 msgr2=0x7f3ce0107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:11:58.882 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.883+0000 7f3ce582e700 1 --2- 172.21.15.26:0/856786227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ce00f6ff0 0x7f3ce0107460 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f3cc8009da0 tx=0x7f3cc8009b30).stop 2021-11-03T17:11:58.882 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.883+0000 7f3ce582e700 1 -- 172.21.15.26:0/856786227 shutdown_connections 2021-11-03T17:11:58.883 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.883+0000 7f3ce582e700 1 --2- 172.21.15.26:0/856786227 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3ccc064090 0x7f3ccc066550 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:58.883 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.883+0000 7f3ce582e700 1 --2- 172.21.15.26:0/856786227 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ce00f66e0 0x7f3ce0106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:58.883 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.883+0000 7f3ce582e700 1 --2- 172.21.15.26:0/856786227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ce00f6ff0 0x7f3ce0107460 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:58.883 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.883+0000 7f3ce582e700 1 -- 172.21.15.26:0/856786227 >> 172.21.15.26:0/856786227 conn(0x7f3ce00f1f00 msgr2=0x7f3ce00fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:11:58.883 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.883+0000 7f3ce582e700 1 -- 172.21.15.26:0/856786227 shutdown_connections 2021-11-03T17:11:58.884 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.883+0000 7f3ce582e700 1 -- 172.21.15.26:0/856786227 wait complete. 2021-11-03T17:11:58.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.983+0000 7f87691ad700 1 -- 172.21.15.26:0/1468299922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87640f5ed0 msgr2=0x7f87640f6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:11:58.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.983+0000 7f87691ad700 1 --2- 172.21.15.26:0/1468299922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87640f5ed0 0x7f87640f6900 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f8754004660 tx=0x7f8754009b30).stop 2021-11-03T17:11:58.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.983+0000 7f87691ad700 1 -- 172.21.15.26:0/1468299922 shutdown_connections 2021-11-03T17:11:58.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.983+0000 7f87691ad700 1 --2- 172.21.15.26:0/1468299922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87640f5ed0 0x7f87640f6900 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:58.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.983+0000 7f87691ad700 1 --2- 172.21.15.26:0/1468299922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87640f55c0 0x7f87640f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:11:58.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.983+0000 7f87691ad700 1 -- 172.21.15.26:0/1468299922 >> 172.21.15.26:0/1468299922 conn(0x7f87640f0de0 msgr2=0x7f87640f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:11:58.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.983+0000 7f87691ad700 1 -- 172.21.15.26:0/1468299922 shutdown_connections 2021-11-03T17:11:58.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.983+0000 7f87691ad700 1 -- 172.21.15.26:0/1468299922 wait complete. 2021-11-03T17:11:58.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.984+0000 7f87691ad700 1 Processor -- start 2021-11-03T17:11:58.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.984+0000 7f87691ad700 1 -- start start 2021-11-03T17:11:58.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.984+0000 7f87691ad700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87640f55c0 0x7f8764104db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:11:58.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.984+0000 7f87691ad700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87640f5ed0 0x7f87641052a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:11:58.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.984+0000 7f87691ad700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8764105930 con 0x7f87640f55c0 2021-11-03T17:11:58.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.984+0000 7f87691ad700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87641060e0 con 0x7f87640f5ed0 2021-11-03T17:11:58.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.984+0000 7f8762d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87640f55c0 0x7f8764104db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:11:58.984 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.984+0000 7f8762d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87640f55c0 0x7f8764104db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53076/0 (socket says 172.21.15.26:53076) 2021-11-03T17:11:58.984 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.984+0000 7f8762d9d700 1 -- 172.21.15.26:0/2379670061 learned_addr learned my addr 172.21.15.26:0/2379670061 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:11:58.984 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.984+0000 7f876259c700 1 --2- 172.21.15.26:0/2379670061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87640f5ed0 0x7f87641052a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:11:58.984 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.984+0000 7f8762d9d700 1 -- 172.21.15.26:0/2379670061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87640f5ed0 msgr2=0x7f87641052a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:11:58.984 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.984+0000 7f8762d9d700 1 --2- 172.21.15.26:0/2379670061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87640f5ed0 0x7f87641052a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:58.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.984+0000 7f8762d9d700 1 -- 172.21.15.26:0/2379670061 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8754005040 con 0x7f87640f55c0 2021-11-03T17:11:58.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.985+0000 7f8762d9d700 1 --2- 172.21.15.26:0/2379670061 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87640f55c0 0x7f8764104db0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f874c00b410 tx=0x7f874c006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:11:58.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.985+0000 7f875b7fe700 1 -- 172.21.15.26:0/2379670061 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f874c0125f0 con 0x7f87640f55c0 2021-11-03T17:11:58.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.985+0000 7f875b7fe700 1 -- 172.21.15.26:0/2379670061 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f874c00be30 con 0x7f87640f55c0 2021-11-03T17:11:58.986 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.985+0000 7f87691ad700 1 -- 172.21.15.26:0/2379670061 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87641063c0 con 0x7f87640f55c0 2021-11-03T17:11:58.986 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.985+0000 7f875b7fe700 1 -- 172.21.15.26:0/2379670061 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f874c002a70 con 0x7f87640f55c0 2021-11-03T17:11:58.986 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.985+0000 7f87691ad700 1 -- 172.21.15.26:0/2379670061 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8764106980 con 0x7f87640f55c0 2021-11-03T17:11:58.986 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.986+0000 7f87691ad700 1 -- 172.21.15.26:0/2379670061 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87640f4a50 con 0x7f87640f55c0 2021-11-03T17:11:58.988 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.986+0000 7f875b7fe700 1 -- 172.21.15.26:0/2379670061 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f874c00f030 con 0x7f87640f55c0 2021-11-03T17:11:58.988 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.986+0000 7f875b7fe700 1 --2- 172.21.15.26:0/2379670061 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f87500662c0 0x7f8750068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:11:58.988 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.987+0000 7f875b7fe700 1 -- 172.21.15.26:0/2379670061 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f874c080bf0 con 0x7f87640f55c0 2021-11-03T17:11:58.988 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.987+0000 7f876259c700 1 --2- 172.21.15.26:0/2379670061 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f87500662c0 0x7f8750068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:11:58.989 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.987+0000 7f876259c700 1 --2- 172.21.15.26:0/2379670061 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f87500662c0 0x7f8750068780 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f8754004630 tx=0x7f8754009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:11:58.989 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:58.991+0000 7f875b7fe700 1 -- 172.21.15.26:0/2379670061 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f874c052f50 con 0x7f87640f55c0 2021-11-03T17:11:59.193 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:59.199+0000 7f87691ad700 1 -- 172.21.15.26:0/2379670061 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f87640fce50 con 0x7f87640f55c0 2021-11-03T17:11:59.194 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:59.199+0000 7f875b7fe700 1 -- 172.21.15.26:0/2379670061 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f874c052b40 con 0x7f87640f55c0 2021-11-03T17:11:59.194 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:11:59.195 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:11:59.195 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:11:59.195 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:11:59.195 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:11:59.195 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:11:59.196 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:11:59.196 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:11:59.196 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:11:59.196 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:11:59.197 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:11:59.197 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:11:59.197 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:11:59.197 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:11:59.197 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:11:59.198 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:11:59.198 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:11:59.198 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:11:59.199 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:11:59.199 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:11:59.200 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:11:59.200 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:11:59.200 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:11:59.200 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:11:59.201 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:11:59.201 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:11:59.201 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:11:59.202 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:11:59.202 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:11:59.202 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:11:59.202 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:11:59.203 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:11:59.203 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:11:59.203 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:11:59.203 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:11:59.204 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:11:59.204 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:11:59.204 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:11:59.204 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:11:59.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:59.201+0000 7f87691ad700 1 -- 172.21.15.26:0/2379670061 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f87500662c0 msgr2=0x7f8750068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:11:59.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:59.201+0000 7f87691ad700 1 --2- 172.21.15.26:0/2379670061 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f87500662c0 0x7f8750068780 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f8754004630 tx=0x7f8754009b30).stop 2021-11-03T17:11:59.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:59.201+0000 7f87691ad700 1 -- 172.21.15.26:0/2379670061 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87640f55c0 msgr2=0x7f8764104db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:11:59.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:59.201+0000 7f87691ad700 1 --2- 172.21.15.26:0/2379670061 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87640f55c0 0x7f8764104db0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f874c00b410 tx=0x7f874c006ef0).stop 2021-11-03T17:11:59.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:59.201+0000 7f87691ad700 1 -- 172.21.15.26:0/2379670061 shutdown_connections 2021-11-03T17:11:59.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:59.201+0000 7f87691ad700 1 --2- 172.21.15.26:0/2379670061 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f87500662c0 0x7f8750068780 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:59.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:59.201+0000 7f87691ad700 1 --2- 172.21.15.26:0/2379670061 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87640f55c0 0x7f8764104db0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:59.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:59.201+0000 7f87691ad700 1 --2- 172.21.15.26:0/2379670061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87640f5ed0 0x7f87641052a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:11:59.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:59.201+0000 7f87691ad700 1 -- 172.21.15.26:0/2379670061 >> 172.21.15.26:0/2379670061 conn(0x7f87640f0de0 msgr2=0x7f87640fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:11:59.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:59.201+0000 7f87691ad700 1 -- 172.21.15.26:0/2379670061 shutdown_connections 2021-11-03T17:11:59.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:11:59.201+0000 7f87691ad700 1 -- 172.21.15.26:0/2379670061 wait complete. 2021-11-03T17:11:59.208 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:11:59.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:59 smithi194 ceph-mon[65619]: from='client.34684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:11:59.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:59 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/856786227' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:11:59.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:11:59 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2379670061' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:11:59.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:59 smithi026 ceph-mon[96795]: from='client.34684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:11:59.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:59 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/856786227' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:11:59.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:11:59 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2379670061' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:12:00.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:00 smithi194 ceph-mon[65619]: from='client.34688 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:12:00.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:00 smithi194 ceph-mon[65619]: pgmap v520: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:00.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:00 smithi026 ceph-mon[96795]: from='client.34688 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:12:00.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:00 smithi026 ceph-mon[96795]: pgmap v520: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:02.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:02 smithi194 ceph-mon[65619]: pgmap v521: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:02.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:02 smithi026 ceph-mon[96795]: pgmap v521: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:04.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:04 smithi194 ceph-mon[65619]: pgmap v522: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:04.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:04 smithi026 ceph-mon[96795]: pgmap v522: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:06.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:06 smithi194 ceph-mon[65619]: pgmap v523: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:06.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:06 smithi026 ceph-mon[96795]: pgmap v523: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:08.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:08 smithi194 ceph-mon[65619]: pgmap v524: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:08.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:08 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:12:08.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:08 smithi026 ceph-mon[96795]: pgmap v524: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:08.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:08 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:12:09.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:09 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:12:09.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:09 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:12:10.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:10 smithi194 ceph-mon[65619]: pgmap v525: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:10.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:10 smithi026 ceph-mon[96795]: pgmap v525: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:12.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:12 smithi194 ceph-mon[65619]: pgmap v526: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:12.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:12 smithi026 ceph-mon[96795]: pgmap v526: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:14.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:14 smithi026 ceph-mon[96795]: pgmap v527: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:14.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:14 smithi194 ceph-mon[65619]: pgmap v527: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:16.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:16 smithi026 ceph-mon[96795]: pgmap v528: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:16.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:16 smithi194 ceph-mon[65619]: pgmap v528: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:18.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:18 smithi026 ceph-mon[96795]: pgmap v529: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:18.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:18 smithi194 ceph-mon[65619]: pgmap v529: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:20.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:20 smithi026 ceph-mon[96795]: pgmap v530: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:20.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:20 smithi194 ceph-mon[65619]: pgmap v530: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:22.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:22 smithi026 ceph-mon[96795]: pgmap v531: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:22.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:22 smithi194 ceph-mon[65619]: pgmap v531: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:23.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:23 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:12:23.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:23 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:12:24.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:24 smithi026 ceph-mon[96795]: pgmap v532: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:24.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:24 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:12:24.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:24 smithi194 ceph-mon[65619]: pgmap v532: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:24.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:24 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:12:26.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:26 smithi026 ceph-mon[96795]: pgmap v533: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:26.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:26 smithi194 ceph-mon[65619]: pgmap v533: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:28.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:28 smithi026 ceph-mon[96795]: pgmap v534: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:28.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:28 smithi194 ceph-mon[65619]: pgmap v534: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:29.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.316+0000 7fcb1badc700 1 -- 172.21.15.26:0/591414345 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb140f6ff0 msgr2=0x7fcb140f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:12:29.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.316+0000 7fcb1badc700 1 --2- 172.21.15.26:0/591414345 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb140f6ff0 0x7fcb140f7a20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7fcb04004660 tx=0x7fcb04009b30).stop 2021-11-03T17:12:29.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.316+0000 7fcb1badc700 1 -- 172.21.15.26:0/591414345 shutdown_connections 2021-11-03T17:12:29.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.316+0000 7fcb1badc700 1 --2- 172.21.15.26:0/591414345 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb140f6ff0 0x7fcb140f7a20 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:12:29.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.316+0000 7fcb1badc700 1 --2- 172.21.15.26:0/591414345 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb140f66e0 0x7fcb140f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:12:29.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.316+0000 7fcb1badc700 1 -- 172.21.15.26:0/591414345 >> 172.21.15.26:0/591414345 conn(0x7fcb140f1f00 msgr2=0x7fcb140f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:12:29.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.316+0000 7fcb1badc700 1 -- 172.21.15.26:0/591414345 shutdown_connections 2021-11-03T17:12:29.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.316+0000 7fcb1badc700 1 -- 172.21.15.26:0/591414345 wait complete. 2021-11-03T17:12:29.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.317+0000 7fcb1badc700 1 Processor -- start 2021-11-03T17:12:29.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.317+0000 7fcb1badc700 1 -- start start 2021-11-03T17:12:29.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.317+0000 7fcb1badc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb140f66e0 0x7fcb14109170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:12:29.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.317+0000 7fcb1badc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb140f6ff0 0x7fcb14109660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:12:29.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.317+0000 7fcb1badc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb14109c10 con 0x7fcb140f66e0 2021-11-03T17:12:29.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.317+0000 7fcb1badc700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb14109d50 con 0x7fcb140f6ff0 2021-11-03T17:12:29.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.317+0000 7fcb19878700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb140f66e0 0x7fcb14109170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:12:29.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.317+0000 7fcb19878700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb140f66e0 0x7fcb14109170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53096/0 (socket says 172.21.15.26:53096) 2021-11-03T17:12:29.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.317+0000 7fcb19878700 1 -- 172.21.15.26:0/2514397571 learned_addr learned my addr 172.21.15.26:0/2514397571 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:12:29.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.317+0000 7fcb19077700 1 --2- 172.21.15.26:0/2514397571 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb140f6ff0 0x7fcb14109660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:12:29.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.317+0000 7fcb19878700 1 -- 172.21.15.26:0/2514397571 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb140f6ff0 msgr2=0x7fcb14109660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:12:29.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.317+0000 7fcb19878700 1 --2- 172.21.15.26:0/2514397571 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb140f6ff0 0x7fcb14109660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:12:29.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.317+0000 7fcb19878700 1 -- 172.21.15.26:0/2514397571 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb04005040 con 0x7fcb140f66e0 2021-11-03T17:12:29.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.317+0000 7fcb19878700 1 --2- 172.21.15.26:0/2514397571 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb140f66e0 0x7fcb14109170 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7fcb100026d0 tx=0x7fcb10009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:12:29.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.318+0000 7fcb0a7fc700 1 -- 172.21.15.26:0/2514397571 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb10009320 con 0x7fcb140f66e0 2021-11-03T17:12:29.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.318+0000 7fcb1badc700 1 -- 172.21.15.26:0/2514397571 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb1410a6f0 con 0x7fcb140f66e0 2021-11-03T17:12:29.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.318+0000 7fcb0a7fc700 1 -- 172.21.15.26:0/2514397571 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcb1000f040 con 0x7fcb140f66e0 2021-11-03T17:12:29.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.318+0000 7fcb0a7fc700 1 -- 172.21.15.26:0/2514397571 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb100147e0 con 0x7fcb140f66e0 2021-11-03T17:12:29.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.318+0000 7fcb1badc700 1 -- 172.21.15.26:0/2514397571 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb1410acb0 con 0x7fcb140f66e0 2021-11-03T17:12:29.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.319+0000 7fcb1badc700 1 -- 172.21.15.26:0/2514397571 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb14045ad0 con 0x7fcb140f66e0 2021-11-03T17:12:29.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.319+0000 7fcb0a7fc700 1 -- 172.21.15.26:0/2514397571 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fcb10009480 con 0x7fcb140f66e0 2021-11-03T17:12:29.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.320+0000 7fcb0a7fc700 1 --2- 172.21.15.26:0/2514397571 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcb000640b0 0x7fcb00066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:12:29.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.320+0000 7fcb0a7fc700 1 -- 172.21.15.26:0/2514397571 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fcb10080ee0 con 0x7fcb140f66e0 2021-11-03T17:12:29.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.320+0000 7fcb19077700 1 --2- 172.21.15.26:0/2514397571 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcb000640b0 0x7fcb00066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:12:29.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.320+0000 7fcb19077700 1 --2- 172.21.15.26:0/2514397571 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcb000640b0 0x7fcb00066570 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fcb04004630 tx=0x7fcb04009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:12:29.323 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.324+0000 7fcb0a7fc700 1 -- 172.21.15.26:0/2514397571 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fcb10053240 con 0x7fcb140f66e0 2021-11-03T17:12:29.502 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.507+0000 7fcb1badc700 1 -- 172.21.15.26:0/2514397571 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb1410af90 con 0x7fcb000640b0 2021-11-03T17:12:29.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.508+0000 7fcb0a7fc700 1 -- 172.21.15.26:0/2514397571 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fcb1410af90 con 0x7fcb000640b0 2021-11-03T17:12:29.505 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.510+0000 7fcb1badc700 1 -- 172.21.15.26:0/2514397571 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcb000640b0 msgr2=0x7fcb00066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:12:29.506 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.510+0000 7fcb1badc700 1 --2- 172.21.15.26:0/2514397571 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcb000640b0 0x7fcb00066570 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fcb04004630 tx=0x7fcb04009b30).stop 2021-11-03T17:12:29.506 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.510+0000 7fcb1badc700 1 -- 172.21.15.26:0/2514397571 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb140f66e0 msgr2=0x7fcb14109170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:12:29.506 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.510+0000 7fcb1badc700 1 --2- 172.21.15.26:0/2514397571 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb140f66e0 0x7fcb14109170 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7fcb100026d0 tx=0x7fcb10009de0).stop 2021-11-03T17:12:29.506 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.510+0000 7fcb1badc700 1 -- 172.21.15.26:0/2514397571 shutdown_connections 2021-11-03T17:12:29.507 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.510+0000 7fcb1badc700 1 --2- 172.21.15.26:0/2514397571 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcb000640b0 0x7fcb00066570 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:12:29.507 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.510+0000 7fcb1badc700 1 --2- 172.21.15.26:0/2514397571 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb140f66e0 0x7fcb14109170 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:12:29.507 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.510+0000 7fcb1badc700 1 --2- 172.21.15.26:0/2514397571 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb140f6ff0 0x7fcb14109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:12:29.507 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.510+0000 7fcb1badc700 1 -- 172.21.15.26:0/2514397571 >> 172.21.15.26:0/2514397571 conn(0x7fcb140f1f00 msgr2=0x7fcb1406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:12:29.508 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.510+0000 7fcb1badc700 1 -- 172.21.15.26:0/2514397571 shutdown_connections 2021-11-03T17:12:29.508 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.510+0000 7fcb1badc700 1 -- 172.21.15.26:0/2514397571 wait complete. 2021-11-03T17:12:29.515 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:12:29.607 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.610+0000 7fea90009700 1 -- 172.21.15.26:0/2744054511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea880f66e0 msgr2=0x7fea880f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:12:29.607 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.610+0000 7fea90009700 1 --2- 172.21.15.26:0/2744054511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea880f66e0 0x7fea880f6b00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7fea800099e0 tx=0x7fea80004d10).stop 2021-11-03T17:12:29.608 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.610+0000 7fea90009700 1 -- 172.21.15.26:0/2744054511 shutdown_connections 2021-11-03T17:12:29.608 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.610+0000 7fea90009700 1 --2- 172.21.15.26:0/2744054511 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea880f7980 0x7fea880f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:12:29.608 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.610+0000 7fea90009700 1 --2- 172.21.15.26:0/2744054511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea880f66e0 0x7fea880f6b00 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:12:29.608 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.610+0000 7fea90009700 1 -- 172.21.15.26:0/2744054511 >> 172.21.15.26:0/2744054511 conn(0x7fea880f1e40 msgr2=0x7fea880f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:12:29.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.610+0000 7fea90009700 1 -- 172.21.15.26:0/2744054511 shutdown_connections 2021-11-03T17:12:29.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.610+0000 7fea90009700 1 -- 172.21.15.26:0/2744054511 wait complete. 2021-11-03T17:12:29.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.610+0000 7fea90009700 1 Processor -- start 2021-11-03T17:12:29.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.610+0000 7fea90009700 1 -- start start 2021-11-03T17:12:29.610 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.611+0000 7fea90009700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea880f66e0 0x7fea8806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:12:29.610 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.611+0000 7fea90009700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea880f7980 0x7fea88069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:12:29.610 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.611+0000 7fea90009700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea8806a380 con 0x7fea880f7980 2021-11-03T17:12:29.610 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.611+0000 7fea90009700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea8806a4c0 con 0x7fea880f66e0 2021-11-03T17:12:29.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.611+0000 7fea8d5a4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea880f7980 0x7fea88069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:12:29.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.611+0000 7fea8d5a4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea880f7980 0x7fea88069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53108/0 (socket says 172.21.15.26:53108) 2021-11-03T17:12:29.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.611+0000 7fea8d5a4700 1 -- 172.21.15.26:0/1370252165 learned_addr learned my addr 172.21.15.26:0/1370252165 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:12:29.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.611+0000 7fea8dda5700 1 --2- 172.21.15.26:0/1370252165 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea880f66e0 0x7fea8806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:12:29.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.611+0000 7fea8d5a4700 1 -- 172.21.15.26:0/1370252165 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea880f66e0 msgr2=0x7fea8806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:12:29.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.611+0000 7fea8d5a4700 1 --2- 172.21.15.26:0/1370252165 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea880f66e0 0x7fea8806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:12:29.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.611+0000 7fea8d5a4700 1 -- 172.21.15.26:0/1370252165 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea80009640 con 0x7fea880f7980 2021-11-03T17:12:29.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.611+0000 7fea8d5a4700 1 --2- 172.21.15.26:0/1370252165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea880f7980 0x7fea88069e20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7fea780026d0 tx=0x7fea78009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:12:29.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.611+0000 7fea7e7fc700 1 -- 172.21.15.26:0/1370252165 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea78009320 con 0x7fea880f7980 2021-11-03T17:12:29.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.611+0000 7fea90009700 1 -- 172.21.15.26:0/1370252165 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea8806a7a0 con 0x7fea880f7980 2021-11-03T17:12:29.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.611+0000 7fea7e7fc700 1 -- 172.21.15.26:0/1370252165 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fea7800f040 con 0x7fea880f7980 2021-11-03T17:12:29.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.611+0000 7fea7e7fc700 1 -- 172.21.15.26:0/1370252165 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea780147e0 con 0x7fea880f7980 2021-11-03T17:12:29.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.611+0000 7fea90009700 1 -- 172.21.15.26:0/1370252165 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea8810f100 con 0x7fea880f7980 2021-11-03T17:12:29.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.612+0000 7fea90009700 1 -- 172.21.15.26:0/1370252165 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea88045ad0 con 0x7fea880f7980 2021-11-03T17:12:29.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.613+0000 7fea7e7fc700 1 -- 172.21.15.26:0/1370252165 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fea78009480 con 0x7fea880f7980 2021-11-03T17:12:29.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.613+0000 7fea7e7fc700 1 --2- 172.21.15.26:0/1370252165 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fea740640b0 0x7fea74066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:12:29.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.613+0000 7fea7e7fc700 1 -- 172.21.15.26:0/1370252165 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fea78080e10 con 0x7fea880f7980 2021-11-03T17:12:29.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.613+0000 7fea8dda5700 1 --2- 172.21.15.26:0/1370252165 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fea740640b0 0x7fea74066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:12:29.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.614+0000 7fea8dda5700 1 --2- 172.21.15.26:0/1370252165 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fea740640b0 0x7fea74066570 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fea8000b730 tx=0x7fea80004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:12:29.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.617+0000 7fea7e7fc700 1 -- 172.21.15.26:0/1370252165 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fea78053230 con 0x7fea880f7980 2021-11-03T17:12:29.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.789+0000 7fea90009700 1 -- 172.21.15.26:0/1370252165 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fea880ff010 con 0x7fea740640b0 2021-11-03T17:12:29.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.804+0000 7fea7e7fc700 1 -- 172.21.15.26:0/1370252165 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fea880ff010 con 0x7fea740640b0 2021-11-03T17:12:29.799 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:12:29.800 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (23m) 3m ago 25m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:12:29.800 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (15m) 3m ago 24m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:12:29.800 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (15m) 2m ago 24m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:12:29.800 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (23m) 3m ago 24m 39.5M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:12:29.801 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (16m) 3m ago 20m 16.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:12:29.801 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (17m) 3m ago 20m 17.8M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:12:29.801 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (20m) 2m ago 20m 19.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:12:29.801 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (20m) 2m ago 20m 19.4M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:12:29.802 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (17m) 3m ago 26m 491M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:12:29.802 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (17m) 2m ago 24m 415M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:12:29.802 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (16m) 3m ago 26m 113M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:12:29.802 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (16m) 2m ago 24m 70.2M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:12:29.802 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (24m) 3m ago 24m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:12:29.803 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (23m) 2m ago 23m 18.4M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:12:29.803 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (15m) 3m ago 23m 190M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:12:29.803 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (15m) 3m ago 23m 204M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:12:29.803 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (14m) 3m ago 22m 170M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:12:29.804 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (14m) 2m ago 22m 211M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:12:29.804 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (13m) 2m ago 22m 189M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:12:29.804 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (13m) 2m ago 21m 174M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:12:29.804 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (23m) 3m ago 24m 49.9M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:12:29.805 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.805+0000 7fea90009700 1 -- 172.21.15.26:0/1370252165 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fea740640b0 msgr2=0x7fea74066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:12:29.805 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.805+0000 7fea90009700 1 --2- 172.21.15.26:0/1370252165 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fea740640b0 0x7fea74066570 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fea8000b730 tx=0x7fea80004d10).stop 2021-11-03T17:12:29.806 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.805+0000 7fea90009700 1 -- 172.21.15.26:0/1370252165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea880f7980 msgr2=0x7fea88069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:12:29.806 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.805+0000 7fea90009700 1 --2- 172.21.15.26:0/1370252165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea880f7980 0x7fea88069e20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7fea780026d0 tx=0x7fea78009de0).stop 2021-11-03T17:12:29.806 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.805+0000 7fea90009700 1 -- 172.21.15.26:0/1370252165 shutdown_connections 2021-11-03T17:12:29.806 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.805+0000 7fea90009700 1 --2- 172.21.15.26:0/1370252165 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fea740640b0 0x7fea74066570 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:12:29.807 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.805+0000 7fea90009700 1 --2- 172.21.15.26:0/1370252165 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea880f66e0 0x7fea8806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:12:29.807 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.805+0000 7fea90009700 1 --2- 172.21.15.26:0/1370252165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea880f7980 0x7fea88069e20 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:12:29.807 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.805+0000 7fea90009700 1 -- 172.21.15.26:0/1370252165 >> 172.21.15.26:0/1370252165 conn(0x7fea880f1e40 msgr2=0x7fea880fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:12:29.807 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.805+0000 7fea90009700 1 -- 172.21.15.26:0/1370252165 shutdown_connections 2021-11-03T17:12:29.808 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.806+0000 7fea90009700 1 -- 172.21.15.26:0/1370252165 wait complete. 2021-11-03T17:12:29.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.904+0000 7fed34d86700 1 -- 172.21.15.26:0/2521500843 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed300f6530 msgr2=0x7fed300f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:12:29.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.904+0000 7fed34d86700 1 --2- 172.21.15.26:0/2521500843 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed300f6530 0x7fed300f6950 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fed20004660 tx=0x7fed20009b30).stop 2021-11-03T17:12:29.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.904+0000 7fed34d86700 1 -- 172.21.15.26:0/2521500843 shutdown_connections 2021-11-03T17:12:29.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.904+0000 7fed34d86700 1 --2- 172.21.15.26:0/2521500843 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed300f77d0 0x7fed300f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:12:29.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.904+0000 7fed34d86700 1 --2- 172.21.15.26:0/2521500843 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed300f6530 0x7fed300f6950 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:12:29.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.904+0000 7fed34d86700 1 -- 172.21.15.26:0/2521500843 >> 172.21.15.26:0/2521500843 conn(0x7fed300f1cd0 msgr2=0x7fed300f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:12:29.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.904+0000 7fed34d86700 1 -- 172.21.15.26:0/2521500843 shutdown_connections 2021-11-03T17:12:29.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.904+0000 7fed34d86700 1 -- 172.21.15.26:0/2521500843 wait complete. 2021-11-03T17:12:29.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.905+0000 7fed34d86700 1 Processor -- start 2021-11-03T17:12:29.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.905+0000 7fed34d86700 1 -- start start 2021-11-03T17:12:29.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.905+0000 7fed34d86700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed300f6530 0x7fed30106d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:12:29.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.905+0000 7fed34d86700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed300f77d0 0x7fed30107260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:12:29.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.905+0000 7fed34d86700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed30107860 con 0x7fed300f6530 2021-11-03T17:12:29.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.905+0000 7fed34d86700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed30108070 con 0x7fed300f77d0 2021-11-03T17:12:29.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.905+0000 7fed2f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed300f6530 0x7fed30106d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:12:29.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.905+0000 7fed2f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed300f6530 0x7fed30106d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53116/0 (socket says 172.21.15.26:53116) 2021-11-03T17:12:29.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.905+0000 7fed2f7fe700 1 -- 172.21.15.26:0/2816614616 learned_addr learned my addr 172.21.15.26:0/2816614616 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:12:29.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.906+0000 7fed2f7fe700 1 -- 172.21.15.26:0/2816614616 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed300f77d0 msgr2=0x7fed30107260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:12:29.906 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.906+0000 7fed2f7fe700 1 --2- 172.21.15.26:0/2816614616 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed300f77d0 0x7fed30107260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:12:29.906 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.906+0000 7fed2f7fe700 1 -- 172.21.15.26:0/2816614616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed20005040 con 0x7fed300f6530 2021-11-03T17:12:29.906 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.906+0000 7fed2f7fe700 1 --2- 172.21.15.26:0/2816614616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed300f6530 0x7fed30106d70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7fed20013a70 tx=0x7fed20009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:12:29.906 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.906+0000 7fed17fff700 1 -- 172.21.15.26:0/2816614616 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed20018070 con 0x7fed300f6530 2021-11-03T17:12:29.907 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.906+0000 7fed17fff700 1 -- 172.21.15.26:0/2816614616 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fed200097d0 con 0x7fed300f6530 2021-11-03T17:12:29.907 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.906+0000 7fed34d86700 1 -- 172.21.15.26:0/2816614616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed30108290 con 0x7fed300f6530 2021-11-03T17:12:29.907 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.906+0000 7fed17fff700 1 -- 172.21.15.26:0/2816614616 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed2001c3c0 con 0x7fed300f6530 2021-11-03T17:12:29.907 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.906+0000 7fed34d86700 1 -- 172.21.15.26:0/2816614616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed301087f0 con 0x7fed300f6530 2021-11-03T17:12:29.908 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.907+0000 7fed34d86700 1 -- 172.21.15.26:0/2816614616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed30059100 con 0x7fed300f6530 2021-11-03T17:12:29.909 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.907+0000 7fed17fff700 1 -- 172.21.15.26:0/2816614616 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fed20007ba0 con 0x7fed300f6530 2021-11-03T17:12:29.909 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.908+0000 7fed17fff700 1 --2- 172.21.15.26:0/2816614616 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fed18064100 0x7fed180665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:12:29.909 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.908+0000 7fed17fff700 1 -- 172.21.15.26:0/2816614616 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fed200824b0 con 0x7fed300f6530 2021-11-03T17:12:29.909 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.908+0000 7fed2effd700 1 --2- 172.21.15.26:0/2816614616 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fed18064100 0x7fed180665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:12:29.909 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.908+0000 7fed2effd700 1 --2- 172.21.15.26:0/2816614616 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fed18064100 0x7fed180665c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fed24009880 tx=0x7fed24009a60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:12:29.910 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:29.912+0000 7fed17fff700 1 -- 172.21.15.26:0/2816614616 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fed20054810 con 0x7fed300f6530 2021-11-03T17:12:30.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.142+0000 7fed34d86700 1 -- 172.21.15.26:0/2816614616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fed300fedc0 con 0x7fed300f6530 2021-11-03T17:12:30.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.143+0000 7fed17fff700 1 -- 172.21.15.26:0/2816614616 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fed20054400 con 0x7fed300f6530 2021-11-03T17:12:30.139 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:12:30.139 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:12:30.139 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:12:30.139 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:12:30.140 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:12:30.140 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:12:30.140 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:12:30.140 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:12:30.141 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:12:30.141 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:12:30.141 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:12:30.141 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:12:30.141 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:12:30.142 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:12:30.142 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:12:30.142 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:12:30.142 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:12:30.143 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:12:30.143 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.144+0000 7fed34d86700 1 -- 172.21.15.26:0/2816614616 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fed18064100 msgr2=0x7fed180665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:12:30.144 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.144+0000 7fed34d86700 1 --2- 172.21.15.26:0/2816614616 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fed18064100 0x7fed180665c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fed24009880 tx=0x7fed24009a60).stop 2021-11-03T17:12:30.144 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.144+0000 7fed34d86700 1 -- 172.21.15.26:0/2816614616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed300f6530 msgr2=0x7fed30106d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:12:30.144 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.144+0000 7fed34d86700 1 --2- 172.21.15.26:0/2816614616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed300f6530 0x7fed30106d70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7fed20013a70 tx=0x7fed20009b30).stop 2021-11-03T17:12:30.144 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.144+0000 7fed34d86700 1 -- 172.21.15.26:0/2816614616 shutdown_connections 2021-11-03T17:12:30.145 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.144+0000 7fed34d86700 1 --2- 172.21.15.26:0/2816614616 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fed18064100 0x7fed180665c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:12:30.145 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.144+0000 7fed34d86700 1 --2- 172.21.15.26:0/2816614616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed300f6530 0x7fed30106d70 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:12:30.145 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.144+0000 7fed34d86700 1 --2- 172.21.15.26:0/2816614616 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed300f77d0 0x7fed30107260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:12:30.145 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.144+0000 7fed34d86700 1 -- 172.21.15.26:0/2816614616 >> 172.21.15.26:0/2816614616 conn(0x7fed300f1cd0 msgr2=0x7fed300fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:12:30.145 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.145+0000 7fed34d86700 1 -- 172.21.15.26:0/2816614616 shutdown_connections 2021-11-03T17:12:30.146 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.145+0000 7fed34d86700 1 -- 172.21.15.26:0/2816614616 wait complete. 2021-11-03T17:12:30.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.248+0000 7f3366aeb700 1 -- 172.21.15.26:0/3869010834 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3360060250 msgr2=0x7f33600f91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:12:30.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.248+0000 7f3366aeb700 1 --2- 172.21.15.26:0/3869010834 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3360060250 0x7f33600f91e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f335c004660 tx=0x7f335c009b30).stop 2021-11-03T17:12:30.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.248+0000 7f3366aeb700 1 -- 172.21.15.26:0/3869010834 shutdown_connections 2021-11-03T17:12:30.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.248+0000 7f3366aeb700 1 --2- 172.21.15.26:0/3869010834 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33600f96d0 0x7f33600fbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:12:30.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.248+0000 7f3366aeb700 1 --2- 172.21.15.26:0/3869010834 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3360060250 0x7f33600f91e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:12:30.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.248+0000 7f3366aeb700 1 -- 172.21.15.26:0/3869010834 >> 172.21.15.26:0/3869010834 conn(0x7f33600f0ba0 msgr2=0x7f33600f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:12:30.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.248+0000 7f3366aeb700 1 -- 172.21.15.26:0/3869010834 shutdown_connections 2021-11-03T17:12:30.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.248+0000 7f3366aeb700 1 -- 172.21.15.26:0/3869010834 wait complete. 2021-11-03T17:12:30.247 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.248+0000 7f3366aeb700 1 Processor -- start 2021-11-03T17:12:30.247 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.248+0000 7f3366aeb700 1 -- start start 2021-11-03T17:12:30.247 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.248+0000 7f3366aeb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3360060250 0x7f3360106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:12:30.247 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.248+0000 7f3366aeb700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33600f96d0 0x7f3360107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:12:30.248 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.248+0000 7f3366aeb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3360107870 con 0x7f3360060250 2021-11-03T17:12:30.248 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.248+0000 7f3366aeb700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3360108080 con 0x7f33600f96d0 2021-11-03T17:12:30.248 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.249+0000 7f3365ae9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3360060250 0x7f3360106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:12:30.248 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.249+0000 7f3365ae9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3360060250 0x7f3360106d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53126/0 (socket says 172.21.15.26:53126) 2021-11-03T17:12:30.248 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.249+0000 7f3365ae9700 1 -- 172.21.15.26:0/3293871100 learned_addr learned my addr 172.21.15.26:0/3293871100 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:12:30.249 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.249+0000 7f3365ae9700 1 -- 172.21.15.26:0/3293871100 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33600f96d0 msgr2=0x7f3360107270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:12:30.249 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.249+0000 7f3365ae9700 1 --2- 172.21.15.26:0/3293871100 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33600f96d0 0x7f3360107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:12:30.249 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.249+0000 7f3365ae9700 1 -- 172.21.15.26:0/3293871100 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f335c005040 con 0x7f3360060250 2021-11-03T17:12:30.249 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.249+0000 7f3365ae9700 1 --2- 172.21.15.26:0/3293871100 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3360060250 0x7f3360106d80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f335c000c00 tx=0x7f335c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:12:30.250 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.249+0000 7f33567fc700 1 -- 172.21.15.26:0/3293871100 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f335c019070 con 0x7f3360060250 2021-11-03T17:12:30.250 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.249+0000 7f33567fc700 1 -- 172.21.15.26:0/3293871100 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f335c007e70 con 0x7f3360060250 2021-11-03T17:12:30.250 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.249+0000 7f3366aeb700 1 -- 172.21.15.26:0/3293871100 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33601082a0 con 0x7f3360060250 2021-11-03T17:12:30.250 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.249+0000 7f33567fc700 1 -- 172.21.15.26:0/3293871100 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f335c014d90 con 0x7f3360060250 2021-11-03T17:12:30.251 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.249+0000 7f3366aeb700 1 -- 172.21.15.26:0/3293871100 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3360108800 con 0x7f3360060250 2021-11-03T17:12:30.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.250+0000 7f3366aeb700 1 -- 172.21.15.26:0/3293871100 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3360059100 con 0x7f3360060250 2021-11-03T17:12:30.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.250+0000 7f33567fc700 1 -- 172.21.15.26:0/3293871100 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f335c025070 con 0x7f3360060250 2021-11-03T17:12:30.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.251+0000 7f33567fc700 1 --2- 172.21.15.26:0/3293871100 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f334c064100 0x7f334c0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:12:30.253 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.251+0000 7f33567fc700 1 -- 172.21.15.26:0/3293871100 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f335c0817a0 con 0x7f3360060250 2021-11-03T17:12:30.253 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.251+0000 7f33652e8700 1 --2- 172.21.15.26:0/3293871100 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f334c064100 0x7f334c0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:12:30.253 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.251+0000 7f33652e8700 1 --2- 172.21.15.26:0/3293871100 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f334c064100 0x7f334c0665c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f3360060020 tx=0x7f335000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:12:30.253 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.255+0000 7f33567fc700 1 -- 172.21.15.26:0/3293871100 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f335c053b00 con 0x7f3360060250 2021-11-03T17:12:30.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.462+0000 7f3366aeb700 1 -- 172.21.15.26:0/3293871100 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f33600fee90 con 0x7f3360060250 2021-11-03T17:12:30.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.463+0000 7f33567fc700 1 -- 172.21.15.26:0/3293871100 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f335c023020 con 0x7f3360060250 2021-11-03T17:12:30.459 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:12:30.459 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:12:30.459 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:12:30.460 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:12:30.460 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:12:30.460 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:12:30.460 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:12:30.460 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:12:30.461 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:12:30.461 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:12:30.461 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:12:30.461 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:12:30.462 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:12:30.462 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:12:30.462 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:12:30.462 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:12:30.463 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:12:30.463 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:12:30.463 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:12:30.463 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:12:30.463 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:12:30.464 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:12:30.464 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:12:30.464 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:12:30.464 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:12:30.465 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:12:30.465 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:12:30.465 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:12:30.465 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:12:30.465 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:12:30.466 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:12:30.466 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:12:30.466 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:12:30.466 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:12:30.467 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:12:30.467 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:12:30.467 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:12:30.467 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:12:30.468 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:12:30.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.464+0000 7f3366aeb700 1 -- 172.21.15.26:0/3293871100 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f334c064100 msgr2=0x7f334c0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:12:30.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.464+0000 7f3366aeb700 1 --2- 172.21.15.26:0/3293871100 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f334c064100 0x7f334c0665c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f3360060020 tx=0x7f335000b040).stop 2021-11-03T17:12:30.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.464+0000 7f3366aeb700 1 -- 172.21.15.26:0/3293871100 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3360060250 msgr2=0x7f3360106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:12:30.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.464+0000 7f3366aeb700 1 --2- 172.21.15.26:0/3293871100 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3360060250 0x7f3360106d80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f335c000c00 tx=0x7f335c00b040).stop 2021-11-03T17:12:30.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.464+0000 7f3366aeb700 1 -- 172.21.15.26:0/3293871100 shutdown_connections 2021-11-03T17:12:30.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.464+0000 7f3366aeb700 1 --2- 172.21.15.26:0/3293871100 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f334c064100 0x7f334c0665c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:12:30.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.464+0000 7f3366aeb700 1 --2- 172.21.15.26:0/3293871100 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3360060250 0x7f3360106d80 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:12:30.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.464+0000 7f3366aeb700 1 --2- 172.21.15.26:0/3293871100 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33600f96d0 0x7f3360107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:12:30.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.464+0000 7f3366aeb700 1 -- 172.21.15.26:0/3293871100 >> 172.21.15.26:0/3293871100 conn(0x7f33600f0ba0 msgr2=0x7f33600f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:12:30.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.465+0000 7f3366aeb700 1 -- 172.21.15.26:0/3293871100 shutdown_connections 2021-11-03T17:12:30.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:12:30.465+0000 7f3366aeb700 1 -- 172.21.15.26:0/3293871100 wait complete. 2021-11-03T17:12:30.471 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:12:30.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:30 smithi026 ceph-mon[96795]: pgmap v535: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:30.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:30 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2816614616' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:12:30.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:30 smithi194 ceph-mon[65619]: pgmap v535: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:30.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:30 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2816614616' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:12:31.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:31 smithi026 ceph-mon[96795]: from='client.34700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:12:31.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:31 smithi026 ceph-mon[96795]: from='client.34704 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:12:31.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:31 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3293871100' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:12:31.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:31 smithi194 ceph-mon[65619]: from='client.34700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:12:31.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:31 smithi194 ceph-mon[65619]: from='client.34704 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:12:31.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:31 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3293871100' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:12:32.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:32 smithi026 ceph-mon[96795]: pgmap v536: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:32.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:32 smithi194 ceph-mon[65619]: pgmap v536: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:34.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:34 smithi026 ceph-mon[96795]: pgmap v537: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:34.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:34 smithi194 ceph-mon[65619]: pgmap v537: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:36.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:36 smithi026 ceph-mon[96795]: pgmap v538: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:36.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:36 smithi194 ceph-mon[65619]: pgmap v538: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:38.591 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:38 smithi194 ceph-mon[65619]: pgmap v539: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:38.591 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:38 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:12:38.606 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:38 smithi026 ceph-mon[96795]: pgmap v539: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:38.607 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:38 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:12:39.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:39 smithi026 ceph-mon[96795]: poll took 60060.089 ms: 1 events 2021-11-03T17:12:39.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:12:39.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:12:39.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:12:39.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:12:39.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:12:39.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:12:39.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:12:39.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:39 smithi194 ceph-mon[65619]: poll took 60060.089 ms: 1 events 2021-11-03T17:12:39.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:12:39.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:12:39.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:12:39.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:12:39.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:12:39.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:12:39.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:12:40.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:40 smithi026 ceph-mon[96795]: pgmap v540: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:40.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:40 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:12:40.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:40 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:12:40.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:40 smithi194 ceph-mon[65619]: pgmap v540: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:40.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:40 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:12:40.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:40 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:12:42.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:42 smithi026 ceph-mon[96795]: pgmap v541: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:42.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:42 smithi194 ceph-mon[65619]: pgmap v541: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:44.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:44 smithi026 ceph-mon[96795]: pgmap v542: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:44.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:44 smithi194 ceph-mon[65619]: pgmap v542: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:46.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:46 smithi026 ceph-mon[96795]: pgmap v543: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:46.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:46 smithi194 ceph-mon[65619]: pgmap v543: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:48 smithi026 ceph-mon[96795]: pgmap v544: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:48.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:12:48.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:12:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:48 smithi194 ceph-mon[65619]: pgmap v544: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:12:48.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:12:50.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:50 smithi026 ceph-mon[96795]: pgmap v545: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:50.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:50 smithi194 ceph-mon[65619]: pgmap v545: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:52.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:52 smithi026 ceph-mon[96795]: pgmap v546: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:52.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:52 smithi194 ceph-mon[65619]: pgmap v546: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:54.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:54 smithi026 ceph-mon[96795]: pgmap v547: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:54.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:12:54.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:54 smithi194 ceph-mon[65619]: pgmap v547: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:54.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:12:55.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:55 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:12:55.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:55 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:12:56.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:56 smithi026 ceph-mon[96795]: pgmap v548: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:56.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:56 smithi194 ceph-mon[65619]: pgmap v548: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:58.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:12:58 smithi026 ceph-mon[96795]: pgmap v549: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:12:58.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:12:58 smithi194 ceph-mon[65619]: pgmap v549: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:00.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.580+0000 7f0da0c69700 1 -- 172.21.15.26:0/318376086 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d9c0f5fe0 msgr2=0x7f0d9c0f6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:13:00.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.580+0000 7f0da0c69700 1 --2- 172.21.15.26:0/318376086 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d9c0f5fe0 0x7f0d9c0f6460 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f0d84004660 tx=0x7f0d84009b30).stop 2021-11-03T17:13:00.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.580+0000 7f0da0c69700 1 -- 172.21.15.26:0/318376086 shutdown_connections 2021-11-03T17:13:00.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.580+0000 7f0da0c69700 1 --2- 172.21.15.26:0/318376086 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d9c0f5fe0 0x7f0d9c0f6460 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:00.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.580+0000 7f0da0c69700 1 --2- 172.21.15.26:0/318376086 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d9c0f4de0 0x7f0d9c0f5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:00.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.580+0000 7f0da0c69700 1 -- 172.21.15.26:0/318376086 >> 172.21.15.26:0/318376086 conn(0x7f0d9c0f0540 msgr2=0x7f0d9c0f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:13:00.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.580+0000 7f0da0c69700 1 -- 172.21.15.26:0/318376086 shutdown_connections 2021-11-03T17:13:00.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.580+0000 7f0da0c69700 1 -- 172.21.15.26:0/318376086 wait complete. 2021-11-03T17:13:00.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.581+0000 7f0da0c69700 1 Processor -- start 2021-11-03T17:13:00.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.581+0000 7f0da0c69700 1 -- start start 2021-11-03T17:13:00.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.581+0000 7f0da0c69700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d9c0f4de0 0x7f0d9c106f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:13:00.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.581+0000 7f0da0c69700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d9c0f5fe0 0x7f0d9c107420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:13:00.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.581+0000 7f0da0c69700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9c1079d0 con 0x7f0d9c0f5fe0 2021-11-03T17:13:00.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.581+0000 7f0da0c69700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9c107b10 con 0x7f0d9c0f4de0 2021-11-03T17:13:00.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.581+0000 7f0d99d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d9c0f5fe0 0x7f0d9c107420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:13:00.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.581+0000 7f0d99d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d9c0f5fe0 0x7f0d9c107420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53148/0 (socket says 172.21.15.26:53148) 2021-11-03T17:13:00.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.581+0000 7f0d99d9b700 1 -- 172.21.15.26:0/2664545544 learned_addr learned my addr 172.21.15.26:0/2664545544 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:13:00.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.582+0000 7f0d9a59c700 1 --2- 172.21.15.26:0/2664545544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d9c0f4de0 0x7f0d9c106f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:13:00.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.582+0000 7f0d99d9b700 1 -- 172.21.15.26:0/2664545544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d9c0f4de0 msgr2=0x7f0d9c106f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:13:00.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.582+0000 7f0d99d9b700 1 --2- 172.21.15.26:0/2664545544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d9c0f4de0 0x7f0d9c106f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:00.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.582+0000 7f0d99d9b700 1 -- 172.21.15.26:0/2664545544 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d84005040 con 0x7f0d9c0f5fe0 2021-11-03T17:13:00.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.582+0000 7f0d9a59c700 1 --2- 172.21.15.26:0/2664545544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d9c0f4de0 0x7f0d9c106f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:13:00.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.582+0000 7f0d99d9b700 1 --2- 172.21.15.26:0/2664545544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d9c0f5fe0 0x7f0d9c107420 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f0d84009990 tx=0x7f0d84009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:13:00.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.582+0000 7f0d92ffd700 1 -- 172.21.15.26:0/2664545544 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d84018070 con 0x7f0d9c0f5fe0 2021-11-03T17:13:00.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.582+0000 7f0da0c69700 1 -- 172.21.15.26:0/2664545544 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d9c108450 con 0x7f0d9c0f5fe0 2021-11-03T17:13:00.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.582+0000 7f0d92ffd700 1 -- 172.21.15.26:0/2664545544 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0d84007ba0 con 0x7f0d9c0f5fe0 2021-11-03T17:13:00.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.582+0000 7f0d92ffd700 1 -- 172.21.15.26:0/2664545544 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d8401c3c0 con 0x7f0d9c0f5fe0 2021-11-03T17:13:00.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.582+0000 7f0da0c69700 1 -- 172.21.15.26:0/2664545544 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d9c1089b0 con 0x7f0d9c0f5fe0 2021-11-03T17:13:00.584 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.583+0000 7f0da0c69700 1 -- 172.21.15.26:0/2664545544 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d9c045ad0 con 0x7f0d9c0f5fe0 2021-11-03T17:13:00.585 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.584+0000 7f0d92ffd700 1 -- 172.21.15.26:0/2664545544 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f0d8401d420 con 0x7f0d9c0f5fe0 2021-11-03T17:13:00.585 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.584+0000 7f0d92ffd700 1 --2- 172.21.15.26:0/2664545544 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0d880640b0 0x7f0d88066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:13:00.585 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.584+0000 7f0d92ffd700 1 -- 172.21.15.26:0/2664545544 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f0d840825d0 con 0x7f0d9c0f5fe0 2021-11-03T17:13:00.585 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.584+0000 7f0d9a59c700 1 --2- 172.21.15.26:0/2664545544 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0d880640b0 0x7f0d88066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:13:00.586 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.584+0000 7f0d9a59c700 1 --2- 172.21.15.26:0/2664545544 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0d880640b0 0x7f0d88066570 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f0d8c007c70 tx=0x7f0d8c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:13:00.586 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.588+0000 7f0d92ffd700 1 -- 172.21.15.26:0/2664545544 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f0d84054990 con 0x7f0d9c0f5fe0 2021-11-03T17:13:00.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:00 smithi026 ceph-mon[96795]: pgmap v550: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:00.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:00 smithi194 ceph-mon[65619]: pgmap v550: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:00.762 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.767+0000 7f0da0c69700 1 -- 172.21.15.26:0/2664545544 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d9c0fd6b0 con 0x7f0d880640b0 2021-11-03T17:13:00.763 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.769+0000 7f0d92ffd700 1 -- 172.21.15.26:0/2664545544 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f0d9c0fd6b0 con 0x7f0d880640b0 2021-11-03T17:13:00.765 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.770+0000 7f0da0c69700 1 -- 172.21.15.26:0/2664545544 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0d880640b0 msgr2=0x7f0d88066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:13:00.765 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.770+0000 7f0da0c69700 1 --2- 172.21.15.26:0/2664545544 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0d880640b0 0x7f0d88066570 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f0d8c007c70 tx=0x7f0d8c00b040).stop 2021-11-03T17:13:00.766 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.770+0000 7f0da0c69700 1 -- 172.21.15.26:0/2664545544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d9c0f5fe0 msgr2=0x7f0d9c107420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:13:00.766 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.770+0000 7f0da0c69700 1 --2- 172.21.15.26:0/2664545544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d9c0f5fe0 0x7f0d9c107420 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f0d84009990 tx=0x7f0d84009b30).stop 2021-11-03T17:13:00.766 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.770+0000 7f0da0c69700 1 -- 172.21.15.26:0/2664545544 shutdown_connections 2021-11-03T17:13:00.766 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.770+0000 7f0da0c69700 1 --2- 172.21.15.26:0/2664545544 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0d880640b0 0x7f0d88066570 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:00.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.770+0000 7f0da0c69700 1 --2- 172.21.15.26:0/2664545544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d9c0f4de0 0x7f0d9c106f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:00.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.770+0000 7f0da0c69700 1 --2- 172.21.15.26:0/2664545544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d9c0f5fe0 0x7f0d9c107420 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:00.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.770+0000 7f0da0c69700 1 -- 172.21.15.26:0/2664545544 >> 172.21.15.26:0/2664545544 conn(0x7f0d9c0f0540 msgr2=0x7f0d9c0fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:13:00.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.770+0000 7f0da0c69700 1 -- 172.21.15.26:0/2664545544 shutdown_connections 2021-11-03T17:13:00.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.771+0000 7f0da0c69700 1 -- 172.21.15.26:0/2664545544 wait complete. 2021-11-03T17:13:00.774 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:13:00.867 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.870+0000 7fe0ca961700 1 -- 172.21.15.26:0/3134849216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0c40f55d0 msgr2=0x7fe0c40f59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:13:00.867 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.870+0000 7fe0ca961700 1 --2- 172.21.15.26:0/3134849216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0c40f55d0 0x7fe0c40f59f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7fe0b8004660 tx=0x7fe0b8009b30).stop 2021-11-03T17:13:00.867 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.871+0000 7fe0ca961700 1 -- 172.21.15.26:0/3134849216 shutdown_connections 2021-11-03T17:13:00.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.871+0000 7fe0ca961700 1 --2- 172.21.15.26:0/3134849216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0c40f6870 0x7fe0c40f6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:00.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.871+0000 7fe0ca961700 1 --2- 172.21.15.26:0/3134849216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0c40f55d0 0x7fe0c40f59f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:00.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.871+0000 7fe0ca961700 1 -- 172.21.15.26:0/3134849216 >> 172.21.15.26:0/3134849216 conn(0x7fe0c40f0d70 msgr2=0x7fe0c40f3190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:13:00.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.871+0000 7fe0ca961700 1 -- 172.21.15.26:0/3134849216 shutdown_connections 2021-11-03T17:13:00.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.871+0000 7fe0ca961700 1 -- 172.21.15.26:0/3134849216 wait complete. 2021-11-03T17:13:00.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.871+0000 7fe0ca961700 1 Processor -- start 2021-11-03T17:13:00.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.871+0000 7fe0ca961700 1 -- start start 2021-11-03T17:13:00.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.871+0000 7fe0ca961700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0c40f55d0 0x7fe0c4109c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:13:00.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.871+0000 7fe0ca961700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0c40f6870 0x7fe0c410c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:13:00.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.871+0000 7fe0ca961700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c4060520 con 0x7fe0c40f6870 2021-11-03T17:13:00.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.872+0000 7fe0ca961700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c4060660 con 0x7fe0c40f55d0 2021-11-03T17:13:00.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.872+0000 7fe0c37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0c40f6870 0x7fe0c410c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:13:00.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.872+0000 7fe0c37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0c40f6870 0x7fe0c410c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53158/0 (socket says 172.21.15.26:53158) 2021-11-03T17:13:00.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.872+0000 7fe0c37fe700 1 -- 172.21.15.26:0/3338150547 learned_addr learned my addr 172.21.15.26:0/3338150547 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:13:00.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.872+0000 7fe0c3fff700 1 --2- 172.21.15.26:0/3338150547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0c40f55d0 0x7fe0c4109c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:13:00.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.872+0000 7fe0c37fe700 1 -- 172.21.15.26:0/3338150547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0c40f55d0 msgr2=0x7fe0c4109c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:13:00.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.872+0000 7fe0c37fe700 1 --2- 172.21.15.26:0/3338150547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0c40f55d0 0x7fe0c4109c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:00.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.872+0000 7fe0c37fe700 1 -- 172.21.15.26:0/3338150547 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b8005040 con 0x7fe0c40f6870 2021-11-03T17:13:00.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.872+0000 7fe0c37fe700 1 --2- 172.21.15.26:0/3338150547 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0c40f6870 0x7fe0c410c100 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7fe0b40026d0 tx=0x7fe0b4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:13:00.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.872+0000 7fe0c0ff9700 1 -- 172.21.15.26:0/3338150547 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0b4009320 con 0x7fe0c40f6870 2021-11-03T17:13:00.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.872+0000 7fe0ca961700 1 -- 172.21.15.26:0/3338150547 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0c410c6b0 con 0x7fe0c40f6870 2021-11-03T17:13:00.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.872+0000 7fe0c0ff9700 1 -- 172.21.15.26:0/3338150547 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe0b400f040 con 0x7fe0c40f6870 2021-11-03T17:13:00.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.872+0000 7fe0c0ff9700 1 -- 172.21.15.26:0/3338150547 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0b40147e0 con 0x7fe0c40f6870 2021-11-03T17:13:00.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.872+0000 7fe0ca961700 1 -- 172.21.15.26:0/3338150547 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0c410cc70 con 0x7fe0c40f6870 2021-11-03T17:13:00.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.874+0000 7fe0ca961700 1 -- 172.21.15.26:0/3338150547 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0c4045ad0 con 0x7fe0c40f6870 2021-11-03T17:13:00.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.874+0000 7fe0c0ff9700 1 -- 172.21.15.26:0/3338150547 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fe0b4009480 con 0x7fe0c40f6870 2021-11-03T17:13:00.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.874+0000 7fe0c0ff9700 1 --2- 172.21.15.26:0/3338150547 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe0ac0640b0 0x7fe0ac066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:13:00.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.874+0000 7fe0c0ff9700 1 -- 172.21.15.26:0/3338150547 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fe0b4080e10 con 0x7fe0c40f6870 2021-11-03T17:13:00.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.874+0000 7fe0c3fff700 1 --2- 172.21.15.26:0/3338150547 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe0ac0640b0 0x7fe0ac066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:13:00.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.875+0000 7fe0c3fff700 1 --2- 172.21.15.26:0/3338150547 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe0ac0640b0 0x7fe0ac066570 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fe0b8009da0 tx=0x7fe0b8009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:13:00.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:00.878+0000 7fe0c0ff9700 1 -- 172.21.15.26:0/3338150547 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fe0b4053230 con 0x7fe0c40f6870 2021-11-03T17:13:01.044 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.050+0000 7fe0ca961700 1 -- 172.21.15.26:0/3338150547 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0c40fdf00 con 0x7fe0ac0640b0 2021-11-03T17:13:01.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.065+0000 7fe0c0ff9700 1 -- 172.21.15.26:0/3338150547 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fe0c40fdf00 con 0x7fe0ac0640b0 2021-11-03T17:13:01.059 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:13:01.060 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (24m) 4m ago 25m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:13:01.060 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (16m) 4m ago 25m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:13:01.060 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (16m) 3m ago 24m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:13:01.060 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (24m) 4m ago 25m 39.5M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:13:01.061 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (17m) 4m ago 20m 16.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:13:01.061 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (17m) 4m ago 20m 17.8M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:13:01.061 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (20m) 3m ago 20m 19.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:13:01.061 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (20m) 3m ago 20m 19.4M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:13:01.062 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (17m) 4m ago 26m 491M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:13:01.062 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (17m) 3m ago 24m 415M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:13:01.062 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (17m) 4m ago 26m 113M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:13:01.062 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (17m) 3m ago 24m 70.2M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:13:01.063 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (25m) 4m ago 25m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:13:01.063 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (24m) 3m ago 24m 18.4M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:13:01.063 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (16m) 4m ago 23m 190M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:13:01.063 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (15m) 4m ago 23m 204M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:13:01.063 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (15m) 4m ago 23m 170M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:13:01.064 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (14m) 3m ago 22m 211M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:13:01.064 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (14m) 3m ago 22m 189M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:13:01.064 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (13m) 3m ago 22m 174M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:13:01.064 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (23m) 4m ago 24m 49.9M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:13:01.066 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.066+0000 7fe0ca961700 1 -- 172.21.15.26:0/3338150547 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe0ac0640b0 msgr2=0x7fe0ac066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:13:01.066 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.066+0000 7fe0ca961700 1 --2- 172.21.15.26:0/3338150547 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe0ac0640b0 0x7fe0ac066570 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fe0b8009da0 tx=0x7fe0b8009b30).stop 2021-11-03T17:13:01.066 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.066+0000 7fe0ca961700 1 -- 172.21.15.26:0/3338150547 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0c40f6870 msgr2=0x7fe0c410c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:13:01.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.066+0000 7fe0ca961700 1 --2- 172.21.15.26:0/3338150547 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0c40f6870 0x7fe0c410c100 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7fe0b40026d0 tx=0x7fe0b4009de0).stop 2021-11-03T17:13:01.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.066+0000 7fe0ca961700 1 -- 172.21.15.26:0/3338150547 shutdown_connections 2021-11-03T17:13:01.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.066+0000 7fe0ca961700 1 --2- 172.21.15.26:0/3338150547 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe0ac0640b0 0x7fe0ac066570 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:01.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.066+0000 7fe0ca961700 1 --2- 172.21.15.26:0/3338150547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0c40f55d0 0x7fe0c4109c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:01.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.066+0000 7fe0ca961700 1 --2- 172.21.15.26:0/3338150547 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0c40f6870 0x7fe0c410c100 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:01.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.066+0000 7fe0ca961700 1 -- 172.21.15.26:0/3338150547 >> 172.21.15.26:0/3338150547 conn(0x7fe0c40f0d70 msgr2=0x7fe0c40fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:13:01.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.067+0000 7fe0ca961700 1 -- 172.21.15.26:0/3338150547 shutdown_connections 2021-11-03T17:13:01.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.067+0000 7fe0ca961700 1 -- 172.21.15.26:0/3338150547 wait complete. 2021-11-03T17:13:01.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.166+0000 7fd508f99700 1 -- 172.21.15.26:0/444757351 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5040f66e0 msgr2=0x7fd5040f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:13:01.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.166+0000 7fd508f99700 1 --2- 172.21.15.26:0/444757351 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5040f66e0 0x7fd5040f6b00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7fd4fc004660 tx=0x7fd4fc009b30).stop 2021-11-03T17:13:01.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.166+0000 7fd508f99700 1 -- 172.21.15.26:0/444757351 shutdown_connections 2021-11-03T17:13:01.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.166+0000 7fd508f99700 1 --2- 172.21.15.26:0/444757351 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5040f6ff0 0x7fd5040f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:01.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.166+0000 7fd508f99700 1 --2- 172.21.15.26:0/444757351 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5040f66e0 0x7fd5040f6b00 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:01.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.166+0000 7fd508f99700 1 -- 172.21.15.26:0/444757351 >> 172.21.15.26:0/444757351 conn(0x7fd5040f1f00 msgr2=0x7fd5040f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:13:01.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.166+0000 7fd508f99700 1 -- 172.21.15.26:0/444757351 shutdown_connections 2021-11-03T17:13:01.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.166+0000 7fd508f99700 1 -- 172.21.15.26:0/444757351 wait complete. 2021-11-03T17:13:01.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.167+0000 7fd508f99700 1 Processor -- start 2021-11-03T17:13:01.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.167+0000 7fd508f99700 1 -- start start 2021-11-03T17:13:01.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.167+0000 7fd508f99700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5040f66e0 0x7fd504106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:13:01.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.167+0000 7fd508f99700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5040f6ff0 0x7fd504107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:13:01.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.167+0000 7fd508f99700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd504107a00 con 0x7fd5040f6ff0 2021-11-03T17:13:01.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.167+0000 7fd508f99700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd504107b40 con 0x7fd5040f66e0 2021-11-03T17:13:01.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.167+0000 7fd501d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5040f6ff0 0x7fd504107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:13:01.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.167+0000 7fd501d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5040f6ff0 0x7fd504107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53168/0 (socket says 172.21.15.26:53168) 2021-11-03T17:13:01.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.167+0000 7fd501d9b700 1 -- 172.21.15.26:0/1552497269 learned_addr learned my addr 172.21.15.26:0/1552497269 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:13:01.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.167+0000 7fd50259c700 1 --2- 172.21.15.26:0/1552497269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5040f66e0 0x7fd504106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:13:01.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.167+0000 7fd501d9b700 1 -- 172.21.15.26:0/1552497269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5040f66e0 msgr2=0x7fd504106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:13:01.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.167+0000 7fd501d9b700 1 --2- 172.21.15.26:0/1552497269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5040f66e0 0x7fd504106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:01.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.167+0000 7fd501d9b700 1 -- 172.21.15.26:0/1552497269 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4fc005040 con 0x7fd5040f6ff0 2021-11-03T17:13:01.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.167+0000 7fd501d9b700 1 --2- 172.21.15.26:0/1552497269 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5040f6ff0 0x7fd504107450 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7fd4ec0026d0 tx=0x7fd4ec009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:13:01.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.168+0000 7fd4faffd700 1 -- 172.21.15.26:0/1552497269 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4ec0079c0 con 0x7fd5040f6ff0 2021-11-03T17:13:01.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.168+0000 7fd4faffd700 1 -- 172.21.15.26:0/1552497269 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd4ec00f040 con 0x7fd5040f6ff0 2021-11-03T17:13:01.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.168+0000 7fd4faffd700 1 -- 172.21.15.26:0/1552497269 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4ec0148b0 con 0x7fd5040f6ff0 2021-11-03T17:13:01.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.168+0000 7fd508f99700 1 -- 172.21.15.26:0/1552497269 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5041084e0 con 0x7fd5040f6ff0 2021-11-03T17:13:01.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.168+0000 7fd508f99700 1 -- 172.21.15.26:0/1552497269 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd504108a50 con 0x7fd5040f6ff0 2021-11-03T17:13:01.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.169+0000 7fd508f99700 1 -- 172.21.15.26:0/1552497269 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd504045ad0 con 0x7fd5040f6ff0 2021-11-03T17:13:01.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.169+0000 7fd4faffd700 1 -- 172.21.15.26:0/1552497269 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fd4ec007b20 con 0x7fd5040f6ff0 2021-11-03T17:13:01.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.169+0000 7fd4faffd700 1 --2- 172.21.15.26:0/1552497269 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd4f0064090 0x7fd4f0066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:13:01.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.170+0000 7fd4faffd700 1 -- 172.21.15.26:0/1552497269 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fd4ec080730 con 0x7fd5040f6ff0 2021-11-03T17:13:01.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.170+0000 7fd50259c700 1 --2- 172.21.15.26:0/1552497269 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd4f0064090 0x7fd4f0066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:13:01.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.170+0000 7fd50259c700 1 --2- 172.21.15.26:0/1552497269 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd4f0064090 0x7fd4f0066550 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fd4fc004e30 tx=0x7fd4fc009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:13:01.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.174+0000 7fd4faffd700 1 -- 172.21.15.26:0/1552497269 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fd4ec052a90 con 0x7fd5040f6ff0 2021-11-03T17:13:01.397 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.403+0000 7fd508f99700 1 -- 172.21.15.26:0/1552497269 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd504027a00 con 0x7fd5040f6ff0 2021-11-03T17:13:01.398 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.403+0000 7fd4faffd700 1 -- 172.21.15.26:0/1552497269 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fd4ec052680 con 0x7fd5040f6ff0 2021-11-03T17:13:01.399 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:13:01.399 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:13:01.399 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:13:01.399 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:13:01.400 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:13:01.400 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:13:01.400 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:13:01.401 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:13:01.401 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:13:01.401 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:13:01.401 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:13:01.401 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:13:01.402 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:13:01.402 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:13:01.402 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:13:01.402 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:13:01.403 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:13:01.403 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:13:01.404 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.405+0000 7fd508f99700 1 -- 172.21.15.26:0/1552497269 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd4f0064090 msgr2=0x7fd4f0066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:13:01.404 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.405+0000 7fd508f99700 1 --2- 172.21.15.26:0/1552497269 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd4f0064090 0x7fd4f0066550 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fd4fc004e30 tx=0x7fd4fc009b30).stop 2021-11-03T17:13:01.404 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.405+0000 7fd508f99700 1 -- 172.21.15.26:0/1552497269 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5040f6ff0 msgr2=0x7fd504107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:13:01.405 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.405+0000 7fd508f99700 1 --2- 172.21.15.26:0/1552497269 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5040f6ff0 0x7fd504107450 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7fd4ec0026d0 tx=0x7fd4ec009de0).stop 2021-11-03T17:13:01.405 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.405+0000 7fd508f99700 1 -- 172.21.15.26:0/1552497269 shutdown_connections 2021-11-03T17:13:01.405 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.405+0000 7fd508f99700 1 --2- 172.21.15.26:0/1552497269 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd4f0064090 0x7fd4f0066550 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:01.405 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.405+0000 7fd508f99700 1 --2- 172.21.15.26:0/1552497269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5040f66e0 0x7fd504106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:01.405 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.405+0000 7fd508f99700 1 --2- 172.21.15.26:0/1552497269 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5040f6ff0 0x7fd504107450 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:01.406 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.405+0000 7fd508f99700 1 -- 172.21.15.26:0/1552497269 >> 172.21.15.26:0/1552497269 conn(0x7fd5040f1f00 msgr2=0x7fd5040fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:13:01.406 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.406+0000 7fd508f99700 1 -- 172.21.15.26:0/1552497269 shutdown_connections 2021-11-03T17:13:01.406 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.406+0000 7fd508f99700 1 -- 172.21.15.26:0/1552497269 wait complete. 2021-11-03T17:13:01.502 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.505+0000 7fd5f648b700 1 -- 172.21.15.26:0/725091680 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5f00f6a10 msgr2=0x7fd5f00f6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:13:01.502 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.505+0000 7fd5f648b700 1 --2- 172.21.15.26:0/725091680 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5f00f6a10 0x7fd5f00f6e30 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7fd5e0004660 tx=0x7fd5e0009b30).stop 2021-11-03T17:13:01.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.505+0000 7fd5f648b700 1 -- 172.21.15.26:0/725091680 shutdown_connections 2021-11-03T17:13:01.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.505+0000 7fd5f648b700 1 --2- 172.21.15.26:0/725091680 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5f00f5710 0x7fd5f00f5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:13:01.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.505+0000 7fd5f648b700 1 --2- 172.21.15.26:0/725091680 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5f00f6a10 0x7fd5f00f6e30 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:01.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.505+0000 7fd5f648b700 1 -- 172.21.15.26:0/725091680 >> 172.21.15.26:0/725091680 conn(0x7fd5f00f0320 msgr2=0x7fd5f00f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:13:01.504 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.505+0000 7fd5f648b700 1 -- 172.21.15.26:0/725091680 shutdown_connections 2021-11-03T17:13:01.504 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.505+0000 7fd5f648b700 1 -- 172.21.15.26:0/725091680 wait complete. 2021-11-03T17:13:01.504 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.506+0000 7fd5f648b700 1 Processor -- start 2021-11-03T17:13:01.505 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.506+0000 7fd5f648b700 1 -- start start 2021-11-03T17:13:01.505 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.506+0000 7fd5f648b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5f00f5710 0x7fd5f0106dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:13:01.505 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.506+0000 7fd5f648b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5f00f6a10 0x7fd5f01072c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:13:01.506 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.506+0000 7fd5f648b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f0107950 con 0x7fd5f00f5710 2021-11-03T17:13:01.506 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.506+0000 7fd5f648b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f0108100 con 0x7fd5f00f6a10 2021-11-03T17:13:01.506 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.506+0000 7fd5f5489700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5f00f5710 0x7fd5f0106dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:13:01.507 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.506+0000 7fd5f5489700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5f00f5710 0x7fd5f0106dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53176/0 (socket says 172.21.15.26:53176) 2021-11-03T17:13:01.507 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.506+0000 7fd5f5489700 1 -- 172.21.15.26:0/329119259 learned_addr learned my addr 172.21.15.26:0/329119259 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:13:01.507 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.506+0000 7fd5f5489700 1 -- 172.21.15.26:0/329119259 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5f00f6a10 msgr2=0x7fd5f01072c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:13:01.507 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.506+0000 7fd5f4c88700 1 --2- 172.21.15.26:0/329119259 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5f00f6a10 0x7fd5f01072c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:13:01.508 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.507+0000 7fd5f5489700 1 --2- 172.21.15.26:0/329119259 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5f00f6a10 0x7fd5f01072c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:01.508 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.507+0000 7fd5f5489700 1 -- 172.21.15.26:0/329119259 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e0005040 con 0x7fd5f00f5710 2021-11-03T17:13:01.508 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.507+0000 7fd5f4c88700 1 --2- 172.21.15.26:0/329119259 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5f00f6a10 0x7fd5f01072c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:13:01.508 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.507+0000 7fd5f5489700 1 --2- 172.21.15.26:0/329119259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5f00f5710 0x7fd5f0106dd0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7fd5e0004f60 tx=0x7fd5e0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:13:01.508 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.507+0000 7fd5e5ffb700 1 -- 172.21.15.26:0/329119259 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5e0018070 con 0x7fd5f00f5710 2021-11-03T17:13:01.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.507+0000 7fd5f648b700 1 -- 172.21.15.26:0/329119259 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5f0108380 con 0x7fd5f00f5710 2021-11-03T17:13:01.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.507+0000 7fd5e5ffb700 1 -- 172.21.15.26:0/329119259 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd5e0007ba0 con 0x7fd5f00f5710 2021-11-03T17:13:01.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.507+0000 7fd5e5ffb700 1 -- 172.21.15.26:0/329119259 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5e001c620 con 0x7fd5f00f5710 2021-11-03T17:13:01.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.507+0000 7fd5f648b700 1 -- 172.21.15.26:0/329119259 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5f01088e0 con 0x7fd5f00f5710 2021-11-03T17:13:01.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.508+0000 7fd5f648b700 1 -- 172.21.15.26:0/329119259 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5f0059100 con 0x7fd5f00f5710 2021-11-03T17:13:01.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.509+0000 7fd5e5ffb700 1 -- 172.21.15.26:0/329119259 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fd5e001c8e0 con 0x7fd5f00f5710 2021-11-03T17:13:01.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.509+0000 7fd5e5ffb700 1 --2- 172.21.15.26:0/329119259 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd5dc064100 0x7fd5dc0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:13:01.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.509+0000 7fd5e5ffb700 1 -- 172.21.15.26:0/329119259 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fd5e00826d0 con 0x7fd5f00f5710 2021-11-03T17:13:01.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.509+0000 7fd5f4c88700 1 --2- 172.21.15.26:0/329119259 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd5dc064100 0x7fd5dc0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:13:01.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.509+0000 7fd5f4c88700 1 --2- 172.21.15.26:0/329119259 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd5dc064100 0x7fd5dc0665c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fd5f0106b60 tx=0x7fd5ec008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:13:01.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.513+0000 7fd5e5ffb700 1 -- 172.21.15.26:0/329119259 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fd5e0054a30 con 0x7fd5f00f5710 2021-11-03T17:13:01.711 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.715+0000 7fd5f648b700 1 -- 172.21.15.26:0/329119259 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd5f010d340 con 0x7fd5f00f5710 2021-11-03T17:13:01.712 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.716+0000 7fd5e5ffb700 1 -- 172.21.15.26:0/329119259 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fd5e0054620 con 0x7fd5f00f5710 2021-11-03T17:13:01.712 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:13:01.713 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:13:01.713 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:13:01.713 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:13:01.713 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:13:01.713 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:13:01.714 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:13:01.714 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:13:01.714 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:13:01.714 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:13:01.715 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:13:01.715 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:13:01.715 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:13:01.715 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:13:01.716 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:13:01.716 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:13:01.716 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:13:01.716 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:13:01.716 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:13:01.717 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:13:01.717 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:13:01.717 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:13:01.717 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:13:01.718 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:13:01.718 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:13:01.718 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:13:01.718 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:13:01.719 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:13:01.719 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:13:01.719 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:13:01.719 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:13:01.719 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:13:01.720 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:13:01.720 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:13:01.720 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:13:01.720 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:13:01.720 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:13:01.721 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:13:01.721 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:13:01.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.718+0000 7fd5f648b700 1 -- 172.21.15.26:0/329119259 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd5dc064100 msgr2=0x7fd5dc0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:13:01.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.718+0000 7fd5f648b700 1 --2- 172.21.15.26:0/329119259 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd5dc064100 0x7fd5dc0665c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fd5f0106b60 tx=0x7fd5ec008040).stop 2021-11-03T17:13:01.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.718+0000 7fd5f648b700 1 -- 172.21.15.26:0/329119259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5f00f5710 msgr2=0x7fd5f0106dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:13:01.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.718+0000 7fd5f648b700 1 --2- 172.21.15.26:0/329119259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5f00f5710 0x7fd5f0106dd0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7fd5e0004f60 tx=0x7fd5e0009b30).stop 2021-11-03T17:13:01.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.718+0000 7fd5f648b700 1 -- 172.21.15.26:0/329119259 shutdown_connections 2021-11-03T17:13:01.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.718+0000 7fd5f648b700 1 --2- 172.21.15.26:0/329119259 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd5dc064100 0x7fd5dc0665c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:01.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.718+0000 7fd5f648b700 1 --2- 172.21.15.26:0/329119259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5f00f5710 0x7fd5f0106dd0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:01.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.718+0000 7fd5f648b700 1 --2- 172.21.15.26:0/329119259 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5f00f6a10 0x7fd5f01072c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:01.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.718+0000 7fd5f648b700 1 -- 172.21.15.26:0/329119259 >> 172.21.15.26:0/329119259 conn(0x7fd5f00f0320 msgr2=0x7fd5f00f4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:13:01.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.718+0000 7fd5f648b700 1 -- 172.21.15.26:0/329119259 shutdown_connections 2021-11-03T17:13:01.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:01.718+0000 7fd5f648b700 1 -- 172.21.15.26:0/329119259 wait complete. 2021-11-03T17:13:01.724 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:13:02.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:02 smithi026 ceph-mon[96795]: pgmap v551: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:02.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:02 smithi026 ceph-mon[96795]: from='client.34716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:13:02.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:02 smithi026 ceph-mon[96795]: from='client.34720 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:13:02.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:02 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1552497269' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:13:02.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:02 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/329119259' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:13:02.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:02 smithi194 ceph-mon[65619]: pgmap v551: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:02.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:02 smithi194 ceph-mon[65619]: from='client.34716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:13:02.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:02 smithi194 ceph-mon[65619]: from='client.34720 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:13:02.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:02 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1552497269' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:13:02.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:02 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/329119259' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:13:04.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:04 smithi026 ceph-mon[96795]: pgmap v552: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:04.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:04 smithi194 ceph-mon[65619]: pgmap v552: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:06.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:06 smithi026 ceph-mon[96795]: pgmap v553: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:06.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:06 smithi194 ceph-mon[65619]: pgmap v553: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:07.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:07 smithi026 ceph-mon[96795]: pgmap v554: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:09.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:09 smithi026 ceph-mon[96795]: pgmap v555: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:09.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:09 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:13:09.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:09 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:13:09.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:07 smithi194 ceph-mon[65619]: pgmap v554: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:09.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:09 smithi194 ceph-mon[65619]: pgmap v555: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:09.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:09 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:13:09.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:09 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:13:11.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:11 smithi026 ceph-mon[96795]: pgmap v556: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:11.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:11 smithi194 ceph-mon[65619]: pgmap v556: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:13.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:13 smithi194 ceph-mon[65619]: pgmap v557: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:13.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:13 smithi026 ceph-mon[96795]: pgmap v557: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:16.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:15 smithi026 ceph-mon[96795]: pgmap v558: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:16.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:15 smithi194 ceph-mon[65619]: pgmap v558: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:18.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:17 smithi026 ceph-mon[96795]: pgmap v559: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:18.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:17 smithi194 ceph-mon[65619]: pgmap v559: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:20.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:19 smithi026 ceph-mon[96795]: pgmap v560: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:20.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:19 smithi194 ceph-mon[65619]: pgmap v560: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:22.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:21 smithi026 ceph-mon[96795]: pgmap v561: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:22.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:21 smithi194 ceph-mon[65619]: pgmap v561: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:24.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:23 smithi026 ceph-mon[96795]: pgmap v562: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:24.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:23 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:13:24.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:23 smithi194 ceph-mon[65619]: pgmap v562: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:24.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:23 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:13:25.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:24 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:13:25.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:24 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:13:26.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:25 smithi194 ceph-mon[65619]: pgmap v563: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:26.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:25 smithi026 ceph-mon[96795]: pgmap v563: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:28.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:27 smithi194 ceph-mon[65619]: pgmap v564: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:28.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:27 smithi026 ceph-mon[96795]: pgmap v564: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:30.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:29 smithi194 ceph-mon[65619]: pgmap v565: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:30.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:29 smithi026 ceph-mon[96795]: pgmap v565: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:31.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:31.830+0000 7f6e7f5c6700 1 -- 172.21.15.26:0/521892932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e780f6ff0 msgr2=0x7f6e780f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:13:31.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:31.830+0000 7f6e7f5c6700 1 --2- 172.21.15.26:0/521892932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e780f6ff0 0x7f6e780f7a20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f6e74004660 tx=0x7f6e74009b30).stop 2021-11-03T17:13:31.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:31.830+0000 7f6e7f5c6700 1 -- 172.21.15.26:0/521892932 shutdown_connections 2021-11-03T17:13:31.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:31.830+0000 7f6e7f5c6700 1 --2- 172.21.15.26:0/521892932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e780f6ff0 0x7f6e780f7a20 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:31.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:31.830+0000 7f6e7f5c6700 1 --2- 172.21.15.26:0/521892932 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e780f66e0 0x7f6e780f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:31.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:31.830+0000 7f6e7f5c6700 1 -- 172.21.15.26:0/521892932 >> 172.21.15.26:0/521892932 conn(0x7f6e780f1f00 msgr2=0x7f6e780f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:13:31.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:31.831+0000 7f6e7f5c6700 1 -- 172.21.15.26:0/521892932 shutdown_connections 2021-11-03T17:13:31.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:31.831+0000 7f6e7f5c6700 1 -- 172.21.15.26:0/521892932 wait complete. 2021-11-03T17:13:31.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:31.831+0000 7f6e7f5c6700 1 Processor -- start 2021-11-03T17:13:31.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:31.831+0000 7f6e7f5c6700 1 -- start start 2021-11-03T17:13:31.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:31.831+0000 7f6e7f5c6700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e780f66e0 0x7f6e78106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:13:31.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:31.831+0000 7f6e7f5c6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e780f6ff0 0x7f6e78107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:13:31.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:31.831+0000 7f6e7f5c6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e78107a10 con 0x7f6e780f6ff0 2021-11-03T17:13:31.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:31.831+0000 7f6e7f5c6700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e78107b50 con 0x7f6e780f66e0 2021-11-03T17:13:31.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:31.832+0000 7f6e7cb61700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e780f6ff0 0x7f6e78107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:13:31.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:31.832+0000 7f6e7cb61700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e780f6ff0 0x7f6e78107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53196/0 (socket says 172.21.15.26:53196) 2021-11-03T17:13:31.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:31.832+0000 7f6e7cb61700 1 -- 172.21.15.26:0/2651546738 learned_addr learned my addr 172.21.15.26:0/2651546738 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:13:31.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:31.832+0000 7f6e7d362700 1 --2- 172.21.15.26:0/2651546738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e780f66e0 0x7f6e78106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:13:31.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:31.832+0000 7f6e7cb61700 1 -- 172.21.15.26:0/2651546738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e780f66e0 msgr2=0x7f6e78106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:13:31.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:31.832+0000 7f6e7cb61700 1 --2- 172.21.15.26:0/2651546738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e780f66e0 0x7f6e78106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:31.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:31.832+0000 7f6e7cb61700 1 -- 172.21.15.26:0/2651546738 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e74005040 con 0x7f6e780f6ff0 2021-11-03T17:13:31.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:31.832+0000 7f6e7d362700 1 --2- 172.21.15.26:0/2651546738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e780f66e0 0x7f6e78106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:13:31.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:31.832+0000 7f6e7cb61700 1 --2- 172.21.15.26:0/2651546738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e780f6ff0 0x7f6e78107460 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f6e74009990 tx=0x7f6e74009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:13:31.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:31.832+0000 7f6e69ffb700 1 -- 172.21.15.26:0/2651546738 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e74018070 con 0x7f6e780f6ff0 2021-11-03T17:13:31.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:31.832+0000 7f6e69ffb700 1 -- 172.21.15.26:0/2651546738 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6e74007ca0 con 0x7f6e780f6ff0 2021-11-03T17:13:31.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:31.832+0000 7f6e7f5c6700 1 -- 172.21.15.26:0/2651546738 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e78108490 con 0x7f6e780f6ff0 2021-11-03T17:13:31.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:31.832+0000 7f6e69ffb700 1 -- 172.21.15.26:0/2651546738 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e7401c620 con 0x7f6e780f6ff0 2021-11-03T17:13:31.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:31.832+0000 7f6e7f5c6700 1 -- 172.21.15.26:0/2651546738 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e781089f0 con 0x7f6e780f6ff0 2021-11-03T17:13:31.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:31.833+0000 7f6e7f5c6700 1 -- 172.21.15.26:0/2651546738 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e78045ad0 con 0x7f6e780f6ff0 2021-11-03T17:13:31.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:31.834+0000 7f6e69ffb700 1 -- 172.21.15.26:0/2651546738 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f6e7401d960 con 0x7f6e780f6ff0 2021-11-03T17:13:31.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:31.834+0000 7f6e69ffb700 1 --2- 172.21.15.26:0/2651546738 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6e640640b0 0x7f6e64066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:13:31.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:31.835+0000 7f6e69ffb700 1 -- 172.21.15.26:0/2651546738 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f6e74082480 con 0x7f6e780f6ff0 2021-11-03T17:13:31.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:31.835+0000 7f6e7d362700 1 --2- 172.21.15.26:0/2651546738 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6e640640b0 0x7f6e64066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:13:31.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:31.835+0000 7f6e7d362700 1 --2- 172.21.15.26:0/2651546738 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6e640640b0 0x7f6e64066570 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f6e6c0041d0 tx=0x7f6e6c009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:13:31.837 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:31.839+0000 7f6e69ffb700 1 -- 172.21.15.26:0/2651546738 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f6e740548a0 con 0x7f6e780f6ff0 2021-11-03T17:13:32.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.018+0000 7f6e7f5c6700 1 -- 172.21.15.26:0/2651546738 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e780008d0 con 0x7f6e640640b0 2021-11-03T17:13:32.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.019+0000 7f6e69ffb700 1 -- 172.21.15.26:0/2651546738 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f6e780008d0 con 0x7f6e640640b0 2021-11-03T17:13:32.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.021+0000 7f6e7f5c6700 1 -- 172.21.15.26:0/2651546738 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6e640640b0 msgr2=0x7f6e64066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:13:32.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.021+0000 7f6e7f5c6700 1 --2- 172.21.15.26:0/2651546738 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6e640640b0 0x7f6e64066570 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f6e6c0041d0 tx=0x7f6e6c009040).stop 2021-11-03T17:13:32.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.021+0000 7f6e7f5c6700 1 -- 172.21.15.26:0/2651546738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e780f6ff0 msgr2=0x7f6e78107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:13:32.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.021+0000 7f6e7f5c6700 1 --2- 172.21.15.26:0/2651546738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e780f6ff0 0x7f6e78107460 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f6e74009990 tx=0x7f6e74009b30).stop 2021-11-03T17:13:32.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.021+0000 7f6e7f5c6700 1 -- 172.21.15.26:0/2651546738 shutdown_connections 2021-11-03T17:13:32.018 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.021+0000 7f6e7f5c6700 1 --2- 172.21.15.26:0/2651546738 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6e640640b0 0x7f6e64066570 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:32.018 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.021+0000 7f6e7f5c6700 1 --2- 172.21.15.26:0/2651546738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e780f66e0 0x7f6e78106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:32.018 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.021+0000 7f6e7f5c6700 1 --2- 172.21.15.26:0/2651546738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e780f6ff0 0x7f6e78107460 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:32.018 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.021+0000 7f6e7f5c6700 1 -- 172.21.15.26:0/2651546738 >> 172.21.15.26:0/2651546738 conn(0x7f6e780f1f00 msgr2=0x7f6e780fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:13:32.018 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.021+0000 7f6e7f5c6700 1 -- 172.21.15.26:0/2651546738 shutdown_connections 2021-11-03T17:13:32.019 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.021+0000 7f6e7f5c6700 1 -- 172.21.15.26:0/2651546738 wait complete. 2021-11-03T17:13:32.026 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:13:32.119 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.122+0000 7effb4579700 1 -- 172.21.15.26:0/3035281710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effac0f55c0 msgr2=0x7effac0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:13:32.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.122+0000 7effb4579700 1 --2- 172.21.15.26:0/3035281710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effac0f55c0 0x7effac0f59e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7eff9c004660 tx=0x7eff9c009b30).stop 2021-11-03T17:13:32.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.122+0000 7effb4579700 1 -- 172.21.15.26:0/3035281710 shutdown_connections 2021-11-03T17:13:32.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.122+0000 7effb4579700 1 --2- 172.21.15.26:0/3035281710 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effac0f6860 0x7effac0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:32.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.122+0000 7effb4579700 1 --2- 172.21.15.26:0/3035281710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effac0f55c0 0x7effac0f59e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:32.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.122+0000 7effb4579700 1 -- 172.21.15.26:0/3035281710 >> 172.21.15.26:0/3035281710 conn(0x7effac0f0d40 msgr2=0x7effac0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:13:32.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.122+0000 7effb4579700 1 -- 172.21.15.26:0/3035281710 shutdown_connections 2021-11-03T17:13:32.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.122+0000 7effb4579700 1 -- 172.21.15.26:0/3035281710 wait complete. 2021-11-03T17:13:32.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.122+0000 7effb4579700 1 Processor -- start 2021-11-03T17:13:32.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.122+0000 7effb4579700 1 -- start start 2021-11-03T17:13:32.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.123+0000 7effb4579700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effac0f55c0 0x7effac10c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:13:32.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.123+0000 7effb4579700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effac0f6860 0x7effac10e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:13:32.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.123+0000 7effb4579700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effac0602b0 con 0x7effac0f6860 2021-11-03T17:13:32.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.123+0000 7effb4579700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effac0603f0 con 0x7effac0f55c0 2021-11-03T17:13:32.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.123+0000 7effb1b14700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effac0f6860 0x7effac10e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:13:32.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.123+0000 7effb1b14700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effac0f6860 0x7effac10e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53206/0 (socket says 172.21.15.26:53206) 2021-11-03T17:13:32.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.123+0000 7effb1b14700 1 -- 172.21.15.26:0/2942004373 learned_addr learned my addr 172.21.15.26:0/2942004373 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:13:32.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.123+0000 7effb2315700 1 --2- 172.21.15.26:0/2942004373 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effac0f55c0 0x7effac10c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:13:32.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.123+0000 7effb1b14700 1 -- 172.21.15.26:0/2942004373 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effac0f55c0 msgr2=0x7effac10c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:13:32.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.123+0000 7effb1b14700 1 --2- 172.21.15.26:0/2942004373 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effac0f55c0 0x7effac10c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:32.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.123+0000 7effb1b14700 1 -- 172.21.15.26:0/2942004373 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff9c005040 con 0x7effac0f6860 2021-11-03T17:13:32.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.123+0000 7effb2315700 1 --2- 172.21.15.26:0/2942004373 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effac0f55c0 0x7effac10c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:13:32.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.123+0000 7effb1b14700 1 --2- 172.21.15.26:0/2942004373 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effac0f6860 0x7effac10e5d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7effa800c790 tx=0x7effa8007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:13:32.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.123+0000 7effa2ffd700 1 -- 172.21.15.26:0/2942004373 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effa800e680 con 0x7effac0f6860 2021-11-03T17:13:32.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.123+0000 7effb4579700 1 -- 172.21.15.26:0/2942004373 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effac10eac0 con 0x7effac0f6860 2021-11-03T17:13:32.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.123+0000 7effa2ffd700 1 -- 172.21.15.26:0/2942004373 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7effa800ec90 con 0x7effac0f6860 2021-11-03T17:13:32.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.123+0000 7effa2ffd700 1 -- 172.21.15.26:0/2942004373 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effa8013d60 con 0x7effac0f6860 2021-11-03T17:13:32.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.123+0000 7effb4579700 1 -- 172.21.15.26:0/2942004373 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effac10ef40 con 0x7effac0f6860 2021-11-03T17:13:32.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.124+0000 7effb4579700 1 -- 172.21.15.26:0/2942004373 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effac045ad0 con 0x7effac0f6860 2021-11-03T17:13:32.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.125+0000 7effa2ffd700 1 -- 172.21.15.26:0/2942004373 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7effa801a060 con 0x7effac0f6860 2021-11-03T17:13:32.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.125+0000 7effa2ffd700 1 --2- 172.21.15.26:0/2942004373 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7eff980640b0 0x7eff98066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:13:32.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.125+0000 7effa2ffd700 1 -- 172.21.15.26:0/2942004373 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7effa8080b90 con 0x7effac0f6860 2021-11-03T17:13:32.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.125+0000 7effb2315700 1 --2- 172.21.15.26:0/2942004373 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7eff980640b0 0x7eff98066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:13:32.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.126+0000 7effb2315700 1 --2- 172.21.15.26:0/2942004373 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7eff980640b0 0x7eff98066570 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7eff9c004e30 tx=0x7eff9c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:13:32.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.129+0000 7effa2ffd700 1 -- 172.21.15.26:0/2942004373 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7effa8052d80 con 0x7effac0f6860 2021-11-03T17:13:32.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:31 smithi194 ceph-mon[65619]: pgmap v566: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:32.297 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.302+0000 7effb4579700 1 -- 172.21.15.26:0/2942004373 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7effac0fdf30 con 0x7eff980640b0 2021-11-03T17:13:32.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.316+0000 7effa2ffd700 1 -- 172.21.15.26:0/2942004373 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7eff9c019040 con 0x7eff980640b0 2021-11-03T17:13:32.312 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:13:32.312 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (24m) 4m ago 26m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:13:32.313 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (16m) 4m ago 25m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:13:32.313 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (16m) 3m ago 25m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:13:32.313 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (24m) 4m ago 25m 39.5M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:13:32.313 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (17m) 4m ago 21m 16.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:13:32.314 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (18m) 4m ago 21m 17.8M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:13:32.314 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (21m) 3m ago 21m 19.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:13:32.314 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (21m) 3m ago 21m 19.4M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:13:32.314 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (18m) 4m ago 27m 491M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:13:32.315 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (18m) 3m ago 25m 415M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:13:32.315 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (17m) 4m ago 27m 113M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:13:32.315 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (17m) 3m ago 25m 70.2M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:13:32.315 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (25m) 4m ago 25m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:13:32.315 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (25m) 3m ago 24m 18.4M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:13:32.316 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (16m) 4m ago 24m 190M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:13:32.316 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (16m) 4m ago 24m 204M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:13:32.316 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (15m) 4m ago 23m 170M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:13:32.316 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (15m) 3m ago 23m 211M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:13:32.317 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (14m) 3m ago 23m 189M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:13:32.317 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (14m) 3m ago 22m 174M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:13:32.317 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (24m) 4m ago 25m 49.9M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:13:32.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.318+0000 7effb4579700 1 -- 172.21.15.26:0/2942004373 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7eff980640b0 msgr2=0x7eff98066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:13:32.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.318+0000 7effb4579700 1 --2- 172.21.15.26:0/2942004373 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7eff980640b0 0x7eff98066570 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7eff9c004e30 tx=0x7eff9c009b30).stop 2021-11-03T17:13:32.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.318+0000 7effb4579700 1 -- 172.21.15.26:0/2942004373 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effac0f6860 msgr2=0x7effac10e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:13:32.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.318+0000 7effb4579700 1 --2- 172.21.15.26:0/2942004373 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effac0f6860 0x7effac10e5d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7effa800c790 tx=0x7effa8007d70).stop 2021-11-03T17:13:32.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.318+0000 7effb4579700 1 -- 172.21.15.26:0/2942004373 shutdown_connections 2021-11-03T17:13:32.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.318+0000 7effb4579700 1 --2- 172.21.15.26:0/2942004373 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7eff980640b0 0x7eff98066570 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:32.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.318+0000 7effb4579700 1 --2- 172.21.15.26:0/2942004373 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effac0f55c0 0x7effac10c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:32.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.318+0000 7effb4579700 1 --2- 172.21.15.26:0/2942004373 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effac0f6860 0x7effac10e5d0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:32.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.318+0000 7effb4579700 1 -- 172.21.15.26:0/2942004373 >> 172.21.15.26:0/2942004373 conn(0x7effac0f0d40 msgr2=0x7effac0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:13:32.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.318+0000 7effb4579700 1 -- 172.21.15.26:0/2942004373 shutdown_connections 2021-11-03T17:13:32.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.318+0000 7effb4579700 1 -- 172.21.15.26:0/2942004373 wait complete. 2021-11-03T17:13:32.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.418+0000 7f23025a1700 1 -- 172.21.15.26:0/828242744 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22fc0f96b0 msgr2=0x7f22fc0fbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:13:32.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.418+0000 7f23025a1700 1 --2- 172.21.15.26:0/828242744 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22fc0f96b0 0x7f22fc0fbb00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f22f0004660 tx=0x7f22f0009b30).stop 2021-11-03T17:13:32.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.418+0000 7f23025a1700 1 -- 172.21.15.26:0/828242744 shutdown_connections 2021-11-03T17:13:32.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.418+0000 7f23025a1700 1 --2- 172.21.15.26:0/828242744 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22fc0f96b0 0x7f22fc0fbb00 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:32.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.418+0000 7f23025a1700 1 --2- 172.21.15.26:0/828242744 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22fc060270 0x7f22fc0f91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:32.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.418+0000 7f23025a1700 1 -- 172.21.15.26:0/828242744 >> 172.21.15.26:0/828242744 conn(0x7f22fc0f0ba0 msgr2=0x7f22fc0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:13:32.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.418+0000 7f23025a1700 1 -- 172.21.15.26:0/828242744 shutdown_connections 2021-11-03T17:13:32.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.418+0000 7f23025a1700 1 -- 172.21.15.26:0/828242744 wait complete. 2021-11-03T17:13:32.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.418+0000 7f23025a1700 1 Processor -- start 2021-11-03T17:13:32.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.418+0000 7f23025a1700 1 -- start start 2021-11-03T17:13:32.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.419+0000 7f23025a1700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22fc060270 0x7f22fc106db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:13:32.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.419+0000 7f23025a1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22fc0f96b0 0x7f22fc1072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:13:32.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.419+0000 7f23025a1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc1078a0 con 0x7f22fc0f96b0 2021-11-03T17:13:32.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.419+0000 7f23025a1700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc1080e0 con 0x7f22fc060270 2021-11-03T17:13:32.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.419+0000 7f2300d9e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22fc0f96b0 0x7f22fc1072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:13:32.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.419+0000 7f2300d9e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22fc0f96b0 0x7f22fc1072a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53216/0 (socket says 172.21.15.26:53216) 2021-11-03T17:13:32.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.419+0000 7f2300d9e700 1 -- 172.21.15.26:0/3608230164 learned_addr learned my addr 172.21.15.26:0/3608230164 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:13:32.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.419+0000 7f2300d9e700 1 -- 172.21.15.26:0/3608230164 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22fc060270 msgr2=0x7f22fc106db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:13:32.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.419+0000 7f2300d9e700 1 --2- 172.21.15.26:0/3608230164 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22fc060270 0x7f22fc106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:13:32.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.419+0000 7f2300d9e700 1 -- 172.21.15.26:0/3608230164 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f0005040 con 0x7f22fc0f96b0 2021-11-03T17:13:32.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.419+0000 7f2300d9e700 1 --2- 172.21.15.26:0/3608230164 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22fc0f96b0 0x7f22fc1072a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f22f0004f60 tx=0x7f22f0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:13:32.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.419+0000 7f22f9ffb700 1 -- 172.21.15.26:0/3608230164 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22f0018070 con 0x7f22fc0f96b0 2021-11-03T17:13:32.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.419+0000 7f22f9ffb700 1 -- 172.21.15.26:0/3608230164 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f22f0007c70 con 0x7f22fc0f96b0 2021-11-03T17:13:32.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.419+0000 7f22f9ffb700 1 -- 172.21.15.26:0/3608230164 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22f001c620 con 0x7f22fc0f96b0 2021-11-03T17:13:32.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.419+0000 7f23025a1700 1 -- 172.21.15.26:0/3608230164 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22fc108360 con 0x7f22fc0f96b0 2021-11-03T17:13:32.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.420+0000 7f23025a1700 1 -- 172.21.15.26:0/3608230164 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22fc108840 con 0x7f22fc0f96b0 2021-11-03T17:13:32.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.421+0000 7f23025a1700 1 -- 172.21.15.26:0/3608230164 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22fc059100 con 0x7f22fc0f96b0 2021-11-03T17:13:32.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.421+0000 7f22f9ffb700 1 -- 172.21.15.26:0/3608230164 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f22f001d420 con 0x7f22fc0f96b0 2021-11-03T17:13:32.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.421+0000 7f22f9ffb700 1 --2- 172.21.15.26:0/3608230164 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f22e4064100 0x7f22e40665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:13:32.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.421+0000 7f22f9ffb700 1 -- 172.21.15.26:0/3608230164 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f22f0082650 con 0x7f22fc0f96b0 2021-11-03T17:13:32.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.422+0000 7f230159f700 1 --2- 172.21.15.26:0/3608230164 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f22e4064100 0x7f22e40665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:13:32.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.422+0000 7f230159f700 1 --2- 172.21.15.26:0/3608230164 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f22e4064100 0x7f22e40665c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f22fc107b70 tx=0x7f22f40049c0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:13:32.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.425+0000 7f22f9ffb700 1 -- 172.21.15.26:0/3608230164 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f22f00549b0 con 0x7f22fc0f96b0 2021-11-03T17:13:32.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:31 smithi026 ceph-mon[96795]: pgmap v566: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:32.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.653+0000 7f23025a1700 1 -- 172.21.15.26:0/3608230164 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f22fc027a00 con 0x7f22fc0f96b0 2021-11-03T17:13:32.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.653+0000 7f22f9ffb700 1 -- 172.21.15.26:0/3608230164 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f22f00545a0 con 0x7f22fc0f96b0 2021-11-03T17:13:32.649 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:13:32.649 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:13:32.650 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:13:32.650 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:13:32.650 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:13:32.650 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:13:32.651 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:13:32.651 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:13:32.651 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:13:32.651 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:13:32.652 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:13:32.652 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:13:32.652 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:13:32.652 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:13:32.652 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:13:32.653 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:13:32.653 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:13:32.653 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:13:32.654 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.655+0000 7f23025a1700 1 -- 172.21.15.26:0/3608230164 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f22e4064100 msgr2=0x7f22e40665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:13:32.654 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.655+0000 7f23025a1700 1 --2- 172.21.15.26:0/3608230164 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f22e4064100 0x7f22e40665c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f22fc107b70 tx=0x7f22f40049c0).stop 2021-11-03T17:13:32.654 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.655+0000 7f23025a1700 1 -- 172.21.15.26:0/3608230164 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22fc0f96b0 msgr2=0x7f22fc1072a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:13:32.655 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.655+0000 7f23025a1700 1 --2- 172.21.15.26:0/3608230164 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22fc0f96b0 0x7f22fc1072a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f22f0004f60 tx=0x7f22f0009b30).stop 2021-11-03T17:13:32.655 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.655+0000 7f23025a1700 1 -- 172.21.15.26:0/3608230164 shutdown_connections 2021-11-03T17:13:32.655 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.655+0000 7f23025a1700 1 --2- 172.21.15.26:0/3608230164 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f22e4064100 0x7f22e40665c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:32.655 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.655+0000 7f23025a1700 1 --2- 172.21.15.26:0/3608230164 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22fc060270 0x7f22fc106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:13:32.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.655+0000 7f23025a1700 1 --2- 172.21.15.26:0/3608230164 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22fc0f96b0 0x7f22fc1072a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:32.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.655+0000 7f23025a1700 1 -- 172.21.15.26:0/3608230164 >> 172.21.15.26:0/3608230164 conn(0x7f22fc0f0ba0 msgr2=0x7f22fc0f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:13:32.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.655+0000 7f23025a1700 1 -- 172.21.15.26:0/3608230164 shutdown_connections 2021-11-03T17:13:32.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.655+0000 7f23025a1700 1 -- 172.21.15.26:0/3608230164 wait complete. 2021-11-03T17:13:32.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.755+0000 7f65bcd9c700 1 -- 172.21.15.26:0/474072809 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65b80f55c0 msgr2=0x7f65b80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:13:32.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.755+0000 7f65bcd9c700 1 --2- 172.21.15.26:0/474072809 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65b80f55c0 0x7f65b80f59e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f65a0004660 tx=0x7f65a0009b30).stop 2021-11-03T17:13:32.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.755+0000 7f65bcd9c700 1 -- 172.21.15.26:0/474072809 shutdown_connections 2021-11-03T17:13:32.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.755+0000 7f65bcd9c700 1 --2- 172.21.15.26:0/474072809 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65b80f5ed0 0x7f65b80f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:32.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.755+0000 7f65bcd9c700 1 --2- 172.21.15.26:0/474072809 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65b80f55c0 0x7f65b80f59e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:32.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.755+0000 7f65bcd9c700 1 -- 172.21.15.26:0/474072809 >> 172.21.15.26:0/474072809 conn(0x7f65b80f0de0 msgr2=0x7f65b80f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:13:32.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.755+0000 7f65bcd9c700 1 -- 172.21.15.26:0/474072809 shutdown_connections 2021-11-03T17:13:32.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.755+0000 7f65bcd9c700 1 -- 172.21.15.26:0/474072809 wait complete. 2021-11-03T17:13:32.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.756+0000 7f65bcd9c700 1 Processor -- start 2021-11-03T17:13:32.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.756+0000 7f65bcd9c700 1 -- start start 2021-11-03T17:13:32.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.756+0000 7f65bcd9c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65b80f55c0 0x7f65b8109c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:13:32.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.756+0000 7f65bcd9c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65b80f5ed0 0x7f65b810c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:13:32.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.756+0000 7f65bcd9c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b8060500 con 0x7f65b80f5ed0 2021-11-03T17:13:32.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.756+0000 7f65bcd9c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b8060640 con 0x7f65b80f55c0 2021-11-03T17:13:32.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.756+0000 7f65b5d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65b80f5ed0 0x7f65b810c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:13:32.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.756+0000 7f65b5d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65b80f5ed0 0x7f65b810c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53226/0 (socket says 172.21.15.26:53226) 2021-11-03T17:13:32.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.756+0000 7f65b5d9b700 1 -- 172.21.15.26:0/3791339989 learned_addr learned my addr 172.21.15.26:0/3791339989 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:13:32.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.756+0000 7f65b659c700 1 --2- 172.21.15.26:0/3791339989 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65b80f55c0 0x7f65b8109c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:13:32.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.756+0000 7f65b5d9b700 1 -- 172.21.15.26:0/3791339989 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65b80f55c0 msgr2=0x7f65b8109c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:13:32.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.756+0000 7f65b5d9b700 1 --2- 172.21.15.26:0/3791339989 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65b80f55c0 0x7f65b8109c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:32.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.756+0000 7f65b5d9b700 1 -- 172.21.15.26:0/3791339989 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a0005040 con 0x7f65b80f5ed0 2021-11-03T17:13:32.757 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.756+0000 7f65b5d9b700 1 --2- 172.21.15.26:0/3791339989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65b80f5ed0 0x7f65b810c130 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f65a800c530 tx=0x7f65a8007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:13:32.758 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.757+0000 7f65aeffd700 1 -- 172.21.15.26:0/3791339989 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65a800f650 con 0x7f65b80f5ed0 2021-11-03T17:13:32.758 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.757+0000 7f65bcd9c700 1 -- 172.21.15.26:0/3791339989 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65b810c740 con 0x7f65b80f5ed0 2021-11-03T17:13:32.759 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.757+0000 7f65aeffd700 1 -- 172.21.15.26:0/3791339989 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f65a800fc60 con 0x7f65b80f5ed0 2021-11-03T17:13:32.759 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.757+0000 7f65aeffd700 1 -- 172.21.15.26:0/3791339989 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65a8012cd0 con 0x7f65b80f5ed0 2021-11-03T17:13:32.759 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.757+0000 7f65bcd9c700 1 -- 172.21.15.26:0/3791339989 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65b810ccd0 con 0x7f65b80f5ed0 2021-11-03T17:13:32.759 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.758+0000 7f65bcd9c700 1 -- 172.21.15.26:0/3791339989 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65b80f4a50 con 0x7f65b80f5ed0 2021-11-03T17:13:32.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.758+0000 7f65aeffd700 1 -- 172.21.15.26:0/3791339989 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f65a8010070 con 0x7f65b80f5ed0 2021-11-03T17:13:32.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.758+0000 7f65aeffd700 1 --2- 172.21.15.26:0/3791339989 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f65a40640b0 0x7f65a4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:13:32.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.759+0000 7f65aeffd700 1 -- 172.21.15.26:0/3791339989 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f65a8080710 con 0x7f65b80f5ed0 2021-11-03T17:13:32.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.759+0000 7f65b659c700 1 --2- 172.21.15.26:0/3791339989 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f65a40640b0 0x7f65a4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:13:32.761 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.759+0000 7f65b659c700 1 --2- 172.21.15.26:0/3791339989 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f65a40640b0 0x7f65a4066570 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f65a0009da0 tx=0x7f65a0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:13:32.761 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.763+0000 7f65aeffd700 1 -- 172.21.15.26:0/3791339989 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f65a8052980 con 0x7f65b80f5ed0 2021-11-03T17:13:32.965 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.969+0000 7f65bcd9c700 1 -- 172.21.15.26:0/3791339989 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f65b8045ad0 con 0x7f65b80f5ed0 2021-11-03T17:13:32.965 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.969+0000 7f65aeffd700 1 -- 172.21.15.26:0/3791339989 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f65a8052570 con 0x7f65b80f5ed0 2021-11-03T17:13:32.965 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:13:32.966 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:13:32.966 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:13:32.966 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:13:32.967 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:13:32.967 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:13:32.967 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:13:32.967 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:13:32.967 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:13:32.968 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:13:32.968 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:13:32.968 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:13:32.968 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:13:32.969 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:13:32.969 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:13:32.969 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:13:32.969 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:13:32.969 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:13:32.970 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:13:32.970 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:13:32.970 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:13:32.970 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:13:32.971 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:13:32.971 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:13:32.971 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:13:32.971 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:13:32.971 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:13:32.972 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:13:32.972 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:13:32.972 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:13:32.972 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:13:32.972 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:13:32.973 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:13:32.973 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:13:32.973 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:13:32.973 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:13:32.973 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:13:32.974 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:13:32.974 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:13:32.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.971+0000 7f65bcd9c700 1 -- 172.21.15.26:0/3791339989 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f65a40640b0 msgr2=0x7f65a4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:13:32.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.971+0000 7f65bcd9c700 1 --2- 172.21.15.26:0/3791339989 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f65a40640b0 0x7f65a4066570 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f65a0009da0 tx=0x7f65a0009b30).stop 2021-11-03T17:13:32.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.971+0000 7f65bcd9c700 1 -- 172.21.15.26:0/3791339989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65b80f5ed0 msgr2=0x7f65b810c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:13:32.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.971+0000 7f65bcd9c700 1 --2- 172.21.15.26:0/3791339989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65b80f5ed0 0x7f65b810c130 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f65a800c530 tx=0x7f65a8007e20).stop 2021-11-03T17:13:32.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.971+0000 7f65bcd9c700 1 -- 172.21.15.26:0/3791339989 shutdown_connections 2021-11-03T17:13:32.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.971+0000 7f65bcd9c700 1 --2- 172.21.15.26:0/3791339989 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f65a40640b0 0x7f65a4066570 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:32.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.971+0000 7f65bcd9c700 1 --2- 172.21.15.26:0/3791339989 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65b80f55c0 0x7f65b8109c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:32.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.971+0000 7f65bcd9c700 1 --2- 172.21.15.26:0/3791339989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65b80f5ed0 0x7f65b810c130 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:13:32.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.971+0000 7f65bcd9c700 1 -- 172.21.15.26:0/3791339989 >> 172.21.15.26:0/3791339989 conn(0x7f65b80f0de0 msgr2=0x7f65b80fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:13:32.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.972+0000 7f65bcd9c700 1 -- 172.21.15.26:0/3791339989 shutdown_connections 2021-11-03T17:13:32.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:13:32.972+0000 7f65bcd9c700 1 -- 172.21.15.26:0/3791339989 wait complete. 2021-11-03T17:13:32.977 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:13:33.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:32 smithi194 ceph-mon[65619]: from='client.34732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:13:33.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:32 smithi194 ceph-mon[65619]: from='client.34736 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:13:33.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:32 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3608230164' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:13:33.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:32 smithi026 ceph-mon[96795]: from='client.34732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:13:33.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:32 smithi026 ceph-mon[96795]: from='client.34736 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:13:33.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:32 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3608230164' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:13:34.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:33 smithi194 ceph-mon[65619]: pgmap v567: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:34.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:33 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3791339989' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:13:34.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:33 smithi026 ceph-mon[96795]: pgmap v567: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:34.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:33 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3791339989' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:13:36.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:35 smithi194 ceph-mon[65619]: pgmap v568: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:36.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:35 smithi026 ceph-mon[96795]: pgmap v568: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:38.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:37 smithi194 ceph-mon[65619]: pgmap v569: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:38.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:37 smithi026 ceph-mon[96795]: pgmap v569: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:38.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:38 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:13:39.032 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:38 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:13:40.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:40 smithi026 ceph-mon[96795]: pgmap v570: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:40.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:40 smithi026 ceph-mon[96795]: poll took 60065.469 ms: 1 events 2021-11-03T17:13:40.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:13:40.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:13:40.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:13:40.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:13:40.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:13:40.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:13:40.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:40 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:13:40.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:13:40.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:40 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:13:40.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:40 smithi194 ceph-mon[65619]: pgmap v570: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:40.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:40 smithi194 ceph-mon[65619]: poll took 60065.469 ms: 1 events 2021-11-03T17:13:40.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:13:40.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:13:40.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:13:40.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:13:40.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:13:40.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:13:40.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:40 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:13:40.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:13:40.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:40 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:13:42.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:42 smithi026 ceph-mon[96795]: pgmap v571: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:42.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:42 smithi194 ceph-mon[65619]: pgmap v571: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:44.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:44 smithi026 ceph-mon[96795]: pgmap v572: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:44.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:44 smithi194 ceph-mon[65619]: pgmap v572: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:46.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:46 smithi026 ceph-mon[96795]: pgmap v573: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:46.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:46 smithi194 ceph-mon[65619]: pgmap v573: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:48.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:48 smithi026 ceph-mon[96795]: pgmap v574: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:48.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:48 smithi194 ceph-mon[65619]: pgmap v574: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:49.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:13:49.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:13:49.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:13:49.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:13:50.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:50 smithi026 ceph-mon[96795]: pgmap v575: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:50.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:50 smithi194 ceph-mon[65619]: pgmap v575: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:52.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:52 smithi026 ceph-mon[96795]: pgmap v576: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:52.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:52 smithi194 ceph-mon[65619]: pgmap v576: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:54.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:54 smithi026 ceph-mon[96795]: pgmap v577: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:54.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:54 smithi194 ceph-mon[65619]: pgmap v577: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:55.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:13:55.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:55 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:13:55.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:13:55.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:55 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:13:56.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:56 smithi026 ceph-mon[96795]: pgmap v578: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:56.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:56 smithi194 ceph-mon[65619]: pgmap v578: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:58.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:13:58 smithi026 ceph-mon[96795]: pgmap v579: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:13:58.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:13:58 smithi194 ceph-mon[65619]: pgmap v579: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:00.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:00 smithi026 ceph-mon[96795]: pgmap v580: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:00.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:00 smithi194 ceph-mon[65619]: pgmap v580: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:02.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:02 smithi026 ceph-mon[96795]: pgmap v581: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:02.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:02 smithi194 ceph-mon[65619]: pgmap v581: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:03.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.090+0000 7f7d4a27b700 1 -- 172.21.15.26:0/520914435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d44060330 msgr2=0x7f7d440f93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:14:03.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.090+0000 7f7d4a27b700 1 --2- 172.21.15.26:0/520914435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d44060330 0x7f7d440f93c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f7d2c004660 tx=0x7f7d2c009b30).stop 2021-11-03T17:14:03.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.090+0000 7f7d4a27b700 1 -- 172.21.15.26:0/520914435 shutdown_connections 2021-11-03T17:14:03.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.090+0000 7f7d4a27b700 1 --2- 172.21.15.26:0/520914435 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d440f98b0 0x7f7d440fbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:14:03.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.090+0000 7f7d4a27b700 1 --2- 172.21.15.26:0/520914435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d44060330 0x7f7d440f93c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:03.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.090+0000 7f7d4a27b700 1 -- 172.21.15.26:0/520914435 >> 172.21.15.26:0/520914435 conn(0x7f7d440f0de0 msgr2=0x7f7d440f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:14:03.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.090+0000 7f7d4a27b700 1 -- 172.21.15.26:0/520914435 shutdown_connections 2021-11-03T17:14:03.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.090+0000 7f7d4a27b700 1 -- 172.21.15.26:0/520914435 wait complete. 2021-11-03T17:14:03.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.090+0000 7f7d4a27b700 1 Processor -- start 2021-11-03T17:14:03.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.090+0000 7f7d4a27b700 1 -- start start 2021-11-03T17:14:03.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.091+0000 7f7d4a27b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d44060330 0x7f7d44106fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:14:03.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.091+0000 7f7d4a27b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d440f98b0 0x7f7d44107490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:14:03.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.091+0000 7f7d4a27b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d44107ad0 con 0x7f7d44060330 2021-11-03T17:14:03.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.091+0000 7f7d4a27b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d44108380 con 0x7f7d440f98b0 2021-11-03T17:14:03.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.091+0000 7f7d43fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d44060330 0x7f7d44106fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:14:03.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.091+0000 7f7d43fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d44060330 0x7f7d44106fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53242/0 (socket says 172.21.15.26:53242) 2021-11-03T17:14:03.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.091+0000 7f7d43fff700 1 -- 172.21.15.26:0/2156781540 learned_addr learned my addr 172.21.15.26:0/2156781540 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:14:03.090 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.091+0000 7f7d437fe700 1 --2- 172.21.15.26:0/2156781540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d440f98b0 0x7f7d44107490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:14:03.090 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.091+0000 7f7d43fff700 1 -- 172.21.15.26:0/2156781540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d440f98b0 msgr2=0x7f7d44107490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:14:03.090 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.091+0000 7f7d43fff700 1 --2- 172.21.15.26:0/2156781540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d440f98b0 0x7f7d44107490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:03.090 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.091+0000 7f7d43fff700 1 -- 172.21.15.26:0/2156781540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d2c005040 con 0x7f7d44060330 2021-11-03T17:14:03.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.091+0000 7f7d437fe700 1 --2- 172.21.15.26:0/2156781540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d440f98b0 0x7f7d44107490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:14:03.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.091+0000 7f7d43fff700 1 --2- 172.21.15.26:0/2156781540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d44060330 0x7f7d44106fa0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f7d2c004f60 tx=0x7f7d2c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:14:03.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.091+0000 7f7d40ff9700 1 -- 172.21.15.26:0/2156781540 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d2c018070 con 0x7f7d44060330 2021-11-03T17:14:03.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.091+0000 7f7d40ff9700 1 -- 172.21.15.26:0/2156781540 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7d2c007ba0 con 0x7f7d44060330 2021-11-03T17:14:03.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.091+0000 7f7d4a27b700 1 -- 172.21.15.26:0/2156781540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d44108600 con 0x7f7d44060330 2021-11-03T17:14:03.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.092+0000 7f7d40ff9700 1 -- 172.21.15.26:0/2156781540 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d2c01c620 con 0x7f7d44060330 2021-11-03T17:14:03.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.092+0000 7f7d4a27b700 1 -- 172.21.15.26:0/2156781540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d44108b60 con 0x7f7d44060330 2021-11-03T17:14:03.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.092+0000 7f7d4a27b700 1 -- 172.21.15.26:0/2156781540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d440f4a70 con 0x7f7d44060330 2021-11-03T17:14:03.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.093+0000 7f7d40ff9700 1 -- 172.21.15.26:0/2156781540 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f7d2c01c8e0 con 0x7f7d44060330 2021-11-03T17:14:03.094 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.093+0000 7f7d40ff9700 1 --2- 172.21.15.26:0/2156781540 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7d300640b0 0x7f7d30066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:14:03.094 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.094+0000 7f7d40ff9700 1 -- 172.21.15.26:0/2156781540 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f7d2c0826e0 con 0x7f7d44060330 2021-11-03T17:14:03.094 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.094+0000 7f7d437fe700 1 --2- 172.21.15.26:0/2156781540 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7d300640b0 0x7f7d30066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:14:03.094 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.094+0000 7f7d437fe700 1 --2- 172.21.15.26:0/2156781540 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7d300640b0 0x7f7d30066570 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f7d3400a7e0 tx=0x7f7d34008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:14:03.094 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.098+0000 7f7d40ff9700 1 -- 172.21.15.26:0/2156781540 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f7d2c054a40 con 0x7f7d44060330 2021-11-03T17:14:03.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.276+0000 7f7d4a27b700 1 -- 172.21.15.26:0/2156781540 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7d440ff020 con 0x7f7d300640b0 2021-11-03T17:14:03.272 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.278+0000 7f7d40ff9700 1 -- 172.21.15.26:0/2156781540 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f7d440ff020 con 0x7f7d300640b0 2021-11-03T17:14:03.274 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.279+0000 7f7d4a27b700 1 -- 172.21.15.26:0/2156781540 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7d300640b0 msgr2=0x7f7d30066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:14:03.274 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.279+0000 7f7d4a27b700 1 --2- 172.21.15.26:0/2156781540 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7d300640b0 0x7f7d30066570 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f7d3400a7e0 tx=0x7f7d34008040).stop 2021-11-03T17:14:03.274 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.279+0000 7f7d4a27b700 1 -- 172.21.15.26:0/2156781540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d44060330 msgr2=0x7f7d44106fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:14:03.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.279+0000 7f7d4a27b700 1 --2- 172.21.15.26:0/2156781540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d44060330 0x7f7d44106fa0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f7d2c004f60 tx=0x7f7d2c009b30).stop 2021-11-03T17:14:03.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.279+0000 7f7d4a27b700 1 -- 172.21.15.26:0/2156781540 shutdown_connections 2021-11-03T17:14:03.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.279+0000 7f7d4a27b700 1 --2- 172.21.15.26:0/2156781540 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7d300640b0 0x7f7d30066570 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:03.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.279+0000 7f7d4a27b700 1 --2- 172.21.15.26:0/2156781540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d44060330 0x7f7d44106fa0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:03.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.279+0000 7f7d4a27b700 1 --2- 172.21.15.26:0/2156781540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d440f98b0 0x7f7d44107490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:03.276 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.279+0000 7f7d4a27b700 1 -- 172.21.15.26:0/2156781540 >> 172.21.15.26:0/2156781540 conn(0x7f7d440f0de0 msgr2=0x7f7d440f31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:14:03.276 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.280+0000 7f7d4a27b700 1 -- 172.21.15.26:0/2156781540 shutdown_connections 2021-11-03T17:14:03.276 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.280+0000 7f7d4a27b700 1 -- 172.21.15.26:0/2156781540 wait complete. 2021-11-03T17:14:03.284 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:14:03.375 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.380+0000 7f774da5b700 1 -- 172.21.15.26:0/1167901490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77480f66e0 msgr2=0x7f77480f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:14:03.375 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.380+0000 7f774da5b700 1 --2- 172.21.15.26:0/1167901490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77480f66e0 0x7f77480f6b40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f7734004660 tx=0x7f7734009b30).stop 2021-11-03T17:14:03.376 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.380+0000 7f774da5b700 1 -- 172.21.15.26:0/1167901490 shutdown_connections 2021-11-03T17:14:03.376 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.380+0000 7f774da5b700 1 --2- 172.21.15.26:0/1167901490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77480f66e0 0x7f77480f6b40 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:03.376 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.380+0000 7f774da5b700 1 --2- 172.21.15.26:0/1167901490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77480f5440 0x7f77480f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:14:03.376 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.380+0000 7f774da5b700 1 -- 172.21.15.26:0/1167901490 >> 172.21.15.26:0/1167901490 conn(0x7f77480f0ba0 msgr2=0x7f77480f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:14:03.377 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.380+0000 7f774da5b700 1 -- 172.21.15.26:0/1167901490 shutdown_connections 2021-11-03T17:14:03.377 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.380+0000 7f774da5b700 1 -- 172.21.15.26:0/1167901490 wait complete. 2021-11-03T17:14:03.377 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.381+0000 7f774da5b700 1 Processor -- start 2021-11-03T17:14:03.377 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.381+0000 7f774da5b700 1 -- start start 2021-11-03T17:14:03.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.381+0000 7f774da5b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77480f5440 0x7f7748105d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:14:03.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.381+0000 7f774da5b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77480f66e0 0x7f7748106210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:14:03.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.381+0000 7f774da5b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7748106850 con 0x7f77480f5440 2021-11-03T17:14:03.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.381+0000 7f774da5b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7748106fc0 con 0x7f77480f66e0 2021-11-03T17:14:03.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.381+0000 7f774ca59700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77480f5440 0x7f7748105d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:14:03.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.381+0000 7f774ca59700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77480f5440 0x7f7748105d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53252/0 (socket says 172.21.15.26:53252) 2021-11-03T17:14:03.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.381+0000 7f774ca59700 1 -- 172.21.15.26:0/187810669 learned_addr learned my addr 172.21.15.26:0/187810669 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:14:03.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.381+0000 7f7747fff700 1 --2- 172.21.15.26:0/187810669 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77480f66e0 0x7f7748106210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:14:03.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.382+0000 7f774ca59700 1 -- 172.21.15.26:0/187810669 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77480f66e0 msgr2=0x7f7748106210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:14:03.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.382+0000 7f774ca59700 1 --2- 172.21.15.26:0/187810669 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77480f66e0 0x7f7748106210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:03.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.382+0000 7f774ca59700 1 -- 172.21.15.26:0/187810669 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7734005040 con 0x7f77480f5440 2021-11-03T17:14:03.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.382+0000 7f774ca59700 1 --2- 172.21.15.26:0/187810669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77480f5440 0x7f7748105d20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f773c0093f0 tx=0x7f773c006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:14:03.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.382+0000 7f77457fa700 1 -- 172.21.15.26:0/187810669 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f773c009ea0 con 0x7f77480f5440 2021-11-03T17:14:03.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.382+0000 7f774da5b700 1 -- 172.21.15.26:0/187810669 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77481072a0 con 0x7f77480f5440 2021-11-03T17:14:03.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.382+0000 7f77457fa700 1 -- 172.21.15.26:0/187810669 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f773c013af0 con 0x7f77480f5440 2021-11-03T17:14:03.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.382+0000 7f77457fa700 1 -- 172.21.15.26:0/187810669 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f773c00db10 con 0x7f77480f5440 2021-11-03T17:14:03.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.382+0000 7f774da5b700 1 -- 172.21.15.26:0/187810669 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7748107860 con 0x7f77480f5440 2021-11-03T17:14:03.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.383+0000 7f774da5b700 1 -- 172.21.15.26:0/187810669 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7748045ad0 con 0x7f77480f5440 2021-11-03T17:14:03.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.383+0000 7f77457fa700 1 -- 172.21.15.26:0/187810669 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f773c01a060 con 0x7f77480f5440 2021-11-03T17:14:03.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.384+0000 7f77457fa700 1 --2- 172.21.15.26:0/187810669 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7738064100 0x7f77380665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:14:03.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.384+0000 7f77457fa700 1 -- 172.21.15.26:0/187810669 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f773c0808e0 con 0x7f77480f5440 2021-11-03T17:14:03.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.384+0000 7f7747fff700 1 --2- 172.21.15.26:0/187810669 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7738064100 0x7f77380665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:14:03.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.384+0000 7f7747fff700 1 --2- 172.21.15.26:0/187810669 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7738064100 0x7f77380665c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f7734004e30 tx=0x7f7734009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:14:03.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.388+0000 7f77457fa700 1 -- 172.21.15.26:0/187810669 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f773c052b50 con 0x7f77480f5440 2021-11-03T17:14:03.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.564+0000 7f774da5b700 1 -- 172.21.15.26:0/187810669 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f77480fdd80 con 0x7f7738064100 2021-11-03T17:14:03.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.579+0000 7f77457fa700 1 -- 172.21.15.26:0/187810669 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f77480fdd80 con 0x7f7738064100 2021-11-03T17:14:03.574 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:14:03.574 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (25m) 5m ago 26m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:14:03.575 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (17m) 5m ago 26m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:14:03.575 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (17m) 4m ago 25m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:14:03.575 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (25m) 5m ago 26m 39.5M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:14:03.575 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (18m) 5m ago 21m 16.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:14:03.576 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (18m) 5m ago 21m 17.8M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:14:03.576 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (21m) 4m ago 21m 19.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:14:03.576 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (21m) 4m ago 21m 19.4M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:14:03.576 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (19m) 5m ago 27m 491M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:14:03.577 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (18m) 4m ago 25m 415M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:14:03.577 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (18m) 5m ago 28m 113M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:14:03.577 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (18m) 4m ago 25m 70.2M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:14:03.577 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (26m) 5m ago 26m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:14:03.578 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (25m) 4m ago 25m 18.4M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:14:03.578 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (17m) 5m ago 24m 190M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:14:03.578 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (16m) 5m ago 24m 204M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:14:03.578 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (16m) 5m ago 24m 170M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:14:03.578 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (15m) 4m ago 23m 211M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:14:03.579 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (15m) 4m ago 23m 189M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:14:03.579 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (14m) 4m ago 23m 174M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:14:03.579 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (25m) 5m ago 25m 49.9M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:14:03.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.581+0000 7f774da5b700 1 -- 172.21.15.26:0/187810669 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7738064100 msgr2=0x7f77380665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:14:03.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.581+0000 7f774da5b700 1 --2- 172.21.15.26:0/187810669 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7738064100 0x7f77380665c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f7734004e30 tx=0x7f7734009b30).stop 2021-11-03T17:14:03.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.581+0000 7f774da5b700 1 -- 172.21.15.26:0/187810669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77480f5440 msgr2=0x7f7748105d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:14:03.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.581+0000 7f774da5b700 1 --2- 172.21.15.26:0/187810669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77480f5440 0x7f7748105d20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f773c0093f0 tx=0x7f773c006ec0).stop 2021-11-03T17:14:03.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.581+0000 7f774da5b700 1 -- 172.21.15.26:0/187810669 shutdown_connections 2021-11-03T17:14:03.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.581+0000 7f774da5b700 1 --2- 172.21.15.26:0/187810669 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7738064100 0x7f77380665c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:03.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.581+0000 7f774da5b700 1 --2- 172.21.15.26:0/187810669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77480f5440 0x7f7748105d20 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:03.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.581+0000 7f774da5b700 1 --2- 172.21.15.26:0/187810669 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77480f66e0 0x7f7748106210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:03.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.581+0000 7f774da5b700 1 -- 172.21.15.26:0/187810669 >> 172.21.15.26:0/187810669 conn(0x7f77480f0ba0 msgr2=0x7f77480fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:14:03.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.581+0000 7f774da5b700 1 -- 172.21.15.26:0/187810669 shutdown_connections 2021-11-03T17:14:03.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.581+0000 7f774da5b700 1 -- 172.21.15.26:0/187810669 wait complete. 2021-11-03T17:14:03.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.680+0000 7f611759e700 1 -- 172.21.15.26:0/1237906525 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61180f77d0 msgr2=0x7f61180f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:14:03.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.680+0000 7f611759e700 1 --2- 172.21.15.26:0/1237906525 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61180f77d0 0x7f61180f7c30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f610c004660 tx=0x7f610c009b30).stop 2021-11-03T17:14:03.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.681+0000 7f611759e700 1 -- 172.21.15.26:0/1237906525 shutdown_connections 2021-11-03T17:14:03.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.681+0000 7f611759e700 1 --2- 172.21.15.26:0/1237906525 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61180f77d0 0x7f61180f7c30 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:03.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.681+0000 7f611759e700 1 --2- 172.21.15.26:0/1237906525 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61180f6530 0x7f61180f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:03.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.681+0000 7f611759e700 1 -- 172.21.15.26:0/1237906525 >> 172.21.15.26:0/1237906525 conn(0x7f61180f1cd0 msgr2=0x7f61180f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:14:03.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.681+0000 7f611759e700 1 -- 172.21.15.26:0/1237906525 shutdown_connections 2021-11-03T17:14:03.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.681+0000 7f611759e700 1 -- 172.21.15.26:0/1237906525 wait complete. 2021-11-03T17:14:03.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.681+0000 7f611759e700 1 Processor -- start 2021-11-03T17:14:03.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.681+0000 7f611759e700 1 -- start start 2021-11-03T17:14:03.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.681+0000 7f611759e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61180f6530 0x7f6118106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:14:03.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.681+0000 7f611759e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61180f77d0 0x7f6118107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:14:03.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.681+0000 7f611759e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6118107870 con 0x7f61180f77d0 2021-11-03T17:14:03.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.681+0000 7f611759e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6118108080 con 0x7f61180f6530 2021-11-03T17:14:03.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.682+0000 7f6115d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61180f77d0 0x7f6118107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:14:03.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.682+0000 7f6115d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61180f77d0 0x7f6118107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53264/0 (socket says 172.21.15.26:53264) 2021-11-03T17:14:03.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.682+0000 7f6115d9b700 1 -- 172.21.15.26:0/196461361 learned_addr learned my addr 172.21.15.26:0/196461361 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:14:03.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.682+0000 7f611659c700 1 --2- 172.21.15.26:0/196461361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61180f6530 0x7f6118106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:14:03.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.682+0000 7f6115d9b700 1 -- 172.21.15.26:0/196461361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61180f6530 msgr2=0x7f6118106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:14:03.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.682+0000 7f6115d9b700 1 --2- 172.21.15.26:0/196461361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61180f6530 0x7f6118106d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:03.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.682+0000 7f6115d9b700 1 -- 172.21.15.26:0/196461361 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610c005040 con 0x7f61180f77d0 2021-11-03T17:14:03.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.682+0000 7f6115d9b700 1 --2- 172.21.15.26:0/196461361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61180f77d0 0x7f6118107270 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f610c009990 tx=0x7f610c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:14:03.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.682+0000 7f6106ffd700 1 -- 172.21.15.26:0/196461361 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f610c018070 con 0x7f61180f77d0 2021-11-03T17:14:03.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.682+0000 7f611759e700 1 -- 172.21.15.26:0/196461361 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61181082a0 con 0x7f61180f77d0 2021-11-03T17:14:03.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.682+0000 7f6106ffd700 1 -- 172.21.15.26:0/196461361 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f610c007ba0 con 0x7f61180f77d0 2021-11-03T17:14:03.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.682+0000 7f6106ffd700 1 -- 172.21.15.26:0/196461361 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f610c01c3c0 con 0x7f61180f77d0 2021-11-03T17:14:03.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.682+0000 7f611759e700 1 -- 172.21.15.26:0/196461361 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6118108800 con 0x7f61180f77d0 2021-11-03T17:14:03.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.683+0000 7f611759e700 1 -- 172.21.15.26:0/196461361 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6118059100 con 0x7f61180f77d0 2021-11-03T17:14:03.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.684+0000 7f6106ffd700 1 -- 172.21.15.26:0/196461361 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f610c01d420 con 0x7f61180f77d0 2021-11-03T17:14:03.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.684+0000 7f6106ffd700 1 --2- 172.21.15.26:0/196461361 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6100068510 0x7f610006a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:14:03.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.684+0000 7f6106ffd700 1 -- 172.21.15.26:0/196461361 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f610c0826d0 con 0x7f61180f77d0 2021-11-03T17:14:03.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.684+0000 7f611659c700 1 --2- 172.21.15.26:0/196461361 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6100068510 0x7f610006a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:14:03.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.685+0000 7f611659c700 1 --2- 172.21.15.26:0/196461361 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6100068510 0x7f610006a9d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f6118106af0 tx=0x7f6108009c00).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:14:03.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.688+0000 7f6106ffd700 1 -- 172.21.15.26:0/196461361 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f610c054990 con 0x7f61180f77d0 2021-11-03T17:14:03.910 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.916+0000 7f611759e700 1 -- 172.21.15.26:0/196461361 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f61180fed50 con 0x7f61180f77d0 2021-11-03T17:14:03.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.916+0000 7f6106ffd700 1 -- 172.21.15.26:0/196461361 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f610c054580 con 0x7f61180f77d0 2021-11-03T17:14:03.911 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:14:03.912 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:14:03.912 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:14:03.912 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:14:03.912 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:14:03.913 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:14:03.913 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:14:03.913 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:14:03.913 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:14:03.913 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:14:03.914 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:14:03.914 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:14:03.914 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:14:03.914 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:14:03.915 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:14:03.915 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:14:03.915 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:14:03.915 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:14:03.916 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.918+0000 7f611759e700 1 -- 172.21.15.26:0/196461361 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6100068510 msgr2=0x7f610006a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:14:03.916 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.918+0000 7f611759e700 1 --2- 172.21.15.26:0/196461361 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6100068510 0x7f610006a9d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f6118106af0 tx=0x7f6108009c00).stop 2021-11-03T17:14:03.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.918+0000 7f611759e700 1 -- 172.21.15.26:0/196461361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61180f77d0 msgr2=0x7f6118107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:14:03.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.918+0000 7f611759e700 1 --2- 172.21.15.26:0/196461361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61180f77d0 0x7f6118107270 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f610c009990 tx=0x7f610c009b30).stop 2021-11-03T17:14:03.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.918+0000 7f611759e700 1 -- 172.21.15.26:0/196461361 shutdown_connections 2021-11-03T17:14:03.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.918+0000 7f611759e700 1 --2- 172.21.15.26:0/196461361 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6100068510 0x7f610006a9d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:03.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.918+0000 7f611759e700 1 --2- 172.21.15.26:0/196461361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61180f6530 0x7f6118106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:03.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.918+0000 7f611759e700 1 --2- 172.21.15.26:0/196461361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61180f77d0 0x7f6118107270 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:03.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.918+0000 7f611759e700 1 -- 172.21.15.26:0/196461361 >> 172.21.15.26:0/196461361 conn(0x7f61180f1cd0 msgr2=0x7f61180fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:14:03.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.918+0000 7f611759e700 1 -- 172.21.15.26:0/196461361 shutdown_connections 2021-11-03T17:14:03.919 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:03.918+0000 7f611759e700 1 -- 172.21.15.26:0/196461361 wait complete. 2021-11-03T17:14:04.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.019+0000 7f28b7fff700 1 -- 172.21.15.26:0/4167400437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28b80f77d0 msgr2=0x7f28b80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:14:04.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.019+0000 7f28b7fff700 1 --2- 172.21.15.26:0/4167400437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28b80f77d0 0x7f28b80f7c30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f28ac004660 tx=0x7f28ac009b30).stop 2021-11-03T17:14:04.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.019+0000 7f28b7fff700 1 -- 172.21.15.26:0/4167400437 shutdown_connections 2021-11-03T17:14:04.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.019+0000 7f28b7fff700 1 --2- 172.21.15.26:0/4167400437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28b80f77d0 0x7f28b80f7c30 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:04.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.019+0000 7f28b7fff700 1 --2- 172.21.15.26:0/4167400437 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28b80f6530 0x7f28b80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:04.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.019+0000 7f28b7fff700 1 -- 172.21.15.26:0/4167400437 >> 172.21.15.26:0/4167400437 conn(0x7f28b80f1cd0 msgr2=0x7f28b80f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:14:04.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.019+0000 7f28b7fff700 1 -- 172.21.15.26:0/4167400437 shutdown_connections 2021-11-03T17:14:04.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.019+0000 7f28b7fff700 1 -- 172.21.15.26:0/4167400437 wait complete. 2021-11-03T17:14:04.018 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.020+0000 7f28b7fff700 1 Processor -- start 2021-11-03T17:14:04.019 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.020+0000 7f28b7fff700 1 -- start start 2021-11-03T17:14:04.019 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.020+0000 7f28b7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28b80f6530 0x7f28b8106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:14:04.019 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.020+0000 7f28b7fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28b80f77d0 0x7f28b8107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:14:04.019 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.020+0000 7f28b7fff700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b8107870 con 0x7f28b80f6530 2021-11-03T17:14:04.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.020+0000 7f28b7fff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b8108080 con 0x7f28b80f77d0 2021-11-03T17:14:04.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.020+0000 7f28b6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28b80f6530 0x7f28b8106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:14:04.021 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.020+0000 7f28b6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28b80f6530 0x7f28b8106d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53272/0 (socket says 172.21.15.26:53272) 2021-11-03T17:14:04.021 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.020+0000 7f28b6ffd700 1 -- 172.21.15.26:0/41335191 learned_addr learned my addr 172.21.15.26:0/41335191 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:14:04.021 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.020+0000 7f28b67fc700 1 --2- 172.21.15.26:0/41335191 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28b80f77d0 0x7f28b8107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:14:04.022 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.021+0000 7f28b6ffd700 1 -- 172.21.15.26:0/41335191 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28b80f77d0 msgr2=0x7f28b8107270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:14:04.022 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.021+0000 7f28b6ffd700 1 --2- 172.21.15.26:0/41335191 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28b80f77d0 0x7f28b8107270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:04.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.021+0000 7f28b6ffd700 1 -- 172.21.15.26:0/41335191 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ac005040 con 0x7f28b80f6530 2021-11-03T17:14:04.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.021+0000 7f28b6ffd700 1 --2- 172.21.15.26:0/41335191 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28b80f6530 0x7f28b8106d80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f28a800c530 tx=0x7f28a8007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:14:04.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.021+0000 7f289f7fe700 1 -- 172.21.15.26:0/41335191 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28a800f650 con 0x7f28b80f6530 2021-11-03T17:14:04.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.021+0000 7f28b7fff700 1 -- 172.21.15.26:0/41335191 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28b8108300 con 0x7f28b80f6530 2021-11-03T17:14:04.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.021+0000 7f289f7fe700 1 -- 172.21.15.26:0/41335191 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f28a800fc60 con 0x7f28b80f6530 2021-11-03T17:14:04.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.021+0000 7f289f7fe700 1 -- 172.21.15.26:0/41335191 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28a8012d20 con 0x7f28b80f6530 2021-11-03T17:14:04.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.021+0000 7f28b7fff700 1 -- 172.21.15.26:0/41335191 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28b81088c0 con 0x7f28b80f6530 2021-11-03T17:14:04.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.022+0000 7f28b7fff700 1 -- 172.21.15.26:0/41335191 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28b8059100 con 0x7f28b80f6530 2021-11-03T17:14:04.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.022+0000 7f289f7fe700 1 -- 172.21.15.26:0/41335191 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f28a8019030 con 0x7f28b80f6530 2021-11-03T17:14:04.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.023+0000 7f289f7fe700 1 --2- 172.21.15.26:0/41335191 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f28a0064100 0x7f28a00665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:14:04.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.023+0000 7f289f7fe700 1 -- 172.21.15.26:0/41335191 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f28a8080620 con 0x7f28b80f6530 2021-11-03T17:14:04.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.023+0000 7f28b67fc700 1 --2- 172.21.15.26:0/41335191 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f28a0064100 0x7f28a00665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:14:04.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.023+0000 7f28b67fc700 1 --2- 172.21.15.26:0/41335191 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f28a0064100 0x7f28a00665c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f28ac004e30 tx=0x7f28ac009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:14:04.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.027+0000 7f289f7fe700 1 -- 172.21.15.26:0/41335191 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f28a80528e0 con 0x7f28b80f6530 2021-11-03T17:14:04.228 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.234+0000 7f28b7fff700 1 -- 172.21.15.26:0/41335191 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f28b8045ad0 con 0x7f28b80f6530 2021-11-03T17:14:04.229 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.234+0000 7f289f7fe700 1 -- 172.21.15.26:0/41335191 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f28a8017710 con 0x7f28b80f6530 2021-11-03T17:14:04.229 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:14:04.230 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:14:04.230 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:14:04.230 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:14:04.230 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:14:04.231 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:14:04.231 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:14:04.231 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:14:04.231 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:14:04.232 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:14:04.232 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:14:04.232 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:14:04.232 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:14:04.232 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:14:04.233 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:14:04.233 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:14:04.233 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:14:04.233 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:14:04.234 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:14:04.234 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:14:04.234 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:14:04.235 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:14:04.235 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:14:04.235 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:14:04.235 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:14:04.236 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:14:04.236 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:14:04.236 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:14:04.236 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:14:04.237 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:14:04.237 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:14:04.237 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:14:04.237 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:14:04.237 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:14:04.238 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:14:04.238 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:14:04.238 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:14:04.238 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:14:04.239 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:14:04.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.236+0000 7f28b7fff700 1 -- 172.21.15.26:0/41335191 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f28a0064100 msgr2=0x7f28a00665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:14:04.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.236+0000 7f28b7fff700 1 --2- 172.21.15.26:0/41335191 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f28a0064100 0x7f28a00665c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f28ac004e30 tx=0x7f28ac009b30).stop 2021-11-03T17:14:04.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.236+0000 7f28b7fff700 1 -- 172.21.15.26:0/41335191 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28b80f6530 msgr2=0x7f28b8106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:14:04.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.236+0000 7f28b7fff700 1 --2- 172.21.15.26:0/41335191 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28b80f6530 0x7f28b8106d80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f28a800c530 tx=0x7f28a8007e10).stop 2021-11-03T17:14:04.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.236+0000 7f28b7fff700 1 -- 172.21.15.26:0/41335191 shutdown_connections 2021-11-03T17:14:04.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.236+0000 7f28b7fff700 1 --2- 172.21.15.26:0/41335191 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f28a0064100 0x7f28a00665c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:04.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.236+0000 7f28b7fff700 1 --2- 172.21.15.26:0/41335191 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28b80f6530 0x7f28b8106d80 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:04.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.236+0000 7f28b7fff700 1 --2- 172.21.15.26:0/41335191 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28b80f77d0 0x7f28b8107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:04.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.236+0000 7f28b7fff700 1 -- 172.21.15.26:0/41335191 >> 172.21.15.26:0/41335191 conn(0x7f28b80f1cd0 msgr2=0x7f28b80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:14:04.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.236+0000 7f28b7fff700 1 -- 172.21.15.26:0/41335191 shutdown_connections 2021-11-03T17:14:04.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:04.236+0000 7f28b7fff700 1 -- 172.21.15.26:0/41335191 wait complete. 2021-11-03T17:14:04.242 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:14:04.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:04 smithi026 ceph-mon[96795]: pgmap v582: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:04.463 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:04 smithi026 ceph-mon[96795]: from='client.34748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:14:04.463 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:04 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/196461361' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:14:04.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:04 smithi194 ceph-mon[65619]: pgmap v582: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:04.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:04 smithi194 ceph-mon[65619]: from='client.34748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:14:04.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:04 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/196461361' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:14:05.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:05 smithi026 ceph-mon[96795]: from='client.34752 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:14:05.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:05 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/41335191' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:14:05.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:05 smithi194 ceph-mon[65619]: from='client.34752 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:14:05.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:05 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/41335191' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:14:06.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:06 smithi026 ceph-mon[96795]: pgmap v583: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:06.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:06 smithi194 ceph-mon[65619]: pgmap v583: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:08.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:08 smithi026 ceph-mon[96795]: pgmap v584: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:08.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:08 smithi194 ceph-mon[65619]: pgmap v584: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:10.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:09 smithi026 ceph-mon[96795]: pgmap v585: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:10.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:09 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:14:10.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:09 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:14:10.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:09 smithi194 ceph-mon[65619]: pgmap v585: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:10.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:09 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:14:10.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:09 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:14:12.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:11 smithi026 ceph-mon[96795]: pgmap v586: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:12.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:11 smithi194 ceph-mon[65619]: pgmap v586: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:14.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:13 smithi194 ceph-mon[65619]: pgmap v587: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:14.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:13 smithi026 ceph-mon[96795]: pgmap v587: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:16.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:15 smithi194 ceph-mon[65619]: pgmap v588: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:16.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:15 smithi026 ceph-mon[96795]: pgmap v588: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:18.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:17 smithi194 ceph-mon[65619]: pgmap v589: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:18.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:17 smithi026 ceph-mon[96795]: pgmap v589: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:20.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:19 smithi194 ceph-mon[65619]: pgmap v590: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:20.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:19 smithi026 ceph-mon[96795]: pgmap v590: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:22.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:21 smithi194 ceph-mon[65619]: pgmap v591: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:22.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:21 smithi026 ceph-mon[96795]: pgmap v591: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:24.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:23 smithi194 ceph-mon[65619]: pgmap v592: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:24.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:23 smithi026 ceph-mon[96795]: pgmap v592: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:25.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:14:25.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:24 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:14:25.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:14:25.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:24 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:14:26.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:25 smithi194 ceph-mon[65619]: pgmap v593: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:26.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:25 smithi026 ceph-mon[96795]: pgmap v593: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:28.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:27 smithi194 ceph-mon[65619]: pgmap v594: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:28.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:27 smithi026 ceph-mon[96795]: pgmap v594: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:30.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:29 smithi194 ceph-mon[65619]: pgmap v595: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:30.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:29 smithi026 ceph-mon[96795]: pgmap v595: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:32.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:31 smithi194 ceph-mon[65619]: pgmap v596: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:32.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:31 smithi026 ceph-mon[96795]: pgmap v596: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:34.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:33 smithi194 ceph-mon[65619]: pgmap v597: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:34.347 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.349+0000 7fa120c81700 1 -- 172.21.15.26:0/2422875279 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa11c0f6ff0 msgr2=0x7fa11c0f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:14:34.347 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.349+0000 7fa120c81700 1 --2- 172.21.15.26:0/2422875279 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa11c0f6ff0 0x7fa11c0f7a20 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7fa110004660 tx=0x7fa110009b30).stop 2021-11-03T17:14:34.347 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.350+0000 7fa120c81700 1 -- 172.21.15.26:0/2422875279 shutdown_connections 2021-11-03T17:14:34.348 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.350+0000 7fa120c81700 1 --2- 172.21.15.26:0/2422875279 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa11c0f6ff0 0x7fa11c0f7a20 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:34.348 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.350+0000 7fa120c81700 1 --2- 172.21.15.26:0/2422875279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa11c0f66e0 0x7fa11c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:34.348 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.350+0000 7fa120c81700 1 -- 172.21.15.26:0/2422875279 >> 172.21.15.26:0/2422875279 conn(0x7fa11c0f1f00 msgr2=0x7fa11c0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:14:34.348 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.350+0000 7fa120c81700 1 -- 172.21.15.26:0/2422875279 shutdown_connections 2021-11-03T17:14:34.349 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.350+0000 7fa120c81700 1 -- 172.21.15.26:0/2422875279 wait complete. 2021-11-03T17:14:34.349 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.350+0000 7fa120c81700 1 Processor -- start 2021-11-03T17:14:34.349 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.350+0000 7fa120c81700 1 -- start start 2021-11-03T17:14:34.349 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.350+0000 7fa120c81700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa11c0f66e0 0x7fa11c106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:14:34.350 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.350+0000 7fa120c81700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa11c0f6ff0 0x7fa11c1073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:14:34.350 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.350+0000 7fa120c81700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11c107990 con 0x7fa11c0f6ff0 2021-11-03T17:14:34.350 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.350+0000 7fa120c81700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11c107ad0 con 0x7fa11c0f66e0 2021-11-03T17:14:34.350 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.351+0000 7fa119d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa11c0f6ff0 0x7fa11c1073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:14:34.351 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.351+0000 7fa119d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa11c0f6ff0 0x7fa11c1073e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53292/0 (socket says 172.21.15.26:53292) 2021-11-03T17:14:34.351 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.351+0000 7fa119d9b700 1 -- 172.21.15.26:0/3350847711 learned_addr learned my addr 172.21.15.26:0/3350847711 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:14:34.351 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.351+0000 7fa11a59c700 1 --2- 172.21.15.26:0/3350847711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa11c0f66e0 0x7fa11c106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:14:34.351 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.351+0000 7fa119d9b700 1 -- 172.21.15.26:0/3350847711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa11c0f66e0 msgr2=0x7fa11c106ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:14:34.351 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.351+0000 7fa119d9b700 1 --2- 172.21.15.26:0/3350847711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa11c0f66e0 0x7fa11c106ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:34.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.351+0000 7fa119d9b700 1 -- 172.21.15.26:0/3350847711 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa110005040 con 0x7fa11c0f6ff0 2021-11-03T17:14:34.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.351+0000 7fa119d9b700 1 --2- 172.21.15.26:0/3350847711 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa11c0f6ff0 0x7fa11c1073e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7fa110000c00 tx=0x7fa11000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:14:34.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.351+0000 7fa10affd700 1 -- 172.21.15.26:0/3350847711 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa110019070 con 0x7fa11c0f6ff0 2021-11-03T17:14:34.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.351+0000 7fa10affd700 1 -- 172.21.15.26:0/3350847711 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa110007e70 con 0x7fa11c0f6ff0 2021-11-03T17:14:34.353 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.351+0000 7fa120c81700 1 -- 172.21.15.26:0/3350847711 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa11c108410 con 0x7fa11c0f6ff0 2021-11-03T17:14:34.353 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.351+0000 7fa10affd700 1 -- 172.21.15.26:0/3350847711 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa110014ce0 con 0x7fa11c0f6ff0 2021-11-03T17:14:34.353 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.351+0000 7fa120c81700 1 -- 172.21.15.26:0/3350847711 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa11c108970 con 0x7fa11c0f6ff0 2021-11-03T17:14:34.354 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.352+0000 7fa120c81700 1 -- 172.21.15.26:0/3350847711 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa11c045ad0 con 0x7fa11c0f6ff0 2021-11-03T17:14:34.354 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.353+0000 7fa10affd700 1 -- 172.21.15.26:0/3350847711 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fa110025070 con 0x7fa11c0f6ff0 2021-11-03T17:14:34.355 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.353+0000 7fa10affd700 1 --2- 172.21.15.26:0/3350847711 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa1040640b0 0x7fa104066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:14:34.355 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.353+0000 7fa10affd700 1 -- 172.21.15.26:0/3350847711 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fa110081770 con 0x7fa11c0f6ff0 2021-11-03T17:14:34.355 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.353+0000 7fa11a59c700 1 --2- 172.21.15.26:0/3350847711 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa1040640b0 0x7fa104066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:14:34.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.354+0000 7fa11a59c700 1 --2- 172.21.15.26:0/3350847711 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa1040640b0 0x7fa104066570 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fa10c009fd0 tx=0x7fa10c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:14:34.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.357+0000 7fa10affd700 1 -- 172.21.15.26:0/3350847711 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fa110053ad0 con 0x7fa11c0f6ff0 2021-11-03T17:14:34.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:33 smithi026 ceph-mon[96795]: pgmap v597: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:34.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.537+0000 7fa120c81700 1 -- 172.21.15.26:0/3350847711 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa11c0ff040 con 0x7fa1040640b0 2021-11-03T17:14:34.533 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.538+0000 7fa10affd700 1 -- 172.21.15.26:0/3350847711 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fa11c0ff040 con 0x7fa1040640b0 2021-11-03T17:14:34.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.540+0000 7fa120c81700 1 -- 172.21.15.26:0/3350847711 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa1040640b0 msgr2=0x7fa104066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:14:34.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.540+0000 7fa120c81700 1 --2- 172.21.15.26:0/3350847711 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa1040640b0 0x7fa104066570 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fa10c009fd0 tx=0x7fa10c00b040).stop 2021-11-03T17:14:34.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.540+0000 7fa120c81700 1 -- 172.21.15.26:0/3350847711 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa11c0f6ff0 msgr2=0x7fa11c1073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:14:34.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.540+0000 7fa120c81700 1 --2- 172.21.15.26:0/3350847711 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa11c0f6ff0 0x7fa11c1073e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7fa110000c00 tx=0x7fa11000b040).stop 2021-11-03T17:14:34.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.540+0000 7fa120c81700 1 -- 172.21.15.26:0/3350847711 shutdown_connections 2021-11-03T17:14:34.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.540+0000 7fa120c81700 1 --2- 172.21.15.26:0/3350847711 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa1040640b0 0x7fa104066570 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:34.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.540+0000 7fa120c81700 1 --2- 172.21.15.26:0/3350847711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa11c0f66e0 0x7fa11c106ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:34.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.540+0000 7fa120c81700 1 --2- 172.21.15.26:0/3350847711 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa11c0f6ff0 0x7fa11c1073e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:34.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.540+0000 7fa120c81700 1 -- 172.21.15.26:0/3350847711 >> 172.21.15.26:0/3350847711 conn(0x7fa11c0f1f00 msgr2=0x7fa11c0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:14:34.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.540+0000 7fa120c81700 1 -- 172.21.15.26:0/3350847711 shutdown_connections 2021-11-03T17:14:34.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.540+0000 7fa120c81700 1 -- 172.21.15.26:0/3350847711 wait complete. 2021-11-03T17:14:34.545 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:14:34.637 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.640+0000 7f73808bc700 1 -- 172.21.15.26:0/406067949 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f737c0f55c0 msgr2=0x7f737c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:14:34.637 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.640+0000 7f73808bc700 1 --2- 172.21.15.26:0/406067949 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f737c0f55c0 0x7f737c0f59e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f736c004660 tx=0x7f736c009b30).stop 2021-11-03T17:14:34.638 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.640+0000 7f73808bc700 1 -- 172.21.15.26:0/406067949 shutdown_connections 2021-11-03T17:14:34.638 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.640+0000 7f73808bc700 1 --2- 172.21.15.26:0/406067949 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f737c0f5ed0 0x7f737c0f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:34.638 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.640+0000 7f73808bc700 1 --2- 172.21.15.26:0/406067949 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f737c0f55c0 0x7f737c0f59e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:34.638 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.640+0000 7f73808bc700 1 -- 172.21.15.26:0/406067949 >> 172.21.15.26:0/406067949 conn(0x7f737c0f0dc0 msgr2=0x7f737c0f31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:14:34.639 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.640+0000 7f73808bc700 1 -- 172.21.15.26:0/406067949 shutdown_connections 2021-11-03T17:14:34.639 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.640+0000 7f73808bc700 1 -- 172.21.15.26:0/406067949 wait complete. 2021-11-03T17:14:34.639 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.641+0000 7f73808bc700 1 Processor -- start 2021-11-03T17:14:34.639 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.641+0000 7f73808bc700 1 -- start start 2021-11-03T17:14:34.639 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.641+0000 7f73808bc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f737c0f55c0 0x7f737c109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:14:34.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.641+0000 7f73808bc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f737c0f5ed0 0x7f737c10c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:14:34.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.641+0000 7f73808bc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737c060540 con 0x7f737c0f5ed0 2021-11-03T17:14:34.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.641+0000 7f73808bc700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737c060680 con 0x7f737c0f55c0 2021-11-03T17:14:34.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.641+0000 7f7379d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f737c0f5ed0 0x7f737c10c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:14:34.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.641+0000 7f7379d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f737c0f5ed0 0x7f737c10c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53300/0 (socket says 172.21.15.26:53300) 2021-11-03T17:14:34.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.641+0000 7f7379d9b700 1 -- 172.21.15.26:0/2282094905 learned_addr learned my addr 172.21.15.26:0/2282094905 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:14:34.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.641+0000 7f737a59c700 1 --2- 172.21.15.26:0/2282094905 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f737c0f55c0 0x7f737c109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:14:34.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.641+0000 7f7379d9b700 1 -- 172.21.15.26:0/2282094905 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f737c0f55c0 msgr2=0x7f737c109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:14:34.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.641+0000 7f7379d9b700 1 --2- 172.21.15.26:0/2282094905 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f737c0f55c0 0x7f737c109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:34.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.641+0000 7f7379d9b700 1 -- 172.21.15.26:0/2282094905 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f736c005040 con 0x7f737c0f5ed0 2021-11-03T17:14:34.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.641+0000 7f7379d9b700 1 --2- 172.21.15.26:0/2282094905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f737c0f5ed0 0x7f737c10c190 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f73640026d0 tx=0x7f7364009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:14:34.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.642+0000 7f7372ffd700 1 -- 172.21.15.26:0/2282094905 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7364009320 con 0x7f737c0f5ed0 2021-11-03T17:14:34.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.642+0000 7f7372ffd700 1 -- 172.21.15.26:0/2282094905 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f736400f040 con 0x7f737c0f5ed0 2021-11-03T17:14:34.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.642+0000 7f73808bc700 1 -- 172.21.15.26:0/2282094905 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f737c10c740 con 0x7f737c0f5ed0 2021-11-03T17:14:34.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.642+0000 7f7372ffd700 1 -- 172.21.15.26:0/2282094905 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73640147e0 con 0x7f737c0f5ed0 2021-11-03T17:14:34.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.642+0000 7f73808bc700 1 -- 172.21.15.26:0/2282094905 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f737c10ccd0 con 0x7f737c0f5ed0 2021-11-03T17:14:34.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.642+0000 7f73808bc700 1 -- 172.21.15.26:0/2282094905 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f737c0f4a50 con 0x7f737c0f5ed0 2021-11-03T17:14:34.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.643+0000 7f7372ffd700 1 -- 172.21.15.26:0/2282094905 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f7364009480 con 0x7f737c0f5ed0 2021-11-03T17:14:34.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.643+0000 7f7372ffd700 1 --2- 172.21.15.26:0/2282094905 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f73680640b0 0x7f7368066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:14:34.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.643+0000 7f7372ffd700 1 -- 172.21.15.26:0/2282094905 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f7364080eb0 con 0x7f737c0f5ed0 2021-11-03T17:14:34.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.643+0000 7f737a59c700 1 --2- 172.21.15.26:0/2282094905 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f73680640b0 0x7f7368066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:14:34.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.644+0000 7f737a59c700 1 --2- 172.21.15.26:0/2282094905 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f73680640b0 0x7f7368066570 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f736c009da0 tx=0x7f736c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:14:34.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.647+0000 7f7372ffd700 1 -- 172.21.15.26:0/2282094905 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f7364053210 con 0x7f737c0f5ed0 2021-11-03T17:14:34.814 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.818+0000 7f73808bc700 1 -- 172.21.15.26:0/2282094905 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f737c0fdf60 con 0x7f73680640b0 2021-11-03T17:14:34.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.833+0000 7f7372ffd700 1 -- 172.21.15.26:0/2282094905 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f736c0092e0 con 0x7f73680640b0 2021-11-03T17:14:34.829 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:14:34.829 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (25m) 6m ago 27m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:14:34.829 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (18m) 6m ago 27m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:14:34.829 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (17m) 4m ago 26m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:14:34.830 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (25m) 6m ago 26m 39.5M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:14:34.830 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (18m) 6m ago 22m 16.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:14:34.830 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (19m) 6m ago 22m 17.8M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:14:34.830 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (22m) 4m ago 22m 19.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:14:34.831 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (22m) 4m ago 22m 19.4M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:14:34.831 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (19m) 6m ago 28m 491M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:14:34.831 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (19m) 4m ago 26m 415M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:14:34.831 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (18m) 6m ago 28m 113M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:14:34.832 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (18m) 4m ago 26m 70.2M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:14:34.832 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (26m) 6m ago 26m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:14:34.832 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (26m) 4m ago 26m 18.4M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:14:34.832 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (17m) 6m ago 25m 190M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:14:34.833 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (17m) 6m ago 25m 204M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:14:34.833 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (16m) 6m ago 24m 170M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:14:34.833 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (16m) 4m ago 24m 211M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:14:34.833 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (15m) 4m ago 24m 189M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:14:34.833 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (15m) 4m ago 23m 174M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:14:34.834 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (25m) 6m ago 26m 49.9M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:14:34.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.835+0000 7f73808bc700 1 -- 172.21.15.26:0/2282094905 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f73680640b0 msgr2=0x7f7368066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:14:34.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.835+0000 7f73808bc700 1 --2- 172.21.15.26:0/2282094905 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f73680640b0 0x7f7368066570 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f736c009da0 tx=0x7f736c009b30).stop 2021-11-03T17:14:34.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.835+0000 7f73808bc700 1 -- 172.21.15.26:0/2282094905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f737c0f5ed0 msgr2=0x7f737c10c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:14:34.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.835+0000 7f73808bc700 1 --2- 172.21.15.26:0/2282094905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f737c0f5ed0 0x7f737c10c190 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f73640026d0 tx=0x7f7364009de0).stop 2021-11-03T17:14:34.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.835+0000 7f73808bc700 1 -- 172.21.15.26:0/2282094905 shutdown_connections 2021-11-03T17:14:34.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.835+0000 7f73808bc700 1 --2- 172.21.15.26:0/2282094905 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f73680640b0 0x7f7368066570 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:34.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.835+0000 7f73808bc700 1 --2- 172.21.15.26:0/2282094905 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f737c0f55c0 0x7f737c109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:34.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.835+0000 7f73808bc700 1 --2- 172.21.15.26:0/2282094905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f737c0f5ed0 0x7f737c10c190 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:34.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.835+0000 7f73808bc700 1 -- 172.21.15.26:0/2282094905 >> 172.21.15.26:0/2282094905 conn(0x7f737c0f0dc0 msgr2=0x7f737c0fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:14:34.837 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.835+0000 7f73808bc700 1 -- 172.21.15.26:0/2282094905 shutdown_connections 2021-11-03T17:14:34.837 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.835+0000 7f73808bc700 1 -- 172.21.15.26:0/2282094905 wait complete. 2021-11-03T17:14:34.931 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.934+0000 7f25f579d700 1 -- 172.21.15.26:0/2176634700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f00f77d0 msgr2=0x7f25f00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:14:34.932 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.934+0000 7f25f579d700 1 --2- 172.21.15.26:0/2176634700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f00f77d0 0x7f25f00f7c30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f25e0004660 tx=0x7f25e0009b30).stop 2021-11-03T17:14:34.932 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.934+0000 7f25f579d700 1 -- 172.21.15.26:0/2176634700 shutdown_connections 2021-11-03T17:14:34.932 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.934+0000 7f25f579d700 1 --2- 172.21.15.26:0/2176634700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f00f77d0 0x7f25f00f7c30 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:34.932 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.934+0000 7f25f579d700 1 --2- 172.21.15.26:0/2176634700 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25f00f6530 0x7f25f00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:34.933 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.934+0000 7f25f579d700 1 -- 172.21.15.26:0/2176634700 >> 172.21.15.26:0/2176634700 conn(0x7f25f00f1cd0 msgr2=0x7f25f00f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:14:34.933 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.934+0000 7f25f579d700 1 -- 172.21.15.26:0/2176634700 shutdown_connections 2021-11-03T17:14:34.933 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.934+0000 7f25f579d700 1 -- 172.21.15.26:0/2176634700 wait complete. 2021-11-03T17:14:34.933 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.935+0000 7f25f579d700 1 Processor -- start 2021-11-03T17:14:34.934 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.935+0000 7f25f579d700 1 -- start start 2021-11-03T17:14:34.934 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.935+0000 7f25f579d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f00f6530 0x7f25f0106d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:14:34.934 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.935+0000 7f25f579d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25f00f77d0 0x7f25f0107210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:14:34.934 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.935+0000 7f25f579d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f01077c0 con 0x7f25f00f6530 2021-11-03T17:14:34.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.935+0000 7f25f579d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f0107fc0 con 0x7f25f00f77d0 2021-11-03T17:14:34.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.935+0000 7f25effff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f00f6530 0x7f25f0106d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:14:34.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.935+0000 7f25effff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f00f6530 0x7f25f0106d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53308/0 (socket says 172.21.15.26:53308) 2021-11-03T17:14:34.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.935+0000 7f25effff700 1 -- 172.21.15.26:0/608121953 learned_addr learned my addr 172.21.15.26:0/608121953 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:14:34.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.936+0000 7f25ef7fe700 1 --2- 172.21.15.26:0/608121953 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25f00f77d0 0x7f25f0107210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:14:34.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.936+0000 7f25effff700 1 -- 172.21.15.26:0/608121953 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25f00f77d0 msgr2=0x7f25f0107210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:14:34.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.936+0000 7f25effff700 1 --2- 172.21.15.26:0/608121953 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25f00f77d0 0x7f25f0107210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:34.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.936+0000 7f25effff700 1 -- 172.21.15.26:0/608121953 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e0005040 con 0x7f25f00f6530 2021-11-03T17:14:34.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.936+0000 7f25effff700 1 --2- 172.21.15.26:0/608121953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f00f6530 0x7f25f0106d20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f25e4002700 tx=0x7f25e4009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:14:34.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.936+0000 7f25ecff9700 1 -- 172.21.15.26:0/608121953 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25e4009320 con 0x7f25f00f6530 2021-11-03T17:14:34.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.936+0000 7f25f579d700 1 -- 172.21.15.26:0/608121953 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25f01082a0 con 0x7f25f00f6530 2021-11-03T17:14:34.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.936+0000 7f25ecff9700 1 -- 172.21.15.26:0/608121953 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f25e400f040 con 0x7f25f00f6530 2021-11-03T17:14:34.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.936+0000 7f25ecff9700 1 -- 172.21.15.26:0/608121953 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25e40148e0 con 0x7f25f00f6530 2021-11-03T17:14:34.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.936+0000 7f25f579d700 1 -- 172.21.15.26:0/608121953 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25f0108860 con 0x7f25f00f6530 2021-11-03T17:14:34.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.937+0000 7f25f579d700 1 -- 172.21.15.26:0/608121953 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25f0059100 con 0x7f25f00f6530 2021-11-03T17:14:34.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.937+0000 7f25ecff9700 1 -- 172.21.15.26:0/608121953 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f25e4009480 con 0x7f25f00f6530 2021-11-03T17:14:34.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.938+0000 7f25ecff9700 1 --2- 172.21.15.26:0/608121953 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f25d8064100 0x7f25d80665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:14:34.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.938+0000 7f25ecff9700 1 -- 172.21.15.26:0/608121953 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f25e4080af0 con 0x7f25f00f6530 2021-11-03T17:14:34.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.938+0000 7f25ef7fe700 1 --2- 172.21.15.26:0/608121953 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f25d8064100 0x7f25d80665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:14:34.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.938+0000 7f25ef7fe700 1 --2- 172.21.15.26:0/608121953 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f25d8064100 0x7f25d80665c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f25e0009da0 tx=0x7f25e0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:14:34.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:34.942+0000 7f25ecff9700 1 -- 172.21.15.26:0/608121953 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f25e4052e50 con 0x7f25f00f6530 2021-11-03T17:14:35.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.174+0000 7f25f579d700 1 -- 172.21.15.26:0/608121953 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f25f0045ad0 con 0x7f25f00f6530 2021-11-03T17:14:35.198 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.175+0000 7f25ecff9700 1 -- 172.21.15.26:0/608121953 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f25e4052a40 con 0x7f25f00f6530 2021-11-03T17:14:35.199 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:14:35.199 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:14:35.199 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:14:35.200 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:14:35.200 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:14:35.200 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:14:35.200 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:14:35.201 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:14:35.201 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:14:35.201 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:14:35.201 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:14:35.202 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:14:35.202 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:14:35.202 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:14:35.202 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:14:35.203 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:14:35.203 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:14:35.203 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:14:35.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.177+0000 7f25f579d700 1 -- 172.21.15.26:0/608121953 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f25d8064100 msgr2=0x7f25d80665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:14:35.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.177+0000 7f25f579d700 1 --2- 172.21.15.26:0/608121953 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f25d8064100 0x7f25d80665c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f25e0009da0 tx=0x7f25e0009b30).stop 2021-11-03T17:14:35.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.177+0000 7f25f579d700 1 -- 172.21.15.26:0/608121953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f00f6530 msgr2=0x7f25f0106d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:14:35.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.177+0000 7f25f579d700 1 --2- 172.21.15.26:0/608121953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f00f6530 0x7f25f0106d20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f25e4002700 tx=0x7f25e4009e00).stop 2021-11-03T17:14:35.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.177+0000 7f25f579d700 1 -- 172.21.15.26:0/608121953 shutdown_connections 2021-11-03T17:14:35.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.177+0000 7f25f579d700 1 --2- 172.21.15.26:0/608121953 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f25d8064100 0x7f25d80665c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:35.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.177+0000 7f25f579d700 1 --2- 172.21.15.26:0/608121953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f00f6530 0x7f25f0106d20 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:35.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.177+0000 7f25f579d700 1 --2- 172.21.15.26:0/608121953 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25f00f77d0 0x7f25f0107210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:35.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.177+0000 7f25f579d700 1 -- 172.21.15.26:0/608121953 >> 172.21.15.26:0/608121953 conn(0x7f25f00f1cd0 msgr2=0x7f25f00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:14:35.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.177+0000 7f25f579d700 1 -- 172.21.15.26:0/608121953 shutdown_connections 2021-11-03T17:14:35.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.177+0000 7f25f579d700 1 -- 172.21.15.26:0/608121953 wait complete. 2021-11-03T17:14:35.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.277+0000 7f3bed855700 1 -- 172.21.15.26:0/2003424419 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3be80f55c0 msgr2=0x7f3be80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:14:35.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.277+0000 7f3bed855700 1 --2- 172.21.15.26:0/2003424419 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3be80f55c0 0x7f3be80f59e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f3bd8004660 tx=0x7f3bd8009b30).stop 2021-11-03T17:14:35.276 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.277+0000 7f3bed855700 1 -- 172.21.15.26:0/2003424419 shutdown_connections 2021-11-03T17:14:35.276 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.277+0000 7f3bed855700 1 --2- 172.21.15.26:0/2003424419 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3be80f6860 0x7f3be80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:35.276 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.277+0000 7f3bed855700 1 --2- 172.21.15.26:0/2003424419 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3be80f55c0 0x7f3be80f59e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:35.277 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.277+0000 7f3bed855700 1 -- 172.21.15.26:0/2003424419 >> 172.21.15.26:0/2003424419 conn(0x7f3be80f0d40 msgr2=0x7f3be80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:14:35.277 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.277+0000 7f3bed855700 1 -- 172.21.15.26:0/2003424419 shutdown_connections 2021-11-03T17:14:35.277 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.277+0000 7f3bed855700 1 -- 172.21.15.26:0/2003424419 wait complete. 2021-11-03T17:14:35.277 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.278+0000 7f3bed855700 1 Processor -- start 2021-11-03T17:14:35.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.278+0000 7f3bed855700 1 -- start start 2021-11-03T17:14:35.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.278+0000 7f3bed855700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3be80f55c0 0x7f3be8106fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:14:35.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.278+0000 7f3bed855700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3be80f6860 0x7f3be8107490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:14:35.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.278+0000 7f3bed855700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be8107a40 con 0x7f3be80f55c0 2021-11-03T17:14:35.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.278+0000 7f3bed855700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be8107b80 con 0x7f3be80f6860 2021-11-03T17:14:35.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.278+0000 7f3be6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3be80f55c0 0x7f3be8106fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:14:35.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.278+0000 7f3be6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3be80f55c0 0x7f3be8106fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53318/0 (socket says 172.21.15.26:53318) 2021-11-03T17:14:35.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.278+0000 7f3be6ffd700 1 -- 172.21.15.26:0/216212107 learned_addr learned my addr 172.21.15.26:0/216212107 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:14:35.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.279+0000 7f3be67fc700 1 --2- 172.21.15.26:0/216212107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3be80f6860 0x7f3be8107490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:14:35.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.279+0000 7f3be6ffd700 1 -- 172.21.15.26:0/216212107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3be80f6860 msgr2=0x7f3be8107490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:14:35.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.279+0000 7f3be6ffd700 1 --2- 172.21.15.26:0/216212107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3be80f6860 0x7f3be8107490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:35.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.279+0000 7f3be6ffd700 1 -- 172.21.15.26:0/216212107 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd8005040 con 0x7f3be80f55c0 2021-11-03T17:14:35.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.279+0000 7f3be6ffd700 1 --2- 172.21.15.26:0/216212107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3be80f55c0 0x7f3be8106fa0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f3bd8013a70 tx=0x7f3bd8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:14:35.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.279+0000 7f3bdf7fe700 1 -- 172.21.15.26:0/216212107 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bd8018070 con 0x7f3be80f55c0 2021-11-03T17:14:35.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.279+0000 7f3bdf7fe700 1 -- 172.21.15.26:0/216212107 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3bd80097d0 con 0x7f3be80f55c0 2021-11-03T17:14:35.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.279+0000 7f3bed855700 1 -- 172.21.15.26:0/216212107 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3be81084c0 con 0x7f3be80f55c0 2021-11-03T17:14:35.282 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.279+0000 7f3bdf7fe700 1 -- 172.21.15.26:0/216212107 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bd801de80 con 0x7f3be80f55c0 2021-11-03T17:14:35.282 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.279+0000 7f3bed855700 1 -- 172.21.15.26:0/216212107 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3be8108a20 con 0x7f3be80f55c0 2021-11-03T17:14:35.282 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.280+0000 7f3bed855700 1 -- 172.21.15.26:0/216212107 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3be8045ad0 con 0x7f3be80f55c0 2021-11-03T17:14:35.283 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.280+0000 7f3bdf7fe700 1 -- 172.21.15.26:0/216212107 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f3bd8007ba0 con 0x7f3be80f55c0 2021-11-03T17:14:35.284 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.281+0000 7f3bdf7fe700 1 --2- 172.21.15.26:0/216212107 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3bd40640b0 0x7f3bd4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:14:35.284 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.281+0000 7f3bdf7fe700 1 -- 172.21.15.26:0/216212107 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f3bd80823d0 con 0x7f3be80f55c0 2021-11-03T17:14:35.284 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.281+0000 7f3be67fc700 1 --2- 172.21.15.26:0/216212107 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3bd40640b0 0x7f3bd4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:14:35.284 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.281+0000 7f3be67fc700 1 --2- 172.21.15.26:0/216212107 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3bd40640b0 0x7f3bd4066570 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f3bd0004c40 tx=0x7f3bd000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:14:35.285 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.285+0000 7f3bdf7fe700 1 -- 172.21.15.26:0/216212107 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f3bd80547f0 con 0x7f3be80f55c0 2021-11-03T17:14:35.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.490+0000 7f3bed855700 1 -- 172.21.15.26:0/216212107 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3be81091e0 con 0x7f3be80f55c0 2021-11-03T17:14:35.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.491+0000 7f3bdf7fe700 1 -- 172.21.15.26:0/216212107 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f3bd80543e0 con 0x7f3be80f55c0 2021-11-03T17:14:35.487 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:14:35.487 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:14:35.487 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:14:35.488 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:14:35.488 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:14:35.488 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:14:35.488 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:14:35.489 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:14:35.489 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:14:35.489 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:14:35.489 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:14:35.489 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:14:35.490 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:14:35.490 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:14:35.490 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:14:35.490 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:14:35.491 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:14:35.491 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:14:35.491 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:14:35.491 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:14:35.491 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:14:35.492 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:14:35.492 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:14:35.492 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:14:35.492 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:14:35.493 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:14:35.493 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:14:35.493 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:14:35.493 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:14:35.493 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:14:35.494 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:14:35.494 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:14:35.494 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:14:35.494 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:14:35.495 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:14:35.495 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:14:35.495 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:14:35.495 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:14:35.495 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:14:35.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.493+0000 7f3bed855700 1 -- 172.21.15.26:0/216212107 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3bd40640b0 msgr2=0x7f3bd4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:14:35.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.493+0000 7f3bed855700 1 --2- 172.21.15.26:0/216212107 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3bd40640b0 0x7f3bd4066570 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f3bd0004c40 tx=0x7f3bd000b040).stop 2021-11-03T17:14:35.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.493+0000 7f3bed855700 1 -- 172.21.15.26:0/216212107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3be80f55c0 msgr2=0x7f3be8106fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:14:35.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.493+0000 7f3bed855700 1 --2- 172.21.15.26:0/216212107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3be80f55c0 0x7f3be8106fa0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f3bd8013a70 tx=0x7f3bd8009b30).stop 2021-11-03T17:14:35.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.493+0000 7f3bed855700 1 -- 172.21.15.26:0/216212107 shutdown_connections 2021-11-03T17:14:35.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.493+0000 7f3bed855700 1 --2- 172.21.15.26:0/216212107 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3bd40640b0 0x7f3bd4066570 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:35.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.493+0000 7f3bed855700 1 --2- 172.21.15.26:0/216212107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3be80f55c0 0x7f3be8106fa0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:35.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.493+0000 7f3bed855700 1 --2- 172.21.15.26:0/216212107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3be80f6860 0x7f3be8107490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:14:35.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.493+0000 7f3bed855700 1 -- 172.21.15.26:0/216212107 >> 172.21.15.26:0/216212107 conn(0x7f3be80f0d40 msgr2=0x7f3be805ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:14:35.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.493+0000 7f3bed855700 1 -- 172.21.15.26:0/216212107 shutdown_connections 2021-11-03T17:14:35.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:14:35.493+0000 7f3bed855700 1 -- 172.21.15.26:0/216212107 wait complete. 2021-11-03T17:14:35.499 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:14:36.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:35 smithi194 ceph-mon[65619]: from='client.34764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:14:36.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:35 smithi194 ceph-mon[65619]: pgmap v598: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:36.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:35 smithi194 ceph-mon[65619]: from='client.34768 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:14:36.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:35 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/608121953' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:14:36.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:35 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/216212107' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:14:36.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:35 smithi026 ceph-mon[96795]: from='client.34764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:14:36.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:35 smithi026 ceph-mon[96795]: pgmap v598: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:36.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:35 smithi026 ceph-mon[96795]: from='client.34768 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:14:36.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:35 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/608121953' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:14:36.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:35 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/216212107' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:14:38.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:37 smithi194 ceph-mon[65619]: pgmap v599: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:38.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:37 smithi026 ceph-mon[96795]: pgmap v599: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:40.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:39 smithi194 ceph-mon[65619]: pgmap v600: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:40.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:14:40.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:39 smithi194 ceph-mon[65619]: poll took 60061.154 ms: 1 events 2021-11-03T17:14:40.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:14:40.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:14:40.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:14:40.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:14:40.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:14:40.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:14:40.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:14:40.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:39 smithi026 ceph-mon[96795]: pgmap v600: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:40.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:14:40.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:39 smithi026 ceph-mon[96795]: poll took 60061.154 ms: 1 events 2021-11-03T17:14:40.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:14:40.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:14:40.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:14:40.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:14:40.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:14:40.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:14:40.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:14:41.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:40 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:14:41.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:40 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:14:41.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:40 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:14:41.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:40 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:14:42.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:41 smithi194 ceph-mon[65619]: pgmap v601: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:42.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:41 smithi026 ceph-mon[96795]: pgmap v601: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:44.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:43 smithi194 ceph-mon[65619]: pgmap v602: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:44.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:43 smithi026 ceph-mon[96795]: pgmap v602: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:46.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:45 smithi194 ceph-mon[65619]: pgmap v603: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:46.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:45 smithi026 ceph-mon[96795]: pgmap v603: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:48.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:47 smithi194 ceph-mon[65619]: pgmap v604: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:48.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:47 smithi026 ceph-mon[96795]: pgmap v604: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:49.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:14:49.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:14:49.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:14:49.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:14:50.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:49 smithi194 ceph-mon[65619]: pgmap v605: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:50.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:49 smithi026 ceph-mon[96795]: pgmap v605: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:52.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:51 smithi194 ceph-mon[65619]: pgmap v606: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:52.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:51 smithi026 ceph-mon[96795]: pgmap v606: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:54.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:53 smithi194 ceph-mon[65619]: pgmap v607: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:54.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:53 smithi026 ceph-mon[96795]: pgmap v607: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:55.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:14:55.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:14:56.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:56 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:14:56.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:56 smithi026 ceph-mon[96795]: pgmap v608: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:56.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:56 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:14:56.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:56 smithi194 ceph-mon[65619]: pgmap v608: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:58.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:14:58 smithi026 ceph-mon[96795]: pgmap v609: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:14:58.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:14:58 smithi194 ceph-mon[65619]: pgmap v609: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:00.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:00 smithi026 ceph-mon[96795]: pgmap v610: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:00.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:00 smithi194 ceph-mon[65619]: pgmap v610: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:02.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:02 smithi026 ceph-mon[96795]: pgmap v611: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:02.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:02 smithi194 ceph-mon[65619]: pgmap v611: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:04.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:04 smithi026 ceph-mon[96795]: pgmap v612: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:04.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:04 smithi194 ceph-mon[65619]: pgmap v612: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:05.605 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.610+0000 7fb162d13700 1 -- 172.21.15.26:0/276373915 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb15c0f66c0 msgr2=0x7fb15c0f6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:15:05.605 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.610+0000 7fb162d13700 1 --2- 172.21.15.26:0/276373915 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb15c0f66c0 0x7fb15c0f6ae0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7fb150004660 tx=0x7fb150009b30).stop 2021-11-03T17:15:05.605 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.610+0000 7fb162d13700 1 -- 172.21.15.26:0/276373915 shutdown_connections 2021-11-03T17:15:05.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.610+0000 7fb162d13700 1 --2- 172.21.15.26:0/276373915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb15c0f7960 0x7fb15c0f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:05.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.610+0000 7fb162d13700 1 --2- 172.21.15.26:0/276373915 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb15c0f66c0 0x7fb15c0f6ae0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:05.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.610+0000 7fb162d13700 1 -- 172.21.15.26:0/276373915 >> 172.21.15.26:0/276373915 conn(0x7fb15c0f1e20 msgr2=0x7fb15c0f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:15:05.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.610+0000 7fb162d13700 1 -- 172.21.15.26:0/276373915 shutdown_connections 2021-11-03T17:15:05.607 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.610+0000 7fb162d13700 1 -- 172.21.15.26:0/276373915 wait complete. 2021-11-03T17:15:05.607 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.611+0000 7fb162d13700 1 Processor -- start 2021-11-03T17:15:05.607 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.611+0000 7fb162d13700 1 -- start start 2021-11-03T17:15:05.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.611+0000 7fb162d13700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb15c0f66c0 0x7fb15c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:15:05.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.611+0000 7fb162d13700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb15c0f7960 0x7fb15c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:15:05.610 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.611+0000 7fb162d13700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15c06a380 con 0x7fb15c0f66c0 2021-11-03T17:15:05.610 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.611+0000 7fb162d13700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15c06a4c0 con 0x7fb15c0f7960 2021-11-03T17:15:05.610 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.611+0000 7fb160aaf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb15c0f66c0 0x7fb15c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:15:05.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.611+0000 7fb160aaf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb15c0f66c0 0x7fb15c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53336/0 (socket says 172.21.15.26:53336) 2021-11-03T17:15:05.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.611+0000 7fb160aaf700 1 -- 172.21.15.26:0/2720880118 learned_addr learned my addr 172.21.15.26:0/2720880118 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:15:05.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.611+0000 7fb15bfff700 1 --2- 172.21.15.26:0/2720880118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb15c0f7960 0x7fb15c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:15:05.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.612+0000 7fb160aaf700 1 -- 172.21.15.26:0/2720880118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb15c0f7960 msgr2=0x7fb15c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:15:05.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.612+0000 7fb160aaf700 1 --2- 172.21.15.26:0/2720880118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb15c0f7960 0x7fb15c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:05.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.612+0000 7fb160aaf700 1 -- 172.21.15.26:0/2720880118 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb150005040 con 0x7fb15c0f66c0 2021-11-03T17:15:05.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.612+0000 7fb160aaf700 1 --2- 172.21.15.26:0/2720880118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb15c0f66c0 0x7fb15c06b9a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7fb150013a70 tx=0x7fb150009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:15:05.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.612+0000 7fb1597fa700 1 -- 172.21.15.26:0/2720880118 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb150018070 con 0x7fb15c0f66c0 2021-11-03T17:15:05.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.612+0000 7fb162d13700 1 -- 172.21.15.26:0/2720880118 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb15c06a740 con 0x7fb15c0f66c0 2021-11-03T17:15:05.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.612+0000 7fb1597fa700 1 -- 172.21.15.26:0/2720880118 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb1500097d0 con 0x7fb15c0f66c0 2021-11-03T17:15:05.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.612+0000 7fb1597fa700 1 -- 172.21.15.26:0/2720880118 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb15001de80 con 0x7fb15c0f66c0 2021-11-03T17:15:05.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.612+0000 7fb162d13700 1 -- 172.21.15.26:0/2720880118 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb15c06aca0 con 0x7fb15c0f66c0 2021-11-03T17:15:05.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.613+0000 7fb146ffd700 1 -- 172.21.15.26:0/2720880118 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb134004fa0 con 0x7fb15c0f66c0 2021-11-03T17:15:05.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.613+0000 7fb1597fa700 1 -- 172.21.15.26:0/2720880118 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fb150007ba0 con 0x7fb15c0f66c0 2021-11-03T17:15:05.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.614+0000 7fb1597fa700 1 --2- 172.21.15.26:0/2720880118 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb14c0640b0 0x7fb14c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:15:05.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.614+0000 7fb1597fa700 1 -- 172.21.15.26:0/2720880118 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fb1500823a0 con 0x7fb15c0f66c0 2021-11-03T17:15:05.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.614+0000 7fb15bfff700 1 --2- 172.21.15.26:0/2720880118 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb14c0640b0 0x7fb14c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:15:05.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.614+0000 7fb15bfff700 1 --2- 172.21.15.26:0/2720880118 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb14c0640b0 0x7fb14c066570 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fb148004e20 tx=0x7fb14800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:15:05.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.618+0000 7fb1597fa700 1 -- 172.21.15.26:0/2720880118 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fb150054700 con 0x7fb15c0f66c0 2021-11-03T17:15:05.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.796+0000 7fb146ffd700 1 -- 172.21.15.26:0/2720880118 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb134000bc0 con 0x7fb14c0640b0 2021-11-03T17:15:05.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.798+0000 7fb1597fa700 1 -- 172.21.15.26:0/2720880118 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fb134000bc0 con 0x7fb14c0640b0 2021-11-03T17:15:05.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.799+0000 7fb146ffd700 1 -- 172.21.15.26:0/2720880118 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb14c0640b0 msgr2=0x7fb14c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:15:05.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.799+0000 7fb146ffd700 1 --2- 172.21.15.26:0/2720880118 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb14c0640b0 0x7fb14c066570 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fb148004e20 tx=0x7fb14800b040).stop 2021-11-03T17:15:05.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.799+0000 7fb146ffd700 1 -- 172.21.15.26:0/2720880118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb15c0f66c0 msgr2=0x7fb15c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:15:05.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.799+0000 7fb146ffd700 1 --2- 172.21.15.26:0/2720880118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb15c0f66c0 0x7fb15c06b9a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7fb150013a70 tx=0x7fb150009b30).stop 2021-11-03T17:15:05.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.800+0000 7fb146ffd700 1 -- 172.21.15.26:0/2720880118 shutdown_connections 2021-11-03T17:15:05.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.800+0000 7fb146ffd700 1 --2- 172.21.15.26:0/2720880118 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb14c0640b0 0x7fb14c066570 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:05.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.800+0000 7fb146ffd700 1 --2- 172.21.15.26:0/2720880118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb15c0f66c0 0x7fb15c06b9a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:05.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.800+0000 7fb146ffd700 1 --2- 172.21.15.26:0/2720880118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb15c0f7960 0x7fb15c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:05.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.800+0000 7fb146ffd700 1 -- 172.21.15.26:0/2720880118 >> 172.21.15.26:0/2720880118 conn(0x7fb15c0f1e20 msgr2=0x7fb15c0fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:15:05.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.800+0000 7fb146ffd700 1 -- 172.21.15.26:0/2720880118 shutdown_connections 2021-11-03T17:15:05.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.800+0000 7fb146ffd700 1 -- 172.21.15.26:0/2720880118 wait complete. 2021-11-03T17:15:05.804 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:15:05.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.900+0000 7f6146e6e700 1 -- 172.21.15.26:0/1708244657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61400f6ff0 msgr2=0x7f61400f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:15:05.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.900+0000 7f6146e6e700 1 --2- 172.21.15.26:0/1708244657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61400f6ff0 0x7f61400f7a20 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f612c004660 tx=0x7f612c009b30).stop 2021-11-03T17:15:05.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.900+0000 7f6146e6e700 1 -- 172.21.15.26:0/1708244657 shutdown_connections 2021-11-03T17:15:05.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.900+0000 7f6146e6e700 1 --2- 172.21.15.26:0/1708244657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61400f6ff0 0x7f61400f7a20 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:05.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.900+0000 7f6146e6e700 1 --2- 172.21.15.26:0/1708244657 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61400f66e0 0x7f61400f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:05.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.900+0000 7f6146e6e700 1 -- 172.21.15.26:0/1708244657 >> 172.21.15.26:0/1708244657 conn(0x7f61400f1f00 msgr2=0x7f61400f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:15:05.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.900+0000 7f6146e6e700 1 -- 172.21.15.26:0/1708244657 shutdown_connections 2021-11-03T17:15:05.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.900+0000 7f6146e6e700 1 -- 172.21.15.26:0/1708244657 wait complete. 2021-11-03T17:15:05.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.900+0000 7f6146e6e700 1 Processor -- start 2021-11-03T17:15:05.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.900+0000 7f6146e6e700 1 -- start start 2021-11-03T17:15:05.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.901+0000 7f6146e6e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61400f66e0 0x7f6140106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:15:05.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.901+0000 7f6146e6e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61400f6ff0 0x7f6140107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:15:05.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.901+0000 7f6146e6e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6140107a10 con 0x7f61400f66e0 2021-11-03T17:15:05.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.901+0000 7f6146e6e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6140107b50 con 0x7f61400f6ff0 2021-11-03T17:15:05.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.901+0000 7f6144c0a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61400f66e0 0x7f6140106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:15:05.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.901+0000 7f6144c0a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61400f66e0 0x7f6140106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53346/0 (socket says 172.21.15.26:53346) 2021-11-03T17:15:05.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.901+0000 7f6144c0a700 1 -- 172.21.15.26:0/4094815579 learned_addr learned my addr 172.21.15.26:0/4094815579 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:15:05.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.901+0000 7f613ffff700 1 --2- 172.21.15.26:0/4094815579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61400f6ff0 0x7f6140107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:15:05.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.901+0000 7f6144c0a700 1 -- 172.21.15.26:0/4094815579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61400f6ff0 msgr2=0x7f6140107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:15:05.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.901+0000 7f6144c0a700 1 --2- 172.21.15.26:0/4094815579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61400f6ff0 0x7f6140107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:05.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.901+0000 7f6144c0a700 1 -- 172.21.15.26:0/4094815579 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612c005040 con 0x7f61400f66e0 2021-11-03T17:15:05.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.901+0000 7f613ffff700 1 --2- 172.21.15.26:0/4094815579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61400f6ff0 0x7f6140107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:15:05.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.901+0000 7f6144c0a700 1 --2- 172.21.15.26:0/4094815579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61400f66e0 0x7f6140106f70 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f61340026d0 tx=0x7f6134009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:15:05.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.901+0000 7f613d7fa700 1 -- 172.21.15.26:0/4094815579 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6134009320 con 0x7f61400f66e0 2021-11-03T17:15:05.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.902+0000 7f613d7fa700 1 -- 172.21.15.26:0/4094815579 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f613400f040 con 0x7f61400f66e0 2021-11-03T17:15:05.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.902+0000 7f613d7fa700 1 -- 172.21.15.26:0/4094815579 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61340147e0 con 0x7f61400f66e0 2021-11-03T17:15:05.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.902+0000 7f6146e6e700 1 -- 172.21.15.26:0/4094815579 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61401084f0 con 0x7f61400f66e0 2021-11-03T17:15:05.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.902+0000 7f6146e6e700 1 -- 172.21.15.26:0/4094815579 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6140108a60 con 0x7f61400f66e0 2021-11-03T17:15:05.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.902+0000 7f6146e6e700 1 -- 172.21.15.26:0/4094815579 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6140045ad0 con 0x7f61400f66e0 2021-11-03T17:15:05.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.903+0000 7f613d7fa700 1 -- 172.21.15.26:0/4094815579 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f6134009480 con 0x7f61400f66e0 2021-11-03T17:15:05.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.903+0000 7f613d7fa700 1 --2- 172.21.15.26:0/4094815579 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f61300640b0 0x7f6130066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:15:05.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.903+0000 7f613d7fa700 1 -- 172.21.15.26:0/4094815579 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f6134080eb0 con 0x7f61400f66e0 2021-11-03T17:15:05.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.903+0000 7f613ffff700 1 --2- 172.21.15.26:0/4094815579 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f61300640b0 0x7f6130066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:15:05.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.904+0000 7f613ffff700 1 --2- 172.21.15.26:0/4094815579 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f61300640b0 0x7f6130066570 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f612c004630 tx=0x7f612c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:15:05.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:05.907+0000 7f613d7fa700 1 -- 172.21.15.26:0/4094815579 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f6134053210 con 0x7f61400f66e0 2021-11-03T17:15:06.076 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.081+0000 7f6146e6e700 1 -- 172.21.15.26:0/4094815579 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f61400ff050 con 0x7f61300640b0 2021-11-03T17:15:06.090 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.096+0000 7f613d7fa700 1 -- 172.21.15.26:0/4094815579 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f61400ff050 con 0x7f61300640b0 2021-11-03T17:15:06.091 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:15:06.092 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (26m) 6m ago 27m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:15:06.092 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (18m) 6m ago 27m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:15:06.093 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (18m) 5m ago 26m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:15:06.093 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (26m) 6m ago 27m 39.5M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:15:06.093 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (19m) 6m ago 22m 16.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:15:06.094 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (19m) 6m ago 22m 17.8M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:15:06.094 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (22m) 5m ago 22m 19.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:15:06.095 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (22m) 5m ago 22m 19.4M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:15:06.095 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (20m) 6m ago 28m 491M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:15:06.096 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (19m) 5m ago 26m 415M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:15:06.096 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (19m) 6m ago 29m 113M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:15:06.097 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (19m) 5m ago 26m 70.2M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:15:06.097 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (27m) 6m ago 27m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:15:06.097 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (26m) 5m ago 26m 18.4M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:15:06.098 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (18m) 6m ago 25m 190M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:15:06.098 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (17m) 6m ago 25m 204M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:15:06.099 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (17m) 6m ago 25m 170M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:15:06.099 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (16m) 5m ago 24m 211M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:15:06.100 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (16m) 5m ago 24m 189M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:15:06.100 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (15m) 5m ago 24m 174M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:15:06.101 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (26m) 6m ago 26m 49.9M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:15:06.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.098+0000 7f6146e6e700 1 -- 172.21.15.26:0/4094815579 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f61300640b0 msgr2=0x7f6130066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:15:06.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.098+0000 7f6146e6e700 1 --2- 172.21.15.26:0/4094815579 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f61300640b0 0x7f6130066570 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f612c004630 tx=0x7f612c009b30).stop 2021-11-03T17:15:06.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.098+0000 7f6146e6e700 1 -- 172.21.15.26:0/4094815579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61400f66e0 msgr2=0x7f6140106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:15:06.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.098+0000 7f6146e6e700 1 --2- 172.21.15.26:0/4094815579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61400f66e0 0x7f6140106f70 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f61340026d0 tx=0x7f6134009de0).stop 2021-11-03T17:15:06.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.098+0000 7f6146e6e700 1 -- 172.21.15.26:0/4094815579 shutdown_connections 2021-11-03T17:15:06.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.098+0000 7f6146e6e700 1 --2- 172.21.15.26:0/4094815579 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f61300640b0 0x7f6130066570 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:06.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.098+0000 7f6146e6e700 1 --2- 172.21.15.26:0/4094815579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61400f66e0 0x7f6140106f70 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:06.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.098+0000 7f6146e6e700 1 --2- 172.21.15.26:0/4094815579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61400f6ff0 0x7f6140107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:06.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.098+0000 7f6146e6e700 1 -- 172.21.15.26:0/4094815579 >> 172.21.15.26:0/4094815579 conn(0x7f61400f1f00 msgr2=0x7f61400fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:15:06.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.098+0000 7f6146e6e700 1 -- 172.21.15.26:0/4094815579 shutdown_connections 2021-11-03T17:15:06.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.098+0000 7f6146e6e700 1 -- 172.21.15.26:0/4094815579 wait complete. 2021-11-03T17:15:06.194 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.197+0000 7ff40f59e700 1 -- 172.21.15.26:0/1715718837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4100f5440 msgr2=0x7ff4100f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:15:06.194 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.197+0000 7ff40f59e700 1 --2- 172.21.15.26:0/1715718837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4100f5440 0x7ff4100f5860 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7ff400004660 tx=0x7ff400009b30).stop 2021-11-03T17:15:06.194 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.197+0000 7ff40f59e700 1 -- 172.21.15.26:0/1715718837 shutdown_connections 2021-11-03T17:15:06.195 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.197+0000 7ff40f59e700 1 --2- 172.21.15.26:0/1715718837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4100f66e0 0x7ff4100f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:06.195 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.197+0000 7ff40f59e700 1 --2- 172.21.15.26:0/1715718837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4100f5440 0x7ff4100f5860 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:06.195 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.197+0000 7ff40f59e700 1 -- 172.21.15.26:0/1715718837 >> 172.21.15.26:0/1715718837 conn(0x7ff4100f0ba0 msgr2=0x7ff4100f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:15:06.195 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.197+0000 7ff40f59e700 1 -- 172.21.15.26:0/1715718837 shutdown_connections 2021-11-03T17:15:06.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.197+0000 7ff40f59e700 1 -- 172.21.15.26:0/1715718837 wait complete. 2021-11-03T17:15:06.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.198+0000 7ff40f59e700 1 Processor -- start 2021-11-03T17:15:06.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.198+0000 7ff40f59e700 1 -- start start 2021-11-03T17:15:06.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.198+0000 7ff40f59e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4100f5440 0x7ff410109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:15:06.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.198+0000 7ff40f59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4100f66e0 0x7ff41010bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:15:06.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.198+0000 7ff40f59e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4100603e0 con 0x7ff4100f66e0 2021-11-03T17:15:06.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.198+0000 7ff40f59e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff410060520 con 0x7ff4100f5440 2021-11-03T17:15:06.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.198+0000 7ff405d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4100f66e0 0x7ff41010bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:15:06.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.198+0000 7ff405d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4100f66e0 0x7ff41010bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53358/0 (socket says 172.21.15.26:53358) 2021-11-03T17:15:06.198 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.198+0000 7ff405d9b700 1 -- 172.21.15.26:0/726355083 learned_addr learned my addr 172.21.15.26:0/726355083 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:15:06.198 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.198+0000 7ff40e59c700 1 --2- 172.21.15.26:0/726355083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4100f5440 0x7ff410109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:15:06.198 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.199+0000 7ff405d9b700 1 -- 172.21.15.26:0/726355083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4100f5440 msgr2=0x7ff410109a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:15:06.199 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.199+0000 7ff405d9b700 1 --2- 172.21.15.26:0/726355083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4100f5440 0x7ff410109a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:06.199 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.199+0000 7ff405d9b700 1 -- 172.21.15.26:0/726355083 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff400005040 con 0x7ff4100f66e0 2021-11-03T17:15:06.200 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.199+0000 7ff40e59c700 1 --2- 172.21.15.26:0/726355083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4100f5440 0x7ff410109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:15:06.200 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.199+0000 7ff405d9b700 1 --2- 172.21.15.26:0/726355083 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4100f66e0 0x7ff41010bf90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7ff3f80026d0 tx=0x7ff3f8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:15:06.200 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.199+0000 7ff4077fe700 1 -- 172.21.15.26:0/726355083 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3f8009320 con 0x7ff4100f66e0 2021-11-03T17:15:06.200 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.199+0000 7ff40f59e700 1 -- 172.21.15.26:0/726355083 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff41010c540 con 0x7ff4100f66e0 2021-11-03T17:15:06.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.199+0000 7ff4077fe700 1 -- 172.21.15.26:0/726355083 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff3f800f040 con 0x7ff4100f66e0 2021-11-03T17:15:06.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.199+0000 7ff4077fe700 1 -- 172.21.15.26:0/726355083 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3f80147e0 con 0x7ff4100f66e0 2021-11-03T17:15:06.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.199+0000 7ff40f59e700 1 -- 172.21.15.26:0/726355083 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff41010cb00 con 0x7ff4100f66e0 2021-11-03T17:15:06.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.200+0000 7ff40f59e700 1 -- 172.21.15.26:0/726355083 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff410045ad0 con 0x7ff4100f66e0 2021-11-03T17:15:06.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.200+0000 7ff4077fe700 1 -- 172.21.15.26:0/726355083 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ff3f8009480 con 0x7ff4100f66e0 2021-11-03T17:15:06.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.201+0000 7ff4077fe700 1 --2- 172.21.15.26:0/726355083 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff3fc064100 0x7ff3fc0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:15:06.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.201+0000 7ff4077fe700 1 -- 172.21.15.26:0/726355083 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ff3f8080eb0 con 0x7ff4100f66e0 2021-11-03T17:15:06.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.201+0000 7ff40e59c700 1 --2- 172.21.15.26:0/726355083 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff3fc064100 0x7ff3fc0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:15:06.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.201+0000 7ff40e59c700 1 --2- 172.21.15.26:0/726355083 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff3fc064100 0x7ff3fc0665c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7ff410060060 tx=0x7ff400009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:15:06.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.205+0000 7ff4077fe700 1 -- 172.21.15.26:0/726355083 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ff3f8053210 con 0x7ff4100f66e0 2021-11-03T17:15:06.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:06 smithi026 ceph-mon[96795]: pgmap v613: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:06.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.435+0000 7ff40f59e700 1 -- 172.21.15.26:0/726355083 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff410027a00 con 0x7ff4100f66e0 2021-11-03T17:15:06.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.436+0000 7ff4077fe700 1 -- 172.21.15.26:0/726355083 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7ff3f8052e00 con 0x7ff4100f66e0 2021-11-03T17:15:06.430 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:15:06.431 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:15:06.431 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:15:06.431 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:15:06.431 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:15:06.432 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:15:06.432 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:15:06.432 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:15:06.432 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:15:06.432 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:15:06.433 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:15:06.433 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:15:06.433 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:15:06.433 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:15:06.434 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:15:06.434 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:15:06.434 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:15:06.435 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:15:06.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.438+0000 7ff40f59e700 1 -- 172.21.15.26:0/726355083 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff3fc064100 msgr2=0x7ff3fc0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:15:06.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.438+0000 7ff40f59e700 1 --2- 172.21.15.26:0/726355083 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff3fc064100 0x7ff3fc0665c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7ff410060060 tx=0x7ff400009b30).stop 2021-11-03T17:15:06.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.438+0000 7ff40f59e700 1 -- 172.21.15.26:0/726355083 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4100f66e0 msgr2=0x7ff41010bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:15:06.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.438+0000 7ff40f59e700 1 --2- 172.21.15.26:0/726355083 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4100f66e0 0x7ff41010bf90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7ff3f80026d0 tx=0x7ff3f8009de0).stop 2021-11-03T17:15:06.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.438+0000 7ff40f59e700 1 -- 172.21.15.26:0/726355083 shutdown_connections 2021-11-03T17:15:06.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.438+0000 7ff40f59e700 1 --2- 172.21.15.26:0/726355083 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff3fc064100 0x7ff3fc0665c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:06.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.438+0000 7ff40f59e700 1 --2- 172.21.15.26:0/726355083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4100f5440 0x7ff410109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:06.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.438+0000 7ff40f59e700 1 --2- 172.21.15.26:0/726355083 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4100f66e0 0x7ff41010bf90 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:06.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.438+0000 7ff40f59e700 1 -- 172.21.15.26:0/726355083 >> 172.21.15.26:0/726355083 conn(0x7ff4100f0ba0 msgr2=0x7ff4100fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:15:06.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.438+0000 7ff40f59e700 1 -- 172.21.15.26:0/726355083 shutdown_connections 2021-11-03T17:15:06.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.438+0000 7ff40f59e700 1 -- 172.21.15.26:0/726355083 wait complete. 2021-11-03T17:15:06.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:06 smithi194 ceph-mon[65619]: pgmap v613: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:06.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.541+0000 7f35679a3700 1 -- 172.21.15.26:0/4138028009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35600f9890 msgr2=0x7f35600fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:15:06.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.541+0000 7f35679a3700 1 --2- 172.21.15.26:0/4138028009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35600f9890 0x7f35600fbc80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f3554004660 tx=0x7f3554009b30).stop 2021-11-03T17:15:06.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.541+0000 7f35679a3700 1 -- 172.21.15.26:0/4138028009 shutdown_connections 2021-11-03T17:15:06.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.541+0000 7f35679a3700 1 --2- 172.21.15.26:0/4138028009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35600f9890 0x7f35600fbc80 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:06.538 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.541+0000 7f35679a3700 1 --2- 172.21.15.26:0/4138028009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35600602f0 0x7f35600f93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:06.538 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.541+0000 7f35679a3700 1 -- 172.21.15.26:0/4138028009 >> 172.21.15.26:0/4138028009 conn(0x7f35600f0de0 msgr2=0x7f35600f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:15:06.538 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.541+0000 7f35679a3700 1 -- 172.21.15.26:0/4138028009 shutdown_connections 2021-11-03T17:15:06.538 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.541+0000 7f35679a3700 1 -- 172.21.15.26:0/4138028009 wait complete. 2021-11-03T17:15:06.539 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.541+0000 7f35679a3700 1 Processor -- start 2021-11-03T17:15:06.539 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.541+0000 7f35679a3700 1 -- start start 2021-11-03T17:15:06.539 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.541+0000 7f35679a3700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35600602f0 0x7f3560106f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:15:06.539 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.541+0000 7f35679a3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35600f9890 0x7f3560107440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:15:06.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.541+0000 7f35679a3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35601079f0 con 0x7f35600f9890 2021-11-03T17:15:06.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.541+0000 7f35679a3700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3560107b30 con 0x7f35600602f0 2021-11-03T17:15:06.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.542+0000 7f3564f3e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35600f9890 0x7f3560107440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:15:06.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.542+0000 7f3564f3e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35600f9890 0x7f3560107440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53368/0 (socket says 172.21.15.26:53368) 2021-11-03T17:15:06.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.542+0000 7f3564f3e700 1 -- 172.21.15.26:0/1558430797 learned_addr learned my addr 172.21.15.26:0/1558430797 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:15:06.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.542+0000 7f356573f700 1 --2- 172.21.15.26:0/1558430797 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35600602f0 0x7f3560106f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:15:06.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.542+0000 7f3564f3e700 1 -- 172.21.15.26:0/1558430797 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35600602f0 msgr2=0x7f3560106f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:15:06.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.542+0000 7f3564f3e700 1 --2- 172.21.15.26:0/1558430797 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35600602f0 0x7f3560106f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:06.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.542+0000 7f3564f3e700 1 -- 172.21.15.26:0/1558430797 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3554005040 con 0x7f35600f9890 2021-11-03T17:15:06.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.542+0000 7f3564f3e700 1 --2- 172.21.15.26:0/1558430797 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35600f9890 0x7f3560107440 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f3554009990 tx=0x7f3554009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:15:06.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.542+0000 7f355dffb700 1 -- 172.21.15.26:0/1558430797 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3554018070 con 0x7f35600f9890 2021-11-03T17:15:06.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.542+0000 7f355dffb700 1 -- 172.21.15.26:0/1558430797 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3554007ba0 con 0x7f35600f9890 2021-11-03T17:15:06.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.542+0000 7f35679a3700 1 -- 172.21.15.26:0/1558430797 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3560108470 con 0x7f35600f9890 2021-11-03T17:15:06.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.542+0000 7f355dffb700 1 -- 172.21.15.26:0/1558430797 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f355401c620 con 0x7f35600f9890 2021-11-03T17:15:06.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.542+0000 7f35679a3700 1 -- 172.21.15.26:0/1558430797 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35601089d0 con 0x7f35600f9890 2021-11-03T17:15:06.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.543+0000 7f35679a3700 1 -- 172.21.15.26:0/1558430797 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3560045ad0 con 0x7f35600f9890 2021-11-03T17:15:06.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.544+0000 7f355dffb700 1 -- 172.21.15.26:0/1558430797 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f355401c890 con 0x7f35600f9890 2021-11-03T17:15:06.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.544+0000 7f355dffb700 1 --2- 172.21.15.26:0/1558430797 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f35480640b0 0x7f3548066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:15:06.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.544+0000 7f355dffb700 1 -- 172.21.15.26:0/1558430797 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f3554082520 con 0x7f35600f9890 2021-11-03T17:15:06.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.544+0000 7f356573f700 1 --2- 172.21.15.26:0/1558430797 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f35480640b0 0x7f3548066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:15:06.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.545+0000 7f356573f700 1 --2- 172.21.15.26:0/1558430797 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f35480640b0 0x7f3548066570 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f35600600c0 tx=0x7f3558009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:15:06.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.548+0000 7f355dffb700 1 -- 172.21.15.26:0/1558430797 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f3554054940 con 0x7f35600f9890 2021-11-03T17:15:06.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.755+0000 7f35679a3700 1 -- 172.21.15.26:0/1558430797 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3560027a00 con 0x7f35600f9890 2021-11-03T17:15:06.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.755+0000 7f355dffb700 1 -- 172.21.15.26:0/1558430797 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f3554054530 con 0x7f35600f9890 2021-11-03T17:15:06.750 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:15:06.750 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:15:06.751 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:15:06.751 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:15:06.751 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:15:06.751 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:15:06.752 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:15:06.752 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:15:06.752 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:15:06.752 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:15:06.752 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:15:06.753 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:15:06.753 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:15:06.753 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:15:06.753 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:15:06.754 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:15:06.754 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:15:06.754 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:15:06.754 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:15:06.754 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:15:06.755 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:15:06.755 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:15:06.755 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:15:06.755 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:15:06.756 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:15:06.756 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:15:06.756 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:15:06.756 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:15:06.757 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:15:06.757 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:15:06.757 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:15:06.757 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:15:06.758 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:15:06.758 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:15:06.758 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:15:06.758 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:15:06.758 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:15:06.759 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:15:06.759 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:15:06.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.757+0000 7f35679a3700 1 -- 172.21.15.26:0/1558430797 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f35480640b0 msgr2=0x7f3548066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:15:06.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.757+0000 7f35679a3700 1 --2- 172.21.15.26:0/1558430797 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f35480640b0 0x7f3548066570 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f35600600c0 tx=0x7f3558009040).stop 2021-11-03T17:15:06.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.757+0000 7f35679a3700 1 -- 172.21.15.26:0/1558430797 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35600f9890 msgr2=0x7f3560107440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:15:06.761 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.757+0000 7f35679a3700 1 --2- 172.21.15.26:0/1558430797 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35600f9890 0x7f3560107440 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f3554009990 tx=0x7f3554009b30).stop 2021-11-03T17:15:06.761 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.757+0000 7f35679a3700 1 -- 172.21.15.26:0/1558430797 shutdown_connections 2021-11-03T17:15:06.761 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.757+0000 7f35679a3700 1 --2- 172.21.15.26:0/1558430797 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f35480640b0 0x7f3548066570 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:06.761 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.757+0000 7f35679a3700 1 --2- 172.21.15.26:0/1558430797 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35600602f0 0x7f3560106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:06.762 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.757+0000 7f35679a3700 1 --2- 172.21.15.26:0/1558430797 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35600f9890 0x7f3560107440 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:06.762 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.757+0000 7f35679a3700 1 -- 172.21.15.26:0/1558430797 >> 172.21.15.26:0/1558430797 conn(0x7f35600f0de0 msgr2=0x7f35600f31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:15:06.762 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.757+0000 7f35679a3700 1 -- 172.21.15.26:0/1558430797 shutdown_connections 2021-11-03T17:15:06.762 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:06.757+0000 7f35679a3700 1 -- 172.21.15.26:0/1558430797 wait complete. 2021-11-03T17:15:06.763 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:15:07.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:07 smithi026 ceph-mon[96795]: from='client.34780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:15:07.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:07 smithi026 ceph-mon[96795]: from='client.34784 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:15:07.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:07 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/726355083' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:15:07.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:07 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1558430797' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:15:07.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:07 smithi194 ceph-mon[65619]: from='client.34780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:15:07.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:07 smithi194 ceph-mon[65619]: from='client.34784 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:15:07.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:07 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/726355083' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:15:07.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:07 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1558430797' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:15:08.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:08 smithi026 ceph-mon[96795]: pgmap v614: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:08.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:08 smithi194 ceph-mon[65619]: pgmap v614: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:10.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:10 smithi026 ceph-mon[96795]: pgmap v615: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:10.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:10 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:15:10.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:10 smithi194 ceph-mon[65619]: pgmap v615: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:10.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:10 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:15:11.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:11 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:15:11.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:11 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:15:12.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:12 smithi026 ceph-mon[96795]: pgmap v616: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:12.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:12 smithi194 ceph-mon[65619]: pgmap v616: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:14.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:14 smithi026 ceph-mon[96795]: pgmap v617: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:14.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:14 smithi194 ceph-mon[65619]: pgmap v617: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:16.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:16 smithi026 ceph-mon[96795]: pgmap v618: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:16.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:16 smithi194 ceph-mon[65619]: pgmap v618: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:18.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:18 smithi026 ceph-mon[96795]: pgmap v619: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:18.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:18 smithi194 ceph-mon[65619]: pgmap v619: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:20.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:20 smithi026 ceph-mon[96795]: pgmap v620: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:20.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:20 smithi194 ceph-mon[65619]: pgmap v620: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:22.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:22 smithi026 ceph-mon[96795]: pgmap v621: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:22.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:22 smithi194 ceph-mon[65619]: pgmap v621: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:24.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:24 smithi026 ceph-mon[96795]: pgmap v622: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:24.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:24 smithi194 ceph-mon[65619]: pgmap v622: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:25.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:15:25.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:15:26.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:26 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:15:26.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:26 smithi026 ceph-mon[96795]: pgmap v623: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:26.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:26 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:15:26.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:26 smithi194 ceph-mon[65619]: pgmap v623: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:28.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:28 smithi026 ceph-mon[96795]: pgmap v624: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:28.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:28 smithi194 ceph-mon[65619]: pgmap v624: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:30.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:30 smithi026 ceph-mon[96795]: pgmap v625: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:30.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:30 smithi194 ceph-mon[65619]: pgmap v625: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:32.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:32 smithi026 ceph-mon[96795]: pgmap v626: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:32.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:32 smithi194 ceph-mon[65619]: pgmap v626: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:34.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:34 smithi026 ceph-mon[96795]: pgmap v627: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:34.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:34 smithi194 ceph-mon[65619]: pgmap v627: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:36.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:36 smithi026 ceph-mon[96795]: pgmap v628: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:36.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:36 smithi194 ceph-mon[65619]: pgmap v628: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:36.867 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:36.871+0000 7f02f5977700 1 -- 172.21.15.26:0/979791069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02f00f6530 msgr2=0x7f02f00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:15:36.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:36.871+0000 7f02f5977700 1 --2- 172.21.15.26:0/979791069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02f00f6530 0x7f02f00f6950 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f02e4004660 tx=0x7f02e4009b30).stop 2021-11-03T17:15:36.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:36.871+0000 7f02f5977700 1 -- 172.21.15.26:0/979791069 shutdown_connections 2021-11-03T17:15:36.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:36.871+0000 7f02f5977700 1 --2- 172.21.15.26:0/979791069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02f00f77d0 0x7f02f00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:36.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:36.871+0000 7f02f5977700 1 --2- 172.21.15.26:0/979791069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02f00f6530 0x7f02f00f6950 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:36.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:36.871+0000 7f02f5977700 1 -- 172.21.15.26:0/979791069 >> 172.21.15.26:0/979791069 conn(0x7f02f00f1c90 msgr2=0x7f02f00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:15:36.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:36.871+0000 7f02f5977700 1 -- 172.21.15.26:0/979791069 shutdown_connections 2021-11-03T17:15:36.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:36.871+0000 7f02f5977700 1 -- 172.21.15.26:0/979791069 wait complete. 2021-11-03T17:15:36.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:36.872+0000 7f02f5977700 1 Processor -- start 2021-11-03T17:15:36.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:36.872+0000 7f02f5977700 1 -- start start 2021-11-03T17:15:36.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:36.872+0000 7f02f5977700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02f00f6530 0x7f02f0106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:15:36.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:36.872+0000 7f02f5977700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02f00f77d0 0x7f02f01072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:15:36.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:36.872+0000 7f02f5977700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f01078f0 con 0x7f02f00f77d0 2021-11-03T17:15:36.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:36.872+0000 7f02f5977700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f0108100 con 0x7f02f00f6530 2021-11-03T17:15:36.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:36.873+0000 7f02effff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02f00f77d0 0x7f02f01072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:15:36.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:36.873+0000 7f02effff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02f00f77d0 0x7f02f01072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53386/0 (socket says 172.21.15.26:53386) 2021-11-03T17:15:36.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:36.873+0000 7f02effff700 1 -- 172.21.15.26:0/2284713209 learned_addr learned my addr 172.21.15.26:0/2284713209 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:15:36.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:36.873+0000 7f02f4975700 1 --2- 172.21.15.26:0/2284713209 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02f00f6530 0x7f02f0106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:15:36.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:36.873+0000 7f02effff700 1 -- 172.21.15.26:0/2284713209 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02f00f6530 msgr2=0x7f02f0106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:15:36.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:36.873+0000 7f02effff700 1 --2- 172.21.15.26:0/2284713209 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02f00f6530 0x7f02f0106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:36.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:36.873+0000 7f02effff700 1 -- 172.21.15.26:0/2284713209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e4005040 con 0x7f02f00f77d0 2021-11-03T17:15:36.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:36.873+0000 7f02effff700 1 --2- 172.21.15.26:0/2284713209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02f00f77d0 0x7f02f01072f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f02dc00c790 tx=0x7f02dc007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:15:36.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:36.873+0000 7f02ed7fa700 1 -- 172.21.15.26:0/2284713209 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02dc002590 con 0x7f02f00f77d0 2021-11-03T17:15:36.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:36.873+0000 7f02ed7fa700 1 -- 172.21.15.26:0/2284713209 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f02dc002ba0 con 0x7f02f00f77d0 2021-11-03T17:15:36.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:36.873+0000 7f02f5977700 1 -- 172.21.15.26:0/2284713209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02f0108380 con 0x7f02f00f77d0 2021-11-03T17:15:36.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:36.873+0000 7f02ed7fa700 1 -- 172.21.15.26:0/2284713209 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02dc013d90 con 0x7f02f00f77d0 2021-11-03T17:15:36.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:36.873+0000 7f02f5977700 1 -- 172.21.15.26:0/2284713209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02f0108940 con 0x7f02f00f77d0 2021-11-03T17:15:36.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:36.874+0000 7f02f5977700 1 -- 172.21.15.26:0/2284713209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02f0059100 con 0x7f02f00f77d0 2021-11-03T17:15:36.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:36.875+0000 7f02ed7fa700 1 -- 172.21.15.26:0/2284713209 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f02dc01a060 con 0x7f02f00f77d0 2021-11-03T17:15:36.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:36.875+0000 7f02ed7fa700 1 --2- 172.21.15.26:0/2284713209 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f02e0064100 0x7f02e00665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:15:36.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:36.875+0000 7f02ed7fa700 1 -- 172.21.15.26:0/2284713209 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f02dc080b50 con 0x7f02f00f77d0 2021-11-03T17:15:36.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:36.876+0000 7f02f4975700 1 --2- 172.21.15.26:0/2284713209 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f02e0064100 0x7f02e00665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:15:36.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:36.876+0000 7f02f4975700 1 --2- 172.21.15.26:0/2284713209 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f02e0064100 0x7f02e00665c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f02e4013690 tx=0x7f02e4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:15:36.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:36.880+0000 7f02ed7fa700 1 -- 172.21.15.26:0/2284713209 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f02dc052d00 con 0x7f02f00f77d0 2021-11-03T17:15:37.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.059+0000 7f02f5977700 1 -- 172.21.15.26:0/2284713209 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f02f00fede0 con 0x7f02e0064100 2021-11-03T17:15:37.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.060+0000 7f02ed7fa700 1 -- 172.21.15.26:0/2284713209 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f02f00fede0 con 0x7f02e0064100 2021-11-03T17:15:37.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.062+0000 7f02f5977700 1 -- 172.21.15.26:0/2284713209 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f02e0064100 msgr2=0x7f02e00665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:15:37.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.062+0000 7f02f5977700 1 --2- 172.21.15.26:0/2284713209 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f02e0064100 0x7f02e00665c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f02e4013690 tx=0x7f02e4009b30).stop 2021-11-03T17:15:37.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.062+0000 7f02f5977700 1 -- 172.21.15.26:0/2284713209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02f00f77d0 msgr2=0x7f02f01072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:15:37.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.062+0000 7f02f5977700 1 --2- 172.21.15.26:0/2284713209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02f00f77d0 0x7f02f01072f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f02dc00c790 tx=0x7f02dc007d70).stop 2021-11-03T17:15:37.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.062+0000 7f02f5977700 1 -- 172.21.15.26:0/2284713209 shutdown_connections 2021-11-03T17:15:37.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.062+0000 7f02f5977700 1 --2- 172.21.15.26:0/2284713209 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f02e0064100 0x7f02e00665c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:37.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.062+0000 7f02f5977700 1 --2- 172.21.15.26:0/2284713209 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02f00f6530 0x7f02f0106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:37.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.062+0000 7f02f5977700 1 --2- 172.21.15.26:0/2284713209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02f00f77d0 0x7f02f01072f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:37.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.062+0000 7f02f5977700 1 -- 172.21.15.26:0/2284713209 >> 172.21.15.26:0/2284713209 conn(0x7f02f00f1c90 msgr2=0x7f02f00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:15:37.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.062+0000 7f02f5977700 1 -- 172.21.15.26:0/2284713209 shutdown_connections 2021-11-03T17:15:37.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.062+0000 7f02f5977700 1 -- 172.21.15.26:0/2284713209 wait complete. 2021-11-03T17:15:37.068 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:15:37.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.163+0000 7fb383258700 1 -- 172.21.15.26:0/3261945232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb37c0f7980 msgr2=0x7fb37c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:15:37.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.163+0000 7fb383258700 1 --2- 172.21.15.26:0/3261945232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb37c0f7980 0x7fb37c0f7de0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7fb368004660 tx=0x7fb368009b30).stop 2021-11-03T17:15:37.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.163+0000 7fb383258700 1 -- 172.21.15.26:0/3261945232 shutdown_connections 2021-11-03T17:15:37.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.163+0000 7fb383258700 1 --2- 172.21.15.26:0/3261945232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb37c0f7980 0x7fb37c0f7de0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:37.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.163+0000 7fb383258700 1 --2- 172.21.15.26:0/3261945232 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb37c0f66e0 0x7fb37c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:37.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.163+0000 7fb383258700 1 -- 172.21.15.26:0/3261945232 >> 172.21.15.26:0/3261945232 conn(0x7fb37c0f1e40 msgr2=0x7fb37c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:15:37.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.163+0000 7fb383258700 1 -- 172.21.15.26:0/3261945232 shutdown_connections 2021-11-03T17:15:37.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.163+0000 7fb383258700 1 -- 172.21.15.26:0/3261945232 wait complete. 2021-11-03T17:15:37.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.164+0000 7fb383258700 1 Processor -- start 2021-11-03T17:15:37.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.164+0000 7fb383258700 1 -- start start 2021-11-03T17:15:37.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.164+0000 7fb383258700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb37c0f66e0 0x7fb37c106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:15:37.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.164+0000 7fb383258700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb37c0f7980 0x7fb37c107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:15:37.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.164+0000 7fb383258700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c107a00 con 0x7fb37c0f66e0 2021-11-03T17:15:37.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.164+0000 7fb383258700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c107b40 con 0x7fb37c0f7980 2021-11-03T17:15:37.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.164+0000 7fb380ff4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb37c0f66e0 0x7fb37c106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:15:37.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.164+0000 7fb380ff4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb37c0f66e0 0x7fb37c106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53394/0 (socket says 172.21.15.26:53394) 2021-11-03T17:15:37.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.164+0000 7fb380ff4700 1 -- 172.21.15.26:0/4263809721 learned_addr learned my addr 172.21.15.26:0/4263809721 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:15:37.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.164+0000 7fb37bfff700 1 --2- 172.21.15.26:0/4263809721 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb37c0f7980 0x7fb37c107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:15:37.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.164+0000 7fb380ff4700 1 -- 172.21.15.26:0/4263809721 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb37c0f7980 msgr2=0x7fb37c107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:15:37.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.164+0000 7fb380ff4700 1 --2- 172.21.15.26:0/4263809721 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb37c0f7980 0x7fb37c107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:37.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.164+0000 7fb380ff4700 1 -- 172.21.15.26:0/4263809721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb368005040 con 0x7fb37c0f66e0 2021-11-03T17:15:37.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.165+0000 7fb380ff4700 1 --2- 172.21.15.26:0/4263809721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb37c0f66e0 0x7fb37c106f60 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7fb370002700 tx=0x7fb370009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:15:37.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.165+0000 7fb3797fa700 1 -- 172.21.15.26:0/4263809721 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3700079c0 con 0x7fb37c0f66e0 2021-11-03T17:15:37.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.165+0000 7fb3797fa700 1 -- 172.21.15.26:0/4263809721 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb37000f040 con 0x7fb37c0f66e0 2021-11-03T17:15:37.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.165+0000 7fb3797fa700 1 -- 172.21.15.26:0/4263809721 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb370014860 con 0x7fb37c0f66e0 2021-11-03T17:15:37.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.165+0000 7fb383258700 1 -- 172.21.15.26:0/4263809721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb37c1084e0 con 0x7fb37c0f66e0 2021-11-03T17:15:37.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.165+0000 7fb383258700 1 -- 172.21.15.26:0/4263809721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb37c108a50 con 0x7fb37c0f66e0 2021-11-03T17:15:37.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.166+0000 7fb383258700 1 -- 172.21.15.26:0/4263809721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb37c045ad0 con 0x7fb37c0f66e0 2021-11-03T17:15:37.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.166+0000 7fb3797fa700 1 -- 172.21.15.26:0/4263809721 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fb37001b060 con 0x7fb37c0f66e0 2021-11-03T17:15:37.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.167+0000 7fb3797fa700 1 --2- 172.21.15.26:0/4263809721 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb36c0640b0 0x7fb36c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:15:37.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.167+0000 7fb3797fa700 1 -- 172.21.15.26:0/4263809721 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fb370080730 con 0x7fb37c0f66e0 2021-11-03T17:15:37.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.167+0000 7fb37bfff700 1 --2- 172.21.15.26:0/4263809721 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb36c0640b0 0x7fb36c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:15:37.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.167+0000 7fb37bfff700 1 --2- 172.21.15.26:0/4263809721 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb36c0640b0 0x7fb36c066570 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fb368004630 tx=0x7fb368009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:15:37.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.171+0000 7fb3797fa700 1 -- 172.21.15.26:0/4263809721 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fb3700529d0 con 0x7fb37c0f66e0 2021-11-03T17:15:37.338 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.342+0000 7fb383258700 1 -- 172.21.15.26:0/4263809721 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb37c108d20 con 0x7fb36c0640b0 2021-11-03T17:15:37.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.357+0000 7fb3797fa700 1 -- 172.21.15.26:0/4263809721 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fb37c108d20 con 0x7fb36c0640b0 2021-11-03T17:15:37.352 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:15:37.353 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (26m) 7m ago 28m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:15:37.353 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (19m) 7m ago 28m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:15:37.353 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (18m) 6m ago 27m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:15:37.353 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (26m) 7m ago 27m 39.5M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:15:37.354 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (19m) 7m ago 23m 16.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:15:37.354 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (20m) 7m ago 23m 17.8M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:15:37.354 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (23m) 6m ago 23m 19.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:15:37.354 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (23m) 6m ago 23m 19.4M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:15:37.354 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (20m) 7m ago 29m 491M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:15:37.355 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (20m) 6m ago 27m 415M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:15:37.355 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (19m) 7m ago 29m 113M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:15:37.355 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (19m) 6m ago 27m 70.2M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:15:37.355 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (27m) 7m ago 27m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:15:37.356 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (27m) 6m ago 27m 18.4M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:15:37.356 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (18m) 7m ago 26m 190M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:15:37.356 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (18m) 7m ago 26m 204M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:15:37.356 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (17m) 7m ago 25m 170M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:15:37.357 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (17m) 6m ago 25m 211M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:15:37.357 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (16m) 6m ago 25m 189M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:15:37.357 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (16m) 6m ago 24m 174M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:15:37.357 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (26m) 7m ago 27m 49.9M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:15:37.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.359+0000 7fb383258700 1 -- 172.21.15.26:0/4263809721 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb36c0640b0 msgr2=0x7fb36c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:15:37.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.359+0000 7fb383258700 1 --2- 172.21.15.26:0/4263809721 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb36c0640b0 0x7fb36c066570 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fb368004630 tx=0x7fb368009b30).stop 2021-11-03T17:15:37.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.359+0000 7fb383258700 1 -- 172.21.15.26:0/4263809721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb37c0f66e0 msgr2=0x7fb37c106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:15:37.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.359+0000 7fb383258700 1 --2- 172.21.15.26:0/4263809721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb37c0f66e0 0x7fb37c106f60 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7fb370002700 tx=0x7fb370009d80).stop 2021-11-03T17:15:37.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.359+0000 7fb383258700 1 -- 172.21.15.26:0/4263809721 shutdown_connections 2021-11-03T17:15:37.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.359+0000 7fb383258700 1 --2- 172.21.15.26:0/4263809721 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb36c0640b0 0x7fb36c066570 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:37.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.359+0000 7fb383258700 1 --2- 172.21.15.26:0/4263809721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb37c0f66e0 0x7fb37c106f60 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:37.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.359+0000 7fb383258700 1 --2- 172.21.15.26:0/4263809721 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb37c0f7980 0x7fb37c107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:37.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.359+0000 7fb383258700 1 -- 172.21.15.26:0/4263809721 >> 172.21.15.26:0/4263809721 conn(0x7fb37c0f1e40 msgr2=0x7fb37c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:15:37.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.359+0000 7fb383258700 1 -- 172.21.15.26:0/4263809721 shutdown_connections 2021-11-03T17:15:37.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.359+0000 7fb383258700 1 -- 172.21.15.26:0/4263809721 wait complete. 2021-11-03T17:15:37.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.458+0000 7f7bbebfc700 1 -- 172.21.15.26:0/2577359646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bb80f6ff0 msgr2=0x7f7bb80f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:15:37.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.458+0000 7f7bbebfc700 1 --2- 172.21.15.26:0/2577359646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bb80f6ff0 0x7f7bb80f7a20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f7ba8004660 tx=0x7f7ba8009b30).stop 2021-11-03T17:15:37.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.458+0000 7f7bbebfc700 1 -- 172.21.15.26:0/2577359646 shutdown_connections 2021-11-03T17:15:37.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.458+0000 7f7bbebfc700 1 --2- 172.21.15.26:0/2577359646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bb80f6ff0 0x7f7bb80f7a20 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:37.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.458+0000 7f7bbebfc700 1 --2- 172.21.15.26:0/2577359646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7bb80f66e0 0x7f7bb80f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:37.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.458+0000 7f7bbebfc700 1 -- 172.21.15.26:0/2577359646 >> 172.21.15.26:0/2577359646 conn(0x7f7bb80f1f00 msgr2=0x7f7bb80f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:15:37.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.458+0000 7f7bbebfc700 1 -- 172.21.15.26:0/2577359646 shutdown_connections 2021-11-03T17:15:37.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.458+0000 7f7bbebfc700 1 -- 172.21.15.26:0/2577359646 wait complete. 2021-11-03T17:15:37.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.459+0000 7f7bbebfc700 1 Processor -- start 2021-11-03T17:15:37.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.459+0000 7f7bbebfc700 1 -- start start 2021-11-03T17:15:37.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.459+0000 7f7bbebfc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7bb80f66e0 0x7f7bb8106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:15:37.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.459+0000 7f7bbebfc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bb80f6ff0 0x7f7bb81073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:15:37.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.459+0000 7f7bbebfc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb8107990 con 0x7f7bb80f6ff0 2021-11-03T17:15:37.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.459+0000 7f7bbebfc700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb8107ad0 con 0x7f7bb80f66e0 2021-11-03T17:15:37.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.459+0000 7f7bb7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bb80f6ff0 0x7f7bb81073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:15:37.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.459+0000 7f7bb7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bb80f6ff0 0x7f7bb81073e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53408/0 (socket says 172.21.15.26:53408) 2021-11-03T17:15:37.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.459+0000 7f7bb7fff700 1 -- 172.21.15.26:0/3615211856 learned_addr learned my addr 172.21.15.26:0/3615211856 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:15:37.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.459+0000 7f7bbc998700 1 --2- 172.21.15.26:0/3615211856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7bb80f66e0 0x7f7bb8106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:15:37.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.460+0000 7f7bb7fff700 1 -- 172.21.15.26:0/3615211856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7bb80f66e0 msgr2=0x7f7bb8106ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:15:37.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.460+0000 7f7bb7fff700 1 --2- 172.21.15.26:0/3615211856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7bb80f66e0 0x7f7bb8106ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:37.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.460+0000 7f7bb7fff700 1 -- 172.21.15.26:0/3615211856 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba8005040 con 0x7f7bb80f6ff0 2021-11-03T17:15:37.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.460+0000 7f7bb7fff700 1 --2- 172.21.15.26:0/3615211856 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bb80f6ff0 0x7f7bb81073e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f7ba8000c00 tx=0x7f7ba800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:15:37.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.460+0000 7f7bb57fa700 1 -- 172.21.15.26:0/3615211856 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ba8019070 con 0x7f7bb80f6ff0 2021-11-03T17:15:37.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.460+0000 7f7bbebfc700 1 -- 172.21.15.26:0/3615211856 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bb8108410 con 0x7f7bb80f6ff0 2021-11-03T17:15:37.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.460+0000 7f7bb57fa700 1 -- 172.21.15.26:0/3615211856 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7ba8007e70 con 0x7f7bb80f6ff0 2021-11-03T17:15:37.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.460+0000 7f7bb57fa700 1 -- 172.21.15.26:0/3615211856 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ba8014ce0 con 0x7f7bb80f6ff0 2021-11-03T17:15:37.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.460+0000 7f7bbebfc700 1 -- 172.21.15.26:0/3615211856 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bb8108970 con 0x7f7bb80f6ff0 2021-11-03T17:15:37.464 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.461+0000 7f7bbebfc700 1 -- 172.21.15.26:0/3615211856 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bb8045ad0 con 0x7f7bb80f6ff0 2021-11-03T17:15:37.464 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.461+0000 7f7bb57fa700 1 -- 172.21.15.26:0/3615211856 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f7ba8025070 con 0x7f7bb80f6ff0 2021-11-03T17:15:37.464 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.462+0000 7f7bb57fa700 1 --2- 172.21.15.26:0/3615211856 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7ba40640b0 0x7f7ba4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:15:37.464 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.462+0000 7f7bb57fa700 1 -- 172.21.15.26:0/3615211856 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f7ba8081770 con 0x7f7bb80f6ff0 2021-11-03T17:15:37.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.462+0000 7f7bbc998700 1 --2- 172.21.15.26:0/3615211856 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7ba40640b0 0x7f7ba4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:15:37.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.462+0000 7f7bbc998700 1 --2- 172.21.15.26:0/3615211856 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7ba40640b0 0x7f7ba4066570 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f7ba0009fd0 tx=0x7f7ba000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:15:37.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.466+0000 7f7bb57fa700 1 -- 172.21.15.26:0/3615211856 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f7ba8053ad0 con 0x7f7bb80f6ff0 2021-11-03T17:15:37.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.692+0000 7f7bbebfc700 1 -- 172.21.15.26:0/3615211856 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7bb8027a00 con 0x7f7bb80f6ff0 2021-11-03T17:15:37.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.692+0000 7f7bb57fa700 1 -- 172.21.15.26:0/3615211856 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f7ba8023070 con 0x7f7bb80f6ff0 2021-11-03T17:15:37.689 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:15:37.689 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:15:37.689 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:15:37.689 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:15:37.690 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:15:37.690 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:15:37.690 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:15:37.690 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:15:37.691 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:15:37.691 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:15:37.691 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:15:37.691 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:15:37.691 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:15:37.692 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:15:37.692 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:15:37.692 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:15:37.693 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:15:37.693 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:15:37.694 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.694+0000 7f7bbebfc700 1 -- 172.21.15.26:0/3615211856 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7ba40640b0 msgr2=0x7f7ba4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:15:37.694 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.694+0000 7f7bbebfc700 1 --2- 172.21.15.26:0/3615211856 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7ba40640b0 0x7f7ba4066570 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f7ba0009fd0 tx=0x7f7ba000b040).stop 2021-11-03T17:15:37.694 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.694+0000 7f7bbebfc700 1 -- 172.21.15.26:0/3615211856 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bb80f6ff0 msgr2=0x7f7bb81073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:15:37.694 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.694+0000 7f7bbebfc700 1 --2- 172.21.15.26:0/3615211856 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bb80f6ff0 0x7f7bb81073e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f7ba8000c00 tx=0x7f7ba800b040).stop 2021-11-03T17:15:37.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.694+0000 7f7bbebfc700 1 -- 172.21.15.26:0/3615211856 shutdown_connections 2021-11-03T17:15:37.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.694+0000 7f7bbebfc700 1 --2- 172.21.15.26:0/3615211856 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7ba40640b0 0x7f7ba4066570 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:37.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.694+0000 7f7bbebfc700 1 --2- 172.21.15.26:0/3615211856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7bb80f66e0 0x7f7bb8106ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:37.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.694+0000 7f7bbebfc700 1 --2- 172.21.15.26:0/3615211856 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bb80f6ff0 0x7f7bb81073e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:37.696 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.694+0000 7f7bbebfc700 1 -- 172.21.15.26:0/3615211856 >> 172.21.15.26:0/3615211856 conn(0x7f7bb80f1f00 msgr2=0x7f7bb80fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:15:37.696 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.694+0000 7f7bbebfc700 1 -- 172.21.15.26:0/3615211856 shutdown_connections 2021-11-03T17:15:37.696 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.694+0000 7f7bbebfc700 1 -- 172.21.15.26:0/3615211856 wait complete. 2021-11-03T17:15:37.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.794+0000 7fd655821700 1 -- 172.21.15.26:0/3630818180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6500f66c0 msgr2=0x7fd6500f6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:15:37.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.794+0000 7fd655821700 1 --2- 172.21.15.26:0/3630818180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6500f66c0 0x7fd6500f6ae0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7fd640004660 tx=0x7fd640009b30).stop 2021-11-03T17:15:37.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.794+0000 7fd655821700 1 -- 172.21.15.26:0/3630818180 shutdown_connections 2021-11-03T17:15:37.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.794+0000 7fd655821700 1 --2- 172.21.15.26:0/3630818180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6500f7960 0x7fd6500f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:37.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.794+0000 7fd655821700 1 --2- 172.21.15.26:0/3630818180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6500f66c0 0x7fd6500f6ae0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:37.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.794+0000 7fd655821700 1 -- 172.21.15.26:0/3630818180 >> 172.21.15.26:0/3630818180 conn(0x7fd6500f1e20 msgr2=0x7fd6500f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:15:37.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.794+0000 7fd655821700 1 -- 172.21.15.26:0/3630818180 shutdown_connections 2021-11-03T17:15:37.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.794+0000 7fd655821700 1 -- 172.21.15.26:0/3630818180 wait complete. 2021-11-03T17:15:37.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.795+0000 7fd655821700 1 Processor -- start 2021-11-03T17:15:37.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.795+0000 7fd655821700 1 -- start start 2021-11-03T17:15:37.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.795+0000 7fd655821700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6500f66c0 0x7fd65006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:15:37.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.795+0000 7fd655821700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6500f7960 0x7fd650069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:15:37.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.795+0000 7fd655821700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65006a380 con 0x7fd6500f7960 2021-11-03T17:15:37.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.795+0000 7fd655821700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65006a4c0 con 0x7fd6500f66c0 2021-11-03T17:15:37.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.795+0000 7fd64e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6500f7960 0x7fd650069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:15:37.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.795+0000 7fd64e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6500f7960 0x7fd650069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53418/0 (socket says 172.21.15.26:53418) 2021-11-03T17:15:37.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.795+0000 7fd64e7fc700 1 -- 172.21.15.26:0/1472404064 learned_addr learned my addr 172.21.15.26:0/1472404064 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:15:37.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.795+0000 7fd64effd700 1 --2- 172.21.15.26:0/1472404064 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6500f66c0 0x7fd65006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:15:37.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.795+0000 7fd64e7fc700 1 -- 172.21.15.26:0/1472404064 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6500f66c0 msgr2=0x7fd65006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:15:37.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.795+0000 7fd64e7fc700 1 --2- 172.21.15.26:0/1472404064 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6500f66c0 0x7fd65006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:37.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.795+0000 7fd64e7fc700 1 -- 172.21.15.26:0/1472404064 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd640005040 con 0x7fd6500f7960 2021-11-03T17:15:37.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.796+0000 7fd64e7fc700 1 --2- 172.21.15.26:0/1472404064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6500f7960 0x7fd650069e20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7fd6440026d0 tx=0x7fd644009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:15:37.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.796+0000 7fd6377fe700 1 -- 172.21.15.26:0/1472404064 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6440079c0 con 0x7fd6500f7960 2021-11-03T17:15:37.805 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.796+0000 7fd6377fe700 1 -- 172.21.15.26:0/1472404064 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd64400f040 con 0x7fd6500f7960 2021-11-03T17:15:37.805 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.796+0000 7fd655821700 1 -- 172.21.15.26:0/1472404064 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd65006a7a0 con 0x7fd6500f7960 2021-11-03T17:15:37.806 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.796+0000 7fd6377fe700 1 -- 172.21.15.26:0/1472404064 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6440148b0 con 0x7fd6500f7960 2021-11-03T17:15:37.806 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.796+0000 7fd655821700 1 -- 172.21.15.26:0/1472404064 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd65010efc0 con 0x7fd6500f7960 2021-11-03T17:15:37.807 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.797+0000 7fd655821700 1 -- 172.21.15.26:0/1472404064 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd650045ad0 con 0x7fd6500f7960 2021-11-03T17:15:37.807 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.797+0000 7fd6377fe700 1 -- 172.21.15.26:0/1472404064 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fd644007b20 con 0x7fd6500f7960 2021-11-03T17:15:37.807 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.798+0000 7fd6377fe700 1 --2- 172.21.15.26:0/1472404064 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd6380640b0 0x7fd638066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:15:37.808 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.798+0000 7fd6377fe700 1 -- 172.21.15.26:0/1472404064 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fd644080730 con 0x7fd6500f7960 2021-11-03T17:15:37.808 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.798+0000 7fd64effd700 1 --2- 172.21.15.26:0/1472404064 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd6380640b0 0x7fd638066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:15:37.808 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.798+0000 7fd64effd700 1 --2- 172.21.15.26:0/1472404064 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd6380640b0 0x7fd638066570 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fd640013690 tx=0x7fd640009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:15:37.809 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:37.802+0000 7fd6377fe700 1 -- 172.21.15.26:0/1472404064 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fd644052a90 con 0x7fd6500f7960 2021-11-03T17:15:38.003 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:38.007+0000 7fd655821700 1 -- 172.21.15.26:0/1472404064 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd650027a00 con 0x7fd6500f7960 2021-11-03T17:15:38.003 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:38.008+0000 7fd6377fe700 1 -- 172.21.15.26:0/1472404064 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fd644052680 con 0x7fd6500f7960 2021-11-03T17:15:38.004 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:15:38.004 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:15:38.004 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:15:38.005 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:15:38.005 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:15:38.005 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:15:38.005 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:15:38.006 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:15:38.006 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:15:38.006 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:15:38.006 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:15:38.007 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:15:38.007 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:15:38.007 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:15:38.007 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:15:38.008 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:15:38.008 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:15:38.008 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:15:38.008 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:15:38.008 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:15:38.009 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:15:38.009 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:15:38.009 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:15:38.009 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:15:38.010 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:15:38.010 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:15:38.010 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:15:38.010 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:15:38.011 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:15:38.011 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:15:38.011 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:15:38.011 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:15:38.012 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:15:38.012 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:15:38.012 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:15:38.012 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:15:38.013 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:15:38.013 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:15:38.013 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:15:38.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:38.010+0000 7fd655821700 1 -- 172.21.15.26:0/1472404064 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd6380640b0 msgr2=0x7fd638066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:15:38.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:38.010+0000 7fd655821700 1 --2- 172.21.15.26:0/1472404064 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd6380640b0 0x7fd638066570 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fd640013690 tx=0x7fd640009b30).stop 2021-11-03T17:15:38.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:38.010+0000 7fd655821700 1 -- 172.21.15.26:0/1472404064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6500f7960 msgr2=0x7fd650069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:15:38.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:38.010+0000 7fd655821700 1 --2- 172.21.15.26:0/1472404064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6500f7960 0x7fd650069e20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7fd6440026d0 tx=0x7fd644009de0).stop 2021-11-03T17:15:38.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:38.010+0000 7fd655821700 1 -- 172.21.15.26:0/1472404064 shutdown_connections 2021-11-03T17:15:38.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:38.010+0000 7fd655821700 1 --2- 172.21.15.26:0/1472404064 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd6380640b0 0x7fd638066570 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:38.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:38.010+0000 7fd655821700 1 --2- 172.21.15.26:0/1472404064 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6500f66c0 0x7fd65006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:38.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:38.010+0000 7fd655821700 1 --2- 172.21.15.26:0/1472404064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6500f7960 0x7fd650069e20 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:15:38.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:38.010+0000 7fd655821700 1 -- 172.21.15.26:0/1472404064 >> 172.21.15.26:0/1472404064 conn(0x7fd6500f1e20 msgr2=0x7fd6500fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:15:38.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:38.010+0000 7fd655821700 1 -- 172.21.15.26:0/1472404064 shutdown_connections 2021-11-03T17:15:38.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:15:38.010+0000 7fd655821700 1 -- 172.21.15.26:0/1472404064 wait complete. 2021-11-03T17:15:38.017 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:15:38.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:38 smithi026 ceph-mon[96795]: pgmap v629: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:38.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:38 smithi026 ceph-mon[96795]: from='client.34796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:15:38.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:38 smithi026 ceph-mon[96795]: from='client.34800 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:15:38.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:38 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3615211856' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:15:38.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:38 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1472404064' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:15:38.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:38 smithi194 ceph-mon[65619]: pgmap v629: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:38.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:38 smithi194 ceph-mon[65619]: from='client.34796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:15:38.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:38 smithi194 ceph-mon[65619]: from='client.34800 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:15:38.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:38 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3615211856' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:15:38.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:38 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1472404064' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:15:40.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:40 smithi026 ceph-mon[96795]: pgmap v630: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:40.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:15:40.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:15:40.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:15:40.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:15:40.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:15:40.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:15:40.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:15:40.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:15:40.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:40 smithi194 ceph-mon[65619]: pgmap v630: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:40.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:15:40.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:15:40.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:15:40.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:15:40.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:15:40.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:15:40.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:15:40.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:15:41.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:41 smithi026 ceph-mon[96795]: poll took 60067.696 ms: 1 events 2021-11-03T17:15:41.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:41 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:15:41.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:41 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:15:41.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:41 smithi194 ceph-mon[65619]: poll took 60067.696 ms: 1 events 2021-11-03T17:15:41.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:41 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:15:41.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:41 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:15:42.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:42 smithi026 ceph-mon[96795]: pgmap v631: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:42.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:42 smithi194 ceph-mon[65619]: pgmap v631: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:44.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:44 smithi026 ceph-mon[96795]: pgmap v632: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:44.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:44 smithi194 ceph-mon[65619]: pgmap v632: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:46.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:46 smithi026 ceph-mon[96795]: pgmap v633: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:46.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:46 smithi194 ceph-mon[65619]: pgmap v633: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:48.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:48 smithi026 ceph-mon[96795]: pgmap v634: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:48.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:48 smithi194 ceph-mon[65619]: pgmap v634: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:49.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:15:49.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:15:49.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:15:49.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:15:50.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:50 smithi026 ceph-mon[96795]: pgmap v635: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:50.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:50 smithi194 ceph-mon[65619]: pgmap v635: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:52.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:52 smithi026 ceph-mon[96795]: pgmap v636: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:52.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:52 smithi194 ceph-mon[65619]: pgmap v636: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:54.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:54 smithi026 ceph-mon[96795]: pgmap v637: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:54.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:54 smithi194 ceph-mon[65619]: pgmap v637: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:55.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:15:55.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:15:56.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:56 smithi026 ceph-mon[96795]: pgmap v638: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:56.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:56 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:15:56.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:56 smithi194 ceph-mon[65619]: pgmap v638: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:56.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:56 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:15:58.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:15:58 smithi026 ceph-mon[96795]: pgmap v639: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:15:58.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:15:58 smithi194 ceph-mon[65619]: pgmap v639: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:00.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:00 smithi026 ceph-mon[96795]: pgmap v640: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:00.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:00 smithi194 ceph-mon[65619]: pgmap v640: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:02.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:02 smithi026 ceph-mon[96795]: pgmap v641: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:02.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:02 smithi194 ceph-mon[65619]: pgmap v641: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:04.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:04 smithi026 ceph-mon[96795]: pgmap v642: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:04.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:04 smithi194 ceph-mon[65619]: pgmap v642: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:06.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:06 smithi026 ceph-mon[96795]: pgmap v643: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:06.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:06 smithi194 ceph-mon[65619]: pgmap v643: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:08.119 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.125+0000 7f0c2167b700 1 -- 172.21.15.26:0/1785459045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c1c0f6ff0 msgr2=0x7f0c1c0f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:16:08.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.125+0000 7f0c2167b700 1 --2- 172.21.15.26:0/1785459045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c1c0f6ff0 0x7f0c1c0f7a20 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f0c04004660 tx=0x7f0c04009b30).stop 2021-11-03T17:16:08.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.125+0000 7f0c2167b700 1 -- 172.21.15.26:0/1785459045 shutdown_connections 2021-11-03T17:16:08.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.125+0000 7f0c2167b700 1 --2- 172.21.15.26:0/1785459045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c1c0f6ff0 0x7f0c1c0f7a20 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:08.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.125+0000 7f0c2167b700 1 --2- 172.21.15.26:0/1785459045 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c1c0f66e0 0x7f0c1c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:08.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.125+0000 7f0c2167b700 1 -- 172.21.15.26:0/1785459045 >> 172.21.15.26:0/1785459045 conn(0x7f0c1c0f1f00 msgr2=0x7f0c1c0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:16:08.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.125+0000 7f0c2167b700 1 -- 172.21.15.26:0/1785459045 shutdown_connections 2021-11-03T17:16:08.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.125+0000 7f0c2167b700 1 -- 172.21.15.26:0/1785459045 wait complete. 2021-11-03T17:16:08.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.126+0000 7f0c2167b700 1 Processor -- start 2021-11-03T17:16:08.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.126+0000 7f0c2167b700 1 -- start start 2021-11-03T17:16:08.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.126+0000 7f0c2167b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c1c0f66e0 0x7f0c1c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:16:08.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.126+0000 7f0c2167b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c1c0f6ff0 0x7f0c1c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:16:08.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.126+0000 7f0c2167b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1c06a380 con 0x7f0c1c0f6ff0 2021-11-03T17:16:08.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.126+0000 7f0c2167b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1c06a4c0 con 0x7f0c1c0f66e0 2021-11-03T17:16:08.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.126+0000 7f0c1a7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c1c0f6ff0 0x7f0c1c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:16:08.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.126+0000 7f0c1a7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c1c0f6ff0 0x7f0c1c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53436/0 (socket says 172.21.15.26:53436) 2021-11-03T17:16:08.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.126+0000 7f0c1a7fc700 1 -- 172.21.15.26:0/2593421537 learned_addr learned my addr 172.21.15.26:0/2593421537 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:16:08.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.126+0000 7f0c1affd700 1 --2- 172.21.15.26:0/2593421537 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c1c0f66e0 0x7f0c1c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:16:08.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.127+0000 7f0c1a7fc700 1 -- 172.21.15.26:0/2593421537 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c1c0f66e0 msgr2=0x7f0c1c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:16:08.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.127+0000 7f0c1a7fc700 1 --2- 172.21.15.26:0/2593421537 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c1c0f66e0 0x7f0c1c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:08.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.127+0000 7f0c1a7fc700 1 -- 172.21.15.26:0/2593421537 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c04005040 con 0x7f0c1c0f6ff0 2021-11-03T17:16:08.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.127+0000 7f0c1a7fc700 1 --2- 172.21.15.26:0/2593421537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c1c0f6ff0 0x7f0c1c069e20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f0c04009990 tx=0x7f0c04009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:16:08.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.127+0000 7f0c137fe700 1 -- 172.21.15.26:0/2593421537 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c04018070 con 0x7f0c1c0f6ff0 2021-11-03T17:16:08.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.127+0000 7f0c137fe700 1 -- 172.21.15.26:0/2593421537 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0c04007ba0 con 0x7f0c1c0f6ff0 2021-11-03T17:16:08.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.127+0000 7f0c137fe700 1 -- 172.21.15.26:0/2593421537 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c0401c620 con 0x7f0c1c0f6ff0 2021-11-03T17:16:08.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.128+0000 7f0c2167b700 1 -- 172.21.15.26:0/2593421537 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c1c06a740 con 0x7f0c1c0f6ff0 2021-11-03T17:16:08.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.128+0000 7f0c2167b700 1 -- 172.21.15.26:0/2593421537 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c1c06ac20 con 0x7f0c1c0f6ff0 2021-11-03T17:16:08.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.129+0000 7f0c2167b700 1 -- 172.21.15.26:0/2593421537 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c1c045ad0 con 0x7f0c1c0f6ff0 2021-11-03T17:16:08.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.131+0000 7f0c137fe700 1 -- 172.21.15.26:0/2593421537 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f0c0401c850 con 0x7f0c1c0f6ff0 2021-11-03T17:16:08.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.131+0000 7f0c137fe700 1 --2- 172.21.15.26:0/2593421537 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0c080640b0 0x7f0c08066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:16:08.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.132+0000 7f0c137fe700 1 -- 172.21.15.26:0/2593421537 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f0c04082730 con 0x7f0c1c0f6ff0 2021-11-03T17:16:08.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.132+0000 7f0c1affd700 1 --2- 172.21.15.26:0/2593421537 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0c080640b0 0x7f0c08066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:16:08.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.132+0000 7f0c1affd700 1 --2- 172.21.15.26:0/2593421537 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0c080640b0 0x7f0c08066570 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f0c14004fd0 tx=0x7f0c14009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:16:08.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.135+0000 7f0c137fe700 1 -- 172.21.15.26:0/2593421537 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f0c04054a10 con 0x7f0c1c0f6ff0 2021-11-03T17:16:08.307 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.313+0000 7f0c2167b700 1 -- 172.21.15.26:0/2593421537 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c1c0ff050 con 0x7f0c080640b0 2021-11-03T17:16:08.308 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.314+0000 7f0c137fe700 1 -- 172.21.15.26:0/2593421537 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f0c1c0ff050 con 0x7f0c080640b0 2021-11-03T17:16:08.310 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.316+0000 7f0c2167b700 1 -- 172.21.15.26:0/2593421537 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0c080640b0 msgr2=0x7f0c08066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:16:08.311 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.316+0000 7f0c2167b700 1 --2- 172.21.15.26:0/2593421537 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0c080640b0 0x7f0c08066570 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f0c14004fd0 tx=0x7f0c14009040).stop 2021-11-03T17:16:08.311 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.316+0000 7f0c2167b700 1 -- 172.21.15.26:0/2593421537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c1c0f6ff0 msgr2=0x7f0c1c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:16:08.311 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.316+0000 7f0c2167b700 1 --2- 172.21.15.26:0/2593421537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c1c0f6ff0 0x7f0c1c069e20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f0c04009990 tx=0x7f0c04009b30).stop 2021-11-03T17:16:08.311 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.316+0000 7f0c2167b700 1 -- 172.21.15.26:0/2593421537 shutdown_connections 2021-11-03T17:16:08.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.316+0000 7f0c2167b700 1 --2- 172.21.15.26:0/2593421537 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0c080640b0 0x7f0c08066570 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:08.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.316+0000 7f0c2167b700 1 --2- 172.21.15.26:0/2593421537 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c1c0f66e0 0x7f0c1c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:08.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.316+0000 7f0c2167b700 1 --2- 172.21.15.26:0/2593421537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c1c0f6ff0 0x7f0c1c069e20 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:08.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.316+0000 7f0c2167b700 1 -- 172.21.15.26:0/2593421537 >> 172.21.15.26:0/2593421537 conn(0x7f0c1c0f1f00 msgr2=0x7f0c1c0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:16:08.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.316+0000 7f0c2167b700 1 -- 172.21.15.26:0/2593421537 shutdown_connections 2021-11-03T17:16:08.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.316+0000 7f0c2167b700 1 -- 172.21.15.26:0/2593421537 wait complete. 2021-11-03T17:16:08.320 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:16:08.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.416+0000 7f8d58767700 1 -- 172.21.15.26:0/3708026853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d500f55c0 msgr2=0x7f8d500f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:16:08.413 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.416+0000 7f8d58767700 1 --2- 172.21.15.26:0/3708026853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d500f55c0 0x7f8d500f59e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f8d40004660 tx=0x7f8d40009b30).stop 2021-11-03T17:16:08.413 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.416+0000 7f8d58767700 1 -- 172.21.15.26:0/3708026853 shutdown_connections 2021-11-03T17:16:08.413 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.416+0000 7f8d58767700 1 --2- 172.21.15.26:0/3708026853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d500f5ed0 0x7f8d500f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:08.414 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.416+0000 7f8d58767700 1 --2- 172.21.15.26:0/3708026853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d500f55c0 0x7f8d500f59e0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:08.414 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.416+0000 7f8d58767700 1 -- 172.21.15.26:0/3708026853 >> 172.21.15.26:0/3708026853 conn(0x7f8d500f0dc0 msgr2=0x7f8d500f31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:16:08.414 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.416+0000 7f8d58767700 1 -- 172.21.15.26:0/3708026853 shutdown_connections 2021-11-03T17:16:08.414 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.416+0000 7f8d58767700 1 -- 172.21.15.26:0/3708026853 wait complete. 2021-11-03T17:16:08.414 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.417+0000 7f8d58767700 1 Processor -- start 2021-11-03T17:16:08.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.417+0000 7f8d58767700 1 -- start start 2021-11-03T17:16:08.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.417+0000 7f8d58767700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d500f55c0 0x7f8d50109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:16:08.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.417+0000 7f8d58767700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d500f5ed0 0x7f8d5010c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:16:08.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.417+0000 7f8d58767700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d50060560 con 0x7f8d500f55c0 2021-11-03T17:16:08.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.417+0000 7f8d58767700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d500606a0 con 0x7f8d500f5ed0 2021-11-03T17:16:08.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.417+0000 7f8d56503700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d500f55c0 0x7f8d50109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:16:08.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.417+0000 7f8d56503700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d500f55c0 0x7f8d50109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53444/0 (socket says 172.21.15.26:53444) 2021-11-03T17:16:08.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.417+0000 7f8d56503700 1 -- 172.21.15.26:0/2032547800 learned_addr learned my addr 172.21.15.26:0/2032547800 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:16:08.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.417+0000 7f8d55d02700 1 --2- 172.21.15.26:0/2032547800 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d500f5ed0 0x7f8d5010c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:16:08.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.417+0000 7f8d56503700 1 -- 172.21.15.26:0/2032547800 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d500f5ed0 msgr2=0x7f8d5010c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:16:08.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.417+0000 7f8d56503700 1 --2- 172.21.15.26:0/2032547800 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d500f5ed0 0x7f8d5010c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:08.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.417+0000 7f8d56503700 1 -- 172.21.15.26:0/2032547800 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d40005040 con 0x7f8d500f55c0 2021-11-03T17:16:08.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.417+0000 7f8d55d02700 1 --2- 172.21.15.26:0/2032547800 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d500f5ed0 0x7f8d5010c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:16:08.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.417+0000 7f8d56503700 1 --2- 172.21.15.26:0/2032547800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d500f55c0 0x7f8d50109c70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f8d40009830 tx=0x7f8d40009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:16:08.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.418+0000 7f8d46ffd700 1 -- 172.21.15.26:0/2032547800 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d40018070 con 0x7f8d500f55c0 2021-11-03T17:16:08.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.418+0000 7f8d46ffd700 1 -- 172.21.15.26:0/2032547800 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8d40007ba0 con 0x7f8d500f55c0 2021-11-03T17:16:08.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.418+0000 7f8d58767700 1 -- 172.21.15.26:0/2032547800 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d5010c6c0 con 0x7f8d500f55c0 2021-11-03T17:16:08.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.418+0000 7f8d46ffd700 1 -- 172.21.15.26:0/2032547800 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d4001c620 con 0x7f8d500f55c0 2021-11-03T17:16:08.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.418+0000 7f8d58767700 1 -- 172.21.15.26:0/2032547800 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d5010cc20 con 0x7f8d500f55c0 2021-11-03T17:16:08.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.419+0000 7f8d58767700 1 -- 172.21.15.26:0/2032547800 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d50045ad0 con 0x7f8d500f55c0 2021-11-03T17:16:08.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.419+0000 7f8d46ffd700 1 -- 172.21.15.26:0/2032547800 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f8d4001c850 con 0x7f8d500f55c0 2021-11-03T17:16:08.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.419+0000 7f8d46ffd700 1 --2- 172.21.15.26:0/2032547800 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8d3c064090 0x7f8d3c066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:16:08.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.419+0000 7f8d46ffd700 1 -- 172.21.15.26:0/2032547800 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f8d40082440 con 0x7f8d500f55c0 2021-11-03T17:16:08.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.419+0000 7f8d55d02700 1 --2- 172.21.15.26:0/2032547800 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8d3c064090 0x7f8d3c066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:16:08.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.420+0000 7f8d55d02700 1 --2- 172.21.15.26:0/2032547800 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8d3c064090 0x7f8d3c066550 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f8d4c009740 tx=0x7f8d4c009be0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:16:08.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.423+0000 7f8d46ffd700 1 -- 172.21.15.26:0/2032547800 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f8d40054860 con 0x7f8d500f55c0 2021-11-03T17:16:08.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:08 smithi026 ceph-mon[96795]: pgmap v644: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:08.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:08 smithi194 ceph-mon[65619]: pgmap v644: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:08.589 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.595+0000 7f8d58767700 1 -- 172.21.15.26:0/2032547800 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d500fdf20 con 0x7f8d3c064090 2021-11-03T17:16:08.604 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.609+0000 7f8d46ffd700 1 -- 172.21.15.26:0/2032547800 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f8d500fdf20 con 0x7f8d3c064090 2021-11-03T17:16:08.604 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:16:08.605 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (27m) 7m ago 28m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:16:08.605 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (19m) 7m ago 28m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:16:08.606 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (19m) 6m ago 27m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:16:08.606 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (27m) 7m ago 28m 39.5M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:16:08.606 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (20m) 7m ago 23m 16.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:16:08.606 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (20m) 7m ago 23m 17.8M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:16:08.607 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (23m) 6m ago 23m 19.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:16:08.607 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (23m) 6m ago 23m 19.4M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:16:08.607 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (21m) 7m ago 29m 491M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:16:08.607 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (20m) 6m ago 27m 415M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:16:08.608 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (20m) 7m ago 30m 113M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:16:08.608 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (20m) 6m ago 27m 70.2M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:16:08.608 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (28m) 7m ago 28m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:16:08.608 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (27m) 6m ago 27m 18.4M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:16:08.609 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (19m) 7m ago 27m 190M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:16:08.609 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (18m) 7m ago 26m 204M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:16:08.609 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (18m) 7m ago 26m 170M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:16:08.609 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (17m) 6m ago 25m 211M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:16:08.609 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (17m) 6m ago 25m 189M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:16:08.610 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (16m) 6m ago 25m 174M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:16:08.610 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (27m) 7m ago 28m 49.9M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:16:08.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.611+0000 7f8d58767700 1 -- 172.21.15.26:0/2032547800 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8d3c064090 msgr2=0x7f8d3c066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:16:08.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.611+0000 7f8d58767700 1 --2- 172.21.15.26:0/2032547800 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8d3c064090 0x7f8d3c066550 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f8d4c009740 tx=0x7f8d4c009be0).stop 2021-11-03T17:16:08.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.611+0000 7f8d58767700 1 -- 172.21.15.26:0/2032547800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d500f55c0 msgr2=0x7f8d50109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:16:08.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.611+0000 7f8d58767700 1 --2- 172.21.15.26:0/2032547800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d500f55c0 0x7f8d50109c70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f8d40009830 tx=0x7f8d40009b30).stop 2021-11-03T17:16:08.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.611+0000 7f8d58767700 1 -- 172.21.15.26:0/2032547800 shutdown_connections 2021-11-03T17:16:08.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.611+0000 7f8d58767700 1 --2- 172.21.15.26:0/2032547800 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8d3c064090 0x7f8d3c066550 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:08.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.611+0000 7f8d58767700 1 --2- 172.21.15.26:0/2032547800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d500f55c0 0x7f8d50109c70 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:08.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.611+0000 7f8d58767700 1 --2- 172.21.15.26:0/2032547800 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d500f5ed0 0x7f8d5010c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:08.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.611+0000 7f8d58767700 1 -- 172.21.15.26:0/2032547800 >> 172.21.15.26:0/2032547800 conn(0x7f8d500f0dc0 msgr2=0x7f8d500fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:16:08.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.611+0000 7f8d58767700 1 -- 172.21.15.26:0/2032547800 shutdown_connections 2021-11-03T17:16:08.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.611+0000 7f8d58767700 1 -- 172.21.15.26:0/2032547800 wait complete. 2021-11-03T17:16:08.707 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.711+0000 7f7a86296700 1 -- 172.21.15.26:0/1162423007 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a800f74a0 msgr2=0x7f7a800f5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:16:08.707 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.711+0000 7f7a86296700 1 --2- 172.21.15.26:0/1162423007 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a800f74a0 0x7f7a800f5930 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f7a70004660 tx=0x7f7a70009b30).stop 2021-11-03T17:16:08.708 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.711+0000 7f7a86296700 1 -- 172.21.15.26:0/1162423007 shutdown_connections 2021-11-03T17:16:08.708 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.711+0000 7f7a86296700 1 --2- 172.21.15.26:0/1162423007 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a800f74a0 0x7f7a800f5930 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:08.708 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.711+0000 7f7a86296700 1 --2- 172.21.15.26:0/1162423007 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a800f6b90 0x7f7a800f6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:08.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.711+0000 7f7a86296700 1 -- 172.21.15.26:0/1162423007 >> 172.21.15.26:0/1162423007 conn(0x7f7a800f0540 msgr2=0x7f7a800f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:16:08.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.711+0000 7f7a86296700 1 -- 172.21.15.26:0/1162423007 shutdown_connections 2021-11-03T17:16:08.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.711+0000 7f7a86296700 1 -- 172.21.15.26:0/1162423007 wait complete. 2021-11-03T17:16:08.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.711+0000 7f7a86296700 1 Processor -- start 2021-11-03T17:16:08.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.711+0000 7f7a86296700 1 -- start start 2021-11-03T17:16:08.710 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.712+0000 7f7a86296700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a800f6b90 0x7f7a801090f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:16:08.710 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.712+0000 7f7a86296700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a800f74a0 0x7f7a801095e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:16:08.710 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.712+0000 7f7a86296700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a80109b90 con 0x7f7a800f74a0 2021-11-03T17:16:08.710 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.712+0000 7f7a86296700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a80109cd0 con 0x7f7a800f6b90 2021-11-03T17:16:08.711 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.712+0000 7f7a7f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a800f74a0 0x7f7a801095e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:16:08.711 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.712+0000 7f7a7f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a800f74a0 0x7f7a801095e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53456/0 (socket says 172.21.15.26:53456) 2021-11-03T17:16:08.711 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.712+0000 7f7a7f7fe700 1 -- 172.21.15.26:0/3000194717 learned_addr learned my addr 172.21.15.26:0/3000194717 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:16:08.711 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.712+0000 7f7a7ffff700 1 --2- 172.21.15.26:0/3000194717 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a800f6b90 0x7f7a801090f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:16:08.712 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.712+0000 7f7a7f7fe700 1 -- 172.21.15.26:0/3000194717 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a800f6b90 msgr2=0x7f7a801090f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:16:08.712 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.712+0000 7f7a7f7fe700 1 --2- 172.21.15.26:0/3000194717 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a800f6b90 0x7f7a801090f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:08.712 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.712+0000 7f7a7f7fe700 1 -- 172.21.15.26:0/3000194717 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a70005040 con 0x7f7a800f74a0 2021-11-03T17:16:08.712 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.712+0000 7f7a7f7fe700 1 --2- 172.21.15.26:0/3000194717 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a800f74a0 0x7f7a801095e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f7a70000c00 tx=0x7f7a7000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:16:08.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.712+0000 7f7a7cff9700 1 -- 172.21.15.26:0/3000194717 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a70019070 con 0x7f7a800f74a0 2021-11-03T17:16:08.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.712+0000 7f7a7cff9700 1 -- 172.21.15.26:0/3000194717 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7a70007e70 con 0x7f7a800f74a0 2021-11-03T17:16:08.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.712+0000 7f7a86296700 1 -- 172.21.15.26:0/3000194717 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a8010a610 con 0x7f7a800f74a0 2021-11-03T17:16:08.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.712+0000 7f7a7cff9700 1 -- 172.21.15.26:0/3000194717 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a70014d90 con 0x7f7a800f74a0 2021-11-03T17:16:08.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.712+0000 7f7a86296700 1 -- 172.21.15.26:0/3000194717 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a8010ab70 con 0x7f7a800f74a0 2021-11-03T17:16:08.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.713+0000 7f7a86296700 1 -- 172.21.15.26:0/3000194717 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a80045ad0 con 0x7f7a800f74a0 2021-11-03T17:16:08.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.714+0000 7f7a7cff9700 1 -- 172.21.15.26:0/3000194717 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f7a70025070 con 0x7f7a800f74a0 2021-11-03T17:16:08.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.714+0000 7f7a7cff9700 1 --2- 172.21.15.26:0/3000194717 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7a6c0640b0 0x7f7a6c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:16:08.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.714+0000 7f7a7cff9700 1 -- 172.21.15.26:0/3000194717 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f7a700817a0 con 0x7f7a800f74a0 2021-11-03T17:16:08.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.714+0000 7f7a7ffff700 1 --2- 172.21.15.26:0/3000194717 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7a6c0640b0 0x7f7a6c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:16:08.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.715+0000 7f7a7ffff700 1 --2- 172.21.15.26:0/3000194717 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7a6c0640b0 0x7f7a6c066570 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f7a8005f250 tx=0x7f7a6800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:16:08.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.718+0000 7f7a7cff9700 1 -- 172.21.15.26:0/3000194717 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f7a70053b00 con 0x7f7a800f74a0 2021-11-03T17:16:08.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.950+0000 7f7a86296700 1 -- 172.21.15.26:0/3000194717 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7a800fdda0 con 0x7f7a800f74a0 2021-11-03T17:16:08.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.950+0000 7f7a7cff9700 1 -- 172.21.15.26:0/3000194717 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f7a70023070 con 0x7f7a800f74a0 2021-11-03T17:16:08.945 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:16:08.946 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:16:08.946 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:16:08.946 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:16:08.946 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:16:08.946 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:16:08.947 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:16:08.947 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:16:08.947 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:16:08.947 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:16:08.948 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:16:08.948 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:16:08.948 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:16:08.948 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:16:08.949 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:16:08.949 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:16:08.949 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:16:08.950 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:16:08.951 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.952+0000 7f7a86296700 1 -- 172.21.15.26:0/3000194717 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7a6c0640b0 msgr2=0x7f7a6c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:16:08.951 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.952+0000 7f7a86296700 1 --2- 172.21.15.26:0/3000194717 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7a6c0640b0 0x7f7a6c066570 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f7a8005f250 tx=0x7f7a6800b040).stop 2021-11-03T17:16:08.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.952+0000 7f7a86296700 1 -- 172.21.15.26:0/3000194717 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a800f74a0 msgr2=0x7f7a801095e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:16:08.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.952+0000 7f7a86296700 1 --2- 172.21.15.26:0/3000194717 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a800f74a0 0x7f7a801095e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f7a70000c00 tx=0x7f7a7000b040).stop 2021-11-03T17:16:08.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.952+0000 7f7a86296700 1 -- 172.21.15.26:0/3000194717 shutdown_connections 2021-11-03T17:16:08.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.952+0000 7f7a86296700 1 --2- 172.21.15.26:0/3000194717 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7a6c0640b0 0x7f7a6c066570 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:08.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.952+0000 7f7a86296700 1 --2- 172.21.15.26:0/3000194717 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a800f6b90 0x7f7a801090f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:08.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.952+0000 7f7a86296700 1 --2- 172.21.15.26:0/3000194717 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a800f74a0 0x7f7a801095e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:08.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.952+0000 7f7a86296700 1 -- 172.21.15.26:0/3000194717 >> 172.21.15.26:0/3000194717 conn(0x7f7a800f0540 msgr2=0x7f7a800f5040 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:16:08.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.952+0000 7f7a86296700 1 -- 172.21.15.26:0/3000194717 shutdown_connections 2021-11-03T17:16:08.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:08.952+0000 7f7a86296700 1 -- 172.21.15.26:0/3000194717 wait complete. 2021-11-03T17:16:09.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.052+0000 7fc458c6a700 1 -- 172.21.15.26:0/141172411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4540f77d0 msgr2=0x7fc4540f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:16:09.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.052+0000 7fc458c6a700 1 --2- 172.21.15.26:0/141172411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4540f77d0 0x7fc4540f7c30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7fc448004660 tx=0x7fc448009b30).stop 2021-11-03T17:16:09.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.052+0000 7fc458c6a700 1 -- 172.21.15.26:0/141172411 shutdown_connections 2021-11-03T17:16:09.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.052+0000 7fc458c6a700 1 --2- 172.21.15.26:0/141172411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4540f77d0 0x7fc4540f7c30 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:09.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.052+0000 7fc458c6a700 1 --2- 172.21.15.26:0/141172411 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4540f6530 0x7fc4540f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:09.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.052+0000 7fc458c6a700 1 -- 172.21.15.26:0/141172411 >> 172.21.15.26:0/141172411 conn(0x7fc4540f1cd0 msgr2=0x7fc4540f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:16:09.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.052+0000 7fc458c6a700 1 -- 172.21.15.26:0/141172411 shutdown_connections 2021-11-03T17:16:09.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.053+0000 7fc458c6a700 1 -- 172.21.15.26:0/141172411 wait complete. 2021-11-03T17:16:09.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.053+0000 7fc458c6a700 1 Processor -- start 2021-11-03T17:16:09.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.053+0000 7fc458c6a700 1 -- start start 2021-11-03T17:16:09.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.053+0000 7fc458c6a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4540f6530 0x7fc454106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:16:09.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.053+0000 7fc458c6a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4540f77d0 0x7fc454107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:16:09.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.053+0000 7fc458c6a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc454107870 con 0x7fc4540f6530 2021-11-03T17:16:09.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.053+0000 7fc458c6a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc454108080 con 0x7fc4540f77d0 2021-11-03T17:16:09.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.053+0000 7fc4537fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4540f6530 0x7fc454106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:16:09.053 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.054+0000 7fc4537fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4540f6530 0x7fc454106d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53464/0 (socket says 172.21.15.26:53464) 2021-11-03T17:16:09.053 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.054+0000 7fc4537fe700 1 -- 172.21.15.26:0/688650860 learned_addr learned my addr 172.21.15.26:0/688650860 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:16:09.053 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.054+0000 7fc452ffd700 1 --2- 172.21.15.26:0/688650860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4540f77d0 0x7fc454107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:16:09.053 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.054+0000 7fc4537fe700 1 -- 172.21.15.26:0/688650860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4540f77d0 msgr2=0x7fc454107270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:16:09.053 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.054+0000 7fc4537fe700 1 --2- 172.21.15.26:0/688650860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4540f77d0 0x7fc454107270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:09.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.054+0000 7fc4537fe700 1 -- 172.21.15.26:0/688650860 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc448005040 con 0x7fc4540f6530 2021-11-03T17:16:09.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.054+0000 7fc452ffd700 1 --2- 172.21.15.26:0/688650860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4540f77d0 0x7fc454107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:16:09.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.054+0000 7fc4537fe700 1 --2- 172.21.15.26:0/688650860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4540f6530 0x7fc454106d80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7fc44400c530 tx=0x7fc444007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:16:09.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.054+0000 7fc43bfff700 1 -- 172.21.15.26:0/688650860 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc44400f650 con 0x7fc4540f6530 2021-11-03T17:16:09.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.054+0000 7fc43bfff700 1 -- 172.21.15.26:0/688650860 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc44400fc60 con 0x7fc4540f6530 2021-11-03T17:16:09.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.054+0000 7fc458c6a700 1 -- 172.21.15.26:0/688650860 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc454108300 con 0x7fc4540f6530 2021-11-03T17:16:09.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.054+0000 7fc43bfff700 1 -- 172.21.15.26:0/688650860 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc444012d20 con 0x7fc4540f6530 2021-11-03T17:16:09.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.054+0000 7fc458c6a700 1 -- 172.21.15.26:0/688650860 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4541088c0 con 0x7fc4540f6530 2021-11-03T17:16:09.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.055+0000 7fc458c6a700 1 -- 172.21.15.26:0/688650860 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc454059100 con 0x7fc4540f6530 2021-11-03T17:16:09.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.056+0000 7fc43bfff700 1 -- 172.21.15.26:0/688650860 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc444019030 con 0x7fc4540f6530 2021-11-03T17:16:09.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.056+0000 7fc43bfff700 1 --2- 172.21.15.26:0/688650860 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc43c064100 0x7fc43c0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:16:09.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.056+0000 7fc43bfff700 1 -- 172.21.15.26:0/688650860 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc444080620 con 0x7fc4540f6530 2021-11-03T17:16:09.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.056+0000 7fc452ffd700 1 --2- 172.21.15.26:0/688650860 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc43c064100 0x7fc43c0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:16:09.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.056+0000 7fc452ffd700 1 --2- 172.21.15.26:0/688650860 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc43c064100 0x7fc43c0665c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7fc448004630 tx=0x7fc448009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:16:09.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.060+0000 7fc43bfff700 1 -- 172.21.15.26:0/688650860 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc4440529a0 con 0x7fc4540f6530 2021-11-03T17:16:09.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.267+0000 7fc458c6a700 1 -- 172.21.15.26:0/688650860 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc4540fee80 con 0x7fc4540f6530 2021-11-03T17:16:09.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.268+0000 7fc43bfff700 1 -- 172.21.15.26:0/688650860 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fc444017710 con 0x7fc4540f6530 2021-11-03T17:16:09.263 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:16:09.263 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:16:09.263 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:16:09.264 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:16:09.264 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:16:09.265 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:16:09.265 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:16:09.265 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:16:09.266 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:16:09.266 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:16:09.266 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:16:09.266 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:16:09.267 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:16:09.267 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:16:09.267 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:16:09.267 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:16:09.268 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:16:09.268 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:16:09.268 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:16:09.268 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:16:09.268 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:16:09.269 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:16:09.269 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:16:09.269 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:16:09.269 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:16:09.269 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:16:09.270 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:16:09.270 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:16:09.270 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:16:09.270 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:16:09.271 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:16:09.271 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:16:09.271 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:16:09.271 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:16:09.272 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:16:09.272 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:16:09.272 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:16:09.272 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:16:09.272 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:16:09.274 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.269+0000 7fc458c6a700 1 -- 172.21.15.26:0/688650860 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc43c064100 msgr2=0x7fc43c0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:16:09.274 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.269+0000 7fc458c6a700 1 --2- 172.21.15.26:0/688650860 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc43c064100 0x7fc43c0665c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7fc448004630 tx=0x7fc448009b30).stop 2021-11-03T17:16:09.274 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.269+0000 7fc458c6a700 1 -- 172.21.15.26:0/688650860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4540f6530 msgr2=0x7fc454106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:16:09.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.269+0000 7fc458c6a700 1 --2- 172.21.15.26:0/688650860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4540f6530 0x7fc454106d80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7fc44400c530 tx=0x7fc444007e10).stop 2021-11-03T17:16:09.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.269+0000 7fc458c6a700 1 -- 172.21.15.26:0/688650860 shutdown_connections 2021-11-03T17:16:09.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.269+0000 7fc458c6a700 1 --2- 172.21.15.26:0/688650860 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc43c064100 0x7fc43c0665c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:09.276 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.269+0000 7fc458c6a700 1 --2- 172.21.15.26:0/688650860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4540f6530 0x7fc454106d80 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:09.276 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.269+0000 7fc458c6a700 1 --2- 172.21.15.26:0/688650860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4540f77d0 0x7fc454107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:09.276 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.269+0000 7fc458c6a700 1 -- 172.21.15.26:0/688650860 >> 172.21.15.26:0/688650860 conn(0x7fc4540f1cd0 msgr2=0x7fc4540fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:16:09.277 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.270+0000 7fc458c6a700 1 -- 172.21.15.26:0/688650860 shutdown_connections 2021-11-03T17:16:09.277 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:09.270+0000 7fc458c6a700 1 -- 172.21.15.26:0/688650860 wait complete. 2021-11-03T17:16:09.277 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:16:09.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:09 smithi026 ceph-mon[96795]: from='client.34812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:16:09.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:09 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3000194717' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:16:09.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:09 smithi194 ceph-mon[65619]: from='client.34812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:16:09.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:09 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3000194717' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:16:10.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:10 smithi026 ceph-mon[96795]: from='client.34816 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:16:10.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:10 smithi026 ceph-mon[96795]: pgmap v645: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:10.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:10 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/688650860' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:16:10.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:10 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:16:10.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:10 smithi194 ceph-mon[65619]: from='client.34816 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:16:10.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:10 smithi194 ceph-mon[65619]: pgmap v645: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:10.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:10 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/688650860' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:16:10.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:10 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:16:11.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:11 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:16:11.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:11 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:16:12.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:12 smithi026 ceph-mon[96795]: pgmap v646: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:12.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:12 smithi194 ceph-mon[65619]: pgmap v646: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:14.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:14 smithi026 ceph-mon[96795]: pgmap v647: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:14.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:14 smithi194 ceph-mon[65619]: pgmap v647: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:16.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:16 smithi026 ceph-mon[96795]: pgmap v648: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:16.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:16 smithi194 ceph-mon[65619]: pgmap v648: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:18.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:18 smithi026 ceph-mon[96795]: pgmap v649: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:18.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:18 smithi194 ceph-mon[65619]: pgmap v649: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:20.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:20 smithi026 ceph-mon[96795]: pgmap v650: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:20.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:20 smithi194 ceph-mon[65619]: pgmap v650: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:22.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:22 smithi026 ceph-mon[96795]: pgmap v651: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:22.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:22 smithi194 ceph-mon[65619]: pgmap v651: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:24.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:24 smithi026 ceph-mon[96795]: pgmap v652: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:24.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:24 smithi194 ceph-mon[65619]: pgmap v652: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:25.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:16:25.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:16:26.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:26 smithi026 ceph-mon[96795]: pgmap v653: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:26.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:26 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:16:26.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:26 smithi194 ceph-mon[65619]: pgmap v653: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:26.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:26 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:16:28.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:28 smithi026 ceph-mon[96795]: pgmap v654: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:28.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:28 smithi194 ceph-mon[65619]: pgmap v654: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:30.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:30 smithi026 ceph-mon[96795]: pgmap v655: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:30.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:30 smithi194 ceph-mon[65619]: pgmap v655: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:32.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:32 smithi026 ceph-mon[96795]: pgmap v656: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:32.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:32 smithi194 ceph-mon[65619]: pgmap v656: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:34.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:34 smithi026 ceph-mon[96795]: pgmap v657: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:34.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:34 smithi194 ceph-mon[65619]: pgmap v657: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:36.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:36 smithi026 ceph-mon[96795]: pgmap v658: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:36.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:36 smithi194 ceph-mon[65619]: pgmap v658: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:38.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:38 smithi194 ceph-mon[65619]: pgmap v659: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:38.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:38 smithi026 ceph-mon[96795]: pgmap v659: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:39.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.384+0000 7f65cb7d6700 1 -- 172.21.15.26:0/387242812 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65c40f7d00 msgr2=0x7f65c40f8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:16:39.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.384+0000 7f65cb7d6700 1 --2- 172.21.15.26:0/387242812 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65c40f7d00 0x7f65c40f8120 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f65bc0099e0 tx=0x7f65bc004d10).stop 2021-11-03T17:16:39.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.384+0000 7f65cb7d6700 1 -- 172.21.15.26:0/387242812 shutdown_connections 2021-11-03T17:16:39.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.384+0000 7f65cb7d6700 1 --2- 172.21.15.26:0/387242812 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65c40f8610 0x7f65c40f4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:39.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.384+0000 7f65cb7d6700 1 --2- 172.21.15.26:0/387242812 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65c40f7d00 0x7f65c40f8120 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:39.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.384+0000 7f65cb7d6700 1 -- 172.21.15.26:0/387242812 >> 172.21.15.26:0/387242812 conn(0x7f65c40f0540 msgr2=0x7f65c40f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:16:39.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.384+0000 7f65cb7d6700 1 -- 172.21.15.26:0/387242812 shutdown_connections 2021-11-03T17:16:39.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.384+0000 7f65cb7d6700 1 -- 172.21.15.26:0/387242812 wait complete. 2021-11-03T17:16:39.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.385+0000 7f65cb7d6700 1 Processor -- start 2021-11-03T17:16:39.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.385+0000 7f65cb7d6700 1 -- start start 2021-11-03T17:16:39.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.385+0000 7f65cb7d6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65c40f7d00 0x7f65c40f75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:16:39.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.385+0000 7f65cb7d6700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65c40f8610 0x7f65c40f5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:16:39.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.385+0000 7f65cb7d6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c40f5fb0 con 0x7f65c40f7d00 2021-11-03T17:16:39.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.385+0000 7f65cb7d6700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c40f60f0 con 0x7f65c40f8610 2021-11-03T17:16:39.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.385+0000 7f65c9572700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65c40f7d00 0x7f65c40f75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:16:39.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.385+0000 7f65c9572700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65c40f7d00 0x7f65c40f75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53482/0 (socket says 172.21.15.26:53482) 2021-11-03T17:16:39.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.385+0000 7f65c9572700 1 -- 172.21.15.26:0/2995505297 learned_addr learned my addr 172.21.15.26:0/2995505297 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:16:39.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.385+0000 7f65c8d71700 1 --2- 172.21.15.26:0/2995505297 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65c40f8610 0x7f65c40f5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:16:39.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.386+0000 7f65c9572700 1 -- 172.21.15.26:0/2995505297 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65c40f8610 msgr2=0x7f65c40f5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:16:39.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.386+0000 7f65c9572700 1 --2- 172.21.15.26:0/2995505297 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65c40f8610 0x7f65c40f5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:39.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.386+0000 7f65c9572700 1 -- 172.21.15.26:0/2995505297 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65bc009640 con 0x7f65c40f7d00 2021-11-03T17:16:39.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.386+0000 7f65c8d71700 1 --2- 172.21.15.26:0/2995505297 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65c40f8610 0x7f65c40f5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:16:39.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.386+0000 7f65c9572700 1 --2- 172.21.15.26:0/2995505297 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65c40f7d00 0x7f65c40f75d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f65bc00b3b0 tx=0x7f65bc004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:16:39.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.386+0000 7f65b9ffb700 1 -- 172.21.15.26:0/2995505297 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65bc00e030 con 0x7f65c40f7d00 2021-11-03T17:16:39.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.386+0000 7f65b9ffb700 1 -- 172.21.15.26:0/2995505297 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f65bc0049b0 con 0x7f65c40f7d00 2021-11-03T17:16:39.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.386+0000 7f65cb7d6700 1 -- 172.21.15.26:0/2995505297 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65c40f6370 con 0x7f65c40f7d00 2021-11-03T17:16:39.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.386+0000 7f65b9ffb700 1 -- 172.21.15.26:0/2995505297 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65bc018070 con 0x7f65c40f7d00 2021-11-03T17:16:39.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.386+0000 7f65cb7d6700 1 -- 172.21.15.26:0/2995505297 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65c40f6850 con 0x7f65c40f7d00 2021-11-03T17:16:39.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.387+0000 7f65cb7d6700 1 -- 172.21.15.26:0/2995505297 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65c4045ad0 con 0x7f65c40f7d00 2021-11-03T17:16:39.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.388+0000 7f65b9ffb700 1 -- 172.21.15.26:0/2995505297 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f65bc007d40 con 0x7f65c40f7d00 2021-11-03T17:16:39.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.388+0000 7f65b9ffb700 1 --2- 172.21.15.26:0/2995505297 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f65b00640b0 0x7f65b0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:16:39.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.388+0000 7f65b9ffb700 1 -- 172.21.15.26:0/2995505297 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f65bc082470 con 0x7f65c40f7d00 2021-11-03T17:16:39.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.388+0000 7f65c8d71700 1 --2- 172.21.15.26:0/2995505297 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f65b00640b0 0x7f65b0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:16:39.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.389+0000 7f65c8d71700 1 --2- 172.21.15.26:0/2995505297 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f65b00640b0 0x7f65b0066570 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f65b4009780 tx=0x7f65b4009c80).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:16:39.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.392+0000 7f65b9ffb700 1 -- 172.21.15.26:0/2995505297 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f65bc0547d0 con 0x7f65c40f7d00 2021-11-03T17:16:39.564 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.570+0000 7f65cb7d6700 1 -- 172.21.15.26:0/2995505297 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f65c40feff0 con 0x7f65b00640b0 2021-11-03T17:16:39.565 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.571+0000 7f65b9ffb700 1 -- 172.21.15.26:0/2995505297 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f65c40feff0 con 0x7f65b00640b0 2021-11-03T17:16:39.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.573+0000 7f65cb7d6700 1 -- 172.21.15.26:0/2995505297 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f65b00640b0 msgr2=0x7f65b0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:16:39.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.573+0000 7f65cb7d6700 1 --2- 172.21.15.26:0/2995505297 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f65b00640b0 0x7f65b0066570 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f65b4009780 tx=0x7f65b4009c80).stop 2021-11-03T17:16:39.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.573+0000 7f65cb7d6700 1 -- 172.21.15.26:0/2995505297 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65c40f7d00 msgr2=0x7f65c40f75d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:16:39.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.573+0000 7f65cb7d6700 1 --2- 172.21.15.26:0/2995505297 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65c40f7d00 0x7f65c40f75d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f65bc00b3b0 tx=0x7f65bc004d10).stop 2021-11-03T17:16:39.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.573+0000 7f65cb7d6700 1 -- 172.21.15.26:0/2995505297 shutdown_connections 2021-11-03T17:16:39.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.573+0000 7f65cb7d6700 1 --2- 172.21.15.26:0/2995505297 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f65b00640b0 0x7f65b0066570 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:39.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.573+0000 7f65cb7d6700 1 --2- 172.21.15.26:0/2995505297 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65c40f7d00 0x7f65c40f75d0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:39.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.573+0000 7f65cb7d6700 1 --2- 172.21.15.26:0/2995505297 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65c40f8610 0x7f65c40f5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:39.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.573+0000 7f65cb7d6700 1 -- 172.21.15.26:0/2995505297 >> 172.21.15.26:0/2995505297 conn(0x7f65c40f0540 msgr2=0x7f65c40fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:16:39.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.573+0000 7f65cb7d6700 1 -- 172.21.15.26:0/2995505297 shutdown_connections 2021-11-03T17:16:39.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.573+0000 7f65cb7d6700 1 -- 172.21.15.26:0/2995505297 wait complete. 2021-11-03T17:16:39.577 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:16:39.670 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.673+0000 7f5e2e9c6700 1 -- 172.21.15.26:0/1334734292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e280f6890 msgr2=0x7f5e280f6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:16:39.670 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.673+0000 7f5e2e9c6700 1 --2- 172.21.15.26:0/1334734292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e280f6890 0x7f5e280f6cb0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f5e18004660 tx=0x7f5e18009b30).stop 2021-11-03T17:16:39.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.674+0000 7f5e2e9c6700 1 -- 172.21.15.26:0/1334734292 shutdown_connections 2021-11-03T17:16:39.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.674+0000 7f5e2e9c6700 1 --2- 172.21.15.26:0/1334734292 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e280f7b30 0x7f5e280f7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:39.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.674+0000 7f5e2e9c6700 1 --2- 172.21.15.26:0/1334734292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e280f6890 0x7f5e280f6cb0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:39.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.674+0000 7f5e2e9c6700 1 -- 172.21.15.26:0/1334734292 >> 172.21.15.26:0/1334734292 conn(0x7f5e280f1ff0 msgr2=0x7f5e280f4410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:16:39.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.674+0000 7f5e2e9c6700 1 -- 172.21.15.26:0/1334734292 shutdown_connections 2021-11-03T17:16:39.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.674+0000 7f5e2e9c6700 1 -- 172.21.15.26:0/1334734292 wait complete. 2021-11-03T17:16:39.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.674+0000 7f5e2e9c6700 1 Processor -- start 2021-11-03T17:16:39.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.674+0000 7f5e2e9c6700 1 -- start start 2021-11-03T17:16:39.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.674+0000 7f5e2e9c6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e280f6890 0x7f5e2806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:16:39.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.674+0000 7f5e2e9c6700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e280f7b30 0x7f5e28069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:16:39.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.674+0000 7f5e2e9c6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2806a380 con 0x7f5e280f6890 2021-11-03T17:16:39.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.674+0000 7f5e2e9c6700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2806a4c0 con 0x7f5e280f7b30 2021-11-03T17:16:39.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.675+0000 7f5e27fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e280f6890 0x7f5e2806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:16:39.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.675+0000 7f5e27fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e280f6890 0x7f5e2806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53490/0 (socket says 172.21.15.26:53490) 2021-11-03T17:16:39.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.675+0000 7f5e27fff700 1 -- 172.21.15.26:0/2547219580 learned_addr learned my addr 172.21.15.26:0/2547219580 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:16:39.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.675+0000 7f5e27fff700 1 -- 172.21.15.26:0/2547219580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e280f7b30 msgr2=0x7f5e28069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:16:39.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.675+0000 7f5e27fff700 1 --2- 172.21.15.26:0/2547219580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e280f7b30 0x7f5e28069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:16:39.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.675+0000 7f5e27fff700 1 -- 172.21.15.26:0/2547219580 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e18005040 con 0x7f5e280f6890 2021-11-03T17:16:39.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.675+0000 7f5e27fff700 1 --2- 172.21.15.26:0/2547219580 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e280f6890 0x7f5e2806b9a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f5e18004f60 tx=0x7f5e18009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:16:39.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.675+0000 7f5e24ff9700 1 -- 172.21.15.26:0/2547219580 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e18018070 con 0x7f5e280f6890 2021-11-03T17:16:39.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.675+0000 7f5e2e9c6700 1 -- 172.21.15.26:0/2547219580 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e2806a740 con 0x7f5e280f6890 2021-11-03T17:16:39.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.675+0000 7f5e24ff9700 1 -- 172.21.15.26:0/2547219580 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5e18007ba0 con 0x7f5e280f6890 2021-11-03T17:16:39.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.675+0000 7f5e2e9c6700 1 -- 172.21.15.26:0/2547219580 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e2806aca0 con 0x7f5e280f6890 2021-11-03T17:16:39.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.675+0000 7f5e24ff9700 1 -- 172.21.15.26:0/2547219580 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e1801c620 con 0x7f5e280f6890 2021-11-03T17:16:39.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.676+0000 7f5e2e9c6700 1 -- 172.21.15.26:0/2547219580 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e28045ad0 con 0x7f5e280f6890 2021-11-03T17:16:39.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.676+0000 7f5e24ff9700 1 -- 172.21.15.26:0/2547219580 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f5e1801c8e0 con 0x7f5e280f6890 2021-11-03T17:16:39.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.677+0000 7f5e24ff9700 1 --2- 172.21.15.26:0/2547219580 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5e10064100 0x7f5e100665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:16:39.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.677+0000 7f5e24ff9700 1 -- 172.21.15.26:0/2547219580 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f5e180826f0 con 0x7f5e280f6890 2021-11-03T17:16:39.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.677+0000 7f5e277fe700 1 --2- 172.21.15.26:0/2547219580 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5e10064100 0x7f5e100665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:16:39.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.677+0000 7f5e277fe700 1 --2- 172.21.15.26:0/2547219580 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5e10064100 0x7f5e100665c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f5e1c004880 tx=0x7f5e1c007ae0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:16:39.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.681+0000 7f5e24ff9700 1 -- 172.21.15.26:0/2547219580 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f5e18054a50 con 0x7f5e280f6890 2021-11-03T17:16:39.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.854+0000 7f5e2e9c6700 1 -- 172.21.15.26:0/2547219580 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e280ff050 con 0x7f5e10064100 2021-11-03T17:16:39.863 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.868+0000 7f5e24ff9700 1 -- 172.21.15.26:0/2547219580 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f5e280ff050 con 0x7f5e10064100 2021-11-03T17:16:39.863 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:16:39.864 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (27m) 8m ago 29m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:16:39.864 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (20m) 8m ago 29m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:16:39.865 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (19m) 7m ago 28m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:16:39.865 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (27m) 8m ago 28m 39.5M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:16:39.865 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (20m) 8m ago 24m 16.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:16:39.865 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (21m) 8m ago 24m 17.8M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:16:39.865 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (24m) 7m ago 24m 19.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:16:39.866 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (24m) 7m ago 24m 19.4M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:16:39.866 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (21m) 8m ago 30m 491M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:16:39.866 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (21m) 7m ago 28m 415M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:16:39.866 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (21m) 8m ago 30m 113M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:16:39.867 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (20m) 7m ago 28m 70.2M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:16:39.867 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (28m) 8m ago 28m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:16:39.867 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (28m) 7m ago 28m 18.4M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:16:39.867 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (19m) 8m ago 27m 190M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:16:39.868 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (19m) 8m ago 27m 204M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:16:39.868 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (18m) 8m ago 26m 170M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:16:39.868 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (18m) 7m ago 26m 211M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:16:39.868 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (17m) 7m ago 26m 189M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:16:39.869 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (17m) 7m ago 25m 174M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:16:39.869 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (27m) 8m ago 28m 49.9M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:16:39.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.870+0000 7f5e2e9c6700 1 -- 172.21.15.26:0/2547219580 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5e10064100 msgr2=0x7f5e100665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:16:39.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.870+0000 7f5e2e9c6700 1 --2- 172.21.15.26:0/2547219580 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5e10064100 0x7f5e100665c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f5e1c004880 tx=0x7f5e1c007ae0).stop 2021-11-03T17:16:39.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.870+0000 7f5e2e9c6700 1 -- 172.21.15.26:0/2547219580 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e280f6890 msgr2=0x7f5e2806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:16:39.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.870+0000 7f5e2e9c6700 1 --2- 172.21.15.26:0/2547219580 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e280f6890 0x7f5e2806b9a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f5e18004f60 tx=0x7f5e18009b30).stop 2021-11-03T17:16:39.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.870+0000 7f5e2e9c6700 1 -- 172.21.15.26:0/2547219580 shutdown_connections 2021-11-03T17:16:39.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.870+0000 7f5e2e9c6700 1 --2- 172.21.15.26:0/2547219580 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5e10064100 0x7f5e100665c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:39.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.870+0000 7f5e2e9c6700 1 --2- 172.21.15.26:0/2547219580 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e280f6890 0x7f5e2806b9a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:39.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.870+0000 7f5e2e9c6700 1 --2- 172.21.15.26:0/2547219580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e280f7b30 0x7f5e28069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:16:39.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.870+0000 7f5e2e9c6700 1 -- 172.21.15.26:0/2547219580 >> 172.21.15.26:0/2547219580 conn(0x7f5e280f1ff0 msgr2=0x7f5e280fb580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:16:39.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.870+0000 7f5e2e9c6700 1 -- 172.21.15.26:0/2547219580 shutdown_connections 2021-11-03T17:16:39.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.870+0000 7f5e2e9c6700 1 -- 172.21.15.26:0/2547219580 wait complete. 2021-11-03T17:16:39.963 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.969+0000 7f18aba35700 1 -- 172.21.15.26:0/827280494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18a406a3b0 msgr2=0x7f18a406a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:16:39.964 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.969+0000 7f18aba35700 1 --2- 172.21.15.26:0/827280494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18a406a3b0 0x7f18a406a830 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f1894004660 tx=0x7f1894009b30).stop 2021-11-03T17:16:39.964 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.969+0000 7f18aba35700 1 -- 172.21.15.26:0/827280494 shutdown_connections 2021-11-03T17:16:39.964 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.969+0000 7f18aba35700 1 --2- 172.21.15.26:0/827280494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18a406a3b0 0x7f18a406a830 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:39.964 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.969+0000 7f18aba35700 1 --2- 172.21.15.26:0/827280494 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18a406b920 0x7f18a4069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:39.964 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.969+0000 7f18aba35700 1 -- 172.21.15.26:0/827280494 >> 172.21.15.26:0/827280494 conn(0x7f18a40f1f00 msgr2=0x7f18a40f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:16:39.965 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.969+0000 7f18aba35700 1 -- 172.21.15.26:0/827280494 shutdown_connections 2021-11-03T17:16:39.965 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.969+0000 7f18aba35700 1 -- 172.21.15.26:0/827280494 wait complete. 2021-11-03T17:16:39.965 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.969+0000 7f18aba35700 1 Processor -- start 2021-11-03T17:16:39.968 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.969+0000 7f18aba35700 1 -- start start 2021-11-03T17:16:39.968 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.970+0000 7f18aba35700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18a406a3b0 0x7f18a410d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:16:39.968 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.970+0000 7f18aba35700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18a406b920 0x7f18a410da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:16:39.969 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.970+0000 7f18aba35700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a410e030 con 0x7f18a406a3b0 2021-11-03T17:16:39.969 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.970+0000 7f18aba35700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a410e170 con 0x7f18a406b920 2021-11-03T17:16:39.969 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.970+0000 7f18a97d1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18a406a3b0 0x7f18a410d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:16:39.969 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.970+0000 7f18a97d1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18a406a3b0 0x7f18a410d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53498/0 (socket says 172.21.15.26:53498) 2021-11-03T17:16:39.970 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.970+0000 7f18a97d1700 1 -- 172.21.15.26:0/3084880971 learned_addr learned my addr 172.21.15.26:0/3084880971 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:16:39.970 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.970+0000 7f18a8fd0700 1 --2- 172.21.15.26:0/3084880971 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18a406b920 0x7f18a410da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:16:39.970 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.970+0000 7f18a97d1700 1 -- 172.21.15.26:0/3084880971 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18a406b920 msgr2=0x7f18a410da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:16:39.970 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.970+0000 7f18a97d1700 1 --2- 172.21.15.26:0/3084880971 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18a406b920 0x7f18a410da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:39.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.970+0000 7f18a97d1700 1 -- 172.21.15.26:0/3084880971 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1894005040 con 0x7f18a406a3b0 2021-11-03T17:16:39.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.970+0000 7f18a97d1700 1 --2- 172.21.15.26:0/3084880971 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18a406a3b0 0x7f18a410d590 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f18a000c530 tx=0x7f18a0007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:16:39.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.970+0000 7f1899ffb700 1 -- 172.21.15.26:0/3084880971 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18a000f650 con 0x7f18a406a3b0 2021-11-03T17:16:39.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.970+0000 7f1899ffb700 1 -- 172.21.15.26:0/3084880971 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f18a000fc60 con 0x7f18a406a3b0 2021-11-03T17:16:39.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.970+0000 7f18aba35700 1 -- 172.21.15.26:0/3084880971 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a410eb10 con 0x7f18a406a3b0 2021-11-03T17:16:39.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.970+0000 7f1899ffb700 1 -- 172.21.15.26:0/3084880971 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18a0012d20 con 0x7f18a406a3b0 2021-11-03T17:16:39.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.971+0000 7f18aba35700 1 -- 172.21.15.26:0/3084880971 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a410f0d0 con 0x7f18a406a3b0 2021-11-03T17:16:39.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.971+0000 7f18aba35700 1 -- 172.21.15.26:0/3084880971 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18a4045ad0 con 0x7f18a406a3b0 2021-11-03T17:16:39.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.972+0000 7f1899ffb700 1 -- 172.21.15.26:0/3084880971 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f18a0019030 con 0x7f18a406a3b0 2021-11-03T17:16:39.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.972+0000 7f1899ffb700 1 --2- 172.21.15.26:0/3084880971 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f18900640b0 0x7f1890066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:16:39.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.973+0000 7f1899ffb700 1 -- 172.21.15.26:0/3084880971 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f18a00806e0 con 0x7f18a406a3b0 2021-11-03T17:16:39.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.973+0000 7f18a8fd0700 1 --2- 172.21.15.26:0/3084880971 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f18900640b0 0x7f1890066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:16:39.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.973+0000 7f18a8fd0700 1 --2- 172.21.15.26:0/3084880971 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f18900640b0 0x7f1890066570 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f1894004e30 tx=0x7f1894009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:16:39.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:39.977+0000 7f1899ffb700 1 -- 172.21.15.26:0/3084880971 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f18a00528e0 con 0x7f18a406a3b0 2021-11-03T17:16:40.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.216+0000 7f18aba35700 1 -- 172.21.15.26:0/3084880971 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f18a410f350 con 0x7f18a406a3b0 2021-11-03T17:16:40.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.217+0000 7f1899ffb700 1 -- 172.21.15.26:0/3084880971 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f18a00524d0 con 0x7f18a406a3b0 2021-11-03T17:16:40.212 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:16:40.212 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:16:40.212 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:16:40.212 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:16:40.213 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:16:40.213 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:16:40.213 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:16:40.213 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:16:40.213 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:16:40.214 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:16:40.214 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:16:40.214 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:16:40.214 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:16:40.215 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:16:40.215 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:16:40.215 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:16:40.215 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:16:40.216 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:16:40.216 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.219+0000 7f18aba35700 1 -- 172.21.15.26:0/3084880971 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f18900640b0 msgr2=0x7f1890066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:16:40.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.219+0000 7f18aba35700 1 --2- 172.21.15.26:0/3084880971 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f18900640b0 0x7f1890066570 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f1894004e30 tx=0x7f1894009b30).stop 2021-11-03T17:16:40.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.219+0000 7f18aba35700 1 -- 172.21.15.26:0/3084880971 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18a406a3b0 msgr2=0x7f18a410d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:16:40.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.219+0000 7f18aba35700 1 --2- 172.21.15.26:0/3084880971 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18a406a3b0 0x7f18a410d590 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f18a000c530 tx=0x7f18a0007e10).stop 2021-11-03T17:16:40.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.219+0000 7f18aba35700 1 -- 172.21.15.26:0/3084880971 shutdown_connections 2021-11-03T17:16:40.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.219+0000 7f18aba35700 1 --2- 172.21.15.26:0/3084880971 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f18900640b0 0x7f1890066570 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:40.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.219+0000 7f18aba35700 1 --2- 172.21.15.26:0/3084880971 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18a406a3b0 0x7f18a410d590 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:40.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.219+0000 7f18aba35700 1 --2- 172.21.15.26:0/3084880971 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18a406b920 0x7f18a410da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:40.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.219+0000 7f18aba35700 1 -- 172.21.15.26:0/3084880971 >> 172.21.15.26:0/3084880971 conn(0x7f18a40f1f00 msgr2=0x7f18a40f8960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:16:40.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.219+0000 7f18aba35700 1 -- 172.21.15.26:0/3084880971 shutdown_connections 2021-11-03T17:16:40.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.219+0000 7f18aba35700 1 -- 172.21.15.26:0/3084880971 wait complete. 2021-11-03T17:16:40.323 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.328+0000 7f62a5e0f700 1 -- 172.21.15.26:0/3593814152 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62a00f7d00 msgr2=0x7f62a00f8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:16:40.323 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.328+0000 7f62a5e0f700 1 --2- 172.21.15.26:0/3593814152 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62a00f7d00 0x7f62a00f8120 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f6290004660 tx=0x7f6290009b30).stop 2021-11-03T17:16:40.323 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.329+0000 7f62a5e0f700 1 -- 172.21.15.26:0/3593814152 shutdown_connections 2021-11-03T17:16:40.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.329+0000 7f62a5e0f700 1 --2- 172.21.15.26:0/3593814152 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62a00f8610 0x7f62a00f4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:40.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.329+0000 7f62a5e0f700 1 --2- 172.21.15.26:0/3593814152 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62a00f7d00 0x7f62a00f8120 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:40.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.329+0000 7f62a5e0f700 1 -- 172.21.15.26:0/3593814152 >> 172.21.15.26:0/3593814152 conn(0x7f62a00f0540 msgr2=0x7f62a00f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:16:40.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.329+0000 7f62a5e0f700 1 -- 172.21.15.26:0/3593814152 shutdown_connections 2021-11-03T17:16:40.325 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.329+0000 7f62a5e0f700 1 -- 172.21.15.26:0/3593814152 wait complete. 2021-11-03T17:16:40.325 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:40 smithi194 ceph-mon[65619]: pgmap v660: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:40.326 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:16:40.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.329+0000 7f62a5e0f700 1 Processor -- start 2021-11-03T17:16:40.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.329+0000 7f62a5e0f700 1 -- start start 2021-11-03T17:16:40.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.330+0000 7f62a5e0f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62a00f7d00 0x7f62a00f75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:16:40.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.330+0000 7f62a5e0f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62a00f8610 0x7f62a00f5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:16:40.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.330+0000 7f62a5e0f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a00f5fb0 con 0x7f62a00f8610 2021-11-03T17:16:40.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.330+0000 7f62a5e0f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a00f60f0 con 0x7f62a00f7d00 2021-11-03T17:16:40.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.330+0000 7f629effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62a00f8610 0x7f62a00f5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:16:40.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.330+0000 7f629effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62a00f8610 0x7f62a00f5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53510/0 (socket says 172.21.15.26:53510) 2021-11-03T17:16:40.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.330+0000 7f629effd700 1 -- 172.21.15.26:0/3911340096 learned_addr learned my addr 172.21.15.26:0/3911340096 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:16:40.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.330+0000 7f629f7fe700 1 --2- 172.21.15.26:0/3911340096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62a00f7d00 0x7f62a00f75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:16:40.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.330+0000 7f629effd700 1 -- 172.21.15.26:0/3911340096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62a00f7d00 msgr2=0x7f62a00f75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:16:40.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.330+0000 7f629effd700 1 --2- 172.21.15.26:0/3911340096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62a00f7d00 0x7f62a00f75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:40.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.330+0000 7f629effd700 1 -- 172.21.15.26:0/3911340096 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6290005040 con 0x7f62a00f8610 2021-11-03T17:16:40.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.330+0000 7f629effd700 1 --2- 172.21.15.26:0/3911340096 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62a00f8610 0x7f62a00f5a50 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f629400e7f0 tx=0x7f629400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:16:40.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.330+0000 7f6287fff700 1 -- 172.21.15.26:0/3911340096 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62940092e0 con 0x7f62a00f8610 2021-11-03T17:16:40.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.331+0000 7f62a5e0f700 1 -- 172.21.15.26:0/3911340096 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62a00f63d0 con 0x7f62a00f8610 2021-11-03T17:16:40.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.331+0000 7f6287fff700 1 -- 172.21.15.26:0/3911340096 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f629400f040 con 0x7f62a00f8610 2021-11-03T17:16:40.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.331+0000 7f62a5e0f700 1 -- 172.21.15.26:0/3911340096 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62a010ef00 con 0x7f62a00f8610 2021-11-03T17:16:40.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.331+0000 7f6287fff700 1 -- 172.21.15.26:0/3911340096 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6294014750 con 0x7f62a00f8610 2021-11-03T17:16:40.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.332+0000 7f62a5e0f700 1 -- 172.21.15.26:0/3911340096 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62a0045ad0 con 0x7f62a00f8610 2021-11-03T17:16:40.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.332+0000 7f6287fff700 1 -- 172.21.15.26:0/3911340096 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f629401b030 con 0x7f62a00f8610 2021-11-03T17:16:40.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.333+0000 7f6287fff700 1 --2- 172.21.15.26:0/3911340096 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f62880640b0 0x7f6288066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:16:40.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.333+0000 7f6287fff700 1 -- 172.21.15.26:0/3911340096 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f62940806d0 con 0x7f62a00f8610 2021-11-03T17:16:40.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.333+0000 7f629f7fe700 1 --2- 172.21.15.26:0/3911340096 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f62880640b0 0x7f6288066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:16:40.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.333+0000 7f629f7fe700 1 --2- 172.21.15.26:0/3911340096 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f62880640b0 0x7f6288066570 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f6290004d80 tx=0x7f6290016040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:16:40.334 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.340+0000 7f6287fff700 1 -- 172.21.15.26:0/3911340096 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f6294048df0 con 0x7f62a00f8610 2021-11-03T17:16:40.339 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:40 smithi026 ceph-mon[96795]: pgmap v660: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:40.340 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:16:40.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.548+0000 7f62a5e0f700 1 -- 172.21.15.26:0/3911340096 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f62a0027a00 con 0x7f62a00f8610 2021-11-03T17:16:40.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.549+0000 7f6287fff700 1 -- 172.21.15.26:0/3911340096 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f6294019070 con 0x7f62a00f8610 2021-11-03T17:16:40.544 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:16:40.544 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:16:40.544 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:16:40.545 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:16:40.545 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:16:40.545 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:16:40.545 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:16:40.546 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:16:40.546 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:16:40.546 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:16:40.546 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:16:40.546 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:16:40.547 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:16:40.547 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:16:40.547 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:16:40.547 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:16:40.548 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:16:40.548 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:16:40.548 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:16:40.548 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:16:40.549 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:16:40.549 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:16:40.549 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:16:40.549 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:16:40.549 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:16:40.550 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:16:40.550 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:16:40.550 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:16:40.550 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:16:40.551 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:16:40.551 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:16:40.551 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:16:40.551 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:16:40.551 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:16:40.552 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:16:40.552 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:16:40.552 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:16:40.552 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:16:40.552 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:16:40.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.551+0000 7f62a5e0f700 1 -- 172.21.15.26:0/3911340096 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f62880640b0 msgr2=0x7f6288066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:16:40.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.551+0000 7f62a5e0f700 1 --2- 172.21.15.26:0/3911340096 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f62880640b0 0x7f6288066570 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f6290004d80 tx=0x7f6290016040).stop 2021-11-03T17:16:40.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.551+0000 7f62a5e0f700 1 -- 172.21.15.26:0/3911340096 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62a00f8610 msgr2=0x7f62a00f5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:16:40.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.551+0000 7f62a5e0f700 1 --2- 172.21.15.26:0/3911340096 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62a00f8610 0x7f62a00f5a50 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f629400e7f0 tx=0x7f629400b040).stop 2021-11-03T17:16:40.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.551+0000 7f62a5e0f700 1 -- 172.21.15.26:0/3911340096 shutdown_connections 2021-11-03T17:16:40.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.551+0000 7f62a5e0f700 1 --2- 172.21.15.26:0/3911340096 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f62880640b0 0x7f6288066570 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:40.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.551+0000 7f62a5e0f700 1 --2- 172.21.15.26:0/3911340096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62a00f7d00 0x7f62a00f75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:40.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.551+0000 7f62a5e0f700 1 --2- 172.21.15.26:0/3911340096 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62a00f8610 0x7f62a00f5a50 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:16:40.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.551+0000 7f62a5e0f700 1 -- 172.21.15.26:0/3911340096 >> 172.21.15.26:0/3911340096 conn(0x7f62a00f0540 msgr2=0x7f62a00fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:16:40.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.551+0000 7f62a5e0f700 1 -- 172.21.15.26:0/3911340096 shutdown_connections 2021-11-03T17:16:40.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:16:40.551+0000 7f62a5e0f700 1 -- 172.21.15.26:0/3911340096 wait complete. 2021-11-03T17:16:40.556 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:16:41.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:41 smithi194 ceph-mon[65619]: from='client.34828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:16:41.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:41 smithi194 ceph-mon[65619]: from='client.34832 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:16:41.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:41 smithi194 ceph-mon[65619]: poll took 60079.365 ms: 1 events 2021-11-03T17:16:41.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:41 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3084880971' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:16:41.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2021-11-03T17:16:41.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi026", "name": "osd_memory_target"}]: dispatch 2021-11-03T17:16:41.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:16:41.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:16:41.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:16:41.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:16:41.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:16:41.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:16:41.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:41 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:16:41.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:16:41.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:41 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:16:41.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:41 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3911340096' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:16:41.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:41 smithi026 ceph-mon[96795]: from='client.34828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:16:41.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:41 smithi026 ceph-mon[96795]: from='client.34832 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:16:41.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:41 smithi026 ceph-mon[96795]: poll took 60079.365 ms: 1 events 2021-11-03T17:16:41.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:41 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3084880971' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:16:41.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2021-11-03T17:16:41.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi026", "name": "osd_memory_target"}]: dispatch 2021-11-03T17:16:41.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:16:41.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:16:41.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:16:41.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:16:41.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:16:41.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:16:41.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:41 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:16:41.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:16:41.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:41 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:16:41.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:41 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3911340096' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:16:42.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:42 smithi026 ceph-mon[96795]: pgmap v661: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:42.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:42 smithi194 ceph-mon[65619]: pgmap v661: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:44.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:44 smithi026 ceph-mon[96795]: pgmap v662: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:44.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:44 smithi194 ceph-mon[65619]: pgmap v662: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:46.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:46 smithi026 ceph-mon[96795]: pgmap v663: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:46.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:46 smithi194 ceph-mon[65619]: pgmap v663: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:48 smithi026 ceph-mon[96795]: pgmap v664: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:16:48.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:16:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:48 smithi194 ceph-mon[65619]: pgmap v664: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:16:48.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:16:50.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:50 smithi026 ceph-mon[96795]: pgmap v665: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:50.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:50 smithi194 ceph-mon[65619]: pgmap v665: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:52.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:52 smithi026 ceph-mon[96795]: pgmap v666: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:52.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:52 smithi194 ceph-mon[65619]: pgmap v666: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:54.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:54 smithi026 ceph-mon[96795]: pgmap v667: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:54.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:54 smithi194 ceph-mon[65619]: pgmap v667: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:56.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:56 smithi026 ceph-mon[96795]: pgmap v668: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:56.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:56 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:16:56.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:56 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:16:56.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:56 smithi194 ceph-mon[65619]: pgmap v668: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:56.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:56 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:16:56.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:56 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:16:58.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:16:58 smithi026 ceph-mon[96795]: pgmap v669: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:16:58.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:16:58 smithi194 ceph-mon[65619]: pgmap v669: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:00.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:00 smithi026 ceph-mon[96795]: pgmap v670: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:00.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:00 smithi194 ceph-mon[65619]: pgmap v670: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:02.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:02 smithi026 ceph-mon[96795]: pgmap v671: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:02.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:02 smithi194 ceph-mon[65619]: pgmap v671: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:04.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:04 smithi026 ceph-mon[96795]: pgmap v672: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:04.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:04 smithi194 ceph-mon[65619]: pgmap v672: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:06.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:06 smithi026 ceph-mon[96795]: pgmap v673: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:06.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:06 smithi194 ceph-mon[65619]: pgmap v673: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:07.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:07 smithi194 ceph-mon[65619]: pgmap v674: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:07.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:07 smithi026 ceph-mon[96795]: pgmap v674: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:10.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:09 smithi194 ceph-mon[65619]: pgmap v675: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:10.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:09 smithi026 ceph-mon[96795]: pgmap v675: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:10.664 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.666+0000 7f09446de700 1 -- 172.21.15.26:0/1646442491 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f093c0f66e0 msgr2=0x7f093c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:17:10.664 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.666+0000 7f09446de700 1 --2- 172.21.15.26:0/1646442491 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f093c0f66e0 0x7f093c0f6b00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f0938004660 tx=0x7f0938009b30).stop 2021-11-03T17:17:10.665 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.666+0000 7f09446de700 1 -- 172.21.15.26:0/1646442491 shutdown_connections 2021-11-03T17:17:10.665 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.666+0000 7f09446de700 1 --2- 172.21.15.26:0/1646442491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f093c0f6ff0 0x7f093c0f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:10.665 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.666+0000 7f09446de700 1 --2- 172.21.15.26:0/1646442491 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f093c0f66e0 0x7f093c0f6b00 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:10.665 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.666+0000 7f09446de700 1 -- 172.21.15.26:0/1646442491 >> 172.21.15.26:0/1646442491 conn(0x7f093c0f1f00 msgr2=0x7f093c0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:17:10.666 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.667+0000 7f09446de700 1 -- 172.21.15.26:0/1646442491 shutdown_connections 2021-11-03T17:17:10.666 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.667+0000 7f09446de700 1 -- 172.21.15.26:0/1646442491 wait complete. 2021-11-03T17:17:10.666 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.667+0000 7f09446de700 1 Processor -- start 2021-11-03T17:17:10.666 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.667+0000 7f09446de700 1 -- start start 2021-11-03T17:17:10.667 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.667+0000 7f09446de700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f093c0f66e0 0x7f093c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:17:10.667 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.667+0000 7f09446de700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f093c0f6ff0 0x7f093c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:17:10.667 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.667+0000 7f09446de700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093c06a380 con 0x7f093c0f66e0 2021-11-03T17:17:10.667 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.667+0000 7f09446de700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093c06a4c0 con 0x7f093c0f6ff0 2021-11-03T17:17:10.667 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.667+0000 7f094247a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f093c0f66e0 0x7f093c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:17:10.668 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.667+0000 7f094247a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f093c0f66e0 0x7f093c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53526/0 (socket says 172.21.15.26:53526) 2021-11-03T17:17:10.668 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.667+0000 7f094247a700 1 -- 172.21.15.26:0/2178038684 learned_addr learned my addr 172.21.15.26:0/2178038684 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:17:10.668 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.668+0000 7f0941c79700 1 --2- 172.21.15.26:0/2178038684 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f093c0f6ff0 0x7f093c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:17:10.668 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.668+0000 7f094247a700 1 -- 172.21.15.26:0/2178038684 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f093c0f6ff0 msgr2=0x7f093c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:17:10.669 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.668+0000 7f094247a700 1 --2- 172.21.15.26:0/2178038684 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f093c0f6ff0 0x7f093c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:10.669 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.668+0000 7f094247a700 1 -- 172.21.15.26:0/2178038684 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0938005040 con 0x7f093c0f66e0 2021-11-03T17:17:10.669 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.668+0000 7f0941c79700 1 --2- 172.21.15.26:0/2178038684 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f093c0f6ff0 0x7f093c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:17:10.670 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.668+0000 7f094247a700 1 --2- 172.21.15.26:0/2178038684 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f093c0f66e0 0x7f093c06b9a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f0938009990 tx=0x7f0938009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:17:10.670 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.668+0000 7f0932ffd700 1 -- 172.21.15.26:0/2178038684 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0938018070 con 0x7f093c0f66e0 2021-11-03T17:17:10.670 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.668+0000 7f0932ffd700 1 -- 172.21.15.26:0/2178038684 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0938007ba0 con 0x7f093c0f66e0 2021-11-03T17:17:10.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.668+0000 7f09446de700 1 -- 172.21.15.26:0/2178038684 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f093c06a740 con 0x7f093c0f66e0 2021-11-03T17:17:10.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.668+0000 7f0932ffd700 1 -- 172.21.15.26:0/2178038684 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f093801c3c0 con 0x7f093c0f66e0 2021-11-03T17:17:10.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.668+0000 7f09446de700 1 -- 172.21.15.26:0/2178038684 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f093c06aca0 con 0x7f093c0f66e0 2021-11-03T17:17:10.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.669+0000 7f09446de700 1 -- 172.21.15.26:0/2178038684 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f093c045ad0 con 0x7f093c0f66e0 2021-11-03T17:17:10.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.670+0000 7f0932ffd700 1 -- 172.21.15.26:0/2178038684 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f093801d420 con 0x7f093c0f66e0 2021-11-03T17:17:10.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.670+0000 7f0932ffd700 1 --2- 172.21.15.26:0/2178038684 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f09280640b0 0x7f0928066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:17:10.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.670+0000 7f0932ffd700 1 -- 172.21.15.26:0/2178038684 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f09380825d0 con 0x7f093c0f66e0 2021-11-03T17:17:10.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.670+0000 7f0941c79700 1 --2- 172.21.15.26:0/2178038684 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f09280640b0 0x7f0928066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:17:10.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.670+0000 7f0941c79700 1 --2- 172.21.15.26:0/2178038684 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f09280640b0 0x7f0928066570 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f092c009780 tx=0x7f092c009c80).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:17:10.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.674+0000 7f0932ffd700 1 -- 172.21.15.26:0/2178038684 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f0938054990 con 0x7f093c0f66e0 2021-11-03T17:17:10.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.853+0000 7f09446de700 1 -- 172.21.15.26:0/2178038684 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f093c057f10 con 0x7f09280640b0 2021-11-03T17:17:10.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.854+0000 7f0932ffd700 1 -- 172.21.15.26:0/2178038684 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f093c057f10 con 0x7f09280640b0 2021-11-03T17:17:10.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.856+0000 7f09446de700 1 -- 172.21.15.26:0/2178038684 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f09280640b0 msgr2=0x7f0928066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:17:10.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.856+0000 7f09446de700 1 --2- 172.21.15.26:0/2178038684 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f09280640b0 0x7f0928066570 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f092c009780 tx=0x7f092c009c80).stop 2021-11-03T17:17:10.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.856+0000 7f09446de700 1 -- 172.21.15.26:0/2178038684 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f093c0f66e0 msgr2=0x7f093c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:17:10.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.856+0000 7f09446de700 1 --2- 172.21.15.26:0/2178038684 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f093c0f66e0 0x7f093c06b9a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f0938009990 tx=0x7f0938009b30).stop 2021-11-03T17:17:10.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.856+0000 7f09446de700 1 -- 172.21.15.26:0/2178038684 shutdown_connections 2021-11-03T17:17:10.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.856+0000 7f09446de700 1 --2- 172.21.15.26:0/2178038684 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f09280640b0 0x7f0928066570 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:10.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.856+0000 7f09446de700 1 --2- 172.21.15.26:0/2178038684 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f093c0f66e0 0x7f093c06b9a0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:10.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.856+0000 7f09446de700 1 --2- 172.21.15.26:0/2178038684 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f093c0f6ff0 0x7f093c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:10.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.856+0000 7f09446de700 1 -- 172.21.15.26:0/2178038684 >> 172.21.15.26:0/2178038684 conn(0x7f093c0f1f00 msgr2=0x7f093c0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:17:10.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.856+0000 7f09446de700 1 -- 172.21.15.26:0/2178038684 shutdown_connections 2021-11-03T17:17:10.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.856+0000 7f09446de700 1 -- 172.21.15.26:0/2178038684 wait complete. 2021-11-03T17:17:10.861 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:17:10.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.956+0000 7f86b7652700 1 -- 172.21.15.26:0/1745883868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86b00f66e0 msgr2=0x7f86b00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:17:10.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.956+0000 7f86b7652700 1 --2- 172.21.15.26:0/1745883868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86b00f66e0 0x7f86b00f6b00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f86ac004660 tx=0x7f86ac009b30).stop 2021-11-03T17:17:10.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.956+0000 7f86b7652700 1 -- 172.21.15.26:0/1745883868 shutdown_connections 2021-11-03T17:17:10.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.956+0000 7f86b7652700 1 --2- 172.21.15.26:0/1745883868 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86b00f6ff0 0x7f86b00f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:10.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.956+0000 7f86b7652700 1 --2- 172.21.15.26:0/1745883868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86b00f66e0 0x7f86b00f6b00 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:10.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.956+0000 7f86b7652700 1 -- 172.21.15.26:0/1745883868 >> 172.21.15.26:0/1745883868 conn(0x7f86b00f1f00 msgr2=0x7f86b00f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:17:10.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.956+0000 7f86b7652700 1 -- 172.21.15.26:0/1745883868 shutdown_connections 2021-11-03T17:17:10.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.956+0000 7f86b7652700 1 -- 172.21.15.26:0/1745883868 wait complete. 2021-11-03T17:17:10.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.957+0000 7f86b7652700 1 Processor -- start 2021-11-03T17:17:10.961 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.957+0000 7f86b7652700 1 -- start start 2021-11-03T17:17:10.961 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.957+0000 7f86b7652700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86b00f66e0 0x7f86b006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:17:10.962 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.957+0000 7f86b7652700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86b00f6ff0 0x7f86b0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:17:10.962 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.957+0000 7f86b7652700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b006a380 con 0x7f86b00f66e0 2021-11-03T17:17:10.962 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.957+0000 7f86b7652700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b006a4c0 con 0x7f86b00f6ff0 2021-11-03T17:17:10.963 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.957+0000 7f86b53ee700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86b00f66e0 0x7f86b006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:17:10.963 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.957+0000 7f86b53ee700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86b00f66e0 0x7f86b006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53536/0 (socket says 172.21.15.26:53536) 2021-11-03T17:17:10.964 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.957+0000 7f86b53ee700 1 -- 172.21.15.26:0/3854310020 learned_addr learned my addr 172.21.15.26:0/3854310020 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:17:10.964 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.957+0000 7f86b4bed700 1 --2- 172.21.15.26:0/3854310020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86b00f6ff0 0x7f86b0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:17:10.965 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.957+0000 7f86b53ee700 1 -- 172.21.15.26:0/3854310020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86b00f6ff0 msgr2=0x7f86b0069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:17:10.965 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.957+0000 7f86b53ee700 1 --2- 172.21.15.26:0/3854310020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86b00f6ff0 0x7f86b0069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:10.966 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.957+0000 7f86b53ee700 1 -- 172.21.15.26:0/3854310020 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ac005040 con 0x7f86b00f66e0 2021-11-03T17:17:10.966 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.957+0000 7f86b4bed700 1 --2- 172.21.15.26:0/3854310020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86b00f6ff0 0x7f86b0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:17:10.967 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.958+0000 7f86b53ee700 1 --2- 172.21.15.26:0/3854310020 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86b00f66e0 0x7f86b006b9a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f86ac009990 tx=0x7f86ac009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:17:10.967 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.958+0000 7f86a5ffb700 1 -- 172.21.15.26:0/3854310020 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86ac018070 con 0x7f86b00f66e0 2021-11-03T17:17:10.967 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.958+0000 7f86a5ffb700 1 -- 172.21.15.26:0/3854310020 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f86ac007ca0 con 0x7f86b00f66e0 2021-11-03T17:17:10.968 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.958+0000 7f86b7652700 1 -- 172.21.15.26:0/3854310020 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b006a740 con 0x7f86b00f66e0 2021-11-03T17:17:10.968 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.958+0000 7f86a5ffb700 1 -- 172.21.15.26:0/3854310020 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86ac01c620 con 0x7f86b00f66e0 2021-11-03T17:17:10.969 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.958+0000 7f86b7652700 1 -- 172.21.15.26:0/3854310020 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86b006aca0 con 0x7f86b00f66e0 2021-11-03T17:17:10.969 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.959+0000 7f86b7652700 1 -- 172.21.15.26:0/3854310020 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86b0045ad0 con 0x7f86b00f66e0 2021-11-03T17:17:10.970 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.959+0000 7f86a5ffb700 1 -- 172.21.15.26:0/3854310020 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f86ac01d960 con 0x7f86b00f66e0 2021-11-03T17:17:10.970 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.960+0000 7f86a5ffb700 1 --2- 172.21.15.26:0/3854310020 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f869c0640b0 0x7f869c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:17:10.970 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.960+0000 7f86a5ffb700 1 -- 172.21.15.26:0/3854310020 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f86ac082480 con 0x7f86b00f66e0 2021-11-03T17:17:10.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.960+0000 7f86b4bed700 1 --2- 172.21.15.26:0/3854310020 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f869c0640b0 0x7f869c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:17:10.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.960+0000 7f86b4bed700 1 --2- 172.21.15.26:0/3854310020 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f869c0640b0 0x7f869c066570 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f86a0004ac0 tx=0x7f86a0009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:17:10.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:10.964+0000 7f86a5ffb700 1 -- 172.21.15.26:0/3854310020 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f86ac0548a0 con 0x7f86b00f66e0 2021-11-03T17:17:11.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.139+0000 7f86b7652700 1 -- 172.21.15.26:0/3854310020 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f86b00fefe0 con 0x7f869c0640b0 2021-11-03T17:17:11.149 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.154+0000 7f86a5ffb700 1 -- 172.21.15.26:0/3854310020 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f86b00fefe0 con 0x7f869c0640b0 2021-11-03T17:17:11.150 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:17:11.150 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (28m) 8m ago 29m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:17:11.151 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (20m) 8m ago 29m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:17:11.151 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (20m) 7m ago 28m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:17:11.152 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (28m) 8m ago 29m 39.5M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:17:11.152 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (21m) 8m ago 24m 16.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:17:11.152 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (21m) 8m ago 24m 17.8M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:17:11.152 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (24m) 7m ago 24m 19.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:17:11.153 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (24m) 7m ago 24m 19.4M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:17:11.153 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (22m) 8m ago 31m 491M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:17:11.153 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (21m) 7m ago 28m 415M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:17:11.154 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (21m) 8m ago 31m 113M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:17:11.154 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (21m) 7m ago 28m 70.2M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:17:11.154 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (29m) 8m ago 29m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:17:11.154 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (28m) 7m ago 28m 18.4M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:17:11.155 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (20m) 8m ago 28m 190M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:17:11.155 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (19m) 8m ago 27m 204M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:17:11.155 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (19m) 8m ago 27m 170M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:17:11.155 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (18m) 7m ago 27m 211M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:17:11.156 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (18m) 7m ago 26m 189M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:17:11.156 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (17m) 7m ago 26m 174M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:17:11.156 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (28m) 8m ago 29m 49.9M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:17:11.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.156+0000 7f86b7652700 1 -- 172.21.15.26:0/3854310020 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f869c0640b0 msgr2=0x7f869c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:17:11.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.156+0000 7f86b7652700 1 --2- 172.21.15.26:0/3854310020 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f869c0640b0 0x7f869c066570 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f86a0004ac0 tx=0x7f86a0009040).stop 2021-11-03T17:17:11.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.156+0000 7f86b7652700 1 -- 172.21.15.26:0/3854310020 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86b00f66e0 msgr2=0x7f86b006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:17:11.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.156+0000 7f86b7652700 1 --2- 172.21.15.26:0/3854310020 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86b00f66e0 0x7f86b006b9a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f86ac009990 tx=0x7f86ac009b30).stop 2021-11-03T17:17:11.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.156+0000 7f86b7652700 1 -- 172.21.15.26:0/3854310020 shutdown_connections 2021-11-03T17:17:11.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.156+0000 7f86b7652700 1 --2- 172.21.15.26:0/3854310020 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f869c0640b0 0x7f869c066570 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:11.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.156+0000 7f86b7652700 1 --2- 172.21.15.26:0/3854310020 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86b00f66e0 0x7f86b006b9a0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:11.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.156+0000 7f86b7652700 1 --2- 172.21.15.26:0/3854310020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86b00f6ff0 0x7f86b0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:11.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.156+0000 7f86b7652700 1 -- 172.21.15.26:0/3854310020 >> 172.21.15.26:0/3854310020 conn(0x7f86b00f1f00 msgr2=0x7f86b00fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:17:11.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.156+0000 7f86b7652700 1 -- 172.21.15.26:0/3854310020 shutdown_connections 2021-11-03T17:17:11.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.156+0000 7f86b7652700 1 -- 172.21.15.26:0/3854310020 wait complete. 2021-11-03T17:17:11.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:10 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:17:11.249 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.254+0000 7fd06e8a4700 1 -- 172.21.15.26:0/353312196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0680f6ff0 msgr2=0x7fd0680f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:17:11.250 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.254+0000 7fd06e8a4700 1 --2- 172.21.15.26:0/353312196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0680f6ff0 0x7fd0680f7a20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7fd058004660 tx=0x7fd058009b30).stop 2021-11-03T17:17:11.250 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.254+0000 7fd06e8a4700 1 -- 172.21.15.26:0/353312196 shutdown_connections 2021-11-03T17:17:11.250 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.254+0000 7fd06e8a4700 1 --2- 172.21.15.26:0/353312196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0680f6ff0 0x7fd0680f7a20 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:11.251 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.254+0000 7fd06e8a4700 1 --2- 172.21.15.26:0/353312196 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0680f66e0 0x7fd0680f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:11.251 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.254+0000 7fd06e8a4700 1 -- 172.21.15.26:0/353312196 >> 172.21.15.26:0/353312196 conn(0x7fd0680f1f00 msgr2=0x7fd0680f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:17:11.251 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.254+0000 7fd06e8a4700 1 -- 172.21.15.26:0/353312196 shutdown_connections 2021-11-03T17:17:11.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.254+0000 7fd06e8a4700 1 -- 172.21.15.26:0/353312196 wait complete. 2021-11-03T17:17:11.254 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.255+0000 7fd06e8a4700 1 Processor -- start 2021-11-03T17:17:11.255 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.255+0000 7fd06e8a4700 1 -- start start 2021-11-03T17:17:11.255 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.255+0000 7fd06e8a4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0680f66e0 0x7fd06806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:17:11.255 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.255+0000 7fd06e8a4700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0680f6ff0 0x7fd068069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:17:11.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.255+0000 7fd06e8a4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06806a380 con 0x7fd0680f66e0 2021-11-03T17:17:11.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.255+0000 7fd06e8a4700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06806a4c0 con 0x7fd0680f6ff0 2021-11-03T17:17:11.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.255+0000 7fd067fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0680f66e0 0x7fd06806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:17:11.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.255+0000 7fd067fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0680f66e0 0x7fd06806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53546/0 (socket says 172.21.15.26:53546) 2021-11-03T17:17:11.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.255+0000 7fd067fff700 1 -- 172.21.15.26:0/4066403813 learned_addr learned my addr 172.21.15.26:0/4066403813 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:17:11.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.256+0000 7fd0677fe700 1 --2- 172.21.15.26:0/4066403813 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0680f6ff0 0x7fd068069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:17:11.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.256+0000 7fd067fff700 1 -- 172.21.15.26:0/4066403813 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0680f6ff0 msgr2=0x7fd068069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:17:11.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.256+0000 7fd067fff700 1 --2- 172.21.15.26:0/4066403813 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0680f6ff0 0x7fd068069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:11.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.256+0000 7fd067fff700 1 -- 172.21.15.26:0/4066403813 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd058005040 con 0x7fd0680f66e0 2021-11-03T17:17:11.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.256+0000 7fd0677fe700 1 --2- 172.21.15.26:0/4066403813 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0680f6ff0 0x7fd068069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:17:11.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.256+0000 7fd067fff700 1 --2- 172.21.15.26:0/4066403813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0680f66e0 0x7fd06806b9a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7fd05c0026d0 tx=0x7fd05c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:17:11.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.256+0000 7fd064ff9700 1 -- 172.21.15.26:0/4066403813 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd05c009320 con 0x7fd0680f66e0 2021-11-03T17:17:11.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.256+0000 7fd064ff9700 1 -- 172.21.15.26:0/4066403813 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd05c00f040 con 0x7fd0680f66e0 2021-11-03T17:17:11.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.256+0000 7fd06e8a4700 1 -- 172.21.15.26:0/4066403813 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd06806a7a0 con 0x7fd0680f66e0 2021-11-03T17:17:11.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.256+0000 7fd064ff9700 1 -- 172.21.15.26:0/4066403813 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd05c0147e0 con 0x7fd0680f66e0 2021-11-03T17:17:11.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.256+0000 7fd06e8a4700 1 -- 172.21.15.26:0/4066403813 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd06810efa0 con 0x7fd0680f66e0 2021-11-03T17:17:11.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.257+0000 7fd06e8a4700 1 -- 172.21.15.26:0/4066403813 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd068045ad0 con 0x7fd0680f66e0 2021-11-03T17:17:11.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.258+0000 7fd064ff9700 1 -- 172.21.15.26:0/4066403813 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fd05c009480 con 0x7fd0680f66e0 2021-11-03T17:17:11.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.258+0000 7fd064ff9700 1 --2- 172.21.15.26:0/4066403813 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd0500640b0 0x7fd050066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:17:11.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.258+0000 7fd064ff9700 1 -- 172.21.15.26:0/4066403813 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fd05c080eb0 con 0x7fd0680f66e0 2021-11-03T17:17:11.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.258+0000 7fd0677fe700 1 --2- 172.21.15.26:0/4066403813 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd0500640b0 0x7fd050066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:17:11.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.259+0000 7fd0677fe700 1 --2- 172.21.15.26:0/4066403813 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd0500640b0 0x7fd050066570 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7fd058004630 tx=0x7fd058009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:17:11.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.262+0000 7fd064ff9700 1 -- 172.21.15.26:0/4066403813 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fd05c053210 con 0x7fd0680f66e0 2021-11-03T17:17:11.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:10 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:17:11.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.495+0000 7fd06e8a4700 1 -- 172.21.15.26:0/4066403813 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd0680fefa0 con 0x7fd0680f66e0 2021-11-03T17:17:11.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.496+0000 7fd064ff9700 1 -- 172.21.15.26:0/4066403813 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fd05c052e00 con 0x7fd0680f66e0 2021-11-03T17:17:11.492 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:17:11.493 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:17:11.493 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:17:11.493 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:17:11.494 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:17:11.494 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:17:11.495 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:17:11.495 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:17:11.496 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:17:11.496 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:17:11.496 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:17:11.497 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:17:11.497 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:17:11.498 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:17:11.498 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:17:11.499 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:17:11.499 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:17:11.500 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:17:11.501 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.498+0000 7fd06e8a4700 1 -- 172.21.15.26:0/4066403813 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd0500640b0 msgr2=0x7fd050066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:17:11.502 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.498+0000 7fd06e8a4700 1 --2- 172.21.15.26:0/4066403813 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd0500640b0 0x7fd050066570 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7fd058004630 tx=0x7fd058009b30).stop 2021-11-03T17:17:11.502 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.498+0000 7fd06e8a4700 1 -- 172.21.15.26:0/4066403813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0680f66e0 msgr2=0x7fd06806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:17:11.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.498+0000 7fd06e8a4700 1 --2- 172.21.15.26:0/4066403813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0680f66e0 0x7fd06806b9a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7fd05c0026d0 tx=0x7fd05c009de0).stop 2021-11-03T17:17:11.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.498+0000 7fd06e8a4700 1 -- 172.21.15.26:0/4066403813 shutdown_connections 2021-11-03T17:17:11.504 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.498+0000 7fd06e8a4700 1 --2- 172.21.15.26:0/4066403813 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd0500640b0 0x7fd050066570 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:11.504 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.498+0000 7fd06e8a4700 1 --2- 172.21.15.26:0/4066403813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0680f66e0 0x7fd06806b9a0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:11.504 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.498+0000 7fd06e8a4700 1 --2- 172.21.15.26:0/4066403813 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0680f6ff0 0x7fd068069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:11.505 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.498+0000 7fd06e8a4700 1 -- 172.21.15.26:0/4066403813 >> 172.21.15.26:0/4066403813 conn(0x7fd0680f1f00 msgr2=0x7fd0680fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:17:11.505 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.498+0000 7fd06e8a4700 1 -- 172.21.15.26:0/4066403813 shutdown_connections 2021-11-03T17:17:11.505 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.498+0000 7fd06e8a4700 1 -- 172.21.15.26:0/4066403813 wait complete. 2021-11-03T17:17:11.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.598+0000 7fab61742700 1 -- 172.21.15.26:0/1813702808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab5c0f6ff0 msgr2=0x7fab5c0f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:17:11.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.598+0000 7fab61742700 1 --2- 172.21.15.26:0/1813702808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab5c0f6ff0 0x7fab5c0f7a20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7fab4c004660 tx=0x7fab4c009b30).stop 2021-11-03T17:17:11.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.598+0000 7fab61742700 1 -- 172.21.15.26:0/1813702808 shutdown_connections 2021-11-03T17:17:11.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.598+0000 7fab61742700 1 --2- 172.21.15.26:0/1813702808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab5c0f6ff0 0x7fab5c0f7a20 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:11.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.598+0000 7fab61742700 1 --2- 172.21.15.26:0/1813702808 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab5c0f66e0 0x7fab5c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:11.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.598+0000 7fab61742700 1 -- 172.21.15.26:0/1813702808 >> 172.21.15.26:0/1813702808 conn(0x7fab5c0f1f00 msgr2=0x7fab5c0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:17:11.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.598+0000 7fab61742700 1 -- 172.21.15.26:0/1813702808 shutdown_connections 2021-11-03T17:17:11.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.598+0000 7fab61742700 1 -- 172.21.15.26:0/1813702808 wait complete. 2021-11-03T17:17:11.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.599+0000 7fab61742700 1 Processor -- start 2021-11-03T17:17:11.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.599+0000 7fab61742700 1 -- start start 2021-11-03T17:17:11.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.599+0000 7fab61742700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab5c0f66e0 0x7fab5c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:17:11.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.599+0000 7fab61742700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab5c0f6ff0 0x7fab5c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:17:11.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.599+0000 7fab61742700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c06a380 con 0x7fab5c0f66e0 2021-11-03T17:17:11.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.599+0000 7fab61742700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c06a4c0 con 0x7fab5c0f6ff0 2021-11-03T17:17:11.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.599+0000 7fab5affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab5c0f66e0 0x7fab5c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:17:11.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.599+0000 7fab5affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab5c0f66e0 0x7fab5c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53556/0 (socket says 172.21.15.26:53556) 2021-11-03T17:17:11.600 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.599+0000 7fab5affd700 1 -- 172.21.15.26:0/152996521 learned_addr learned my addr 172.21.15.26:0/152996521 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:17:11.600 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.599+0000 7fab5a7fc700 1 --2- 172.21.15.26:0/152996521 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab5c0f6ff0 0x7fab5c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:17:11.600 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.599+0000 7fab5affd700 1 -- 172.21.15.26:0/152996521 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab5c0f6ff0 msgr2=0x7fab5c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:17:11.601 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.599+0000 7fab5affd700 1 --2- 172.21.15.26:0/152996521 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab5c0f6ff0 0x7fab5c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:11.601 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.599+0000 7fab5affd700 1 -- 172.21.15.26:0/152996521 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4c005040 con 0x7fab5c0f66e0 2021-11-03T17:17:11.601 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.600+0000 7fab5affd700 1 --2- 172.21.15.26:0/152996521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab5c0f66e0 0x7fab5c06b9a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7fab5000c530 tx=0x7fab50007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:17:11.601 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.600+0000 7fab437fe700 1 -- 172.21.15.26:0/152996521 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab5000f650 con 0x7fab5c0f66e0 2021-11-03T17:17:11.602 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.600+0000 7fab61742700 1 -- 172.21.15.26:0/152996521 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab5c06a7a0 con 0x7fab5c0f66e0 2021-11-03T17:17:11.602 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.600+0000 7fab437fe700 1 -- 172.21.15.26:0/152996521 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fab5000fc60 con 0x7fab5c0f66e0 2021-11-03T17:17:11.602 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.600+0000 7fab437fe700 1 -- 172.21.15.26:0/152996521 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab50012c20 con 0x7fab5c0f66e0 2021-11-03T17:17:11.602 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.600+0000 7fab61742700 1 -- 172.21.15.26:0/152996521 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab5c10efa0 con 0x7fab5c0f66e0 2021-11-03T17:17:11.603 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.601+0000 7fab61742700 1 -- 172.21.15.26:0/152996521 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab5c045ad0 con 0x7fab5c0f66e0 2021-11-03T17:17:11.603 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.601+0000 7fab437fe700 1 -- 172.21.15.26:0/152996521 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fab50010070 con 0x7fab5c0f66e0 2021-11-03T17:17:11.603 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.602+0000 7fab437fe700 1 --2- 172.21.15.26:0/152996521 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fab440640b0 0x7fab44066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:17:11.603 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.602+0000 7fab437fe700 1 -- 172.21.15.26:0/152996521 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fab50080640 con 0x7fab5c0f66e0 2021-11-03T17:17:11.604 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.602+0000 7fab5a7fc700 1 --2- 172.21.15.26:0/152996521 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fab440640b0 0x7fab44066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:17:11.604 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.602+0000 7fab5a7fc700 1 --2- 172.21.15.26:0/152996521 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fab440640b0 0x7fab44066570 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fab4c004630 tx=0x7fab4c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:17:11.604 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.606+0000 7fab437fe700 1 -- 172.21.15.26:0/152996521 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fab500528b0 con 0x7fab5c0f66e0 2021-11-03T17:17:11.805 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.810+0000 7fab61742700 1 -- 172.21.15.26:0/152996521 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fab5c0feed0 con 0x7fab5c0f66e0 2021-11-03T17:17:11.806 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.810+0000 7fab437fe700 1 -- 172.21.15.26:0/152996521 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fab500524a0 con 0x7fab5c0f66e0 2021-11-03T17:17:11.806 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:17:11.806 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:17:11.807 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:17:11.807 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:17:11.807 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:17:11.807 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:17:11.808 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:17:11.808 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:17:11.808 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:17:11.808 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:17:11.809 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:17:11.809 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:17:11.809 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:17:11.810 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:17:11.810 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:17:11.810 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:17:11.810 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:17:11.811 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:17:11.811 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:17:11.811 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:17:11.811 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:17:11.812 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:17:11.812 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:17:11.812 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:17:11.812 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:17:11.813 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:17:11.813 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:17:11.813 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:17:11.813 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:17:11.813 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:17:11.814 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:17:11.814 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:17:11.814 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:17:11.814 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:17:11.815 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:17:11.815 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:17:11.815 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:17:11.815 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:17:11.815 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:17:11.816 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.812+0000 7fab61742700 1 -- 172.21.15.26:0/152996521 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fab440640b0 msgr2=0x7fab44066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:17:11.817 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.812+0000 7fab61742700 1 --2- 172.21.15.26:0/152996521 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fab440640b0 0x7fab44066570 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fab4c004630 tx=0x7fab4c009b30).stop 2021-11-03T17:17:11.817 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.812+0000 7fab61742700 1 -- 172.21.15.26:0/152996521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab5c0f66e0 msgr2=0x7fab5c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:17:11.817 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.812+0000 7fab61742700 1 --2- 172.21.15.26:0/152996521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab5c0f66e0 0x7fab5c06b9a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7fab5000c530 tx=0x7fab50007e20).stop 2021-11-03T17:17:11.817 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.812+0000 7fab61742700 1 -- 172.21.15.26:0/152996521 shutdown_connections 2021-11-03T17:17:11.818 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.812+0000 7fab61742700 1 --2- 172.21.15.26:0/152996521 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fab440640b0 0x7fab44066570 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:11.818 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.812+0000 7fab61742700 1 --2- 172.21.15.26:0/152996521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab5c0f66e0 0x7fab5c06b9a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:11.818 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.812+0000 7fab61742700 1 --2- 172.21.15.26:0/152996521 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab5c0f6ff0 0x7fab5c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:11.818 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.812+0000 7fab61742700 1 -- 172.21.15.26:0/152996521 >> 172.21.15.26:0/152996521 conn(0x7fab5c0f1f00 msgr2=0x7fab5c0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:17:11.819 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.812+0000 7fab61742700 1 -- 172.21.15.26:0/152996521 shutdown_connections 2021-11-03T17:17:11.819 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:11.812+0000 7fab61742700 1 -- 172.21.15.26:0/152996521 wait complete. 2021-11-03T17:17:11.819 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:17:12.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:11 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:17:12.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:11 smithi194 ceph-mon[65619]: pgmap v676: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:12.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:11 smithi194 ceph-mon[65619]: from='client.34844 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:17:12.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:11 smithi194 ceph-mon[65619]: from='client.34848 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:17:12.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:11 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/4066403813' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:17:12.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:11 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/152996521' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:17:12.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:11 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:17:12.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:11 smithi026 ceph-mon[96795]: pgmap v676: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:12.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:11 smithi026 ceph-mon[96795]: from='client.34844 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:17:12.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:11 smithi026 ceph-mon[96795]: from='client.34848 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:17:12.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:11 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/4066403813' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:17:12.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:11 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/152996521' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:17:14.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:13 smithi194 ceph-mon[65619]: pgmap v677: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:14.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:13 smithi026 ceph-mon[96795]: pgmap v677: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:16.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:15 smithi194 ceph-mon[65619]: pgmap v678: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:16.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:15 smithi026 ceph-mon[96795]: pgmap v678: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:18.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:17 smithi194 ceph-mon[65619]: pgmap v679: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:18.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:17 smithi026 ceph-mon[96795]: pgmap v679: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:20.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:19 smithi194 ceph-mon[65619]: pgmap v680: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:20.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:19 smithi026 ceph-mon[96795]: pgmap v680: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:22.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:21 smithi194 ceph-mon[65619]: pgmap v681: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:22.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:21 smithi026 ceph-mon[96795]: pgmap v681: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:24.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:23 smithi194 ceph-mon[65619]: pgmap v682: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:24.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:23 smithi026 ceph-mon[96795]: pgmap v682: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:26.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:25 smithi194 ceph-mon[65619]: pgmap v683: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:26.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:17:26.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:25 smithi026 ceph-mon[96795]: pgmap v683: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:26.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:17:27.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:26 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:17:27.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:26 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:17:28.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:27 smithi194 ceph-mon[65619]: pgmap v684: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:28.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:27 smithi026 ceph-mon[96795]: pgmap v684: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:30.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:30 smithi194 ceph-mon[65619]: pgmap v685: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:30.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:29 smithi026 ceph-mon[96795]: pgmap v685: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:32.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:32 smithi026 ceph-mon[96795]: pgmap v686: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:32.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:32 smithi194 ceph-mon[65619]: pgmap v686: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:34.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:34 smithi026 ceph-mon[96795]: pgmap v687: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:34.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:34 smithi194 ceph-mon[65619]: pgmap v687: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:36.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:36 smithi026 ceph-mon[96795]: pgmap v688: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:36.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:36 smithi194 ceph-mon[65619]: pgmap v688: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:38.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:38 smithi026 ceph-mon[96795]: pgmap v689: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:38.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:38 smithi194 ceph-mon[65619]: pgmap v689: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:40.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:40 smithi026 ceph-mon[96795]: pgmap v690: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:40.431 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:40 smithi194 ceph-mon[65619]: pgmap v690: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:41.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:17:41.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:17:41.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:17:41.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:17:41.924 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:41.927+0000 7fc3e1008700 1 -- 172.21.15.26:0/539793160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3dc0f49a0 msgr2=0x7fc3dc0f4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:17:41.924 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:41.927+0000 7fc3e1008700 1 --2- 172.21.15.26:0/539793160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3dc0f49a0 0x7fc3dc0f4dc0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7fc3cc004660 tx=0x7fc3cc009b30).stop 2021-11-03T17:17:41.924 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:41.927+0000 7fc3e1008700 1 -- 172.21.15.26:0/539793160 shutdown_connections 2021-11-03T17:17:41.924 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:41.927+0000 7fc3e1008700 1 --2- 172.21.15.26:0/539793160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3dc0f5340 0x7fc3dc0f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:41.925 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:41.927+0000 7fc3e1008700 1 --2- 172.21.15.26:0/539793160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3dc0f49a0 0x7fc3dc0f4dc0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:41.925 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:41.927+0000 7fc3e1008700 1 -- 172.21.15.26:0/539793160 >> 172.21.15.26:0/539793160 conn(0x7fc3dc0f04c0 msgr2=0x7fc3dc0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:17:41.925 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:41.927+0000 7fc3e1008700 1 -- 172.21.15.26:0/539793160 shutdown_connections 2021-11-03T17:17:41.925 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:41.927+0000 7fc3e1008700 1 -- 172.21.15.26:0/539793160 wait complete. 2021-11-03T17:17:41.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:41.928+0000 7fc3e1008700 1 Processor -- start 2021-11-03T17:17:41.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:41.928+0000 7fc3e1008700 1 -- start start 2021-11-03T17:17:41.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:41.928+0000 7fc3e1008700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3dc0f49a0 0x7fc3dc0f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:17:41.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:41.928+0000 7fc3e1008700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3dc0f5340 0x7fc3dc0f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:17:41.927 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:41.928+0000 7fc3e1008700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc0f5f30 con 0x7fc3dc0f49a0 2021-11-03T17:17:41.927 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:41.928+0000 7fc3e1008700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc0f6070 con 0x7fc3dc0f5340 2021-11-03T17:17:41.927 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:41.928+0000 7fc3dad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3dc0f49a0 0x7fc3dc0f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:17:41.927 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:41.928+0000 7fc3dad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3dc0f49a0 0x7fc3dc0f7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53574/0 (socket says 172.21.15.26:53574) 2021-11-03T17:17:41.928 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:41.928+0000 7fc3dad9d700 1 -- 172.21.15.26:0/1206135431 learned_addr learned my addr 172.21.15.26:0/1206135431 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:17:41.928 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:41.929+0000 7fc3da59c700 1 --2- 172.21.15.26:0/1206135431 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3dc0f5340 0x7fc3dc0f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:17:41.928 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:41.929+0000 7fc3dad9d700 1 -- 172.21.15.26:0/1206135431 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3dc0f5340 msgr2=0x7fc3dc0f59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:17:41.928 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:41.929+0000 7fc3dad9d700 1 --2- 172.21.15.26:0/1206135431 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3dc0f5340 0x7fc3dc0f59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:41.929 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:41.929+0000 7fc3dad9d700 1 -- 172.21.15.26:0/1206135431 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3cc005040 con 0x7fc3dc0f49a0 2021-11-03T17:17:41.929 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:41.929+0000 7fc3dad9d700 1 --2- 172.21.15.26:0/1206135431 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3dc0f49a0 0x7fc3dc0f7550 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7fc3cc009d80 tx=0x7fc3cc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:17:41.929 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:41.929+0000 7fc3c37fe700 1 -- 172.21.15.26:0/1206135431 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3cc018070 con 0x7fc3dc0f49a0 2021-11-03T17:17:41.929 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:41.929+0000 7fc3c37fe700 1 -- 172.21.15.26:0/1206135431 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc3cc007ba0 con 0x7fc3dc0f49a0 2021-11-03T17:17:41.929 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:41.929+0000 7fc3e1008700 1 -- 172.21.15.26:0/1206135431 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3dc0f62f0 con 0x7fc3dc0f49a0 2021-11-03T17:17:41.930 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:41.929+0000 7fc3c37fe700 1 -- 172.21.15.26:0/1206135431 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3cc01c620 con 0x7fc3dc0f49a0 2021-11-03T17:17:41.930 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:41.929+0000 7fc3e1008700 1 -- 172.21.15.26:0/1206135431 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3dc0f6850 con 0x7fc3dc0f49a0 2021-11-03T17:17:41.932 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:41.930+0000 7fc3e1008700 1 -- 172.21.15.26:0/1206135431 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3dc045ad0 con 0x7fc3dc0f49a0 2021-11-03T17:17:41.932 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:41.930+0000 7fc3c37fe700 1 -- 172.21.15.26:0/1206135431 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc3cc01d420 con 0x7fc3dc0f49a0 2021-11-03T17:17:41.932 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:41.931+0000 7fc3c37fe700 1 --2- 172.21.15.26:0/1206135431 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3c40640b0 0x7fc3c4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:17:41.932 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:41.931+0000 7fc3c37fe700 1 -- 172.21.15.26:0/1206135431 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc3cc082630 con 0x7fc3dc0f49a0 2021-11-03T17:17:41.933 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:41.931+0000 7fc3da59c700 1 --2- 172.21.15.26:0/1206135431 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3c40640b0 0x7fc3c4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:17:41.933 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:41.931+0000 7fc3da59c700 1 --2- 172.21.15.26:0/1206135431 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3c40640b0 0x7fc3c4066570 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fc3dc0f5780 tx=0x7fc3d0009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:17:41.933 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:41.935+0000 7fc3c37fe700 1 -- 172.21.15.26:0/1206135431 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc3cc054930 con 0x7fc3dc0f49a0 2021-11-03T17:17:42.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.117+0000 7fc3e1008700 1 -- 172.21.15.26:0/1206135431 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3dc0feff0 con 0x7fc3c40640b0 2021-11-03T17:17:42.113 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.119+0000 7fc3c37fe700 1 -- 172.21.15.26:0/1206135431 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fc3dc0feff0 con 0x7fc3c40640b0 2021-11-03T17:17:42.115 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.121+0000 7fc3e1008700 1 -- 172.21.15.26:0/1206135431 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3c40640b0 msgr2=0x7fc3c4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:17:42.115 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.121+0000 7fc3e1008700 1 --2- 172.21.15.26:0/1206135431 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3c40640b0 0x7fc3c4066570 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fc3dc0f5780 tx=0x7fc3d0009040).stop 2021-11-03T17:17:42.115 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.121+0000 7fc3e1008700 1 -- 172.21.15.26:0/1206135431 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3dc0f49a0 msgr2=0x7fc3dc0f7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:17:42.116 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.121+0000 7fc3e1008700 1 --2- 172.21.15.26:0/1206135431 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3dc0f49a0 0x7fc3dc0f7550 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7fc3cc009d80 tx=0x7fc3cc009b30).stop 2021-11-03T17:17:42.116 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.121+0000 7fc3e1008700 1 -- 172.21.15.26:0/1206135431 shutdown_connections 2021-11-03T17:17:42.116 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.121+0000 7fc3e1008700 1 --2- 172.21.15.26:0/1206135431 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3c40640b0 0x7fc3c4066570 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:42.116 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.121+0000 7fc3e1008700 1 --2- 172.21.15.26:0/1206135431 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3dc0f49a0 0x7fc3dc0f7550 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:42.116 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.121+0000 7fc3e1008700 1 --2- 172.21.15.26:0/1206135431 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3dc0f5340 0x7fc3dc0f59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:42.117 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.121+0000 7fc3e1008700 1 -- 172.21.15.26:0/1206135431 >> 172.21.15.26:0/1206135431 conn(0x7fc3dc0f04c0 msgr2=0x7fc3dc0fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:17:42.117 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.121+0000 7fc3e1008700 1 -- 172.21.15.26:0/1206135431 shutdown_connections 2021-11-03T17:17:42.117 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.121+0000 7fc3e1008700 1 -- 172.21.15.26:0/1206135431 wait complete. 2021-11-03T17:17:42.125 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:17:42.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.221+0000 7fe507c27700 1 -- 172.21.15.26:0/1179369421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5000f58b0 msgr2=0x7fe5000f5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:17:42.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.221+0000 7fe507c27700 1 --2- 172.21.15.26:0/1179369421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5000f58b0 0x7fe5000f5d30 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7fe4fc004660 tx=0x7fe4fc009b30).stop 2021-11-03T17:17:42.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.221+0000 7fe507c27700 1 -- 172.21.15.26:0/1179369421 shutdown_connections 2021-11-03T17:17:42.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.221+0000 7fe507c27700 1 --2- 172.21.15.26:0/1179369421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5000f58b0 0x7fe5000f5d30 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:42.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.221+0000 7fe507c27700 1 --2- 172.21.15.26:0/1179369421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5000f6bb0 0x7fe5000f6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:17:42.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.221+0000 7fe507c27700 1 -- 172.21.15.26:0/1179369421 >> 172.21.15.26:0/1179369421 conn(0x7fe5000f04c0 msgr2=0x7fe5000f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:17:42.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.221+0000 7fe507c27700 1 -- 172.21.15.26:0/1179369421 shutdown_connections 2021-11-03T17:17:42.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.221+0000 7fe507c27700 1 -- 172.21.15.26:0/1179369421 wait complete. 2021-11-03T17:17:42.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.222+0000 7fe507c27700 1 Processor -- start 2021-11-03T17:17:42.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.222+0000 7fe507c27700 1 -- start start 2021-11-03T17:17:42.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.222+0000 7fe507c27700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5000f58b0 0x7fe500109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:17:42.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.222+0000 7fe507c27700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5000f6bb0 0x7fe50010c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:17:42.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.222+0000 7fe507c27700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5000f5630 con 0x7fe5000f6bb0 2021-11-03T17:17:42.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.222+0000 7fe507c27700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5000f5770 con 0x7fe5000f58b0 2021-11-03T17:17:42.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.222+0000 7fe5051c2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5000f6bb0 0x7fe50010c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:17:42.221 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.222+0000 7fe5051c2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5000f6bb0 0x7fe50010c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53586/0 (socket says 172.21.15.26:53586) 2021-11-03T17:17:42.221 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.222+0000 7fe5051c2700 1 -- 172.21.15.26:0/1638960126 learned_addr learned my addr 172.21.15.26:0/1638960126 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:17:42.221 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.222+0000 7fe5059c3700 1 --2- 172.21.15.26:0/1638960126 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5000f58b0 0x7fe500109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:17:42.221 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.222+0000 7fe5051c2700 1 -- 172.21.15.26:0/1638960126 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5000f58b0 msgr2=0x7fe500109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:17:42.222 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.222+0000 7fe5051c2700 1 --2- 172.21.15.26:0/1638960126 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5000f58b0 0x7fe500109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:42.222 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.222+0000 7fe5051c2700 1 -- 172.21.15.26:0/1638960126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4fc005040 con 0x7fe5000f6bb0 2021-11-03T17:17:42.222 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.222+0000 7fe5059c3700 1 --2- 172.21.15.26:0/1638960126 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5000f58b0 0x7fe500109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:17:42.222 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.222+0000 7fe5051c2700 1 --2- 172.21.15.26:0/1638960126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5000f6bb0 0x7fe50010c190 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7fe4fc000c00 tx=0x7fe4fc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:17:42.222 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.222+0000 7fe4f27fc700 1 -- 172.21.15.26:0/1638960126 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4fc018070 con 0x7fe5000f6bb0 2021-11-03T17:17:42.223 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.223+0000 7fe4f27fc700 1 -- 172.21.15.26:0/1638960126 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe4fc007d70 con 0x7fe5000f6bb0 2021-11-03T17:17:42.223 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.223+0000 7fe507c27700 1 -- 172.21.15.26:0/1638960126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe50010c790 con 0x7fe5000f6bb0 2021-11-03T17:17:42.223 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.223+0000 7fe4f27fc700 1 -- 172.21.15.26:0/1638960126 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4fc01c620 con 0x7fe5000f6bb0 2021-11-03T17:17:42.224 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.223+0000 7fe507c27700 1 -- 172.21.15.26:0/1638960126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe50010ccf0 con 0x7fe5000f6bb0 2021-11-03T17:17:42.225 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.223+0000 7fe507c27700 1 -- 172.21.15.26:0/1638960126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe500045ad0 con 0x7fe5000f6bb0 2021-11-03T17:17:42.225 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.224+0000 7fe4f27fc700 1 -- 172.21.15.26:0/1638960126 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fe4fc01c860 con 0x7fe5000f6bb0 2021-11-03T17:17:42.225 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.224+0000 7fe4f27fc700 1 --2- 172.21.15.26:0/1638960126 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe4ec064090 0x7fe4ec066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:17:42.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.224+0000 7fe4f27fc700 1 -- 172.21.15.26:0/1638960126 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fe4fc082690 con 0x7fe5000f6bb0 2021-11-03T17:17:42.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.224+0000 7fe5059c3700 1 --2- 172.21.15.26:0/1638960126 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe4ec064090 0x7fe4ec066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:17:42.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.225+0000 7fe5059c3700 1 --2- 172.21.15.26:0/1638960126 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe4ec064090 0x7fe4ec066550 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fe5000f5220 tx=0x7fe4f4008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:17:42.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.229+0000 7fe4f27fc700 1 -- 172.21.15.26:0/1638960126 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fe4fc054ab0 con 0x7fe5000f6bb0 2021-11-03T17:17:42.397 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.402+0000 7fe507c27700 1 -- 172.21.15.26:0/1638960126 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe5000fdfe0 con 0x7fe4ec064090 2021-11-03T17:17:42.411 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.417+0000 7fe4f27fc700 1 -- 172.21.15.26:0/1638960126 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fe5000fdfe0 con 0x7fe4ec064090 2021-11-03T17:17:42.412 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:17:42.412 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (28m) 9m ago 30m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:17:42.412 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (21m) 9m ago 30m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:17:42.412 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (20m) 8m ago 29m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:17:42.413 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (28m) 9m ago 29m 39.5M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:17:42.413 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (21m) 9m ago 25m 16.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:17:42.413 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (22m) 9m ago 25m 17.8M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:17:42.413 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (25m) 8m ago 25m 19.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:17:42.413 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (25m) 8m ago 25m 19.4M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:17:42.414 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (22m) 9m ago 31m 491M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:17:42.414 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (22m) 8m ago 29m 415M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:17:42.414 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (22m) 9m ago 31m 113M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:17:42.414 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (21m) 8m ago 29m 70.2M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:17:42.415 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (29m) 9m ago 29m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:17:42.415 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (29m) 8m ago 29m 18.4M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:17:42.415 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (20m) 9m ago 28m 190M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:17:42.415 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (20m) 9m ago 28m 204M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:17:42.416 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (19m) 9m ago 27m 170M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:17:42.416 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (19m) 8m ago 27m 211M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:17:42.416 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (18m) 8m ago 27m 189M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:17:42.416 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (18m) 8m ago 26m 174M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:17:42.416 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (28m) 9m ago 29m 49.9M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:17:42.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.419+0000 7fe507c27700 1 -- 172.21.15.26:0/1638960126 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe4ec064090 msgr2=0x7fe4ec066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:17:42.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.419+0000 7fe507c27700 1 --2- 172.21.15.26:0/1638960126 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe4ec064090 0x7fe4ec066550 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fe5000f5220 tx=0x7fe4f4008040).stop 2021-11-03T17:17:42.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.419+0000 7fe507c27700 1 -- 172.21.15.26:0/1638960126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5000f6bb0 msgr2=0x7fe50010c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:17:42.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.419+0000 7fe507c27700 1 --2- 172.21.15.26:0/1638960126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5000f6bb0 0x7fe50010c190 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7fe4fc000c00 tx=0x7fe4fc009b30).stop 2021-11-03T17:17:42.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.419+0000 7fe507c27700 1 -- 172.21.15.26:0/1638960126 shutdown_connections 2021-11-03T17:17:42.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.419+0000 7fe507c27700 1 --2- 172.21.15.26:0/1638960126 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe4ec064090 0x7fe4ec066550 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:42.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.419+0000 7fe507c27700 1 --2- 172.21.15.26:0/1638960126 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5000f58b0 0x7fe500109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:42.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.419+0000 7fe507c27700 1 --2- 172.21.15.26:0/1638960126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5000f6bb0 0x7fe50010c190 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:42.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.419+0000 7fe507c27700 1 -- 172.21.15.26:0/1638960126 >> 172.21.15.26:0/1638960126 conn(0x7fe5000f04c0 msgr2=0x7fe5000fa310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:17:42.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.419+0000 7fe507c27700 1 -- 172.21.15.26:0/1638960126 shutdown_connections 2021-11-03T17:17:42.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.419+0000 7fe507c27700 1 -- 172.21.15.26:0/1638960126 wait complete. 2021-11-03T17:17:42.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:42 smithi026 ceph-mon[96795]: poll took 60056.399 ms: 1 events 2021-11-03T17:17:42.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:42 smithi026 ceph-mon[96795]: pgmap v691: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:42.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:17:42.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:17:42.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:17:42.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:17:42.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:17:42.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:17:42.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:42 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:17:42.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:17:42.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:42 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:17:42.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:42 smithi194 ceph-mon[65619]: poll took 60056.399 ms: 1 events 2021-11-03T17:17:42.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:42 smithi194 ceph-mon[65619]: pgmap v691: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:42.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:17:42.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:17:42.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:17:42.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:17:42.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:17:42.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:17:42.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:42 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:17:42.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:17:42.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:42 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:17:42.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.523+0000 7f30ae121700 1 -- 172.21.15.26:0/282829905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30a80f5ef0 msgr2=0x7f30a80f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:17:42.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.523+0000 7f30ae121700 1 --2- 172.21.15.26:0/282829905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30a80f5ef0 0x7f30a80f6920 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f309c004660 tx=0x7f309c009b30).stop 2021-11-03T17:17:42.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.523+0000 7f30ae121700 1 -- 172.21.15.26:0/282829905 shutdown_connections 2021-11-03T17:17:42.520 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.523+0000 7f30ae121700 1 --2- 172.21.15.26:0/282829905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30a80f5ef0 0x7f30a80f6920 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:42.520 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.523+0000 7f30ae121700 1 --2- 172.21.15.26:0/282829905 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30a80f55e0 0x7f30a80f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:42.520 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.523+0000 7f30ae121700 1 -- 172.21.15.26:0/282829905 >> 172.21.15.26:0/282829905 conn(0x7f30a80f0de0 msgr2=0x7f30a80f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:17:42.520 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.523+0000 7f30ae121700 1 -- 172.21.15.26:0/282829905 shutdown_connections 2021-11-03T17:17:42.520 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.523+0000 7f30ae121700 1 -- 172.21.15.26:0/282829905 wait complete. 2021-11-03T17:17:42.521 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.523+0000 7f30ae121700 1 Processor -- start 2021-11-03T17:17:42.521 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.523+0000 7f30ae121700 1 -- start start 2021-11-03T17:17:42.522 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.524+0000 7f30ae121700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30a80f55e0 0x7f30a810c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:17:42.522 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.524+0000 7f30ae121700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30a80f5ef0 0x7f30a810e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:17:42.522 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.524+0000 7f30ae121700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a80603b0 con 0x7f30a80f5ef0 2021-11-03T17:17:42.522 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.524+0000 7f30ae121700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a80604f0 con 0x7f30a80f55e0 2021-11-03T17:17:42.522 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.524+0000 7f30a6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30a80f5ef0 0x7f30a810e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:17:42.523 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.524+0000 7f30a6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30a80f5ef0 0x7f30a810e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53596/0 (socket says 172.21.15.26:53596) 2021-11-03T17:17:42.523 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.524+0000 7f30a6ffd700 1 -- 172.21.15.26:0/2014044210 learned_addr learned my addr 172.21.15.26:0/2014044210 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:17:42.523 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.524+0000 7f30a77fe700 1 --2- 172.21.15.26:0/2014044210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30a80f55e0 0x7f30a810c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:17:42.523 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.524+0000 7f30a6ffd700 1 -- 172.21.15.26:0/2014044210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30a80f55e0 msgr2=0x7f30a810c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:17:42.524 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.524+0000 7f30a6ffd700 1 --2- 172.21.15.26:0/2014044210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30a80f55e0 0x7f30a810c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:42.524 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.524+0000 7f30a6ffd700 1 -- 172.21.15.26:0/2014044210 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f309c005040 con 0x7f30a80f5ef0 2021-11-03T17:17:42.524 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.524+0000 7f30a77fe700 1 --2- 172.21.15.26:0/2014044210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30a80f55e0 0x7f30a810c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:17:42.524 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.524+0000 7f30a6ffd700 1 --2- 172.21.15.26:0/2014044210 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30a80f5ef0 0x7f30a810e5b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f309c009830 tx=0x7f309c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:17:42.525 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.524+0000 7f308ffff700 1 -- 172.21.15.26:0/2014044210 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f309c018070 con 0x7f30a80f5ef0 2021-11-03T17:17:42.525 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.524+0000 7f308ffff700 1 -- 172.21.15.26:0/2014044210 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f309c007ba0 con 0x7f30a80f5ef0 2021-11-03T17:17:42.525 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.524+0000 7f30ae121700 1 -- 172.21.15.26:0/2014044210 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30a810eaa0 con 0x7f30a80f5ef0 2021-11-03T17:17:42.525 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.524+0000 7f308ffff700 1 -- 172.21.15.26:0/2014044210 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f309c01c620 con 0x7f30a80f5ef0 2021-11-03T17:17:42.525 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.524+0000 7f30ae121700 1 -- 172.21.15.26:0/2014044210 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30a810ee70 con 0x7f30a80f5ef0 2021-11-03T17:17:42.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.525+0000 7f30ae121700 1 -- 172.21.15.26:0/2014044210 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30a8045ad0 con 0x7f30a80f5ef0 2021-11-03T17:17:42.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.526+0000 7f308ffff700 1 -- 172.21.15.26:0/2014044210 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f309c007d10 con 0x7f30a80f5ef0 2021-11-03T17:17:42.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.526+0000 7f308ffff700 1 --2- 172.21.15.26:0/2014044210 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3090064090 0x7f3090066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:17:42.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.526+0000 7f308ffff700 1 -- 172.21.15.26:0/2014044210 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f309c082500 con 0x7f30a80f5ef0 2021-11-03T17:17:42.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.526+0000 7f30a77fe700 1 --2- 172.21.15.26:0/2014044210 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3090064090 0x7f3090066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:17:42.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.526+0000 7f30a77fe700 1 --2- 172.21.15.26:0/2014044210 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3090064090 0x7f3090066550 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f30a8060140 tx=0x7f3098009c00).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:17:42.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.530+0000 7f308ffff700 1 -- 172.21.15.26:0/2014044210 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f309c054920 con 0x7f30a80f5ef0 2021-11-03T17:17:42.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.761+0000 7f30ae121700 1 -- 172.21.15.26:0/2014044210 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f30a8027a00 con 0x7f30a80f5ef0 2021-11-03T17:17:42.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.762+0000 7f308ffff700 1 -- 172.21.15.26:0/2014044210 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f309c054510 con 0x7f30a80f5ef0 2021-11-03T17:17:42.756 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:17:42.757 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:17:42.757 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:17:42.757 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:17:42.757 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:17:42.758 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:17:42.758 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:17:42.758 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:17:42.758 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:17:42.759 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:17:42.759 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:17:42.759 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:17:42.759 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:17:42.760 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:17:42.760 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:17:42.760 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:17:42.760 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:17:42.760 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:17:42.761 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.763+0000 7f30ae121700 1 -- 172.21.15.26:0/2014044210 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3090064090 msgr2=0x7f3090066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:17:42.762 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.763+0000 7f30ae121700 1 --2- 172.21.15.26:0/2014044210 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3090064090 0x7f3090066550 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f30a8060140 tx=0x7f3098009c00).stop 2021-11-03T17:17:42.762 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.763+0000 7f30ae121700 1 -- 172.21.15.26:0/2014044210 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30a80f5ef0 msgr2=0x7f30a810e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:17:42.762 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.763+0000 7f30ae121700 1 --2- 172.21.15.26:0/2014044210 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30a80f5ef0 0x7f30a810e5b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f309c009830 tx=0x7f309c009b30).stop 2021-11-03T17:17:42.762 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.763+0000 7f30ae121700 1 -- 172.21.15.26:0/2014044210 shutdown_connections 2021-11-03T17:17:42.763 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.763+0000 7f30ae121700 1 --2- 172.21.15.26:0/2014044210 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3090064090 0x7f3090066550 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:42.763 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.763+0000 7f30ae121700 1 --2- 172.21.15.26:0/2014044210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30a80f55e0 0x7f30a810c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:42.763 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.763+0000 7f30ae121700 1 --2- 172.21.15.26:0/2014044210 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30a80f5ef0 0x7f30a810e5b0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:42.763 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.763+0000 7f30ae121700 1 -- 172.21.15.26:0/2014044210 >> 172.21.15.26:0/2014044210 conn(0x7f30a80f0de0 msgr2=0x7f30a80fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:17:42.763 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.764+0000 7f30ae121700 1 -- 172.21.15.26:0/2014044210 shutdown_connections 2021-11-03T17:17:42.764 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.764+0000 7f30ae121700 1 -- 172.21.15.26:0/2014044210 wait complete. 2021-11-03T17:17:42.858 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.863+0000 7feccffff700 1 -- 172.21.15.26:0/239182682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecd00f66e0 msgr2=0x7fecd00f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:17:42.858 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.863+0000 7feccffff700 1 --2- 172.21.15.26:0/239182682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecd00f66e0 0x7fecd00f6b40 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7fecc4004660 tx=0x7fecc4009b30).stop 2021-11-03T17:17:42.858 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.863+0000 7feccffff700 1 -- 172.21.15.26:0/239182682 shutdown_connections 2021-11-03T17:17:42.859 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.863+0000 7feccffff700 1 --2- 172.21.15.26:0/239182682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecd00f66e0 0x7fecd00f6b40 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:42.859 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.863+0000 7feccffff700 1 --2- 172.21.15.26:0/239182682 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fecd00f5440 0x7fecd00f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:17:42.859 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.863+0000 7feccffff700 1 -- 172.21.15.26:0/239182682 >> 172.21.15.26:0/239182682 conn(0x7fecd00f0ba0 msgr2=0x7fecd00f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:17:42.859 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.863+0000 7feccffff700 1 -- 172.21.15.26:0/239182682 shutdown_connections 2021-11-03T17:17:42.860 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.863+0000 7feccffff700 1 -- 172.21.15.26:0/239182682 wait complete. 2021-11-03T17:17:42.862 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.864+0000 7feccffff700 1 Processor -- start 2021-11-03T17:17:42.862 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.864+0000 7feccffff700 1 -- start start 2021-11-03T17:17:42.863 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.864+0000 7feccffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecd00f5440 0x7fecd0109aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:17:42.863 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.864+0000 7feccffff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fecd00f66e0 0x7fecd010bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:17:42.863 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.864+0000 7feccffff700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd0060450 con 0x7fecd00f5440 2021-11-03T17:17:42.863 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.864+0000 7feccffff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd0060590 con 0x7fecd00f66e0 2021-11-03T17:17:42.864 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.864+0000 7fecceffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecd00f5440 0x7fecd0109aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:17:42.864 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.864+0000 7fecceffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecd00f5440 0x7fecd0109aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53604/0 (socket says 172.21.15.26:53604) 2021-11-03T17:17:42.864 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.864+0000 7fecceffd700 1 -- 172.21.15.26:0/2114995520 learned_addr learned my addr 172.21.15.26:0/2114995520 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:17:42.864 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.864+0000 7fecce7fc700 1 --2- 172.21.15.26:0/2114995520 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fecd00f66e0 0x7fecd010bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:17:42.865 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.865+0000 7fecceffd700 1 -- 172.21.15.26:0/2114995520 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fecd00f66e0 msgr2=0x7fecd010bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:17:42.865 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.865+0000 7fecceffd700 1 --2- 172.21.15.26:0/2114995520 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fecd00f66e0 0x7fecd010bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:42.865 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.865+0000 7fecceffd700 1 -- 172.21.15.26:0/2114995520 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc4005040 con 0x7fecd00f5440 2021-11-03T17:17:42.865 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.865+0000 7fecceffd700 1 --2- 172.21.15.26:0/2114995520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecd00f5440 0x7fecd0109aa0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7fecc00093f0 tx=0x7fecc0006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:17:42.865 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.865+0000 7fecb77fe700 1 -- 172.21.15.26:0/2114995520 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecc0013640 con 0x7fecd00f5440 2021-11-03T17:17:42.866 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.865+0000 7feccffff700 1 -- 172.21.15.26:0/2114995520 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd010c5b0 con 0x7fecd00f5440 2021-11-03T17:17:42.866 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.865+0000 7fecb77fe700 1 -- 172.21.15.26:0/2114995520 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fecc0013c50 con 0x7fecd00f5440 2021-11-03T17:17:42.866 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.865+0000 7fecb77fe700 1 -- 172.21.15.26:0/2114995520 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecc0012d10 con 0x7fecd00f5440 2021-11-03T17:17:42.866 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.865+0000 7feccffff700 1 -- 172.21.15.26:0/2114995520 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd010cb70 con 0x7fecd00f5440 2021-11-03T17:17:42.867 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.866+0000 7feccffff700 1 -- 172.21.15.26:0/2114995520 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecd0045ad0 con 0x7fecd00f5440 2021-11-03T17:17:42.867 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.866+0000 7fecb77fe700 1 -- 172.21.15.26:0/2114995520 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fecc001a060 con 0x7fecd00f5440 2021-11-03T17:17:42.867 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.867+0000 7fecb77fe700 1 --2- 172.21.15.26:0/2114995520 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fecb8064100 0x7fecb80665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:17:42.867 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.867+0000 7fecb77fe700 1 -- 172.21.15.26:0/2114995520 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fecc00808b0 con 0x7fecd00f5440 2021-11-03T17:17:42.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.867+0000 7fecce7fc700 1 --2- 172.21.15.26:0/2114995520 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fecb8064100 0x7fecb80665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:17:42.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.867+0000 7fecce7fc700 1 --2- 172.21.15.26:0/2114995520 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fecb8064100 0x7fecb80665c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fecc4004630 tx=0x7fecc4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:17:42.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:42.871+0000 7fecb77fe700 1 -- 172.21.15.26:0/2114995520 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fecc0052b20 con 0x7fecd00f5440 2021-11-03T17:17:43.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:43.075+0000 7feccffff700 1 -- 172.21.15.26:0/2114995520 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fecd0027a00 con 0x7fecd00f5440 2021-11-03T17:17:43.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:43.076+0000 7fecb77fe700 1 -- 172.21.15.26:0/2114995520 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fecc0018710 con 0x7fecd00f5440 2021-11-03T17:17:43.071 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:17:43.071 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:17:43.071 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:17:43.072 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:17:43.072 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:17:43.072 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:17:43.072 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:17:43.073 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:17:43.073 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:17:43.073 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:17:43.073 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:17:43.073 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:17:43.074 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:17:43.074 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:17:43.074 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:17:43.074 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:17:43.075 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:17:43.075 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:17:43.076 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:17:43.076 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:17:43.076 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:17:43.076 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:17:43.077 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:17:43.077 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:17:43.077 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:17:43.077 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:17:43.077 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:17:43.078 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:17:43.078 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:17:43.078 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:17:43.078 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:17:43.079 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:17:43.079 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:17:43.079 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:17:43.079 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:17:43.080 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:17:43.080 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:17:43.080 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:17:43.080 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:17:43.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:43.078+0000 7feccffff700 1 -- 172.21.15.26:0/2114995520 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fecb8064100 msgr2=0x7fecb80665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:17:43.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:43.078+0000 7feccffff700 1 --2- 172.21.15.26:0/2114995520 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fecb8064100 0x7fecb80665c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fecc4004630 tx=0x7fecc4009b30).stop 2021-11-03T17:17:43.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:43.078+0000 7feccffff700 1 -- 172.21.15.26:0/2114995520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecd00f5440 msgr2=0x7fecd0109aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:17:43.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:43.078+0000 7feccffff700 1 --2- 172.21.15.26:0/2114995520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecd00f5440 0x7fecd0109aa0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7fecc00093f0 tx=0x7fecc0006ec0).stop 2021-11-03T17:17:43.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:43.078+0000 7feccffff700 1 -- 172.21.15.26:0/2114995520 shutdown_connections 2021-11-03T17:17:43.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:43.078+0000 7feccffff700 1 --2- 172.21.15.26:0/2114995520 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fecb8064100 0x7fecb80665c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:43.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:43.078+0000 7feccffff700 1 --2- 172.21.15.26:0/2114995520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecd00f5440 0x7fecd0109aa0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:43.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:43.078+0000 7feccffff700 1 --2- 172.21.15.26:0/2114995520 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fecd00f66e0 0x7fecd010bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:17:43.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:43.078+0000 7feccffff700 1 -- 172.21.15.26:0/2114995520 >> 172.21.15.26:0/2114995520 conn(0x7fecd00f0ba0 msgr2=0x7fecd00fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:17:43.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:43.078+0000 7feccffff700 1 -- 172.21.15.26:0/2114995520 shutdown_connections 2021-11-03T17:17:43.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:17:43.078+0000 7feccffff700 1 -- 172.21.15.26:0/2114995520 wait complete. 2021-11-03T17:17:43.084 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:17:43.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:43 smithi026 ceph-mon[96795]: from='client.34860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:17:43.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:43 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2014044210' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:17:43.470 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:43 smithi194 ceph-mon[65619]: from='client.34860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:17:43.470 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:43 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2014044210' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:17:44.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:44 smithi026 ceph-mon[96795]: from='client.34864 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:17:44.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:44 smithi026 ceph-mon[96795]: pgmap v692: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:44.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:44 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2114995520' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:17:44.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:44 smithi194 ceph-mon[65619]: from='client.34864 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:17:44.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:44 smithi194 ceph-mon[65619]: pgmap v692: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:44.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:44 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2114995520' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:17:46.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:46 smithi026 ceph-mon[96795]: pgmap v693: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:46.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:46 smithi194 ceph-mon[65619]: pgmap v693: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:48.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:48 smithi026 ceph-mon[96795]: pgmap v694: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:48.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:48 smithi194 ceph-mon[65619]: pgmap v694: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:49.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:17:49.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:17:49.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:17:49.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:17:50.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:50 smithi026 ceph-mon[96795]: pgmap v695: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:50.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:50 smithi194 ceph-mon[65619]: pgmap v695: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:52.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:52 smithi026 ceph-mon[96795]: pgmap v696: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:52.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:52 smithi194 ceph-mon[65619]: pgmap v696: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:54.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:54 smithi026 ceph-mon[96795]: pgmap v697: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:54.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:54 smithi194 ceph-mon[65619]: pgmap v697: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:56.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:56 smithi026 ceph-mon[96795]: pgmap v698: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:56.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:56 smithi194 ceph-mon[65619]: pgmap v698: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:57.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:57 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:17:57.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:57 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:17:57.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:57 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:17:57.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:57 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:17:58.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:17:58 smithi026 ceph-mon[96795]: pgmap v699: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:17:58.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:17:58 smithi194 ceph-mon[65619]: pgmap v699: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:00.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:00 smithi026 ceph-mon[96795]: pgmap v700: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:00.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:00 smithi194 ceph-mon[65619]: pgmap v700: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:02.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:02 smithi026 ceph-mon[96795]: pgmap v701: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:02.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:02 smithi194 ceph-mon[65619]: pgmap v701: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:04.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:04 smithi026 ceph-mon[96795]: pgmap v702: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:04.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:04 smithi194 ceph-mon[65619]: pgmap v702: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:06.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:06 smithi026 ceph-mon[96795]: pgmap v703: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:06.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:06 smithi194 ceph-mon[65619]: pgmap v703: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:08.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:08 smithi026 ceph-mon[96795]: pgmap v704: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:08.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:08 smithi194 ceph-mon[65619]: pgmap v704: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:10.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:10 smithi026 ceph-mon[96795]: pgmap v705: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:10.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:10 smithi194 ceph-mon[65619]: pgmap v705: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:11.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:11 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:18:11.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:11 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:18:12.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:12 smithi026 ceph-mon[96795]: pgmap v706: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:12.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:12 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:18:12.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:12 smithi194 ceph-mon[65619]: pgmap v706: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:12.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:12 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:18:13.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.192+0000 7fdc52575700 1 -- 172.21.15.26:0/1333962531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc4c0f7490 msgr2=0x7fdc4c0f9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:18:13.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.192+0000 7fdc52575700 1 --2- 172.21.15.26:0/1333962531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc4c0f7490 0x7fdc4c0f9920 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7fdc3c004660 tx=0x7fdc3c009b30).stop 2021-11-03T17:18:13.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.192+0000 7fdc52575700 1 -- 172.21.15.26:0/1333962531 shutdown_connections 2021-11-03T17:18:13.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.192+0000 7fdc52575700 1 --2- 172.21.15.26:0/1333962531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc4c0f7490 0x7fdc4c0f9920 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:13.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.192+0000 7fdc52575700 1 --2- 172.21.15.26:0/1333962531 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc4c060310 0x7fdc4c0f6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:13.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.192+0000 7fdc52575700 1 -- 172.21.15.26:0/1333962531 >> 172.21.15.26:0/1333962531 conn(0x7fdc4c0f0ba0 msgr2=0x7fdc4c0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:18:13.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.192+0000 7fdc52575700 1 -- 172.21.15.26:0/1333962531 shutdown_connections 2021-11-03T17:18:13.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.192+0000 7fdc52575700 1 -- 172.21.15.26:0/1333962531 wait complete. 2021-11-03T17:18:13.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.192+0000 7fdc52575700 1 Processor -- start 2021-11-03T17:18:13.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.193+0000 7fdc52575700 1 -- start start 2021-11-03T17:18:13.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.193+0000 7fdc52575700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc4c060310 0x7fdc4c10d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:18:13.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.193+0000 7fdc52575700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc4c0f7490 0x7fdc4c10d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:18:13.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.193+0000 7fdc52575700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4c10dda0 con 0x7fdc4c060310 2021-11-03T17:18:13.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.193+0000 7fdc52575700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4c10dee0 con 0x7fdc4c0f7490 2021-11-03T17:18:13.193 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.193+0000 7fdc51573700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc4c060310 0x7fdc4c10d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:18:13.193 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.193+0000 7fdc51573700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc4c060310 0x7fdc4c10d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53622/0 (socket says 172.21.15.26:53622) 2021-11-03T17:18:13.193 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.193+0000 7fdc51573700 1 -- 172.21.15.26:0/3791470504 learned_addr learned my addr 172.21.15.26:0/3791470504 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:18:13.193 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.193+0000 7fdc50d72700 1 --2- 172.21.15.26:0/3791470504 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc4c0f7490 0x7fdc4c10d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:18:13.193 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.193+0000 7fdc51573700 1 -- 172.21.15.26:0/3791470504 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc4c0f7490 msgr2=0x7fdc4c10d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:18:13.194 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.193+0000 7fdc51573700 1 --2- 172.21.15.26:0/3791470504 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc4c0f7490 0x7fdc4c10d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:13.194 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.193+0000 7fdc51573700 1 -- 172.21.15.26:0/3791470504 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc3c005040 con 0x7fdc4c060310 2021-11-03T17:18:13.194 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.193+0000 7fdc51573700 1 --2- 172.21.15.26:0/3791470504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc4c060310 0x7fdc4c10d300 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7fdc4800c530 tx=0x7fdc48007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:18:13.194 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.193+0000 7fdc41ffb700 1 -- 172.21.15.26:0/3791470504 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc4800f650 con 0x7fdc4c060310 2021-11-03T17:18:13.195 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.193+0000 7fdc41ffb700 1 -- 172.21.15.26:0/3791470504 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdc4800fc60 con 0x7fdc4c060310 2021-11-03T17:18:13.195 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.194+0000 7fdc41ffb700 1 -- 172.21.15.26:0/3791470504 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc48012c20 con 0x7fdc4c060310 2021-11-03T17:18:13.195 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.194+0000 7fdc52575700 1 -- 172.21.15.26:0/3791470504 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc4c10e880 con 0x7fdc4c060310 2021-11-03T17:18:13.195 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.194+0000 7fdc52575700 1 -- 172.21.15.26:0/3791470504 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc4c10edf0 con 0x7fdc4c060310 2021-11-03T17:18:13.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.195+0000 7fdc52575700 1 -- 172.21.15.26:0/3791470504 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc4c045ad0 con 0x7fdc4c060310 2021-11-03T17:18:13.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.195+0000 7fdc41ffb700 1 -- 172.21.15.26:0/3791470504 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fdc48010070 con 0x7fdc4c060310 2021-11-03T17:18:13.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.195+0000 7fdc41ffb700 1 --2- 172.21.15.26:0/3791470504 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdc38064100 0x7fdc380665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:18:13.198 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.195+0000 7fdc41ffb700 1 -- 172.21.15.26:0/3791470504 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fdc48080660 con 0x7fdc4c060310 2021-11-03T17:18:13.198 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.196+0000 7fdc50d72700 1 --2- 172.21.15.26:0/3791470504 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdc38064100 0x7fdc380665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:18:13.198 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.196+0000 7fdc50d72700 1 --2- 172.21.15.26:0/3791470504 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdc38064100 0x7fdc380665c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fdc3c004630 tx=0x7fdc3c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:18:13.198 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.200+0000 7fdc41ffb700 1 -- 172.21.15.26:0/3791470504 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fdc480528d0 con 0x7fdc4c060310 2021-11-03T17:18:13.372 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.377+0000 7fdc52575700 1 -- 172.21.15.26:0/3791470504 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdc4c105470 con 0x7fdc38064100 2021-11-03T17:18:13.374 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.378+0000 7fdc41ffb700 1 -- 172.21.15.26:0/3791470504 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fdc4c105470 con 0x7fdc38064100 2021-11-03T17:18:13.377 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.380+0000 7fdc52575700 1 -- 172.21.15.26:0/3791470504 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdc38064100 msgr2=0x7fdc380665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:18:13.378 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.380+0000 7fdc52575700 1 --2- 172.21.15.26:0/3791470504 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdc38064100 0x7fdc380665c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fdc3c004630 tx=0x7fdc3c009b30).stop 2021-11-03T17:18:13.378 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.380+0000 7fdc52575700 1 -- 172.21.15.26:0/3791470504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc4c060310 msgr2=0x7fdc4c10d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:18:13.379 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.380+0000 7fdc52575700 1 --2- 172.21.15.26:0/3791470504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc4c060310 0x7fdc4c10d300 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7fdc4800c530 tx=0x7fdc48007e20).stop 2021-11-03T17:18:13.379 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.380+0000 7fdc52575700 1 -- 172.21.15.26:0/3791470504 shutdown_connections 2021-11-03T17:18:13.379 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.380+0000 7fdc52575700 1 --2- 172.21.15.26:0/3791470504 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdc38064100 0x7fdc380665c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:13.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.380+0000 7fdc52575700 1 --2- 172.21.15.26:0/3791470504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc4c060310 0x7fdc4c10d300 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:13.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.380+0000 7fdc52575700 1 --2- 172.21.15.26:0/3791470504 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc4c0f7490 0x7fdc4c10d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:13.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.380+0000 7fdc52575700 1 -- 172.21.15.26:0/3791470504 >> 172.21.15.26:0/3791470504 conn(0x7fdc4c0f0ba0 msgr2=0x7fdc4c0f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:18:13.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.380+0000 7fdc52575700 1 -- 172.21.15.26:0/3791470504 shutdown_connections 2021-11-03T17:18:13.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.380+0000 7fdc52575700 1 -- 172.21.15.26:0/3791470504 wait complete. 2021-11-03T17:18:13.385 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:18:13.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.480+0000 7f4562898700 1 -- 172.21.15.26:0/2846407686 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f455c0f5710 msgr2=0x7f455c0f5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:18:13.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.480+0000 7f4562898700 1 --2- 172.21.15.26:0/2846407686 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f455c0f5710 0x7f455c0f5b90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f4558004660 tx=0x7f4558009b30).stop 2021-11-03T17:18:13.481 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.480+0000 7f4562898700 1 -- 172.21.15.26:0/2846407686 shutdown_connections 2021-11-03T17:18:13.481 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.480+0000 7f4562898700 1 --2- 172.21.15.26:0/2846407686 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f455c0f5710 0x7f455c0f5b90 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:13.481 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.480+0000 7f4562898700 1 --2- 172.21.15.26:0/2846407686 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f455c0f6a10 0x7f455c0f6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:13.482 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.480+0000 7f4562898700 1 -- 172.21.15.26:0/2846407686 >> 172.21.15.26:0/2846407686 conn(0x7f455c0f0320 msgr2=0x7f455c0f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:18:13.482 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.480+0000 7f4562898700 1 -- 172.21.15.26:0/2846407686 shutdown_connections 2021-11-03T17:18:13.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.480+0000 7f4562898700 1 -- 172.21.15.26:0/2846407686 wait complete. 2021-11-03T17:18:13.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.481+0000 7f4562898700 1 Processor -- start 2021-11-03T17:18:13.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.481+0000 7f4562898700 1 -- start start 2021-11-03T17:18:13.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.481+0000 7f4562898700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f455c0f5710 0x7f455c106e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:18:13.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.481+0000 7f4562898700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f455c0f6a10 0x7f455c107300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:18:13.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.481+0000 7f4562898700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f455c107900 con 0x7f455c0f5710 2021-11-03T17:18:13.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.481+0000 7f4562898700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f455c108110 con 0x7f455c0f6a10 2021-11-03T17:18:13.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.481+0000 7f4561896700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f455c0f5710 0x7f455c106e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:18:13.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.481+0000 7f4561896700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f455c0f5710 0x7f455c106e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53632/0 (socket says 172.21.15.26:53632) 2021-11-03T17:18:13.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.481+0000 7f4561896700 1 -- 172.21.15.26:0/739527090 learned_addr learned my addr 172.21.15.26:0/739527090 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:18:13.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.482+0000 7f4561095700 1 --2- 172.21.15.26:0/739527090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f455c0f6a10 0x7f455c107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:18:13.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.482+0000 7f4561896700 1 -- 172.21.15.26:0/739527090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f455c0f6a10 msgr2=0x7f455c107300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:18:13.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.482+0000 7f4561896700 1 --2- 172.21.15.26:0/739527090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f455c0f6a10 0x7f455c107300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:13.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.482+0000 7f4561896700 1 -- 172.21.15.26:0/739527090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4558005040 con 0x7f455c0f5710 2021-11-03T17:18:13.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.482+0000 7f4561896700 1 --2- 172.21.15.26:0/739527090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f455c0f5710 0x7f455c106e10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f454c002700 tx=0x7f454c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:18:13.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.482+0000 7f45527fc700 1 -- 172.21.15.26:0/739527090 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f454c009320 con 0x7f455c0f5710 2021-11-03T17:18:13.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.482+0000 7f4562898700 1 -- 172.21.15.26:0/739527090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f455c108390 con 0x7f455c0f5710 2021-11-03T17:18:13.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.482+0000 7f45527fc700 1 -- 172.21.15.26:0/739527090 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f454c00f040 con 0x7f455c0f5710 2021-11-03T17:18:13.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.482+0000 7f45527fc700 1 -- 172.21.15.26:0/739527090 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f454c014900 con 0x7f455c0f5710 2021-11-03T17:18:13.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.482+0000 7f4562898700 1 -- 172.21.15.26:0/739527090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f455c108950 con 0x7f455c0f5710 2021-11-03T17:18:13.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.483+0000 7f4562898700 1 -- 172.21.15.26:0/739527090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f455c059100 con 0x7f455c0f5710 2021-11-03T17:18:13.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.484+0000 7f45527fc700 1 -- 172.21.15.26:0/739527090 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f454c009480 con 0x7f455c0f5710 2021-11-03T17:18:13.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.484+0000 7f45527fc700 1 --2- 172.21.15.26:0/739527090 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4548064100 0x7f45480665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:18:13.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.484+0000 7f45527fc700 1 -- 172.21.15.26:0/739527090 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f454c080dd0 con 0x7f455c0f5710 2021-11-03T17:18:13.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.484+0000 7f4561095700 1 --2- 172.21.15.26:0/739527090 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4548064100 0x7f45480665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:18:13.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.484+0000 7f4561095700 1 --2- 172.21.15.26:0/739527090 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4548064100 0x7f45480665c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f4558009da0 tx=0x7f4558009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:18:13.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.487+0000 7f45527fc700 1 -- 172.21.15.26:0/739527090 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f454c0531e0 con 0x7f455c0f5710 2021-11-03T17:18:13.654 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.659+0000 7f4562898700 1 -- 172.21.15.26:0/739527090 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f455c0f4d10 con 0x7f4548064100 2021-11-03T17:18:13.669 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.673+0000 7f45527fc700 1 -- 172.21.15.26:0/739527090 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f455c0f4d10 con 0x7f4548064100 2021-11-03T17:18:13.669 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:18:13.670 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (29m) 9m ago 30m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:18:13.670 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (21m) 9m ago 30m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:18:13.670 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (21m) 8m ago 29m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:18:13.671 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (29m) 9m ago 30m 39.5M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:18:13.671 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (22m) 9m ago 25m 16.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:18:13.672 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (22m) 9m ago 25m 17.8M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:18:13.672 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (25m) 8m ago 25m 19.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:18:13.673 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (25m) 8m ago 25m 19.4M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:18:13.673 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (23m) 9m ago 32m 491M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:18:13.673 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (22m) 8m ago 29m 415M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:18:13.674 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (22m) 9m ago 32m 113M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:18:13.674 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (22m) 8m ago 29m 70.2M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:18:13.675 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (30m) 9m ago 30m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:18:13.675 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (29m) 8m ago 29m 18.4M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:18:13.676 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (21m) 9m ago 29m 190M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:18:13.676 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (20m) 9m ago 28m 204M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:18:13.677 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (20m) 9m ago 28m 170M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:18:13.677 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (19m) 8m ago 28m 211M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:18:13.677 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (19m) 8m ago 27m 189M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:18:13.678 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (18m) 8m ago 27m 174M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:18:13.678 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (29m) 9m ago 30m 49.9M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:18:13.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.675+0000 7f4562898700 1 -- 172.21.15.26:0/739527090 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4548064100 msgr2=0x7f45480665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:18:13.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.675+0000 7f4562898700 1 --2- 172.21.15.26:0/739527090 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4548064100 0x7f45480665c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f4558009da0 tx=0x7f4558009b30).stop 2021-11-03T17:18:13.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.675+0000 7f4562898700 1 -- 172.21.15.26:0/739527090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f455c0f5710 msgr2=0x7f455c106e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:18:13.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.675+0000 7f4562898700 1 --2- 172.21.15.26:0/739527090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f455c0f5710 0x7f455c106e10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f454c002700 tx=0x7f454c009d80).stop 2021-11-03T17:18:13.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.675+0000 7f4562898700 1 -- 172.21.15.26:0/739527090 shutdown_connections 2021-11-03T17:18:13.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.675+0000 7f4562898700 1 --2- 172.21.15.26:0/739527090 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4548064100 0x7f45480665c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:13.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.675+0000 7f4562898700 1 --2- 172.21.15.26:0/739527090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f455c0f5710 0x7f455c106e10 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:13.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.675+0000 7f4562898700 1 --2- 172.21.15.26:0/739527090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f455c0f6a10 0x7f455c107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:13.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.675+0000 7f4562898700 1 -- 172.21.15.26:0/739527090 >> 172.21.15.26:0/739527090 conn(0x7f455c0f0320 msgr2=0x7f455c0f4600 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:18:13.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.675+0000 7f4562898700 1 -- 172.21.15.26:0/739527090 shutdown_connections 2021-11-03T17:18:13.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.675+0000 7f4562898700 1 -- 172.21.15.26:0/739527090 wait complete. 2021-11-03T17:18:13.774 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.774+0000 7f4303586700 1 -- 172.21.15.26:0/3266071333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42fc0f6530 msgr2=0x7f42fc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:18:13.774 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.774+0000 7f4303586700 1 --2- 172.21.15.26:0/3266071333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42fc0f6530 0x7f42fc0f6950 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f42f8004660 tx=0x7f42f8009b30).stop 2021-11-03T17:18:13.775 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.774+0000 7f4303586700 1 -- 172.21.15.26:0/3266071333 shutdown_connections 2021-11-03T17:18:13.775 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.774+0000 7f4303586700 1 --2- 172.21.15.26:0/3266071333 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42fc0f77d0 0x7f42fc0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:13.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.774+0000 7f4303586700 1 --2- 172.21.15.26:0/3266071333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42fc0f6530 0x7f42fc0f6950 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:13.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.774+0000 7f4303586700 1 -- 172.21.15.26:0/3266071333 >> 172.21.15.26:0/3266071333 conn(0x7f42fc0f1cd0 msgr2=0x7f42fc0f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:18:13.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.774+0000 7f4303586700 1 -- 172.21.15.26:0/3266071333 shutdown_connections 2021-11-03T17:18:13.777 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.775+0000 7f4303586700 1 -- 172.21.15.26:0/3266071333 wait complete. 2021-11-03T17:18:13.777 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.775+0000 7f4303586700 1 Processor -- start 2021-11-03T17:18:13.778 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.775+0000 7f4303586700 1 -- start start 2021-11-03T17:18:13.778 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.775+0000 7f4303586700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42fc0f6530 0x7f42fc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:18:13.779 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.775+0000 7f4303586700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42fc0f77d0 0x7f42fc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:18:13.779 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.775+0000 7f4303586700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42fc06a380 con 0x7f42fc0f6530 2021-11-03T17:18:13.779 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.775+0000 7f4303586700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42fc06a4c0 con 0x7f42fc0f77d0 2021-11-03T17:18:13.780 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.775+0000 7f4302584700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42fc0f6530 0x7f42fc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:18:13.780 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.775+0000 7f4302584700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42fc0f6530 0x7f42fc06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53644/0 (socket says 172.21.15.26:53644) 2021-11-03T17:18:13.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.775+0000 7f4302584700 1 -- 172.21.15.26:0/1800845601 learned_addr learned my addr 172.21.15.26:0/1800845601 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:18:13.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.776+0000 7f4301d83700 1 --2- 172.21.15.26:0/1800845601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42fc0f77d0 0x7f42fc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:18:13.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.776+0000 7f4302584700 1 -- 172.21.15.26:0/1800845601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42fc0f77d0 msgr2=0x7f42fc069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:18:13.782 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.776+0000 7f4302584700 1 --2- 172.21.15.26:0/1800845601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42fc0f77d0 0x7f42fc069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:13.782 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.776+0000 7f4302584700 1 -- 172.21.15.26:0/1800845601 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f8005040 con 0x7f42fc0f6530 2021-11-03T17:18:13.783 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.776+0000 7f4302584700 1 --2- 172.21.15.26:0/1800845601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42fc0f6530 0x7f42fc06b9a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f42f8013a70 tx=0x7f42f8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:18:13.783 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.776+0000 7f42f2ffd700 1 -- 172.21.15.26:0/1800845601 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42f8018070 con 0x7f42fc0f6530 2021-11-03T17:18:13.783 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.776+0000 7f42f2ffd700 1 -- 172.21.15.26:0/1800845601 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f42f80097d0 con 0x7f42fc0f6530 2021-11-03T17:18:13.784 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.776+0000 7f42f2ffd700 1 -- 172.21.15.26:0/1800845601 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42f801c3c0 con 0x7f42fc0f6530 2021-11-03T17:18:13.784 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.776+0000 7f4303586700 1 -- 172.21.15.26:0/1800845601 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42fc06a740 con 0x7f42fc0f6530 2021-11-03T17:18:13.784 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.776+0000 7f4303586700 1 -- 172.21.15.26:0/1800845601 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42fc06aca0 con 0x7f42fc0f6530 2021-11-03T17:18:13.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.777+0000 7f4303586700 1 -- 172.21.15.26:0/1800845601 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42fc045ad0 con 0x7f42fc0f6530 2021-11-03T17:18:13.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.777+0000 7f42f2ffd700 1 -- 172.21.15.26:0/1800845601 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f42f8007ba0 con 0x7f42fc0f6530 2021-11-03T17:18:13.786 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.778+0000 7f42f2ffd700 1 --2- 172.21.15.26:0/1800845601 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f42e8064100 0x7f42e80665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:18:13.786 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.778+0000 7f42f2ffd700 1 -- 172.21.15.26:0/1800845601 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f42f80824b0 con 0x7f42fc0f6530 2021-11-03T17:18:13.786 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.778+0000 7f4301d83700 1 --2- 172.21.15.26:0/1800845601 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f42e8064100 0x7f42e80665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:18:13.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.778+0000 7f4301d83700 1 --2- 172.21.15.26:0/1800845601 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f42e8064100 0x7f42e80665c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f42ec009760 tx=0x7f42ec009c60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:18:13.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:13.782+0000 7f42f2ffd700 1 -- 172.21.15.26:0/1800845601 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f42f8054810 con 0x7f42fc0f6530 2021-11-03T17:18:14.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.015+0000 7f4303586700 1 -- 172.21.15.26:0/1800845601 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f42fc0586e0 con 0x7f42fc0f6530 2021-11-03T17:18:14.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.015+0000 7f42f2ffd700 1 -- 172.21.15.26:0/1800845601 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f42f8054400 con 0x7f42fc0f6530 2021-11-03T17:18:14.011 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:18:14.012 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:18:14.012 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:18:14.012 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:18:14.013 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:18:14.014 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:18:14.014 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:18:14.015 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:18:14.015 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:18:14.015 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:18:14.016 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:18:14.016 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:18:14.016 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:18:14.017 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:18:14.017 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:18:14.018 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:18:14.018 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:18:14.019 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:18:14.021 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.017+0000 7f4303586700 1 -- 172.21.15.26:0/1800845601 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f42e8064100 msgr2=0x7f42e80665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:18:14.022 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.017+0000 7f4303586700 1 --2- 172.21.15.26:0/1800845601 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f42e8064100 0x7f42e80665c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f42ec009760 tx=0x7f42ec009c60).stop 2021-11-03T17:18:14.022 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.017+0000 7f4303586700 1 -- 172.21.15.26:0/1800845601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42fc0f6530 msgr2=0x7f42fc06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:18:14.022 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.017+0000 7f4303586700 1 --2- 172.21.15.26:0/1800845601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42fc0f6530 0x7f42fc06b9a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f42f8013a70 tx=0x7f42f8009b30).stop 2021-11-03T17:18:14.022 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.017+0000 7f4303586700 1 -- 172.21.15.26:0/1800845601 shutdown_connections 2021-11-03T17:18:14.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.017+0000 7f4303586700 1 --2- 172.21.15.26:0/1800845601 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f42e8064100 0x7f42e80665c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:14.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.017+0000 7f4303586700 1 --2- 172.21.15.26:0/1800845601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42fc0f6530 0x7f42fc06b9a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:14.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.017+0000 7f4303586700 1 --2- 172.21.15.26:0/1800845601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42fc0f77d0 0x7f42fc069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:14.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.017+0000 7f4303586700 1 -- 172.21.15.26:0/1800845601 >> 172.21.15.26:0/1800845601 conn(0x7f42fc0f1cd0 msgr2=0x7f42fc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:18:14.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.018+0000 7f4303586700 1 -- 172.21.15.26:0/1800845601 shutdown_connections 2021-11-03T17:18:14.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.018+0000 7f4303586700 1 -- 172.21.15.26:0/1800845601 wait complete. 2021-11-03T17:18:14.117 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.118+0000 7f01780e3700 1 -- 172.21.15.26:0/1262151845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01700f66e0 msgr2=0x7f01700f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:18:14.118 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.118+0000 7f01780e3700 1 --2- 172.21.15.26:0/1262151845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01700f66e0 0x7f01700f6b00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f0160004660 tx=0x7f0160009b30).stop 2021-11-03T17:18:14.118 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.118+0000 7f01780e3700 1 -- 172.21.15.26:0/1262151845 shutdown_connections 2021-11-03T17:18:14.118 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.118+0000 7f01780e3700 1 --2- 172.21.15.26:0/1262151845 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01700f6ff0 0x7f01700f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:14.119 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.118+0000 7f01780e3700 1 --2- 172.21.15.26:0/1262151845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01700f66e0 0x7f01700f6b00 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:14.119 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.118+0000 7f01780e3700 1 -- 172.21.15.26:0/1262151845 >> 172.21.15.26:0/1262151845 conn(0x7f01700f1f00 msgr2=0x7f01700f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:18:14.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.118+0000 7f01780e3700 1 -- 172.21.15.26:0/1262151845 shutdown_connections 2021-11-03T17:18:14.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.118+0000 7f01780e3700 1 -- 172.21.15.26:0/1262151845 wait complete. 2021-11-03T17:18:14.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.118+0000 7f01780e3700 1 Processor -- start 2021-11-03T17:18:14.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.119+0000 7f01780e3700 1 -- start start 2021-11-03T17:18:14.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.119+0000 7f01780e3700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01700f66e0 0x7f017006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:18:14.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.119+0000 7f01780e3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01700f6ff0 0x7f0170069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:18:14.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.119+0000 7f01780e3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017006a380 con 0x7f01700f6ff0 2021-11-03T17:18:14.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.119+0000 7f01780e3700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017006a4c0 con 0x7f01700f66e0 2021-11-03T17:18:14.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.119+0000 7f017567e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01700f6ff0 0x7f0170069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:18:14.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.119+0000 7f017567e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01700f6ff0 0x7f0170069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53656/0 (socket says 172.21.15.26:53656) 2021-11-03T17:18:14.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.119+0000 7f017567e700 1 -- 172.21.15.26:0/3854481468 learned_addr learned my addr 172.21.15.26:0/3854481468 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:18:14.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.119+0000 7f0175e7f700 1 --2- 172.21.15.26:0/3854481468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01700f66e0 0x7f017006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:18:14.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.119+0000 7f017567e700 1 -- 172.21.15.26:0/3854481468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01700f66e0 msgr2=0x7f017006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:18:14.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.119+0000 7f017567e700 1 --2- 172.21.15.26:0/3854481468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01700f66e0 0x7f017006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:14.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.119+0000 7f017567e700 1 -- 172.21.15.26:0/3854481468 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0160005040 con 0x7f01700f6ff0 2021-11-03T17:18:14.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.119+0000 7f0175e7f700 1 --2- 172.21.15.26:0/3854481468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01700f66e0 0x7f017006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:18:14.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.119+0000 7f017567e700 1 --2- 172.21.15.26:0/3854481468 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01700f6ff0 0x7f0170069e20 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f016c00c530 tx=0x7f016c007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:18:14.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.119+0000 7f01667fc700 1 -- 172.21.15.26:0/3854481468 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f016c00f650 con 0x7f01700f6ff0 2021-11-03T17:18:14.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.119+0000 7f01667fc700 1 -- 172.21.15.26:0/3854481468 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f016c00fc60 con 0x7f01700f6ff0 2021-11-03T17:18:14.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.119+0000 7f01780e3700 1 -- 172.21.15.26:0/3854481468 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f017006a7a0 con 0x7f01700f6ff0 2021-11-03T17:18:14.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.120+0000 7f01667fc700 1 -- 172.21.15.26:0/3854481468 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f016c012cd0 con 0x7f01700f6ff0 2021-11-03T17:18:14.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.120+0000 7f01780e3700 1 -- 172.21.15.26:0/3854481468 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f017010ef90 con 0x7f01700f6ff0 2021-11-03T17:18:14.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.120+0000 7f01780e3700 1 -- 172.21.15.26:0/3854481468 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0170045ad0 con 0x7f01700f6ff0 2021-11-03T17:18:14.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.121+0000 7f01667fc700 1 -- 172.21.15.26:0/3854481468 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f016c010070 con 0x7f01700f6ff0 2021-11-03T17:18:14.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.121+0000 7f01667fc700 1 --2- 172.21.15.26:0/3854481468 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f015c0640b0 0x7f015c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:18:14.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.121+0000 7f01667fc700 1 -- 172.21.15.26:0/3854481468 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f016c0806e0 con 0x7f01700f6ff0 2021-11-03T17:18:14.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.121+0000 7f0175e7f700 1 --2- 172.21.15.26:0/3854481468 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f015c0640b0 0x7f015c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:18:14.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.122+0000 7f0175e7f700 1 --2- 172.21.15.26:0/3854481468 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f015c0640b0 0x7f015c066570 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f0160004e30 tx=0x7f0160009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:18:14.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.126+0000 7f01667fc700 1 -- 172.21.15.26:0/3854481468 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f016c052950 con 0x7f01700f6ff0 2021-11-03T17:18:14.327 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.332+0000 7f01780e3700 1 -- 172.21.15.26:0/3854481468 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0170027a00 con 0x7f01700f6ff0 2021-11-03T17:18:14.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.332+0000 7f01667fc700 1 -- 172.21.15.26:0/3854481468 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f016c052540 con 0x7f01700f6ff0 2021-11-03T17:18:14.328 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:18:14.329 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:18:14.329 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:18:14.329 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:18:14.329 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:18:14.330 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:18:14.330 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:18:14.330 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:18:14.331 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:18:14.331 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:18:14.331 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:18:14.332 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:18:14.332 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:18:14.332 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:18:14.332 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:18:14.333 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:18:14.333 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:18:14.333 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:18:14.333 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:18:14.334 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:18:14.334 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:18:14.334 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:18:14.334 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:18:14.335 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:18:14.335 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:18:14.335 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:18:14.335 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:18:14.336 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:18:14.336 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:18:14.336 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:18:14.336 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:18:14.336 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:18:14.337 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:18:14.337 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:18:14.337 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:18:14.337 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:18:14.338 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:18:14.338 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:18:14.338 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:18:14.339 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.334+0000 7f01780e3700 1 -- 172.21.15.26:0/3854481468 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f015c0640b0 msgr2=0x7f015c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:18:14.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.334+0000 7f01780e3700 1 --2- 172.21.15.26:0/3854481468 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f015c0640b0 0x7f015c066570 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f0160004e30 tx=0x7f0160009b30).stop 2021-11-03T17:18:14.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.334+0000 7f01780e3700 1 -- 172.21.15.26:0/3854481468 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01700f6ff0 msgr2=0x7f0170069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:18:14.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.334+0000 7f01780e3700 1 --2- 172.21.15.26:0/3854481468 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01700f6ff0 0x7f0170069e20 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f016c00c530 tx=0x7f016c007e20).stop 2021-11-03T17:18:14.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.334+0000 7f01780e3700 1 -- 172.21.15.26:0/3854481468 shutdown_connections 2021-11-03T17:18:14.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.334+0000 7f01780e3700 1 --2- 172.21.15.26:0/3854481468 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f015c0640b0 0x7f015c066570 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:14.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.334+0000 7f01780e3700 1 --2- 172.21.15.26:0/3854481468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01700f66e0 0x7f017006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:14.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.334+0000 7f01780e3700 1 --2- 172.21.15.26:0/3854481468 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01700f6ff0 0x7f0170069e20 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:14.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.334+0000 7f01780e3700 1 -- 172.21.15.26:0/3854481468 >> 172.21.15.26:0/3854481468 conn(0x7f01700f1f00 msgr2=0x7f01700fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:18:14.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.334+0000 7f01780e3700 1 -- 172.21.15.26:0/3854481468 shutdown_connections 2021-11-03T17:18:14.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:14.334+0000 7f01780e3700 1 -- 172.21.15.26:0/3854481468 wait complete. 2021-11-03T17:18:14.343 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:18:14.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:14 smithi026 ceph-mon[96795]: pgmap v707: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:14.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:14 smithi026 ceph-mon[96795]: from='client.34876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:18:14.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:14 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1800845601' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:18:14.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:14 smithi194 ceph-mon[65619]: pgmap v707: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:14.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:14 smithi194 ceph-mon[65619]: from='client.34876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:18:14.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:14 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1800845601' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:18:15.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:15 smithi026 ceph-mon[96795]: from='client.34880 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:18:15.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:15 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3854481468' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:18:15.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:15 smithi194 ceph-mon[65619]: from='client.34880 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:18:15.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:15 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3854481468' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:18:16.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:16 smithi026 ceph-mon[96795]: pgmap v708: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:16.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:16 smithi194 ceph-mon[65619]: pgmap v708: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:18.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:18 smithi026 ceph-mon[96795]: pgmap v709: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:18.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:18 smithi194 ceph-mon[65619]: pgmap v709: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:20.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:20 smithi026 ceph-mon[96795]: pgmap v710: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:20.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:20 smithi194 ceph-mon[65619]: pgmap v710: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:22.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:22 smithi026 ceph-mon[96795]: pgmap v711: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:22.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:22 smithi194 ceph-mon[65619]: pgmap v711: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:24.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:24 smithi026 ceph-mon[96795]: pgmap v712: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:24.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:24 smithi194 ceph-mon[65619]: pgmap v712: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:26.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:26 smithi026 ceph-mon[96795]: pgmap v713: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:26.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:26 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:18:26.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:26 smithi194 ceph-mon[65619]: pgmap v713: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:26.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:26 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:18:27.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:27 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:18:27.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:27 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:18:28.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:28 smithi026 ceph-mon[96795]: pgmap v714: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:28.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:28 smithi194 ceph-mon[65619]: pgmap v714: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:30.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:30 smithi026 ceph-mon[96795]: pgmap v715: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:30.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:30 smithi194 ceph-mon[65619]: pgmap v715: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:32.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:32 smithi026 ceph-mon[96795]: pgmap v716: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:32.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:32 smithi194 ceph-mon[65619]: pgmap v716: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:34.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:34 smithi026 ceph-mon[96795]: pgmap v717: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:34.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:34 smithi194 ceph-mon[65619]: pgmap v717: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:36.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:36 smithi026 ceph-mon[96795]: pgmap v718: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:36.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:36 smithi194 ceph-mon[65619]: pgmap v718: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:38.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:38 smithi026 ceph-mon[96795]: pgmap v719: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:38.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:38 smithi194 ceph-mon[65619]: pgmap v719: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:40.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:40 smithi026 ceph-mon[96795]: pgmap v720: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:40.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:40 smithi194 ceph-mon[65619]: pgmap v720: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:41.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:18:41.441 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:18:42.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:42 smithi194 ceph-mon[65619]: pgmap v721: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:42.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:42 smithi194 ceph-mon[65619]: poll took 60083.841 ms: 1 events 2021-11-03T17:18:42.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:18:42.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:42 smithi026 ceph-mon[96795]: pgmap v721: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:42.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:42 smithi026 ceph-mon[96795]: poll took 60083.841 ms: 1 events 2021-11-03T17:18:42.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:18:44.451 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.454+0000 7faac759e700 1 -- 172.21.15.26:0/185685628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac80fba40 msgr2=0x7faac80fde30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:18:44.451 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.454+0000 7faac759e700 1 --2- 172.21.15.26:0/185685628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac80fba40 0x7faac80fde30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7faabc004660 tx=0x7faabc009b30).stop 2021-11-03T17:18:44.452 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.455+0000 7faac759e700 1 -- 172.21.15.26:0/185685628 shutdown_connections 2021-11-03T17:18:44.452 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.455+0000 7faac759e700 1 --2- 172.21.15.26:0/185685628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac80fba40 0x7faac80fde30 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:44.452 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.455+0000 7faac759e700 1 --2- 172.21.15.26:0/185685628 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faac80602d0 0x7faac80fb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:44.452 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.455+0000 7faac759e700 1 -- 172.21.15.26:0/185685628 >> 172.21.15.26:0/185685628 conn(0x7faac80f0b90 msgr2=0x7faac80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:18:44.453 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.455+0000 7faac759e700 1 -- 172.21.15.26:0/185685628 shutdown_connections 2021-11-03T17:18:44.453 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.455+0000 7faac759e700 1 -- 172.21.15.26:0/185685628 wait complete. 2021-11-03T17:18:44.453 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.455+0000 7faac759e700 1 Processor -- start 2021-11-03T17:18:44.453 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.455+0000 7faac759e700 1 -- start start 2021-11-03T17:18:44.453 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.455+0000 7faac759e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faac80602d0 0x7faac8108f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:18:44.454 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.455+0000 7faac759e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac80fba40 0x7faac8109440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:18:44.454 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.455+0000 7faac759e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac81099f0 con 0x7faac80fba40 2021-11-03T17:18:44.454 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.455+0000 7faac759e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac8109b30 con 0x7faac80602d0 2021-11-03T17:18:44.454 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.455+0000 7faac5d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac80fba40 0x7faac8109440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:18:44.455 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.455+0000 7faac5d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac80fba40 0x7faac8109440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53674/0 (socket says 172.21.15.26:53674) 2021-11-03T17:18:44.455 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.456+0000 7faac5d9b700 1 -- 172.21.15.26:0/463585597 learned_addr learned my addr 172.21.15.26:0/463585597 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:18:44.455 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.456+0000 7faac659c700 1 --2- 172.21.15.26:0/463585597 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faac80602d0 0x7faac8108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:18:44.455 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.456+0000 7faac5d9b700 1 -- 172.21.15.26:0/463585597 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faac80602d0 msgr2=0x7faac8108f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:18:44.455 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.456+0000 7faac5d9b700 1 --2- 172.21.15.26:0/463585597 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faac80602d0 0x7faac8108f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:44.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.456+0000 7faac5d9b700 1 -- 172.21.15.26:0/463585597 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faabc005040 con 0x7faac80fba40 2021-11-03T17:18:44.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.456+0000 7faac5d9b700 1 --2- 172.21.15.26:0/463585597 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac80fba40 0x7faac8109440 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7faabc013a70 tx=0x7faabc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:18:44.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.456+0000 7faab6ffd700 1 -- 172.21.15.26:0/463585597 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faabc018070 con 0x7faac80fba40 2021-11-03T17:18:44.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.456+0000 7faab6ffd700 1 -- 172.21.15.26:0/463585597 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7faabc0097d0 con 0x7faac80fba40 2021-11-03T17:18:44.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.456+0000 7faab6ffd700 1 -- 172.21.15.26:0/463585597 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faabc01de80 con 0x7faac80fba40 2021-11-03T17:18:44.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.456+0000 7faac759e700 1 -- 172.21.15.26:0/463585597 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faac810a470 con 0x7faac80fba40 2021-11-03T17:18:44.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.456+0000 7faac759e700 1 -- 172.21.15.26:0/463585597 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac810a9d0 con 0x7faac80fba40 2021-11-03T17:18:44.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.457+0000 7faac759e700 1 -- 172.21.15.26:0/463585597 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faac8045ad0 con 0x7faac80fba40 2021-11-03T17:18:44.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.458+0000 7faab6ffd700 1 -- 172.21.15.26:0/463585597 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7faabc007ba0 con 0x7faac80fba40 2021-11-03T17:18:44.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.458+0000 7faab6ffd700 1 --2- 172.21.15.26:0/463585597 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faab0064100 0x7faab00665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:18:44.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.458+0000 7faab6ffd700 1 -- 172.21.15.26:0/463585597 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7faabc0823d0 con 0x7faac80fba40 2021-11-03T17:18:44.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.458+0000 7faac659c700 1 --2- 172.21.15.26:0/463585597 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faab0064100 0x7faab00665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:18:44.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.459+0000 7faac659c700 1 --2- 172.21.15.26:0/463585597 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faab0064100 0x7faab00665c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7faab8004c40 tx=0x7faab800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:18:44.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.463+0000 7faab6ffd700 1 -- 172.21.15.26:0/463585597 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7faabc0547f0 con 0x7faac80fba40 2021-11-03T17:18:44.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:44 smithi194 ceph-mon[65619]: pgmap v722: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:44.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.647+0000 7faac759e700 1 -- 172.21.15.26:0/463585597 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faac810abf0 con 0x7faab0064100 2021-11-03T17:18:44.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.649+0000 7faab6ffd700 1 -- 172.21.15.26:0/463585597 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7faac810abf0 con 0x7faab0064100 2021-11-03T17:18:44.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.650+0000 7faac759e700 1 -- 172.21.15.26:0/463585597 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faab0064100 msgr2=0x7faab00665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:18:44.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.650+0000 7faac759e700 1 --2- 172.21.15.26:0/463585597 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faab0064100 0x7faab00665c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7faab8004c40 tx=0x7faab800b040).stop 2021-11-03T17:18:44.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.650+0000 7faac759e700 1 -- 172.21.15.26:0/463585597 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac80fba40 msgr2=0x7faac8109440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:18:44.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.650+0000 7faac759e700 1 --2- 172.21.15.26:0/463585597 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac80fba40 0x7faac8109440 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7faabc013a70 tx=0x7faabc009b30).stop 2021-11-03T17:18:44.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.650+0000 7faac759e700 1 -- 172.21.15.26:0/463585597 shutdown_connections 2021-11-03T17:18:44.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.650+0000 7faac759e700 1 --2- 172.21.15.26:0/463585597 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faab0064100 0x7faab00665c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:44.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.650+0000 7faac759e700 1 --2- 172.21.15.26:0/463585597 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faac80602d0 0x7faac8108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:44.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.650+0000 7faac759e700 1 --2- 172.21.15.26:0/463585597 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac80fba40 0x7faac8109440 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:44.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.651+0000 7faac759e700 1 -- 172.21.15.26:0/463585597 >> 172.21.15.26:0/463585597 conn(0x7faac80f0b90 msgr2=0x7faac80f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:18:44.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.651+0000 7faac759e700 1 -- 172.21.15.26:0/463585597 shutdown_connections 2021-11-03T17:18:44.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.651+0000 7faac759e700 1 -- 172.21.15.26:0/463585597 wait complete. 2021-11-03T17:18:44.655 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:18:44.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:44 smithi026 ceph-mon[96795]: pgmap v722: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:44.748 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.751+0000 7fdd7b59e700 1 -- 172.21.15.26:0/1377525298 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd7c0f77d0 msgr2=0x7fdd7c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:18:44.748 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.751+0000 7fdd7b59e700 1 --2- 172.21.15.26:0/1377525298 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd7c0f77d0 0x7fdd7c0f7c30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7fdd70004660 tx=0x7fdd70009b30).stop 2021-11-03T17:18:44.748 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.752+0000 7fdd7b59e700 1 -- 172.21.15.26:0/1377525298 shutdown_connections 2021-11-03T17:18:44.748 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.752+0000 7fdd7b59e700 1 --2- 172.21.15.26:0/1377525298 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd7c0f77d0 0x7fdd7c0f7c30 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:44.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.752+0000 7fdd7b59e700 1 --2- 172.21.15.26:0/1377525298 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd7c0f6530 0x7fdd7c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:44.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.752+0000 7fdd7b59e700 1 -- 172.21.15.26:0/1377525298 >> 172.21.15.26:0/1377525298 conn(0x7fdd7c0f1c90 msgr2=0x7fdd7c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:18:44.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.752+0000 7fdd7b59e700 1 -- 172.21.15.26:0/1377525298 shutdown_connections 2021-11-03T17:18:44.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.752+0000 7fdd7b59e700 1 -- 172.21.15.26:0/1377525298 wait complete. 2021-11-03T17:18:44.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.752+0000 7fdd7b59e700 1 Processor -- start 2021-11-03T17:18:44.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.752+0000 7fdd7b59e700 1 -- start start 2021-11-03T17:18:44.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.752+0000 7fdd7b59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd7c0f6530 0x7fdd7c106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:18:44.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.752+0000 7fdd7b59e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd7c0f77d0 0x7fdd7c107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:18:44.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.752+0000 7fdd7b59e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7c107880 con 0x7fdd7c0f6530 2021-11-03T17:18:44.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.752+0000 7fdd7b59e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7c108090 con 0x7fdd7c0f77d0 2021-11-03T17:18:44.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.752+0000 7fdd7a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd7c0f6530 0x7fdd7c106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:18:44.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.752+0000 7fdd7a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd7c0f6530 0x7fdd7c106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53682/0 (socket says 172.21.15.26:53682) 2021-11-03T17:18:44.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.752+0000 7fdd7a59c700 1 -- 172.21.15.26:0/200719348 learned_addr learned my addr 172.21.15.26:0/200719348 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:18:44.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.752+0000 7fdd79d9b700 1 --2- 172.21.15.26:0/200719348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd7c0f77d0 0x7fdd7c107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:18:44.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.753+0000 7fdd7a59c700 1 -- 172.21.15.26:0/200719348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd7c0f77d0 msgr2=0x7fdd7c107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:18:44.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.753+0000 7fdd7a59c700 1 --2- 172.21.15.26:0/200719348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd7c0f77d0 0x7fdd7c107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:44.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.753+0000 7fdd7a59c700 1 -- 172.21.15.26:0/200719348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd70005040 con 0x7fdd7c0f6530 2021-11-03T17:18:44.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.753+0000 7fdd7a59c700 1 --2- 172.21.15.26:0/200719348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd7c0f6530 0x7fdd7c106d90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7fdd6c002700 tx=0x7fdd6c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:18:44.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.753+0000 7fdd6affd700 1 -- 172.21.15.26:0/200719348 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd6c0079c0 con 0x7fdd7c0f6530 2021-11-03T17:18:44.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.753+0000 7fdd6affd700 1 -- 172.21.15.26:0/200719348 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdd6c00f040 con 0x7fdd7c0f6530 2021-11-03T17:18:44.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.753+0000 7fdd7b59e700 1 -- 172.21.15.26:0/200719348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd7c108310 con 0x7fdd7c0f6530 2021-11-03T17:18:44.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.753+0000 7fdd6affd700 1 -- 172.21.15.26:0/200719348 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd6c014860 con 0x7fdd7c0f6530 2021-11-03T17:18:44.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.753+0000 7fdd7b59e700 1 -- 172.21.15.26:0/200719348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd7c1088d0 con 0x7fdd7c0f6530 2021-11-03T17:18:44.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.754+0000 7fdd7b59e700 1 -- 172.21.15.26:0/200719348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd7c059100 con 0x7fdd7c0f6530 2021-11-03T17:18:44.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.755+0000 7fdd6affd700 1 -- 172.21.15.26:0/200719348 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fdd6c01b060 con 0x7fdd7c0f6530 2021-11-03T17:18:44.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.755+0000 7fdd6affd700 1 --2- 172.21.15.26:0/200719348 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdd64064100 0x7fdd640665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:18:44.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.756+0000 7fdd6affd700 1 -- 172.21.15.26:0/200719348 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fdd6c0807a0 con 0x7fdd7c0f6530 2021-11-03T17:18:44.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.756+0000 7fdd79d9b700 1 --2- 172.21.15.26:0/200719348 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdd64064100 0x7fdd640665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:18:44.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.756+0000 7fdd79d9b700 1 --2- 172.21.15.26:0/200719348 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdd64064100 0x7fdd640665c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fdd70004630 tx=0x7fdd70009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:18:44.757 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.759+0000 7fdd6affd700 1 -- 172.21.15.26:0/200719348 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fdd6c052b80 con 0x7fdd7c0f6530 2021-11-03T17:18:44.932 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.938+0000 7fdd7b59e700 1 -- 172.21.15.26:0/200719348 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdd7c0fee70 con 0x7fdd64064100 2021-11-03T17:18:44.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.952+0000 7fdd6affd700 1 -- 172.21.15.26:0/200719348 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fdd7c0fee70 con 0x7fdd64064100 2021-11-03T17:18:44.946 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:18:44.947 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (29m) 10m ago 31m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:18:44.947 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (22m) 10m ago 31m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:18:44.947 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (22m) 9m ago 30m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:18:44.947 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (29m) 10m ago 30m 39.5M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:18:44.948 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (22m) 10m ago 26m 16.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:18:44.948 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (23m) 10m ago 26m 17.8M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:18:44.948 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (26m) 9m ago 26m 19.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:18:44.949 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (26m) 9m ago 26m 19.4M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:18:44.949 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (23m) 10m ago 32m 491M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:18:44.949 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (23m) 9m ago 30m 415M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:18:44.949 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (23m) 10m ago 32m 113M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:18:44.950 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (22m) 9m ago 30m 70.2M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:18:44.950 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (30m) 10m ago 30m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:18:44.950 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (30m) 9m ago 30m 18.4M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:18:44.950 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (21m) 10m ago 29m 190M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:18:44.950 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (21m) 10m ago 29m 204M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:18:44.951 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (20m) 10m ago 28m 170M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:18:44.951 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (20m) 9m ago 28m 211M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:18:44.951 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (19m) 9m ago 28m 189M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:18:44.951 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (19m) 9m ago 27m 174M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:18:44.952 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (29m) 10m ago 30m 49.9M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:18:44.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.954+0000 7fdd7b59e700 1 -- 172.21.15.26:0/200719348 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdd64064100 msgr2=0x7fdd640665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:18:44.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.954+0000 7fdd7b59e700 1 --2- 172.21.15.26:0/200719348 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdd64064100 0x7fdd640665c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fdd70004630 tx=0x7fdd70009b30).stop 2021-11-03T17:18:44.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.954+0000 7fdd7b59e700 1 -- 172.21.15.26:0/200719348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd7c0f6530 msgr2=0x7fdd7c106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:18:44.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.954+0000 7fdd7b59e700 1 --2- 172.21.15.26:0/200719348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd7c0f6530 0x7fdd7c106d90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7fdd6c002700 tx=0x7fdd6c009d80).stop 2021-11-03T17:18:44.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.954+0000 7fdd7b59e700 1 -- 172.21.15.26:0/200719348 shutdown_connections 2021-11-03T17:18:44.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.954+0000 7fdd7b59e700 1 --2- 172.21.15.26:0/200719348 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdd64064100 0x7fdd640665c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:44.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.954+0000 7fdd7b59e700 1 --2- 172.21.15.26:0/200719348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd7c0f6530 0x7fdd7c106d90 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:44.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.954+0000 7fdd7b59e700 1 --2- 172.21.15.26:0/200719348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd7c0f77d0 0x7fdd7c107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:44.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.954+0000 7fdd7b59e700 1 -- 172.21.15.26:0/200719348 >> 172.21.15.26:0/200719348 conn(0x7fdd7c0f1c90 msgr2=0x7fdd7c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:18:44.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.954+0000 7fdd7b59e700 1 -- 172.21.15.26:0/200719348 shutdown_connections 2021-11-03T17:18:44.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:44.954+0000 7fdd7b59e700 1 -- 172.21.15.26:0/200719348 wait complete. 2021-11-03T17:18:45.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.066+0000 7feebf266700 1 -- 172.21.15.26:0/2861240109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeb80f9850 msgr2=0x7feeb80fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:18:45.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.066+0000 7feebf266700 1 --2- 172.21.15.26:0/2861240109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeb80f9850 0x7feeb80fbc80 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7feea8004660 tx=0x7feea8009b30).stop 2021-11-03T17:18:45.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.066+0000 7feebf266700 1 -- 172.21.15.26:0/2861240109 shutdown_connections 2021-11-03T17:18:45.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.066+0000 7feebf266700 1 --2- 172.21.15.26:0/2861240109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeb80f9850 0x7feeb80fbc80 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:45.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.066+0000 7feebf266700 1 --2- 172.21.15.26:0/2861240109 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feeb8060250 0x7feeb80f9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:45.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.066+0000 7feebf266700 1 -- 172.21.15.26:0/2861240109 >> 172.21.15.26:0/2861240109 conn(0x7feeb80f0d40 msgr2=0x7feeb80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:18:45.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.066+0000 7feebf266700 1 -- 172.21.15.26:0/2861240109 shutdown_connections 2021-11-03T17:18:45.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.066+0000 7feebf266700 1 -- 172.21.15.26:0/2861240109 wait complete. 2021-11-03T17:18:45.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.067+0000 7feebf266700 1 Processor -- start 2021-11-03T17:18:45.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.067+0000 7feebf266700 1 -- start start 2021-11-03T17:18:45.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.067+0000 7feebf266700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feeb8060250 0x7feeb8106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:18:45.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.067+0000 7feebf266700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeb80f9850 0x7feeb8107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:18:45.065 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.067+0000 7feebf266700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb8107a20 con 0x7feeb80f9850 2021-11-03T17:18:45.065 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.067+0000 7feebf266700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb8107b60 con 0x7feeb8060250 2021-11-03T17:18:45.065 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.067+0000 7feebc801700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeb80f9850 0x7feeb8107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:18:45.065 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.067+0000 7feebc801700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeb80f9850 0x7feeb8107470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53694/0 (socket says 172.21.15.26:53694) 2021-11-03T17:18:45.066 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.067+0000 7feebc801700 1 -- 172.21.15.26:0/3040569921 learned_addr learned my addr 172.21.15.26:0/3040569921 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:18:45.066 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.067+0000 7feebd002700 1 --2- 172.21.15.26:0/3040569921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feeb8060250 0x7feeb8106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:18:45.066 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.068+0000 7feebc801700 1 -- 172.21.15.26:0/3040569921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feeb8060250 msgr2=0x7feeb8106f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:18:45.066 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.068+0000 7feebc801700 1 --2- 172.21.15.26:0/3040569921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feeb8060250 0x7feeb8106f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:45.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.068+0000 7feebc801700 1 -- 172.21.15.26:0/3040569921 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea8005040 con 0x7feeb80f9850 2021-11-03T17:18:45.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.068+0000 7feebc801700 1 --2- 172.21.15.26:0/3040569921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeb80f9850 0x7feeb8107470 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7feea8009830 tx=0x7feea8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:18:45.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.068+0000 7feeadffb700 1 -- 172.21.15.26:0/3040569921 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feea8018070 con 0x7feeb80f9850 2021-11-03T17:18:45.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.068+0000 7feeadffb700 1 -- 172.21.15.26:0/3040569921 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7feea8007ba0 con 0x7feeb80f9850 2021-11-03T17:18:45.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.068+0000 7feebf266700 1 -- 172.21.15.26:0/3040569921 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb81084a0 con 0x7feeb80f9850 2021-11-03T17:18:45.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.068+0000 7feeadffb700 1 -- 172.21.15.26:0/3040569921 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feea801de60 con 0x7feeb80f9850 2021-11-03T17:18:45.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.068+0000 7feebf266700 1 -- 172.21.15.26:0/3040569921 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb8108a00 con 0x7feeb80f9850 2021-11-03T17:18:45.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.069+0000 7feebf266700 1 -- 172.21.15.26:0/3040569921 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb8045ad0 con 0x7feeb80f9850 2021-11-03T17:18:45.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.070+0000 7feeadffb700 1 -- 172.21.15.26:0/3040569921 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7feea8007d10 con 0x7feeb80f9850 2021-11-03T17:18:45.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.071+0000 7feeadffb700 1 --2- 172.21.15.26:0/3040569921 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7feea4064090 0x7feea4066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:18:45.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.071+0000 7feeadffb700 1 -- 172.21.15.26:0/3040569921 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7feea8082690 con 0x7feeb80f9850 2021-11-03T17:18:45.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.071+0000 7feebd002700 1 --2- 172.21.15.26:0/3040569921 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7feea4064090 0x7feea4066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:18:45.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.071+0000 7feebd002700 1 --2- 172.21.15.26:0/3040569921 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7feea4064090 0x7feea4066550 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7feeb4004c40 tx=0x7feeb400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:18:45.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.075+0000 7feeadffb700 1 -- 172.21.15.26:0/3040569921 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7feea8054990 con 0x7feeb80f9850 2021-11-03T17:18:45.326 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.332+0000 7feebf266700 1 -- 172.21.15.26:0/3040569921 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7feeb8027a00 con 0x7feeb80f9850 2021-11-03T17:18:45.327 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.333+0000 7feeadffb700 1 -- 172.21.15.26:0/3040569921 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7feea8054580 con 0x7feeb80f9850 2021-11-03T17:18:45.328 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:18:45.328 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:18:45.328 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:18:45.328 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:18:45.329 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:18:45.329 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:18:45.329 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:18:45.329 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:18:45.330 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:18:45.330 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:18:45.330 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:18:45.330 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:18:45.331 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:18:45.331 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:18:45.331 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:18:45.331 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:18:45.332 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:18:45.332 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:18:45.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.335+0000 7feebf266700 1 -- 172.21.15.26:0/3040569921 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7feea4064090 msgr2=0x7feea4066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:18:45.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.335+0000 7feebf266700 1 --2- 172.21.15.26:0/3040569921 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7feea4064090 0x7feea4066550 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7feeb4004c40 tx=0x7feeb400b040).stop 2021-11-03T17:18:45.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.335+0000 7feebf266700 1 -- 172.21.15.26:0/3040569921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeb80f9850 msgr2=0x7feeb8107470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:18:45.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.335+0000 7feebf266700 1 --2- 172.21.15.26:0/3040569921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeb80f9850 0x7feeb8107470 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7feea8009830 tx=0x7feea8009b30).stop 2021-11-03T17:18:45.334 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.335+0000 7feebf266700 1 -- 172.21.15.26:0/3040569921 shutdown_connections 2021-11-03T17:18:45.334 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.335+0000 7feebf266700 1 --2- 172.21.15.26:0/3040569921 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7feea4064090 0x7feea4066550 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:45.334 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.335+0000 7feebf266700 1 --2- 172.21.15.26:0/3040569921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feeb8060250 0x7feeb8106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:45.334 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.335+0000 7feebf266700 1 --2- 172.21.15.26:0/3040569921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feeb80f9850 0x7feeb8107470 secure :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0x7feea8009830 tx=0x7feea8009b30).stop 2021-11-03T17:18:45.334 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.335+0000 7feebf266700 1 -- 172.21.15.26:0/3040569921 >> 172.21.15.26:0/3040569921 conn(0x7feeb80f0d40 msgr2=0x7feeb80f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:18:45.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.335+0000 7feebf266700 1 -- 172.21.15.26:0/3040569921 shutdown_connections 2021-11-03T17:18:45.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.335+0000 7feebf266700 1 -- 172.21.15.26:0/3040569921 wait complete. 2021-11-03T17:18:45.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.452+0000 7f8de579d700 1 -- 172.21.15.26:0/3077486892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8de00f66e0 msgr2=0x7f8de00f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:18:45.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.452+0000 7f8de579d700 1 --2- 172.21.15.26:0/3077486892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8de00f66e0 0x7f8de00f6b40 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f8dd4004660 tx=0x7f8dd4009b30).stop 2021-11-03T17:18:45.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.452+0000 7f8de579d700 1 -- 172.21.15.26:0/3077486892 shutdown_connections 2021-11-03T17:18:45.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.452+0000 7f8de579d700 1 --2- 172.21.15.26:0/3077486892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8de00f66e0 0x7f8de00f6b40 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:45.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.452+0000 7f8de579d700 1 --2- 172.21.15.26:0/3077486892 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8de00f5440 0x7f8de00f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:45.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.452+0000 7f8de579d700 1 -- 172.21.15.26:0/3077486892 >> 172.21.15.26:0/3077486892 conn(0x7f8de00f0ba0 msgr2=0x7f8de00f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:18:45.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.453+0000 7f8de579d700 1 -- 172.21.15.26:0/3077486892 shutdown_connections 2021-11-03T17:18:45.450 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.453+0000 7f8de579d700 1 -- 172.21.15.26:0/3077486892 wait complete. 2021-11-03T17:18:45.450 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.453+0000 7f8de579d700 1 Processor -- start 2021-11-03T17:18:45.450 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.453+0000 7f8de579d700 1 -- start start 2021-11-03T17:18:45.450 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.454+0000 7f8de579d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8de00f5440 0x7f8de0109ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:18:45.451 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.454+0000 7f8de579d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8de00f66e0 0x7f8de010bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:18:45.451 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.454+0000 7f8de579d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de00603c0 con 0x7f8de00f66e0 2021-11-03T17:18:45.451 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.454+0000 7f8de579d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de0060500 con 0x7f8de00f5440 2021-11-03T17:18:45.451 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.454+0000 7f8ddffff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8de00f5440 0x7f8de0109ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:18:45.452 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.454+0000 7f8ddffff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8de00f5440 0x7f8de0109ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.26:57908/0 (socket says 172.21.15.26:57908) 2021-11-03T17:18:45.452 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.454+0000 7f8ddffff700 1 -- 172.21.15.26:0/3346273742 learned_addr learned my addr 172.21.15.26:0/3346273742 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:18:45.452 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.454+0000 7f8ddf7fe700 1 --2- 172.21.15.26:0/3346273742 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8de00f66e0 0x7f8de010bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:18:45.452 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.454+0000 7f8ddffff700 1 -- 172.21.15.26:0/3346273742 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8de00f66e0 msgr2=0x7f8de010bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:18:45.452 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.454+0000 7f8ddffff700 1 --2- 172.21.15.26:0/3346273742 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8de00f66e0 0x7f8de010bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:45.453 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.454+0000 7f8ddffff700 1 -- 172.21.15.26:0/3346273742 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd4005040 con 0x7f8de00f5440 2021-11-03T17:18:45.453 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.455+0000 7f8ddffff700 1 --2- 172.21.15.26:0/3346273742 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8de00f5440 0x7f8de0109ab0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f8dd000c530 tx=0x7f8dd0007e10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:18:45.453 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.455+0000 7f8ddcff9700 1 -- 172.21.15.26:0/3346273742 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8dd000f650 con 0x7f8de00f5440 2021-11-03T17:18:45.454 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.455+0000 7f8ddcff9700 1 -- 172.21.15.26:0/3346273742 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8dd000fc60 con 0x7f8de00f5440 2021-11-03T17:18:45.454 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.455+0000 7f8de579d700 1 -- 172.21.15.26:0/3346273742 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8de0105950 con 0x7f8de00f5440 2021-11-03T17:18:45.455 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.455+0000 7f8ddcff9700 1 -- 172.21.15.26:0/3346273742 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8dd0012cf0 con 0x7f8de00f5440 2021-11-03T17:18:45.455 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.455+0000 7f8de579d700 1 -- 172.21.15.26:0/3346273742 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8de0105f10 con 0x7f8de00f5440 2021-11-03T17:18:45.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.456+0000 7f8ddcff9700 1 -- 172.21.15.26:0/3346273742 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f8dd0019030 con 0x7f8de00f5440 2021-11-03T17:18:45.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.456+0000 7f8de579d700 1 -- 172.21.15.26:0/3346273742 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8de0045ad0 con 0x7f8de00f5440 2021-11-03T17:18:45.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.457+0000 7f8ddcff9700 1 --2- 172.21.15.26:0/3346273742 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8dc8064100 0x7f8dc80665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:18:45.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.457+0000 7f8ddcff9700 1 -- 172.21.15.26:0/3346273742 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f8dd0080610 con 0x7f8de00f5440 2021-11-03T17:18:45.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.457+0000 7f8ddf7fe700 1 --2- 172.21.15.26:0/3346273742 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8dc8064100 0x7f8dc80665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:18:45.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.457+0000 7f8ddf7fe700 1 --2- 172.21.15.26:0/3346273742 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8dc8064100 0x7f8dc80665c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f8dd4004e30 tx=0x7f8dd4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:18:45.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.461+0000 7f8ddcff9700 1 -- 172.21.15.26:0/3346273742 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f8dd00528b0 con 0x7f8de00f5440 2021-11-03T17:18:45.664 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.669+0000 7f8de579d700 1 -- 172.21.15.26:0/3346273742 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8de00ff610 con 0x7f8de00f5440 2021-11-03T17:18:45.665 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.670+0000 7f8ddcff9700 1 -- 172.21.15.26:0/3346273742 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f8dd0017070 con 0x7f8de00f5440 2021-11-03T17:18:45.665 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:18:45.665 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:18:45.665 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:18:45.666 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:18:45.666 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:18:45.666 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:18:45.666 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:18:45.667 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:18:45.667 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:18:45.667 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:18:45.668 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:18:45.668 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:18:45.668 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:18:45.668 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:18:45.669 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:18:45.669 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:18:45.669 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:18:45.669 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:18:45.669 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:18:45.670 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:18:45.670 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:18:45.670 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:18:45.670 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:18:45.671 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:18:45.671 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:18:45.671 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:18:45.671 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:18:45.671 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:18:45.672 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:18:45.672 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:18:45.672 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:18:45.672 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:18:45.672 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:18:45.673 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:18:45.673 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:18:45.673 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:18:45.673 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:18:45.673 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:18:45.674 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:18:45.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.672+0000 7f8de579d700 1 -- 172.21.15.26:0/3346273742 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8dc8064100 msgr2=0x7f8dc80665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:18:45.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.672+0000 7f8de579d700 1 --2- 172.21.15.26:0/3346273742 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8dc8064100 0x7f8dc80665c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f8dd4004e30 tx=0x7f8dd4009b30).stop 2021-11-03T17:18:45.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.672+0000 7f8de579d700 1 -- 172.21.15.26:0/3346273742 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8de00f5440 msgr2=0x7f8de0109ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:18:45.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.672+0000 7f8de579d700 1 --2- 172.21.15.26:0/3346273742 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8de00f5440 0x7f8de0109ab0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f8dd000c530 tx=0x7f8dd0007e10).stop 2021-11-03T17:18:45.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.672+0000 7f8de579d700 1 -- 172.21.15.26:0/3346273742 shutdown_connections 2021-11-03T17:18:45.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.672+0000 7f8de579d700 1 --2- 172.21.15.26:0/3346273742 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8dc8064100 0x7f8dc80665c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:45.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.672+0000 7f8de579d700 1 --2- 172.21.15.26:0/3346273742 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8de00f5440 0x7f8de0109ab0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:45.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.672+0000 7f8de579d700 1 --2- 172.21.15.26:0/3346273742 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8de00f66e0 0x7f8de010bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:18:45.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.672+0000 7f8de579d700 1 -- 172.21.15.26:0/3346273742 >> 172.21.15.26:0/3346273742 conn(0x7f8de00f0ba0 msgr2=0x7f8de00fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:18:45.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.672+0000 7f8de579d700 1 -- 172.21.15.26:0/3346273742 shutdown_connections 2021-11-03T17:18:45.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:18:45.672+0000 7f8de579d700 1 -- 172.21.15.26:0/3346273742 wait complete. 2021-11-03T17:18:45.677 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:18:46.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:46 smithi026 ceph-mon[96795]: from='client.34892 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:18:46.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:46 smithi026 ceph-mon[96795]: pgmap v723: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:46.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:46 smithi026 ceph-mon[96795]: from='client.34896 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:18:46.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:46 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3040569921' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:18:46.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:46 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3346273742' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:18:46.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:46 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:18:46.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:46 smithi194 ceph-mon[65619]: from='client.34892 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:18:46.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:46 smithi194 ceph-mon[65619]: pgmap v723: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:46.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:46 smithi194 ceph-mon[65619]: from='client.34896 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:18:46.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:46 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3040569921' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:18:46.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:46 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3346273742' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:18:46.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:46 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:18:47.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:47 smithi194 ceph-mon[65619]: poll took 4314.410 ms: 1 events 2021-11-03T17:18:47.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:47 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:18:47.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:47 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:18:47.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:47 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:18:47.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:47 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:18:47.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:47 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:18:47.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:47 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:18:47.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:47 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:18:47.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:47 smithi026 ceph-mon[96795]: poll took 4314.410 ms: 1 events 2021-11-03T17:18:47.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:47 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:18:47.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:47 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:18:47.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:47 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:18:47.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:47 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:18:47.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:47 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:18:47.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:47 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:18:47.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:47 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:18:48.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:48 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:18:48.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:48 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:18:48.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:48 smithi194 ceph-mon[65619]: pgmap v724: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:48.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:18:48.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:18:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:48 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:18:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:48 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:18:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:48 smithi026 ceph-mon[96795]: pgmap v724: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:48.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:18:48.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:18:50.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:50 smithi194 ceph-mon[65619]: pgmap v725: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:50.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:50 smithi026 ceph-mon[96795]: pgmap v725: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:52.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:52 smithi194 ceph-mon[65619]: pgmap v726: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:52.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:52 smithi026 ceph-mon[96795]: pgmap v726: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:54.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:54 smithi194 ceph-mon[65619]: pgmap v727: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:54.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:54 smithi026 ceph-mon[96795]: pgmap v727: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:56.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:56 smithi194 ceph-mon[65619]: pgmap v728: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:56.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:56 smithi026 ceph-mon[96795]: pgmap v728: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:58.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:18:58 smithi194 ceph-mon[65619]: pgmap v729: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:18:58.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:18:58 smithi026 ceph-mon[96795]: pgmap v729: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:00.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:00 smithi194 ceph-mon[65619]: pgmap v730: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:00.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:00 smithi026 ceph-mon[96795]: pgmap v730: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:02.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:02 smithi194 ceph-mon[65619]: pgmap v731: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:02.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:02 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:19:02.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:02 smithi026 ceph-mon[96795]: pgmap v731: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:02.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:02 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:19:03.471 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:03 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:19:03.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:03 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:19:04.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:04 smithi194 ceph-mon[65619]: pgmap v732: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:04.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:04 smithi026 ceph-mon[96795]: pgmap v732: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:06.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:06 smithi194 ceph-mon[65619]: pgmap v733: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:06.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:06 smithi026 ceph-mon[96795]: pgmap v733: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:08.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:08 smithi194 ceph-mon[65619]: pgmap v734: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:08.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:08 smithi026 ceph-mon[96795]: pgmap v734: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:10.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:10 smithi194 ceph-mon[65619]: pgmap v735: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:10.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:10 smithi026 ceph-mon[96795]: pgmap v735: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:12.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:12 smithi194 ceph-mon[65619]: pgmap v736: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:12.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:12 smithi026 ceph-mon[96795]: pgmap v736: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:14.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:14 smithi194 ceph-mon[65619]: pgmap v737: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:14.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:14 smithi026 ceph-mon[96795]: pgmap v737: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:15.784 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.787+0000 7fb4ce314700 1 -- 172.21.15.26:0/612503346 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4c806a330 msgr2=0x7fb4c806a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:19:15.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.787+0000 7fb4ce314700 1 --2- 172.21.15.26:0/612503346 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4c806a330 0x7fb4c806a7b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7fb4b0004660 tx=0x7fb4b0009b30).stop 2021-11-03T17:19:15.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.787+0000 7fb4ce314700 1 -- 172.21.15.26:0/612503346 shutdown_connections 2021-11-03T17:19:15.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.787+0000 7fb4ce314700 1 --2- 172.21.15.26:0/612503346 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4c806a330 0x7fb4c806a7b0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:15.786 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.787+0000 7fb4ce314700 1 --2- 172.21.15.26:0/612503346 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4c806b8a0 0x7fb4c8069e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:15.786 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.787+0000 7fb4ce314700 1 -- 172.21.15.26:0/612503346 >> 172.21.15.26:0/612503346 conn(0x7fb4c80f1f00 msgr2=0x7fb4c80f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:19:15.786 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.787+0000 7fb4ce314700 1 -- 172.21.15.26:0/612503346 shutdown_connections 2021-11-03T17:19:15.786 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.787+0000 7fb4ce314700 1 -- 172.21.15.26:0/612503346 wait complete. 2021-11-03T17:19:15.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.788+0000 7fb4ce314700 1 Processor -- start 2021-11-03T17:19:15.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.788+0000 7fb4ce314700 1 -- start start 2021-11-03T17:19:15.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.788+0000 7fb4ce314700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4c806a330 0x7fb4c81091a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:19:15.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.788+0000 7fb4ce314700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4c806b8a0 0x7fb4c8109690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:19:15.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.788+0000 7fb4ce314700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c8109c40 con 0x7fb4c806a330 2021-11-03T17:19:15.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.788+0000 7fb4ce314700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c8109d80 con 0x7fb4c806b8a0 2021-11-03T17:19:15.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.788+0000 7fb4c7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4c806a330 0x7fb4c81091a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:19:15.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.788+0000 7fb4c7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4c806a330 0x7fb4c81091a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53724/0 (socket says 172.21.15.26:53724) 2021-11-03T17:19:15.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.788+0000 7fb4c7fff700 1 -- 172.21.15.26:0/1519848973 learned_addr learned my addr 172.21.15.26:0/1519848973 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:19:15.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.789+0000 7fb4c77fe700 1 --2- 172.21.15.26:0/1519848973 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4c806b8a0 0x7fb4c8109690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:19:15.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.789+0000 7fb4c7fff700 1 -- 172.21.15.26:0/1519848973 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4c806b8a0 msgr2=0x7fb4c8109690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:19:15.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.789+0000 7fb4c7fff700 1 --2- 172.21.15.26:0/1519848973 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4c806b8a0 0x7fb4c8109690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:15.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.789+0000 7fb4c7fff700 1 -- 172.21.15.26:0/1519848973 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b0005040 con 0x7fb4c806a330 2021-11-03T17:19:15.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.789+0000 7fb4c7fff700 1 --2- 172.21.15.26:0/1519848973 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4c806a330 0x7fb4c81091a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7fb4b8002700 tx=0x7fb4b8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:19:15.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.789+0000 7fb4c4ff9700 1 -- 172.21.15.26:0/1519848973 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4b80079c0 con 0x7fb4c806a330 2021-11-03T17:19:15.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.789+0000 7fb4ce314700 1 -- 172.21.15.26:0/1519848973 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4c810a720 con 0x7fb4c806a330 2021-11-03T17:19:15.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.789+0000 7fb4c4ff9700 1 -- 172.21.15.26:0/1519848973 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb4b800f040 con 0x7fb4c806a330 2021-11-03T17:19:15.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.789+0000 7fb4c4ff9700 1 -- 172.21.15.26:0/1519848973 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4b8014860 con 0x7fb4c806a330 2021-11-03T17:19:15.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.789+0000 7fb4ce314700 1 -- 172.21.15.26:0/1519848973 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4c810ace0 con 0x7fb4c806a330 2021-11-03T17:19:15.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.790+0000 7fb4ce314700 1 -- 172.21.15.26:0/1519848973 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4c8045ad0 con 0x7fb4c806a330 2021-11-03T17:19:15.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.791+0000 7fb4c4ff9700 1 -- 172.21.15.26:0/1519848973 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fb4b801b060 con 0x7fb4c806a330 2021-11-03T17:19:15.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.792+0000 7fb4c4ff9700 1 --2- 172.21.15.26:0/1519848973 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb4b40640b0 0x7fb4b4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:19:15.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.792+0000 7fb4c4ff9700 1 -- 172.21.15.26:0/1519848973 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fb4b8080870 con 0x7fb4c806a330 2021-11-03T17:19:15.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.792+0000 7fb4c77fe700 1 --2- 172.21.15.26:0/1519848973 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb4b40640b0 0x7fb4b4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:19:15.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.792+0000 7fb4c77fe700 1 --2- 172.21.15.26:0/1519848973 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb4b40640b0 0x7fb4b4066570 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fb4b0005010 tx=0x7fb4b0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:19:15.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.795+0000 7fb4c4ff9700 1 -- 172.21.15.26:0/1519848973 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fb4b8052bd0 con 0x7fb4c806a330 2021-11-03T17:19:15.969 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.973+0000 7fb4ce314700 1 -- 172.21.15.26:0/1519848973 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb4c810af60 con 0x7fb4b40640b0 2021-11-03T17:19:15.970 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.975+0000 7fb4c4ff9700 1 -- 172.21.15.26:0/1519848973 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fb4c810af60 con 0x7fb4b40640b0 2021-11-03T17:19:15.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.977+0000 7fb4ce314700 1 -- 172.21.15.26:0/1519848973 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb4b40640b0 msgr2=0x7fb4b4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:19:15.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.977+0000 7fb4ce314700 1 --2- 172.21.15.26:0/1519848973 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb4b40640b0 0x7fb4b4066570 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fb4b0005010 tx=0x7fb4b0009b30).stop 2021-11-03T17:19:15.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.977+0000 7fb4ce314700 1 -- 172.21.15.26:0/1519848973 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4c806a330 msgr2=0x7fb4c81091a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:19:15.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.977+0000 7fb4ce314700 1 --2- 172.21.15.26:0/1519848973 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4c806a330 0x7fb4c81091a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7fb4b8002700 tx=0x7fb4b8009d80).stop 2021-11-03T17:19:15.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.977+0000 7fb4ce314700 1 -- 172.21.15.26:0/1519848973 shutdown_connections 2021-11-03T17:19:15.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.977+0000 7fb4ce314700 1 --2- 172.21.15.26:0/1519848973 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb4b40640b0 0x7fb4b4066570 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:15.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.977+0000 7fb4ce314700 1 --2- 172.21.15.26:0/1519848973 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4c806a330 0x7fb4c81091a0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:15.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.977+0000 7fb4ce314700 1 --2- 172.21.15.26:0/1519848973 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4c806b8a0 0x7fb4c8109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:15.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.977+0000 7fb4ce314700 1 -- 172.21.15.26:0/1519848973 >> 172.21.15.26:0/1519848973 conn(0x7fb4c80f1f00 msgr2=0x7fb4c80fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:19:15.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.977+0000 7fb4ce314700 1 -- 172.21.15.26:0/1519848973 shutdown_connections 2021-11-03T17:19:15.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:15.977+0000 7fb4ce314700 1 -- 172.21.15.26:0/1519848973 wait complete. 2021-11-03T17:19:15.982 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:19:16.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.077+0000 7f79dcc58700 1 -- 172.21.15.26:0/397759786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79d80f6540 msgr2=0x7f79d80f69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:19:16.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.077+0000 7f79dcc58700 1 --2- 172.21.15.26:0/397759786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79d80f6540 0x7f79d80f69c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f79cc004660 tx=0x7f79cc009b30).stop 2021-11-03T17:19:16.078 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.078+0000 7f79dcc58700 1 -- 172.21.15.26:0/397759786 shutdown_connections 2021-11-03T17:19:16.078 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.078+0000 7f79dcc58700 1 --2- 172.21.15.26:0/397759786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79d80f6540 0x7f79d80f69c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:16.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.078+0000 7f79dcc58700 1 --2- 172.21.15.26:0/397759786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79d80f5c30 0x7f79d80f6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:16.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.078+0000 7f79dcc58700 1 -- 172.21.15.26:0/397759786 >> 172.21.15.26:0/397759786 conn(0x7f79d80f0540 msgr2=0x7f79d80f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:19:16.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.078+0000 7f79dcc58700 1 -- 172.21.15.26:0/397759786 shutdown_connections 2021-11-03T17:19:16.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.078+0000 7f79dcc58700 1 -- 172.21.15.26:0/397759786 wait complete. 2021-11-03T17:19:16.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.078+0000 7f79dcc58700 1 Processor -- start 2021-11-03T17:19:16.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.078+0000 7f79dcc58700 1 -- start start 2021-11-03T17:19:16.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.078+0000 7f79dcc58700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79d80f5c30 0x7f79d8106e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:19:16.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.078+0000 7f79dcc58700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79d80f6540 0x7f79d8107380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:19:16.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.078+0000 7f79dcc58700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d8107930 con 0x7f79d80f6540 2021-11-03T17:19:16.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.078+0000 7f79dcc58700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d8107a70 con 0x7f79d80f5c30 2021-11-03T17:19:16.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.078+0000 7f79d5d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79d80f6540 0x7f79d8107380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:19:16.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.078+0000 7f79d5d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79d80f6540 0x7f79d8107380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53736/0 (socket says 172.21.15.26:53736) 2021-11-03T17:19:16.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.078+0000 7f79d5d9b700 1 -- 172.21.15.26:0/3127400995 learned_addr learned my addr 172.21.15.26:0/3127400995 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:19:16.085 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.079+0000 7f79d659c700 1 --2- 172.21.15.26:0/3127400995 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79d80f5c30 0x7f79d8106e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:19:16.085 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.079+0000 7f79d5d9b700 1 -- 172.21.15.26:0/3127400995 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79d80f5c30 msgr2=0x7f79d8106e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:19:16.085 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.079+0000 7f79d5d9b700 1 --2- 172.21.15.26:0/3127400995 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79d80f5c30 0x7f79d8106e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:16.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.079+0000 7f79d5d9b700 1 -- 172.21.15.26:0/3127400995 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79cc005040 con 0x7f79d80f6540 2021-11-03T17:19:16.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.079+0000 7f79d659c700 1 --2- 172.21.15.26:0/3127400995 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79d80f5c30 0x7f79d8106e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:19:16.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.079+0000 7f79d5d9b700 1 --2- 172.21.15.26:0/3127400995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79d80f6540 0x7f79d8107380 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f79cc000c00 tx=0x7f79cc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:19:16.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.079+0000 7f79c6ffd700 1 -- 172.21.15.26:0/3127400995 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79cc019070 con 0x7f79d80f6540 2021-11-03T17:19:16.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.079+0000 7f79dcc58700 1 -- 172.21.15.26:0/3127400995 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d81083b0 con 0x7f79d80f6540 2021-11-03T17:19:16.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.079+0000 7f79c6ffd700 1 -- 172.21.15.26:0/3127400995 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f79cc007e70 con 0x7f79d80f6540 2021-11-03T17:19:16.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.079+0000 7f79c6ffd700 1 -- 172.21.15.26:0/3127400995 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79cc014e20 con 0x7f79d80f6540 2021-11-03T17:19:16.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.079+0000 7f79dcc58700 1 -- 172.21.15.26:0/3127400995 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d8108910 con 0x7f79d80f6540 2021-11-03T17:19:16.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.080+0000 7f79dcc58700 1 -- 172.21.15.26:0/3127400995 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79d8045ad0 con 0x7f79d80f6540 2021-11-03T17:19:16.090 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.080+0000 7f79c6ffd700 1 -- 172.21.15.26:0/3127400995 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f79cc025070 con 0x7f79d80f6540 2021-11-03T17:19:16.090 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.081+0000 7f79c6ffd700 1 --2- 172.21.15.26:0/3127400995 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f79c00640b0 0x7f79c0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:19:16.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.081+0000 7f79c6ffd700 1 -- 172.21.15.26:0/3127400995 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f79cc0817d0 con 0x7f79d80f6540 2021-11-03T17:19:16.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.081+0000 7f79d659c700 1 --2- 172.21.15.26:0/3127400995 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f79c00640b0 0x7f79c0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:19:16.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.081+0000 7f79d659c700 1 --2- 172.21.15.26:0/3127400995 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f79c00640b0 0x7f79c0066570 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f79c8007fc0 tx=0x7f79c800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:19:16.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.085+0000 7f79c6ffd700 1 -- 172.21.15.26:0/3127400995 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f79cc053ad0 con 0x7f79d80f6540 2021-11-03T17:19:16.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.262+0000 7f79dcc58700 1 -- 172.21.15.26:0/3127400995 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f79d8108b80 con 0x7f79c00640b0 2021-11-03T17:19:16.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.276+0000 7f79c6ffd700 1 -- 172.21.15.26:0/3127400995 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f79d8108b80 con 0x7f79c00640b0 2021-11-03T17:19:16.272 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:19:16.272 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (30m) 30s ago 31m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:19:16.272 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (22m) 30s ago 31m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:19:16.272 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (22m) 9m ago 30m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:19:16.273 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (30m) 30s ago 31m 39.6M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:19:16.273 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (23m) 30s ago 26m 19.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:19:16.273 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (23m) 30s ago 26m 20.6M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:19:16.273 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (26m) 9m ago 26m 19.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:19:16.274 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (26m) 9m ago 26m 19.4M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:19:16.274 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (24m) 30s ago 33m 505M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:19:16.274 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (23m) 9m ago 30m 415M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:19:16.274 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (23m) 30s ago 33m 147M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:19:16.275 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (23m) 9m ago 30m 70.2M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:19:16.275 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (31m) 30s ago 31m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:19:16.275 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (30m) 9m ago 30m 18.4M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:19:16.275 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (22m) 30s ago 30m 211M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:19:16.275 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (21m) 30s ago 29m 226M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:19:16.276 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (21m) 30s ago 29m 189M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:19:16.276 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (20m) 9m ago 29m 211M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:19:16.276 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (20m) 9m ago 28m 189M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:19:16.276 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (19m) 9m ago 28m 174M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:19:16.277 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (30m) 30s ago 31m 52.1M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:19:16.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.278+0000 7f79dcc58700 1 -- 172.21.15.26:0/3127400995 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f79c00640b0 msgr2=0x7f79c0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:19:16.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.278+0000 7f79dcc58700 1 --2- 172.21.15.26:0/3127400995 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f79c00640b0 0x7f79c0066570 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f79c8007fc0 tx=0x7f79c800b040).stop 2021-11-03T17:19:16.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.278+0000 7f79dcc58700 1 -- 172.21.15.26:0/3127400995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79d80f6540 msgr2=0x7f79d8107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:19:16.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.278+0000 7f79dcc58700 1 --2- 172.21.15.26:0/3127400995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79d80f6540 0x7f79d8107380 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f79cc000c00 tx=0x7f79cc00b040).stop 2021-11-03T17:19:16.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.278+0000 7f79dcc58700 1 -- 172.21.15.26:0/3127400995 shutdown_connections 2021-11-03T17:19:16.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.278+0000 7f79dcc58700 1 --2- 172.21.15.26:0/3127400995 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f79c00640b0 0x7f79c0066570 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:16.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.278+0000 7f79dcc58700 1 --2- 172.21.15.26:0/3127400995 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79d80f5c30 0x7f79d8106e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:16.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.278+0000 7f79dcc58700 1 --2- 172.21.15.26:0/3127400995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79d80f6540 0x7f79d8107380 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:16.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.278+0000 7f79dcc58700 1 -- 172.21.15.26:0/3127400995 >> 172.21.15.26:0/3127400995 conn(0x7f79d80f0540 msgr2=0x7f79d80fa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:19:16.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.278+0000 7f79dcc58700 1 -- 172.21.15.26:0/3127400995 shutdown_connections 2021-11-03T17:19:16.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.278+0000 7f79dcc58700 1 -- 172.21.15.26:0/3127400995 wait complete. 2021-11-03T17:19:16.375 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.377+0000 7f38388ec700 1 -- 172.21.15.26:0/2343317590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38340f66e0 msgr2=0x7f38340f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:19:16.376 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.377+0000 7f38388ec700 1 --2- 172.21.15.26:0/2343317590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38340f66e0 0x7f38340f6b00 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f382c0099e0 tx=0x7f382c004d10).stop 2021-11-03T17:19:16.376 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.377+0000 7f38388ec700 1 -- 172.21.15.26:0/2343317590 shutdown_connections 2021-11-03T17:19:16.376 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.377+0000 7f38388ec700 1 --2- 172.21.15.26:0/2343317590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38340f7980 0x7f38340f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:19:16.377 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.377+0000 7f38388ec700 1 --2- 172.21.15.26:0/2343317590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38340f66e0 0x7f38340f6b00 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:16.377 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.377+0000 7f38388ec700 1 -- 172.21.15.26:0/2343317590 >> 172.21.15.26:0/2343317590 conn(0x7f38340f1e40 msgr2=0x7f38340f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:19:16.377 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.377+0000 7f38388ec700 1 -- 172.21.15.26:0/2343317590 shutdown_connections 2021-11-03T17:19:16.377 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.377+0000 7f38388ec700 1 -- 172.21.15.26:0/2343317590 wait complete. 2021-11-03T17:19:16.377 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.377+0000 7f38388ec700 1 Processor -- start 2021-11-03T17:19:16.378 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.377+0000 7f38388ec700 1 -- start start 2021-11-03T17:19:16.378 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.378+0000 7f38388ec700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38340f66e0 0x7f3834107120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:19:16.378 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.378+0000 7f38388ec700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38340f7980 0x7f3834107610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:19:16.378 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.378+0000 7f38388ec700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3834107c50 con 0x7f38340f66e0 2021-11-03T17:19:16.379 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.378+0000 7f38388ec700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3834108500 con 0x7f38340f7980 2021-11-03T17:19:16.379 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.378+0000 7f383259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38340f66e0 0x7f3834107120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:19:16.379 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.378+0000 7f383259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38340f66e0 0x7f3834107120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53744/0 (socket says 172.21.15.26:53744) 2021-11-03T17:19:16.379 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.378+0000 7f383259c700 1 -- 172.21.15.26:0/661428225 learned_addr learned my addr 172.21.15.26:0/661428225 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:19:16.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.378+0000 7f3831d9b700 1 --2- 172.21.15.26:0/661428225 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38340f7980 0x7f3834107610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:19:16.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.378+0000 7f383259c700 1 -- 172.21.15.26:0/661428225 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38340f7980 msgr2=0x7f3834107610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:19:16.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.378+0000 7f383259c700 1 --2- 172.21.15.26:0/661428225 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38340f7980 0x7f3834107610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:16.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.378+0000 7f383259c700 1 -- 172.21.15.26:0/661428225 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382c009640 con 0x7f38340f66e0 2021-11-03T17:19:16.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.378+0000 7f3831d9b700 1 --2- 172.21.15.26:0/661428225 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38340f7980 0x7f3834107610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:19:16.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.378+0000 7f383259c700 1 --2- 172.21.15.26:0/661428225 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38340f66e0 0x7f3834107120 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f382c00c010 tx=0x7f382c004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:19:16.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.378+0000 7f382affd700 1 -- 172.21.15.26:0/661428225 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f382c00e070 con 0x7f38340f66e0 2021-11-03T17:19:16.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.378+0000 7f382affd700 1 -- 172.21.15.26:0/661428225 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f382c007dc0 con 0x7f38340f66e0 2021-11-03T17:19:16.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.378+0000 7f38388ec700 1 -- 172.21.15.26:0/661428225 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3834108780 con 0x7f38340f66e0 2021-11-03T17:19:16.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.378+0000 7f382affd700 1 -- 172.21.15.26:0/661428225 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f382c018070 con 0x7f38340f66e0 2021-11-03T17:19:16.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.378+0000 7f38388ec700 1 -- 172.21.15.26:0/661428225 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3834108c60 con 0x7f38340f66e0 2021-11-03T17:19:16.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.379+0000 7f38388ec700 1 -- 172.21.15.26:0/661428225 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38340f5ad0 con 0x7f38340f66e0 2021-11-03T17:19:16.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.380+0000 7f382affd700 1 -- 172.21.15.26:0/661428225 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f382c024060 con 0x7f38340f66e0 2021-11-03T17:19:16.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.380+0000 7f382affd700 1 --2- 172.21.15.26:0/661428225 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f38200640b0 0x7f3820066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:19:16.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.380+0000 7f382affd700 1 -- 172.21.15.26:0/661428225 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f382c082260 con 0x7f38340f66e0 2021-11-03T17:19:16.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.380+0000 7f3831d9b700 1 --2- 172.21.15.26:0/661428225 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f38200640b0 0x7f3820066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:19:16.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.381+0000 7f3831d9b700 1 --2- 172.21.15.26:0/661428225 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f38200640b0 0x7f3820066570 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f381c00b830 tx=0x7f381c008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:19:16.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.384+0000 7f382affd700 1 -- 172.21.15.26:0/661428225 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f382c0545c0 con 0x7f38340f66e0 2021-11-03T17:19:16.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:16 smithi194 ceph-mon[65619]: pgmap v738: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:16.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.614+0000 7f38388ec700 1 -- 172.21.15.26:0/661428225 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f38340008d0 con 0x7f38340f66e0 2021-11-03T17:19:16.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.615+0000 7f382affd700 1 -- 172.21.15.26:0/661428225 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f382c0222e0 con 0x7f38340f66e0 2021-11-03T17:19:16.611 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:19:16.611 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:19:16.612 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:19:16.612 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:19:16.612 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:19:16.612 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:19:16.613 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:19:16.613 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:19:16.613 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:19:16.614 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:19:16.614 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:19:16.614 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:19:16.614 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:19:16.615 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:19:16.615 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:19:16.615 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:19:16.615 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:19:16.616 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:19:16.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.616+0000 7f38388ec700 1 -- 172.21.15.26:0/661428225 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f38200640b0 msgr2=0x7f3820066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:19:16.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.616+0000 7f38388ec700 1 --2- 172.21.15.26:0/661428225 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f38200640b0 0x7f3820066570 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f381c00b830 tx=0x7f381c008040).stop 2021-11-03T17:19:16.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.616+0000 7f38388ec700 1 -- 172.21.15.26:0/661428225 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38340f66e0 msgr2=0x7f3834107120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:19:16.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.616+0000 7f38388ec700 1 --2- 172.21.15.26:0/661428225 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38340f66e0 0x7f3834107120 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f382c00c010 tx=0x7f382c004d10).stop 2021-11-03T17:19:16.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.617+0000 7f38388ec700 1 -- 172.21.15.26:0/661428225 shutdown_connections 2021-11-03T17:19:16.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.617+0000 7f38388ec700 1 --2- 172.21.15.26:0/661428225 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f38200640b0 0x7f3820066570 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:16.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.617+0000 7f38388ec700 1 --2- 172.21.15.26:0/661428225 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38340f66e0 0x7f3834107120 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:16.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.617+0000 7f38388ec700 1 --2- 172.21.15.26:0/661428225 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38340f7980 0x7f3834107610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:16.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.617+0000 7f38388ec700 1 -- 172.21.15.26:0/661428225 >> 172.21.15.26:0/661428225 conn(0x7f38340f1e40 msgr2=0x7f38340fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:19:16.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.617+0000 7f38388ec700 1 -- 172.21.15.26:0/661428225 shutdown_connections 2021-11-03T17:19:16.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.617+0000 7f38388ec700 1 -- 172.21.15.26:0/661428225 wait complete. 2021-11-03T17:19:16.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:16 smithi026 ceph-mon[96795]: pgmap v738: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:16.712 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.717+0000 7fd46702e700 1 -- 172.21.15.26:0/1067274376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4600f66c0 msgr2=0x7fd4600f6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:19:16.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.717+0000 7fd46702e700 1 --2- 172.21.15.26:0/1067274376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4600f66c0 0x7fd4600f6ae0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7fd4580099e0 tx=0x7fd458004d10).stop 2021-11-03T17:19:16.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.717+0000 7fd46702e700 1 -- 172.21.15.26:0/1067274376 shutdown_connections 2021-11-03T17:19:16.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.717+0000 7fd46702e700 1 --2- 172.21.15.26:0/1067274376 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4600f7960 0x7fd4600f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:16.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.717+0000 7fd46702e700 1 --2- 172.21.15.26:0/1067274376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4600f66c0 0x7fd4600f6ae0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:16.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.717+0000 7fd46702e700 1 -- 172.21.15.26:0/1067274376 >> 172.21.15.26:0/1067274376 conn(0x7fd4600f1e20 msgr2=0x7fd4600f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:19:16.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.717+0000 7fd46702e700 1 -- 172.21.15.26:0/1067274376 shutdown_connections 2021-11-03T17:19:16.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.717+0000 7fd46702e700 1 -- 172.21.15.26:0/1067274376 wait complete. 2021-11-03T17:19:16.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.717+0000 7fd46702e700 1 Processor -- start 2021-11-03T17:19:16.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.717+0000 7fd46702e700 1 -- start start 2021-11-03T17:19:16.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.718+0000 7fd46702e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4600f66c0 0x7fd46006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:19:16.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.718+0000 7fd46702e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4600f7960 0x7fd460069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:19:16.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.718+0000 7fd46702e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46006a380 con 0x7fd4600f66c0 2021-11-03T17:19:16.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.718+0000 7fd46702e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46006a4c0 con 0x7fd4600f7960 2021-11-03T17:19:16.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.718+0000 7fd464dca700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4600f66c0 0x7fd46006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:19:16.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.718+0000 7fd464dca700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4600f66c0 0x7fd46006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53754/0 (socket says 172.21.15.26:53754) 2021-11-03T17:19:16.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.718+0000 7fd464dca700 1 -- 172.21.15.26:0/2655948501 learned_addr learned my addr 172.21.15.26:0/2655948501 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:19:16.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.718+0000 7fd45ffff700 1 --2- 172.21.15.26:0/2655948501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4600f7960 0x7fd460069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:19:16.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.718+0000 7fd464dca700 1 -- 172.21.15.26:0/2655948501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4600f7960 msgr2=0x7fd460069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:19:16.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.718+0000 7fd464dca700 1 --2- 172.21.15.26:0/2655948501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4600f7960 0x7fd460069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:16.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.718+0000 7fd464dca700 1 -- 172.21.15.26:0/2655948501 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd458009640 con 0x7fd4600f66c0 2021-11-03T17:19:16.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.718+0000 7fd464dca700 1 --2- 172.21.15.26:0/2655948501 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4600f66c0 0x7fd46006b9a0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7fd45800c010 tx=0x7fd458004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:19:16.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.719+0000 7fd45d7fa700 1 -- 172.21.15.26:0/2655948501 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd45800e070 con 0x7fd4600f66c0 2021-11-03T17:19:16.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.719+0000 7fd45d7fa700 1 -- 172.21.15.26:0/2655948501 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd458007d10 con 0x7fd4600f66c0 2021-11-03T17:19:16.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.719+0000 7fd46702e700 1 -- 172.21.15.26:0/2655948501 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd46006a740 con 0x7fd4600f66c0 2021-11-03T17:19:16.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.719+0000 7fd45d7fa700 1 -- 172.21.15.26:0/2655948501 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd458018070 con 0x7fd4600f66c0 2021-11-03T17:19:16.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.719+0000 7fd46702e700 1 -- 172.21.15.26:0/2655948501 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd46006ac20 con 0x7fd4600f66c0 2021-11-03T17:19:16.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.720+0000 7fd46702e700 1 -- 172.21.15.26:0/2655948501 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd460045ad0 con 0x7fd4600f66c0 2021-11-03T17:19:16.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.720+0000 7fd45d7fa700 1 -- 172.21.15.26:0/2655948501 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fd458024060 con 0x7fd4600f66c0 2021-11-03T17:19:16.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.720+0000 7fd45d7fa700 1 --2- 172.21.15.26:0/2655948501 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd4480640b0 0x7fd448066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:19:16.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.721+0000 7fd45d7fa700 1 -- 172.21.15.26:0/2655948501 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fd458082020 con 0x7fd4600f66c0 2021-11-03T17:19:16.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.721+0000 7fd45ffff700 1 --2- 172.21.15.26:0/2655948501 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd4480640b0 0x7fd448066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:19:16.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.721+0000 7fd45ffff700 1 --2- 172.21.15.26:0/2655948501 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd4480640b0 0x7fd448066570 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fd454004e20 tx=0x7fd45400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:19:16.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.725+0000 7fd45d7fa700 1 -- 172.21.15.26:0/2655948501 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fd458054380 con 0x7fd4600f66c0 2021-11-03T17:19:16.923 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.927+0000 7fd46702e700 1 -- 172.21.15.26:0/2655948501 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd4600fef20 con 0x7fd4600f66c0 2021-11-03T17:19:16.923 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.928+0000 7fd45d7fa700 1 -- 172.21.15.26:0/2655948501 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fd458022070 con 0x7fd4600f66c0 2021-11-03T17:19:16.923 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:19:16.924 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:19:16.924 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:19:16.924 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:19:16.924 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:19:16.925 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:19:16.925 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:19:16.925 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:19:16.925 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:19:16.925 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:19:16.926 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:19:16.926 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:19:16.926 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:19:16.927 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:19:16.927 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:19:16.927 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:19:16.928 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:19:16.928 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:19:16.929 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:19:16.929 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:19:16.929 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:19:16.929 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:19:16.929 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:19:16.930 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:19:16.930 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:19:16.930 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:19:16.930 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:19:16.931 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:19:16.931 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:19:16.931 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:19:16.932 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:19:16.932 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:19:16.932 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:19:16.932 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:19:16.933 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:19:16.933 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:19:16.933 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:19:16.933 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:19:16.934 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:19:16.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.929+0000 7fd46702e700 1 -- 172.21.15.26:0/2655948501 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd4480640b0 msgr2=0x7fd448066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:19:16.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.929+0000 7fd46702e700 1 --2- 172.21.15.26:0/2655948501 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd4480640b0 0x7fd448066570 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fd454004e20 tx=0x7fd45400b040).stop 2021-11-03T17:19:16.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.929+0000 7fd46702e700 1 -- 172.21.15.26:0/2655948501 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4600f66c0 msgr2=0x7fd46006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:19:16.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.929+0000 7fd46702e700 1 --2- 172.21.15.26:0/2655948501 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4600f66c0 0x7fd46006b9a0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7fd45800c010 tx=0x7fd458004d10).stop 2021-11-03T17:19:16.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.929+0000 7fd46702e700 1 -- 172.21.15.26:0/2655948501 shutdown_connections 2021-11-03T17:19:16.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.929+0000 7fd46702e700 1 --2- 172.21.15.26:0/2655948501 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd4480640b0 0x7fd448066570 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:16.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.929+0000 7fd46702e700 1 --2- 172.21.15.26:0/2655948501 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4600f66c0 0x7fd46006b9a0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:16.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.929+0000 7fd46702e700 1 --2- 172.21.15.26:0/2655948501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4600f7960 0x7fd460069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:16.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.929+0000 7fd46702e700 1 -- 172.21.15.26:0/2655948501 >> 172.21.15.26:0/2655948501 conn(0x7fd4600f1e20 msgr2=0x7fd4600fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:19:16.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.930+0000 7fd46702e700 1 -- 172.21.15.26:0/2655948501 shutdown_connections 2021-11-03T17:19:16.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:16.930+0000 7fd46702e700 1 -- 172.21.15.26:0/2655948501 wait complete. 2021-11-03T17:19:16.937 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:19:17.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:17 smithi194 ceph-mon[65619]: from='client.34908 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:19:17.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:17 smithi194 ceph-mon[65619]: from='client.34912 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:19:17.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:17 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:19:17.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:17 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/661428225' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:19:17.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:17 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2655948501' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:19:17.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:17 smithi026 ceph-mon[96795]: from='client.34908 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:19:17.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:17 smithi026 ceph-mon[96795]: from='client.34912 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:19:17.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:17 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:19:17.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:17 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/661428225' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:19:17.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:17 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2655948501' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:19:18.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:18 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:19:18.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:18 smithi194 ceph-mon[65619]: pgmap v739: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:18.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:18 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:19:18.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:18 smithi026 ceph-mon[96795]: pgmap v739: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:20.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:20 smithi194 ceph-mon[65619]: pgmap v740: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:20.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:20 smithi026 ceph-mon[96795]: pgmap v740: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:22.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:22 smithi194 ceph-mon[65619]: pgmap v741: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:22.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:22 smithi026 ceph-mon[96795]: pgmap v741: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:24.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:24 smithi194 ceph-mon[65619]: pgmap v742: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:24.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:24 smithi026 ceph-mon[96795]: pgmap v742: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:26.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:26 smithi194 ceph-mon[65619]: pgmap v743: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:26.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:26 smithi026 ceph-mon[96795]: pgmap v743: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:28.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:28 smithi026 ceph-mon[96795]: pgmap v744: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:28.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:28 smithi194 ceph-mon[65619]: pgmap v744: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:30.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:30 smithi026 ceph-mon[96795]: pgmap v745: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:30.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:30 smithi194 ceph-mon[65619]: pgmap v745: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:32.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:32 smithi026 ceph-mon[96795]: pgmap v746: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:32.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:32 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:19:32.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:32 smithi194 ceph-mon[65619]: pgmap v746: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:32.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:32 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:19:33.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:33 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:19:33.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:33 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:19:34.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:34 smithi026 ceph-mon[96795]: pgmap v747: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:34.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:34 smithi194 ceph-mon[65619]: pgmap v747: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:36.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:36 smithi026 ceph-mon[96795]: pgmap v748: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:36.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:36 smithi194 ceph-mon[65619]: pgmap v748: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:38.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:38 smithi026 ceph-mon[96795]: pgmap v749: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:38.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:38 smithi194 ceph-mon[65619]: pgmap v749: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:40.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:40 smithi026 ceph-mon[96795]: pgmap v750: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:40.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:40 smithi194 ceph-mon[65619]: pgmap v750: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:42.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:42 smithi026 ceph-mon[96795]: pgmap v751: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:42.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:42 smithi194 ceph-mon[65619]: pgmap v751: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:44.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:44 smithi026 ceph-mon[96795]: pgmap v752: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:44.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:44 smithi194 ceph-mon[65619]: pgmap v752: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:46.546 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:46 smithi194 ceph-mon[65619]: pgmap v753: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:46.547 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:46 smithi026 ceph-mon[96795]: pgmap v753: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:47.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.033+0000 7f6d4aaa9700 1 -- 172.21.15.26:0/488507459 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d440f5ef0 msgr2=0x7f6d440f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:19:47.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.033+0000 7f6d4aaa9700 1 --2- 172.21.15.26:0/488507459 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d440f5ef0 0x7f6d440f6920 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f6d300045a0 tx=0x7f6d30009b30).stop 2021-11-03T17:19:47.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.033+0000 7f6d4aaa9700 1 -- 172.21.15.26:0/488507459 shutdown_connections 2021-11-03T17:19:47.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.033+0000 7f6d4aaa9700 1 --2- 172.21.15.26:0/488507459 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d440f5ef0 0x7f6d440f6920 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:47.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.033+0000 7f6d4aaa9700 1 --2- 172.21.15.26:0/488507459 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d440f55e0 0x7f6d440f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:47.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.033+0000 7f6d4aaa9700 1 -- 172.21.15.26:0/488507459 >> 172.21.15.26:0/488507459 conn(0x7f6d440f0de0 msgr2=0x7f6d440f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:19:47.030 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.033+0000 7f6d4aaa9700 1 -- 172.21.15.26:0/488507459 shutdown_connections 2021-11-03T17:19:47.030 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.033+0000 7f6d4aaa9700 1 -- 172.21.15.26:0/488507459 wait complete. 2021-11-03T17:19:47.030 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.034+0000 7f6d4aaa9700 1 Processor -- start 2021-11-03T17:19:47.030 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.034+0000 7f6d4aaa9700 1 -- start start 2021-11-03T17:19:47.033 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.034+0000 7f6d4aaa9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d440f55e0 0x7f6d440f97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:19:47.033 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.034+0000 7f6d4aaa9700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d440f5ef0 0x7f6d440f7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:19:47.034 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.034+0000 7f6d4aaa9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d440f81c0 con 0x7f6d440f55e0 2021-11-03T17:19:47.034 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.034+0000 7f6d4aaa9700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d440f8300 con 0x7f6d440f5ef0 2021-11-03T17:19:47.034 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.034+0000 7f6d48845700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d440f55e0 0x7f6d440f97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:19:47.035 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.034+0000 7f6d48845700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d440f55e0 0x7f6d440f97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53772/0 (socket says 172.21.15.26:53772) 2021-11-03T17:19:47.035 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.034+0000 7f6d48845700 1 -- 172.21.15.26:0/3619703995 learned_addr learned my addr 172.21.15.26:0/3619703995 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:19:47.035 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.034+0000 7f6d43fff700 1 --2- 172.21.15.26:0/3619703995 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d440f5ef0 0x7f6d440f7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:19:47.035 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.035+0000 7f6d48845700 1 -- 172.21.15.26:0/3619703995 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d440f5ef0 msgr2=0x7f6d440f7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:19:47.035 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.035+0000 7f6d48845700 1 --2- 172.21.15.26:0/3619703995 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d440f5ef0 0x7f6d440f7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:47.036 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.035+0000 7f6d48845700 1 -- 172.21.15.26:0/3619703995 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d30005040 con 0x7f6d440f55e0 2021-11-03T17:19:47.036 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.035+0000 7f6d48845700 1 --2- 172.21.15.26:0/3619703995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d440f55e0 0x7f6d440f97e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f6d3800e7c0 tx=0x7f6d3800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:19:47.036 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.035+0000 7f6d417fa700 1 -- 172.21.15.26:0/3619703995 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d380092e0 con 0x7f6d440f55e0 2021-11-03T17:19:47.037 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.035+0000 7f6d417fa700 1 -- 172.21.15.26:0/3619703995 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6d3800f040 con 0x7f6d440f55e0 2021-11-03T17:19:47.037 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.035+0000 7f6d417fa700 1 -- 172.21.15.26:0/3619703995 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d38014880 con 0x7f6d440f55e0 2021-11-03T17:19:47.037 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.035+0000 7f6d4aaa9700 1 -- 172.21.15.26:0/3619703995 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d440f85e0 con 0x7f6d440f55e0 2021-11-03T17:19:47.037 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.035+0000 7f6d4aaa9700 1 -- 172.21.15.26:0/3619703995 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d4410ef20 con 0x7f6d440f55e0 2021-11-03T17:19:47.038 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.036+0000 7f6d4aaa9700 1 -- 172.21.15.26:0/3619703995 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d44045ad0 con 0x7f6d440f55e0 2021-11-03T17:19:47.038 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.036+0000 7f6d417fa700 1 -- 172.21.15.26:0/3619703995 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f6d3801b030 con 0x7f6d440f55e0 2021-11-03T17:19:47.038 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.037+0000 7f6d417fa700 1 --2- 172.21.15.26:0/3619703995 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6d340640b0 0x7f6d34066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:19:47.039 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.037+0000 7f6d417fa700 1 -- 172.21.15.26:0/3619703995 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f6d38080800 con 0x7f6d440f55e0 2021-11-03T17:19:47.039 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.037+0000 7f6d43fff700 1 --2- 172.21.15.26:0/3619703995 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6d340640b0 0x7f6d34066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:19:47.039 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.037+0000 7f6d43fff700 1 --2- 172.21.15.26:0/3619703995 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6d340640b0 0x7f6d34066570 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f6d30004cc0 tx=0x7f6d30016040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:19:47.040 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.041+0000 7f6d417fa700 1 -- 172.21.15.26:0/3619703995 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f6d38052a70 con 0x7f6d440f55e0 2021-11-03T17:19:47.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.218+0000 7f6d4aaa9700 1 -- 172.21.15.26:0/3619703995 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d440fad60 con 0x7f6d340640b0 2021-11-03T17:19:47.213 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.219+0000 7f6d417fa700 1 -- 172.21.15.26:0/3619703995 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f6d440fad60 con 0x7f6d340640b0 2021-11-03T17:19:47.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.221+0000 7f6d4aaa9700 1 -- 172.21.15.26:0/3619703995 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6d340640b0 msgr2=0x7f6d34066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:19:47.216 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.221+0000 7f6d4aaa9700 1 --2- 172.21.15.26:0/3619703995 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6d340640b0 0x7f6d34066570 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f6d30004cc0 tx=0x7f6d30016040).stop 2021-11-03T17:19:47.216 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.221+0000 7f6d4aaa9700 1 -- 172.21.15.26:0/3619703995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d440f55e0 msgr2=0x7f6d440f97e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:19:47.216 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.221+0000 7f6d4aaa9700 1 --2- 172.21.15.26:0/3619703995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d440f55e0 0x7f6d440f97e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f6d3800e7c0 tx=0x7f6d3800b040).stop 2021-11-03T17:19:47.216 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.221+0000 7f6d4aaa9700 1 -- 172.21.15.26:0/3619703995 shutdown_connections 2021-11-03T17:19:47.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.221+0000 7f6d4aaa9700 1 --2- 172.21.15.26:0/3619703995 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6d340640b0 0x7f6d34066570 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:47.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.221+0000 7f6d4aaa9700 1 --2- 172.21.15.26:0/3619703995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d440f55e0 0x7f6d440f97e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:47.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.221+0000 7f6d4aaa9700 1 --2- 172.21.15.26:0/3619703995 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d440f5ef0 0x7f6d440f7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:47.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.221+0000 7f6d4aaa9700 1 -- 172.21.15.26:0/3619703995 >> 172.21.15.26:0/3619703995 conn(0x7f6d440f0de0 msgr2=0x7f6d4405ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:19:47.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.221+0000 7f6d4aaa9700 1 -- 172.21.15.26:0/3619703995 shutdown_connections 2021-11-03T17:19:47.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.221+0000 7f6d4aaa9700 1 -- 172.21.15.26:0/3619703995 wait complete. 2021-11-03T17:19:47.227 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:19:47.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.322+0000 7f26e2e1a700 1 -- 172.21.15.26:0/1302523791 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26dc0f7960 msgr2=0x7f26dc0f7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:19:47.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.322+0000 7f26e2e1a700 1 --2- 172.21.15.26:0/1302523791 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26dc0f7960 0x7f26dc0f7dc0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f26d0004660 tx=0x7f26d0009b30).stop 2021-11-03T17:19:47.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.322+0000 7f26e2e1a700 1 -- 172.21.15.26:0/1302523791 shutdown_connections 2021-11-03T17:19:47.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.322+0000 7f26e2e1a700 1 --2- 172.21.15.26:0/1302523791 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26dc0f7960 0x7f26dc0f7dc0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:47.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.322+0000 7f26e2e1a700 1 --2- 172.21.15.26:0/1302523791 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26dc0f66c0 0x7f26dc0f6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:47.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.322+0000 7f26e2e1a700 1 -- 172.21.15.26:0/1302523791 >> 172.21.15.26:0/1302523791 conn(0x7f26dc0f1e20 msgr2=0x7f26dc0f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:19:47.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.322+0000 7f26e2e1a700 1 -- 172.21.15.26:0/1302523791 shutdown_connections 2021-11-03T17:19:47.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.322+0000 7f26e2e1a700 1 -- 172.21.15.26:0/1302523791 wait complete. 2021-11-03T17:19:47.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.322+0000 7f26e2e1a700 1 Processor -- start 2021-11-03T17:19:47.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.322+0000 7f26e2e1a700 1 -- start start 2021-11-03T17:19:47.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.323+0000 7f26e2e1a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26dc0f66c0 0x7f26dc106ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:19:47.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.323+0000 7f26e2e1a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26dc0f7960 0x7f26dc1073b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:19:47.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.323+0000 7f26e2e1a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc107960 con 0x7f26dc0f7960 2021-11-03T17:19:47.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.323+0000 7f26e2e1a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc107aa0 con 0x7f26dc0f66c0 2021-11-03T17:19:47.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.323+0000 7f26dbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26dc0f7960 0x7f26dc1073b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:19:47.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.323+0000 7f26dbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26dc0f7960 0x7f26dc1073b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53784/0 (socket says 172.21.15.26:53784) 2021-11-03T17:19:47.325 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.323+0000 7f26dbfff700 1 -- 172.21.15.26:0/2548583368 learned_addr learned my addr 172.21.15.26:0/2548583368 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:19:47.325 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.323+0000 7f26e0bb6700 1 --2- 172.21.15.26:0/2548583368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26dc0f66c0 0x7f26dc106ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:19:47.325 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.323+0000 7f26dbfff700 1 -- 172.21.15.26:0/2548583368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26dc0f66c0 msgr2=0x7f26dc106ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:19:47.325 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.323+0000 7f26dbfff700 1 --2- 172.21.15.26:0/2548583368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26dc0f66c0 0x7f26dc106ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:47.326 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.323+0000 7f26dbfff700 1 -- 172.21.15.26:0/2548583368 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d0005040 con 0x7f26dc0f7960 2021-11-03T17:19:47.326 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.323+0000 7f26dbfff700 1 --2- 172.21.15.26:0/2548583368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26dc0f7960 0x7f26dc1073b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f26d0009990 tx=0x7f26d0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:19:47.326 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.323+0000 7f26d97fa700 1 -- 172.21.15.26:0/2548583368 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26d0018070 con 0x7f26dc0f7960 2021-11-03T17:19:47.326 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.323+0000 7f26d97fa700 1 -- 172.21.15.26:0/2548583368 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f26d0007ba0 con 0x7f26dc0f7960 2021-11-03T17:19:47.327 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.323+0000 7f26e2e1a700 1 -- 172.21.15.26:0/2548583368 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26dc1083e0 con 0x7f26dc0f7960 2021-11-03T17:19:47.327 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.323+0000 7f26d97fa700 1 -- 172.21.15.26:0/2548583368 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26d001c3c0 con 0x7f26dc0f7960 2021-11-03T17:19:47.327 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.323+0000 7f26e2e1a700 1 -- 172.21.15.26:0/2548583368 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26dc108940 con 0x7f26dc0f7960 2021-11-03T17:19:47.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.324+0000 7f26e2e1a700 1 -- 172.21.15.26:0/2548583368 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26dc045ad0 con 0x7f26dc0f7960 2021-11-03T17:19:47.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.325+0000 7f26d97fa700 1 -- 172.21.15.26:0/2548583368 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f26d001d420 con 0x7f26dc0f7960 2021-11-03T17:19:47.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.325+0000 7f26d97fa700 1 --2- 172.21.15.26:0/2548583368 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f26c40640b0 0x7f26c4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:19:47.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.325+0000 7f26d97fa700 1 -- 172.21.15.26:0/2548583368 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f26d0082340 con 0x7f26dc0f7960 2021-11-03T17:19:47.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.325+0000 7f26e0bb6700 1 --2- 172.21.15.26:0/2548583368 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f26c40640b0 0x7f26c4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:19:47.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.326+0000 7f26e0bb6700 1 --2- 172.21.15.26:0/2548583368 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f26c40640b0 0x7f26c4066570 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f26dc0f77c0 tx=0x7f26d4009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:19:47.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.329+0000 7f26d97fa700 1 -- 172.21.15.26:0/2548583368 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f26d0054760 con 0x7f26dc0f7960 2021-11-03T17:19:47.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.501+0000 7f26e2e1a700 1 -- 172.21.15.26:0/2548583368 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f26dc108bb0 con 0x7f26c40640b0 2021-11-03T17:19:47.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.515+0000 7f26d97fa700 1 -- 172.21.15.26:0/2548583368 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f26dc108bb0 con 0x7f26c40640b0 2021-11-03T17:19:47.510 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:19:47.511 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (31m) 61s ago 32m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:19:47.511 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (23m) 61s ago 32m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:19:47.512 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (23m) 10m ago 31m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:19:47.512 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (30m) 61s ago 31m 39.6M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:19:47.512 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (24m) 61s ago 27m 19.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:19:47.513 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (24m) 61s ago 27m 20.6M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:19:47.513 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (27m) 10m ago 27m 19.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:19:47.514 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (27m) 10m ago 27m 19.4M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:19:47.514 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (24m) 61s ago 33m 505M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:19:47.515 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (24m) 10m ago 31m 415M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:19:47.515 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (24m) 61s ago 33m 147M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:19:47.515 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (23m) 10m ago 31m 70.2M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:19:47.516 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (31m) 61s ago 31m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:19:47.516 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (31m) 10m ago 31m 18.4M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:19:47.517 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (22m) 61s ago 30m 211M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:19:47.517 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (22m) 61s ago 30m 226M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:19:47.517 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (21m) 61s ago 29m 189M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:19:47.517 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (21m) 10m ago 29m 211M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:19:47.518 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (20m) 10m ago 29m 189M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:19:47.518 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (20m) 10m ago 28m 174M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:19:47.518 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (30m) 61s ago 31m 52.1M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:19:47.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.517+0000 7f26e2e1a700 1 -- 172.21.15.26:0/2548583368 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f26c40640b0 msgr2=0x7f26c4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:19:47.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.517+0000 7f26e2e1a700 1 --2- 172.21.15.26:0/2548583368 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f26c40640b0 0x7f26c4066570 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f26dc0f77c0 tx=0x7f26d4009040).stop 2021-11-03T17:19:47.520 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.517+0000 7f26e2e1a700 1 -- 172.21.15.26:0/2548583368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26dc0f7960 msgr2=0x7f26dc1073b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:19:47.520 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.517+0000 7f26e2e1a700 1 --2- 172.21.15.26:0/2548583368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26dc0f7960 0x7f26dc1073b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f26d0009990 tx=0x7f26d0009b30).stop 2021-11-03T17:19:47.521 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.517+0000 7f26e2e1a700 1 -- 172.21.15.26:0/2548583368 shutdown_connections 2021-11-03T17:19:47.521 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.517+0000 7f26e2e1a700 1 --2- 172.21.15.26:0/2548583368 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f26c40640b0 0x7f26c4066570 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:47.521 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.517+0000 7f26e2e1a700 1 --2- 172.21.15.26:0/2548583368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26dc0f66c0 0x7f26dc106ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:47.521 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.517+0000 7f26e2e1a700 1 --2- 172.21.15.26:0/2548583368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26dc0f7960 0x7f26dc1073b0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:47.522 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.517+0000 7f26e2e1a700 1 -- 172.21.15.26:0/2548583368 >> 172.21.15.26:0/2548583368 conn(0x7f26dc0f1e20 msgr2=0x7f26dc0fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:19:47.522 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.517+0000 7f26e2e1a700 1 -- 172.21.15.26:0/2548583368 shutdown_connections 2021-11-03T17:19:47.522 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.517+0000 7f26e2e1a700 1 -- 172.21.15.26:0/2548583368 wait complete. 2021-11-03T17:19:47.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.616+0000 7f3b6dbc5700 1 -- 172.21.15.26:0/1808483543 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b680f6860 msgr2=0x7f3b680f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:19:47.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.616+0000 7f3b6dbc5700 1 --2- 172.21.15.26:0/1808483543 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b680f6860 0x7f3b680f6cc0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f3b5c004660 tx=0x7f3b5c009b30).stop 2021-11-03T17:19:47.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.617+0000 7f3b6dbc5700 1 -- 172.21.15.26:0/1808483543 shutdown_connections 2021-11-03T17:19:47.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.617+0000 7f3b6dbc5700 1 --2- 172.21.15.26:0/1808483543 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b680f6860 0x7f3b680f6cc0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:47.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.617+0000 7f3b6dbc5700 1 --2- 172.21.15.26:0/1808483543 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b680f55c0 0x7f3b680f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:47.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.617+0000 7f3b6dbc5700 1 -- 172.21.15.26:0/1808483543 >> 172.21.15.26:0/1808483543 conn(0x7f3b680f0d40 msgr2=0x7f3b680f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:19:47.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.617+0000 7f3b6dbc5700 1 -- 172.21.15.26:0/1808483543 shutdown_connections 2021-11-03T17:19:47.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.617+0000 7f3b6dbc5700 1 -- 172.21.15.26:0/1808483543 wait complete. 2021-11-03T17:19:47.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.617+0000 7f3b6dbc5700 1 Processor -- start 2021-11-03T17:19:47.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.617+0000 7f3b6dbc5700 1 -- start start 2021-11-03T17:19:47.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.617+0000 7f3b6dbc5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b680f55c0 0x7f3b68105e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:19:47.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.617+0000 7f3b6dbc5700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b680f6860 0x7f3b68106320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:19:47.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.617+0000 7f3b6dbc5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b68106920 con 0x7f3b680f55c0 2021-11-03T17:19:47.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.618+0000 7f3b6dbc5700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b68107130 con 0x7f3b680f6860 2021-11-03T17:19:47.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.618+0000 7f3b677fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b680f55c0 0x7f3b68105e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:19:47.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.618+0000 7f3b677fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b680f55c0 0x7f3b68105e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53792/0 (socket says 172.21.15.26:53792) 2021-11-03T17:19:47.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.618+0000 7f3b677fe700 1 -- 172.21.15.26:0/842849394 learned_addr learned my addr 172.21.15.26:0/842849394 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:19:47.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.618+0000 7f3b66ffd700 1 --2- 172.21.15.26:0/842849394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b680f6860 0x7f3b68106320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:19:47.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.618+0000 7f3b677fe700 1 -- 172.21.15.26:0/842849394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b680f6860 msgr2=0x7f3b68106320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:19:47.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.618+0000 7f3b677fe700 1 --2- 172.21.15.26:0/842849394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b680f6860 0x7f3b68106320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:47.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.618+0000 7f3b677fe700 1 -- 172.21.15.26:0/842849394 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b5c005040 con 0x7f3b680f55c0 2021-11-03T17:19:47.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.618+0000 7f3b677fe700 1 --2- 172.21.15.26:0/842849394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b680f55c0 0x7f3b68105e30 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f3b58002700 tx=0x7f3b58009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:19:47.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.618+0000 7f3b4ffff700 1 -- 172.21.15.26:0/842849394 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b580079c0 con 0x7f3b680f55c0 2021-11-03T17:19:47.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.618+0000 7f3b6dbc5700 1 -- 172.21.15.26:0/842849394 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b681073b0 con 0x7f3b680f55c0 2021-11-03T17:19:47.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.618+0000 7f3b4ffff700 1 -- 172.21.15.26:0/842849394 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3b5800f040 con 0x7f3b680f55c0 2021-11-03T17:19:47.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.618+0000 7f3b4ffff700 1 -- 172.21.15.26:0/842849394 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b58014850 con 0x7f3b680f55c0 2021-11-03T17:19:47.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.618+0000 7f3b6dbc5700 1 -- 172.21.15.26:0/842849394 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b68107970 con 0x7f3b680f55c0 2021-11-03T17:19:47.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.619+0000 7f3b6dbc5700 1 -- 172.21.15.26:0/842849394 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b680f49b0 con 0x7f3b680f55c0 2021-11-03T17:19:47.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.620+0000 7f3b4ffff700 1 -- 172.21.15.26:0/842849394 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f3b5801b060 con 0x7f3b680f55c0 2021-11-03T17:19:47.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.620+0000 7f3b4ffff700 1 --2- 172.21.15.26:0/842849394 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3b50064090 0x7f3b50066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:19:47.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.620+0000 7f3b4ffff700 1 -- 172.21.15.26:0/842849394 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f3b58080650 con 0x7f3b680f55c0 2021-11-03T17:19:47.622 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.620+0000 7f3b66ffd700 1 --2- 172.21.15.26:0/842849394 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3b50064090 0x7f3b50066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:19:47.622 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.621+0000 7f3b66ffd700 1 --2- 172.21.15.26:0/842849394 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3b50064090 0x7f3b50066550 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f3b5c004e30 tx=0x7f3b5c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:19:47.623 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.624+0000 7f3b4ffff700 1 -- 172.21.15.26:0/842849394 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f3b580529b0 con 0x7f3b680f55c0 2021-11-03T17:19:47.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:47 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:19:47.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:47 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:19:47.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.854+0000 7f3b6dbc5700 1 -- 172.21.15.26:0/842849394 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3b68045ad0 con 0x7f3b680f55c0 2021-11-03T17:19:47.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.855+0000 7f3b4ffff700 1 -- 172.21.15.26:0/842849394 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f3b580525a0 con 0x7f3b680f55c0 2021-11-03T17:19:47.850 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:19:47.850 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:19:47.851 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:19:47.851 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:19:47.851 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:19:47.851 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:19:47.851 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:19:47.852 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:19:47.852 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:19:47.852 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:19:47.852 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:19:47.853 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:19:47.853 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:19:47.853 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:19:47.853 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:19:47.853 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:19:47.854 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:19:47.854 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:19:47.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.857+0000 7f3b6dbc5700 1 -- 172.21.15.26:0/842849394 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3b50064090 msgr2=0x7f3b50066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:19:47.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.857+0000 7f3b6dbc5700 1 --2- 172.21.15.26:0/842849394 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3b50064090 0x7f3b50066550 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f3b5c004e30 tx=0x7f3b5c009b30).stop 2021-11-03T17:19:47.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.857+0000 7f3b6dbc5700 1 -- 172.21.15.26:0/842849394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b680f55c0 msgr2=0x7f3b68105e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:19:47.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.857+0000 7f3b6dbc5700 1 --2- 172.21.15.26:0/842849394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b680f55c0 0x7f3b68105e30 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f3b58002700 tx=0x7f3b58009e00).stop 2021-11-03T17:19:47.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.857+0000 7f3b6dbc5700 1 -- 172.21.15.26:0/842849394 shutdown_connections 2021-11-03T17:19:47.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.857+0000 7f3b6dbc5700 1 --2- 172.21.15.26:0/842849394 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3b50064090 0x7f3b50066550 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:47.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.857+0000 7f3b6dbc5700 1 --2- 172.21.15.26:0/842849394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b680f55c0 0x7f3b68105e30 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:47.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.857+0000 7f3b6dbc5700 1 --2- 172.21.15.26:0/842849394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b680f6860 0x7f3b68106320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:47.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.857+0000 7f3b6dbc5700 1 -- 172.21.15.26:0/842849394 >> 172.21.15.26:0/842849394 conn(0x7f3b680f0d40 msgr2=0x7f3b680fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:19:47.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.857+0000 7f3b6dbc5700 1 -- 172.21.15.26:0/842849394 shutdown_connections 2021-11-03T17:19:47.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.857+0000 7f3b6dbc5700 1 -- 172.21.15.26:0/842849394 wait complete. 2021-11-03T17:19:47.951 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.957+0000 7fa71193f700 1 -- 172.21.15.26:0/362434959 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa70c0f55e0 msgr2=0x7fa70c0f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:19:47.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.957+0000 7fa71193f700 1 --2- 172.21.15.26:0/362434959 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa70c0f55e0 0x7fa70c0f5a00 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7fa6fc004660 tx=0x7fa6fc009b30).stop 2021-11-03T17:19:47.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.957+0000 7fa71193f700 1 -- 172.21.15.26:0/362434959 shutdown_connections 2021-11-03T17:19:47.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.957+0000 7fa71193f700 1 --2- 172.21.15.26:0/362434959 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa70c0f5ef0 0x7fa70c0f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:47.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.957+0000 7fa71193f700 1 --2- 172.21.15.26:0/362434959 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa70c0f55e0 0x7fa70c0f5a00 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:47.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.957+0000 7fa71193f700 1 -- 172.21.15.26:0/362434959 >> 172.21.15.26:0/362434959 conn(0x7fa70c0f0de0 msgr2=0x7fa70c0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:19:47.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.957+0000 7fa71193f700 1 -- 172.21.15.26:0/362434959 shutdown_connections 2021-11-03T17:19:47.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.957+0000 7fa71193f700 1 -- 172.21.15.26:0/362434959 wait complete. 2021-11-03T17:19:47.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.958+0000 7fa71193f700 1 Processor -- start 2021-11-03T17:19:47.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.958+0000 7fa71193f700 1 -- start start 2021-11-03T17:19:47.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.958+0000 7fa71193f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa70c0f55e0 0x7fa70c0f97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:19:47.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.958+0000 7fa71193f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa70c0f5ef0 0x7fa70c0f7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:19:47.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.958+0000 7fa71193f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70c0f81c0 con 0x7fa70c0f55e0 2021-11-03T17:19:47.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.958+0000 7fa71193f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70c0f8300 con 0x7fa70c0f5ef0 2021-11-03T17:19:47.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.958+0000 7fa70affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa70c0f55e0 0x7fa70c0f97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:19:47.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.958+0000 7fa70affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa70c0f55e0 0x7fa70c0f97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53802/0 (socket says 172.21.15.26:53802) 2021-11-03T17:19:47.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.958+0000 7fa70affd700 1 -- 172.21.15.26:0/412127988 learned_addr learned my addr 172.21.15.26:0/412127988 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:19:47.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.958+0000 7fa70a7fc700 1 --2- 172.21.15.26:0/412127988 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa70c0f5ef0 0x7fa70c0f7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:19:47.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.959+0000 7fa70affd700 1 -- 172.21.15.26:0/412127988 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa70c0f5ef0 msgr2=0x7fa70c0f7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:19:47.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.959+0000 7fa70affd700 1 --2- 172.21.15.26:0/412127988 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa70c0f5ef0 0x7fa70c0f7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:47.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.959+0000 7fa70affd700 1 -- 172.21.15.26:0/412127988 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6fc005040 con 0x7fa70c0f55e0 2021-11-03T17:19:47.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.959+0000 7fa70affd700 1 --2- 172.21.15.26:0/412127988 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa70c0f55e0 0x7fa70c0f97e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7fa6fc000c00 tx=0x7fa6fc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:19:47.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.959+0000 7fa6f37fe700 1 -- 172.21.15.26:0/412127988 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6fc019070 con 0x7fa70c0f55e0 2021-11-03T17:19:47.961 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.959+0000 7fa6f37fe700 1 -- 172.21.15.26:0/412127988 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa6fc007e70 con 0x7fa70c0f55e0 2021-11-03T17:19:47.961 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.959+0000 7fa71193f700 1 -- 172.21.15.26:0/412127988 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa70c0f8580 con 0x7fa70c0f55e0 2021-11-03T17:19:47.961 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.959+0000 7fa6f37fe700 1 -- 172.21.15.26:0/412127988 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6fc014ce0 con 0x7fa70c0f55e0 2021-11-03T17:19:47.961 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.959+0000 7fa71193f700 1 -- 172.21.15.26:0/412127988 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa70c0f8ae0 con 0x7fa70c0f55e0 2021-11-03T17:19:47.962 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.960+0000 7fa71193f700 1 -- 172.21.15.26:0/412127988 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa70c045ad0 con 0x7fa70c0f55e0 2021-11-03T17:19:47.962 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.960+0000 7fa6f37fe700 1 -- 172.21.15.26:0/412127988 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fa6fc025070 con 0x7fa70c0f55e0 2021-11-03T17:19:47.963 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.961+0000 7fa6f37fe700 1 --2- 172.21.15.26:0/412127988 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa6f40640b0 0x7fa6f4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:19:47.963 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.961+0000 7fa6f37fe700 1 -- 172.21.15.26:0/412127988 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fa6fc081770 con 0x7fa70c0f55e0 2021-11-03T17:19:47.963 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.961+0000 7fa70a7fc700 1 --2- 172.21.15.26:0/412127988 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa6f40640b0 0x7fa6f4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:19:47.963 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.961+0000 7fa70a7fc700 1 --2- 172.21.15.26:0/412127988 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa6f40640b0 0x7fa6f4066570 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fa700009fd0 tx=0x7fa70000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:19:47.964 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:47.965+0000 7fa6f37fe700 1 -- 172.21.15.26:0/412127988 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fa6fc053ad0 con 0x7fa70c0f55e0 2021-11-03T17:19:48.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:48.183+0000 7fa71193f700 1 -- 172.21.15.26:0/412127988 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa70c10f5e0 con 0x7fa70c0f55e0 2021-11-03T17:19:48.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:48.184+0000 7fa6f37fe700 1 -- 172.21.15.26:0/412127988 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fa6fc023020 con 0x7fa70c0f55e0 2021-11-03T17:19:48.179 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:19:48.179 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:19:48.179 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:19:48.180 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:19:48.180 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:19:48.180 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:19:48.180 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:19:48.181 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:19:48.181 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:19:48.181 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:19:48.181 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:19:48.181 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:19:48.182 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:19:48.182 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:19:48.182 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:19:48.182 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:19:48.183 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:19:48.183 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:19:48.183 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:19:48.183 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:19:48.184 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:19:48.184 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:19:48.184 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:19:48.185 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:19:48.185 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:19:48.185 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:19:48.185 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:19:48.186 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:19:48.186 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:19:48.186 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:19:48.186 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:19:48.187 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:19:48.187 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:19:48.187 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:19:48.187 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:19:48.187 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:19:48.188 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:19:48.188 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:19:48.188 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:19:48.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:48.185+0000 7fa71193f700 1 -- 172.21.15.26:0/412127988 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa6f40640b0 msgr2=0x7fa6f4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:19:48.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:48.185+0000 7fa71193f700 1 --2- 172.21.15.26:0/412127988 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa6f40640b0 0x7fa6f4066570 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fa700009fd0 tx=0x7fa70000b040).stop 2021-11-03T17:19:48.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:48.185+0000 7fa71193f700 1 -- 172.21.15.26:0/412127988 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa70c0f55e0 msgr2=0x7fa70c0f97e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:19:48.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:48.185+0000 7fa71193f700 1 --2- 172.21.15.26:0/412127988 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa70c0f55e0 0x7fa70c0f97e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7fa6fc000c00 tx=0x7fa6fc00b040).stop 2021-11-03T17:19:48.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:48.186+0000 7fa71193f700 1 -- 172.21.15.26:0/412127988 shutdown_connections 2021-11-03T17:19:48.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:48.186+0000 7fa71193f700 1 --2- 172.21.15.26:0/412127988 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa6f40640b0 0x7fa6f4066570 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:48.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:48.186+0000 7fa71193f700 1 --2- 172.21.15.26:0/412127988 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa70c0f55e0 0x7fa70c0f97e0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:48.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:48.186+0000 7fa71193f700 1 --2- 172.21.15.26:0/412127988 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa70c0f5ef0 0x7fa70c0f7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:19:48.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:48.186+0000 7fa71193f700 1 -- 172.21.15.26:0/412127988 >> 172.21.15.26:0/412127988 conn(0x7fa70c0f0de0 msgr2=0x7fa70c05ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:19:48.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:48.186+0000 7fa71193f700 1 -- 172.21.15.26:0/412127988 shutdown_connections 2021-11-03T17:19:48.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:19:48.186+0000 7fa71193f700 1 -- 172.21.15.26:0/412127988 wait complete. 2021-11-03T17:19:48.192 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:19:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:48 smithi026 ceph-mon[96795]: poll took 60063.346 ms: 1 events 2021-11-03T17:19:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:48 smithi026 ceph-mon[96795]: pgmap v754: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:48 smithi026 ceph-mon[96795]: from='client.34924 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:19:48.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:48 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/842849394' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:19:48.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:19:48.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:19:48.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:48 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/412127988' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:19:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:48 smithi194 ceph-mon[65619]: poll took 60063.346 ms: 1 events 2021-11-03T17:19:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:48 smithi194 ceph-mon[65619]: pgmap v754: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:48.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:48 smithi194 ceph-mon[65619]: from='client.34924 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:19:48.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:48 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/842849394' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:19:48.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:19:48.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:19:48.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:48 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/412127988' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:19:49.664 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:49 smithi194 ceph-mon[65619]: from='client.34928 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:19:49.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:49 smithi026 ceph-mon[96795]: from='client.34928 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:19:50.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:50 smithi026 ceph-mon[96795]: pgmap v755: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:50.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:50 smithi026 ceph-mon[96795]: poll took 2435.124 ms: 1 events 2021-11-03T17:19:50.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:50 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:19:50.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:50 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:19:50.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:50 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:19:50.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:50 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:19:50.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:50 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:19:50.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:50 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:19:50.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:50 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:19:50.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:50 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:19:50.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:50 smithi194 ceph-mon[65619]: pgmap v755: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:50.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:50 smithi194 ceph-mon[65619]: poll took 2435.124 ms: 1 events 2021-11-03T17:19:50.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:50 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:19:50.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:50 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:19:50.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:50 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:19:50.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:50 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:19:50.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:50 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:19:50.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:50 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:19:50.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:50 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:19:50.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:50 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:19:51.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:51 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:19:51.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:51 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:19:51.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:51 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:19:51.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:51 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:19:52.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:52 smithi026 ceph-mon[96795]: pgmap v756: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:52.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:52 smithi194 ceph-mon[65619]: pgmap v756: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:54.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:54 smithi026 ceph-mon[96795]: pgmap v757: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:54.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:54 smithi194 ceph-mon[65619]: pgmap v757: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:56.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:56 smithi026 ceph-mon[96795]: pgmap v758: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:56.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:56 smithi194 ceph-mon[65619]: pgmap v758: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:58.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:19:58 smithi026 ceph-mon[96795]: pgmap v759: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:19:58.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:19:58 smithi194 ceph-mon[65619]: pgmap v759: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:00.359 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:00 smithi026 conmon[96772]: 2021-11-03T17:19:59.999+0000 7f27986f6700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 2 daemons have recently crashed 2021-11-03T17:20:00.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:00 smithi026 ceph-mon[96795]: pgmap v760: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:00.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:00 smithi026 ceph-mon[96795]: overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 2 daemons have recently crashed 2021-11-03T17:20:00.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:00 smithi194 ceph-mon[65619]: pgmap v760: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:00.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:00 smithi194 ceph-mon[65619]: overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 2 daemons have recently crashed 2021-11-03T17:20:02.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:02 smithi026 ceph-mon[96795]: pgmap v761: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:02.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:02 smithi194 ceph-mon[65619]: pgmap v761: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:04.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:04 smithi026 ceph-mon[96795]: pgmap v762: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:04.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:04 smithi194 ceph-mon[65619]: pgmap v762: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:05.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:05 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:20:05.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:05 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:20:06.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:06 smithi026 ceph-mon[96795]: pgmap v763: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:06.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:06 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:20:06.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:06 smithi194 ceph-mon[65619]: pgmap v763: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:06.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:06 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:20:08.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:08 smithi026 ceph-mon[96795]: pgmap v764: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:08.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:08 smithi194 ceph-mon[65619]: pgmap v764: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:10.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:10 smithi026 ceph-mon[96795]: pgmap v765: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:10.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:10 smithi194 ceph-mon[65619]: pgmap v765: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:12.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:12 smithi026 ceph-mon[96795]: pgmap v766: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:12.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:12 smithi194 ceph-mon[65619]: pgmap v766: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:14.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:14 smithi026 ceph-mon[96795]: pgmap v767: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:14.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:14 smithi194 ceph-mon[65619]: pgmap v767: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:16.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:16 smithi026 ceph-mon[96795]: pgmap v768: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:16.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:16 smithi194 ceph-mon[65619]: pgmap v768: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:18.296 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.299+0000 7f3adde6a700 1 -- 172.21.15.26:0/951607278 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ad80f6ff0 msgr2=0x7f3ad80f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:20:18.297 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.299+0000 7f3adde6a700 1 --2- 172.21.15.26:0/951607278 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ad80f6ff0 0x7f3ad80f7a20 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f3ac8004660 tx=0x7f3ac8009b30).stop 2021-11-03T17:20:18.297 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.299+0000 7f3adde6a700 1 -- 172.21.15.26:0/951607278 shutdown_connections 2021-11-03T17:20:18.297 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.299+0000 7f3adde6a700 1 --2- 172.21.15.26:0/951607278 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ad80f6ff0 0x7f3ad80f7a20 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:18.297 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.299+0000 7f3adde6a700 1 --2- 172.21.15.26:0/951607278 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ad80f66e0 0x7f3ad80f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:18.297 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.299+0000 7f3adde6a700 1 -- 172.21.15.26:0/951607278 >> 172.21.15.26:0/951607278 conn(0x7f3ad80f1f00 msgr2=0x7f3ad80f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:20:18.298 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.300+0000 7f3adde6a700 1 -- 172.21.15.26:0/951607278 shutdown_connections 2021-11-03T17:20:18.298 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.300+0000 7f3adde6a700 1 -- 172.21.15.26:0/951607278 wait complete. 2021-11-03T17:20:18.298 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.300+0000 7f3adde6a700 1 Processor -- start 2021-11-03T17:20:18.298 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.300+0000 7f3adde6a700 1 -- start start 2021-11-03T17:20:18.299 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.300+0000 7f3adde6a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ad80f66e0 0x7f3ad8106f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:20:18.299 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.300+0000 7f3adde6a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ad80f6ff0 0x7f3ad81073f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:20:18.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.300+0000 7f3adde6a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad81079a0 con 0x7f3ad80f66e0 2021-11-03T17:20:18.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.300+0000 7f3adde6a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad8107ae0 con 0x7f3ad80f6ff0 2021-11-03T17:20:18.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.301+0000 7f3ad77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ad80f66e0 0x7f3ad8106f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:20:18.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.301+0000 7f3ad77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ad80f66e0 0x7f3ad8106f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53820/0 (socket says 172.21.15.26:53820) 2021-11-03T17:20:18.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.301+0000 7f3ad77fe700 1 -- 172.21.15.26:0/254051490 learned_addr learned my addr 172.21.15.26:0/254051490 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:20:18.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.301+0000 7f3ad6ffd700 1 --2- 172.21.15.26:0/254051490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ad80f6ff0 0x7f3ad81073f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:20:18.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.301+0000 7f3ad77fe700 1 -- 172.21.15.26:0/254051490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ad80f6ff0 msgr2=0x7f3ad81073f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:20:18.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.301+0000 7f3ad77fe700 1 --2- 172.21.15.26:0/254051490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ad80f6ff0 0x7f3ad81073f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:18.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.301+0000 7f3ad77fe700 1 -- 172.21.15.26:0/254051490 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac8005040 con 0x7f3ad80f66e0 2021-11-03T17:20:18.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.301+0000 7f3ad77fe700 1 --2- 172.21.15.26:0/254051490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ad80f66e0 0x7f3ad8106f00 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f3acc0026d0 tx=0x7f3acc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:20:18.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.301+0000 7f3abffff700 1 -- 172.21.15.26:0/254051490 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3acc009320 con 0x7f3ad80f66e0 2021-11-03T17:20:18.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.301+0000 7f3adde6a700 1 -- 172.21.15.26:0/254051490 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ad8108480 con 0x7f3ad80f66e0 2021-11-03T17:20:18.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.301+0000 7f3abffff700 1 -- 172.21.15.26:0/254051490 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3acc00f040 con 0x7f3ad80f66e0 2021-11-03T17:20:18.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.301+0000 7f3abffff700 1 -- 172.21.15.26:0/254051490 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3acc0147e0 con 0x7f3ad80f66e0 2021-11-03T17:20:18.303 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.301+0000 7f3adde6a700 1 -- 172.21.15.26:0/254051490 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ad8108a40 con 0x7f3ad80f66e0 2021-11-03T17:20:18.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.302+0000 7f3adde6a700 1 -- 172.21.15.26:0/254051490 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ad8045ad0 con 0x7f3ad80f66e0 2021-11-03T17:20:18.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.303+0000 7f3abffff700 1 -- 172.21.15.26:0/254051490 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f3acc009480 con 0x7f3ad80f66e0 2021-11-03T17:20:18.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.303+0000 7f3abffff700 1 --2- 172.21.15.26:0/254051490 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3ac00640b0 0x7f3ac0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:20:18.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.303+0000 7f3abffff700 1 -- 172.21.15.26:0/254051490 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f3acc080ee0 con 0x7f3ad80f66e0 2021-11-03T17:20:18.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.303+0000 7f3ad6ffd700 1 --2- 172.21.15.26:0/254051490 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3ac00640b0 0x7f3ac0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:20:18.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.304+0000 7f3ad6ffd700 1 --2- 172.21.15.26:0/254051490 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3ac00640b0 0x7f3ac0066570 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f3ac8004630 tx=0x7f3ac8009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:20:18.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.307+0000 7f3abffff700 1 -- 172.21.15.26:0/254051490 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f3acc053240 con 0x7f3ad80f66e0 2021-11-03T17:20:18.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.487+0000 7f3adde6a700 1 -- 172.21.15.26:0/254051490 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ad80ff010 con 0x7f3ac00640b0 2021-11-03T17:20:18.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.488+0000 7f3abffff700 1 -- 172.21.15.26:0/254051490 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f3ad80ff010 con 0x7f3ac00640b0 2021-11-03T17:20:18.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.490+0000 7f3adde6a700 1 -- 172.21.15.26:0/254051490 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3ac00640b0 msgr2=0x7f3ac0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:20:18.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.490+0000 7f3adde6a700 1 --2- 172.21.15.26:0/254051490 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3ac00640b0 0x7f3ac0066570 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f3ac8004630 tx=0x7f3ac8009b30).stop 2021-11-03T17:20:18.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.490+0000 7f3adde6a700 1 -- 172.21.15.26:0/254051490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ad80f66e0 msgr2=0x7f3ad8106f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:20:18.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.490+0000 7f3adde6a700 1 --2- 172.21.15.26:0/254051490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ad80f66e0 0x7f3ad8106f00 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f3acc0026d0 tx=0x7f3acc009de0).stop 2021-11-03T17:20:18.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.490+0000 7f3adde6a700 1 -- 172.21.15.26:0/254051490 shutdown_connections 2021-11-03T17:20:18.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.490+0000 7f3adde6a700 1 --2- 172.21.15.26:0/254051490 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3ac00640b0 0x7f3ac0066570 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:18.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.490+0000 7f3adde6a700 1 --2- 172.21.15.26:0/254051490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ad80f66e0 0x7f3ad8106f00 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:18.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.490+0000 7f3adde6a700 1 --2- 172.21.15.26:0/254051490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ad80f6ff0 0x7f3ad81073f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:18.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.490+0000 7f3adde6a700 1 -- 172.21.15.26:0/254051490 >> 172.21.15.26:0/254051490 conn(0x7f3ad80f1f00 msgr2=0x7f3ad80fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:20:18.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.490+0000 7f3adde6a700 1 -- 172.21.15.26:0/254051490 shutdown_connections 2021-11-03T17:20:18.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.490+0000 7f3adde6a700 1 -- 172.21.15.26:0/254051490 wait complete. 2021-11-03T17:20:18.495 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:20:18.590 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.591+0000 7f2b4359e700 1 -- 172.21.15.26:0/3292426030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b440f66e0 msgr2=0x7f2b440f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:20:18.590 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.591+0000 7f2b4359e700 1 --2- 172.21.15.26:0/3292426030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b440f66e0 0x7f2b440f6b40 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f2b2c004660 tx=0x7f2b2c009b30).stop 2021-11-03T17:20:18.590 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.591+0000 7f2b4359e700 1 -- 172.21.15.26:0/3292426030 shutdown_connections 2021-11-03T17:20:18.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.591+0000 7f2b4359e700 1 --2- 172.21.15.26:0/3292426030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b440f66e0 0x7f2b440f6b40 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:18.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.591+0000 7f2b4359e700 1 --2- 172.21.15.26:0/3292426030 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b440f5440 0x7f2b440f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:18.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.591+0000 7f2b4359e700 1 -- 172.21.15.26:0/3292426030 >> 172.21.15.26:0/3292426030 conn(0x7f2b440f0ba0 msgr2=0x7f2b440f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:20:18.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.591+0000 7f2b4359e700 1 -- 172.21.15.26:0/3292426030 shutdown_connections 2021-11-03T17:20:18.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.591+0000 7f2b4359e700 1 -- 172.21.15.26:0/3292426030 wait complete. 2021-11-03T17:20:18.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.592+0000 7f2b4359e700 1 Processor -- start 2021-11-03T17:20:18.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.592+0000 7f2b4359e700 1 -- start start 2021-11-03T17:20:18.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.592+0000 7f2b4359e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b440f5440 0x7f2b44109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:20:18.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.592+0000 7f2b4359e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b440f66e0 0x7f2b4410bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:20:18.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.592+0000 7f2b4359e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b440603e0 con 0x7f2b440f66e0 2021-11-03T17:20:18.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.592+0000 7f2b4359e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b44060520 con 0x7f2b440f5440 2021-11-03T17:20:18.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.592+0000 7f2b41d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b440f66e0 0x7f2b4410bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:20:18.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.592+0000 7f2b41d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b440f66e0 0x7f2b4410bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53832/0 (socket says 172.21.15.26:53832) 2021-11-03T17:20:18.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.592+0000 7f2b41d9b700 1 -- 172.21.15.26:0/4058326610 learned_addr learned my addr 172.21.15.26:0/4058326610 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:20:18.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.592+0000 7f2b4259c700 1 --2- 172.21.15.26:0/4058326610 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b440f5440 0x7f2b44109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:20:18.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.592+0000 7f2b41d9b700 1 -- 172.21.15.26:0/4058326610 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b440f5440 msgr2=0x7f2b44109a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:20:18.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.592+0000 7f2b41d9b700 1 --2- 172.21.15.26:0/4058326610 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b440f5440 0x7f2b44109a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:18.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.592+0000 7f2b41d9b700 1 -- 172.21.15.26:0/4058326610 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b2c005040 con 0x7f2b440f66e0 2021-11-03T17:20:18.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.593+0000 7f2b41d9b700 1 --2- 172.21.15.26:0/4058326610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b440f66e0 0x7f2b4410bf90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f2b2c009990 tx=0x7f2b2c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:20:18.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.593+0000 7f2b3affd700 1 -- 172.21.15.26:0/4058326610 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b2c018070 con 0x7f2b440f66e0 2021-11-03T17:20:18.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.593+0000 7f2b3affd700 1 -- 172.21.15.26:0/4058326610 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2b2c007ba0 con 0x7f2b440f66e0 2021-11-03T17:20:18.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.593+0000 7f2b4359e700 1 -- 172.21.15.26:0/4058326610 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b4410c4e0 con 0x7f2b440f66e0 2021-11-03T17:20:18.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.593+0000 7f2b3affd700 1 -- 172.21.15.26:0/4058326610 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b2c01c3c0 con 0x7f2b440f66e0 2021-11-03T17:20:18.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.593+0000 7f2b4359e700 1 -- 172.21.15.26:0/4058326610 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b4410ca40 con 0x7f2b440f66e0 2021-11-03T17:20:18.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.594+0000 7f2b4359e700 1 -- 172.21.15.26:0/4058326610 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b44045ad0 con 0x7f2b440f66e0 2021-11-03T17:20:18.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.594+0000 7f2b3affd700 1 -- 172.21.15.26:0/4058326610 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f2b2c01d420 con 0x7f2b440f66e0 2021-11-03T17:20:18.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.594+0000 7f2b3affd700 1 --2- 172.21.15.26:0/4058326610 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2b30064100 0x7f2b300665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:20:18.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.595+0000 7f2b3affd700 1 -- 172.21.15.26:0/4058326610 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f2b2c082410 con 0x7f2b440f66e0 2021-11-03T17:20:18.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.595+0000 7f2b4259c700 1 --2- 172.21.15.26:0/4058326610 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2b30064100 0x7f2b300665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:20:18.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.595+0000 7f2b4259c700 1 --2- 172.21.15.26:0/4058326610 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2b30064100 0x7f2b300665c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f2b44060060 tx=0x7f2b3c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:20:18.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.599+0000 7f2b3affd700 1 -- 172.21.15.26:0/4058326610 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f2b2c054710 con 0x7f2b440f66e0 2021-11-03T17:20:18.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:18 smithi026 ceph-mon[96795]: pgmap v769: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:18.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:18 smithi194 ceph-mon[65619]: pgmap v769: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:18.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.773+0000 7f2b4359e700 1 -- 172.21.15.26:0/4058326610 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b440fddb0 con 0x7f2b30064100 2021-11-03T17:20:18.782 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.787+0000 7f2b3affd700 1 -- 172.21.15.26:0/4058326610 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f2b3c00f040 con 0x7f2b30064100 2021-11-03T17:20:18.783 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:20:18.784 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (31m) 92s ago 32m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:20:18.784 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (23m) 92s ago 32m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:20:18.784 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (23m) 29s ago 32m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:20:18.784 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (31m) 92s ago 32m 39.6M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:20:18.784 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (24m) 92s ago 27m 19.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:20:18.785 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (24m) 92s ago 27m 20.6M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:20:18.785 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (27m) 29s ago 27m 22.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:20:18.785 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (27m) 29s ago 27m 22.2M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:20:18.785 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (25m) 92s ago 34m 505M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:20:18.786 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (24m) 29s ago 31m 419M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:20:18.786 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (24m) 92s ago 34m 147M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:20:18.786 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (24m) 29s ago 31m 75.7M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:20:18.786 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (32m) 92s ago 32m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:20:18.787 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (31m) 29s ago 31m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:20:18.787 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (23m) 92s ago 31m 211M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:20:18.787 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (22m) 92s ago 30m 226M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:20:18.787 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (22m) 92s ago 30m 189M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:20:18.787 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (21m) 29s ago 30m 236M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:20:18.788 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (21m) 29s ago 29m 208M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:20:18.788 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (20m) 29s ago 29m 194M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:20:18.788 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (31m) 92s ago 32m 52.1M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:20:18.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.789+0000 7f2b4359e700 1 -- 172.21.15.26:0/4058326610 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2b30064100 msgr2=0x7f2b300665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:20:18.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.789+0000 7f2b4359e700 1 --2- 172.21.15.26:0/4058326610 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2b30064100 0x7f2b300665c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f2b44060060 tx=0x7f2b3c00b040).stop 2021-11-03T17:20:18.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.789+0000 7f2b4359e700 1 -- 172.21.15.26:0/4058326610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b440f66e0 msgr2=0x7f2b4410bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:20:18.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.789+0000 7f2b4359e700 1 --2- 172.21.15.26:0/4058326610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b440f66e0 0x7f2b4410bf90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f2b2c009990 tx=0x7f2b2c009b30).stop 2021-11-03T17:20:18.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.789+0000 7f2b4359e700 1 -- 172.21.15.26:0/4058326610 shutdown_connections 2021-11-03T17:20:18.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.789+0000 7f2b4359e700 1 --2- 172.21.15.26:0/4058326610 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2b30064100 0x7f2b300665c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:18.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.789+0000 7f2b4359e700 1 --2- 172.21.15.26:0/4058326610 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b440f5440 0x7f2b44109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:18.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.789+0000 7f2b4359e700 1 --2- 172.21.15.26:0/4058326610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b440f66e0 0x7f2b4410bf90 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:18.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.789+0000 7f2b4359e700 1 -- 172.21.15.26:0/4058326610 >> 172.21.15.26:0/4058326610 conn(0x7f2b440f0ba0 msgr2=0x7f2b440fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:20:18.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.790+0000 7f2b4359e700 1 -- 172.21.15.26:0/4058326610 shutdown_connections 2021-11-03T17:20:18.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.790+0000 7f2b4359e700 1 -- 172.21.15.26:0/4058326610 wait complete. 2021-11-03T17:20:18.886 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.889+0000 7f9d8a1c7700 1 -- 172.21.15.26:0/2854442448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d840f49a0 msgr2=0x7f9d840f4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:20:18.886 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.889+0000 7f9d8a1c7700 1 --2- 172.21.15.26:0/2854442448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d840f49a0 0x7f9d840f4dc0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f9d740099e0 tx=0x7f9d74004d10).stop 2021-11-03T17:20:18.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.889+0000 7f9d8a1c7700 1 -- 172.21.15.26:0/2854442448 shutdown_connections 2021-11-03T17:20:18.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.889+0000 7f9d8a1c7700 1 --2- 172.21.15.26:0/2854442448 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d840f5340 0x7f9d840f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:18.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.889+0000 7f9d8a1c7700 1 --2- 172.21.15.26:0/2854442448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d840f49a0 0x7f9d840f4dc0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:18.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.889+0000 7f9d8a1c7700 1 -- 172.21.15.26:0/2854442448 >> 172.21.15.26:0/2854442448 conn(0x7f9d840f04c0 msgr2=0x7f9d840f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:20:18.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.889+0000 7f9d8a1c7700 1 -- 172.21.15.26:0/2854442448 shutdown_connections 2021-11-03T17:20:18.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.889+0000 7f9d8a1c7700 1 -- 172.21.15.26:0/2854442448 wait complete. 2021-11-03T17:20:18.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.890+0000 7f9d8a1c7700 1 Processor -- start 2021-11-03T17:20:18.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.890+0000 7f9d8a1c7700 1 -- start start 2021-11-03T17:20:18.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.890+0000 7f9d8a1c7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d840f49a0 0x7f9d840f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:20:18.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.890+0000 7f9d8a1c7700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d840f5340 0x7f9d840f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:20:18.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.890+0000 7f9d8a1c7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d840f5f30 con 0x7f9d840f49a0 2021-11-03T17:20:18.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.890+0000 7f9d8a1c7700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d840f6070 con 0x7f9d840f5340 2021-11-03T17:20:18.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.890+0000 7f9d837fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d840f49a0 0x7f9d840f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:20:18.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.890+0000 7f9d837fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d840f49a0 0x7f9d840f7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53840/0 (socket says 172.21.15.26:53840) 2021-11-03T17:20:18.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.890+0000 7f9d837fe700 1 -- 172.21.15.26:0/63876619 learned_addr learned my addr 172.21.15.26:0/63876619 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:20:18.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.890+0000 7f9d82ffd700 1 --2- 172.21.15.26:0/63876619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d840f5340 0x7f9d840f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:20:18.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.890+0000 7f9d837fe700 1 -- 172.21.15.26:0/63876619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d840f5340 msgr2=0x7f9d840f59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:20:18.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.890+0000 7f9d837fe700 1 --2- 172.21.15.26:0/63876619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d840f5340 0x7f9d840f59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:18.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.890+0000 7f9d837fe700 1 -- 172.21.15.26:0/63876619 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d74009640 con 0x7f9d840f49a0 2021-11-03T17:20:18.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.890+0000 7f9d82ffd700 1 --2- 172.21.15.26:0/63876619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d840f5340 0x7f9d840f59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:20:18.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.891+0000 7f9d837fe700 1 --2- 172.21.15.26:0/63876619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d840f49a0 0x7f9d840f7550 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f9d7400c010 tx=0x7f9d74004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:20:18.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.891+0000 7f9d7bfff700 1 -- 172.21.15.26:0/63876619 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d7400e070 con 0x7f9d840f49a0 2021-11-03T17:20:18.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.891+0000 7f9d7bfff700 1 -- 172.21.15.26:0/63876619 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9d74007dc0 con 0x7f9d840f49a0 2021-11-03T17:20:18.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.891+0000 7f9d7bfff700 1 -- 172.21.15.26:0/63876619 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d74018070 con 0x7f9d840f49a0 2021-11-03T17:20:18.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.891+0000 7f9d8a1c7700 1 -- 172.21.15.26:0/63876619 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d840f62f0 con 0x7f9d840f49a0 2021-11-03T17:20:18.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.891+0000 7f9d8a1c7700 1 -- 172.21.15.26:0/63876619 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d840f67d0 con 0x7f9d840f49a0 2021-11-03T17:20:18.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.892+0000 7f9d8a1c7700 1 -- 172.21.15.26:0/63876619 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d84045ad0 con 0x7f9d840f49a0 2021-11-03T17:20:18.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.892+0000 7f9d7bfff700 1 -- 172.21.15.26:0/63876619 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f9d74024060 con 0x7f9d840f49a0 2021-11-03T17:20:18.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.893+0000 7f9d7bfff700 1 --2- 172.21.15.26:0/63876619 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9d700640b0 0x7f9d70066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:20:18.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.893+0000 7f9d7bfff700 1 -- 172.21.15.26:0/63876619 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f9d740821e0 con 0x7f9d840f49a0 2021-11-03T17:20:18.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.893+0000 7f9d82ffd700 1 --2- 172.21.15.26:0/63876619 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9d700640b0 0x7f9d70066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:20:18.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.893+0000 7f9d82ffd700 1 --2- 172.21.15.26:0/63876619 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9d700640b0 0x7f9d70066570 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f9d840f5780 tx=0x7f9d6c009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:20:18.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:18.897+0000 7f9d7bfff700 1 -- 172.21.15.26:0/63876619 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f9d74054540 con 0x7f9d840f49a0 2021-11-03T17:20:19.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.124+0000 7f9d8a1c7700 1 -- 172.21.15.26:0/63876619 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9d84027a00 con 0x7f9d840f49a0 2021-11-03T17:20:19.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.125+0000 7f9d7bfff700 1 -- 172.21.15.26:0/63876619 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f9d74054130 con 0x7f9d840f49a0 2021-11-03T17:20:19.121 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:20:19.121 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:20:19.121 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:20:19.121 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:20:19.122 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:20:19.122 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:20:19.122 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:20:19.122 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:20:19.122 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:20:19.123 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:20:19.123 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:20:19.123 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:20:19.123 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:20:19.124 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:20:19.124 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:20:19.124 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:20:19.124 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:20:19.124 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:20:19.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.126+0000 7f9d8a1c7700 1 -- 172.21.15.26:0/63876619 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9d700640b0 msgr2=0x7f9d70066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:20:19.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.126+0000 7f9d8a1c7700 1 --2- 172.21.15.26:0/63876619 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9d700640b0 0x7f9d70066570 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f9d840f5780 tx=0x7f9d6c009040).stop 2021-11-03T17:20:19.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.126+0000 7f9d8a1c7700 1 -- 172.21.15.26:0/63876619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d840f49a0 msgr2=0x7f9d840f7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:20:19.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.126+0000 7f9d8a1c7700 1 --2- 172.21.15.26:0/63876619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d840f49a0 0x7f9d840f7550 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f9d7400c010 tx=0x7f9d74004d10).stop 2021-11-03T17:20:19.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.126+0000 7f9d8a1c7700 1 -- 172.21.15.26:0/63876619 shutdown_connections 2021-11-03T17:20:19.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.126+0000 7f9d8a1c7700 1 --2- 172.21.15.26:0/63876619 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9d700640b0 0x7f9d70066570 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:19.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.126+0000 7f9d8a1c7700 1 --2- 172.21.15.26:0/63876619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d840f49a0 0x7f9d840f7550 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:19.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.126+0000 7f9d8a1c7700 1 --2- 172.21.15.26:0/63876619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d840f5340 0x7f9d840f59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:19.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.126+0000 7f9d8a1c7700 1 -- 172.21.15.26:0/63876619 >> 172.21.15.26:0/63876619 conn(0x7f9d840f04c0 msgr2=0x7f9d840fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:20:19.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.126+0000 7f9d8a1c7700 1 -- 172.21.15.26:0/63876619 shutdown_connections 2021-11-03T17:20:19.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.127+0000 7f9d8a1c7700 1 -- 172.21.15.26:0/63876619 wait complete. 2021-11-03T17:20:19.224 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.226+0000 7f77ef181700 1 -- 172.21.15.26:0/1661602195 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77e80f5ef0 msgr2=0x7f77e80f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:20:19.224 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.226+0000 7f77ef181700 1 --2- 172.21.15.26:0/1661602195 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77e80f5ef0 0x7f77e80f6920 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f77d4004660 tx=0x7f77d4009b30).stop 2021-11-03T17:20:19.224 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.226+0000 7f77ef181700 1 -- 172.21.15.26:0/1661602195 shutdown_connections 2021-11-03T17:20:19.224 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.227+0000 7f77ef181700 1 --2- 172.21.15.26:0/1661602195 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77e80f5ef0 0x7f77e80f6920 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:19.225 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.227+0000 7f77ef181700 1 --2- 172.21.15.26:0/1661602195 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77e80f55e0 0x7f77e80f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:19.225 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.227+0000 7f77ef181700 1 -- 172.21.15.26:0/1661602195 >> 172.21.15.26:0/1661602195 conn(0x7f77e80f0de0 msgr2=0x7f77e80f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:20:19.225 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.227+0000 7f77ef181700 1 -- 172.21.15.26:0/1661602195 shutdown_connections 2021-11-03T17:20:19.225 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.227+0000 7f77ef181700 1 -- 172.21.15.26:0/1661602195 wait complete. 2021-11-03T17:20:19.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.227+0000 7f77ef181700 1 Processor -- start 2021-11-03T17:20:19.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.227+0000 7f77ef181700 1 -- start start 2021-11-03T17:20:19.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.227+0000 7f77ef181700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77e80f55e0 0x7f77e8109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:20:19.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.227+0000 7f77ef181700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77e80f5ef0 0x7f77e810c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:20:19.227 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.227+0000 7f77ef181700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e8060500 con 0x7f77e80f55e0 2021-11-03T17:20:19.227 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.227+0000 7f77ef181700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e8060640 con 0x7f77e80f5ef0 2021-11-03T17:20:19.227 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.228+0000 7f77ecf1d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77e80f55e0 0x7f77e8109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:20:19.227 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.228+0000 7f77ecf1d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77e80f55e0 0x7f77e8109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53850/0 (socket says 172.21.15.26:53850) 2021-11-03T17:20:19.228 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.228+0000 7f77ecf1d700 1 -- 172.21.15.26:0/766428774 learned_addr learned my addr 172.21.15.26:0/766428774 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:20:19.228 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.228+0000 7f77e7fff700 1 --2- 172.21.15.26:0/766428774 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77e80f5ef0 0x7f77e810c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:20:19.228 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.228+0000 7f77ecf1d700 1 -- 172.21.15.26:0/766428774 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77e80f5ef0 msgr2=0x7f77e810c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:20:19.228 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.228+0000 7f77ecf1d700 1 --2- 172.21.15.26:0/766428774 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77e80f5ef0 0x7f77e810c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:19.228 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.228+0000 7f77ecf1d700 1 -- 172.21.15.26:0/766428774 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d4005040 con 0x7f77e80f55e0 2021-11-03T17:20:19.229 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.228+0000 7f77ecf1d700 1 --2- 172.21.15.26:0/766428774 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77e80f55e0 0x7f77e8109c90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f77dc0026d0 tx=0x7f77dc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:20:19.229 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.228+0000 7f77e57fa700 1 -- 172.21.15.26:0/766428774 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77dc0079c0 con 0x7f77e80f55e0 2021-11-03T17:20:19.229 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.228+0000 7f77e57fa700 1 -- 172.21.15.26:0/766428774 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f77dc00f040 con 0x7f77e80f55e0 2021-11-03T17:20:19.229 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.228+0000 7f77ef181700 1 -- 172.21.15.26:0/766428774 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77e810c740 con 0x7f77e80f55e0 2021-11-03T17:20:19.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.228+0000 7f77e57fa700 1 -- 172.21.15.26:0/766428774 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77dc0148b0 con 0x7f77e80f55e0 2021-11-03T17:20:19.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.228+0000 7f77ef181700 1 -- 172.21.15.26:0/766428774 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e810cd00 con 0x7f77e80f55e0 2021-11-03T17:20:19.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.229+0000 7f77ef181700 1 -- 172.21.15.26:0/766428774 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77e8045ad0 con 0x7f77e80f55e0 2021-11-03T17:20:19.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.229+0000 7f77e57fa700 1 -- 172.21.15.26:0/766428774 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f77dc007b20 con 0x7f77e80f55e0 2021-11-03T17:20:19.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.230+0000 7f77e57fa700 1 --2- 172.21.15.26:0/766428774 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f77d80640b0 0x7f77d8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:20:19.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.230+0000 7f77e57fa700 1 -- 172.21.15.26:0/766428774 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f77dc080730 con 0x7f77e80f55e0 2021-11-03T17:20:19.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.230+0000 7f77e7fff700 1 --2- 172.21.15.26:0/766428774 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f77d80640b0 0x7f77d8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:20:19.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.230+0000 7f77e7fff700 1 --2- 172.21.15.26:0/766428774 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f77d80640b0 0x7f77d8066570 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f77d4004630 tx=0x7f77d4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:20:19.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.234+0000 7f77e57fa700 1 -- 172.21.15.26:0/766428774 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f77dc052a90 con 0x7f77e80f55e0 2021-11-03T17:20:19.433 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.437+0000 7f77ef181700 1 -- 172.21.15.26:0/766428774 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f77e80fded0 con 0x7f77e80f55e0 2021-11-03T17:20:19.433 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.438+0000 7f77e57fa700 1 -- 172.21.15.26:0/766428774 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f77dc052680 con 0x7f77e80f55e0 2021-11-03T17:20:19.434 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:20:19.434 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:20:19.434 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:20:19.435 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:20:19.435 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:20:19.435 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:20:19.435 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:20:19.436 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:20:19.436 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:20:19.436 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:20:19.436 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:20:19.436 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:20:19.437 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:20:19.437 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:20:19.437 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:20:19.437 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:20:19.438 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:20:19.438 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:20:19.438 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:20:19.438 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:20:19.439 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:20:19.439 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:20:19.439 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:20:19.439 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:20:19.439 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:20:19.440 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:20:19.440 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:20:19.440 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:20:19.440 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:20:19.441 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:20:19.441 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:20:19.441 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:20:19.441 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:20:19.442 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:20:19.442 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:20:19.442 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:20:19.443 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:20:19.443 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:20:19.443 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:20:19.444 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.440+0000 7f77ef181700 1 -- 172.21.15.26:0/766428774 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f77d80640b0 msgr2=0x7f77d8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:20:19.444 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.440+0000 7f77ef181700 1 --2- 172.21.15.26:0/766428774 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f77d80640b0 0x7f77d8066570 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f77d4004630 tx=0x7f77d4009b30).stop 2021-11-03T17:20:19.444 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.440+0000 7f77ef181700 1 -- 172.21.15.26:0/766428774 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77e80f55e0 msgr2=0x7f77e8109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:20:19.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.440+0000 7f77ef181700 1 --2- 172.21.15.26:0/766428774 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77e80f55e0 0x7f77e8109c90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f77dc0026d0 tx=0x7f77dc009de0).stop 2021-11-03T17:20:19.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.440+0000 7f77ef181700 1 -- 172.21.15.26:0/766428774 shutdown_connections 2021-11-03T17:20:19.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.440+0000 7f77ef181700 1 --2- 172.21.15.26:0/766428774 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f77d80640b0 0x7f77d8066570 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:19.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.440+0000 7f77ef181700 1 --2- 172.21.15.26:0/766428774 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77e80f55e0 0x7f77e8109c90 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:19.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.440+0000 7f77ef181700 1 --2- 172.21.15.26:0/766428774 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77e80f5ef0 0x7f77e810c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:19.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.440+0000 7f77ef181700 1 -- 172.21.15.26:0/766428774 >> 172.21.15.26:0/766428774 conn(0x7f77e80f0de0 msgr2=0x7f77e80fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:20:19.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.440+0000 7f77ef181700 1 -- 172.21.15.26:0/766428774 shutdown_connections 2021-11-03T17:20:19.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:19.440+0000 7f77ef181700 1 -- 172.21.15.26:0/766428774 wait complete. 2021-11-03T17:20:19.447 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:20:20.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:20 smithi026 ceph-mon[96795]: from='client.34940 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:20:20.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:20 smithi026 ceph-mon[96795]: pgmap v770: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:20.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:20 smithi026 ceph-mon[96795]: from='client.34944 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:20:20.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:20 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/63876619' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:20:20.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:20 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/766428774' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:20:20.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:20 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:20:20.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:20 smithi194 ceph-mon[65619]: from='client.34940 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:20:20.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:20 smithi194 ceph-mon[65619]: pgmap v770: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:20.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:20 smithi194 ceph-mon[65619]: from='client.34944 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:20:20.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:20 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/63876619' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:20:20.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:20 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/766428774' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:20:20.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:20 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:20:21.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:21 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:20:21.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:21 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:20:22.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:22 smithi026 ceph-mon[96795]: pgmap v771: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:22.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:22 smithi194 ceph-mon[65619]: pgmap v771: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:24.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:24 smithi026 ceph-mon[96795]: pgmap v772: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:24.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:24 smithi194 ceph-mon[65619]: pgmap v772: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:26.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:26 smithi026 ceph-mon[96795]: pgmap v773: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:26.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:26 smithi194 ceph-mon[65619]: pgmap v773: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:28.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:28 smithi026 ceph-mon[96795]: pgmap v774: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:28.540 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:28 smithi194 ceph-mon[65619]: pgmap v774: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:30.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:30 smithi026 ceph-mon[96795]: pgmap v775: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:30.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:30 smithi194 ceph-mon[65619]: pgmap v775: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:32.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:32 smithi026 ceph-mon[96795]: pgmap v776: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:32.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:32 smithi194 ceph-mon[65619]: pgmap v776: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:34.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:34 smithi026 ceph-mon[96795]: pgmap v777: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:34.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:34 smithi194 ceph-mon[65619]: pgmap v777: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:35.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:35 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:20:35.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:35 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:20:36.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:36 smithi026 ceph-mon[96795]: pgmap v778: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:36.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:36 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:20:36.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:36 smithi194 ceph-mon[65619]: pgmap v778: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:36.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:36 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:20:38.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:38 smithi026 ceph-mon[96795]: pgmap v779: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:38.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:38 smithi194 ceph-mon[65619]: pgmap v779: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:40.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:40 smithi026 ceph-mon[96795]: pgmap v780: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:40.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:40 smithi194 ceph-mon[65619]: pgmap v780: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:42.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:42 smithi026 ceph-mon[96795]: pgmap v781: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:42.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:42 smithi194 ceph-mon[65619]: pgmap v781: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:44.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:44 smithi026 ceph-mon[96795]: pgmap v782: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:44.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:44 smithi194 ceph-mon[65619]: pgmap v782: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:46.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:46 smithi026 ceph-mon[96795]: pgmap v783: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:46.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:46 smithi194 ceph-mon[65619]: pgmap v783: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:48.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:48 smithi026 ceph-mon[96795]: pgmap v784: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:48.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:48 smithi194 ceph-mon[65619]: pgmap v784: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:49.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:20:49.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:20:49.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:20:49.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:20:49.551 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.556+0000 7fa99b433700 1 -- 172.21.15.26:0/2232505014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9940f6ff0 msgr2=0x7fa9940f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:20:49.551 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.556+0000 7fa99b433700 1 --2- 172.21.15.26:0/2232505014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9940f6ff0 0x7fa9940f7a20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7fa988004660 tx=0x7fa988009b30).stop 2021-11-03T17:20:49.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.556+0000 7fa99b433700 1 -- 172.21.15.26:0/2232505014 shutdown_connections 2021-11-03T17:20:49.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.556+0000 7fa99b433700 1 --2- 172.21.15.26:0/2232505014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9940f6ff0 0x7fa9940f7a20 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:49.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.556+0000 7fa99b433700 1 --2- 172.21.15.26:0/2232505014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9940f66e0 0x7fa9940f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:49.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.556+0000 7fa99b433700 1 -- 172.21.15.26:0/2232505014 >> 172.21.15.26:0/2232505014 conn(0x7fa9940f1f00 msgr2=0x7fa9940f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:20:49.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.556+0000 7fa99b433700 1 -- 172.21.15.26:0/2232505014 shutdown_connections 2021-11-03T17:20:49.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.556+0000 7fa99b433700 1 -- 172.21.15.26:0/2232505014 wait complete. 2021-11-03T17:20:49.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.557+0000 7fa99b433700 1 Processor -- start 2021-11-03T17:20:49.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.557+0000 7fa99b433700 1 -- start start 2021-11-03T17:20:49.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.557+0000 7fa99b433700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9940f66e0 0x7fa994106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:20:49.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.557+0000 7fa99b433700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9940f6ff0 0x7fa994107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:20:49.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.557+0000 7fa99b433700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa994107a10 con 0x7fa9940f6ff0 2021-11-03T17:20:49.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.557+0000 7fa99b433700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa994107b50 con 0x7fa9940f66e0 2021-11-03T17:20:49.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.558+0000 7fa9989ce700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9940f6ff0 0x7fa994107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:20:49.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.558+0000 7fa9989ce700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9940f6ff0 0x7fa994107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53870/0 (socket says 172.21.15.26:53870) 2021-11-03T17:20:49.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.558+0000 7fa9989ce700 1 -- 172.21.15.26:0/2282893663 learned_addr learned my addr 172.21.15.26:0/2282893663 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:20:49.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.558+0000 7fa9989ce700 1 -- 172.21.15.26:0/2282893663 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9940f66e0 msgr2=0x7fa994106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:20:49.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.558+0000 7fa9991cf700 1 --2- 172.21.15.26:0/2282893663 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9940f66e0 0x7fa994106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:20:49.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.558+0000 7fa9989ce700 1 --2- 172.21.15.26:0/2282893663 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9940f66e0 0x7fa994106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:49.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.558+0000 7fa9989ce700 1 -- 172.21.15.26:0/2282893663 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa988005040 con 0x7fa9940f6ff0 2021-11-03T17:20:49.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.558+0000 7fa9989ce700 1 --2- 172.21.15.26:0/2282893663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9940f6ff0 0x7fa994107460 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7fa988009990 tx=0x7fa988009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:20:49.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.558+0000 7fa991ffb700 1 -- 172.21.15.26:0/2282893663 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa988018070 con 0x7fa9940f6ff0 2021-11-03T17:20:49.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.558+0000 7fa991ffb700 1 -- 172.21.15.26:0/2282893663 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa988007ba0 con 0x7fa9940f6ff0 2021-11-03T17:20:49.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.558+0000 7fa99b433700 1 -- 172.21.15.26:0/2282893663 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa994108490 con 0x7fa9940f6ff0 2021-11-03T17:20:49.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.558+0000 7fa991ffb700 1 -- 172.21.15.26:0/2282893663 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa98801c3c0 con 0x7fa9940f6ff0 2021-11-03T17:20:49.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.559+0000 7fa99b433700 1 -- 172.21.15.26:0/2282893663 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9941089f0 con 0x7fa9940f6ff0 2021-11-03T17:20:49.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.559+0000 7fa99b433700 1 -- 172.21.15.26:0/2282893663 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa994045ad0 con 0x7fa9940f6ff0 2021-11-03T17:20:49.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.560+0000 7fa991ffb700 1 -- 172.21.15.26:0/2282893663 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fa98801d420 con 0x7fa9940f6ff0 2021-11-03T17:20:49.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.560+0000 7fa991ffb700 1 --2- 172.21.15.26:0/2282893663 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa97c0640b0 0x7fa97c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:20:49.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.560+0000 7fa991ffb700 1 -- 172.21.15.26:0/2282893663 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fa9880825c0 con 0x7fa9940f6ff0 2021-11-03T17:20:49.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.561+0000 7fa9991cf700 1 --2- 172.21.15.26:0/2282893663 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa97c0640b0 0x7fa97c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:20:49.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.561+0000 7fa9991cf700 1 --2- 172.21.15.26:0/2282893663 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa97c0640b0 0x7fa97c066570 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fa98c007bb0 tx=0x7fa98c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:20:49.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.565+0000 7fa991ffb700 1 -- 172.21.15.26:0/2282893663 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fa9880548c0 con 0x7fa9940f6ff0 2021-11-03T17:20:49.743 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.748+0000 7fa99b433700 1 -- 172.21.15.26:0/2282893663 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa9940fefe0 con 0x7fa97c0640b0 2021-11-03T17:20:49.743 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.750+0000 7fa991ffb700 1 -- 172.21.15.26:0/2282893663 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fa9940fefe0 con 0x7fa97c0640b0 2021-11-03T17:20:49.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.751+0000 7fa99b433700 1 -- 172.21.15.26:0/2282893663 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa97c0640b0 msgr2=0x7fa97c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:20:49.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.751+0000 7fa99b433700 1 --2- 172.21.15.26:0/2282893663 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa97c0640b0 0x7fa97c066570 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fa98c007bb0 tx=0x7fa98c00b040).stop 2021-11-03T17:20:49.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.751+0000 7fa99b433700 1 -- 172.21.15.26:0/2282893663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9940f6ff0 msgr2=0x7fa994107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:20:49.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.751+0000 7fa99b433700 1 --2- 172.21.15.26:0/2282893663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9940f6ff0 0x7fa994107460 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7fa988009990 tx=0x7fa988009b30).stop 2021-11-03T17:20:49.747 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.752+0000 7fa99b433700 1 -- 172.21.15.26:0/2282893663 shutdown_connections 2021-11-03T17:20:49.747 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.752+0000 7fa99b433700 1 --2- 172.21.15.26:0/2282893663 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa97c0640b0 0x7fa97c066570 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:49.747 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.752+0000 7fa99b433700 1 --2- 172.21.15.26:0/2282893663 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9940f66e0 0x7fa994106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:49.747 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.752+0000 7fa99b433700 1 --2- 172.21.15.26:0/2282893663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9940f6ff0 0x7fa994107460 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:49.748 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.752+0000 7fa99b433700 1 -- 172.21.15.26:0/2282893663 >> 172.21.15.26:0/2282893663 conn(0x7fa9940f1f00 msgr2=0x7fa9940fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:20:49.748 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.752+0000 7fa99b433700 1 -- 172.21.15.26:0/2282893663 shutdown_connections 2021-11-03T17:20:49.748 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.752+0000 7fa99b433700 1 -- 172.21.15.26:0/2282893663 wait complete. 2021-11-03T17:20:49.756 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:20:49.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.855+0000 7f21d9ade700 1 -- 172.21.15.26:0/840714329 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21d40f66d0 msgr2=0x7f21d40f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:20:49.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.855+0000 7f21d9ade700 1 --2- 172.21.15.26:0/840714329 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21d40f66d0 0x7f21d40f6b30 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f21c0004660 tx=0x7f21c0009b30).stop 2021-11-03T17:20:49.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.855+0000 7f21d9ade700 1 -- 172.21.15.26:0/840714329 shutdown_connections 2021-11-03T17:20:49.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.855+0000 7f21d9ade700 1 --2- 172.21.15.26:0/840714329 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21d40f66d0 0x7f21d40f6b30 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:49.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.855+0000 7f21d9ade700 1 --2- 172.21.15.26:0/840714329 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21d40f5430 0x7f21d40f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:49.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.855+0000 7f21d9ade700 1 -- 172.21.15.26:0/840714329 >> 172.21.15.26:0/840714329 conn(0x7f21d40f0b90 msgr2=0x7f21d40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:20:49.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.855+0000 7f21d9ade700 1 -- 172.21.15.26:0/840714329 shutdown_connections 2021-11-03T17:20:49.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.855+0000 7f21d9ade700 1 -- 172.21.15.26:0/840714329 wait complete. 2021-11-03T17:20:49.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.856+0000 7f21d9ade700 1 Processor -- start 2021-11-03T17:20:49.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.856+0000 7f21d9ade700 1 -- start start 2021-11-03T17:20:49.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.856+0000 7f21d9ade700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21d40f5430 0x7f21d4108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:20:49.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.856+0000 7f21d9ade700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21d40f66d0 0x7f21d4109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:20:49.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.856+0000 7f21d9ade700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d41099e0 con 0x7f21d40f66d0 2021-11-03T17:20:49.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.856+0000 7f21d9ade700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d4109b20 con 0x7f21d40f5430 2021-11-03T17:20:49.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.856+0000 7f21d3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21d40f66d0 0x7f21d4109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:20:49.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.856+0000 7f21d3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21d40f66d0 0x7f21d4109430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53880/0 (socket says 172.21.15.26:53880) 2021-11-03T17:20:49.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.856+0000 7f21d3fff700 1 -- 172.21.15.26:0/4137804837 learned_addr learned my addr 172.21.15.26:0/4137804837 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:20:49.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.857+0000 7f21d8adc700 1 --2- 172.21.15.26:0/4137804837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21d40f5430 0x7f21d4108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:20:49.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.857+0000 7f21d3fff700 1 -- 172.21.15.26:0/4137804837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21d40f5430 msgr2=0x7f21d4108f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:20:49.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.857+0000 7f21d3fff700 1 --2- 172.21.15.26:0/4137804837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21d40f5430 0x7f21d4108f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:49.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.857+0000 7f21d3fff700 1 -- 172.21.15.26:0/4137804837 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c0005040 con 0x7f21d40f66d0 2021-11-03T17:20:49.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.857+0000 7f21d8adc700 1 --2- 172.21.15.26:0/4137804837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21d40f5430 0x7f21d4108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:20:49.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.857+0000 7f21d3fff700 1 --2- 172.21.15.26:0/4137804837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21d40f66d0 0x7f21d4109430 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f21c0009990 tx=0x7f21c0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:20:49.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.857+0000 7f21d17fa700 1 -- 172.21.15.26:0/4137804837 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21c0018070 con 0x7f21d40f66d0 2021-11-03T17:20:49.858 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.857+0000 7f21d17fa700 1 -- 172.21.15.26:0/4137804837 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f21c0007ba0 con 0x7f21d40f66d0 2021-11-03T17:20:49.858 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.857+0000 7f21d9ade700 1 -- 172.21.15.26:0/4137804837 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d410a460 con 0x7f21d40f66d0 2021-11-03T17:20:49.858 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.857+0000 7f21d9ade700 1 -- 172.21.15.26:0/4137804837 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d410a9c0 con 0x7f21d40f66d0 2021-11-03T17:20:49.858 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.857+0000 7f21d17fa700 1 -- 172.21.15.26:0/4137804837 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21c001c3c0 con 0x7f21d40f66d0 2021-11-03T17:20:49.858 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.858+0000 7f21d9ade700 1 -- 172.21.15.26:0/4137804837 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21b4004fa0 con 0x7f21d40f66d0 2021-11-03T17:20:49.859 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.859+0000 7f21d17fa700 1 -- 172.21.15.26:0/4137804837 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f21c001d420 con 0x7f21d40f66d0 2021-11-03T17:20:49.859 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.859+0000 7f21d17fa700 1 --2- 172.21.15.26:0/4137804837 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f21c4064100 0x7f21c40665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:20:49.859 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.859+0000 7f21d17fa700 1 -- 172.21.15.26:0/4137804837 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f21c0082460 con 0x7f21d40f66d0 2021-11-03T17:20:49.859 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.859+0000 7f21d8adc700 1 --2- 172.21.15.26:0/4137804837 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f21c4064100 0x7f21c40665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:20:49.860 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.860+0000 7f21d8adc700 1 --2- 172.21.15.26:0/4137804837 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f21c4064100 0x7f21c40665c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f21d40f6530 tx=0x7f21c8009c00).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:20:49.860 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:49.863+0000 7f21d17fa700 1 -- 172.21.15.26:0/4137804837 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f21c00548c0 con 0x7f21d40f66d0 2021-11-03T17:20:50.034 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.040+0000 7f21d9ade700 1 -- 172.21.15.26:0/4137804837 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f21b4000bc0 con 0x7f21c4064100 2021-11-03T17:20:50.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.055+0000 7f21d17fa700 1 -- 172.21.15.26:0/4137804837 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f21b4000bc0 con 0x7f21c4064100 2021-11-03T17:20:50.049 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:20:50.050 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (32m) 2m ago 33m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:20:50.050 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (24m) 2m ago 33m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:20:50.050 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (24m) 60s ago 32m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:20:50.051 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (31m) 2m ago 33m 39.6M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:20:50.051 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (25m) 2m ago 28m 19.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:20:50.051 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (25m) 2m ago 28m 20.6M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:20:50.051 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (28m) 60s ago 28m 22.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:20:50.052 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (28m) 60s ago 28m 22.2M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:20:50.052 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (25m) 2m ago 34m 505M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:20:50.052 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (25m) 60s ago 32m 419M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:20:50.052 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (25m) 2m ago 34m 147M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:20:50.052 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (24m) 60s ago 32m 75.7M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:20:50.053 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (32m) 2m ago 32m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:20:50.053 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (32m) 60s ago 32m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:20:50.053 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (23m) 2m ago 31m 211M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:20:50.053 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (23m) 2m ago 31m 226M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:20:50.054 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (22m) 2m ago 30m 189M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:20:50.054 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (22m) 60s ago 30m 236M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:20:50.054 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (21m) 60s ago 30m 208M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:20:50.054 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (21m) 60s ago 30m 194M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:20:50.055 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (31m) 2m ago 32m 52.1M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:20:50.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.057+0000 7f21d9ade700 1 -- 172.21.15.26:0/4137804837 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f21c4064100 msgr2=0x7f21c40665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:20:50.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.057+0000 7f21d9ade700 1 --2- 172.21.15.26:0/4137804837 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f21c4064100 0x7f21c40665c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f21d40f6530 tx=0x7f21c8009c00).stop 2021-11-03T17:20:50.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.057+0000 7f21d9ade700 1 -- 172.21.15.26:0/4137804837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21d40f66d0 msgr2=0x7f21d4109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:20:50.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.057+0000 7f21d9ade700 1 --2- 172.21.15.26:0/4137804837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21d40f66d0 0x7f21d4109430 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f21c0009990 tx=0x7f21c0009b30).stop 2021-11-03T17:20:50.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.057+0000 7f21d9ade700 1 -- 172.21.15.26:0/4137804837 shutdown_connections 2021-11-03T17:20:50.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.057+0000 7f21d9ade700 1 --2- 172.21.15.26:0/4137804837 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f21c4064100 0x7f21c40665c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:50.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.057+0000 7f21d9ade700 1 --2- 172.21.15.26:0/4137804837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21d40f5430 0x7f21d4108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:50.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.057+0000 7f21d9ade700 1 --2- 172.21.15.26:0/4137804837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21d40f66d0 0x7f21d4109430 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:50.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.057+0000 7f21d9ade700 1 -- 172.21.15.26:0/4137804837 >> 172.21.15.26:0/4137804837 conn(0x7f21d40f0b90 msgr2=0x7f21d405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:20:50.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.057+0000 7f21d9ade700 1 -- 172.21.15.26:0/4137804837 shutdown_connections 2021-11-03T17:20:50.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.057+0000 7f21d9ade700 1 -- 172.21.15.26:0/4137804837 wait complete. 2021-11-03T17:20:50.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.161+0000 7ff5bc232700 1 -- 172.21.15.26:0/2308537059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5b40f9830 msgr2=0x7ff5b40fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:20:50.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.161+0000 7ff5bc232700 1 --2- 172.21.15.26:0/2308537059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5b40f9830 0x7ff5b40fbc80 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7ff5a4004660 tx=0x7ff5a4009b30).stop 2021-11-03T17:20:50.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.161+0000 7ff5bc232700 1 -- 172.21.15.26:0/2308537059 shutdown_connections 2021-11-03T17:20:50.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.161+0000 7ff5bc232700 1 --2- 172.21.15.26:0/2308537059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5b40f9830 0x7ff5b40fbc80 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:50.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.161+0000 7ff5bc232700 1 --2- 172.21.15.26:0/2308537059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff5b4060270 0x7ff5b40f9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:50.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.161+0000 7ff5bc232700 1 -- 172.21.15.26:0/2308537059 >> 172.21.15.26:0/2308537059 conn(0x7ff5b40f0d40 msgr2=0x7ff5b40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:20:50.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.162+0000 7ff5bc232700 1 -- 172.21.15.26:0/2308537059 shutdown_connections 2021-11-03T17:20:50.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.162+0000 7ff5bc232700 1 -- 172.21.15.26:0/2308537059 wait complete. 2021-11-03T17:20:50.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.162+0000 7ff5bc232700 1 Processor -- start 2021-11-03T17:20:50.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.162+0000 7ff5bc232700 1 -- start start 2021-11-03T17:20:50.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.162+0000 7ff5bc232700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff5b4060270 0x7ff5b4106f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:20:50.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.162+0000 7ff5bc232700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5b40f9830 0x7ff5b4107430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:20:50.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.162+0000 7ff5bc232700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b41079e0 con 0x7ff5b40f9830 2021-11-03T17:20:50.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.162+0000 7ff5bc232700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b4107b20 con 0x7ff5b4060270 2021-11-03T17:20:50.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.163+0000 7ff5b97cd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5b40f9830 0x7ff5b4107430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:20:50.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.163+0000 7ff5b97cd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5b40f9830 0x7ff5b4107430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53890/0 (socket says 172.21.15.26:53890) 2021-11-03T17:20:50.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.163+0000 7ff5b97cd700 1 -- 172.21.15.26:0/3669654872 learned_addr learned my addr 172.21.15.26:0/3669654872 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:20:50.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.163+0000 7ff5b9fce700 1 --2- 172.21.15.26:0/3669654872 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff5b4060270 0x7ff5b4106f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:20:50.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.163+0000 7ff5b97cd700 1 -- 172.21.15.26:0/3669654872 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff5b4060270 msgr2=0x7ff5b4106f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:20:50.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.163+0000 7ff5b97cd700 1 --2- 172.21.15.26:0/3669654872 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff5b4060270 0x7ff5b4106f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:50.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.163+0000 7ff5b97cd700 1 -- 172.21.15.26:0/3669654872 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a4005040 con 0x7ff5b40f9830 2021-11-03T17:20:50.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.163+0000 7ff5b97cd700 1 --2- 172.21.15.26:0/3669654872 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5b40f9830 0x7ff5b4107430 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7ff5a4004f60 tx=0x7ff5a4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:20:50.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.163+0000 7ff5aa7fc700 1 -- 172.21.15.26:0/3669654872 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5a4018070 con 0x7ff5b40f9830 2021-11-03T17:20:50.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.163+0000 7ff5bc232700 1 -- 172.21.15.26:0/3669654872 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b4108460 con 0x7ff5b40f9830 2021-11-03T17:20:50.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.163+0000 7ff5aa7fc700 1 -- 172.21.15.26:0/3669654872 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff5a4007c70 con 0x7ff5b40f9830 2021-11-03T17:20:50.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.163+0000 7ff5aa7fc700 1 -- 172.21.15.26:0/3669654872 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5a401c620 con 0x7ff5b40f9830 2021-11-03T17:20:50.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.163+0000 7ff5bc232700 1 -- 172.21.15.26:0/3669654872 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b41089c0 con 0x7ff5b40f9830 2021-11-03T17:20:50.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.164+0000 7ff5bc232700 1 -- 172.21.15.26:0/3669654872 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5b4045ad0 con 0x7ff5b40f9830 2021-11-03T17:20:50.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.165+0000 7ff5aa7fc700 1 -- 172.21.15.26:0/3669654872 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ff5a401d420 con 0x7ff5b40f9830 2021-11-03T17:20:50.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.165+0000 7ff5aa7fc700 1 --2- 172.21.15.26:0/3669654872 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff5a00640b0 0x7ff5a0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:20:50.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.166+0000 7ff5aa7fc700 1 -- 172.21.15.26:0/3669654872 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ff5a4082730 con 0x7ff5b40f9830 2021-11-03T17:20:50.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.166+0000 7ff5b9fce700 1 --2- 172.21.15.26:0/3669654872 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff5a00640b0 0x7ff5a0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:20:50.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.166+0000 7ff5b9fce700 1 --2- 172.21.15.26:0/3669654872 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff5a00640b0 0x7ff5a0066570 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7ff5b00041d0 tx=0x7ff5b0009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:20:50.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.170+0000 7ff5aa7fc700 1 -- 172.21.15.26:0/3669654872 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ff5a4054a90 con 0x7ff5b40f9830 2021-11-03T17:20:50.404 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.409+0000 7ff5bc232700 1 -- 172.21.15.26:0/3669654872 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff5b40fef90 con 0x7ff5b40f9830 2021-11-03T17:20:50.404 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.410+0000 7ff5aa7fc700 1 -- 172.21.15.26:0/3669654872 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7ff5a4054680 con 0x7ff5b40f9830 2021-11-03T17:20:50.405 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:20:50.405 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:20:50.405 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:20:50.406 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:20:50.406 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:20:50.406 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:20:50.406 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:20:50.407 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:20:50.407 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:20:50.407 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:20:50.408 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:20:50.408 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:20:50.408 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:20:50.408 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:20:50.408 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:20:50.409 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:20:50.409 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:20:50.409 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:20:50.410 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.412+0000 7ff5bc232700 1 -- 172.21.15.26:0/3669654872 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff5a00640b0 msgr2=0x7ff5a0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:20:50.410 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.412+0000 7ff5bc232700 1 --2- 172.21.15.26:0/3669654872 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff5a00640b0 0x7ff5a0066570 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7ff5b00041d0 tx=0x7ff5b0009040).stop 2021-11-03T17:20:50.411 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.412+0000 7ff5bc232700 1 -- 172.21.15.26:0/3669654872 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5b40f9830 msgr2=0x7ff5b4107430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:20:50.411 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.412+0000 7ff5bc232700 1 --2- 172.21.15.26:0/3669654872 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5b40f9830 0x7ff5b4107430 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7ff5a4004f60 tx=0x7ff5a4009b30).stop 2021-11-03T17:20:50.411 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.412+0000 7ff5bc232700 1 -- 172.21.15.26:0/3669654872 shutdown_connections 2021-11-03T17:20:50.411 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.412+0000 7ff5bc232700 1 --2- 172.21.15.26:0/3669654872 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff5a00640b0 0x7ff5a0066570 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:50.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.412+0000 7ff5bc232700 1 --2- 172.21.15.26:0/3669654872 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff5b4060270 0x7ff5b4106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:50.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.412+0000 7ff5bc232700 1 --2- 172.21.15.26:0/3669654872 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5b40f9830 0x7ff5b4107430 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:50.413 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.412+0000 7ff5bc232700 1 -- 172.21.15.26:0/3669654872 >> 172.21.15.26:0/3669654872 conn(0x7ff5b40f0d40 msgr2=0x7ff5b40f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:20:50.413 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.412+0000 7ff5bc232700 1 -- 172.21.15.26:0/3669654872 shutdown_connections 2021-11-03T17:20:50.413 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.412+0000 7ff5bc232700 1 -- 172.21.15.26:0/3669654872 wait complete. 2021-11-03T17:20:50.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:50 smithi026 ceph-mon[96795]: pgmap v785: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:50.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:50 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:20:50.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:50 smithi194 ceph-mon[65619]: pgmap v785: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:50.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:50 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:20:50.520 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.521+0000 7f370af6a700 1 -- 172.21.15.26:0/630990094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3704060250 msgr2=0x7f37040f91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:20:50.520 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.521+0000 7f370af6a700 1 --2- 172.21.15.26:0/630990094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3704060250 0x7f37040f91e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f36fc0099e0 tx=0x7f36fc004d10).stop 2021-11-03T17:20:50.521 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.521+0000 7f370af6a700 1 -- 172.21.15.26:0/630990094 shutdown_connections 2021-11-03T17:20:50.521 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.521+0000 7f370af6a700 1 --2- 172.21.15.26:0/630990094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37040f96d0 0x7f37040fbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:50.521 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.521+0000 7f370af6a700 1 --2- 172.21.15.26:0/630990094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3704060250 0x7f37040f91e0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:50.522 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.521+0000 7f370af6a700 1 -- 172.21.15.26:0/630990094 >> 172.21.15.26:0/630990094 conn(0x7f37040f0ba0 msgr2=0x7f37040f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:20:50.522 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.521+0000 7f370af6a700 1 -- 172.21.15.26:0/630990094 shutdown_connections 2021-11-03T17:20:50.523 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.521+0000 7f370af6a700 1 -- 172.21.15.26:0/630990094 wait complete. 2021-11-03T17:20:50.523 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.522+0000 7f370af6a700 1 Processor -- start 2021-11-03T17:20:50.523 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.522+0000 7f370af6a700 1 -- start start 2021-11-03T17:20:50.523 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.522+0000 7f370af6a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3704060250 0x7f3704106e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:20:50.524 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.522+0000 7f370af6a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37040f96d0 0x7f3704107370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:20:50.524 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.522+0000 7f370af6a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3704107920 con 0x7f37040f96d0 2021-11-03T17:20:50.524 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.522+0000 7f370af6a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3704107a60 con 0x7f3704060250 2021-11-03T17:20:50.524 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.522+0000 7f3709767700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37040f96d0 0x7f3704107370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:20:50.525 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.522+0000 7f3709767700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37040f96d0 0x7f3704107370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53900/0 (socket says 172.21.15.26:53900) 2021-11-03T17:20:50.525 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.522+0000 7f3709767700 1 -- 172.21.15.26:0/1623677280 learned_addr learned my addr 172.21.15.26:0/1623677280 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:20:50.525 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.522+0000 7f3709f68700 1 --2- 172.21.15.26:0/1623677280 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3704060250 0x7f3704106e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:20:50.525 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.523+0000 7f3709767700 1 -- 172.21.15.26:0/1623677280 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3704060250 msgr2=0x7f3704106e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:20:50.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.523+0000 7f3709767700 1 --2- 172.21.15.26:0/1623677280 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3704060250 0x7f3704106e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:50.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.523+0000 7f3709767700 1 -- 172.21.15.26:0/1623677280 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36fc009640 con 0x7f37040f96d0 2021-11-03T17:20:50.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.523+0000 7f3709767700 1 --2- 172.21.15.26:0/1623677280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37040f96d0 0x7f3704107370 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f36f800e7c0 tx=0x7f36f800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:20:50.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.523+0000 7f37027fc700 1 -- 172.21.15.26:0/1623677280 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36f80092e0 con 0x7f37040f96d0 2021-11-03T17:20:50.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.523+0000 7f37027fc700 1 -- 172.21.15.26:0/1623677280 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f36f800f040 con 0x7f37040f96d0 2021-11-03T17:20:50.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.523+0000 7f370af6a700 1 -- 172.21.15.26:0/1623677280 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3704108400 con 0x7f37040f96d0 2021-11-03T17:20:50.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.523+0000 7f37027fc700 1 -- 172.21.15.26:0/1623677280 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36f8014860 con 0x7f37040f96d0 2021-11-03T17:20:50.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.523+0000 7f370af6a700 1 -- 172.21.15.26:0/1623677280 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37041089c0 con 0x7f37040f96d0 2021-11-03T17:20:50.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.524+0000 7f370af6a700 1 -- 172.21.15.26:0/1623677280 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3704045ad0 con 0x7f37040f96d0 2021-11-03T17:20:50.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.524+0000 7f37027fc700 1 -- 172.21.15.26:0/1623677280 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f36f801b030 con 0x7f37040f96d0 2021-11-03T17:20:50.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.525+0000 7f37027fc700 1 --2- 172.21.15.26:0/1623677280 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f36ec064100 0x7f36ec0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:20:50.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.525+0000 7f37027fc700 1 -- 172.21.15.26:0/1623677280 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f36f8080730 con 0x7f37040f96d0 2021-11-03T17:20:50.530 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.525+0000 7f3709f68700 1 --2- 172.21.15.26:0/1623677280 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f36ec064100 0x7f36ec0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:20:50.530 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.525+0000 7f3709f68700 1 --2- 172.21.15.26:0/1623677280 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f36ec064100 0x7f36ec0665c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f36fc00b3b0 tx=0x7f36fc015040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:20:50.531 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.529+0000 7f37027fc700 1 -- 172.21.15.26:0/1623677280 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f36f8052940 con 0x7f37040f96d0 2021-11-03T17:20:50.748 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.753+0000 7f370af6a700 1 -- 172.21.15.26:0/1623677280 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3704027a00 con 0x7f37040f96d0 2021-11-03T17:20:50.748 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.754+0000 7f37027fc700 1 -- 172.21.15.26:0/1623677280 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f36f8019710 con 0x7f37040f96d0 2021-11-03T17:20:50.749 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:20:50.749 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:20:50.750 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:20:50.750 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:20:50.750 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:20:50.750 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:20:50.751 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:20:50.751 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:20:50.751 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:20:50.751 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:20:50.752 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:20:50.752 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:20:50.752 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:20:50.752 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:20:50.753 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:20:50.753 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:20:50.753 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:20:50.753 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:20:50.754 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:20:50.754 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:20:50.754 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:20:50.754 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:20:50.755 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:20:50.755 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:20:50.755 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:20:50.755 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:20:50.756 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:20:50.756 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:20:50.756 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:20:50.756 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:20:50.757 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:20:50.757 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:20:50.757 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:20:50.757 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:20:50.758 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:20:50.758 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:20:50.758 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:20:50.758 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:20:50.759 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:20:50.759 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.755+0000 7f370af6a700 1 -- 172.21.15.26:0/1623677280 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f36ec064100 msgr2=0x7f36ec0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:20:50.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.755+0000 7f370af6a700 1 --2- 172.21.15.26:0/1623677280 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f36ec064100 0x7f36ec0665c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f36fc00b3b0 tx=0x7f36fc015040).stop 2021-11-03T17:20:50.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.755+0000 7f370af6a700 1 -- 172.21.15.26:0/1623677280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37040f96d0 msgr2=0x7f3704107370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:20:50.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.755+0000 7f370af6a700 1 --2- 172.21.15.26:0/1623677280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37040f96d0 0x7f3704107370 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f36f800e7c0 tx=0x7f36f800b040).stop 2021-11-03T17:20:50.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.756+0000 7f370af6a700 1 -- 172.21.15.26:0/1623677280 shutdown_connections 2021-11-03T17:20:50.761 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.756+0000 7f370af6a700 1 --2- 172.21.15.26:0/1623677280 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f36ec064100 0x7f36ec0665c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:50.761 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.756+0000 7f370af6a700 1 --2- 172.21.15.26:0/1623677280 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3704060250 0x7f3704106e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:50.761 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.756+0000 7f370af6a700 1 --2- 172.21.15.26:0/1623677280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37040f96d0 0x7f3704107370 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:20:50.761 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.756+0000 7f370af6a700 1 -- 172.21.15.26:0/1623677280 >> 172.21.15.26:0/1623677280 conn(0x7f37040f0ba0 msgr2=0x7f37040f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:20:50.762 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.756+0000 7f370af6a700 1 -- 172.21.15.26:0/1623677280 shutdown_connections 2021-11-03T17:20:50.762 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:20:50.756+0000 7f370af6a700 1 -- 172.21.15.26:0/1623677280 wait complete. 2021-11-03T17:20:50.762 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:20:51.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:51 smithi026 ceph-mon[96795]: poll took 60058.076 ms: 1 events 2021-11-03T17:20:51.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:51 smithi026 ceph-mon[96795]: from='client.34956 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:20:51.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:51 smithi026 ceph-mon[96795]: from='client.34960 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:20:51.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:51 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3669654872' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:20:51.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:51 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1623677280' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:20:51.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:51 smithi194 ceph-mon[65619]: poll took 60058.076 ms: 1 events 2021-11-03T17:20:51.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:51 smithi194 ceph-mon[65619]: from='client.34956 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:20:51.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:51 smithi194 ceph-mon[65619]: from='client.34960 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:20:51.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:51 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3669654872' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:20:51.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:51 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1623677280' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:20:52.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:52 smithi026 ceph-mon[96795]: pgmap v786: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:52.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:52 smithi194 ceph-mon[65619]: pgmap v786: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:54.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:54 smithi026 ceph-mon[96795]: pgmap v787: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:54.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:54 smithi026 ceph-mon[96795]: poll took 2819.164 ms: 1 events 2021-11-03T17:20:54.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:54 smithi026 ceph-mon[96795]: Detected new or changed devices on smithi026 2021-11-03T17:20:54.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:20:54.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:20:54.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:20:54.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:20:54.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:20:54.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:20:54.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:20:54.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:54 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:20:54.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:20:54.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:54 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:20:54.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:54 smithi194 ceph-mon[65619]: pgmap v787: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:54.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:54 smithi194 ceph-mon[65619]: poll took 2819.164 ms: 1 events 2021-11-03T17:20:54.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:54 smithi194 ceph-mon[65619]: Detected new or changed devices on smithi026 2021-11-03T17:20:54.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:20:54.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:20:54.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:20:54.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:20:54.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:20:54.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:20:54.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:20:54.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:54 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:20:54.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:20:54.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:54 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:20:56.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:56 smithi026 ceph-mon[96795]: pgmap v788: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:56.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:56 smithi194 ceph-mon[65619]: pgmap v788: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:58.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:20:58 smithi026 ceph-mon[96795]: pgmap v789: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:20:58.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:20:58 smithi194 ceph-mon[65619]: pgmap v789: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:00.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:00 smithi026 ceph-mon[96795]: pgmap v790: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:00.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:00 smithi194 ceph-mon[65619]: pgmap v790: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:02.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:02 smithi026 ceph-mon[96795]: pgmap v791: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:02.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:02 smithi194 ceph-mon[65619]: pgmap v791: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:04.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:04 smithi026 ceph-mon[96795]: pgmap v792: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:04.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:04 smithi194 ceph-mon[65619]: pgmap v792: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:06.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:06 smithi026 ceph-mon[96795]: pgmap v793: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:06.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:06 smithi194 ceph-mon[65619]: pgmap v793: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:08.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:08 smithi026 ceph-mon[96795]: pgmap v794: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:08.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:08 smithi194 ceph-mon[65619]: pgmap v794: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:09.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:09 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:21:09.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:09 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:21:09.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:09 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:21:09.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:09 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:21:10.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:10 smithi026 ceph-mon[96795]: pgmap v795: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:10.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:10 smithi194 ceph-mon[65619]: pgmap v795: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:12.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:12 smithi026 ceph-mon[96795]: pgmap v796: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:12.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:12 smithi194 ceph-mon[65619]: pgmap v796: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:14.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:14 smithi026 ceph-mon[96795]: pgmap v797: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:14.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:14 smithi194 ceph-mon[65619]: pgmap v797: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:16.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:16 smithi026 ceph-mon[96795]: pgmap v798: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:16.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:16 smithi194 ceph-mon[65619]: pgmap v798: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:18.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:18 smithi026 ceph-mon[96795]: pgmap v799: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:18.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:18 smithi194 ceph-mon[65619]: pgmap v799: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:20.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:20 smithi026 ceph-mon[96795]: pgmap v800: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:20.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:20 smithi194 ceph-mon[65619]: pgmap v800: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:20.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:20.871+0000 7ff7bc265700 1 -- 172.21.15.26:0/703888501 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7b40f55e0 msgr2=0x7ff7b40f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:21:20.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:20.871+0000 7ff7bc265700 1 --2- 172.21.15.26:0/703888501 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7b40f55e0 0x7ff7b40f5a00 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7ff7ac0099e0 tx=0x7ff7ac004d10).stop 2021-11-03T17:21:20.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:20.871+0000 7ff7bc265700 1 -- 172.21.15.26:0/703888501 shutdown_connections 2021-11-03T17:21:20.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:20.871+0000 7ff7bc265700 1 --2- 172.21.15.26:0/703888501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7b40f5ef0 0x7ff7b40f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:20.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:20.871+0000 7ff7bc265700 1 --2- 172.21.15.26:0/703888501 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7b40f55e0 0x7ff7b40f5a00 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:20.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:20.871+0000 7ff7bc265700 1 -- 172.21.15.26:0/703888501 >> 172.21.15.26:0/703888501 conn(0x7ff7b40f0de0 msgr2=0x7ff7b40f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:21:20.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:20.871+0000 7ff7bc265700 1 -- 172.21.15.26:0/703888501 shutdown_connections 2021-11-03T17:21:20.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:20.871+0000 7ff7bc265700 1 -- 172.21.15.26:0/703888501 wait complete. 2021-11-03T17:21:20.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:20.872+0000 7ff7bc265700 1 Processor -- start 2021-11-03T17:21:20.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:20.872+0000 7ff7bc265700 1 -- start start 2021-11-03T17:21:20.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:20.872+0000 7ff7bc265700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7b40f55e0 0x7ff7b4109d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:21:20.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:20.872+0000 7ff7bc265700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7b40f5ef0 0x7ff7b410c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:21:20.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:20.872+0000 7ff7bc265700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b40604c0 con 0x7ff7b40f5ef0 2021-11-03T17:21:20.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:20.872+0000 7ff7bc265700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b4060600 con 0x7ff7b40f55e0 2021-11-03T17:21:20.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:20.872+0000 7ff7b9800700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7b40f5ef0 0x7ff7b410c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:21:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:20.872+0000 7ff7b9800700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7b40f5ef0 0x7ff7b410c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53918/0 (socket says 172.21.15.26:53918) 2021-11-03T17:21:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:20.872+0000 7ff7b9800700 1 -- 172.21.15.26:0/2214980662 learned_addr learned my addr 172.21.15.26:0/2214980662 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:21:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:20.872+0000 7ff7ba001700 1 --2- 172.21.15.26:0/2214980662 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7b40f55e0 0x7ff7b4109d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:21:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:20.872+0000 7ff7b9800700 1 -- 172.21.15.26:0/2214980662 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7b40f55e0 msgr2=0x7ff7b4109d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:21:20.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:20.872+0000 7ff7b9800700 1 --2- 172.21.15.26:0/2214980662 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7b40f55e0 0x7ff7b4109d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:20.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:20.872+0000 7ff7b9800700 1 -- 172.21.15.26:0/2214980662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7ac009640 con 0x7ff7b40f5ef0 2021-11-03T17:21:20.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:20.872+0000 7ff7b9800700 1 --2- 172.21.15.26:0/2214980662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7b40f5ef0 0x7ff7b410c280 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7ff7a800e7f0 tx=0x7ff7a800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:21:20.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:20.873+0000 7ff7b27fc700 1 -- 172.21.15.26:0/2214980662 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7a80092e0 con 0x7ff7b40f5ef0 2021-11-03T17:21:20.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:20.873+0000 7ff7b27fc700 1 -- 172.21.15.26:0/2214980662 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff7a800f040 con 0x7ff7b40f5ef0 2021-11-03T17:21:20.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:20.873+0000 7ff7bc265700 1 -- 172.21.15.26:0/2214980662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7b410c830 con 0x7ff7b40f5ef0 2021-11-03T17:21:20.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:20.873+0000 7ff7b27fc700 1 -- 172.21.15.26:0/2214980662 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7a8014750 con 0x7ff7b40f5ef0 2021-11-03T17:21:20.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:20.873+0000 7ff7bc265700 1 -- 172.21.15.26:0/2214980662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b410cdc0 con 0x7ff7b40f5ef0 2021-11-03T17:21:20.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:20.874+0000 7ff7bc265700 1 -- 172.21.15.26:0/2214980662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7b40f4a70 con 0x7ff7b40f5ef0 2021-11-03T17:21:20.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:20.874+0000 7ff7b27fc700 1 -- 172.21.15.26:0/2214980662 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ff7a801b030 con 0x7ff7b40f5ef0 2021-11-03T17:21:20.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:20.874+0000 7ff7b27fc700 1 --2- 172.21.15.26:0/2214980662 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff79c0640b0 0x7ff79c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:21:20.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:20.875+0000 7ff7b27fc700 1 -- 172.21.15.26:0/2214980662 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ff7a80805a0 con 0x7ff7b40f5ef0 2021-11-03T17:21:20.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:20.875+0000 7ff7ba001700 1 --2- 172.21.15.26:0/2214980662 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff79c0640b0 0x7ff79c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:21:20.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:20.875+0000 7ff7ba001700 1 --2- 172.21.15.26:0/2214980662 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff79c0640b0 0x7ff79c066570 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7ff7ac00b620 tx=0x7ff7ac015040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:21:20.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:20.879+0000 7ff7b27fc700 1 -- 172.21.15.26:0/2214980662 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ff7a80528c0 con 0x7ff7b40f5ef0 2021-11-03T17:21:21.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.057+0000 7ff7bc265700 1 -- 172.21.15.26:0/2214980662 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff7b40008d0 con 0x7ff79c0640b0 2021-11-03T17:21:21.053 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.058+0000 7ff7b27fc700 1 -- 172.21.15.26:0/2214980662 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7ff7b40008d0 con 0x7ff79c0640b0 2021-11-03T17:21:21.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.060+0000 7ff7bc265700 1 -- 172.21.15.26:0/2214980662 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff79c0640b0 msgr2=0x7ff79c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:21:21.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.060+0000 7ff7bc265700 1 --2- 172.21.15.26:0/2214980662 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff79c0640b0 0x7ff79c066570 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7ff7ac00b620 tx=0x7ff7ac015040).stop 2021-11-03T17:21:21.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.060+0000 7ff7bc265700 1 -- 172.21.15.26:0/2214980662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7b40f5ef0 msgr2=0x7ff7b410c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:21:21.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.060+0000 7ff7bc265700 1 --2- 172.21.15.26:0/2214980662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7b40f5ef0 0x7ff7b410c280 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7ff7a800e7f0 tx=0x7ff7a800b040).stop 2021-11-03T17:21:21.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.060+0000 7ff7bc265700 1 -- 172.21.15.26:0/2214980662 shutdown_connections 2021-11-03T17:21:21.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.060+0000 7ff7bc265700 1 --2- 172.21.15.26:0/2214980662 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff79c0640b0 0x7ff79c066570 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:21.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.060+0000 7ff7bc265700 1 --2- 172.21.15.26:0/2214980662 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7b40f55e0 0x7ff7b4109d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:21.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.060+0000 7ff7bc265700 1 --2- 172.21.15.26:0/2214980662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7b40f5ef0 0x7ff7b410c280 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:21.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.060+0000 7ff7bc265700 1 -- 172.21.15.26:0/2214980662 >> 172.21.15.26:0/2214980662 conn(0x7ff7b40f0de0 msgr2=0x7ff7b40fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:21:21.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.060+0000 7ff7bc265700 1 -- 172.21.15.26:0/2214980662 shutdown_connections 2021-11-03T17:21:21.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.060+0000 7ff7bc265700 1 -- 172.21.15.26:0/2214980662 wait complete. 2021-11-03T17:21:21.065 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:21:21.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.160+0000 7febd53fe700 1 -- 172.21.15.26:0/3535529352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febd00f77d0 msgr2=0x7febd00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:21:21.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.160+0000 7febd53fe700 1 --2- 172.21.15.26:0/3535529352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febd00f77d0 0x7febd00f7c30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7febb8004660 tx=0x7febb8009b30).stop 2021-11-03T17:21:21.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.160+0000 7febd53fe700 1 -- 172.21.15.26:0/3535529352 shutdown_connections 2021-11-03T17:21:21.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.160+0000 7febd53fe700 1 --2- 172.21.15.26:0/3535529352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febd00f77d0 0x7febd00f7c30 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:21.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.160+0000 7febd53fe700 1 --2- 172.21.15.26:0/3535529352 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febd00f6530 0x7febd00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:21.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.161+0000 7febd53fe700 1 -- 172.21.15.26:0/3535529352 >> 172.21.15.26:0/3535529352 conn(0x7febd00f1cd0 msgr2=0x7febd00f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:21:21.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.161+0000 7febd53fe700 1 -- 172.21.15.26:0/3535529352 shutdown_connections 2021-11-03T17:21:21.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.161+0000 7febd53fe700 1 -- 172.21.15.26:0/3535529352 wait complete. 2021-11-03T17:21:21.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.161+0000 7febd53fe700 1 Processor -- start 2021-11-03T17:21:21.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.161+0000 7febd53fe700 1 -- start start 2021-11-03T17:21:21.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.161+0000 7febd53fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febd00f6530 0x7febd0106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:21:21.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.161+0000 7febd53fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febd00f77d0 0x7febd0107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:21:21.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.161+0000 7febd53fe700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd0107880 con 0x7febd00f77d0 2021-11-03T17:21:21.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.161+0000 7febd53fe700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd0108090 con 0x7febd00f6530 2021-11-03T17:21:21.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.162+0000 7febcf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febd00f77d0 0x7febd0107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:21:21.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.162+0000 7febcf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febd00f77d0 0x7febd0107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53928/0 (socket says 172.21.15.26:53928) 2021-11-03T17:21:21.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.162+0000 7febcf7fe700 1 -- 172.21.15.26:0/1844086716 learned_addr learned my addr 172.21.15.26:0/1844086716 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:21:21.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.162+0000 7febcffff700 1 --2- 172.21.15.26:0/1844086716 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febd00f6530 0x7febd0106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:21:21.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.162+0000 7febcf7fe700 1 -- 172.21.15.26:0/1844086716 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febd00f6530 msgr2=0x7febd0106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:21:21.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.162+0000 7febcf7fe700 1 --2- 172.21.15.26:0/1844086716 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febd00f6530 0x7febd0106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:21.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.162+0000 7febcf7fe700 1 -- 172.21.15.26:0/1844086716 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb8005040 con 0x7febd00f77d0 2021-11-03T17:21:21.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.162+0000 7febcf7fe700 1 --2- 172.21.15.26:0/1844086716 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febd00f77d0 0x7febd0107280 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7febb8009990 tx=0x7febb8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:21:21.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.162+0000 7febccff9700 1 -- 172.21.15.26:0/1844086716 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febb8018070 con 0x7febd00f77d0 2021-11-03T17:21:21.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.162+0000 7febd53fe700 1 -- 172.21.15.26:0/1844086716 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd01082b0 con 0x7febd00f77d0 2021-11-03T17:21:21.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.162+0000 7febccff9700 1 -- 172.21.15.26:0/1844086716 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7febb8007ca0 con 0x7febd00f77d0 2021-11-03T17:21:21.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.162+0000 7febccff9700 1 -- 172.21.15.26:0/1844086716 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febb801c620 con 0x7febd00f77d0 2021-11-03T17:21:21.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.162+0000 7febd53fe700 1 -- 172.21.15.26:0/1844086716 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd0108810 con 0x7febd00f77d0 2021-11-03T17:21:21.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.163+0000 7febd53fe700 1 -- 172.21.15.26:0/1844086716 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febd0059100 con 0x7febd00f77d0 2021-11-03T17:21:21.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.163+0000 7febccff9700 1 -- 172.21.15.26:0/1844086716 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7febb801d960 con 0x7febd00f77d0 2021-11-03T17:21:21.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.164+0000 7febccff9700 1 --2- 172.21.15.26:0/1844086716 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7febbc064100 0x7febbc0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:21:21.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.164+0000 7febccff9700 1 -- 172.21.15.26:0/1844086716 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7febb8082520 con 0x7febd00f77d0 2021-11-03T17:21:21.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.164+0000 7febcffff700 1 --2- 172.21.15.26:0/1844086716 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7febbc064100 0x7febbc0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:21:21.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.164+0000 7febcffff700 1 --2- 172.21.15.26:0/1844086716 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7febbc064100 0x7febbc0665c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7febd0106b00 tx=0x7febc0009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:21:21.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.168+0000 7febccff9700 1 -- 172.21.15.26:0/1844086716 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7febb8054940 con 0x7febd00f77d0 2021-11-03T17:21:21.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.341+0000 7febd53fe700 1 -- 172.21.15.26:0/1844086716 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7febd00fee80 con 0x7febbc064100 2021-11-03T17:21:21.350 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.355+0000 7febccff9700 1 -- 172.21.15.26:0/1844086716 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7febd00fee80 con 0x7febbc064100 2021-11-03T17:21:21.351 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:21:21.351 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (32m) 2m ago 33m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:21:21.351 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (24m) 2m ago 33m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:21:21.352 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (24m) 92s ago 33m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:21:21.352 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (32m) 2m ago 33m 39.6M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:21:21.352 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (25m) 2m ago 28m 19.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:21:21.352 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (25m) 2m ago 28m 20.6M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:21:21.352 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (29m) 92s ago 29m 22.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:21:21.353 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (28m) 92s ago 28m 22.2M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:21:21.353 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (26m) 2m ago 35m 505M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:21:21.353 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (25m) 92s ago 33m 419M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:21:21.353 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (25m) 2m ago 35m 147M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:21:21.354 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (25m) 92s ago 32m 75.7M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:21:21.354 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (33m) 2m ago 33m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:21:21.354 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (32m) 92s ago 32m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:21:21.354 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (24m) 2m ago 32m 211M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:21:21.355 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (23m) 2m ago 31m 226M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:21:21.355 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (23m) 2m ago 31m 189M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:21:21.355 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (22m) 92s ago 31m 236M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:21:21.355 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (22m) 92s ago 30m 208M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:21:21.356 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (22m) 92s ago 30m 194M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:21:21.356 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (32m) 2m ago 33m 52.1M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:21:21.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.357+0000 7febd53fe700 1 -- 172.21.15.26:0/1844086716 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7febbc064100 msgr2=0x7febbc0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:21:21.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.357+0000 7febd53fe700 1 --2- 172.21.15.26:0/1844086716 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7febbc064100 0x7febbc0665c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7febd0106b00 tx=0x7febc0009040).stop 2021-11-03T17:21:21.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.357+0000 7febd53fe700 1 -- 172.21.15.26:0/1844086716 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febd00f77d0 msgr2=0x7febd0107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:21:21.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.357+0000 7febd53fe700 1 --2- 172.21.15.26:0/1844086716 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febd00f77d0 0x7febd0107280 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7febb8009990 tx=0x7febb8009b30).stop 2021-11-03T17:21:21.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.357+0000 7febd53fe700 1 -- 172.21.15.26:0/1844086716 shutdown_connections 2021-11-03T17:21:21.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.357+0000 7febd53fe700 1 --2- 172.21.15.26:0/1844086716 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7febbc064100 0x7febbc0665c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:21.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.357+0000 7febd53fe700 1 --2- 172.21.15.26:0/1844086716 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febd00f6530 0x7febd0106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:21.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.357+0000 7febd53fe700 1 --2- 172.21.15.26:0/1844086716 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febd00f77d0 0x7febd0107280 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:21.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.357+0000 7febd53fe700 1 -- 172.21.15.26:0/1844086716 >> 172.21.15.26:0/1844086716 conn(0x7febd00f1cd0 msgr2=0x7febd00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:21:21.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.357+0000 7febd53fe700 1 -- 172.21.15.26:0/1844086716 shutdown_connections 2021-11-03T17:21:21.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.357+0000 7febd53fe700 1 -- 172.21.15.26:0/1844086716 wait complete. 2021-11-03T17:21:21.453 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.457+0000 7f28aff46700 1 -- 172.21.15.26:0/1537708281 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28a80f6b90 msgr2=0x7f28a80f6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:21:21.453 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.457+0000 7f28aff46700 1 --2- 172.21.15.26:0/1537708281 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28a80f6b90 0x7f28a80f6fb0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f28a4004660 tx=0x7f28a4009b30).stop 2021-11-03T17:21:21.453 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.457+0000 7f28aff46700 1 -- 172.21.15.26:0/1537708281 shutdown_connections 2021-11-03T17:21:21.454 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.457+0000 7f28aff46700 1 --2- 172.21.15.26:0/1537708281 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28a80f74a0 0x7f28a80f5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:21.454 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.457+0000 7f28aff46700 1 --2- 172.21.15.26:0/1537708281 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28a80f6b90 0x7f28a80f6fb0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:21.454 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.457+0000 7f28aff46700 1 -- 172.21.15.26:0/1537708281 >> 172.21.15.26:0/1537708281 conn(0x7f28a80f0540 msgr2=0x7f28a80f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:21:21.454 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.457+0000 7f28aff46700 1 -- 172.21.15.26:0/1537708281 shutdown_connections 2021-11-03T17:21:21.455 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.457+0000 7f28aff46700 1 -- 172.21.15.26:0/1537708281 wait complete. 2021-11-03T17:21:21.455 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.457+0000 7f28aff46700 1 Processor -- start 2021-11-03T17:21:21.455 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.458+0000 7f28aff46700 1 -- start start 2021-11-03T17:21:21.455 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.458+0000 7f28aff46700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28a80f6b90 0x7f28a80f9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:21:21.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.458+0000 7f28aff46700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28a80f74a0 0x7f28a80f7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:21:21.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.458+0000 7f28aff46700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a80f81e0 con 0x7f28a80f74a0 2021-11-03T17:21:21.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.458+0000 7f28aff46700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a80f8320 con 0x7f28a80f6b90 2021-11-03T17:21:21.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.458+0000 7f28ad4e1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28a80f74a0 0x7f28a80f7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:21:21.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.458+0000 7f28ad4e1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28a80f74a0 0x7f28a80f7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53938/0 (socket says 172.21.15.26:53938) 2021-11-03T17:21:21.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.458+0000 7f28ad4e1700 1 -- 172.21.15.26:0/3807264877 learned_addr learned my addr 172.21.15.26:0/3807264877 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:21:21.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.458+0000 7f28adce2700 1 --2- 172.21.15.26:0/3807264877 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28a80f6b90 0x7f28a80f9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:21:21.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.458+0000 7f28adce2700 1 -- 172.21.15.26:0/3807264877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28a80f74a0 msgr2=0x7f28a80f7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:21:21.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.458+0000 7f28adce2700 1 --2- 172.21.15.26:0/3807264877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28a80f74a0 0x7f28a80f7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:21.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.458+0000 7f28adce2700 1 -- 172.21.15.26:0/3807264877 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a4005040 con 0x7f28a80f6b90 2021-11-03T17:21:21.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.459+0000 7f28adce2700 1 --2- 172.21.15.26:0/3807264877 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28a80f6b90 0x7f28a80f9800 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f28a4000c00 tx=0x7f28a4009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:21:21.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.460+0000 7f289e7fc700 1 -- 172.21.15.26:0/3807264877 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28a4018070 con 0x7f28a80f6b90 2021-11-03T17:21:21.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.460+0000 7f289e7fc700 1 -- 172.21.15.26:0/3807264877 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f28a40097d0 con 0x7f28a80f6b90 2021-11-03T17:21:21.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.460+0000 7f28aff46700 1 -- 172.21.15.26:0/3807264877 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28a80f85a0 con 0x7f28a80f6b90 2021-11-03T17:21:21.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.460+0000 7f289e7fc700 1 -- 172.21.15.26:0/3807264877 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28a401ddb0 con 0x7f28a80f6b90 2021-11-03T17:21:21.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.460+0000 7f28aff46700 1 -- 172.21.15.26:0/3807264877 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28a80f8b00 con 0x7f28a80f6b90 2021-11-03T17:21:21.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.461+0000 7f289e7fc700 1 -- 172.21.15.26:0/3807264877 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f28a4007ca0 con 0x7f28a80f6b90 2021-11-03T17:21:21.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.461+0000 7f28aff46700 1 -- 172.21.15.26:0/3807264877 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28a8045ad0 con 0x7f28a80f6b90 2021-11-03T17:21:21.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.461+0000 7f289e7fc700 1 --2- 172.21.15.26:0/3807264877 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f28940640b0 0x7f2894066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:21:21.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.462+0000 7f289e7fc700 1 -- 172.21.15.26:0/3807264877 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f28a4081cd0 con 0x7f28a80f6b90 2021-11-03T17:21:21.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.462+0000 7f28ad4e1700 1 --2- 172.21.15.26:0/3807264877 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f28940640b0 0x7f2894066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:21:21.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.462+0000 7f28ad4e1700 1 --2- 172.21.15.26:0/3807264877 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f28940640b0 0x7f2894066570 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f28980041d0 tx=0x7f289800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:21:21.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.466+0000 7f289e7fc700 1 -- 172.21.15.26:0/3807264877 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f28a4054030 con 0x7f28a80f6b90 2021-11-03T17:21:21.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.702+0000 7f28aff46700 1 -- 172.21.15.26:0/3807264877 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f28a810f660 con 0x7f28a80f6b90 2021-11-03T17:21:21.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.702+0000 7f289e7fc700 1 -- 172.21.15.26:0/3807264877 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f28a4053c20 con 0x7f28a80f6b90 2021-11-03T17:21:21.699 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:21:21.699 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:21:21.699 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:21:21.700 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:21:21.700 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:21:21.700 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:21:21.700 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:21:21.700 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:21:21.701 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:21:21.701 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:21:21.701 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:21:21.701 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:21:21.702 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:21:21.702 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:21:21.702 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:21:21.702 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:21:21.702 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:21:21.703 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:21:21.704 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.704+0000 7f28aff46700 1 -- 172.21.15.26:0/3807264877 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f28940640b0 msgr2=0x7f2894066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:21:21.704 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.704+0000 7f28aff46700 1 --2- 172.21.15.26:0/3807264877 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f28940640b0 0x7f2894066570 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f28980041d0 tx=0x7f289800b040).stop 2021-11-03T17:21:21.704 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.704+0000 7f28aff46700 1 -- 172.21.15.26:0/3807264877 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28a80f6b90 msgr2=0x7f28a80f9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:21:21.705 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.704+0000 7f28aff46700 1 --2- 172.21.15.26:0/3807264877 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28a80f6b90 0x7f28a80f9800 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f28a4000c00 tx=0x7f28a4009b30).stop 2021-11-03T17:21:21.705 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.704+0000 7f28aff46700 1 -- 172.21.15.26:0/3807264877 shutdown_connections 2021-11-03T17:21:21.705 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.704+0000 7f28aff46700 1 --2- 172.21.15.26:0/3807264877 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f28940640b0 0x7f2894066570 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:21.705 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.704+0000 7f28aff46700 1 --2- 172.21.15.26:0/3807264877 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28a80f6b90 0x7f28a80f9800 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:21.705 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.704+0000 7f28aff46700 1 --2- 172.21.15.26:0/3807264877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28a80f74a0 0x7f28a80f7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:21.706 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.704+0000 7f28aff46700 1 -- 172.21.15.26:0/3807264877 >> 172.21.15.26:0/3807264877 conn(0x7f28a80f0540 msgr2=0x7f28a80f5040 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:21:21.706 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.704+0000 7f28aff46700 1 -- 172.21.15.26:0/3807264877 shutdown_connections 2021-11-03T17:21:21.706 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.704+0000 7f28aff46700 1 -- 172.21.15.26:0/3807264877 wait complete. 2021-11-03T17:21:21.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.804+0000 7ff2bd109700 1 -- 172.21.15.26:0/3589229625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2b80f6ff0 msgr2=0x7ff2b80f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:21:21.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.804+0000 7ff2bd109700 1 --2- 172.21.15.26:0/3589229625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2b80f6ff0 0x7ff2b80f7a20 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7ff2ac004660 tx=0x7ff2ac009b30).stop 2021-11-03T17:21:21.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.804+0000 7ff2bd109700 1 -- 172.21.15.26:0/3589229625 shutdown_connections 2021-11-03T17:21:21.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.804+0000 7ff2bd109700 1 --2- 172.21.15.26:0/3589229625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2b80f6ff0 0x7ff2b80f7a20 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:21.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.804+0000 7ff2bd109700 1 --2- 172.21.15.26:0/3589229625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2b80f66e0 0x7ff2b80f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:21.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.804+0000 7ff2bd109700 1 -- 172.21.15.26:0/3589229625 >> 172.21.15.26:0/3589229625 conn(0x7ff2b80f1f00 msgr2=0x7ff2b80f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:21:21.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.804+0000 7ff2bd109700 1 -- 172.21.15.26:0/3589229625 shutdown_connections 2021-11-03T17:21:21.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.804+0000 7ff2bd109700 1 -- 172.21.15.26:0/3589229625 wait complete. 2021-11-03T17:21:21.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.804+0000 7ff2bd109700 1 Processor -- start 2021-11-03T17:21:21.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.805+0000 7ff2bd109700 1 -- start start 2021-11-03T17:21:21.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.805+0000 7ff2bd109700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2b80f66e0 0x7ff2b806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:21:21.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.805+0000 7ff2bd109700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2b80f6ff0 0x7ff2b8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:21:21.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.805+0000 7ff2bd109700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b806a380 con 0x7ff2b80f6ff0 2021-11-03T17:21:21.805 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.805+0000 7ff2bd109700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b806a4c0 con 0x7ff2b80f66e0 2021-11-03T17:21:21.805 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.805+0000 7ff2b659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2b80f6ff0 0x7ff2b8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:21:21.805 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.805+0000 7ff2b659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2b80f6ff0 0x7ff2b8069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53948/0 (socket says 172.21.15.26:53948) 2021-11-03T17:21:21.805 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.805+0000 7ff2b659c700 1 -- 172.21.15.26:0/445950750 learned_addr learned my addr 172.21.15.26:0/445950750 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:21:21.806 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.805+0000 7ff2b6d9d700 1 --2- 172.21.15.26:0/445950750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2b80f66e0 0x7ff2b806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:21:21.806 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.805+0000 7ff2b659c700 1 -- 172.21.15.26:0/445950750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2b80f66e0 msgr2=0x7ff2b806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:21:21.806 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.805+0000 7ff2b659c700 1 --2- 172.21.15.26:0/445950750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2b80f66e0 0x7ff2b806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:21.807 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.805+0000 7ff2b659c700 1 -- 172.21.15.26:0/445950750 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ac005040 con 0x7ff2b80f6ff0 2021-11-03T17:21:21.807 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.805+0000 7ff2b6d9d700 1 --2- 172.21.15.26:0/445950750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2b80f66e0 0x7ff2b806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:21:21.807 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.805+0000 7ff2b659c700 1 --2- 172.21.15.26:0/445950750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2b80f6ff0 0x7ff2b8069e20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7ff2ac009990 tx=0x7ff2ac009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:21:21.807 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.805+0000 7ff29f7fe700 1 -- 172.21.15.26:0/445950750 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2ac018070 con 0x7ff2b80f6ff0 2021-11-03T17:21:21.807 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.806+0000 7ff29f7fe700 1 -- 172.21.15.26:0/445950750 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff2ac007ba0 con 0x7ff2b80f6ff0 2021-11-03T17:21:21.808 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.806+0000 7ff2bd109700 1 -- 172.21.15.26:0/445950750 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2b806a740 con 0x7ff2b80f6ff0 2021-11-03T17:21:21.808 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.806+0000 7ff29f7fe700 1 -- 172.21.15.26:0/445950750 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2ac01c3c0 con 0x7ff2b80f6ff0 2021-11-03T17:21:21.808 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.806+0000 7ff2bd109700 1 -- 172.21.15.26:0/445950750 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2b806aca0 con 0x7ff2b80f6ff0 2021-11-03T17:21:21.809 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.807+0000 7ff2bd109700 1 -- 172.21.15.26:0/445950750 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2b8045ad0 con 0x7ff2b80f6ff0 2021-11-03T17:21:21.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.807+0000 7ff29f7fe700 1 -- 172.21.15.26:0/445950750 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ff2ac01d420 con 0x7ff2b80f6ff0 2021-11-03T17:21:21.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.807+0000 7ff29f7fe700 1 --2- 172.21.15.26:0/445950750 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff2a00640b0 0x7ff2a0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:21:21.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.807+0000 7ff29f7fe700 1 -- 172.21.15.26:0/445950750 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ff2ac082500 con 0x7ff2b80f6ff0 2021-11-03T17:21:21.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.807+0000 7ff2b6d9d700 1 --2- 172.21.15.26:0/445950750 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff2a00640b0 0x7ff2a0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:21:21.811 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.808+0000 7ff2b6d9d700 1 --2- 172.21.15.26:0/445950750 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff2a00640b0 0x7ff2a0066570 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7ff2b806b730 tx=0x7ff2a800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:21:21.811 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:21.812+0000 7ff29f7fe700 1 -- 172.21.15.26:0/445950750 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ff2ac0548c0 con 0x7ff2b80f6ff0 2021-11-03T17:21:22.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:22.016+0000 7ff2bd109700 1 -- 172.21.15.26:0/445950750 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff2b8027a00 con 0x7ff2b80f6ff0 2021-11-03T17:21:22.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:22.017+0000 7ff29f7fe700 1 -- 172.21.15.26:0/445950750 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7ff2ac0544b0 con 0x7ff2b80f6ff0 2021-11-03T17:21:22.013 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:21:22.013 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:21:22.013 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:21:22.014 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:21:22.014 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:21:22.014 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:21:22.014 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:21:22.015 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:21:22.015 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:21:22.015 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:21:22.015 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:21:22.016 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:21:22.016 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:21:22.016 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:21:22.016 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:21:22.017 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:21:22.017 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:21:22.017 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:21:22.017 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:21:22.018 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:21:22.018 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:21:22.018 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:21:22.018 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:21:22.019 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:21:22.019 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:21:22.019 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:21:22.019 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:21:22.020 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:21:22.020 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:21:22.020 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:21:22.020 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:21:22.021 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:21:22.021 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:21:22.021 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:21:22.021 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:21:22.022 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:21:22.022 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:21:22.022 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:21:22.022 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:21:22.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:22.018+0000 7ff2bd109700 1 -- 172.21.15.26:0/445950750 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff2a00640b0 msgr2=0x7ff2a0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:21:22.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:22.018+0000 7ff2bd109700 1 --2- 172.21.15.26:0/445950750 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff2a00640b0 0x7ff2a0066570 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7ff2b806b730 tx=0x7ff2a800b040).stop 2021-11-03T17:21:22.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:22.018+0000 7ff2bd109700 1 -- 172.21.15.26:0/445950750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2b80f6ff0 msgr2=0x7ff2b8069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:21:22.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:22.018+0000 7ff2bd109700 1 --2- 172.21.15.26:0/445950750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2b80f6ff0 0x7ff2b8069e20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7ff2ac009990 tx=0x7ff2ac009b30).stop 2021-11-03T17:21:22.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:22.018+0000 7ff2bd109700 1 -- 172.21.15.26:0/445950750 shutdown_connections 2021-11-03T17:21:22.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:22.018+0000 7ff2bd109700 1 --2- 172.21.15.26:0/445950750 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff2a00640b0 0x7ff2a0066570 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:22.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:22.019+0000 7ff2bd109700 1 --2- 172.21.15.26:0/445950750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2b80f66e0 0x7ff2b806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:22.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:22.019+0000 7ff2bd109700 1 --2- 172.21.15.26:0/445950750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2b80f6ff0 0x7ff2b8069e20 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:22.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:22.019+0000 7ff2bd109700 1 -- 172.21.15.26:0/445950750 >> 172.21.15.26:0/445950750 conn(0x7ff2b80f1f00 msgr2=0x7ff2b80fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:21:22.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:22.019+0000 7ff2bd109700 1 -- 172.21.15.26:0/445950750 shutdown_connections 2021-11-03T17:21:22.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:22.019+0000 7ff2bd109700 1 -- 172.21.15.26:0/445950750 wait complete. 2021-11-03T17:21:22.026 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:21:22.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:22 smithi026 ceph-mon[96795]: pgmap v801: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:22.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:22 smithi026 ceph-mon[96795]: from='client.34972 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:21:22.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:22 smithi026 ceph-mon[96795]: from='client.34976 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:21:22.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:22 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3807264877' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:21:22.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:22 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/445950750' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:21:22.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:22 smithi194 ceph-mon[65619]: pgmap v801: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:22.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:22 smithi194 ceph-mon[65619]: from='client.34972 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:21:22.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:22 smithi194 ceph-mon[65619]: from='client.34976 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:21:22.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:22 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3807264877' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:21:22.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:22 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/445950750' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:21:23.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:23 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:21:23.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:23 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:21:24.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:24 smithi026 ceph-mon[96795]: pgmap v802: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:24.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:24 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:21:24.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:24 smithi194 ceph-mon[65619]: pgmap v802: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:24.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:24 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:21:26.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:26 smithi026 ceph-mon[96795]: pgmap v803: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:26.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:26 smithi194 ceph-mon[65619]: pgmap v803: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:28.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:28 smithi026 ceph-mon[96795]: pgmap v804: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:28.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:28 smithi194 ceph-mon[65619]: pgmap v804: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:30.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:30 smithi026 ceph-mon[96795]: pgmap v805: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:30.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:30 smithi194 ceph-mon[65619]: pgmap v805: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:32.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:32 smithi026 ceph-mon[96795]: pgmap v806: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:32.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:32 smithi194 ceph-mon[65619]: pgmap v806: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:34.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:34 smithi026 ceph-mon[96795]: pgmap v807: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:34.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:34 smithi194 ceph-mon[65619]: pgmap v807: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:36.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:36 smithi026 ceph-mon[96795]: pgmap v808: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:36.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:36 smithi194 ceph-mon[65619]: pgmap v808: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:38.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:38 smithi026 ceph-mon[96795]: pgmap v809: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:38.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:38 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:21:38.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:38 smithi194 ceph-mon[65619]: pgmap v809: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:38.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:38 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:21:39.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:39 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:21:39.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:39 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:21:40.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:40 smithi026 ceph-mon[96795]: pgmap v810: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:40.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:40 smithi194 ceph-mon[65619]: pgmap v810: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:42.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:42 smithi026 ceph-mon[96795]: pgmap v811: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:42.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:42 smithi194 ceph-mon[65619]: pgmap v811: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:44.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:44 smithi026 ceph-mon[96795]: pgmap v812: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:44.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:44 smithi194 ceph-mon[65619]: pgmap v812: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:46.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:46 smithi026 ceph-mon[96795]: pgmap v813: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:46.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:46 smithi194 ceph-mon[65619]: pgmap v813: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:48 smithi026 ceph-mon[96795]: pgmap v814: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:21:48.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:21:48.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:48 smithi194 ceph-mon[65619]: pgmap v814: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:21:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:21:50.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:50 smithi026 ceph-mon[96795]: pgmap v815: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:50.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:50 smithi194 ceph-mon[65619]: pgmap v815: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:52.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.134+0000 7ffb25e0c700 1 -- 172.21.15.26:0/3770840075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb200f6ff0 msgr2=0x7ffb200f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:21:52.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.134+0000 7ffb25e0c700 1 --2- 172.21.15.26:0/3770840075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb200f6ff0 0x7ffb200f7a20 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7ffb08004660 tx=0x7ffb08009b30).stop 2021-11-03T17:21:52.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.134+0000 7ffb25e0c700 1 -- 172.21.15.26:0/3770840075 shutdown_connections 2021-11-03T17:21:52.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.134+0000 7ffb25e0c700 1 --2- 172.21.15.26:0/3770840075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb200f6ff0 0x7ffb200f7a20 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:52.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.134+0000 7ffb25e0c700 1 --2- 172.21.15.26:0/3770840075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb200f66e0 0x7ffb200f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:52.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.134+0000 7ffb25e0c700 1 -- 172.21.15.26:0/3770840075 >> 172.21.15.26:0/3770840075 conn(0x7ffb200f1f00 msgr2=0x7ffb200f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:21:52.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.134+0000 7ffb25e0c700 1 -- 172.21.15.26:0/3770840075 shutdown_connections 2021-11-03T17:21:52.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.134+0000 7ffb25e0c700 1 -- 172.21.15.26:0/3770840075 wait complete. 2021-11-03T17:21:52.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.135+0000 7ffb25e0c700 1 Processor -- start 2021-11-03T17:21:52.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.135+0000 7ffb25e0c700 1 -- start start 2021-11-03T17:21:52.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.135+0000 7ffb25e0c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb200f66e0 0x7ffb20106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:21:52.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.135+0000 7ffb25e0c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb200f6ff0 0x7ffb20107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:21:52.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.135+0000 7ffb25e0c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb20107a10 con 0x7ffb200f66e0 2021-11-03T17:21:52.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.135+0000 7ffb25e0c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb20107b50 con 0x7ffb200f6ff0 2021-11-03T17:21:52.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.135+0000 7ffb1f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb200f66e0 0x7ffb20106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:21:52.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.135+0000 7ffb1f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb200f66e0 0x7ffb20106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53964/0 (socket says 172.21.15.26:53964) 2021-11-03T17:21:52.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.136+0000 7ffb1f7fe700 1 -- 172.21.15.26:0/469674197 learned_addr learned my addr 172.21.15.26:0/469674197 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:21:52.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.136+0000 7ffb1effd700 1 --2- 172.21.15.26:0/469674197 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb200f6ff0 0x7ffb20107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:21:52.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.136+0000 7ffb1f7fe700 1 -- 172.21.15.26:0/469674197 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb200f6ff0 msgr2=0x7ffb20107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:21:52.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.136+0000 7ffb1f7fe700 1 --2- 172.21.15.26:0/469674197 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb200f6ff0 0x7ffb20107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:52.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.136+0000 7ffb1f7fe700 1 -- 172.21.15.26:0/469674197 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb08005040 con 0x7ffb200f66e0 2021-11-03T17:21:52.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.136+0000 7ffb1f7fe700 1 --2- 172.21.15.26:0/469674197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb200f66e0 0x7ffb20106f70 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7ffb1000c530 tx=0x7ffb10007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:21:52.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.136+0000 7ffb17fff700 1 -- 172.21.15.26:0/469674197 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb1000f650 con 0x7ffb200f66e0 2021-11-03T17:21:52.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.136+0000 7ffb17fff700 1 -- 172.21.15.26:0/469674197 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ffb1000fc60 con 0x7ffb200f66e0 2021-11-03T17:21:52.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.136+0000 7ffb17fff700 1 -- 172.21.15.26:0/469674197 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb10012cd0 con 0x7ffb200f66e0 2021-11-03T17:21:52.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.136+0000 7ffb25e0c700 1 -- 172.21.15.26:0/469674197 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb201084f0 con 0x7ffb200f66e0 2021-11-03T17:21:52.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.136+0000 7ffb25e0c700 1 -- 172.21.15.26:0/469674197 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb20108ab0 con 0x7ffb200f66e0 2021-11-03T17:21:52.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.137+0000 7ffb25e0c700 1 -- 172.21.15.26:0/469674197 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb20045ad0 con 0x7ffb200f66e0 2021-11-03T17:21:52.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.138+0000 7ffb17fff700 1 -- 172.21.15.26:0/469674197 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ffb10010070 con 0x7ffb200f66e0 2021-11-03T17:21:52.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.138+0000 7ffb17fff700 1 --2- 172.21.15.26:0/469674197 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffb0c0640b0 0x7ffb0c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:21:52.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.138+0000 7ffb17fff700 1 -- 172.21.15.26:0/469674197 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ffb100806e0 con 0x7ffb200f66e0 2021-11-03T17:21:52.139 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.138+0000 7ffb1effd700 1 --2- 172.21.15.26:0/469674197 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffb0c0640b0 0x7ffb0c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:21:52.139 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.139+0000 7ffb1effd700 1 --2- 172.21.15.26:0/469674197 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffb0c0640b0 0x7ffb0c066570 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7ffb08004e30 tx=0x7ffb08009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:21:52.139 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.142+0000 7ffb17fff700 1 -- 172.21.15.26:0/469674197 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ffb10052950 con 0x7ffb200f66e0 2021-11-03T17:21:52.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.322+0000 7ffb25e0c700 1 -- 172.21.15.26:0/469674197 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb20108cd0 con 0x7ffb0c0640b0 2021-11-03T17:21:52.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.323+0000 7ffb17fff700 1 -- 172.21.15.26:0/469674197 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7ffb20108cd0 con 0x7ffb0c0640b0 2021-11-03T17:21:52.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.325+0000 7ffb25e0c700 1 -- 172.21.15.26:0/469674197 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffb0c0640b0 msgr2=0x7ffb0c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:21:52.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.325+0000 7ffb25e0c700 1 --2- 172.21.15.26:0/469674197 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffb0c0640b0 0x7ffb0c066570 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7ffb08004e30 tx=0x7ffb08009b30).stop 2021-11-03T17:21:52.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.325+0000 7ffb25e0c700 1 -- 172.21.15.26:0/469674197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb200f66e0 msgr2=0x7ffb20106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:21:52.323 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.325+0000 7ffb25e0c700 1 --2- 172.21.15.26:0/469674197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb200f66e0 0x7ffb20106f70 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7ffb1000c530 tx=0x7ffb10007e20).stop 2021-11-03T17:21:52.323 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.325+0000 7ffb25e0c700 1 -- 172.21.15.26:0/469674197 shutdown_connections 2021-11-03T17:21:52.323 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.325+0000 7ffb25e0c700 1 --2- 172.21.15.26:0/469674197 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffb0c0640b0 0x7ffb0c066570 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:52.323 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.325+0000 7ffb25e0c700 1 --2- 172.21.15.26:0/469674197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb200f66e0 0x7ffb20106f70 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:52.323 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.325+0000 7ffb25e0c700 1 --2- 172.21.15.26:0/469674197 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb200f6ff0 0x7ffb20107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:52.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.325+0000 7ffb25e0c700 1 -- 172.21.15.26:0/469674197 >> 172.21.15.26:0/469674197 conn(0x7ffb200f1f00 msgr2=0x7ffb200fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:21:52.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.325+0000 7ffb25e0c700 1 -- 172.21.15.26:0/469674197 shutdown_connections 2021-11-03T17:21:52.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.325+0000 7ffb25e0c700 1 -- 172.21.15.26:0/469674197 wait complete. 2021-11-03T17:21:52.329 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:21:52.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.426+0000 7f1cbc3ed700 1 -- 172.21.15.26:0/4270359682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cb40f6860 msgr2=0x7f1cb40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:21:52.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.426+0000 7f1cbc3ed700 1 --2- 172.21.15.26:0/4270359682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cb40f6860 0x7f1cb40f6cc0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f1cb0004660 tx=0x7f1cb0009b30).stop 2021-11-03T17:21:52.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.426+0000 7f1cbc3ed700 1 -- 172.21.15.26:0/4270359682 shutdown_connections 2021-11-03T17:21:52.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.426+0000 7f1cbc3ed700 1 --2- 172.21.15.26:0/4270359682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cb40f6860 0x7f1cb40f6cc0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:52.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.426+0000 7f1cbc3ed700 1 --2- 172.21.15.26:0/4270359682 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cb40f55c0 0x7f1cb40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:52.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.426+0000 7f1cbc3ed700 1 -- 172.21.15.26:0/4270359682 >> 172.21.15.26:0/4270359682 conn(0x7f1cb40f0d40 msgr2=0x7f1cb40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:21:52.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.426+0000 7f1cbc3ed700 1 -- 172.21.15.26:0/4270359682 shutdown_connections 2021-11-03T17:21:52.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.426+0000 7f1cbc3ed700 1 -- 172.21.15.26:0/4270359682 wait complete. 2021-11-03T17:21:52.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.426+0000 7f1cbc3ed700 1 Processor -- start 2021-11-03T17:21:52.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.426+0000 7f1cbc3ed700 1 -- start start 2021-11-03T17:21:52.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.427+0000 7f1cbc3ed700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cb40f55c0 0x7f1cb4109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:21:52.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.427+0000 7f1cbc3ed700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cb40f6860 0x7f1cb410c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:21:52.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.427+0000 7f1cbc3ed700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb40603c0 con 0x7f1cb40f55c0 2021-11-03T17:21:52.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.427+0000 7f1cbc3ed700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb4060500 con 0x7f1cb40f6860 2021-11-03T17:21:52.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.427+0000 7f1cba189700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cb40f55c0 0x7f1cb4109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:21:52.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.427+0000 7f1cba189700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cb40f55c0 0x7f1cb4109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53974/0 (socket says 172.21.15.26:53974) 2021-11-03T17:21:52.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.427+0000 7f1cba189700 1 -- 172.21.15.26:0/679902955 learned_addr learned my addr 172.21.15.26:0/679902955 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:21:52.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.427+0000 7f1cb9988700 1 --2- 172.21.15.26:0/679902955 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cb40f6860 0x7f1cb410c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:21:52.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.427+0000 7f1cba189700 1 -- 172.21.15.26:0/679902955 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cb40f6860 msgr2=0x7f1cb410c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:21:52.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.427+0000 7f1cba189700 1 --2- 172.21.15.26:0/679902955 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cb40f6860 0x7f1cb410c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:52.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.427+0000 7f1cba189700 1 -- 172.21.15.26:0/679902955 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb0005040 con 0x7f1cb40f55c0 2021-11-03T17:21:52.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.427+0000 7f1cb9988700 1 --2- 172.21.15.26:0/679902955 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cb40f6860 0x7f1cb410c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:21:52.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.427+0000 7f1cba189700 1 --2- 172.21.15.26:0/679902955 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cb40f55c0 0x7f1cb4109c70 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f1ca400c530 tx=0x7f1ca4007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:21:52.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.427+0000 7f1caaffd700 1 -- 172.21.15.26:0/679902955 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ca400f650 con 0x7f1cb40f55c0 2021-11-03T17:21:52.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.427+0000 7f1caaffd700 1 -- 172.21.15.26:0/679902955 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1ca400fc60 con 0x7f1cb40f55c0 2021-11-03T17:21:52.428 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.427+0000 7f1cbc3ed700 1 -- 172.21.15.26:0/679902955 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cb410c720 con 0x7f1cb40f55c0 2021-11-03T17:21:52.428 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.427+0000 7f1caaffd700 1 -- 172.21.15.26:0/679902955 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ca4012d20 con 0x7f1cb40f55c0 2021-11-03T17:21:52.428 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.427+0000 7f1cbc3ed700 1 -- 172.21.15.26:0/679902955 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cb410ccb0 con 0x7f1cb40f55c0 2021-11-03T17:21:52.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.428+0000 7f1cbc3ed700 1 -- 172.21.15.26:0/679902955 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cb40f49b0 con 0x7f1cb40f55c0 2021-11-03T17:21:52.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.429+0000 7f1caaffd700 1 -- 172.21.15.26:0/679902955 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f1ca4019030 con 0x7f1cb40f55c0 2021-11-03T17:21:52.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.429+0000 7f1caaffd700 1 --2- 172.21.15.26:0/679902955 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1ca00640b0 0x7f1ca0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:21:52.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.429+0000 7f1caaffd700 1 -- 172.21.15.26:0/679902955 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f1ca40806d0 con 0x7f1cb40f55c0 2021-11-03T17:21:52.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.429+0000 7f1cb9988700 1 --2- 172.21.15.26:0/679902955 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1ca00640b0 0x7f1ca0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:21:52.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.430+0000 7f1cb9988700 1 --2- 172.21.15.26:0/679902955 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1ca00640b0 0x7f1ca0066570 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f1cb0009da0 tx=0x7f1cb0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:21:52.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.433+0000 7f1caaffd700 1 -- 172.21.15.26:0/679902955 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f1ca40529d0 con 0x7f1cb40f55c0 2021-11-03T17:21:52.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.603+0000 7f1cbc3ed700 1 -- 172.21.15.26:0/679902955 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1cb4057f10 con 0x7f1ca00640b0 2021-11-03T17:21:52.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.618+0000 7f1caaffd700 1 -- 172.21.15.26:0/679902955 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f1cb4057f10 con 0x7f1ca00640b0 2021-11-03T17:21:52.613 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:21:52.613 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (33m) 3m ago 34m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:21:52.613 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (25m) 3m ago 34m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:21:52.613 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (25m) 2m ago 33m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:21:52.614 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (32m) 3m ago 34m 39.6M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:21:52.614 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (26m) 3m ago 29m 19.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:21:52.614 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (26m) 3m ago 29m 20.6M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:21:52.614 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (29m) 2m ago 29m 22.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:21:52.615 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (29m) 2m ago 29m 22.2M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:21:52.615 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (26m) 3m ago 35m 505M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:21:52.615 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (26m) 2m ago 33m 419M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:21:52.615 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (26m) 3m ago 35m 147M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:21:52.616 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (25m) 2m ago 33m 75.7M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:21:52.616 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (33m) 3m ago 33m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:21:52.616 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (33m) 2m ago 33m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:21:52.616 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (24m) 3m ago 32m 211M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:21:52.616 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (24m) 3m ago 32m 226M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:21:52.617 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (23m) 3m ago 32m 189M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:21:52.617 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (23m) 2m ago 31m 236M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:21:52.617 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (22m) 2m ago 31m 208M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:21:52.617 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (22m) 2m ago 31m 194M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:21:52.618 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (32m) 3m ago 33m 52.1M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:21:52.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.620+0000 7f1cbc3ed700 1 -- 172.21.15.26:0/679902955 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1ca00640b0 msgr2=0x7f1ca0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:21:52.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.620+0000 7f1cbc3ed700 1 --2- 172.21.15.26:0/679902955 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1ca00640b0 0x7f1ca0066570 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f1cb0009da0 tx=0x7f1cb0009b30).stop 2021-11-03T17:21:52.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.620+0000 7f1cbc3ed700 1 -- 172.21.15.26:0/679902955 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cb40f55c0 msgr2=0x7f1cb4109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:21:52.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.620+0000 7f1cbc3ed700 1 --2- 172.21.15.26:0/679902955 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cb40f55c0 0x7f1cb4109c70 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f1ca400c530 tx=0x7f1ca4007e10).stop 2021-11-03T17:21:52.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.620+0000 7f1cbc3ed700 1 -- 172.21.15.26:0/679902955 shutdown_connections 2021-11-03T17:21:52.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.620+0000 7f1cbc3ed700 1 --2- 172.21.15.26:0/679902955 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1ca00640b0 0x7f1ca0066570 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:52.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.620+0000 7f1cbc3ed700 1 --2- 172.21.15.26:0/679902955 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cb40f55c0 0x7f1cb4109c70 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:52.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.620+0000 7f1cbc3ed700 1 --2- 172.21.15.26:0/679902955 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cb40f6860 0x7f1cb410c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:52.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.620+0000 7f1cbc3ed700 1 -- 172.21.15.26:0/679902955 >> 172.21.15.26:0/679902955 conn(0x7f1cb40f0d40 msgr2=0x7f1cb40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:21:52.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.620+0000 7f1cbc3ed700 1 -- 172.21.15.26:0/679902955 shutdown_connections 2021-11-03T17:21:52.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.620+0000 7f1cbc3ed700 1 -- 172.21.15.26:0/679902955 wait complete. 2021-11-03T17:21:52.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:52 smithi026 ceph-mon[96795]: pgmap v816: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:52.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.719+0000 7fbb7544a700 1 -- 172.21.15.26:0/2087093950 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb700f6ff0 msgr2=0x7fbb700f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:21:52.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.719+0000 7fbb7544a700 1 --2- 172.21.15.26:0/2087093950 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb700f6ff0 0x7fbb700f7a20 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fbb58004660 tx=0x7fbb58009b30).stop 2021-11-03T17:21:52.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.719+0000 7fbb7544a700 1 -- 172.21.15.26:0/2087093950 shutdown_connections 2021-11-03T17:21:52.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.719+0000 7fbb7544a700 1 --2- 172.21.15.26:0/2087093950 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb700f6ff0 0x7fbb700f7a20 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:52.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.719+0000 7fbb7544a700 1 --2- 172.21.15.26:0/2087093950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb700f66e0 0x7fbb700f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:52.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.719+0000 7fbb7544a700 1 -- 172.21.15.26:0/2087093950 >> 172.21.15.26:0/2087093950 conn(0x7fbb700f1f00 msgr2=0x7fbb700f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:21:52.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.719+0000 7fbb7544a700 1 -- 172.21.15.26:0/2087093950 shutdown_connections 2021-11-03T17:21:52.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.719+0000 7fbb7544a700 1 -- 172.21.15.26:0/2087093950 wait complete. 2021-11-03T17:21:52.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.720+0000 7fbb7544a700 1 Processor -- start 2021-11-03T17:21:52.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.720+0000 7fbb7544a700 1 -- start start 2021-11-03T17:21:52.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.720+0000 7fbb7544a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb700f66e0 0x7fbb70106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:21:52.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.720+0000 7fbb7544a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb700f6ff0 0x7fbb70107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:21:52.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.720+0000 7fbb7544a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb70107a10 con 0x7fbb700f6ff0 2021-11-03T17:21:52.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.720+0000 7fbb7544a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb70107b50 con 0x7fbb700f66e0 2021-11-03T17:21:52.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.720+0000 7fbb6e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb700f6ff0 0x7fbb70107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:21:52.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.720+0000 7fbb6e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb700f6ff0 0x7fbb70107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53988/0 (socket says 172.21.15.26:53988) 2021-11-03T17:21:52.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.720+0000 7fbb6e7fc700 1 -- 172.21.15.26:0/2928813623 learned_addr learned my addr 172.21.15.26:0/2928813623 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:21:52.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.721+0000 7fbb6effd700 1 --2- 172.21.15.26:0/2928813623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb700f66e0 0x7fbb70106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:21:52.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.721+0000 7fbb6e7fc700 1 -- 172.21.15.26:0/2928813623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb700f66e0 msgr2=0x7fbb70106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:21:52.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.721+0000 7fbb6e7fc700 1 --2- 172.21.15.26:0/2928813623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb700f66e0 0x7fbb70106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:52.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.721+0000 7fbb6e7fc700 1 -- 172.21.15.26:0/2928813623 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb58005040 con 0x7fbb700f6ff0 2021-11-03T17:21:52.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.721+0000 7fbb6effd700 1 --2- 172.21.15.26:0/2928813623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb700f66e0 0x7fbb70106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:21:52.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.721+0000 7fbb6e7fc700 1 --2- 172.21.15.26:0/2928813623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb700f6ff0 0x7fbb70107460 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7fbb58009990 tx=0x7fbb58009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:21:52.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.721+0000 7fbb677fe700 1 -- 172.21.15.26:0/2928813623 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb58018070 con 0x7fbb700f6ff0 2021-11-03T17:21:52.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.721+0000 7fbb677fe700 1 -- 172.21.15.26:0/2928813623 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbb58007ca0 con 0x7fbb700f6ff0 2021-11-03T17:21:52.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.721+0000 7fbb7544a700 1 -- 172.21.15.26:0/2928813623 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb70108490 con 0x7fbb700f6ff0 2021-11-03T17:21:52.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.721+0000 7fbb677fe700 1 -- 172.21.15.26:0/2928813623 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb5801c620 con 0x7fbb700f6ff0 2021-11-03T17:21:52.726 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.721+0000 7fbb7544a700 1 -- 172.21.15.26:0/2928813623 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb701089f0 con 0x7fbb700f6ff0 2021-11-03T17:21:52.726 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.722+0000 7fbb7544a700 1 -- 172.21.15.26:0/2928813623 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb70045ad0 con 0x7fbb700f6ff0 2021-11-03T17:21:52.726 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.722+0000 7fbb677fe700 1 -- 172.21.15.26:0/2928813623 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fbb5801d960 con 0x7fbb700f6ff0 2021-11-03T17:21:52.727 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.723+0000 7fbb677fe700 1 --2- 172.21.15.26:0/2928813623 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbb5c0640b0 0x7fbb5c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:21:52.727 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.723+0000 7fbb677fe700 1 -- 172.21.15.26:0/2928813623 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fbb58082540 con 0x7fbb700f6ff0 2021-11-03T17:21:52.727 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.723+0000 7fbb6effd700 1 --2- 172.21.15.26:0/2928813623 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbb5c0640b0 0x7fbb5c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:21:52.728 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.723+0000 7fbb6effd700 1 --2- 172.21.15.26:0/2928813623 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbb5c0640b0 0x7fbb5c066570 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fbb68007c60 tx=0x7fbb68009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:21:52.728 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.727+0000 7fbb677fe700 1 -- 172.21.15.26:0/2928813623 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fbb58054960 con 0x7fbb700f6ff0 2021-11-03T17:21:52.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:52 smithi194 ceph-mon[65619]: pgmap v816: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:52.951 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.957+0000 7fbb7544a700 1 -- 172.21.15.26:0/2928813623 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbb70027a00 con 0x7fbb700f6ff0 2021-11-03T17:21:52.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.958+0000 7fbb677fe700 1 -- 172.21.15.26:0/2928813623 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fbb58054550 con 0x7fbb700f6ff0 2021-11-03T17:21:52.952 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:21:52.952 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:21:52.953 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:21:52.953 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:21:52.953 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:21:52.953 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:21:52.954 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:21:52.954 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:21:52.954 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:21:52.954 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:21:52.955 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:21:52.955 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:21:52.955 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:21:52.955 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:21:52.955 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:21:52.956 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:21:52.956 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:21:52.956 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:21:52.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.959+0000 7fbb7544a700 1 -- 172.21.15.26:0/2928813623 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbb5c0640b0 msgr2=0x7fbb5c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:21:52.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.959+0000 7fbb7544a700 1 --2- 172.21.15.26:0/2928813623 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbb5c0640b0 0x7fbb5c066570 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fbb68007c60 tx=0x7fbb68009040).stop 2021-11-03T17:21:52.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.959+0000 7fbb7544a700 1 -- 172.21.15.26:0/2928813623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb700f6ff0 msgr2=0x7fbb70107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:21:52.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.959+0000 7fbb7544a700 1 --2- 172.21.15.26:0/2928813623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb700f6ff0 0x7fbb70107460 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7fbb58009990 tx=0x7fbb58009b30).stop 2021-11-03T17:21:52.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.959+0000 7fbb7544a700 1 -- 172.21.15.26:0/2928813623 shutdown_connections 2021-11-03T17:21:52.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.959+0000 7fbb7544a700 1 --2- 172.21.15.26:0/2928813623 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbb5c0640b0 0x7fbb5c066570 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:52.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.959+0000 7fbb7544a700 1 --2- 172.21.15.26:0/2928813623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb700f66e0 0x7fbb70106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:52.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.959+0000 7fbb7544a700 1 --2- 172.21.15.26:0/2928813623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb700f6ff0 0x7fbb70107460 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:52.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.959+0000 7fbb7544a700 1 -- 172.21.15.26:0/2928813623 >> 172.21.15.26:0/2928813623 conn(0x7fbb700f1f00 msgr2=0x7fbb700fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:21:52.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.960+0000 7fbb7544a700 1 -- 172.21.15.26:0/2928813623 shutdown_connections 2021-11-03T17:21:52.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:52.960+0000 7fbb7544a700 1 -- 172.21.15.26:0/2928813623 wait complete. 2021-11-03T17:21:53.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.060+0000 7fe5e24d9700 1 -- 172.21.15.26:0/253423183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5dc0f7960 msgr2=0x7fe5dc0f7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:21:53.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.060+0000 7fe5e24d9700 1 --2- 172.21.15.26:0/253423183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5dc0f7960 0x7fe5dc0f7dc0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7fe5cc004660 tx=0x7fe5cc009b30).stop 2021-11-03T17:21:53.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.060+0000 7fe5e24d9700 1 -- 172.21.15.26:0/253423183 shutdown_connections 2021-11-03T17:21:53.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.060+0000 7fe5e24d9700 1 --2- 172.21.15.26:0/253423183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5dc0f7960 0x7fe5dc0f7dc0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:53.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.060+0000 7fe5e24d9700 1 --2- 172.21.15.26:0/253423183 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5dc0f66c0 0x7fe5dc0f6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:53.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.060+0000 7fe5e24d9700 1 -- 172.21.15.26:0/253423183 >> 172.21.15.26:0/253423183 conn(0x7fe5dc0f1e20 msgr2=0x7fe5dc0f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:21:53.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.060+0000 7fe5e24d9700 1 -- 172.21.15.26:0/253423183 shutdown_connections 2021-11-03T17:21:53.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.060+0000 7fe5e24d9700 1 -- 172.21.15.26:0/253423183 wait complete. 2021-11-03T17:21:53.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.061+0000 7fe5e24d9700 1 Processor -- start 2021-11-03T17:21:53.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.061+0000 7fe5e24d9700 1 -- start start 2021-11-03T17:21:53.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.061+0000 7fe5e24d9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5dc0f66c0 0x7fe5dc106f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:21:53.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.061+0000 7fe5e24d9700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5dc0f7960 0x7fe5dc107440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:21:53.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.061+0000 7fe5e24d9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5dc1079f0 con 0x7fe5dc0f66c0 2021-11-03T17:21:53.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.061+0000 7fe5e24d9700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5dc107b30 con 0x7fe5dc0f7960 2021-11-03T17:21:53.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.061+0000 7fe5dbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5dc0f66c0 0x7fe5dc106f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:21:53.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.061+0000 7fe5dbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5dc0f66c0 0x7fe5dc106f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53996/0 (socket says 172.21.15.26:53996) 2021-11-03T17:21:53.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.061+0000 7fe5dbfff700 1 -- 172.21.15.26:0/661861918 learned_addr learned my addr 172.21.15.26:0/661861918 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:21:53.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.061+0000 7fe5db7fe700 1 --2- 172.21.15.26:0/661861918 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5dc0f7960 0x7fe5dc107440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:21:53.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.061+0000 7fe5dbfff700 1 -- 172.21.15.26:0/661861918 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5dc0f7960 msgr2=0x7fe5dc107440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:21:53.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.061+0000 7fe5dbfff700 1 --2- 172.21.15.26:0/661861918 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5dc0f7960 0x7fe5dc107440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:53.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.061+0000 7fe5dbfff700 1 -- 172.21.15.26:0/661861918 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5cc005040 con 0x7fe5dc0f66c0 2021-11-03T17:21:53.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.062+0000 7fe5dbfff700 1 --2- 172.21.15.26:0/661861918 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5dc0f66c0 0x7fe5dc106f50 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fe5d0002700 tx=0x7fe5d0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:21:53.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.062+0000 7fe5d8ff9700 1 -- 172.21.15.26:0/661861918 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5d00079c0 con 0x7fe5dc0f66c0 2021-11-03T17:21:53.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.062+0000 7fe5d8ff9700 1 -- 172.21.15.26:0/661861918 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe5d000f040 con 0x7fe5dc0f66c0 2021-11-03T17:21:53.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.062+0000 7fe5e24d9700 1 -- 172.21.15.26:0/661861918 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5dc1084d0 con 0x7fe5dc0f66c0 2021-11-03T17:21:53.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.062+0000 7fe5d8ff9700 1 -- 172.21.15.26:0/661861918 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5d0014860 con 0x7fe5dc0f66c0 2021-11-03T17:21:53.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.062+0000 7fe5e24d9700 1 -- 172.21.15.26:0/661861918 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5dc108a90 con 0x7fe5dc0f66c0 2021-11-03T17:21:53.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.063+0000 7fe5e24d9700 1 -- 172.21.15.26:0/661861918 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5dc045ad0 con 0x7fe5dc0f66c0 2021-11-03T17:21:53.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.063+0000 7fe5d8ff9700 1 -- 172.21.15.26:0/661861918 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fe5d001b060 con 0x7fe5dc0f66c0 2021-11-03T17:21:53.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.064+0000 7fe5d8ff9700 1 --2- 172.21.15.26:0/661861918 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe5c40640b0 0x7fe5c4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:21:53.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.064+0000 7fe5d8ff9700 1 -- 172.21.15.26:0/661861918 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fe5d0080670 con 0x7fe5dc0f66c0 2021-11-03T17:21:53.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.064+0000 7fe5db7fe700 1 --2- 172.21.15.26:0/661861918 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe5c40640b0 0x7fe5c4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:21:53.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.064+0000 7fe5db7fe700 1 --2- 172.21.15.26:0/661861918 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe5c40640b0 0x7fe5c4066570 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fe5cc004630 tx=0x7fe5cc009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:21:53.065 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.068+0000 7fe5d8ff9700 1 -- 172.21.15.26:0/661861918 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fe5d00529d0 con 0x7fe5dc0f66c0 2021-11-03T17:21:53.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.271+0000 7fe5e24d9700 1 -- 172.21.15.26:0/661861918 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe5dc0ff000 con 0x7fe5dc0f66c0 2021-11-03T17:21:53.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.272+0000 7fe5d8ff9700 1 -- 172.21.15.26:0/661861918 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fe5d0019070 con 0x7fe5dc0f66c0 2021-11-03T17:21:53.266 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:21:53.267 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:21:53.267 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:21:53.267 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:21:53.267 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:21:53.267 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:21:53.269 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:21:53.269 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:21:53.270 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:21:53.270 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:21:53.270 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:21:53.270 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:21:53.271 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:21:53.271 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:21:53.271 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:21:53.272 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:21:53.272 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:21:53.272 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:21:53.272 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:21:53.272 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:21:53.273 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:21:53.273 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:21:53.273 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:21:53.273 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:21:53.274 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:21:53.274 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:21:53.274 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:21:53.274 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:21:53.275 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:21:53.276 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:21:53.276 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:21:53.276 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:21:53.277 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:21:53.277 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:21:53.277 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:21:53.277 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:21:53.278 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:21:53.278 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:21:53.278 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:21:53.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.273+0000 7fe5e24d9700 1 -- 172.21.15.26:0/661861918 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe5c40640b0 msgr2=0x7fe5c4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:21:53.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.273+0000 7fe5e24d9700 1 --2- 172.21.15.26:0/661861918 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe5c40640b0 0x7fe5c4066570 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fe5cc004630 tx=0x7fe5cc009b30).stop 2021-11-03T17:21:53.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.273+0000 7fe5e24d9700 1 -- 172.21.15.26:0/661861918 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5dc0f66c0 msgr2=0x7fe5dc106f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:21:53.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.273+0000 7fe5e24d9700 1 --2- 172.21.15.26:0/661861918 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5dc0f66c0 0x7fe5dc106f50 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fe5d0002700 tx=0x7fe5d0009d80).stop 2021-11-03T17:21:53.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.274+0000 7fe5e24d9700 1 -- 172.21.15.26:0/661861918 shutdown_connections 2021-11-03T17:21:53.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.274+0000 7fe5e24d9700 1 --2- 172.21.15.26:0/661861918 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe5c40640b0 0x7fe5c4066570 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:53.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.274+0000 7fe5e24d9700 1 --2- 172.21.15.26:0/661861918 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5dc0f66c0 0x7fe5dc106f50 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:53.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.274+0000 7fe5e24d9700 1 --2- 172.21.15.26:0/661861918 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5dc0f7960 0x7fe5dc107440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:21:53.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.274+0000 7fe5e24d9700 1 -- 172.21.15.26:0/661861918 >> 172.21.15.26:0/661861918 conn(0x7fe5dc0f1e20 msgr2=0x7fe5dc0fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:21:53.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.274+0000 7fe5e24d9700 1 -- 172.21.15.26:0/661861918 shutdown_connections 2021-11-03T17:21:53.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:21:53.274+0000 7fe5e24d9700 1 -- 172.21.15.26:0/661861918 wait complete. 2021-11-03T17:21:53.282 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:21:53.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:53 smithi026 ceph-mon[96795]: from='client.34988 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:21:53.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:53 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2928813623' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:21:53.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:53 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/661861918' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:21:53.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:53 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:21:53.672 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:53 smithi194 ceph-mon[65619]: from='client.34988 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:21:53.672 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:53 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2928813623' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:21:53.673 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:53 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/661861918' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:21:53.673 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:53 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:21:54.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:54 smithi194 ceph-mon[65619]: from='client.34992 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:21:54.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:54 smithi194 ceph-mon[65619]: pgmap v817: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:54.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:54 smithi194 ceph-mon[65619]: poll took 60056.513 ms: 1 events 2021-11-03T17:21:54.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:54 smithi026 ceph-mon[96795]: from='client.34992 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:21:54.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:54 smithi026 ceph-mon[96795]: pgmap v817: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:54.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:54 smithi026 ceph-mon[96795]: poll took 60056.513 ms: 1 events 2021-11-03T17:21:56.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:56 smithi026 ceph-mon[96795]: pgmap v818: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:56.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:56 smithi194 ceph-mon[65619]: pgmap v818: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:58.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:57 smithi026 ceph-mon[96795]: pgmap v819: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:58.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:57 smithi026 ceph-mon[96795]: poll took 2795.582 ms: 1 events 2021-11-03T17:21:58.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:57 smithi026 ceph-mon[96795]: Detected new or changed devices on smithi194 2021-11-03T17:21:58.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:57 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:21:58.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:57 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:21:58.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:57 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:21:58.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:57 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:21:58.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:57 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:21:58.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:57 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:21:58.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:57 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:21:58.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:57 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:21:58.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:57 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:21:58.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:21:57 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:21:58.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:57 smithi194 ceph-mon[65619]: pgmap v819: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:21:58.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:57 smithi194 ceph-mon[65619]: poll took 2795.582 ms: 1 events 2021-11-03T17:21:58.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:57 smithi194 ceph-mon[65619]: Detected new or changed devices on smithi194 2021-11-03T17:21:58.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:57 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:21:58.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:57 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:21:58.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:57 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:21:58.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:57 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:21:58.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:57 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:21:58.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:57 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:21:58.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:57 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:21:58.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:57 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:21:58.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:57 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:21:58.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:21:57 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:22:00.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:00 smithi026 ceph-mon[96795]: pgmap v820: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:00.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:00 smithi194 ceph-mon[65619]: pgmap v820: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:02.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:02 smithi026 ceph-mon[96795]: pgmap v821: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:02.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:02 smithi194 ceph-mon[65619]: pgmap v821: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:04.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:04 smithi026 ceph-mon[96795]: pgmap v822: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:04.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:04 smithi194 ceph-mon[65619]: pgmap v822: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:06.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:06 smithi026 ceph-mon[96795]: pgmap v823: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:06.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:06 smithi194 ceph-mon[65619]: pgmap v823: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:08.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:08 smithi026 ceph-mon[96795]: pgmap v824: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:08.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:08 smithi194 ceph-mon[65619]: pgmap v824: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:10.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:10 smithi026 ceph-mon[96795]: pgmap v825: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:10.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:10 smithi194 ceph-mon[65619]: pgmap v825: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:12.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:12 smithi026 ceph-mon[96795]: pgmap v826: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:12.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:12 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:22:12.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:12 smithi194 ceph-mon[65619]: pgmap v826: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:12.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:12 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:22:13.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:13 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:22:13.470 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:13 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:22:14.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:14 smithi026 ceph-mon[96795]: pgmap v827: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:14.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:14 smithi194 ceph-mon[65619]: pgmap v827: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:16.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:16 smithi026 ceph-mon[96795]: pgmap v828: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:16.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:16 smithi194 ceph-mon[65619]: pgmap v828: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:18.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:18 smithi026 ceph-mon[96795]: pgmap v829: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:18.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:18 smithi194 ceph-mon[65619]: pgmap v829: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:20.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:20 smithi026 ceph-mon[96795]: pgmap v830: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:20.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:20 smithi194 ceph-mon[65619]: pgmap v830: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:22.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:22 smithi026 ceph-mon[96795]: pgmap v831: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:22.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:22 smithi194 ceph-mon[65619]: pgmap v831: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:23.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.388+0000 7f9d2c286700 1 -- 172.21.15.26:0/1725044762 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d240f66e0 msgr2=0x7f9d240f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:22:23.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.388+0000 7f9d2c286700 1 --2- 172.21.15.26:0/1725044762 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d240f66e0 0x7f9d240f6b00 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f9d20004660 tx=0x7f9d20009b30).stop 2021-11-03T17:22:23.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.388+0000 7f9d2c286700 1 -- 172.21.15.26:0/1725044762 shutdown_connections 2021-11-03T17:22:23.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.388+0000 7f9d2c286700 1 --2- 172.21.15.26:0/1725044762 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d240f6ff0 0x7f9d240f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:22:23.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.388+0000 7f9d2c286700 1 --2- 172.21.15.26:0/1725044762 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d240f66e0 0x7f9d240f6b00 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:23.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.388+0000 7f9d2c286700 1 -- 172.21.15.26:0/1725044762 >> 172.21.15.26:0/1725044762 conn(0x7f9d240f1f00 msgr2=0x7f9d240f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:22:23.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.388+0000 7f9d2c286700 1 -- 172.21.15.26:0/1725044762 shutdown_connections 2021-11-03T17:22:23.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.388+0000 7f9d2c286700 1 -- 172.21.15.26:0/1725044762 wait complete. 2021-11-03T17:22:23.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.389+0000 7f9d2c286700 1 Processor -- start 2021-11-03T17:22:23.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.389+0000 7f9d2c286700 1 -- start start 2021-11-03T17:22:23.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.389+0000 7f9d2c286700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d240f66e0 0x7f9d24106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:22:23.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.389+0000 7f9d2c286700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d240f6ff0 0x7f9d24107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:22:23.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.389+0000 7f9d2c286700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d24107ab0 con 0x7f9d240f6ff0 2021-11-03T17:22:23.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.389+0000 7f9d2c286700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d24108360 con 0x7f9d240f66e0 2021-11-03T17:22:23.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.389+0000 7f9d29821700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d240f6ff0 0x7f9d24107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:22:23.395 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.389+0000 7f9d29821700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d240f6ff0 0x7f9d24107470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54016/0 (socket says 172.21.15.26:54016) 2021-11-03T17:22:23.395 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.389+0000 7f9d29821700 1 -- 172.21.15.26:0/3512877785 learned_addr learned my addr 172.21.15.26:0/3512877785 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:22:23.395 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.389+0000 7f9d2a022700 1 --2- 172.21.15.26:0/3512877785 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d240f66e0 0x7f9d24106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:22:23.395 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.389+0000 7f9d29821700 1 -- 172.21.15.26:0/3512877785 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d240f66e0 msgr2=0x7f9d24106f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:22:23.396 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.389+0000 7f9d29821700 1 --2- 172.21.15.26:0/3512877785 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d240f66e0 0x7f9d24106f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:23.396 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.389+0000 7f9d29821700 1 -- 172.21.15.26:0/3512877785 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d20005040 con 0x7f9d240f6ff0 2021-11-03T17:22:23.396 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.389+0000 7f9d2a022700 1 --2- 172.21.15.26:0/3512877785 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d240f66e0 0x7f9d24106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:22:23.396 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.390+0000 7f9d29821700 1 --2- 172.21.15.26:0/3512877785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d240f6ff0 0x7f9d24107470 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f9d1800b410 tx=0x7f9d18006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:22:23.397 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.390+0000 7f9d16ffd700 1 -- 172.21.15.26:0/3512877785 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d180125f0 con 0x7f9d240f6ff0 2021-11-03T17:22:23.397 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.390+0000 7f9d16ffd700 1 -- 172.21.15.26:0/3512877785 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9d18012c00 con 0x7f9d240f6ff0 2021-11-03T17:22:23.397 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.390+0000 7f9d2c286700 1 -- 172.21.15.26:0/3512877785 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d24108640 con 0x7f9d240f6ff0 2021-11-03T17:22:23.397 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.390+0000 7f9d16ffd700 1 -- 172.21.15.26:0/3512877785 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d18002ae0 con 0x7f9d240f6ff0 2021-11-03T17:22:23.398 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.390+0000 7f9d2c286700 1 -- 172.21.15.26:0/3512877785 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d24108c00 con 0x7f9d240f6ff0 2021-11-03T17:22:23.398 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.391+0000 7f9d2c286700 1 -- 172.21.15.26:0/3512877785 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d240f5b70 con 0x7f9d240f6ff0 2021-11-03T17:22:23.398 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.391+0000 7f9d16ffd700 1 -- 172.21.15.26:0/3512877785 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f9d1800f030 con 0x7f9d240f6ff0 2021-11-03T17:22:23.399 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.392+0000 7f9d16ffd700 1 --2- 172.21.15.26:0/3512877785 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9d100640b0 0x7f9d10066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:22:23.399 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.392+0000 7f9d16ffd700 1 -- 172.21.15.26:0/3512877785 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f9d18080be0 con 0x7f9d240f6ff0 2021-11-03T17:22:23.400 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.392+0000 7f9d2a022700 1 --2- 172.21.15.26:0/3512877785 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9d100640b0 0x7f9d10066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:22:23.400 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.392+0000 7f9d2a022700 1 --2- 172.21.15.26:0/3512877785 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9d100640b0 0x7f9d10066570 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f9d20004e30 tx=0x7f9d20009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:22:23.400 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.396+0000 7f9d16ffd700 1 -- 172.21.15.26:0/3512877785 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f9d18052f40 con 0x7f9d240f6ff0 2021-11-03T17:22:23.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.575+0000 7f9d2c286700 1 -- 172.21.15.26:0/3512877785 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9d240fefc0 con 0x7f9d100640b0 2021-11-03T17:22:23.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.576+0000 7f9d16ffd700 1 -- 172.21.15.26:0/3512877785 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f9d240fefc0 con 0x7f9d100640b0 2021-11-03T17:22:23.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.578+0000 7f9d2c286700 1 -- 172.21.15.26:0/3512877785 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9d100640b0 msgr2=0x7f9d10066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:22:23.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.578+0000 7f9d2c286700 1 --2- 172.21.15.26:0/3512877785 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9d100640b0 0x7f9d10066570 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f9d20004e30 tx=0x7f9d20009b30).stop 2021-11-03T17:22:23.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.578+0000 7f9d2c286700 1 -- 172.21.15.26:0/3512877785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d240f6ff0 msgr2=0x7f9d24107470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:22:23.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.578+0000 7f9d2c286700 1 --2- 172.21.15.26:0/3512877785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d240f6ff0 0x7f9d24107470 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f9d1800b410 tx=0x7f9d18006ef0).stop 2021-11-03T17:22:23.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.578+0000 7f9d2c286700 1 -- 172.21.15.26:0/3512877785 shutdown_connections 2021-11-03T17:22:23.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.578+0000 7f9d2c286700 1 --2- 172.21.15.26:0/3512877785 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9d100640b0 0x7f9d10066570 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:23.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.578+0000 7f9d2c286700 1 --2- 172.21.15.26:0/3512877785 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d240f66e0 0x7f9d24106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:23.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.578+0000 7f9d2c286700 1 --2- 172.21.15.26:0/3512877785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d240f6ff0 0x7f9d24107470 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:23.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.578+0000 7f9d2c286700 1 -- 172.21.15.26:0/3512877785 >> 172.21.15.26:0/3512877785 conn(0x7f9d240f1f00 msgr2=0x7f9d240fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:22:23.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.578+0000 7f9d2c286700 1 -- 172.21.15.26:0/3512877785 shutdown_connections 2021-11-03T17:22:23.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.578+0000 7f9d2c286700 1 -- 172.21.15.26:0/3512877785 wait complete. 2021-11-03T17:22:23.583 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:22:23.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.679+0000 7fdd1d1d6700 1 -- 172.21.15.26:0/2250704424 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd180f6ff0 msgr2=0x7fdd180f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:22:23.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.679+0000 7fdd1d1d6700 1 --2- 172.21.15.26:0/2250704424 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd180f6ff0 0x7fdd180f7a20 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7fdd0c004660 tx=0x7fdd0c009b30).stop 2021-11-03T17:22:23.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.679+0000 7fdd1d1d6700 1 -- 172.21.15.26:0/2250704424 shutdown_connections 2021-11-03T17:22:23.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.679+0000 7fdd1d1d6700 1 --2- 172.21.15.26:0/2250704424 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd180f6ff0 0x7fdd180f7a20 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:23.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.679+0000 7fdd1d1d6700 1 --2- 172.21.15.26:0/2250704424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd180f66e0 0x7fdd180f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:23.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.679+0000 7fdd1d1d6700 1 -- 172.21.15.26:0/2250704424 >> 172.21.15.26:0/2250704424 conn(0x7fdd180f1f00 msgr2=0x7fdd180f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:22:23.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.679+0000 7fdd1d1d6700 1 -- 172.21.15.26:0/2250704424 shutdown_connections 2021-11-03T17:22:23.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.679+0000 7fdd1d1d6700 1 -- 172.21.15.26:0/2250704424 wait complete. 2021-11-03T17:22:23.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.679+0000 7fdd1d1d6700 1 Processor -- start 2021-11-03T17:22:23.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.679+0000 7fdd1d1d6700 1 -- start start 2021-11-03T17:22:23.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.680+0000 7fdd1d1d6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd180f66e0 0x7fdd18106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:22:23.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.680+0000 7fdd1d1d6700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd180f6ff0 0x7fdd18107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:22:23.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.680+0000 7fdd1d1d6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd18107a10 con 0x7fdd180f66e0 2021-11-03T17:22:23.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.680+0000 7fdd1d1d6700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd18107b50 con 0x7fdd180f6ff0 2021-11-03T17:22:23.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.680+0000 7fdd16d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd180f66e0 0x7fdd18106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:22:23.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.680+0000 7fdd16d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd180f66e0 0x7fdd18106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54024/0 (socket says 172.21.15.26:54024) 2021-11-03T17:22:23.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.680+0000 7fdd16d9d700 1 -- 172.21.15.26:0/2470998055 learned_addr learned my addr 172.21.15.26:0/2470998055 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:22:23.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.680+0000 7fdd1659c700 1 --2- 172.21.15.26:0/2470998055 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd180f6ff0 0x7fdd18107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:22:23.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.680+0000 7fdd16d9d700 1 -- 172.21.15.26:0/2470998055 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd180f6ff0 msgr2=0x7fdd18107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:22:23.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.680+0000 7fdd16d9d700 1 --2- 172.21.15.26:0/2470998055 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd180f6ff0 0x7fdd18107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:23.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.680+0000 7fdd16d9d700 1 -- 172.21.15.26:0/2470998055 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd0c005040 con 0x7fdd180f66e0 2021-11-03T17:22:23.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.680+0000 7fdd16d9d700 1 --2- 172.21.15.26:0/2470998055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd180f66e0 0x7fdd18106f70 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7fdd0800c530 tx=0x7fdd08007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:22:23.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.680+0000 7fdcff7fe700 1 -- 172.21.15.26:0/2470998055 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd0800f650 con 0x7fdd180f66e0 2021-11-03T17:22:23.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.680+0000 7fdcff7fe700 1 -- 172.21.15.26:0/2470998055 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdd0800fc60 con 0x7fdd180f66e0 2021-11-03T17:22:23.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.680+0000 7fdd1d1d6700 1 -- 172.21.15.26:0/2470998055 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd181084f0 con 0x7fdd180f66e0 2021-11-03T17:22:23.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.680+0000 7fdcff7fe700 1 -- 172.21.15.26:0/2470998055 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd08012c20 con 0x7fdd180f66e0 2021-11-03T17:22:23.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.680+0000 7fdd1d1d6700 1 -- 172.21.15.26:0/2470998055 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd18108ab0 con 0x7fdd180f66e0 2021-11-03T17:22:23.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.681+0000 7fdd1d1d6700 1 -- 172.21.15.26:0/2470998055 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd18045ad0 con 0x7fdd180f66e0 2021-11-03T17:22:23.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.682+0000 7fdcff7fe700 1 -- 172.21.15.26:0/2470998055 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fdd08010070 con 0x7fdd180f66e0 2021-11-03T17:22:23.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.682+0000 7fdcff7fe700 1 --2- 172.21.15.26:0/2470998055 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdd000640b0 0x7fdd00066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:22:23.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.682+0000 7fdcff7fe700 1 -- 172.21.15.26:0/2470998055 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fdd08080660 con 0x7fdd180f66e0 2021-11-03T17:22:23.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.682+0000 7fdd1659c700 1 --2- 172.21.15.26:0/2470998055 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdd000640b0 0x7fdd00066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:22:23.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.683+0000 7fdd1659c700 1 --2- 172.21.15.26:0/2470998055 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdd000640b0 0x7fdd00066570 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fdd0c004630 tx=0x7fdd0c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:22:23.692 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.686+0000 7fdcff7fe700 1 -- 172.21.15.26:0/2470998055 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fdd080528d0 con 0x7fdd180f66e0 2021-11-03T17:22:23.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.857+0000 7fdd1d1d6700 1 -- 172.21.15.26:0/2470998055 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdd180ff050 con 0x7fdd000640b0 2021-11-03T17:22:23.866 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.871+0000 7fdcff7fe700 1 -- 172.21.15.26:0/2470998055 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fdd180ff050 con 0x7fdd000640b0 2021-11-03T17:22:23.867 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:22:23.867 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (33m) 3m ago 34m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:22:23.867 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (25m) 3m ago 34m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:22:23.867 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (25m) 2m ago 34m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:22:23.868 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (33m) 3m ago 34m 39.6M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:22:23.868 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (26m) 3m ago 30m 19.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:22:23.868 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (26m) 3m ago 29m 20.6M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:22:23.868 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (30m) 2m ago 30m 22.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:22:23.869 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (29m) 2m ago 29m 22.2M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:22:23.869 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (27m) 3m ago 36m 505M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:22:23.869 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (26m) 2m ago 34m 419M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:22:23.869 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (26m) 3m ago 36m 147M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:22:23.870 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (26m) 2m ago 33m 75.7M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:22:23.870 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (34m) 3m ago 34m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:22:23.870 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (33m) 2m ago 33m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:22:23.871 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (25m) 3m ago 33m 211M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:22:23.871 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (24m) 3m ago 32m 226M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:22:23.872 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (24m) 3m ago 32m 189M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:22:23.872 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (23m) 2m ago 32m 236M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:22:23.872 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (23m) 2m ago 31m 208M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:22:23.872 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (23m) 2m ago 31m 194M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:22:23.873 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (33m) 3m ago 34m 52.1M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:22:23.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.873+0000 7fdd1d1d6700 1 -- 172.21.15.26:0/2470998055 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdd000640b0 msgr2=0x7fdd00066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:22:23.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.873+0000 7fdd1d1d6700 1 --2- 172.21.15.26:0/2470998055 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdd000640b0 0x7fdd00066570 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fdd0c004630 tx=0x7fdd0c009b30).stop 2021-11-03T17:22:23.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.873+0000 7fdd1d1d6700 1 -- 172.21.15.26:0/2470998055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd180f66e0 msgr2=0x7fdd18106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:22:23.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.873+0000 7fdd1d1d6700 1 --2- 172.21.15.26:0/2470998055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd180f66e0 0x7fdd18106f70 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7fdd0800c530 tx=0x7fdd08007e20).stop 2021-11-03T17:22:23.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.873+0000 7fdd1d1d6700 1 -- 172.21.15.26:0/2470998055 shutdown_connections 2021-11-03T17:22:23.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.873+0000 7fdd1d1d6700 1 --2- 172.21.15.26:0/2470998055 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdd000640b0 0x7fdd00066570 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:23.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.873+0000 7fdd1d1d6700 1 --2- 172.21.15.26:0/2470998055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd180f66e0 0x7fdd18106f70 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:23.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.873+0000 7fdd1d1d6700 1 --2- 172.21.15.26:0/2470998055 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd180f6ff0 0x7fdd18107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:23.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.873+0000 7fdd1d1d6700 1 -- 172.21.15.26:0/2470998055 >> 172.21.15.26:0/2470998055 conn(0x7fdd180f1f00 msgr2=0x7fdd180fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:22:23.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.873+0000 7fdd1d1d6700 1 -- 172.21.15.26:0/2470998055 shutdown_connections 2021-11-03T17:22:23.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.873+0000 7fdd1d1d6700 1 -- 172.21.15.26:0/2470998055 wait complete. 2021-11-03T17:22:23.970 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.973+0000 7ff8cf463700 1 -- 172.21.15.26:0/561143514 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8c80f66d0 msgr2=0x7ff8c80f6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:22:23.970 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.973+0000 7ff8cf463700 1 --2- 172.21.15.26:0/561143514 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8c80f66d0 0x7ff8c80f6af0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7ff8c4004660 tx=0x7ff8c4009b30).stop 2021-11-03T17:22:23.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.973+0000 7ff8cf463700 1 -- 172.21.15.26:0/561143514 shutdown_connections 2021-11-03T17:22:23.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.973+0000 7ff8cf463700 1 --2- 172.21.15.26:0/561143514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8c80f7970 0x7ff8c80f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:23.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.973+0000 7ff8cf463700 1 --2- 172.21.15.26:0/561143514 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8c80f66d0 0x7ff8c80f6af0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:23.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.973+0000 7ff8cf463700 1 -- 172.21.15.26:0/561143514 >> 172.21.15.26:0/561143514 conn(0x7ff8c80f1e50 msgr2=0x7ff8c80f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:22:23.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.973+0000 7ff8cf463700 1 -- 172.21.15.26:0/561143514 shutdown_connections 2021-11-03T17:22:23.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.973+0000 7ff8cf463700 1 -- 172.21.15.26:0/561143514 wait complete. 2021-11-03T17:22:23.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.974+0000 7ff8cf463700 1 Processor -- start 2021-11-03T17:22:23.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.974+0000 7ff8cf463700 1 -- start start 2021-11-03T17:22:23.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.974+0000 7ff8cf463700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8c80f66d0 0x7ff8c8106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:22:23.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.974+0000 7ff8cf463700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8c80f7970 0x7ff8c8107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:22:23.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.974+0000 7ff8cf463700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c8107a20 con 0x7ff8c80f7970 2021-11-03T17:22:23.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.974+0000 7ff8cf463700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c8107b60 con 0x7ff8c80f66d0 2021-11-03T17:22:23.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.974+0000 7ff8cc9fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8c80f7970 0x7ff8c8107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:22:23.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.974+0000 7ff8cc9fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8c80f7970 0x7ff8c8107470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54036/0 (socket says 172.21.15.26:54036) 2021-11-03T17:22:23.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.974+0000 7ff8cc9fe700 1 -- 172.21.15.26:0/1460294100 learned_addr learned my addr 172.21.15.26:0/1460294100 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:22:23.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.974+0000 7ff8cd1ff700 1 --2- 172.21.15.26:0/1460294100 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8c80f66d0 0x7ff8c8106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:22:23.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.974+0000 7ff8cc9fe700 1 -- 172.21.15.26:0/1460294100 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8c80f66d0 msgr2=0x7ff8c8106f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:22:23.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.974+0000 7ff8cc9fe700 1 --2- 172.21.15.26:0/1460294100 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8c80f66d0 0x7ff8c8106f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:23.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.974+0000 7ff8cc9fe700 1 -- 172.21.15.26:0/1460294100 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c4005040 con 0x7ff8c80f7970 2021-11-03T17:22:23.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.975+0000 7ff8cc9fe700 1 --2- 172.21.15.26:0/1460294100 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8c80f7970 0x7ff8c8107470 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7ff8b80026d0 tx=0x7ff8b8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:22:23.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.975+0000 7ff8bdffb700 1 -- 172.21.15.26:0/1460294100 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8b80079c0 con 0x7ff8c80f7970 2021-11-03T17:22:23.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.975+0000 7ff8bdffb700 1 -- 172.21.15.26:0/1460294100 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff8b800f040 con 0x7ff8c80f7970 2021-11-03T17:22:23.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.975+0000 7ff8cf463700 1 -- 172.21.15.26:0/1460294100 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8c8108500 con 0x7ff8c80f7970 2021-11-03T17:22:23.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.975+0000 7ff8bdffb700 1 -- 172.21.15.26:0/1460294100 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8b80148b0 con 0x7ff8c80f7970 2021-11-03T17:22:23.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.975+0000 7ff8cf463700 1 -- 172.21.15.26:0/1460294100 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8c8108ac0 con 0x7ff8c80f7970 2021-11-03T17:22:23.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.976+0000 7ff8cf463700 1 -- 172.21.15.26:0/1460294100 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8c8045ad0 con 0x7ff8c80f7970 2021-11-03T17:22:23.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.976+0000 7ff8bdffb700 1 -- 172.21.15.26:0/1460294100 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ff8b8007b20 con 0x7ff8c80f7970 2021-11-03T17:22:23.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.977+0000 7ff8bdffb700 1 --2- 172.21.15.26:0/1460294100 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff8b40640b0 0x7ff8b4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:22:23.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.977+0000 7ff8bdffb700 1 -- 172.21.15.26:0/1460294100 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ff8b8080730 con 0x7ff8c80f7970 2021-11-03T17:22:23.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.977+0000 7ff8cd1ff700 1 --2- 172.21.15.26:0/1460294100 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff8b40640b0 0x7ff8b4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:22:23.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.977+0000 7ff8cd1ff700 1 --2- 172.21.15.26:0/1460294100 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff8b40640b0 0x7ff8b4066570 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7ff8c4004630 tx=0x7ff8c4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:22:23.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:23.981+0000 7ff8bdffb700 1 -- 172.21.15.26:0/1460294100 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ff8b8052a90 con 0x7ff8c80f7970 2021-11-03T17:22:24.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.213+0000 7ff8cf463700 1 -- 172.21.15.26:0/1460294100 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff8c8027a00 con 0x7ff8c80f7970 2021-11-03T17:22:24.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.213+0000 7ff8bdffb700 1 -- 172.21.15.26:0/1460294100 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7ff8b8052680 con 0x7ff8c80f7970 2021-11-03T17:22:24.210 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:22:24.211 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:22:24.211 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:22:24.212 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:22:24.212 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:22:24.212 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:22:24.213 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:22:24.213 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:22:24.214 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:22:24.214 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:22:24.214 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:22:24.215 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:22:24.215 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:22:24.216 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:22:24.216 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:22:24.216 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:22:24.217 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:22:24.217 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:22:24.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.215+0000 7ff8cf463700 1 -- 172.21.15.26:0/1460294100 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff8b40640b0 msgr2=0x7ff8b4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:22:24.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.215+0000 7ff8cf463700 1 --2- 172.21.15.26:0/1460294100 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff8b40640b0 0x7ff8b4066570 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7ff8c4004630 tx=0x7ff8c4009b30).stop 2021-11-03T17:22:24.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.215+0000 7ff8cf463700 1 -- 172.21.15.26:0/1460294100 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8c80f7970 msgr2=0x7ff8c8107470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:22:24.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.215+0000 7ff8cf463700 1 --2- 172.21.15.26:0/1460294100 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8c80f7970 0x7ff8c8107470 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7ff8b80026d0 tx=0x7ff8b8009de0).stop 2021-11-03T17:22:24.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.215+0000 7ff8cf463700 1 -- 172.21.15.26:0/1460294100 shutdown_connections 2021-11-03T17:22:24.221 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.215+0000 7ff8cf463700 1 --2- 172.21.15.26:0/1460294100 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff8b40640b0 0x7ff8b4066570 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:24.221 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.215+0000 7ff8cf463700 1 --2- 172.21.15.26:0/1460294100 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8c80f66d0 0x7ff8c8106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:24.222 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.215+0000 7ff8cf463700 1 --2- 172.21.15.26:0/1460294100 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8c80f7970 0x7ff8c8107470 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:24.222 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.215+0000 7ff8cf463700 1 -- 172.21.15.26:0/1460294100 >> 172.21.15.26:0/1460294100 conn(0x7ff8c80f1e50 msgr2=0x7ff8c80fb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:22:24.223 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.215+0000 7ff8cf463700 1 -- 172.21.15.26:0/1460294100 shutdown_connections 2021-11-03T17:22:24.223 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.215+0000 7ff8cf463700 1 -- 172.21.15.26:0/1460294100 wait complete. 2021-11-03T17:22:24.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.316+0000 7fad859b8700 1 -- 172.21.15.26:0/3061095435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad800f7980 msgr2=0x7fad800f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:22:24.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.316+0000 7fad859b8700 1 --2- 172.21.15.26:0/3061095435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad800f7980 0x7fad800f7de0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7fad74004660 tx=0x7fad74009b30).stop 2021-11-03T17:22:24.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.316+0000 7fad859b8700 1 -- 172.21.15.26:0/3061095435 shutdown_connections 2021-11-03T17:22:24.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.316+0000 7fad859b8700 1 --2- 172.21.15.26:0/3061095435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad800f7980 0x7fad800f7de0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:24.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.316+0000 7fad859b8700 1 --2- 172.21.15.26:0/3061095435 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad800f66e0 0x7fad800f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:24.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.316+0000 7fad859b8700 1 -- 172.21.15.26:0/3061095435 >> 172.21.15.26:0/3061095435 conn(0x7fad800f1e40 msgr2=0x7fad800f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:22:24.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.316+0000 7fad859b8700 1 -- 172.21.15.26:0/3061095435 shutdown_connections 2021-11-03T17:22:24.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.316+0000 7fad859b8700 1 -- 172.21.15.26:0/3061095435 wait complete. 2021-11-03T17:22:24.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.316+0000 7fad859b8700 1 Processor -- start 2021-11-03T17:22:24.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.317+0000 7fad859b8700 1 -- start start 2021-11-03T17:22:24.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.317+0000 7fad859b8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad800f66e0 0x7fad80106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:22:24.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.317+0000 7fad859b8700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad800f7980 0x7fad80107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:22:24.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.317+0000 7fad859b8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad80107a00 con 0x7fad800f66e0 2021-11-03T17:22:24.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.317+0000 7fad859b8700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad80107b40 con 0x7fad800f7980 2021-11-03T17:22:24.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.317+0000 7fad7effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad800f66e0 0x7fad80106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:22:24.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.317+0000 7fad7effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad800f66e0 0x7fad80106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54044/0 (socket says 172.21.15.26:54044) 2021-11-03T17:22:24.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.317+0000 7fad7effd700 1 -- 172.21.15.26:0/2884575707 learned_addr learned my addr 172.21.15.26:0/2884575707 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:22:24.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.317+0000 7fad7e7fc700 1 --2- 172.21.15.26:0/2884575707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad800f7980 0x7fad80107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:22:24.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.317+0000 7fad7effd700 1 -- 172.21.15.26:0/2884575707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad800f7980 msgr2=0x7fad80107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:22:24.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.317+0000 7fad7effd700 1 --2- 172.21.15.26:0/2884575707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad800f7980 0x7fad80107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:24.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.317+0000 7fad7effd700 1 -- 172.21.15.26:0/2884575707 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad74005040 con 0x7fad800f66e0 2021-11-03T17:22:24.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.317+0000 7fad7effd700 1 --2- 172.21.15.26:0/2884575707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad800f66e0 0x7fad80106f60 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7fad7000c530 tx=0x7fad70007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:22:24.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.317+0000 7fad677fe700 1 -- 172.21.15.26:0/2884575707 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad7000f650 con 0x7fad800f66e0 2021-11-03T17:22:24.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.317+0000 7fad859b8700 1 -- 172.21.15.26:0/2884575707 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad801084e0 con 0x7fad800f66e0 2021-11-03T17:22:24.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.317+0000 7fad677fe700 1 -- 172.21.15.26:0/2884575707 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fad7000fc60 con 0x7fad800f66e0 2021-11-03T17:22:24.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.317+0000 7fad677fe700 1 -- 172.21.15.26:0/2884575707 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad70012d20 con 0x7fad800f66e0 2021-11-03T17:22:24.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.317+0000 7fad859b8700 1 -- 172.21.15.26:0/2884575707 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad80108aa0 con 0x7fad800f66e0 2021-11-03T17:22:24.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.318+0000 7fad859b8700 1 -- 172.21.15.26:0/2884575707 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad80045ad0 con 0x7fad800f66e0 2021-11-03T17:22:24.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.319+0000 7fad677fe700 1 -- 172.21.15.26:0/2884575707 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fad70019030 con 0x7fad800f66e0 2021-11-03T17:22:24.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.319+0000 7fad677fe700 1 --2- 172.21.15.26:0/2884575707 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fad680640b0 0x7fad68066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:22:24.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.319+0000 7fad677fe700 1 -- 172.21.15.26:0/2884575707 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fad70080620 con 0x7fad800f66e0 2021-11-03T17:22:24.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.319+0000 7fad7e7fc700 1 --2- 172.21.15.26:0/2884575707 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fad680640b0 0x7fad68066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:22:24.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.320+0000 7fad7e7fc700 1 --2- 172.21.15.26:0/2884575707 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fad680640b0 0x7fad68066570 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fad74004e30 tx=0x7fad74009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:22:24.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.323+0000 7fad677fe700 1 -- 172.21.15.26:0/2884575707 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fad700528e0 con 0x7fad800f66e0 2021-11-03T17:22:24.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:24 smithi026 ceph-mon[96795]: pgmap v832: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:24.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:24 smithi194 ceph-mon[65619]: pgmap v832: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:24.524 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.529+0000 7fad859b8700 1 -- 172.21.15.26:0/2884575707 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fad800ff020 con 0x7fad800f66e0 2021-11-03T17:22:24.525 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.530+0000 7fad677fe700 1 -- 172.21.15.26:0/2884575707 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fad70017710 con 0x7fad800f66e0 2021-11-03T17:22:24.525 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:22:24.525 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:22:24.526 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:22:24.526 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:22:24.526 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:22:24.526 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:22:24.527 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:22:24.527 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:22:24.527 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:22:24.527 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:22:24.528 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:22:24.528 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:22:24.528 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:22:24.528 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:22:24.529 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:22:24.529 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:22:24.529 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:22:24.529 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:22:24.529 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:22:24.530 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:22:24.530 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:22:24.530 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:22:24.530 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:22:24.531 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:22:24.531 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:22:24.531 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:22:24.531 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:22:24.532 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:22:24.533 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:22:24.534 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:22:24.534 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:22:24.534 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:22:24.534 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:22:24.535 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:22:24.535 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:22:24.535 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:22:24.535 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:22:24.536 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:22:24.536 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:22:24.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.531+0000 7fad859b8700 1 -- 172.21.15.26:0/2884575707 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fad680640b0 msgr2=0x7fad68066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:22:24.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.531+0000 7fad859b8700 1 --2- 172.21.15.26:0/2884575707 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fad680640b0 0x7fad68066570 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fad74004e30 tx=0x7fad74009b30).stop 2021-11-03T17:22:24.538 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.531+0000 7fad859b8700 1 -- 172.21.15.26:0/2884575707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad800f66e0 msgr2=0x7fad80106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:22:24.539 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.531+0000 7fad859b8700 1 --2- 172.21.15.26:0/2884575707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad800f66e0 0x7fad80106f60 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7fad7000c530 tx=0x7fad70007e10).stop 2021-11-03T17:22:24.539 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.531+0000 7fad859b8700 1 -- 172.21.15.26:0/2884575707 shutdown_connections 2021-11-03T17:22:24.539 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.531+0000 7fad859b8700 1 --2- 172.21.15.26:0/2884575707 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fad680640b0 0x7fad68066570 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:24.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.531+0000 7fad859b8700 1 --2- 172.21.15.26:0/2884575707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad800f66e0 0x7fad80106f60 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:24.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.531+0000 7fad859b8700 1 --2- 172.21.15.26:0/2884575707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad800f7980 0x7fad80107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:24.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.531+0000 7fad859b8700 1 -- 172.21.15.26:0/2884575707 >> 172.21.15.26:0/2884575707 conn(0x7fad800f1e40 msgr2=0x7fad800fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:22:24.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.531+0000 7fad859b8700 1 -- 172.21.15.26:0/2884575707 shutdown_connections 2021-11-03T17:22:24.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:24.531+0000 7fad859b8700 1 -- 172.21.15.26:0/2884575707 wait complete. 2021-11-03T17:22:24.541 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:22:25.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:25 smithi026 ceph-mon[96795]: from='client.35004 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:22:25.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:25 smithi026 ceph-mon[96795]: from='client.35008 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:22:25.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:25 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1460294100' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:22:25.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:25 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2884575707' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:22:25.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:25 smithi194 ceph-mon[65619]: from='client.35004 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:22:25.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:25 smithi194 ceph-mon[65619]: from='client.35008 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:22:25.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:25 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1460294100' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:22:25.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:25 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2884575707' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:22:26.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:26 smithi026 ceph-mon[96795]: pgmap v833: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:26.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:26 smithi194 ceph-mon[65619]: pgmap v833: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:27.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:27 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:22:27.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:27 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:22:28.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:28 smithi026 ceph-mon[96795]: pgmap v834: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:28.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:28 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:22:28.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:28 smithi194 ceph-mon[65619]: pgmap v834: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:28.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:28 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:22:30.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:30 smithi026 ceph-mon[96795]: pgmap v835: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:30.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:30 smithi194 ceph-mon[65619]: pgmap v835: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:32.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:32 smithi026 ceph-mon[96795]: pgmap v836: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:32.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:32 smithi194 ceph-mon[65619]: pgmap v836: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:34.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:34 smithi026 ceph-mon[96795]: pgmap v837: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:34.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:34 smithi194 ceph-mon[65619]: pgmap v837: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:36.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:36 smithi026 ceph-mon[96795]: pgmap v838: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:36.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:36 smithi194 ceph-mon[65619]: pgmap v838: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:38.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:38 smithi026 ceph-mon[96795]: pgmap v839: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:38.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:38 smithi194 ceph-mon[65619]: pgmap v839: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:40.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:40 smithi026 ceph-mon[96795]: pgmap v840: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:40.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:40 smithi194 ceph-mon[65619]: pgmap v840: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:42.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:42 smithi026 ceph-mon[96795]: pgmap v841: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:42.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:22:42.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:42 smithi194 ceph-mon[65619]: pgmap v841: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:42.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:22:43.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:43 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:22:43.470 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:43 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:22:44.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:44 smithi026 ceph-mon[96795]: pgmap v842: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:44.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:44 smithi194 ceph-mon[65619]: pgmap v842: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:46.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:46 smithi026 ceph-mon[96795]: pgmap v843: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:46.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:46 smithi194 ceph-mon[65619]: pgmap v843: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:48.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:48 smithi026 ceph-mon[96795]: pgmap v844: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:48.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:48 smithi194 ceph-mon[65619]: pgmap v844: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:49.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:22:49.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:22:49.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:22:49.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:22:50.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:50 smithi026 ceph-mon[96795]: pgmap v845: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:50.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:50 smithi194 ceph-mon[65619]: pgmap v845: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:52.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:52 smithi026 ceph-mon[96795]: pgmap v846: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:52.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:52 smithi194 ceph-mon[65619]: pgmap v846: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:54.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:54 smithi026 ceph-mon[96795]: pgmap v847: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:54.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:54 smithi194 ceph-mon[65619]: pgmap v847: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:54.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.647+0000 7f85b208e700 1 -- 172.21.15.26:0/2996432536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85ac0f66e0 msgr2=0x7f85ac0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:22:54.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.647+0000 7f85b208e700 1 --2- 172.21.15.26:0/2996432536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85ac0f66e0 0x7f85ac0f6b00 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f859c004660 tx=0x7f859c009b30).stop 2021-11-03T17:22:54.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.647+0000 7f85b208e700 1 -- 172.21.15.26:0/2996432536 shutdown_connections 2021-11-03T17:22:54.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.647+0000 7f85b208e700 1 --2- 172.21.15.26:0/2996432536 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85ac0f6ff0 0x7f85ac0f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:54.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.647+0000 7f85b208e700 1 --2- 172.21.15.26:0/2996432536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85ac0f66e0 0x7f85ac0f6b00 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:54.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.647+0000 7f85b208e700 1 -- 172.21.15.26:0/2996432536 >> 172.21.15.26:0/2996432536 conn(0x7f85ac0f1f00 msgr2=0x7f85ac0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:22:54.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.647+0000 7f85b208e700 1 -- 172.21.15.26:0/2996432536 shutdown_connections 2021-11-03T17:22:54.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.647+0000 7f85b208e700 1 -- 172.21.15.26:0/2996432536 wait complete. 2021-11-03T17:22:54.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.647+0000 7f85b208e700 1 Processor -- start 2021-11-03T17:22:54.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.648+0000 7f85b208e700 1 -- start start 2021-11-03T17:22:54.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.648+0000 7f85b208e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85ac0f66e0 0x7f85ac106f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:22:54.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.648+0000 7f85b208e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85ac0f6ff0 0x7f85ac1073f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:22:54.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.648+0000 7f85b208e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac1079a0 con 0x7f85ac0f66e0 2021-11-03T17:22:54.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.648+0000 7f85b208e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac107ae0 con 0x7f85ac0f6ff0 2021-11-03T17:22:54.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.648+0000 7f85ab7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85ac0f66e0 0x7f85ac106f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:22:54.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.648+0000 7f85ab7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85ac0f66e0 0x7f85ac106f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54062/0 (socket says 172.21.15.26:54062) 2021-11-03T17:22:54.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.648+0000 7f85ab7fe700 1 -- 172.21.15.26:0/571936255 learned_addr learned my addr 172.21.15.26:0/571936255 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:22:54.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.648+0000 7f85aaffd700 1 --2- 172.21.15.26:0/571936255 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85ac0f6ff0 0x7f85ac1073f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:22:54.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.648+0000 7f85ab7fe700 1 -- 172.21.15.26:0/571936255 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85ac0f6ff0 msgr2=0x7f85ac1073f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:22:54.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.648+0000 7f85ab7fe700 1 --2- 172.21.15.26:0/571936255 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85ac0f6ff0 0x7f85ac1073f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:54.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.648+0000 7f85ab7fe700 1 -- 172.21.15.26:0/571936255 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f859c005040 con 0x7f85ac0f66e0 2021-11-03T17:22:54.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.649+0000 7f85ab7fe700 1 --2- 172.21.15.26:0/571936255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85ac0f66e0 0x7f85ac106f00 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f859c009990 tx=0x7f859c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:22:54.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.649+0000 7f8593fff700 1 -- 172.21.15.26:0/571936255 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f859c018070 con 0x7f85ac0f66e0 2021-11-03T17:22:54.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.649+0000 7f8593fff700 1 -- 172.21.15.26:0/571936255 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f859c007ba0 con 0x7f85ac0f66e0 2021-11-03T17:22:54.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.649+0000 7f85b208e700 1 -- 172.21.15.26:0/571936255 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85ac108420 con 0x7f85ac0f66e0 2021-11-03T17:22:54.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.649+0000 7f8593fff700 1 -- 172.21.15.26:0/571936255 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f859c01c3c0 con 0x7f85ac0f66e0 2021-11-03T17:22:54.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.649+0000 7f85b208e700 1 -- 172.21.15.26:0/571936255 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85ac108980 con 0x7f85ac0f66e0 2021-11-03T17:22:54.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.650+0000 7f85b208e700 1 -- 172.21.15.26:0/571936255 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85ac045ad0 con 0x7f85ac0f66e0 2021-11-03T17:22:54.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.650+0000 7f8593fff700 1 -- 172.21.15.26:0/571936255 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f859c01d420 con 0x7f85ac0f66e0 2021-11-03T17:22:54.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.651+0000 7f8593fff700 1 --2- 172.21.15.26:0/571936255 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85940640b0 0x7f8594066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:22:54.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.651+0000 7f8593fff700 1 -- 172.21.15.26:0/571936255 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f859c082410 con 0x7f85ac0f66e0 2021-11-03T17:22:54.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.651+0000 7f85aaffd700 1 --2- 172.21.15.26:0/571936255 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85940640b0 0x7f8594066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:22:54.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.651+0000 7f85aaffd700 1 --2- 172.21.15.26:0/571936255 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85940640b0 0x7f8594066570 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f85a0004ce0 tx=0x7f85a000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:22:54.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.655+0000 7f8593fff700 1 -- 172.21.15.26:0/571936255 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f859c054710 con 0x7f85ac0f66e0 2021-11-03T17:22:54.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.836+0000 7f85b208e700 1 -- 172.21.15.26:0/571936255 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f85ac0fefb0 con 0x7f85940640b0 2021-11-03T17:22:54.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.837+0000 7f8593fff700 1 -- 172.21.15.26:0/571936255 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f85ac0fefb0 con 0x7f85940640b0 2021-11-03T17:22:54.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.839+0000 7f85b208e700 1 -- 172.21.15.26:0/571936255 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85940640b0 msgr2=0x7f8594066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:22:54.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.839+0000 7f85b208e700 1 --2- 172.21.15.26:0/571936255 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85940640b0 0x7f8594066570 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f85a0004ce0 tx=0x7f85a000b040).stop 2021-11-03T17:22:54.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.839+0000 7f85b208e700 1 -- 172.21.15.26:0/571936255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85ac0f66e0 msgr2=0x7f85ac106f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:22:54.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.839+0000 7f85b208e700 1 --2- 172.21.15.26:0/571936255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85ac0f66e0 0x7f85ac106f00 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f859c009990 tx=0x7f859c009b30).stop 2021-11-03T17:22:54.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.839+0000 7f85b208e700 1 -- 172.21.15.26:0/571936255 shutdown_connections 2021-11-03T17:22:54.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.839+0000 7f85b208e700 1 --2- 172.21.15.26:0/571936255 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85940640b0 0x7f8594066570 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:54.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.839+0000 7f85b208e700 1 --2- 172.21.15.26:0/571936255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85ac0f66e0 0x7f85ac106f00 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:54.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.839+0000 7f85b208e700 1 --2- 172.21.15.26:0/571936255 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85ac0f6ff0 0x7f85ac1073f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:54.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.839+0000 7f85b208e700 1 -- 172.21.15.26:0/571936255 >> 172.21.15.26:0/571936255 conn(0x7f85ac0f1f00 msgr2=0x7f85ac0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:22:54.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.839+0000 7f85b208e700 1 -- 172.21.15.26:0/571936255 shutdown_connections 2021-11-03T17:22:54.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.839+0000 7f85b208e700 1 -- 172.21.15.26:0/571936255 wait complete. 2021-11-03T17:22:54.843 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:22:54.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.939+0000 7f555b59e700 1 -- 172.21.15.26:0/188677674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f555c0f6530 msgr2=0x7f555c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:22:54.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.939+0000 7f555b59e700 1 --2- 172.21.15.26:0/188677674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f555c0f6530 0x7f555c0f6950 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f554c004660 tx=0x7f554c009b30).stop 2021-11-03T17:22:54.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.939+0000 7f555b59e700 1 -- 172.21.15.26:0/188677674 shutdown_connections 2021-11-03T17:22:54.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.939+0000 7f555b59e700 1 --2- 172.21.15.26:0/188677674 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f555c0f77d0 0x7f555c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:54.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.939+0000 7f555b59e700 1 --2- 172.21.15.26:0/188677674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f555c0f6530 0x7f555c0f6950 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:54.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.939+0000 7f555b59e700 1 -- 172.21.15.26:0/188677674 >> 172.21.15.26:0/188677674 conn(0x7f555c0f1cd0 msgr2=0x7f555c0f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:22:54.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.939+0000 7f555b59e700 1 -- 172.21.15.26:0/188677674 shutdown_connections 2021-11-03T17:22:54.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.939+0000 7f555b59e700 1 -- 172.21.15.26:0/188677674 wait complete. 2021-11-03T17:22:54.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.940+0000 7f555b59e700 1 Processor -- start 2021-11-03T17:22:54.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.940+0000 7f555b59e700 1 -- start start 2021-11-03T17:22:54.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.940+0000 7f555b59e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f555c0f6530 0x7f555c106db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:22:54.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.940+0000 7f555b59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f555c0f77d0 0x7f555c1072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:22:54.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.940+0000 7f555b59e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555c1078a0 con 0x7f555c0f77d0 2021-11-03T17:22:54.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.940+0000 7f555b59e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555c1080e0 con 0x7f555c0f6530 2021-11-03T17:22:54.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.940+0000 7f5559d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f555c0f77d0 0x7f555c1072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:22:54.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.940+0000 7f5559d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f555c0f77d0 0x7f555c1072a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54074/0 (socket says 172.21.15.26:54074) 2021-11-03T17:22:54.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.940+0000 7f5559d9b700 1 -- 172.21.15.26:0/1784366199 learned_addr learned my addr 172.21.15.26:0/1784366199 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:22:54.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.940+0000 7f555a59c700 1 --2- 172.21.15.26:0/1784366199 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f555c0f6530 0x7f555c106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:22:54.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.940+0000 7f5559d9b700 1 -- 172.21.15.26:0/1784366199 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f555c0f6530 msgr2=0x7f555c106db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:22:54.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.940+0000 7f5559d9b700 1 --2- 172.21.15.26:0/1784366199 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f555c0f6530 0x7f555c106db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:54.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.941+0000 7f5559d9b700 1 -- 172.21.15.26:0/1784366199 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554c005040 con 0x7f555c0f77d0 2021-11-03T17:22:54.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.941+0000 7f5559d9b700 1 --2- 172.21.15.26:0/1784366199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f555c0f77d0 0x7f555c1072a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f55440026d0 tx=0x7f5544009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:22:54.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.941+0000 7f5552ffd700 1 -- 172.21.15.26:0/1784366199 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55440079c0 con 0x7f555c0f77d0 2021-11-03T17:22:54.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.941+0000 7f555b59e700 1 -- 172.21.15.26:0/1784366199 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f555c1083c0 con 0x7f555c0f77d0 2021-11-03T17:22:54.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.941+0000 7f5552ffd700 1 -- 172.21.15.26:0/1784366199 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f554400f040 con 0x7f555c0f77d0 2021-11-03T17:22:54.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.941+0000 7f5552ffd700 1 -- 172.21.15.26:0/1784366199 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55440148b0 con 0x7f555c0f77d0 2021-11-03T17:22:54.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.941+0000 7f555b59e700 1 -- 172.21.15.26:0/1784366199 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f555c108900 con 0x7f555c0f77d0 2021-11-03T17:22:54.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.942+0000 7f555b59e700 1 -- 172.21.15.26:0/1784366199 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f555c059100 con 0x7f555c0f77d0 2021-11-03T17:22:54.943 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.942+0000 7f5552ffd700 1 -- 172.21.15.26:0/1784366199 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f5544007b20 con 0x7f555c0f77d0 2021-11-03T17:22:54.943 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.943+0000 7f5552ffd700 1 --2- 172.21.15.26:0/1784366199 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5548064100 0x7f55480665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:22:54.943 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.943+0000 7f5552ffd700 1 -- 172.21.15.26:0/1784366199 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f5544080730 con 0x7f555c0f77d0 2021-11-03T17:22:54.943 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.943+0000 7f555a59c700 1 --2- 172.21.15.26:0/1784366199 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5548064100 0x7f55480665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:22:54.943 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.943+0000 7f555a59c700 1 --2- 172.21.15.26:0/1784366199 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5548064100 0x7f55480665c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f554c013690 tx=0x7f554c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:22:54.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:54.947+0000 7f5552ffd700 1 -- 172.21.15.26:0/1784366199 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f5544052a90 con 0x7f555c0f77d0 2021-11-03T17:22:55.113 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.119+0000 7f555b59e700 1 -- 172.21.15.26:0/1784366199 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f555c0fee80 con 0x7f5548064100 2021-11-03T17:22:55.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.134+0000 7f5552ffd700 1 -- 172.21.15.26:0/1784366199 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f555c0fee80 con 0x7f5548064100 2021-11-03T17:22:55.128 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:22:55.129 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (34m) 4m ago 35m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:22:55.129 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (26m) 4m ago 35m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:22:55.129 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (26m) 3m ago 34m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:22:55.130 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (33m) 4m ago 35m 39.6M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:22:55.130 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (27m) 4m ago 30m 19.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:22:55.130 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (27m) 4m ago 30m 20.6M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:22:55.130 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (30m) 3m ago 30m 22.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:22:55.131 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (30m) 3m ago 30m 22.2M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:22:55.131 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (27m) 4m ago 36m 505M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:22:55.132 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (27m) 3m ago 34m 419M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:22:55.132 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (27m) 4m ago 36m 147M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:22:55.132 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (26m) 3m ago 34m 75.7M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:22:55.133 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (35m) 4m ago 35m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:22:55.133 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (34m) 3m ago 34m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:22:55.133 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (25m) 4m ago 33m 211M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:22:55.133 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (25m) 4m ago 33m 226M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:22:55.134 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (24m) 4m ago 33m 189M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:22:55.134 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (24m) 3m ago 32m 236M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:22:55.134 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (24m) 3m ago 32m 208M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:22:55.134 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (23m) 3m ago 32m 194M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:22:55.135 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (33m) 4m ago 34m 52.1M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:22:55.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.136+0000 7f555b59e700 1 -- 172.21.15.26:0/1784366199 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5548064100 msgr2=0x7f55480665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:22:55.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.136+0000 7f555b59e700 1 --2- 172.21.15.26:0/1784366199 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5548064100 0x7f55480665c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f554c013690 tx=0x7f554c009b30).stop 2021-11-03T17:22:55.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.136+0000 7f555b59e700 1 -- 172.21.15.26:0/1784366199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f555c0f77d0 msgr2=0x7f555c1072a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:22:55.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.136+0000 7f555b59e700 1 --2- 172.21.15.26:0/1784366199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f555c0f77d0 0x7f555c1072a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f55440026d0 tx=0x7f5544009de0).stop 2021-11-03T17:22:55.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.136+0000 7f555b59e700 1 -- 172.21.15.26:0/1784366199 shutdown_connections 2021-11-03T17:22:55.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.136+0000 7f555b59e700 1 --2- 172.21.15.26:0/1784366199 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5548064100 0x7f55480665c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:55.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.136+0000 7f555b59e700 1 --2- 172.21.15.26:0/1784366199 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f555c0f6530 0x7f555c106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:55.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.136+0000 7f555b59e700 1 --2- 172.21.15.26:0/1784366199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f555c0f77d0 0x7f555c1072a0 secure :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0x7f55440026d0 tx=0x7f5544009de0).stop 2021-11-03T17:22:55.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.136+0000 7f555b59e700 1 -- 172.21.15.26:0/1784366199 >> 172.21.15.26:0/1784366199 conn(0x7f555c0f1cd0 msgr2=0x7f555c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:22:55.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.136+0000 7f555b59e700 1 -- 172.21.15.26:0/1784366199 shutdown_connections 2021-11-03T17:22:55.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.136+0000 7f555b59e700 1 -- 172.21.15.26:0/1784366199 wait complete. 2021-11-03T17:22:55.229 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.235+0000 7fd3117ab700 1 -- 172.21.15.26:0/2464422260 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd30c0f7980 msgr2=0x7fd30c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:22:55.229 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.235+0000 7fd3117ab700 1 --2- 172.21.15.26:0/2464422260 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd30c0f7980 0x7fd30c0f7de0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7fd2f4004660 tx=0x7fd2f4009b30).stop 2021-11-03T17:22:55.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.235+0000 7fd3117ab700 1 -- 172.21.15.26:0/2464422260 shutdown_connections 2021-11-03T17:22:55.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.235+0000 7fd3117ab700 1 --2- 172.21.15.26:0/2464422260 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd30c0f7980 0x7fd30c0f7de0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:55.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.235+0000 7fd3117ab700 1 --2- 172.21.15.26:0/2464422260 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd30c0f66e0 0x7fd30c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:55.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.235+0000 7fd3117ab700 1 -- 172.21.15.26:0/2464422260 >> 172.21.15.26:0/2464422260 conn(0x7fd30c0f1e40 msgr2=0x7fd30c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:22:55.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.235+0000 7fd3117ab700 1 -- 172.21.15.26:0/2464422260 shutdown_connections 2021-11-03T17:22:55.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.235+0000 7fd3117ab700 1 -- 172.21.15.26:0/2464422260 wait complete. 2021-11-03T17:22:55.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.235+0000 7fd3117ab700 1 Processor -- start 2021-11-03T17:22:55.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.236+0000 7fd3117ab700 1 -- start start 2021-11-03T17:22:55.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.236+0000 7fd3117ab700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd30c0f66e0 0x7fd30c106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:22:55.235 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.236+0000 7fd3117ab700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd30c0f7980 0x7fd30c107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:22:55.235 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.236+0000 7fd3117ab700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30c107a00 con 0x7fd30c0f66e0 2021-11-03T17:22:55.235 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.236+0000 7fd3117ab700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30c107b40 con 0x7fd30c0f7980 2021-11-03T17:22:55.235 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.236+0000 7fd30affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd30c0f66e0 0x7fd30c106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:22:55.236 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.236+0000 7fd30affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd30c0f66e0 0x7fd30c106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54082/0 (socket says 172.21.15.26:54082) 2021-11-03T17:22:55.236 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.236+0000 7fd30affd700 1 -- 172.21.15.26:0/177863693 learned_addr learned my addr 172.21.15.26:0/177863693 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:22:55.236 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.236+0000 7fd30a7fc700 1 --2- 172.21.15.26:0/177863693 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd30c0f7980 0x7fd30c107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:22:55.236 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.236+0000 7fd30affd700 1 -- 172.21.15.26:0/177863693 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd30c0f7980 msgr2=0x7fd30c107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:22:55.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.236+0000 7fd30affd700 1 --2- 172.21.15.26:0/177863693 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd30c0f7980 0x7fd30c107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:55.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.236+0000 7fd30affd700 1 -- 172.21.15.26:0/177863693 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f4005040 con 0x7fd30c0f66e0 2021-11-03T17:22:55.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.236+0000 7fd30affd700 1 --2- 172.21.15.26:0/177863693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd30c0f66e0 0x7fd30c106f60 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7fd30400d7f0 tx=0x7fd304004e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:22:55.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.236+0000 7fd3037fe700 1 -- 172.21.15.26:0/177863693 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd30400f490 con 0x7fd30c0f66e0 2021-11-03T17:22:55.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.236+0000 7fd3037fe700 1 -- 172.21.15.26:0/177863693 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd30400f040 con 0x7fd30c0f66e0 2021-11-03T17:22:55.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.237+0000 7fd3117ab700 1 -- 172.21.15.26:0/177863693 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd30c1084e0 con 0x7fd30c0f66e0 2021-11-03T17:22:55.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.237+0000 7fd3037fe700 1 -- 172.21.15.26:0/177863693 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3040139b0 con 0x7fd30c0f66e0 2021-11-03T17:22:55.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.237+0000 7fd3117ab700 1 -- 172.21.15.26:0/177863693 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd30c108aa0 con 0x7fd30c0f66e0 2021-11-03T17:22:55.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.237+0000 7fd3117ab700 1 -- 172.21.15.26:0/177863693 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd30c045ad0 con 0x7fd30c0f66e0 2021-11-03T17:22:55.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.238+0000 7fd3037fe700 1 -- 172.21.15.26:0/177863693 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fd30401a030 con 0x7fd30c0f66e0 2021-11-03T17:22:55.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.238+0000 7fd3037fe700 1 --2- 172.21.15.26:0/177863693 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd2f8064180 0x7fd2f8066640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:22:55.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.238+0000 7fd3037fe700 1 -- 172.21.15.26:0/177863693 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fd304080660 con 0x7fd30c0f66e0 2021-11-03T17:22:55.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.238+0000 7fd30a7fc700 1 --2- 172.21.15.26:0/177863693 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd2f8064180 0x7fd2f8066640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:22:55.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.239+0000 7fd30a7fc700 1 --2- 172.21.15.26:0/177863693 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd2f8064180 0x7fd2f8066640 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7fd2f4004630 tx=0x7fd2f4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:22:55.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.242+0000 7fd3037fe700 1 -- 172.21.15.26:0/177863693 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fd304052950 con 0x7fd30c0f66e0 2021-11-03T17:22:55.464 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.470+0000 7fd3117ab700 1 -- 172.21.15.26:0/177863693 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd30c0fef70 con 0x7fd30c0f66e0 2021-11-03T17:22:55.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.470+0000 7fd3037fe700 1 -- 172.21.15.26:0/177863693 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fd304018070 con 0x7fd30c0f66e0 2021-11-03T17:22:55.465 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:22:55.465 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:22:55.465 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:22:55.466 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:22:55.466 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:22:55.466 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:22:55.466 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:22:55.467 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:22:55.467 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:22:55.467 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:22:55.467 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:22:55.468 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:22:55.468 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:22:55.468 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:22:55.469 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:22:55.469 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:22:55.469 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:22:55.469 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:22:55.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.472+0000 7fd3117ab700 1 -- 172.21.15.26:0/177863693 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd2f8064180 msgr2=0x7fd2f8066640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:22:55.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.472+0000 7fd3117ab700 1 --2- 172.21.15.26:0/177863693 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd2f8064180 0x7fd2f8066640 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7fd2f4004630 tx=0x7fd2f4009b30).stop 2021-11-03T17:22:55.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.472+0000 7fd3117ab700 1 -- 172.21.15.26:0/177863693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd30c0f66e0 msgr2=0x7fd30c106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:22:55.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.472+0000 7fd3117ab700 1 --2- 172.21.15.26:0/177863693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd30c0f66e0 0x7fd30c106f60 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7fd30400d7f0 tx=0x7fd304004e80).stop 2021-11-03T17:22:55.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.472+0000 7fd3117ab700 1 -- 172.21.15.26:0/177863693 shutdown_connections 2021-11-03T17:22:55.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.472+0000 7fd3117ab700 1 --2- 172.21.15.26:0/177863693 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd2f8064180 0x7fd2f8066640 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:55.472 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.472+0000 7fd3117ab700 1 --2- 172.21.15.26:0/177863693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd30c0f66e0 0x7fd30c106f60 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:55.472 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.472+0000 7fd3117ab700 1 --2- 172.21.15.26:0/177863693 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd30c0f7980 0x7fd30c107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:55.472 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.472+0000 7fd3117ab700 1 -- 172.21.15.26:0/177863693 >> 172.21.15.26:0/177863693 conn(0x7fd30c0f1e40 msgr2=0x7fd30c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:22:55.472 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.472+0000 7fd3117ab700 1 -- 172.21.15.26:0/177863693 shutdown_connections 2021-11-03T17:22:55.473 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.472+0000 7fd3117ab700 1 -- 172.21.15.26:0/177863693 wait complete. 2021-11-03T17:22:55.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.572+0000 7f14a7409700 1 -- 172.21.15.26:0/1272964008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14a00f66e0 msgr2=0x7f14a00f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:22:55.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.572+0000 7f14a7409700 1 --2- 172.21.15.26:0/1272964008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14a00f66e0 0x7f14a00f6b40 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f1490004660 tx=0x7f1490009b30).stop 2021-11-03T17:22:55.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.572+0000 7f14a7409700 1 -- 172.21.15.26:0/1272964008 shutdown_connections 2021-11-03T17:22:55.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.572+0000 7f14a7409700 1 --2- 172.21.15.26:0/1272964008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14a00f66e0 0x7f14a00f6b40 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:55.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.572+0000 7f14a7409700 1 --2- 172.21.15.26:0/1272964008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14a00f5440 0x7f14a00f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:55.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.572+0000 7f14a7409700 1 -- 172.21.15.26:0/1272964008 >> 172.21.15.26:0/1272964008 conn(0x7f14a00f0ba0 msgr2=0x7f14a00f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:22:55.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.573+0000 7f14a7409700 1 -- 172.21.15.26:0/1272964008 shutdown_connections 2021-11-03T17:22:55.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.573+0000 7f14a7409700 1 -- 172.21.15.26:0/1272964008 wait complete. 2021-11-03T17:22:55.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.573+0000 7f14a7409700 1 Processor -- start 2021-11-03T17:22:55.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.573+0000 7f14a7409700 1 -- start start 2021-11-03T17:22:55.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.573+0000 7f14a7409700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14a00f5440 0x7f14a00f95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:22:55.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.573+0000 7f14a7409700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14a00f66e0 0x7f14a00f7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:22:55.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.573+0000 7f14a7409700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a00f7f80 con 0x7f14a00f66e0 2021-11-03T17:22:55.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.573+0000 7f14a7409700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a00f80c0 con 0x7f14a00f5440 2021-11-03T17:22:55.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.573+0000 7f14a5c06700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14a00f66e0 0x7f14a00f7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:22:55.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.573+0000 7f14a5c06700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14a00f66e0 0x7f14a00f7a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54092/0 (socket says 172.21.15.26:54092) 2021-11-03T17:22:55.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.573+0000 7f14a5c06700 1 -- 172.21.15.26:0/1828512828 learned_addr learned my addr 172.21.15.26:0/1828512828 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:22:55.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.573+0000 7f14a6407700 1 --2- 172.21.15.26:0/1828512828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14a00f5440 0x7f14a00f95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:22:55.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.574+0000 7f14a5c06700 1 -- 172.21.15.26:0/1828512828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14a00f5440 msgr2=0x7f14a00f95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:22:55.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.574+0000 7f14a5c06700 1 --2- 172.21.15.26:0/1828512828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14a00f5440 0x7f14a00f95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:55.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.574+0000 7f14a5c06700 1 -- 172.21.15.26:0/1828512828 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1490005040 con 0x7f14a00f66e0 2021-11-03T17:22:55.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.574+0000 7f14a5c06700 1 --2- 172.21.15.26:0/1828512828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14a00f66e0 0x7f14a00f7a20 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f1490009990 tx=0x7f1490009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:22:55.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.574+0000 7f1496ffd700 1 -- 172.21.15.26:0/1828512828 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1490018070 con 0x7f14a00f66e0 2021-11-03T17:22:55.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.574+0000 7f14a7409700 1 -- 172.21.15.26:0/1828512828 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14a00f8340 con 0x7f14a00f66e0 2021-11-03T17:22:55.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.574+0000 7f1496ffd700 1 -- 172.21.15.26:0/1828512828 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1490007ba0 con 0x7f14a00f66e0 2021-11-03T17:22:55.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.574+0000 7f1496ffd700 1 -- 172.21.15.26:0/1828512828 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f149001c3c0 con 0x7f14a00f66e0 2021-11-03T17:22:55.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.574+0000 7f14a7409700 1 -- 172.21.15.26:0/1828512828 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14a00f88a0 con 0x7f14a00f66e0 2021-11-03T17:22:55.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.575+0000 7f14a7409700 1 -- 172.21.15.26:0/1828512828 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14a0045ad0 con 0x7f14a00f66e0 2021-11-03T17:22:55.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.575+0000 7f1496ffd700 1 -- 172.21.15.26:0/1828512828 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f149001d420 con 0x7f14a00f66e0 2021-11-03T17:22:55.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.576+0000 7f1496ffd700 1 --2- 172.21.15.26:0/1828512828 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f148c064100 0x7f148c0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:22:55.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.576+0000 7f1496ffd700 1 -- 172.21.15.26:0/1828512828 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f1490082410 con 0x7f14a00f66e0 2021-11-03T17:22:55.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.576+0000 7f14a6407700 1 --2- 172.21.15.26:0/1828512828 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f148c064100 0x7f148c0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:22:55.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.576+0000 7f14a6407700 1 --2- 172.21.15.26:0/1828512828 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f148c064100 0x7f148c0665c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f14a00f9330 tx=0x7f149c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:22:55.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.580+0000 7f1496ffd700 1 -- 172.21.15.26:0/1828512828 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f1490054710 con 0x7f14a00f66e0 2021-11-03T17:22:55.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.782+0000 7f14a7409700 1 -- 172.21.15.26:0/1828512828 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f14a00fdc00 con 0x7f14a00f66e0 2021-11-03T17:22:55.777 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.783+0000 7f1496ffd700 1 -- 172.21.15.26:0/1828512828 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f1490054300 con 0x7f14a00f66e0 2021-11-03T17:22:55.777 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:22:55.778 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:22:55.778 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:22:55.778 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:22:55.778 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:22:55.779 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:22:55.779 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:22:55.779 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:22:55.779 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:22:55.780 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:22:55.780 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:22:55.780 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:22:55.780 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:22:55.781 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:22:55.781 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:22:55.781 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:22:55.781 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:22:55.781 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:22:55.782 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:22:55.782 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:22:55.782 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:22:55.782 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:22:55.783 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:22:55.783 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:22:55.783 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:22:55.783 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:22:55.784 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:22:55.784 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:22:55.784 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:22:55.784 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:22:55.785 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:22:55.785 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:22:55.785 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:22:55.785 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:22:55.785 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:22:55.786 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:22:55.786 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:22:55.786 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:22:55.786 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:22:55.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.784+0000 7f14a7409700 1 -- 172.21.15.26:0/1828512828 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f148c064100 msgr2=0x7f148c0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:22:55.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.784+0000 7f14a7409700 1 --2- 172.21.15.26:0/1828512828 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f148c064100 0x7f148c0665c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f14a00f9330 tx=0x7f149c00b040).stop 2021-11-03T17:22:55.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.784+0000 7f14a7409700 1 -- 172.21.15.26:0/1828512828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14a00f66e0 msgr2=0x7f14a00f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:22:55.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.784+0000 7f14a7409700 1 --2- 172.21.15.26:0/1828512828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14a00f66e0 0x7f14a00f7a20 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f1490009990 tx=0x7f1490009b30).stop 2021-11-03T17:22:55.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.784+0000 7f14a7409700 1 -- 172.21.15.26:0/1828512828 shutdown_connections 2021-11-03T17:22:55.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.784+0000 7f14a7409700 1 --2- 172.21.15.26:0/1828512828 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f148c064100 0x7f148c0665c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:55.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.784+0000 7f14a7409700 1 --2- 172.21.15.26:0/1828512828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14a00f5440 0x7f14a00f95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:55.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.784+0000 7f14a7409700 1 --2- 172.21.15.26:0/1828512828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14a00f66e0 0x7f14a00f7a20 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:22:55.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.784+0000 7f14a7409700 1 -- 172.21.15.26:0/1828512828 >> 172.21.15.26:0/1828512828 conn(0x7f14a00f0ba0 msgr2=0x7f14a005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:22:55.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.784+0000 7f14a7409700 1 -- 172.21.15.26:0/1828512828 shutdown_connections 2021-11-03T17:22:55.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:22:55.785+0000 7f14a7409700 1 -- 172.21.15.26:0/1828512828 wait complete. 2021-11-03T17:22:55.790 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:22:56.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:56 smithi026 ceph-mon[96795]: pgmap v848: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:56.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:56 smithi026 ceph-mon[96795]: from='client.35020 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:22:56.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:56 smithi026 ceph-mon[96795]: from='client.35024 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:22:56.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:56 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/177863693' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:22:56.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:56 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1828512828' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:22:56.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:56 smithi194 ceph-mon[65619]: pgmap v848: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:56.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:56 smithi194 ceph-mon[65619]: from='client.35020 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:22:56.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:56 smithi194 ceph-mon[65619]: from='client.35024 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:22:56.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:56 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/177863693' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:22:56.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:56 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1828512828' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:22:57.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:57 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:22:57.227 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:57 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:22:58.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:58 smithi026 ceph-mon[96795]: pgmap v849: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:58.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:58 smithi026 ceph-mon[96795]: poll took 60092.738 ms: 1 events 2021-11-03T17:22:58.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:58 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:22:58.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:58 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:22:58.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:58 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:22:58.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:58 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:22:58.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:58 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:22:58.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:58 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:22:58.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:58 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:22:58.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:58 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:22:58.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:22:58 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:22:58.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:58 smithi194 ceph-mon[65619]: pgmap v849: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:22:58.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:58 smithi194 ceph-mon[65619]: poll took 60092.738 ms: 1 events 2021-11-03T17:22:58.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:58 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:22:58.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:58 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:22:58.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:58 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:22:58.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:58 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:22:58.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:58 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:22:58.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:58 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:22:58.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:58 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:22:58.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:58 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:22:58.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:22:58 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:23:00.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:00 smithi026 ceph-mon[96795]: pgmap v850: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:00.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:00 smithi194 ceph-mon[65619]: pgmap v850: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:02.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:02 smithi026 ceph-mon[96795]: pgmap v851: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:02.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:02 smithi194 ceph-mon[65619]: pgmap v851: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:04.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:04 smithi026 ceph-mon[96795]: pgmap v852: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:04.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:04 smithi194 ceph-mon[65619]: pgmap v852: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:06.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:06 smithi026 ceph-mon[96795]: pgmap v853: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:06.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:06 smithi194 ceph-mon[65619]: pgmap v853: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:08.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:08 smithi026 ceph-mon[96795]: pgmap v854: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:08.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:08 smithi194 ceph-mon[65619]: pgmap v854: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:10.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:10 smithi026 ceph-mon[96795]: pgmap v855: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:10.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:10 smithi194 ceph-mon[65619]: pgmap v855: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:12.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:12 smithi026 ceph-mon[96795]: pgmap v856: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:12.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:12 smithi194 ceph-mon[65619]: pgmap v856: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:13.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:13 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:23:13.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:13 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:23:13.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:13 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:23:13.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:13 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:23:14.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:14 smithi026 ceph-mon[96795]: pgmap v857: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:14.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:14 smithi194 ceph-mon[65619]: pgmap v857: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:16.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:16 smithi026 ceph-mon[96795]: pgmap v858: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:16.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:16 smithi194 ceph-mon[65619]: pgmap v858: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:18.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:18 smithi026 ceph-mon[96795]: pgmap v859: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:18.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:18 smithi194 ceph-mon[65619]: pgmap v859: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:20.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:20 smithi026 ceph-mon[96795]: pgmap v860: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:20.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:20 smithi194 ceph-mon[65619]: pgmap v860: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:22.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:22 smithi026 ceph-mon[96795]: pgmap v861: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:22.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:22 smithi194 ceph-mon[65619]: pgmap v861: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:24.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:24 smithi026 ceph-mon[96795]: pgmap v862: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:24.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:24 smithi194 ceph-mon[65619]: pgmap v862: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:25.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:25.900+0000 7f60dd675700 1 -- 172.21.15.26:0/892076485 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60d80f6530 msgr2=0x7f60d80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:23:25.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:25.900+0000 7f60dd675700 1 --2- 172.21.15.26:0/892076485 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60d80f6530 0x7f60d80f6950 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f60c8004660 tx=0x7f60c8009b30).stop 2021-11-03T17:23:25.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:25.900+0000 7f60dd675700 1 -- 172.21.15.26:0/892076485 shutdown_connections 2021-11-03T17:23:25.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:25.900+0000 7f60dd675700 1 --2- 172.21.15.26:0/892076485 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60d80f77d0 0x7f60d80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:25.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:25.900+0000 7f60dd675700 1 --2- 172.21.15.26:0/892076485 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60d80f6530 0x7f60d80f6950 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:25.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:25.900+0000 7f60dd675700 1 -- 172.21.15.26:0/892076485 >> 172.21.15.26:0/892076485 conn(0x7f60d80f1c90 msgr2=0x7f60d80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:23:25.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:25.900+0000 7f60dd675700 1 -- 172.21.15.26:0/892076485 shutdown_connections 2021-11-03T17:23:25.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:25.900+0000 7f60dd675700 1 -- 172.21.15.26:0/892076485 wait complete. 2021-11-03T17:23:25.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:25.900+0000 7f60dd675700 1 Processor -- start 2021-11-03T17:23:25.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:25.900+0000 7f60dd675700 1 -- start start 2021-11-03T17:23:25.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:25.901+0000 7f60dd675700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60d80f6530 0x7f60d8106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:23:25.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:25.901+0000 7f60dd675700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60d80f77d0 0x7f60d81072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:23:25.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:25.901+0000 7f60dd675700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d81078f0 con 0x7f60d80f6530 2021-11-03T17:23:25.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:25.901+0000 7f60dd675700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d8108100 con 0x7f60d80f77d0 2021-11-03T17:23:25.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:25.901+0000 7f60d7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60d80f6530 0x7f60d8106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:23:25.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:25.901+0000 7f60d7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60d80f6530 0x7f60d8106e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54108/0 (socket says 172.21.15.26:54108) 2021-11-03T17:23:25.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:25.901+0000 7f60d7fff700 1 -- 172.21.15.26:0/354600121 learned_addr learned my addr 172.21.15.26:0/354600121 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:23:25.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:25.901+0000 7f60d77fe700 1 --2- 172.21.15.26:0/354600121 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60d80f77d0 0x7f60d81072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:23:25.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:25.901+0000 7f60d7fff700 1 -- 172.21.15.26:0/354600121 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60d80f77d0 msgr2=0x7f60d81072f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:23:25.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:25.901+0000 7f60d7fff700 1 --2- 172.21.15.26:0/354600121 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60d80f77d0 0x7f60d81072f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:25.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:25.901+0000 7f60d7fff700 1 -- 172.21.15.26:0/354600121 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c8005040 con 0x7f60d80f6530 2021-11-03T17:23:25.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:25.901+0000 7f60d77fe700 1 --2- 172.21.15.26:0/354600121 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60d80f77d0 0x7f60d81072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:23:25.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:25.901+0000 7f60d7fff700 1 --2- 172.21.15.26:0/354600121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60d80f6530 0x7f60d8106e00 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f60c8004f60 tx=0x7f60c8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:23:25.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:25.901+0000 7f60d4ff9700 1 -- 172.21.15.26:0/354600121 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60c8018070 con 0x7f60d80f6530 2021-11-03T17:23:25.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:25.902+0000 7f60dd675700 1 -- 172.21.15.26:0/354600121 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60d8108320 con 0x7f60d80f6530 2021-11-03T17:23:25.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:25.902+0000 7f60d4ff9700 1 -- 172.21.15.26:0/354600121 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f60c8007ba0 con 0x7f60d80f6530 2021-11-03T17:23:25.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:25.902+0000 7f60d4ff9700 1 -- 172.21.15.26:0/354600121 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60c801c620 con 0x7f60d80f6530 2021-11-03T17:23:25.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:25.902+0000 7f60dd675700 1 -- 172.21.15.26:0/354600121 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60d8108880 con 0x7f60d80f6530 2021-11-03T17:23:25.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:25.902+0000 7f60dd675700 1 -- 172.21.15.26:0/354600121 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60d8059100 con 0x7f60d80f6530 2021-11-03T17:23:25.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:25.903+0000 7f60d4ff9700 1 -- 172.21.15.26:0/354600121 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f60c801c8e0 con 0x7f60d80f6530 2021-11-03T17:23:25.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:25.903+0000 7f60d4ff9700 1 --2- 172.21.15.26:0/354600121 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f60c0064100 0x7f60c00665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:23:25.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:25.903+0000 7f60d4ff9700 1 -- 172.21.15.26:0/354600121 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f60c80826c0 con 0x7f60d80f6530 2021-11-03T17:23:25.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:25.904+0000 7f60d77fe700 1 --2- 172.21.15.26:0/354600121 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f60c0064100 0x7f60c00665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:23:25.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:25.904+0000 7f60d77fe700 1 --2- 172.21.15.26:0/354600121 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f60c0064100 0x7f60c00665c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f60cc004a70 tx=0x7f60cc009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:23:25.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:25.908+0000 7f60d4ff9700 1 -- 172.21.15.26:0/354600121 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f60c8054a20 con 0x7f60d80f6530 2021-11-03T17:23:26.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.088+0000 7f60dd675700 1 -- 172.21.15.26:0/354600121 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f60d80fed60 con 0x7f60c0064100 2021-11-03T17:23:26.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.090+0000 7f60d4ff9700 1 -- 172.21.15.26:0/354600121 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f60d80fed60 con 0x7f60c0064100 2021-11-03T17:23:26.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.091+0000 7f60dd675700 1 -- 172.21.15.26:0/354600121 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f60c0064100 msgr2=0x7f60c00665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:23:26.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.091+0000 7f60dd675700 1 --2- 172.21.15.26:0/354600121 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f60c0064100 0x7f60c00665c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f60cc004a70 tx=0x7f60cc009040).stop 2021-11-03T17:23:26.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.091+0000 7f60dd675700 1 -- 172.21.15.26:0/354600121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60d80f6530 msgr2=0x7f60d8106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:23:26.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.091+0000 7f60dd675700 1 --2- 172.21.15.26:0/354600121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60d80f6530 0x7f60d8106e00 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f60c8004f60 tx=0x7f60c8009b30).stop 2021-11-03T17:23:26.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.091+0000 7f60dd675700 1 -- 172.21.15.26:0/354600121 shutdown_connections 2021-11-03T17:23:26.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.091+0000 7f60dd675700 1 --2- 172.21.15.26:0/354600121 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f60c0064100 0x7f60c00665c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:26.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.091+0000 7f60dd675700 1 --2- 172.21.15.26:0/354600121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60d80f6530 0x7f60d8106e00 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:26.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.091+0000 7f60dd675700 1 --2- 172.21.15.26:0/354600121 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60d80f77d0 0x7f60d81072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:26.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.091+0000 7f60dd675700 1 -- 172.21.15.26:0/354600121 >> 172.21.15.26:0/354600121 conn(0x7f60d80f1c90 msgr2=0x7f60d80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:23:26.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.092+0000 7f60dd675700 1 -- 172.21.15.26:0/354600121 shutdown_connections 2021-11-03T17:23:26.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.092+0000 7f60dd675700 1 -- 172.21.15.26:0/354600121 wait complete. 2021-11-03T17:23:26.096 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:23:26.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.192+0000 7f01c300b700 1 -- 172.21.15.26:0/2460945323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01bc0fbb90 msgr2=0x7f01bc0fdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:23:26.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.192+0000 7f01c300b700 1 --2- 172.21.15.26:0/2460945323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01bc0fbb90 0x7f01bc0fdf80 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f01a8004660 tx=0x7f01a8009b30).stop 2021-11-03T17:23:26.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.192+0000 7f01c300b700 1 -- 172.21.15.26:0/2460945323 shutdown_connections 2021-11-03T17:23:26.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.192+0000 7f01c300b700 1 --2- 172.21.15.26:0/2460945323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01bc0fbb90 0x7f01bc0fdf80 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:26.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.192+0000 7f01c300b700 1 --2- 172.21.15.26:0/2460945323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01bc060430 0x7f01bc0fb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:26.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.192+0000 7f01c300b700 1 -- 172.21.15.26:0/2460945323 >> 172.21.15.26:0/2460945323 conn(0x7f01bc0f0d40 msgr2=0x7f01bc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:23:26.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.193+0000 7f01c300b700 1 -- 172.21.15.26:0/2460945323 shutdown_connections 2021-11-03T17:23:26.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.193+0000 7f01c300b700 1 -- 172.21.15.26:0/2460945323 wait complete. 2021-11-03T17:23:26.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.193+0000 7f01c300b700 1 Processor -- start 2021-11-03T17:23:26.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.193+0000 7f01c300b700 1 -- start start 2021-11-03T17:23:26.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.193+0000 7f01c300b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01bc060430 0x7f01bc1091b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:23:26.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.193+0000 7f01c300b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01bc0fbb90 0x7f01bc1096a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:23:26.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.193+0000 7f01c300b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc109c50 con 0x7f01bc0fbb90 2021-11-03T17:23:26.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.193+0000 7f01c300b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc109d90 con 0x7f01bc060430 2021-11-03T17:23:26.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.193+0000 7f01bbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01bc0fbb90 0x7f01bc1096a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:23:26.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.194+0000 7f01bbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01bc0fbb90 0x7f01bc1096a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54120/0 (socket says 172.21.15.26:54120) 2021-11-03T17:23:26.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.194+0000 7f01bbfff700 1 -- 172.21.15.26:0/383464280 learned_addr learned my addr 172.21.15.26:0/383464280 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:23:26.193 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.194+0000 7f01bbfff700 1 -- 172.21.15.26:0/383464280 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01bc060430 msgr2=0x7f01bc1091b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:23:26.193 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.194+0000 7f01bbfff700 1 --2- 172.21.15.26:0/383464280 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01bc060430 0x7f01bc1091b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:23:26.193 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.194+0000 7f01bbfff700 1 -- 172.21.15.26:0/383464280 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a8005040 con 0x7f01bc0fbb90 2021-11-03T17:23:26.194 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.194+0000 7f01bbfff700 1 --2- 172.21.15.26:0/383464280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01bc0fbb90 0x7f01bc1096a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f01a8013a70 tx=0x7f01a8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:23:26.194 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.194+0000 7f01b97fa700 1 -- 172.21.15.26:0/383464280 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01a8018070 con 0x7f01bc0fbb90 2021-11-03T17:23:26.194 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.194+0000 7f01c300b700 1 -- 172.21.15.26:0/383464280 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01bc10a6d0 con 0x7f01bc0fbb90 2021-11-03T17:23:26.194 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.194+0000 7f01b97fa700 1 -- 172.21.15.26:0/383464280 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f01a8007ba0 con 0x7f01bc0fbb90 2021-11-03T17:23:26.195 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.194+0000 7f01b97fa700 1 -- 172.21.15.26:0/383464280 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01a801c3c0 con 0x7f01bc0fbb90 2021-11-03T17:23:26.195 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.194+0000 7f01c300b700 1 -- 172.21.15.26:0/383464280 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01bc10ac30 con 0x7f01bc0fbb90 2021-11-03T17:23:26.195 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.195+0000 7f01c300b700 1 -- 172.21.15.26:0/383464280 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01bc045ad0 con 0x7f01bc0fbb90 2021-11-03T17:23:26.195 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.195+0000 7f01b97fa700 1 -- 172.21.15.26:0/383464280 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f01a801d420 con 0x7f01bc0fbb90 2021-11-03T17:23:26.195 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.196+0000 7f01b97fa700 1 --2- 172.21.15.26:0/383464280 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f01ac0640b0 0x7f01ac066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:23:26.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.196+0000 7f01b97fa700 1 -- 172.21.15.26:0/383464280 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f01a80825d0 con 0x7f01bc0fbb90 2021-11-03T17:23:26.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.196+0000 7f01c0da7700 1 --2- 172.21.15.26:0/383464280 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f01ac0640b0 0x7f01ac066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:23:26.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.196+0000 7f01c0da7700 1 --2- 172.21.15.26:0/383464280 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f01ac0640b0 0x7f01ac066570 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f01b0004a10 tx=0x7f01b00099e0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:23:26.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.200+0000 7f01b97fa700 1 -- 172.21.15.26:0/383464280 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f01a80549f0 con 0x7f01bc0fbb90 2021-11-03T17:23:26.367 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.373+0000 7f01c300b700 1 -- 172.21.15.26:0/383464280 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f01bc1011c0 con 0x7f01ac0640b0 2021-11-03T17:23:26.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.388+0000 7f01b97fa700 1 -- 172.21.15.26:0/383464280 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f01bc1011c0 con 0x7f01ac0640b0 2021-11-03T17:23:26.382 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:23:26.383 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (34m) 4m ago 35m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:23:26.383 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (26m) 4m ago 35m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:23:26.383 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (26m) 3m ago 35m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:23:26.383 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (34m) 4m ago 35m 39.6M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:23:26.384 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (27m) 4m ago 31m 19.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:23:26.384 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (27m) 4m ago 30m 20.6M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:23:26.384 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (31m) 3m ago 31m 22.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:23:26.384 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (31m) 3m ago 31m 22.2M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:23:26.384 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (28m) 4m ago 37m 505M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:23:26.385 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (28m) 3m ago 35m 419M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:23:26.385 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (27m) 4m ago 37m 147M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:23:26.385 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (27m) 3m ago 35m 75.7M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:23:26.385 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (35m) 4m ago 35m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:23:26.385 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (34m) 3m ago 34m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:23:26.386 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (26m) 4m ago 34m 211M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:23:26.386 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (25m) 4m ago 33m 226M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:23:26.386 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (25m) 4m ago 33m 189M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:23:26.386 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (24m) 3m ago 33m 236M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:23:26.387 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (24m) 3m ago 32m 208M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:23:26.387 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (24m) 3m ago 32m 194M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:23:26.387 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (34m) 4m ago 35m 52.1M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:23:26.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.390+0000 7f01c300b700 1 -- 172.21.15.26:0/383464280 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f01ac0640b0 msgr2=0x7f01ac066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:23:26.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.390+0000 7f01c300b700 1 --2- 172.21.15.26:0/383464280 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f01ac0640b0 0x7f01ac066570 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f01b0004a10 tx=0x7f01b00099e0).stop 2021-11-03T17:23:26.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.390+0000 7f01c300b700 1 -- 172.21.15.26:0/383464280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01bc0fbb90 msgr2=0x7f01bc1096a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:23:26.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.390+0000 7f01c300b700 1 --2- 172.21.15.26:0/383464280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01bc0fbb90 0x7f01bc1096a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f01a8013a70 tx=0x7f01a8009b30).stop 2021-11-03T17:23:26.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.390+0000 7f01c300b700 1 -- 172.21.15.26:0/383464280 shutdown_connections 2021-11-03T17:23:26.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.390+0000 7f01c300b700 1 --2- 172.21.15.26:0/383464280 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f01ac0640b0 0x7f01ac066570 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:26.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.390+0000 7f01c300b700 1 --2- 172.21.15.26:0/383464280 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01bc060430 0x7f01bc1091b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:23:26.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.390+0000 7f01c300b700 1 --2- 172.21.15.26:0/383464280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01bc0fbb90 0x7f01bc1096a0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:26.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.390+0000 7f01c300b700 1 -- 172.21.15.26:0/383464280 >> 172.21.15.26:0/383464280 conn(0x7f01bc0f0d40 msgr2=0x7f01bc0f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:23:26.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.390+0000 7f01c300b700 1 -- 172.21.15.26:0/383464280 shutdown_connections 2021-11-03T17:23:26.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.390+0000 7f01c300b700 1 -- 172.21.15.26:0/383464280 wait complete. 2021-11-03T17:23:26.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.490+0000 7f4d0fba3700 1 -- 172.21.15.26:0/1260009669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d080f6bb0 msgr2=0x7f4d080f6fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:23:26.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.490+0000 7f4d0fba3700 1 --2- 172.21.15.26:0/1260009669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d080f6bb0 0x7f4d080f6fd0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f4d000099e0 tx=0x7f4d00004d10).stop 2021-11-03T17:23:26.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.490+0000 7f4d0fba3700 1 -- 172.21.15.26:0/1260009669 shutdown_connections 2021-11-03T17:23:26.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.490+0000 7f4d0fba3700 1 --2- 172.21.15.26:0/1260009669 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d080f58b0 0x7f4d080f5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:26.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.490+0000 7f4d0fba3700 1 --2- 172.21.15.26:0/1260009669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d080f6bb0 0x7f4d080f6fd0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:26.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.490+0000 7f4d0fba3700 1 -- 172.21.15.26:0/1260009669 >> 172.21.15.26:0/1260009669 conn(0x7f4d080f04c0 msgr2=0x7f4d080f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:23:26.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.490+0000 7f4d0fba3700 1 -- 172.21.15.26:0/1260009669 shutdown_connections 2021-11-03T17:23:26.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.490+0000 7f4d0fba3700 1 -- 172.21.15.26:0/1260009669 wait complete. 2021-11-03T17:23:26.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.490+0000 7f4d0fba3700 1 Processor -- start 2021-11-03T17:23:26.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.490+0000 7f4d0fba3700 1 -- start start 2021-11-03T17:23:26.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.490+0000 7f4d0fba3700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d080f58b0 0x7f4d081070b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:23:26.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.490+0000 7f4d0fba3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d080f6bb0 0x7f4d081075a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:23:26.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.490+0000 7f4d0fba3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d08107b50 con 0x7f4d080f6bb0 2021-11-03T17:23:26.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.490+0000 7f4d0fba3700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d08107c90 con 0x7f4d080f58b0 2021-11-03T17:23:26.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.491+0000 7f4d0d13e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d080f6bb0 0x7f4d081075a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:23:26.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.491+0000 7f4d0d13e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d080f6bb0 0x7f4d081075a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54130/0 (socket says 172.21.15.26:54130) 2021-11-03T17:23:26.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.491+0000 7f4d0d13e700 1 -- 172.21.15.26:0/2342331244 learned_addr learned my addr 172.21.15.26:0/2342331244 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:23:26.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.491+0000 7f4d0d93f700 1 --2- 172.21.15.26:0/2342331244 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d080f58b0 0x7f4d081070b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:23:26.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.491+0000 7f4d0d13e700 1 -- 172.21.15.26:0/2342331244 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d080f58b0 msgr2=0x7f4d081070b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:23:26.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.491+0000 7f4d0d13e700 1 --2- 172.21.15.26:0/2342331244 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d080f58b0 0x7f4d081070b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:26.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.491+0000 7f4d0d13e700 1 -- 172.21.15.26:0/2342331244 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d00009640 con 0x7f4d080f6bb0 2021-11-03T17:23:26.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.491+0000 7f4d0d13e700 1 --2- 172.21.15.26:0/2342331244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d080f6bb0 0x7f4d081075a0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f4cfc00c530 tx=0x7f4cfc007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:23:26.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.491+0000 7f4d067fc700 1 -- 172.21.15.26:0/2342331244 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cfc00f650 con 0x7f4d080f6bb0 2021-11-03T17:23:26.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.491+0000 7f4d0fba3700 1 -- 172.21.15.26:0/2342331244 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d08108630 con 0x7f4d080f6bb0 2021-11-03T17:23:26.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.491+0000 7f4d067fc700 1 -- 172.21.15.26:0/2342331244 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4cfc00fc60 con 0x7f4d080f6bb0 2021-11-03T17:23:26.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.491+0000 7f4d067fc700 1 -- 172.21.15.26:0/2342331244 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cfc012cb0 con 0x7f4d080f6bb0 2021-11-03T17:23:26.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.491+0000 7f4d0fba3700 1 -- 172.21.15.26:0/2342331244 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d08108b70 con 0x7f4d080f6bb0 2021-11-03T17:23:26.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.492+0000 7f4d0fba3700 1 -- 172.21.15.26:0/2342331244 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d08045ad0 con 0x7f4d080f6bb0 2021-11-03T17:23:26.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.493+0000 7f4d067fc700 1 -- 172.21.15.26:0/2342331244 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f4cfc019030 con 0x7f4d080f6bb0 2021-11-03T17:23:26.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.493+0000 7f4d067fc700 1 --2- 172.21.15.26:0/2342331244 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4cf00640b0 0x7f4cf0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:23:26.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.493+0000 7f4d067fc700 1 -- 172.21.15.26:0/2342331244 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f4cfc080610 con 0x7f4d080f6bb0 2021-11-03T17:23:26.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.493+0000 7f4d0d93f700 1 --2- 172.21.15.26:0/2342331244 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4cf00640b0 0x7f4cf0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:23:26.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.494+0000 7f4d0d93f700 1 --2- 172.21.15.26:0/2342331244 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4cf00640b0 0x7f4cf0066570 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f4d0000b730 tx=0x7f4d00004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:23:26.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.497+0000 7f4d067fc700 1 -- 172.21.15.26:0/2342331244 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f4cfc0529f0 con 0x7f4d080f6bb0 2021-11-03T17:23:26.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:26 smithi026 ceph-mon[96795]: pgmap v863: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:26.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.725+0000 7f4d0fba3700 1 -- 172.21.15.26:0/2342331244 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4d08108df0 con 0x7f4d080f6bb0 2021-11-03T17:23:26.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.726+0000 7f4d067fc700 1 -- 172.21.15.26:0/2342331244 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f4cfc0172e0 con 0x7f4d080f6bb0 2021-11-03T17:23:26.722 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:23:26.722 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:23:26.722 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:23:26.722 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:23:26.723 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:23:26.723 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:23:26.723 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:23:26.723 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:23:26.724 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:23:26.724 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:23:26.724 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:23:26.724 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:23:26.724 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:23:26.725 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:23:26.725 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:23:26.725 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:23:26.725 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:23:26.726 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:23:26.726 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.728+0000 7f4d0fba3700 1 -- 172.21.15.26:0/2342331244 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4cf00640b0 msgr2=0x7f4cf0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:23:26.727 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.728+0000 7f4d0fba3700 1 --2- 172.21.15.26:0/2342331244 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4cf00640b0 0x7f4cf0066570 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f4d0000b730 tx=0x7f4d00004d10).stop 2021-11-03T17:23:26.727 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.728+0000 7f4d0fba3700 1 -- 172.21.15.26:0/2342331244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d080f6bb0 msgr2=0x7f4d081075a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:23:26.727 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.728+0000 7f4d0fba3700 1 --2- 172.21.15.26:0/2342331244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d080f6bb0 0x7f4d081075a0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f4cfc00c530 tx=0x7f4cfc007e10).stop 2021-11-03T17:23:26.727 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.728+0000 7f4d0fba3700 1 -- 172.21.15.26:0/2342331244 shutdown_connections 2021-11-03T17:23:26.728 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.728+0000 7f4d0fba3700 1 --2- 172.21.15.26:0/2342331244 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4cf00640b0 0x7f4cf0066570 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:26.728 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.728+0000 7f4d0fba3700 1 --2- 172.21.15.26:0/2342331244 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d080f58b0 0x7f4d081070b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:26.728 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.728+0000 7f4d0fba3700 1 --2- 172.21.15.26:0/2342331244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d080f6bb0 0x7f4d081075a0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:26.728 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.728+0000 7f4d0fba3700 1 -- 172.21.15.26:0/2342331244 >> 172.21.15.26:0/2342331244 conn(0x7f4d080f04c0 msgr2=0x7f4d080fa310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:23:26.729 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.728+0000 7f4d0fba3700 1 -- 172.21.15.26:0/2342331244 shutdown_connections 2021-11-03T17:23:26.729 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.728+0000 7f4d0fba3700 1 -- 172.21.15.26:0/2342331244 wait complete. 2021-11-03T17:23:26.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:26 smithi194 ceph-mon[65619]: pgmap v863: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:26.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.828+0000 7f6027128700 1 -- 172.21.15.26:0/2288987444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60200f6860 msgr2=0x7f60200f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:23:26.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.828+0000 7f6027128700 1 --2- 172.21.15.26:0/2288987444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60200f6860 0x7f60200f6cc0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f600c004660 tx=0x7f600c009b30).stop 2021-11-03T17:23:26.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.828+0000 7f6027128700 1 -- 172.21.15.26:0/2288987444 shutdown_connections 2021-11-03T17:23:26.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.828+0000 7f6027128700 1 --2- 172.21.15.26:0/2288987444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60200f6860 0x7f60200f6cc0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:26.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.828+0000 7f6027128700 1 --2- 172.21.15.26:0/2288987444 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60200f55c0 0x7f60200f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:23:26.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.828+0000 7f6027128700 1 -- 172.21.15.26:0/2288987444 >> 172.21.15.26:0/2288987444 conn(0x7f60200f0d40 msgr2=0x7f60200f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:23:26.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.828+0000 7f6027128700 1 -- 172.21.15.26:0/2288987444 shutdown_connections 2021-11-03T17:23:26.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.828+0000 7f6027128700 1 -- 172.21.15.26:0/2288987444 wait complete. 2021-11-03T17:23:26.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.828+0000 7f6027128700 1 Processor -- start 2021-11-03T17:23:26.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.828+0000 7f6027128700 1 -- start start 2021-11-03T17:23:26.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.829+0000 7f6027128700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60200f55c0 0x7f6020109cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:23:26.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.829+0000 7f6027128700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60200f6860 0x7f602010c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:23:26.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.829+0000 7f6027128700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6020060450 con 0x7f60200f6860 2021-11-03T17:23:26.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.829+0000 7f6027128700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6020060590 con 0x7f60200f55c0 2021-11-03T17:23:26.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.829+0000 7f601ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60200f6860 0x7f602010c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:23:26.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.829+0000 7f601ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60200f6860 0x7f602010c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54140/0 (socket says 172.21.15.26:54140) 2021-11-03T17:23:26.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.829+0000 7f601ffff700 1 -- 172.21.15.26:0/3415301398 learned_addr learned my addr 172.21.15.26:0/3415301398 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:23:26.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.829+0000 7f6024ec4700 1 --2- 172.21.15.26:0/3415301398 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60200f55c0 0x7f6020109cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:23:26.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.829+0000 7f601ffff700 1 -- 172.21.15.26:0/3415301398 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60200f55c0 msgr2=0x7f6020109cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:23:26.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.829+0000 7f601ffff700 1 --2- 172.21.15.26:0/3415301398 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60200f55c0 0x7f6020109cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:26.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.829+0000 7f601ffff700 1 -- 172.21.15.26:0/3415301398 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f600c005040 con 0x7f60200f6860 2021-11-03T17:23:26.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.829+0000 7f6024ec4700 1 --2- 172.21.15.26:0/3415301398 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60200f55c0 0x7f6020109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:23:26.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.829+0000 7f601ffff700 1 --2- 172.21.15.26:0/3415301398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60200f6860 0x7f602010c1d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f600c009990 tx=0x7f600c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:23:26.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.829+0000 7f601d7fa700 1 -- 172.21.15.26:0/3415301398 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f600c018070 con 0x7f60200f6860 2021-11-03T17:23:26.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.829+0000 7f601d7fa700 1 -- 172.21.15.26:0/3415301398 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f600c007ca0 con 0x7f60200f6860 2021-11-03T17:23:26.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.829+0000 7f6027128700 1 -- 172.21.15.26:0/3415301398 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f602010c780 con 0x7f60200f6860 2021-11-03T17:23:26.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.830+0000 7f601d7fa700 1 -- 172.21.15.26:0/3415301398 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f600c01c620 con 0x7f60200f6860 2021-11-03T17:23:26.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.830+0000 7f6027128700 1 -- 172.21.15.26:0/3415301398 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f602010cce0 con 0x7f60200f6860 2021-11-03T17:23:26.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.830+0000 7f6027128700 1 -- 172.21.15.26:0/3415301398 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6020045ad0 con 0x7f60200f6860 2021-11-03T17:23:26.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.831+0000 7f601d7fa700 1 -- 172.21.15.26:0/3415301398 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f600c01d960 con 0x7f60200f6860 2021-11-03T17:23:26.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.831+0000 7f601d7fa700 1 --2- 172.21.15.26:0/3415301398 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f60100640b0 0x7f6010066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:23:26.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.831+0000 7f601d7fa700 1 -- 172.21.15.26:0/3415301398 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f600c0828d0 con 0x7f60200f6860 2021-11-03T17:23:26.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.832+0000 7f6024ec4700 1 --2- 172.21.15.26:0/3415301398 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f60100640b0 0x7f6010066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:23:26.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.832+0000 7f6024ec4700 1 --2- 172.21.15.26:0/3415301398 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f60100640b0 0x7f6010066570 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f6020060040 tx=0x7f6014008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:23:26.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:26.836+0000 7f601d7fa700 1 -- 172.21.15.26:0/3415301398 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f600c054c30 con 0x7f60200f6860 2021-11-03T17:23:27.037 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:27.042+0000 7f6027128700 1 -- 172.21.15.26:0/3415301398 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6020027a00 con 0x7f60200f6860 2021-11-03T17:23:27.038 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:27.043+0000 7f601d7fa700 1 -- 172.21.15.26:0/3415301398 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f600c080e60 con 0x7f60200f6860 2021-11-03T17:23:27.039 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:23:27.039 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:23:27.040 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:23:27.040 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:23:27.040 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:23:27.041 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:23:27.041 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:23:27.041 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:23:27.042 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:23:27.042 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:23:27.042 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:23:27.043 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:23:27.043 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:23:27.043 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:23:27.043 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:23:27.044 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:23:27.045 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:23:27.045 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:23:27.045 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:23:27.045 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:23:27.046 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:23:27.046 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:23:27.046 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:23:27.046 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:23:27.046 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:23:27.047 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:23:27.047 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:23:27.047 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:23:27.047 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:23:27.048 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:23:27.048 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:23:27.048 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:23:27.049 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:23:27.049 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:23:27.049 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:23:27.049 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:23:27.050 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:23:27.050 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:23:27.050 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:23:27.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:27.044+0000 7f6027128700 1 -- 172.21.15.26:0/3415301398 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f60100640b0 msgr2=0x7f6010066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:23:27.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:27.044+0000 7f6027128700 1 --2- 172.21.15.26:0/3415301398 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f60100640b0 0x7f6010066570 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f6020060040 tx=0x7f6014008040).stop 2021-11-03T17:23:27.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:27.044+0000 7f6027128700 1 -- 172.21.15.26:0/3415301398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60200f6860 msgr2=0x7f602010c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:23:27.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:27.044+0000 7f6027128700 1 --2- 172.21.15.26:0/3415301398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60200f6860 0x7f602010c1d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f600c009990 tx=0x7f600c009b30).stop 2021-11-03T17:23:27.053 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:27.044+0000 7f6027128700 1 -- 172.21.15.26:0/3415301398 shutdown_connections 2021-11-03T17:23:27.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:27.044+0000 7f6027128700 1 --2- 172.21.15.26:0/3415301398 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f60100640b0 0x7f6010066570 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:27.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:27.044+0000 7f6027128700 1 --2- 172.21.15.26:0/3415301398 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60200f55c0 0x7f6020109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:27.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:27.044+0000 7f6027128700 1 --2- 172.21.15.26:0/3415301398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60200f6860 0x7f602010c1d0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:27.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:27.044+0000 7f6027128700 1 -- 172.21.15.26:0/3415301398 >> 172.21.15.26:0/3415301398 conn(0x7f60200f0d40 msgr2=0x7f60200fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:23:27.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:27.045+0000 7f6027128700 1 -- 172.21.15.26:0/3415301398 shutdown_connections 2021-11-03T17:23:27.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:27.045+0000 7f6027128700 1 -- 172.21.15.26:0/3415301398 wait complete. 2021-11-03T17:23:27.055 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:23:27.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:27 smithi026 ceph-mon[96795]: from='client.35036 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:23:27.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:27 smithi026 ceph-mon[96795]: from='client.35040 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:23:27.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:27 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2342331244' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:23:27.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:27 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3415301398' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:23:27.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:27 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:23:27.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:27 smithi194 ceph-mon[65619]: from='client.35036 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:23:27.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:27 smithi194 ceph-mon[65619]: from='client.35040 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:23:27.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:27 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2342331244' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:23:27.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:27 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3415301398' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:23:27.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:27 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:23:28.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:28 smithi026 ceph-mon[96795]: pgmap v864: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:28.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:28 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:23:28.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:28 smithi194 ceph-mon[65619]: pgmap v864: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:28.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:28 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:23:30.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:30 smithi026 ceph-mon[96795]: pgmap v865: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:30.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:30 smithi194 ceph-mon[65619]: pgmap v865: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:32.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:32 smithi026 ceph-mon[96795]: pgmap v866: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:32.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:32 smithi194 ceph-mon[65619]: pgmap v866: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:34.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:34 smithi026 ceph-mon[96795]: pgmap v867: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:34.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:34 smithi194 ceph-mon[65619]: pgmap v867: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:36.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:36 smithi026 ceph-mon[96795]: pgmap v868: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:36.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:36 smithi194 ceph-mon[65619]: pgmap v868: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:38.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:38 smithi026 ceph-mon[96795]: pgmap v869: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:38.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:38 smithi194 ceph-mon[65619]: pgmap v869: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:40.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:40 smithi026 ceph-mon[96795]: pgmap v870: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:40.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:40 smithi194 ceph-mon[65619]: pgmap v870: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:42.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:42 smithi026 ceph-mon[96795]: pgmap v871: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:42.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:23:42.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:42 smithi194 ceph-mon[65619]: pgmap v871: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:42.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:23:43.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:43 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:23:43.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:43 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:23:44.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:44 smithi026 ceph-mon[96795]: pgmap v872: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:44.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:44 smithi194 ceph-mon[65619]: pgmap v872: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:46.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:46 smithi026 ceph-mon[96795]: pgmap v873: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:46.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:46 smithi194 ceph-mon[65619]: pgmap v873: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:48 smithi026 ceph-mon[96795]: pgmap v874: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:23:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:23:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:48 smithi194 ceph-mon[65619]: pgmap v874: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:23:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:23:50.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:50 smithi026 ceph-mon[96795]: pgmap v875: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:50.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:50 smithi194 ceph-mon[65619]: pgmap v875: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:52.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:52 smithi026 ceph-mon[96795]: pgmap v876: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:52.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:52 smithi194 ceph-mon[65619]: pgmap v876: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:54.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:54 smithi026 ceph-mon[96795]: pgmap v877: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:54.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:54 smithi194 ceph-mon[65619]: pgmap v877: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:56.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:56 smithi026 ceph-mon[96795]: pgmap v878: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:56.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:56 smithi194 ceph-mon[65619]: pgmap v878: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:57.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.160+0000 7f75d500f700 1 -- 172.21.15.26:0/532597537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75d00f9700 msgr2=0x7f75d00fbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:23:57.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.160+0000 7f75d500f700 1 --2- 172.21.15.26:0/532597537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75d00f9700 0x7f75d00fbaf0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f75b8004660 tx=0x7f75b8009b30).stop 2021-11-03T17:23:57.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.160+0000 7f75d500f700 1 -- 172.21.15.26:0/532597537 shutdown_connections 2021-11-03T17:23:57.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.160+0000 7f75d500f700 1 --2- 172.21.15.26:0/532597537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75d00f9700 0x7f75d00fbaf0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:57.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.160+0000 7f75d500f700 1 --2- 172.21.15.26:0/532597537 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75d00602b0 0x7f75d00f9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:57.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.160+0000 7f75d500f700 1 -- 172.21.15.26:0/532597537 >> 172.21.15.26:0/532597537 conn(0x7f75d00f0ba0 msgr2=0x7f75d00f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:23:57.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.160+0000 7f75d500f700 1 -- 172.21.15.26:0/532597537 shutdown_connections 2021-11-03T17:23:57.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.160+0000 7f75d500f700 1 -- 172.21.15.26:0/532597537 wait complete. 2021-11-03T17:23:57.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.160+0000 7f75d500f700 1 Processor -- start 2021-11-03T17:23:57.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.160+0000 7f75d500f700 1 -- start start 2021-11-03T17:23:57.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.161+0000 7f75d500f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75d00602b0 0x7f75d00f6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:23:57.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.161+0000 7f75d500f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75d00f9700 0x7f75d00f5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:23:57.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.161+0000 7f75d500f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d00f55e0 con 0x7f75d00602b0 2021-11-03T17:23:57.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.161+0000 7f75d500f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d00f5720 con 0x7f75d00f9700 2021-11-03T17:23:57.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.161+0000 7f75cffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75d00602b0 0x7f75d00f6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:23:57.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.161+0000 7f75cffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75d00602b0 0x7f75d00f6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54156/0 (socket says 172.21.15.26:54156) 2021-11-03T17:23:57.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.161+0000 7f75cffff700 1 -- 172.21.15.26:0/3794903223 learned_addr learned my addr 172.21.15.26:0/3794903223 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:23:57.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.161+0000 7f75cf7fe700 1 --2- 172.21.15.26:0/3794903223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75d00f9700 0x7f75d00f5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:23:57.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.161+0000 7f75cffff700 1 -- 172.21.15.26:0/3794903223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75d00f9700 msgr2=0x7f75d00f5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:23:57.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.161+0000 7f75cffff700 1 --2- 172.21.15.26:0/3794903223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75d00f9700 0x7f75d00f5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:57.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.161+0000 7f75cffff700 1 -- 172.21.15.26:0/3794903223 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b8005040 con 0x7f75d00602b0 2021-11-03T17:23:57.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.161+0000 7f75cf7fe700 1 --2- 172.21.15.26:0/3794903223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75d00f9700 0x7f75d00f5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:23:57.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.161+0000 7f75cffff700 1 --2- 172.21.15.26:0/3794903223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75d00602b0 0x7f75d00f6c00 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f75c0002700 tx=0x7f75c0009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:23:57.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.161+0000 7f75ccff9700 1 -- 172.21.15.26:0/3794903223 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75c0009320 con 0x7f75d00602b0 2021-11-03T17:23:57.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.162+0000 7f75ccff9700 1 -- 172.21.15.26:0/3794903223 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f75c000f040 con 0x7f75d00602b0 2021-11-03T17:23:57.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.162+0000 7f75d500f700 1 -- 172.21.15.26:0/3794903223 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75d00f5a00 con 0x7f75d00602b0 2021-11-03T17:23:57.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.162+0000 7f75ccff9700 1 -- 172.21.15.26:0/3794903223 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75c0014820 con 0x7f75d00602b0 2021-11-03T17:23:57.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.162+0000 7f75d500f700 1 -- 172.21.15.26:0/3794903223 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d010ed10 con 0x7f75d00602b0 2021-11-03T17:23:57.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.163+0000 7f75d500f700 1 -- 172.21.15.26:0/3794903223 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75d0045ad0 con 0x7f75d00602b0 2021-11-03T17:23:57.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.163+0000 7f75ccff9700 1 -- 172.21.15.26:0/3794903223 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f75c0009480 con 0x7f75d00602b0 2021-11-03T17:23:57.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.163+0000 7f75ccff9700 1 --2- 172.21.15.26:0/3794903223 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f75bc064100 0x7f75bc0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:23:57.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.164+0000 7f75ccff9700 1 -- 172.21.15.26:0/3794903223 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f75c0080a30 con 0x7f75d00602b0 2021-11-03T17:23:57.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.164+0000 7f75cf7fe700 1 --2- 172.21.15.26:0/3794903223 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f75bc064100 0x7f75bc0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:23:57.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.164+0000 7f75cf7fe700 1 --2- 172.21.15.26:0/3794903223 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f75bc064100 0x7f75bc0665c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f75b8005010 tx=0x7f75b8009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:23:57.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.168+0000 7f75ccff9700 1 -- 172.21.15.26:0/3794903223 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f75c0052d90 con 0x7f75d00602b0 2021-11-03T17:23:57.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.348+0000 7f75d500f700 1 -- 172.21.15.26:0/3794903223 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f75d00fee70 con 0x7f75bc064100 2021-11-03T17:23:57.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.350+0000 7f75ccff9700 1 -- 172.21.15.26:0/3794903223 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f75d00fee70 con 0x7f75bc064100 2021-11-03T17:23:57.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.352+0000 7f75d500f700 1 -- 172.21.15.26:0/3794903223 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f75bc064100 msgr2=0x7f75bc0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:23:57.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.352+0000 7f75d500f700 1 --2- 172.21.15.26:0/3794903223 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f75bc064100 0x7f75bc0665c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f75b8005010 tx=0x7f75b8009b30).stop 2021-11-03T17:23:57.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.352+0000 7f75d500f700 1 -- 172.21.15.26:0/3794903223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75d00602b0 msgr2=0x7f75d00f6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:23:57.347 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.352+0000 7f75d500f700 1 --2- 172.21.15.26:0/3794903223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75d00602b0 0x7f75d00f6c00 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f75c0002700 tx=0x7f75c0009e00).stop 2021-11-03T17:23:57.347 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.352+0000 7f75d500f700 1 -- 172.21.15.26:0/3794903223 shutdown_connections 2021-11-03T17:23:57.347 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.352+0000 7f75d500f700 1 --2- 172.21.15.26:0/3794903223 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f75bc064100 0x7f75bc0665c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:57.347 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.352+0000 7f75d500f700 1 --2- 172.21.15.26:0/3794903223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75d00602b0 0x7f75d00f6c00 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:57.347 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.352+0000 7f75d500f700 1 --2- 172.21.15.26:0/3794903223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75d00f9700 0x7f75d00f5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:57.348 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.352+0000 7f75d500f700 1 -- 172.21.15.26:0/3794903223 >> 172.21.15.26:0/3794903223 conn(0x7f75d00f0ba0 msgr2=0x7f75d00f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:23:57.348 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.352+0000 7f75d500f700 1 -- 172.21.15.26:0/3794903223 shutdown_connections 2021-11-03T17:23:57.348 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.352+0000 7f75d500f700 1 -- 172.21.15.26:0/3794903223 wait complete. 2021-11-03T17:23:57.359 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:23:57.455 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.460+0000 7ff8f7fff700 1 -- 172.21.15.26:0/300807436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8f80f5430 msgr2=0x7ff8f80f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:23:57.455 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.460+0000 7ff8f7fff700 1 --2- 172.21.15.26:0/300807436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8f80f5430 0x7ff8f80f5850 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7ff8e8004660 tx=0x7ff8e8009b30).stop 2021-11-03T17:23:57.455 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.460+0000 7ff8f7fff700 1 -- 172.21.15.26:0/300807436 shutdown_connections 2021-11-03T17:23:57.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.460+0000 7ff8f7fff700 1 --2- 172.21.15.26:0/300807436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8f80f66d0 0x7ff8f80f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:57.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.460+0000 7ff8f7fff700 1 --2- 172.21.15.26:0/300807436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8f80f5430 0x7ff8f80f5850 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:57.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.460+0000 7ff8f7fff700 1 -- 172.21.15.26:0/300807436 >> 172.21.15.26:0/300807436 conn(0x7ff8f80f0b90 msgr2=0x7ff8f80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:23:57.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.461+0000 7ff8f7fff700 1 -- 172.21.15.26:0/300807436 shutdown_connections 2021-11-03T17:23:57.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.461+0000 7ff8f7fff700 1 -- 172.21.15.26:0/300807436 wait complete. 2021-11-03T17:23:57.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.461+0000 7ff8f7fff700 1 Processor -- start 2021-11-03T17:23:57.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.461+0000 7ff8f7fff700 1 -- start start 2021-11-03T17:23:57.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.462+0000 7ff8f7fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8f80f5430 0x7ff8f8106e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:23:57.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.462+0000 7ff8f7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8f80f66d0 0x7ff8f8107300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:23:57.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.462+0000 7ff8f7fff700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f8107900 con 0x7ff8f80f66d0 2021-11-03T17:23:57.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.462+0000 7ff8f7fff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f8108110 con 0x7ff8f80f5430 2021-11-03T17:23:57.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.462+0000 7ff8f67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8f80f66d0 0x7ff8f8107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:23:57.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.462+0000 7ff8f67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8f80f66d0 0x7ff8f8107300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54168/0 (socket says 172.21.15.26:54168) 2021-11-03T17:23:57.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.462+0000 7ff8f6ffd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8f80f5430 0x7ff8f8106e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:23:57.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.462+0000 7ff8f67fc700 1 -- 172.21.15.26:0/137030738 learned_addr learned my addr 172.21.15.26:0/137030738 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:23:57.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.462+0000 7ff8f6ffd700 1 -- 172.21.15.26:0/137030738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8f80f66d0 msgr2=0x7ff8f8107300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:23:57.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.462+0000 7ff8f6ffd700 1 --2- 172.21.15.26:0/137030738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8f80f66d0 0x7ff8f8107300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:57.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.462+0000 7ff8f6ffd700 1 -- 172.21.15.26:0/137030738 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e8005040 con 0x7ff8f80f5430 2021-11-03T17:23:57.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.462+0000 7ff8f67fc700 1 --2- 172.21.15.26:0/137030738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8f80f66d0 0x7ff8f8107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-03T17:23:57.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.462+0000 7ff8f6ffd700 1 --2- 172.21.15.26:0/137030738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8f80f5430 0x7ff8f8106e10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7ff8e8000c00 tx=0x7ff8e8009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:23:57.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.463+0000 7ff8df7fe700 1 -- 172.21.15.26:0/137030738 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8e8018070 con 0x7ff8f80f5430 2021-11-03T17:23:57.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.463+0000 7ff8f7fff700 1 -- 172.21.15.26:0/137030738 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8f8108330 con 0x7ff8f80f5430 2021-11-03T17:23:57.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.463+0000 7ff8df7fe700 1 -- 172.21.15.26:0/137030738 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff8e80097d0 con 0x7ff8f80f5430 2021-11-03T17:23:57.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.463+0000 7ff8df7fe700 1 -- 172.21.15.26:0/137030738 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8e801ddb0 con 0x7ff8f80f5430 2021-11-03T17:23:57.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.463+0000 7ff8f7fff700 1 -- 172.21.15.26:0/137030738 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8f8108890 con 0x7ff8f80f5430 2021-11-03T17:23:57.464 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.464+0000 7ff8f7fff700 1 -- 172.21.15.26:0/137030738 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8f8059100 con 0x7ff8f80f5430 2021-11-03T17:23:57.464 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.464+0000 7ff8df7fe700 1 -- 172.21.15.26:0/137030738 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ff8e8007ca0 con 0x7ff8f80f5430 2021-11-03T17:23:57.464 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.465+0000 7ff8df7fe700 1 --2- 172.21.15.26:0/137030738 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff8e0064100 0x7ff8e00665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:23:57.464 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.465+0000 7ff8df7fe700 1 -- 172.21.15.26:0/137030738 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ff8e8082310 con 0x7ff8f80f5430 2021-11-03T17:23:57.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.465+0000 7ff8f67fc700 1 --2- 172.21.15.26:0/137030738 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff8e0064100 0x7ff8e00665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:23:57.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.465+0000 7ff8f67fc700 1 --2- 172.21.15.26:0/137030738 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff8e0064100 0x7ff8e00665c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7ff8ec0041d0 tx=0x7ff8ec00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:23:57.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.469+0000 7ff8df7fe700 1 -- 172.21.15.26:0/137030738 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ff8e8054730 con 0x7ff8f80f5430 2021-11-03T17:23:57.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.646+0000 7ff8f7fff700 1 -- 172.21.15.26:0/137030738 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff8f80fab10 con 0x7ff8e0064100 2021-11-03T17:23:57.659 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.665+0000 7ff8df7fe700 1 -- 172.21.15.26:0/137030738 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7ff8f80fab10 con 0x7ff8e0064100 2021-11-03T17:23:57.659 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:23:57.659 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (35m) 5m ago 36m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:23:57.660 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (27m) 5m ago 36m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:23:57.660 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (27m) 4m ago 35m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:23:57.660 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (35m) 5m ago 36m 39.6M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:23:57.660 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (28m) 5m ago 31m 19.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:23:57.661 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (28m) 5m ago 31m 20.6M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:23:57.661 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (31m) 4m ago 31m 22.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:23:57.661 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (31m) 4m ago 31m 22.2M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:23:57.661 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (28m) 5m ago 37m 505M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:23:57.661 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (28m) 4m ago 35m 419M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:23:57.662 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (28m) 5m ago 37m 147M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:23:57.662 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (27m) 4m ago 35m 75.7M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:23:57.662 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (36m) 5m ago 36m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:23:57.662 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (35m) 4m ago 35m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:23:57.663 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (27m) 5m ago 34m 211M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:23:57.663 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (26m) 5m ago 34m 226M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:23:57.663 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (25m) 5m ago 34m 189M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:23:57.663 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (25m) 4m ago 33m 236M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:23:57.663 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (25m) 4m ago 33m 208M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:23:57.664 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (24m) 4m ago 33m 194M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:23:57.664 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (34m) 5m ago 35m 52.1M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:23:57.665 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:57 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:23:57.665 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.667+0000 7ff8f7fff700 1 -- 172.21.15.26:0/137030738 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff8e0064100 msgr2=0x7ff8e00665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:23:57.666 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.667+0000 7ff8f7fff700 1 --2- 172.21.15.26:0/137030738 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff8e0064100 0x7ff8e00665c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7ff8ec0041d0 tx=0x7ff8ec00b040).stop 2021-11-03T17:23:57.666 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.667+0000 7ff8f7fff700 1 -- 172.21.15.26:0/137030738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8f80f5430 msgr2=0x7ff8f8106e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:23:57.666 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.667+0000 7ff8f7fff700 1 --2- 172.21.15.26:0/137030738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8f80f5430 0x7ff8f8106e10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7ff8e8000c00 tx=0x7ff8e8009b30).stop 2021-11-03T17:23:57.666 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.667+0000 7ff8f7fff700 1 -- 172.21.15.26:0/137030738 shutdown_connections 2021-11-03T17:23:57.667 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.667+0000 7ff8f7fff700 1 --2- 172.21.15.26:0/137030738 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff8e0064100 0x7ff8e00665c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:57.667 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.667+0000 7ff8f7fff700 1 --2- 172.21.15.26:0/137030738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8f80f5430 0x7ff8f8106e10 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:57.667 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.667+0000 7ff8f7fff700 1 --2- 172.21.15.26:0/137030738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8f80f66d0 0x7ff8f8107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:57.667 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.667+0000 7ff8f7fff700 1 -- 172.21.15.26:0/137030738 >> 172.21.15.26:0/137030738 conn(0x7ff8f80f0b90 msgr2=0x7ff8f805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:23:57.667 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.667+0000 7ff8f7fff700 1 -- 172.21.15.26:0/137030738 shutdown_connections 2021-11-03T17:23:57.668 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.667+0000 7ff8f7fff700 1 -- 172.21.15.26:0/137030738 wait complete. 2021-11-03T17:23:57.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:57 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:23:57.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.770+0000 7f1d6d591700 1 -- 172.21.15.26:0/147262004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d680f5fe0 msgr2=0x7f1d680f6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:23:57.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.770+0000 7f1d6d591700 1 --2- 172.21.15.26:0/147262004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d680f5fe0 0x7f1d680f6460 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f1d50004660 tx=0x7f1d50009b30).stop 2021-11-03T17:23:57.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.770+0000 7f1d6d591700 1 -- 172.21.15.26:0/147262004 shutdown_connections 2021-11-03T17:23:57.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.770+0000 7f1d6d591700 1 --2- 172.21.15.26:0/147262004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d680f5fe0 0x7f1d680f6460 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:57.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.770+0000 7f1d6d591700 1 --2- 172.21.15.26:0/147262004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d680f4de0 0x7f1d680f5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:57.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.770+0000 7f1d6d591700 1 -- 172.21.15.26:0/147262004 >> 172.21.15.26:0/147262004 conn(0x7f1d680f0540 msgr2=0x7f1d680f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:23:57.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.770+0000 7f1d6d591700 1 -- 172.21.15.26:0/147262004 shutdown_connections 2021-11-03T17:23:57.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.770+0000 7f1d6d591700 1 -- 172.21.15.26:0/147262004 wait complete. 2021-11-03T17:23:57.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.771+0000 7f1d6d591700 1 Processor -- start 2021-11-03T17:23:57.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.771+0000 7f1d6d591700 1 -- start start 2021-11-03T17:23:57.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.771+0000 7f1d6d591700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d680f4de0 0x7f1d68105f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:23:57.770 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.771+0000 7f1d6d591700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d680f5fe0 0x7f1d68106440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:23:57.770 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.771+0000 7f1d6d591700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d681069f0 con 0x7f1d680f5fe0 2021-11-03T17:23:57.770 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.771+0000 7f1d6d591700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d68106b30 con 0x7f1d680f4de0 2021-11-03T17:23:57.770 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.771+0000 7f1d667fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d680f5fe0 0x7f1d68106440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:23:57.770 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.771+0000 7f1d667fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d680f5fe0 0x7f1d68106440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54178/0 (socket says 172.21.15.26:54178) 2021-11-03T17:23:57.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.771+0000 7f1d667fc700 1 -- 172.21.15.26:0/3008692810 learned_addr learned my addr 172.21.15.26:0/3008692810 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:23:57.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.771+0000 7f1d66ffd700 1 --2- 172.21.15.26:0/3008692810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d680f4de0 0x7f1d68105f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:23:57.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.771+0000 7f1d667fc700 1 -- 172.21.15.26:0/3008692810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d680f4de0 msgr2=0x7f1d68105f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:23:57.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.771+0000 7f1d667fc700 1 --2- 172.21.15.26:0/3008692810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d680f4de0 0x7f1d68105f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:57.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.771+0000 7f1d667fc700 1 -- 172.21.15.26:0/3008692810 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d50005040 con 0x7f1d680f5fe0 2021-11-03T17:23:57.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.771+0000 7f1d667fc700 1 --2- 172.21.15.26:0/3008692810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d680f5fe0 0x7f1d68106440 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f1d50009990 tx=0x7f1d50009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:23:57.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.771+0000 7f1d5f7fe700 1 -- 172.21.15.26:0/3008692810 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d50018070 con 0x7f1d680f5fe0 2021-11-03T17:23:57.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.772+0000 7f1d6d591700 1 -- 172.21.15.26:0/3008692810 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d68107470 con 0x7f1d680f5fe0 2021-11-03T17:23:57.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.772+0000 7f1d5f7fe700 1 -- 172.21.15.26:0/3008692810 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1d50007ba0 con 0x7f1d680f5fe0 2021-11-03T17:23:57.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.772+0000 7f1d5f7fe700 1 -- 172.21.15.26:0/3008692810 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d5001c3c0 con 0x7f1d680f5fe0 2021-11-03T17:23:57.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.772+0000 7f1d6d591700 1 -- 172.21.15.26:0/3008692810 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d68107950 con 0x7f1d680f5fe0 2021-11-03T17:23:57.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.773+0000 7f1d6d591700 1 -- 172.21.15.26:0/3008692810 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d68045ad0 con 0x7f1d680f5fe0 2021-11-03T17:23:57.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.773+0000 7f1d5f7fe700 1 -- 172.21.15.26:0/3008692810 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f1d5001d420 con 0x7f1d680f5fe0 2021-11-03T17:23:57.775 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.773+0000 7f1d5f7fe700 1 --2- 172.21.15.26:0/3008692810 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1d540640b0 0x7f1d54066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:23:57.775 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.773+0000 7f1d5f7fe700 1 -- 172.21.15.26:0/3008692810 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f1d50082410 con 0x7f1d680f5fe0 2021-11-03T17:23:57.775 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.773+0000 7f1d66ffd700 1 --2- 172.21.15.26:0/3008692810 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1d540640b0 0x7f1d54066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:23:57.775 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.774+0000 7f1d66ffd700 1 --2- 172.21.15.26:0/3008692810 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1d540640b0 0x7f1d54066570 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f1d60007db0 tx=0x7f1d60009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:23:57.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:57.777+0000 7f1d5f7fe700 1 -- 172.21.15.26:0/3008692810 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f1d50054710 con 0x7f1d680f5fe0 2021-11-03T17:23:58.003 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.009+0000 7f1d6d591700 1 -- 172.21.15.26:0/3008692810 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1d680fd600 con 0x7f1d680f5fe0 2021-11-03T17:23:58.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.010+0000 7f1d5f7fe700 1 -- 172.21.15.26:0/3008692810 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f1d50054300 con 0x7f1d680f5fe0 2021-11-03T17:23:58.004 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:23:58.005 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:23:58.005 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:23:58.005 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:23:58.005 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:23:58.005 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:23:58.006 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:23:58.006 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:23:58.006 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:23:58.006 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:23:58.007 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:23:58.007 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:23:58.007 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:23:58.007 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:23:58.008 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:23:58.008 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:23:58.008 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:23:58.008 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:23:58.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.011+0000 7f1d6d591700 1 -- 172.21.15.26:0/3008692810 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1d540640b0 msgr2=0x7f1d54066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:23:58.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.011+0000 7f1d6d591700 1 --2- 172.21.15.26:0/3008692810 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1d540640b0 0x7f1d54066570 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f1d60007db0 tx=0x7f1d60009040).stop 2021-11-03T17:23:58.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.011+0000 7f1d6d591700 1 -- 172.21.15.26:0/3008692810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d680f5fe0 msgr2=0x7f1d68106440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:23:58.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.011+0000 7f1d6d591700 1 --2- 172.21.15.26:0/3008692810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d680f5fe0 0x7f1d68106440 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f1d50009990 tx=0x7f1d50009b30).stop 2021-11-03T17:23:58.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.012+0000 7f1d6d591700 1 -- 172.21.15.26:0/3008692810 shutdown_connections 2021-11-03T17:23:58.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.012+0000 7f1d6d591700 1 --2- 172.21.15.26:0/3008692810 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1d540640b0 0x7f1d54066570 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:58.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.012+0000 7f1d6d591700 1 --2- 172.21.15.26:0/3008692810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d680f4de0 0x7f1d68105f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:58.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.012+0000 7f1d6d591700 1 --2- 172.21.15.26:0/3008692810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d680f5fe0 0x7f1d68106440 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:58.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.012+0000 7f1d6d591700 1 -- 172.21.15.26:0/3008692810 >> 172.21.15.26:0/3008692810 conn(0x7f1d680f0540 msgr2=0x7f1d680f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:23:58.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.012+0000 7f1d6d591700 1 -- 172.21.15.26:0/3008692810 shutdown_connections 2021-11-03T17:23:58.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.012+0000 7f1d6d591700 1 -- 172.21.15.26:0/3008692810 wait complete. 2021-11-03T17:23:58.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.112+0000 7fbae0167700 1 -- 172.21.15.26:0/3364597104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbad80f66e0 msgr2=0x7fbad80f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:23:58.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.112+0000 7fbae0167700 1 --2- 172.21.15.26:0/3364597104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbad80f66e0 0x7fbad80f6b00 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7fbac8004660 tx=0x7fbac8009b30).stop 2021-11-03T17:23:58.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.112+0000 7fbae0167700 1 -- 172.21.15.26:0/3364597104 shutdown_connections 2021-11-03T17:23:58.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.112+0000 7fbae0167700 1 --2- 172.21.15.26:0/3364597104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbad80f7980 0x7fbad80f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:58.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.112+0000 7fbae0167700 1 --2- 172.21.15.26:0/3364597104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbad80f66e0 0x7fbad80f6b00 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:58.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.112+0000 7fbae0167700 1 -- 172.21.15.26:0/3364597104 >> 172.21.15.26:0/3364597104 conn(0x7fbad80f1e40 msgr2=0x7fbad80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:23:58.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.112+0000 7fbae0167700 1 -- 172.21.15.26:0/3364597104 shutdown_connections 2021-11-03T17:23:58.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.112+0000 7fbae0167700 1 -- 172.21.15.26:0/3364597104 wait complete. 2021-11-03T17:23:58.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.112+0000 7fbae0167700 1 Processor -- start 2021-11-03T17:23:58.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.112+0000 7fbae0167700 1 -- start start 2021-11-03T17:23:58.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.112+0000 7fbae0167700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbad80f66e0 0x7fbad8106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:23:58.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.112+0000 7fbae0167700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbad80f7980 0x7fbad81074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:23:58.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.113+0000 7fbae0167700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad8107a50 con 0x7fbad80f66e0 2021-11-03T17:23:58.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.113+0000 7fbae0167700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad8107b90 con 0x7fbad80f7980 2021-11-03T17:23:58.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.113+0000 7fbaddf03700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbad80f66e0 0x7fbad8106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:23:58.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.113+0000 7fbaddf03700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbad80f66e0 0x7fbad8106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54186/0 (socket says 172.21.15.26:54186) 2021-11-03T17:23:58.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.113+0000 7fbaddf03700 1 -- 172.21.15.26:0/3200429007 learned_addr learned my addr 172.21.15.26:0/3200429007 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:23:58.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.113+0000 7fbaddf03700 1 -- 172.21.15.26:0/3200429007 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbad80f7980 msgr2=0x7fbad81074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:23:58.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.113+0000 7fbaddf03700 1 --2- 172.21.15.26:0/3200429007 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbad80f7980 0x7fbad81074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:23:58.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.113+0000 7fbaddf03700 1 -- 172.21.15.26:0/3200429007 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac8005040 con 0x7fbad80f66e0 2021-11-03T17:23:58.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.113+0000 7fbaddf03700 1 --2- 172.21.15.26:0/3200429007 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbad80f66e0 0x7fbad8106fb0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7fbac8004f60 tx=0x7fbac8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:23:58.114 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.113+0000 7fbace7fc700 1 -- 172.21.15.26:0/3200429007 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbac8018070 con 0x7fbad80f66e0 2021-11-03T17:23:58.114 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.113+0000 7fbae0167700 1 -- 172.21.15.26:0/3200429007 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbad81084d0 con 0x7fbad80f66e0 2021-11-03T17:23:58.115 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.113+0000 7fbace7fc700 1 -- 172.21.15.26:0/3200429007 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbac8007ba0 con 0x7fbad80f66e0 2021-11-03T17:23:58.115 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.113+0000 7fbace7fc700 1 -- 172.21.15.26:0/3200429007 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbac801c620 con 0x7fbad80f66e0 2021-11-03T17:23:58.115 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.114+0000 7fbae0167700 1 -- 172.21.15.26:0/3200429007 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad81089e0 con 0x7fbad80f66e0 2021-11-03T17:23:58.115 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.114+0000 7fbae0167700 1 -- 172.21.15.26:0/3200429007 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbad8045ad0 con 0x7fbad80f66e0 2021-11-03T17:23:58.116 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.115+0000 7fbace7fc700 1 -- 172.21.15.26:0/3200429007 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fbac801c8e0 con 0x7fbad80f66e0 2021-11-03T17:23:58.116 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.115+0000 7fbace7fc700 1 --2- 172.21.15.26:0/3200429007 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbac40640b0 0x7fbac4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:23:58.116 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.116+0000 7fbace7fc700 1 -- 172.21.15.26:0/3200429007 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fbac80826e0 con 0x7fbad80f66e0 2021-11-03T17:23:58.116 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.116+0000 7fbadd702700 1 --2- 172.21.15.26:0/3200429007 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbac40640b0 0x7fbac4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:23:58.117 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.116+0000 7fbadd702700 1 --2- 172.21.15.26:0/3200429007 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbac40640b0 0x7fbac4066570 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7fbad40047d0 tx=0x7fbad4007a40).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:23:58.117 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.120+0000 7fbace7fc700 1 -- 172.21.15.26:0/3200429007 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fbac8054a40 con 0x7fbad80f66e0 2021-11-03T17:23:58.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.328+0000 7fbae0167700 1 -- 172.21.15.26:0/3200429007 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbad8027a00 con 0x7fbad80f66e0 2021-11-03T17:23:58.323 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.328+0000 7fbace7fc700 1 -- 172.21.15.26:0/3200429007 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fbac8054630 con 0x7fbad80f66e0 2021-11-03T17:23:58.323 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:23:58.323 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:23:58.324 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:23:58.324 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:23:58.324 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:23:58.325 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:23:58.325 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:23:58.325 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:23:58.325 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:23:58.325 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:23:58.326 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:23:58.326 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:23:58.326 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:23:58.326 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:23:58.327 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:23:58.327 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:23:58.327 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:23:58.327 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:23:58.328 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:23:58.328 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:23:58.328 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:23:58.328 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:23:58.328 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:23:58.329 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:23:58.329 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:23:58.329 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:23:58.329 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:23:58.329 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:23:58.330 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:23:58.330 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:23:58.330 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:23:58.330 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:23:58.331 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:23:58.331 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:23:58.331 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:23:58.331 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:23:58.332 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:23:58.332 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:23:58.332 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:23:58.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.330+0000 7fbae0167700 1 -- 172.21.15.26:0/3200429007 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbac40640b0 msgr2=0x7fbac4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:23:58.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.330+0000 7fbae0167700 1 --2- 172.21.15.26:0/3200429007 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbac40640b0 0x7fbac4066570 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7fbad40047d0 tx=0x7fbad4007a40).stop 2021-11-03T17:23:58.334 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.330+0000 7fbae0167700 1 -- 172.21.15.26:0/3200429007 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbad80f66e0 msgr2=0x7fbad8106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:23:58.334 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.330+0000 7fbae0167700 1 --2- 172.21.15.26:0/3200429007 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbad80f66e0 0x7fbad8106fb0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7fbac8004f60 tx=0x7fbac8009b30).stop 2021-11-03T17:23:58.334 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.331+0000 7fbae0167700 1 -- 172.21.15.26:0/3200429007 shutdown_connections 2021-11-03T17:23:58.334 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.331+0000 7fbae0167700 1 --2- 172.21.15.26:0/3200429007 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbac40640b0 0x7fbac4066570 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:58.334 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.331+0000 7fbae0167700 1 --2- 172.21.15.26:0/3200429007 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbad80f66e0 0x7fbad8106fb0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:23:58.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.331+0000 7fbae0167700 1 --2- 172.21.15.26:0/3200429007 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbad80f7980 0x7fbad81074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:23:58.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.331+0000 7fbae0167700 1 -- 172.21.15.26:0/3200429007 >> 172.21.15.26:0/3200429007 conn(0x7fbad80f1e40 msgr2=0x7fbad80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:23:58.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.331+0000 7fbae0167700 1 -- 172.21.15.26:0/3200429007 shutdown_connections 2021-11-03T17:23:58.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:23:58.331+0000 7fbae0167700 1 -- 172.21.15.26:0/3200429007 wait complete. 2021-11-03T17:23:58.336 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:23:58.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:58 smithi026 ceph-mon[96795]: pgmap v879: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:58.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:58 smithi026 ceph-mon[96795]: poll took 60067.949 ms: 1 events 2021-11-03T17:23:58.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:58 smithi026 ceph-mon[96795]: from='client.35052 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:23:58.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:58 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:23:58.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:58 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:23:58.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:58 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:23:58.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:58 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:23:58.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:58 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:23:58.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:58 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:23:58.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:58 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:23:58.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:58 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3008692810' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:23:58.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:58 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3200429007' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:23:58.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:58 smithi194 ceph-mon[65619]: pgmap v879: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:23:58.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:58 smithi194 ceph-mon[65619]: poll took 60067.949 ms: 1 events 2021-11-03T17:23:58.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:58 smithi194 ceph-mon[65619]: from='client.35052 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:23:58.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:58 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:23:58.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:58 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:23:58.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:58 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:23:58.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:58 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:23:58.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:58 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:23:58.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:58 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:23:58.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:58 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:23:58.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:58 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3008692810' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:23:58.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:58 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3200429007' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:23:59.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:59 smithi026 ceph-mon[96795]: from='client.44709 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:23:59.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:59 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:23:59.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:23:59 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:23:59.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:59 smithi194 ceph-mon[65619]: from='client.44709 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:23:59.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:59 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:23:59.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:23:59 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:24:00.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:00 smithi026 ceph-mon[96795]: pgmap v880: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:00.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:00 smithi194 ceph-mon[65619]: pgmap v880: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:02.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:02 smithi026 ceph-mon[96795]: pgmap v881: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:02.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:02 smithi194 ceph-mon[65619]: pgmap v881: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:04.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:04 smithi026 ceph-mon[96795]: pgmap v882: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:04.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:04 smithi194 ceph-mon[65619]: pgmap v882: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:06.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:06 smithi026 ceph-mon[96795]: pgmap v883: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:06.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:06 smithi194 ceph-mon[65619]: pgmap v883: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:08.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:08 smithi026 ceph-mon[96795]: pgmap v884: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:08.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:08 smithi194 ceph-mon[65619]: pgmap v884: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:10.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:10 smithi026 ceph-mon[96795]: pgmap v885: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:10.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:10 smithi194 ceph-mon[65619]: pgmap v885: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:12.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:12 smithi026 ceph-mon[96795]: pgmap v886: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:12.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:12 smithi194 ceph-mon[65619]: pgmap v886: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:13.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:13 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:24:13.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:13 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:24:14.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:14 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:24:14.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:14 smithi026 ceph-mon[96795]: pgmap v887: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:14.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:14 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:24:14.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:14 smithi194 ceph-mon[65619]: pgmap v887: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:16.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:16 smithi026 ceph-mon[96795]: pgmap v888: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:16.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:16 smithi194 ceph-mon[65619]: pgmap v888: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:18.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:18 smithi026 ceph-mon[96795]: pgmap v889: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:18.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:18 smithi194 ceph-mon[65619]: pgmap v889: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:20.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:20 smithi026 ceph-mon[96795]: pgmap v890: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:20.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:20 smithi194 ceph-mon[65619]: pgmap v890: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:22.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:22 smithi026 ceph-mon[96795]: pgmap v891: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:22.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:22 smithi194 ceph-mon[65619]: pgmap v891: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:24.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:24 smithi026 ceph-mon[96795]: pgmap v892: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:24.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:24 smithi194 ceph-mon[65619]: pgmap v892: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:26.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:26 smithi026 ceph-mon[96795]: pgmap v893: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:26.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:26 smithi194 ceph-mon[65619]: pgmap v893: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:28.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.446+0000 7fef99d4a700 1 -- 172.21.15.26:0/768452476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef940f5440 msgr2=0x7fef940f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:24:28.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.446+0000 7fef99d4a700 1 --2- 172.21.15.26:0/768452476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef940f5440 0x7fef940f5860 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7fef88004660 tx=0x7fef88009b30).stop 2021-11-03T17:24:28.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.446+0000 7fef99d4a700 1 -- 172.21.15.26:0/768452476 shutdown_connections 2021-11-03T17:24:28.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.446+0000 7fef99d4a700 1 --2- 172.21.15.26:0/768452476 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef940f66e0 0x7fef940f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:24:28.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.446+0000 7fef99d4a700 1 --2- 172.21.15.26:0/768452476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef940f5440 0x7fef940f5860 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:24:28.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.446+0000 7fef99d4a700 1 -- 172.21.15.26:0/768452476 >> 172.21.15.26:0/768452476 conn(0x7fef940f0ba0 msgr2=0x7fef940f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:24:28.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.446+0000 7fef99d4a700 1 -- 172.21.15.26:0/768452476 shutdown_connections 2021-11-03T17:24:28.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.446+0000 7fef99d4a700 1 -- 172.21.15.26:0/768452476 wait complete. 2021-11-03T17:24:28.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.446+0000 7fef99d4a700 1 Processor -- start 2021-11-03T17:24:28.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.446+0000 7fef99d4a700 1 -- start start 2021-11-03T17:24:28.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.447+0000 7fef99d4a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef940f5440 0x7fef94106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:24:28.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.447+0000 7fef99d4a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef940f66e0 0x7fef94107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:24:28.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.447+0000 7fef99d4a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef941078e0 con 0x7fef940f5440 2021-11-03T17:24:28.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.447+0000 7fef99d4a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef94108060 con 0x7fef940f66e0 2021-11-03T17:24:28.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.447+0000 7fef98d48700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef940f5440 0x7fef94106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:24:28.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.447+0000 7fef98d48700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef940f5440 0x7fef94106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54204/0 (socket says 172.21.15.26:54204) 2021-11-03T17:24:28.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.447+0000 7fef98d48700 1 -- 172.21.15.26:0/2551842017 learned_addr learned my addr 172.21.15.26:0/2551842017 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:24:28.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.447+0000 7fef93fff700 1 --2- 172.21.15.26:0/2551842017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef940f66e0 0x7fef94107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:24:28.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.447+0000 7fef98d48700 1 -- 172.21.15.26:0/2551842017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef940f66e0 msgr2=0x7fef94107250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:24:28.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.447+0000 7fef98d48700 1 --2- 172.21.15.26:0/2551842017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef940f66e0 0x7fef94107250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:24:28.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.447+0000 7fef98d48700 1 -- 172.21.15.26:0/2551842017 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef88005040 con 0x7fef940f5440 2021-11-03T17:24:28.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.447+0000 7fef98d48700 1 --2- 172.21.15.26:0/2551842017 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef940f5440 0x7fef94106d60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7fef88004f60 tx=0x7fef88009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:24:28.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.447+0000 7fef917fa700 1 -- 172.21.15.26:0/2551842017 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef88018070 con 0x7fef940f5440 2021-11-03T17:24:28.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.448+0000 7fef917fa700 1 -- 172.21.15.26:0/2551842017 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fef88007ba0 con 0x7fef940f5440 2021-11-03T17:24:28.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.448+0000 7fef917fa700 1 -- 172.21.15.26:0/2551842017 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef8801c620 con 0x7fef940f5440 2021-11-03T17:24:28.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.448+0000 7fef99d4a700 1 -- 172.21.15.26:0/2551842017 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef94108280 con 0x7fef940f5440 2021-11-03T17:24:28.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.448+0000 7fef99d4a700 1 -- 172.21.15.26:0/2551842017 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef941087e0 con 0x7fef940f5440 2021-11-03T17:24:28.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.448+0000 7fef99d4a700 1 -- 172.21.15.26:0/2551842017 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef94045ad0 con 0x7fef940f5440 2021-11-03T17:24:28.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.449+0000 7fef917fa700 1 -- 172.21.15.26:0/2551842017 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fef8801c8e0 con 0x7fef940f5440 2021-11-03T17:24:28.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.449+0000 7fef917fa700 1 --2- 172.21.15.26:0/2551842017 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fef84064100 0x7fef840665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:24:28.450 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.449+0000 7fef917fa700 1 -- 172.21.15.26:0/2551842017 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fef880826e0 con 0x7fef940f5440 2021-11-03T17:24:28.450 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.450+0000 7fef93fff700 1 --2- 172.21.15.26:0/2551842017 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fef84064100 0x7fef840665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:24:28.450 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.450+0000 7fef93fff700 1 --2- 172.21.15.26:0/2551842017 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fef84064100 0x7fef840665c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7fef8000b790 tx=0x7fef80008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:24:28.451 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.454+0000 7fef917fa700 1 -- 172.21.15.26:0/2551842017 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fef88054a40 con 0x7fef940f5440 2021-11-03T17:24:28.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.634+0000 7fef99d4a700 1 -- 172.21.15.26:0/2551842017 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fef940fab20 con 0x7fef84064100 2021-11-03T17:24:28.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.635+0000 7fef917fa700 1 -- 172.21.15.26:0/2551842017 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fef940fab20 con 0x7fef84064100 2021-11-03T17:24:28.631 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.637+0000 7fef99d4a700 1 -- 172.21.15.26:0/2551842017 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fef84064100 msgr2=0x7fef840665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:24:28.631 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.637+0000 7fef99d4a700 1 --2- 172.21.15.26:0/2551842017 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fef84064100 0x7fef840665c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7fef8000b790 tx=0x7fef80008040).stop 2021-11-03T17:24:28.631 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.637+0000 7fef99d4a700 1 -- 172.21.15.26:0/2551842017 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef940f5440 msgr2=0x7fef94106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:24:28.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.637+0000 7fef99d4a700 1 --2- 172.21.15.26:0/2551842017 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef940f5440 0x7fef94106d60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7fef88004f60 tx=0x7fef88009b30).stop 2021-11-03T17:24:28.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.637+0000 7fef99d4a700 1 -- 172.21.15.26:0/2551842017 shutdown_connections 2021-11-03T17:24:28.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.637+0000 7fef99d4a700 1 --2- 172.21.15.26:0/2551842017 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fef84064100 0x7fef840665c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:24:28.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.637+0000 7fef99d4a700 1 --2- 172.21.15.26:0/2551842017 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef940f5440 0x7fef94106d60 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:24:28.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.637+0000 7fef99d4a700 1 --2- 172.21.15.26:0/2551842017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef940f66e0 0x7fef94107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:24:28.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.637+0000 7fef99d4a700 1 -- 172.21.15.26:0/2551842017 >> 172.21.15.26:0/2551842017 conn(0x7fef940f0ba0 msgr2=0x7fef9405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:24:28.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.637+0000 7fef99d4a700 1 -- 172.21.15.26:0/2551842017 shutdown_connections 2021-11-03T17:24:28.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.637+0000 7fef99d4a700 1 -- 172.21.15.26:0/2551842017 wait complete. 2021-11-03T17:24:28.641 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:24:28.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:28 smithi026 ceph-mon[96795]: pgmap v894: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:28.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:24:28.733 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.737+0000 7f39ae732700 1 -- 172.21.15.26:0/186353053 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39a80f77d0 msgr2=0x7f39a80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:24:28.733 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.737+0000 7f39ae732700 1 --2- 172.21.15.26:0/186353053 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39a80f77d0 0x7f39a80f7c30 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f399c004660 tx=0x7f399c009b30).stop 2021-11-03T17:24:28.733 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.737+0000 7f39ae732700 1 -- 172.21.15.26:0/186353053 shutdown_connections 2021-11-03T17:24:28.734 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.737+0000 7f39ae732700 1 --2- 172.21.15.26:0/186353053 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39a80f77d0 0x7f39a80f7c30 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:24:28.734 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.737+0000 7f39ae732700 1 --2- 172.21.15.26:0/186353053 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39a80f6530 0x7f39a80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:24:28.734 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.737+0000 7f39ae732700 1 -- 172.21.15.26:0/186353053 >> 172.21.15.26:0/186353053 conn(0x7f39a80f1cd0 msgr2=0x7f39a80f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:24:28.734 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.737+0000 7f39ae732700 1 -- 172.21.15.26:0/186353053 shutdown_connections 2021-11-03T17:24:28.735 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.737+0000 7f39ae732700 1 -- 172.21.15.26:0/186353053 wait complete. 2021-11-03T17:24:28.735 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.738+0000 7f39ae732700 1 Processor -- start 2021-11-03T17:24:28.735 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.738+0000 7f39ae732700 1 -- start start 2021-11-03T17:24:28.735 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.738+0000 7f39ae732700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39a80f6530 0x7f39a806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:24:28.735 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.738+0000 7f39ae732700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39a80f77d0 0x7f39a8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:24:28.736 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.738+0000 7f39ae732700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a810a9a0 con 0x7f39a80f6530 2021-11-03T17:24:28.736 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.738+0000 7f39ae732700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a810aae0 con 0x7f39a80f77d0 2021-11-03T17:24:28.736 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.738+0000 7f39ad730700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39a80f6530 0x7f39a806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:24:28.736 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.738+0000 7f39ad730700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39a80f6530 0x7f39a806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54216/0 (socket says 172.21.15.26:54216) 2021-11-03T17:24:28.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.738+0000 7f39ad730700 1 -- 172.21.15.26:0/2454321398 learned_addr learned my addr 172.21.15.26:0/2454321398 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:24:28.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.738+0000 7f39acf2f700 1 --2- 172.21.15.26:0/2454321398 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39a80f77d0 0x7f39a8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:24:28.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.738+0000 7f39ad730700 1 -- 172.21.15.26:0/2454321398 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39a80f77d0 msgr2=0x7f39a8069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:24:28.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.738+0000 7f39ad730700 1 --2- 172.21.15.26:0/2454321398 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39a80f77d0 0x7f39a8069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:24:28.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.738+0000 7f39ad730700 1 -- 172.21.15.26:0/2454321398 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f399c005040 con 0x7f39a80f6530 2021-11-03T17:24:28.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.739+0000 7f39ad730700 1 --2- 172.21.15.26:0/2454321398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39a80f6530 0x7f39a806b9a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f39a400c530 tx=0x7f39a4007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:24:28.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.739+0000 7f3999ffb700 1 -- 172.21.15.26:0/2454321398 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39a400f650 con 0x7f39a80f6530 2021-11-03T17:24:28.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.739+0000 7f3999ffb700 1 -- 172.21.15.26:0/2454321398 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f39a400fc60 con 0x7f39a80f6530 2021-11-03T17:24:28.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.739+0000 7f39ae732700 1 -- 172.21.15.26:0/2454321398 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39a806a3d0 con 0x7f39a80f6530 2021-11-03T17:24:28.739 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.739+0000 7f3999ffb700 1 -- 172.21.15.26:0/2454321398 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39a4012cb0 con 0x7f39a80f6530 2021-11-03T17:24:28.739 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.739+0000 7f39ae732700 1 -- 172.21.15.26:0/2454321398 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39a806a990 con 0x7f39a80f6530 2021-11-03T17:24:28.740 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.740+0000 7f39ae732700 1 -- 172.21.15.26:0/2454321398 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39a8045ad0 con 0x7f39a80f6530 2021-11-03T17:24:28.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.740+0000 7f3999ffb700 1 -- 172.21.15.26:0/2454321398 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f39a4019030 con 0x7f39a80f6530 2021-11-03T17:24:28.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.741+0000 7f3999ffb700 1 --2- 172.21.15.26:0/2454321398 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3994064100 0x7f39940665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:24:28.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.741+0000 7f3999ffb700 1 -- 172.21.15.26:0/2454321398 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f39a4080560 con 0x7f39a80f6530 2021-11-03T17:24:28.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.741+0000 7f39acf2f700 1 --2- 172.21.15.26:0/2454321398 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3994064100 0x7f39940665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:24:28.742 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.741+0000 7f39acf2f700 1 --2- 172.21.15.26:0/2454321398 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3994064100 0x7f39940665c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f399c004630 tx=0x7f399c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:24:28.742 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.745+0000 7f3999ffb700 1 -- 172.21.15.26:0/2454321398 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f39a4052940 con 0x7f39a80f6530 2021-11-03T17:24:28.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:28 smithi194 ceph-mon[65619]: pgmap v894: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:28.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:24:28.913 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.919+0000 7f39ae732700 1 -- 172.21.15.26:0/2454321398 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f39a80fed40 con 0x7f3994064100 2021-11-03T17:24:28.928 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.934+0000 7f3999ffb700 1 -- 172.21.15.26:0/2454321398 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f39a80fed40 con 0x7f3994064100 2021-11-03T17:24:28.929 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:24:28.929 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (35m) 5m ago 36m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:24:28.930 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (27m) 5m ago 36m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:24:28.930 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (27m) 4m ago 36m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:24:28.930 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (35m) 5m ago 36m 39.6M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:24:28.930 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (28m) 5m ago 32m 19.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:24:28.930 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (29m) 5m ago 31m 20.6M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:24:28.931 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (32m) 4m ago 32m 22.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:24:28.931 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (32m) 4m ago 32m 22.2M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:24:28.931 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (29m) 5m ago 38m 505M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:24:28.931 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (29m) 4m ago 36m 419M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:24:28.932 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (28m) 5m ago 38m 147M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:24:28.932 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (28m) 4m ago 36m 75.7M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:24:28.932 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (36m) 5m ago 36m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:24:28.932 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (35m) 4m ago 35m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:24:28.932 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (27m) 5m ago 35m 211M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:24:28.933 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (27m) 5m ago 34m 226M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:24:28.933 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (26m) 5m ago 34m 189M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:24:28.933 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (26m) 4m ago 34m 236M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:24:28.934 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (25m) 4m ago 34m 208M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:24:28.934 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (25m) 4m ago 33m 194M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:24:28.934 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (35m) 5m ago 36m 52.1M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:24:28.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.936+0000 7f39ae732700 1 -- 172.21.15.26:0/2454321398 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3994064100 msgr2=0x7f39940665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:24:28.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.936+0000 7f39ae732700 1 --2- 172.21.15.26:0/2454321398 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3994064100 0x7f39940665c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f399c004630 tx=0x7f399c009b30).stop 2021-11-03T17:24:28.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.936+0000 7f39ae732700 1 -- 172.21.15.26:0/2454321398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39a80f6530 msgr2=0x7f39a806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:24:28.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.936+0000 7f39ae732700 1 --2- 172.21.15.26:0/2454321398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39a80f6530 0x7f39a806b9a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f39a400c530 tx=0x7f39a4007e10).stop 2021-11-03T17:24:28.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.936+0000 7f39ae732700 1 -- 172.21.15.26:0/2454321398 shutdown_connections 2021-11-03T17:24:28.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.936+0000 7f39ae732700 1 --2- 172.21.15.26:0/2454321398 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3994064100 0x7f39940665c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:24:28.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.936+0000 7f39ae732700 1 --2- 172.21.15.26:0/2454321398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39a80f6530 0x7f39a806b9a0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:24:28.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.936+0000 7f39ae732700 1 --2- 172.21.15.26:0/2454321398 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39a80f77d0 0x7f39a8069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:24:28.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.936+0000 7f39ae732700 1 -- 172.21.15.26:0/2454321398 >> 172.21.15.26:0/2454321398 conn(0x7f39a80f1cd0 msgr2=0x7f39a80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:24:28.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.936+0000 7f39ae732700 1 -- 172.21.15.26:0/2454321398 shutdown_connections 2021-11-03T17:24:28.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:28.936+0000 7f39ae732700 1 -- 172.21.15.26:0/2454321398 wait complete. 2021-11-03T17:24:29.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.035+0000 7f3eba1ba700 1 -- 172.21.15.26:0/2805490405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3eb40f7980 msgr2=0x7f3eb40f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:24:29.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.035+0000 7f3eba1ba700 1 --2- 172.21.15.26:0/2805490405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3eb40f7980 0x7f3eb40f7de0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f3ea4004660 tx=0x7f3ea4009b30).stop 2021-11-03T17:24:29.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.035+0000 7f3eba1ba700 1 -- 172.21.15.26:0/2805490405 shutdown_connections 2021-11-03T17:24:29.032 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.035+0000 7f3eba1ba700 1 --2- 172.21.15.26:0/2805490405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3eb40f7980 0x7f3eb40f7de0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:24:29.032 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.035+0000 7f3eba1ba700 1 --2- 172.21.15.26:0/2805490405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3eb40f66e0 0x7f3eb40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:24:29.032 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.035+0000 7f3eba1ba700 1 -- 172.21.15.26:0/2805490405 >> 172.21.15.26:0/2805490405 conn(0x7f3eb40f1e40 msgr2=0x7f3eb40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:24:29.032 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.035+0000 7f3eba1ba700 1 -- 172.21.15.26:0/2805490405 shutdown_connections 2021-11-03T17:24:29.032 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.035+0000 7f3eba1ba700 1 -- 172.21.15.26:0/2805490405 wait complete. 2021-11-03T17:24:29.033 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.035+0000 7f3eba1ba700 1 Processor -- start 2021-11-03T17:24:29.033 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.036+0000 7f3eba1ba700 1 -- start start 2021-11-03T17:24:29.033 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.036+0000 7f3eba1ba700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3eb40f66e0 0x7f3eb4106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:24:29.033 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.036+0000 7f3eba1ba700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3eb40f7980 0x7f3eb41074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:24:29.033 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.036+0000 7f3eba1ba700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb4107ae0 con 0x7f3eb40f7980 2021-11-03T17:24:29.034 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.036+0000 7f3eba1ba700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb4108390 con 0x7f3eb40f66e0 2021-11-03T17:24:29.034 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.036+0000 7f3eb2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3eb40f7980 0x7f3eb41074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:24:29.034 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.036+0000 7f3eb2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3eb40f7980 0x7f3eb41074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54228/0 (socket says 172.21.15.26:54228) 2021-11-03T17:24:29.034 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.036+0000 7f3eb2ffd700 1 -- 172.21.15.26:0/2257047042 learned_addr learned my addr 172.21.15.26:0/2257047042 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:24:29.035 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.036+0000 7f3eb2ffd700 1 -- 172.21.15.26:0/2257047042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3eb40f66e0 msgr2=0x7f3eb4106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:24:29.035 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.036+0000 7f3eb37fe700 1 --2- 172.21.15.26:0/2257047042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3eb40f66e0 0x7f3eb4106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:24:29.035 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.036+0000 7f3eb2ffd700 1 --2- 172.21.15.26:0/2257047042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3eb40f66e0 0x7f3eb4106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:24:29.035 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.036+0000 7f3eb2ffd700 1 -- 172.21.15.26:0/2257047042 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea4005040 con 0x7f3eb40f7980 2021-11-03T17:24:29.036 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.036+0000 7f3eb37fe700 1 --2- 172.21.15.26:0/2257047042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3eb40f66e0 0x7f3eb4106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:24:29.036 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.036+0000 7f3eb2ffd700 1 --2- 172.21.15.26:0/2257047042 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3eb40f7980 0x7f3eb41074a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f3ea4009990 tx=0x7f3ea4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:24:29.036 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.036+0000 7f3e9bfff700 1 -- 172.21.15.26:0/2257047042 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ea4018070 con 0x7f3eb40f7980 2021-11-03T17:24:29.036 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.037+0000 7f3e9bfff700 1 -- 172.21.15.26:0/2257047042 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3ea4007ca0 con 0x7f3eb40f7980 2021-11-03T17:24:29.037 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.037+0000 7f3eba1ba700 1 -- 172.21.15.26:0/2257047042 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eb4108610 con 0x7f3eb40f7980 2021-11-03T17:24:29.037 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.037+0000 7f3e9bfff700 1 -- 172.21.15.26:0/2257047042 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ea401c620 con 0x7f3eb40f7980 2021-11-03T17:24:29.037 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.037+0000 7f3eba1ba700 1 -- 172.21.15.26:0/2257047042 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eb4108b70 con 0x7f3eb40f7980 2021-11-03T17:24:29.038 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.038+0000 7f3eba1ba700 1 -- 172.21.15.26:0/2257047042 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eb40f5ad0 con 0x7f3eb40f7980 2021-11-03T17:24:29.039 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.038+0000 7f3e9bfff700 1 -- 172.21.15.26:0/2257047042 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f3ea401d420 con 0x7f3eb40f7980 2021-11-03T17:24:29.039 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.038+0000 7f3e9bfff700 1 --2- 172.21.15.26:0/2257047042 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3e9c0640b0 0x7f3e9c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:24:29.039 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.038+0000 7f3e9bfff700 1 -- 172.21.15.26:0/2257047042 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f3ea4082590 con 0x7f3eb40f7980 2021-11-03T17:24:29.039 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.038+0000 7f3eb37fe700 1 --2- 172.21.15.26:0/2257047042 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3e9c0640b0 0x7f3e9c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:24:29.040 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.039+0000 7f3eb37fe700 1 --2- 172.21.15.26:0/2257047042 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3e9c0640b0 0x7f3e9c066570 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f3eb40f77e0 tx=0x7f3ea8008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:24:29.040 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.042+0000 7f3e9bfff700 1 -- 172.21.15.26:0/2257047042 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f3ea40549b0 con 0x7f3eb40f7980 2021-11-03T17:24:29.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.271+0000 7f3eba1ba700 1 -- 172.21.15.26:0/2257047042 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3eb40fef40 con 0x7f3eb40f7980 2021-11-03T17:24:29.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.272+0000 7f3e9bfff700 1 -- 172.21.15.26:0/2257047042 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f3ea401d960 con 0x7f3eb40f7980 2021-11-03T17:24:29.266 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:24:29.266 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:24:29.267 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:24:29.267 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:24:29.267 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:24:29.267 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:24:29.268 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:24:29.268 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:24:29.268 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:24:29.268 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:24:29.268 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:24:29.269 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:24:29.269 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:24:29.269 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:24:29.269 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:24:29.269 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:24:29.270 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:24:29.270 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:24:29.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.273+0000 7f3eba1ba700 1 -- 172.21.15.26:0/2257047042 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3e9c0640b0 msgr2=0x7f3e9c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:24:29.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.273+0000 7f3eba1ba700 1 --2- 172.21.15.26:0/2257047042 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3e9c0640b0 0x7f3e9c066570 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f3eb40f77e0 tx=0x7f3ea8008040).stop 2021-11-03T17:24:29.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.273+0000 7f3eba1ba700 1 -- 172.21.15.26:0/2257047042 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3eb40f7980 msgr2=0x7f3eb41074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:24:29.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.273+0000 7f3eba1ba700 1 --2- 172.21.15.26:0/2257047042 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3eb40f7980 0x7f3eb41074a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f3ea4009990 tx=0x7f3ea4009b30).stop 2021-11-03T17:24:29.272 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.273+0000 7f3eba1ba700 1 -- 172.21.15.26:0/2257047042 shutdown_connections 2021-11-03T17:24:29.272 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.273+0000 7f3eba1ba700 1 --2- 172.21.15.26:0/2257047042 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3e9c0640b0 0x7f3e9c066570 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:24:29.272 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.273+0000 7f3eba1ba700 1 --2- 172.21.15.26:0/2257047042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3eb40f66e0 0x7f3eb4106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:24:29.272 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.273+0000 7f3eba1ba700 1 --2- 172.21.15.26:0/2257047042 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3eb40f7980 0x7f3eb41074a0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:24:29.273 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.273+0000 7f3eba1ba700 1 -- 172.21.15.26:0/2257047042 >> 172.21.15.26:0/2257047042 conn(0x7f3eb40f1e40 msgr2=0x7f3eb40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:24:29.273 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.273+0000 7f3eba1ba700 1 -- 172.21.15.26:0/2257047042 shutdown_connections 2021-11-03T17:24:29.273 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.273+0000 7f3eba1ba700 1 -- 172.21.15.26:0/2257047042 wait complete. 2021-11-03T17:24:29.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.373+0000 7efcf3683700 1 -- 172.21.15.26:0/2092881205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efcec0f55e0 msgr2=0x7efcec0f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:24:29.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.373+0000 7efcf3683700 1 --2- 172.21.15.26:0/2092881205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efcec0f55e0 0x7efcec0f5a00 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7efcdc004660 tx=0x7efcdc009b30).stop 2021-11-03T17:24:29.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.373+0000 7efcf3683700 1 -- 172.21.15.26:0/2092881205 shutdown_connections 2021-11-03T17:24:29.370 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.373+0000 7efcf3683700 1 --2- 172.21.15.26:0/2092881205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efcec0f5ef0 0x7efcec0f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:24:29.370 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.373+0000 7efcf3683700 1 --2- 172.21.15.26:0/2092881205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efcec0f55e0 0x7efcec0f5a00 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:24:29.370 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.373+0000 7efcf3683700 1 -- 172.21.15.26:0/2092881205 >> 172.21.15.26:0/2092881205 conn(0x7efcec0f0de0 msgr2=0x7efcec0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:24:29.370 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.373+0000 7efcf3683700 1 -- 172.21.15.26:0/2092881205 shutdown_connections 2021-11-03T17:24:29.371 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.373+0000 7efcf3683700 1 -- 172.21.15.26:0/2092881205 wait complete. 2021-11-03T17:24:29.371 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.374+0000 7efcf3683700 1 Processor -- start 2021-11-03T17:24:29.371 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.374+0000 7efcf3683700 1 -- start start 2021-11-03T17:24:29.371 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.374+0000 7efcf3683700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efcec0f55e0 0x7efcec109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:24:29.372 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.374+0000 7efcf3683700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efcec0f5ef0 0x7efcec10c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:24:29.372 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.374+0000 7efcf3683700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcec0604c0 con 0x7efcec0f5ef0 2021-11-03T17:24:29.372 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.374+0000 7efcf3683700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcec060600 con 0x7efcec0f55e0 2021-11-03T17:24:29.372 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.374+0000 7efcf0c1e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efcec0f5ef0 0x7efcec10c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:24:29.372 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.374+0000 7efcf0c1e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efcec0f5ef0 0x7efcec10c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54238/0 (socket says 172.21.15.26:54238) 2021-11-03T17:24:29.373 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.374+0000 7efcf0c1e700 1 -- 172.21.15.26:0/3621349897 learned_addr learned my addr 172.21.15.26:0/3621349897 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:24:29.373 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.374+0000 7efcf141f700 1 --2- 172.21.15.26:0/3621349897 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efcec0f55e0 0x7efcec109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:24:29.373 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.374+0000 7efcf0c1e700 1 -- 172.21.15.26:0/3621349897 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efcec0f55e0 msgr2=0x7efcec109cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:24:29.373 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.374+0000 7efcf0c1e700 1 --2- 172.21.15.26:0/3621349897 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efcec0f55e0 0x7efcec109cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:24:29.374 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.374+0000 7efcf0c1e700 1 -- 172.21.15.26:0/3621349897 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcdc005040 con 0x7efcec0f5ef0 2021-11-03T17:24:29.374 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.374+0000 7efcf141f700 1 --2- 172.21.15.26:0/3621349897 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efcec0f55e0 0x7efcec109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:24:29.374 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.374+0000 7efcf0c1e700 1 --2- 172.21.15.26:0/3621349897 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efcec0f5ef0 0x7efcec10c1b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7efce800c530 tx=0x7efce8007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:24:29.374 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.375+0000 7efce1ffb700 1 -- 172.21.15.26:0/3621349897 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efce800f650 con 0x7efcec0f5ef0 2021-11-03T17:24:29.375 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.375+0000 7efce1ffb700 1 -- 172.21.15.26:0/3621349897 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efce800fc60 con 0x7efcec0f5ef0 2021-11-03T17:24:29.375 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.375+0000 7efcf3683700 1 -- 172.21.15.26:0/3621349897 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcec10c760 con 0x7efcec0f5ef0 2021-11-03T17:24:29.375 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.375+0000 7efce1ffb700 1 -- 172.21.15.26:0/3621349897 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efce8012cd0 con 0x7efcec0f5ef0 2021-11-03T17:24:29.376 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.375+0000 7efcf3683700 1 -- 172.21.15.26:0/3621349897 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcec10ccf0 con 0x7efcec0f5ef0 2021-11-03T17:24:29.377 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.376+0000 7efcf3683700 1 -- 172.21.15.26:0/3621349897 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcec0f4a70 con 0x7efcec0f5ef0 2021-11-03T17:24:29.377 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.376+0000 7efce1ffb700 1 -- 172.21.15.26:0/3621349897 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7efce8010070 con 0x7efcec0f5ef0 2021-11-03T17:24:29.379 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.377+0000 7efce1ffb700 1 --2- 172.21.15.26:0/3621349897 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efcd80640b0 0x7efcd8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:24:29.379 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.377+0000 7efce1ffb700 1 -- 172.21.15.26:0/3621349897 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7efce8080710 con 0x7efcec0f5ef0 2021-11-03T17:24:29.379 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.377+0000 7efcf141f700 1 --2- 172.21.15.26:0/3621349897 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efcd80640b0 0x7efcd8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:24:29.379 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.377+0000 7efcf141f700 1 --2- 172.21.15.26:0/3621349897 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efcd80640b0 0x7efcd8066570 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7efcdc004e30 tx=0x7efcdc009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:24:29.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.381+0000 7efce1ffb700 1 -- 172.21.15.26:0/3621349897 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7efce8052980 con 0x7efcec0f5ef0 2021-11-03T17:24:29.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.584+0000 7efcf3683700 1 -- 172.21.15.26:0/3621349897 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7efcec045ad0 con 0x7efcec0f5ef0 2021-11-03T17:24:29.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.585+0000 7efce1ffb700 1 -- 172.21.15.26:0/3621349897 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7efce8052570 con 0x7efcec0f5ef0 2021-11-03T17:24:29.580 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:24:29.580 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:24:29.581 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:24:29.581 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:24:29.581 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:24:29.581 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:24:29.581 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:24:29.582 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:24:29.582 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:24:29.582 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:24:29.582 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:24:29.583 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:24:29.583 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:24:29.583 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:24:29.583 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:24:29.584 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:24:29.584 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:24:29.584 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:24:29.584 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:24:29.584 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:24:29.585 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:24:29.585 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:24:29.585 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:24:29.585 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:24:29.586 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:24:29.586 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:24:29.586 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:24:29.586 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:24:29.587 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:24:29.587 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:24:29.587 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:24:29.587 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:24:29.587 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:24:29.588 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:24:29.588 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:24:29.588 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:24:29.588 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:24:29.589 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:24:29.589 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:24:29.590 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.587+0000 7efcf3683700 1 -- 172.21.15.26:0/3621349897 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efcd80640b0 msgr2=0x7efcd8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:24:29.590 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.587+0000 7efcf3683700 1 --2- 172.21.15.26:0/3621349897 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efcd80640b0 0x7efcd8066570 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7efcdc004e30 tx=0x7efcdc009b30).stop 2021-11-03T17:24:29.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.587+0000 7efcf3683700 1 -- 172.21.15.26:0/3621349897 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efcec0f5ef0 msgr2=0x7efcec10c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:24:29.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.587+0000 7efcf3683700 1 --2- 172.21.15.26:0/3621349897 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efcec0f5ef0 0x7efcec10c1b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7efce800c530 tx=0x7efce8007e20).stop 2021-11-03T17:24:29.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.587+0000 7efcf3683700 1 -- 172.21.15.26:0/3621349897 shutdown_connections 2021-11-03T17:24:29.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.587+0000 7efcf3683700 1 --2- 172.21.15.26:0/3621349897 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efcd80640b0 0x7efcd8066570 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:24:29.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.587+0000 7efcf3683700 1 --2- 172.21.15.26:0/3621349897 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efcec0f55e0 0x7efcec109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:24:29.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.587+0000 7efcf3683700 1 --2- 172.21.15.26:0/3621349897 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efcec0f5ef0 0x7efcec10c1b0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:24:29.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.587+0000 7efcf3683700 1 -- 172.21.15.26:0/3621349897 >> 172.21.15.26:0/3621349897 conn(0x7efcec0f0de0 msgr2=0x7efcec0fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:24:29.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.587+0000 7efcf3683700 1 -- 172.21.15.26:0/3621349897 shutdown_connections 2021-11-03T17:24:29.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:29.587+0000 7efcf3683700 1 -- 172.21.15.26:0/3621349897 wait complete. 2021-11-03T17:24:29.593 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:24:29.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:29 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:24:29.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:29 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2257047042' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:24:29.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:29 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:24:29.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:29 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2257047042' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:24:30.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:30 smithi026 ceph-mon[96795]: from='client.35068 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:24:30.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:30 smithi026 ceph-mon[96795]: pgmap v895: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:30.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:30 smithi026 ceph-mon[96795]: from='client.35072 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:24:30.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:30 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3621349897' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:24:30.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:30 smithi194 ceph-mon[65619]: from='client.35068 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:24:30.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:30 smithi194 ceph-mon[65619]: pgmap v895: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:30.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:30 smithi194 ceph-mon[65619]: from='client.35072 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:24:30.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:30 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3621349897' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:24:32.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:32 smithi026 ceph-mon[96795]: pgmap v896: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:32.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:32 smithi194 ceph-mon[65619]: pgmap v896: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:34.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:34 smithi026 ceph-mon[96795]: pgmap v897: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:34.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:34 smithi194 ceph-mon[65619]: pgmap v897: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:36.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:36 smithi026 ceph-mon[96795]: pgmap v898: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:36.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:36 smithi194 ceph-mon[65619]: pgmap v898: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:38.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:38 smithi026 ceph-mon[96795]: pgmap v899: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:38.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:38 smithi194 ceph-mon[65619]: pgmap v899: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:40.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:40 smithi194 ceph-mon[65619]: pgmap v900: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:40.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:40 smithi026 ceph-mon[96795]: pgmap v900: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:42.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:42 smithi194 ceph-mon[65619]: pgmap v901: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:42.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:42 smithi026 ceph-mon[96795]: pgmap v901: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:43.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:43 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:24:43.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:43 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:24:44.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:44 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:24:44.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:44 smithi194 ceph-mon[65619]: pgmap v902: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:44.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:44 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:24:44.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:44 smithi026 ceph-mon[96795]: pgmap v902: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:46.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:46 smithi194 ceph-mon[65619]: pgmap v903: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:46.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:46 smithi026 ceph-mon[96795]: pgmap v903: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:48.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:48 smithi194 ceph-mon[65619]: pgmap v904: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:24:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:24:48.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:48 smithi026 ceph-mon[96795]: pgmap v904: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:48.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:24:48.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:24:50.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:50 smithi194 ceph-mon[65619]: pgmap v905: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:50.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:50 smithi026 ceph-mon[96795]: pgmap v905: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:52.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:52 smithi194 ceph-mon[65619]: pgmap v906: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:52.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:52 smithi026 ceph-mon[96795]: pgmap v906: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:54.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:54 smithi194 ceph-mon[65619]: pgmap v907: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:54.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:54 smithi026 ceph-mon[96795]: pgmap v907: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:56.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:56 smithi194 ceph-mon[65619]: pgmap v908: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:56.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:56 smithi026 ceph-mon[96795]: pgmap v908: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:58.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:58 smithi194 ceph-mon[65619]: pgmap v909: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:58.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:58 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:24:58.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:58 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:24:58.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:58 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:24:58.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:58 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:24:58.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:58 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:24:58.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:58 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:24:58.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:58 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:24:58.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:58 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:24:58.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:58 smithi026 ceph-mon[96795]: pgmap v909: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:24:58.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:58 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:24:58.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:58 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:24:58.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:58 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:24:58.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:58 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:24:58.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:58 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:24:58.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:58 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:24:58.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:58 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:24:58.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:58 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:24:59.700 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.700+0000 7f90d7edc700 1 -- 172.21.15.26:0/3783708815 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90d00f6ff0 msgr2=0x7f90d00f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:24:59.700 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.700+0000 7f90d7edc700 1 --2- 172.21.15.26:0/3783708815 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90d00f6ff0 0x7f90d00f7a20 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f90cc004660 tx=0x7f90cc009b30).stop 2021-11-03T17:24:59.701 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.700+0000 7f90d7edc700 1 -- 172.21.15.26:0/3783708815 shutdown_connections 2021-11-03T17:24:59.701 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.700+0000 7f90d7edc700 1 --2- 172.21.15.26:0/3783708815 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90d00f6ff0 0x7f90d00f7a20 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:24:59.701 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.700+0000 7f90d7edc700 1 --2- 172.21.15.26:0/3783708815 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90d00f66e0 0x7f90d00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:24:59.702 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.700+0000 7f90d7edc700 1 -- 172.21.15.26:0/3783708815 >> 172.21.15.26:0/3783708815 conn(0x7f90d00f1f00 msgr2=0x7f90d00f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:24:59.702 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.700+0000 7f90d7edc700 1 -- 172.21.15.26:0/3783708815 shutdown_connections 2021-11-03T17:24:59.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.701+0000 7f90d7edc700 1 -- 172.21.15.26:0/3783708815 wait complete. 2021-11-03T17:24:59.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.701+0000 7f90d7edc700 1 Processor -- start 2021-11-03T17:24:59.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.701+0000 7f90d7edc700 1 -- start start 2021-11-03T17:24:59.704 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.701+0000 7f90d7edc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90d00f66e0 0x7f90d0106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:24:59.704 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.701+0000 7f90d7edc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90d00f6ff0 0x7f90d0107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:24:59.704 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.701+0000 7f90d7edc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d0107a10 con 0x7f90d00f66e0 2021-11-03T17:24:59.704 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.701+0000 7f90d7edc700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d0107b50 con 0x7f90d00f6ff0 2021-11-03T17:24:59.705 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.701+0000 7f90d5c78700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90d00f66e0 0x7f90d0106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:24:59.705 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.701+0000 7f90d5c78700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90d00f66e0 0x7f90d0106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54254/0 (socket says 172.21.15.26:54254) 2021-11-03T17:24:59.705 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.701+0000 7f90d5c78700 1 -- 172.21.15.26:0/489284999 learned_addr learned my addr 172.21.15.26:0/489284999 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:24:59.706 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.702+0000 7f90d5477700 1 --2- 172.21.15.26:0/489284999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90d00f6ff0 0x7f90d0107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:24:59.706 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.702+0000 7f90d5c78700 1 -- 172.21.15.26:0/489284999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90d00f6ff0 msgr2=0x7f90d0107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:24:59.706 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.702+0000 7f90d5c78700 1 --2- 172.21.15.26:0/489284999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90d00f6ff0 0x7f90d0107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:24:59.706 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.702+0000 7f90d5c78700 1 -- 172.21.15.26:0/489284999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90cc005040 con 0x7f90d00f66e0 2021-11-03T17:24:59.707 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.702+0000 7f90d5c78700 1 --2- 172.21.15.26:0/489284999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90d00f66e0 0x7f90d0106f70 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f90c400c530 tx=0x7f90c4007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:24:59.707 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.702+0000 7f90c27fc700 1 -- 172.21.15.26:0/489284999 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90c400f650 con 0x7f90d00f66e0 2021-11-03T17:24:59.707 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.702+0000 7f90c27fc700 1 -- 172.21.15.26:0/489284999 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f90c400fc60 con 0x7f90d00f66e0 2021-11-03T17:24:59.708 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.702+0000 7f90d7edc700 1 -- 172.21.15.26:0/489284999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d01084f0 con 0x7f90d00f66e0 2021-11-03T17:24:59.708 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.702+0000 7f90c27fc700 1 -- 172.21.15.26:0/489284999 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90c4012c20 con 0x7f90d00f66e0 2021-11-03T17:24:59.708 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.702+0000 7f90d7edc700 1 -- 172.21.15.26:0/489284999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d0108ab0 con 0x7f90d00f66e0 2021-11-03T17:24:59.708 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.703+0000 7f90d7edc700 1 -- 172.21.15.26:0/489284999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90d0045ad0 con 0x7f90d00f66e0 2021-11-03T17:24:59.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.704+0000 7f90c27fc700 1 -- 172.21.15.26:0/489284999 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f90c4010070 con 0x7f90d00f66e0 2021-11-03T17:24:59.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.704+0000 7f90c27fc700 1 --2- 172.21.15.26:0/489284999 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f90bc0640b0 0x7f90bc066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:24:59.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.704+0000 7f90c27fc700 1 -- 172.21.15.26:0/489284999 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f90c4080660 con 0x7f90d00f66e0 2021-11-03T17:24:59.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.704+0000 7f90d5477700 1 --2- 172.21.15.26:0/489284999 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f90bc0640b0 0x7f90bc066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:24:59.710 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.704+0000 7f90d5477700 1 --2- 172.21.15.26:0/489284999 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f90bc0640b0 0x7f90bc066570 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f90cc004630 tx=0x7f90cc009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:24:59.710 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.708+0000 7f90c27fc700 1 -- 172.21.15.26:0/489284999 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f90c40528d0 con 0x7f90d00f66e0 2021-11-03T17:24:59.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:59 smithi194 ceph-mon[65619]: poll took 60064.351 ms: 1 events 2021-11-03T17:24:59.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:59 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:24:59.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:24:59 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:24:59.883 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.888+0000 7f90d7edc700 1 -- 172.21.15.26:0/489284999 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f90d00ff050 con 0x7f90bc0640b0 2021-11-03T17:24:59.884 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.889+0000 7f90c27fc700 1 -- 172.21.15.26:0/489284999 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f90d00ff050 con 0x7f90bc0640b0 2021-11-03T17:24:59.886 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.891+0000 7f90d7edc700 1 -- 172.21.15.26:0/489284999 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f90bc0640b0 msgr2=0x7f90bc066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:24:59.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.891+0000 7f90d7edc700 1 --2- 172.21.15.26:0/489284999 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f90bc0640b0 0x7f90bc066570 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f90cc004630 tx=0x7f90cc009b30).stop 2021-11-03T17:24:59.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.891+0000 7f90d7edc700 1 -- 172.21.15.26:0/489284999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90d00f66e0 msgr2=0x7f90d0106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:24:59.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.891+0000 7f90d7edc700 1 --2- 172.21.15.26:0/489284999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90d00f66e0 0x7f90d0106f70 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f90c400c530 tx=0x7f90c4007e20).stop 2021-11-03T17:24:59.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.891+0000 7f90d7edc700 1 -- 172.21.15.26:0/489284999 shutdown_connections 2021-11-03T17:24:59.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.891+0000 7f90d7edc700 1 --2- 172.21.15.26:0/489284999 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f90bc0640b0 0x7f90bc066570 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:24:59.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.891+0000 7f90d7edc700 1 --2- 172.21.15.26:0/489284999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90d00f66e0 0x7f90d0106f70 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:24:59.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.891+0000 7f90d7edc700 1 --2- 172.21.15.26:0/489284999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90d00f6ff0 0x7f90d0107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:24:59.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.891+0000 7f90d7edc700 1 -- 172.21.15.26:0/489284999 >> 172.21.15.26:0/489284999 conn(0x7f90d00f1f00 msgr2=0x7f90d00fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:24:59.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.891+0000 7f90d7edc700 1 -- 172.21.15.26:0/489284999 shutdown_connections 2021-11-03T17:24:59.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.891+0000 7f90d7edc700 1 -- 172.21.15.26:0/489284999 wait complete. 2021-11-03T17:24:59.896 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:24:59.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:59 smithi026 ceph-mon[96795]: poll took 60064.351 ms: 1 events 2021-11-03T17:24:59.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:59 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:24:59.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:24:59 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:24:59.989 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.991+0000 7f640597d700 1 -- 172.21.15.26:0/1463331354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64000f6530 msgr2=0x7f64000f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:24:59.989 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.991+0000 7f640597d700 1 --2- 172.21.15.26:0/1463331354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64000f6530 0x7f64000f6950 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f63f4004660 tx=0x7f63f4009b30).stop 2021-11-03T17:24:59.990 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.991+0000 7f640597d700 1 -- 172.21.15.26:0/1463331354 shutdown_connections 2021-11-03T17:24:59.990 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.991+0000 7f640597d700 1 --2- 172.21.15.26:0/1463331354 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64000f77d0 0x7f64000f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:24:59.991 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.991+0000 7f640597d700 1 --2- 172.21.15.26:0/1463331354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64000f6530 0x7f64000f6950 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:24:59.991 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.991+0000 7f640597d700 1 -- 172.21.15.26:0/1463331354 >> 172.21.15.26:0/1463331354 conn(0x7f64000f1c90 msgr2=0x7f64000f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:24:59.991 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.991+0000 7f640597d700 1 -- 172.21.15.26:0/1463331354 shutdown_connections 2021-11-03T17:24:59.991 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.991+0000 7f640597d700 1 -- 172.21.15.26:0/1463331354 wait complete. 2021-11-03T17:24:59.992 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.992+0000 7f640597d700 1 Processor -- start 2021-11-03T17:24:59.992 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.992+0000 7f640597d700 1 -- start start 2021-11-03T17:24:59.992 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.992+0000 7f640597d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64000f6530 0x7f6400106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:24:59.992 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.992+0000 7f640597d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64000f77d0 0x7f6400107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:24:59.993 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.992+0000 7f640597d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6400107880 con 0x7f64000f6530 2021-11-03T17:24:59.993 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.992+0000 7f640597d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6400108090 con 0x7f64000f77d0 2021-11-03T17:24:59.993 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.992+0000 7f640497b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64000f6530 0x7f6400106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:24:59.993 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.992+0000 7f640497b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64000f6530 0x7f6400106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54264/0 (socket says 172.21.15.26:54264) 2021-11-03T17:24:59.994 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.992+0000 7f640497b700 1 -- 172.21.15.26:0/3615572816 learned_addr learned my addr 172.21.15.26:0/3615572816 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:24:59.994 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.993+0000 7f63fffff700 1 --2- 172.21.15.26:0/3615572816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64000f77d0 0x7f6400107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:24:59.994 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.993+0000 7f640497b700 1 -- 172.21.15.26:0/3615572816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64000f77d0 msgr2=0x7f6400107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:24:59.994 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.993+0000 7f640497b700 1 --2- 172.21.15.26:0/3615572816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64000f77d0 0x7f6400107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:24:59.994 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.993+0000 7f640497b700 1 -- 172.21.15.26:0/3615572816 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f4005040 con 0x7f64000f6530 2021-11-03T17:24:59.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.993+0000 7f640497b700 1 --2- 172.21.15.26:0/3615572816 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64000f6530 0x7f6400106d90 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f63f4014040 tx=0x7f63f400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:24:59.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.993+0000 7f63fd7fa700 1 -- 172.21.15.26:0/3615572816 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63f4019070 con 0x7f64000f6530 2021-11-03T17:24:59.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.993+0000 7f640597d700 1 -- 172.21.15.26:0/3615572816 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64001082b0 con 0x7f64000f6530 2021-11-03T17:24:59.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.993+0000 7f63fd7fa700 1 -- 172.21.15.26:0/3615572816 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f63f4007e70 con 0x7f64000f6530 2021-11-03T17:24:59.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.993+0000 7f63fd7fa700 1 -- 172.21.15.26:0/3615572816 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63f4014d50 con 0x7f64000f6530 2021-11-03T17:24:59.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.993+0000 7f640597d700 1 -- 172.21.15.26:0/3615572816 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6400108810 con 0x7f64000f6530 2021-11-03T17:24:59.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.994+0000 7f640597d700 1 -- 172.21.15.26:0/3615572816 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6400059100 con 0x7f64000f6530 2021-11-03T17:24:59.997 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.994+0000 7f63fd7fa700 1 -- 172.21.15.26:0/3615572816 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f63f4025070 con 0x7f64000f6530 2021-11-03T17:24:59.998 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.995+0000 7f63fd7fa700 1 --2- 172.21.15.26:0/3615572816 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f63f0064100 0x7f63f00665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:24:59.998 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.995+0000 7f63fd7fa700 1 -- 172.21.15.26:0/3615572816 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f63f40817f0 con 0x7f64000f6530 2021-11-03T17:24:59.998 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.995+0000 7f63fffff700 1 --2- 172.21.15.26:0/3615572816 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f63f0064100 0x7f63f00665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:24:59.998 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.995+0000 7f63fffff700 1 --2- 172.21.15.26:0/3615572816 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f63f0064100 0x7f63f00665c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f63ec007f80 tx=0x7f63ec00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:24:59.999 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:24:59.999+0000 7f63fd7fa700 1 -- 172.21.15.26:0/3615572816 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f63f4053b50 con 0x7f64000f6530 2021-11-03T17:25:00.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.173+0000 7f640597d700 1 -- 172.21.15.26:0/3615572816 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f64000008d0 con 0x7f63f0064100 2021-11-03T17:25:00.183 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.188+0000 7f63fd7fa700 1 -- 172.21.15.26:0/3615572816 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f64000008d0 con 0x7f63f0064100 2021-11-03T17:25:00.184 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:25:00.184 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (36m) 6m ago 37m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:25:00.184 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (28m) 6m ago 37m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:25:00.185 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (28m) 5m ago 36m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:25:00.185 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (36m) 6m ago 37m 39.6M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:25:00.185 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (29m) 6m ago 32m 19.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:25:00.185 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (29m) 6m ago 32m 20.6M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:25:00.185 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (32m) 5m ago 32m 22.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:25:00.186 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (32m) 5m ago 32m 22.2M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:25:00.186 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (29m) 6m ago 38m 505M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:25:00.187 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (29m) 5m ago 36m 419M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:25:00.187 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (29m) 6m ago 38m 147M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:25:00.187 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (29m) 5m ago 36m 75.7M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:25:00.187 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (37m) 6m ago 37m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:25:00.188 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (36m) 5m ago 36m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:25:00.188 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (28m) 6m ago 35m 211M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:25:00.188 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (27m) 6m ago 35m 226M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:25:00.188 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (27m) 6m ago 35m 189M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:25:00.189 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (26m) 5m ago 34m 236M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:25:00.189 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (26m) 5m ago 34m 208M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:25:00.189 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (25m) 5m ago 34m 194M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:25:00.189 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (35m) 6m ago 36m 52.1M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:25:00.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.190+0000 7f640597d700 1 -- 172.21.15.26:0/3615572816 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f63f0064100 msgr2=0x7f63f00665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:25:00.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.190+0000 7f640597d700 1 --2- 172.21.15.26:0/3615572816 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f63f0064100 0x7f63f00665c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f63ec007f80 tx=0x7f63ec00b040).stop 2021-11-03T17:25:00.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.190+0000 7f640597d700 1 -- 172.21.15.26:0/3615572816 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64000f6530 msgr2=0x7f6400106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:25:00.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.190+0000 7f640597d700 1 --2- 172.21.15.26:0/3615572816 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64000f6530 0x7f6400106d90 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f63f4014040 tx=0x7f63f400b040).stop 2021-11-03T17:25:00.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.190+0000 7f640597d700 1 -- 172.21.15.26:0/3615572816 shutdown_connections 2021-11-03T17:25:00.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.190+0000 7f640597d700 1 --2- 172.21.15.26:0/3615572816 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f63f0064100 0x7f63f00665c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:25:00.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.190+0000 7f640597d700 1 --2- 172.21.15.26:0/3615572816 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64000f6530 0x7f6400106d90 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:25:00.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.190+0000 7f640597d700 1 --2- 172.21.15.26:0/3615572816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64000f77d0 0x7f6400107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:25:00.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.190+0000 7f640597d700 1 -- 172.21.15.26:0/3615572816 >> 172.21.15.26:0/3615572816 conn(0x7f64000f1c90 msgr2=0x7f64000fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:25:00.193 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.190+0000 7f640597d700 1 -- 172.21.15.26:0/3615572816 shutdown_connections 2021-11-03T17:25:00.193 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.190+0000 7f640597d700 1 -- 172.21.15.26:0/3615572816 wait complete. 2021-11-03T17:25:00.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.294+0000 7f6a0138a700 1 -- 172.21.15.26:0/844303030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69fc0603f0 msgr2=0x7f69fc0f9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:25:00.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.294+0000 7f6a0138a700 1 --2- 172.21.15.26:0/844303030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69fc0603f0 0x7f69fc0f9340 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f69ec004660 tx=0x7f69ec009b30).stop 2021-11-03T17:25:00.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.294+0000 7f6a0138a700 1 -- 172.21.15.26:0/844303030 shutdown_connections 2021-11-03T17:25:00.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.294+0000 7f6a0138a700 1 --2- 172.21.15.26:0/844303030 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69fc0f9830 0x7f69fc0fbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:25:00.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.294+0000 7f6a0138a700 1 --2- 172.21.15.26:0/844303030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69fc0603f0 0x7f69fc0f9340 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:25:00.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.294+0000 7f6a0138a700 1 -- 172.21.15.26:0/844303030 >> 172.21.15.26:0/844303030 conn(0x7f69fc0f0dc0 msgr2=0x7f69fc0f31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:25:00.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.294+0000 7f6a0138a700 1 -- 172.21.15.26:0/844303030 shutdown_connections 2021-11-03T17:25:00.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.294+0000 7f6a0138a700 1 -- 172.21.15.26:0/844303030 wait complete. 2021-11-03T17:25:00.294 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.295+0000 7f6a0138a700 1 Processor -- start 2021-11-03T17:25:00.294 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.295+0000 7f6a0138a700 1 -- start start 2021-11-03T17:25:00.294 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.295+0000 7f6a0138a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69fc0603f0 0x7f69fc106ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:25:00.294 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.295+0000 7f6a0138a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69fc0f9830 0x7f69fc1073d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:25:00.295 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.295+0000 7f6a0138a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc107a10 con 0x7f69fc0603f0 2021-11-03T17:25:00.295 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.295+0000 7f6a0138a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc1082c0 con 0x7f69fc0f9830 2021-11-03T17:25:00.295 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.295+0000 7f69faffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69fc0603f0 0x7f69fc106ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:25:00.295 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.295+0000 7f69faffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69fc0603f0 0x7f69fc106ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54274/0 (socket says 172.21.15.26:54274) 2021-11-03T17:25:00.296 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.295+0000 7f69faffd700 1 -- 172.21.15.26:0/3511609090 learned_addr learned my addr 172.21.15.26:0/3511609090 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:25:00.296 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.295+0000 7f69fa7fc700 1 --2- 172.21.15.26:0/3511609090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69fc0f9830 0x7f69fc1073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:25:00.296 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.295+0000 7f69faffd700 1 -- 172.21.15.26:0/3511609090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69fc0f9830 msgr2=0x7f69fc1073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:25:00.296 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.295+0000 7f69faffd700 1 --2- 172.21.15.26:0/3511609090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69fc0f9830 0x7f69fc1073d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:25:00.296 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.295+0000 7f69faffd700 1 -- 172.21.15.26:0/3511609090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69ec005040 con 0x7f69fc0603f0 2021-11-03T17:25:00.297 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.296+0000 7f69faffd700 1 --2- 172.21.15.26:0/3511609090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69fc0603f0 0x7f69fc106ee0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f69ec004f60 tx=0x7f69ec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:25:00.297 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.296+0000 7f69e37fe700 1 -- 172.21.15.26:0/3511609090 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69ec018070 con 0x7f69fc0603f0 2021-11-03T17:25:00.297 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.296+0000 7f69e37fe700 1 -- 172.21.15.26:0/3511609090 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f69ec007ba0 con 0x7f69fc0603f0 2021-11-03T17:25:00.297 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.296+0000 7f69e37fe700 1 -- 172.21.15.26:0/3511609090 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69ec01c620 con 0x7f69fc0603f0 2021-11-03T17:25:00.298 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.296+0000 7f6a0138a700 1 -- 172.21.15.26:0/3511609090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69fc108540 con 0x7f69fc0603f0 2021-11-03T17:25:00.298 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.296+0000 7f6a0138a700 1 -- 172.21.15.26:0/3511609090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69fc108aa0 con 0x7f69fc0603f0 2021-11-03T17:25:00.298 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.297+0000 7f6a0138a700 1 -- 172.21.15.26:0/3511609090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69fc0f4a50 con 0x7f69fc0603f0 2021-11-03T17:25:00.299 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.297+0000 7f69e37fe700 1 -- 172.21.15.26:0/3511609090 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f69ec01d420 con 0x7f69fc0603f0 2021-11-03T17:25:00.299 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.298+0000 7f69e37fe700 1 --2- 172.21.15.26:0/3511609090 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f69e40640b0 0x7f69e4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:25:00.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.298+0000 7f69e37fe700 1 -- 172.21.15.26:0/3511609090 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f69ec082610 con 0x7f69fc0603f0 2021-11-03T17:25:00.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.298+0000 7f69fa7fc700 1 --2- 172.21.15.26:0/3511609090 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f69e40640b0 0x7f69e4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:25:00.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.298+0000 7f69fa7fc700 1 --2- 172.21.15.26:0/3511609090 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f69e40640b0 0x7f69e4066570 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f69f000b790 tx=0x7f69f0008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:25:00.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.302+0000 7f69e37fe700 1 -- 172.21.15.26:0/3511609090 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f69ec054a30 con 0x7f69fc0603f0 2021-11-03T17:25:00.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.533+0000 7f6a0138a700 1 -- 172.21.15.26:0/3511609090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f69fc027a00 con 0x7f69fc0603f0 2021-11-03T17:25:00.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.533+0000 7f69e37fe700 1 -- 172.21.15.26:0/3511609090 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f69ec054620 con 0x7f69fc0603f0 2021-11-03T17:25:00.529 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:25:00.529 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:25:00.530 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:25:00.530 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:25:00.530 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:25:00.530 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:25:00.531 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:25:00.531 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:25:00.531 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:25:00.531 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:25:00.531 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:25:00.532 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:25:00.532 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:25:00.532 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:25:00.532 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:25:00.533 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:25:00.533 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:25:00.533 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:25:00.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.535+0000 7f6a0138a700 1 -- 172.21.15.26:0/3511609090 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f69e40640b0 msgr2=0x7f69e4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:25:00.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.535+0000 7f6a0138a700 1 --2- 172.21.15.26:0/3511609090 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f69e40640b0 0x7f69e4066570 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f69f000b790 tx=0x7f69f0008040).stop 2021-11-03T17:25:00.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.535+0000 7f6a0138a700 1 -- 172.21.15.26:0/3511609090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69fc0603f0 msgr2=0x7f69fc106ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:25:00.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.535+0000 7f6a0138a700 1 --2- 172.21.15.26:0/3511609090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69fc0603f0 0x7f69fc106ee0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f69ec004f60 tx=0x7f69ec009b30).stop 2021-11-03T17:25:00.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.535+0000 7f6a0138a700 1 -- 172.21.15.26:0/3511609090 shutdown_connections 2021-11-03T17:25:00.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.535+0000 7f6a0138a700 1 --2- 172.21.15.26:0/3511609090 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f69e40640b0 0x7f69e4066570 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:25:00.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.535+0000 7f6a0138a700 1 --2- 172.21.15.26:0/3511609090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69fc0603f0 0x7f69fc106ee0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:25:00.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.535+0000 7f6a0138a700 1 --2- 172.21.15.26:0/3511609090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69fc0f9830 0x7f69fc1073d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:25:00.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.535+0000 7f6a0138a700 1 -- 172.21.15.26:0/3511609090 >> 172.21.15.26:0/3511609090 conn(0x7f69fc0f0dc0 msgr2=0x7f69fc0f31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:25:00.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.536+0000 7f6a0138a700 1 -- 172.21.15.26:0/3511609090 shutdown_connections 2021-11-03T17:25:00.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.536+0000 7f6a0138a700 1 -- 172.21.15.26:0/3511609090 wait complete. 2021-11-03T17:25:00.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.636+0000 7f4a96e82700 1 -- 172.21.15.26:0/2035128237 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a900f6860 msgr2=0x7f4a900f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:25:00.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.636+0000 7f4a96e82700 1 --2- 172.21.15.26:0/2035128237 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a900f6860 0x7f4a900f6cc0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f4a7c004660 tx=0x7f4a7c009b30).stop 2021-11-03T17:25:00.634 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.636+0000 7f4a96e82700 1 -- 172.21.15.26:0/2035128237 shutdown_connections 2021-11-03T17:25:00.634 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.636+0000 7f4a96e82700 1 --2- 172.21.15.26:0/2035128237 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a900f6860 0x7f4a900f6cc0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:25:00.634 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.636+0000 7f4a96e82700 1 --2- 172.21.15.26:0/2035128237 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a900f55c0 0x7f4a900f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:25:00.635 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.636+0000 7f4a96e82700 1 -- 172.21.15.26:0/2035128237 >> 172.21.15.26:0/2035128237 conn(0x7f4a900f0d20 msgr2=0x7f4a900f3140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:25:00.635 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.636+0000 7f4a96e82700 1 -- 172.21.15.26:0/2035128237 shutdown_connections 2021-11-03T17:25:00.636 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.636+0000 7f4a96e82700 1 -- 172.21.15.26:0/2035128237 wait complete. 2021-11-03T17:25:00.636 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.636+0000 7f4a96e82700 1 Processor -- start 2021-11-03T17:25:00.636 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.636+0000 7f4a96e82700 1 -- start start 2021-11-03T17:25:00.636 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.637+0000 7f4a96e82700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a900f55c0 0x7f4a90105ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:25:00.637 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.637+0000 7f4a96e82700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a900f6860 0x7f4a901063c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:25:00.637 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.637+0000 7f4a96e82700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a90106970 con 0x7f4a900f6860 2021-11-03T17:25:00.637 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.637+0000 7f4a96e82700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a90107170 con 0x7f4a900f55c0 2021-11-03T17:25:00.637 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.637+0000 7f4a8ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a900f6860 0x7f4a901063c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:25:00.638 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.637+0000 7f4a8ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a900f6860 0x7f4a901063c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54286/0 (socket says 172.21.15.26:54286) 2021-11-03T17:25:00.638 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.637+0000 7f4a8ffff700 1 -- 172.21.15.26:0/2012960312 learned_addr learned my addr 172.21.15.26:0/2012960312 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:25:00.638 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.637+0000 7f4a8ffff700 1 -- 172.21.15.26:0/2012960312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a900f55c0 msgr2=0x7f4a90105ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:25:00.638 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.637+0000 7f4a94c1e700 1 --2- 172.21.15.26:0/2012960312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a900f55c0 0x7f4a90105ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:25:00.639 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.637+0000 7f4a8ffff700 1 --2- 172.21.15.26:0/2012960312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a900f55c0 0x7f4a90105ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:25:00.639 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.637+0000 7f4a8ffff700 1 -- 172.21.15.26:0/2012960312 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a7c005040 con 0x7f4a900f6860 2021-11-03T17:25:00.639 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.637+0000 7f4a94c1e700 1 --2- 172.21.15.26:0/2012960312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a900f55c0 0x7f4a90105ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:25:00.639 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.637+0000 7f4a8ffff700 1 --2- 172.21.15.26:0/2012960312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a900f6860 0x7f4a901063c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f4a7c009990 tx=0x7f4a7c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:25:00.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.637+0000 7f4a8d7fa700 1 -- 172.21.15.26:0/2012960312 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a7c018070 con 0x7f4a900f6860 2021-11-03T17:25:00.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.638+0000 7f4a96e82700 1 -- 172.21.15.26:0/2012960312 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a901073f0 con 0x7f4a900f6860 2021-11-03T17:25:00.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.638+0000 7f4a8d7fa700 1 -- 172.21.15.26:0/2012960312 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4a7c007ca0 con 0x7f4a900f6860 2021-11-03T17:25:00.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.638+0000 7f4a8d7fa700 1 -- 172.21.15.26:0/2012960312 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a7c01c620 con 0x7f4a900f6860 2021-11-03T17:25:00.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.638+0000 7f4a96e82700 1 -- 172.21.15.26:0/2012960312 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a90107950 con 0x7f4a900f6860 2021-11-03T17:25:00.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.639+0000 7f4a96e82700 1 -- 172.21.15.26:0/2012960312 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a900f49b0 con 0x7f4a900f6860 2021-11-03T17:25:00.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.639+0000 7f4a8d7fa700 1 -- 172.21.15.26:0/2012960312 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f4a7c01d960 con 0x7f4a900f6860 2021-11-03T17:25:00.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.639+0000 7f4a8d7fa700 1 --2- 172.21.15.26:0/2012960312 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4a800640b0 0x7f4a80066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:25:00.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.640+0000 7f4a8d7fa700 1 -- 172.21.15.26:0/2012960312 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f4a7c082520 con 0x7f4a900f6860 2021-11-03T17:25:00.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.640+0000 7f4a94c1e700 1 --2- 172.21.15.26:0/2012960312 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4a800640b0 0x7f4a80066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:25:00.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.640+0000 7f4a94c1e700 1 --2- 172.21.15.26:0/2012960312 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4a800640b0 0x7f4a80066570 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f4a900f66c0 tx=0x7f4a84009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:25:00.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.644+0000 7f4a8d7fa700 1 -- 172.21.15.26:0/2012960312 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f4a7c054940 con 0x7f4a900f6860 2021-11-03T17:25:00.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:00 smithi194 ceph-mon[65619]: pgmap v910: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:00.844 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.849+0000 7f4a96e82700 1 -- 172.21.15.26:0/2012960312 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4a900fdd80 con 0x7f4a900f6860 2021-11-03T17:25:00.845 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.849+0000 7f4a8d7fa700 1 -- 172.21.15.26:0/2012960312 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f4a7c054530 con 0x7f4a900f6860 2021-11-03T17:25:00.845 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:25:00.846 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:25:00.846 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:25:00.846 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:25:00.846 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:25:00.847 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:25:00.847 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:25:00.847 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:25:00.847 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:25:00.848 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:25:00.848 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:25:00.848 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:25:00.848 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:25:00.848 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:25:00.849 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:25:00.849 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:25:00.849 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:25:00.849 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:25:00.850 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:25:00.850 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:25:00.850 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:25:00.850 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:25:00.851 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:25:00.851 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:25:00.851 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:25:00.852 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:25:00.852 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:25:00.852 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:25:00.852 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:25:00.852 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:25:00.853 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:25:00.853 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:25:00.853 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:25:00.853 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:25:00.854 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:25:00.854 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:25:00.854 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:25:00.854 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:25:00.854 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:25:00.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.851+0000 7f4a96e82700 1 -- 172.21.15.26:0/2012960312 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4a800640b0 msgr2=0x7f4a80066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:25:00.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.851+0000 7f4a96e82700 1 --2- 172.21.15.26:0/2012960312 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4a800640b0 0x7f4a80066570 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f4a900f66c0 tx=0x7f4a84009040).stop 2021-11-03T17:25:00.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.851+0000 7f4a96e82700 1 -- 172.21.15.26:0/2012960312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a900f6860 msgr2=0x7f4a901063c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:25:00.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.851+0000 7f4a96e82700 1 --2- 172.21.15.26:0/2012960312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a900f6860 0x7f4a901063c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f4a7c009990 tx=0x7f4a7c009b30).stop 2021-11-03T17:25:00.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.851+0000 7f4a96e82700 1 -- 172.21.15.26:0/2012960312 shutdown_connections 2021-11-03T17:25:00.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.851+0000 7f4a96e82700 1 --2- 172.21.15.26:0/2012960312 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4a800640b0 0x7f4a80066570 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:25:00.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.851+0000 7f4a96e82700 1 --2- 172.21.15.26:0/2012960312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a900f55c0 0x7f4a90105ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:25:00.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.851+0000 7f4a96e82700 1 --2- 172.21.15.26:0/2012960312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a900f6860 0x7f4a901063c0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:25:00.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.851+0000 7f4a96e82700 1 -- 172.21.15.26:0/2012960312 >> 172.21.15.26:0/2012960312 conn(0x7f4a900f0d20 msgr2=0x7f4a900fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:25:00.858 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.852+0000 7f4a96e82700 1 -- 172.21.15.26:0/2012960312 shutdown_connections 2021-11-03T17:25:00.858 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:00.852+0000 7f4a96e82700 1 -- 172.21.15.26:0/2012960312 wait complete. 2021-11-03T17:25:00.858 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:25:00.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:00 smithi026 ceph-mon[96795]: pgmap v910: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:01.635 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:01 smithi194 ceph-mon[65619]: from='client.35084 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:25:01.636 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:01 smithi194 ceph-mon[65619]: from='client.35088 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:25:01.636 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:01 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3511609090' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:25:01.636 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:01 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2012960312' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:25:01.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:01 smithi026 ceph-mon[96795]: from='client.35084 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:25:01.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:01 smithi026 ceph-mon[96795]: from='client.35088 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:25:01.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:01 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3511609090' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:25:01.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:01 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2012960312' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:25:02.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:02 smithi194 ceph-mon[65619]: pgmap v911: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:02.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:02 smithi026 ceph-mon[96795]: pgmap v911: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:04.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:04 smithi194 ceph-mon[65619]: pgmap v912: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:04.914 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:04 smithi026 ceph-mon[96795]: pgmap v912: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:05.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:05 smithi194 ceph-mon[65619]: pgmap v913: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:05.760 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:05 smithi026 ceph-mon[96795]: pgmap v913: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:08.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:07 smithi026 ceph-mon[96795]: pgmap v914: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:08.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:07 smithi194 ceph-mon[65619]: pgmap v914: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:10.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:10 smithi026 ceph-mon[96795]: pgmap v915: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:10.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:10 smithi194 ceph-mon[65619]: pgmap v915: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:12.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:12 smithi026 ceph-mon[96795]: pgmap v916: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:12.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:12 smithi194 ceph-mon[65619]: pgmap v916: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:14.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:14 smithi026 ceph-mon[96795]: pgmap v917: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:14.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:14 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:25:14.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:14 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:25:14.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:14 smithi194 ceph-mon[65619]: pgmap v917: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:14.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:14 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:25:14.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:14 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:25:16.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:16 smithi026 ceph-mon[96795]: pgmap v918: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:16.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:16 smithi194 ceph-mon[65619]: pgmap v918: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:18.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:18 smithi026 ceph-mon[96795]: pgmap v919: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:18.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:18 smithi194 ceph-mon[65619]: pgmap v919: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:20.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:20 smithi026 ceph-mon[96795]: pgmap v920: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:20.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:20 smithi194 ceph-mon[65619]: pgmap v920: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:22.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:22 smithi026 ceph-mon[96795]: pgmap v921: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:22.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:22 smithi194 ceph-mon[65619]: pgmap v921: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:24.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:24 smithi026 ceph-mon[96795]: pgmap v922: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:24.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:24 smithi194 ceph-mon[65619]: pgmap v922: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:26.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:26 smithi026 ceph-mon[96795]: pgmap v923: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:26.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:26 smithi194 ceph-mon[65619]: pgmap v923: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:28.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:28 smithi026 ceph-mon[96795]: pgmap v924: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:28.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:28 smithi194 ceph-mon[65619]: pgmap v924: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:29.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:29 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:25:29.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:29 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:25:29.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:29 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:25:29.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:29 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:25:30.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:30 smithi026 ceph-mon[96795]: pgmap v925: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:30.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:30 smithi194 ceph-mon[65619]: pgmap v925: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:30.966 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:30.969+0000 7f663349e700 1 -- 172.21.15.26:0/1497686482 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f662c0f6be0 msgr2=0x7f662c0f7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:25:30.966 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:30.969+0000 7f663349e700 1 --2- 172.21.15.26:0/1497686482 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f662c0f6be0 0x7f662c0f7000 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f6628004660 tx=0x7f6628009b30).stop 2021-11-03T17:25:30.966 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:30.970+0000 7f663349e700 1 -- 172.21.15.26:0/1497686482 shutdown_connections 2021-11-03T17:25:30.967 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:30.970+0000 7f663349e700 1 --2- 172.21.15.26:0/1497686482 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f662c0f7580 0x7f662c0f59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:25:30.967 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:30.970+0000 7f663349e700 1 --2- 172.21.15.26:0/1497686482 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f662c0f6be0 0x7f662c0f7000 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:25:30.967 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:30.970+0000 7f663349e700 1 -- 172.21.15.26:0/1497686482 >> 172.21.15.26:0/1497686482 conn(0x7f662c0f04c0 msgr2=0x7f662c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:25:30.967 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:30.970+0000 7f663349e700 1 -- 172.21.15.26:0/1497686482 shutdown_connections 2021-11-03T17:25:30.968 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:30.970+0000 7f663349e700 1 -- 172.21.15.26:0/1497686482 wait complete. 2021-11-03T17:25:30.968 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:30.970+0000 7f663349e700 1 Processor -- start 2021-11-03T17:25:30.969 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:30.970+0000 7f663349e700 1 -- start start 2021-11-03T17:25:30.969 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:30.971+0000 7f663349e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f662c0f6be0 0x7f662c109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:25:30.970 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:30.971+0000 7f663349e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f662c0f7580 0x7f662c10c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:25:30.970 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:30.971+0000 7f663349e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662c0f5680 con 0x7f662c0f6be0 2021-11-03T17:25:30.970 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:30.971+0000 7f663349e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662c0f57c0 con 0x7f662c0f7580 2021-11-03T17:25:30.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:30.971+0000 7f663123a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f662c0f6be0 0x7f662c109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:25:30.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:30.971+0000 7f663123a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f662c0f6be0 0x7f662c109cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54302/0 (socket says 172.21.15.26:54302) 2021-11-03T17:25:30.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:30.971+0000 7f663123a700 1 -- 172.21.15.26:0/526399566 learned_addr learned my addr 172.21.15.26:0/526399566 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:25:30.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:30.971+0000 7f6630a39700 1 --2- 172.21.15.26:0/526399566 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f662c0f7580 0x7f662c10c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:25:30.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:30.971+0000 7f663123a700 1 -- 172.21.15.26:0/526399566 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f662c0f7580 msgr2=0x7f662c10c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:25:30.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:30.971+0000 7f663123a700 1 --2- 172.21.15.26:0/526399566 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f662c0f7580 0x7f662c10c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:25:30.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:30.971+0000 7f663123a700 1 -- 172.21.15.26:0/526399566 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6628005040 con 0x7f662c0f6be0 2021-11-03T17:25:30.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:30.971+0000 7f6630a39700 1 --2- 172.21.15.26:0/526399566 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f662c0f7580 0x7f662c10c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:25:30.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:30.971+0000 7f663123a700 1 --2- 172.21.15.26:0/526399566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f662c0f6be0 0x7f662c109cb0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f6628013a70 tx=0x7f6628009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:25:30.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:30.971+0000 7f6621ffb700 1 -- 172.21.15.26:0/526399566 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6628018070 con 0x7f662c0f6be0 2021-11-03T17:25:30.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:30.971+0000 7f6621ffb700 1 -- 172.21.15.26:0/526399566 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f66280097d0 con 0x7f662c0f6be0 2021-11-03T17:25:30.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:30.971+0000 7f663349e700 1 -- 172.21.15.26:0/526399566 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f662c10c700 con 0x7f662c0f6be0 2021-11-03T17:25:30.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:30.971+0000 7f6621ffb700 1 -- 172.21.15.26:0/526399566 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f662801c3c0 con 0x7f662c0f6be0 2021-11-03T17:25:30.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:30.972+0000 7f663349e700 1 -- 172.21.15.26:0/526399566 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f662c10cc60 con 0x7f662c0f6be0 2021-11-03T17:25:30.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:30.973+0000 7f663349e700 1 -- 172.21.15.26:0/526399566 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f662c045ad0 con 0x7f662c0f6be0 2021-11-03T17:25:30.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:30.973+0000 7f6621ffb700 1 -- 172.21.15.26:0/526399566 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f6628007ba0 con 0x7f662c0f6be0 2021-11-03T17:25:30.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:30.973+0000 7f6621ffb700 1 --2- 172.21.15.26:0/526399566 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f66180640b0 0x7f6618066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:25:30.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:30.974+0000 7f6621ffb700 1 -- 172.21.15.26:0/526399566 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f66280823a0 con 0x7f662c0f6be0 2021-11-03T17:25:30.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:30.974+0000 7f6630a39700 1 --2- 172.21.15.26:0/526399566 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f66180640b0 0x7f6618066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:25:30.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:30.974+0000 7f6630a39700 1 --2- 172.21.15.26:0/526399566 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f66180640b0 0x7f6618066570 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f661c009fd0 tx=0x7f661c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:25:30.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:30.978+0000 7f6621ffb700 1 -- 172.21.15.26:0/526399566 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f66280547c0 con 0x7f662c0f6be0 2021-11-03T17:25:31.150 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.156+0000 7f663349e700 1 -- 172.21.15.26:0/526399566 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f662c0fdf10 con 0x7f66180640b0 2021-11-03T17:25:31.151 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.158+0000 7f6621ffb700 1 -- 172.21.15.26:0/526399566 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f662c0fdf10 con 0x7f66180640b0 2021-11-03T17:25:31.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.159+0000 7f663349e700 1 -- 172.21.15.26:0/526399566 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f66180640b0 msgr2=0x7f6618066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:25:31.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.159+0000 7f663349e700 1 --2- 172.21.15.26:0/526399566 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f66180640b0 0x7f6618066570 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f661c009fd0 tx=0x7f661c00b040).stop 2021-11-03T17:25:31.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.159+0000 7f663349e700 1 -- 172.21.15.26:0/526399566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f662c0f6be0 msgr2=0x7f662c109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:25:31.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.159+0000 7f663349e700 1 --2- 172.21.15.26:0/526399566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f662c0f6be0 0x7f662c109cb0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f6628013a70 tx=0x7f6628009b30).stop 2021-11-03T17:25:31.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.159+0000 7f663349e700 1 -- 172.21.15.26:0/526399566 shutdown_connections 2021-11-03T17:25:31.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.159+0000 7f663349e700 1 --2- 172.21.15.26:0/526399566 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f66180640b0 0x7f6618066570 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:25:31.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.159+0000 7f663349e700 1 --2- 172.21.15.26:0/526399566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f662c0f6be0 0x7f662c109cb0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:25:31.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.159+0000 7f663349e700 1 --2- 172.21.15.26:0/526399566 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f662c0f7580 0x7f662c10c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:25:31.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.159+0000 7f663349e700 1 -- 172.21.15.26:0/526399566 >> 172.21.15.26:0/526399566 conn(0x7f662c0f04c0 msgr2=0x7f662c0fa430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:25:31.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.160+0000 7f663349e700 1 -- 172.21.15.26:0/526399566 shutdown_connections 2021-11-03T17:25:31.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.160+0000 7f663349e700 1 -- 172.21.15.26:0/526399566 wait complete. 2021-11-03T17:25:31.163 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:25:31.254 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.259+0000 7f0579932700 1 -- 172.21.15.26:0/3532356044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05740f4800 msgr2=0x7f05740f4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:25:31.254 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.259+0000 7f0579932700 1 --2- 172.21.15.26:0/3532356044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05740f4800 0x7f05740f4c20 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f0568004660 tx=0x7f0568009b30).stop 2021-11-03T17:25:31.254 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.259+0000 7f0579932700 1 -- 172.21.15.26:0/3532356044 shutdown_connections 2021-11-03T17:25:31.255 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.259+0000 7f0579932700 1 --2- 172.21.15.26:0/3532356044 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05740f51a0 0x7f05740f7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:25:31.255 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.259+0000 7f0579932700 1 --2- 172.21.15.26:0/3532356044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05740f4800 0x7f05740f4c20 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:25:31.255 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.259+0000 7f0579932700 1 -- 172.21.15.26:0/3532356044 >> 172.21.15.26:0/3532356044 conn(0x7f05740f0320 msgr2=0x7f05740f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:25:31.255 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.259+0000 7f0579932700 1 -- 172.21.15.26:0/3532356044 shutdown_connections 2021-11-03T17:25:31.255 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.259+0000 7f0579932700 1 -- 172.21.15.26:0/3532356044 wait complete. 2021-11-03T17:25:31.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.260+0000 7f0579932700 1 Processor -- start 2021-11-03T17:25:31.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.260+0000 7f0579932700 1 -- start start 2021-11-03T17:25:31.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.260+0000 7f0579932700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05740f4800 0x7f05740f73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:25:31.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.260+0000 7f0579932700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05740f51a0 0x7f05740f5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:25:31.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.260+0000 7f0579932700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05740f5e20 con 0x7f05740f4800 2021-11-03T17:25:31.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.260+0000 7f0579932700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05740f5f60 con 0x7f05740f51a0 2021-11-03T17:25:31.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.260+0000 7f0578930700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05740f4800 0x7f05740f73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:25:31.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.260+0000 7f0578930700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05740f4800 0x7f05740f73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54312/0 (socket says 172.21.15.26:54312) 2021-11-03T17:25:31.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.260+0000 7f0578930700 1 -- 172.21.15.26:0/3054869424 learned_addr learned my addr 172.21.15.26:0/3054869424 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:25:31.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.261+0000 7f0578930700 1 -- 172.21.15.26:0/3054869424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05740f51a0 msgr2=0x7f05740f5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:25:31.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.261+0000 7f0573fff700 1 --2- 172.21.15.26:0/3054869424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05740f51a0 0x7f05740f5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:25:31.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.261+0000 7f0578930700 1 --2- 172.21.15.26:0/3054869424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05740f51a0 0x7f05740f5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:25:31.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.261+0000 7f0578930700 1 -- 172.21.15.26:0/3054869424 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0568005040 con 0x7f05740f4800 2021-11-03T17:25:31.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.261+0000 7f0573fff700 1 --2- 172.21.15.26:0/3054869424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05740f51a0 0x7f05740f5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:25:31.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.261+0000 7f0578930700 1 --2- 172.21.15.26:0/3054869424 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05740f4800 0x7f05740f73b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f0568004f60 tx=0x7f0568009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:25:31.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.261+0000 7f05717fa700 1 -- 172.21.15.26:0/3054869424 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0568018070 con 0x7f05740f4800 2021-11-03T17:25:31.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.261+0000 7f05717fa700 1 -- 172.21.15.26:0/3054869424 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0568007ba0 con 0x7f05740f4800 2021-11-03T17:25:31.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.261+0000 7f0579932700 1 -- 172.21.15.26:0/3054869424 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05740f61e0 con 0x7f05740f4800 2021-11-03T17:25:31.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.261+0000 7f05717fa700 1 -- 172.21.15.26:0/3054869424 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f056801c620 con 0x7f05740f4800 2021-11-03T17:25:31.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.261+0000 7f0579932700 1 -- 172.21.15.26:0/3054869424 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f057410ee10 con 0x7f05740f4800 2021-11-03T17:25:31.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.262+0000 7f0579932700 1 -- 172.21.15.26:0/3054869424 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0574045ad0 con 0x7f05740f4800 2021-11-03T17:25:31.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.262+0000 7f05717fa700 1 -- 172.21.15.26:0/3054869424 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f056801c8e0 con 0x7f05740f4800 2021-11-03T17:25:31.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.263+0000 7f05717fa700 1 --2- 172.21.15.26:0/3054869424 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0564064100 0x7f05640665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:25:31.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.263+0000 7f05717fa700 1 -- 172.21.15.26:0/3054869424 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f05680826c0 con 0x7f05740f4800 2021-11-03T17:25:31.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.263+0000 7f0573fff700 1 --2- 172.21.15.26:0/3054869424 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0564064100 0x7f05640665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:25:31.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.263+0000 7f0573fff700 1 --2- 172.21.15.26:0/3054869424 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0564064100 0x7f05640665c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f05740f55e0 tx=0x7f0560008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:25:31.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.267+0000 7f05717fa700 1 -- 172.21.15.26:0/3054869424 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f0568054a20 con 0x7f05740f4800 2021-11-03T17:25:31.434 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.439+0000 7f0579932700 1 -- 172.21.15.26:0/3054869424 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f05740fef00 con 0x7f0564064100 2021-11-03T17:25:31.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.454+0000 7f05717fa700 1 -- 172.21.15.26:0/3054869424 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f05740fef00 con 0x7f0564064100 2021-11-03T17:25:31.448 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:25:31.449 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (36m) 6m ago 38m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:25:31.449 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (28m) 6m ago 37m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:25:31.449 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (28m) 5m ago 37m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:25:31.449 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (36m) 6m ago 37m 39.6M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:25:31.450 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (29m) 6m ago 33m 19.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:25:31.450 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (30m) 6m ago 33m 20.6M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:25:31.450 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (33m) 5m ago 33m 22.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:25:31.450 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (33m) 5m ago 33m 22.2M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:25:31.451 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (30m) 6m ago 39m 505M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:25:31.451 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (30m) 5m ago 37m 419M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:25:31.451 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (29m) 6m ago 39m 147M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:25:31.451 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (29m) 5m ago 37m 75.7M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:25:31.452 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (37m) 6m ago 37m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:25:31.452 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (36m) 5m ago 36m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:25:31.452 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (28m) 6m ago 36m 211M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:25:31.452 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (28m) 6m ago 36m 226M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:25:31.452 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (27m) 6m ago 35m 189M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:25:31.453 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (27m) 5m ago 35m 236M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:25:31.453 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (26m) 5m ago 35m 208M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:25:31.453 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (26m) 5m ago 34m 194M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:25:31.453 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (36m) 6m ago 37m 52.1M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:25:31.454 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.456+0000 7f0579932700 1 -- 172.21.15.26:0/3054869424 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0564064100 msgr2=0x7f05640665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:25:31.455 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.456+0000 7f0579932700 1 --2- 172.21.15.26:0/3054869424 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0564064100 0x7f05640665c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f05740f55e0 tx=0x7f0560008040).stop 2021-11-03T17:25:31.455 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.456+0000 7f0579932700 1 -- 172.21.15.26:0/3054869424 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05740f4800 msgr2=0x7f05740f73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:25:31.455 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.456+0000 7f0579932700 1 --2- 172.21.15.26:0/3054869424 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05740f4800 0x7f05740f73b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f0568004f60 tx=0x7f0568009b30).stop 2021-11-03T17:25:31.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.456+0000 7f0579932700 1 -- 172.21.15.26:0/3054869424 shutdown_connections 2021-11-03T17:25:31.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.456+0000 7f0579932700 1 --2- 172.21.15.26:0/3054869424 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0564064100 0x7f05640665c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:25:31.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.456+0000 7f0579932700 1 --2- 172.21.15.26:0/3054869424 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05740f4800 0x7f05740f73b0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:25:31.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.456+0000 7f0579932700 1 --2- 172.21.15.26:0/3054869424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05740f51a0 0x7f05740f5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:25:31.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.456+0000 7f0579932700 1 -- 172.21.15.26:0/3054869424 >> 172.21.15.26:0/3054869424 conn(0x7f05740f0320 msgr2=0x7f05740fb370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:25:31.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.456+0000 7f0579932700 1 -- 172.21.15.26:0/3054869424 shutdown_connections 2021-11-03T17:25:31.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.456+0000 7f0579932700 1 -- 172.21.15.26:0/3054869424 wait complete. 2021-11-03T17:25:31.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.555+0000 7f3b6c274700 1 -- 172.21.15.26:0/2863660291 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b640f55c0 msgr2=0x7f3b640f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:25:31.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.555+0000 7f3b6c274700 1 --2- 172.21.15.26:0/2863660291 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b640f55c0 0x7f3b640f59e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f3b5c004660 tx=0x7f3b5c009b30).stop 2021-11-03T17:25:31.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.555+0000 7f3b6c274700 1 -- 172.21.15.26:0/2863660291 shutdown_connections 2021-11-03T17:25:31.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.555+0000 7f3b6c274700 1 --2- 172.21.15.26:0/2863660291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b640f6860 0x7f3b640f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:25:31.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.555+0000 7f3b6c274700 1 --2- 172.21.15.26:0/2863660291 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b640f55c0 0x7f3b640f59e0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:25:31.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.555+0000 7f3b6c274700 1 -- 172.21.15.26:0/2863660291 >> 172.21.15.26:0/2863660291 conn(0x7f3b640f0d40 msgr2=0x7f3b640f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:25:31.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.555+0000 7f3b6c274700 1 -- 172.21.15.26:0/2863660291 shutdown_connections 2021-11-03T17:25:31.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.555+0000 7f3b6c274700 1 -- 172.21.15.26:0/2863660291 wait complete. 2021-11-03T17:25:31.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.555+0000 7f3b6c274700 1 Processor -- start 2021-11-03T17:25:31.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.556+0000 7f3b6c274700 1 -- start start 2021-11-03T17:25:31.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.556+0000 7f3b6c274700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b640f55c0 0x7f3b64109160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:25:31.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.556+0000 7f3b6c274700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b640f6860 0x7f3b64109650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:25:31.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.556+0000 7f3b6c274700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b64109c00 con 0x7f3b640f6860 2021-11-03T17:25:31.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.556+0000 7f3b6c274700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b64109d40 con 0x7f3b640f55c0 2021-11-03T17:25:31.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.556+0000 7f3b6980f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b640f6860 0x7f3b64109650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:25:31.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.556+0000 7f3b6980f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b640f6860 0x7f3b64109650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54324/0 (socket says 172.21.15.26:54324) 2021-11-03T17:25:31.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.556+0000 7f3b6980f700 1 -- 172.21.15.26:0/557708172 learned_addr learned my addr 172.21.15.26:0/557708172 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:25:31.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.556+0000 7f3b6a010700 1 --2- 172.21.15.26:0/557708172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b640f55c0 0x7f3b64109160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:25:31.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.556+0000 7f3b6980f700 1 -- 172.21.15.26:0/557708172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b640f55c0 msgr2=0x7f3b64109160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:25:31.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.556+0000 7f3b6980f700 1 --2- 172.21.15.26:0/557708172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b640f55c0 0x7f3b64109160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:25:31.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.556+0000 7f3b6980f700 1 -- 172.21.15.26:0/557708172 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b5c005040 con 0x7f3b640f6860 2021-11-03T17:25:31.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.556+0000 7f3b6a010700 1 --2- 172.21.15.26:0/557708172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b640f55c0 0x7f3b64109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:25:31.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.556+0000 7f3b6980f700 1 --2- 172.21.15.26:0/557708172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b640f6860 0x7f3b64109650 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7f3b580026d0 tx=0x7f3b58009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:25:31.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.556+0000 7f3b62ffd700 1 -- 172.21.15.26:0/557708172 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b58009320 con 0x7f3b640f6860 2021-11-03T17:25:31.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.556+0000 7f3b62ffd700 1 -- 172.21.15.26:0/557708172 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3b5800f040 con 0x7f3b640f6860 2021-11-03T17:25:31.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.556+0000 7f3b62ffd700 1 -- 172.21.15.26:0/557708172 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b580147e0 con 0x7f3b640f6860 2021-11-03T17:25:31.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.556+0000 7f3b6c274700 1 -- 172.21.15.26:0/557708172 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b6410a6e0 con 0x7f3b640f6860 2021-11-03T17:25:31.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.557+0000 7f3b6c274700 1 -- 172.21.15.26:0/557708172 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b6410aca0 con 0x7f3b640f6860 2021-11-03T17:25:31.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.557+0000 7f3b6c274700 1 -- 172.21.15.26:0/557708172 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b64045ad0 con 0x7f3b640f6860 2021-11-03T17:25:31.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.558+0000 7f3b62ffd700 1 -- 172.21.15.26:0/557708172 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f3b58009480 con 0x7f3b640f6860 2021-11-03T17:25:31.562 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.558+0000 7f3b62ffd700 1 --2- 172.21.15.26:0/557708172 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3b4c0640b0 0x7f3b4c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:25:31.562 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.559+0000 7f3b62ffd700 1 -- 172.21.15.26:0/557708172 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f3b580811a0 con 0x7f3b640f6860 2021-11-03T17:25:31.562 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.559+0000 7f3b6a010700 1 --2- 172.21.15.26:0/557708172 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3b4c0640b0 0x7f3b4c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:25:31.562 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.559+0000 7f3b6a010700 1 --2- 172.21.15.26:0/557708172 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3b4c0640b0 0x7f3b4c066570 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f3b5c009da0 tx=0x7f3b5c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:25:31.563 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.562+0000 7f3b62ffd700 1 -- 172.21.15.26:0/557708172 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f3b580534c0 con 0x7f3b640f6860 2021-11-03T17:25:31.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.790+0000 7f3b6c274700 1 -- 172.21.15.26:0/557708172 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3b6410f780 con 0x7f3b640f6860 2021-11-03T17:25:31.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.791+0000 7f3b62ffd700 1 -- 172.21.15.26:0/557708172 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f3b580530b0 con 0x7f3b640f6860 2021-11-03T17:25:31.786 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:25:31.786 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:25:31.786 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:25:31.786 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:25:31.786 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:25:31.787 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:25:31.787 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:25:31.787 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:25:31.787 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:25:31.788 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:25:31.788 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:25:31.788 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:25:31.788 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:25:31.788 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:25:31.789 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:25:31.789 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:25:31.789 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:25:31.789 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:25:31.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.793+0000 7f3b6c274700 1 -- 172.21.15.26:0/557708172 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3b4c0640b0 msgr2=0x7f3b4c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:25:31.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.793+0000 7f3b6c274700 1 --2- 172.21.15.26:0/557708172 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3b4c0640b0 0x7f3b4c066570 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f3b5c009da0 tx=0x7f3b5c009b30).stop 2021-11-03T17:25:31.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.793+0000 7f3b6c274700 1 -- 172.21.15.26:0/557708172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b640f6860 msgr2=0x7f3b64109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:25:31.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.793+0000 7f3b6c274700 1 --2- 172.21.15.26:0/557708172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b640f6860 0x7f3b64109650 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7f3b580026d0 tx=0x7f3b58009de0).stop 2021-11-03T17:25:31.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.793+0000 7f3b6c274700 1 -- 172.21.15.26:0/557708172 shutdown_connections 2021-11-03T17:25:31.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.793+0000 7f3b6c274700 1 --2- 172.21.15.26:0/557708172 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3b4c0640b0 0x7f3b4c066570 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:25:31.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.793+0000 7f3b6c274700 1 --2- 172.21.15.26:0/557708172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b640f55c0 0x7f3b64109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:25:31.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.793+0000 7f3b6c274700 1 --2- 172.21.15.26:0/557708172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b640f6860 0x7f3b64109650 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:25:31.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.793+0000 7f3b6c274700 1 -- 172.21.15.26:0/557708172 >> 172.21.15.26:0/557708172 conn(0x7f3b640f0d40 msgr2=0x7f3b640f2cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:25:31.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.793+0000 7f3b6c274700 1 -- 172.21.15.26:0/557708172 shutdown_connections 2021-11-03T17:25:31.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.793+0000 7f3b6c274700 1 -- 172.21.15.26:0/557708172 wait complete. 2021-11-03T17:25:31.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.893+0000 7f1c6f136700 1 -- 172.21.15.26:0/2997031099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c680f66e0 msgr2=0x7f1c680f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:25:31.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.893+0000 7f1c6f136700 1 --2- 172.21.15.26:0/2997031099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c680f66e0 0x7f1c680f6b00 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f1c5c004660 tx=0x7f1c5c009b30).stop 2021-11-03T17:25:31.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.893+0000 7f1c6f136700 1 -- 172.21.15.26:0/2997031099 shutdown_connections 2021-11-03T17:25:31.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.893+0000 7f1c6f136700 1 --2- 172.21.15.26:0/2997031099 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c680f6ff0 0x7f1c680f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:25:31.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.893+0000 7f1c6f136700 1 --2- 172.21.15.26:0/2997031099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c680f66e0 0x7f1c680f6b00 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:25:31.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.893+0000 7f1c6f136700 1 -- 172.21.15.26:0/2997031099 >> 172.21.15.26:0/2997031099 conn(0x7f1c680f1f00 msgr2=0x7f1c680f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:25:31.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.893+0000 7f1c6f136700 1 -- 172.21.15.26:0/2997031099 shutdown_connections 2021-11-03T17:25:31.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.893+0000 7f1c6f136700 1 -- 172.21.15.26:0/2997031099 wait complete. 2021-11-03T17:25:31.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.893+0000 7f1c6f136700 1 Processor -- start 2021-11-03T17:25:31.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.893+0000 7f1c6f136700 1 -- start start 2021-11-03T17:25:31.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.894+0000 7f1c6f136700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c680f66e0 0x7f1c68106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:25:31.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.894+0000 7f1c6f136700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c680f6ff0 0x7f1c68107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:25:31.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.894+0000 7f1c6f136700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c68107ab0 con 0x7f1c680f66e0 2021-11-03T17:25:31.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.894+0000 7f1c6f136700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c68108360 con 0x7f1c680f6ff0 2021-11-03T17:25:31.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.894+0000 7f1c6ced2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c680f66e0 0x7f1c68106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:25:31.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.894+0000 7f1c6ced2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c680f66e0 0x7f1c68106f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54332/0 (socket says 172.21.15.26:54332) 2021-11-03T17:25:31.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.894+0000 7f1c6ced2700 1 -- 172.21.15.26:0/2359535571 learned_addr learned my addr 172.21.15.26:0/2359535571 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:25:31.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.894+0000 7f1c6ced2700 1 -- 172.21.15.26:0/2359535571 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c680f6ff0 msgr2=0x7f1c68107470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:25:31.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.894+0000 7f1c67fff700 1 --2- 172.21.15.26:0/2359535571 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c680f6ff0 0x7f1c68107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:25:31.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.894+0000 7f1c6ced2700 1 --2- 172.21.15.26:0/2359535571 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c680f6ff0 0x7f1c68107470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:25:31.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.894+0000 7f1c6ced2700 1 -- 172.21.15.26:0/2359535571 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c5c005040 con 0x7f1c680f66e0 2021-11-03T17:25:31.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.894+0000 7f1c67fff700 1 --2- 172.21.15.26:0/2359535571 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c680f6ff0 0x7f1c68107470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:25:31.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.894+0000 7f1c6ced2700 1 --2- 172.21.15.26:0/2359535571 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c680f66e0 0x7f1c68106f80 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f1c5c009990 tx=0x7f1c5c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:25:31.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.894+0000 7f1c657fa700 1 -- 172.21.15.26:0/2359535571 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c5c018070 con 0x7f1c680f66e0 2021-11-03T17:25:31.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.894+0000 7f1c6f136700 1 -- 172.21.15.26:0/2359535571 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c681085e0 con 0x7f1c680f66e0 2021-11-03T17:25:31.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.894+0000 7f1c657fa700 1 -- 172.21.15.26:0/2359535571 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1c5c007ca0 con 0x7f1c680f66e0 2021-11-03T17:25:31.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.894+0000 7f1c657fa700 1 -- 172.21.15.26:0/2359535571 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c5c01c620 con 0x7f1c680f66e0 2021-11-03T17:25:31.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.895+0000 7f1c6f136700 1 -- 172.21.15.26:0/2359535571 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c68108b40 con 0x7f1c680f66e0 2021-11-03T17:25:31.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.895+0000 7f1c6f136700 1 -- 172.21.15.26:0/2359535571 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c680f5b70 con 0x7f1c680f66e0 2021-11-03T17:25:31.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.896+0000 7f1c657fa700 1 -- 172.21.15.26:0/2359535571 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f1c5c01d960 con 0x7f1c680f66e0 2021-11-03T17:25:31.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.896+0000 7f1c657fa700 1 --2- 172.21.15.26:0/2359535571 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1c580640b0 0x7f1c58066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:25:31.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.896+0000 7f1c657fa700 1 -- 172.21.15.26:0/2359535571 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f1c5c082540 con 0x7f1c680f66e0 2021-11-03T17:25:31.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.896+0000 7f1c67fff700 1 --2- 172.21.15.26:0/2359535571 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1c580640b0 0x7f1c58066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:25:31.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.897+0000 7f1c67fff700 1 --2- 172.21.15.26:0/2359535571 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1c580640b0 0x7f1c58066570 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f1c5400a7e0 tx=0x7f1c54008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:25:31.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:31.901+0000 7f1c657fa700 1 -- 172.21.15.26:0/2359535571 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f1c5c054960 con 0x7f1c680f66e0 2021-11-03T17:25:32.100 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:32.106+0000 7f1c6f136700 1 -- 172.21.15.26:0/2359535571 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1c680008d0 con 0x7f1c680f66e0 2021-11-03T17:25:32.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:32.106+0000 7f1c657fa700 1 -- 172.21.15.26:0/2359535571 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f1c5c054550 con 0x7f1c680f66e0 2021-11-03T17:25:32.101 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:25:32.101 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:25:32.102 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:25:32.102 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:25:32.102 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:25:32.102 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:25:32.103 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:25:32.103 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:25:32.103 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:25:32.103 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:25:32.103 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:25:32.104 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:25:32.104 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:25:32.104 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:25:32.104 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:25:32.105 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:25:32.105 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:25:32.105 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:25:32.105 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:25:32.105 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:25:32.106 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:25:32.106 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:25:32.106 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:25:32.106 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:25:32.107 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:25:32.107 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:25:32.107 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:25:32.107 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:25:32.108 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:25:32.108 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:25:32.108 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:25:32.108 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:25:32.108 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:25:32.109 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:25:32.109 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:25:32.109 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:25:32.109 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:25:32.110 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:25:32.110 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:25:32.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:32.108+0000 7f1c6f136700 1 -- 172.21.15.26:0/2359535571 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1c580640b0 msgr2=0x7f1c58066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:25:32.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:32.108+0000 7f1c6f136700 1 --2- 172.21.15.26:0/2359535571 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1c580640b0 0x7f1c58066570 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f1c5400a7e0 tx=0x7f1c54008040).stop 2021-11-03T17:25:32.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:32.108+0000 7f1c6f136700 1 -- 172.21.15.26:0/2359535571 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c680f66e0 msgr2=0x7f1c68106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:25:32.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:32.108+0000 7f1c6f136700 1 --2- 172.21.15.26:0/2359535571 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c680f66e0 0x7f1c68106f80 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f1c5c009990 tx=0x7f1c5c009b30).stop 2021-11-03T17:25:32.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:32.108+0000 7f1c6f136700 1 -- 172.21.15.26:0/2359535571 shutdown_connections 2021-11-03T17:25:32.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:32.108+0000 7f1c6f136700 1 --2- 172.21.15.26:0/2359535571 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1c580640b0 0x7f1c58066570 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:25:32.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:32.108+0000 7f1c6f136700 1 --2- 172.21.15.26:0/2359535571 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c680f66e0 0x7f1c68106f80 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:25:32.113 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:32.108+0000 7f1c6f136700 1 --2- 172.21.15.26:0/2359535571 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c680f6ff0 0x7f1c68107470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:25:32.113 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:32.108+0000 7f1c6f136700 1 -- 172.21.15.26:0/2359535571 >> 172.21.15.26:0/2359535571 conn(0x7f1c680f1f00 msgr2=0x7f1c680fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:25:32.113 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:32.108+0000 7f1c6f136700 1 -- 172.21.15.26:0/2359535571 shutdown_connections 2021-11-03T17:25:32.113 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:25:32.108+0000 7f1c6f136700 1 -- 172.21.15.26:0/2359535571 wait complete. 2021-11-03T17:25:32.113 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:25:32.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:32 smithi026 ceph-mon[96795]: pgmap v926: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:32.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:32 smithi026 ceph-mon[96795]: from='client.35100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:25:32.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:32 smithi026 ceph-mon[96795]: from='client.35104 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:25:32.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:32 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/557708172' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:25:32.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:32 smithi194 ceph-mon[65619]: pgmap v926: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:32.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:32 smithi194 ceph-mon[65619]: from='client.35100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:25:32.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:32 smithi194 ceph-mon[65619]: from='client.35104 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:25:32.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:32 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/557708172' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:25:33.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:33 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2359535571' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:25:33.470 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:33 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2359535571' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:25:34.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:34 smithi026 ceph-mon[96795]: pgmap v927: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:34.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:34 smithi194 ceph-mon[65619]: pgmap v927: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:36.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:36 smithi026 ceph-mon[96795]: pgmap v928: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:36.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:36 smithi194 ceph-mon[65619]: pgmap v928: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:38.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:38 smithi026 ceph-mon[96795]: pgmap v929: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:38.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:38 smithi194 ceph-mon[65619]: pgmap v929: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:40.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:40 smithi026 ceph-mon[96795]: pgmap v930: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:40.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:40 smithi194 ceph-mon[65619]: pgmap v930: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:42.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:42 smithi026 ceph-mon[96795]: pgmap v931: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:42.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:42 smithi194 ceph-mon[65619]: pgmap v931: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:44.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:44 smithi026 ceph-mon[96795]: pgmap v932: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:44.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:44 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:25:44.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:44 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:25:44.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:44 smithi194 ceph-mon[65619]: pgmap v932: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:44.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:44 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:25:44.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:44 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:25:46.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:46 smithi026 ceph-mon[96795]: pgmap v933: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:46.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:46 smithi194 ceph-mon[65619]: pgmap v933: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:48.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:48 smithi026 ceph-mon[96795]: pgmap v934: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:48.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:48 smithi194 ceph-mon[65619]: pgmap v934: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:49.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:25:49.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:25:49.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:25:49.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:25:50.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:50 smithi026 ceph-mon[96795]: pgmap v935: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:50.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:50 smithi194 ceph-mon[65619]: pgmap v935: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:52.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:52 smithi026 ceph-mon[96795]: pgmap v936: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:52.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:52 smithi194 ceph-mon[65619]: pgmap v936: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:54.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:54 smithi026 ceph-mon[96795]: pgmap v937: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:54.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:54 smithi194 ceph-mon[65619]: pgmap v937: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:56.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:56 smithi026 ceph-mon[96795]: pgmap v938: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:56.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:56 smithi194 ceph-mon[65619]: pgmap v938: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:58.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:58 smithi026 ceph-mon[96795]: pgmap v939: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:58.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:58 smithi194 ceph-mon[65619]: pgmap v939: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:25:59.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:59 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:25:59.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:59 smithi026 ceph-mon[96795]: poll took 60052.307 ms: 1 events 2021-11-03T17:25:59.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:59 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:25:59.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:59 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:25:59.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:59 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:25:59.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:59 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:25:59.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:59 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:25:59.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:59 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:25:59.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:59 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:25:59.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:59 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:25:59.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:25:59 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:25:59.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:59 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:25:59.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:59 smithi194 ceph-mon[65619]: poll took 60052.307 ms: 1 events 2021-11-03T17:25:59.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:59 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:25:59.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:59 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:25:59.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:59 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:25:59.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:59 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:25:59.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:59 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:25:59.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:59 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:25:59.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:59 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:25:59.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:59 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:25:59.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:25:59 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:26:00.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:00 smithi026 ceph-mon[96795]: pgmap v940: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:00.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:00 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:26:00.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:00 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:26:00.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:00 smithi194 ceph-mon[65619]: pgmap v940: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:00.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:00 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:26:00.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:00 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:26:02.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.223+0000 7f94d81dc700 1 -- 172.21.15.26:0/3540303623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d00f66e0 msgr2=0x7f94d00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:26:02.221 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.223+0000 7f94d81dc700 1 --2- 172.21.15.26:0/3540303623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d00f66e0 0x7f94d00f6b00 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f94cc004660 tx=0x7f94cc009b30).stop 2021-11-03T17:26:02.221 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.223+0000 7f94d81dc700 1 -- 172.21.15.26:0/3540303623 shutdown_connections 2021-11-03T17:26:02.221 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.223+0000 7f94d81dc700 1 --2- 172.21.15.26:0/3540303623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94d00f6ff0 0x7f94d00f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:02.221 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.223+0000 7f94d81dc700 1 --2- 172.21.15.26:0/3540303623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d00f66e0 0x7f94d00f6b00 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:02.222 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.223+0000 7f94d81dc700 1 -- 172.21.15.26:0/3540303623 >> 172.21.15.26:0/3540303623 conn(0x7f94d00f1f00 msgr2=0x7f94d00f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:26:02.222 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.224+0000 7f94d81dc700 1 -- 172.21.15.26:0/3540303623 shutdown_connections 2021-11-03T17:26:02.222 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.224+0000 7f94d81dc700 1 -- 172.21.15.26:0/3540303623 wait complete. 2021-11-03T17:26:02.222 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.224+0000 7f94d81dc700 1 Processor -- start 2021-11-03T17:26:02.223 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.224+0000 7f94d81dc700 1 -- start start 2021-11-03T17:26:02.223 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.224+0000 7f94d81dc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94d00f66e0 0x7f94d0106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:26:02.223 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.224+0000 7f94d81dc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d00f6ff0 0x7f94d0107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:26:02.223 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.224+0000 7f94d81dc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d0107a00 con 0x7f94d00f6ff0 2021-11-03T17:26:02.223 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.224+0000 7f94d81dc700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d0107b40 con 0x7f94d00f66e0 2021-11-03T17:26:02.224 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.224+0000 7f94d5777700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d00f6ff0 0x7f94d0107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:26:02.224 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.225+0000 7f94d5777700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d00f6ff0 0x7f94d0107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54368/0 (socket says 172.21.15.26:54368) 2021-11-03T17:26:02.224 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.225+0000 7f94d5777700 1 -- 172.21.15.26:0/936133644 learned_addr learned my addr 172.21.15.26:0/936133644 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:26:02.224 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.225+0000 7f94d5f78700 1 --2- 172.21.15.26:0/936133644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94d00f66e0 0x7f94d0106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:26:02.224 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.225+0000 7f94d5777700 1 -- 172.21.15.26:0/936133644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94d00f66e0 msgr2=0x7f94d0106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:26:02.225 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.225+0000 7f94d5777700 1 --2- 172.21.15.26:0/936133644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94d00f66e0 0x7f94d0106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:02.225 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.225+0000 7f94d5777700 1 -- 172.21.15.26:0/936133644 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94cc005040 con 0x7f94d00f6ff0 2021-11-03T17:26:02.225 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.225+0000 7f94d5f78700 1 --2- 172.21.15.26:0/936133644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94d00f66e0 0x7f94d0106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:26:02.225 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.225+0000 7f94d5777700 1 --2- 172.21.15.26:0/936133644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d00f6ff0 0x7f94d0107450 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f94c000c530 tx=0x7f94c0007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:26:02.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.225+0000 7f94c67fc700 1 -- 172.21.15.26:0/936133644 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94c000f650 con 0x7f94d00f6ff0 2021-11-03T17:26:02.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.225+0000 7f94c67fc700 1 -- 172.21.15.26:0/936133644 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f94c000fc60 con 0x7f94d00f6ff0 2021-11-03T17:26:02.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.225+0000 7f94c67fc700 1 -- 172.21.15.26:0/936133644 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94c0012cd0 con 0x7f94d00f6ff0 2021-11-03T17:26:02.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.225+0000 7f94d81dc700 1 -- 172.21.15.26:0/936133644 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94d01084e0 con 0x7f94d00f6ff0 2021-11-03T17:26:02.227 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.225+0000 7f94d81dc700 1 -- 172.21.15.26:0/936133644 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94d0108aa0 con 0x7f94d00f6ff0 2021-11-03T17:26:02.228 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.226+0000 7f94d81dc700 1 -- 172.21.15.26:0/936133644 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94d0045ad0 con 0x7f94d00f6ff0 2021-11-03T17:26:02.228 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.227+0000 7f94c67fc700 1 -- 172.21.15.26:0/936133644 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f94c0010070 con 0x7f94d00f6ff0 2021-11-03T17:26:02.228 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.227+0000 7f94c67fc700 1 --2- 172.21.15.26:0/936133644 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f94bc0640b0 0x7f94bc066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:26:02.228 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.227+0000 7f94c67fc700 1 -- 172.21.15.26:0/936133644 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f94c0080640 con 0x7f94d00f6ff0 2021-11-03T17:26:02.229 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.227+0000 7f94d5f78700 1 --2- 172.21.15.26:0/936133644 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f94bc0640b0 0x7f94bc066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:26:02.229 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.228+0000 7f94d5f78700 1 --2- 172.21.15.26:0/936133644 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f94bc0640b0 0x7f94bc066570 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f94cc004e30 tx=0x7f94cc009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:26:02.229 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.231+0000 7f94c67fc700 1 -- 172.21.15.26:0/936133644 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f94c00528b0 con 0x7f94d00f6ff0 2021-11-03T17:26:02.406 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.411+0000 7f94d81dc700 1 -- 172.21.15.26:0/936133644 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f94d00ff080 con 0x7f94bc0640b0 2021-11-03T17:26:02.407 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.412+0000 7f94c67fc700 1 -- 172.21.15.26:0/936133644 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f94cc019040 con 0x7f94bc0640b0 2021-11-03T17:26:02.409 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.414+0000 7f94d81dc700 1 -- 172.21.15.26:0/936133644 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f94bc0640b0 msgr2=0x7f94bc066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:26:02.410 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.414+0000 7f94d81dc700 1 --2- 172.21.15.26:0/936133644 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f94bc0640b0 0x7f94bc066570 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f94cc004e30 tx=0x7f94cc009b30).stop 2021-11-03T17:26:02.410 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.414+0000 7f94d81dc700 1 -- 172.21.15.26:0/936133644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d00f6ff0 msgr2=0x7f94d0107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:26:02.410 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.414+0000 7f94d81dc700 1 --2- 172.21.15.26:0/936133644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d00f6ff0 0x7f94d0107450 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f94c000c530 tx=0x7f94c0007e20).stop 2021-11-03T17:26:02.411 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.414+0000 7f94d81dc700 1 -- 172.21.15.26:0/936133644 shutdown_connections 2021-11-03T17:26:02.411 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.414+0000 7f94d81dc700 1 --2- 172.21.15.26:0/936133644 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f94bc0640b0 0x7f94bc066570 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:02.411 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.414+0000 7f94d81dc700 1 --2- 172.21.15.26:0/936133644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94d00f66e0 0x7f94d0106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:02.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.414+0000 7f94d81dc700 1 --2- 172.21.15.26:0/936133644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d00f6ff0 0x7f94d0107450 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:02.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.414+0000 7f94d81dc700 1 -- 172.21.15.26:0/936133644 >> 172.21.15.26:0/936133644 conn(0x7f94d00f1f00 msgr2=0x7f94d00fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:26:02.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.414+0000 7f94d81dc700 1 -- 172.21.15.26:0/936133644 shutdown_connections 2021-11-03T17:26:02.413 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.414+0000 7f94d81dc700 1 -- 172.21.15.26:0/936133644 wait complete. 2021-11-03T17:26:02.418 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:26:02.420 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:02 smithi026 ceph-mon[96795]: pgmap v941: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:02.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:02 smithi194 ceph-mon[65619]: pgmap v941: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:02.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.514+0000 7fc8d579b700 1 -- 172.21.15.26:0/3787307250 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8d00f77d0 msgr2=0x7fc8d00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:26:02.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.514+0000 7fc8d579b700 1 --2- 172.21.15.26:0/3787307250 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8d00f77d0 0x7fc8d00f7c30 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7fc8c4004660 tx=0x7fc8c4009b30).stop 2021-11-03T17:26:02.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.514+0000 7fc8d579b700 1 -- 172.21.15.26:0/3787307250 shutdown_connections 2021-11-03T17:26:02.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.514+0000 7fc8d579b700 1 --2- 172.21.15.26:0/3787307250 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8d00f77d0 0x7fc8d00f7c30 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:02.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.514+0000 7fc8d579b700 1 --2- 172.21.15.26:0/3787307250 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8d00f6530 0x7fc8d00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:02.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.514+0000 7fc8d579b700 1 -- 172.21.15.26:0/3787307250 >> 172.21.15.26:0/3787307250 conn(0x7fc8d00f1c90 msgr2=0x7fc8d00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:26:02.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.514+0000 7fc8d579b700 1 -- 172.21.15.26:0/3787307250 shutdown_connections 2021-11-03T17:26:02.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.514+0000 7fc8d579b700 1 -- 172.21.15.26:0/3787307250 wait complete. 2021-11-03T17:26:02.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.515+0000 7fc8d579b700 1 Processor -- start 2021-11-03T17:26:02.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.515+0000 7fc8d579b700 1 -- start start 2021-11-03T17:26:02.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.515+0000 7fc8d579b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8d00f6530 0x7fc8d0106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:26:02.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.515+0000 7fc8d579b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8d00f77d0 0x7fc8d0107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:26:02.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.515+0000 7fc8d579b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d0107880 con 0x7fc8d00f6530 2021-11-03T17:26:02.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.515+0000 7fc8d579b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d0108090 con 0x7fc8d00f77d0 2021-11-03T17:26:02.517 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.515+0000 7fc8cffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8d00f6530 0x7fc8d0106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:26:02.517 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.515+0000 7fc8cffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8d00f6530 0x7fc8d0106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54376/0 (socket says 172.21.15.26:54376) 2021-11-03T17:26:02.517 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.515+0000 7fc8cffff700 1 -- 172.21.15.26:0/712496505 learned_addr learned my addr 172.21.15.26:0/712496505 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:26:02.517 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.516+0000 7fc8cffff700 1 -- 172.21.15.26:0/712496505 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8d00f77d0 msgr2=0x7fc8d0107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:26:02.518 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.516+0000 7fc8cf7fe700 1 --2- 172.21.15.26:0/712496505 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8d00f77d0 0x7fc8d0107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:26:02.518 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.516+0000 7fc8cffff700 1 --2- 172.21.15.26:0/712496505 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8d00f77d0 0x7fc8d0107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:02.518 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.516+0000 7fc8cffff700 1 -- 172.21.15.26:0/712496505 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c4005040 con 0x7fc8d00f6530 2021-11-03T17:26:02.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.516+0000 7fc8cf7fe700 1 --2- 172.21.15.26:0/712496505 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8d00f77d0 0x7fc8d0107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:26:02.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.516+0000 7fc8cffff700 1 --2- 172.21.15.26:0/712496505 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8d00f6530 0x7fc8d0106d90 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7fc8c000c530 tx=0x7fc8c0007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:26:02.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.516+0000 7fc8ccff9700 1 -- 172.21.15.26:0/712496505 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8c000f650 con 0x7fc8d00f6530 2021-11-03T17:26:02.520 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.516+0000 7fc8ccff9700 1 -- 172.21.15.26:0/712496505 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc8c000fc60 con 0x7fc8d00f6530 2021-11-03T17:26:02.520 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.516+0000 7fc8d579b700 1 -- 172.21.15.26:0/712496505 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8d0108310 con 0x7fc8d00f6530 2021-11-03T17:26:02.521 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.516+0000 7fc8ccff9700 1 -- 172.21.15.26:0/712496505 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8c0012d20 con 0x7fc8d00f6530 2021-11-03T17:26:02.521 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.516+0000 7fc8d579b700 1 -- 172.21.15.26:0/712496505 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8d01088d0 con 0x7fc8d00f6530 2021-11-03T17:26:02.521 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.517+0000 7fc8d579b700 1 -- 172.21.15.26:0/712496505 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8d0059100 con 0x7fc8d00f6530 2021-11-03T17:26:02.522 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.517+0000 7fc8ccff9700 1 -- 172.21.15.26:0/712496505 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc8c0019030 con 0x7fc8d00f6530 2021-11-03T17:26:02.522 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.518+0000 7fc8ccff9700 1 --2- 172.21.15.26:0/712496505 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc8b8064100 0x7fc8b80665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:26:02.523 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.518+0000 7fc8ccff9700 1 -- 172.21.15.26:0/712496505 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc8c0080630 con 0x7fc8d00f6530 2021-11-03T17:26:02.523 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.518+0000 7fc8cf7fe700 1 --2- 172.21.15.26:0/712496505 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc8b8064100 0x7fc8b80665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:26:02.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.518+0000 7fc8cf7fe700 1 --2- 172.21.15.26:0/712496505 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc8b8064100 0x7fc8b80665c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7fc8c4009da0 tx=0x7fc8c4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:26:02.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.522+0000 7fc8ccff9700 1 -- 172.21.15.26:0/712496505 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc8c00529b0 con 0x7fc8d00f6530 2021-11-03T17:26:02.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.696+0000 7fc8d579b700 1 -- 172.21.15.26:0/712496505 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8d00008d0 con 0x7fc8b8064100 2021-11-03T17:26:02.705 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.710+0000 7fc8ccff9700 1 -- 172.21.15.26:0/712496505 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fc8d00008d0 con 0x7fc8b8064100 2021-11-03T17:26:02.706 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:26:02.706 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (37m) 7m ago 38m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:26:02.706 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (29m) 7m ago 38m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:26:02.707 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (29m) 6m ago 37m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:26:02.707 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (37m) 7m ago 38m 39.6M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:26:02.707 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (30m) 7m ago 33m 19.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:26:02.707 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (30m) 7m ago 33m 20.6M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:26:02.707 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (33m) 6m ago 33m 22.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:26:02.708 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (33m) 6m ago 33m 22.2M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:26:02.708 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (31m) 7m ago 39m 505M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:26:02.708 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (30m) 6m ago 37m 419M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:26:02.708 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (30m) 7m ago 40m 147M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:26:02.709 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (30m) 6m ago 37m 75.7M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:26:02.709 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (38m) 7m ago 38m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:26:02.709 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (37m) 6m ago 37m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:26:02.709 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (29m) 7m ago 36m 211M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:26:02.709 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (28m) 7m ago 36m 226M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:26:02.710 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (28m) 7m ago 36m 189M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:26:02.710 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (27m) 6m ago 35m 236M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:26:02.710 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (27m) 6m ago 35m 208M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:26:02.710 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (26m) 6m ago 35m 194M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:26:02.711 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (37m) 7m ago 37m 52.1M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:26:02.711 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.712+0000 7fc8d579b700 1 -- 172.21.15.26:0/712496505 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc8b8064100 msgr2=0x7fc8b80665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:26:02.712 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.712+0000 7fc8d579b700 1 --2- 172.21.15.26:0/712496505 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc8b8064100 0x7fc8b80665c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7fc8c4009da0 tx=0x7fc8c4009b30).stop 2021-11-03T17:26:02.712 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.712+0000 7fc8d579b700 1 -- 172.21.15.26:0/712496505 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8d00f6530 msgr2=0x7fc8d0106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:26:02.712 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.712+0000 7fc8d579b700 1 --2- 172.21.15.26:0/712496505 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8d00f6530 0x7fc8d0106d90 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7fc8c000c530 tx=0x7fc8c0007e10).stop 2021-11-03T17:26:02.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.712+0000 7fc8d579b700 1 -- 172.21.15.26:0/712496505 shutdown_connections 2021-11-03T17:26:02.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.712+0000 7fc8d579b700 1 --2- 172.21.15.26:0/712496505 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc8b8064100 0x7fc8b80665c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:02.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.712+0000 7fc8d579b700 1 --2- 172.21.15.26:0/712496505 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8d00f6530 0x7fc8d0106d90 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:02.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.712+0000 7fc8d579b700 1 --2- 172.21.15.26:0/712496505 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8d00f77d0 0x7fc8d0107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:02.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.712+0000 7fc8d579b700 1 -- 172.21.15.26:0/712496505 >> 172.21.15.26:0/712496505 conn(0x7fc8d00f1c90 msgr2=0x7fc8d00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:26:02.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.712+0000 7fc8d579b700 1 -- 172.21.15.26:0/712496505 shutdown_connections 2021-11-03T17:26:02.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.712+0000 7fc8d579b700 1 -- 172.21.15.26:0/712496505 wait complete. 2021-11-03T17:26:02.808 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.811+0000 7f22b61ed700 1 -- 172.21.15.26:0/1216699120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22b00f6860 msgr2=0x7f22b00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:26:02.808 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.811+0000 7f22b61ed700 1 --2- 172.21.15.26:0/1216699120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22b00f6860 0x7f22b00f6cc0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f22a4004660 tx=0x7f22a4009b30).stop 2021-11-03T17:26:02.809 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.811+0000 7f22b61ed700 1 -- 172.21.15.26:0/1216699120 shutdown_connections 2021-11-03T17:26:02.809 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.811+0000 7f22b61ed700 1 --2- 172.21.15.26:0/1216699120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22b00f6860 0x7f22b00f6cc0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:02.809 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.811+0000 7f22b61ed700 1 --2- 172.21.15.26:0/1216699120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22b00f55c0 0x7f22b00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:02.809 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.811+0000 7f22b61ed700 1 -- 172.21.15.26:0/1216699120 >> 172.21.15.26:0/1216699120 conn(0x7f22b00f0d20 msgr2=0x7f22b00f3140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:26:02.809 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.811+0000 7f22b61ed700 1 -- 172.21.15.26:0/1216699120 shutdown_connections 2021-11-03T17:26:02.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.811+0000 7f22b61ed700 1 -- 172.21.15.26:0/1216699120 wait complete. 2021-11-03T17:26:02.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.811+0000 7f22b61ed700 1 Processor -- start 2021-11-03T17:26:02.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.812+0000 7f22b61ed700 1 -- start start 2021-11-03T17:26:02.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.812+0000 7f22b61ed700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22b00f55c0 0x7f22b0109bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:26:02.811 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.812+0000 7f22b61ed700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22b00f6860 0x7f22b010c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:26:02.811 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.812+0000 7f22b61ed700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b0060560 con 0x7f22b00f6860 2021-11-03T17:26:02.811 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.812+0000 7f22b61ed700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b00606a0 con 0x7f22b00f55c0 2021-11-03T17:26:02.811 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.812+0000 7f22aeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22b00f6860 0x7f22b010c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:26:02.812 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.812+0000 7f22aeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22b00f6860 0x7f22b010c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54388/0 (socket says 172.21.15.26:54388) 2021-11-03T17:26:02.812 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.812+0000 7f22aeffd700 1 -- 172.21.15.26:0/3922181473 learned_addr learned my addr 172.21.15.26:0/3922181473 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:26:02.812 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.812+0000 7f22af7fe700 1 --2- 172.21.15.26:0/3922181473 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22b00f55c0 0x7f22b0109bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:26:02.812 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.812+0000 7f22aeffd700 1 -- 172.21.15.26:0/3922181473 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22b00f55c0 msgr2=0x7f22b0109bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:26:02.812 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.812+0000 7f22aeffd700 1 --2- 172.21.15.26:0/3922181473 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22b00f55c0 0x7f22b0109bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:02.813 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.812+0000 7f22aeffd700 1 -- 172.21.15.26:0/3922181473 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a4005040 con 0x7f22b00f6860 2021-11-03T17:26:02.813 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.812+0000 7f22aeffd700 1 --2- 172.21.15.26:0/3922181473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22b00f6860 0x7f22b010c0c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f22a4000c00 tx=0x7f22a400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:26:02.813 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.813+0000 7f2297fff700 1 -- 172.21.15.26:0/3922181473 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22a4019070 con 0x7f22b00f6860 2021-11-03T17:26:02.813 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.813+0000 7f22b61ed700 1 -- 172.21.15.26:0/3922181473 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b010c610 con 0x7f22b00f6860 2021-11-03T17:26:02.814 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.813+0000 7f2297fff700 1 -- 172.21.15.26:0/3922181473 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f22a4007e70 con 0x7f22b00f6860 2021-11-03T17:26:02.814 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.813+0000 7f2297fff700 1 -- 172.21.15.26:0/3922181473 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22a4014ce0 con 0x7f22b00f6860 2021-11-03T17:26:02.814 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.813+0000 7f22b61ed700 1 -- 172.21.15.26:0/3922181473 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b010cb70 con 0x7f22b00f6860 2021-11-03T17:26:02.815 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.814+0000 7f22b61ed700 1 -- 172.21.15.26:0/3922181473 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22b0045ad0 con 0x7f22b00f6860 2021-11-03T17:26:02.816 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.814+0000 7f2297fff700 1 -- 172.21.15.26:0/3922181473 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f22a4025070 con 0x7f22b00f6860 2021-11-03T17:26:02.816 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.814+0000 7f2297fff700 1 --2- 172.21.15.26:0/3922181473 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f22980640b0 0x7f2298066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:26:02.816 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.814+0000 7f2297fff700 1 -- 172.21.15.26:0/3922181473 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f22a4081830 con 0x7f22b00f6860 2021-11-03T17:26:02.816 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.815+0000 7f22af7fe700 1 --2- 172.21.15.26:0/3922181473 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f22980640b0 0x7f2298066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:26:02.817 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.815+0000 7f22af7fe700 1 --2- 172.21.15.26:0/3922181473 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f22980640b0 0x7f2298066570 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f22b00601e0 tx=0x7f22a000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:26:02.817 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:02.818+0000 7f2297fff700 1 -- 172.21.15.26:0/3922181473 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f22a4053ad0 con 0x7f22b00f6860 2021-11-03T17:26:03.042 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.047+0000 7f22b61ed700 1 -- 172.21.15.26:0/3922181473 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f22b0027a00 con 0x7f22b00f6860 2021-11-03T17:26:03.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.048+0000 7f2297fff700 1 -- 172.21.15.26:0/3922181473 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f22a4023070 con 0x7f22b00f6860 2021-11-03T17:26:03.044 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:26:03.044 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:26:03.044 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:26:03.044 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:26:03.045 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:26:03.045 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:26:03.045 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:26:03.045 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:26:03.046 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:26:03.046 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:26:03.046 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:26:03.046 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:26:03.047 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:26:03.047 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:26:03.047 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:26:03.047 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:26:03.048 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:26:03.048 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:26:03.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.050+0000 7f22b61ed700 1 -- 172.21.15.26:0/3922181473 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f22980640b0 msgr2=0x7f2298066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:26:03.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.050+0000 7f22b61ed700 1 --2- 172.21.15.26:0/3922181473 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f22980640b0 0x7f2298066570 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f22b00601e0 tx=0x7f22a000b040).stop 2021-11-03T17:26:03.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.050+0000 7f22b61ed700 1 -- 172.21.15.26:0/3922181473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22b00f6860 msgr2=0x7f22b010c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:26:03.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.050+0000 7f22b61ed700 1 --2- 172.21.15.26:0/3922181473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22b00f6860 0x7f22b010c0c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f22a4000c00 tx=0x7f22a400b040).stop 2021-11-03T17:26:03.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.050+0000 7f22b61ed700 1 -- 172.21.15.26:0/3922181473 shutdown_connections 2021-11-03T17:26:03.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.050+0000 7f22b61ed700 1 --2- 172.21.15.26:0/3922181473 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f22980640b0 0x7f2298066570 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:03.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.050+0000 7f22b61ed700 1 --2- 172.21.15.26:0/3922181473 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22b00f55c0 0x7f22b0109bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:03.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.050+0000 7f22b61ed700 1 --2- 172.21.15.26:0/3922181473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22b00f6860 0x7f22b010c0c0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:03.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.050+0000 7f22b61ed700 1 -- 172.21.15.26:0/3922181473 >> 172.21.15.26:0/3922181473 conn(0x7f22b00f0d20 msgr2=0x7f22b00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:26:03.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.050+0000 7f22b61ed700 1 -- 172.21.15.26:0/3922181473 shutdown_connections 2021-11-03T17:26:03.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.050+0000 7f22b61ed700 1 -- 172.21.15.26:0/3922181473 wait complete. 2021-11-03T17:26:03.146 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.151+0000 7f23de033700 1 -- 172.21.15.26:0/1937146445 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23d80f6b90 msgr2=0x7f23d80f6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:26:03.147 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.151+0000 7f23de033700 1 --2- 172.21.15.26:0/1937146445 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23d80f6b90 0x7f23d80f6fb0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f23c8004660 tx=0x7f23c8009b30).stop 2021-11-03T17:26:03.147 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.151+0000 7f23de033700 1 -- 172.21.15.26:0/1937146445 shutdown_connections 2021-11-03T17:26:03.147 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.151+0000 7f23de033700 1 --2- 172.21.15.26:0/1937146445 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23d80f74a0 0x7f23d80f5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:03.148 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.151+0000 7f23de033700 1 --2- 172.21.15.26:0/1937146445 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23d80f6b90 0x7f23d80f6fb0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:03.148 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.151+0000 7f23de033700 1 -- 172.21.15.26:0/1937146445 >> 172.21.15.26:0/1937146445 conn(0x7f23d80f0540 msgr2=0x7f23d80f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:26:03.148 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.151+0000 7f23de033700 1 -- 172.21.15.26:0/1937146445 shutdown_connections 2021-11-03T17:26:03.148 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.151+0000 7f23de033700 1 -- 172.21.15.26:0/1937146445 wait complete. 2021-11-03T17:26:03.148 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.152+0000 7f23de033700 1 Processor -- start 2021-11-03T17:26:03.149 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.152+0000 7f23de033700 1 -- start start 2021-11-03T17:26:03.151 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.152+0000 7f23de033700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23d80f6b90 0x7f23d80f9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:26:03.151 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.152+0000 7f23de033700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23d80f74a0 0x7f23d80f7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:26:03.151 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.152+0000 7f23de033700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d80f81e0 con 0x7f23d80f6b90 2021-11-03T17:26:03.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.152+0000 7f23de033700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d80f8320 con 0x7f23d80f74a0 2021-11-03T17:26:03.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.152+0000 7f23d77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23d80f6b90 0x7f23d80f9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:26:03.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.152+0000 7f23d77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23d80f6b90 0x7f23d80f9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54396/0 (socket says 172.21.15.26:54396) 2021-11-03T17:26:03.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.152+0000 7f23d77fe700 1 -- 172.21.15.26:0/289295482 learned_addr learned my addr 172.21.15.26:0/289295482 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:26:03.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.152+0000 7f23d6ffd700 1 --2- 172.21.15.26:0/289295482 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23d80f74a0 0x7f23d80f7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:26:03.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.153+0000 7f23d77fe700 1 -- 172.21.15.26:0/289295482 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23d80f74a0 msgr2=0x7f23d80f7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:26:03.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.153+0000 7f23d77fe700 1 --2- 172.21.15.26:0/289295482 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23d80f74a0 0x7f23d80f7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:03.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.153+0000 7f23d77fe700 1 -- 172.21.15.26:0/289295482 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c8005040 con 0x7f23d80f6b90 2021-11-03T17:26:03.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.153+0000 7f23d77fe700 1 --2- 172.21.15.26:0/289295482 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23d80f6b90 0x7f23d80f9800 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f23c8013a70 tx=0x7f23c8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:26:03.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.153+0000 7f23bffff700 1 -- 172.21.15.26:0/289295482 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23c8018070 con 0x7f23d80f6b90 2021-11-03T17:26:03.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.153+0000 7f23bffff700 1 -- 172.21.15.26:0/289295482 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f23c80097d0 con 0x7f23d80f6b90 2021-11-03T17:26:03.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.153+0000 7f23de033700 1 -- 172.21.15.26:0/289295482 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d80f85a0 con 0x7f23d80f6b90 2021-11-03T17:26:03.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.153+0000 7f23bffff700 1 -- 172.21.15.26:0/289295482 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23c801de80 con 0x7f23d80f6b90 2021-11-03T17:26:03.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.153+0000 7f23de033700 1 -- 172.21.15.26:0/289295482 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d80f8b00 con 0x7f23d80f6b90 2021-11-03T17:26:03.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.154+0000 7f23de033700 1 -- 172.21.15.26:0/289295482 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23d8045ad0 con 0x7f23d80f6b90 2021-11-03T17:26:03.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.154+0000 7f23bffff700 1 -- 172.21.15.26:0/289295482 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f23c8007ba0 con 0x7f23d80f6b90 2021-11-03T17:26:03.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.155+0000 7f23bffff700 1 --2- 172.21.15.26:0/289295482 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f23c00640b0 0x7f23c0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:26:03.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.155+0000 7f23bffff700 1 -- 172.21.15.26:0/289295482 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f23c80823d0 con 0x7f23d80f6b90 2021-11-03T17:26:03.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.155+0000 7f23d6ffd700 1 --2- 172.21.15.26:0/289295482 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f23c00640b0 0x7f23c0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:26:03.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.155+0000 7f23d6ffd700 1 --2- 172.21.15.26:0/289295482 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f23c00640b0 0x7f23c0066570 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f23cc004e20 tx=0x7f23cc00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:26:03.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.159+0000 7f23bffff700 1 -- 172.21.15.26:0/289295482 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f23c80547f0 con 0x7f23d80f6b90 2021-11-03T17:26:03.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.363+0000 7f23de033700 1 -- 172.21.15.26:0/289295482 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f23d810f670 con 0x7f23d80f6b90 2021-11-03T17:26:03.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.364+0000 7f23bffff700 1 -- 172.21.15.26:0/289295482 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f23c80543e0 con 0x7f23d80f6b90 2021-11-03T17:26:03.359 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:26:03.360 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:26:03.360 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:26:03.360 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:26:03.360 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:26:03.361 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:26:03.361 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:26:03.361 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:26:03.361 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:26:03.361 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:26:03.362 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:26:03.362 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:26:03.362 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:26:03.362 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:26:03.363 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:26:03.363 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:26:03.363 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:26:03.363 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:26:03.364 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:26:03.364 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:26:03.364 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:26:03.364 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:26:03.365 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:26:03.365 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:26:03.365 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:26:03.365 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:26:03.365 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:26:03.366 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:26:03.366 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:26:03.366 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:26:03.366 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:26:03.367 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:26:03.367 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:26:03.367 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:26:03.367 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:26:03.368 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:26:03.368 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:26:03.368 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:26:03.368 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:26:03.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.365+0000 7f23de033700 1 -- 172.21.15.26:0/289295482 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f23c00640b0 msgr2=0x7f23c0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:26:03.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.365+0000 7f23de033700 1 --2- 172.21.15.26:0/289295482 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f23c00640b0 0x7f23c0066570 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f23cc004e20 tx=0x7f23cc00b040).stop 2021-11-03T17:26:03.370 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.365+0000 7f23de033700 1 -- 172.21.15.26:0/289295482 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23d80f6b90 msgr2=0x7f23d80f9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:26:03.370 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.365+0000 7f23de033700 1 --2- 172.21.15.26:0/289295482 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23d80f6b90 0x7f23d80f9800 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f23c8013a70 tx=0x7f23c8009b30).stop 2021-11-03T17:26:03.370 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.365+0000 7f23de033700 1 -- 172.21.15.26:0/289295482 shutdown_connections 2021-11-03T17:26:03.370 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.365+0000 7f23de033700 1 --2- 172.21.15.26:0/289295482 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f23c00640b0 0x7f23c0066570 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:03.371 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.365+0000 7f23de033700 1 --2- 172.21.15.26:0/289295482 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23d80f6b90 0x7f23d80f9800 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:03.371 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.365+0000 7f23de033700 1 --2- 172.21.15.26:0/289295482 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23d80f74a0 0x7f23d80f7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:03.371 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.365+0000 7f23de033700 1 -- 172.21.15.26:0/289295482 >> 172.21.15.26:0/289295482 conn(0x7f23d80f0540 msgr2=0x7f23d80f5040 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:26:03.371 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.366+0000 7f23de033700 1 -- 172.21.15.26:0/289295482 shutdown_connections 2021-11-03T17:26:03.372 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:03.366+0000 7f23de033700 1 -- 172.21.15.26:0/289295482 wait complete. 2021-11-03T17:26:03.372 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:26:03.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:03 smithi026 ceph-mon[96795]: from='client.35116 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:26:03.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:03 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3922181473' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:26:03.471 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:03 smithi194 ceph-mon[65619]: from='client.35116 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:26:03.472 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:03 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3922181473' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:26:04.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:04 smithi026 ceph-mon[96795]: from='client.35120 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:26:04.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:04 smithi026 ceph-mon[96795]: pgmap v942: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:04.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:04 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/289295482' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:26:04.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:04 smithi194 ceph-mon[65619]: from='client.35120 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:26:04.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:04 smithi194 ceph-mon[65619]: pgmap v942: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:04.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:04 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/289295482' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:26:06.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:06 smithi026 ceph-mon[96795]: pgmap v943: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:06.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:06 smithi194 ceph-mon[65619]: pgmap v943: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:08.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:08 smithi026 ceph-mon[96795]: pgmap v944: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:08.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:08 smithi194 ceph-mon[65619]: pgmap v944: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:10.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:10 smithi026 ceph-mon[96795]: pgmap v945: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:10.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:10 smithi194 ceph-mon[65619]: pgmap v945: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:12.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:12 smithi026 ceph-mon[96795]: pgmap v946: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:12.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:12 smithi194 ceph-mon[65619]: pgmap v946: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:14.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:14 smithi194 ceph-mon[65619]: pgmap v947: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:14.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:14 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:26:14.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:14 smithi026 ceph-mon[96795]: pgmap v947: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:14.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:14 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:26:15.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:15 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:26:15.573 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:15 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:26:16.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:16 smithi194 ceph-mon[65619]: pgmap v948: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:16.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:16 smithi026 ceph-mon[96795]: pgmap v948: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:18.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:18 smithi194 ceph-mon[65619]: pgmap v949: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:18.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:18 smithi026 ceph-mon[96795]: pgmap v949: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:20.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:20 smithi194 ceph-mon[65619]: pgmap v950: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:20.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:20 smithi026 ceph-mon[96795]: pgmap v950: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:22.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:22 smithi194 ceph-mon[65619]: pgmap v951: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:22.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:22 smithi026 ceph-mon[96795]: pgmap v951: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:24.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:24 smithi194 ceph-mon[65619]: pgmap v952: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:24.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:24 smithi026 ceph-mon[96795]: pgmap v952: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:26.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:26 smithi194 ceph-mon[65619]: pgmap v953: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:26.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:26 smithi026 ceph-mon[96795]: pgmap v953: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:28.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:28 smithi194 ceph-mon[65619]: pgmap v954: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:28.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:28 smithi026 ceph-mon[96795]: pgmap v954: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:29.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:29 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:26:29.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:29 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:26:30.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:30 smithi194 ceph-mon[65619]: pgmap v955: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:30.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:30 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:26:30.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:30 smithi026 ceph-mon[96795]: pgmap v955: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:30.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:30 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:26:32.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:32 smithi194 ceph-mon[65619]: pgmap v956: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:32.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:32 smithi026 ceph-mon[96795]: pgmap v956: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:33.478 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.484+0000 7f23aee03700 1 -- 172.21.15.26:0/214312630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23a806b9c0 msgr2=0x7f23a8069ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:26:33.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.484+0000 7f23aee03700 1 --2- 172.21.15.26:0/214312630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23a806b9c0 0x7f23a8069ec0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f23a4004660 tx=0x7f23a4009b30).stop 2021-11-03T17:26:33.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.484+0000 7f23aee03700 1 -- 172.21.15.26:0/214312630 shutdown_connections 2021-11-03T17:26:33.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.484+0000 7f23aee03700 1 --2- 172.21.15.26:0/214312630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23a806a3b0 0x7f23a806a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:33.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.484+0000 7f23aee03700 1 --2- 172.21.15.26:0/214312630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23a806b9c0 0x7f23a8069ec0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:33.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.484+0000 7f23aee03700 1 -- 172.21.15.26:0/214312630 >> 172.21.15.26:0/214312630 conn(0x7f23a80f1cd0 msgr2=0x7f23a80f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:26:33.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.484+0000 7f23aee03700 1 -- 172.21.15.26:0/214312630 shutdown_connections 2021-11-03T17:26:33.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.484+0000 7f23aee03700 1 -- 172.21.15.26:0/214312630 wait complete. 2021-11-03T17:26:33.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.484+0000 7f23aee03700 1 Processor -- start 2021-11-03T17:26:33.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.485+0000 7f23aee03700 1 -- start start 2021-11-03T17:26:33.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.485+0000 7f23aee03700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23a806a3b0 0x7f23a810d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:26:33.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.485+0000 7f23aee03700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23a806b9c0 0x7f23a810d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:26:33.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.485+0000 7f23aee03700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a810dd50 con 0x7f23a806b9c0 2021-11-03T17:26:33.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.485+0000 7f23aee03700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a810de90 con 0x7f23a806a3b0 2021-11-03T17:26:33.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.485+0000 7f23ad600700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23a806b9c0 0x7f23a810d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:26:33.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.485+0000 7f23ad600700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23a806b9c0 0x7f23a810d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54416/0 (socket says 172.21.15.26:54416) 2021-11-03T17:26:33.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.485+0000 7f23ad600700 1 -- 172.21.15.26:0/2499241884 learned_addr learned my addr 172.21.15.26:0/2499241884 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:26:33.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.485+0000 7f23ade01700 1 --2- 172.21.15.26:0/2499241884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23a806a3b0 0x7f23a810d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:26:33.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.485+0000 7f23ad600700 1 -- 172.21.15.26:0/2499241884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23a806a3b0 msgr2=0x7f23a810d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:26:33.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.485+0000 7f23ad600700 1 --2- 172.21.15.26:0/2499241884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23a806a3b0 0x7f23a810d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:33.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.485+0000 7f23ad600700 1 -- 172.21.15.26:0/2499241884 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a4005040 con 0x7f23a806b9c0 2021-11-03T17:26:33.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.485+0000 7f23ade01700 1 --2- 172.21.15.26:0/2499241884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23a806a3b0 0x7f23a810d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:26:33.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.485+0000 7f23ad600700 1 --2- 172.21.15.26:0/2499241884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23a806b9c0 0x7f23a810d7a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f239800e7f0 tx=0x7f239800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:26:33.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.486+0000 7f239e7fc700 1 -- 172.21.15.26:0/2499241884 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23980092e0 con 0x7f23a806b9c0 2021-11-03T17:26:33.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.486+0000 7f239e7fc700 1 -- 172.21.15.26:0/2499241884 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f239800f040 con 0x7f23a806b9c0 2021-11-03T17:26:33.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.486+0000 7f23aee03700 1 -- 172.21.15.26:0/2499241884 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23a810e830 con 0x7f23a806b9c0 2021-11-03T17:26:33.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.486+0000 7f239e7fc700 1 -- 172.21.15.26:0/2499241884 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2398014750 con 0x7f23a806b9c0 2021-11-03T17:26:33.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.486+0000 7f23aee03700 1 -- 172.21.15.26:0/2499241884 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23a810edf0 con 0x7f23a806b9c0 2021-11-03T17:26:33.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.487+0000 7f23aee03700 1 -- 172.21.15.26:0/2499241884 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23a8045ad0 con 0x7f23a806b9c0 2021-11-03T17:26:33.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.487+0000 7f239e7fc700 1 -- 172.21.15.26:0/2499241884 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f239801b030 con 0x7f23a806b9c0 2021-11-03T17:26:33.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.487+0000 7f239e7fc700 1 --2- 172.21.15.26:0/2499241884 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2394064100 0x7f23940665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:26:33.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.488+0000 7f239e7fc700 1 -- 172.21.15.26:0/2499241884 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f2398080600 con 0x7f23a806b9c0 2021-11-03T17:26:33.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.488+0000 7f23ade01700 1 --2- 172.21.15.26:0/2499241884 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2394064100 0x7f23940665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:26:33.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.488+0000 7f23ade01700 1 --2- 172.21.15.26:0/2499241884 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2394064100 0x7f23940665c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f23a4004d80 tx=0x7f23a400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:26:33.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.492+0000 7f239e7fc700 1 -- 172.21.15.26:0/2499241884 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f23980528a0 con 0x7f23a806b9c0 2021-11-03T17:26:33.665 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.671+0000 7f23aee03700 1 -- 172.21.15.26:0/2499241884 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f23a810f060 con 0x7f2394064100 2021-11-03T17:26:33.666 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.673+0000 7f239e7fc700 1 -- 172.21.15.26:0/2499241884 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f23a810f060 con 0x7f2394064100 2021-11-03T17:26:33.669 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.675+0000 7f23aee03700 1 -- 172.21.15.26:0/2499241884 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2394064100 msgr2=0x7f23940665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:26:33.669 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.675+0000 7f23aee03700 1 --2- 172.21.15.26:0/2499241884 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2394064100 0x7f23940665c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f23a4004d80 tx=0x7f23a400b040).stop 2021-11-03T17:26:33.670 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.675+0000 7f23aee03700 1 -- 172.21.15.26:0/2499241884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23a806b9c0 msgr2=0x7f23a810d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:26:33.670 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.675+0000 7f23aee03700 1 --2- 172.21.15.26:0/2499241884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23a806b9c0 0x7f23a810d7a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f239800e7f0 tx=0x7f239800b040).stop 2021-11-03T17:26:33.670 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.675+0000 7f23aee03700 1 -- 172.21.15.26:0/2499241884 shutdown_connections 2021-11-03T17:26:33.670 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.675+0000 7f23aee03700 1 --2- 172.21.15.26:0/2499241884 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2394064100 0x7f23940665c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:33.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.675+0000 7f23aee03700 1 --2- 172.21.15.26:0/2499241884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23a806a3b0 0x7f23a810d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:33.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.675+0000 7f23aee03700 1 --2- 172.21.15.26:0/2499241884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23a806b9c0 0x7f23a810d7a0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:33.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.675+0000 7f23aee03700 1 -- 172.21.15.26:0/2499241884 >> 172.21.15.26:0/2499241884 conn(0x7f23a80f1cd0 msgr2=0x7f23a80f8820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:26:33.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.675+0000 7f23aee03700 1 -- 172.21.15.26:0/2499241884 shutdown_connections 2021-11-03T17:26:33.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.675+0000 7f23aee03700 1 -- 172.21.15.26:0/2499241884 wait complete. 2021-11-03T17:26:33.679 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:26:33.774 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.775+0000 7f997c086700 1 -- 172.21.15.26:0/433109474 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99740f5ed0 msgr2=0x7f99740f6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:26:33.775 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.775+0000 7f997c086700 1 --2- 172.21.15.26:0/433109474 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99740f5ed0 0x7f99740f6900 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f9968004660 tx=0x7f9968009b30).stop 2021-11-03T17:26:33.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.775+0000 7f997c086700 1 -- 172.21.15.26:0/433109474 shutdown_connections 2021-11-03T17:26:33.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.775+0000 7f997c086700 1 --2- 172.21.15.26:0/433109474 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99740f5ed0 0x7f99740f6900 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:33.777 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.775+0000 7f997c086700 1 --2- 172.21.15.26:0/433109474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99740f55c0 0x7f99740f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:26:33.777 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.775+0000 7f997c086700 1 -- 172.21.15.26:0/433109474 >> 172.21.15.26:0/433109474 conn(0x7f99740f0de0 msgr2=0x7f99740f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:26:33.778 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.775+0000 7f997c086700 1 -- 172.21.15.26:0/433109474 shutdown_connections 2021-11-03T17:26:33.779 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.775+0000 7f997c086700 1 -- 172.21.15.26:0/433109474 wait complete. 2021-11-03T17:26:33.779 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.775+0000 7f997c086700 1 Processor -- start 2021-11-03T17:26:33.780 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.775+0000 7f997c086700 1 -- start start 2021-11-03T17:26:33.780 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.776+0000 7f997c086700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99740f55c0 0x7f9974106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:26:33.780 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.776+0000 7f997c086700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99740f5ed0 0x7f9974107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:26:33.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.776+0000 7f997c086700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9974107a90 con 0x7f99740f55c0 2021-11-03T17:26:33.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.776+0000 7f997c086700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9974108340 con 0x7f99740f5ed0 2021-11-03T17:26:33.782 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.776+0000 7f9979e22700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99740f55c0 0x7f9974106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:26:33.783 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.776+0000 7f9979e22700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99740f55c0 0x7f9974106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54424/0 (socket says 172.21.15.26:54424) 2021-11-03T17:26:33.783 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.776+0000 7f9979e22700 1 -- 172.21.15.26:0/2343845578 learned_addr learned my addr 172.21.15.26:0/2343845578 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:26:33.783 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.776+0000 7f9979621700 1 --2- 172.21.15.26:0/2343845578 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99740f5ed0 0x7f9974107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:26:33.784 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.776+0000 7f9979e22700 1 -- 172.21.15.26:0/2343845578 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99740f5ed0 msgr2=0x7f9974107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:26:33.784 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.776+0000 7f9979e22700 1 --2- 172.21.15.26:0/2343845578 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99740f5ed0 0x7f9974107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:33.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.776+0000 7f9979e22700 1 -- 172.21.15.26:0/2343845578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9968005040 con 0x7f99740f55c0 2021-11-03T17:26:33.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.776+0000 7f9979621700 1 --2- 172.21.15.26:0/2343845578 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99740f5ed0 0x7f9974107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:26:33.786 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.776+0000 7f9979e22700 1 --2- 172.21.15.26:0/2343845578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99740f55c0 0x7f9974106f60 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f997000b410 tx=0x7f9970006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:26:33.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.776+0000 7f99667fc700 1 -- 172.21.15.26:0/2343845578 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99700125f0 con 0x7f99740f55c0 2021-11-03T17:26:33.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.776+0000 7f99667fc700 1 -- 172.21.15.26:0/2343845578 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9970012c00 con 0x7f99740f55c0 2021-11-03T17:26:33.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.776+0000 7f997c086700 1 -- 172.21.15.26:0/2343845578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9974108620 con 0x7f99740f55c0 2021-11-03T17:26:33.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.776+0000 7f99667fc700 1 -- 172.21.15.26:0/2343845578 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9970002ae0 con 0x7f99740f55c0 2021-11-03T17:26:33.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.777+0000 7f997c086700 1 -- 172.21.15.26:0/2343845578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9974108be0 con 0x7f99740f55c0 2021-11-03T17:26:33.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.777+0000 7f997c086700 1 -- 172.21.15.26:0/2343845578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99740f4a50 con 0x7f99740f55c0 2021-11-03T17:26:33.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.778+0000 7f99667fc700 1 -- 172.21.15.26:0/2343845578 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f997000f030 con 0x7f99740f55c0 2021-11-03T17:26:33.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.778+0000 7f99667fc700 1 --2- 172.21.15.26:0/2343845578 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f99600640b0 0x7f9960066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:26:33.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.779+0000 7f99667fc700 1 -- 172.21.15.26:0/2343845578 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f9970080bf0 con 0x7f99740f55c0 2021-11-03T17:26:33.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.779+0000 7f9979621700 1 --2- 172.21.15.26:0/2343845578 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f99600640b0 0x7f9960066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:26:33.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.779+0000 7f9979621700 1 --2- 172.21.15.26:0/2343845578 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f99600640b0 0x7f9960066570 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f9968009da0 tx=0x7f9968009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:26:33.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.783+0000 7f99667fc700 1 -- 172.21.15.26:0/2343845578 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f9970052f50 con 0x7f99740f55c0 2021-11-03T17:26:33.950 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.956+0000 7f997c086700 1 -- 172.21.15.26:0/2343845578 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f99740008d0 con 0x7f99600640b0 2021-11-03T17:26:33.967 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.971+0000 7f99667fc700 1 -- 172.21.15.26:0/2343845578 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f99740008d0 con 0x7f99600640b0 2021-11-03T17:26:33.968 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:26:33.969 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (37m) 7m ago 39m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:26:33.969 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (30m) 7m ago 39m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:26:33.970 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (29m) 6m ago 38m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:26:33.970 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (37m) 7m ago 38m 39.6M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:26:33.970 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (30m) 7m ago 34m 19.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:26:33.971 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (31m) 7m ago 34m 20.6M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:26:33.971 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (34m) 6m ago 34m 22.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:26:33.971 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (34m) 6m ago 34m 22.2M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:26:33.971 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (31m) 7m ago 40m 505M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:26:33.972 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (31m) 6m ago 38m 419M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:26:33.972 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (30m) 7m ago 40m 147M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:26:33.972 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (30m) 6m ago 38m 75.7M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:26:33.972 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (38m) 7m ago 38m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:26:33.972 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (38m) 6m ago 38m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:26:33.973 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (29m) 7m ago 37m 211M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:26:33.973 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (29m) 7m ago 37m 226M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:26:33.973 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (28m) 7m ago 36m 189M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:26:33.973 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (28m) 6m ago 36m 236M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:26:33.973 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (27m) 6m ago 36m 208M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:26:33.974 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (27m) 6m ago 35m 194M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:26:33.974 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (37m) 7m ago 38m 52.1M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:26:33.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.973+0000 7f997c086700 1 -- 172.21.15.26:0/2343845578 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f99600640b0 msgr2=0x7f9960066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:26:33.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.973+0000 7f997c086700 1 --2- 172.21.15.26:0/2343845578 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f99600640b0 0x7f9960066570 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f9968009da0 tx=0x7f9968009b30).stop 2021-11-03T17:26:33.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.973+0000 7f997c086700 1 -- 172.21.15.26:0/2343845578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99740f55c0 msgr2=0x7f9974106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:26:33.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.973+0000 7f997c086700 1 --2- 172.21.15.26:0/2343845578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99740f55c0 0x7f9974106f60 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f997000b410 tx=0x7f9970006ef0).stop 2021-11-03T17:26:33.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.973+0000 7f997c086700 1 -- 172.21.15.26:0/2343845578 shutdown_connections 2021-11-03T17:26:33.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.973+0000 7f997c086700 1 --2- 172.21.15.26:0/2343845578 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f99600640b0 0x7f9960066570 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:33.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.973+0000 7f997c086700 1 --2- 172.21.15.26:0/2343845578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99740f55c0 0x7f9974106f60 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:33.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.973+0000 7f997c086700 1 --2- 172.21.15.26:0/2343845578 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99740f5ed0 0x7f9974107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:33.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.973+0000 7f997c086700 1 -- 172.21.15.26:0/2343845578 >> 172.21.15.26:0/2343845578 conn(0x7f99740f0de0 msgr2=0x7f99740fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:26:33.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.973+0000 7f997c086700 1 -- 172.21.15.26:0/2343845578 shutdown_connections 2021-11-03T17:26:33.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:33.973+0000 7f997c086700 1 -- 172.21.15.26:0/2343845578 wait complete. 2021-11-03T17:26:34.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.073+0000 7f1251f4b700 1 -- 172.21.15.26:0/2583261586 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f124c0f55c0 msgr2=0x7f124c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:26:34.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.073+0000 7f1251f4b700 1 --2- 172.21.15.26:0/2583261586 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f124c0f55c0 0x7f124c0f59e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f12440099e0 tx=0x7f1244004d10).stop 2021-11-03T17:26:34.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.073+0000 7f1251f4b700 1 -- 172.21.15.26:0/2583261586 shutdown_connections 2021-11-03T17:26:34.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.073+0000 7f1251f4b700 1 --2- 172.21.15.26:0/2583261586 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f124c0f6860 0x7f124c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:34.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.073+0000 7f1251f4b700 1 --2- 172.21.15.26:0/2583261586 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f124c0f55c0 0x7f124c0f59e0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:34.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.073+0000 7f1251f4b700 1 -- 172.21.15.26:0/2583261586 >> 172.21.15.26:0/2583261586 conn(0x7f124c0f0d40 msgr2=0x7f124c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:26:34.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.073+0000 7f1251f4b700 1 -- 172.21.15.26:0/2583261586 shutdown_connections 2021-11-03T17:26:34.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.073+0000 7f1251f4b700 1 -- 172.21.15.26:0/2583261586 wait complete. 2021-11-03T17:26:34.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.073+0000 7f1251f4b700 1 Processor -- start 2021-11-03T17:26:34.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.073+0000 7f1251f4b700 1 -- start start 2021-11-03T17:26:34.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.074+0000 7f1251f4b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f124c0f55c0 0x7f124c105f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:26:34.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.074+0000 7f1251f4b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f124c0f6860 0x7f124c106450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:26:34.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.074+0000 7f1251f4b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124c106a00 con 0x7f124c0f6860 2021-11-03T17:26:34.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.074+0000 7f1251f4b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124c106b40 con 0x7f124c0f55c0 2021-11-03T17:26:34.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.074+0000 7f124affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f124c0f6860 0x7f124c106450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:26:34.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.074+0000 7f124affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f124c0f6860 0x7f124c106450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54436/0 (socket says 172.21.15.26:54436) 2021-11-03T17:26:34.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.074+0000 7f124affd700 1 -- 172.21.15.26:0/1582194165 learned_addr learned my addr 172.21.15.26:0/1582194165 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:26:34.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.074+0000 7f124b7fe700 1 --2- 172.21.15.26:0/1582194165 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f124c0f55c0 0x7f124c105f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:26:34.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.074+0000 7f124affd700 1 -- 172.21.15.26:0/1582194165 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f124c0f55c0 msgr2=0x7f124c105f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:26:34.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.074+0000 7f124affd700 1 --2- 172.21.15.26:0/1582194165 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f124c0f55c0 0x7f124c105f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:34.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.074+0000 7f124affd700 1 -- 172.21.15.26:0/1582194165 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1244009640 con 0x7f124c0f6860 2021-11-03T17:26:34.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.074+0000 7f124affd700 1 --2- 172.21.15.26:0/1582194165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f124c0f6860 0x7f124c106450 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f123400c530 tx=0x7f1234007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:26:34.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.074+0000 7f1243fff700 1 -- 172.21.15.26:0/1582194165 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f123400f650 con 0x7f124c0f6860 2021-11-03T17:26:34.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.074+0000 7f1251f4b700 1 -- 172.21.15.26:0/1582194165 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f124c1074e0 con 0x7f124c0f6860 2021-11-03T17:26:34.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.074+0000 7f1243fff700 1 -- 172.21.15.26:0/1582194165 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f123400fc60 con 0x7f124c0f6860 2021-11-03T17:26:34.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.074+0000 7f1243fff700 1 -- 172.21.15.26:0/1582194165 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1234012cd0 con 0x7f124c0f6860 2021-11-03T17:26:34.075 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.074+0000 7f1251f4b700 1 -- 172.21.15.26:0/1582194165 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f124c107a20 con 0x7f124c0f6860 2021-11-03T17:26:34.076 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.075+0000 7f1251f4b700 1 -- 172.21.15.26:0/1582194165 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f124c045ad0 con 0x7f124c0f6860 2021-11-03T17:26:34.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.076+0000 7f1243fff700 1 -- 172.21.15.26:0/1582194165 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f1234010070 con 0x7f124c0f6860 2021-11-03T17:26:34.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.076+0000 7f1243fff700 1 --2- 172.21.15.26:0/1582194165 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f12380640b0 0x7f1238066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:26:34.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.076+0000 7f1243fff700 1 -- 172.21.15.26:0/1582194165 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f12340806e0 con 0x7f124c0f6860 2021-11-03T17:26:34.078 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.076+0000 7f124b7fe700 1 --2- 172.21.15.26:0/1582194165 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f12380640b0 0x7f1238066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:26:34.078 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.077+0000 7f124b7fe700 1 --2- 172.21.15.26:0/1582194165 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f12380640b0 0x7f1238066570 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f1244009f50 tx=0x7f1244004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:26:34.078 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.080+0000 7f1243fff700 1 -- 172.21.15.26:0/1582194165 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f1234052950 con 0x7f124c0f6860 2021-11-03T17:26:34.307 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.313+0000 7f1251f4b700 1 -- 172.21.15.26:0/1582194165 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f124c027a00 con 0x7f124c0f6860 2021-11-03T17:26:34.308 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.313+0000 7f1243fff700 1 -- 172.21.15.26:0/1582194165 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f1234052540 con 0x7f124c0f6860 2021-11-03T17:26:34.308 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:26:34.308 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:26:34.309 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:26:34.309 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:26:34.309 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:26:34.309 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:26:34.309 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:26:34.310 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:26:34.310 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:26:34.310 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:26:34.310 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:26:34.311 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:26:34.311 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:26:34.311 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:26:34.311 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:26:34.311 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:26:34.312 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:26:34.312 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:26:34.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.315+0000 7f1251f4b700 1 -- 172.21.15.26:0/1582194165 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f12380640b0 msgr2=0x7f1238066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:26:34.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.315+0000 7f1251f4b700 1 --2- 172.21.15.26:0/1582194165 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f12380640b0 0x7f1238066570 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f1244009f50 tx=0x7f1244004d10).stop 2021-11-03T17:26:34.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.315+0000 7f1251f4b700 1 -- 172.21.15.26:0/1582194165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f124c0f6860 msgr2=0x7f124c106450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:26:34.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.315+0000 7f1251f4b700 1 --2- 172.21.15.26:0/1582194165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f124c0f6860 0x7f124c106450 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f123400c530 tx=0x7f1234007e20).stop 2021-11-03T17:26:34.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.315+0000 7f1251f4b700 1 -- 172.21.15.26:0/1582194165 shutdown_connections 2021-11-03T17:26:34.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.315+0000 7f1251f4b700 1 --2- 172.21.15.26:0/1582194165 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f12380640b0 0x7f1238066570 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:34.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.315+0000 7f1251f4b700 1 --2- 172.21.15.26:0/1582194165 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f124c0f55c0 0x7f124c105f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:34.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.315+0000 7f1251f4b700 1 --2- 172.21.15.26:0/1582194165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f124c0f6860 0x7f124c106450 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:34.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.315+0000 7f1251f4b700 1 -- 172.21.15.26:0/1582194165 >> 172.21.15.26:0/1582194165 conn(0x7f124c0f0d40 msgr2=0x7f124c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:26:34.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.316+0000 7f1251f4b700 1 -- 172.21.15.26:0/1582194165 shutdown_connections 2021-11-03T17:26:34.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.316+0000 7f1251f4b700 1 -- 172.21.15.26:0/1582194165 wait complete. 2021-11-03T17:26:34.410 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.416+0000 7fc65305e700 1 -- 172.21.15.26:0/2541320492 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc64c0f7960 msgr2=0x7fc64c0f7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:26:34.410 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.416+0000 7fc65305e700 1 --2- 172.21.15.26:0/2541320492 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc64c0f7960 0x7fc64c0f7dc0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fc63c0099e0 tx=0x7fc63c004d10).stop 2021-11-03T17:26:34.411 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.416+0000 7fc65305e700 1 -- 172.21.15.26:0/2541320492 shutdown_connections 2021-11-03T17:26:34.411 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.416+0000 7fc65305e700 1 --2- 172.21.15.26:0/2541320492 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc64c0f7960 0x7fc64c0f7dc0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:34.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.416+0000 7fc65305e700 1 --2- 172.21.15.26:0/2541320492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc64c0f66c0 0x7fc64c0f6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:26:34.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.416+0000 7fc65305e700 1 -- 172.21.15.26:0/2541320492 >> 172.21.15.26:0/2541320492 conn(0x7fc64c0f1e20 msgr2=0x7fc64c0f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:26:34.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.416+0000 7fc65305e700 1 -- 172.21.15.26:0/2541320492 shutdown_connections 2021-11-03T17:26:34.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.416+0000 7fc65305e700 1 -- 172.21.15.26:0/2541320492 wait complete. 2021-11-03T17:26:34.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.416+0000 7fc65305e700 1 Processor -- start 2021-11-03T17:26:34.413 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.416+0000 7fc65305e700 1 -- start start 2021-11-03T17:26:34.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.417+0000 7fc65305e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc64c0f66c0 0x7fc64c107100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:26:34.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.417+0000 7fc65305e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc64c0f7960 0x7fc64c1075f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:26:34.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.417+0000 7fc65305e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c107c30 con 0x7fc64c0f66c0 2021-11-03T17:26:34.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.417+0000 7fc65305e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c1084e0 con 0x7fc64c0f7960 2021-11-03T17:26:34.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.417+0000 7fc650dfa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc64c0f66c0 0x7fc64c107100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:26:34.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.417+0000 7fc650dfa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc64c0f66c0 0x7fc64c107100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54444/0 (socket says 172.21.15.26:54444) 2021-11-03T17:26:34.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.417+0000 7fc650dfa700 1 -- 172.21.15.26:0/1866728318 learned_addr learned my addr 172.21.15.26:0/1866728318 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:26:34.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.417+0000 7fc64bfff700 1 --2- 172.21.15.26:0/1866728318 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc64c0f7960 0x7fc64c1075f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:26:34.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.417+0000 7fc650dfa700 1 -- 172.21.15.26:0/1866728318 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc64c0f7960 msgr2=0x7fc64c1075f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:26:34.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.417+0000 7fc650dfa700 1 --2- 172.21.15.26:0/1866728318 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc64c0f7960 0x7fc64c1075f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:34.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.417+0000 7fc650dfa700 1 -- 172.21.15.26:0/1866728318 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63c009640 con 0x7fc64c0f66c0 2021-11-03T17:26:34.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.417+0000 7fc64bfff700 1 --2- 172.21.15.26:0/1866728318 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc64c0f7960 0x7fc64c1075f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:26:34.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.417+0000 7fc650dfa700 1 --2- 172.21.15.26:0/1866728318 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc64c0f66c0 0x7fc64c107100 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7fc6440093f0 tx=0x7fc644006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:26:34.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.417+0000 7fc6497fa700 1 -- 172.21.15.26:0/1866728318 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc644009ea0 con 0x7fc64c0f66c0 2021-11-03T17:26:34.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.417+0000 7fc6497fa700 1 -- 172.21.15.26:0/1866728318 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc644013af0 con 0x7fc64c0f66c0 2021-11-03T17:26:34.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.417+0000 7fc65305e700 1 -- 172.21.15.26:0/1866728318 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc64c1087c0 con 0x7fc64c0f66c0 2021-11-03T17:26:34.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.418+0000 7fc6497fa700 1 -- 172.21.15.26:0/1866728318 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc64400db10 con 0x7fc64c0f66c0 2021-11-03T17:26:34.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.418+0000 7fc65305e700 1 -- 172.21.15.26:0/1866728318 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc64c108d00 con 0x7fc64c0f66c0 2021-11-03T17:26:34.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.418+0000 7fc65305e700 1 -- 172.21.15.26:0/1866728318 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc64c0f5ab0 con 0x7fc64c0f66c0 2021-11-03T17:26:34.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.419+0000 7fc6497fa700 1 -- 172.21.15.26:0/1866728318 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc64401a060 con 0x7fc64c0f66c0 2021-11-03T17:26:34.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.419+0000 7fc6497fa700 1 --2- 172.21.15.26:0/1866728318 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc6380640b0 0x7fc638066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:26:34.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.419+0000 7fc6497fa700 1 -- 172.21.15.26:0/1866728318 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc644080840 con 0x7fc64c0f66c0 2021-11-03T17:26:34.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.419+0000 7fc64bfff700 1 --2- 172.21.15.26:0/1866728318 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc6380640b0 0x7fc638066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:26:34.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.420+0000 7fc64bfff700 1 --2- 172.21.15.26:0/1866728318 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc6380640b0 0x7fc638066570 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7fc63c00b3b0 tx=0x7fc63c004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:26:34.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.424+0000 7fc6497fa700 1 -- 172.21.15.26:0/1866728318 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc644052ab0 con 0x7fc64c0f66c0 2021-11-03T17:26:34.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:34 smithi194 ceph-mon[65619]: pgmap v957: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:34.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.627+0000 7fc65305e700 1 -- 172.21.15.26:0/1866728318 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc64c027a00 con 0x7fc64c0f66c0 2021-11-03T17:26:34.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.627+0000 7fc6497fa700 1 -- 172.21.15.26:0/1866728318 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fc644018710 con 0x7fc64c0f66c0 2021-11-03T17:26:34.621 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:26:34.622 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:26:34.622 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:26:34.622 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:26:34.622 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:26:34.623 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:26:34.623 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:26:34.623 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:26:34.623 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:26:34.624 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:26:34.624 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:26:34.624 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:26:34.624 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:26:34.624 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:26:34.625 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:26:34.625 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:26:34.626 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:26:34.626 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:26:34.626 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:26:34.626 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:26:34.627 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:26:34.627 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:26:34.627 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:26:34.627 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:26:34.627 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:26:34.628 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:26:34.628 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:26:34.628 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:26:34.628 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:26:34.629 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:26:34.629 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:26:34.629 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:26:34.629 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:26:34.629 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:26:34.630 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:26:34.630 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:26:34.630 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:26:34.630 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:26:34.630 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:26:34.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.629+0000 7fc65305e700 1 -- 172.21.15.26:0/1866728318 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc6380640b0 msgr2=0x7fc638066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:26:34.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.629+0000 7fc65305e700 1 --2- 172.21.15.26:0/1866728318 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc6380640b0 0x7fc638066570 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7fc63c00b3b0 tx=0x7fc63c004d10).stop 2021-11-03T17:26:34.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.629+0000 7fc65305e700 1 -- 172.21.15.26:0/1866728318 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc64c0f66c0 msgr2=0x7fc64c107100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:26:34.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.629+0000 7fc65305e700 1 --2- 172.21.15.26:0/1866728318 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc64c0f66c0 0x7fc64c107100 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7fc6440093f0 tx=0x7fc644006ec0).stop 2021-11-03T17:26:34.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.629+0000 7fc65305e700 1 -- 172.21.15.26:0/1866728318 shutdown_connections 2021-11-03T17:26:34.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.629+0000 7fc65305e700 1 --2- 172.21.15.26:0/1866728318 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc6380640b0 0x7fc638066570 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:34.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.629+0000 7fc65305e700 1 --2- 172.21.15.26:0/1866728318 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc64c0f66c0 0x7fc64c107100 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:34.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.629+0000 7fc65305e700 1 --2- 172.21.15.26:0/1866728318 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc64c0f7960 0x7fc64c1075f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:26:34.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.629+0000 7fc65305e700 1 -- 172.21.15.26:0/1866728318 >> 172.21.15.26:0/1866728318 conn(0x7fc64c0f1e20 msgr2=0x7fc64c0fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:26:34.634 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.629+0000 7fc65305e700 1 -- 172.21.15.26:0/1866728318 shutdown_connections 2021-11-03T17:26:34.634 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:26:34.629+0000 7fc65305e700 1 -- 172.21.15.26:0/1866728318 wait complete. 2021-11-03T17:26:34.634 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:26:34.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:34 smithi026 ceph-mon[96795]: pgmap v957: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:35.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:35 smithi194 ceph-mon[65619]: from='client.35132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:26:35.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:35 smithi194 ceph-mon[65619]: from='client.35136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:26:35.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:35 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1582194165' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:26:35.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:35 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1866728318' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:26:35.573 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:35 smithi026 ceph-mon[96795]: from='client.35132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:26:35.573 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:35 smithi026 ceph-mon[96795]: from='client.35136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:26:35.574 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:35 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1582194165' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:26:35.574 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:35 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1866728318' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:26:36.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:36 smithi194 ceph-mon[65619]: pgmap v958: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:36.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:36 smithi026 ceph-mon[96795]: pgmap v958: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:38.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:38 smithi194 ceph-mon[65619]: pgmap v959: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:38.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:38 smithi026 ceph-mon[96795]: pgmap v959: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:40.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:40 smithi194 ceph-mon[65619]: pgmap v960: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:40.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:40 smithi026 ceph-mon[96795]: pgmap v960: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:42.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:42 smithi194 ceph-mon[65619]: pgmap v961: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:42.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:42 smithi026 ceph-mon[96795]: pgmap v961: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:44.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:44 smithi194 ceph-mon[65619]: pgmap v962: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:44.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:44 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:26:44.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:44 smithi026 ceph-mon[96795]: pgmap v962: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:44.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:44 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:26:45.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:45 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:26:45.573 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:45 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:26:46.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:46 smithi194 ceph-mon[65619]: pgmap v963: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:46.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:46 smithi026 ceph-mon[96795]: pgmap v963: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:48.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:48 smithi194 ceph-mon[65619]: pgmap v964: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:48.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:26:48.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:26:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:48 smithi026 ceph-mon[96795]: pgmap v964: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:26:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:26:50.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:50 smithi194 ceph-mon[65619]: pgmap v965: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:50.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:50 smithi026 ceph-mon[96795]: pgmap v965: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:52.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:52 smithi194 ceph-mon[65619]: pgmap v966: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:52.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:52 smithi026 ceph-mon[96795]: pgmap v966: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:54.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:54 smithi194 ceph-mon[65619]: pgmap v967: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:54.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:54 smithi026 ceph-mon[96795]: pgmap v967: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:56.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:56 smithi026 ceph-mon[96795]: pgmap v968: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:56.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:56 smithi194 ceph-mon[65619]: pgmap v968: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:58.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:58 smithi026 ceph-mon[96795]: pgmap v969: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:58.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:58 smithi194 ceph-mon[65619]: pgmap v969: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:26:59.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:26:59 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:26:59.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:26:59 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:27:00.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:00 smithi026 ceph-mon[96795]: pgmap v970: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:00.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:00 smithi026 ceph-mon[96795]: poll took 60063.228 ms: 1 events 2021-11-03T17:27:00.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:00 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2021-11-03T17:27:00.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:00 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi026", "name": "osd_memory_target"}]: dispatch 2021-11-03T17:27:00.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:00 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:27:00.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:00 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:27:00.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:00 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:27:00.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:00 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:27:00.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:00 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:27:00.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:00 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:27:00.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:00 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:27:00.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:00 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:27:00.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:00 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:27:00.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:00 smithi194 ceph-mon[65619]: pgmap v970: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:00.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:00 smithi194 ceph-mon[65619]: poll took 60063.228 ms: 1 events 2021-11-03T17:27:00.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:00 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2021-11-03T17:27:00.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:00 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi026", "name": "osd_memory_target"}]: dispatch 2021-11-03T17:27:00.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:00 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:27:00.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:00 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:27:00.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:00 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:27:00.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:00 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:27:00.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:00 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:27:00.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:00 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:27:00.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:00 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:27:00.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:00 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:27:00.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:00 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:27:02.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:02 smithi026 ceph-mon[96795]: pgmap v971: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:02.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:02 smithi194 ceph-mon[65619]: pgmap v971: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:04.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:04 smithi026 ceph-mon[96795]: pgmap v972: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:04.739 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.743+0000 7fbabae38700 1 -- 172.21.15.26:0/3676514514 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbab40f5fe0 msgr2=0x7fbab40f6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:27:04.740 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.743+0000 7fbabae38700 1 --2- 172.21.15.26:0/3676514514 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbab40f5fe0 0x7fbab40f6460 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7fbaa0004660 tx=0x7fbaa0009b30).stop 2021-11-03T17:27:04.740 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.743+0000 7fbabae38700 1 -- 172.21.15.26:0/3676514514 shutdown_connections 2021-11-03T17:27:04.740 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.743+0000 7fbabae38700 1 --2- 172.21.15.26:0/3676514514 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbab40f5fe0 0x7fbab40f6460 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:04.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.743+0000 7fbabae38700 1 --2- 172.21.15.26:0/3676514514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbab40f4de0 0x7fbab40f5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:04.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.743+0000 7fbabae38700 1 -- 172.21.15.26:0/3676514514 >> 172.21.15.26:0/3676514514 conn(0x7fbab40f0540 msgr2=0x7fbab40f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:27:04.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.743+0000 7fbabae38700 1 -- 172.21.15.26:0/3676514514 shutdown_connections 2021-11-03T17:27:04.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.743+0000 7fbabae38700 1 -- 172.21.15.26:0/3676514514 wait complete. 2021-11-03T17:27:04.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.744+0000 7fbabae38700 1 Processor -- start 2021-11-03T17:27:04.742 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.744+0000 7fbabae38700 1 -- start start 2021-11-03T17:27:04.742 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.745+0000 7fbabae38700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbab40f4de0 0x7fbab4105eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:27:04.742 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.745+0000 7fbabae38700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbab40f5fe0 0x7fbab41063a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:27:04.742 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.745+0000 7fbabae38700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab41069a0 con 0x7fbab40f4de0 2021-11-03T17:27:04.743 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.745+0000 7fbabae38700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab41071b0 con 0x7fbab40f5fe0 2021-11-03T17:27:04.743 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.745+0000 7fbab8bd4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbab40f4de0 0x7fbab4105eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:27:04.743 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.745+0000 7fbab8bd4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbab40f4de0 0x7fbab4105eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54464/0 (socket says 172.21.15.26:54464) 2021-11-03T17:27:04.743 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.745+0000 7fbab8bd4700 1 -- 172.21.15.26:0/3423147898 learned_addr learned my addr 172.21.15.26:0/3423147898 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:27:04.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.745+0000 7fbab3fff700 1 --2- 172.21.15.26:0/3423147898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbab40f5fe0 0x7fbab41063a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:27:04.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.745+0000 7fbab8bd4700 1 -- 172.21.15.26:0/3423147898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbab40f5fe0 msgr2=0x7fbab41063a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:27:04.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.745+0000 7fbab8bd4700 1 --2- 172.21.15.26:0/3423147898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbab40f5fe0 0x7fbab41063a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:04.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.745+0000 7fbab8bd4700 1 -- 172.21.15.26:0/3423147898 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa0005040 con 0x7fbab40f4de0 2021-11-03T17:27:04.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.745+0000 7fbab8bd4700 1 --2- 172.21.15.26:0/3423147898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbab40f4de0 0x7fbab4105eb0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7fbaa800c530 tx=0x7fbaa8007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:27:04.747 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.745+0000 7fbab17fa700 1 -- 172.21.15.26:0/3423147898 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbaa800f650 con 0x7fbab40f4de0 2021-11-03T17:27:04.747 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.745+0000 7fbabae38700 1 -- 172.21.15.26:0/3423147898 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbab4107430 con 0x7fbab40f4de0 2021-11-03T17:27:04.747 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.745+0000 7fbab17fa700 1 -- 172.21.15.26:0/3423147898 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbaa800fc60 con 0x7fbab40f4de0 2021-11-03T17:27:04.747 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.745+0000 7fbab17fa700 1 -- 172.21.15.26:0/3423147898 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbaa8012cd0 con 0x7fbab40f4de0 2021-11-03T17:27:04.748 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.746+0000 7fbabae38700 1 -- 172.21.15.26:0/3423147898 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbab41079f0 con 0x7fbab40f4de0 2021-11-03T17:27:04.748 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.746+0000 7fbabae38700 1 -- 172.21.15.26:0/3423147898 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbab40f41d0 con 0x7fbab40f4de0 2021-11-03T17:27:04.748 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.747+0000 7fbab17fa700 1 -- 172.21.15.26:0/3423147898 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fbaa8010070 con 0x7fbab40f4de0 2021-11-03T17:27:04.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.747+0000 7fbab17fa700 1 --2- 172.21.15.26:0/3423147898 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbaa40640b0 0x7fbaa4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:27:04.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.748+0000 7fbab3fff700 1 --2- 172.21.15.26:0/3423147898 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbaa40640b0 0x7fbaa4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:27:04.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.748+0000 7fbab17fa700 1 -- 172.21.15.26:0/3423147898 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fbaa80806e0 con 0x7fbab40f4de0 2021-11-03T17:27:04.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.748+0000 7fbab3fff700 1 --2- 172.21.15.26:0/3423147898 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbaa40640b0 0x7fbaa4066570 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7fbaa0009da0 tx=0x7fbaa0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:27:04.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:04 smithi194 ceph-mon[65619]: pgmap v972: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:04.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.752+0000 7fbab17fa700 1 -- 172.21.15.26:0/3423147898 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fbaa8052950 con 0x7fbab40f4de0 2021-11-03T17:27:04.927 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.932+0000 7fbabae38700 1 -- 172.21.15.26:0/3423147898 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbab40fdea0 con 0x7fbaa40640b0 2021-11-03T17:27:04.928 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.933+0000 7fbab17fa700 1 -- 172.21.15.26:0/3423147898 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fbab40fdea0 con 0x7fbaa40640b0 2021-11-03T17:27:04.930 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.935+0000 7fbabae38700 1 -- 172.21.15.26:0/3423147898 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbaa40640b0 msgr2=0x7fbaa4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:27:04.930 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.935+0000 7fbabae38700 1 --2- 172.21.15.26:0/3423147898 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbaa40640b0 0x7fbaa4066570 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7fbaa0009da0 tx=0x7fbaa0009b30).stop 2021-11-03T17:27:04.930 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.935+0000 7fbabae38700 1 -- 172.21.15.26:0/3423147898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbab40f4de0 msgr2=0x7fbab4105eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:27:04.930 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.935+0000 7fbabae38700 1 --2- 172.21.15.26:0/3423147898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbab40f4de0 0x7fbab4105eb0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7fbaa800c530 tx=0x7fbaa8007e20).stop 2021-11-03T17:27:04.931 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.935+0000 7fbabae38700 1 -- 172.21.15.26:0/3423147898 shutdown_connections 2021-11-03T17:27:04.931 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.935+0000 7fbabae38700 1 --2- 172.21.15.26:0/3423147898 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbaa40640b0 0x7fbaa4066570 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:04.931 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.935+0000 7fbabae38700 1 --2- 172.21.15.26:0/3423147898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbab40f4de0 0x7fbab4105eb0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:04.931 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.935+0000 7fbabae38700 1 --2- 172.21.15.26:0/3423147898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbab40f5fe0 0x7fbab41063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:04.932 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.935+0000 7fbabae38700 1 -- 172.21.15.26:0/3423147898 >> 172.21.15.26:0/3423147898 conn(0x7fbab40f0540 msgr2=0x7fbab40f9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:27:04.932 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.935+0000 7fbabae38700 1 -- 172.21.15.26:0/3423147898 shutdown_connections 2021-11-03T17:27:04.932 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:04.935+0000 7fbabae38700 1 -- 172.21.15.26:0/3423147898 wait complete. 2021-11-03T17:27:04.939 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:27:05.033 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.035+0000 7fb6a8ca2700 1 -- 172.21.15.26:0/3352012805 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6a40f55e0 msgr2=0x7fb6a40f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:27:05.033 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.035+0000 7fb6a8ca2700 1 --2- 172.21.15.26:0/3352012805 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6a40f55e0 0x7fb6a40f5a00 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7fb694004660 tx=0x7fb694009b30).stop 2021-11-03T17:27:05.034 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.036+0000 7fb6a8ca2700 1 -- 172.21.15.26:0/3352012805 shutdown_connections 2021-11-03T17:27:05.034 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.036+0000 7fb6a8ca2700 1 --2- 172.21.15.26:0/3352012805 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6a40f5ef0 0x7fb6a40f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:27:05.034 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.036+0000 7fb6a8ca2700 1 --2- 172.21.15.26:0/3352012805 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6a40f55e0 0x7fb6a40f5a00 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:05.034 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.036+0000 7fb6a8ca2700 1 -- 172.21.15.26:0/3352012805 >> 172.21.15.26:0/3352012805 conn(0x7fb6a40f0de0 msgr2=0x7fb6a40f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:27:05.035 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.036+0000 7fb6a8ca2700 1 -- 172.21.15.26:0/3352012805 shutdown_connections 2021-11-03T17:27:05.035 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.036+0000 7fb6a8ca2700 1 -- 172.21.15.26:0/3352012805 wait complete. 2021-11-03T17:27:05.035 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.036+0000 7fb6a8ca2700 1 Processor -- start 2021-11-03T17:27:05.035 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.036+0000 7fb6a8ca2700 1 -- start start 2021-11-03T17:27:05.035 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.036+0000 7fb6a8ca2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6a40f55e0 0x7fb6a4109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:27:05.036 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.036+0000 7fb6a8ca2700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6a40f5ef0 0x7fb6a410c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:27:05.036 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.036+0000 7fb6a8ca2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a4060570 con 0x7fb6a40f55e0 2021-11-03T17:27:05.036 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.036+0000 7fb6a8ca2700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a40606b0 con 0x7fb6a40f5ef0 2021-11-03T17:27:05.036 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.036+0000 7fb6a259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6a40f55e0 0x7fb6a4109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:27:05.037 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.036+0000 7fb6a259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6a40f55e0 0x7fb6a4109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54474/0 (socket says 172.21.15.26:54474) 2021-11-03T17:27:05.037 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.036+0000 7fb6a259c700 1 -- 172.21.15.26:0/2699571884 learned_addr learned my addr 172.21.15.26:0/2699571884 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:27:05.037 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.037+0000 7fb6a259c700 1 -- 172.21.15.26:0/2699571884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6a40f5ef0 msgr2=0x7fb6a410c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:27:05.037 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.037+0000 7fb6a259c700 1 --2- 172.21.15.26:0/2699571884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6a40f5ef0 0x7fb6a410c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:27:05.037 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.037+0000 7fb6a259c700 1 -- 172.21.15.26:0/2699571884 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb694005040 con 0x7fb6a40f55e0 2021-11-03T17:27:05.038 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.037+0000 7fb6a259c700 1 --2- 172.21.15.26:0/2699571884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6a40f55e0 0x7fb6a4109c70 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7fb694009990 tx=0x7fb694009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:27:05.038 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.037+0000 7fb692ffd700 1 -- 172.21.15.26:0/2699571884 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb694018070 con 0x7fb6a40f55e0 2021-11-03T17:27:05.038 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.037+0000 7fb692ffd700 1 -- 172.21.15.26:0/2699571884 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb694007ca0 con 0x7fb6a40f55e0 2021-11-03T17:27:05.038 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.037+0000 7fb692ffd700 1 -- 172.21.15.26:0/2699571884 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb69401c620 con 0x7fb6a40f55e0 2021-11-03T17:27:05.039 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.037+0000 7fb6a8ca2700 1 -- 172.21.15.26:0/2699571884 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6a410c770 con 0x7fb6a40f55e0 2021-11-03T17:27:05.039 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.037+0000 7fb6a8ca2700 1 -- 172.21.15.26:0/2699571884 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6a410cc50 con 0x7fb6a40f55e0 2021-11-03T17:27:05.039 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.038+0000 7fb6a8ca2700 1 -- 172.21.15.26:0/2699571884 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6a4045ad0 con 0x7fb6a40f55e0 2021-11-03T17:27:05.040 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.039+0000 7fb692ffd700 1 -- 172.21.15.26:0/2699571884 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fb69401d960 con 0x7fb6a40f55e0 2021-11-03T17:27:05.040 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.039+0000 7fb692ffd700 1 --2- 172.21.15.26:0/2699571884 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb68c0640b0 0x7fb68c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:27:05.041 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.039+0000 7fb692ffd700 1 -- 172.21.15.26:0/2699571884 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fb694082540 con 0x7fb6a40f55e0 2021-11-03T17:27:05.041 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.039+0000 7fb6a1d9b700 1 --2- 172.21.15.26:0/2699571884 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb68c0640b0 0x7fb68c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:27:05.041 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.039+0000 7fb6a1d9b700 1 --2- 172.21.15.26:0/2699571884 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb68c0640b0 0x7fb68c066570 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7fb698009610 tx=0x7fb698006ab0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:27:05.041 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.043+0000 7fb692ffd700 1 -- 172.21.15.26:0/2699571884 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fb694054960 con 0x7fb6a40f55e0 2021-11-03T17:27:05.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.215+0000 7fb6a8ca2700 1 -- 172.21.15.26:0/2699571884 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb6a4057f10 con 0x7fb68c0640b0 2021-11-03T17:27:05.225 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.230+0000 7fb692ffd700 1 -- 172.21.15.26:0/2699571884 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fb6a4057f10 con 0x7fb68c0640b0 2021-11-03T17:27:05.225 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:27:05.225 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (38m) 8m ago 39m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:27:05.226 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (30m) 8m ago 39m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:27:05.226 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (30m) 7m ago 38m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:27:05.226 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (38m) 8m ago 39m 39.6M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:27:05.226 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (31m) 8m ago 34m 19.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:27:05.227 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (31m) 8m ago 34m 20.6M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:27:05.227 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (34m) 7m ago 34m 22.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:27:05.227 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (34m) 7m ago 34m 22.2M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:27:05.228 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (32m) 8m ago 40m 505M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:27:05.228 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (31m) 7m ago 38m 419M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:27:05.228 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (31m) 8m ago 41m 147M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:27:05.228 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (31m) 7m ago 38m 75.7M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:27:05.229 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (39m) 8m ago 39m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:27:05.229 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (38m) 7m ago 38m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:27:05.229 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (30m) 8m ago 37m 211M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:27:05.229 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (29m) 8m ago 37m 226M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:27:05.229 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (29m) 8m ago 37m 189M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:27:05.230 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (28m) 7m ago 36m 236M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:27:05.230 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (28m) 7m ago 36m 208M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:27:05.231 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (27m) 7m ago 36m 194M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:27:05.231 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (38m) 8m ago 38m 52.1M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:27:05.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.232+0000 7fb6a8ca2700 1 -- 172.21.15.26:0/2699571884 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb68c0640b0 msgr2=0x7fb68c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:27:05.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.232+0000 7fb6a8ca2700 1 --2- 172.21.15.26:0/2699571884 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb68c0640b0 0x7fb68c066570 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7fb698009610 tx=0x7fb698006ab0).stop 2021-11-03T17:27:05.233 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.232+0000 7fb6a8ca2700 1 -- 172.21.15.26:0/2699571884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6a40f55e0 msgr2=0x7fb6a4109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:27:05.233 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.232+0000 7fb6a8ca2700 1 --2- 172.21.15.26:0/2699571884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6a40f55e0 0x7fb6a4109c70 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7fb694009990 tx=0x7fb694009b30).stop 2021-11-03T17:27:05.233 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.232+0000 7fb6a8ca2700 1 -- 172.21.15.26:0/2699571884 shutdown_connections 2021-11-03T17:27:05.233 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.232+0000 7fb6a8ca2700 1 --2- 172.21.15.26:0/2699571884 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb68c0640b0 0x7fb68c066570 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:05.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.232+0000 7fb6a8ca2700 1 --2- 172.21.15.26:0/2699571884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6a40f55e0 0x7fb6a4109c70 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:05.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.232+0000 7fb6a8ca2700 1 --2- 172.21.15.26:0/2699571884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6a40f5ef0 0x7fb6a410c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:27:05.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.232+0000 7fb6a8ca2700 1 -- 172.21.15.26:0/2699571884 >> 172.21.15.26:0/2699571884 conn(0x7fb6a40f0de0 msgr2=0x7fb6a40fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:27:05.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.232+0000 7fb6a8ca2700 1 -- 172.21.15.26:0/2699571884 shutdown_connections 2021-11-03T17:27:05.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.232+0000 7fb6a8ca2700 1 -- 172.21.15.26:0/2699571884 wait complete. 2021-11-03T17:27:05.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.331+0000 7efc7a3c2700 1 -- 172.21.15.26:0/171986377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc740f5ef0 msgr2=0x7efc740f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:27:05.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.331+0000 7efc7a3c2700 1 --2- 172.21.15.26:0/171986377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc740f5ef0 0x7efc740f6920 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7efc68004660 tx=0x7efc68009b30).stop 2021-11-03T17:27:05.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.331+0000 7efc7a3c2700 1 -- 172.21.15.26:0/171986377 shutdown_connections 2021-11-03T17:27:05.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.331+0000 7efc7a3c2700 1 --2- 172.21.15.26:0/171986377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc740f5ef0 0x7efc740f6920 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:05.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.331+0000 7efc7a3c2700 1 --2- 172.21.15.26:0/171986377 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc740f55e0 0x7efc740f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:05.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.331+0000 7efc7a3c2700 1 -- 172.21.15.26:0/171986377 >> 172.21.15.26:0/171986377 conn(0x7efc740f0de0 msgr2=0x7efc740f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:27:05.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.331+0000 7efc7a3c2700 1 -- 172.21.15.26:0/171986377 shutdown_connections 2021-11-03T17:27:05.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.331+0000 7efc7a3c2700 1 -- 172.21.15.26:0/171986377 wait complete. 2021-11-03T17:27:05.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.332+0000 7efc7a3c2700 1 Processor -- start 2021-11-03T17:27:05.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.332+0000 7efc7a3c2700 1 -- start start 2021-11-03T17:27:05.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.332+0000 7efc7a3c2700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc740f55e0 0x7efc74106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:27:05.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.332+0000 7efc7a3c2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc740f5ef0 0x7efc74107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:27:05.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.332+0000 7efc7a3c2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc74107a20 con 0x7efc740f5ef0 2021-11-03T17:27:05.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.332+0000 7efc7a3c2700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc74107b60 con 0x7efc740f55e0 2021-11-03T17:27:05.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.332+0000 7efc737fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc740f5ef0 0x7efc74107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:27:05.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.332+0000 7efc737fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc740f5ef0 0x7efc74107470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54486/0 (socket says 172.21.15.26:54486) 2021-11-03T17:27:05.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.332+0000 7efc737fe700 1 -- 172.21.15.26:0/2256223911 learned_addr learned my addr 172.21.15.26:0/2256223911 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:27:05.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.332+0000 7efc73fff700 1 --2- 172.21.15.26:0/2256223911 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc740f55e0 0x7efc74106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:27:05.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.332+0000 7efc737fe700 1 -- 172.21.15.26:0/2256223911 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc740f55e0 msgr2=0x7efc74106f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:27:05.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.332+0000 7efc737fe700 1 --2- 172.21.15.26:0/2256223911 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc740f55e0 0x7efc74106f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:05.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.332+0000 7efc737fe700 1 -- 172.21.15.26:0/2256223911 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc68005040 con 0x7efc740f5ef0 2021-11-03T17:27:05.334 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.333+0000 7efc737fe700 1 --2- 172.21.15.26:0/2256223911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc740f5ef0 0x7efc74107470 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7efc68009990 tx=0x7efc68009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:27:05.334 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.333+0000 7efc70ff9700 1 -- 172.21.15.26:0/2256223911 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc68018070 con 0x7efc740f5ef0 2021-11-03T17:27:05.334 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.333+0000 7efc70ff9700 1 -- 172.21.15.26:0/2256223911 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efc68007ba0 con 0x7efc740f5ef0 2021-11-03T17:27:05.334 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.333+0000 7efc7a3c2700 1 -- 172.21.15.26:0/2256223911 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc741084a0 con 0x7efc740f5ef0 2021-11-03T17:27:05.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.333+0000 7efc70ff9700 1 -- 172.21.15.26:0/2256223911 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc6801c3c0 con 0x7efc740f5ef0 2021-11-03T17:27:05.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.333+0000 7efc7a3c2700 1 -- 172.21.15.26:0/2256223911 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc74108a00 con 0x7efc740f5ef0 2021-11-03T17:27:05.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.334+0000 7efc7a3c2700 1 -- 172.21.15.26:0/2256223911 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc74045ad0 con 0x7efc740f5ef0 2021-11-03T17:27:05.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.334+0000 7efc70ff9700 1 -- 172.21.15.26:0/2256223911 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7efc6801d420 con 0x7efc740f5ef0 2021-11-03T17:27:05.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.335+0000 7efc70ff9700 1 --2- 172.21.15.26:0/2256223911 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efc5c0640b0 0x7efc5c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:27:05.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.335+0000 7efc70ff9700 1 -- 172.21.15.26:0/2256223911 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7efc68082410 con 0x7efc740f5ef0 2021-11-03T17:27:05.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.335+0000 7efc73fff700 1 --2- 172.21.15.26:0/2256223911 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efc5c0640b0 0x7efc5c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:27:05.338 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.335+0000 7efc73fff700 1 --2- 172.21.15.26:0/2256223911 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efc5c0640b0 0x7efc5c066570 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7efc64004c40 tx=0x7efc6400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:27:05.338 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.339+0000 7efc70ff9700 1 -- 172.21.15.26:0/2256223911 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7efc68054830 con 0x7efc740f5ef0 2021-11-03T17:27:05.563 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.568+0000 7efc7a3c2700 1 -- 172.21.15.26:0/2256223911 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efc74027a00 con 0x7efc740f5ef0 2021-11-03T17:27:05.564 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.568+0000 7efc70ff9700 1 -- 172.21.15.26:0/2256223911 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7efc68054420 con 0x7efc740f5ef0 2021-11-03T17:27:05.564 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:27:05.564 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:27:05.565 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:27:05.565 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:27:05.565 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:27:05.565 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:27:05.565 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:27:05.566 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:27:05.566 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:27:05.566 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:27:05.566 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:27:05.567 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:27:05.567 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:27:05.567 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:27:05.567 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:27:05.567 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:27:05.568 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:27:05.568 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:27:05.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.570+0000 7efc7a3c2700 1 -- 172.21.15.26:0/2256223911 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efc5c0640b0 msgr2=0x7efc5c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:27:05.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.570+0000 7efc7a3c2700 1 --2- 172.21.15.26:0/2256223911 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efc5c0640b0 0x7efc5c066570 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7efc64004c40 tx=0x7efc6400b040).stop 2021-11-03T17:27:05.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.570+0000 7efc7a3c2700 1 -- 172.21.15.26:0/2256223911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc740f5ef0 msgr2=0x7efc74107470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:27:05.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.570+0000 7efc7a3c2700 1 --2- 172.21.15.26:0/2256223911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc740f5ef0 0x7efc74107470 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7efc68009990 tx=0x7efc68009b30).stop 2021-11-03T17:27:05.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.570+0000 7efc7a3c2700 1 -- 172.21.15.26:0/2256223911 shutdown_connections 2021-11-03T17:27:05.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.570+0000 7efc7a3c2700 1 --2- 172.21.15.26:0/2256223911 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efc5c0640b0 0x7efc5c066570 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:05.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.570+0000 7efc7a3c2700 1 --2- 172.21.15.26:0/2256223911 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc740f55e0 0x7efc74106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:05.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.570+0000 7efc7a3c2700 1 --2- 172.21.15.26:0/2256223911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc740f5ef0 0x7efc74107470 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:05.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.570+0000 7efc7a3c2700 1 -- 172.21.15.26:0/2256223911 >> 172.21.15.26:0/2256223911 conn(0x7efc740f0de0 msgr2=0x7efc740fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:27:05.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.571+0000 7efc7a3c2700 1 -- 172.21.15.26:0/2256223911 shutdown_connections 2021-11-03T17:27:05.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.571+0000 7efc7a3c2700 1 -- 172.21.15.26:0/2256223911 wait complete. 2021-11-03T17:27:05.670 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.671+0000 7fbe54415700 1 -- 172.21.15.26:0/2273055027 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe4c0f55d0 msgr2=0x7fbe4c0f59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:27:05.670 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.671+0000 7fbe54415700 1 --2- 172.21.15.26:0/2273055027 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe4c0f55d0 0x7fbe4c0f59f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7fbe3c004660 tx=0x7fbe3c009b30).stop 2021-11-03T17:27:05.670 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.671+0000 7fbe54415700 1 -- 172.21.15.26:0/2273055027 shutdown_connections 2021-11-03T17:27:05.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.671+0000 7fbe54415700 1 --2- 172.21.15.26:0/2273055027 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe4c0f6870 0x7fbe4c0f6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:05.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.671+0000 7fbe54415700 1 --2- 172.21.15.26:0/2273055027 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe4c0f55d0 0x7fbe4c0f59f0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:05.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.671+0000 7fbe54415700 1 -- 172.21.15.26:0/2273055027 >> 172.21.15.26:0/2273055027 conn(0x7fbe4c0f0d70 msgr2=0x7fbe4c0f3190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:27:05.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.671+0000 7fbe54415700 1 -- 172.21.15.26:0/2273055027 shutdown_connections 2021-11-03T17:27:05.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.671+0000 7fbe54415700 1 -- 172.21.15.26:0/2273055027 wait complete. 2021-11-03T17:27:05.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.671+0000 7fbe54415700 1 Processor -- start 2021-11-03T17:27:05.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.671+0000 7fbe54415700 1 -- start start 2021-11-03T17:27:05.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.672+0000 7fbe54415700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe4c0f55d0 0x7fbe4c109c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:27:05.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.672+0000 7fbe54415700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe4c0f6870 0x7fbe4c10c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:27:05.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.672+0000 7fbe54415700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c060520 con 0x7fbe4c0f55d0 2021-11-03T17:27:05.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.672+0000 7fbe54415700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c060660 con 0x7fbe4c0f6870 2021-11-03T17:27:05.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.672+0000 7fbe521b1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe4c0f55d0 0x7fbe4c109c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:27:05.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.672+0000 7fbe521b1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe4c0f55d0 0x7fbe4c109c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54494/0 (socket says 172.21.15.26:54494) 2021-11-03T17:27:05.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.672+0000 7fbe521b1700 1 -- 172.21.15.26:0/3483931456 learned_addr learned my addr 172.21.15.26:0/3483931456 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:27:05.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.672+0000 7fbe519b0700 1 --2- 172.21.15.26:0/3483931456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe4c0f6870 0x7fbe4c10c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:27:05.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.672+0000 7fbe521b1700 1 -- 172.21.15.26:0/3483931456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe4c0f6870 msgr2=0x7fbe4c10c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:27:05.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.672+0000 7fbe521b1700 1 --2- 172.21.15.26:0/3483931456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe4c0f6870 0x7fbe4c10c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:05.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.672+0000 7fbe521b1700 1 -- 172.21.15.26:0/3483931456 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe3c005040 con 0x7fbe4c0f55d0 2021-11-03T17:27:05.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.672+0000 7fbe519b0700 1 --2- 172.21.15.26:0/3483931456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe4c0f6870 0x7fbe4c10c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:27:05.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.672+0000 7fbe521b1700 1 --2- 172.21.15.26:0/3483931456 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe4c0f55d0 0x7fbe4c109c00 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7fbe3c004f60 tx=0x7fbe3c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:27:05.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.672+0000 7fbe42ffd700 1 -- 172.21.15.26:0/3483931456 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe3c018070 con 0x7fbe4c0f55d0 2021-11-03T17:27:05.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.672+0000 7fbe42ffd700 1 -- 172.21.15.26:0/3483931456 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbe3c007ba0 con 0x7fbe4c0f55d0 2021-11-03T17:27:05.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.672+0000 7fbe54415700 1 -- 172.21.15.26:0/3483931456 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe4c10c650 con 0x7fbe4c0f55d0 2021-11-03T17:27:05.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.672+0000 7fbe42ffd700 1 -- 172.21.15.26:0/3483931456 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe3c01c620 con 0x7fbe4c0f55d0 2021-11-03T17:27:05.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.672+0000 7fbe54415700 1 -- 172.21.15.26:0/3483931456 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe4c10cbb0 con 0x7fbe4c0f55d0 2021-11-03T17:27:05.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.673+0000 7fbe54415700 1 -- 172.21.15.26:0/3483931456 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe4c045ad0 con 0x7fbe4c0f55d0 2021-11-03T17:27:05.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.674+0000 7fbe42ffd700 1 -- 172.21.15.26:0/3483931456 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fbe3c01c8e0 con 0x7fbe4c0f55d0 2021-11-03T17:27:05.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.674+0000 7fbe42ffd700 1 --2- 172.21.15.26:0/3483931456 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbe380640b0 0x7fbe38066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:27:05.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.674+0000 7fbe42ffd700 1 -- 172.21.15.26:0/3483931456 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fbe3c0826c0 con 0x7fbe4c0f55d0 2021-11-03T17:27:05.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.674+0000 7fbe519b0700 1 --2- 172.21.15.26:0/3483931456 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbe380640b0 0x7fbe38066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:27:05.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.675+0000 7fbe519b0700 1 --2- 172.21.15.26:0/3483931456 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbe380640b0 0x7fbe38066570 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7fbe48004a70 tx=0x7fbe48009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:27:05.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.678+0000 7fbe42ffd700 1 -- 172.21.15.26:0/3483931456 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fbe3c054a20 con 0x7fbe4c0f55d0 2021-11-03T17:27:05.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.879+0000 7fbe54415700 1 -- 172.21.15.26:0/3483931456 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbe4c0fdd90 con 0x7fbe4c0f55d0 2021-11-03T17:27:05.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.880+0000 7fbe42ffd700 1 -- 172.21.15.26:0/3483931456 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fbe3c054610 con 0x7fbe4c0f55d0 2021-11-03T17:27:05.876 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:27:05.876 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:27:05.876 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:27:05.877 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:27:05.877 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:27:05.877 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:27:05.877 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:27:05.878 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:27:05.878 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:27:05.878 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:27:05.878 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:27:05.879 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:27:05.879 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:27:05.879 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:27:05.879 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:27:05.879 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:27:05.880 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:27:05.880 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:27:05.880 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:27:05.880 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:27:05.881 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:27:05.881 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:27:05.881 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:27:05.881 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:27:05.881 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:27:05.882 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:27:05.882 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:27:05.882 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:27:05.882 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:27:05.883 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:27:05.883 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:27:05.883 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:27:05.884 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:27:05.884 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:27:05.884 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:27:05.884 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:27:05.885 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:27:05.885 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:27:05.885 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:27:05.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.881+0000 7fbe54415700 1 -- 172.21.15.26:0/3483931456 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbe380640b0 msgr2=0x7fbe38066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:27:05.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.881+0000 7fbe54415700 1 --2- 172.21.15.26:0/3483931456 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbe380640b0 0x7fbe38066570 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7fbe48004a70 tx=0x7fbe48009040).stop 2021-11-03T17:27:05.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.881+0000 7fbe54415700 1 -- 172.21.15.26:0/3483931456 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe4c0f55d0 msgr2=0x7fbe4c109c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:27:05.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.881+0000 7fbe54415700 1 --2- 172.21.15.26:0/3483931456 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe4c0f55d0 0x7fbe4c109c00 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7fbe3c004f60 tx=0x7fbe3c009b30).stop 2021-11-03T17:27:05.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.882+0000 7fbe54415700 1 -- 172.21.15.26:0/3483931456 shutdown_connections 2021-11-03T17:27:05.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.882+0000 7fbe54415700 1 --2- 172.21.15.26:0/3483931456 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbe380640b0 0x7fbe38066570 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:05.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.882+0000 7fbe54415700 1 --2- 172.21.15.26:0/3483931456 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe4c0f55d0 0x7fbe4c109c00 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:05.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.882+0000 7fbe54415700 1 --2- 172.21.15.26:0/3483931456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe4c0f6870 0x7fbe4c10c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:05.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.882+0000 7fbe54415700 1 -- 172.21.15.26:0/3483931456 >> 172.21.15.26:0/3483931456 conn(0x7fbe4c0f0d70 msgr2=0x7fbe4c0fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:27:05.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.882+0000 7fbe54415700 1 -- 172.21.15.26:0/3483931456 shutdown_connections 2021-11-03T17:27:05.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:05.882+0000 7fbe54415700 1 -- 172.21.15.26:0/3483931456 wait complete. 2021-11-03T17:27:05.889 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:27:06.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:06 smithi026 ceph-mon[96795]: pgmap v973: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:06.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:06 smithi026 ceph-mon[96795]: from='client.35148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:27:06.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:06 smithi026 ceph-mon[96795]: from='client.35152 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:27:06.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:06 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2256223911' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:27:06.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:06 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3483931456' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:27:06.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:06 smithi194 ceph-mon[65619]: pgmap v973: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:06.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:06 smithi194 ceph-mon[65619]: from='client.35148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:27:06.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:06 smithi194 ceph-mon[65619]: from='client.35152 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:27:06.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:06 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2256223911' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:27:06.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:06 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3483931456' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:27:08.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:08 smithi026 ceph-mon[96795]: pgmap v974: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:08.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:08 smithi194 ceph-mon[65619]: pgmap v974: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:10.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:10 smithi026 ceph-mon[96795]: pgmap v975: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:10.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:10 smithi194 ceph-mon[65619]: pgmap v975: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:12.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:12 smithi026 ceph-mon[96795]: pgmap v976: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:12.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:12 smithi194 ceph-mon[65619]: pgmap v976: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:14.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:14 smithi026 ceph-mon[96795]: pgmap v977: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:14.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:14 smithi194 ceph-mon[65619]: pgmap v977: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:15.573 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:15 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:27:15.573 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:15 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:27:15.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:15 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:27:15.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:15 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:27:16.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:16 smithi026 ceph-mon[96795]: pgmap v978: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:16.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:16 smithi194 ceph-mon[65619]: pgmap v978: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:18.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:18 smithi026 ceph-mon[96795]: pgmap v979: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:18.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:18 smithi194 ceph-mon[65619]: pgmap v979: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:20.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:20 smithi026 ceph-mon[96795]: pgmap v980: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:20.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:20 smithi194 ceph-mon[65619]: pgmap v980: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:22.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:22 smithi026 ceph-mon[96795]: pgmap v981: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:22.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:22 smithi194 ceph-mon[65619]: pgmap v981: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:24.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:24 smithi026 ceph-mon[96795]: pgmap v982: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:24.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:24 smithi194 ceph-mon[65619]: pgmap v982: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:26.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:26 smithi026 ceph-mon[96795]: pgmap v983: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:26.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:26 smithi194 ceph-mon[65619]: pgmap v983: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:28.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:28 smithi026 ceph-mon[96795]: pgmap v984: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:28.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:28 smithi194 ceph-mon[65619]: pgmap v984: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:30.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:30 smithi026 ceph-mon[96795]: pgmap v985: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:30.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:30 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:27:30.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:30 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:27:30.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:30 smithi194 ceph-mon[65619]: pgmap v985: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:30.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:30 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:27:30.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:30 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:27:32.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:32 smithi026 ceph-mon[96795]: pgmap v986: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:32.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:32 smithi194 ceph-mon[65619]: pgmap v986: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:34.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:34 smithi026 ceph-mon[96795]: pgmap v987: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:34.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:34 smithi194 ceph-mon[65619]: pgmap v987: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:35.994 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:35.997+0000 7f87133af700 1 -- 172.21.15.26:0/3151959967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f870c0f5ef0 msgr2=0x7f870c0f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:27:35.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:35.997+0000 7f87133af700 1 --2- 172.21.15.26:0/3151959967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f870c0f5ef0 0x7f870c0f6920 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7f86fc004660 tx=0x7f86fc009b30).stop 2021-11-03T17:27:35.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:35.997+0000 7f87133af700 1 -- 172.21.15.26:0/3151959967 shutdown_connections 2021-11-03T17:27:35.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:35.997+0000 7f87133af700 1 --2- 172.21.15.26:0/3151959967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f870c0f5ef0 0x7f870c0f6920 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:35.997 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:35.997+0000 7f87133af700 1 --2- 172.21.15.26:0/3151959967 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f870c0f55e0 0x7f870c0f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:35.997 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:35.997+0000 7f87133af700 1 -- 172.21.15.26:0/3151959967 >> 172.21.15.26:0/3151959967 conn(0x7f870c0f0de0 msgr2=0x7f870c0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:27:35.997 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:35.997+0000 7f87133af700 1 -- 172.21.15.26:0/3151959967 shutdown_connections 2021-11-03T17:27:35.997 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:35.997+0000 7f87133af700 1 -- 172.21.15.26:0/3151959967 wait complete. 2021-11-03T17:27:35.997 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:35.998+0000 7f87133af700 1 Processor -- start 2021-11-03T17:27:35.998 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:35.998+0000 7f87133af700 1 -- start start 2021-11-03T17:27:35.998 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:35.998+0000 7f87133af700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f870c0f55e0 0x7f870c10c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:27:35.998 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:35.998+0000 7f87133af700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f870c0f5ef0 0x7f870c10e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:27:35.998 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:35.998+0000 7f87133af700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870c0603d0 con 0x7f870c0f55e0 2021-11-03T17:27:35.999 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:35.998+0000 7f87133af700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870c060510 con 0x7f870c0f5ef0 2021-11-03T17:27:35.999 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:35.998+0000 7f871114b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f870c0f55e0 0x7f870c10c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:27:35.999 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:35.998+0000 7f871114b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f870c0f55e0 0x7f870c10c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54512/0 (socket says 172.21.15.26:54512) 2021-11-03T17:27:35.999 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:35.998+0000 7f871114b700 1 -- 172.21.15.26:0/309377950 learned_addr learned my addr 172.21.15.26:0/309377950 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:27:36.000 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:35.999+0000 7f871094a700 1 --2- 172.21.15.26:0/309377950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f870c0f5ef0 0x7f870c10e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:27:36.000 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:35.999+0000 7f871114b700 1 -- 172.21.15.26:0/309377950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f870c0f5ef0 msgr2=0x7f870c10e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:27:36.000 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:35.999+0000 7f871114b700 1 --2- 172.21.15.26:0/309377950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f870c0f5ef0 0x7f870c10e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:36.000 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:35.999+0000 7f871114b700 1 -- 172.21.15.26:0/309377950 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86fc005040 con 0x7f870c0f55e0 2021-11-03T17:27:36.001 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:35.999+0000 7f871094a700 1 --2- 172.21.15.26:0/309377950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f870c0f5ef0 0x7f870c10e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:27:36.001 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:35.999+0000 7f871114b700 1 --2- 172.21.15.26:0/309377950 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f870c0f55e0 0x7f870c10c0b0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f870400c760 tx=0x7f8704004d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:27:36.001 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:35.999+0000 7f8701ffb700 1 -- 172.21.15.26:0/309377950 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8704004200 con 0x7f870c0f55e0 2021-11-03T17:27:36.001 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:35.999+0000 7f8701ffb700 1 -- 172.21.15.26:0/309377950 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f87040109c0 con 0x7f870c0f55e0 2021-11-03T17:27:36.001 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:35.999+0000 7f8701ffb700 1 -- 172.21.15.26:0/309377950 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8704003920 con 0x7f870c0f55e0 2021-11-03T17:27:36.002 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:35.999+0000 7f87133af700 1 -- 172.21.15.26:0/309377950 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f870c10eaa0 con 0x7f870c0f55e0 2021-11-03T17:27:36.002 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:35.999+0000 7f87133af700 1 -- 172.21.15.26:0/309377950 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f870c10ef20 con 0x7f870c0f55e0 2021-11-03T17:27:36.002 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.000+0000 7f87133af700 1 -- 172.21.15.26:0/309377950 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f870c045ad0 con 0x7f870c0f55e0 2021-11-03T17:27:36.003 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.000+0000 7f8701ffb700 1 -- 172.21.15.26:0/309377950 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f8704018020 con 0x7f870c0f55e0 2021-11-03T17:27:36.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.001+0000 7f8701ffb700 1 --2- 172.21.15.26:0/309377950 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f86f80640b0 0x7f86f8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:27:36.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.001+0000 7f8701ffb700 1 -- 172.21.15.26:0/309377950 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f8704080780 con 0x7f870c0f55e0 2021-11-03T17:27:36.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.001+0000 7f871094a700 1 --2- 172.21.15.26:0/309377950 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f86f80640b0 0x7f86f8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:27:36.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.001+0000 7f871094a700 1 --2- 172.21.15.26:0/309377950 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f86f80640b0 0x7f86f8066570 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f86fc009da0 tx=0x7f86fc009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:27:36.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.005+0000 7f8701ffb700 1 -- 172.21.15.26:0/309377950 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f87040529f0 con 0x7f870c0f55e0 2021-11-03T17:27:36.180 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.186+0000 7f87133af700 1 -- 172.21.15.26:0/309377950 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f870c057f10 con 0x7f86f80640b0 2021-11-03T17:27:36.181 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.187+0000 7f8701ffb700 1 -- 172.21.15.26:0/309377950 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f870c057f10 con 0x7f86f80640b0 2021-11-03T17:27:36.183 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.189+0000 7f87133af700 1 -- 172.21.15.26:0/309377950 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f86f80640b0 msgr2=0x7f86f8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:27:36.183 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.189+0000 7f87133af700 1 --2- 172.21.15.26:0/309377950 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f86f80640b0 0x7f86f8066570 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f86fc009da0 tx=0x7f86fc009b30).stop 2021-11-03T17:27:36.184 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.189+0000 7f87133af700 1 -- 172.21.15.26:0/309377950 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f870c0f55e0 msgr2=0x7f870c10c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:27:36.184 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.189+0000 7f87133af700 1 --2- 172.21.15.26:0/309377950 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f870c0f55e0 0x7f870c10c0b0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f870400c760 tx=0x7f8704004d20).stop 2021-11-03T17:27:36.184 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.189+0000 7f87133af700 1 -- 172.21.15.26:0/309377950 shutdown_connections 2021-11-03T17:27:36.184 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.189+0000 7f87133af700 1 --2- 172.21.15.26:0/309377950 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f86f80640b0 0x7f86f8066570 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:36.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.189+0000 7f87133af700 1 --2- 172.21.15.26:0/309377950 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f870c0f55e0 0x7f870c10c0b0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:36.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.189+0000 7f87133af700 1 --2- 172.21.15.26:0/309377950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f870c0f5ef0 0x7f870c10e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:36.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.189+0000 7f87133af700 1 -- 172.21.15.26:0/309377950 >> 172.21.15.26:0/309377950 conn(0x7f870c0f0de0 msgr2=0x7f870c0fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:27:36.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.189+0000 7f87133af700 1 -- 172.21.15.26:0/309377950 shutdown_connections 2021-11-03T17:27:36.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.189+0000 7f87133af700 1 -- 172.21.15.26:0/309377950 wait complete. 2021-11-03T17:27:36.193 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:27:36.284 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.290+0000 7fb40cf6d700 1 -- 172.21.15.26:0/2708541399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4080f5430 msgr2=0x7fb4080f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:27:36.284 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.290+0000 7fb40cf6d700 1 --2- 172.21.15.26:0/2708541399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4080f5430 0x7fb4080f5850 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7fb3f8004660 tx=0x7fb3f8009b30).stop 2021-11-03T17:27:36.285 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.290+0000 7fb40cf6d700 1 -- 172.21.15.26:0/2708541399 shutdown_connections 2021-11-03T17:27:36.285 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.290+0000 7fb40cf6d700 1 --2- 172.21.15.26:0/2708541399 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4080f66d0 0x7fb4080f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:36.285 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.290+0000 7fb40cf6d700 1 --2- 172.21.15.26:0/2708541399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4080f5430 0x7fb4080f5850 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:36.286 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.290+0000 7fb40cf6d700 1 -- 172.21.15.26:0/2708541399 >> 172.21.15.26:0/2708541399 conn(0x7fb4080f0b90 msgr2=0x7fb4080f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:27:36.286 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.290+0000 7fb40cf6d700 1 -- 172.21.15.26:0/2708541399 shutdown_connections 2021-11-03T17:27:36.286 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.290+0000 7fb40cf6d700 1 -- 172.21.15.26:0/2708541399 wait complete. 2021-11-03T17:27:36.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.290+0000 7fb40cf6d700 1 Processor -- start 2021-11-03T17:27:36.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.290+0000 7fb40cf6d700 1 -- start start 2021-11-03T17:27:36.290 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.291+0000 7fb40cf6d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4080f5430 0x7fb408109ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:27:36.291 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.291+0000 7fb40cf6d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4080f66d0 0x7fb40810bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:27:36.291 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.291+0000 7fb40cf6d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4080603c0 con 0x7fb4080f5430 2021-11-03T17:27:36.291 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.291+0000 7fb40cf6d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb408060500 con 0x7fb4080f66d0 2021-11-03T17:27:36.291 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.291+0000 7fb4077fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4080f5430 0x7fb408109ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:27:36.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.291+0000 7fb4077fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4080f5430 0x7fb408109ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54522/0 (socket says 172.21.15.26:54522) 2021-11-03T17:27:36.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.291+0000 7fb4077fe700 1 -- 172.21.15.26:0/2439329295 learned_addr learned my addr 172.21.15.26:0/2439329295 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:27:36.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.291+0000 7fb406ffd700 1 --2- 172.21.15.26:0/2439329295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4080f66d0 0x7fb40810bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:27:36.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.291+0000 7fb4077fe700 1 -- 172.21.15.26:0/2439329295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4080f66d0 msgr2=0x7fb40810bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:27:36.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.291+0000 7fb4077fe700 1 --2- 172.21.15.26:0/2439329295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4080f66d0 0x7fb40810bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:36.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.291+0000 7fb4077fe700 1 -- 172.21.15.26:0/2439329295 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f8005040 con 0x7fb4080f5430 2021-11-03T17:27:36.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.291+0000 7fb4077fe700 1 --2- 172.21.15.26:0/2439329295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4080f5430 0x7fb408109ab0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7fb3f8009830 tx=0x7fb3f8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:27:36.294 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.291+0000 7fb3effff700 1 -- 172.21.15.26:0/2439329295 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3f8018070 con 0x7fb4080f5430 2021-11-03T17:27:36.294 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.291+0000 7fb40cf6d700 1 -- 172.21.15.26:0/2439329295 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb40810c500 con 0x7fb4080f5430 2021-11-03T17:27:36.294 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.291+0000 7fb3effff700 1 -- 172.21.15.26:0/2439329295 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb3f8007ba0 con 0x7fb4080f5430 2021-11-03T17:27:36.294 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.291+0000 7fb3effff700 1 -- 172.21.15.26:0/2439329295 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3f801c620 con 0x7fb4080f5430 2021-11-03T17:27:36.295 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.291+0000 7fb40cf6d700 1 -- 172.21.15.26:0/2439329295 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb40810ca30 con 0x7fb4080f5430 2021-11-03T17:27:36.295 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.292+0000 7fb40cf6d700 1 -- 172.21.15.26:0/2439329295 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb408059100 con 0x7fb4080f5430 2021-11-03T17:27:36.295 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.293+0000 7fb3effff700 1 -- 172.21.15.26:0/2439329295 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fb3f8007d10 con 0x7fb4080f5430 2021-11-03T17:27:36.296 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.293+0000 7fb3effff700 1 --2- 172.21.15.26:0/2439329295 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb3f0064100 0x7fb3f00665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:27:36.296 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.293+0000 7fb3effff700 1 -- 172.21.15.26:0/2439329295 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fb3f8082720 con 0x7fb4080f5430 2021-11-03T17:27:36.296 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.293+0000 7fb406ffd700 1 --2- 172.21.15.26:0/2439329295 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb3f0064100 0x7fb3f00665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:27:36.297 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.294+0000 7fb406ffd700 1 --2- 172.21.15.26:0/2439329295 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb3f0064100 0x7fb3f00665c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7fb3fc0096c0 tx=0x7fb3fc009be0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:27:36.297 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.297+0000 7fb3effff700 1 -- 172.21.15.26:0/2439329295 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fb3f8054b40 con 0x7fb4080f5430 2021-11-03T17:27:36.473 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.479+0000 7fb40cf6d700 1 -- 172.21.15.26:0/2439329295 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb4080fdd70 con 0x7fb3f0064100 2021-11-03T17:27:36.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.494+0000 7fb3effff700 1 -- 172.21.15.26:0/2439329295 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fb4080fdd70 con 0x7fb3f0064100 2021-11-03T17:27:36.488 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:27:36.488 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (38m) 8m ago 40m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:27:36.489 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (31m) 8m ago 40m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:27:36.489 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (30m) 7m ago 39m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:27:36.489 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (38m) 8m ago 39m 39.6M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:27:36.490 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (31m) 8m ago 35m 19.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:27:36.490 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (32m) 8m ago 35m 20.6M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:27:36.490 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (35m) 7m ago 35m 22.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:27:36.490 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (35m) 7m ago 35m 22.2M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:27:36.491 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (32m) 8m ago 41m 505M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:27:36.491 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (32m) 7m ago 39m 419M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:27:36.491 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (31m) 8m ago 41m 147M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:27:36.491 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (31m) 7m ago 39m 75.7M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:27:36.492 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (39m) 8m ago 39m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:27:36.492 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (39m) 7m ago 39m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:27:36.492 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (30m) 8m ago 38m 211M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:27:36.492 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (30m) 8m ago 38m 226M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:27:36.493 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (29m) 8m ago 37m 189M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:27:36.493 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (29m) 7m ago 37m 236M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:27:36.493 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (28m) 7m ago 37m 208M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:27:36.493 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (28m) 7m ago 36m 194M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:27:36.493 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (38m) 8m ago 39m 52.1M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:27:36.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.496+0000 7fb40cf6d700 1 -- 172.21.15.26:0/2439329295 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb3f0064100 msgr2=0x7fb3f00665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:27:36.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.496+0000 7fb40cf6d700 1 --2- 172.21.15.26:0/2439329295 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb3f0064100 0x7fb3f00665c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7fb3fc0096c0 tx=0x7fb3fc009be0).stop 2021-11-03T17:27:36.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.496+0000 7fb40cf6d700 1 -- 172.21.15.26:0/2439329295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4080f5430 msgr2=0x7fb408109ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:27:36.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.496+0000 7fb40cf6d700 1 --2- 172.21.15.26:0/2439329295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4080f5430 0x7fb408109ab0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7fb3f8009830 tx=0x7fb3f8009b30).stop 2021-11-03T17:27:36.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.496+0000 7fb40cf6d700 1 -- 172.21.15.26:0/2439329295 shutdown_connections 2021-11-03T17:27:36.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.496+0000 7fb40cf6d700 1 --2- 172.21.15.26:0/2439329295 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb3f0064100 0x7fb3f00665c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:36.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.496+0000 7fb40cf6d700 1 --2- 172.21.15.26:0/2439329295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4080f5430 0x7fb408109ab0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:36.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.496+0000 7fb40cf6d700 1 --2- 172.21.15.26:0/2439329295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4080f66d0 0x7fb40810bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:36.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.496+0000 7fb40cf6d700 1 -- 172.21.15.26:0/2439329295 >> 172.21.15.26:0/2439329295 conn(0x7fb4080f0b90 msgr2=0x7fb4080fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:27:36.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.496+0000 7fb40cf6d700 1 -- 172.21.15.26:0/2439329295 shutdown_connections 2021-11-03T17:27:36.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.496+0000 7fb40cf6d700 1 -- 172.21.15.26:0/2439329295 wait complete. 2021-11-03T17:27:36.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.595+0000 7fc323736700 1 -- 172.21.15.26:0/1658572069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc31c0f55e0 msgr2=0x7fc31c0f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:27:36.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.595+0000 7fc323736700 1 --2- 172.21.15.26:0/1658572069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc31c0f55e0 0x7fc31c0f5a00 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7fc3140099e0 tx=0x7fc314004d10).stop 2021-11-03T17:27:36.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.595+0000 7fc323736700 1 -- 172.21.15.26:0/1658572069 shutdown_connections 2021-11-03T17:27:36.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.595+0000 7fc323736700 1 --2- 172.21.15.26:0/1658572069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc31c0f5ef0 0x7fc31c0f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:36.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.595+0000 7fc323736700 1 --2- 172.21.15.26:0/1658572069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc31c0f55e0 0x7fc31c0f5a00 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:36.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.595+0000 7fc323736700 1 -- 172.21.15.26:0/1658572069 >> 172.21.15.26:0/1658572069 conn(0x7fc31c0f0de0 msgr2=0x7fc31c0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:27:36.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.595+0000 7fc323736700 1 -- 172.21.15.26:0/1658572069 shutdown_connections 2021-11-03T17:27:36.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.595+0000 7fc323736700 1 -- 172.21.15.26:0/1658572069 wait complete. 2021-11-03T17:27:36.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.596+0000 7fc323736700 1 Processor -- start 2021-11-03T17:27:36.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.596+0000 7fc323736700 1 -- start start 2021-11-03T17:27:36.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.596+0000 7fc323736700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc31c0f55e0 0x7fc31c0f97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:27:36.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.596+0000 7fc323736700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc31c0f5ef0 0x7fc31c0f7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:27:36.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.596+0000 7fc323736700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c0f81c0 con 0x7fc31c0f5ef0 2021-11-03T17:27:36.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.596+0000 7fc323736700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c0f8300 con 0x7fc31c0f55e0 2021-11-03T17:27:36.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.596+0000 7fc320cd1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc31c0f5ef0 0x7fc31c0f7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:27:36.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.596+0000 7fc320cd1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc31c0f5ef0 0x7fc31c0f7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54534/0 (socket says 172.21.15.26:54534) 2021-11-03T17:27:36.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.596+0000 7fc320cd1700 1 -- 172.21.15.26:0/3822477913 learned_addr learned my addr 172.21.15.26:0/3822477913 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:27:36.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.596+0000 7fc3214d2700 1 --2- 172.21.15.26:0/3822477913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc31c0f55e0 0x7fc31c0f97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:27:36.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.596+0000 7fc320cd1700 1 -- 172.21.15.26:0/3822477913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc31c0f55e0 msgr2=0x7fc31c0f97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:27:36.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.596+0000 7fc320cd1700 1 --2- 172.21.15.26:0/3822477913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc31c0f55e0 0x7fc31c0f97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:36.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.596+0000 7fc320cd1700 1 -- 172.21.15.26:0/3822477913 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc314009640 con 0x7fc31c0f5ef0 2021-11-03T17:27:36.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.596+0000 7fc320cd1700 1 --2- 172.21.15.26:0/3822477913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc31c0f5ef0 0x7fc31c0f7c60 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7fc31000c530 tx=0x7fc310007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:27:36.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.596+0000 7fc319ffb700 1 -- 172.21.15.26:0/3822477913 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc31000f650 con 0x7fc31c0f5ef0 2021-11-03T17:27:36.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.596+0000 7fc323736700 1 -- 172.21.15.26:0/3822477913 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc31c0f85e0 con 0x7fc31c0f5ef0 2021-11-03T17:27:36.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.596+0000 7fc319ffb700 1 -- 172.21.15.26:0/3822477913 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc31000fc60 con 0x7fc31c0f5ef0 2021-11-03T17:27:36.600 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.596+0000 7fc319ffb700 1 -- 172.21.15.26:0/3822477913 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc310012c20 con 0x7fc31c0f5ef0 2021-11-03T17:27:36.600 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.597+0000 7fc323736700 1 -- 172.21.15.26:0/3822477913 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc31c10f090 con 0x7fc31c0f5ef0 2021-11-03T17:27:36.601 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.598+0000 7fc323736700 1 -- 172.21.15.26:0/3822477913 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc31c0f4a70 con 0x7fc31c0f5ef0 2021-11-03T17:27:36.601 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.598+0000 7fc319ffb700 1 -- 172.21.15.26:0/3822477913 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc310010070 con 0x7fc31c0f5ef0 2021-11-03T17:27:36.603 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.598+0000 7fc319ffb700 1 --2- 172.21.15.26:0/3822477913 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3040640b0 0x7fc304066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:27:36.604 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.598+0000 7fc319ffb700 1 -- 172.21.15.26:0/3822477913 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc310080660 con 0x7fc31c0f5ef0 2021-11-03T17:27:36.604 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.598+0000 7fc3214d2700 1 --2- 172.21.15.26:0/3822477913 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3040640b0 0x7fc304066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:27:36.605 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.599+0000 7fc3214d2700 1 --2- 172.21.15.26:0/3822477913 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3040640b0 0x7fc304066570 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fc31400b730 tx=0x7fc314004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:27:36.605 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.602+0000 7fc319ffb700 1 -- 172.21.15.26:0/3822477913 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc3100528d0 con 0x7fc31c0f5ef0 2021-11-03T17:27:36.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:36 smithi026 ceph-mon[96795]: pgmap v988: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:36.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:36 smithi194 ceph-mon[65619]: pgmap v988: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:36.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.831+0000 7fc323736700 1 -- 172.21.15.26:0/3822477913 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc31c045ad0 con 0x7fc31c0f5ef0 2021-11-03T17:27:36.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.832+0000 7fc319ffb700 1 -- 172.21.15.26:0/3822477913 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fc3100524c0 con 0x7fc31c0f5ef0 2021-11-03T17:27:36.827 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:27:36.827 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:27:36.827 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:27:36.827 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:27:36.828 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:27:36.828 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:27:36.828 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:27:36.828 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:27:36.829 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:27:36.829 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:27:36.829 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:27:36.830 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:27:36.830 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:27:36.831 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:27:36.831 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:27:36.832 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:27:36.832 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:27:36.833 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:27:36.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.834+0000 7fc323736700 1 -- 172.21.15.26:0/3822477913 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3040640b0 msgr2=0x7fc304066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:27:36.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.834+0000 7fc323736700 1 --2- 172.21.15.26:0/3822477913 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3040640b0 0x7fc304066570 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fc31400b730 tx=0x7fc314004d10).stop 2021-11-03T17:27:36.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.834+0000 7fc323736700 1 -- 172.21.15.26:0/3822477913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc31c0f5ef0 msgr2=0x7fc31c0f7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:27:36.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.834+0000 7fc323736700 1 --2- 172.21.15.26:0/3822477913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc31c0f5ef0 0x7fc31c0f7c60 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7fc31000c530 tx=0x7fc310007e20).stop 2021-11-03T17:27:36.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.834+0000 7fc323736700 1 -- 172.21.15.26:0/3822477913 shutdown_connections 2021-11-03T17:27:36.837 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.834+0000 7fc323736700 1 --2- 172.21.15.26:0/3822477913 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3040640b0 0x7fc304066570 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:36.837 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.834+0000 7fc323736700 1 --2- 172.21.15.26:0/3822477913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc31c0f55e0 0x7fc31c0f97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:36.838 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.834+0000 7fc323736700 1 --2- 172.21.15.26:0/3822477913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc31c0f5ef0 0x7fc31c0f7c60 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:36.838 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.834+0000 7fc323736700 1 -- 172.21.15.26:0/3822477913 >> 172.21.15.26:0/3822477913 conn(0x7fc31c0f0de0 msgr2=0x7fc31c05ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:27:36.838 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.834+0000 7fc323736700 1 -- 172.21.15.26:0/3822477913 shutdown_connections 2021-11-03T17:27:36.839 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.834+0000 7fc323736700 1 -- 172.21.15.26:0/3822477913 wait complete. 2021-11-03T17:27:36.929 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.934+0000 7f543d3aa700 1 -- 172.21.15.26:0/272731542 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54380f55e0 msgr2=0x7f54380f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:27:36.929 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.934+0000 7f543d3aa700 1 --2- 172.21.15.26:0/272731542 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54380f55e0 0x7f54380f5a00 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f5430004660 tx=0x7f5430009b30).stop 2021-11-03T17:27:36.929 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.935+0000 7f543d3aa700 1 -- 172.21.15.26:0/272731542 shutdown_connections 2021-11-03T17:27:36.929 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.935+0000 7f543d3aa700 1 --2- 172.21.15.26:0/272731542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54380f5ef0 0x7f54380f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:36.930 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.935+0000 7f543d3aa700 1 --2- 172.21.15.26:0/272731542 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54380f55e0 0x7f54380f5a00 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:36.930 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.935+0000 7f543d3aa700 1 -- 172.21.15.26:0/272731542 >> 172.21.15.26:0/272731542 conn(0x7f54380f0de0 msgr2=0x7f54380f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:27:36.930 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.935+0000 7f543d3aa700 1 -- 172.21.15.26:0/272731542 shutdown_connections 2021-11-03T17:27:36.930 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.935+0000 7f543d3aa700 1 -- 172.21.15.26:0/272731542 wait complete. 2021-11-03T17:27:36.933 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.935+0000 7f543d3aa700 1 Processor -- start 2021-11-03T17:27:36.933 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.935+0000 7f543d3aa700 1 -- start start 2021-11-03T17:27:36.934 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.935+0000 7f543d3aa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54380f55e0 0x7f5438109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:27:36.934 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.935+0000 7f543d3aa700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54380f5ef0 0x7f543810c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:27:36.934 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.936+0000 7f543d3aa700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54380604c0 con 0x7f54380f55e0 2021-11-03T17:27:36.934 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.936+0000 7f543d3aa700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5438060600 con 0x7f54380f5ef0 2021-11-03T17:27:36.934 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.936+0000 7f5436ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54380f55e0 0x7f5438109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:27:36.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.936+0000 7f5436ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54380f55e0 0x7f5438109cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54542/0 (socket says 172.21.15.26:54542) 2021-11-03T17:27:36.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.936+0000 7f5436ffd700 1 -- 172.21.15.26:0/3957359349 learned_addr learned my addr 172.21.15.26:0/3957359349 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:27:36.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.936+0000 7f54367fc700 1 --2- 172.21.15.26:0/3957359349 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54380f5ef0 0x7f543810c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:27:36.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.936+0000 7f5436ffd700 1 -- 172.21.15.26:0/3957359349 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54380f5ef0 msgr2=0x7f543810c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:27:36.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.936+0000 7f5436ffd700 1 --2- 172.21.15.26:0/3957359349 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54380f5ef0 0x7f543810c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:36.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.936+0000 7f5436ffd700 1 -- 172.21.15.26:0/3957359349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5430005040 con 0x7f54380f55e0 2021-11-03T17:27:36.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.936+0000 7f5436ffd700 1 --2- 172.21.15.26:0/3957359349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54380f55e0 0x7f5438109cb0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f5430009990 tx=0x7f5430009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:27:36.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.936+0000 7f542f7fe700 1 -- 172.21.15.26:0/3957359349 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5430018070 con 0x7f54380f55e0 2021-11-03T17:27:36.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.936+0000 7f543d3aa700 1 -- 172.21.15.26:0/3957359349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f543810c700 con 0x7f54380f55e0 2021-11-03T17:27:36.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.936+0000 7f542f7fe700 1 -- 172.21.15.26:0/3957359349 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5430007ba0 con 0x7f54380f55e0 2021-11-03T17:27:36.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.936+0000 7f542f7fe700 1 -- 172.21.15.26:0/3957359349 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f543001c3c0 con 0x7f54380f55e0 2021-11-03T17:27:36.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.936+0000 7f543d3aa700 1 -- 172.21.15.26:0/3957359349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f543810cc30 con 0x7f54380f55e0 2021-11-03T17:27:36.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.937+0000 7f543d3aa700 1 -- 172.21.15.26:0/3957359349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54380f4a70 con 0x7f54380f55e0 2021-11-03T17:27:36.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.938+0000 7f542f7fe700 1 -- 172.21.15.26:0/3957359349 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f543001d420 con 0x7f54380f55e0 2021-11-03T17:27:36.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.938+0000 7f542f7fe700 1 --2- 172.21.15.26:0/3957359349 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f54240640b0 0x7f5424066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:27:36.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.938+0000 7f542f7fe700 1 -- 172.21.15.26:0/3957359349 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f54300823e0 con 0x7f54380f55e0 2021-11-03T17:27:36.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.938+0000 7f54367fc700 1 --2- 172.21.15.26:0/3957359349 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f54240640b0 0x7f5424066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:27:36.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.938+0000 7f54367fc700 1 --2- 172.21.15.26:0/3957359349 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f54240640b0 0x7f5424066570 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f54200096c0 tx=0x7f5420009be0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:27:36.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:36.942+0000 7f542f7fe700 1 -- 172.21.15.26:0/3957359349 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f54300547a0 con 0x7f54380f55e0 2021-11-03T17:27:37.139 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:37.145+0000 7f543d3aa700 1 -- 172.21.15.26:0/3957359349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5438045ad0 con 0x7f54380f55e0 2021-11-03T17:27:37.139 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:37.145+0000 7f542f7fe700 1 -- 172.21.15.26:0/3957359349 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f5430054390 con 0x7f54380f55e0 2021-11-03T17:27:37.140 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:27:37.140 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:27:37.140 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:27:37.141 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:27:37.141 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:27:37.141 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:27:37.141 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:27:37.142 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:27:37.142 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:27:37.142 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:27:37.142 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:27:37.142 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:27:37.143 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:27:37.143 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:27:37.143 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:27:37.143 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:27:37.144 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:27:37.144 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:27:37.144 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:27:37.144 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:27:37.144 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:27:37.145 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:27:37.145 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:27:37.145 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:27:37.146 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:27:37.147 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:27:37.147 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:27:37.147 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:27:37.148 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:27:37.148 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:27:37.148 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:27:37.149 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:27:37.149 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:27:37.149 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:27:37.150 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:27:37.150 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:27:37.150 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:27:37.150 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:27:37.151 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:27:37.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:37.147+0000 7f543d3aa700 1 -- 172.21.15.26:0/3957359349 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f54240640b0 msgr2=0x7f5424066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:27:37.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:37.147+0000 7f543d3aa700 1 --2- 172.21.15.26:0/3957359349 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f54240640b0 0x7f5424066570 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f54200096c0 tx=0x7f5420009be0).stop 2021-11-03T17:27:37.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:37.147+0000 7f543d3aa700 1 -- 172.21.15.26:0/3957359349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54380f55e0 msgr2=0x7f5438109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:27:37.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:37.147+0000 7f543d3aa700 1 --2- 172.21.15.26:0/3957359349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54380f55e0 0x7f5438109cb0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f5430009990 tx=0x7f5430009b30).stop 2021-11-03T17:27:37.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:37.147+0000 7f543d3aa700 1 -- 172.21.15.26:0/3957359349 shutdown_connections 2021-11-03T17:27:37.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:37.147+0000 7f543d3aa700 1 --2- 172.21.15.26:0/3957359349 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f54240640b0 0x7f5424066570 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:37.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:37.147+0000 7f543d3aa700 1 --2- 172.21.15.26:0/3957359349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54380f55e0 0x7f5438109cb0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:37.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:37.147+0000 7f543d3aa700 1 --2- 172.21.15.26:0/3957359349 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54380f5ef0 0x7f543810c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:27:37.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:37.147+0000 7f543d3aa700 1 -- 172.21.15.26:0/3957359349 >> 172.21.15.26:0/3957359349 conn(0x7f54380f0de0 msgr2=0x7f54380fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:27:37.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:37.147+0000 7f543d3aa700 1 -- 172.21.15.26:0/3957359349 shutdown_connections 2021-11-03T17:27:37.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:27:37.147+0000 7f543d3aa700 1 -- 172.21.15.26:0/3957359349 wait complete. 2021-11-03T17:27:37.158 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:27:37.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:37 smithi026 ceph-mon[96795]: from='client.35164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:27:37.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:37 smithi026 ceph-mon[96795]: from='client.35168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:27:37.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:37 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3822477913' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:27:37.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:37 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3957359349' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:27:37.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:37 smithi194 ceph-mon[65619]: from='client.35164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:27:37.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:37 smithi194 ceph-mon[65619]: from='client.35168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:27:37.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:37 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3822477913' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:27:37.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:37 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3957359349' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:27:38.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:38 smithi026 ceph-mon[96795]: pgmap v989: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:38.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:38 smithi194 ceph-mon[65619]: pgmap v989: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:40.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:40 smithi026 ceph-mon[96795]: pgmap v990: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:40.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:40 smithi194 ceph-mon[65619]: pgmap v990: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:42.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:42 smithi026 ceph-mon[96795]: pgmap v991: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:42.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:42 smithi194 ceph-mon[65619]: pgmap v991: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:44.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:44 smithi026 ceph-mon[96795]: pgmap v992: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:44.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:44 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:27:44.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:44 smithi194 ceph-mon[65619]: pgmap v992: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:44.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:44 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:27:45.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:45 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:27:45.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:45 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:27:46.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:46 smithi026 ceph-mon[96795]: pgmap v993: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:46.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:46 smithi194 ceph-mon[65619]: pgmap v993: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:48 smithi026 ceph-mon[96795]: pgmap v994: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:27:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:27:48.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:48 smithi194 ceph-mon[65619]: pgmap v994: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:27:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:27:50.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:50 smithi026 ceph-mon[96795]: pgmap v995: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:50.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:50 smithi194 ceph-mon[65619]: pgmap v995: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:52.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:52 smithi026 ceph-mon[96795]: pgmap v996: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:52.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:52 smithi194 ceph-mon[65619]: pgmap v996: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:54.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:54 smithi026 ceph-mon[96795]: pgmap v997: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:54.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:54 smithi194 ceph-mon[65619]: pgmap v997: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:56.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:56 smithi026 ceph-mon[96795]: pgmap v998: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:56.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:56 smithi194 ceph-mon[65619]: pgmap v998: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:58.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:27:58 smithi026 ceph-mon[96795]: pgmap v999: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:27:58.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:27:58 smithi194 ceph-mon[65619]: pgmap v999: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:00.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:00 smithi026 ceph-mon[96795]: pgmap v1000: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:00.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:00 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:28:00.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:00 smithi026 ceph-mon[96795]: poll took 60064.018 ms: 1 events 2021-11-03T17:28:00.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:00 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:28:00.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:00 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:28:00.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:00 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:28:00.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:00 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:28:00.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:00 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:28:00.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:00 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:28:00.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:00 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:28:00.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:00 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:28:00.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:00 smithi194 ceph-mon[65619]: pgmap v1000: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:00.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:00 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:28:00.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:00 smithi194 ceph-mon[65619]: poll took 60064.018 ms: 1 events 2021-11-03T17:28:00.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:00 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:28:00.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:00 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:28:00.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:00 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:28:00.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:00 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:28:00.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:00 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:28:00.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:00 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:28:00.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:00 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:28:00.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:00 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:28:01.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:01 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:28:01.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:01 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:28:01.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:01 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:28:01.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:01 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:28:02.420 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:02 smithi026 ceph-mon[96795]: pgmap v1001: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:02.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:02 smithi194 ceph-mon[65619]: pgmap v1001: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:04.420 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:04 smithi026 ceph-mon[96795]: pgmap v1002: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:04.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:04 smithi194 ceph-mon[65619]: pgmap v1002: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:06.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:06 smithi026 ceph-mon[96795]: pgmap v1003: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:06.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:06 smithi194 ceph-mon[65619]: pgmap v1003: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:07.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.262+0000 7feaeeea1700 1 -- 172.21.15.26:0/2038882338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feae80f5ef0 msgr2=0x7feae80f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:28:07.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.262+0000 7feaeeea1700 1 --2- 172.21.15.26:0/2038882338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feae80f5ef0 0x7feae80f6920 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fead4004660 tx=0x7fead4009b30).stop 2021-11-03T17:28:07.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.262+0000 7feaeeea1700 1 -- 172.21.15.26:0/2038882338 shutdown_connections 2021-11-03T17:28:07.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.262+0000 7feaeeea1700 1 --2- 172.21.15.26:0/2038882338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feae80f5ef0 0x7feae80f6920 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:07.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.262+0000 7feaeeea1700 1 --2- 172.21.15.26:0/2038882338 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feae80f55e0 0x7feae80f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:07.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.262+0000 7feaeeea1700 1 -- 172.21.15.26:0/2038882338 >> 172.21.15.26:0/2038882338 conn(0x7feae80f0de0 msgr2=0x7feae80f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:28:07.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.263+0000 7feaeeea1700 1 -- 172.21.15.26:0/2038882338 shutdown_connections 2021-11-03T17:28:07.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.263+0000 7feaeeea1700 1 -- 172.21.15.26:0/2038882338 wait complete. 2021-11-03T17:28:07.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.263+0000 7feaeeea1700 1 Processor -- start 2021-11-03T17:28:07.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.263+0000 7feaeeea1700 1 -- start start 2021-11-03T17:28:07.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.263+0000 7feaeeea1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feae80f55e0 0x7feae8106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:28:07.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.263+0000 7feaeeea1700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feae80f5ef0 0x7feae8107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:28:07.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.263+0000 7feaeeea1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae8107a10 con 0x7feae80f55e0 2021-11-03T17:28:07.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.263+0000 7feaeeea1700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae8107b50 con 0x7feae80f5ef0 2021-11-03T17:28:07.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.264+0000 7feaecc3d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feae80f55e0 0x7feae8106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:28:07.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.264+0000 7feaecc3d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feae80f55e0 0x7feae8106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54562/0 (socket says 172.21.15.26:54562) 2021-11-03T17:28:07.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.264+0000 7feaecc3d700 1 -- 172.21.15.26:0/56742840 learned_addr learned my addr 172.21.15.26:0/56742840 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:28:07.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.264+0000 7feae7fff700 1 --2- 172.21.15.26:0/56742840 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feae80f5ef0 0x7feae8107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:28:07.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.264+0000 7feaecc3d700 1 -- 172.21.15.26:0/56742840 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feae80f5ef0 msgr2=0x7feae8107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:28:07.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.264+0000 7feaecc3d700 1 --2- 172.21.15.26:0/56742840 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feae80f5ef0 0x7feae8107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:07.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.264+0000 7feaecc3d700 1 -- 172.21.15.26:0/56742840 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead4005040 con 0x7feae80f55e0 2021-11-03T17:28:07.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.264+0000 7feae7fff700 1 --2- 172.21.15.26:0/56742840 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feae80f5ef0 0x7feae8107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:28:07.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.264+0000 7feaecc3d700 1 --2- 172.21.15.26:0/56742840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feae80f55e0 0x7feae8106f70 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7feadc0026d0 tx=0x7feadc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:28:07.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.264+0000 7feae57fa700 1 -- 172.21.15.26:0/56742840 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feadc009320 con 0x7feae80f55e0 2021-11-03T17:28:07.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.264+0000 7feaeeea1700 1 -- 172.21.15.26:0/56742840 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae81084f0 con 0x7feae80f55e0 2021-11-03T17:28:07.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.264+0000 7feae57fa700 1 -- 172.21.15.26:0/56742840 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7feadc00f040 con 0x7feae80f55e0 2021-11-03T17:28:07.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.264+0000 7feae57fa700 1 -- 172.21.15.26:0/56742840 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feadc0147e0 con 0x7feae80f55e0 2021-11-03T17:28:07.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.264+0000 7feaeeea1700 1 -- 172.21.15.26:0/56742840 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae8108ab0 con 0x7feae80f55e0 2021-11-03T17:28:07.268 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.265+0000 7feaeeea1700 1 -- 172.21.15.26:0/56742840 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feae8045ad0 con 0x7feae80f55e0 2021-11-03T17:28:07.268 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.266+0000 7feae57fa700 1 -- 172.21.15.26:0/56742840 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7feadc009480 con 0x7feae80f55e0 2021-11-03T17:28:07.268 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.266+0000 7feae57fa700 1 --2- 172.21.15.26:0/56742840 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fead80640b0 0x7fead8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:28:07.268 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.266+0000 7feae57fa700 1 -- 172.21.15.26:0/56742840 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7feadc080ee0 con 0x7feae80f55e0 2021-11-03T17:28:07.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.266+0000 7feae7fff700 1 --2- 172.21.15.26:0/56742840 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fead80640b0 0x7fead8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:28:07.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.267+0000 7feae7fff700 1 --2- 172.21.15.26:0/56742840 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fead80640b0 0x7fead8066570 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7fead4004630 tx=0x7fead4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:28:07.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.270+0000 7feae57fa700 1 -- 172.21.15.26:0/56742840 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7feadc053240 con 0x7feae80f55e0 2021-11-03T17:28:07.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.447+0000 7feaeeea1700 1 -- 172.21.15.26:0/56742840 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7feae805fe50 con 0x7fead80640b0 2021-11-03T17:28:07.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.449+0000 7feae57fa700 1 -- 172.21.15.26:0/56742840 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7feae805fe50 con 0x7fead80640b0 2021-11-03T17:28:07.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.451+0000 7feaeeea1700 1 -- 172.21.15.26:0/56742840 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fead80640b0 msgr2=0x7fead8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:28:07.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.451+0000 7feaeeea1700 1 --2- 172.21.15.26:0/56742840 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fead80640b0 0x7fead8066570 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7fead4004630 tx=0x7fead4009b30).stop 2021-11-03T17:28:07.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.451+0000 7feaeeea1700 1 -- 172.21.15.26:0/56742840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feae80f55e0 msgr2=0x7feae8106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:28:07.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.451+0000 7feaeeea1700 1 --2- 172.21.15.26:0/56742840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feae80f55e0 0x7feae8106f70 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7feadc0026d0 tx=0x7feadc009de0).stop 2021-11-03T17:28:07.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.451+0000 7feaeeea1700 1 -- 172.21.15.26:0/56742840 shutdown_connections 2021-11-03T17:28:07.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.451+0000 7feaeeea1700 1 --2- 172.21.15.26:0/56742840 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fead80640b0 0x7fead8066570 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:07.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.451+0000 7feaeeea1700 1 --2- 172.21.15.26:0/56742840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feae80f55e0 0x7feae8106f70 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:07.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.451+0000 7feaeeea1700 1 --2- 172.21.15.26:0/56742840 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feae80f5ef0 0x7feae8107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:07.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.451+0000 7feaeeea1700 1 -- 172.21.15.26:0/56742840 >> 172.21.15.26:0/56742840 conn(0x7feae80f0de0 msgr2=0x7feae805f740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:28:07.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.451+0000 7feaeeea1700 1 -- 172.21.15.26:0/56742840 shutdown_connections 2021-11-03T17:28:07.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.451+0000 7feaeeea1700 1 -- 172.21.15.26:0/56742840 wait complete. 2021-11-03T17:28:07.455 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:28:07.550 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.551+0000 7f8e00e13700 1 -- 172.21.15.26:0/3923929597 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8dfc0f6ff0 msgr2=0x7f8dfc0f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:28:07.550 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.551+0000 7f8e00e13700 1 --2- 172.21.15.26:0/3923929597 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8dfc0f6ff0 0x7f8dfc0f7a20 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f8df0004660 tx=0x7f8df0009b30).stop 2021-11-03T17:28:07.551 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.551+0000 7f8e00e13700 1 -- 172.21.15.26:0/3923929597 shutdown_connections 2021-11-03T17:28:07.551 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.551+0000 7f8e00e13700 1 --2- 172.21.15.26:0/3923929597 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8dfc0f6ff0 0x7f8dfc0f7a20 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:07.551 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.551+0000 7f8e00e13700 1 --2- 172.21.15.26:0/3923929597 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8dfc0f66e0 0x7f8dfc0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:28:07.551 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.551+0000 7f8e00e13700 1 -- 172.21.15.26:0/3923929597 >> 172.21.15.26:0/3923929597 conn(0x7f8dfc0f1f00 msgr2=0x7f8dfc0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:28:07.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.552+0000 7f8e00e13700 1 -- 172.21.15.26:0/3923929597 shutdown_connections 2021-11-03T17:28:07.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.552+0000 7f8e00e13700 1 -- 172.21.15.26:0/3923929597 wait complete. 2021-11-03T17:28:07.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.552+0000 7f8e00e13700 1 Processor -- start 2021-11-03T17:28:07.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.552+0000 7f8e00e13700 1 -- start start 2021-11-03T17:28:07.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.552+0000 7f8e00e13700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8dfc0f66e0 0x7f8dfc106fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:28:07.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.552+0000 7f8e00e13700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8dfc0f6ff0 0x7f8dfc107490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:28:07.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.552+0000 7f8e00e13700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc107ad0 con 0x7f8dfc0f66e0 2021-11-03T17:28:07.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.552+0000 7f8e00e13700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc108380 con 0x7f8dfc0f6ff0 2021-11-03T17:28:07.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.552+0000 7f8dfa59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8dfc0f66e0 0x7f8dfc106fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:28:07.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.552+0000 7f8dfa59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8dfc0f66e0 0x7f8dfc106fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54574/0 (socket says 172.21.15.26:54574) 2021-11-03T17:28:07.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.552+0000 7f8dfa59c700 1 -- 172.21.15.26:0/2839245539 learned_addr learned my addr 172.21.15.26:0/2839245539 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:28:07.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.553+0000 7f8df9d9b700 1 --2- 172.21.15.26:0/2839245539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8dfc0f6ff0 0x7f8dfc107490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:28:07.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.553+0000 7f8dfa59c700 1 -- 172.21.15.26:0/2839245539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8dfc0f6ff0 msgr2=0x7f8dfc107490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:28:07.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.553+0000 7f8dfa59c700 1 --2- 172.21.15.26:0/2839245539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8dfc0f6ff0 0x7f8dfc107490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:07.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.553+0000 7f8dfa59c700 1 -- 172.21.15.26:0/2839245539 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df0005040 con 0x7f8dfc0f66e0 2021-11-03T17:28:07.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.553+0000 7f8dfa59c700 1 --2- 172.21.15.26:0/2839245539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8dfc0f66e0 0x7f8dfc106fa0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f8dec00b410 tx=0x7f8dec006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:28:07.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.553+0000 7f8deaffd700 1 -- 172.21.15.26:0/2839245539 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8dec0125f0 con 0x7f8dfc0f66e0 2021-11-03T17:28:07.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.553+0000 7f8e00e13700 1 -- 172.21.15.26:0/2839245539 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dfc108660 con 0x7f8dfc0f66e0 2021-11-03T17:28:07.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.553+0000 7f8deaffd700 1 -- 172.21.15.26:0/2839245539 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8dec012c00 con 0x7f8dfc0f66e0 2021-11-03T17:28:07.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.553+0000 7f8deaffd700 1 -- 172.21.15.26:0/2839245539 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8dec002ae0 con 0x7f8dfc0f66e0 2021-11-03T17:28:07.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.553+0000 7f8e00e13700 1 -- 172.21.15.26:0/2839245539 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dfc108c20 con 0x7f8dfc0f66e0 2021-11-03T17:28:07.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.554+0000 7f8e00e13700 1 -- 172.21.15.26:0/2839245539 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dfc0f5b70 con 0x7f8dfc0f66e0 2021-11-03T17:28:07.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.554+0000 7f8deaffd700 1 -- 172.21.15.26:0/2839245539 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f8dec00f030 con 0x7f8dfc0f66e0 2021-11-03T17:28:07.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.555+0000 7f8deaffd700 1 --2- 172.21.15.26:0/2839245539 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8de40640b0 0x7f8de4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:28:07.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.555+0000 7f8deaffd700 1 -- 172.21.15.26:0/2839245539 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f8dec080cb0 con 0x7f8dfc0f66e0 2021-11-03T17:28:07.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.555+0000 7f8df9d9b700 1 --2- 172.21.15.26:0/2839245539 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8de40640b0 0x7f8de4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:28:07.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.555+0000 7f8df9d9b700 1 --2- 172.21.15.26:0/2839245539 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8de40640b0 0x7f8de4066570 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f8df0004e30 tx=0x7f8df0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:28:07.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.559+0000 7f8deaffd700 1 -- 172.21.15.26:0/2839245539 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f8dec053010 con 0x7f8dfc0f66e0 2021-11-03T17:28:07.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.729+0000 7f8e00e13700 1 -- 172.21.15.26:0/2839245539 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8dfc0fef50 con 0x7f8de40640b0 2021-11-03T17:28:07.739 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.744+0000 7f8deaffd700 1 -- 172.21.15.26:0/2839245539 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f8dfc0fef50 con 0x7f8de40640b0 2021-11-03T17:28:07.739 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:28:07.739 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (39m) 9m ago 40m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:28:07.740 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (31m) 9m ago 40m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:28:07.740 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (31m) 8m ago 39m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:28:07.740 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (39m) 9m ago 40m 39.6M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:28:07.740 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (32m) 9m ago 35m 19.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:28:07.741 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (32m) 9m ago 35m 20.6M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:28:07.741 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (35m) 8m ago 35m 22.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:28:07.741 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (35m) 8m ago 35m 22.2M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:28:07.741 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (33m) 9m ago 41m 505M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:28:07.741 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (32m) 8m ago 39m 419M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:28:07.742 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (32m) 9m ago 42m 147M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:28:07.742 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (32m) 8m ago 39m 75.7M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:28:07.742 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (40m) 9m ago 40m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:28:07.742 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (39m) 8m ago 39m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:28:07.743 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (31m) 9m ago 39m 211M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:28:07.743 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (30m) 9m ago 38m 226M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:28:07.743 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (30m) 9m ago 38m 189M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:28:07.743 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (29m) 8m ago 37m 236M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:28:07.743 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (29m) 8m ago 37m 208M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:28:07.744 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (28m) 8m ago 37m 194M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:28:07.744 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (39m) 9m ago 39m 52.1M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:28:07.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.746+0000 7f8e00e13700 1 -- 172.21.15.26:0/2839245539 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8de40640b0 msgr2=0x7f8de4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:28:07.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.746+0000 7f8e00e13700 1 --2- 172.21.15.26:0/2839245539 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8de40640b0 0x7f8de4066570 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f8df0004e30 tx=0x7f8df0009b30).stop 2021-11-03T17:28:07.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.746+0000 7f8e00e13700 1 -- 172.21.15.26:0/2839245539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8dfc0f66e0 msgr2=0x7f8dfc106fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:28:07.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.746+0000 7f8e00e13700 1 --2- 172.21.15.26:0/2839245539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8dfc0f66e0 0x7f8dfc106fa0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f8dec00b410 tx=0x7f8dec006ef0).stop 2021-11-03T17:28:07.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.746+0000 7f8e00e13700 1 -- 172.21.15.26:0/2839245539 shutdown_connections 2021-11-03T17:28:07.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.746+0000 7f8e00e13700 1 --2- 172.21.15.26:0/2839245539 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8de40640b0 0x7f8de4066570 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:07.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.746+0000 7f8e00e13700 1 --2- 172.21.15.26:0/2839245539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8dfc0f66e0 0x7f8dfc106fa0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:07.747 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.746+0000 7f8e00e13700 1 --2- 172.21.15.26:0/2839245539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8dfc0f6ff0 0x7f8dfc107490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:07.747 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.746+0000 7f8e00e13700 1 -- 172.21.15.26:0/2839245539 >> 172.21.15.26:0/2839245539 conn(0x7f8dfc0f1f00 msgr2=0x7f8dfc0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:28:07.747 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.746+0000 7f8e00e13700 1 -- 172.21.15.26:0/2839245539 shutdown_connections 2021-11-03T17:28:07.747 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.746+0000 7f8e00e13700 1 -- 172.21.15.26:0/2839245539 wait complete. 2021-11-03T17:28:07.845 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.845+0000 7f0c10217700 1 -- 172.21.15.26:0/2475916549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c080f49a0 msgr2=0x7f0c080f4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:28:07.845 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.845+0000 7f0c10217700 1 --2- 172.21.15.26:0/2475916549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c080f49a0 0x7f0c080f4dc0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7f0c000099e0 tx=0x7f0c00004d10).stop 2021-11-03T17:28:07.846 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.845+0000 7f0c10217700 1 -- 172.21.15.26:0/2475916549 shutdown_connections 2021-11-03T17:28:07.846 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.845+0000 7f0c10217700 1 --2- 172.21.15.26:0/2475916549 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c080f5340 0x7f0c080f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:07.846 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.845+0000 7f0c10217700 1 --2- 172.21.15.26:0/2475916549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c080f49a0 0x7f0c080f4dc0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:07.847 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.845+0000 7f0c10217700 1 -- 172.21.15.26:0/2475916549 >> 172.21.15.26:0/2475916549 conn(0x7f0c080f04c0 msgr2=0x7f0c080f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:28:07.847 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.845+0000 7f0c10217700 1 -- 172.21.15.26:0/2475916549 shutdown_connections 2021-11-03T17:28:07.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.845+0000 7f0c10217700 1 -- 172.21.15.26:0/2475916549 wait complete. 2021-11-03T17:28:07.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.846+0000 7f0c10217700 1 Processor -- start 2021-11-03T17:28:07.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.846+0000 7f0c10217700 1 -- start start 2021-11-03T17:28:07.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.846+0000 7f0c10217700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c080f49a0 0x7f0c081070e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:28:07.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.846+0000 7f0c10217700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c080f5340 0x7f0c081075d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:28:07.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.846+0000 7f0c10217700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c08107b80 con 0x7f0c080f5340 2021-11-03T17:28:07.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.846+0000 7f0c10217700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c08107cc0 con 0x7f0c080f49a0 2021-11-03T17:28:07.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.846+0000 7f0c0d7b2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c080f5340 0x7f0c081075d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:28:07.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.846+0000 7f0c0d7b2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c080f5340 0x7f0c081075d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54586/0 (socket says 172.21.15.26:54586) 2021-11-03T17:28:07.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.846+0000 7f0c0d7b2700 1 -- 172.21.15.26:0/336479048 learned_addr learned my addr 172.21.15.26:0/336479048 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:28:07.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.846+0000 7f0c0dfb3700 1 --2- 172.21.15.26:0/336479048 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c080f49a0 0x7f0c081070e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:28:07.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.846+0000 7f0c0d7b2700 1 -- 172.21.15.26:0/336479048 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c080f49a0 msgr2=0x7f0c081070e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:28:07.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.846+0000 7f0c0d7b2700 1 --2- 172.21.15.26:0/336479048 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c080f49a0 0x7f0c081070e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:07.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.846+0000 7f0c0d7b2700 1 -- 172.21.15.26:0/336479048 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c00009640 con 0x7f0c080f5340 2021-11-03T17:28:07.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.846+0000 7f0c0d7b2700 1 --2- 172.21.15.26:0/336479048 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c080f5340 0x7f0c081075d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f0bfc002700 tx=0x7f0bfc009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:28:07.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.847+0000 7f0c067fc700 1 -- 172.21.15.26:0/336479048 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bfc009320 con 0x7f0c080f5340 2021-11-03T17:28:07.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.847+0000 7f0c10217700 1 -- 172.21.15.26:0/336479048 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c08108660 con 0x7f0c080f5340 2021-11-03T17:28:07.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.847+0000 7f0c067fc700 1 -- 172.21.15.26:0/336479048 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0bfc00f040 con 0x7f0c080f5340 2021-11-03T17:28:07.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.847+0000 7f0c067fc700 1 -- 172.21.15.26:0/336479048 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bfc014810 con 0x7f0c080f5340 2021-11-03T17:28:07.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.847+0000 7f0c10217700 1 -- 172.21.15.26:0/336479048 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c08108ba0 con 0x7f0c080f5340 2021-11-03T17:28:07.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.848+0000 7f0c10217700 1 -- 172.21.15.26:0/336479048 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0be8004fa0 con 0x7f0c080f5340 2021-11-03T17:28:07.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.848+0000 7f0c067fc700 1 -- 172.21.15.26:0/336479048 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f0bfc009480 con 0x7f0c080f5340 2021-11-03T17:28:07.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.848+0000 7f0c067fc700 1 --2- 172.21.15.26:0/336479048 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0bf00640b0 0x7f0bf0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:28:07.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.849+0000 7f0c067fc700 1 -- 172.21.15.26:0/336479048 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f0bfc080d90 con 0x7f0c080f5340 2021-11-03T17:28:07.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.849+0000 7f0c0dfb3700 1 --2- 172.21.15.26:0/336479048 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0bf00640b0 0x7f0bf0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:28:07.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.849+0000 7f0c0dfb3700 1 --2- 172.21.15.26:0/336479048 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0bf00640b0 0x7f0bf0066570 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f0c00009f50 tx=0x7f0c00004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:28:07.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:07.853+0000 7f0c067fc700 1 -- 172.21.15.26:0/336479048 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f0bfc0530f0 con 0x7f0c080f5340 2021-11-03T17:28:08.076 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.081+0000 7f0c10217700 1 -- 172.21.15.26:0/336479048 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0be8005e80 con 0x7f0c080f5340 2021-11-03T17:28:08.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.082+0000 7f0c067fc700 1 -- 172.21.15.26:0/336479048 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f0bfc052ce0 con 0x7f0c080f5340 2021-11-03T17:28:08.077 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:28:08.078 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:28:08.078 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:28:08.078 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:28:08.078 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:28:08.079 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:28:08.079 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:28:08.079 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:28:08.079 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:28:08.080 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:28:08.080 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:28:08.080 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:28:08.080 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:28:08.081 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:28:08.081 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:28:08.081 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:28:08.081 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:28:08.081 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:28:08.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.084+0000 7f0c10217700 1 -- 172.21.15.26:0/336479048 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0bf00640b0 msgr2=0x7f0bf0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:28:08.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.084+0000 7f0c10217700 1 --2- 172.21.15.26:0/336479048 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0bf00640b0 0x7f0bf0066570 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f0c00009f50 tx=0x7f0c00004d10).stop 2021-11-03T17:28:08.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.084+0000 7f0c10217700 1 -- 172.21.15.26:0/336479048 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c080f5340 msgr2=0x7f0c081075d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:28:08.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.084+0000 7f0c10217700 1 --2- 172.21.15.26:0/336479048 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c080f5340 0x7f0c081075d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f0bfc002700 tx=0x7f0bfc009d60).stop 2021-11-03T17:28:08.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.084+0000 7f0c10217700 1 -- 172.21.15.26:0/336479048 shutdown_connections 2021-11-03T17:28:08.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.084+0000 7f0c10217700 1 --2- 172.21.15.26:0/336479048 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0bf00640b0 0x7f0bf0066570 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:08.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.084+0000 7f0c10217700 1 --2- 172.21.15.26:0/336479048 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c080f49a0 0x7f0c081070e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:08.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.084+0000 7f0c10217700 1 --2- 172.21.15.26:0/336479048 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c080f5340 0x7f0c081075d0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:08.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.084+0000 7f0c10217700 1 -- 172.21.15.26:0/336479048 >> 172.21.15.26:0/336479048 conn(0x7f0c080f04c0 msgr2=0x7f0c080fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:28:08.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.084+0000 7f0c10217700 1 -- 172.21.15.26:0/336479048 shutdown_connections 2021-11-03T17:28:08.085 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.084+0000 7f0c10217700 1 -- 172.21.15.26:0/336479048 wait complete. 2021-11-03T17:28:08.184 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.185+0000 7f52f4727700 1 -- 172.21.15.26:0/2936347290 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52ec0f6ff0 msgr2=0x7f52ec0f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:28:08.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.185+0000 7f52f4727700 1 --2- 172.21.15.26:0/2936347290 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52ec0f6ff0 0x7f52ec0f7a20 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f52e8004660 tx=0x7f52e8009b30).stop 2021-11-03T17:28:08.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.185+0000 7f52f4727700 1 -- 172.21.15.26:0/2936347290 shutdown_connections 2021-11-03T17:28:08.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.185+0000 7f52f4727700 1 --2- 172.21.15.26:0/2936347290 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52ec0f6ff0 0x7f52ec0f7a20 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:08.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.185+0000 7f52f4727700 1 --2- 172.21.15.26:0/2936347290 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52ec0f66e0 0x7f52ec0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:08.186 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.185+0000 7f52f4727700 1 -- 172.21.15.26:0/2936347290 >> 172.21.15.26:0/2936347290 conn(0x7f52ec0f1f00 msgr2=0x7f52ec0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:28:08.186 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.185+0000 7f52f4727700 1 -- 172.21.15.26:0/2936347290 shutdown_connections 2021-11-03T17:28:08.186 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.185+0000 7f52f4727700 1 -- 172.21.15.26:0/2936347290 wait complete. 2021-11-03T17:28:08.186 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.186+0000 7f52f4727700 1 Processor -- start 2021-11-03T17:28:08.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.186+0000 7f52f4727700 1 -- start start 2021-11-03T17:28:08.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.186+0000 7f52f4727700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52ec0f66e0 0x7f52ec106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:28:08.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.186+0000 7f52f4727700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52ec0f6ff0 0x7f52ec107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:28:08.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.186+0000 7f52f4727700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec107a10 con 0x7f52ec0f6ff0 2021-11-03T17:28:08.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.186+0000 7f52f4727700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec107b50 con 0x7f52ec0f66e0 2021-11-03T17:28:08.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.186+0000 7f52f1cc2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52ec0f6ff0 0x7f52ec107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:28:08.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.186+0000 7f52f1cc2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52ec0f6ff0 0x7f52ec107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54596/0 (socket says 172.21.15.26:54596) 2021-11-03T17:28:08.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.186+0000 7f52f1cc2700 1 -- 172.21.15.26:0/1247493538 learned_addr learned my addr 172.21.15.26:0/1247493538 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:28:08.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.186+0000 7f52f24c3700 1 --2- 172.21.15.26:0/1247493538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52ec0f66e0 0x7f52ec106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:28:08.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.186+0000 7f52f1cc2700 1 -- 172.21.15.26:0/1247493538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52ec0f66e0 msgr2=0x7f52ec106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:28:08.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.186+0000 7f52f1cc2700 1 --2- 172.21.15.26:0/1247493538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52ec0f66e0 0x7f52ec106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:08.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.186+0000 7f52f1cc2700 1 -- 172.21.15.26:0/1247493538 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e8005040 con 0x7f52ec0f6ff0 2021-11-03T17:28:08.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.186+0000 7f52f1cc2700 1 --2- 172.21.15.26:0/1247493538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52ec0f6ff0 0x7f52ec107460 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f52e8009990 tx=0x7f52e8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:28:08.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.187+0000 7f52e2ffd700 1 -- 172.21.15.26:0/1247493538 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52e8018070 con 0x7f52ec0f6ff0 2021-11-03T17:28:08.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.187+0000 7f52e2ffd700 1 -- 172.21.15.26:0/1247493538 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f52e8007ba0 con 0x7f52ec0f6ff0 2021-11-03T17:28:08.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.187+0000 7f52f4727700 1 -- 172.21.15.26:0/1247493538 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52ec108490 con 0x7f52ec0f6ff0 2021-11-03T17:28:08.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.187+0000 7f52e2ffd700 1 -- 172.21.15.26:0/1247493538 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52e801c3c0 con 0x7f52ec0f6ff0 2021-11-03T17:28:08.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.187+0000 7f52f4727700 1 -- 172.21.15.26:0/1247493538 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52ec1089f0 con 0x7f52ec0f6ff0 2021-11-03T17:28:08.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.188+0000 7f52f4727700 1 -- 172.21.15.26:0/1247493538 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52ec045ad0 con 0x7f52ec0f6ff0 2021-11-03T17:28:08.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.188+0000 7f52e2ffd700 1 -- 172.21.15.26:0/1247493538 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f52e801d420 con 0x7f52ec0f6ff0 2021-11-03T17:28:08.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.188+0000 7f52e2ffd700 1 --2- 172.21.15.26:0/1247493538 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f52d80640b0 0x7f52d8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:28:08.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.189+0000 7f52e2ffd700 1 -- 172.21.15.26:0/1247493538 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f52e8082360 con 0x7f52ec0f6ff0 2021-11-03T17:28:08.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.189+0000 7f52f24c3700 1 --2- 172.21.15.26:0/1247493538 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f52d80640b0 0x7f52d8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:28:08.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.189+0000 7f52f24c3700 1 --2- 172.21.15.26:0/1247493538 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f52d80640b0 0x7f52d8066570 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f52dc004c40 tx=0x7f52dc00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:28:08.194 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.193+0000 7f52e2ffd700 1 -- 172.21.15.26:0/1247493538 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f52e8054720 con 0x7f52ec0f6ff0 2021-11-03T17:28:08.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.396+0000 7f52f4727700 1 -- 172.21.15.26:0/1247493538 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f52ec027a00 con 0x7f52ec0f6ff0 2021-11-03T17:28:08.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.397+0000 7f52e2ffd700 1 -- 172.21.15.26:0/1247493538 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f52e8054310 con 0x7f52ec0f6ff0 2021-11-03T17:28:08.392 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:28:08.392 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:28:08.393 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:28:08.393 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:28:08.393 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:28:08.393 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:28:08.394 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:28:08.394 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:28:08.394 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:28:08.394 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:28:08.395 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:28:08.395 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:28:08.395 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:28:08.395 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:28:08.396 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:28:08.396 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:28:08.396 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:28:08.396 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:28:08.397 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:28:08.397 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:28:08.397 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:28:08.397 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:28:08.397 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:28:08.398 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:28:08.398 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:28:08.398 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:28:08.399 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:28:08.399 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:28:08.399 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:28:08.399 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:28:08.399 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:28:08.400 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:28:08.400 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:28:08.400 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:28:08.400 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:28:08.401 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:28:08.401 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:28:08.401 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:28:08.402 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:28:08.403 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.398+0000 7f52f4727700 1 -- 172.21.15.26:0/1247493538 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f52d80640b0 msgr2=0x7f52d8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:28:08.403 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.398+0000 7f52f4727700 1 --2- 172.21.15.26:0/1247493538 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f52d80640b0 0x7f52d8066570 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f52dc004c40 tx=0x7f52dc00b040).stop 2021-11-03T17:28:08.404 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.398+0000 7f52f4727700 1 -- 172.21.15.26:0/1247493538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52ec0f6ff0 msgr2=0x7f52ec107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:28:08.404 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.398+0000 7f52f4727700 1 --2- 172.21.15.26:0/1247493538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52ec0f6ff0 0x7f52ec107460 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f52e8009990 tx=0x7f52e8009b30).stop 2021-11-03T17:28:08.404 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.399+0000 7f52f4727700 1 -- 172.21.15.26:0/1247493538 shutdown_connections 2021-11-03T17:28:08.404 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.399+0000 7f52f4727700 1 --2- 172.21.15.26:0/1247493538 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f52d80640b0 0x7f52d8066570 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:08.405 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.399+0000 7f52f4727700 1 --2- 172.21.15.26:0/1247493538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52ec0f66e0 0x7f52ec106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:08.405 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.399+0000 7f52f4727700 1 --2- 172.21.15.26:0/1247493538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52ec0f6ff0 0x7f52ec107460 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:08.405 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.399+0000 7f52f4727700 1 -- 172.21.15.26:0/1247493538 >> 172.21.15.26:0/1247493538 conn(0x7f52ec0f1f00 msgr2=0x7f52ec0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:28:08.405 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.399+0000 7f52f4727700 1 -- 172.21.15.26:0/1247493538 shutdown_connections 2021-11-03T17:28:08.406 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:08.399+0000 7f52f4727700 1 -- 172.21.15.26:0/1247493538 wait complete. 2021-11-03T17:28:08.406 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:28:08.420 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:08 smithi026 ceph-mon[96795]: pgmap v1004: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:08.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:08 smithi026 ceph-mon[96795]: from='client.35180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:28:08.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:08 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/336479048' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:28:08.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:08 smithi194 ceph-mon[65619]: pgmap v1004: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:08.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:08 smithi194 ceph-mon[65619]: from='client.35180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:28:08.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:08 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/336479048' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:28:09.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:09 smithi026 ceph-mon[96795]: from='client.35184 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:28:09.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:09 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1247493538' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:28:09.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:09 smithi194 ceph-mon[65619]: from='client.35184 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:28:09.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:09 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1247493538' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:28:10.420 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:10 smithi026 ceph-mon[96795]: pgmap v1005: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:10.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:10 smithi194 ceph-mon[65619]: pgmap v1005: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:12.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:12 smithi026 ceph-mon[96795]: pgmap v1006: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:12.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:12 smithi194 ceph-mon[65619]: pgmap v1006: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:14.420 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:14 smithi026 ceph-mon[96795]: pgmap v1007: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:14.523 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:14 smithi194 ceph-mon[65619]: pgmap v1007: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:15.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:15 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:28:15.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:15 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:28:16.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:16 smithi026 ceph-mon[96795]: pgmap v1008: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:16.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:16 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:28:16.425 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:16 smithi194 ceph-mon[65619]: pgmap v1008: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:16.425 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:16 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:28:18.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:18 smithi026 ceph-mon[96795]: pgmap v1009: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:18.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:18 smithi194 ceph-mon[65619]: pgmap v1009: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:20.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:20 smithi026 ceph-mon[96795]: pgmap v1010: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:20.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:20 smithi194 ceph-mon[65619]: pgmap v1010: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:22.420 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:22 smithi026 ceph-mon[96795]: pgmap v1011: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:22.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:22 smithi194 ceph-mon[65619]: pgmap v1011: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:24.245 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:24 smithi194 ceph-mon[65619]: pgmap v1012: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:24.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:24 smithi026 ceph-mon[96795]: pgmap v1012: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:26.416 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:26 smithi194 ceph-mon[65619]: pgmap v1013: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:26.420 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:26 smithi026 ceph-mon[96795]: pgmap v1013: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:28.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:28 smithi026 ceph-mon[96795]: pgmap v1014: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:28.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:28 smithi194 ceph-mon[65619]: pgmap v1014: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:30.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:30 smithi026 ceph-mon[96795]: pgmap v1015: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:30.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:30 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:28:30.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:30 smithi194 ceph-mon[65619]: pgmap v1015: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:30.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:30 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:28:31.420 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:31 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:28:31.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:31 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:28:32.420 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:32 smithi026 ceph-mon[96795]: pgmap v1016: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:32.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:32 smithi194 ceph-mon[65619]: pgmap v1016: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:34.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:34 smithi026 ceph-mon[96795]: pgmap v1017: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:34.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:34 smithi194 ceph-mon[65619]: pgmap v1017: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:36.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:36 smithi026 ceph-mon[96795]: pgmap v1018: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:36.494 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:36 smithi194 ceph-mon[65619]: pgmap v1018: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:38.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:38 smithi194 ceph-mon[65619]: pgmap v1019: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:38.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.514+0000 7f11fbdbd700 1 -- 172.21.15.26:0/3770002578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11f406a3b0 msgr2=0x7f11f406a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:28:38.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.514+0000 7f11fbdbd700 1 --2- 172.21.15.26:0/3770002578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11f406a3b0 0x7f11f406a830 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f11e8004690 tx=0x7f11e8009b30).stop 2021-11-03T17:28:38.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.514+0000 7f11fbdbd700 1 -- 172.21.15.26:0/3770002578 shutdown_connections 2021-11-03T17:28:38.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.514+0000 7f11fbdbd700 1 --2- 172.21.15.26:0/3770002578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11f406a3b0 0x7f11f406a830 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:38.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.514+0000 7f11fbdbd700 1 --2- 172.21.15.26:0/3770002578 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11f406b920 0x7f11f4069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:38.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.514+0000 7f11fbdbd700 1 -- 172.21.15.26:0/3770002578 >> 172.21.15.26:0/3770002578 conn(0x7f11f40f1f00 msgr2=0x7f11f40f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:28:38.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.514+0000 7f11fbdbd700 1 -- 172.21.15.26:0/3770002578 shutdown_connections 2021-11-03T17:28:38.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.514+0000 7f11fbdbd700 1 -- 172.21.15.26:0/3770002578 wait complete. 2021-11-03T17:28:38.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.515+0000 7f11fbdbd700 1 Processor -- start 2021-11-03T17:28:38.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.515+0000 7f11fbdbd700 1 -- start start 2021-11-03T17:28:38.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.515+0000 7f11fbdbd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11f406a3b0 0x7f11f4109110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:28:38.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.515+0000 7f11fbdbd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11f406b920 0x7f11f4109600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:28:38.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.515+0000 7f11fbdbd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f4109bb0 con 0x7f11f406b920 2021-11-03T17:28:38.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.515+0000 7f11fbdbd700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f4109cf0 con 0x7f11f406a3b0 2021-11-03T17:28:38.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.515+0000 7f11f9358700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11f406b920 0x7f11f4109600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:28:38.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.515+0000 7f11f9358700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11f406b920 0x7f11f4109600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54614/0 (socket says 172.21.15.26:54614) 2021-11-03T17:28:38.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.515+0000 7f11f9358700 1 -- 172.21.15.26:0/2297254883 learned_addr learned my addr 172.21.15.26:0/2297254883 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:28:38.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.515+0000 7f11f9b59700 1 --2- 172.21.15.26:0/2297254883 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11f406a3b0 0x7f11f4109110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:28:38.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.515+0000 7f11f9358700 1 -- 172.21.15.26:0/2297254883 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11f406a3b0 msgr2=0x7f11f4109110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:28:38.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.515+0000 7f11f9358700 1 --2- 172.21.15.26:0/2297254883 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11f406a3b0 0x7f11f4109110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:38.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.515+0000 7f11f9358700 1 -- 172.21.15.26:0/2297254883 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e8005040 con 0x7f11f406b920 2021-11-03T17:28:38.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.515+0000 7f11f9358700 1 --2- 172.21.15.26:0/2297254883 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11f406b920 0x7f11f4109600 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f11e80079e0 tx=0x7f11e8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:28:38.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.516+0000 7f11f27fc700 1 -- 172.21.15.26:0/2297254883 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11e8018070 con 0x7f11f406b920 2021-11-03T17:28:38.517 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.516+0000 7f11f27fc700 1 -- 172.21.15.26:0/2297254883 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f11e8013e40 con 0x7f11f406b920 2021-11-03T17:28:38.517 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.516+0000 7f11fbdbd700 1 -- 172.21.15.26:0/2297254883 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11f410a630 con 0x7f11f406b920 2021-11-03T17:28:38.517 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.516+0000 7f11f27fc700 1 -- 172.21.15.26:0/2297254883 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11e801c3c0 con 0x7f11f406b920 2021-11-03T17:28:38.517 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.516+0000 7f11fbdbd700 1 -- 172.21.15.26:0/2297254883 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11f410ab90 con 0x7f11f406b920 2021-11-03T17:28:38.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.517+0000 7f11fbdbd700 1 -- 172.21.15.26:0/2297254883 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11f4045ad0 con 0x7f11f406b920 2021-11-03T17:28:38.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.517+0000 7f11f27fc700 1 -- 172.21.15.26:0/2297254883 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f11e801d420 con 0x7f11f406b920 2021-11-03T17:28:38.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.517+0000 7f11f27fc700 1 --2- 172.21.15.26:0/2297254883 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f11dc0640b0 0x7f11dc066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:28:38.520 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.517+0000 7f11f27fc700 1 -- 172.21.15.26:0/2297254883 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f11e80825e0 con 0x7f11f406b920 2021-11-03T17:28:38.520 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.517+0000 7f11f9b59700 1 --2- 172.21.15.26:0/2297254883 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f11dc0640b0 0x7f11dc066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:28:38.520 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.518+0000 7f11f9b59700 1 --2- 172.21.15.26:0/2297254883 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f11dc0640b0 0x7f11dc066570 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f11f406b6f0 tx=0x7f11ec00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:28:38.520 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.522+0000 7f11f27fc700 1 -- 172.21.15.26:0/2297254883 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f11e8054a00 con 0x7f11f406b920 2021-11-03T17:28:38.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:38 smithi026 ceph-mon[96795]: pgmap v1019: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:38.694 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.700+0000 7f11fbdbd700 1 -- 172.21.15.26:0/2297254883 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f11f41011e0 con 0x7f11dc0640b0 2021-11-03T17:28:38.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.702+0000 7f11f27fc700 1 -- 172.21.15.26:0/2297254883 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f11f41011e0 con 0x7f11dc0640b0 2021-11-03T17:28:38.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.704+0000 7f11fbdbd700 1 -- 172.21.15.26:0/2297254883 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f11dc0640b0 msgr2=0x7f11dc066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:28:38.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.704+0000 7f11fbdbd700 1 --2- 172.21.15.26:0/2297254883 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f11dc0640b0 0x7f11dc066570 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f11f406b6f0 tx=0x7f11ec00b040).stop 2021-11-03T17:28:38.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.704+0000 7f11fbdbd700 1 -- 172.21.15.26:0/2297254883 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11f406b920 msgr2=0x7f11f4109600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:28:38.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.704+0000 7f11fbdbd700 1 --2- 172.21.15.26:0/2297254883 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11f406b920 0x7f11f4109600 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f11e80079e0 tx=0x7f11e8009b30).stop 2021-11-03T17:28:38.699 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.704+0000 7f11fbdbd700 1 -- 172.21.15.26:0/2297254883 shutdown_connections 2021-11-03T17:28:38.699 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.704+0000 7f11fbdbd700 1 --2- 172.21.15.26:0/2297254883 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f11dc0640b0 0x7f11dc066570 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:38.699 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.704+0000 7f11fbdbd700 1 --2- 172.21.15.26:0/2297254883 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11f406a3b0 0x7f11f4109110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:38.699 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.704+0000 7f11fbdbd700 1 --2- 172.21.15.26:0/2297254883 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11f406b920 0x7f11f4109600 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:38.700 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.704+0000 7f11fbdbd700 1 -- 172.21.15.26:0/2297254883 >> 172.21.15.26:0/2297254883 conn(0x7f11f40f1f00 msgr2=0x7f11f40fcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:28:38.700 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.704+0000 7f11fbdbd700 1 -- 172.21.15.26:0/2297254883 shutdown_connections 2021-11-03T17:28:38.700 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.704+0000 7f11fbdbd700 1 -- 172.21.15.26:0/2297254883 wait complete. 2021-11-03T17:28:38.707 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:28:38.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.804+0000 7f51ed99f700 1 -- 172.21.15.26:0/141513446 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51e80f4800 msgr2=0x7f51e80f4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:28:38.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.804+0000 7f51ed99f700 1 --2- 172.21.15.26:0/141513446 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51e80f4800 0x7f51e80f4c20 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f51dc004660 tx=0x7f51dc009b30).stop 2021-11-03T17:28:38.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.804+0000 7f51ed99f700 1 -- 172.21.15.26:0/141513446 shutdown_connections 2021-11-03T17:28:38.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.804+0000 7f51ed99f700 1 --2- 172.21.15.26:0/141513446 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51e80f51a0 0x7f51e80f7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:38.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.804+0000 7f51ed99f700 1 --2- 172.21.15.26:0/141513446 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51e80f4800 0x7f51e80f4c20 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:38.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.804+0000 7f51ed99f700 1 -- 172.21.15.26:0/141513446 >> 172.21.15.26:0/141513446 conn(0x7f51e80f0320 msgr2=0x7f51e80f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:28:38.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.805+0000 7f51ed99f700 1 -- 172.21.15.26:0/141513446 shutdown_connections 2021-11-03T17:28:38.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.805+0000 7f51ed99f700 1 -- 172.21.15.26:0/141513446 wait complete. 2021-11-03T17:28:38.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.805+0000 7f51ed99f700 1 Processor -- start 2021-11-03T17:28:38.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.805+0000 7f51ed99f700 1 -- start start 2021-11-03T17:28:38.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.805+0000 7f51ed99f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51e80f4800 0x7f51e8106dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:28:38.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.805+0000 7f51ed99f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51e80f51a0 0x7f51e81072b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:28:38.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.805+0000 7f51ed99f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e81078b0 con 0x7f51e80f4800 2021-11-03T17:28:38.805 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.805+0000 7f51ed99f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e81080f0 con 0x7f51e80f51a0 2021-11-03T17:28:38.805 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.806+0000 7f51ec99d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51e80f4800 0x7f51e8106dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:28:38.805 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.806+0000 7f51ec99d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51e80f4800 0x7f51e8106dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54622/0 (socket says 172.21.15.26:54622) 2021-11-03T17:28:38.805 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.806+0000 7f51ec99d700 1 -- 172.21.15.26:0/866952502 learned_addr learned my addr 172.21.15.26:0/866952502 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:28:38.806 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.806+0000 7f51e7fff700 1 --2- 172.21.15.26:0/866952502 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51e80f51a0 0x7f51e81072b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:28:38.806 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.806+0000 7f51ec99d700 1 -- 172.21.15.26:0/866952502 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51e80f51a0 msgr2=0x7f51e81072b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:28:38.806 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.806+0000 7f51ec99d700 1 --2- 172.21.15.26:0/866952502 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51e80f51a0 0x7f51e81072b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:38.806 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.806+0000 7f51ec99d700 1 -- 172.21.15.26:0/866952502 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51dc005040 con 0x7f51e80f4800 2021-11-03T17:28:38.807 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.806+0000 7f51e7fff700 1 --2- 172.21.15.26:0/866952502 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51e80f51a0 0x7f51e81072b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:28:38.807 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.806+0000 7f51ec99d700 1 --2- 172.21.15.26:0/866952502 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51e80f4800 0x7f51e8106dc0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f51dc004f60 tx=0x7f51dc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:28:38.807 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.806+0000 7f51e57fa700 1 -- 172.21.15.26:0/866952502 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51dc018070 con 0x7f51e80f4800 2021-11-03T17:28:38.807 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.806+0000 7f51e57fa700 1 -- 172.21.15.26:0/866952502 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f51dc007ba0 con 0x7f51e80f4800 2021-11-03T17:28:38.808 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.806+0000 7f51ed99f700 1 -- 172.21.15.26:0/866952502 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e8108370 con 0x7f51e80f4800 2021-11-03T17:28:38.808 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.806+0000 7f51ed99f700 1 -- 172.21.15.26:0/866952502 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e8108850 con 0x7f51e80f4800 2021-11-03T17:28:38.808 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.806+0000 7f51e57fa700 1 -- 172.21.15.26:0/866952502 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51dc01c620 con 0x7f51e80f4800 2021-11-03T17:28:38.808 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.807+0000 7f51ed99f700 1 -- 172.21.15.26:0/866952502 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51e8059100 con 0x7f51e80f4800 2021-11-03T17:28:38.809 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.808+0000 7f51e57fa700 1 -- 172.21.15.26:0/866952502 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f51dc01c8e0 con 0x7f51e80f4800 2021-11-03T17:28:38.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.808+0000 7f51e57fa700 1 --2- 172.21.15.26:0/866952502 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f51d8064100 0x7f51d80665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:28:38.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.808+0000 7f51e57fa700 1 -- 172.21.15.26:0/866952502 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f51dc0826e0 con 0x7f51e80f4800 2021-11-03T17:28:38.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.808+0000 7f51e7fff700 1 --2- 172.21.15.26:0/866952502 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f51d8064100 0x7f51d80665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:28:38.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.808+0000 7f51e7fff700 1 --2- 172.21.15.26:0/866952502 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f51d8064100 0x7f51d80665c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f51e8106b50 tx=0x7f51d4009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:28:38.811 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.812+0000 7f51e57fa700 1 -- 172.21.15.26:0/866952502 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f51dc054a40 con 0x7f51e80f4800 2021-11-03T17:28:38.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:38.986+0000 7f51ed99f700 1 -- 172.21.15.26:0/866952502 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f51e80fed90 con 0x7f51d8064100 2021-11-03T17:28:38.994 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.001+0000 7f51e57fa700 1 -- 172.21.15.26:0/866952502 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f51e80fed90 con 0x7f51d8064100 2021-11-03T17:28:38.995 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:28:38.995 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (39m) 9m ago 41m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:28:38.995 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (32m) 9m ago 41m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:28:38.996 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (31m) 8m ago 40m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:28:38.996 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (39m) 9m ago 40m 39.6M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:28:38.996 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (32m) 9m ago 36m 19.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:28:38.996 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (33m) 9m ago 36m 20.6M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:28:38.997 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (36m) 8m ago 36m 22.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:28:38.997 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (36m) 8m ago 36m 22.2M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:28:38.997 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (33m) 9m ago 42m 505M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:28:38.997 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (33m) 8m ago 40m 419M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:28:38.998 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (33m) 9m ago 42m 147M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:28:38.998 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (32m) 8m ago 40m 75.7M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:28:38.998 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (40m) 9m ago 40m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:28:38.998 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (40m) 8m ago 40m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:28:38.999 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (31m) 9m ago 39m 211M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:28:38.999 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (31m) 9m ago 39m 226M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:28:38.999 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (30m) 9m ago 38m 189M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:28:38.999 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (30m) 8m ago 38m 236M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:28:38.999 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (29m) 8m ago 38m 208M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:28:39.000 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (29m) 8m ago 37m 194M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:28:39.000 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (39m) 9m ago 40m 52.1M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:28:39.001 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.002+0000 7f51ed99f700 1 -- 172.21.15.26:0/866952502 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f51d8064100 msgr2=0x7f51d80665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:28:39.002 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.002+0000 7f51ed99f700 1 --2- 172.21.15.26:0/866952502 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f51d8064100 0x7f51d80665c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f51e8106b50 tx=0x7f51d4009040).stop 2021-11-03T17:28:39.002 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.002+0000 7f51ed99f700 1 -- 172.21.15.26:0/866952502 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51e80f4800 msgr2=0x7f51e8106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:28:39.002 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.002+0000 7f51ed99f700 1 --2- 172.21.15.26:0/866952502 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51e80f4800 0x7f51e8106dc0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f51dc004f60 tx=0x7f51dc009b30).stop 2021-11-03T17:28:39.003 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.003+0000 7f51ed99f700 1 -- 172.21.15.26:0/866952502 shutdown_connections 2021-11-03T17:28:39.003 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.003+0000 7f51ed99f700 1 --2- 172.21.15.26:0/866952502 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f51d8064100 0x7f51d80665c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:39.003 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.003+0000 7f51ed99f700 1 --2- 172.21.15.26:0/866952502 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51e80f4800 0x7f51e8106dc0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:39.003 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.003+0000 7f51ed99f700 1 --2- 172.21.15.26:0/866952502 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51e80f51a0 0x7f51e81072b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:39.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.003+0000 7f51ed99f700 1 -- 172.21.15.26:0/866952502 >> 172.21.15.26:0/866952502 conn(0x7f51e80f0320 msgr2=0x7f51e80fb370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:28:39.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.003+0000 7f51ed99f700 1 -- 172.21.15.26:0/866952502 shutdown_connections 2021-11-03T17:28:39.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.003+0000 7f51ed99f700 1 -- 172.21.15.26:0/866952502 wait complete. 2021-11-03T17:28:39.096 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.102+0000 7f5cf582b700 1 -- 172.21.15.26:0/824831539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5cf006b9c0 msgr2=0x7f5cf0069ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:28:39.097 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.102+0000 7f5cf582b700 1 --2- 172.21.15.26:0/824831539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5cf006b9c0 0x7f5cf0069ec0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f5ce0004660 tx=0x7f5ce0009b30).stop 2021-11-03T17:28:39.097 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.102+0000 7f5cf582b700 1 -- 172.21.15.26:0/824831539 shutdown_connections 2021-11-03T17:28:39.097 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.102+0000 7f5cf582b700 1 --2- 172.21.15.26:0/824831539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5cf006a3b0 0x7f5cf006a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:39.097 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.102+0000 7f5cf582b700 1 --2- 172.21.15.26:0/824831539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5cf006b9c0 0x7f5cf0069ec0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:39.097 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.102+0000 7f5cf582b700 1 -- 172.21.15.26:0/824831539 >> 172.21.15.26:0/824831539 conn(0x7f5cf00f1cd0 msgr2=0x7f5cf00f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:28:39.098 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.102+0000 7f5cf582b700 1 -- 172.21.15.26:0/824831539 shutdown_connections 2021-11-03T17:28:39.098 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.102+0000 7f5cf582b700 1 -- 172.21.15.26:0/824831539 wait complete. 2021-11-03T17:28:39.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.103+0000 7f5cf582b700 1 Processor -- start 2021-11-03T17:28:39.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.103+0000 7f5cf582b700 1 -- start start 2021-11-03T17:28:39.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.103+0000 7f5cf582b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5cf006a3b0 0x7f5cf010d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:28:39.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.103+0000 7f5cf582b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5cf006b9c0 0x7f5cf010d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:28:39.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.103+0000 7f5cf582b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf010de30 con 0x7f5cf006b9c0 2021-11-03T17:28:39.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.103+0000 7f5cf582b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf010df70 con 0x7f5cf006a3b0 2021-11-03T17:28:39.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.103+0000 7f5cee7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5cf006b9c0 0x7f5cf010d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:28:39.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.103+0000 7f5cee7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5cf006b9c0 0x7f5cf010d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54634/0 (socket says 172.21.15.26:54634) 2021-11-03T17:28:39.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.103+0000 7f5cee7fc700 1 -- 172.21.15.26:0/939489378 learned_addr learned my addr 172.21.15.26:0/939489378 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:28:39.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.103+0000 7f5ceeffd700 1 --2- 172.21.15.26:0/939489378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5cf006a3b0 0x7f5cf010d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:28:39.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.103+0000 7f5cee7fc700 1 -- 172.21.15.26:0/939489378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5cf006a3b0 msgr2=0x7f5cf010d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:28:39.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.103+0000 7f5cee7fc700 1 --2- 172.21.15.26:0/939489378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5cf006a3b0 0x7f5cf010d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:39.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.103+0000 7f5cee7fc700 1 -- 172.21.15.26:0/939489378 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce0005040 con 0x7f5cf006b9c0 2021-11-03T17:28:39.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.104+0000 7f5cee7fc700 1 --2- 172.21.15.26:0/939489378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5cf006b9c0 0x7f5cf010d880 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f5ce40026d0 tx=0x7f5ce4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:28:39.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.104+0000 7f5cd77fe700 1 -- 172.21.15.26:0/939489378 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ce4009320 con 0x7f5cf006b9c0 2021-11-03T17:28:39.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.104+0000 7f5cd77fe700 1 -- 172.21.15.26:0/939489378 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5ce400f040 con 0x7f5cf006b9c0 2021-11-03T17:28:39.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.104+0000 7f5cd77fe700 1 -- 172.21.15.26:0/939489378 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ce40147e0 con 0x7f5cf006b9c0 2021-11-03T17:28:39.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.104+0000 7f5cf582b700 1 -- 172.21.15.26:0/939489378 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf010e910 con 0x7f5cf006b9c0 2021-11-03T17:28:39.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.104+0000 7f5cf582b700 1 -- 172.21.15.26:0/939489378 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf010eed0 con 0x7f5cf006b9c0 2021-11-03T17:28:39.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.105+0000 7f5cf582b700 1 -- 172.21.15.26:0/939489378 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cf0045ad0 con 0x7f5cf006b9c0 2021-11-03T17:28:39.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.105+0000 7f5cd77fe700 1 -- 172.21.15.26:0/939489378 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f5ce4009480 con 0x7f5cf006b9c0 2021-11-03T17:28:39.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.105+0000 7f5cd77fe700 1 --2- 172.21.15.26:0/939489378 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5cd8064100 0x7f5cd80665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:28:39.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.106+0000 7f5cd77fe700 1 -- 172.21.15.26:0/939489378 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f5ce4080eb0 con 0x7f5cf006b9c0 2021-11-03T17:28:39.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.106+0000 7f5ceeffd700 1 --2- 172.21.15.26:0/939489378 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5cd8064100 0x7f5cd80665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:28:39.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.106+0000 7f5ceeffd700 1 --2- 172.21.15.26:0/939489378 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5cd8064100 0x7f5cd80665c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f5ce0004630 tx=0x7f5ce0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:28:39.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.110+0000 7f5cd77fe700 1 -- 172.21.15.26:0/939489378 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f5ce4053210 con 0x7f5cf006b9c0 2021-11-03T17:28:39.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.341+0000 7f5cf582b700 1 -- 172.21.15.26:0/939489378 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5cf0027a00 con 0x7f5cf006b9c0 2021-11-03T17:28:39.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.342+0000 7f5cd77fe700 1 -- 172.21.15.26:0/939489378 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f5ce4052e00 con 0x7f5cf006b9c0 2021-11-03T17:28:39.337 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:28:39.338 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:28:39.338 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:28:39.338 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:28:39.339 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:28:39.339 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:28:39.339 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:28:39.339 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:28:39.340 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:28:39.340 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:28:39.340 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:28:39.340 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:28:39.341 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:28:39.341 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:28:39.341 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:28:39.341 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:28:39.341 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:28:39.342 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:28:39.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.344+0000 7f5cf582b700 1 -- 172.21.15.26:0/939489378 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5cd8064100 msgr2=0x7f5cd80665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:28:39.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.344+0000 7f5cf582b700 1 --2- 172.21.15.26:0/939489378 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5cd8064100 0x7f5cd80665c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f5ce0004630 tx=0x7f5ce0009b30).stop 2021-11-03T17:28:39.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.344+0000 7f5cf582b700 1 -- 172.21.15.26:0/939489378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5cf006b9c0 msgr2=0x7f5cf010d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:28:39.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.344+0000 7f5cf582b700 1 --2- 172.21.15.26:0/939489378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5cf006b9c0 0x7f5cf010d880 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f5ce40026d0 tx=0x7f5ce4009de0).stop 2021-11-03T17:28:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.344+0000 7f5cf582b700 1 -- 172.21.15.26:0/939489378 shutdown_connections 2021-11-03T17:28:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.344+0000 7f5cf582b700 1 --2- 172.21.15.26:0/939489378 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5cd8064100 0x7f5cd80665c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.344+0000 7f5cf582b700 1 --2- 172.21.15.26:0/939489378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5cf006a3b0 0x7f5cf010d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.344+0000 7f5cf582b700 1 --2- 172.21.15.26:0/939489378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5cf006b9c0 0x7f5cf010d880 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:39.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.344+0000 7f5cf582b700 1 -- 172.21.15.26:0/939489378 >> 172.21.15.26:0/939489378 conn(0x7f5cf00f1cd0 msgr2=0x7f5cf00f8840 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:28:39.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.344+0000 7f5cf582b700 1 -- 172.21.15.26:0/939489378 shutdown_connections 2021-11-03T17:28:39.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.344+0000 7f5cf582b700 1 -- 172.21.15.26:0/939489378 wait complete. 2021-11-03T17:28:39.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.444+0000 7fd7926b2700 1 -- 172.21.15.26:0/3187507628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd78c0f55c0 msgr2=0x7fd78c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:28:39.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.444+0000 7fd7926b2700 1 --2- 172.21.15.26:0/3187507628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd78c0f55c0 0x7fd78c0f59e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7fd77c004660 tx=0x7fd77c009b30).stop 2021-11-03T17:28:39.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.444+0000 7fd7926b2700 1 -- 172.21.15.26:0/3187507628 shutdown_connections 2021-11-03T17:28:39.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.444+0000 7fd7926b2700 1 --2- 172.21.15.26:0/3187507628 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd78c0f6860 0x7fd78c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:39.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.444+0000 7fd7926b2700 1 --2- 172.21.15.26:0/3187507628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd78c0f55c0 0x7fd78c0f59e0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:39.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.444+0000 7fd7926b2700 1 -- 172.21.15.26:0/3187507628 >> 172.21.15.26:0/3187507628 conn(0x7fd78c0f0d40 msgr2=0x7fd78c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:28:39.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.444+0000 7fd7926b2700 1 -- 172.21.15.26:0/3187507628 shutdown_connections 2021-11-03T17:28:39.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.444+0000 7fd7926b2700 1 -- 172.21.15.26:0/3187507628 wait complete. 2021-11-03T17:28:39.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.444+0000 7fd7926b2700 1 Processor -- start 2021-11-03T17:28:39.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.444+0000 7fd7926b2700 1 -- start start 2021-11-03T17:28:39.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.445+0000 7fd7926b2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd78c0f55c0 0x7fd78c109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:28:39.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.445+0000 7fd7926b2700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd78c0f6860 0x7fd78c10c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:28:39.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.445+0000 7fd7926b2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c0603e0 con 0x7fd78c0f55c0 2021-11-03T17:28:39.444 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.445+0000 7fd7926b2700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c060520 con 0x7fd78c0f6860 2021-11-03T17:28:39.444 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.445+0000 7fd78bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd78c0f55c0 0x7fd78c109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:28:39.444 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.445+0000 7fd78bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd78c0f55c0 0x7fd78c109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54642/0 (socket says 172.21.15.26:54642) 2021-11-03T17:28:39.444 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.445+0000 7fd78bfff700 1 -- 172.21.15.26:0/1291657004 learned_addr learned my addr 172.21.15.26:0/1291657004 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:28:39.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.445+0000 7fd78b7fe700 1 --2- 172.21.15.26:0/1291657004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd78c0f6860 0x7fd78c10c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:28:39.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.445+0000 7fd78bfff700 1 -- 172.21.15.26:0/1291657004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd78c0f6860 msgr2=0x7fd78c10c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:28:39.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.445+0000 7fd78bfff700 1 --2- 172.21.15.26:0/1291657004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd78c0f6860 0x7fd78c10c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:39.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.445+0000 7fd78bfff700 1 -- 172.21.15.26:0/1291657004 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd77c005040 con 0x7fd78c0f55c0 2021-11-03T17:28:39.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.445+0000 7fd78bfff700 1 --2- 172.21.15.26:0/1291657004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd78c0f55c0 0x7fd78c109c70 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fd77c013a70 tx=0x7fd77c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:28:39.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.445+0000 7fd788ff9700 1 -- 172.21.15.26:0/1291657004 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd77c018070 con 0x7fd78c0f55c0 2021-11-03T17:28:39.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.445+0000 7fd788ff9700 1 -- 172.21.15.26:0/1291657004 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd77c0097d0 con 0x7fd78c0f55c0 2021-11-03T17:28:39.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.445+0000 7fd7926b2700 1 -- 172.21.15.26:0/1291657004 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd78c10c6c0 con 0x7fd78c0f55c0 2021-11-03T17:28:39.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.445+0000 7fd788ff9700 1 -- 172.21.15.26:0/1291657004 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd77c01de80 con 0x7fd78c0f55c0 2021-11-03T17:28:39.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.445+0000 7fd7926b2700 1 -- 172.21.15.26:0/1291657004 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd78c10cc20 con 0x7fd78c0f55c0 2021-11-03T17:28:39.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.446+0000 7fd7926b2700 1 -- 172.21.15.26:0/1291657004 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd78c045ad0 con 0x7fd78c0f55c0 2021-11-03T17:28:39.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.447+0000 7fd788ff9700 1 -- 172.21.15.26:0/1291657004 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fd77c007ba0 con 0x7fd78c0f55c0 2021-11-03T17:28:39.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.447+0000 7fd788ff9700 1 --2- 172.21.15.26:0/1291657004 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd7780640b0 0x7fd778066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:28:39.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.447+0000 7fd788ff9700 1 -- 172.21.15.26:0/1291657004 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fd77c0823d0 con 0x7fd78c0f55c0 2021-11-03T17:28:39.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.447+0000 7fd78b7fe700 1 --2- 172.21.15.26:0/1291657004 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd7780640b0 0x7fd778066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:28:39.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.448+0000 7fd78b7fe700 1 --2- 172.21.15.26:0/1291657004 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd7780640b0 0x7fd778066570 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7fd774004c40 tx=0x7fd77400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:28:39.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.452+0000 7fd788ff9700 1 -- 172.21.15.26:0/1291657004 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fd77c0547f0 con 0x7fd78c0f55c0 2021-11-03T17:28:39.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.655+0000 7fd7926b2700 1 -- 172.21.15.26:0/1291657004 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd78c0fde50 con 0x7fd78c0f55c0 2021-11-03T17:28:39.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.656+0000 7fd788ff9700 1 -- 172.21.15.26:0/1291657004 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fd77c0543e0 con 0x7fd78c0f55c0 2021-11-03T17:28:39.650 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:28:39.650 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:28:39.650 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:28:39.651 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:28:39.651 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:28:39.651 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:28:39.651 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:28:39.652 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:28:39.652 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:28:39.652 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:28:39.652 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:28:39.653 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:28:39.653 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:28:39.653 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:28:39.653 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:28:39.653 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:28:39.654 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:28:39.654 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:28:39.654 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:28:39.654 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:28:39.655 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:28:39.655 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:28:39.655 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:28:39.655 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:28:39.656 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:28:39.656 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:28:39.656 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:28:39.656 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:28:39.656 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:28:39.657 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:28:39.657 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:28:39.657 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:28:39.657 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:28:39.657 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:28:39.658 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:28:39.658 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:28:39.658 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:28:39.658 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:28:39.659 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:28:39.660 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.657+0000 7fd7926b2700 1 -- 172.21.15.26:0/1291657004 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd7780640b0 msgr2=0x7fd778066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:28:39.660 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.657+0000 7fd7926b2700 1 --2- 172.21.15.26:0/1291657004 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd7780640b0 0x7fd778066570 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7fd774004c40 tx=0x7fd77400b040).stop 2021-11-03T17:28:39.660 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.657+0000 7fd7926b2700 1 -- 172.21.15.26:0/1291657004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd78c0f55c0 msgr2=0x7fd78c109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:28:39.661 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.657+0000 7fd7926b2700 1 --2- 172.21.15.26:0/1291657004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd78c0f55c0 0x7fd78c109c70 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fd77c013a70 tx=0x7fd77c009b30).stop 2021-11-03T17:28:39.661 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.657+0000 7fd7926b2700 1 -- 172.21.15.26:0/1291657004 shutdown_connections 2021-11-03T17:28:39.662 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.657+0000 7fd7926b2700 1 --2- 172.21.15.26:0/1291657004 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd7780640b0 0x7fd778066570 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:39.662 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.657+0000 7fd7926b2700 1 --2- 172.21.15.26:0/1291657004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd78c0f55c0 0x7fd78c109c70 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:39.662 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.657+0000 7fd7926b2700 1 --2- 172.21.15.26:0/1291657004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd78c0f6860 0x7fd78c10c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:28:39.663 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.657+0000 7fd7926b2700 1 -- 172.21.15.26:0/1291657004 >> 172.21.15.26:0/1291657004 conn(0x7fd78c0f0d40 msgr2=0x7fd78c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:28:39.663 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.657+0000 7fd7926b2700 1 -- 172.21.15.26:0/1291657004 shutdown_connections 2021-11-03T17:28:39.664 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:28:39.658+0000 7fd7926b2700 1 -- 172.21.15.26:0/1291657004 wait complete. 2021-11-03T17:28:39.664 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:28:40.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:40 smithi194 ceph-mon[65619]: from='client.35196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:28:40.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:40 smithi194 ceph-mon[65619]: pgmap v1020: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:40.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:40 smithi194 ceph-mon[65619]: from='client.35200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:28:40.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:40 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/939489378' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:28:40.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:40 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1291657004' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:28:40.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:40 smithi026 ceph-mon[96795]: from='client.35196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:28:40.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:40 smithi026 ceph-mon[96795]: pgmap v1020: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:40.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:40 smithi026 ceph-mon[96795]: from='client.35200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:28:40.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:40 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/939489378' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:28:40.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:40 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1291657004' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:28:42.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:42 smithi194 ceph-mon[65619]: pgmap v1021: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:42.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:42 smithi026 ceph-mon[96795]: pgmap v1021: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:44.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:44 smithi194 ceph-mon[65619]: pgmap v1022: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:44.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:44 smithi026 ceph-mon[96795]: pgmap v1022: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:45.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:45 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:28:45.573 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:45 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:28:46.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:46 smithi194 ceph-mon[65619]: pgmap v1023: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:46.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:46 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:28:46.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:46 smithi026 ceph-mon[96795]: pgmap v1023: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:46.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:46 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:28:48.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:48 smithi194 ceph-mon[65619]: pgmap v1024: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:48.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:28:48.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:28:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:48 smithi026 ceph-mon[96795]: pgmap v1024: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:28:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:28:50.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:50 smithi194 ceph-mon[65619]: pgmap v1025: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:50.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:50 smithi026 ceph-mon[96795]: pgmap v1025: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:52.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:52 smithi194 ceph-mon[65619]: pgmap v1026: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:52.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:52 smithi026 ceph-mon[96795]: pgmap v1026: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:54.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:54 smithi194 ceph-mon[65619]: pgmap v1027: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:54.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:54 smithi026 ceph-mon[96795]: pgmap v1027: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:56.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:56 smithi194 ceph-mon[65619]: pgmap v1028: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:56.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:56 smithi026 ceph-mon[96795]: pgmap v1028: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:58.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:28:58 smithi194 ceph-mon[65619]: pgmap v1029: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:28:58.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:28:58 smithi026 ceph-mon[96795]: pgmap v1029: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:00.361 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:00 smithi194 ceph-mon[65619]: pgmap v1030: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:00.361 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:00 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:29:00.420 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:00 smithi026 ceph-mon[96795]: pgmap v1030: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:00.518 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:00 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:29:01.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:01 smithi026 ceph-mon[96795]: poll took 60056.374 ms: 1 events 2021-11-03T17:29:01.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:29:01.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:01 smithi194 ceph-mon[65619]: poll took 60056.374 ms: 1 events 2021-11-03T17:29:01.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:29:02.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:02 smithi026 ceph-mon[96795]: pgmap v1031: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:02.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:02 smithi194 ceph-mon[65619]: pgmap v1031: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:04.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:04 smithi026 ceph-mon[96795]: pgmap v1032: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:04.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:04 smithi194 ceph-mon[65619]: pgmap v1032: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:06.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:06 smithi026 ceph-mon[96795]: pgmap v1033: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:06.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:06 smithi026 ceph-mon[96795]: poll took 4337.952 ms: 1 events 2021-11-03T17:29:06.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:06 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:29:06.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:06 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:29:06.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:06 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:29:06.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:06 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:29:06.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:06 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:29:06.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:06 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:29:06.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:06 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:29:06.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:06 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:29:06.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:06 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:29:06.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:06 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:29:06.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:06 smithi194 ceph-mon[65619]: pgmap v1033: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:06.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:06 smithi194 ceph-mon[65619]: poll took 4337.952 ms: 1 events 2021-11-03T17:29:06.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:06 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:29:06.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:06 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:29:06.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:06 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:29:06.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:06 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:29:06.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:06 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:29:06.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:06 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:29:06.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:06 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:29:06.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:06 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:29:06.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:06 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:29:06.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:06 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:29:08.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:08 smithi026 ceph-mon[96795]: pgmap v1034: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:08.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:08 smithi194 ceph-mon[65619]: pgmap v1034: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:09.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.772+0000 7fec2402c700 1 -- 172.21.15.26:0/3629677035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec1c0f55c0 msgr2=0x7fec1c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:29:09.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.772+0000 7fec2402c700 1 --2- 172.21.15.26:0/3629677035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec1c0f55c0 0x7fec1c0f59e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7fec10004660 tx=0x7fec10009b30).stop 2021-11-03T17:29:09.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.772+0000 7fec2402c700 1 -- 172.21.15.26:0/3629677035 shutdown_connections 2021-11-03T17:29:09.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.772+0000 7fec2402c700 1 --2- 172.21.15.26:0/3629677035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec1c0f6860 0x7fec1c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:09.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.772+0000 7fec2402c700 1 --2- 172.21.15.26:0/3629677035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec1c0f55c0 0x7fec1c0f59e0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:09.770 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.772+0000 7fec2402c700 1 -- 172.21.15.26:0/3629677035 >> 172.21.15.26:0/3629677035 conn(0x7fec1c0f0d40 msgr2=0x7fec1c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:29:09.770 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.773+0000 7fec2402c700 1 -- 172.21.15.26:0/3629677035 shutdown_connections 2021-11-03T17:29:09.770 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.773+0000 7fec2402c700 1 -- 172.21.15.26:0/3629677035 wait complete. 2021-11-03T17:29:09.770 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.773+0000 7fec2402c700 1 Processor -- start 2021-11-03T17:29:09.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.773+0000 7fec2402c700 1 -- start start 2021-11-03T17:29:09.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.773+0000 7fec2402c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec1c0f55c0 0x7fec1c109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:29:09.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.773+0000 7fec2402c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec1c0f6860 0x7fec1c10c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:29:09.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.773+0000 7fec2402c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c0603e0 con 0x7fec1c0f6860 2021-11-03T17:29:09.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.773+0000 7fec2402c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c060520 con 0x7fec1c0f55c0 2021-11-03T17:29:09.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.773+0000 7fec215c7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec1c0f6860 0x7fec1c10c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:29:09.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.774+0000 7fec215c7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec1c0f6860 0x7fec1c10c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54666/0 (socket says 172.21.15.26:54666) 2021-11-03T17:29:09.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.774+0000 7fec215c7700 1 -- 172.21.15.26:0/2493245843 learned_addr learned my addr 172.21.15.26:0/2493245843 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:29:09.774 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.774+0000 7fec21dc8700 1 --2- 172.21.15.26:0/2493245843 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec1c0f55c0 0x7fec1c109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:29:09.775 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.774+0000 7fec215c7700 1 -- 172.21.15.26:0/2493245843 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec1c0f55c0 msgr2=0x7fec1c109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:29:09.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.774+0000 7fec215c7700 1 --2- 172.21.15.26:0/2493245843 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec1c0f55c0 0x7fec1c109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:09.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.774+0000 7fec215c7700 1 -- 172.21.15.26:0/2493245843 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec10005040 con 0x7fec1c0f6860 2021-11-03T17:29:09.777 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.774+0000 7fec215c7700 1 --2- 172.21.15.26:0/2493245843 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec1c0f6860 0x7fec1c10c170 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7fec1800fae0 tx=0x7fec18009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:29:09.777 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.774+0000 7fec0e7fc700 1 -- 172.21.15.26:0/2493245843 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec18014070 con 0x7fec1c0f6860 2021-11-03T17:29:09.777 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.774+0000 7fec0e7fc700 1 -- 172.21.15.26:0/2493245843 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fec18009500 con 0x7fec1c0f6860 2021-11-03T17:29:09.778 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.774+0000 7fec2402c700 1 -- 172.21.15.26:0/2493245843 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec1c105ab0 con 0x7fec1c0f6860 2021-11-03T17:29:09.778 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.774+0000 7fec0e7fc700 1 -- 172.21.15.26:0/2493245843 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec18002ba0 con 0x7fec1c0f6860 2021-11-03T17:29:09.778 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.774+0000 7fec2402c700 1 -- 172.21.15.26:0/2493245843 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec1c106070 con 0x7fec1c0f6860 2021-11-03T17:29:09.778 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.775+0000 7fec2402c700 1 -- 172.21.15.26:0/2493245843 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec1c045ad0 con 0x7fec1c0f6860 2021-11-03T17:29:09.779 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.776+0000 7fec0e7fc700 1 -- 172.21.15.26:0/2493245843 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fec180077b0 con 0x7fec1c0f6860 2021-11-03T17:29:09.779 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.776+0000 7fec0e7fc700 1 --2- 172.21.15.26:0/2493245843 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fec080640b0 0x7fec08066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:29:09.780 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.776+0000 7fec0e7fc700 1 -- 172.21.15.26:0/2493245843 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fec18084b80 con 0x7fec1c0f6860 2021-11-03T17:29:09.780 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.776+0000 7fec21dc8700 1 --2- 172.21.15.26:0/2493245843 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fec080640b0 0x7fec08066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:29:09.780 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.777+0000 7fec21dc8700 1 --2- 172.21.15.26:0/2493245843 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fec080640b0 0x7fec08066570 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7fec10013690 tx=0x7fec10009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:29:09.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.780+0000 7fec0e7fc700 1 -- 172.21.15.26:0/2493245843 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fec18056f60 con 0x7fec1c0f6860 2021-11-03T17:29:09.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.960+0000 7fec2402c700 1 -- 172.21.15.26:0/2493245843 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fec1c057f10 con 0x7fec080640b0 2021-11-03T17:29:09.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.961+0000 7fec0e7fc700 1 -- 172.21.15.26:0/2493245843 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fec1c057f10 con 0x7fec080640b0 2021-11-03T17:29:09.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.963+0000 7fec2402c700 1 -- 172.21.15.26:0/2493245843 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fec080640b0 msgr2=0x7fec08066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:29:09.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.963+0000 7fec2402c700 1 --2- 172.21.15.26:0/2493245843 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fec080640b0 0x7fec08066570 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7fec10013690 tx=0x7fec10009b30).stop 2021-11-03T17:29:09.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.963+0000 7fec2402c700 1 -- 172.21.15.26:0/2493245843 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec1c0f6860 msgr2=0x7fec1c10c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:29:09.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.963+0000 7fec2402c700 1 --2- 172.21.15.26:0/2493245843 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec1c0f6860 0x7fec1c10c170 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7fec1800fae0 tx=0x7fec18009de0).stop 2021-11-03T17:29:09.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.963+0000 7fec2402c700 1 -- 172.21.15.26:0/2493245843 shutdown_connections 2021-11-03T17:29:09.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.963+0000 7fec2402c700 1 --2- 172.21.15.26:0/2493245843 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fec080640b0 0x7fec08066570 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:09.961 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.963+0000 7fec2402c700 1 --2- 172.21.15.26:0/2493245843 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec1c0f55c0 0x7fec1c109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:09.961 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.963+0000 7fec2402c700 1 --2- 172.21.15.26:0/2493245843 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec1c0f6860 0x7fec1c10c170 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:09.961 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.963+0000 7fec2402c700 1 -- 172.21.15.26:0/2493245843 >> 172.21.15.26:0/2493245843 conn(0x7fec1c0f0d40 msgr2=0x7fec1c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:29:09.961 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.963+0000 7fec2402c700 1 -- 172.21.15.26:0/2493245843 shutdown_connections 2021-11-03T17:29:09.962 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:09.963+0000 7fec2402c700 1 -- 172.21.15.26:0/2493245843 wait complete. 2021-11-03T17:29:09.968 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:29:10.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.068+0000 7f2246249700 1 -- 172.21.15.26:0/374341599 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22400f5ef0 msgr2=0x7f22400f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:29:10.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.068+0000 7f2246249700 1 --2- 172.21.15.26:0/374341599 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22400f5ef0 0x7f22400f6920 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f2234004660 tx=0x7f2234009b30).stop 2021-11-03T17:29:10.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.068+0000 7f2246249700 1 -- 172.21.15.26:0/374341599 shutdown_connections 2021-11-03T17:29:10.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.068+0000 7f2246249700 1 --2- 172.21.15.26:0/374341599 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22400f5ef0 0x7f22400f6920 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:10.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.068+0000 7f2246249700 1 --2- 172.21.15.26:0/374341599 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22400f55e0 0x7f22400f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:10.065 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.068+0000 7f2246249700 1 -- 172.21.15.26:0/374341599 >> 172.21.15.26:0/374341599 conn(0x7f22400f0de0 msgr2=0x7f22400f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:29:10.065 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.068+0000 7f2246249700 1 -- 172.21.15.26:0/374341599 shutdown_connections 2021-11-03T17:29:10.065 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.068+0000 7f2246249700 1 -- 172.21.15.26:0/374341599 wait complete. 2021-11-03T17:29:10.065 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.068+0000 7f2246249700 1 Processor -- start 2021-11-03T17:29:10.065 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.069+0000 7f2246249700 1 -- start start 2021-11-03T17:29:10.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.069+0000 7f2246249700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22400f55e0 0x7f2240106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:29:10.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.069+0000 7f2246249700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22400f5ef0 0x7f2240107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:29:10.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.069+0000 7f2246249700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2240107a20 con 0x7f22400f5ef0 2021-11-03T17:29:10.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.069+0000 7f2246249700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2240107b60 con 0x7f22400f55e0 2021-11-03T17:29:10.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.069+0000 7f223effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22400f5ef0 0x7f2240107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:29:10.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.069+0000 7f223effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22400f5ef0 0x7f2240107470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54676/0 (socket says 172.21.15.26:54676) 2021-11-03T17:29:10.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.069+0000 7f223effd700 1 -- 172.21.15.26:0/191003056 learned_addr learned my addr 172.21.15.26:0/191003056 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:29:10.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.069+0000 7f223f7fe700 1 --2- 172.21.15.26:0/191003056 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22400f55e0 0x7f2240106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:29:10.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.069+0000 7f223effd700 1 -- 172.21.15.26:0/191003056 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22400f55e0 msgr2=0x7f2240106f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:29:10.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.069+0000 7f223effd700 1 --2- 172.21.15.26:0/191003056 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22400f55e0 0x7f2240106f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:10.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.069+0000 7f223effd700 1 -- 172.21.15.26:0/191003056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2234005040 con 0x7f22400f5ef0 2021-11-03T17:29:10.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.069+0000 7f223effd700 1 --2- 172.21.15.26:0/191003056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22400f5ef0 0x7f2240107470 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f2234009990 tx=0x7f2234009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:29:10.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.070+0000 7f2227fff700 1 -- 172.21.15.26:0/191003056 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2234018070 con 0x7f22400f5ef0 2021-11-03T17:29:10.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.070+0000 7f2246249700 1 -- 172.21.15.26:0/191003056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22401084a0 con 0x7f22400f5ef0 2021-11-03T17:29:10.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.070+0000 7f2227fff700 1 -- 172.21.15.26:0/191003056 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2234007ba0 con 0x7f22400f5ef0 2021-11-03T17:29:10.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.070+0000 7f2227fff700 1 -- 172.21.15.26:0/191003056 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f223401c3c0 con 0x7f22400f5ef0 2021-11-03T17:29:10.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.070+0000 7f2246249700 1 -- 172.21.15.26:0/191003056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2240108a00 con 0x7f22400f5ef0 2021-11-03T17:29:10.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.071+0000 7f2246249700 1 -- 172.21.15.26:0/191003056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2240045ad0 con 0x7f22400f5ef0 2021-11-03T17:29:10.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.071+0000 7f2227fff700 1 -- 172.21.15.26:0/191003056 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f223401c680 con 0x7f22400f5ef0 2021-11-03T17:29:10.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.071+0000 7f2227fff700 1 --2- 172.21.15.26:0/191003056 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f22280640b0 0x7f2228066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:29:10.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.071+0000 7f2227fff700 1 -- 172.21.15.26:0/191003056 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f2234082470 con 0x7f22400f5ef0 2021-11-03T17:29:10.075 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.071+0000 7f223f7fe700 1 --2- 172.21.15.26:0/191003056 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f22280640b0 0x7f2228066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:29:10.075 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.072+0000 7f223f7fe700 1 --2- 172.21.15.26:0/191003056 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f22280640b0 0x7f2228066570 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f2230004c40 tx=0x7f223000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:29:10.076 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.076+0000 7f2227fff700 1 -- 172.21.15.26:0/191003056 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f2234054920 con 0x7f22400f5ef0 2021-11-03T17:29:10.249 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.254+0000 7f2246249700 1 -- 172.21.15.26:0/191003056 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2240108c20 con 0x7f22280640b0 2021-11-03T17:29:10.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.269+0000 7f2227fff700 1 -- 172.21.15.26:0/191003056 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f2240108c20 con 0x7f22280640b0 2021-11-03T17:29:10.264 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:29:10.265 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (40m) 5s ago 41m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:29:10.265 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (32m) 5s ago 41m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:29:10.265 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (32m) 9m ago 40m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:29:10.266 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (40m) 5s ago 41m 40.3M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:29:10.266 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (33m) 5s ago 36m 22.6M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:29:10.266 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (33m) 5s ago 36m 23.5M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:29:10.267 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (36m) 9m ago 36m 22.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:29:10.267 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (36m) 9m ago 36m 22.2M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:29:10.267 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (34m) 5s ago 42m 520M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:29:10.268 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (33m) 9m ago 40m 419M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:29:10.268 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (33m) 5s ago 43m 176M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:29:10.268 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (33m) 9m ago 40m 75.7M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:29:10.269 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (41m) 5s ago 41m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:29:10.269 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (40m) 9m ago 40m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:29:10.269 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (32m) 5s ago 40m 231M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:29:10.270 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (31m) 5s ago 39m 248M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:29:10.270 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (31m) 5s ago 39m 207M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:29:10.271 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (30m) 9m ago 39m 236M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:29:10.271 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (30m) 9m ago 38m 208M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:29:10.271 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (29m) 9m ago 38m 194M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:29:10.272 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (40m) 5s ago 41m 54.4M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:29:10.273 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.270+0000 7f2246249700 1 -- 172.21.15.26:0/191003056 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f22280640b0 msgr2=0x7f2228066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:29:10.273 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.270+0000 7f2246249700 1 --2- 172.21.15.26:0/191003056 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f22280640b0 0x7f2228066570 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f2230004c40 tx=0x7f223000b040).stop 2021-11-03T17:29:10.273 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.271+0000 7f2246249700 1 -- 172.21.15.26:0/191003056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22400f5ef0 msgr2=0x7f2240107470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:29:10.274 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.271+0000 7f2246249700 1 --2- 172.21.15.26:0/191003056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22400f5ef0 0x7f2240107470 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f2234009990 tx=0x7f2234009b30).stop 2021-11-03T17:29:10.274 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.271+0000 7f2246249700 1 -- 172.21.15.26:0/191003056 shutdown_connections 2021-11-03T17:29:10.274 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.271+0000 7f2246249700 1 --2- 172.21.15.26:0/191003056 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f22280640b0 0x7f2228066570 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:10.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.271+0000 7f2246249700 1 --2- 172.21.15.26:0/191003056 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22400f55e0 0x7f2240106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:10.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.271+0000 7f2246249700 1 --2- 172.21.15.26:0/191003056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22400f5ef0 0x7f2240107470 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:10.276 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.271+0000 7f2246249700 1 -- 172.21.15.26:0/191003056 >> 172.21.15.26:0/191003056 conn(0x7f22400f0de0 msgr2=0x7f22400fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:29:10.276 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.271+0000 7f2246249700 1 -- 172.21.15.26:0/191003056 shutdown_connections 2021-11-03T17:29:10.276 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.271+0000 7f2246249700 1 -- 172.21.15.26:0/191003056 wait complete. 2021-11-03T17:29:10.367 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.370+0000 7f11c59f8700 1 -- 172.21.15.26:0/790379794 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11c00f41a0 msgr2=0x7f11c00f45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:29:10.367 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.370+0000 7f11c59f8700 1 --2- 172.21.15.26:0/790379794 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11c00f41a0 0x7f11c00f45c0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f11b4004660 tx=0x7f11b4009b30).stop 2021-11-03T17:29:10.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.370+0000 7f11c59f8700 1 -- 172.21.15.26:0/790379794 shutdown_connections 2021-11-03T17:29:10.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.370+0000 7f11c59f8700 1 --2- 172.21.15.26:0/790379794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11c00f4b40 0x7f11c00fbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:10.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.370+0000 7f11c59f8700 1 --2- 172.21.15.26:0/790379794 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11c00f41a0 0x7f11c00f45c0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:10.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.370+0000 7f11c59f8700 1 -- 172.21.15.26:0/790379794 >> 172.21.15.26:0/790379794 conn(0x7f11c00efec0 msgr2=0x7f11c00f2300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:29:10.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.371+0000 7f11c59f8700 1 -- 172.21.15.26:0/790379794 shutdown_connections 2021-11-03T17:29:10.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.371+0000 7f11c59f8700 1 -- 172.21.15.26:0/790379794 wait complete. 2021-11-03T17:29:10.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.371+0000 7f11c59f8700 1 Processor -- start 2021-11-03T17:29:10.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.371+0000 7f11c59f8700 1 -- start start 2021-11-03T17:29:10.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.371+0000 7f11c59f8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11c00f41a0 0x7f11c0106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:29:10.370 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.371+0000 7f11c59f8700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11c00f4b40 0x7f11c0107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:29:10.370 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.371+0000 7f11c59f8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c0107880 con 0x7f11c00f41a0 2021-11-03T17:29:10.370 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.371+0000 7f11c59f8700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c01080c0 con 0x7f11c00f4b40 2021-11-03T17:29:10.370 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.372+0000 7f11c49f6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11c00f41a0 0x7f11c0106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:29:10.371 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.372+0000 7f11c49f6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11c00f41a0 0x7f11c0106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54684/0 (socket says 172.21.15.26:54684) 2021-11-03T17:29:10.371 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.372+0000 7f11c49f6700 1 -- 172.21.15.26:0/2986297950 learned_addr learned my addr 172.21.15.26:0/2986297950 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:29:10.371 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.372+0000 7f11bffff700 1 --2- 172.21.15.26:0/2986297950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11c00f4b40 0x7f11c0107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:29:10.371 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.372+0000 7f11c49f6700 1 -- 172.21.15.26:0/2986297950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11c00f4b40 msgr2=0x7f11c0107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:29:10.372 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.372+0000 7f11c49f6700 1 --2- 172.21.15.26:0/2986297950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11c00f4b40 0x7f11c0107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:10.372 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.372+0000 7f11c49f6700 1 -- 172.21.15.26:0/2986297950 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b4005040 con 0x7f11c00f41a0 2021-11-03T17:29:10.372 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.372+0000 7f11c49f6700 1 --2- 172.21.15.26:0/2986297950 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11c00f41a0 0x7f11c0106d90 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f11b4013a70 tx=0x7f11b4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:29:10.372 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.372+0000 7f11bd7fa700 1 -- 172.21.15.26:0/2986297950 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11b4018070 con 0x7f11c00f41a0 2021-11-03T17:29:10.372 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.372+0000 7f11bd7fa700 1 -- 172.21.15.26:0/2986297950 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f11b40097d0 con 0x7f11c00f41a0 2021-11-03T17:29:10.373 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.372+0000 7f11c59f8700 1 -- 172.21.15.26:0/2986297950 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c0108340 con 0x7f11c00f41a0 2021-11-03T17:29:10.373 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.372+0000 7f11bd7fa700 1 -- 172.21.15.26:0/2986297950 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11b401de80 con 0x7f11c00f41a0 2021-11-03T17:29:10.373 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.372+0000 7f11c59f8700 1 -- 172.21.15.26:0/2986297950 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c0108820 con 0x7f11c00f41a0 2021-11-03T17:29:10.374 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.373+0000 7f11c59f8700 1 -- 172.21.15.26:0/2986297950 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11c0059100 con 0x7f11c00f41a0 2021-11-03T17:29:10.374 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.374+0000 7f11bd7fa700 1 -- 172.21.15.26:0/2986297950 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f11b4007ba0 con 0x7f11c00f41a0 2021-11-03T17:29:10.375 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.374+0000 7f11bd7fa700 1 --2- 172.21.15.26:0/2986297950 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f11b0064100 0x7f11b00665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:29:10.375 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.374+0000 7f11bd7fa700 1 -- 172.21.15.26:0/2986297950 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f11b40822e0 con 0x7f11c00f41a0 2021-11-03T17:29:10.375 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.374+0000 7f11bffff700 1 --2- 172.21.15.26:0/2986297950 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f11b0064100 0x7f11b00665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:29:10.375 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.374+0000 7f11bffff700 1 --2- 172.21.15.26:0/2986297950 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f11b0064100 0x7f11b00665c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f11c0106b20 tx=0x7f11ac00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:29:10.376 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.378+0000 7f11bd7fa700 1 -- 172.21.15.26:0/2986297950 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f11b4054700 con 0x7f11c00f41a0 2021-11-03T17:29:10.420 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:10 smithi026 ceph-mon[96795]: pgmap v1035: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:10.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:10 smithi194 ceph-mon[65619]: pgmap v1035: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:10.604 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.609+0000 7f11c59f8700 1 -- 172.21.15.26:0/2986297950 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f11c00fed20 con 0x7f11c00f41a0 2021-11-03T17:29:10.605 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.610+0000 7f11bd7fa700 1 -- 172.21.15.26:0/2986297950 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f11b40542f0 con 0x7f11c00f41a0 2021-11-03T17:29:10.605 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:29:10.605 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:29:10.606 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:29:10.606 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:29:10.606 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:29:10.606 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:29:10.607 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:29:10.607 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:29:10.607 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:29:10.607 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:29:10.607 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:29:10.608 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:29:10.608 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:29:10.608 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:29:10.608 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:29:10.609 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:29:10.609 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:29:10.609 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:29:10.610 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.612+0000 7f11c59f8700 1 -- 172.21.15.26:0/2986297950 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f11b0064100 msgr2=0x7f11b00665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:29:10.610 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.612+0000 7f11c59f8700 1 --2- 172.21.15.26:0/2986297950 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f11b0064100 0x7f11b00665c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f11c0106b20 tx=0x7f11ac00b040).stop 2021-11-03T17:29:10.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.612+0000 7f11c59f8700 1 -- 172.21.15.26:0/2986297950 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11c00f41a0 msgr2=0x7f11c0106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:29:10.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.612+0000 7f11c59f8700 1 --2- 172.21.15.26:0/2986297950 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11c00f41a0 0x7f11c0106d90 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f11b4013a70 tx=0x7f11b4009b30).stop 2021-11-03T17:29:10.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.612+0000 7f11c59f8700 1 -- 172.21.15.26:0/2986297950 shutdown_connections 2021-11-03T17:29:10.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.612+0000 7f11c59f8700 1 --2- 172.21.15.26:0/2986297950 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f11b0064100 0x7f11b00665c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:10.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.612+0000 7f11c59f8700 1 --2- 172.21.15.26:0/2986297950 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11c00f41a0 0x7f11c0106d90 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:10.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.612+0000 7f11c59f8700 1 --2- 172.21.15.26:0/2986297950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11c00f4b40 0x7f11c0107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:10.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.612+0000 7f11c59f8700 1 -- 172.21.15.26:0/2986297950 >> 172.21.15.26:0/2986297950 conn(0x7f11c00efec0 msgr2=0x7f11c00f8570 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:29:10.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.612+0000 7f11c59f8700 1 -- 172.21.15.26:0/2986297950 shutdown_connections 2021-11-03T17:29:10.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.612+0000 7f11c59f8700 1 -- 172.21.15.26:0/2986297950 wait complete. 2021-11-03T17:29:10.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.712+0000 7fedf8f2a700 1 -- 172.21.15.26:0/1813692846 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedf40f66e0 msgr2=0x7fedf40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:29:10.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.712+0000 7fedf8f2a700 1 --2- 172.21.15.26:0/1813692846 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedf40f66e0 0x7fedf40f6b00 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7fede4004660 tx=0x7fede4009b30).stop 2021-11-03T17:29:10.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.712+0000 7fedf8f2a700 1 -- 172.21.15.26:0/1813692846 shutdown_connections 2021-11-03T17:29:10.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.712+0000 7fedf8f2a700 1 --2- 172.21.15.26:0/1813692846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fedf40f6ff0 0x7fedf40f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:10.710 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.712+0000 7fedf8f2a700 1 --2- 172.21.15.26:0/1813692846 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedf40f66e0 0x7fedf40f6b00 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:10.710 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.712+0000 7fedf8f2a700 1 -- 172.21.15.26:0/1813692846 >> 172.21.15.26:0/1813692846 conn(0x7fedf40f1f00 msgr2=0x7fedf40f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:29:10.710 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.712+0000 7fedf8f2a700 1 -- 172.21.15.26:0/1813692846 shutdown_connections 2021-11-03T17:29:10.711 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.712+0000 7fedf8f2a700 1 -- 172.21.15.26:0/1813692846 wait complete. 2021-11-03T17:29:10.711 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.712+0000 7fedf8f2a700 1 Processor -- start 2021-11-03T17:29:10.711 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.712+0000 7fedf8f2a700 1 -- start start 2021-11-03T17:29:10.711 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.713+0000 7fedf8f2a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedf40f66e0 0x7fedf4106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:29:10.711 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.713+0000 7fedf8f2a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fedf40f6ff0 0x7fedf4107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:29:10.712 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.713+0000 7fedf8f2a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf4107a00 con 0x7fedf40f66e0 2021-11-03T17:29:10.712 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.713+0000 7fedf8f2a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf4107b40 con 0x7fedf40f6ff0 2021-11-03T17:29:10.712 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.713+0000 7fedf259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedf40f66e0 0x7fedf4106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:29:10.712 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.713+0000 7fedf259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedf40f66e0 0x7fedf4106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54694/0 (socket says 172.21.15.26:54694) 2021-11-03T17:29:10.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.713+0000 7fedf259c700 1 -- 172.21.15.26:0/4039484274 learned_addr learned my addr 172.21.15.26:0/4039484274 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:29:10.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.713+0000 7fedf259c700 1 -- 172.21.15.26:0/4039484274 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fedf40f6ff0 msgr2=0x7fedf4107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:29:10.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.713+0000 7fedf259c700 1 --2- 172.21.15.26:0/4039484274 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fedf40f6ff0 0x7fedf4107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:29:10.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.713+0000 7fedf259c700 1 -- 172.21.15.26:0/4039484274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede4005040 con 0x7fedf40f66e0 2021-11-03T17:29:10.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.713+0000 7fedf259c700 1 --2- 172.21.15.26:0/4039484274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedf40f66e0 0x7fedf4106f60 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7fede4009da0 tx=0x7fede4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:29:10.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.713+0000 7fede2ffd700 1 -- 172.21.15.26:0/4039484274 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fede4018070 con 0x7fedf40f66e0 2021-11-03T17:29:10.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.713+0000 7fede2ffd700 1 -- 172.21.15.26:0/4039484274 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fede4007d70 con 0x7fedf40f66e0 2021-11-03T17:29:10.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.713+0000 7fedf8f2a700 1 -- 172.21.15.26:0/4039484274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf4108480 con 0x7fedf40f66e0 2021-11-03T17:29:10.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.713+0000 7fede2ffd700 1 -- 172.21.15.26:0/4039484274 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fede401dea0 con 0x7fedf40f66e0 2021-11-03T17:29:10.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.713+0000 7fedf8f2a700 1 -- 172.21.15.26:0/4039484274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf41089e0 con 0x7fedf40f66e0 2021-11-03T17:29:10.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.714+0000 7fede0ff9700 1 -- 172.21.15.26:0/4039484274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedcc004fa0 con 0x7fedf40f66e0 2021-11-03T17:29:10.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.715+0000 7fede2ffd700 1 -- 172.21.15.26:0/4039484274 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fede401d420 con 0x7fedf40f66e0 2021-11-03T17:29:10.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.715+0000 7fede2ffd700 1 --2- 172.21.15.26:0/4039484274 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7feddc064090 0x7feddc066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:29:10.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.715+0000 7fede2ffd700 1 -- 172.21.15.26:0/4039484274 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fede4082590 con 0x7fedf40f66e0 2021-11-03T17:29:10.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.715+0000 7fedf1d9b700 1 --2- 172.21.15.26:0/4039484274 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7feddc064090 0x7feddc066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:29:10.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.715+0000 7fedf1d9b700 1 --2- 172.21.15.26:0/4039484274 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7feddc064090 0x7feddc066550 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fede8004870 tx=0x7fede80079c0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:29:10.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.719+0000 7fede2ffd700 1 -- 172.21.15.26:0/4039484274 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fede40548f0 con 0x7fedf40f66e0 2021-11-03T17:29:10.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.921+0000 7fede0ff9700 1 -- 172.21.15.26:0/4039484274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fedcc005e80 con 0x7fedf40f66e0 2021-11-03T17:29:10.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.922+0000 7fede2ffd700 1 -- 172.21.15.26:0/4039484274 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fede40544e0 con 0x7fedf40f66e0 2021-11-03T17:29:10.917 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:29:10.918 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:29:10.918 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:29:10.918 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:29:10.918 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:29:10.919 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:29:10.919 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:29:10.919 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:29:10.919 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:29:10.919 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:29:10.920 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:29:10.920 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:29:10.920 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:29:10.920 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:29:10.921 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:29:10.921 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:29:10.921 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:29:10.921 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:29:10.921 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:29:10.922 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:29:10.922 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:29:10.922 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:29:10.922 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:29:10.923 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:29:10.923 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:29:10.923 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:29:10.923 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:29:10.924 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:29:10.924 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:29:10.924 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:29:10.924 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:29:10.924 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:29:10.925 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:29:10.925 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:29:10.925 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:29:10.925 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:29:10.926 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:29:10.926 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:29:10.926 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:29:10.927 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.924+0000 7fede0ff9700 1 -- 172.21.15.26:0/4039484274 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7feddc064090 msgr2=0x7feddc066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:29:10.928 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.924+0000 7fede0ff9700 1 --2- 172.21.15.26:0/4039484274 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7feddc064090 0x7feddc066550 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fede8004870 tx=0x7fede80079c0).stop 2021-11-03T17:29:10.928 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.924+0000 7fede0ff9700 1 -- 172.21.15.26:0/4039484274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedf40f66e0 msgr2=0x7fedf4106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:29:10.928 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.924+0000 7fede0ff9700 1 --2- 172.21.15.26:0/4039484274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedf40f66e0 0x7fedf4106f60 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7fede4009da0 tx=0x7fede4009b30).stop 2021-11-03T17:29:10.928 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.924+0000 7fede0ff9700 1 -- 172.21.15.26:0/4039484274 shutdown_connections 2021-11-03T17:29:10.928 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.924+0000 7fede0ff9700 1 --2- 172.21.15.26:0/4039484274 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7feddc064090 0x7feddc066550 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:10.929 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.924+0000 7fede0ff9700 1 --2- 172.21.15.26:0/4039484274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedf40f66e0 0x7fedf4106f60 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:10.929 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.924+0000 7fede0ff9700 1 --2- 172.21.15.26:0/4039484274 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fedf40f6ff0 0x7fedf4107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:29:10.929 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.924+0000 7fede0ff9700 1 -- 172.21.15.26:0/4039484274 >> 172.21.15.26:0/4039484274 conn(0x7fedf40f1f00 msgr2=0x7fedf40fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:29:10.929 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.924+0000 7fede0ff9700 1 -- 172.21.15.26:0/4039484274 shutdown_connections 2021-11-03T17:29:10.930 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:10.924+0000 7fede0ff9700 1 -- 172.21.15.26:0/4039484274 wait complete. 2021-11-03T17:29:10.930 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:29:11.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:11 smithi026 ceph-mon[96795]: from='client.35212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:29:11.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:11 smithi026 ceph-mon[96795]: from='client.35216 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:29:11.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:11 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2986297950' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:29:11.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:11 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/4039484274' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:29:11.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:11 smithi194 ceph-mon[65619]: from='client.35212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:29:11.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:11 smithi194 ceph-mon[65619]: from='client.35216 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:29:11.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:11 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2986297950' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:29:11.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:11 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/4039484274' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:29:12.420 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:12 smithi026 ceph-mon[96795]: pgmap v1036: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:12.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:12 smithi194 ceph-mon[65619]: pgmap v1036: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:14.420 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:14 smithi026 ceph-mon[96795]: pgmap v1037: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:14.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:14 smithi194 ceph-mon[65619]: pgmap v1037: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:16.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:16 smithi026 ceph-mon[96795]: pgmap v1038: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:16.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:16 smithi194 ceph-mon[65619]: pgmap v1038: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:18.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:18 smithi026 ceph-mon[96795]: pgmap v1039: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:18.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:18 smithi194 ceph-mon[65619]: pgmap v1039: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:20.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:20 smithi026 ceph-mon[96795]: pgmap v1040: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:20.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:20 smithi194 ceph-mon[65619]: pgmap v1040: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:21.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:21 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:29:21.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:21 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:29:21.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:21 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:29:21.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:21 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:29:22.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:22 smithi026 ceph-mon[96795]: pgmap v1041: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:22.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:22 smithi194 ceph-mon[65619]: pgmap v1041: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:24.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:24 smithi026 ceph-mon[96795]: pgmap v1042: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:24.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:24 smithi194 ceph-mon[65619]: pgmap v1042: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:26.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:26 smithi026 ceph-mon[96795]: pgmap v1043: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:26.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:26 smithi194 ceph-mon[65619]: pgmap v1043: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:28.420 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:28 smithi026 ceph-mon[96795]: pgmap v1044: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:28.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:28 smithi194 ceph-mon[65619]: pgmap v1044: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:30.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:30 smithi026 ceph-mon[96795]: pgmap v1045: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:30.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:30 smithi194 ceph-mon[65619]: pgmap v1045: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:32.420 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:32 smithi026 ceph-mon[96795]: pgmap v1046: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:32.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:32 smithi194 ceph-mon[65619]: pgmap v1046: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:34.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:34 smithi026 ceph-mon[96795]: pgmap v1047: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:34.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:34 smithi194 ceph-mon[65619]: pgmap v1047: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:36.420 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:36 smithi026 ceph-mon[96795]: pgmap v1048: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:36.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:36 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:29:36.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:36 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:29:36.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:36 smithi194 ceph-mon[65619]: pgmap v1048: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:36.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:36 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:29:36.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:36 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:29:38.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:38 smithi026 ceph-mon[96795]: pgmap v1049: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:38.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:38 smithi194 ceph-mon[65619]: pgmap v1049: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:40.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:40 smithi026 ceph-mon[96795]: pgmap v1050: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:40.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:40 smithi194 ceph-mon[65619]: pgmap v1050: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:41.035 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.040+0000 7f38c6bcb700 1 -- 172.21.15.26:0/2089999570 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38c00602b0 msgr2=0x7f38c00f9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:29:41.035 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.040+0000 7f38c6bcb700 1 --2- 172.21.15.26:0/2089999570 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38c00602b0 0x7f38c00f9420 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f38b4004690 tx=0x7f38b4009b30).stop 2021-11-03T17:29:41.035 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.040+0000 7f38c6bcb700 1 -- 172.21.15.26:0/2089999570 shutdown_connections 2021-11-03T17:29:41.036 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.040+0000 7f38c6bcb700 1 --2- 172.21.15.26:0/2089999570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38c00f9910 0x7f38c00fbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:41.036 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.040+0000 7f38c6bcb700 1 --2- 172.21.15.26:0/2089999570 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38c00602b0 0x7f38c00f9420 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:41.036 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.040+0000 7f38c6bcb700 1 -- 172.21.15.26:0/2089999570 >> 172.21.15.26:0/2089999570 conn(0x7f38c00f0de0 msgr2=0x7f38c00f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:29:41.036 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.040+0000 7f38c6bcb700 1 -- 172.21.15.26:0/2089999570 shutdown_connections 2021-11-03T17:29:41.037 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.040+0000 7f38c6bcb700 1 -- 172.21.15.26:0/2089999570 wait complete. 2021-11-03T17:29:41.037 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.041+0000 7f38c6bcb700 1 Processor -- start 2021-11-03T17:29:41.037 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.041+0000 7f38c6bcb700 1 -- start start 2021-11-03T17:29:41.039 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.041+0000 7f38c6bcb700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38c00602b0 0x7f38c0106f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:29:41.040 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.041+0000 7f38c6bcb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38c00f9910 0x7f38c0107420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:29:41.040 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.041+0000 7f38c6bcb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c01079d0 con 0x7f38c00f9910 2021-11-03T17:29:41.040 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.041+0000 7f38c6bcb700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c0107b10 con 0x7f38c00602b0 2021-11-03T17:29:41.040 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.042+0000 7f38bffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38c00f9910 0x7f38c0107420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:29:41.041 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.042+0000 7f38bffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38c00f9910 0x7f38c0107420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54714/0 (socket says 172.21.15.26:54714) 2021-11-03T17:29:41.041 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.042+0000 7f38bffff700 1 -- 172.21.15.26:0/3552929474 learned_addr learned my addr 172.21.15.26:0/3552929474 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:29:41.041 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.042+0000 7f38c4967700 1 --2- 172.21.15.26:0/3552929474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38c00602b0 0x7f38c0106f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:29:41.041 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.042+0000 7f38bffff700 1 -- 172.21.15.26:0/3552929474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38c00602b0 msgr2=0x7f38c0106f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:29:41.042 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.042+0000 7f38bffff700 1 --2- 172.21.15.26:0/3552929474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38c00602b0 0x7f38c0106f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:41.042 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.042+0000 7f38bffff700 1 -- 172.21.15.26:0/3552929474 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b4005040 con 0x7f38c00f9910 2021-11-03T17:29:41.042 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.042+0000 7f38bffff700 1 --2- 172.21.15.26:0/3552929474 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38c00f9910 0x7f38c0107420 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f38ac0026d0 tx=0x7f38ac009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:29:41.042 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.042+0000 7f38bd7fa700 1 -- 172.21.15.26:0/3552929474 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38ac0079c0 con 0x7f38c00f9910 2021-11-03T17:29:41.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.042+0000 7f38c6bcb700 1 -- 172.21.15.26:0/3552929474 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38c01084b0 con 0x7f38c00f9910 2021-11-03T17:29:41.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.042+0000 7f38bd7fa700 1 -- 172.21.15.26:0/3552929474 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f38ac00f040 con 0x7f38c00f9910 2021-11-03T17:29:41.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.042+0000 7f38bd7fa700 1 -- 172.21.15.26:0/3552929474 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38ac0148b0 con 0x7f38c00f9910 2021-11-03T17:29:41.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.042+0000 7f38c6bcb700 1 -- 172.21.15.26:0/3552929474 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c0108a70 con 0x7f38c00f9910 2021-11-03T17:29:41.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.043+0000 7f38c6bcb700 1 -- 172.21.15.26:0/3552929474 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c0045ad0 con 0x7f38c00f9910 2021-11-03T17:29:41.044 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.044+0000 7f38bd7fa700 1 -- 172.21.15.26:0/3552929474 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f38ac007b20 con 0x7f38c00f9910 2021-11-03T17:29:41.044 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.044+0000 7f38bd7fa700 1 --2- 172.21.15.26:0/3552929474 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f38b0064090 0x7f38b0066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:29:41.044 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.044+0000 7f38bd7fa700 1 -- 172.21.15.26:0/3552929474 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f38ac0807f0 con 0x7f38c00f9910 2021-11-03T17:29:41.044 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.044+0000 7f38c4967700 1 --2- 172.21.15.26:0/3552929474 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f38b0064090 0x7f38b0066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:29:41.045 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.045+0000 7f38c4967700 1 --2- 172.21.15.26:0/3552929474 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f38b0064090 0x7f38b0066550 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f38b4000c00 tx=0x7f38b4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:29:41.045 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.048+0000 7f38bd7fa700 1 -- 172.21.15.26:0/3552929474 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f38ac052a90 con 0x7f38c00f9910 2021-11-03T17:29:41.222 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.228+0000 7f38c6bcb700 1 -- 172.21.15.26:0/3552929474 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f38c0108cf0 con 0x7f38b0064090 2021-11-03T17:29:41.223 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.229+0000 7f38bd7fa700 1 -- 172.21.15.26:0/3552929474 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f38c0108cf0 con 0x7f38b0064090 2021-11-03T17:29:41.225 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.231+0000 7f38c6bcb700 1 -- 172.21.15.26:0/3552929474 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f38b0064090 msgr2=0x7f38b0066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:29:41.225 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.231+0000 7f38c6bcb700 1 --2- 172.21.15.26:0/3552929474 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f38b0064090 0x7f38b0066550 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f38b4000c00 tx=0x7f38b4009b30).stop 2021-11-03T17:29:41.225 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.231+0000 7f38c6bcb700 1 -- 172.21.15.26:0/3552929474 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38c00f9910 msgr2=0x7f38c0107420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:29:41.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.231+0000 7f38c6bcb700 1 --2- 172.21.15.26:0/3552929474 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38c00f9910 0x7f38c0107420 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f38ac0026d0 tx=0x7f38ac009de0).stop 2021-11-03T17:29:41.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.231+0000 7f38c6bcb700 1 -- 172.21.15.26:0/3552929474 shutdown_connections 2021-11-03T17:29:41.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.231+0000 7f38c6bcb700 1 --2- 172.21.15.26:0/3552929474 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f38b0064090 0x7f38b0066550 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:41.227 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.231+0000 7f38c6bcb700 1 --2- 172.21.15.26:0/3552929474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38c00602b0 0x7f38c0106f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:41.227 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.231+0000 7f38c6bcb700 1 --2- 172.21.15.26:0/3552929474 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38c00f9910 0x7f38c0107420 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:41.227 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.231+0000 7f38c6bcb700 1 -- 172.21.15.26:0/3552929474 >> 172.21.15.26:0/3552929474 conn(0x7f38c00f0de0 msgr2=0x7f38c00f31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:29:41.227 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.231+0000 7f38c6bcb700 1 -- 172.21.15.26:0/3552929474 shutdown_connections 2021-11-03T17:29:41.227 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.231+0000 7f38c6bcb700 1 -- 172.21.15.26:0/3552929474 wait complete. 2021-11-03T17:29:41.235 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:29:41.327 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.331+0000 7f95dc949700 1 -- 172.21.15.26:0/3531885494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95d80f55e0 msgr2=0x7f95d80f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:29:41.327 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.331+0000 7f95dc949700 1 --2- 172.21.15.26:0/3531885494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95d80f55e0 0x7f95d80f5a00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f95c8004660 tx=0x7f95c8009b30).stop 2021-11-03T17:29:41.327 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.331+0000 7f95dc949700 1 -- 172.21.15.26:0/3531885494 shutdown_connections 2021-11-03T17:29:41.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.331+0000 7f95dc949700 1 --2- 172.21.15.26:0/3531885494 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95d80f5ef0 0x7f95d80f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:41.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.331+0000 7f95dc949700 1 --2- 172.21.15.26:0/3531885494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95d80f55e0 0x7f95d80f5a00 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:41.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.331+0000 7f95dc949700 1 -- 172.21.15.26:0/3531885494 >> 172.21.15.26:0/3531885494 conn(0x7f95d80f0de0 msgr2=0x7f95d80f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:29:41.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.331+0000 7f95dc949700 1 -- 172.21.15.26:0/3531885494 shutdown_connections 2021-11-03T17:29:41.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.331+0000 7f95dc949700 1 -- 172.21.15.26:0/3531885494 wait complete. 2021-11-03T17:29:41.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.332+0000 7f95dc949700 1 Processor -- start 2021-11-03T17:29:41.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.332+0000 7f95dc949700 1 -- start start 2021-11-03T17:29:41.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.332+0000 7f95dc949700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95d80f55e0 0x7f95d8106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:29:41.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.332+0000 7f95dc949700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95d80f5ef0 0x7f95d81073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:29:41.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.332+0000 7f95dc949700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d8107990 con 0x7f95d80f5ef0 2021-11-03T17:29:41.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.332+0000 7f95dc949700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d8107ad0 con 0x7f95d80f55e0 2021-11-03T17:29:41.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.332+0000 7f95cffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95d80f5ef0 0x7f95d81073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:29:41.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.332+0000 7f95cffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95d80f5ef0 0x7f95d81073e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54724/0 (socket says 172.21.15.26:54724) 2021-11-03T17:29:41.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.332+0000 7f95cffff700 1 -- 172.21.15.26:0/2825560773 learned_addr learned my addr 172.21.15.26:0/2825560773 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:29:41.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.332+0000 7f95d659c700 1 --2- 172.21.15.26:0/2825560773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95d80f55e0 0x7f95d8106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:29:41.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.333+0000 7f95cffff700 1 -- 172.21.15.26:0/2825560773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95d80f55e0 msgr2=0x7f95d8106ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:29:41.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.333+0000 7f95cffff700 1 --2- 172.21.15.26:0/2825560773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95d80f55e0 0x7f95d8106ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:41.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.333+0000 7f95cffff700 1 -- 172.21.15.26:0/2825560773 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c8005040 con 0x7f95d80f5ef0 2021-11-03T17:29:41.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.333+0000 7f95cffff700 1 --2- 172.21.15.26:0/2825560773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95d80f5ef0 0x7f95d81073e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f95c00026d0 tx=0x7f95c0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:29:41.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.333+0000 7f95ceffd700 1 -- 172.21.15.26:0/2825560773 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95c00079c0 con 0x7f95d80f5ef0 2021-11-03T17:29:41.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.333+0000 7f95ceffd700 1 -- 172.21.15.26:0/2825560773 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f95c000f040 con 0x7f95d80f5ef0 2021-11-03T17:29:41.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.333+0000 7f95ceffd700 1 -- 172.21.15.26:0/2825560773 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95c00148b0 con 0x7f95d80f5ef0 2021-11-03T17:29:41.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.333+0000 7f95dc949700 1 -- 172.21.15.26:0/2825560773 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95d8108470 con 0x7f95d80f5ef0 2021-11-03T17:29:41.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.333+0000 7f95dc949700 1 -- 172.21.15.26:0/2825560773 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95d8108a30 con 0x7f95d80f5ef0 2021-11-03T17:29:41.334 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.334+0000 7f95dc949700 1 -- 172.21.15.26:0/2825560773 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95d8045ad0 con 0x7f95d80f5ef0 2021-11-03T17:29:41.334 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.334+0000 7f95ceffd700 1 -- 172.21.15.26:0/2825560773 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f95c0007b20 con 0x7f95d80f5ef0 2021-11-03T17:29:41.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.335+0000 7f95ceffd700 1 --2- 172.21.15.26:0/2825560773 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f95c40640b0 0x7f95c4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:29:41.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.335+0000 7f95ceffd700 1 -- 172.21.15.26:0/2825560773 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f95c0080660 con 0x7f95d80f5ef0 2021-11-03T17:29:41.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.335+0000 7f95d659c700 1 --2- 172.21.15.26:0/2825560773 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f95c40640b0 0x7f95c4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:29:41.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.335+0000 7f95d659c700 1 --2- 172.21.15.26:0/2825560773 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f95c40640b0 0x7f95c4066570 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f95c8004630 tx=0x7f95c8009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:29:41.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.339+0000 7f95ceffd700 1 -- 172.21.15.26:0/2825560773 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f95c00529c0 con 0x7f95d80f5ef0 2021-11-03T17:29:41.507 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.513+0000 7f95dc949700 1 -- 172.21.15.26:0/2825560773 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f95d8108d00 con 0x7f95c40640b0 2021-11-03T17:29:41.521 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.528+0000 7f95ceffd700 1 -- 172.21.15.26:0/2825560773 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f95d8108d00 con 0x7f95c40640b0 2021-11-03T17:29:41.522 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:29:41.522 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (40m) 36s ago 42m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:29:41.522 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (33m) 36s ago 42m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:29:41.523 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (32m) 9m ago 41m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:29:41.523 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (40m) 36s ago 41m 40.3M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:29:41.523 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (33m) 36s ago 37m 22.6M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:29:41.523 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (34m) 36s ago 37m 23.5M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:29:41.524 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (37m) 9m ago 37m 22.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:29:41.524 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (37m) 9m ago 37m 22.2M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:29:41.524 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (34m) 36s ago 43m 520M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:29:41.524 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (34m) 9m ago 41m 419M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:29:41.524 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (34m) 36s ago 43m 176M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:29:41.525 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (33m) 9m ago 41m 75.7M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:29:41.525 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (41m) 36s ago 41m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:29:41.525 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (41m) 9m ago 41m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:29:41.525 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (32m) 36s ago 40m 231M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:29:41.526 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (32m) 36s ago 40m 248M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:29:41.526 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (31m) 36s ago 39m 207M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:29:41.526 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (31m) 9m ago 39m 236M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:29:41.526 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (30m) 9m ago 39m 208M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:29:41.526 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (30m) 9m ago 38m 194M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:29:41.527 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (40m) 36s ago 41m 54.4M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:29:41.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.529+0000 7f95dc949700 1 -- 172.21.15.26:0/2825560773 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f95c40640b0 msgr2=0x7f95c4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:29:41.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.529+0000 7f95dc949700 1 --2- 172.21.15.26:0/2825560773 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f95c40640b0 0x7f95c4066570 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f95c8004630 tx=0x7f95c8009b30).stop 2021-11-03T17:29:41.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.529+0000 7f95dc949700 1 -- 172.21.15.26:0/2825560773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95d80f5ef0 msgr2=0x7f95d81073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:29:41.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.529+0000 7f95dc949700 1 --2- 172.21.15.26:0/2825560773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95d80f5ef0 0x7f95d81073e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f95c00026d0 tx=0x7f95c0009de0).stop 2021-11-03T17:29:41.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.529+0000 7f95dc949700 1 -- 172.21.15.26:0/2825560773 shutdown_connections 2021-11-03T17:29:41.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.529+0000 7f95dc949700 1 --2- 172.21.15.26:0/2825560773 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f95c40640b0 0x7f95c4066570 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:41.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.529+0000 7f95dc949700 1 --2- 172.21.15.26:0/2825560773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95d80f55e0 0x7f95d8106ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:41.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.529+0000 7f95dc949700 1 --2- 172.21.15.26:0/2825560773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95d80f5ef0 0x7f95d81073e0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:41.530 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.529+0000 7f95dc949700 1 -- 172.21.15.26:0/2825560773 >> 172.21.15.26:0/2825560773 conn(0x7f95d80f0de0 msgr2=0x7f95d80fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:29:41.530 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.529+0000 7f95dc949700 1 -- 172.21.15.26:0/2825560773 shutdown_connections 2021-11-03T17:29:41.530 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.529+0000 7f95dc949700 1 -- 172.21.15.26:0/2825560773 wait complete. 2021-11-03T17:29:41.623 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.628+0000 7fed531e0700 1 -- 172.21.15.26:0/4162419069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed4c0f5ef0 msgr2=0x7fed4c0f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:29:41.624 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.628+0000 7fed531e0700 1 --2- 172.21.15.26:0/4162419069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed4c0f5ef0 0x7fed4c0f6920 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7fed40004660 tx=0x7fed40009b30).stop 2021-11-03T17:29:41.624 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.628+0000 7fed531e0700 1 -- 172.21.15.26:0/4162419069 shutdown_connections 2021-11-03T17:29:41.624 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.628+0000 7fed531e0700 1 --2- 172.21.15.26:0/4162419069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed4c0f5ef0 0x7fed4c0f6920 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:41.624 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.628+0000 7fed531e0700 1 --2- 172.21.15.26:0/4162419069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed4c0f55e0 0x7fed4c0f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:41.625 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.628+0000 7fed531e0700 1 -- 172.21.15.26:0/4162419069 >> 172.21.15.26:0/4162419069 conn(0x7fed4c0f0de0 msgr2=0x7fed4c0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:29:41.625 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.628+0000 7fed531e0700 1 -- 172.21.15.26:0/4162419069 shutdown_connections 2021-11-03T17:29:41.625 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.628+0000 7fed531e0700 1 -- 172.21.15.26:0/4162419069 wait complete. 2021-11-03T17:29:41.625 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.628+0000 7fed531e0700 1 Processor -- start 2021-11-03T17:29:41.626 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.628+0000 7fed531e0700 1 -- start start 2021-11-03T17:29:41.626 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.629+0000 7fed531e0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed4c0f55e0 0x7fed4c10c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:29:41.626 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.629+0000 7fed531e0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed4c0f5ef0 0x7fed4c10e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:29:41.626 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.629+0000 7fed531e0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c0603d0 con 0x7fed4c0f5ef0 2021-11-03T17:29:41.627 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.629+0000 7fed531e0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c060510 con 0x7fed4c0f55e0 2021-11-03T17:29:41.627 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.629+0000 7fed4bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed4c0f5ef0 0x7fed4c10e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:29:41.627 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.629+0000 7fed4bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed4c0f5ef0 0x7fed4c10e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54734/0 (socket says 172.21.15.26:54734) 2021-11-03T17:29:41.627 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.629+0000 7fed4bfff700 1 -- 172.21.15.26:0/925214772 learned_addr learned my addr 172.21.15.26:0/925214772 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:29:41.627 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.629+0000 7fed50f7c700 1 --2- 172.21.15.26:0/925214772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed4c0f55e0 0x7fed4c10c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:29:41.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.629+0000 7fed4bfff700 1 -- 172.21.15.26:0/925214772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed4c0f55e0 msgr2=0x7fed4c10c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:29:41.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.629+0000 7fed4bfff700 1 --2- 172.21.15.26:0/925214772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed4c0f55e0 0x7fed4c10c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:41.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.629+0000 7fed4bfff700 1 -- 172.21.15.26:0/925214772 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed40005040 con 0x7fed4c0f5ef0 2021-11-03T17:29:41.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.629+0000 7fed50f7c700 1 --2- 172.21.15.26:0/925214772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed4c0f55e0 0x7fed4c10c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:29:41.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.629+0000 7fed4bfff700 1 --2- 172.21.15.26:0/925214772 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed4c0f5ef0 0x7fed4c10e5b0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7fed40009990 tx=0x7fed40009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:29:41.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.629+0000 7fed497fa700 1 -- 172.21.15.26:0/925214772 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed40018070 con 0x7fed4c0f5ef0 2021-11-03T17:29:41.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.629+0000 7fed497fa700 1 -- 172.21.15.26:0/925214772 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fed40007ba0 con 0x7fed4c0f5ef0 2021-11-03T17:29:41.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.629+0000 7fed531e0700 1 -- 172.21.15.26:0/925214772 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed4c10eaa0 con 0x7fed4c0f5ef0 2021-11-03T17:29:41.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.629+0000 7fed497fa700 1 -- 172.21.15.26:0/925214772 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed4001c3c0 con 0x7fed4c0f5ef0 2021-11-03T17:29:41.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.630+0000 7fed531e0700 1 -- 172.21.15.26:0/925214772 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed4c10ee70 con 0x7fed4c0f5ef0 2021-11-03T17:29:41.631 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.631+0000 7fed531e0700 1 -- 172.21.15.26:0/925214772 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed4c045ad0 con 0x7fed4c0f5ef0 2021-11-03T17:29:41.631 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.631+0000 7fed497fa700 1 -- 172.21.15.26:0/925214772 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fed4001d420 con 0x7fed4c0f5ef0 2021-11-03T17:29:41.631 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.631+0000 7fed497fa700 1 --2- 172.21.15.26:0/925214772 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fed340640b0 0x7fed34066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:29:41.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.631+0000 7fed497fa700 1 -- 172.21.15.26:0/925214772 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fed400825b0 con 0x7fed4c0f5ef0 2021-11-03T17:29:41.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.631+0000 7fed50f7c700 1 --2- 172.21.15.26:0/925214772 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fed340640b0 0x7fed34066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:29:41.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.632+0000 7fed50f7c700 1 --2- 172.21.15.26:0/925214772 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fed340640b0 0x7fed34066570 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7fed4c060160 tx=0x7fed44004d00).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:29:41.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.635+0000 7fed497fa700 1 -- 172.21.15.26:0/925214772 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fed40054970 con 0x7fed4c0f5ef0 2021-11-03T17:29:41.862 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.868+0000 7fed531e0700 1 -- 172.21.15.26:0/925214772 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fed4c027a00 con 0x7fed4c0f5ef0 2021-11-03T17:29:41.863 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.868+0000 7fed497fa700 1 -- 172.21.15.26:0/925214772 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fed40054560 con 0x7fed4c0f5ef0 2021-11-03T17:29:41.863 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:29:41.863 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:29:41.864 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:29:41.864 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:29:41.864 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:29:41.864 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:29:41.864 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:29:41.865 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:29:41.865 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:29:41.865 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:29:41.865 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:29:41.866 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:29:41.866 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:29:41.866 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:29:41.866 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:29:41.866 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:29:41.867 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:29:41.867 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:29:41.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.870+0000 7fed531e0700 1 -- 172.21.15.26:0/925214772 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fed340640b0 msgr2=0x7fed34066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:29:41.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.870+0000 7fed531e0700 1 --2- 172.21.15.26:0/925214772 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fed340640b0 0x7fed34066570 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7fed4c060160 tx=0x7fed44004d00).stop 2021-11-03T17:29:41.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.870+0000 7fed531e0700 1 -- 172.21.15.26:0/925214772 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed4c0f5ef0 msgr2=0x7fed4c10e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:29:41.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.870+0000 7fed531e0700 1 --2- 172.21.15.26:0/925214772 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed4c0f5ef0 0x7fed4c10e5b0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7fed40009990 tx=0x7fed40009b30).stop 2021-11-03T17:29:41.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.870+0000 7fed531e0700 1 -- 172.21.15.26:0/925214772 shutdown_connections 2021-11-03T17:29:41.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.870+0000 7fed531e0700 1 --2- 172.21.15.26:0/925214772 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fed340640b0 0x7fed34066570 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:41.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.870+0000 7fed531e0700 1 --2- 172.21.15.26:0/925214772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed4c0f55e0 0x7fed4c10c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:41.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.870+0000 7fed531e0700 1 --2- 172.21.15.26:0/925214772 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed4c0f5ef0 0x7fed4c10e5b0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:41.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.870+0000 7fed531e0700 1 -- 172.21.15.26:0/925214772 >> 172.21.15.26:0/925214772 conn(0x7fed4c0f0de0 msgr2=0x7fed4c0fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:29:41.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.870+0000 7fed531e0700 1 -- 172.21.15.26:0/925214772 shutdown_connections 2021-11-03T17:29:41.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.870+0000 7fed531e0700 1 -- 172.21.15.26:0/925214772 wait complete. 2021-11-03T17:29:41.964 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.970+0000 7fa36248b700 1 -- 172.21.15.26:0/2910265667 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa35c0f5340 msgr2=0x7fa35c0f7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:29:41.965 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.970+0000 7fa36248b700 1 --2- 172.21.15.26:0/2910265667 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa35c0f5340 0x7fa35c0f7ac0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7fa350004660 tx=0x7fa350009b30).stop 2021-11-03T17:29:41.965 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.970+0000 7fa36248b700 1 -- 172.21.15.26:0/2910265667 shutdown_connections 2021-11-03T17:29:41.965 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.970+0000 7fa36248b700 1 --2- 172.21.15.26:0/2910265667 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa35c0f5340 0x7fa35c0f7ac0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:41.965 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.970+0000 7fa36248b700 1 --2- 172.21.15.26:0/2910265667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa35c0f49a0 0x7fa35c0f4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:29:41.966 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.970+0000 7fa36248b700 1 -- 172.21.15.26:0/2910265667 >> 172.21.15.26:0/2910265667 conn(0x7fa35c0f04c0 msgr2=0x7fa35c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:29:41.966 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.970+0000 7fa36248b700 1 -- 172.21.15.26:0/2910265667 shutdown_connections 2021-11-03T17:29:41.966 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.970+0000 7fa36248b700 1 -- 172.21.15.26:0/2910265667 wait complete. 2021-11-03T17:29:41.966 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.971+0000 7fa36248b700 1 Processor -- start 2021-11-03T17:29:41.967 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.971+0000 7fa36248b700 1 -- start start 2021-11-03T17:29:41.969 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.971+0000 7fa36248b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa35c0f49a0 0x7fa35c106fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:29:41.969 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.971+0000 7fa36248b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa35c0f5340 0x7fa35c1074c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:29:41.969 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.971+0000 7fa36248b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35c107b00 con 0x7fa35c0f49a0 2021-11-03T17:29:41.970 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.971+0000 7fa36248b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35c1083b0 con 0x7fa35c0f5340 2021-11-03T17:29:41.970 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.971+0000 7fa35bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa35c0f49a0 0x7fa35c106fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:29:41.970 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.971+0000 7fa35bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa35c0f49a0 0x7fa35c106fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54742/0 (socket says 172.21.15.26:54742) 2021-11-03T17:29:41.970 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.971+0000 7fa35bfff700 1 -- 172.21.15.26:0/3024094579 learned_addr learned my addr 172.21.15.26:0/3024094579 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:29:41.970 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.971+0000 7fa35b7fe700 1 --2- 172.21.15.26:0/3024094579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa35c0f5340 0x7fa35c1074c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:29:41.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.971+0000 7fa35bfff700 1 -- 172.21.15.26:0/3024094579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa35c0f5340 msgr2=0x7fa35c1074c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:29:41.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.971+0000 7fa35bfff700 1 --2- 172.21.15.26:0/3024094579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa35c0f5340 0x7fa35c1074c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:41.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.972+0000 7fa35bfff700 1 -- 172.21.15.26:0/3024094579 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa350005040 con 0x7fa35c0f49a0 2021-11-03T17:29:41.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.972+0000 7fa35b7fe700 1 --2- 172.21.15.26:0/3024094579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa35c0f5340 0x7fa35c1074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:29:41.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.972+0000 7fa35bfff700 1 --2- 172.21.15.26:0/3024094579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa35c0f49a0 0x7fa35c106fd0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7fa34c0093f0 tx=0x7fa34c006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:29:41.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.972+0000 7fa358ff9700 1 -- 172.21.15.26:0/3024094579 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa34c009ea0 con 0x7fa35c0f49a0 2021-11-03T17:29:41.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.972+0000 7fa36248b700 1 -- 172.21.15.26:0/3024094579 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa35c108690 con 0x7fa35c0f49a0 2021-11-03T17:29:41.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.972+0000 7fa358ff9700 1 -- 172.21.15.26:0/3024094579 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa34c013af0 con 0x7fa35c0f49a0 2021-11-03T17:29:41.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.972+0000 7fa358ff9700 1 -- 172.21.15.26:0/3024094579 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa34c00db10 con 0x7fa35c0f49a0 2021-11-03T17:29:41.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.972+0000 7fa36248b700 1 -- 172.21.15.26:0/3024094579 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa35c108c50 con 0x7fa35c0f49a0 2021-11-03T17:29:41.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.973+0000 7fa36248b700 1 -- 172.21.15.26:0/3024094579 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa35c0f4150 con 0x7fa35c0f49a0 2021-11-03T17:29:41.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.973+0000 7fa358ff9700 1 -- 172.21.15.26:0/3024094579 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fa34c01a060 con 0x7fa35c0f49a0 2021-11-03T17:29:41.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.974+0000 7fa358ff9700 1 --2- 172.21.15.26:0/3024094579 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa3440640b0 0x7fa344066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:29:41.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.974+0000 7fa358ff9700 1 -- 172.21.15.26:0/3024094579 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fa34c080910 con 0x7fa35c0f49a0 2021-11-03T17:29:41.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.974+0000 7fa35b7fe700 1 --2- 172.21.15.26:0/3024094579 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa3440640b0 0x7fa344066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:29:41.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.974+0000 7fa35b7fe700 1 --2- 172.21.15.26:0/3024094579 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa3440640b0 0x7fa344066570 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7fa350009da0 tx=0x7fa350009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:29:41.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:41.978+0000 7fa358ff9700 1 -- 172.21.15.26:0/3024094579 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fa34c052b80 con 0x7fa35c0f49a0 2021-11-03T17:29:42.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:42.184+0000 7fa36248b700 1 -- 172.21.15.26:0/3024094579 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa35c0ff050 con 0x7fa35c0f49a0 2021-11-03T17:29:42.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:42.184+0000 7fa358ff9700 1 -- 172.21.15.26:0/3024094579 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fa34c018710 con 0x7fa35c0f49a0 2021-11-03T17:29:42.179 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:29:42.179 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:29:42.180 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:29:42.180 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:29:42.180 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:29:42.180 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:29:42.181 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:29:42.181 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:29:42.181 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:29:42.181 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:29:42.181 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:29:42.182 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:29:42.182 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:29:42.182 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:29:42.182 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:29:42.183 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:29:42.183 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:29:42.183 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:29:42.183 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:29:42.183 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:29:42.184 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:29:42.184 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:29:42.184 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:29:42.184 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:29:42.185 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:29:42.185 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:29:42.185 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:29:42.185 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:29:42.186 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:29:42.186 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:29:42.186 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:29:42.186 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:29:42.187 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:29:42.187 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:29:42.187 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:29:42.187 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:29:42.187 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:29:42.188 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:29:42.188 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:29:42.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:42.186+0000 7fa36248b700 1 -- 172.21.15.26:0/3024094579 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa3440640b0 msgr2=0x7fa344066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:29:42.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:42.186+0000 7fa36248b700 1 --2- 172.21.15.26:0/3024094579 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa3440640b0 0x7fa344066570 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7fa350009da0 tx=0x7fa350009b30).stop 2021-11-03T17:29:42.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:42.186+0000 7fa36248b700 1 -- 172.21.15.26:0/3024094579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa35c0f49a0 msgr2=0x7fa35c106fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:29:42.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:42.186+0000 7fa36248b700 1 --2- 172.21.15.26:0/3024094579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa35c0f49a0 0x7fa35c106fd0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7fa34c0093f0 tx=0x7fa34c006ec0).stop 2021-11-03T17:29:42.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:42.186+0000 7fa36248b700 1 -- 172.21.15.26:0/3024094579 shutdown_connections 2021-11-03T17:29:42.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:42.186+0000 7fa36248b700 1 --2- 172.21.15.26:0/3024094579 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa3440640b0 0x7fa344066570 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:42.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:42.186+0000 7fa36248b700 1 --2- 172.21.15.26:0/3024094579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa35c0f49a0 0x7fa35c106fd0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:42.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:42.186+0000 7fa36248b700 1 --2- 172.21.15.26:0/3024094579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa35c0f5340 0x7fa35c1074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:29:42.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:42.186+0000 7fa36248b700 1 -- 172.21.15.26:0/3024094579 >> 172.21.15.26:0/3024094579 conn(0x7fa35c0f04c0 msgr2=0x7fa35c0fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:29:42.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:42.187+0000 7fa36248b700 1 -- 172.21.15.26:0/3024094579 shutdown_connections 2021-11-03T17:29:42.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:29:42.187+0000 7fa36248b700 1 -- 172.21.15.26:0/3024094579 wait complete. 2021-11-03T17:29:42.192 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:29:42.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:42 smithi194 ceph-mon[65619]: pgmap v1051: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:42.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:42 smithi194 ceph-mon[65619]: from='client.35228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:29:42.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:42 smithi194 ceph-mon[65619]: from='client.35232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:29:42.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:42 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/925214772' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:29:42.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:42 smithi026 ceph-mon[96795]: pgmap v1051: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:42.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:42 smithi026 ceph-mon[96795]: from='client.35228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:29:42.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:42 smithi026 ceph-mon[96795]: from='client.35232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:29:42.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:42 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/925214772' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:29:43.470 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:43 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3024094579' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:29:43.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:43 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3024094579' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:29:44.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:44 smithi194 ceph-mon[65619]: pgmap v1052: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:44.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:44 smithi026 ceph-mon[96795]: pgmap v1052: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:46.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:46 smithi194 ceph-mon[65619]: pgmap v1053: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:46.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:46 smithi026 ceph-mon[96795]: pgmap v1053: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:48.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:48 smithi194 ceph-mon[65619]: pgmap v1054: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:48.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:29:48.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:29:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:48 smithi026 ceph-mon[96795]: pgmap v1054: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:29:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:29:50.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:50 smithi194 ceph-mon[65619]: pgmap v1055: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:50.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:50 smithi026 ceph-mon[96795]: pgmap v1055: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:51.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:51 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:29:51.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:51 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:29:51.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:51 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:29:51.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:51 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:29:52.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:52 smithi194 ceph-mon[65619]: pgmap v1056: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:52.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:52 smithi026 ceph-mon[96795]: pgmap v1056: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:54.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:54 smithi194 ceph-mon[65619]: pgmap v1057: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:54.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:54 smithi026 ceph-mon[96795]: pgmap v1057: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:56.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:56 smithi194 ceph-mon[65619]: pgmap v1058: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:56.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:56 smithi026 ceph-mon[96795]: pgmap v1058: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:58.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:29:58 smithi194 ceph-mon[65619]: pgmap v1059: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:29:58.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:29:58 smithi026 ceph-mon[96795]: pgmap v1059: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:00.420 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:00 smithi026 conmon[96772]: 2021-11-03T17:29:59.999+0000 7f27986f6700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 2 daemons have recently crashed 2021-11-03T17:30:00.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:00 smithi026 ceph-mon[96795]: pgmap v1060: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:00.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:00 smithi026 ceph-mon[96795]: overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 2 daemons have recently crashed 2021-11-03T17:30:00.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:00 smithi194 ceph-mon[65619]: pgmap v1060: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:00.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:00 smithi194 ceph-mon[65619]: overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 2 daemons have recently crashed 2021-11-03T17:30:02.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:02 smithi194 ceph-mon[65619]: pgmap v1061: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:02.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:02 smithi026 ceph-mon[96795]: pgmap v1061: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:04.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:04 smithi194 ceph-mon[65619]: pgmap v1062: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:04.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:04 smithi026 ceph-mon[96795]: pgmap v1062: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:06.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:06 smithi194 ceph-mon[65619]: pgmap v1063: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:06.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:06 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:30:06.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:06 smithi194 ceph-mon[65619]: poll took 60075.497 ms: 1 events 2021-11-03T17:30:06.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:06 smithi026 ceph-mon[96795]: pgmap v1063: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:06.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:06 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:30:06.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:06 smithi026 ceph-mon[96795]: poll took 60075.497 ms: 1 events 2021-11-03T17:30:08.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:08 smithi194 ceph-mon[65619]: pgmap v1064: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:08.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:08 smithi026 ceph-mon[96795]: pgmap v1064: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:09.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:09 smithi026 ceph-mon[96795]: poll took 2523.052 ms: 1 events 2021-11-03T17:30:09.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:09 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:30:09.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:09 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:30:09.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:09 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:30:09.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:09 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:30:09.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:09 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:30:09.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:09 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:30:09.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:09 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:30:09.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:09 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:30:09.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:09 smithi194 ceph-mon[65619]: poll took 2523.052 ms: 1 events 2021-11-03T17:30:09.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:09 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:30:09.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:09 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:30:09.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:09 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:30:09.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:09 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:30:09.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:09 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:30:09.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:09 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:30:09.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:09 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:30:09.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:09 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:30:10.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:10 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:30:10.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:10 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:30:10.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:10 smithi026 ceph-mon[96795]: pgmap v1065: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:10.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:10 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:30:10.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:10 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:30:10.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:10 smithi194 ceph-mon[65619]: pgmap v1065: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:12.298 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.301+0000 7fefa5afa700 1 -- 172.21.15.26:0/437346661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefa00f6860 msgr2=0x7fefa00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:30:12.298 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.301+0000 7fefa5afa700 1 --2- 172.21.15.26:0/437346661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefa00f6860 0x7fefa00f6cc0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7fef94004660 tx=0x7fef94009b30).stop 2021-11-03T17:30:12.299 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.301+0000 7fefa5afa700 1 -- 172.21.15.26:0/437346661 shutdown_connections 2021-11-03T17:30:12.299 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.301+0000 7fefa5afa700 1 --2- 172.21.15.26:0/437346661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefa00f6860 0x7fefa00f6cc0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:12.299 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.301+0000 7fefa5afa700 1 --2- 172.21.15.26:0/437346661 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefa00f55c0 0x7fefa00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:12.299 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.301+0000 7fefa5afa700 1 -- 172.21.15.26:0/437346661 >> 172.21.15.26:0/437346661 conn(0x7fefa00f0d40 msgr2=0x7fefa00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:30:12.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.301+0000 7fefa5afa700 1 -- 172.21.15.26:0/437346661 shutdown_connections 2021-11-03T17:30:12.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.301+0000 7fefa5afa700 1 -- 172.21.15.26:0/437346661 wait complete. 2021-11-03T17:30:12.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.302+0000 7fefa5afa700 1 Processor -- start 2021-11-03T17:30:12.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.302+0000 7fefa5afa700 1 -- start start 2021-11-03T17:30:12.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.302+0000 7fefa5afa700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefa00f55c0 0x7fefa00f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:30:12.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.302+0000 7fefa5afa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefa00f6860 0x7fefa00f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:30:12.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.302+0000 7fefa5afa700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa00f8100 con 0x7fefa00f6860 2021-11-03T17:30:12.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.302+0000 7fefa5afa700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa00f8240 con 0x7fefa00f55c0 2021-11-03T17:30:12.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.302+0000 7fef9effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefa00f6860 0x7fefa00f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:30:12.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.302+0000 7fef9effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefa00f6860 0x7fefa00f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54762/0 (socket says 172.21.15.26:54762) 2021-11-03T17:30:12.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.302+0000 7fef9effd700 1 -- 172.21.15.26:0/1970961274 learned_addr learned my addr 172.21.15.26:0/1970961274 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:30:12.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.303+0000 7fef9f7fe700 1 --2- 172.21.15.26:0/1970961274 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefa00f55c0 0x7fefa00f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:30:12.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.303+0000 7fef9effd700 1 -- 172.21.15.26:0/1970961274 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefa00f55c0 msgr2=0x7fefa00f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:30:12.303 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.303+0000 7fef9effd700 1 --2- 172.21.15.26:0/1970961274 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefa00f55c0 0x7fefa00f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:12.303 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.303+0000 7fef9effd700 1 -- 172.21.15.26:0/1970961274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef94005040 con 0x7fefa00f6860 2021-11-03T17:30:12.303 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.303+0000 7fef9effd700 1 --2- 172.21.15.26:0/1970961274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefa00f6860 0x7fefa00f7ba0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7fef94009990 tx=0x7fef94009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:30:12.303 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.303+0000 7fef87fff700 1 -- 172.21.15.26:0/1970961274 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef94018070 con 0x7fefa00f6860 2021-11-03T17:30:12.303 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.303+0000 7fefa5afa700 1 -- 172.21.15.26:0/1970961274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefa00f84c0 con 0x7fefa00f6860 2021-11-03T17:30:12.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.303+0000 7fef87fff700 1 -- 172.21.15.26:0/1970961274 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fef94007ba0 con 0x7fefa00f6860 2021-11-03T17:30:12.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.303+0000 7fef87fff700 1 -- 172.21.15.26:0/1970961274 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef9401c3c0 con 0x7fefa00f6860 2021-11-03T17:30:12.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.303+0000 7fefa5afa700 1 -- 172.21.15.26:0/1970961274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefa00f8a20 con 0x7fefa00f6860 2021-11-03T17:30:12.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.304+0000 7fefa5afa700 1 -- 172.21.15.26:0/1970961274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefa0045ad0 con 0x7fefa00f6860 2021-11-03T17:30:12.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.305+0000 7fef87fff700 1 -- 172.21.15.26:0/1970961274 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fef9401d420 con 0x7fefa00f6860 2021-11-03T17:30:12.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.305+0000 7fef87fff700 1 --2- 172.21.15.26:0/1970961274 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fef880640b0 0x7fef88066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:30:12.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.305+0000 7fef87fff700 1 -- 172.21.15.26:0/1970961274 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fef94082500 con 0x7fefa00f6860 2021-11-03T17:30:12.307 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.305+0000 7fef9f7fe700 1 --2- 172.21.15.26:0/1970961274 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fef880640b0 0x7fef88066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:30:12.307 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.306+0000 7fef9f7fe700 1 --2- 172.21.15.26:0/1970961274 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fef880640b0 0x7fef88066570 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7fefa00f94b0 tx=0x7fef90004d80).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:30:12.307 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.310+0000 7fef87fff700 1 -- 172.21.15.26:0/1970961274 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fef940548c0 con 0x7fefa00f6860 2021-11-03T17:30:12.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.488+0000 7fefa5afa700 1 -- 172.21.15.26:0/1970961274 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fefa00faca0 con 0x7fef880640b0 2021-11-03T17:30:12.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.489+0000 7fef87fff700 1 -- 172.21.15.26:0/1970961274 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fefa00faca0 con 0x7fef880640b0 2021-11-03T17:30:12.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.491+0000 7fefa5afa700 1 -- 172.21.15.26:0/1970961274 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fef880640b0 msgr2=0x7fef88066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:30:12.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.491+0000 7fefa5afa700 1 --2- 172.21.15.26:0/1970961274 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fef880640b0 0x7fef88066570 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7fefa00f94b0 tx=0x7fef90004d80).stop 2021-11-03T17:30:12.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.491+0000 7fefa5afa700 1 -- 172.21.15.26:0/1970961274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefa00f6860 msgr2=0x7fefa00f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:30:12.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.491+0000 7fefa5afa700 1 --2- 172.21.15.26:0/1970961274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefa00f6860 0x7fefa00f7ba0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7fef94009990 tx=0x7fef94009b30).stop 2021-11-03T17:30:12.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.491+0000 7fefa5afa700 1 -- 172.21.15.26:0/1970961274 shutdown_connections 2021-11-03T17:30:12.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.491+0000 7fefa5afa700 1 --2- 172.21.15.26:0/1970961274 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fef880640b0 0x7fef88066570 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:12.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.491+0000 7fefa5afa700 1 --2- 172.21.15.26:0/1970961274 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefa00f55c0 0x7fefa00f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:12.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.491+0000 7fefa5afa700 1 --2- 172.21.15.26:0/1970961274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fefa00f6860 0x7fefa00f7ba0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:12.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.491+0000 7fefa5afa700 1 -- 172.21.15.26:0/1970961274 >> 172.21.15.26:0/1970961274 conn(0x7fefa00f0d40 msgr2=0x7fefa005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:30:12.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.491+0000 7fefa5afa700 1 -- 172.21.15.26:0/1970961274 shutdown_connections 2021-11-03T17:30:12.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.491+0000 7fefa5afa700 1 -- 172.21.15.26:0/1970961274 wait complete. 2021-11-03T17:30:12.496 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:30:12.589 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.592+0000 7f3d352a3700 1 -- 172.21.15.26:0/3138922065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d300f66c0 msgr2=0x7f3d300f6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:30:12.589 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.592+0000 7f3d352a3700 1 --2- 172.21.15.26:0/3138922065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d300f66c0 0x7f3d300f6ae0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f3d20004660 tx=0x7f3d20009b30).stop 2021-11-03T17:30:12.589 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.592+0000 7f3d352a3700 1 -- 172.21.15.26:0/3138922065 shutdown_connections 2021-11-03T17:30:12.589 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.592+0000 7f3d352a3700 1 --2- 172.21.15.26:0/3138922065 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d300f7960 0x7f3d300f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:12.590 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.592+0000 7f3d352a3700 1 --2- 172.21.15.26:0/3138922065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d300f66c0 0x7f3d300f6ae0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:12.590 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.592+0000 7f3d352a3700 1 -- 172.21.15.26:0/3138922065 >> 172.21.15.26:0/3138922065 conn(0x7f3d300f1e20 msgr2=0x7f3d300f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:30:12.590 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.592+0000 7f3d352a3700 1 -- 172.21.15.26:0/3138922065 shutdown_connections 2021-11-03T17:30:12.590 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.592+0000 7f3d352a3700 1 -- 172.21.15.26:0/3138922065 wait complete. 2021-11-03T17:30:12.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.592+0000 7f3d352a3700 1 Processor -- start 2021-11-03T17:30:12.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.593+0000 7f3d352a3700 1 -- start start 2021-11-03T17:30:12.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.593+0000 7f3d352a3700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d300f66c0 0x7f3d30106f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:30:12.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.593+0000 7f3d352a3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d300f7960 0x7f3d30107480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:30:12.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.593+0000 7f3d352a3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d30107a30 con 0x7f3d300f7960 2021-11-03T17:30:12.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.593+0000 7f3d352a3700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d30107b70 con 0x7f3d300f66c0 2021-11-03T17:30:12.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.593+0000 7f3d2e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d300f7960 0x7f3d30107480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:30:12.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.593+0000 7f3d2e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d300f7960 0x7f3d30107480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54772/0 (socket says 172.21.15.26:54772) 2021-11-03T17:30:12.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.593+0000 7f3d2e7fc700 1 -- 172.21.15.26:0/3920334570 learned_addr learned my addr 172.21.15.26:0/3920334570 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:30:12.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.593+0000 7f3d2effd700 1 --2- 172.21.15.26:0/3920334570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d300f66c0 0x7f3d30106f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:30:12.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.593+0000 7f3d2e7fc700 1 -- 172.21.15.26:0/3920334570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d300f66c0 msgr2=0x7f3d30106f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:30:12.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.593+0000 7f3d2e7fc700 1 --2- 172.21.15.26:0/3920334570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d300f66c0 0x7f3d30106f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:12.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.593+0000 7f3d2e7fc700 1 -- 172.21.15.26:0/3920334570 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d20005040 con 0x7f3d300f7960 2021-11-03T17:30:12.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.593+0000 7f3d2effd700 1 --2- 172.21.15.26:0/3920334570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d300f66c0 0x7f3d30106f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:30:12.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.593+0000 7f3d2e7fc700 1 --2- 172.21.15.26:0/3920334570 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d300f7960 0x7f3d30107480 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f3d2400c790 tx=0x7f3d24007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:30:12.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.593+0000 7f3d177fe700 1 -- 172.21.15.26:0/3920334570 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d2400e680 con 0x7f3d300f7960 2021-11-03T17:30:12.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.593+0000 7f3d177fe700 1 -- 172.21.15.26:0/3920334570 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3d2400ec90 con 0x7f3d300f7960 2021-11-03T17:30:12.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.594+0000 7f3d352a3700 1 -- 172.21.15.26:0/3920334570 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d30108510 con 0x7f3d300f7960 2021-11-03T17:30:12.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.594+0000 7f3d177fe700 1 -- 172.21.15.26:0/3920334570 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d24013d60 con 0x7f3d300f7960 2021-11-03T17:30:12.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.594+0000 7f3d352a3700 1 -- 172.21.15.26:0/3920334570 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d30108ad0 con 0x7f3d300f7960 2021-11-03T17:30:12.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.595+0000 7f3d352a3700 1 -- 172.21.15.26:0/3920334570 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d30045ad0 con 0x7f3d300f7960 2021-11-03T17:30:12.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.595+0000 7f3d177fe700 1 -- 172.21.15.26:0/3920334570 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f3d2401a060 con 0x7f3d300f7960 2021-11-03T17:30:12.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.595+0000 7f3d177fe700 1 --2- 172.21.15.26:0/3920334570 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3d180640b0 0x7f3d18066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:30:12.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.596+0000 7f3d177fe700 1 -- 172.21.15.26:0/3920334570 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f3d24080b00 con 0x7f3d300f7960 2021-11-03T17:30:12.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.596+0000 7f3d2effd700 1 --2- 172.21.15.26:0/3920334570 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3d180640b0 0x7f3d18066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:30:12.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.596+0000 7f3d2effd700 1 --2- 172.21.15.26:0/3920334570 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3d180640b0 0x7f3d18066570 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f3d20009da0 tx=0x7f3d20009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:30:12.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.600+0000 7f3d177fe700 1 -- 172.21.15.26:0/3920334570 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f3d24052d70 con 0x7f3d300f7960 2021-11-03T17:30:12.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:12 smithi026 ceph-mon[96795]: pgmap v1066: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:12.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:12 smithi194 ceph-mon[65619]: pgmap v1066: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:12.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.773+0000 7f3d352a3700 1 -- 172.21.15.26:0/3920334570 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3d300feff0 con 0x7f3d180640b0 2021-11-03T17:30:12.783 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.788+0000 7f3d177fe700 1 -- 172.21.15.26:0/3920334570 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f3d300feff0 con 0x7f3d180640b0 2021-11-03T17:30:12.783 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:30:12.784 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (41m) 67s ago 42m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:30:12.784 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (33m) 67s ago 42m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:30:12.784 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (33m) 4s ago 41m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:30:12.784 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (41m) 67s ago 42m 40.3M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:30:12.785 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (34m) 67s ago 37m 22.6M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:30:12.785 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (34m) 67s ago 37m 23.5M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:30:12.785 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (37m) 4s ago 37m 24.8M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:30:12.785 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (37m) 4s ago 37m 25.0M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:30:12.785 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (35m) 67s ago 44m 520M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:30:12.786 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (34m) 4s ago 41m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:30:12.786 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (34m) 67s ago 44m 176M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:30:12.786 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (34m) 4s ago 41m 89.5M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:30:12.786 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (42m) 67s ago 42m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:30:12.787 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (41m) 4s ago 41m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:30:12.787 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (33m) 67s ago 41m 231M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:30:12.787 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (32m) 67s ago 40m 248M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:30:12.787 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (32m) 67s ago 40m 207M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:30:12.787 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (31m) 4s ago 40m 262M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:30:12.788 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (31m) 4s ago 39m 227M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:30:12.788 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (30m) 4s ago 39m 215M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:30:12.788 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (41m) 67s ago 42m 54.4M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:30:12.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.790+0000 7f3d352a3700 1 -- 172.21.15.26:0/3920334570 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3d180640b0 msgr2=0x7f3d18066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:30:12.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.790+0000 7f3d352a3700 1 --2- 172.21.15.26:0/3920334570 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3d180640b0 0x7f3d18066570 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f3d20009da0 tx=0x7f3d20009b30).stop 2021-11-03T17:30:12.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.790+0000 7f3d352a3700 1 -- 172.21.15.26:0/3920334570 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d300f7960 msgr2=0x7f3d30107480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:30:12.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.790+0000 7f3d352a3700 1 --2- 172.21.15.26:0/3920334570 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d300f7960 0x7f3d30107480 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f3d2400c790 tx=0x7f3d24007d70).stop 2021-11-03T17:30:12.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.790+0000 7f3d352a3700 1 -- 172.21.15.26:0/3920334570 shutdown_connections 2021-11-03T17:30:12.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.790+0000 7f3d352a3700 1 --2- 172.21.15.26:0/3920334570 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3d180640b0 0x7f3d18066570 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:12.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.790+0000 7f3d352a3700 1 --2- 172.21.15.26:0/3920334570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d300f66c0 0x7f3d30106f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:12.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.790+0000 7f3d352a3700 1 --2- 172.21.15.26:0/3920334570 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d300f7960 0x7f3d30107480 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:12.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.790+0000 7f3d352a3700 1 -- 172.21.15.26:0/3920334570 >> 172.21.15.26:0/3920334570 conn(0x7f3d300f1e20 msgr2=0x7f3d300fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:30:12.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.790+0000 7f3d352a3700 1 -- 172.21.15.26:0/3920334570 shutdown_connections 2021-11-03T17:30:12.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.790+0000 7f3d352a3700 1 -- 172.21.15.26:0/3920334570 wait complete. 2021-11-03T17:30:12.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.888+0000 7fb74f59e700 1 -- 172.21.15.26:0/1010957678 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7500f77d0 msgr2=0x7fb7500f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:30:12.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.888+0000 7fb74f59e700 1 --2- 172.21.15.26:0/1010957678 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7500f77d0 0x7fb7500f7c30 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7fb744004660 tx=0x7fb744009b30).stop 2021-11-03T17:30:12.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.889+0000 7fb74f59e700 1 -- 172.21.15.26:0/1010957678 shutdown_connections 2021-11-03T17:30:12.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.889+0000 7fb74f59e700 1 --2- 172.21.15.26:0/1010957678 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7500f77d0 0x7fb7500f7c30 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:12.886 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.889+0000 7fb74f59e700 1 --2- 172.21.15.26:0/1010957678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7500f6530 0x7fb7500f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:12.886 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.889+0000 7fb74f59e700 1 -- 172.21.15.26:0/1010957678 >> 172.21.15.26:0/1010957678 conn(0x7fb7500f1cd0 msgr2=0x7fb7500f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:30:12.886 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.889+0000 7fb74f59e700 1 -- 172.21.15.26:0/1010957678 shutdown_connections 2021-11-03T17:30:12.886 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.889+0000 7fb74f59e700 1 -- 172.21.15.26:0/1010957678 wait complete. 2021-11-03T17:30:12.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.889+0000 7fb74f59e700 1 Processor -- start 2021-11-03T17:30:12.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.889+0000 7fb74f59e700 1 -- start start 2021-11-03T17:30:12.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.889+0000 7fb74f59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7500f6530 0x7fb750106d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:30:12.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.889+0000 7fb74f59e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7500f77d0 0x7fb750107210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:30:12.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.889+0000 7fb74f59e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7501077c0 con 0x7fb7500f6530 2021-11-03T17:30:12.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.889+0000 7fb74f59e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb750107fc0 con 0x7fb7500f77d0 2021-11-03T17:30:12.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.889+0000 7fb74e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7500f6530 0x7fb750106d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:30:12.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.889+0000 7fb74e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7500f6530 0x7fb750106d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54780/0 (socket says 172.21.15.26:54780) 2021-11-03T17:30:12.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.889+0000 7fb74e59c700 1 -- 172.21.15.26:0/1072715353 learned_addr learned my addr 172.21.15.26:0/1072715353 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:30:12.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.890+0000 7fb74e59c700 1 -- 172.21.15.26:0/1072715353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7500f77d0 msgr2=0x7fb750107210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:30:12.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.890+0000 7fb74e59c700 1 --2- 172.21.15.26:0/1072715353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7500f77d0 0x7fb750107210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:30:12.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.890+0000 7fb74e59c700 1 -- 172.21.15.26:0/1072715353 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb744005040 con 0x7fb7500f6530 2021-11-03T17:30:12.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.890+0000 7fb74e59c700 1 --2- 172.21.15.26:0/1072715353 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7500f6530 0x7fb750106d20 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7fb740002700 tx=0x7fb740009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:30:12.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.890+0000 7fb73effd700 1 -- 172.21.15.26:0/1072715353 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb740009320 con 0x7fb7500f6530 2021-11-03T17:30:12.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.890+0000 7fb73effd700 1 -- 172.21.15.26:0/1072715353 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb74000f040 con 0x7fb7500f6530 2021-11-03T17:30:12.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.890+0000 7fb74f59e700 1 -- 172.21.15.26:0/1072715353 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7501082a0 con 0x7fb7500f6530 2021-11-03T17:30:12.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.890+0000 7fb73effd700 1 -- 172.21.15.26:0/1072715353 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7400148e0 con 0x7fb7500f6530 2021-11-03T17:30:12.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.890+0000 7fb74f59e700 1 -- 172.21.15.26:0/1072715353 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb750108860 con 0x7fb7500f6530 2021-11-03T17:30:12.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.891+0000 7fb74f59e700 1 -- 172.21.15.26:0/1072715353 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb750059100 con 0x7fb7500f6530 2021-11-03T17:30:12.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.891+0000 7fb73effd700 1 -- 172.21.15.26:0/1072715353 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fb740009480 con 0x7fb7500f6530 2021-11-03T17:30:12.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.892+0000 7fb73effd700 1 --2- 172.21.15.26:0/1072715353 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb738064100 0x7fb7380665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:30:12.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.892+0000 7fb73effd700 1 -- 172.21.15.26:0/1072715353 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fb740080b70 con 0x7fb7500f6530 2021-11-03T17:30:12.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.892+0000 7fb74dd9b700 1 --2- 172.21.15.26:0/1072715353 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb738064100 0x7fb7380665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:30:12.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.892+0000 7fb74dd9b700 1 --2- 172.21.15.26:0/1072715353 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb738064100 0x7fb7380665c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7fb744004e30 tx=0x7fb744009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:30:12.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:12.896+0000 7fb73effd700 1 -- 172.21.15.26:0/1072715353 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fb740052e50 con 0x7fb7500f6530 2021-11-03T17:30:13.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.125+0000 7fb74f59e700 1 -- 172.21.15.26:0/1072715353 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb750045ad0 con 0x7fb7500f6530 2021-11-03T17:30:13.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.125+0000 7fb73effd700 1 -- 172.21.15.26:0/1072715353 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fb740052a40 con 0x7fb7500f6530 2021-11-03T17:30:13.121 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:30:13.121 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:30:13.121 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:30:13.122 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:30:13.122 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:30:13.122 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:30:13.122 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:30:13.122 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:30:13.123 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:30:13.123 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:30:13.123 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:30:13.123 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:30:13.124 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:30:13.124 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:30:13.124 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:30:13.124 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:30:13.124 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:30:13.125 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:30:13.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.127+0000 7fb74f59e700 1 -- 172.21.15.26:0/1072715353 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb738064100 msgr2=0x7fb7380665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:30:13.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.127+0000 7fb74f59e700 1 --2- 172.21.15.26:0/1072715353 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb738064100 0x7fb7380665c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7fb744004e30 tx=0x7fb744009b30).stop 2021-11-03T17:30:13.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.127+0000 7fb74f59e700 1 -- 172.21.15.26:0/1072715353 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7500f6530 msgr2=0x7fb750106d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:30:13.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.127+0000 7fb74f59e700 1 --2- 172.21.15.26:0/1072715353 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7500f6530 0x7fb750106d20 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7fb740002700 tx=0x7fb740009e00).stop 2021-11-03T17:30:13.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.127+0000 7fb74f59e700 1 -- 172.21.15.26:0/1072715353 shutdown_connections 2021-11-03T17:30:13.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.127+0000 7fb74f59e700 1 --2- 172.21.15.26:0/1072715353 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb738064100 0x7fb7380665c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:13.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.127+0000 7fb74f59e700 1 --2- 172.21.15.26:0/1072715353 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7500f6530 0x7fb750106d20 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:13.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.127+0000 7fb74f59e700 1 --2- 172.21.15.26:0/1072715353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7500f77d0 0x7fb750107210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:30:13.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.127+0000 7fb74f59e700 1 -- 172.21.15.26:0/1072715353 >> 172.21.15.26:0/1072715353 conn(0x7fb7500f1cd0 msgr2=0x7fb7500fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:30:13.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.127+0000 7fb74f59e700 1 -- 172.21.15.26:0/1072715353 shutdown_connections 2021-11-03T17:30:13.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.127+0000 7fb74f59e700 1 -- 172.21.15.26:0/1072715353 wait complete. 2021-11-03T17:30:13.224 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.227+0000 7f3578fd2700 1 -- 172.21.15.26:0/4134381911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35740f66e0 msgr2=0x7f35740f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:30:13.224 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.227+0000 7f3578fd2700 1 --2- 172.21.15.26:0/4134381911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35740f66e0 0x7f35740f6b00 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f3564004660 tx=0x7f3564009b30).stop 2021-11-03T17:30:13.224 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.227+0000 7f3578fd2700 1 -- 172.21.15.26:0/4134381911 shutdown_connections 2021-11-03T17:30:13.225 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.227+0000 7f3578fd2700 1 --2- 172.21.15.26:0/4134381911 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35740f6ff0 0x7f35740f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:13.225 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.227+0000 7f3578fd2700 1 --2- 172.21.15.26:0/4134381911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35740f66e0 0x7f35740f6b00 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:13.225 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.227+0000 7f3578fd2700 1 -- 172.21.15.26:0/4134381911 >> 172.21.15.26:0/4134381911 conn(0x7f35740f1f00 msgr2=0x7f35740f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:30:13.225 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.227+0000 7f3578fd2700 1 -- 172.21.15.26:0/4134381911 shutdown_connections 2021-11-03T17:30:13.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.227+0000 7f3578fd2700 1 -- 172.21.15.26:0/4134381911 wait complete. 2021-11-03T17:30:13.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.228+0000 7f3578fd2700 1 Processor -- start 2021-11-03T17:30:13.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.228+0000 7f3578fd2700 1 -- start start 2021-11-03T17:30:13.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.228+0000 7f3578fd2700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35740f66e0 0x7f3574106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:30:13.227 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.228+0000 7f3578fd2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35740f6ff0 0x7f3574107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:30:13.227 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.228+0000 7f3578fd2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3574107a00 con 0x7f35740f6ff0 2021-11-03T17:30:13.227 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.228+0000 7f3578fd2700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3574107b40 con 0x7f35740f66e0 2021-11-03T17:30:13.227 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.228+0000 7f3571d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35740f6ff0 0x7f3574107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:30:13.227 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.228+0000 7f3571d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35740f6ff0 0x7f3574107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54792/0 (socket says 172.21.15.26:54792) 2021-11-03T17:30:13.228 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.228+0000 7f3571d9b700 1 -- 172.21.15.26:0/579552729 learned_addr learned my addr 172.21.15.26:0/579552729 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:30:13.228 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.228+0000 7f357259c700 1 --2- 172.21.15.26:0/579552729 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35740f66e0 0x7f3574106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:30:13.228 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.228+0000 7f3571d9b700 1 -- 172.21.15.26:0/579552729 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35740f66e0 msgr2=0x7f3574106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:30:13.228 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.228+0000 7f3571d9b700 1 --2- 172.21.15.26:0/579552729 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35740f66e0 0x7f3574106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:13.229 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.229+0000 7f3571d9b700 1 -- 172.21.15.26:0/579552729 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3564005040 con 0x7f35740f6ff0 2021-11-03T17:30:13.229 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.229+0000 7f3571d9b700 1 --2- 172.21.15.26:0/579552729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35740f6ff0 0x7f3574107450 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f356800c530 tx=0x7f3568007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:30:13.229 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.229+0000 7f3562ffd700 1 -- 172.21.15.26:0/579552729 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f356800f650 con 0x7f35740f6ff0 2021-11-03T17:30:13.229 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.229+0000 7f3562ffd700 1 -- 172.21.15.26:0/579552729 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f356800fc60 con 0x7f35740f6ff0 2021-11-03T17:30:13.229 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.229+0000 7f3578fd2700 1 -- 172.21.15.26:0/579552729 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35741084e0 con 0x7f35740f6ff0 2021-11-03T17:30:13.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.229+0000 7f3562ffd700 1 -- 172.21.15.26:0/579552729 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3568012cd0 con 0x7f35740f6ff0 2021-11-03T17:30:13.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.229+0000 7f3578fd2700 1 -- 172.21.15.26:0/579552729 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3574108aa0 con 0x7f35740f6ff0 2021-11-03T17:30:13.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.230+0000 7f3578fd2700 1 -- 172.21.15.26:0/579552729 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3574045ad0 con 0x7f35740f6ff0 2021-11-03T17:30:13.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.230+0000 7f3562ffd700 1 -- 172.21.15.26:0/579552729 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f3568010070 con 0x7f35740f6ff0 2021-11-03T17:30:13.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.231+0000 7f3562ffd700 1 --2- 172.21.15.26:0/579552729 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f355c0640b0 0x7f355c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:30:13.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.231+0000 7f3562ffd700 1 -- 172.21.15.26:0/579552729 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f3568080700 con 0x7f35740f6ff0 2021-11-03T17:30:13.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.231+0000 7f357259c700 1 --2- 172.21.15.26:0/579552729 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f355c0640b0 0x7f355c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:30:13.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.231+0000 7f357259c700 1 --2- 172.21.15.26:0/579552729 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f355c0640b0 0x7f355c066570 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f3564004e30 tx=0x7f3564009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:30:13.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.235+0000 7f3562ffd700 1 -- 172.21.15.26:0/579552729 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f35680528b0 con 0x7f35740f6ff0 2021-11-03T17:30:13.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.441+0000 7f3578fd2700 1 -- 172.21.15.26:0/579552729 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3574027a00 con 0x7f35740f6ff0 2021-11-03T17:30:13.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.442+0000 7f3562ffd700 1 -- 172.21.15.26:0/579552729 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f35680524a0 con 0x7f35740f6ff0 2021-11-03T17:30:13.437 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:30:13.437 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:30:13.437 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:30:13.438 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:30:13.438 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:30:13.438 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:30:13.438 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:30:13.439 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:30:13.439 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:30:13.439 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:30:13.439 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:30:13.440 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:30:13.440 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:30:13.440 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:30:13.440 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:30:13.441 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:30:13.441 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:30:13.441 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:30:13.441 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:30:13.441 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:30:13.442 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:30:13.442 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:30:13.442 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:30:13.442 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:30:13.443 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:30:13.443 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:30:13.443 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:30:13.443 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:30:13.443 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:30:13.444 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:30:13.444 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:30:13.444 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:30:13.444 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:30:13.445 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:30:13.445 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:30:13.445 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:30:13.445 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:30:13.445 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:30:13.446 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:30:13.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.444+0000 7f3578fd2700 1 -- 172.21.15.26:0/579552729 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f355c0640b0 msgr2=0x7f355c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:30:13.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.444+0000 7f3578fd2700 1 --2- 172.21.15.26:0/579552729 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f355c0640b0 0x7f355c066570 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f3564004e30 tx=0x7f3564009b30).stop 2021-11-03T17:30:13.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.444+0000 7f3578fd2700 1 -- 172.21.15.26:0/579552729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35740f6ff0 msgr2=0x7f3574107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:30:13.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.444+0000 7f3578fd2700 1 --2- 172.21.15.26:0/579552729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35740f6ff0 0x7f3574107450 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f356800c530 tx=0x7f3568007e20).stop 2021-11-03T17:30:13.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.444+0000 7f3578fd2700 1 -- 172.21.15.26:0/579552729 shutdown_connections 2021-11-03T17:30:13.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.444+0000 7f3578fd2700 1 --2- 172.21.15.26:0/579552729 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f355c0640b0 0x7f355c066570 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:13.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.444+0000 7f3578fd2700 1 --2- 172.21.15.26:0/579552729 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35740f66e0 0x7f3574106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:13.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.444+0000 7f3578fd2700 1 --2- 172.21.15.26:0/579552729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35740f6ff0 0x7f3574107450 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:13.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.444+0000 7f3578fd2700 1 -- 172.21.15.26:0/579552729 >> 172.21.15.26:0/579552729 conn(0x7f35740f1f00 msgr2=0x7f35740fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:30:13.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.444+0000 7f3578fd2700 1 -- 172.21.15.26:0/579552729 shutdown_connections 2021-11-03T17:30:13.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:13.444+0000 7f3578fd2700 1 -- 172.21.15.26:0/579552729 wait complete. 2021-11-03T17:30:13.449 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:30:13.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:13 smithi026 ceph-mon[96795]: from='client.35244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:30:13.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:13 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1072715353' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:30:13.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:13 smithi194 ceph-mon[65619]: from='client.35244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:30:13.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:13 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1072715353' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:30:14.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:14 smithi026 ceph-mon[96795]: from='client.35248 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:30:14.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:14 smithi026 ceph-mon[96795]: pgmap v1067: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:14.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:14 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/579552729' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:30:14.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:14 smithi194 ceph-mon[65619]: from='client.35248 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:30:14.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:14 smithi194 ceph-mon[65619]: pgmap v1067: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:14.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:14 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/579552729' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:30:16.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:16 smithi026 ceph-mon[96795]: pgmap v1068: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:16.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:16 smithi194 ceph-mon[65619]: pgmap v1068: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:18.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:18 smithi194 ceph-mon[65619]: pgmap v1069: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:18.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:18 smithi026 ceph-mon[96795]: pgmap v1069: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:20.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:20 smithi194 ceph-mon[65619]: pgmap v1070: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:20.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:20 smithi026 ceph-mon[96795]: pgmap v1070: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:22.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:22 smithi194 ceph-mon[65619]: pgmap v1071: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:22.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:22 smithi026 ceph-mon[96795]: pgmap v1071: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:24.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:24 smithi194 ceph-mon[65619]: pgmap v1072: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:24.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:30:24.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:24 smithi026 ceph-mon[96795]: pgmap v1072: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:24.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:30:25.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:25 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:30:25.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:25 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:30:26.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:26 smithi194 ceph-mon[65619]: pgmap v1073: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:26.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:26 smithi026 ceph-mon[96795]: pgmap v1073: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:28.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:28 smithi194 ceph-mon[65619]: pgmap v1074: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:28.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:28 smithi026 ceph-mon[96795]: pgmap v1074: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:30.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:30 smithi194 ceph-mon[65619]: pgmap v1075: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:30.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:30 smithi026 ceph-mon[96795]: pgmap v1075: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:32.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:32 smithi194 ceph-mon[65619]: pgmap v1076: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:32.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:32 smithi026 ceph-mon[96795]: pgmap v1076: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:34.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:34 smithi194 ceph-mon[65619]: pgmap v1077: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:34.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:34 smithi026 ceph-mon[96795]: pgmap v1077: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:36.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:36 smithi194 ceph-mon[65619]: pgmap v1078: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:36.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:36 smithi026 ceph-mon[96795]: pgmap v1078: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:38.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:38 smithi194 ceph-mon[65619]: pgmap v1079: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:38.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:38 smithi026 ceph-mon[96795]: pgmap v1079: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:39.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:30:39.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:30:40.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:40 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:30:40.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:40 smithi194 ceph-mon[65619]: pgmap v1080: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:40.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:40 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:30:40.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:40 smithi026 ceph-mon[96795]: pgmap v1080: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:42.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:42 smithi194 ceph-mon[65619]: pgmap v1081: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:42.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:42 smithi026 ceph-mon[96795]: pgmap v1081: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:43.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.560+0000 7fb948fd1700 1 -- 172.21.15.26:0/3089219521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9440f6ff0 msgr2=0x7fb9440f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:30:43.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.560+0000 7fb948fd1700 1 --2- 172.21.15.26:0/3089219521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9440f6ff0 0x7fb9440f7a20 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7fb92c004660 tx=0x7fb92c009b30).stop 2021-11-03T17:30:43.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.560+0000 7fb948fd1700 1 -- 172.21.15.26:0/3089219521 shutdown_connections 2021-11-03T17:30:43.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.560+0000 7fb948fd1700 1 --2- 172.21.15.26:0/3089219521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9440f6ff0 0x7fb9440f7a20 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:43.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.560+0000 7fb948fd1700 1 --2- 172.21.15.26:0/3089219521 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9440f66e0 0x7fb9440f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:43.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.560+0000 7fb948fd1700 1 -- 172.21.15.26:0/3089219521 >> 172.21.15.26:0/3089219521 conn(0x7fb9440f1f00 msgr2=0x7fb9440f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:30:43.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.560+0000 7fb948fd1700 1 -- 172.21.15.26:0/3089219521 shutdown_connections 2021-11-03T17:30:43.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.560+0000 7fb948fd1700 1 -- 172.21.15.26:0/3089219521 wait complete. 2021-11-03T17:30:43.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.561+0000 7fb948fd1700 1 Processor -- start 2021-11-03T17:30:43.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.561+0000 7fb948fd1700 1 -- start start 2021-11-03T17:30:43.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.561+0000 7fb948fd1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9440f66e0 0x7fb944106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:30:43.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.561+0000 7fb948fd1700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9440f6ff0 0x7fb944107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:30:43.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.561+0000 7fb948fd1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb944107a10 con 0x7fb9440f66e0 2021-11-03T17:30:43.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.561+0000 7fb948fd1700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb944107b50 con 0x7fb9440f6ff0 2021-11-03T17:30:43.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.561+0000 7fb94259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9440f66e0 0x7fb944106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:30:43.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.561+0000 7fb94259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9440f66e0 0x7fb944106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54808/0 (socket says 172.21.15.26:54808) 2021-11-03T17:30:43.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.561+0000 7fb94259c700 1 -- 172.21.15.26:0/2019360477 learned_addr learned my addr 172.21.15.26:0/2019360477 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:30:43.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.561+0000 7fb941d9b700 1 --2- 172.21.15.26:0/2019360477 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9440f6ff0 0x7fb944107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:30:43.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.562+0000 7fb94259c700 1 -- 172.21.15.26:0/2019360477 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9440f6ff0 msgr2=0x7fb944107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:30:43.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.562+0000 7fb94259c700 1 --2- 172.21.15.26:0/2019360477 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9440f6ff0 0x7fb944107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:43.562 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.562+0000 7fb94259c700 1 -- 172.21.15.26:0/2019360477 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb92c005040 con 0x7fb9440f66e0 2021-11-03T17:30:43.562 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.562+0000 7fb94259c700 1 --2- 172.21.15.26:0/2019360477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9440f66e0 0x7fb944106f70 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7fb93c0026d0 tx=0x7fb93c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:30:43.562 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.562+0000 7fb93affd700 1 -- 172.21.15.26:0/2019360477 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb93c0079c0 con 0x7fb9440f66e0 2021-11-03T17:30:43.562 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.562+0000 7fb93affd700 1 -- 172.21.15.26:0/2019360477 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb93c00f040 con 0x7fb9440f66e0 2021-11-03T17:30:43.562 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.562+0000 7fb948fd1700 1 -- 172.21.15.26:0/2019360477 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9441084f0 con 0x7fb9440f66e0 2021-11-03T17:30:43.563 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.562+0000 7fb93affd700 1 -- 172.21.15.26:0/2019360477 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb93c0148b0 con 0x7fb9440f66e0 2021-11-03T17:30:43.563 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.562+0000 7fb948fd1700 1 -- 172.21.15.26:0/2019360477 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb944108ab0 con 0x7fb9440f66e0 2021-11-03T17:30:43.563 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.563+0000 7fb948fd1700 1 -- 172.21.15.26:0/2019360477 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb944045ad0 con 0x7fb9440f66e0 2021-11-03T17:30:43.564 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.563+0000 7fb93affd700 1 -- 172.21.15.26:0/2019360477 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fb93c007b20 con 0x7fb9440f66e0 2021-11-03T17:30:43.565 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.564+0000 7fb93affd700 1 --2- 172.21.15.26:0/2019360477 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb9300640b0 0x7fb930066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:30:43.565 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.564+0000 7fb93affd700 1 -- 172.21.15.26:0/2019360477 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fb93c080660 con 0x7fb9440f66e0 2021-11-03T17:30:43.565 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.564+0000 7fb941d9b700 1 --2- 172.21.15.26:0/2019360477 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb9300640b0 0x7fb930066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:30:43.565 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.564+0000 7fb941d9b700 1 --2- 172.21.15.26:0/2019360477 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb9300640b0 0x7fb930066570 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7fb92c004630 tx=0x7fb92c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:30:43.566 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.568+0000 7fb93affd700 1 -- 172.21.15.26:0/2019360477 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fb93c0529c0 con 0x7fb9440f66e0 2021-11-03T17:30:43.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.747+0000 7fb948fd1700 1 -- 172.21.15.26:0/2019360477 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9440ff050 con 0x7fb9300640b0 2021-11-03T17:30:43.743 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.749+0000 7fb93affd700 1 -- 172.21.15.26:0/2019360477 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fb9440ff050 con 0x7fb9300640b0 2021-11-03T17:30:43.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.751+0000 7fb948fd1700 1 -- 172.21.15.26:0/2019360477 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb9300640b0 msgr2=0x7fb930066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:30:43.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.751+0000 7fb948fd1700 1 --2- 172.21.15.26:0/2019360477 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb9300640b0 0x7fb930066570 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7fb92c004630 tx=0x7fb92c009b30).stop 2021-11-03T17:30:43.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.751+0000 7fb948fd1700 1 -- 172.21.15.26:0/2019360477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9440f66e0 msgr2=0x7fb944106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:30:43.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.751+0000 7fb948fd1700 1 --2- 172.21.15.26:0/2019360477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9440f66e0 0x7fb944106f70 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7fb93c0026d0 tx=0x7fb93c009de0).stop 2021-11-03T17:30:43.747 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.751+0000 7fb948fd1700 1 -- 172.21.15.26:0/2019360477 shutdown_connections 2021-11-03T17:30:43.747 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.751+0000 7fb948fd1700 1 --2- 172.21.15.26:0/2019360477 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb9300640b0 0x7fb930066570 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:43.748 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.751+0000 7fb948fd1700 1 --2- 172.21.15.26:0/2019360477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9440f66e0 0x7fb944106f70 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:43.748 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.751+0000 7fb948fd1700 1 --2- 172.21.15.26:0/2019360477 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9440f6ff0 0x7fb944107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:43.748 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.751+0000 7fb948fd1700 1 -- 172.21.15.26:0/2019360477 >> 172.21.15.26:0/2019360477 conn(0x7fb9440f1f00 msgr2=0x7fb9440fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:30:43.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.751+0000 7fb948fd1700 1 -- 172.21.15.26:0/2019360477 shutdown_connections 2021-11-03T17:30:43.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.751+0000 7fb948fd1700 1 -- 172.21.15.26:0/2019360477 wait complete. 2021-11-03T17:30:43.754 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:30:43.846 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.851+0000 7f21dae73700 1 -- 172.21.15.26:0/613918687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21d40f6860 msgr2=0x7f21d40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:30:43.847 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.851+0000 7f21dae73700 1 --2- 172.21.15.26:0/613918687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21d40f6860 0x7f21d40f6cc0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f21c40099e0 tx=0x7f21c4004d10).stop 2021-11-03T17:30:43.847 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.851+0000 7f21dae73700 1 -- 172.21.15.26:0/613918687 shutdown_connections 2021-11-03T17:30:43.847 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.851+0000 7f21dae73700 1 --2- 172.21.15.26:0/613918687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21d40f6860 0x7f21d40f6cc0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:43.847 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.851+0000 7f21dae73700 1 --2- 172.21.15.26:0/613918687 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21d40f55c0 0x7f21d40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:43.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.851+0000 7f21dae73700 1 -- 172.21.15.26:0/613918687 >> 172.21.15.26:0/613918687 conn(0x7f21d40f0d20 msgr2=0x7f21d40f3140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:30:43.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.851+0000 7f21dae73700 1 -- 172.21.15.26:0/613918687 shutdown_connections 2021-11-03T17:30:43.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.851+0000 7f21dae73700 1 -- 172.21.15.26:0/613918687 wait complete. 2021-11-03T17:30:43.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.851+0000 7f21dae73700 1 Processor -- start 2021-11-03T17:30:43.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.851+0000 7f21dae73700 1 -- start start 2021-11-03T17:30:43.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.852+0000 7f21dae73700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21d40f55c0 0x7f21d4107040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:30:43.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.852+0000 7f21dae73700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21d40f6860 0x7f21d4107530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:30:43.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.852+0000 7f21dae73700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d4107ae0 con 0x7f21d40f6860 2021-11-03T17:30:43.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.852+0000 7f21dae73700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d4107c20 con 0x7f21d40f55c0 2021-11-03T17:30:43.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.852+0000 7f21d3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21d40f6860 0x7f21d4107530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:30:43.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.852+0000 7f21d3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21d40f6860 0x7f21d4107530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54822/0 (socket says 172.21.15.26:54822) 2021-11-03T17:30:43.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.852+0000 7f21d3fff700 1 -- 172.21.15.26:0/1152299865 learned_addr learned my addr 172.21.15.26:0/1152299865 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:30:43.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.852+0000 7f21d8c0f700 1 --2- 172.21.15.26:0/1152299865 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21d40f55c0 0x7f21d4107040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:30:43.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.852+0000 7f21d3fff700 1 -- 172.21.15.26:0/1152299865 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21d40f55c0 msgr2=0x7f21d4107040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:30:43.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.852+0000 7f21d3fff700 1 --2- 172.21.15.26:0/1152299865 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21d40f55c0 0x7f21d4107040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:43.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.852+0000 7f21d3fff700 1 -- 172.21.15.26:0/1152299865 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c4009640 con 0x7f21d40f6860 2021-11-03T17:30:43.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.852+0000 7f21d8c0f700 1 --2- 172.21.15.26:0/1152299865 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21d40f55c0 0x7f21d4107040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:30:43.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.852+0000 7f21d3fff700 1 --2- 172.21.15.26:0/1152299865 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21d40f6860 0x7f21d4107530 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f21c400c010 tx=0x7f21c4004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:30:43.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.852+0000 7f21d17fa700 1 -- 172.21.15.26:0/1152299865 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21c400e070 con 0x7f21d40f6860 2021-11-03T17:30:43.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.852+0000 7f21d17fa700 1 -- 172.21.15.26:0/1152299865 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f21c4007dc0 con 0x7f21d40f6860 2021-11-03T17:30:43.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.852+0000 7f21dae73700 1 -- 172.21.15.26:0/1152299865 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d4108560 con 0x7f21d40f6860 2021-11-03T17:30:43.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.852+0000 7f21d17fa700 1 -- 172.21.15.26:0/1152299865 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21c4018070 con 0x7f21d40f6860 2021-11-03T17:30:43.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.853+0000 7f21dae73700 1 -- 172.21.15.26:0/1152299865 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d4108a40 con 0x7f21d40f6860 2021-11-03T17:30:43.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.854+0000 7f21d17fa700 1 -- 172.21.15.26:0/1152299865 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f21c4013420 con 0x7f21d40f6860 2021-11-03T17:30:43.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.854+0000 7f21dae73700 1 -- 172.21.15.26:0/1152299865 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d4045ad0 con 0x7f21d40f6860 2021-11-03T17:30:43.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.854+0000 7f21d17fa700 1 --2- 172.21.15.26:0/1152299865 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f21c0064090 0x7f21c0066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:30:43.858 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.854+0000 7f21d17fa700 1 -- 172.21.15.26:0/1152299865 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f21c4081d30 con 0x7f21d40f6860 2021-11-03T17:30:43.858 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.854+0000 7f21d8c0f700 1 --2- 172.21.15.26:0/1152299865 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f21c0064090 0x7f21c0066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:30:43.859 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.855+0000 7f21d8c0f700 1 --2- 172.21.15.26:0/1152299865 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f21c0064090 0x7f21c0066550 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f21cc009880 tx=0x7f21cc00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:30:43.859 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:43.858+0000 7f21d17fa700 1 -- 172.21.15.26:0/1152299865 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f21c4054090 con 0x7f21d40f6860 2021-11-03T17:30:44.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.032+0000 7f21dae73700 1 -- 172.21.15.26:0/1152299865 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f21d405fe90 con 0x7f21c0064090 2021-11-03T17:30:44.041 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.047+0000 7f21d17fa700 1 -- 172.21.15.26:0/1152299865 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f21d405fe90 con 0x7f21c0064090 2021-11-03T17:30:44.041 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:30:44.041 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (41m) 98s ago 43m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:30:44.042 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (34m) 98s ago 43m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:30:44.042 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (34m) 35s ago 42m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:30:44.042 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (41m) 98s ago 42m 40.3M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:30:44.042 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (34m) 98s ago 38m 22.6M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:30:44.043 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (35m) 98s ago 38m 23.5M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:30:44.043 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (38m) 35s ago 38m 24.8M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:30:44.043 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (38m) 35s ago 38m 25.0M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:30:44.043 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (35m) 98s ago 44m 520M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:30:44.043 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (35m) 35s ago 42m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:30:44.044 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (35m) 98s ago 44m 176M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:30:44.044 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (34m) 35s ago 42m 89.5M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:30:44.044 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (42m) 98s ago 42m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:30:44.044 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (42m) 35s ago 42m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:30:44.045 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (33m) 98s ago 41m 231M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:30:44.045 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (33m) 98s ago 41m 248M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:30:44.045 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (32m) 98s ago 40m 207M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:30:44.045 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (32m) 35s ago 40m 262M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:30:44.046 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (31m) 35s ago 40m 227M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:30:44.046 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (31m) 35s ago 39m 215M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:30:44.046 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (41m) 98s ago 42m 54.4M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:30:44.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.049+0000 7f21dae73700 1 -- 172.21.15.26:0/1152299865 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f21c0064090 msgr2=0x7f21c0066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:30:44.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.049+0000 7f21dae73700 1 --2- 172.21.15.26:0/1152299865 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f21c0064090 0x7f21c0066550 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f21cc009880 tx=0x7f21cc00b040).stop 2021-11-03T17:30:44.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.049+0000 7f21dae73700 1 -- 172.21.15.26:0/1152299865 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21d40f6860 msgr2=0x7f21d4107530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:30:44.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.049+0000 7f21dae73700 1 --2- 172.21.15.26:0/1152299865 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21d40f6860 0x7f21d4107530 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f21c400c010 tx=0x7f21c4004d10).stop 2021-11-03T17:30:44.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.049+0000 7f21dae73700 1 -- 172.21.15.26:0/1152299865 shutdown_connections 2021-11-03T17:30:44.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.049+0000 7f21dae73700 1 --2- 172.21.15.26:0/1152299865 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f21c0064090 0x7f21c0066550 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:44.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.049+0000 7f21dae73700 1 --2- 172.21.15.26:0/1152299865 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21d40f55c0 0x7f21d4107040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:44.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.049+0000 7f21dae73700 1 --2- 172.21.15.26:0/1152299865 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21d40f6860 0x7f21d4107530 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:44.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.049+0000 7f21dae73700 1 -- 172.21.15.26:0/1152299865 >> 172.21.15.26:0/1152299865 conn(0x7f21d40f0d20 msgr2=0x7f21d405f780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:30:44.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.049+0000 7f21dae73700 1 -- 172.21.15.26:0/1152299865 shutdown_connections 2021-11-03T17:30:44.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.049+0000 7f21dae73700 1 -- 172.21.15.26:0/1152299865 wait complete. 2021-11-03T17:30:44.145 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.149+0000 7f8be4c62700 1 -- 172.21.15.26:0/2402813076 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8be00f6530 msgr2=0x7f8be00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:30:44.145 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.149+0000 7f8be4c62700 1 --2- 172.21.15.26:0/2402813076 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8be00f6530 0x7f8be00f6950 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f8bd00099e0 tx=0x7f8bd0004d10).stop 2021-11-03T17:30:44.145 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.149+0000 7f8be4c62700 1 -- 172.21.15.26:0/2402813076 shutdown_connections 2021-11-03T17:30:44.146 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.149+0000 7f8be4c62700 1 --2- 172.21.15.26:0/2402813076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8be00f77d0 0x7f8be00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:44.146 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.149+0000 7f8be4c62700 1 --2- 172.21.15.26:0/2402813076 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8be00f6530 0x7f8be00f6950 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:44.146 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.149+0000 7f8be4c62700 1 -- 172.21.15.26:0/2402813076 >> 172.21.15.26:0/2402813076 conn(0x7f8be00f1c90 msgr2=0x7f8be00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:30:44.147 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.149+0000 7f8be4c62700 1 -- 172.21.15.26:0/2402813076 shutdown_connections 2021-11-03T17:30:44.147 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.149+0000 7f8be4c62700 1 -- 172.21.15.26:0/2402813076 wait complete. 2021-11-03T17:30:44.147 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.150+0000 7f8be4c62700 1 Processor -- start 2021-11-03T17:30:44.147 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.150+0000 7f8be4c62700 1 -- start start 2021-11-03T17:30:44.148 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.150+0000 7f8be4c62700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8be00f6530 0x7f8be0106e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:30:44.148 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.150+0000 7f8be4c62700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8be00f77d0 0x7f8be0107380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:30:44.148 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.150+0000 7f8be4c62700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be0107930 con 0x7f8be00f77d0 2021-11-03T17:30:44.148 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.150+0000 7f8be4c62700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be0107a70 con 0x7f8be00f6530 2021-11-03T17:30:44.149 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.150+0000 7f8bdeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8be00f77d0 0x7f8be0107380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:30:44.149 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.150+0000 7f8bdeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8be00f77d0 0x7f8be0107380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54830/0 (socket says 172.21.15.26:54830) 2021-11-03T17:30:44.149 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.150+0000 7f8bdeffd700 1 -- 172.21.15.26:0/1975802847 learned_addr learned my addr 172.21.15.26:0/1975802847 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:30:44.149 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.150+0000 7f8bdf7fe700 1 --2- 172.21.15.26:0/1975802847 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8be00f6530 0x7f8be0106e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:30:44.149 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.150+0000 7f8bdeffd700 1 -- 172.21.15.26:0/1975802847 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8be00f6530 msgr2=0x7f8be0106e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:30:44.150 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.150+0000 7f8bdeffd700 1 --2- 172.21.15.26:0/1975802847 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8be00f6530 0x7f8be0106e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:44.150 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.150+0000 7f8bdeffd700 1 -- 172.21.15.26:0/1975802847 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd0009640 con 0x7f8be00f77d0 2021-11-03T17:30:44.150 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.151+0000 7f8bdeffd700 1 --2- 172.21.15.26:0/1975802847 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8be00f77d0 0x7f8be0107380 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f8bc80026d0 tx=0x7f8bc8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:30:44.150 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.151+0000 7f8bd7fff700 1 -- 172.21.15.26:0/1975802847 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bc80079c0 con 0x7f8be00f77d0 2021-11-03T17:30:44.151 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.151+0000 7f8bd7fff700 1 -- 172.21.15.26:0/1975802847 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8bc800f040 con 0x7f8be00f77d0 2021-11-03T17:30:44.151 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.151+0000 7f8be4c62700 1 -- 172.21.15.26:0/1975802847 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8be0108410 con 0x7f8be00f77d0 2021-11-03T17:30:44.151 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.151+0000 7f8bd7fff700 1 -- 172.21.15.26:0/1975802847 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bc80148b0 con 0x7f8be00f77d0 2021-11-03T17:30:44.151 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.151+0000 7f8be4c62700 1 -- 172.21.15.26:0/1975802847 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8be0108950 con 0x7f8be00f77d0 2021-11-03T17:30:44.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.152+0000 7f8be4c62700 1 -- 172.21.15.26:0/1975802847 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8be0045ad0 con 0x7f8be00f77d0 2021-11-03T17:30:44.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.152+0000 7f8bd7fff700 1 -- 172.21.15.26:0/1975802847 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f8bc8007b20 con 0x7f8be00f77d0 2021-11-03T17:30:44.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.152+0000 7f8bd7fff700 1 --2- 172.21.15.26:0/1975802847 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8bcc064100 0x7f8bcc0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:30:44.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.153+0000 7f8bd7fff700 1 -- 172.21.15.26:0/1975802847 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f8bc80807f0 con 0x7f8be00f77d0 2021-11-03T17:30:44.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.153+0000 7f8bdf7fe700 1 --2- 172.21.15.26:0/1975802847 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8bcc064100 0x7f8bcc0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:30:44.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.153+0000 7f8bdf7fe700 1 --2- 172.21.15.26:0/1975802847 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8bcc064100 0x7f8bcc0665c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f8bd000b3b0 tx=0x7f8bd0004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:30:44.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.157+0000 7f8bd7fff700 1 -- 172.21.15.26:0/1975802847 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f8bc8052a90 con 0x7f8be00f77d0 2021-11-03T17:30:44.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.386+0000 7f8be4c62700 1 -- 172.21.15.26:0/1975802847 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8be0027a00 con 0x7f8be00f77d0 2021-11-03T17:30:44.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.386+0000 7f8bd7fff700 1 -- 172.21.15.26:0/1975802847 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f8bc8052680 con 0x7f8be00f77d0 2021-11-03T17:30:44.380 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:30:44.381 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:30:44.381 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:30:44.381 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:30:44.381 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:30:44.382 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:30:44.382 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:30:44.382 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:30:44.382 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:30:44.383 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:30:44.383 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:30:44.383 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:30:44.383 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:30:44.384 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:30:44.384 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:30:44.384 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:30:44.384 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:30:44.384 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:30:44.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.388+0000 7f8be4c62700 1 -- 172.21.15.26:0/1975802847 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8bcc064100 msgr2=0x7f8bcc0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:30:44.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.388+0000 7f8be4c62700 1 --2- 172.21.15.26:0/1975802847 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8bcc064100 0x7f8bcc0665c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f8bd000b3b0 tx=0x7f8bd0004d10).stop 2021-11-03T17:30:44.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.388+0000 7f8be4c62700 1 -- 172.21.15.26:0/1975802847 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8be00f77d0 msgr2=0x7f8be0107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:30:44.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.388+0000 7f8be4c62700 1 --2- 172.21.15.26:0/1975802847 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8be00f77d0 0x7f8be0107380 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f8bc80026d0 tx=0x7f8bc8009de0).stop 2021-11-03T17:30:44.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.388+0000 7f8be4c62700 1 -- 172.21.15.26:0/1975802847 shutdown_connections 2021-11-03T17:30:44.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.388+0000 7f8be4c62700 1 --2- 172.21.15.26:0/1975802847 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8bcc064100 0x7f8bcc0665c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:44.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.388+0000 7f8be4c62700 1 --2- 172.21.15.26:0/1975802847 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8be00f6530 0x7f8be0106e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:44.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.388+0000 7f8be4c62700 1 --2- 172.21.15.26:0/1975802847 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8be00f77d0 0x7f8be0107380 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:44.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.388+0000 7f8be4c62700 1 -- 172.21.15.26:0/1975802847 >> 172.21.15.26:0/1975802847 conn(0x7f8be00f1c90 msgr2=0x7f8be00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:30:44.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.388+0000 7f8be4c62700 1 -- 172.21.15.26:0/1975802847 shutdown_connections 2021-11-03T17:30:44.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.388+0000 7f8be4c62700 1 -- 172.21.15.26:0/1975802847 wait complete. 2021-11-03T17:30:44.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.488+0000 7f9bd9d42700 1 -- 172.21.15.26:0/854983263 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd40f6ff0 msgr2=0x7f9bd40f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:30:44.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.488+0000 7f9bd9d42700 1 --2- 172.21.15.26:0/854983263 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd40f6ff0 0x7f9bd40f7a20 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f9bc8004660 tx=0x7f9bc8009b30).stop 2021-11-03T17:30:44.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.488+0000 7f9bd9d42700 1 -- 172.21.15.26:0/854983263 shutdown_connections 2021-11-03T17:30:44.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.488+0000 7f9bd9d42700 1 --2- 172.21.15.26:0/854983263 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd40f6ff0 0x7f9bd40f7a20 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:44.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.488+0000 7f9bd9d42700 1 --2- 172.21.15.26:0/854983263 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9bd40f66e0 0x7f9bd40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:30:44.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.488+0000 7f9bd9d42700 1 -- 172.21.15.26:0/854983263 >> 172.21.15.26:0/854983263 conn(0x7f9bd40f1f00 msgr2=0x7f9bd40f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:30:44.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.488+0000 7f9bd9d42700 1 -- 172.21.15.26:0/854983263 shutdown_connections 2021-11-03T17:30:44.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.489+0000 7f9bd9d42700 1 -- 172.21.15.26:0/854983263 wait complete. 2021-11-03T17:30:44.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.489+0000 7f9bd9d42700 1 Processor -- start 2021-11-03T17:30:44.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.489+0000 7f9bd9d42700 1 -- start start 2021-11-03T17:30:44.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.489+0000 7f9bd9d42700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd40f66e0 0x7f9bd4106fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:30:44.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.489+0000 7f9bd9d42700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9bd40f6ff0 0x7f9bd4107490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:30:44.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.489+0000 7f9bd9d42700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd4107ad0 con 0x7f9bd40f66e0 2021-11-03T17:30:44.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.489+0000 7f9bd9d42700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd4108380 con 0x7f9bd40f6ff0 2021-11-03T17:30:44.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.489+0000 7f9bd37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd40f66e0 0x7f9bd4106fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:30:44.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.490+0000 7f9bd37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd40f66e0 0x7f9bd4106fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54838/0 (socket says 172.21.15.26:54838) 2021-11-03T17:30:44.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.490+0000 7f9bd37fe700 1 -- 172.21.15.26:0/2956749761 learned_addr learned my addr 172.21.15.26:0/2956749761 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:30:44.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.490+0000 7f9bd2ffd700 1 --2- 172.21.15.26:0/2956749761 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9bd40f6ff0 0x7f9bd4107490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:30:44.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.490+0000 7f9bd37fe700 1 -- 172.21.15.26:0/2956749761 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9bd40f6ff0 msgr2=0x7f9bd4107490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:30:44.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.490+0000 7f9bd37fe700 1 --2- 172.21.15.26:0/2956749761 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9bd40f6ff0 0x7f9bd4107490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:44.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.490+0000 7f9bd37fe700 1 -- 172.21.15.26:0/2956749761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc8005040 con 0x7f9bd40f66e0 2021-11-03T17:30:44.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.490+0000 7f9bd37fe700 1 --2- 172.21.15.26:0/2956749761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd40f66e0 0x7f9bd4106fa0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f9bc400b410 tx=0x7f9bc4006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:30:44.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.490+0000 7f9bbbfff700 1 -- 172.21.15.26:0/2956749761 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bc40125f0 con 0x7f9bd40f66e0 2021-11-03T17:30:44.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.490+0000 7f9bd9d42700 1 -- 172.21.15.26:0/2956749761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bd4108660 con 0x7f9bd40f66e0 2021-11-03T17:30:44.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.490+0000 7f9bbbfff700 1 -- 172.21.15.26:0/2956749761 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9bc400be30 con 0x7f9bd40f66e0 2021-11-03T17:30:44.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.490+0000 7f9bbbfff700 1 -- 172.21.15.26:0/2956749761 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bc4002a70 con 0x7f9bd40f66e0 2021-11-03T17:30:44.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.490+0000 7f9bd9d42700 1 -- 172.21.15.26:0/2956749761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bd4108c20 con 0x7f9bd40f66e0 2021-11-03T17:30:44.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.491+0000 7f9bd9d42700 1 -- 172.21.15.26:0/2956749761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bd40f5b70 con 0x7f9bd40f66e0 2021-11-03T17:30:44.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.492+0000 7f9bbbfff700 1 -- 172.21.15.26:0/2956749761 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f9bc400f030 con 0x7f9bd40f66e0 2021-11-03T17:30:44.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.492+0000 7f9bbbfff700 1 --2- 172.21.15.26:0/2956749761 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9bbc064090 0x7f9bbc066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:30:44.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.492+0000 7f9bbbfff700 1 -- 172.21.15.26:0/2956749761 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f9bc4080c10 con 0x7f9bd40f66e0 2021-11-03T17:30:44.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.492+0000 7f9bd2ffd700 1 --2- 172.21.15.26:0/2956749761 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9bbc064090 0x7f9bbc066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:30:44.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.493+0000 7f9bd2ffd700 1 --2- 172.21.15.26:0/2956749761 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9bbc064090 0x7f9bbc066550 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f9bc8004e30 tx=0x7f9bc8009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:30:44.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.496+0000 7f9bbbfff700 1 -- 172.21.15.26:0/2956749761 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f9bc4052f70 con 0x7f9bd40f66e0 2021-11-03T17:30:44.693 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.699+0000 7f9bd9d42700 1 -- 172.21.15.26:0/2956749761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9bd40fef50 con 0x7f9bd40f66e0 2021-11-03T17:30:44.694 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.700+0000 7f9bbbfff700 1 -- 172.21.15.26:0/2956749761 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f9bc4052b60 con 0x7f9bd40f66e0 2021-11-03T17:30:44.694 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:30:44.695 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:30:44.695 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:30:44.695 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:30:44.696 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:30:44.696 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:30:44.696 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:30:44.696 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:30:44.696 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:30:44.697 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:30:44.697 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:30:44.697 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:30:44.697 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:30:44.698 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:30:44.698 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:30:44.698 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:30:44.698 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:30:44.698 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:30:44.699 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:30:44.699 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:30:44.699 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:30:44.699 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:30:44.700 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:30:44.700 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:30:44.700 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:30:44.701 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:30:44.701 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:30:44.701 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:30:44.701 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:30:44.702 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:30:44.702 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:30:44.702 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:30:44.703 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:30:44.703 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:30:44.703 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:30:44.703 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:30:44.704 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:30:44.704 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:30:44.704 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:30:44.705 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.701+0000 7f9bd9d42700 1 -- 172.21.15.26:0/2956749761 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9bbc064090 msgr2=0x7f9bbc066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:30:44.705 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.701+0000 7f9bd9d42700 1 --2- 172.21.15.26:0/2956749761 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9bbc064090 0x7f9bbc066550 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f9bc8004e30 tx=0x7f9bc8009b30).stop 2021-11-03T17:30:44.705 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.701+0000 7f9bd9d42700 1 -- 172.21.15.26:0/2956749761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd40f66e0 msgr2=0x7f9bd4106fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:30:44.706 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.701+0000 7f9bd9d42700 1 --2- 172.21.15.26:0/2956749761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd40f66e0 0x7f9bd4106fa0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f9bc400b410 tx=0x7f9bc4006ef0).stop 2021-11-03T17:30:44.706 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.701+0000 7f9bd9d42700 1 -- 172.21.15.26:0/2956749761 shutdown_connections 2021-11-03T17:30:44.706 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.701+0000 7f9bd9d42700 1 --2- 172.21.15.26:0/2956749761 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9bbc064090 0x7f9bbc066550 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:44.706 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.701+0000 7f9bd9d42700 1 --2- 172.21.15.26:0/2956749761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd40f66e0 0x7f9bd4106fa0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:44.707 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.701+0000 7f9bd9d42700 1 --2- 172.21.15.26:0/2956749761 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9bd40f6ff0 0x7f9bd4107490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:30:44.707 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.701+0000 7f9bd9d42700 1 -- 172.21.15.26:0/2956749761 >> 172.21.15.26:0/2956749761 conn(0x7f9bd40f1f00 msgr2=0x7f9bd40fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:30:44.707 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.701+0000 7f9bd9d42700 1 -- 172.21.15.26:0/2956749761 shutdown_connections 2021-11-03T17:30:44.707 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:30:44.701+0000 7f9bd9d42700 1 -- 172.21.15.26:0/2956749761 wait complete. 2021-11-03T17:30:44.708 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:30:44.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:44 smithi194 ceph-mon[65619]: pgmap v1082: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:44.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:44 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1975802847' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:30:44.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:44 smithi026 ceph-mon[96795]: pgmap v1082: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:44.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:44 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1975802847' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:30:45.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:45 smithi194 ceph-mon[65619]: from='client.35260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:30:45.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:45 smithi194 ceph-mon[65619]: from='client.35264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:30:45.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:45 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2956749761' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:30:45.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:45 smithi026 ceph-mon[96795]: from='client.35260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:30:45.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:45 smithi026 ceph-mon[96795]: from='client.35264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:30:45.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:45 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2956749761' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:30:46.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:46 smithi194 ceph-mon[65619]: pgmap v1083: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:46.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:46 smithi026 ceph-mon[96795]: pgmap v1083: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:48.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:48 smithi194 ceph-mon[65619]: pgmap v1084: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:30:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:30:48.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:48 smithi026 ceph-mon[96795]: pgmap v1084: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:48.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:30:48.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:30:50.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:50 smithi194 ceph-mon[65619]: pgmap v1085: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:50.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:50 smithi026 ceph-mon[96795]: pgmap v1085: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:52.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:52 smithi194 ceph-mon[65619]: pgmap v1086: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:52.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:52 smithi026 ceph-mon[96795]: pgmap v1086: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:54.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:54 smithi194 ceph-mon[65619]: pgmap v1087: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:54.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:30:54.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:54 smithi026 ceph-mon[96795]: pgmap v1087: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:54.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:30:55.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:55 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:30:55.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:55 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:30:56.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:56 smithi194 ceph-mon[65619]: pgmap v1088: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:56.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:56 smithi026 ceph-mon[96795]: pgmap v1088: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:58.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:30:58 smithi194 ceph-mon[65619]: pgmap v1089: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:30:58.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:30:58 smithi026 ceph-mon[96795]: pgmap v1089: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:00.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:00 smithi194 ceph-mon[65619]: pgmap v1090: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:00.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:00 smithi026 ceph-mon[96795]: pgmap v1090: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:02.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:02 smithi026 ceph-mon[96795]: pgmap v1091: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:02.995 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:02 smithi194 ceph-mon[65619]: pgmap v1091: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:04.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:04 smithi026 ceph-mon[96795]: pgmap v1092: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:04.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:04 smithi194 ceph-mon[65619]: pgmap v1092: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:06.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:06 smithi026 ceph-mon[96795]: pgmap v1093: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:06.995 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:06 smithi194 ceph-mon[65619]: pgmap v1093: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:08.859 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:08 smithi026 ceph-mon[96795]: pgmap v1094: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:08.859 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:08 smithi194 ceph-mon[65619]: pgmap v1094: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:09.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:09 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:31:09.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:09 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:31:09.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:09 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:31:09.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:09 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:31:09.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:09 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:31:09.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:09 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:31:09.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:09 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:31:09.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:09 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:31:09.995 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:09 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:31:09.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:09 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:31:09.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:09 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:31:09.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:09 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:31:09.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:09 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:31:09.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:09 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:31:09.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:09 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:31:09.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:09 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:31:10.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:10 smithi026 ceph-mon[96795]: poll took 60083.430 ms: 1 events 2021-11-03T17:31:10.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:10 smithi026 ceph-mon[96795]: pgmap v1095: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:10.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:10 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:31:10.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:10 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:31:10.995 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:10 smithi194 ceph-mon[65619]: poll took 60083.430 ms: 1 events 2021-11-03T17:31:10.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:10 smithi194 ceph-mon[65619]: pgmap v1095: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:10.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:10 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:31:10.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:10 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:31:12.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:12 smithi026 ceph-mon[96795]: pgmap v1096: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:12.995 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:12 smithi194 ceph-mon[65619]: pgmap v1096: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:14.811 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:14.816+0000 7f4a7a842700 1 -- 172.21.15.26:0/555306289 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a740f66e0 msgr2=0x7f4a740f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:31:14.811 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:14.816+0000 7f4a7a842700 1 --2- 172.21.15.26:0/555306289 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a740f66e0 0x7f4a740f6b00 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f4a64004660 tx=0x7f4a64009b30).stop 2021-11-03T17:31:14.811 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:14.816+0000 7f4a7a842700 1 -- 172.21.15.26:0/555306289 shutdown_connections 2021-11-03T17:31:14.811 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:14.816+0000 7f4a7a842700 1 --2- 172.21.15.26:0/555306289 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a740f6ff0 0x7f4a740f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:14.812 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:14.816+0000 7f4a7a842700 1 --2- 172.21.15.26:0/555306289 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a740f66e0 0x7f4a740f6b00 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:14.812 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:14.816+0000 7f4a7a842700 1 -- 172.21.15.26:0/555306289 >> 172.21.15.26:0/555306289 conn(0x7f4a740f1f00 msgr2=0x7f4a740f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:31:14.812 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:14.816+0000 7f4a7a842700 1 -- 172.21.15.26:0/555306289 shutdown_connections 2021-11-03T17:31:14.812 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:14.816+0000 7f4a7a842700 1 -- 172.21.15.26:0/555306289 wait complete. 2021-11-03T17:31:14.813 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:14.817+0000 7f4a7a842700 1 Processor -- start 2021-11-03T17:31:14.813 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:14.817+0000 7f4a7a842700 1 -- start start 2021-11-03T17:31:14.815 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:14.817+0000 7f4a7a842700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a740f66e0 0x7f4a74106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:31:14.815 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:14.817+0000 7f4a7a842700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a740f6ff0 0x7f4a74107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:31:14.815 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:14.817+0000 7f4a7a842700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a74107a00 con 0x7f4a740f66e0 2021-11-03T17:31:14.816 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:14.817+0000 7f4a7a842700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a74107b40 con 0x7f4a740f6ff0 2021-11-03T17:31:14.816 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:14.817+0000 7f4a73fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a740f66e0 0x7f4a74106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:31:14.816 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:14.817+0000 7f4a73fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a740f66e0 0x7f4a74106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54856/0 (socket says 172.21.15.26:54856) 2021-11-03T17:31:14.816 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:14.817+0000 7f4a73fff700 1 -- 172.21.15.26:0/3422882879 learned_addr learned my addr 172.21.15.26:0/3422882879 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:31:14.817 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:14.818+0000 7f4a73fff700 1 -- 172.21.15.26:0/3422882879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a740f6ff0 msgr2=0x7f4a74107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:31:14.817 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:14.818+0000 7f4a737fe700 1 --2- 172.21.15.26:0/3422882879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a740f6ff0 0x7f4a74107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:31:14.817 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:14.818+0000 7f4a73fff700 1 --2- 172.21.15.26:0/3422882879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a740f6ff0 0x7f4a74107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:14.818 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:14.818+0000 7f4a73fff700 1 -- 172.21.15.26:0/3422882879 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a64005040 con 0x7f4a740f66e0 2021-11-03T17:31:14.818 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:14.818+0000 7f4a73fff700 1 --2- 172.21.15.26:0/3422882879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a740f66e0 0x7f4a74106f60 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f4a64009da0 tx=0x7f4a64009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:31:14.818 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:14.818+0000 7f4a70ff9700 1 -- 172.21.15.26:0/3422882879 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a64018070 con 0x7f4a740f66e0 2021-11-03T17:31:14.818 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:14.818+0000 7f4a7a842700 1 -- 172.21.15.26:0/3422882879 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a74108480 con 0x7f4a740f66e0 2021-11-03T17:31:14.819 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:14.818+0000 7f4a7a842700 1 -- 172.21.15.26:0/3422882879 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a741089e0 con 0x7f4a740f66e0 2021-11-03T17:31:14.819 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:14.818+0000 7f4a70ff9700 1 -- 172.21.15.26:0/3422882879 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4a64007d70 con 0x7f4a740f66e0 2021-11-03T17:31:14.819 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:14.818+0000 7f4a70ff9700 1 -- 172.21.15.26:0/3422882879 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a6401dea0 con 0x7f4a740f66e0 2021-11-03T17:31:14.819 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:14.819+0000 7f4a7a842700 1 -- 172.21.15.26:0/3422882879 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a74045ad0 con 0x7f4a740f66e0 2021-11-03T17:31:14.820 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:14.820+0000 7f4a70ff9700 1 -- 172.21.15.26:0/3422882879 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f4a6401d420 con 0x7f4a740f66e0 2021-11-03T17:31:14.820 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:14.820+0000 7f4a70ff9700 1 --2- 172.21.15.26:0/3422882879 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4a60064090 0x7f4a60066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:31:14.820 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:14.820+0000 7f4a70ff9700 1 -- 172.21.15.26:0/3422882879 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f4a64082580 con 0x7f4a740f66e0 2021-11-03T17:31:14.820 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:14.820+0000 7f4a737fe700 1 --2- 172.21.15.26:0/3422882879 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4a60064090 0x7f4a60066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:31:14.820 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:14.821+0000 7f4a737fe700 1 --2- 172.21.15.26:0/3422882879 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4a60064090 0x7f4a60066550 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f4a5c0041d0 tx=0x7f4a5c009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:31:14.821 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:14.824+0000 7f4a70ff9700 1 -- 172.21.15.26:0/3422882879 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f4a640549a0 con 0x7f4a740f66e0 2021-11-03T17:31:14.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:14 smithi026 ceph-mon[96795]: pgmap v1097: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:14.995 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:14 smithi194 ceph-mon[65619]: pgmap v1097: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:14.998 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.004+0000 7f4a7a842700 1 -- 172.21.15.26:0/3422882879 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a740ff010 con 0x7f4a60064090 2021-11-03T17:31:14.999 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.006+0000 7f4a70ff9700 1 -- 172.21.15.26:0/3422882879 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f4a740ff010 con 0x7f4a60064090 2021-11-03T17:31:15.001 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.007+0000 7f4a7a842700 1 -- 172.21.15.26:0/3422882879 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4a60064090 msgr2=0x7f4a60066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:31:15.002 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.007+0000 7f4a7a842700 1 --2- 172.21.15.26:0/3422882879 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4a60064090 0x7f4a60066550 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f4a5c0041d0 tx=0x7f4a5c009040).stop 2021-11-03T17:31:15.002 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.007+0000 7f4a7a842700 1 -- 172.21.15.26:0/3422882879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a740f66e0 msgr2=0x7f4a74106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:31:15.002 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.007+0000 7f4a7a842700 1 --2- 172.21.15.26:0/3422882879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a740f66e0 0x7f4a74106f60 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f4a64009da0 tx=0x7f4a64009b30).stop 2021-11-03T17:31:15.002 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.008+0000 7f4a7a842700 1 -- 172.21.15.26:0/3422882879 shutdown_connections 2021-11-03T17:31:15.003 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.008+0000 7f4a7a842700 1 --2- 172.21.15.26:0/3422882879 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4a60064090 0x7f4a60066550 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:15.003 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.008+0000 7f4a7a842700 1 --2- 172.21.15.26:0/3422882879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a740f66e0 0x7f4a74106f60 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:15.003 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.008+0000 7f4a7a842700 1 --2- 172.21.15.26:0/3422882879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a740f6ff0 0x7f4a74107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:15.003 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.008+0000 7f4a7a842700 1 -- 172.21.15.26:0/3422882879 >> 172.21.15.26:0/3422882879 conn(0x7f4a740f1f00 msgr2=0x7f4a740fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:31:15.003 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.008+0000 7f4a7a842700 1 -- 172.21.15.26:0/3422882879 shutdown_connections 2021-11-03T17:31:15.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.008+0000 7f4a7a842700 1 -- 172.21.15.26:0/3422882879 wait complete. 2021-11-03T17:31:15.011 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:31:15.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.108+0000 7f334e90b700 1 -- 172.21.15.26:0/2201330657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33480f55e0 msgr2=0x7f33480f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:31:15.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.108+0000 7f334e90b700 1 --2- 172.21.15.26:0/2201330657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33480f55e0 0x7f33480f5a00 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f3338004660 tx=0x7f3338009b30).stop 2021-11-03T17:31:15.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.108+0000 7f334e90b700 1 -- 172.21.15.26:0/2201330657 shutdown_connections 2021-11-03T17:31:15.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.108+0000 7f334e90b700 1 --2- 172.21.15.26:0/2201330657 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33480f5ef0 0x7f33480f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:15.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.108+0000 7f334e90b700 1 --2- 172.21.15.26:0/2201330657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33480f55e0 0x7f33480f5a00 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:15.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.108+0000 7f334e90b700 1 -- 172.21.15.26:0/2201330657 >> 172.21.15.26:0/2201330657 conn(0x7f33480f0de0 msgr2=0x7f33480f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:31:15.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.108+0000 7f334e90b700 1 -- 172.21.15.26:0/2201330657 shutdown_connections 2021-11-03T17:31:15.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.108+0000 7f334e90b700 1 -- 172.21.15.26:0/2201330657 wait complete. 2021-11-03T17:31:15.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.108+0000 7f334e90b700 1 Processor -- start 2021-11-03T17:31:15.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.109+0000 7f334e90b700 1 -- start start 2021-11-03T17:31:15.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.109+0000 7f334e90b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33480f55e0 0x7f3348109150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:31:15.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.109+0000 7f334e90b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33480f5ef0 0x7f3348109640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:31:15.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.109+0000 7f334e90b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3348109bf0 con 0x7f33480f5ef0 2021-11-03T17:31:15.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.109+0000 7f334e90b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3348109d30 con 0x7f33480f55e0 2021-11-03T17:31:15.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.109+0000 7f33477fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33480f5ef0 0x7f3348109640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:31:15.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.109+0000 7f33477fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33480f5ef0 0x7f3348109640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54868/0 (socket says 172.21.15.26:54868) 2021-11-03T17:31:15.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.109+0000 7f33477fe700 1 -- 172.21.15.26:0/1684133894 learned_addr learned my addr 172.21.15.26:0/1684133894 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:31:15.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.109+0000 7f3347fff700 1 --2- 172.21.15.26:0/1684133894 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33480f55e0 0x7f3348109150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:31:15.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.109+0000 7f33477fe700 1 -- 172.21.15.26:0/1684133894 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33480f55e0 msgr2=0x7f3348109150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:31:15.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.109+0000 7f33477fe700 1 --2- 172.21.15.26:0/1684133894 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33480f55e0 0x7f3348109150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:15.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.109+0000 7f33477fe700 1 -- 172.21.15.26:0/1684133894 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3338005040 con 0x7f33480f5ef0 2021-11-03T17:31:15.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.109+0000 7f33477fe700 1 --2- 172.21.15.26:0/1684133894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33480f5ef0 0x7f3348109640 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f33300026d0 tx=0x7f3330009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:31:15.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.110+0000 7f3344ff9700 1 -- 172.21.15.26:0/1684133894 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33300079c0 con 0x7f33480f5ef0 2021-11-03T17:31:15.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.110+0000 7f334e90b700 1 -- 172.21.15.26:0/1684133894 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f334810a6d0 con 0x7f33480f5ef0 2021-11-03T17:31:15.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.110+0000 7f3344ff9700 1 -- 172.21.15.26:0/1684133894 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f333000f040 con 0x7f33480f5ef0 2021-11-03T17:31:15.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.110+0000 7f334e90b700 1 -- 172.21.15.26:0/1684133894 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f334810ac90 con 0x7f33480f5ef0 2021-11-03T17:31:15.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.110+0000 7f3344ff9700 1 -- 172.21.15.26:0/1684133894 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33300148b0 con 0x7f33480f5ef0 2021-11-03T17:31:15.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.110+0000 7f334e90b700 1 -- 172.21.15.26:0/1684133894 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f332c004fa0 con 0x7f33480f5ef0 2021-11-03T17:31:15.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.111+0000 7f3344ff9700 1 -- 172.21.15.26:0/1684133894 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f33300090d0 con 0x7f33480f5ef0 2021-11-03T17:31:15.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.111+0000 7f3344ff9700 1 --2- 172.21.15.26:0/1684133894 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f33340640b0 0x7f3334066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:31:15.113 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.111+0000 7f3344ff9700 1 -- 172.21.15.26:0/1684133894 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f33300806a0 con 0x7f33480f5ef0 2021-11-03T17:31:15.113 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.111+0000 7f3347fff700 1 --2- 172.21.15.26:0/1684133894 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f33340640b0 0x7f3334066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:31:15.113 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.112+0000 7f3347fff700 1 --2- 172.21.15.26:0/1684133894 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f33340640b0 0x7f3334066570 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f3338004630 tx=0x7f3338009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:31:15.113 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.115+0000 7f3344ff9700 1 -- 172.21.15.26:0/1684133894 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f3330052a00 con 0x7f33480f5ef0 2021-11-03T17:31:15.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.285+0000 7f334e90b700 1 -- 172.21.15.26:0/1684133894 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f332c000bc0 con 0x7f33340640b0 2021-11-03T17:31:15.294 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.300+0000 7f3344ff9700 1 -- 172.21.15.26:0/1684133894 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f332c000bc0 con 0x7f33340640b0 2021-11-03T17:31:15.294 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:31:15.294 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (42m) 2m ago 43m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:31:15.295 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (34m) 2m ago 43m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:31:15.295 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (34m) 66s ago 42m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:31:15.295 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (42m) 2m ago 43m 40.3M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:31:15.295 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (35m) 2m ago 38m 22.6M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:31:15.296 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (35m) 2m ago 38m 23.5M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:31:15.296 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (38m) 66s ago 38m 24.8M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:31:15.296 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (38m) 66s ago 38m 25.0M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:31:15.296 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (36m) 2m ago 45m 520M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:31:15.297 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (35m) 66s ago 42m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:31:15.297 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (35m) 2m ago 45m 176M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:31:15.297 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (35m) 66s ago 42m 89.5M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:31:15.297 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (43m) 2m ago 43m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:31:15.297 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (42m) 66s ago 42m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:31:15.298 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (34m) 2m ago 42m 231M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:31:15.298 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (33m) 2m ago 41m 248M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:31:15.298 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (33m) 2m ago 41m 207M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:31:15.298 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (32m) 66s ago 41m 262M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:31:15.299 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (32m) 66s ago 40m 227M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:31:15.299 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (31m) 66s ago 40m 215M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:31:15.299 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (42m) 2m ago 43m 54.4M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:31:15.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.302+0000 7f334e90b700 1 -- 172.21.15.26:0/1684133894 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f33340640b0 msgr2=0x7f3334066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:31:15.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.302+0000 7f334e90b700 1 --2- 172.21.15.26:0/1684133894 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f33340640b0 0x7f3334066570 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f3338004630 tx=0x7f3338009b30).stop 2021-11-03T17:31:15.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.302+0000 7f334e90b700 1 -- 172.21.15.26:0/1684133894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33480f5ef0 msgr2=0x7f3348109640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:31:15.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.302+0000 7f334e90b700 1 --2- 172.21.15.26:0/1684133894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33480f5ef0 0x7f3348109640 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f33300026d0 tx=0x7f3330009de0).stop 2021-11-03T17:31:15.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.302+0000 7f334e90b700 1 -- 172.21.15.26:0/1684133894 shutdown_connections 2021-11-03T17:31:15.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.302+0000 7f334e90b700 1 --2- 172.21.15.26:0/1684133894 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f33340640b0 0x7f3334066570 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:15.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.302+0000 7f334e90b700 1 --2- 172.21.15.26:0/1684133894 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33480f55e0 0x7f3348109150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:15.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.302+0000 7f334e90b700 1 --2- 172.21.15.26:0/1684133894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33480f5ef0 0x7f3348109640 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:15.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.302+0000 7f334e90b700 1 -- 172.21.15.26:0/1684133894 >> 172.21.15.26:0/1684133894 conn(0x7f33480f0de0 msgr2=0x7f334805ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:31:15.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.302+0000 7f334e90b700 1 -- 172.21.15.26:0/1684133894 shutdown_connections 2021-11-03T17:31:15.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.302+0000 7f334e90b700 1 -- 172.21.15.26:0/1684133894 wait complete. 2021-11-03T17:31:15.396 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.401+0000 7f54471e8700 1 -- 172.21.15.26:0/3982019681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54400f9880 msgr2=0x7f54400fbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:31:15.397 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.401+0000 7f54471e8700 1 --2- 172.21.15.26:0/3982019681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54400f9880 0x7f54400fbc70 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f54300099e0 tx=0x7f5430004d10).stop 2021-11-03T17:31:15.397 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.401+0000 7f54471e8700 1 -- 172.21.15.26:0/3982019681 shutdown_connections 2021-11-03T17:31:15.397 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.401+0000 7f54471e8700 1 --2- 172.21.15.26:0/3982019681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54400f9880 0x7f54400fbc70 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:15.398 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.401+0000 7f54471e8700 1 --2- 172.21.15.26:0/3982019681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54400602b0 0x7f54400f9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:15.398 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.401+0000 7f54471e8700 1 -- 172.21.15.26:0/3982019681 >> 172.21.15.26:0/3982019681 conn(0x7f54400f0d40 msgr2=0x7f54400f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:31:15.398 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.401+0000 7f54471e8700 1 -- 172.21.15.26:0/3982019681 shutdown_connections 2021-11-03T17:31:15.398 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.401+0000 7f54471e8700 1 -- 172.21.15.26:0/3982019681 wait complete. 2021-11-03T17:31:15.399 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.401+0000 7f54471e8700 1 Processor -- start 2021-11-03T17:31:15.399 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.401+0000 7f54471e8700 1 -- start start 2021-11-03T17:31:15.399 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.402+0000 7f54471e8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54400602b0 0x7f5440107030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:31:15.399 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.402+0000 7f54471e8700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54400f9880 0x7f5440107520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:31:15.399 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.402+0000 7f54471e8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5440107ad0 con 0x7f54400602b0 2021-11-03T17:31:15.400 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.402+0000 7f54471e8700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5440107c10 con 0x7f54400f9880 2021-11-03T17:31:15.400 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.402+0000 7f5444f84700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54400602b0 0x7f5440107030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:31:15.400 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.402+0000 7f5444f84700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54400602b0 0x7f5440107030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54876/0 (socket says 172.21.15.26:54876) 2021-11-03T17:31:15.400 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.402+0000 7f5444f84700 1 -- 172.21.15.26:0/2333541808 learned_addr learned my addr 172.21.15.26:0/2333541808 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:31:15.401 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.402+0000 7f543ffff700 1 --2- 172.21.15.26:0/2333541808 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54400f9880 0x7f5440107520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:31:15.401 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.402+0000 7f5444f84700 1 -- 172.21.15.26:0/2333541808 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54400f9880 msgr2=0x7f5440107520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:31:15.401 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.402+0000 7f5444f84700 1 --2- 172.21.15.26:0/2333541808 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54400f9880 0x7f5440107520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:15.401 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.402+0000 7f5444f84700 1 -- 172.21.15.26:0/2333541808 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5430009640 con 0x7f54400602b0 2021-11-03T17:31:15.402 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.402+0000 7f5444f84700 1 --2- 172.21.15.26:0/2333541808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54400602b0 0x7f5440107030 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f54380026d0 tx=0x7f5438009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:31:15.402 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.402+0000 7f543d7fa700 1 -- 172.21.15.26:0/2333541808 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5438009320 con 0x7f54400602b0 2021-11-03T17:31:15.402 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.402+0000 7f54471e8700 1 -- 172.21.15.26:0/2333541808 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54401085b0 con 0x7f54400602b0 2021-11-03T17:31:15.402 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.402+0000 7f543d7fa700 1 -- 172.21.15.26:0/2333541808 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f543800f040 con 0x7f54400602b0 2021-11-03T17:31:15.402 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.402+0000 7f543d7fa700 1 -- 172.21.15.26:0/2333541808 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54380147e0 con 0x7f54400602b0 2021-11-03T17:31:15.403 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.402+0000 7f54471e8700 1 -- 172.21.15.26:0/2333541808 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5440108af0 con 0x7f54400602b0 2021-11-03T17:31:15.404 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.404+0000 7f54471e8700 1 -- 172.21.15.26:0/2333541808 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5440045ad0 con 0x7f54400602b0 2021-11-03T17:31:15.405 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.404+0000 7f543d7fa700 1 -- 172.21.15.26:0/2333541808 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f5438009480 con 0x7f54400602b0 2021-11-03T17:31:15.405 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.404+0000 7f543d7fa700 1 --2- 172.21.15.26:0/2333541808 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f542c064090 0x7f542c066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:31:15.405 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.404+0000 7f543d7fa700 1 -- 172.21.15.26:0/2333541808 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f5438080eb0 con 0x7f54400602b0 2021-11-03T17:31:15.405 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.404+0000 7f543ffff700 1 --2- 172.21.15.26:0/2333541808 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f542c064090 0x7f542c066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:31:15.406 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.405+0000 7f543ffff700 1 --2- 172.21.15.26:0/2333541808 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f542c064090 0x7f542c066550 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f543000b3b0 tx=0x7f5430004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:31:15.406 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.408+0000 7f543d7fa700 1 -- 172.21.15.26:0/2333541808 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f5438053210 con 0x7f54400602b0 2021-11-03T17:31:15.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.639+0000 7f54471e8700 1 -- 172.21.15.26:0/2333541808 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5440027a00 con 0x7f54400602b0 2021-11-03T17:31:15.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.639+0000 7f543d7fa700 1 -- 172.21.15.26:0/2333541808 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f5438052e00 con 0x7f54400602b0 2021-11-03T17:31:15.634 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:31:15.634 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:31:15.635 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:31:15.635 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:31:15.635 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:31:15.635 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:31:15.636 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:31:15.636 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:31:15.636 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:31:15.636 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:31:15.636 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:31:15.637 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:31:15.637 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:31:15.637 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:31:15.637 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:31:15.638 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:31:15.638 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:31:15.638 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:31:15.639 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.641+0000 7f54471e8700 1 -- 172.21.15.26:0/2333541808 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f542c064090 msgr2=0x7f542c066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:31:15.639 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.641+0000 7f54471e8700 1 --2- 172.21.15.26:0/2333541808 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f542c064090 0x7f542c066550 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f543000b3b0 tx=0x7f5430004d10).stop 2021-11-03T17:31:15.639 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.641+0000 7f54471e8700 1 -- 172.21.15.26:0/2333541808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54400602b0 msgr2=0x7f5440107030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:31:15.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.641+0000 7f54471e8700 1 --2- 172.21.15.26:0/2333541808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54400602b0 0x7f5440107030 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f54380026d0 tx=0x7f5438009de0).stop 2021-11-03T17:31:15.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.641+0000 7f54471e8700 1 -- 172.21.15.26:0/2333541808 shutdown_connections 2021-11-03T17:31:15.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.641+0000 7f54471e8700 1 --2- 172.21.15.26:0/2333541808 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f542c064090 0x7f542c066550 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:15.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.641+0000 7f54471e8700 1 --2- 172.21.15.26:0/2333541808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54400602b0 0x7f5440107030 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:15.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.641+0000 7f54471e8700 1 --2- 172.21.15.26:0/2333541808 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54400f9880 0x7f5440107520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:15.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.641+0000 7f54471e8700 1 -- 172.21.15.26:0/2333541808 >> 172.21.15.26:0/2333541808 conn(0x7f54400f0d40 msgr2=0x7f54400f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:31:15.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.641+0000 7f54471e8700 1 -- 172.21.15.26:0/2333541808 shutdown_connections 2021-11-03T17:31:15.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.641+0000 7f54471e8700 1 -- 172.21.15.26:0/2333541808 wait complete. 2021-11-03T17:31:15.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.741+0000 7f1a0d19f700 1 -- 172.21.15.26:0/3325432394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a080602b0 msgr2=0x7f1a080f9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:31:15.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.741+0000 7f1a0d19f700 1 --2- 172.21.15.26:0/3325432394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a080602b0 0x7f1a080f9180 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f19f8004660 tx=0x7f19f8009b30).stop 2021-11-03T17:31:15.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.741+0000 7f1a0d19f700 1 -- 172.21.15.26:0/3325432394 shutdown_connections 2021-11-03T17:31:15.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.741+0000 7f1a0d19f700 1 --2- 172.21.15.26:0/3325432394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a080f9700 0x7f1a080fbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:15.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.741+0000 7f1a0d19f700 1 --2- 172.21.15.26:0/3325432394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a080602b0 0x7f1a080f9180 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:15.739 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.741+0000 7f1a0d19f700 1 -- 172.21.15.26:0/3325432394 >> 172.21.15.26:0/3325432394 conn(0x7f1a080f0ba0 msgr2=0x7f1a080f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:31:15.739 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.742+0000 7f1a0d19f700 1 -- 172.21.15.26:0/3325432394 shutdown_connections 2021-11-03T17:31:15.740 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.742+0000 7f1a0d19f700 1 -- 172.21.15.26:0/3325432394 wait complete. 2021-11-03T17:31:15.740 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.742+0000 7f1a0d19f700 1 Processor -- start 2021-11-03T17:31:15.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.742+0000 7f1a0d19f700 1 -- start start 2021-11-03T17:31:15.742 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.742+0000 7f1a0d19f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a080602b0 0x7f1a080f6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:31:15.742 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.742+0000 7f1a0d19f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a080f9700 0x7f1a080f5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:31:15.742 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.742+0000 7f1a0d19f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a080f55e0 con 0x7f1a080602b0 2021-11-03T17:31:15.743 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.742+0000 7f1a0d19f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a080f5720 con 0x7f1a080f9700 2021-11-03T17:31:15.743 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.743+0000 7f1a07fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a080602b0 0x7f1a080f6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:31:15.743 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.743+0000 7f1a07fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a080602b0 0x7f1a080f6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54886/0 (socket says 172.21.15.26:54886) 2021-11-03T17:31:15.743 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.743+0000 7f1a07fff700 1 -- 172.21.15.26:0/465860991 learned_addr learned my addr 172.21.15.26:0/465860991 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:31:15.744 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.743+0000 7f1a07fff700 1 -- 172.21.15.26:0/465860991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a080f9700 msgr2=0x7f1a080f5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:31:15.744 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.743+0000 7f1a07fff700 1 --2- 172.21.15.26:0/465860991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a080f9700 0x7f1a080f5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:31:15.744 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.743+0000 7f1a07fff700 1 -- 172.21.15.26:0/465860991 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f8005040 con 0x7f1a080602b0 2021-11-03T17:31:15.744 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.743+0000 7f1a07fff700 1 --2- 172.21.15.26:0/465860991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a080602b0 0x7f1a080f6c00 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f19f8000c00 tx=0x7f19f800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:31:15.744 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.743+0000 7f1a04ff9700 1 -- 172.21.15.26:0/465860991 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19f8019070 con 0x7f1a080602b0 2021-11-03T17:31:15.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.743+0000 7f1a04ff9700 1 -- 172.21.15.26:0/465860991 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f19f8007e70 con 0x7f1a080602b0 2021-11-03T17:31:15.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.743+0000 7f1a04ff9700 1 -- 172.21.15.26:0/465860991 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19f8014d90 con 0x7f1a080602b0 2021-11-03T17:31:15.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.743+0000 7f1a0d19f700 1 -- 172.21.15.26:0/465860991 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a080f59a0 con 0x7f1a080602b0 2021-11-03T17:31:15.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.743+0000 7f1a0d19f700 1 -- 172.21.15.26:0/465860991 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a080f5f00 con 0x7f1a080602b0 2021-11-03T17:31:15.747 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.744+0000 7f1a0d19f700 1 -- 172.21.15.26:0/465860991 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a08045ad0 con 0x7f1a080602b0 2021-11-03T17:31:15.747 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.745+0000 7f1a04ff9700 1 -- 172.21.15.26:0/465860991 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f19f8025070 con 0x7f1a080602b0 2021-11-03T17:31:15.747 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.745+0000 7f1a04ff9700 1 --2- 172.21.15.26:0/465860991 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f19f0064100 0x7f19f00665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:31:15.747 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.745+0000 7f1a04ff9700 1 -- 172.21.15.26:0/465860991 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f19f8081730 con 0x7f1a080602b0 2021-11-03T17:31:15.748 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.745+0000 7f1a077fe700 1 --2- 172.21.15.26:0/465860991 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f19f0064100 0x7f19f00665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:31:15.748 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.745+0000 7f1a077fe700 1 --2- 172.21.15.26:0/465860991 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f19f0064100 0x7f19f00665c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f1a08060080 tx=0x7f19fc00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:31:15.748 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.749+0000 7f1a04ff9700 1 -- 172.21.15.26:0/465860991 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f19f8053a30 con 0x7f1a080602b0 2021-11-03T17:31:15.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.954+0000 7f1a0d19f700 1 -- 172.21.15.26:0/465860991 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1a080fee60 con 0x7f1a080602b0 2021-11-03T17:31:15.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.954+0000 7f1a04ff9700 1 -- 172.21.15.26:0/465860991 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f19f8023020 con 0x7f1a080602b0 2021-11-03T17:31:15.950 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:31:15.951 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:31:15.951 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:31:15.951 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:31:15.952 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:31:15.952 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:31:15.953 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:31:15.954 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:31:15.954 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:31:15.955 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:31:15.955 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:31:15.956 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:31:15.956 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:31:15.957 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:31:15.957 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:31:15.958 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:31:15.958 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:31:15.959 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:31:15.959 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:31:15.960 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:31:15.960 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:31:15.961 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:31:15.961 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:31:15.962 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:31:15.962 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:31:15.963 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:31:15.963 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:31:15.964 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:31:15.965 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:31:15.965 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:31:15.965 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:31:15.966 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:31:15.966 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:31:15.967 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:31:15.967 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:31:15.968 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:31:15.968 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:31:15.968 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:31:15.969 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:31:15.970 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.956+0000 7f1a0d19f700 1 -- 172.21.15.26:0/465860991 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f19f0064100 msgr2=0x7f19f00665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:31:15.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.956+0000 7f1a0d19f700 1 --2- 172.21.15.26:0/465860991 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f19f0064100 0x7f19f00665c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f1a08060080 tx=0x7f19fc00b040).stop 2021-11-03T17:31:15.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.956+0000 7f1a0d19f700 1 -- 172.21.15.26:0/465860991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a080602b0 msgr2=0x7f1a080f6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:31:15.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.956+0000 7f1a0d19f700 1 --2- 172.21.15.26:0/465860991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a080602b0 0x7f1a080f6c00 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f19f8000c00 tx=0x7f19f800b040).stop 2021-11-03T17:31:15.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.956+0000 7f1a0d19f700 1 -- 172.21.15.26:0/465860991 shutdown_connections 2021-11-03T17:31:15.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.956+0000 7f1a0d19f700 1 --2- 172.21.15.26:0/465860991 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f19f0064100 0x7f19f00665c0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:15.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.956+0000 7f1a0d19f700 1 --2- 172.21.15.26:0/465860991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a080602b0 0x7f1a080f6c00 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:15.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.956+0000 7f1a0d19f700 1 --2- 172.21.15.26:0/465860991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a080f9700 0x7f1a080f5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:31:15.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.956+0000 7f1a0d19f700 1 -- 172.21.15.26:0/465860991 >> 172.21.15.26:0/465860991 conn(0x7f1a080f0ba0 msgr2=0x7f1a080f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:31:15.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.956+0000 7f1a0d19f700 1 -- 172.21.15.26:0/465860991 shutdown_connections 2021-11-03T17:31:15.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:15.956+0000 7f1a0d19f700 1 -- 172.21.15.26:0/465860991 wait complete. 2021-11-03T17:31:15.975 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:31:16.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:16 smithi026 ceph-mon[96795]: pgmap v1098: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:16.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:16 smithi026 ceph-mon[96795]: from='client.35276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:31:16.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:16 smithi026 ceph-mon[96795]: from='client.35280 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:31:16.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:16 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2333541808' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:31:16.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:16 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/465860991' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:31:16.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:16 smithi194 ceph-mon[65619]: pgmap v1098: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:16.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:16 smithi194 ceph-mon[65619]: from='client.35276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:31:16.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:16 smithi194 ceph-mon[65619]: from='client.35280 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:31:16.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:16 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2333541808' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:31:16.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:16 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/465860991' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:31:18.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:18 smithi026 ceph-mon[96795]: pgmap v1099: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:18.995 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:18 smithi194 ceph-mon[65619]: pgmap v1099: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:20.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:20 smithi026 ceph-mon[96795]: pgmap v1100: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:20.995 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:20 smithi194 ceph-mon[65619]: pgmap v1100: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:22.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:22 smithi026 ceph-mon[96795]: pgmap v1101: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:22.995 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:22 smithi194 ceph-mon[65619]: pgmap v1101: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:24.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:24 smithi026 ceph-mon[96795]: pgmap v1102: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:24.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:31:24.995 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:24 smithi194 ceph-mon[65619]: pgmap v1102: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:24.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:31:25.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:25 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:31:25.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:25 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:31:26.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:26 smithi026 ceph-mon[96795]: pgmap v1103: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:26.995 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:26 smithi194 ceph-mon[65619]: pgmap v1103: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:27.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:27 smithi026 ceph-mon[96795]: pgmap v1104: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:27.995 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:27 smithi194 ceph-mon[65619]: pgmap v1104: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:30.420 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:30 smithi026 ceph-mon[96795]: pgmap v1105: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:30.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:30 smithi194 ceph-mon[65619]: pgmap v1105: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:32.420 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:32 smithi026 ceph-mon[96795]: pgmap v1106: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:32.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:32 smithi194 ceph-mon[65619]: pgmap v1106: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:34.420 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:34 smithi026 ceph-mon[96795]: pgmap v1107: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:34.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:34 smithi194 ceph-mon[65619]: pgmap v1107: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:36.420 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:36 smithi026 ceph-mon[96795]: pgmap v1108: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:36.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:36 smithi194 ceph-mon[65619]: pgmap v1108: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:38.420 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:38 smithi026 ceph-mon[96795]: pgmap v1109: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:38.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:38 smithi194 ceph-mon[65619]: pgmap v1109: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:40.420 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:40 smithi026 ceph-mon[96795]: pgmap v1110: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:40.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:31:40.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:40 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:31:40.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:40 smithi194 ceph-mon[65619]: pgmap v1110: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:40.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:31:40.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:40 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:31:42.420 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:42 smithi026 ceph-mon[96795]: pgmap v1111: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:42.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:42 smithi194 ceph-mon[65619]: pgmap v1111: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:44.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:44 smithi194 ceph-mon[65619]: pgmap v1112: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:44.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:44 smithi026 ceph-mon[96795]: pgmap v1112: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:46.066 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.069+0000 7f51b3e45700 1 -- 172.21.15.26:0/797527875 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51ac0f6860 msgr2=0x7f51ac0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:31:46.066 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.069+0000 7f51b3e45700 1 --2- 172.21.15.26:0/797527875 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51ac0f6860 0x7f51ac0f6cc0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f51a0004660 tx=0x7f51a0009b30).stop 2021-11-03T17:31:46.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.069+0000 7f51b3e45700 1 -- 172.21.15.26:0/797527875 shutdown_connections 2021-11-03T17:31:46.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.069+0000 7f51b3e45700 1 --2- 172.21.15.26:0/797527875 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51ac0f6860 0x7f51ac0f6cc0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:46.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.069+0000 7f51b3e45700 1 --2- 172.21.15.26:0/797527875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51ac0f55c0 0x7f51ac0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:46.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.069+0000 7f51b3e45700 1 -- 172.21.15.26:0/797527875 >> 172.21.15.26:0/797527875 conn(0x7f51ac0f0d40 msgr2=0x7f51ac0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:31:46.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.069+0000 7f51b3e45700 1 -- 172.21.15.26:0/797527875 shutdown_connections 2021-11-03T17:31:46.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.069+0000 7f51b3e45700 1 -- 172.21.15.26:0/797527875 wait complete. 2021-11-03T17:31:46.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.070+0000 7f51b3e45700 1 Processor -- start 2021-11-03T17:31:46.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.070+0000 7f51b3e45700 1 -- start start 2021-11-03T17:31:46.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.070+0000 7f51b3e45700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51ac0f55c0 0x7f51ac105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:31:46.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.070+0000 7f51b3e45700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51ac0f6860 0x7f51ac1063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:31:46.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.070+0000 7f51b3e45700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac1069b0 con 0x7f51ac0f55c0 2021-11-03T17:31:46.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.070+0000 7f51b3e45700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac1071c0 con 0x7f51ac0f6860 2021-11-03T17:31:46.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.070+0000 7f51b1be1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51ac0f55c0 0x7f51ac105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:31:46.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.070+0000 7f51b1be1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51ac0f55c0 0x7f51ac105ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54904/0 (socket says 172.21.15.26:54904) 2021-11-03T17:31:46.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.070+0000 7f51b1be1700 1 -- 172.21.15.26:0/126941262 learned_addr learned my addr 172.21.15.26:0/126941262 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:31:46.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.070+0000 7f51b1be1700 1 -- 172.21.15.26:0/126941262 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51ac0f6860 msgr2=0x7f51ac1063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:31:46.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.071+0000 7f51b1be1700 1 --2- 172.21.15.26:0/126941262 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51ac0f6860 0x7f51ac1063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:31:46.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.071+0000 7f51b1be1700 1 -- 172.21.15.26:0/126941262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a0005040 con 0x7f51ac0f55c0 2021-11-03T17:31:46.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.071+0000 7f51b1be1700 1 --2- 172.21.15.26:0/126941262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51ac0f55c0 0x7f51ac105ec0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f51a400d7f0 tx=0x7f51a4004e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:31:46.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.071+0000 7f51aa7fc700 1 -- 172.21.15.26:0/126941262 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51a400b4f0 con 0x7f51ac0f55c0 2021-11-03T17:31:46.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.071+0000 7f51aa7fc700 1 -- 172.21.15.26:0/126941262 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f51a400f040 con 0x7f51ac0f55c0 2021-11-03T17:31:46.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.071+0000 7f51b3e45700 1 -- 172.21.15.26:0/126941262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51ac107440 con 0x7f51ac0f55c0 2021-11-03T17:31:46.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.071+0000 7f51aa7fc700 1 -- 172.21.15.26:0/126941262 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51a4013980 con 0x7f51ac0f55c0 2021-11-03T17:31:46.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.071+0000 7f51b3e45700 1 -- 172.21.15.26:0/126941262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ac107a00 con 0x7f51ac0f55c0 2021-11-03T17:31:46.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.072+0000 7f51b3e45700 1 -- 172.21.15.26:0/126941262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51ac0f49b0 con 0x7f51ac0f55c0 2021-11-03T17:31:46.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.072+0000 7f51aa7fc700 1 -- 172.21.15.26:0/126941262 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f51a401a030 con 0x7f51ac0f55c0 2021-11-03T17:31:46.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.073+0000 7f51aa7fc700 1 --2- 172.21.15.26:0/126941262 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f51940640b0 0x7f5194066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:31:46.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.073+0000 7f51aa7fc700 1 -- 172.21.15.26:0/126941262 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f51a4080850 con 0x7f51ac0f55c0 2021-11-03T17:31:46.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.073+0000 7f51b13e0700 1 --2- 172.21.15.26:0/126941262 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f51940640b0 0x7f5194066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:31:46.075 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.073+0000 7f51b13e0700 1 --2- 172.21.15.26:0/126941262 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f51940640b0 0x7f5194066570 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f51a0004e30 tx=0x7f51a0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:31:46.075 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.077+0000 7f51aa7fc700 1 -- 172.21.15.26:0/126941262 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f51a4052ac0 con 0x7f51ac0f55c0 2021-11-03T17:31:46.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.257+0000 7f51b3e45700 1 -- 172.21.15.26:0/126941262 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f51ac0fde60 con 0x7f51940640b0 2021-11-03T17:31:46.253 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.258+0000 7f51aa7fc700 1 -- 172.21.15.26:0/126941262 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f51ac0fde60 con 0x7f51940640b0 2021-11-03T17:31:46.255 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.260+0000 7f51b3e45700 1 -- 172.21.15.26:0/126941262 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f51940640b0 msgr2=0x7f5194066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:31:46.255 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.260+0000 7f51b3e45700 1 --2- 172.21.15.26:0/126941262 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f51940640b0 0x7f5194066570 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f51a0004e30 tx=0x7f51a0009b30).stop 2021-11-03T17:31:46.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.260+0000 7f51b3e45700 1 -- 172.21.15.26:0/126941262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51ac0f55c0 msgr2=0x7f51ac105ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:31:46.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.260+0000 7f51b3e45700 1 --2- 172.21.15.26:0/126941262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51ac0f55c0 0x7f51ac105ec0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f51a400d7f0 tx=0x7f51a4004e80).stop 2021-11-03T17:31:46.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.260+0000 7f51b3e45700 1 -- 172.21.15.26:0/126941262 shutdown_connections 2021-11-03T17:31:46.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.260+0000 7f51b3e45700 1 --2- 172.21.15.26:0/126941262 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f51940640b0 0x7f5194066570 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:46.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.260+0000 7f51b3e45700 1 --2- 172.21.15.26:0/126941262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51ac0f55c0 0x7f51ac105ec0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:46.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.260+0000 7f51b3e45700 1 --2- 172.21.15.26:0/126941262 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51ac0f6860 0x7f51ac1063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:31:46.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.260+0000 7f51b3e45700 1 -- 172.21.15.26:0/126941262 >> 172.21.15.26:0/126941262 conn(0x7f51ac0f0d40 msgr2=0x7f51ac0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:31:46.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.261+0000 7f51b3e45700 1 -- 172.21.15.26:0/126941262 shutdown_connections 2021-11-03T17:31:46.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.261+0000 7f51b3e45700 1 -- 172.21.15.26:0/126941262 wait complete. 2021-11-03T17:31:46.265 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:31:46.355 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.360+0000 7f30b0abc700 1 -- 172.21.15.26:0/3850814533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30ac0f66e0 msgr2=0x7f30ac0f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:31:46.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.360+0000 7f30b0abc700 1 --2- 172.21.15.26:0/3850814533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30ac0f66e0 0x7f30ac0f6b40 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f30a0004660 tx=0x7f30a0009b30).stop 2021-11-03T17:31:46.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.360+0000 7f30b0abc700 1 -- 172.21.15.26:0/3850814533 shutdown_connections 2021-11-03T17:31:46.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.360+0000 7f30b0abc700 1 --2- 172.21.15.26:0/3850814533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30ac0f66e0 0x7f30ac0f6b40 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:46.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.360+0000 7f30b0abc700 1 --2- 172.21.15.26:0/3850814533 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30ac0f5440 0x7f30ac0f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:46.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.360+0000 7f30b0abc700 1 -- 172.21.15.26:0/3850814533 >> 172.21.15.26:0/3850814533 conn(0x7f30ac0f0ba0 msgr2=0x7f30ac0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:31:46.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.360+0000 7f30b0abc700 1 -- 172.21.15.26:0/3850814533 shutdown_connections 2021-11-03T17:31:46.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.360+0000 7f30b0abc700 1 -- 172.21.15.26:0/3850814533 wait complete. 2021-11-03T17:31:46.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.361+0000 7f30b0abc700 1 Processor -- start 2021-11-03T17:31:46.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.361+0000 7f30b0abc700 1 -- start start 2021-11-03T17:31:46.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.361+0000 7f30b0abc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30ac0f5440 0x7f30ac109ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:31:46.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.361+0000 7f30b0abc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30ac0f66e0 0x7f30ac10bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:31:46.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.361+0000 7f30b0abc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac0603c0 con 0x7f30ac0f66e0 2021-11-03T17:31:46.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.361+0000 7f30b0abc700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac060500 con 0x7f30ac0f5440 2021-11-03T17:31:46.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.361+0000 7f30aaffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30ac0f66e0 0x7f30ac10bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:31:46.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.361+0000 7f30aaffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30ac0f66e0 0x7f30ac10bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54916/0 (socket says 172.21.15.26:54916) 2021-11-03T17:31:46.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.361+0000 7f30aaffd700 1 -- 172.21.15.26:0/2729246947 learned_addr learned my addr 172.21.15.26:0/2729246947 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:31:46.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.361+0000 7f30ab7fe700 1 --2- 172.21.15.26:0/2729246947 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30ac0f5440 0x7f30ac109ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:31:46.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.362+0000 7f30aaffd700 1 -- 172.21.15.26:0/2729246947 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30ac0f5440 msgr2=0x7f30ac109ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:31:46.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.362+0000 7f30aaffd700 1 --2- 172.21.15.26:0/2729246947 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30ac0f5440 0x7f30ac109ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:46.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.362+0000 7f30aaffd700 1 -- 172.21.15.26:0/2729246947 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a0005040 con 0x7f30ac0f66e0 2021-11-03T17:31:46.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.362+0000 7f30ab7fe700 1 --2- 172.21.15.26:0/2729246947 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30ac0f5440 0x7f30ac109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:31:46.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.362+0000 7f30aaffd700 1 --2- 172.21.15.26:0/2729246947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30ac0f66e0 0x7f30ac10bfb0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f30a0009990 tx=0x7f30a0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:31:46.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.362+0000 7f3093fff700 1 -- 172.21.15.26:0/2729246947 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30a0018070 con 0x7f30ac0f66e0 2021-11-03T17:31:46.363 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.362+0000 7f3093fff700 1 -- 172.21.15.26:0/2729246947 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f30a0007ba0 con 0x7f30ac0f66e0 2021-11-03T17:31:46.363 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.362+0000 7f30b0abc700 1 -- 172.21.15.26:0/2729246947 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30ac10c500 con 0x7f30ac0f66e0 2021-11-03T17:31:46.363 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.362+0000 7f3093fff700 1 -- 172.21.15.26:0/2729246947 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30a001c3c0 con 0x7f30ac0f66e0 2021-11-03T17:31:46.363 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.362+0000 7f30b0abc700 1 -- 172.21.15.26:0/2729246947 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30ac10ca30 con 0x7f30ac0f66e0 2021-11-03T17:31:46.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.363+0000 7f30b0abc700 1 -- 172.21.15.26:0/2729246947 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30ac059100 con 0x7f30ac0f66e0 2021-11-03T17:31:46.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.363+0000 7f3093fff700 1 -- 172.21.15.26:0/2729246947 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f30a001d420 con 0x7f30ac0f66e0 2021-11-03T17:31:46.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.364+0000 7f3093fff700 1 --2- 172.21.15.26:0/2729246947 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3094064100 0x7f30940665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:31:46.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.364+0000 7f3093fff700 1 -- 172.21.15.26:0/2729246947 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f30a00823d0 con 0x7f30ac0f66e0 2021-11-03T17:31:46.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.364+0000 7f30ab7fe700 1 --2- 172.21.15.26:0/2729246947 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3094064100 0x7f30940665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:31:46.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.364+0000 7f30ab7fe700 1 --2- 172.21.15.26:0/2729246947 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3094064100 0x7f30940665c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f30ac060040 tx=0x7f309c009c00).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:31:46.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.368+0000 7f3093fff700 1 -- 172.21.15.26:0/2729246947 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f30a0054790 con 0x7f30ac0f66e0 2021-11-03T17:31:46.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:46 smithi194 ceph-mon[65619]: pgmap v1113: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:46.538 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.543+0000 7f30b0abc700 1 -- 172.21.15.26:0/2729246947 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f30ac0fdd70 con 0x7f3094064100 2021-11-03T17:31:46.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.558+0000 7f3093fff700 1 -- 172.21.15.26:0/2729246947 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f30ac0fdd70 con 0x7f3094064100 2021-11-03T17:31:46.553 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:31:46.553 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (43m) 2m ago 44m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:31:46.553 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (35m) 2m ago 44m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:31:46.553 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (35m) 98s ago 43m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:31:46.554 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (42m) 2m ago 43m 40.3M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:31:46.554 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (35m) 2m ago 39m 22.6M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:31:46.554 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (36m) 2m ago 39m 23.5M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:31:46.555 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (39m) 98s ago 39m 24.8M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:31:46.555 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (39m) 98s ago 39m 25.0M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:31:46.555 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (36m) 2m ago 45m 520M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:31:46.555 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (36m) 98s ago 43m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:31:46.556 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (36m) 2m ago 45m 176M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:31:46.556 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (35m) 98s ago 43m 89.5M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:31:46.556 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (43m) 2m ago 43m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:31:46.556 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (43m) 98s ago 43m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:31:46.557 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (34m) 2m ago 42m 231M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:31:46.557 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (34m) 2m ago 42m 248M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:31:46.557 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (33m) 2m ago 41m 207M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:31:46.557 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (33m) 98s ago 41m 262M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:31:46.558 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (32m) 98s ago 41m 227M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:31:46.558 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (32m) 98s ago 40m 215M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:31:46.558 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (42m) 2m ago 43m 54.4M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:31:46.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.560+0000 7f30b0abc700 1 -- 172.21.15.26:0/2729246947 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3094064100 msgr2=0x7f30940665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:31:46.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.560+0000 7f30b0abc700 1 --2- 172.21.15.26:0/2729246947 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3094064100 0x7f30940665c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f30ac060040 tx=0x7f309c009c00).stop 2021-11-03T17:31:46.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.560+0000 7f30b0abc700 1 -- 172.21.15.26:0/2729246947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30ac0f66e0 msgr2=0x7f30ac10bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:31:46.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.560+0000 7f30b0abc700 1 --2- 172.21.15.26:0/2729246947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30ac0f66e0 0x7f30ac10bfb0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f30a0009990 tx=0x7f30a0009b30).stop 2021-11-03T17:31:46.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.560+0000 7f30b0abc700 1 -- 172.21.15.26:0/2729246947 shutdown_connections 2021-11-03T17:31:46.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.560+0000 7f30b0abc700 1 --2- 172.21.15.26:0/2729246947 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3094064100 0x7f30940665c0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:46.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.560+0000 7f30b0abc700 1 --2- 172.21.15.26:0/2729246947 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30ac0f5440 0x7f30ac109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:46.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.560+0000 7f30b0abc700 1 --2- 172.21.15.26:0/2729246947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30ac0f66e0 0x7f30ac10bfb0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:46.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.560+0000 7f30b0abc700 1 -- 172.21.15.26:0/2729246947 >> 172.21.15.26:0/2729246947 conn(0x7f30ac0f0ba0 msgr2=0x7f30ac0fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:31:46.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.560+0000 7f30b0abc700 1 -- 172.21.15.26:0/2729246947 shutdown_connections 2021-11-03T17:31:46.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.560+0000 7f30b0abc700 1 -- 172.21.15.26:0/2729246947 wait complete. 2021-11-03T17:31:46.655 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.659+0000 7f8e9804c700 1 -- 172.21.15.26:0/1307294363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e900f7980 msgr2=0x7f8e900f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:31:46.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.659+0000 7f8e9804c700 1 --2- 172.21.15.26:0/1307294363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e900f7980 0x7f8e900f7de0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7f8e84004660 tx=0x7f8e84009b30).stop 2021-11-03T17:31:46.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.659+0000 7f8e9804c700 1 -- 172.21.15.26:0/1307294363 shutdown_connections 2021-11-03T17:31:46.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.659+0000 7f8e9804c700 1 --2- 172.21.15.26:0/1307294363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e900f7980 0x7f8e900f7de0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:46.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.659+0000 7f8e9804c700 1 --2- 172.21.15.26:0/1307294363 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e900f66e0 0x7f8e900f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:46.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.659+0000 7f8e9804c700 1 -- 172.21.15.26:0/1307294363 >> 172.21.15.26:0/1307294363 conn(0x7f8e900f1e40 msgr2=0x7f8e900f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:31:46.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.659+0000 7f8e9804c700 1 -- 172.21.15.26:0/1307294363 shutdown_connections 2021-11-03T17:31:46.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.659+0000 7f8e9804c700 1 -- 172.21.15.26:0/1307294363 wait complete. 2021-11-03T17:31:46.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.659+0000 7f8e9804c700 1 Processor -- start 2021-11-03T17:31:46.658 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.660+0000 7f8e9804c700 1 -- start start 2021-11-03T17:31:46.658 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.660+0000 7f8e9804c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e900f66e0 0x7f8e90106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:31:46.658 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.660+0000 7f8e9804c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e900f7980 0x7f8e90107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:31:46.658 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.660+0000 7f8e9804c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e90107a00 con 0x7f8e900f66e0 2021-11-03T17:31:46.659 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.660+0000 7f8e9804c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e90107b40 con 0x7f8e900f7980 2021-11-03T17:31:46.659 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.660+0000 7f8e95de8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e900f66e0 0x7f8e90106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:31:46.659 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.660+0000 7f8e95de8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e900f66e0 0x7f8e90106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54924/0 (socket says 172.21.15.26:54924) 2021-11-03T17:31:46.659 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.660+0000 7f8e95de8700 1 -- 172.21.15.26:0/3568494670 learned_addr learned my addr 172.21.15.26:0/3568494670 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:31:46.660 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.660+0000 7f8e955e7700 1 --2- 172.21.15.26:0/3568494670 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e900f7980 0x7f8e90107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:31:46.660 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.660+0000 7f8e95de8700 1 -- 172.21.15.26:0/3568494670 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e900f7980 msgr2=0x7f8e90107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:31:46.660 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.660+0000 7f8e95de8700 1 --2- 172.21.15.26:0/3568494670 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e900f7980 0x7f8e90107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:46.660 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.660+0000 7f8e95de8700 1 -- 172.21.15.26:0/3568494670 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e84005040 con 0x7f8e900f66e0 2021-11-03T17:31:46.660 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.660+0000 7f8e95de8700 1 --2- 172.21.15.26:0/3568494670 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e900f66e0 0x7f8e90106f60 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f8e8800d7f0 tx=0x7f8e88004e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:31:46.661 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.660+0000 7f8e8e7fc700 1 -- 172.21.15.26:0/3568494670 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e8800b4f0 con 0x7f8e900f66e0 2021-11-03T17:31:46.661 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.660+0000 7f8e8e7fc700 1 -- 172.21.15.26:0/3568494670 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8e8800f040 con 0x7f8e900f66e0 2021-11-03T17:31:46.661 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.660+0000 7f8e9804c700 1 -- 172.21.15.26:0/3568494670 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e901084e0 con 0x7f8e900f66e0 2021-11-03T17:31:46.661 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.660+0000 7f8e8e7fc700 1 -- 172.21.15.26:0/3568494670 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e88013980 con 0x7f8e900f66e0 2021-11-03T17:31:46.662 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.661+0000 7f8e9804c700 1 -- 172.21.15.26:0/3568494670 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e90108aa0 con 0x7f8e900f66e0 2021-11-03T17:31:46.663 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.662+0000 7f8e8e7fc700 1 -- 172.21.15.26:0/3568494670 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f8e8801a030 con 0x7f8e900f66e0 2021-11-03T17:31:46.663 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.662+0000 7f8e9804c700 1 -- 172.21.15.26:0/3568494670 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e90045ad0 con 0x7f8e900f66e0 2021-11-03T17:31:46.664 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.662+0000 7f8e8e7fc700 1 --2- 172.21.15.26:0/3568494670 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8e780640b0 0x7f8e78066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:31:46.664 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.662+0000 7f8e8e7fc700 1 -- 172.21.15.26:0/3568494670 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f8e88080780 con 0x7f8e900f66e0 2021-11-03T17:31:46.664 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.662+0000 7f8e955e7700 1 --2- 172.21.15.26:0/3568494670 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8e780640b0 0x7f8e78066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:31:46.664 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.663+0000 7f8e955e7700 1 --2- 172.21.15.26:0/3568494670 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8e780640b0 0x7f8e78066570 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f8e84004630 tx=0x7f8e84009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:31:46.665 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.666+0000 7f8e8e7fc700 1 -- 172.21.15.26:0/3568494670 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f8e880529f0 con 0x7f8e900f66e0 2021-11-03T17:31:46.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:46 smithi026 ceph-mon[96795]: pgmap v1113: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:46.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.895+0000 7f8e9804c700 1 -- 172.21.15.26:0/3568494670 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8e900fef70 con 0x7f8e900f66e0 2021-11-03T17:31:46.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.896+0000 7f8e8e7fc700 1 -- 172.21.15.26:0/3568494670 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f8e880182e0 con 0x7f8e900f66e0 2021-11-03T17:31:46.891 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:31:46.892 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:31:46.892 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:31:46.892 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:31:46.892 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:31:46.893 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:31:46.893 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:31:46.893 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:31:46.893 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:31:46.894 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:31:46.894 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:31:46.894 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:31:46.894 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:31:46.894 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:31:46.895 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:31:46.895 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:31:46.895 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:31:46.895 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:31:46.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.898+0000 7f8e9804c700 1 -- 172.21.15.26:0/3568494670 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8e780640b0 msgr2=0x7f8e78066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:31:46.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.898+0000 7f8e9804c700 1 --2- 172.21.15.26:0/3568494670 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8e780640b0 0x7f8e78066570 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f8e84004630 tx=0x7f8e84009b30).stop 2021-11-03T17:31:46.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.898+0000 7f8e9804c700 1 -- 172.21.15.26:0/3568494670 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e900f66e0 msgr2=0x7f8e90106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:31:46.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.898+0000 7f8e9804c700 1 --2- 172.21.15.26:0/3568494670 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e900f66e0 0x7f8e90106f60 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f8e8800d7f0 tx=0x7f8e88004e80).stop 2021-11-03T17:31:46.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.898+0000 7f8e9804c700 1 -- 172.21.15.26:0/3568494670 shutdown_connections 2021-11-03T17:31:46.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.898+0000 7f8e9804c700 1 --2- 172.21.15.26:0/3568494670 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8e780640b0 0x7f8e78066570 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:46.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.898+0000 7f8e9804c700 1 --2- 172.21.15.26:0/3568494670 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e900f66e0 0x7f8e90106f60 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:46.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.898+0000 7f8e9804c700 1 --2- 172.21.15.26:0/3568494670 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e900f7980 0x7f8e90107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:46.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.898+0000 7f8e9804c700 1 -- 172.21.15.26:0/3568494670 >> 172.21.15.26:0/3568494670 conn(0x7f8e900f1e40 msgr2=0x7f8e900fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:31:46.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.898+0000 7f8e9804c700 1 -- 172.21.15.26:0/3568494670 shutdown_connections 2021-11-03T17:31:46.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.898+0000 7f8e9804c700 1 -- 172.21.15.26:0/3568494670 wait complete. 2021-11-03T17:31:46.994 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.998+0000 7f755992e700 1 -- 172.21.15.26:0/1033142611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75540f9830 msgr2=0x7f75540fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:31:46.994 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.998+0000 7f755992e700 1 --2- 172.21.15.26:0/1033142611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75540f9830 0x7f75540fbc80 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f7548004660 tx=0x7f7548009b30).stop 2021-11-03T17:31:46.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.998+0000 7f755992e700 1 -- 172.21.15.26:0/1033142611 shutdown_connections 2021-11-03T17:31:46.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.998+0000 7f755992e700 1 --2- 172.21.15.26:0/1033142611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75540f9830 0x7f75540fbc80 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:46.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.998+0000 7f755992e700 1 --2- 172.21.15.26:0/1033142611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7554060270 0x7f75540f9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:46.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.998+0000 7f755992e700 1 -- 172.21.15.26:0/1033142611 >> 172.21.15.26:0/1033142611 conn(0x7f75540f0d40 msgr2=0x7f75540f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:31:46.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.998+0000 7f755992e700 1 -- 172.21.15.26:0/1033142611 shutdown_connections 2021-11-03T17:31:46.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.998+0000 7f755992e700 1 -- 172.21.15.26:0/1033142611 wait complete. 2021-11-03T17:31:46.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.998+0000 7f755992e700 1 Processor -- start 2021-11-03T17:31:46.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.998+0000 7f755992e700 1 -- start start 2021-11-03T17:31:46.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.999+0000 7f755992e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7554060270 0x7f7554106f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:31:46.997 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.999+0000 7f755992e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75540f9830 0x7f7554107430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:31:46.997 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.999+0000 7f755992e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75541079e0 con 0x7f7554060270 2021-11-03T17:31:46.997 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.999+0000 7f755992e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7554107b20 con 0x7f75540f9830 2021-11-03T17:31:46.997 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.999+0000 7f7552ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7554060270 0x7f7554106f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:31:46.997 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.999+0000 7f7552ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7554060270 0x7f7554106f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54934/0 (socket says 172.21.15.26:54934) 2021-11-03T17:31:46.998 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.999+0000 7f7552ffd700 1 -- 172.21.15.26:0/266273053 learned_addr learned my addr 172.21.15.26:0/266273053 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:31:46.998 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.999+0000 7f75527fc700 1 --2- 172.21.15.26:0/266273053 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75540f9830 0x7f7554107430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:31:46.998 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.999+0000 7f7552ffd700 1 -- 172.21.15.26:0/266273053 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75540f9830 msgr2=0x7f7554107430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:31:46.998 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.999+0000 7f7552ffd700 1 --2- 172.21.15.26:0/266273053 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75540f9830 0x7f7554107430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:46.998 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.999+0000 7f7552ffd700 1 -- 172.21.15.26:0/266273053 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7548005040 con 0x7f7554060270 2021-11-03T17:31:46.999 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.999+0000 7f7552ffd700 1 --2- 172.21.15.26:0/266273053 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7554060270 0x7f7554106f40 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f754c007fd0 tx=0x7f754c004ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:31:46.999 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.999+0000 7f753b7fe700 1 -- 172.21.15.26:0/266273053 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f754c00b4f0 con 0x7f7554060270 2021-11-03T17:31:46.999 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.999+0000 7f755992e700 1 -- 172.21.15.26:0/266273053 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75541084c0 con 0x7f7554060270 2021-11-03T17:31:46.999 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.999+0000 7f753b7fe700 1 -- 172.21.15.26:0/266273053 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f754c00f040 con 0x7f7554060270 2021-11-03T17:31:47.000 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.999+0000 7f753b7fe700 1 -- 172.21.15.26:0/266273053 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f754c013a50 con 0x7f7554060270 2021-11-03T17:31:47.000 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:46.999+0000 7f755992e700 1 -- 172.21.15.26:0/266273053 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7554108a80 con 0x7f7554060270 2021-11-03T17:31:47.001 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:47.000+0000 7f755992e700 1 -- 172.21.15.26:0/266273053 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7554045ad0 con 0x7f7554060270 2021-11-03T17:31:47.001 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:47.001+0000 7f753b7fe700 1 -- 172.21.15.26:0/266273053 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f754c01a030 con 0x7f7554060270 2021-11-03T17:31:47.001 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:47.001+0000 7f753b7fe700 1 --2- 172.21.15.26:0/266273053 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f753c0640b0 0x7f753c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:31:47.001 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:47.001+0000 7f753b7fe700 1 -- 172.21.15.26:0/266273053 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f754c080710 con 0x7f7554060270 2021-11-03T17:31:47.002 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:47.001+0000 7f75527fc700 1 --2- 172.21.15.26:0/266273053 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f753c0640b0 0x7f753c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:31:47.002 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:47.002+0000 7f75527fc700 1 --2- 172.21.15.26:0/266273053 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f753c0640b0 0x7f753c066570 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f7548005010 tx=0x7f7548009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:31:47.002 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:47.005+0000 7f753b7fe700 1 -- 172.21.15.26:0/266273053 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f754c052af0 con 0x7f7554060270 2021-11-03T17:31:47.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:47.211+0000 7f755992e700 1 -- 172.21.15.26:0/266273053 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f75540ff010 con 0x7f7554060270 2021-11-03T17:31:47.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:47.211+0000 7f753b7fe700 1 -- 172.21.15.26:0/266273053 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f754c018020 con 0x7f7554060270 2021-11-03T17:31:47.208 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:31:47.209 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:31:47.209 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:31:47.209 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:31:47.210 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:31:47.210 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:31:47.210 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:31:47.210 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:31:47.211 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:31:47.211 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:31:47.211 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:31:47.211 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:31:47.212 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:31:47.212 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:31:47.212 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:31:47.212 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:31:47.213 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:31:47.213 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:31:47.213 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:31:47.213 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:31:47.214 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:31:47.214 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:31:47.214 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:31:47.214 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:31:47.215 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:31:47.215 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:31:47.215 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:31:47.216 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:31:47.216 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:31:47.216 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:31:47.216 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:31:47.216 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:31:47.217 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:31:47.217 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:31:47.217 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:31:47.217 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:31:47.218 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:31:47.218 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:31:47.218 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:31:47.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:47.213+0000 7f755992e700 1 -- 172.21.15.26:0/266273053 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f753c0640b0 msgr2=0x7f753c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:31:47.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:47.213+0000 7f755992e700 1 --2- 172.21.15.26:0/266273053 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f753c0640b0 0x7f753c066570 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f7548005010 tx=0x7f7548009b30).stop 2021-11-03T17:31:47.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:47.213+0000 7f755992e700 1 -- 172.21.15.26:0/266273053 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7554060270 msgr2=0x7f7554106f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:31:47.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:47.213+0000 7f755992e700 1 --2- 172.21.15.26:0/266273053 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7554060270 0x7f7554106f40 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f754c007fd0 tx=0x7f754c004ee0).stop 2021-11-03T17:31:47.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:47.213+0000 7f755992e700 1 -- 172.21.15.26:0/266273053 shutdown_connections 2021-11-03T17:31:47.221 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:47.213+0000 7f755992e700 1 --2- 172.21.15.26:0/266273053 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f753c0640b0 0x7f753c066570 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:47.221 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:47.213+0000 7f755992e700 1 --2- 172.21.15.26:0/266273053 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7554060270 0x7f7554106f40 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:47.221 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:47.213+0000 7f755992e700 1 --2- 172.21.15.26:0/266273053 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75540f9830 0x7f7554107430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:31:47.221 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:47.213+0000 7f755992e700 1 -- 172.21.15.26:0/266273053 >> 172.21.15.26:0/266273053 conn(0x7f75540f0d40 msgr2=0x7f75540f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:31:47.222 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:47.213+0000 7f755992e700 1 -- 172.21.15.26:0/266273053 shutdown_connections 2021-11-03T17:31:47.222 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:31:47.213+0000 7f755992e700 1 -- 172.21.15.26:0/266273053 wait complete. 2021-11-03T17:31:47.222 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:31:47.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:47 smithi194 ceph-mon[65619]: from='client.35292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:31:47.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:47 smithi194 ceph-mon[65619]: from='client.35296 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:31:47.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:47 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3568494670' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:31:47.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:47 smithi026 ceph-mon[96795]: from='client.35292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:31:47.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:47 smithi026 ceph-mon[96795]: from='client.35296 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:31:47.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:47 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3568494670' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:31:48.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:48 smithi194 ceph-mon[65619]: pgmap v1114: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:48.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:48 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/266273053' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:31:48.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:31:48.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:31:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:48 smithi026 ceph-mon[96795]: pgmap v1114: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:48 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/266273053' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:31:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:31:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:31:50.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:50 smithi194 ceph-mon[65619]: pgmap v1115: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:50.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:50 smithi026 ceph-mon[96795]: pgmap v1115: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:52.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:52 smithi194 ceph-mon[65619]: pgmap v1116: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:52.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:52 smithi026 ceph-mon[96795]: pgmap v1116: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:54.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:54 smithi194 ceph-mon[65619]: pgmap v1117: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:54.776 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:54 smithi026 ceph-mon[96795]: pgmap v1117: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:55.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:31:55.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:55 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:31:55.573 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:31:55.573 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:55 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:31:56.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:56 smithi194 ceph-mon[65619]: pgmap v1118: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:56.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:56 smithi026 ceph-mon[96795]: pgmap v1118: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:58.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:31:58 smithi194 ceph-mon[65619]: pgmap v1119: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:31:58.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:31:58 smithi026 ceph-mon[96795]: pgmap v1119: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:00.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:00 smithi194 ceph-mon[65619]: pgmap v1120: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:00.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:00 smithi026 ceph-mon[96795]: pgmap v1120: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:02.420 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:02 smithi026 ceph-mon[96795]: pgmap v1121: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:02.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:02 smithi194 ceph-mon[65619]: pgmap v1121: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:04.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:04 smithi194 ceph-mon[65619]: pgmap v1122: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:04.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:04 smithi026 ceph-mon[96795]: pgmap v1122: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:06.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:06 smithi194 ceph-mon[65619]: pgmap v1123: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:06.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:06 smithi026 ceph-mon[96795]: pgmap v1123: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:08.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:08 smithi194 ceph-mon[65619]: pgmap v1124: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:08.561 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:08 smithi026 ceph-mon[96795]: pgmap v1124: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:10.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:10 smithi194 ceph-mon[65619]: pgmap v1125: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:10.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:10 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:32:10.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:10 smithi194 ceph-mon[65619]: poll took 60054.617 ms: 1 events 2021-11-03T17:32:10.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:10 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:32:10.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:10 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:32:10.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:10 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:32:10.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:10 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:32:10.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:10 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:32:10.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:10 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:32:10.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:10 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:32:10.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:10 smithi026 ceph-mon[96795]: pgmap v1125: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:10.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:10 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:32:10.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:10 smithi026 ceph-mon[96795]: poll took 60054.617 ms: 1 events 2021-11-03T17:32:10.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:10 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:32:10.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:10 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:32:10.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:10 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:32:10.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:10 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:32:10.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:10 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:32:10.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:10 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:32:10.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:10 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:32:11.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:11 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:32:11.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:11 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:32:11.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:11 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:32:11.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:11 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:32:12.495 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:12 smithi194 ceph-mon[65619]: pgmap v1126: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:12.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:12 smithi026 ceph-mon[96795]: pgmap v1126: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:14.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:14 smithi194 ceph-mon[65619]: pgmap v1127: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:14.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:14 smithi026 ceph-mon[96795]: pgmap v1127: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:16.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:16 smithi194 ceph-mon[65619]: pgmap v1128: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:16.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:16 smithi026 ceph-mon[96795]: pgmap v1128: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:17.327 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.331+0000 7f3302246700 1 -- 172.21.15.26:0/3492421452 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32fc0f6ff0 msgr2=0x7f32fc0f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:32:17.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.331+0000 7f3302246700 1 --2- 172.21.15.26:0/3492421452 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32fc0f6ff0 0x7f32fc0f7a20 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f32e4004660 tx=0x7f32e4009b30).stop 2021-11-03T17:32:17.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.331+0000 7f3302246700 1 -- 172.21.15.26:0/3492421452 shutdown_connections 2021-11-03T17:32:17.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.331+0000 7f3302246700 1 --2- 172.21.15.26:0/3492421452 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32fc0f6ff0 0x7f32fc0f7a20 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:17.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.331+0000 7f3302246700 1 --2- 172.21.15.26:0/3492421452 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32fc0f66e0 0x7f32fc0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:17.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.331+0000 7f3302246700 1 -- 172.21.15.26:0/3492421452 >> 172.21.15.26:0/3492421452 conn(0x7f32fc0f1f00 msgr2=0x7f32fc0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:32:17.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.331+0000 7f3302246700 1 -- 172.21.15.26:0/3492421452 shutdown_connections 2021-11-03T17:32:17.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.331+0000 7f3302246700 1 -- 172.21.15.26:0/3492421452 wait complete. 2021-11-03T17:32:17.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.332+0000 7f3302246700 1 Processor -- start 2021-11-03T17:32:17.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.332+0000 7f3302246700 1 -- start start 2021-11-03T17:32:17.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.332+0000 7f3302246700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32fc0f66e0 0x7f32fc106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:32:17.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.332+0000 7f3302246700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32fc0f6ff0 0x7f32fc107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:32:17.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.332+0000 7f3302246700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc107a10 con 0x7f32fc0f6ff0 2021-11-03T17:32:17.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.332+0000 7f3302246700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc107b50 con 0x7f32fc0f66e0 2021-11-03T17:32:17.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.332+0000 7f32faffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32fc0f6ff0 0x7f32fc107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:32:17.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.332+0000 7f32faffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32fc0f6ff0 0x7f32fc107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54954/0 (socket says 172.21.15.26:54954) 2021-11-03T17:32:17.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.332+0000 7f32faffd700 1 -- 172.21.15.26:0/456318389 learned_addr learned my addr 172.21.15.26:0/456318389 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:32:17.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.333+0000 7f32fb7fe700 1 --2- 172.21.15.26:0/456318389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32fc0f66e0 0x7f32fc106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:32:17.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.333+0000 7f32faffd700 1 -- 172.21.15.26:0/456318389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32fc0f66e0 msgr2=0x7f32fc106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:32:17.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.333+0000 7f32faffd700 1 --2- 172.21.15.26:0/456318389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32fc0f66e0 0x7f32fc106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:17.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.333+0000 7f32faffd700 1 -- 172.21.15.26:0/456318389 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e4005040 con 0x7f32fc0f6ff0 2021-11-03T17:32:17.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.333+0000 7f32faffd700 1 --2- 172.21.15.26:0/456318389 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32fc0f6ff0 0x7f32fc107460 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f32e4009990 tx=0x7f32e4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:32:17.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.333+0000 7f32f3fff700 1 -- 172.21.15.26:0/456318389 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32e4018070 con 0x7f32fc0f6ff0 2021-11-03T17:32:17.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.333+0000 7f32f3fff700 1 -- 172.21.15.26:0/456318389 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f32e4007ba0 con 0x7f32fc0f6ff0 2021-11-03T17:32:17.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.333+0000 7f3302246700 1 -- 172.21.15.26:0/456318389 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32fc108490 con 0x7f32fc0f6ff0 2021-11-03T17:32:17.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.333+0000 7f32f3fff700 1 -- 172.21.15.26:0/456318389 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32e401c3c0 con 0x7f32fc0f6ff0 2021-11-03T17:32:17.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.333+0000 7f3302246700 1 -- 172.21.15.26:0/456318389 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32fc1089f0 con 0x7f32fc0f6ff0 2021-11-03T17:32:17.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.334+0000 7f3302246700 1 -- 172.21.15.26:0/456318389 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32fc045ad0 con 0x7f32fc0f6ff0 2021-11-03T17:32:17.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.335+0000 7f32f3fff700 1 -- 172.21.15.26:0/456318389 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f32e401d420 con 0x7f32fc0f6ff0 2021-11-03T17:32:17.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.335+0000 7f32f3fff700 1 --2- 172.21.15.26:0/456318389 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f32e80640b0 0x7f32e8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:32:17.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.335+0000 7f32f3fff700 1 -- 172.21.15.26:0/456318389 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f32e4082340 con 0x7f32fc0f6ff0 2021-11-03T17:32:17.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.335+0000 7f32fb7fe700 1 --2- 172.21.15.26:0/456318389 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f32e80640b0 0x7f32e8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:32:17.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.336+0000 7f32fb7fe700 1 --2- 172.21.15.26:0/456318389 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f32e80640b0 0x7f32e8066570 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f32f4007db0 tx=0x7f32f4009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:32:17.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.340+0000 7f32f3fff700 1 -- 172.21.15.26:0/456318389 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f32e4054760 con 0x7f32fc0f6ff0 2021-11-03T17:32:17.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.516+0000 7f3302246700 1 -- 172.21.15.26:0/456318389 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f32fc0ff040 con 0x7f32e80640b0 2021-11-03T17:32:17.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.518+0000 7f32f3fff700 1 -- 172.21.15.26:0/456318389 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f32fc0ff040 con 0x7f32e80640b0 2021-11-03T17:32:17.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.520+0000 7f3302246700 1 -- 172.21.15.26:0/456318389 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f32e80640b0 msgr2=0x7f32e8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:32:17.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.520+0000 7f3302246700 1 --2- 172.21.15.26:0/456318389 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f32e80640b0 0x7f32e8066570 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f32f4007db0 tx=0x7f32f4009040).stop 2021-11-03T17:32:17.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.520+0000 7f3302246700 1 -- 172.21.15.26:0/456318389 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32fc0f6ff0 msgr2=0x7f32fc107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:32:17.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.520+0000 7f3302246700 1 --2- 172.21.15.26:0/456318389 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32fc0f6ff0 0x7f32fc107460 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f32e4009990 tx=0x7f32e4009b30).stop 2021-11-03T17:32:17.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.520+0000 7f3302246700 1 -- 172.21.15.26:0/456318389 shutdown_connections 2021-11-03T17:32:17.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.520+0000 7f3302246700 1 --2- 172.21.15.26:0/456318389 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f32e80640b0 0x7f32e8066570 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:17.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.520+0000 7f3302246700 1 --2- 172.21.15.26:0/456318389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32fc0f66e0 0x7f32fc106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:17.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.520+0000 7f3302246700 1 --2- 172.21.15.26:0/456318389 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32fc0f6ff0 0x7f32fc107460 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:17.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.520+0000 7f3302246700 1 -- 172.21.15.26:0/456318389 >> 172.21.15.26:0/456318389 conn(0x7f32fc0f1f00 msgr2=0x7f32fc0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:32:17.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.520+0000 7f3302246700 1 -- 172.21.15.26:0/456318389 shutdown_connections 2021-11-03T17:32:17.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.520+0000 7f3302246700 1 -- 172.21.15.26:0/456318389 wait complete. 2021-11-03T17:32:17.523 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:32:17.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.620+0000 7ff446b29700 1 -- 172.21.15.26:0/1604736058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4400f66e0 msgr2=0x7ff4400f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:32:17.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.620+0000 7ff446b29700 1 --2- 172.21.15.26:0/1604736058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4400f66e0 0x7ff4400f6b00 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7ff438004660 tx=0x7ff438009b30).stop 2021-11-03T17:32:17.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.620+0000 7ff446b29700 1 -- 172.21.15.26:0/1604736058 shutdown_connections 2021-11-03T17:32:17.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.620+0000 7ff446b29700 1 --2- 172.21.15.26:0/1604736058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4400f6ff0 0x7ff4400f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:17.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.620+0000 7ff446b29700 1 --2- 172.21.15.26:0/1604736058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4400f66e0 0x7ff4400f6b00 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:17.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.620+0000 7ff446b29700 1 -- 172.21.15.26:0/1604736058 >> 172.21.15.26:0/1604736058 conn(0x7ff4400f1f00 msgr2=0x7ff4400f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:32:17.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.620+0000 7ff446b29700 1 -- 172.21.15.26:0/1604736058 shutdown_connections 2021-11-03T17:32:17.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.620+0000 7ff446b29700 1 -- 172.21.15.26:0/1604736058 wait complete. 2021-11-03T17:32:17.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.620+0000 7ff446b29700 1 Processor -- start 2021-11-03T17:32:17.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.620+0000 7ff446b29700 1 -- start start 2021-11-03T17:32:17.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.621+0000 7ff446b29700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4400f66e0 0x7ff44006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:32:17.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.621+0000 7ff446b29700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4400f6ff0 0x7ff440069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:32:17.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.621+0000 7ff446b29700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44006a380 con 0x7ff4400f6ff0 2021-11-03T17:32:17.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.621+0000 7ff446b29700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44006a4c0 con 0x7ff4400f66e0 2021-11-03T17:32:17.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.621+0000 7ff43ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4400f6ff0 0x7ff440069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:32:17.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.621+0000 7ff43ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4400f6ff0 0x7ff440069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54964/0 (socket says 172.21.15.26:54964) 2021-11-03T17:32:17.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.621+0000 7ff43ffff700 1 -- 172.21.15.26:0/1737309336 learned_addr learned my addr 172.21.15.26:0/1737309336 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:32:17.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.621+0000 7ff4448c5700 1 --2- 172.21.15.26:0/1737309336 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4400f66e0 0x7ff44006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:32:17.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.621+0000 7ff43ffff700 1 -- 172.21.15.26:0/1737309336 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4400f66e0 msgr2=0x7ff44006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:32:17.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.621+0000 7ff43ffff700 1 --2- 172.21.15.26:0/1737309336 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4400f66e0 0x7ff44006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:17.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.621+0000 7ff43ffff700 1 -- 172.21.15.26:0/1737309336 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff438005040 con 0x7ff4400f6ff0 2021-11-03T17:32:17.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.621+0000 7ff43ffff700 1 --2- 172.21.15.26:0/1737309336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4400f6ff0 0x7ff440069e20 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7ff43000c760 tx=0x7ff430004d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:32:17.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.621+0000 7ff43d7fa700 1 -- 172.21.15.26:0/1737309336 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff430004200 con 0x7ff4400f6ff0 2021-11-03T17:32:17.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.622+0000 7ff43d7fa700 1 -- 172.21.15.26:0/1737309336 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff4300109c0 con 0x7ff4400f6ff0 2021-11-03T17:32:17.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.622+0000 7ff446b29700 1 -- 172.21.15.26:0/1737309336 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff44006a7a0 con 0x7ff4400f6ff0 2021-11-03T17:32:17.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.622+0000 7ff43d7fa700 1 -- 172.21.15.26:0/1737309336 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff430003920 con 0x7ff4400f6ff0 2021-11-03T17:32:17.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.622+0000 7ff446b29700 1 -- 172.21.15.26:0/1737309336 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff44010ef90 con 0x7ff4400f6ff0 2021-11-03T17:32:17.623 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.623+0000 7ff446b29700 1 -- 172.21.15.26:0/1737309336 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff440045ad0 con 0x7ff4400f6ff0 2021-11-03T17:32:17.623 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.623+0000 7ff43d7fa700 1 -- 172.21.15.26:0/1737309336 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ff430018020 con 0x7ff4400f6ff0 2021-11-03T17:32:17.623 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.623+0000 7ff43d7fa700 1 --2- 172.21.15.26:0/1737309336 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff42c0640b0 0x7ff42c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:32:17.623 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.624+0000 7ff43d7fa700 1 -- 172.21.15.26:0/1737309336 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ff430080790 con 0x7ff4400f6ff0 2021-11-03T17:32:17.624 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.624+0000 7ff4448c5700 1 --2- 172.21.15.26:0/1737309336 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff42c0640b0 0x7ff42c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:32:17.624 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.624+0000 7ff4448c5700 1 --2- 172.21.15.26:0/1737309336 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff42c0640b0 0x7ff42c066570 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7ff438004e30 tx=0x7ff438009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:32:17.624 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.628+0000 7ff43d7fa700 1 -- 172.21.15.26:0/1737309336 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ff430052a00 con 0x7ff4400f6ff0 2021-11-03T17:32:17.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.800+0000 7ff446b29700 1 -- 172.21.15.26:0/1737309336 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4400ff040 con 0x7ff42c0640b0 2021-11-03T17:32:17.808 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.815+0000 7ff43d7fa700 1 -- 172.21.15.26:0/1737309336 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7ff4400ff040 con 0x7ff42c0640b0 2021-11-03T17:32:17.809 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:32:17.809 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (43m) 3m ago 44m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:32:17.809 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (35m) 3m ago 44m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:32:17.809 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (35m) 2m ago 44m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:32:17.810 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (43m) 3m ago 44m 40.3M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:32:17.810 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (36m) 3m ago 39m 22.6M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:32:17.810 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (36m) 3m ago 39m 23.5M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:32:17.810 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (39m) 2m ago 39m 24.8M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:32:17.811 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (39m) 2m ago 39m 25.0M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:32:17.811 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (37m) 3m ago 46m 520M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:32:17.811 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (36m) 2m ago 43m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:32:17.811 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (36m) 3m ago 46m 176M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:32:17.811 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (36m) 2m ago 43m 89.5M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:32:17.812 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (44m) 3m ago 44m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:32:17.812 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (43m) 2m ago 43m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:32:17.812 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (35m) 3m ago 43m 231M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:32:17.812 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (34m) 3m ago 42m 248M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:32:17.813 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (34m) 3m ago 42m 207M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:32:17.813 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (33m) 2m ago 42m 262M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:32:17.813 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (33m) 2m ago 41m 227M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:32:17.813 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (32m) 2m ago 41m 215M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:32:17.813 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (43m) 3m ago 44m 54.4M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:32:17.814 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.817+0000 7ff446b29700 1 -- 172.21.15.26:0/1737309336 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff42c0640b0 msgr2=0x7ff42c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:32:17.815 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.817+0000 7ff446b29700 1 --2- 172.21.15.26:0/1737309336 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff42c0640b0 0x7ff42c066570 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7ff438004e30 tx=0x7ff438009b30).stop 2021-11-03T17:32:17.815 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.817+0000 7ff446b29700 1 -- 172.21.15.26:0/1737309336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4400f6ff0 msgr2=0x7ff440069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:32:17.815 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.817+0000 7ff446b29700 1 --2- 172.21.15.26:0/1737309336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4400f6ff0 0x7ff440069e20 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7ff43000c760 tx=0x7ff430004d20).stop 2021-11-03T17:32:17.815 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.817+0000 7ff446b29700 1 -- 172.21.15.26:0/1737309336 shutdown_connections 2021-11-03T17:32:17.816 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.817+0000 7ff446b29700 1 --2- 172.21.15.26:0/1737309336 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff42c0640b0 0x7ff42c066570 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:17.816 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.817+0000 7ff446b29700 1 --2- 172.21.15.26:0/1737309336 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4400f66e0 0x7ff44006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:17.816 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.817+0000 7ff446b29700 1 --2- 172.21.15.26:0/1737309336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4400f6ff0 0x7ff440069e20 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:17.816 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.817+0000 7ff446b29700 1 -- 172.21.15.26:0/1737309336 >> 172.21.15.26:0/1737309336 conn(0x7ff4400f1f00 msgr2=0x7ff4400fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:32:17.817 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.817+0000 7ff446b29700 1 -- 172.21.15.26:0/1737309336 shutdown_connections 2021-11-03T17:32:17.817 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.817+0000 7ff446b29700 1 -- 172.21.15.26:0/1737309336 wait complete. 2021-11-03T17:32:17.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.916+0000 7fcb0ae17700 1 -- 172.21.15.26:0/983548383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb040f6530 msgr2=0x7fcb040f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:32:17.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.916+0000 7fcb0ae17700 1 --2- 172.21.15.26:0/983548383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb040f6530 0x7fcb040f6950 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7fcb00004660 tx=0x7fcb00009b30).stop 2021-11-03T17:32:17.913 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.916+0000 7fcb0ae17700 1 -- 172.21.15.26:0/983548383 shutdown_connections 2021-11-03T17:32:17.913 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.916+0000 7fcb0ae17700 1 --2- 172.21.15.26:0/983548383 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb040f77d0 0x7fcb040f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:32:17.913 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.916+0000 7fcb0ae17700 1 --2- 172.21.15.26:0/983548383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb040f6530 0x7fcb040f6950 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:17.913 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.916+0000 7fcb0ae17700 1 -- 172.21.15.26:0/983548383 >> 172.21.15.26:0/983548383 conn(0x7fcb040f1cd0 msgr2=0x7fcb040f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:32:17.914 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.917+0000 7fcb0ae17700 1 -- 172.21.15.26:0/983548383 shutdown_connections 2021-11-03T17:32:17.914 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.917+0000 7fcb0ae17700 1 -- 172.21.15.26:0/983548383 wait complete. 2021-11-03T17:32:17.914 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.917+0000 7fcb0ae17700 1 Processor -- start 2021-11-03T17:32:17.914 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.917+0000 7fcb0ae17700 1 -- start start 2021-11-03T17:32:17.915 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.917+0000 7fcb0ae17700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb040f6530 0x7fcb0406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:32:17.915 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.917+0000 7fcb0ae17700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb040f77d0 0x7fcb04069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:32:17.915 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.917+0000 7fcb0ae17700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0406a410 con 0x7fcb040f6530 2021-11-03T17:32:17.915 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.917+0000 7fcb0ae17700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0406a550 con 0x7fcb040f77d0 2021-11-03T17:32:17.916 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.917+0000 7fcb09e15700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb040f6530 0x7fcb0406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:32:17.916 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.917+0000 7fcb09e15700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb040f6530 0x7fcb0406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54972/0 (socket says 172.21.15.26:54972) 2021-11-03T17:32:17.916 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.917+0000 7fcb09e15700 1 -- 172.21.15.26:0/1914008168 learned_addr learned my addr 172.21.15.26:0/1914008168 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:32:17.916 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.917+0000 7fcb09614700 1 --2- 172.21.15.26:0/1914008168 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb040f77d0 0x7fcb04069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:32:17.916 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.918+0000 7fcb09e15700 1 -- 172.21.15.26:0/1914008168 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb040f77d0 msgr2=0x7fcb04069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:32:17.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.918+0000 7fcb09e15700 1 --2- 172.21.15.26:0/1914008168 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb040f77d0 0x7fcb04069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:17.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.918+0000 7fcb09e15700 1 -- 172.21.15.26:0/1914008168 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb00005040 con 0x7fcb040f6530 2021-11-03T17:32:17.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.918+0000 7fcb09614700 1 --2- 172.21.15.26:0/1914008168 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb040f77d0 0x7fcb04069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:32:17.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.918+0000 7fcb09e15700 1 --2- 172.21.15.26:0/1914008168 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb040f6530 0x7fcb0406b9a0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7fcb00004f60 tx=0x7fcb00009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:32:17.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.918+0000 7fcafa7fc700 1 -- 172.21.15.26:0/1914008168 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb00018070 con 0x7fcb040f6530 2021-11-03T17:32:17.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.918+0000 7fcafa7fc700 1 -- 172.21.15.26:0/1914008168 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcb00007ba0 con 0x7fcb040f6530 2021-11-03T17:32:17.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.918+0000 7fcb0ae17700 1 -- 172.21.15.26:0/1914008168 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb0406a7d0 con 0x7fcb040f6530 2021-11-03T17:32:17.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.918+0000 7fcafa7fc700 1 -- 172.21.15.26:0/1914008168 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb0001c620 con 0x7fcb040f6530 2021-11-03T17:32:17.919 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.918+0000 7fcb0ae17700 1 -- 172.21.15.26:0/1914008168 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb0410ed80 con 0x7fcb040f6530 2021-11-03T17:32:17.920 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.919+0000 7fcb0ae17700 1 -- 172.21.15.26:0/1914008168 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb04045ad0 con 0x7fcb040f6530 2021-11-03T17:32:17.920 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.919+0000 7fcafa7fc700 1 -- 172.21.15.26:0/1914008168 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fcb0001c8e0 con 0x7fcb040f6530 2021-11-03T17:32:17.921 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.920+0000 7fcafa7fc700 1 --2- 172.21.15.26:0/1914008168 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcaf0064100 0x7fcaf00665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:32:17.921 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.920+0000 7fcafa7fc700 1 -- 172.21.15.26:0/1914008168 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fcb000826e0 con 0x7fcb040f6530 2021-11-03T17:32:17.921 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.920+0000 7fcb09614700 1 --2- 172.21.15.26:0/1914008168 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcaf0064100 0x7fcaf00665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:32:17.922 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.920+0000 7fcb09614700 1 --2- 172.21.15.26:0/1914008168 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcaf0064100 0x7fcaf00665c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7fcaf400a880 tx=0x7fcaf4008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:32:17.922 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:17.924+0000 7fcafa7fc700 1 -- 172.21.15.26:0/1914008168 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fcb00054a40 con 0x7fcb040f6530 2021-11-03T17:32:18.149 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.155+0000 7fcb0ae17700 1 -- 172.21.15.26:0/1914008168 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcb040fee40 con 0x7fcb040f6530 2021-11-03T17:32:18.149 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.156+0000 7fcafa7fc700 1 -- 172.21.15.26:0/1914008168 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fcb00054630 con 0x7fcb040f6530 2021-11-03T17:32:18.150 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:32:18.150 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:32:18.150 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:32:18.151 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:32:18.151 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:32:18.151 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:32:18.152 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:32:18.152 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:32:18.152 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:32:18.152 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:32:18.152 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:32:18.153 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:32:18.153 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:32:18.153 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:32:18.153 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:32:18.154 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:32:18.154 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:32:18.154 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:32:18.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.157+0000 7fcb0ae17700 1 -- 172.21.15.26:0/1914008168 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcaf0064100 msgr2=0x7fcaf00665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:32:18.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.157+0000 7fcb0ae17700 1 --2- 172.21.15.26:0/1914008168 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcaf0064100 0x7fcaf00665c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7fcaf400a880 tx=0x7fcaf4008040).stop 2021-11-03T17:32:18.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.157+0000 7fcb0ae17700 1 -- 172.21.15.26:0/1914008168 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb040f6530 msgr2=0x7fcb0406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:32:18.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.157+0000 7fcb0ae17700 1 --2- 172.21.15.26:0/1914008168 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb040f6530 0x7fcb0406b9a0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7fcb00004f60 tx=0x7fcb00009b30).stop 2021-11-03T17:32:18.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.157+0000 7fcb0ae17700 1 -- 172.21.15.26:0/1914008168 shutdown_connections 2021-11-03T17:32:18.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.157+0000 7fcb0ae17700 1 --2- 172.21.15.26:0/1914008168 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcaf0064100 0x7fcaf00665c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:18.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.157+0000 7fcb0ae17700 1 --2- 172.21.15.26:0/1914008168 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb040f6530 0x7fcb0406b9a0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:18.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.157+0000 7fcb0ae17700 1 --2- 172.21.15.26:0/1914008168 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb040f77d0 0x7fcb04069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:18.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.157+0000 7fcb0ae17700 1 -- 172.21.15.26:0/1914008168 >> 172.21.15.26:0/1914008168 conn(0x7fcb040f1cd0 msgr2=0x7fcb040fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:32:18.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.157+0000 7fcb0ae17700 1 -- 172.21.15.26:0/1914008168 shutdown_connections 2021-11-03T17:32:18.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.157+0000 7fcb0ae17700 1 -- 172.21.15.26:0/1914008168 wait complete. 2021-11-03T17:32:18.251 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.257+0000 7facae016700 1 -- 172.21.15.26:0/3887507126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faca80f7980 msgr2=0x7faca80f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:32:18.251 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.257+0000 7facae016700 1 --2- 172.21.15.26:0/3887507126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faca80f7980 0x7faca80f7de0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7fac9c004660 tx=0x7fac9c009b30).stop 2021-11-03T17:32:18.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.257+0000 7facae016700 1 -- 172.21.15.26:0/3887507126 shutdown_connections 2021-11-03T17:32:18.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.257+0000 7facae016700 1 --2- 172.21.15.26:0/3887507126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faca80f7980 0x7faca80f7de0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:18.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.257+0000 7facae016700 1 --2- 172.21.15.26:0/3887507126 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faca80f66e0 0x7faca80f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:32:18.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.257+0000 7facae016700 1 -- 172.21.15.26:0/3887507126 >> 172.21.15.26:0/3887507126 conn(0x7faca80f1e40 msgr2=0x7faca80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:32:18.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.257+0000 7facae016700 1 -- 172.21.15.26:0/3887507126 shutdown_connections 2021-11-03T17:32:18.253 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.257+0000 7facae016700 1 -- 172.21.15.26:0/3887507126 wait complete. 2021-11-03T17:32:18.253 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.258+0000 7facae016700 1 Processor -- start 2021-11-03T17:32:18.255 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.258+0000 7facae016700 1 -- start start 2021-11-03T17:32:18.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.258+0000 7facae016700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faca80f66e0 0x7faca8106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:32:18.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.258+0000 7facae016700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faca80f7980 0x7faca81074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:32:18.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.258+0000 7facae016700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca8107ae0 con 0x7faca80f7980 2021-11-03T17:32:18.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.258+0000 7facae016700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca8108390 con 0x7faca80f66e0 2021-11-03T17:32:18.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.258+0000 7faca6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faca80f7980 0x7faca81074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:32:18.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.258+0000 7faca6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faca80f7980 0x7faca81074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54984/0 (socket says 172.21.15.26:54984) 2021-11-03T17:32:18.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.258+0000 7faca6ffd700 1 -- 172.21.15.26:0/2598244045 learned_addr learned my addr 172.21.15.26:0/2598244045 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:32:18.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.258+0000 7faca6ffd700 1 -- 172.21.15.26:0/2598244045 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faca80f66e0 msgr2=0x7faca8106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:32:18.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.258+0000 7faca77fe700 1 --2- 172.21.15.26:0/2598244045 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faca80f66e0 0x7faca8106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:32:18.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.258+0000 7faca6ffd700 1 --2- 172.21.15.26:0/2598244045 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faca80f66e0 0x7faca8106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:18.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.258+0000 7faca6ffd700 1 -- 172.21.15.26:0/2598244045 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9c005040 con 0x7faca80f7980 2021-11-03T17:32:18.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.258+0000 7faca77fe700 1 --2- 172.21.15.26:0/2598244045 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faca80f66e0 0x7faca8106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:32:18.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.259+0000 7faca6ffd700 1 --2- 172.21.15.26:0/2598244045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faca80f7980 0x7faca81074a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7fac9c009990 tx=0x7fac9c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:32:18.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.259+0000 7fac8ffff700 1 -- 172.21.15.26:0/2598244045 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac9c018070 con 0x7faca80f7980 2021-11-03T17:32:18.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.259+0000 7fac8ffff700 1 -- 172.21.15.26:0/2598244045 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fac9c007ca0 con 0x7faca80f7980 2021-11-03T17:32:18.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.259+0000 7fac8ffff700 1 -- 172.21.15.26:0/2598244045 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac9c01c620 con 0x7faca80f7980 2021-11-03T17:32:18.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.259+0000 7facae016700 1 -- 172.21.15.26:0/2598244045 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faca8108610 con 0x7faca80f7980 2021-11-03T17:32:18.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.259+0000 7facae016700 1 -- 172.21.15.26:0/2598244045 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faca8108b70 con 0x7faca80f7980 2021-11-03T17:32:18.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.260+0000 7facae016700 1 -- 172.21.15.26:0/2598244045 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faca80f5ad0 con 0x7faca80f7980 2021-11-03T17:32:18.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.260+0000 7fac8ffff700 1 -- 172.21.15.26:0/2598244045 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fac9c01d960 con 0x7faca80f7980 2021-11-03T17:32:18.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.261+0000 7fac8ffff700 1 --2- 172.21.15.26:0/2598244045 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fac900640b0 0x7fac90066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:32:18.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.261+0000 7fac8ffff700 1 -- 172.21.15.26:0/2598244045 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fac9c082600 con 0x7faca80f7980 2021-11-03T17:32:18.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.261+0000 7faca77fe700 1 --2- 172.21.15.26:0/2598244045 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fac900640b0 0x7fac90066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:32:18.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.261+0000 7faca77fe700 1 --2- 172.21.15.26:0/2598244045 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fac900640b0 0x7fac90066570 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7faca80f77e0 tx=0x7fac98008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:32:18.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.265+0000 7fac8ffff700 1 -- 172.21.15.26:0/2598244045 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fac9c054960 con 0x7faca80f7980 2021-11-03T17:32:18.464 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.470+0000 7facae016700 1 -- 172.21.15.26:0/2598244045 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7faca80008d0 con 0x7faca80f7980 2021-11-03T17:32:18.464 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.470+0000 7fac8ffff700 1 -- 172.21.15.26:0/2598244045 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fac9c054550 con 0x7faca80f7980 2021-11-03T17:32:18.464 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:32:18.465 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:32:18.465 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:32:18.465 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:32:18.465 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:32:18.465 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:32:18.466 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:32:18.466 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:32:18.466 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:32:18.466 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:32:18.467 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:32:18.467 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:32:18.467 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:32:18.467 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:32:18.467 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:32:18.468 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:32:18.468 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:32:18.468 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:32:18.468 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:32:18.469 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:32:18.469 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:32:18.469 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:32:18.469 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:32:18.470 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:32:18.470 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:32:18.470 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:32:18.470 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:32:18.470 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:32:18.471 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:32:18.471 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:32:18.471 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:32:18.472 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:32:18.472 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:32:18.472 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:32:18.472 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:32:18.473 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:32:18.473 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:32:18.473 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:32:18.473 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:32:18.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.472+0000 7facae016700 1 -- 172.21.15.26:0/2598244045 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fac900640b0 msgr2=0x7fac90066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:32:18.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.472+0000 7facae016700 1 --2- 172.21.15.26:0/2598244045 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fac900640b0 0x7fac90066570 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7faca80f77e0 tx=0x7fac98008040).stop 2021-11-03T17:32:18.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.472+0000 7facae016700 1 -- 172.21.15.26:0/2598244045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faca80f7980 msgr2=0x7faca81074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:32:18.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.472+0000 7facae016700 1 --2- 172.21.15.26:0/2598244045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faca80f7980 0x7faca81074a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7fac9c009990 tx=0x7fac9c009b30).stop 2021-11-03T17:32:18.476 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.472+0000 7facae016700 1 -- 172.21.15.26:0/2598244045 shutdown_connections 2021-11-03T17:32:18.476 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.472+0000 7facae016700 1 --2- 172.21.15.26:0/2598244045 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fac900640b0 0x7fac90066570 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:18.476 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.472+0000 7facae016700 1 --2- 172.21.15.26:0/2598244045 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faca80f66e0 0x7faca8106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:18.476 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.472+0000 7facae016700 1 --2- 172.21.15.26:0/2598244045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faca80f7980 0x7faca81074a0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:18.477 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.472+0000 7facae016700 1 -- 172.21.15.26:0/2598244045 >> 172.21.15.26:0/2598244045 conn(0x7faca80f1e40 msgr2=0x7faca80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:32:18.477 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.472+0000 7facae016700 1 -- 172.21.15.26:0/2598244045 shutdown_connections 2021-11-03T17:32:18.477 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:18.472+0000 7facae016700 1 -- 172.21.15.26:0/2598244045 wait complete. 2021-11-03T17:32:18.478 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:32:18.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:18 smithi194 ceph-mon[65619]: pgmap v1129: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:18.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:18 smithi194 ceph-mon[65619]: from='client.35308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:32:18.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:18 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1914008168' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:32:18.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:18 smithi026 ceph-mon[96795]: pgmap v1129: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:18.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:18 smithi026 ceph-mon[96795]: from='client.35308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:32:18.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:18 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1914008168' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:32:19.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:19 smithi194 ceph-mon[65619]: from='client.35312 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:32:19.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:19 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2598244045' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:32:19.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:19 smithi026 ceph-mon[96795]: from='client.35312 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:32:19.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:19 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2598244045' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:32:20.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:20 smithi194 ceph-mon[65619]: pgmap v1130: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:20.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:20 smithi026 ceph-mon[96795]: pgmap v1130: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:22.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:22 smithi026 ceph-mon[96795]: pgmap v1131: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:22.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:22 smithi194 ceph-mon[65619]: pgmap v1131: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:24.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:24 smithi026 ceph-mon[96795]: pgmap v1132: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:24.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:24 smithi194 ceph-mon[65619]: pgmap v1132: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:25.573 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:32:25.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:32:26.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:26 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:32:26.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:26 smithi026 ceph-mon[96795]: pgmap v1133: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:26.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:26 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:32:26.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:26 smithi194 ceph-mon[65619]: pgmap v1133: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:28.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:28 smithi026 ceph-mon[96795]: pgmap v1134: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:28.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:28 smithi194 ceph-mon[65619]: pgmap v1134: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:30.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:30 smithi026 ceph-mon[96795]: pgmap v1135: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:30.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:30 smithi194 ceph-mon[65619]: pgmap v1135: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:32.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:32 smithi026 ceph-mon[96795]: pgmap v1136: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:32.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:32 smithi194 ceph-mon[65619]: pgmap v1136: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:34.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:34 smithi026 ceph-mon[96795]: pgmap v1137: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:34.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:34 smithi194 ceph-mon[65619]: pgmap v1137: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:36.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:36 smithi026 ceph-mon[96795]: pgmap v1138: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:36.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:36 smithi194 ceph-mon[65619]: pgmap v1138: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:38.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:38 smithi026 ceph-mon[96795]: pgmap v1139: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:38.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:38 smithi194 ceph-mon[65619]: pgmap v1139: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:40.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:40 smithi026 ceph-mon[96795]: pgmap v1140: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:40.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:32:40.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:40 smithi194 ceph-mon[65619]: pgmap v1140: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:40.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:32:41.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:41 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:32:41.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:41 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:32:42.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:42 smithi026 ceph-mon[96795]: pgmap v1141: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:42.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:42 smithi194 ceph-mon[65619]: pgmap v1141: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:44.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:44 smithi026 ceph-mon[96795]: pgmap v1142: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:44.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:44 smithi194 ceph-mon[65619]: pgmap v1142: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:46.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:46 smithi026 ceph-mon[96795]: pgmap v1143: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:46.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:46 smithi194 ceph-mon[65619]: pgmap v1143: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:48.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.585+0000 7f26386ca700 1 -- 172.21.15.26:0/622855219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26300f66e0 msgr2=0x7f26300f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:32:48.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.585+0000 7f26386ca700 1 --2- 172.21.15.26:0/622855219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26300f66e0 0x7f26300f6b00 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f2620004660 tx=0x7f2620009b30).stop 2021-11-03T17:32:48.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.585+0000 7f26386ca700 1 -- 172.21.15.26:0/622855219 shutdown_connections 2021-11-03T17:32:48.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.586+0000 7f26386ca700 1 --2- 172.21.15.26:0/622855219 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26300f6ff0 0x7f26300f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:32:48.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.586+0000 7f26386ca700 1 --2- 172.21.15.26:0/622855219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26300f66e0 0x7f26300f6b00 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:48.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.586+0000 7f26386ca700 1 -- 172.21.15.26:0/622855219 >> 172.21.15.26:0/622855219 conn(0x7f26300f1f00 msgr2=0x7f26300f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:32:48.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.586+0000 7f26386ca700 1 -- 172.21.15.26:0/622855219 shutdown_connections 2021-11-03T17:32:48.584 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.586+0000 7f26386ca700 1 -- 172.21.15.26:0/622855219 wait complete. 2021-11-03T17:32:48.584 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.586+0000 7f26386ca700 1 Processor -- start 2021-11-03T17:32:48.584 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.586+0000 7f26386ca700 1 -- start start 2021-11-03T17:32:48.584 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.586+0000 7f26386ca700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26300f66e0 0x7f2630106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:32:48.585 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.586+0000 7f26386ca700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26300f6ff0 0x7f2630107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:32:48.585 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.586+0000 7f26386ca700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2630107ab0 con 0x7f26300f6ff0 2021-11-03T17:32:48.585 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.586+0000 7f26386ca700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2630108360 con 0x7f26300f66e0 2021-11-03T17:32:48.586 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.587+0000 7f2635c65700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26300f6ff0 0x7f2630107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:32:48.586 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.587+0000 7f2635c65700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26300f6ff0 0x7f2630107470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55000/0 (socket says 172.21.15.26:55000) 2021-11-03T17:32:48.586 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.587+0000 7f2635c65700 1 -- 172.21.15.26:0/1883986890 learned_addr learned my addr 172.21.15.26:0/1883986890 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:32:48.586 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.587+0000 7f2636466700 1 --2- 172.21.15.26:0/1883986890 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26300f66e0 0x7f2630106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:32:48.587 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.587+0000 7f2635c65700 1 -- 172.21.15.26:0/1883986890 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26300f66e0 msgr2=0x7f2630106f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:32:48.587 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.587+0000 7f2635c65700 1 --2- 172.21.15.26:0/1883986890 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26300f66e0 0x7f2630106f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:48.587 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.587+0000 7f2635c65700 1 -- 172.21.15.26:0/1883986890 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2620005040 con 0x7f26300f6ff0 2021-11-03T17:32:48.587 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.587+0000 7f2635c65700 1 --2- 172.21.15.26:0/1883986890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26300f6ff0 0x7f2630107470 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f262c00b410 tx=0x7f262c006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:32:48.587 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.587+0000 7f2626ffd700 1 -- 172.21.15.26:0/1883986890 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f262c0125f0 con 0x7f26300f6ff0 2021-11-03T17:32:48.588 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.587+0000 7f26386ca700 1 -- 172.21.15.26:0/1883986890 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2630108640 con 0x7f26300f6ff0 2021-11-03T17:32:48.588 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.587+0000 7f2626ffd700 1 -- 172.21.15.26:0/1883986890 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f262c00be30 con 0x7f26300f6ff0 2021-11-03T17:32:48.588 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.587+0000 7f2626ffd700 1 -- 172.21.15.26:0/1883986890 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f262c002a70 con 0x7f26300f6ff0 2021-11-03T17:32:48.588 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.587+0000 7f26386ca700 1 -- 172.21.15.26:0/1883986890 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2630108c00 con 0x7f26300f6ff0 2021-11-03T17:32:48.589 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.588+0000 7f26386ca700 1 -- 172.21.15.26:0/1883986890 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26300f5b70 con 0x7f26300f6ff0 2021-11-03T17:32:48.590 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.589+0000 7f2626ffd700 1 -- 172.21.15.26:0/1883986890 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f262c00f030 con 0x7f26300f6ff0 2021-11-03T17:32:48.590 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.589+0000 7f2626ffd700 1 --2- 172.21.15.26:0/1883986890 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f261c064090 0x7f261c066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:32:48.590 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.590+0000 7f2626ffd700 1 -- 172.21.15.26:0/1883986890 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f262c080c10 con 0x7f26300f6ff0 2021-11-03T17:32:48.590 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.590+0000 7f2636466700 1 --2- 172.21.15.26:0/1883986890 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f261c064090 0x7f261c066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:32:48.590 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.590+0000 7f2636466700 1 --2- 172.21.15.26:0/1883986890 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f261c064090 0x7f261c066550 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f2620004e30 tx=0x7f2620009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:32:48.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.594+0000 7f2626ffd700 1 -- 172.21.15.26:0/1883986890 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f262c052f70 con 0x7f26300f6ff0 2021-11-03T17:32:48.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:48 smithi026 ceph-mon[96795]: pgmap v1144: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:48.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:32:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:32:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:48 smithi194 ceph-mon[65619]: pgmap v1144: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:32:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:32:48.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.773+0000 7f26386ca700 1 -- 172.21.15.26:0/1883986890 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f26300008d0 con 0x7f261c064090 2021-11-03T17:32:48.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.774+0000 7f2626ffd700 1 -- 172.21.15.26:0/1883986890 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f26300008d0 con 0x7f261c064090 2021-11-03T17:32:48.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.776+0000 7f26386ca700 1 -- 172.21.15.26:0/1883986890 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f261c064090 msgr2=0x7f261c066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:32:48.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.776+0000 7f26386ca700 1 --2- 172.21.15.26:0/1883986890 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f261c064090 0x7f261c066550 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f2620004e30 tx=0x7f2620009b30).stop 2021-11-03T17:32:48.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.776+0000 7f26386ca700 1 -- 172.21.15.26:0/1883986890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26300f6ff0 msgr2=0x7f2630107470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:32:48.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.776+0000 7f26386ca700 1 --2- 172.21.15.26:0/1883986890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26300f6ff0 0x7f2630107470 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f262c00b410 tx=0x7f262c006ef0).stop 2021-11-03T17:32:48.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.776+0000 7f26386ca700 1 -- 172.21.15.26:0/1883986890 shutdown_connections 2021-11-03T17:32:48.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.776+0000 7f26386ca700 1 --2- 172.21.15.26:0/1883986890 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f261c064090 0x7f261c066550 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:48.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.776+0000 7f26386ca700 1 --2- 172.21.15.26:0/1883986890 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26300f66e0 0x7f2630106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:48.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.776+0000 7f26386ca700 1 --2- 172.21.15.26:0/1883986890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26300f6ff0 0x7f2630107470 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:48.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.776+0000 7f26386ca700 1 -- 172.21.15.26:0/1883986890 >> 172.21.15.26:0/1883986890 conn(0x7f26300f1f00 msgr2=0x7f26300fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:32:48.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.776+0000 7f26386ca700 1 -- 172.21.15.26:0/1883986890 shutdown_connections 2021-11-03T17:32:48.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.776+0000 7f26386ca700 1 -- 172.21.15.26:0/1883986890 wait complete. 2021-11-03T17:32:48.780 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:32:48.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.876+0000 7ffb15693700 1 -- 172.21.15.26:0/462545262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb100f5e60 msgr2=0x7ffb100f62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:32:48.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.876+0000 7ffb15693700 1 --2- 172.21.15.26:0/462545262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb100f5e60 0x7ffb100f62c0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7ffaf8004660 tx=0x7ffaf8009b30).stop 2021-11-03T17:32:48.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.876+0000 7ffb15693700 1 -- 172.21.15.26:0/462545262 shutdown_connections 2021-11-03T17:32:48.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.876+0000 7ffb15693700 1 --2- 172.21.15.26:0/462545262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb100f5e60 0x7ffb100f62c0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:48.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.876+0000 7ffb15693700 1 --2- 172.21.15.26:0/462545262 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb100f4bc0 0x7ffb100f4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:48.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.876+0000 7ffb15693700 1 -- 172.21.15.26:0/462545262 >> 172.21.15.26:0/462545262 conn(0x7ffb100f0320 msgr2=0x7ffb100f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:32:48.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.876+0000 7ffb15693700 1 -- 172.21.15.26:0/462545262 shutdown_connections 2021-11-03T17:32:48.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.876+0000 7ffb15693700 1 -- 172.21.15.26:0/462545262 wait complete. 2021-11-03T17:32:48.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.877+0000 7ffb15693700 1 Processor -- start 2021-11-03T17:32:48.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.877+0000 7ffb15693700 1 -- start start 2021-11-03T17:32:48.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.877+0000 7ffb15693700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb100f4bc0 0x7ffb10109ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:32:48.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.877+0000 7ffb15693700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb100f5e60 0x7ffb1010bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:32:48.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.877+0000 7ffb15693700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb100fe950 con 0x7ffb100f5e60 2021-11-03T17:32:48.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.877+0000 7ffb15693700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb100fea90 con 0x7ffb100f4bc0 2021-11-03T17:32:48.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.877+0000 7ffb0f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb100f5e60 0x7ffb1010bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:32:48.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.877+0000 7ffb0f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb100f5e60 0x7ffb1010bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55010/0 (socket says 172.21.15.26:55010) 2021-11-03T17:32:48.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.877+0000 7ffb0f7fe700 1 -- 172.21.15.26:0/2554784262 learned_addr learned my addr 172.21.15.26:0/2554784262 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:32:48.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.878+0000 7ffb0ffff700 1 --2- 172.21.15.26:0/2554784262 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb100f4bc0 0x7ffb10109ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:32:48.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.878+0000 7ffb0f7fe700 1 -- 172.21.15.26:0/2554784262 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb100f4bc0 msgr2=0x7ffb10109ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:32:48.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.878+0000 7ffb0f7fe700 1 --2- 172.21.15.26:0/2554784262 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb100f4bc0 0x7ffb10109ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:48.879 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.878+0000 7ffb0f7fe700 1 -- 172.21.15.26:0/2554784262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf8005040 con 0x7ffb100f5e60 2021-11-03T17:32:48.879 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.878+0000 7ffb0ffff700 1 --2- 172.21.15.26:0/2554784262 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb100f4bc0 0x7ffb10109ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:32:48.879 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.878+0000 7ffb0f7fe700 1 --2- 172.21.15.26:0/2554784262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb100f5e60 0x7ffb1010bfd0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7ffaf8009990 tx=0x7ffaf8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:32:48.879 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.878+0000 7ffb0cff9700 1 -- 172.21.15.26:0/2554784262 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaf8018070 con 0x7ffb100f5e60 2021-11-03T17:32:48.880 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.878+0000 7ffb15693700 1 -- 172.21.15.26:0/2554784262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb1010c520 con 0x7ffb100f5e60 2021-11-03T17:32:48.880 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.878+0000 7ffb0cff9700 1 -- 172.21.15.26:0/2554784262 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ffaf8007ca0 con 0x7ffb100f5e60 2021-11-03T17:32:48.880 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.878+0000 7ffb0cff9700 1 -- 172.21.15.26:0/2554784262 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaf801c620 con 0x7ffb100f5e60 2021-11-03T17:32:48.880 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.878+0000 7ffb15693700 1 -- 172.21.15.26:0/2554784262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb1010ca00 con 0x7ffb100f5e60 2021-11-03T17:32:48.880 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.879+0000 7ffb15693700 1 -- 172.21.15.26:0/2554784262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb10045ad0 con 0x7ffb100f5e60 2021-11-03T17:32:48.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.879+0000 7ffb0cff9700 1 -- 172.21.15.26:0/2554784262 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ffaf801d960 con 0x7ffb100f5e60 2021-11-03T17:32:48.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.880+0000 7ffb0cff9700 1 --2- 172.21.15.26:0/2554784262 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffafc064100 0x7ffafc0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:32:48.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.880+0000 7ffb0cff9700 1 -- 172.21.15.26:0/2554784262 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ffaf8082540 con 0x7ffb100f5e60 2021-11-03T17:32:48.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.880+0000 7ffb0ffff700 1 --2- 172.21.15.26:0/2554784262 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffafc064100 0x7ffafc0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:32:48.882 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.880+0000 7ffb0ffff700 1 --2- 172.21.15.26:0/2554784262 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffafc064100 0x7ffafc0665c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7ffb100fe5d0 tx=0x7ffb00009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:32:48.882 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:48.884+0000 7ffb0cff9700 1 -- 172.21.15.26:0/2554784262 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ffaf8054960 con 0x7ffb100f5e60 2021-11-03T17:32:49.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.057+0000 7ffb15693700 1 -- 172.21.15.26:0/2554784262 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb100fa4f0 con 0x7ffafc064100 2021-11-03T17:32:49.066 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.072+0000 7ffb0cff9700 1 -- 172.21.15.26:0/2554784262 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7ffb100fa4f0 con 0x7ffafc064100 2021-11-03T17:32:49.067 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:32:49.067 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (44m) 3m ago 45m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:32:49.067 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (36m) 3m ago 45m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:32:49.067 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (36m) 2m ago 44m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:32:49.068 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (43m) 3m ago 44m 40.3M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:32:49.068 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (37m) 3m ago 40m 22.6M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:32:49.068 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (37m) 3m ago 40m 23.5M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:32:49.068 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (40m) 2m ago 40m 24.8M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:32:49.068 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (40m) 2m ago 40m 25.0M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:32:49.069 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (37m) 3m ago 46m 520M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:32:49.069 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (37m) 2m ago 44m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:32:49.069 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (37m) 3m ago 46m 176M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:32:49.069 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (36m) 2m ago 44m 89.5M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:32:49.070 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (44m) 3m ago 44m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:32:49.070 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (44m) 2m ago 44m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:32:49.070 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (35m) 3m ago 43m 231M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:32:49.070 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (35m) 3m ago 43m 248M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:32:49.070 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (34m) 3m ago 42m 207M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:32:49.071 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (34m) 2m ago 42m 262M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:32:49.071 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (33m) 2m ago 42m 227M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:32:49.071 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (33m) 2m ago 42m 215M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:32:49.071 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (43m) 3m ago 44m 54.4M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:32:49.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.074+0000 7ffb15693700 1 -- 172.21.15.26:0/2554784262 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffafc064100 msgr2=0x7ffafc0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:32:49.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.074+0000 7ffb15693700 1 --2- 172.21.15.26:0/2554784262 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffafc064100 0x7ffafc0665c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7ffb100fe5d0 tx=0x7ffb00009040).stop 2021-11-03T17:32:49.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.074+0000 7ffb15693700 1 -- 172.21.15.26:0/2554784262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb100f5e60 msgr2=0x7ffb1010bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:32:49.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.074+0000 7ffb15693700 1 --2- 172.21.15.26:0/2554784262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb100f5e60 0x7ffb1010bfd0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7ffaf8009990 tx=0x7ffaf8009b30).stop 2021-11-03T17:32:49.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.074+0000 7ffb15693700 1 -- 172.21.15.26:0/2554784262 shutdown_connections 2021-11-03T17:32:49.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.074+0000 7ffb15693700 1 --2- 172.21.15.26:0/2554784262 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffafc064100 0x7ffafc0665c0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:49.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.074+0000 7ffb15693700 1 --2- 172.21.15.26:0/2554784262 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb100f4bc0 0x7ffb10109ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:49.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.074+0000 7ffb15693700 1 --2- 172.21.15.26:0/2554784262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb100f5e60 0x7ffb1010bfd0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:49.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.074+0000 7ffb15693700 1 -- 172.21.15.26:0/2554784262 >> 172.21.15.26:0/2554784262 conn(0x7ffb100f0320 msgr2=0x7ffb100f2610 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:32:49.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.074+0000 7ffb15693700 1 -- 172.21.15.26:0/2554784262 shutdown_connections 2021-11-03T17:32:49.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.074+0000 7ffb15693700 1 -- 172.21.15.26:0/2554784262 wait complete. 2021-11-03T17:32:49.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.174+0000 7fb4be8e1700 1 -- 172.21.15.26:0/4218763079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4b80f6860 msgr2=0x7fb4b80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:32:49.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.174+0000 7fb4be8e1700 1 --2- 172.21.15.26:0/4218763079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4b80f6860 0x7fb4b80f6cc0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7fb4ac004660 tx=0x7fb4ac009b30).stop 2021-11-03T17:32:49.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.174+0000 7fb4be8e1700 1 -- 172.21.15.26:0/4218763079 shutdown_connections 2021-11-03T17:32:49.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.174+0000 7fb4be8e1700 1 --2- 172.21.15.26:0/4218763079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4b80f6860 0x7fb4b80f6cc0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:49.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.174+0000 7fb4be8e1700 1 --2- 172.21.15.26:0/4218763079 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4b80f55c0 0x7fb4b80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:49.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.174+0000 7fb4be8e1700 1 -- 172.21.15.26:0/4218763079 >> 172.21.15.26:0/4218763079 conn(0x7fb4b80f0d40 msgr2=0x7fb4b80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:32:49.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.174+0000 7fb4be8e1700 1 -- 172.21.15.26:0/4218763079 shutdown_connections 2021-11-03T17:32:49.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.174+0000 7fb4be8e1700 1 -- 172.21.15.26:0/4218763079 wait complete. 2021-11-03T17:32:49.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.174+0000 7fb4be8e1700 1 Processor -- start 2021-11-03T17:32:49.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.175+0000 7fb4be8e1700 1 -- start start 2021-11-03T17:32:49.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.175+0000 7fb4be8e1700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4b80f55c0 0x7fb4b8109bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:32:49.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.175+0000 7fb4be8e1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4b80f6860 0x7fb4b810c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:32:49.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.175+0000 7fb4be8e1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b80603e0 con 0x7fb4b80f6860 2021-11-03T17:32:49.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.175+0000 7fb4be8e1700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b8060520 con 0x7fb4b80f55c0 2021-11-03T17:32:49.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.175+0000 7fb4b77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4b80f6860 0x7fb4b810c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:32:49.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.175+0000 7fb4b77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4b80f6860 0x7fb4b810c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55020/0 (socket says 172.21.15.26:55020) 2021-11-03T17:32:49.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.175+0000 7fb4b77fe700 1 -- 172.21.15.26:0/656033600 learned_addr learned my addr 172.21.15.26:0/656033600 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:32:49.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.175+0000 7fb4b7fff700 1 --2- 172.21.15.26:0/656033600 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4b80f55c0 0x7fb4b8109bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:32:49.175 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.175+0000 7fb4b77fe700 1 -- 172.21.15.26:0/656033600 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4b80f55c0 msgr2=0x7fb4b8109bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:32:49.175 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.175+0000 7fb4b77fe700 1 --2- 172.21.15.26:0/656033600 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4b80f55c0 0x7fb4b8109bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:49.175 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.175+0000 7fb4b77fe700 1 -- 172.21.15.26:0/656033600 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ac005040 con 0x7fb4b80f6860 2021-11-03T17:32:49.175 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.175+0000 7fb4b77fe700 1 --2- 172.21.15.26:0/656033600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4b80f6860 0x7fb4b810c0c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7fb4ac009990 tx=0x7fb4ac009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:32:49.175 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.175+0000 7fb4b4ff9700 1 -- 172.21.15.26:0/656033600 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4ac018070 con 0x7fb4b80f6860 2021-11-03T17:32:49.176 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.175+0000 7fb4b4ff9700 1 -- 172.21.15.26:0/656033600 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb4ac007ba0 con 0x7fb4b80f6860 2021-11-03T17:32:49.176 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.175+0000 7fb4b4ff9700 1 -- 172.21.15.26:0/656033600 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4ac01c3c0 con 0x7fb4b80f6860 2021-11-03T17:32:49.176 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.176+0000 7fb4be8e1700 1 -- 172.21.15.26:0/656033600 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4b810c610 con 0x7fb4b80f6860 2021-11-03T17:32:49.176 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.176+0000 7fb4be8e1700 1 -- 172.21.15.26:0/656033600 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4b810cb20 con 0x7fb4b80f6860 2021-11-03T17:32:49.177 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.176+0000 7fb4be8e1700 1 -- 172.21.15.26:0/656033600 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4b8045ad0 con 0x7fb4b80f6860 2021-11-03T17:32:49.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.177+0000 7fb4b4ff9700 1 -- 172.21.15.26:0/656033600 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fb4ac01d420 con 0x7fb4b80f6860 2021-11-03T17:32:49.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.177+0000 7fb4b4ff9700 1 --2- 172.21.15.26:0/656033600 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb4a00640b0 0x7fb4a0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:32:49.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.177+0000 7fb4b4ff9700 1 -- 172.21.15.26:0/656033600 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fb4ac082410 con 0x7fb4b80f6860 2021-11-03T17:32:49.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.177+0000 7fb4b7fff700 1 --2- 172.21.15.26:0/656033600 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb4a00640b0 0x7fb4a0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:32:49.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.178+0000 7fb4b7fff700 1 --2- 172.21.15.26:0/656033600 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb4a00640b0 0x7fb4a0066570 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7fb4b8060060 tx=0x7fb4a800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:32:49.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.182+0000 7fb4b4ff9700 1 -- 172.21.15.26:0/656033600 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fb4ac054830 con 0x7fb4b80f6860 2021-11-03T17:32:49.406 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.411+0000 7fb4be8e1700 1 -- 172.21.15.26:0/656033600 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb4b8027a00 con 0x7fb4b80f6860 2021-11-03T17:32:49.406 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.412+0000 7fb4b4ff9700 1 -- 172.21.15.26:0/656033600 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fb4ac054420 con 0x7fb4b80f6860 2021-11-03T17:32:49.407 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:32:49.407 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:32:49.408 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:32:49.408 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:32:49.408 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:32:49.408 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:32:49.408 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:32:49.409 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:32:49.409 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:32:49.409 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:32:49.409 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:32:49.410 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:32:49.410 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:32:49.410 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:32:49.410 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:32:49.411 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:32:49.411 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:32:49.411 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:32:49.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.413+0000 7fb4be8e1700 1 -- 172.21.15.26:0/656033600 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb4a00640b0 msgr2=0x7fb4a0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:32:49.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.413+0000 7fb4be8e1700 1 --2- 172.21.15.26:0/656033600 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb4a00640b0 0x7fb4a0066570 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7fb4b8060060 tx=0x7fb4a800b040).stop 2021-11-03T17:32:49.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.413+0000 7fb4be8e1700 1 -- 172.21.15.26:0/656033600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4b80f6860 msgr2=0x7fb4b810c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:32:49.413 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.413+0000 7fb4be8e1700 1 --2- 172.21.15.26:0/656033600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4b80f6860 0x7fb4b810c0c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7fb4ac009990 tx=0x7fb4ac009b30).stop 2021-11-03T17:32:49.413 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.413+0000 7fb4be8e1700 1 -- 172.21.15.26:0/656033600 shutdown_connections 2021-11-03T17:32:49.413 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.413+0000 7fb4be8e1700 1 --2- 172.21.15.26:0/656033600 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb4a00640b0 0x7fb4a0066570 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:49.413 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.413+0000 7fb4be8e1700 1 --2- 172.21.15.26:0/656033600 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4b80f55c0 0x7fb4b8109bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:49.414 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.413+0000 7fb4be8e1700 1 --2- 172.21.15.26:0/656033600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4b80f6860 0x7fb4b810c0c0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:49.414 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.413+0000 7fb4be8e1700 1 -- 172.21.15.26:0/656033600 >> 172.21.15.26:0/656033600 conn(0x7fb4b80f0d40 msgr2=0x7fb4b80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:32:49.414 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.414+0000 7fb4be8e1700 1 -- 172.21.15.26:0/656033600 shutdown_connections 2021-11-03T17:32:49.414 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.414+0000 7fb4be8e1700 1 -- 172.21.15.26:0/656033600 wait complete. 2021-11-03T17:32:49.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.514+0000 7fc3e06ea700 1 -- 172.21.15.26:0/2843420823 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3d80f55c0 msgr2=0x7fc3d80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:32:49.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.514+0000 7fc3e06ea700 1 --2- 172.21.15.26:0/2843420823 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3d80f55c0 0x7fc3d80f59e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7fc3d0004660 tx=0x7fc3d0009b30).stop 2021-11-03T17:32:49.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.514+0000 7fc3e06ea700 1 -- 172.21.15.26:0/2843420823 shutdown_connections 2021-11-03T17:32:49.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.514+0000 7fc3e06ea700 1 --2- 172.21.15.26:0/2843420823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3d80f6860 0x7fc3d80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:32:49.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.514+0000 7fc3e06ea700 1 --2- 172.21.15.26:0/2843420823 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3d80f55c0 0x7fc3d80f59e0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:49.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.514+0000 7fc3e06ea700 1 -- 172.21.15.26:0/2843420823 >> 172.21.15.26:0/2843420823 conn(0x7fc3d80f0d40 msgr2=0x7fc3d80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:32:49.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.514+0000 7fc3e06ea700 1 -- 172.21.15.26:0/2843420823 shutdown_connections 2021-11-03T17:32:49.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.514+0000 7fc3e06ea700 1 -- 172.21.15.26:0/2843420823 wait complete. 2021-11-03T17:32:49.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.514+0000 7fc3e06ea700 1 Processor -- start 2021-11-03T17:32:49.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.514+0000 7fc3e06ea700 1 -- start start 2021-11-03T17:32:49.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.514+0000 7fc3e06ea700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3d80f55c0 0x7fc3d8105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:32:49.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.514+0000 7fc3e06ea700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3d80f6860 0x7fc3d81063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:32:49.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.514+0000 7fc3e06ea700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d81069f0 con 0x7fc3d80f6860 2021-11-03T17:32:49.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.515+0000 7fc3e06ea700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d81072a0 con 0x7fc3d80f55c0 2021-11-03T17:32:49.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.515+0000 7fc3ddc85700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3d80f6860 0x7fc3d81063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:32:49.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.515+0000 7fc3ddc85700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3d80f6860 0x7fc3d81063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55030/0 (socket says 172.21.15.26:55030) 2021-11-03T17:32:49.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.515+0000 7fc3ddc85700 1 -- 172.21.15.26:0/3409712056 learned_addr learned my addr 172.21.15.26:0/3409712056 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:32:49.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.515+0000 7fc3de486700 1 --2- 172.21.15.26:0/3409712056 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3d80f55c0 0x7fc3d8105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:32:49.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.515+0000 7fc3ddc85700 1 -- 172.21.15.26:0/3409712056 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3d80f55c0 msgr2=0x7fc3d8105ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:32:49.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.515+0000 7fc3ddc85700 1 --2- 172.21.15.26:0/3409712056 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3d80f55c0 0x7fc3d8105ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:49.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.515+0000 7fc3ddc85700 1 -- 172.21.15.26:0/3409712056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d0005040 con 0x7fc3d80f6860 2021-11-03T17:32:49.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.515+0000 7fc3ddc85700 1 --2- 172.21.15.26:0/3409712056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3d80f6860 0x7fc3d81063b0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7fc3cc00b410 tx=0x7fc3cc006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:32:49.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.515+0000 7fc3d6ffd700 1 -- 172.21.15.26:0/3409712056 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3cc0125f0 con 0x7fc3d80f6860 2021-11-03T17:32:49.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.515+0000 7fc3d6ffd700 1 -- 172.21.15.26:0/3409712056 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc3cc00be30 con 0x7fc3d80f6860 2021-11-03T17:32:49.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.515+0000 7fc3e06ea700 1 -- 172.21.15.26:0/3409712056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3d8107580 con 0x7fc3d80f6860 2021-11-03T17:32:49.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.515+0000 7fc3d6ffd700 1 -- 172.21.15.26:0/3409712056 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3cc002a70 con 0x7fc3d80f6860 2021-11-03T17:32:49.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.515+0000 7fc3e06ea700 1 -- 172.21.15.26:0/3409712056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3d8107b40 con 0x7fc3d80f6860 2021-11-03T17:32:49.518 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.516+0000 7fc3e06ea700 1 -- 172.21.15.26:0/3409712056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3d80f49b0 con 0x7fc3d80f6860 2021-11-03T17:32:49.518 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.517+0000 7fc3d6ffd700 1 -- 172.21.15.26:0/3409712056 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc3cc00f030 con 0x7fc3d80f6860 2021-11-03T17:32:49.518 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.517+0000 7fc3d6ffd700 1 --2- 172.21.15.26:0/3409712056 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3c00640b0 0x7fc3c0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:32:49.518 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.517+0000 7fc3d6ffd700 1 -- 172.21.15.26:0/3409712056 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc3cc080c30 con 0x7fc3d80f6860 2021-11-03T17:32:49.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.517+0000 7fc3de486700 1 --2- 172.21.15.26:0/3409712056 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3c00640b0 0x7fc3c0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:32:49.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.518+0000 7fc3de486700 1 --2- 172.21.15.26:0/3409712056 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3c00640b0 0x7fc3c0066570 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7fc3d0004630 tx=0x7fc3d0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:32:49.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.521+0000 7fc3d6ffd700 1 -- 172.21.15.26:0/3409712056 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc3cc052f90 con 0x7fc3d80f6860 2021-11-03T17:32:49.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.724+0000 7fc3e06ea700 1 -- 172.21.15.26:0/3409712056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc3d80ff810 con 0x7fc3d80f6860 2021-11-03T17:32:49.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.724+0000 7fc3d6ffd700 1 -- 172.21.15.26:0/3409712056 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fc3cc052b80 con 0x7fc3d80f6860 2021-11-03T17:32:49.720 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:32:49.720 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:32:49.720 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:32:49.720 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:32:49.721 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:32:49.721 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:32:49.721 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:32:49.721 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:32:49.721 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:32:49.722 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:32:49.722 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:32:49.722 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:32:49.722 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:32:49.723 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:32:49.723 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:32:49.723 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:32:49.723 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:32:49.723 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:32:49.724 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:32:49.724 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:32:49.724 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:32:49.724 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:32:49.724 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:32:49.725 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:32:49.725 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:32:49.725 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:32:49.725 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:32:49.725 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:32:49.726 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:32:49.726 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:32:49.726 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:32:49.726 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:32:49.726 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:32:49.727 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:32:49.727 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:32:49.727 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:32:49.727 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:32:49.727 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:32:49.728 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:32:49.729 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.726+0000 7fc3e06ea700 1 -- 172.21.15.26:0/3409712056 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3c00640b0 msgr2=0x7fc3c0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:32:49.729 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.726+0000 7fc3e06ea700 1 --2- 172.21.15.26:0/3409712056 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3c00640b0 0x7fc3c0066570 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7fc3d0004630 tx=0x7fc3d0009b30).stop 2021-11-03T17:32:49.729 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.726+0000 7fc3e06ea700 1 -- 172.21.15.26:0/3409712056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3d80f6860 msgr2=0x7fc3d81063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:32:49.729 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.726+0000 7fc3e06ea700 1 --2- 172.21.15.26:0/3409712056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3d80f6860 0x7fc3d81063b0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7fc3cc00b410 tx=0x7fc3cc006ef0).stop 2021-11-03T17:32:49.729 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.726+0000 7fc3e06ea700 1 -- 172.21.15.26:0/3409712056 shutdown_connections 2021-11-03T17:32:49.730 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.726+0000 7fc3e06ea700 1 --2- 172.21.15.26:0/3409712056 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3c00640b0 0x7fc3c0066570 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:49.730 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.726+0000 7fc3e06ea700 1 --2- 172.21.15.26:0/3409712056 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3d80f55c0 0x7fc3d8105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:49.730 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.726+0000 7fc3e06ea700 1 --2- 172.21.15.26:0/3409712056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3d80f6860 0x7fc3d81063b0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:32:49.730 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.726+0000 7fc3e06ea700 1 -- 172.21.15.26:0/3409712056 >> 172.21.15.26:0/3409712056 conn(0x7fc3d80f0d40 msgr2=0x7fc3d80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:32:49.730 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.726+0000 7fc3e06ea700 1 -- 172.21.15.26:0/3409712056 shutdown_connections 2021-11-03T17:32:49.731 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:32:49.726+0000 7fc3e06ea700 1 -- 172.21.15.26:0/3409712056 wait complete. 2021-11-03T17:32:49.731 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:32:50.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:50 smithi026 ceph-mon[96795]: from='client.35324 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:32:50.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:50 smithi026 ceph-mon[96795]: pgmap v1145: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:50.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:50 smithi026 ceph-mon[96795]: from='client.35328 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:32:50.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:50 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/656033600' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:32:50.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:50 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3409712056' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:32:50.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:50 smithi194 ceph-mon[65619]: from='client.35324 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:32:50.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:50 smithi194 ceph-mon[65619]: pgmap v1145: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:50.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:50 smithi194 ceph-mon[65619]: from='client.35328 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:32:50.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:50 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/656033600' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:32:50.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:50 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3409712056' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:32:52.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:52 smithi026 ceph-mon[96795]: pgmap v1146: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:52.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:52 smithi194 ceph-mon[65619]: pgmap v1146: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:54.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:54 smithi026 ceph-mon[96795]: pgmap v1147: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:54.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:54 smithi194 ceph-mon[65619]: pgmap v1147: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:55.573 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:32:55.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:32:56.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:56 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:32:56.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:56 smithi026 ceph-mon[96795]: pgmap v1148: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:56.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:56 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:32:56.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:56 smithi194 ceph-mon[65619]: pgmap v1148: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:58.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:32:58 smithi026 ceph-mon[96795]: pgmap v1149: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:32:58.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:32:58 smithi194 ceph-mon[65619]: pgmap v1149: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:00.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:00 smithi026 ceph-mon[96795]: pgmap v1150: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:00.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:00 smithi194 ceph-mon[65619]: pgmap v1150: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:02.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:02 smithi026 ceph-mon[96795]: pgmap v1151: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:02.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:02 smithi194 ceph-mon[65619]: pgmap v1151: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:04.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:04 smithi026 ceph-mon[96795]: pgmap v1152: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:04.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:04 smithi194 ceph-mon[65619]: pgmap v1152: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:06.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:06 smithi026 ceph-mon[96795]: pgmap v1153: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:06.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:06 smithi194 ceph-mon[65619]: pgmap v1153: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:08.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:08 smithi026 ceph-mon[96795]: pgmap v1154: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:08.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:08 smithi194 ceph-mon[65619]: pgmap v1154: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:10.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:10 smithi026 ceph-mon[96795]: pgmap v1155: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:10.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:10 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:33:10.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:10 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:33:10.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:10 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:33:10.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:10 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:33:10.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:10 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:33:10.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:10 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:33:10.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:10 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:33:10.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:10 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:33:10.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:10 smithi194 ceph-mon[65619]: pgmap v1155: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:10.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:10 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:33:10.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:10 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:33:10.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:10 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:33:10.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:10 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:33:10.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:10 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:33:10.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:10 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:33:10.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:10 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:33:10.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:10 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:33:11.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:11 smithi026 ceph-mon[96795]: poll took 60051.080 ms: 1 events 2021-11-03T17:33:11.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:11 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:33:11.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:11 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:33:11.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:11 smithi194 ceph-mon[65619]: poll took 60051.080 ms: 1 events 2021-11-03T17:33:11.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:11 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:33:11.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:11 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:33:12.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:12 smithi026 ceph-mon[96795]: pgmap v1156: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:12.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:12 smithi194 ceph-mon[65619]: pgmap v1156: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:14.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:14 smithi026 ceph-mon[96795]: pgmap v1157: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:14.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:14 smithi194 ceph-mon[65619]: pgmap v1157: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:16.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:16 smithi026 ceph-mon[96795]: pgmap v1158: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:16.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:16 smithi194 ceph-mon[65619]: pgmap v1158: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:18.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:18 smithi026 ceph-mon[96795]: pgmap v1159: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:18.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:18 smithi194 ceph-mon[65619]: pgmap v1159: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:19.838 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:19.842+0000 7f090d785700 1 -- 172.21.15.26:0/270898411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09080f66e0 msgr2=0x7f09080f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:33:19.839 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:19.842+0000 7f090d785700 1 --2- 172.21.15.26:0/270898411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09080f66e0 0x7f09080f6b00 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f08fc004660 tx=0x7f08fc009b30).stop 2021-11-03T17:33:19.839 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:19.842+0000 7f090d785700 1 -- 172.21.15.26:0/270898411 shutdown_connections 2021-11-03T17:33:19.839 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:19.842+0000 7f090d785700 1 --2- 172.21.15.26:0/270898411 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09080f6ff0 0x7f09080f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:19.840 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:19.842+0000 7f090d785700 1 --2- 172.21.15.26:0/270898411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09080f66e0 0x7f09080f6b00 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:19.840 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:19.842+0000 7f090d785700 1 -- 172.21.15.26:0/270898411 >> 172.21.15.26:0/270898411 conn(0x7f09080f1f00 msgr2=0x7f09080f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:33:19.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:19.842+0000 7f090d785700 1 -- 172.21.15.26:0/270898411 shutdown_connections 2021-11-03T17:33:19.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:19.842+0000 7f090d785700 1 -- 172.21.15.26:0/270898411 wait complete. 2021-11-03T17:33:19.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:19.843+0000 7f090d785700 1 Processor -- start 2021-11-03T17:33:19.842 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:19.843+0000 7f090d785700 1 -- start start 2021-11-03T17:33:19.842 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:19.843+0000 7f090d785700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09080f66e0 0x7f090806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:33:19.843 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:19.843+0000 7f090d785700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09080f6ff0 0x7f0908069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:33:19.843 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:19.843+0000 7f090d785700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090806a380 con 0x7f09080f6ff0 2021-11-03T17:33:19.844 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:19.843+0000 7f090d785700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090806a4c0 con 0x7f09080f66e0 2021-11-03T17:33:19.844 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:19.843+0000 7f09067fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09080f6ff0 0x7f0908069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:33:19.844 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:19.843+0000 7f09067fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09080f6ff0 0x7f0908069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55048/0 (socket says 172.21.15.26:55048) 2021-11-03T17:33:19.845 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:19.843+0000 7f09067fc700 1 -- 172.21.15.26:0/3467256002 learned_addr learned my addr 172.21.15.26:0/3467256002 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:33:19.845 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:19.844+0000 7f0906ffd700 1 --2- 172.21.15.26:0/3467256002 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09080f66e0 0x7f090806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:33:19.845 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:19.844+0000 7f09067fc700 1 -- 172.21.15.26:0/3467256002 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09080f66e0 msgr2=0x7f090806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:33:19.846 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:19.844+0000 7f09067fc700 1 --2- 172.21.15.26:0/3467256002 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09080f66e0 0x7f090806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:19.846 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:19.844+0000 7f09067fc700 1 -- 172.21.15.26:0/3467256002 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08fc005040 con 0x7f09080f6ff0 2021-11-03T17:33:19.846 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:19.844+0000 7f0906ffd700 1 --2- 172.21.15.26:0/3467256002 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09080f66e0 0x7f090806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:33:19.847 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:19.844+0000 7f09067fc700 1 --2- 172.21.15.26:0/3467256002 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09080f6ff0 0x7f0908069e20 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f08f800c530 tx=0x7f08f8007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:33:19.847 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:19.844+0000 7f08ef7fe700 1 -- 172.21.15.26:0/3467256002 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08f800f650 con 0x7f09080f6ff0 2021-11-03T17:33:19.847 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:19.844+0000 7f08ef7fe700 1 -- 172.21.15.26:0/3467256002 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f08f800fc60 con 0x7f09080f6ff0 2021-11-03T17:33:19.847 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:19.844+0000 7f090d785700 1 -- 172.21.15.26:0/3467256002 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f090806a7a0 con 0x7f09080f6ff0 2021-11-03T17:33:19.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:19.844+0000 7f08ef7fe700 1 -- 172.21.15.26:0/3467256002 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08f8012cd0 con 0x7f09080f6ff0 2021-11-03T17:33:19.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:19.844+0000 7f090d785700 1 -- 172.21.15.26:0/3467256002 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f090810ef90 con 0x7f09080f6ff0 2021-11-03T17:33:19.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:19.845+0000 7f090d785700 1 -- 172.21.15.26:0/3467256002 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0908045ad0 con 0x7f09080f6ff0 2021-11-03T17:33:19.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:19.846+0000 7f08ef7fe700 1 -- 172.21.15.26:0/3467256002 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f08f8010070 con 0x7f09080f6ff0 2021-11-03T17:33:19.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:19.846+0000 7f08ef7fe700 1 --2- 172.21.15.26:0/3467256002 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f08f00640b0 0x7f08f0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:33:19.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:19.846+0000 7f08ef7fe700 1 -- 172.21.15.26:0/3467256002 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f08f8080620 con 0x7f09080f6ff0 2021-11-03T17:33:19.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:19.846+0000 7f0906ffd700 1 --2- 172.21.15.26:0/3467256002 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f08f00640b0 0x7f08f0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:33:19.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:19.847+0000 7f0906ffd700 1 --2- 172.21.15.26:0/3467256002 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f08f00640b0 0x7f08f0066570 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f08fc004e30 tx=0x7f08fc009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:33:19.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:19.851+0000 7f08ef7fe700 1 -- 172.21.15.26:0/3467256002 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f08f8052890 con 0x7f09080f6ff0 2021-11-03T17:33:20.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.029+0000 7f090d785700 1 -- 172.21.15.26:0/3467256002 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0908057f10 con 0x7f08f00640b0 2021-11-03T17:33:20.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.030+0000 7f08ef7fe700 1 -- 172.21.15.26:0/3467256002 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f0908057f10 con 0x7f08f00640b0 2021-11-03T17:33:20.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.032+0000 7f090d785700 1 -- 172.21.15.26:0/3467256002 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f08f00640b0 msgr2=0x7f08f0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:33:20.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.032+0000 7f090d785700 1 --2- 172.21.15.26:0/3467256002 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f08f00640b0 0x7f08f0066570 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f08fc004e30 tx=0x7f08fc009b30).stop 2021-11-03T17:33:20.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.032+0000 7f090d785700 1 -- 172.21.15.26:0/3467256002 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09080f6ff0 msgr2=0x7f0908069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:33:20.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.032+0000 7f090d785700 1 --2- 172.21.15.26:0/3467256002 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09080f6ff0 0x7f0908069e20 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f08f800c530 tx=0x7f08f8007e20).stop 2021-11-03T17:33:20.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.032+0000 7f090d785700 1 -- 172.21.15.26:0/3467256002 shutdown_connections 2021-11-03T17:33:20.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.032+0000 7f090d785700 1 --2- 172.21.15.26:0/3467256002 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f08f00640b0 0x7f08f0066570 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:20.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.032+0000 7f090d785700 1 --2- 172.21.15.26:0/3467256002 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09080f66e0 0x7f090806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:20.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.032+0000 7f090d785700 1 --2- 172.21.15.26:0/3467256002 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09080f6ff0 0x7f0908069e20 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:20.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.032+0000 7f090d785700 1 -- 172.21.15.26:0/3467256002 >> 172.21.15.26:0/3467256002 conn(0x7f09080f1f00 msgr2=0x7f09080fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:33:20.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.032+0000 7f090d785700 1 -- 172.21.15.26:0/3467256002 shutdown_connections 2021-11-03T17:33:20.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.032+0000 7f090d785700 1 -- 172.21.15.26:0/3467256002 wait complete. 2021-11-03T17:33:20.036 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:33:20.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.132+0000 7f9142ff5700 1 -- 172.21.15.26:0/296665445 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f913c0f5440 msgr2=0x7f913c0f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:33:20.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.132+0000 7f9142ff5700 1 --2- 172.21.15.26:0/296665445 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f913c0f5440 0x7f913c0f5860 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f9138004660 tx=0x7f9138009b30).stop 2021-11-03T17:33:20.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.133+0000 7f9142ff5700 1 -- 172.21.15.26:0/296665445 shutdown_connections 2021-11-03T17:33:20.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.133+0000 7f9142ff5700 1 --2- 172.21.15.26:0/296665445 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f913c0f66e0 0x7f913c0f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:20.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.133+0000 7f9142ff5700 1 --2- 172.21.15.26:0/296665445 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f913c0f5440 0x7f913c0f5860 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:20.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.133+0000 7f9142ff5700 1 -- 172.21.15.26:0/296665445 >> 172.21.15.26:0/296665445 conn(0x7f913c0f0ba0 msgr2=0x7f913c0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:33:20.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.133+0000 7f9142ff5700 1 -- 172.21.15.26:0/296665445 shutdown_connections 2021-11-03T17:33:20.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.133+0000 7f9142ff5700 1 -- 172.21.15.26:0/296665445 wait complete. 2021-11-03T17:33:20.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.133+0000 7f9142ff5700 1 Processor -- start 2021-11-03T17:33:20.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.133+0000 7f9142ff5700 1 -- start start 2021-11-03T17:33:20.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.133+0000 7f9142ff5700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f913c0f5440 0x7f913c109aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:33:20.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.133+0000 7f9142ff5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f913c0f66e0 0x7f913c10bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:33:20.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.133+0000 7f9142ff5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913c0603e0 con 0x7f913c0f66e0 2021-11-03T17:33:20.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.133+0000 7f9142ff5700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913c060520 con 0x7f913c0f5440 2021-11-03T17:33:20.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.133+0000 7f91417f2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f913c0f66e0 0x7f913c10bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:33:20.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.134+0000 7f91417f2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f913c0f66e0 0x7f913c10bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55058/0 (socket says 172.21.15.26:55058) 2021-11-03T17:33:20.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.134+0000 7f91417f2700 1 -- 172.21.15.26:0/709719128 learned_addr learned my addr 172.21.15.26:0/709719128 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:33:20.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.134+0000 7f9141ff3700 1 --2- 172.21.15.26:0/709719128 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f913c0f5440 0x7f913c109aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:33:20.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.134+0000 7f91417f2700 1 -- 172.21.15.26:0/709719128 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f913c0f5440 msgr2=0x7f913c109aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:33:20.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.134+0000 7f91417f2700 1 --2- 172.21.15.26:0/709719128 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f913c0f5440 0x7f913c109aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:20.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.134+0000 7f91417f2700 1 -- 172.21.15.26:0/709719128 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9138005040 con 0x7f913c0f66e0 2021-11-03T17:33:20.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.134+0000 7f9141ff3700 1 --2- 172.21.15.26:0/709719128 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f913c0f5440 0x7f913c109aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:33:20.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.134+0000 7f91417f2700 1 --2- 172.21.15.26:0/709719128 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f913c0f66e0 0x7f913c10bfa0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7f912c0026d0 tx=0x7f912c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:33:20.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.134+0000 7f91327fc700 1 -- 172.21.15.26:0/709719128 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f912c009320 con 0x7f913c0f66e0 2021-11-03T17:33:20.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.134+0000 7f91327fc700 1 -- 172.21.15.26:0/709719128 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f912c00f040 con 0x7f913c0f66e0 2021-11-03T17:33:20.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.134+0000 7f9142ff5700 1 -- 172.21.15.26:0/709719128 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f913c10c550 con 0x7f913c0f66e0 2021-11-03T17:33:20.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.134+0000 7f91327fc700 1 -- 172.21.15.26:0/709719128 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f912c0147e0 con 0x7f913c0f66e0 2021-11-03T17:33:20.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.134+0000 7f9142ff5700 1 -- 172.21.15.26:0/709719128 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f913c10cb10 con 0x7f913c0f66e0 2021-11-03T17:33:20.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.135+0000 7f9142ff5700 1 -- 172.21.15.26:0/709719128 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f913c045ad0 con 0x7f913c0f66e0 2021-11-03T17:33:20.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.135+0000 7f91327fc700 1 -- 172.21.15.26:0/709719128 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f912c009480 con 0x7f913c0f66e0 2021-11-03T17:33:20.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.136+0000 7f91327fc700 1 --2- 172.21.15.26:0/709719128 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9128064100 0x7f91280665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:33:20.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.136+0000 7f91327fc700 1 -- 172.21.15.26:0/709719128 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f912c080eb0 con 0x7f913c0f66e0 2021-11-03T17:33:20.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.136+0000 7f9141ff3700 1 --2- 172.21.15.26:0/709719128 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9128064100 0x7f91280665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:33:20.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.136+0000 7f9141ff3700 1 --2- 172.21.15.26:0/709719128 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9128064100 0x7f91280665c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f9138004e30 tx=0x7f9138009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:33:20.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.140+0000 7f91327fc700 1 -- 172.21.15.26:0/709719128 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f912c053210 con 0x7f913c0f66e0 2021-11-03T17:33:20.308 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.315+0000 7f9142ff5700 1 -- 172.21.15.26:0/709719128 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f913c057f10 con 0x7f9128064100 2021-11-03T17:33:20.323 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.329+0000 7f91327fc700 1 -- 172.21.15.26:0/709719128 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f913c057f10 con 0x7f9128064100 2021-11-03T17:33:20.323 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:33:20.324 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (44m) 4m ago 45m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:33:20.324 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (36m) 4m ago 45m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:33:20.324 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (36m) 3m ago 45m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:33:20.325 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (44m) 4m ago 45m 40.3M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:33:20.325 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (37m) 4m ago 40m 22.6M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:33:20.325 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (37m) 4m ago 40m 23.5M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:33:20.325 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (41m) 3m ago 41m 24.8M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:33:20.325 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (40m) 3m ago 40m 25.0M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:33:20.326 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (38m) 4m ago 47m 520M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:33:20.326 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (37m) 3m ago 45m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:33:20.326 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (37m) 4m ago 47m 176M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:33:20.327 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (37m) 3m ago 44m 89.5M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:33:20.327 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (45m) 4m ago 45m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:33:20.327 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (44m) 3m ago 44m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:33:20.327 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (36m) 4m ago 44m 231M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:33:20.327 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (35m) 4m ago 43m 248M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:33:20.328 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (35m) 4m ago 43m 207M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:33:20.328 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (34m) 3m ago 43m 262M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:33:20.328 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (34m) 3m ago 42m 227M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:33:20.328 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (34m) 3m ago 42m 215M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:33:20.329 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (44m) 4m ago 45m 54.4M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:33:20.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.331+0000 7f9142ff5700 1 -- 172.21.15.26:0/709719128 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9128064100 msgr2=0x7f91280665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:33:20.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.331+0000 7f9142ff5700 1 --2- 172.21.15.26:0/709719128 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9128064100 0x7f91280665c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f9138004e30 tx=0x7f9138009b30).stop 2021-11-03T17:33:20.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.331+0000 7f9142ff5700 1 -- 172.21.15.26:0/709719128 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f913c0f66e0 msgr2=0x7f913c10bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:33:20.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.331+0000 7f9142ff5700 1 --2- 172.21.15.26:0/709719128 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f913c0f66e0 0x7f913c10bfa0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7f912c0026d0 tx=0x7f912c009de0).stop 2021-11-03T17:33:20.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.331+0000 7f9142ff5700 1 -- 172.21.15.26:0/709719128 shutdown_connections 2021-11-03T17:33:20.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.331+0000 7f9142ff5700 1 --2- 172.21.15.26:0/709719128 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9128064100 0x7f91280665c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:20.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.331+0000 7f9142ff5700 1 --2- 172.21.15.26:0/709719128 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f913c0f5440 0x7f913c109aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:20.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.331+0000 7f9142ff5700 1 --2- 172.21.15.26:0/709719128 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f913c0f66e0 0x7f913c10bfa0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:20.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.331+0000 7f9142ff5700 1 -- 172.21.15.26:0/709719128 >> 172.21.15.26:0/709719128 conn(0x7f913c0f0ba0 msgr2=0x7f913c0fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:33:20.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.331+0000 7f9142ff5700 1 -- 172.21.15.26:0/709719128 shutdown_connections 2021-11-03T17:33:20.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.331+0000 7f9142ff5700 1 -- 172.21.15.26:0/709719128 wait complete. 2021-11-03T17:33:20.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.430+0000 7fcb92cbd700 1 -- 172.21.15.26:0/2671456048 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb8c0f5440 msgr2=0x7fcb8c0f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:33:20.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.430+0000 7fcb92cbd700 1 --2- 172.21.15.26:0/2671456048 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb8c0f5440 0x7fcb8c0f5860 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7fcb88004660 tx=0x7fcb88009b30).stop 2021-11-03T17:33:20.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.430+0000 7fcb92cbd700 1 -- 172.21.15.26:0/2671456048 shutdown_connections 2021-11-03T17:33:20.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.430+0000 7fcb92cbd700 1 --2- 172.21.15.26:0/2671456048 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb8c0f66e0 0x7fcb8c0f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:20.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.430+0000 7fcb92cbd700 1 --2- 172.21.15.26:0/2671456048 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb8c0f5440 0x7fcb8c0f5860 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:20.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.430+0000 7fcb92cbd700 1 -- 172.21.15.26:0/2671456048 >> 172.21.15.26:0/2671456048 conn(0x7fcb8c0f0ba0 msgr2=0x7fcb8c0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:33:20.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.430+0000 7fcb92cbd700 1 -- 172.21.15.26:0/2671456048 shutdown_connections 2021-11-03T17:33:20.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.431+0000 7fcb92cbd700 1 -- 172.21.15.26:0/2671456048 wait complete. 2021-11-03T17:33:20.428 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.431+0000 7fcb92cbd700 1 Processor -- start 2021-11-03T17:33:20.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.431+0000 7fcb92cbd700 1 -- start start 2021-11-03T17:33:20.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.431+0000 7fcb92cbd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb8c0f5440 0x7fcb8c109a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:33:20.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.431+0000 7fcb92cbd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb8c0f66e0 0x7fcb8c10bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:33:20.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.431+0000 7fcb92cbd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c0603e0 con 0x7fcb8c0f66e0 2021-11-03T17:33:20.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.431+0000 7fcb92cbd700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c060520 con 0x7fcb8c0f5440 2021-11-03T17:33:20.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.431+0000 7fcb914ba700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb8c0f66e0 0x7fcb8c10bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:33:20.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.431+0000 7fcb914ba700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb8c0f66e0 0x7fcb8c10bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55068/0 (socket says 172.21.15.26:55068) 2021-11-03T17:33:20.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.431+0000 7fcb914ba700 1 -- 172.21.15.26:0/2937112326 learned_addr learned my addr 172.21.15.26:0/2937112326 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:33:20.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.432+0000 7fcb91cbb700 1 --2- 172.21.15.26:0/2937112326 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb8c0f5440 0x7fcb8c109a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:33:20.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.432+0000 7fcb914ba700 1 -- 172.21.15.26:0/2937112326 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb8c0f5440 msgr2=0x7fcb8c109a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:33:20.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.432+0000 7fcb914ba700 1 --2- 172.21.15.26:0/2937112326 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb8c0f5440 0x7fcb8c109a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:20.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.432+0000 7fcb914ba700 1 -- 172.21.15.26:0/2937112326 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb88005040 con 0x7fcb8c0f66e0 2021-11-03T17:33:20.432 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.432+0000 7fcb914ba700 1 --2- 172.21.15.26:0/2937112326 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb8c0f66e0 0x7fcb8c10bf30 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7fcb7c002700 tx=0x7fcb7c009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:33:20.432 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.432+0000 7fcb827fc700 1 -- 172.21.15.26:0/2937112326 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb7c009320 con 0x7fcb8c0f66e0 2021-11-03T17:33:20.432 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.432+0000 7fcb827fc700 1 -- 172.21.15.26:0/2937112326 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcb7c00f040 con 0x7fcb8c0f66e0 2021-11-03T17:33:20.432 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.432+0000 7fcb92cbd700 1 -- 172.21.15.26:0/2937112326 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb8c10c4e0 con 0x7fcb8c0f66e0 2021-11-03T17:33:20.432 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.432+0000 7fcb827fc700 1 -- 172.21.15.26:0/2937112326 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb7c014820 con 0x7fcb8c0f66e0 2021-11-03T17:33:20.433 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.432+0000 7fcb92cbd700 1 -- 172.21.15.26:0/2937112326 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb8c10caa0 con 0x7fcb8c0f66e0 2021-11-03T17:33:20.433 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.433+0000 7fcb92cbd700 1 -- 172.21.15.26:0/2937112326 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb8c045ad0 con 0x7fcb8c0f66e0 2021-11-03T17:33:20.433 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.433+0000 7fcb827fc700 1 -- 172.21.15.26:0/2937112326 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fcb7c009480 con 0x7fcb8c0f66e0 2021-11-03T17:33:20.433 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.434+0000 7fcb827fc700 1 --2- 172.21.15.26:0/2937112326 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcb78064100 0x7fcb780665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:33:20.434 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.434+0000 7fcb827fc700 1 -- 172.21.15.26:0/2937112326 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fcb7c080b10 con 0x7fcb8c0f66e0 2021-11-03T17:33:20.434 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.434+0000 7fcb91cbb700 1 --2- 172.21.15.26:0/2937112326 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcb78064100 0x7fcb780665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:33:20.434 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.434+0000 7fcb91cbb700 1 --2- 172.21.15.26:0/2937112326 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcb78064100 0x7fcb780665c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7fcb8c060060 tx=0x7fcb88009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:33:20.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.438+0000 7fcb827fc700 1 -- 172.21.15.26:0/2937112326 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fcb7c052e70 con 0x7fcb8c0f66e0 2021-11-03T17:33:20.658 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.664+0000 7fcb92cbd700 1 -- 172.21.15.26:0/2937112326 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcb8c027a00 con 0x7fcb8c0f66e0 2021-11-03T17:33:20.659 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.665+0000 7fcb827fc700 1 -- 172.21.15.26:0/2937112326 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fcb7c052a60 con 0x7fcb8c0f66e0 2021-11-03T17:33:20.659 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:33:20.659 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:33:20.660 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:33:20.660 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:33:20.660 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:33:20.661 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:33:20.661 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:33:20.661 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:33:20.661 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:33:20.662 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:33:20.662 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:33:20.662 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:33:20.662 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:33:20.663 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:33:20.663 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:33:20.663 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:33:20.664 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:33:20.664 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:33:20.665 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.667+0000 7fcb92cbd700 1 -- 172.21.15.26:0/2937112326 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcb78064100 msgr2=0x7fcb780665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:33:20.665 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.667+0000 7fcb92cbd700 1 --2- 172.21.15.26:0/2937112326 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcb78064100 0x7fcb780665c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7fcb8c060060 tx=0x7fcb88009b30).stop 2021-11-03T17:33:20.665 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.667+0000 7fcb92cbd700 1 -- 172.21.15.26:0/2937112326 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb8c0f66e0 msgr2=0x7fcb8c10bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:33:20.666 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.667+0000 7fcb92cbd700 1 --2- 172.21.15.26:0/2937112326 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb8c0f66e0 0x7fcb8c10bf30 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7fcb7c002700 tx=0x7fcb7c009e00).stop 2021-11-03T17:33:20.666 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.667+0000 7fcb92cbd700 1 -- 172.21.15.26:0/2937112326 shutdown_connections 2021-11-03T17:33:20.666 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.667+0000 7fcb92cbd700 1 --2- 172.21.15.26:0/2937112326 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcb78064100 0x7fcb780665c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:20.667 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.667+0000 7fcb92cbd700 1 --2- 172.21.15.26:0/2937112326 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb8c0f5440 0x7fcb8c109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:20.667 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.667+0000 7fcb92cbd700 1 --2- 172.21.15.26:0/2937112326 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb8c0f66e0 0x7fcb8c10bf30 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:20.667 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.667+0000 7fcb92cbd700 1 -- 172.21.15.26:0/2937112326 >> 172.21.15.26:0/2937112326 conn(0x7fcb8c0f0ba0 msgr2=0x7fcb8c0fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:33:20.667 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.667+0000 7fcb92cbd700 1 -- 172.21.15.26:0/2937112326 shutdown_connections 2021-11-03T17:33:20.668 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.667+0000 7fcb92cbd700 1 -- 172.21.15.26:0/2937112326 wait complete. 2021-11-03T17:33:20.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:20 smithi026 ceph-mon[96795]: pgmap v1160: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:20.745 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:20 smithi194 ceph-mon[65619]: pgmap v1160: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:20.763 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.767+0000 7fa14c839700 1 -- 172.21.15.26:0/2418533451 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1480f6870 msgr2=0x7fa1480f6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:33:20.763 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.767+0000 7fa14c839700 1 --2- 172.21.15.26:0/2418533451 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1480f6870 0x7fa1480f6cd0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7fa138004660 tx=0x7fa138009b30).stop 2021-11-03T17:33:20.763 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.767+0000 7fa14c839700 1 -- 172.21.15.26:0/2418533451 shutdown_connections 2021-11-03T17:33:20.763 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.767+0000 7fa14c839700 1 --2- 172.21.15.26:0/2418533451 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1480f6870 0x7fa1480f6cd0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:20.764 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.767+0000 7fa14c839700 1 --2- 172.21.15.26:0/2418533451 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1480f55d0 0x7fa1480f59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:20.764 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.767+0000 7fa14c839700 1 -- 172.21.15.26:0/2418533451 >> 172.21.15.26:0/2418533451 conn(0x7fa1480f0d30 msgr2=0x7fa1480f3150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:33:20.764 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.767+0000 7fa14c839700 1 -- 172.21.15.26:0/2418533451 shutdown_connections 2021-11-03T17:33:20.765 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.767+0000 7fa14c839700 1 -- 172.21.15.26:0/2418533451 wait complete. 2021-11-03T17:33:20.765 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.767+0000 7fa14c839700 1 Processor -- start 2021-11-03T17:33:20.765 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.767+0000 7fa14c839700 1 -- start start 2021-11-03T17:33:20.765 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.768+0000 7fa14c839700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1480f55d0 0x7fa148109bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:33:20.766 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.768+0000 7fa14c839700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1480f6870 0x7fa14810c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:33:20.766 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.768+0000 7fa14c839700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1480604c0 con 0x7fa1480f55d0 2021-11-03T17:33:20.766 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.768+0000 7fa14c839700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa148060600 con 0x7fa1480f6870 2021-11-03T17:33:20.766 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.768+0000 7fa14659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1480f55d0 0x7fa148109bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:33:20.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.768+0000 7fa14659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1480f55d0 0x7fa148109bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55074/0 (socket says 172.21.15.26:55074) 2021-11-03T17:33:20.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.768+0000 7fa14659c700 1 -- 172.21.15.26:0/1759752493 learned_addr learned my addr 172.21.15.26:0/1759752493 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:33:20.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.768+0000 7fa145d9b700 1 --2- 172.21.15.26:0/1759752493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1480f6870 0x7fa14810c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:33:20.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.768+0000 7fa14659c700 1 -- 172.21.15.26:0/1759752493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1480f6870 msgr2=0x7fa14810c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:33:20.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.768+0000 7fa14659c700 1 --2- 172.21.15.26:0/1759752493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1480f6870 0x7fa14810c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:20.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.768+0000 7fa14659c700 1 -- 172.21.15.26:0/1759752493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa138005040 con 0x7fa1480f55d0 2021-11-03T17:33:20.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.768+0000 7fa14659c700 1 --2- 172.21.15.26:0/1759752493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1480f55d0 0x7fa148109bf0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7fa13000e7c0 tx=0x7fa13000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:33:20.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.768+0000 7fa13effd700 1 -- 172.21.15.26:0/1759752493 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1300092e0 con 0x7fa1480f55d0 2021-11-03T17:33:20.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.768+0000 7fa13effd700 1 -- 172.21.15.26:0/1759752493 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa13000f040 con 0x7fa1480f55d0 2021-11-03T17:33:20.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.768+0000 7fa14c839700 1 -- 172.21.15.26:0/1759752493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa14810c6a0 con 0x7fa1480f55d0 2021-11-03T17:33:20.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.768+0000 7fa13effd700 1 -- 172.21.15.26:0/1759752493 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1300147e0 con 0x7fa1480f55d0 2021-11-03T17:33:20.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.768+0000 7fa14c839700 1 -- 172.21.15.26:0/1759752493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa14810cc30 con 0x7fa1480f55d0 2021-11-03T17:33:20.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.769+0000 7fa14c839700 1 -- 172.21.15.26:0/1759752493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa148045ad0 con 0x7fa1480f55d0 2021-11-03T17:33:20.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.770+0000 7fa13effd700 1 -- 172.21.15.26:0/1759752493 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fa13001b030 con 0x7fa1480f55d0 2021-11-03T17:33:20.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.770+0000 7fa13effd700 1 --2- 172.21.15.26:0/1759752493 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa1340640b0 0x7fa134066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:33:20.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.770+0000 7fa13effd700 1 -- 172.21.15.26:0/1759752493 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fa130080750 con 0x7fa1480f55d0 2021-11-03T17:33:20.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.770+0000 7fa145d9b700 1 --2- 172.21.15.26:0/1759752493 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa1340640b0 0x7fa134066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:33:20.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.771+0000 7fa145d9b700 1 --2- 172.21.15.26:0/1759752493 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa1340640b0 0x7fa134066570 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7fa138005010 tx=0x7fa138016040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:33:20.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.774+0000 7fa13effd700 1 -- 172.21.15.26:0/1759752493 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fa1300529c0 con 0x7fa1480f55d0 2021-11-03T17:33:20.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.979+0000 7fa14c839700 1 -- 172.21.15.26:0/1759752493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa1480fde60 con 0x7fa1480f55d0 2021-11-03T17:33:20.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.980+0000 7fa13effd700 1 -- 172.21.15.26:0/1759752493 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fa130019020 con 0x7fa1480f55d0 2021-11-03T17:33:20.974 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:33:20.974 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:33:20.975 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:33:20.975 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:33:20.975 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:33:20.975 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:33:20.976 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:33:20.976 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:33:20.976 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:33:20.976 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:33:20.976 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:33:20.977 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:33:20.977 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:33:20.977 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:33:20.977 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:33:20.977 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:33:20.978 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:33:20.978 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:33:20.978 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:33:20.978 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:33:20.979 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:33:20.979 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:33:20.979 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:33:20.979 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:33:20.979 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:33:20.980 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:33:20.980 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:33:20.980 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:33:20.980 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:33:20.981 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:33:20.981 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:33:20.981 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:33:20.981 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:33:20.981 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:33:20.982 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:33:20.982 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:33:20.982 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:33:20.982 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:33:20.982 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:33:20.984 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.982+0000 7fa14c839700 1 -- 172.21.15.26:0/1759752493 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa1340640b0 msgr2=0x7fa134066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:33:20.984 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.982+0000 7fa14c839700 1 --2- 172.21.15.26:0/1759752493 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa1340640b0 0x7fa134066570 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7fa138005010 tx=0x7fa138016040).stop 2021-11-03T17:33:20.984 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.982+0000 7fa14c839700 1 -- 172.21.15.26:0/1759752493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1480f55d0 msgr2=0x7fa148109bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:33:20.984 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.982+0000 7fa14c839700 1 --2- 172.21.15.26:0/1759752493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1480f55d0 0x7fa148109bf0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7fa13000e7c0 tx=0x7fa13000b040).stop 2021-11-03T17:33:20.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.982+0000 7fa14c839700 1 -- 172.21.15.26:0/1759752493 shutdown_connections 2021-11-03T17:33:20.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.982+0000 7fa14c839700 1 --2- 172.21.15.26:0/1759752493 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa1340640b0 0x7fa134066570 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:20.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.982+0000 7fa14c839700 1 --2- 172.21.15.26:0/1759752493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1480f55d0 0x7fa148109bf0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:20.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.982+0000 7fa14c839700 1 --2- 172.21.15.26:0/1759752493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1480f6870 0x7fa14810c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:20.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.982+0000 7fa14c839700 1 -- 172.21.15.26:0/1759752493 >> 172.21.15.26:0/1759752493 conn(0x7fa1480f0d30 msgr2=0x7fa1480fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:33:20.986 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.982+0000 7fa14c839700 1 -- 172.21.15.26:0/1759752493 shutdown_connections 2021-11-03T17:33:20.986 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:20.982+0000 7fa14c839700 1 -- 172.21.15.26:0/1759752493 wait complete. 2021-11-03T17:33:20.986 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:33:21.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:21 smithi026 ceph-mon[96795]: from='client.35340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:33:21.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:21 smithi026 ceph-mon[96795]: from='client.35344 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:33:21.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:21 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2937112326' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:33:21.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:21 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1759752493' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:33:21.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:21 smithi194 ceph-mon[65619]: from='client.35340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:33:21.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:21 smithi194 ceph-mon[65619]: from='client.35344 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:33:21.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:21 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2937112326' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:33:21.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:21 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1759752493' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:33:22.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:22 smithi026 ceph-mon[96795]: pgmap v1161: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:22.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:22 smithi194 ceph-mon[65619]: pgmap v1161: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:24.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:24 smithi026 ceph-mon[96795]: pgmap v1162: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:24.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:24 smithi194 ceph-mon[65619]: pgmap v1162: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:25.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:33:25.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:33:26.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:26 smithi026 ceph-mon[96795]: pgmap v1163: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:26.684 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:26 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:33:26.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:26 smithi194 ceph-mon[65619]: pgmap v1163: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:26.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:26 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:33:28.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:28 smithi026 ceph-mon[96795]: pgmap v1164: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:28.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:28 smithi194 ceph-mon[65619]: pgmap v1164: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:30.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:30 smithi026 ceph-mon[96795]: pgmap v1165: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:30.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:30 smithi194 ceph-mon[65619]: pgmap v1165: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:32.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:32 smithi026 ceph-mon[96795]: pgmap v1166: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:32.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:32 smithi194 ceph-mon[65619]: pgmap v1166: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:34.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:34 smithi026 ceph-mon[96795]: pgmap v1167: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:34.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:34 smithi194 ceph-mon[65619]: pgmap v1167: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:36.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:36 smithi026 ceph-mon[96795]: pgmap v1168: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:36.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:36 smithi194 ceph-mon[65619]: pgmap v1168: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:38.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:38 smithi026 ceph-mon[96795]: pgmap v1169: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:38.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:38 smithi194 ceph-mon[65619]: pgmap v1169: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:40.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:40 smithi026 ceph-mon[96795]: pgmap v1170: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:40.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:33:40.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:40 smithi194 ceph-mon[65619]: pgmap v1170: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:40.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:33:41.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:41 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:33:41.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:41 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:33:42.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:42 smithi026 ceph-mon[96795]: pgmap v1171: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:42.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:42 smithi194 ceph-mon[65619]: pgmap v1171: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:44.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:44 smithi026 ceph-mon[96795]: pgmap v1172: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:44.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:44 smithi194 ceph-mon[65619]: pgmap v1172: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:46.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:46 smithi026 ceph-mon[96795]: pgmap v1173: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:46.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:46 smithi194 ceph-mon[65619]: pgmap v1173: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:48 smithi026 ceph-mon[96795]: pgmap v1174: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:33:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:33:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:48 smithi194 ceph-mon[65619]: pgmap v1174: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:33:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:33:50.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:50 smithi026 ceph-mon[96795]: pgmap v1175: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:50.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:50 smithi194 ceph-mon[65619]: pgmap v1175: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:51.090 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.095+0000 7f84d6f06700 1 -- 172.21.15.26:0/3913869760 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84d00f7970 msgr2=0x7f84d00f7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:33:51.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.095+0000 7f84d6f06700 1 --2- 172.21.15.26:0/3913869760 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84d00f7970 0x7f84d00f7dd0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f84bc004660 tx=0x7f84bc009b30).stop 2021-11-03T17:33:51.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.095+0000 7f84d6f06700 1 -- 172.21.15.26:0/3913869760 shutdown_connections 2021-11-03T17:33:51.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.095+0000 7f84d6f06700 1 --2- 172.21.15.26:0/3913869760 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84d00f7970 0x7f84d00f7dd0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:51.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.095+0000 7f84d6f06700 1 --2- 172.21.15.26:0/3913869760 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84d00f66d0 0x7f84d00f6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:51.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.095+0000 7f84d6f06700 1 -- 172.21.15.26:0/3913869760 >> 172.21.15.26:0/3913869760 conn(0x7f84d00f1e10 msgr2=0x7f84d00f4250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:33:51.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.095+0000 7f84d6f06700 1 -- 172.21.15.26:0/3913869760 shutdown_connections 2021-11-03T17:33:51.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.095+0000 7f84d6f06700 1 -- 172.21.15.26:0/3913869760 wait complete. 2021-11-03T17:33:51.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.096+0000 7f84d6f06700 1 Processor -- start 2021-11-03T17:33:51.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.096+0000 7f84d6f06700 1 -- start start 2021-11-03T17:33:51.095 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.096+0000 7f84d6f06700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84d00f66d0 0x7f84d0106ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:33:51.095 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.096+0000 7f84d6f06700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84d00f7970 0x7f84d01073d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:33:51.095 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.096+0000 7f84d6f06700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d0107980 con 0x7f84d00f66d0 2021-11-03T17:33:51.095 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.096+0000 7f84d6f06700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d0107ac0 con 0x7f84d00f7970 2021-11-03T17:33:51.096 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.096+0000 7f84d4ca2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84d00f66d0 0x7f84d0106ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:33:51.096 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.096+0000 7f84d4ca2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84d00f66d0 0x7f84d0106ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55092/0 (socket says 172.21.15.26:55092) 2021-11-03T17:33:51.096 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.096+0000 7f84d4ca2700 1 -- 172.21.15.26:0/4223957549 learned_addr learned my addr 172.21.15.26:0/4223957549 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:33:51.096 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.096+0000 7f84cffff700 1 --2- 172.21.15.26:0/4223957549 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84d00f7970 0x7f84d01073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:33:51.097 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.097+0000 7f84d4ca2700 1 -- 172.21.15.26:0/4223957549 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84d00f7970 msgr2=0x7f84d01073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:33:51.097 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.097+0000 7f84d4ca2700 1 --2- 172.21.15.26:0/4223957549 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84d00f7970 0x7f84d01073d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:51.097 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.097+0000 7f84d4ca2700 1 -- 172.21.15.26:0/4223957549 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84bc005040 con 0x7f84d00f66d0 2021-11-03T17:33:51.098 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.097+0000 7f84d4ca2700 1 --2- 172.21.15.26:0/4223957549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84d00f66d0 0x7f84d0106ee0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f84c400c790 tx=0x7f84c4007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:33:51.098 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.097+0000 7f84cd7fa700 1 -- 172.21.15.26:0/4223957549 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84c400e680 con 0x7f84d00f66d0 2021-11-03T17:33:51.098 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.097+0000 7f84d6f06700 1 -- 172.21.15.26:0/4223957549 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84d0108460 con 0x7f84d00f66d0 2021-11-03T17:33:51.098 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.097+0000 7f84cd7fa700 1 -- 172.21.15.26:0/4223957549 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f84c400ec90 con 0x7f84d00f66d0 2021-11-03T17:33:51.099 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.097+0000 7f84cd7fa700 1 -- 172.21.15.26:0/4223957549 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84c4012d00 con 0x7f84d00f66d0 2021-11-03T17:33:51.099 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.097+0000 7f84d6f06700 1 -- 172.21.15.26:0/4223957549 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84d0108a20 con 0x7f84d00f66d0 2021-11-03T17:33:51.099 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.098+0000 7f84d6f06700 1 -- 172.21.15.26:0/4223957549 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84d0045ad0 con 0x7f84d00f66d0 2021-11-03T17:33:51.099 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.098+0000 7f84cd7fa700 1 -- 172.21.15.26:0/4223957549 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f84c4010070 con 0x7f84d00f66d0 2021-11-03T17:33:51.100 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.099+0000 7f84cd7fa700 1 --2- 172.21.15.26:0/4223957549 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f84c00640b0 0x7f84c0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:33:51.100 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.099+0000 7f84cd7fa700 1 -- 172.21.15.26:0/4223957549 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f84c40808e0 con 0x7f84d00f66d0 2021-11-03T17:33:51.100 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.099+0000 7f84cffff700 1 --2- 172.21.15.26:0/4223957549 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f84c00640b0 0x7f84c0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:33:51.100 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.099+0000 7f84cffff700 1 --2- 172.21.15.26:0/4223957549 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f84c00640b0 0x7f84c0066570 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f84bc004e30 tx=0x7f84bc009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:33:51.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.103+0000 7f84cd7fa700 1 -- 172.21.15.26:0/4223957549 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f84c4052af0 con 0x7f84d00f66d0 2021-11-03T17:33:51.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.280+0000 7f84d6f06700 1 -- 172.21.15.26:0/4223957549 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f84d00fefd0 con 0x7f84c00640b0 2021-11-03T17:33:51.276 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.282+0000 7f84cd7fa700 1 -- 172.21.15.26:0/4223957549 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f84d00fefd0 con 0x7f84c00640b0 2021-11-03T17:33:51.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.283+0000 7f84d6f06700 1 -- 172.21.15.26:0/4223957549 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f84c00640b0 msgr2=0x7f84c0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:33:51.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.283+0000 7f84d6f06700 1 --2- 172.21.15.26:0/4223957549 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f84c00640b0 0x7f84c0066570 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f84bc004e30 tx=0x7f84bc009b30).stop 2021-11-03T17:33:51.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.283+0000 7f84d6f06700 1 -- 172.21.15.26:0/4223957549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84d00f66d0 msgr2=0x7f84d0106ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:33:51.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.283+0000 7f84d6f06700 1 --2- 172.21.15.26:0/4223957549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84d00f66d0 0x7f84d0106ee0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f84c400c790 tx=0x7f84c4007d90).stop 2021-11-03T17:33:51.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.283+0000 7f84d6f06700 1 -- 172.21.15.26:0/4223957549 shutdown_connections 2021-11-03T17:33:51.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.283+0000 7f84d6f06700 1 --2- 172.21.15.26:0/4223957549 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f84c00640b0 0x7f84c0066570 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:51.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.283+0000 7f84d6f06700 1 --2- 172.21.15.26:0/4223957549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84d00f66d0 0x7f84d0106ee0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:51.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.283+0000 7f84d6f06700 1 --2- 172.21.15.26:0/4223957549 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84d00f7970 0x7f84d01073d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:51.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.283+0000 7f84d6f06700 1 -- 172.21.15.26:0/4223957549 >> 172.21.15.26:0/4223957549 conn(0x7f84d00f1e10 msgr2=0x7f84d00fb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:33:51.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.284+0000 7f84d6f06700 1 -- 172.21.15.26:0/4223957549 shutdown_connections 2021-11-03T17:33:51.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.284+0000 7f84d6f06700 1 -- 172.21.15.26:0/4223957549 wait complete. 2021-11-03T17:33:51.288 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:33:51.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.384+0000 7fea8cab8700 1 -- 172.21.15.26:0/3968329779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea880f6ff0 msgr2=0x7fea880f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:33:51.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.384+0000 7fea8cab8700 1 --2- 172.21.15.26:0/3968329779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea880f6ff0 0x7fea880f7a20 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7fea78004660 tx=0x7fea78009b30).stop 2021-11-03T17:33:51.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.384+0000 7fea8cab8700 1 -- 172.21.15.26:0/3968329779 shutdown_connections 2021-11-03T17:33:51.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.384+0000 7fea8cab8700 1 --2- 172.21.15.26:0/3968329779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea880f6ff0 0x7fea880f7a20 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:51.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.384+0000 7fea8cab8700 1 --2- 172.21.15.26:0/3968329779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea880f66e0 0x7fea880f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:51.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.384+0000 7fea8cab8700 1 -- 172.21.15.26:0/3968329779 >> 172.21.15.26:0/3968329779 conn(0x7fea880f1f00 msgr2=0x7fea880f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:33:51.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.384+0000 7fea8cab8700 1 -- 172.21.15.26:0/3968329779 shutdown_connections 2021-11-03T17:33:51.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.384+0000 7fea8cab8700 1 -- 172.21.15.26:0/3968329779 wait complete. 2021-11-03T17:33:51.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.384+0000 7fea8cab8700 1 Processor -- start 2021-11-03T17:33:51.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.384+0000 7fea8cab8700 1 -- start start 2021-11-03T17:33:51.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.385+0000 7fea8cab8700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea880f66e0 0x7fea8806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:33:51.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.385+0000 7fea8cab8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea880f6ff0 0x7fea88069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:33:51.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.385+0000 7fea8cab8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea8806a380 con 0x7fea880f6ff0 2021-11-03T17:33:51.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.385+0000 7fea8cab8700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea8806a4c0 con 0x7fea880f66e0 2021-11-03T17:33:51.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.385+0000 7fea85d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea880f6ff0 0x7fea88069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:33:51.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.385+0000 7fea85d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea880f6ff0 0x7fea88069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55104/0 (socket says 172.21.15.26:55104) 2021-11-03T17:33:51.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.385+0000 7fea85d9b700 1 -- 172.21.15.26:0/4135584195 learned_addr learned my addr 172.21.15.26:0/4135584195 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:33:51.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.385+0000 7fea8659c700 1 --2- 172.21.15.26:0/4135584195 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea880f66e0 0x7fea8806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:33:51.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.385+0000 7fea85d9b700 1 -- 172.21.15.26:0/4135584195 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea880f66e0 msgr2=0x7fea8806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:33:51.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.385+0000 7fea85d9b700 1 --2- 172.21.15.26:0/4135584195 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea880f66e0 0x7fea8806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:51.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.385+0000 7fea85d9b700 1 -- 172.21.15.26:0/4135584195 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea78005040 con 0x7fea880f6ff0 2021-11-03T17:33:51.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.385+0000 7fea8659c700 1 --2- 172.21.15.26:0/4135584195 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea880f66e0 0x7fea8806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:33:51.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.385+0000 7fea85d9b700 1 --2- 172.21.15.26:0/4135584195 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea880f6ff0 0x7fea88069e20 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7fea78009830 tx=0x7fea78009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:33:51.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.385+0000 7fea76ffd700 1 -- 172.21.15.26:0/4135584195 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea78018070 con 0x7fea880f6ff0 2021-11-03T17:33:51.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.385+0000 7fea76ffd700 1 -- 172.21.15.26:0/4135584195 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fea78007ba0 con 0x7fea880f6ff0 2021-11-03T17:33:51.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.385+0000 7fea8cab8700 1 -- 172.21.15.26:0/4135584195 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea8806a740 con 0x7fea880f6ff0 2021-11-03T17:33:51.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.385+0000 7fea76ffd700 1 -- 172.21.15.26:0/4135584195 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea7801c620 con 0x7fea880f6ff0 2021-11-03T17:33:51.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.385+0000 7fea8cab8700 1 -- 172.21.15.26:0/4135584195 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea8806aca0 con 0x7fea880f6ff0 2021-11-03T17:33:51.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.386+0000 7fea8cab8700 1 -- 172.21.15.26:0/4135584195 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea88045ad0 con 0x7fea880f6ff0 2021-11-03T17:33:51.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.387+0000 7fea76ffd700 1 -- 172.21.15.26:0/4135584195 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fea7801c850 con 0x7fea880f6ff0 2021-11-03T17:33:51.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.387+0000 7fea76ffd700 1 --2- 172.21.15.26:0/4135584195 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fea70064090 0x7fea70066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:33:51.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.387+0000 7fea76ffd700 1 -- 172.21.15.26:0/4135584195 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fea78082440 con 0x7fea880f6ff0 2021-11-03T17:33:51.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.387+0000 7fea8659c700 1 --2- 172.21.15.26:0/4135584195 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fea70064090 0x7fea70066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:33:51.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.388+0000 7fea8659c700 1 --2- 172.21.15.26:0/4135584195 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fea70064090 0x7fea70066550 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7fea8806b730 tx=0x7fea7c009c80).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:33:51.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.391+0000 7fea76ffd700 1 -- 172.21.15.26:0/4135584195 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fea78054860 con 0x7fea880f6ff0 2021-11-03T17:33:51.562 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.567+0000 7fea8cab8700 1 -- 172.21.15.26:0/4135584195 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fea880ff040 con 0x7fea70064090 2021-11-03T17:33:51.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.582+0000 7fea76ffd700 1 -- 172.21.15.26:0/4135584195 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fea880ff040 con 0x7fea70064090 2021-11-03T17:33:51.577 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:33:51.577 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (45m) 4m ago 46m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:33:51.577 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (37m) 4m ago 46m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:33:51.578 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (37m) 3m ago 45m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:33:51.578 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (44m) 4m ago 46m 40.3M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:33:51.578 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (38m) 4m ago 41m 22.6M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:33:51.578 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (38m) 4m ago 41m 23.5M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:33:51.579 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (41m) 3m ago 41m 24.8M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:33:51.579 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (41m) 3m ago 41m 25.0M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:33:51.579 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (38m) 4m ago 47m 520M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:33:51.579 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (38m) 3m ago 45m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:33:51.580 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (38m) 4m ago 47m 176M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:33:51.580 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (37m) 3m ago 45m 89.5M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:33:51.580 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (45m) 4m ago 45m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:33:51.580 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (45m) 3m ago 45m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:33:51.580 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (36m) 4m ago 44m 231M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:33:51.581 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (36m) 4m ago 44m 248M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:33:51.581 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (35m) 4m ago 43m 207M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:33:51.581 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (35m) 3m ago 43m 262M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:33:51.581 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (34m) 3m ago 43m 227M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:33:51.582 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (34m) 3m ago 43m 215M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:33:51.582 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (44m) 4m ago 45m 54.4M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:33:51.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.583+0000 7fea8cab8700 1 -- 172.21.15.26:0/4135584195 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fea70064090 msgr2=0x7fea70066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:33:51.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.583+0000 7fea8cab8700 1 --2- 172.21.15.26:0/4135584195 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fea70064090 0x7fea70066550 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7fea8806b730 tx=0x7fea7c009c80).stop 2021-11-03T17:33:51.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.583+0000 7fea8cab8700 1 -- 172.21.15.26:0/4135584195 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea880f6ff0 msgr2=0x7fea88069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:33:51.584 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.583+0000 7fea8cab8700 1 --2- 172.21.15.26:0/4135584195 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea880f6ff0 0x7fea88069e20 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7fea78009830 tx=0x7fea78009b30).stop 2021-11-03T17:33:51.584 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.583+0000 7fea8cab8700 1 -- 172.21.15.26:0/4135584195 shutdown_connections 2021-11-03T17:33:51.584 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.583+0000 7fea8cab8700 1 --2- 172.21.15.26:0/4135584195 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fea70064090 0x7fea70066550 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:51.584 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.583+0000 7fea8cab8700 1 --2- 172.21.15.26:0/4135584195 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea880f66e0 0x7fea8806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:51.585 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.583+0000 7fea8cab8700 1 --2- 172.21.15.26:0/4135584195 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea880f6ff0 0x7fea88069e20 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:51.585 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.583+0000 7fea8cab8700 1 -- 172.21.15.26:0/4135584195 >> 172.21.15.26:0/4135584195 conn(0x7fea880f1f00 msgr2=0x7fea880fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:33:51.585 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.584+0000 7fea8cab8700 1 -- 172.21.15.26:0/4135584195 shutdown_connections 2021-11-03T17:33:51.585 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.584+0000 7fea8cab8700 1 -- 172.21.15.26:0/4135584195 wait complete. 2021-11-03T17:33:51.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.682+0000 7f406b1ea700 1 -- 172.21.15.26:0/1399373453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40640f5440 msgr2=0x7f40640f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:33:51.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.682+0000 7f406b1ea700 1 --2- 172.21.15.26:0/1399373453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40640f5440 0x7f40640f5860 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f4054004660 tx=0x7f4054009b30).stop 2021-11-03T17:33:51.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.682+0000 7f406b1ea700 1 -- 172.21.15.26:0/1399373453 shutdown_connections 2021-11-03T17:33:51.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.682+0000 7f406b1ea700 1 --2- 172.21.15.26:0/1399373453 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40640f66e0 0x7f40640f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:51.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.682+0000 7f406b1ea700 1 --2- 172.21.15.26:0/1399373453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40640f5440 0x7f40640f5860 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:51.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.682+0000 7f406b1ea700 1 -- 172.21.15.26:0/1399373453 >> 172.21.15.26:0/1399373453 conn(0x7f40640f0ba0 msgr2=0x7f40640f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:33:51.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.682+0000 7f406b1ea700 1 -- 172.21.15.26:0/1399373453 shutdown_connections 2021-11-03T17:33:51.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.682+0000 7f406b1ea700 1 -- 172.21.15.26:0/1399373453 wait complete. 2021-11-03T17:33:51.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.683+0000 7f406b1ea700 1 Processor -- start 2021-11-03T17:33:51.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.683+0000 7f406b1ea700 1 -- start start 2021-11-03T17:33:51.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.683+0000 7f406b1ea700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40640f5440 0x7f4064106e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:33:51.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.683+0000 7f406b1ea700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40640f66e0 0x7f4064107300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:33:51.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.683+0000 7f406b1ea700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4064107900 con 0x7f40640f66e0 2021-11-03T17:33:51.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.683+0000 7f406b1ea700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4064108110 con 0x7f40640f5440 2021-11-03T17:33:51.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.683+0000 7f40699e7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40640f66e0 0x7f4064107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:33:51.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.683+0000 7f40699e7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40640f66e0 0x7f4064107300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55114/0 (socket says 172.21.15.26:55114) 2021-11-03T17:33:51.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.683+0000 7f40699e7700 1 -- 172.21.15.26:0/3250393989 learned_addr learned my addr 172.21.15.26:0/3250393989 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:33:51.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.684+0000 7f406a1e8700 1 --2- 172.21.15.26:0/3250393989 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40640f5440 0x7f4064106e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:33:51.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.684+0000 7f40699e7700 1 -- 172.21.15.26:0/3250393989 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40640f5440 msgr2=0x7f4064106e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:33:51.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.684+0000 7f40699e7700 1 --2- 172.21.15.26:0/3250393989 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40640f5440 0x7f4064106e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:51.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.684+0000 7f40699e7700 1 -- 172.21.15.26:0/3250393989 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4054005040 con 0x7f40640f66e0 2021-11-03T17:33:51.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.684+0000 7f406a1e8700 1 --2- 172.21.15.26:0/3250393989 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40640f5440 0x7f4064106e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:33:51.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.684+0000 7f40699e7700 1 --2- 172.21.15.26:0/3250393989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40640f66e0 0x7f4064107300 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f40600026d0 tx=0x7f4060009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:33:51.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.684+0000 7f405affd700 1 -- 172.21.15.26:0/3250393989 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4060009320 con 0x7f40640f66e0 2021-11-03T17:33:51.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.684+0000 7f405affd700 1 -- 172.21.15.26:0/3250393989 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f406000f040 con 0x7f40640f66e0 2021-11-03T17:33:51.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.684+0000 7f406b1ea700 1 -- 172.21.15.26:0/3250393989 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4064108390 con 0x7f40640f66e0 2021-11-03T17:33:51.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.684+0000 7f405affd700 1 -- 172.21.15.26:0/3250393989 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40600147e0 con 0x7f40640f66e0 2021-11-03T17:33:51.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.684+0000 7f406b1ea700 1 -- 172.21.15.26:0/3250393989 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4064108950 con 0x7f40640f66e0 2021-11-03T17:33:51.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.685+0000 7f406b1ea700 1 -- 172.21.15.26:0/3250393989 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4064059100 con 0x7f40640f66e0 2021-11-03T17:33:51.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.685+0000 7f405affd700 1 -- 172.21.15.26:0/3250393989 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f4060009480 con 0x7f40640f66e0 2021-11-03T17:33:51.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.686+0000 7f405affd700 1 --2- 172.21.15.26:0/3250393989 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f404c064100 0x7f404c0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:33:51.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.686+0000 7f405affd700 1 -- 172.21.15.26:0/3250393989 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f4060080eb0 con 0x7f40640f66e0 2021-11-03T17:33:51.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.686+0000 7f406a1e8700 1 --2- 172.21.15.26:0/3250393989 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f404c064100 0x7f404c0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:33:51.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.686+0000 7f406a1e8700 1 --2- 172.21.15.26:0/3250393989 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f404c064100 0x7f404c0665c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f4054009830 tx=0x7f4054009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:33:51.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.690+0000 7f405affd700 1 -- 172.21.15.26:0/3250393989 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f4060053210 con 0x7f40640f66e0 2021-11-03T17:33:51.913 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.919+0000 7f406b1ea700 1 -- 172.21.15.26:0/3250393989 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f40640fee00 con 0x7f40640f66e0 2021-11-03T17:33:51.914 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.919+0000 7f405affd700 1 -- 172.21.15.26:0/3250393989 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f4060052e00 con 0x7f40640f66e0 2021-11-03T17:33:51.915 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:33:51.915 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:33:51.915 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:33:51.915 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:33:51.916 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:33:51.916 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:33:51.916 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:33:51.916 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:33:51.917 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:33:51.917 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:33:51.917 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:33:51.917 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:33:51.917 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:33:51.918 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:33:51.918 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:33:51.918 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:33:51.918 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:33:51.919 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:33:51.919 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.921+0000 7f406b1ea700 1 -- 172.21.15.26:0/3250393989 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f404c064100 msgr2=0x7f404c0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:33:51.920 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.921+0000 7f406b1ea700 1 --2- 172.21.15.26:0/3250393989 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f404c064100 0x7f404c0665c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f4054009830 tx=0x7f4054009b30).stop 2021-11-03T17:33:51.920 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.921+0000 7f406b1ea700 1 -- 172.21.15.26:0/3250393989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40640f66e0 msgr2=0x7f4064107300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:33:51.920 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.921+0000 7f406b1ea700 1 --2- 172.21.15.26:0/3250393989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40640f66e0 0x7f4064107300 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f40600026d0 tx=0x7f4060009de0).stop 2021-11-03T17:33:51.921 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.921+0000 7f406b1ea700 1 -- 172.21.15.26:0/3250393989 shutdown_connections 2021-11-03T17:33:51.921 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.921+0000 7f406b1ea700 1 --2- 172.21.15.26:0/3250393989 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f404c064100 0x7f404c0665c0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:51.921 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.921+0000 7f406b1ea700 1 --2- 172.21.15.26:0/3250393989 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40640f5440 0x7f4064106e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:51.921 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.921+0000 7f406b1ea700 1 --2- 172.21.15.26:0/3250393989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40640f66e0 0x7f4064107300 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:51.922 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.921+0000 7f406b1ea700 1 -- 172.21.15.26:0/3250393989 >> 172.21.15.26:0/3250393989 conn(0x7f40640f0ba0 msgr2=0x7f40640fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:33:51.922 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.921+0000 7f406b1ea700 1 -- 172.21.15.26:0/3250393989 shutdown_connections 2021-11-03T17:33:51.922 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:51.921+0000 7f406b1ea700 1 -- 172.21.15.26:0/3250393989 wait complete. 2021-11-03T17:33:52.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.020+0000 7f37c15ce700 1 -- 172.21.15.26:0/464392565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37bc0f6860 msgr2=0x7f37bc0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:33:52.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.021+0000 7f37c15ce700 1 --2- 172.21.15.26:0/464392565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37bc0f6860 0x7f37bc0f6cc0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f37b0004660 tx=0x7f37b0009b30).stop 2021-11-03T17:33:52.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.021+0000 7f37c15ce700 1 -- 172.21.15.26:0/464392565 shutdown_connections 2021-11-03T17:33:52.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.021+0000 7f37c15ce700 1 --2- 172.21.15.26:0/464392565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37bc0f6860 0x7f37bc0f6cc0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:52.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.021+0000 7f37c15ce700 1 --2- 172.21.15.26:0/464392565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37bc0f55c0 0x7f37bc0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:52.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.021+0000 7f37c15ce700 1 -- 172.21.15.26:0/464392565 >> 172.21.15.26:0/464392565 conn(0x7f37bc0f0d40 msgr2=0x7f37bc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:33:52.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.021+0000 7f37c15ce700 1 -- 172.21.15.26:0/464392565 shutdown_connections 2021-11-03T17:33:52.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.021+0000 7f37c15ce700 1 -- 172.21.15.26:0/464392565 wait complete. 2021-11-03T17:33:52.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.021+0000 7f37c15ce700 1 Processor -- start 2021-11-03T17:33:52.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.021+0000 7f37c15ce700 1 -- start start 2021-11-03T17:33:52.021 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.022+0000 7f37c15ce700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37bc0f55c0 0x7f37bc109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:33:52.021 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.022+0000 7f37c15ce700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37bc0f6860 0x7f37bc10c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:33:52.021 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.022+0000 7f37c15ce700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc0603c0 con 0x7f37bc0f55c0 2021-11-03T17:33:52.021 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.022+0000 7f37c15ce700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc060500 con 0x7f37bc0f6860 2021-11-03T17:33:52.021 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.022+0000 7f37baffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37bc0f55c0 0x7f37bc109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:33:52.022 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.022+0000 7f37baffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37bc0f55c0 0x7f37bc109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55122/0 (socket says 172.21.15.26:55122) 2021-11-03T17:33:52.022 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.022+0000 7f37baffd700 1 -- 172.21.15.26:0/2460478735 learned_addr learned my addr 172.21.15.26:0/2460478735 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:33:52.022 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.022+0000 7f37ba7fc700 1 --2- 172.21.15.26:0/2460478735 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37bc0f6860 0x7f37bc10c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:33:52.022 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.022+0000 7f37baffd700 1 -- 172.21.15.26:0/2460478735 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37bc0f6860 msgr2=0x7f37bc10c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:33:52.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.022+0000 7f37baffd700 1 --2- 172.21.15.26:0/2460478735 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37bc0f6860 0x7f37bc10c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:52.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.022+0000 7f37baffd700 1 -- 172.21.15.26:0/2460478735 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b0005040 con 0x7f37bc0f55c0 2021-11-03T17:33:52.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.022+0000 7f37ba7fc700 1 --2- 172.21.15.26:0/2460478735 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37bc0f6860 0x7f37bc10c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:33:52.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.022+0000 7f37baffd700 1 --2- 172.21.15.26:0/2460478735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37bc0f55c0 0x7f37bc109c70 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f37b400c710 tx=0x7f37b4004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:33:52.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.022+0000 7f37a37fe700 1 -- 172.21.15.26:0/2460478735 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37b40106f0 con 0x7f37bc0f55c0 2021-11-03T17:33:52.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.022+0000 7f37c15ce700 1 -- 172.21.15.26:0/2460478735 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37bc10c720 con 0x7f37bc0f55c0 2021-11-03T17:33:52.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.022+0000 7f37a37fe700 1 -- 172.21.15.26:0/2460478735 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f37b4010d00 con 0x7f37bc0f55c0 2021-11-03T17:33:52.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.022+0000 7f37a37fe700 1 -- 172.21.15.26:0/2460478735 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37b4012d90 con 0x7f37bc0f55c0 2021-11-03T17:33:52.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.022+0000 7f37c15ce700 1 -- 172.21.15.26:0/2460478735 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37bc10ccb0 con 0x7f37bc0f55c0 2021-11-03T17:33:52.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.023+0000 7f37c15ce700 1 -- 172.21.15.26:0/2460478735 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37bc0f49b0 con 0x7f37bc0f55c0 2021-11-03T17:33:52.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.024+0000 7f37a37fe700 1 -- 172.21.15.26:0/2460478735 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f37b4010070 con 0x7f37bc0f55c0 2021-11-03T17:33:52.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.024+0000 7f37a37fe700 1 --2- 172.21.15.26:0/2460478735 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f37a40640b0 0x7f37a4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:33:52.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.024+0000 7f37a37fe700 1 -- 172.21.15.26:0/2460478735 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f37b4080d50 con 0x7f37bc0f55c0 2021-11-03T17:33:52.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.024+0000 7f37ba7fc700 1 --2- 172.21.15.26:0/2460478735 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f37a40640b0 0x7f37a4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:33:52.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.025+0000 7f37ba7fc700 1 --2- 172.21.15.26:0/2460478735 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f37a40640b0 0x7f37a4066570 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f37b0004e30 tx=0x7f37b0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:33:52.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.028+0000 7f37a37fe700 1 -- 172.21.15.26:0/2460478735 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f37b4053080 con 0x7f37bc0f55c0 2021-11-03T17:33:52.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.231+0000 7f37c15ce700 1 -- 172.21.15.26:0/2460478735 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f37bc0586e0 con 0x7f37bc0f55c0 2021-11-03T17:33:52.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.231+0000 7f37a37fe700 1 -- 172.21.15.26:0/2460478735 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f37b4052c70 con 0x7f37bc0f55c0 2021-11-03T17:33:52.227 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:33:52.227 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:33:52.227 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:33:52.228 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:33:52.228 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:33:52.228 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:33:52.228 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:33:52.229 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:33:52.229 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:33:52.229 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:33:52.229 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:33:52.229 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:33:52.230 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:33:52.230 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:33:52.230 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:33:52.230 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:33:52.231 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:33:52.231 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:33:52.231 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:33:52.231 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:33:52.231 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:33:52.232 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:33:52.232 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:33:52.232 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:33:52.232 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:33:52.233 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:33:52.233 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:33:52.233 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:33:52.233 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:33:52.233 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:33:52.234 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:33:52.234 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:33:52.234 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:33:52.234 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:33:52.235 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:33:52.235 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:33:52.235 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:33:52.235 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:33:52.235 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:33:52.236 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.233+0000 7f37c15ce700 1 -- 172.21.15.26:0/2460478735 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f37a40640b0 msgr2=0x7f37a4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:33:52.236 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.233+0000 7f37c15ce700 1 --2- 172.21.15.26:0/2460478735 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f37a40640b0 0x7f37a4066570 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f37b0004e30 tx=0x7f37b0009b30).stop 2021-11-03T17:33:52.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.233+0000 7f37c15ce700 1 -- 172.21.15.26:0/2460478735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37bc0f55c0 msgr2=0x7f37bc109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:33:52.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.233+0000 7f37c15ce700 1 --2- 172.21.15.26:0/2460478735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37bc0f55c0 0x7f37bc109c70 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f37b400c710 tx=0x7f37b4004d10).stop 2021-11-03T17:33:52.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.233+0000 7f37c15ce700 1 -- 172.21.15.26:0/2460478735 shutdown_connections 2021-11-03T17:33:52.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.233+0000 7f37c15ce700 1 --2- 172.21.15.26:0/2460478735 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f37a40640b0 0x7f37a4066570 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:52.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.233+0000 7f37c15ce700 1 --2- 172.21.15.26:0/2460478735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37bc0f55c0 0x7f37bc109c70 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:52.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.233+0000 7f37c15ce700 1 --2- 172.21.15.26:0/2460478735 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37bc0f6860 0x7f37bc10c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:33:52.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.233+0000 7f37c15ce700 1 -- 172.21.15.26:0/2460478735 >> 172.21.15.26:0/2460478735 conn(0x7f37bc0f0d40 msgr2=0x7f37bc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:33:52.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.233+0000 7f37c15ce700 1 -- 172.21.15.26:0/2460478735 shutdown_connections 2021-11-03T17:33:52.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:33:52.234+0000 7f37c15ce700 1 -- 172.21.15.26:0/2460478735 wait complete. 2021-11-03T17:33:52.239 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:33:52.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:52 smithi026 ceph-mon[96795]: pgmap v1176: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:52.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:52 smithi026 ceph-mon[96795]: from='client.35356 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:33:52.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:52 smithi026 ceph-mon[96795]: from='client.35360 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:33:52.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:52 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3250393989' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:33:52.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:52 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2460478735' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:33:52.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:52 smithi194 ceph-mon[65619]: pgmap v1176: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:52.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:52 smithi194 ceph-mon[65619]: from='client.35356 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:33:52.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:52 smithi194 ceph-mon[65619]: from='client.35360 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:33:52.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:52 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3250393989' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:33:52.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:52 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2460478735' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:33:54.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:54 smithi026 ceph-mon[96795]: pgmap v1177: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:54.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:54 smithi194 ceph-mon[65619]: pgmap v1177: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:55.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:33:55.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:33:56.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:56 smithi026 ceph-mon[96795]: pgmap v1178: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:56.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:56 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:33:56.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:56 smithi194 ceph-mon[65619]: pgmap v1178: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:56.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:56 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:33:58.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:33:58 smithi026 ceph-mon[96795]: pgmap v1179: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:33:58.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:33:58 smithi194 ceph-mon[65619]: pgmap v1179: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:00.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:00 smithi026 ceph-mon[96795]: pgmap v1180: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:00.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:00 smithi194 ceph-mon[65619]: pgmap v1180: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:02.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:02 smithi026 ceph-mon[96795]: pgmap v1181: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:02.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:02 smithi194 ceph-mon[65619]: pgmap v1181: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:04.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:04 smithi194 ceph-mon[65619]: pgmap v1182: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:04.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:04 smithi026 ceph-mon[96795]: pgmap v1182: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:06.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:06 smithi194 ceph-mon[65619]: pgmap v1183: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:06.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:06 smithi026 ceph-mon[96795]: pgmap v1183: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:08.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:08 smithi194 ceph-mon[65619]: pgmap v1184: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:08.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:08 smithi026 ceph-mon[96795]: pgmap v1184: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:10.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:10 smithi194 ceph-mon[65619]: pgmap v1185: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:10.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:10 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:34:10.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:10 smithi026 ceph-mon[96795]: pgmap v1185: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:10.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:10 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:34:11.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:11 smithi194 ceph-mon[65619]: poll took 60068.699 ms: 1 events 2021-11-03T17:34:11.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:11 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:34:11.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:11 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:34:11.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:11 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:34:11.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:11 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:34:11.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:11 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:34:11.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:11 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:34:11.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:11 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:34:11.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:11 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:34:11.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:11 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:34:11.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:11 smithi026 ceph-mon[96795]: poll took 60068.699 ms: 1 events 2021-11-03T17:34:11.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:11 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:34:11.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:11 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:34:11.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:11 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:34:11.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:11 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:34:11.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:11 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:34:11.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:11 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:34:11.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:11 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:34:11.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:11 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:34:11.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:11 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:34:12.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:12 smithi194 ceph-mon[65619]: pgmap v1186: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:12.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:12 smithi026 ceph-mon[96795]: pgmap v1186: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:14.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:14 smithi194 ceph-mon[65619]: pgmap v1187: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:14.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:14 smithi026 ceph-mon[96795]: pgmap v1187: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:16.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:16 smithi194 ceph-mon[65619]: pgmap v1188: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:16.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:16 smithi026 ceph-mon[96795]: pgmap v1188: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:18.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:18 smithi194 ceph-mon[65619]: pgmap v1189: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:18.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:18 smithi026 ceph-mon[96795]: pgmap v1189: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:20.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:20 smithi194 ceph-mon[65619]: pgmap v1190: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:20.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:20 smithi026 ceph-mon[96795]: pgmap v1190: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:22.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.349+0000 7ff961167700 1 -- 172.21.15.26:0/3140081381 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff95c0f5ef0 msgr2=0x7ff95c0f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:34:22.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.349+0000 7ff961167700 1 --2- 172.21.15.26:0/3140081381 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff95c0f5ef0 0x7ff95c0f6920 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7ff944004660 tx=0x7ff944009b30).stop 2021-11-03T17:34:22.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.349+0000 7ff961167700 1 -- 172.21.15.26:0/3140081381 shutdown_connections 2021-11-03T17:34:22.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.349+0000 7ff961167700 1 --2- 172.21.15.26:0/3140081381 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff95c0f5ef0 0x7ff95c0f6920 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:22.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.349+0000 7ff961167700 1 --2- 172.21.15.26:0/3140081381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff95c0f55e0 0x7ff95c0f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:22.347 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.349+0000 7ff961167700 1 -- 172.21.15.26:0/3140081381 >> 172.21.15.26:0/3140081381 conn(0x7ff95c0f0de0 msgr2=0x7ff95c0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:34:22.347 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.349+0000 7ff961167700 1 -- 172.21.15.26:0/3140081381 shutdown_connections 2021-11-03T17:34:22.347 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.349+0000 7ff961167700 1 -- 172.21.15.26:0/3140081381 wait complete. 2021-11-03T17:34:22.347 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.350+0000 7ff961167700 1 Processor -- start 2021-11-03T17:34:22.348 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.350+0000 7ff961167700 1 -- start start 2021-11-03T17:34:22.348 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.350+0000 7ff961167700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff95c0f55e0 0x7ff95c109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:34:22.348 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.350+0000 7ff961167700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff95c0f5ef0 0x7ff95c10c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:34:22.348 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.350+0000 7ff961167700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95c060520 con 0x7ff95c0f5ef0 2021-11-03T17:34:22.349 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.350+0000 7ff961167700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95c060660 con 0x7ff95c0f55e0 2021-11-03T17:34:22.349 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.350+0000 7ff95a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff95c0f5ef0 0x7ff95c10c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:34:22.349 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.350+0000 7ff95a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff95c0f5ef0 0x7ff95c10c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55142/0 (socket says 172.21.15.26:55142) 2021-11-03T17:34:22.349 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.350+0000 7ff95a59c700 1 -- 172.21.15.26:0/65831925 learned_addr learned my addr 172.21.15.26:0/65831925 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:34:22.349 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.350+0000 7ff95ad9d700 1 --2- 172.21.15.26:0/65831925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff95c0f55e0 0x7ff95c109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:34:22.350 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.351+0000 7ff95a59c700 1 -- 172.21.15.26:0/65831925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff95c0f55e0 msgr2=0x7ff95c109c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:34:22.350 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.351+0000 7ff95a59c700 1 --2- 172.21.15.26:0/65831925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff95c0f55e0 0x7ff95c109c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:22.350 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.351+0000 7ff95a59c700 1 -- 172.21.15.26:0/65831925 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff944005040 con 0x7ff95c0f5ef0 2021-11-03T17:34:22.350 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.351+0000 7ff95a59c700 1 --2- 172.21.15.26:0/65831925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff95c0f5ef0 0x7ff95c10c150 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7ff944009990 tx=0x7ff944009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:34:22.351 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.351+0000 7ff9537fe700 1 -- 172.21.15.26:0/65831925 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff944018070 con 0x7ff95c0f5ef0 2021-11-03T17:34:22.351 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.351+0000 7ff961167700 1 -- 172.21.15.26:0/65831925 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff95c10c700 con 0x7ff95c0f5ef0 2021-11-03T17:34:22.351 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.351+0000 7ff9537fe700 1 -- 172.21.15.26:0/65831925 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff944007ba0 con 0x7ff95c0f5ef0 2021-11-03T17:34:22.351 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.351+0000 7ff9537fe700 1 -- 172.21.15.26:0/65831925 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff94401c3c0 con 0x7ff95c0f5ef0 2021-11-03T17:34:22.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.351+0000 7ff961167700 1 -- 172.21.15.26:0/65831925 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff95c10cc30 con 0x7ff95c0f5ef0 2021-11-03T17:34:22.353 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.352+0000 7ff961167700 1 -- 172.21.15.26:0/65831925 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff95c045ad0 con 0x7ff95c0f5ef0 2021-11-03T17:34:22.353 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.353+0000 7ff9537fe700 1 -- 172.21.15.26:0/65831925 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ff94401d420 con 0x7ff95c0f5ef0 2021-11-03T17:34:22.353 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.353+0000 7ff9537fe700 1 --2- 172.21.15.26:0/65831925 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff9480640b0 0x7ff948066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:34:22.353 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.353+0000 7ff9537fe700 1 -- 172.21.15.26:0/65831925 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ff9440826b0 con 0x7ff95c0f5ef0 2021-11-03T17:34:22.354 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.353+0000 7ff95ad9d700 1 --2- 172.21.15.26:0/65831925 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff9480640b0 0x7ff948066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:34:22.354 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.354+0000 7ff95ad9d700 1 --2- 172.21.15.26:0/65831925 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff9480640b0 0x7ff948066570 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7ff95c0601a0 tx=0x7ff954009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:34:22.354 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.357+0000 7ff9537fe700 1 -- 172.21.15.26:0/65831925 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ff944054a10 con 0x7ff95c0f5ef0 2021-11-03T17:34:22.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.535+0000 7ff961167700 1 -- 172.21.15.26:0/65831925 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff95c0fdf80 con 0x7ff9480640b0 2021-11-03T17:34:22.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.536+0000 7ff9537fe700 1 -- 172.21.15.26:0/65831925 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7ff95400f040 con 0x7ff9480640b0 2021-11-03T17:34:22.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.538+0000 7ff961167700 1 -- 172.21.15.26:0/65831925 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff9480640b0 msgr2=0x7ff948066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:34:22.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.538+0000 7ff961167700 1 --2- 172.21.15.26:0/65831925 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff9480640b0 0x7ff948066570 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7ff95c0601a0 tx=0x7ff954009040).stop 2021-11-03T17:34:22.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.538+0000 7ff961167700 1 -- 172.21.15.26:0/65831925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff95c0f5ef0 msgr2=0x7ff95c10c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:34:22.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.538+0000 7ff961167700 1 --2- 172.21.15.26:0/65831925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff95c0f5ef0 0x7ff95c10c150 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7ff944009990 tx=0x7ff944009b30).stop 2021-11-03T17:34:22.533 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.538+0000 7ff961167700 1 -- 172.21.15.26:0/65831925 shutdown_connections 2021-11-03T17:34:22.533 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.538+0000 7ff961167700 1 --2- 172.21.15.26:0/65831925 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff9480640b0 0x7ff948066570 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:22.533 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.538+0000 7ff961167700 1 --2- 172.21.15.26:0/65831925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff95c0f55e0 0x7ff95c109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:22.533 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.538+0000 7ff961167700 1 --2- 172.21.15.26:0/65831925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff95c0f5ef0 0x7ff95c10c150 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:22.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.538+0000 7ff961167700 1 -- 172.21.15.26:0/65831925 >> 172.21.15.26:0/65831925 conn(0x7ff95c0f0de0 msgr2=0x7ff95c0fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:34:22.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.538+0000 7ff961167700 1 -- 172.21.15.26:0/65831925 shutdown_connections 2021-11-03T17:34:22.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.538+0000 7ff961167700 1 -- 172.21.15.26:0/65831925 wait complete. 2021-11-03T17:34:22.542 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:34:22.638 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.639+0000 7fd19666b700 1 -- 172.21.15.26:0/4020908013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1900f55c0 msgr2=0x7fd1900f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:34:22.638 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.639+0000 7fd19666b700 1 --2- 172.21.15.26:0/4020908013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1900f55c0 0x7fd1900f59e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7fd184004660 tx=0x7fd184009b30).stop 2021-11-03T17:34:22.639 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.639+0000 7fd19666b700 1 -- 172.21.15.26:0/4020908013 shutdown_connections 2021-11-03T17:34:22.639 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.639+0000 7fd19666b700 1 --2- 172.21.15.26:0/4020908013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1900f6860 0x7fd1900f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:22.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.639+0000 7fd19666b700 1 --2- 172.21.15.26:0/4020908013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1900f55c0 0x7fd1900f59e0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:22.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.639+0000 7fd19666b700 1 -- 172.21.15.26:0/4020908013 >> 172.21.15.26:0/4020908013 conn(0x7fd1900f0d40 msgr2=0x7fd1900f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:34:22.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.639+0000 7fd19666b700 1 -- 172.21.15.26:0/4020908013 shutdown_connections 2021-11-03T17:34:22.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.639+0000 7fd19666b700 1 -- 172.21.15.26:0/4020908013 wait complete. 2021-11-03T17:34:22.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.640+0000 7fd19666b700 1 Processor -- start 2021-11-03T17:34:22.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.640+0000 7fd19666b700 1 -- start start 2021-11-03T17:34:22.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.640+0000 7fd19666b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1900f55c0 0x7fd190109ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:34:22.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.640+0000 7fd19666b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1900f6860 0x7fd19010c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:34:22.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.640+0000 7fd19666b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1900604e0 con 0x7fd1900f55c0 2021-11-03T17:34:22.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.640+0000 7fd19666b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd190060620 con 0x7fd1900f6860 2021-11-03T17:34:22.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.640+0000 7fd18ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1900f55c0 0x7fd190109ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:34:22.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.640+0000 7fd18ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1900f55c0 0x7fd190109ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55150/0 (socket says 172.21.15.26:55150) 2021-11-03T17:34:22.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.640+0000 7fd18ffff700 1 -- 172.21.15.26:0/1266522934 learned_addr learned my addr 172.21.15.26:0/1266522934 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:34:22.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.640+0000 7fd18f7fe700 1 --2- 172.21.15.26:0/1266522934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1900f6860 0x7fd19010c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:34:22.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.640+0000 7fd18ffff700 1 -- 172.21.15.26:0/1266522934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1900f6860 msgr2=0x7fd19010c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:34:22.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.640+0000 7fd18ffff700 1 --2- 172.21.15.26:0/1266522934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1900f6860 0x7fd19010c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:22.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.640+0000 7fd18ffff700 1 -- 172.21.15.26:0/1266522934 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd184005040 con 0x7fd1900f55c0 2021-11-03T17:34:22.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.640+0000 7fd18f7fe700 1 --2- 172.21.15.26:0/1266522934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1900f6860 0x7fd19010c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:34:22.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.640+0000 7fd18ffff700 1 --2- 172.21.15.26:0/1266522934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1900f55c0 0x7fd190109ce0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7fd184009830 tx=0x7fd184009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:34:22.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.641+0000 7fd18cff9700 1 -- 172.21.15.26:0/1266522934 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd184018070 con 0x7fd1900f55c0 2021-11-03T17:34:22.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.641+0000 7fd19666b700 1 -- 172.21.15.26:0/1266522934 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd19010c730 con 0x7fd1900f55c0 2021-11-03T17:34:22.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.641+0000 7fd18cff9700 1 -- 172.21.15.26:0/1266522934 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd184007ba0 con 0x7fd1900f55c0 2021-11-03T17:34:22.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.641+0000 7fd18cff9700 1 -- 172.21.15.26:0/1266522934 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd18401c620 con 0x7fd1900f55c0 2021-11-03T17:34:22.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.641+0000 7fd19666b700 1 -- 172.21.15.26:0/1266522934 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd19010cc60 con 0x7fd1900f55c0 2021-11-03T17:34:22.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.642+0000 7fd19666b700 1 -- 172.21.15.26:0/1266522934 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd190045ad0 con 0x7fd1900f55c0 2021-11-03T17:34:22.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.642+0000 7fd18cff9700 1 -- 172.21.15.26:0/1266522934 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fd184007d10 con 0x7fd1900f55c0 2021-11-03T17:34:22.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.643+0000 7fd18cff9700 1 --2- 172.21.15.26:0/1266522934 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd178064090 0x7fd178066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:34:22.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.643+0000 7fd18cff9700 1 -- 172.21.15.26:0/1266522934 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fd184082720 con 0x7fd1900f55c0 2021-11-03T17:34:22.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.643+0000 7fd18f7fe700 1 --2- 172.21.15.26:0/1266522934 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd178064090 0x7fd178066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:34:22.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.643+0000 7fd18f7fe700 1 --2- 172.21.15.26:0/1266522934 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd178064090 0x7fd178066550 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7fd180009fd0 tx=0x7fd18000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:34:22.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.647+0000 7fd18cff9700 1 -- 172.21.15.26:0/1266522934 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fd184054b40 con 0x7fd1900f55c0 2021-11-03T17:34:22.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:22 smithi194 ceph-mon[65619]: pgmap v1191: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:22.811 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.817+0000 7fd19666b700 1 -- 172.21.15.26:0/1266522934 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd190057f10 con 0x7fd178064090 2021-11-03T17:34:22.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.831+0000 7fd18cff9700 1 -- 172.21.15.26:0/1266522934 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fd190057f10 con 0x7fd178064090 2021-11-03T17:34:22.826 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:34:22.826 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (45m) 5m ago 46m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:34:22.826 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (37m) 5m ago 46m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:34:22.826 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (37m) 4m ago 46m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:34:22.827 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (45m) 5m ago 46m 40.3M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:34:22.827 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (38m) 5m ago 41m 22.6M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:34:22.827 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (38m) 5m ago 41m 23.5M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:34:22.827 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (42m) 4m ago 42m 24.8M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:34:22.828 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (41m) 4m ago 41m 25.0M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:34:22.828 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (39m) 5m ago 48m 520M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:34:22.828 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (38m) 4m ago 46m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:34:22.828 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (38m) 5m ago 48m 176M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:34:22.828 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (38m) 4m ago 45m 89.5M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:34:22.829 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (46m) 5m ago 46m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:34:22.829 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (45m) 4m ago 45m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:34:22.829 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (37m) 5m ago 45m 231M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:34:22.829 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (36m) 5m ago 44m 248M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:34:22.830 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (36m) 5m ago 44m 207M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:34:22.830 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (35m) 4m ago 44m 262M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:34:22.830 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (35m) 4m ago 43m 227M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:34:22.830 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (35m) 4m ago 43m 215M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:34:22.830 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (45m) 5m ago 46m 54.4M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:34:22.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.833+0000 7fd19666b700 1 -- 172.21.15.26:0/1266522934 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd178064090 msgr2=0x7fd178066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:34:22.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.833+0000 7fd19666b700 1 --2- 172.21.15.26:0/1266522934 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd178064090 0x7fd178066550 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7fd180009fd0 tx=0x7fd18000b040).stop 2021-11-03T17:34:22.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.833+0000 7fd19666b700 1 -- 172.21.15.26:0/1266522934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1900f55c0 msgr2=0x7fd190109ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:34:22.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.833+0000 7fd19666b700 1 --2- 172.21.15.26:0/1266522934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1900f55c0 0x7fd190109ce0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7fd184009830 tx=0x7fd184009b30).stop 2021-11-03T17:34:22.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.833+0000 7fd19666b700 1 -- 172.21.15.26:0/1266522934 shutdown_connections 2021-11-03T17:34:22.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.833+0000 7fd19666b700 1 --2- 172.21.15.26:0/1266522934 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd178064090 0x7fd178066550 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:22.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.833+0000 7fd19666b700 1 --2- 172.21.15.26:0/1266522934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1900f55c0 0x7fd190109ce0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:22.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.833+0000 7fd19666b700 1 --2- 172.21.15.26:0/1266522934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1900f6860 0x7fd19010c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:22.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.833+0000 7fd19666b700 1 -- 172.21.15.26:0/1266522934 >> 172.21.15.26:0/1266522934 conn(0x7fd1900f0d40 msgr2=0x7fd1900fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:34:22.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.833+0000 7fd19666b700 1 -- 172.21.15.26:0/1266522934 shutdown_connections 2021-11-03T17:34:22.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.833+0000 7fd19666b700 1 -- 172.21.15.26:0/1266522934 wait complete. 2021-11-03T17:34:22.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:22 smithi026 ceph-mon[96795]: pgmap v1191: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:22.928 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.933+0000 7f0f7f524700 1 -- 172.21.15.26:0/1860063859 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f780f6860 msgr2=0x7f0f780f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:34:22.928 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.933+0000 7f0f7f524700 1 --2- 172.21.15.26:0/1860063859 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f780f6860 0x7f0f780f6cc0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f0f6c004660 tx=0x7f0f6c009b30).stop 2021-11-03T17:34:22.929 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.933+0000 7f0f7f524700 1 -- 172.21.15.26:0/1860063859 shutdown_connections 2021-11-03T17:34:22.929 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.933+0000 7f0f7f524700 1 --2- 172.21.15.26:0/1860063859 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f780f6860 0x7f0f780f6cc0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:22.929 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.933+0000 7f0f7f524700 1 --2- 172.21.15.26:0/1860063859 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f780f55c0 0x7f0f780f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:22.929 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.933+0000 7f0f7f524700 1 -- 172.21.15.26:0/1860063859 >> 172.21.15.26:0/1860063859 conn(0x7f0f780f0d40 msgr2=0x7f0f780f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:34:22.930 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.933+0000 7f0f7f524700 1 -- 172.21.15.26:0/1860063859 shutdown_connections 2021-11-03T17:34:22.930 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.933+0000 7f0f7f524700 1 -- 172.21.15.26:0/1860063859 wait complete. 2021-11-03T17:34:22.931 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.933+0000 7f0f7f524700 1 Processor -- start 2021-11-03T17:34:22.931 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.933+0000 7f0f7f524700 1 -- start start 2021-11-03T17:34:22.931 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.934+0000 7f0f7f524700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f780f55c0 0x7f0f78109c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:34:22.931 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.934+0000 7f0f7f524700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f780f6860 0x7f0f7810c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:34:22.931 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.934+0000 7f0f7f524700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f780603e0 con 0x7f0f780f55c0 2021-11-03T17:34:22.932 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.934+0000 7f0f7f524700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f78060520 con 0x7f0f780f6860 2021-11-03T17:34:22.932 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.934+0000 7f0f7d2c0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f780f55c0 0x7f0f78109c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:34:22.932 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.934+0000 7f0f7d2c0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f780f55c0 0x7f0f78109c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55160/0 (socket says 172.21.15.26:55160) 2021-11-03T17:34:22.932 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.934+0000 7f0f7d2c0700 1 -- 172.21.15.26:0/2467355681 learned_addr learned my addr 172.21.15.26:0/2467355681 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:34:22.933 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.934+0000 7f0f7cabf700 1 --2- 172.21.15.26:0/2467355681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f780f6860 0x7f0f7810c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:34:22.933 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.934+0000 7f0f7d2c0700 1 -- 172.21.15.26:0/2467355681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f780f6860 msgr2=0x7f0f7810c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:34:22.933 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.934+0000 7f0f7d2c0700 1 --2- 172.21.15.26:0/2467355681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f780f6860 0x7f0f7810c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:22.933 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.934+0000 7f0f7d2c0700 1 -- 172.21.15.26:0/2467355681 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f6c005040 con 0x7f0f780f55c0 2021-11-03T17:34:22.934 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.934+0000 7f0f7d2c0700 1 --2- 172.21.15.26:0/2467355681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f780f55c0 0x7f0f78109c60 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7f0f7000c510 tx=0x7f0f70007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:34:22.934 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.934+0000 7f0f75ffb700 1 -- 172.21.15.26:0/2467355681 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f7000f650 con 0x7f0f780f55c0 2021-11-03T17:34:22.934 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.934+0000 7f0f75ffb700 1 -- 172.21.15.26:0/2467355681 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0f7000fc60 con 0x7f0f780f55c0 2021-11-03T17:34:22.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.934+0000 7f0f7f524700 1 -- 172.21.15.26:0/2467355681 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f7810c710 con 0x7f0f780f55c0 2021-11-03T17:34:22.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.934+0000 7f0f75ffb700 1 -- 172.21.15.26:0/2467355681 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f70012cb0 con 0x7f0f780f55c0 2021-11-03T17:34:22.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.935+0000 7f0f7f524700 1 -- 172.21.15.26:0/2467355681 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f7810ccd0 con 0x7f0f780f55c0 2021-11-03T17:34:22.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.935+0000 7f0f7f524700 1 -- 172.21.15.26:0/2467355681 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f78045ad0 con 0x7f0f780f55c0 2021-11-03T17:34:22.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.936+0000 7f0f75ffb700 1 -- 172.21.15.26:0/2467355681 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f0f70010070 con 0x7f0f780f55c0 2021-11-03T17:34:22.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.936+0000 7f0f75ffb700 1 --2- 172.21.15.26:0/2467355681 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0f600640b0 0x7f0f60066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:34:22.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.936+0000 7f0f75ffb700 1 -- 172.21.15.26:0/2467355681 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f0f70080380 con 0x7f0f780f55c0 2021-11-03T17:34:22.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.936+0000 7f0f7cabf700 1 --2- 172.21.15.26:0/2467355681 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0f600640b0 0x7f0f60066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:34:22.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.937+0000 7f0f7cabf700 1 --2- 172.21.15.26:0/2467355681 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0f600640b0 0x7f0f60066570 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f0f6c004e30 tx=0x7f0f6c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:34:22.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:22.940+0000 7f0f75ffb700 1 -- 172.21.15.26:0/2467355681 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f0f700526a0 con 0x7f0f780f55c0 2021-11-03T17:34:23.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.171+0000 7f0f7f524700 1 -- 172.21.15.26:0/2467355681 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0f780fdeb0 con 0x7f0f780f55c0 2021-11-03T17:34:23.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.171+0000 7f0f75ffb700 1 -- 172.21.15.26:0/2467355681 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f0f70052290 con 0x7f0f780f55c0 2021-11-03T17:34:23.167 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:34:23.167 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:34:23.167 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:34:23.168 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:34:23.168 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:34:23.168 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:34:23.169 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:34:23.169 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:34:23.170 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:34:23.170 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:34:23.170 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:34:23.171 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:34:23.171 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:34:23.172 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:34:23.172 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:34:23.172 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:34:23.173 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:34:23.173 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:34:23.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.173+0000 7f0f7f524700 1 -- 172.21.15.26:0/2467355681 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0f600640b0 msgr2=0x7f0f60066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:34:23.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.173+0000 7f0f7f524700 1 --2- 172.21.15.26:0/2467355681 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0f600640b0 0x7f0f60066570 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f0f6c004e30 tx=0x7f0f6c009b30).stop 2021-11-03T17:34:23.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.173+0000 7f0f7f524700 1 -- 172.21.15.26:0/2467355681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f780f55c0 msgr2=0x7f0f78109c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:34:23.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.173+0000 7f0f7f524700 1 --2- 172.21.15.26:0/2467355681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f780f55c0 0x7f0f78109c60 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7f0f7000c510 tx=0x7f0f70007df0).stop 2021-11-03T17:34:23.175 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.173+0000 7f0f7f524700 1 -- 172.21.15.26:0/2467355681 shutdown_connections 2021-11-03T17:34:23.175 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.173+0000 7f0f7f524700 1 --2- 172.21.15.26:0/2467355681 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0f600640b0 0x7f0f60066570 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:23.175 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.173+0000 7f0f7f524700 1 --2- 172.21.15.26:0/2467355681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f780f55c0 0x7f0f78109c60 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:23.175 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.173+0000 7f0f7f524700 1 --2- 172.21.15.26:0/2467355681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f780f6860 0x7f0f7810c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:23.176 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.173+0000 7f0f7f524700 1 -- 172.21.15.26:0/2467355681 >> 172.21.15.26:0/2467355681 conn(0x7f0f780f0d40 msgr2=0x7f0f780fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:34:23.176 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.173+0000 7f0f7f524700 1 -- 172.21.15.26:0/2467355681 shutdown_connections 2021-11-03T17:34:23.176 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.173+0000 7f0f7f524700 1 -- 172.21.15.26:0/2467355681 wait complete. 2021-11-03T17:34:23.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.273+0000 7faa4fd13700 1 -- 172.21.15.26:0/3064242107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa480f5ef0 msgr2=0x7faa480f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:34:23.272 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.273+0000 7faa4fd13700 1 --2- 172.21.15.26:0/3064242107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa480f5ef0 0x7faa480f6920 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7faa44004660 tx=0x7faa44009b30).stop 2021-11-03T17:34:23.272 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.273+0000 7faa4fd13700 1 -- 172.21.15.26:0/3064242107 shutdown_connections 2021-11-03T17:34:23.273 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.273+0000 7faa4fd13700 1 --2- 172.21.15.26:0/3064242107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa480f5ef0 0x7faa480f6920 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:23.273 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.273+0000 7faa4fd13700 1 --2- 172.21.15.26:0/3064242107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa480f55e0 0x7faa480f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:23.274 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.273+0000 7faa4fd13700 1 -- 172.21.15.26:0/3064242107 >> 172.21.15.26:0/3064242107 conn(0x7faa480f0de0 msgr2=0x7faa480f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:34:23.274 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.273+0000 7faa4fd13700 1 -- 172.21.15.26:0/3064242107 shutdown_connections 2021-11-03T17:34:23.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.273+0000 7faa4fd13700 1 -- 172.21.15.26:0/3064242107 wait complete. 2021-11-03T17:34:23.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.274+0000 7faa4fd13700 1 Processor -- start 2021-11-03T17:34:23.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.274+0000 7faa4fd13700 1 -- start start 2021-11-03T17:34:23.276 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.274+0000 7faa4fd13700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa480f55e0 0x7faa48105e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:34:23.276 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.274+0000 7faa4fd13700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa480f5ef0 0x7faa48106380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:34:23.276 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.274+0000 7faa4fd13700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa48106930 con 0x7faa480f5ef0 2021-11-03T17:34:23.276 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.274+0000 7faa4fd13700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa48106a70 con 0x7faa480f55e0 2021-11-03T17:34:23.277 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.274+0000 7faa4d2ae700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa480f5ef0 0x7faa48106380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:34:23.277 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.274+0000 7faa4d2ae700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa480f5ef0 0x7faa48106380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55172/0 (socket says 172.21.15.26:55172) 2021-11-03T17:34:23.277 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.274+0000 7faa4d2ae700 1 -- 172.21.15.26:0/3169811748 learned_addr learned my addr 172.21.15.26:0/3169811748 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:34:23.277 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.274+0000 7faa4daaf700 1 --2- 172.21.15.26:0/3169811748 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa480f55e0 0x7faa48105e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:34:23.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.274+0000 7faa4d2ae700 1 -- 172.21.15.26:0/3169811748 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa480f55e0 msgr2=0x7faa48105e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:34:23.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.274+0000 7faa4d2ae700 1 --2- 172.21.15.26:0/3169811748 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa480f55e0 0x7faa48105e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:23.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.274+0000 7faa4d2ae700 1 -- 172.21.15.26:0/3169811748 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa44005040 con 0x7faa480f5ef0 2021-11-03T17:34:23.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.274+0000 7faa4d2ae700 1 --2- 172.21.15.26:0/3169811748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa480f5ef0 0x7faa48106380 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7faa44009990 tx=0x7faa44009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:34:23.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.274+0000 7faa3e7fc700 1 -- 172.21.15.26:0/3169811748 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa44018070 con 0x7faa480f5ef0 2021-11-03T17:34:23.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.274+0000 7faa3e7fc700 1 -- 172.21.15.26:0/3169811748 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7faa44007ca0 con 0x7faa480f5ef0 2021-11-03T17:34:23.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.274+0000 7faa4fd13700 1 -- 172.21.15.26:0/3169811748 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa481073b0 con 0x7faa480f5ef0 2021-11-03T17:34:23.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.275+0000 7faa3e7fc700 1 -- 172.21.15.26:0/3169811748 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa4401c620 con 0x7faa480f5ef0 2021-11-03T17:34:23.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.275+0000 7faa4fd13700 1 -- 172.21.15.26:0/3169811748 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa48107910 con 0x7faa480f5ef0 2021-11-03T17:34:23.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.276+0000 7faa4fd13700 1 -- 172.21.15.26:0/3169811748 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa48045ad0 con 0x7faa480f5ef0 2021-11-03T17:34:23.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.276+0000 7faa3e7fc700 1 -- 172.21.15.26:0/3169811748 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7faa4401d960 con 0x7faa480f5ef0 2021-11-03T17:34:23.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.276+0000 7faa3e7fc700 1 --2- 172.21.15.26:0/3169811748 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faa340640b0 0x7faa34066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:34:23.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.277+0000 7faa4daaf700 1 --2- 172.21.15.26:0/3169811748 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faa340640b0 0x7faa34066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:34:23.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.277+0000 7faa3e7fc700 1 -- 172.21.15.26:0/3169811748 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7faa44082520 con 0x7faa480f5ef0 2021-11-03T17:34:23.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.277+0000 7faa4daaf700 1 --2- 172.21.15.26:0/3169811748 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faa340640b0 0x7faa34066570 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7faa380041d0 tx=0x7faa38009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:34:23.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.281+0000 7faa3e7fc700 1 -- 172.21.15.26:0/3169811748 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7faa44054940 con 0x7faa480f5ef0 2021-11-03T17:34:23.478 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.483+0000 7faa4fd13700 1 -- 172.21.15.26:0/3169811748 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7faa48027a00 con 0x7faa480f5ef0 2021-11-03T17:34:23.478 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.484+0000 7faa3e7fc700 1 -- 172.21.15.26:0/3169811748 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7faa44054530 con 0x7faa480f5ef0 2021-11-03T17:34:23.479 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:34:23.479 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:34:23.479 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:34:23.479 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:34:23.480 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:34:23.480 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:34:23.480 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:34:23.480 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:34:23.481 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:34:23.481 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:34:23.481 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:34:23.481 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:34:23.481 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:34:23.482 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:34:23.482 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:34:23.482 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:34:23.482 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:34:23.482 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:34:23.483 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:34:23.483 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:34:23.483 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:34:23.483 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:34:23.484 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:34:23.484 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:34:23.484 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:34:23.484 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:34:23.485 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:34:23.485 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:34:23.485 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:34:23.485 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:34:23.485 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:34:23.486 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:34:23.486 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:34:23.486 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:34:23.486 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:34:23.486 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:34:23.487 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:34:23.487 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:34:23.487 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:34:23.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.486+0000 7faa4fd13700 1 -- 172.21.15.26:0/3169811748 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faa340640b0 msgr2=0x7faa34066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:34:23.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.486+0000 7faa4fd13700 1 --2- 172.21.15.26:0/3169811748 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faa340640b0 0x7faa34066570 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7faa380041d0 tx=0x7faa38009040).stop 2021-11-03T17:34:23.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.486+0000 7faa4fd13700 1 -- 172.21.15.26:0/3169811748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa480f5ef0 msgr2=0x7faa48106380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:34:23.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.486+0000 7faa4fd13700 1 --2- 172.21.15.26:0/3169811748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa480f5ef0 0x7faa48106380 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7faa44009990 tx=0x7faa44009b30).stop 2021-11-03T17:34:23.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.486+0000 7faa4fd13700 1 -- 172.21.15.26:0/3169811748 shutdown_connections 2021-11-03T17:34:23.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.486+0000 7faa4fd13700 1 --2- 172.21.15.26:0/3169811748 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faa340640b0 0x7faa34066570 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:23.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.486+0000 7faa4fd13700 1 --2- 172.21.15.26:0/3169811748 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa480f55e0 0x7faa48105e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:23.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.486+0000 7faa4fd13700 1 --2- 172.21.15.26:0/3169811748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa480f5ef0 0x7faa48106380 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:23.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.486+0000 7faa4fd13700 1 -- 172.21.15.26:0/3169811748 >> 172.21.15.26:0/3169811748 conn(0x7faa480f0de0 msgr2=0x7faa480fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:34:23.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.486+0000 7faa4fd13700 1 -- 172.21.15.26:0/3169811748 shutdown_connections 2021-11-03T17:34:23.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:23.486+0000 7faa4fd13700 1 -- 172.21.15.26:0/3169811748 wait complete. 2021-11-03T17:34:23.491 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:34:23.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:23 smithi194 ceph-mon[65619]: from='client.35372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:34:23.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:23 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2467355681' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:34:23.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:23 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3169811748' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:34:23.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:23 smithi026 ceph-mon[96795]: from='client.35372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:34:23.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:23 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2467355681' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:34:23.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:23 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3169811748' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:34:24.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:24 smithi026 ceph-mon[96795]: from='client.35376 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:34:24.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:24 smithi026 ceph-mon[96795]: pgmap v1192: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:24.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:24 smithi194 ceph-mon[65619]: from='client.35376 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:34:24.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:24 smithi194 ceph-mon[65619]: pgmap v1192: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:26.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:26 smithi026 ceph-mon[96795]: pgmap v1193: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:26.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:26 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:34:26.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:26 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:34:26.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:26 smithi194 ceph-mon[65619]: pgmap v1193: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:26.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:26 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:34:26.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:26 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:34:28.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:28 smithi026 ceph-mon[96795]: pgmap v1194: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:28.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:28 smithi194 ceph-mon[65619]: pgmap v1194: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:30.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:30 smithi026 ceph-mon[96795]: pgmap v1195: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:30.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:30 smithi194 ceph-mon[65619]: pgmap v1195: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:32.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:32 smithi026 ceph-mon[96795]: pgmap v1196: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:32.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:32 smithi194 ceph-mon[65619]: pgmap v1196: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:34.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:34 smithi026 ceph-mon[96795]: pgmap v1197: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:34.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:34 smithi194 ceph-mon[65619]: pgmap v1197: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:36.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:36 smithi026 ceph-mon[96795]: pgmap v1198: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:36.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:36 smithi194 ceph-mon[65619]: pgmap v1198: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:38.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:38 smithi026 ceph-mon[96795]: pgmap v1199: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:38.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:38 smithi194 ceph-mon[65619]: pgmap v1199: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:40.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:40 smithi026 ceph-mon[96795]: pgmap v1200: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:40.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:34:40.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:40 smithi194 ceph-mon[65619]: pgmap v1200: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:40.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:34:41.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:41 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:34:41.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:41 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:34:42.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:42 smithi026 ceph-mon[96795]: pgmap v1201: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:42.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:42 smithi194 ceph-mon[65619]: pgmap v1201: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:44.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:44 smithi026 ceph-mon[96795]: pgmap v1202: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:44.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:44 smithi194 ceph-mon[65619]: pgmap v1202: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:46.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:46 smithi026 ceph-mon[96795]: pgmap v1203: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:46.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:46 smithi194 ceph-mon[65619]: pgmap v1203: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:48.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:48 smithi026 ceph-mon[96795]: pgmap v1204: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:48.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:34:48.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:34:48.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:48 smithi194 ceph-mon[65619]: pgmap v1204: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:48.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:34:48.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:34:50.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:50 smithi026 ceph-mon[96795]: pgmap v1205: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:50.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:50 smithi194 ceph-mon[65619]: pgmap v1205: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:52.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:52 smithi026 ceph-mon[96795]: pgmap v1206: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:52.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:52 smithi194 ceph-mon[65619]: pgmap v1206: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:53.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.599+0000 7f3194919700 1 -- 172.21.15.26:0/4052064661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31900f8610 msgr2=0x7f31900f4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:34:53.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.599+0000 7f3194919700 1 --2- 172.21.15.26:0/4052064661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31900f8610 0x7f31900f4820 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f3184004660 tx=0x7f3184009b30).stop 2021-11-03T17:34:53.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.600+0000 7f3194919700 1 -- 172.21.15.26:0/4052064661 shutdown_connections 2021-11-03T17:34:53.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.600+0000 7f3194919700 1 --2- 172.21.15.26:0/4052064661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31900f8610 0x7f31900f4820 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:53.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.600+0000 7f3194919700 1 --2- 172.21.15.26:0/4052064661 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31900f7d00 0x7f31900f8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:53.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.600+0000 7f3194919700 1 -- 172.21.15.26:0/4052064661 >> 172.21.15.26:0/4052064661 conn(0x7f31900f0540 msgr2=0x7f31900f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:34:53.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.600+0000 7f3194919700 1 -- 172.21.15.26:0/4052064661 shutdown_connections 2021-11-03T17:34:53.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.600+0000 7f3194919700 1 -- 172.21.15.26:0/4052064661 wait complete. 2021-11-03T17:34:53.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.600+0000 7f3194919700 1 Processor -- start 2021-11-03T17:34:53.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.600+0000 7f3194919700 1 -- start start 2021-11-03T17:34:53.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.600+0000 7f3194919700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31900f7d00 0x7f3190106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:34:53.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.600+0000 7f3194919700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31900f8610 0x7f3190107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:34:53.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.600+0000 7f3194919700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31901079b0 con 0x7f31900f7d00 2021-11-03T17:34:53.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.600+0000 7f3194919700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3190107af0 con 0x7f31900f8610 2021-11-03T17:34:53.600 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.600+0000 7f318e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31900f7d00 0x7f3190106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:34:53.600 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.601+0000 7f318e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31900f7d00 0x7f3190106f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55188/0 (socket says 172.21.15.26:55188) 2021-11-03T17:34:53.600 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.601+0000 7f318e59c700 1 -- 172.21.15.26:0/3045893208 learned_addr learned my addr 172.21.15.26:0/3045893208 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:34:53.600 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.601+0000 7f318dd9b700 1 --2- 172.21.15.26:0/3045893208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31900f8610 0x7f3190107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:34:53.600 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.601+0000 7f318e59c700 1 -- 172.21.15.26:0/3045893208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31900f8610 msgr2=0x7f3190107400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:34:53.601 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.601+0000 7f318e59c700 1 --2- 172.21.15.26:0/3045893208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31900f8610 0x7f3190107400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:53.601 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.601+0000 7f318e59c700 1 -- 172.21.15.26:0/3045893208 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3184005040 con 0x7f31900f7d00 2021-11-03T17:34:53.601 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.601+0000 7f318e59c700 1 --2- 172.21.15.26:0/3045893208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31900f7d00 0x7f3190106f10 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f318000c530 tx=0x7f3180007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:34:53.601 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.601+0000 7f317effd700 1 -- 172.21.15.26:0/3045893208 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f318000f650 con 0x7f31900f7d00 2021-11-03T17:34:53.602 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.601+0000 7f317effd700 1 -- 172.21.15.26:0/3045893208 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f318000fc60 con 0x7f31900f7d00 2021-11-03T17:34:53.602 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.601+0000 7f3194919700 1 -- 172.21.15.26:0/3045893208 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3190108490 con 0x7f31900f7d00 2021-11-03T17:34:53.602 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.601+0000 7f317effd700 1 -- 172.21.15.26:0/3045893208 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3180012c20 con 0x7f31900f7d00 2021-11-03T17:34:53.602 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.601+0000 7f3194919700 1 -- 172.21.15.26:0/3045893208 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3190108a50 con 0x7f31900f7d00 2021-11-03T17:34:53.604 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.602+0000 7f3194919700 1 -- 172.21.15.26:0/3045893208 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3190045ad0 con 0x7f31900f7d00 2021-11-03T17:34:53.604 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.603+0000 7f317effd700 1 -- 172.21.15.26:0/3045893208 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f3180010070 con 0x7f31900f7d00 2021-11-03T17:34:53.604 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.603+0000 7f317effd700 1 --2- 172.21.15.26:0/3045893208 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f31780640b0 0x7f3178066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:34:53.604 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.603+0000 7f317effd700 1 -- 172.21.15.26:0/3045893208 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f3180080660 con 0x7f31900f7d00 2021-11-03T17:34:53.605 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.603+0000 7f318dd9b700 1 --2- 172.21.15.26:0/3045893208 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f31780640b0 0x7f3178066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:34:53.605 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.604+0000 7f318dd9b700 1 --2- 172.21.15.26:0/3045893208 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f31780640b0 0x7f3178066570 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f3184004630 tx=0x7f3184009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:34:53.605 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.607+0000 7f317effd700 1 -- 172.21.15.26:0/3045893208 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f31800528d0 con 0x7f31900f7d00 2021-11-03T17:34:53.780 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.785+0000 7f3194919700 1 -- 172.21.15.26:0/3045893208 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f31900ff030 con 0x7f31780640b0 2021-11-03T17:34:53.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.786+0000 7f317effd700 1 -- 172.21.15.26:0/3045893208 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f31900ff030 con 0x7f31780640b0 2021-11-03T17:34:53.783 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.788+0000 7f3194919700 1 -- 172.21.15.26:0/3045893208 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f31780640b0 msgr2=0x7f3178066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:34:53.783 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.788+0000 7f3194919700 1 --2- 172.21.15.26:0/3045893208 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f31780640b0 0x7f3178066570 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f3184004630 tx=0x7f3184009b30).stop 2021-11-03T17:34:53.783 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.788+0000 7f3194919700 1 -- 172.21.15.26:0/3045893208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31900f7d00 msgr2=0x7f3190106f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:34:53.784 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.788+0000 7f3194919700 1 --2- 172.21.15.26:0/3045893208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31900f7d00 0x7f3190106f10 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f318000c530 tx=0x7f3180007e20).stop 2021-11-03T17:34:53.784 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.788+0000 7f3194919700 1 -- 172.21.15.26:0/3045893208 shutdown_connections 2021-11-03T17:34:53.784 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.788+0000 7f3194919700 1 --2- 172.21.15.26:0/3045893208 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f31780640b0 0x7f3178066570 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:53.784 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.788+0000 7f3194919700 1 --2- 172.21.15.26:0/3045893208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31900f7d00 0x7f3190106f10 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:53.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.788+0000 7f3194919700 1 --2- 172.21.15.26:0/3045893208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31900f8610 0x7f3190107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:53.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.788+0000 7f3194919700 1 -- 172.21.15.26:0/3045893208 >> 172.21.15.26:0/3045893208 conn(0x7f31900f0540 msgr2=0x7f31900fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:34:53.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.788+0000 7f3194919700 1 -- 172.21.15.26:0/3045893208 shutdown_connections 2021-11-03T17:34:53.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.788+0000 7f3194919700 1 -- 172.21.15.26:0/3045893208 wait complete. 2021-11-03T17:34:53.793 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:34:53.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.888+0000 7f8d1ec8f700 1 -- 172.21.15.26:0/1306343579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d180f6530 msgr2=0x7f8d180f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:34:53.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.888+0000 7f8d1ec8f700 1 --2- 172.21.15.26:0/1306343579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d180f6530 0x7f8d180f6950 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f8d14004660 tx=0x7f8d14009b30).stop 2021-11-03T17:34:53.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.888+0000 7f8d1ec8f700 1 -- 172.21.15.26:0/1306343579 shutdown_connections 2021-11-03T17:34:53.886 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.888+0000 7f8d1ec8f700 1 --2- 172.21.15.26:0/1306343579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d180f77d0 0x7f8d180f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:53.886 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.888+0000 7f8d1ec8f700 1 --2- 172.21.15.26:0/1306343579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d180f6530 0x7f8d180f6950 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:53.886 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.888+0000 7f8d1ec8f700 1 -- 172.21.15.26:0/1306343579 >> 172.21.15.26:0/1306343579 conn(0x7f8d180f1cd0 msgr2=0x7f8d180f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:34:53.886 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.888+0000 7f8d1ec8f700 1 -- 172.21.15.26:0/1306343579 shutdown_connections 2021-11-03T17:34:53.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.888+0000 7f8d1ec8f700 1 -- 172.21.15.26:0/1306343579 wait complete. 2021-11-03T17:34:53.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.889+0000 7f8d1ec8f700 1 Processor -- start 2021-11-03T17:34:53.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.889+0000 7f8d1ec8f700 1 -- start start 2021-11-03T17:34:53.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.889+0000 7f8d1ec8f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d180f6530 0x7f8d18106db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:34:53.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.889+0000 7f8d1ec8f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d180f77d0 0x7f8d181072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:34:53.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.889+0000 7f8d1ec8f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d181078a0 con 0x7f8d180f6530 2021-11-03T17:34:53.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.889+0000 7f8d1ec8f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d181080e0 con 0x7f8d180f77d0 2021-11-03T17:34:53.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.889+0000 7f8d1dc8d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d180f6530 0x7f8d18106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:34:53.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.889+0000 7f8d1dc8d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d180f6530 0x7f8d18106db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55198/0 (socket says 172.21.15.26:55198) 2021-11-03T17:34:53.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.889+0000 7f8d1dc8d700 1 -- 172.21.15.26:0/3427489770 learned_addr learned my addr 172.21.15.26:0/3427489770 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:34:53.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.889+0000 7f8d1dc8d700 1 -- 172.21.15.26:0/3427489770 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d180f77d0 msgr2=0x7f8d181072a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:34:53.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.889+0000 7f8d1dc8d700 1 --2- 172.21.15.26:0/3427489770 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d180f77d0 0x7f8d181072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:34:53.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.889+0000 7f8d1dc8d700 1 -- 172.21.15.26:0/3427489770 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d14005040 con 0x7f8d180f6530 2021-11-03T17:34:53.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.890+0000 7f8d1dc8d700 1 --2- 172.21.15.26:0/3427489770 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d180f6530 0x7f8d18106db0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f8d14004f60 tx=0x7f8d14009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:34:53.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.890+0000 7f8d0e7fc700 1 -- 172.21.15.26:0/3427489770 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d14018070 con 0x7f8d180f6530 2021-11-03T17:34:53.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.890+0000 7f8d0e7fc700 1 -- 172.21.15.26:0/3427489770 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8d14007ba0 con 0x7f8d180f6530 2021-11-03T17:34:53.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.890+0000 7f8d1ec8f700 1 -- 172.21.15.26:0/3427489770 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d18108360 con 0x7f8d180f6530 2021-11-03T17:34:53.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.890+0000 7f8d0e7fc700 1 -- 172.21.15.26:0/3427489770 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d1401c620 con 0x7f8d180f6530 2021-11-03T17:34:53.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.890+0000 7f8d1ec8f700 1 -- 172.21.15.26:0/3427489770 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d18108840 con 0x7f8d180f6530 2021-11-03T17:34:53.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.891+0000 7f8d1ec8f700 1 -- 172.21.15.26:0/3427489770 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d18059100 con 0x7f8d180f6530 2021-11-03T17:34:53.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.891+0000 7f8d0e7fc700 1 -- 172.21.15.26:0/3427489770 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f8d1401c8e0 con 0x7f8d180f6530 2021-11-03T17:34:53.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.891+0000 7f8d0e7fc700 1 --2- 172.21.15.26:0/3427489770 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8d04064100 0x7f8d040665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:34:53.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.892+0000 7f8d0e7fc700 1 -- 172.21.15.26:0/3427489770 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f8d140826e0 con 0x7f8d180f6530 2021-11-03T17:34:53.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.892+0000 7f8d1d48c700 1 --2- 172.21.15.26:0/3427489770 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8d04064100 0x7f8d040665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:34:53.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.892+0000 7f8d1d48c700 1 --2- 172.21.15.26:0/3427489770 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8d04064100 0x7f8d040665c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f8d18106b40 tx=0x7f8d08007a40).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:34:53.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:53.896+0000 7f8d0e7fc700 1 -- 172.21.15.26:0/3427489770 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f8d14054a40 con 0x7f8d180f6530 2021-11-03T17:34:54.065 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.070+0000 7f8d1ec8f700 1 -- 172.21.15.26:0/3427489770 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d180fee20 con 0x7f8d04064100 2021-11-03T17:34:54.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.085+0000 7f8d0e7fc700 1 -- 172.21.15.26:0/3427489770 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f8d180fee20 con 0x7f8d04064100 2021-11-03T17:34:54.080 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:34:54.080 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (46m) 5m ago 47m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:34:54.081 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (38m) 5m ago 47m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:34:54.081 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (38m) 4m ago 46m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:34:54.081 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (45m) 5m ago 47m 40.3M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:34:54.081 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (39m) 5m ago 42m 22.6M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:34:54.082 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (39m) 5m ago 42m 23.5M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:34:54.082 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (42m) 4m ago 42m 24.8M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:34:54.082 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (42m) 4m ago 42m 25.0M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:34:54.082 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (39m) 5m ago 48m 520M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:34:54.083 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (39m) 4m ago 46m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:34:54.083 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (39m) 5m ago 48m 176M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:34:54.083 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (38m) 4m ago 46m 89.5M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:34:54.083 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (47m) 5m ago 47m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:34:54.084 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (46m) 4m ago 46m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:34:54.084 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (37m) 5m ago 45m 231M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:34:54.084 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (37m) 5m ago 45m 248M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:34:54.084 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (36m) 5m ago 45m 207M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:34:54.084 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (36m) 4m ago 44m 262M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:34:54.085 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (36m) 4m ago 44m 227M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:34:54.085 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (35m) 4m ago 44m 215M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:34:54.085 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (45m) 5m ago 46m 54.4M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:34:54.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.087+0000 7f8d1ec8f700 1 -- 172.21.15.26:0/3427489770 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8d04064100 msgr2=0x7f8d040665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:34:54.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.087+0000 7f8d1ec8f700 1 --2- 172.21.15.26:0/3427489770 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8d04064100 0x7f8d040665c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f8d18106b40 tx=0x7f8d08007a40).stop 2021-11-03T17:34:54.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.087+0000 7f8d1ec8f700 1 -- 172.21.15.26:0/3427489770 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d180f6530 msgr2=0x7f8d18106db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:34:54.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.087+0000 7f8d1ec8f700 1 --2- 172.21.15.26:0/3427489770 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d180f6530 0x7f8d18106db0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f8d14004f60 tx=0x7f8d14009b30).stop 2021-11-03T17:34:54.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.087+0000 7f8d1ec8f700 1 -- 172.21.15.26:0/3427489770 shutdown_connections 2021-11-03T17:34:54.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.087+0000 7f8d1ec8f700 1 --2- 172.21.15.26:0/3427489770 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8d04064100 0x7f8d040665c0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:54.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.087+0000 7f8d1ec8f700 1 --2- 172.21.15.26:0/3427489770 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d180f6530 0x7f8d18106db0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:54.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.087+0000 7f8d1ec8f700 1 --2- 172.21.15.26:0/3427489770 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d180f77d0 0x7f8d181072a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:34:54.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.087+0000 7f8d1ec8f700 1 -- 172.21.15.26:0/3427489770 >> 172.21.15.26:0/3427489770 conn(0x7f8d180f1cd0 msgr2=0x7f8d180fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:34:54.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.087+0000 7f8d1ec8f700 1 -- 172.21.15.26:0/3427489770 shutdown_connections 2021-11-03T17:34:54.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.087+0000 7f8d1ec8f700 1 -- 172.21.15.26:0/3427489770 wait complete. 2021-11-03T17:34:54.184 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.186+0000 7f686c0f4700 1 -- 172.21.15.26:0/1350752836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68640f6ff0 msgr2=0x7f68640f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:34:54.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.186+0000 7f686c0f4700 1 --2- 172.21.15.26:0/1350752836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68640f6ff0 0x7f68640f7a20 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f6858004660 tx=0x7f6858009b30).stop 2021-11-03T17:34:54.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.186+0000 7f686c0f4700 1 -- 172.21.15.26:0/1350752836 shutdown_connections 2021-11-03T17:34:54.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.186+0000 7f686c0f4700 1 --2- 172.21.15.26:0/1350752836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68640f6ff0 0x7f68640f7a20 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:54.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.186+0000 7f686c0f4700 1 --2- 172.21.15.26:0/1350752836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68640f66e0 0x7f68640f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:54.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.186+0000 7f686c0f4700 1 -- 172.21.15.26:0/1350752836 >> 172.21.15.26:0/1350752836 conn(0x7f68640f1f00 msgr2=0x7f68640f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:34:54.186 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.186+0000 7f686c0f4700 1 -- 172.21.15.26:0/1350752836 shutdown_connections 2021-11-03T17:34:54.186 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.186+0000 7f686c0f4700 1 -- 172.21.15.26:0/1350752836 wait complete. 2021-11-03T17:34:54.186 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.187+0000 7f686c0f4700 1 Processor -- start 2021-11-03T17:34:54.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.187+0000 7f686c0f4700 1 -- start start 2021-11-03T17:34:54.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.187+0000 7f686c0f4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68640f66e0 0x7f6864106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:34:54.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.187+0000 7f686c0f4700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68640f6ff0 0x7f6864107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:34:54.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.187+0000 7f686c0f4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6864107a10 con 0x7f68640f66e0 2021-11-03T17:34:54.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.187+0000 7f686c0f4700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6864107b50 con 0x7f68640f6ff0 2021-11-03T17:34:54.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.187+0000 7f6869e90700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68640f66e0 0x7f6864106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:34:54.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.187+0000 7f6869e90700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68640f66e0 0x7f6864106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55208/0 (socket says 172.21.15.26:55208) 2021-11-03T17:34:54.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.187+0000 7f6869e90700 1 -- 172.21.15.26:0/1111441000 learned_addr learned my addr 172.21.15.26:0/1111441000 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:34:54.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.187+0000 7f686968f700 1 --2- 172.21.15.26:0/1111441000 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68640f6ff0 0x7f6864107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:34:54.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.187+0000 7f6869e90700 1 -- 172.21.15.26:0/1111441000 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68640f6ff0 msgr2=0x7f6864107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:34:54.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.187+0000 7f6869e90700 1 --2- 172.21.15.26:0/1111441000 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68640f6ff0 0x7f6864107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:54.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.187+0000 7f6869e90700 1 -- 172.21.15.26:0/1111441000 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6858005040 con 0x7f68640f66e0 2021-11-03T17:34:54.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.188+0000 7f6869e90700 1 --2- 172.21.15.26:0/1111441000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68640f66e0 0x7f6864106f70 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f685c007fd0 tx=0x7f685c004ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:34:54.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.188+0000 7f68627fc700 1 -- 172.21.15.26:0/1111441000 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f685c00b4f0 con 0x7f68640f66e0 2021-11-03T17:34:54.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.188+0000 7f68627fc700 1 -- 172.21.15.26:0/1111441000 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f685c00f040 con 0x7f68640f66e0 2021-11-03T17:34:54.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.188+0000 7f686c0f4700 1 -- 172.21.15.26:0/1111441000 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68641084f0 con 0x7f68640f66e0 2021-11-03T17:34:54.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.188+0000 7f68627fc700 1 -- 172.21.15.26:0/1111441000 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f685c013a50 con 0x7f68640f66e0 2021-11-03T17:34:54.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.188+0000 7f686c0f4700 1 -- 172.21.15.26:0/1111441000 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6864108ab0 con 0x7f68640f66e0 2021-11-03T17:34:54.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.189+0000 7f686c0f4700 1 -- 172.21.15.26:0/1111441000 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6864045ad0 con 0x7f68640f66e0 2021-11-03T17:34:54.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.189+0000 7f68627fc700 1 -- 172.21.15.26:0/1111441000 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f685c01a030 con 0x7f68640f66e0 2021-11-03T17:34:54.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.189+0000 7f68627fc700 1 --2- 172.21.15.26:0/1111441000 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f684c0640b0 0x7f684c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:34:54.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.190+0000 7f68627fc700 1 -- 172.21.15.26:0/1111441000 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f685c080710 con 0x7f68640f66e0 2021-11-03T17:34:54.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.190+0000 7f686968f700 1 --2- 172.21.15.26:0/1111441000 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f684c0640b0 0x7f684c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:34:54.193 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.190+0000 7f686968f700 1 --2- 172.21.15.26:0/1111441000 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f684c0640b0 0x7f684c066570 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f6858004630 tx=0x7f6858009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:34:54.193 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.193+0000 7f68627fc700 1 -- 172.21.15.26:0/1111441000 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f685c052af0 con 0x7f68640f66e0 2021-11-03T17:34:54.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.421+0000 7f686c0f4700 1 -- 172.21.15.26:0/1111441000 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f68640fefe0 con 0x7f68640f66e0 2021-11-03T17:34:54.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.421+0000 7f68627fc700 1 -- 172.21.15.26:0/1111441000 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f685c018070 con 0x7f68640f66e0 2021-11-03T17:34:54.418 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:34:54.418 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:34:54.419 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:34:54.419 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:34:54.420 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:34:54.420 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:34:54.420 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:34:54.421 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:34:54.421 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:34:54.421 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:34:54.422 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:34:54.422 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:34:54.422 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:34:54.423 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:34:54.423 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:34:54.425 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:34:54.425 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:34:54.425 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:34:54.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.423+0000 7f686c0f4700 1 -- 172.21.15.26:0/1111441000 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f684c0640b0 msgr2=0x7f684c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:34:54.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.423+0000 7f686c0f4700 1 --2- 172.21.15.26:0/1111441000 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f684c0640b0 0x7f684c066570 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f6858004630 tx=0x7f6858009b30).stop 2021-11-03T17:34:54.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.423+0000 7f686c0f4700 1 -- 172.21.15.26:0/1111441000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68640f66e0 msgr2=0x7f6864106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:34:54.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.423+0000 7f686c0f4700 1 --2- 172.21.15.26:0/1111441000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68640f66e0 0x7f6864106f70 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f685c007fd0 tx=0x7f685c004ee0).stop 2021-11-03T17:34:54.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.423+0000 7f686c0f4700 1 -- 172.21.15.26:0/1111441000 shutdown_connections 2021-11-03T17:34:54.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.423+0000 7f686c0f4700 1 --2- 172.21.15.26:0/1111441000 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f684c0640b0 0x7f684c066570 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:54.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.423+0000 7f686c0f4700 1 --2- 172.21.15.26:0/1111441000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68640f66e0 0x7f6864106f70 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:54.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.423+0000 7f686c0f4700 1 --2- 172.21.15.26:0/1111441000 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68640f6ff0 0x7f6864107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:54.428 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.423+0000 7f686c0f4700 1 -- 172.21.15.26:0/1111441000 >> 172.21.15.26:0/1111441000 conn(0x7f68640f1f00 msgr2=0x7f68640fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:34:54.428 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.423+0000 7f686c0f4700 1 -- 172.21.15.26:0/1111441000 shutdown_connections 2021-11-03T17:34:54.428 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.423+0000 7f686c0f4700 1 -- 172.21.15.26:0/1111441000 wait complete. 2021-11-03T17:34:54.520 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.523+0000 7f19d814b700 1 -- 172.21.15.26:0/2446644738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19d00f6ff0 msgr2=0x7f19d00f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:34:54.520 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.523+0000 7f19d814b700 1 --2- 172.21.15.26:0/2446644738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19d00f6ff0 0x7f19d00f7a20 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f19c4004660 tx=0x7f19c4009b30).stop 2021-11-03T17:34:54.521 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.523+0000 7f19d814b700 1 -- 172.21.15.26:0/2446644738 shutdown_connections 2021-11-03T17:34:54.521 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.523+0000 7f19d814b700 1 --2- 172.21.15.26:0/2446644738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19d00f6ff0 0x7f19d00f7a20 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:54.521 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.523+0000 7f19d814b700 1 --2- 172.21.15.26:0/2446644738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19d00f66e0 0x7f19d00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:54.521 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.523+0000 7f19d814b700 1 -- 172.21.15.26:0/2446644738 >> 172.21.15.26:0/2446644738 conn(0x7f19d00f1f00 msgr2=0x7f19d00f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:34:54.522 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.523+0000 7f19d814b700 1 -- 172.21.15.26:0/2446644738 shutdown_connections 2021-11-03T17:34:54.522 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.523+0000 7f19d814b700 1 -- 172.21.15.26:0/2446644738 wait complete. 2021-11-03T17:34:54.522 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.524+0000 7f19d814b700 1 Processor -- start 2021-11-03T17:34:54.522 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.524+0000 7f19d814b700 1 -- start start 2021-11-03T17:34:54.523 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.524+0000 7f19d814b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19d00f66e0 0x7f19d0106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:34:54.523 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.524+0000 7f19d814b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19d00f6ff0 0x7f19d0107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:34:54.523 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.524+0000 7f19d814b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d0107a10 con 0x7f19d00f6ff0 2021-11-03T17:34:54.523 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.524+0000 7f19d814b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d0107b50 con 0x7f19d00f66e0 2021-11-03T17:34:54.523 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.524+0000 7f19d56e6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19d00f6ff0 0x7f19d0107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:34:54.524 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.524+0000 7f19d56e6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19d00f6ff0 0x7f19d0107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55220/0 (socket says 172.21.15.26:55220) 2021-11-03T17:34:54.524 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.524+0000 7f19d56e6700 1 -- 172.21.15.26:0/4240846737 learned_addr learned my addr 172.21.15.26:0/4240846737 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:34:54.524 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.524+0000 7f19d5ee7700 1 --2- 172.21.15.26:0/4240846737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19d00f66e0 0x7f19d0106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:34:54.525 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.525+0000 7f19d56e6700 1 -- 172.21.15.26:0/4240846737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19d00f66e0 msgr2=0x7f19d0106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:34:54.525 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.525+0000 7f19d56e6700 1 --2- 172.21.15.26:0/4240846737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19d00f66e0 0x7f19d0106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:54.525 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.525+0000 7f19d56e6700 1 -- 172.21.15.26:0/4240846737 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c4005040 con 0x7f19d00f6ff0 2021-11-03T17:34:54.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.525+0000 7f19d56e6700 1 --2- 172.21.15.26:0/4240846737 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19d00f6ff0 0x7f19d0107460 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f19c4009990 tx=0x7f19c4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:34:54.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.525+0000 7f19ce7fc700 1 -- 172.21.15.26:0/4240846737 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19c4018070 con 0x7f19d00f6ff0 2021-11-03T17:34:54.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.525+0000 7f19ce7fc700 1 -- 172.21.15.26:0/4240846737 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f19c4007ba0 con 0x7f19d00f6ff0 2021-11-03T17:34:54.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.525+0000 7f19ce7fc700 1 -- 172.21.15.26:0/4240846737 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19c401c3c0 con 0x7f19d00f6ff0 2021-11-03T17:34:54.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.525+0000 7f19d814b700 1 -- 172.21.15.26:0/4240846737 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19d0108490 con 0x7f19d00f6ff0 2021-11-03T17:34:54.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.525+0000 7f19d814b700 1 -- 172.21.15.26:0/4240846737 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19d01089f0 con 0x7f19d00f6ff0 2021-11-03T17:34:54.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.526+0000 7f19d814b700 1 -- 172.21.15.26:0/4240846737 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19d0045ad0 con 0x7f19d00f6ff0 2021-11-03T17:34:54.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.526+0000 7f19ce7fc700 1 -- 172.21.15.26:0/4240846737 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f19c401d420 con 0x7f19d00f6ff0 2021-11-03T17:34:54.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.527+0000 7f19ce7fc700 1 --2- 172.21.15.26:0/4240846737 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f19b80640b0 0x7f19b8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:34:54.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.527+0000 7f19d5ee7700 1 --2- 172.21.15.26:0/4240846737 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f19b80640b0 0x7f19b8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:34:54.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.527+0000 7f19ce7fc700 1 -- 172.21.15.26:0/4240846737 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f19c4082410 con 0x7f19d00f6ff0 2021-11-03T17:34:54.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.527+0000 7f19d5ee7700 1 --2- 172.21.15.26:0/4240846737 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f19b80640b0 0x7f19b8066570 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f19c8004c40 tx=0x7f19c800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:34:54.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.531+0000 7f19ce7fc700 1 -- 172.21.15.26:0/4240846737 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f19c4054830 con 0x7f19d00f6ff0 2021-11-03T17:34:54.732 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.737+0000 7f19d814b700 1 -- 172.21.15.26:0/4240846737 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f19d0027a00 con 0x7f19d00f6ff0 2021-11-03T17:34:54.733 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.738+0000 7f19ce7fc700 1 -- 172.21.15.26:0/4240846737 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f19c4054420 con 0x7f19d00f6ff0 2021-11-03T17:34:54.733 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:34:54.734 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:34:54.734 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:34:54.734 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:34:54.734 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:34:54.735 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:34:54.735 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:34:54.735 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:34:54.735 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:34:54.736 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:34:54.736 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:34:54.736 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:34:54.736 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:34:54.736 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:34:54.737 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:34:54.737 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:34:54.737 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:34:54.737 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:34:54.738 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:34:54.738 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:34:54.738 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:34:54.738 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:34:54.739 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:34:54.739 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:34:54.739 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:34:54.739 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:34:54.740 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:34:54.740 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:34:54.740 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:34:54.740 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:34:54.741 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:34:54.741 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:34:54.741 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:34:54.741 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:34:54.742 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:34:54.742 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:34:54.742 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:34:54.742 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:34:54.743 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:34:54.744 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.739+0000 7f19d814b700 1 -- 172.21.15.26:0/4240846737 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f19b80640b0 msgr2=0x7f19b8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:34:54.744 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.740+0000 7f19d814b700 1 --2- 172.21.15.26:0/4240846737 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f19b80640b0 0x7f19b8066570 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f19c8004c40 tx=0x7f19c800b040).stop 2021-11-03T17:34:54.744 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.740+0000 7f19d814b700 1 -- 172.21.15.26:0/4240846737 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19d00f6ff0 msgr2=0x7f19d0107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:34:54.744 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.740+0000 7f19d814b700 1 --2- 172.21.15.26:0/4240846737 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19d00f6ff0 0x7f19d0107460 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f19c4009990 tx=0x7f19c4009b30).stop 2021-11-03T17:34:54.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.740+0000 7f19d814b700 1 -- 172.21.15.26:0/4240846737 shutdown_connections 2021-11-03T17:34:54.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.740+0000 7f19d814b700 1 --2- 172.21.15.26:0/4240846737 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f19b80640b0 0x7f19b8066570 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:54.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.740+0000 7f19d814b700 1 --2- 172.21.15.26:0/4240846737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19d00f66e0 0x7f19d0106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:54.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.740+0000 7f19d814b700 1 --2- 172.21.15.26:0/4240846737 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19d00f6ff0 0x7f19d0107460 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:34:54.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.740+0000 7f19d814b700 1 -- 172.21.15.26:0/4240846737 >> 172.21.15.26:0/4240846737 conn(0x7f19d00f1f00 msgr2=0x7f19d00fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:34:54.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.740+0000 7f19d814b700 1 -- 172.21.15.26:0/4240846737 shutdown_connections 2021-11-03T17:34:54.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:34:54.740+0000 7f19d814b700 1 -- 172.21.15.26:0/4240846737 wait complete. 2021-11-03T17:34:54.746 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:34:54.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:54 smithi026 ceph-mon[96795]: pgmap v1207: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:54.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:54 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1111441000' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:34:54.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:54 smithi194 ceph-mon[65619]: pgmap v1207: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:54.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:54 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1111441000' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:34:55.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:55 smithi026 ceph-mon[96795]: from='client.35388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:34:55.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:55 smithi026 ceph-mon[96795]: from='client.35392 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:34:55.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:55 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/4240846737' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:34:55.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:34:55.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:55 smithi194 ceph-mon[65619]: from='client.35388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:34:55.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:55 smithi194 ceph-mon[65619]: from='client.35392 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:34:55.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:55 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/4240846737' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:34:55.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:34:56.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:56 smithi026 ceph-mon[96795]: pgmap v1208: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:56.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:56 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:34:56.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:56 smithi194 ceph-mon[65619]: pgmap v1208: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:56.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:56 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:34:58.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:34:58 smithi026 ceph-mon[96795]: pgmap v1209: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:34:58.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:34:58 smithi194 ceph-mon[65619]: pgmap v1209: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:00.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:00 smithi026 ceph-mon[96795]: pgmap v1210: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:00.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:00 smithi194 ceph-mon[65619]: pgmap v1210: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:02.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:02 smithi026 ceph-mon[96795]: pgmap v1211: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:02.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:02 smithi194 ceph-mon[65619]: pgmap v1211: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:04.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:04 smithi026 ceph-mon[96795]: pgmap v1212: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:04.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:04 smithi194 ceph-mon[65619]: pgmap v1212: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:06.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:06 smithi026 ceph-mon[96795]: pgmap v1213: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:06.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:06 smithi194 ceph-mon[65619]: pgmap v1213: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:08.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:08 smithi026 ceph-mon[96795]: pgmap v1214: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:08.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:08 smithi194 ceph-mon[65619]: pgmap v1214: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:10.884 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:10 smithi194 ceph-mon[65619]: pgmap v1215: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:10.885 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:10 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:35:10.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:10 smithi026 ceph-mon[96795]: pgmap v1215: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:10.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:10 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:35:11.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:11 smithi026 ceph-mon[96795]: poll took 60073.291 ms: 1 events 2021-11-03T17:35:11.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:11 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:35:11.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:11 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:35:11.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:11 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:35:11.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:11 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:35:11.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:11 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:35:11.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:11 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:35:11.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:11 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:35:11.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:11 smithi194 ceph-mon[65619]: poll took 60073.291 ms: 1 events 2021-11-03T17:35:11.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:11 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:35:11.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:11 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:35:11.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:11 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:35:11.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:11 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:35:11.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:11 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:35:11.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:11 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:35:11.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:11 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:35:12.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:12 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:35:12.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:12 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:35:12.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:12 smithi026 ceph-mon[96795]: pgmap v1216: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:12.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:12 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:35:12.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:12 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:35:12.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:12 smithi194 ceph-mon[65619]: pgmap v1216: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:14.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:14 smithi026 ceph-mon[96795]: pgmap v1217: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:14.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:14 smithi194 ceph-mon[65619]: pgmap v1217: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:16.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:16 smithi026 ceph-mon[96795]: pgmap v1218: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:16.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:16 smithi194 ceph-mon[65619]: pgmap v1218: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:17.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:17 smithi026 ceph-mon[96795]: pgmap v1219: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:17.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:17 smithi194 ceph-mon[65619]: pgmap v1219: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:20.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:20 smithi194 ceph-mon[65619]: pgmap v1220: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:20.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:20 smithi026 ceph-mon[96795]: pgmap v1220: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:22.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:22 smithi194 ceph-mon[65619]: pgmap v1221: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:22.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:22 smithi026 ceph-mon[96795]: pgmap v1221: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:24.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:24 smithi194 ceph-mon[65619]: pgmap v1222: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:24.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:24 smithi026 ceph-mon[96795]: pgmap v1222: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:24.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:24.855+0000 7fe30759e700 1 -- 172.21.15.26:0/2209070069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3080f6530 msgr2=0x7fe3080f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:35:24.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:24.855+0000 7fe30759e700 1 --2- 172.21.15.26:0/2209070069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3080f6530 0x7fe3080f6950 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7fe2f8004660 tx=0x7fe2f8009b30).stop 2021-11-03T17:35:24.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:24.855+0000 7fe30759e700 1 -- 172.21.15.26:0/2209070069 shutdown_connections 2021-11-03T17:35:24.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:24.855+0000 7fe30759e700 1 --2- 172.21.15.26:0/2209070069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3080f77d0 0x7fe3080f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:24.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:24.855+0000 7fe30759e700 1 --2- 172.21.15.26:0/2209070069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3080f6530 0x7fe3080f6950 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:24.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:24.855+0000 7fe30759e700 1 -- 172.21.15.26:0/2209070069 >> 172.21.15.26:0/2209070069 conn(0x7fe3080f1cd0 msgr2=0x7fe3080f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:35:24.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:24.855+0000 7fe30759e700 1 -- 172.21.15.26:0/2209070069 shutdown_connections 2021-11-03T17:35:24.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:24.855+0000 7fe30759e700 1 -- 172.21.15.26:0/2209070069 wait complete. 2021-11-03T17:35:24.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:24.856+0000 7fe30759e700 1 Processor -- start 2021-11-03T17:35:24.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:24.856+0000 7fe30759e700 1 -- start start 2021-11-03T17:35:24.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:24.856+0000 7fe30759e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3080f6530 0x7fe308106db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:35:24.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:24.856+0000 7fe30759e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3080f77d0 0x7fe3081072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:35:24.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:24.856+0000 7fe30759e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3081078a0 con 0x7fe3080f77d0 2021-11-03T17:35:24.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:24.856+0000 7fe30759e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3081080e0 con 0x7fe3080f6530 2021-11-03T17:35:24.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:24.856+0000 7fe305d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3080f77d0 0x7fe3081072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:35:24.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:24.856+0000 7fe305d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3080f77d0 0x7fe3081072a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55238/0 (socket says 172.21.15.26:55238) 2021-11-03T17:35:24.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:24.856+0000 7fe305d9b700 1 -- 172.21.15.26:0/4233406070 learned_addr learned my addr 172.21.15.26:0/4233406070 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:35:24.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:24.856+0000 7fe30659c700 1 --2- 172.21.15.26:0/4233406070 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3080f6530 0x7fe308106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:35:24.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:24.856+0000 7fe305d9b700 1 -- 172.21.15.26:0/4233406070 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3080f6530 msgr2=0x7fe308106db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:35:24.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:24.856+0000 7fe305d9b700 1 --2- 172.21.15.26:0/4233406070 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3080f6530 0x7fe308106db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:24.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:24.856+0000 7fe305d9b700 1 -- 172.21.15.26:0/4233406070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f8005040 con 0x7fe3080f77d0 2021-11-03T17:35:24.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:24.856+0000 7fe305d9b700 1 --2- 172.21.15.26:0/4233406070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3080f77d0 0x7fe3081072a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7fe2fc0026d0 tx=0x7fe2fc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:35:24.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:24.857+0000 7fe2f6ffd700 1 -- 172.21.15.26:0/4233406070 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2fc009320 con 0x7fe3080f77d0 2021-11-03T17:35:24.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:24.857+0000 7fe2f6ffd700 1 -- 172.21.15.26:0/4233406070 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe2fc00f040 con 0x7fe3080f77d0 2021-11-03T17:35:24.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:24.857+0000 7fe2f6ffd700 1 -- 172.21.15.26:0/4233406070 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2fc0147e0 con 0x7fe3080f77d0 2021-11-03T17:35:24.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:24.857+0000 7fe30759e700 1 -- 172.21.15.26:0/4233406070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3081083c0 con 0x7fe3080f77d0 2021-11-03T17:35:24.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:24.857+0000 7fe30759e700 1 -- 172.21.15.26:0/4233406070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe308108900 con 0x7fe3080f77d0 2021-11-03T17:35:24.858 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:24.858+0000 7fe30759e700 1 -- 172.21.15.26:0/4233406070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe308059100 con 0x7fe3080f77d0 2021-11-03T17:35:24.859 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:24.858+0000 7fe2f6ffd700 1 -- 172.21.15.26:0/4233406070 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fe2fc009480 con 0x7fe3080f77d0 2021-11-03T17:35:24.859 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:24.859+0000 7fe2f6ffd700 1 --2- 172.21.15.26:0/4233406070 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe2f0064100 0x7fe2f00665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:35:24.859 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:24.859+0000 7fe2f6ffd700 1 -- 172.21.15.26:0/4233406070 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fe2fc080eb0 con 0x7fe3080f77d0 2021-11-03T17:35:24.859 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:24.859+0000 7fe30659c700 1 --2- 172.21.15.26:0/4233406070 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe2f0064100 0x7fe2f00665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:35:24.859 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:24.859+0000 7fe30659c700 1 --2- 172.21.15.26:0/4233406070 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe2f0064100 0x7fe2f00665c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7fe2f8009da0 tx=0x7fe2f8009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:35:24.860 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:24.863+0000 7fe2f6ffd700 1 -- 172.21.15.26:0/4233406070 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fe2fc053210 con 0x7fe3080f77d0 2021-11-03T17:35:25.038 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.044+0000 7fe30759e700 1 -- 172.21.15.26:0/4233406070 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe3080fee30 con 0x7fe2f0064100 2021-11-03T17:35:25.039 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.045+0000 7fe2f6ffd700 1 -- 172.21.15.26:0/4233406070 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fe3080fee30 con 0x7fe2f0064100 2021-11-03T17:35:25.041 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.047+0000 7fe30759e700 1 -- 172.21.15.26:0/4233406070 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe2f0064100 msgr2=0x7fe2f00665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:35:25.041 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.047+0000 7fe30759e700 1 --2- 172.21.15.26:0/4233406070 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe2f0064100 0x7fe2f00665c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7fe2f8009da0 tx=0x7fe2f8009b30).stop 2021-11-03T17:35:25.042 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.047+0000 7fe30759e700 1 -- 172.21.15.26:0/4233406070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3080f77d0 msgr2=0x7fe3081072a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:35:25.042 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.047+0000 7fe30759e700 1 --2- 172.21.15.26:0/4233406070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3080f77d0 0x7fe3081072a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7fe2fc0026d0 tx=0x7fe2fc009de0).stop 2021-11-03T17:35:25.042 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.047+0000 7fe30759e700 1 -- 172.21.15.26:0/4233406070 shutdown_connections 2021-11-03T17:35:25.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.047+0000 7fe30759e700 1 --2- 172.21.15.26:0/4233406070 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe2f0064100 0x7fe2f00665c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:25.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.047+0000 7fe30759e700 1 --2- 172.21.15.26:0/4233406070 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3080f6530 0x7fe308106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:25.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.047+0000 7fe30759e700 1 --2- 172.21.15.26:0/4233406070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3080f77d0 0x7fe3081072a0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:25.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.047+0000 7fe30759e700 1 -- 172.21.15.26:0/4233406070 >> 172.21.15.26:0/4233406070 conn(0x7fe3080f1cd0 msgr2=0x7fe3080fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:35:25.044 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.047+0000 7fe30759e700 1 -- 172.21.15.26:0/4233406070 shutdown_connections 2021-11-03T17:35:25.044 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.047+0000 7fe30759e700 1 -- 172.21.15.26:0/4233406070 wait complete. 2021-11-03T17:35:25.051 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:35:25.143 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.147+0000 7f526b918700 1 -- 172.21.15.26:0/161076979 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52640f66e0 msgr2=0x7f52640f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:35:25.143 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.147+0000 7f526b918700 1 --2- 172.21.15.26:0/161076979 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52640f66e0 0x7f52640f6b00 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f5260004660 tx=0x7f5260009b30).stop 2021-11-03T17:35:25.143 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.147+0000 7f526b918700 1 -- 172.21.15.26:0/161076979 shutdown_connections 2021-11-03T17:35:25.144 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.147+0000 7f526b918700 1 --2- 172.21.15.26:0/161076979 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52640f7980 0x7f52640f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:25.144 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.147+0000 7f526b918700 1 --2- 172.21.15.26:0/161076979 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52640f66e0 0x7f52640f6b00 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:25.144 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.147+0000 7f526b918700 1 -- 172.21.15.26:0/161076979 >> 172.21.15.26:0/161076979 conn(0x7f52640f1e40 msgr2=0x7f52640f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:35:25.145 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.147+0000 7f526b918700 1 -- 172.21.15.26:0/161076979 shutdown_connections 2021-11-03T17:35:25.145 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.147+0000 7f526b918700 1 -- 172.21.15.26:0/161076979 wait complete. 2021-11-03T17:35:25.145 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.147+0000 7f526b918700 1 Processor -- start 2021-11-03T17:35:25.145 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.148+0000 7f526b918700 1 -- start start 2021-11-03T17:35:25.145 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.148+0000 7f526b918700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52640f66e0 0x7f526406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:35:25.146 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.148+0000 7f526b918700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52640f7980 0x7f5264069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:35:25.146 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.148+0000 7f526b918700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526406a380 con 0x7f52640f7980 2021-11-03T17:35:25.146 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.148+0000 7f526b918700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526406a4c0 con 0x7f52640f66e0 2021-11-03T17:35:25.146 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.148+0000 7f5268eb3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52640f7980 0x7f5264069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:35:25.147 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.148+0000 7f5268eb3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52640f7980 0x7f5264069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55248/0 (socket says 172.21.15.26:55248) 2021-11-03T17:35:25.147 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.148+0000 7f5268eb3700 1 -- 172.21.15.26:0/1750305920 learned_addr learned my addr 172.21.15.26:0/1750305920 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:35:25.147 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.148+0000 7f52696b4700 1 --2- 172.21.15.26:0/1750305920 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52640f66e0 0x7f526406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:35:25.147 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.148+0000 7f5268eb3700 1 -- 172.21.15.26:0/1750305920 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52640f66e0 msgr2=0x7f526406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:35:25.148 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.148+0000 7f5268eb3700 1 --2- 172.21.15.26:0/1750305920 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52640f66e0 0x7f526406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:25.148 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.148+0000 7f5268eb3700 1 -- 172.21.15.26:0/1750305920 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5260005040 con 0x7f52640f7980 2021-11-03T17:35:25.148 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.148+0000 7f5268eb3700 1 --2- 172.21.15.26:0/1750305920 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52640f7980 0x7f5264069e20 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f525400c530 tx=0x7f5254007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:35:25.148 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.148+0000 7f5259ffb700 1 -- 172.21.15.26:0/1750305920 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f525400f650 con 0x7f52640f7980 2021-11-03T17:35:25.149 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.148+0000 7f5259ffb700 1 -- 172.21.15.26:0/1750305920 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f525400fc60 con 0x7f52640f7980 2021-11-03T17:35:25.149 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.149+0000 7f5259ffb700 1 -- 172.21.15.26:0/1750305920 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5254012cd0 con 0x7f52640f7980 2021-11-03T17:35:25.149 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.149+0000 7f526b918700 1 -- 172.21.15.26:0/1750305920 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f526406a7a0 con 0x7f52640f7980 2021-11-03T17:35:25.149 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.149+0000 7f526b918700 1 -- 172.21.15.26:0/1750305920 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f526410efe0 con 0x7f52640f7980 2021-11-03T17:35:25.150 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.150+0000 7f526b918700 1 -- 172.21.15.26:0/1750305920 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5264045ad0 con 0x7f52640f7980 2021-11-03T17:35:25.151 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.150+0000 7f5259ffb700 1 -- 172.21.15.26:0/1750305920 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f5254010070 con 0x7f52640f7980 2021-11-03T17:35:25.151 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.150+0000 7f5259ffb700 1 --2- 172.21.15.26:0/1750305920 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f52500640b0 0x7f5250066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:35:25.151 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.150+0000 7f5259ffb700 1 -- 172.21.15.26:0/1750305920 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f5254080620 con 0x7f52640f7980 2021-11-03T17:35:25.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.150+0000 7f52696b4700 1 --2- 172.21.15.26:0/1750305920 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f52500640b0 0x7f5250066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:35:25.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.151+0000 7f52696b4700 1 --2- 172.21.15.26:0/1750305920 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f52500640b0 0x7f5250066570 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f5260004e30 tx=0x7f5260009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:35:25.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.154+0000 7f5259ffb700 1 -- 172.21.15.26:0/1750305920 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f5254052890 con 0x7f52640f7980 2021-11-03T17:35:25.323 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.329+0000 7f526b918700 1 -- 172.21.15.26:0/1750305920 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5264057f10 con 0x7f52500640b0 2021-11-03T17:35:25.338 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.344+0000 7f5259ffb700 1 -- 172.21.15.26:0/1750305920 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f5264057f10 con 0x7f52500640b0 2021-11-03T17:35:25.338 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:35:25.338 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (46m) 6m ago 47m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:35:25.339 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (38m) 6m ago 47m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:35:25.339 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (38m) 5m ago 47m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:35:25.339 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (46m) 6m ago 47m 40.3M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:35:25.339 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (39m) 6m ago 43m 22.6M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:35:25.340 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (39m) 6m ago 42m 23.5M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:35:25.340 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (43m) 5m ago 43m 24.8M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:35:25.340 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (43m) 5m ago 42m 25.0M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:35:25.340 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (40m) 6m ago 49m 520M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:35:25.340 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (39m) 5m ago 47m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:35:25.341 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (39m) 6m ago 49m 176M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:35:25.341 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (39m) 5m ago 47m 89.5M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:35:25.341 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (47m) 6m ago 47m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:35:25.341 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (46m) 5m ago 46m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:35:25.342 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (38m) 6m ago 46m 231M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:35:25.342 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (37m) 6m ago 45m 248M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:35:25.342 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (37m) 6m ago 45m 207M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:35:25.342 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (36m) 5m ago 45m 262M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:35:25.342 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (36m) 5m ago 44m 227M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:35:25.343 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (36m) 5m ago 44m 215M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:35:25.343 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (46m) 6m ago 47m 54.4M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:35:25.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.346+0000 7f526b918700 1 -- 172.21.15.26:0/1750305920 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f52500640b0 msgr2=0x7f5250066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:35:25.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.346+0000 7f526b918700 1 --2- 172.21.15.26:0/1750305920 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f52500640b0 0x7f5250066570 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f5260004e30 tx=0x7f5260009b30).stop 2021-11-03T17:35:25.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.346+0000 7f526b918700 1 -- 172.21.15.26:0/1750305920 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52640f7980 msgr2=0x7f5264069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:35:25.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.346+0000 7f526b918700 1 --2- 172.21.15.26:0/1750305920 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52640f7980 0x7f5264069e20 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f525400c530 tx=0x7f5254007e20).stop 2021-11-03T17:35:25.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.346+0000 7f526b918700 1 -- 172.21.15.26:0/1750305920 shutdown_connections 2021-11-03T17:35:25.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.346+0000 7f526b918700 1 --2- 172.21.15.26:0/1750305920 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f52500640b0 0x7f5250066570 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:25.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.346+0000 7f526b918700 1 --2- 172.21.15.26:0/1750305920 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52640f66e0 0x7f526406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:25.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.346+0000 7f526b918700 1 --2- 172.21.15.26:0/1750305920 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52640f7980 0x7f5264069e20 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:25.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.346+0000 7f526b918700 1 -- 172.21.15.26:0/1750305920 >> 172.21.15.26:0/1750305920 conn(0x7f52640f1e40 msgr2=0x7f52640fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:35:25.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.346+0000 7f526b918700 1 -- 172.21.15.26:0/1750305920 shutdown_connections 2021-11-03T17:35:25.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.346+0000 7f526b918700 1 -- 172.21.15.26:0/1750305920 wait complete. 2021-11-03T17:35:25.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.444+0000 7fca11f46700 1 -- 172.21.15.26:0/3507347527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca0c0f6ff0 msgr2=0x7fca0c0f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:35:25.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.444+0000 7fca11f46700 1 --2- 172.21.15.26:0/3507347527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca0c0f6ff0 0x7fca0c0f7a20 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7fca00004660 tx=0x7fca00009b30).stop 2021-11-03T17:35:25.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.445+0000 7fca11f46700 1 -- 172.21.15.26:0/3507347527 shutdown_connections 2021-11-03T17:35:25.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.445+0000 7fca11f46700 1 --2- 172.21.15.26:0/3507347527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca0c0f6ff0 0x7fca0c0f7a20 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:25.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.445+0000 7fca11f46700 1 --2- 172.21.15.26:0/3507347527 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca0c0f66e0 0x7fca0c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:25.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.445+0000 7fca11f46700 1 -- 172.21.15.26:0/3507347527 >> 172.21.15.26:0/3507347527 conn(0x7fca0c0f1f00 msgr2=0x7fca0c0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:35:25.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.445+0000 7fca11f46700 1 -- 172.21.15.26:0/3507347527 shutdown_connections 2021-11-03T17:35:25.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.445+0000 7fca11f46700 1 -- 172.21.15.26:0/3507347527 wait complete. 2021-11-03T17:35:25.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.445+0000 7fca11f46700 1 Processor -- start 2021-11-03T17:35:25.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.445+0000 7fca11f46700 1 -- start start 2021-11-03T17:35:25.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.445+0000 7fca11f46700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca0c0f66e0 0x7fca0c106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:35:25.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.445+0000 7fca11f46700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca0c0f6ff0 0x7fca0c107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:35:25.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.445+0000 7fca11f46700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c107a10 con 0x7fca0c0f6ff0 2021-11-03T17:35:25.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.445+0000 7fca11f46700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c107b50 con 0x7fca0c0f66e0 2021-11-03T17:35:25.444 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.446+0000 7fca0affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca0c0f6ff0 0x7fca0c107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:35:25.444 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.446+0000 7fca0affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca0c0f6ff0 0x7fca0c107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55258/0 (socket says 172.21.15.26:55258) 2021-11-03T17:35:25.444 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.446+0000 7fca0affd700 1 -- 172.21.15.26:0/3458121897 learned_addr learned my addr 172.21.15.26:0/3458121897 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:35:25.444 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.446+0000 7fca0b7fe700 1 --2- 172.21.15.26:0/3458121897 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca0c0f66e0 0x7fca0c106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:35:25.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.446+0000 7fca0affd700 1 -- 172.21.15.26:0/3458121897 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca0c0f66e0 msgr2=0x7fca0c106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:35:25.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.446+0000 7fca0affd700 1 --2- 172.21.15.26:0/3458121897 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca0c0f66e0 0x7fca0c106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:25.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.446+0000 7fca0affd700 1 -- 172.21.15.26:0/3458121897 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca00005040 con 0x7fca0c0f6ff0 2021-11-03T17:35:25.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.446+0000 7fca0affd700 1 --2- 172.21.15.26:0/3458121897 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca0c0f6ff0 0x7fca0c107460 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7fca00009990 tx=0x7fca00009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:35:25.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.446+0000 7fc9f3fff700 1 -- 172.21.15.26:0/3458121897 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca00018070 con 0x7fca0c0f6ff0 2021-11-03T17:35:25.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.446+0000 7fc9f3fff700 1 -- 172.21.15.26:0/3458121897 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fca00007ba0 con 0x7fca0c0f6ff0 2021-11-03T17:35:25.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.446+0000 7fca11f46700 1 -- 172.21.15.26:0/3458121897 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca0c108490 con 0x7fca0c0f6ff0 2021-11-03T17:35:25.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.446+0000 7fc9f3fff700 1 -- 172.21.15.26:0/3458121897 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca0001c3c0 con 0x7fca0c0f6ff0 2021-11-03T17:35:25.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.446+0000 7fca11f46700 1 -- 172.21.15.26:0/3458121897 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca0c1089f0 con 0x7fca0c0f6ff0 2021-11-03T17:35:25.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.447+0000 7fca11f46700 1 -- 172.21.15.26:0/3458121897 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca0c045ad0 con 0x7fca0c0f6ff0 2021-11-03T17:35:25.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.448+0000 7fc9f3fff700 1 -- 172.21.15.26:0/3458121897 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fca0001d420 con 0x7fca0c0f6ff0 2021-11-03T17:35:25.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.448+0000 7fc9f3fff700 1 --2- 172.21.15.26:0/3458121897 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc9f40640b0 0x7fc9f4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:35:25.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.448+0000 7fc9f3fff700 1 -- 172.21.15.26:0/3458121897 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fca00082410 con 0x7fca0c0f6ff0 2021-11-03T17:35:25.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.448+0000 7fca0b7fe700 1 --2- 172.21.15.26:0/3458121897 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc9f40640b0 0x7fc9f4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:35:25.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.449+0000 7fca0b7fe700 1 --2- 172.21.15.26:0/3458121897 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc9f40640b0 0x7fc9f4066570 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7fc9fc004c40 tx=0x7fc9fc00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:35:25.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.452+0000 7fc9f3fff700 1 -- 172.21.15.26:0/3458121897 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fca00054830 con 0x7fca0c0f6ff0 2021-11-03T17:35:25.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.683+0000 7fca11f46700 1 -- 172.21.15.26:0/3458121897 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fca0c027a00 con 0x7fca0c0f6ff0 2021-11-03T17:35:25.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.683+0000 7fc9f3fff700 1 -- 172.21.15.26:0/3458121897 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fca00054420 con 0x7fca0c0f6ff0 2021-11-03T17:35:25.678 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:35:25.679 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:35:25.679 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:35:25.679 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:35:25.679 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:35:25.680 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:35:25.680 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:35:25.680 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:35:25.680 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:35:25.681 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:35:25.681 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:35:25.681 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:35:25.681 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:35:25.681 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:35:25.682 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:35:25.682 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:35:25.682 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:35:25.682 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:35:25.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.685+0000 7fca11f46700 1 -- 172.21.15.26:0/3458121897 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc9f40640b0 msgr2=0x7fc9f4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:35:25.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.685+0000 7fca11f46700 1 --2- 172.21.15.26:0/3458121897 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc9f40640b0 0x7fc9f4066570 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7fc9fc004c40 tx=0x7fc9fc00b040).stop 2021-11-03T17:35:25.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.685+0000 7fca11f46700 1 -- 172.21.15.26:0/3458121897 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca0c0f6ff0 msgr2=0x7fca0c107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:35:25.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.685+0000 7fca11f46700 1 --2- 172.21.15.26:0/3458121897 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca0c0f6ff0 0x7fca0c107460 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7fca00009990 tx=0x7fca00009b30).stop 2021-11-03T17:35:25.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.685+0000 7fca11f46700 1 -- 172.21.15.26:0/3458121897 shutdown_connections 2021-11-03T17:35:25.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.685+0000 7fca11f46700 1 --2- 172.21.15.26:0/3458121897 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc9f40640b0 0x7fc9f4066570 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:25.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.685+0000 7fca11f46700 1 --2- 172.21.15.26:0/3458121897 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca0c0f66e0 0x7fca0c106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:25.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.685+0000 7fca11f46700 1 --2- 172.21.15.26:0/3458121897 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca0c0f6ff0 0x7fca0c107460 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:25.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.685+0000 7fca11f46700 1 -- 172.21.15.26:0/3458121897 >> 172.21.15.26:0/3458121897 conn(0x7fca0c0f1f00 msgr2=0x7fca0c0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:35:25.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.685+0000 7fca11f46700 1 -- 172.21.15.26:0/3458121897 shutdown_connections 2021-11-03T17:35:25.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.685+0000 7fca11f46700 1 -- 172.21.15.26:0/3458121897 wait complete. 2021-11-03T17:35:25.780 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.785+0000 7f0610111700 1 -- 172.21.15.26:0/2440883545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06080f49a0 msgr2=0x7f06080f4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:35:25.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.785+0000 7f0610111700 1 --2- 172.21.15.26:0/2440883545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06080f49a0 0x7f06080f4dc0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f05f8004660 tx=0x7f05f8009b30).stop 2021-11-03T17:35:25.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.785+0000 7f0610111700 1 -- 172.21.15.26:0/2440883545 shutdown_connections 2021-11-03T17:35:25.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.785+0000 7f0610111700 1 --2- 172.21.15.26:0/2440883545 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f06080f5340 0x7f06080f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:35:25.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.785+0000 7f0610111700 1 --2- 172.21.15.26:0/2440883545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06080f49a0 0x7f06080f4dc0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:25.782 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.785+0000 7f0610111700 1 -- 172.21.15.26:0/2440883545 >> 172.21.15.26:0/2440883545 conn(0x7f06080f04c0 msgr2=0x7f06080f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:35:25.782 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.785+0000 7f0610111700 1 -- 172.21.15.26:0/2440883545 shutdown_connections 2021-11-03T17:35:25.782 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.785+0000 7f0610111700 1 -- 172.21.15.26:0/2440883545 wait complete. 2021-11-03T17:35:25.782 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.785+0000 7f0610111700 1 Processor -- start 2021-11-03T17:35:25.783 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.786+0000 7f0610111700 1 -- start start 2021-11-03T17:35:25.783 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.786+0000 7f0610111700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f06080f49a0 0x7f06080f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:35:25.783 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.786+0000 7f0610111700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06080f5340 0x7f06080f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:35:25.783 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.786+0000 7f0610111700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06080f5fc0 con 0x7f06080f5340 2021-11-03T17:35:25.784 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.786+0000 7f0610111700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06080f6100 con 0x7f06080f49a0 2021-11-03T17:35:25.784 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.786+0000 7f060d6ac700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06080f5340 0x7f06080f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:35:25.784 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.786+0000 7f060d6ac700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06080f5340 0x7f06080f59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55268/0 (socket says 172.21.15.26:55268) 2021-11-03T17:35:25.784 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.786+0000 7f060d6ac700 1 -- 172.21.15.26:0/4089295627 learned_addr learned my addr 172.21.15.26:0/4089295627 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:35:25.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.786+0000 7f060dead700 1 --2- 172.21.15.26:0/4089295627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f06080f49a0 0x7f06080f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:35:25.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.786+0000 7f060d6ac700 1 -- 172.21.15.26:0/4089295627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f06080f49a0 msgr2=0x7f06080f7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:35:25.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.786+0000 7f060d6ac700 1 --2- 172.21.15.26:0/4089295627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f06080f49a0 0x7f06080f7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:25.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.786+0000 7f060d6ac700 1 -- 172.21.15.26:0/4089295627 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f8005040 con 0x7f06080f5340 2021-11-03T17:35:25.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.786+0000 7f060d6ac700 1 --2- 172.21.15.26:0/4089295627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06080f5340 0x7f06080f59d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7f06040093f0 tx=0x7f0604006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:35:25.786 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.786+0000 7f05fe7fc700 1 -- 172.21.15.26:0/4089295627 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0604009ea0 con 0x7f06080f5340 2021-11-03T17:35:25.786 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.786+0000 7f05fe7fc700 1 -- 172.21.15.26:0/4089295627 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0604013af0 con 0x7f06080f5340 2021-11-03T17:35:25.786 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.786+0000 7f05fe7fc700 1 -- 172.21.15.26:0/4089295627 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f060400db10 con 0x7f06080f5340 2021-11-03T17:35:25.786 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.786+0000 7f0610111700 1 -- 172.21.15.26:0/4089295627 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06080f63e0 con 0x7f06080f5340 2021-11-03T17:35:25.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.787+0000 7f0610111700 1 -- 172.21.15.26:0/4089295627 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f060810f090 con 0x7f06080f5340 2021-11-03T17:35:25.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.787+0000 7f0610111700 1 -- 172.21.15.26:0/4089295627 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0608045ad0 con 0x7f06080f5340 2021-11-03T17:35:25.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.788+0000 7f05fe7fc700 1 -- 172.21.15.26:0/4089295627 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f060401a060 con 0x7f06080f5340 2021-11-03T17:35:25.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.788+0000 7f05fe7fc700 1 --2- 172.21.15.26:0/4089295627 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f05f40640b0 0x7f05f4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:35:25.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.788+0000 7f05fe7fc700 1 -- 172.21.15.26:0/4089295627 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f0604080910 con 0x7f06080f5340 2021-11-03T17:35:25.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.789+0000 7f060dead700 1 --2- 172.21.15.26:0/4089295627 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f05f40640b0 0x7f05f4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:35:25.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.789+0000 7f060dead700 1 --2- 172.21.15.26:0/4089295627 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f05f40640b0 0x7f05f4066570 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f05f8004e30 tx=0x7f05f8009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:35:25.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:25.792+0000 7f05fe7fc700 1 -- 172.21.15.26:0/4089295627 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f0604052b80 con 0x7f06080f5340 2021-11-03T17:35:25.994 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:26.000+0000 7f0610111700 1 -- 172.21.15.26:0/4089295627 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f06080ff000 con 0x7f06080f5340 2021-11-03T17:35:25.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:26.001+0000 7f05fe7fc700 1 -- 172.21.15.26:0/4089295627 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f0604018710 con 0x7f06080f5340 2021-11-03T17:35:25.995 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:35:25.995 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:35:25.996 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:35:25.996 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:35:25.996 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:35:25.996 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:35:25.996 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:35:25.997 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:35:25.997 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:35:25.997 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:35:25.997 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:35:25.998 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:35:25.998 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:35:25.998 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:35:25.998 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:35:25.999 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:35:25.999 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:35:25.999 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:35:25.999 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:35:25.999 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:35:26.000 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:35:26.000 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:35:26.000 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:35:26.000 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:35:26.001 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:35:26.001 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:35:26.001 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:35:26.001 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:35:26.001 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:35:26.002 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:35:26.002 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:35:26.002 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:35:26.002 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:35:26.003 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:35:26.003 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:35:26.003 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:35:26.003 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:35:26.004 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:35:26.004 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:35:26.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:26.003+0000 7f0610111700 1 -- 172.21.15.26:0/4089295627 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f05f40640b0 msgr2=0x7f05f4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:35:26.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:26.003+0000 7f0610111700 1 --2- 172.21.15.26:0/4089295627 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f05f40640b0 0x7f05f4066570 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f05f8004e30 tx=0x7f05f8009b30).stop 2021-11-03T17:35:26.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:26.003+0000 7f0610111700 1 -- 172.21.15.26:0/4089295627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06080f5340 msgr2=0x7f06080f59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:35:26.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:26.003+0000 7f0610111700 1 --2- 172.21.15.26:0/4089295627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06080f5340 0x7f06080f59d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7f06040093f0 tx=0x7f0604006ec0).stop 2021-11-03T17:35:26.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:26.003+0000 7f0610111700 1 -- 172.21.15.26:0/4089295627 shutdown_connections 2021-11-03T17:35:26.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:26.003+0000 7f0610111700 1 --2- 172.21.15.26:0/4089295627 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f05f40640b0 0x7f05f4066570 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:26.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:26.003+0000 7f0610111700 1 --2- 172.21.15.26:0/4089295627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f06080f49a0 0x7f06080f7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:26.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:26.003+0000 7f0610111700 1 --2- 172.21.15.26:0/4089295627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06080f5340 0x7f06080f59d0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:26.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:26.003+0000 7f0610111700 1 -- 172.21.15.26:0/4089295627 >> 172.21.15.26:0/4089295627 conn(0x7f06080f04c0 msgr2=0x7f06080fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:35:26.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:26.003+0000 7f0610111700 1 -- 172.21.15.26:0/4089295627 shutdown_connections 2021-11-03T17:35:26.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:26.003+0000 7f0610111700 1 -- 172.21.15.26:0/4089295627 wait complete. 2021-11-03T17:35:26.008 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:35:26.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:26 smithi194 ceph-mon[65619]: pgmap v1223: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:26.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:26 smithi194 ceph-mon[65619]: from='client.35404 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:35:26.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:26 smithi194 ceph-mon[65619]: from='client.35408 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:35:26.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:26 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3458121897' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:35:26.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:26 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:35:26.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:26 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/4089295627' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:35:26.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:26 smithi026 ceph-mon[96795]: pgmap v1223: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:26.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:26 smithi026 ceph-mon[96795]: from='client.35404 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:35:26.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:26 smithi026 ceph-mon[96795]: from='client.35408 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:35:26.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:26 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3458121897' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:35:26.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:26 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:35:26.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:26 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/4089295627' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:35:27.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:27 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:35:27.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:27 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:35:28.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:28 smithi194 ceph-mon[65619]: pgmap v1224: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:28.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:28 smithi026 ceph-mon[96795]: pgmap v1224: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:30.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:30 smithi194 ceph-mon[65619]: pgmap v1225: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:30.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:30 smithi026 ceph-mon[96795]: pgmap v1225: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:32.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:32 smithi194 ceph-mon[65619]: pgmap v1226: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:32.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:32 smithi026 ceph-mon[96795]: pgmap v1226: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:34.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:34 smithi194 ceph-mon[65619]: pgmap v1227: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:34.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:34 smithi026 ceph-mon[96795]: pgmap v1227: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:36.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:36 smithi194 ceph-mon[65619]: pgmap v1228: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:36.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:36 smithi026 ceph-mon[96795]: pgmap v1228: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:38.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:38 smithi194 ceph-mon[65619]: pgmap v1229: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:38.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:38 smithi026 ceph-mon[96795]: pgmap v1229: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:40.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:40 smithi194 ceph-mon[65619]: pgmap v1230: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:40.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:40 smithi026 ceph-mon[96795]: pgmap v1230: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:41.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:35:41.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:35:42.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:42 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:35:42.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:42 smithi194 ceph-mon[65619]: pgmap v1231: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:42.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:42 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:35:42.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:42 smithi026 ceph-mon[96795]: pgmap v1231: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:44.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:44 smithi194 ceph-mon[65619]: pgmap v1232: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:44.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:44 smithi026 ceph-mon[96795]: pgmap v1232: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:46.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:46 smithi026 ceph-mon[96795]: pgmap v1233: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:46.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:46 smithi194 ceph-mon[65619]: pgmap v1233: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:48 smithi026 ceph-mon[96795]: pgmap v1234: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:35:48.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:35:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:48 smithi194 ceph-mon[65619]: pgmap v1234: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:35:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:35:50.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:50 smithi026 ceph-mon[96795]: pgmap v1235: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:50.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:50 smithi194 ceph-mon[65619]: pgmap v1235: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:52.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:52 smithi026 ceph-mon[96795]: pgmap v1236: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:52.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:52 smithi194 ceph-mon[65619]: pgmap v1236: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:54.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:54 smithi026 ceph-mon[96795]: pgmap v1237: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:54.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:54 smithi194 ceph-mon[65619]: pgmap v1237: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:56.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.116+0000 7f95ebc9a700 1 -- 172.21.15.26:0/3835551968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95e40f4de0 msgr2=0x7f95e40f5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:35:56.113 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.116+0000 7f95ebc9a700 1 --2- 172.21.15.26:0/3835551968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95e40f4de0 0x7f95e40f5200 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f95e0004660 tx=0x7f95e0009b30).stop 2021-11-03T17:35:56.113 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.116+0000 7f95ebc9a700 1 -- 172.21.15.26:0/3835551968 shutdown_connections 2021-11-03T17:35:56.113 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.116+0000 7f95ebc9a700 1 --2- 172.21.15.26:0/3835551968 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95e40f5fe0 0x7f95e40f6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:56.113 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.116+0000 7f95ebc9a700 1 --2- 172.21.15.26:0/3835551968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95e40f4de0 0x7f95e40f5200 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:56.114 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.116+0000 7f95ebc9a700 1 -- 172.21.15.26:0/3835551968 >> 172.21.15.26:0/3835551968 conn(0x7f95e40f0540 msgr2=0x7f95e40f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:35:56.114 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.116+0000 7f95ebc9a700 1 -- 172.21.15.26:0/3835551968 shutdown_connections 2021-11-03T17:35:56.114 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.116+0000 7f95ebc9a700 1 -- 172.21.15.26:0/3835551968 wait complete. 2021-11-03T17:35:56.114 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.117+0000 7f95ebc9a700 1 Processor -- start 2021-11-03T17:35:56.115 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.117+0000 7f95ebc9a700 1 -- start start 2021-11-03T17:35:56.115 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.117+0000 7f95ebc9a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95e40f4de0 0x7f95e4106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:35:56.116 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.117+0000 7f95ebc9a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95e40f5fe0 0x7f95e4107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:35:56.116 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.117+0000 7f95ebc9a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e4107a00 con 0x7f95e40f4de0 2021-11-03T17:35:56.116 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.117+0000 7f95ebc9a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e4107b40 con 0x7f95e40f5fe0 2021-11-03T17:35:56.116 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.117+0000 7f95e9a36700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95e40f4de0 0x7f95e4106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:35:56.116 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.117+0000 7f95e9a36700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95e40f4de0 0x7f95e4106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55284/0 (socket says 172.21.15.26:55284) 2021-11-03T17:35:56.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.117+0000 7f95e9a36700 1 -- 172.21.15.26:0/568600490 learned_addr learned my addr 172.21.15.26:0/568600490 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:35:56.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.117+0000 7f95e9235700 1 --2- 172.21.15.26:0/568600490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95e40f5fe0 0x7f95e4107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:35:56.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.118+0000 7f95e9a36700 1 -- 172.21.15.26:0/568600490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95e40f5fe0 msgr2=0x7f95e4107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:35:56.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.118+0000 7f95e9a36700 1 --2- 172.21.15.26:0/568600490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95e40f5fe0 0x7f95e4107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:56.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.118+0000 7f95e9a36700 1 -- 172.21.15.26:0/568600490 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e0005040 con 0x7f95e40f4de0 2021-11-03T17:35:56.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.118+0000 7f95e9a36700 1 --2- 172.21.15.26:0/568600490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95e40f4de0 0x7f95e4106f60 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7f95e0009990 tx=0x7f95e0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:35:56.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.118+0000 7f95da7fc700 1 -- 172.21.15.26:0/568600490 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95e0018070 con 0x7f95e40f4de0 2021-11-03T17:35:56.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.118+0000 7f95da7fc700 1 -- 172.21.15.26:0/568600490 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f95e0007ba0 con 0x7f95e40f4de0 2021-11-03T17:35:56.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.118+0000 7f95ebc9a700 1 -- 172.21.15.26:0/568600490 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95e4108480 con 0x7f95e40f4de0 2021-11-03T17:35:56.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.118+0000 7f95da7fc700 1 -- 172.21.15.26:0/568600490 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95e001c3c0 con 0x7f95e40f4de0 2021-11-03T17:35:56.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.118+0000 7f95ebc9a700 1 -- 172.21.15.26:0/568600490 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e41089e0 con 0x7f95e40f4de0 2021-11-03T17:35:56.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.119+0000 7f95ebc9a700 1 -- 172.21.15.26:0/568600490 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e4045ad0 con 0x7f95e40f4de0 2021-11-03T17:35:56.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.119+0000 7f95da7fc700 1 -- 172.21.15.26:0/568600490 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f95e001d420 con 0x7f95e40f4de0 2021-11-03T17:35:56.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.120+0000 7f95da7fc700 1 --2- 172.21.15.26:0/568600490 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f95d00640b0 0x7f95d0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:35:56.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.120+0000 7f95da7fc700 1 -- 172.21.15.26:0/568600490 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f95e0082360 con 0x7f95e40f4de0 2021-11-03T17:35:56.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.120+0000 7f95e9235700 1 --2- 172.21.15.26:0/568600490 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f95d00640b0 0x7f95d0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:35:56.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.120+0000 7f95e9235700 1 --2- 172.21.15.26:0/568600490 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f95d00640b0 0x7f95d0066570 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f95d400a7f0 tx=0x7f95d4009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:35:56.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.124+0000 7f95da7fc700 1 -- 172.21.15.26:0/568600490 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f95e0054720 con 0x7f95e40f4de0 2021-11-03T17:35:56.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.306+0000 7f95ebc9a700 1 -- 172.21.15.26:0/568600490 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f95e40fcda0 con 0x7f95d00640b0 2021-11-03T17:35:56.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.307+0000 7f95da7fc700 1 -- 172.21.15.26:0/568600490 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f95e40fcda0 con 0x7f95d00640b0 2021-11-03T17:35:56.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.309+0000 7f95ebc9a700 1 -- 172.21.15.26:0/568600490 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f95d00640b0 msgr2=0x7f95d0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:35:56.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.309+0000 7f95ebc9a700 1 --2- 172.21.15.26:0/568600490 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f95d00640b0 0x7f95d0066570 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f95d400a7f0 tx=0x7f95d4009040).stop 2021-11-03T17:35:56.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.309+0000 7f95ebc9a700 1 -- 172.21.15.26:0/568600490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95e40f4de0 msgr2=0x7f95e4106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:35:56.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.309+0000 7f95ebc9a700 1 --2- 172.21.15.26:0/568600490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95e40f4de0 0x7f95e4106f60 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7f95e0009990 tx=0x7f95e0009b30).stop 2021-11-03T17:35:56.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.309+0000 7f95ebc9a700 1 -- 172.21.15.26:0/568600490 shutdown_connections 2021-11-03T17:35:56.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.309+0000 7f95ebc9a700 1 --2- 172.21.15.26:0/568600490 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f95d00640b0 0x7f95d0066570 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:56.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.309+0000 7f95ebc9a700 1 --2- 172.21.15.26:0/568600490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95e40f4de0 0x7f95e4106f60 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:56.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.309+0000 7f95ebc9a700 1 --2- 172.21.15.26:0/568600490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95e40f5fe0 0x7f95e4107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:56.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.309+0000 7f95ebc9a700 1 -- 172.21.15.26:0/568600490 >> 172.21.15.26:0/568600490 conn(0x7f95e40f0540 msgr2=0x7f95e40f9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:35:56.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.309+0000 7f95ebc9a700 1 -- 172.21.15.26:0/568600490 shutdown_connections 2021-11-03T17:35:56.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.309+0000 7f95ebc9a700 1 -- 172.21.15.26:0/568600490 wait complete. 2021-11-03T17:35:56.314 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:35:56.406 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.409+0000 7fe8df1db700 1 -- 172.21.15.26:0/2276472198 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8d80f6530 msgr2=0x7fe8d80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:35:56.406 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.409+0000 7fe8df1db700 1 --2- 172.21.15.26:0/2276472198 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8d80f6530 0x7fe8d80f6950 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7fe8d4004660 tx=0x7fe8d4009b30).stop 2021-11-03T17:35:56.406 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.409+0000 7fe8df1db700 1 -- 172.21.15.26:0/2276472198 shutdown_connections 2021-11-03T17:35:56.407 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.409+0000 7fe8df1db700 1 --2- 172.21.15.26:0/2276472198 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8d80f77d0 0x7fe8d80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:56.407 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.409+0000 7fe8df1db700 1 --2- 172.21.15.26:0/2276472198 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8d80f6530 0x7fe8d80f6950 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:56.407 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.409+0000 7fe8df1db700 1 -- 172.21.15.26:0/2276472198 >> 172.21.15.26:0/2276472198 conn(0x7fe8d80f1c90 msgr2=0x7fe8d80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:35:56.407 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.409+0000 7fe8df1db700 1 -- 172.21.15.26:0/2276472198 shutdown_connections 2021-11-03T17:35:56.407 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.410+0000 7fe8df1db700 1 -- 172.21.15.26:0/2276472198 wait complete. 2021-11-03T17:35:56.408 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.410+0000 7fe8df1db700 1 Processor -- start 2021-11-03T17:35:56.408 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.410+0000 7fe8df1db700 1 -- start start 2021-11-03T17:35:56.408 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.410+0000 7fe8df1db700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8d80f6530 0x7fe8d8108f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:35:56.408 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.410+0000 7fe8df1db700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8d80f77d0 0x7fe8d8109480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:35:56.409 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.410+0000 7fe8df1db700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d8109a30 con 0x7fe8d80f77d0 2021-11-03T17:35:56.409 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.410+0000 7fe8df1db700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d8109b70 con 0x7fe8d80f6530 2021-11-03T17:35:56.409 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.410+0000 7fe8dd9d8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8d80f77d0 0x7fe8d8109480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:35:56.409 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.410+0000 7fe8dd9d8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8d80f77d0 0x7fe8d8109480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55296/0 (socket says 172.21.15.26:55296) 2021-11-03T17:35:56.409 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.410+0000 7fe8dd9d8700 1 -- 172.21.15.26:0/271903293 learned_addr learned my addr 172.21.15.26:0/271903293 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:35:56.410 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.411+0000 7fe8de1d9700 1 --2- 172.21.15.26:0/271903293 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8d80f6530 0x7fe8d8108f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:35:56.410 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.411+0000 7fe8dd9d8700 1 -- 172.21.15.26:0/271903293 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8d80f6530 msgr2=0x7fe8d8108f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:35:56.410 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.411+0000 7fe8dd9d8700 1 --2- 172.21.15.26:0/271903293 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8d80f6530 0x7fe8d8108f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:56.410 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.411+0000 7fe8dd9d8700 1 -- 172.21.15.26:0/271903293 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d4005040 con 0x7fe8d80f77d0 2021-11-03T17:35:56.411 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.411+0000 7fe8dd9d8700 1 --2- 172.21.15.26:0/271903293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8d80f77d0 0x7fe8d8109480 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7fe8c80026d0 tx=0x7fe8c8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:35:56.411 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.411+0000 7fe8ceffd700 1 -- 172.21.15.26:0/271903293 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8c80079c0 con 0x7fe8d80f77d0 2021-11-03T17:35:56.411 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.411+0000 7fe8df1db700 1 -- 172.21.15.26:0/271903293 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d810a510 con 0x7fe8d80f77d0 2021-11-03T17:35:56.411 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.411+0000 7fe8ceffd700 1 -- 172.21.15.26:0/271903293 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe8c800f040 con 0x7fe8d80f77d0 2021-11-03T17:35:56.411 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.411+0000 7fe8ceffd700 1 -- 172.21.15.26:0/271903293 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8c80148b0 con 0x7fe8d80f77d0 2021-11-03T17:35:56.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.411+0000 7fe8df1db700 1 -- 172.21.15.26:0/271903293 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d810aad0 con 0x7fe8d80f77d0 2021-11-03T17:35:56.413 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.412+0000 7fe8df1db700 1 -- 172.21.15.26:0/271903293 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d8045ad0 con 0x7fe8d80f77d0 2021-11-03T17:35:56.413 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.412+0000 7fe8ceffd700 1 -- 172.21.15.26:0/271903293 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fe8c8007b20 con 0x7fe8d80f77d0 2021-11-03T17:35:56.414 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.413+0000 7fe8ceffd700 1 --2- 172.21.15.26:0/271903293 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe8c4064100 0x7fe8c40665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:35:56.414 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.413+0000 7fe8ceffd700 1 -- 172.21.15.26:0/271903293 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fe8c8080660 con 0x7fe8d80f77d0 2021-11-03T17:35:56.414 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.413+0000 7fe8de1d9700 1 --2- 172.21.15.26:0/271903293 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe8c4064100 0x7fe8c40665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:35:56.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.413+0000 7fe8de1d9700 1 --2- 172.21.15.26:0/271903293 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe8c4064100 0x7fe8c40665c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7fe8d4004630 tx=0x7fe8d4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:35:56.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.417+0000 7fe8ceffd700 1 -- 172.21.15.26:0/271903293 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fe8c80529c0 con 0x7fe8d80f77d0 2021-11-03T17:35:56.584 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.590+0000 7fe8df1db700 1 -- 172.21.15.26:0/271903293 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8d810ada0 con 0x7fe8c4064100 2021-11-03T17:35:56.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.604+0000 7fe8ceffd700 1 -- 172.21.15.26:0/271903293 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fe8d810ada0 con 0x7fe8c4064100 2021-11-03T17:35:56.599 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:35:56.600 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (47m) 6m ago 48m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:35:56.600 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (39m) 6m ago 48m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:35:56.600 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (39m) 5m ago 47m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:35:56.600 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (46m) 6m ago 48m 40.3M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:35:56.601 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (40m) 6m ago 43m 22.6M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:35:56.601 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (40m) 6m ago 43m 23.5M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:35:56.601 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (43m) 5m ago 43m 24.8M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:35:56.601 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (43m) 5m ago 43m 25.0M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:35:56.601 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (40m) 6m ago 49m 520M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:35:56.602 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (40m) 5m ago 47m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:35:56.602 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (40m) 6m ago 49m 176M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:35:56.602 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (39m) 5m ago 47m 89.5M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:35:56.603 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (48m) 6m ago 48m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:35:56.603 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (47m) 5m ago 47m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:35:56.603 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (39m) 6m ago 46m 231M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:35:56.603 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (38m) 6m ago 46m 248M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:35:56.604 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (37m) 6m ago 46m 207M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:35:56.604 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (37m) 5m ago 45m 262M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:35:56.604 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (37m) 5m ago 45m 227M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:35:56.604 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (36m) 5m ago 45m 215M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:35:56.605 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (46m) 6m ago 47m 54.4M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:35:56.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.606+0000 7fe8df1db700 1 -- 172.21.15.26:0/271903293 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe8c4064100 msgr2=0x7fe8c40665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:35:56.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.606+0000 7fe8df1db700 1 --2- 172.21.15.26:0/271903293 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe8c4064100 0x7fe8c40665c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7fe8d4004630 tx=0x7fe8d4009b30).stop 2021-11-03T17:35:56.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.606+0000 7fe8df1db700 1 -- 172.21.15.26:0/271903293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8d80f77d0 msgr2=0x7fe8d8109480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:35:56.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.606+0000 7fe8df1db700 1 --2- 172.21.15.26:0/271903293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8d80f77d0 0x7fe8d8109480 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7fe8c80026d0 tx=0x7fe8c8009de0).stop 2021-11-03T17:35:56.607 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.606+0000 7fe8df1db700 1 -- 172.21.15.26:0/271903293 shutdown_connections 2021-11-03T17:35:56.607 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.606+0000 7fe8df1db700 1 --2- 172.21.15.26:0/271903293 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe8c4064100 0x7fe8c40665c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:56.607 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.606+0000 7fe8df1db700 1 --2- 172.21.15.26:0/271903293 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8d80f6530 0x7fe8d8108f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:56.607 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.606+0000 7fe8df1db700 1 --2- 172.21.15.26:0/271903293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8d80f77d0 0x7fe8d8109480 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:56.608 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.606+0000 7fe8df1db700 1 -- 172.21.15.26:0/271903293 >> 172.21.15.26:0/271903293 conn(0x7fe8d80f1c90 msgr2=0x7fe8d806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:35:56.608 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.606+0000 7fe8df1db700 1 -- 172.21.15.26:0/271903293 shutdown_connections 2021-11-03T17:35:56.608 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.606+0000 7fe8df1db700 1 -- 172.21.15.26:0/271903293 wait complete. 2021-11-03T17:35:56.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:56 smithi026 ceph-mon[96795]: pgmap v1238: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:56.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:56 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:35:56.702 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.706+0000 7fe46426c700 1 -- 172.21.15.26:0/1454806008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe45c0f7980 msgr2=0x7fe45c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:35:56.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.706+0000 7fe46426c700 1 --2- 172.21.15.26:0/1454806008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe45c0f7980 0x7fe45c0f7de0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7fe450004660 tx=0x7fe450009b30).stop 2021-11-03T17:35:56.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.706+0000 7fe46426c700 1 -- 172.21.15.26:0/1454806008 shutdown_connections 2021-11-03T17:35:56.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.706+0000 7fe46426c700 1 --2- 172.21.15.26:0/1454806008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe45c0f7980 0x7fe45c0f7de0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:56.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.706+0000 7fe46426c700 1 --2- 172.21.15.26:0/1454806008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe45c0f66e0 0x7fe45c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:56.704 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.706+0000 7fe46426c700 1 -- 172.21.15.26:0/1454806008 >> 172.21.15.26:0/1454806008 conn(0x7fe45c0f1e40 msgr2=0x7fe45c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:35:56.704 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.706+0000 7fe46426c700 1 -- 172.21.15.26:0/1454806008 shutdown_connections 2021-11-03T17:35:56.704 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.706+0000 7fe46426c700 1 -- 172.21.15.26:0/1454806008 wait complete. 2021-11-03T17:35:56.704 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.706+0000 7fe46426c700 1 Processor -- start 2021-11-03T17:35:56.704 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.706+0000 7fe46426c700 1 -- start start 2021-11-03T17:35:56.705 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.707+0000 7fe46426c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe45c0f66e0 0x7fe45c106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:35:56.705 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.707+0000 7fe46426c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe45c0f7980 0x7fe45c107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:35:56.705 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.707+0000 7fe46426c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c107a20 con 0x7fe45c0f7980 2021-11-03T17:35:56.706 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.707+0000 7fe46426c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c107b60 con 0x7fe45c0f66e0 2021-11-03T17:35:56.706 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.707+0000 7fe461807700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe45c0f7980 0x7fe45c107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:35:56.706 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.707+0000 7fe461807700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe45c0f7980 0x7fe45c107470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55306/0 (socket says 172.21.15.26:55306) 2021-11-03T17:35:56.707 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.707+0000 7fe461807700 1 -- 172.21.15.26:0/1921781933 learned_addr learned my addr 172.21.15.26:0/1921781933 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:35:56.707 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.707+0000 7fe462008700 1 --2- 172.21.15.26:0/1921781933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe45c0f66e0 0x7fe45c106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:35:56.707 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.707+0000 7fe461807700 1 -- 172.21.15.26:0/1921781933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe45c0f66e0 msgr2=0x7fe45c106f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:35:56.708 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.707+0000 7fe461807700 1 --2- 172.21.15.26:0/1921781933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe45c0f66e0 0x7fe45c106f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:56.708 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.707+0000 7fe461807700 1 -- 172.21.15.26:0/1921781933 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe450005040 con 0x7fe45c0f7980 2021-11-03T17:35:56.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.707+0000 7fe461807700 1 --2- 172.21.15.26:0/1921781933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe45c0f7980 0x7fe45c107470 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7fe450009990 tx=0x7fe450009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:35:56.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.707+0000 7fe45affd700 1 -- 172.21.15.26:0/1921781933 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe450018070 con 0x7fe45c0f7980 2021-11-03T17:35:56.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.707+0000 7fe45affd700 1 -- 172.21.15.26:0/1921781933 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe450007ca0 con 0x7fe45c0f7980 2021-11-03T17:35:56.710 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.707+0000 7fe46426c700 1 -- 172.21.15.26:0/1921781933 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe45c1084a0 con 0x7fe45c0f7980 2021-11-03T17:35:56.710 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.707+0000 7fe45affd700 1 -- 172.21.15.26:0/1921781933 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe45001c620 con 0x7fe45c0f7980 2021-11-03T17:35:56.710 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.707+0000 7fe46426c700 1 -- 172.21.15.26:0/1921781933 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe45c108a00 con 0x7fe45c0f7980 2021-11-03T17:35:56.712 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.708+0000 7fe46426c700 1 -- 172.21.15.26:0/1921781933 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe45c045ad0 con 0x7fe45c0f7980 2021-11-03T17:35:56.712 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.709+0000 7fe45affd700 1 -- 172.21.15.26:0/1921781933 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fe45001d960 con 0x7fe45c0f7980 2021-11-03T17:35:56.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.709+0000 7fe45affd700 1 --2- 172.21.15.26:0/1921781933 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe4440640b0 0x7fe444066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:35:56.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.709+0000 7fe45affd700 1 -- 172.21.15.26:0/1921781933 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fe450082470 con 0x7fe45c0f7980 2021-11-03T17:35:56.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.709+0000 7fe462008700 1 --2- 172.21.15.26:0/1921781933 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe4440640b0 0x7fe444066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:35:56.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.709+0000 7fe462008700 1 --2- 172.21.15.26:0/1921781933 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe4440640b0 0x7fe444066570 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7fe454004550 tx=0x7fe454009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:35:56.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.713+0000 7fe45affd700 1 -- 172.21.15.26:0/1921781933 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fe450054890 con 0x7fe45c0f7980 2021-11-03T17:35:56.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:56 smithi194 ceph-mon[65619]: pgmap v1238: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:56.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:56 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:35:56.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.942+0000 7fe46426c700 1 -- 172.21.15.26:0/1921781933 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe45c027a00 con 0x7fe45c0f7980 2021-11-03T17:35:56.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.943+0000 7fe45affd700 1 -- 172.21.15.26:0/1921781933 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fe450054480 con 0x7fe45c0f7980 2021-11-03T17:35:56.939 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:35:56.939 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:35:56.939 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:35:56.939 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:35:56.940 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:35:56.940 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:35:56.940 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:35:56.940 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:35:56.941 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:35:56.941 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:35:56.941 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:35:56.941 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:35:56.941 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:35:56.942 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:35:56.942 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:35:56.942 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:35:56.942 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:35:56.943 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:35:56.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.945+0000 7fe46426c700 1 -- 172.21.15.26:0/1921781933 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe4440640b0 msgr2=0x7fe444066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:35:56.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.945+0000 7fe46426c700 1 --2- 172.21.15.26:0/1921781933 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe4440640b0 0x7fe444066570 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7fe454004550 tx=0x7fe454009040).stop 2021-11-03T17:35:56.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.945+0000 7fe46426c700 1 -- 172.21.15.26:0/1921781933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe45c0f7980 msgr2=0x7fe45c107470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:35:56.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.945+0000 7fe46426c700 1 --2- 172.21.15.26:0/1921781933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe45c0f7980 0x7fe45c107470 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7fe450009990 tx=0x7fe450009b30).stop 2021-11-03T17:35:56.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.945+0000 7fe46426c700 1 -- 172.21.15.26:0/1921781933 shutdown_connections 2021-11-03T17:35:56.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.945+0000 7fe46426c700 1 --2- 172.21.15.26:0/1921781933 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe4440640b0 0x7fe444066570 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:56.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.945+0000 7fe46426c700 1 --2- 172.21.15.26:0/1921781933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe45c0f66e0 0x7fe45c106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:56.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.945+0000 7fe46426c700 1 --2- 172.21.15.26:0/1921781933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe45c0f7980 0x7fe45c107470 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:56.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.945+0000 7fe46426c700 1 -- 172.21.15.26:0/1921781933 >> 172.21.15.26:0/1921781933 conn(0x7fe45c0f1e40 msgr2=0x7fe45c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:35:56.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.945+0000 7fe46426c700 1 -- 172.21.15.26:0/1921781933 shutdown_connections 2021-11-03T17:35:56.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:56.945+0000 7fe46426c700 1 -- 172.21.15.26:0/1921781933 wait complete. 2021-11-03T17:35:57.042 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.045+0000 7f63c9bf5700 1 -- 172.21.15.26:0/646690560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63c40f55c0 msgr2=0x7f63c40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:35:57.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.045+0000 7f63c9bf5700 1 --2- 172.21.15.26:0/646690560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63c40f55c0 0x7f63c40f59e0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f63b4004660 tx=0x7f63b4009b30).stop 2021-11-03T17:35:57.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.045+0000 7f63c9bf5700 1 -- 172.21.15.26:0/646690560 shutdown_connections 2021-11-03T17:35:57.044 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.045+0000 7f63c9bf5700 1 --2- 172.21.15.26:0/646690560 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63c40f6860 0x7f63c40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:57.044 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.045+0000 7f63c9bf5700 1 --2- 172.21.15.26:0/646690560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63c40f55c0 0x7f63c40f59e0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:57.044 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.045+0000 7f63c9bf5700 1 -- 172.21.15.26:0/646690560 >> 172.21.15.26:0/646690560 conn(0x7f63c40f0d40 msgr2=0x7f63c40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:35:57.045 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.045+0000 7f63c9bf5700 1 -- 172.21.15.26:0/646690560 shutdown_connections 2021-11-03T17:35:57.045 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.045+0000 7f63c9bf5700 1 -- 172.21.15.26:0/646690560 wait complete. 2021-11-03T17:35:57.045 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.045+0000 7f63c9bf5700 1 Processor -- start 2021-11-03T17:35:57.046 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.046+0000 7f63c9bf5700 1 -- start start 2021-11-03T17:35:57.046 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.046+0000 7f63c9bf5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63c40f55c0 0x7f63c4109c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:35:57.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.046+0000 7f63c9bf5700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63c40f6860 0x7f63c410c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:35:57.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.046+0000 7f63c9bf5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c40603c0 con 0x7f63c40f55c0 2021-11-03T17:35:57.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.046+0000 7f63c9bf5700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c4060500 con 0x7f63c40f6860 2021-11-03T17:35:57.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.046+0000 7f63c37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63c40f55c0 0x7f63c4109c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:35:57.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.046+0000 7f63c37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63c40f55c0 0x7f63c4109c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55314/0 (socket says 172.21.15.26:55314) 2021-11-03T17:35:57.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.046+0000 7f63c37fe700 1 -- 172.21.15.26:0/796312621 learned_addr learned my addr 172.21.15.26:0/796312621 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:35:57.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.046+0000 7f63c37fe700 1 -- 172.21.15.26:0/796312621 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63c40f6860 msgr2=0x7f63c410c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:35:57.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.046+0000 7f63c37fe700 1 --2- 172.21.15.26:0/796312621 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63c40f6860 0x7f63c410c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:35:57.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.046+0000 7f63c37fe700 1 -- 172.21.15.26:0/796312621 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b4005040 con 0x7f63c40f55c0 2021-11-03T17:35:57.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.046+0000 7f63c37fe700 1 --2- 172.21.15.26:0/796312621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63c40f55c0 0x7f63c4109c20 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7f63b4013a70 tx=0x7f63b4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:35:57.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.047+0000 7f63abfff700 1 -- 172.21.15.26:0/796312621 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63b4018070 con 0x7f63c40f55c0 2021-11-03T17:35:57.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.047+0000 7f63abfff700 1 -- 172.21.15.26:0/796312621 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f63b40097d0 con 0x7f63c40f55c0 2021-11-03T17:35:57.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.047+0000 7f63c9bf5700 1 -- 172.21.15.26:0/796312621 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c410c670 con 0x7f63c40f55c0 2021-11-03T17:35:57.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.047+0000 7f63abfff700 1 -- 172.21.15.26:0/796312621 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63b401c3c0 con 0x7f63c40f55c0 2021-11-03T17:35:57.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.047+0000 7f63c9bf5700 1 -- 172.21.15.26:0/796312621 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c410cba0 con 0x7f63c40f55c0 2021-11-03T17:35:57.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.048+0000 7f63c9bf5700 1 -- 172.21.15.26:0/796312621 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c4045ad0 con 0x7f63c40f55c0 2021-11-03T17:35:57.053 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.048+0000 7f63abfff700 1 -- 172.21.15.26:0/796312621 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f63b4007ba0 con 0x7f63c40f55c0 2021-11-03T17:35:57.053 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.049+0000 7f63abfff700 1 --2- 172.21.15.26:0/796312621 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f63ac0640b0 0x7f63ac066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:35:57.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.049+0000 7f63abfff700 1 -- 172.21.15.26:0/796312621 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f63b4082460 con 0x7f63c40f55c0 2021-11-03T17:35:57.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.049+0000 7f63c2ffd700 1 --2- 172.21.15.26:0/796312621 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f63ac0640b0 0x7f63ac066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:35:57.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.049+0000 7f63c2ffd700 1 --2- 172.21.15.26:0/796312621 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f63ac0640b0 0x7f63ac066570 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f63b8004a10 tx=0x7f63b80099e0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:35:57.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.053+0000 7f63abfff700 1 -- 172.21.15.26:0/796312621 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f63b4054880 con 0x7f63c40f55c0 2021-11-03T17:35:57.248 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.253+0000 7f63c9bf5700 1 -- 172.21.15.26:0/796312621 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f63c4027a00 con 0x7f63c40f55c0 2021-11-03T17:35:57.248 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.253+0000 7f63abfff700 1 -- 172.21.15.26:0/796312621 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f63b4054470 con 0x7f63c40f55c0 2021-11-03T17:35:57.249 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:35:57.249 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:35:57.249 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:35:57.249 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:35:57.250 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:35:57.250 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:35:57.250 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:35:57.250 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:35:57.251 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:35:57.251 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:35:57.251 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:35:57.252 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:35:57.252 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:35:57.252 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:35:57.252 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:35:57.253 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:35:57.253 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:35:57.253 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:35:57.253 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:35:57.253 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:35:57.254 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:35:57.254 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:35:57.254 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:35:57.254 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:35:57.255 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:35:57.255 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:35:57.255 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:35:57.255 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:35:57.255 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:35:57.256 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:35:57.256 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:35:57.256 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:35:57.256 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:35:57.256 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:35:57.257 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:35:57.257 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:35:57.257 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:35:57.257 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:35:57.258 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:35:57.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.255+0000 7f63c9bf5700 1 -- 172.21.15.26:0/796312621 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f63ac0640b0 msgr2=0x7f63ac066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:35:57.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.255+0000 7f63c9bf5700 1 --2- 172.21.15.26:0/796312621 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f63ac0640b0 0x7f63ac066570 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f63b8004a10 tx=0x7f63b80099e0).stop 2021-11-03T17:35:57.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.255+0000 7f63c9bf5700 1 -- 172.21.15.26:0/796312621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63c40f55c0 msgr2=0x7f63c4109c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:35:57.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.255+0000 7f63c9bf5700 1 --2- 172.21.15.26:0/796312621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63c40f55c0 0x7f63c4109c20 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7f63b4013a70 tx=0x7f63b4009b30).stop 2021-11-03T17:35:57.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.255+0000 7f63c9bf5700 1 -- 172.21.15.26:0/796312621 shutdown_connections 2021-11-03T17:35:57.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.255+0000 7f63c9bf5700 1 --2- 172.21.15.26:0/796312621 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f63ac0640b0 0x7f63ac066570 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:57.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.255+0000 7f63c9bf5700 1 --2- 172.21.15.26:0/796312621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63c40f55c0 0x7f63c4109c20 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:35:57.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.255+0000 7f63c9bf5700 1 --2- 172.21.15.26:0/796312621 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63c40f6860 0x7f63c410c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:35:57.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.255+0000 7f63c9bf5700 1 -- 172.21.15.26:0/796312621 >> 172.21.15.26:0/796312621 conn(0x7f63c40f0d40 msgr2=0x7f63c40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:35:57.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.255+0000 7f63c9bf5700 1 -- 172.21.15.26:0/796312621 shutdown_connections 2021-11-03T17:35:57.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:35:57.255+0000 7f63c9bf5700 1 -- 172.21.15.26:0/796312621 wait complete. 2021-11-03T17:35:57.261 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:35:57.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:57 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:35:57.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:57 smithi026 ceph-mon[96795]: from='client.35420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:35:57.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:57 smithi026 ceph-mon[96795]: from='client.35424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:35:57.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:57 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1921781933' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:35:57.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:57 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/796312621' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:35:57.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:57 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:35:57.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:57 smithi194 ceph-mon[65619]: from='client.35420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:35:57.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:57 smithi194 ceph-mon[65619]: from='client.35424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:35:57.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:57 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1921781933' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:35:57.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:57 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/796312621' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:35:58.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:35:58 smithi026 ceph-mon[96795]: pgmap v1239: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:35:58.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:35:58 smithi194 ceph-mon[65619]: pgmap v1239: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:00.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:00 smithi026 ceph-mon[96795]: pgmap v1240: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:00.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:00 smithi194 ceph-mon[65619]: pgmap v1240: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:02.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:02 smithi026 ceph-mon[96795]: pgmap v1241: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:02.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:02 smithi194 ceph-mon[65619]: pgmap v1241: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:04.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:04 smithi026 ceph-mon[96795]: pgmap v1242: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:04.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:04 smithi194 ceph-mon[65619]: pgmap v1242: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:06.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:06 smithi026 ceph-mon[96795]: pgmap v1243: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:06.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:06 smithi194 ceph-mon[65619]: pgmap v1243: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:08.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:08 smithi026 ceph-mon[96795]: pgmap v1244: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:08.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:08 smithi194 ceph-mon[65619]: pgmap v1244: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:10.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:10 smithi026 ceph-mon[96795]: pgmap v1245: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:10.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:10 smithi194 ceph-mon[65619]: pgmap v1245: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:11.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:11 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:36:11.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:11 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:36:12.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:12 smithi026 ceph-mon[96795]: poll took 60057.429 ms: 1 events 2021-11-03T17:36:12.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:12 smithi026 ceph-mon[96795]: pgmap v1246: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:12.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:12 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:36:12.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:12 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:36:12.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:12 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:36:12.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:12 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:36:12.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:12 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:36:12.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:12 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:36:12.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:12 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:36:12.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:12 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:36:12.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:12 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:36:12.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:12 smithi194 ceph-mon[65619]: poll took 60057.429 ms: 1 events 2021-11-03T17:36:12.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:12 smithi194 ceph-mon[65619]: pgmap v1246: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:12.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:12 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:36:12.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:12 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:36:12.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:12 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:36:12.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:12 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:36:12.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:12 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:36:12.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:12 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:36:12.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:12 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:36:12.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:12 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:36:12.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:12 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:36:14.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:14 smithi026 ceph-mon[96795]: pgmap v1247: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:14.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:14 smithi194 ceph-mon[65619]: pgmap v1247: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:16.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:16 smithi026 ceph-mon[96795]: pgmap v1248: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:16.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:16 smithi194 ceph-mon[65619]: pgmap v1248: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:18.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:18 smithi026 ceph-mon[96795]: pgmap v1249: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:18.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:18 smithi194 ceph-mon[65619]: pgmap v1249: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:20.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:20 smithi026 ceph-mon[96795]: pgmap v1250: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:20.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:20 smithi194 ceph-mon[65619]: pgmap v1250: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:22.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:22 smithi026 ceph-mon[96795]: pgmap v1251: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:22.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:22 smithi194 ceph-mon[65619]: pgmap v1251: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:24.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:24 smithi026 ceph-mon[96795]: pgmap v1252: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:24.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:24 smithi194 ceph-mon[65619]: pgmap v1252: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:26.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:26 smithi026 ceph-mon[96795]: pgmap v1253: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:26.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:26 smithi194 ceph-mon[65619]: pgmap v1253: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:27.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.371+0000 7fc5c8af9700 1 -- 172.21.15.26:0/51885951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5c40f6ff0 msgr2=0x7fc5c40f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:36:27.367 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.371+0000 7fc5c8af9700 1 --2- 172.21.15.26:0/51885951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5c40f6ff0 0x7fc5c40f7a20 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7fc5b4004660 tx=0x7fc5b4009b30).stop 2021-11-03T17:36:27.367 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.371+0000 7fc5c8af9700 1 -- 172.21.15.26:0/51885951 shutdown_connections 2021-11-03T17:36:27.367 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.371+0000 7fc5c8af9700 1 --2- 172.21.15.26:0/51885951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5c40f6ff0 0x7fc5c40f7a20 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:36:27.367 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.371+0000 7fc5c8af9700 1 --2- 172.21.15.26:0/51885951 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5c40f66e0 0x7fc5c40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:36:27.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.371+0000 7fc5c8af9700 1 -- 172.21.15.26:0/51885951 >> 172.21.15.26:0/51885951 conn(0x7fc5c40f1f00 msgr2=0x7fc5c40f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:36:27.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.371+0000 7fc5c8af9700 1 -- 172.21.15.26:0/51885951 shutdown_connections 2021-11-03T17:36:27.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.371+0000 7fc5c8af9700 1 -- 172.21.15.26:0/51885951 wait complete. 2021-11-03T17:36:27.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.372+0000 7fc5c8af9700 1 Processor -- start 2021-11-03T17:36:27.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.372+0000 7fc5c8af9700 1 -- start start 2021-11-03T17:36:27.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.372+0000 7fc5c8af9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5c40f66e0 0x7fc5c406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:36:27.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.372+0000 7fc5c8af9700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5c40f6ff0 0x7fc5c4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:36:27.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.372+0000 7fc5c8af9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c406a380 con 0x7fc5c40f66e0 2021-11-03T17:36:27.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.372+0000 7fc5c8af9700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c406a4c0 con 0x7fc5c40f6ff0 2021-11-03T17:36:27.370 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.372+0000 7fc5c259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5c40f66e0 0x7fc5c406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:36:27.370 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.372+0000 7fc5c259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5c40f66e0 0x7fc5c406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55332/0 (socket says 172.21.15.26:55332) 2021-11-03T17:36:27.370 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.372+0000 7fc5c259c700 1 -- 172.21.15.26:0/1932480847 learned_addr learned my addr 172.21.15.26:0/1932480847 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:36:27.370 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.372+0000 7fc5c1d9b700 1 --2- 172.21.15.26:0/1932480847 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5c40f6ff0 0x7fc5c4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:36:27.371 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.372+0000 7fc5c259c700 1 -- 172.21.15.26:0/1932480847 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5c40f6ff0 msgr2=0x7fc5c4069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:36:27.371 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.372+0000 7fc5c259c700 1 --2- 172.21.15.26:0/1932480847 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5c40f6ff0 0x7fc5c4069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:36:27.371 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.372+0000 7fc5c259c700 1 -- 172.21.15.26:0/1932480847 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b4005040 con 0x7fc5c40f66e0 2021-11-03T17:36:27.371 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.372+0000 7fc5c1d9b700 1 --2- 172.21.15.26:0/1932480847 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5c40f6ff0 0x7fc5c4069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:36:27.371 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.373+0000 7fc5c259c700 1 --2- 172.21.15.26:0/1932480847 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5c40f66e0 0x7fc5c406b9a0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7fc5ac00c790 tx=0x7fc5ac007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:36:27.373 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.375+0000 7fc5baffd700 1 -- 172.21.15.26:0/1932480847 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5ac00e680 con 0x7fc5c40f66e0 2021-11-03T17:36:27.373 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.375+0000 7fc5baffd700 1 -- 172.21.15.26:0/1932480847 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc5ac00ec90 con 0x7fc5c40f66e0 2021-11-03T17:36:27.373 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.375+0000 7fc5baffd700 1 -- 172.21.15.26:0/1932480847 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5ac013d60 con 0x7fc5c40f66e0 2021-11-03T17:36:27.374 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.375+0000 7fc5c8af9700 1 -- 172.21.15.26:0/1932480847 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5c406a7a0 con 0x7fc5c40f66e0 2021-11-03T17:36:27.374 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.375+0000 7fc5c8af9700 1 -- 172.21.15.26:0/1932480847 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5c410efa0 con 0x7fc5c40f66e0 2021-11-03T17:36:27.374 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.376+0000 7fc5c8af9700 1 -- 172.21.15.26:0/1932480847 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5c4045ad0 con 0x7fc5c40f66e0 2021-11-03T17:36:27.374 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.376+0000 7fc5baffd700 1 -- 172.21.15.26:0/1932480847 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc5ac01a060 con 0x7fc5c40f66e0 2021-11-03T17:36:27.374 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.377+0000 7fc5baffd700 1 --2- 172.21.15.26:0/1932480847 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc5b0064090 0x7fc5b0066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:36:27.375 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.377+0000 7fc5baffd700 1 -- 172.21.15.26:0/1932480847 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc5ac080b00 con 0x7fc5c40f66e0 2021-11-03T17:36:27.375 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.377+0000 7fc5c1d9b700 1 --2- 172.21.15.26:0/1932480847 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc5b0064090 0x7fc5b0066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:36:27.375 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.377+0000 7fc5c1d9b700 1 --2- 172.21.15.26:0/1932480847 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc5b0064090 0x7fc5b0066550 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7fc5b4004630 tx=0x7fc5b4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:36:27.376 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.383+0000 7fc5baffd700 1 -- 172.21.15.26:0/1932480847 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc5ac052d70 con 0x7fc5c40f66e0 2021-11-03T17:36:27.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.561+0000 7fc5c8af9700 1 -- 172.21.15.26:0/1932480847 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5c40ff010 con 0x7fc5b0064090 2021-11-03T17:36:27.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.563+0000 7fc5baffd700 1 -- 172.21.15.26:0/1932480847 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fc5c40ff010 con 0x7fc5b0064090 2021-11-03T17:36:27.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.565+0000 7fc5c8af9700 1 -- 172.21.15.26:0/1932480847 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc5b0064090 msgr2=0x7fc5b0066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:36:27.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.565+0000 7fc5c8af9700 1 --2- 172.21.15.26:0/1932480847 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc5b0064090 0x7fc5b0066550 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7fc5b4004630 tx=0x7fc5b4009b30).stop 2021-11-03T17:36:27.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.565+0000 7fc5c8af9700 1 -- 172.21.15.26:0/1932480847 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5c40f66e0 msgr2=0x7fc5c406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:36:27.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.565+0000 7fc5c8af9700 1 --2- 172.21.15.26:0/1932480847 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5c40f66e0 0x7fc5c406b9a0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7fc5ac00c790 tx=0x7fc5ac007d70).stop 2021-11-03T17:36:27.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.565+0000 7fc5c8af9700 1 -- 172.21.15.26:0/1932480847 shutdown_connections 2021-11-03T17:36:27.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.565+0000 7fc5c8af9700 1 --2- 172.21.15.26:0/1932480847 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc5b0064090 0x7fc5b0066550 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:36:27.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.565+0000 7fc5c8af9700 1 --2- 172.21.15.26:0/1932480847 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5c40f66e0 0x7fc5c406b9a0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:36:27.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.565+0000 7fc5c8af9700 1 --2- 172.21.15.26:0/1932480847 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5c40f6ff0 0x7fc5c4069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:36:27.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.565+0000 7fc5c8af9700 1 -- 172.21.15.26:0/1932480847 >> 172.21.15.26:0/1932480847 conn(0x7fc5c40f1f00 msgr2=0x7fc5c40fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:36:27.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.565+0000 7fc5c8af9700 1 -- 172.21.15.26:0/1932480847 shutdown_connections 2021-11-03T17:36:27.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.565+0000 7fc5c8af9700 1 -- 172.21.15.26:0/1932480847 wait complete. 2021-11-03T17:36:27.568 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:36:27.666 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.665+0000 7f7d88050700 1 -- 172.21.15.26:0/3304465969 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d800f5ed0 msgr2=0x7f7d800f6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:36:27.666 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.665+0000 7f7d88050700 1 --2- 172.21.15.26:0/3304465969 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d800f5ed0 0x7f7d800f6900 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f7d7c004660 tx=0x7f7d7c009b30).stop 2021-11-03T17:36:27.667 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.665+0000 7f7d88050700 1 -- 172.21.15.26:0/3304465969 shutdown_connections 2021-11-03T17:36:27.667 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.665+0000 7f7d88050700 1 --2- 172.21.15.26:0/3304465969 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d800f5ed0 0x7f7d800f6900 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:36:27.668 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.665+0000 7f7d88050700 1 --2- 172.21.15.26:0/3304465969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d800f55c0 0x7f7d800f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:36:27.668 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.665+0000 7f7d88050700 1 -- 172.21.15.26:0/3304465969 >> 172.21.15.26:0/3304465969 conn(0x7f7d800f0de0 msgr2=0x7f7d800f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:36:27.669 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.665+0000 7f7d88050700 1 -- 172.21.15.26:0/3304465969 shutdown_connections 2021-11-03T17:36:27.669 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.665+0000 7f7d88050700 1 -- 172.21.15.26:0/3304465969 wait complete. 2021-11-03T17:36:27.670 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.666+0000 7f7d88050700 1 Processor -- start 2021-11-03T17:36:27.670 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.666+0000 7f7d88050700 1 -- start start 2021-11-03T17:36:27.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.666+0000 7f7d88050700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d800f55c0 0x7f7d80105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:36:27.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.666+0000 7f7d88050700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d800f5ed0 0x7f7d80106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:36:27.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.666+0000 7f7d88050700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d801069a0 con 0x7f7d800f5ed0 2021-11-03T17:36:27.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.666+0000 7f7d88050700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d80107250 con 0x7f7d800f55c0 2021-11-03T17:36:27.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.666+0000 7f7d855eb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d800f5ed0 0x7f7d80106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:36:27.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.666+0000 7f7d855eb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d800f5ed0 0x7f7d80106360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55342/0 (socket says 172.21.15.26:55342) 2021-11-03T17:36:27.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.666+0000 7f7d855eb700 1 -- 172.21.15.26:0/1310594607 learned_addr learned my addr 172.21.15.26:0/1310594607 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:36:27.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.666+0000 7f7d85dec700 1 --2- 172.21.15.26:0/1310594607 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d800f55c0 0x7f7d80105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:36:27.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.666+0000 7f7d855eb700 1 -- 172.21.15.26:0/1310594607 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d800f55c0 msgr2=0x7f7d80105e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:36:27.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.666+0000 7f7d855eb700 1 --2- 172.21.15.26:0/1310594607 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d800f55c0 0x7f7d80105e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:36:27.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.666+0000 7f7d855eb700 1 -- 172.21.15.26:0/1310594607 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7c005040 con 0x7f7d800f5ed0 2021-11-03T17:36:27.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.666+0000 7f7d85dec700 1 --2- 172.21.15.26:0/1310594607 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d800f55c0 0x7f7d80105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:36:27.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.667+0000 7f7d855eb700 1 --2- 172.21.15.26:0/1310594607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d800f5ed0 0x7f7d80106360 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f7d7c009990 tx=0x7f7d7c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:36:27.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.667+0000 7f7d767fc700 1 -- 172.21.15.26:0/1310594607 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d7c018070 con 0x7f7d800f5ed0 2021-11-03T17:36:27.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.667+0000 7f7d767fc700 1 -- 172.21.15.26:0/1310594607 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7d7c007ca0 con 0x7f7d800f5ed0 2021-11-03T17:36:27.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.667+0000 7f7d88050700 1 -- 172.21.15.26:0/1310594607 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d801074d0 con 0x7f7d800f5ed0 2021-11-03T17:36:27.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.667+0000 7f7d767fc700 1 -- 172.21.15.26:0/1310594607 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d7c01c620 con 0x7f7d800f5ed0 2021-11-03T17:36:27.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.667+0000 7f7d88050700 1 -- 172.21.15.26:0/1310594607 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d80107a30 con 0x7f7d800f5ed0 2021-11-03T17:36:27.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.668+0000 7f7d88050700 1 -- 172.21.15.26:0/1310594607 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d800f4a50 con 0x7f7d800f5ed0 2021-11-03T17:36:27.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.668+0000 7f7d767fc700 1 -- 172.21.15.26:0/1310594607 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f7d7c01d960 con 0x7f7d800f5ed0 2021-11-03T17:36:27.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.669+0000 7f7d767fc700 1 --2- 172.21.15.26:0/1310594607 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7d6c0640b0 0x7f7d6c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:36:27.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.669+0000 7f7d767fc700 1 -- 172.21.15.26:0/1310594607 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f7d7c082540 con 0x7f7d800f5ed0 2021-11-03T17:36:27.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.669+0000 7f7d85dec700 1 --2- 172.21.15.26:0/1310594607 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7d6c0640b0 0x7f7d6c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:36:27.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.669+0000 7f7d85dec700 1 --2- 172.21.15.26:0/1310594607 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7d6c0640b0 0x7f7d6c066570 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f7d7000b830 tx=0x7f7d70008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:36:27.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.673+0000 7f7d767fc700 1 -- 172.21.15.26:0/1310594607 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f7d7c054960 con 0x7f7d800f5ed0 2021-11-03T17:36:27.682 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:27 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:36:27.683 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:27 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:36:27.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:27 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:36:27.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:27 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:36:27.840 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.846+0000 7f7d88050700 1 -- 172.21.15.26:0/1310594607 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7d800fdea0 con 0x7f7d6c0640b0 2021-11-03T17:36:27.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.861+0000 7f7d767fc700 1 -- 172.21.15.26:0/1310594607 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f7d800fdea0 con 0x7f7d6c0640b0 2021-11-03T17:36:27.855 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:36:27.855 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (47m) 7m ago 48m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:36:27.856 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (39m) 7m ago 48m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:36:27.856 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (39m) 6m ago 48m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:36:27.856 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (47m) 7m ago 48m 40.3M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:36:27.856 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (40m) 7m ago 44m 22.6M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:36:27.857 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (41m) 7m ago 43m 23.5M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:36:27.857 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (44m) 6m ago 44m 24.8M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:36:27.857 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (44m) 6m ago 44m 25.0M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:36:27.857 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (41m) 7m ago 50m 520M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:36:27.857 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (41m) 6m ago 48m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:36:27.858 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (40m) 7m ago 50m 176M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:36:27.858 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (40m) 6m ago 48m 89.5M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:36:27.858 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (48m) 7m ago 48m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:36:27.858 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (47m) 6m ago 47m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:36:27.859 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (39m) 7m ago 47m 231M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:36:27.859 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (39m) 7m ago 46m 248M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:36:27.859 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (38m) 7m ago 46m 207M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:36:27.859 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (38m) 6m ago 46m 262M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:36:27.860 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (37m) 6m ago 45m 227M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:36:27.860 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (37m) 6m ago 45m 215M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:36:27.860 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (47m) 7m ago 48m 54.4M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:36:27.861 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.863+0000 7f7d88050700 1 -- 172.21.15.26:0/1310594607 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7d6c0640b0 msgr2=0x7f7d6c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:36:27.861 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.863+0000 7f7d88050700 1 --2- 172.21.15.26:0/1310594607 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7d6c0640b0 0x7f7d6c066570 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f7d7000b830 tx=0x7f7d70008040).stop 2021-11-03T17:36:27.861 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.863+0000 7f7d88050700 1 -- 172.21.15.26:0/1310594607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d800f5ed0 msgr2=0x7f7d80106360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:36:27.862 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.863+0000 7f7d88050700 1 --2- 172.21.15.26:0/1310594607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d800f5ed0 0x7f7d80106360 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f7d7c009990 tx=0x7f7d7c009b30).stop 2021-11-03T17:36:27.862 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.863+0000 7f7d88050700 1 -- 172.21.15.26:0/1310594607 shutdown_connections 2021-11-03T17:36:27.862 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.863+0000 7f7d88050700 1 --2- 172.21.15.26:0/1310594607 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7d6c0640b0 0x7f7d6c066570 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:36:27.862 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.863+0000 7f7d88050700 1 --2- 172.21.15.26:0/1310594607 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d800f55c0 0x7f7d80105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:36:27.863 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.863+0000 7f7d88050700 1 --2- 172.21.15.26:0/1310594607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d800f5ed0 0x7f7d80106360 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:36:27.863 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.863+0000 7f7d88050700 1 -- 172.21.15.26:0/1310594607 >> 172.21.15.26:0/1310594607 conn(0x7f7d800f0de0 msgr2=0x7f7d800fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:36:27.863 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.863+0000 7f7d88050700 1 -- 172.21.15.26:0/1310594607 shutdown_connections 2021-11-03T17:36:27.864 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.863+0000 7f7d88050700 1 -- 172.21.15.26:0/1310594607 wait complete. 2021-11-03T17:36:27.963 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.961+0000 7f54de7e0700 1 -- 172.21.15.26:0/2164929935 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54d80f5440 msgr2=0x7f54d80f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:36:27.963 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.962+0000 7f54de7e0700 1 --2- 172.21.15.26:0/2164929935 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54d80f5440 0x7f54d80f5860 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f54d4004660 tx=0x7f54d4009b30).stop 2021-11-03T17:36:27.963 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.962+0000 7f54de7e0700 1 -- 172.21.15.26:0/2164929935 shutdown_connections 2021-11-03T17:36:27.964 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.962+0000 7f54de7e0700 1 --2- 172.21.15.26:0/2164929935 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54d80f66e0 0x7f54d80f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:36:27.964 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.962+0000 7f54de7e0700 1 --2- 172.21.15.26:0/2164929935 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54d80f5440 0x7f54d80f5860 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:36:27.964 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.962+0000 7f54de7e0700 1 -- 172.21.15.26:0/2164929935 >> 172.21.15.26:0/2164929935 conn(0x7f54d80f0ba0 msgr2=0x7f54d80f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:36:27.964 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.962+0000 7f54de7e0700 1 -- 172.21.15.26:0/2164929935 shutdown_connections 2021-11-03T17:36:27.965 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.962+0000 7f54de7e0700 1 -- 172.21.15.26:0/2164929935 wait complete. 2021-11-03T17:36:27.965 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.962+0000 7f54de7e0700 1 Processor -- start 2021-11-03T17:36:27.965 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.962+0000 7f54de7e0700 1 -- start start 2021-11-03T17:36:27.966 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.962+0000 7f54de7e0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54d80f5440 0x7f54d8106dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:36:27.966 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.962+0000 7f54de7e0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54d80f66e0 0x7f54d81072c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:36:27.967 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.962+0000 7f54de7e0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d8107950 con 0x7f54d80f5440 2021-11-03T17:36:27.967 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.962+0000 7f54de7e0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d8108100 con 0x7f54d80f66e0 2021-11-03T17:36:27.967 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.963+0000 7f54dd7de700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54d80f5440 0x7f54d8106dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:36:27.968 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.963+0000 7f54dd7de700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54d80f5440 0x7f54d8106dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55350/0 (socket says 172.21.15.26:55350) 2021-11-03T17:36:27.968 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.963+0000 7f54dd7de700 1 -- 172.21.15.26:0/1666683734 learned_addr learned my addr 172.21.15.26:0/1666683734 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:36:27.968 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.963+0000 7f54dcfdd700 1 --2- 172.21.15.26:0/1666683734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54d80f66e0 0x7f54d81072c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:36:27.969 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.963+0000 7f54dd7de700 1 -- 172.21.15.26:0/1666683734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54d80f66e0 msgr2=0x7f54d81072c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:36:27.969 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.963+0000 7f54dd7de700 1 --2- 172.21.15.26:0/1666683734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54d80f66e0 0x7f54d81072c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:36:27.969 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.963+0000 7f54dd7de700 1 -- 172.21.15.26:0/1666683734 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d4005040 con 0x7f54d80f5440 2021-11-03T17:36:27.970 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.963+0000 7f54dcfdd700 1 --2- 172.21.15.26:0/1666683734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54d80f66e0 0x7f54d81072c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:36:27.970 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.963+0000 7f54dd7de700 1 --2- 172.21.15.26:0/1666683734 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54d80f5440 0x7f54d8106dd0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f54d4004f60 tx=0x7f54d4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:36:27.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.963+0000 7f54cdffb700 1 -- 172.21.15.26:0/1666683734 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54d4018070 con 0x7f54d80f5440 2021-11-03T17:36:27.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.963+0000 7f54cdffb700 1 -- 172.21.15.26:0/1666683734 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f54d4007ba0 con 0x7f54d80f5440 2021-11-03T17:36:27.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.963+0000 7f54de7e0700 1 -- 172.21.15.26:0/1666683734 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54d8108380 con 0x7f54d80f5440 2021-11-03T17:36:27.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.963+0000 7f54cdffb700 1 -- 172.21.15.26:0/1666683734 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54d401c620 con 0x7f54d80f5440 2021-11-03T17:36:27.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.963+0000 7f54de7e0700 1 -- 172.21.15.26:0/1666683734 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54d81088e0 con 0x7f54d80f5440 2021-11-03T17:36:27.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.964+0000 7f54de7e0700 1 -- 172.21.15.26:0/1666683734 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54d8059100 con 0x7f54d80f5440 2021-11-03T17:36:27.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.965+0000 7f54cdffb700 1 -- 172.21.15.26:0/1666683734 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f54d401c8e0 con 0x7f54d80f5440 2021-11-03T17:36:27.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.965+0000 7f54cdffb700 1 --2- 172.21.15.26:0/1666683734 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f54c4064100 0x7f54c40665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:36:27.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.965+0000 7f54cdffb700 1 -- 172.21.15.26:0/1666683734 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f54d40826e0 con 0x7f54d80f5440 2021-11-03T17:36:27.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.965+0000 7f54dcfdd700 1 --2- 172.21.15.26:0/1666683734 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f54c4064100 0x7f54c40665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:36:27.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.966+0000 7f54dcfdd700 1 --2- 172.21.15.26:0/1666683734 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f54c4064100 0x7f54c40665c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f54d8106b60 tx=0x7f54c8008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:36:27.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:27.969+0000 7f54cdffb700 1 -- 172.21.15.26:0/1666683734 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f54d4054a40 con 0x7f54d80f5440 2021-11-03T17:36:28.194 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.200+0000 7f54de7e0700 1 -- 172.21.15.26:0/1666683734 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f54d80fed80 con 0x7f54d80f5440 2021-11-03T17:36:28.195 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.201+0000 7f54cdffb700 1 -- 172.21.15.26:0/1666683734 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f54d4054630 con 0x7f54d80f5440 2021-11-03T17:36:28.195 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:36:28.196 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:36:28.196 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:36:28.196 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:36:28.196 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:36:28.197 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:36:28.197 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:36:28.197 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:36:28.197 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:36:28.197 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:36:28.198 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:36:28.198 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:36:28.198 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:36:28.198 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:36:28.199 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:36:28.199 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:36:28.199 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:36:28.199 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:36:28.200 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.202+0000 7f54de7e0700 1 -- 172.21.15.26:0/1666683734 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f54c4064100 msgr2=0x7f54c40665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:36:28.200 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.202+0000 7f54de7e0700 1 --2- 172.21.15.26:0/1666683734 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f54c4064100 0x7f54c40665c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f54d8106b60 tx=0x7f54c8008040).stop 2021-11-03T17:36:28.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.202+0000 7f54de7e0700 1 -- 172.21.15.26:0/1666683734 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54d80f5440 msgr2=0x7f54d8106dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:36:28.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.202+0000 7f54de7e0700 1 --2- 172.21.15.26:0/1666683734 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54d80f5440 0x7f54d8106dd0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f54d4004f60 tx=0x7f54d4009b30).stop 2021-11-03T17:36:28.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.202+0000 7f54de7e0700 1 -- 172.21.15.26:0/1666683734 shutdown_connections 2021-11-03T17:36:28.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.202+0000 7f54de7e0700 1 --2- 172.21.15.26:0/1666683734 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f54c4064100 0x7f54c40665c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:36:28.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.202+0000 7f54de7e0700 1 --2- 172.21.15.26:0/1666683734 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54d80f5440 0x7f54d8106dd0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:36:28.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.202+0000 7f54de7e0700 1 --2- 172.21.15.26:0/1666683734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54d80f66e0 0x7f54d81072c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:36:28.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.202+0000 7f54de7e0700 1 -- 172.21.15.26:0/1666683734 >> 172.21.15.26:0/1666683734 conn(0x7f54d80f0ba0 msgr2=0x7f54d80fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:36:28.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.203+0000 7f54de7e0700 1 -- 172.21.15.26:0/1666683734 shutdown_connections 2021-11-03T17:36:28.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.203+0000 7f54de7e0700 1 -- 172.21.15.26:0/1666683734 wait complete. 2021-11-03T17:36:28.297 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.303+0000 7fb35ab42700 1 -- 172.21.15.26:0/286015527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3540f7980 msgr2=0x7fb3540f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:36:28.297 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.303+0000 7fb35ab42700 1 --2- 172.21.15.26:0/286015527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3540f7980 0x7fb3540f7de0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7fb340004660 tx=0x7fb340009b30).stop 2021-11-03T17:36:28.298 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.303+0000 7fb35ab42700 1 -- 172.21.15.26:0/286015527 shutdown_connections 2021-11-03T17:36:28.298 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.303+0000 7fb35ab42700 1 --2- 172.21.15.26:0/286015527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3540f7980 0x7fb3540f7de0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:36:28.299 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.303+0000 7fb35ab42700 1 --2- 172.21.15.26:0/286015527 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3540f66e0 0x7fb3540f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:36:28.299 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.303+0000 7fb35ab42700 1 -- 172.21.15.26:0/286015527 >> 172.21.15.26:0/286015527 conn(0x7fb3540f1e40 msgr2=0x7fb3540f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:36:28.299 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.303+0000 7fb35ab42700 1 -- 172.21.15.26:0/286015527 shutdown_connections 2021-11-03T17:36:28.299 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.303+0000 7fb35ab42700 1 -- 172.21.15.26:0/286015527 wait complete. 2021-11-03T17:36:28.299 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.303+0000 7fb35ab42700 1 Processor -- start 2021-11-03T17:36:28.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.303+0000 7fb35ab42700 1 -- start start 2021-11-03T17:36:28.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.304+0000 7fb35ab42700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3540f66e0 0x7fb35406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:36:28.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.304+0000 7fb35ab42700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3540f7980 0x7fb354069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:36:28.303 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.304+0000 7fb35ab42700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35406a380 con 0x7fb3540f66e0 2021-11-03T17:36:28.303 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.304+0000 7fb35ab42700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35406a4c0 con 0x7fb3540f7980 2021-11-03T17:36:28.303 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.304+0000 7fb3588de700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3540f66e0 0x7fb35406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:36:28.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.304+0000 7fb3588de700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3540f66e0 0x7fb35406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55360/0 (socket says 172.21.15.26:55360) 2021-11-03T17:36:28.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.304+0000 7fb3588de700 1 -- 172.21.15.26:0/4124041736 learned_addr learned my addr 172.21.15.26:0/4124041736 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:36:28.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.304+0000 7fb3588de700 1 -- 172.21.15.26:0/4124041736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3540f7980 msgr2=0x7fb354069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:36:28.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.304+0000 7fb3588de700 1 --2- 172.21.15.26:0/4124041736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3540f7980 0x7fb354069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:36:28.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.304+0000 7fb3588de700 1 -- 172.21.15.26:0/4124041736 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb340005040 con 0x7fb3540f66e0 2021-11-03T17:36:28.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.304+0000 7fb3588de700 1 --2- 172.21.15.26:0/4124041736 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3540f66e0 0x7fb35406b9a0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7fb34800c530 tx=0x7fb348007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:36:28.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.304+0000 7fb3517fa700 1 -- 172.21.15.26:0/4124041736 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb34800f650 con 0x7fb3540f66e0 2021-11-03T17:36:28.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.304+0000 7fb35ab42700 1 -- 172.21.15.26:0/4124041736 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb35406a7a0 con 0x7fb3540f66e0 2021-11-03T17:36:28.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.304+0000 7fb35ab42700 1 -- 172.21.15.26:0/4124041736 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb35410ef90 con 0x7fb3540f66e0 2021-11-03T17:36:28.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.304+0000 7fb3517fa700 1 -- 172.21.15.26:0/4124041736 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb34800fc60 con 0x7fb3540f66e0 2021-11-03T17:36:28.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.304+0000 7fb3517fa700 1 -- 172.21.15.26:0/4124041736 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb348012d20 con 0x7fb3540f66e0 2021-11-03T17:36:28.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.305+0000 7fb35ab42700 1 -- 172.21.15.26:0/4124041736 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb354045ad0 con 0x7fb3540f66e0 2021-11-03T17:36:28.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.306+0000 7fb3517fa700 1 -- 172.21.15.26:0/4124041736 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fb348019030 con 0x7fb3540f66e0 2021-11-03T17:36:28.307 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.306+0000 7fb3517fa700 1 --2- 172.21.15.26:0/4124041736 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb3440640b0 0x7fb344066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:36:28.307 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.306+0000 7fb3517fa700 1 -- 172.21.15.26:0/4124041736 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fb3480806e0 con 0x7fb3540f66e0 2021-11-03T17:36:28.307 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.306+0000 7fb353fff700 1 --2- 172.21.15.26:0/4124041736 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb3440640b0 0x7fb344066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:36:28.307 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.307+0000 7fb353fff700 1 --2- 172.21.15.26:0/4124041736 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb3440640b0 0x7fb344066570 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7fb340004e30 tx=0x7fb340009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:36:28.308 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.310+0000 7fb3517fa700 1 -- 172.21.15.26:0/4124041736 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fb3480529a0 con 0x7fb3540f66e0 2021-11-03T17:36:28.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.518+0000 7fb35ab42700 1 -- 172.21.15.26:0/4124041736 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb3540feea0 con 0x7fb3540f66e0 2021-11-03T17:36:28.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.518+0000 7fb3517fa700 1 -- 172.21.15.26:0/4124041736 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fb348017710 con 0x7fb3540f66e0 2021-11-03T17:36:28.514 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:36:28.514 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:36:28.515 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:36:28.515 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:36:28.515 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:36:28.516 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:36:28.516 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:36:28.517 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:36:28.517 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:36:28.518 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:36:28.518 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:36:28.518 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:36:28.519 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:36:28.519 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:36:28.520 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:36:28.520 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:36:28.520 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:36:28.521 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:36:28.521 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:36:28.522 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:36:28.522 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:36:28.523 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:36:28.523 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:36:28.523 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:36:28.524 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:36:28.524 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:36:28.525 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:36:28.525 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:36:28.526 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:36:28.526 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:36:28.526 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:36:28.527 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:36:28.527 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:36:28.527 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:36:28.528 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:36:28.528 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:36:28.528 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:36:28.528 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:36:28.528 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:36:28.530 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.520+0000 7fb35ab42700 1 -- 172.21.15.26:0/4124041736 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb3440640b0 msgr2=0x7fb344066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:36:28.530 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.520+0000 7fb35ab42700 1 --2- 172.21.15.26:0/4124041736 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb3440640b0 0x7fb344066570 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7fb340004e30 tx=0x7fb340009b30).stop 2021-11-03T17:36:28.530 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.520+0000 7fb35ab42700 1 -- 172.21.15.26:0/4124041736 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3540f66e0 msgr2=0x7fb35406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:36:28.530 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.520+0000 7fb35ab42700 1 --2- 172.21.15.26:0/4124041736 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3540f66e0 0x7fb35406b9a0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7fb34800c530 tx=0x7fb348007e10).stop 2021-11-03T17:36:28.531 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.520+0000 7fb35ab42700 1 -- 172.21.15.26:0/4124041736 shutdown_connections 2021-11-03T17:36:28.531 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.520+0000 7fb35ab42700 1 --2- 172.21.15.26:0/4124041736 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb3440640b0 0x7fb344066570 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:36:28.531 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.520+0000 7fb35ab42700 1 --2- 172.21.15.26:0/4124041736 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3540f66e0 0x7fb35406b9a0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:36:28.531 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.520+0000 7fb35ab42700 1 --2- 172.21.15.26:0/4124041736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3540f7980 0x7fb354069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:36:28.531 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.520+0000 7fb35ab42700 1 -- 172.21.15.26:0/4124041736 >> 172.21.15.26:0/4124041736 conn(0x7fb3540f1e40 msgr2=0x7fb3540fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:36:28.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.521+0000 7fb35ab42700 1 -- 172.21.15.26:0/4124041736 shutdown_connections 2021-11-03T17:36:28.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:28.521+0000 7fb35ab42700 1 -- 172.21.15.26:0/4124041736 wait complete. 2021-11-03T17:36:28.532 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:36:28.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:28 smithi026 ceph-mon[96795]: pgmap v1254: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:28.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:28 smithi026 ceph-mon[96795]: from='client.35436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:36:28.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:28 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1666683734' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:36:28.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:28 smithi194 ceph-mon[65619]: pgmap v1254: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:28.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:28 smithi194 ceph-mon[65619]: from='client.35436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:36:28.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:28 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1666683734' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:36:29.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:29 smithi026 ceph-mon[96795]: from='client.35440 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:36:29.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:29 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/4124041736' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:36:29.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:29 smithi194 ceph-mon[65619]: from='client.35440 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:36:29.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:29 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/4124041736' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:36:30.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:30 smithi026 ceph-mon[96795]: pgmap v1255: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:30.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:30 smithi194 ceph-mon[65619]: pgmap v1255: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:32.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:32 smithi026 ceph-mon[96795]: pgmap v1256: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:32.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:32 smithi194 ceph-mon[65619]: pgmap v1256: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:34.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:34 smithi026 ceph-mon[96795]: pgmap v1257: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:34.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:34 smithi194 ceph-mon[65619]: pgmap v1257: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:36.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:36 smithi026 ceph-mon[96795]: pgmap v1258: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:36.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:36 smithi194 ceph-mon[65619]: pgmap v1258: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:38.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:38 smithi026 ceph-mon[96795]: pgmap v1259: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:38.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:38 smithi194 ceph-mon[65619]: pgmap v1259: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:40.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:40 smithi026 ceph-mon[96795]: pgmap v1260: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:40.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:40 smithi194 ceph-mon[65619]: pgmap v1260: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:41.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:36:41.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:36:42.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:42 smithi026 ceph-mon[96795]: pgmap v1261: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:42.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:42 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:36:42.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:42 smithi194 ceph-mon[65619]: pgmap v1261: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:42.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:42 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:36:44.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:44 smithi026 ceph-mon[96795]: pgmap v1262: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:44.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:44 smithi194 ceph-mon[65619]: pgmap v1262: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:46.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:46 smithi026 ceph-mon[96795]: pgmap v1263: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:46.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:46 smithi194 ceph-mon[65619]: pgmap v1263: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:48 smithi026 ceph-mon[96795]: pgmap v1264: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:36:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:36:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:48 smithi194 ceph-mon[65619]: pgmap v1264: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:36:48.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:36:50.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:50 smithi026 ceph-mon[96795]: pgmap v1265: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:50.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:50 smithi194 ceph-mon[65619]: pgmap v1265: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:52.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:52 smithi026 ceph-mon[96795]: pgmap v1266: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:52.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:52 smithi194 ceph-mon[65619]: pgmap v1266: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:54.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:54 smithi026 ceph-mon[96795]: pgmap v1267: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:54.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:54 smithi194 ceph-mon[65619]: pgmap v1267: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:56.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:56 smithi026 ceph-mon[96795]: pgmap v1268: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:56.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:56 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:36:56.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:56 smithi194 ceph-mon[65619]: pgmap v1268: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:56.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:56 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:36:57.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:57 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:36:57.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:57 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:36:58.631 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.634+0000 7f42a1370700 1 -- 172.21.15.26:0/4080425207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f429c0f6ff0 msgr2=0x7f429c0f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:36:58.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.634+0000 7f42a1370700 1 --2- 172.21.15.26:0/4080425207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f429c0f6ff0 0x7f429c0f7a20 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f42840099e0 tx=0x7f4284004d10).stop 2021-11-03T17:36:58.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.634+0000 7f42a1370700 1 -- 172.21.15.26:0/4080425207 shutdown_connections 2021-11-03T17:36:58.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.634+0000 7f42a1370700 1 --2- 172.21.15.26:0/4080425207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f429c0f6ff0 0x7f429c0f7a20 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:36:58.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.634+0000 7f42a1370700 1 --2- 172.21.15.26:0/4080425207 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f429c0f66e0 0x7f429c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:36:58.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.634+0000 7f42a1370700 1 -- 172.21.15.26:0/4080425207 >> 172.21.15.26:0/4080425207 conn(0x7f429c0f1f00 msgr2=0x7f429c0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:36:58.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.634+0000 7f42a1370700 1 -- 172.21.15.26:0/4080425207 shutdown_connections 2021-11-03T17:36:58.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.634+0000 7f42a1370700 1 -- 172.21.15.26:0/4080425207 wait complete. 2021-11-03T17:36:58.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.635+0000 7f42a1370700 1 Processor -- start 2021-11-03T17:36:58.634 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.635+0000 7f42a1370700 1 -- start start 2021-11-03T17:36:58.634 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.635+0000 7f42a1370700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f429c0f66e0 0x7f429c107110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:36:58.634 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.635+0000 7f42a1370700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f429c0f6ff0 0x7f429c107600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:36:58.634 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.635+0000 7f42a1370700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429c107c40 con 0x7f429c0f66e0 2021-11-03T17:36:58.635 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.635+0000 7f42a1370700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429c1084f0 con 0x7f429c0f6ff0 2021-11-03T17:36:58.635 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.635+0000 7f429affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f429c0f66e0 0x7f429c107110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:36:58.635 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.635+0000 7f429affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f429c0f66e0 0x7f429c107110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55378/0 (socket says 172.21.15.26:55378) 2021-11-03T17:36:58.636 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.635+0000 7f429affd700 1 -- 172.21.15.26:0/3010916014 learned_addr learned my addr 172.21.15.26:0/3010916014 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:36:58.636 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.636+0000 7f429a7fc700 1 --2- 172.21.15.26:0/3010916014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f429c0f6ff0 0x7f429c107600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:36:58.637 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.636+0000 7f429affd700 1 -- 172.21.15.26:0/3010916014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f429c0f6ff0 msgr2=0x7f429c107600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:36:58.637 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.636+0000 7f429affd700 1 --2- 172.21.15.26:0/3010916014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f429c0f6ff0 0x7f429c107600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:36:58.637 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.636+0000 7f429affd700 1 -- 172.21.15.26:0/3010916014 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4284009640 con 0x7f429c0f66e0 2021-11-03T17:36:58.638 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.636+0000 7f429a7fc700 1 --2- 172.21.15.26:0/3010916014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f429c0f6ff0 0x7f429c107600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:36:58.638 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.636+0000 7f429affd700 1 --2- 172.21.15.26:0/3010916014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f429c0f66e0 0x7f429c107110 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f429400b410 tx=0x7f4294006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:36:58.639 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.636+0000 7f42937fe700 1 -- 172.21.15.26:0/3010916014 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42940125f0 con 0x7f429c0f66e0 2021-11-03T17:36:58.639 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.636+0000 7f42a1370700 1 -- 172.21.15.26:0/3010916014 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f429c1087d0 con 0x7f429c0f66e0 2021-11-03T17:36:58.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.636+0000 7f42937fe700 1 -- 172.21.15.26:0/3010916014 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4294012c00 con 0x7f429c0f66e0 2021-11-03T17:36:58.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.636+0000 7f42937fe700 1 -- 172.21.15.26:0/3010916014 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4294002ae0 con 0x7f429c0f66e0 2021-11-03T17:36:58.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.636+0000 7f42a1370700 1 -- 172.21.15.26:0/3010916014 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f429c108d10 con 0x7f429c0f66e0 2021-11-03T17:36:58.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.637+0000 7f42a1370700 1 -- 172.21.15.26:0/3010916014 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f429c0f5b70 con 0x7f429c0f66e0 2021-11-03T17:36:58.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.637+0000 7f42937fe700 1 -- 172.21.15.26:0/3010916014 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f429400f030 con 0x7f429c0f66e0 2021-11-03T17:36:58.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.638+0000 7f42937fe700 1 --2- 172.21.15.26:0/3010916014 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f42880640b0 0x7f4288066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:36:58.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.638+0000 7f42937fe700 1 -- 172.21.15.26:0/3010916014 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f4294080c80 con 0x7f429c0f66e0 2021-11-03T17:36:58.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.638+0000 7f429a7fc700 1 --2- 172.21.15.26:0/3010916014 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f42880640b0 0x7f4288066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:36:58.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.638+0000 7f429a7fc700 1 --2- 172.21.15.26:0/3010916014 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f42880640b0 0x7f4288066570 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f4284009f50 tx=0x7f4284004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:36:58.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.642+0000 7f42937fe700 1 -- 172.21.15.26:0/3010916014 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f4294052fe0 con 0x7f429c0f66e0 2021-11-03T17:36:58.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:36:58 smithi194 ceph-mon[65619]: pgmap v1269: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:58.815 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.820+0000 7f42a1370700 1 -- 172.21.15.26:0/3010916014 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f429c0fefc0 con 0x7f42880640b0 2021-11-03T17:36:58.816 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.821+0000 7f42937fe700 1 -- 172.21.15.26:0/3010916014 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f429c0fefc0 con 0x7f42880640b0 2021-11-03T17:36:58.818 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.823+0000 7f42a1370700 1 -- 172.21.15.26:0/3010916014 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f42880640b0 msgr2=0x7f4288066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:36:58.818 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.823+0000 7f42a1370700 1 --2- 172.21.15.26:0/3010916014 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f42880640b0 0x7f4288066570 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f4284009f50 tx=0x7f4284004d10).stop 2021-11-03T17:36:58.818 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.823+0000 7f42a1370700 1 -- 172.21.15.26:0/3010916014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f429c0f66e0 msgr2=0x7f429c107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:36:58.819 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.823+0000 7f42a1370700 1 --2- 172.21.15.26:0/3010916014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f429c0f66e0 0x7f429c107110 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f429400b410 tx=0x7f4294006ef0).stop 2021-11-03T17:36:58.819 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.823+0000 7f42a1370700 1 -- 172.21.15.26:0/3010916014 shutdown_connections 2021-11-03T17:36:58.819 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.823+0000 7f42a1370700 1 --2- 172.21.15.26:0/3010916014 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f42880640b0 0x7f4288066570 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:36:58.819 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.823+0000 7f42a1370700 1 --2- 172.21.15.26:0/3010916014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f429c0f66e0 0x7f429c107110 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:36:58.820 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.823+0000 7f42a1370700 1 --2- 172.21.15.26:0/3010916014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f429c0f6ff0 0x7f429c107600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:36:58.820 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.823+0000 7f42a1370700 1 -- 172.21.15.26:0/3010916014 >> 172.21.15.26:0/3010916014 conn(0x7f429c0f1f00 msgr2=0x7f429c0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:36:58.820 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.823+0000 7f42a1370700 1 -- 172.21.15.26:0/3010916014 shutdown_connections 2021-11-03T17:36:58.821 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.823+0000 7f42a1370700 1 -- 172.21.15.26:0/3010916014 wait complete. 2021-11-03T17:36:58.827 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:36:58.920 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.922+0000 7fad54fcf700 1 -- 172.21.15.26:0/4236988937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad500f77d0 msgr2=0x7fad500f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:36:58.921 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.922+0000 7fad54fcf700 1 --2- 172.21.15.26:0/4236988937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad500f77d0 0x7fad500f7c30 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7fad38004660 tx=0x7fad38009b30).stop 2021-11-03T17:36:58.921 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.923+0000 7fad54fcf700 1 -- 172.21.15.26:0/4236988937 shutdown_connections 2021-11-03T17:36:58.921 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.923+0000 7fad54fcf700 1 --2- 172.21.15.26:0/4236988937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad500f77d0 0x7fad500f7c30 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:36:58.922 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.923+0000 7fad54fcf700 1 --2- 172.21.15.26:0/4236988937 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad500f6530 0x7fad500f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:36:58.922 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.923+0000 7fad54fcf700 1 -- 172.21.15.26:0/4236988937 >> 172.21.15.26:0/4236988937 conn(0x7fad500f1cd0 msgr2=0x7fad500f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:36:58.923 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.923+0000 7fad54fcf700 1 -- 172.21.15.26:0/4236988937 shutdown_connections 2021-11-03T17:36:58.923 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.923+0000 7fad54fcf700 1 -- 172.21.15.26:0/4236988937 wait complete. 2021-11-03T17:36:58.923 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.923+0000 7fad54fcf700 1 Processor -- start 2021-11-03T17:36:58.923 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.923+0000 7fad54fcf700 1 -- start start 2021-11-03T17:36:58.924 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.924+0000 7fad54fcf700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad500f6530 0x7fad50106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:36:58.924 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.924+0000 7fad54fcf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad500f77d0 0x7fad50107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:36:58.924 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.924+0000 7fad54fcf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad50107870 con 0x7fad500f77d0 2021-11-03T17:36:58.925 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.924+0000 7fad54fcf700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad50108080 con 0x7fad500f6530 2021-11-03T17:36:58.925 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.924+0000 7fad4effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad500f77d0 0x7fad50107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:36:58.925 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.924+0000 7fad4effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad500f77d0 0x7fad50107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55392/0 (socket says 172.21.15.26:55392) 2021-11-03T17:36:58.925 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.924+0000 7fad4effd700 1 -- 172.21.15.26:0/1790644376 learned_addr learned my addr 172.21.15.26:0/1790644376 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:36:58.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.924+0000 7fad4f7fe700 1 --2- 172.21.15.26:0/1790644376 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad500f6530 0x7fad50106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:36:58.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.924+0000 7fad4effd700 1 -- 172.21.15.26:0/1790644376 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad500f6530 msgr2=0x7fad50106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:36:58.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.924+0000 7fad4effd700 1 --2- 172.21.15.26:0/1790644376 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad500f6530 0x7fad50106d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:36:58.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.924+0000 7fad4effd700 1 -- 172.21.15.26:0/1790644376 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad38005040 con 0x7fad500f77d0 2021-11-03T17:36:58.927 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.924+0000 7fad4effd700 1 --2- 172.21.15.26:0/1790644376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad500f77d0 0x7fad50107270 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7fad38009da0 tx=0x7fad38009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:36:58.927 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.924+0000 7fad47fff700 1 -- 172.21.15.26:0/1790644376 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad38018070 con 0x7fad500f77d0 2021-11-03T17:36:58.927 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.924+0000 7fad54fcf700 1 -- 172.21.15.26:0/1790644376 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad501082a0 con 0x7fad500f77d0 2021-11-03T17:36:58.928 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.924+0000 7fad47fff700 1 -- 172.21.15.26:0/1790644376 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fad38007d70 con 0x7fad500f77d0 2021-11-03T17:36:58.928 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.924+0000 7fad47fff700 1 -- 172.21.15.26:0/1790644376 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad3801dea0 con 0x7fad500f77d0 2021-11-03T17:36:58.928 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.924+0000 7fad54fcf700 1 -- 172.21.15.26:0/1790644376 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad50108800 con 0x7fad500f77d0 2021-11-03T17:36:58.928 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.925+0000 7fad54fcf700 1 -- 172.21.15.26:0/1790644376 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad50059100 con 0x7fad500f77d0 2021-11-03T17:36:58.929 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:36:58 smithi026 ceph-mon[96795]: pgmap v1269: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:36:58.930 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.926+0000 7fad47fff700 1 -- 172.21.15.26:0/1790644376 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fad3801d420 con 0x7fad500f77d0 2021-11-03T17:36:58.930 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.926+0000 7fad47fff700 1 --2- 172.21.15.26:0/1790644376 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fad3c064100 0x7fad3c0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:36:58.931 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.926+0000 7fad47fff700 1 -- 172.21.15.26:0/1790644376 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fad38082690 con 0x7fad500f77d0 2021-11-03T17:36:58.931 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.926+0000 7fad4f7fe700 1 --2- 172.21.15.26:0/1790644376 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fad3c064100 0x7fad3c0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:36:58.931 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.927+0000 7fad4f7fe700 1 --2- 172.21.15.26:0/1790644376 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fad3c064100 0x7fad3c0665c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7fad50106af0 tx=0x7fad48009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:36:58.931 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:58.930+0000 7fad47fff700 1 -- 172.21.15.26:0/1790644376 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fad38054ab0 con 0x7fad500f77d0 2021-11-03T17:36:59.098 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.104+0000 7fad54fcf700 1 -- 172.21.15.26:0/1790644376 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fad500fee80 con 0x7fad3c064100 2021-11-03T17:36:59.113 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.118+0000 7fad47fff700 1 -- 172.21.15.26:0/1790644376 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fad500fee80 con 0x7fad3c064100 2021-11-03T17:36:59.113 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:36:59.114 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (48m) 7m ago 49m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:36:59.114 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (40m) 7m ago 49m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:36:59.114 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (40m) 6m ago 48m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:36:59.115 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (48m) 7m ago 49m 40.3M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:36:59.115 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (41m) 7m ago 44m 22.6M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:36:59.115 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (41m) 7m ago 44m 23.5M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:36:59.116 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (44m) 6m ago 44m 24.8M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:36:59.116 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (44m) 6m ago 44m 25.0M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:36:59.116 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (41m) 7m ago 50m 520M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:36:59.116 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (41m) 6m ago 48m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:36:59.117 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (41m) 7m ago 50m 176M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:36:59.117 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (40m) 6m ago 48m 89.5M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:36:59.117 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (49m) 7m ago 49m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:36:59.117 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (48m) 6m ago 48m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:36:59.118 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (40m) 7m ago 47m 231M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:36:59.118 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (39m) 7m ago 47m 248M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:36:59.118 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (39m) 7m ago 47m 207M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:36:59.118 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (38m) 6m ago 46m 262M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:36:59.119 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (38m) 6m ago 46m 227M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:36:59.119 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (37m) 6m ago 46m 215M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:36:59.119 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (47m) 7m ago 48m 54.4M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:36:59.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.120+0000 7fad54fcf700 1 -- 172.21.15.26:0/1790644376 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fad3c064100 msgr2=0x7fad3c0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:36:59.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.120+0000 7fad54fcf700 1 --2- 172.21.15.26:0/1790644376 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fad3c064100 0x7fad3c0665c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7fad50106af0 tx=0x7fad48009040).stop 2021-11-03T17:36:59.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.120+0000 7fad54fcf700 1 -- 172.21.15.26:0/1790644376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad500f77d0 msgr2=0x7fad50107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:36:59.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.120+0000 7fad54fcf700 1 --2- 172.21.15.26:0/1790644376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad500f77d0 0x7fad50107270 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7fad38009da0 tx=0x7fad38009b30).stop 2021-11-03T17:36:59.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.120+0000 7fad54fcf700 1 -- 172.21.15.26:0/1790644376 shutdown_connections 2021-11-03T17:36:59.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.120+0000 7fad54fcf700 1 --2- 172.21.15.26:0/1790644376 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fad3c064100 0x7fad3c0665c0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:36:59.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.120+0000 7fad54fcf700 1 --2- 172.21.15.26:0/1790644376 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad500f6530 0x7fad50106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:36:59.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.120+0000 7fad54fcf700 1 --2- 172.21.15.26:0/1790644376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad500f77d0 0x7fad50107270 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:36:59.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.120+0000 7fad54fcf700 1 -- 172.21.15.26:0/1790644376 >> 172.21.15.26:0/1790644376 conn(0x7fad500f1cd0 msgr2=0x7fad500fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:36:59.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.120+0000 7fad54fcf700 1 -- 172.21.15.26:0/1790644376 shutdown_connections 2021-11-03T17:36:59.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.120+0000 7fad54fcf700 1 -- 172.21.15.26:0/1790644376 wait complete. 2021-11-03T17:36:59.216 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.219+0000 7f73d0e5e700 1 -- 172.21.15.26:0/4272319179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73cc0f6880 msgr2=0x7f73cc0f6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:36:59.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.219+0000 7f73d0e5e700 1 --2- 172.21.15.26:0/4272319179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73cc0f6880 0x7f73cc0f6ce0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f73b4004660 tx=0x7f73b4009b30).stop 2021-11-03T17:36:59.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.219+0000 7f73d0e5e700 1 -- 172.21.15.26:0/4272319179 shutdown_connections 2021-11-03T17:36:59.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.219+0000 7f73d0e5e700 1 --2- 172.21.15.26:0/4272319179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73cc0f6880 0x7f73cc0f6ce0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:36:59.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.219+0000 7f73d0e5e700 1 --2- 172.21.15.26:0/4272319179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73cc0f55e0 0x7f73cc0f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:36:59.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.219+0000 7f73d0e5e700 1 -- 172.21.15.26:0/4272319179 >> 172.21.15.26:0/4272319179 conn(0x7f73cc0f0d40 msgr2=0x7f73cc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:36:59.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.219+0000 7f73d0e5e700 1 -- 172.21.15.26:0/4272319179 shutdown_connections 2021-11-03T17:36:59.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.219+0000 7f73d0e5e700 1 -- 172.21.15.26:0/4272319179 wait complete. 2021-11-03T17:36:59.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.219+0000 7f73d0e5e700 1 Processor -- start 2021-11-03T17:36:59.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.220+0000 7f73d0e5e700 1 -- start start 2021-11-03T17:36:59.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.220+0000 7f73d0e5e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73cc0f55e0 0x7f73cc109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:36:59.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.220+0000 7f73d0e5e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73cc0f6880 0x7f73cc10c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:36:59.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.220+0000 7f73d0e5e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73cc0604e0 con 0x7f73cc0f55e0 2021-11-03T17:36:59.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.220+0000 7f73d0e5e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73cc060620 con 0x7f73cc0f6880 2021-11-03T17:36:59.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.220+0000 7f73ca59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73cc0f55e0 0x7f73cc109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:36:59.221 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.220+0000 7f73ca59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73cc0f55e0 0x7f73cc109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55400/0 (socket says 172.21.15.26:55400) 2021-11-03T17:36:59.221 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.220+0000 7f73ca59c700 1 -- 172.21.15.26:0/1601794196 learned_addr learned my addr 172.21.15.26:0/1601794196 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:36:59.221 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.220+0000 7f73c9d9b700 1 --2- 172.21.15.26:0/1601794196 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73cc0f6880 0x7f73cc10c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:36:59.221 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.220+0000 7f73ca59c700 1 -- 172.21.15.26:0/1601794196 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73cc0f6880 msgr2=0x7f73cc10c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:36:59.221 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.220+0000 7f73ca59c700 1 --2- 172.21.15.26:0/1601794196 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73cc0f6880 0x7f73cc10c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:36:59.222 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.220+0000 7f73ca59c700 1 -- 172.21.15.26:0/1601794196 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b4005040 con 0x7f73cc0f55e0 2021-11-03T17:36:59.222 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.220+0000 7f73ca59c700 1 --2- 172.21.15.26:0/1601794196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73cc0f55e0 0x7f73cc109c70 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7f73c400d7f0 tx=0x7f73c4004e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:36:59.222 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.220+0000 7f73c2ffd700 1 -- 172.21.15.26:0/1601794196 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73c400b4f0 con 0x7f73cc0f55e0 2021-11-03T17:36:59.223 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.220+0000 7f73c2ffd700 1 -- 172.21.15.26:0/1601794196 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f73c400f040 con 0x7f73cc0f55e0 2021-11-03T17:36:59.223 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.220+0000 7f73d0e5e700 1 -- 172.21.15.26:0/1601794196 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73cc10c720 con 0x7f73cc0f55e0 2021-11-03T17:36:59.224 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.220+0000 7f73c2ffd700 1 -- 172.21.15.26:0/1601794196 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73c4013980 con 0x7f73cc0f55e0 2021-11-03T17:36:59.224 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.220+0000 7f73d0e5e700 1 -- 172.21.15.26:0/1601794196 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73cc10ccb0 con 0x7f73cc0f55e0 2021-11-03T17:36:59.225 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.221+0000 7f73d0e5e700 1 -- 172.21.15.26:0/1601794196 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73cc0f49d0 con 0x7f73cc0f55e0 2021-11-03T17:36:59.227 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.222+0000 7f73c2ffd700 1 -- 172.21.15.26:0/1601794196 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f73c401a030 con 0x7f73cc0f55e0 2021-11-03T17:36:59.227 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.222+0000 7f73c2ffd700 1 --2- 172.21.15.26:0/1601794196 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f73b80640b0 0x7f73b8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:36:59.228 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.222+0000 7f73c2ffd700 1 -- 172.21.15.26:0/1601794196 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f73c4080860 con 0x7f73cc0f55e0 2021-11-03T17:36:59.228 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.222+0000 7f73c9d9b700 1 --2- 172.21.15.26:0/1601794196 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f73b80640b0 0x7f73b8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:36:59.228 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.223+0000 7f73c9d9b700 1 --2- 172.21.15.26:0/1601794196 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f73b80640b0 0x7f73b8066570 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f73b4009da0 tx=0x7f73b4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:36:59.229 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.226+0000 7f73c2ffd700 1 -- 172.21.15.26:0/1601794196 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f73c4052ad0 con 0x7f73cc0f55e0 2021-11-03T17:36:59.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.460+0000 7f73d0e5e700 1 -- 172.21.15.26:0/1601794196 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f73cc045ad0 con 0x7f73cc0f55e0 2021-11-03T17:36:59.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.460+0000 7f73c2ffd700 1 -- 172.21.15.26:0/1601794196 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f73c40526c0 con 0x7f73cc0f55e0 2021-11-03T17:36:59.457 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:36:59.458 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:36:59.458 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:36:59.459 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:36:59.459 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:36:59.460 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:36:59.460 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:36:59.461 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:36:59.461 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:36:59.462 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:36:59.462 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:36:59.463 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:36:59.463 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:36:59.463 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:36:59.464 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:36:59.464 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:36:59.465 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:36:59.465 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:36:59.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.462+0000 7f73d0e5e700 1 -- 172.21.15.26:0/1601794196 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f73b80640b0 msgr2=0x7f73b8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:36:59.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.462+0000 7f73d0e5e700 1 --2- 172.21.15.26:0/1601794196 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f73b80640b0 0x7f73b8066570 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f73b4009da0 tx=0x7f73b4009b30).stop 2021-11-03T17:36:59.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.462+0000 7f73d0e5e700 1 -- 172.21.15.26:0/1601794196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73cc0f55e0 msgr2=0x7f73cc109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:36:59.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.462+0000 7f73d0e5e700 1 --2- 172.21.15.26:0/1601794196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73cc0f55e0 0x7f73cc109c70 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7f73c400d7f0 tx=0x7f73c4004e80).stop 2021-11-03T17:36:59.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.462+0000 7f73d0e5e700 1 -- 172.21.15.26:0/1601794196 shutdown_connections 2021-11-03T17:36:59.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.462+0000 7f73d0e5e700 1 --2- 172.21.15.26:0/1601794196 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f73b80640b0 0x7f73b8066570 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:36:59.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.462+0000 7f73d0e5e700 1 --2- 172.21.15.26:0/1601794196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73cc0f55e0 0x7f73cc109c70 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:36:59.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.462+0000 7f73d0e5e700 1 --2- 172.21.15.26:0/1601794196 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73cc0f6880 0x7f73cc10c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:36:59.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.462+0000 7f73d0e5e700 1 -- 172.21.15.26:0/1601794196 >> 172.21.15.26:0/1601794196 conn(0x7f73cc0f0d40 msgr2=0x7f73cc0fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:36:59.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.462+0000 7f73d0e5e700 1 -- 172.21.15.26:0/1601794196 shutdown_connections 2021-11-03T17:36:59.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.462+0000 7f73d0e5e700 1 -- 172.21.15.26:0/1601794196 wait complete. 2021-11-03T17:36:59.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.562+0000 7f3ffce33700 1 -- 172.21.15.26:0/452985313 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ff80f55e0 msgr2=0x7f3ff80f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:36:59.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.562+0000 7f3ffce33700 1 --2- 172.21.15.26:0/452985313 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ff80f55e0 0x7f3ff80f5a00 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f3fe0004660 tx=0x7f3fe0009b30).stop 2021-11-03T17:36:59.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.562+0000 7f3ffce33700 1 -- 172.21.15.26:0/452985313 shutdown_connections 2021-11-03T17:36:59.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.562+0000 7f3ffce33700 1 --2- 172.21.15.26:0/452985313 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ff80f5ef0 0x7f3ff80f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:36:59.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.562+0000 7f3ffce33700 1 --2- 172.21.15.26:0/452985313 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ff80f55e0 0x7f3ff80f5a00 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:36:59.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.562+0000 7f3ffce33700 1 -- 172.21.15.26:0/452985313 >> 172.21.15.26:0/452985313 conn(0x7f3ff80f0de0 msgr2=0x7f3ff80f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:36:59.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.562+0000 7f3ffce33700 1 -- 172.21.15.26:0/452985313 shutdown_connections 2021-11-03T17:36:59.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.562+0000 7f3ffce33700 1 -- 172.21.15.26:0/452985313 wait complete. 2021-11-03T17:36:59.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.563+0000 7f3ffce33700 1 Processor -- start 2021-11-03T17:36:59.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.563+0000 7f3ffce33700 1 -- start start 2021-11-03T17:36:59.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.563+0000 7f3ffce33700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ff80f55e0 0x7f3ff810c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:36:59.562 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.563+0000 7f3ffce33700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ff80f5ef0 0x7f3ff810e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:36:59.562 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.563+0000 7f3ffce33700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff80603d0 con 0x7f3ff80f55e0 2021-11-03T17:36:59.562 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.563+0000 7f3ffce33700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff8060510 con 0x7f3ff80f5ef0 2021-11-03T17:36:59.562 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.563+0000 7f3ff659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ff80f55e0 0x7f3ff810c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:36:59.563 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.563+0000 7f3ff659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ff80f55e0 0x7f3ff810c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55410/0 (socket says 172.21.15.26:55410) 2021-11-03T17:36:59.563 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.563+0000 7f3ff659c700 1 -- 172.21.15.26:0/1719078843 learned_addr learned my addr 172.21.15.26:0/1719078843 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:36:59.563 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.563+0000 7f3ff659c700 1 -- 172.21.15.26:0/1719078843 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ff80f5ef0 msgr2=0x7f3ff810e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:36:59.563 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.563+0000 7f3ff659c700 1 --2- 172.21.15.26:0/1719078843 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ff80f5ef0 0x7f3ff810e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:36:59.564 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.563+0000 7f3ff659c700 1 -- 172.21.15.26:0/1719078843 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe0005040 con 0x7f3ff80f55e0 2021-11-03T17:36:59.564 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.563+0000 7f3ff659c700 1 --2- 172.21.15.26:0/1719078843 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ff80f55e0 0x7f3ff810c0b0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7f3fe0009990 tx=0x7f3fe0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:36:59.564 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.564+0000 7f3feeffd700 1 -- 172.21.15.26:0/1719078843 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fe0018070 con 0x7f3ff80f55e0 2021-11-03T17:36:59.564 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.564+0000 7f3feeffd700 1 -- 172.21.15.26:0/1719078843 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3fe0007ca0 con 0x7f3ff80f55e0 2021-11-03T17:36:59.565 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.564+0000 7f3ffce33700 1 -- 172.21.15.26:0/1719078843 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ff810eaa0 con 0x7f3ff80f55e0 2021-11-03T17:36:59.565 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.564+0000 7f3feeffd700 1 -- 172.21.15.26:0/1719078843 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fe001c620 con 0x7f3ff80f55e0 2021-11-03T17:36:59.565 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.564+0000 7f3ffce33700 1 -- 172.21.15.26:0/1719078843 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ff810ee70 con 0x7f3ff80f55e0 2021-11-03T17:36:59.566 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.565+0000 7f3ffce33700 1 -- 172.21.15.26:0/1719078843 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ff8045ad0 con 0x7f3ff80f55e0 2021-11-03T17:36:59.567 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.565+0000 7f3feeffd700 1 -- 172.21.15.26:0/1719078843 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f3fe001d960 con 0x7f3ff80f55e0 2021-11-03T17:36:59.567 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.565+0000 7f3feeffd700 1 --2- 172.21.15.26:0/1719078843 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3fe40640b0 0x7f3fe4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:36:59.567 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.566+0000 7f3feeffd700 1 -- 172.21.15.26:0/1719078843 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f3fe0082470 con 0x7f3ff80f55e0 2021-11-03T17:36:59.567 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.566+0000 7f3ff5d9b700 1 --2- 172.21.15.26:0/1719078843 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3fe40640b0 0x7f3fe4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:36:59.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.566+0000 7f3ff5d9b700 1 --2- 172.21.15.26:0/1719078843 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3fe40640b0 0x7f3fe4066570 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f3fe80047d0 tx=0x7f3fe8007a40).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:36:59.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.570+0000 7f3feeffd700 1 -- 172.21.15.26:0/1719078843 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f3fe0054890 con 0x7f3ff80f55e0 2021-11-03T17:36:59.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.774+0000 7f3ffce33700 1 -- 172.21.15.26:0/1719078843 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3ff80586e0 con 0x7f3ff80f55e0 2021-11-03T17:36:59.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.774+0000 7f3feeffd700 1 -- 172.21.15.26:0/1719078843 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f3fe0054480 con 0x7f3ff80f55e0 2021-11-03T17:36:59.770 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:36:59.770 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:36:59.771 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:36:59.771 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:36:59.771 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:36:59.771 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:36:59.772 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:36:59.772 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:36:59.772 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:36:59.772 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:36:59.773 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:36:59.773 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:36:59.773 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:36:59.773 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:36:59.774 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:36:59.774 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:36:59.774 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:36:59.774 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:36:59.774 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:36:59.775 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:36:59.775 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:36:59.775 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:36:59.775 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:36:59.776 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:36:59.776 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:36:59.776 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:36:59.776 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:36:59.777 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:36:59.777 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:36:59.777 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:36:59.777 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:36:59.777 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:36:59.778 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:36:59.778 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:36:59.778 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:36:59.778 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:36:59.779 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:36:59.779 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:36:59.779 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:36:59.780 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.776+0000 7f3ffce33700 1 -- 172.21.15.26:0/1719078843 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3fe40640b0 msgr2=0x7f3fe4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:36:59.780 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.776+0000 7f3ffce33700 1 --2- 172.21.15.26:0/1719078843 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3fe40640b0 0x7f3fe4066570 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f3fe80047d0 tx=0x7f3fe8007a40).stop 2021-11-03T17:36:59.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.776+0000 7f3ffce33700 1 -- 172.21.15.26:0/1719078843 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ff80f55e0 msgr2=0x7f3ff810c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:36:59.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.776+0000 7f3ffce33700 1 --2- 172.21.15.26:0/1719078843 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ff80f55e0 0x7f3ff810c0b0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7f3fe0009990 tx=0x7f3fe0009b30).stop 2021-11-03T17:36:59.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.776+0000 7f3ffce33700 1 -- 172.21.15.26:0/1719078843 shutdown_connections 2021-11-03T17:36:59.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.776+0000 7f3ffce33700 1 --2- 172.21.15.26:0/1719078843 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3fe40640b0 0x7f3fe4066570 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:36:59.782 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.776+0000 7f3ffce33700 1 --2- 172.21.15.26:0/1719078843 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ff80f55e0 0x7f3ff810c0b0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:36:59.782 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.776+0000 7f3ffce33700 1 --2- 172.21.15.26:0/1719078843 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ff80f5ef0 0x7f3ff810e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:36:59.782 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.776+0000 7f3ffce33700 1 -- 172.21.15.26:0/1719078843 >> 172.21.15.26:0/1719078843 conn(0x7f3ff80f0de0 msgr2=0x7f3ff80fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:36:59.782 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.776+0000 7f3ffce33700 1 -- 172.21.15.26:0/1719078843 shutdown_connections 2021-11-03T17:36:59.782 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:36:59.776+0000 7f3ffce33700 1 -- 172.21.15.26:0/1719078843 wait complete. 2021-11-03T17:36:59.783 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:37:00.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:00 smithi194 ceph-mon[65619]: from='client.35452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:37:00.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:00 smithi194 ceph-mon[65619]: pgmap v1270: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:00.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:00 smithi194 ceph-mon[65619]: from='client.35456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:37:00.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:00 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1601794196' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:37:00.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:00 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1719078843' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:37:00.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:00 smithi026 ceph-mon[96795]: from='client.35452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:37:00.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:00 smithi026 ceph-mon[96795]: pgmap v1270: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:00.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:00 smithi026 ceph-mon[96795]: from='client.35456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:37:00.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:00 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1601794196' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:37:00.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:00 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1719078843' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:37:02.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:02 smithi194 ceph-mon[65619]: pgmap v1271: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:02.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:02 smithi026 ceph-mon[96795]: pgmap v1271: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:04.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:04 smithi194 ceph-mon[65619]: pgmap v1272: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:04.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:04 smithi026 ceph-mon[96795]: pgmap v1272: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:06.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:06 smithi194 ceph-mon[65619]: pgmap v1273: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:06.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:06 smithi026 ceph-mon[96795]: pgmap v1273: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:08.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:08 smithi194 ceph-mon[65619]: pgmap v1274: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:08.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:08 smithi026 ceph-mon[96795]: pgmap v1274: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:10.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:10 smithi194 ceph-mon[65619]: pgmap v1275: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:10.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:10 smithi026 ceph-mon[96795]: pgmap v1275: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:11.739 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:11 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:37:11.768 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:11 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:37:12.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:12 smithi194 ceph-mon[65619]: pgmap v1276: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:12.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:12 smithi194 ceph-mon[65619]: poll took 60058.202 ms: 1 events 2021-11-03T17:37:12.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:12 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2021-11-03T17:37:12.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:12 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi026", "name": "osd_memory_target"}]: dispatch 2021-11-03T17:37:12.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:12 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:37:12.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:12 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:37:12.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:12 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:37:12.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:12 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:37:12.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:12 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:37:12.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:12 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:37:12.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:12 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:37:12.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:12 smithi026 ceph-mon[96795]: pgmap v1276: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:12.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:12 smithi026 ceph-mon[96795]: poll took 60058.202 ms: 1 events 2021-11-03T17:37:12.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:12 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2021-11-03T17:37:12.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:12 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi026", "name": "osd_memory_target"}]: dispatch 2021-11-03T17:37:12.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:12 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:37:12.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:12 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:37:12.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:12 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:37:12.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:12 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:37:12.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:12 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:37:12.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:12 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:37:12.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:12 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:37:13.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:13 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:37:13.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:13 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:37:13.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:13 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:37:13.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:13 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:37:14.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:14 smithi194 ceph-mon[65619]: pgmap v1277: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:14.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:14 smithi026 ceph-mon[96795]: pgmap v1277: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:16.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:16 smithi194 ceph-mon[65619]: pgmap v1278: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:16.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:16 smithi026 ceph-mon[96795]: pgmap v1278: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:18.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:18 smithi194 ceph-mon[65619]: pgmap v1279: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:18.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:18 smithi026 ceph-mon[96795]: pgmap v1279: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:20.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:20 smithi194 ceph-mon[65619]: pgmap v1280: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:20.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:20 smithi026 ceph-mon[96795]: pgmap v1280: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:22.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:22 smithi194 ceph-mon[65619]: pgmap v1281: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:22.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:22 smithi026 ceph-mon[96795]: pgmap v1281: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:24.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:24 smithi194 ceph-mon[65619]: pgmap v1282: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:24.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:24 smithi026 ceph-mon[96795]: pgmap v1282: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:26.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:26 smithi194 ceph-mon[65619]: pgmap v1283: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:26.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:26 smithi026 ceph-mon[96795]: pgmap v1283: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:27.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:27 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:37:27.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:27 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:37:28.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:28 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:37:28.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:28 smithi194 ceph-mon[65619]: pgmap v1284: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:28.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:28 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:37:28.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:28 smithi026 ceph-mon[96795]: pgmap v1284: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:29.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:29.892+0000 7efebb365700 1 -- 172.21.15.26:0/792941171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efeb406a3b0 msgr2=0x7efeb406a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:37:29.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:29.892+0000 7efebb365700 1 --2- 172.21.15.26:0/792941171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efeb406a3b0 0x7efeb406a830 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7efea8004660 tx=0x7efea8009b30).stop 2021-11-03T17:37:29.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:29.892+0000 7efebb365700 1 -- 172.21.15.26:0/792941171 shutdown_connections 2021-11-03T17:37:29.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:29.892+0000 7efebb365700 1 --2- 172.21.15.26:0/792941171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efeb406a3b0 0x7efeb406a830 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:37:29.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:29.892+0000 7efebb365700 1 --2- 172.21.15.26:0/792941171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efeb406b9c0 0x7efeb4069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:37:29.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:29.892+0000 7efebb365700 1 -- 172.21.15.26:0/792941171 >> 172.21.15.26:0/792941171 conn(0x7efeb40f1e40 msgr2=0x7efeb40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:37:29.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:29.892+0000 7efebb365700 1 -- 172.21.15.26:0/792941171 shutdown_connections 2021-11-03T17:37:29.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:29.892+0000 7efebb365700 1 -- 172.21.15.26:0/792941171 wait complete. 2021-11-03T17:37:29.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:29.893+0000 7efebb365700 1 Processor -- start 2021-11-03T17:37:29.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:29.893+0000 7efebb365700 1 -- start start 2021-11-03T17:37:29.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:29.893+0000 7efebb365700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efeb406a3b0 0x7efeb410d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:37:29.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:29.893+0000 7efebb365700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efeb406b9c0 0x7efeb410d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:37:29.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:29.893+0000 7efebb365700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb410df50 con 0x7efeb406a3b0 2021-11-03T17:37:29.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:29.893+0000 7efebb365700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb410e090 con 0x7efeb406b9c0 2021-11-03T17:37:29.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:29.893+0000 7efeb9101700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efeb406a3b0 0x7efeb410d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:37:29.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:29.893+0000 7efeb9101700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efeb406a3b0 0x7efeb410d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55428/0 (socket says 172.21.15.26:55428) 2021-11-03T17:37:29.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:29.893+0000 7efeb9101700 1 -- 172.21.15.26:0/942978796 learned_addr learned my addr 172.21.15.26:0/942978796 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:37:29.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:29.893+0000 7efeb8900700 1 --2- 172.21.15.26:0/942978796 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efeb406b9c0 0x7efeb410d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:37:29.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:29.894+0000 7efeb9101700 1 -- 172.21.15.26:0/942978796 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efeb406b9c0 msgr2=0x7efeb410d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:37:29.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:29.894+0000 7efeb9101700 1 --2- 172.21.15.26:0/942978796 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efeb406b9c0 0x7efeb410d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:37:29.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:29.894+0000 7efeb9101700 1 -- 172.21.15.26:0/942978796 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea8005040 con 0x7efeb406a3b0 2021-11-03T17:37:29.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:29.894+0000 7efeb8900700 1 --2- 172.21.15.26:0/942978796 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efeb406b9c0 0x7efeb410d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-03T17:37:29.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:29.894+0000 7efeb9101700 1 --2- 172.21.15.26:0/942978796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efeb406a3b0 0x7efeb410d4b0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7efeac00eb70 tx=0x7efeac00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:37:29.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:29.894+0000 7efeb1ffb700 1 -- 172.21.15.26:0/942978796 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efeac0092e0 con 0x7efeb406a3b0 2021-11-03T17:37:29.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:29.894+0000 7efeb1ffb700 1 -- 172.21.15.26:0/942978796 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efeac00f040 con 0x7efeb406a3b0 2021-11-03T17:37:29.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:29.894+0000 7efebb365700 1 -- 172.21.15.26:0/942978796 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb410ea30 con 0x7efeb406a3b0 2021-11-03T17:37:29.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:29.894+0000 7efeb1ffb700 1 -- 172.21.15.26:0/942978796 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efeac00c930 con 0x7efeb406a3b0 2021-11-03T17:37:29.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:29.894+0000 7efebb365700 1 -- 172.21.15.26:0/942978796 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb410eff0 con 0x7efeb406a3b0 2021-11-03T17:37:29.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:29.895+0000 7efebb365700 1 -- 172.21.15.26:0/942978796 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb4045ad0 con 0x7efeb406a3b0 2021-11-03T17:37:29.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:29.895+0000 7efeb1ffb700 1 -- 172.21.15.26:0/942978796 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7efeac01b030 con 0x7efeb406a3b0 2021-11-03T17:37:29.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:29.896+0000 7efeb1ffb700 1 --2- 172.21.15.26:0/942978796 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efe9c0640b0 0x7efe9c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:37:29.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:29.896+0000 7efeb1ffb700 1 -- 172.21.15.26:0/942978796 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7efeac080c20 con 0x7efeb406a3b0 2021-11-03T17:37:29.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:29.896+0000 7efeb8900700 1 --2- 172.21.15.26:0/942978796 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efe9c0640b0 0x7efe9c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:37:29.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:29.896+0000 7efeb8900700 1 --2- 172.21.15.26:0/942978796 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efe9c0640b0 0x7efe9c066570 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7efea8005010 tx=0x7efea8016040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:37:29.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:29.900+0000 7efeb1ffb700 1 -- 172.21.15.26:0/942978796 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7efeac052e90 con 0x7efeb406a3b0 2021-11-03T17:37:30.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.078+0000 7efebb365700 1 -- 172.21.15.26:0/942978796 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efeb4105610 con 0x7efe9c0640b0 2021-11-03T17:37:30.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.079+0000 7efeb1ffb700 1 -- 172.21.15.26:0/942978796 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7efeb4105610 con 0x7efe9c0640b0 2021-11-03T17:37:30.075 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.081+0000 7efebb365700 1 -- 172.21.15.26:0/942978796 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efe9c0640b0 msgr2=0x7efe9c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:37:30.075 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.081+0000 7efebb365700 1 --2- 172.21.15.26:0/942978796 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efe9c0640b0 0x7efe9c066570 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7efea8005010 tx=0x7efea8016040).stop 2021-11-03T17:37:30.076 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.081+0000 7efebb365700 1 -- 172.21.15.26:0/942978796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efeb406a3b0 msgr2=0x7efeb410d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:37:30.076 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.081+0000 7efebb365700 1 --2- 172.21.15.26:0/942978796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efeb406a3b0 0x7efeb410d4b0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7efeac00eb70 tx=0x7efeac00b040).stop 2021-11-03T17:37:30.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.081+0000 7efebb365700 1 -- 172.21.15.26:0/942978796 shutdown_connections 2021-11-03T17:37:30.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.081+0000 7efebb365700 1 --2- 172.21.15.26:0/942978796 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efe9c0640b0 0x7efe9c066570 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:37:30.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.081+0000 7efebb365700 1 --2- 172.21.15.26:0/942978796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efeb406a3b0 0x7efeb410d4b0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:37:30.078 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.081+0000 7efebb365700 1 --2- 172.21.15.26:0/942978796 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efeb406b9c0 0x7efeb410d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:37:30.078 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.081+0000 7efebb365700 1 -- 172.21.15.26:0/942978796 >> 172.21.15.26:0/942978796 conn(0x7efeb40f1e40 msgr2=0x7efeb40f88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:37:30.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.081+0000 7efebb365700 1 -- 172.21.15.26:0/942978796 shutdown_connections 2021-11-03T17:37:30.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.081+0000 7efebb365700 1 -- 172.21.15.26:0/942978796 wait complete. 2021-11-03T17:37:30.084 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:37:30.176 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.181+0000 7f843a7a1700 1 -- 172.21.15.26:0/746749051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84340f55c0 msgr2=0x7f84340f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:37:30.177 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.181+0000 7f843a7a1700 1 --2- 172.21.15.26:0/746749051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84340f55c0 0x7f84340f59e0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f8424004660 tx=0x7f8424009b30).stop 2021-11-03T17:37:30.177 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.181+0000 7f843a7a1700 1 -- 172.21.15.26:0/746749051 shutdown_connections 2021-11-03T17:37:30.177 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.181+0000 7f843a7a1700 1 --2- 172.21.15.26:0/746749051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84340f6860 0x7f84340f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:37:30.177 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.181+0000 7f843a7a1700 1 --2- 172.21.15.26:0/746749051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84340f55c0 0x7f84340f59e0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:37:30.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.181+0000 7f843a7a1700 1 -- 172.21.15.26:0/746749051 >> 172.21.15.26:0/746749051 conn(0x7f84340f0d40 msgr2=0x7f84340f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:37:30.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.181+0000 7f843a7a1700 1 -- 172.21.15.26:0/746749051 shutdown_connections 2021-11-03T17:37:30.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.181+0000 7f843a7a1700 1 -- 172.21.15.26:0/746749051 wait complete. 2021-11-03T17:37:30.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.181+0000 7f843a7a1700 1 Processor -- start 2021-11-03T17:37:30.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.182+0000 7f843a7a1700 1 -- start start 2021-11-03T17:37:30.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.182+0000 7f843a7a1700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84340f55c0 0x7f8434109c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:37:30.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.182+0000 7f843a7a1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84340f6860 0x7f843410c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:37:30.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.182+0000 7f843a7a1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8434060470 con 0x7f84340f6860 2021-11-03T17:37:30.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.182+0000 7f843a7a1700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84340605b0 con 0x7f84340f55c0 2021-11-03T17:37:30.180 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.182+0000 7f84337fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84340f6860 0x7f843410c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:37:30.180 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.182+0000 7f84337fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84340f6860 0x7f843410c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55440/0 (socket says 172.21.15.26:55440) 2021-11-03T17:37:30.180 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.182+0000 7f84337fe700 1 -- 172.21.15.26:0/2126981721 learned_addr learned my addr 172.21.15.26:0/2126981721 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:37:30.180 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.182+0000 7f8433fff700 1 --2- 172.21.15.26:0/2126981721 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84340f55c0 0x7f8434109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:37:30.181 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.182+0000 7f84337fe700 1 -- 172.21.15.26:0/2126981721 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84340f55c0 msgr2=0x7f8434109c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:37:30.181 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.182+0000 7f84337fe700 1 --2- 172.21.15.26:0/2126981721 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84340f55c0 0x7f8434109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:37:30.181 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.182+0000 7f84337fe700 1 -- 172.21.15.26:0/2126981721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8424005040 con 0x7f84340f6860 2021-11-03T17:37:30.181 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.182+0000 7f84337fe700 1 --2- 172.21.15.26:0/2126981721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84340f6860 0x7f843410c180 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f842800b410 tx=0x7f8428006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:37:30.181 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.182+0000 7f8430ff9700 1 -- 172.21.15.26:0/2126981721 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84280125f0 con 0x7f84340f6860 2021-11-03T17:37:30.182 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.183+0000 7f843a7a1700 1 -- 172.21.15.26:0/2126981721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f843410c7e0 con 0x7f84340f6860 2021-11-03T17:37:30.182 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.183+0000 7f8430ff9700 1 -- 172.21.15.26:0/2126981721 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8428012c00 con 0x7f84340f6860 2021-11-03T17:37:30.182 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.183+0000 7f8430ff9700 1 -- 172.21.15.26:0/2126981721 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8428002ae0 con 0x7f84340f6860 2021-11-03T17:37:30.182 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.183+0000 7f843a7a1700 1 -- 172.21.15.26:0/2126981721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f843410cd70 con 0x7f84340f6860 2021-11-03T17:37:30.184 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.183+0000 7f843a7a1700 1 -- 172.21.15.26:0/2126981721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84340f49b0 con 0x7f84340f6860 2021-11-03T17:37:30.184 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.184+0000 7f8430ff9700 1 -- 172.21.15.26:0/2126981721 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f842800f030 con 0x7f84340f6860 2021-11-03T17:37:30.184 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.184+0000 7f8430ff9700 1 --2- 172.21.15.26:0/2126981721 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f841c0640b0 0x7f841c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:37:30.184 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.184+0000 7f8430ff9700 1 -- 172.21.15.26:0/2126981721 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f8428080c60 con 0x7f84340f6860 2021-11-03T17:37:30.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.184+0000 7f8433fff700 1 --2- 172.21.15.26:0/2126981721 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f841c0640b0 0x7f841c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:37:30.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.185+0000 7f8433fff700 1 --2- 172.21.15.26:0/2126981721 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f841c0640b0 0x7f841c066570 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f8424009da0 tx=0x7f8424009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:37:30.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.188+0000 7f8430ff9700 1 -- 172.21.15.26:0/2126981721 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f8428052fc0 con 0x7f84340f6860 2021-11-03T17:37:30.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.365+0000 7f843a7a1700 1 -- 172.21.15.26:0/2126981721 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f84340fdf70 con 0x7f841c0640b0 2021-11-03T17:37:30.374 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.380+0000 7f8430ff9700 1 -- 172.21.15.26:0/2126981721 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f84340fdf70 con 0x7f841c0640b0 2021-11-03T17:37:30.375 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:37:30.375 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (48m) 8m ago 50m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:37:30.375 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (40m) 8m ago 49m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:37:30.375 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (40m) 7m ago 49m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:37:30.376 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (48m) 8m ago 49m 40.3M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:37:30.376 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (41m) 8m ago 45m 22.6M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:37:30.376 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (42m) 8m ago 45m 23.5M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:37:30.376 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (45m) 7m ago 45m 24.8M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:37:30.376 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (45m) 7m ago 45m 25.0M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:37:30.377 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (42m) 8m ago 51m 520M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:37:30.377 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (42m) 7m ago 49m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:37:30.377 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (41m) 8m ago 51m 176M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:37:30.377 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (41m) 7m ago 49m 89.5M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:37:30.378 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (49m) 8m ago 49m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:37:30.378 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (48m) 7m ago 48m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:37:30.378 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (40m) 8m ago 48m 231M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:37:30.378 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (40m) 8m ago 48m 248M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:37:30.378 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (39m) 8m ago 47m 207M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:37:30.379 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (39m) 7m ago 47m 262M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:37:30.379 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (38m) 7m ago 47m 227M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:37:30.379 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (38m) 7m ago 46m 215M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:37:30.379 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (48m) 8m ago 49m 54.4M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:37:30.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.382+0000 7f843a7a1700 1 -- 172.21.15.26:0/2126981721 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f841c0640b0 msgr2=0x7f841c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:37:30.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.382+0000 7f843a7a1700 1 --2- 172.21.15.26:0/2126981721 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f841c0640b0 0x7f841c066570 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f8424009da0 tx=0x7f8424009b30).stop 2021-11-03T17:37:30.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.382+0000 7f843a7a1700 1 -- 172.21.15.26:0/2126981721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84340f6860 msgr2=0x7f843410c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:37:30.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.382+0000 7f843a7a1700 1 --2- 172.21.15.26:0/2126981721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84340f6860 0x7f843410c180 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f842800b410 tx=0x7f8428006ef0).stop 2021-11-03T17:37:30.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.382+0000 7f843a7a1700 1 -- 172.21.15.26:0/2126981721 shutdown_connections 2021-11-03T17:37:30.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.382+0000 7f843a7a1700 1 --2- 172.21.15.26:0/2126981721 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f841c0640b0 0x7f841c066570 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:37:30.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.382+0000 7f843a7a1700 1 --2- 172.21.15.26:0/2126981721 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84340f55c0 0x7f8434109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:37:30.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.382+0000 7f843a7a1700 1 --2- 172.21.15.26:0/2126981721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84340f6860 0x7f843410c180 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:37:30.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.382+0000 7f843a7a1700 1 -- 172.21.15.26:0/2126981721 >> 172.21.15.26:0/2126981721 conn(0x7f84340f0d40 msgr2=0x7f84340fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:37:30.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.382+0000 7f843a7a1700 1 -- 172.21.15.26:0/2126981721 shutdown_connections 2021-11-03T17:37:30.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.382+0000 7f843a7a1700 1 -- 172.21.15.26:0/2126981721 wait complete. 2021-11-03T17:37:30.477 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.482+0000 7fd7ae3aa700 1 -- 172.21.15.26:0/4003948037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7a80f7970 msgr2=0x7fd7a80f7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:37:30.478 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.482+0000 7fd7ae3aa700 1 --2- 172.21.15.26:0/4003948037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7a80f7970 0x7fd7a80f7dd0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7fd79c004660 tx=0x7fd79c009b30).stop 2021-11-03T17:37:30.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.482+0000 7fd7ae3aa700 1 -- 172.21.15.26:0/4003948037 shutdown_connections 2021-11-03T17:37:30.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.482+0000 7fd7ae3aa700 1 --2- 172.21.15.26:0/4003948037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7a80f7970 0x7fd7a80f7dd0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:37:30.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.482+0000 7fd7ae3aa700 1 --2- 172.21.15.26:0/4003948037 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7a80f66d0 0x7fd7a80f6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:37:30.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.482+0000 7fd7ae3aa700 1 -- 172.21.15.26:0/4003948037 >> 172.21.15.26:0/4003948037 conn(0x7fd7a80f1e50 msgr2=0x7fd7a80f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:37:30.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.482+0000 7fd7ae3aa700 1 -- 172.21.15.26:0/4003948037 shutdown_connections 2021-11-03T17:37:30.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.482+0000 7fd7ae3aa700 1 -- 172.21.15.26:0/4003948037 wait complete. 2021-11-03T17:37:30.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.482+0000 7fd7ae3aa700 1 Processor -- start 2021-11-03T17:37:30.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.482+0000 7fd7ae3aa700 1 -- start start 2021-11-03T17:37:30.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.483+0000 7fd7ae3aa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7a80f66d0 0x7fd7a8106f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:37:30.481 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.483+0000 7fd7ae3aa700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7a80f7970 0x7fd7a8107440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:37:30.481 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.483+0000 7fd7ae3aa700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a81079f0 con 0x7fd7a80f66d0 2021-11-03T17:37:30.481 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.483+0000 7fd7ae3aa700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a8107b30 con 0x7fd7a80f7970 2021-11-03T17:37:30.481 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.483+0000 7fd7a7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7a80f66d0 0x7fd7a8106f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:37:30.482 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.483+0000 7fd7a7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7a80f66d0 0x7fd7a8106f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55448/0 (socket says 172.21.15.26:55448) 2021-11-03T17:37:30.482 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.483+0000 7fd7a7fff700 1 -- 172.21.15.26:0/2085381236 learned_addr learned my addr 172.21.15.26:0/2085381236 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:37:30.482 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.483+0000 7fd7a77fe700 1 --2- 172.21.15.26:0/2085381236 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7a80f7970 0x7fd7a8107440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:37:30.482 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.483+0000 7fd7a7fff700 1 -- 172.21.15.26:0/2085381236 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7a80f7970 msgr2=0x7fd7a8107440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:37:30.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.483+0000 7fd7a7fff700 1 --2- 172.21.15.26:0/2085381236 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7a80f7970 0x7fd7a8107440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:37:30.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.483+0000 7fd7a7fff700 1 -- 172.21.15.26:0/2085381236 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd79c005040 con 0x7fd7a80f66d0 2021-11-03T17:37:30.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.483+0000 7fd7a7fff700 1 --2- 172.21.15.26:0/2085381236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7a80f66d0 0x7fd7a8106f50 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7fd79800c530 tx=0x7fd798007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:37:30.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.483+0000 7fd7a4ff9700 1 -- 172.21.15.26:0/2085381236 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd79800f650 con 0x7fd7a80f66d0 2021-11-03T17:37:30.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.483+0000 7fd7a4ff9700 1 -- 172.21.15.26:0/2085381236 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd79800fc60 con 0x7fd7a80f66d0 2021-11-03T17:37:30.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.483+0000 7fd7ae3aa700 1 -- 172.21.15.26:0/2085381236 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7a81084d0 con 0x7fd7a80f66d0 2021-11-03T17:37:30.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.483+0000 7fd7a4ff9700 1 -- 172.21.15.26:0/2085381236 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd798012d20 con 0x7fd7a80f66d0 2021-11-03T17:37:30.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.483+0000 7fd7ae3aa700 1 -- 172.21.15.26:0/2085381236 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7a8108a90 con 0x7fd7a80f66d0 2021-11-03T17:37:30.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.484+0000 7fd7ae3aa700 1 -- 172.21.15.26:0/2085381236 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7a8045ad0 con 0x7fd7a80f66d0 2021-11-03T17:37:30.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.485+0000 7fd7a4ff9700 1 -- 172.21.15.26:0/2085381236 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fd798019030 con 0x7fd7a80f66d0 2021-11-03T17:37:30.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.485+0000 7fd7a4ff9700 1 --2- 172.21.15.26:0/2085381236 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd7900640b0 0x7fd790066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:37:30.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.485+0000 7fd7a77fe700 1 --2- 172.21.15.26:0/2085381236 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd7900640b0 0x7fd790066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:37:30.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.486+0000 7fd7a77fe700 1 --2- 172.21.15.26:0/2085381236 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd7900640b0 0x7fd790066570 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7fd79c004e30 tx=0x7fd79c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:37:30.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.486+0000 7fd7a4ff9700 1 -- 172.21.15.26:0/2085381236 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fd7980588a0 con 0x7fd7a80f66d0 2021-11-03T17:37:30.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.491+0000 7fd7a4ff9700 1 -- 172.21.15.26:0/2085381236 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fd798052830 con 0x7fd7a80f66d0 2021-11-03T17:37:30.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.721+0000 7fd7ae3aa700 1 -- 172.21.15.26:0/2085381236 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd7a80fef90 con 0x7fd7a80f66d0 2021-11-03T17:37:30.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.721+0000 7fd7a4ff9700 1 -- 172.21.15.26:0/2085381236 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fd7980172e0 con 0x7fd7a80f66d0 2021-11-03T17:37:30.716 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:37:30.716 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:37:30.717 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:37:30.717 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:37:30.717 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:37:30.717 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:37:30.718 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:37:30.718 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:37:30.718 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:37:30.718 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:37:30.719 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:37:30.719 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:37:30.719 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:37:30.719 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:37:30.719 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:37:30.720 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:37:30.720 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:37:30.720 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:37:30.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.723+0000 7fd7ae3aa700 1 -- 172.21.15.26:0/2085381236 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd7900640b0 msgr2=0x7fd790066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:37:30.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.723+0000 7fd7ae3aa700 1 --2- 172.21.15.26:0/2085381236 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd7900640b0 0x7fd790066570 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7fd79c004e30 tx=0x7fd79c009b30).stop 2021-11-03T17:37:30.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.723+0000 7fd7ae3aa700 1 -- 172.21.15.26:0/2085381236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7a80f66d0 msgr2=0x7fd7a8106f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:37:30.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.723+0000 7fd7ae3aa700 1 --2- 172.21.15.26:0/2085381236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7a80f66d0 0x7fd7a8106f50 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7fd79800c530 tx=0x7fd798007e10).stop 2021-11-03T17:37:30.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.723+0000 7fd7ae3aa700 1 -- 172.21.15.26:0/2085381236 shutdown_connections 2021-11-03T17:37:30.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.724+0000 7fd7ae3aa700 1 --2- 172.21.15.26:0/2085381236 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd7900640b0 0x7fd790066570 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:37:30.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.724+0000 7fd7ae3aa700 1 --2- 172.21.15.26:0/2085381236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7a80f66d0 0x7fd7a8106f50 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:37:30.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.724+0000 7fd7ae3aa700 1 --2- 172.21.15.26:0/2085381236 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7a80f7970 0x7fd7a8107440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:37:30.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.724+0000 7fd7ae3aa700 1 -- 172.21.15.26:0/2085381236 >> 172.21.15.26:0/2085381236 conn(0x7fd7a80f1e50 msgr2=0x7fd7a80fb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:37:30.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.724+0000 7fd7ae3aa700 1 -- 172.21.15.26:0/2085381236 shutdown_connections 2021-11-03T17:37:30.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.724+0000 7fd7ae3aa700 1 -- 172.21.15.26:0/2085381236 wait complete. 2021-11-03T17:37:30.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:30 smithi194 ceph-mon[65619]: pgmap v1285: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:30.820 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.824+0000 7f94b09cd700 1 -- 172.21.15.26:0/367591159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94ac0f55e0 msgr2=0x7f94ac0f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:37:30.820 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.824+0000 7f94b09cd700 1 --2- 172.21.15.26:0/367591159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94ac0f55e0 0x7f94ac0f5a00 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7f94a0004660 tx=0x7f94a0009b30).stop 2021-11-03T17:37:30.820 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.824+0000 7f94b09cd700 1 -- 172.21.15.26:0/367591159 shutdown_connections 2021-11-03T17:37:30.820 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.824+0000 7f94b09cd700 1 --2- 172.21.15.26:0/367591159 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94ac0f5ef0 0x7f94ac0f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:37:30.821 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.824+0000 7f94b09cd700 1 --2- 172.21.15.26:0/367591159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94ac0f55e0 0x7f94ac0f5a00 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:37:30.821 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.824+0000 7f94b09cd700 1 -- 172.21.15.26:0/367591159 >> 172.21.15.26:0/367591159 conn(0x7f94ac0f0de0 msgr2=0x7f94ac0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:37:30.822 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.824+0000 7f94b09cd700 1 -- 172.21.15.26:0/367591159 shutdown_connections 2021-11-03T17:37:30.822 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.824+0000 7f94b09cd700 1 -- 172.21.15.26:0/367591159 wait complete. 2021-11-03T17:37:30.822 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.825+0000 7f94b09cd700 1 Processor -- start 2021-11-03T17:37:30.822 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.825+0000 7f94b09cd700 1 -- start start 2021-11-03T17:37:30.823 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.825+0000 7f94b09cd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94ac0f55e0 0x7f94ac106f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:37:30.823 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.825+0000 7f94b09cd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94ac0f5ef0 0x7f94ac107480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:37:30.823 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.825+0000 7f94b09cd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac107a30 con 0x7f94ac0f5ef0 2021-11-03T17:37:30.823 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.825+0000 7f94b09cd700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac107b70 con 0x7f94ac0f55e0 2021-11-03T17:37:30.824 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.825+0000 7f94a9d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94ac0f5ef0 0x7f94ac107480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:37:30.824 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.825+0000 7f94a9d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94ac0f5ef0 0x7f94ac107480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55460/0 (socket says 172.21.15.26:55460) 2021-11-03T17:37:30.824 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.825+0000 7f94a9d9b700 1 -- 172.21.15.26:0/2979447025 learned_addr learned my addr 172.21.15.26:0/2979447025 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:37:30.824 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.825+0000 7f94aa59c700 1 --2- 172.21.15.26:0/2979447025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94ac0f55e0 0x7f94ac106f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:37:30.824 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.825+0000 7f94a9d9b700 1 -- 172.21.15.26:0/2979447025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94ac0f55e0 msgr2=0x7f94ac106f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:37:30.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.825+0000 7f94a9d9b700 1 --2- 172.21.15.26:0/2979447025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94ac0f55e0 0x7f94ac106f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:37:30.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.825+0000 7f94a9d9b700 1 -- 172.21.15.26:0/2979447025 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a0005040 con 0x7f94ac0f5ef0 2021-11-03T17:37:30.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.825+0000 7f94a9d9b700 1 --2- 172.21.15.26:0/2979447025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94ac0f5ef0 0x7f94ac107480 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7f949c0026d0 tx=0x7f949c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:37:30.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.826+0000 7f949affd700 1 -- 172.21.15.26:0/2979447025 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f949c0079c0 con 0x7f94ac0f5ef0 2021-11-03T17:37:30.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.826+0000 7f949affd700 1 -- 172.21.15.26:0/2979447025 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f949c00f040 con 0x7f94ac0f5ef0 2021-11-03T17:37:30.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.826+0000 7f94b09cd700 1 -- 172.21.15.26:0/2979447025 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94ac108510 con 0x7f94ac0f5ef0 2021-11-03T17:37:30.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.826+0000 7f949affd700 1 -- 172.21.15.26:0/2979447025 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f949c0148b0 con 0x7f94ac0f5ef0 2021-11-03T17:37:30.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.826+0000 7f94b09cd700 1 -- 172.21.15.26:0/2979447025 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94ac108ad0 con 0x7f94ac0f5ef0 2021-11-03T17:37:30.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.826+0000 7f94b09cd700 1 -- 172.21.15.26:0/2979447025 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94ac045ad0 con 0x7f94ac0f5ef0 2021-11-03T17:37:30.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.827+0000 7f949affd700 1 -- 172.21.15.26:0/2979447025 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f949c007b20 con 0x7f94ac0f5ef0 2021-11-03T17:37:30.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.828+0000 7f949affd700 1 --2- 172.21.15.26:0/2979447025 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f94940640b0 0x7f9494066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:37:30.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.828+0000 7f949affd700 1 -- 172.21.15.26:0/2979447025 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f949c080b90 con 0x7f94ac0f5ef0 2021-11-03T17:37:30.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.828+0000 7f94aa59c700 1 --2- 172.21.15.26:0/2979447025 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f94940640b0 0x7f9494066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:37:30.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.828+0000 7f94aa59c700 1 --2- 172.21.15.26:0/2979447025 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f94940640b0 0x7f9494066570 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f94a0004630 tx=0x7f94a0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:37:30.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:30.831+0000 7f949affd700 1 -- 172.21.15.26:0/2979447025 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f949c052ef0 con 0x7f94ac0f5ef0 2021-11-03T17:37:30.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:30 smithi026 ceph-mon[96795]: pgmap v1285: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:31.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:31.037+0000 7f94b09cd700 1 -- 172.21.15.26:0/2979447025 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f94ac027a00 con 0x7f94ac0f5ef0 2021-11-03T17:37:31.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:31.037+0000 7f949affd700 1 -- 172.21.15.26:0/2979447025 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f949c052ae0 con 0x7f94ac0f5ef0 2021-11-03T17:37:31.032 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:37:31.032 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:37:31.032 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:37:31.032 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:37:31.033 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:37:31.033 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:37:31.033 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:37:31.033 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:37:31.033 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:37:31.034 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:37:31.034 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:37:31.034 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:37:31.034 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:37:31.035 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:37:31.035 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:37:31.035 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:37:31.035 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:37:31.036 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:37:31.036 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:37:31.036 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:37:31.036 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:37:31.036 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:37:31.037 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:37:31.037 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:37:31.037 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:37:31.037 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:37:31.038 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:37:31.038 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:37:31.038 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:37:31.038 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:37:31.039 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:37:31.039 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:37:31.039 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:37:31.039 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:37:31.039 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:37:31.040 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:37:31.040 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:37:31.040 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:37:31.040 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:37:31.041 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:31.039+0000 7f94b09cd700 1 -- 172.21.15.26:0/2979447025 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f94940640b0 msgr2=0x7f9494066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:37:31.042 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:31.039+0000 7f94b09cd700 1 --2- 172.21.15.26:0/2979447025 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f94940640b0 0x7f9494066570 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f94a0004630 tx=0x7f94a0009b30).stop 2021-11-03T17:37:31.042 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:31.039+0000 7f94b09cd700 1 -- 172.21.15.26:0/2979447025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94ac0f5ef0 msgr2=0x7f94ac107480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:37:31.042 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:31.039+0000 7f94b09cd700 1 --2- 172.21.15.26:0/2979447025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94ac0f5ef0 0x7f94ac107480 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7f949c0026d0 tx=0x7f949c009de0).stop 2021-11-03T17:37:31.042 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:31.039+0000 7f94b09cd700 1 -- 172.21.15.26:0/2979447025 shutdown_connections 2021-11-03T17:37:31.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:31.039+0000 7f94b09cd700 1 --2- 172.21.15.26:0/2979447025 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f94940640b0 0x7f9494066570 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:37:31.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:31.039+0000 7f94b09cd700 1 --2- 172.21.15.26:0/2979447025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94ac0f55e0 0x7f94ac106f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:37:31.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:31.039+0000 7f94b09cd700 1 --2- 172.21.15.26:0/2979447025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94ac0f5ef0 0x7f94ac107480 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:37:31.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:31.039+0000 7f94b09cd700 1 -- 172.21.15.26:0/2979447025 >> 172.21.15.26:0/2979447025 conn(0x7f94ac0f0de0 msgr2=0x7f94ac0fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:37:31.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:31.039+0000 7f94b09cd700 1 -- 172.21.15.26:0/2979447025 shutdown_connections 2021-11-03T17:37:31.044 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:37:31.039+0000 7f94b09cd700 1 -- 172.21.15.26:0/2979447025 wait complete. 2021-11-03T17:37:31.044 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:37:31.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:31 smithi194 ceph-mon[65619]: from='client.35468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:37:31.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:31 smithi194 ceph-mon[65619]: from='client.35472 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:37:31.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:31 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2085381236' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:37:31.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:31 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2979447025' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:37:31.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:31 smithi026 ceph-mon[96795]: from='client.35468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:37:31.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:31 smithi026 ceph-mon[96795]: from='client.35472 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:37:31.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:31 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2085381236' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:37:31.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:31 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2979447025' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:37:32.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:32 smithi194 ceph-mon[65619]: pgmap v1286: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:32.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:32 smithi026 ceph-mon[96795]: pgmap v1286: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:34.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:34 smithi194 ceph-mon[65619]: pgmap v1287: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:34.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:34 smithi026 ceph-mon[96795]: pgmap v1287: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:36.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:36 smithi194 ceph-mon[65619]: pgmap v1288: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:36.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:36 smithi026 ceph-mon[96795]: pgmap v1288: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:38.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:38 smithi194 ceph-mon[65619]: pgmap v1289: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:38.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:38 smithi026 ceph-mon[96795]: pgmap v1289: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:40.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:40 smithi194 ceph-mon[65619]: pgmap v1290: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:40.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:40 smithi026 ceph-mon[96795]: pgmap v1290: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:42.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:42 smithi026 ceph-mon[96795]: pgmap v1291: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:42.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:37:42.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:42 smithi194 ceph-mon[65619]: pgmap v1291: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:42.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:37:43.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:43 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:37:43.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:43 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:37:44.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:44 smithi026 ceph-mon[96795]: pgmap v1292: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:44.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:44 smithi194 ceph-mon[65619]: pgmap v1292: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:46.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:46 smithi026 ceph-mon[96795]: pgmap v1293: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:46.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:46 smithi194 ceph-mon[65619]: pgmap v1293: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:48.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:48 smithi026 ceph-mon[96795]: pgmap v1294: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:48.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:37:48.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:37:48.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:48 smithi194 ceph-mon[65619]: pgmap v1294: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:48.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:37:48.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:37:50.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:50 smithi026 ceph-mon[96795]: pgmap v1295: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:50.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:50 smithi194 ceph-mon[65619]: pgmap v1295: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:52.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:52 smithi026 ceph-mon[96795]: pgmap v1296: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:52.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:52 smithi194 ceph-mon[65619]: pgmap v1296: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:54.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:54 smithi026 ceph-mon[96795]: pgmap v1297: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:54.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:54 smithi194 ceph-mon[65619]: pgmap v1297: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:56.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:56 smithi026 ceph-mon[96795]: pgmap v1298: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:56.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:56 smithi194 ceph-mon[65619]: pgmap v1298: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:57.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:57 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:37:57.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:57 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:37:58.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:58 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:37:58.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:37:58 smithi026 ceph-mon[96795]: pgmap v1299: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:37:58.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:58 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:37:58.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:37:58 smithi194 ceph-mon[65619]: pgmap v1299: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:00.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:00 smithi026 ceph-mon[96795]: pgmap v1300: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:00.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:00 smithi194 ceph-mon[65619]: pgmap v1300: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:01.147 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.152+0000 7f90d9dfa700 1 -- 172.21.15.26:0/4131745306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90d40f66e0 msgr2=0x7f90d40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:38:01.148 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.152+0000 7f90d9dfa700 1 --2- 172.21.15.26:0/4131745306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90d40f66e0 0x7f90d40f6b00 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f90c4004660 tx=0x7f90c4009b30).stop 2021-11-03T17:38:01.148 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.152+0000 7f90d9dfa700 1 -- 172.21.15.26:0/4131745306 shutdown_connections 2021-11-03T17:38:01.148 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.152+0000 7f90d9dfa700 1 --2- 172.21.15.26:0/4131745306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90d40f6ff0 0x7f90d40f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:01.148 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.152+0000 7f90d9dfa700 1 --2- 172.21.15.26:0/4131745306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90d40f66e0 0x7f90d40f6b00 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:01.149 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.152+0000 7f90d9dfa700 1 -- 172.21.15.26:0/4131745306 >> 172.21.15.26:0/4131745306 conn(0x7f90d40f1f00 msgr2=0x7f90d40f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:38:01.149 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.152+0000 7f90d9dfa700 1 -- 172.21.15.26:0/4131745306 shutdown_connections 2021-11-03T17:38:01.149 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.152+0000 7f90d9dfa700 1 -- 172.21.15.26:0/4131745306 wait complete. 2021-11-03T17:38:01.149 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.153+0000 7f90d9dfa700 1 Processor -- start 2021-11-03T17:38:01.150 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.153+0000 7f90d9dfa700 1 -- start start 2021-11-03T17:38:01.151 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.153+0000 7f90d9dfa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90d40f66e0 0x7f90d4106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:38:01.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.153+0000 7f90d9dfa700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90d40f6ff0 0x7f90d4107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:38:01.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.153+0000 7f90d9dfa700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d4107a00 con 0x7f90d40f66e0 2021-11-03T17:38:01.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.153+0000 7f90d9dfa700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d4107b40 con 0x7f90d40f6ff0 2021-11-03T17:38:01.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.153+0000 7f90d37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90d40f66e0 0x7f90d4106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:38:01.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.153+0000 7f90d37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90d40f66e0 0x7f90d4106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55476/0 (socket says 172.21.15.26:55476) 2021-11-03T17:38:01.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.153+0000 7f90d37fe700 1 -- 172.21.15.26:0/4082645992 learned_addr learned my addr 172.21.15.26:0/4082645992 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:38:01.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.153+0000 7f90d2ffd700 1 --2- 172.21.15.26:0/4082645992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90d40f6ff0 0x7f90d4107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:38:01.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.154+0000 7f90d37fe700 1 -- 172.21.15.26:0/4082645992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90d40f6ff0 msgr2=0x7f90d4107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:38:01.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.154+0000 7f90d37fe700 1 --2- 172.21.15.26:0/4082645992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90d40f6ff0 0x7f90d4107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:01.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.154+0000 7f90d37fe700 1 -- 172.21.15.26:0/4082645992 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c4005040 con 0x7f90d40f66e0 2021-11-03T17:38:01.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.154+0000 7f90d37fe700 1 --2- 172.21.15.26:0/4082645992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90d40f66e0 0x7f90d4106f60 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f90c4009990 tx=0x7f90c4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:38:01.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.154+0000 7f90bbfff700 1 -- 172.21.15.26:0/4082645992 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90c4018070 con 0x7f90d40f66e0 2021-11-03T17:38:01.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.154+0000 7f90bbfff700 1 -- 172.21.15.26:0/4082645992 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f90c4007ba0 con 0x7f90d40f66e0 2021-11-03T17:38:01.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.154+0000 7f90d9dfa700 1 -- 172.21.15.26:0/4082645992 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d4108480 con 0x7f90d40f66e0 2021-11-03T17:38:01.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.154+0000 7f90bbfff700 1 -- 172.21.15.26:0/4082645992 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90c401c620 con 0x7f90d40f66e0 2021-11-03T17:38:01.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.154+0000 7f90d9dfa700 1 -- 172.21.15.26:0/4082645992 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d41089e0 con 0x7f90d40f66e0 2021-11-03T17:38:01.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.155+0000 7f90d9dfa700 1 -- 172.21.15.26:0/4082645992 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90d4045ad0 con 0x7f90d40f66e0 2021-11-03T17:38:01.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.156+0000 7f90bbfff700 1 -- 172.21.15.26:0/4082645992 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f90c401c8e0 con 0x7f90d40f66e0 2021-11-03T17:38:01.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.157+0000 7f90bbfff700 1 --2- 172.21.15.26:0/4082645992 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f90bc0640b0 0x7f90bc066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:38:01.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.157+0000 7f90bbfff700 1 -- 172.21.15.26:0/4082645992 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f90c40828f0 con 0x7f90d40f66e0 2021-11-03T17:38:01.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.157+0000 7f90d2ffd700 1 --2- 172.21.15.26:0/4082645992 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f90bc0640b0 0x7f90bc066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:38:01.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.157+0000 7f90d2ffd700 1 --2- 172.21.15.26:0/4082645992 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f90bc0640b0 0x7f90bc066570 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f90c80041d0 tx=0x7f90c8009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:38:01.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.160+0000 7f90bbfff700 1 -- 172.21.15.26:0/4082645992 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f90c4054bd0 con 0x7f90d40f66e0 2021-11-03T17:38:01.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.338+0000 7f90d9dfa700 1 -- 172.21.15.26:0/4082645992 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f90d40ff010 con 0x7f90bc0640b0 2021-11-03T17:38:01.334 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.339+0000 7f90bbfff700 1 -- 172.21.15.26:0/4082645992 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f90d40ff010 con 0x7f90bc0640b0 2021-11-03T17:38:01.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.341+0000 7f90d9dfa700 1 -- 172.21.15.26:0/4082645992 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f90bc0640b0 msgr2=0x7f90bc066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:38:01.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.341+0000 7f90d9dfa700 1 --2- 172.21.15.26:0/4082645992 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f90bc0640b0 0x7f90bc066570 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f90c80041d0 tx=0x7f90c8009040).stop 2021-11-03T17:38:01.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.341+0000 7f90d9dfa700 1 -- 172.21.15.26:0/4082645992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90d40f66e0 msgr2=0x7f90d4106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:38:01.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.341+0000 7f90d9dfa700 1 --2- 172.21.15.26:0/4082645992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90d40f66e0 0x7f90d4106f60 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f90c4009990 tx=0x7f90c4009b30).stop 2021-11-03T17:38:01.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.341+0000 7f90d9dfa700 1 -- 172.21.15.26:0/4082645992 shutdown_connections 2021-11-03T17:38:01.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.341+0000 7f90d9dfa700 1 --2- 172.21.15.26:0/4082645992 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f90bc0640b0 0x7f90bc066570 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:01.338 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.341+0000 7f90d9dfa700 1 --2- 172.21.15.26:0/4082645992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90d40f66e0 0x7f90d4106f60 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:01.338 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.341+0000 7f90d9dfa700 1 --2- 172.21.15.26:0/4082645992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90d40f6ff0 0x7f90d4107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:01.338 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.341+0000 7f90d9dfa700 1 -- 172.21.15.26:0/4082645992 >> 172.21.15.26:0/4082645992 conn(0x7f90d40f1f00 msgr2=0x7f90d40fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:38:01.338 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.341+0000 7f90d9dfa700 1 -- 172.21.15.26:0/4082645992 shutdown_connections 2021-11-03T17:38:01.339 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.341+0000 7f90d9dfa700 1 -- 172.21.15.26:0/4082645992 wait complete. 2021-11-03T17:38:01.346 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:38:01.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.442+0000 7fdc3b755700 1 -- 172.21.15.26:0/3180254340 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc340f55e0 msgr2=0x7fdc340f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:38:01.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.442+0000 7fdc3b755700 1 --2- 172.21.15.26:0/3180254340 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc340f55e0 0x7fdc340f5a00 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7fdc2c004660 tx=0x7fdc2c009b30).stop 2021-11-03T17:38:01.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.442+0000 7fdc3b755700 1 -- 172.21.15.26:0/3180254340 shutdown_connections 2021-11-03T17:38:01.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.442+0000 7fdc3b755700 1 --2- 172.21.15.26:0/3180254340 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc340f5ef0 0x7fdc340f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:38:01.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.442+0000 7fdc3b755700 1 --2- 172.21.15.26:0/3180254340 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc340f55e0 0x7fdc340f5a00 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:01.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.442+0000 7fdc3b755700 1 -- 172.21.15.26:0/3180254340 >> 172.21.15.26:0/3180254340 conn(0x7fdc340f0de0 msgr2=0x7fdc340f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:38:01.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.442+0000 7fdc3b755700 1 -- 172.21.15.26:0/3180254340 shutdown_connections 2021-11-03T17:38:01.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.442+0000 7fdc3b755700 1 -- 172.21.15.26:0/3180254340 wait complete. 2021-11-03T17:38:01.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.442+0000 7fdc3b755700 1 Processor -- start 2021-11-03T17:38:01.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.442+0000 7fdc3b755700 1 -- start start 2021-11-03T17:38:01.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.442+0000 7fdc3b755700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc340f55e0 0x7fdc34109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:38:01.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.442+0000 7fdc3b755700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc340f5ef0 0x7fdc3410c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:38:01.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.442+0000 7fdc3b755700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc34060590 con 0x7fdc340f5ef0 2021-11-03T17:38:01.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.442+0000 7fdc3b755700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc340606d0 con 0x7fdc340f55e0 2021-11-03T17:38:01.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.443+0000 7fdc38cf0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc340f5ef0 0x7fdc3410c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:38:01.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.443+0000 7fdc38cf0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc340f5ef0 0x7fdc3410c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55488/0 (socket says 172.21.15.26:55488) 2021-11-03T17:38:01.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.443+0000 7fdc38cf0700 1 -- 172.21.15.26:0/4088321208 learned_addr learned my addr 172.21.15.26:0/4088321208 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:38:01.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.443+0000 7fdc394f1700 1 --2- 172.21.15.26:0/4088321208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc340f55e0 0x7fdc34109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:38:01.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.443+0000 7fdc38cf0700 1 -- 172.21.15.26:0/4088321208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc340f55e0 msgr2=0x7fdc34109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:38:01.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.443+0000 7fdc38cf0700 1 --2- 172.21.15.26:0/4088321208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc340f55e0 0x7fdc34109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:01.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.443+0000 7fdc38cf0700 1 -- 172.21.15.26:0/4088321208 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2c005040 con 0x7fdc340f5ef0 2021-11-03T17:38:01.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.443+0000 7fdc38cf0700 1 --2- 172.21.15.26:0/4088321208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc340f5ef0 0x7fdc3410c170 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7fdc2800b410 tx=0x7fdc28006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:38:01.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.443+0000 7fdc31ffb700 1 -- 172.21.15.26:0/4088321208 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc280125f0 con 0x7fdc340f5ef0 2021-11-03T17:38:01.444 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.443+0000 7fdc31ffb700 1 -- 172.21.15.26:0/4088321208 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdc28012c00 con 0x7fdc340f5ef0 2021-11-03T17:38:01.444 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.443+0000 7fdc3b755700 1 -- 172.21.15.26:0/4088321208 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc3410c7d0 con 0x7fdc340f5ef0 2021-11-03T17:38:01.444 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.443+0000 7fdc31ffb700 1 -- 172.21.15.26:0/4088321208 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc28002ae0 con 0x7fdc340f5ef0 2021-11-03T17:38:01.444 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.443+0000 7fdc3b755700 1 -- 172.21.15.26:0/4088321208 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc3410cd60 con 0x7fdc340f5ef0 2021-11-03T17:38:01.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.444+0000 7fdc3b755700 1 -- 172.21.15.26:0/4088321208 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc34045ad0 con 0x7fdc340f5ef0 2021-11-03T17:38:01.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.445+0000 7fdc31ffb700 1 -- 172.21.15.26:0/4088321208 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fdc2800f030 con 0x7fdc340f5ef0 2021-11-03T17:38:01.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.445+0000 7fdc31ffb700 1 --2- 172.21.15.26:0/4088321208 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdc1c0640b0 0x7fdc1c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:38:01.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.445+0000 7fdc31ffb700 1 -- 172.21.15.26:0/4088321208 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fdc28080c60 con 0x7fdc340f5ef0 2021-11-03T17:38:01.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.445+0000 7fdc394f1700 1 --2- 172.21.15.26:0/4088321208 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdc1c0640b0 0x7fdc1c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:38:01.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.446+0000 7fdc394f1700 1 --2- 172.21.15.26:0/4088321208 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdc1c0640b0 0x7fdc1c066570 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7fdc2c004e30 tx=0x7fdc2c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:38:01.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.449+0000 7fdc31ffb700 1 -- 172.21.15.26:0/4088321208 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fdc28052fc0 con 0x7fdc340f5ef0 2021-11-03T17:38:01.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.625+0000 7fdc3b755700 1 -- 172.21.15.26:0/4088321208 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdc340fdfc0 con 0x7fdc1c0640b0 2021-11-03T17:38:01.635 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.639+0000 7fdc31ffb700 1 -- 172.21.15.26:0/4088321208 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fdc340fdfc0 con 0x7fdc1c0640b0 2021-11-03T17:38:01.635 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:38:01.636 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (49m) 8m ago 50m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:38:01.636 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (41m) 8m ago 50m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:38:01.637 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (41m) 7m ago 49m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:38:01.637 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (49m) 8m ago 50m 40.3M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:38:01.638 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (42m) 8m ago 45m 22.6M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:38:01.638 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (42m) 8m ago 45m 23.5M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:38:01.638 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (45m) 7m ago 45m 24.8M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:38:01.639 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (45m) 7m ago 45m 25.0M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:38:01.639 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (42m) 8m ago 51m 520M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:38:01.640 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (42m) 7m ago 49m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:38:01.640 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (42m) 8m ago 51m 176M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:38:01.640 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (42m) 7m ago 49m 89.5M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:38:01.641 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (50m) 8m ago 50m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:38:01.641 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (49m) 7m ago 49m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:38:01.641 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (41m) 8m ago 48m 231M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:38:01.642 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (40m) 8m ago 48m 248M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:38:01.642 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (40m) 8m ago 48m 207M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:38:01.642 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (39m) 7m ago 47m 262M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:38:01.643 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (39m) 7m ago 47m 227M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:38:01.643 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (38m) 7m ago 47m 215M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:38:01.643 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (48m) 8m ago 49m 54.4M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:38:01.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.641+0000 7fdc3b755700 1 -- 172.21.15.26:0/4088321208 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdc1c0640b0 msgr2=0x7fdc1c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:38:01.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.641+0000 7fdc3b755700 1 --2- 172.21.15.26:0/4088321208 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdc1c0640b0 0x7fdc1c066570 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7fdc2c004e30 tx=0x7fdc2c009b30).stop 2021-11-03T17:38:01.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.641+0000 7fdc3b755700 1 -- 172.21.15.26:0/4088321208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc340f5ef0 msgr2=0x7fdc3410c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:38:01.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.641+0000 7fdc3b755700 1 --2- 172.21.15.26:0/4088321208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc340f5ef0 0x7fdc3410c170 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7fdc2800b410 tx=0x7fdc28006ef0).stop 2021-11-03T17:38:01.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.641+0000 7fdc3b755700 1 -- 172.21.15.26:0/4088321208 shutdown_connections 2021-11-03T17:38:01.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.641+0000 7fdc3b755700 1 --2- 172.21.15.26:0/4088321208 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdc1c0640b0 0x7fdc1c066570 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:01.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.641+0000 7fdc3b755700 1 --2- 172.21.15.26:0/4088321208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc340f55e0 0x7fdc34109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:01.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.642+0000 7fdc3b755700 1 --2- 172.21.15.26:0/4088321208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc340f5ef0 0x7fdc3410c170 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:01.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.642+0000 7fdc3b755700 1 -- 172.21.15.26:0/4088321208 >> 172.21.15.26:0/4088321208 conn(0x7fdc340f0de0 msgr2=0x7fdc340fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:38:01.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.642+0000 7fdc3b755700 1 -- 172.21.15.26:0/4088321208 shutdown_connections 2021-11-03T17:38:01.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.642+0000 7fdc3b755700 1 -- 172.21.15.26:0/4088321208 wait complete. 2021-11-03T17:38:01.735 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.740+0000 7f6486798700 1 -- 172.21.15.26:0/2585485212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64800f5340 msgr2=0x7f64800f7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:38:01.736 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.740+0000 7f6486798700 1 --2- 172.21.15.26:0/2585485212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64800f5340 0x7f64800f7ac0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f6474004660 tx=0x7f6474009b30).stop 2021-11-03T17:38:01.736 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.740+0000 7f6486798700 1 -- 172.21.15.26:0/2585485212 shutdown_connections 2021-11-03T17:38:01.736 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.740+0000 7f6486798700 1 --2- 172.21.15.26:0/2585485212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64800f5340 0x7f64800f7ac0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:01.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.740+0000 7f6486798700 1 --2- 172.21.15.26:0/2585485212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64800f49a0 0x7f64800f4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:01.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.740+0000 7f6486798700 1 -- 172.21.15.26:0/2585485212 >> 172.21.15.26:0/2585485212 conn(0x7f64800f04c0 msgr2=0x7f64800f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:38:01.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.740+0000 7f6486798700 1 -- 172.21.15.26:0/2585485212 shutdown_connections 2021-11-03T17:38:01.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.740+0000 7f6486798700 1 -- 172.21.15.26:0/2585485212 wait complete. 2021-11-03T17:38:01.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.741+0000 7f6486798700 1 Processor -- start 2021-11-03T17:38:01.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.741+0000 7f6486798700 1 -- start start 2021-11-03T17:38:01.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.741+0000 7f6486798700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64800f49a0 0x7f64800f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:38:01.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.741+0000 7f6486798700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64800f5340 0x7f64800f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:38:01.742 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.741+0000 7f6486798700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64800f5f30 con 0x7f64800f49a0 2021-11-03T17:38:01.742 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.741+0000 7f6486798700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64800f6070 con 0x7f64800f5340 2021-11-03T17:38:01.742 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.741+0000 7f647ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64800f49a0 0x7f64800f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:38:01.742 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.742+0000 7f647ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64800f49a0 0x7f64800f7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55496/0 (socket says 172.21.15.26:55496) 2021-11-03T17:38:01.743 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.742+0000 7f647ffff700 1 -- 172.21.15.26:0/761318464 learned_addr learned my addr 172.21.15.26:0/761318464 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:38:01.743 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.742+0000 7f647f7fe700 1 --2- 172.21.15.26:0/761318464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64800f5340 0x7f64800f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:38:01.743 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.742+0000 7f647ffff700 1 -- 172.21.15.26:0/761318464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64800f5340 msgr2=0x7f64800f59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:38:01.743 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.742+0000 7f647ffff700 1 --2- 172.21.15.26:0/761318464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64800f5340 0x7f64800f59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:01.744 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.742+0000 7f647ffff700 1 -- 172.21.15.26:0/761318464 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6474005040 con 0x7f64800f49a0 2021-11-03T17:38:01.744 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.742+0000 7f647ffff700 1 --2- 172.21.15.26:0/761318464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64800f49a0 0x7f64800f7550 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f6470002700 tx=0x7f6470009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:38:01.744 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.742+0000 7f647cff9700 1 -- 172.21.15.26:0/761318464 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6470009320 con 0x7f64800f49a0 2021-11-03T17:38:01.744 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.742+0000 7f6486798700 1 -- 172.21.15.26:0/761318464 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64800f6350 con 0x7f64800f49a0 2021-11-03T17:38:01.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.742+0000 7f647cff9700 1 -- 172.21.15.26:0/761318464 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f647000f040 con 0x7f64800f49a0 2021-11-03T17:38:01.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.742+0000 7f647cff9700 1 -- 172.21.15.26:0/761318464 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6470014900 con 0x7f64800f49a0 2021-11-03T17:38:01.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.742+0000 7f6486798700 1 -- 172.21.15.26:0/761318464 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f648010efd0 con 0x7f64800f49a0 2021-11-03T17:38:01.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.743+0000 7f6486798700 1 -- 172.21.15.26:0/761318464 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6480045ad0 con 0x7f64800f49a0 2021-11-03T17:38:01.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.743+0000 7f647cff9700 1 -- 172.21.15.26:0/761318464 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f6470009480 con 0x7f64800f49a0 2021-11-03T17:38:01.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.744+0000 7f647cff9700 1 --2- 172.21.15.26:0/761318464 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f64680640b0 0x7f6468066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:38:01.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.744+0000 7f647cff9700 1 -- 172.21.15.26:0/761318464 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f6470080a50 con 0x7f64800f49a0 2021-11-03T17:38:01.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.744+0000 7f647f7fe700 1 --2- 172.21.15.26:0/761318464 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f64680640b0 0x7f6468066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:38:01.747 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.744+0000 7f647f7fe700 1 --2- 172.21.15.26:0/761318464 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f64680640b0 0x7f6468066570 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f6474004630 tx=0x7f6474009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:38:01.747 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.748+0000 7f647cff9700 1 -- 172.21.15.26:0/761318464 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f6470052db0 con 0x7f64800f49a0 2021-11-03T17:38:01.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.979+0000 7f6486798700 1 -- 172.21.15.26:0/761318464 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6480027a00 con 0x7f64800f49a0 2021-11-03T17:38:01.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.980+0000 7f647cff9700 1 -- 172.21.15.26:0/761318464 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f64700529a0 con 0x7f64800f49a0 2021-11-03T17:38:01.975 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:38:01.976 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:38:01.976 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:38:01.976 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:38:01.976 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:38:01.976 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:38:01.977 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:38:01.977 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:38:01.977 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:38:01.977 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:38:01.978 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:38:01.978 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:38:01.978 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:38:01.978 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:38:01.978 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:38:01.979 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:38:01.979 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:38:01.979 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:38:01.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.982+0000 7f6486798700 1 -- 172.21.15.26:0/761318464 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f64680640b0 msgr2=0x7f6468066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:38:01.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.982+0000 7f6486798700 1 --2- 172.21.15.26:0/761318464 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f64680640b0 0x7f6468066570 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f6474004630 tx=0x7f6474009b30).stop 2021-11-03T17:38:01.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.982+0000 7f6486798700 1 -- 172.21.15.26:0/761318464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64800f49a0 msgr2=0x7f64800f7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:38:01.984 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.982+0000 7f6486798700 1 --2- 172.21.15.26:0/761318464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64800f49a0 0x7f64800f7550 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f6470002700 tx=0x7f6470009d80).stop 2021-11-03T17:38:01.984 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.982+0000 7f6486798700 1 -- 172.21.15.26:0/761318464 shutdown_connections 2021-11-03T17:38:01.984 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.982+0000 7f6486798700 1 --2- 172.21.15.26:0/761318464 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f64680640b0 0x7f6468066570 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:01.984 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.982+0000 7f6486798700 1 --2- 172.21.15.26:0/761318464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64800f49a0 0x7f64800f7550 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:01.984 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.982+0000 7f6486798700 1 --2- 172.21.15.26:0/761318464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64800f5340 0x7f64800f59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:01.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.982+0000 7f6486798700 1 -- 172.21.15.26:0/761318464 >> 172.21.15.26:0/761318464 conn(0x7f64800f04c0 msgr2=0x7f64800fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:38:01.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.982+0000 7f6486798700 1 -- 172.21.15.26:0/761318464 shutdown_connections 2021-11-03T17:38:01.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:01.982+0000 7f6486798700 1 -- 172.21.15.26:0/761318464 wait complete. 2021-11-03T17:38:02.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.082+0000 7f7f7dfc3700 1 -- 172.21.15.26:0/1632524258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f780f5ef0 msgr2=0x7f7f780f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:38:02.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.082+0000 7f7f7dfc3700 1 --2- 172.21.15.26:0/1632524258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f780f5ef0 0x7f7f780f6920 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f7f6c004660 tx=0x7f7f6c009b30).stop 2021-11-03T17:38:02.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.082+0000 7f7f7dfc3700 1 -- 172.21.15.26:0/1632524258 shutdown_connections 2021-11-03T17:38:02.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.082+0000 7f7f7dfc3700 1 --2- 172.21.15.26:0/1632524258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f780f5ef0 0x7f7f780f6920 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:02.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.082+0000 7f7f7dfc3700 1 --2- 172.21.15.26:0/1632524258 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f780f55e0 0x7f7f780f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:38:02.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.082+0000 7f7f7dfc3700 1 -- 172.21.15.26:0/1632524258 >> 172.21.15.26:0/1632524258 conn(0x7f7f780f0de0 msgr2=0x7f7f780f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:38:02.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.082+0000 7f7f7dfc3700 1 -- 172.21.15.26:0/1632524258 shutdown_connections 2021-11-03T17:38:02.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.082+0000 7f7f7dfc3700 1 -- 172.21.15.26:0/1632524258 wait complete. 2021-11-03T17:38:02.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.082+0000 7f7f7dfc3700 1 Processor -- start 2021-11-03T17:38:02.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.083+0000 7f7f7dfc3700 1 -- start start 2021-11-03T17:38:02.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.083+0000 7f7f7dfc3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f780f55e0 0x7f7f78106fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:38:02.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.083+0000 7f7f7dfc3700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f780f5ef0 0x7f7f78107490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:38:02.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.083+0000 7f7f7dfc3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f78107ad0 con 0x7f7f780f55e0 2021-11-03T17:38:02.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.083+0000 7f7f7dfc3700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f78108380 con 0x7f7f780f5ef0 2021-11-03T17:38:02.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.083+0000 7f7f777fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f780f55e0 0x7f7f78106fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:38:02.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.083+0000 7f7f777fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f780f55e0 0x7f7f78106fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55506/0 (socket says 172.21.15.26:55506) 2021-11-03T17:38:02.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.083+0000 7f7f777fe700 1 -- 172.21.15.26:0/1434648565 learned_addr learned my addr 172.21.15.26:0/1434648565 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:38:02.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.083+0000 7f7f76ffd700 1 --2- 172.21.15.26:0/1434648565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f780f5ef0 0x7f7f78107490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:38:02.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.083+0000 7f7f777fe700 1 -- 172.21.15.26:0/1434648565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f780f5ef0 msgr2=0x7f7f78107490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:38:02.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.083+0000 7f7f777fe700 1 --2- 172.21.15.26:0/1434648565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f780f5ef0 0x7f7f78107490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:02.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.083+0000 7f7f777fe700 1 -- 172.21.15.26:0/1434648565 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6c005040 con 0x7f7f780f55e0 2021-11-03T17:38:02.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.083+0000 7f7f777fe700 1 --2- 172.21.15.26:0/1434648565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f780f55e0 0x7f7f78106fa0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f7f6800b410 tx=0x7f7f68006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:38:02.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.084+0000 7f7f5ffff700 1 -- 172.21.15.26:0/1434648565 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f680125f0 con 0x7f7f780f55e0 2021-11-03T17:38:02.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.084+0000 7f7f5ffff700 1 -- 172.21.15.26:0/1434648565 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7f68012c00 con 0x7f7f780f55e0 2021-11-03T17:38:02.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.084+0000 7f7f7dfc3700 1 -- 172.21.15.26:0/1434648565 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f78108660 con 0x7f7f780f55e0 2021-11-03T17:38:02.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.084+0000 7f7f5ffff700 1 -- 172.21.15.26:0/1434648565 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f68002ae0 con 0x7f7f780f55e0 2021-11-03T17:38:02.085 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.084+0000 7f7f7dfc3700 1 -- 172.21.15.26:0/1434648565 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f78108c20 con 0x7f7f780f55e0 2021-11-03T17:38:02.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.084+0000 7f7f7dfc3700 1 -- 172.21.15.26:0/1434648565 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f780f4a70 con 0x7f7f780f55e0 2021-11-03T17:38:02.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.085+0000 7f7f5ffff700 1 -- 172.21.15.26:0/1434648565 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f7f6800f030 con 0x7f7f780f55e0 2021-11-03T17:38:02.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.085+0000 7f7f5ffff700 1 --2- 172.21.15.26:0/1434648565 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7f600640b0 0x7f7f60066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:38:02.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.085+0000 7f7f5ffff700 1 -- 172.21.15.26:0/1434648565 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f7f68080cb0 con 0x7f7f780f55e0 2021-11-03T17:38:02.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.085+0000 7f7f76ffd700 1 --2- 172.21.15.26:0/1434648565 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7f600640b0 0x7f7f60066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:38:02.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.086+0000 7f7f76ffd700 1 --2- 172.21.15.26:0/1434648565 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7f600640b0 0x7f7f60066570 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f7f6c004e30 tx=0x7f7f6c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:38:02.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.089+0000 7f7f5ffff700 1 -- 172.21.15.26:0/1434648565 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f7f68053010 con 0x7f7f780f55e0 2021-11-03T17:38:02.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.293+0000 7f7f7dfc3700 1 -- 172.21.15.26:0/1434648565 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7f7810d5c0 con 0x7f7f780f55e0 2021-11-03T17:38:02.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.293+0000 7f7f5ffff700 1 -- 172.21.15.26:0/1434648565 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f7f68052c00 con 0x7f7f780f55e0 2021-11-03T17:38:02.289 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:38:02.289 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:38:02.289 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:38:02.289 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:38:02.290 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:38:02.290 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:38:02.290 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:38:02.290 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:38:02.291 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:38:02.291 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:38:02.291 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:38:02.291 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:38:02.291 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:38:02.292 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:38:02.292 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:38:02.292 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:38:02.292 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:38:02.293 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:38:02.293 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:38:02.293 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:38:02.293 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:38:02.293 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:38:02.294 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:38:02.294 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:38:02.294 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:38:02.295 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:38:02.295 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:38:02.295 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:38:02.295 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:38:02.295 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:38:02.296 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:38:02.296 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:38:02.296 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:38:02.296 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:38:02.297 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:38:02.297 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:38:02.297 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:38:02.298 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:38:02.298 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:38:02.299 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.295+0000 7f7f7dfc3700 1 -- 172.21.15.26:0/1434648565 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7f600640b0 msgr2=0x7f7f60066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:38:02.299 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.295+0000 7f7f7dfc3700 1 --2- 172.21.15.26:0/1434648565 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7f600640b0 0x7f7f60066570 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f7f6c004e30 tx=0x7f7f6c009b30).stop 2021-11-03T17:38:02.299 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.295+0000 7f7f7dfc3700 1 -- 172.21.15.26:0/1434648565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f780f55e0 msgr2=0x7f7f78106fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:38:02.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.295+0000 7f7f7dfc3700 1 --2- 172.21.15.26:0/1434648565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f780f55e0 0x7f7f78106fa0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f7f6800b410 tx=0x7f7f68006ef0).stop 2021-11-03T17:38:02.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.295+0000 7f7f7dfc3700 1 -- 172.21.15.26:0/1434648565 shutdown_connections 2021-11-03T17:38:02.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.295+0000 7f7f7dfc3700 1 --2- 172.21.15.26:0/1434648565 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7f600640b0 0x7f7f60066570 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:02.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.295+0000 7f7f7dfc3700 1 --2- 172.21.15.26:0/1434648565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f780f55e0 0x7f7f78106fa0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:02.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.295+0000 7f7f7dfc3700 1 --2- 172.21.15.26:0/1434648565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f780f5ef0 0x7f7f78107490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:02.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.295+0000 7f7f7dfc3700 1 -- 172.21.15.26:0/1434648565 >> 172.21.15.26:0/1434648565 conn(0x7f7f780f0de0 msgr2=0x7f7f7805f740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:38:02.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.295+0000 7f7f7dfc3700 1 -- 172.21.15.26:0/1434648565 shutdown_connections 2021-11-03T17:38:02.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:02.295+0000 7f7f7dfc3700 1 -- 172.21.15.26:0/1434648565 wait complete. 2021-11-03T17:38:02.301 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:38:02.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:02 smithi026 ceph-mon[96795]: pgmap v1301: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:02.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:02 smithi026 ceph-mon[96795]: from='client.35484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:38:02.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:02 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/761318464' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:38:02.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:02 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1434648565' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:38:02.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:02 smithi194 ceph-mon[65619]: pgmap v1301: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:02.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:02 smithi194 ceph-mon[65619]: from='client.35484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:38:02.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:02 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/761318464' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:38:02.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:02 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1434648565' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:38:03.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:03 smithi194 ceph-mon[65619]: from='client.35488 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:38:03.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:03 smithi026 ceph-mon[96795]: from='client.35488 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:38:04.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:04 smithi026 ceph-mon[96795]: pgmap v1302: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:04.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:04 smithi194 ceph-mon[65619]: pgmap v1302: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:06.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:06 smithi026 ceph-mon[96795]: pgmap v1303: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:06.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:06 smithi194 ceph-mon[65619]: pgmap v1303: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:08.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:08 smithi026 ceph-mon[96795]: pgmap v1304: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:08.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:08 smithi194 ceph-mon[65619]: pgmap v1304: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:10.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:10 smithi026 ceph-mon[96795]: pgmap v1305: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:10.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:10 smithi194 ceph-mon[65619]: pgmap v1305: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:12.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:12 smithi026 ceph-mon[96795]: pgmap v1306: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:12.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:12 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:38:12.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:12 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:38:12.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:12 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:38:12.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:12 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:38:12.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:12 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:38:12.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:12 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:38:12.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:12 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:38:12.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:12 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:38:12.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:12 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:38:12.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:12 smithi194 ceph-mon[65619]: pgmap v1306: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:12.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:12 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:38:12.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:12 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:38:12.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:12 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:38:12.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:12 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:38:12.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:12 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:38:12.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:12 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:38:12.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:12 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:38:12.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:12 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:38:12.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:12 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:38:13.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:13 smithi194 ceph-mon[65619]: poll took 60067.900 ms: 1 events 2021-11-03T17:38:13.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:13 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:38:13.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:13 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:38:13.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:13 smithi026 ceph-mon[96795]: poll took 60067.900 ms: 1 events 2021-11-03T17:38:13.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:13 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:38:13.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:13 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:38:14.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:14 smithi026 ceph-mon[96795]: pgmap v1307: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:14.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:14 smithi194 ceph-mon[65619]: pgmap v1307: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:16.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:16 smithi026 ceph-mon[96795]: pgmap v1308: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:16.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:16 smithi194 ceph-mon[65619]: pgmap v1308: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:18.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:18 smithi026 ceph-mon[96795]: pgmap v1309: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:18.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:18 smithi194 ceph-mon[65619]: pgmap v1309: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:20.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:20 smithi026 ceph-mon[96795]: pgmap v1310: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:20.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:20 smithi194 ceph-mon[65619]: pgmap v1310: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:22.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:22 smithi026 ceph-mon[96795]: pgmap v1311: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:22.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:22 smithi194 ceph-mon[65619]: pgmap v1311: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:24.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:24 smithi026 ceph-mon[96795]: pgmap v1312: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:24.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:24 smithi194 ceph-mon[65619]: pgmap v1312: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:26.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:26 smithi026 ceph-mon[96795]: pgmap v1313: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:26.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:26 smithi194 ceph-mon[65619]: pgmap v1313: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:27.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:27 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:38:27.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:27 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:38:28.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:28 smithi026 ceph-mon[96795]: pgmap v1314: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:28.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:28 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:38:28.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:28 smithi194 ceph-mon[65619]: pgmap v1314: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:28.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:28 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:38:30.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:30 smithi026 ceph-mon[96795]: pgmap v1315: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:30.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:30 smithi194 ceph-mon[65619]: pgmap v1315: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:32.408 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.412+0000 7f8c87130700 1 -- 172.21.15.26:0/550174590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c800f5340 msgr2=0x7f8c800f7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:38:32.408 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.412+0000 7f8c87130700 1 --2- 172.21.15.26:0/550174590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c800f5340 0x7f8c800f7ac0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7f8c6c004660 tx=0x7f8c6c009b30).stop 2021-11-03T17:38:32.408 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.412+0000 7f8c87130700 1 -- 172.21.15.26:0/550174590 shutdown_connections 2021-11-03T17:38:32.409 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.412+0000 7f8c87130700 1 --2- 172.21.15.26:0/550174590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c800f5340 0x7f8c800f7ac0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:32.409 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.412+0000 7f8c87130700 1 --2- 172.21.15.26:0/550174590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c800f49a0 0x7f8c800f4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:32.409 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.412+0000 7f8c87130700 1 -- 172.21.15.26:0/550174590 >> 172.21.15.26:0/550174590 conn(0x7f8c800f04c0 msgr2=0x7f8c800f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:38:32.410 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.412+0000 7f8c87130700 1 -- 172.21.15.26:0/550174590 shutdown_connections 2021-11-03T17:38:32.410 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.412+0000 7f8c87130700 1 -- 172.21.15.26:0/550174590 wait complete. 2021-11-03T17:38:32.411 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.413+0000 7f8c87130700 1 Processor -- start 2021-11-03T17:38:32.411 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.413+0000 7f8c87130700 1 -- start start 2021-11-03T17:38:32.411 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.413+0000 7f8c87130700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c800f49a0 0x7f8c800f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:38:32.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.413+0000 7f8c87130700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c800f5340 0x7f8c800f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:38:32.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.413+0000 7f8c87130700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c800f5f30 con 0x7f8c800f49a0 2021-11-03T17:38:32.413 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.413+0000 7f8c87130700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c800f6070 con 0x7f8c800f5340 2021-11-03T17:38:32.413 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.413+0000 7f8c84ecc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c800f49a0 0x7f8c800f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:38:32.414 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.413+0000 7f8c84ecc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c800f49a0 0x7f8c800f7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55524/0 (socket says 172.21.15.26:55524) 2021-11-03T17:38:32.414 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.413+0000 7f8c84ecc700 1 -- 172.21.15.26:0/3324805590 learned_addr learned my addr 172.21.15.26:0/3324805590 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:38:32.414 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.413+0000 7f8c7ffff700 1 --2- 172.21.15.26:0/3324805590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c800f5340 0x7f8c800f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:38:32.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.413+0000 7f8c84ecc700 1 -- 172.21.15.26:0/3324805590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c800f5340 msgr2=0x7f8c800f59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:38:32.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.413+0000 7f8c84ecc700 1 --2- 172.21.15.26:0/3324805590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c800f5340 0x7f8c800f59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:32.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.414+0000 7f8c84ecc700 1 -- 172.21.15.26:0/3324805590 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c6c005040 con 0x7f8c800f49a0 2021-11-03T17:38:32.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.414+0000 7f8c84ecc700 1 --2- 172.21.15.26:0/3324805590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c800f49a0 0x7f8c800f7550 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7f8c74002700 tx=0x7f8c74009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:38:32.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.414+0000 7f8c7d7fa700 1 -- 172.21.15.26:0/3324805590 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c740079c0 con 0x7f8c800f49a0 2021-11-03T17:38:32.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.414+0000 7f8c87130700 1 -- 172.21.15.26:0/3324805590 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c800f6350 con 0x7f8c800f49a0 2021-11-03T17:38:32.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.414+0000 7f8c7d7fa700 1 -- 172.21.15.26:0/3324805590 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8c7400f040 con 0x7f8c800f49a0 2021-11-03T17:38:32.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.414+0000 7f8c7d7fa700 1 -- 172.21.15.26:0/3324805590 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c74014860 con 0x7f8c800f49a0 2021-11-03T17:38:32.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.414+0000 7f8c87130700 1 -- 172.21.15.26:0/3324805590 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c8010efd0 con 0x7f8c800f49a0 2021-11-03T17:38:32.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.415+0000 7f8c87130700 1 -- 172.21.15.26:0/3324805590 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c80045ad0 con 0x7f8c800f49a0 2021-11-03T17:38:32.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.415+0000 7f8c7d7fa700 1 -- 172.21.15.26:0/3324805590 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f8c7401b060 con 0x7f8c800f49a0 2021-11-03T17:38:32.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.416+0000 7f8c7d7fa700 1 --2- 172.21.15.26:0/3324805590 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8c70064090 0x7f8c70066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:38:32.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.416+0000 7f8c7d7fa700 1 -- 172.21.15.26:0/3324805590 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f8c74080670 con 0x7f8c800f49a0 2021-11-03T17:38:32.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.416+0000 7f8c7ffff700 1 --2- 172.21.15.26:0/3324805590 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8c70064090 0x7f8c70066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:38:32.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.416+0000 7f8c7ffff700 1 --2- 172.21.15.26:0/3324805590 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8c70064090 0x7f8c70066550 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f8c6c013690 tx=0x7f8c6c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:38:32.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.420+0000 7f8c7d7fa700 1 -- 172.21.15.26:0/3324805590 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f8c740529d0 con 0x7f8c800f49a0 2021-11-03T17:38:32.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.597+0000 7f8c87130700 1 -- 172.21.15.26:0/3324805590 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c800ff000 con 0x7f8c70064090 2021-11-03T17:38:32.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.599+0000 7f8c7d7fa700 1 -- 172.21.15.26:0/3324805590 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f8c800ff000 con 0x7f8c70064090 2021-11-03T17:38:32.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.601+0000 7f8c87130700 1 -- 172.21.15.26:0/3324805590 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8c70064090 msgr2=0x7f8c70066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:38:32.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.601+0000 7f8c87130700 1 --2- 172.21.15.26:0/3324805590 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8c70064090 0x7f8c70066550 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f8c6c013690 tx=0x7f8c6c009b30).stop 2021-11-03T17:38:32.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.601+0000 7f8c87130700 1 -- 172.21.15.26:0/3324805590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c800f49a0 msgr2=0x7f8c800f7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:38:32.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.601+0000 7f8c87130700 1 --2- 172.21.15.26:0/3324805590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c800f49a0 0x7f8c800f7550 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7f8c74002700 tx=0x7f8c74009d80).stop 2021-11-03T17:38:32.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.601+0000 7f8c87130700 1 -- 172.21.15.26:0/3324805590 shutdown_connections 2021-11-03T17:38:32.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.601+0000 7f8c87130700 1 --2- 172.21.15.26:0/3324805590 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8c70064090 0x7f8c70066550 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:32.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.601+0000 7f8c87130700 1 --2- 172.21.15.26:0/3324805590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c800f49a0 0x7f8c800f7550 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:32.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.601+0000 7f8c87130700 1 --2- 172.21.15.26:0/3324805590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c800f5340 0x7f8c800f59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:32.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.601+0000 7f8c87130700 1 -- 172.21.15.26:0/3324805590 >> 172.21.15.26:0/3324805590 conn(0x7f8c800f04c0 msgr2=0x7f8c800fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:38:32.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.601+0000 7f8c87130700 1 -- 172.21.15.26:0/3324805590 shutdown_connections 2021-11-03T17:38:32.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.601+0000 7f8c87130700 1 -- 172.21.15.26:0/3324805590 wait complete. 2021-11-03T17:38:32.604 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:38:32.700 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.701+0000 7f119fcfc700 1 -- 172.21.15.26:0/3272796470 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11980f6c30 msgr2=0x7f11980f7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:38:32.701 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.701+0000 7f119fcfc700 1 --2- 172.21.15.26:0/3272796470 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11980f6c30 0x7f11980f7050 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7f1194004690 tx=0x7f1194009b30).stop 2021-11-03T17:38:32.702 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.701+0000 7f119fcfc700 1 -- 172.21.15.26:0/3272796470 shutdown_connections 2021-11-03T17:38:32.702 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.701+0000 7f119fcfc700 1 --2- 172.21.15.26:0/3272796470 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11980f7540 0x7f11980fdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:32.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.701+0000 7f119fcfc700 1 --2- 172.21.15.26:0/3272796470 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11980f6c30 0x7f11980f7050 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:32.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.701+0000 7f119fcfc700 1 -- 172.21.15.26:0/3272796470 >> 172.21.15.26:0/3272796470 conn(0x7f11980f0540 msgr2=0x7f11980f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:38:32.704 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.702+0000 7f119fcfc700 1 -- 172.21.15.26:0/3272796470 shutdown_connections 2021-11-03T17:38:32.704 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.702+0000 7f119fcfc700 1 -- 172.21.15.26:0/3272796470 wait complete. 2021-11-03T17:38:32.705 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.702+0000 7f119fcfc700 1 Processor -- start 2021-11-03T17:38:32.705 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.702+0000 7f119fcfc700 1 -- start start 2021-11-03T17:38:32.705 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.702+0000 7f119fcfc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11980f6c30 0x7f11981090f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:38:32.706 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.702+0000 7f119fcfc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11980f7540 0x7f11981095e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:38:32.706 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.702+0000 7f119fcfc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1198109b90 con 0x7f11980f7540 2021-11-03T17:38:32.707 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.702+0000 7f119fcfc700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1198109cd0 con 0x7f11980f6c30 2021-11-03T17:38:32.708 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.702+0000 7f119d297700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11980f7540 0x7f11981095e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:38:32.708 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.702+0000 7f119d297700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11980f7540 0x7f11981095e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55536/0 (socket says 172.21.15.26:55536) 2021-11-03T17:38:32.708 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.702+0000 7f119d297700 1 -- 172.21.15.26:0/366567111 learned_addr learned my addr 172.21.15.26:0/366567111 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:38:32.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.702+0000 7f119da98700 1 --2- 172.21.15.26:0/366567111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11980f6c30 0x7f11981090f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:38:32.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.703+0000 7f119d297700 1 -- 172.21.15.26:0/366567111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11980f6c30 msgr2=0x7f11981090f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:38:32.710 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.703+0000 7f119d297700 1 --2- 172.21.15.26:0/366567111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11980f6c30 0x7f11981090f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:32.710 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.703+0000 7f119d297700 1 -- 172.21.15.26:0/366567111 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1194005040 con 0x7f11980f7540 2021-11-03T17:38:32.711 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.703+0000 7f119d297700 1 --2- 172.21.15.26:0/366567111 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11980f7540 0x7f11981095e0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7f118800c530 tx=0x7f1188007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:38:32.711 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.703+0000 7f118e7fc700 1 -- 172.21.15.26:0/366567111 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1188013630 con 0x7f11980f7540 2021-11-03T17:38:32.711 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.703+0000 7f119fcfc700 1 -- 172.21.15.26:0/366567111 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f119810a670 con 0x7f11980f7540 2021-11-03T17:38:32.712 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.703+0000 7f118e7fc700 1 -- 172.21.15.26:0/366567111 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1188013c40 con 0x7f11980f7540 2021-11-03T17:38:32.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.703+0000 7f118e7fc700 1 -- 172.21.15.26:0/366567111 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1188002b60 con 0x7f11980f7540 2021-11-03T17:38:32.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.703+0000 7f119fcfc700 1 -- 172.21.15.26:0/366567111 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f119810ac30 con 0x7f11980f7540 2021-11-03T17:38:32.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.704+0000 7f119fcfc700 1 -- 172.21.15.26:0/366567111 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1198045ad0 con 0x7f11980f7540 2021-11-03T17:38:32.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.704+0000 7f118e7fc700 1 -- 172.21.15.26:0/366567111 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f118801a060 con 0x7f11980f7540 2021-11-03T17:38:32.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.705+0000 7f118e7fc700 1 --2- 172.21.15.26:0/366567111 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f11840640b0 0x7f1184066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:38:32.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.705+0000 7f118e7fc700 1 -- 172.21.15.26:0/366567111 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f1188080a80 con 0x7f11980f7540 2021-11-03T17:38:32.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.705+0000 7f119da98700 1 --2- 172.21.15.26:0/366567111 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f11840640b0 0x7f1184066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:38:32.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.705+0000 7f119da98700 1 --2- 172.21.15.26:0/366567111 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f11840640b0 0x7f1184066570 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f1194000c00 tx=0x7f1194009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:38:32.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.709+0000 7f118e7fc700 1 -- 172.21.15.26:0/366567111 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f1188052cf0 con 0x7f11980f7540 2021-11-03T17:38:32.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.882+0000 7f119fcfc700 1 -- 172.21.15.26:0/366567111 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f119810ae50 con 0x7f11840640b0 2021-11-03T17:38:32.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.896+0000 7f118e7fc700 1 -- 172.21.15.26:0/366567111 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f119810ae50 con 0x7f11840640b0 2021-11-03T17:38:32.891 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:38:32.891 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (49m) 9m ago 51m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:38:32.891 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (42m) 9m ago 51m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:38:32.892 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (41m) 8m ago 50m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:38:32.892 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (49m) 9m ago 50m 40.3M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:38:32.892 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (42m) 9m ago 46m 22.6M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:38:32.893 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (43m) 9m ago 46m 23.5M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:38:32.893 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (46m) 8m ago 46m 24.8M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:38:32.893 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (46m) 8m ago 46m 25.0M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:38:32.893 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (43m) 9m ago 52m 520M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:38:32.894 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (43m) 8m ago 50m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:38:32.894 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (42m) 9m ago 52m 176M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:38:32.894 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (42m) 8m ago 50m 89.5M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:38:32.895 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (50m) 9m ago 50m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:38:32.895 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (50m) 8m ago 50m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:38:32.896 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (41m) 9m ago 49m 231M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:38:32.896 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (41m) 9m ago 49m 248M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:38:32.897 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (40m) 9m ago 48m 207M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:38:32.897 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (40m) 8m ago 48m 262M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:38:32.897 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (39m) 8m ago 48m 227M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:38:32.897 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (39m) 8m ago 47m 215M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:38:32.898 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (49m) 9m ago 50m 54.4M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:38:32.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.898+0000 7f119fcfc700 1 -- 172.21.15.26:0/366567111 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f11840640b0 msgr2=0x7f1184066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:38:32.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.898+0000 7f119fcfc700 1 --2- 172.21.15.26:0/366567111 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f11840640b0 0x7f1184066570 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f1194000c00 tx=0x7f1194009b30).stop 2021-11-03T17:38:32.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.898+0000 7f119fcfc700 1 -- 172.21.15.26:0/366567111 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11980f7540 msgr2=0x7f11981095e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:38:32.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.898+0000 7f119fcfc700 1 --2- 172.21.15.26:0/366567111 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11980f7540 0x7f11981095e0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7f118800c530 tx=0x7f1188007d70).stop 2021-11-03T17:38:32.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.898+0000 7f119fcfc700 1 -- 172.21.15.26:0/366567111 shutdown_connections 2021-11-03T17:38:32.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.898+0000 7f119fcfc700 1 --2- 172.21.15.26:0/366567111 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f11840640b0 0x7f1184066570 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:32.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.898+0000 7f119fcfc700 1 --2- 172.21.15.26:0/366567111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11980f6c30 0x7f11981090f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:32.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.898+0000 7f119fcfc700 1 --2- 172.21.15.26:0/366567111 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11980f7540 0x7f11981095e0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:32.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.898+0000 7f119fcfc700 1 -- 172.21.15.26:0/366567111 >> 172.21.15.26:0/366567111 conn(0x7f11980f0540 msgr2=0x7f11980f2930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:38:32.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.898+0000 7f119fcfc700 1 -- 172.21.15.26:0/366567111 shutdown_connections 2021-11-03T17:38:32.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.898+0000 7f119fcfc700 1 -- 172.21.15.26:0/366567111 wait complete. 2021-11-03T17:38:32.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:32 smithi026 ceph-mon[96795]: pgmap v1316: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:32.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.998+0000 7fd9b5205700 1 -- 172.21.15.26:0/3488624007 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9b00fba10 msgr2=0x7fd9b00fde00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:38:32.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.998+0000 7fd9b5205700 1 --2- 172.21.15.26:0/3488624007 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9b00fba10 0x7fd9b00fde00 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7fd9a0004660 tx=0x7fd9a0009b30).stop 2021-11-03T17:38:32.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.998+0000 7fd9b5205700 1 -- 172.21.15.26:0/3488624007 shutdown_connections 2021-11-03T17:38:32.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.998+0000 7fd9b5205700 1 --2- 172.21.15.26:0/3488624007 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9b00fba10 0x7fd9b00fde00 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:32.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.998+0000 7fd9b5205700 1 --2- 172.21.15.26:0/3488624007 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9b0060310 0x7fd9b00fb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:32.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.998+0000 7fd9b5205700 1 -- 172.21.15.26:0/3488624007 >> 172.21.15.26:0/3488624007 conn(0x7fd9b00f0ba0 msgr2=0x7fd9b00f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:38:32.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.998+0000 7fd9b5205700 1 -- 172.21.15.26:0/3488624007 shutdown_connections 2021-11-03T17:38:32.997 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.998+0000 7fd9b5205700 1 -- 172.21.15.26:0/3488624007 wait complete. 2021-11-03T17:38:32.997 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.999+0000 7fd9b5205700 1 Processor -- start 2021-11-03T17:38:32.997 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.999+0000 7fd9b5205700 1 -- start start 2021-11-03T17:38:32.997 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.999+0000 7fd9b5205700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9b0060310 0x7fd9b0108f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:38:32.998 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.999+0000 7fd9b5205700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9b00fba10 0x7fd9b0109460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:38:32.998 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.999+0000 7fd9b5205700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b0109a10 con 0x7fd9b00fba10 2021-11-03T17:38:32.998 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.999+0000 7fd9b5205700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b0109b50 con 0x7fd9b0060310 2021-11-03T17:38:32.998 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.999+0000 7fd9af7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9b00fba10 0x7fd9b0109460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:38:32.999 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.999+0000 7fd9af7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9b00fba10 0x7fd9b0109460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55546/0 (socket says 172.21.15.26:55546) 2021-11-03T17:38:32.999 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:32.999+0000 7fd9af7fe700 1 -- 172.21.15.26:0/1795401362 learned_addr learned my addr 172.21.15.26:0/1795401362 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:38:33.000 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.000+0000 7fd9af7fe700 1 -- 172.21.15.26:0/1795401362 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9b0060310 msgr2=0x7fd9b0108f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:38:33.000 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.000+0000 7fd9af7fe700 1 --2- 172.21.15.26:0/1795401362 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9b0060310 0x7fd9b0108f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:38:33.000 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.000+0000 7fd9af7fe700 1 -- 172.21.15.26:0/1795401362 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a0005040 con 0x7fd9b00fba10 2021-11-03T17:38:33.000 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.000+0000 7fd9af7fe700 1 --2- 172.21.15.26:0/1795401362 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9b00fba10 0x7fd9b0109460 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7fd9a0013a70 tx=0x7fd9a0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:38:33.001 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.000+0000 7fd9acff9700 1 -- 172.21.15.26:0/1795401362 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9a0018070 con 0x7fd9b00fba10 2021-11-03T17:38:33.001 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.000+0000 7fd9b5205700 1 -- 172.21.15.26:0/1795401362 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b010a490 con 0x7fd9b00fba10 2021-11-03T17:38:33.001 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.000+0000 7fd9acff9700 1 -- 172.21.15.26:0/1795401362 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd9a0007ba0 con 0x7fd9b00fba10 2021-11-03T17:38:33.001 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.000+0000 7fd9acff9700 1 -- 172.21.15.26:0/1795401362 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9a001c3c0 con 0x7fd9b00fba10 2021-11-03T17:38:33.002 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.000+0000 7fd9b5205700 1 -- 172.21.15.26:0/1795401362 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b010a9f0 con 0x7fd9b00fba10 2021-11-03T17:38:33.002 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.001+0000 7fd9b5205700 1 -- 172.21.15.26:0/1795401362 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b0045ad0 con 0x7fd9b00fba10 2021-11-03T17:38:33.003 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:32 smithi194 ceph-mon[65619]: pgmap v1316: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:33.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.001+0000 7fd9acff9700 1 -- 172.21.15.26:0/1795401362 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fd9a001d420 con 0x7fd9b00fba10 2021-11-03T17:38:33.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.002+0000 7fd9acff9700 1 --2- 172.21.15.26:0/1795401362 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd998064100 0x7fd9980665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:38:33.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.002+0000 7fd9acff9700 1 -- 172.21.15.26:0/1795401362 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fd9a0082590 con 0x7fd9b00fba10 2021-11-03T17:38:33.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.002+0000 7fd9affff700 1 --2- 172.21.15.26:0/1795401362 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd998064100 0x7fd9980665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:38:33.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.002+0000 7fd9affff700 1 --2- 172.21.15.26:0/1795401362 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd998064100 0x7fd9980665c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7fd9a4004a10 tx=0x7fd9a40099e0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:38:33.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.006+0000 7fd9acff9700 1 -- 172.21.15.26:0/1795401362 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fd9a00549b0 con 0x7fd9b00fba10 2021-11-03T17:38:33.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.238+0000 7fd9b5205700 1 -- 172.21.15.26:0/1795401362 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd9b010ac10 con 0x7fd9b00fba10 2021-11-03T17:38:33.233 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.238+0000 7fd9acff9700 1 -- 172.21.15.26:0/1795401362 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fd9a00545a0 con 0x7fd9b00fba10 2021-11-03T17:38:33.233 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:38:33.233 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:38:33.234 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:38:33.234 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:38:33.234 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:38:33.234 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:38:33.235 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:38:33.235 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:38:33.235 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:38:33.235 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:38:33.235 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:38:33.236 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:38:33.236 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:38:33.236 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:38:33.237 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:38:33.237 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:38:33.237 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:38:33.237 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:38:33.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.240+0000 7fd9b5205700 1 -- 172.21.15.26:0/1795401362 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd998064100 msgr2=0x7fd9980665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:38:33.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.240+0000 7fd9b5205700 1 --2- 172.21.15.26:0/1795401362 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd998064100 0x7fd9980665c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7fd9a4004a10 tx=0x7fd9a40099e0).stop 2021-11-03T17:38:33.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.240+0000 7fd9b5205700 1 -- 172.21.15.26:0/1795401362 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9b00fba10 msgr2=0x7fd9b0109460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:38:33.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.240+0000 7fd9b5205700 1 --2- 172.21.15.26:0/1795401362 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9b00fba10 0x7fd9b0109460 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7fd9a0013a70 tx=0x7fd9a0009b30).stop 2021-11-03T17:38:33.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.240+0000 7fd9b5205700 1 -- 172.21.15.26:0/1795401362 shutdown_connections 2021-11-03T17:38:33.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.240+0000 7fd9b5205700 1 --2- 172.21.15.26:0/1795401362 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd998064100 0x7fd9980665c0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:33.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.240+0000 7fd9b5205700 1 --2- 172.21.15.26:0/1795401362 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9b0060310 0x7fd9b0108f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:38:33.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.240+0000 7fd9b5205700 1 --2- 172.21.15.26:0/1795401362 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9b00fba10 0x7fd9b0109460 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:33.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.240+0000 7fd9b5205700 1 -- 172.21.15.26:0/1795401362 >> 172.21.15.26:0/1795401362 conn(0x7fd9b00f0ba0 msgr2=0x7fd9b00f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:38:33.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.240+0000 7fd9b5205700 1 -- 172.21.15.26:0/1795401362 shutdown_connections 2021-11-03T17:38:33.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.241+0000 7fd9b5205700 1 -- 172.21.15.26:0/1795401362 wait complete. 2021-11-03T17:38:33.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.341+0000 7f8b3fa8a700 1 -- 172.21.15.26:0/3329835130 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b380f66e0 msgr2=0x7f8b380f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:38:33.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.341+0000 7f8b3fa8a700 1 --2- 172.21.15.26:0/3329835130 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b380f66e0 0x7f8b380f6b00 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7f8b300099e0 tx=0x7f8b30004d10).stop 2021-11-03T17:38:33.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.341+0000 7f8b3fa8a700 1 -- 172.21.15.26:0/3329835130 shutdown_connections 2021-11-03T17:38:33.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.341+0000 7f8b3fa8a700 1 --2- 172.21.15.26:0/3329835130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b380f7980 0x7f8b380f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:33.338 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.341+0000 7f8b3fa8a700 1 --2- 172.21.15.26:0/3329835130 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b380f66e0 0x7f8b380f6b00 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:33.338 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.341+0000 7f8b3fa8a700 1 -- 172.21.15.26:0/3329835130 >> 172.21.15.26:0/3329835130 conn(0x7f8b380f1e40 msgr2=0x7f8b380f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:38:33.338 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.341+0000 7f8b3fa8a700 1 -- 172.21.15.26:0/3329835130 shutdown_connections 2021-11-03T17:38:33.338 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.341+0000 7f8b3fa8a700 1 -- 172.21.15.26:0/3329835130 wait complete. 2021-11-03T17:38:33.338 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.341+0000 7f8b3fa8a700 1 Processor -- start 2021-11-03T17:38:33.339 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.341+0000 7f8b3fa8a700 1 -- start start 2021-11-03T17:38:33.339 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.342+0000 7f8b3fa8a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b380f66e0 0x7f8b381070d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:38:33.339 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.342+0000 7f8b3fa8a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b380f7980 0x7f8b381075c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:38:33.339 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.342+0000 7f8b3fa8a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b38107b70 con 0x7f8b380f7980 2021-11-03T17:38:33.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.342+0000 7f8b3fa8a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b38107cb0 con 0x7f8b380f66e0 2021-11-03T17:38:33.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.342+0000 7f8b3d025700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b380f7980 0x7f8b381075c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:38:33.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.342+0000 7f8b3d025700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b380f7980 0x7f8b381075c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55556/0 (socket says 172.21.15.26:55556) 2021-11-03T17:38:33.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.342+0000 7f8b3d025700 1 -- 172.21.15.26:0/1988377707 learned_addr learned my addr 172.21.15.26:0/1988377707 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:38:33.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.342+0000 7f8b3d826700 1 --2- 172.21.15.26:0/1988377707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b380f66e0 0x7f8b381070d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:38:33.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.342+0000 7f8b3d025700 1 -- 172.21.15.26:0/1988377707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b380f66e0 msgr2=0x7f8b381070d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:38:33.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.342+0000 7f8b3d025700 1 --2- 172.21.15.26:0/1988377707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b380f66e0 0x7f8b381070d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:33.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.342+0000 7f8b3d025700 1 -- 172.21.15.26:0/1988377707 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b30009640 con 0x7f8b380f7980 2021-11-03T17:38:33.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.342+0000 7f8b3d025700 1 --2- 172.21.15.26:0/1988377707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b380f7980 0x7f8b381075c0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f8b2c0026d0 tx=0x7f8b2c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:38:33.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.342+0000 7f8b367fc700 1 -- 172.21.15.26:0/1988377707 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b2c0079c0 con 0x7f8b380f7980 2021-11-03T17:38:33.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.342+0000 7f8b367fc700 1 -- 172.21.15.26:0/1988377707 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8b2c00f040 con 0x7f8b380f7980 2021-11-03T17:38:33.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.342+0000 7f8b3fa8a700 1 -- 172.21.15.26:0/1988377707 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b38108650 con 0x7f8b380f7980 2021-11-03T17:38:33.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.342+0000 7f8b367fc700 1 -- 172.21.15.26:0/1988377707 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b2c0148b0 con 0x7f8b380f7980 2021-11-03T17:38:33.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.342+0000 7f8b3fa8a700 1 -- 172.21.15.26:0/1988377707 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b38108b90 con 0x7f8b380f7980 2021-11-03T17:38:33.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.343+0000 7f8b3fa8a700 1 -- 172.21.15.26:0/1988377707 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b38045ad0 con 0x7f8b380f7980 2021-11-03T17:38:33.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.344+0000 7f8b367fc700 1 -- 172.21.15.26:0/1988377707 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f8b2c014a10 con 0x7f8b380f7980 2021-11-03T17:38:33.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.344+0000 7f8b367fc700 1 --2- 172.21.15.26:0/1988377707 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8b200640b0 0x7f8b20066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:38:33.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.344+0000 7f8b367fc700 1 -- 172.21.15.26:0/1988377707 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f8b2c080680 con 0x7f8b380f7980 2021-11-03T17:38:33.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.344+0000 7f8b3d826700 1 --2- 172.21.15.26:0/1988377707 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8b200640b0 0x7f8b20066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:38:33.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.345+0000 7f8b3d826700 1 --2- 172.21.15.26:0/1988377707 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8b200640b0 0x7f8b20066570 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f8b3000b730 tx=0x7f8b30004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:38:33.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.348+0000 7f8b367fc700 1 -- 172.21.15.26:0/1988377707 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f8b2c052b30 con 0x7f8b380f7980 2021-11-03T17:38:33.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.552+0000 7f8b3fa8a700 1 -- 172.21.15.26:0/1988377707 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8b38027a00 con 0x7f8b380f7980 2021-11-03T17:38:33.548 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.553+0000 7f8b367fc700 1 -- 172.21.15.26:0/1988377707 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f8b2c052720 con 0x7f8b380f7980 2021-11-03T17:38:33.549 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:38:33.549 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:38:33.550 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:38:33.550 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:38:33.550 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:38:33.550 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:38:33.551 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:38:33.551 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:38:33.551 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:38:33.551 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:38:33.551 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:38:33.552 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:38:33.552 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:38:33.553 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:38:33.553 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:38:33.553 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:38:33.553 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:38:33.554 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:38:33.554 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:38:33.554 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:38:33.554 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:38:33.555 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:38:33.555 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:38:33.555 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:38:33.556 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:38:33.556 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:38:33.556 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:38:33.556 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:38:33.556 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:38:33.557 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:38:33.557 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:38:33.557 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:38:33.557 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:38:33.558 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:38:33.558 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:38:33.558 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:38:33.558 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:38:33.559 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:38:33.559 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:38:33.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.555+0000 7f8b3fa8a700 1 -- 172.21.15.26:0/1988377707 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8b200640b0 msgr2=0x7f8b20066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:38:33.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.555+0000 7f8b3fa8a700 1 --2- 172.21.15.26:0/1988377707 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8b200640b0 0x7f8b20066570 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f8b3000b730 tx=0x7f8b30004d10).stop 2021-11-03T17:38:33.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.555+0000 7f8b3fa8a700 1 -- 172.21.15.26:0/1988377707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b380f7980 msgr2=0x7f8b381075c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:38:33.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.555+0000 7f8b3fa8a700 1 --2- 172.21.15.26:0/1988377707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b380f7980 0x7f8b381075c0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f8b2c0026d0 tx=0x7f8b2c009de0).stop 2021-11-03T17:38:33.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.555+0000 7f8b3fa8a700 1 -- 172.21.15.26:0/1988377707 shutdown_connections 2021-11-03T17:38:33.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.555+0000 7f8b3fa8a700 1 --2- 172.21.15.26:0/1988377707 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8b200640b0 0x7f8b20066570 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:33.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.555+0000 7f8b3fa8a700 1 --2- 172.21.15.26:0/1988377707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b380f66e0 0x7f8b381070d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:33.562 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.555+0000 7f8b3fa8a700 1 --2- 172.21.15.26:0/1988377707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b380f7980 0x7f8b381075c0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:38:33.562 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.555+0000 7f8b3fa8a700 1 -- 172.21.15.26:0/1988377707 >> 172.21.15.26:0/1988377707 conn(0x7f8b380f1e40 msgr2=0x7f8b380fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:38:33.562 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.555+0000 7f8b3fa8a700 1 -- 172.21.15.26:0/1988377707 shutdown_connections 2021-11-03T17:38:33.562 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:38:33.555+0000 7f8b3fa8a700 1 -- 172.21.15.26:0/1988377707 wait complete. 2021-11-03T17:38:33.563 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:38:33.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:33 smithi194 ceph-mon[65619]: from='client.35500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:38:33.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:33 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1795401362' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:38:33.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:33 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1988377707' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:38:33.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:33 smithi026 ceph-mon[96795]: from='client.35500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:38:34.121 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:33 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1795401362' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:38:34.122 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:33 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1988377707' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:38:34.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:34 smithi026 ceph-mon[96795]: from='client.35504 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:38:34.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:34 smithi026 ceph-mon[96795]: pgmap v1317: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:34.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:34 smithi194 ceph-mon[65619]: from='client.35504 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:38:34.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:34 smithi194 ceph-mon[65619]: pgmap v1317: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:36.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:36 smithi026 ceph-mon[96795]: pgmap v1318: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:36.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:36 smithi194 ceph-mon[65619]: pgmap v1318: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:38.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:38 smithi026 ceph-mon[96795]: pgmap v1319: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:38.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:38 smithi194 ceph-mon[65619]: pgmap v1319: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:40.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:40 smithi026 ceph-mon[96795]: pgmap v1320: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:40.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:40 smithi194 ceph-mon[65619]: pgmap v1320: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:42.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:42 smithi026 ceph-mon[96795]: pgmap v1321: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:42.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:38:42.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:42 smithi194 ceph-mon[65619]: pgmap v1321: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:42.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:38:43.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:43 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:38:43.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:43 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:38:44.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:44 smithi026 ceph-mon[96795]: pgmap v1322: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:44.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:44 smithi194 ceph-mon[65619]: pgmap v1322: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:46.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:46 smithi026 ceph-mon[96795]: pgmap v1323: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:46.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:46 smithi194 ceph-mon[65619]: pgmap v1323: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:48.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:48 smithi026 ceph-mon[96795]: pgmap v1324: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:48.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:38:48.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:38:48.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:48 smithi194 ceph-mon[65619]: pgmap v1324: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:48.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:38:48.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:38:50.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:50 smithi026 ceph-mon[96795]: pgmap v1325: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:50.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:50 smithi194 ceph-mon[65619]: pgmap v1325: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:51.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:51 smithi026 ceph-mon[96795]: pgmap v1326: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:51.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:51 smithi194 ceph-mon[65619]: pgmap v1326: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:54.420 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:54 smithi026 ceph-mon[96795]: pgmap v1327: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:54.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:54 smithi194 ceph-mon[65619]: pgmap v1327: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:56.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:56 smithi026 ceph-mon[96795]: pgmap v1328: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:56.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:56 smithi194 ceph-mon[65619]: pgmap v1328: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:58.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:58 smithi026 ceph-mon[96795]: pgmap v1329: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:58.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:58 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:38:58.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:38:58 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:38:58.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:58 smithi194 ceph-mon[65619]: pgmap v1329: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:38:58.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:58 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:38:58.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:38:58 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:39:00.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:00 smithi026 ceph-mon[96795]: pgmap v1330: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:00.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:00 smithi194 ceph-mon[65619]: pgmap v1330: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:02.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:02 smithi026 ceph-mon[96795]: pgmap v1331: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:02.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:02 smithi194 ceph-mon[65619]: pgmap v1331: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:03.665 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.669+0000 7f1e07f34700 1 -- 172.21.15.26:0/1818565069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e000f55e0 msgr2=0x7f1e000f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:39:03.666 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.669+0000 7f1e07f34700 1 --2- 172.21.15.26:0/1818565069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e000f55e0 0x7f1e000f5a00 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f1df80099e0 tx=0x7f1df8004d10).stop 2021-11-03T17:39:03.666 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.669+0000 7f1e07f34700 1 -- 172.21.15.26:0/1818565069 shutdown_connections 2021-11-03T17:39:03.666 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.669+0000 7f1e07f34700 1 --2- 172.21.15.26:0/1818565069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e000f5ef0 0x7f1e000f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:03.667 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.669+0000 7f1e07f34700 1 --2- 172.21.15.26:0/1818565069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e000f55e0 0x7f1e000f5a00 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:03.667 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.669+0000 7f1e07f34700 1 -- 172.21.15.26:0/1818565069 >> 172.21.15.26:0/1818565069 conn(0x7f1e000f0de0 msgr2=0x7f1e000f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:39:03.667 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.669+0000 7f1e07f34700 1 -- 172.21.15.26:0/1818565069 shutdown_connections 2021-11-03T17:39:03.667 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.669+0000 7f1e07f34700 1 -- 172.21.15.26:0/1818565069 wait complete. 2021-11-03T17:39:03.668 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.670+0000 7f1e07f34700 1 Processor -- start 2021-11-03T17:39:03.668 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.670+0000 7f1e07f34700 1 -- start start 2021-11-03T17:39:03.668 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.670+0000 7f1e07f34700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e000f55e0 0x7f1e000fd800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:39:03.668 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.670+0000 7f1e07f34700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e000f5ef0 0x7f1e000fbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:39:03.668 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.670+0000 7f1e07f34700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e000fc1e0 con 0x7f1e000f5ef0 2021-11-03T17:39:03.669 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.670+0000 7f1e07f34700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e000fc320 con 0x7f1e000f55e0 2021-11-03T17:39:03.669 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.670+0000 7f1e054cf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e000f5ef0 0x7f1e000fbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:39:03.669 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.670+0000 7f1e054cf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e000f5ef0 0x7f1e000fbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55578/0 (socket says 172.21.15.26:55578) 2021-11-03T17:39:03.669 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.670+0000 7f1e054cf700 1 -- 172.21.15.26:0/822845283 learned_addr learned my addr 172.21.15.26:0/822845283 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:39:03.670 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.670+0000 7f1e05cd0700 1 --2- 172.21.15.26:0/822845283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e000f55e0 0x7f1e000fd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:39:03.670 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.670+0000 7f1e054cf700 1 -- 172.21.15.26:0/822845283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e000f55e0 msgr2=0x7f1e000fd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:39:03.670 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.670+0000 7f1e054cf700 1 --2- 172.21.15.26:0/822845283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e000f55e0 0x7f1e000fd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:03.670 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.670+0000 7f1e054cf700 1 -- 172.21.15.26:0/822845283 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df8009640 con 0x7f1e000f5ef0 2021-11-03T17:39:03.670 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.671+0000 7f1e054cf700 1 --2- 172.21.15.26:0/822845283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e000f5ef0 0x7f1e000fbc80 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f1df40026d0 tx=0x7f1df4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:39:03.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.671+0000 7f1dfe7fc700 1 -- 172.21.15.26:0/822845283 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1df40079c0 con 0x7f1e000f5ef0 2021-11-03T17:39:03.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.671+0000 7f1dfe7fc700 1 -- 172.21.15.26:0/822845283 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1df400f040 con 0x7f1e000f5ef0 2021-11-03T17:39:03.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.671+0000 7f1e07f34700 1 -- 172.21.15.26:0/822845283 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e000fc600 con 0x7f1e000f5ef0 2021-11-03T17:39:03.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.671+0000 7f1dfe7fc700 1 -- 172.21.15.26:0/822845283 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1df40148b0 con 0x7f1e000f5ef0 2021-11-03T17:39:03.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.671+0000 7f1e07f34700 1 -- 172.21.15.26:0/822845283 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e0010f0a0 con 0x7f1e000f5ef0 2021-11-03T17:39:03.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.672+0000 7f1e07f34700 1 -- 172.21.15.26:0/822845283 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e00045ad0 con 0x7f1e000f5ef0 2021-11-03T17:39:03.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.672+0000 7f1dfe7fc700 1 -- 172.21.15.26:0/822845283 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f1df4007b20 con 0x7f1e000f5ef0 2021-11-03T17:39:03.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.673+0000 7f1dfe7fc700 1 --2- 172.21.15.26:0/822845283 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1de80640b0 0x7f1de8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:39:03.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.673+0000 7f1dfe7fc700 1 -- 172.21.15.26:0/822845283 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f1df4080720 con 0x7f1e000f5ef0 2021-11-03T17:39:03.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.673+0000 7f1e05cd0700 1 --2- 172.21.15.26:0/822845283 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1de80640b0 0x7f1de8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:39:03.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.673+0000 7f1e05cd0700 1 --2- 172.21.15.26:0/822845283 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1de80640b0 0x7f1de8066570 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f1df800b730 tx=0x7f1df8004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:39:03.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.677+0000 7f1dfe7fc700 1 -- 172.21.15.26:0/822845283 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f1df40529c0 con 0x7f1e000f5ef0 2021-11-03T17:39:03.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.853+0000 7f1e07f34700 1 -- 172.21.15.26:0/822845283 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e00057f10 con 0x7f1de80640b0 2021-11-03T17:39:03.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.855+0000 7f1dfe7fc700 1 -- 172.21.15.26:0/822845283 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f1e00057f10 con 0x7f1de80640b0 2021-11-03T17:39:03.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.856+0000 7f1e07f34700 1 -- 172.21.15.26:0/822845283 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1de80640b0 msgr2=0x7f1de8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:39:03.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.856+0000 7f1e07f34700 1 --2- 172.21.15.26:0/822845283 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1de80640b0 0x7f1de8066570 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f1df800b730 tx=0x7f1df8004d10).stop 2021-11-03T17:39:03.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.856+0000 7f1e07f34700 1 -- 172.21.15.26:0/822845283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e000f5ef0 msgr2=0x7f1e000fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:39:03.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.856+0000 7f1e07f34700 1 --2- 172.21.15.26:0/822845283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e000f5ef0 0x7f1e000fbc80 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f1df40026d0 tx=0x7f1df4009de0).stop 2021-11-03T17:39:03.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.856+0000 7f1e07f34700 1 -- 172.21.15.26:0/822845283 shutdown_connections 2021-11-03T17:39:03.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.856+0000 7f1e07f34700 1 --2- 172.21.15.26:0/822845283 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1de80640b0 0x7f1de8066570 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:03.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.856+0000 7f1e07f34700 1 --2- 172.21.15.26:0/822845283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e000f55e0 0x7f1e000fd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:03.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.856+0000 7f1e07f34700 1 --2- 172.21.15.26:0/822845283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e000f5ef0 0x7f1e000fbc80 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:03.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.856+0000 7f1e07f34700 1 -- 172.21.15.26:0/822845283 >> 172.21.15.26:0/822845283 conn(0x7f1e000f0de0 msgr2=0x7f1e000fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:39:03.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.856+0000 7f1e07f34700 1 -- 172.21.15.26:0/822845283 shutdown_connections 2021-11-03T17:39:03.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.857+0000 7f1e07f34700 1 -- 172.21.15.26:0/822845283 wait complete. 2021-11-03T17:39:03.861 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:39:03.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.956+0000 7f0ba9006700 1 -- 172.21.15.26:0/3188363868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ba406b920 msgr2=0x7f0ba4069ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:39:03.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.956+0000 7f0ba9006700 1 --2- 172.21.15.26:0/3188363868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ba406b920 0x7f0ba4069ec0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7f0b94004660 tx=0x7f0b94009b30).stop 2021-11-03T17:39:03.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.956+0000 7f0ba9006700 1 -- 172.21.15.26:0/3188363868 shutdown_connections 2021-11-03T17:39:03.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.956+0000 7f0ba9006700 1 --2- 172.21.15.26:0/3188363868 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ba406a3b0 0x7f0ba406a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:03.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.956+0000 7f0ba9006700 1 --2- 172.21.15.26:0/3188363868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ba406b920 0x7f0ba4069ec0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:03.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.956+0000 7f0ba9006700 1 -- 172.21.15.26:0/3188363868 >> 172.21.15.26:0/3188363868 conn(0x7f0ba40f1f00 msgr2=0x7f0ba40f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:39:03.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.956+0000 7f0ba9006700 1 -- 172.21.15.26:0/3188363868 shutdown_connections 2021-11-03T17:39:03.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.957+0000 7f0ba9006700 1 -- 172.21.15.26:0/3188363868 wait complete. 2021-11-03T17:39:03.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.957+0000 7f0ba9006700 1 Processor -- start 2021-11-03T17:39:03.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.957+0000 7f0ba9006700 1 -- start start 2021-11-03T17:39:03.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.957+0000 7f0ba9006700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ba406a3b0 0x7f0ba410d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:39:03.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.957+0000 7f0ba9006700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ba406b920 0x7f0ba410dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:39:03.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.957+0000 7f0ba9006700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba410e070 con 0x7f0ba406b920 2021-11-03T17:39:03.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.957+0000 7f0ba9006700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba410e1b0 con 0x7f0ba406a3b0 2021-11-03T17:39:03.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.957+0000 7f0ba259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ba406b920 0x7f0ba410dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:39:03.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.957+0000 7f0ba259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ba406b920 0x7f0ba410dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55588/0 (socket says 172.21.15.26:55588) 2021-11-03T17:39:03.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.957+0000 7f0ba259c700 1 -- 172.21.15.26:0/1048673023 learned_addr learned my addr 172.21.15.26:0/1048673023 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:39:03.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.958+0000 7f0ba2d9d700 1 --2- 172.21.15.26:0/1048673023 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ba406a3b0 0x7f0ba410d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:39:03.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.958+0000 7f0ba259c700 1 -- 172.21.15.26:0/1048673023 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ba406a3b0 msgr2=0x7f0ba410d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:39:03.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.958+0000 7f0ba259c700 1 --2- 172.21.15.26:0/1048673023 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ba406a3b0 0x7f0ba410d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:03.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.958+0000 7f0ba259c700 1 -- 172.21.15.26:0/1048673023 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b94005040 con 0x7f0ba406b920 2021-11-03T17:39:03.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.958+0000 7f0ba259c700 1 --2- 172.21.15.26:0/1048673023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ba406b920 0x7f0ba410dac0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f0b980026d0 tx=0x7f0b98009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:39:03.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.958+0000 7f0b8b7fe700 1 -- 172.21.15.26:0/1048673023 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b98009320 con 0x7f0ba406b920 2021-11-03T17:39:03.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.958+0000 7f0ba9006700 1 -- 172.21.15.26:0/1048673023 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ba410eb50 con 0x7f0ba406b920 2021-11-03T17:39:03.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.958+0000 7f0b8b7fe700 1 -- 172.21.15.26:0/1048673023 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0b9800f040 con 0x7f0ba406b920 2021-11-03T17:39:03.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.958+0000 7f0b8b7fe700 1 -- 172.21.15.26:0/1048673023 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b980147e0 con 0x7f0ba406b920 2021-11-03T17:39:03.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.958+0000 7f0ba9006700 1 -- 172.21.15.26:0/1048673023 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba410f110 con 0x7f0ba406b920 2021-11-03T17:39:03.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.959+0000 7f0ba9006700 1 -- 172.21.15.26:0/1048673023 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ba4045ad0 con 0x7f0ba406b920 2021-11-03T17:39:03.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.959+0000 7f0b8b7fe700 1 -- 172.21.15.26:0/1048673023 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f0b98009480 con 0x7f0ba406b920 2021-11-03T17:39:03.961 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.960+0000 7f0b8b7fe700 1 --2- 172.21.15.26:0/1048673023 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0b8c0640b0 0x7f0b8c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:39:03.961 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.960+0000 7f0b8b7fe700 1 -- 172.21.15.26:0/1048673023 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f0b98080eb0 con 0x7f0ba406b920 2021-11-03T17:39:03.961 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.960+0000 7f0ba2d9d700 1 --2- 172.21.15.26:0/1048673023 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0b8c0640b0 0x7f0b8c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:39:03.961 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.960+0000 7f0ba2d9d700 1 --2- 172.21.15.26:0/1048673023 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0b8c0640b0 0x7f0b8c066570 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f0b94004630 tx=0x7f0b94009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:39:03.962 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:03.964+0000 7f0b8b7fe700 1 -- 172.21.15.26:0/1048673023 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f0b98053210 con 0x7f0ba406b920 2021-11-03T17:39:04.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.139+0000 7f0ba9006700 1 -- 172.21.15.26:0/1048673023 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ba4105680 con 0x7f0b8c0640b0 2021-11-03T17:39:04.149 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.153+0000 7f0b8b7fe700 1 -- 172.21.15.26:0/1048673023 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f0b94019040 con 0x7f0b8c0640b0 2021-11-03T17:39:04.150 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:39:04.151 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (50m) 9m ago 51m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:39:04.151 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (42m) 9m ago 51m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:39:04.152 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (42m) 8m ago 50m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:39:04.152 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (50m) 9m ago 51m 40.3M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:39:04.152 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (43m) 9m ago 46m 22.6M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:39:04.153 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (43m) 9m ago 46m 23.5M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:39:04.153 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (46m) 8m ago 46m 24.8M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:39:04.153 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (46m) 8m ago 46m 25.0M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:39:04.154 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (44m) 9m ago 52m 520M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:39:04.154 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (43m) 8m ago 50m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:39:04.154 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (43m) 9m ago 53m 176M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:39:04.154 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (43m) 8m ago 50m 89.5M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:39:04.155 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (51m) 9m ago 51m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:39:04.155 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (50m) 8m ago 50m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:39:04.155 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (42m) 9m ago 49m 231M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:39:04.155 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (41m) 9m ago 49m 248M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:39:04.155 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (41m) 9m ago 49m 207M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:39:04.156 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (40m) 8m ago 48m 262M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:39:04.156 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (40m) 8m ago 48m 227M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:39:04.156 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (39m) 8m ago 48m 215M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:39:04.157 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (50m) 9m ago 50m 54.4M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:39:04.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.155+0000 7f0ba9006700 1 -- 172.21.15.26:0/1048673023 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0b8c0640b0 msgr2=0x7f0b8c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:39:04.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.155+0000 7f0ba9006700 1 --2- 172.21.15.26:0/1048673023 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0b8c0640b0 0x7f0b8c066570 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f0b94004630 tx=0x7f0b94009b30).stop 2021-11-03T17:39:04.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.155+0000 7f0ba9006700 1 -- 172.21.15.26:0/1048673023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ba406b920 msgr2=0x7f0ba410dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:39:04.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.155+0000 7f0ba9006700 1 --2- 172.21.15.26:0/1048673023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ba406b920 0x7f0ba410dac0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f0b980026d0 tx=0x7f0b98009de0).stop 2021-11-03T17:39:04.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.155+0000 7f0ba9006700 1 -- 172.21.15.26:0/1048673023 shutdown_connections 2021-11-03T17:39:04.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.155+0000 7f0ba9006700 1 --2- 172.21.15.26:0/1048673023 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0b8c0640b0 0x7f0b8c066570 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:04.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.155+0000 7f0ba9006700 1 --2- 172.21.15.26:0/1048673023 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ba406a3b0 0x7f0ba410d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:04.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.155+0000 7f0ba9006700 1 --2- 172.21.15.26:0/1048673023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ba406b920 0x7f0ba410dac0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:04.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.155+0000 7f0ba9006700 1 -- 172.21.15.26:0/1048673023 >> 172.21.15.26:0/1048673023 conn(0x7f0ba40f1f00 msgr2=0x7f0ba40f8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:39:04.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.156+0000 7f0ba9006700 1 -- 172.21.15.26:0/1048673023 shutdown_connections 2021-11-03T17:39:04.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.156+0000 7f0ba9006700 1 -- 172.21.15.26:0/1048673023 wait complete. 2021-11-03T17:39:04.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.255+0000 7f553b59e700 1 -- 172.21.15.26:0/2758827484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f553c0f66e0 msgr2=0x7f553c0f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:39:04.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.255+0000 7f553b59e700 1 --2- 172.21.15.26:0/2758827484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f553c0f66e0 0x7f553c0f6b40 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f5524004660 tx=0x7f5524009b30).stop 2021-11-03T17:39:04.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.255+0000 7f553b59e700 1 -- 172.21.15.26:0/2758827484 shutdown_connections 2021-11-03T17:39:04.253 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.255+0000 7f553b59e700 1 --2- 172.21.15.26:0/2758827484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f553c0f66e0 0x7f553c0f6b40 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:04.253 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.255+0000 7f553b59e700 1 --2- 172.21.15.26:0/2758827484 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f553c0f5440 0x7f553c0f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:04.253 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.255+0000 7f553b59e700 1 -- 172.21.15.26:0/2758827484 >> 172.21.15.26:0/2758827484 conn(0x7f553c0f0ba0 msgr2=0x7f553c0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:39:04.253 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.255+0000 7f553b59e700 1 -- 172.21.15.26:0/2758827484 shutdown_connections 2021-11-03T17:39:04.254 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.255+0000 7f553b59e700 1 -- 172.21.15.26:0/2758827484 wait complete. 2021-11-03T17:39:04.254 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.255+0000 7f553b59e700 1 Processor -- start 2021-11-03T17:39:04.254 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.255+0000 7f553b59e700 1 -- start start 2021-11-03T17:39:04.254 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.256+0000 7f553b59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f553c0f5440 0x7f553c106dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:39:04.255 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.256+0000 7f553b59e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f553c0f66e0 0x7f553c1072c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:39:04.255 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.256+0000 7f553b59e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553c1078c0 con 0x7f553c0f5440 2021-11-03T17:39:04.255 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.256+0000 7f553b59e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553c108100 con 0x7f553c0f66e0 2021-11-03T17:39:04.255 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.256+0000 7f553a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f553c0f5440 0x7f553c106dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:39:04.255 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.256+0000 7f553a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f553c0f5440 0x7f553c106dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55596/0 (socket says 172.21.15.26:55596) 2021-11-03T17:39:04.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.256+0000 7f553a59c700 1 -- 172.21.15.26:0/1420596750 learned_addr learned my addr 172.21.15.26:0/1420596750 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:39:04.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.256+0000 7f5539d9b700 1 --2- 172.21.15.26:0/1420596750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f553c0f66e0 0x7f553c1072c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:39:04.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.256+0000 7f553a59c700 1 -- 172.21.15.26:0/1420596750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f553c0f66e0 msgr2=0x7f553c1072c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:39:04.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.256+0000 7f553a59c700 1 --2- 172.21.15.26:0/1420596750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f553c0f66e0 0x7f553c1072c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:04.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.256+0000 7f553a59c700 1 -- 172.21.15.26:0/1420596750 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5524005040 con 0x7f553c0f5440 2021-11-03T17:39:04.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.256+0000 7f553a59c700 1 --2- 172.21.15.26:0/1420596750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f553c0f5440 0x7f553c106dd0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f5534002700 tx=0x7f5534009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:39:04.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.256+0000 7f5532ffd700 1 -- 172.21.15.26:0/1420596750 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55340079c0 con 0x7f553c0f5440 2021-11-03T17:39:04.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.256+0000 7f5532ffd700 1 -- 172.21.15.26:0/1420596750 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f553400f040 con 0x7f553c0f5440 2021-11-03T17:39:04.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.256+0000 7f553b59e700 1 -- 172.21.15.26:0/1420596750 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f553c1083e0 con 0x7f553c0f5440 2021-11-03T17:39:04.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.256+0000 7f5532ffd700 1 -- 172.21.15.26:0/1420596750 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5534014860 con 0x7f553c0f5440 2021-11-03T17:39:04.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.256+0000 7f553b59e700 1 -- 172.21.15.26:0/1420596750 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f553c108920 con 0x7f553c0f5440 2021-11-03T17:39:04.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.257+0000 7f553b59e700 1 -- 172.21.15.26:0/1420596750 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f553c059100 con 0x7f553c0f5440 2021-11-03T17:39:04.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.259+0000 7f5532ffd700 1 -- 172.21.15.26:0/1420596750 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f553401b060 con 0x7f553c0f5440 2021-11-03T17:39:04.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.259+0000 7f5532ffd700 1 --2- 172.21.15.26:0/1420596750 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5528064100 0x7f55280665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:39:04.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.259+0000 7f5532ffd700 1 -- 172.21.15.26:0/1420596750 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f5534080900 con 0x7f553c0f5440 2021-11-03T17:39:04.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.259+0000 7f5539d9b700 1 --2- 172.21.15.26:0/1420596750 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5528064100 0x7f55280665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:39:04.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.259+0000 7f5539d9b700 1 --2- 172.21.15.26:0/1420596750 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5528064100 0x7f55280665c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f5524004630 tx=0x7f5524009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:39:04.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.262+0000 7f5532ffd700 1 -- 172.21.15.26:0/1420596750 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f5534047df0 con 0x7f553c0f5440 2021-11-03T17:39:04.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.490+0000 7f553b59e700 1 -- 172.21.15.26:0/1420596750 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f553c045b50 con 0x7f553c0f5440 2021-11-03T17:39:04.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.490+0000 7f5532ffd700 1 -- 172.21.15.26:0/1420596750 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f553c045b50 con 0x7f553c0f5440 2021-11-03T17:39:04.486 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:39:04.486 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:39:04.486 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:39:04.487 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:39:04.487 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:39:04.487 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:39:04.487 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:39:04.488 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:39:04.488 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:39:04.488 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:39:04.488 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:39:04.489 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:39:04.489 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:39:04.489 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:39:04.489 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:39:04.489 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:39:04.490 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:39:04.490 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:39:04.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.492+0000 7f553b59e700 1 -- 172.21.15.26:0/1420596750 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5528064100 msgr2=0x7f55280665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:39:04.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.492+0000 7f553b59e700 1 --2- 172.21.15.26:0/1420596750 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5528064100 0x7f55280665c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f5524004630 tx=0x7f5524009b30).stop 2021-11-03T17:39:04.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.492+0000 7f553b59e700 1 -- 172.21.15.26:0/1420596750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f553c0f5440 msgr2=0x7f553c106dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:39:04.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.492+0000 7f553b59e700 1 --2- 172.21.15.26:0/1420596750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f553c0f5440 0x7f553c106dd0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f5534002700 tx=0x7f5534009d80).stop 2021-11-03T17:39:04.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.492+0000 7f553b59e700 1 -- 172.21.15.26:0/1420596750 shutdown_connections 2021-11-03T17:39:04.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.492+0000 7f553b59e700 1 --2- 172.21.15.26:0/1420596750 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5528064100 0x7f55280665c0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:04.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.492+0000 7f553b59e700 1 --2- 172.21.15.26:0/1420596750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f553c0f5440 0x7f553c106dd0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:04.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.492+0000 7f553b59e700 1 --2- 172.21.15.26:0/1420596750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f553c0f66e0 0x7f553c1072c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:04.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.492+0000 7f553b59e700 1 -- 172.21.15.26:0/1420596750 >> 172.21.15.26:0/1420596750 conn(0x7f553c0f0ba0 msgr2=0x7f553c05f620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:39:04.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.492+0000 7f553b59e700 1 -- 172.21.15.26:0/1420596750 shutdown_connections 2021-11-03T17:39:04.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.492+0000 7f553b59e700 1 -- 172.21.15.26:0/1420596750 wait complete. 2021-11-03T17:39:04.589 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.593+0000 7f37ac497700 1 -- 172.21.15.26:0/3957597355 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37a40f6860 msgr2=0x7f37a40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:39:04.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.593+0000 7f37ac497700 1 --2- 172.21.15.26:0/3957597355 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37a40f6860 0x7f37a40f6cc0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7f37a0004660 tx=0x7f37a0009b30).stop 2021-11-03T17:39:04.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.593+0000 7f37ac497700 1 -- 172.21.15.26:0/3957597355 shutdown_connections 2021-11-03T17:39:04.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.593+0000 7f37ac497700 1 --2- 172.21.15.26:0/3957597355 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37a40f6860 0x7f37a40f6cc0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:04.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.593+0000 7f37ac497700 1 --2- 172.21.15.26:0/3957597355 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37a40f55c0 0x7f37a40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:04.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.593+0000 7f37ac497700 1 -- 172.21.15.26:0/3957597355 >> 172.21.15.26:0/3957597355 conn(0x7f37a40f0d40 msgr2=0x7f37a40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:39:04.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.593+0000 7f37ac497700 1 -- 172.21.15.26:0/3957597355 shutdown_connections 2021-11-03T17:39:04.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.593+0000 7f37ac497700 1 -- 172.21.15.26:0/3957597355 wait complete. 2021-11-03T17:39:04.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.593+0000 7f37ac497700 1 Processor -- start 2021-11-03T17:39:04.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.593+0000 7f37ac497700 1 -- start start 2021-11-03T17:39:04.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.594+0000 7f37ac497700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37a40f55c0 0x7f37a40f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:39:04.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.594+0000 7f37ac497700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37a40f6860 0x7f37a40f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:39:04.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.594+0000 7f37ac497700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a40f8100 con 0x7f37a40f55c0 2021-11-03T17:39:04.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.594+0000 7f37ac497700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a40f8240 con 0x7f37a40f6860 2021-11-03T17:39:04.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.594+0000 7f37aa233700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37a40f55c0 0x7f37a40f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:39:04.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.594+0000 7f37aa233700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37a40f55c0 0x7f37a40f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55606/0 (socket says 172.21.15.26:55606) 2021-11-03T17:39:04.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.594+0000 7f37aa233700 1 -- 172.21.15.26:0/448623218 learned_addr learned my addr 172.21.15.26:0/448623218 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:39:04.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.594+0000 7f37a9a32700 1 --2- 172.21.15.26:0/448623218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37a40f6860 0x7f37a40f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:39:04.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.594+0000 7f37aa233700 1 -- 172.21.15.26:0/448623218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37a40f6860 msgr2=0x7f37a40f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:39:04.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.594+0000 7f37aa233700 1 --2- 172.21.15.26:0/448623218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37a40f6860 0x7f37a40f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:04.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.594+0000 7f37aa233700 1 -- 172.21.15.26:0/448623218 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a0005040 con 0x7f37a40f55c0 2021-11-03T17:39:04.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.594+0000 7f37aa233700 1 --2- 172.21.15.26:0/448623218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37a40f55c0 0x7f37a40f9720 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f379400c530 tx=0x7f3794007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:39:04.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.594+0000 7f379affd700 1 -- 172.21.15.26:0/448623218 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f379400f650 con 0x7f37a40f55c0 2021-11-03T17:39:04.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.594+0000 7f379affd700 1 -- 172.21.15.26:0/448623218 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f379400fc60 con 0x7f37a40f55c0 2021-11-03T17:39:04.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.594+0000 7f379affd700 1 -- 172.21.15.26:0/448623218 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3794012cb0 con 0x7f37a40f55c0 2021-11-03T17:39:04.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.594+0000 7f37ac497700 1 -- 172.21.15.26:0/448623218 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37a40f8520 con 0x7f37a40f55c0 2021-11-03T17:39:04.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.594+0000 7f37ac497700 1 -- 172.21.15.26:0/448623218 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a410efa0 con 0x7f37a40f55c0 2021-11-03T17:39:04.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.595+0000 7f37ac497700 1 -- 172.21.15.26:0/448623218 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37a4045ad0 con 0x7f37a40f55c0 2021-11-03T17:39:04.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.596+0000 7f379affd700 1 -- 172.21.15.26:0/448623218 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f3794019030 con 0x7f37a40f55c0 2021-11-03T17:39:04.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.596+0000 7f379affd700 1 --2- 172.21.15.26:0/448623218 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f37900640b0 0x7f3790066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:39:04.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.596+0000 7f379affd700 1 -- 172.21.15.26:0/448623218 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f37940805b0 con 0x7f37a40f55c0 2021-11-03T17:39:04.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.596+0000 7f37a9a32700 1 --2- 172.21.15.26:0/448623218 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f37900640b0 0x7f3790066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:39:04.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.597+0000 7f37a9a32700 1 --2- 172.21.15.26:0/448623218 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f37900640b0 0x7f3790066570 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f37a0004630 tx=0x7f37a0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:39:04.654 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.600+0000 7f379affd700 1 -- 172.21.15.26:0/448623218 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f37940528d0 con 0x7f37a40f55c0 2021-11-03T17:39:04.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:04 smithi026 ceph-mon[96795]: pgmap v1332: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:04.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:04 smithi194 ceph-mon[65619]: pgmap v1332: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:04.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.802+0000 7f37ac497700 1 -- 172.21.15.26:0/448623218 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f37a40f86b0 con 0x7f37a40f55c0 2021-11-03T17:39:04.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.803+0000 7f379affd700 1 -- 172.21.15.26:0/448623218 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f37a40f86b0 con 0x7f37a40f55c0 2021-11-03T17:39:04.798 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:39:04.798 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:39:04.799 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:39:04.799 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:39:04.799 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:39:04.799 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:39:04.800 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:39:04.800 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:39:04.800 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:39:04.800 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:39:04.801 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:39:04.801 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:39:04.801 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:39:04.801 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:39:04.802 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:39:04.802 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:39:04.802 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:39:04.802 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:39:04.802 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:39:04.803 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:39:04.803 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:39:04.803 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:39:04.803 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:39:04.804 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:39:04.804 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:39:04.804 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:39:04.804 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:39:04.805 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:39:04.805 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:39:04.805 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:39:04.805 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:39:04.805 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:39:04.806 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:39:04.806 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:39:04.806 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:39:04.806 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:39:04.807 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:39:04.807 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:39:04.807 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:39:04.808 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.804+0000 7f37ac497700 1 -- 172.21.15.26:0/448623218 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f37900640b0 msgr2=0x7f3790066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:39:04.808 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.804+0000 7f37ac497700 1 --2- 172.21.15.26:0/448623218 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f37900640b0 0x7f3790066570 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f37a0004630 tx=0x7f37a0009b30).stop 2021-11-03T17:39:04.808 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.804+0000 7f37ac497700 1 -- 172.21.15.26:0/448623218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37a40f55c0 msgr2=0x7f37a40f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:39:04.809 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.804+0000 7f37ac497700 1 --2- 172.21.15.26:0/448623218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37a40f55c0 0x7f37a40f9720 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f379400c530 tx=0x7f3794007e10).stop 2021-11-03T17:39:04.809 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.804+0000 7f37ac497700 1 -- 172.21.15.26:0/448623218 shutdown_connections 2021-11-03T17:39:04.809 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.804+0000 7f37ac497700 1 --2- 172.21.15.26:0/448623218 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f37900640b0 0x7f3790066570 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:04.809 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.804+0000 7f37ac497700 1 --2- 172.21.15.26:0/448623218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37a40f55c0 0x7f37a40f9720 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:04.809 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.804+0000 7f37ac497700 1 --2- 172.21.15.26:0/448623218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37a40f6860 0x7f37a40f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:04.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.805+0000 7f37ac497700 1 -- 172.21.15.26:0/448623218 >> 172.21.15.26:0/448623218 conn(0x7f37a40f0d40 msgr2=0x7f37a405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:39:04.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.805+0000 7f37ac497700 1 -- 172.21.15.26:0/448623218 shutdown_connections 2021-11-03T17:39:04.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:04.805+0000 7f37ac497700 1 -- 172.21.15.26:0/448623218 wait complete. 2021-11-03T17:39:04.810 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:39:05.573 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:05 smithi026 ceph-mon[96795]: from='client.35516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:39:05.573 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:05 smithi026 ceph-mon[96795]: from='client.35520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:39:05.573 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:05 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1420596750' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:39:05.574 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:05 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/448623218' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:39:05.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:05 smithi194 ceph-mon[65619]: from='client.35516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:39:05.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:05 smithi194 ceph-mon[65619]: from='client.35520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:39:05.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:05 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1420596750' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:39:05.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:05 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/448623218' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:39:06.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:06 smithi026 ceph-mon[96795]: pgmap v1333: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:06.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:06 smithi194 ceph-mon[65619]: pgmap v1333: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:08.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:08 smithi026 ceph-mon[96795]: pgmap v1334: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:08.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:08 smithi194 ceph-mon[65619]: pgmap v1334: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:10.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:10 smithi026 ceph-mon[96795]: pgmap v1335: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:10.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:10 smithi194 ceph-mon[65619]: pgmap v1335: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:12.600 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:12 smithi194 ceph-mon[65619]: pgmap v1336: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:12.604 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:12 smithi026 ceph-mon[96795]: pgmap v1336: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:13.469 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:13 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:39:13.470 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:13 smithi194 ceph-mon[65619]: poll took 60062.758 ms: 1 events 2021-11-03T17:39:13.470 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:13 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:39:13.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:13 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:39:13.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:13 smithi026 ceph-mon[96795]: poll took 60062.758 ms: 1 events 2021-11-03T17:39:13.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:13 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:39:14.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:14 smithi026 ceph-mon[96795]: pgmap v1337: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:14.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:14 smithi194 ceph-mon[65619]: pgmap v1337: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:16.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:16 smithi026 ceph-mon[96795]: pgmap v1338: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:16.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:16 smithi194 ceph-mon[65619]: pgmap v1338: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:18.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:18 smithi026 ceph-mon[96795]: pgmap v1339: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:18.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:18 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:39:18.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:18 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:39:18.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:18 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:39:18.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:18 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:39:18.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:18 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:39:18.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:18 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:39:18.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:18 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:39:18.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:18 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:39:18.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:18 smithi194 ceph-mon[65619]: pgmap v1339: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:18.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:18 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:39:18.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:18 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:39:18.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:18 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:39:18.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:18 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:39:18.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:18 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:39:18.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:18 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:39:18.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:18 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:39:18.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:18 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:39:19.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:19 smithi026 ceph-mon[96795]: poll took 4552.955 ms: 1 events 2021-11-03T17:39:19.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:19 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:39:19.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:19 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:39:19.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:19 smithi194 ceph-mon[65619]: poll took 4552.955 ms: 1 events 2021-11-03T17:39:19.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:19 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:39:19.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:19 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:39:20.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:20 smithi026 ceph-mon[96795]: pgmap v1340: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:20.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:20 smithi194 ceph-mon[65619]: pgmap v1340: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:22.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:22 smithi026 ceph-mon[96795]: pgmap v1341: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:22.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:22 smithi194 ceph-mon[65619]: pgmap v1341: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:24.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:24 smithi026 ceph-mon[96795]: pgmap v1342: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:24.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:24 smithi194 ceph-mon[65619]: pgmap v1342: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:26.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:26 smithi026 ceph-mon[96795]: pgmap v1343: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:26.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:26 smithi194 ceph-mon[65619]: pgmap v1343: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:28.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:28 smithi026 ceph-mon[96795]: pgmap v1344: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:28.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:28 smithi194 ceph-mon[65619]: pgmap v1344: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:30.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:30 smithi026 ceph-mon[96795]: pgmap v1345: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:30.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:30 smithi194 ceph-mon[65619]: pgmap v1345: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:32.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:32 smithi026 ceph-mon[96795]: pgmap v1346: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:32.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:32 smithi194 ceph-mon[65619]: pgmap v1346: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:33.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:33 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:39:33.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:33 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:39:34.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:34 smithi026 ceph-mon[96795]: pgmap v1347: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:34.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:34 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:39:34.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:34 smithi194 ceph-mon[65619]: pgmap v1347: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:34.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:34 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:39:34.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:34.920+0000 7ffbdd15d700 1 -- 172.21.15.26:0/1563693367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbd80f55e0 msgr2=0x7ffbd80f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:39:34.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:34.920+0000 7ffbdd15d700 1 --2- 172.21.15.26:0/1563693367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbd80f55e0 0x7ffbd80f5a00 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7ffbc0004660 tx=0x7ffbc0009b30).stop 2021-11-03T17:39:34.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:34.920+0000 7ffbdd15d700 1 -- 172.21.15.26:0/1563693367 shutdown_connections 2021-11-03T17:39:34.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:34.920+0000 7ffbdd15d700 1 --2- 172.21.15.26:0/1563693367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffbd80f5ef0 0x7ffbd80f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:34.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:34.920+0000 7ffbdd15d700 1 --2- 172.21.15.26:0/1563693367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbd80f55e0 0x7ffbd80f5a00 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:34.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:34.920+0000 7ffbdd15d700 1 -- 172.21.15.26:0/1563693367 >> 172.21.15.26:0/1563693367 conn(0x7ffbd80f0de0 msgr2=0x7ffbd80f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:39:34.919 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:34.921+0000 7ffbdd15d700 1 -- 172.21.15.26:0/1563693367 shutdown_connections 2021-11-03T17:39:34.919 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:34.921+0000 7ffbdd15d700 1 -- 172.21.15.26:0/1563693367 wait complete. 2021-11-03T17:39:34.919 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:34.921+0000 7ffbdd15d700 1 Processor -- start 2021-11-03T17:39:34.919 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:34.921+0000 7ffbdd15d700 1 -- start start 2021-11-03T17:39:34.920 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:34.922+0000 7ffbdd15d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffbd80f55e0 0x7ffbd8105e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:39:34.920 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:34.922+0000 7ffbdd15d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbd80f5ef0 0x7ffbd8106380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:39:34.920 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:34.922+0000 7ffbdd15d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd8106930 con 0x7ffbd80f5ef0 2021-11-03T17:39:34.920 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:34.922+0000 7ffbdd15d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd8106a70 con 0x7ffbd80f55e0 2021-11-03T17:39:34.921 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:34.922+0000 7ffbd659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbd80f5ef0 0x7ffbd8106380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:39:34.921 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:34.922+0000 7ffbd659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbd80f5ef0 0x7ffbd8106380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55624/0 (socket says 172.21.15.26:55624) 2021-11-03T17:39:34.921 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:34.922+0000 7ffbd659c700 1 -- 172.21.15.26:0/112080404 learned_addr learned my addr 172.21.15.26:0/112080404 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:39:34.922 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:34.922+0000 7ffbd6d9d700 1 --2- 172.21.15.26:0/112080404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffbd80f55e0 0x7ffbd8105e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:39:34.922 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:34.922+0000 7ffbd659c700 1 -- 172.21.15.26:0/112080404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffbd80f55e0 msgr2=0x7ffbd8105e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:39:34.922 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:34.922+0000 7ffbd659c700 1 --2- 172.21.15.26:0/112080404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffbd80f55e0 0x7ffbd8105e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:34.922 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:34.922+0000 7ffbd659c700 1 -- 172.21.15.26:0/112080404 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc0005040 con 0x7ffbd80f5ef0 2021-11-03T17:39:34.923 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:34.922+0000 7ffbd6d9d700 1 --2- 172.21.15.26:0/112080404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffbd80f55e0 0x7ffbd8105e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:39:34.923 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:34.922+0000 7ffbd659c700 1 --2- 172.21.15.26:0/112080404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbd80f5ef0 0x7ffbd8106380 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7ffbc80026d0 tx=0x7ffbc8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:39:34.923 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:34.922+0000 7ffbcf7fe700 1 -- 172.21.15.26:0/112080404 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbc8009320 con 0x7ffbd80f5ef0 2021-11-03T17:39:34.923 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:34.922+0000 7ffbcf7fe700 1 -- 172.21.15.26:0/112080404 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ffbc800f040 con 0x7ffbd80f5ef0 2021-11-03T17:39:34.924 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:34.922+0000 7ffbdd15d700 1 -- 172.21.15.26:0/112080404 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbd8107410 con 0x7ffbd80f5ef0 2021-11-03T17:39:34.924 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:34.922+0000 7ffbcf7fe700 1 -- 172.21.15.26:0/112080404 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbc80147e0 con 0x7ffbd80f5ef0 2021-11-03T17:39:34.924 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:34.922+0000 7ffbdd15d700 1 -- 172.21.15.26:0/112080404 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd81079d0 con 0x7ffbd80f5ef0 2021-11-03T17:39:34.924 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:34.923+0000 7ffbdd15d700 1 -- 172.21.15.26:0/112080404 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbd8045ad0 con 0x7ffbd80f5ef0 2021-11-03T17:39:34.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:34.924+0000 7ffbcf7fe700 1 -- 172.21.15.26:0/112080404 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ffbc8009480 con 0x7ffbd80f5ef0 2021-11-03T17:39:34.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:34.924+0000 7ffbcf7fe700 1 --2- 172.21.15.26:0/112080404 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffbc40640b0 0x7ffbc4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:39:34.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:34.924+0000 7ffbcf7fe700 1 -- 172.21.15.26:0/112080404 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ffbc8080eb0 con 0x7ffbd80f5ef0 2021-11-03T17:39:34.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:34.924+0000 7ffbd6d9d700 1 --2- 172.21.15.26:0/112080404 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffbc40640b0 0x7ffbc4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:39:34.927 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:34.925+0000 7ffbd6d9d700 1 --2- 172.21.15.26:0/112080404 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffbc40640b0 0x7ffbc4066570 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7ffbc0009da0 tx=0x7ffbc0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:39:34.927 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:34.929+0000 7ffbcf7fe700 1 -- 172.21.15.26:0/112080404 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ffbc8053210 con 0x7ffbd80f5ef0 2021-11-03T17:39:35.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.109+0000 7ffbdd15d700 1 -- 172.21.15.26:0/112080404 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffbd80fdf80 con 0x7ffbc40640b0 2021-11-03T17:39:35.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.110+0000 7ffbcf7fe700 1 -- 172.21.15.26:0/112080404 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7ffbc00092e0 con 0x7ffbc40640b0 2021-11-03T17:39:35.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.112+0000 7ffbdd15d700 1 -- 172.21.15.26:0/112080404 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffbc40640b0 msgr2=0x7ffbc4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:39:35.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.112+0000 7ffbdd15d700 1 --2- 172.21.15.26:0/112080404 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffbc40640b0 0x7ffbc4066570 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7ffbc0009da0 tx=0x7ffbc0009b30).stop 2021-11-03T17:39:35.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.112+0000 7ffbdd15d700 1 -- 172.21.15.26:0/112080404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbd80f5ef0 msgr2=0x7ffbd8106380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:39:35.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.112+0000 7ffbdd15d700 1 --2- 172.21.15.26:0/112080404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbd80f5ef0 0x7ffbd8106380 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7ffbc80026d0 tx=0x7ffbc8009de0).stop 2021-11-03T17:39:35.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.112+0000 7ffbdd15d700 1 -- 172.21.15.26:0/112080404 shutdown_connections 2021-11-03T17:39:35.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.112+0000 7ffbdd15d700 1 --2- 172.21.15.26:0/112080404 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffbc40640b0 0x7ffbc4066570 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:35.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.112+0000 7ffbdd15d700 1 --2- 172.21.15.26:0/112080404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffbd80f55e0 0x7ffbd8105e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:35.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.112+0000 7ffbdd15d700 1 --2- 172.21.15.26:0/112080404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbd80f5ef0 0x7ffbd8106380 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:35.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.112+0000 7ffbdd15d700 1 -- 172.21.15.26:0/112080404 >> 172.21.15.26:0/112080404 conn(0x7ffbd80f0de0 msgr2=0x7ffbd80fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:39:35.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.112+0000 7ffbdd15d700 1 -- 172.21.15.26:0/112080404 shutdown_connections 2021-11-03T17:39:35.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.112+0000 7ffbdd15d700 1 -- 172.21.15.26:0/112080404 wait complete. 2021-11-03T17:39:35.115 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:39:35.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.212+0000 7f0d44e1c700 1 -- 172.21.15.26:0/3679338096 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d400f55e0 msgr2=0x7f0d400f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:39:35.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.212+0000 7f0d44e1c700 1 --2- 172.21.15.26:0/3679338096 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d400f55e0 0x7f0d400f5a00 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f0d30004660 tx=0x7f0d30009b30).stop 2021-11-03T17:39:35.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.212+0000 7f0d44e1c700 1 -- 172.21.15.26:0/3679338096 shutdown_connections 2021-11-03T17:39:35.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.212+0000 7f0d44e1c700 1 --2- 172.21.15.26:0/3679338096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d400f5ef0 0x7f0d400f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:39:35.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.212+0000 7f0d44e1c700 1 --2- 172.21.15.26:0/3679338096 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d400f55e0 0x7f0d400f5a00 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:35.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.212+0000 7f0d44e1c700 1 -- 172.21.15.26:0/3679338096 >> 172.21.15.26:0/3679338096 conn(0x7f0d400f0de0 msgr2=0x7f0d400f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:39:35.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.212+0000 7f0d44e1c700 1 -- 172.21.15.26:0/3679338096 shutdown_connections 2021-11-03T17:39:35.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.212+0000 7f0d44e1c700 1 -- 172.21.15.26:0/3679338096 wait complete. 2021-11-03T17:39:35.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.213+0000 7f0d44e1c700 1 Processor -- start 2021-11-03T17:39:35.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.213+0000 7f0d44e1c700 1 -- start start 2021-11-03T17:39:35.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.213+0000 7f0d44e1c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d400f55e0 0x7f0d40109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:39:35.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.213+0000 7f0d44e1c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d400f5ef0 0x7f0d4010c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:39:35.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.213+0000 7f0d44e1c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d40060590 con 0x7f0d400f5ef0 2021-11-03T17:39:35.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.213+0000 7f0d44e1c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d400606d0 con 0x7f0d400f55e0 2021-11-03T17:39:35.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.213+0000 7f0d3dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d400f5ef0 0x7f0d4010c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:39:35.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.213+0000 7f0d3dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d400f5ef0 0x7f0d4010c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55634/0 (socket says 172.21.15.26:55634) 2021-11-03T17:39:35.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.213+0000 7f0d3dd9b700 1 -- 172.21.15.26:0/2538110946 learned_addr learned my addr 172.21.15.26:0/2538110946 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:39:35.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.213+0000 7f0d3e59c700 1 --2- 172.21.15.26:0/2538110946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d400f55e0 0x7f0d40109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:39:35.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.213+0000 7f0d3dd9b700 1 -- 172.21.15.26:0/2538110946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d400f55e0 msgr2=0x7f0d40109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:39:35.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.213+0000 7f0d3dd9b700 1 --2- 172.21.15.26:0/2538110946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d400f55e0 0x7f0d40109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:35.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.213+0000 7f0d3dd9b700 1 -- 172.21.15.26:0/2538110946 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d30005040 con 0x7f0d400f5ef0 2021-11-03T17:39:35.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.213+0000 7f0d3dd9b700 1 --2- 172.21.15.26:0/2538110946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d400f5ef0 0x7f0d4010c170 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7f0d2800b410 tx=0x7f0d28006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:39:35.213 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.214+0000 7f0d36ffd700 1 -- 172.21.15.26:0/2538110946 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d280125f0 con 0x7f0d400f5ef0 2021-11-03T17:39:35.213 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.214+0000 7f0d36ffd700 1 -- 172.21.15.26:0/2538110946 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0d2800be30 con 0x7f0d400f5ef0 2021-11-03T17:39:35.213 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.214+0000 7f0d44e1c700 1 -- 172.21.15.26:0/2538110946 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d4010c7d0 con 0x7f0d400f5ef0 2021-11-03T17:39:35.213 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.214+0000 7f0d36ffd700 1 -- 172.21.15.26:0/2538110946 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d28002a70 con 0x7f0d400f5ef0 2021-11-03T17:39:35.214 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.214+0000 7f0d44e1c700 1 -- 172.21.15.26:0/2538110946 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d4010cd60 con 0x7f0d400f5ef0 2021-11-03T17:39:35.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.215+0000 7f0d44e1c700 1 -- 172.21.15.26:0/2538110946 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d400f4a70 con 0x7f0d400f5ef0 2021-11-03T17:39:35.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.215+0000 7f0d36ffd700 1 -- 172.21.15.26:0/2538110946 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f0d2800f030 con 0x7f0d400f5ef0 2021-11-03T17:39:35.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.215+0000 7f0d36ffd700 1 --2- 172.21.15.26:0/2538110946 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0d2c064090 0x7f0d2c066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:39:35.216 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.215+0000 7f0d36ffd700 1 -- 172.21.15.26:0/2538110946 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f0d28080c50 con 0x7f0d400f5ef0 2021-11-03T17:39:35.216 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.215+0000 7f0d3e59c700 1 --2- 172.21.15.26:0/2538110946 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0d2c064090 0x7f0d2c066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:39:35.216 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.216+0000 7f0d3e59c700 1 --2- 172.21.15.26:0/2538110946 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0d2c064090 0x7f0d2c066550 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f0d30013690 tx=0x7f0d30009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:39:35.216 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.219+0000 7f0d36ffd700 1 -- 172.21.15.26:0/2538110946 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f0d28052f30 con 0x7f0d400f5ef0 2021-11-03T17:39:35.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.396+0000 7f0d44e1c700 1 -- 172.21.15.26:0/2538110946 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d400fdf90 con 0x7f0d2c064090 2021-11-03T17:39:35.404 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.410+0000 7f0d36ffd700 1 -- 172.21.15.26:0/2538110946 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f0d400fdf90 con 0x7f0d2c064090 2021-11-03T17:39:35.404 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:39:35.404 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (50m) 17s ago 52m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:39:35.405 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (43m) 17s ago 52m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:39:35.405 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (42m) 9m ago 51m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:39:35.405 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (50m) 17s ago 51m 40.8M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:39:35.405 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (43m) 17s ago 47m 25.1M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:39:35.406 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (44m) 17s ago 47m 25.7M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:39:35.406 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (47m) 9m ago 47m 24.8M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:39:35.406 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (47m) 9m ago 47m 25.0M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:39:35.406 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (44m) 17s ago 53m 533M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:39:35.407 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (44m) 9m ago 51m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:39:35.407 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (43m) 17s ago 53m 209M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:39:35.407 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (43m) 9m ago 51m 89.5M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:39:35.407 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (51m) 17s ago 51m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:39:35.407 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (51m) 9m ago 51m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:39:35.408 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (42m) 17s ago 50m 251M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:39:35.408 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (42m) 17s ago 50m 270M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:39:35.408 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (41m) 17s ago 49m 225M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:39:35.408 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (41m) 9m ago 49m 262M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:39:35.409 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (40m) 9m ago 49m 227M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:39:35.409 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (40m) 9m ago 48m 215M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:39:35.409 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (50m) 17s ago 51m 56.7M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:39:35.410 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.412+0000 7f0d44e1c700 1 -- 172.21.15.26:0/2538110946 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0d2c064090 msgr2=0x7f0d2c066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:39:35.410 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.412+0000 7f0d44e1c700 1 --2- 172.21.15.26:0/2538110946 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0d2c064090 0x7f0d2c066550 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f0d30013690 tx=0x7f0d30009b30).stop 2021-11-03T17:39:35.410 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.412+0000 7f0d44e1c700 1 -- 172.21.15.26:0/2538110946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d400f5ef0 msgr2=0x7f0d4010c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:39:35.411 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.412+0000 7f0d44e1c700 1 --2- 172.21.15.26:0/2538110946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d400f5ef0 0x7f0d4010c170 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7f0d2800b410 tx=0x7f0d28006ef0).stop 2021-11-03T17:39:35.411 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.412+0000 7f0d44e1c700 1 -- 172.21.15.26:0/2538110946 shutdown_connections 2021-11-03T17:39:35.411 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.412+0000 7f0d44e1c700 1 --2- 172.21.15.26:0/2538110946 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0d2c064090 0x7f0d2c066550 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:35.411 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.412+0000 7f0d44e1c700 1 --2- 172.21.15.26:0/2538110946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d400f55e0 0x7f0d40109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:35.411 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.412+0000 7f0d44e1c700 1 --2- 172.21.15.26:0/2538110946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d400f5ef0 0x7f0d4010c170 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:35.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.412+0000 7f0d44e1c700 1 -- 172.21.15.26:0/2538110946 >> 172.21.15.26:0/2538110946 conn(0x7f0d400f0de0 msgr2=0x7f0d400fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:39:35.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.412+0000 7f0d44e1c700 1 -- 172.21.15.26:0/2538110946 shutdown_connections 2021-11-03T17:39:35.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.412+0000 7f0d44e1c700 1 -- 172.21.15.26:0/2538110946 wait complete. 2021-11-03T17:39:35.507 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.512+0000 7f718f9fa700 1 -- 172.21.15.26:0/3750973164 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f718806b940 msgr2=0x7f7188069e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:39:35.508 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.512+0000 7f718f9fa700 1 --2- 172.21.15.26:0/3750973164 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f718806b940 0x7f7188069e40 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f71800099e0 tx=0x7f7180004d10).stop 2021-11-03T17:39:35.508 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.512+0000 7f718f9fa700 1 -- 172.21.15.26:0/3750973164 shutdown_connections 2021-11-03T17:39:35.508 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.512+0000 7f718f9fa700 1 --2- 172.21.15.26:0/3750973164 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f718806a330 0x7f718806a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:35.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.512+0000 7f718f9fa700 1 --2- 172.21.15.26:0/3750973164 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f718806b940 0x7f7188069e40 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:35.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.512+0000 7f718f9fa700 1 -- 172.21.15.26:0/3750973164 >> 172.21.15.26:0/3750973164 conn(0x7f71880f1e20 msgr2=0x7f71880f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:39:35.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.512+0000 7f718f9fa700 1 -- 172.21.15.26:0/3750973164 shutdown_connections 2021-11-03T17:39:35.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.512+0000 7f718f9fa700 1 -- 172.21.15.26:0/3750973164 wait complete. 2021-11-03T17:39:35.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.512+0000 7f718f9fa700 1 Processor -- start 2021-11-03T17:39:35.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.512+0000 7f718f9fa700 1 -- start start 2021-11-03T17:39:35.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.513+0000 7f718f9fa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f718806a330 0x7f7188109270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:39:35.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.513+0000 7f718f9fa700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f718806b940 0x7f7188109760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:39:35.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.513+0000 7f718f9fa700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7188109d10 con 0x7f718806a330 2021-11-03T17:39:35.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.513+0000 7f718f9fa700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7188109e50 con 0x7f718806b940 2021-11-03T17:39:35.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.513+0000 7f718d796700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f718806a330 0x7f7188109270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:39:35.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.513+0000 7f718d796700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f718806a330 0x7f7188109270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55642/0 (socket says 172.21.15.26:55642) 2021-11-03T17:39:35.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.513+0000 7f718d796700 1 -- 172.21.15.26:0/1755534957 learned_addr learned my addr 172.21.15.26:0/1755534957 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:39:35.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.513+0000 7f718cf95700 1 --2- 172.21.15.26:0/1755534957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f718806b940 0x7f7188109760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:39:35.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.513+0000 7f718d796700 1 -- 172.21.15.26:0/1755534957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f718806b940 msgr2=0x7f7188109760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:39:35.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.513+0000 7f718d796700 1 --2- 172.21.15.26:0/1755534957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f718806b940 0x7f7188109760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:35.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.513+0000 7f718d796700 1 -- 172.21.15.26:0/1755534957 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7180009640 con 0x7f718806a330 2021-11-03T17:39:35.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.513+0000 7f718d796700 1 --2- 172.21.15.26:0/1755534957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f718806a330 0x7f7188109270 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f718000b3b0 tx=0x7f7180004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:39:35.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.513+0000 7f7185ffb700 1 -- 172.21.15.26:0/1755534957 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f718000e030 con 0x7f718806a330 2021-11-03T17:39:35.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.513+0000 7f7185ffb700 1 -- 172.21.15.26:0/1755534957 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f71800049b0 con 0x7f718806a330 2021-11-03T17:39:35.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.513+0000 7f718f9fa700 1 -- 172.21.15.26:0/1755534957 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f718810a790 con 0x7f718806a330 2021-11-03T17:39:35.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.513+0000 7f7185ffb700 1 -- 172.21.15.26:0/1755534957 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7180018070 con 0x7f718806a330 2021-11-03T17:39:35.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.513+0000 7f718f9fa700 1 -- 172.21.15.26:0/1755534957 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f718810ac70 con 0x7f718806a330 2021-11-03T17:39:35.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.514+0000 7f718f9fa700 1 -- 172.21.15.26:0/1755534957 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7188045ad0 con 0x7f718806a330 2021-11-03T17:39:35.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.515+0000 7f7185ffb700 1 -- 172.21.15.26:0/1755534957 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f718001d420 con 0x7f718806a330 2021-11-03T17:39:35.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.515+0000 7f7185ffb700 1 --2- 172.21.15.26:0/1755534957 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f71700640b0 0x7f7170066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:39:35.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.515+0000 7f7185ffb700 1 -- 172.21.15.26:0/1755534957 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f71800824b0 con 0x7f718806a330 2021-11-03T17:39:35.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.515+0000 7f718cf95700 1 --2- 172.21.15.26:0/1755534957 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f71700640b0 0x7f7170066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:39:35.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.516+0000 7f718cf95700 1 --2- 172.21.15.26:0/1755534957 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f71700640b0 0x7f7170066570 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f717c004c40 tx=0x7f717c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:39:35.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.520+0000 7f7185ffb700 1 -- 172.21.15.26:0/1755534957 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f7180054810 con 0x7f718806a330 2021-11-03T17:39:35.747 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.753+0000 7f718f9fa700 1 -- 172.21.15.26:0/1755534957 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7188101110 con 0x7f718806a330 2021-11-03T17:39:35.748 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.754+0000 7f7185ffb700 1 -- 172.21.15.26:0/1755534957 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f7180054400 con 0x7f718806a330 2021-11-03T17:39:35.748 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:39:35.749 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:39:35.749 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:39:35.749 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:39:35.749 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:39:35.749 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:39:35.750 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:39:35.750 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:39:35.750 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:39:35.750 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:39:35.751 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:39:35.751 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:39:35.751 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:39:35.751 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:39:35.751 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:39:35.752 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:39:35.752 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:39:35.752 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:39:35.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.756+0000 7f718f9fa700 1 -- 172.21.15.26:0/1755534957 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f71700640b0 msgr2=0x7f7170066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:39:35.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.756+0000 7f718f9fa700 1 --2- 172.21.15.26:0/1755534957 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f71700640b0 0x7f7170066570 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f717c004c40 tx=0x7f717c00b040).stop 2021-11-03T17:39:35.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.756+0000 7f718f9fa700 1 -- 172.21.15.26:0/1755534957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f718806a330 msgr2=0x7f7188109270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:39:35.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.756+0000 7f718f9fa700 1 --2- 172.21.15.26:0/1755534957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f718806a330 0x7f7188109270 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f718000b3b0 tx=0x7f7180004d10).stop 2021-11-03T17:39:35.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.756+0000 7f718f9fa700 1 -- 172.21.15.26:0/1755534957 shutdown_connections 2021-11-03T17:39:35.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.756+0000 7f718f9fa700 1 --2- 172.21.15.26:0/1755534957 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f71700640b0 0x7f7170066570 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:35.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.756+0000 7f718f9fa700 1 --2- 172.21.15.26:0/1755534957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f718806a330 0x7f7188109270 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:35.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.756+0000 7f718f9fa700 1 --2- 172.21.15.26:0/1755534957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f718806b940 0x7f7188109760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:35.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.756+0000 7f718f9fa700 1 -- 172.21.15.26:0/1755534957 >> 172.21.15.26:0/1755534957 conn(0x7f71880f1e20 msgr2=0x7f71880fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:39:35.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.756+0000 7f718f9fa700 1 -- 172.21.15.26:0/1755534957 shutdown_connections 2021-11-03T17:39:35.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.756+0000 7f718f9fa700 1 -- 172.21.15.26:0/1755534957 wait complete. 2021-11-03T17:39:35.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.857+0000 7f9b6511a700 1 -- 172.21.15.26:0/3038925098 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b600f66e0 msgr2=0x7f9b600f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:39:35.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.857+0000 7f9b6511a700 1 --2- 172.21.15.26:0/3038925098 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b600f66e0 0x7f9b600f6b40 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f9b54004660 tx=0x7f9b54009b30).stop 2021-11-03T17:39:35.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.857+0000 7f9b6511a700 1 -- 172.21.15.26:0/3038925098 shutdown_connections 2021-11-03T17:39:35.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.857+0000 7f9b6511a700 1 --2- 172.21.15.26:0/3038925098 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b600f66e0 0x7f9b600f6b40 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:35.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.857+0000 7f9b6511a700 1 --2- 172.21.15.26:0/3038925098 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b600f5440 0x7f9b600f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:35.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.857+0000 7f9b6511a700 1 -- 172.21.15.26:0/3038925098 >> 172.21.15.26:0/3038925098 conn(0x7f9b600f0ba0 msgr2=0x7f9b600f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:39:35.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.857+0000 7f9b6511a700 1 -- 172.21.15.26:0/3038925098 shutdown_connections 2021-11-03T17:39:35.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.857+0000 7f9b6511a700 1 -- 172.21.15.26:0/3038925098 wait complete. 2021-11-03T17:39:35.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.858+0000 7f9b6511a700 1 Processor -- start 2021-11-03T17:39:35.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.858+0000 7f9b6511a700 1 -- start start 2021-11-03T17:39:35.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.858+0000 7f9b6511a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b600f5440 0x7f9b600f95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:39:35.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.858+0000 7f9b6511a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b600f66e0 0x7f9b600f7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:39:35.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.858+0000 7f9b6511a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b600f7f80 con 0x7f9b600f66e0 2021-11-03T17:39:35.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.858+0000 7f9b6511a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b600f80c0 con 0x7f9b600f5440 2021-11-03T17:39:35.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.858+0000 7f9b5f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b600f66e0 0x7f9b600f7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:39:35.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.858+0000 7f9b5f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b600f66e0 0x7f9b600f7a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55654/0 (socket says 172.21.15.26:55654) 2021-11-03T17:39:35.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.858+0000 7f9b5f7fe700 1 -- 172.21.15.26:0/2218128708 learned_addr learned my addr 172.21.15.26:0/2218128708 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:39:35.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.858+0000 7f9b5ffff700 1 --2- 172.21.15.26:0/2218128708 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b600f5440 0x7f9b600f95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:39:35.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.858+0000 7f9b5f7fe700 1 -- 172.21.15.26:0/2218128708 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b600f5440 msgr2=0x7f9b600f95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:39:35.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.858+0000 7f9b5f7fe700 1 --2- 172.21.15.26:0/2218128708 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b600f5440 0x7f9b600f95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:35.858 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.858+0000 7f9b5f7fe700 1 -- 172.21.15.26:0/2218128708 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b54005040 con 0x7f9b600f66e0 2021-11-03T17:39:35.858 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.858+0000 7f9b5ffff700 1 --2- 172.21.15.26:0/2218128708 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b600f5440 0x7f9b600f95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:39:35.858 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.859+0000 7f9b5f7fe700 1 --2- 172.21.15.26:0/2218128708 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b600f66e0 0x7f9b600f7a20 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f9b54009990 tx=0x7f9b54009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:39:35.858 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.859+0000 7f9b5cff9700 1 -- 172.21.15.26:0/2218128708 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b54018070 con 0x7f9b600f66e0 2021-11-03T17:39:35.859 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.859+0000 7f9b6511a700 1 -- 172.21.15.26:0/2218128708 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b600f8340 con 0x7f9b600f66e0 2021-11-03T17:39:35.859 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.859+0000 7f9b5cff9700 1 -- 172.21.15.26:0/2218128708 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9b54007ba0 con 0x7f9b600f66e0 2021-11-03T17:39:35.859 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.859+0000 7f9b5cff9700 1 -- 172.21.15.26:0/2218128708 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b5401c3c0 con 0x7f9b600f66e0 2021-11-03T17:39:35.859 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.859+0000 7f9b6511a700 1 -- 172.21.15.26:0/2218128708 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b600f88a0 con 0x7f9b600f66e0 2021-11-03T17:39:35.859 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.860+0000 7f9b6511a700 1 -- 172.21.15.26:0/2218128708 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b60045ad0 con 0x7f9b600f66e0 2021-11-03T17:39:35.860 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.860+0000 7f9b5cff9700 1 -- 172.21.15.26:0/2218128708 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f9b5401d420 con 0x7f9b600f66e0 2021-11-03T17:39:35.860 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.861+0000 7f9b5cff9700 1 --2- 172.21.15.26:0/2218128708 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9b48064100 0x7f9b480665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:39:35.860 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.861+0000 7f9b5cff9700 1 -- 172.21.15.26:0/2218128708 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f9b540825c0 con 0x7f9b600f66e0 2021-11-03T17:39:35.860 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.861+0000 7f9b5ffff700 1 --2- 172.21.15.26:0/2218128708 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9b48064100 0x7f9b480665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:39:35.861 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.861+0000 7f9b5ffff700 1 --2- 172.21.15.26:0/2218128708 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9b48064100 0x7f9b480665c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f9b50009880 tx=0x7f9b5000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:39:35.861 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:35.865+0000 7f9b5cff9700 1 -- 172.21.15.26:0/2218128708 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f9b540548c0 con 0x7f9b600f66e0 2021-11-03T17:39:36.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:36.069+0000 7f9b6511a700 1 -- 172.21.15.26:0/2218128708 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9b600fdc00 con 0x7f9b600f66e0 2021-11-03T17:39:36.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:36.070+0000 7f9b5cff9700 1 -- 172.21.15.26:0/2218128708 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f9b540544b0 con 0x7f9b600f66e0 2021-11-03T17:39:36.064 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:39:36.065 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:39:36.065 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:39:36.065 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:39:36.065 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:39:36.066 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:39:36.066 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:39:36.066 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:39:36.066 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:39:36.067 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:39:36.067 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:39:36.067 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:39:36.067 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:39:36.068 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:39:36.068 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:39:36.068 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:39:36.068 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:39:36.069 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:39:36.069 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:39:36.069 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:39:36.069 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:39:36.069 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:39:36.070 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:39:36.070 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:39:36.070 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:39:36.070 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:39:36.071 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:39:36.071 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:39:36.071 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:39:36.071 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:39:36.072 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:39:36.072 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:39:36.072 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:39:36.072 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:39:36.073 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:39:36.073 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:39:36.073 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:39:36.073 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:39:36.073 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:39:36.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:36.072+0000 7f9b6511a700 1 -- 172.21.15.26:0/2218128708 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9b48064100 msgr2=0x7f9b480665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:39:36.075 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:36.072+0000 7f9b6511a700 1 --2- 172.21.15.26:0/2218128708 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9b48064100 0x7f9b480665c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f9b50009880 tx=0x7f9b5000b040).stop 2021-11-03T17:39:36.075 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:36.072+0000 7f9b6511a700 1 -- 172.21.15.26:0/2218128708 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b600f66e0 msgr2=0x7f9b600f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:39:36.075 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:36.072+0000 7f9b6511a700 1 --2- 172.21.15.26:0/2218128708 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b600f66e0 0x7f9b600f7a20 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f9b54009990 tx=0x7f9b54009b30).stop 2021-11-03T17:39:36.075 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:36.072+0000 7f9b6511a700 1 -- 172.21.15.26:0/2218128708 shutdown_connections 2021-11-03T17:39:36.076 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:36.072+0000 7f9b6511a700 1 --2- 172.21.15.26:0/2218128708 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9b48064100 0x7f9b480665c0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:36.076 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:36.072+0000 7f9b6511a700 1 --2- 172.21.15.26:0/2218128708 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b600f5440 0x7f9b600f95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:36.076 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:36.072+0000 7f9b6511a700 1 --2- 172.21.15.26:0/2218128708 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b600f66e0 0x7f9b600f7a20 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:39:36.076 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:36.072+0000 7f9b6511a700 1 -- 172.21.15.26:0/2218128708 >> 172.21.15.26:0/2218128708 conn(0x7f9b600f0ba0 msgr2=0x7f9b6005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:39:36.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:36.072+0000 7f9b6511a700 1 -- 172.21.15.26:0/2218128708 shutdown_connections 2021-11-03T17:39:36.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:39:36.072+0000 7f9b6511a700 1 -- 172.21.15.26:0/2218128708 wait complete. 2021-11-03T17:39:36.077 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:39:36.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:36 smithi026 ceph-mon[96795]: pgmap v1348: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:36.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:36 smithi026 ceph-mon[96795]: from='client.35532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:39:36.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:36 smithi026 ceph-mon[96795]: from='client.35536 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:39:36.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:36 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1755534957' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:39:36.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:36 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2218128708' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:39:36.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:36 smithi194 ceph-mon[65619]: pgmap v1348: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:36.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:36 smithi194 ceph-mon[65619]: from='client.35532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:39:36.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:36 smithi194 ceph-mon[65619]: from='client.35536 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:39:36.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:36 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1755534957' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:39:36.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:36 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2218128708' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:39:38.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:38 smithi026 ceph-mon[96795]: pgmap v1349: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:38.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:38 smithi194 ceph-mon[65619]: pgmap v1349: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:40.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:40 smithi026 ceph-mon[96795]: pgmap v1350: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:40.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:40 smithi194 ceph-mon[65619]: pgmap v1350: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:42.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:42 smithi026 ceph-mon[96795]: pgmap v1351: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:42.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:42 smithi194 ceph-mon[65619]: pgmap v1351: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:44.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:44 smithi026 ceph-mon[96795]: pgmap v1352: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:44.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:44 smithi194 ceph-mon[65619]: pgmap v1352: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:46.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:46 smithi026 ceph-mon[96795]: pgmap v1353: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:46.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:46 smithi194 ceph-mon[65619]: pgmap v1353: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:48 smithi026 ceph-mon[96795]: pgmap v1354: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:39:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:39:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:39:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:48 smithi194 ceph-mon[65619]: pgmap v1354: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:48.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:39:48.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:39:48.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:39:49.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:49 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:39:49.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:49 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:39:50.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:50 smithi026 ceph-mon[96795]: pgmap v1355: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:50.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:50 smithi194 ceph-mon[65619]: pgmap v1355: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:52.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:52 smithi026 ceph-mon[96795]: pgmap v1356: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:52.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:52 smithi194 ceph-mon[65619]: pgmap v1356: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:54.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:54 smithi026 ceph-mon[96795]: pgmap v1357: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:54.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:54 smithi194 ceph-mon[65619]: pgmap v1357: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:56.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:56 smithi026 ceph-mon[96795]: pgmap v1358: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:56.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:56 smithi194 ceph-mon[65619]: pgmap v1358: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:58.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:39:58 smithi026 ceph-mon[96795]: pgmap v1359: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:39:58.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:39:58 smithi194 ceph-mon[65619]: pgmap v1359: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:00.359 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:00 smithi026 conmon[96772]: 2021-11-03T17:39:59.999+0000 7f27986f6700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 2 daemons have recently crashed 2021-11-03T17:40:00.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:00 smithi026 ceph-mon[96795]: pgmap v1360: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:00.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:00 smithi026 ceph-mon[96795]: overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 2 daemons have recently crashed 2021-11-03T17:40:00.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:00 smithi194 ceph-mon[65619]: pgmap v1360: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:00.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:00 smithi194 ceph-mon[65619]: overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 2 daemons have recently crashed 2021-11-03T17:40:02.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:02 smithi026 ceph-mon[96795]: pgmap v1361: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:02.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:02 smithi194 ceph-mon[65619]: pgmap v1361: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:03.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:03 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:40:03.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:03 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:40:04.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:04 smithi026 ceph-mon[96795]: pgmap v1362: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:04.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:04 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:40:04.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:04 smithi194 ceph-mon[65619]: pgmap v1362: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:04.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:04 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:40:06.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.188+0000 7f1b7e996700 1 -- 172.21.15.26:0/3951109480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b780f9830 msgr2=0x7f1b780fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:40:06.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.188+0000 7f1b7e996700 1 --2- 172.21.15.26:0/3951109480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b780f9830 0x7f1b780fbc80 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7f1b68004660 tx=0x7f1b68009b30).stop 2021-11-03T17:40:06.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.188+0000 7f1b7e996700 1 -- 172.21.15.26:0/3951109480 shutdown_connections 2021-11-03T17:40:06.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.188+0000 7f1b7e996700 1 --2- 172.21.15.26:0/3951109480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b780f9830 0x7f1b780fbc80 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:06.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.188+0000 7f1b7e996700 1 --2- 172.21.15.26:0/3951109480 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b78060370 0x7f1b780f9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:06.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.188+0000 7f1b7e996700 1 -- 172.21.15.26:0/3951109480 >> 172.21.15.26:0/3951109480 conn(0x7f1b780f0d40 msgr2=0x7f1b780f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:40:06.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.188+0000 7f1b7e996700 1 -- 172.21.15.26:0/3951109480 shutdown_connections 2021-11-03T17:40:06.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.188+0000 7f1b7e996700 1 -- 172.21.15.26:0/3951109480 wait complete. 2021-11-03T17:40:06.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.188+0000 7f1b7e996700 1 Processor -- start 2021-11-03T17:40:06.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.189+0000 7f1b7e996700 1 -- start start 2021-11-03T17:40:06.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.189+0000 7f1b7e996700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b78060370 0x7f1b780f6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:40:06.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.189+0000 7f1b7e996700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b780f9830 0x7f1b780f5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:40:06.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.189+0000 7f1b7e996700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b780f57a0 con 0x7f1b780f9830 2021-11-03T17:40:06.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.189+0000 7f1b7e996700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b780f58e0 con 0x7f1b78060370 2021-11-03T17:40:06.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.189+0000 7f1b777fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b780f9830 0x7f1b780f5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:40:06.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.189+0000 7f1b777fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b780f9830 0x7f1b780f5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55672/0 (socket says 172.21.15.26:55672) 2021-11-03T17:40:06.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.189+0000 7f1b777fe700 1 -- 172.21.15.26:0/2377687404 learned_addr learned my addr 172.21.15.26:0/2377687404 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:40:06.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.189+0000 7f1b77fff700 1 --2- 172.21.15.26:0/2377687404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b78060370 0x7f1b780f6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:40:06.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.189+0000 7f1b777fe700 1 -- 172.21.15.26:0/2377687404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b78060370 msgr2=0x7f1b780f6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:40:06.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.189+0000 7f1b777fe700 1 --2- 172.21.15.26:0/2377687404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b78060370 0x7f1b780f6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:06.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.189+0000 7f1b777fe700 1 -- 172.21.15.26:0/2377687404 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b68005040 con 0x7f1b780f9830 2021-11-03T17:40:06.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.189+0000 7f1b777fe700 1 --2- 172.21.15.26:0/2377687404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b780f9830 0x7f1b780f5240 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f1b68013a70 tx=0x7f1b68009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:40:06.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.189+0000 7f1b74ff9700 1 -- 172.21.15.26:0/2377687404 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b68018070 con 0x7f1b780f9830 2021-11-03T17:40:06.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.190+0000 7f1b74ff9700 1 -- 172.21.15.26:0/2377687404 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1b68007ba0 con 0x7f1b780f9830 2021-11-03T17:40:06.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.190+0000 7f1b74ff9700 1 -- 172.21.15.26:0/2377687404 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b6801c3c0 con 0x7f1b780f9830 2021-11-03T17:40:06.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.190+0000 7f1b7e996700 1 -- 172.21.15.26:0/2377687404 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b780f5b60 con 0x7f1b780f9830 2021-11-03T17:40:06.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.190+0000 7f1b7e996700 1 -- 172.21.15.26:0/2377687404 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b780f60c0 con 0x7f1b780f9830 2021-11-03T17:40:06.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.191+0000 7f1b7e996700 1 -- 172.21.15.26:0/2377687404 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b78045ad0 con 0x7f1b780f9830 2021-11-03T17:40:06.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.191+0000 7f1b74ff9700 1 -- 172.21.15.26:0/2377687404 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f1b6801d420 con 0x7f1b780f9830 2021-11-03T17:40:06.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.191+0000 7f1b74ff9700 1 --2- 172.21.15.26:0/2377687404 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1b600640b0 0x7f1b60066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:40:06.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.191+0000 7f1b74ff9700 1 -- 172.21.15.26:0/2377687404 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f1b68082590 con 0x7f1b780f9830 2021-11-03T17:40:06.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.192+0000 7f1b77fff700 1 --2- 172.21.15.26:0/2377687404 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1b600640b0 0x7f1b60066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:40:06.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.192+0000 7f1b77fff700 1 --2- 172.21.15.26:0/2377687404 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1b600640b0 0x7f1b60066570 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f1b780f6b50 tx=0x7f1b6c009be0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:40:06.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.196+0000 7f1b74ff9700 1 -- 172.21.15.26:0/2377687404 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f1b680549b0 con 0x7f1b780f9830 2021-11-03T17:40:06.370 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.375+0000 7f1b7e996700 1 -- 172.21.15.26:0/2377687404 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b78057f10 con 0x7f1b600640b0 2021-11-03T17:40:06.371 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.377+0000 7f1b74ff9700 1 -- 172.21.15.26:0/2377687404 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f1b78057f10 con 0x7f1b600640b0 2021-11-03T17:40:06.373 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.379+0000 7f1b7e996700 1 -- 172.21.15.26:0/2377687404 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1b600640b0 msgr2=0x7f1b60066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:40:06.374 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.379+0000 7f1b7e996700 1 --2- 172.21.15.26:0/2377687404 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1b600640b0 0x7f1b60066570 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f1b780f6b50 tx=0x7f1b6c009be0).stop 2021-11-03T17:40:06.374 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.379+0000 7f1b7e996700 1 -- 172.21.15.26:0/2377687404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b780f9830 msgr2=0x7f1b780f5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:40:06.374 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.379+0000 7f1b7e996700 1 --2- 172.21.15.26:0/2377687404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b780f9830 0x7f1b780f5240 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f1b68013a70 tx=0x7f1b68009b30).stop 2021-11-03T17:40:06.375 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.379+0000 7f1b7e996700 1 -- 172.21.15.26:0/2377687404 shutdown_connections 2021-11-03T17:40:06.375 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.379+0000 7f1b7e996700 1 --2- 172.21.15.26:0/2377687404 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1b600640b0 0x7f1b60066570 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:06.375 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.379+0000 7f1b7e996700 1 --2- 172.21.15.26:0/2377687404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b78060370 0x7f1b780f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:06.375 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.379+0000 7f1b7e996700 1 --2- 172.21.15.26:0/2377687404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b780f9830 0x7f1b780f5240 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:06.375 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.379+0000 7f1b7e996700 1 -- 172.21.15.26:0/2377687404 >> 172.21.15.26:0/2377687404 conn(0x7f1b780f0d40 msgr2=0x7f1b780f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:40:06.376 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.379+0000 7f1b7e996700 1 -- 172.21.15.26:0/2377687404 shutdown_connections 2021-11-03T17:40:06.376 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.379+0000 7f1b7e996700 1 -- 172.21.15.26:0/2377687404 wait complete. 2021-11-03T17:40:06.383 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:40:06.474 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.479+0000 7faf31f11700 1 -- 172.21.15.26:0/207256135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf2c0f96b0 msgr2=0x7faf2c0fbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:40:06.474 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.479+0000 7faf31f11700 1 --2- 172.21.15.26:0/207256135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf2c0f96b0 0x7faf2c0fbb00 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7faf18004660 tx=0x7faf18009b30).stop 2021-11-03T17:40:06.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.479+0000 7faf31f11700 1 -- 172.21.15.26:0/207256135 shutdown_connections 2021-11-03T17:40:06.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.479+0000 7faf31f11700 1 --2- 172.21.15.26:0/207256135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf2c0f96b0 0x7faf2c0fbb00 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:06.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.479+0000 7faf31f11700 1 --2- 172.21.15.26:0/207256135 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf2c060270 0x7faf2c0f91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:40:06.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.479+0000 7faf31f11700 1 -- 172.21.15.26:0/207256135 >> 172.21.15.26:0/207256135 conn(0x7faf2c0f0ba0 msgr2=0x7faf2c0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:40:06.476 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.479+0000 7faf31f11700 1 -- 172.21.15.26:0/207256135 shutdown_connections 2021-11-03T17:40:06.476 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.479+0000 7faf31f11700 1 -- 172.21.15.26:0/207256135 wait complete. 2021-11-03T17:40:06.476 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.480+0000 7faf31f11700 1 Processor -- start 2021-11-03T17:40:06.476 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.480+0000 7faf31f11700 1 -- start start 2021-11-03T17:40:06.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.480+0000 7faf31f11700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf2c060270 0x7faf2c0f6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:40:06.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.480+0000 7faf31f11700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf2c0f96b0 0x7faf2c0f50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:40:06.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.480+0000 7faf31f11700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c0f56b0 con 0x7faf2c0f96b0 2021-11-03T17:40:06.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.480+0000 7faf31f11700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c0f57f0 con 0x7faf2c060270 2021-11-03T17:40:06.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.480+0000 7faf2bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf2c0f96b0 0x7faf2c0f50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:40:06.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.480+0000 7faf2bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf2c0f96b0 0x7faf2c0f50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55682/0 (socket says 172.21.15.26:55682) 2021-11-03T17:40:06.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.480+0000 7faf2bfff700 1 -- 172.21.15.26:0/610036046 learned_addr learned my addr 172.21.15.26:0/610036046 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:40:06.481 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.480+0000 7faf2bfff700 1 -- 172.21.15.26:0/610036046 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf2c060270 msgr2=0x7faf2c0f6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:40:06.481 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.480+0000 7faf2bfff700 1 --2- 172.21.15.26:0/610036046 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf2c060270 0x7faf2c0f6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:40:06.481 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.480+0000 7faf2bfff700 1 -- 172.21.15.26:0/610036046 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf18005040 con 0x7faf2c0f96b0 2021-11-03T17:40:06.481 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.480+0000 7faf2bfff700 1 --2- 172.21.15.26:0/610036046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf2c0f96b0 0x7faf2c0f50c0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7faf18004f60 tx=0x7faf18009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:40:06.482 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.481+0000 7faf297fa700 1 -- 172.21.15.26:0/610036046 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf18018070 con 0x7faf2c0f96b0 2021-11-03T17:40:06.482 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.481+0000 7faf297fa700 1 -- 172.21.15.26:0/610036046 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7faf18007c70 con 0x7faf2c0f96b0 2021-11-03T17:40:06.482 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.481+0000 7faf31f11700 1 -- 172.21.15.26:0/610036046 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf2c0f5a70 con 0x7faf2c0f96b0 2021-11-03T17:40:06.482 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.481+0000 7faf297fa700 1 -- 172.21.15.26:0/610036046 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf1801c620 con 0x7faf2c0f96b0 2021-11-03T17:40:06.482 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.481+0000 7faf31f11700 1 -- 172.21.15.26:0/610036046 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf2c10edb0 con 0x7faf2c0f96b0 2021-11-03T17:40:06.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.482+0000 7faf31f11700 1 -- 172.21.15.26:0/610036046 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf2c045ad0 con 0x7faf2c0f96b0 2021-11-03T17:40:06.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.482+0000 7faf297fa700 1 -- 172.21.15.26:0/610036046 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7faf1801d420 con 0x7faf2c0f96b0 2021-11-03T17:40:06.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.482+0000 7faf297fa700 1 --2- 172.21.15.26:0/610036046 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faf1c064100 0x7faf1c0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:40:06.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.483+0000 7faf297fa700 1 -- 172.21.15.26:0/610036046 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7faf180825f0 con 0x7faf2c0f96b0 2021-11-03T17:40:06.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.483+0000 7faf30f0f700 1 --2- 172.21.15.26:0/610036046 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faf1c064100 0x7faf1c0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:40:06.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.483+0000 7faf30f0f700 1 --2- 172.21.15.26:0/610036046 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faf1c064100 0x7faf1c0665c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7faf2c0f69d0 tx=0x7faf20006ab0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:40:06.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.487+0000 7faf297fa700 1 -- 172.21.15.26:0/610036046 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7faf18054950 con 0x7faf2c0f96b0 2021-11-03T17:40:06.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.659+0000 7faf31f11700 1 -- 172.21.15.26:0/610036046 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7faf2c0fef40 con 0x7faf1c064100 2021-11-03T17:40:06.668 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.673+0000 7faf297fa700 1 -- 172.21.15.26:0/610036046 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7faf20009180 con 0x7faf1c064100 2021-11-03T17:40:06.669 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:40:06.669 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (51m) 48s ago 52m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:40:06.669 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (43m) 48s ago 52m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:40:06.670 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (43m) 9m ago 51m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:40:06.670 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (51m) 48s ago 52m 40.8M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:40:06.670 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (44m) 48s ago 47m 25.1M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:40:06.670 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (44m) 48s ago 47m 25.7M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:40:06.671 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (47m) 9m ago 47m 24.8M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:40:06.671 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (47m) 9m ago 47m 25.0M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:40:06.671 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (45m) 48s ago 53m 533M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:40:06.671 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (44m) 9m ago 51m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:40:06.672 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (44m) 48s ago 54m 209M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:40:06.672 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (44m) 9m ago 51m 89.5M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:40:06.672 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (52m) 48s ago 52m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:40:06.672 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (51m) 9m ago 51m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:40:06.672 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (43m) 48s ago 50m 251M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:40:06.673 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (42m) 48s ago 50m 270M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:40:06.673 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (42m) 48s ago 50m 225M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:40:06.673 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (41m) 9m ago 49m 262M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:40:06.674 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (41m) 9m ago 49m 227M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:40:06.674 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (40m) 9m ago 49m 215M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:40:06.674 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (51m) 48s ago 51m 56.7M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:40:06.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.675+0000 7faf31f11700 1 -- 172.21.15.26:0/610036046 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faf1c064100 msgr2=0x7faf1c0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:40:06.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.675+0000 7faf31f11700 1 --2- 172.21.15.26:0/610036046 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faf1c064100 0x7faf1c0665c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7faf2c0f69d0 tx=0x7faf20006ab0).stop 2021-11-03T17:40:06.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.675+0000 7faf31f11700 1 -- 172.21.15.26:0/610036046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf2c0f96b0 msgr2=0x7faf2c0f50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:40:06.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.675+0000 7faf31f11700 1 --2- 172.21.15.26:0/610036046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf2c0f96b0 0x7faf2c0f50c0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7faf18004f60 tx=0x7faf18009b30).stop 2021-11-03T17:40:06.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.675+0000 7faf31f11700 1 -- 172.21.15.26:0/610036046 shutdown_connections 2021-11-03T17:40:06.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.675+0000 7faf31f11700 1 --2- 172.21.15.26:0/610036046 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faf1c064100 0x7faf1c0665c0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:06.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.675+0000 7faf31f11700 1 --2- 172.21.15.26:0/610036046 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf2c060270 0x7faf2c0f6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:40:06.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.675+0000 7faf31f11700 1 --2- 172.21.15.26:0/610036046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf2c0f96b0 0x7faf2c0f50c0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:06.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.675+0000 7faf31f11700 1 -- 172.21.15.26:0/610036046 >> 172.21.15.26:0/610036046 conn(0x7faf2c0f0ba0 msgr2=0x7faf2c0f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:40:06.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.675+0000 7faf31f11700 1 -- 172.21.15.26:0/610036046 shutdown_connections 2021-11-03T17:40:06.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.675+0000 7faf31f11700 1 -- 172.21.15.26:0/610036046 wait complete. 2021-11-03T17:40:06.678 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:06 smithi026 ceph-mon[96795]: pgmap v1363: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:06.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:06 smithi194 ceph-mon[65619]: pgmap v1363: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:06.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.774+0000 7f6d8759e700 1 -- 172.21.15.26:0/1104997129 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d880f63b0 msgr2=0x7f6d880f6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:40:06.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.774+0000 7f6d8759e700 1 --2- 172.21.15.26:0/1104997129 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d880f63b0 0x7f6d880f6810 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f6d7c004660 tx=0x7f6d7c009b30).stop 2021-11-03T17:40:06.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.774+0000 7f6d8759e700 1 -- 172.21.15.26:0/1104997129 shutdown_connections 2021-11-03T17:40:06.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.774+0000 7f6d8759e700 1 --2- 172.21.15.26:0/1104997129 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d880f63b0 0x7f6d880f6810 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:06.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.774+0000 7f6d8759e700 1 --2- 172.21.15.26:0/1104997129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d880f5a10 0x7f6d880f5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:06.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.774+0000 7f6d8759e700 1 -- 172.21.15.26:0/1104997129 >> 172.21.15.26:0/1104997129 conn(0x7f6d880f0320 msgr2=0x7f6d880f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:40:06.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.774+0000 7f6d8759e700 1 -- 172.21.15.26:0/1104997129 shutdown_connections 2021-11-03T17:40:06.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.774+0000 7f6d8759e700 1 -- 172.21.15.26:0/1104997129 wait complete. 2021-11-03T17:40:06.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.775+0000 7f6d8759e700 1 Processor -- start 2021-11-03T17:40:06.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.775+0000 7f6d8759e700 1 -- start start 2021-11-03T17:40:06.774 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.775+0000 7f6d8759e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d880f5a10 0x7f6d88106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:40:06.774 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.775+0000 7f6d8759e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d880f63b0 0x7f6d88107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:40:06.774 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.775+0000 7f6d8759e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d88107880 con 0x7f6d880f5a10 2021-11-03T17:40:06.774 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.775+0000 7f6d8759e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d881080c0 con 0x7f6d880f63b0 2021-11-03T17:40:06.774 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.775+0000 7f6d8659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d880f5a10 0x7f6d88106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:40:06.775 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.775+0000 7f6d8659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d880f5a10 0x7f6d88106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55690/0 (socket says 172.21.15.26:55690) 2021-11-03T17:40:06.775 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.775+0000 7f6d8659c700 1 -- 172.21.15.26:0/748509424 learned_addr learned my addr 172.21.15.26:0/748509424 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:40:06.775 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.775+0000 7f6d85d9b700 1 --2- 172.21.15.26:0/748509424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d880f63b0 0x7f6d88107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:40:06.775 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.776+0000 7f6d8659c700 1 -- 172.21.15.26:0/748509424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d880f63b0 msgr2=0x7f6d88107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:40:06.775 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.776+0000 7f6d8659c700 1 --2- 172.21.15.26:0/748509424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d880f63b0 0x7f6d88107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:06.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.776+0000 7f6d8659c700 1 -- 172.21.15.26:0/748509424 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d7c005040 con 0x7f6d880f5a10 2021-11-03T17:40:06.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.776+0000 7f6d8659c700 1 --2- 172.21.15.26:0/748509424 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d880f5a10 0x7f6d88106d90 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7f6d78002700 tx=0x7f6d78009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:40:06.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.776+0000 7f6d76ffd700 1 -- 172.21.15.26:0/748509424 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d78009320 con 0x7f6d880f5a10 2021-11-03T17:40:06.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.776+0000 7f6d76ffd700 1 -- 172.21.15.26:0/748509424 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6d7800f040 con 0x7f6d880f5a10 2021-11-03T17:40:06.777 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.776+0000 7f6d8759e700 1 -- 172.21.15.26:0/748509424 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d881083a0 con 0x7f6d880f5a10 2021-11-03T17:40:06.777 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.776+0000 7f6d76ffd700 1 -- 172.21.15.26:0/748509424 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d78014900 con 0x7f6d880f5a10 2021-11-03T17:40:06.777 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.776+0000 7f6d8759e700 1 -- 172.21.15.26:0/748509424 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d881088e0 con 0x7f6d880f5a10 2021-11-03T17:40:06.777 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.777+0000 7f6d8759e700 1 -- 172.21.15.26:0/748509424 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d88059100 con 0x7f6d880f5a10 2021-11-03T17:40:06.778 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.777+0000 7f6d76ffd700 1 -- 172.21.15.26:0/748509424 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f6d78009480 con 0x7f6d880f5a10 2021-11-03T17:40:06.779 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.778+0000 7f6d76ffd700 1 --2- 172.21.15.26:0/748509424 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6d700641d0 0x7f6d70066690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:40:06.779 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.778+0000 7f6d76ffd700 1 -- 172.21.15.26:0/748509424 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f6d780808b0 con 0x7f6d880f5a10 2021-11-03T17:40:06.779 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.778+0000 7f6d85d9b700 1 --2- 172.21.15.26:0/748509424 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6d700641d0 0x7f6d70066690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:40:06.779 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.778+0000 7f6d85d9b700 1 --2- 172.21.15.26:0/748509424 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6d700641d0 0x7f6d70066690 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f6d7c004630 tx=0x7f6d7c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:40:06.780 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:06.782+0000 7f6d76ffd700 1 -- 172.21.15.26:0/748509424 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f6d78052c90 con 0x7f6d880f5a10 2021-11-03T17:40:07.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.013+0000 7f6d8759e700 1 -- 172.21.15.26:0/748509424 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6d8810d3a0 con 0x7f6d880f5a10 2021-11-03T17:40:07.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.013+0000 7f6d76ffd700 1 -- 172.21.15.26:0/748509424 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f6d78052880 con 0x7f6d880f5a10 2021-11-03T17:40:07.009 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:40:07.009 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:40:07.009 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:40:07.010 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:40:07.010 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:40:07.010 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:40:07.010 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:40:07.010 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:40:07.011 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:40:07.011 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:40:07.011 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:40:07.011 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:40:07.012 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:40:07.012 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:40:07.012 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:40:07.012 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:40:07.013 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:40:07.013 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:40:07.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.015+0000 7f6d8759e700 1 -- 172.21.15.26:0/748509424 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6d700641d0 msgr2=0x7f6d70066690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:40:07.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.015+0000 7f6d8759e700 1 --2- 172.21.15.26:0/748509424 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6d700641d0 0x7f6d70066690 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f6d7c004630 tx=0x7f6d7c009b30).stop 2021-11-03T17:40:07.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.015+0000 7f6d8759e700 1 -- 172.21.15.26:0/748509424 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d880f5a10 msgr2=0x7f6d88106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:40:07.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.015+0000 7f6d8759e700 1 --2- 172.21.15.26:0/748509424 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d880f5a10 0x7f6d88106d90 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7f6d78002700 tx=0x7f6d78009d80).stop 2021-11-03T17:40:07.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.015+0000 7f6d8759e700 1 -- 172.21.15.26:0/748509424 shutdown_connections 2021-11-03T17:40:07.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.015+0000 7f6d8759e700 1 --2- 172.21.15.26:0/748509424 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6d700641d0 0x7f6d70066690 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:07.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.015+0000 7f6d8759e700 1 --2- 172.21.15.26:0/748509424 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d880f5a10 0x7f6d88106d90 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:07.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.015+0000 7f6d8759e700 1 --2- 172.21.15.26:0/748509424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d880f63b0 0x7f6d88107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:07.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.015+0000 7f6d8759e700 1 -- 172.21.15.26:0/748509424 >> 172.21.15.26:0/748509424 conn(0x7f6d880f0320 msgr2=0x7f6d880f4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:40:07.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.015+0000 7f6d8759e700 1 -- 172.21.15.26:0/748509424 shutdown_connections 2021-11-03T17:40:07.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.015+0000 7f6d8759e700 1 -- 172.21.15.26:0/748509424 wait complete. 2021-11-03T17:40:07.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.115+0000 7f0ef9147700 1 -- 172.21.15.26:0/2605294683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ef40f66e0 msgr2=0x7f0ef40f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:40:07.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.115+0000 7f0ef9147700 1 --2- 172.21.15.26:0/2605294683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ef40f66e0 0x7f0ef40f6b40 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7f0ee4004660 tx=0x7f0ee4009b30).stop 2021-11-03T17:40:07.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.115+0000 7f0ef9147700 1 -- 172.21.15.26:0/2605294683 shutdown_connections 2021-11-03T17:40:07.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.115+0000 7f0ef9147700 1 --2- 172.21.15.26:0/2605294683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ef40f66e0 0x7f0ef40f6b40 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:07.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.115+0000 7f0ef9147700 1 --2- 172.21.15.26:0/2605294683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ef40f5440 0x7f0ef40f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:07.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.115+0000 7f0ef9147700 1 -- 172.21.15.26:0/2605294683 >> 172.21.15.26:0/2605294683 conn(0x7f0ef40f0ba0 msgr2=0x7f0ef40f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:40:07.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.116+0000 7f0ef9147700 1 -- 172.21.15.26:0/2605294683 shutdown_connections 2021-11-03T17:40:07.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.116+0000 7f0ef9147700 1 -- 172.21.15.26:0/2605294683 wait complete. 2021-11-03T17:40:07.113 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.116+0000 7f0ef9147700 1 Processor -- start 2021-11-03T17:40:07.113 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.116+0000 7f0ef9147700 1 -- start start 2021-11-03T17:40:07.115 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.116+0000 7f0ef9147700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ef40f5440 0x7f0ef4106dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:40:07.116 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.116+0000 7f0ef9147700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ef40f66e0 0x7f0ef41072c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:40:07.116 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.116+0000 7f0ef9147700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef41078c0 con 0x7f0ef40f5440 2021-11-03T17:40:07.116 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.116+0000 7f0ef9147700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef4108100 con 0x7f0ef40f66e0 2021-11-03T17:40:07.116 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.117+0000 7f0ef3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ef40f5440 0x7f0ef4106dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:40:07.117 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.117+0000 7f0ef3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ef40f5440 0x7f0ef4106dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55700/0 (socket says 172.21.15.26:55700) 2021-11-03T17:40:07.117 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.117+0000 7f0ef3fff700 1 -- 172.21.15.26:0/2302069624 learned_addr learned my addr 172.21.15.26:0/2302069624 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:40:07.117 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.117+0000 7f0ef37fe700 1 --2- 172.21.15.26:0/2302069624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ef40f66e0 0x7f0ef41072c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:40:07.117 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.117+0000 7f0ef3fff700 1 -- 172.21.15.26:0/2302069624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ef40f66e0 msgr2=0x7f0ef41072c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:40:07.117 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.117+0000 7f0ef3fff700 1 --2- 172.21.15.26:0/2302069624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ef40f66e0 0x7f0ef41072c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:07.118 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.117+0000 7f0ef3fff700 1 -- 172.21.15.26:0/2302069624 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee4005040 con 0x7f0ef40f5440 2021-11-03T17:40:07.118 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.117+0000 7f0ef3fff700 1 --2- 172.21.15.26:0/2302069624 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ef40f5440 0x7f0ef4106dd0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f0ee8002700 tx=0x7f0ee8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:40:07.118 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.117+0000 7f0ef0ff9700 1 -- 172.21.15.26:0/2302069624 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ee80079c0 con 0x7f0ef40f5440 2021-11-03T17:40:07.118 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.117+0000 7f0ef9147700 1 -- 172.21.15.26:0/2302069624 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef41083e0 con 0x7f0ef40f5440 2021-11-03T17:40:07.119 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.117+0000 7f0ef0ff9700 1 -- 172.21.15.26:0/2302069624 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0ee800f040 con 0x7f0ef40f5440 2021-11-03T17:40:07.119 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.117+0000 7f0ef0ff9700 1 -- 172.21.15.26:0/2302069624 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ee8014860 con 0x7f0ef40f5440 2021-11-03T17:40:07.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.117+0000 7f0ef9147700 1 -- 172.21.15.26:0/2302069624 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef4108920 con 0x7f0ef40f5440 2021-11-03T17:40:07.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.118+0000 7f0ef9147700 1 -- 172.21.15.26:0/2302069624 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef4059100 con 0x7f0ef40f5440 2021-11-03T17:40:07.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.119+0000 7f0ef0ff9700 1 -- 172.21.15.26:0/2302069624 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f0ee801b060 con 0x7f0ef40f5440 2021-11-03T17:40:07.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.119+0000 7f0ef0ff9700 1 --2- 172.21.15.26:0/2302069624 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0edc064100 0x7f0edc0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:40:07.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.119+0000 7f0ef0ff9700 1 -- 172.21.15.26:0/2302069624 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f0ee8080660 con 0x7f0ef40f5440 2021-11-03T17:40:07.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.119+0000 7f0ef37fe700 1 --2- 172.21.15.26:0/2302069624 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0edc064100 0x7f0edc0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:40:07.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.119+0000 7f0ef37fe700 1 --2- 172.21.15.26:0/2302069624 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0edc064100 0x7f0edc0665c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f0ee4004630 tx=0x7f0ee4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:40:07.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.123+0000 7f0ef0ff9700 1 -- 172.21.15.26:0/2302069624 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f0ee80529c0 con 0x7f0ef40f5440 2021-11-03T17:40:07.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.326+0000 7f0ef9147700 1 -- 172.21.15.26:0/2302069624 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0ef410d3e0 con 0x7f0ef40f5440 2021-11-03T17:40:07.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.327+0000 7f0ef0ff9700 1 -- 172.21.15.26:0/2302069624 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f0ee8019070 con 0x7f0ef40f5440 2021-11-03T17:40:07.322 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:40:07.323 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:40:07.323 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:40:07.323 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:40:07.323 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:40:07.323 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:40:07.324 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:40:07.324 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:40:07.324 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:40:07.324 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:40:07.325 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:40:07.325 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:40:07.325 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:40:07.325 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:40:07.326 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:40:07.326 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:40:07.326 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:40:07.326 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:40:07.327 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:40:07.327 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:40:07.327 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:40:07.327 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:40:07.327 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:40:07.328 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:40:07.328 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:40:07.328 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:40:07.328 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:40:07.329 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:40:07.329 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:40:07.329 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:40:07.329 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:40:07.329 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:40:07.330 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:40:07.330 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:40:07.330 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:40:07.330 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:40:07.331 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:40:07.331 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:40:07.331 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:40:07.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.328+0000 7f0ef9147700 1 -- 172.21.15.26:0/2302069624 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0edc064100 msgr2=0x7f0edc0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:40:07.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.328+0000 7f0ef9147700 1 --2- 172.21.15.26:0/2302069624 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0edc064100 0x7f0edc0665c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f0ee4004630 tx=0x7f0ee4009b30).stop 2021-11-03T17:40:07.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.328+0000 7f0ef9147700 1 -- 172.21.15.26:0/2302069624 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ef40f5440 msgr2=0x7f0ef4106dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:40:07.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.328+0000 7f0ef9147700 1 --2- 172.21.15.26:0/2302069624 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ef40f5440 0x7f0ef4106dd0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f0ee8002700 tx=0x7f0ee8009d80).stop 2021-11-03T17:40:07.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.329+0000 7f0ef9147700 1 -- 172.21.15.26:0/2302069624 shutdown_connections 2021-11-03T17:40:07.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.329+0000 7f0ef9147700 1 --2- 172.21.15.26:0/2302069624 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0edc064100 0x7f0edc0665c0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:07.334 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.329+0000 7f0ef9147700 1 --2- 172.21.15.26:0/2302069624 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ef40f5440 0x7f0ef4106dd0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:07.334 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.329+0000 7f0ef9147700 1 --2- 172.21.15.26:0/2302069624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ef40f66e0 0x7f0ef41072c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:07.334 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.329+0000 7f0ef9147700 1 -- 172.21.15.26:0/2302069624 >> 172.21.15.26:0/2302069624 conn(0x7f0ef40f0ba0 msgr2=0x7f0ef405f620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:40:07.334 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.329+0000 7f0ef9147700 1 -- 172.21.15.26:0/2302069624 shutdown_connections 2021-11-03T17:40:07.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:07.329+0000 7f0ef9147700 1 -- 172.21.15.26:0/2302069624 wait complete. 2021-11-03T17:40:07.335 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:40:07.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:07 smithi026 ceph-mon[96795]: from='client.35548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:40:07.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:07 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/748509424' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:40:07.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:07 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2302069624' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:40:07.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:07 smithi194 ceph-mon[65619]: from='client.35548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:40:07.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:07 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/748509424' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:40:07.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:07 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2302069624' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:40:08.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:08 smithi026 ceph-mon[96795]: from='client.35552 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:40:08.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:08 smithi026 ceph-mon[96795]: pgmap v1364: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:08.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:08 smithi194 ceph-mon[65619]: from='client.35552 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:40:08.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:08 smithi194 ceph-mon[65619]: pgmap v1364: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:10.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:10 smithi026 ceph-mon[96795]: pgmap v1365: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:10.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:10 smithi194 ceph-mon[65619]: pgmap v1365: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:12.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:12 smithi026 ceph-mon[96795]: pgmap v1366: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:12.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:12 smithi194 ceph-mon[65619]: pgmap v1366: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:14.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:14 smithi026 ceph-mon[96795]: pgmap v1367: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:14.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:14 smithi194 ceph-mon[65619]: pgmap v1367: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:16.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:16 smithi026 ceph-mon[96795]: pgmap v1368: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:16.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:16 smithi194 ceph-mon[65619]: pgmap v1368: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:18.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:18 smithi194 ceph-mon[65619]: pgmap v1369: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:18.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:18 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:40:18.582 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:18 smithi026 ceph-mon[96795]: pgmap v1369: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:18.583 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:18 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:40:19.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:19 smithi026 ceph-mon[96795]: poll took 60060.291 ms: 1 events 2021-11-03T17:40:19.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:19 smithi194 ceph-mon[65619]: poll took 60060.291 ms: 1 events 2021-11-03T17:40:20.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:20 smithi026 ceph-mon[96795]: pgmap v1370: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:20.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:20 smithi194 ceph-mon[65619]: pgmap v1370: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:22.420 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:22 smithi026 ceph-mon[96795]: pgmap v1371: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:22.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:22 smithi026 ceph-mon[96795]: poll took 2527.125 ms: 1 events 2021-11-03T17:40:22.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:22 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:40:22.421 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:22 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:40:22.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:22 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:40:22.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:22 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:40:22.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:22 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:40:22.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:22 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:40:22.422 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:22 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:40:22.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:22 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:40:22.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:22 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:40:22.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:22 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:40:22.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:22 smithi194 ceph-mon[65619]: pgmap v1371: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:22.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:22 smithi194 ceph-mon[65619]: poll took 2527.125 ms: 1 events 2021-11-03T17:40:22.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:22 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:40:22.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:22 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:40:22.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:22 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:40:22.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:22 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:40:22.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:22 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:40:22.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:22 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:40:22.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:22 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:40:22.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:22 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:40:22.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:22 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:40:22.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:22 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:40:24.420 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:24 smithi026 ceph-mon[96795]: pgmap v1372: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:24.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:24 smithi194 ceph-mon[65619]: pgmap v1372: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:26.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:26 smithi026 ceph-mon[96795]: pgmap v1373: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:26.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:26 smithi194 ceph-mon[65619]: pgmap v1373: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:28.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:28 smithi026 ceph-mon[96795]: pgmap v1374: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:28.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:28 smithi194 ceph-mon[65619]: pgmap v1374: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:30.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:30 smithi026 ceph-mon[96795]: pgmap v1375: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:30.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:30 smithi194 ceph-mon[65619]: pgmap v1375: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:32.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:32 smithi026 ceph-mon[96795]: pgmap v1376: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:32.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:32 smithi194 ceph-mon[65619]: pgmap v1376: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:34.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:34 smithi026 ceph-mon[96795]: pgmap v1377: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:34.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:34 smithi194 ceph-mon[65619]: pgmap v1377: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:36.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:36 smithi026 ceph-mon[96795]: pgmap v1378: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:36.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:36 smithi194 ceph-mon[65619]: pgmap v1378: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:37.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.445+0000 7f88f702a700 1 -- 172.21.15.26:0/2151097251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88f00f5ef0 msgr2=0x7f88f00f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:40:37.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.445+0000 7f88f702a700 1 --2- 172.21.15.26:0/2151097251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88f00f5ef0 0x7f88f00f6920 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7f88e00099e0 tx=0x7f88e0004d10).stop 2021-11-03T17:40:37.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.445+0000 7f88f702a700 1 -- 172.21.15.26:0/2151097251 shutdown_connections 2021-11-03T17:40:37.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.445+0000 7f88f702a700 1 --2- 172.21.15.26:0/2151097251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88f00f5ef0 0x7f88f00f6920 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:37.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.445+0000 7f88f702a700 1 --2- 172.21.15.26:0/2151097251 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88f00f55e0 0x7f88f00f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:37.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.445+0000 7f88f702a700 1 -- 172.21.15.26:0/2151097251 >> 172.21.15.26:0/2151097251 conn(0x7f88f00f0de0 msgr2=0x7f88f00f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:40:37.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.445+0000 7f88f702a700 1 -- 172.21.15.26:0/2151097251 shutdown_connections 2021-11-03T17:40:37.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.445+0000 7f88f702a700 1 -- 172.21.15.26:0/2151097251 wait complete. 2021-11-03T17:40:37.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.445+0000 7f88f702a700 1 Processor -- start 2021-11-03T17:40:37.444 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.446+0000 7f88f702a700 1 -- start start 2021-11-03T17:40:37.444 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.446+0000 7f88f702a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88f00f55e0 0x7f88f0105f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:40:37.444 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.446+0000 7f88f702a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88f00f5ef0 0x7f88f0106450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:40:37.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.446+0000 7f88f702a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f0106a00 con 0x7f88f00f55e0 2021-11-03T17:40:37.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.446+0000 7f88f702a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f0106b40 con 0x7f88f00f5ef0 2021-11-03T17:40:37.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.446+0000 7f88f4dc6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88f00f55e0 0x7f88f0105f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:40:37.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.446+0000 7f88f4dc6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88f00f55e0 0x7f88f0105f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55718/0 (socket says 172.21.15.26:55718) 2021-11-03T17:40:37.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.446+0000 7f88f4dc6700 1 -- 172.21.15.26:0/269440500 learned_addr learned my addr 172.21.15.26:0/269440500 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:40:37.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.447+0000 7f88effff700 1 --2- 172.21.15.26:0/269440500 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88f00f5ef0 0x7f88f0106450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:40:37.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.447+0000 7f88f4dc6700 1 -- 172.21.15.26:0/269440500 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88f00f5ef0 msgr2=0x7f88f0106450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:40:37.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.447+0000 7f88f4dc6700 1 --2- 172.21.15.26:0/269440500 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88f00f5ef0 0x7f88f0106450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:37.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.447+0000 7f88f4dc6700 1 -- 172.21.15.26:0/269440500 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e0009640 con 0x7f88f00f55e0 2021-11-03T17:40:37.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.447+0000 7f88f4dc6700 1 --2- 172.21.15.26:0/269440500 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88f00f55e0 0x7f88f0105f60 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7f88e800f940 tx=0x7f88e8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:40:37.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.447+0000 7f88ed7fa700 1 -- 172.21.15.26:0/269440500 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88e8009500 con 0x7f88f00f55e0 2021-11-03T17:40:37.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.447+0000 7f88f702a700 1 -- 172.21.15.26:0/269440500 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f01074e0 con 0x7f88f00f55e0 2021-11-03T17:40:37.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.447+0000 7f88ed7fa700 1 -- 172.21.15.26:0/269440500 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f88e8009660 con 0x7f88f00f55e0 2021-11-03T17:40:37.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.447+0000 7f88ed7fa700 1 -- 172.21.15.26:0/269440500 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88e800de30 con 0x7f88f00f55e0 2021-11-03T17:40:37.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.447+0000 7f88f702a700 1 -- 172.21.15.26:0/269440500 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f0107a20 con 0x7f88f00f55e0 2021-11-03T17:40:37.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.448+0000 7f88f702a700 1 -- 172.21.15.26:0/269440500 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88f0045ad0 con 0x7f88f00f55e0 2021-11-03T17:40:37.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.449+0000 7f88ed7fa700 1 -- 172.21.15.26:0/269440500 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f88e800e040 con 0x7f88f00f55e0 2021-11-03T17:40:37.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.449+0000 7f88ed7fa700 1 --2- 172.21.15.26:0/269440500 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f88dc0640b0 0x7f88dc066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:40:37.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.449+0000 7f88ed7fa700 1 -- 172.21.15.26:0/269440500 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f88e8083390 con 0x7f88f00f55e0 2021-11-03T17:40:37.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.449+0000 7f88effff700 1 --2- 172.21.15.26:0/269440500 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f88dc0640b0 0x7f88dc066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:40:37.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.450+0000 7f88effff700 1 --2- 172.21.15.26:0/269440500 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f88dc0640b0 0x7f88dc066570 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f88e0003380 tx=0x7f88e0004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:40:37.450 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.453+0000 7f88ed7fa700 1 -- 172.21.15.26:0/269440500 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f88e8055600 con 0x7f88f00f55e0 2021-11-03T17:40:37.626 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.632+0000 7f88f702a700 1 -- 172.21.15.26:0/269440500 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f88f005f720 con 0x7f88dc0640b0 2021-11-03T17:40:37.627 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.634+0000 7f88ed7fa700 1 -- 172.21.15.26:0/269440500 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f88f005f720 con 0x7f88dc0640b0 2021-11-03T17:40:37.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.635+0000 7f88f702a700 1 -- 172.21.15.26:0/269440500 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f88dc0640b0 msgr2=0x7f88dc066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:40:37.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.635+0000 7f88f702a700 1 --2- 172.21.15.26:0/269440500 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f88dc0640b0 0x7f88dc066570 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f88e0003380 tx=0x7f88e0004d10).stop 2021-11-03T17:40:37.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.635+0000 7f88f702a700 1 -- 172.21.15.26:0/269440500 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88f00f55e0 msgr2=0x7f88f0105f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:40:37.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.635+0000 7f88f702a700 1 --2- 172.21.15.26:0/269440500 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88f00f55e0 0x7f88f0105f60 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7f88e800f940 tx=0x7f88e8009de0).stop 2021-11-03T17:40:37.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.635+0000 7f88f702a700 1 -- 172.21.15.26:0/269440500 shutdown_connections 2021-11-03T17:40:37.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.635+0000 7f88f702a700 1 --2- 172.21.15.26:0/269440500 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f88dc0640b0 0x7f88dc066570 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:37.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.635+0000 7f88f702a700 1 --2- 172.21.15.26:0/269440500 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88f00f55e0 0x7f88f0105f60 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:37.631 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.635+0000 7f88f702a700 1 --2- 172.21.15.26:0/269440500 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88f00f5ef0 0x7f88f0106450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:37.631 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.635+0000 7f88f702a700 1 -- 172.21.15.26:0/269440500 >> 172.21.15.26:0/269440500 conn(0x7f88f00f0de0 msgr2=0x7f88f00fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:40:37.631 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.635+0000 7f88f702a700 1 -- 172.21.15.26:0/269440500 shutdown_connections 2021-11-03T17:40:37.631 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.635+0000 7f88f702a700 1 -- 172.21.15.26:0/269440500 wait complete. 2021-11-03T17:40:37.639 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:40:37.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:37 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:40:37.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:37 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:40:37.729 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.735+0000 7f820d4b4700 1 -- 172.21.15.26:0/515206260 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82080f66d0 msgr2=0x7f82080f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:40:37.730 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.735+0000 7f820d4b4700 1 --2- 172.21.15.26:0/515206260 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82080f66d0 0x7f82080f6b30 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7f81fc004660 tx=0x7f81fc009b30).stop 2021-11-03T17:40:37.730 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.735+0000 7f820d4b4700 1 -- 172.21.15.26:0/515206260 shutdown_connections 2021-11-03T17:40:37.730 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.735+0000 7f820d4b4700 1 --2- 172.21.15.26:0/515206260 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82080f66d0 0x7f82080f6b30 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:37.730 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.735+0000 7f820d4b4700 1 --2- 172.21.15.26:0/515206260 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82080f5430 0x7f82080f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:37.731 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.735+0000 7f820d4b4700 1 -- 172.21.15.26:0/515206260 >> 172.21.15.26:0/515206260 conn(0x7f82080f0b90 msgr2=0x7f82080f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:40:37.731 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.735+0000 7f820d4b4700 1 -- 172.21.15.26:0/515206260 shutdown_connections 2021-11-03T17:40:37.731 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.735+0000 7f820d4b4700 1 -- 172.21.15.26:0/515206260 wait complete. 2021-11-03T17:40:37.731 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.736+0000 7f820d4b4700 1 Processor -- start 2021-11-03T17:40:37.732 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.736+0000 7f820d4b4700 1 -- start start 2021-11-03T17:40:37.734 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.736+0000 7f820d4b4700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82080f5430 0x7f8208106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:40:37.734 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.736+0000 7f820d4b4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82080f66d0 0x7f8208107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:40:37.734 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.736+0000 7f820d4b4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8208107870 con 0x7f82080f66d0 2021-11-03T17:40:37.735 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.736+0000 7f820d4b4700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82081080b0 con 0x7f82080f5430 2021-11-03T17:40:37.735 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.736+0000 7f82077fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82080f66d0 0x7f8208107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:40:37.735 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.736+0000 7f82077fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82080f66d0 0x7f8208107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55732/0 (socket says 172.21.15.26:55732) 2021-11-03T17:40:37.735 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.736+0000 7f82077fe700 1 -- 172.21.15.26:0/1707165333 learned_addr learned my addr 172.21.15.26:0/1707165333 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:40:37.736 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.736+0000 7f8207fff700 1 --2- 172.21.15.26:0/1707165333 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82080f5430 0x7f8208106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:40:37.736 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.737+0000 7f82077fe700 1 -- 172.21.15.26:0/1707165333 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82080f5430 msgr2=0x7f8208106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:40:37.736 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.737+0000 7f82077fe700 1 --2- 172.21.15.26:0/1707165333 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82080f5430 0x7f8208106d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:37.736 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.737+0000 7f82077fe700 1 -- 172.21.15.26:0/1707165333 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81fc005040 con 0x7f82080f66d0 2021-11-03T17:40:37.736 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.737+0000 7f82077fe700 1 --2- 172.21.15.26:0/1707165333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82080f66d0 0x7f8208107270 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7f81fc009990 tx=0x7f81fc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:40:37.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.737+0000 7f8204ff9700 1 -- 172.21.15.26:0/1707165333 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81fc018070 con 0x7f82080f66d0 2021-11-03T17:40:37.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.737+0000 7f8204ff9700 1 -- 172.21.15.26:0/1707165333 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f81fc007ba0 con 0x7f82080f66d0 2021-11-03T17:40:37.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.737+0000 7f8204ff9700 1 -- 172.21.15.26:0/1707165333 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81fc01c620 con 0x7f82080f66d0 2021-11-03T17:40:37.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.737+0000 7f820d4b4700 1 -- 172.21.15.26:0/1707165333 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8208108330 con 0x7f82080f66d0 2021-11-03T17:40:37.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.737+0000 7f820d4b4700 1 -- 172.21.15.26:0/1707165333 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8208108810 con 0x7f82080f66d0 2021-11-03T17:40:37.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.738+0000 7f820d4b4700 1 -- 172.21.15.26:0/1707165333 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8208059100 con 0x7f82080f66d0 2021-11-03T17:40:37.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.738+0000 7f8204ff9700 1 -- 172.21.15.26:0/1707165333 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f81fc01c8e0 con 0x7f82080f66d0 2021-11-03T17:40:37.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.739+0000 7f8204ff9700 1 --2- 172.21.15.26:0/1707165333 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f81f0064100 0x7f81f00665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:40:37.739 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.739+0000 7f8204ff9700 1 -- 172.21.15.26:0/1707165333 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f81fc082600 con 0x7f82080f66d0 2021-11-03T17:40:37.739 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.739+0000 7f8207fff700 1 --2- 172.21.15.26:0/1707165333 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f81f0064100 0x7f81f00665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:40:37.739 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.739+0000 7f8207fff700 1 --2- 172.21.15.26:0/1707165333 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f81f0064100 0x7f81f00665c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f8208107b40 tx=0x7f81f8009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:40:37.739 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.743+0000 7f8204ff9700 1 -- 172.21.15.26:0/1707165333 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f81fc054a20 con 0x7f82080f66d0 2021-11-03T17:40:37.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:37 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:40:37.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:37 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:40:37.907 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.913+0000 7f820d4b4700 1 -- 172.21.15.26:0/1707165333 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f82080fab10 con 0x7f81f0064100 2021-11-03T17:40:37.921 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.928+0000 7f8204ff9700 1 -- 172.21.15.26:0/1707165333 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f82080fab10 con 0x7f81f0064100 2021-11-03T17:40:37.922 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:40:37.922 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (51m) 80s ago 53m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:40:37.922 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (44m) 80s ago 53m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:40:37.923 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (43m) 16s ago 52m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:40:37.923 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (51m) 80s ago 52m 40.8M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:40:37.923 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (44m) 80s ago 48m 25.1M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:40:37.923 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (45m) 80s ago 48m 25.7M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:40:37.923 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (48m) 16s ago 48m 26.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:40:37.924 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (48m) 16s ago 48m 26.3M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:40:37.924 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (45m) 80s ago 54m 533M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:40:37.924 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (45m) 16s ago 52m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:40:37.924 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (44m) 80s ago 54m 209M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:40:37.925 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (44m) 16s ago 52m 103M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:40:37.925 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (52m) 80s ago 52m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:40:37.925 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (52m) 16s ago 52m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:40:37.925 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (43m) 80s ago 51m 251M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:40:37.926 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (43m) 80s ago 51m 270M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:40:37.926 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (42m) 80s ago 50m 225M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:40:37.926 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (42m) 16s ago 50m 287M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:40:37.926 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (41m) 16s ago 50m 246M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:40:37.926 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (41m) 16s ago 49m 235M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:40:37.927 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (51m) 80s ago 52m 56.7M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:40:37.927 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.930+0000 7f820d4b4700 1 -- 172.21.15.26:0/1707165333 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f81f0064100 msgr2=0x7f81f00665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:40:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.930+0000 7f820d4b4700 1 --2- 172.21.15.26:0/1707165333 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f81f0064100 0x7f81f00665c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f8208107b40 tx=0x7f81f8009040).stop 2021-11-03T17:40:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.930+0000 7f820d4b4700 1 -- 172.21.15.26:0/1707165333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82080f66d0 msgr2=0x7f8208107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:40:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.930+0000 7f820d4b4700 1 --2- 172.21.15.26:0/1707165333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82080f66d0 0x7f8208107270 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7f81fc009990 tx=0x7f81fc009b30).stop 2021-11-03T17:40:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.930+0000 7f820d4b4700 1 -- 172.21.15.26:0/1707165333 shutdown_connections 2021-11-03T17:40:37.929 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.930+0000 7f820d4b4700 1 --2- 172.21.15.26:0/1707165333 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f81f0064100 0x7f81f00665c0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:37.929 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.930+0000 7f820d4b4700 1 --2- 172.21.15.26:0/1707165333 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82080f5430 0x7f8208106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:37.929 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.930+0000 7f820d4b4700 1 --2- 172.21.15.26:0/1707165333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82080f66d0 0x7f8208107270 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:37.929 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.930+0000 7f820d4b4700 1 -- 172.21.15.26:0/1707165333 >> 172.21.15.26:0/1707165333 conn(0x7f82080f0b90 msgr2=0x7f820805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:40:37.930 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.930+0000 7f820d4b4700 1 -- 172.21.15.26:0/1707165333 shutdown_connections 2021-11-03T17:40:37.930 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:37.930+0000 7f820d4b4700 1 -- 172.21.15.26:0/1707165333 wait complete. 2021-11-03T17:40:38.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.030+0000 7fba28f5d700 1 -- 172.21.15.26:0/1111964329 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba240f49a0 msgr2=0x7fba240f4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:40:38.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.030+0000 7fba28f5d700 1 --2- 172.21.15.26:0/1111964329 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba240f49a0 0x7fba240f4dc0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7fba140099e0 tx=0x7fba14004d10).stop 2021-11-03T17:40:38.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.030+0000 7fba28f5d700 1 -- 172.21.15.26:0/1111964329 shutdown_connections 2021-11-03T17:40:38.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.030+0000 7fba28f5d700 1 --2- 172.21.15.26:0/1111964329 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba240f5340 0x7fba240f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:38.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.030+0000 7fba28f5d700 1 --2- 172.21.15.26:0/1111964329 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba240f49a0 0x7fba240f4dc0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:38.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.030+0000 7fba28f5d700 1 -- 172.21.15.26:0/1111964329 >> 172.21.15.26:0/1111964329 conn(0x7fba240f04c0 msgr2=0x7fba240f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:40:38.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.030+0000 7fba28f5d700 1 -- 172.21.15.26:0/1111964329 shutdown_connections 2021-11-03T17:40:38.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.030+0000 7fba28f5d700 1 -- 172.21.15.26:0/1111964329 wait complete. 2021-11-03T17:40:38.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.030+0000 7fba28f5d700 1 Processor -- start 2021-11-03T17:40:38.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.030+0000 7fba28f5d700 1 -- start start 2021-11-03T17:40:38.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.030+0000 7fba28f5d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba240f49a0 0x7fba241070e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:40:38.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.030+0000 7fba28f5d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba240f5340 0x7fba241075d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:40:38.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.030+0000 7fba28f5d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba24107b80 con 0x7fba240f49a0 2021-11-03T17:40:38.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.030+0000 7fba28f5d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba24107cc0 con 0x7fba240f5340 2021-11-03T17:40:38.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.031+0000 7fba2259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba240f49a0 0x7fba241070e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:40:38.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.031+0000 7fba2259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba240f49a0 0x7fba241070e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55740/0 (socket says 172.21.15.26:55740) 2021-11-03T17:40:38.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.031+0000 7fba2259c700 1 -- 172.21.15.26:0/1084381363 learned_addr learned my addr 172.21.15.26:0/1084381363 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:40:38.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.031+0000 7fba21d9b700 1 --2- 172.21.15.26:0/1084381363 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba240f5340 0x7fba241075d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:40:38.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.031+0000 7fba2259c700 1 -- 172.21.15.26:0/1084381363 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba240f5340 msgr2=0x7fba241075d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:40:38.030 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.031+0000 7fba2259c700 1 --2- 172.21.15.26:0/1084381363 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba240f5340 0x7fba241075d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:38.030 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.031+0000 7fba2259c700 1 -- 172.21.15.26:0/1084381363 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba14009640 con 0x7fba240f49a0 2021-11-03T17:40:38.030 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.031+0000 7fba21d9b700 1 --2- 172.21.15.26:0/1084381363 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba240f5340 0x7fba241075d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:40:38.030 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.031+0000 7fba2259c700 1 --2- 172.21.15.26:0/1084381363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba240f49a0 0x7fba241070e0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7fba1400c010 tx=0x7fba14004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:40:38.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.031+0000 7fba1affd700 1 -- 172.21.15.26:0/1084381363 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba1400e070 con 0x7fba240f49a0 2021-11-03T17:40:38.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.031+0000 7fba1affd700 1 -- 172.21.15.26:0/1084381363 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fba14007dc0 con 0x7fba240f49a0 2021-11-03T17:40:38.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.031+0000 7fba28f5d700 1 -- 172.21.15.26:0/1084381363 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba24108600 con 0x7fba240f49a0 2021-11-03T17:40:38.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.031+0000 7fba1affd700 1 -- 172.21.15.26:0/1084381363 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba14018070 con 0x7fba240f49a0 2021-11-03T17:40:38.032 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.031+0000 7fba28f5d700 1 -- 172.21.15.26:0/1084381363 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba24108ae0 con 0x7fba240f49a0 2021-11-03T17:40:38.033 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.032+0000 7fba28f5d700 1 -- 172.21.15.26:0/1084381363 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba24045ad0 con 0x7fba240f49a0 2021-11-03T17:40:38.033 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.033+0000 7fba1affd700 1 -- 172.21.15.26:0/1084381363 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fba14024060 con 0x7fba240f49a0 2021-11-03T17:40:38.033 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.033+0000 7fba1affd700 1 --2- 172.21.15.26:0/1084381363 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fba100640b0 0x7fba10066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:40:38.033 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.033+0000 7fba1affd700 1 -- 172.21.15.26:0/1084381363 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fba140821e0 con 0x7fba240f49a0 2021-11-03T17:40:38.034 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.033+0000 7fba21d9b700 1 --2- 172.21.15.26:0/1084381363 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fba100640b0 0x7fba10066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:40:38.034 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.033+0000 7fba21d9b700 1 --2- 172.21.15.26:0/1084381363 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fba100640b0 0x7fba10066570 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7fba0c0041d0 tx=0x7fba0c009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:40:38.034 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.037+0000 7fba1affd700 1 -- 172.21.15.26:0/1084381363 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fba14054540 con 0x7fba240f49a0 2021-11-03T17:40:38.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.266+0000 7fba28f5d700 1 -- 172.21.15.26:0/1084381363 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fba24027a00 con 0x7fba240f49a0 2021-11-03T17:40:38.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.267+0000 7fba1affd700 1 -- 172.21.15.26:0/1084381363 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fba14054130 con 0x7fba240f49a0 2021-11-03T17:40:38.261 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:40:38.261 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:40:38.261 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:40:38.261 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:40:38.262 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:40:38.262 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:40:38.262 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:40:38.262 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:40:38.263 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:40:38.263 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:40:38.263 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:40:38.263 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:40:38.264 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:40:38.264 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:40:38.264 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:40:38.264 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:40:38.265 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:40:38.265 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:40:38.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.268+0000 7fba28f5d700 1 -- 172.21.15.26:0/1084381363 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fba100640b0 msgr2=0x7fba10066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:40:38.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.268+0000 7fba28f5d700 1 --2- 172.21.15.26:0/1084381363 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fba100640b0 0x7fba10066570 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7fba0c0041d0 tx=0x7fba0c009040).stop 2021-11-03T17:40:38.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.268+0000 7fba28f5d700 1 -- 172.21.15.26:0/1084381363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba240f49a0 msgr2=0x7fba241070e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:40:38.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.268+0000 7fba28f5d700 1 --2- 172.21.15.26:0/1084381363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba240f49a0 0x7fba241070e0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7fba1400c010 tx=0x7fba14004d10).stop 2021-11-03T17:40:38.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.268+0000 7fba28f5d700 1 -- 172.21.15.26:0/1084381363 shutdown_connections 2021-11-03T17:40:38.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.268+0000 7fba28f5d700 1 --2- 172.21.15.26:0/1084381363 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fba100640b0 0x7fba10066570 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:38.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.268+0000 7fba28f5d700 1 --2- 172.21.15.26:0/1084381363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba240f49a0 0x7fba241070e0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:38.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.268+0000 7fba28f5d700 1 --2- 172.21.15.26:0/1084381363 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba240f5340 0x7fba241075d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:38.268 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.268+0000 7fba28f5d700 1 -- 172.21.15.26:0/1084381363 >> 172.21.15.26:0/1084381363 conn(0x7fba240f04c0 msgr2=0x7fba240fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:40:38.268 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.268+0000 7fba28f5d700 1 -- 172.21.15.26:0/1084381363 shutdown_connections 2021-11-03T17:40:38.268 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.268+0000 7fba28f5d700 1 -- 172.21.15.26:0/1084381363 wait complete. 2021-11-03T17:40:38.363 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.369+0000 7f85ea4cc700 1 -- 172.21.15.26:0/2279552567 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85e40f6ff0 msgr2=0x7f85e40f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:40:38.363 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.369+0000 7f85ea4cc700 1 --2- 172.21.15.26:0/2279552567 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85e40f6ff0 0x7f85e40f7a20 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f85d8004660 tx=0x7f85d8009b30).stop 2021-11-03T17:40:38.363 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.369+0000 7f85ea4cc700 1 -- 172.21.15.26:0/2279552567 shutdown_connections 2021-11-03T17:40:38.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.369+0000 7f85ea4cc700 1 --2- 172.21.15.26:0/2279552567 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85e40f6ff0 0x7f85e40f7a20 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:38.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.369+0000 7f85ea4cc700 1 --2- 172.21.15.26:0/2279552567 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85e40f66e0 0x7f85e40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:38.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.369+0000 7f85ea4cc700 1 -- 172.21.15.26:0/2279552567 >> 172.21.15.26:0/2279552567 conn(0x7f85e40f1f00 msgr2=0x7f85e40f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:40:38.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.369+0000 7f85ea4cc700 1 -- 172.21.15.26:0/2279552567 shutdown_connections 2021-11-03T17:40:38.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.369+0000 7f85ea4cc700 1 -- 172.21.15.26:0/2279552567 wait complete. 2021-11-03T17:40:38.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.369+0000 7f85ea4cc700 1 Processor -- start 2021-11-03T17:40:38.367 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.370+0000 7f85ea4cc700 1 -- start start 2021-11-03T17:40:38.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.370+0000 7f85ea4cc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85e40f66e0 0x7f85e406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:40:38.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.370+0000 7f85ea4cc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85e40f6ff0 0x7f85e4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:40:38.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.370+0000 7f85ea4cc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e406a380 con 0x7f85e40f6ff0 2021-11-03T17:40:38.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.370+0000 7f85ea4cc700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e406a4c0 con 0x7f85e40f66e0 2021-11-03T17:40:38.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.370+0000 7f85e37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85e40f6ff0 0x7f85e4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:40:38.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.370+0000 7f85e37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85e40f6ff0 0x7f85e4069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55752/0 (socket says 172.21.15.26:55752) 2021-11-03T17:40:38.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.370+0000 7f85e37fe700 1 -- 172.21.15.26:0/1983519467 learned_addr learned my addr 172.21.15.26:0/1983519467 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:40:38.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.370+0000 7f85e3fff700 1 --2- 172.21.15.26:0/1983519467 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85e40f66e0 0x7f85e406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:40:38.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.370+0000 7f85e37fe700 1 -- 172.21.15.26:0/1983519467 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85e40f66e0 msgr2=0x7f85e406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:40:38.370 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.370+0000 7f85e37fe700 1 --2- 172.21.15.26:0/1983519467 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85e40f66e0 0x7f85e406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:38.370 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.370+0000 7f85e37fe700 1 -- 172.21.15.26:0/1983519467 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d8005040 con 0x7f85e40f6ff0 2021-11-03T17:40:38.370 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.370+0000 7f85e37fe700 1 --2- 172.21.15.26:0/1983519467 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85e40f6ff0 0x7f85e4069e20 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f85d8009830 tx=0x7f85d8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:40:38.370 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.371+0000 7f85e0ff9700 1 -- 172.21.15.26:0/1983519467 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85d8018070 con 0x7f85e40f6ff0 2021-11-03T17:40:38.371 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.371+0000 7f85ea4cc700 1 -- 172.21.15.26:0/1983519467 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e406a740 con 0x7f85e40f6ff0 2021-11-03T17:40:38.371 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.371+0000 7f85e0ff9700 1 -- 172.21.15.26:0/1983519467 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f85d8007ba0 con 0x7f85e40f6ff0 2021-11-03T17:40:38.371 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.371+0000 7f85e0ff9700 1 -- 172.21.15.26:0/1983519467 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85d801c3c0 con 0x7f85e40f6ff0 2021-11-03T17:40:38.371 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.371+0000 7f85ea4cc700 1 -- 172.21.15.26:0/1983519467 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e406aca0 con 0x7f85e40f6ff0 2021-11-03T17:40:38.371 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.372+0000 7f85ea4cc700 1 -- 172.21.15.26:0/1983519467 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85e4045ad0 con 0x7f85e40f6ff0 2021-11-03T17:40:38.372 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.372+0000 7f85e0ff9700 1 -- 172.21.15.26:0/1983519467 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f85d8007d10 con 0x7f85e40f6ff0 2021-11-03T17:40:38.372 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.372+0000 7f85e0ff9700 1 --2- 172.21.15.26:0/1983519467 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85cc064090 0x7f85cc066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:40:38.372 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.373+0000 7f85e0ff9700 1 -- 172.21.15.26:0/1983519467 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f85d80823a0 con 0x7f85e40f6ff0 2021-11-03T17:40:38.372 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.373+0000 7f85e3fff700 1 --2- 172.21.15.26:0/1983519467 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85cc064090 0x7f85cc066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:40:38.373 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.373+0000 7f85e3fff700 1 --2- 172.21.15.26:0/1983519467 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85cc064090 0x7f85cc066550 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f85e406b730 tx=0x7f85d400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:40:38.373 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.377+0000 7f85e0ff9700 1 -- 172.21.15.26:0/1983519467 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f85d8054700 con 0x7f85e40f6ff0 2021-11-03T17:40:38.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.585+0000 7f85ea4cc700 1 -- 172.21.15.26:0/1983519467 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f85e4027a00 con 0x7f85e40f6ff0 2021-11-03T17:40:38.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.586+0000 7f85e0ff9700 1 -- 172.21.15.26:0/1983519467 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f85d80542f0 con 0x7f85e40f6ff0 2021-11-03T17:40:38.580 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:40:38.581 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:40:38.581 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:40:38.581 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:40:38.581 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:40:38.582 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:40:38.582 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:40:38.582 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:40:38.582 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:40:38.582 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:40:38.583 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:40:38.583 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:40:38.583 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:40:38.583 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:40:38.584 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:40:38.584 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:40:38.584 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:40:38.584 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:40:38.584 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:40:38.585 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:40:38.585 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:40:38.585 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:40:38.585 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:40:38.586 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:40:38.586 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:40:38.586 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:40:38.586 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:40:38.587 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:40:38.587 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:40:38.587 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:40:38.587 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:40:38.587 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:40:38.588 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:40:38.588 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:40:38.588 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:40:38.588 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:40:38.588 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:40:38.589 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:40:38.589 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:40:38.590 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.588+0000 7f85ea4cc700 1 -- 172.21.15.26:0/1983519467 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85cc064090 msgr2=0x7f85cc066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:40:38.590 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.588+0000 7f85ea4cc700 1 --2- 172.21.15.26:0/1983519467 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85cc064090 0x7f85cc066550 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f85e406b730 tx=0x7f85d400b040).stop 2021-11-03T17:40:38.590 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.588+0000 7f85ea4cc700 1 -- 172.21.15.26:0/1983519467 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85e40f6ff0 msgr2=0x7f85e4069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:40:38.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.588+0000 7f85ea4cc700 1 --2- 172.21.15.26:0/1983519467 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85e40f6ff0 0x7f85e4069e20 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f85d8009830 tx=0x7f85d8009b30).stop 2021-11-03T17:40:38.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.588+0000 7f85ea4cc700 1 -- 172.21.15.26:0/1983519467 shutdown_connections 2021-11-03T17:40:38.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.588+0000 7f85ea4cc700 1 --2- 172.21.15.26:0/1983519467 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85cc064090 0x7f85cc066550 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:38.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.588+0000 7f85ea4cc700 1 --2- 172.21.15.26:0/1983519467 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85e40f66e0 0x7f85e406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:38.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.588+0000 7f85ea4cc700 1 --2- 172.21.15.26:0/1983519467 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85e40f6ff0 0x7f85e4069e20 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:40:38.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.588+0000 7f85ea4cc700 1 -- 172.21.15.26:0/1983519467 >> 172.21.15.26:0/1983519467 conn(0x7f85e40f1f00 msgr2=0x7f85e40fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:40:38.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.588+0000 7f85ea4cc700 1 -- 172.21.15.26:0/1983519467 shutdown_connections 2021-11-03T17:40:38.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:40:38.588+0000 7f85ea4cc700 1 -- 172.21.15.26:0/1983519467 wait complete. 2021-11-03T17:40:38.592 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:40:38.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:38 smithi026 ceph-mon[96795]: pgmap v1379: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:38.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:38 smithi026 ceph-mon[96795]: from='client.35564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:40:38.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:38 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1084381363' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:40:38.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:38 smithi194 ceph-mon[65619]: pgmap v1379: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:38.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:38 smithi194 ceph-mon[65619]: from='client.35564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:40:38.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:38 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1084381363' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:40:39.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:39 smithi026 ceph-mon[96795]: from='client.35568 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:40:39.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:39 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1983519467' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:40:39.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:39 smithi194 ceph-mon[65619]: from='client.35568 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:40:39.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:39 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1983519467' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:40:40.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:40 smithi026 ceph-mon[96795]: pgmap v1380: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:40.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:40 smithi194 ceph-mon[65619]: pgmap v1380: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:42.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:42 smithi026 ceph-mon[96795]: pgmap v1381: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:42.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:42 smithi194 ceph-mon[65619]: pgmap v1381: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:44.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:44 smithi026 ceph-mon[96795]: pgmap v1382: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:44.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:44 smithi194 ceph-mon[65619]: pgmap v1382: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:46.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:46 smithi026 ceph-mon[96795]: pgmap v1383: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:46.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:46 smithi194 ceph-mon[65619]: pgmap v1383: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:48.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:48 smithi026 ceph-mon[96795]: pgmap v1384: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:40:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:40:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:48 smithi194 ceph-mon[65619]: pgmap v1384: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:40:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:40:50.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:50 smithi026 ceph-mon[96795]: pgmap v1385: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:50.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:50 smithi194 ceph-mon[65619]: pgmap v1385: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:52.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:52 smithi026 ceph-mon[96795]: pgmap v1386: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:52.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:52 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:40:52.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:52 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:40:52.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:52 smithi194 ceph-mon[65619]: pgmap v1386: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:52.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:52 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:40:52.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:52 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:40:54.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:54 smithi026 ceph-mon[96795]: pgmap v1387: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:54.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:54 smithi194 ceph-mon[65619]: pgmap v1387: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:56.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:56 smithi026 ceph-mon[96795]: pgmap v1388: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:56.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:56 smithi194 ceph-mon[65619]: pgmap v1388: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:58.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:40:58 smithi026 ceph-mon[96795]: pgmap v1389: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:40:58.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:40:58 smithi194 ceph-mon[65619]: pgmap v1389: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:00.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:00 smithi026 ceph-mon[96795]: pgmap v1390: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:00.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:00 smithi194 ceph-mon[65619]: pgmap v1390: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:02.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:02 smithi026 ceph-mon[96795]: pgmap v1391: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:02.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:02 smithi194 ceph-mon[65619]: pgmap v1391: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:04.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:04 smithi026 ceph-mon[96795]: pgmap v1392: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:04.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:04 smithi194 ceph-mon[65619]: pgmap v1392: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:06.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:06 smithi026 ceph-mon[96795]: pgmap v1393: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:06.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:06 smithi194 ceph-mon[65619]: pgmap v1393: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:07.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:07 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:41:07.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:07 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:41:07.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:07 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:41:07.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:07 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:41:08.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:08 smithi026 ceph-mon[96795]: pgmap v1394: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:08.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.702+0000 7f297ed64700 1 -- 172.21.15.26:0/123896493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29780f6530 msgr2=0x7f29780f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:41:08.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.702+0000 7f297ed64700 1 --2- 172.21.15.26:0/123896493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29780f6530 0x7f29780f6950 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7f2974004660 tx=0x7f2974009b30).stop 2021-11-03T17:41:08.699 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.702+0000 7f297ed64700 1 -- 172.21.15.26:0/123896493 shutdown_connections 2021-11-03T17:41:08.699 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.702+0000 7f297ed64700 1 --2- 172.21.15.26:0/123896493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29780f77d0 0x7f29780f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:08.699 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.702+0000 7f297ed64700 1 --2- 172.21.15.26:0/123896493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29780f6530 0x7f29780f6950 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:08.699 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.702+0000 7f297ed64700 1 -- 172.21.15.26:0/123896493 >> 172.21.15.26:0/123896493 conn(0x7f29780f1cd0 msgr2=0x7f29780f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:41:08.700 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.702+0000 7f297ed64700 1 -- 172.21.15.26:0/123896493 shutdown_connections 2021-11-03T17:41:08.700 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.702+0000 7f297ed64700 1 -- 172.21.15.26:0/123896493 wait complete. 2021-11-03T17:41:08.700 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.702+0000 7f297ed64700 1 Processor -- start 2021-11-03T17:41:08.700 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.702+0000 7f297ed64700 1 -- start start 2021-11-03T17:41:08.700 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.703+0000 7f297ed64700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29780f6530 0x7f2978106db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:41:08.701 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.703+0000 7f297ed64700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29780f77d0 0x7f29781072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:41:08.701 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.703+0000 7f297ed64700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29781078a0 con 0x7f29780f77d0 2021-11-03T17:41:08.701 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.703+0000 7f297ed64700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29781080e0 con 0x7f29780f6530 2021-11-03T17:41:08.701 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.703+0000 7f297d561700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29780f77d0 0x7f29781072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:41:08.702 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.703+0000 7f297d561700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29780f77d0 0x7f29781072a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55784/0 (socket says 172.21.15.26:55784) 2021-11-03T17:41:08.702 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.703+0000 7f297d561700 1 -- 172.21.15.26:0/1528260561 learned_addr learned my addr 172.21.15.26:0/1528260561 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:41:08.702 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.703+0000 7f297dd62700 1 --2- 172.21.15.26:0/1528260561 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29780f6530 0x7f2978106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:41:08.702 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.703+0000 7f297d561700 1 -- 172.21.15.26:0/1528260561 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29780f6530 msgr2=0x7f2978106db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:41:08.702 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.703+0000 7f297d561700 1 --2- 172.21.15.26:0/1528260561 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29780f6530 0x7f2978106db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:08.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.703+0000 7f297d561700 1 -- 172.21.15.26:0/1528260561 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2974005040 con 0x7f29780f77d0 2021-11-03T17:41:08.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.703+0000 7f297d561700 1 --2- 172.21.15.26:0/1528260561 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29780f77d0 0x7f29781072a0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f296800c790 tx=0x7f2968007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:41:08.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.703+0000 7f296e7fc700 1 -- 172.21.15.26:0/1528260561 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f296800e680 con 0x7f29780f77d0 2021-11-03T17:41:08.704 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.703+0000 7f297ed64700 1 -- 172.21.15.26:0/1528260561 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29781083c0 con 0x7f29780f77d0 2021-11-03T17:41:08.704 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.703+0000 7f296e7fc700 1 -- 172.21.15.26:0/1528260561 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f296800ec90 con 0x7f29780f77d0 2021-11-03T17:41:08.704 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.703+0000 7f296e7fc700 1 -- 172.21.15.26:0/1528260561 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2968013d60 con 0x7f29780f77d0 2021-11-03T17:41:08.704 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.703+0000 7f297ed64700 1 -- 172.21.15.26:0/1528260561 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2978108900 con 0x7f29780f77d0 2021-11-03T17:41:08.705 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.705+0000 7f297ed64700 1 -- 172.21.15.26:0/1528260561 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2978059100 con 0x7f29780f77d0 2021-11-03T17:41:08.706 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.705+0000 7f296e7fc700 1 -- 172.21.15.26:0/1528260561 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f296801a060 con 0x7f29780f77d0 2021-11-03T17:41:08.706 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.705+0000 7f296e7fc700 1 --2- 172.21.15.26:0/1528260561 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2964064100 0x7f29640665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:41:08.706 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.705+0000 7f296e7fc700 1 -- 172.21.15.26:0/1528260561 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f2968080a20 con 0x7f29780f77d0 2021-11-03T17:41:08.706 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.705+0000 7f297dd62700 1 --2- 172.21.15.26:0/1528260561 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2964064100 0x7f29640665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:41:08.707 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.706+0000 7f297dd62700 1 --2- 172.21.15.26:0/1528260561 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2964064100 0x7f29640665c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f2974004e30 tx=0x7f2974009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:41:08.707 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.710+0000 7f296e7fc700 1 -- 172.21.15.26:0/1528260561 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f2968052c30 con 0x7f29780f77d0 2021-11-03T17:41:08.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:08 smithi194 ceph-mon[65619]: pgmap v1394: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:08.884 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.890+0000 7f297ed64700 1 -- 172.21.15.26:0/1528260561 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f29780fede0 con 0x7f2964064100 2021-11-03T17:41:08.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.891+0000 7f296e7fc700 1 -- 172.21.15.26:0/1528260561 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f29780fede0 con 0x7f2964064100 2021-11-03T17:41:08.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.893+0000 7f297ed64700 1 -- 172.21.15.26:0/1528260561 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2964064100 msgr2=0x7f29640665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:41:08.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.893+0000 7f297ed64700 1 --2- 172.21.15.26:0/1528260561 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2964064100 0x7f29640665c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f2974004e30 tx=0x7f2974009b30).stop 2021-11-03T17:41:08.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.893+0000 7f297ed64700 1 -- 172.21.15.26:0/1528260561 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29780f77d0 msgr2=0x7f29781072a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:41:08.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.893+0000 7f297ed64700 1 --2- 172.21.15.26:0/1528260561 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29780f77d0 0x7f29781072a0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f296800c790 tx=0x7f2968007d70).stop 2021-11-03T17:41:08.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.893+0000 7f297ed64700 1 -- 172.21.15.26:0/1528260561 shutdown_connections 2021-11-03T17:41:08.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.893+0000 7f297ed64700 1 --2- 172.21.15.26:0/1528260561 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2964064100 0x7f29640665c0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:08.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.893+0000 7f297ed64700 1 --2- 172.21.15.26:0/1528260561 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29780f6530 0x7f2978106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:08.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.893+0000 7f297ed64700 1 --2- 172.21.15.26:0/1528260561 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29780f77d0 0x7f29781072a0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:08.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.893+0000 7f297ed64700 1 -- 172.21.15.26:0/1528260561 >> 172.21.15.26:0/1528260561 conn(0x7f29780f1cd0 msgr2=0x7f29780fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:41:08.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.893+0000 7f297ed64700 1 -- 172.21.15.26:0/1528260561 shutdown_connections 2021-11-03T17:41:08.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.893+0000 7f297ed64700 1 -- 172.21.15.26:0/1528260561 wait complete. 2021-11-03T17:41:08.897 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:41:08.989 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.993+0000 7f5948627700 1 -- 172.21.15.26:0/1355064560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59400f5340 msgr2=0x7f59400f7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:41:08.990 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.993+0000 7f5948627700 1 --2- 172.21.15.26:0/1355064560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59400f5340 0x7f59400f7ac0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7f593c004660 tx=0x7f593c009b30).stop 2021-11-03T17:41:08.990 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.993+0000 7f5948627700 1 -- 172.21.15.26:0/1355064560 shutdown_connections 2021-11-03T17:41:08.990 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.993+0000 7f5948627700 1 --2- 172.21.15.26:0/1355064560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59400f5340 0x7f59400f7ac0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:08.990 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.993+0000 7f5948627700 1 --2- 172.21.15.26:0/1355064560 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59400f49a0 0x7f59400f4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:41:08.991 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.993+0000 7f5948627700 1 -- 172.21.15.26:0/1355064560 >> 172.21.15.26:0/1355064560 conn(0x7f59400f04c0 msgr2=0x7f59400f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:41:08.991 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.993+0000 7f5948627700 1 -- 172.21.15.26:0/1355064560 shutdown_connections 2021-11-03T17:41:08.991 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.993+0000 7f5948627700 1 -- 172.21.15.26:0/1355064560 wait complete. 2021-11-03T17:41:08.991 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.994+0000 7f5948627700 1 Processor -- start 2021-11-03T17:41:08.992 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.994+0000 7f5948627700 1 -- start start 2021-11-03T17:41:08.992 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.994+0000 7f5948627700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59400f49a0 0x7f5940106fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:41:08.992 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.994+0000 7f5948627700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59400f5340 0x7f59401074c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:41:08.992 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.994+0000 7f5948627700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5940107b00 con 0x7f59400f5340 2021-11-03T17:41:08.992 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.994+0000 7f5948627700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59401083b0 con 0x7f59400f49a0 2021-11-03T17:41:08.993 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.994+0000 7f5945bc2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59400f5340 0x7f59401074c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:41:08.993 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.994+0000 7f5945bc2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59400f5340 0x7f59401074c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55794/0 (socket says 172.21.15.26:55794) 2021-11-03T17:41:08.993 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.994+0000 7f5945bc2700 1 -- 172.21.15.26:0/3905551739 learned_addr learned my addr 172.21.15.26:0/3905551739 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:41:08.993 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.994+0000 7f59463c3700 1 --2- 172.21.15.26:0/3905551739 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59400f49a0 0x7f5940106fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:41:08.994 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.994+0000 7f5945bc2700 1 -- 172.21.15.26:0/3905551739 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59400f49a0 msgr2=0x7f5940106fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:41:08.994 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.994+0000 7f5945bc2700 1 --2- 172.21.15.26:0/3905551739 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59400f49a0 0x7f5940106fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:08.994 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.994+0000 7f5945bc2700 1 -- 172.21.15.26:0/3905551739 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593c005040 con 0x7f59400f5340 2021-11-03T17:41:08.994 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.994+0000 7f5945bc2700 1 --2- 172.21.15.26:0/3905551739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59400f5340 0x7f59401074c0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f593c004f60 tx=0x7f593c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:41:08.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.994+0000 7f5936ffd700 1 -- 172.21.15.26:0/3905551739 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f593c018070 con 0x7f59400f5340 2021-11-03T17:41:08.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.995+0000 7f5936ffd700 1 -- 172.21.15.26:0/3905551739 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f593c007ba0 con 0x7f59400f5340 2021-11-03T17:41:08.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.995+0000 7f5936ffd700 1 -- 172.21.15.26:0/3905551739 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f593c01c620 con 0x7f59400f5340 2021-11-03T17:41:08.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.995+0000 7f5948627700 1 -- 172.21.15.26:0/3905551739 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5940108630 con 0x7f59400f5340 2021-11-03T17:41:08.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.995+0000 7f5948627700 1 -- 172.21.15.26:0/3905551739 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5940108b90 con 0x7f59400f5340 2021-11-03T17:41:08.997 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.995+0000 7f5948627700 1 -- 172.21.15.26:0/3905551739 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59400f4150 con 0x7f59400f5340 2021-11-03T17:41:08.997 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.996+0000 7f5936ffd700 1 -- 172.21.15.26:0/3905551739 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f593c01d420 con 0x7f59400f5340 2021-11-03T17:41:08.997 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.996+0000 7f5936ffd700 1 --2- 172.21.15.26:0/3905551739 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f592c0640b0 0x7f592c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:41:08.998 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.996+0000 7f5936ffd700 1 -- 172.21.15.26:0/3905551739 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f593c082610 con 0x7f59400f5340 2021-11-03T17:41:08.998 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.996+0000 7f59463c3700 1 --2- 172.21.15.26:0/3905551739 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f592c0640b0 0x7f592c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:41:08.998 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:08.997+0000 7f59463c3700 1 --2- 172.21.15.26:0/3905551739 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f592c0640b0 0x7f592c066570 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f594005f4c0 tx=0x7f5930008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:41:08.998 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.000+0000 7f5936ffd700 1 -- 172.21.15.26:0/3905551739 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f593c054a30 con 0x7f59400f5340 2021-11-03T17:41:09.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.174+0000 7f5948627700 1 -- 172.21.15.26:0/3905551739 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f59400008d0 con 0x7f592c0640b0 2021-11-03T17:41:09.184 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.189+0000 7f5936ffd700 1 -- 172.21.15.26:0/3905551739 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f59400008d0 con 0x7f592c0640b0 2021-11-03T17:41:09.184 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:41:09.185 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (52m) 111s ago 53m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:41:09.185 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (44m) 111s ago 53m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:41:09.185 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (44m) 48s ago 52m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:41:09.185 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (52m) 111s ago 53m 40.8M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:41:09.185 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (45m) 111s ago 48m 25.1M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:41:09.186 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (45m) 111s ago 48m 25.7M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:41:09.186 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (48m) 48s ago 48m 26.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:41:09.186 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (48m) 48s ago 48m 26.3M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:41:09.186 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (46m) 111s ago 54m 533M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:41:09.187 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (45m) 48s ago 52m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:41:09.187 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (45m) 111s ago 55m 209M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:41:09.187 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (45m) 48s ago 52m 103M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:41:09.187 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (53m) 111s ago 53m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:41:09.188 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (52m) 48s ago 52m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:41:09.188 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (44m) 111s ago 52m 251M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:41:09.188 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (43m) 111s ago 51m 270M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:41:09.188 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (43m) 111s ago 51m 225M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:41:09.188 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (42m) 48s ago 50m 287M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:41:09.189 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (42m) 48s ago 50m 246M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:41:09.189 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (41m) 48s ago 50m 235M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:41:09.189 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (52m) 111s ago 53m 56.7M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:41:09.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.191+0000 7f5948627700 1 -- 172.21.15.26:0/3905551739 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f592c0640b0 msgr2=0x7f592c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:41:09.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.191+0000 7f5948627700 1 --2- 172.21.15.26:0/3905551739 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f592c0640b0 0x7f592c066570 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f594005f4c0 tx=0x7f5930008040).stop 2021-11-03T17:41:09.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.191+0000 7f5948627700 1 -- 172.21.15.26:0/3905551739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59400f5340 msgr2=0x7f59401074c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:41:09.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.191+0000 7f5948627700 1 --2- 172.21.15.26:0/3905551739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59400f5340 0x7f59401074c0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f593c004f60 tx=0x7f593c009b30).stop 2021-11-03T17:41:09.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.191+0000 7f5948627700 1 -- 172.21.15.26:0/3905551739 shutdown_connections 2021-11-03T17:41:09.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.191+0000 7f5948627700 1 --2- 172.21.15.26:0/3905551739 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f592c0640b0 0x7f592c066570 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:09.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.191+0000 7f5948627700 1 --2- 172.21.15.26:0/3905551739 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59400f49a0 0x7f5940106fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:09.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.191+0000 7f5948627700 1 --2- 172.21.15.26:0/3905551739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59400f5340 0x7f59401074c0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:09.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.191+0000 7f5948627700 1 -- 172.21.15.26:0/3905551739 >> 172.21.15.26:0/3905551739 conn(0x7f59400f04c0 msgr2=0x7f59400fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:41:09.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.191+0000 7f5948627700 1 -- 172.21.15.26:0/3905551739 shutdown_connections 2021-11-03T17:41:09.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.191+0000 7f5948627700 1 -- 172.21.15.26:0/3905551739 wait complete. 2021-11-03T17:41:09.285 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.290+0000 7efdaef29700 1 -- 172.21.15.26:0/2187299 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efda80f66e0 msgr2=0x7efda80f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:41:09.285 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.290+0000 7efdaef29700 1 --2- 172.21.15.26:0/2187299 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efda80f66e0 0x7efda80f6b00 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7efd9c004660 tx=0x7efd9c009b30).stop 2021-11-03T17:41:09.286 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.290+0000 7efdaef29700 1 -- 172.21.15.26:0/2187299 shutdown_connections 2021-11-03T17:41:09.286 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.290+0000 7efdaef29700 1 --2- 172.21.15.26:0/2187299 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efda80f7980 0x7efda80f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:09.286 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.290+0000 7efdaef29700 1 --2- 172.21.15.26:0/2187299 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efda80f66e0 0x7efda80f6b00 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:09.286 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.290+0000 7efdaef29700 1 -- 172.21.15.26:0/2187299 >> 172.21.15.26:0/2187299 conn(0x7efda80f1e40 msgr2=0x7efda80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:41:09.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.290+0000 7efdaef29700 1 -- 172.21.15.26:0/2187299 shutdown_connections 2021-11-03T17:41:09.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.290+0000 7efdaef29700 1 -- 172.21.15.26:0/2187299 wait complete. 2021-11-03T17:41:09.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.291+0000 7efdaef29700 1 Processor -- start 2021-11-03T17:41:09.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.291+0000 7efdaef29700 1 -- start start 2021-11-03T17:41:09.290 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.291+0000 7efdaef29700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efda80f66e0 0x7efda8106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:41:09.290 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.291+0000 7efdaef29700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efda80f7980 0x7efda8107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:41:09.290 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.291+0000 7efdaef29700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda8107a10 con 0x7efda80f66e0 2021-11-03T17:41:09.290 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.291+0000 7efdaef29700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda8107b50 con 0x7efda80f7980 2021-11-03T17:41:09.291 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.291+0000 7efdaccc5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efda80f66e0 0x7efda8106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:41:09.291 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.291+0000 7efdaccc5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efda80f66e0 0x7efda8106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55802/0 (socket says 172.21.15.26:55802) 2021-11-03T17:41:09.291 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.291+0000 7efdaccc5700 1 -- 172.21.15.26:0/3396864325 learned_addr learned my addr 172.21.15.26:0/3396864325 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:41:09.291 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.291+0000 7efda7fff700 1 --2- 172.21.15.26:0/3396864325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efda80f7980 0x7efda8107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:41:09.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.291+0000 7efdaccc5700 1 -- 172.21.15.26:0/3396864325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efda80f7980 msgr2=0x7efda8107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:41:09.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.291+0000 7efdaccc5700 1 --2- 172.21.15.26:0/3396864325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efda80f7980 0x7efda8107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:09.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.291+0000 7efdaccc5700 1 -- 172.21.15.26:0/3396864325 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd9c005040 con 0x7efda80f66e0 2021-11-03T17:41:09.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.292+0000 7efdaccc5700 1 --2- 172.21.15.26:0/3396864325 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efda80f66e0 0x7efda8106f70 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7efd9c013a70 tx=0x7efd9c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:41:09.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.292+0000 7efda57fa700 1 -- 172.21.15.26:0/3396864325 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd9c018070 con 0x7efda80f66e0 2021-11-03T17:41:09.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.292+0000 7efda57fa700 1 -- 172.21.15.26:0/3396864325 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efd9c0097d0 con 0x7efda80f66e0 2021-11-03T17:41:09.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.292+0000 7efdaef29700 1 -- 172.21.15.26:0/3396864325 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda8108490 con 0x7efda80f66e0 2021-11-03T17:41:09.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.292+0000 7efda57fa700 1 -- 172.21.15.26:0/3396864325 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd9c01c3c0 con 0x7efda80f66e0 2021-11-03T17:41:09.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.292+0000 7efdaef29700 1 -- 172.21.15.26:0/3396864325 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda81089f0 con 0x7efda80f66e0 2021-11-03T17:41:09.294 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.293+0000 7efdaef29700 1 -- 172.21.15.26:0/3396864325 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda8045ad0 con 0x7efda80f66e0 2021-11-03T17:41:09.294 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.293+0000 7efda57fa700 1 -- 172.21.15.26:0/3396864325 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7efd9c007ba0 con 0x7efda80f66e0 2021-11-03T17:41:09.294 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.293+0000 7efda57fa700 1 --2- 172.21.15.26:0/3396864325 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efd980640b0 0x7efd98066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:41:09.294 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.294+0000 7efda57fa700 1 -- 172.21.15.26:0/3396864325 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7efd9c0824b0 con 0x7efda80f66e0 2021-11-03T17:41:09.295 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.294+0000 7efda7fff700 1 --2- 172.21.15.26:0/3396864325 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efd980640b0 0x7efd98066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:41:09.295 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.294+0000 7efda7fff700 1 --2- 172.21.15.26:0/3396864325 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efd980640b0 0x7efd98066570 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7efd940096c0 tx=0x7efd94009be0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:41:09.295 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.298+0000 7efda57fa700 1 -- 172.21.15.26:0/3396864325 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7efd9c054810 con 0x7efda80f66e0 2021-11-03T17:41:09.520 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.525+0000 7efdaef29700 1 -- 172.21.15.26:0/3396864325 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efda80fefb0 con 0x7efda80f66e0 2021-11-03T17:41:09.521 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.526+0000 7efda57fa700 1 -- 172.21.15.26:0/3396864325 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7efd9c054400 con 0x7efda80f66e0 2021-11-03T17:41:09.521 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:41:09.521 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:41:09.522 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:41:09.522 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:41:09.522 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:41:09.522 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:41:09.523 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:41:09.523 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:41:09.523 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:41:09.523 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:41:09.523 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:41:09.524 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:41:09.524 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:41:09.524 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:41:09.524 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:41:09.525 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:41:09.525 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:41:09.525 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:41:09.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.527+0000 7efdaef29700 1 -- 172.21.15.26:0/3396864325 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efd980640b0 msgr2=0x7efd98066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:41:09.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.527+0000 7efdaef29700 1 --2- 172.21.15.26:0/3396864325 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efd980640b0 0x7efd98066570 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7efd940096c0 tx=0x7efd94009be0).stop 2021-11-03T17:41:09.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.527+0000 7efdaef29700 1 -- 172.21.15.26:0/3396864325 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efda80f66e0 msgr2=0x7efda8106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:41:09.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.527+0000 7efdaef29700 1 --2- 172.21.15.26:0/3396864325 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efda80f66e0 0x7efda8106f70 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7efd9c013a70 tx=0x7efd9c009b30).stop 2021-11-03T17:41:09.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.527+0000 7efdaef29700 1 -- 172.21.15.26:0/3396864325 shutdown_connections 2021-11-03T17:41:09.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.527+0000 7efdaef29700 1 --2- 172.21.15.26:0/3396864325 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efd980640b0 0x7efd98066570 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:09.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.527+0000 7efdaef29700 1 --2- 172.21.15.26:0/3396864325 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efda80f66e0 0x7efda8106f70 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:09.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.527+0000 7efdaef29700 1 --2- 172.21.15.26:0/3396864325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efda80f7980 0x7efda8107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:09.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.528+0000 7efdaef29700 1 -- 172.21.15.26:0/3396864325 >> 172.21.15.26:0/3396864325 conn(0x7efda80f1e40 msgr2=0x7efda80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:41:09.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.528+0000 7efdaef29700 1 -- 172.21.15.26:0/3396864325 shutdown_connections 2021-11-03T17:41:09.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.528+0000 7efdaef29700 1 -- 172.21.15.26:0/3396864325 wait complete. 2021-11-03T17:41:09.623 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.628+0000 7f6265a9d700 1 -- 172.21.15.26:0/2351585831 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62600f77d0 msgr2=0x7f62600f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:41:09.624 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.628+0000 7f6265a9d700 1 --2- 172.21.15.26:0/2351585831 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62600f77d0 0x7f62600f7c30 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7f624c004660 tx=0x7f624c009b30).stop 2021-11-03T17:41:09.624 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.628+0000 7f6265a9d700 1 -- 172.21.15.26:0/2351585831 shutdown_connections 2021-11-03T17:41:09.624 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.628+0000 7f6265a9d700 1 --2- 172.21.15.26:0/2351585831 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62600f77d0 0x7f62600f7c30 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:09.624 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.628+0000 7f6265a9d700 1 --2- 172.21.15.26:0/2351585831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62600f6530 0x7f62600f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:09.625 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.628+0000 7f6265a9d700 1 -- 172.21.15.26:0/2351585831 >> 172.21.15.26:0/2351585831 conn(0x7f62600f1cd0 msgr2=0x7f62600f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:41:09.625 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.628+0000 7f6265a9d700 1 -- 172.21.15.26:0/2351585831 shutdown_connections 2021-11-03T17:41:09.625 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.628+0000 7f6265a9d700 1 -- 172.21.15.26:0/2351585831 wait complete. 2021-11-03T17:41:09.625 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.629+0000 7f6265a9d700 1 Processor -- start 2021-11-03T17:41:09.625 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.629+0000 7f6265a9d700 1 -- start start 2021-11-03T17:41:09.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.629+0000 7f6265a9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62600f6530 0x7f626006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:41:09.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.629+0000 7f6265a9d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62600f77d0 0x7f6260069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:41:09.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.629+0000 7f6265a9d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626006a380 con 0x7f62600f6530 2021-11-03T17:41:09.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.629+0000 7f6265a9d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626006a4c0 con 0x7f62600f77d0 2021-11-03T17:41:09.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.629+0000 7f6264a9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62600f6530 0x7f626006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:41:09.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.629+0000 7f6264a9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62600f6530 0x7f626006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55812/0 (socket says 172.21.15.26:55812) 2021-11-03T17:41:09.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.629+0000 7f6264a9b700 1 -- 172.21.15.26:0/505118197 learned_addr learned my addr 172.21.15.26:0/505118197 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:41:09.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.629+0000 7f625ffff700 1 --2- 172.21.15.26:0/505118197 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62600f77d0 0x7f6260069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:41:09.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.630+0000 7f6264a9b700 1 -- 172.21.15.26:0/505118197 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62600f77d0 msgr2=0x7f6260069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:41:09.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.630+0000 7f6264a9b700 1 --2- 172.21.15.26:0/505118197 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62600f77d0 0x7f6260069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:09.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.630+0000 7f6264a9b700 1 -- 172.21.15.26:0/505118197 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f624c005040 con 0x7f62600f6530 2021-11-03T17:41:09.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.630+0000 7f625ffff700 1 --2- 172.21.15.26:0/505118197 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62600f77d0 0x7f6260069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:41:09.631 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.630+0000 7f6264a9b700 1 --2- 172.21.15.26:0/505118197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62600f6530 0x7f626006b9a0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f625400c790 tx=0x7f6254007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:41:09.631 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.630+0000 7f625d7fa700 1 -- 172.21.15.26:0/505118197 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f625400e680 con 0x7f62600f6530 2021-11-03T17:41:09.631 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.630+0000 7f625d7fa700 1 -- 172.21.15.26:0/505118197 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f625400ec90 con 0x7f62600f6530 2021-11-03T17:41:09.631 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.630+0000 7f6265a9d700 1 -- 172.21.15.26:0/505118197 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f626006a7a0 con 0x7f62600f6530 2021-11-03T17:41:09.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.630+0000 7f625d7fa700 1 -- 172.21.15.26:0/505118197 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6254012d00 con 0x7f62600f6530 2021-11-03T17:41:09.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.630+0000 7f6265a9d700 1 -- 172.21.15.26:0/505118197 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f626010ed40 con 0x7f62600f6530 2021-11-03T17:41:09.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.631+0000 7f6265a9d700 1 -- 172.21.15.26:0/505118197 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6260045ad0 con 0x7f62600f6530 2021-11-03T17:41:09.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.631+0000 7f625d7fa700 1 -- 172.21.15.26:0/505118197 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f6254010070 con 0x7f62600f6530 2021-11-03T17:41:09.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.632+0000 7f625d7fa700 1 --2- 172.21.15.26:0/505118197 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6250064100 0x7f62500665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:41:09.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.632+0000 7f625d7fa700 1 -- 172.21.15.26:0/505118197 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f6254080990 con 0x7f62600f6530 2021-11-03T17:41:09.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.632+0000 7f625ffff700 1 --2- 172.21.15.26:0/505118197 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6250064100 0x7f62500665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:41:09.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.632+0000 7f625ffff700 1 --2- 172.21.15.26:0/505118197 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6250064100 0x7f62500665c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f624c004e30 tx=0x7f624c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:41:09.634 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.636+0000 7f625d7fa700 1 -- 172.21.15.26:0/505118197 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f6254052c00 con 0x7f62600f6530 2021-11-03T17:41:09.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.841+0000 7f6265a9d700 1 -- 172.21.15.26:0/505118197 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f62600fed90 con 0x7f62600f6530 2021-11-03T17:41:09.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.841+0000 7f625d7fa700 1 -- 172.21.15.26:0/505118197 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f62540527f0 con 0x7f62600f6530 2021-11-03T17:41:09.837 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:41:09.837 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:41:09.837 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:41:09.838 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:41:09.838 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:41:09.838 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:41:09.838 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:41:09.839 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:41:09.839 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:41:09.839 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:41:09.839 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:41:09.840 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:41:09.840 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:41:09.840 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:41:09.840 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:41:09.840 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:41:09.841 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:41:09.841 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:41:09.841 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:41:09.841 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:41:09.841 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:41:09.842 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:41:09.842 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:41:09.842 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:41:09.842 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:41:09.843 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:41:09.843 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:41:09.843 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:41:09.843 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:41:09.844 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:41:09.844 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:41:09.844 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:41:09.844 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:41:09.844 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:41:09.845 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:41:09.845 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:41:09.845 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:41:09.845 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:41:09.846 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:41:09.847 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.843+0000 7f6265a9d700 1 -- 172.21.15.26:0/505118197 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6250064100 msgr2=0x7f62500665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:41:09.847 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.843+0000 7f6265a9d700 1 --2- 172.21.15.26:0/505118197 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6250064100 0x7f62500665c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f624c004e30 tx=0x7f624c009b30).stop 2021-11-03T17:41:09.847 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.843+0000 7f6265a9d700 1 -- 172.21.15.26:0/505118197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62600f6530 msgr2=0x7f626006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:41:09.847 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.843+0000 7f6265a9d700 1 --2- 172.21.15.26:0/505118197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62600f6530 0x7f626006b9a0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f625400c790 tx=0x7f6254007d90).stop 2021-11-03T17:41:09.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.843+0000 7f6265a9d700 1 -- 172.21.15.26:0/505118197 shutdown_connections 2021-11-03T17:41:09.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.843+0000 7f6265a9d700 1 --2- 172.21.15.26:0/505118197 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6250064100 0x7f62500665c0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:09.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.843+0000 7f6265a9d700 1 --2- 172.21.15.26:0/505118197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62600f6530 0x7f626006b9a0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:09.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.843+0000 7f6265a9d700 1 --2- 172.21.15.26:0/505118197 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62600f77d0 0x7f6260069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:09.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.843+0000 7f6265a9d700 1 -- 172.21.15.26:0/505118197 >> 172.21.15.26:0/505118197 conn(0x7f62600f1cd0 msgr2=0x7f62600fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:41:09.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.844+0000 7f6265a9d700 1 -- 172.21.15.26:0/505118197 shutdown_connections 2021-11-03T17:41:09.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:09.844+0000 7f6265a9d700 1 -- 172.21.15.26:0/505118197 wait complete. 2021-11-03T17:41:09.849 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:41:10.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:10 smithi026 ceph-mon[96795]: from='client.35580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:41:10.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:10 smithi026 ceph-mon[96795]: pgmap v1395: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:10.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:10 smithi026 ceph-mon[96795]: from='client.35584 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:41:10.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:10 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3396864325' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:41:10.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:10 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/505118197' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:41:10.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:10 smithi194 ceph-mon[65619]: from='client.35580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:41:10.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:10 smithi194 ceph-mon[65619]: pgmap v1395: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:10.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:10 smithi194 ceph-mon[65619]: from='client.35584 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:41:10.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:10 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3396864325' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:41:10.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:10 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/505118197' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:41:12.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:12 smithi026 ceph-mon[96795]: pgmap v1396: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:12.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:12 smithi194 ceph-mon[65619]: pgmap v1396: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:14.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:14 smithi026 ceph-mon[96795]: pgmap v1397: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:14.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:14 smithi194 ceph-mon[65619]: pgmap v1397: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:16.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:16 smithi026 ceph-mon[96795]: pgmap v1398: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:16.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:16 smithi194 ceph-mon[65619]: pgmap v1398: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:18.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:18 smithi026 ceph-mon[96795]: pgmap v1399: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:18.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:18 smithi194 ceph-mon[65619]: pgmap v1399: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:20.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:20 smithi026 ceph-mon[96795]: pgmap v1400: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:20.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:20 smithi194 ceph-mon[65619]: pgmap v1400: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:22.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:22 smithi026 ceph-mon[96795]: pgmap v1401: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:22.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:22 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:41:22.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:22 smithi026 ceph-mon[96795]: poll took 60077.949 ms: 1 events 2021-11-03T17:41:22.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:22 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:41:22.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:22 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:41:22.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:22 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:41:22.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:22 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:41:22.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:22 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:41:22.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:22 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:41:22.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:22 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:41:22.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:22 smithi194 ceph-mon[65619]: pgmap v1401: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:22.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:22 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:41:22.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:22 smithi194 ceph-mon[65619]: poll took 60077.949 ms: 1 events 2021-11-03T17:41:22.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:22 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:41:22.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:22 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:41:22.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:22 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:41:22.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:22 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:41:22.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:22 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:41:22.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:22 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:41:22.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:22 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:41:23.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:23 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:41:23.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:23 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:41:23.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:23 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:41:23.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:23 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:41:24.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:24 smithi026 ceph-mon[96795]: pgmap v1402: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:24.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:24 smithi194 ceph-mon[65619]: pgmap v1402: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:26.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:26 smithi026 ceph-mon[96795]: pgmap v1403: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:26.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:26 smithi194 ceph-mon[65619]: pgmap v1403: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:28.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:28 smithi026 ceph-mon[96795]: pgmap v1404: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:28.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:28 smithi194 ceph-mon[65619]: pgmap v1404: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:30.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:30 smithi026 ceph-mon[96795]: pgmap v1405: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:30.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:30 smithi194 ceph-mon[65619]: pgmap v1405: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:32.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:32 smithi026 ceph-mon[96795]: pgmap v1406: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:32.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:32 smithi194 ceph-mon[65619]: pgmap v1406: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:34.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:34 smithi026 ceph-mon[96795]: pgmap v1407: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:34.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:34 smithi194 ceph-mon[65619]: pgmap v1407: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:36.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:36 smithi026 ceph-mon[96795]: pgmap v1408: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:36.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:36 smithi194 ceph-mon[65619]: pgmap v1408: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:37.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:37 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:41:37.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:37 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:41:38.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:38 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:41:38.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:38 smithi026 ceph-mon[96795]: pgmap v1409: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:38.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:38 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:41:38.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:38 smithi194 ceph-mon[65619]: pgmap v1409: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:39.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:39.960+0000 7f3b4f2e3700 1 -- 172.21.15.26:0/3577380597 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b480f55c0 msgr2=0x7f3b480f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:41:39.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:39.960+0000 7f3b4f2e3700 1 --2- 172.21.15.26:0/3577380597 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b480f55c0 0x7f3b480f59e0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7f3b44004660 tx=0x7f3b44009b30).stop 2021-11-03T17:41:39.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:39.960+0000 7f3b4f2e3700 1 -- 172.21.15.26:0/3577380597 shutdown_connections 2021-11-03T17:41:39.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:39.960+0000 7f3b4f2e3700 1 --2- 172.21.15.26:0/3577380597 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b480f6860 0x7f3b480f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:39.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:39.960+0000 7f3b4f2e3700 1 --2- 172.21.15.26:0/3577380597 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b480f55c0 0x7f3b480f59e0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:39.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:39.960+0000 7f3b4f2e3700 1 -- 172.21.15.26:0/3577380597 >> 172.21.15.26:0/3577380597 conn(0x7f3b480f0d40 msgr2=0x7f3b480f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:41:39.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:39.960+0000 7f3b4f2e3700 1 -- 172.21.15.26:0/3577380597 shutdown_connections 2021-11-03T17:41:39.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:39.960+0000 7f3b4f2e3700 1 -- 172.21.15.26:0/3577380597 wait complete. 2021-11-03T17:41:39.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:39.960+0000 7f3b4f2e3700 1 Processor -- start 2021-11-03T17:41:39.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:39.961+0000 7f3b4f2e3700 1 -- start start 2021-11-03T17:41:39.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:39.961+0000 7f3b4f2e3700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b480f55c0 0x7f3b4810c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:41:39.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:39.961+0000 7f3b4f2e3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b480f6860 0x7f3b4810e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:41:39.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:39.961+0000 7f3b4f2e3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b480603d0 con 0x7f3b480f6860 2021-11-03T17:41:39.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:39.961+0000 7f3b4f2e3700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b48060510 con 0x7f3b480f55c0 2021-11-03T17:41:39.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:39.961+0000 7f3b4c87e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b480f6860 0x7f3b4810e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:41:39.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:39.961+0000 7f3b4c87e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b480f6860 0x7f3b4810e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55832/0 (socket says 172.21.15.26:55832) 2021-11-03T17:41:39.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:39.961+0000 7f3b4c87e700 1 -- 172.21.15.26:0/2885422064 learned_addr learned my addr 172.21.15.26:0/2885422064 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:41:39.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:39.961+0000 7f3b4d07f700 1 --2- 172.21.15.26:0/2885422064 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b480f55c0 0x7f3b4810c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:41:39.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:39.961+0000 7f3b4c87e700 1 -- 172.21.15.26:0/2885422064 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b480f55c0 msgr2=0x7f3b4810c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:41:39.961 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:39.961+0000 7f3b4c87e700 1 --2- 172.21.15.26:0/2885422064 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b480f55c0 0x7f3b4810c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:39.961 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:39.961+0000 7f3b4c87e700 1 -- 172.21.15.26:0/2885422064 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b44005040 con 0x7f3b480f6860 2021-11-03T17:41:39.961 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:39.961+0000 7f3b4c87e700 1 --2- 172.21.15.26:0/2885422064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b480f6860 0x7f3b4810e5e0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7f3b380026d0 tx=0x7f3b38009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:41:39.961 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:39.961+0000 7f3b3dffb700 1 -- 172.21.15.26:0/2885422064 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b380079c0 con 0x7f3b480f6860 2021-11-03T17:41:39.962 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:39.962+0000 7f3b3dffb700 1 -- 172.21.15.26:0/2885422064 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3b3800f040 con 0x7f3b480f6860 2021-11-03T17:41:39.962 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:39.962+0000 7f3b4f2e3700 1 -- 172.21.15.26:0/2885422064 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b4810ead0 con 0x7f3b480f6860 2021-11-03T17:41:39.962 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:39.962+0000 7f3b3dffb700 1 -- 172.21.15.26:0/2885422064 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b380148b0 con 0x7f3b480f6860 2021-11-03T17:41:39.962 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:39.962+0000 7f3b4f2e3700 1 -- 172.21.15.26:0/2885422064 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b4810ef50 con 0x7f3b480f6860 2021-11-03T17:41:39.963 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:39.963+0000 7f3b4f2e3700 1 -- 172.21.15.26:0/2885422064 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b48045ad0 con 0x7f3b480f6860 2021-11-03T17:41:39.964 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:39.963+0000 7f3b3dffb700 1 -- 172.21.15.26:0/2885422064 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f3b38007b20 con 0x7f3b480f6860 2021-11-03T17:41:39.964 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:39.964+0000 7f3b3dffb700 1 --2- 172.21.15.26:0/2885422064 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3b34064170 0x7f3b34066630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:41:39.964 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:39.964+0000 7f3b3dffb700 1 -- 172.21.15.26:0/2885422064 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f3b38080700 con 0x7f3b480f6860 2021-11-03T17:41:39.964 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:39.964+0000 7f3b4d07f700 1 --2- 172.21.15.26:0/2885422064 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3b34064170 0x7f3b34066630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:41:39.965 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:39.964+0000 7f3b4d07f700 1 --2- 172.21.15.26:0/2885422064 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3b34064170 0x7f3b34066630 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f3b44013690 tx=0x7f3b44009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:41:39.965 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:39.968+0000 7f3b3dffb700 1 -- 172.21.15.26:0/2885422064 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f3b380529a0 con 0x7f3b480f6860 2021-11-03T17:41:40.142 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.148+0000 7f3b4f2e3700 1 -- 172.21.15.26:0/2885422064 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b480fdf40 con 0x7f3b34064170 2021-11-03T17:41:40.143 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.149+0000 7f3b3dffb700 1 -- 172.21.15.26:0/2885422064 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f3b480fdf40 con 0x7f3b34064170 2021-11-03T17:41:40.146 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.151+0000 7f3b4f2e3700 1 -- 172.21.15.26:0/2885422064 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3b34064170 msgr2=0x7f3b34066630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:41:40.146 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.151+0000 7f3b4f2e3700 1 --2- 172.21.15.26:0/2885422064 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3b34064170 0x7f3b34066630 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f3b44013690 tx=0x7f3b44009b30).stop 2021-11-03T17:41:40.146 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.151+0000 7f3b4f2e3700 1 -- 172.21.15.26:0/2885422064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b480f6860 msgr2=0x7f3b4810e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:41:40.146 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.151+0000 7f3b4f2e3700 1 --2- 172.21.15.26:0/2885422064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b480f6860 0x7f3b4810e5e0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7f3b380026d0 tx=0x7f3b38009de0).stop 2021-11-03T17:41:40.147 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.151+0000 7f3b4f2e3700 1 -- 172.21.15.26:0/2885422064 shutdown_connections 2021-11-03T17:41:40.147 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.151+0000 7f3b4f2e3700 1 --2- 172.21.15.26:0/2885422064 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3b34064170 0x7f3b34066630 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:40.147 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.151+0000 7f3b4f2e3700 1 --2- 172.21.15.26:0/2885422064 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b480f55c0 0x7f3b4810c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:40.147 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.151+0000 7f3b4f2e3700 1 --2- 172.21.15.26:0/2885422064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b480f6860 0x7f3b4810e5e0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:40.147 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.151+0000 7f3b4f2e3700 1 -- 172.21.15.26:0/2885422064 >> 172.21.15.26:0/2885422064 conn(0x7f3b480f0d40 msgr2=0x7f3b480fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:41:40.148 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.151+0000 7f3b4f2e3700 1 -- 172.21.15.26:0/2885422064 shutdown_connections 2021-11-03T17:41:40.148 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.151+0000 7f3b4f2e3700 1 -- 172.21.15.26:0/2885422064 wait complete. 2021-11-03T17:41:40.155 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:41:40.251 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.254+0000 7f3e9929c700 1 -- 172.21.15.26:0/1855109975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e940f6530 msgr2=0x7f3e940f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:41:40.251 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.254+0000 7f3e9929c700 1 --2- 172.21.15.26:0/1855109975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e940f6530 0x7f3e940f6950 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7f3e84004660 tx=0x7f3e84009b30).stop 2021-11-03T17:41:40.251 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.254+0000 7f3e9929c700 1 -- 172.21.15.26:0/1855109975 shutdown_connections 2021-11-03T17:41:40.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.254+0000 7f3e9929c700 1 --2- 172.21.15.26:0/1855109975 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e940f77d0 0x7f3e940f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:41:40.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.254+0000 7f3e9929c700 1 --2- 172.21.15.26:0/1855109975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e940f6530 0x7f3e940f6950 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:40.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.254+0000 7f3e9929c700 1 -- 172.21.15.26:0/1855109975 >> 172.21.15.26:0/1855109975 conn(0x7f3e940f1cd0 msgr2=0x7f3e940f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:41:40.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.254+0000 7f3e9929c700 1 -- 172.21.15.26:0/1855109975 shutdown_connections 2021-11-03T17:41:40.253 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.254+0000 7f3e9929c700 1 -- 172.21.15.26:0/1855109975 wait complete. 2021-11-03T17:41:40.253 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.255+0000 7f3e9929c700 1 Processor -- start 2021-11-03T17:41:40.254 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.255+0000 7f3e9929c700 1 -- start start 2021-11-03T17:41:40.254 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.255+0000 7f3e9929c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e940f6530 0x7f3e9406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:41:40.255 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.255+0000 7f3e9929c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e940f77d0 0x7f3e94069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:41:40.255 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.255+0000 7f3e9929c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9406a410 con 0x7f3e940f6530 2021-11-03T17:41:40.255 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.255+0000 7f3e9929c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9406a550 con 0x7f3e940f77d0 2021-11-03T17:41:40.255 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.255+0000 7f3e93fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e940f6530 0x7f3e9406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:41:40.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.256+0000 7f3e93fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e940f6530 0x7f3e9406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55840/0 (socket says 172.21.15.26:55840) 2021-11-03T17:41:40.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.256+0000 7f3e93fff700 1 -- 172.21.15.26:0/1789848389 learned_addr learned my addr 172.21.15.26:0/1789848389 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:41:40.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.256+0000 7f3e937fe700 1 --2- 172.21.15.26:0/1789848389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e940f77d0 0x7f3e94069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:41:40.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.256+0000 7f3e93fff700 1 -- 172.21.15.26:0/1789848389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e940f77d0 msgr2=0x7f3e94069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:41:40.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.256+0000 7f3e93fff700 1 --2- 172.21.15.26:0/1789848389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e940f77d0 0x7f3e94069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:40.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.256+0000 7f3e93fff700 1 -- 172.21.15.26:0/1789848389 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e84005040 con 0x7f3e940f6530 2021-11-03T17:41:40.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.256+0000 7f3e937fe700 1 --2- 172.21.15.26:0/1789848389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e940f77d0 0x7f3e94069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:41:40.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.256+0000 7f3e93fff700 1 --2- 172.21.15.26:0/1789848389 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e940f6530 0x7f3e9406b9a0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7f3e84004f60 tx=0x7f3e84009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:41:40.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.256+0000 7f3e90ff9700 1 -- 172.21.15.26:0/1789848389 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e84018070 con 0x7f3e940f6530 2021-11-03T17:41:40.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.256+0000 7f3e9929c700 1 -- 172.21.15.26:0/1789848389 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e9406a7d0 con 0x7f3e940f6530 2021-11-03T17:41:40.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.256+0000 7f3e90ff9700 1 -- 172.21.15.26:0/1789848389 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3e84007ba0 con 0x7f3e940f6530 2021-11-03T17:41:40.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.256+0000 7f3e9929c700 1 -- 172.21.15.26:0/1789848389 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e9410ed80 con 0x7f3e940f6530 2021-11-03T17:41:40.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.256+0000 7f3e90ff9700 1 -- 172.21.15.26:0/1789848389 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e8401c620 con 0x7f3e940f6530 2021-11-03T17:41:40.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.257+0000 7f3e9929c700 1 -- 172.21.15.26:0/1789848389 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e94045ad0 con 0x7f3e940f6530 2021-11-03T17:41:40.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.258+0000 7f3e90ff9700 1 -- 172.21.15.26:0/1789848389 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f3e8401c8e0 con 0x7f3e940f6530 2021-11-03T17:41:40.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.258+0000 7f3e90ff9700 1 --2- 172.21.15.26:0/1789848389 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3e80064100 0x7f3e800665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:41:40.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.258+0000 7f3e90ff9700 1 -- 172.21.15.26:0/1789848389 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f3e84082bb0 con 0x7f3e940f6530 2021-11-03T17:41:40.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.258+0000 7f3e937fe700 1 --2- 172.21.15.26:0/1789848389 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3e80064100 0x7f3e800665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:41:40.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.259+0000 7f3e937fe700 1 --2- 172.21.15.26:0/1789848389 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3e80064100 0x7f3e800665c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f3e7c00b8d0 tx=0x7f3e7c008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:41:40.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.262+0000 7f3e90ff9700 1 -- 172.21.15.26:0/1789848389 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f3e84054e50 con 0x7f3e940f6530 2021-11-03T17:41:40.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.435+0000 7f3e9929c700 1 -- 172.21.15.26:0/1789848389 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e940fee80 con 0x7f3e80064100 2021-11-03T17:41:40.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.450+0000 7f3e90ff9700 1 -- 172.21.15.26:0/1789848389 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f3e940fee80 con 0x7f3e80064100 2021-11-03T17:41:40.444 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:41:40.444 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (52m) 2m ago 54m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:41:40.444 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (45m) 2m ago 54m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:41:40.444 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (44m) 79s ago 53m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:41:40.445 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (52m) 2m ago 53m 40.8M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:41:40.445 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (45m) 2m ago 49m 25.1M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:41:40.445 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (46m) 2m ago 49m 25.7M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:41:40.445 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (49m) 79s ago 49m 26.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:41:40.446 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (49m) 79s ago 49m 26.3M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:41:40.446 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (46m) 2m ago 55m 533M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:41:40.446 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (46m) 79s ago 53m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:41:40.446 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (46m) 2m ago 55m 209M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:41:40.446 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (45m) 79s ago 53m 103M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:41:40.447 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (53m) 2m ago 53m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:41:40.447 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (53m) 79s ago 53m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:41:40.447 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (44m) 2m ago 52m 251M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:41:40.447 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (44m) 2m ago 52m 270M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:41:40.448 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (43m) 2m ago 51m 225M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:41:40.448 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (43m) 79s ago 51m 287M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:41:40.448 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (42m) 79s ago 51m 246M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:41:40.448 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (42m) 79s ago 50m 235M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:41:40.449 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (52m) 2m ago 53m 56.7M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:41:40.450 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.452+0000 7f3e9929c700 1 -- 172.21.15.26:0/1789848389 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3e80064100 msgr2=0x7f3e800665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:41:40.450 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.452+0000 7f3e9929c700 1 --2- 172.21.15.26:0/1789848389 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3e80064100 0x7f3e800665c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f3e7c00b8d0 tx=0x7f3e7c008040).stop 2021-11-03T17:41:40.450 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.452+0000 7f3e9929c700 1 -- 172.21.15.26:0/1789848389 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e940f6530 msgr2=0x7f3e9406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:41:40.451 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.452+0000 7f3e9929c700 1 --2- 172.21.15.26:0/1789848389 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e940f6530 0x7f3e9406b9a0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7f3e84004f60 tx=0x7f3e84009b30).stop 2021-11-03T17:41:40.451 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.452+0000 7f3e9929c700 1 -- 172.21.15.26:0/1789848389 shutdown_connections 2021-11-03T17:41:40.451 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.452+0000 7f3e9929c700 1 --2- 172.21.15.26:0/1789848389 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3e80064100 0x7f3e800665c0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:40.451 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.452+0000 7f3e9929c700 1 --2- 172.21.15.26:0/1789848389 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e940f6530 0x7f3e9406b9a0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:40.452 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.452+0000 7f3e9929c700 1 --2- 172.21.15.26:0/1789848389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e940f77d0 0x7f3e94069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:40.452 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.452+0000 7f3e9929c700 1 -- 172.21.15.26:0/1789848389 >> 172.21.15.26:0/1789848389 conn(0x7f3e940f1cd0 msgr2=0x7f3e940fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:41:40.452 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.452+0000 7f3e9929c700 1 -- 172.21.15.26:0/1789848389 shutdown_connections 2021-11-03T17:41:40.452 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.452+0000 7f3e9929c700 1 -- 172.21.15.26:0/1789848389 wait complete. 2021-11-03T17:41:40.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.551+0000 7f0ab2d1c700 1 -- 172.21.15.26:0/2945422518 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0aac0f5ef0 msgr2=0x7f0aac0f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:41:40.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.551+0000 7f0ab2d1c700 1 --2- 172.21.15.26:0/2945422518 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0aac0f5ef0 0x7f0aac0f6920 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7f0a98004660 tx=0x7f0a98009b30).stop 2021-11-03T17:41:40.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.551+0000 7f0ab2d1c700 1 -- 172.21.15.26:0/2945422518 shutdown_connections 2021-11-03T17:41:40.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.551+0000 7f0ab2d1c700 1 --2- 172.21.15.26:0/2945422518 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0aac0f5ef0 0x7f0aac0f6920 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:40.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.551+0000 7f0ab2d1c700 1 --2- 172.21.15.26:0/2945422518 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0aac0f55e0 0x7f0aac0f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:40.548 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.551+0000 7f0ab2d1c700 1 -- 172.21.15.26:0/2945422518 >> 172.21.15.26:0/2945422518 conn(0x7f0aac0f0de0 msgr2=0x7f0aac0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:41:40.548 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.551+0000 7f0ab2d1c700 1 -- 172.21.15.26:0/2945422518 shutdown_connections 2021-11-03T17:41:40.548 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.551+0000 7f0ab2d1c700 1 -- 172.21.15.26:0/2945422518 wait complete. 2021-11-03T17:41:40.548 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.551+0000 7f0ab2d1c700 1 Processor -- start 2021-11-03T17:41:40.549 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.551+0000 7f0ab2d1c700 1 -- start start 2021-11-03T17:41:40.549 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.552+0000 7f0ab2d1c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0aac0f55e0 0x7f0aac0f97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:41:40.549 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.552+0000 7f0ab2d1c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0aac0f5ef0 0x7f0aac0f7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:41:40.550 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.552+0000 7f0ab2d1c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aac0f81c0 con 0x7f0aac0f55e0 2021-11-03T17:41:40.550 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.552+0000 7f0ab2d1c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aac0f8300 con 0x7f0aac0f5ef0 2021-11-03T17:41:40.550 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.552+0000 7f0ab0ab8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0aac0f55e0 0x7f0aac0f97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:41:40.550 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.552+0000 7f0ab0ab8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0aac0f55e0 0x7f0aac0f97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55850/0 (socket says 172.21.15.26:55850) 2021-11-03T17:41:40.550 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.552+0000 7f0ab0ab8700 1 -- 172.21.15.26:0/1340482707 learned_addr learned my addr 172.21.15.26:0/1340482707 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:41:40.551 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.552+0000 7f0aabfff700 1 --2- 172.21.15.26:0/1340482707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0aac0f5ef0 0x7f0aac0f7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:41:40.551 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.552+0000 7f0ab0ab8700 1 -- 172.21.15.26:0/1340482707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0aac0f5ef0 msgr2=0x7f0aac0f7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:41:40.551 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.552+0000 7f0ab0ab8700 1 --2- 172.21.15.26:0/1340482707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0aac0f5ef0 0x7f0aac0f7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:40.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.552+0000 7f0ab0ab8700 1 -- 172.21.15.26:0/1340482707 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a98005040 con 0x7f0aac0f55e0 2021-11-03T17:41:40.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.552+0000 7f0aabfff700 1 --2- 172.21.15.26:0/1340482707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0aac0f5ef0 0x7f0aac0f7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:41:40.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.552+0000 7f0ab0ab8700 1 --2- 172.21.15.26:0/1340482707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0aac0f55e0 0x7f0aac0f97e0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7f0aa000c530 tx=0x7f0aa0007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:41:40.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.553+0000 7f0aa97fa700 1 -- 172.21.15.26:0/1340482707 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0aa000f650 con 0x7f0aac0f55e0 2021-11-03T17:41:40.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.553+0000 7f0aa97fa700 1 -- 172.21.15.26:0/1340482707 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0aa000fc60 con 0x7f0aac0f55e0 2021-11-03T17:41:40.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.553+0000 7f0ab2d1c700 1 -- 172.21.15.26:0/1340482707 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aac0f85e0 con 0x7f0aac0f55e0 2021-11-03T17:41:40.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.553+0000 7f0aa97fa700 1 -- 172.21.15.26:0/1340482707 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0aa0012cd0 con 0x7f0aac0f55e0 2021-11-03T17:41:40.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.553+0000 7f0ab2d1c700 1 -- 172.21.15.26:0/1340482707 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aac10ef90 con 0x7f0aac0f55e0 2021-11-03T17:41:40.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.553+0000 7f0ab2d1c700 1 -- 172.21.15.26:0/1340482707 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aac045ad0 con 0x7f0aac0f55e0 2021-11-03T17:41:40.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.554+0000 7f0aa97fa700 1 -- 172.21.15.26:0/1340482707 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f0aa0010070 con 0x7f0aac0f55e0 2021-11-03T17:41:40.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.554+0000 7f0aa97fa700 1 --2- 172.21.15.26:0/1340482707 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0a9c064180 0x7f0a9c066640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:41:40.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.554+0000 7f0aa97fa700 1 -- 172.21.15.26:0/1340482707 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f0aa0080560 con 0x7f0aac0f55e0 2021-11-03T17:41:40.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.554+0000 7f0aabfff700 1 --2- 172.21.15.26:0/1340482707 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0a9c064180 0x7f0a9c066640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:41:40.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.555+0000 7f0aabfff700 1 --2- 172.21.15.26:0/1340482707 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0a9c064180 0x7f0a9c066640 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f0a98004e30 tx=0x7f0a98009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:41:40.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.558+0000 7f0aa97fa700 1 -- 172.21.15.26:0/1340482707 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f0aa0052910 con 0x7f0aac0f55e0 2021-11-03T17:41:40.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:40 smithi026 ceph-mon[96795]: pgmap v1410: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:40.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:40 smithi194 ceph-mon[65619]: pgmap v1410: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:40.782 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.788+0000 7f0ab2d1c700 1 -- 172.21.15.26:0/1340482707 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0aac0fddd0 con 0x7f0aac0f55e0 2021-11-03T17:41:40.783 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.789+0000 7f0aa97fa700 1 -- 172.21.15.26:0/1340482707 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f0aa0052500 con 0x7f0aac0f55e0 2021-11-03T17:41:40.783 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:41:40.783 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:41:40.784 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:41:40.784 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:41:40.784 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:41:40.784 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:41:40.784 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:41:40.785 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:41:40.785 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:41:40.785 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:41:40.785 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:41:40.786 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:41:40.786 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:41:40.787 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:41:40.787 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:41:40.787 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:41:40.787 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:41:40.788 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:41:40.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.790+0000 7f0ab2d1c700 1 -- 172.21.15.26:0/1340482707 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0a9c064180 msgr2=0x7f0a9c066640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:41:40.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.790+0000 7f0ab2d1c700 1 --2- 172.21.15.26:0/1340482707 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0a9c064180 0x7f0a9c066640 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f0a98004e30 tx=0x7f0a98009b30).stop 2021-11-03T17:41:40.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.790+0000 7f0ab2d1c700 1 -- 172.21.15.26:0/1340482707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0aac0f55e0 msgr2=0x7f0aac0f97e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:41:40.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.790+0000 7f0ab2d1c700 1 --2- 172.21.15.26:0/1340482707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0aac0f55e0 0x7f0aac0f97e0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7f0aa000c530 tx=0x7f0aa0007e20).stop 2021-11-03T17:41:40.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.791+0000 7f0ab2d1c700 1 -- 172.21.15.26:0/1340482707 shutdown_connections 2021-11-03T17:41:40.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.791+0000 7f0ab2d1c700 1 --2- 172.21.15.26:0/1340482707 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0a9c064180 0x7f0a9c066640 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:40.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.791+0000 7f0ab2d1c700 1 --2- 172.21.15.26:0/1340482707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0aac0f55e0 0x7f0aac0f97e0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:40.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.791+0000 7f0ab2d1c700 1 --2- 172.21.15.26:0/1340482707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0aac0f5ef0 0x7f0aac0f7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:40.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.791+0000 7f0ab2d1c700 1 -- 172.21.15.26:0/1340482707 >> 172.21.15.26:0/1340482707 conn(0x7f0aac0f0de0 msgr2=0x7f0aac05ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:41:40.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.791+0000 7f0ab2d1c700 1 -- 172.21.15.26:0/1340482707 shutdown_connections 2021-11-03T17:41:40.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.791+0000 7f0ab2d1c700 1 -- 172.21.15.26:0/1340482707 wait complete. 2021-11-03T17:41:40.886 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.890+0000 7efe62d61700 1 -- 172.21.15.26:0/1140100091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe5c0602d0 msgr2=0x7efe5c0f9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:41:40.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.890+0000 7efe62d61700 1 --2- 172.21.15.26:0/1140100091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe5c0602d0 0x7efe5c0f9420 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7efe50004690 tx=0x7efe50009b30).stop 2021-11-03T17:41:40.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.891+0000 7efe62d61700 1 -- 172.21.15.26:0/1140100091 shutdown_connections 2021-11-03T17:41:40.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.891+0000 7efe62d61700 1 --2- 172.21.15.26:0/1140100091 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe5c0f9910 0x7efe5c0fbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:40.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.891+0000 7efe62d61700 1 --2- 172.21.15.26:0/1140100091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe5c0602d0 0x7efe5c0f9420 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:40.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.891+0000 7efe62d61700 1 -- 172.21.15.26:0/1140100091 >> 172.21.15.26:0/1140100091 conn(0x7efe5c0f0de0 msgr2=0x7efe5c0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:41:40.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.891+0000 7efe62d61700 1 -- 172.21.15.26:0/1140100091 shutdown_connections 2021-11-03T17:41:40.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.891+0000 7efe62d61700 1 -- 172.21.15.26:0/1140100091 wait complete. 2021-11-03T17:41:40.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.891+0000 7efe62d61700 1 Processor -- start 2021-11-03T17:41:40.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.891+0000 7efe62d61700 1 -- start start 2021-11-03T17:41:40.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.891+0000 7efe62d61700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe5c0602d0 0x7efe5c106f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:41:40.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.891+0000 7efe62d61700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe5c0f9910 0x7efe5c107420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:41:40.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.891+0000 7efe62d61700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c1079d0 con 0x7efe5c0f9910 2021-11-03T17:41:40.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.891+0000 7efe62d61700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c107b10 con 0x7efe5c0602d0 2021-11-03T17:41:40.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.892+0000 7efe5bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe5c0f9910 0x7efe5c107420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:41:40.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.892+0000 7efe5bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe5c0f9910 0x7efe5c107420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55862/0 (socket says 172.21.15.26:55862) 2021-11-03T17:41:40.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.892+0000 7efe5bfff700 1 -- 172.21.15.26:0/3853001853 learned_addr learned my addr 172.21.15.26:0/3853001853 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:41:40.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.892+0000 7efe60afd700 1 --2- 172.21.15.26:0/3853001853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe5c0602d0 0x7efe5c106f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:41:40.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.892+0000 7efe5bfff700 1 -- 172.21.15.26:0/3853001853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe5c0602d0 msgr2=0x7efe5c106f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:41:40.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.892+0000 7efe5bfff700 1 --2- 172.21.15.26:0/3853001853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe5c0602d0 0x7efe5c106f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:40.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.892+0000 7efe5bfff700 1 -- 172.21.15.26:0/3853001853 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe50005040 con 0x7efe5c0f9910 2021-11-03T17:41:40.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.892+0000 7efe60afd700 1 --2- 172.21.15.26:0/3853001853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe5c0602d0 0x7efe5c106f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:41:40.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.892+0000 7efe5bfff700 1 --2- 172.21.15.26:0/3853001853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe5c0f9910 0x7efe5c107420 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7efe4800c530 tx=0x7efe48007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:41:40.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.892+0000 7efe597fa700 1 -- 172.21.15.26:0/3853001853 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe4800f650 con 0x7efe5c0f9910 2021-11-03T17:41:40.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.892+0000 7efe597fa700 1 -- 172.21.15.26:0/3853001853 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efe4800fc60 con 0x7efe5c0f9910 2021-11-03T17:41:40.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.892+0000 7efe62d61700 1 -- 172.21.15.26:0/3853001853 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe5c1084b0 con 0x7efe5c0f9910 2021-11-03T17:41:40.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.892+0000 7efe597fa700 1 -- 172.21.15.26:0/3853001853 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe48012cd0 con 0x7efe5c0f9910 2021-11-03T17:41:40.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.892+0000 7efe62d61700 1 -- 172.21.15.26:0/3853001853 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe5c108a70 con 0x7efe5c0f9910 2021-11-03T17:41:40.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.893+0000 7efe62d61700 1 -- 172.21.15.26:0/3853001853 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe5c045ad0 con 0x7efe5c0f9910 2021-11-03T17:41:40.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.894+0000 7efe597fa700 1 -- 172.21.15.26:0/3853001853 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7efe48010070 con 0x7efe5c0f9910 2021-11-03T17:41:40.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.894+0000 7efe597fa700 1 --2- 172.21.15.26:0/3853001853 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efe4c0640b0 0x7efe4c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:41:40.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.894+0000 7efe597fa700 1 -- 172.21.15.26:0/3853001853 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7efe480806e0 con 0x7efe5c0f9910 2021-11-03T17:41:40.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.894+0000 7efe60afd700 1 --2- 172.21.15.26:0/3853001853 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efe4c0640b0 0x7efe4c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:41:40.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.895+0000 7efe60afd700 1 --2- 172.21.15.26:0/3853001853 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efe4c0640b0 0x7efe4c066570 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7efe500134c0 tx=0x7efe50009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:41:40.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:40.898+0000 7efe597fa700 1 -- 172.21.15.26:0/3853001853 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7efe48052950 con 0x7efe5c0f9910 2021-11-03T17:41:41.099 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:41.105+0000 7efe62d61700 1 -- 172.21.15.26:0/3853001853 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7efe5c108c90 con 0x7efe5c0f9910 2021-11-03T17:41:41.099 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:41.105+0000 7efe597fa700 1 -- 172.21.15.26:0/3853001853 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7efe48052540 con 0x7efe5c0f9910 2021-11-03T17:41:41.099 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:41:41.100 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:41:41.100 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:41:41.100 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:41:41.100 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:41:41.101 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:41:41.101 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:41:41.101 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:41:41.101 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:41:41.102 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:41:41.102 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:41:41.102 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:41:41.102 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:41:41.103 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:41:41.103 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:41:41.103 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:41:41.103 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:41:41.103 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:41:41.104 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:41:41.104 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:41:41.104 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:41:41.104 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:41:41.105 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:41:41.105 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:41:41.105 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:41:41.105 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:41:41.106 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:41:41.106 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:41:41.106 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:41:41.106 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:41:41.107 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:41:41.107 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:41:41.107 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:41:41.107 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:41:41.107 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:41:41.108 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:41:41.108 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:41:41.108 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:41:41.108 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:41:41.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:41.107+0000 7efe62d61700 1 -- 172.21.15.26:0/3853001853 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efe4c0640b0 msgr2=0x7efe4c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:41:41.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:41.107+0000 7efe62d61700 1 --2- 172.21.15.26:0/3853001853 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efe4c0640b0 0x7efe4c066570 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7efe500134c0 tx=0x7efe50009b30).stop 2021-11-03T17:41:41.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:41.107+0000 7efe62d61700 1 -- 172.21.15.26:0/3853001853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe5c0f9910 msgr2=0x7efe5c107420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:41:41.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:41.107+0000 7efe62d61700 1 --2- 172.21.15.26:0/3853001853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe5c0f9910 0x7efe5c107420 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7efe4800c530 tx=0x7efe48007e20).stop 2021-11-03T17:41:41.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:41.107+0000 7efe62d61700 1 -- 172.21.15.26:0/3853001853 shutdown_connections 2021-11-03T17:41:41.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:41.107+0000 7efe62d61700 1 --2- 172.21.15.26:0/3853001853 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efe4c0640b0 0x7efe4c066570 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:41.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:41.107+0000 7efe62d61700 1 --2- 172.21.15.26:0/3853001853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe5c0602d0 0x7efe5c106f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:41.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:41.107+0000 7efe62d61700 1 --2- 172.21.15.26:0/3853001853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe5c0f9910 0x7efe5c107420 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:41:41.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:41.107+0000 7efe62d61700 1 -- 172.21.15.26:0/3853001853 >> 172.21.15.26:0/3853001853 conn(0x7efe5c0f0de0 msgr2=0x7efe5c0f31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:41:41.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:41.107+0000 7efe62d61700 1 -- 172.21.15.26:0/3853001853 shutdown_connections 2021-11-03T17:41:41.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:41:41.107+0000 7efe62d61700 1 -- 172.21.15.26:0/3853001853 wait complete. 2021-11-03T17:41:41.112 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:41:41.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:41 smithi026 ceph-mon[96795]: from='client.35596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:41:41.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:41 smithi026 ceph-mon[96795]: from='client.35600 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:41:41.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:41 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1340482707' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:41:41.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:41 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3853001853' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:41:41.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:41 smithi194 ceph-mon[65619]: from='client.35596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:41:41.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:41 smithi194 ceph-mon[65619]: from='client.35600 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:41:41.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:41 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1340482707' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:41:41.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:41 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3853001853' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:41:42.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:42 smithi026 ceph-mon[96795]: pgmap v1411: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:42.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:42 smithi194 ceph-mon[65619]: pgmap v1411: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:44.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:44 smithi026 ceph-mon[96795]: pgmap v1412: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:44.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:44 smithi194 ceph-mon[65619]: pgmap v1412: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:46.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:46 smithi026 ceph-mon[96795]: pgmap v1413: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:46.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:46 smithi194 ceph-mon[65619]: pgmap v1413: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:48 smithi026 ceph-mon[96795]: pgmap v1414: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:41:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:41:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:48 smithi194 ceph-mon[65619]: pgmap v1414: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:41:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:41:50.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:50 smithi026 ceph-mon[96795]: pgmap v1415: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:50.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:50 smithi194 ceph-mon[65619]: pgmap v1415: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:52.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:52 smithi194 ceph-mon[65619]: pgmap v1416: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:52.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:52 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:41:52.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:52 smithi026 ceph-mon[96795]: pgmap v1416: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:52.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:52 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:41:53.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:53 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:41:53.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:53 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:41:54.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:54 smithi194 ceph-mon[65619]: pgmap v1417: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:54.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:54 smithi026 ceph-mon[96795]: pgmap v1417: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:56.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:56 smithi194 ceph-mon[65619]: pgmap v1418: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:56.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:56 smithi026 ceph-mon[96795]: pgmap v1418: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:58.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:41:58 smithi194 ceph-mon[65619]: pgmap v1419: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:41:58.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:41:58 smithi026 ceph-mon[96795]: pgmap v1419: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:00.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:00 smithi194 ceph-mon[65619]: pgmap v1420: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:00.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:00 smithi026 ceph-mon[96795]: pgmap v1420: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:02.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:02 smithi194 ceph-mon[65619]: pgmap v1421: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:02.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:02 smithi026 ceph-mon[96795]: pgmap v1421: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:04.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:04 smithi194 ceph-mon[65619]: pgmap v1422: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:04.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:04 smithi026 ceph-mon[96795]: pgmap v1422: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:06.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:06 smithi194 ceph-mon[65619]: pgmap v1423: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:06.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:06 smithi026 ceph-mon[96795]: pgmap v1423: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:07.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:07 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:42:07.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:07 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:42:08.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:08 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:42:08.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:08 smithi194 ceph-mon[65619]: pgmap v1424: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:08.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:08 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:42:08.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:08 smithi026 ceph-mon[96795]: pgmap v1424: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:10.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:10 smithi194 ceph-mon[65619]: pgmap v1425: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:10.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:10 smithi026 ceph-mon[96795]: pgmap v1425: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:11.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.221+0000 7fb0f98c3700 1 -- 172.21.15.26:0/3610901362 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0f40f5ef0 msgr2=0x7fb0f40f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:42:11.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.221+0000 7fb0f98c3700 1 --2- 172.21.15.26:0/3610901362 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0f40f5ef0 0x7fb0f40f6920 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7fb0e4004660 tx=0x7fb0e4009b30).stop 2021-11-03T17:42:11.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.221+0000 7fb0f98c3700 1 -- 172.21.15.26:0/3610901362 shutdown_connections 2021-11-03T17:42:11.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.221+0000 7fb0f98c3700 1 --2- 172.21.15.26:0/3610901362 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0f40f5ef0 0x7fb0f40f6920 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:11.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.221+0000 7fb0f98c3700 1 --2- 172.21.15.26:0/3610901362 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0f40f55e0 0x7fb0f40f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:11.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.221+0000 7fb0f98c3700 1 -- 172.21.15.26:0/3610901362 >> 172.21.15.26:0/3610901362 conn(0x7fb0f40f0de0 msgr2=0x7fb0f40f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:42:11.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.221+0000 7fb0f98c3700 1 -- 172.21.15.26:0/3610901362 shutdown_connections 2021-11-03T17:42:11.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.221+0000 7fb0f98c3700 1 -- 172.21.15.26:0/3610901362 wait complete. 2021-11-03T17:42:11.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.222+0000 7fb0f98c3700 1 Processor -- start 2021-11-03T17:42:11.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.222+0000 7fb0f98c3700 1 -- start start 2021-11-03T17:42:11.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.222+0000 7fb0f98c3700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0f40f55e0 0x7fb0f410c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:42:11.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.222+0000 7fb0f98c3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0f40f5ef0 0x7fb0f410e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:42:11.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.222+0000 7fb0f98c3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f40603f0 con 0x7fb0f40f5ef0 2021-11-03T17:42:11.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.222+0000 7fb0f98c3700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f4060530 con 0x7fb0f40f55e0 2021-11-03T17:42:11.221 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.222+0000 7fb0f27fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0f40f5ef0 0x7fb0f410e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:42:11.221 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.222+0000 7fb0f27fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0f40f5ef0 0x7fb0f410e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55882/0 (socket says 172.21.15.26:55882) 2021-11-03T17:42:11.221 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.222+0000 7fb0f27fc700 1 -- 172.21.15.26:0/1582342763 learned_addr learned my addr 172.21.15.26:0/1582342763 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:42:11.221 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.222+0000 7fb0f2ffd700 1 --2- 172.21.15.26:0/1582342763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0f40f55e0 0x7fb0f410c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:42:11.222 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.223+0000 7fb0f27fc700 1 -- 172.21.15.26:0/1582342763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0f40f55e0 msgr2=0x7fb0f410c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:42:11.222 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.223+0000 7fb0f27fc700 1 --2- 172.21.15.26:0/1582342763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0f40f55e0 0x7fb0f410c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:11.222 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.223+0000 7fb0f27fc700 1 -- 172.21.15.26:0/1582342763 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e4005040 con 0x7fb0f40f5ef0 2021-11-03T17:42:11.222 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.223+0000 7fb0f27fc700 1 --2- 172.21.15.26:0/1582342763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0f40f5ef0 0x7fb0f410e590 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7fb0e4009990 tx=0x7fb0e4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:42:11.224 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.223+0000 7fb0db7fe700 1 -- 172.21.15.26:0/1582342763 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0e4018070 con 0x7fb0f40f5ef0 2021-11-03T17:42:11.224 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.223+0000 7fb0db7fe700 1 -- 172.21.15.26:0/1582342763 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb0e4007ba0 con 0x7fb0f40f5ef0 2021-11-03T17:42:11.224 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.223+0000 7fb0db7fe700 1 -- 172.21.15.26:0/1582342763 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0e401c620 con 0x7fb0f40f5ef0 2021-11-03T17:42:11.225 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.223+0000 7fb0f98c3700 1 -- 172.21.15.26:0/1582342763 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0f410ea80 con 0x7fb0f40f5ef0 2021-11-03T17:42:11.225 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.223+0000 7fb0f98c3700 1 -- 172.21.15.26:0/1582342763 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0f410ee50 con 0x7fb0f40f5ef0 2021-11-03T17:42:11.225 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.224+0000 7fb0f98c3700 1 -- 172.21.15.26:0/1582342763 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0f4045ad0 con 0x7fb0f40f5ef0 2021-11-03T17:42:11.225 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.224+0000 7fb0db7fe700 1 -- 172.21.15.26:0/1582342763 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fb0e401c8e0 con 0x7fb0f40f5ef0 2021-11-03T17:42:11.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.225+0000 7fb0db7fe700 1 --2- 172.21.15.26:0/1582342763 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb0dc0640b0 0x7fb0dc066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:42:11.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.225+0000 7fb0db7fe700 1 -- 172.21.15.26:0/1582342763 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fb0e4082600 con 0x7fb0f40f5ef0 2021-11-03T17:42:11.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.225+0000 7fb0f2ffd700 1 --2- 172.21.15.26:0/1582342763 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb0dc0640b0 0x7fb0dc066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:42:11.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.225+0000 7fb0f2ffd700 1 --2- 172.21.15.26:0/1582342763 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb0dc0640b0 0x7fb0dc066570 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7fb0e8007fd0 tx=0x7fb0e8009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:42:11.227 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.229+0000 7fb0db7fe700 1 -- 172.21.15.26:0/1582342763 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fb0e4054a20 con 0x7fb0f40f5ef0 2021-11-03T17:42:11.403 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.408+0000 7fb0f98c3700 1 -- 172.21.15.26:0/1582342763 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0f40fdf10 con 0x7fb0dc0640b0 2021-11-03T17:42:11.404 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.409+0000 7fb0db7fe700 1 -- 172.21.15.26:0/1582342763 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fb0f40fdf10 con 0x7fb0dc0640b0 2021-11-03T17:42:11.406 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.411+0000 7fb0f98c3700 1 -- 172.21.15.26:0/1582342763 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb0dc0640b0 msgr2=0x7fb0dc066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:42:11.406 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.411+0000 7fb0f98c3700 1 --2- 172.21.15.26:0/1582342763 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb0dc0640b0 0x7fb0dc066570 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7fb0e8007fd0 tx=0x7fb0e8009040).stop 2021-11-03T17:42:11.406 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.411+0000 7fb0f98c3700 1 -- 172.21.15.26:0/1582342763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0f40f5ef0 msgr2=0x7fb0f410e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:42:11.407 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.411+0000 7fb0f98c3700 1 --2- 172.21.15.26:0/1582342763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0f40f5ef0 0x7fb0f410e590 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7fb0e4009990 tx=0x7fb0e4009b30).stop 2021-11-03T17:42:11.407 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.411+0000 7fb0f98c3700 1 -- 172.21.15.26:0/1582342763 shutdown_connections 2021-11-03T17:42:11.407 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.411+0000 7fb0f98c3700 1 --2- 172.21.15.26:0/1582342763 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb0dc0640b0 0x7fb0dc066570 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:11.407 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.411+0000 7fb0f98c3700 1 --2- 172.21.15.26:0/1582342763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0f40f55e0 0x7fb0f410c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:11.408 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.411+0000 7fb0f98c3700 1 --2- 172.21.15.26:0/1582342763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0f40f5ef0 0x7fb0f410e590 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:11.408 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.411+0000 7fb0f98c3700 1 -- 172.21.15.26:0/1582342763 >> 172.21.15.26:0/1582342763 conn(0x7fb0f40f0de0 msgr2=0x7fb0f40fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:42:11.408 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.411+0000 7fb0f98c3700 1 -- 172.21.15.26:0/1582342763 shutdown_connections 2021-11-03T17:42:11.408 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.411+0000 7fb0f98c3700 1 -- 172.21.15.26:0/1582342763 wait complete. 2021-11-03T17:42:11.416 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:42:11.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.512+0000 7f869bb12700 1 -- 172.21.15.26:0/1464226139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86940f7960 msgr2=0x7f86940f7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:42:11.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.512+0000 7f869bb12700 1 --2- 172.21.15.26:0/1464226139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86940f7960 0x7f86940f7dc0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7f8684004660 tx=0x7f8684009b30).stop 2021-11-03T17:42:11.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.512+0000 7f869bb12700 1 -- 172.21.15.26:0/1464226139 shutdown_connections 2021-11-03T17:42:11.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.512+0000 7f869bb12700 1 --2- 172.21.15.26:0/1464226139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86940f7960 0x7f86940f7dc0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:11.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.512+0000 7f869bb12700 1 --2- 172.21.15.26:0/1464226139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86940f66c0 0x7f86940f6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:11.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.512+0000 7f869bb12700 1 -- 172.21.15.26:0/1464226139 >> 172.21.15.26:0/1464226139 conn(0x7f86940f1e20 msgr2=0x7f86940f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:42:11.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.513+0000 7f869bb12700 1 -- 172.21.15.26:0/1464226139 shutdown_connections 2021-11-03T17:42:11.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.513+0000 7f869bb12700 1 -- 172.21.15.26:0/1464226139 wait complete. 2021-11-03T17:42:11.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.513+0000 7f869bb12700 1 Processor -- start 2021-11-03T17:42:11.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.513+0000 7f869bb12700 1 -- start start 2021-11-03T17:42:11.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.513+0000 7f869bb12700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86940f66c0 0x7f8694106f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:42:11.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.513+0000 7f869bb12700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86940f7960 0x7f8694107480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:42:11.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.513+0000 7f869bb12700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8694107a30 con 0x7f86940f66c0 2021-11-03T17:42:11.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.513+0000 7f869bb12700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8694107b70 con 0x7f86940f7960 2021-11-03T17:42:11.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.513+0000 7f86998ae700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86940f66c0 0x7f8694106f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:42:11.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.513+0000 7f86998ae700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86940f66c0 0x7f8694106f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55890/0 (socket says 172.21.15.26:55890) 2021-11-03T17:42:11.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.513+0000 7f86998ae700 1 -- 172.21.15.26:0/2606671421 learned_addr learned my addr 172.21.15.26:0/2606671421 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:42:11.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.514+0000 7f86990ad700 1 --2- 172.21.15.26:0/2606671421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86940f7960 0x7f8694107480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:42:11.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.514+0000 7f86998ae700 1 -- 172.21.15.26:0/2606671421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86940f7960 msgr2=0x7f8694107480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:42:11.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.514+0000 7f86998ae700 1 --2- 172.21.15.26:0/2606671421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86940f7960 0x7f8694107480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:11.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.514+0000 7f86998ae700 1 -- 172.21.15.26:0/2606671421 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8684005040 con 0x7f86940f66c0 2021-11-03T17:42:11.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.514+0000 7f86990ad700 1 --2- 172.21.15.26:0/2606671421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86940f7960 0x7f8694107480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:42:11.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.514+0000 7f86998ae700 1 --2- 172.21.15.26:0/2606671421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86940f66c0 0x7f8694106f90 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x7f8690002700 tx=0x7f8690009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:42:11.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.514+0000 7f868a7fc700 1 -- 172.21.15.26:0/2606671421 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8690009320 con 0x7f86940f66c0 2021-11-03T17:42:11.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.514+0000 7f868a7fc700 1 -- 172.21.15.26:0/2606671421 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f869000f040 con 0x7f86940f66c0 2021-11-03T17:42:11.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.514+0000 7f869bb12700 1 -- 172.21.15.26:0/2606671421 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8694108510 con 0x7f86940f66c0 2021-11-03T17:42:11.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.514+0000 7f868a7fc700 1 -- 172.21.15.26:0/2606671421 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8690014780 con 0x7f86940f66c0 2021-11-03T17:42:11.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.514+0000 7f869bb12700 1 -- 172.21.15.26:0/2606671421 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8694108ad0 con 0x7f86940f66c0 2021-11-03T17:42:11.518 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.515+0000 7f869bb12700 1 -- 172.21.15.26:0/2606671421 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8694045ad0 con 0x7f86940f66c0 2021-11-03T17:42:11.518 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.515+0000 7f868a7fc700 1 -- 172.21.15.26:0/2606671421 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f8690009480 con 0x7f86940f66c0 2021-11-03T17:42:11.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.516+0000 7f868a7fc700 1 --2- 172.21.15.26:0/2606671421 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8680064090 0x7f8680066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:42:11.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.516+0000 7f868a7fc700 1 -- 172.21.15.26:0/2606671421 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f8690080e00 con 0x7f86940f66c0 2021-11-03T17:42:11.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.516+0000 7f86990ad700 1 --2- 172.21.15.26:0/2606671421 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8680064090 0x7f8680066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:42:11.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.516+0000 7f86990ad700 1 --2- 172.21.15.26:0/2606671421 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8680064090 0x7f8680066550 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f8684004e30 tx=0x7f8684009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:42:11.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.520+0000 7f868a7fc700 1 -- 172.21.15.26:0/2606671421 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f8690053100 con 0x7f86940f66c0 2021-11-03T17:42:11.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.692+0000 7f869bb12700 1 -- 172.21.15.26:0/2606671421 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f86940fefe0 con 0x7f8680064090 2021-11-03T17:42:11.702 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.707+0000 7f868a7fc700 1 -- 172.21.15.26:0/2606671421 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f86940fefe0 con 0x7f8680064090 2021-11-03T17:42:11.702 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:42:11.702 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (53m) 2m ago 54m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:42:11.703 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (45m) 2m ago 54m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:42:11.703 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (45m) 110s ago 53m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:42:11.703 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (53m) 2m ago 54m 40.8M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:42:11.703 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (46m) 2m ago 49m 25.1M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:42:11.704 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (46m) 2m ago 49m 25.7M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:42:11.704 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (49m) 110s ago 49m 26.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:42:11.704 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (49m) 110s ago 49m 26.3M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:42:11.704 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (47m) 2m ago 56m 533M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:42:11.704 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (46m) 110s ago 53m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:42:11.705 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (46m) 2m ago 56m 209M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:42:11.705 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (46m) 110s ago 53m 103M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:42:11.705 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (54m) 2m ago 54m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:42:11.705 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (53m) 110s ago 53m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:42:11.705 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (45m) 2m ago 53m 251M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:42:11.706 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (44m) 2m ago 52m 270M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:42:11.706 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (44m) 2m ago 52m 225M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:42:11.706 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (43m) 110s ago 52m 287M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:42:11.706 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (43m) 110s ago 51m 246M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:42:11.707 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (42m) 110s ago 51m 235M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:42:11.707 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (53m) 2m ago 54m 56.7M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:42:11.708 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.709+0000 7f869bb12700 1 -- 172.21.15.26:0/2606671421 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8680064090 msgr2=0x7f8680066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:42:11.708 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.709+0000 7f869bb12700 1 --2- 172.21.15.26:0/2606671421 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8680064090 0x7f8680066550 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f8684004e30 tx=0x7f8684009b30).stop 2021-11-03T17:42:11.708 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.709+0000 7f869bb12700 1 -- 172.21.15.26:0/2606671421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86940f66c0 msgr2=0x7f8694106f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:42:11.708 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.709+0000 7f869bb12700 1 --2- 172.21.15.26:0/2606671421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86940f66c0 0x7f8694106f90 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x7f8690002700 tx=0x7f8690009d60).stop 2021-11-03T17:42:11.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.709+0000 7f869bb12700 1 -- 172.21.15.26:0/2606671421 shutdown_connections 2021-11-03T17:42:11.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.709+0000 7f869bb12700 1 --2- 172.21.15.26:0/2606671421 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8680064090 0x7f8680066550 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:11.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.709+0000 7f869bb12700 1 --2- 172.21.15.26:0/2606671421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86940f66c0 0x7f8694106f90 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:11.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.709+0000 7f869bb12700 1 --2- 172.21.15.26:0/2606671421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86940f7960 0x7f8694107480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:11.710 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.709+0000 7f869bb12700 1 -- 172.21.15.26:0/2606671421 >> 172.21.15.26:0/2606671421 conn(0x7f86940f1e20 msgr2=0x7f86940fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:42:11.710 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.709+0000 7f869bb12700 1 -- 172.21.15.26:0/2606671421 shutdown_connections 2021-11-03T17:42:11.710 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.709+0000 7f869bb12700 1 -- 172.21.15.26:0/2606671421 wait complete. 2021-11-03T17:42:11.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.807+0000 7fb14c6e4700 1 -- 172.21.15.26:0/879707296 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1440f7960 msgr2=0x7fb1440f7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:42:11.805 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.807+0000 7fb14c6e4700 1 --2- 172.21.15.26:0/879707296 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1440f7960 0x7fb1440f7dc0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7fb134004660 tx=0x7fb134009b30).stop 2021-11-03T17:42:11.805 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.808+0000 7fb14c6e4700 1 -- 172.21.15.26:0/879707296 shutdown_connections 2021-11-03T17:42:11.805 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.808+0000 7fb14c6e4700 1 --2- 172.21.15.26:0/879707296 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1440f7960 0x7fb1440f7dc0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:11.805 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.808+0000 7fb14c6e4700 1 --2- 172.21.15.26:0/879707296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1440f66c0 0x7fb1440f6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:11.806 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.808+0000 7fb14c6e4700 1 -- 172.21.15.26:0/879707296 >> 172.21.15.26:0/879707296 conn(0x7fb1440f1e20 msgr2=0x7fb1440f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:42:11.806 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.808+0000 7fb14c6e4700 1 -- 172.21.15.26:0/879707296 shutdown_connections 2021-11-03T17:42:11.806 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.808+0000 7fb14c6e4700 1 -- 172.21.15.26:0/879707296 wait complete. 2021-11-03T17:42:11.806 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.808+0000 7fb14c6e4700 1 Processor -- start 2021-11-03T17:42:11.807 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.808+0000 7fb14c6e4700 1 -- start start 2021-11-03T17:42:11.807 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.808+0000 7fb14c6e4700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1440f66c0 0x7fb144106f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:42:11.807 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.808+0000 7fb14c6e4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1440f7960 0x7fb144107440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:42:11.807 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.808+0000 7fb14c6e4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1441079f0 con 0x7fb1440f7960 2021-11-03T17:42:11.808 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.808+0000 7fb14c6e4700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb144107b30 con 0x7fb1440f66c0 2021-11-03T17:42:11.808 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.809+0000 7fb149c7f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1440f7960 0x7fb144107440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:42:11.808 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.809+0000 7fb149c7f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1440f7960 0x7fb144107440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55902/0 (socket says 172.21.15.26:55902) 2021-11-03T17:42:11.808 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.809+0000 7fb149c7f700 1 -- 172.21.15.26:0/18322938 learned_addr learned my addr 172.21.15.26:0/18322938 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:42:11.808 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.809+0000 7fb149c7f700 1 -- 172.21.15.26:0/18322938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1440f66c0 msgr2=0x7fb144106f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:42:11.809 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.809+0000 7fb14a480700 1 --2- 172.21.15.26:0/18322938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1440f66c0 0x7fb144106f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:42:11.809 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.809+0000 7fb149c7f700 1 --2- 172.21.15.26:0/18322938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1440f66c0 0x7fb144106f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:11.809 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.809+0000 7fb149c7f700 1 -- 172.21.15.26:0/18322938 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb134005040 con 0x7fb1440f7960 2021-11-03T17:42:11.809 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.809+0000 7fb149c7f700 1 --2- 172.21.15.26:0/18322938 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1440f7960 0x7fb144107440 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7fb134009990 tx=0x7fb134009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:42:11.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.809+0000 7fb13affd700 1 -- 172.21.15.26:0/18322938 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb134018070 con 0x7fb1440f7960 2021-11-03T17:42:11.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.809+0000 7fb14c6e4700 1 -- 172.21.15.26:0/18322938 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb144108470 con 0x7fb1440f7960 2021-11-03T17:42:11.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.809+0000 7fb13affd700 1 -- 172.21.15.26:0/18322938 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb134007ca0 con 0x7fb1440f7960 2021-11-03T17:42:11.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.809+0000 7fb13affd700 1 -- 172.21.15.26:0/18322938 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb13401c620 con 0x7fb1440f7960 2021-11-03T17:42:11.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.809+0000 7fb14c6e4700 1 -- 172.21.15.26:0/18322938 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1441089d0 con 0x7fb1440f7960 2021-11-03T17:42:11.812 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.810+0000 7fb14c6e4700 1 -- 172.21.15.26:0/18322938 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb144045ad0 con 0x7fb1440f7960 2021-11-03T17:42:11.812 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.811+0000 7fb13affd700 1 -- 172.21.15.26:0/18322938 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fb13401d960 con 0x7fb1440f7960 2021-11-03T17:42:11.812 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.811+0000 7fb13affd700 1 --2- 172.21.15.26:0/18322938 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb1300640b0 0x7fb130066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:42:11.812 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.811+0000 7fb13affd700 1 -- 172.21.15.26:0/18322938 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fb134082540 con 0x7fb1440f7960 2021-11-03T17:42:11.813 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.811+0000 7fb14a480700 1 --2- 172.21.15.26:0/18322938 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb1300640b0 0x7fb130066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:42:11.813 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.812+0000 7fb14a480700 1 --2- 172.21.15.26:0/18322938 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb1300640b0 0x7fb130066570 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7fb1440f77c0 tx=0x7fb140009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:42:11.813 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:11.815+0000 7fb13affd700 1 -- 172.21.15.26:0/18322938 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fb134054960 con 0x7fb1440f7960 2021-11-03T17:42:12.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.048+0000 7fb14c6e4700 1 -- 172.21.15.26:0/18322938 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb144027a00 con 0x7fb1440f7960 2021-11-03T17:42:12.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.048+0000 7fb13affd700 1 -- 172.21.15.26:0/18322938 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fb134054550 con 0x7fb1440f7960 2021-11-03T17:42:12.043 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:42:12.044 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:42:12.044 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:42:12.044 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:42:12.044 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:42:12.045 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:42:12.045 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:42:12.045 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:42:12.045 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:42:12.046 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:42:12.046 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:42:12.046 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:42:12.046 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:42:12.047 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:42:12.047 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:42:12.047 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:42:12.047 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:42:12.047 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:42:12.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.050+0000 7fb14c6e4700 1 -- 172.21.15.26:0/18322938 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb1300640b0 msgr2=0x7fb130066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:42:12.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.050+0000 7fb14c6e4700 1 --2- 172.21.15.26:0/18322938 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb1300640b0 0x7fb130066570 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7fb1440f77c0 tx=0x7fb140009040).stop 2021-11-03T17:42:12.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.050+0000 7fb14c6e4700 1 -- 172.21.15.26:0/18322938 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1440f7960 msgr2=0x7fb144107440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:42:12.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.050+0000 7fb14c6e4700 1 --2- 172.21.15.26:0/18322938 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1440f7960 0x7fb144107440 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7fb134009990 tx=0x7fb134009b30).stop 2021-11-03T17:42:12.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.050+0000 7fb14c6e4700 1 -- 172.21.15.26:0/18322938 shutdown_connections 2021-11-03T17:42:12.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.050+0000 7fb14c6e4700 1 --2- 172.21.15.26:0/18322938 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb1300640b0 0x7fb130066570 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:12.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.050+0000 7fb14c6e4700 1 --2- 172.21.15.26:0/18322938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1440f66c0 0x7fb144106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:12.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.050+0000 7fb14c6e4700 1 --2- 172.21.15.26:0/18322938 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1440f7960 0x7fb144107440 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:12.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.050+0000 7fb14c6e4700 1 -- 172.21.15.26:0/18322938 >> 172.21.15.26:0/18322938 conn(0x7fb1440f1e20 msgr2=0x7fb1440fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:42:12.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.050+0000 7fb14c6e4700 1 -- 172.21.15.26:0/18322938 shutdown_connections 2021-11-03T17:42:12.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.050+0000 7fb14c6e4700 1 -- 172.21.15.26:0/18322938 wait complete. 2021-11-03T17:42:12.147 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.150+0000 7fba36cf2700 1 -- 172.21.15.26:0/3926933365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba300f66e0 msgr2=0x7fba300f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:42:12.147 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.150+0000 7fba36cf2700 1 --2- 172.21.15.26:0/3926933365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba300f66e0 0x7fba300f6b00 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7fba24004660 tx=0x7fba24009b30).stop 2021-11-03T17:42:12.147 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.150+0000 7fba36cf2700 1 -- 172.21.15.26:0/3926933365 shutdown_connections 2021-11-03T17:42:12.148 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.150+0000 7fba36cf2700 1 --2- 172.21.15.26:0/3926933365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba300f6ff0 0x7fba300f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:12.148 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.150+0000 7fba36cf2700 1 --2- 172.21.15.26:0/3926933365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba300f66e0 0x7fba300f6b00 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:12.148 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.150+0000 7fba36cf2700 1 -- 172.21.15.26:0/3926933365 >> 172.21.15.26:0/3926933365 conn(0x7fba300f1f00 msgr2=0x7fba300f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:42:12.148 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.150+0000 7fba36cf2700 1 -- 172.21.15.26:0/3926933365 shutdown_connections 2021-11-03T17:42:12.149 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.150+0000 7fba36cf2700 1 -- 172.21.15.26:0/3926933365 wait complete. 2021-11-03T17:42:12.149 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.151+0000 7fba36cf2700 1 Processor -- start 2021-11-03T17:42:12.149 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.151+0000 7fba36cf2700 1 -- start start 2021-11-03T17:42:12.149 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.151+0000 7fba36cf2700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba300f66e0 0x7fba30106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:42:12.149 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.151+0000 7fba36cf2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba300f6ff0 0x7fba30107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:42:12.150 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.151+0000 7fba36cf2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba30107a00 con 0x7fba300f6ff0 2021-11-03T17:42:12.150 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.151+0000 7fba36cf2700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba30107b40 con 0x7fba300f66e0 2021-11-03T17:42:12.150 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.151+0000 7fba2ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba300f6ff0 0x7fba30107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:42:12.150 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.151+0000 7fba2ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba300f6ff0 0x7fba30107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55912/0 (socket says 172.21.15.26:55912) 2021-11-03T17:42:12.151 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.151+0000 7fba2ffff700 1 -- 172.21.15.26:0/402851778 learned_addr learned my addr 172.21.15.26:0/402851778 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:42:12.151 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.151+0000 7fba34a8e700 1 --2- 172.21.15.26:0/402851778 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba300f66e0 0x7fba30106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:42:12.151 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.152+0000 7fba2ffff700 1 -- 172.21.15.26:0/402851778 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba300f66e0 msgr2=0x7fba30106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:42:12.151 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.152+0000 7fba2ffff700 1 --2- 172.21.15.26:0/402851778 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba300f66e0 0x7fba30106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:12.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.152+0000 7fba2ffff700 1 -- 172.21.15.26:0/402851778 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba24005040 con 0x7fba300f6ff0 2021-11-03T17:42:12.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.152+0000 7fba34a8e700 1 --2- 172.21.15.26:0/402851778 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba300f66e0 0x7fba30106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:42:12.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.152+0000 7fba2ffff700 1 --2- 172.21.15.26:0/402851778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba300f6ff0 0x7fba30107450 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7fba1c0026d0 tx=0x7fba1c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:42:12.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.152+0000 7fba2d7fa700 1 -- 172.21.15.26:0/402851778 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba1c009320 con 0x7fba300f6ff0 2021-11-03T17:42:12.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.152+0000 7fba2d7fa700 1 -- 172.21.15.26:0/402851778 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fba1c00f040 con 0x7fba300f6ff0 2021-11-03T17:42:12.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.152+0000 7fba36cf2700 1 -- 172.21.15.26:0/402851778 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba301084e0 con 0x7fba300f6ff0 2021-11-03T17:42:12.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.152+0000 7fba2d7fa700 1 -- 172.21.15.26:0/402851778 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba1c0147e0 con 0x7fba300f6ff0 2021-11-03T17:42:12.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.152+0000 7fba36cf2700 1 -- 172.21.15.26:0/402851778 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba30108aa0 con 0x7fba300f6ff0 2021-11-03T17:42:12.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.153+0000 7fba36cf2700 1 -- 172.21.15.26:0/402851778 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba30045ad0 con 0x7fba300f6ff0 2021-11-03T17:42:12.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.153+0000 7fba2d7fa700 1 -- 172.21.15.26:0/402851778 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fba1c009480 con 0x7fba300f6ff0 2021-11-03T17:42:12.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.154+0000 7fba2d7fa700 1 --2- 172.21.15.26:0/402851778 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fba200640b0 0x7fba20066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:42:12.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.154+0000 7fba2d7fa700 1 -- 172.21.15.26:0/402851778 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fba1c080df0 con 0x7fba300f6ff0 2021-11-03T17:42:12.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.154+0000 7fba34a8e700 1 --2- 172.21.15.26:0/402851778 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fba200640b0 0x7fba20066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:42:12.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.154+0000 7fba34a8e700 1 --2- 172.21.15.26:0/402851778 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fba200640b0 0x7fba20066570 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7fba24009da0 tx=0x7fba24009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:42:12.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.158+0000 7fba2d7fa700 1 -- 172.21.15.26:0/402851778 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fba1c053210 con 0x7fba300f6ff0 2021-11-03T17:42:12.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.362+0000 7fba36cf2700 1 -- 172.21.15.26:0/402851778 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fba300ff010 con 0x7fba300f6ff0 2021-11-03T17:42:12.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.362+0000 7fba2d7fa700 1 -- 172.21.15.26:0/402851778 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fba1c052e00 con 0x7fba300f6ff0 2021-11-03T17:42:12.358 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:42:12.358 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:42:12.358 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:42:12.358 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:42:12.359 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:42:12.359 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:42:12.359 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:42:12.360 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:42:12.360 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:42:12.360 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:42:12.360 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:42:12.361 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:42:12.361 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:42:12.361 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:42:12.361 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:42:12.361 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:42:12.362 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:42:12.362 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:42:12.362 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:42:12.362 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:42:12.363 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:42:12.363 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:42:12.363 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:42:12.363 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:42:12.364 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:42:12.364 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:42:12.364 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:42:12.365 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:42:12.365 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:42:12.365 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:42:12.366 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:42:12.366 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:42:12.366 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:42:12.366 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:42:12.367 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:42:12.367 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:42:12.367 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:42:12.367 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:42:12.368 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:42:12.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.364+0000 7fba36cf2700 1 -- 172.21.15.26:0/402851778 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fba200640b0 msgr2=0x7fba20066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:42:12.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.364+0000 7fba36cf2700 1 --2- 172.21.15.26:0/402851778 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fba200640b0 0x7fba20066570 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7fba24009da0 tx=0x7fba24009b30).stop 2021-11-03T17:42:12.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.364+0000 7fba36cf2700 1 -- 172.21.15.26:0/402851778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba300f6ff0 msgr2=0x7fba30107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:42:12.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.364+0000 7fba36cf2700 1 --2- 172.21.15.26:0/402851778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba300f6ff0 0x7fba30107450 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7fba1c0026d0 tx=0x7fba1c009de0).stop 2021-11-03T17:42:12.370 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.364+0000 7fba36cf2700 1 -- 172.21.15.26:0/402851778 shutdown_connections 2021-11-03T17:42:12.370 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.364+0000 7fba36cf2700 1 --2- 172.21.15.26:0/402851778 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fba200640b0 0x7fba20066570 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:12.370 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.364+0000 7fba36cf2700 1 --2- 172.21.15.26:0/402851778 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba300f66e0 0x7fba30106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:12.371 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.364+0000 7fba36cf2700 1 --2- 172.21.15.26:0/402851778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba300f6ff0 0x7fba30107450 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:12.371 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.364+0000 7fba36cf2700 1 -- 172.21.15.26:0/402851778 >> 172.21.15.26:0/402851778 conn(0x7fba300f1f00 msgr2=0x7fba300fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:42:12.371 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.364+0000 7fba36cf2700 1 -- 172.21.15.26:0/402851778 shutdown_connections 2021-11-03T17:42:12.372 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:12.365+0000 7fba36cf2700 1 -- 172.21.15.26:0/402851778 wait complete. 2021-11-03T17:42:12.372 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:42:12.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:12 smithi194 ceph-mon[65619]: pgmap v1426: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:12.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:12 smithi194 ceph-mon[65619]: from='client.35612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:42:12.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:12 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/18322938' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:42:12.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:12 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/402851778' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:42:12.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:12 smithi026 ceph-mon[96795]: pgmap v1426: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:12.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:12 smithi026 ceph-mon[96795]: from='client.35612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:42:12.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:12 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/18322938' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:42:12.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:12 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/402851778' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:42:13.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:13 smithi194 ceph-mon[65619]: from='client.35616 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:42:13.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:13 smithi026 ceph-mon[96795]: from='client.35616 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:42:14.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:14 smithi194 ceph-mon[65619]: pgmap v1427: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:14.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:14 smithi026 ceph-mon[96795]: pgmap v1427: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:16.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:16 smithi194 ceph-mon[65619]: pgmap v1428: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:16.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:16 smithi026 ceph-mon[96795]: pgmap v1428: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:18.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:18 smithi194 ceph-mon[65619]: pgmap v1429: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:18.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:18 smithi026 ceph-mon[96795]: pgmap v1429: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:20.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:20 smithi194 ceph-mon[65619]: pgmap v1430: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:20.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:20 smithi026 ceph-mon[96795]: pgmap v1430: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:22.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:22 smithi026 ceph-mon[96795]: pgmap v1431: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:22.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:22 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:42:22.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:22 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:42:22.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:22 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:42:22.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:22 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:42:22.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:22 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:42:22.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:22 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:42:22.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:22 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:42:22.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:22 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:42:22.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:22 smithi194 ceph-mon[65619]: pgmap v1431: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:22.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:22 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:42:22.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:22 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:42:22.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:22 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:42:22.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:22 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:42:22.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:22 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:42:22.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:22 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:42:22.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:22 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:42:22.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:22 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:42:23.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:23 smithi194 ceph-mon[65619]: poll took 60056.046 ms: 1 events 2021-11-03T17:42:23.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:23 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:42:23.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:23 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:42:23.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:23 smithi026 ceph-mon[96795]: poll took 60056.046 ms: 1 events 2021-11-03T17:42:23.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:23 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:42:23.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:23 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:42:24.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:24 smithi194 ceph-mon[65619]: pgmap v1432: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:24.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:24 smithi026 ceph-mon[96795]: pgmap v1432: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:26.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:26 smithi194 ceph-mon[65619]: pgmap v1433: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:26.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:26 smithi026 ceph-mon[96795]: pgmap v1433: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:28.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:28 smithi194 ceph-mon[65619]: pgmap v1434: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:28.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:28 smithi026 ceph-mon[96795]: pgmap v1434: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:30.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:30 smithi194 ceph-mon[65619]: pgmap v1435: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:30.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:30 smithi026 ceph-mon[96795]: pgmap v1435: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:32.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:32 smithi194 ceph-mon[65619]: pgmap v1436: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:32.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:32 smithi026 ceph-mon[96795]: pgmap v1436: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:34.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:34 smithi026 ceph-mon[96795]: pgmap v1437: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:34.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:34 smithi194 ceph-mon[65619]: pgmap v1437: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:36.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:36 smithi026 ceph-mon[96795]: pgmap v1438: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:36.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:36 smithi194 ceph-mon[65619]: pgmap v1438: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:37.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:37 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:42:37.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:37 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:42:38.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:38 smithi026 ceph-mon[96795]: pgmap v1439: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:38.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:38 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:42:38.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:38 smithi194 ceph-mon[65619]: pgmap v1439: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:38.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:38 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:42:40.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:40 smithi026 ceph-mon[96795]: pgmap v1440: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:40.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:40 smithi194 ceph-mon[65619]: pgmap v1440: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:42.478 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.483+0000 7f69a692f700 1 -- 172.21.15.26:0/3229456934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69a00f49a0 msgr2=0x7f69a00f4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:42:42.478 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.483+0000 7f69a692f700 1 --2- 172.21.15.26:0/3229456934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69a00f49a0 0x7f69a00f4dc0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7f6990004660 tx=0x7f6990009b30).stop 2021-11-03T17:42:42.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.483+0000 7f69a692f700 1 -- 172.21.15.26:0/3229456934 shutdown_connections 2021-11-03T17:42:42.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.483+0000 7f69a692f700 1 --2- 172.21.15.26:0/3229456934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69a00f5340 0x7f69a00f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:42.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.483+0000 7f69a692f700 1 --2- 172.21.15.26:0/3229456934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69a00f49a0 0x7f69a00f4dc0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:42.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.483+0000 7f69a692f700 1 -- 172.21.15.26:0/3229456934 >> 172.21.15.26:0/3229456934 conn(0x7f69a00f04c0 msgr2=0x7f69a00f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:42:42.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.483+0000 7f69a692f700 1 -- 172.21.15.26:0/3229456934 shutdown_connections 2021-11-03T17:42:42.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.483+0000 7f69a692f700 1 -- 172.21.15.26:0/3229456934 wait complete. 2021-11-03T17:42:42.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.484+0000 7f69a692f700 1 Processor -- start 2021-11-03T17:42:42.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.484+0000 7f69a692f700 1 -- start start 2021-11-03T17:42:42.481 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.484+0000 7f69a692f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69a00f49a0 0x7f69a0106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:42:42.481 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.484+0000 7f69a692f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69a00f5340 0x7f69a0107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:42:42.481 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.484+0000 7f69a692f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a0107a10 con 0x7f69a00f49a0 2021-11-03T17:42:42.481 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.484+0000 7f69a692f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a0107b50 con 0x7f69a00f5340 2021-11-03T17:42:42.481 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.484+0000 7f699ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69a00f49a0 0x7f69a0106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:42:42.482 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.484+0000 7f699ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69a00f49a0 0x7f69a0106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55930/0 (socket says 172.21.15.26:55930) 2021-11-03T17:42:42.482 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.484+0000 7f699ffff700 1 -- 172.21.15.26:0/2282324782 learned_addr learned my addr 172.21.15.26:0/2282324782 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:42:42.482 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.484+0000 7f699f7fe700 1 --2- 172.21.15.26:0/2282324782 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69a00f5340 0x7f69a0107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:42:42.482 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.485+0000 7f699ffff700 1 -- 172.21.15.26:0/2282324782 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69a00f5340 msgr2=0x7f69a0107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:42:42.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.485+0000 7f699ffff700 1 --2- 172.21.15.26:0/2282324782 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69a00f5340 0x7f69a0107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:42.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.485+0000 7f699ffff700 1 -- 172.21.15.26:0/2282324782 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6990005040 con 0x7f69a00f49a0 2021-11-03T17:42:42.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.485+0000 7f699ffff700 1 --2- 172.21.15.26:0/2282324782 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69a00f49a0 0x7f69a0106f70 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f6990014040 tx=0x7f699000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:42:42.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.485+0000 7f699cff9700 1 -- 172.21.15.26:0/2282324782 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6990019070 con 0x7f69a00f49a0 2021-11-03T17:42:42.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.485+0000 7f699cff9700 1 -- 172.21.15.26:0/2282324782 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6990007e70 con 0x7f69a00f49a0 2021-11-03T17:42:42.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.485+0000 7f699cff9700 1 -- 172.21.15.26:0/2282324782 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6990014d10 con 0x7f69a00f49a0 2021-11-03T17:42:42.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.485+0000 7f69a692f700 1 -- 172.21.15.26:0/2282324782 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69a0108490 con 0x7f69a00f49a0 2021-11-03T17:42:42.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.485+0000 7f69a692f700 1 -- 172.21.15.26:0/2282324782 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69a01089f0 con 0x7f69a00f49a0 2021-11-03T17:42:42.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.486+0000 7f69a692f700 1 -- 172.21.15.26:0/2282324782 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69a0045ad0 con 0x7f69a00f49a0 2021-11-03T17:42:42.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.486+0000 7f699cff9700 1 -- 172.21.15.26:0/2282324782 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f6990025070 con 0x7f69a00f49a0 2021-11-03T17:42:42.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.487+0000 7f699cff9700 1 --2- 172.21.15.26:0/2282324782 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f69880640b0 0x7f6988066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:42:42.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.487+0000 7f699cff9700 1 -- 172.21.15.26:0/2282324782 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f69900817e0 con 0x7f69a00f49a0 2021-11-03T17:42:42.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.487+0000 7f699f7fe700 1 --2- 172.21.15.26:0/2282324782 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f69880640b0 0x7f6988066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:42:42.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.487+0000 7f699f7fe700 1 --2- 172.21.15.26:0/2282324782 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f69880640b0 0x7f6988066570 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f6994009fd0 tx=0x7f699400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:42:42.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.491+0000 7f699cff9700 1 -- 172.21.15.26:0/2282324782 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f6990053b40 con 0x7f69a00f49a0 2021-11-03T17:42:42.668 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.674+0000 7f69a692f700 1 -- 172.21.15.26:0/2282324782 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f69a00ff060 con 0x7f69880640b0 2021-11-03T17:42:42.669 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.675+0000 7f699cff9700 1 -- 172.21.15.26:0/2282324782 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f69a00ff060 con 0x7f69880640b0 2021-11-03T17:42:42.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.677+0000 7f69a692f700 1 -- 172.21.15.26:0/2282324782 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f69880640b0 msgr2=0x7f6988066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:42:42.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.677+0000 7f69a692f700 1 --2- 172.21.15.26:0/2282324782 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f69880640b0 0x7f6988066570 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f6994009fd0 tx=0x7f699400b040).stop 2021-11-03T17:42:42.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.677+0000 7f69a692f700 1 -- 172.21.15.26:0/2282324782 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69a00f49a0 msgr2=0x7f69a0106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:42:42.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.677+0000 7f69a692f700 1 --2- 172.21.15.26:0/2282324782 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69a00f49a0 0x7f69a0106f70 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f6990014040 tx=0x7f699000b040).stop 2021-11-03T17:42:42.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.677+0000 7f69a692f700 1 -- 172.21.15.26:0/2282324782 shutdown_connections 2021-11-03T17:42:42.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.677+0000 7f69a692f700 1 --2- 172.21.15.26:0/2282324782 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f69880640b0 0x7f6988066570 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:42.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.677+0000 7f69a692f700 1 --2- 172.21.15.26:0/2282324782 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69a00f49a0 0x7f69a0106f70 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:42.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.677+0000 7f69a692f700 1 --2- 172.21.15.26:0/2282324782 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69a00f5340 0x7f69a0107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:42.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.677+0000 7f69a692f700 1 -- 172.21.15.26:0/2282324782 >> 172.21.15.26:0/2282324782 conn(0x7f69a00f04c0 msgr2=0x7f69a00fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:42:42.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.678+0000 7f69a692f700 1 -- 172.21.15.26:0/2282324782 shutdown_connections 2021-11-03T17:42:42.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.678+0000 7f69a692f700 1 -- 172.21.15.26:0/2282324782 wait complete. 2021-11-03T17:42:42.681 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:42:42.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.777+0000 7f5831fa6700 1 -- 172.21.15.26:0/2828092172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f582c0f66e0 msgr2=0x7f582c0f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:42:42.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.777+0000 7f5831fa6700 1 --2- 172.21.15.26:0/2828092172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f582c0f66e0 0x7f582c0f6b40 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7f5818004660 tx=0x7f5818009b30).stop 2021-11-03T17:42:42.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.777+0000 7f5831fa6700 1 -- 172.21.15.26:0/2828092172 shutdown_connections 2021-11-03T17:42:42.774 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.777+0000 7f5831fa6700 1 --2- 172.21.15.26:0/2828092172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f582c0f66e0 0x7f582c0f6b40 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:42.774 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.777+0000 7f5831fa6700 1 --2- 172.21.15.26:0/2828092172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f582c0f5440 0x7f582c0f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:42.774 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.777+0000 7f5831fa6700 1 -- 172.21.15.26:0/2828092172 >> 172.21.15.26:0/2828092172 conn(0x7f582c0f0ba0 msgr2=0x7f582c0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:42:42.775 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.777+0000 7f5831fa6700 1 -- 172.21.15.26:0/2828092172 shutdown_connections 2021-11-03T17:42:42.775 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.778+0000 7f5831fa6700 1 -- 172.21.15.26:0/2828092172 wait complete. 2021-11-03T17:42:42.775 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.778+0000 7f5831fa6700 1 Processor -- start 2021-11-03T17:42:42.775 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.778+0000 7f5831fa6700 1 -- start start 2021-11-03T17:42:42.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.778+0000 7f5831fa6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f582c0f5440 0x7f582c106dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:42:42.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.778+0000 7f5831fa6700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f582c0f66e0 0x7f582c1072c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:42:42.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.778+0000 7f5831fa6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582c1078c0 con 0x7f582c0f5440 2021-11-03T17:42:42.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.778+0000 7f5831fa6700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582c108100 con 0x7f582c0f66e0 2021-11-03T17:42:42.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.778+0000 7f5830fa4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f582c0f5440 0x7f582c106dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:42:42.777 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.778+0000 7f5830fa4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f582c0f5440 0x7f582c106dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55940/0 (socket says 172.21.15.26:55940) 2021-11-03T17:42:42.777 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.778+0000 7f5830fa4700 1 -- 172.21.15.26:0/3785974372 learned_addr learned my addr 172.21.15.26:0/3785974372 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:42:42.777 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.779+0000 7f582bfff700 1 --2- 172.21.15.26:0/3785974372 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f582c0f66e0 0x7f582c1072c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:42:42.777 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.779+0000 7f5830fa4700 1 -- 172.21.15.26:0/3785974372 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f582c0f66e0 msgr2=0x7f582c1072c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:42:42.778 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.779+0000 7f5830fa4700 1 --2- 172.21.15.26:0/3785974372 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f582c0f66e0 0x7f582c1072c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:42.778 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.779+0000 7f5830fa4700 1 -- 172.21.15.26:0/3785974372 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5818005040 con 0x7f582c0f5440 2021-11-03T17:42:42.778 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.779+0000 7f5830fa4700 1 --2- 172.21.15.26:0/3785974372 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f582c0f5440 0x7f582c106dd0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7f5820002700 tx=0x7f5820009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:42:42.778 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.779+0000 7f58297fa700 1 -- 172.21.15.26:0/3785974372 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5820009320 con 0x7f582c0f5440 2021-11-03T17:42:42.779 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.779+0000 7f5831fa6700 1 -- 172.21.15.26:0/3785974372 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f582c1083e0 con 0x7f582c0f5440 2021-11-03T17:42:42.779 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.779+0000 7f58297fa700 1 -- 172.21.15.26:0/3785974372 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f582000f040 con 0x7f582c0f5440 2021-11-03T17:42:42.779 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.779+0000 7f58297fa700 1 -- 172.21.15.26:0/3785974372 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5820014900 con 0x7f582c0f5440 2021-11-03T17:42:42.779 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.779+0000 7f5831fa6700 1 -- 172.21.15.26:0/3785974372 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f582c108920 con 0x7f582c0f5440 2021-11-03T17:42:42.780 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.780+0000 7f5831fa6700 1 -- 172.21.15.26:0/3785974372 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f582c059100 con 0x7f582c0f5440 2021-11-03T17:42:42.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.781+0000 7f58297fa700 1 -- 172.21.15.26:0/3785974372 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f5820009480 con 0x7f582c0f5440 2021-11-03T17:42:42.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.781+0000 7f58297fa700 1 --2- 172.21.15.26:0/3785974372 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f581c064100 0x7f581c0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:42:42.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.781+0000 7f58297fa700 1 -- 172.21.15.26:0/3785974372 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f5820080a50 con 0x7f582c0f5440 2021-11-03T17:42:42.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.781+0000 7f582bfff700 1 --2- 172.21.15.26:0/3785974372 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f581c064100 0x7f581c0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:42:42.782 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.781+0000 7f582bfff700 1 --2- 172.21.15.26:0/3785974372 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f581c064100 0x7f581c0665c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f5818004630 tx=0x7f5818009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:42:42.782 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.785+0000 7f58297fa700 1 -- 172.21.15.26:0/3785974372 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f5820052db0 con 0x7f582c0f5440 2021-11-03T17:42:42.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:42 smithi026 ceph-mon[96795]: pgmap v1441: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:42.951 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.957+0000 7f5831fa6700 1 -- 172.21.15.26:0/3785974372 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f582c05fd30 con 0x7f581c064100 2021-11-03T17:42:42.965 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.972+0000 7f58297fa700 1 -- 172.21.15.26:0/3785974372 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f582c05fd30 con 0x7f581c064100 2021-11-03T17:42:42.966 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:42:42.966 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (53m) 3m ago 55m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:42:42.967 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (46m) 3m ago 55m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:42:42.967 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (46m) 2m ago 54m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:42:42.967 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (53m) 3m ago 54m 40.8M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:42:42.967 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (46m) 3m ago 50m 25.1M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:42:42.968 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (47m) 3m ago 50m 25.7M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:42:42.968 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (50m) 2m ago 50m 26.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:42:42.968 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (50m) 2m ago 50m 26.3M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:42:42.969 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (47m) 3m ago 56m 533M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:42:42.969 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (47m) 2m ago 54m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:42:42.969 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (47m) 3m ago 56m 209M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:42:42.970 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (46m) 2m ago 54m 103M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:42:42.970 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (54m) 3m ago 54m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:42:42.970 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (54m) 2m ago 54m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:42:42.970 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (45m) 3m ago 53m 251M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:42:42.971 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (45m) 3m ago 53m 270M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:42:42.971 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (44m) 3m ago 52m 225M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:42:42.971 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (44m) 2m ago 52m 287M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:42:42.971 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (43m) 2m ago 52m 246M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:42:42.972 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (43m) 2m ago 51m 235M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:42:42.972 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (53m) 3m ago 54m 56.7M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:42:42.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.973+0000 7f5831fa6700 1 -- 172.21.15.26:0/3785974372 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f581c064100 msgr2=0x7f581c0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:42:42.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.973+0000 7f5831fa6700 1 --2- 172.21.15.26:0/3785974372 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f581c064100 0x7f581c0665c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f5818004630 tx=0x7f5818009b30).stop 2021-11-03T17:42:42.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.973+0000 7f5831fa6700 1 -- 172.21.15.26:0/3785974372 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f582c0f5440 msgr2=0x7f582c106dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:42:42.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.973+0000 7f5831fa6700 1 --2- 172.21.15.26:0/3785974372 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f582c0f5440 0x7f582c106dd0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7f5820002700 tx=0x7f5820009d80).stop 2021-11-03T17:42:42.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.974+0000 7f5831fa6700 1 -- 172.21.15.26:0/3785974372 shutdown_connections 2021-11-03T17:42:42.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.974+0000 7f5831fa6700 1 --2- 172.21.15.26:0/3785974372 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f581c064100 0x7f581c0665c0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:42.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.974+0000 7f5831fa6700 1 --2- 172.21.15.26:0/3785974372 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f582c0f5440 0x7f582c106dd0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:42.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.974+0000 7f5831fa6700 1 --2- 172.21.15.26:0/3785974372 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f582c0f66e0 0x7f582c1072c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:42.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.974+0000 7f5831fa6700 1 -- 172.21.15.26:0/3785974372 >> 172.21.15.26:0/3785974372 conn(0x7f582c0f0ba0 msgr2=0x7f582c05f620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:42:42.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.974+0000 7f5831fa6700 1 -- 172.21.15.26:0/3785974372 shutdown_connections 2021-11-03T17:42:42.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:42.974+0000 7f5831fa6700 1 -- 172.21.15.26:0/3785974372 wait complete. 2021-11-03T17:42:42.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:42 smithi194 ceph-mon[65619]: pgmap v1441: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:43.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.073+0000 7f7ef9999700 1 -- 172.21.15.26:0/3107826247 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ef40f7980 msgr2=0x7f7ef40f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:42:43.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.073+0000 7f7ef9999700 1 --2- 172.21.15.26:0/3107826247 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ef40f7980 0x7f7ef40f7de0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f7edc004660 tx=0x7f7edc009b30).stop 2021-11-03T17:42:43.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.073+0000 7f7ef9999700 1 -- 172.21.15.26:0/3107826247 shutdown_connections 2021-11-03T17:42:43.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.073+0000 7f7ef9999700 1 --2- 172.21.15.26:0/3107826247 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ef40f7980 0x7f7ef40f7de0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:43.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.073+0000 7f7ef9999700 1 --2- 172.21.15.26:0/3107826247 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ef40f66e0 0x7f7ef40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:43.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.073+0000 7f7ef9999700 1 -- 172.21.15.26:0/3107826247 >> 172.21.15.26:0/3107826247 conn(0x7f7ef40f1e40 msgr2=0x7f7ef40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:42:43.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.073+0000 7f7ef9999700 1 -- 172.21.15.26:0/3107826247 shutdown_connections 2021-11-03T17:42:43.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.073+0000 7f7ef9999700 1 -- 172.21.15.26:0/3107826247 wait complete. 2021-11-03T17:42:43.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.074+0000 7f7ef9999700 1 Processor -- start 2021-11-03T17:42:43.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.074+0000 7f7ef9999700 1 -- start start 2021-11-03T17:42:43.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.074+0000 7f7ef9999700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ef40f66e0 0x7f7ef406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:42:43.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.074+0000 7f7ef9999700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ef40f7980 0x7f7ef4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:42:43.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.074+0000 7f7ef9999700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef406a380 con 0x7f7ef40f66e0 2021-11-03T17:42:43.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.074+0000 7f7ef9999700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef406a4c0 con 0x7f7ef40f7980 2021-11-03T17:42:43.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.074+0000 7f7ef2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ef40f66e0 0x7f7ef406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:42:43.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.074+0000 7f7ef2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ef40f66e0 0x7f7ef406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55950/0 (socket says 172.21.15.26:55950) 2021-11-03T17:42:43.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.074+0000 7f7ef2ffd700 1 -- 172.21.15.26:0/1434937047 learned_addr learned my addr 172.21.15.26:0/1434937047 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:42:43.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.074+0000 7f7ef27fc700 1 --2- 172.21.15.26:0/1434937047 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ef40f7980 0x7f7ef4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:42:43.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.074+0000 7f7ef2ffd700 1 -- 172.21.15.26:0/1434937047 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ef40f7980 msgr2=0x7f7ef4069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:42:43.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.074+0000 7f7ef2ffd700 1 --2- 172.21.15.26:0/1434937047 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ef40f7980 0x7f7ef4069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:43.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.074+0000 7f7ef2ffd700 1 -- 172.21.15.26:0/1434937047 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7edc005040 con 0x7f7ef40f66e0 2021-11-03T17:42:43.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.074+0000 7f7ef2ffd700 1 --2- 172.21.15.26:0/1434937047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ef40f66e0 0x7f7ef406b9a0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7f7eec00d7f0 tx=0x7f7eec004e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:42:43.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.074+0000 7f7eeb7fe700 1 -- 172.21.15.26:0/1434937047 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7eec00f490 con 0x7f7ef40f66e0 2021-11-03T17:42:43.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.075+0000 7f7eeb7fe700 1 -- 172.21.15.26:0/1434937047 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7eec00f040 con 0x7f7ef40f66e0 2021-11-03T17:42:43.075 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.075+0000 7f7eeb7fe700 1 -- 172.21.15.26:0/1434937047 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7eec0139b0 con 0x7f7ef40f66e0 2021-11-03T17:42:43.075 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.075+0000 7f7ef9999700 1 -- 172.21.15.26:0/1434937047 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef406a7a0 con 0x7f7ef40f66e0 2021-11-03T17:42:43.075 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.075+0000 7f7ef9999700 1 -- 172.21.15.26:0/1434937047 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef410ef90 con 0x7f7ef40f66e0 2021-11-03T17:42:43.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.075+0000 7f7ef9999700 1 -- 172.21.15.26:0/1434937047 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ef4045ad0 con 0x7f7ef40f66e0 2021-11-03T17:42:43.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.076+0000 7f7eeb7fe700 1 -- 172.21.15.26:0/1434937047 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f7eec01a030 con 0x7f7ef40f66e0 2021-11-03T17:42:43.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.076+0000 7f7eeb7fe700 1 --2- 172.21.15.26:0/1434937047 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7ee00640b0 0x7f7ee0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:42:43.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.077+0000 7f7ef27fc700 1 --2- 172.21.15.26:0/1434937047 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7ee00640b0 0x7f7ee0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:42:43.078 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.077+0000 7f7eeb7fe700 1 -- 172.21.15.26:0/1434937047 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f7eec0807b0 con 0x7f7ef40f66e0 2021-11-03T17:42:43.078 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.077+0000 7f7ef27fc700 1 --2- 172.21.15.26:0/1434937047 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7ee00640b0 0x7f7ee0066570 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f7edc004630 tx=0x7f7edc009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:42:43.078 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.081+0000 7f7eeb7fe700 1 -- 172.21.15.26:0/1434937047 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f7eec052a20 con 0x7f7ef40f66e0 2021-11-03T17:42:43.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.307+0000 7f7ef9999700 1 -- 172.21.15.26:0/1434937047 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7ef40fef70 con 0x7f7ef40f66e0 2021-11-03T17:42:43.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.308+0000 7f7eeb7fe700 1 -- 172.21.15.26:0/1434937047 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f7eec0182e0 con 0x7f7ef40f66e0 2021-11-03T17:42:43.302 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:42:43.303 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:42:43.303 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:42:43.303 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:42:43.304 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:42:43.304 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:42:43.304 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:42:43.304 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:42:43.304 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:42:43.305 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:42:43.305 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:42:43.305 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:42:43.305 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:42:43.306 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:42:43.306 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:42:43.306 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:42:43.306 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:42:43.306 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:42:43.308 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.310+0000 7f7ef9999700 1 -- 172.21.15.26:0/1434937047 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7ee00640b0 msgr2=0x7f7ee0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:42:43.308 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.310+0000 7f7ef9999700 1 --2- 172.21.15.26:0/1434937047 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7ee00640b0 0x7f7ee0066570 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f7edc004630 tx=0x7f7edc009b30).stop 2021-11-03T17:42:43.308 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.310+0000 7f7ef9999700 1 -- 172.21.15.26:0/1434937047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ef40f66e0 msgr2=0x7f7ef406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:42:43.308 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.310+0000 7f7ef9999700 1 --2- 172.21.15.26:0/1434937047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ef40f66e0 0x7f7ef406b9a0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7f7eec00d7f0 tx=0x7f7eec004e80).stop 2021-11-03T17:42:43.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.310+0000 7f7ef9999700 1 -- 172.21.15.26:0/1434937047 shutdown_connections 2021-11-03T17:42:43.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.310+0000 7f7ef9999700 1 --2- 172.21.15.26:0/1434937047 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7ee00640b0 0x7f7ee0066570 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:43.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.310+0000 7f7ef9999700 1 --2- 172.21.15.26:0/1434937047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ef40f66e0 0x7f7ef406b9a0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:43.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.310+0000 7f7ef9999700 1 --2- 172.21.15.26:0/1434937047 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ef40f7980 0x7f7ef4069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:43.310 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.310+0000 7f7ef9999700 1 -- 172.21.15.26:0/1434937047 >> 172.21.15.26:0/1434937047 conn(0x7f7ef40f1e40 msgr2=0x7f7ef40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:42:43.310 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.310+0000 7f7ef9999700 1 -- 172.21.15.26:0/1434937047 shutdown_connections 2021-11-03T17:42:43.310 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.310+0000 7f7ef9999700 1 -- 172.21.15.26:0/1434937047 wait complete. 2021-11-03T17:42:43.406 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.410+0000 7fd9ac91a700 1 -- 172.21.15.26:0/4158414042 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9a806a3b0 msgr2=0x7fd9a806a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:42:43.406 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.410+0000 7fd9ac91a700 1 --2- 172.21.15.26:0/4158414042 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9a806a3b0 0x7fd9a806a830 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7fd99c004660 tx=0x7fd99c009b30).stop 2021-11-03T17:42:43.407 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.410+0000 7fd9ac91a700 1 -- 172.21.15.26:0/4158414042 shutdown_connections 2021-11-03T17:42:43.407 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.410+0000 7fd9ac91a700 1 --2- 172.21.15.26:0/4158414042 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9a806a3b0 0x7fd9a806a830 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:43.407 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.410+0000 7fd9ac91a700 1 --2- 172.21.15.26:0/4158414042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9a806b9c0 0x7fd9a8069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:43.408 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.410+0000 7fd9ac91a700 1 -- 172.21.15.26:0/4158414042 >> 172.21.15.26:0/4158414042 conn(0x7fd9a80f1cd0 msgr2=0x7fd9a80f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:42:43.408 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.410+0000 7fd9ac91a700 1 -- 172.21.15.26:0/4158414042 shutdown_connections 2021-11-03T17:42:43.408 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.410+0000 7fd9ac91a700 1 -- 172.21.15.26:0/4158414042 wait complete. 2021-11-03T17:42:43.408 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.411+0000 7fd9ac91a700 1 Processor -- start 2021-11-03T17:42:43.409 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.411+0000 7fd9ac91a700 1 -- start start 2021-11-03T17:42:43.409 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.411+0000 7fd9ac91a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9a806a3b0 0x7fd9a810d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:42:43.409 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.411+0000 7fd9ac91a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9a806b9c0 0x7fd9a810d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:42:43.409 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.411+0000 7fd9ac91a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a810dda0 con 0x7fd9a806b9c0 2021-11-03T17:42:43.409 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.411+0000 7fd9ac91a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a810dee0 con 0x7fd9a806a3b0 2021-11-03T17:42:43.410 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.411+0000 7fd9a659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9a806b9c0 0x7fd9a810d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:42:43.410 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.411+0000 7fd9a659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9a806b9c0 0x7fd9a810d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55962/0 (socket says 172.21.15.26:55962) 2021-11-03T17:42:43.410 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.411+0000 7fd9a659c700 1 -- 172.21.15.26:0/2058355709 learned_addr learned my addr 172.21.15.26:0/2058355709 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:42:43.410 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.411+0000 7fd9a6d9d700 1 --2- 172.21.15.26:0/2058355709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9a806a3b0 0x7fd9a810d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:42:43.411 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.412+0000 7fd9a659c700 1 -- 172.21.15.26:0/2058355709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9a806a3b0 msgr2=0x7fd9a810d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:42:43.411 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.412+0000 7fd9a659c700 1 --2- 172.21.15.26:0/2058355709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9a806a3b0 0x7fd9a810d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:43.411 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.412+0000 7fd9a659c700 1 -- 172.21.15.26:0/2058355709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd99c005040 con 0x7fd9a806b9c0 2021-11-03T17:42:43.411 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.412+0000 7fd9a6d9d700 1 --2- 172.21.15.26:0/2058355709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9a806a3b0 0x7fd9a810d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:42:43.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.412+0000 7fd9a659c700 1 --2- 172.21.15.26:0/2058355709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9a806b9c0 0x7fd9a810d7f0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7fd99c009990 tx=0x7fd99c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:42:43.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.412+0000 7fd98f7fe700 1 -- 172.21.15.26:0/2058355709 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd99c018070 con 0x7fd9a806b9c0 2021-11-03T17:42:43.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.412+0000 7fd9ac91a700 1 -- 172.21.15.26:0/2058355709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9a810e820 con 0x7fd9a806b9c0 2021-11-03T17:42:43.413 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.412+0000 7fd98f7fe700 1 -- 172.21.15.26:0/2058355709 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd99c007ba0 con 0x7fd9a806b9c0 2021-11-03T17:42:43.413 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.412+0000 7fd98f7fe700 1 -- 172.21.15.26:0/2058355709 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd99c01c3c0 con 0x7fd9a806b9c0 2021-11-03T17:42:43.413 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.412+0000 7fd9ac91a700 1 -- 172.21.15.26:0/2058355709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a810ed80 con 0x7fd9a806b9c0 2021-11-03T17:42:43.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.413+0000 7fd9ac91a700 1 -- 172.21.15.26:0/2058355709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9a8045ad0 con 0x7fd9a806b9c0 2021-11-03T17:42:43.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.413+0000 7fd98f7fe700 1 -- 172.21.15.26:0/2058355709 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fd99c01d420 con 0x7fd9a806b9c0 2021-11-03T17:42:43.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.414+0000 7fd98f7fe700 1 --2- 172.21.15.26:0/2058355709 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd990064100 0x7fd9900665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:42:43.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.414+0000 7fd98f7fe700 1 -- 172.21.15.26:0/2058355709 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fd99c0825d0 con 0x7fd9a806b9c0 2021-11-03T17:42:43.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.414+0000 7fd9a6d9d700 1 --2- 172.21.15.26:0/2058355709 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd990064100 0x7fd9900665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:42:43.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.414+0000 7fd9a6d9d700 1 --2- 172.21.15.26:0/2058355709 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd990064100 0x7fd9900665c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7fd998009740 tx=0x7fd998009be0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:42:43.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.418+0000 7fd98f7fe700 1 -- 172.21.15.26:0/2058355709 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fd99c054990 con 0x7fd9a806b9c0 2021-11-03T17:42:43.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.622+0000 7fd9ac91a700 1 -- 172.21.15.26:0/2058355709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd9a8027a00 con 0x7fd9a806b9c0 2021-11-03T17:42:43.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.623+0000 7fd98f7fe700 1 -- 172.21.15.26:0/2058355709 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fd99c054580 con 0x7fd9a806b9c0 2021-11-03T17:42:43.617 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:42:43.617 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:42:43.618 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:42:43.618 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:42:43.618 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:42:43.618 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:42:43.619 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:42:43.619 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:42:43.619 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:42:43.620 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:42:43.620 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:42:43.620 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:42:43.620 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:42:43.621 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:42:43.621 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:42:43.621 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:42:43.621 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:42:43.621 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:42:43.622 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:42:43.622 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:42:43.622 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:42:43.623 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:42:43.623 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:42:43.623 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:42:43.623 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:42:43.624 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:42:43.624 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:42:43.624 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:42:43.624 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:42:43.625 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:42:43.625 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:42:43.625 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:42:43.625 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:42:43.626 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:42:43.626 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:42:43.626 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:42:43.626 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:42:43.626 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:42:43.627 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:42:43.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.624+0000 7fd9ac91a700 1 -- 172.21.15.26:0/2058355709 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd990064100 msgr2=0x7fd9900665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:42:43.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.624+0000 7fd9ac91a700 1 --2- 172.21.15.26:0/2058355709 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd990064100 0x7fd9900665c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7fd998009740 tx=0x7fd998009be0).stop 2021-11-03T17:42:43.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.624+0000 7fd9ac91a700 1 -- 172.21.15.26:0/2058355709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9a806b9c0 msgr2=0x7fd9a810d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:42:43.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.624+0000 7fd9ac91a700 1 --2- 172.21.15.26:0/2058355709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9a806b9c0 0x7fd9a810d7f0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7fd99c009990 tx=0x7fd99c009b30).stop 2021-11-03T17:42:43.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.624+0000 7fd9ac91a700 1 -- 172.21.15.26:0/2058355709 shutdown_connections 2021-11-03T17:42:43.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.624+0000 7fd9ac91a700 1 --2- 172.21.15.26:0/2058355709 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd990064100 0x7fd9900665c0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:43.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.624+0000 7fd9ac91a700 1 --2- 172.21.15.26:0/2058355709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9a806a3b0 0x7fd9a810d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:43.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.624+0000 7fd9ac91a700 1 --2- 172.21.15.26:0/2058355709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9a806b9c0 0x7fd9a810d7f0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:42:43.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.624+0000 7fd9ac91a700 1 -- 172.21.15.26:0/2058355709 >> 172.21.15.26:0/2058355709 conn(0x7fd9a80f1cd0 msgr2=0x7fd9a80f8710 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:42:43.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.625+0000 7fd9ac91a700 1 -- 172.21.15.26:0/2058355709 shutdown_connections 2021-11-03T17:42:43.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:42:43.625+0000 7fd9ac91a700 1 -- 172.21.15.26:0/2058355709 wait complete. 2021-11-03T17:42:43.630 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:42:43.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:43 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1434937047' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:42:43.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:43 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1434937047' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:42:44.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:44 smithi026 ceph-mon[96795]: from='client.35628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:42:44.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:44 smithi026 ceph-mon[96795]: from='client.35632 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:42:44.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:44 smithi026 ceph-mon[96795]: pgmap v1442: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:44.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:44 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2058355709' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:42:44.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:44 smithi194 ceph-mon[65619]: from='client.35628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:42:44.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:44 smithi194 ceph-mon[65619]: from='client.35632 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:42:44.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:44 smithi194 ceph-mon[65619]: pgmap v1442: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:44.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:44 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2058355709' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:42:46.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:46 smithi026 ceph-mon[96795]: pgmap v1443: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:46.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:46 smithi194 ceph-mon[65619]: pgmap v1443: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:48.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:48 smithi026 ceph-mon[96795]: pgmap v1444: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:48.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:42:48.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:42:48.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:48 smithi194 ceph-mon[65619]: pgmap v1444: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:48.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:42:48.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:42:50.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:50 smithi026 ceph-mon[96795]: pgmap v1445: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:50.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:50 smithi194 ceph-mon[65619]: pgmap v1445: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:52.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:52 smithi026 ceph-mon[96795]: pgmap v1446: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:52.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:52 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:42:52.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:52 smithi194 ceph-mon[65619]: pgmap v1446: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:52.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:52 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:42:53.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:53 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:42:53.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:53 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:42:54.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:54 smithi026 ceph-mon[96795]: pgmap v1447: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:54.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:54 smithi194 ceph-mon[65619]: pgmap v1447: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:56.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:56 smithi026 ceph-mon[96795]: pgmap v1448: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:56.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:56 smithi194 ceph-mon[65619]: pgmap v1448: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:58.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:42:58 smithi026 ceph-mon[96795]: pgmap v1449: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:42:58.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:42:58 smithi194 ceph-mon[65619]: pgmap v1449: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:00.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:00 smithi026 ceph-mon[96795]: pgmap v1450: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:00.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:00 smithi194 ceph-mon[65619]: pgmap v1450: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:02.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:02 smithi026 ceph-mon[96795]: pgmap v1451: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:02.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:02 smithi194 ceph-mon[65619]: pgmap v1451: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:04.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:04 smithi026 ceph-mon[96795]: pgmap v1452: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:04.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:04 smithi194 ceph-mon[65619]: pgmap v1452: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:06.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:06 smithi026 ceph-mon[96795]: pgmap v1453: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:06.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:06 smithi194 ceph-mon[65619]: pgmap v1453: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:07.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:07 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:43:07.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:07 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:43:08.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:08 smithi026 ceph-mon[96795]: pgmap v1454: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:08.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:08 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:43:08.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:08 smithi194 ceph-mon[65619]: pgmap v1454: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:08.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:08 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:43:10.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:10 smithi026 ceph-mon[96795]: pgmap v1455: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:10.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:10 smithi194 ceph-mon[65619]: pgmap v1455: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:12.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:12 smithi026 ceph-mon[96795]: pgmap v1456: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:12.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:12 smithi194 ceph-mon[65619]: pgmap v1456: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:13.735 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.740+0000 7f43e44bd700 1 -- 172.21.15.26:0/287680426 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43dc0f6ff0 msgr2=0x7f43dc0f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:43:13.735 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.740+0000 7f43e44bd700 1 --2- 172.21.15.26:0/287680426 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43dc0f6ff0 0x7f43dc0f7a20 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7f43cc004660 tx=0x7f43cc009b30).stop 2021-11-03T17:43:13.736 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.740+0000 7f43e44bd700 1 -- 172.21.15.26:0/287680426 shutdown_connections 2021-11-03T17:43:13.736 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.740+0000 7f43e44bd700 1 --2- 172.21.15.26:0/287680426 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43dc0f6ff0 0x7f43dc0f7a20 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:13.736 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.740+0000 7f43e44bd700 1 --2- 172.21.15.26:0/287680426 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43dc0f66e0 0x7f43dc0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:13.736 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.740+0000 7f43e44bd700 1 -- 172.21.15.26:0/287680426 >> 172.21.15.26:0/287680426 conn(0x7f43dc0f1f00 msgr2=0x7f43dc0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:43:13.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.740+0000 7f43e44bd700 1 -- 172.21.15.26:0/287680426 shutdown_connections 2021-11-03T17:43:13.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.740+0000 7f43e44bd700 1 -- 172.21.15.26:0/287680426 wait complete. 2021-11-03T17:43:13.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.740+0000 7f43e44bd700 1 Processor -- start 2021-11-03T17:43:13.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.740+0000 7f43e44bd700 1 -- start start 2021-11-03T17:43:13.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.740+0000 7f43e44bd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43dc0f66e0 0x7f43dc106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:43:13.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.740+0000 7f43e44bd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43dc0f6ff0 0x7f43dc1073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:43:13.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.740+0000 7f43e44bd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc107990 con 0x7f43dc0f6ff0 2021-11-03T17:43:13.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.740+0000 7f43e44bd700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc107ad0 con 0x7f43dc0f66e0 2021-11-03T17:43:13.739 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.741+0000 7f43e1a58700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43dc0f6ff0 0x7f43dc1073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:43:13.739 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.741+0000 7f43e1a58700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43dc0f6ff0 0x7f43dc1073e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55980/0 (socket says 172.21.15.26:55980) 2021-11-03T17:43:13.739 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.741+0000 7f43e1a58700 1 -- 172.21.15.26:0/2574634904 learned_addr learned my addr 172.21.15.26:0/2574634904 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:43:13.739 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.741+0000 7f43e2259700 1 --2- 172.21.15.26:0/2574634904 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43dc0f66e0 0x7f43dc106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:43:13.739 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.741+0000 7f43e1a58700 1 -- 172.21.15.26:0/2574634904 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43dc0f66e0 msgr2=0x7f43dc106ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:43:13.740 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.741+0000 7f43e1a58700 1 --2- 172.21.15.26:0/2574634904 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43dc0f66e0 0x7f43dc106ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:13.740 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.741+0000 7f43e1a58700 1 -- 172.21.15.26:0/2574634904 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43cc005040 con 0x7f43dc0f6ff0 2021-11-03T17:43:13.740 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.741+0000 7f43e1a58700 1 --2- 172.21.15.26:0/2574634904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43dc0f6ff0 0x7f43dc1073e0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f43cc009990 tx=0x7f43cc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:43:13.740 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.741+0000 7f43d2ffd700 1 -- 172.21.15.26:0/2574634904 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43cc018070 con 0x7f43dc0f6ff0 2021-11-03T17:43:13.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.741+0000 7f43d2ffd700 1 -- 172.21.15.26:0/2574634904 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f43cc007ba0 con 0x7f43dc0f6ff0 2021-11-03T17:43:13.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.741+0000 7f43e44bd700 1 -- 172.21.15.26:0/2574634904 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43dc108410 con 0x7f43dc0f6ff0 2021-11-03T17:43:13.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.741+0000 7f43e44bd700 1 -- 172.21.15.26:0/2574634904 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43dc108970 con 0x7f43dc0f6ff0 2021-11-03T17:43:13.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.741+0000 7f43d2ffd700 1 -- 172.21.15.26:0/2574634904 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43cc01c3c0 con 0x7f43dc0f6ff0 2021-11-03T17:43:13.742 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.742+0000 7f43e44bd700 1 -- 172.21.15.26:0/2574634904 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c4004fa0 con 0x7f43dc0f6ff0 2021-11-03T17:43:13.743 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.743+0000 7f43d2ffd700 1 -- 172.21.15.26:0/2574634904 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f43cc01d420 con 0x7f43dc0f6ff0 2021-11-03T17:43:13.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.743+0000 7f43d2ffd700 1 --2- 172.21.15.26:0/2574634904 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f43c80640b0 0x7f43c8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:43:13.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.743+0000 7f43d2ffd700 1 -- 172.21.15.26:0/2574634904 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f43cc082390 con 0x7f43dc0f6ff0 2021-11-03T17:43:13.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.743+0000 7f43e2259700 1 --2- 172.21.15.26:0/2574634904 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f43c80640b0 0x7f43c8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:43:13.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.744+0000 7f43e2259700 1 --2- 172.21.15.26:0/2574634904 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f43c80640b0 0x7f43c8066570 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f43d8004ce0 tx=0x7f43d800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:43:13.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.748+0000 7f43d2ffd700 1 -- 172.21.15.26:0/2574634904 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f43cc0547b0 con 0x7f43dc0f6ff0 2021-11-03T17:43:13.921 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.927+0000 7f43e44bd700 1 -- 172.21.15.26:0/2574634904 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f43c4000bc0 con 0x7f43c80640b0 2021-11-03T17:43:13.922 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.929+0000 7f43d2ffd700 1 -- 172.21.15.26:0/2574634904 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f43c4000bc0 con 0x7f43c80640b0 2021-11-03T17:43:13.924 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.930+0000 7f43e44bd700 1 -- 172.21.15.26:0/2574634904 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f43c80640b0 msgr2=0x7f43c8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:43:13.924 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.930+0000 7f43e44bd700 1 --2- 172.21.15.26:0/2574634904 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f43c80640b0 0x7f43c8066570 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f43d8004ce0 tx=0x7f43d800b040).stop 2021-11-03T17:43:13.925 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.930+0000 7f43e44bd700 1 -- 172.21.15.26:0/2574634904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43dc0f6ff0 msgr2=0x7f43dc1073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:43:13.925 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.930+0000 7f43e44bd700 1 --2- 172.21.15.26:0/2574634904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43dc0f6ff0 0x7f43dc1073e0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f43cc009990 tx=0x7f43cc009b30).stop 2021-11-03T17:43:13.925 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.931+0000 7f43e44bd700 1 -- 172.21.15.26:0/2574634904 shutdown_connections 2021-11-03T17:43:13.925 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.931+0000 7f43e44bd700 1 --2- 172.21.15.26:0/2574634904 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f43c80640b0 0x7f43c8066570 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:13.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.931+0000 7f43e44bd700 1 --2- 172.21.15.26:0/2574634904 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43dc0f66e0 0x7f43dc106ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:13.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.931+0000 7f43e44bd700 1 --2- 172.21.15.26:0/2574634904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43dc0f6ff0 0x7f43dc1073e0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:13.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.931+0000 7f43e44bd700 1 -- 172.21.15.26:0/2574634904 >> 172.21.15.26:0/2574634904 conn(0x7f43dc0f1f00 msgr2=0x7f43dc0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:43:13.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.931+0000 7f43e44bd700 1 -- 172.21.15.26:0/2574634904 shutdown_connections 2021-11-03T17:43:13.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:13.931+0000 7f43e44bd700 1 -- 172.21.15.26:0/2574634904 wait complete. 2021-11-03T17:43:13.934 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:43:14.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.031+0000 7fbb05b2c700 1 -- 172.21.15.26:0/1463961162 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb000f6860 msgr2=0x7fbb000f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:43:14.030 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.031+0000 7fbb05b2c700 1 --2- 172.21.15.26:0/1463961162 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb000f6860 0x7fbb000f6cc0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7fbaf4004660 tx=0x7fbaf4009b30).stop 2021-11-03T17:43:14.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.031+0000 7fbb05b2c700 1 -- 172.21.15.26:0/1463961162 shutdown_connections 2021-11-03T17:43:14.032 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.031+0000 7fbb05b2c700 1 --2- 172.21.15.26:0/1463961162 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb000f6860 0x7fbb000f6cc0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:14.032 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.031+0000 7fbb05b2c700 1 --2- 172.21.15.26:0/1463961162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb000f55c0 0x7fbb000f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:14.032 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.031+0000 7fbb05b2c700 1 -- 172.21.15.26:0/1463961162 >> 172.21.15.26:0/1463961162 conn(0x7fbb000f0d40 msgr2=0x7fbb000f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:43:14.033 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.031+0000 7fbb05b2c700 1 -- 172.21.15.26:0/1463961162 shutdown_connections 2021-11-03T17:43:14.033 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.031+0000 7fbb05b2c700 1 -- 172.21.15.26:0/1463961162 wait complete. 2021-11-03T17:43:14.033 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.031+0000 7fbb05b2c700 1 Processor -- start 2021-11-03T17:43:14.033 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.031+0000 7fbb05b2c700 1 -- start start 2021-11-03T17:43:14.034 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.032+0000 7fbb05b2c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb000f55c0 0x7fbb00109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:43:14.034 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.032+0000 7fbb05b2c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb000f6860 0x7fbb0010c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:43:14.034 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.032+0000 7fbb05b2c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb000603e0 con 0x7fbb000f6860 2021-11-03T17:43:14.035 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.032+0000 7fbb05b2c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb00060520 con 0x7fbb000f55c0 2021-11-03T17:43:14.035 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.032+0000 7fbafeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb000f6860 0x7fbb0010c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:43:14.036 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.032+0000 7fbafeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb000f6860 0x7fbb0010c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55992/0 (socket says 172.21.15.26:55992) 2021-11-03T17:43:14.036 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.032+0000 7fbafeffd700 1 -- 172.21.15.26:0/2110578270 learned_addr learned my addr 172.21.15.26:0/2110578270 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:43:14.037 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.032+0000 7fbaff7fe700 1 --2- 172.21.15.26:0/2110578270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb000f55c0 0x7fbb00109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:43:14.037 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.032+0000 7fbafeffd700 1 -- 172.21.15.26:0/2110578270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb000f55c0 msgr2=0x7fbb00109c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:43:14.037 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.032+0000 7fbafeffd700 1 --2- 172.21.15.26:0/2110578270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb000f55c0 0x7fbb00109c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:14.038 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.032+0000 7fbafeffd700 1 -- 172.21.15.26:0/2110578270 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf4005040 con 0x7fbb000f6860 2021-11-03T17:43:14.038 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.032+0000 7fbafeffd700 1 --2- 172.21.15.26:0/2110578270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb000f6860 0x7fbb0010c150 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7fbaf4009990 tx=0x7fbaf4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:43:14.039 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.032+0000 7fbae7fff700 1 -- 172.21.15.26:0/2110578270 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbaf4018070 con 0x7fbb000f6860 2021-11-03T17:43:14.039 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.032+0000 7fbae7fff700 1 -- 172.21.15.26:0/2110578270 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbaf4007ba0 con 0x7fbb000f6860 2021-11-03T17:43:14.039 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.032+0000 7fbb05b2c700 1 -- 172.21.15.26:0/2110578270 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb0010c6a0 con 0x7fbb000f6860 2021-11-03T17:43:14.040 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.032+0000 7fbae7fff700 1 -- 172.21.15.26:0/2110578270 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbaf401c3c0 con 0x7fbb000f6860 2021-11-03T17:43:14.040 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.033+0000 7fbb05b2c700 1 -- 172.21.15.26:0/2110578270 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb0010cc00 con 0x7fbb000f6860 2021-11-03T17:43:14.040 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.033+0000 7fbb05b2c700 1 -- 172.21.15.26:0/2110578270 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb00045ad0 con 0x7fbb000f6860 2021-11-03T17:43:14.040 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.034+0000 7fbae7fff700 1 -- 172.21.15.26:0/2110578270 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fbaf401d420 con 0x7fbb000f6860 2021-11-03T17:43:14.041 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.034+0000 7fbae7fff700 1 --2- 172.21.15.26:0/2110578270 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbae80640b0 0x7fbae8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:43:14.041 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.034+0000 7fbae7fff700 1 -- 172.21.15.26:0/2110578270 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fbaf4082410 con 0x7fbb000f6860 2021-11-03T17:43:14.041 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.034+0000 7fbaff7fe700 1 --2- 172.21.15.26:0/2110578270 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbae80640b0 0x7fbae8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:43:14.042 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.035+0000 7fbaff7fe700 1 --2- 172.21.15.26:0/2110578270 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbae80640b0 0x7fbae8066570 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7fbb00060060 tx=0x7fbaf000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:43:14.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.039+0000 7fbae7fff700 1 -- 172.21.15.26:0/2110578270 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fbaf4054830 con 0x7fbb000f6860 2021-11-03T17:43:14.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.212+0000 7fbb05b2c700 1 -- 172.21.15.26:0/2110578270 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb000fdec0 con 0x7fbae80640b0 2021-11-03T17:43:14.221 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.227+0000 7fbae7fff700 1 -- 172.21.15.26:0/2110578270 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fbb000fdec0 con 0x7fbae80640b0 2021-11-03T17:43:14.222 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:43:14.222 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (54m) 3m ago 55m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:43:14.223 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (46m) 3m ago 55m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:43:14.223 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (46m) 2m ago 54m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:43:14.223 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (54m) 3m ago 55m 40.8M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:43:14.224 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (47m) 3m ago 50m 25.1M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:43:14.224 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (47m) 3m ago 50m 25.7M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:43:14.225 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (50m) 2m ago 50m 26.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:43:14.225 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (50m) 2m ago 50m 26.3M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:43:14.225 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (48m) 3m ago 57m 533M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:43:14.226 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (47m) 2m ago 54m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:43:14.226 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (47m) 3m ago 57m 209M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:43:14.226 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (47m) 2m ago 54m 103M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:43:14.226 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (55m) 3m ago 55m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:43:14.227 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (54m) 2m ago 54m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:43:14.227 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (46m) 3m ago 54m 251M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:43:14.227 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (45m) 3m ago 53m 270M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:43:14.228 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (45m) 3m ago 53m 225M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:43:14.228 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (44m) 2m ago 53m 287M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:43:14.228 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (44m) 2m ago 52m 246M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:43:14.228 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (43m) 2m ago 52m 235M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:43:14.228 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (54m) 3m ago 55m 56.7M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:43:14.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.229+0000 7fbb05b2c700 1 -- 172.21.15.26:0/2110578270 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbae80640b0 msgr2=0x7fbae8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:43:14.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.229+0000 7fbb05b2c700 1 --2- 172.21.15.26:0/2110578270 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbae80640b0 0x7fbae8066570 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7fbb00060060 tx=0x7fbaf000b040).stop 2021-11-03T17:43:14.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.229+0000 7fbb05b2c700 1 -- 172.21.15.26:0/2110578270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb000f6860 msgr2=0x7fbb0010c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:43:14.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.229+0000 7fbb05b2c700 1 --2- 172.21.15.26:0/2110578270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb000f6860 0x7fbb0010c150 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7fbaf4009990 tx=0x7fbaf4009b30).stop 2021-11-03T17:43:14.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.229+0000 7fbb05b2c700 1 -- 172.21.15.26:0/2110578270 shutdown_connections 2021-11-03T17:43:14.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.229+0000 7fbb05b2c700 1 --2- 172.21.15.26:0/2110578270 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbae80640b0 0x7fbae8066570 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:14.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.229+0000 7fbb05b2c700 1 --2- 172.21.15.26:0/2110578270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb000f55c0 0x7fbb00109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:14.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.229+0000 7fbb05b2c700 1 --2- 172.21.15.26:0/2110578270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb000f6860 0x7fbb0010c150 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:14.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.229+0000 7fbb05b2c700 1 -- 172.21.15.26:0/2110578270 >> 172.21.15.26:0/2110578270 conn(0x7fbb000f0d40 msgr2=0x7fbb000fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:43:14.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.229+0000 7fbb05b2c700 1 -- 172.21.15.26:0/2110578270 shutdown_connections 2021-11-03T17:43:14.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.229+0000 7fbb05b2c700 1 -- 172.21.15.26:0/2110578270 wait complete. 2021-11-03T17:43:14.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.328+0000 7f2c38efd700 1 -- 172.21.15.26:0/3801535589 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c340f6ff0 msgr2=0x7f2c340f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:43:14.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.328+0000 7f2c38efd700 1 --2- 172.21.15.26:0/3801535589 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c340f6ff0 0x7f2c340f7a20 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f2c1c004660 tx=0x7f2c1c009b30).stop 2021-11-03T17:43:14.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.328+0000 7f2c38efd700 1 -- 172.21.15.26:0/3801535589 shutdown_connections 2021-11-03T17:43:14.325 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.328+0000 7f2c38efd700 1 --2- 172.21.15.26:0/3801535589 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c340f6ff0 0x7f2c340f7a20 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:14.325 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.328+0000 7f2c38efd700 1 --2- 172.21.15.26:0/3801535589 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c340f66e0 0x7f2c340f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:14.325 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.328+0000 7f2c38efd700 1 -- 172.21.15.26:0/3801535589 >> 172.21.15.26:0/3801535589 conn(0x7f2c340f1f00 msgr2=0x7f2c340f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:43:14.325 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.328+0000 7f2c38efd700 1 -- 172.21.15.26:0/3801535589 shutdown_connections 2021-11-03T17:43:14.326 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.328+0000 7f2c38efd700 1 -- 172.21.15.26:0/3801535589 wait complete. 2021-11-03T17:43:14.326 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.329+0000 7f2c38efd700 1 Processor -- start 2021-11-03T17:43:14.326 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.329+0000 7f2c38efd700 1 -- start start 2021-11-03T17:43:14.326 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.329+0000 7f2c38efd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c340f66e0 0x7f2c3406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:43:14.327 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.329+0000 7f2c38efd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c340f6ff0 0x7f2c34069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:43:14.327 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.329+0000 7f2c38efd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3406a380 con 0x7f2c340f66e0 2021-11-03T17:43:14.327 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.329+0000 7f2c38efd700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3406a4c0 con 0x7f2c340f6ff0 2021-11-03T17:43:14.327 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.329+0000 7f2c3259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c340f66e0 0x7f2c3406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:43:14.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.329+0000 7f2c3259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c340f66e0 0x7f2c3406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56000/0 (socket says 172.21.15.26:56000) 2021-11-03T17:43:14.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.329+0000 7f2c3259c700 1 -- 172.21.15.26:0/1014783218 learned_addr learned my addr 172.21.15.26:0/1014783218 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:43:14.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.329+0000 7f2c31d9b700 1 --2- 172.21.15.26:0/1014783218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c340f6ff0 0x7f2c34069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:43:14.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.330+0000 7f2c3259c700 1 -- 172.21.15.26:0/1014783218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c340f6ff0 msgr2=0x7f2c34069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:43:14.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.330+0000 7f2c3259c700 1 --2- 172.21.15.26:0/1014783218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c340f6ff0 0x7f2c34069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:14.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.330+0000 7f2c3259c700 1 -- 172.21.15.26:0/1014783218 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c1c005040 con 0x7f2c340f66e0 2021-11-03T17:43:14.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.330+0000 7f2c3259c700 1 --2- 172.21.15.26:0/1014783218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c340f66e0 0x7f2c3406b9a0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7f2c2400c760 tx=0x7f2c24004d00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:43:14.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.330+0000 7f2c2affd700 1 -- 172.21.15.26:0/1014783218 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c24004200 con 0x7f2c340f66e0 2021-11-03T17:43:14.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.330+0000 7f2c38efd700 1 -- 172.21.15.26:0/1014783218 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c3406a7a0 con 0x7f2c340f66e0 2021-11-03T17:43:14.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.330+0000 7f2c2affd700 1 -- 172.21.15.26:0/1014783218 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2c2400e950 con 0x7f2c340f66e0 2021-11-03T17:43:14.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.330+0000 7f2c2affd700 1 -- 172.21.15.26:0/1014783218 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c24003880 con 0x7f2c340f66e0 2021-11-03T17:43:14.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.330+0000 7f2c38efd700 1 -- 172.21.15.26:0/1014783218 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c3410efc0 con 0x7f2c340f66e0 2021-11-03T17:43:14.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.331+0000 7f2c38efd700 1 -- 172.21.15.26:0/1014783218 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c34045ad0 con 0x7f2c340f66e0 2021-11-03T17:43:14.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.331+0000 7f2c2affd700 1 -- 172.21.15.26:0/1014783218 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f2c24010070 con 0x7f2c340f66e0 2021-11-03T17:43:14.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.332+0000 7f2c2affd700 1 --2- 172.21.15.26:0/1014783218 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2c200640b0 0x7f2c20066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:43:14.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.332+0000 7f2c2affd700 1 -- 172.21.15.26:0/1014783218 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f2c24080790 con 0x7f2c340f66e0 2021-11-03T17:43:14.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.332+0000 7f2c31d9b700 1 --2- 172.21.15.26:0/1014783218 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2c200640b0 0x7f2c20066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:43:14.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.332+0000 7f2c31d9b700 1 --2- 172.21.15.26:0/1014783218 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2c200640b0 0x7f2c20066570 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f2c1c004630 tx=0x7f2c1c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:43:14.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.336+0000 7f2c2affd700 1 -- 172.21.15.26:0/1014783218 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f2c240529a0 con 0x7f2c340f66e0 2021-11-03T17:43:14.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.561+0000 7f2c38efd700 1 -- 172.21.15.26:0/1014783218 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2c340fefc0 con 0x7f2c340f66e0 2021-11-03T17:43:14.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.562+0000 7f2c2affd700 1 -- 172.21.15.26:0/1014783218 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f2c24052590 con 0x7f2c340f66e0 2021-11-03T17:43:14.557 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:43:14.557 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:43:14.558 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:43:14.558 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:43:14.558 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:43:14.558 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:43:14.559 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:43:14.559 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:43:14.559 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:43:14.559 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:43:14.559 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:43:14.560 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:43:14.560 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:43:14.560 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:43:14.560 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:43:14.561 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:43:14.562 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:43:14.562 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:43:14.563 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.564+0000 7f2c38efd700 1 -- 172.21.15.26:0/1014783218 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2c200640b0 msgr2=0x7f2c20066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:43:14.563 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.564+0000 7f2c38efd700 1 --2- 172.21.15.26:0/1014783218 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2c200640b0 0x7f2c20066570 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f2c1c004630 tx=0x7f2c1c009b30).stop 2021-11-03T17:43:14.563 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.564+0000 7f2c38efd700 1 -- 172.21.15.26:0/1014783218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c340f66e0 msgr2=0x7f2c3406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:43:14.564 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.564+0000 7f2c38efd700 1 --2- 172.21.15.26:0/1014783218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c340f66e0 0x7f2c3406b9a0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7f2c2400c760 tx=0x7f2c24004d00).stop 2021-11-03T17:43:14.564 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.564+0000 7f2c38efd700 1 -- 172.21.15.26:0/1014783218 shutdown_connections 2021-11-03T17:43:14.564 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.564+0000 7f2c38efd700 1 --2- 172.21.15.26:0/1014783218 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2c200640b0 0x7f2c20066570 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:14.564 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.564+0000 7f2c38efd700 1 --2- 172.21.15.26:0/1014783218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c340f66e0 0x7f2c3406b9a0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:14.565 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.564+0000 7f2c38efd700 1 --2- 172.21.15.26:0/1014783218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c340f6ff0 0x7f2c34069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:14.565 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.564+0000 7f2c38efd700 1 -- 172.21.15.26:0/1014783218 >> 172.21.15.26:0/1014783218 conn(0x7f2c340f1f00 msgr2=0x7f2c340fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:43:14.565 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.564+0000 7f2c38efd700 1 -- 172.21.15.26:0/1014783218 shutdown_connections 2021-11-03T17:43:14.566 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.564+0000 7f2c38efd700 1 -- 172.21.15.26:0/1014783218 wait complete. 2021-11-03T17:43:14.663 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.664+0000 7f85807b7700 1 -- 172.21.15.26:0/3483324134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85780f6ff0 msgr2=0x7f85780f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:43:14.664 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.664+0000 7f85807b7700 1 --2- 172.21.15.26:0/3483324134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85780f6ff0 0x7f85780f7a20 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7f8574004660 tx=0x7f8574009b30).stop 2021-11-03T17:43:14.664 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.664+0000 7f85807b7700 1 -- 172.21.15.26:0/3483324134 shutdown_connections 2021-11-03T17:43:14.664 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.664+0000 7f85807b7700 1 --2- 172.21.15.26:0/3483324134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85780f6ff0 0x7f85780f7a20 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:14.665 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.664+0000 7f85807b7700 1 --2- 172.21.15.26:0/3483324134 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85780f66e0 0x7f85780f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:43:14.665 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.664+0000 7f85807b7700 1 -- 172.21.15.26:0/3483324134 >> 172.21.15.26:0/3483324134 conn(0x7f85780f1f00 msgr2=0x7f85780f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:43:14.666 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.664+0000 7f85807b7700 1 -- 172.21.15.26:0/3483324134 shutdown_connections 2021-11-03T17:43:14.666 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.664+0000 7f85807b7700 1 -- 172.21.15.26:0/3483324134 wait complete. 2021-11-03T17:43:14.666 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.664+0000 7f85807b7700 1 Processor -- start 2021-11-03T17:43:14.667 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.664+0000 7f85807b7700 1 -- start start 2021-11-03T17:43:14.667 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.665+0000 7f85807b7700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85780f66e0 0x7f8578106fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:43:14.668 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.665+0000 7f85807b7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85780f6ff0 0x7f8578107490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:43:14.668 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.665+0000 7f85807b7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8578107ad0 con 0x7f85780f6ff0 2021-11-03T17:43:14.668 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.665+0000 7f85807b7700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8578108380 con 0x7f85780f66e0 2021-11-03T17:43:14.669 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.665+0000 7f857dd52700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85780f6ff0 0x7f8578107490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:43:14.669 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.665+0000 7f857dd52700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85780f6ff0 0x7f8578107490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56012/0 (socket says 172.21.15.26:56012) 2021-11-03T17:43:14.670 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.665+0000 7f857dd52700 1 -- 172.21.15.26:0/2821770180 learned_addr learned my addr 172.21.15.26:0/2821770180 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:43:14.670 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.665+0000 7f857e553700 1 --2- 172.21.15.26:0/2821770180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85780f66e0 0x7f8578106fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:43:14.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.665+0000 7f857dd52700 1 -- 172.21.15.26:0/2821770180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85780f66e0 msgr2=0x7f8578106fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:43:14.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.665+0000 7f857dd52700 1 --2- 172.21.15.26:0/2821770180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85780f66e0 0x7f8578106fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:14.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.665+0000 7f857dd52700 1 -- 172.21.15.26:0/2821770180 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8574005040 con 0x7f85780f6ff0 2021-11-03T17:43:14.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.665+0000 7f857dd52700 1 --2- 172.21.15.26:0/2821770180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85780f6ff0 0x7f8578107490 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7f8574009990 tx=0x7f8574009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:43:14.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.665+0000 7f856effd700 1 -- 172.21.15.26:0/2821770180 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8574018070 con 0x7f85780f6ff0 2021-11-03T17:43:14.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.665+0000 7f856effd700 1 -- 172.21.15.26:0/2821770180 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8574007ca0 con 0x7f85780f6ff0 2021-11-03T17:43:14.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.665+0000 7f856effd700 1 -- 172.21.15.26:0/2821770180 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f857401c620 con 0x7f85780f6ff0 2021-11-03T17:43:14.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.665+0000 7f85807b7700 1 -- 172.21.15.26:0/2821770180 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8578108600 con 0x7f85780f6ff0 2021-11-03T17:43:14.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.665+0000 7f85807b7700 1 -- 172.21.15.26:0/2821770180 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8578108b60 con 0x7f85780f6ff0 2021-11-03T17:43:14.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.666+0000 7f85807b7700 1 -- 172.21.15.26:0/2821770180 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85780f5b70 con 0x7f85780f6ff0 2021-11-03T17:43:14.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.667+0000 7f856effd700 1 -- 172.21.15.26:0/2821770180 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f857401d960 con 0x7f85780f6ff0 2021-11-03T17:43:14.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.667+0000 7f856effd700 1 --2- 172.21.15.26:0/2821770180 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85640640b0 0x7f8564066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:43:14.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.667+0000 7f856effd700 1 -- 172.21.15.26:0/2821770180 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f8574082480 con 0x7f85780f6ff0 2021-11-03T17:43:14.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.667+0000 7f857e553700 1 --2- 172.21.15.26:0/2821770180 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85640640b0 0x7f8564066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:43:14.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.668+0000 7f857e553700 1 --2- 172.21.15.26:0/2821770180 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85640640b0 0x7f8564066570 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f856800a6f0 tx=0x7f8568008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:43:14.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.671+0000 7f856effd700 1 -- 172.21.15.26:0/2821770180 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f85740548a0 con 0x7f85780f6ff0 2021-11-03T17:43:14.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.873+0000 7f85807b7700 1 -- 172.21.15.26:0/2821770180 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8578045ad0 con 0x7f85780f6ff0 2021-11-03T17:43:14.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.874+0000 7f856effd700 1 -- 172.21.15.26:0/2821770180 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f8574054490 con 0x7f85780f6ff0 2021-11-03T17:43:14.869 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:43:14.870 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:43:14.870 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:43:14.870 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:43:14.870 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:43:14.870 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:43:14.871 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:43:14.871 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:43:14.871 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:43:14.871 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:43:14.872 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:43:14.872 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:43:14.872 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:43:14.872 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:43:14.872 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:43:14.873 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:43:14.873 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:43:14.873 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:43:14.873 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:43:14.874 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:43:14.874 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:43:14.874 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:43:14.874 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:43:14.875 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:43:14.875 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:43:14.875 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:43:14.875 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:43:14.876 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:43:14.876 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:43:14.876 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:43:14.876 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:43:14.876 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:43:14.877 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:43:14.877 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:43:14.877 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:43:14.877 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:43:14.877 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:43:14.878 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:43:14.878 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:43:14.879 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.876+0000 7f85807b7700 1 -- 172.21.15.26:0/2821770180 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85640640b0 msgr2=0x7f8564066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:43:14.879 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.876+0000 7f85807b7700 1 --2- 172.21.15.26:0/2821770180 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85640640b0 0x7f8564066570 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f856800a6f0 tx=0x7f8568008040).stop 2021-11-03T17:43:14.880 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.876+0000 7f85807b7700 1 -- 172.21.15.26:0/2821770180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85780f6ff0 msgr2=0x7f8578107490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:43:14.880 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.876+0000 7f85807b7700 1 --2- 172.21.15.26:0/2821770180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85780f6ff0 0x7f8578107490 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7f8574009990 tx=0x7f8574009b30).stop 2021-11-03T17:43:14.880 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.876+0000 7f85807b7700 1 -- 172.21.15.26:0/2821770180 shutdown_connections 2021-11-03T17:43:14.880 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.876+0000 7f85807b7700 1 --2- 172.21.15.26:0/2821770180 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85640640b0 0x7f8564066570 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:14.880 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.876+0000 7f85807b7700 1 --2- 172.21.15.26:0/2821770180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85780f66e0 0x7f8578106fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:14.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.876+0000 7f85807b7700 1 --2- 172.21.15.26:0/2821770180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85780f6ff0 0x7f8578107490 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:14.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.876+0000 7f85807b7700 1 -- 172.21.15.26:0/2821770180 >> 172.21.15.26:0/2821770180 conn(0x7f85780f1f00 msgr2=0x7f85780fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:43:14.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.876+0000 7f85807b7700 1 -- 172.21.15.26:0/2821770180 shutdown_connections 2021-11-03T17:43:14.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:14.876+0000 7f85807b7700 1 -- 172.21.15.26:0/2821770180 wait complete. 2021-11-03T17:43:14.882 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:43:14.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:14 smithi026 ceph-mon[96795]: pgmap v1457: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:14.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:14 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1014783218' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:43:14.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:14 smithi194 ceph-mon[65619]: pgmap v1457: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:14.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:14 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1014783218' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:43:15.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:15 smithi026 ceph-mon[96795]: from='client.35644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:43:15.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:15 smithi026 ceph-mon[96795]: from='client.35648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:43:15.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:15 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2821770180' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:43:15.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:15 smithi194 ceph-mon[65619]: from='client.35644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:43:15.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:15 smithi194 ceph-mon[65619]: from='client.35648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:43:15.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:15 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2821770180' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:43:16.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:16 smithi026 ceph-mon[96795]: pgmap v1458: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:16.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:16 smithi194 ceph-mon[65619]: pgmap v1458: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:18.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:18 smithi026 ceph-mon[96795]: pgmap v1459: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:18.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:18 smithi194 ceph-mon[65619]: pgmap v1459: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:20.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:20 smithi026 ceph-mon[96795]: pgmap v1460: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:20.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:20 smithi194 ceph-mon[65619]: pgmap v1460: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:22.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:22 smithi194 ceph-mon[65619]: pgmap v1461: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:22.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:22 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:43:22.749 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:22 smithi026 ceph-mon[96795]: pgmap v1461: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:22.749 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:22 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:43:23.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:23 smithi194 ceph-mon[65619]: poll took 60058.949 ms: 1 events 2021-11-03T17:43:23.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:23 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:43:23.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:23 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:43:23.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:23 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:43:23.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:23 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:43:23.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:23 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:43:23.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:23 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:43:23.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:23 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:43:23.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:23 smithi026 ceph-mon[96795]: poll took 60058.949 ms: 1 events 2021-11-03T17:43:23.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:23 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:43:23.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:23 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:43:23.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:23 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:43:23.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:23 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:43:23.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:23 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:43:23.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:23 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:43:23.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:23 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:43:24.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:24 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:43:24.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:24 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:43:24.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:24 smithi026 ceph-mon[96795]: pgmap v1462: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:24.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:24 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:43:24.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:24 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:43:24.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:24 smithi194 ceph-mon[65619]: pgmap v1462: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:26.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:26 smithi026 ceph-mon[96795]: pgmap v1463: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:26.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:26 smithi194 ceph-mon[65619]: pgmap v1463: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:28.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:28 smithi026 ceph-mon[96795]: pgmap v1464: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:28.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:28 smithi194 ceph-mon[65619]: pgmap v1464: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:30.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:30 smithi026 ceph-mon[96795]: pgmap v1465: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:30.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:30 smithi194 ceph-mon[65619]: pgmap v1465: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:32.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:32 smithi026 ceph-mon[96795]: pgmap v1466: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:32.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:32 smithi194 ceph-mon[65619]: pgmap v1466: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:34.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:34 smithi026 ceph-mon[96795]: pgmap v1467: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:34.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:34 smithi194 ceph-mon[65619]: pgmap v1467: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:36.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:36 smithi026 ceph-mon[96795]: pgmap v1468: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:36.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:36 smithi194 ceph-mon[65619]: pgmap v1468: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:38.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:38 smithi026 ceph-mon[96795]: pgmap v1469: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:38.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:38 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:43:38.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:38 smithi194 ceph-mon[65619]: pgmap v1469: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:38.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:38 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:43:39.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:39 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:43:39.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:39 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:43:40.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:40 smithi026 ceph-mon[96795]: pgmap v1470: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:40.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:40 smithi194 ceph-mon[65619]: pgmap v1470: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:42.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:42 smithi026 ceph-mon[96795]: pgmap v1471: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:42.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:42 smithi194 ceph-mon[65619]: pgmap v1471: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:44.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:44 smithi026 ceph-mon[96795]: pgmap v1472: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:44.989 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:44.993+0000 7fd3cedd9700 1 -- 172.21.15.26:0/2596094129 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3c80f66e0 msgr2=0x7fd3c80f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:43:44.989 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:44.993+0000 7fd3cedd9700 1 --2- 172.21.15.26:0/2596094129 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3c80f66e0 0x7fd3c80f6b00 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7fd3c00099e0 tx=0x7fd3c0004d10).stop 2021-11-03T17:43:44.989 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:44.993+0000 7fd3cedd9700 1 -- 172.21.15.26:0/2596094129 shutdown_connections 2021-11-03T17:43:44.989 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:44.993+0000 7fd3cedd9700 1 --2- 172.21.15.26:0/2596094129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3c80f7980 0x7fd3c80f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:44.990 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:44.993+0000 7fd3cedd9700 1 --2- 172.21.15.26:0/2596094129 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3c80f66e0 0x7fd3c80f6b00 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:44.990 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:44.993+0000 7fd3cedd9700 1 -- 172.21.15.26:0/2596094129 >> 172.21.15.26:0/2596094129 conn(0x7fd3c80f1e40 msgr2=0x7fd3c80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:43:44.990 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:44.993+0000 7fd3cedd9700 1 -- 172.21.15.26:0/2596094129 shutdown_connections 2021-11-03T17:43:44.990 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:44.993+0000 7fd3cedd9700 1 -- 172.21.15.26:0/2596094129 wait complete. 2021-11-03T17:43:44.991 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:44.994+0000 7fd3cedd9700 1 Processor -- start 2021-11-03T17:43:44.991 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:44.994+0000 7fd3cedd9700 1 -- start start 2021-11-03T17:43:44.992 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:44.994+0000 7fd3cedd9700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3c80f66e0 0x7fd3c81070d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:43:44.992 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:44.994+0000 7fd3cedd9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3c80f7980 0x7fd3c81075c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:43:44.993 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:44.994+0000 7fd3cedd9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c8107b70 con 0x7fd3c80f7980 2021-11-03T17:43:44.993 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:44.994+0000 7fd3cedd9700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c8107cb0 con 0x7fd3c80f66e0 2021-11-03T17:43:44.994 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:44.994+0000 7fd3c7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3c80f7980 0x7fd3c81075c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:43:44.994 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:44.994+0000 7fd3c7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3c80f7980 0x7fd3c81075c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56030/0 (socket says 172.21.15.26:56030) 2021-11-03T17:43:44.994 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:44.994+0000 7fd3c7fff700 1 -- 172.21.15.26:0/3130170712 learned_addr learned my addr 172.21.15.26:0/3130170712 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:43:44.994 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:44.994+0000 7fd3ccb75700 1 --2- 172.21.15.26:0/3130170712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3c80f66e0 0x7fd3c81070d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:43:44.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:44.994+0000 7fd3c7fff700 1 -- 172.21.15.26:0/3130170712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3c80f66e0 msgr2=0x7fd3c81070d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:43:44.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:44.994+0000 7fd3c7fff700 1 --2- 172.21.15.26:0/3130170712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3c80f66e0 0x7fd3c81070d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:44.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:44.994+0000 7fd3c7fff700 1 -- 172.21.15.26:0/3130170712 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c0009640 con 0x7fd3c80f7980 2021-11-03T17:43:44.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:44.995+0000 7fd3c7fff700 1 --2- 172.21.15.26:0/3130170712 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3c80f7980 0x7fd3c81075c0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7fd3bc0026d0 tx=0x7fd3bc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:43:44.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:44.995+0000 7fd3c57fa700 1 -- 172.21.15.26:0/3130170712 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3bc0079c0 con 0x7fd3c80f7980 2021-11-03T17:43:44.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:44.995+0000 7fd3c57fa700 1 -- 172.21.15.26:0/3130170712 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd3bc00f040 con 0x7fd3c80f7980 2021-11-03T17:43:44.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:44.995+0000 7fd3cedd9700 1 -- 172.21.15.26:0/3130170712 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3c8108650 con 0x7fd3c80f7980 2021-11-03T17:43:44.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:44.995+0000 7fd3c57fa700 1 -- 172.21.15.26:0/3130170712 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3bc0148b0 con 0x7fd3c80f7980 2021-11-03T17:43:44.999 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:44.995+0000 7fd3cedd9700 1 -- 172.21.15.26:0/3130170712 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c8108b90 con 0x7fd3c80f7980 2021-11-03T17:43:45.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:44 smithi194 ceph-mon[65619]: pgmap v1472: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:45.001 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:44.996+0000 7fd3cedd9700 1 -- 172.21.15.26:0/3130170712 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3c8045ad0 con 0x7fd3c80f7980 2021-11-03T17:43:45.001 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:44.997+0000 7fd3c57fa700 1 -- 172.21.15.26:0/3130170712 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fd3bc007b20 con 0x7fd3c80f7980 2021-11-03T17:43:45.001 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:44.997+0000 7fd3c57fa700 1 --2- 172.21.15.26:0/3130170712 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd3b00640b0 0x7fd3b0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:43:45.001 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:44.997+0000 7fd3c57fa700 1 -- 172.21.15.26:0/3130170712 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fd3bc0806a0 con 0x7fd3c80f7980 2021-11-03T17:43:45.002 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:44.997+0000 7fd3ccb75700 1 --2- 172.21.15.26:0/3130170712 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd3b00640b0 0x7fd3b0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:43:45.002 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:44.997+0000 7fd3ccb75700 1 --2- 172.21.15.26:0/3130170712 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd3b00640b0 0x7fd3b0066570 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fd3c000b730 tx=0x7fd3c0004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:43:45.002 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.001+0000 7fd3c57fa700 1 -- 172.21.15.26:0/3130170712 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fd3bc052a00 con 0x7fd3c80f7980 2021-11-03T17:43:45.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.180+0000 7fd3cedd9700 1 -- 172.21.15.26:0/3130170712 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3c8108e70 con 0x7fd3b00640b0 2021-11-03T17:43:45.175 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.181+0000 7fd3c57fa700 1 -- 172.21.15.26:0/3130170712 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fd3c8108e70 con 0x7fd3b00640b0 2021-11-03T17:43:45.177 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.183+0000 7fd3cedd9700 1 -- 172.21.15.26:0/3130170712 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd3b00640b0 msgr2=0x7fd3b0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:43:45.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.183+0000 7fd3cedd9700 1 --2- 172.21.15.26:0/3130170712 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd3b00640b0 0x7fd3b0066570 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fd3c000b730 tx=0x7fd3c0004d10).stop 2021-11-03T17:43:45.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.183+0000 7fd3cedd9700 1 -- 172.21.15.26:0/3130170712 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3c80f7980 msgr2=0x7fd3c81075c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:43:45.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.183+0000 7fd3cedd9700 1 --2- 172.21.15.26:0/3130170712 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3c80f7980 0x7fd3c81075c0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7fd3bc0026d0 tx=0x7fd3bc009de0).stop 2021-11-03T17:43:45.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.184+0000 7fd3cedd9700 1 -- 172.21.15.26:0/3130170712 shutdown_connections 2021-11-03T17:43:45.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.184+0000 7fd3cedd9700 1 --2- 172.21.15.26:0/3130170712 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd3b00640b0 0x7fd3b0066570 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:45.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.184+0000 7fd3cedd9700 1 --2- 172.21.15.26:0/3130170712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3c80f66e0 0x7fd3c81070d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:45.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.184+0000 7fd3cedd9700 1 --2- 172.21.15.26:0/3130170712 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3c80f7980 0x7fd3c81075c0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:45.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.184+0000 7fd3cedd9700 1 -- 172.21.15.26:0/3130170712 >> 172.21.15.26:0/3130170712 conn(0x7fd3c80f1e40 msgr2=0x7fd3c80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:43:45.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.184+0000 7fd3cedd9700 1 -- 172.21.15.26:0/3130170712 shutdown_connections 2021-11-03T17:43:45.180 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.184+0000 7fd3cedd9700 1 -- 172.21.15.26:0/3130170712 wait complete. 2021-11-03T17:43:45.187 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:43:45.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.283+0000 7f360359e700 1 -- 172.21.15.26:0/1627042787 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36040f6530 msgr2=0x7f36040f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:43:45.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.283+0000 7f360359e700 1 --2- 172.21.15.26:0/1627042787 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36040f6530 0x7f36040f6950 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7f35f4004660 tx=0x7f35f4009b30).stop 2021-11-03T17:43:45.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.283+0000 7f360359e700 1 -- 172.21.15.26:0/1627042787 shutdown_connections 2021-11-03T17:43:45.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.283+0000 7f360359e700 1 --2- 172.21.15.26:0/1627042787 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36040f77d0 0x7f36040f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:45.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.283+0000 7f360359e700 1 --2- 172.21.15.26:0/1627042787 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36040f6530 0x7f36040f6950 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:45.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.283+0000 7f360359e700 1 -- 172.21.15.26:0/1627042787 >> 172.21.15.26:0/1627042787 conn(0x7f36040f1cd0 msgr2=0x7f36040f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:43:45.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.283+0000 7f360359e700 1 -- 172.21.15.26:0/1627042787 shutdown_connections 2021-11-03T17:43:45.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.283+0000 7f360359e700 1 -- 172.21.15.26:0/1627042787 wait complete. 2021-11-03T17:43:45.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.284+0000 7f360359e700 1 Processor -- start 2021-11-03T17:43:45.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.284+0000 7f360359e700 1 -- start start 2021-11-03T17:43:45.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.284+0000 7f360359e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36040f6530 0x7f3604106db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:43:45.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.284+0000 7f360359e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36040f77d0 0x7f36041072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:43:45.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.284+0000 7f360359e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36041078a0 con 0x7f36040f77d0 2021-11-03T17:43:45.282 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.284+0000 7f360359e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36041080e0 con 0x7f36040f6530 2021-11-03T17:43:45.282 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.284+0000 7f3601d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36040f77d0 0x7f36041072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:43:45.282 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.284+0000 7f3601d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36040f77d0 0x7f36041072a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56040/0 (socket says 172.21.15.26:56040) 2021-11-03T17:43:45.282 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.284+0000 7f3601d9b700 1 -- 172.21.15.26:0/2114372203 learned_addr learned my addr 172.21.15.26:0/2114372203 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:43:45.283 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.284+0000 7f360259c700 1 --2- 172.21.15.26:0/2114372203 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36040f6530 0x7f3604106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:43:45.283 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.285+0000 7f3601d9b700 1 -- 172.21.15.26:0/2114372203 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36040f6530 msgr2=0x7f3604106db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:43:45.283 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.285+0000 7f3601d9b700 1 --2- 172.21.15.26:0/2114372203 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36040f6530 0x7f3604106db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:45.283 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.285+0000 7f3601d9b700 1 -- 172.21.15.26:0/2114372203 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f4005040 con 0x7f36040f77d0 2021-11-03T17:43:45.283 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.285+0000 7f3601d9b700 1 --2- 172.21.15.26:0/2114372203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36040f77d0 0x7f36041072a0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f35f80026d0 tx=0x7f35f8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:43:45.284 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.285+0000 7f35f2ffd700 1 -- 172.21.15.26:0/2114372203 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35f8009320 con 0x7f36040f77d0 2021-11-03T17:43:45.284 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.285+0000 7f35f2ffd700 1 -- 172.21.15.26:0/2114372203 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f35f800f040 con 0x7f36040f77d0 2021-11-03T17:43:45.284 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.285+0000 7f360359e700 1 -- 172.21.15.26:0/2114372203 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36041083c0 con 0x7f36040f77d0 2021-11-03T17:43:45.284 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.285+0000 7f35f2ffd700 1 -- 172.21.15.26:0/2114372203 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35f80147e0 con 0x7f36040f77d0 2021-11-03T17:43:45.286 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.285+0000 7f360359e700 1 -- 172.21.15.26:0/2114372203 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3604108900 con 0x7f36040f77d0 2021-11-03T17:43:45.286 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.286+0000 7f360359e700 1 -- 172.21.15.26:0/2114372203 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3604059100 con 0x7f36040f77d0 2021-11-03T17:43:45.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.286+0000 7f35f2ffd700 1 -- 172.21.15.26:0/2114372203 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f35f8009480 con 0x7f36040f77d0 2021-11-03T17:43:45.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.287+0000 7f35f2ffd700 1 --2- 172.21.15.26:0/2114372203 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f35ec064100 0x7f35ec0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:43:45.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.287+0000 7f35f2ffd700 1 -- 172.21.15.26:0/2114372203 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f35f8080eb0 con 0x7f36040f77d0 2021-11-03T17:43:45.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.287+0000 7f360259c700 1 --2- 172.21.15.26:0/2114372203 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f35ec064100 0x7f35ec0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:43:45.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.287+0000 7f360259c700 1 --2- 172.21.15.26:0/2114372203 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f35ec064100 0x7f35ec0665c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f35f4004e30 tx=0x7f35f4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:43:45.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.291+0000 7f35f2ffd700 1 -- 172.21.15.26:0/2114372203 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f35f8053210 con 0x7f36040f77d0 2021-11-03T17:43:45.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.463+0000 7f360359e700 1 -- 172.21.15.26:0/2114372203 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f36040fee70 con 0x7f35ec064100 2021-11-03T17:43:45.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.478+0000 7f35f2ffd700 1 -- 172.21.15.26:0/2114372203 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f36040fee70 con 0x7f35ec064100 2021-11-03T17:43:45.472 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:43:45.472 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (54m) 4m ago 56m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:43:45.472 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (47m) 4m ago 56m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:43:45.472 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (47m) 3m ago 55m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:43:45.473 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (54m) 4m ago 55m 40.8M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:43:45.473 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (47m) 4m ago 51m 25.1M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:43:45.473 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (48m) 4m ago 51m 25.7M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:43:45.473 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (51m) 3m ago 51m 26.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:43:45.474 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (51m) 3m ago 51m 26.3M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:43:45.474 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (48m) 4m ago 57m 533M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:43:45.474 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (48m) 3m ago 55m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:43:45.474 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (48m) 4m ago 57m 209M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:43:45.474 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (47m) 3m ago 55m 103M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:43:45.475 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (55m) 4m ago 55m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:43:45.475 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (55m) 3m ago 55m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:43:45.475 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (46m) 4m ago 54m 251M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:43:45.475 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (46m) 4m ago 54m 270M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:43:45.476 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (45m) 4m ago 53m 225M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:43:45.476 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (45m) 3m ago 53m 287M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:43:45.476 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (44m) 3m ago 53m 246M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:43:45.476 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (44m) 3m ago 52m 235M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:43:45.476 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (54m) 4m ago 55m 56.7M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:43:45.477 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.480+0000 7f360359e700 1 -- 172.21.15.26:0/2114372203 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f35ec064100 msgr2=0x7f35ec0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:43:45.477 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.480+0000 7f360359e700 1 --2- 172.21.15.26:0/2114372203 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f35ec064100 0x7f35ec0665c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f35f4004e30 tx=0x7f35f4009b30).stop 2021-11-03T17:43:45.478 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.480+0000 7f360359e700 1 -- 172.21.15.26:0/2114372203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36040f77d0 msgr2=0x7f36041072a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:43:45.478 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.480+0000 7f360359e700 1 --2- 172.21.15.26:0/2114372203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36040f77d0 0x7f36041072a0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f35f80026d0 tx=0x7f35f8009de0).stop 2021-11-03T17:43:45.478 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.480+0000 7f360359e700 1 -- 172.21.15.26:0/2114372203 shutdown_connections 2021-11-03T17:43:45.478 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.480+0000 7f360359e700 1 --2- 172.21.15.26:0/2114372203 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f35ec064100 0x7f35ec0665c0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:45.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.480+0000 7f360359e700 1 --2- 172.21.15.26:0/2114372203 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36040f6530 0x7f3604106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:45.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.480+0000 7f360359e700 1 --2- 172.21.15.26:0/2114372203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36040f77d0 0x7f36041072a0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:45.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.480+0000 7f360359e700 1 -- 172.21.15.26:0/2114372203 >> 172.21.15.26:0/2114372203 conn(0x7f36040f1cd0 msgr2=0x7f36040fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:43:45.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.480+0000 7f360359e700 1 -- 172.21.15.26:0/2114372203 shutdown_connections 2021-11-03T17:43:45.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.480+0000 7f360359e700 1 -- 172.21.15.26:0/2114372203 wait complete. 2021-11-03T17:43:45.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.579+0000 7f3a63805700 1 -- 172.21.15.26:0/2452257715 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a5c0f7980 msgr2=0x7f3a5c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:43:45.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.579+0000 7f3a63805700 1 --2- 172.21.15.26:0/2452257715 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a5c0f7980 0x7f3a5c0f7de0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f3a50004660 tx=0x7f3a50009b30).stop 2021-11-03T17:43:45.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.579+0000 7f3a63805700 1 -- 172.21.15.26:0/2452257715 shutdown_connections 2021-11-03T17:43:45.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.579+0000 7f3a63805700 1 --2- 172.21.15.26:0/2452257715 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a5c0f7980 0x7f3a5c0f7de0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:45.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.579+0000 7f3a63805700 1 --2- 172.21.15.26:0/2452257715 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a5c0f66e0 0x7f3a5c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:45.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.579+0000 7f3a63805700 1 -- 172.21.15.26:0/2452257715 >> 172.21.15.26:0/2452257715 conn(0x7f3a5c0f1e40 msgr2=0x7f3a5c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:43:45.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.580+0000 7f3a63805700 1 -- 172.21.15.26:0/2452257715 shutdown_connections 2021-11-03T17:43:45.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.580+0000 7f3a63805700 1 -- 172.21.15.26:0/2452257715 wait complete. 2021-11-03T17:43:45.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.580+0000 7f3a63805700 1 Processor -- start 2021-11-03T17:43:45.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.580+0000 7f3a63805700 1 -- start start 2021-11-03T17:43:45.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.580+0000 7f3a63805700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a5c0f66e0 0x7f3a5c10d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:43:45.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.580+0000 7f3a63805700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a5c0f7980 0x7f3a5c10d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:43:45.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.580+0000 7f3a63805700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c10dfa0 con 0x7f3a5c0f66e0 2021-11-03T17:43:45.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.580+0000 7f3a63805700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c10e0e0 con 0x7f3a5c0f7980 2021-11-03T17:43:45.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.580+0000 7f3a615a1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a5c0f66e0 0x7f3a5c10d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:43:45.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.580+0000 7f3a615a1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a5c0f66e0 0x7f3a5c10d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56048/0 (socket says 172.21.15.26:56048) 2021-11-03T17:43:45.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.580+0000 7f3a615a1700 1 -- 172.21.15.26:0/3775589385 learned_addr learned my addr 172.21.15.26:0/3775589385 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:43:45.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.581+0000 7f3a60da0700 1 --2- 172.21.15.26:0/3775589385 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a5c0f7980 0x7f3a5c10d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:43:45.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.581+0000 7f3a615a1700 1 -- 172.21.15.26:0/3775589385 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a5c0f7980 msgr2=0x7f3a5c10d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:43:45.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.581+0000 7f3a615a1700 1 --2- 172.21.15.26:0/3775589385 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a5c0f7980 0x7f3a5c10d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:45.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.581+0000 7f3a615a1700 1 -- 172.21.15.26:0/3775589385 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a50005040 con 0x7f3a5c0f66e0 2021-11-03T17:43:45.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.581+0000 7f3a615a1700 1 --2- 172.21.15.26:0/3775589385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a5c0f66e0 0x7f3a5c10d500 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f3a5400e7c0 tx=0x7f3a5400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:43:45.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.581+0000 7f3a59ffb700 1 -- 172.21.15.26:0/3775589385 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a540092e0 con 0x7f3a5c0f66e0 2021-11-03T17:43:45.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.581+0000 7f3a63805700 1 -- 172.21.15.26:0/3775589385 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a5c10ea80 con 0x7f3a5c0f66e0 2021-11-03T17:43:45.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.581+0000 7f3a59ffb700 1 -- 172.21.15.26:0/3775589385 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3a5400f040 con 0x7f3a5c0f66e0 2021-11-03T17:43:45.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.581+0000 7f3a59ffb700 1 -- 172.21.15.26:0/3775589385 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a540147e0 con 0x7f3a5c0f66e0 2021-11-03T17:43:45.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.581+0000 7f3a63805700 1 -- 172.21.15.26:0/3775589385 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a5c10f040 con 0x7f3a5c0f66e0 2021-11-03T17:43:45.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.583+0000 7f3a59ffb700 1 -- 172.21.15.26:0/3775589385 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f3a5401b030 con 0x7f3a5c0f66e0 2021-11-03T17:43:45.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.583+0000 7f3a63805700 1 -- 172.21.15.26:0/3775589385 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a5c045ad0 con 0x7f3a5c0f66e0 2021-11-03T17:43:45.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.583+0000 7f3a59ffb700 1 --2- 172.21.15.26:0/3775589385 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3a440640b0 0x7f3a44066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:43:45.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.583+0000 7f3a59ffb700 1 -- 172.21.15.26:0/3775589385 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f3a54080880 con 0x7f3a5c0f66e0 2021-11-03T17:43:45.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.583+0000 7f3a60da0700 1 --2- 172.21.15.26:0/3775589385 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3a440640b0 0x7f3a44066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:43:45.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.583+0000 7f3a60da0700 1 --2- 172.21.15.26:0/3775589385 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3a440640b0 0x7f3a44066570 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f3a50005010 tx=0x7f3a50016040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:43:45.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.587+0000 7f3a59ffb700 1 -- 172.21.15.26:0/3775589385 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f3a54052af0 con 0x7f3a5c0f66e0 2021-11-03T17:43:45.812 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.817+0000 7f3a63805700 1 -- 172.21.15.26:0/3775589385 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3a5c06b6d0 con 0x7f3a5c0f66e0 2021-11-03T17:43:45.813 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.817+0000 7f3a59ffb700 1 -- 172.21.15.26:0/3775589385 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f3a54019070 con 0x7f3a5c0f66e0 2021-11-03T17:43:45.813 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:43:45.814 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:43:45.814 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:43:45.815 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:43:45.815 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:43:45.815 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:43:45.816 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:43:45.816 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:43:45.817 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:43:45.818 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:43:45.818 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:43:45.818 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:43:45.818 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:43:45.818 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:43:45.819 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:43:45.819 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:43:45.819 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:43:45.819 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:43:45.820 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.819+0000 7f3a63805700 1 -- 172.21.15.26:0/3775589385 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3a440640b0 msgr2=0x7f3a44066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:43:45.820 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.819+0000 7f3a63805700 1 --2- 172.21.15.26:0/3775589385 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3a440640b0 0x7f3a44066570 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f3a50005010 tx=0x7f3a50016040).stop 2021-11-03T17:43:45.821 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.819+0000 7f3a63805700 1 -- 172.21.15.26:0/3775589385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a5c0f66e0 msgr2=0x7f3a5c10d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:43:45.821 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.819+0000 7f3a63805700 1 --2- 172.21.15.26:0/3775589385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a5c0f66e0 0x7f3a5c10d500 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f3a5400e7c0 tx=0x7f3a5400b040).stop 2021-11-03T17:43:45.821 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.819+0000 7f3a63805700 1 -- 172.21.15.26:0/3775589385 shutdown_connections 2021-11-03T17:43:45.821 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.819+0000 7f3a63805700 1 --2- 172.21.15.26:0/3775589385 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3a440640b0 0x7f3a44066570 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:45.822 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.819+0000 7f3a63805700 1 --2- 172.21.15.26:0/3775589385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a5c0f66e0 0x7f3a5c10d500 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:45.822 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.819+0000 7f3a63805700 1 --2- 172.21.15.26:0/3775589385 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a5c0f7980 0x7f3a5c10d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:45.822 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.819+0000 7f3a63805700 1 -- 172.21.15.26:0/3775589385 >> 172.21.15.26:0/3775589385 conn(0x7f3a5c0f1e40 msgr2=0x7f3a5c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:43:45.822 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.819+0000 7f3a63805700 1 -- 172.21.15.26:0/3775589385 shutdown_connections 2021-11-03T17:43:45.823 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.819+0000 7f3a63805700 1 -- 172.21.15.26:0/3775589385 wait complete. 2021-11-03T17:43:45.914 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.919+0000 7f13cbfd3700 1 -- 172.21.15.26:0/160496678 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13c40f66e0 msgr2=0x7f13c40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:43:45.914 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.919+0000 7f13cbfd3700 1 --2- 172.21.15.26:0/160496678 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13c40f66e0 0x7f13c40f6b00 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7f13b4004660 tx=0x7f13b4009b30).stop 2021-11-03T17:43:45.914 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.919+0000 7f13cbfd3700 1 -- 172.21.15.26:0/160496678 shutdown_connections 2021-11-03T17:43:45.915 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.919+0000 7f13cbfd3700 1 --2- 172.21.15.26:0/160496678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13c40f6ff0 0x7f13c40f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:45.915 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.919+0000 7f13cbfd3700 1 --2- 172.21.15.26:0/160496678 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13c40f66e0 0x7f13c40f6b00 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:45.915 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.919+0000 7f13cbfd3700 1 -- 172.21.15.26:0/160496678 >> 172.21.15.26:0/160496678 conn(0x7f13c40f1f00 msgr2=0x7f13c40f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:43:45.915 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.919+0000 7f13cbfd3700 1 -- 172.21.15.26:0/160496678 shutdown_connections 2021-11-03T17:43:45.916 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.919+0000 7f13cbfd3700 1 -- 172.21.15.26:0/160496678 wait complete. 2021-11-03T17:43:45.916 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.920+0000 7f13cbfd3700 1 Processor -- start 2021-11-03T17:43:45.916 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.920+0000 7f13cbfd3700 1 -- start start 2021-11-03T17:43:45.916 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.920+0000 7f13cbfd3700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13c40f66e0 0x7f13c406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:43:45.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.920+0000 7f13cbfd3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13c40f6ff0 0x7f13c4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:43:45.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.920+0000 7f13cbfd3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c406a380 con 0x7f13c40f6ff0 2021-11-03T17:43:45.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.920+0000 7f13cbfd3700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c406a4c0 con 0x7f13c40f66e0 2021-11-03T17:43:45.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.920+0000 7f13c956e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13c40f6ff0 0x7f13c4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:43:45.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.920+0000 7f13c956e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13c40f6ff0 0x7f13c4069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56060/0 (socket says 172.21.15.26:56060) 2021-11-03T17:43:45.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.920+0000 7f13c956e700 1 -- 172.21.15.26:0/2772346851 learned_addr learned my addr 172.21.15.26:0/2772346851 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:43:45.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.920+0000 7f13c9d6f700 1 --2- 172.21.15.26:0/2772346851 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13c40f66e0 0x7f13c406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:43:45.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.920+0000 7f13c956e700 1 -- 172.21.15.26:0/2772346851 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13c40f66e0 msgr2=0x7f13c406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:43:45.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.920+0000 7f13c956e700 1 --2- 172.21.15.26:0/2772346851 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13c40f66e0 0x7f13c406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:45.919 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.920+0000 7f13c956e700 1 -- 172.21.15.26:0/2772346851 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b4005040 con 0x7f13c40f6ff0 2021-11-03T17:43:45.919 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.920+0000 7f13c956e700 1 --2- 172.21.15.26:0/2772346851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13c40f6ff0 0x7f13c4069e20 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7f13c00026d0 tx=0x7f13c0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:43:45.921 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.921+0000 7f13ba7fc700 1 -- 172.21.15.26:0/2772346851 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13c0009320 con 0x7f13c40f6ff0 2021-11-03T17:43:45.921 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.921+0000 7f13ba7fc700 1 -- 172.21.15.26:0/2772346851 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f13c000f040 con 0x7f13c40f6ff0 2021-11-03T17:43:45.921 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.921+0000 7f13cbfd3700 1 -- 172.21.15.26:0/2772346851 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13c406a7a0 con 0x7f13c40f6ff0 2021-11-03T17:43:45.921 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.921+0000 7f13ba7fc700 1 -- 172.21.15.26:0/2772346851 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13c00147e0 con 0x7f13c40f6ff0 2021-11-03T17:43:45.922 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.921+0000 7f13cbfd3700 1 -- 172.21.15.26:0/2772346851 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13c410ef90 con 0x7f13c40f6ff0 2021-11-03T17:43:45.922 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.922+0000 7f13cbfd3700 1 -- 172.21.15.26:0/2772346851 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13c4045ad0 con 0x7f13c40f6ff0 2021-11-03T17:43:45.922 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.922+0000 7f13ba7fc700 1 -- 172.21.15.26:0/2772346851 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f13c0009480 con 0x7f13c40f6ff0 2021-11-03T17:43:45.923 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.923+0000 7f13ba7fc700 1 --2- 172.21.15.26:0/2772346851 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f13b00640b0 0x7f13b0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:43:45.923 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.923+0000 7f13ba7fc700 1 -- 172.21.15.26:0/2772346851 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f13c0080f30 con 0x7f13c40f6ff0 2021-11-03T17:43:45.923 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.923+0000 7f13c9d6f700 1 --2- 172.21.15.26:0/2772346851 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f13b00640b0 0x7f13b0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:43:45.923 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.923+0000 7f13c9d6f700 1 --2- 172.21.15.26:0/2772346851 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f13b00640b0 0x7f13b0066570 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f13b4004630 tx=0x7f13b4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:43:45.924 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:45.927+0000 7f13ba7fc700 1 -- 172.21.15.26:0/2772346851 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f13c0053210 con 0x7f13c40f6ff0 2021-11-03T17:43:46.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:46.129+0000 7f13cbfd3700 1 -- 172.21.15.26:0/2772346851 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f13c406a930 con 0x7f13c40f6ff0 2021-11-03T17:43:46.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:46.129+0000 7f13ba7fc700 1 -- 172.21.15.26:0/2772346851 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f13c406a930 con 0x7f13c40f6ff0 2021-11-03T17:43:46.124 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:43:46.124 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:43:46.124 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:43:46.125 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:43:46.125 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:43:46.125 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:43:46.125 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:43:46.125 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:43:46.126 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:43:46.126 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:43:46.126 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:43:46.126 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:43:46.127 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:43:46.127 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:43:46.127 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:43:46.127 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:43:46.128 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:43:46.128 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:43:46.128 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:43:46.128 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:43:46.128 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:43:46.129 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:43:46.129 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:43:46.129 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:43:46.129 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:43:46.130 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:43:46.130 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:43:46.130 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:43:46.131 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:43:46.131 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:43:46.131 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:43:46.131 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:43:46.132 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:43:46.132 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:43:46.132 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:43:46.133 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:43:46.133 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:43:46.133 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:43:46.133 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:43:46.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:46.131+0000 7f13cbfd3700 1 -- 172.21.15.26:0/2772346851 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f13b00640b0 msgr2=0x7f13b0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:43:46.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:46.131+0000 7f13cbfd3700 1 --2- 172.21.15.26:0/2772346851 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f13b00640b0 0x7f13b0066570 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f13b4004630 tx=0x7f13b4009b30).stop 2021-11-03T17:43:46.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:46.131+0000 7f13cbfd3700 1 -- 172.21.15.26:0/2772346851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13c40f6ff0 msgr2=0x7f13c4069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:43:46.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:46.131+0000 7f13cbfd3700 1 --2- 172.21.15.26:0/2772346851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13c40f6ff0 0x7f13c4069e20 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7f13c00026d0 tx=0x7f13c0009de0).stop 2021-11-03T17:43:46.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:46.131+0000 7f13cbfd3700 1 -- 172.21.15.26:0/2772346851 shutdown_connections 2021-11-03T17:43:46.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:46.131+0000 7f13cbfd3700 1 --2- 172.21.15.26:0/2772346851 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f13b00640b0 0x7f13b0066570 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:46.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:46.131+0000 7f13cbfd3700 1 --2- 172.21.15.26:0/2772346851 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13c40f66e0 0x7f13c406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:46.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:46.131+0000 7f13cbfd3700 1 --2- 172.21.15.26:0/2772346851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13c40f6ff0 0x7f13c4069e20 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:43:46.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:46.131+0000 7f13cbfd3700 1 -- 172.21.15.26:0/2772346851 >> 172.21.15.26:0/2772346851 conn(0x7f13c40f1f00 msgr2=0x7f13c40fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:43:46.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:46.131+0000 7f13cbfd3700 1 -- 172.21.15.26:0/2772346851 shutdown_connections 2021-11-03T17:43:46.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:43:46.131+0000 7f13cbfd3700 1 -- 172.21.15.26:0/2772346851 wait complete. 2021-11-03T17:43:46.137 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:43:46.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:46 smithi026 ceph-mon[96795]: pgmap v1473: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:46.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:46 smithi026 ceph-mon[96795]: from='client.35660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:43:46.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:46 smithi026 ceph-mon[96795]: from='client.35664 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:43:46.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:46 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3775589385' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:43:46.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:46 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2772346851' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:43:46.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:46 smithi194 ceph-mon[65619]: pgmap v1473: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:46.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:46 smithi194 ceph-mon[65619]: from='client.35660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:43:46.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:46 smithi194 ceph-mon[65619]: from='client.35664 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:43:46.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:46 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3775589385' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:43:46.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:46 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2772346851' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:43:48.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:48 smithi026 ceph-mon[96795]: pgmap v1474: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:48.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:43:48.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:43:48.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:48 smithi194 ceph-mon[65619]: pgmap v1474: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:48.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:43:48.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:43:50.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:50 smithi026 ceph-mon[96795]: pgmap v1475: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:50.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:50 smithi194 ceph-mon[65619]: pgmap v1475: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:52.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:52 smithi026 ceph-mon[96795]: pgmap v1476: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:52.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:52 smithi194 ceph-mon[65619]: pgmap v1476: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:53.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:53 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:43:53.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:53 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:43:54.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:54 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:43:54.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:54 smithi026 ceph-mon[96795]: pgmap v1477: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:54.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:54 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:43:54.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:54 smithi194 ceph-mon[65619]: pgmap v1477: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:56.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:56 smithi026 ceph-mon[96795]: pgmap v1478: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:56.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:56 smithi194 ceph-mon[65619]: pgmap v1478: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:58.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:43:58 smithi026 ceph-mon[96795]: pgmap v1479: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:43:58.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:43:58 smithi194 ceph-mon[65619]: pgmap v1479: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:00.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:00 smithi026 ceph-mon[96795]: pgmap v1480: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:00.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:00 smithi194 ceph-mon[65619]: pgmap v1480: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:02.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:02 smithi026 ceph-mon[96795]: pgmap v1481: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:02.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:02 smithi194 ceph-mon[65619]: pgmap v1481: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:04.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:04 smithi026 ceph-mon[96795]: pgmap v1482: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:04.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:04 smithi194 ceph-mon[65619]: pgmap v1482: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:06.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:06 smithi026 ceph-mon[96795]: pgmap v1483: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:06.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:06 smithi194 ceph-mon[65619]: pgmap v1483: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:08.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:08 smithi026 ceph-mon[96795]: pgmap v1484: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:08.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:08 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:44:08.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:08 smithi194 ceph-mon[65619]: pgmap v1484: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:08.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:08 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:44:09.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:09 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:44:09.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:09 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:44:10.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:10 smithi026 ceph-mon[96795]: pgmap v1485: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:10.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:10 smithi194 ceph-mon[65619]: pgmap v1485: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:12.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:12 smithi026 ceph-mon[96795]: pgmap v1486: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:12.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:12 smithi194 ceph-mon[65619]: pgmap v1486: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:14.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:14 smithi026 ceph-mon[96795]: pgmap v1487: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:14.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:14 smithi194 ceph-mon[65619]: pgmap v1487: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:16.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.245+0000 7f1f87fff700 1 -- 172.21.15.26:0/2918962716 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f880f6530 msgr2=0x7f1f880f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:44:16.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.245+0000 7f1f87fff700 1 --2- 172.21.15.26:0/2918962716 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f880f6530 0x7f1f880f6950 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7f1f780099e0 tx=0x7f1f78004d10).stop 2021-11-03T17:44:16.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.245+0000 7f1f87fff700 1 -- 172.21.15.26:0/2918962716 shutdown_connections 2021-11-03T17:44:16.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.245+0000 7f1f87fff700 1 --2- 172.21.15.26:0/2918962716 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f880f77d0 0x7f1f880f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:16.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.245+0000 7f1f87fff700 1 --2- 172.21.15.26:0/2918962716 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f880f6530 0x7f1f880f6950 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:16.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.245+0000 7f1f87fff700 1 -- 172.21.15.26:0/2918962716 >> 172.21.15.26:0/2918962716 conn(0x7f1f880f1cd0 msgr2=0x7f1f880f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:44:16.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.245+0000 7f1f87fff700 1 -- 172.21.15.26:0/2918962716 shutdown_connections 2021-11-03T17:44:16.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.245+0000 7f1f87fff700 1 -- 172.21.15.26:0/2918962716 wait complete. 2021-11-03T17:44:16.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.245+0000 7f1f87fff700 1 Processor -- start 2021-11-03T17:44:16.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.246+0000 7f1f87fff700 1 -- start start 2021-11-03T17:44:16.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.246+0000 7f1f87fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f880f6530 0x7f1f8806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:44:16.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.246+0000 7f1f87fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f880f77d0 0x7f1f88069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:44:16.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.246+0000 7f1f87fff700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8806a380 con 0x7f1f880f6530 2021-11-03T17:44:16.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.246+0000 7f1f87fff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8806a4c0 con 0x7f1f880f77d0 2021-11-03T17:44:16.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.246+0000 7f1f86ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f880f6530 0x7f1f8806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:44:16.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.246+0000 7f1f86ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f880f6530 0x7f1f8806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56076/0 (socket says 172.21.15.26:56076) 2021-11-03T17:44:16.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.246+0000 7f1f86ffd700 1 -- 172.21.15.26:0/401172981 learned_addr learned my addr 172.21.15.26:0/401172981 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:44:16.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.246+0000 7f1f867fc700 1 --2- 172.21.15.26:0/401172981 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f880f77d0 0x7f1f88069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:44:16.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.246+0000 7f1f86ffd700 1 -- 172.21.15.26:0/401172981 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f880f77d0 msgr2=0x7f1f88069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:44:16.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.246+0000 7f1f86ffd700 1 --2- 172.21.15.26:0/401172981 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f880f77d0 0x7f1f88069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:16.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.246+0000 7f1f86ffd700 1 -- 172.21.15.26:0/401172981 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f78009640 con 0x7f1f880f6530 2021-11-03T17:44:16.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.246+0000 7f1f86ffd700 1 --2- 172.21.15.26:0/401172981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f880f6530 0x7f1f8806b9a0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7f1f7800c010 tx=0x7f1f78004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:44:16.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.247+0000 7f1f7f7fe700 1 -- 172.21.15.26:0/401172981 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f7800e070 con 0x7f1f880f6530 2021-11-03T17:44:16.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.247+0000 7f1f87fff700 1 -- 172.21.15.26:0/401172981 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f8806a740 con 0x7f1f880f6530 2021-11-03T17:44:16.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.247+0000 7f1f7f7fe700 1 -- 172.21.15.26:0/401172981 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1f78007d10 con 0x7f1f880f6530 2021-11-03T17:44:16.247 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.247+0000 7f1f7f7fe700 1 -- 172.21.15.26:0/401172981 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f78018070 con 0x7f1f880f6530 2021-11-03T17:44:16.247 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.247+0000 7f1f87fff700 1 -- 172.21.15.26:0/401172981 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f8806ac20 con 0x7f1f880f6530 2021-11-03T17:44:16.247 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.248+0000 7f1f87fff700 1 -- 172.21.15.26:0/401172981 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f88045ad0 con 0x7f1f880f6530 2021-11-03T17:44:16.247 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.248+0000 7f1f7f7fe700 1 -- 172.21.15.26:0/401172981 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f1f78024060 con 0x7f1f880f6530 2021-11-03T17:44:16.247 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.248+0000 7f1f7f7fe700 1 --2- 172.21.15.26:0/401172981 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1f74064100 0x7f1f740665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:44:16.248 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.249+0000 7f1f7f7fe700 1 -- 172.21.15.26:0/401172981 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f1f78082170 con 0x7f1f880f6530 2021-11-03T17:44:16.248 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.249+0000 7f1f867fc700 1 --2- 172.21.15.26:0/401172981 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1f74064100 0x7f1f740665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:44:16.248 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.249+0000 7f1f867fc700 1 --2- 172.21.15.26:0/401172981 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1f74064100 0x7f1f740665c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f1f700041d0 tx=0x7f1f70009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:44:16.249 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.253+0000 7f1f7f7fe700 1 -- 172.21.15.26:0/401172981 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f1f780544d0 con 0x7f1f880f6530 2021-11-03T17:44:16.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.432+0000 7f1f87fff700 1 -- 172.21.15.26:0/401172981 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f880fee30 con 0x7f1f74064100 2021-11-03T17:44:16.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.433+0000 7f1f7f7fe700 1 -- 172.21.15.26:0/401172981 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f1f880fee30 con 0x7f1f74064100 2021-11-03T17:44:16.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.435+0000 7f1f87fff700 1 -- 172.21.15.26:0/401172981 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1f74064100 msgr2=0x7f1f740665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:44:16.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.435+0000 7f1f87fff700 1 --2- 172.21.15.26:0/401172981 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1f74064100 0x7f1f740665c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f1f700041d0 tx=0x7f1f70009040).stop 2021-11-03T17:44:16.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.435+0000 7f1f87fff700 1 -- 172.21.15.26:0/401172981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f880f6530 msgr2=0x7f1f8806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:44:16.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.435+0000 7f1f87fff700 1 --2- 172.21.15.26:0/401172981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f880f6530 0x7f1f8806b9a0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7f1f7800c010 tx=0x7f1f78004d10).stop 2021-11-03T17:44:16.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.435+0000 7f1f87fff700 1 -- 172.21.15.26:0/401172981 shutdown_connections 2021-11-03T17:44:16.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.435+0000 7f1f87fff700 1 --2- 172.21.15.26:0/401172981 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1f74064100 0x7f1f740665c0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:16.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.435+0000 7f1f87fff700 1 --2- 172.21.15.26:0/401172981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f880f6530 0x7f1f8806b9a0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:16.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.435+0000 7f1f87fff700 1 --2- 172.21.15.26:0/401172981 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f880f77d0 0x7f1f88069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:16.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.435+0000 7f1f87fff700 1 -- 172.21.15.26:0/401172981 >> 172.21.15.26:0/401172981 conn(0x7f1f880f1cd0 msgr2=0x7f1f880fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:44:16.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.435+0000 7f1f87fff700 1 -- 172.21.15.26:0/401172981 shutdown_connections 2021-11-03T17:44:16.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.435+0000 7f1f87fff700 1 -- 172.21.15.26:0/401172981 wait complete. 2021-11-03T17:44:16.438 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:44:16.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.534+0000 7f192d584700 1 -- 172.21.15.26:0/766523953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19280f66d0 msgr2=0x7f19280f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:44:16.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.534+0000 7f192d584700 1 --2- 172.21.15.26:0/766523953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19280f66d0 0x7f19280f6b30 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7f191c004660 tx=0x7f191c009b30).stop 2021-11-03T17:44:16.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.534+0000 7f192d584700 1 -- 172.21.15.26:0/766523953 shutdown_connections 2021-11-03T17:44:16.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.534+0000 7f192d584700 1 --2- 172.21.15.26:0/766523953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19280f66d0 0x7f19280f6b30 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:16.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.534+0000 7f192d584700 1 --2- 172.21.15.26:0/766523953 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19280f5430 0x7f19280f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:16.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.534+0000 7f192d584700 1 -- 172.21.15.26:0/766523953 >> 172.21.15.26:0/766523953 conn(0x7f19280f0b90 msgr2=0x7f19280f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:44:16.530 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.534+0000 7f192d584700 1 -- 172.21.15.26:0/766523953 shutdown_connections 2021-11-03T17:44:16.530 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.534+0000 7f192d584700 1 -- 172.21.15.26:0/766523953 wait complete. 2021-11-03T17:44:16.533 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.535+0000 7f192d584700 1 Processor -- start 2021-11-03T17:44:16.533 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.535+0000 7f192d584700 1 -- start start 2021-11-03T17:44:16.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.535+0000 7f192d584700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19280f5430 0x7f1928109a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:44:16.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.535+0000 7f192d584700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19280f66d0 0x7f192810bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:44:16.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.535+0000 7f192d584700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19280603e0 con 0x7f19280f5430 2021-11-03T17:44:16.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.535+0000 7f192d584700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1928060520 con 0x7f19280f66d0 2021-11-03T17:44:16.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.535+0000 7f1927fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19280f5430 0x7f1928109a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:44:16.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.535+0000 7f1927fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19280f5430 0x7f1928109a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56086/0 (socket says 172.21.15.26:56086) 2021-11-03T17:44:16.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.535+0000 7f1927fff700 1 -- 172.21.15.26:0/4172869062 learned_addr learned my addr 172.21.15.26:0/4172869062 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:44:16.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.536+0000 7f1927fff700 1 -- 172.21.15.26:0/4172869062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19280f66d0 msgr2=0x7f192810bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:44:16.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.536+0000 7f1927fff700 1 --2- 172.21.15.26:0/4172869062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19280f66d0 0x7f192810bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:44:16.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.536+0000 7f1927fff700 1 -- 172.21.15.26:0/4172869062 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f191c005040 con 0x7f19280f5430 2021-11-03T17:44:16.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.536+0000 7f1927fff700 1 --2- 172.21.15.26:0/4172869062 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19280f5430 0x7f1928109a20 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7f191800c530 tx=0x7f1918007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:44:16.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.536+0000 7f1924ff9700 1 -- 172.21.15.26:0/4172869062 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f191800f650 con 0x7f19280f5430 2021-11-03T17:44:16.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.536+0000 7f192d584700 1 -- 172.21.15.26:0/4172869062 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f192810c4d0 con 0x7f19280f5430 2021-11-03T17:44:16.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.536+0000 7f1924ff9700 1 -- 172.21.15.26:0/4172869062 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f191800fc60 con 0x7f19280f5430 2021-11-03T17:44:16.538 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.536+0000 7f1924ff9700 1 -- 172.21.15.26:0/4172869062 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1918012d20 con 0x7f19280f5430 2021-11-03T17:44:16.538 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.536+0000 7f192d584700 1 -- 172.21.15.26:0/4172869062 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f192810ca90 con 0x7f19280f5430 2021-11-03T17:44:16.538 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.537+0000 7f192d584700 1 -- 172.21.15.26:0/4172869062 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1928045ad0 con 0x7f19280f5430 2021-11-03T17:44:16.538 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.537+0000 7f1924ff9700 1 -- 172.21.15.26:0/4172869062 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f1918019030 con 0x7f19280f5430 2021-11-03T17:44:16.539 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.538+0000 7f1924ff9700 1 --2- 172.21.15.26:0/4172869062 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1910064100 0x7f19100665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:44:16.539 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.538+0000 7f1924ff9700 1 -- 172.21.15.26:0/4172869062 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f1918080620 con 0x7f19280f5430 2021-11-03T17:44:16.539 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.538+0000 7f19277fe700 1 --2- 172.21.15.26:0/4172869062 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1910064100 0x7f19100665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:44:16.539 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.538+0000 7f19277fe700 1 --2- 172.21.15.26:0/4172869062 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1910064100 0x7f19100665c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f191c004e30 tx=0x7f191c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:44:16.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.542+0000 7f1924ff9700 1 -- 172.21.15.26:0/4172869062 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f19180528e0 con 0x7f19280f5430 2021-11-03T17:44:16.707 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.712+0000 7f192d584700 1 -- 172.21.15.26:0/4172869062 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1928057f10 con 0x7f1910064100 2021-11-03T17:44:16.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.727+0000 7f1924ff9700 1 -- 172.21.15.26:0/4172869062 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f1928057f10 con 0x7f1910064100 2021-11-03T17:44:16.721 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:44:16.721 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (55m) 4m ago 56m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:44:16.722 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (47m) 4m ago 56m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:44:16.722 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (47m) 3m ago 55m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:44:16.722 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (55m) 4m ago 56m 40.8M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:44:16.722 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (48m) 4m ago 51m 25.1M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:44:16.723 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (48m) 4m ago 51m 25.7M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:44:16.723 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (51m) 3m ago 51m 26.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:44:16.723 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (51m) 3m ago 51m 26.3M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:44:16.723 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (49m) 4m ago 58m 533M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:44:16.724 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (48m) 3m ago 55m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:44:16.724 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (48m) 4m ago 58m 209M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:44:16.724 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (48m) 3m ago 55m 103M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:44:16.724 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (56m) 4m ago 56m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:44:16.725 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (55m) 3m ago 55m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:44:16.725 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (47m) 4m ago 55m 251M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:44:16.725 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (46m) 4m ago 54m 270M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:44:16.726 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (46m) 4m ago 54m 225M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:44:16.726 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (45m) 3m ago 54m 287M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:44:16.726 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (45m) 3m ago 53m 246M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:44:16.727 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (44m) 3m ago 53m 235M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:44:16.727 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (55m) 4m ago 56m 56.7M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:44:16.728 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.729+0000 7f192d584700 1 -- 172.21.15.26:0/4172869062 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1910064100 msgr2=0x7f19100665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:44:16.728 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.729+0000 7f192d584700 1 --2- 172.21.15.26:0/4172869062 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1910064100 0x7f19100665c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f191c004e30 tx=0x7f191c009b30).stop 2021-11-03T17:44:16.729 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.729+0000 7f192d584700 1 -- 172.21.15.26:0/4172869062 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19280f5430 msgr2=0x7f1928109a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:44:16.729 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.729+0000 7f192d584700 1 --2- 172.21.15.26:0/4172869062 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19280f5430 0x7f1928109a20 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7f191800c530 tx=0x7f1918007e10).stop 2021-11-03T17:44:16.729 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.729+0000 7f192d584700 1 -- 172.21.15.26:0/4172869062 shutdown_connections 2021-11-03T17:44:16.730 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.729+0000 7f192d584700 1 --2- 172.21.15.26:0/4172869062 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1910064100 0x7f19100665c0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:16.730 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.729+0000 7f192d584700 1 --2- 172.21.15.26:0/4172869062 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19280f5430 0x7f1928109a20 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:16.730 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.729+0000 7f192d584700 1 --2- 172.21.15.26:0/4172869062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19280f66d0 0x7f192810bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:44:16.730 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.729+0000 7f192d584700 1 -- 172.21.15.26:0/4172869062 >> 172.21.15.26:0/4172869062 conn(0x7f19280f0b90 msgr2=0x7f19280fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:44:16.731 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.729+0000 7f192d584700 1 -- 172.21.15.26:0/4172869062 shutdown_connections 2021-11-03T17:44:16.731 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.729+0000 7f192d584700 1 -- 172.21.15.26:0/4172869062 wait complete. 2021-11-03T17:44:16.824 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.828+0000 7fdf2917c700 1 -- 172.21.15.26:0/4219973529 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf240f8610 msgr2=0x7fdf240f4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:44:16.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.828+0000 7fdf2917c700 1 --2- 172.21.15.26:0/4219973529 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf240f8610 0x7fdf240f4820 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7fdf0c004660 tx=0x7fdf0c009b30).stop 2021-11-03T17:44:16.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.828+0000 7fdf2917c700 1 -- 172.21.15.26:0/4219973529 shutdown_connections 2021-11-03T17:44:16.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.828+0000 7fdf2917c700 1 --2- 172.21.15.26:0/4219973529 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf240f8610 0x7fdf240f4820 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:16.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.828+0000 7fdf2917c700 1 --2- 172.21.15.26:0/4219973529 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf240f7d00 0x7fdf240f8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:16.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.828+0000 7fdf2917c700 1 -- 172.21.15.26:0/4219973529 >> 172.21.15.26:0/4219973529 conn(0x7fdf240f0540 msgr2=0x7fdf240f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:44:16.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.828+0000 7fdf2917c700 1 -- 172.21.15.26:0/4219973529 shutdown_connections 2021-11-03T17:44:16.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.829+0000 7fdf2917c700 1 -- 172.21.15.26:0/4219973529 wait complete. 2021-11-03T17:44:16.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.829+0000 7fdf2917c700 1 Processor -- start 2021-11-03T17:44:16.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.829+0000 7fdf2917c700 1 -- start start 2021-11-03T17:44:16.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.829+0000 7fdf2917c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf240f7d00 0x7fdf24106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:44:16.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.829+0000 7fdf2917c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf240f8610 0x7fdf24107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:44:16.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.829+0000 7fdf2917c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf241079b0 con 0x7fdf240f7d00 2021-11-03T17:44:16.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.829+0000 7fdf2917c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf24107af0 con 0x7fdf240f8610 2021-11-03T17:44:16.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.829+0000 7fdf22d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf240f7d00 0x7fdf24106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:44:16.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.830+0000 7fdf22d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf240f7d00 0x7fdf24106f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56096/0 (socket says 172.21.15.26:56096) 2021-11-03T17:44:16.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.830+0000 7fdf22d9d700 1 -- 172.21.15.26:0/1298380911 learned_addr learned my addr 172.21.15.26:0/1298380911 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:44:16.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.830+0000 7fdf2259c700 1 --2- 172.21.15.26:0/1298380911 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf240f8610 0x7fdf24107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:44:16.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.830+0000 7fdf22d9d700 1 -- 172.21.15.26:0/1298380911 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf240f8610 msgr2=0x7fdf24107400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:44:16.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.830+0000 7fdf22d9d700 1 --2- 172.21.15.26:0/1298380911 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf240f8610 0x7fdf24107400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:16.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.830+0000 7fdf22d9d700 1 -- 172.21.15.26:0/1298380911 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0c005040 con 0x7fdf240f7d00 2021-11-03T17:44:16.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.830+0000 7fdf22d9d700 1 --2- 172.21.15.26:0/1298380911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf240f7d00 0x7fdf24106f10 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7fdf1c00c7c0 tx=0x7fdf1c004d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:44:16.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.830+0000 7fdf1b7fe700 1 -- 172.21.15.26:0/1298380911 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf1c00a6e0 con 0x7fdf240f7d00 2021-11-03T17:44:16.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.830+0000 7fdf1b7fe700 1 -- 172.21.15.26:0/1298380911 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdf1c00acf0 con 0x7fdf240f7d00 2021-11-03T17:44:16.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.830+0000 7fdf2917c700 1 -- 172.21.15.26:0/1298380911 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf24108490 con 0x7fdf240f7d00 2021-11-03T17:44:16.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.830+0000 7fdf1b7fe700 1 -- 172.21.15.26:0/1298380911 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf1c012df0 con 0x7fdf240f7d00 2021-11-03T17:44:16.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.830+0000 7fdf2917c700 1 -- 172.21.15.26:0/1298380911 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf24108a50 con 0x7fdf240f7d00 2021-11-03T17:44:16.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.831+0000 7fdf2917c700 1 -- 172.21.15.26:0/1298380911 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf24045ad0 con 0x7fdf240f7d00 2021-11-03T17:44:16.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.832+0000 7fdf1b7fe700 1 -- 172.21.15.26:0/1298380911 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fdf1c019030 con 0x7fdf240f7d00 2021-11-03T17:44:16.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.832+0000 7fdf1b7fe700 1 --2- 172.21.15.26:0/1298380911 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdf100640b0 0x7fdf10066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:44:16.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.832+0000 7fdf1b7fe700 1 -- 172.21.15.26:0/1298380911 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fdf1c080a90 con 0x7fdf240f7d00 2021-11-03T17:44:16.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.832+0000 7fdf2259c700 1 --2- 172.21.15.26:0/1298380911 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdf100640b0 0x7fdf10066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:44:16.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.832+0000 7fdf2259c700 1 --2- 172.21.15.26:0/1298380911 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdf100640b0 0x7fdf10066570 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7fdf0c004e30 tx=0x7fdf0c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:44:16.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:16.836+0000 7fdf1b7fe700 1 -- 172.21.15.26:0/1298380911 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fdf1c052db0 con 0x7fdf240f7d00 2021-11-03T17:44:16.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:16 smithi194 ceph-mon[65619]: pgmap v1488: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:17.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.066+0000 7fdf2917c700 1 -- 172.21.15.26:0/1298380911 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdf240fef50 con 0x7fdf240f7d00 2021-11-03T17:44:17.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.067+0000 7fdf1b7fe700 1 -- 172.21.15.26:0/1298380911 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fdf1c017020 con 0x7fdf240f7d00 2021-11-03T17:44:17.062 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:44:17.062 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:44:17.063 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:44:17.063 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:44:17.063 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:44:17.063 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:44:17.064 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:44:17.064 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:44:17.064 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:44:17.065 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:44:17.065 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:44:17.065 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:44:17.065 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:44:17.066 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:44:17.066 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:44:17.067 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:44:17.067 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:44:17.067 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:44:17.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.068+0000 7fdf2917c700 1 -- 172.21.15.26:0/1298380911 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdf100640b0 msgr2=0x7fdf10066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:44:17.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.068+0000 7fdf2917c700 1 --2- 172.21.15.26:0/1298380911 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdf100640b0 0x7fdf10066570 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7fdf0c004e30 tx=0x7fdf0c009b30).stop 2021-11-03T17:44:17.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.068+0000 7fdf2917c700 1 -- 172.21.15.26:0/1298380911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf240f7d00 msgr2=0x7fdf24106f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:44:17.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.068+0000 7fdf2917c700 1 --2- 172.21.15.26:0/1298380911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf240f7d00 0x7fdf24106f10 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7fdf1c00c7c0 tx=0x7fdf1c004d70).stop 2021-11-03T17:44:17.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.069+0000 7fdf2917c700 1 -- 172.21.15.26:0/1298380911 shutdown_connections 2021-11-03T17:44:17.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.069+0000 7fdf2917c700 1 --2- 172.21.15.26:0/1298380911 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdf100640b0 0x7fdf10066570 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:17.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.069+0000 7fdf2917c700 1 --2- 172.21.15.26:0/1298380911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf240f7d00 0x7fdf24106f10 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:17.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.069+0000 7fdf2917c700 1 --2- 172.21.15.26:0/1298380911 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf240f8610 0x7fdf24107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:17.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.069+0000 7fdf2917c700 1 -- 172.21.15.26:0/1298380911 >> 172.21.15.26:0/1298380911 conn(0x7fdf240f0540 msgr2=0x7fdf240fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:44:17.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.069+0000 7fdf2917c700 1 -- 172.21.15.26:0/1298380911 shutdown_connections 2021-11-03T17:44:17.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.069+0000 7fdf2917c700 1 -- 172.21.15.26:0/1298380911 wait complete. 2021-11-03T17:44:17.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.169+0000 7fc0261cf700 1 -- 172.21.15.26:0/1082418232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0200f4d60 msgr2=0x7fc0200f5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:44:17.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.169+0000 7fc0261cf700 1 --2- 172.21.15.26:0/1082418232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0200f4d60 0x7fc0200f5180 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7fc010004660 tx=0x7fc010009b30).stop 2021-11-03T17:44:17.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.169+0000 7fc0261cf700 1 -- 172.21.15.26:0/1082418232 shutdown_connections 2021-11-03T17:44:17.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.169+0000 7fc0261cf700 1 --2- 172.21.15.26:0/1082418232 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0200f5f60 0x7fc0200f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:17.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.169+0000 7fc0261cf700 1 --2- 172.21.15.26:0/1082418232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0200f4d60 0x7fc0200f5180 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:17.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.169+0000 7fc0261cf700 1 -- 172.21.15.26:0/1082418232 >> 172.21.15.26:0/1082418232 conn(0x7fc0200f04c0 msgr2=0x7fc0200f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:44:17.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.169+0000 7fc0261cf700 1 -- 172.21.15.26:0/1082418232 shutdown_connections 2021-11-03T17:44:17.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.169+0000 7fc0261cf700 1 -- 172.21.15.26:0/1082418232 wait complete. 2021-11-03T17:44:17.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.169+0000 7fc0261cf700 1 Processor -- start 2021-11-03T17:44:17.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.169+0000 7fc0261cf700 1 -- start start 2021-11-03T17:44:17.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.170+0000 7fc0261cf700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0200f4d60 0x7fc020109c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:44:17.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.170+0000 7fc0261cf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0200f5f60 0x7fc02010c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:44:17.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.170+0000 7fc0261cf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0200f87f0 con 0x7fc0200f5f60 2021-11-03T17:44:17.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.170+0000 7fc0261cf700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0200f8930 con 0x7fc0200f4d60 2021-11-03T17:44:17.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.170+0000 7fc01effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0200f5f60 0x7fc02010c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:44:17.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.170+0000 7fc01effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0200f5f60 0x7fc02010c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56108/0 (socket says 172.21.15.26:56108) 2021-11-03T17:44:17.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.170+0000 7fc01effd700 1 -- 172.21.15.26:0/2543765045 learned_addr learned my addr 172.21.15.26:0/2543765045 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:44:17.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.170+0000 7fc01f7fe700 1 --2- 172.21.15.26:0/2543765045 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0200f4d60 0x7fc020109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:44:17.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.170+0000 7fc01effd700 1 -- 172.21.15.26:0/2543765045 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0200f4d60 msgr2=0x7fc020109c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:44:17.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.170+0000 7fc01effd700 1 --2- 172.21.15.26:0/2543765045 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0200f4d60 0x7fc020109c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:17.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.170+0000 7fc01effd700 1 -- 172.21.15.26:0/2543765045 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc010005040 con 0x7fc0200f5f60 2021-11-03T17:44:17.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.170+0000 7fc01effd700 1 --2- 172.21.15.26:0/2543765045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0200f5f60 0x7fc02010c180 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7fc01400c510 tx=0x7fc014007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:44:17.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.170+0000 7fc007fff700 1 -- 172.21.15.26:0/2543765045 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc01400f650 con 0x7fc0200f5f60 2021-11-03T17:44:17.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.170+0000 7fc007fff700 1 -- 172.21.15.26:0/2543765045 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc01400fc60 con 0x7fc0200f5f60 2021-11-03T17:44:17.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.170+0000 7fc0261cf700 1 -- 172.21.15.26:0/2543765045 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc02010c730 con 0x7fc0200f5f60 2021-11-03T17:44:17.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.170+0000 7fc007fff700 1 -- 172.21.15.26:0/2543765045 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc014012c50 con 0x7fc0200f5f60 2021-11-03T17:44:17.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.170+0000 7fc0261cf700 1 -- 172.21.15.26:0/2543765045 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc02010ccf0 con 0x7fc0200f5f60 2021-11-03T17:44:17.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.171+0000 7fc0261cf700 1 -- 172.21.15.26:0/2543765045 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc020045ad0 con 0x7fc0200f5f60 2021-11-03T17:44:17.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.172+0000 7fc007fff700 1 -- 172.21.15.26:0/2543765045 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc014010070 con 0x7fc0200f5f60 2021-11-03T17:44:17.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.172+0000 7fc007fff700 1 --2- 172.21.15.26:0/2543765045 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc0080640b0 0x7fc008066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:44:17.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.172+0000 7fc007fff700 1 -- 172.21.15.26:0/2543765045 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc0140805e0 con 0x7fc0200f5f60 2021-11-03T17:44:17.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.172+0000 7fc01f7fe700 1 --2- 172.21.15.26:0/2543765045 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc0080640b0 0x7fc008066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:44:17.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.173+0000 7fc01f7fe700 1 --2- 172.21.15.26:0/2543765045 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc0080640b0 0x7fc008066570 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7fc010004630 tx=0x7fc010009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:44:17.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:16 smithi026 ceph-mon[96795]: pgmap v1488: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:17.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.176+0000 7fc007fff700 1 -- 172.21.15.26:0/2543765045 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc014052850 con 0x7fc0200f5f60 2021-11-03T17:44:17.375 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.381+0000 7fc0261cf700 1 -- 172.21.15.26:0/2543765045 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc0200fd560 con 0x7fc0200f5f60 2021-11-03T17:44:17.375 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.381+0000 7fc007fff700 1 -- 172.21.15.26:0/2543765045 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fc014052440 con 0x7fc0200f5f60 2021-11-03T17:44:17.375 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:44:17.376 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:44:17.376 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:44:17.376 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:44:17.376 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:44:17.377 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:44:17.377 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:44:17.377 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:44:17.378 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:44:17.378 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:44:17.378 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:44:17.378 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:44:17.379 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:44:17.379 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:44:17.379 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:44:17.379 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:44:17.380 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:44:17.380 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:44:17.380 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:44:17.380 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:44:17.381 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:44:17.381 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:44:17.381 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:44:17.381 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:44:17.382 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:44:17.382 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:44:17.382 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:44:17.382 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:44:17.382 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:44:17.383 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:44:17.383 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:44:17.383 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:44:17.384 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:44:17.384 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:44:17.384 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:44:17.384 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:44:17.385 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:44:17.385 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:44:17.385 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:44:17.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.383+0000 7fc0261cf700 1 -- 172.21.15.26:0/2543765045 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc0080640b0 msgr2=0x7fc008066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:44:17.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.383+0000 7fc0261cf700 1 --2- 172.21.15.26:0/2543765045 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc0080640b0 0x7fc008066570 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7fc010004630 tx=0x7fc010009b30).stop 2021-11-03T17:44:17.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.383+0000 7fc0261cf700 1 -- 172.21.15.26:0/2543765045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0200f5f60 msgr2=0x7fc02010c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:44:17.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.383+0000 7fc0261cf700 1 --2- 172.21.15.26:0/2543765045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0200f5f60 0x7fc02010c180 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7fc01400c510 tx=0x7fc014007e00).stop 2021-11-03T17:44:17.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.383+0000 7fc0261cf700 1 -- 172.21.15.26:0/2543765045 shutdown_connections 2021-11-03T17:44:17.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.383+0000 7fc0261cf700 1 --2- 172.21.15.26:0/2543765045 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc0080640b0 0x7fc008066570 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:17.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.383+0000 7fc0261cf700 1 --2- 172.21.15.26:0/2543765045 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0200f4d60 0x7fc020109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:17.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.383+0000 7fc0261cf700 1 --2- 172.21.15.26:0/2543765045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0200f5f60 0x7fc02010c180 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:17.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.383+0000 7fc0261cf700 1 -- 172.21.15.26:0/2543765045 >> 172.21.15.26:0/2543765045 conn(0x7fc0200f04c0 msgr2=0x7fc0200fab50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:44:17.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.383+0000 7fc0261cf700 1 -- 172.21.15.26:0/2543765045 shutdown_connections 2021-11-03T17:44:17.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:17.383+0000 7fc0261cf700 1 -- 172.21.15.26:0/2543765045 wait complete. 2021-11-03T17:44:17.389 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:44:17.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:17 smithi194 ceph-mon[65619]: from='client.35676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:44:17.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:17 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1298380911' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:44:17.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:17 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2543765045' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:44:18.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:17 smithi026 ceph-mon[96795]: from='client.35676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:44:18.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:17 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1298380911' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:44:18.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:17 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2543765045' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:44:18.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:18 smithi194 ceph-mon[65619]: from='client.35680 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:44:18.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:18 smithi194 ceph-mon[65619]: pgmap v1489: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:19.170 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:18 smithi026 ceph-mon[96795]: from='client.35680 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:44:19.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:18 smithi026 ceph-mon[96795]: pgmap v1489: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:20.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:20 smithi194 ceph-mon[65619]: pgmap v1490: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:21.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:20 smithi026 ceph-mon[96795]: pgmap v1490: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:22.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:22 smithi194 ceph-mon[65619]: pgmap v1491: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:23.170 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:22 smithi026 ceph-mon[96795]: pgmap v1491: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:23.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:23 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:44:23.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:23 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:44:23.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:23 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:44:23.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:23 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:44:23.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:23 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:44:23.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:23 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:44:23.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:23 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:44:23.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:23 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:44:24.170 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:23 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:44:24.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:23 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:44:24.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:23 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:44:24.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:23 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:44:24.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:23 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:44:24.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:23 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:44:24.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:23 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:44:24.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:23 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:44:24.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:24 smithi194 ceph-mon[65619]: poll took 60064.568 ms: 1 events 2021-11-03T17:44:24.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:24 smithi194 ceph-mon[65619]: pgmap v1492: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:24.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:24 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:44:24.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:24 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:44:25.170 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:24 smithi026 ceph-mon[96795]: poll took 60064.568 ms: 1 events 2021-11-03T17:44:25.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:24 smithi026 ceph-mon[96795]: pgmap v1492: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:25.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:24 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:44:25.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:24 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:44:25.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:25 smithi026 ceph-mon[96795]: pgmap v1493: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:25.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:25 smithi194 ceph-mon[65619]: pgmap v1493: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:28.420 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:28 smithi026 ceph-mon[96795]: pgmap v1494: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:28.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:28 smithi194 ceph-mon[65619]: pgmap v1494: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:30.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:30 smithi026 ceph-mon[96795]: pgmap v1495: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:30.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:30 smithi194 ceph-mon[65619]: pgmap v1495: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:32.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:32 smithi026 ceph-mon[96795]: pgmap v1496: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:32.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:32 smithi194 ceph-mon[65619]: pgmap v1496: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:34.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:34 smithi026 ceph-mon[96795]: pgmap v1497: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:34.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:34 smithi194 ceph-mon[65619]: pgmap v1497: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:36.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:36 smithi026 ceph-mon[96795]: pgmap v1498: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:36.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:36 smithi194 ceph-mon[65619]: pgmap v1498: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:38.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:38 smithi026 ceph-mon[96795]: pgmap v1499: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:38.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:38 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:44:38.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:38 smithi194 ceph-mon[65619]: pgmap v1499: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:38.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:38 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:44:39.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:39 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:44:39.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:39 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:44:40.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:40 smithi026 ceph-mon[96795]: pgmap v1500: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:40.754 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:40 smithi194 ceph-mon[65619]: pgmap v1500: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:42.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:42 smithi026 ceph-mon[96795]: pgmap v1501: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:42.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:42 smithi194 ceph-mon[65619]: pgmap v1501: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:44.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:44 smithi026 ceph-mon[96795]: pgmap v1502: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:44.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:44 smithi194 ceph-mon[65619]: pgmap v1502: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:46.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:46 smithi026 ceph-mon[96795]: pgmap v1503: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:46.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:46 smithi194 ceph-mon[65619]: pgmap v1503: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:47.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.496+0000 7fa896513700 1 -- 172.21.15.26:0/1653513209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8900f66e0 msgr2=0x7fa8900f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:44:47.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.496+0000 7fa896513700 1 --2- 172.21.15.26:0/1653513209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8900f66e0 0x7fa8900f6b00 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7fa880004660 tx=0x7fa880009b30).stop 2021-11-03T17:44:47.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.497+0000 7fa896513700 1 -- 172.21.15.26:0/1653513209 shutdown_connections 2021-11-03T17:44:47.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.497+0000 7fa896513700 1 --2- 172.21.15.26:0/1653513209 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8900f7980 0x7fa8900f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:47.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.497+0000 7fa896513700 1 --2- 172.21.15.26:0/1653513209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8900f66e0 0x7fa8900f6b00 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:47.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.497+0000 7fa896513700 1 -- 172.21.15.26:0/1653513209 >> 172.21.15.26:0/1653513209 conn(0x7fa8900f1e40 msgr2=0x7fa8900f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:44:47.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.497+0000 7fa896513700 1 -- 172.21.15.26:0/1653513209 shutdown_connections 2021-11-03T17:44:47.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.497+0000 7fa896513700 1 -- 172.21.15.26:0/1653513209 wait complete. 2021-11-03T17:44:47.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.497+0000 7fa896513700 1 Processor -- start 2021-11-03T17:44:47.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.497+0000 7fa896513700 1 -- start start 2021-11-03T17:44:47.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.498+0000 7fa896513700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8900f66e0 0x7fa890106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:44:47.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.498+0000 7fa896513700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8900f7980 0x7fa890107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:44:47.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.498+0000 7fa896513700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa890107a00 con 0x7fa8900f66e0 2021-11-03T17:44:47.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.498+0000 7fa896513700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa890107b40 con 0x7fa8900f7980 2021-11-03T17:44:47.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.498+0000 7fa88ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8900f66e0 0x7fa890106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:44:47.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.498+0000 7fa88ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8900f66e0 0x7fa890106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56124/0 (socket says 172.21.15.26:56124) 2021-11-03T17:44:47.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.498+0000 7fa88ffff700 1 -- 172.21.15.26:0/3711989421 learned_addr learned my addr 172.21.15.26:0/3711989421 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:44:47.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.498+0000 7fa88f7fe700 1 --2- 172.21.15.26:0/3711989421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8900f7980 0x7fa890107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:44:47.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.498+0000 7fa88ffff700 1 -- 172.21.15.26:0/3711989421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8900f7980 msgr2=0x7fa890107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:44:47.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.498+0000 7fa88ffff700 1 --2- 172.21.15.26:0/3711989421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8900f7980 0x7fa890107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:47.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.498+0000 7fa88ffff700 1 -- 172.21.15.26:0/3711989421 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa880005040 con 0x7fa8900f66e0 2021-11-03T17:44:47.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.498+0000 7fa88ffff700 1 --2- 172.21.15.26:0/3711989421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8900f66e0 0x7fa890106f60 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7fa880014040 tx=0x7fa88000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:44:47.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.498+0000 7fa88cff9700 1 -- 172.21.15.26:0/3711989421 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa880019070 con 0x7fa8900f66e0 2021-11-03T17:44:47.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.498+0000 7fa88cff9700 1 -- 172.21.15.26:0/3711989421 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa880007e70 con 0x7fa8900f66e0 2021-11-03T17:44:47.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.498+0000 7fa896513700 1 -- 172.21.15.26:0/3711989421 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa890108480 con 0x7fa8900f66e0 2021-11-03T17:44:47.500 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.498+0000 7fa88cff9700 1 -- 172.21.15.26:0/3711989421 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa880014d50 con 0x7fa8900f66e0 2021-11-03T17:44:47.500 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.498+0000 7fa896513700 1 -- 172.21.15.26:0/3711989421 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8901089e0 con 0x7fa8900f66e0 2021-11-03T17:44:47.501 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.499+0000 7fa896513700 1 -- 172.21.15.26:0/3711989421 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa890045ad0 con 0x7fa8900f66e0 2021-11-03T17:44:47.501 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.500+0000 7fa88cff9700 1 -- 172.21.15.26:0/3711989421 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fa880025070 con 0x7fa8900f66e0 2021-11-03T17:44:47.502 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.501+0000 7fa88cff9700 1 --2- 172.21.15.26:0/3711989421 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa8780640b0 0x7fa878066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:44:47.502 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.501+0000 7fa88cff9700 1 -- 172.21.15.26:0/3711989421 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fa880081ac0 con 0x7fa8900f66e0 2021-11-03T17:44:47.502 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.501+0000 7fa88f7fe700 1 --2- 172.21.15.26:0/3711989421 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa8780640b0 0x7fa878066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:44:47.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.501+0000 7fa88f7fe700 1 --2- 172.21.15.26:0/3711989421 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa8780640b0 0x7fa878066570 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7fa884007f80 tx=0x7fa88400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:44:47.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.504+0000 7fa88cff9700 1 -- 172.21.15.26:0/3711989421 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fa880053ea0 con 0x7fa8900f66e0 2021-11-03T17:44:47.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.681+0000 7fa896513700 1 -- 172.21.15.26:0/3711989421 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8900fefe0 con 0x7fa8780640b0 2021-11-03T17:44:47.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.683+0000 7fa88cff9700 1 -- 172.21.15.26:0/3711989421 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fa8900fefe0 con 0x7fa8780640b0 2021-11-03T17:44:47.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.684+0000 7fa896513700 1 -- 172.21.15.26:0/3711989421 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa8780640b0 msgr2=0x7fa878066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:44:47.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.684+0000 7fa896513700 1 --2- 172.21.15.26:0/3711989421 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa8780640b0 0x7fa878066570 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7fa884007f80 tx=0x7fa88400b040).stop 2021-11-03T17:44:47.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.684+0000 7fa896513700 1 -- 172.21.15.26:0/3711989421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8900f66e0 msgr2=0x7fa890106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:44:47.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.684+0000 7fa896513700 1 --2- 172.21.15.26:0/3711989421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8900f66e0 0x7fa890106f60 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7fa880014040 tx=0x7fa88000b040).stop 2021-11-03T17:44:47.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.685+0000 7fa896513700 1 -- 172.21.15.26:0/3711989421 shutdown_connections 2021-11-03T17:44:47.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.685+0000 7fa896513700 1 --2- 172.21.15.26:0/3711989421 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa8780640b0 0x7fa878066570 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:47.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.685+0000 7fa896513700 1 --2- 172.21.15.26:0/3711989421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8900f66e0 0x7fa890106f60 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:47.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.685+0000 7fa896513700 1 --2- 172.21.15.26:0/3711989421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8900f7980 0x7fa890107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:47.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.685+0000 7fa896513700 1 -- 172.21.15.26:0/3711989421 >> 172.21.15.26:0/3711989421 conn(0x7fa8900f1e40 msgr2=0x7fa8900fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:44:47.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.685+0000 7fa896513700 1 -- 172.21.15.26:0/3711989421 shutdown_connections 2021-11-03T17:44:47.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.685+0000 7fa896513700 1 -- 172.21.15.26:0/3711989421 wait complete. 2021-11-03T17:44:47.689 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:44:47.780 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.785+0000 7fbd1ca4f700 1 -- 172.21.15.26:0/3491609091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd180f5440 msgr2=0x7fbd180f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:44:47.780 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.785+0000 7fbd1ca4f700 1 --2- 172.21.15.26:0/3491609091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd180f5440 0x7fbd180f5860 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7fbd0c004660 tx=0x7fbd0c009b30).stop 2021-11-03T17:44:47.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.785+0000 7fbd1ca4f700 1 -- 172.21.15.26:0/3491609091 shutdown_connections 2021-11-03T17:44:47.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.785+0000 7fbd1ca4f700 1 --2- 172.21.15.26:0/3491609091 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd180f66e0 0x7fbd180f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:44:47.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.785+0000 7fbd1ca4f700 1 --2- 172.21.15.26:0/3491609091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd180f5440 0x7fbd180f5860 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:47.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.785+0000 7fbd1ca4f700 1 -- 172.21.15.26:0/3491609091 >> 172.21.15.26:0/3491609091 conn(0x7fbd180f0ba0 msgr2=0x7fbd180f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:44:47.782 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.785+0000 7fbd1ca4f700 1 -- 172.21.15.26:0/3491609091 shutdown_connections 2021-11-03T17:44:47.782 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.785+0000 7fbd1ca4f700 1 -- 172.21.15.26:0/3491609091 wait complete. 2021-11-03T17:44:47.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.786+0000 7fbd1ca4f700 1 Processor -- start 2021-11-03T17:44:47.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.786+0000 7fbd1ca4f700 1 -- start start 2021-11-03T17:44:47.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.786+0000 7fbd1ca4f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd180f5440 0x7fbd1810bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:44:47.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.786+0000 7fbd1ca4f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd180f66e0 0x7fbd1810e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:44:47.786 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.786+0000 7fbd1ca4f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd180602b0 con 0x7fbd180f5440 2021-11-03T17:44:47.786 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.786+0000 7fbd1ca4f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd180603f0 con 0x7fbd180f66e0 2021-11-03T17:44:47.786 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.786+0000 7fbd16d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd180f5440 0x7fbd1810bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:44:47.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.786+0000 7fbd16d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd180f5440 0x7fbd1810bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56134/0 (socket says 172.21.15.26:56134) 2021-11-03T17:44:47.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.786+0000 7fbd16d9d700 1 -- 172.21.15.26:0/23642865 learned_addr learned my addr 172.21.15.26:0/23642865 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:44:47.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.786+0000 7fbd1659c700 1 --2- 172.21.15.26:0/23642865 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd180f66e0 0x7fbd1810e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:44:47.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.786+0000 7fbd16d9d700 1 -- 172.21.15.26:0/23642865 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd180f66e0 msgr2=0x7fbd1810e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:44:47.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.786+0000 7fbd16d9d700 1 --2- 172.21.15.26:0/23642865 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd180f66e0 0x7fbd1810e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:47.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.786+0000 7fbd16d9d700 1 -- 172.21.15.26:0/23642865 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0c005040 con 0x7fbd180f5440 2021-11-03T17:44:47.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.786+0000 7fbd16d9d700 1 --2- 172.21.15.26:0/23642865 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd180f5440 0x7fbd1810bea0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7fbd0c004f60 tx=0x7fbd0c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:44:47.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.787+0000 7fbcff7fe700 1 -- 172.21.15.26:0/23642865 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd0c018070 con 0x7fbd180f5440 2021-11-03T17:44:47.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.787+0000 7fbcff7fe700 1 -- 172.21.15.26:0/23642865 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbd0c007ba0 con 0x7fbd180f5440 2021-11-03T17:44:47.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.787+0000 7fbd1ca4f700 1 -- 172.21.15.26:0/23642865 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd1810e890 con 0x7fbd180f5440 2021-11-03T17:44:47.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.787+0000 7fbcff7fe700 1 -- 172.21.15.26:0/23642865 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd0c01c620 con 0x7fbd180f5440 2021-11-03T17:44:47.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.787+0000 7fbd1ca4f700 1 -- 172.21.15.26:0/23642865 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd1810ecb0 con 0x7fbd180f5440 2021-11-03T17:44:47.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.788+0000 7fbd1ca4f700 1 -- 172.21.15.26:0/23642865 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd18045ad0 con 0x7fbd180f5440 2021-11-03T17:44:47.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.788+0000 7fbcff7fe700 1 -- 172.21.15.26:0/23642865 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fbd0c01c8e0 con 0x7fbd180f5440 2021-11-03T17:44:47.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.788+0000 7fbcff7fe700 1 --2- 172.21.15.26:0/23642865 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbd00064100 0x7fbd000665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:44:47.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.789+0000 7fbcff7fe700 1 -- 172.21.15.26:0/23642865 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fbd0c0826e0 con 0x7fbd180f5440 2021-11-03T17:44:47.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.789+0000 7fbd1659c700 1 --2- 172.21.15.26:0/23642865 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbd00064100 0x7fbd000665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:44:47.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.789+0000 7fbd1659c700 1 --2- 172.21.15.26:0/23642865 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbd00064100 0x7fbd000665c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7fbd0800b790 tx=0x7fbd08008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:44:47.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.793+0000 7fbcff7fe700 1 -- 172.21.15.26:0/23642865 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fbd0c054a40 con 0x7fbd180f5440 2021-11-03T17:44:47.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.966+0000 7fbd1ca4f700 1 -- 172.21.15.26:0/23642865 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd180fdd60 con 0x7fbd00064100 2021-11-03T17:44:47.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.980+0000 7fbcff7fe700 1 -- 172.21.15.26:0/23642865 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fbd180fdd60 con 0x7fbd00064100 2021-11-03T17:44:47.976 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:44:47.976 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (56m) 5m ago 57m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:44:47.976 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (48m) 5m ago 57m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:44:47.976 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (48m) 4m ago 56m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:44:47.977 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (55m) 5m ago 56m 40.8M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:44:47.977 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (49m) 5m ago 52m 25.1M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:44:47.977 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (49m) 5m ago 52m 25.7M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:44:47.977 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (52m) 4m ago 52m 26.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:44:47.977 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (52m) 4m ago 52m 26.3M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:44:47.978 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (49m) 5m ago 58m 533M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:44:47.978 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (49m) 4m ago 56m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:44:47.978 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (49m) 5m ago 58m 209M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:44:47.978 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (48m) 4m ago 56m 103M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:44:47.979 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (56m) 5m ago 56m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:44:47.979 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (56m) 4m ago 56m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:44:47.979 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (47m) 5m ago 55m 251M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:44:47.979 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (47m) 5m ago 55m 270M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:44:47.980 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (46m) 5m ago 54m 225M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:44:47.980 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (46m) 4m ago 54m 287M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:44:47.980 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (45m) 4m ago 54m 246M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:44:47.980 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (45m) 4m ago 54m 235M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:44:47.981 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (55m) 5m ago 56m 56.7M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:44:47.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.982+0000 7fbd1ca4f700 1 -- 172.21.15.26:0/23642865 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbd00064100 msgr2=0x7fbd000665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:44:47.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.982+0000 7fbd1ca4f700 1 --2- 172.21.15.26:0/23642865 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbd00064100 0x7fbd000665c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7fbd0800b790 tx=0x7fbd08008040).stop 2021-11-03T17:44:47.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.982+0000 7fbd1ca4f700 1 -- 172.21.15.26:0/23642865 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd180f5440 msgr2=0x7fbd1810bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:44:47.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.982+0000 7fbd1ca4f700 1 --2- 172.21.15.26:0/23642865 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd180f5440 0x7fbd1810bea0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7fbd0c004f60 tx=0x7fbd0c009b30).stop 2021-11-03T17:44:47.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.982+0000 7fbd1ca4f700 1 -- 172.21.15.26:0/23642865 shutdown_connections 2021-11-03T17:44:47.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.982+0000 7fbd1ca4f700 1 --2- 172.21.15.26:0/23642865 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbd00064100 0x7fbd000665c0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:47.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.982+0000 7fbd1ca4f700 1 --2- 172.21.15.26:0/23642865 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd180f5440 0x7fbd1810bea0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:47.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.982+0000 7fbd1ca4f700 1 --2- 172.21.15.26:0/23642865 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd180f66e0 0x7fbd1810e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:47.984 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.982+0000 7fbd1ca4f700 1 -- 172.21.15.26:0/23642865 >> 172.21.15.26:0/23642865 conn(0x7fbd180f0ba0 msgr2=0x7fbd180fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:44:47.984 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.983+0000 7fbd1ca4f700 1 -- 172.21.15.26:0/23642865 shutdown_connections 2021-11-03T17:44:47.984 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:47.983+0000 7fbd1ca4f700 1 -- 172.21.15.26:0/23642865 wait complete. 2021-11-03T17:44:48.078 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.081+0000 7ff26e43b700 1 -- 172.21.15.26:0/127077186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2680f6ae0 msgr2=0x7ff2680f6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:44:48.078 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.081+0000 7ff26e43b700 1 --2- 172.21.15.26:0/127077186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2680f6ae0 0x7ff2680f6f00 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7ff264004690 tx=0x7ff264009b30).stop 2021-11-03T17:44:48.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.081+0000 7ff26e43b700 1 -- 172.21.15.26:0/127077186 shutdown_connections 2021-11-03T17:44:48.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.081+0000 7ff26e43b700 1 --2- 172.21.15.26:0/127077186 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2680f73f0 0x7ff2680fde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:44:48.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.081+0000 7ff26e43b700 1 --2- 172.21.15.26:0/127077186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2680f6ae0 0x7ff2680f6f00 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:48.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.081+0000 7ff26e43b700 1 -- 172.21.15.26:0/127077186 >> 172.21.15.26:0/127077186 conn(0x7ff2680f0330 msgr2=0x7ff2680f2750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:44:48.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.082+0000 7ff26e43b700 1 -- 172.21.15.26:0/127077186 shutdown_connections 2021-11-03T17:44:48.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.082+0000 7ff26e43b700 1 -- 172.21.15.26:0/127077186 wait complete. 2021-11-03T17:44:48.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.082+0000 7ff26e43b700 1 Processor -- start 2021-11-03T17:44:48.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.082+0000 7ff26e43b700 1 -- start start 2021-11-03T17:44:48.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.082+0000 7ff26e43b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2680f6ae0 0x7ff268108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:44:48.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.082+0000 7ff26e43b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2680f73f0 0x7ff268109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:44:48.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.082+0000 7ff26e43b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff268109a50 con 0x7ff2680f73f0 2021-11-03T17:44:48.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.082+0000 7ff26e43b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26810a300 con 0x7ff2680f6ae0 2021-11-03T17:44:48.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.082+0000 7ff26cc38700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2680f73f0 0x7ff268109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:44:48.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.082+0000 7ff26cc38700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2680f73f0 0x7ff268109410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56146/0 (socket says 172.21.15.26:56146) 2021-11-03T17:44:48.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.082+0000 7ff26cc38700 1 -- 172.21.15.26:0/2728850993 learned_addr learned my addr 172.21.15.26:0/2728850993 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:44:48.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.083+0000 7ff26d439700 1 --2- 172.21.15.26:0/2728850993 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2680f6ae0 0x7ff268108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:44:48.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.083+0000 7ff26cc38700 1 -- 172.21.15.26:0/2728850993 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2680f6ae0 msgr2=0x7ff268108f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:44:48.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.083+0000 7ff26cc38700 1 --2- 172.21.15.26:0/2728850993 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2680f6ae0 0x7ff268108f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:48.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.083+0000 7ff26cc38700 1 -- 172.21.15.26:0/2728850993 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff264005040 con 0x7ff2680f73f0 2021-11-03T17:44:48.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.083+0000 7ff26d439700 1 --2- 172.21.15.26:0/2728850993 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2680f6ae0 0x7ff268108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:44:48.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.083+0000 7ff26cc38700 1 --2- 172.21.15.26:0/2728850993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2680f73f0 0x7ff268109410 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7ff25800b410 tx=0x7ff258006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:44:48.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.083+0000 7ff25dffb700 1 -- 172.21.15.26:0/2728850993 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2580125f0 con 0x7ff2680f73f0 2021-11-03T17:44:48.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.083+0000 7ff25dffb700 1 -- 172.21.15.26:0/2728850993 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff258012c00 con 0x7ff2680f73f0 2021-11-03T17:44:48.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.083+0000 7ff26e43b700 1 -- 172.21.15.26:0/2728850993 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff26810a5e0 con 0x7ff2680f73f0 2021-11-03T17:44:48.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.083+0000 7ff25dffb700 1 -- 172.21.15.26:0/2728850993 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff258002ae0 con 0x7ff2680f73f0 2021-11-03T17:44:48.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.083+0000 7ff26e43b700 1 -- 172.21.15.26:0/2728850993 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff26810ab20 con 0x7ff2680f73f0 2021-11-03T17:44:48.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.084+0000 7ff26e43b700 1 -- 172.21.15.26:0/2728850993 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff268059100 con 0x7ff2680f73f0 2021-11-03T17:44:48.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.085+0000 7ff25dffb700 1 -- 172.21.15.26:0/2728850993 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ff258012d70 con 0x7ff2680f73f0 2021-11-03T17:44:48.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.085+0000 7ff25dffb700 1 --2- 172.21.15.26:0/2728850993 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff254064100 0x7ff2540665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:44:48.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.085+0000 7ff25dffb700 1 -- 172.21.15.26:0/2728850993 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ff258081110 con 0x7ff2680f73f0 2021-11-03T17:44:48.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.086+0000 7ff26d439700 1 --2- 172.21.15.26:0/2728850993 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff254064100 0x7ff2540665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:44:48.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.086+0000 7ff26d439700 1 --2- 172.21.15.26:0/2728850993 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff254064100 0x7ff2540665c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7ff2640134c0 tx=0x7ff264009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:44:48.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.089+0000 7ff25dffb700 1 -- 172.21.15.26:0/2728850993 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ff2580533f0 con 0x7ff2680f73f0 2021-11-03T17:44:48.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.328+0000 7ff26e43b700 1 -- 172.21.15.26:0/2728850993 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff268045ad0 con 0x7ff2680f73f0 2021-11-03T17:44:48.323 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.328+0000 7ff25dffb700 1 -- 172.21.15.26:0/2728850993 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7ff258052fe0 con 0x7ff2680f73f0 2021-11-03T17:44:48.324 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:44:48.324 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:44:48.325 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:44:48.325 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:44:48.326 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:44:48.326 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:44:48.327 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:44:48.327 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:44:48.327 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:44:48.328 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:44:48.328 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:44:48.329 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:44:48.329 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:44:48.330 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:44:48.330 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:44:48.331 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:44:48.331 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:44:48.332 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:44:48.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.330+0000 7ff26e43b700 1 -- 172.21.15.26:0/2728850993 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff254064100 msgr2=0x7ff2540665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:44:48.334 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.330+0000 7ff26e43b700 1 --2- 172.21.15.26:0/2728850993 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff254064100 0x7ff2540665c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7ff2640134c0 tx=0x7ff264009b30).stop 2021-11-03T17:44:48.334 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.330+0000 7ff26e43b700 1 -- 172.21.15.26:0/2728850993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2680f73f0 msgr2=0x7ff268109410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:44:48.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.330+0000 7ff26e43b700 1 --2- 172.21.15.26:0/2728850993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2680f73f0 0x7ff268109410 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7ff25800b410 tx=0x7ff258006ef0).stop 2021-11-03T17:44:48.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.330+0000 7ff26e43b700 1 -- 172.21.15.26:0/2728850993 shutdown_connections 2021-11-03T17:44:48.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.330+0000 7ff26e43b700 1 --2- 172.21.15.26:0/2728850993 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff254064100 0x7ff2540665c0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:48.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.330+0000 7ff26e43b700 1 --2- 172.21.15.26:0/2728850993 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2680f6ae0 0x7ff268108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:48.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.330+0000 7ff26e43b700 1 --2- 172.21.15.26:0/2728850993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2680f73f0 0x7ff268109410 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:48.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.330+0000 7ff26e43b700 1 -- 172.21.15.26:0/2728850993 >> 172.21.15.26:0/2728850993 conn(0x7ff2680f0330 msgr2=0x7ff2680f2720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:44:48.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.330+0000 7ff26e43b700 1 -- 172.21.15.26:0/2728850993 shutdown_connections 2021-11-03T17:44:48.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.330+0000 7ff26e43b700 1 -- 172.21.15.26:0/2728850993 wait complete. 2021-11-03T17:44:48.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.431+0000 7fc70b59e700 1 -- 172.21.15.26:0/2377132615 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc70c0f77d0 msgr2=0x7fc70c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:44:48.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.431+0000 7fc70b59e700 1 --2- 172.21.15.26:0/2377132615 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc70c0f77d0 0x7fc70c0f7c30 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7fc6f4004660 tx=0x7fc6f4009b30).stop 2021-11-03T17:44:48.432 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.431+0000 7fc70b59e700 1 -- 172.21.15.26:0/2377132615 shutdown_connections 2021-11-03T17:44:48.432 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.431+0000 7fc70b59e700 1 --2- 172.21.15.26:0/2377132615 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc70c0f77d0 0x7fc70c0f7c30 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:48.433 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.431+0000 7fc70b59e700 1 --2- 172.21.15.26:0/2377132615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc70c0f6530 0x7fc70c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:48.433 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.431+0000 7fc70b59e700 1 -- 172.21.15.26:0/2377132615 >> 172.21.15.26:0/2377132615 conn(0x7fc70c0f1cd0 msgr2=0x7fc70c0f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:44:48.434 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.431+0000 7fc70b59e700 1 -- 172.21.15.26:0/2377132615 shutdown_connections 2021-11-03T17:44:48.434 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.431+0000 7fc70b59e700 1 -- 172.21.15.26:0/2377132615 wait complete. 2021-11-03T17:44:48.434 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.432+0000 7fc70b59e700 1 Processor -- start 2021-11-03T17:44:48.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.432+0000 7fc70b59e700 1 -- start start 2021-11-03T17:44:48.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.432+0000 7fc70b59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc70c0f6530 0x7fc70c106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:44:48.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.432+0000 7fc70b59e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc70c0f77d0 0x7fc70c107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:44:48.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.432+0000 7fc70b59e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c107870 con 0x7fc70c0f6530 2021-11-03T17:44:48.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.432+0000 7fc70b59e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c108080 con 0x7fc70c0f77d0 2021-11-03T17:44:48.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.432+0000 7fc70a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc70c0f6530 0x7fc70c106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:44:48.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.432+0000 7fc70a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc70c0f6530 0x7fc70c106d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56154/0 (socket says 172.21.15.26:56154) 2021-11-03T17:44:48.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.432+0000 7fc70a59c700 1 -- 172.21.15.26:0/2508603691 learned_addr learned my addr 172.21.15.26:0/2508603691 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:44:48.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.432+0000 7fc709d9b700 1 --2- 172.21.15.26:0/2508603691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc70c0f77d0 0x7fc70c107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:44:48.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.432+0000 7fc70a59c700 1 -- 172.21.15.26:0/2508603691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc70c0f77d0 msgr2=0x7fc70c107270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:44:48.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.433+0000 7fc70a59c700 1 --2- 172.21.15.26:0/2508603691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc70c0f77d0 0x7fc70c107270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:48.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.433+0000 7fc70a59c700 1 -- 172.21.15.26:0/2508603691 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f4005040 con 0x7fc70c0f6530 2021-11-03T17:44:48.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.433+0000 7fc709d9b700 1 --2- 172.21.15.26:0/2508603691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc70c0f77d0 0x7fc70c107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:44:48.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.433+0000 7fc70a59c700 1 --2- 172.21.15.26:0/2508603691 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc70c0f6530 0x7fc70c106d80 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7fc70400c710 tx=0x7fc704004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:44:48.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.433+0000 7fc702ffd700 1 -- 172.21.15.26:0/2508603691 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7040106f0 con 0x7fc70c0f6530 2021-11-03T17:44:48.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.433+0000 7fc702ffd700 1 -- 172.21.15.26:0/2508603691 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc704010d00 con 0x7fc70c0f6530 2021-11-03T17:44:48.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.433+0000 7fc70b59e700 1 -- 172.21.15.26:0/2508603691 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc70c108300 con 0x7fc70c0f6530 2021-11-03T17:44:48.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.433+0000 7fc702ffd700 1 -- 172.21.15.26:0/2508603691 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc704012d90 con 0x7fc70c0f6530 2021-11-03T17:44:48.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.433+0000 7fc70b59e700 1 -- 172.21.15.26:0/2508603691 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc70c1088c0 con 0x7fc70c0f6530 2021-11-03T17:44:48.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.434+0000 7fc70b59e700 1 -- 172.21.15.26:0/2508603691 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc70c059100 con 0x7fc70c0f6530 2021-11-03T17:44:48.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.434+0000 7fc702ffd700 1 -- 172.21.15.26:0/2508603691 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc704010070 con 0x7fc70c0f6530 2021-11-03T17:44:48.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.435+0000 7fc702ffd700 1 --2- 172.21.15.26:0/2508603691 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc6f8064100 0x7fc6f80665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:44:48.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.435+0000 7fc702ffd700 1 -- 172.21.15.26:0/2508603691 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc704080ce0 con 0x7fc70c0f6530 2021-11-03T17:44:48.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.435+0000 7fc709d9b700 1 --2- 172.21.15.26:0/2508603691 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc6f8064100 0x7fc6f80665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:44:48.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.435+0000 7fc709d9b700 1 --2- 172.21.15.26:0/2508603691 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc6f8064100 0x7fc6f80665c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7fc6f4009da0 tx=0x7fc6f4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:44:48.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.439+0000 7fc702ffd700 1 -- 172.21.15.26:0/2508603691 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc704052f50 con 0x7fc70c0f6530 2021-11-03T17:44:48.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.649+0000 7fc70b59e700 1 -- 172.21.15.26:0/2508603691 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc70c0fee80 con 0x7fc70c0f6530 2021-11-03T17:44:48.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.649+0000 7fc702ffd700 1 -- 172.21.15.26:0/2508603691 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fc70c0fee80 con 0x7fc70c0f6530 2021-11-03T17:44:48.645 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:44:48.645 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:44:48.645 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:44:48.646 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:44:48.646 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:44:48.646 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:44:48.646 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:44:48.647 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:44:48.647 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:44:48.647 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:44:48.647 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:44:48.648 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:44:48.648 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:44:48.648 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:44:48.649 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:44:48.649 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:44:48.649 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:44:48.649 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:44:48.650 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:44:48.650 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:44:48.650 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:44:48.650 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:44:48.650 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:44:48.651 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:44:48.651 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:44:48.651 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:44:48.651 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:44:48.652 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:44:48.652 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:44:48.652 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:44:48.652 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:44:48.653 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:44:48.653 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:44:48.653 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:44:48.653 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:44:48.653 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:44:48.654 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:44:48.654 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:44:48.654 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:44:48.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.651+0000 7fc70b59e700 1 -- 172.21.15.26:0/2508603691 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc6f8064100 msgr2=0x7fc6f80665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:44:48.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.651+0000 7fc70b59e700 1 --2- 172.21.15.26:0/2508603691 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc6f8064100 0x7fc6f80665c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7fc6f4009da0 tx=0x7fc6f4009b30).stop 2021-11-03T17:44:48.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.651+0000 7fc70b59e700 1 -- 172.21.15.26:0/2508603691 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc70c0f6530 msgr2=0x7fc70c106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:44:48.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.651+0000 7fc70b59e700 1 --2- 172.21.15.26:0/2508603691 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc70c0f6530 0x7fc70c106d80 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7fc70400c710 tx=0x7fc704004d10).stop 2021-11-03T17:44:48.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.651+0000 7fc70b59e700 1 -- 172.21.15.26:0/2508603691 shutdown_connections 2021-11-03T17:44:48.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.651+0000 7fc70b59e700 1 --2- 172.21.15.26:0/2508603691 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc6f8064100 0x7fc6f80665c0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:48.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.651+0000 7fc70b59e700 1 --2- 172.21.15.26:0/2508603691 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc70c0f6530 0x7fc70c106d80 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:48.658 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.651+0000 7fc70b59e700 1 --2- 172.21.15.26:0/2508603691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc70c0f77d0 0x7fc70c107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:44:48.658 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.651+0000 7fc70b59e700 1 -- 172.21.15.26:0/2508603691 >> 172.21.15.26:0/2508603691 conn(0x7fc70c0f1cd0 msgr2=0x7fc70c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:44:48.658 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.651+0000 7fc70b59e700 1 -- 172.21.15.26:0/2508603691 shutdown_connections 2021-11-03T17:44:48.660 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:44:48.651+0000 7fc70b59e700 1 -- 172.21.15.26:0/2508603691 wait complete. 2021-11-03T17:44:48.660 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:44:48.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:48 smithi026 ceph-mon[96795]: pgmap v1504: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:48 smithi026 ceph-mon[96795]: from='client.35692 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:44:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:44:48.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:44:48.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:48 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2728850993' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:44:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:48 smithi194 ceph-mon[65619]: pgmap v1504: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:48 smithi194 ceph-mon[65619]: from='client.35692 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:44:48.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:44:48.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:44:48.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:48 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2728850993' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:44:49.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:49 smithi026 ceph-mon[96795]: from='client.35696 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:44:49.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:49 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2508603691' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:44:49.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:49 smithi194 ceph-mon[65619]: from='client.35696 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:44:49.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:49 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2508603691' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:44:50.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:50 smithi026 ceph-mon[96795]: pgmap v1505: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:50.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:50 smithi194 ceph-mon[65619]: pgmap v1505: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:52.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:52 smithi026 ceph-mon[96795]: pgmap v1506: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:52.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:52 smithi194 ceph-mon[65619]: pgmap v1506: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:53.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:53 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:44:53.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:53 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:44:54.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:54 smithi026 ceph-mon[96795]: pgmap v1507: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:54.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:54 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:44:54.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:54 smithi194 ceph-mon[65619]: pgmap v1507: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:54.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:54 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:44:56.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:56 smithi026 ceph-mon[96795]: pgmap v1508: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:56.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:56 smithi194 ceph-mon[65619]: pgmap v1508: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:58.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:44:58 smithi026 ceph-mon[96795]: pgmap v1509: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:44:58.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:44:58 smithi194 ceph-mon[65619]: pgmap v1509: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:00.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:00 smithi026 ceph-mon[96795]: pgmap v1510: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:00.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:00 smithi194 ceph-mon[65619]: pgmap v1510: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:02.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:02 smithi026 ceph-mon[96795]: pgmap v1511: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:02.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:02 smithi194 ceph-mon[65619]: pgmap v1511: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:04.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:04 smithi026 ceph-mon[96795]: pgmap v1512: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:04.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:04 smithi194 ceph-mon[65619]: pgmap v1512: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:06.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:06 smithi026 ceph-mon[96795]: pgmap v1513: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:06.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:06 smithi194 ceph-mon[65619]: pgmap v1513: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:08.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:08 smithi026 ceph-mon[96795]: pgmap v1514: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:08.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:08 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:45:08.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:08 smithi194 ceph-mon[65619]: pgmap v1514: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:08.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:08 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:45:09.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:09 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:45:09.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:09 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:45:10.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:10 smithi026 ceph-mon[96795]: pgmap v1515: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:10.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:10 smithi194 ceph-mon[65619]: pgmap v1515: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:12.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:12 smithi026 ceph-mon[96795]: pgmap v1516: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:12.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:12 smithi194 ceph-mon[65619]: pgmap v1516: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:14.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:14 smithi026 ceph-mon[96795]: pgmap v1517: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:14.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:14 smithi194 ceph-mon[65619]: pgmap v1517: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:16.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:16 smithi026 ceph-mon[96795]: pgmap v1518: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:16.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:16 smithi194 ceph-mon[65619]: pgmap v1518: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:18.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:18 smithi026 ceph-mon[96795]: pgmap v1519: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:18.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:18 smithi194 ceph-mon[65619]: pgmap v1519: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:18.761 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.767+0000 7fccdf0a7700 1 -- 172.21.15.26:0/2795596365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccd80f55c0 msgr2=0x7fccd80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:45:18.761 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.767+0000 7fccdf0a7700 1 --2- 172.21.15.26:0/2795596365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccd80f55c0 0x7fccd80f59e0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7fcccc004660 tx=0x7fcccc009b30).stop 2021-11-03T17:45:18.761 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.767+0000 7fccdf0a7700 1 -- 172.21.15.26:0/2795596365 shutdown_connections 2021-11-03T17:45:18.762 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.767+0000 7fccdf0a7700 1 --2- 172.21.15.26:0/2795596365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccd80f5ed0 0x7fccd80f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:18.762 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.767+0000 7fccdf0a7700 1 --2- 172.21.15.26:0/2795596365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccd80f55c0 0x7fccd80f59e0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:18.762 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.767+0000 7fccdf0a7700 1 -- 172.21.15.26:0/2795596365 >> 172.21.15.26:0/2795596365 conn(0x7fccd80f0de0 msgr2=0x7fccd80f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:45:18.762 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.767+0000 7fccdf0a7700 1 -- 172.21.15.26:0/2795596365 shutdown_connections 2021-11-03T17:45:18.763 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.767+0000 7fccdf0a7700 1 -- 172.21.15.26:0/2795596365 wait complete. 2021-11-03T17:45:18.763 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.767+0000 7fccdf0a7700 1 Processor -- start 2021-11-03T17:45:18.763 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.767+0000 7fccdf0a7700 1 -- start start 2021-11-03T17:45:18.765 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.768+0000 7fccdf0a7700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccd80f55c0 0x7fccd8109bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:45:18.765 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.768+0000 7fccdf0a7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccd80f5ed0 0x7fccd810c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:45:18.766 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.768+0000 7fccdf0a7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd80604a0 con 0x7fccd80f5ed0 2021-11-03T17:45:18.766 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.768+0000 7fccdf0a7700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd80605e0 con 0x7fccd80f55c0 2021-11-03T17:45:18.766 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.768+0000 7fccd7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccd80f5ed0 0x7fccd810c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:45:18.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.768+0000 7fccd7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccd80f5ed0 0x7fccd810c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56174/0 (socket says 172.21.15.26:56174) 2021-11-03T17:45:18.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.768+0000 7fccd7fff700 1 -- 172.21.15.26:0/3847066991 learned_addr learned my addr 172.21.15.26:0/3847066991 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:45:18.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.768+0000 7fccdce43700 1 --2- 172.21.15.26:0/3847066991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccd80f55c0 0x7fccd8109bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:45:18.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.768+0000 7fccd7fff700 1 -- 172.21.15.26:0/3847066991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccd80f55c0 msgr2=0x7fccd8109bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:45:18.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.768+0000 7fccd7fff700 1 --2- 172.21.15.26:0/3847066991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccd80f55c0 0x7fccd8109bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:18.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.768+0000 7fccd7fff700 1 -- 172.21.15.26:0/3847066991 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcccc005040 con 0x7fccd80f5ed0 2021-11-03T17:45:18.770 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.768+0000 7fccd7fff700 1 --2- 172.21.15.26:0/3847066991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccd80f5ed0 0x7fccd810c0f0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7fccc400e7f0 tx=0x7fccc400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:45:18.770 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.768+0000 7fccd57fa700 1 -- 172.21.15.26:0/3847066991 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccc40092e0 con 0x7fccd80f5ed0 2021-11-03T17:45:18.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.769+0000 7fccd57fa700 1 -- 172.21.15.26:0/3847066991 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fccc400f040 con 0x7fccd80f5ed0 2021-11-03T17:45:18.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.769+0000 7fccdf0a7700 1 -- 172.21.15.26:0/3847066991 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccd810c6a0 con 0x7fccd80f5ed0 2021-11-03T17:45:18.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.769+0000 7fccd57fa700 1 -- 172.21.15.26:0/3847066991 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccc4014750 con 0x7fccd80f5ed0 2021-11-03T17:45:18.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.769+0000 7fccdf0a7700 1 -- 172.21.15.26:0/3847066991 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccd810cc30 con 0x7fccd80f5ed0 2021-11-03T17:45:18.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.770+0000 7fccdf0a7700 1 -- 172.21.15.26:0/3847066991 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccd80f4a50 con 0x7fccd80f5ed0 2021-11-03T17:45:18.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.770+0000 7fccd57fa700 1 -- 172.21.15.26:0/3847066991 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fccc401b030 con 0x7fccd80f5ed0 2021-11-03T17:45:18.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.770+0000 7fccd57fa700 1 --2- 172.21.15.26:0/3847066991 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fccc80640b0 0x7fccc8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:45:18.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.771+0000 7fccd57fa700 1 -- 172.21.15.26:0/3847066991 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fccc4080680 con 0x7fccd80f5ed0 2021-11-03T17:45:18.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.771+0000 7fccdce43700 1 --2- 172.21.15.26:0/3847066991 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fccc80640b0 0x7fccc8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:45:18.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.771+0000 7fccdce43700 1 --2- 172.21.15.26:0/3847066991 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fccc80640b0 0x7fccc8066570 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7fcccc004d80 tx=0x7fcccc016040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:45:18.774 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.775+0000 7fccd57fa700 1 -- 172.21.15.26:0/3847066991 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fccc40529a0 con 0x7fccd80f5ed0 2021-11-03T17:45:18.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.956+0000 7fccdf0a7700 1 -- 172.21.15.26:0/3847066991 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fccd80fdf30 con 0x7fccc80640b0 2021-11-03T17:45:18.950 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.957+0000 7fccd57fa700 1 -- 172.21.15.26:0/3847066991 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fccd80fdf30 con 0x7fccc80640b0 2021-11-03T17:45:18.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.959+0000 7fccdf0a7700 1 -- 172.21.15.26:0/3847066991 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fccc80640b0 msgr2=0x7fccc8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:45:18.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.959+0000 7fccdf0a7700 1 --2- 172.21.15.26:0/3847066991 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fccc80640b0 0x7fccc8066570 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7fcccc004d80 tx=0x7fcccc016040).stop 2021-11-03T17:45:18.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.959+0000 7fccdf0a7700 1 -- 172.21.15.26:0/3847066991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccd80f5ed0 msgr2=0x7fccd810c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:45:18.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.959+0000 7fccdf0a7700 1 --2- 172.21.15.26:0/3847066991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccd80f5ed0 0x7fccd810c0f0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7fccc400e7f0 tx=0x7fccc400b040).stop 2021-11-03T17:45:18.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.959+0000 7fccdf0a7700 1 -- 172.21.15.26:0/3847066991 shutdown_connections 2021-11-03T17:45:18.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.959+0000 7fccdf0a7700 1 --2- 172.21.15.26:0/3847066991 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fccc80640b0 0x7fccc8066570 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:18.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.959+0000 7fccdf0a7700 1 --2- 172.21.15.26:0/3847066991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccd80f55c0 0x7fccd8109bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:18.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.959+0000 7fccdf0a7700 1 --2- 172.21.15.26:0/3847066991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccd80f5ed0 0x7fccd810c0f0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:18.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.959+0000 7fccdf0a7700 1 -- 172.21.15.26:0/3847066991 >> 172.21.15.26:0/3847066991 conn(0x7fccd80f0de0 msgr2=0x7fccd80fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:45:18.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.959+0000 7fccdf0a7700 1 -- 172.21.15.26:0/3847066991 shutdown_connections 2021-11-03T17:45:18.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:18.959+0000 7fccdf0a7700 1 -- 172.21.15.26:0/3847066991 wait complete. 2021-11-03T17:45:18.962 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:45:19.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.059+0000 7feb907fa700 1 -- 172.21.15.26:0/2679808488 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb880f6860 msgr2=0x7feb880f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:45:19.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.059+0000 7feb907fa700 1 --2- 172.21.15.26:0/2679808488 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb880f6860 0x7feb880f6cc0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7feb7c004660 tx=0x7feb7c009b30).stop 2021-11-03T17:45:19.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.059+0000 7feb907fa700 1 -- 172.21.15.26:0/2679808488 shutdown_connections 2021-11-03T17:45:19.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.059+0000 7feb907fa700 1 --2- 172.21.15.26:0/2679808488 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb880f6860 0x7feb880f6cc0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:19.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.059+0000 7feb907fa700 1 --2- 172.21.15.26:0/2679808488 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb880f55c0 0x7feb880f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:45:19.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.059+0000 7feb907fa700 1 -- 172.21.15.26:0/2679808488 >> 172.21.15.26:0/2679808488 conn(0x7feb880f0d40 msgr2=0x7feb880f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:45:19.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.059+0000 7feb907fa700 1 -- 172.21.15.26:0/2679808488 shutdown_connections 2021-11-03T17:45:19.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.059+0000 7feb907fa700 1 -- 172.21.15.26:0/2679808488 wait complete. 2021-11-03T17:45:19.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.059+0000 7feb907fa700 1 Processor -- start 2021-11-03T17:45:19.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.059+0000 7feb907fa700 1 -- start start 2021-11-03T17:45:19.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.059+0000 7feb907fa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb880f55c0 0x7feb88109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:45:19.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.059+0000 7feb907fa700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb880f6860 0x7feb8810c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:45:19.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.059+0000 7feb907fa700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb88060570 con 0x7feb880f55c0 2021-11-03T17:45:19.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.059+0000 7feb907fa700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb880606b0 con 0x7feb880f6860 2021-11-03T17:45:19.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.060+0000 7feb8e596700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb880f55c0 0x7feb88109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:45:19.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.060+0000 7feb8e596700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb880f55c0 0x7feb88109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56182/0 (socket says 172.21.15.26:56182) 2021-11-03T17:45:19.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.060+0000 7feb8e596700 1 -- 172.21.15.26:0/464010173 learned_addr learned my addr 172.21.15.26:0/464010173 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:45:19.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.060+0000 7feb8dd95700 1 --2- 172.21.15.26:0/464010173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb880f6860 0x7feb8810c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:45:19.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.060+0000 7feb8e596700 1 -- 172.21.15.26:0/464010173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb880f6860 msgr2=0x7feb8810c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:45:19.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.060+0000 7feb8e596700 1 --2- 172.21.15.26:0/464010173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb880f6860 0x7feb8810c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:19.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.060+0000 7feb8e596700 1 -- 172.21.15.26:0/464010173 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb7c005040 con 0x7feb880f55c0 2021-11-03T17:45:19.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.060+0000 7feb8dd95700 1 --2- 172.21.15.26:0/464010173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb880f6860 0x7feb8810c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:45:19.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.060+0000 7feb8e596700 1 --2- 172.21.15.26:0/464010173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb880f55c0 0x7feb88109c90 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7feb8000b790 tx=0x7feb800092b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:45:19.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.060+0000 7feb86ffd700 1 -- 172.21.15.26:0/464010173 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb8000d700 con 0x7feb880f55c0 2021-11-03T17:45:19.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.060+0000 7feb86ffd700 1 -- 172.21.15.26:0/464010173 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7feb8000dd10 con 0x7feb880f55c0 2021-11-03T17:45:19.065 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.060+0000 7feb86ffd700 1 -- 172.21.15.26:0/464010173 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb80010e60 con 0x7feb880f55c0 2021-11-03T17:45:19.065 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.060+0000 7feb907fa700 1 -- 172.21.15.26:0/464010173 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb8810c7f0 con 0x7feb880f55c0 2021-11-03T17:45:19.066 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.060+0000 7feb907fa700 1 -- 172.21.15.26:0/464010173 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb8810cd80 con 0x7feb880f55c0 2021-11-03T17:45:19.066 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.061+0000 7feb907fa700 1 -- 172.21.15.26:0/464010173 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb880f49b0 con 0x7feb880f55c0 2021-11-03T17:45:19.066 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.061+0000 7feb86ffd700 1 -- 172.21.15.26:0/464010173 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7feb80010670 con 0x7feb880f55c0 2021-11-03T17:45:19.066 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.062+0000 7feb86ffd700 1 --2- 172.21.15.26:0/464010173 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7feb700640b0 0x7feb70066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:45:19.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.062+0000 7feb86ffd700 1 -- 172.21.15.26:0/464010173 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7feb80080bd0 con 0x7feb880f55c0 2021-11-03T17:45:19.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.062+0000 7feb8dd95700 1 --2- 172.21.15.26:0/464010173 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7feb700640b0 0x7feb70066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:45:19.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.062+0000 7feb8dd95700 1 --2- 172.21.15.26:0/464010173 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7feb700640b0 0x7feb70066570 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7feb7c004e30 tx=0x7feb7c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:45:19.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.066+0000 7feb86ffd700 1 -- 172.21.15.26:0/464010173 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7feb80052e40 con 0x7feb880f55c0 2021-11-03T17:45:19.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.239+0000 7feb907fa700 1 -- 172.21.15.26:0/464010173 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7feb880fdf00 con 0x7feb700640b0 2021-11-03T17:45:19.247 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.253+0000 7feb86ffd700 1 -- 172.21.15.26:0/464010173 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7feb880fdf00 con 0x7feb700640b0 2021-11-03T17:45:19.248 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:45:19.248 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (56m) 6m ago 57m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:45:19.249 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (48m) 6m ago 57m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:45:19.249 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (48m) 4m ago 57m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:45:19.249 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (56m) 6m ago 57m 40.8M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:45:19.250 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (49m) 6m ago 52m 25.1M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:45:19.250 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (49m) 6m ago 52m 25.7M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:45:19.250 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (53m) 4m ago 52m 26.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:45:19.251 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (52m) 4m ago 52m 26.3M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:45:19.251 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (50m) 6m ago 59m 533M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:45:19.251 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (49m) 4m ago 56m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:45:19.251 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (49m) 6m ago 59m 209M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:45:19.251 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (49m) 4m ago 56m 103M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:45:19.252 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (57m) 6m ago 57m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:45:19.252 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (56m) 4m ago 56m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:45:19.252 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (48m) 6m ago 56m 251M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:45:19.252 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (47m) 6m ago 55m 270M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:45:19.253 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (47m) 6m ago 55m 225M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:45:19.253 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (46m) 4m ago 55m 287M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:45:19.253 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (46m) 4m ago 54m 246M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:45:19.253 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (45m) 4m ago 54m 235M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:45:19.253 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (56m) 6m ago 57m 56.7M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:45:19.254 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.255+0000 7feb907fa700 1 -- 172.21.15.26:0/464010173 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7feb700640b0 msgr2=0x7feb70066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:45:19.255 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.255+0000 7feb907fa700 1 --2- 172.21.15.26:0/464010173 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7feb700640b0 0x7feb70066570 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7feb7c004e30 tx=0x7feb7c009b30).stop 2021-11-03T17:45:19.255 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.255+0000 7feb907fa700 1 -- 172.21.15.26:0/464010173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb880f55c0 msgr2=0x7feb88109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:45:19.255 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.255+0000 7feb907fa700 1 --2- 172.21.15.26:0/464010173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb880f55c0 0x7feb88109c90 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7feb8000b790 tx=0x7feb800092b0).stop 2021-11-03T17:45:19.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.255+0000 7feb907fa700 1 -- 172.21.15.26:0/464010173 shutdown_connections 2021-11-03T17:45:19.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.255+0000 7feb907fa700 1 --2- 172.21.15.26:0/464010173 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7feb700640b0 0x7feb70066570 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:19.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.255+0000 7feb907fa700 1 --2- 172.21.15.26:0/464010173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb880f55c0 0x7feb88109c90 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:19.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.255+0000 7feb907fa700 1 --2- 172.21.15.26:0/464010173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb880f6860 0x7feb8810c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:19.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.255+0000 7feb907fa700 1 -- 172.21.15.26:0/464010173 >> 172.21.15.26:0/464010173 conn(0x7feb880f0d40 msgr2=0x7feb880fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:45:19.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.255+0000 7feb907fa700 1 -- 172.21.15.26:0/464010173 shutdown_connections 2021-11-03T17:45:19.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.255+0000 7feb907fa700 1 -- 172.21.15.26:0/464010173 wait complete. 2021-11-03T17:45:19.350 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.354+0000 7ff13f59e700 1 -- 172.21.15.26:0/1941543276 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff140060290 msgr2=0x7ff1400f91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:45:19.350 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.354+0000 7ff13f59e700 1 --2- 172.21.15.26:0/1941543276 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff140060290 0x7ff1400f91a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7ff130004660 tx=0x7ff130009b30).stop 2021-11-03T17:45:19.350 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.354+0000 7ff13f59e700 1 -- 172.21.15.26:0/1941543276 shutdown_connections 2021-11-03T17:45:19.350 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.354+0000 7ff13f59e700 1 --2- 172.21.15.26:0/1941543276 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1400f9720 0x7ff1400fbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:45:19.351 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.354+0000 7ff13f59e700 1 --2- 172.21.15.26:0/1941543276 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff140060290 0x7ff1400f91a0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:19.351 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.354+0000 7ff13f59e700 1 -- 172.21.15.26:0/1941543276 >> 172.21.15.26:0/1941543276 conn(0x7ff1400f0ba0 msgr2=0x7ff1400f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:45:19.351 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.355+0000 7ff13f59e700 1 -- 172.21.15.26:0/1941543276 shutdown_connections 2021-11-03T17:45:19.351 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.355+0000 7ff13f59e700 1 -- 172.21.15.26:0/1941543276 wait complete. 2021-11-03T17:45:19.351 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.355+0000 7ff13f59e700 1 Processor -- start 2021-11-03T17:45:19.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.355+0000 7ff13f59e700 1 -- start start 2021-11-03T17:45:19.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.355+0000 7ff13f59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff140060290 0x7ff1400f6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:45:19.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.355+0000 7ff13f59e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1400f9720 0x7ff1400f50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:45:19.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.355+0000 7ff13f59e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1400f5690 con 0x7ff140060290 2021-11-03T17:45:19.353 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.355+0000 7ff13f59e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1400f57d0 con 0x7ff1400f9720 2021-11-03T17:45:19.353 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.355+0000 7ff13e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff140060290 0x7ff1400f6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:45:19.353 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.355+0000 7ff13e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff140060290 0x7ff1400f6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56192/0 (socket says 172.21.15.26:56192) 2021-11-03T17:45:19.353 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.355+0000 7ff13e59c700 1 -- 172.21.15.26:0/2804445670 learned_addr learned my addr 172.21.15.26:0/2804445670 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:45:19.354 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.356+0000 7ff13e59c700 1 -- 172.21.15.26:0/2804445670 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1400f9720 msgr2=0x7ff1400f50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:45:19.354 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.356+0000 7ff13e59c700 1 --2- 172.21.15.26:0/2804445670 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1400f9720 0x7ff1400f50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:45:19.354 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.356+0000 7ff13e59c700 1 -- 172.21.15.26:0/2804445670 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff130005040 con 0x7ff140060290 2021-11-03T17:45:19.354 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.356+0000 7ff13e59c700 1 --2- 172.21.15.26:0/2804445670 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff140060290 0x7ff1400f6c20 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7ff130009990 tx=0x7ff130009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:45:19.355 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.356+0000 7ff12effd700 1 -- 172.21.15.26:0/2804445670 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff130018070 con 0x7ff140060290 2021-11-03T17:45:19.355 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.356+0000 7ff12effd700 1 -- 172.21.15.26:0/2804445670 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff130007ca0 con 0x7ff140060290 2021-11-03T17:45:19.355 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.356+0000 7ff13f59e700 1 -- 172.21.15.26:0/2804445670 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1400f5a50 con 0x7ff140060290 2021-11-03T17:45:19.355 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.356+0000 7ff12effd700 1 -- 172.21.15.26:0/2804445670 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff13001c620 con 0x7ff140060290 2021-11-03T17:45:19.355 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.356+0000 7ff13f59e700 1 -- 172.21.15.26:0/2804445670 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff14010ed90 con 0x7ff140060290 2021-11-03T17:45:19.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.357+0000 7ff13f59e700 1 -- 172.21.15.26:0/2804445670 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff140045ad0 con 0x7ff140060290 2021-11-03T17:45:19.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.357+0000 7ff12effd700 1 -- 172.21.15.26:0/2804445670 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ff13001d960 con 0x7ff140060290 2021-11-03T17:45:19.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.358+0000 7ff12effd700 1 --2- 172.21.15.26:0/2804445670 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff128064100 0x7ff1280665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:45:19.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.358+0000 7ff12effd700 1 -- 172.21.15.26:0/2804445670 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ff130082540 con 0x7ff140060290 2021-11-03T17:45:19.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.358+0000 7ff13dd9b700 1 --2- 172.21.15.26:0/2804445670 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff128064100 0x7ff1280665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:45:19.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.358+0000 7ff13dd9b700 1 --2- 172.21.15.26:0/2804445670 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff128064100 0x7ff1280665c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7ff140060060 tx=0x7ff134006b50).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:45:19.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.362+0000 7ff12effd700 1 -- 172.21.15.26:0/2804445670 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ff130054960 con 0x7ff140060290 2021-11-03T17:45:19.588 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.594+0000 7ff13f59e700 1 -- 172.21.15.26:0/2804445670 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff1400fee40 con 0x7ff140060290 2021-11-03T17:45:19.590 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.594+0000 7ff12effd700 1 -- 172.21.15.26:0/2804445670 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7ff130054550 con 0x7ff140060290 2021-11-03T17:45:19.591 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:45:19.591 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:45:19.592 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:45:19.592 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:45:19.592 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:45:19.592 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:45:19.592 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:45:19.593 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:45:19.593 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:45:19.593 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:45:19.593 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:45:19.593 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:45:19.594 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:45:19.594 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:45:19.594 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:45:19.595 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:45:19.595 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:45:19.595 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:45:19.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.596+0000 7ff13f59e700 1 -- 172.21.15.26:0/2804445670 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff128064100 msgr2=0x7ff1280665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:45:19.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.596+0000 7ff13f59e700 1 --2- 172.21.15.26:0/2804445670 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff128064100 0x7ff1280665c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7ff140060060 tx=0x7ff134006b50).stop 2021-11-03T17:45:19.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.596+0000 7ff13f59e700 1 -- 172.21.15.26:0/2804445670 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff140060290 msgr2=0x7ff1400f6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:45:19.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.596+0000 7ff13f59e700 1 --2- 172.21.15.26:0/2804445670 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff140060290 0x7ff1400f6c20 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7ff130009990 tx=0x7ff130009b30).stop 2021-11-03T17:45:19.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.596+0000 7ff13f59e700 1 -- 172.21.15.26:0/2804445670 shutdown_connections 2021-11-03T17:45:19.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.596+0000 7ff13f59e700 1 --2- 172.21.15.26:0/2804445670 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff128064100 0x7ff1280665c0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:19.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.596+0000 7ff13f59e700 1 --2- 172.21.15.26:0/2804445670 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff140060290 0x7ff1400f6c20 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:19.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.596+0000 7ff13f59e700 1 --2- 172.21.15.26:0/2804445670 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1400f9720 0x7ff1400f50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:45:19.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.596+0000 7ff13f59e700 1 -- 172.21.15.26:0/2804445670 >> 172.21.15.26:0/2804445670 conn(0x7ff1400f0ba0 msgr2=0x7ff1400f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:45:19.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.596+0000 7ff13f59e700 1 -- 172.21.15.26:0/2804445670 shutdown_connections 2021-11-03T17:45:19.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.596+0000 7ff13f59e700 1 -- 172.21.15.26:0/2804445670 wait complete. 2021-11-03T17:45:19.692 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.696+0000 7fc65d901700 1 -- 172.21.15.26:0/1918778781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6580f55c0 msgr2=0x7fc6580f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:45:19.692 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.696+0000 7fc65d901700 1 --2- 172.21.15.26:0/1918778781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6580f55c0 0x7fc6580f59e0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7fc648004660 tx=0x7fc648009b30).stop 2021-11-03T17:45:19.693 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.696+0000 7fc65d901700 1 -- 172.21.15.26:0/1918778781 shutdown_connections 2021-11-03T17:45:19.693 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.696+0000 7fc65d901700 1 --2- 172.21.15.26:0/1918778781 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6580f6860 0x7fc6580f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:19.693 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.696+0000 7fc65d901700 1 --2- 172.21.15.26:0/1918778781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6580f55c0 0x7fc6580f59e0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:19.694 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.696+0000 7fc65d901700 1 -- 172.21.15.26:0/1918778781 >> 172.21.15.26:0/1918778781 conn(0x7fc6580f0d40 msgr2=0x7fc6580f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:45:19.694 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.696+0000 7fc65d901700 1 -- 172.21.15.26:0/1918778781 shutdown_connections 2021-11-03T17:45:19.694 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.696+0000 7fc65d901700 1 -- 172.21.15.26:0/1918778781 wait complete. 2021-11-03T17:45:19.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.697+0000 7fc65d901700 1 Processor -- start 2021-11-03T17:45:19.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.697+0000 7fc65d901700 1 -- start start 2021-11-03T17:45:19.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.697+0000 7fc65d901700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6580f55c0 0x7fc658106fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:45:19.696 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.697+0000 7fc65d901700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6580f6860 0x7fc6581074c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:45:19.696 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.697+0000 7fc65d901700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc658107a70 con 0x7fc6580f6860 2021-11-03T17:45:19.696 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.697+0000 7fc65d901700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc658107bb0 con 0x7fc6580f55c0 2021-11-03T17:45:19.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.697+0000 7fc6567fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6580f6860 0x7fc6581074c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:45:19.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.697+0000 7fc6567fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6580f6860 0x7fc6581074c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56204/0 (socket says 172.21.15.26:56204) 2021-11-03T17:45:19.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.697+0000 7fc6567fc700 1 -- 172.21.15.26:0/1560876070 learned_addr learned my addr 172.21.15.26:0/1560876070 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:45:19.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.697+0000 7fc656ffd700 1 --2- 172.21.15.26:0/1560876070 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6580f55c0 0x7fc658106fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:45:19.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.697+0000 7fc6567fc700 1 -- 172.21.15.26:0/1560876070 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6580f55c0 msgr2=0x7fc658106fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:45:19.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.697+0000 7fc6567fc700 1 --2- 172.21.15.26:0/1560876070 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6580f55c0 0x7fc658106fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:19.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.697+0000 7fc6567fc700 1 -- 172.21.15.26:0/1560876070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc648005040 con 0x7fc6580f6860 2021-11-03T17:45:19.699 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.698+0000 7fc6567fc700 1 --2- 172.21.15.26:0/1560876070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6580f6860 0x7fc6581074c0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7fc64c0026d0 tx=0x7fc64c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:45:19.699 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.698+0000 7fc63f7fe700 1 -- 172.21.15.26:0/1560876070 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc64c0079c0 con 0x7fc6580f6860 2021-11-03T17:45:19.700 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.698+0000 7fc63f7fe700 1 -- 172.21.15.26:0/1560876070 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc64c00f040 con 0x7fc6580f6860 2021-11-03T17:45:19.700 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.698+0000 7fc65d901700 1 -- 172.21.15.26:0/1560876070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc658108550 con 0x7fc6580f6860 2021-11-03T17:45:19.700 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.698+0000 7fc63f7fe700 1 -- 172.21.15.26:0/1560876070 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc64c0148b0 con 0x7fc6580f6860 2021-11-03T17:45:19.701 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.698+0000 7fc65d901700 1 -- 172.21.15.26:0/1560876070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc658108b10 con 0x7fc6580f6860 2021-11-03T17:45:19.702 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.699+0000 7fc65d901700 1 -- 172.21.15.26:0/1560876070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc658045ad0 con 0x7fc6580f6860 2021-11-03T17:45:19.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.699+0000 7fc63f7fe700 1 -- 172.21.15.26:0/1560876070 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc64c007b20 con 0x7fc6580f6860 2021-11-03T17:45:19.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.699+0000 7fc63f7fe700 1 --2- 172.21.15.26:0/1560876070 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc6400640b0 0x7fc640066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:45:19.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.700+0000 7fc63f7fe700 1 -- 172.21.15.26:0/1560876070 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc64c080660 con 0x7fc6580f6860 2021-11-03T17:45:19.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.700+0000 7fc656ffd700 1 --2- 172.21.15.26:0/1560876070 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc6400640b0 0x7fc640066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:45:19.704 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.700+0000 7fc656ffd700 1 --2- 172.21.15.26:0/1560876070 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc6400640b0 0x7fc640066570 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fc648004630 tx=0x7fc648009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:45:19.704 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.704+0000 7fc63f7fe700 1 -- 172.21.15.26:0/1560876070 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc64c0529c0 con 0x7fc6580f6860 2021-11-03T17:45:19.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.905+0000 7fc65d901700 1 -- 172.21.15.26:0/1560876070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc658109200 con 0x7fc6580f6860 2021-11-03T17:45:19.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.906+0000 7fc63f7fe700 1 -- 172.21.15.26:0/1560876070 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fc64c0525b0 con 0x7fc6580f6860 2021-11-03T17:45:19.900 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:45:19.901 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:45:19.901 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:45:19.901 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:45:19.901 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:45:19.902 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:45:19.902 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:45:19.902 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:45:19.902 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:45:19.903 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:45:19.903 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:45:19.903 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:45:19.903 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:45:19.904 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:45:19.904 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:45:19.904 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:45:19.904 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:45:19.904 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:45:19.905 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:45:19.905 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:45:19.906 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:45:19.906 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:45:19.906 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:45:19.906 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:45:19.906 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:45:19.907 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:45:19.907 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:45:19.907 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:45:19.907 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:45:19.908 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:45:19.908 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:45:19.908 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:45:19.908 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:45:19.908 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:45:19.909 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:45:19.909 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:45:19.909 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:45:19.910 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:45:19.910 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:45:19.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.907+0000 7fc65d901700 1 -- 172.21.15.26:0/1560876070 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc6400640b0 msgr2=0x7fc640066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:45:19.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.907+0000 7fc65d901700 1 --2- 172.21.15.26:0/1560876070 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc6400640b0 0x7fc640066570 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fc648004630 tx=0x7fc648009b30).stop 2021-11-03T17:45:19.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.907+0000 7fc65d901700 1 -- 172.21.15.26:0/1560876070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6580f6860 msgr2=0x7fc6581074c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:45:19.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.907+0000 7fc65d901700 1 --2- 172.21.15.26:0/1560876070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6580f6860 0x7fc6581074c0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7fc64c0026d0 tx=0x7fc64c009de0).stop 2021-11-03T17:45:19.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.907+0000 7fc65d901700 1 -- 172.21.15.26:0/1560876070 shutdown_connections 2021-11-03T17:45:19.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.907+0000 7fc65d901700 1 --2- 172.21.15.26:0/1560876070 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc6400640b0 0x7fc640066570 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:19.913 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.907+0000 7fc65d901700 1 --2- 172.21.15.26:0/1560876070 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6580f55c0 0x7fc658106fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:19.913 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.907+0000 7fc65d901700 1 --2- 172.21.15.26:0/1560876070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6580f6860 0x7fc6581074c0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:19.913 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.907+0000 7fc65d901700 1 -- 172.21.15.26:0/1560876070 >> 172.21.15.26:0/1560876070 conn(0x7fc6580f0d40 msgr2=0x7fc65805f740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:45:19.913 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.908+0000 7fc65d901700 1 -- 172.21.15.26:0/1560876070 shutdown_connections 2021-11-03T17:45:19.913 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:19.908+0000 7fc65d901700 1 -- 172.21.15.26:0/1560876070 wait complete. 2021-11-03T17:45:19.914 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:45:20.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:20 smithi026 ceph-mon[96795]: from='client.35708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:45:20.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:20 smithi026 ceph-mon[96795]: pgmap v1520: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:20.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:20 smithi026 ceph-mon[96795]: from='client.35712 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:45:20.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:20 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2804445670' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:45:20.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:20 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1560876070' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:45:20.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:20 smithi194 ceph-mon[65619]: from='client.35708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:45:20.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:20 smithi194 ceph-mon[65619]: pgmap v1520: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:20.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:20 smithi194 ceph-mon[65619]: from='client.35712 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:45:20.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:20 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2804445670' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:45:20.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:20 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1560876070' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:45:22.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:22 smithi026 ceph-mon[96795]: pgmap v1521: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:22.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:22 smithi194 ceph-mon[65619]: pgmap v1521: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:23.610 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:23 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:45:23.613 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:23 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:45:24.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:24 smithi026 ceph-mon[96795]: pgmap v1522: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:24.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:24 smithi026 ceph-mon[96795]: poll took 60073.610 ms: 1 events 2021-11-03T17:45:24.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:45:24.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:45:24.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:45:24.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:45:24.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:45:24.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:45:24.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:24 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:45:24.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:45:24.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:24 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:45:24.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:24 smithi194 ceph-mon[65619]: pgmap v1522: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:24.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:24 smithi194 ceph-mon[65619]: poll took 60073.610 ms: 1 events 2021-11-03T17:45:24.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:45:24.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:45:24.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:45:24.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:45:24.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:45:24.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:45:24.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:24 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:45:24.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:45:24.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:24 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:45:26.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:26 smithi026 ceph-mon[96795]: pgmap v1523: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:26.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:26 smithi194 ceph-mon[65619]: pgmap v1523: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:28.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:28 smithi026 ceph-mon[96795]: pgmap v1524: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:28.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:28 smithi194 ceph-mon[65619]: pgmap v1524: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:30.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:30 smithi026 ceph-mon[96795]: pgmap v1525: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:30.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:30 smithi194 ceph-mon[65619]: pgmap v1525: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:32.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:32 smithi026 ceph-mon[96795]: pgmap v1526: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:32.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:32 smithi194 ceph-mon[65619]: pgmap v1526: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:34.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:34 smithi026 ceph-mon[96795]: pgmap v1527: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:34.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:34 smithi194 ceph-mon[65619]: pgmap v1527: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:36.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:36 smithi026 ceph-mon[96795]: pgmap v1528: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:36.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:36 smithi194 ceph-mon[65619]: pgmap v1528: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:38.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:38 smithi026 ceph-mon[96795]: pgmap v1529: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:38.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:38 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:45:38.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:38 smithi194 ceph-mon[65619]: pgmap v1529: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:38.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:38 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:45:39.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:39 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:45:39.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:39 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:45:40.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:40 smithi026 ceph-mon[96795]: pgmap v1530: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:40.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:40 smithi194 ceph-mon[65619]: pgmap v1530: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:42.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:42 smithi026 ceph-mon[96795]: pgmap v1531: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:42.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:42 smithi194 ceph-mon[65619]: pgmap v1531: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:44.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:44 smithi026 ceph-mon[96795]: pgmap v1532: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:44.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:44 smithi194 ceph-mon[65619]: pgmap v1532: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:46.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:46 smithi026 ceph-mon[96795]: pgmap v1533: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:46.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:46 smithi194 ceph-mon[65619]: pgmap v1533: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:48.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:48 smithi026 ceph-mon[96795]: pgmap v1534: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:48.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:45:48.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:45:48.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:48 smithi194 ceph-mon[65619]: pgmap v1534: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:48.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:45:48.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:45:50.019 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.022+0000 7fbcfc6bd700 1 -- 172.21.15.26:0/1940467738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbcf40f6ff0 msgr2=0x7fbcf40f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:45:50.019 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.022+0000 7fbcfc6bd700 1 --2- 172.21.15.26:0/1940467738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbcf40f6ff0 0x7fbcf40f7a20 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7fbcf0004660 tx=0x7fbcf0009b30).stop 2021-11-03T17:45:50.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.022+0000 7fbcfc6bd700 1 -- 172.21.15.26:0/1940467738 shutdown_connections 2021-11-03T17:45:50.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.022+0000 7fbcfc6bd700 1 --2- 172.21.15.26:0/1940467738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbcf40f6ff0 0x7fbcf40f7a20 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:50.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.022+0000 7fbcfc6bd700 1 --2- 172.21.15.26:0/1940467738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbcf40f66e0 0x7fbcf40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:50.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.022+0000 7fbcfc6bd700 1 -- 172.21.15.26:0/1940467738 >> 172.21.15.26:0/1940467738 conn(0x7fbcf40f1f00 msgr2=0x7fbcf40f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:45:50.021 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.022+0000 7fbcfc6bd700 1 -- 172.21.15.26:0/1940467738 shutdown_connections 2021-11-03T17:45:50.021 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.022+0000 7fbcfc6bd700 1 -- 172.21.15.26:0/1940467738 wait complete. 2021-11-03T17:45:50.021 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.022+0000 7fbcfc6bd700 1 Processor -- start 2021-11-03T17:45:50.021 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.022+0000 7fbcfc6bd700 1 -- start start 2021-11-03T17:45:50.022 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.022+0000 7fbcfc6bd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbcf40f66e0 0x7fbcf4106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:45:50.022 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.023+0000 7fbcfc6bd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbcf40f6ff0 0x7fbcf4107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:45:50.022 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.023+0000 7fbcfc6bd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf4107a10 con 0x7fbcf40f66e0 2021-11-03T17:45:50.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.023+0000 7fbcfc6bd700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf4107b50 con 0x7fbcf40f6ff0 2021-11-03T17:45:50.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.023+0000 7fbcfa459700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbcf40f66e0 0x7fbcf4106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:45:50.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.023+0000 7fbcfa459700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbcf40f66e0 0x7fbcf4106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56220/0 (socket says 172.21.15.26:56220) 2021-11-03T17:45:50.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.023+0000 7fbcfa459700 1 -- 172.21.15.26:0/1770609084 learned_addr learned my addr 172.21.15.26:0/1770609084 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:45:50.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.023+0000 7fbcf9c58700 1 --2- 172.21.15.26:0/1770609084 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbcf40f6ff0 0x7fbcf4107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:45:50.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.023+0000 7fbcfa459700 1 -- 172.21.15.26:0/1770609084 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbcf40f6ff0 msgr2=0x7fbcf4107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:45:50.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.023+0000 7fbcfa459700 1 --2- 172.21.15.26:0/1770609084 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbcf40f6ff0 0x7fbcf4107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:50.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.023+0000 7fbcfa459700 1 -- 172.21.15.26:0/1770609084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf0005040 con 0x7fbcf40f66e0 2021-11-03T17:45:50.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.023+0000 7fbcfa459700 1 --2- 172.21.15.26:0/1770609084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbcf40f66e0 0x7fbcf4106f70 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 rx=0x7fbce40026d0 tx=0x7fbce4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:45:50.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.023+0000 7fbceaffd700 1 -- 172.21.15.26:0/1770609084 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbce4009320 con 0x7fbcf40f66e0 2021-11-03T17:45:50.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.023+0000 7fbceaffd700 1 -- 172.21.15.26:0/1770609084 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbce400f040 con 0x7fbcf40f66e0 2021-11-03T17:45:50.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.023+0000 7fbcfc6bd700 1 -- 172.21.15.26:0/1770609084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcf41084f0 con 0x7fbcf40f66e0 2021-11-03T17:45:50.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.023+0000 7fbceaffd700 1 -- 172.21.15.26:0/1770609084 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbce40147e0 con 0x7fbcf40f66e0 2021-11-03T17:45:50.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.023+0000 7fbcfc6bd700 1 -- 172.21.15.26:0/1770609084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcf4108ab0 con 0x7fbcf40f66e0 2021-11-03T17:45:50.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.025+0000 7fbcfc6bd700 1 -- 172.21.15.26:0/1770609084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcf4045ad0 con 0x7fbcf40f66e0 2021-11-03T17:45:50.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.026+0000 7fbceaffd700 1 -- 172.21.15.26:0/1770609084 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fbce4009480 con 0x7fbcf40f66e0 2021-11-03T17:45:50.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.026+0000 7fbceaffd700 1 --2- 172.21.15.26:0/1770609084 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbce00640b0 0x7fbce0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:45:50.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.026+0000 7fbceaffd700 1 -- 172.21.15.26:0/1770609084 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fbce4080df0 con 0x7fbcf40f66e0 2021-11-03T17:45:50.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.026+0000 7fbcf9c58700 1 --2- 172.21.15.26:0/1770609084 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbce00640b0 0x7fbce0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:45:50.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.027+0000 7fbcf9c58700 1 --2- 172.21.15.26:0/1770609084 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbce00640b0 0x7fbce0066570 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7fbcf0004630 tx=0x7fbcf0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:45:50.030 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.031+0000 7fbceaffd700 1 -- 172.21.15.26:0/1770609084 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fbce4053210 con 0x7fbcf40f66e0 2021-11-03T17:45:50.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.209+0000 7fbcfc6bd700 1 -- 172.21.15.26:0/1770609084 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbcf4108d80 con 0x7fbce00640b0 2021-11-03T17:45:50.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.211+0000 7fbceaffd700 1 -- 172.21.15.26:0/1770609084 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fbcf4108d80 con 0x7fbce00640b0 2021-11-03T17:45:50.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.212+0000 7fbcfc6bd700 1 -- 172.21.15.26:0/1770609084 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbce00640b0 msgr2=0x7fbce0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:45:50.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.212+0000 7fbcfc6bd700 1 --2- 172.21.15.26:0/1770609084 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbce00640b0 0x7fbce0066570 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7fbcf0004630 tx=0x7fbcf0009b30).stop 2021-11-03T17:45:50.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.212+0000 7fbcfc6bd700 1 -- 172.21.15.26:0/1770609084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbcf40f66e0 msgr2=0x7fbcf4106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:45:50.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.212+0000 7fbcfc6bd700 1 --2- 172.21.15.26:0/1770609084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbcf40f66e0 0x7fbcf4106f70 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 rx=0x7fbce40026d0 tx=0x7fbce4009de0).stop 2021-11-03T17:45:50.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.213+0000 7fbcfc6bd700 1 -- 172.21.15.26:0/1770609084 shutdown_connections 2021-11-03T17:45:50.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.213+0000 7fbcfc6bd700 1 --2- 172.21.15.26:0/1770609084 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbce00640b0 0x7fbce0066570 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:50.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.213+0000 7fbcfc6bd700 1 --2- 172.21.15.26:0/1770609084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbcf40f66e0 0x7fbcf4106f70 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:50.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.213+0000 7fbcfc6bd700 1 --2- 172.21.15.26:0/1770609084 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbcf40f6ff0 0x7fbcf4107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:50.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.213+0000 7fbcfc6bd700 1 -- 172.21.15.26:0/1770609084 >> 172.21.15.26:0/1770609084 conn(0x7fbcf40f1f00 msgr2=0x7fbcf40fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:45:50.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.213+0000 7fbcfc6bd700 1 -- 172.21.15.26:0/1770609084 shutdown_connections 2021-11-03T17:45:50.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.213+0000 7fbcfc6bd700 1 -- 172.21.15.26:0/1770609084 wait complete. 2021-11-03T17:45:50.218 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:45:50.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.314+0000 7f1c53fff700 1 -- 172.21.15.26:0/2450434906 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c540f77d0 msgr2=0x7f1c540f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:45:50.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.314+0000 7f1c53fff700 1 --2- 172.21.15.26:0/2450434906 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c540f77d0 0x7f1c540f7c30 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7f1c48004660 tx=0x7f1c48009b30).stop 2021-11-03T17:45:50.310 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.314+0000 7f1c53fff700 1 -- 172.21.15.26:0/2450434906 shutdown_connections 2021-11-03T17:45:50.310 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.314+0000 7f1c53fff700 1 --2- 172.21.15.26:0/2450434906 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c540f77d0 0x7f1c540f7c30 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:50.310 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.314+0000 7f1c53fff700 1 --2- 172.21.15.26:0/2450434906 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c540f6530 0x7f1c540f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:50.310 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.314+0000 7f1c53fff700 1 -- 172.21.15.26:0/2450434906 >> 172.21.15.26:0/2450434906 conn(0x7f1c540f1cd0 msgr2=0x7f1c540f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:45:50.311 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.314+0000 7f1c53fff700 1 -- 172.21.15.26:0/2450434906 shutdown_connections 2021-11-03T17:45:50.311 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.314+0000 7f1c53fff700 1 -- 172.21.15.26:0/2450434906 wait complete. 2021-11-03T17:45:50.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.315+0000 7f1c53fff700 1 Processor -- start 2021-11-03T17:45:50.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.315+0000 7f1c53fff700 1 -- start start 2021-11-03T17:45:50.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.315+0000 7f1c53fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c540f6530 0x7f1c54106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:45:50.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.315+0000 7f1c53fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c540f77d0 0x7f1c54107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:45:50.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.315+0000 7f1c53fff700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c54107870 con 0x7f1c540f77d0 2021-11-03T17:45:50.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.315+0000 7f1c53fff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c54108080 con 0x7f1c540f6530 2021-11-03T17:45:50.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.315+0000 7f1c527fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c540f77d0 0x7f1c54107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:45:50.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.315+0000 7f1c527fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c540f77d0 0x7f1c54107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56232/0 (socket says 172.21.15.26:56232) 2021-11-03T17:45:50.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.315+0000 7f1c527fc700 1 -- 172.21.15.26:0/2383777167 learned_addr learned my addr 172.21.15.26:0/2383777167 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:45:50.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.315+0000 7f1c52ffd700 1 --2- 172.21.15.26:0/2383777167 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c540f6530 0x7f1c54106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:45:50.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.316+0000 7f1c527fc700 1 -- 172.21.15.26:0/2383777167 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c540f6530 msgr2=0x7f1c54106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:45:50.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.316+0000 7f1c527fc700 1 --2- 172.21.15.26:0/2383777167 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c540f6530 0x7f1c54106d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:50.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.316+0000 7f1c527fc700 1 -- 172.21.15.26:0/2383777167 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c48005040 con 0x7f1c540f77d0 2021-11-03T17:45:50.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.316+0000 7f1c527fc700 1 --2- 172.21.15.26:0/2383777167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c540f77d0 0x7f1c54107270 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7f1c48009830 tx=0x7f1c48009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:45:50.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.316+0000 7f1c3b7fe700 1 -- 172.21.15.26:0/2383777167 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c48018070 con 0x7f1c540f77d0 2021-11-03T17:45:50.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.316+0000 7f1c53fff700 1 -- 172.21.15.26:0/2383777167 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c541082a0 con 0x7f1c540f77d0 2021-11-03T17:45:50.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.316+0000 7f1c3b7fe700 1 -- 172.21.15.26:0/2383777167 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1c48007ba0 con 0x7f1c540f77d0 2021-11-03T17:45:50.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.316+0000 7f1c3b7fe700 1 -- 172.21.15.26:0/2383777167 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c4801c3c0 con 0x7f1c540f77d0 2021-11-03T17:45:50.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.316+0000 7f1c53fff700 1 -- 172.21.15.26:0/2383777167 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c54108800 con 0x7f1c540f77d0 2021-11-03T17:45:50.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.317+0000 7f1c53fff700 1 -- 172.21.15.26:0/2383777167 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c54059100 con 0x7f1c540f77d0 2021-11-03T17:45:50.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.317+0000 7f1c3b7fe700 1 -- 172.21.15.26:0/2383777167 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f1c48007d10 con 0x7f1c540f77d0 2021-11-03T17:45:50.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.318+0000 7f1c3b7fe700 1 --2- 172.21.15.26:0/2383777167 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1c3c064100 0x7f1c3c0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:45:50.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.318+0000 7f1c3b7fe700 1 -- 172.21.15.26:0/2383777167 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f1c480823a0 con 0x7f1c540f77d0 2021-11-03T17:45:50.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.318+0000 7f1c52ffd700 1 --2- 172.21.15.26:0/2383777167 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1c3c064100 0x7f1c3c0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:45:50.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.318+0000 7f1c52ffd700 1 --2- 172.21.15.26:0/2383777167 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1c3c064100 0x7f1c3c0665c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f1c54106af0 tx=0x7f1c4400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:45:50.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.322+0000 7f1c3b7fe700 1 -- 172.21.15.26:0/2383777167 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f1c48054700 con 0x7f1c540f77d0 2021-11-03T17:45:50.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.495+0000 7f1c53fff700 1 -- 172.21.15.26:0/2383777167 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c540fee80 con 0x7f1c3c064100 2021-11-03T17:45:50.505 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.510+0000 7f1c3b7fe700 1 -- 172.21.15.26:0/2383777167 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f1c540fee80 con 0x7f1c3c064100 2021-11-03T17:45:50.505 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:45:50.505 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (57m) 6m ago 58m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:45:50.506 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (49m) 6m ago 58m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:45:50.506 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (49m) 5m ago 57m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:45:50.506 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (56m) 6m ago 58m 40.8M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:45:50.506 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (50m) 6m ago 53m 25.1M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:45:50.507 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (50m) 6m ago 53m 25.7M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:45:50.507 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (53m) 5m ago 53m 26.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:45:50.507 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (53m) 5m ago 53m 26.3M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:45:50.507 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (50m) 6m ago 59m 533M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:45:50.508 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (50m) 5m ago 57m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:45:50.508 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (50m) 6m ago 59m 209M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:45:50.508 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (49m) 5m ago 57m 103M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:45:50.508 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (57m) 6m ago 57m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:45:50.509 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (57m) 5m ago 57m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:45:50.509 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (48m) 6m ago 56m 251M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:45:50.509 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (48m) 6m ago 56m 270M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:45:50.510 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (47m) 6m ago 55m 225M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:45:50.510 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (47m) 5m ago 55m 287M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:45:50.510 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (46m) 5m ago 55m 246M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:45:50.510 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (46m) 5m ago 55m 235M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:45:50.511 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (56m) 6m ago 57m 56.7M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:45:50.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.512+0000 7f1c53fff700 1 -- 172.21.15.26:0/2383777167 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1c3c064100 msgr2=0x7f1c3c0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:45:50.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.512+0000 7f1c53fff700 1 --2- 172.21.15.26:0/2383777167 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1c3c064100 0x7f1c3c0665c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f1c54106af0 tx=0x7f1c4400b040).stop 2021-11-03T17:45:50.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.512+0000 7f1c53fff700 1 -- 172.21.15.26:0/2383777167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c540f77d0 msgr2=0x7f1c54107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:45:50.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.512+0000 7f1c53fff700 1 --2- 172.21.15.26:0/2383777167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c540f77d0 0x7f1c54107270 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7f1c48009830 tx=0x7f1c48009b30).stop 2021-11-03T17:45:50.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.512+0000 7f1c53fff700 1 -- 172.21.15.26:0/2383777167 shutdown_connections 2021-11-03T17:45:50.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.512+0000 7f1c53fff700 1 --2- 172.21.15.26:0/2383777167 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1c3c064100 0x7f1c3c0665c0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:50.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.512+0000 7f1c53fff700 1 --2- 172.21.15.26:0/2383777167 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c540f6530 0x7f1c54106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:50.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.512+0000 7f1c53fff700 1 --2- 172.21.15.26:0/2383777167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c540f77d0 0x7f1c54107270 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:50.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.512+0000 7f1c53fff700 1 -- 172.21.15.26:0/2383777167 >> 172.21.15.26:0/2383777167 conn(0x7f1c540f1cd0 msgr2=0x7f1c540fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:45:50.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.512+0000 7f1c53fff700 1 -- 172.21.15.26:0/2383777167 shutdown_connections 2021-11-03T17:45:50.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.512+0000 7f1c53fff700 1 -- 172.21.15.26:0/2383777167 wait complete. 2021-11-03T17:45:50.608 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.611+0000 7f89cef1e700 1 -- 172.21.15.26:0/2320142844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89c80f55e0 msgr2=0x7f89c80f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:45:50.608 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.611+0000 7f89cef1e700 1 --2- 172.21.15.26:0/2320142844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89c80f55e0 0x7f89c80f5a00 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7f89c00099e0 tx=0x7f89c0004d10).stop 2021-11-03T17:45:50.608 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.611+0000 7f89cef1e700 1 -- 172.21.15.26:0/2320142844 shutdown_connections 2021-11-03T17:45:50.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.611+0000 7f89cef1e700 1 --2- 172.21.15.26:0/2320142844 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89c80f5ef0 0x7f89c80f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:50.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.611+0000 7f89cef1e700 1 --2- 172.21.15.26:0/2320142844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89c80f55e0 0x7f89c80f5a00 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:50.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.611+0000 7f89cef1e700 1 -- 172.21.15.26:0/2320142844 >> 172.21.15.26:0/2320142844 conn(0x7f89c80f0de0 msgr2=0x7f89c80f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:45:50.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.611+0000 7f89cef1e700 1 -- 172.21.15.26:0/2320142844 shutdown_connections 2021-11-03T17:45:50.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.611+0000 7f89cef1e700 1 -- 172.21.15.26:0/2320142844 wait complete. 2021-11-03T17:45:50.610 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.612+0000 7f89cef1e700 1 Processor -- start 2021-11-03T17:45:50.610 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.612+0000 7f89cef1e700 1 -- start start 2021-11-03T17:45:50.610 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.612+0000 7f89cef1e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89c80f55e0 0x7f89c8107060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:45:50.610 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.612+0000 7f89cef1e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89c80f5ef0 0x7f89c8107550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:45:50.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.612+0000 7f89cef1e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c8107b00 con 0x7f89c80f55e0 2021-11-03T17:45:50.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.612+0000 7f89cef1e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c8107c40 con 0x7f89c80f5ef0 2021-11-03T17:45:50.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.612+0000 7f89cccba700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89c80f55e0 0x7f89c8107060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:45:50.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.612+0000 7f89cccba700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89c80f55e0 0x7f89c8107060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56240/0 (socket says 172.21.15.26:56240) 2021-11-03T17:45:50.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.612+0000 7f89cccba700 1 -- 172.21.15.26:0/4106643178 learned_addr learned my addr 172.21.15.26:0/4106643178 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:45:50.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.613+0000 7f89c7fff700 1 --2- 172.21.15.26:0/4106643178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89c80f5ef0 0x7f89c8107550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:45:50.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.613+0000 7f89cccba700 1 -- 172.21.15.26:0/4106643178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89c80f5ef0 msgr2=0x7f89c8107550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:45:50.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.613+0000 7f89cccba700 1 --2- 172.21.15.26:0/4106643178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89c80f5ef0 0x7f89c8107550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:50.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.613+0000 7f89cccba700 1 -- 172.21.15.26:0/4106643178 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c0009640 con 0x7f89c80f55e0 2021-11-03T17:45:50.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.613+0000 7f89c7fff700 1 --2- 172.21.15.26:0/4106643178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89c80f5ef0 0x7f89c8107550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:45:50.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.613+0000 7f89cccba700 1 --2- 172.21.15.26:0/4106643178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89c80f55e0 0x7f89c8107060 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7f89c000b3b0 tx=0x7f89c0004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:45:50.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.613+0000 7f89c57fa700 1 -- 172.21.15.26:0/4106643178 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89c000e030 con 0x7f89c80f55e0 2021-11-03T17:45:50.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.613+0000 7f89cef1e700 1 -- 172.21.15.26:0/4106643178 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89c8108580 con 0x7f89c80f55e0 2021-11-03T17:45:50.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.613+0000 7f89c57fa700 1 -- 172.21.15.26:0/4106643178 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f89c00049b0 con 0x7f89c80f55e0 2021-11-03T17:45:50.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.613+0000 7f89c57fa700 1 -- 172.21.15.26:0/4106643178 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89c0018070 con 0x7f89c80f55e0 2021-11-03T17:45:50.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.613+0000 7f89cef1e700 1 -- 172.21.15.26:0/4106643178 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89c8108a60 con 0x7f89c80f55e0 2021-11-03T17:45:50.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.614+0000 7f89cef1e700 1 -- 172.21.15.26:0/4106643178 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89c8045ad0 con 0x7f89c80f55e0 2021-11-03T17:45:50.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.614+0000 7f89c57fa700 1 -- 172.21.15.26:0/4106643178 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f89c0007d40 con 0x7f89c80f55e0 2021-11-03T17:45:50.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.615+0000 7f89c57fa700 1 --2- 172.21.15.26:0/4106643178 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f89b40640b0 0x7f89b4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:45:50.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.615+0000 7f89c57fa700 1 -- 172.21.15.26:0/4106643178 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f89c0082540 con 0x7f89c80f55e0 2021-11-03T17:45:50.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.615+0000 7f89c7fff700 1 --2- 172.21.15.26:0/4106643178 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f89b40640b0 0x7f89b4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:45:50.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.615+0000 7f89c7fff700 1 --2- 172.21.15.26:0/4106643178 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f89b40640b0 0x7f89b4066570 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f89b8009fd0 tx=0x7f89b800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:45:50.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.619+0000 7f89c57fa700 1 -- 172.21.15.26:0/4106643178 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f89c00548a0 con 0x7f89c80f55e0 2021-11-03T17:45:50.842 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.848+0000 7f89cef1e700 1 -- 172.21.15.26:0/4106643178 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f89c8109230 con 0x7f89c80f55e0 2021-11-03T17:45:50.843 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.848+0000 7f89c57fa700 1 -- 172.21.15.26:0/4106643178 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f89c0054490 con 0x7f89c80f55e0 2021-11-03T17:45:50.844 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:45:50.844 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:45:50.844 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:45:50.844 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:45:50.845 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:45:50.849 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:45:50.850 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:45:50.850 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:45:50.850 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:45:50.850 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:45:50.850 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:45:50.851 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:45:50.851 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:45:50.851 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:45:50.851 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:45:50.852 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:45:50.852 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:45:50.852 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:45:50.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.850+0000 7f89cef1e700 1 -- 172.21.15.26:0/4106643178 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f89b40640b0 msgr2=0x7f89b4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:45:50.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.850+0000 7f89cef1e700 1 --2- 172.21.15.26:0/4106643178 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f89b40640b0 0x7f89b4066570 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f89b8009fd0 tx=0x7f89b800b040).stop 2021-11-03T17:45:50.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.850+0000 7f89cef1e700 1 -- 172.21.15.26:0/4106643178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89c80f55e0 msgr2=0x7f89c8107060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:45:50.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.850+0000 7f89cef1e700 1 --2- 172.21.15.26:0/4106643178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89c80f55e0 0x7f89c8107060 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7f89c000b3b0 tx=0x7f89c0004d10).stop 2021-11-03T17:45:50.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.850+0000 7f89cef1e700 1 -- 172.21.15.26:0/4106643178 shutdown_connections 2021-11-03T17:45:50.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.850+0000 7f89cef1e700 1 --2- 172.21.15.26:0/4106643178 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f89b40640b0 0x7f89b4066570 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:50.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.850+0000 7f89cef1e700 1 --2- 172.21.15.26:0/4106643178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89c80f55e0 0x7f89c8107060 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:50.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.850+0000 7f89cef1e700 1 --2- 172.21.15.26:0/4106643178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89c80f5ef0 0x7f89c8107550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:50.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.850+0000 7f89cef1e700 1 -- 172.21.15.26:0/4106643178 >> 172.21.15.26:0/4106643178 conn(0x7f89c80f0de0 msgr2=0x7f89c805ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:45:50.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.850+0000 7f89cef1e700 1 -- 172.21.15.26:0/4106643178 shutdown_connections 2021-11-03T17:45:50.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.850+0000 7f89cef1e700 1 -- 172.21.15.26:0/4106643178 wait complete. 2021-11-03T17:45:50.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:50 smithi026 ceph-mon[96795]: pgmap v1535: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:50.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.951+0000 7feabc0e0700 1 -- 172.21.15.26:0/1319033445 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feab40f66e0 msgr2=0x7feab40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:45:50.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.951+0000 7feabc0e0700 1 --2- 172.21.15.26:0/1319033445 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feab40f66e0 0x7feab40f6b00 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7feaac0099e0 tx=0x7feaac004d10).stop 2021-11-03T17:45:50.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.951+0000 7feabc0e0700 1 -- 172.21.15.26:0/1319033445 shutdown_connections 2021-11-03T17:45:50.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.951+0000 7feabc0e0700 1 --2- 172.21.15.26:0/1319033445 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feab40f7980 0x7feab40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:50.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.951+0000 7feabc0e0700 1 --2- 172.21.15.26:0/1319033445 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feab40f66e0 0x7feab40f6b00 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:50.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.951+0000 7feabc0e0700 1 -- 172.21.15.26:0/1319033445 >> 172.21.15.26:0/1319033445 conn(0x7feab40f1e40 msgr2=0x7feab40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:45:50.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.951+0000 7feabc0e0700 1 -- 172.21.15.26:0/1319033445 shutdown_connections 2021-11-03T17:45:50.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.951+0000 7feabc0e0700 1 -- 172.21.15.26:0/1319033445 wait complete. 2021-11-03T17:45:50.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.951+0000 7feabc0e0700 1 Processor -- start 2021-11-03T17:45:50.950 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.951+0000 7feabc0e0700 1 -- start start 2021-11-03T17:45:50.950 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.952+0000 7feabc0e0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feab40f66e0 0x7feab4107060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:45:50.950 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.952+0000 7feabc0e0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feab40f7980 0x7feab4107550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:45:50.950 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.952+0000 7feabc0e0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab4107b00 con 0x7feab40f7980 2021-11-03T17:45:50.951 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.952+0000 7feabc0e0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab4107c40 con 0x7feab40f66e0 2021-11-03T17:45:50.951 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.952+0000 7feab967b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feab40f7980 0x7feab4107550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:45:50.951 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.952+0000 7feab967b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feab40f7980 0x7feab4107550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56252/0 (socket says 172.21.15.26:56252) 2021-11-03T17:45:50.951 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.952+0000 7feab967b700 1 -- 172.21.15.26:0/4044981083 learned_addr learned my addr 172.21.15.26:0/4044981083 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:45:50.951 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.952+0000 7feab9e7c700 1 --2- 172.21.15.26:0/4044981083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feab40f66e0 0x7feab4107060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:45:50.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.952+0000 7feab967b700 1 -- 172.21.15.26:0/4044981083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feab40f66e0 msgr2=0x7feab4107060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:45:50.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.952+0000 7feab967b700 1 --2- 172.21.15.26:0/4044981083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feab40f66e0 0x7feab4107060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:50.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.952+0000 7feab967b700 1 -- 172.21.15.26:0/4044981083 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaac009640 con 0x7feab40f7980 2021-11-03T17:45:50.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.952+0000 7feab967b700 1 --2- 172.21.15.26:0/4044981083 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feab40f7980 0x7feab4107550 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7feaa80026d0 tx=0x7feaa8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:45:50.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.952+0000 7feab27fc700 1 -- 172.21.15.26:0/4044981083 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feaa80079c0 con 0x7feab40f7980 2021-11-03T17:45:50.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.952+0000 7feab27fc700 1 -- 172.21.15.26:0/4044981083 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7feaa800f040 con 0x7feab40f7980 2021-11-03T17:45:50.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.952+0000 7feabc0e0700 1 -- 172.21.15.26:0/4044981083 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feab41085e0 con 0x7feab40f7980 2021-11-03T17:45:50.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.952+0000 7feab27fc700 1 -- 172.21.15.26:0/4044981083 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feaa80148b0 con 0x7feab40f7980 2021-11-03T17:45:50.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.952+0000 7feabc0e0700 1 -- 172.21.15.26:0/4044981083 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab4108b20 con 0x7feab40f7980 2021-11-03T17:45:50.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.953+0000 7feabc0e0700 1 -- 172.21.15.26:0/4044981083 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feab4045ad0 con 0x7feab40f7980 2021-11-03T17:45:50.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.954+0000 7feab27fc700 1 -- 172.21.15.26:0/4044981083 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7feaa8007b20 con 0x7feab40f7980 2021-11-03T17:45:50.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.954+0000 7feab27fc700 1 --2- 172.21.15.26:0/4044981083 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fea9c0640b0 0x7fea9c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:45:50.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.954+0000 7feab27fc700 1 -- 172.21.15.26:0/4044981083 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7feaa8080730 con 0x7feab40f7980 2021-11-03T17:45:50.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.954+0000 7feab9e7c700 1 --2- 172.21.15.26:0/4044981083 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fea9c0640b0 0x7fea9c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:45:50.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.955+0000 7feab9e7c700 1 --2- 172.21.15.26:0/4044981083 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fea9c0640b0 0x7fea9c066570 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7feaac00b730 tx=0x7feaac004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:45:50.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:50.958+0000 7feab27fc700 1 -- 172.21.15.26:0/4044981083 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7feaa8052a90 con 0x7feab40f7980 2021-11-03T17:45:50.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:50 smithi194 ceph-mon[65619]: pgmap v1535: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:51.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:51.163+0000 7feabc0e0700 1 -- 172.21.15.26:0/4044981083 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7feab4027a00 con 0x7feab40f7980 2021-11-03T17:45:51.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:51.163+0000 7feab27fc700 1 -- 172.21.15.26:0/4044981083 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7feaa8052680 con 0x7feab40f7980 2021-11-03T17:45:51.159 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:45:51.159 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:45:51.159 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:45:51.159 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:45:51.160 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:45:51.160 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:45:51.160 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:45:51.160 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:45:51.161 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:45:51.161 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:45:51.161 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:45:51.161 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:45:51.162 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:45:51.162 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:45:51.162 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:45:51.163 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:45:51.163 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:45:51.164 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:45:51.164 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:45:51.165 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:45:51.165 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:45:51.165 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:45:51.166 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:45:51.167 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:45:51.167 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:45:51.168 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:45:51.168 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:45:51.168 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:45:51.169 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:45:51.169 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:45:51.170 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:45:51.170 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:45:51.171 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:45:51.171 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:45:51.171 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:45:51.172 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:45:51.172 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:45:51.172 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:45:51.172 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:45:51.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:51.165+0000 7feabc0e0700 1 -- 172.21.15.26:0/4044981083 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fea9c0640b0 msgr2=0x7fea9c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:45:51.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:51.165+0000 7feabc0e0700 1 --2- 172.21.15.26:0/4044981083 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fea9c0640b0 0x7fea9c066570 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7feaac00b730 tx=0x7feaac004d10).stop 2021-11-03T17:45:51.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:51.165+0000 7feabc0e0700 1 -- 172.21.15.26:0/4044981083 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feab40f7980 msgr2=0x7feab4107550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:45:51.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:51.165+0000 7feabc0e0700 1 --2- 172.21.15.26:0/4044981083 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feab40f7980 0x7feab4107550 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7feaa80026d0 tx=0x7feaa8009de0).stop 2021-11-03T17:45:51.175 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:51.165+0000 7feabc0e0700 1 -- 172.21.15.26:0/4044981083 shutdown_connections 2021-11-03T17:45:51.175 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:51.165+0000 7feabc0e0700 1 --2- 172.21.15.26:0/4044981083 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fea9c0640b0 0x7fea9c066570 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:51.175 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:51.165+0000 7feabc0e0700 1 --2- 172.21.15.26:0/4044981083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feab40f66e0 0x7feab4107060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:51.175 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:51.165+0000 7feabc0e0700 1 --2- 172.21.15.26:0/4044981083 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feab40f7980 0x7feab4107550 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:45:51.176 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:51.165+0000 7feabc0e0700 1 -- 172.21.15.26:0/4044981083 >> 172.21.15.26:0/4044981083 conn(0x7feab40f1e40 msgr2=0x7feab40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:45:51.176 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:51.165+0000 7feabc0e0700 1 -- 172.21.15.26:0/4044981083 shutdown_connections 2021-11-03T17:45:51.176 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:45:51.165+0000 7feabc0e0700 1 -- 172.21.15.26:0/4044981083 wait complete. 2021-11-03T17:45:51.176 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:45:51.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:51 smithi026 ceph-mon[96795]: from='client.35724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:45:51.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:51 smithi026 ceph-mon[96795]: from='client.35728 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:45:51.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:51 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/4106643178' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:45:51.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:51 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/4044981083' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:45:51.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:51 smithi194 ceph-mon[65619]: from='client.35724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:45:51.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:51 smithi194 ceph-mon[65619]: from='client.35728 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:45:51.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:51 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/4106643178' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:45:51.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:51 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/4044981083' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:45:52.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:52 smithi026 ceph-mon[96795]: pgmap v1536: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:52.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:52 smithi194 ceph-mon[65619]: pgmap v1536: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:53.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:53 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:45:54.170 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:53 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:45:54.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:54 smithi194 ceph-mon[65619]: pgmap v1537: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:54.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:54 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:45:55.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:54 smithi026 ceph-mon[96795]: pgmap v1537: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:55.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:54 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:45:56.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:56 smithi194 ceph-mon[65619]: pgmap v1538: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:57.170 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:56 smithi026 ceph-mon[96795]: pgmap v1538: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:58.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:45:58 smithi194 ceph-mon[65619]: pgmap v1539: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:45:59.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:45:58 smithi026 ceph-mon[96795]: pgmap v1539: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:00.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:00 smithi194 ceph-mon[65619]: pgmap v1540: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:01.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:00 smithi026 ceph-mon[96795]: pgmap v1540: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:02.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:02 smithi194 ceph-mon[65619]: pgmap v1541: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:03.170 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:02 smithi026 ceph-mon[96795]: pgmap v1541: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:04.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:04 smithi194 ceph-mon[65619]: pgmap v1542: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:05.170 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:04 smithi026 ceph-mon[96795]: pgmap v1542: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:06.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:06 smithi194 ceph-mon[65619]: pgmap v1543: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:07.170 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:06 smithi026 ceph-mon[96795]: pgmap v1543: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:08.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:08 smithi194 ceph-mon[65619]: pgmap v1544: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:08.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:08 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:46:09.170 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:08 smithi026 ceph-mon[96795]: pgmap v1544: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:09.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:08 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:46:09.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:09 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:46:10.170 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:09 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:46:10.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:10 smithi194 ceph-mon[65619]: pgmap v1545: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:11.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:10 smithi026 ceph-mon[96795]: pgmap v1545: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:12.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:12 smithi194 ceph-mon[65619]: pgmap v1546: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:13.170 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:12 smithi026 ceph-mon[96795]: pgmap v1546: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:14.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:14 smithi194 ceph-mon[65619]: pgmap v1547: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:15.170 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:14 smithi026 ceph-mon[96795]: pgmap v1547: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:15.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:15 smithi026 ceph-mon[96795]: pgmap v1548: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:15.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:15 smithi194 ceph-mon[65619]: pgmap v1548: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:18.496 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:18 smithi194 ceph-mon[65619]: pgmap v1549: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:18.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:18 smithi026 ceph-mon[96795]: pgmap v1549: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:20.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:20 smithi026 ceph-mon[96795]: pgmap v1550: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:20.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:20 smithi194 ceph-mon[65619]: pgmap v1550: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:21.276 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.281+0000 7f140cffd700 1 -- 172.21.15.26:0/2682152974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14080f77d0 msgr2=0x7f14080f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:46:21.276 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.281+0000 7f140cffd700 1 --2- 172.21.15.26:0/2682152974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14080f77d0 0x7f14080f7c30 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7f13fc004660 tx=0x7f13fc009b30).stop 2021-11-03T17:46:21.277 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.281+0000 7f140cffd700 1 -- 172.21.15.26:0/2682152974 shutdown_connections 2021-11-03T17:46:21.277 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.281+0000 7f140cffd700 1 --2- 172.21.15.26:0/2682152974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14080f77d0 0x7f14080f7c30 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:21.277 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.281+0000 7f140cffd700 1 --2- 172.21.15.26:0/2682152974 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14080f6530 0x7f14080f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:21.277 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.281+0000 7f140cffd700 1 -- 172.21.15.26:0/2682152974 >> 172.21.15.26:0/2682152974 conn(0x7f14080f1cd0 msgr2=0x7f14080f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:46:21.277 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.281+0000 7f140cffd700 1 -- 172.21.15.26:0/2682152974 shutdown_connections 2021-11-03T17:46:21.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.281+0000 7f140cffd700 1 -- 172.21.15.26:0/2682152974 wait complete. 2021-11-03T17:46:21.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.282+0000 7f140cffd700 1 Processor -- start 2021-11-03T17:46:21.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.282+0000 7f140cffd700 1 -- start start 2021-11-03T17:46:21.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.282+0000 7f140cffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14080f6530 0x7f1408106d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:46:21.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.282+0000 7f140cffd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14080f77d0 0x7f1408107230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:46:21.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.282+0000 7f140cffd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14081077e0 con 0x7f14080f6530 2021-11-03T17:46:21.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.282+0000 7f140cffd700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1408107fe0 con 0x7f14080f77d0 2021-11-03T17:46:21.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.282+0000 7f14077fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14080f6530 0x7f1408106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:46:21.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.282+0000 7f14077fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14080f6530 0x7f1408106d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56268/0 (socket says 172.21.15.26:56268) 2021-11-03T17:46:21.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.282+0000 7f14077fe700 1 -- 172.21.15.26:0/3354379443 learned_addr learned my addr 172.21.15.26:0/3354379443 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:46:21.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.282+0000 7f1406ffd700 1 --2- 172.21.15.26:0/3354379443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14080f77d0 0x7f1408107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:46:21.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.282+0000 7f14077fe700 1 -- 172.21.15.26:0/3354379443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14080f77d0 msgr2=0x7f1408107230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:46:21.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.282+0000 7f14077fe700 1 --2- 172.21.15.26:0/3354379443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14080f77d0 0x7f1408107230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:21.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.282+0000 7f14077fe700 1 -- 172.21.15.26:0/3354379443 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13fc005040 con 0x7f14080f6530 2021-11-03T17:46:21.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.283+0000 7f14077fe700 1 --2- 172.21.15.26:0/3354379443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14080f6530 0x7f1408106d40 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x7f13f8002700 tx=0x7f13f8009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:46:21.283 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.283+0000 7f13effff700 1 -- 172.21.15.26:0/3354379443 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13f80079c0 con 0x7f14080f6530 2021-11-03T17:46:21.283 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.283+0000 7f13effff700 1 -- 172.21.15.26:0/3354379443 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f13f800f040 con 0x7f14080f6530 2021-11-03T17:46:21.283 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.283+0000 7f140cffd700 1 -- 172.21.15.26:0/3354379443 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14081082c0 con 0x7f14080f6530 2021-11-03T17:46:21.283 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.283+0000 7f13effff700 1 -- 172.21.15.26:0/3354379443 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13f8014850 con 0x7f14080f6530 2021-11-03T17:46:21.284 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.283+0000 7f140cffd700 1 -- 172.21.15.26:0/3354379443 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1408108880 con 0x7f14080f6530 2021-11-03T17:46:21.284 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.284+0000 7f140cffd700 1 -- 172.21.15.26:0/3354379443 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1408059100 con 0x7f14080f6530 2021-11-03T17:46:21.284 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.284+0000 7f13effff700 1 -- 172.21.15.26:0/3354379443 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f13f801b060 con 0x7f14080f6530 2021-11-03T17:46:21.284 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.285+0000 7f13effff700 1 --2- 172.21.15.26:0/3354379443 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f13f0064100 0x7f13f00665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:46:21.284 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.285+0000 7f13effff700 1 -- 172.21.15.26:0/3354379443 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f13f80805b0 con 0x7f14080f6530 2021-11-03T17:46:21.285 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.285+0000 7f1406ffd700 1 --2- 172.21.15.26:0/3354379443 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f13f0064100 0x7f13f00665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:46:21.285 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.285+0000 7f1406ffd700 1 --2- 172.21.15.26:0/3354379443 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f13f0064100 0x7f13f00665c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f13fc004e30 tx=0x7f13fc009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:46:21.285 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.289+0000 7f13effff700 1 -- 172.21.15.26:0/3354379443 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f13f8052910 con 0x7f14080f6530 2021-11-03T17:46:21.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.471+0000 7f140cffd700 1 -- 172.21.15.26:0/3354379443 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f14080fee00 con 0x7f13f0064100 2021-11-03T17:46:21.466 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.472+0000 7f13effff700 1 -- 172.21.15.26:0/3354379443 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f14080fee00 con 0x7f13f0064100 2021-11-03T17:46:21.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.474+0000 7f140cffd700 1 -- 172.21.15.26:0/3354379443 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f13f0064100 msgr2=0x7f13f00665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:46:21.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.474+0000 7f140cffd700 1 --2- 172.21.15.26:0/3354379443 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f13f0064100 0x7f13f00665c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f13fc004e30 tx=0x7f13fc009b30).stop 2021-11-03T17:46:21.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.474+0000 7f140cffd700 1 -- 172.21.15.26:0/3354379443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14080f6530 msgr2=0x7f1408106d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:46:21.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.474+0000 7f140cffd700 1 --2- 172.21.15.26:0/3354379443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14080f6530 0x7f1408106d40 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x7f13f8002700 tx=0x7f13f8009e00).stop 2021-11-03T17:46:21.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.474+0000 7f140cffd700 1 -- 172.21.15.26:0/3354379443 shutdown_connections 2021-11-03T17:46:21.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.474+0000 7f140cffd700 1 --2- 172.21.15.26:0/3354379443 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f13f0064100 0x7f13f00665c0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:21.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.475+0000 7f140cffd700 1 --2- 172.21.15.26:0/3354379443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14080f6530 0x7f1408106d40 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:21.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.475+0000 7f140cffd700 1 --2- 172.21.15.26:0/3354379443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14080f77d0 0x7f1408107230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:21.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.475+0000 7f140cffd700 1 -- 172.21.15.26:0/3354379443 >> 172.21.15.26:0/3354379443 conn(0x7f14080f1cd0 msgr2=0x7f14080fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:46:21.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.475+0000 7f140cffd700 1 -- 172.21.15.26:0/3354379443 shutdown_connections 2021-11-03T17:46:21.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.475+0000 7f140cffd700 1 -- 172.21.15.26:0/3354379443 wait complete. 2021-11-03T17:46:21.478 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:46:21.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.574+0000 7febdf4bf700 1 -- 172.21.15.26:0/2011661518 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febd80f55e0 msgr2=0x7febd80f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:46:21.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.574+0000 7febdf4bf700 1 --2- 172.21.15.26:0/2011661518 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febd80f55e0 0x7febd80f5a00 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7febd4004660 tx=0x7febd4009b30).stop 2021-11-03T17:46:21.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.575+0000 7febdf4bf700 1 -- 172.21.15.26:0/2011661518 shutdown_connections 2021-11-03T17:46:21.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.575+0000 7febdf4bf700 1 --2- 172.21.15.26:0/2011661518 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febd80f5ef0 0x7febd80f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:21.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.575+0000 7febdf4bf700 1 --2- 172.21.15.26:0/2011661518 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febd80f55e0 0x7febd80f5a00 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:21.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.575+0000 7febdf4bf700 1 -- 172.21.15.26:0/2011661518 >> 172.21.15.26:0/2011661518 conn(0x7febd80f0de0 msgr2=0x7febd80f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:46:21.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.575+0000 7febdf4bf700 1 -- 172.21.15.26:0/2011661518 shutdown_connections 2021-11-03T17:46:21.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.575+0000 7febdf4bf700 1 -- 172.21.15.26:0/2011661518 wait complete. 2021-11-03T17:46:21.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.575+0000 7febdf4bf700 1 Processor -- start 2021-11-03T17:46:21.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.575+0000 7febdf4bf700 1 -- start start 2021-11-03T17:46:21.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.575+0000 7febdf4bf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febd80f55e0 0x7febd8109150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:46:21.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.575+0000 7febdf4bf700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febd80f5ef0 0x7febd8109640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:46:21.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.575+0000 7febdf4bf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd8109bf0 con 0x7febd80f55e0 2021-11-03T17:46:21.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.575+0000 7febdf4bf700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd8109d30 con 0x7febd80f5ef0 2021-11-03T17:46:21.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.575+0000 7febdd25b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febd80f55e0 0x7febd8109150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:46:21.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.576+0000 7febdd25b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febd80f55e0 0x7febd8109150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56278/0 (socket says 172.21.15.26:56278) 2021-11-03T17:46:21.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.576+0000 7febdd25b700 1 -- 172.21.15.26:0/405710500 learned_addr learned my addr 172.21.15.26:0/405710500 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:46:21.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.576+0000 7febdca5a700 1 --2- 172.21.15.26:0/405710500 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febd80f5ef0 0x7febd8109640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:46:21.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.576+0000 7febdd25b700 1 -- 172.21.15.26:0/405710500 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febd80f5ef0 msgr2=0x7febd8109640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:46:21.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.576+0000 7febdd25b700 1 --2- 172.21.15.26:0/405710500 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febd80f5ef0 0x7febd8109640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:21.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.576+0000 7febdd25b700 1 -- 172.21.15.26:0/405710500 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd4005040 con 0x7febd80f55e0 2021-11-03T17:46:21.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.576+0000 7febdd25b700 1 --2- 172.21.15.26:0/405710500 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febd80f55e0 0x7febd8109150 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7febd4009990 tx=0x7febd4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:46:21.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.576+0000 7febcdffb700 1 -- 172.21.15.26:0/405710500 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febd4018070 con 0x7febd80f55e0 2021-11-03T17:46:21.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.576+0000 7febdf4bf700 1 -- 172.21.15.26:0/405710500 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd810a670 con 0x7febd80f55e0 2021-11-03T17:46:21.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.576+0000 7febcdffb700 1 -- 172.21.15.26:0/405710500 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7febd4007ba0 con 0x7febd80f55e0 2021-11-03T17:46:21.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.576+0000 7febcdffb700 1 -- 172.21.15.26:0/405710500 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febd401c3c0 con 0x7febd80f55e0 2021-11-03T17:46:21.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.576+0000 7febdf4bf700 1 -- 172.21.15.26:0/405710500 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd810abd0 con 0x7febd80f55e0 2021-11-03T17:46:21.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.577+0000 7febdf4bf700 1 -- 172.21.15.26:0/405710500 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febd8045ad0 con 0x7febd80f55e0 2021-11-03T17:46:21.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.578+0000 7febcdffb700 1 -- 172.21.15.26:0/405710500 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7febd401d420 con 0x7febd80f55e0 2021-11-03T17:46:21.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.578+0000 7febcdffb700 1 --2- 172.21.15.26:0/405710500 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7febc40640b0 0x7febc4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:46:21.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.578+0000 7febcdffb700 1 -- 172.21.15.26:0/405710500 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7febd4082500 con 0x7febd80f55e0 2021-11-03T17:46:21.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.578+0000 7febdca5a700 1 --2- 172.21.15.26:0/405710500 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7febc40640b0 0x7febc4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:46:21.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.579+0000 7febdca5a700 1 --2- 172.21.15.26:0/405710500 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7febc40640b0 0x7febc4066570 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7febc80096c0 tx=0x7febc8009be0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:46:21.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.582+0000 7febcdffb700 1 -- 172.21.15.26:0/405710500 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7febd40548c0 con 0x7febd80f55e0 2021-11-03T17:46:21.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.755+0000 7febdf4bf700 1 -- 172.21.15.26:0/405710500 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7febd80fab60 con 0x7febc40640b0 2021-11-03T17:46:21.764 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.770+0000 7febcdffb700 1 -- 172.21.15.26:0/405710500 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7febd80fab60 con 0x7febc40640b0 2021-11-03T17:46:21.764 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:46:21.764 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (57m) 7m ago 58m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:46:21.765 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (49m) 7m ago 58m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:46:21.765 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (49m) 6m ago 58m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:46:21.765 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (57m) 7m ago 58m 40.8M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:46:21.765 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (50m) 7m ago 53m 25.1M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:46:21.766 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (50m) 7m ago 53m 25.7M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:46:21.766 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (54m) 6m ago 54m 26.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:46:21.766 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (53m) 6m ago 53m 26.3M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:46:21.767 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (51m) 7m ago 60m 533M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:46:21.767 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (50m) 6m ago 58m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:46:21.767 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (50m) 7m ago 60m 209M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:46:21.767 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (50m) 6m ago 57m 103M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:46:21.768 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (58m) 7m ago 58m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:46:21.768 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (57m) 6m ago 57m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:46:21.768 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (49m) 7m ago 57m 251M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:46:21.768 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (48m) 7m ago 56m 270M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:46:21.768 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (48m) 7m ago 56m 225M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:46:21.769 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (47m) 6m ago 56m 287M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:46:21.769 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (47m) 6m ago 55m 246M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:46:21.769 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (47m) 6m ago 55m 235M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:46:21.770 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (57m) 7m ago 58m 56.7M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:46:21.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.772+0000 7febdf4bf700 1 -- 172.21.15.26:0/405710500 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7febc40640b0 msgr2=0x7febc4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:46:21.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.772+0000 7febdf4bf700 1 --2- 172.21.15.26:0/405710500 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7febc40640b0 0x7febc4066570 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7febc80096c0 tx=0x7febc8009be0).stop 2021-11-03T17:46:21.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.772+0000 7febdf4bf700 1 -- 172.21.15.26:0/405710500 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febd80f55e0 msgr2=0x7febd8109150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:46:21.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.772+0000 7febdf4bf700 1 --2- 172.21.15.26:0/405710500 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febd80f55e0 0x7febd8109150 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7febd4009990 tx=0x7febd4009b30).stop 2021-11-03T17:46:21.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.772+0000 7febdf4bf700 1 -- 172.21.15.26:0/405710500 shutdown_connections 2021-11-03T17:46:21.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.772+0000 7febdf4bf700 1 --2- 172.21.15.26:0/405710500 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7febc40640b0 0x7febc4066570 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:21.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.772+0000 7febdf4bf700 1 --2- 172.21.15.26:0/405710500 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febd80f55e0 0x7febd8109150 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:21.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.772+0000 7febdf4bf700 1 --2- 172.21.15.26:0/405710500 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febd80f5ef0 0x7febd8109640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:21.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.772+0000 7febdf4bf700 1 -- 172.21.15.26:0/405710500 >> 172.21.15.26:0/405710500 conn(0x7febd80f0de0 msgr2=0x7febd805ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:46:21.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.772+0000 7febdf4bf700 1 -- 172.21.15.26:0/405710500 shutdown_connections 2021-11-03T17:46:21.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.772+0000 7febdf4bf700 1 -- 172.21.15.26:0/405710500 wait complete. 2021-11-03T17:46:21.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.871+0000 7ff0160b6700 1 -- 172.21.15.26:0/3063416436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff010060290 msgr2=0x7ff0100f91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:46:21.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.871+0000 7ff0160b6700 1 --2- 172.21.15.26:0/3063416436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff010060290 0x7ff0100f91a0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7ff00c004660 tx=0x7ff00c009b30).stop 2021-11-03T17:46:21.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.871+0000 7ff0160b6700 1 -- 172.21.15.26:0/3063416436 shutdown_connections 2021-11-03T17:46:21.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.871+0000 7ff0160b6700 1 --2- 172.21.15.26:0/3063416436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0100f9720 0x7ff0100fbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:21.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.871+0000 7ff0160b6700 1 --2- 172.21.15.26:0/3063416436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff010060290 0x7ff0100f91a0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:21.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.871+0000 7ff0160b6700 1 -- 172.21.15.26:0/3063416436 >> 172.21.15.26:0/3063416436 conn(0x7ff0100f0ba0 msgr2=0x7ff0100f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:46:21.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.872+0000 7ff0160b6700 1 -- 172.21.15.26:0/3063416436 shutdown_connections 2021-11-03T17:46:21.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.872+0000 7ff0160b6700 1 -- 172.21.15.26:0/3063416436 wait complete. 2021-11-03T17:46:21.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.872+0000 7ff0160b6700 1 Processor -- start 2021-11-03T17:46:21.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.872+0000 7ff0160b6700 1 -- start start 2021-11-03T17:46:21.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.872+0000 7ff0160b6700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff010060290 0x7ff010106db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:46:21.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.872+0000 7ff0160b6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0100f9720 0x7ff0101072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:46:21.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.872+0000 7ff0160b6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0101078a0 con 0x7ff0100f9720 2021-11-03T17:46:21.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.872+0000 7ff0160b6700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0101080e0 con 0x7ff010060290 2021-11-03T17:46:21.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.872+0000 7ff0148b3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0100f9720 0x7ff0101072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:46:21.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.872+0000 7ff0148b3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0100f9720 0x7ff0101072a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56290/0 (socket says 172.21.15.26:56290) 2021-11-03T17:46:21.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.872+0000 7ff0148b3700 1 -- 172.21.15.26:0/3356228924 learned_addr learned my addr 172.21.15.26:0/3356228924 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:46:21.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.873+0000 7ff0150b4700 1 --2- 172.21.15.26:0/3356228924 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff010060290 0x7ff010106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:46:21.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.873+0000 7ff0148b3700 1 -- 172.21.15.26:0/3356228924 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff010060290 msgr2=0x7ff010106db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:46:21.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.873+0000 7ff0148b3700 1 --2- 172.21.15.26:0/3356228924 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff010060290 0x7ff010106db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:21.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.873+0000 7ff0148b3700 1 -- 172.21.15.26:0/3356228924 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff00c005040 con 0x7ff0100f9720 2021-11-03T17:46:21.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.873+0000 7ff0150b4700 1 --2- 172.21.15.26:0/3356228924 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff010060290 0x7ff010106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:46:21.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.873+0000 7ff0148b3700 1 --2- 172.21.15.26:0/3356228924 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0100f9720 0x7ff0101072a0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7ff000002700 tx=0x7ff000009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:46:21.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.873+0000 7ff005ffb700 1 -- 172.21.15.26:0/3356228924 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff000009320 con 0x7ff0100f9720 2021-11-03T17:46:21.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.873+0000 7ff005ffb700 1 -- 172.21.15.26:0/3356228924 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff00000f040 con 0x7ff0100f9720 2021-11-03T17:46:21.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.873+0000 7ff0160b6700 1 -- 172.21.15.26:0/3356228924 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0101083c0 con 0x7ff0100f9720 2021-11-03T17:46:21.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.873+0000 7ff005ffb700 1 -- 172.21.15.26:0/3356228924 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff000014810 con 0x7ff0100f9720 2021-11-03T17:46:21.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.873+0000 7ff0160b6700 1 -- 172.21.15.26:0/3356228924 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff010108900 con 0x7ff0100f9720 2021-11-03T17:46:21.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.874+0000 7ff0160b6700 1 -- 172.21.15.26:0/3356228924 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff010059100 con 0x7ff0100f9720 2021-11-03T17:46:21.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.874+0000 7ff005ffb700 1 -- 172.21.15.26:0/3356228924 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ff0000077b0 con 0x7ff0100f9720 2021-11-03T17:46:21.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.875+0000 7ff005ffb700 1 --2- 172.21.15.26:0/3356228924 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7feffc064100 0x7feffc0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:46:21.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.875+0000 7ff005ffb700 1 -- 172.21.15.26:0/3356228924 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ff000080e10 con 0x7ff0100f9720 2021-11-03T17:46:21.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.875+0000 7ff0150b4700 1 --2- 172.21.15.26:0/3356228924 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7feffc064100 0x7feffc0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:46:21.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.875+0000 7ff0150b4700 1 --2- 172.21.15.26:0/3356228924 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7feffc064100 0x7feffc0665c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7ff00c005010 tx=0x7ff00c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:46:21.879 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:21.879+0000 7ff005ffb700 1 -- 172.21.15.26:0/3356228924 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ff000053170 con 0x7ff0100f9720 2021-11-03T17:46:22.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.108+0000 7ff0160b6700 1 -- 172.21.15.26:0/3356228924 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff0100feeb0 con 0x7ff0100f9720 2021-11-03T17:46:22.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.109+0000 7ff005ffb700 1 -- 172.21.15.26:0/3356228924 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7ff0100feeb0 con 0x7ff0100f9720 2021-11-03T17:46:22.103 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:46:22.104 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:46:22.104 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:46:22.104 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:46:22.104 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:46:22.105 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:46:22.105 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:46:22.105 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:46:22.105 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:46:22.105 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:46:22.106 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:46:22.106 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:46:22.106 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:46:22.107 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:46:22.107 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:46:22.107 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:46:22.108 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:46:22.108 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:46:22.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.111+0000 7ff0160b6700 1 -- 172.21.15.26:0/3356228924 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7feffc064100 msgr2=0x7feffc0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:46:22.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.111+0000 7ff0160b6700 1 --2- 172.21.15.26:0/3356228924 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7feffc064100 0x7feffc0665c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7ff00c005010 tx=0x7ff00c009b30).stop 2021-11-03T17:46:22.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.111+0000 7ff0160b6700 1 -- 172.21.15.26:0/3356228924 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0100f9720 msgr2=0x7ff0101072a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:46:22.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.111+0000 7ff0160b6700 1 --2- 172.21.15.26:0/3356228924 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0100f9720 0x7ff0101072a0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7ff000002700 tx=0x7ff000009d60).stop 2021-11-03T17:46:22.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.111+0000 7ff0160b6700 1 -- 172.21.15.26:0/3356228924 shutdown_connections 2021-11-03T17:46:22.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.111+0000 7ff0160b6700 1 --2- 172.21.15.26:0/3356228924 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7feffc064100 0x7feffc0665c0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:22.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.111+0000 7ff0160b6700 1 --2- 172.21.15.26:0/3356228924 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff010060290 0x7ff010106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:22.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.111+0000 7ff0160b6700 1 --2- 172.21.15.26:0/3356228924 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0100f9720 0x7ff0101072a0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:22.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.111+0000 7ff0160b6700 1 -- 172.21.15.26:0/3356228924 >> 172.21.15.26:0/3356228924 conn(0x7ff0100f0ba0 msgr2=0x7ff0100f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:46:22.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.111+0000 7ff0160b6700 1 -- 172.21.15.26:0/3356228924 shutdown_connections 2021-11-03T17:46:22.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.111+0000 7ff0160b6700 1 -- 172.21.15.26:0/3356228924 wait complete. 2021-11-03T17:46:22.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.211+0000 7fd2032a4700 1 -- 172.21.15.26:0/2987048094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1fc0f96b0 msgr2=0x7fd1fc0fbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:46:22.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.211+0000 7fd2032a4700 1 --2- 172.21.15.26:0/2987048094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1fc0f96b0 0x7fd1fc0fbb00 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7fd1f8004660 tx=0x7fd1f8009b30).stop 2021-11-03T17:46:22.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.211+0000 7fd2032a4700 1 -- 172.21.15.26:0/2987048094 shutdown_connections 2021-11-03T17:46:22.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.211+0000 7fd2032a4700 1 --2- 172.21.15.26:0/2987048094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1fc0f96b0 0x7fd1fc0fbb00 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:22.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.211+0000 7fd2032a4700 1 --2- 172.21.15.26:0/2987048094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1fc060270 0x7fd1fc0f91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:46:22.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.211+0000 7fd2032a4700 1 -- 172.21.15.26:0/2987048094 >> 172.21.15.26:0/2987048094 conn(0x7fd1fc0f0ba0 msgr2=0x7fd1fc0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:46:22.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.211+0000 7fd2032a4700 1 -- 172.21.15.26:0/2987048094 shutdown_connections 2021-11-03T17:46:22.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.211+0000 7fd2032a4700 1 -- 172.21.15.26:0/2987048094 wait complete. 2021-11-03T17:46:22.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.212+0000 7fd2032a4700 1 Processor -- start 2021-11-03T17:46:22.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.212+0000 7fd2032a4700 1 -- start start 2021-11-03T17:46:22.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.212+0000 7fd2032a4700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1fc060270 0x7fd1fc108f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:46:22.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.212+0000 7fd2032a4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1fc0f96b0 0x7fd1fc109480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:46:22.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.212+0000 7fd2032a4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1fc109ac0 con 0x7fd1fc0f96b0 2021-11-03T17:46:22.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.212+0000 7fd2032a4700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1fc10a370 con 0x7fd1fc060270 2021-11-03T17:46:22.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.212+0000 7fd201aa1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1fc0f96b0 0x7fd1fc109480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:46:22.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.212+0000 7fd201aa1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1fc0f96b0 0x7fd1fc109480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56300/0 (socket says 172.21.15.26:56300) 2021-11-03T17:46:22.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.212+0000 7fd201aa1700 1 -- 172.21.15.26:0/455511207 learned_addr learned my addr 172.21.15.26:0/455511207 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:46:22.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.212+0000 7fd2022a2700 1 --2- 172.21.15.26:0/455511207 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1fc060270 0x7fd1fc108f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:46:22.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.212+0000 7fd201aa1700 1 -- 172.21.15.26:0/455511207 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1fc060270 msgr2=0x7fd1fc108f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:46:22.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.212+0000 7fd201aa1700 1 --2- 172.21.15.26:0/455511207 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1fc060270 0x7fd1fc108f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:22.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.212+0000 7fd201aa1700 1 -- 172.21.15.26:0/455511207 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f8005040 con 0x7fd1fc0f96b0 2021-11-03T17:46:22.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.212+0000 7fd201aa1700 1 --2- 172.21.15.26:0/455511207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1fc0f96b0 0x7fd1fc109480 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7fd1f8004f60 tx=0x7fd1f8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:46:22.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.213+0000 7fd1f2ffd700 1 -- 172.21.15.26:0/455511207 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1f8018070 con 0x7fd1fc0f96b0 2021-11-03T17:46:22.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.213+0000 7fd1f2ffd700 1 -- 172.21.15.26:0/455511207 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd1f8007c70 con 0x7fd1fc0f96b0 2021-11-03T17:46:22.213 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.213+0000 7fd2032a4700 1 -- 172.21.15.26:0/455511207 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1fc10a5f0 con 0x7fd1fc0f96b0 2021-11-03T17:46:22.213 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.213+0000 7fd1f2ffd700 1 -- 172.21.15.26:0/455511207 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1f801c620 con 0x7fd1fc0f96b0 2021-11-03T17:46:22.213 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.213+0000 7fd2032a4700 1 -- 172.21.15.26:0/455511207 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1fc10ab50 con 0x7fd1fc0f96b0 2021-11-03T17:46:22.214 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.214+0000 7fd2032a4700 1 -- 172.21.15.26:0/455511207 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1fc059100 con 0x7fd1fc0f96b0 2021-11-03T17:46:22.214 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.214+0000 7fd1f2ffd700 1 -- 172.21.15.26:0/455511207 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fd1f801d420 con 0x7fd1fc0f96b0 2021-11-03T17:46:22.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.214+0000 7fd1f2ffd700 1 --2- 172.21.15.26:0/455511207 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd1e8064100 0x7fd1e80665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:46:22.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.215+0000 7fd1f2ffd700 1 -- 172.21.15.26:0/455511207 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fd1f80826b0 con 0x7fd1fc0f96b0 2021-11-03T17:46:22.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.215+0000 7fd2022a2700 1 --2- 172.21.15.26:0/455511207 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd1e8064100 0x7fd1e80665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:46:22.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.215+0000 7fd2022a2700 1 --2- 172.21.15.26:0/455511207 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd1e8064100 0x7fd1e80665c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7fd1ec00b790 tx=0x7fd1ec008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:46:22.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.219+0000 7fd1f2ffd700 1 -- 172.21.15.26:0/455511207 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fd1f8054950 con 0x7fd1fc0f96b0 2021-11-03T17:46:22.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.423+0000 7fd2032a4700 1 -- 172.21.15.26:0/455511207 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd1fc10f5b0 con 0x7fd1fc0f96b0 2021-11-03T17:46:22.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.423+0000 7fd1f2ffd700 1 -- 172.21.15.26:0/455511207 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fd1f8054540 con 0x7fd1fc0f96b0 2021-11-03T17:46:22.418 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:46:22.419 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:46:22.419 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:46:22.420 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:46:22.420 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:46:22.420 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:46:22.421 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:46:22.421 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:46:22.422 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:46:22.422 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:46:22.423 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:46:22.423 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:46:22.423 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:46:22.424 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:46:22.424 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:46:22.425 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:46:22.425 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:46:22.426 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:46:22.426 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:46:22.426 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:46:22.427 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:46:22.428 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:46:22.428 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:46:22.429 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:46:22.429 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:46:22.429 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:46:22.429 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:46:22.430 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:46:22.430 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:46:22.430 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:46:22.430 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:46:22.431 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:46:22.431 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:46:22.431 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:46:22.431 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:46:22.431 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:46:22.432 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:46:22.432 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:46:22.432 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:46:22.433 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.425+0000 7fd2032a4700 1 -- 172.21.15.26:0/455511207 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd1e8064100 msgr2=0x7fd1e80665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:46:22.434 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.425+0000 7fd2032a4700 1 --2- 172.21.15.26:0/455511207 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd1e8064100 0x7fd1e80665c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7fd1ec00b790 tx=0x7fd1ec008040).stop 2021-11-03T17:46:22.434 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.425+0000 7fd2032a4700 1 -- 172.21.15.26:0/455511207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1fc0f96b0 msgr2=0x7fd1fc109480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:46:22.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.425+0000 7fd2032a4700 1 --2- 172.21.15.26:0/455511207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1fc0f96b0 0x7fd1fc109480 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7fd1f8004f60 tx=0x7fd1f8009b30).stop 2021-11-03T17:46:22.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.425+0000 7fd2032a4700 1 -- 172.21.15.26:0/455511207 shutdown_connections 2021-11-03T17:46:22.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.425+0000 7fd2032a4700 1 --2- 172.21.15.26:0/455511207 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd1e8064100 0x7fd1e80665c0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:22.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.425+0000 7fd2032a4700 1 --2- 172.21.15.26:0/455511207 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1fc060270 0x7fd1fc108f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:22.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.425+0000 7fd2032a4700 1 --2- 172.21.15.26:0/455511207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1fc0f96b0 0x7fd1fc109480 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:22.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.425+0000 7fd2032a4700 1 -- 172.21.15.26:0/455511207 >> 172.21.15.26:0/455511207 conn(0x7fd1fc0f0ba0 msgr2=0x7fd1fc0f5030 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:46:22.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.425+0000 7fd2032a4700 1 -- 172.21.15.26:0/455511207 shutdown_connections 2021-11-03T17:46:22.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:22.425+0000 7fd2032a4700 1 -- 172.21.15.26:0/455511207 wait complete. 2021-11-03T17:46:22.437 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:46:22.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:22 smithi026 ceph-mon[96795]: pgmap v1551: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:22.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:22 smithi026 ceph-mon[96795]: from='client.35740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:46:22.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:22 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3356228924' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:46:22.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:22 smithi194 ceph-mon[65619]: pgmap v1551: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:22.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:22 smithi194 ceph-mon[65619]: from='client.35740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:46:22.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:22 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3356228924' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:46:23.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:23 smithi026 ceph-mon[96795]: from='client.35744 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:46:23.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:23 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/455511207' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:46:23.726 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:23 smithi194 ceph-mon[65619]: from='client.35744 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:46:23.727 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:23 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/455511207' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:46:24.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:24 smithi026 ceph-mon[96795]: pgmap v1552: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:24.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:46:24.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:24 smithi026 ceph-mon[96795]: poll took 60070.180 ms: 1 events 2021-11-03T17:46:24.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:46:24.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:46:24.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:46:24.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:46:24.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:46:24.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:46:24.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:46:24.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:24 smithi194 ceph-mon[65619]: pgmap v1552: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:24.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:46:24.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:24 smithi194 ceph-mon[65619]: poll took 60070.180 ms: 1 events 2021-11-03T17:46:24.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:46:24.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:46:24.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:46:24.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:46:24.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:46:24.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:46:24.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:46:25.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:25 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:46:25.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:25 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:46:25.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:25 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:46:25.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:25 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:46:26.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:26 smithi026 ceph-mon[96795]: pgmap v1553: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:26.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:26 smithi194 ceph-mon[65619]: pgmap v1553: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:28.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:28 smithi026 ceph-mon[96795]: pgmap v1554: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:28.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:28 smithi194 ceph-mon[65619]: pgmap v1554: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:30.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:30 smithi026 ceph-mon[96795]: pgmap v1555: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:30.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:30 smithi194 ceph-mon[65619]: pgmap v1555: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:32.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:32 smithi026 ceph-mon[96795]: pgmap v1556: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:32.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:32 smithi194 ceph-mon[65619]: pgmap v1556: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:34.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:34 smithi026 ceph-mon[96795]: pgmap v1557: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:34.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:34 smithi194 ceph-mon[65619]: pgmap v1557: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:36.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:36 smithi026 ceph-mon[96795]: pgmap v1558: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:36.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:36 smithi194 ceph-mon[65619]: pgmap v1558: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:38.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:38 smithi026 ceph-mon[96795]: pgmap v1559: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:38.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:38 smithi194 ceph-mon[65619]: pgmap v1559: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:39.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:46:39.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:46:40.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:40 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:46:40.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:40 smithi026 ceph-mon[96795]: pgmap v1560: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:40.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:40 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:46:40.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:40 smithi194 ceph-mon[65619]: pgmap v1560: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:42.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:42 smithi026 ceph-mon[96795]: pgmap v1561: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:42.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:42 smithi194 ceph-mon[65619]: pgmap v1561: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:44.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:44 smithi026 ceph-mon[96795]: pgmap v1562: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:44.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:44 smithi194 ceph-mon[65619]: pgmap v1562: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:46.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:46 smithi026 ceph-mon[96795]: pgmap v1563: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:46.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:46 smithi194 ceph-mon[65619]: pgmap v1563: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:48 smithi026 ceph-mon[96795]: pgmap v1564: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:46:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:46:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:48 smithi194 ceph-mon[65619]: pgmap v1564: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:46:48.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:46:50.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:50 smithi026 ceph-mon[96795]: pgmap v1565: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:50.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:50 smithi194 ceph-mon[65619]: pgmap v1565: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:52.538 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.538+0000 7f05263da700 1 -- 172.21.15.26:0/4166198174 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05200f6860 msgr2=0x7f05200f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:46:52.538 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.538+0000 7f05263da700 1 --2- 172.21.15.26:0/4166198174 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05200f6860 0x7f05200f6cc0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7f0514004660 tx=0x7f0514009b30).stop 2021-11-03T17:46:52.539 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.538+0000 7f05263da700 1 -- 172.21.15.26:0/4166198174 shutdown_connections 2021-11-03T17:46:52.539 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.538+0000 7f05263da700 1 --2- 172.21.15.26:0/4166198174 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05200f6860 0x7f05200f6cc0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:52.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.538+0000 7f05263da700 1 --2- 172.21.15.26:0/4166198174 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05200f55c0 0x7f05200f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:52.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.538+0000 7f05263da700 1 -- 172.21.15.26:0/4166198174 >> 172.21.15.26:0/4166198174 conn(0x7f05200f0d40 msgr2=0x7f05200f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:46:52.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.538+0000 7f05263da700 1 -- 172.21.15.26:0/4166198174 shutdown_connections 2021-11-03T17:46:52.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.538+0000 7f05263da700 1 -- 172.21.15.26:0/4166198174 wait complete. 2021-11-03T17:46:52.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.539+0000 7f05263da700 1 Processor -- start 2021-11-03T17:46:52.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.539+0000 7f05263da700 1 -- start start 2021-11-03T17:46:52.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.539+0000 7f05263da700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05200f55c0 0x7f0520105e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:46:52.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.539+0000 7f05263da700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05200f6860 0x7f0520106320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:46:52.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.539+0000 7f05263da700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0520106920 con 0x7f05200f55c0 2021-11-03T17:46:52.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.539+0000 7f05263da700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0520107130 con 0x7f05200f6860 2021-11-03T17:46:52.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.539+0000 7f051ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05200f55c0 0x7f0520105e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:46:52.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.539+0000 7f051ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05200f55c0 0x7f0520105e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56316/0 (socket says 172.21.15.26:56316) 2021-11-03T17:46:52.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.539+0000 7f051ffff700 1 -- 172.21.15.26:0/1082211392 learned_addr learned my addr 172.21.15.26:0/1082211392 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:46:52.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.539+0000 7f051f7fe700 1 --2- 172.21.15.26:0/1082211392 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05200f6860 0x7f0520106320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:46:52.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.540+0000 7f051ffff700 1 -- 172.21.15.26:0/1082211392 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05200f6860 msgr2=0x7f0520106320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:46:52.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.540+0000 7f051ffff700 1 --2- 172.21.15.26:0/1082211392 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05200f6860 0x7f0520106320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:52.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.540+0000 7f051ffff700 1 -- 172.21.15.26:0/1082211392 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0514005040 con 0x7f05200f55c0 2021-11-03T17:46:52.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.540+0000 7f051ffff700 1 --2- 172.21.15.26:0/1082211392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05200f55c0 0x7f0520105e30 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7f0510002700 tx=0x7f0510009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:46:52.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.540+0000 7f051cff9700 1 -- 172.21.15.26:0/1082211392 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0510009320 con 0x7f05200f55c0 2021-11-03T17:46:52.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.540+0000 7f05263da700 1 -- 172.21.15.26:0/1082211392 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05201073b0 con 0x7f05200f55c0 2021-11-03T17:46:52.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.540+0000 7f051cff9700 1 -- 172.21.15.26:0/1082211392 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f051000f040 con 0x7f05200f55c0 2021-11-03T17:46:52.548 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.540+0000 7f051cff9700 1 -- 172.21.15.26:0/1082211392 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05100148e0 con 0x7f05200f55c0 2021-11-03T17:46:52.548 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.540+0000 7f05263da700 1 -- 172.21.15.26:0/1082211392 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0520107970 con 0x7f05200f55c0 2021-11-03T17:46:52.549 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.541+0000 7f05263da700 1 -- 172.21.15.26:0/1082211392 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05200f49b0 con 0x7f05200f55c0 2021-11-03T17:46:52.549 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.541+0000 7f051cff9700 1 -- 172.21.15.26:0/1082211392 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f0510009480 con 0x7f05200f55c0 2021-11-03T17:46:52.549 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.542+0000 7f051cff9700 1 --2- 172.21.15.26:0/1082211392 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f05080640b0 0x7f0508066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:46:52.550 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.542+0000 7f051cff9700 1 -- 172.21.15.26:0/1082211392 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f0510080b80 con 0x7f05200f55c0 2021-11-03T17:46:52.550 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.542+0000 7f051f7fe700 1 --2- 172.21.15.26:0/1082211392 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f05080640b0 0x7f0508066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:46:52.551 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.542+0000 7f051f7fe700 1 --2- 172.21.15.26:0/1082211392 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f05080640b0 0x7f0508066570 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f0514004630 tx=0x7f0514009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:46:52.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.546+0000 7f051cff9700 1 -- 172.21.15.26:0/1082211392 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f0510052e60 con 0x7f05200f55c0 2021-11-03T17:46:52.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:52 smithi026 ceph-mon[96795]: pgmap v1566: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:52.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.725+0000 7f05263da700 1 -- 172.21.15.26:0/1082211392 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f05200ff800 con 0x7f05080640b0 2021-11-03T17:46:52.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.726+0000 7f051cff9700 1 -- 172.21.15.26:0/1082211392 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f05200ff800 con 0x7f05080640b0 2021-11-03T17:46:52.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.728+0000 7f05263da700 1 -- 172.21.15.26:0/1082211392 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f05080640b0 msgr2=0x7f0508066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:46:52.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.728+0000 7f05263da700 1 --2- 172.21.15.26:0/1082211392 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f05080640b0 0x7f0508066570 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f0514004630 tx=0x7f0514009b30).stop 2021-11-03T17:46:52.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.728+0000 7f05263da700 1 -- 172.21.15.26:0/1082211392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05200f55c0 msgr2=0x7f0520105e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:46:52.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.728+0000 7f05263da700 1 --2- 172.21.15.26:0/1082211392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05200f55c0 0x7f0520105e30 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7f0510002700 tx=0x7f0510009e00).stop 2021-11-03T17:46:52.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.728+0000 7f05263da700 1 -- 172.21.15.26:0/1082211392 shutdown_connections 2021-11-03T17:46:52.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.728+0000 7f05263da700 1 --2- 172.21.15.26:0/1082211392 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f05080640b0 0x7f0508066570 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:52.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.728+0000 7f05263da700 1 --2- 172.21.15.26:0/1082211392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05200f55c0 0x7f0520105e30 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:52.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.728+0000 7f05263da700 1 --2- 172.21.15.26:0/1082211392 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05200f6860 0x7f0520106320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:52.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.728+0000 7f05263da700 1 -- 172.21.15.26:0/1082211392 >> 172.21.15.26:0/1082211392 conn(0x7f05200f0d40 msgr2=0x7f05200fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:46:52.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.728+0000 7f05263da700 1 -- 172.21.15.26:0/1082211392 shutdown_connections 2021-11-03T17:46:52.726 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.728+0000 7f05263da700 1 -- 172.21.15.26:0/1082211392 wait complete. 2021-11-03T17:46:52.733 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:46:52.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:52 smithi194 ceph-mon[65619]: pgmap v1566: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:52.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.828+0000 7f2d3bfff700 1 -- 172.21.15.26:0/505853404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d3c0f66e0 msgr2=0x7f2d3c0f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:46:52.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.828+0000 7f2d3bfff700 1 --2- 172.21.15.26:0/505853404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d3c0f66e0 0x7f2d3c0f6b40 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7f2d30004660 tx=0x7f2d30009b30).stop 2021-11-03T17:46:52.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.828+0000 7f2d3bfff700 1 -- 172.21.15.26:0/505853404 shutdown_connections 2021-11-03T17:46:52.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.828+0000 7f2d3bfff700 1 --2- 172.21.15.26:0/505853404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d3c0f66e0 0x7f2d3c0f6b40 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:52.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.828+0000 7f2d3bfff700 1 --2- 172.21.15.26:0/505853404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d3c0f5440 0x7f2d3c0f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:52.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.828+0000 7f2d3bfff700 1 -- 172.21.15.26:0/505853404 >> 172.21.15.26:0/505853404 conn(0x7f2d3c0f0ba0 msgr2=0x7f2d3c0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:46:52.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.829+0000 7f2d3bfff700 1 -- 172.21.15.26:0/505853404 shutdown_connections 2021-11-03T17:46:52.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.829+0000 7f2d3bfff700 1 -- 172.21.15.26:0/505853404 wait complete. 2021-11-03T17:46:52.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.829+0000 7f2d3bfff700 1 Processor -- start 2021-11-03T17:46:52.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.829+0000 7f2d3bfff700 1 -- start start 2021-11-03T17:46:52.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.829+0000 7f2d3bfff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d3c0f5440 0x7f2d3c1099b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:46:52.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.829+0000 7f2d3bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d3c0f66e0 0x7f2d3c10beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:46:52.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.829+0000 7f2d3bfff700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3c0603e0 con 0x7f2d3c0f66e0 2021-11-03T17:46:52.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.829+0000 7f2d3bfff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3c060520 con 0x7f2d3c0f5440 2021-11-03T17:46:52.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.829+0000 7f2d3a7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d3c0f66e0 0x7f2d3c10beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:46:52.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.830+0000 7f2d3a7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d3c0f66e0 0x7f2d3c10beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56330/0 (socket says 172.21.15.26:56330) 2021-11-03T17:46:52.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.830+0000 7f2d3a7fc700 1 -- 172.21.15.26:0/3772744564 learned_addr learned my addr 172.21.15.26:0/3772744564 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:46:52.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.830+0000 7f2d3affd700 1 --2- 172.21.15.26:0/3772744564 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d3c0f5440 0x7f2d3c1099b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:46:52.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.830+0000 7f2d3a7fc700 1 -- 172.21.15.26:0/3772744564 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d3c0f5440 msgr2=0x7f2d3c1099b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:46:52.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.830+0000 7f2d3a7fc700 1 --2- 172.21.15.26:0/3772744564 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d3c0f5440 0x7f2d3c1099b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:52.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.830+0000 7f2d3a7fc700 1 -- 172.21.15.26:0/3772744564 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d30005040 con 0x7f2d3c0f66e0 2021-11-03T17:46:52.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.830+0000 7f2d3affd700 1 --2- 172.21.15.26:0/3772744564 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d3c0f5440 0x7f2d3c1099b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:46:52.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.830+0000 7f2d3a7fc700 1 --2- 172.21.15.26:0/3772744564 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d3c0f66e0 0x7f2d3c10beb0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7f2d30009990 tx=0x7f2d30009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:46:52.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.830+0000 7f2d237fe700 1 -- 172.21.15.26:0/3772744564 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d30018070 con 0x7f2d3c0f66e0 2021-11-03T17:46:52.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.830+0000 7f2d237fe700 1 -- 172.21.15.26:0/3772744564 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2d30007ba0 con 0x7f2d3c0f66e0 2021-11-03T17:46:52.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.830+0000 7f2d3bfff700 1 -- 172.21.15.26:0/3772744564 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d3c10c400 con 0x7f2d3c0f66e0 2021-11-03T17:46:52.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.830+0000 7f2d237fe700 1 -- 172.21.15.26:0/3772744564 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d3001c3c0 con 0x7f2d3c0f66e0 2021-11-03T17:46:52.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.830+0000 7f2d3bfff700 1 -- 172.21.15.26:0/3772744564 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d3c10c960 con 0x7f2d3c0f66e0 2021-11-03T17:46:52.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.831+0000 7f2d3bfff700 1 -- 172.21.15.26:0/3772744564 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d3c045ad0 con 0x7f2d3c0f66e0 2021-11-03T17:46:52.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.832+0000 7f2d237fe700 1 -- 172.21.15.26:0/3772744564 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f2d3001d420 con 0x7f2d3c0f66e0 2021-11-03T17:46:52.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.832+0000 7f2d237fe700 1 --2- 172.21.15.26:0/3772744564 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2d24064100 0x7f2d240665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:46:52.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.832+0000 7f2d237fe700 1 -- 172.21.15.26:0/3772744564 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f2d300823e0 con 0x7f2d3c0f66e0 2021-11-03T17:46:52.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.832+0000 7f2d3affd700 1 --2- 172.21.15.26:0/3772744564 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2d24064100 0x7f2d240665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:46:52.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.833+0000 7f2d3affd700 1 --2- 172.21.15.26:0/3772744564 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2d24064100 0x7f2d240665c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f2d2c009880 tx=0x7f2d2c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:46:52.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:52.836+0000 7f2d237fe700 1 -- 172.21.15.26:0/3772744564 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f2d300547a0 con 0x7f2d3c0f66e0 2021-11-03T17:46:53.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.011+0000 7f2d3bfff700 1 -- 172.21.15.26:0/3772744564 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d3c0fdd70 con 0x7f2d24064100 2021-11-03T17:46:53.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.025+0000 7f2d237fe700 1 -- 172.21.15.26:0/3772744564 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f2d3c0fdd70 con 0x7f2d24064100 2021-11-03T17:46:53.020 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:46:53.021 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (58m) 7m ago 59m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:46:53.021 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (50m) 7m ago 59m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:46:53.021 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (50m) 6m ago 58m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:46:53.021 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (57m) 7m ago 59m 40.8M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:46:53.022 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (51m) 7m ago 54m 25.1M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:46:53.022 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (51m) 7m ago 54m 25.7M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:46:53.022 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (54m) 6m ago 54m 26.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:46:53.022 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (54m) 6m ago 54m 26.3M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:46:53.023 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (51m) 7m ago 60m 533M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:46:53.023 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (51m) 6m ago 58m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:46:53.023 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (51m) 7m ago 60m 209M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:46:53.023 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (50m) 6m ago 58m 103M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:46:53.024 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (58m) 7m ago 58m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:46:53.024 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (58m) 6m ago 58m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:46:53.024 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (49m) 7m ago 57m 251M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:46:53.024 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (49m) 7m ago 57m 270M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:46:53.024 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (48m) 7m ago 57m 225M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:46:53.025 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (48m) 6m ago 56m 287M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:46:53.025 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (47m) 6m ago 56m 246M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:46:53.025 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (47m) 6m ago 56m 235M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:46:53.025 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (57m) 7m ago 58m 56.7M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:46:53.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.027+0000 7f2d3bfff700 1 -- 172.21.15.26:0/3772744564 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2d24064100 msgr2=0x7f2d240665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:46:53.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.027+0000 7f2d3bfff700 1 --2- 172.21.15.26:0/3772744564 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2d24064100 0x7f2d240665c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f2d2c009880 tx=0x7f2d2c00b040).stop 2021-11-03T17:46:53.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.027+0000 7f2d3bfff700 1 -- 172.21.15.26:0/3772744564 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d3c0f66e0 msgr2=0x7f2d3c10beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:46:53.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.027+0000 7f2d3bfff700 1 --2- 172.21.15.26:0/3772744564 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d3c0f66e0 0x7f2d3c10beb0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7f2d30009990 tx=0x7f2d30009b30).stop 2021-11-03T17:46:53.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.027+0000 7f2d3bfff700 1 -- 172.21.15.26:0/3772744564 shutdown_connections 2021-11-03T17:46:53.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.027+0000 7f2d3bfff700 1 --2- 172.21.15.26:0/3772744564 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2d24064100 0x7f2d240665c0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:53.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.027+0000 7f2d3bfff700 1 --2- 172.21.15.26:0/3772744564 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d3c0f5440 0x7f2d3c1099b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:53.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.027+0000 7f2d3bfff700 1 --2- 172.21.15.26:0/3772744564 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d3c0f66e0 0x7f2d3c10beb0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:53.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.027+0000 7f2d3bfff700 1 -- 172.21.15.26:0/3772744564 >> 172.21.15.26:0/3772744564 conn(0x7f2d3c0f0ba0 msgr2=0x7f2d3c0fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:46:53.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.027+0000 7f2d3bfff700 1 -- 172.21.15.26:0/3772744564 shutdown_connections 2021-11-03T17:46:53.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.028+0000 7f2d3bfff700 1 -- 172.21.15.26:0/3772744564 wait complete. 2021-11-03T17:46:53.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.127+0000 7f21febdb700 1 -- 172.21.15.26:0/1193921973 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21f80f66e0 msgr2=0x7f21f80f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:46:53.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.127+0000 7f21febdb700 1 --2- 172.21.15.26:0/1193921973 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21f80f66e0 0x7f21f80f6b00 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7f21f00099e0 tx=0x7f21f0004d10).stop 2021-11-03T17:46:53.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.127+0000 7f21febdb700 1 -- 172.21.15.26:0/1193921973 shutdown_connections 2021-11-03T17:46:53.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.127+0000 7f21febdb700 1 --2- 172.21.15.26:0/1193921973 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21f80f6ff0 0x7f21f80f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:53.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.127+0000 7f21febdb700 1 --2- 172.21.15.26:0/1193921973 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21f80f66e0 0x7f21f80f6b00 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:53.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.127+0000 7f21febdb700 1 -- 172.21.15.26:0/1193921973 >> 172.21.15.26:0/1193921973 conn(0x7f21f80f1f00 msgr2=0x7f21f80f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:46:53.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.127+0000 7f21febdb700 1 -- 172.21.15.26:0/1193921973 shutdown_connections 2021-11-03T17:46:53.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.127+0000 7f21febdb700 1 -- 172.21.15.26:0/1193921973 wait complete. 2021-11-03T17:46:53.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.127+0000 7f21febdb700 1 Processor -- start 2021-11-03T17:46:53.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.127+0000 7f21febdb700 1 -- start start 2021-11-03T17:46:53.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.128+0000 7f21febdb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21f80f66e0 0x7f21f806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:46:53.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.128+0000 7f21febdb700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21f80f6ff0 0x7f21f8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:46:53.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.128+0000 7f21febdb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f806a380 con 0x7f21f80f66e0 2021-11-03T17:46:53.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.128+0000 7f21febdb700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f806a4c0 con 0x7f21f80f6ff0 2021-11-03T17:46:53.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.128+0000 7f21fc977700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21f80f66e0 0x7f21f806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:46:53.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.128+0000 7f21fc977700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21f80f66e0 0x7f21f806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56338/0 (socket says 172.21.15.26:56338) 2021-11-03T17:46:53.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.128+0000 7f21fc977700 1 -- 172.21.15.26:0/1259339222 learned_addr learned my addr 172.21.15.26:0/1259339222 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:46:53.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.128+0000 7f21f7fff700 1 --2- 172.21.15.26:0/1259339222 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21f80f6ff0 0x7f21f8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:46:53.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.128+0000 7f21fc977700 1 -- 172.21.15.26:0/1259339222 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21f80f6ff0 msgr2=0x7f21f8069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:46:53.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.128+0000 7f21fc977700 1 --2- 172.21.15.26:0/1259339222 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21f80f6ff0 0x7f21f8069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:53.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.128+0000 7f21fc977700 1 -- 172.21.15.26:0/1259339222 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f0009640 con 0x7f21f80f66e0 2021-11-03T17:46:53.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.128+0000 7f21f7fff700 1 --2- 172.21.15.26:0/1259339222 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21f80f6ff0 0x7f21f8069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:46:53.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.128+0000 7f21fc977700 1 --2- 172.21.15.26:0/1259339222 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21f80f66e0 0x7f21f806b9a0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7f21f0004b70 tx=0x7f21f0004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:46:53.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.128+0000 7f21f57fa700 1 -- 172.21.15.26:0/1259339222 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21f000e040 con 0x7f21f80f66e0 2021-11-03T17:46:53.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.128+0000 7f21f57fa700 1 -- 172.21.15.26:0/1259339222 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f21f0018040 con 0x7f21f80f66e0 2021-11-03T17:46:53.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.128+0000 7f21febdb700 1 -- 172.21.15.26:0/1259339222 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f806a740 con 0x7f21f80f66e0 2021-11-03T17:46:53.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.129+0000 7f21febdb700 1 -- 172.21.15.26:0/1259339222 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f806ac20 con 0x7f21f80f66e0 2021-11-03T17:46:53.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.129+0000 7f21f57fa700 1 -- 172.21.15.26:0/1259339222 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21f001c650 con 0x7f21f80f66e0 2021-11-03T17:46:53.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.129+0000 7f21febdb700 1 -- 172.21.15.26:0/1259339222 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d8004fa0 con 0x7f21f80f66e0 2021-11-03T17:46:53.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.130+0000 7f21f57fa700 1 -- 172.21.15.26:0/1259339222 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f21f0023030 con 0x7f21f80f66e0 2021-11-03T17:46:53.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.130+0000 7f21f57fa700 1 --2- 172.21.15.26:0/1259339222 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f21e00640b0 0x7f21e0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:46:53.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.130+0000 7f21f57fa700 1 -- 172.21.15.26:0/1259339222 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f21f0081a00 con 0x7f21f80f66e0 2021-11-03T17:46:53.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.130+0000 7f21f7fff700 1 --2- 172.21.15.26:0/1259339222 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f21e00640b0 0x7f21e0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:46:53.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.131+0000 7f21f7fff700 1 --2- 172.21.15.26:0/1259339222 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f21e00640b0 0x7f21e0066570 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f21ec0041d0 tx=0x7f21ec009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:46:53.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.134+0000 7f21f57fa700 1 -- 172.21.15.26:0/1259339222 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f21f0053e10 con 0x7f21f80f66e0 2021-11-03T17:46:53.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.364+0000 7f21febdb700 1 -- 172.21.15.26:0/1259339222 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f21d8005e80 con 0x7f21f80f66e0 2021-11-03T17:46:53.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.364+0000 7f21f57fa700 1 -- 172.21.15.26:0/1259339222 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f21f00212e0 con 0x7f21f80f66e0 2021-11-03T17:46:53.360 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:46:53.360 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:46:53.360 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:46:53.360 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:46:53.361 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:46:53.361 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:46:53.361 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:46:53.361 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:46:53.361 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:46:53.362 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:46:53.362 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:46:53.362 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:46:53.362 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:46:53.363 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:46:53.363 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:46:53.363 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:46:53.363 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:46:53.363 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:46:53.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.366+0000 7f21febdb700 1 -- 172.21.15.26:0/1259339222 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f21e00640b0 msgr2=0x7f21e0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:46:53.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.366+0000 7f21febdb700 1 --2- 172.21.15.26:0/1259339222 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f21e00640b0 0x7f21e0066570 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f21ec0041d0 tx=0x7f21ec009040).stop 2021-11-03T17:46:53.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.366+0000 7f21febdb700 1 -- 172.21.15.26:0/1259339222 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21f80f66e0 msgr2=0x7f21f806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:46:53.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.366+0000 7f21febdb700 1 --2- 172.21.15.26:0/1259339222 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21f80f66e0 0x7f21f806b9a0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7f21f0004b70 tx=0x7f21f0004d10).stop 2021-11-03T17:46:53.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.366+0000 7f21febdb700 1 -- 172.21.15.26:0/1259339222 shutdown_connections 2021-11-03T17:46:53.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.366+0000 7f21febdb700 1 --2- 172.21.15.26:0/1259339222 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f21e00640b0 0x7f21e0066570 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:53.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.366+0000 7f21febdb700 1 --2- 172.21.15.26:0/1259339222 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21f80f66e0 0x7f21f806b9a0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:53.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.366+0000 7f21febdb700 1 --2- 172.21.15.26:0/1259339222 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21f80f6ff0 0x7f21f8069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:53.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.366+0000 7f21febdb700 1 -- 172.21.15.26:0/1259339222 >> 172.21.15.26:0/1259339222 conn(0x7f21f80f1f00 msgr2=0x7f21f80fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:46:53.367 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.366+0000 7f21febdb700 1 -- 172.21.15.26:0/1259339222 shutdown_connections 2021-11-03T17:46:53.367 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.366+0000 7f21febdb700 1 -- 172.21.15.26:0/1259339222 wait complete. 2021-11-03T17:46:53.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.467+0000 7f9829d86700 1 -- 172.21.15.26:0/1014055756 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98240f66e0 msgr2=0x7f98240f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:46:53.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.467+0000 7f9829d86700 1 --2- 172.21.15.26:0/1014055756 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98240f66e0 0x7f98240f6b40 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7f980c0099e0 tx=0x7f980c004d10).stop 2021-11-03T17:46:53.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.467+0000 7f9829d86700 1 -- 172.21.15.26:0/1014055756 shutdown_connections 2021-11-03T17:46:53.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.467+0000 7f9829d86700 1 --2- 172.21.15.26:0/1014055756 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98240f66e0 0x7f98240f6b40 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:53.464 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.467+0000 7f9829d86700 1 --2- 172.21.15.26:0/1014055756 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98240f5440 0x7f98240f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:53.464 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.467+0000 7f9829d86700 1 -- 172.21.15.26:0/1014055756 >> 172.21.15.26:0/1014055756 conn(0x7f98240f0ba0 msgr2=0x7f98240f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:46:53.464 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.467+0000 7f9829d86700 1 -- 172.21.15.26:0/1014055756 shutdown_connections 2021-11-03T17:46:53.464 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.467+0000 7f9829d86700 1 -- 172.21.15.26:0/1014055756 wait complete. 2021-11-03T17:46:53.464 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.468+0000 7f9829d86700 1 Processor -- start 2021-11-03T17:46:53.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.468+0000 7f9829d86700 1 -- start start 2021-11-03T17:46:53.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.468+0000 7f9829d86700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98240f5440 0x7f9824109b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:46:53.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.468+0000 7f9829d86700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98240f66e0 0x7f982410c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:46:53.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.468+0000 7f9829d86700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98240603c0 con 0x7f98240f5440 2021-11-03T17:46:53.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.468+0000 7f9829d86700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9824060500 con 0x7f98240f66e0 2021-11-03T17:46:53.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.468+0000 7f9828d84700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98240f5440 0x7f9824109b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:46:53.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.469+0000 7f9828d84700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98240f5440 0x7f9824109b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56348/0 (socket says 172.21.15.26:56348) 2021-11-03T17:46:53.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.469+0000 7f9828d84700 1 -- 172.21.15.26:0/3656039521 learned_addr learned my addr 172.21.15.26:0/3656039521 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:46:53.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.469+0000 7f9823fff700 1 --2- 172.21.15.26:0/3656039521 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98240f66e0 0x7f982410c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:46:53.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.469+0000 7f9828d84700 1 -- 172.21.15.26:0/3656039521 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98240f66e0 msgr2=0x7f982410c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:46:53.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.469+0000 7f9828d84700 1 --2- 172.21.15.26:0/3656039521 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98240f66e0 0x7f982410c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:53.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.469+0000 7f9828d84700 1 -- 172.21.15.26:0/3656039521 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f980c009640 con 0x7f98240f5440 2021-11-03T17:46:53.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.469+0000 7f9828d84700 1 --2- 172.21.15.26:0/3656039521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98240f5440 0x7f9824109b40 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7f9814002700 tx=0x7f9814009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:46:53.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.469+0000 7f98217fa700 1 -- 172.21.15.26:0/3656039521 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98140079c0 con 0x7f98240f5440 2021-11-03T17:46:53.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.469+0000 7f9829d86700 1 -- 172.21.15.26:0/3656039521 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f982410c5f0 con 0x7f98240f5440 2021-11-03T17:46:53.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.469+0000 7f98217fa700 1 -- 172.21.15.26:0/3656039521 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f981400f040 con 0x7f98240f5440 2021-11-03T17:46:53.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.469+0000 7f98217fa700 1 -- 172.21.15.26:0/3656039521 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9814014860 con 0x7f98240f5440 2021-11-03T17:46:53.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.469+0000 7f9829d86700 1 -- 172.21.15.26:0/3656039521 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f982410cb00 con 0x7f98240f5440 2021-11-03T17:46:53.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.470+0000 7f9829d86700 1 -- 172.21.15.26:0/3656039521 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9824045ad0 con 0x7f98240f5440 2021-11-03T17:46:53.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.471+0000 7f98217fa700 1 -- 172.21.15.26:0/3656039521 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f981401b060 con 0x7f98240f5440 2021-11-03T17:46:53.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.471+0000 7f98217fa700 1 --2- 172.21.15.26:0/3656039521 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9810064100 0x7f98100665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:46:53.472 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.471+0000 7f98217fa700 1 -- 172.21.15.26:0/3656039521 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f9814080650 con 0x7f98240f5440 2021-11-03T17:46:53.472 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.471+0000 7f9823fff700 1 --2- 172.21.15.26:0/3656039521 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9810064100 0x7f98100665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:46:53.472 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.472+0000 7f9823fff700 1 --2- 172.21.15.26:0/3656039521 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9810064100 0x7f98100665c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f980c003380 tx=0x7f980c004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:46:53.473 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.475+0000 7f98217fa700 1 -- 172.21.15.26:0/3656039521 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f98140529b0 con 0x7f98240f5440 2021-11-03T17:46:53.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:53 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1259339222' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:46:53.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.680+0000 7f9829d86700 1 -- 172.21.15.26:0/3656039521 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f98240586e0 con 0x7f98240f5440 2021-11-03T17:46:53.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.680+0000 7f98217fa700 1 -- 172.21.15.26:0/3656039521 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f9814019070 con 0x7f98240f5440 2021-11-03T17:46:53.675 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:46:53.676 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:46:53.676 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:46:53.676 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:46:53.676 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:46:53.677 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:46:53.677 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:46:53.677 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:46:53.677 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:46:53.677 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:46:53.678 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:46:53.678 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:46:53.678 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:46:53.678 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:46:53.679 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:46:53.679 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:46:53.679 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:46:53.679 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:46:53.679 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:46:53.680 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:46:53.680 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:46:53.680 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:46:53.680 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:46:53.681 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:46:53.681 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:46:53.681 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:46:53.681 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:46:53.681 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:46:53.682 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:46:53.682 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:46:53.682 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:46:53.682 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:46:53.683 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:46:53.683 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:46:53.683 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:46:53.683 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:46:53.683 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:46:53.684 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:46:53.684 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:46:53.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.682+0000 7f9829d86700 1 -- 172.21.15.26:0/3656039521 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9810064100 msgr2=0x7f98100665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:46:53.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.682+0000 7f9829d86700 1 --2- 172.21.15.26:0/3656039521 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9810064100 0x7f98100665c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f980c003380 tx=0x7f980c004d10).stop 2021-11-03T17:46:53.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.682+0000 7f9829d86700 1 -- 172.21.15.26:0/3656039521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98240f5440 msgr2=0x7f9824109b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:46:53.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.682+0000 7f9829d86700 1 --2- 172.21.15.26:0/3656039521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98240f5440 0x7f9824109b40 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7f9814002700 tx=0x7f9814009d80).stop 2021-11-03T17:46:53.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.682+0000 7f9829d86700 1 -- 172.21.15.26:0/3656039521 shutdown_connections 2021-11-03T17:46:53.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.682+0000 7f9829d86700 1 --2- 172.21.15.26:0/3656039521 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9810064100 0x7f98100665c0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:53.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.682+0000 7f9829d86700 1 --2- 172.21.15.26:0/3656039521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98240f5440 0x7f9824109b40 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:53.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.682+0000 7f9829d86700 1 --2- 172.21.15.26:0/3656039521 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98240f66e0 0x7f982410c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:46:53.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.682+0000 7f9829d86700 1 -- 172.21.15.26:0/3656039521 >> 172.21.15.26:0/3656039521 conn(0x7f98240f0ba0 msgr2=0x7f98240fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:46:53.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.682+0000 7f9829d86700 1 -- 172.21.15.26:0/3656039521 shutdown_connections 2021-11-03T17:46:53.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:46:53.682+0000 7f9829d86700 1 -- 172.21.15.26:0/3656039521 wait complete. 2021-11-03T17:46:53.687 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:46:53.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:53 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1259339222' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:46:54.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:54 smithi026 ceph-mon[96795]: from='client.35756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:46:54.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:54 smithi026 ceph-mon[96795]: from='client.35760 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:46:54.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:54 smithi026 ceph-mon[96795]: pgmap v1567: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:54.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:54 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3656039521' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:46:54.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:46:54.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:54 smithi194 ceph-mon[65619]: from='client.35756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:46:54.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:54 smithi194 ceph-mon[65619]: from='client.35760 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:46:54.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:54 smithi194 ceph-mon[65619]: pgmap v1567: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:54.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:54 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3656039521' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:46:54.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:46:55.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:55 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:46:55.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:55 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:46:56.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:56 smithi026 ceph-mon[96795]: pgmap v1568: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:56.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:56 smithi194 ceph-mon[65619]: pgmap v1568: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:58.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:46:58 smithi026 ceph-mon[96795]: pgmap v1569: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:46:58.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:46:58 smithi194 ceph-mon[65619]: pgmap v1569: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:00.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:00 smithi194 ceph-mon[65619]: pgmap v1570: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:00.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:00 smithi026 ceph-mon[96795]: pgmap v1570: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:02.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:02 smithi194 ceph-mon[65619]: pgmap v1571: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:02.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:02 smithi026 ceph-mon[96795]: pgmap v1571: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:04.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:04 smithi194 ceph-mon[65619]: pgmap v1572: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:04.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:04 smithi026 ceph-mon[96795]: pgmap v1572: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:06.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:06 smithi194 ceph-mon[65619]: pgmap v1573: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:06.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:06 smithi026 ceph-mon[96795]: pgmap v1573: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:08.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:08 smithi194 ceph-mon[65619]: pgmap v1574: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:08.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:08 smithi026 ceph-mon[96795]: pgmap v1574: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:09.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:09 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:47:09.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:09 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:47:10.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:10 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:47:10.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:10 smithi194 ceph-mon[65619]: pgmap v1575: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:10.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:10 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:47:10.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:10 smithi026 ceph-mon[96795]: pgmap v1575: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:12.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:12 smithi194 ceph-mon[65619]: pgmap v1576: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:12.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:12 smithi026 ceph-mon[96795]: pgmap v1576: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:14.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:14 smithi194 ceph-mon[65619]: pgmap v1577: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:14.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:14 smithi026 ceph-mon[96795]: pgmap v1577: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:16.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:16 smithi194 ceph-mon[65619]: pgmap v1578: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:16.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:16 smithi026 ceph-mon[96795]: pgmap v1578: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:18.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:18 smithi194 ceph-mon[65619]: pgmap v1579: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:18.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:18 smithi026 ceph-mon[96795]: pgmap v1579: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:20.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:20 smithi194 ceph-mon[65619]: pgmap v1580: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:20.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:20 smithi026 ceph-mon[96795]: pgmap v1580: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:22.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:22 smithi194 ceph-mon[65619]: pgmap v1581: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:22.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:22 smithi026 ceph-mon[96795]: pgmap v1581: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:23.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.798+0000 7f33aa4e3700 1 -- 172.21.15.26:0/2575289360 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33a406a3b0 msgr2=0x7f33a406a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:47:23.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.798+0000 7f33aa4e3700 1 --2- 172.21.15.26:0/2575289360 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33a406a3b0 0x7f33a406a830 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7f3394004660 tx=0x7f3394009b30).stop 2021-11-03T17:47:23.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.798+0000 7f33aa4e3700 1 -- 172.21.15.26:0/2575289360 shutdown_connections 2021-11-03T17:47:23.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.798+0000 7f33aa4e3700 1 --2- 172.21.15.26:0/2575289360 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33a406a3b0 0x7f33a406a830 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:23.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.798+0000 7f33aa4e3700 1 --2- 172.21.15.26:0/2575289360 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33a406b9c0 0x7f33a4069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:23.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.798+0000 7f33aa4e3700 1 -- 172.21.15.26:0/2575289360 >> 172.21.15.26:0/2575289360 conn(0x7f33a40f1cd0 msgr2=0x7f33a40f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:47:23.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.798+0000 7f33aa4e3700 1 -- 172.21.15.26:0/2575289360 shutdown_connections 2021-11-03T17:47:23.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.798+0000 7f33aa4e3700 1 -- 172.21.15.26:0/2575289360 wait complete. 2021-11-03T17:47:23.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.799+0000 7f33aa4e3700 1 Processor -- start 2021-11-03T17:47:23.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.799+0000 7f33aa4e3700 1 -- start start 2021-11-03T17:47:23.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.799+0000 7f33aa4e3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33a406a3b0 0x7f33a4108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:47:23.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.799+0000 7f33aa4e3700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33a406b9c0 0x7f33a4109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:47:23.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.799+0000 7f33aa4e3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a41099c0 con 0x7f33a406a3b0 2021-11-03T17:47:23.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.799+0000 7f33aa4e3700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a4109b00 con 0x7f33a406b9c0 2021-11-03T17:47:23.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.799+0000 7f33a94e1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33a406a3b0 0x7f33a4108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:47:23.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.799+0000 7f33a94e1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33a406a3b0 0x7f33a4108f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56366/0 (socket says 172.21.15.26:56366) 2021-11-03T17:47:23.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.799+0000 7f33a94e1700 1 -- 172.21.15.26:0/2307705218 learned_addr learned my addr 172.21.15.26:0/2307705218 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:47:23.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.799+0000 7f33a8ce0700 1 --2- 172.21.15.26:0/2307705218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33a406b9c0 0x7f33a4109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:47:23.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.799+0000 7f33a94e1700 1 -- 172.21.15.26:0/2307705218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33a406b9c0 msgr2=0x7f33a4109410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:47:23.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.799+0000 7f33a94e1700 1 --2- 172.21.15.26:0/2307705218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33a406b9c0 0x7f33a4109410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:23.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.799+0000 7f33a94e1700 1 -- 172.21.15.26:0/2307705218 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3394005040 con 0x7f33a406a3b0 2021-11-03T17:47:23.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.799+0000 7f33a94e1700 1 --2- 172.21.15.26:0/2307705218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33a406a3b0 0x7f33a4108f20 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7f33a00026d0 tx=0x7f33a0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:47:23.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.800+0000 7f3399ffb700 1 -- 172.21.15.26:0/2307705218 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33a00079c0 con 0x7f33a406a3b0 2021-11-03T17:47:23.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.800+0000 7f3399ffb700 1 -- 172.21.15.26:0/2307705218 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f33a000f040 con 0x7f33a406a3b0 2021-11-03T17:47:23.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.800+0000 7f33aa4e3700 1 -- 172.21.15.26:0/2307705218 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33a410a4a0 con 0x7f33a406a3b0 2021-11-03T17:47:23.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.800+0000 7f3399ffb700 1 -- 172.21.15.26:0/2307705218 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33a00148b0 con 0x7f33a406a3b0 2021-11-03T17:47:23.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.800+0000 7f33aa4e3700 1 -- 172.21.15.26:0/2307705218 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a410aa60 con 0x7f33a406a3b0 2021-11-03T17:47:23.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.801+0000 7f33aa4e3700 1 -- 172.21.15.26:0/2307705218 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33a4045ad0 con 0x7f33a406a3b0 2021-11-03T17:47:23.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.801+0000 7f3399ffb700 1 -- 172.21.15.26:0/2307705218 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f33a0007b20 con 0x7f33a406a3b0 2021-11-03T17:47:23.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.802+0000 7f3399ffb700 1 --2- 172.21.15.26:0/2307705218 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3390064100 0x7f33900665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:47:23.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.802+0000 7f3399ffb700 1 -- 172.21.15.26:0/2307705218 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f33a0080660 con 0x7f33a406a3b0 2021-11-03T17:47:23.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.802+0000 7f33a8ce0700 1 --2- 172.21.15.26:0/2307705218 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3390064100 0x7f33900665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:47:23.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.802+0000 7f33a8ce0700 1 --2- 172.21.15.26:0/2307705218 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3390064100 0x7f33900665c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f3394004630 tx=0x7f3394009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:47:23.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.806+0000 7f3399ffb700 1 -- 172.21.15.26:0/2307705218 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f33a00529c0 con 0x7f33a406a3b0 2021-11-03T17:47:23.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.986+0000 7f33aa4e3700 1 -- 172.21.15.26:0/2307705218 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f33a4101060 con 0x7f3390064100 2021-11-03T17:47:23.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.988+0000 7f3399ffb700 1 -- 172.21.15.26:0/2307705218 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f33a4101060 con 0x7f3390064100 2021-11-03T17:47:23.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.989+0000 7f33aa4e3700 1 -- 172.21.15.26:0/2307705218 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3390064100 msgr2=0x7f33900665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:47:23.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.989+0000 7f33aa4e3700 1 --2- 172.21.15.26:0/2307705218 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3390064100 0x7f33900665c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f3394004630 tx=0x7f3394009b30).stop 2021-11-03T17:47:23.984 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.989+0000 7f33aa4e3700 1 -- 172.21.15.26:0/2307705218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33a406a3b0 msgr2=0x7f33a4108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:47:23.984 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.989+0000 7f33aa4e3700 1 --2- 172.21.15.26:0/2307705218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33a406a3b0 0x7f33a4108f20 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7f33a00026d0 tx=0x7f33a0009de0).stop 2021-11-03T17:47:23.984 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.989+0000 7f33aa4e3700 1 -- 172.21.15.26:0/2307705218 shutdown_connections 2021-11-03T17:47:23.984 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.989+0000 7f33aa4e3700 1 --2- 172.21.15.26:0/2307705218 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3390064100 0x7f33900665c0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:23.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.989+0000 7f33aa4e3700 1 --2- 172.21.15.26:0/2307705218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33a406a3b0 0x7f33a4108f20 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:23.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.989+0000 7f33aa4e3700 1 --2- 172.21.15.26:0/2307705218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33a406b9c0 0x7f33a4109410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:23.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.989+0000 7f33aa4e3700 1 -- 172.21.15.26:0/2307705218 >> 172.21.15.26:0/2307705218 conn(0x7f33a40f1cd0 msgr2=0x7f33a40fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:47:23.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.990+0000 7f33aa4e3700 1 -- 172.21.15.26:0/2307705218 shutdown_connections 2021-11-03T17:47:23.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:23.990+0000 7f33aa4e3700 1 -- 172.21.15.26:0/2307705218 wait complete. 2021-11-03T17:47:23.993 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:47:24.085 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.090+0000 7f631082d700 1 -- 172.21.15.26:0/2742408652 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f630c0f6be0 msgr2=0x7f630c0f7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:47:24.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.090+0000 7f631082d700 1 --2- 172.21.15.26:0/2742408652 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f630c0f6be0 0x7f630c0f7000 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7f62fc004660 tx=0x7f62fc009b30).stop 2021-11-03T17:47:24.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.090+0000 7f631082d700 1 -- 172.21.15.26:0/2742408652 shutdown_connections 2021-11-03T17:47:24.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.090+0000 7f631082d700 1 --2- 172.21.15.26:0/2742408652 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f630c0f7580 0x7f630c0f59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:47:24.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.090+0000 7f631082d700 1 --2- 172.21.15.26:0/2742408652 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f630c0f6be0 0x7f630c0f7000 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:24.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.090+0000 7f631082d700 1 -- 172.21.15.26:0/2742408652 >> 172.21.15.26:0/2742408652 conn(0x7f630c0f04c0 msgr2=0x7f630c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:47:24.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.090+0000 7f631082d700 1 -- 172.21.15.26:0/2742408652 shutdown_connections 2021-11-03T17:47:24.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.090+0000 7f631082d700 1 -- 172.21.15.26:0/2742408652 wait complete. 2021-11-03T17:47:24.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.090+0000 7f631082d700 1 Processor -- start 2021-11-03T17:47:24.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.091+0000 7f631082d700 1 -- start start 2021-11-03T17:47:24.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.091+0000 7f631082d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f630c0f6be0 0x7f630c109ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:47:24.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.091+0000 7f631082d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f630c0f7580 0x7f630c10c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:47:24.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.091+0000 7f631082d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630c0f5710 con 0x7f630c0f6be0 2021-11-03T17:47:24.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.091+0000 7f631082d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630c0f5850 con 0x7f630c0f7580 2021-11-03T17:47:24.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.091+0000 7f630a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f630c0f6be0 0x7f630c109ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:47:24.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.091+0000 7f630a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f630c0f6be0 0x7f630c109ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56376/0 (socket says 172.21.15.26:56376) 2021-11-03T17:47:24.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.091+0000 7f630a59c700 1 -- 172.21.15.26:0/1660537887 learned_addr learned my addr 172.21.15.26:0/1660537887 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:47:24.090 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.091+0000 7f6309d9b700 1 --2- 172.21.15.26:0/1660537887 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f630c0f7580 0x7f630c10c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:47:24.090 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.091+0000 7f630a59c700 1 -- 172.21.15.26:0/1660537887 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f630c0f7580 msgr2=0x7f630c10c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:47:24.090 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.091+0000 7f630a59c700 1 --2- 172.21.15.26:0/1660537887 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f630c0f7580 0x7f630c10c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:24.090 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.091+0000 7f630a59c700 1 -- 172.21.15.26:0/1660537887 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62fc005040 con 0x7f630c0f6be0 2021-11-03T17:47:24.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.091+0000 7f6309d9b700 1 --2- 172.21.15.26:0/1660537887 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f630c0f7580 0x7f630c10c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:47:24.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.091+0000 7f630a59c700 1 --2- 172.21.15.26:0/1660537887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f630c0f6be0 0x7f630c109ce0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7f62fc004f60 tx=0x7f62fc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:47:24.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.091+0000 7f62faffd700 1 -- 172.21.15.26:0/1660537887 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62fc018070 con 0x7f630c0f6be0 2021-11-03T17:47:24.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.091+0000 7f62faffd700 1 -- 172.21.15.26:0/1660537887 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f62fc007ba0 con 0x7f630c0f6be0 2021-11-03T17:47:24.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.091+0000 7f631082d700 1 -- 172.21.15.26:0/1660537887 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f630c10c7e0 con 0x7f630c0f6be0 2021-11-03T17:47:24.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.092+0000 7f62faffd700 1 -- 172.21.15.26:0/1660537887 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62fc01c620 con 0x7f630c0f6be0 2021-11-03T17:47:24.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.092+0000 7f631082d700 1 -- 172.21.15.26:0/1660537887 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f630c10cd10 con 0x7f630c0f6be0 2021-11-03T17:47:24.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.092+0000 7f631082d700 1 -- 172.21.15.26:0/1660537887 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f630c0f4150 con 0x7f630c0f6be0 2021-11-03T17:47:24.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.093+0000 7f62faffd700 1 -- 172.21.15.26:0/1660537887 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f62fc01c8e0 con 0x7f630c0f6be0 2021-11-03T17:47:24.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.093+0000 7f62faffd700 1 --2- 172.21.15.26:0/1660537887 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f62f40640b0 0x7f62f4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:47:24.094 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.094+0000 7f62faffd700 1 -- 172.21.15.26:0/1660537887 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f62fc0826e0 con 0x7f630c0f6be0 2021-11-03T17:47:24.094 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.094+0000 7f6309d9b700 1 --2- 172.21.15.26:0/1660537887 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f62f40640b0 0x7f62f4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:47:24.094 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.094+0000 7f6309d9b700 1 --2- 172.21.15.26:0/1660537887 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f62f40640b0 0x7f62f4066570 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f630c0f79c0 tx=0x7f6300008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:47:24.094 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.098+0000 7f62faffd700 1 -- 172.21.15.26:0/1660537887 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f62fc054a40 con 0x7f630c0f6be0 2021-11-03T17:47:24.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.273+0000 7f631082d700 1 -- 172.21.15.26:0/1660537887 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f630c0fdf30 con 0x7f62f40640b0 2021-11-03T17:47:24.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.288+0000 7f62faffd700 1 -- 172.21.15.26:0/1660537887 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f630c0fdf30 con 0x7f62f40640b0 2021-11-03T17:47:24.282 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:47:24.282 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (58m) 8m ago 59m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:47:24.282 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (50m) 8m ago 59m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:47:24.283 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (50m) 7m ago 59m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:47:24.283 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (58m) 8m ago 59m 40.8M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:47:24.283 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (51m) 8m ago 55m 25.1M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:47:24.284 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (51m) 8m ago 54m 25.7M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:47:24.284 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (55m) 7m ago 55m 26.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:47:24.284 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (54m) 7m ago 54m 26.3M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:47:24.284 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (52m) 8m ago 61m 533M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:47:24.285 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (51m) 7m ago 59m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:47:24.285 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (51m) 8m ago 61m 209M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:47:24.285 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (51m) 7m ago 58m 103M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:47:24.285 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (59m) 8m ago 59m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:47:24.286 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (58m) 7m ago 58m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:47:24.286 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (50m) 8m ago 58m 251M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:47:24.286 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (49m) 8m ago 57m 270M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:47:24.286 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (49m) 8m ago 57m 225M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:47:24.287 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (48m) 7m ago 57m 287M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:47:24.287 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (48m) 7m ago 56m 246M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:47:24.287 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (48m) 7m ago 56m 235M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:47:24.287 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (58m) 8m ago 59m 56.7M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:47:24.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.290+0000 7f631082d700 1 -- 172.21.15.26:0/1660537887 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f62f40640b0 msgr2=0x7f62f4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:47:24.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.290+0000 7f631082d700 1 --2- 172.21.15.26:0/1660537887 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f62f40640b0 0x7f62f4066570 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f630c0f79c0 tx=0x7f6300008040).stop 2021-11-03T17:47:24.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.290+0000 7f631082d700 1 -- 172.21.15.26:0/1660537887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f630c0f6be0 msgr2=0x7f630c109ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:47:24.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.290+0000 7f631082d700 1 --2- 172.21.15.26:0/1660537887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f630c0f6be0 0x7f630c109ce0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7f62fc004f60 tx=0x7f62fc009b30).stop 2021-11-03T17:47:24.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.290+0000 7f631082d700 1 -- 172.21.15.26:0/1660537887 shutdown_connections 2021-11-03T17:47:24.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.290+0000 7f631082d700 1 --2- 172.21.15.26:0/1660537887 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f62f40640b0 0x7f62f4066570 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:24.290 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.290+0000 7f631082d700 1 --2- 172.21.15.26:0/1660537887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f630c0f6be0 0x7f630c109ce0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:24.290 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.290+0000 7f631082d700 1 --2- 172.21.15.26:0/1660537887 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f630c0f7580 0x7f630c10c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:24.290 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.290+0000 7f631082d700 1 -- 172.21.15.26:0/1660537887 >> 172.21.15.26:0/1660537887 conn(0x7f630c0f04c0 msgr2=0x7f630c0fa430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:47:24.290 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.290+0000 7f631082d700 1 -- 172.21.15.26:0/1660537887 shutdown_connections 2021-11-03T17:47:24.291 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.290+0000 7f631082d700 1 -- 172.21.15.26:0/1660537887 wait complete. 2021-11-03T17:47:24.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.396+0000 7ffa67e61700 1 -- 172.21.15.26:0/4025460618 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa60060310 msgr2=0x7ffa600f92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:47:24.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.396+0000 7ffa67e61700 1 --2- 172.21.15.26:0/4025460618 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa60060310 0x7ffa600f92a0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7ffa500099e0 tx=0x7ffa50004d10).stop 2021-11-03T17:47:24.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.396+0000 7ffa67e61700 1 -- 172.21.15.26:0/4025460618 shutdown_connections 2021-11-03T17:47:24.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.396+0000 7ffa67e61700 1 --2- 172.21.15.26:0/4025460618 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa600f9820 0x7ffa600fbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:24.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.396+0000 7ffa67e61700 1 --2- 172.21.15.26:0/4025460618 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa60060310 0x7ffa600f92a0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:24.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.396+0000 7ffa67e61700 1 -- 172.21.15.26:0/4025460618 >> 172.21.15.26:0/4025460618 conn(0x7ffa600f0d40 msgr2=0x7ffa600f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:47:24.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.396+0000 7ffa67e61700 1 -- 172.21.15.26:0/4025460618 shutdown_connections 2021-11-03T17:47:24.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.396+0000 7ffa67e61700 1 -- 172.21.15.26:0/4025460618 wait complete. 2021-11-03T17:47:24.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.397+0000 7ffa67e61700 1 Processor -- start 2021-11-03T17:47:24.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.397+0000 7ffa67e61700 1 -- start start 2021-11-03T17:47:24.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.397+0000 7ffa67e61700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa60060310 0x7ffa60107050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:47:24.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.397+0000 7ffa67e61700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa600f9820 0x7ffa60107540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:47:24.395 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.397+0000 7ffa67e61700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa60107af0 con 0x7ffa60060310 2021-11-03T17:47:24.395 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.397+0000 7ffa67e61700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa60107c30 con 0x7ffa600f9820 2021-11-03T17:47:24.395 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.397+0000 7ffa65bfd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa60060310 0x7ffa60107050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:47:24.395 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.397+0000 7ffa65bfd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa60060310 0x7ffa60107050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56386/0 (socket says 172.21.15.26:56386) 2021-11-03T17:47:24.395 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.397+0000 7ffa65bfd700 1 -- 172.21.15.26:0/2009290988 learned_addr learned my addr 172.21.15.26:0/2009290988 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:47:24.396 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.397+0000 7ffa653fc700 1 --2- 172.21.15.26:0/2009290988 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa600f9820 0x7ffa60107540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:47:24.396 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.397+0000 7ffa65bfd700 1 -- 172.21.15.26:0/2009290988 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa600f9820 msgr2=0x7ffa60107540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:47:24.396 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.397+0000 7ffa65bfd700 1 --2- 172.21.15.26:0/2009290988 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa600f9820 0x7ffa60107540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:24.396 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.397+0000 7ffa65bfd700 1 -- 172.21.15.26:0/2009290988 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa50009640 con 0x7ffa60060310 2021-11-03T17:47:24.397 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.398+0000 7ffa65bfd700 1 --2- 172.21.15.26:0/2009290988 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa60060310 0x7ffa60107050 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7ffa5000b3b0 tx=0x7ffa50004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:47:24.397 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.398+0000 7ffa5e7fc700 1 -- 172.21.15.26:0/2009290988 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa5000e030 con 0x7ffa60060310 2021-11-03T17:47:24.397 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.398+0000 7ffa5e7fc700 1 -- 172.21.15.26:0/2009290988 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ffa500049b0 con 0x7ffa60060310 2021-11-03T17:47:24.398 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.398+0000 7ffa67e61700 1 -- 172.21.15.26:0/2009290988 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa60108570 con 0x7ffa60060310 2021-11-03T17:47:24.399 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.398+0000 7ffa5e7fc700 1 -- 172.21.15.26:0/2009290988 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa50018070 con 0x7ffa60060310 2021-11-03T17:47:24.399 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.398+0000 7ffa67e61700 1 -- 172.21.15.26:0/2009290988 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa60108a50 con 0x7ffa60060310 2021-11-03T17:47:24.399 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.399+0000 7ffa67e61700 1 -- 172.21.15.26:0/2009290988 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa60045ad0 con 0x7ffa60060310 2021-11-03T17:47:24.400 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.399+0000 7ffa5e7fc700 1 -- 172.21.15.26:0/2009290988 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ffa50007c90 con 0x7ffa60060310 2021-11-03T17:47:24.400 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.400+0000 7ffa5e7fc700 1 --2- 172.21.15.26:0/2009290988 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffa480640b0 0x7ffa48066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:47:24.400 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.400+0000 7ffa5e7fc700 1 -- 172.21.15.26:0/2009290988 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ffa500823b0 con 0x7ffa60060310 2021-11-03T17:47:24.400 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.400+0000 7ffa653fc700 1 --2- 172.21.15.26:0/2009290988 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffa480640b0 0x7ffa48066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:47:24.401 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.400+0000 7ffa653fc700 1 --2- 172.21.15.26:0/2009290988 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffa480640b0 0x7ffa48066570 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7ffa600600e0 tx=0x7ffa5400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:47:24.401 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.405+0000 7ffa5e7fc700 1 -- 172.21.15.26:0/2009290988 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ffa500546b0 con 0x7ffa60060310 2021-11-03T17:47:24.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.639+0000 7ffa67e61700 1 -- 172.21.15.26:0/2009290988 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ffa600fefb0 con 0x7ffa60060310 2021-11-03T17:47:24.634 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.640+0000 7ffa5e7fc700 1 -- 172.21.15.26:0/2009290988 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7ffa500542a0 con 0x7ffa60060310 2021-11-03T17:47:24.634 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:47:24.635 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:47:24.635 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:47:24.635 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:47:24.635 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:47:24.636 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:47:24.636 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:47:24.636 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:47:24.636 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:47:24.636 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:47:24.637 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:47:24.637 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:47:24.637 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:47:24.637 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:47:24.638 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:47:24.638 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:47:24.638 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:47:24.638 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:47:24.639 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.642+0000 7ffa67e61700 1 -- 172.21.15.26:0/2009290988 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffa480640b0 msgr2=0x7ffa48066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:47:24.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.642+0000 7ffa67e61700 1 --2- 172.21.15.26:0/2009290988 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffa480640b0 0x7ffa48066570 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7ffa600600e0 tx=0x7ffa5400b040).stop 2021-11-03T17:47:24.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.642+0000 7ffa67e61700 1 -- 172.21.15.26:0/2009290988 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa60060310 msgr2=0x7ffa60107050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:47:24.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.642+0000 7ffa67e61700 1 --2- 172.21.15.26:0/2009290988 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa60060310 0x7ffa60107050 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7ffa5000b3b0 tx=0x7ffa50004d10).stop 2021-11-03T17:47:24.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.642+0000 7ffa67e61700 1 -- 172.21.15.26:0/2009290988 shutdown_connections 2021-11-03T17:47:24.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.642+0000 7ffa67e61700 1 --2- 172.21.15.26:0/2009290988 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffa480640b0 0x7ffa48066570 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:24.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.642+0000 7ffa67e61700 1 --2- 172.21.15.26:0/2009290988 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa60060310 0x7ffa60107050 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:24.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.642+0000 7ffa67e61700 1 --2- 172.21.15.26:0/2009290988 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa600f9820 0x7ffa60107540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:24.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.642+0000 7ffa67e61700 1 -- 172.21.15.26:0/2009290988 >> 172.21.15.26:0/2009290988 conn(0x7ffa600f0d40 msgr2=0x7ffa600f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:47:24.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.642+0000 7ffa67e61700 1 -- 172.21.15.26:0/2009290988 shutdown_connections 2021-11-03T17:47:24.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.642+0000 7ffa67e61700 1 -- 172.21.15.26:0/2009290988 wait complete. 2021-11-03T17:47:24.739 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.742+0000 7fab7a463700 1 -- 172.21.15.26:0/3464639662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab740f55e0 msgr2=0x7fab740f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:47:24.739 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.742+0000 7fab7a463700 1 --2- 172.21.15.26:0/3464639662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab740f55e0 0x7fab740f5a00 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7fab64004660 tx=0x7fab64009b30).stop 2021-11-03T17:47:24.739 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.742+0000 7fab7a463700 1 -- 172.21.15.26:0/3464639662 shutdown_connections 2021-11-03T17:47:24.740 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.742+0000 7fab7a463700 1 --2- 172.21.15.26:0/3464639662 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab740f5ef0 0x7fab740f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:24.740 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.742+0000 7fab7a463700 1 --2- 172.21.15.26:0/3464639662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab740f55e0 0x7fab740f5a00 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:24.740 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.742+0000 7fab7a463700 1 -- 172.21.15.26:0/3464639662 >> 172.21.15.26:0/3464639662 conn(0x7fab740f0de0 msgr2=0x7fab740f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:47:24.740 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.742+0000 7fab7a463700 1 -- 172.21.15.26:0/3464639662 shutdown_connections 2021-11-03T17:47:24.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.742+0000 7fab7a463700 1 -- 172.21.15.26:0/3464639662 wait complete. 2021-11-03T17:47:24.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.743+0000 7fab7a463700 1 Processor -- start 2021-11-03T17:47:24.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.743+0000 7fab7a463700 1 -- start start 2021-11-03T17:47:24.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.743+0000 7fab7a463700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab740f55e0 0x7fab74109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:47:24.742 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.743+0000 7fab7a463700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab740f5ef0 0x7fab7410c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:47:24.742 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.743+0000 7fab7a463700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab740604e0 con 0x7fab740f5ef0 2021-11-03T17:47:24.742 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.743+0000 7fab7a463700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab74060620 con 0x7fab740f55e0 2021-11-03T17:47:24.743 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.743+0000 7fab737fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab740f5ef0 0x7fab7410c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:47:24.743 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.743+0000 7fab737fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab740f5ef0 0x7fab7410c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56398/0 (socket says 172.21.15.26:56398) 2021-11-03T17:47:24.743 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.743+0000 7fab737fe700 1 -- 172.21.15.26:0/3401593431 learned_addr learned my addr 172.21.15.26:0/3401593431 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:47:24.743 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.743+0000 7fab73fff700 1 --2- 172.21.15.26:0/3401593431 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab740f55e0 0x7fab74109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:47:24.743 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.744+0000 7fab737fe700 1 -- 172.21.15.26:0/3401593431 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab740f55e0 msgr2=0x7fab74109cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:47:24.744 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.744+0000 7fab737fe700 1 --2- 172.21.15.26:0/3401593431 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab740f55e0 0x7fab74109cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:24.744 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.744+0000 7fab737fe700 1 -- 172.21.15.26:0/3401593431 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab64005040 con 0x7fab740f5ef0 2021-11-03T17:47:24.744 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.744+0000 7fab737fe700 1 --2- 172.21.15.26:0/3401593431 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab740f5ef0 0x7fab7410c1b0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7fab680026d0 tx=0x7fab68009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:47:24.744 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.744+0000 7fab70ff9700 1 -- 172.21.15.26:0/3401593431 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab680079c0 con 0x7fab740f5ef0 2021-11-03T17:47:24.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.744+0000 7fab70ff9700 1 -- 172.21.15.26:0/3401593431 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fab6800f040 con 0x7fab740f5ef0 2021-11-03T17:47:24.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.744+0000 7fab70ff9700 1 -- 172.21.15.26:0/3401593431 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab680148b0 con 0x7fab740f5ef0 2021-11-03T17:47:24.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.744+0000 7fab7a463700 1 -- 172.21.15.26:0/3401593431 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab7410c760 con 0x7fab740f5ef0 2021-11-03T17:47:24.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.744+0000 7fab7a463700 1 -- 172.21.15.26:0/3401593431 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab7410ccf0 con 0x7fab740f5ef0 2021-11-03T17:47:24.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.745+0000 7fab7a463700 1 -- 172.21.15.26:0/3401593431 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab740f4a70 con 0x7fab740f5ef0 2021-11-03T17:47:24.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.745+0000 7fab70ff9700 1 -- 172.21.15.26:0/3401593431 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fab68014a10 con 0x7fab740f5ef0 2021-11-03T17:47:24.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:24 smithi194 ceph-mon[65619]: pgmap v1582: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:24.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:47:24.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2021-11-03T17:47:24.748 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.746+0000 7fab70ff9700 1 --2- 172.21.15.26:0/3401593431 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fab5c064090 0x7fab5c066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:47:24.748 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.746+0000 7fab70ff9700 1 -- 172.21.15.26:0/3401593431 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fab680806a0 con 0x7fab740f5ef0 2021-11-03T17:47:24.748 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.746+0000 7fab73fff700 1 --2- 172.21.15.26:0/3401593431 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fab5c064090 0x7fab5c066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:47:24.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.746+0000 7fab73fff700 1 --2- 172.21.15.26:0/3401593431 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fab5c064090 0x7fab5c066550 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7fab64013690 tx=0x7fab64009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:47:24.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.750+0000 7fab70ff9700 1 -- 172.21.15.26:0/3401593431 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fab68052a00 con 0x7fab740f5ef0 2021-11-03T17:47:24.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:24 smithi026 ceph-mon[96795]: pgmap v1582: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:24.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:47:24.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2021-11-03T17:47:24.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.952+0000 7fab7a463700 1 -- 172.21.15.26:0/3401593431 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fab74045ad0 con 0x7fab740f5ef0 2021-11-03T17:47:24.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.953+0000 7fab70ff9700 1 -- 172.21.15.26:0/3401593431 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fab680525f0 con 0x7fab740f5ef0 2021-11-03T17:47:24.947 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:47:24.947 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:47:24.948 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:47:24.948 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:47:24.948 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:47:24.949 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:47:24.949 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:47:24.949 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:47:24.949 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:47:24.949 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:47:24.950 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:47:24.950 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:47:24.950 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:47:24.951 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:47:24.951 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:47:24.951 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:47:24.951 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:47:24.952 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:47:24.952 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:47:24.952 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:47:24.952 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:47:24.952 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:47:24.953 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:47:24.953 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:47:24.953 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:47:24.953 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:47:24.954 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:47:24.954 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:47:24.954 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:47:24.954 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:47:24.954 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:47:24.955 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:47:24.955 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:47:24.955 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:47:24.955 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:47:24.956 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:47:24.956 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:47:24.956 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:47:24.956 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:47:24.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.954+0000 7fab7a463700 1 -- 172.21.15.26:0/3401593431 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fab5c064090 msgr2=0x7fab5c066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:47:24.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.954+0000 7fab7a463700 1 --2- 172.21.15.26:0/3401593431 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fab5c064090 0x7fab5c066550 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7fab64013690 tx=0x7fab64009b30).stop 2021-11-03T17:47:24.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.954+0000 7fab7a463700 1 -- 172.21.15.26:0/3401593431 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab740f5ef0 msgr2=0x7fab7410c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:47:24.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.954+0000 7fab7a463700 1 --2- 172.21.15.26:0/3401593431 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab740f5ef0 0x7fab7410c1b0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7fab680026d0 tx=0x7fab68009de0).stop 2021-11-03T17:47:24.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.954+0000 7fab7a463700 1 -- 172.21.15.26:0/3401593431 shutdown_connections 2021-11-03T17:47:24.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.954+0000 7fab7a463700 1 --2- 172.21.15.26:0/3401593431 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fab5c064090 0x7fab5c066550 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:24.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.954+0000 7fab7a463700 1 --2- 172.21.15.26:0/3401593431 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab740f55e0 0x7fab74109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:24.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.954+0000 7fab7a463700 1 --2- 172.21.15.26:0/3401593431 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab740f5ef0 0x7fab7410c1b0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:24.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.954+0000 7fab7a463700 1 -- 172.21.15.26:0/3401593431 >> 172.21.15.26:0/3401593431 conn(0x7fab740f0de0 msgr2=0x7fab740fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:47:24.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.955+0000 7fab7a463700 1 -- 172.21.15.26:0/3401593431 shutdown_connections 2021-11-03T17:47:24.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:24.955+0000 7fab7a463700 1 -- 172.21.15.26:0/3401593431 wait complete. 2021-11-03T17:47:24.960 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:47:25.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:25 smithi194 ceph-mon[65619]: from='client.35772 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:47:25.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:25 smithi194 ceph-mon[65619]: poll took 60059.882 ms: 1 events 2021-11-03T17:47:25.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:25 smithi194 ceph-mon[65619]: from='client.35776 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:47:25.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi026", "name": "osd_memory_target"}]: dispatch 2021-11-03T17:47:25.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:47:25.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:47:25.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:47:25.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:47:25.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:47:25.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:47:25.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:25 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:47:25.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:47:25.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:25 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:47:25.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:25 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2009290988' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:47:25.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:25 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3401593431' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:47:25.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:25 smithi026 ceph-mon[96795]: from='client.35772 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:47:25.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:25 smithi026 ceph-mon[96795]: poll took 60059.882 ms: 1 events 2021-11-03T17:47:25.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:25 smithi026 ceph-mon[96795]: from='client.35776 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:47:25.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi026", "name": "osd_memory_target"}]: dispatch 2021-11-03T17:47:25.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:47:25.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:47:25.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:47:25.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:47:25.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:47:25.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:47:25.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:25 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:47:25.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:47:25.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:25 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:47:25.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:25 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2009290988' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:47:25.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:25 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3401593431' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:47:26.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:26 smithi194 ceph-mon[65619]: pgmap v1583: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:26.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:26 smithi026 ceph-mon[96795]: pgmap v1583: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:28.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:28 smithi194 ceph-mon[65619]: pgmap v1584: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:28.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:28 smithi026 ceph-mon[96795]: pgmap v1584: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:30.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:30 smithi194 ceph-mon[65619]: pgmap v1585: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:30.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:30 smithi026 ceph-mon[96795]: pgmap v1585: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:32.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:32 smithi194 ceph-mon[65619]: pgmap v1586: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:32.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:32 smithi026 ceph-mon[96795]: pgmap v1586: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:34.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:34 smithi194 ceph-mon[65619]: pgmap v1587: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:34.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:34 smithi026 ceph-mon[96795]: pgmap v1587: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:36.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:36 smithi026 ceph-mon[96795]: pgmap v1588: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:36.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:36 smithi194 ceph-mon[65619]: pgmap v1588: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:38.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:38 smithi026 ceph-mon[96795]: pgmap v1589: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:38.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:38 smithi194 ceph-mon[65619]: pgmap v1589: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:40.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:40 smithi026 ceph-mon[96795]: pgmap v1590: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:40.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:47:40.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:40 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:47:40.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:40 smithi194 ceph-mon[65619]: pgmap v1590: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:40.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:47:40.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:40 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:47:42.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:42 smithi026 ceph-mon[96795]: pgmap v1591: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:42.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:42 smithi194 ceph-mon[65619]: pgmap v1591: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:44.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:44 smithi026 ceph-mon[96795]: pgmap v1592: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:44.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:44 smithi194 ceph-mon[65619]: pgmap v1592: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:46.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:46 smithi026 ceph-mon[96795]: pgmap v1593: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:46.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:46 smithi194 ceph-mon[65619]: pgmap v1593: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:48 smithi026 ceph-mon[96795]: pgmap v1594: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:47:48.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:47:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:48 smithi194 ceph-mon[65619]: pgmap v1594: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:47:48.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:47:50.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:50 smithi026 ceph-mon[96795]: pgmap v1595: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:50.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:50 smithi194 ceph-mon[65619]: pgmap v1595: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:52.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:52 smithi026 ceph-mon[96795]: pgmap v1596: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:52.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:52 smithi194 ceph-mon[65619]: pgmap v1596: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:54.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:54 smithi026 ceph-mon[96795]: pgmap v1597: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:54.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:54 smithi194 ceph-mon[65619]: pgmap v1597: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:55.066 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.068+0000 7f4332fac700 1 -- 172.21.15.26:0/3208939203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f432c0f66e0 msgr2=0x7f432c0f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:47:55.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.068+0000 7f4332fac700 1 --2- 172.21.15.26:0/3208939203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f432c0f66e0 0x7f432c0f6b40 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7f431c004660 tx=0x7f431c009b30).stop 2021-11-03T17:47:55.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.068+0000 7f4332fac700 1 -- 172.21.15.26:0/3208939203 shutdown_connections 2021-11-03T17:47:55.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.068+0000 7f4332fac700 1 --2- 172.21.15.26:0/3208939203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f432c0f66e0 0x7f432c0f6b40 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:55.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.068+0000 7f4332fac700 1 --2- 172.21.15.26:0/3208939203 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f432c0f5440 0x7f432c0f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:55.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.068+0000 7f4332fac700 1 -- 172.21.15.26:0/3208939203 >> 172.21.15.26:0/3208939203 conn(0x7f432c0f0ba0 msgr2=0x7f432c0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:47:55.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.068+0000 7f4332fac700 1 -- 172.21.15.26:0/3208939203 shutdown_connections 2021-11-03T17:47:55.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.068+0000 7f4332fac700 1 -- 172.21.15.26:0/3208939203 wait complete. 2021-11-03T17:47:55.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.068+0000 7f4332fac700 1 Processor -- start 2021-11-03T17:47:55.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.068+0000 7f4332fac700 1 -- start start 2021-11-03T17:47:55.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.069+0000 7f4332fac700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f432c0f5440 0x7f432c1099b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:47:55.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.069+0000 7f4332fac700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f432c0f66e0 0x7f432c10beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:47:55.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.069+0000 7f4332fac700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432c0603e0 con 0x7f432c0f66e0 2021-11-03T17:47:55.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.069+0000 7f4332fac700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432c060520 con 0x7f432c0f5440 2021-11-03T17:47:55.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.069+0000 7f43317a9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f432c0f66e0 0x7f432c10beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:47:55.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.069+0000 7f43317a9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f432c0f66e0 0x7f432c10beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56416/0 (socket says 172.21.15.26:56416) 2021-11-03T17:47:55.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.069+0000 7f43317a9700 1 -- 172.21.15.26:0/2882450391 learned_addr learned my addr 172.21.15.26:0/2882450391 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:47:55.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.069+0000 7f4331faa700 1 --2- 172.21.15.26:0/2882450391 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f432c0f5440 0x7f432c1099b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:47:55.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.069+0000 7f43317a9700 1 -- 172.21.15.26:0/2882450391 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f432c0f5440 msgr2=0x7f432c1099b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:47:55.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.069+0000 7f43317a9700 1 --2- 172.21.15.26:0/2882450391 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f432c0f5440 0x7f432c1099b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:55.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.069+0000 7f43317a9700 1 -- 172.21.15.26:0/2882450391 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f431c005040 con 0x7f432c0f66e0 2021-11-03T17:47:55.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.069+0000 7f43317a9700 1 --2- 172.21.15.26:0/2882450391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f432c0f66e0 0x7f432c10beb0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7f431c009990 tx=0x7f431c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:47:55.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.069+0000 7f43227fc700 1 -- 172.21.15.26:0/2882450391 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f431c018070 con 0x7f432c0f66e0 2021-11-03T17:47:55.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.069+0000 7f43227fc700 1 -- 172.21.15.26:0/2882450391 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f431c007ba0 con 0x7f432c0f66e0 2021-11-03T17:47:55.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.069+0000 7f4332fac700 1 -- 172.21.15.26:0/2882450391 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f432c10c400 con 0x7f432c0f66e0 2021-11-03T17:47:55.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.069+0000 7f43227fc700 1 -- 172.21.15.26:0/2882450391 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f431c01c3c0 con 0x7f432c0f66e0 2021-11-03T17:47:55.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.070+0000 7f4332fac700 1 -- 172.21.15.26:0/2882450391 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f432c10c960 con 0x7f432c0f66e0 2021-11-03T17:47:55.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.070+0000 7f4332fac700 1 -- 172.21.15.26:0/2882450391 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f432c045ad0 con 0x7f432c0f66e0 2021-11-03T17:47:55.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.071+0000 7f43227fc700 1 -- 172.21.15.26:0/2882450391 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f431c01d420 con 0x7f432c0f66e0 2021-11-03T17:47:55.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.071+0000 7f43227fc700 1 --2- 172.21.15.26:0/2882450391 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4318064100 0x7f43180665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:47:55.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.071+0000 7f43227fc700 1 -- 172.21.15.26:0/2882450391 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f431c082410 con 0x7f432c0f66e0 2021-11-03T17:47:55.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.071+0000 7f4331faa700 1 --2- 172.21.15.26:0/2882450391 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4318064100 0x7f43180665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:47:55.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.072+0000 7f4331faa700 1 --2- 172.21.15.26:0/2882450391 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4318064100 0x7f43180665c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f432c060060 tx=0x7f432800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:47:55.075 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.076+0000 7f43227fc700 1 -- 172.21.15.26:0/2882450391 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f431c054710 con 0x7f432c0f66e0 2021-11-03T17:47:55.248 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.253+0000 7f4332fac700 1 -- 172.21.15.26:0/2882450391 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f432c0fdd10 con 0x7f4318064100 2021-11-03T17:47:55.249 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.254+0000 7f43227fc700 1 -- 172.21.15.26:0/2882450391 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f432c0fdd10 con 0x7f4318064100 2021-11-03T17:47:55.251 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.256+0000 7f4332fac700 1 -- 172.21.15.26:0/2882450391 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4318064100 msgr2=0x7f43180665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:47:55.251 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.256+0000 7f4332fac700 1 --2- 172.21.15.26:0/2882450391 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4318064100 0x7f43180665c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f432c060060 tx=0x7f432800b040).stop 2021-11-03T17:47:55.251 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.256+0000 7f4332fac700 1 -- 172.21.15.26:0/2882450391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f432c0f66e0 msgr2=0x7f432c10beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:47:55.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.256+0000 7f4332fac700 1 --2- 172.21.15.26:0/2882450391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f432c0f66e0 0x7f432c10beb0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7f431c009990 tx=0x7f431c009b30).stop 2021-11-03T17:47:55.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.256+0000 7f4332fac700 1 -- 172.21.15.26:0/2882450391 shutdown_connections 2021-11-03T17:47:55.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.256+0000 7f4332fac700 1 --2- 172.21.15.26:0/2882450391 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4318064100 0x7f43180665c0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:55.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.256+0000 7f4332fac700 1 --2- 172.21.15.26:0/2882450391 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f432c0f5440 0x7f432c1099b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:55.253 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.256+0000 7f4332fac700 1 --2- 172.21.15.26:0/2882450391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f432c0f66e0 0x7f432c10beb0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:55.253 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.256+0000 7f4332fac700 1 -- 172.21.15.26:0/2882450391 >> 172.21.15.26:0/2882450391 conn(0x7f432c0f0ba0 msgr2=0x7f432c0fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:47:55.253 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.256+0000 7f4332fac700 1 -- 172.21.15.26:0/2882450391 shutdown_connections 2021-11-03T17:47:55.253 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.256+0000 7f4332fac700 1 -- 172.21.15.26:0/2882450391 wait complete. 2021-11-03T17:47:55.261 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:47:55.353 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.356+0000 7f462f59e700 1 -- 172.21.15.26:0/2629685852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46300f66e0 msgr2=0x7f46300f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:47:55.353 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.356+0000 7f462f59e700 1 --2- 172.21.15.26:0/2629685852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46300f66e0 0x7f46300f6b40 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7f4624004660 tx=0x7f4624009b30).stop 2021-11-03T17:47:55.353 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.356+0000 7f462f59e700 1 -- 172.21.15.26:0/2629685852 shutdown_connections 2021-11-03T17:47:55.354 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.356+0000 7f462f59e700 1 --2- 172.21.15.26:0/2629685852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46300f66e0 0x7f46300f6b40 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:55.354 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.356+0000 7f462f59e700 1 --2- 172.21.15.26:0/2629685852 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46300f5440 0x7f46300f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:55.354 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.356+0000 7f462f59e700 1 -- 172.21.15.26:0/2629685852 >> 172.21.15.26:0/2629685852 conn(0x7f46300f0ba0 msgr2=0x7f46300f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:47:55.355 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.356+0000 7f462f59e700 1 -- 172.21.15.26:0/2629685852 shutdown_connections 2021-11-03T17:47:55.355 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.356+0000 7f462f59e700 1 -- 172.21.15.26:0/2629685852 wait complete. 2021-11-03T17:47:55.355 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.357+0000 7f462f59e700 1 Processor -- start 2021-11-03T17:47:55.355 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.357+0000 7f462f59e700 1 -- start start 2021-11-03T17:47:55.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.357+0000 7f462f59e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46300f5440 0x7f4630109ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:47:55.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.357+0000 7f462f59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46300f66e0 0x7f463010bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:47:55.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.357+0000 7f462f59e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46300603c0 con 0x7f46300f66e0 2021-11-03T17:47:55.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.357+0000 7f462f59e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4630060500 con 0x7f46300f5440 2021-11-03T17:47:55.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.357+0000 7f462dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46300f66e0 0x7f463010bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:47:55.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.357+0000 7f462dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46300f66e0 0x7f463010bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56426/0 (socket says 172.21.15.26:56426) 2021-11-03T17:47:55.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.357+0000 7f462dd9b700 1 -- 172.21.15.26:0/4211150627 learned_addr learned my addr 172.21.15.26:0/4211150627 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:47:55.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.357+0000 7f462e59c700 1 --2- 172.21.15.26:0/4211150627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46300f5440 0x7f4630109ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:47:55.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.358+0000 7f462dd9b700 1 -- 172.21.15.26:0/4211150627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46300f5440 msgr2=0x7f4630109ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:47:55.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.358+0000 7f462dd9b700 1 --2- 172.21.15.26:0/4211150627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46300f5440 0x7f4630109ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:55.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.358+0000 7f462dd9b700 1 -- 172.21.15.26:0/4211150627 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4624005040 con 0x7f46300f66e0 2021-11-03T17:47:55.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.358+0000 7f462e59c700 1 --2- 172.21.15.26:0/4211150627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46300f5440 0x7f4630109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:47:55.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.358+0000 7f462dd9b700 1 --2- 172.21.15.26:0/4211150627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46300f66e0 0x7f463010bfb0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7f4624009990 tx=0x7f4624009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:47:55.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.358+0000 7f461effd700 1 -- 172.21.15.26:0/4211150627 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4624018070 con 0x7f46300f66e0 2021-11-03T17:47:55.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.358+0000 7f461effd700 1 -- 172.21.15.26:0/4211150627 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4624007ca0 con 0x7f46300f66e0 2021-11-03T17:47:55.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.358+0000 7f462f59e700 1 -- 172.21.15.26:0/4211150627 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f463010c500 con 0x7f46300f66e0 2021-11-03T17:47:55.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.358+0000 7f461effd700 1 -- 172.21.15.26:0/4211150627 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f462401c620 con 0x7f46300f66e0 2021-11-03T17:47:55.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.358+0000 7f462f59e700 1 -- 172.21.15.26:0/4211150627 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f463010ca30 con 0x7f46300f66e0 2021-11-03T17:47:55.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.359+0000 7f462f59e700 1 -- 172.21.15.26:0/4211150627 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4630045ad0 con 0x7f46300f66e0 2021-11-03T17:47:55.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.359+0000 7f461effd700 1 -- 172.21.15.26:0/4211150627 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f462401d960 con 0x7f46300f66e0 2021-11-03T17:47:55.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.360+0000 7f461effd700 1 --2- 172.21.15.26:0/4211150627 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4618064100 0x7f46180665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:47:55.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.360+0000 7f461effd700 1 -- 172.21.15.26:0/4211150627 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f4624082470 con 0x7f46300f66e0 2021-11-03T17:47:55.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.360+0000 7f462e59c700 1 --2- 172.21.15.26:0/4211150627 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4618064100 0x7f46180665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:47:55.363 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.360+0000 7f462e59c700 1 --2- 172.21.15.26:0/4211150627 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4618064100 0x7f46180665c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f4630060040 tx=0x7f4620009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:47:55.363 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.364+0000 7f461effd700 1 -- 172.21.15.26:0/4211150627 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f4624054890 con 0x7f46300f66e0 2021-11-03T17:47:55.531 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.537+0000 7f462f59e700 1 -- 172.21.15.26:0/4211150627 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4630057f10 con 0x7f4618064100 2021-11-03T17:47:55.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.551+0000 7f461effd700 1 -- 172.21.15.26:0/4211150627 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f4630057f10 con 0x7f4618064100 2021-11-03T17:47:55.546 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:47:55.547 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (59m) 8m ago 60m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:47:55.547 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (51m) 8m ago 60m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:47:55.547 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (51m) 7m ago 59m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:47:55.547 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (58m) 8m ago 60m 40.8M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:47:55.548 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (52m) 8m ago 55m 25.1M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:47:55.548 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (52m) 8m ago 55m 25.7M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:47:55.548 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (55m) 7m ago 55m 26.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:47:55.549 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (55m) 7m ago 55m 26.3M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:47:55.549 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (52m) 8m ago 61m 533M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:47:55.549 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (52m) 7m ago 59m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:47:55.549 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (52m) 8m ago 61m 209M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:47:55.549 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (51m) 7m ago 59m 103M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:47:55.550 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (60m) 8m ago 60m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:47:55.550 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (59m) 7m ago 59m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:47:55.550 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (50m) 8m ago 58m 251M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:47:55.550 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (50m) 8m ago 58m 270M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:47:55.551 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (49m) 8m ago 58m 225M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:47:55.551 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (49m) 7m ago 57m 287M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:47:55.551 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (49m) 7m ago 57m 246M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:47:55.552 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (48m) 7m ago 57m 235M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:47:55.552 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (58m) 8m ago 59m 56.7M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:47:55.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.553+0000 7f462f59e700 1 -- 172.21.15.26:0/4211150627 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4618064100 msgr2=0x7f46180665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:47:55.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.553+0000 7f462f59e700 1 --2- 172.21.15.26:0/4211150627 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4618064100 0x7f46180665c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f4630060040 tx=0x7f4620009040).stop 2021-11-03T17:47:55.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.553+0000 7f462f59e700 1 -- 172.21.15.26:0/4211150627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46300f66e0 msgr2=0x7f463010bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:47:55.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.553+0000 7f462f59e700 1 --2- 172.21.15.26:0/4211150627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46300f66e0 0x7f463010bfb0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7f4624009990 tx=0x7f4624009b30).stop 2021-11-03T17:47:55.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.553+0000 7f462f59e700 1 -- 172.21.15.26:0/4211150627 shutdown_connections 2021-11-03T17:47:55.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.553+0000 7f462f59e700 1 --2- 172.21.15.26:0/4211150627 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4618064100 0x7f46180665c0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:55.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.553+0000 7f462f59e700 1 --2- 172.21.15.26:0/4211150627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46300f5440 0x7f4630109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:55.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.553+0000 7f462f59e700 1 --2- 172.21.15.26:0/4211150627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46300f66e0 0x7f463010bfb0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:55.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.553+0000 7f462f59e700 1 -- 172.21.15.26:0/4211150627 >> 172.21.15.26:0/4211150627 conn(0x7f46300f0ba0 msgr2=0x7f46300fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:47:55.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.553+0000 7f462f59e700 1 -- 172.21.15.26:0/4211150627 shutdown_connections 2021-11-03T17:47:55.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.553+0000 7f462f59e700 1 -- 172.21.15.26:0/4211150627 wait complete. 2021-11-03T17:47:55.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.652+0000 7fcf00b2e700 1 -- 172.21.15.26:0/1065778259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcefc060310 msgr2=0x7fcefc0f93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:47:55.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.652+0000 7fcf00b2e700 1 --2- 172.21.15.26:0/1065778259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcefc060310 0x7fcefc0f93e0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7fceec004660 tx=0x7fceec009b30).stop 2021-11-03T17:47:55.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.653+0000 7fcf00b2e700 1 -- 172.21.15.26:0/1065778259 shutdown_connections 2021-11-03T17:47:55.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.653+0000 7fcf00b2e700 1 --2- 172.21.15.26:0/1065778259 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcefc0f98d0 0x7fcefc0fbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:55.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.653+0000 7fcf00b2e700 1 --2- 172.21.15.26:0/1065778259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcefc060310 0x7fcefc0f93e0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:55.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.653+0000 7fcf00b2e700 1 -- 172.21.15.26:0/1065778259 >> 172.21.15.26:0/1065778259 conn(0x7fcefc0f0de0 msgr2=0x7fcefc0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:47:55.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.653+0000 7fcf00b2e700 1 -- 172.21.15.26:0/1065778259 shutdown_connections 2021-11-03T17:47:55.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.653+0000 7fcf00b2e700 1 -- 172.21.15.26:0/1065778259 wait complete. 2021-11-03T17:47:55.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.653+0000 7fcf00b2e700 1 Processor -- start 2021-11-03T17:47:55.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.653+0000 7fcf00b2e700 1 -- start start 2021-11-03T17:47:55.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.653+0000 7fcf00b2e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcefc060310 0x7fcefc0f6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:47:55.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.653+0000 7fcf00b2e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcefc0f98d0 0x7fcefc0f52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:47:55.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.653+0000 7fcf00b2e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcefc0f5840 con 0x7fcefc0f98d0 2021-11-03T17:47:55.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.653+0000 7fcf00b2e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcefc0f5980 con 0x7fcefc060310 2021-11-03T17:47:55.654 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.653+0000 7fcef9d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcefc0f98d0 0x7fcefc0f52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:47:55.654 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.653+0000 7fcef9d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcefc0f98d0 0x7fcefc0f52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56436/0 (socket says 172.21.15.26:56436) 2021-11-03T17:47:55.654 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.653+0000 7fcef9d9b700 1 -- 172.21.15.26:0/2152057704 learned_addr learned my addr 172.21.15.26:0/2152057704 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:47:55.655 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.654+0000 7fcefa59c700 1 --2- 172.21.15.26:0/2152057704 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcefc060310 0x7fcefc0f6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:47:55.655 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.654+0000 7fcef9d9b700 1 -- 172.21.15.26:0/2152057704 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcefc060310 msgr2=0x7fcefc0f6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:47:55.655 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.654+0000 7fcef9d9b700 1 --2- 172.21.15.26:0/2152057704 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcefc060310 0x7fcefc0f6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:55.655 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.654+0000 7fcef9d9b700 1 -- 172.21.15.26:0/2152057704 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceec005040 con 0x7fcefc0f98d0 2021-11-03T17:47:55.655 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.654+0000 7fcefa59c700 1 --2- 172.21.15.26:0/2152057704 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcefc060310 0x7fcefc0f6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:47:55.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.654+0000 7fcef9d9b700 1 --2- 172.21.15.26:0/2152057704 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcefc0f98d0 0x7fcefc0f52e0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7fcef0002700 tx=0x7fcef0009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:47:55.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.654+0000 7fceeaffd700 1 -- 172.21.15.26:0/2152057704 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcef0009320 con 0x7fcefc0f98d0 2021-11-03T17:47:55.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.654+0000 7fceeaffd700 1 -- 172.21.15.26:0/2152057704 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcef000f040 con 0x7fcefc0f98d0 2021-11-03T17:47:55.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.654+0000 7fcf00b2e700 1 -- 172.21.15.26:0/2152057704 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcefc0f5c60 con 0x7fcefc0f98d0 2021-11-03T17:47:55.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.654+0000 7fceeaffd700 1 -- 172.21.15.26:0/2152057704 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcef0014820 con 0x7fcefc0f98d0 2021-11-03T17:47:55.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.654+0000 7fcf00b2e700 1 -- 172.21.15.26:0/2152057704 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcefc10ef40 con 0x7fcefc0f98d0 2021-11-03T17:47:55.658 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.655+0000 7fcf00b2e700 1 -- 172.21.15.26:0/2152057704 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcefc045ad0 con 0x7fcefc0f98d0 2021-11-03T17:47:55.659 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.655+0000 7fceeaffd700 1 -- 172.21.15.26:0/2152057704 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fcef0009480 con 0x7fcefc0f98d0 2021-11-03T17:47:55.659 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.656+0000 7fceeaffd700 1 --2- 172.21.15.26:0/2152057704 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcee40640b0 0x7fcee4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:47:55.660 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.656+0000 7fceeaffd700 1 -- 172.21.15.26:0/2152057704 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fcef0080a30 con 0x7fcefc0f98d0 2021-11-03T17:47:55.660 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.656+0000 7fcefa59c700 1 --2- 172.21.15.26:0/2152057704 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcee40640b0 0x7fcee4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:47:55.660 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.656+0000 7fcefa59c700 1 --2- 172.21.15.26:0/2152057704 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcee40640b0 0x7fcee4066570 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7fceec004e30 tx=0x7fceec009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:47:55.661 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.660+0000 7fceeaffd700 1 -- 172.21.15.26:0/2152057704 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fcef0052d90 con 0x7fcefc0f98d0 2021-11-03T17:47:55.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:47:55.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:55 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:47:55.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:47:55.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:55 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:47:55.882 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.887+0000 7fcf00b2e700 1 -- 172.21.15.26:0/2152057704 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcefc0fef50 con 0x7fcefc0f98d0 2021-11-03T17:47:55.883 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.888+0000 7fceeaffd700 1 -- 172.21.15.26:0/2152057704 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fcef0052980 con 0x7fcefc0f98d0 2021-11-03T17:47:55.883 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:47:55.883 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:47:55.884 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:47:55.884 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:47:55.884 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:47:55.885 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:47:55.885 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:47:55.885 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:47:55.885 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:47:55.885 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:47:55.886 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:47:55.886 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:47:55.886 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:47:55.886 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:47:55.887 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:47:55.887 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:47:55.887 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:47:55.887 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:47:55.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.889+0000 7fcf00b2e700 1 -- 172.21.15.26:0/2152057704 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcee40640b0 msgr2=0x7fcee4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:47:55.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.889+0000 7fcf00b2e700 1 --2- 172.21.15.26:0/2152057704 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcee40640b0 0x7fcee4066570 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7fceec004e30 tx=0x7fceec009b30).stop 2021-11-03T17:47:55.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.889+0000 7fcf00b2e700 1 -- 172.21.15.26:0/2152057704 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcefc0f98d0 msgr2=0x7fcefc0f52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:47:55.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.889+0000 7fcf00b2e700 1 --2- 172.21.15.26:0/2152057704 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcefc0f98d0 0x7fcefc0f52e0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7fcef0002700 tx=0x7fcef0009e00).stop 2021-11-03T17:47:55.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.889+0000 7fcf00b2e700 1 -- 172.21.15.26:0/2152057704 shutdown_connections 2021-11-03T17:47:55.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.889+0000 7fcf00b2e700 1 --2- 172.21.15.26:0/2152057704 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcee40640b0 0x7fcee4066570 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:55.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.889+0000 7fcf00b2e700 1 --2- 172.21.15.26:0/2152057704 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcefc060310 0x7fcefc0f6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:55.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.889+0000 7fcf00b2e700 1 --2- 172.21.15.26:0/2152057704 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcefc0f98d0 0x7fcefc0f52e0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:55.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.889+0000 7fcf00b2e700 1 -- 172.21.15.26:0/2152057704 >> 172.21.15.26:0/2152057704 conn(0x7fcefc0f0de0 msgr2=0x7fcefc0f31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:47:55.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.890+0000 7fcf00b2e700 1 -- 172.21.15.26:0/2152057704 shutdown_connections 2021-11-03T17:47:55.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.890+0000 7fcf00b2e700 1 -- 172.21.15.26:0/2152057704 wait complete. 2021-11-03T17:47:55.986 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.989+0000 7f627949c700 1 -- 172.21.15.26:0/859291920 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62740f55e0 msgr2=0x7f62740f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:47:55.986 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.989+0000 7f627949c700 1 --2- 172.21.15.26:0/859291920 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62740f55e0 0x7f62740f5a00 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7f626c0099e0 tx=0x7f626c004d10).stop 2021-11-03T17:47:55.987 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.990+0000 7f627949c700 1 -- 172.21.15.26:0/859291920 shutdown_connections 2021-11-03T17:47:55.987 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.990+0000 7f627949c700 1 --2- 172.21.15.26:0/859291920 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62740f5ef0 0x7f62740f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:55.987 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.990+0000 7f627949c700 1 --2- 172.21.15.26:0/859291920 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62740f55e0 0x7f62740f5a00 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:55.988 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.990+0000 7f627949c700 1 -- 172.21.15.26:0/859291920 >> 172.21.15.26:0/859291920 conn(0x7f62740f0de0 msgr2=0x7f62740f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:47:55.988 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.990+0000 7f627949c700 1 -- 172.21.15.26:0/859291920 shutdown_connections 2021-11-03T17:47:55.988 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.990+0000 7f627949c700 1 -- 172.21.15.26:0/859291920 wait complete. 2021-11-03T17:47:55.988 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.990+0000 7f627949c700 1 Processor -- start 2021-11-03T17:47:55.989 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.990+0000 7f627949c700 1 -- start start 2021-11-03T17:47:55.989 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.990+0000 7f627949c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62740f55e0 0x7f6274107090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:47:55.989 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.990+0000 7f627949c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62740f5ef0 0x7f6274107580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:47:55.989 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.990+0000 7f627949c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6274107b30 con 0x7f62740f55e0 2021-11-03T17:47:55.990 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.990+0000 7f627949c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6274107c70 con 0x7f62740f5ef0 2021-11-03T17:47:55.990 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.991+0000 7f6272ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62740f55e0 0x7f6274107090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:47:55.990 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.991+0000 7f6272ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62740f55e0 0x7f6274107090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56444/0 (socket says 172.21.15.26:56444) 2021-11-03T17:47:55.990 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.991+0000 7f6272ffd700 1 -- 172.21.15.26:0/1727377336 learned_addr learned my addr 172.21.15.26:0/1727377336 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:47:55.990 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.991+0000 7f6272ffd700 1 -- 172.21.15.26:0/1727377336 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62740f5ef0 msgr2=0x7f6274107580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:47:55.991 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.991+0000 7f6272ffd700 1 --2- 172.21.15.26:0/1727377336 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62740f5ef0 0x7f6274107580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:47:55.991 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.991+0000 7f6272ffd700 1 -- 172.21.15.26:0/1727377336 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626c009640 con 0x7f62740f55e0 2021-11-03T17:47:55.991 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.991+0000 7f6272ffd700 1 --2- 172.21.15.26:0/1727377336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62740f55e0 0x7f6274107090 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7f626c00b3b0 tx=0x7f626c004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:47:55.991 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.991+0000 7f626b7fe700 1 -- 172.21.15.26:0/1727377336 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f626c00e030 con 0x7f62740f55e0 2021-11-03T17:47:55.992 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.991+0000 7f626b7fe700 1 -- 172.21.15.26:0/1727377336 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f626c0049b0 con 0x7f62740f55e0 2021-11-03T17:47:55.992 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.991+0000 7f627949c700 1 -- 172.21.15.26:0/1727377336 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62741085b0 con 0x7f62740f55e0 2021-11-03T17:47:55.992 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.991+0000 7f626b7fe700 1 -- 172.21.15.26:0/1727377336 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f626c018070 con 0x7f62740f55e0 2021-11-03T17:47:55.992 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.991+0000 7f627949c700 1 -- 172.21.15.26:0/1727377336 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6274108a90 con 0x7f62740f55e0 2021-11-03T17:47:55.993 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.992+0000 7f627949c700 1 -- 172.21.15.26:0/1727377336 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6274045ad0 con 0x7f62740f55e0 2021-11-03T17:47:55.994 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.993+0000 7f626b7fe700 1 -- 172.21.15.26:0/1727377336 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f626c007d40 con 0x7f62740f55e0 2021-11-03T17:47:55.994 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.993+0000 7f626b7fe700 1 --2- 172.21.15.26:0/1727377336 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f62600640b0 0x7f6260066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:47:55.994 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.993+0000 7f626b7fe700 1 -- 172.21.15.26:0/1727377336 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f626c082520 con 0x7f62740f55e0 2021-11-03T17:47:55.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.993+0000 7f62727fc700 1 --2- 172.21.15.26:0/1727377336 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f62600640b0 0x7f6260066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:47:55.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.993+0000 7f62727fc700 1 --2- 172.21.15.26:0/1727377336 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f62600640b0 0x7f6260066570 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f625c004a10 tx=0x7f625c0099e0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:47:55.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:55.997+0000 7f626b7fe700 1 -- 172.21.15.26:0/1727377336 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f626c054880 con 0x7f62740f55e0 2021-11-03T17:47:56.194 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:56.199+0000 7f627949c700 1 -- 172.21.15.26:0/1727377336 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f627410d6b0 con 0x7f62740f55e0 2021-11-03T17:47:56.195 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:56.200+0000 7f626b7fe700 1 -- 172.21.15.26:0/1727377336 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f626c054470 con 0x7f62740f55e0 2021-11-03T17:47:56.195 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:47:56.195 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:47:56.196 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:47:56.196 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:47:56.196 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:47:56.196 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:47:56.196 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:47:56.197 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:47:56.197 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:47:56.197 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:47:56.197 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:47:56.198 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:47:56.198 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:47:56.198 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:47:56.198 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:47:56.198 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:47:56.199 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:47:56.199 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:47:56.199 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:47:56.199 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:47:56.200 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:47:56.200 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:47:56.200 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:47:56.200 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:47:56.200 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:47:56.201 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:47:56.201 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:47:56.201 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:47:56.201 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:47:56.202 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:47:56.202 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:47:56.203 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:47:56.203 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:47:56.203 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:47:56.203 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:47:56.204 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:47:56.204 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:47:56.204 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:47:56.204 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:47:56.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:56.201+0000 7f627949c700 1 -- 172.21.15.26:0/1727377336 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f62600640b0 msgr2=0x7f6260066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:47:56.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:56.201+0000 7f627949c700 1 --2- 172.21.15.26:0/1727377336 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f62600640b0 0x7f6260066570 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f625c004a10 tx=0x7f625c0099e0).stop 2021-11-03T17:47:56.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:56.201+0000 7f627949c700 1 -- 172.21.15.26:0/1727377336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62740f55e0 msgr2=0x7f6274107090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:47:56.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:56.201+0000 7f627949c700 1 --2- 172.21.15.26:0/1727377336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62740f55e0 0x7f6274107090 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7f626c00b3b0 tx=0x7f626c004d10).stop 2021-11-03T17:47:56.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:56.201+0000 7f627949c700 1 -- 172.21.15.26:0/1727377336 shutdown_connections 2021-11-03T17:47:56.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:56.202+0000 7f627949c700 1 --2- 172.21.15.26:0/1727377336 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f62600640b0 0x7f6260066570 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:56.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:56.202+0000 7f627949c700 1 --2- 172.21.15.26:0/1727377336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62740f55e0 0x7f6274107090 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:47:56.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:56.202+0000 7f627949c700 1 --2- 172.21.15.26:0/1727377336 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62740f5ef0 0x7f6274107580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:47:56.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:56.202+0000 7f627949c700 1 -- 172.21.15.26:0/1727377336 >> 172.21.15.26:0/1727377336 conn(0x7f62740f0de0 msgr2=0x7f627405f740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:47:56.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:56.202+0000 7f627949c700 1 -- 172.21.15.26:0/1727377336 shutdown_connections 2021-11-03T17:47:56.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:47:56.202+0000 7f627949c700 1 -- 172.21.15.26:0/1727377336 wait complete. 2021-11-03T17:47:56.208 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:47:56.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:56 smithi026 ceph-mon[96795]: pgmap v1598: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:56.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:56 smithi026 ceph-mon[96795]: from='client.35788 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:47:56.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:56 smithi026 ceph-mon[96795]: from='client.35792 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:47:56.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:56 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2152057704' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:47:56.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:56 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1727377336' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:47:56.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:56 smithi194 ceph-mon[65619]: pgmap v1598: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:56.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:56 smithi194 ceph-mon[65619]: from='client.35788 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:47:56.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:56 smithi194 ceph-mon[65619]: from='client.35792 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:47:56.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:56 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2152057704' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:47:56.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:56 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1727377336' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:47:58.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:47:58 smithi026 ceph-mon[96795]: pgmap v1599: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:47:58.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:47:58 smithi194 ceph-mon[65619]: pgmap v1599: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:00.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:00 smithi026 ceph-mon[96795]: pgmap v1600: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:00.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:00 smithi194 ceph-mon[65619]: pgmap v1600: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:02.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:02 smithi026 ceph-mon[96795]: pgmap v1601: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:02.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:02 smithi194 ceph-mon[65619]: pgmap v1601: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:04.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:04 smithi026 ceph-mon[96795]: pgmap v1602: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:04.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:04 smithi194 ceph-mon[65619]: pgmap v1602: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:06.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:06 smithi026 ceph-mon[96795]: pgmap v1603: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:06.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:06 smithi194 ceph-mon[65619]: pgmap v1603: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:08.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:08 smithi026 ceph-mon[96795]: pgmap v1604: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:08.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:08 smithi194 ceph-mon[65619]: pgmap v1604: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:10.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:10 smithi026 ceph-mon[96795]: pgmap v1605: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:10.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:10 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:48:10.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:10 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:48:10.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:10 smithi194 ceph-mon[65619]: pgmap v1605: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:10.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:10 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:48:10.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:10 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:48:12.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:12 smithi026 ceph-mon[96795]: pgmap v1606: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:12.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:12 smithi194 ceph-mon[65619]: pgmap v1606: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:14.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:14 smithi026 ceph-mon[96795]: pgmap v1607: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:14.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:14 smithi194 ceph-mon[65619]: pgmap v1607: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:16.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:16 smithi194 ceph-mon[65619]: pgmap v1608: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:16.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:16 smithi026 ceph-mon[96795]: pgmap v1608: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:18.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:18 smithi194 ceph-mon[65619]: pgmap v1609: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:18.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:18 smithi026 ceph-mon[96795]: pgmap v1609: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:20.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:20 smithi194 ceph-mon[65619]: pgmap v1610: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:20.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:20 smithi026 ceph-mon[96795]: pgmap v1610: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:22.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:22 smithi194 ceph-mon[65619]: pgmap v1611: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:22.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:22 smithi026 ceph-mon[96795]: pgmap v1611: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:24.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:24 smithi194 ceph-mon[65619]: pgmap v1612: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:24.841 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:24 smithi026 ceph-mon[96795]: pgmap v1612: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:25.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:48:25.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:25 smithi194 ceph-mon[65619]: poll took 60056.906 ms: 1 events 2021-11-03T17:48:25.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:48:25.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:48:25.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:48:25.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:48:25.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:48:25.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:48:25.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:48:25.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:48:25.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:48:25.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:25 smithi026 ceph-mon[96795]: poll took 60056.906 ms: 1 events 2021-11-03T17:48:25.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:48:25.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:48:25.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:48:25.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:48:25.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:48:25.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:48:25.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:48:25.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:48:26.311 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.317+0000 7f51c2b82700 1 -- 172.21.15.26:0/916908919 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51bc0f5400 msgr2=0x7f51bc0fbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:48:26.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.317+0000 7f51c2b82700 1 --2- 172.21.15.26:0/916908919 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51bc0f5400 0x7f51bc0fbd10 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 rx=0x7f51a8004660 tx=0x7f51a8009b30).stop 2021-11-03T17:48:26.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.317+0000 7f51c2b82700 1 -- 172.21.15.26:0/916908919 shutdown_connections 2021-11-03T17:48:26.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.317+0000 7f51c2b82700 1 --2- 172.21.15.26:0/916908919 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51bc0f5400 0x7f51bc0fbd10 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:26.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.317+0000 7f51c2b82700 1 --2- 172.21.15.26:0/916908919 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51bc0f4a60 0x7f51bc0f4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:26.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.317+0000 7f51c2b82700 1 -- 172.21.15.26:0/916908919 >> 172.21.15.26:0/916908919 conn(0x7f51bc0f04c0 msgr2=0x7f51bc0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:48:26.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.317+0000 7f51c2b82700 1 -- 172.21.15.26:0/916908919 shutdown_connections 2021-11-03T17:48:26.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.317+0000 7f51c2b82700 1 -- 172.21.15.26:0/916908919 wait complete. 2021-11-03T17:48:26.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.318+0000 7f51c2b82700 1 Processor -- start 2021-11-03T17:48:26.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.318+0000 7f51c2b82700 1 -- start start 2021-11-03T17:48:26.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.318+0000 7f51c2b82700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51bc0f4a60 0x7f51bc0f7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:48:26.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.318+0000 7f51c2b82700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51bc0f5400 0x7f51bc0f5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:48:26.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.318+0000 7f51c2b82700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc0f6030 con 0x7f51bc0f4a60 2021-11-03T17:48:26.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.318+0000 7f51c2b82700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc0f6170 con 0x7f51bc0f5400 2021-11-03T17:48:26.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.318+0000 7f51c091e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51bc0f4a60 0x7f51bc0f7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:48:26.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.318+0000 7f51c091e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51bc0f4a60 0x7f51bc0f7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56462/0 (socket says 172.21.15.26:56462) 2021-11-03T17:48:26.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.318+0000 7f51c091e700 1 -- 172.21.15.26:0/4027084540 learned_addr learned my addr 172.21.15.26:0/4027084540 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:48:26.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.319+0000 7f51bbfff700 1 --2- 172.21.15.26:0/4027084540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51bc0f5400 0x7f51bc0f5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:48:26.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.319+0000 7f51c091e700 1 -- 172.21.15.26:0/4027084540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51bc0f5400 msgr2=0x7f51bc0f5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:48:26.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.319+0000 7f51c091e700 1 --2- 172.21.15.26:0/4027084540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51bc0f5400 0x7f51bc0f5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:26.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.319+0000 7f51c091e700 1 -- 172.21.15.26:0/4027084540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a8005040 con 0x7f51bc0f4a60 2021-11-03T17:48:26.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.319+0000 7f51bbfff700 1 --2- 172.21.15.26:0/4027084540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51bc0f5400 0x7f51bc0f5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:48:26.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.319+0000 7f51c091e700 1 --2- 172.21.15.26:0/4027084540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51bc0f4a60 0x7f51bc0f7650 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7f51b0002700 tx=0x7f51b0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:48:26.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.319+0000 7f51b97fa700 1 -- 172.21.15.26:0/4027084540 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51b0009320 con 0x7f51bc0f4a60 2021-11-03T17:48:26.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.319+0000 7f51c2b82700 1 -- 172.21.15.26:0/4027084540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51bc0f6450 con 0x7f51bc0f4a60 2021-11-03T17:48:26.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.319+0000 7f51b97fa700 1 -- 172.21.15.26:0/4027084540 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f51b000f040 con 0x7f51bc0f4a60 2021-11-03T17:48:26.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.319+0000 7f51b97fa700 1 -- 172.21.15.26:0/4027084540 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51b0013850 con 0x7f51bc0f4a60 2021-11-03T17:48:26.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.319+0000 7f51c2b82700 1 -- 172.21.15.26:0/4027084540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51bc10efb0 con 0x7f51bc0f4a60 2021-11-03T17:48:26.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.320+0000 7f51c2b82700 1 -- 172.21.15.26:0/4027084540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51bc045ad0 con 0x7f51bc0f4a60 2021-11-03T17:48:26.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.321+0000 7f51b97fa700 1 -- 172.21.15.26:0/4027084540 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f51b0009480 con 0x7f51bc0f4a60 2021-11-03T17:48:26.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.321+0000 7f51b97fa700 1 --2- 172.21.15.26:0/4027084540 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f51ac0640b0 0x7f51ac066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:48:26.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.321+0000 7f51b97fa700 1 -- 172.21.15.26:0/4027084540 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f51b00809c0 con 0x7f51bc0f4a60 2021-11-03T17:48:26.323 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.321+0000 7f51bbfff700 1 --2- 172.21.15.26:0/4027084540 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f51ac0640b0 0x7f51ac066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:48:26.323 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.321+0000 7f51bbfff700 1 --2- 172.21.15.26:0/4027084540 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f51ac0640b0 0x7f51ac066570 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f51a8005010 tx=0x7f51a8009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:48:26.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.325+0000 7f51b97fa700 1 -- 172.21.15.26:0/4027084540 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f51b0052c30 con 0x7f51bc0f4a60 2021-11-03T17:48:26.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.503+0000 7f51c2b82700 1 -- 172.21.15.26:0/4027084540 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f51bc0fefc0 con 0x7f51ac0640b0 2021-11-03T17:48:26.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.505+0000 7f51b97fa700 1 -- 172.21.15.26:0/4027084540 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f51bc0fefc0 con 0x7f51ac0640b0 2021-11-03T17:48:26.500 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.506+0000 7f51c2b82700 1 -- 172.21.15.26:0/4027084540 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f51ac0640b0 msgr2=0x7f51ac066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:48:26.500 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.506+0000 7f51c2b82700 1 --2- 172.21.15.26:0/4027084540 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f51ac0640b0 0x7f51ac066570 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f51a8005010 tx=0x7f51a8009b30).stop 2021-11-03T17:48:26.501 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.506+0000 7f51c2b82700 1 -- 172.21.15.26:0/4027084540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51bc0f4a60 msgr2=0x7f51bc0f7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:48:26.501 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.506+0000 7f51c2b82700 1 --2- 172.21.15.26:0/4027084540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51bc0f4a60 0x7f51bc0f7650 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7f51b0002700 tx=0x7f51b0009de0).stop 2021-11-03T17:48:26.501 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.506+0000 7f51c2b82700 1 -- 172.21.15.26:0/4027084540 shutdown_connections 2021-11-03T17:48:26.501 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.506+0000 7f51c2b82700 1 --2- 172.21.15.26:0/4027084540 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f51ac0640b0 0x7f51ac066570 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:26.502 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.506+0000 7f51c2b82700 1 --2- 172.21.15.26:0/4027084540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51bc0f4a60 0x7f51bc0f7650 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:26.502 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.506+0000 7f51c2b82700 1 --2- 172.21.15.26:0/4027084540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51bc0f5400 0x7f51bc0f5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:26.502 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.506+0000 7f51c2b82700 1 -- 172.21.15.26:0/4027084540 >> 172.21.15.26:0/4027084540 conn(0x7f51bc0f04c0 msgr2=0x7f51bc0f8510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:48:26.502 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.507+0000 7f51c2b82700 1 -- 172.21.15.26:0/4027084540 shutdown_connections 2021-11-03T17:48:26.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.507+0000 7f51c2b82700 1 -- 172.21.15.26:0/4027084540 wait complete. 2021-11-03T17:48:26.510 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:48:26.600 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.606+0000 7fef51d55700 1 -- 172.21.15.26:0/2452237806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef4c0f55e0 msgr2=0x7fef4c0f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:48:26.601 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.606+0000 7fef51d55700 1 --2- 172.21.15.26:0/2452237806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef4c0f55e0 0x7fef4c0f5a00 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7fef3c004660 tx=0x7fef3c009b30).stop 2021-11-03T17:48:26.601 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.606+0000 7fef51d55700 1 -- 172.21.15.26:0/2452237806 shutdown_connections 2021-11-03T17:48:26.601 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.606+0000 7fef51d55700 1 --2- 172.21.15.26:0/2452237806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef4c0f5ef0 0x7fef4c0f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:26.601 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.606+0000 7fef51d55700 1 --2- 172.21.15.26:0/2452237806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef4c0f55e0 0x7fef4c0f5a00 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:26.602 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.606+0000 7fef51d55700 1 -- 172.21.15.26:0/2452237806 >> 172.21.15.26:0/2452237806 conn(0x7fef4c0f0de0 msgr2=0x7fef4c0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:48:26.602 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.606+0000 7fef51d55700 1 -- 172.21.15.26:0/2452237806 shutdown_connections 2021-11-03T17:48:26.602 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.606+0000 7fef51d55700 1 -- 172.21.15.26:0/2452237806 wait complete. 2021-11-03T17:48:26.602 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.606+0000 7fef51d55700 1 Processor -- start 2021-11-03T17:48:26.603 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.607+0000 7fef51d55700 1 -- start start 2021-11-03T17:48:26.605 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.607+0000 7fef51d55700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef4c0f55e0 0x7fef4c106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:48:26.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.607+0000 7fef51d55700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef4c0f5ef0 0x7fef4c107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:48:26.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.607+0000 7fef51d55700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4c107a00 con 0x7fef4c0f55e0 2021-11-03T17:48:26.607 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.607+0000 7fef51d55700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4c107b40 con 0x7fef4c0f5ef0 2021-11-03T17:48:26.607 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.607+0000 7fef4b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef4c0f55e0 0x7fef4c106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:48:26.607 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.607+0000 7fef4b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef4c0f55e0 0x7fef4c106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56472/0 (socket says 172.21.15.26:56472) 2021-11-03T17:48:26.608 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.607+0000 7fef4b7fe700 1 -- 172.21.15.26:0/2555103630 learned_addr learned my addr 172.21.15.26:0/2555103630 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:48:26.608 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.607+0000 7fef4affd700 1 --2- 172.21.15.26:0/2555103630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef4c0f5ef0 0x7fef4c107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:48:26.608 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.607+0000 7fef4b7fe700 1 -- 172.21.15.26:0/2555103630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef4c0f5ef0 msgr2=0x7fef4c107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:48:26.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.607+0000 7fef4b7fe700 1 --2- 172.21.15.26:0/2555103630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef4c0f5ef0 0x7fef4c107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:26.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.607+0000 7fef4b7fe700 1 -- 172.21.15.26:0/2555103630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef3c005040 con 0x7fef4c0f55e0 2021-11-03T17:48:26.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.607+0000 7fef4b7fe700 1 --2- 172.21.15.26:0/2555103630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef4c0f55e0 0x7fef4c106f60 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7fef3c009990 tx=0x7fef3c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:48:26.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.608+0000 7fef33fff700 1 -- 172.21.15.26:0/2555103630 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef3c018070 con 0x7fef4c0f55e0 2021-11-03T17:48:26.610 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.608+0000 7fef51d55700 1 -- 172.21.15.26:0/2555103630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef4c108480 con 0x7fef4c0f55e0 2021-11-03T17:48:26.610 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.608+0000 7fef33fff700 1 -- 172.21.15.26:0/2555103630 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fef3c007ca0 con 0x7fef4c0f55e0 2021-11-03T17:48:26.610 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.608+0000 7fef33fff700 1 -- 172.21.15.26:0/2555103630 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef3c01c620 con 0x7fef4c0f55e0 2021-11-03T17:48:26.610 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.608+0000 7fef51d55700 1 -- 172.21.15.26:0/2555103630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef4c1089e0 con 0x7fef4c0f55e0 2021-11-03T17:48:26.610 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.608+0000 7fef51d55700 1 -- 172.21.15.26:0/2555103630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef4c045ad0 con 0x7fef4c0f55e0 2021-11-03T17:48:26.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.609+0000 7fef33fff700 1 -- 172.21.15.26:0/2555103630 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fef3c01d960 con 0x7fef4c0f55e0 2021-11-03T17:48:26.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.609+0000 7fef33fff700 1 --2- 172.21.15.26:0/2555103630 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fef340640b0 0x7fef34066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:48:26.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.609+0000 7fef33fff700 1 -- 172.21.15.26:0/2555103630 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fef3c082540 con 0x7fef4c0f55e0 2021-11-03T17:48:26.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.610+0000 7fef4affd700 1 --2- 172.21.15.26:0/2555103630 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fef340640b0 0x7fef34066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:48:26.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.610+0000 7fef4affd700 1 --2- 172.21.15.26:0/2555103630 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fef340640b0 0x7fef34066570 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7fef400041d0 tx=0x7fef40009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:48:26.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.614+0000 7fef33fff700 1 -- 172.21.15.26:0/2555103630 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fef3c054960 con 0x7fef4c0f55e0 2021-11-03T17:48:26.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:26 smithi194 ceph-mon[65619]: pgmap v1613: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:26.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:26 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:48:26.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:26 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:48:26.779 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.785+0000 7fef51d55700 1 -- 172.21.15.26:0/2555103630 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fef4c0fad60 con 0x7fef340640b0 2021-11-03T17:48:26.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.800+0000 7fef33fff700 1 -- 172.21.15.26:0/2555103630 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fef4c0fad60 con 0x7fef340640b0 2021-11-03T17:48:26.794 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:48:26.795 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (59m) 9m ago 60m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:48:26.795 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (51m) 9m ago 60m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:48:26.795 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (51m) 8m ago 60m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:48:26.795 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (59m) 9m ago 60m 40.8M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:48:26.796 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (52m) 9m ago 56m 25.1M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:48:26.796 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (52m) 9m ago 55m 25.7M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:48:26.796 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (56m) 8m ago 56m 26.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:48:26.796 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (56m) 8m ago 56m 26.3M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:48:26.796 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (53m) 9m ago 62m 533M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:48:26.797 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (53m) 8m ago 60m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:48:26.797 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (52m) 9m ago 62m 209M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:48:26.797 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (52m) 8m ago 60m 103M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:48:26.797 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (60m) 9m ago 60m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:48:26.798 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (59m) 8m ago 59m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:48:26.798 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (51m) 9m ago 59m 251M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:48:26.798 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (50m) 9m ago 58m 270M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:48:26.798 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (50m) 9m ago 58m 225M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:48:26.799 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (49m) 8m ago 58m 287M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:48:26.799 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (49m) 8m ago 57m 246M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:48:26.799 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (49m) 8m ago 57m 235M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:48:26.799 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (59m) 9m ago 60m 56.7M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:48:26.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.802+0000 7fef51d55700 1 -- 172.21.15.26:0/2555103630 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fef340640b0 msgr2=0x7fef34066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:48:26.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.802+0000 7fef51d55700 1 --2- 172.21.15.26:0/2555103630 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fef340640b0 0x7fef34066570 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7fef400041d0 tx=0x7fef40009040).stop 2021-11-03T17:48:26.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.802+0000 7fef51d55700 1 -- 172.21.15.26:0/2555103630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef4c0f55e0 msgr2=0x7fef4c106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:48:26.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.802+0000 7fef51d55700 1 --2- 172.21.15.26:0/2555103630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef4c0f55e0 0x7fef4c106f60 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7fef3c009990 tx=0x7fef3c009b30).stop 2021-11-03T17:48:26.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.802+0000 7fef51d55700 1 -- 172.21.15.26:0/2555103630 shutdown_connections 2021-11-03T17:48:26.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.802+0000 7fef51d55700 1 --2- 172.21.15.26:0/2555103630 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fef340640b0 0x7fef34066570 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:26.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.802+0000 7fef51d55700 1 --2- 172.21.15.26:0/2555103630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef4c0f55e0 0x7fef4c106f60 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:26.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.802+0000 7fef51d55700 1 --2- 172.21.15.26:0/2555103630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef4c0f5ef0 0x7fef4c107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:26.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.802+0000 7fef51d55700 1 -- 172.21.15.26:0/2555103630 >> 172.21.15.26:0/2555103630 conn(0x7fef4c0f0de0 msgr2=0x7fef4c05ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:48:26.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.802+0000 7fef51d55700 1 -- 172.21.15.26:0/2555103630 shutdown_connections 2021-11-03T17:48:26.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.802+0000 7fef51d55700 1 -- 172.21.15.26:0/2555103630 wait complete. 2021-11-03T17:48:26.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.902+0000 7f00b3b53700 1 -- 172.21.15.26:0/1973081317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00ac0f5ef0 msgr2=0x7f00ac0f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:48:26.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.902+0000 7f00b3b53700 1 --2- 172.21.15.26:0/1973081317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00ac0f5ef0 0x7f00ac0f6920 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7f00a0004660 tx=0x7f00a0009b30).stop 2021-11-03T17:48:26.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.902+0000 7f00b3b53700 1 -- 172.21.15.26:0/1973081317 shutdown_connections 2021-11-03T17:48:26.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.902+0000 7f00b3b53700 1 --2- 172.21.15.26:0/1973081317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00ac0f5ef0 0x7f00ac0f6920 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:26.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.902+0000 7f00b3b53700 1 --2- 172.21.15.26:0/1973081317 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00ac0f55e0 0x7f00ac0f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:48:26.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.902+0000 7f00b3b53700 1 -- 172.21.15.26:0/1973081317 >> 172.21.15.26:0/1973081317 conn(0x7f00ac0f0de0 msgr2=0x7f00ac0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:48:26.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.902+0000 7f00b3b53700 1 -- 172.21.15.26:0/1973081317 shutdown_connections 2021-11-03T17:48:26.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.902+0000 7f00b3b53700 1 -- 172.21.15.26:0/1973081317 wait complete. 2021-11-03T17:48:26.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.902+0000 7f00b3b53700 1 Processor -- start 2021-11-03T17:48:26.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.902+0000 7f00b3b53700 1 -- start start 2021-11-03T17:48:26.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.902+0000 7f00b3b53700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00ac0f55e0 0x7f00ac109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:48:26.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.902+0000 7f00b3b53700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00ac0f5ef0 0x7f00ac10c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:48:26.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.902+0000 7f00b3b53700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ac060550 con 0x7f00ac0f55e0 2021-11-03T17:48:26.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.903+0000 7f00b3b53700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ac060690 con 0x7f00ac0f5ef0 2021-11-03T17:48:26.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.903+0000 7f00b18ef700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00ac0f55e0 0x7f00ac109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:48:26.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.903+0000 7f00b18ef700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00ac0f55e0 0x7f00ac109cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56482/0 (socket says 172.21.15.26:56482) 2021-11-03T17:48:26.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.903+0000 7f00b18ef700 1 -- 172.21.15.26:0/1535780585 learned_addr learned my addr 172.21.15.26:0/1535780585 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:48:26.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.903+0000 7f00b10ee700 1 --2- 172.21.15.26:0/1535780585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00ac0f5ef0 0x7f00ac10c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:48:26.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.903+0000 7f00b18ef700 1 -- 172.21.15.26:0/1535780585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00ac0f5ef0 msgr2=0x7f00ac10c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:48:26.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.903+0000 7f00b18ef700 1 --2- 172.21.15.26:0/1535780585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00ac0f5ef0 0x7f00ac10c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:26.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.903+0000 7f00b18ef700 1 -- 172.21.15.26:0/1535780585 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a0005040 con 0x7f00ac0f55e0 2021-11-03T17:48:26.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.903+0000 7f00b18ef700 1 --2- 172.21.15.26:0/1535780585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00ac0f55e0 0x7f00ac109cb0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7f00a400b790 tx=0x7f00a40092d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:48:26.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.903+0000 7f00aa7fc700 1 -- 172.21.15.26:0/1535780585 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00a400d780 con 0x7f00ac0f55e0 2021-11-03T17:48:26.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.903+0000 7f00aa7fc700 1 -- 172.21.15.26:0/1535780585 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f00a400dd90 con 0x7f00ac0f55e0 2021-11-03T17:48:26.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.903+0000 7f00b3b53700 1 -- 172.21.15.26:0/1535780585 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00ac10c7c0 con 0x7f00ac0f55e0 2021-11-03T17:48:26.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.903+0000 7f00aa7fc700 1 -- 172.21.15.26:0/1535780585 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00a400e360 con 0x7f00ac0f55e0 2021-11-03T17:48:26.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.903+0000 7f00b3b53700 1 -- 172.21.15.26:0/1535780585 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00ac10cd80 con 0x7f00ac0f55e0 2021-11-03T17:48:26.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.904+0000 7f00b3b53700 1 -- 172.21.15.26:0/1535780585 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00ac045ad0 con 0x7f00ac0f55e0 2021-11-03T17:48:26.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.905+0000 7f00aa7fc700 1 -- 172.21.15.26:0/1535780585 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f00a400d8e0 con 0x7f00ac0f55e0 2021-11-03T17:48:26.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.905+0000 7f00aa7fc700 1 --2- 172.21.15.26:0/1535780585 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f00940640b0 0x7f0094066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:48:26.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.905+0000 7f00aa7fc700 1 -- 172.21.15.26:0/1535780585 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f00a4081290 con 0x7f00ac0f55e0 2021-11-03T17:48:26.906 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.905+0000 7f00b10ee700 1 --2- 172.21.15.26:0/1535780585 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f00940640b0 0x7f0094066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:48:26.906 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.905+0000 7f00b10ee700 1 --2- 172.21.15.26:0/1535780585 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f00940640b0 0x7f0094066570 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f00a0009da0 tx=0x7f00a0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:48:26.906 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:26.909+0000 7f00aa7fc700 1 -- 172.21.15.26:0/1535780585 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f00a4053500 con 0x7f00ac0f55e0 2021-11-03T17:48:26.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:26 smithi026 ceph-mon[96795]: pgmap v1613: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:26.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:26 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:48:26.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:26 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:48:27.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.140+0000 7f00b3b53700 1 -- 172.21.15.26:0/1535780585 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f00ac0fdf50 con 0x7f00ac0f55e0 2021-11-03T17:48:27.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.141+0000 7f00aa7fc700 1 -- 172.21.15.26:0/1535780585 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f00a40530f0 con 0x7f00ac0f55e0 2021-11-03T17:48:27.135 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:48:27.135 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:48:27.136 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:48:27.136 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:48:27.136 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:48:27.136 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:48:27.137 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:48:27.137 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:48:27.137 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:48:27.137 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:48:27.138 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:48:27.138 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:48:27.139 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:48:27.139 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:48:27.140 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:48:27.140 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:48:27.141 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:48:27.141 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:48:27.143 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.143+0000 7f00b3b53700 1 -- 172.21.15.26:0/1535780585 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f00940640b0 msgr2=0x7f0094066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:48:27.143 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.143+0000 7f00b3b53700 1 --2- 172.21.15.26:0/1535780585 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f00940640b0 0x7f0094066570 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f00a0009da0 tx=0x7f00a0009b30).stop 2021-11-03T17:48:27.143 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.143+0000 7f00b3b53700 1 -- 172.21.15.26:0/1535780585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00ac0f55e0 msgr2=0x7f00ac109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:48:27.144 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.143+0000 7f00b3b53700 1 --2- 172.21.15.26:0/1535780585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00ac0f55e0 0x7f00ac109cb0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7f00a400b790 tx=0x7f00a40092d0).stop 2021-11-03T17:48:27.144 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.143+0000 7f00b3b53700 1 -- 172.21.15.26:0/1535780585 shutdown_connections 2021-11-03T17:48:27.145 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.143+0000 7f00b3b53700 1 --2- 172.21.15.26:0/1535780585 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f00940640b0 0x7f0094066570 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:27.145 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.143+0000 7f00b3b53700 1 --2- 172.21.15.26:0/1535780585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00ac0f55e0 0x7f00ac109cb0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:27.145 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.143+0000 7f00b3b53700 1 --2- 172.21.15.26:0/1535780585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00ac0f5ef0 0x7f00ac10c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:27.146 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.143+0000 7f00b3b53700 1 -- 172.21.15.26:0/1535780585 >> 172.21.15.26:0/1535780585 conn(0x7f00ac0f0de0 msgr2=0x7f00ac0fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:48:27.146 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.143+0000 7f00b3b53700 1 -- 172.21.15.26:0/1535780585 shutdown_connections 2021-11-03T17:48:27.147 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.143+0000 7f00b3b53700 1 -- 172.21.15.26:0/1535780585 wait complete. 2021-11-03T17:48:27.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.243+0000 7ff89967f700 1 -- 172.21.15.26:0/717028143 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8940f5340 msgr2=0x7ff8940f7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:48:27.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.243+0000 7ff89967f700 1 --2- 172.21.15.26:0/717028143 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8940f5340 0x7ff8940f7ac0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7ff884004660 tx=0x7ff884009b30).stop 2021-11-03T17:48:27.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.243+0000 7ff89967f700 1 -- 172.21.15.26:0/717028143 shutdown_connections 2021-11-03T17:48:27.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.243+0000 7ff89967f700 1 --2- 172.21.15.26:0/717028143 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8940f5340 0x7ff8940f7ac0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:27.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.243+0000 7ff89967f700 1 --2- 172.21.15.26:0/717028143 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8940f49a0 0x7ff8940f4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:48:27.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.243+0000 7ff89967f700 1 -- 172.21.15.26:0/717028143 >> 172.21.15.26:0/717028143 conn(0x7ff8940f04c0 msgr2=0x7ff8940f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:48:27.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.243+0000 7ff89967f700 1 -- 172.21.15.26:0/717028143 shutdown_connections 2021-11-03T17:48:27.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.243+0000 7ff89967f700 1 -- 172.21.15.26:0/717028143 wait complete. 2021-11-03T17:48:27.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.243+0000 7ff89967f700 1 Processor -- start 2021-11-03T17:48:27.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.244+0000 7ff89967f700 1 -- start start 2021-11-03T17:48:27.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.244+0000 7ff89967f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8940f49a0 0x7ff8940f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:48:27.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.244+0000 7ff89967f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8940f5340 0x7ff8940f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:48:27.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.244+0000 7ff89967f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8940f5fc0 con 0x7ff8940f5340 2021-11-03T17:48:27.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.244+0000 7ff89967f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8940f6100 con 0x7ff8940f49a0 2021-11-03T17:48:27.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.244+0000 7ff8927fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8940f5340 0x7ff8940f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:48:27.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.244+0000 7ff8927fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8940f5340 0x7ff8940f59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56494/0 (socket says 172.21.15.26:56494) 2021-11-03T17:48:27.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.244+0000 7ff8927fc700 1 -- 172.21.15.26:0/1461022303 learned_addr learned my addr 172.21.15.26:0/1461022303 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:48:27.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.244+0000 7ff892ffd700 1 --2- 172.21.15.26:0/1461022303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8940f49a0 0x7ff8940f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:48:27.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.244+0000 7ff8927fc700 1 -- 172.21.15.26:0/1461022303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8940f49a0 msgr2=0x7ff8940f7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:48:27.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.244+0000 7ff8927fc700 1 --2- 172.21.15.26:0/1461022303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8940f49a0 0x7ff8940f7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:27.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.244+0000 7ff8927fc700 1 -- 172.21.15.26:0/1461022303 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff884005040 con 0x7ff8940f5340 2021-11-03T17:48:27.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.244+0000 7ff892ffd700 1 --2- 172.21.15.26:0/1461022303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8940f49a0 0x7ff8940f7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:48:27.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.244+0000 7ff8927fc700 1 --2- 172.21.15.26:0/1461022303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8940f5340 0x7ff8940f59d0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7ff884004f60 tx=0x7ff884009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:48:27.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.244+0000 7ff88b7fe700 1 -- 172.21.15.26:0/1461022303 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff884018070 con 0x7ff8940f5340 2021-11-03T17:48:27.247 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.245+0000 7ff88b7fe700 1 -- 172.21.15.26:0/1461022303 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff884007ba0 con 0x7ff8940f5340 2021-11-03T17:48:27.247 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.245+0000 7ff89967f700 1 -- 172.21.15.26:0/1461022303 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8940f6380 con 0x7ff8940f5340 2021-11-03T17:48:27.248 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.245+0000 7ff88b7fe700 1 -- 172.21.15.26:0/1461022303 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff88401c620 con 0x7ff8940f5340 2021-11-03T17:48:27.248 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.245+0000 7ff89967f700 1 -- 172.21.15.26:0/1461022303 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff89410f000 con 0x7ff8940f5340 2021-11-03T17:48:27.248 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.246+0000 7ff89967f700 1 -- 172.21.15.26:0/1461022303 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff894045ad0 con 0x7ff8940f5340 2021-11-03T17:48:27.249 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.246+0000 7ff88b7fe700 1 -- 172.21.15.26:0/1461022303 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ff88401c8e0 con 0x7ff8940f5340 2021-11-03T17:48:27.249 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.246+0000 7ff88b7fe700 1 --2- 172.21.15.26:0/1461022303 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff8800640b0 0x7ff880066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:48:27.250 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.246+0000 7ff88b7fe700 1 -- 172.21.15.26:0/1461022303 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ff8840826c0 con 0x7ff8940f5340 2021-11-03T17:48:27.250 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.246+0000 7ff892ffd700 1 --2- 172.21.15.26:0/1461022303 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff8800640b0 0x7ff880066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:48:27.251 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.247+0000 7ff892ffd700 1 --2- 172.21.15.26:0/1461022303 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff8800640b0 0x7ff880066570 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7ff8940f72e0 tx=0x7ff87c008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:48:27.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.250+0000 7ff88b7fe700 1 -- 172.21.15.26:0/1461022303 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ff884054a20 con 0x7ff8940f5340 2021-11-03T17:48:27.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.462+0000 7ff89967f700 1 -- 172.21.15.26:0/1461022303 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff894027a00 con 0x7ff8940f5340 2021-11-03T17:48:27.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.462+0000 7ff88b7fe700 1 -- 172.21.15.26:0/1461022303 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7ff884054610 con 0x7ff8940f5340 2021-11-03T17:48:27.456 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:48:27.457 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:48:27.457 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:48:27.457 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:48:27.457 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:48:27.458 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:48:27.458 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:48:27.459 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:48:27.459 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:48:27.459 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:48:27.460 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:48:27.460 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:48:27.460 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:48:27.460 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:48:27.460 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:48:27.461 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:48:27.461 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:48:27.461 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:48:27.461 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:48:27.461 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:48:27.462 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:48:27.462 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:48:27.462 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:48:27.462 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:48:27.463 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:48:27.463 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:48:27.463 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:48:27.463 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:48:27.464 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:48:27.464 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:48:27.464 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:48:27.464 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:48:27.465 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:48:27.465 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:48:27.465 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:48:27.465 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:48:27.465 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:48:27.466 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:48:27.466 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:48:27.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.465+0000 7ff89967f700 1 -- 172.21.15.26:0/1461022303 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff8800640b0 msgr2=0x7ff880066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:48:27.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.465+0000 7ff89967f700 1 --2- 172.21.15.26:0/1461022303 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff8800640b0 0x7ff880066570 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7ff8940f72e0 tx=0x7ff87c008040).stop 2021-11-03T17:48:27.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.465+0000 7ff89967f700 1 -- 172.21.15.26:0/1461022303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8940f5340 msgr2=0x7ff8940f59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:48:27.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.465+0000 7ff89967f700 1 --2- 172.21.15.26:0/1461022303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8940f5340 0x7ff8940f59d0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7ff884004f60 tx=0x7ff884009b30).stop 2021-11-03T17:48:27.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.465+0000 7ff89967f700 1 -- 172.21.15.26:0/1461022303 shutdown_connections 2021-11-03T17:48:27.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.465+0000 7ff89967f700 1 --2- 172.21.15.26:0/1461022303 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff8800640b0 0x7ff880066570 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:27.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.465+0000 7ff89967f700 1 --2- 172.21.15.26:0/1461022303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8940f49a0 0x7ff8940f7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:27.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.465+0000 7ff89967f700 1 --2- 172.21.15.26:0/1461022303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8940f5340 0x7ff8940f59d0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:27.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.465+0000 7ff89967f700 1 -- 172.21.15.26:0/1461022303 >> 172.21.15.26:0/1461022303 conn(0x7ff8940f04c0 msgr2=0x7ff8940fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:48:27.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.465+0000 7ff89967f700 1 -- 172.21.15.26:0/1461022303 shutdown_connections 2021-11-03T17:48:27.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:27.465+0000 7ff89967f700 1 -- 172.21.15.26:0/1461022303 wait complete. 2021-11-03T17:48:27.470 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:48:27.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:27 smithi194 ceph-mon[65619]: from='client.35804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:48:27.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:27 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1535780585' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:48:27.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:27 smithi026 ceph-mon[96795]: from='client.35804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:48:27.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:27 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1535780585' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:48:28.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:28 smithi194 ceph-mon[65619]: from='client.35808 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:48:28.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:28 smithi194 ceph-mon[65619]: pgmap v1614: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:28.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:28 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1461022303' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:48:28.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:28 smithi026 ceph-mon[96795]: from='client.35808 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:48:28.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:28 smithi026 ceph-mon[96795]: pgmap v1614: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:28.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:28 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1461022303' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:48:30.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:30 smithi194 ceph-mon[65619]: pgmap v1615: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:30.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:30 smithi026 ceph-mon[96795]: pgmap v1615: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:32.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:32 smithi194 ceph-mon[65619]: pgmap v1616: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:32.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:32 smithi026 ceph-mon[96795]: pgmap v1616: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:34.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:34 smithi194 ceph-mon[65619]: pgmap v1617: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:34.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:34 smithi026 ceph-mon[96795]: pgmap v1617: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:36.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:36 smithi194 ceph-mon[65619]: pgmap v1618: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:36.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:36 smithi026 ceph-mon[96795]: pgmap v1618: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:38.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:38 smithi194 ceph-mon[65619]: pgmap v1619: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:38.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:38 smithi026 ceph-mon[96795]: pgmap v1619: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:40.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:40 smithi194 ceph-mon[65619]: pgmap v1620: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:40.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:48:40.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:40 smithi026 ceph-mon[96795]: pgmap v1620: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:40.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:48:41.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:41 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:48:41.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:41 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:48:42.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:42 smithi194 ceph-mon[65619]: pgmap v1621: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:42.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:42 smithi026 ceph-mon[96795]: pgmap v1621: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:44.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:44 smithi194 ceph-mon[65619]: pgmap v1622: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:44.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:44 smithi026 ceph-mon[96795]: pgmap v1622: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:46.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:46 smithi194 ceph-mon[65619]: pgmap v1623: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:46.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:46 smithi026 ceph-mon[96795]: pgmap v1623: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:48.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:48 smithi194 ceph-mon[65619]: pgmap v1624: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:48.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:48:48.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:48:48.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:48 smithi026 ceph-mon[96795]: pgmap v1624: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:48.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:48:48.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:48:50.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:50 smithi194 ceph-mon[65619]: pgmap v1625: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:50.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:50 smithi026 ceph-mon[96795]: pgmap v1625: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:52.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:52 smithi194 ceph-mon[65619]: pgmap v1626: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:52.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:52 smithi026 ceph-mon[96795]: pgmap v1626: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:54.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:54 smithi194 ceph-mon[65619]: pgmap v1627: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:54.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:54 smithi026 ceph-mon[96795]: pgmap v1627: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:55.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:48:55.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:48:56.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:56 smithi194 ceph-mon[65619]: pgmap v1628: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:56.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:56 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:48:56.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:56 smithi026 ceph-mon[96795]: pgmap v1628: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:56.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:56 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:48:57.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.578+0000 7fe4db439700 1 -- 172.21.15.26:0/3435936394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4d40f66e0 msgr2=0x7fe4d40f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:48:57.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.578+0000 7fe4db439700 1 --2- 172.21.15.26:0/3435936394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4d40f66e0 0x7fe4d40f6b40 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7fe4c4004660 tx=0x7fe4c4009b30).stop 2021-11-03T17:48:57.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.578+0000 7fe4db439700 1 -- 172.21.15.26:0/3435936394 shutdown_connections 2021-11-03T17:48:57.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.578+0000 7fe4db439700 1 --2- 172.21.15.26:0/3435936394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4d40f66e0 0x7fe4d40f6b40 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:57.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.578+0000 7fe4db439700 1 --2- 172.21.15.26:0/3435936394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4d40f5440 0x7fe4d40f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:57.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.578+0000 7fe4db439700 1 -- 172.21.15.26:0/3435936394 >> 172.21.15.26:0/3435936394 conn(0x7fe4d40f0ba0 msgr2=0x7fe4d40f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:48:57.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.578+0000 7fe4db439700 1 -- 172.21.15.26:0/3435936394 shutdown_connections 2021-11-03T17:48:57.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.578+0000 7fe4db439700 1 -- 172.21.15.26:0/3435936394 wait complete. 2021-11-03T17:48:57.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.578+0000 7fe4db439700 1 Processor -- start 2021-11-03T17:48:57.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.578+0000 7fe4db439700 1 -- start start 2021-11-03T17:48:57.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.579+0000 7fe4db439700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4d40f5440 0x7fe4d4106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:48:57.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.579+0000 7fe4db439700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4d40f66e0 0x7fe4d41072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:48:57.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.579+0000 7fe4db439700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d41078f0 con 0x7fe4d40f66e0 2021-11-03T17:48:57.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.579+0000 7fe4db439700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d4108100 con 0x7fe4d40f5440 2021-11-03T17:48:57.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.579+0000 7fe4d9c36700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4d40f66e0 0x7fe4d41072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:48:57.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.579+0000 7fe4d9c36700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4d40f66e0 0x7fe4d41072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56512/0 (socket says 172.21.15.26:56512) 2021-11-03T17:48:57.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.579+0000 7fe4d9c36700 1 -- 172.21.15.26:0/16297990 learned_addr learned my addr 172.21.15.26:0/16297990 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:48:57.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.579+0000 7fe4da437700 1 --2- 172.21.15.26:0/16297990 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4d40f5440 0x7fe4d4106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:48:57.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.579+0000 7fe4d9c36700 1 -- 172.21.15.26:0/16297990 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4d40f5440 msgr2=0x7fe4d4106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:48:57.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.579+0000 7fe4d9c36700 1 --2- 172.21.15.26:0/16297990 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4d40f5440 0x7fe4d4106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:57.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.579+0000 7fe4d9c36700 1 -- 172.21.15.26:0/16297990 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c4005040 con 0x7fe4d40f66e0 2021-11-03T17:48:57.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.579+0000 7fe4d9c36700 1 --2- 172.21.15.26:0/16297990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4d40f66e0 0x7fe4d41072f0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7fe4c4009990 tx=0x7fe4c4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:48:57.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.579+0000 7fe4caffd700 1 -- 172.21.15.26:0/16297990 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4c4018070 con 0x7fe4d40f66e0 2021-11-03T17:48:57.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.579+0000 7fe4caffd700 1 -- 172.21.15.26:0/16297990 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe4c4007ca0 con 0x7fe4d40f66e0 2021-11-03T17:48:57.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.579+0000 7fe4db439700 1 -- 172.21.15.26:0/16297990 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4d4108320 con 0x7fe4d40f66e0 2021-11-03T17:48:57.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.580+0000 7fe4caffd700 1 -- 172.21.15.26:0/16297990 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4c401c620 con 0x7fe4d40f66e0 2021-11-03T17:48:57.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.580+0000 7fe4db439700 1 -- 172.21.15.26:0/16297990 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4d4108880 con 0x7fe4d40f66e0 2021-11-03T17:48:57.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.581+0000 7fe4db439700 1 -- 172.21.15.26:0/16297990 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4d4059100 con 0x7fe4d40f66e0 2021-11-03T17:48:57.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.581+0000 7fe4caffd700 1 -- 172.21.15.26:0/16297990 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fe4c401d960 con 0x7fe4d40f66e0 2021-11-03T17:48:57.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.581+0000 7fe4caffd700 1 --2- 172.21.15.26:0/16297990 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe4c0064100 0x7fe4c00665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:48:57.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.581+0000 7fe4caffd700 1 -- 172.21.15.26:0/16297990 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fe4c4082520 con 0x7fe4d40f66e0 2021-11-03T17:48:57.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.581+0000 7fe4da437700 1 --2- 172.21.15.26:0/16297990 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe4c0064100 0x7fe4c00665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:48:57.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.582+0000 7fe4da437700 1 --2- 172.21.15.26:0/16297990 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe4c0064100 0x7fe4c00665c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7fe4d4106b70 tx=0x7fe4d0009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:48:57.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.586+0000 7fe4caffd700 1 -- 172.21.15.26:0/16297990 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fe4c4054940 con 0x7fe4d40f66e0 2021-11-03T17:48:57.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.765+0000 7fe4db439700 1 -- 172.21.15.26:0/16297990 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4d40fede0 con 0x7fe4c0064100 2021-11-03T17:48:57.761 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.767+0000 7fe4caffd700 1 -- 172.21.15.26:0/16297990 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fe4d40fede0 con 0x7fe4c0064100 2021-11-03T17:48:57.763 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.768+0000 7fe4db439700 1 -- 172.21.15.26:0/16297990 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe4c0064100 msgr2=0x7fe4c00665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:48:57.763 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.768+0000 7fe4db439700 1 --2- 172.21.15.26:0/16297990 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe4c0064100 0x7fe4c00665c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7fe4d4106b70 tx=0x7fe4d0009040).stop 2021-11-03T17:48:57.764 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.768+0000 7fe4db439700 1 -- 172.21.15.26:0/16297990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4d40f66e0 msgr2=0x7fe4d41072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:48:57.764 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.768+0000 7fe4db439700 1 --2- 172.21.15.26:0/16297990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4d40f66e0 0x7fe4d41072f0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7fe4c4009990 tx=0x7fe4c4009b30).stop 2021-11-03T17:48:57.764 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.769+0000 7fe4db439700 1 -- 172.21.15.26:0/16297990 shutdown_connections 2021-11-03T17:48:57.764 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.769+0000 7fe4db439700 1 --2- 172.21.15.26:0/16297990 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe4c0064100 0x7fe4c00665c0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:57.765 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.769+0000 7fe4db439700 1 --2- 172.21.15.26:0/16297990 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4d40f5440 0x7fe4d4106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:57.765 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.769+0000 7fe4db439700 1 --2- 172.21.15.26:0/16297990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4d40f66e0 0x7fe4d41072f0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:57.765 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.769+0000 7fe4db439700 1 -- 172.21.15.26:0/16297990 >> 172.21.15.26:0/16297990 conn(0x7fe4d40f0ba0 msgr2=0x7fe4d40fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:48:57.765 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.769+0000 7fe4db439700 1 -- 172.21.15.26:0/16297990 shutdown_connections 2021-11-03T17:48:57.765 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.769+0000 7fe4db439700 1 -- 172.21.15.26:0/16297990 wait complete. 2021-11-03T17:48:57.774 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:48:57.865 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.869+0000 7f0ccc6c4700 1 -- 172.21.15.26:0/2922412912 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0cc40f6860 msgr2=0x7f0cc40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:48:57.866 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.869+0000 7f0ccc6c4700 1 --2- 172.21.15.26:0/2922412912 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0cc40f6860 0x7f0cc40f6cc0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f0cb4004660 tx=0x7f0cb4009b30).stop 2021-11-03T17:48:57.866 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.869+0000 7f0ccc6c4700 1 -- 172.21.15.26:0/2922412912 shutdown_connections 2021-11-03T17:48:57.866 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.869+0000 7f0ccc6c4700 1 --2- 172.21.15.26:0/2922412912 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0cc40f6860 0x7f0cc40f6cc0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:57.866 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.869+0000 7f0ccc6c4700 1 --2- 172.21.15.26:0/2922412912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cc40f55c0 0x7f0cc40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:57.867 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.869+0000 7f0ccc6c4700 1 -- 172.21.15.26:0/2922412912 >> 172.21.15.26:0/2922412912 conn(0x7f0cc40f0d40 msgr2=0x7f0cc40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:48:57.867 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.869+0000 7f0ccc6c4700 1 -- 172.21.15.26:0/2922412912 shutdown_connections 2021-11-03T17:48:57.867 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.869+0000 7f0ccc6c4700 1 -- 172.21.15.26:0/2922412912 wait complete. 2021-11-03T17:48:57.867 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.869+0000 7f0ccc6c4700 1 Processor -- start 2021-11-03T17:48:57.867 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.869+0000 7f0ccc6c4700 1 -- start start 2021-11-03T17:48:57.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.870+0000 7f0ccc6c4700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cc40f55c0 0x7f0cc4109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:48:57.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.870+0000 7f0ccc6c4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0cc40f6860 0x7f0cc410c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:48:57.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.870+0000 7f0ccc6c4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc40603c0 con 0x7f0cc40f6860 2021-11-03T17:48:57.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.870+0000 7f0ccc6c4700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc4060500 con 0x7f0cc40f55c0 2021-11-03T17:48:57.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.870+0000 7f0cc9c5f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0cc40f6860 0x7f0cc410c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:48:57.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.870+0000 7f0cc9c5f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0cc40f6860 0x7f0cc410c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56524/0 (socket says 172.21.15.26:56524) 2021-11-03T17:48:57.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.870+0000 7f0cc9c5f700 1 -- 172.21.15.26:0/3585112348 learned_addr learned my addr 172.21.15.26:0/3585112348 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:48:57.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.870+0000 7f0cca460700 1 --2- 172.21.15.26:0/3585112348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cc40f55c0 0x7f0cc4109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:48:57.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.870+0000 7f0cc9c5f700 1 -- 172.21.15.26:0/3585112348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cc40f55c0 msgr2=0x7f0cc4109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:48:57.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.870+0000 7f0cc9c5f700 1 --2- 172.21.15.26:0/3585112348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cc40f55c0 0x7f0cc4109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:57.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.870+0000 7f0cc9c5f700 1 -- 172.21.15.26:0/3585112348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb4005040 con 0x7f0cc40f6860 2021-11-03T17:48:57.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.870+0000 7f0cc9c5f700 1 --2- 172.21.15.26:0/3585112348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0cc40f6860 0x7f0cc410c170 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7f0cb4009990 tx=0x7f0cb4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:48:57.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.870+0000 7f0cbaffd700 1 -- 172.21.15.26:0/3585112348 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cb4018070 con 0x7f0cc40f6860 2021-11-03T17:48:57.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.870+0000 7f0cbaffd700 1 -- 172.21.15.26:0/3585112348 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0cb4007ba0 con 0x7f0cc40f6860 2021-11-03T17:48:57.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.870+0000 7f0ccc6c4700 1 -- 172.21.15.26:0/3585112348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc410c6c0 con 0x7f0cc40f6860 2021-11-03T17:48:57.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.870+0000 7f0cbaffd700 1 -- 172.21.15.26:0/3585112348 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cb401c3c0 con 0x7f0cc40f6860 2021-11-03T17:48:57.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.870+0000 7f0ccc6c4700 1 -- 172.21.15.26:0/3585112348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc410cbf0 con 0x7f0cc40f6860 2021-11-03T17:48:57.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.871+0000 7f0ccc6c4700 1 -- 172.21.15.26:0/3585112348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc4045ad0 con 0x7f0cc40f6860 2021-11-03T17:48:57.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.872+0000 7f0cbaffd700 1 -- 172.21.15.26:0/3585112348 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f0cb401d420 con 0x7f0cc40f6860 2021-11-03T17:48:57.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.872+0000 7f0cbaffd700 1 --2- 172.21.15.26:0/3585112348 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0cb00640b0 0x7f0cb0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:48:57.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.872+0000 7f0cbaffd700 1 -- 172.21.15.26:0/3585112348 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f0cb40823f0 con 0x7f0cc40f6860 2021-11-03T17:48:57.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.872+0000 7f0cca460700 1 --2- 172.21.15.26:0/3585112348 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0cb00640b0 0x7f0cb0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:48:57.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.873+0000 7f0cca460700 1 --2- 172.21.15.26:0/3585112348 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0cb00640b0 0x7f0cb0066570 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f0cc4060040 tx=0x7f0cbc009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:48:57.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:57.876+0000 7f0cbaffd700 1 -- 172.21.15.26:0/3585112348 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f0cb40546f0 con 0x7f0cc40f6860 2021-11-03T17:48:58.046 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.051+0000 7f0ccc6c4700 1 -- 172.21.15.26:0/3585112348 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0cc4057f10 con 0x7f0cb00640b0 2021-11-03T17:48:58.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.066+0000 7f0cbaffd700 1 -- 172.21.15.26:0/3585112348 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f0cc4057f10 con 0x7f0cb00640b0 2021-11-03T17:48:58.061 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:48:58.062 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (60m) 9m ago 61m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:48:58.062 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (52m) 9m ago 61m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:48:58.062 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (52m) 8m ago 60m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:48:58.063 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (60m) 9m ago 61m 40.8M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:48:58.063 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (53m) 9m ago 56m 25.1M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:48:58.063 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (53m) 9m ago 56m 25.7M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:48:58.063 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (56m) 8m ago 56m 26.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:48:58.064 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (56m) 8m ago 56m 26.3M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:48:58.064 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (53m) 9m ago 62m 533M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:48:58.064 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (53m) 8m ago 60m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:48:58.064 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (53m) 9m ago 62m 209M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:48:58.064 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (52m) 8m ago 60m 103M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:48:58.065 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (61m) 9m ago 61m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:48:58.065 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (60m) 8m ago 60m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:48:58.065 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (52m) 9m ago 59m 251M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:48:58.065 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (51m) 9m ago 59m 270M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:48:58.065 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (51m) 9m ago 59m 225M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:48:58.066 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (50m) 8m ago 58m 287M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:48:58.066 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (50m) 8m ago 58m 246M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:48:58.067 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (49m) 8m ago 58m 235M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:48:58.067 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (59m) 9m ago 60m 56.7M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:48:58.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.068+0000 7f0ccc6c4700 1 -- 172.21.15.26:0/3585112348 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0cb00640b0 msgr2=0x7f0cb0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:48:58.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.068+0000 7f0ccc6c4700 1 --2- 172.21.15.26:0/3585112348 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0cb00640b0 0x7f0cb0066570 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f0cc4060040 tx=0x7f0cbc009040).stop 2021-11-03T17:48:58.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.068+0000 7f0ccc6c4700 1 -- 172.21.15.26:0/3585112348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0cc40f6860 msgr2=0x7f0cc410c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:48:58.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.068+0000 7f0ccc6c4700 1 --2- 172.21.15.26:0/3585112348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0cc40f6860 0x7f0cc410c170 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7f0cb4009990 tx=0x7f0cb4009b30).stop 2021-11-03T17:48:58.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.068+0000 7f0ccc6c4700 1 -- 172.21.15.26:0/3585112348 shutdown_connections 2021-11-03T17:48:58.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.068+0000 7f0ccc6c4700 1 --2- 172.21.15.26:0/3585112348 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0cb00640b0 0x7f0cb0066570 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:58.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.068+0000 7f0ccc6c4700 1 --2- 172.21.15.26:0/3585112348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cc40f55c0 0x7f0cc4109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:58.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.068+0000 7f0ccc6c4700 1 --2- 172.21.15.26:0/3585112348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0cc40f6860 0x7f0cc410c170 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:58.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.068+0000 7f0ccc6c4700 1 -- 172.21.15.26:0/3585112348 >> 172.21.15.26:0/3585112348 conn(0x7f0cc40f0d40 msgr2=0x7f0cc40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:48:58.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.068+0000 7f0ccc6c4700 1 -- 172.21.15.26:0/3585112348 shutdown_connections 2021-11-03T17:48:58.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.068+0000 7f0ccc6c4700 1 -- 172.21.15.26:0/3585112348 wait complete. 2021-11-03T17:48:58.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.167+0000 7f0b47fce700 1 -- 172.21.15.26:0/3640936708 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b400f66e0 msgr2=0x7f0b400f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:48:58.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.167+0000 7f0b47fce700 1 --2- 172.21.15.26:0/3640936708 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b400f66e0 0x7f0b400f6b00 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7f0b380099e0 tx=0x7f0b38004d10).stop 2021-11-03T17:48:58.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.167+0000 7f0b47fce700 1 -- 172.21.15.26:0/3640936708 shutdown_connections 2021-11-03T17:48:58.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.167+0000 7f0b47fce700 1 --2- 172.21.15.26:0/3640936708 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b400f6ff0 0x7f0b400f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:58.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.167+0000 7f0b47fce700 1 --2- 172.21.15.26:0/3640936708 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b400f66e0 0x7f0b400f6b00 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:58.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.167+0000 7f0b47fce700 1 -- 172.21.15.26:0/3640936708 >> 172.21.15.26:0/3640936708 conn(0x7f0b400f1f00 msgr2=0x7f0b400f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:48:58.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.167+0000 7f0b47fce700 1 -- 172.21.15.26:0/3640936708 shutdown_connections 2021-11-03T17:48:58.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.167+0000 7f0b47fce700 1 -- 172.21.15.26:0/3640936708 wait complete. 2021-11-03T17:48:58.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.167+0000 7f0b47fce700 1 Processor -- start 2021-11-03T17:48:58.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.168+0000 7f0b47fce700 1 -- start start 2021-11-03T17:48:58.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.168+0000 7f0b47fce700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b400f66e0 0x7f0b4006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:48:58.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.168+0000 7f0b47fce700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b400f6ff0 0x7f0b40069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:48:58.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.168+0000 7f0b47fce700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4006a380 con 0x7f0b400f66e0 2021-11-03T17:48:58.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.168+0000 7f0b47fce700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4006a4c0 con 0x7f0b400f6ff0 2021-11-03T17:48:58.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.168+0000 7f0b45d6a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b400f66e0 0x7f0b4006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:48:58.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.168+0000 7f0b45d6a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b400f66e0 0x7f0b4006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56532/0 (socket says 172.21.15.26:56532) 2021-11-03T17:48:58.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.168+0000 7f0b45d6a700 1 -- 172.21.15.26:0/2829615349 learned_addr learned my addr 172.21.15.26:0/2829615349 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:48:58.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.168+0000 7f0b45569700 1 --2- 172.21.15.26:0/2829615349 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b400f6ff0 0x7f0b40069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:48:58.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.168+0000 7f0b45d6a700 1 -- 172.21.15.26:0/2829615349 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b400f6ff0 msgr2=0x7f0b40069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:48:58.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.168+0000 7f0b45d6a700 1 --2- 172.21.15.26:0/2829615349 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b400f6ff0 0x7f0b40069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:58.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.168+0000 7f0b45d6a700 1 -- 172.21.15.26:0/2829615349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b38009640 con 0x7f0b400f66e0 2021-11-03T17:48:58.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.168+0000 7f0b45d6a700 1 --2- 172.21.15.26:0/2829615349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b400f66e0 0x7f0b4006b9a0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f0b3800b3b0 tx=0x7f0b38004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:48:58.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.168+0000 7f0b3e7fc700 1 -- 172.21.15.26:0/2829615349 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b3800e030 con 0x7f0b400f66e0 2021-11-03T17:48:58.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.168+0000 7f0b3e7fc700 1 -- 172.21.15.26:0/2829615349 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0b380049b0 con 0x7f0b400f66e0 2021-11-03T17:48:58.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.168+0000 7f0b47fce700 1 -- 172.21.15.26:0/2829615349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b4006a740 con 0x7f0b400f66e0 2021-11-03T17:48:58.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.169+0000 7f0b3e7fc700 1 -- 172.21.15.26:0/2829615349 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b38018070 con 0x7f0b400f66e0 2021-11-03T17:48:58.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.169+0000 7f0b47fce700 1 -- 172.21.15.26:0/2829615349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b4006ac20 con 0x7f0b400f66e0 2021-11-03T17:48:58.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.169+0000 7f0b47fce700 1 -- 172.21.15.26:0/2829615349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b40045ad0 con 0x7f0b400f66e0 2021-11-03T17:48:58.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.170+0000 7f0b3e7fc700 1 -- 172.21.15.26:0/2829615349 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f0b38007c90 con 0x7f0b400f66e0 2021-11-03T17:48:58.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.170+0000 7f0b3e7fc700 1 --2- 172.21.15.26:0/2829615349 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0b280640b0 0x7f0b28066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:48:58.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.170+0000 7f0b3e7fc700 1 -- 172.21.15.26:0/2829615349 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f0b38082480 con 0x7f0b400f66e0 2021-11-03T17:48:58.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.170+0000 7f0b45569700 1 --2- 172.21.15.26:0/2829615349 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0b280640b0 0x7f0b28066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:48:58.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.171+0000 7f0b45569700 1 --2- 172.21.15.26:0/2829615349 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0b280640b0 0x7f0b28066570 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f0b34004e20 tx=0x7f0b3400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:48:58.175 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.174+0000 7f0b3e7fc700 1 -- 172.21.15.26:0/2829615349 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f0b380547e0 con 0x7f0b400f66e0 2021-11-03T17:48:58.400 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.404+0000 7f0b47fce700 1 -- 172.21.15.26:0/2829615349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0b400008d0 con 0x7f0b400f66e0 2021-11-03T17:48:58.401 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.405+0000 7f0b3e7fc700 1 -- 172.21.15.26:0/2829615349 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f0b380543d0 con 0x7f0b400f66e0 2021-11-03T17:48:58.401 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:48:58.402 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:48:58.402 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:48:58.402 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:48:58.402 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:48:58.403 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:48:58.403 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:48:58.403 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:48:58.403 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:48:58.404 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:48:58.404 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:48:58.404 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:48:58.404 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:48:58.404 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:48:58.405 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:48:58.405 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:48:58.405 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:48:58.405 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:48:58.406 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.407+0000 7f0b47fce700 1 -- 172.21.15.26:0/2829615349 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0b280640b0 msgr2=0x7f0b28066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:48:58.406 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.407+0000 7f0b47fce700 1 --2- 172.21.15.26:0/2829615349 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0b280640b0 0x7f0b28066570 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f0b34004e20 tx=0x7f0b3400b040).stop 2021-11-03T17:48:58.407 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.407+0000 7f0b47fce700 1 -- 172.21.15.26:0/2829615349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b400f66e0 msgr2=0x7f0b4006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:48:58.407 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.407+0000 7f0b47fce700 1 --2- 172.21.15.26:0/2829615349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b400f66e0 0x7f0b4006b9a0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f0b3800b3b0 tx=0x7f0b38004d10).stop 2021-11-03T17:48:58.408 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.407+0000 7f0b47fce700 1 -- 172.21.15.26:0/2829615349 shutdown_connections 2021-11-03T17:48:58.408 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.407+0000 7f0b47fce700 1 --2- 172.21.15.26:0/2829615349 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0b280640b0 0x7f0b28066570 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:58.408 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.407+0000 7f0b47fce700 1 --2- 172.21.15.26:0/2829615349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b400f66e0 0x7f0b4006b9a0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:58.408 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.407+0000 7f0b47fce700 1 --2- 172.21.15.26:0/2829615349 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b400f6ff0 0x7f0b40069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:58.409 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.407+0000 7f0b47fce700 1 -- 172.21.15.26:0/2829615349 >> 172.21.15.26:0/2829615349 conn(0x7f0b400f1f00 msgr2=0x7f0b400fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:48:58.409 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.407+0000 7f0b47fce700 1 -- 172.21.15.26:0/2829615349 shutdown_connections 2021-11-03T17:48:58.410 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.407+0000 7f0b47fce700 1 -- 172.21.15.26:0/2829615349 wait complete. 2021-11-03T17:48:58.504 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.507+0000 7fb36ba62700 1 -- 172.21.15.26:0/3907309151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3640f6ff0 msgr2=0x7fb3640f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:48:58.505 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.507+0000 7fb36ba62700 1 --2- 172.21.15.26:0/3907309151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3640f6ff0 0x7fb3640f7a20 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7fb354004660 tx=0x7fb354009b30).stop 2021-11-03T17:48:58.505 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.507+0000 7fb36ba62700 1 -- 172.21.15.26:0/3907309151 shutdown_connections 2021-11-03T17:48:58.505 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.507+0000 7fb36ba62700 1 --2- 172.21.15.26:0/3907309151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3640f6ff0 0x7fb3640f7a20 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:58.506 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.507+0000 7fb36ba62700 1 --2- 172.21.15.26:0/3907309151 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3640f66e0 0x7fb3640f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:58.506 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.507+0000 7fb36ba62700 1 -- 172.21.15.26:0/3907309151 >> 172.21.15.26:0/3907309151 conn(0x7fb3640f1f00 msgr2=0x7fb3640f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:48:58.506 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.508+0000 7fb36ba62700 1 -- 172.21.15.26:0/3907309151 shutdown_connections 2021-11-03T17:48:58.507 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.508+0000 7fb36ba62700 1 -- 172.21.15.26:0/3907309151 wait complete. 2021-11-03T17:48:58.507 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.508+0000 7fb36ba62700 1 Processor -- start 2021-11-03T17:48:58.507 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.508+0000 7fb36ba62700 1 -- start start 2021-11-03T17:48:58.507 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.508+0000 7fb36ba62700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3640f66e0 0x7fb364106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:48:58.508 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.508+0000 7fb36ba62700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3640f6ff0 0x7fb364107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:48:58.508 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.508+0000 7fb36ba62700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3641079b0 con 0x7fb3640f6ff0 2021-11-03T17:48:58.508 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.508+0000 7fb36ba62700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb364107af0 con 0x7fb3640f66e0 2021-11-03T17:48:58.508 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.508+0000 7fb368ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3640f6ff0 0x7fb364107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:48:58.508 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.508+0000 7fb368ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3640f6ff0 0x7fb364107400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56544/0 (socket says 172.21.15.26:56544) 2021-11-03T17:48:58.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.508+0000 7fb368ffd700 1 -- 172.21.15.26:0/1363259199 learned_addr learned my addr 172.21.15.26:0/1363259199 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:48:58.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.509+0000 7fb3697fe700 1 --2- 172.21.15.26:0/1363259199 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3640f66e0 0x7fb364106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:48:58.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.509+0000 7fb368ffd700 1 -- 172.21.15.26:0/1363259199 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3640f66e0 msgr2=0x7fb364106f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:48:58.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.509+0000 7fb368ffd700 1 --2- 172.21.15.26:0/1363259199 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3640f66e0 0x7fb364106f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:58.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.509+0000 7fb368ffd700 1 -- 172.21.15.26:0/1363259199 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb354005040 con 0x7fb3640f6ff0 2021-11-03T17:48:58.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.509+0000 7fb3697fe700 1 --2- 172.21.15.26:0/1363259199 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3640f66e0 0x7fb364106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:48:58.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.509+0000 7fb368ffd700 1 --2- 172.21.15.26:0/1363259199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3640f6ff0 0x7fb364107400 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7fb354009990 tx=0x7fb354009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:48:58.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.509+0000 7fb359ffb700 1 -- 172.21.15.26:0/1363259199 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb354018070 con 0x7fb3640f6ff0 2021-11-03T17:48:58.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.509+0000 7fb36ba62700 1 -- 172.21.15.26:0/1363259199 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb364108430 con 0x7fb3640f6ff0 2021-11-03T17:48:58.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.509+0000 7fb359ffb700 1 -- 172.21.15.26:0/1363259199 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb354007ba0 con 0x7fb3640f6ff0 2021-11-03T17:48:58.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.509+0000 7fb359ffb700 1 -- 172.21.15.26:0/1363259199 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb35401c3c0 con 0x7fb3640f6ff0 2021-11-03T17:48:58.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.509+0000 7fb36ba62700 1 -- 172.21.15.26:0/1363259199 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb364108990 con 0x7fb3640f6ff0 2021-11-03T17:48:58.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.510+0000 7fb36ba62700 1 -- 172.21.15.26:0/1363259199 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb364045ad0 con 0x7fb3640f6ff0 2021-11-03T17:48:58.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.511+0000 7fb359ffb700 1 -- 172.21.15.26:0/1363259199 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fb35401d420 con 0x7fb3640f6ff0 2021-11-03T17:48:58.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.511+0000 7fb359ffb700 1 --2- 172.21.15.26:0/1363259199 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb3500640b0 0x7fb350066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:48:58.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.511+0000 7fb359ffb700 1 -- 172.21.15.26:0/1363259199 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fb354082430 con 0x7fb3640f6ff0 2021-11-03T17:48:58.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.511+0000 7fb3697fe700 1 --2- 172.21.15.26:0/1363259199 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb3500640b0 0x7fb350066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:48:58.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.511+0000 7fb3697fe700 1 --2- 172.21.15.26:0/1363259199 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb3500640b0 0x7fb350066570 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7fb360009880 tx=0x7fb36000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:48:58.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.515+0000 7fb359ffb700 1 -- 172.21.15.26:0/1363259199 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fb3540547f0 con 0x7fb3640f6ff0 2021-11-03T17:48:58.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.719+0000 7fb36ba62700 1 -- 172.21.15.26:0/1363259199 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb364027a00 con 0x7fb3640f6ff0 2021-11-03T17:48:58.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.720+0000 7fb359ffb700 1 -- 172.21.15.26:0/1363259199 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fb3540543e0 con 0x7fb3640f6ff0 2021-11-03T17:48:58.715 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:48:58.716 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:48:58.716 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:48:58.716 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:48:58.721 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:48:58.722 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:48:58.722 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:48:58.722 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:48:58.723 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:48:58.723 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:48:58.723 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:48:58.723 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:48:58.723 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:48:58.724 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:48:58.724 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:48:58.724 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:48:58.724 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:48:58.725 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:48:58.725 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:48:58.725 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:48:58.725 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:48:58.726 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:48:58.726 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:48:58.726 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:48:58.726 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:48:58.727 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:48:58.727 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:48:58.727 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:48:58.727 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:48:58.727 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:48:58.728 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:48:58.728 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:48:58.728 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:48:58.729 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:48:58.729 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:48:58.729 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:48:58.729 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:48:58.730 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:48:58.730 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:48:58.731 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.722+0000 7fb36ba62700 1 -- 172.21.15.26:0/1363259199 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb3500640b0 msgr2=0x7fb350066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:48:58.731 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.722+0000 7fb36ba62700 1 --2- 172.21.15.26:0/1363259199 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb3500640b0 0x7fb350066570 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7fb360009880 tx=0x7fb36000b040).stop 2021-11-03T17:48:58.732 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.722+0000 7fb36ba62700 1 -- 172.21.15.26:0/1363259199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3640f6ff0 msgr2=0x7fb364107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:48:58.732 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.722+0000 7fb36ba62700 1 --2- 172.21.15.26:0/1363259199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3640f6ff0 0x7fb364107400 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7fb354009990 tx=0x7fb354009b30).stop 2021-11-03T17:48:58.732 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.722+0000 7fb36ba62700 1 -- 172.21.15.26:0/1363259199 shutdown_connections 2021-11-03T17:48:58.732 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.722+0000 7fb36ba62700 1 --2- 172.21.15.26:0/1363259199 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb3500640b0 0x7fb350066570 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:58.733 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.722+0000 7fb36ba62700 1 --2- 172.21.15.26:0/1363259199 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3640f66e0 0x7fb364106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:58.733 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.722+0000 7fb36ba62700 1 --2- 172.21.15.26:0/1363259199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3640f6ff0 0x7fb364107400 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:48:58.733 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.722+0000 7fb36ba62700 1 -- 172.21.15.26:0/1363259199 >> 172.21.15.26:0/1363259199 conn(0x7fb3640f1f00 msgr2=0x7fb3640fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:48:58.733 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.722+0000 7fb36ba62700 1 -- 172.21.15.26:0/1363259199 shutdown_connections 2021-11-03T17:48:58.734 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:48:58.722+0000 7fb36ba62700 1 -- 172.21.15.26:0/1363259199 wait complete. 2021-11-03T17:48:58.734 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:48:58.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:58 smithi194 ceph-mon[65619]: pgmap v1629: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:58.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:58 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2829615349' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:48:58.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:58 smithi026 ceph-mon[96795]: pgmap v1629: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:48:58.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:58 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2829615349' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:48:59.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:59 smithi026 ceph-mon[96795]: from='client.35820 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:48:59.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:59 smithi026 ceph-mon[96795]: from='client.35824 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:48:59.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:48:59 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1363259199' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:48:59.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:59 smithi194 ceph-mon[65619]: from='client.35820 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:48:59.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:59 smithi194 ceph-mon[65619]: from='client.35824 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:48:59.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:48:59 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1363259199' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:49:00.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:00 smithi026 ceph-mon[96795]: pgmap v1630: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:00.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:00 smithi194 ceph-mon[65619]: pgmap v1630: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:02.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:02 smithi026 ceph-mon[96795]: pgmap v1631: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:02.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:02 smithi194 ceph-mon[65619]: pgmap v1631: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:04.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:04 smithi026 ceph-mon[96795]: pgmap v1632: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:04.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:04 smithi194 ceph-mon[65619]: pgmap v1632: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:06.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:06 smithi026 ceph-mon[96795]: pgmap v1633: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:06.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:06 smithi194 ceph-mon[65619]: pgmap v1633: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:08.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:08 smithi026 ceph-mon[96795]: pgmap v1634: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:08.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:08 smithi194 ceph-mon[65619]: pgmap v1634: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:10.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:10 smithi026 ceph-mon[96795]: pgmap v1635: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:10.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:10 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:49:10.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:10 smithi194 ceph-mon[65619]: pgmap v1635: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:10.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:10 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:49:11.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:11 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:49:11.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:11 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:49:12.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:12 smithi026 ceph-mon[96795]: pgmap v1636: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:12.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:12 smithi194 ceph-mon[65619]: pgmap v1636: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:14.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:14 smithi026 ceph-mon[96795]: pgmap v1637: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:14.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:14 smithi194 ceph-mon[65619]: pgmap v1637: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:16.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:16 smithi026 ceph-mon[96795]: pgmap v1638: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:16.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:16 smithi194 ceph-mon[65619]: pgmap v1638: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:18.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:18 smithi026 ceph-mon[96795]: pgmap v1639: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:18.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:18 smithi194 ceph-mon[65619]: pgmap v1639: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:20.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:20 smithi026 ceph-mon[96795]: pgmap v1640: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:20.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:20 smithi194 ceph-mon[65619]: pgmap v1640: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:22.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:22 smithi026 ceph-mon[96795]: pgmap v1641: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:22.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:22 smithi194 ceph-mon[65619]: pgmap v1641: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:24.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:24 smithi026 ceph-mon[96795]: pgmap v1642: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:24.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:24 smithi194 ceph-mon[65619]: pgmap v1642: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:25.842 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:49:25.843 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:49:25.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:49:25.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:49:26.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:26 smithi026 ceph-mon[96795]: pgmap v1643: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:26.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:26 smithi026 ceph-mon[96795]: poll took 60034.659 ms: 1 events 2021-11-03T17:49:26.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:26 smithi194 ceph-mon[65619]: pgmap v1643: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:26.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:26 smithi194 ceph-mon[65619]: poll took 60034.659 ms: 1 events 2021-11-03T17:49:28.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:28.833+0000 7fa73cbb2700 1 -- 172.21.15.26:0/3012333877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7380f5430 msgr2=0x7fa7380f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:49:28.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:28.833+0000 7fa73cbb2700 1 --2- 172.21.15.26:0/3012333877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7380f5430 0x7fa7380f5850 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7fa728004660 tx=0x7fa728009b30).stop 2021-11-03T17:49:28.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:28.833+0000 7fa73cbb2700 1 -- 172.21.15.26:0/3012333877 shutdown_connections 2021-11-03T17:49:28.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:28.833+0000 7fa73cbb2700 1 --2- 172.21.15.26:0/3012333877 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7380f66d0 0x7fa7380f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:49:28.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:28.833+0000 7fa73cbb2700 1 --2- 172.21.15.26:0/3012333877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7380f5430 0x7fa7380f5850 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:49:28.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:28.833+0000 7fa73cbb2700 1 -- 172.21.15.26:0/3012333877 >> 172.21.15.26:0/3012333877 conn(0x7fa7380f0b90 msgr2=0x7fa7380f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:49:28.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:28.833+0000 7fa73cbb2700 1 -- 172.21.15.26:0/3012333877 shutdown_connections 2021-11-03T17:49:28.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:28.833+0000 7fa73cbb2700 1 -- 172.21.15.26:0/3012333877 wait complete. 2021-11-03T17:49:28.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:28.834+0000 7fa73cbb2700 1 Processor -- start 2021-11-03T17:49:28.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:28.834+0000 7fa73cbb2700 1 -- start start 2021-11-03T17:49:28.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:28.834+0000 7fa73cbb2700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7380f5430 0x7fa73810beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:49:28.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:28.834+0000 7fa73cbb2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7380f66d0 0x7fa73810e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:49:28.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:28.834+0000 7fa73cbb2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7380602b0 con 0x7fa7380f66d0 2021-11-03T17:49:28.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:28.834+0000 7fa73cbb2700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7380603f0 con 0x7fa7380f5430 2021-11-03T17:49:28.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:28.834+0000 7fa736ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7380f66d0 0x7fa73810e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:49:28.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:28.834+0000 7fa736ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7380f66d0 0x7fa73810e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56564/0 (socket says 172.21.15.26:56564) 2021-11-03T17:49:28.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:28.834+0000 7fa736ffd700 1 -- 172.21.15.26:0/383085208 learned_addr learned my addr 172.21.15.26:0/383085208 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:49:28.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:28.834+0000 7fa7377fe700 1 --2- 172.21.15.26:0/383085208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7380f5430 0x7fa73810beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:49:28.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:28.835+0000 7fa736ffd700 1 -- 172.21.15.26:0/383085208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7380f5430 msgr2=0x7fa73810beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:49:28.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:28.835+0000 7fa736ffd700 1 --2- 172.21.15.26:0/383085208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7380f5430 0x7fa73810beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:49:28.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:28.835+0000 7fa736ffd700 1 -- 172.21.15.26:0/383085208 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa728005040 con 0x7fa7380f66d0 2021-11-03T17:49:28.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:28.835+0000 7fa736ffd700 1 --2- 172.21.15.26:0/383085208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7380f66d0 0x7fa73810e3b0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7fa72c0026d0 tx=0x7fa72c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:49:28.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:28.835+0000 7fa71ffff700 1 -- 172.21.15.26:0/383085208 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa72c0079c0 con 0x7fa7380f66d0 2021-11-03T17:49:28.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:28.835+0000 7fa73cbb2700 1 -- 172.21.15.26:0/383085208 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa73810e8a0 con 0x7fa7380f66d0 2021-11-03T17:49:28.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:28.835+0000 7fa71ffff700 1 -- 172.21.15.26:0/383085208 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa72c00f040 con 0x7fa7380f66d0 2021-11-03T17:49:28.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:28.835+0000 7fa71ffff700 1 -- 172.21.15.26:0/383085208 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa72c0148b0 con 0x7fa7380f66d0 2021-11-03T17:49:28.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:28.835+0000 7fa73cbb2700 1 -- 172.21.15.26:0/383085208 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa73810ed20 con 0x7fa7380f66d0 2021-11-03T17:49:28.837 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:28.836+0000 7fa73cbb2700 1 -- 172.21.15.26:0/383085208 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa738045ad0 con 0x7fa7380f66d0 2021-11-03T17:49:28.837 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:28.837+0000 7fa71ffff700 1 -- 172.21.15.26:0/383085208 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fa72c007b20 con 0x7fa7380f66d0 2021-11-03T17:49:28.838 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:28.837+0000 7fa71ffff700 1 --2- 172.21.15.26:0/383085208 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa720064100 0x7fa7200665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:49:28.838 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:28.837+0000 7fa71ffff700 1 -- 172.21.15.26:0/383085208 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fa72c080720 con 0x7fa7380f66d0 2021-11-03T17:49:28.838 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:28.837+0000 7fa7377fe700 1 --2- 172.21.15.26:0/383085208 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa720064100 0x7fa7200665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:49:28.838 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:28.838+0000 7fa7377fe700 1 --2- 172.21.15.26:0/383085208 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa720064100 0x7fa7200665c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7fa728013690 tx=0x7fa728009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:49:28.838 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:28.841+0000 7fa71ffff700 1 -- 172.21.15.26:0/383085208 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fa72c052a80 con 0x7fa7380f66d0 2021-11-03T17:49:28.920 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:28 smithi026 ceph-mon[96795]: pgmap v1644: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:28.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:28 smithi194 ceph-mon[65619]: pgmap v1644: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:29.022 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.028+0000 7fa73cbb2700 1 -- 172.21.15.26:0/383085208 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa738057f10 con 0x7fa720064100 2021-11-03T17:49:29.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.030+0000 7fa71ffff700 1 -- 172.21.15.26:0/383085208 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fa738057f10 con 0x7fa720064100 2021-11-03T17:49:29.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.031+0000 7fa73cbb2700 1 -- 172.21.15.26:0/383085208 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa720064100 msgr2=0x7fa7200665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:49:29.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.031+0000 7fa73cbb2700 1 --2- 172.21.15.26:0/383085208 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa720064100 0x7fa7200665c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7fa728013690 tx=0x7fa728009b30).stop 2021-11-03T17:49:29.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.031+0000 7fa73cbb2700 1 -- 172.21.15.26:0/383085208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7380f66d0 msgr2=0x7fa73810e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:49:29.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.031+0000 7fa73cbb2700 1 --2- 172.21.15.26:0/383085208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7380f66d0 0x7fa73810e3b0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7fa72c0026d0 tx=0x7fa72c009de0).stop 2021-11-03T17:49:29.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.031+0000 7fa73cbb2700 1 -- 172.21.15.26:0/383085208 shutdown_connections 2021-11-03T17:49:29.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.031+0000 7fa73cbb2700 1 --2- 172.21.15.26:0/383085208 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa720064100 0x7fa7200665c0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:49:29.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.031+0000 7fa73cbb2700 1 --2- 172.21.15.26:0/383085208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7380f5430 0x7fa73810beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:49:29.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.031+0000 7fa73cbb2700 1 --2- 172.21.15.26:0/383085208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7380f66d0 0x7fa73810e3b0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:49:29.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.031+0000 7fa73cbb2700 1 -- 172.21.15.26:0/383085208 >> 172.21.15.26:0/383085208 conn(0x7fa7380f0b90 msgr2=0x7fa7380fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:49:29.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.032+0000 7fa73cbb2700 1 -- 172.21.15.26:0/383085208 shutdown_connections 2021-11-03T17:49:29.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.032+0000 7fa73cbb2700 1 -- 172.21.15.26:0/383085208 wait complete. 2021-11-03T17:49:29.035 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:49:29.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.133+0000 7f74663d0700 1 -- 172.21.15.26:0/557667299 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74600f66e0 msgr2=0x7f74600f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:49:29.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.133+0000 7f74663d0700 1 --2- 172.21.15.26:0/557667299 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74600f66e0 0x7f74600f6b00 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7f7450004660 tx=0x7f7450009b30).stop 2021-11-03T17:49:29.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.133+0000 7f74663d0700 1 -- 172.21.15.26:0/557667299 shutdown_connections 2021-11-03T17:49:29.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.133+0000 7f74663d0700 1 --2- 172.21.15.26:0/557667299 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74600f7980 0x7f74600f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:49:29.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.133+0000 7f74663d0700 1 --2- 172.21.15.26:0/557667299 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74600f66e0 0x7f74600f6b00 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:49:29.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.133+0000 7f74663d0700 1 -- 172.21.15.26:0/557667299 >> 172.21.15.26:0/557667299 conn(0x7f74600f1e40 msgr2=0x7f74600f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:49:29.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.134+0000 7f74663d0700 1 -- 172.21.15.26:0/557667299 shutdown_connections 2021-11-03T17:49:29.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.134+0000 7f74663d0700 1 -- 172.21.15.26:0/557667299 wait complete. 2021-11-03T17:49:29.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.134+0000 7f74663d0700 1 Processor -- start 2021-11-03T17:49:29.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.134+0000 7f74663d0700 1 -- start start 2021-11-03T17:49:29.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.134+0000 7f74663d0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74600f66e0 0x7f7460106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:49:29.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.134+0000 7f74663d0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74600f7980 0x7f7460107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:49:29.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.134+0000 7f74663d0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7460107a00 con 0x7f74600f7980 2021-11-03T17:49:29.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.134+0000 7f74663d0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7460107b40 con 0x7f74600f66e0 2021-11-03T17:49:29.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.135+0000 7f745f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74600f7980 0x7f7460107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:49:29.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.135+0000 7f745f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74600f7980 0x7f7460107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56574/0 (socket says 172.21.15.26:56574) 2021-11-03T17:49:29.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.135+0000 7f745f7fe700 1 -- 172.21.15.26:0/2052272356 learned_addr learned my addr 172.21.15.26:0/2052272356 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:49:29.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.135+0000 7f745ffff700 1 --2- 172.21.15.26:0/2052272356 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74600f66e0 0x7f7460106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:49:29.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.135+0000 7f745f7fe700 1 -- 172.21.15.26:0/2052272356 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74600f66e0 msgr2=0x7f7460106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:49:29.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.135+0000 7f745f7fe700 1 --2- 172.21.15.26:0/2052272356 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74600f66e0 0x7f7460106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:49:29.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.135+0000 7f745f7fe700 1 -- 172.21.15.26:0/2052272356 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7450005040 con 0x7f74600f7980 2021-11-03T17:49:29.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.135+0000 7f745f7fe700 1 --2- 172.21.15.26:0/2052272356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74600f7980 0x7f7460107450 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7f745400e7f0 tx=0x7f745400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:49:29.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.135+0000 7f745cff9700 1 -- 172.21.15.26:0/2052272356 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74540092e0 con 0x7f74600f7980 2021-11-03T17:49:29.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.135+0000 7f74663d0700 1 -- 172.21.15.26:0/2052272356 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74601084e0 con 0x7f74600f7980 2021-11-03T17:49:29.139 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.135+0000 7f74663d0700 1 -- 172.21.15.26:0/2052272356 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7460108aa0 con 0x7f74600f7980 2021-11-03T17:49:29.139 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.135+0000 7f745cff9700 1 -- 172.21.15.26:0/2052272356 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f745400f040 con 0x7f74600f7980 2021-11-03T17:49:29.139 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.135+0000 7f745cff9700 1 -- 172.21.15.26:0/2052272356 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7454014750 con 0x7f74600f7980 2021-11-03T17:49:29.139 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.136+0000 7f74663d0700 1 -- 172.21.15.26:0/2052272356 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7440004fa0 con 0x7f74600f7980 2021-11-03T17:49:29.139 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.137+0000 7f745cff9700 1 -- 172.21.15.26:0/2052272356 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f745401b030 con 0x7f74600f7980 2021-11-03T17:49:29.140 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.137+0000 7f745cff9700 1 --2- 172.21.15.26:0/2052272356 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f74480640b0 0x7f7448066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:49:29.140 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.137+0000 7f745cff9700 1 -- 172.21.15.26:0/2052272356 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f7454080530 con 0x7f74600f7980 2021-11-03T17:49:29.140 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.137+0000 7f745ffff700 1 --2- 172.21.15.26:0/2052272356 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f74480640b0 0x7f7448066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:49:29.140 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.138+0000 7f745ffff700 1 --2- 172.21.15.26:0/2052272356 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f74480640b0 0x7f7448066570 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f7450004d80 tx=0x7f7450016040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:49:29.141 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.142+0000 7f745cff9700 1 -- 172.21.15.26:0/2052272356 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f7454052850 con 0x7f74600f7980 2021-11-03T17:49:29.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.338+0000 7f74663d0700 1 -- 172.21.15.26:0/2052272356 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7440000bc0 con 0x7f74480640b0 2021-11-03T17:49:29.348 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.354+0000 7f745cff9700 1 -- 172.21.15.26:0/2052272356 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f7440000bc0 con 0x7f74480640b0 2021-11-03T17:49:29.348 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:49:29.349 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (60m) 10m ago 61m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:49:29.349 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (52m) 10m ago 61m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:49:29.349 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (52m) 9m ago 61m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:49:29.351 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (60m) 10m ago 61m 40.8M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:49:29.351 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (53m) 10m ago 57m 25.1M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:49:29.351 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (54m) 10m ago 56m 25.7M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:49:29.351 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (57m) 9m ago 57m 26.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:49:29.352 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (57m) 9m ago 57m 26.3M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:49:29.352 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (54m) 10m ago 63m 533M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:49:29.352 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (54m) 9m ago 61m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:49:29.352 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (53m) 10m ago 63m 209M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:49:29.353 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (53m) 9m ago 61m 103M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:49:29.353 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (61m) 10m ago 61m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:49:29.353 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (60m) 9m ago 60m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:49:29.353 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (52m) 10m ago 60m 251M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:49:29.353 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (52m) 10m ago 59m 270M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:49:29.354 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (51m) 10m ago 59m 225M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:49:29.354 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (51m) 9m ago 59m 287M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:49:29.354 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (50m) 9m ago 59m 246M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:49:29.354 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (50m) 9m ago 58m 235M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:49:29.355 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (60m) 10m ago 61m 56.7M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:49:29.355 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.356+0000 7f74663d0700 1 -- 172.21.15.26:0/2052272356 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f74480640b0 msgr2=0x7f7448066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:49:29.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.356+0000 7f74663d0700 1 --2- 172.21.15.26:0/2052272356 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f74480640b0 0x7f7448066570 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f7450004d80 tx=0x7f7450016040).stop 2021-11-03T17:49:29.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.356+0000 7f74663d0700 1 -- 172.21.15.26:0/2052272356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74600f7980 msgr2=0x7f7460107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:49:29.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.356+0000 7f74663d0700 1 --2- 172.21.15.26:0/2052272356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74600f7980 0x7f7460107450 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7f745400e7f0 tx=0x7f745400b040).stop 2021-11-03T17:49:29.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.356+0000 7f74663d0700 1 -- 172.21.15.26:0/2052272356 shutdown_connections 2021-11-03T17:49:29.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.356+0000 7f74663d0700 1 --2- 172.21.15.26:0/2052272356 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f74480640b0 0x7f7448066570 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:49:29.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.356+0000 7f74663d0700 1 --2- 172.21.15.26:0/2052272356 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74600f66e0 0x7f7460106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:49:29.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.356+0000 7f74663d0700 1 --2- 172.21.15.26:0/2052272356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74600f7980 0x7f7460107450 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:49:29.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.356+0000 7f74663d0700 1 -- 172.21.15.26:0/2052272356 >> 172.21.15.26:0/2052272356 conn(0x7f74600f1e40 msgr2=0x7f74600fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:49:29.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.356+0000 7f74663d0700 1 -- 172.21.15.26:0/2052272356 shutdown_connections 2021-11-03T17:49:29.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.356+0000 7f74663d0700 1 -- 172.21.15.26:0/2052272356 wait complete. 2021-11-03T17:49:29.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.471+0000 7f6bb45e0700 1 -- 172.21.15.26:0/1899460903 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bac0f66c0 msgr2=0x7f6bac0f6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:49:29.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.471+0000 7f6bb45e0700 1 --2- 172.21.15.26:0/1899460903 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bac0f66c0 0x7f6bac0f6ae0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7f6ba8004660 tx=0x7f6ba8009b30).stop 2021-11-03T17:49:29.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.471+0000 7f6bb45e0700 1 -- 172.21.15.26:0/1899460903 shutdown_connections 2021-11-03T17:49:29.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.471+0000 7f6bb45e0700 1 --2- 172.21.15.26:0/1899460903 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6bac0f7960 0x7f6bac0f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:49:29.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.471+0000 7f6bb45e0700 1 --2- 172.21.15.26:0/1899460903 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bac0f66c0 0x7f6bac0f6ae0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:49:29.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.471+0000 7f6bb45e0700 1 -- 172.21.15.26:0/1899460903 >> 172.21.15.26:0/1899460903 conn(0x7f6bac0f1e20 msgr2=0x7f6bac0f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:49:29.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.471+0000 7f6bb45e0700 1 -- 172.21.15.26:0/1899460903 shutdown_connections 2021-11-03T17:49:29.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.471+0000 7f6bb45e0700 1 -- 172.21.15.26:0/1899460903 wait complete. 2021-11-03T17:49:29.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.472+0000 7f6bb45e0700 1 Processor -- start 2021-11-03T17:49:29.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.472+0000 7f6bb45e0700 1 -- start start 2021-11-03T17:49:29.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.472+0000 7f6bb45e0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6bac0f66c0 0x7f6bac06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:49:29.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.472+0000 7f6bb45e0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bac0f7960 0x7f6bac069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:49:29.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.472+0000 7f6bb45e0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac06a380 con 0x7f6bac0f7960 2021-11-03T17:49:29.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.472+0000 7f6bb45e0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac06a4c0 con 0x7f6bac0f66c0 2021-11-03T17:49:29.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.472+0000 7f6bb1b7b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bac0f7960 0x7f6bac069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:49:29.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.472+0000 7f6bb1b7b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bac0f7960 0x7f6bac069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56584/0 (socket says 172.21.15.26:56584) 2021-11-03T17:49:29.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.472+0000 7f6bb1b7b700 1 -- 172.21.15.26:0/2259433119 learned_addr learned my addr 172.21.15.26:0/2259433119 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:49:29.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.472+0000 7f6bb237c700 1 --2- 172.21.15.26:0/2259433119 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6bac0f66c0 0x7f6bac06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:49:29.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.473+0000 7f6bb1b7b700 1 -- 172.21.15.26:0/2259433119 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6bac0f66c0 msgr2=0x7f6bac06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:49:29.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.473+0000 7f6bb1b7b700 1 --2- 172.21.15.26:0/2259433119 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6bac0f66c0 0x7f6bac06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:49:29.472 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.473+0000 7f6bb1b7b700 1 -- 172.21.15.26:0/2259433119 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba8005040 con 0x7f6bac0f7960 2021-11-03T17:49:29.472 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.473+0000 7f6bb1b7b700 1 --2- 172.21.15.26:0/2259433119 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bac0f7960 0x7f6bac069e20 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7f6b9c0026d0 tx=0x7f6b9c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:49:29.472 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.473+0000 7f6ba2ffd700 1 -- 172.21.15.26:0/2259433119 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b9c0079c0 con 0x7f6bac0f7960 2021-11-03T17:49:29.472 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.473+0000 7f6ba2ffd700 1 -- 172.21.15.26:0/2259433119 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6b9c00f040 con 0x7f6bac0f7960 2021-11-03T17:49:29.472 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.473+0000 7f6bb45e0700 1 -- 172.21.15.26:0/2259433119 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bac06a7a0 con 0x7f6bac0f7960 2021-11-03T17:49:29.474 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.473+0000 7f6bb45e0700 1 -- 172.21.15.26:0/2259433119 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bac10ef80 con 0x7f6bac0f7960 2021-11-03T17:49:29.474 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.473+0000 7f6ba2ffd700 1 -- 172.21.15.26:0/2259433119 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b9c0148b0 con 0x7f6bac0f7960 2021-11-03T17:49:29.474 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.474+0000 7f6bb45e0700 1 -- 172.21.15.26:0/2259433119 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b94004fa0 con 0x7f6bac0f7960 2021-11-03T17:49:29.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.475+0000 7f6ba2ffd700 1 -- 172.21.15.26:0/2259433119 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f6b9c014a10 con 0x7f6bac0f7960 2021-11-03T17:49:29.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.475+0000 7f6ba2ffd700 1 --2- 172.21.15.26:0/2259433119 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6b98064090 0x7f6b98066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:49:29.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.475+0000 7f6ba2ffd700 1 -- 172.21.15.26:0/2259433119 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f6b9c0805e0 con 0x7f6bac0f7960 2021-11-03T17:49:29.476 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.475+0000 7f6bb237c700 1 --2- 172.21.15.26:0/2259433119 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6b98064090 0x7f6b98066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:49:29.476 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.476+0000 7f6bb237c700 1 --2- 172.21.15.26:0/2259433119 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6b98064090 0x7f6b98066550 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f6bac06b730 tx=0x7f6ba8009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:49:29.476 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.480+0000 7f6ba2ffd700 1 -- 172.21.15.26:0/2259433119 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f6b9c052940 con 0x7f6bac0f7960 2021-11-03T17:49:29.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.724+0000 7f6bb45e0700 1 -- 172.21.15.26:0/2259433119 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6b94005e80 con 0x7f6bac0f7960 2021-11-03T17:49:29.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.725+0000 7f6ba2ffd700 1 -- 172.21.15.26:0/2259433119 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f6b9c052530 con 0x7f6bac0f7960 2021-11-03T17:49:29.719 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:49:29.720 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:49:29.720 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:49:29.720 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:49:29.720 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:49:29.721 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:49:29.721 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:49:29.721 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:49:29.721 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:49:29.721 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:49:29.722 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:49:29.722 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:49:29.722 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:49:29.722 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:49:29.723 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:49:29.723 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:49:29.723 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:49:29.723 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:49:29.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.727+0000 7f6bb45e0700 1 -- 172.21.15.26:0/2259433119 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6b98064090 msgr2=0x7f6b98066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:49:29.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.727+0000 7f6bb45e0700 1 --2- 172.21.15.26:0/2259433119 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6b98064090 0x7f6b98066550 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f6bac06b730 tx=0x7f6ba8009b30).stop 2021-11-03T17:49:29.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.727+0000 7f6bb45e0700 1 -- 172.21.15.26:0/2259433119 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bac0f7960 msgr2=0x7f6bac069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:49:29.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.727+0000 7f6bb45e0700 1 --2- 172.21.15.26:0/2259433119 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bac0f7960 0x7f6bac069e20 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7f6b9c0026d0 tx=0x7f6b9c009de0).stop 2021-11-03T17:49:29.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.727+0000 7f6bb45e0700 1 -- 172.21.15.26:0/2259433119 shutdown_connections 2021-11-03T17:49:29.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.727+0000 7f6bb45e0700 1 --2- 172.21.15.26:0/2259433119 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6b98064090 0x7f6b98066550 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:49:29.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.727+0000 7f6bb45e0700 1 --2- 172.21.15.26:0/2259433119 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6bac0f66c0 0x7f6bac06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:49:29.726 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.727+0000 7f6bb45e0700 1 --2- 172.21.15.26:0/2259433119 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bac0f7960 0x7f6bac069e20 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:49:29.726 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.727+0000 7f6bb45e0700 1 -- 172.21.15.26:0/2259433119 >> 172.21.15.26:0/2259433119 conn(0x7f6bac0f1e20 msgr2=0x7f6bac0fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:49:29.726 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.727+0000 7f6bb45e0700 1 -- 172.21.15.26:0/2259433119 shutdown_connections 2021-11-03T17:49:29.726 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.727+0000 7f6bb45e0700 1 -- 172.21.15.26:0/2259433119 wait complete. 2021-11-03T17:49:29.824 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.830+0000 7f3bbc812700 1 -- 172.21.15.26:0/2227614421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bb8060290 msgr2=0x7f3bb80f91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:49:29.824 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.830+0000 7f3bbc812700 1 --2- 172.21.15.26:0/2227614421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bb8060290 0x7f3bb80f91a0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7f3ba8004660 tx=0x7f3ba8009b30).stop 2021-11-03T17:49:29.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.830+0000 7f3bbc812700 1 -- 172.21.15.26:0/2227614421 shutdown_connections 2021-11-03T17:49:29.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.830+0000 7f3bbc812700 1 --2- 172.21.15.26:0/2227614421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bb80f9720 0x7f3bb80fbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:49:29.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.830+0000 7f3bbc812700 1 --2- 172.21.15.26:0/2227614421 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bb8060290 0x7f3bb80f91a0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:49:29.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.830+0000 7f3bbc812700 1 -- 172.21.15.26:0/2227614421 >> 172.21.15.26:0/2227614421 conn(0x7f3bb80f0ba0 msgr2=0x7f3bb80f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:49:29.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.830+0000 7f3bbc812700 1 -- 172.21.15.26:0/2227614421 shutdown_connections 2021-11-03T17:49:29.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.830+0000 7f3bbc812700 1 -- 172.21.15.26:0/2227614421 wait complete. 2021-11-03T17:49:29.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.831+0000 7f3bbc812700 1 Processor -- start 2021-11-03T17:49:29.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.831+0000 7f3bbc812700 1 -- start start 2021-11-03T17:49:29.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.831+0000 7f3bbc812700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bb8060290 0x7f3bb8106db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:49:29.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.831+0000 7f3bbc812700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bb80f9720 0x7f3bb81072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:49:29.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.831+0000 7f3bbc812700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb81078a0 con 0x7f3bb8060290 2021-11-03T17:49:29.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.831+0000 7f3bbc812700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb81080e0 con 0x7f3bb80f9720 2021-11-03T17:49:29.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.831+0000 7f3bb6d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bb8060290 0x7f3bb8106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:49:29.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.831+0000 7f3bb6d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bb8060290 0x7f3bb8106db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56592/0 (socket says 172.21.15.26:56592) 2021-11-03T17:49:29.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.831+0000 7f3bb6d9d700 1 -- 172.21.15.26:0/3806147321 learned_addr learned my addr 172.21.15.26:0/3806147321 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:49:29.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.831+0000 7f3bb659c700 1 --2- 172.21.15.26:0/3806147321 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bb80f9720 0x7f3bb81072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:49:29.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.831+0000 7f3bb6d9d700 1 -- 172.21.15.26:0/3806147321 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bb80f9720 msgr2=0x7f3bb81072a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:49:29.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.831+0000 7f3bb6d9d700 1 --2- 172.21.15.26:0/3806147321 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bb80f9720 0x7f3bb81072a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:49:29.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.831+0000 7f3bb6d9d700 1 -- 172.21.15.26:0/3806147321 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba8005040 con 0x7f3bb8060290 2021-11-03T17:49:29.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.831+0000 7f3bb659c700 1 --2- 172.21.15.26:0/3806147321 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bb80f9720 0x7f3bb81072a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:49:29.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.832+0000 7f3bb6d9d700 1 --2- 172.21.15.26:0/3806147321 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bb8060290 0x7f3bb8106db0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7f3ba8009990 tx=0x7f3ba8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:49:29.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.832+0000 7f3b9f7fe700 1 -- 172.21.15.26:0/3806147321 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ba8018070 con 0x7f3bb8060290 2021-11-03T17:49:29.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.832+0000 7f3b9f7fe700 1 -- 172.21.15.26:0/3806147321 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3ba8007ca0 con 0x7f3bb8060290 2021-11-03T17:49:29.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.832+0000 7f3bbc812700 1 -- 172.21.15.26:0/3806147321 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb8108360 con 0x7f3bb8060290 2021-11-03T17:49:29.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.832+0000 7f3b9f7fe700 1 -- 172.21.15.26:0/3806147321 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ba801c620 con 0x7f3bb8060290 2021-11-03T17:49:29.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.832+0000 7f3bbc812700 1 -- 172.21.15.26:0/3806147321 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb8108840 con 0x7f3bb8060290 2021-11-03T17:49:29.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.833+0000 7f3bbc812700 1 -- 172.21.15.26:0/3806147321 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb8059100 con 0x7f3bb8060290 2021-11-03T17:49:29.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.833+0000 7f3b9f7fe700 1 -- 172.21.15.26:0/3806147321 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f3ba801d960 con 0x7f3bb8060290 2021-11-03T17:49:29.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.834+0000 7f3b9f7fe700 1 --2- 172.21.15.26:0/3806147321 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3ba0064100 0x7f3ba00665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:49:29.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.834+0000 7f3b9f7fe700 1 -- 172.21.15.26:0/3806147321 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f3ba8082600 con 0x7f3bb8060290 2021-11-03T17:49:29.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.834+0000 7f3bb659c700 1 --2- 172.21.15.26:0/3806147321 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3ba0064100 0x7f3ba00665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:49:29.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.834+0000 7f3bb659c700 1 --2- 172.21.15.26:0/3806147321 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3ba0064100 0x7f3ba00665c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f3bb8106b40 tx=0x7f3bac009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:49:29.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:29.839+0000 7f3b9f7fe700 1 -- 172.21.15.26:0/3806147321 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f3ba8054960 con 0x7f3bb8060290 2021-11-03T17:49:30.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:30.055+0000 7f3bbc812700 1 -- 172.21.15.26:0/3806147321 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3bb8045ad0 con 0x7f3bb8060290 2021-11-03T17:49:30.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:30.056+0000 7f3b9f7fe700 1 -- 172.21.15.26:0/3806147321 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f3ba8054550 con 0x7f3bb8060290 2021-11-03T17:49:30.050 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:49:30.050 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:49:30.051 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:49:30.051 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:49:30.051 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:49:30.051 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:49:30.051 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:49:30.052 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:49:30.052 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:49:30.052 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:49:30.052 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:49:30.053 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:49:30.053 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:49:30.053 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:49:30.053 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:49:30.053 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:49:30.054 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:49:30.054 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:49:30.054 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:49:30.054 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:49:30.055 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:49:30.055 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:49:30.055 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:49:30.055 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:49:30.055 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:49:30.056 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:49:30.056 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:49:30.056 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:49:30.056 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:49:30.057 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:49:30.057 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:49:30.057 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:49:30.057 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:49:30.057 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:49:30.058 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:49:30.058 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:49:30.058 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:49:30.058 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:49:30.059 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:49:30.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:30.057+0000 7f3bbc812700 1 -- 172.21.15.26:0/3806147321 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3ba0064100 msgr2=0x7f3ba00665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:49:30.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:30.057+0000 7f3bbc812700 1 --2- 172.21.15.26:0/3806147321 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3ba0064100 0x7f3ba00665c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f3bb8106b40 tx=0x7f3bac009040).stop 2021-11-03T17:49:30.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:30.057+0000 7f3bbc812700 1 -- 172.21.15.26:0/3806147321 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bb8060290 msgr2=0x7f3bb8106db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:49:30.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:30.057+0000 7f3bbc812700 1 --2- 172.21.15.26:0/3806147321 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bb8060290 0x7f3bb8106db0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7f3ba8009990 tx=0x7f3ba8009b30).stop 2021-11-03T17:49:30.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:30.057+0000 7f3bbc812700 1 -- 172.21.15.26:0/3806147321 shutdown_connections 2021-11-03T17:49:30.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:30.057+0000 7f3bbc812700 1 --2- 172.21.15.26:0/3806147321 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3ba0064100 0x7f3ba00665c0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:49:30.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:30.057+0000 7f3bbc812700 1 --2- 172.21.15.26:0/3806147321 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bb8060290 0x7f3bb8106db0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:49:30.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:30.057+0000 7f3bbc812700 1 --2- 172.21.15.26:0/3806147321 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bb80f9720 0x7f3bb81072a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:49:30.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:30.057+0000 7f3bbc812700 1 -- 172.21.15.26:0/3806147321 >> 172.21.15.26:0/3806147321 conn(0x7f3bb80f0ba0 msgr2=0x7f3bb80f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:49:30.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:30.058+0000 7f3bbc812700 1 -- 172.21.15.26:0/3806147321 shutdown_connections 2021-11-03T17:49:30.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:49:30.058+0000 7f3bbc812700 1 -- 172.21.15.26:0/3806147321 wait complete. 2021-11-03T17:49:30.062 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:49:30.774 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:30 smithi026 ceph-mon[96795]: from='client.35836 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:49:30.774 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:30 smithi026 ceph-mon[96795]: pgmap v1645: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:30.774 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:30 smithi026 ceph-mon[96795]: from='client.35840 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:49:30.775 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:30 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2259433119' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:49:30.775 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:30 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3806147321' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:49:30.775 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:30 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:49:30.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:30 smithi194 ceph-mon[65619]: from='client.35836 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:49:30.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:30 smithi194 ceph-mon[65619]: pgmap v1645: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:30.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:30 smithi194 ceph-mon[65619]: from='client.35840 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:49:30.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:30 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2259433119' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:49:30.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:30 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3806147321' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:49:30.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:30 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:49:31.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:31 smithi026 ceph-mon[96795]: poll took 4563.089 ms: 1 events 2021-11-03T17:49:31.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:31 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:49:31.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:31 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:49:31.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:31 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:49:31.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:31 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:49:31.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:31 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:49:31.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:31 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:49:31.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:31 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:49:31.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:31 smithi194 ceph-mon[65619]: poll took 4563.089 ms: 1 events 2021-11-03T17:49:31.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:31 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:49:31.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:31 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:49:31.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:31 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:49:31.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:31 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:49:31.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:31 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:49:31.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:31 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:49:31.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:31 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:49:32.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:32 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:49:32.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:32 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:49:32.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:32 smithi026 ceph-mon[96795]: pgmap v1646: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:32.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:32 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:49:32.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:32 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:49:32.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:32 smithi194 ceph-mon[65619]: pgmap v1646: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:34.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:34 smithi026 ceph-mon[96795]: pgmap v1647: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:34.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:34 smithi194 ceph-mon[65619]: pgmap v1647: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:36.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:36 smithi026 ceph-mon[96795]: pgmap v1648: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:36.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:36 smithi194 ceph-mon[65619]: pgmap v1648: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:38.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:38 smithi026 ceph-mon[96795]: pgmap v1649: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:38.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:38 smithi194 ceph-mon[65619]: pgmap v1649: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:40.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:40 smithi026 ceph-mon[96795]: pgmap v1650: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:40.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:40 smithi194 ceph-mon[65619]: pgmap v1650: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:42.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:42 smithi026 ceph-mon[96795]: pgmap v1651: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:42.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:42 smithi194 ceph-mon[65619]: pgmap v1651: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:44.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:44 smithi026 ceph-mon[96795]: pgmap v1652: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:44.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:44 smithi194 ceph-mon[65619]: pgmap v1652: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:46.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:46 smithi026 ceph-mon[96795]: pgmap v1653: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:46.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:46 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:49:46.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:46 smithi194 ceph-mon[65619]: pgmap v1653: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:46.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:46 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:49:47.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:47 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:49:47.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:47 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:49:48.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:48 smithi026 ceph-mon[96795]: pgmap v1654: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:48.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:49:48.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:49:48.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:48 smithi194 ceph-mon[65619]: pgmap v1654: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:48.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:49:48.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:49:50.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:50 smithi026 ceph-mon[96795]: pgmap v1655: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:50.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:50 smithi194 ceph-mon[65619]: pgmap v1655: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:52.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:52 smithi026 ceph-mon[96795]: pgmap v1656: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:52.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:52 smithi194 ceph-mon[65619]: pgmap v1656: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:54.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:54 smithi026 ceph-mon[96795]: pgmap v1657: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:54.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:54 smithi194 ceph-mon[65619]: pgmap v1657: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:56.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:56 smithi026 ceph-mon[96795]: pgmap v1658: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:56.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:56 smithi194 ceph-mon[65619]: pgmap v1658: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:58.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:49:58 smithi026 ceph-mon[96795]: pgmap v1659: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:49:58.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:49:58 smithi194 ceph-mon[65619]: pgmap v1659: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:00.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.172+0000 7f12ce793700 1 -- 172.21.15.26:0/1863807781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12c80f6860 msgr2=0x7f12c80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:50:00.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.172+0000 7f12ce793700 1 --2- 172.21.15.26:0/1863807781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12c80f6860 0x7f12c80f6cc0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7f12bc004660 tx=0x7f12bc009b30).stop 2021-11-03T17:50:00.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.172+0000 7f12ce793700 1 -- 172.21.15.26:0/1863807781 shutdown_connections 2021-11-03T17:50:00.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.172+0000 7f12ce793700 1 --2- 172.21.15.26:0/1863807781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12c80f6860 0x7f12c80f6cc0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:00.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.172+0000 7f12ce793700 1 --2- 172.21.15.26:0/1863807781 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12c80f55c0 0x7f12c80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:00.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.172+0000 7f12ce793700 1 -- 172.21.15.26:0/1863807781 >> 172.21.15.26:0/1863807781 conn(0x7f12c80f0d40 msgr2=0x7f12c80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:50:00.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.172+0000 7f12ce793700 1 -- 172.21.15.26:0/1863807781 shutdown_connections 2021-11-03T17:50:00.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.172+0000 7f12ce793700 1 -- 172.21.15.26:0/1863807781 wait complete. 2021-11-03T17:50:00.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.173+0000 7f12ce793700 1 Processor -- start 2021-11-03T17:50:00.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.173+0000 7f12ce793700 1 -- start start 2021-11-03T17:50:00.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.173+0000 7f12ce793700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12c80f55c0 0x7f12c80f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:50:00.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.173+0000 7f12ce793700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12c80f6860 0x7f12c80f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:50:00.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.173+0000 7f12ce793700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c80f8100 con 0x7f12c80f6860 2021-11-03T17:50:00.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.173+0000 7f12ce793700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c80f8240 con 0x7f12c80f55c0 2021-11-03T17:50:00.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.173+0000 7f12c77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12c80f6860 0x7f12c80f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:50:00.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.173+0000 7f12c77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12c80f6860 0x7f12c80f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56612/0 (socket says 172.21.15.26:56612) 2021-11-03T17:50:00.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.173+0000 7f12c77fe700 1 -- 172.21.15.26:0/2826221004 learned_addr learned my addr 172.21.15.26:0/2826221004 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:50:00.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.174+0000 7f12c7fff700 1 --2- 172.21.15.26:0/2826221004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12c80f55c0 0x7f12c80f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:50:00.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.174+0000 7f12c77fe700 1 -- 172.21.15.26:0/2826221004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12c80f55c0 msgr2=0x7f12c80f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:50:00.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.174+0000 7f12c77fe700 1 --2- 172.21.15.26:0/2826221004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12c80f55c0 0x7f12c80f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:00.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.174+0000 7f12c77fe700 1 -- 172.21.15.26:0/2826221004 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12bc005040 con 0x7f12c80f6860 2021-11-03T17:50:00.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.174+0000 7f12c7fff700 1 --2- 172.21.15.26:0/2826221004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12c80f55c0 0x7f12c80f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:50:00.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.174+0000 7f12c77fe700 1 --2- 172.21.15.26:0/2826221004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12c80f6860 0x7f12c80f7ba0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 rx=0x7f12bc009990 tx=0x7f12bc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:50:00.175 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.174+0000 7f12c4ff9700 1 -- 172.21.15.26:0/2826221004 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12bc018070 con 0x7f12c80f6860 2021-11-03T17:50:00.175 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.174+0000 7f12c4ff9700 1 -- 172.21.15.26:0/2826221004 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f12bc007ca0 con 0x7f12c80f6860 2021-11-03T17:50:00.175 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.174+0000 7f12c4ff9700 1 -- 172.21.15.26:0/2826221004 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12bc01c620 con 0x7f12c80f6860 2021-11-03T17:50:00.175 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.174+0000 7f12ce793700 1 -- 172.21.15.26:0/2826221004 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12c80f84c0 con 0x7f12c80f6860 2021-11-03T17:50:00.176 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.174+0000 7f12ce793700 1 -- 172.21.15.26:0/2826221004 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12c80f8a20 con 0x7f12c80f6860 2021-11-03T17:50:00.177 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.175+0000 7f12ce793700 1 -- 172.21.15.26:0/2826221004 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12c8045ad0 con 0x7f12c80f6860 2021-11-03T17:50:00.177 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.176+0000 7f12c4ff9700 1 -- 172.21.15.26:0/2826221004 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f12bc01d960 con 0x7f12c80f6860 2021-11-03T17:50:00.177 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.176+0000 7f12c4ff9700 1 --2- 172.21.15.26:0/2826221004 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f12b00640b0 0x7f12b0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:50:00.177 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.176+0000 7f12c4ff9700 1 -- 172.21.15.26:0/2826221004 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f12bc082470 con 0x7f12c80f6860 2021-11-03T17:50:00.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.176+0000 7f12c7fff700 1 --2- 172.21.15.26:0/2826221004 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f12b00640b0 0x7f12b0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:50:00.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.177+0000 7f12c7fff700 1 --2- 172.21.15.26:0/2826221004 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f12b00640b0 0x7f12b0066570 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f12c80f94b0 tx=0x7f12b8009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:50:00.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.180+0000 7f12c4ff9700 1 -- 172.21.15.26:0/2826221004 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f12bc054890 con 0x7f12c80f6860 2021-11-03T17:50:00.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.361+0000 7f12ce793700 1 -- 172.21.15.26:0/2826221004 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f12c80faca0 con 0x7f12b00640b0 2021-11-03T17:50:00.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.362+0000 7f12c4ff9700 1 -- 172.21.15.26:0/2826221004 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f12c80faca0 con 0x7f12b00640b0 2021-11-03T17:50:00.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.364+0000 7f12ce793700 1 -- 172.21.15.26:0/2826221004 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f12b00640b0 msgr2=0x7f12b0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:50:00.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.364+0000 7f12ce793700 1 --2- 172.21.15.26:0/2826221004 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f12b00640b0 0x7f12b0066570 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f12c80f94b0 tx=0x7f12b8009040).stop 2021-11-03T17:50:00.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.364+0000 7f12ce793700 1 -- 172.21.15.26:0/2826221004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12c80f6860 msgr2=0x7f12c80f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:50:00.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.364+0000 7f12ce793700 1 --2- 172.21.15.26:0/2826221004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12c80f6860 0x7f12c80f7ba0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 rx=0x7f12bc009990 tx=0x7f12bc009b30).stop 2021-11-03T17:50:00.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.364+0000 7f12ce793700 1 -- 172.21.15.26:0/2826221004 shutdown_connections 2021-11-03T17:50:00.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.364+0000 7f12ce793700 1 --2- 172.21.15.26:0/2826221004 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f12b00640b0 0x7f12b0066570 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:00.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.364+0000 7f12ce793700 1 --2- 172.21.15.26:0/2826221004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12c80f55c0 0x7f12c80f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:00.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.364+0000 7f12ce793700 1 --2- 172.21.15.26:0/2826221004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12c80f6860 0x7f12c80f7ba0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:00.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.364+0000 7f12ce793700 1 -- 172.21.15.26:0/2826221004 >> 172.21.15.26:0/2826221004 conn(0x7f12c80f0d40 msgr2=0x7f12c805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:50:00.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.364+0000 7f12ce793700 1 -- 172.21.15.26:0/2826221004 shutdown_connections 2021-11-03T17:50:00.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.364+0000 7f12ce793700 1 -- 172.21.15.26:0/2826221004 wait complete. 2021-11-03T17:50:00.369 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:50:00.420 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:00 smithi026 conmon[96772]: 2021-11-03T17:49:59.998+0000 7f27986f6700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 2 daemons have recently crashed 2021-11-03T17:50:00.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.464+0000 7f2e808cb700 1 -- 172.21.15.26:0/502153611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e7c0f5340 msgr2=0x7f2e7c0f7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:50:00.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.464+0000 7f2e808cb700 1 --2- 172.21.15.26:0/502153611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e7c0f5340 0x7f2e7c0f7ac0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7f2e70004660 tx=0x7f2e70009b30).stop 2021-11-03T17:50:00.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.465+0000 7f2e808cb700 1 -- 172.21.15.26:0/502153611 shutdown_connections 2021-11-03T17:50:00.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.465+0000 7f2e808cb700 1 --2- 172.21.15.26:0/502153611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e7c0f5340 0x7f2e7c0f7ac0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:00.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.465+0000 7f2e808cb700 1 --2- 172.21.15.26:0/502153611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e7c0f49a0 0x7f2e7c0f4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:00.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.465+0000 7f2e808cb700 1 -- 172.21.15.26:0/502153611 >> 172.21.15.26:0/502153611 conn(0x7f2e7c0f04c0 msgr2=0x7f2e7c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:50:00.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.465+0000 7f2e808cb700 1 -- 172.21.15.26:0/502153611 shutdown_connections 2021-11-03T17:50:00.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.465+0000 7f2e808cb700 1 -- 172.21.15.26:0/502153611 wait complete. 2021-11-03T17:50:00.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.465+0000 7f2e808cb700 1 Processor -- start 2021-11-03T17:50:00.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.465+0000 7f2e808cb700 1 -- start start 2021-11-03T17:50:00.464 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.465+0000 7f2e808cb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e7c0f49a0 0x7f2e7c106fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:50:00.464 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.465+0000 7f2e808cb700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e7c0f5340 0x7f2e7c107490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:50:00.464 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.465+0000 7f2e808cb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c107a40 con 0x7f2e7c0f49a0 2021-11-03T17:50:00.464 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.465+0000 7f2e808cb700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c107b80 con 0x7f2e7c0f5340 2021-11-03T17:50:00.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.465+0000 7f2e7a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e7c0f49a0 0x7f2e7c106fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:50:00.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.465+0000 7f2e7a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e7c0f49a0 0x7f2e7c106fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56620/0 (socket says 172.21.15.26:56620) 2021-11-03T17:50:00.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.465+0000 7f2e7a59c700 1 -- 172.21.15.26:0/1853640765 learned_addr learned my addr 172.21.15.26:0/1853640765 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:50:00.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.466+0000 7f2e79d9b700 1 --2- 172.21.15.26:0/1853640765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e7c0f5340 0x7f2e7c107490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:50:00.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.466+0000 7f2e7a59c700 1 -- 172.21.15.26:0/1853640765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e7c0f5340 msgr2=0x7f2e7c107490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:50:00.466 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.466+0000 7f2e7a59c700 1 --2- 172.21.15.26:0/1853640765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e7c0f5340 0x7f2e7c107490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:00.466 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.466+0000 7f2e7a59c700 1 -- 172.21.15.26:0/1853640765 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e70005040 con 0x7f2e7c0f49a0 2021-11-03T17:50:00.466 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.466+0000 7f2e79d9b700 1 --2- 172.21.15.26:0/1853640765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e7c0f5340 0x7f2e7c107490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:50:00.466 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.466+0000 7f2e7a59c700 1 --2- 172.21.15.26:0/1853640765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e7c0f49a0 0x7f2e7c106fa0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7f2e6c00c790 tx=0x7f2e6c007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:50:00.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.466+0000 7f2e6affd700 1 -- 172.21.15.26:0/1853640765 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e6c00e680 con 0x7f2e7c0f49a0 2021-11-03T17:50:00.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.466+0000 7f2e6affd700 1 -- 172.21.15.26:0/1853640765 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2e6c00ec90 con 0x7f2e7c0f49a0 2021-11-03T17:50:00.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.466+0000 7f2e6affd700 1 -- 172.21.15.26:0/1853640765 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e6c012d00 con 0x7f2e7c0f49a0 2021-11-03T17:50:00.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.466+0000 7f2e808cb700 1 -- 172.21.15.26:0/1853640765 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e7c108520 con 0x7f2e7c0f49a0 2021-11-03T17:50:00.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.466+0000 7f2e808cb700 1 -- 172.21.15.26:0/1853640765 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e7c108a90 con 0x7f2e7c0f49a0 2021-11-03T17:50:00.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.467+0000 7f2e808cb700 1 -- 172.21.15.26:0/1853640765 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e7c045ad0 con 0x7f2e7c0f49a0 2021-11-03T17:50:00.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.467+0000 7f2e6affd700 1 -- 172.21.15.26:0/1853640765 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f2e6c010070 con 0x7f2e7c0f49a0 2021-11-03T17:50:00.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.468+0000 7f2e6affd700 1 --2- 172.21.15.26:0/1853640765 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2e640640b0 0x7f2e64066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:50:00.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.468+0000 7f2e6affd700 1 -- 172.21.15.26:0/1853640765 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f2e6c080990 con 0x7f2e7c0f49a0 2021-11-03T17:50:00.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.468+0000 7f2e79d9b700 1 --2- 172.21.15.26:0/1853640765 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2e640640b0 0x7f2e64066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:50:00.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.468+0000 7f2e79d9b700 1 --2- 172.21.15.26:0/1853640765 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2e640640b0 0x7f2e64066570 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f2e70004e30 tx=0x7f2e70009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:50:00.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.472+0000 7f2e6affd700 1 -- 172.21.15.26:0/1853640765 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f2e6c052c00 con 0x7f2e7c0f49a0 2021-11-03T17:50:00.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.647+0000 7f2e808cb700 1 -- 172.21.15.26:0/1853640765 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2e7c0ff000 con 0x7f2e640640b0 2021-11-03T17:50:00.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.662+0000 7f2e6affd700 1 -- 172.21.15.26:0/1853640765 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f2e7c0ff000 con 0x7f2e640640b0 2021-11-03T17:50:00.657 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:50:00.658 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (61m) 30s ago 62m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:50:00.658 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (53m) 30s ago 62m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:50:00.658 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (53m) 9m ago 61m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:50:00.658 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (61m) 30s ago 62m 41.4M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:50:00.659 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (54m) 30s ago 57m 25.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:50:00.659 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (54m) 30s ago 57m 26.0M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:50:00.659 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (57m) 9m ago 57m 26.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:50:00.659 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (57m) 9m ago 57m 26.3M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:50:00.659 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (54m) 30s ago 63m 547M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:50:00.660 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (54m) 9m ago 61m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:50:00.660 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (54m) 30s ago 63m 242M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:50:00.660 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (54m) 9m ago 61m 103M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:50:00.660 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (62m) 30s ago 62m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:50:00.661 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (61m) 9m ago 61m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:50:00.661 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (53m) 30s ago 60m 271M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:50:00.661 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (52m) 30s ago 60m 291M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:50:00.661 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (52m) 30s ago 60m 243M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:50:00.661 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (51m) 9m ago 59m 287M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:50:00.662 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (51m) 9m ago 59m 246M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:50:00.662 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (50m) 9m ago 59m 235M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:50:00.662 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (60m) 30s ago 61m 58.9M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:50:00.663 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.663+0000 7f2e808cb700 1 -- 172.21.15.26:0/1853640765 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2e640640b0 msgr2=0x7f2e64066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:50:00.663 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.663+0000 7f2e808cb700 1 --2- 172.21.15.26:0/1853640765 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2e640640b0 0x7f2e64066570 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f2e70004e30 tx=0x7f2e70009b30).stop 2021-11-03T17:50:00.663 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.663+0000 7f2e808cb700 1 -- 172.21.15.26:0/1853640765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e7c0f49a0 msgr2=0x7f2e7c106fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:50:00.664 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.663+0000 7f2e808cb700 1 --2- 172.21.15.26:0/1853640765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e7c0f49a0 0x7f2e7c106fa0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7f2e6c00c790 tx=0x7f2e6c007d90).stop 2021-11-03T17:50:00.664 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.663+0000 7f2e808cb700 1 -- 172.21.15.26:0/1853640765 shutdown_connections 2021-11-03T17:50:00.664 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.663+0000 7f2e808cb700 1 --2- 172.21.15.26:0/1853640765 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2e640640b0 0x7f2e64066570 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:00.664 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.663+0000 7f2e808cb700 1 --2- 172.21.15.26:0/1853640765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e7c0f49a0 0x7f2e7c106fa0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:00.664 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.663+0000 7f2e808cb700 1 --2- 172.21.15.26:0/1853640765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e7c0f5340 0x7f2e7c107490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:00.665 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.664+0000 7f2e808cb700 1 -- 172.21.15.26:0/1853640765 >> 172.21.15.26:0/1853640765 conn(0x7f2e7c0f04c0 msgr2=0x7f2e7c0fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:50:00.665 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.664+0000 7f2e808cb700 1 -- 172.21.15.26:0/1853640765 shutdown_connections 2021-11-03T17:50:00.665 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.664+0000 7f2e808cb700 1 -- 172.21.15.26:0/1853640765 wait complete. 2021-11-03T17:50:00.758 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.763+0000 7fa7eb810700 1 -- 172.21.15.26:0/3928959919 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7e40f7980 msgr2=0x7fa7e40f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:50:00.758 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.763+0000 7fa7eb810700 1 --2- 172.21.15.26:0/3928959919 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7e40f7980 0x7fa7e40f7de0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7fa7d4004660 tx=0x7fa7d4009b30).stop 2021-11-03T17:50:00.759 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.763+0000 7fa7eb810700 1 -- 172.21.15.26:0/3928959919 shutdown_connections 2021-11-03T17:50:00.759 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.763+0000 7fa7eb810700 1 --2- 172.21.15.26:0/3928959919 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7e40f7980 0x7fa7e40f7de0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:00.759 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.763+0000 7fa7eb810700 1 --2- 172.21.15.26:0/3928959919 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7e40f66e0 0x7fa7e40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:00.759 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.763+0000 7fa7eb810700 1 -- 172.21.15.26:0/3928959919 >> 172.21.15.26:0/3928959919 conn(0x7fa7e40f1e40 msgr2=0x7fa7e40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:50:00.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.763+0000 7fa7eb810700 1 -- 172.21.15.26:0/3928959919 shutdown_connections 2021-11-03T17:50:00.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.763+0000 7fa7eb810700 1 -- 172.21.15.26:0/3928959919 wait complete. 2021-11-03T17:50:00.762 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.764+0000 7fa7eb810700 1 Processor -- start 2021-11-03T17:50:00.763 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.764+0000 7fa7eb810700 1 -- start start 2021-11-03T17:50:00.763 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.764+0000 7fa7eb810700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7e40f66e0 0x7fa7e4106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:50:00.763 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.764+0000 7fa7eb810700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7e40f7980 0x7fa7e4107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:50:00.763 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.764+0000 7fa7eb810700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e4107a00 con 0x7fa7e40f7980 2021-11-03T17:50:00.764 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.764+0000 7fa7eb810700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e4107b40 con 0x7fa7e40f66e0 2021-11-03T17:50:00.764 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.764+0000 7fa7e8dab700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7e40f7980 0x7fa7e4107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:50:00.764 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.764+0000 7fa7e8dab700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7e40f7980 0x7fa7e4107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56632/0 (socket says 172.21.15.26:56632) 2021-11-03T17:50:00.764 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.764+0000 7fa7e8dab700 1 -- 172.21.15.26:0/2524813947 learned_addr learned my addr 172.21.15.26:0/2524813947 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:50:00.764 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.764+0000 7fa7e95ac700 1 --2- 172.21.15.26:0/2524813947 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7e40f66e0 0x7fa7e4106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:50:00.765 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.764+0000 7fa7e8dab700 1 -- 172.21.15.26:0/2524813947 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7e40f66e0 msgr2=0x7fa7e4106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:50:00.765 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.764+0000 7fa7e8dab700 1 --2- 172.21.15.26:0/2524813947 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7e40f66e0 0x7fa7e4106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:00.765 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.764+0000 7fa7e8dab700 1 -- 172.21.15.26:0/2524813947 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d4005040 con 0x7fa7e40f7980 2021-11-03T17:50:00.765 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.764+0000 7fa7e8dab700 1 --2- 172.21.15.26:0/2524813947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7e40f7980 0x7fa7e4107450 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7fa7d4009990 tx=0x7fa7d4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:50:00.766 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.764+0000 7fa7d9ffb700 1 -- 172.21.15.26:0/2524813947 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7d4018070 con 0x7fa7e40f7980 2021-11-03T17:50:00.766 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.765+0000 7fa7d9ffb700 1 -- 172.21.15.26:0/2524813947 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa7d4007ca0 con 0x7fa7e40f7980 2021-11-03T17:50:00.766 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.765+0000 7fa7eb810700 1 -- 172.21.15.26:0/2524813947 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e4108480 con 0x7fa7e40f7980 2021-11-03T17:50:00.766 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.765+0000 7fa7d9ffb700 1 -- 172.21.15.26:0/2524813947 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7d401c620 con 0x7fa7e40f7980 2021-11-03T17:50:00.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.765+0000 7fa7eb810700 1 -- 172.21.15.26:0/2524813947 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e41089e0 con 0x7fa7e40f7980 2021-11-03T17:50:00.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.766+0000 7fa7eb810700 1 -- 172.21.15.26:0/2524813947 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e4045ad0 con 0x7fa7e40f7980 2021-11-03T17:50:00.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.766+0000 7fa7d9ffb700 1 -- 172.21.15.26:0/2524813947 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fa7d401d960 con 0x7fa7e40f7980 2021-11-03T17:50:00.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.766+0000 7fa7d9ffb700 1 --2- 172.21.15.26:0/2524813947 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa7d00640b0 0x7fa7d0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:50:00.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.767+0000 7fa7d9ffb700 1 -- 172.21.15.26:0/2524813947 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fa7d4082480 con 0x7fa7e40f7980 2021-11-03T17:50:00.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.767+0000 7fa7e95ac700 1 --2- 172.21.15.26:0/2524813947 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa7d00640b0 0x7fa7d0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:50:00.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.767+0000 7fa7e95ac700 1 --2- 172.21.15.26:0/2524813947 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa7d00640b0 0x7fa7d0066570 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7fa7e40f77e0 tx=0x7fa7dc009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:50:00.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:00.770+0000 7fa7d9ffb700 1 -- 172.21.15.26:0/2524813947 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fa7d40548a0 con 0x7fa7e40f7980 2021-11-03T17:50:00.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:00 smithi026 ceph-mon[96795]: pgmap v1660: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:00.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:00 smithi026 ceph-mon[96795]: overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 2 daemons have recently crashed 2021-11-03T17:50:00.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.000+0000 7fa7eb810700 1 -- 172.21.15.26:0/2524813947 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa7e4027a00 con 0x7fa7e40f7980 2021-11-03T17:50:00.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.000+0000 7fa7d9ffb700 1 -- 172.21.15.26:0/2524813947 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fa7d4054490 con 0x7fa7e40f7980 2021-11-03T17:50:00.996 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:50:00.997 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:50:00.997 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:50:00.997 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:50:00.998 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:50:00.998 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:50:00.998 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:50:00.998 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:50:00.999 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:50:00.999 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:50:00.999 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:50:00.999 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:50:01.000 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:50:01.000 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:50:01.000 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:50:01.000 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:50:01.001 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:50:01.001 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:50:01.002 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:00 smithi194 ceph-mon[65619]: pgmap v1660: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:01.002 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:00 smithi194 ceph-mon[65619]: overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 2 daemons have recently crashed 2021-11-03T17:50:01.003 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.002+0000 7fa7eb810700 1 -- 172.21.15.26:0/2524813947 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa7d00640b0 msgr2=0x7fa7d0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:50:01.003 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.002+0000 7fa7eb810700 1 --2- 172.21.15.26:0/2524813947 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa7d00640b0 0x7fa7d0066570 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7fa7e40f77e0 tx=0x7fa7dc009040).stop 2021-11-03T17:50:01.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.002+0000 7fa7eb810700 1 -- 172.21.15.26:0/2524813947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7e40f7980 msgr2=0x7fa7e4107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:50:01.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.002+0000 7fa7eb810700 1 --2- 172.21.15.26:0/2524813947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7e40f7980 0x7fa7e4107450 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7fa7d4009990 tx=0x7fa7d4009b30).stop 2021-11-03T17:50:01.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.002+0000 7fa7eb810700 1 -- 172.21.15.26:0/2524813947 shutdown_connections 2021-11-03T17:50:01.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.002+0000 7fa7eb810700 1 --2- 172.21.15.26:0/2524813947 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa7d00640b0 0x7fa7d0066570 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:01.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.002+0000 7fa7eb810700 1 --2- 172.21.15.26:0/2524813947 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7e40f66e0 0x7fa7e4106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:01.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.002+0000 7fa7eb810700 1 --2- 172.21.15.26:0/2524813947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7e40f7980 0x7fa7e4107450 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:01.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.002+0000 7fa7eb810700 1 -- 172.21.15.26:0/2524813947 >> 172.21.15.26:0/2524813947 conn(0x7fa7e40f1e40 msgr2=0x7fa7e40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:50:01.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.002+0000 7fa7eb810700 1 -- 172.21.15.26:0/2524813947 shutdown_connections 2021-11-03T17:50:01.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.002+0000 7fa7eb810700 1 -- 172.21.15.26:0/2524813947 wait complete. 2021-11-03T17:50:01.100 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.103+0000 7efd46f25700 1 -- 172.21.15.26:0/3293712134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd400f6540 msgr2=0x7efd400f69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:50:01.100 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.103+0000 7efd46f25700 1 --2- 172.21.15.26:0/3293712134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd400f6540 0x7efd400f69c0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7efd2c004660 tx=0x7efd2c009b30).stop 2021-11-03T17:50:01.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.103+0000 7efd46f25700 1 -- 172.21.15.26:0/3293712134 shutdown_connections 2021-11-03T17:50:01.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.103+0000 7efd46f25700 1 --2- 172.21.15.26:0/3293712134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd400f6540 0x7efd400f69c0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:01.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.103+0000 7efd46f25700 1 --2- 172.21.15.26:0/3293712134 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd400f5c30 0x7efd400f6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:01.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.103+0000 7efd46f25700 1 -- 172.21.15.26:0/3293712134 >> 172.21.15.26:0/3293712134 conn(0x7efd400f0540 msgr2=0x7efd400f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:50:01.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.103+0000 7efd46f25700 1 -- 172.21.15.26:0/3293712134 shutdown_connections 2021-11-03T17:50:01.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.103+0000 7efd46f25700 1 -- 172.21.15.26:0/3293712134 wait complete. 2021-11-03T17:50:01.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.103+0000 7efd46f25700 1 Processor -- start 2021-11-03T17:50:01.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.103+0000 7efd46f25700 1 -- start start 2021-11-03T17:50:01.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.104+0000 7efd46f25700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd400f5c30 0x7efd40109c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:50:01.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.104+0000 7efd46f25700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd400f6540 0x7efd4010c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:50:01.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.104+0000 7efd46f25700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd400f5700 con 0x7efd400f6540 2021-11-03T17:50:01.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.104+0000 7efd46f25700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd400f5840 con 0x7efd400f5c30 2021-11-03T17:50:01.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.104+0000 7efd3ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd400f6540 0x7efd4010c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:50:01.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.104+0000 7efd3ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd400f6540 0x7efd4010c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56642/0 (socket says 172.21.15.26:56642) 2021-11-03T17:50:01.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.104+0000 7efd3ffff700 1 -- 172.21.15.26:0/1969461371 learned_addr learned my addr 172.21.15.26:0/1969461371 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:50:01.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.104+0000 7efd44cc1700 1 --2- 172.21.15.26:0/1969461371 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd400f5c30 0x7efd40109c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:50:01.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.104+0000 7efd3ffff700 1 -- 172.21.15.26:0/1969461371 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd400f5c30 msgr2=0x7efd40109c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:50:01.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.104+0000 7efd3ffff700 1 --2- 172.21.15.26:0/1969461371 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd400f5c30 0x7efd40109c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:01.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.104+0000 7efd3ffff700 1 -- 172.21.15.26:0/1969461371 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd2c005040 con 0x7efd400f6540 2021-11-03T17:50:01.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.104+0000 7efd44cc1700 1 --2- 172.21.15.26:0/1969461371 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd400f5c30 0x7efd40109c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:50:01.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.104+0000 7efd3ffff700 1 --2- 172.21.15.26:0/1969461371 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd400f6540 0x7efd4010c140 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7efd2c009990 tx=0x7efd2c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:50:01.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.104+0000 7efd3d7fa700 1 -- 172.21.15.26:0/1969461371 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd2c018070 con 0x7efd400f6540 2021-11-03T17:50:01.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.104+0000 7efd3d7fa700 1 -- 172.21.15.26:0/1969461371 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efd2c007ba0 con 0x7efd400f6540 2021-11-03T17:50:01.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.105+0000 7efd46f25700 1 -- 172.21.15.26:0/1969461371 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd4010c690 con 0x7efd400f6540 2021-11-03T17:50:01.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.105+0000 7efd3d7fa700 1 -- 172.21.15.26:0/1969461371 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd2c01c3c0 con 0x7efd400f6540 2021-11-03T17:50:01.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.105+0000 7efd46f25700 1 -- 172.21.15.26:0/1969461371 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd4010cbc0 con 0x7efd400f6540 2021-11-03T17:50:01.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.105+0000 7efd46f25700 1 -- 172.21.15.26:0/1969461371 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd40045ad0 con 0x7efd400f6540 2021-11-03T17:50:01.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.106+0000 7efd3d7fa700 1 -- 172.21.15.26:0/1969461371 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7efd2c01d420 con 0x7efd400f6540 2021-11-03T17:50:01.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.106+0000 7efd3d7fa700 1 --2- 172.21.15.26:0/1969461371 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efd300640b0 0x7efd30066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:50:01.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.106+0000 7efd3d7fa700 1 -- 172.21.15.26:0/1969461371 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7efd2c0824f0 con 0x7efd400f6540 2021-11-03T17:50:01.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.107+0000 7efd44cc1700 1 --2- 172.21.15.26:0/1969461371 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efd300640b0 0x7efd30066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:50:01.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.107+0000 7efd44cc1700 1 --2- 172.21.15.26:0/1969461371 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efd300640b0 0x7efd30066570 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7efd400f5380 tx=0x7efd34009c00).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:50:01.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.111+0000 7efd3d7fa700 1 -- 172.21.15.26:0/1969461371 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7efd2c054850 con 0x7efd400f6540 2021-11-03T17:50:01.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.313+0000 7efd46f25700 1 -- 172.21.15.26:0/1969461371 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7efd400fdeb0 con 0x7efd400f6540 2021-11-03T17:50:01.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.314+0000 7efd3d7fa700 1 -- 172.21.15.26:0/1969461371 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7efd2c054440 con 0x7efd400f6540 2021-11-03T17:50:01.309 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:50:01.310 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:50:01.310 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:50:01.310 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:50:01.310 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:50:01.311 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:50:01.311 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:50:01.311 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:50:01.311 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:50:01.312 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:50:01.312 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:50:01.312 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:50:01.313 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:50:01.313 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:50:01.313 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:50:01.313 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:50:01.313 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:50:01.314 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:50:01.314 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:50:01.314 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:50:01.315 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:50:01.315 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:50:01.315 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:50:01.315 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:50:01.315 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:50:01.316 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:50:01.316 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:50:01.316 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:50:01.316 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:50:01.317 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:50:01.317 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:50:01.317 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:50:01.317 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:50:01.318 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:50:01.318 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:50:01.318 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:50:01.319 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:50:01.319 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:50:01.319 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:50:01.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.316+0000 7efd46f25700 1 -- 172.21.15.26:0/1969461371 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efd300640b0 msgr2=0x7efd30066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:50:01.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.316+0000 7efd46f25700 1 --2- 172.21.15.26:0/1969461371 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efd300640b0 0x7efd30066570 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7efd400f5380 tx=0x7efd34009c00).stop 2021-11-03T17:50:01.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.316+0000 7efd46f25700 1 -- 172.21.15.26:0/1969461371 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd400f6540 msgr2=0x7efd4010c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:50:01.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.316+0000 7efd46f25700 1 --2- 172.21.15.26:0/1969461371 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd400f6540 0x7efd4010c140 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7efd2c009990 tx=0x7efd2c009b30).stop 2021-11-03T17:50:01.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.316+0000 7efd46f25700 1 -- 172.21.15.26:0/1969461371 shutdown_connections 2021-11-03T17:50:01.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.316+0000 7efd46f25700 1 --2- 172.21.15.26:0/1969461371 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efd300640b0 0x7efd30066570 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:01.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.316+0000 7efd46f25700 1 --2- 172.21.15.26:0/1969461371 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd400f5c30 0x7efd40109c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:01.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.316+0000 7efd46f25700 1 --2- 172.21.15.26:0/1969461371 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd400f6540 0x7efd4010c140 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:01.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.316+0000 7efd46f25700 1 -- 172.21.15.26:0/1969461371 >> 172.21.15.26:0/1969461371 conn(0x7efd400f0540 msgr2=0x7efd400fa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:50:01.323 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.316+0000 7efd46f25700 1 -- 172.21.15.26:0/1969461371 shutdown_connections 2021-11-03T17:50:01.323 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:01.316+0000 7efd46f25700 1 -- 172.21.15.26:0/1969461371 wait complete. 2021-11-03T17:50:01.323 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:50:01.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:01 smithi026 ceph-mon[96795]: from='client.35852 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:50:01.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:01 smithi026 ceph-mon[96795]: from='client.35856 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:50:01.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:01 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:50:01.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:01 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2524813947' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:50:01.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:01 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1969461371' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:50:01.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:01 smithi194 ceph-mon[65619]: from='client.35852 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:50:01.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:01 smithi194 ceph-mon[65619]: from='client.35856 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:50:01.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:01 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:50:01.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:01 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2524813947' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:50:01.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:01 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1969461371' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:50:02.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:02 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:50:02.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:02 smithi026 ceph-mon[96795]: pgmap v1661: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:02.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:02 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:50:02.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:02 smithi194 ceph-mon[65619]: pgmap v1661: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:04.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:04 smithi026 ceph-mon[96795]: pgmap v1662: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:04.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:04 smithi194 ceph-mon[65619]: pgmap v1662: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:06.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:06 smithi026 ceph-mon[96795]: pgmap v1663: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:06.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:06 smithi194 ceph-mon[65619]: pgmap v1663: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:08.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:08 smithi026 ceph-mon[96795]: pgmap v1664: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:08.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:08 smithi194 ceph-mon[65619]: pgmap v1664: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:10.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:10 smithi026 ceph-mon[96795]: pgmap v1665: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:10.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:10 smithi194 ceph-mon[65619]: pgmap v1665: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:12.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:12 smithi026 ceph-mon[96795]: pgmap v1666: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:12.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:12 smithi194 ceph-mon[65619]: pgmap v1666: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:14.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:14 smithi026 ceph-mon[96795]: pgmap v1667: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:14.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:14 smithi194 ceph-mon[65619]: pgmap v1667: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:16.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:16 smithi026 ceph-mon[96795]: pgmap v1668: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:16.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:16 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:50:16.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:16 smithi194 ceph-mon[65619]: pgmap v1668: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:16.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:16 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:50:17.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:17 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:50:17.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:17 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:50:18.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:18 smithi026 ceph-mon[96795]: pgmap v1669: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:18.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:18 smithi194 ceph-mon[65619]: pgmap v1669: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:20.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:20 smithi026 ceph-mon[96795]: pgmap v1670: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:20.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:20 smithi194 ceph-mon[65619]: pgmap v1670: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:22.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:22 smithi026 ceph-mon[96795]: pgmap v1671: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:22.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:22 smithi194 ceph-mon[65619]: pgmap v1671: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:24.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:24 smithi026 ceph-mon[96795]: pgmap v1672: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:24.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:24 smithi194 ceph-mon[65619]: pgmap v1672: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:26.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:26 smithi026 ceph-mon[96795]: pgmap v1673: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:26.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:26 smithi194 ceph-mon[65619]: pgmap v1673: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:28.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:28 smithi026 ceph-mon[96795]: pgmap v1674: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:28.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:28 smithi194 ceph-mon[65619]: pgmap v1674: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:30.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:30 smithi026 ceph-mon[96795]: pgmap v1675: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:30.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:30 smithi194 ceph-mon[65619]: pgmap v1675: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:31.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.421+0000 7fdb6b3c2700 1 -- 172.21.15.26:0/2340638884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb640f66e0 msgr2=0x7fdb640f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:50:31.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.421+0000 7fdb6b3c2700 1 --2- 172.21.15.26:0/2340638884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb640f66e0 0x7fdb640f6b00 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7fdb5c0099e0 tx=0x7fdb5c004d10).stop 2021-11-03T17:50:31.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.421+0000 7fdb6b3c2700 1 -- 172.21.15.26:0/2340638884 shutdown_connections 2021-11-03T17:50:31.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.421+0000 7fdb6b3c2700 1 --2- 172.21.15.26:0/2340638884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb640f7980 0x7fdb640f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:31.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.421+0000 7fdb6b3c2700 1 --2- 172.21.15.26:0/2340638884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb640f66e0 0x7fdb640f6b00 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:31.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.421+0000 7fdb6b3c2700 1 -- 172.21.15.26:0/2340638884 >> 172.21.15.26:0/2340638884 conn(0x7fdb640f1e40 msgr2=0x7fdb640f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:50:31.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.421+0000 7fdb6b3c2700 1 -- 172.21.15.26:0/2340638884 shutdown_connections 2021-11-03T17:50:31.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.421+0000 7fdb6b3c2700 1 -- 172.21.15.26:0/2340638884 wait complete. 2021-11-03T17:50:31.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.422+0000 7fdb6b3c2700 1 Processor -- start 2021-11-03T17:50:31.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.422+0000 7fdb6b3c2700 1 -- start start 2021-11-03T17:50:31.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.422+0000 7fdb6b3c2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb640f66e0 0x7fdb64107060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:50:31.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.422+0000 7fdb6b3c2700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb640f7980 0x7fdb64107550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:50:31.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.422+0000 7fdb6b3c2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb64107b00 con 0x7fdb640f66e0 2021-11-03T17:50:31.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.422+0000 7fdb6b3c2700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb64107c40 con 0x7fdb640f7980 2021-11-03T17:50:31.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.422+0000 7fdb6915e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb640f66e0 0x7fdb64107060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:50:31.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.422+0000 7fdb6915e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb640f66e0 0x7fdb64107060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56658/0 (socket says 172.21.15.26:56658) 2021-11-03T17:50:31.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.422+0000 7fdb6915e700 1 -- 172.21.15.26:0/1092142524 learned_addr learned my addr 172.21.15.26:0/1092142524 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:50:31.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.422+0000 7fdb6895d700 1 --2- 172.21.15.26:0/1092142524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb640f7980 0x7fdb64107550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:50:31.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.422+0000 7fdb6915e700 1 -- 172.21.15.26:0/1092142524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb640f7980 msgr2=0x7fdb64107550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:50:31.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.422+0000 7fdb6915e700 1 --2- 172.21.15.26:0/1092142524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb640f7980 0x7fdb64107550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:31.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.422+0000 7fdb6915e700 1 -- 172.21.15.26:0/1092142524 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb5c009640 con 0x7fdb640f66e0 2021-11-03T17:50:31.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.422+0000 7fdb6915e700 1 --2- 172.21.15.26:0/1092142524 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb640f66e0 0x7fdb64107060 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7fdb5c00c010 tx=0x7fdb5c004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:50:31.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.423+0000 7fdb61ffb700 1 -- 172.21.15.26:0/1092142524 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb5c00e070 con 0x7fdb640f66e0 2021-11-03T17:50:31.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.423+0000 7fdb61ffb700 1 -- 172.21.15.26:0/1092142524 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdb5c007d10 con 0x7fdb640f66e0 2021-11-03T17:50:31.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.423+0000 7fdb6b3c2700 1 -- 172.21.15.26:0/1092142524 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb64108580 con 0x7fdb640f66e0 2021-11-03T17:50:31.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.423+0000 7fdb61ffb700 1 -- 172.21.15.26:0/1092142524 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb5c018070 con 0x7fdb640f66e0 2021-11-03T17:50:31.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.423+0000 7fdb6b3c2700 1 -- 172.21.15.26:0/1092142524 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb64108a60 con 0x7fdb640f66e0 2021-11-03T17:50:31.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.424+0000 7fdb6b3c2700 1 -- 172.21.15.26:0/1092142524 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb64045ad0 con 0x7fdb640f66e0 2021-11-03T17:50:31.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.424+0000 7fdb61ffb700 1 -- 172.21.15.26:0/1092142524 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fdb5c024060 con 0x7fdb640f66e0 2021-11-03T17:50:31.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.425+0000 7fdb61ffb700 1 --2- 172.21.15.26:0/1092142524 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdb4c0640b0 0x7fdb4c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:50:31.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.425+0000 7fdb61ffb700 1 -- 172.21.15.26:0/1092142524 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fdb5c081e70 con 0x7fdb640f66e0 2021-11-03T17:50:31.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.425+0000 7fdb6895d700 1 --2- 172.21.15.26:0/1092142524 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdb4c0640b0 0x7fdb4c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:50:31.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.425+0000 7fdb6895d700 1 --2- 172.21.15.26:0/1092142524 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdb4c0640b0 0x7fdb4c066570 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7fdb58004ce0 tx=0x7fdb5800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:50:31.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.429+0000 7fdb61ffb700 1 -- 172.21.15.26:0/1092142524 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fdb5c054290 con 0x7fdb640f66e0 2021-11-03T17:50:31.602 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.608+0000 7fdb6b3c2700 1 -- 172.21.15.26:0/1092142524 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdb640fefb0 con 0x7fdb4c0640b0 2021-11-03T17:50:31.603 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.609+0000 7fdb61ffb700 1 -- 172.21.15.26:0/1092142524 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fdb640fefb0 con 0x7fdb4c0640b0 2021-11-03T17:50:31.605 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.611+0000 7fdb6b3c2700 1 -- 172.21.15.26:0/1092142524 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdb4c0640b0 msgr2=0x7fdb4c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:50:31.605 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.611+0000 7fdb6b3c2700 1 --2- 172.21.15.26:0/1092142524 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdb4c0640b0 0x7fdb4c066570 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7fdb58004ce0 tx=0x7fdb5800b040).stop 2021-11-03T17:50:31.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.611+0000 7fdb6b3c2700 1 -- 172.21.15.26:0/1092142524 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb640f66e0 msgr2=0x7fdb64107060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:50:31.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.611+0000 7fdb6b3c2700 1 --2- 172.21.15.26:0/1092142524 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb640f66e0 0x7fdb64107060 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7fdb5c00c010 tx=0x7fdb5c004d10).stop 2021-11-03T17:50:31.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.611+0000 7fdb6b3c2700 1 -- 172.21.15.26:0/1092142524 shutdown_connections 2021-11-03T17:50:31.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.611+0000 7fdb6b3c2700 1 --2- 172.21.15.26:0/1092142524 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdb4c0640b0 0x7fdb4c066570 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:31.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.611+0000 7fdb6b3c2700 1 --2- 172.21.15.26:0/1092142524 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb640f66e0 0x7fdb64107060 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:31.607 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.611+0000 7fdb6b3c2700 1 --2- 172.21.15.26:0/1092142524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb640f7980 0x7fdb64107550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:31.607 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.611+0000 7fdb6b3c2700 1 -- 172.21.15.26:0/1092142524 >> 172.21.15.26:0/1092142524 conn(0x7fdb640f1e40 msgr2=0x7fdb640fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:50:31.607 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.611+0000 7fdb6b3c2700 1 -- 172.21.15.26:0/1092142524 shutdown_connections 2021-11-03T17:50:31.607 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.611+0000 7fdb6b3c2700 1 -- 172.21.15.26:0/1092142524 wait complete. 2021-11-03T17:50:31.615 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:50:31.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.713+0000 7f59981bb700 1 -- 172.21.15.26:0/3177985762 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59900f55c0 msgr2=0x7f59900f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:50:31.710 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.713+0000 7f59981bb700 1 --2- 172.21.15.26:0/3177985762 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59900f55c0 0x7f59900f59e0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7f59880099e0 tx=0x7f5988004d10).stop 2021-11-03T17:50:31.710 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.713+0000 7f59981bb700 1 -- 172.21.15.26:0/3177985762 shutdown_connections 2021-11-03T17:50:31.710 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.713+0000 7f59981bb700 1 --2- 172.21.15.26:0/3177985762 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59900f5ed0 0x7f59900f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:31.710 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.713+0000 7f59981bb700 1 --2- 172.21.15.26:0/3177985762 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59900f55c0 0x7f59900f59e0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:31.711 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.713+0000 7f59981bb700 1 -- 172.21.15.26:0/3177985762 >> 172.21.15.26:0/3177985762 conn(0x7f59900f0de0 msgr2=0x7f59900f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:50:31.711 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.713+0000 7f59981bb700 1 -- 172.21.15.26:0/3177985762 shutdown_connections 2021-11-03T17:50:31.711 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.713+0000 7f59981bb700 1 -- 172.21.15.26:0/3177985762 wait complete. 2021-11-03T17:50:31.711 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.714+0000 7f59981bb700 1 Processor -- start 2021-11-03T17:50:31.711 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.714+0000 7f59981bb700 1 -- start start 2021-11-03T17:50:31.712 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.714+0000 7f59981bb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59900f55c0 0x7f5990109d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:50:31.712 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.714+0000 7f59981bb700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59900f5ed0 0x7f599010c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:50:31.712 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.714+0000 7f59981bb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5990060500 con 0x7f59900f55c0 2021-11-03T17:50:31.712 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.714+0000 7f59981bb700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5990060640 con 0x7f59900f5ed0 2021-11-03T17:50:31.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.714+0000 7f5995f57700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59900f55c0 0x7f5990109d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:50:31.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.714+0000 7f5995f57700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59900f55c0 0x7f5990109d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56668/0 (socket says 172.21.15.26:56668) 2021-11-03T17:50:31.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.714+0000 7f5995f57700 1 -- 172.21.15.26:0/3918896866 learned_addr learned my addr 172.21.15.26:0/3918896866 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:50:31.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.714+0000 7f5995756700 1 --2- 172.21.15.26:0/3918896866 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59900f5ed0 0x7f599010c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:50:31.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.714+0000 7f5995f57700 1 -- 172.21.15.26:0/3918896866 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59900f5ed0 msgr2=0x7f599010c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:50:31.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.714+0000 7f5995f57700 1 --2- 172.21.15.26:0/3918896866 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59900f5ed0 0x7f599010c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:31.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.714+0000 7f5995f57700 1 -- 172.21.15.26:0/3918896866 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5988009640 con 0x7f59900f55c0 2021-11-03T17:50:31.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.714+0000 7f5995f57700 1 --2- 172.21.15.26:0/3918896866 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59900f55c0 0x7f5990109d00 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7f5988003380 tx=0x7f5988004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:50:31.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.715+0000 7f598e7fc700 1 -- 172.21.15.26:0/3918896866 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f598800e070 con 0x7f59900f55c0 2021-11-03T17:50:31.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.715+0000 7f598e7fc700 1 -- 172.21.15.26:0/3918896866 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5988007d10 con 0x7f59900f55c0 2021-11-03T17:50:31.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.715+0000 7f59981bb700 1 -- 172.21.15.26:0/3918896866 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f599010c7b0 con 0x7f59900f55c0 2021-11-03T17:50:31.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.715+0000 7f598e7fc700 1 -- 172.21.15.26:0/3918896866 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5988018070 con 0x7f59900f55c0 2021-11-03T17:50:31.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.715+0000 7f59981bb700 1 -- 172.21.15.26:0/3918896866 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f599010cce0 con 0x7f59900f55c0 2021-11-03T17:50:31.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.715+0000 7f59981bb700 1 -- 172.21.15.26:0/3918896866 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5990045ad0 con 0x7f59900f55c0 2021-11-03T17:50:31.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.716+0000 7f598e7fc700 1 -- 172.21.15.26:0/3918896866 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f5988013420 con 0x7f59900f55c0 2021-11-03T17:50:31.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.716+0000 7f598e7fc700 1 --2- 172.21.15.26:0/3918896866 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f59780640b0 0x7f5978066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:50:31.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.716+0000 7f598e7fc700 1 -- 172.21.15.26:0/3918896866 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f5988081ff0 con 0x7f59900f55c0 2021-11-03T17:50:31.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.716+0000 7f5995756700 1 --2- 172.21.15.26:0/3918896866 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f59780640b0 0x7f5978066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:50:31.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.717+0000 7f5995756700 1 --2- 172.21.15.26:0/3918896866 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f59780640b0 0x7f5978066570 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f5984009fd0 tx=0x7f598400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:50:31.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.721+0000 7f598e7fc700 1 -- 172.21.15.26:0/3918896866 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f5988054350 con 0x7f59900f55c0 2021-11-03T17:50:31.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.893+0000 7f59981bb700 1 -- 172.21.15.26:0/3918896866 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f59900fde90 con 0x7f59780640b0 2021-11-03T17:50:31.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.907+0000 7f598e7fc700 1 -- 172.21.15.26:0/3918896866 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f59900fde90 con 0x7f59780640b0 2021-11-03T17:50:31.902 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:50:31.902 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (61m) 61s ago 63m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:50:31.903 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (53m) 61s ago 62m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:50:31.903 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (53m) 10m ago 62m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:50:31.903 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (61m) 61s ago 62m 41.4M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:50:31.903 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (54m) 61s ago 58m 25.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:50:31.904 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (55m) 61s ago 58m 26.0M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:50:31.904 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (58m) 10m ago 58m 26.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:50:31.904 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (58m) 10m ago 58m 26.3M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:50:31.904 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (55m) 61s ago 64m 547M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:50:31.904 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (55m) 10m ago 62m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:50:31.905 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (54m) 61s ago 64m 242M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:50:31.905 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (54m) 10m ago 62m 103M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:50:31.905 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (62m) 61s ago 62m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:50:31.905 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (61m) 10m ago 61m 18.5M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:50:31.906 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (53m) 61s ago 61m 271M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:50:31.906 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (53m) 61s ago 61m 291M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:50:31.906 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (52m) 61s ago 60m 243M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:50:31.906 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (52m) 10m ago 60m 287M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:50:31.907 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (51m) 10m ago 60m 246M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:50:31.907 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (51m) 10m ago 59m 235M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:50:31.907 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (61m) 61s ago 62m 58.9M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:50:31.908 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.909+0000 7f59981bb700 1 -- 172.21.15.26:0/3918896866 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f59780640b0 msgr2=0x7f5978066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:50:31.908 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.909+0000 7f59981bb700 1 --2- 172.21.15.26:0/3918896866 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f59780640b0 0x7f5978066570 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f5984009fd0 tx=0x7f598400b040).stop 2021-11-03T17:50:31.909 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.909+0000 7f59981bb700 1 -- 172.21.15.26:0/3918896866 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59900f55c0 msgr2=0x7f5990109d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:50:31.909 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.909+0000 7f59981bb700 1 --2- 172.21.15.26:0/3918896866 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59900f55c0 0x7f5990109d00 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7f5988003380 tx=0x7f5988004d10).stop 2021-11-03T17:50:31.909 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.909+0000 7f59981bb700 1 -- 172.21.15.26:0/3918896866 shutdown_connections 2021-11-03T17:50:31.909 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.909+0000 7f59981bb700 1 --2- 172.21.15.26:0/3918896866 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f59780640b0 0x7f5978066570 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:31.910 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.909+0000 7f59981bb700 1 --2- 172.21.15.26:0/3918896866 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59900f55c0 0x7f5990109d00 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:31.910 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.909+0000 7f59981bb700 1 --2- 172.21.15.26:0/3918896866 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59900f5ed0 0x7f599010c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:31.910 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.909+0000 7f59981bb700 1 -- 172.21.15.26:0/3918896866 >> 172.21.15.26:0/3918896866 conn(0x7f59900f0de0 msgr2=0x7f59900fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:50:31.910 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.909+0000 7f59981bb700 1 -- 172.21.15.26:0/3918896866 shutdown_connections 2021-11-03T17:50:31.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:31.909+0000 7f59981bb700 1 -- 172.21.15.26:0/3918896866 wait complete. 2021-11-03T17:50:31.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:31 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:50:31.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:31 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:50:32.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.008+0000 7effba0a5700 1 -- 172.21.15.26:0/4179822852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb40f66e0 msgr2=0x7effb40f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:50:32.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.008+0000 7effba0a5700 1 --2- 172.21.15.26:0/4179822852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb40f66e0 0x7effb40f6b40 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7effa4004660 tx=0x7effa4009b30).stop 2021-11-03T17:50:32.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.008+0000 7effba0a5700 1 -- 172.21.15.26:0/4179822852 shutdown_connections 2021-11-03T17:50:32.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.008+0000 7effba0a5700 1 --2- 172.21.15.26:0/4179822852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb40f66e0 0x7effb40f6b40 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:32.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.008+0000 7effba0a5700 1 --2- 172.21.15.26:0/4179822852 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effb40f5440 0x7effb40f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:32.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.008+0000 7effba0a5700 1 -- 172.21.15.26:0/4179822852 >> 172.21.15.26:0/4179822852 conn(0x7effb40f0ba0 msgr2=0x7effb40f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:50:32.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.008+0000 7effba0a5700 1 -- 172.21.15.26:0/4179822852 shutdown_connections 2021-11-03T17:50:32.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.009+0000 7effba0a5700 1 -- 172.21.15.26:0/4179822852 wait complete. 2021-11-03T17:50:32.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.009+0000 7effba0a5700 1 Processor -- start 2021-11-03T17:50:32.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.009+0000 7effba0a5700 1 -- start start 2021-11-03T17:50:32.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.009+0000 7effba0a5700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effb40f5440 0x7effb40fd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:50:32.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.009+0000 7effba0a5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb40f66e0 0x7effb40fba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:50:32.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.009+0000 7effba0a5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb40fbfa0 con 0x7effb40f66e0 2021-11-03T17:50:32.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.009+0000 7effba0a5700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb40fc0e0 con 0x7effb40f5440 2021-11-03T17:50:32.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.009+0000 7effb88a2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb40f66e0 0x7effb40fba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:50:32.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.009+0000 7effb88a2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb40f66e0 0x7effb40fba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56680/0 (socket says 172.21.15.26:56680) 2021-11-03T17:50:32.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.009+0000 7effb88a2700 1 -- 172.21.15.26:0/1581318526 learned_addr learned my addr 172.21.15.26:0/1581318526 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:50:32.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.009+0000 7effb90a3700 1 --2- 172.21.15.26:0/1581318526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effb40f5440 0x7effb40fd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:50:32.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.010+0000 7effb88a2700 1 -- 172.21.15.26:0/1581318526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effb40f5440 msgr2=0x7effb40fd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:50:32.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.010+0000 7effb88a2700 1 --2- 172.21.15.26:0/1581318526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effb40f5440 0x7effb40fd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:32.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.010+0000 7effb88a2700 1 -- 172.21.15.26:0/1581318526 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa4005040 con 0x7effb40f66e0 2021-11-03T17:50:32.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.010+0000 7effb88a2700 1 --2- 172.21.15.26:0/1581318526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb40f66e0 0x7effb40fba40 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7effa4000c00 tx=0x7effa400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:50:32.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.010+0000 7effa9ffb700 1 -- 172.21.15.26:0/1581318526 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effa4019070 con 0x7effb40f66e0 2021-11-03T17:50:32.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.010+0000 7effa9ffb700 1 -- 172.21.15.26:0/1581318526 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7effa4007e70 con 0x7effb40f66e0 2021-11-03T17:50:32.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.010+0000 7effba0a5700 1 -- 172.21.15.26:0/1581318526 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb40fc360 con 0x7effb40f66e0 2021-11-03T17:50:32.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.010+0000 7effa9ffb700 1 -- 172.21.15.26:0/1581318526 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effa4014ce0 con 0x7effb40f66e0 2021-11-03T17:50:32.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.010+0000 7effba0a5700 1 -- 172.21.15.26:0/1581318526 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb40fc8c0 con 0x7effb40f66e0 2021-11-03T17:50:32.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.012+0000 7effa9ffb700 1 -- 172.21.15.26:0/1581318526 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7effa4025070 con 0x7effb40f66e0 2021-11-03T17:50:32.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.012+0000 7effba0a5700 1 -- 172.21.15.26:0/1581318526 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb4045ad0 con 0x7effb40f66e0 2021-11-03T17:50:32.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.012+0000 7effa9ffb700 1 --2- 172.21.15.26:0/1581318526 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7effa0064100 0x7effa00665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:50:32.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.012+0000 7effa9ffb700 1 -- 172.21.15.26:0/1581318526 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7effa4081650 con 0x7effb40f66e0 2021-11-03T17:50:32.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.012+0000 7effb90a3700 1 --2- 172.21.15.26:0/1581318526 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7effa0064100 0x7effa00665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:50:32.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.012+0000 7effb90a3700 1 --2- 172.21.15.26:0/1581318526 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7effa0064100 0x7effa00665c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7effb40fd350 tx=0x7effb000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:50:32.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.016+0000 7effa9ffb700 1 -- 172.21.15.26:0/1581318526 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7effa40539b0 con 0x7effb40f66e0 2021-11-03T17:50:32.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.244+0000 7effba0a5700 1 -- 172.21.15.26:0/1581318526 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7effb4027a00 con 0x7effb40f66e0 2021-11-03T17:50:32.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.244+0000 7effa9ffb700 1 -- 172.21.15.26:0/1581318526 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7effa4023070 con 0x7effb40f66e0 2021-11-03T17:50:32.239 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:50:32.239 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:50:32.240 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:50:32.240 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:50:32.240 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:50:32.241 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:50:32.241 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:50:32.241 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:50:32.241 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:50:32.242 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:50:32.242 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:50:32.242 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:50:32.242 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:50:32.242 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:50:32.243 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:50:32.243 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:50:32.243 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:50:32.243 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:50:32.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.246+0000 7effba0a5700 1 -- 172.21.15.26:0/1581318526 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7effa0064100 msgr2=0x7effa00665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:50:32.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.246+0000 7effba0a5700 1 --2- 172.21.15.26:0/1581318526 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7effa0064100 0x7effa00665c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7effb40fd350 tx=0x7effb000b040).stop 2021-11-03T17:50:32.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.246+0000 7effba0a5700 1 -- 172.21.15.26:0/1581318526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb40f66e0 msgr2=0x7effb40fba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:50:32.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.246+0000 7effba0a5700 1 --2- 172.21.15.26:0/1581318526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb40f66e0 0x7effb40fba40 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7effa4000c00 tx=0x7effa400b040).stop 2021-11-03T17:50:32.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.246+0000 7effba0a5700 1 -- 172.21.15.26:0/1581318526 shutdown_connections 2021-11-03T17:50:32.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.246+0000 7effba0a5700 1 --2- 172.21.15.26:0/1581318526 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7effa0064100 0x7effa00665c0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:32.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.246+0000 7effba0a5700 1 --2- 172.21.15.26:0/1581318526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effb40f5440 0x7effb40fd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:32.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.246+0000 7effba0a5700 1 --2- 172.21.15.26:0/1581318526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effb40f66e0 0x7effb40fba40 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:32.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.246+0000 7effba0a5700 1 -- 172.21.15.26:0/1581318526 >> 172.21.15.26:0/1581318526 conn(0x7effb40f0ba0 msgr2=0x7effb40fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:50:32.247 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.246+0000 7effba0a5700 1 -- 172.21.15.26:0/1581318526 shutdown_connections 2021-11-03T17:50:32.247 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.246+0000 7effba0a5700 1 -- 172.21.15.26:0/1581318526 wait complete. 2021-11-03T17:50:32.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.347+0000 7fc3c7686700 1 -- 172.21.15.26:0/2776564262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3c00f7960 msgr2=0x7fc3c00f7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:50:32.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.347+0000 7fc3c7686700 1 --2- 172.21.15.26:0/2776564262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3c00f7960 0x7fc3c00f7dc0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7fc3b4004660 tx=0x7fc3b4009b30).stop 2021-11-03T17:50:32.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.347+0000 7fc3c7686700 1 -- 172.21.15.26:0/2776564262 shutdown_connections 2021-11-03T17:50:32.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.347+0000 7fc3c7686700 1 --2- 172.21.15.26:0/2776564262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3c00f7960 0x7fc3c00f7dc0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:32.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.347+0000 7fc3c7686700 1 --2- 172.21.15.26:0/2776564262 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3c00f66c0 0x7fc3c00f6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:32.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.347+0000 7fc3c7686700 1 -- 172.21.15.26:0/2776564262 >> 172.21.15.26:0/2776564262 conn(0x7fc3c00f1e20 msgr2=0x7fc3c00f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:50:32.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.347+0000 7fc3c7686700 1 -- 172.21.15.26:0/2776564262 shutdown_connections 2021-11-03T17:50:32.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.347+0000 7fc3c7686700 1 -- 172.21.15.26:0/2776564262 wait complete. 2021-11-03T17:50:32.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.347+0000 7fc3c7686700 1 Processor -- start 2021-11-03T17:50:32.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.347+0000 7fc3c7686700 1 -- start start 2021-11-03T17:50:32.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.347+0000 7fc3c7686700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3c00f66c0 0x7fc3c006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:50:32.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.347+0000 7fc3c7686700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3c00f7960 0x7fc3c0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:50:32.347 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.347+0000 7fc3c7686700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c006a380 con 0x7fc3c00f7960 2021-11-03T17:50:32.347 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.347+0000 7fc3c7686700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c006a4c0 con 0x7fc3c00f66c0 2021-11-03T17:50:32.347 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.348+0000 7fc3c4c21700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3c00f7960 0x7fc3c0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:50:32.347 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.348+0000 7fc3c4c21700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3c00f7960 0x7fc3c0069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56690/0 (socket says 172.21.15.26:56690) 2021-11-03T17:50:32.348 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.348+0000 7fc3c4c21700 1 -- 172.21.15.26:0/3734220831 learned_addr learned my addr 172.21.15.26:0/3734220831 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:50:32.348 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.348+0000 7fc3c5422700 1 --2- 172.21.15.26:0/3734220831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3c00f66c0 0x7fc3c006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:50:32.348 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.348+0000 7fc3c4c21700 1 -- 172.21.15.26:0/3734220831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3c00f66c0 msgr2=0x7fc3c006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:50:32.348 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.348+0000 7fc3c4c21700 1 --2- 172.21.15.26:0/3734220831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3c00f66c0 0x7fc3c006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:32.349 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.348+0000 7fc3c4c21700 1 -- 172.21.15.26:0/3734220831 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b4005040 con 0x7fc3c00f7960 2021-11-03T17:50:32.349 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.348+0000 7fc3c4c21700 1 --2- 172.21.15.26:0/3734220831 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3c00f7960 0x7fc3c0069e20 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7fc3b4009990 tx=0x7fc3b4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:50:32.349 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.348+0000 7fc3bdffb700 1 -- 172.21.15.26:0/3734220831 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3b4018070 con 0x7fc3c00f7960 2021-11-03T17:50:32.349 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.348+0000 7fc3bdffb700 1 -- 172.21.15.26:0/3734220831 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc3b4007ba0 con 0x7fc3c00f7960 2021-11-03T17:50:32.350 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.348+0000 7fc3bdffb700 1 -- 172.21.15.26:0/3734220831 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3b401c3c0 con 0x7fc3c00f7960 2021-11-03T17:50:32.350 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.348+0000 7fc3c7686700 1 -- 172.21.15.26:0/3734220831 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3c006a740 con 0x7fc3c00f7960 2021-11-03T17:50:32.350 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.348+0000 7fc3c7686700 1 -- 172.21.15.26:0/3734220831 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3c006aca0 con 0x7fc3c00f7960 2021-11-03T17:50:32.351 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.349+0000 7fc3c7686700 1 -- 172.21.15.26:0/3734220831 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3c0045ad0 con 0x7fc3c00f7960 2021-11-03T17:50:32.351 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.350+0000 7fc3bdffb700 1 -- 172.21.15.26:0/3734220831 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc3b401d420 con 0x7fc3c00f7960 2021-11-03T17:50:32.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.350+0000 7fc3bdffb700 1 --2- 172.21.15.26:0/3734220831 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3a80640b0 0x7fc3a8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:50:32.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.350+0000 7fc3bdffb700 1 -- 172.21.15.26:0/3734220831 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc3b4082410 con 0x7fc3c00f7960 2021-11-03T17:50:32.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.350+0000 7fc3c5422700 1 --2- 172.21.15.26:0/3734220831 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3a80640b0 0x7fc3a8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:50:32.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.351+0000 7fc3c5422700 1 --2- 172.21.15.26:0/3734220831 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3a80640b0 0x7fc3a8066570 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7fc3c006b730 tx=0x7fc3b8009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:50:32.353 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.355+0000 7fc3bdffb700 1 -- 172.21.15.26:0/3734220831 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc3b4054830 con 0x7fc3c00f7960 2021-11-03T17:50:32.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.559+0000 7fc3c7686700 1 -- 172.21.15.26:0/3734220831 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc3c0027a00 con 0x7fc3c00f7960 2021-11-03T17:50:32.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.560+0000 7fc3bdffb700 1 -- 172.21.15.26:0/3734220831 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fc3b4054420 con 0x7fc3c00f7960 2021-11-03T17:50:32.555 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:50:32.555 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:50:32.555 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:50:32.555 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:50:32.556 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:50:32.556 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:50:32.556 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:50:32.556 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:50:32.557 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:50:32.557 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:50:32.557 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:50:32.558 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:50:32.558 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:50:32.559 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:50:32.559 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:50:32.559 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:50:32.559 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:50:32.560 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:50:32.560 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:50:32.560 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:50:32.561 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:50:32.561 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:50:32.561 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:50:32.562 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:50:32.562 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:50:32.562 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:50:32.562 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:50:32.563 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:50:32.563 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:50:32.563 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:50:32.563 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:50:32.564 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:50:32.564 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:50:32.564 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:50:32.565 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:50:32.565 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:50:32.565 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:50:32.565 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:50:32.566 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:50:32.567 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.561+0000 7fc3c7686700 1 -- 172.21.15.26:0/3734220831 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3a80640b0 msgr2=0x7fc3a8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:50:32.567 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.561+0000 7fc3c7686700 1 --2- 172.21.15.26:0/3734220831 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3a80640b0 0x7fc3a8066570 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7fc3c006b730 tx=0x7fc3b8009040).stop 2021-11-03T17:50:32.567 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.561+0000 7fc3c7686700 1 -- 172.21.15.26:0/3734220831 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3c00f7960 msgr2=0x7fc3c0069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:50:32.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.561+0000 7fc3c7686700 1 --2- 172.21.15.26:0/3734220831 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3c00f7960 0x7fc3c0069e20 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7fc3b4009990 tx=0x7fc3b4009b30).stop 2021-11-03T17:50:32.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.561+0000 7fc3c7686700 1 -- 172.21.15.26:0/3734220831 shutdown_connections 2021-11-03T17:50:32.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.561+0000 7fc3c7686700 1 --2- 172.21.15.26:0/3734220831 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3a80640b0 0x7fc3a8066570 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:32.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.561+0000 7fc3c7686700 1 --2- 172.21.15.26:0/3734220831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3c00f66c0 0x7fc3c006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:32.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.561+0000 7fc3c7686700 1 --2- 172.21.15.26:0/3734220831 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3c00f7960 0x7fc3c0069e20 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:50:32.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.561+0000 7fc3c7686700 1 -- 172.21.15.26:0/3734220831 >> 172.21.15.26:0/3734220831 conn(0x7fc3c00f1e20 msgr2=0x7fc3c00fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:50:32.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.562+0000 7fc3c7686700 1 -- 172.21.15.26:0/3734220831 shutdown_connections 2021-11-03T17:50:32.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:50:32.562+0000 7fc3c7686700 1 -- 172.21.15.26:0/3734220831 wait complete. 2021-11-03T17:50:32.570 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:50:32.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:32 smithi026 ceph-mon[96795]: poll took 60046.370 ms: 1 events 2021-11-03T17:50:32.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:32 smithi026 ceph-mon[96795]: pgmap v1676: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:32.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:32 smithi026 ceph-mon[96795]: from='client.35868 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:50:32.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:32 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1581318526' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:50:32.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:32 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3734220831' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:50:32.996 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:32 smithi194 ceph-mon[65619]: poll took 60046.370 ms: 1 events 2021-11-03T17:50:32.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:32 smithi194 ceph-mon[65619]: pgmap v1676: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:32.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:32 smithi194 ceph-mon[65619]: from='client.35868 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:50:32.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:32 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1581318526' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:50:32.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:32 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3734220831' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:50:33.742 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:33 smithi194 ceph-mon[65619]: from='client.35872 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:50:33.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:33 smithi026 ceph-mon[96795]: from='client.35872 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:50:35.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:34 smithi026 ceph-mon[96795]: pgmap v1677: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:35.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:34 smithi026 ceph-mon[96795]: poll took 2539.120 ms: 1 events 2021-11-03T17:50:35.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:34 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:50:35.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:34 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:50:35.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:34 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:50:35.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:34 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:50:35.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:34 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:50:35.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:34 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:50:35.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:34 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:50:35.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:34 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:50:35.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:34 smithi194 ceph-mon[65619]: pgmap v1677: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:35.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:34 smithi194 ceph-mon[65619]: poll took 2539.120 ms: 1 events 2021-11-03T17:50:35.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:34 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:50:35.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:34 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:50:35.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:34 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:50:35.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:34 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:50:35.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:34 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:50:35.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:34 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:50:35.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:34 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:50:35.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:34 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:50:35.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:35 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:50:35.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:35 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:50:36.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:35 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:50:36.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:35 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:50:37.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:36 smithi026 ceph-mon[96795]: pgmap v1678: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:37.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:36 smithi194 ceph-mon[65619]: pgmap v1678: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:38.171 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:37 smithi026 ceph-mon[96795]: pgmap v1679: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:38.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:37 smithi194 ceph-mon[65619]: pgmap v1679: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:40.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:40 smithi026 ceph-mon[96795]: pgmap v1680: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:40.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:40 smithi194 ceph-mon[65619]: pgmap v1680: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:42.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:42 smithi026 ceph-mon[96795]: pgmap v1681: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:42.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:42 smithi194 ceph-mon[65619]: pgmap v1681: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:44.671 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:44 smithi026 ceph-mon[96795]: pgmap v1682: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:44.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:44 smithi194 ceph-mon[65619]: pgmap v1682: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:46.746 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:46 smithi194 ceph-mon[65619]: pgmap v1683: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:46.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:46 smithi026 ceph-mon[96795]: pgmap v1683: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:48.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:48 smithi194 ceph-mon[65619]: pgmap v1684: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:48.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:50:48.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:50:48.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:48 smithi026 ceph-mon[96795]: pgmap v1684: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:48.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:50:48.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:50:49.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:50:49.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:50:50.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:50 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:50:50.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:50 smithi194 ceph-mon[65619]: pgmap v1685: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:50.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:50 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:50:50.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:50 smithi026 ceph-mon[96795]: pgmap v1685: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:52.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:52 smithi194 ceph-mon[65619]: pgmap v1686: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:52.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:52 smithi026 ceph-mon[96795]: pgmap v1686: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:54.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:54 smithi194 ceph-mon[65619]: pgmap v1687: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:54.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:54 smithi026 ceph-mon[96795]: pgmap v1687: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:56.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:56 smithi194 ceph-mon[65619]: pgmap v1688: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:56.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:56 smithi026 ceph-mon[96795]: pgmap v1688: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:58.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:50:58 smithi194 ceph-mon[65619]: pgmap v1689: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:50:58.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:50:58 smithi026 ceph-mon[96795]: pgmap v1689: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:00.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:00 smithi194 ceph-mon[65619]: pgmap v1690: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:00.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:00 smithi026 ceph-mon[96795]: pgmap v1690: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:02.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.676+0000 7f927581b700 1 -- 172.21.15.26:0/2238924741 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92700f5440 msgr2=0x7f92700f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:51:02.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.676+0000 7f927581b700 1 --2- 172.21.15.26:0/2238924741 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92700f5440 0x7f92700f5860 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7f92680099e0 tx=0x7f9268004d10).stop 2021-11-03T17:51:02.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.676+0000 7f927581b700 1 -- 172.21.15.26:0/2238924741 shutdown_connections 2021-11-03T17:51:02.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.676+0000 7f927581b700 1 --2- 172.21.15.26:0/2238924741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92700f66e0 0x7f92700f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:02.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.676+0000 7f927581b700 1 --2- 172.21.15.26:0/2238924741 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92700f5440 0x7f92700f5860 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:02.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.676+0000 7f927581b700 1 -- 172.21.15.26:0/2238924741 >> 172.21.15.26:0/2238924741 conn(0x7f92700f0ba0 msgr2=0x7f92700f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:51:02.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.676+0000 7f927581b700 1 -- 172.21.15.26:0/2238924741 shutdown_connections 2021-11-03T17:51:02.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.676+0000 7f927581b700 1 -- 172.21.15.26:0/2238924741 wait complete. 2021-11-03T17:51:02.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.676+0000 7f927581b700 1 Processor -- start 2021-11-03T17:51:02.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.676+0000 7f927581b700 1 -- start start 2021-11-03T17:51:02.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.677+0000 7f927581b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92700f5440 0x7f9270105e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:51:02.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.677+0000 7f927581b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92700f66e0 0x7f9270106300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:51:02.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.677+0000 7f927581b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9270106900 con 0x7f92700f5440 2021-11-03T17:51:02.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.677+0000 7f927581b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9270107110 con 0x7f92700f66e0 2021-11-03T17:51:02.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.677+0000 7f9274819700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92700f5440 0x7f9270105e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:51:02.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.677+0000 7f9274819700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92700f5440 0x7f9270105e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56704/0 (socket says 172.21.15.26:56704) 2021-11-03T17:51:02.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.677+0000 7f9274819700 1 -- 172.21.15.26:0/1584162395 learned_addr learned my addr 172.21.15.26:0/1584162395 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:51:02.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.677+0000 7f926ffff700 1 --2- 172.21.15.26:0/1584162395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92700f66e0 0x7f9270106300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:51:02.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.677+0000 7f9274819700 1 -- 172.21.15.26:0/1584162395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92700f66e0 msgr2=0x7f9270106300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:51:02.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.677+0000 7f9274819700 1 --2- 172.21.15.26:0/1584162395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92700f66e0 0x7f9270106300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:02.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.677+0000 7f9274819700 1 -- 172.21.15.26:0/1584162395 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9268009640 con 0x7f92700f5440 2021-11-03T17:51:02.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.677+0000 7f926ffff700 1 --2- 172.21.15.26:0/1584162395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92700f66e0 0x7f9270106300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:51:02.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.677+0000 7f9274819700 1 --2- 172.21.15.26:0/1584162395 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92700f5440 0x7f9270105e10 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7f926800baa0 tx=0x7f9268004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:51:02.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.677+0000 7f926d7fa700 1 -- 172.21.15.26:0/1584162395 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f926800e070 con 0x7f92700f5440 2021-11-03T17:51:02.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.677+0000 7f926d7fa700 1 -- 172.21.15.26:0/1584162395 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9268007df0 con 0x7f92700f5440 2021-11-03T17:51:02.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.678+0000 7f927581b700 1 -- 172.21.15.26:0/1584162395 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9270107330 con 0x7f92700f5440 2021-11-03T17:51:02.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.678+0000 7f926d7fa700 1 -- 172.21.15.26:0/1584162395 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9268018070 con 0x7f92700f5440 2021-11-03T17:51:02.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.678+0000 7f927581b700 1 -- 172.21.15.26:0/1584162395 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9270107890 con 0x7f92700f5440 2021-11-03T17:51:02.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.679+0000 7f927581b700 1 -- 172.21.15.26:0/1584162395 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9270059100 con 0x7f92700f5440 2021-11-03T17:51:02.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.679+0000 7f926d7fa700 1 -- 172.21.15.26:0/1584162395 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f9268024060 con 0x7f92700f5440 2021-11-03T17:51:02.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.680+0000 7f926d7fa700 1 --2- 172.21.15.26:0/1584162395 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f925c064100 0x7f925c0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:51:02.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.680+0000 7f926d7fa700 1 -- 172.21.15.26:0/1584162395 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f9268081f30 con 0x7f92700f5440 2021-11-03T17:51:02.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.680+0000 7f926ffff700 1 --2- 172.21.15.26:0/1584162395 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f925c064100 0x7f925c0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:51:02.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.680+0000 7f926ffff700 1 --2- 172.21.15.26:0/1584162395 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f925c064100 0x7f925c0665c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f9258007fc0 tx=0x7f925800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:51:02.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.684+0000 7f926d7fa700 1 -- 172.21.15.26:0/1584162395 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f92680aedf0 con 0x7f92700f5440 2021-11-03T17:51:02.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:02 smithi194 ceph-mon[65619]: pgmap v1691: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:02.859 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.864+0000 7f927581b700 1 -- 172.21.15.26:0/1584162395 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f92700fdc70 con 0x7f925c064100 2021-11-03T17:51:02.860 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.865+0000 7f926d7fa700 1 -- 172.21.15.26:0/1584162395 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f92700fdc70 con 0x7f925c064100 2021-11-03T17:51:02.863 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.867+0000 7f927581b700 1 -- 172.21.15.26:0/1584162395 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f925c064100 msgr2=0x7f925c0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:51:02.863 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.867+0000 7f927581b700 1 --2- 172.21.15.26:0/1584162395 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f925c064100 0x7f925c0665c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f9258007fc0 tx=0x7f925800b040).stop 2021-11-03T17:51:02.864 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.867+0000 7f927581b700 1 -- 172.21.15.26:0/1584162395 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92700f5440 msgr2=0x7f9270105e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:51:02.864 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.867+0000 7f927581b700 1 --2- 172.21.15.26:0/1584162395 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92700f5440 0x7f9270105e10 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7f926800baa0 tx=0x7f9268004d10).stop 2021-11-03T17:51:02.864 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.867+0000 7f927581b700 1 -- 172.21.15.26:0/1584162395 shutdown_connections 2021-11-03T17:51:02.865 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.867+0000 7f927581b700 1 --2- 172.21.15.26:0/1584162395 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f925c064100 0x7f925c0665c0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:02.865 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.867+0000 7f927581b700 1 --2- 172.21.15.26:0/1584162395 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92700f5440 0x7f9270105e10 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:02.866 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.867+0000 7f927581b700 1 --2- 172.21.15.26:0/1584162395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92700f66e0 0x7f9270106300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:02.866 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.867+0000 7f927581b700 1 -- 172.21.15.26:0/1584162395 >> 172.21.15.26:0/1584162395 conn(0x7f92700f0ba0 msgr2=0x7f92700fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:51:02.867 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.867+0000 7f927581b700 1 -- 172.21.15.26:0/1584162395 shutdown_connections 2021-11-03T17:51:02.867 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.867+0000 7f927581b700 1 -- 172.21.15.26:0/1584162395 wait complete. 2021-11-03T17:51:02.873 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:51:02.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:02 smithi026 ceph-mon[96795]: pgmap v1691: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:02.968 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.967+0000 7f04f188e700 1 -- 172.21.15.26:0/873683604 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04ec0f53d0 msgr2=0x7f04ec0f7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:51:02.968 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.967+0000 7f04f188e700 1 --2- 172.21.15.26:0/873683604 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04ec0f53d0 0x7f04ec0f7d00 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7f04e0004660 tx=0x7f04e0009b30).stop 2021-11-03T17:51:02.968 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.967+0000 7f04f188e700 1 -- 172.21.15.26:0/873683604 shutdown_connections 2021-11-03T17:51:02.969 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.967+0000 7f04f188e700 1 --2- 172.21.15.26:0/873683604 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04ec0f53d0 0x7f04ec0f7d00 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:02.969 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.967+0000 7f04f188e700 1 --2- 172.21.15.26:0/873683604 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04ec0f4ac0 0x7f04ec0f4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:02.969 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.967+0000 7f04f188e700 1 -- 172.21.15.26:0/873683604 >> 172.21.15.26:0/873683604 conn(0x7f04ec0f0540 msgr2=0x7f04ec0f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:51:02.969 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.967+0000 7f04f188e700 1 -- 172.21.15.26:0/873683604 shutdown_connections 2021-11-03T17:51:02.970 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.967+0000 7f04f188e700 1 -- 172.21.15.26:0/873683604 wait complete. 2021-11-03T17:51:02.970 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.968+0000 7f04f188e700 1 Processor -- start 2021-11-03T17:51:02.970 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.968+0000 7f04f188e700 1 -- start start 2021-11-03T17:51:02.970 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.968+0000 7f04f188e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04ec0f4ac0 0x7f04ec0f76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:51:02.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.968+0000 7f04f188e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04ec0f53d0 0x7f04ec0f5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:51:02.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.968+0000 7f04f188e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ec0f6090 con 0x7f04ec0f53d0 2021-11-03T17:51:02.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.968+0000 7f04f188e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ec0f61d0 con 0x7f04ec0f4ac0 2021-11-03T17:51:02.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.968+0000 7f04ea7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04ec0f53d0 0x7f04ec0f5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:51:02.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.968+0000 7f04ea7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04ec0f53d0 0x7f04ec0f5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56716/0 (socket says 172.21.15.26:56716) 2021-11-03T17:51:02.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.968+0000 7f04ea7fc700 1 -- 172.21.15.26:0/2784190908 learned_addr learned my addr 172.21.15.26:0/2784190908 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:51:02.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.968+0000 7f04eaffd700 1 --2- 172.21.15.26:0/2784190908 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04ec0f4ac0 0x7f04ec0f76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:51:02.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.969+0000 7f04ea7fc700 1 -- 172.21.15.26:0/2784190908 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04ec0f4ac0 msgr2=0x7f04ec0f76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:51:02.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.969+0000 7f04ea7fc700 1 --2- 172.21.15.26:0/2784190908 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04ec0f4ac0 0x7f04ec0f76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:02.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.969+0000 7f04ea7fc700 1 -- 172.21.15.26:0/2784190908 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e0005040 con 0x7f04ec0f53d0 2021-11-03T17:51:02.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.969+0000 7f04ea7fc700 1 --2- 172.21.15.26:0/2784190908 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04ec0f53d0 0x7f04ec0f5b30 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7f04e0000c00 tx=0x7f04e000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:51:02.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.969+0000 7f04d37fe700 1 -- 172.21.15.26:0/2784190908 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04e0019070 con 0x7f04ec0f53d0 2021-11-03T17:51:02.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.969+0000 7f04d37fe700 1 -- 172.21.15.26:0/2784190908 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f04e0007e70 con 0x7f04ec0f53d0 2021-11-03T17:51:02.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.969+0000 7f04f188e700 1 -- 172.21.15.26:0/2784190908 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04ec0f6450 con 0x7f04ec0f53d0 2021-11-03T17:51:02.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.969+0000 7f04d37fe700 1 -- 172.21.15.26:0/2784190908 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04e0014ce0 con 0x7f04ec0f53d0 2021-11-03T17:51:02.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.969+0000 7f04f188e700 1 -- 172.21.15.26:0/2784190908 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04ec0f69b0 con 0x7f04ec0f53d0 2021-11-03T17:51:02.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.970+0000 7f04f188e700 1 -- 172.21.15.26:0/2784190908 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04ec045ad0 con 0x7f04ec0f53d0 2021-11-03T17:51:02.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.970+0000 7f04d37fe700 1 -- 172.21.15.26:0/2784190908 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f04e0025070 con 0x7f04ec0f53d0 2021-11-03T17:51:02.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.971+0000 7f04d37fe700 1 --2- 172.21.15.26:0/2784190908 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f04d40640b0 0x7f04d4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:51:02.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.971+0000 7f04d37fe700 1 -- 172.21.15.26:0/2784190908 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f04e0081670 con 0x7f04ec0f53d0 2021-11-03T17:51:02.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.971+0000 7f04eaffd700 1 --2- 172.21.15.26:0/2784190908 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f04d40640b0 0x7f04d4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:51:02.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.971+0000 7f04eaffd700 1 --2- 172.21.15.26:0/2784190908 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f04d40640b0 0x7f04d4066570 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f04ec0f7440 tx=0x7f04dc00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:51:02.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:02.975+0000 7f04d37fe700 1 -- 172.21.15.26:0/2784190908 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f04e00539d0 con 0x7f04ec0f53d0 2021-11-03T17:51:03.143 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.148+0000 7f04f188e700 1 -- 172.21.15.26:0/2784190908 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f04ec0ff0d0 con 0x7f04d40640b0 2021-11-03T17:51:03.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.162+0000 7f04d37fe700 1 -- 172.21.15.26:0/2784190908 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f04ec0ff0d0 con 0x7f04d40640b0 2021-11-03T17:51:03.159 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:51:03.159 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (62m) 92s ago 63m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:51:03.160 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (54m) 92s ago 63m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:51:03.161 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (54m) 29s ago 62m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:51:03.161 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (62m) 92s ago 63m 41.4M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:51:03.161 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (55m) 92s ago 58m 25.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:51:03.162 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (55m) 92s ago 58m 26.0M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:51:03.162 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (58m) 29s ago 58m 26.2M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:51:03.163 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (58m) 29s ago 58m 26.5M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:51:03.163 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (56m) 92s ago 64m 547M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:51:03.163 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (55m) 29s ago 62m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:51:03.164 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (55m) 92s ago 65m 242M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:51:03.164 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (55m) 29s ago 62m 117M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:51:03.165 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (63m) 92s ago 63m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:51:03.165 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (62m) 29s ago 62m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:51:03.165 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (54m) 92s ago 61m 271M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:51:03.166 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (53m) 92s ago 61m 291M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:51:03.166 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (53m) 92s ago 61m 243M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:51:03.167 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (52m) 29s ago 60m 312M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:51:03.167 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (52m) 29s ago 60m 265M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:51:03.167 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (51m) 29s ago 60m 255M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:51:03.167 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (62m) 92s ago 62m 58.9M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:51:03.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.164+0000 7f04f188e700 1 -- 172.21.15.26:0/2784190908 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f04d40640b0 msgr2=0x7f04d4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:51:03.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.164+0000 7f04f188e700 1 --2- 172.21.15.26:0/2784190908 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f04d40640b0 0x7f04d4066570 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f04ec0f7440 tx=0x7f04dc00b040).stop 2021-11-03T17:51:03.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.164+0000 7f04f188e700 1 -- 172.21.15.26:0/2784190908 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04ec0f53d0 msgr2=0x7f04ec0f5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:51:03.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.164+0000 7f04f188e700 1 --2- 172.21.15.26:0/2784190908 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04ec0f53d0 0x7f04ec0f5b30 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7f04e0000c00 tx=0x7f04e000b040).stop 2021-11-03T17:51:03.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.164+0000 7f04f188e700 1 -- 172.21.15.26:0/2784190908 shutdown_connections 2021-11-03T17:51:03.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.164+0000 7f04f188e700 1 --2- 172.21.15.26:0/2784190908 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f04d40640b0 0x7f04d4066570 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:03.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.164+0000 7f04f188e700 1 --2- 172.21.15.26:0/2784190908 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04ec0f4ac0 0x7f04ec0f76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:03.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.164+0000 7f04f188e700 1 --2- 172.21.15.26:0/2784190908 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04ec0f53d0 0x7f04ec0f5b30 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:03.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.164+0000 7f04f188e700 1 -- 172.21.15.26:0/2784190908 >> 172.21.15.26:0/2784190908 conn(0x7f04ec0f0540 msgr2=0x7f04ec0fb750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:51:03.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.164+0000 7f04f188e700 1 -- 172.21.15.26:0/2784190908 shutdown_connections 2021-11-03T17:51:03.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.164+0000 7f04f188e700 1 -- 172.21.15.26:0/2784190908 wait complete. 2021-11-03T17:51:03.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.264+0000 7f47cc419700 1 -- 172.21.15.26:0/3587331928 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47c40f66c0 msgr2=0x7f47c40f6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:51:03.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.264+0000 7f47cc419700 1 --2- 172.21.15.26:0/3587331928 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47c40f66c0 0x7f47c40f6ae0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7f47b4004660 tx=0x7f47b4009b30).stop 2021-11-03T17:51:03.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.264+0000 7f47cc419700 1 -- 172.21.15.26:0/3587331928 shutdown_connections 2021-11-03T17:51:03.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.264+0000 7f47cc419700 1 --2- 172.21.15.26:0/3587331928 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47c40f7960 0x7f47c40f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:03.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.264+0000 7f47cc419700 1 --2- 172.21.15.26:0/3587331928 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47c40f66c0 0x7f47c40f6ae0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:03.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.264+0000 7f47cc419700 1 -- 172.21.15.26:0/3587331928 >> 172.21.15.26:0/3587331928 conn(0x7f47c40f1e20 msgr2=0x7f47c40f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:51:03.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.264+0000 7f47cc419700 1 -- 172.21.15.26:0/3587331928 shutdown_connections 2021-11-03T17:51:03.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.264+0000 7f47cc419700 1 -- 172.21.15.26:0/3587331928 wait complete. 2021-11-03T17:51:03.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.264+0000 7f47cc419700 1 Processor -- start 2021-11-03T17:51:03.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.264+0000 7f47cc419700 1 -- start start 2021-11-03T17:51:03.268 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.264+0000 7f47cc419700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47c40f66c0 0x7f47c4106f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:51:03.268 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.264+0000 7f47cc419700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47c40f7960 0x7f47c4107480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:51:03.268 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.264+0000 7f47cc419700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c4107a30 con 0x7f47c40f7960 2021-11-03T17:51:03.268 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.264+0000 7f47cc419700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c4107b70 con 0x7f47c40f66c0 2021-11-03T17:51:03.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.265+0000 7f47c99b4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47c40f7960 0x7f47c4107480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:51:03.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.265+0000 7f47c99b4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47c40f7960 0x7f47c4107480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56724/0 (socket says 172.21.15.26:56724) 2021-11-03T17:51:03.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.265+0000 7f47c99b4700 1 -- 172.21.15.26:0/4220473656 learned_addr learned my addr 172.21.15.26:0/4220473656 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:51:03.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.265+0000 7f47ca1b5700 1 --2- 172.21.15.26:0/4220473656 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47c40f66c0 0x7f47c4106f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:51:03.270 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.265+0000 7f47c99b4700 1 -- 172.21.15.26:0/4220473656 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47c40f66c0 msgr2=0x7f47c4106f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:51:03.270 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.265+0000 7f47c99b4700 1 --2- 172.21.15.26:0/4220473656 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47c40f66c0 0x7f47c4106f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:03.270 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.265+0000 7f47c99b4700 1 -- 172.21.15.26:0/4220473656 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b4005040 con 0x7f47c40f7960 2021-11-03T17:51:03.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.265+0000 7f47ca1b5700 1 --2- 172.21.15.26:0/4220473656 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47c40f66c0 0x7f47c4106f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:51:03.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.265+0000 7f47c99b4700 1 --2- 172.21.15.26:0/4220473656 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47c40f7960 0x7f47c4107480 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 rx=0x7f47c000c530 tx=0x7f47c0007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:51:03.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.265+0000 7f47baffd700 1 -- 172.21.15.26:0/4220473656 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47c000f650 con 0x7f47c40f7960 2021-11-03T17:51:03.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.265+0000 7f47baffd700 1 -- 172.21.15.26:0/4220473656 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f47c000fc60 con 0x7f47c40f7960 2021-11-03T17:51:03.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.265+0000 7f47baffd700 1 -- 172.21.15.26:0/4220473656 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47c0012cd0 con 0x7f47c40f7960 2021-11-03T17:51:03.272 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.265+0000 7f47cc419700 1 -- 172.21.15.26:0/4220473656 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47c4108510 con 0x7f47c40f7960 2021-11-03T17:51:03.272 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.265+0000 7f47cc419700 1 -- 172.21.15.26:0/4220473656 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47c4108ad0 con 0x7f47c40f7960 2021-11-03T17:51:03.272 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.266+0000 7f47cc419700 1 -- 172.21.15.26:0/4220473656 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47c4045ad0 con 0x7f47c40f7960 2021-11-03T17:51:03.272 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.267+0000 7f47baffd700 1 -- 172.21.15.26:0/4220473656 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f47c0010070 con 0x7f47c40f7960 2021-11-03T17:51:03.273 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.267+0000 7f47baffd700 1 --2- 172.21.15.26:0/4220473656 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f47b00640b0 0x7f47b0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:51:03.273 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.267+0000 7f47baffd700 1 -- 172.21.15.26:0/4220473656 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f47c0080640 con 0x7f47c40f7960 2021-11-03T17:51:03.273 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.267+0000 7f47ca1b5700 1 --2- 172.21.15.26:0/4220473656 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f47b00640b0 0x7f47b0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:51:03.273 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.268+0000 7f47ca1b5700 1 --2- 172.21.15.26:0/4220473656 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f47b00640b0 0x7f47b0066570 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f47b4009da0 tx=0x7f47b4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:51:03.274 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.271+0000 7f47baffd700 1 -- 172.21.15.26:0/4220473656 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f47c00528b0 con 0x7f47c40f7960 2021-11-03T17:51:03.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.502+0000 7f47cc419700 1 -- 172.21.15.26:0/4220473656 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f47c4108d40 con 0x7f47c40f7960 2021-11-03T17:51:03.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.502+0000 7f47baffd700 1 -- 172.21.15.26:0/4220473656 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f47c00524a0 con 0x7f47c40f7960 2021-11-03T17:51:03.498 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:51:03.499 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:51:03.499 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:51:03.499 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:51:03.499 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:51:03.500 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:51:03.500 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:51:03.500 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:51:03.500 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:51:03.500 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:51:03.501 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:51:03.501 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:51:03.501 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:51:03.501 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:51:03.502 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:51:03.502 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:51:03.502 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:51:03.502 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:51:03.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.504+0000 7f47cc419700 1 -- 172.21.15.26:0/4220473656 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f47b00640b0 msgr2=0x7f47b0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:51:03.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.504+0000 7f47cc419700 1 --2- 172.21.15.26:0/4220473656 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f47b00640b0 0x7f47b0066570 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f47b4009da0 tx=0x7f47b4009b30).stop 2021-11-03T17:51:03.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.504+0000 7f47cc419700 1 -- 172.21.15.26:0/4220473656 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47c40f7960 msgr2=0x7f47c4107480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:51:03.504 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.504+0000 7f47cc419700 1 --2- 172.21.15.26:0/4220473656 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47c40f7960 0x7f47c4107480 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 rx=0x7f47c000c530 tx=0x7f47c0007e20).stop 2021-11-03T17:51:03.504 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.504+0000 7f47cc419700 1 -- 172.21.15.26:0/4220473656 shutdown_connections 2021-11-03T17:51:03.504 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.504+0000 7f47cc419700 1 --2- 172.21.15.26:0/4220473656 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f47b00640b0 0x7f47b0066570 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:03.504 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.504+0000 7f47cc419700 1 --2- 172.21.15.26:0/4220473656 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47c40f66c0 0x7f47c4106f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:03.505 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.504+0000 7f47cc419700 1 --2- 172.21.15.26:0/4220473656 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47c40f7960 0x7f47c4107480 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:03.505 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.504+0000 7f47cc419700 1 -- 172.21.15.26:0/4220473656 >> 172.21.15.26:0/4220473656 conn(0x7f47c40f1e20 msgr2=0x7f47c40fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:51:03.505 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.504+0000 7f47cc419700 1 -- 172.21.15.26:0/4220473656 shutdown_connections 2021-11-03T17:51:03.505 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.504+0000 7f47cc419700 1 -- 172.21.15.26:0/4220473656 wait complete. 2021-11-03T17:51:03.601 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.605+0000 7fc15eb58700 1 -- 172.21.15.26:0/3543356746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1580f66e0 msgr2=0x7fc1580f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:51:03.601 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.605+0000 7fc15eb58700 1 --2- 172.21.15.26:0/3543356746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1580f66e0 0x7fc1580f6b00 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7fc14c004660 tx=0x7fc14c009b30).stop 2021-11-03T17:51:03.601 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.605+0000 7fc15eb58700 1 -- 172.21.15.26:0/3543356746 shutdown_connections 2021-11-03T17:51:03.602 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.605+0000 7fc15eb58700 1 --2- 172.21.15.26:0/3543356746 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1580f6ff0 0x7fc1580f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:51:03.602 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.605+0000 7fc15eb58700 1 --2- 172.21.15.26:0/3543356746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1580f66e0 0x7fc1580f6b00 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:03.602 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.605+0000 7fc15eb58700 1 -- 172.21.15.26:0/3543356746 >> 172.21.15.26:0/3543356746 conn(0x7fc1580f1f00 msgr2=0x7fc1580f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:51:03.602 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.605+0000 7fc15eb58700 1 -- 172.21.15.26:0/3543356746 shutdown_connections 2021-11-03T17:51:03.603 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.605+0000 7fc15eb58700 1 -- 172.21.15.26:0/3543356746 wait complete. 2021-11-03T17:51:03.603 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.606+0000 7fc15eb58700 1 Processor -- start 2021-11-03T17:51:03.603 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.606+0000 7fc15eb58700 1 -- start start 2021-11-03T17:51:03.605 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.606+0000 7fc15eb58700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1580f66e0 0x7fc158106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:51:03.605 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.606+0000 7fc15eb58700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1580f6ff0 0x7fc158107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:51:03.605 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.606+0000 7fc15eb58700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc158107ab0 con 0x7fc1580f6ff0 2021-11-03T17:51:03.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.606+0000 7fc15eb58700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc158108360 con 0x7fc1580f66e0 2021-11-03T17:51:03.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.606+0000 7fc157fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1580f6ff0 0x7fc158107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:51:03.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.606+0000 7fc157fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1580f6ff0 0x7fc158107470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56734/0 (socket says 172.21.15.26:56734) 2021-11-03T17:51:03.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.606+0000 7fc157fff700 1 -- 172.21.15.26:0/3534780963 learned_addr learned my addr 172.21.15.26:0/3534780963 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:51:03.607 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.606+0000 7fc15c8f4700 1 --2- 172.21.15.26:0/3534780963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1580f66e0 0x7fc158106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:51:03.607 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.606+0000 7fc157fff700 1 -- 172.21.15.26:0/3534780963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1580f66e0 msgr2=0x7fc158106f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:51:03.607 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.606+0000 7fc157fff700 1 --2- 172.21.15.26:0/3534780963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1580f66e0 0x7fc158106f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:03.607 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.606+0000 7fc157fff700 1 -- 172.21.15.26:0/3534780963 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc14c005040 con 0x7fc1580f6ff0 2021-11-03T17:51:03.608 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.607+0000 7fc157fff700 1 --2- 172.21.15.26:0/3534780963 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1580f6ff0 0x7fc158107470 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7fc14400b410 tx=0x7fc144006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:51:03.608 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.607+0000 7fc1557fa700 1 -- 172.21.15.26:0/3534780963 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1440125f0 con 0x7fc1580f6ff0 2021-11-03T17:51:03.608 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.607+0000 7fc1557fa700 1 -- 172.21.15.26:0/3534780963 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc144012c00 con 0x7fc1580f6ff0 2021-11-03T17:51:03.608 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.607+0000 7fc15eb58700 1 -- 172.21.15.26:0/3534780963 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc158108640 con 0x7fc1580f6ff0 2021-11-03T17:51:03.608 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.607+0000 7fc1557fa700 1 -- 172.21.15.26:0/3534780963 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc144002ae0 con 0x7fc1580f6ff0 2021-11-03T17:51:03.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.607+0000 7fc15eb58700 1 -- 172.21.15.26:0/3534780963 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc158108c00 con 0x7fc1580f6ff0 2021-11-03T17:51:03.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.608+0000 7fc15eb58700 1 -- 172.21.15.26:0/3534780963 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1580f5b70 con 0x7fc1580f6ff0 2021-11-03T17:51:03.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.608+0000 7fc1557fa700 1 -- 172.21.15.26:0/3534780963 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc14400f030 con 0x7fc1580f6ff0 2021-11-03T17:51:03.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.609+0000 7fc1557fa700 1 --2- 172.21.15.26:0/3534780963 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc1480640b0 0x7fc148066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:51:03.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.609+0000 7fc1557fa700 1 -- 172.21.15.26:0/3534780963 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc144080bf0 con 0x7fc1580f6ff0 2021-11-03T17:51:03.610 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.609+0000 7fc15c8f4700 1 --2- 172.21.15.26:0/3534780963 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc1480640b0 0x7fc148066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:51:03.610 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.609+0000 7fc15c8f4700 1 --2- 172.21.15.26:0/3534780963 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc1480640b0 0x7fc148066570 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7fc14c004e30 tx=0x7fc14c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:51:03.610 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.613+0000 7fc1557fa700 1 -- 172.21.15.26:0/3534780963 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc144052f50 con 0x7fc1580f6ff0 2021-11-03T17:51:03.814 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.818+0000 7fc15eb58700 1 -- 172.21.15.26:0/3534780963 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc158045ad0 con 0x7fc1580f6ff0 2021-11-03T17:51:03.814 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.819+0000 7fc1557fa700 1 -- 172.21.15.26:0/3534780963 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fc144052b40 con 0x7fc1580f6ff0 2021-11-03T17:51:03.815 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:51:03.815 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:51:03.815 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:51:03.815 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:51:03.816 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:51:03.816 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:51:03.816 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:51:03.816 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:51:03.816 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:51:03.817 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:51:03.817 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:51:03.817 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:51:03.817 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:51:03.818 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:51:03.818 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:51:03.818 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:51:03.818 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:51:03.818 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:51:03.819 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:51:03.819 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:51:03.819 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:51:03.819 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:51:03.819 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:51:03.820 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:51:03.820 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:51:03.820 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:51:03.820 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:51:03.821 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:51:03.821 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:51:03.821 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:51:03.821 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:51:03.821 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:51:03.822 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:51:03.822 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:51:03.822 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:51:03.822 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:51:03.823 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:51:03.823 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:51:03.823 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:51:03.824 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.820+0000 7fc15eb58700 1 -- 172.21.15.26:0/3534780963 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc1480640b0 msgr2=0x7fc148066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:51:03.824 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.820+0000 7fc15eb58700 1 --2- 172.21.15.26:0/3534780963 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc1480640b0 0x7fc148066570 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7fc14c004e30 tx=0x7fc14c009b30).stop 2021-11-03T17:51:03.824 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.820+0000 7fc15eb58700 1 -- 172.21.15.26:0/3534780963 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1580f6ff0 msgr2=0x7fc158107470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:51:03.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.820+0000 7fc15eb58700 1 --2- 172.21.15.26:0/3534780963 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1580f6ff0 0x7fc158107470 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7fc14400b410 tx=0x7fc144006ef0).stop 2021-11-03T17:51:03.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.820+0000 7fc15eb58700 1 -- 172.21.15.26:0/3534780963 shutdown_connections 2021-11-03T17:51:03.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.820+0000 7fc15eb58700 1 --2- 172.21.15.26:0/3534780963 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc1480640b0 0x7fc148066570 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:03.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.820+0000 7fc15eb58700 1 --2- 172.21.15.26:0/3534780963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1580f66e0 0x7fc158106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:03.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.820+0000 7fc15eb58700 1 --2- 172.21.15.26:0/3534780963 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1580f6ff0 0x7fc158107470 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:03.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.820+0000 7fc15eb58700 1 -- 172.21.15.26:0/3534780963 >> 172.21.15.26:0/3534780963 conn(0x7fc1580f1f00 msgr2=0x7fc1580fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:51:03.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.821+0000 7fc15eb58700 1 -- 172.21.15.26:0/3534780963 shutdown_connections 2021-11-03T17:51:03.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:03.821+0000 7fc15eb58700 1 -- 172.21.15.26:0/3534780963 wait complete. 2021-11-03T17:51:03.826 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:51:04.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:04 smithi194 ceph-mon[65619]: from='client.35884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:51:04.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:04 smithi194 ceph-mon[65619]: from='client.35888 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:51:04.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:04 smithi194 ceph-mon[65619]: pgmap v1692: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:04.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:04 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/4220473656' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:51:04.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:04 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3534780963' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:51:04.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:04 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:51:04.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:04 smithi026 ceph-mon[96795]: from='client.35884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:51:04.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:04 smithi026 ceph-mon[96795]: from='client.35888 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:51:04.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:04 smithi026 ceph-mon[96795]: pgmap v1692: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:04.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:04 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/4220473656' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:51:04.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:04 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3534780963' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:51:04.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:04 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:51:05.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:05 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:51:05.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:05 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:51:06.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:06 smithi194 ceph-mon[65619]: pgmap v1693: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:06.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:06 smithi026 ceph-mon[96795]: pgmap v1693: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:08.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:08 smithi194 ceph-mon[65619]: pgmap v1694: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:08.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:08 smithi026 ceph-mon[96795]: pgmap v1694: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:10.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:10 smithi194 ceph-mon[65619]: pgmap v1695: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:10.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:10 smithi026 ceph-mon[96795]: pgmap v1695: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:12.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:12 smithi194 ceph-mon[65619]: pgmap v1696: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:12.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:12 smithi026 ceph-mon[96795]: pgmap v1696: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:14.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:14 smithi194 ceph-mon[65619]: pgmap v1697: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:14.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:14 smithi026 ceph-mon[96795]: pgmap v1697: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:16.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:16 smithi194 ceph-mon[65619]: pgmap v1698: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:16.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:16 smithi026 ceph-mon[96795]: pgmap v1698: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:18.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:18 smithi194 ceph-mon[65619]: pgmap v1699: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:18.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:18 smithi026 ceph-mon[96795]: pgmap v1699: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:19.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:19 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:51:19.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:19 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:51:20.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:20 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:51:20.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:20 smithi194 ceph-mon[65619]: pgmap v1700: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:20.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:20 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:51:20.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:20 smithi026 ceph-mon[96795]: pgmap v1700: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:22.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:22 smithi194 ceph-mon[65619]: pgmap v1701: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:22.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:22 smithi026 ceph-mon[96795]: pgmap v1701: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:24.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:24 smithi194 ceph-mon[65619]: pgmap v1702: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:24.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:24 smithi026 ceph-mon[96795]: pgmap v1702: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:26.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:26 smithi194 ceph-mon[65619]: pgmap v1703: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:26.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:26 smithi026 ceph-mon[96795]: pgmap v1703: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:28.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:28 smithi194 ceph-mon[65619]: pgmap v1704: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:28.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:28 smithi026 ceph-mon[96795]: pgmap v1704: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:30.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:30 smithi194 ceph-mon[65619]: pgmap v1705: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:30.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:30 smithi026 ceph-mon[96795]: pgmap v1705: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:32.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:32 smithi026 ceph-mon[96795]: pgmap v1706: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:32.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:32 smithi194 ceph-mon[65619]: pgmap v1706: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:33.932 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:33.936+0000 7f41c7da1700 1 -- 172.21.15.26:0/3956832571 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41c00f5340 msgr2=0x7f41c00f7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:51:33.933 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:33.936+0000 7f41c7da1700 1 --2- 172.21.15.26:0/3956832571 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41c00f5340 0x7f41c00f7ac0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7f41b0004660 tx=0x7f41b0009b30).stop 2021-11-03T17:51:33.933 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:33.936+0000 7f41c7da1700 1 -- 172.21.15.26:0/3956832571 shutdown_connections 2021-11-03T17:51:33.933 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:33.936+0000 7f41c7da1700 1 --2- 172.21.15.26:0/3956832571 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41c00f5340 0x7f41c00f7ac0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:33.933 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:33.936+0000 7f41c7da1700 1 --2- 172.21.15.26:0/3956832571 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41c00f49a0 0x7f41c00f4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:33.934 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:33.936+0000 7f41c7da1700 1 -- 172.21.15.26:0/3956832571 >> 172.21.15.26:0/3956832571 conn(0x7f41c00f04c0 msgr2=0x7f41c00f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:51:33.934 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:33.936+0000 7f41c7da1700 1 -- 172.21.15.26:0/3956832571 shutdown_connections 2021-11-03T17:51:33.934 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:33.936+0000 7f41c7da1700 1 -- 172.21.15.26:0/3956832571 wait complete. 2021-11-03T17:51:33.934 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:33.937+0000 7f41c7da1700 1 Processor -- start 2021-11-03T17:51:33.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:33.937+0000 7f41c7da1700 1 -- start start 2021-11-03T17:51:33.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:33.937+0000 7f41c7da1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41c00f49a0 0x7f41c0106fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:51:33.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:33.937+0000 7f41c7da1700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41c00f5340 0x7f41c0107490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:51:33.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:33.937+0000 7f41c7da1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c0107a40 con 0x7f41c00f49a0 2021-11-03T17:51:33.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:33.937+0000 7f41c7da1700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c0107b80 con 0x7f41c00f5340 2021-11-03T17:51:33.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:33.937+0000 7f41c5b3d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41c00f49a0 0x7f41c0106fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:51:33.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:33.937+0000 7f41c5b3d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41c00f49a0 0x7f41c0106fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56750/0 (socket says 172.21.15.26:56750) 2021-11-03T17:51:33.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:33.937+0000 7f41c5b3d700 1 -- 172.21.15.26:0/2895187757 learned_addr learned my addr 172.21.15.26:0/2895187757 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:51:33.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:33.937+0000 7f41c533c700 1 --2- 172.21.15.26:0/2895187757 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41c00f5340 0x7f41c0107490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:51:33.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:33.938+0000 7f41c5b3d700 1 -- 172.21.15.26:0/2895187757 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41c00f5340 msgr2=0x7f41c0107490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:51:33.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:33.938+0000 7f41c5b3d700 1 --2- 172.21.15.26:0/2895187757 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41c00f5340 0x7f41c0107490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:33.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:33.938+0000 7f41c5b3d700 1 -- 172.21.15.26:0/2895187757 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b0005040 con 0x7f41c00f49a0 2021-11-03T17:51:33.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:33.938+0000 7f41c5b3d700 1 --2- 172.21.15.26:0/2895187757 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41c00f49a0 0x7f41c0106fa0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7f41bc002700 tx=0x7f41bc009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:51:33.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:33.938+0000 7f41b67fc700 1 -- 172.21.15.26:0/2895187757 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41bc009320 con 0x7f41c00f49a0 2021-11-03T17:51:33.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:33.938+0000 7f41c7da1700 1 -- 172.21.15.26:0/2895187757 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41c0108520 con 0x7f41c00f49a0 2021-11-03T17:51:33.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:33.938+0000 7f41b67fc700 1 -- 172.21.15.26:0/2895187757 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f41bc00f040 con 0x7f41c00f49a0 2021-11-03T17:51:33.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:33.938+0000 7f41b67fc700 1 -- 172.21.15.26:0/2895187757 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41bc014900 con 0x7f41c00f49a0 2021-11-03T17:51:33.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:33.938+0000 7f41c7da1700 1 -- 172.21.15.26:0/2895187757 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41c0108ae0 con 0x7f41c00f49a0 2021-11-03T17:51:33.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:33.939+0000 7f41c7da1700 1 -- 172.21.15.26:0/2895187757 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41c0045ad0 con 0x7f41c00f49a0 2021-11-03T17:51:33.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:33.940+0000 7f41b67fc700 1 -- 172.21.15.26:0/2895187757 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f41bc009480 con 0x7f41c00f49a0 2021-11-03T17:51:33.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:33.940+0000 7f41b67fc700 1 --2- 172.21.15.26:0/2895187757 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f41ac0640b0 0x7f41ac066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:51:33.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:33.940+0000 7f41b67fc700 1 -- 172.21.15.26:0/2895187757 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f41bc080dd0 con 0x7f41c00f49a0 2021-11-03T17:51:33.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:33.940+0000 7f41c533c700 1 --2- 172.21.15.26:0/2895187757 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f41ac0640b0 0x7f41ac066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:51:33.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:33.941+0000 7f41c533c700 1 --2- 172.21.15.26:0/2895187757 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f41ac0640b0 0x7f41ac066570 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f41b0004630 tx=0x7f41b0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:51:33.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:33.944+0000 7f41b67fc700 1 -- 172.21.15.26:0/2895187757 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f41bc0531e0 con 0x7f41c00f49a0 2021-11-03T17:51:34.119 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.125+0000 7f41c7da1700 1 -- 172.21.15.26:0/2895187757 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f41c0108dc0 con 0x7f41ac0640b0 2021-11-03T17:51:34.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.126+0000 7f41b67fc700 1 -- 172.21.15.26:0/2895187757 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f41c0108dc0 con 0x7f41ac0640b0 2021-11-03T17:51:34.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.128+0000 7f41c7da1700 1 -- 172.21.15.26:0/2895187757 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f41ac0640b0 msgr2=0x7f41ac066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:51:34.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.128+0000 7f41c7da1700 1 --2- 172.21.15.26:0/2895187757 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f41ac0640b0 0x7f41ac066570 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f41b0004630 tx=0x7f41b0009b30).stop 2021-11-03T17:51:34.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.128+0000 7f41c7da1700 1 -- 172.21.15.26:0/2895187757 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41c00f49a0 msgr2=0x7f41c0106fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:51:34.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.128+0000 7f41c7da1700 1 --2- 172.21.15.26:0/2895187757 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41c00f49a0 0x7f41c0106fa0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7f41bc002700 tx=0x7f41bc009d80).stop 2021-11-03T17:51:34.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.128+0000 7f41c7da1700 1 -- 172.21.15.26:0/2895187757 shutdown_connections 2021-11-03T17:51:34.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.128+0000 7f41c7da1700 1 --2- 172.21.15.26:0/2895187757 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f41ac0640b0 0x7f41ac066570 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:34.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.128+0000 7f41c7da1700 1 --2- 172.21.15.26:0/2895187757 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41c00f49a0 0x7f41c0106fa0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:34.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.128+0000 7f41c7da1700 1 --2- 172.21.15.26:0/2895187757 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41c00f5340 0x7f41c0107490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:34.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.128+0000 7f41c7da1700 1 -- 172.21.15.26:0/2895187757 >> 172.21.15.26:0/2895187757 conn(0x7f41c00f04c0 msgr2=0x7f41c00fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:51:34.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.128+0000 7f41c7da1700 1 -- 172.21.15.26:0/2895187757 shutdown_connections 2021-11-03T17:51:34.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.128+0000 7f41c7da1700 1 -- 172.21.15.26:0/2895187757 wait complete. 2021-11-03T17:51:34.132 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:51:34.235 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.238+0000 7f40cf653700 1 -- 172.21.15.26:0/296719648 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40c80f5bd0 msgr2=0x7f40c80f5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:51:34.236 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.238+0000 7f40cf653700 1 --2- 172.21.15.26:0/296719648 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40c80f5bd0 0x7f40c80f5ff0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7f40c4004660 tx=0x7f40c4009b30).stop 2021-11-03T17:51:34.236 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.239+0000 7f40cf653700 1 -- 172.21.15.26:0/296719648 shutdown_connections 2021-11-03T17:51:34.236 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.239+0000 7f40cf653700 1 --2- 172.21.15.26:0/296719648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40c80f64e0 0x7f40c80f6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:34.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.239+0000 7f40cf653700 1 --2- 172.21.15.26:0/296719648 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40c80f5bd0 0x7f40c80f5ff0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:34.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.239+0000 7f40cf653700 1 -- 172.21.15.26:0/296719648 >> 172.21.15.26:0/296719648 conn(0x7f40c80f0540 msgr2=0x7f40c80f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:51:34.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.239+0000 7f40cf653700 1 -- 172.21.15.26:0/296719648 shutdown_connections 2021-11-03T17:51:34.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.239+0000 7f40cf653700 1 -- 172.21.15.26:0/296719648 wait complete. 2021-11-03T17:51:34.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.239+0000 7f40cf653700 1 Processor -- start 2021-11-03T17:51:34.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.239+0000 7f40cf653700 1 -- start start 2021-11-03T17:51:34.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.240+0000 7f40cf653700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40c80f64e0 0x7f40c810c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:51:34.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.240+0000 7f40cf653700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40c80f5590 0x7f40c810e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:51:34.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.240+0000 7f40cf653700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c8107c40 con 0x7f40c80f5590 2021-11-03T17:51:34.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.240+0000 7f40cf653700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c810ebf0 con 0x7f40c80f64e0 2021-11-03T17:51:34.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.240+0000 7f40ccbee700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40c80f5590 0x7f40c810e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:51:34.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.240+0000 7f40ccbee700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40c80f5590 0x7f40c810e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56762/0 (socket says 172.21.15.26:56762) 2021-11-03T17:51:34.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.240+0000 7f40ccbee700 1 -- 172.21.15.26:0/3591845985 learned_addr learned my addr 172.21.15.26:0/3591845985 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:51:34.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.240+0000 7f40cd3ef700 1 --2- 172.21.15.26:0/3591845985 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40c80f64e0 0x7f40c810c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:51:34.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.240+0000 7f40ccbee700 1 -- 172.21.15.26:0/3591845985 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40c80f64e0 msgr2=0x7f40c810c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:51:34.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.240+0000 7f40ccbee700 1 --2- 172.21.15.26:0/3591845985 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40c80f64e0 0x7f40c810c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:34.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.240+0000 7f40ccbee700 1 -- 172.21.15.26:0/3591845985 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c4005040 con 0x7f40c80f5590 2021-11-03T17:51:34.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.240+0000 7f40ccbee700 1 --2- 172.21.15.26:0/3591845985 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40c80f5590 0x7f40c810e700 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7f40bc0026d0 tx=0x7f40bc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:51:34.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.240+0000 7f40b9ffb700 1 -- 172.21.15.26:0/3591845985 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40bc0079c0 con 0x7f40c80f5590 2021-11-03T17:51:34.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.240+0000 7f40cf653700 1 -- 172.21.15.26:0/3591845985 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40c810ee80 con 0x7f40c80f5590 2021-11-03T17:51:34.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.240+0000 7f40b9ffb700 1 -- 172.21.15.26:0/3591845985 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f40bc00f040 con 0x7f40c80f5590 2021-11-03T17:51:34.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.240+0000 7f40b9ffb700 1 -- 172.21.15.26:0/3591845985 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40bc0148b0 con 0x7f40c80f5590 2021-11-03T17:51:34.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.241+0000 7f40cf653700 1 -- 172.21.15.26:0/3591845985 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40c810f410 con 0x7f40c80f5590 2021-11-03T17:51:34.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.241+0000 7f40cf653700 1 -- 172.21.15.26:0/3591845985 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40c8045ad0 con 0x7f40c80f5590 2021-11-03T17:51:34.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.242+0000 7f40b9ffb700 1 -- 172.21.15.26:0/3591845985 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f40bc007b20 con 0x7f40c80f5590 2021-11-03T17:51:34.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.243+0000 7f40b9ffb700 1 --2- 172.21.15.26:0/3591845985 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f40b40640b0 0x7f40b4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:51:34.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.243+0000 7f40b9ffb700 1 -- 172.21.15.26:0/3591845985 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f40bc080b50 con 0x7f40c80f5590 2021-11-03T17:51:34.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.243+0000 7f40cd3ef700 1 --2- 172.21.15.26:0/3591845985 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f40b40640b0 0x7f40b4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:51:34.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.243+0000 7f40cd3ef700 1 --2- 172.21.15.26:0/3591845985 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f40b40640b0 0x7f40b4066570 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f40c4000c00 tx=0x7f40c4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:51:34.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.246+0000 7f40b9ffb700 1 -- 172.21.15.26:0/3591845985 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f40bc052eb0 con 0x7f40c80f5590 2021-11-03T17:51:34.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.427+0000 7f40cf653700 1 -- 172.21.15.26:0/3591845985 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f40c8057f10 con 0x7f40b40640b0 2021-11-03T17:51:34.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.444+0000 7f40b9ffb700 1 -- 172.21.15.26:0/3591845985 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f40c8057f10 con 0x7f40b40640b0 2021-11-03T17:51:34.439 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:51:34.439 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (62m) 2m ago 64m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:51:34.439 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (55m) 2m ago 64m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:51:34.440 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (54m) 60s ago 63m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:51:34.440 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (62m) 2m ago 63m 41.4M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:51:34.440 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (55m) 2m ago 59m 25.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:51:34.440 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (56m) 2m ago 59m 26.0M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:51:34.440 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (59m) 60s ago 59m 26.2M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:51:34.441 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (59m) 60s ago 59m 26.5M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:51:34.441 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (56m) 2m ago 65m 547M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:51:34.441 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (56m) 60s ago 63m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:51:34.441 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (55m) 2m ago 65m 242M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:51:34.442 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (55m) 60s ago 63m 117M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:51:34.442 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (63m) 2m ago 63m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:51:34.442 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (63m) 60s ago 63m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:51:34.442 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (54m) 2m ago 62m 271M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:51:34.443 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (54m) 2m ago 62m 291M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:51:34.443 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (53m) 2m ago 61m 243M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:51:34.443 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (53m) 60s ago 61m 312M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:51:34.443 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (52m) 60s ago 61m 265M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:51:34.444 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (52m) 60s ago 60m 255M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:51:34.444 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (62m) 2m ago 63m 58.9M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:51:34.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.446+0000 7f40cf653700 1 -- 172.21.15.26:0/3591845985 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f40b40640b0 msgr2=0x7f40b4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:51:34.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.446+0000 7f40cf653700 1 --2- 172.21.15.26:0/3591845985 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f40b40640b0 0x7f40b4066570 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f40c4000c00 tx=0x7f40c4009b30).stop 2021-11-03T17:51:34.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.446+0000 7f40cf653700 1 -- 172.21.15.26:0/3591845985 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40c80f5590 msgr2=0x7f40c810e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:51:34.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.446+0000 7f40cf653700 1 --2- 172.21.15.26:0/3591845985 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40c80f5590 0x7f40c810e700 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7f40bc0026d0 tx=0x7f40bc009de0).stop 2021-11-03T17:51:34.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.446+0000 7f40cf653700 1 -- 172.21.15.26:0/3591845985 shutdown_connections 2021-11-03T17:51:34.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.446+0000 7f40cf653700 1 --2- 172.21.15.26:0/3591845985 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f40b40640b0 0x7f40b4066570 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:34.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.446+0000 7f40cf653700 1 --2- 172.21.15.26:0/3591845985 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40c80f64e0 0x7f40c810c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:34.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.446+0000 7f40cf653700 1 --2- 172.21.15.26:0/3591845985 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40c80f5590 0x7f40c810e700 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:34.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.446+0000 7f40cf653700 1 -- 172.21.15.26:0/3591845985 >> 172.21.15.26:0/3591845985 conn(0x7f40c80f0540 msgr2=0x7f40c80fa470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:51:34.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.446+0000 7f40cf653700 1 -- 172.21.15.26:0/3591845985 shutdown_connections 2021-11-03T17:51:34.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.446+0000 7f40cf653700 1 -- 172.21.15.26:0/3591845985 wait complete. 2021-11-03T17:51:34.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.556+0000 7f0fa949f700 1 -- 172.21.15.26:0/3968256388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fa40f8610 msgr2=0x7f0fa40f4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:51:34.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.556+0000 7f0fa949f700 1 --2- 172.21.15.26:0/3968256388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fa40f8610 0x7f0fa40f4820 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7f0f94004660 tx=0x7f0f94009b30).stop 2021-11-03T17:51:34.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.556+0000 7f0fa949f700 1 -- 172.21.15.26:0/3968256388 shutdown_connections 2021-11-03T17:51:34.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.556+0000 7f0fa949f700 1 --2- 172.21.15.26:0/3968256388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fa40f8610 0x7f0fa40f4820 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:34.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.556+0000 7f0fa949f700 1 --2- 172.21.15.26:0/3968256388 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0fa40f7d00 0x7f0fa40f8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:51:34.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.556+0000 7f0fa949f700 1 -- 172.21.15.26:0/3968256388 >> 172.21.15.26:0/3968256388 conn(0x7f0fa40f0540 msgr2=0x7f0fa40f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:51:34.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.556+0000 7f0fa949f700 1 -- 172.21.15.26:0/3968256388 shutdown_connections 2021-11-03T17:51:34.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.556+0000 7f0fa949f700 1 -- 172.21.15.26:0/3968256388 wait complete. 2021-11-03T17:51:34.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.556+0000 7f0fa949f700 1 Processor -- start 2021-11-03T17:51:34.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.556+0000 7f0fa949f700 1 -- start start 2021-11-03T17:51:34.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.557+0000 7f0fa949f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0fa40f7d00 0x7f0fa40f75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:51:34.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.557+0000 7f0fa949f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fa40f8610 0x7f0fa40f5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:51:34.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.557+0000 7f0fa949f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa40f6040 con 0x7f0fa40f8610 2021-11-03T17:51:34.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.557+0000 7f0fa949f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa40f6180 con 0x7f0fa40f7d00 2021-11-03T17:51:34.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.557+0000 7f0fa27fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fa40f8610 0x7f0fa40f5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:51:34.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.557+0000 7f0fa27fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fa40f8610 0x7f0fa40f5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56770/0 (socket says 172.21.15.26:56770) 2021-11-03T17:51:34.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.557+0000 7f0fa27fc700 1 -- 172.21.15.26:0/400386600 learned_addr learned my addr 172.21.15.26:0/400386600 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:51:34.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.557+0000 7f0fa2ffd700 1 --2- 172.21.15.26:0/400386600 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0fa40f7d00 0x7f0fa40f75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:51:34.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.557+0000 7f0fa27fc700 1 -- 172.21.15.26:0/400386600 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0fa40f7d00 msgr2=0x7f0fa40f75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:51:34.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.557+0000 7f0fa27fc700 1 --2- 172.21.15.26:0/400386600 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0fa40f7d00 0x7f0fa40f75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:34.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.557+0000 7f0fa27fc700 1 -- 172.21.15.26:0/400386600 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f94005040 con 0x7f0fa40f8610 2021-11-03T17:51:34.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.557+0000 7f0fa27fc700 1 --2- 172.21.15.26:0/400386600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fa40f8610 0x7f0fa40f5a50 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7f0f94009990 tx=0x7f0f94009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:51:34.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.557+0000 7f0f9b7fe700 1 -- 172.21.15.26:0/400386600 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f94018070 con 0x7f0fa40f8610 2021-11-03T17:51:34.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.558+0000 7f0fa949f700 1 -- 172.21.15.26:0/400386600 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa40f6400 con 0x7f0fa40f8610 2021-11-03T17:51:34.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.558+0000 7f0f9b7fe700 1 -- 172.21.15.26:0/400386600 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0f94007ba0 con 0x7f0fa40f8610 2021-11-03T17:51:34.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.558+0000 7f0fa949f700 1 -- 172.21.15.26:0/400386600 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa410ef80 con 0x7f0fa40f8610 2021-11-03T17:51:34.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.558+0000 7f0f9b7fe700 1 -- 172.21.15.26:0/400386600 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f9401c620 con 0x7f0fa40f8610 2021-11-03T17:51:34.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.559+0000 7f0fa949f700 1 -- 172.21.15.26:0/400386600 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fa4045ad0 con 0x7f0fa40f8610 2021-11-03T17:51:34.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.559+0000 7f0f9b7fe700 1 -- 172.21.15.26:0/400386600 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f0f9401c890 con 0x7f0fa40f8610 2021-11-03T17:51:34.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.560+0000 7f0f9b7fe700 1 --2- 172.21.15.26:0/400386600 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0f900640b0 0x7f0f90066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:51:34.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.560+0000 7f0f9b7fe700 1 -- 172.21.15.26:0/400386600 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f0f94082570 con 0x7f0fa40f8610 2021-11-03T17:51:34.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.560+0000 7f0fa2ffd700 1 --2- 172.21.15.26:0/400386600 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0f900640b0 0x7f0f90066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:51:34.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.560+0000 7f0fa2ffd700 1 --2- 172.21.15.26:0/400386600 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0f900640b0 0x7f0f90066570 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f0fa40f7360 tx=0x7f0f8c008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:51:34.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.564+0000 7f0f9b7fe700 1 -- 172.21.15.26:0/400386600 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f0f940548d0 con 0x7f0fa40f8610 2021-11-03T17:51:34.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.802+0000 7f0fa949f700 1 -- 172.21.15.26:0/400386600 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0fa40fefd0 con 0x7f0fa40f8610 2021-11-03T17:51:34.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.803+0000 7f0f9b7fe700 1 -- 172.21.15.26:0/400386600 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f0f940544c0 con 0x7f0fa40f8610 2021-11-03T17:51:34.798 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:51:34.799 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:51:34.799 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:51:34.799 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:51:34.799 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:51:34.800 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:51:34.800 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:51:34.800 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:51:34.800 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:51:34.801 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:51:34.801 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:51:34.801 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:51:34.801 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:51:34.802 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:51:34.802 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:51:34.802 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:51:34.802 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:51:34.803 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:51:34.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.805+0000 7f0fa949f700 1 -- 172.21.15.26:0/400386600 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0f900640b0 msgr2=0x7f0f90066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:51:34.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.805+0000 7f0fa949f700 1 --2- 172.21.15.26:0/400386600 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0f900640b0 0x7f0f90066570 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f0fa40f7360 tx=0x7f0f8c008040).stop 2021-11-03T17:51:34.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.805+0000 7f0fa949f700 1 -- 172.21.15.26:0/400386600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fa40f8610 msgr2=0x7f0fa40f5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:51:34.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.805+0000 7f0fa949f700 1 --2- 172.21.15.26:0/400386600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fa40f8610 0x7f0fa40f5a50 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7f0f94009990 tx=0x7f0f94009b30).stop 2021-11-03T17:51:34.805 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.805+0000 7f0fa949f700 1 -- 172.21.15.26:0/400386600 shutdown_connections 2021-11-03T17:51:34.805 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.805+0000 7f0fa949f700 1 --2- 172.21.15.26:0/400386600 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0f900640b0 0x7f0f90066570 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:34.805 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.805+0000 7f0fa949f700 1 --2- 172.21.15.26:0/400386600 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0fa40f7d00 0x7f0fa40f75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:34.805 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.805+0000 7f0fa949f700 1 --2- 172.21.15.26:0/400386600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fa40f8610 0x7f0fa40f5a50 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:34.806 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.805+0000 7f0fa949f700 1 -- 172.21.15.26:0/400386600 >> 172.21.15.26:0/400386600 conn(0x7f0fa40f0540 msgr2=0x7f0fa40fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:51:34.806 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.805+0000 7f0fa949f700 1 -- 172.21.15.26:0/400386600 shutdown_connections 2021-11-03T17:51:34.806 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.805+0000 7f0fa949f700 1 -- 172.21.15.26:0/400386600 wait complete. 2021-11-03T17:51:34.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:34 smithi026 ceph-mon[96795]: pgmap v1707: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:34.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:34 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:51:34.932 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.938+0000 7fc5ff2fa700 1 -- 172.21.15.26:0/219235359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5f80f55c0 msgr2=0x7fc5f80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:51:34.933 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.938+0000 7fc5ff2fa700 1 --2- 172.21.15.26:0/219235359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5f80f55c0 0x7fc5f80f59e0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7fc5f4004660 tx=0x7fc5f4009b30).stop 2021-11-03T17:51:34.933 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.938+0000 7fc5ff2fa700 1 -- 172.21.15.26:0/219235359 shutdown_connections 2021-11-03T17:51:34.933 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.938+0000 7fc5ff2fa700 1 --2- 172.21.15.26:0/219235359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5f80f6860 0x7fc5f80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:34.934 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.938+0000 7fc5ff2fa700 1 --2- 172.21.15.26:0/219235359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5f80f55c0 0x7fc5f80f59e0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:34.934 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.938+0000 7fc5ff2fa700 1 -- 172.21.15.26:0/219235359 >> 172.21.15.26:0/219235359 conn(0x7fc5f80f0d40 msgr2=0x7fc5f80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:51:34.934 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.938+0000 7fc5ff2fa700 1 -- 172.21.15.26:0/219235359 shutdown_connections 2021-11-03T17:51:34.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.938+0000 7fc5ff2fa700 1 -- 172.21.15.26:0/219235359 wait complete. 2021-11-03T17:51:34.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.939+0000 7fc5ff2fa700 1 Processor -- start 2021-11-03T17:51:34.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.939+0000 7fc5ff2fa700 1 -- start start 2021-11-03T17:51:34.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.939+0000 7fc5ff2fa700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5f80f55c0 0x7fc5f805fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:51:34.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.939+0000 7fc5ff2fa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5f80f6860 0x7fc5f8068920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:51:34.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.939+0000 7fc5ff2fa700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f80604e0 con 0x7fc5f80f6860 2021-11-03T17:51:34.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.939+0000 7fc5ff2fa700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f8068e10 con 0x7fc5f80f55c0 2021-11-03T17:51:34.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.939+0000 7fc5fc895700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5f80f6860 0x7fc5f8068920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:51:34.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.939+0000 7fc5fc895700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5f80f6860 0x7fc5f8068920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56782/0 (socket says 172.21.15.26:56782) 2021-11-03T17:51:34.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.939+0000 7fc5fc895700 1 -- 172.21.15.26:0/4207335876 learned_addr learned my addr 172.21.15.26:0/4207335876 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:51:34.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.939+0000 7fc5fd096700 1 --2- 172.21.15.26:0/4207335876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5f80f55c0 0x7fc5f805fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:51:34.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.939+0000 7fc5fc895700 1 -- 172.21.15.26:0/4207335876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5f80f55c0 msgr2=0x7fc5f805fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:51:34.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.939+0000 7fc5fc895700 1 --2- 172.21.15.26:0/4207335876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5f80f55c0 0x7fc5f805fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:34.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.939+0000 7fc5fc895700 1 -- 172.21.15.26:0/4207335876 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f4005040 con 0x7fc5f80f6860 2021-11-03T17:51:34.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.939+0000 7fc5fc895700 1 --2- 172.21.15.26:0/4207335876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5f80f6860 0x7fc5f8068920 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 rx=0x7fc5e800e7f0 tx=0x7fc5e800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:51:34.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.940+0000 7fc5edffb700 1 -- 172.21.15.26:0/4207335876 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5e80092e0 con 0x7fc5f80f6860 2021-11-03T17:51:34.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.940+0000 7fc5ff2fa700 1 -- 172.21.15.26:0/4207335876 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5f80690f0 con 0x7fc5f80f6860 2021-11-03T17:51:34.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.940+0000 7fc5edffb700 1 -- 172.21.15.26:0/4207335876 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc5e800f040 con 0x7fc5f80f6860 2021-11-03T17:51:34.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.940+0000 7fc5edffb700 1 -- 172.21.15.26:0/4207335876 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5e8014750 con 0x7fc5f80f6860 2021-11-03T17:51:34.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.940+0000 7fc5ff2fa700 1 -- 172.21.15.26:0/4207335876 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5f80696b0 con 0x7fc5f80f6860 2021-11-03T17:51:34.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.941+0000 7fc5ff2fa700 1 -- 172.21.15.26:0/4207335876 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5f80f49b0 con 0x7fc5f80f6860 2021-11-03T17:51:34.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.941+0000 7fc5edffb700 1 -- 172.21.15.26:0/4207335876 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc5e801b030 con 0x7fc5f80f6860 2021-11-03T17:51:34.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.942+0000 7fc5edffb700 1 --2- 172.21.15.26:0/4207335876 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc5e40640b0 0x7fc5e4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:51:34.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.942+0000 7fc5edffb700 1 -- 172.21.15.26:0/4207335876 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc5e8080660 con 0x7fc5f80f6860 2021-11-03T17:51:34.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.942+0000 7fc5fd096700 1 --2- 172.21.15.26:0/4207335876 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc5e40640b0 0x7fc5e4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:51:34.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.942+0000 7fc5fd096700 1 --2- 172.21.15.26:0/4207335876 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc5e40640b0 0x7fc5e4066570 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7fc5f4000c00 tx=0x7fc5f400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:51:34.943 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:34.946+0000 7fc5edffb700 1 -- 172.21.15.26:0/4207335876 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc5e8052980 con 0x7fc5f80f6860 2021-11-03T17:51:34.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:34 smithi194 ceph-mon[65619]: pgmap v1707: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:34.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:34 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:51:35.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:35.163+0000 7fc5ff2fa700 1 -- 172.21.15.26:0/4207335876 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc5f80fdd80 con 0x7fc5f80f6860 2021-11-03T17:51:35.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:35.166+0000 7fc5edffb700 1 -- 172.21.15.26:0/4207335876 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fc5e8019070 con 0x7fc5f80f6860 2021-11-03T17:51:35.161 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:51:35.161 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:51:35.162 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:51:35.162 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:51:35.162 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:51:35.162 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:51:35.162 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:51:35.163 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:51:35.163 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:51:35.163 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:51:35.163 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:51:35.164 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:51:35.164 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:51:35.164 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:51:35.164 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:51:35.164 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:51:35.165 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:51:35.165 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:51:35.165 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:51:35.165 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:51:35.166 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:51:35.166 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:51:35.166 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:51:35.166 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:51:35.167 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:51:35.167 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:51:35.167 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:51:35.167 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:51:35.167 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:51:35.168 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:51:35.168 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:51:35.168 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:51:35.168 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:51:35.169 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:51:35.169 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:51:35.169 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:51:35.169 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:51:35.169 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:51:35.170 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:51:35.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:35.170+0000 7fc5ff2fa700 1 -- 172.21.15.26:0/4207335876 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc5e40640b0 msgr2=0x7fc5e4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:51:35.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:35.171+0000 7fc5ff2fa700 1 --2- 172.21.15.26:0/4207335876 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc5e40640b0 0x7fc5e4066570 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7fc5f4000c00 tx=0x7fc5f400b040).stop 2021-11-03T17:51:35.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:35.171+0000 7fc5ff2fa700 1 -- 172.21.15.26:0/4207335876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5f80f6860 msgr2=0x7fc5f8068920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:51:35.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:35.171+0000 7fc5ff2fa700 1 --2- 172.21.15.26:0/4207335876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5f80f6860 0x7fc5f8068920 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 rx=0x7fc5e800e7f0 tx=0x7fc5e800b040).stop 2021-11-03T17:51:35.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:35.171+0000 7fc5ff2fa700 1 -- 172.21.15.26:0/4207335876 shutdown_connections 2021-11-03T17:51:35.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:35.171+0000 7fc5ff2fa700 1 --2- 172.21.15.26:0/4207335876 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc5e40640b0 0x7fc5e4066570 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:35.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:35.171+0000 7fc5ff2fa700 1 --2- 172.21.15.26:0/4207335876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5f80f55c0 0x7fc5f805fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:35.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:35.171+0000 7fc5ff2fa700 1 --2- 172.21.15.26:0/4207335876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5f80f6860 0x7fc5f8068920 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:51:35.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:35.171+0000 7fc5ff2fa700 1 -- 172.21.15.26:0/4207335876 >> 172.21.15.26:0/4207335876 conn(0x7fc5f80f0d40 msgr2=0x7fc5f80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:51:35.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:35.171+0000 7fc5ff2fa700 1 -- 172.21.15.26:0/4207335876 shutdown_connections 2021-11-03T17:51:35.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:51:35.171+0000 7fc5ff2fa700 1 -- 172.21.15.26:0/4207335876 wait complete. 2021-11-03T17:51:35.173 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:51:35.854 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:35 smithi026 ceph-mon[96795]: from='client.35900 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:51:35.855 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:35 smithi026 ceph-mon[96795]: poll took 60085.439 ms: 1 events 2021-11-03T17:51:35.855 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:35 smithi026 ceph-mon[96795]: from='client.35904 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:51:35.855 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:35 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/400386600' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:51:35.855 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:35 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/4207335876' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:51:35.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:35 smithi194 ceph-mon[65619]: from='client.35900 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:51:35.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:35 smithi194 ceph-mon[65619]: poll took 60085.439 ms: 1 events 2021-11-03T17:51:35.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:35 smithi194 ceph-mon[65619]: from='client.35904 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:51:35.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:35 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/400386600' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:51:35.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:35 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/4207335876' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:51:36.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:36 smithi026 ceph-mon[96795]: pgmap v1708: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:36.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:36 smithi194 ceph-mon[65619]: pgmap v1708: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:38.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:38 smithi026 ceph-mon[96795]: pgmap v1709: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:38.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:38 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:51:38.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:38 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:51:38.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:38 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:51:38.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:38 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:51:38.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:38 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:51:38.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:38 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:51:38.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:38 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:51:38.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:38 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:51:38.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:38 smithi194 ceph-mon[65619]: pgmap v1709: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:38.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:38 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:51:38.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:38 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:51:38.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:38 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:51:38.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:38 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:51:38.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:38 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:51:38.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:38 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:51:39.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:38 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:51:39.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:38 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:51:39.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:39 smithi026 ceph-mon[96795]: poll took 3031.806 ms: 1 events 2021-11-03T17:51:39.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:39 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:51:39.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:39 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:51:39.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:39 smithi194 ceph-mon[65619]: poll took 3031.806 ms: 1 events 2021-11-03T17:51:39.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:39 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:51:39.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:39 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:51:40.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:40 smithi026 ceph-mon[96795]: pgmap v1710: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:40.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:40 smithi194 ceph-mon[65619]: pgmap v1710: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:42.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:42 smithi026 ceph-mon[96795]: pgmap v1711: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:42.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:42 smithi194 ceph-mon[65619]: pgmap v1711: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:44.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:44 smithi026 ceph-mon[96795]: pgmap v1712: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:44.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:44 smithi194 ceph-mon[65619]: pgmap v1712: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:46.912 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:46 smithi026 ceph-mon[96795]: pgmap v1713: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:46.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:46 smithi194 ceph-mon[65619]: pgmap v1713: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:48.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:48 smithi026 ceph-mon[96795]: pgmap v1714: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:48.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:51:48.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:51:48.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:48 smithi194 ceph-mon[65619]: pgmap v1714: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:48.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:51:48.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:51:50.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:50 smithi026 ceph-mon[96795]: pgmap v1715: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:50.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:50 smithi194 ceph-mon[65619]: pgmap v1715: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:52.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:52 smithi026 ceph-mon[96795]: pgmap v1716: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:52.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:52 smithi194 ceph-mon[65619]: pgmap v1716: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:53.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:53 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:51:53.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:53 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:51:54.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:54 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:51:54.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:54 smithi026 ceph-mon[96795]: pgmap v1717: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:54.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:54 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:51:54.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:54 smithi194 ceph-mon[65619]: pgmap v1717: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:56.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:56 smithi026 ceph-mon[96795]: pgmap v1718: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:56.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:56 smithi194 ceph-mon[65619]: pgmap v1718: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:58.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:51:58 smithi026 ceph-mon[96795]: pgmap v1719: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:51:58.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:51:58 smithi194 ceph-mon[65619]: pgmap v1719: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:00.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:00 smithi026 ceph-mon[96795]: pgmap v1720: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:00.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:00 smithi194 ceph-mon[65619]: pgmap v1720: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:02.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:02 smithi026 ceph-mon[96795]: pgmap v1721: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:02.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:02 smithi194 ceph-mon[65619]: pgmap v1721: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:04.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:04 smithi026 ceph-mon[96795]: pgmap v1722: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:04.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:04 smithi194 ceph-mon[65619]: pgmap v1722: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:05.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.291+0000 7f75cacc7700 1 -- 172.21.15.26:0/1638321371 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75c40f66e0 msgr2=0x7f75c40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:52:05.290 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.291+0000 7f75cacc7700 1 --2- 172.21.15.26:0/1638321371 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75c40f66e0 0x7f75c40f6b00 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7f75b8004660 tx=0x7f75b8009b30).stop 2021-11-03T17:52:05.290 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.291+0000 7f75cacc7700 1 -- 172.21.15.26:0/1638321371 shutdown_connections 2021-11-03T17:52:05.290 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.291+0000 7f75cacc7700 1 --2- 172.21.15.26:0/1638321371 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75c40f7980 0x7f75c40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:05.291 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.291+0000 7f75cacc7700 1 --2- 172.21.15.26:0/1638321371 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75c40f66e0 0x7f75c40f6b00 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:05.291 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.291+0000 7f75cacc7700 1 -- 172.21.15.26:0/1638321371 >> 172.21.15.26:0/1638321371 conn(0x7f75c40f1e40 msgr2=0x7f75c40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:52:05.291 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.292+0000 7f75cacc7700 1 -- 172.21.15.26:0/1638321371 shutdown_connections 2021-11-03T17:52:05.291 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.292+0000 7f75cacc7700 1 -- 172.21.15.26:0/1638321371 wait complete. 2021-11-03T17:52:05.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.292+0000 7f75cacc7700 1 Processor -- start 2021-11-03T17:52:05.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.292+0000 7f75cacc7700 1 -- start start 2021-11-03T17:52:05.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.292+0000 7f75cacc7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75c40f66e0 0x7f75c406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:52:05.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.292+0000 7f75cacc7700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75c40f7980 0x7f75c4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:52:05.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.292+0000 7f75cacc7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c406a380 con 0x7f75c40f66e0 2021-11-03T17:52:05.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.293+0000 7f75cacc7700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c406a4c0 con 0x7f75c40f7980 2021-11-03T17:52:05.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.293+0000 7f75c8a63700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75c40f66e0 0x7f75c406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:52:05.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.293+0000 7f75c8a63700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75c40f66e0 0x7f75c406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56798/0 (socket says 172.21.15.26:56798) 2021-11-03T17:52:05.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.293+0000 7f75c8a63700 1 -- 172.21.15.26:0/223824303 learned_addr learned my addr 172.21.15.26:0/223824303 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:52:05.294 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.293+0000 7f75c3fff700 1 --2- 172.21.15.26:0/223824303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75c40f7980 0x7f75c4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:52:05.294 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.293+0000 7f75c8a63700 1 -- 172.21.15.26:0/223824303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75c40f7980 msgr2=0x7f75c4069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:52:05.294 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.293+0000 7f75c8a63700 1 --2- 172.21.15.26:0/223824303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75c40f7980 0x7f75c4069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:05.294 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.293+0000 7f75c8a63700 1 -- 172.21.15.26:0/223824303 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b8005040 con 0x7f75c40f66e0 2021-11-03T17:52:05.295 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.293+0000 7f75c8a63700 1 --2- 172.21.15.26:0/223824303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75c40f66e0 0x7f75c406b9a0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7f75b8013a70 tx=0x7f75b8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:52:05.295 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.293+0000 7f75c17fa700 1 -- 172.21.15.26:0/223824303 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75b8018070 con 0x7f75c40f66e0 2021-11-03T17:52:05.295 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.293+0000 7f75c17fa700 1 -- 172.21.15.26:0/223824303 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f75b80097d0 con 0x7f75c40f66e0 2021-11-03T17:52:05.295 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.293+0000 7f75cacc7700 1 -- 172.21.15.26:0/223824303 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75c406a740 con 0x7f75c40f66e0 2021-11-03T17:52:05.295 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.293+0000 7f75cacc7700 1 -- 172.21.15.26:0/223824303 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75c406aca0 con 0x7f75c40f66e0 2021-11-03T17:52:05.296 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.293+0000 7f75c17fa700 1 -- 172.21.15.26:0/223824303 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75b801de80 con 0x7f75c40f66e0 2021-11-03T17:52:05.297 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.294+0000 7f75cacc7700 1 -- 172.21.15.26:0/223824303 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75c4045ad0 con 0x7f75c40f66e0 2021-11-03T17:52:05.297 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.295+0000 7f75c17fa700 1 -- 172.21.15.26:0/223824303 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f75b8007ba0 con 0x7f75c40f66e0 2021-11-03T17:52:05.297 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.295+0000 7f75c17fa700 1 --2- 172.21.15.26:0/223824303 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f75b40640b0 0x7f75b4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:52:05.297 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.295+0000 7f75c17fa700 1 -- 172.21.15.26:0/223824303 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f75b8082310 con 0x7f75c40f66e0 2021-11-03T17:52:05.298 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.295+0000 7f75c3fff700 1 --2- 172.21.15.26:0/223824303 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f75b40640b0 0x7f75b4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:52:05.298 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.296+0000 7f75c3fff700 1 --2- 172.21.15.26:0/223824303 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f75b40640b0 0x7f75b4066570 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f75b0004d80 tx=0x7f75b000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:52:05.298 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.299+0000 7f75c17fa700 1 -- 172.21.15.26:0/223824303 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f75b8054730 con 0x7f75c40f66e0 2021-11-03T17:52:05.474 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.478+0000 7f75cacc7700 1 -- 172.21.15.26:0/223824303 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f75c4057f10 con 0x7f75b40640b0 2021-11-03T17:52:05.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.480+0000 7f75c17fa700 1 -- 172.21.15.26:0/223824303 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f75c4057f10 con 0x7f75b40640b0 2021-11-03T17:52:05.477 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.482+0000 7f75cacc7700 1 -- 172.21.15.26:0/223824303 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f75b40640b0 msgr2=0x7f75b4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:52:05.478 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.482+0000 7f75cacc7700 1 --2- 172.21.15.26:0/223824303 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f75b40640b0 0x7f75b4066570 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f75b0004d80 tx=0x7f75b000b040).stop 2021-11-03T17:52:05.478 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.482+0000 7f75cacc7700 1 -- 172.21.15.26:0/223824303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75c40f66e0 msgr2=0x7f75c406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:52:05.478 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.482+0000 7f75cacc7700 1 --2- 172.21.15.26:0/223824303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75c40f66e0 0x7f75c406b9a0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7f75b8013a70 tx=0x7f75b8009b30).stop 2021-11-03T17:52:05.478 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.482+0000 7f75cacc7700 1 -- 172.21.15.26:0/223824303 shutdown_connections 2021-11-03T17:52:05.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.482+0000 7f75cacc7700 1 --2- 172.21.15.26:0/223824303 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f75b40640b0 0x7f75b4066570 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:05.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.482+0000 7f75cacc7700 1 --2- 172.21.15.26:0/223824303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75c40f66e0 0x7f75c406b9a0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:05.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.482+0000 7f75cacc7700 1 --2- 172.21.15.26:0/223824303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75c40f7980 0x7f75c4069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:05.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.482+0000 7f75cacc7700 1 -- 172.21.15.26:0/223824303 >> 172.21.15.26:0/223824303 conn(0x7f75c40f1e40 msgr2=0x7f75c40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:52:05.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.482+0000 7f75cacc7700 1 -- 172.21.15.26:0/223824303 shutdown_connections 2021-11-03T17:52:05.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.482+0000 7f75cacc7700 1 -- 172.21.15.26:0/223824303 wait complete. 2021-11-03T17:52:05.487 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:52:05.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.583+0000 7f4feb906700 1 -- 172.21.15.26:0/3040954003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fe40f6870 msgr2=0x7f4fe40f6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:52:05.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.583+0000 7f4feb906700 1 --2- 172.21.15.26:0/3040954003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fe40f6870 0x7f4fe40f6cd0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7f4fd4004660 tx=0x7f4fd4009b30).stop 2021-11-03T17:52:05.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.583+0000 7f4feb906700 1 -- 172.21.15.26:0/3040954003 shutdown_connections 2021-11-03T17:52:05.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.583+0000 7f4feb906700 1 --2- 172.21.15.26:0/3040954003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fe40f6870 0x7f4fe40f6cd0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:05.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.583+0000 7f4feb906700 1 --2- 172.21.15.26:0/3040954003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4fe40f55d0 0x7f4fe40f59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:05.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.583+0000 7f4feb906700 1 -- 172.21.15.26:0/3040954003 >> 172.21.15.26:0/3040954003 conn(0x7f4fe40f0d30 msgr2=0x7f4fe40f3150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:52:05.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.583+0000 7f4feb906700 1 -- 172.21.15.26:0/3040954003 shutdown_connections 2021-11-03T17:52:05.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.583+0000 7f4feb906700 1 -- 172.21.15.26:0/3040954003 wait complete. 2021-11-03T17:52:05.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.584+0000 7f4feb906700 1 Processor -- start 2021-11-03T17:52:05.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.584+0000 7f4feb906700 1 -- start start 2021-11-03T17:52:05.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.584+0000 7f4feb906700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4fe40f55d0 0x7f4fe410c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:52:05.584 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.584+0000 7f4feb906700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fe40f6870 0x7f4fe410e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:52:05.584 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.584+0000 7f4feb906700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe40603b0 con 0x7f4fe40f6870 2021-11-03T17:52:05.584 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.584+0000 7f4feb906700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe40604f0 con 0x7f4fe40f55d0 2021-11-03T17:52:05.584 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.584+0000 7f4fe8ea1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fe40f6870 0x7f4fe410e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:52:05.585 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.584+0000 7f4fe8ea1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fe40f6870 0x7f4fe410e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56810/0 (socket says 172.21.15.26:56810) 2021-11-03T17:52:05.585 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.584+0000 7f4fe8ea1700 1 -- 172.21.15.26:0/2469235061 learned_addr learned my addr 172.21.15.26:0/2469235061 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:52:05.585 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.584+0000 7f4fe96a2700 1 --2- 172.21.15.26:0/2469235061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4fe40f55d0 0x7f4fe410c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:52:05.585 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.584+0000 7f4fe8ea1700 1 -- 172.21.15.26:0/2469235061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4fe40f55d0 msgr2=0x7f4fe410c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:52:05.586 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.584+0000 7f4fe8ea1700 1 --2- 172.21.15.26:0/2469235061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4fe40f55d0 0x7f4fe410c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:05.586 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.584+0000 7f4fe8ea1700 1 -- 172.21.15.26:0/2469235061 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd4005040 con 0x7f4fe40f6870 2021-11-03T17:52:05.586 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.585+0000 7f4fe8ea1700 1 --2- 172.21.15.26:0/2469235061 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fe40f6870 0x7f4fe410e580 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7f4fd4009da0 tx=0x7f4fd4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:52:05.586 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.585+0000 7f4fd9ffb700 1 -- 172.21.15.26:0/2469235061 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fd4018070 con 0x7f4fe40f6870 2021-11-03T17:52:05.587 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.585+0000 7f4fd9ffb700 1 -- 172.21.15.26:0/2469235061 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4fd4007cf0 con 0x7f4fe40f6870 2021-11-03T17:52:05.587 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.585+0000 7f4feb906700 1 -- 172.21.15.26:0/2469235061 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fe410ea70 con 0x7f4fe40f6870 2021-11-03T17:52:05.587 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.585+0000 7f4fd9ffb700 1 -- 172.21.15.26:0/2469235061 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fd401c620 con 0x7f4fe40f6870 2021-11-03T17:52:05.587 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.585+0000 7f4feb906700 1 -- 172.21.15.26:0/2469235061 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fe410ee40 con 0x7f4fe40f6870 2021-11-03T17:52:05.588 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.586+0000 7f4feb906700 1 -- 172.21.15.26:0/2469235061 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fe4045ad0 con 0x7f4fe40f6870 2021-11-03T17:52:05.589 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.586+0000 7f4fd9ffb700 1 -- 172.21.15.26:0/2469235061 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f4fd401d420 con 0x7f4fe40f6870 2021-11-03T17:52:05.589 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.587+0000 7f4fd9ffb700 1 --2- 172.21.15.26:0/2469235061 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4fd0064090 0x7f4fd0066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:52:05.589 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.587+0000 7f4fd9ffb700 1 -- 172.21.15.26:0/2469235061 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f4fd4082620 con 0x7f4fe40f6870 2021-11-03T17:52:05.589 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.587+0000 7f4fe96a2700 1 --2- 172.21.15.26:0/2469235061 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4fd0064090 0x7f4fd0066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:52:05.590 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.587+0000 7f4fe96a2700 1 --2- 172.21.15.26:0/2469235061 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4fd0064090 0x7f4fd0066550 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f4fe4060140 tx=0x7f4fe0009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:52:05.590 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.591+0000 7f4fd9ffb700 1 -- 172.21.15.26:0/2469235061 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f4fd4054980 con 0x7f4fe40f6870 2021-11-03T17:52:05.758 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.763+0000 7f4feb906700 1 -- 172.21.15.26:0/2469235061 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4fe40fdea0 con 0x7f4fd0064090 2021-11-03T17:52:05.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.777+0000 7f4fd9ffb700 1 -- 172.21.15.26:0/2469235061 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f4fe40fdea0 con 0x7f4fd0064090 2021-11-03T17:52:05.774 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:52:05.774 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (63m) 2m ago 64m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:52:05.775 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (55m) 2m ago 64m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:52:05.775 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (55m) 92s ago 63m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:52:05.775 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (63m) 2m ago 64m 41.4M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:52:05.775 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (56m) 2m ago 59m 25.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:52:05.776 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (56m) 2m ago 59m 26.0M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:52:05.776 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (59m) 92s ago 59m 26.2M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:52:05.776 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (59m) 92s ago 59m 26.5M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:52:05.776 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (57m) 2m ago 65m 547M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:52:05.777 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (56m) 92s ago 63m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:52:05.777 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (56m) 2m ago 66m 242M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:52:05.777 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (56m) 92s ago 63m 117M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:52:05.778 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (64m) 2m ago 64m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:52:05.778 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (63m) 92s ago 63m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:52:05.778 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (55m) 2m ago 62m 271M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:52:05.779 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (54m) 2m ago 62m 291M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:52:05.779 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (54m) 2m ago 62m 243M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:52:05.779 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (53m) 92s ago 61m 312M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:52:05.780 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (53m) 92s ago 61m 265M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:52:05.780 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (52m) 92s ago 61m 255M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:52:05.780 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (63m) 2m ago 63m 58.9M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:52:05.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.779+0000 7f4feb906700 1 -- 172.21.15.26:0/2469235061 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4fd0064090 msgr2=0x7f4fd0066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:52:05.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.779+0000 7f4feb906700 1 --2- 172.21.15.26:0/2469235061 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4fd0064090 0x7f4fd0066550 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f4fe4060140 tx=0x7f4fe0009040).stop 2021-11-03T17:52:05.782 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.779+0000 7f4feb906700 1 -- 172.21.15.26:0/2469235061 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fe40f6870 msgr2=0x7f4fe410e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:52:05.783 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.779+0000 7f4feb906700 1 --2- 172.21.15.26:0/2469235061 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fe40f6870 0x7f4fe410e580 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7f4fd4009da0 tx=0x7f4fd4009b30).stop 2021-11-03T17:52:05.783 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.779+0000 7f4feb906700 1 -- 172.21.15.26:0/2469235061 shutdown_connections 2021-11-03T17:52:05.783 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.779+0000 7f4feb906700 1 --2- 172.21.15.26:0/2469235061 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4fd0064090 0x7f4fd0066550 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:05.784 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.779+0000 7f4feb906700 1 --2- 172.21.15.26:0/2469235061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4fe40f55d0 0x7f4fe410c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:05.784 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.779+0000 7f4feb906700 1 --2- 172.21.15.26:0/2469235061 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fe40f6870 0x7f4fe410e580 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:05.784 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.779+0000 7f4feb906700 1 -- 172.21.15.26:0/2469235061 >> 172.21.15.26:0/2469235061 conn(0x7f4fe40f0d30 msgr2=0x7f4fe40fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:52:05.784 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.779+0000 7f4feb906700 1 -- 172.21.15.26:0/2469235061 shutdown_connections 2021-11-03T17:52:05.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.780+0000 7f4feb906700 1 -- 172.21.15.26:0/2469235061 wait complete. 2021-11-03T17:52:05.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.878+0000 7fcf79c60700 1 -- 172.21.15.26:0/4227277848 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf740f66e0 msgr2=0x7fcf740f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:52:05.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.878+0000 7fcf79c60700 1 --2- 172.21.15.26:0/4227277848 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf740f66e0 0x7fcf740f6b40 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7fcf640099e0 tx=0x7fcf64004d10).stop 2021-11-03T17:52:05.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.878+0000 7fcf79c60700 1 -- 172.21.15.26:0/4227277848 shutdown_connections 2021-11-03T17:52:05.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.878+0000 7fcf79c60700 1 --2- 172.21.15.26:0/4227277848 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf740f66e0 0x7fcf740f6b40 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:05.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.878+0000 7fcf79c60700 1 --2- 172.21.15.26:0/4227277848 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf740f5440 0x7fcf740f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:52:05.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.878+0000 7fcf79c60700 1 -- 172.21.15.26:0/4227277848 >> 172.21.15.26:0/4227277848 conn(0x7fcf740f0ba0 msgr2=0x7fcf740f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:52:05.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.878+0000 7fcf79c60700 1 -- 172.21.15.26:0/4227277848 shutdown_connections 2021-11-03T17:52:05.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.878+0000 7fcf79c60700 1 -- 172.21.15.26:0/4227277848 wait complete. 2021-11-03T17:52:05.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.879+0000 7fcf79c60700 1 Processor -- start 2021-11-03T17:52:05.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.879+0000 7fcf79c60700 1 -- start start 2021-11-03T17:52:05.879 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.879+0000 7fcf79c60700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf740f5440 0x7fcf74106f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:52:05.879 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.879+0000 7fcf79c60700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf740f66e0 0x7fcf741073f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:52:05.879 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.879+0000 7fcf79c60700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf74107a30 con 0x7fcf740f5440 2021-11-03T17:52:05.879 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.879+0000 7fcf79c60700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf741082e0 con 0x7fcf740f66e0 2021-11-03T17:52:05.880 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.879+0000 7fcf78c5e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf740f5440 0x7fcf74106f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:52:05.880 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.879+0000 7fcf78c5e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf740f5440 0x7fcf74106f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56818/0 (socket says 172.21.15.26:56818) 2021-11-03T17:52:05.880 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.879+0000 7fcf78c5e700 1 -- 172.21.15.26:0/598509773 learned_addr learned my addr 172.21.15.26:0/598509773 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:52:05.880 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.880+0000 7fcf78c5e700 1 -- 172.21.15.26:0/598509773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf740f66e0 msgr2=0x7fcf741073f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:52:05.880 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.880+0000 7fcf73fff700 1 --2- 172.21.15.26:0/598509773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf740f66e0 0x7fcf741073f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:52:05.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.880+0000 7fcf78c5e700 1 --2- 172.21.15.26:0/598509773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf740f66e0 0x7fcf741073f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:05.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.880+0000 7fcf78c5e700 1 -- 172.21.15.26:0/598509773 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf64009640 con 0x7fcf740f5440 2021-11-03T17:52:05.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.880+0000 7fcf73fff700 1 --2- 172.21.15.26:0/598509773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf740f66e0 0x7fcf741073f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:52:05.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.880+0000 7fcf78c5e700 1 --2- 172.21.15.26:0/598509773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf740f5440 0x7fcf74106f00 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7fcf6c0093f0 tx=0x7fcf6c006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:52:05.882 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.880+0000 7fcf717fa700 1 -- 172.21.15.26:0/598509773 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf6c009ea0 con 0x7fcf740f5440 2021-11-03T17:52:05.882 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.880+0000 7fcf717fa700 1 -- 172.21.15.26:0/598509773 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcf6c013af0 con 0x7fcf740f5440 2021-11-03T17:52:05.882 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.880+0000 7fcf79c60700 1 -- 172.21.15.26:0/598509773 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf741085c0 con 0x7fcf740f5440 2021-11-03T17:52:05.882 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.880+0000 7fcf717fa700 1 -- 172.21.15.26:0/598509773 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf6c00db10 con 0x7fcf740f5440 2021-11-03T17:52:05.883 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.880+0000 7fcf79c60700 1 -- 172.21.15.26:0/598509773 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf74108b00 con 0x7fcf740f5440 2021-11-03T17:52:05.884 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.881+0000 7fcf79c60700 1 -- 172.21.15.26:0/598509773 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf74059100 con 0x7fcf740f5440 2021-11-03T17:52:05.884 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.881+0000 7fcf717fa700 1 -- 172.21.15.26:0/598509773 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fcf6c01a060 con 0x7fcf740f5440 2021-11-03T17:52:05.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.882+0000 7fcf717fa700 1 --2- 172.21.15.26:0/598509773 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcf60064100 0x7fcf600665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:52:05.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.882+0000 7fcf717fa700 1 -- 172.21.15.26:0/598509773 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fcf6c080820 con 0x7fcf740f5440 2021-11-03T17:52:05.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.882+0000 7fcf73fff700 1 --2- 172.21.15.26:0/598509773 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcf60064100 0x7fcf600665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:52:05.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.882+0000 7fcf73fff700 1 --2- 172.21.15.26:0/598509773 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcf60064100 0x7fcf600665c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7fcf64009f50 tx=0x7fcf64004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:52:05.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:05.886+0000 7fcf717fa700 1 -- 172.21.15.26:0/598509773 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fcf6c052a90 con 0x7fcf740f5440 2021-11-03T17:52:06.114 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.118+0000 7fcf79c60700 1 -- 172.21.15.26:0/598509773 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcf7410d570 con 0x7fcf740f5440 2021-11-03T17:52:06.114 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.118+0000 7fcf717fa700 1 -- 172.21.15.26:0/598509773 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fcf6c052680 con 0x7fcf740f5440 2021-11-03T17:52:06.115 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:52:06.115 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:52:06.115 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:52:06.116 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:52:06.116 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:52:06.116 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:52:06.116 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:52:06.117 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:52:06.117 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:52:06.117 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:52:06.117 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:52:06.117 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:52:06.118 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:52:06.118 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:52:06.118 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:52:06.119 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:52:06.119 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:52:06.119 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:52:06.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.120+0000 7fcf79c60700 1 -- 172.21.15.26:0/598509773 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcf60064100 msgr2=0x7fcf600665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:52:06.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.120+0000 7fcf79c60700 1 --2- 172.21.15.26:0/598509773 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcf60064100 0x7fcf600665c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7fcf64009f50 tx=0x7fcf64004d10).stop 2021-11-03T17:52:06.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.120+0000 7fcf79c60700 1 -- 172.21.15.26:0/598509773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf740f5440 msgr2=0x7fcf74106f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:52:06.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.120+0000 7fcf79c60700 1 --2- 172.21.15.26:0/598509773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf740f5440 0x7fcf74106f00 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7fcf6c0093f0 tx=0x7fcf6c006ec0).stop 2021-11-03T17:52:06.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.120+0000 7fcf79c60700 1 -- 172.21.15.26:0/598509773 shutdown_connections 2021-11-03T17:52:06.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.120+0000 7fcf79c60700 1 --2- 172.21.15.26:0/598509773 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcf60064100 0x7fcf600665c0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:06.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.120+0000 7fcf79c60700 1 --2- 172.21.15.26:0/598509773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf740f5440 0x7fcf74106f00 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:06.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.120+0000 7fcf79c60700 1 --2- 172.21.15.26:0/598509773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf740f66e0 0x7fcf741073f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:06.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.120+0000 7fcf79c60700 1 -- 172.21.15.26:0/598509773 >> 172.21.15.26:0/598509773 conn(0x7fcf740f0ba0 msgr2=0x7fcf7405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:52:06.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.121+0000 7fcf79c60700 1 -- 172.21.15.26:0/598509773 shutdown_connections 2021-11-03T17:52:06.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.121+0000 7fcf79c60700 1 -- 172.21.15.26:0/598509773 wait complete. 2021-11-03T17:52:06.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.221+0000 7f20f1b72700 1 -- 172.21.15.26:0/1776835262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20ec0f5440 msgr2=0x7f20ec0f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:52:06.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.221+0000 7f20f1b72700 1 --2- 172.21.15.26:0/1776835262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20ec0f5440 0x7f20ec0f5860 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 rx=0x7f20e0004660 tx=0x7f20e0009b30).stop 2021-11-03T17:52:06.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.221+0000 7f20f1b72700 1 -- 172.21.15.26:0/1776835262 shutdown_connections 2021-11-03T17:52:06.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.221+0000 7f20f1b72700 1 --2- 172.21.15.26:0/1776835262 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20ec0f66e0 0x7f20ec0f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:06.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.221+0000 7f20f1b72700 1 --2- 172.21.15.26:0/1776835262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20ec0f5440 0x7f20ec0f5860 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:06.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.221+0000 7f20f1b72700 1 -- 172.21.15.26:0/1776835262 >> 172.21.15.26:0/1776835262 conn(0x7f20ec0f0ba0 msgr2=0x7f20ec0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:52:06.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.221+0000 7f20f1b72700 1 -- 172.21.15.26:0/1776835262 shutdown_connections 2021-11-03T17:52:06.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.221+0000 7f20f1b72700 1 -- 172.21.15.26:0/1776835262 wait complete. 2021-11-03T17:52:06.221 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.222+0000 7f20f1b72700 1 Processor -- start 2021-11-03T17:52:06.221 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.222+0000 7f20f1b72700 1 -- start start 2021-11-03T17:52:06.221 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.222+0000 7f20f1b72700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20ec0f5440 0x7f20ec106e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:52:06.221 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.222+0000 7f20f1b72700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20ec0f66e0 0x7f20ec107300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:52:06.222 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.222+0000 7f20f1b72700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec107900 con 0x7f20ec0f5440 2021-11-03T17:52:06.222 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.222+0000 7f20f1b72700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec108110 con 0x7f20ec0f66e0 2021-11-03T17:52:06.222 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.222+0000 7f20f0b70700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20ec0f5440 0x7f20ec106e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:52:06.222 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.222+0000 7f20f0b70700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20ec0f5440 0x7f20ec106e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56828/0 (socket says 172.21.15.26:56828) 2021-11-03T17:52:06.222 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.222+0000 7f20f0b70700 1 -- 172.21.15.26:0/685794045 learned_addr learned my addr 172.21.15.26:0/685794045 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:52:06.223 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.223+0000 7f20f0b70700 1 -- 172.21.15.26:0/685794045 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20ec0f66e0 msgr2=0x7f20ec107300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:52:06.223 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.223+0000 7f20f0b70700 1 --2- 172.21.15.26:0/685794045 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20ec0f66e0 0x7f20ec107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:52:06.223 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.223+0000 7f20f0b70700 1 -- 172.21.15.26:0/685794045 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e0005040 con 0x7f20ec0f5440 2021-11-03T17:52:06.223 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.223+0000 7f20f0b70700 1 --2- 172.21.15.26:0/685794045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20ec0f5440 0x7f20ec106e10 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7f20e0013a70 tx=0x7f20e0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:52:06.224 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.223+0000 7f20e97fa700 1 -- 172.21.15.26:0/685794045 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20e0018070 con 0x7f20ec0f5440 2021-11-03T17:52:06.224 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.223+0000 7f20e97fa700 1 -- 172.21.15.26:0/685794045 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f20e00097d0 con 0x7f20ec0f5440 2021-11-03T17:52:06.224 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.223+0000 7f20e97fa700 1 -- 172.21.15.26:0/685794045 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20e001c3c0 con 0x7f20ec0f5440 2021-11-03T17:52:06.224 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.223+0000 7f20f1b72700 1 -- 172.21.15.26:0/685794045 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20ec108330 con 0x7f20ec0f5440 2021-11-03T17:52:06.224 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.223+0000 7f20f1b72700 1 -- 172.21.15.26:0/685794045 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20ec108890 con 0x7f20ec0f5440 2021-11-03T17:52:06.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.224+0000 7f20f1b72700 1 -- 172.21.15.26:0/685794045 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20ec059100 con 0x7f20ec0f5440 2021-11-03T17:52:06.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.225+0000 7f20e97fa700 1 -- 172.21.15.26:0/685794045 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f20e0007ba0 con 0x7f20ec0f5440 2021-11-03T17:52:06.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.225+0000 7f20e97fa700 1 --2- 172.21.15.26:0/685794045 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f20dc064100 0x7f20dc0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:52:06.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.225+0000 7f20e97fa700 1 -- 172.21.15.26:0/685794045 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f20e00828a0 con 0x7f20ec0f5440 2021-11-03T17:52:06.227 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.225+0000 7f20ebfff700 1 --2- 172.21.15.26:0/685794045 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f20dc064100 0x7f20dc0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:52:06.227 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.226+0000 7f20ebfff700 1 --2- 172.21.15.26:0/685794045 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f20dc064100 0x7f20dc0665c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f20d8004a10 tx=0x7f20d80099e0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:52:06.227 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.229+0000 7f20e97fa700 1 -- 172.21.15.26:0/685794045 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f20e0054be0 con 0x7f20ec0f5440 2021-11-03T17:52:06.432 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.436+0000 7f20f1b72700 1 -- 172.21.15.26:0/685794045 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f20ec0fed00 con 0x7f20ec0f5440 2021-11-03T17:52:06.432 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.436+0000 7f20e97fa700 1 -- 172.21.15.26:0/685794045 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f20e00547d0 con 0x7f20ec0f5440 2021-11-03T17:52:06.432 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:52:06.433 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:52:06.433 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:52:06.433 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:52:06.434 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:52:06.434 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:52:06.434 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:52:06.435 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:52:06.435 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:52:06.435 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:52:06.435 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:52:06.436 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:52:06.436 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:52:06.436 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:52:06.436 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:52:06.437 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:52:06.437 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:52:06.437 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:52:06.437 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:52:06.438 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:52:06.438 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:52:06.438 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:52:06.438 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:52:06.438 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:52:06.439 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:52:06.439 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:52:06.439 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:52:06.439 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:52:06.440 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:52:06.440 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:52:06.440 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:52:06.440 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:52:06.441 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:52:06.441 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:52:06.441 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:52:06.441 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:52:06.441 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:52:06.442 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:52:06.442 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:52:06.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.438+0000 7f20f1b72700 1 -- 172.21.15.26:0/685794045 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f20dc064100 msgr2=0x7f20dc0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:52:06.444 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.438+0000 7f20f1b72700 1 --2- 172.21.15.26:0/685794045 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f20dc064100 0x7f20dc0665c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f20d8004a10 tx=0x7f20d80099e0).stop 2021-11-03T17:52:06.444 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.438+0000 7f20f1b72700 1 -- 172.21.15.26:0/685794045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20ec0f5440 msgr2=0x7f20ec106e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:52:06.444 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.438+0000 7f20f1b72700 1 --2- 172.21.15.26:0/685794045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20ec0f5440 0x7f20ec106e10 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7f20e0013a70 tx=0x7f20e0009b30).stop 2021-11-03T17:52:06.444 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.438+0000 7f20f1b72700 1 -- 172.21.15.26:0/685794045 shutdown_connections 2021-11-03T17:52:06.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.438+0000 7f20f1b72700 1 --2- 172.21.15.26:0/685794045 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f20dc064100 0x7f20dc0665c0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:06.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.438+0000 7f20f1b72700 1 --2- 172.21.15.26:0/685794045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20ec0f5440 0x7f20ec106e10 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:06.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.438+0000 7f20f1b72700 1 --2- 172.21.15.26:0/685794045 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20ec0f66e0 0x7f20ec107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:52:06.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.438+0000 7f20f1b72700 1 -- 172.21.15.26:0/685794045 >> 172.21.15.26:0/685794045 conn(0x7f20ec0f0ba0 msgr2=0x7f20ec0fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:52:06.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.438+0000 7f20f1b72700 1 -- 172.21.15.26:0/685794045 shutdown_connections 2021-11-03T17:52:06.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:06.438+0000 7f20f1b72700 1 -- 172.21.15.26:0/685794045 wait complete. 2021-11-03T17:52:06.446 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:52:06.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:06 smithi026 ceph-mon[96795]: pgmap v1723: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:06.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:06 smithi026 ceph-mon[96795]: from='client.35916 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:52:06.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:06 smithi026 ceph-mon[96795]: from='client.35920 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:52:06.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:06 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/598509773' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:52:06.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:06 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/685794045' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:52:06.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:06 smithi194 ceph-mon[65619]: pgmap v1723: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:06.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:06 smithi194 ceph-mon[65619]: from='client.35916 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:52:06.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:06 smithi194 ceph-mon[65619]: from='client.35920 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:52:06.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:06 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/598509773' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:52:06.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:06 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/685794045' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:52:08.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:08 smithi026 ceph-mon[96795]: pgmap v1724: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:08.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:08 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:52:08.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:08 smithi194 ceph-mon[65619]: pgmap v1724: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:08.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:08 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:52:09.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:09 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:52:09.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:09 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:52:10.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:10 smithi026 ceph-mon[96795]: pgmap v1725: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:10.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:10 smithi194 ceph-mon[65619]: pgmap v1725: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:12.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:12 smithi026 ceph-mon[96795]: pgmap v1726: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:12.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:12 smithi194 ceph-mon[65619]: pgmap v1726: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:14.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:14 smithi026 ceph-mon[96795]: pgmap v1727: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:14.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:14 smithi194 ceph-mon[65619]: pgmap v1727: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:16.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:16 smithi026 ceph-mon[96795]: pgmap v1728: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:16.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:16 smithi194 ceph-mon[65619]: pgmap v1728: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:18.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:18 smithi026 ceph-mon[96795]: pgmap v1729: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:18.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:18 smithi194 ceph-mon[65619]: pgmap v1729: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:20.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:20 smithi026 ceph-mon[96795]: pgmap v1730: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:20.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:20 smithi194 ceph-mon[65619]: pgmap v1730: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:22.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:22 smithi026 ceph-mon[96795]: pgmap v1731: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:22.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:22 smithi194 ceph-mon[65619]: pgmap v1731: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:23.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:23 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:52:23.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:23 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:52:24.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:24 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:52:24.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:24 smithi026 ceph-mon[96795]: pgmap v1732: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:24.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:24 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:52:24.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:24 smithi194 ceph-mon[65619]: pgmap v1732: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:26.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:26 smithi026 ceph-mon[96795]: pgmap v1733: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:26.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:26 smithi194 ceph-mon[65619]: pgmap v1733: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:28.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:28 smithi026 ceph-mon[96795]: pgmap v1734: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:28.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:28 smithi194 ceph-mon[65619]: pgmap v1734: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:30.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:30 smithi026 ceph-mon[96795]: pgmap v1735: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:30.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:30 smithi194 ceph-mon[65619]: pgmap v1735: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:32.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:32 smithi026 ceph-mon[96795]: pgmap v1736: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:32.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:32 smithi194 ceph-mon[65619]: pgmap v1736: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:34.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:34 smithi026 ceph-mon[96795]: pgmap v1737: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:34.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:34 smithi194 ceph-mon[65619]: pgmap v1737: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:36.550 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.553+0000 7f06733ef700 1 -- 172.21.15.26:0/243156207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f066c0f7980 msgr2=0x7f066c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:52:36.550 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.553+0000 7f06733ef700 1 --2- 172.21.15.26:0/243156207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f066c0f7980 0x7f066c0f7de0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7f0660004660 tx=0x7f0660009b30).stop 2021-11-03T17:52:36.551 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.553+0000 7f06733ef700 1 -- 172.21.15.26:0/243156207 shutdown_connections 2021-11-03T17:52:36.551 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.553+0000 7f06733ef700 1 --2- 172.21.15.26:0/243156207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f066c0f7980 0x7f066c0f7de0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:36.551 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.553+0000 7f06733ef700 1 --2- 172.21.15.26:0/243156207 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f066c0f66e0 0x7f066c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:36.551 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.553+0000 7f06733ef700 1 -- 172.21.15.26:0/243156207 >> 172.21.15.26:0/243156207 conn(0x7f066c0f1e40 msgr2=0x7f066c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:52:36.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.554+0000 7f06733ef700 1 -- 172.21.15.26:0/243156207 shutdown_connections 2021-11-03T17:52:36.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.554+0000 7f06733ef700 1 -- 172.21.15.26:0/243156207 wait complete. 2021-11-03T17:52:36.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.554+0000 7f06733ef700 1 Processor -- start 2021-11-03T17:52:36.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.554+0000 7f06733ef700 1 -- start start 2021-11-03T17:52:36.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.554+0000 7f06733ef700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f066c0f66e0 0x7f066c106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:52:36.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.554+0000 7f06733ef700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f066c0f7980 0x7f066c107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:52:36.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.554+0000 7f06733ef700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066c107a00 con 0x7f066c0f66e0 2021-11-03T17:52:36.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.554+0000 7f06733ef700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066c107b40 con 0x7f066c0f7980 2021-11-03T17:52:36.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.554+0000 7f067118b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f066c0f66e0 0x7f066c106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:52:36.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.554+0000 7f067118b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f066c0f66e0 0x7f066c106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56846/0 (socket says 172.21.15.26:56846) 2021-11-03T17:52:36.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.554+0000 7f067118b700 1 -- 172.21.15.26:0/1289188693 learned_addr learned my addr 172.21.15.26:0/1289188693 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:52:36.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.555+0000 7f067118b700 1 -- 172.21.15.26:0/1289188693 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f066c0f7980 msgr2=0x7f066c107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:52:36.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.555+0000 7f067118b700 1 --2- 172.21.15.26:0/1289188693 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f066c0f7980 0x7f066c107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:52:36.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.555+0000 7f067118b700 1 -- 172.21.15.26:0/1289188693 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0660005040 con 0x7f066c0f66e0 2021-11-03T17:52:36.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.555+0000 7f067118b700 1 --2- 172.21.15.26:0/1289188693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f066c0f66e0 0x7f066c106f60 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7f066800c790 tx=0x7f0668007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:52:36.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.555+0000 7f065dffb700 1 -- 172.21.15.26:0/1289188693 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f066800e680 con 0x7f066c0f66e0 2021-11-03T17:52:36.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.555+0000 7f065dffb700 1 -- 172.21.15.26:0/1289188693 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f066800ec90 con 0x7f066c0f66e0 2021-11-03T17:52:36.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.555+0000 7f06733ef700 1 -- 172.21.15.26:0/1289188693 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f066c1084e0 con 0x7f066c0f66e0 2021-11-03T17:52:36.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.555+0000 7f065dffb700 1 -- 172.21.15.26:0/1289188693 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0668012d00 con 0x7f066c0f66e0 2021-11-03T17:52:36.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.555+0000 7f06733ef700 1 -- 172.21.15.26:0/1289188693 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f066c108aa0 con 0x7f066c0f66e0 2021-11-03T17:52:36.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.556+0000 7f06733ef700 1 -- 172.21.15.26:0/1289188693 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f066c045ad0 con 0x7f066c0f66e0 2021-11-03T17:52:36.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.556+0000 7f065dffb700 1 -- 172.21.15.26:0/1289188693 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f0668010070 con 0x7f066c0f66e0 2021-11-03T17:52:36.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.557+0000 7f065dffb700 1 --2- 172.21.15.26:0/1289188693 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f06580640b0 0x7f0658066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:52:36.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.557+0000 7f065dffb700 1 -- 172.21.15.26:0/1289188693 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f06680808d0 con 0x7f066c0f66e0 2021-11-03T17:52:36.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.557+0000 7f067098a700 1 --2- 172.21.15.26:0/1289188693 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f06580640b0 0x7f0658066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:52:36.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.557+0000 7f067098a700 1 --2- 172.21.15.26:0/1289188693 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f06580640b0 0x7f0658066570 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f0660004e30 tx=0x7f0660009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:52:36.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.561+0000 7f065dffb700 1 -- 172.21.15.26:0/1289188693 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f0668052b40 con 0x7f066c0f66e0 2021-11-03T17:52:36.733 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.738+0000 7f06733ef700 1 -- 172.21.15.26:0/1289188693 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f066c108d10 con 0x7f06580640b0 2021-11-03T17:52:36.734 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.740+0000 7f065dffb700 1 -- 172.21.15.26:0/1289188693 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f066c108d10 con 0x7f06580640b0 2021-11-03T17:52:36.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.741+0000 7f06733ef700 1 -- 172.21.15.26:0/1289188693 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f06580640b0 msgr2=0x7f0658066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:52:36.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.741+0000 7f06733ef700 1 --2- 172.21.15.26:0/1289188693 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f06580640b0 0x7f0658066570 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f0660004e30 tx=0x7f0660009b30).stop 2021-11-03T17:52:36.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.741+0000 7f06733ef700 1 -- 172.21.15.26:0/1289188693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f066c0f66e0 msgr2=0x7f066c106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:52:36.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.741+0000 7f06733ef700 1 --2- 172.21.15.26:0/1289188693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f066c0f66e0 0x7f066c106f60 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7f066800c790 tx=0x7f0668007d90).stop 2021-11-03T17:52:36.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.742+0000 7f06733ef700 1 -- 172.21.15.26:0/1289188693 shutdown_connections 2021-11-03T17:52:36.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.742+0000 7f06733ef700 1 --2- 172.21.15.26:0/1289188693 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f06580640b0 0x7f0658066570 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:36.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.742+0000 7f06733ef700 1 --2- 172.21.15.26:0/1289188693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f066c0f66e0 0x7f066c106f60 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:36.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.742+0000 7f06733ef700 1 --2- 172.21.15.26:0/1289188693 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f066c0f7980 0x7f066c107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:52:36.739 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.742+0000 7f06733ef700 1 -- 172.21.15.26:0/1289188693 >> 172.21.15.26:0/1289188693 conn(0x7f066c0f1e40 msgr2=0x7f066c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:52:36.739 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.742+0000 7f06733ef700 1 -- 172.21.15.26:0/1289188693 shutdown_connections 2021-11-03T17:52:36.739 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.742+0000 7f06733ef700 1 -- 172.21.15.26:0/1289188693 wait complete. 2021-11-03T17:52:36.746 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:52:36.838 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.841+0000 7f669d681700 1 -- 172.21.15.26:0/786663945 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66980f66e0 msgr2=0x7f66980f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:52:36.838 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.841+0000 7f669d681700 1 --2- 172.21.15.26:0/786663945 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66980f66e0 0x7f66980f6b40 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7f668c004660 tx=0x7f668c009b30).stop 2021-11-03T17:52:36.839 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.841+0000 7f669d681700 1 -- 172.21.15.26:0/786663945 shutdown_connections 2021-11-03T17:52:36.839 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.841+0000 7f669d681700 1 --2- 172.21.15.26:0/786663945 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66980f66e0 0x7f66980f6b40 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:36.839 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.841+0000 7f669d681700 1 --2- 172.21.15.26:0/786663945 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66980f5440 0x7f66980f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:36.839 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.841+0000 7f669d681700 1 -- 172.21.15.26:0/786663945 >> 172.21.15.26:0/786663945 conn(0x7f66980f0ba0 msgr2=0x7f66980f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:52:36.840 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.842+0000 7f669d681700 1 -- 172.21.15.26:0/786663945 shutdown_connections 2021-11-03T17:52:36.840 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.842+0000 7f669d681700 1 -- 172.21.15.26:0/786663945 wait complete. 2021-11-03T17:52:36.840 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.842+0000 7f669d681700 1 Processor -- start 2021-11-03T17:52:36.840 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.842+0000 7f669d681700 1 -- start start 2021-11-03T17:52:36.840 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.842+0000 7f669d681700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66980f5440 0x7f66980f9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:52:36.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.842+0000 7f669d681700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66980f66e0 0x7f66980f8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:52:36.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.842+0000 7f669d681700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66980f87a0 con 0x7f66980f66e0 2021-11-03T17:52:36.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.842+0000 7f669d681700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66980f88e0 con 0x7f66980f5440 2021-11-03T17:52:36.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.842+0000 7f66977fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66980f66e0 0x7f66980f8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:52:36.842 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.843+0000 7f66977fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66980f66e0 0x7f66980f8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56858/0 (socket says 172.21.15.26:56858) 2021-11-03T17:52:36.842 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.843+0000 7f66977fe700 1 -- 172.21.15.26:0/3909478954 learned_addr learned my addr 172.21.15.26:0/3909478954 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:52:36.842 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.843+0000 7f6697fff700 1 --2- 172.21.15.26:0/3909478954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66980f5440 0x7f66980f9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:52:36.842 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.843+0000 7f66977fe700 1 -- 172.21.15.26:0/3909478954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66980f5440 msgr2=0x7f66980f9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:52:36.843 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.843+0000 7f66977fe700 1 --2- 172.21.15.26:0/3909478954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66980f5440 0x7f66980f9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:36.843 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.843+0000 7f66977fe700 1 -- 172.21.15.26:0/3909478954 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668c005040 con 0x7f66980f66e0 2021-11-03T17:52:36.843 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.843+0000 7f66977fe700 1 --2- 172.21.15.26:0/3909478954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66980f66e0 0x7f66980f8240 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7f668c009990 tx=0x7f668c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:52:36.843 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.843+0000 7f6694ff9700 1 -- 172.21.15.26:0/3909478954 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f668c018070 con 0x7f66980f66e0 2021-11-03T17:52:36.844 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.843+0000 7f6694ff9700 1 -- 172.21.15.26:0/3909478954 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f668c007ba0 con 0x7f66980f66e0 2021-11-03T17:52:36.844 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.843+0000 7f669d681700 1 -- 172.21.15.26:0/3909478954 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66980f8b60 con 0x7f66980f66e0 2021-11-03T17:52:36.844 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.843+0000 7f6694ff9700 1 -- 172.21.15.26:0/3909478954 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f668c01c3c0 con 0x7f66980f66e0 2021-11-03T17:52:36.844 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.843+0000 7f669d681700 1 -- 172.21.15.26:0/3909478954 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66980f90c0 con 0x7f66980f66e0 2021-11-03T17:52:36.846 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.844+0000 7f669d681700 1 -- 172.21.15.26:0/3909478954 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6698045ad0 con 0x7f66980f66e0 2021-11-03T17:52:36.846 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.844+0000 7f6694ff9700 1 -- 172.21.15.26:0/3909478954 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f668c01d420 con 0x7f66980f66e0 2021-11-03T17:52:36.846 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.845+0000 7f6694ff9700 1 --2- 172.21.15.26:0/3909478954 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6680064100 0x7f66800665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:52:36.846 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.845+0000 7f6694ff9700 1 -- 172.21.15.26:0/3909478954 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f668c082500 con 0x7f66980f66e0 2021-11-03T17:52:36.847 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.845+0000 7f6697fff700 1 --2- 172.21.15.26:0/3909478954 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6680064100 0x7f66800665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:52:36.847 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.845+0000 7f6697fff700 1 --2- 172.21.15.26:0/3909478954 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6680064100 0x7f66800665c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f66980f9b50 tx=0x7f6688009c80).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:52:36.847 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:36.849+0000 7f6694ff9700 1 -- 172.21.15.26:0/3909478954 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f668c0548c0 con 0x7f66980f66e0 2021-11-03T17:52:36.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:36 smithi026 ceph-mon[96795]: pgmap v1738: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:36.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:36 smithi194 ceph-mon[65619]: pgmap v1738: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:37.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.021+0000 7f669d681700 1 -- 172.21.15.26:0/3909478954 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f669805fd30 con 0x7f6680064100 2021-11-03T17:52:37.030 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.036+0000 7f6694ff9700 1 -- 172.21.15.26:0/3909478954 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f669805fd30 con 0x7f6680064100 2021-11-03T17:52:37.031 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:52:37.031 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (63m) 3m ago 65m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:52:37.032 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (56m) 3m ago 65m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:52:37.032 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (55m) 2m ago 64m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:52:37.032 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (63m) 3m ago 64m 41.4M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:52:37.032 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (56m) 3m ago 60m 25.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:52:37.033 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (57m) 3m ago 60m 26.0M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:52:37.033 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (60m) 2m ago 60m 26.2M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:52:37.033 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (60m) 2m ago 60m 26.5M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:52:37.033 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (57m) 3m ago 66m 547M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:52:37.033 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (57m) 2m ago 64m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:52:37.034 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (56m) 3m ago 66m 242M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:52:37.034 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (56m) 2m ago 64m 117M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:52:37.034 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (64m) 3m ago 64m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:52:37.034 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (64m) 2m ago 64m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:52:37.035 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (55m) 3m ago 63m 271M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:52:37.035 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (55m) 3m ago 63m 291M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:52:37.035 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (54m) 3m ago 62m 243M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:52:37.035 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (54m) 2m ago 62m 312M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:52:37.036 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (53m) 2m ago 62m 265M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:52:37.036 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (53m) 2m ago 61m 255M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:52:37.036 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (63m) 3m ago 64m 58.9M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:52:37.037 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.038+0000 7f669d681700 1 -- 172.21.15.26:0/3909478954 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6680064100 msgr2=0x7f66800665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:52:37.037 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.038+0000 7f669d681700 1 --2- 172.21.15.26:0/3909478954 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6680064100 0x7f66800665c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f66980f9b50 tx=0x7f6688009c80).stop 2021-11-03T17:52:37.037 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.038+0000 7f669d681700 1 -- 172.21.15.26:0/3909478954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66980f66e0 msgr2=0x7f66980f8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:52:37.038 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.038+0000 7f669d681700 1 --2- 172.21.15.26:0/3909478954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66980f66e0 0x7f66980f8240 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7f668c009990 tx=0x7f668c009b30).stop 2021-11-03T17:52:37.038 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.038+0000 7f669d681700 1 -- 172.21.15.26:0/3909478954 shutdown_connections 2021-11-03T17:52:37.038 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.038+0000 7f669d681700 1 --2- 172.21.15.26:0/3909478954 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6680064100 0x7f66800665c0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:37.039 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.038+0000 7f669d681700 1 --2- 172.21.15.26:0/3909478954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66980f5440 0x7f66980f9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:37.039 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.038+0000 7f669d681700 1 --2- 172.21.15.26:0/3909478954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66980f66e0 0x7f66980f8240 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:37.039 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.038+0000 7f669d681700 1 -- 172.21.15.26:0/3909478954 >> 172.21.15.26:0/3909478954 conn(0x7f66980f0ba0 msgr2=0x7f669805f620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:52:37.039 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.038+0000 7f669d681700 1 -- 172.21.15.26:0/3909478954 shutdown_connections 2021-11-03T17:52:37.040 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.038+0000 7f669d681700 1 -- 172.21.15.26:0/3909478954 wait complete. 2021-11-03T17:52:37.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.136+0000 7f2e1906f700 1 -- 172.21.15.26:0/807398285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e140f55c0 msgr2=0x7f2e140f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:52:37.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.136+0000 7f2e1906f700 1 --2- 172.21.15.26:0/807398285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e140f55c0 0x7f2e140f59e0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 rx=0x7f2e0c0099e0 tx=0x7f2e0c004d10).stop 2021-11-03T17:52:37.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.137+0000 7f2e1906f700 1 -- 172.21.15.26:0/807398285 shutdown_connections 2021-11-03T17:52:37.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.137+0000 7f2e1906f700 1 --2- 172.21.15.26:0/807398285 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e140f6860 0x7f2e140f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:37.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.137+0000 7f2e1906f700 1 --2- 172.21.15.26:0/807398285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e140f55c0 0x7f2e140f59e0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:37.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.137+0000 7f2e1906f700 1 -- 172.21.15.26:0/807398285 >> 172.21.15.26:0/807398285 conn(0x7f2e140f0d40 msgr2=0x7f2e140f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:52:37.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.137+0000 7f2e1906f700 1 -- 172.21.15.26:0/807398285 shutdown_connections 2021-11-03T17:52:37.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.137+0000 7f2e1906f700 1 -- 172.21.15.26:0/807398285 wait complete. 2021-11-03T17:52:37.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.137+0000 7f2e1906f700 1 Processor -- start 2021-11-03T17:52:37.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.137+0000 7f2e1906f700 1 -- start start 2021-11-03T17:52:37.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.137+0000 7f2e1906f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e140f55c0 0x7f2e14109d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:52:37.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.137+0000 7f2e1906f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e140f6860 0x7f2e1410c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:52:37.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.137+0000 7f2e1906f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e140603c0 con 0x7f2e140f55c0 2021-11-03T17:52:37.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.137+0000 7f2e1906f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e14060500 con 0x7f2e140f6860 2021-11-03T17:52:37.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.138+0000 7f2e12d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e140f55c0 0x7f2e14109d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:52:37.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.138+0000 7f2e12d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e140f55c0 0x7f2e14109d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56866/0 (socket says 172.21.15.26:56866) 2021-11-03T17:52:37.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.138+0000 7f2e12d9d700 1 -- 172.21.15.26:0/1800620542 learned_addr learned my addr 172.21.15.26:0/1800620542 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:52:37.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.138+0000 7f2e1259c700 1 --2- 172.21.15.26:0/1800620542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e140f6860 0x7f2e1410c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:52:37.139 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.138+0000 7f2e12d9d700 1 -- 172.21.15.26:0/1800620542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e140f6860 msgr2=0x7f2e1410c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:52:37.139 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.138+0000 7f2e12d9d700 1 --2- 172.21.15.26:0/1800620542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e140f6860 0x7f2e1410c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:37.139 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.138+0000 7f2e12d9d700 1 -- 172.21.15.26:0/1800620542 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e0c009640 con 0x7f2e140f55c0 2021-11-03T17:52:37.139 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.138+0000 7f2e12d9d700 1 --2- 172.21.15.26:0/1800620542 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e140f55c0 0x7f2e14109d80 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7f2e0c00c010 tx=0x7f2e0c004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:52:37.139 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.138+0000 7f2dfb7fe700 1 -- 172.21.15.26:0/1800620542 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e0c00e070 con 0x7f2e140f55c0 2021-11-03T17:52:37.140 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.138+0000 7f2dfb7fe700 1 -- 172.21.15.26:0/1800620542 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2e0c007dc0 con 0x7f2e140f55c0 2021-11-03T17:52:37.140 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.138+0000 7f2e1906f700 1 -- 172.21.15.26:0/1800620542 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e1410c7d0 con 0x7f2e140f55c0 2021-11-03T17:52:37.140 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.138+0000 7f2dfb7fe700 1 -- 172.21.15.26:0/1800620542 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e0c018070 con 0x7f2e140f55c0 2021-11-03T17:52:37.140 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.138+0000 7f2e1906f700 1 -- 172.21.15.26:0/1800620542 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e1410cc80 con 0x7f2e140f55c0 2021-11-03T17:52:37.141 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.139+0000 7f2e1906f700 1 -- 172.21.15.26:0/1800620542 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e14045ad0 con 0x7f2e140f55c0 2021-11-03T17:52:37.141 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.140+0000 7f2dfb7fe700 1 -- 172.21.15.26:0/1800620542 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f2e0c024060 con 0x7f2e140f55c0 2021-11-03T17:52:37.141 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.140+0000 7f2dfb7fe700 1 --2- 172.21.15.26:0/1800620542 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2dfc0640b0 0x7f2dfc066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:52:37.141 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.140+0000 7f2dfb7fe700 1 -- 172.21.15.26:0/1800620542 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f2e0c082200 con 0x7f2e140f55c0 2021-11-03T17:52:37.141 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.140+0000 7f2e1259c700 1 --2- 172.21.15.26:0/1800620542 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2dfc0640b0 0x7f2dfc066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:52:37.142 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.141+0000 7f2e1259c700 1 --2- 172.21.15.26:0/1800620542 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2dfc0640b0 0x7f2dfc066570 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f2e08007fd0 tx=0x7f2e08009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:52:37.142 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.144+0000 7f2dfb7fe700 1 -- 172.21.15.26:0/1800620542 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f2e0c054560 con 0x7f2e140f55c0 2021-11-03T17:52:37.371 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.375+0000 7f2e1906f700 1 -- 172.21.15.26:0/1800620542 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2e140fdd80 con 0x7f2e140f55c0 2021-11-03T17:52:37.371 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.376+0000 7f2dfb7fe700 1 -- 172.21.15.26:0/1800620542 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f2e0c0222e0 con 0x7f2e140f55c0 2021-11-03T17:52:37.372 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:52:37.372 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:52:37.372 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:52:37.372 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:52:37.373 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:52:37.373 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:52:37.373 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:52:37.373 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:52:37.373 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:52:37.374 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:52:37.374 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:52:37.374 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:52:37.375 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:52:37.375 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:52:37.375 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:52:37.375 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:52:37.375 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:52:37.376 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:52:37.377 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.377+0000 7f2e1906f700 1 -- 172.21.15.26:0/1800620542 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2dfc0640b0 msgr2=0x7f2dfc066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:52:37.377 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.377+0000 7f2e1906f700 1 --2- 172.21.15.26:0/1800620542 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2dfc0640b0 0x7f2dfc066570 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f2e08007fd0 tx=0x7f2e08009040).stop 2021-11-03T17:52:37.377 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.377+0000 7f2e1906f700 1 -- 172.21.15.26:0/1800620542 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e140f55c0 msgr2=0x7f2e14109d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:52:37.377 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.377+0000 7f2e1906f700 1 --2- 172.21.15.26:0/1800620542 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e140f55c0 0x7f2e14109d80 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7f2e0c00c010 tx=0x7f2e0c004d10).stop 2021-11-03T17:52:37.378 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.377+0000 7f2e1906f700 1 -- 172.21.15.26:0/1800620542 shutdown_connections 2021-11-03T17:52:37.378 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.377+0000 7f2e1906f700 1 --2- 172.21.15.26:0/1800620542 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2dfc0640b0 0x7f2dfc066570 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:37.378 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.377+0000 7f2e1906f700 1 --2- 172.21.15.26:0/1800620542 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e140f55c0 0x7f2e14109d80 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:37.378 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.377+0000 7f2e1906f700 1 --2- 172.21.15.26:0/1800620542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e140f6860 0x7f2e1410c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:37.379 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.377+0000 7f2e1906f700 1 -- 172.21.15.26:0/1800620542 >> 172.21.15.26:0/1800620542 conn(0x7f2e140f0d40 msgr2=0x7f2e140fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:52:37.379 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.378+0000 7f2e1906f700 1 -- 172.21.15.26:0/1800620542 shutdown_connections 2021-11-03T17:52:37.379 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.378+0000 7f2e1906f700 1 -- 172.21.15.26:0/1800620542 wait complete. 2021-11-03T17:52:37.473 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.478+0000 7f5706d68700 1 -- 172.21.15.26:0/1742469869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57000f66e0 msgr2=0x7f57000f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:52:37.474 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.478+0000 7f5706d68700 1 --2- 172.21.15.26:0/1742469869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57000f66e0 0x7f57000f6b00 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7f56f4004660 tx=0x7f56f4009b30).stop 2021-11-03T17:52:37.474 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.478+0000 7f5706d68700 1 -- 172.21.15.26:0/1742469869 shutdown_connections 2021-11-03T17:52:37.474 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.478+0000 7f5706d68700 1 --2- 172.21.15.26:0/1742469869 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57000f6ff0 0x7f57000f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:37.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.478+0000 7f5706d68700 1 --2- 172.21.15.26:0/1742469869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57000f66e0 0x7f57000f6b00 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:37.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.478+0000 7f5706d68700 1 -- 172.21.15.26:0/1742469869 >> 172.21.15.26:0/1742469869 conn(0x7f57000f1f00 msgr2=0x7f57000f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:52:37.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.478+0000 7f5706d68700 1 -- 172.21.15.26:0/1742469869 shutdown_connections 2021-11-03T17:52:37.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.478+0000 7f5706d68700 1 -- 172.21.15.26:0/1742469869 wait complete. 2021-11-03T17:52:37.476 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.478+0000 7f5706d68700 1 Processor -- start 2021-11-03T17:52:37.476 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.478+0000 7f5706d68700 1 -- start start 2021-11-03T17:52:37.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.479+0000 7f5706d68700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57000f66e0 0x7f5700106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:52:37.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.479+0000 7f5706d68700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57000f6ff0 0x7f5700107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:52:37.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.479+0000 7f5706d68700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5700107a00 con 0x7f57000f66e0 2021-11-03T17:52:37.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.479+0000 7f5706d68700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5700107b40 con 0x7f57000f6ff0 2021-11-03T17:52:37.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.479+0000 7f5704b04700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57000f66e0 0x7f5700106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:52:37.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.479+0000 7f5704b04700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57000f66e0 0x7f5700106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56876/0 (socket says 172.21.15.26:56876) 2021-11-03T17:52:37.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.479+0000 7f5704b04700 1 -- 172.21.15.26:0/2678449863 learned_addr learned my addr 172.21.15.26:0/2678449863 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:52:37.481 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.479+0000 7f56fffff700 1 --2- 172.21.15.26:0/2678449863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57000f6ff0 0x7f5700107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:52:37.481 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.479+0000 7f5704b04700 1 -- 172.21.15.26:0/2678449863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57000f6ff0 msgr2=0x7f5700107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:52:37.481 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.479+0000 7f5704b04700 1 --2- 172.21.15.26:0/2678449863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57000f6ff0 0x7f5700107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:37.481 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.479+0000 7f5704b04700 1 -- 172.21.15.26:0/2678449863 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f4005040 con 0x7f57000f66e0 2021-11-03T17:52:37.482 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.479+0000 7f5704b04700 1 --2- 172.21.15.26:0/2678449863 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57000f66e0 0x7f5700106f60 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7f56f4009990 tx=0x7f56f4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:52:37.482 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.480+0000 7f56fd7fa700 1 -- 172.21.15.26:0/2678449863 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56f4018070 con 0x7f57000f66e0 2021-11-03T17:52:37.482 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.480+0000 7f56fd7fa700 1 -- 172.21.15.26:0/2678449863 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f56f4007ba0 con 0x7f57000f66e0 2021-11-03T17:52:37.482 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.480+0000 7f56fd7fa700 1 -- 172.21.15.26:0/2678449863 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56f401c3c0 con 0x7f57000f66e0 2021-11-03T17:52:37.482 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.480+0000 7f5706d68700 1 -- 172.21.15.26:0/2678449863 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5700108480 con 0x7f57000f66e0 2021-11-03T17:52:37.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.480+0000 7f5706d68700 1 -- 172.21.15.26:0/2678449863 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57001089e0 con 0x7f57000f66e0 2021-11-03T17:52:37.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.480+0000 7f5706d68700 1 -- 172.21.15.26:0/2678449863 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5700045ad0 con 0x7f57000f66e0 2021-11-03T17:52:37.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.481+0000 7f56fd7fa700 1 -- 172.21.15.26:0/2678449863 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f56f401d420 con 0x7f57000f66e0 2021-11-03T17:52:37.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.481+0000 7f56fd7fa700 1 --2- 172.21.15.26:0/2678449863 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f56f00640b0 0x7f56f0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:52:37.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.481+0000 7f56fd7fa700 1 -- 172.21.15.26:0/2678449863 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f56f4082500 con 0x7f57000f66e0 2021-11-03T17:52:37.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.482+0000 7f56fffff700 1 --2- 172.21.15.26:0/2678449863 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f56f00640b0 0x7f56f0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:52:37.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.482+0000 7f56fffff700 1 --2- 172.21.15.26:0/2678449863 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f56f00640b0 0x7f56f0066570 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7f56ec0096c0 tx=0x7f56ec009be0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:52:37.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.486+0000 7f56fd7fa700 1 -- 172.21.15.26:0/2678449863 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f56f40548c0 con 0x7f57000f66e0 2021-11-03T17:52:37.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.691+0000 7f5706d68700 1 -- 172.21.15.26:0/2678449863 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f57000feed0 con 0x7f57000f66e0 2021-11-03T17:52:37.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.691+0000 7f56fd7fa700 1 -- 172.21.15.26:0/2678449863 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f56f40544b0 con 0x7f57000f66e0 2021-11-03T17:52:37.687 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:52:37.688 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:52:37.688 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:52:37.688 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:52:37.688 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:52:37.689 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:52:37.689 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:52:37.689 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:52:37.689 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:52:37.690 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:52:37.690 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:52:37.690 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:52:37.690 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:52:37.691 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:52:37.691 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:52:37.691 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:52:37.691 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:52:37.692 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:52:37.692 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:52:37.692 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:52:37.692 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:52:37.693 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:52:37.693 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:52:37.694 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:52:37.694 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:52:37.694 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:52:37.695 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:52:37.695 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:52:37.695 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:52:37.695 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:52:37.696 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:52:37.696 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:52:37.696 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:52:37.696 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:52:37.697 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:52:37.697 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:52:37.697 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:52:37.697 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:52:37.697 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:52:37.699 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.693+0000 7f5706d68700 1 -- 172.21.15.26:0/2678449863 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f56f00640b0 msgr2=0x7f56f0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:52:37.699 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.693+0000 7f5706d68700 1 --2- 172.21.15.26:0/2678449863 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f56f00640b0 0x7f56f0066570 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7f56ec0096c0 tx=0x7f56ec009be0).stop 2021-11-03T17:52:37.699 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.693+0000 7f5706d68700 1 -- 172.21.15.26:0/2678449863 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57000f66e0 msgr2=0x7f5700106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:52:37.700 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.693+0000 7f5706d68700 1 --2- 172.21.15.26:0/2678449863 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57000f66e0 0x7f5700106f60 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7f56f4009990 tx=0x7f56f4009b30).stop 2021-11-03T17:52:37.700 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.693+0000 7f5706d68700 1 -- 172.21.15.26:0/2678449863 shutdown_connections 2021-11-03T17:52:37.700 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.693+0000 7f5706d68700 1 --2- 172.21.15.26:0/2678449863 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f56f00640b0 0x7f56f0066570 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:37.700 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.693+0000 7f5706d68700 1 --2- 172.21.15.26:0/2678449863 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57000f66e0 0x7f5700106f60 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:37.700 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.693+0000 7f5706d68700 1 --2- 172.21.15.26:0/2678449863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57000f6ff0 0x7f5700107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:52:37.701 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.693+0000 7f5706d68700 1 -- 172.21.15.26:0/2678449863 >> 172.21.15.26:0/2678449863 conn(0x7f57000f1f00 msgr2=0x7f57000fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:52:37.701 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.693+0000 7f5706d68700 1 -- 172.21.15.26:0/2678449863 shutdown_connections 2021-11-03T17:52:37.701 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:52:37.693+0000 7f5706d68700 1 -- 172.21.15.26:0/2678449863 wait complete. 2021-11-03T17:52:37.701 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:52:37.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:37 smithi026 ceph-mon[96795]: from='client.35932 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:52:37.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:37 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1800620542' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:52:37.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:37 smithi194 ceph-mon[65619]: from='client.35932 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:52:37.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:37 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1800620542' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:52:38.612 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:38 smithi194 ceph-mon[65619]: from='client.35936 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:52:38.612 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:38 smithi194 ceph-mon[65619]: pgmap v1739: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:38.613 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:38 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2678449863' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:52:38.613 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:38 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:52:38.929 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:38 smithi026 ceph-mon[96795]: from='client.35936 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:52:38.929 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:38 smithi026 ceph-mon[96795]: pgmap v1739: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:38.930 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:38 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2678449863' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:52:38.930 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:38 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:52:39.921 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:39 smithi026 ceph-mon[96795]: poll took 60070.330 ms: 1 events 2021-11-03T17:52:39.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:39 smithi194 ceph-mon[65619]: poll took 60070.330 ms: 1 events 2021-11-03T17:52:40.875 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:40 smithi194 ceph-mon[65619]: pgmap v1740: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:40.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:40 smithi026 ceph-mon[96795]: pgmap v1740: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:42.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:42 smithi194 ceph-mon[65619]: pgmap v1741: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:42.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:42 smithi194 ceph-mon[65619]: poll took 2632.508 ms: 1 events 2021-11-03T17:52:42.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:52:42.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:52:42.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:52:42.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:52:42.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:52:42.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:52:42.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:52:42.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:42 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:52:42.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:52:42.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:42 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:52:42.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:42 smithi026 ceph-mon[96795]: pgmap v1741: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:42.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:42 smithi026 ceph-mon[96795]: poll took 2632.508 ms: 1 events 2021-11-03T17:52:42.673 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:52:42.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:52:42.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:52:42.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:52:42.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:52:42.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:52:42.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:52:42.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:42 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:52:42.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:52:42.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:42 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:52:44.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:44 smithi026 ceph-mon[96795]: pgmap v1742: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:44.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:44 smithi194 ceph-mon[65619]: pgmap v1742: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:46.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:46 smithi194 ceph-mon[65619]: pgmap v1743: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:46.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:46 smithi026 ceph-mon[96795]: pgmap v1743: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:48.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:48 smithi194 ceph-mon[65619]: pgmap v1744: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:48.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:52:48.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:52:48.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:48 smithi026 ceph-mon[96795]: pgmap v1744: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:48.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:52:48.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:52:50.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:50 smithi194 ceph-mon[65619]: pgmap v1745: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:50.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:50 smithi026 ceph-mon[96795]: pgmap v1745: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:52.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:52 smithi194 ceph-mon[65619]: pgmap v1746: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:52.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:52 smithi026 ceph-mon[96795]: pgmap v1746: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:54.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:54 smithi194 ceph-mon[65619]: pgmap v1747: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:54.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:54 smithi026 ceph-mon[96795]: pgmap v1747: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:56.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:56 smithi194 ceph-mon[65619]: pgmap v1748: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:56.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:56 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:52:56.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:56 smithi026 ceph-mon[96795]: pgmap v1748: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:56.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:56 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:52:57.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:57 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:52:57.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:57 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:52:58.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:52:58 smithi194 ceph-mon[65619]: pgmap v1749: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:52:58.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:52:58 smithi026 ceph-mon[96795]: pgmap v1749: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:00.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:00 smithi194 ceph-mon[65619]: pgmap v1750: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:00.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:00 smithi026 ceph-mon[96795]: pgmap v1750: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:02.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:02 smithi194 ceph-mon[65619]: pgmap v1751: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:02.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:02 smithi026 ceph-mon[96795]: pgmap v1751: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:04.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:04 smithi194 ceph-mon[65619]: pgmap v1752: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:04.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:04 smithi026 ceph-mon[96795]: pgmap v1752: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:06.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:06 smithi194 ceph-mon[65619]: pgmap v1753: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:06.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:06 smithi026 ceph-mon[96795]: pgmap v1753: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:07.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.807+0000 7ffb8dae0700 1 -- 172.21.15.26:0/2965419962 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb880f5ef0 msgr2=0x7ffb880f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:53:07.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.807+0000 7ffb8dae0700 1 --2- 172.21.15.26:0/2965419962 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb880f5ef0 0x7ffb880f6920 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7ffb7c004660 tx=0x7ffb7c009b30).stop 2021-11-03T17:53:07.805 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.807+0000 7ffb8dae0700 1 -- 172.21.15.26:0/2965419962 shutdown_connections 2021-11-03T17:53:07.805 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.807+0000 7ffb8dae0700 1 --2- 172.21.15.26:0/2965419962 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb880f5ef0 0x7ffb880f6920 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:07.805 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.807+0000 7ffb8dae0700 1 --2- 172.21.15.26:0/2965419962 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb880f55e0 0x7ffb880f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:07.805 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.807+0000 7ffb8dae0700 1 -- 172.21.15.26:0/2965419962 >> 172.21.15.26:0/2965419962 conn(0x7ffb880f0de0 msgr2=0x7ffb880f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:53:07.805 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.808+0000 7ffb8dae0700 1 -- 172.21.15.26:0/2965419962 shutdown_connections 2021-11-03T17:53:07.806 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.808+0000 7ffb8dae0700 1 -- 172.21.15.26:0/2965419962 wait complete. 2021-11-03T17:53:07.808 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.808+0000 7ffb8dae0700 1 Processor -- start 2021-11-03T17:53:07.809 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.809+0000 7ffb8dae0700 1 -- start start 2021-11-03T17:53:07.809 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.809+0000 7ffb8dae0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb880f55e0 0x7ffb88109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:53:07.809 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.809+0000 7ffb8dae0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb880f5ef0 0x7ffb8810c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:53:07.809 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.809+0000 7ffb8dae0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb880604c0 con 0x7ffb880f55e0 2021-11-03T17:53:07.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.809+0000 7ffb8dae0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb88060600 con 0x7ffb880f5ef0 2021-11-03T17:53:07.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.809+0000 7ffb877fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb880f55e0 0x7ffb88109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:53:07.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.809+0000 7ffb877fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb880f55e0 0x7ffb88109cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56896/0 (socket says 172.21.15.26:56896) 2021-11-03T17:53:07.811 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.809+0000 7ffb877fe700 1 -- 172.21.15.26:0/791221902 learned_addr learned my addr 172.21.15.26:0/791221902 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:53:07.811 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.809+0000 7ffb86ffd700 1 --2- 172.21.15.26:0/791221902 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb880f5ef0 0x7ffb8810c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:53:07.811 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.809+0000 7ffb877fe700 1 -- 172.21.15.26:0/791221902 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb880f5ef0 msgr2=0x7ffb8810c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:53:07.812 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.809+0000 7ffb877fe700 1 --2- 172.21.15.26:0/791221902 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb880f5ef0 0x7ffb8810c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:07.812 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.809+0000 7ffb877fe700 1 -- 172.21.15.26:0/791221902 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7c005040 con 0x7ffb880f55e0 2021-11-03T17:53:07.812 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.809+0000 7ffb877fe700 1 --2- 172.21.15.26:0/791221902 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb880f55e0 0x7ffb88109cb0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7ffb7800c530 tx=0x7ffb78007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:53:07.812 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.810+0000 7ffb6ffff700 1 -- 172.21.15.26:0/791221902 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb7800f650 con 0x7ffb880f55e0 2021-11-03T17:53:07.813 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.810+0000 7ffb6ffff700 1 -- 172.21.15.26:0/791221902 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ffb7800fc60 con 0x7ffb880f55e0 2021-11-03T17:53:07.813 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.810+0000 7ffb8dae0700 1 -- 172.21.15.26:0/791221902 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb8810c760 con 0x7ffb880f55e0 2021-11-03T17:53:07.813 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.810+0000 7ffb6ffff700 1 -- 172.21.15.26:0/791221902 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb78012c20 con 0x7ffb880f55e0 2021-11-03T17:53:07.813 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.810+0000 7ffb8dae0700 1 -- 172.21.15.26:0/791221902 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb8810ccf0 con 0x7ffb880f55e0 2021-11-03T17:53:07.813 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.811+0000 7ffb8dae0700 1 -- 172.21.15.26:0/791221902 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb880f4a70 con 0x7ffb880f55e0 2021-11-03T17:53:07.814 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.811+0000 7ffb6ffff700 1 -- 172.21.15.26:0/791221902 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ffb78010070 con 0x7ffb880f55e0 2021-11-03T17:53:07.814 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.811+0000 7ffb6ffff700 1 --2- 172.21.15.26:0/791221902 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffb700640b0 0x7ffb70066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:53:07.814 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.812+0000 7ffb6ffff700 1 -- 172.21.15.26:0/791221902 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ffb78080540 con 0x7ffb880f55e0 2021-11-03T17:53:07.814 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.812+0000 7ffb86ffd700 1 --2- 172.21.15.26:0/791221902 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffb700640b0 0x7ffb70066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:53:07.815 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.812+0000 7ffb86ffd700 1 --2- 172.21.15.26:0/791221902 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffb700640b0 0x7ffb70066570 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7ffb7c004630 tx=0x7ffb7c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:53:07.815 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.816+0000 7ffb6ffff700 1 -- 172.21.15.26:0/791221902 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ffb780527b0 con 0x7ffb880f55e0 2021-11-03T17:53:07.992 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.996+0000 7ffb8dae0700 1 -- 172.21.15.26:0/791221902 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb880fdf40 con 0x7ffb700640b0 2021-11-03T17:53:07.993 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.997+0000 7ffb6ffff700 1 -- 172.21.15.26:0/791221902 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7ffb880fdf40 con 0x7ffb700640b0 2021-11-03T17:53:07.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.999+0000 7ffb8dae0700 1 -- 172.21.15.26:0/791221902 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffb700640b0 msgr2=0x7ffb70066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:53:07.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.999+0000 7ffb8dae0700 1 --2- 172.21.15.26:0/791221902 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffb700640b0 0x7ffb70066570 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7ffb7c004630 tx=0x7ffb7c009b30).stop 2021-11-03T17:53:07.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.999+0000 7ffb8dae0700 1 -- 172.21.15.26:0/791221902 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb880f55e0 msgr2=0x7ffb88109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:53:07.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.999+0000 7ffb8dae0700 1 --2- 172.21.15.26:0/791221902 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb880f55e0 0x7ffb88109cb0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7ffb7800c530 tx=0x7ffb78007e20).stop 2021-11-03T17:53:07.997 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.999+0000 7ffb8dae0700 1 -- 172.21.15.26:0/791221902 shutdown_connections 2021-11-03T17:53:07.997 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.999+0000 7ffb8dae0700 1 --2- 172.21.15.26:0/791221902 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffb700640b0 0x7ffb70066570 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:07.997 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.999+0000 7ffb8dae0700 1 --2- 172.21.15.26:0/791221902 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb880f55e0 0x7ffb88109cb0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:07.997 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.999+0000 7ffb8dae0700 1 --2- 172.21.15.26:0/791221902 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb880f5ef0 0x7ffb8810c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:07.998 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.999+0000 7ffb8dae0700 1 -- 172.21.15.26:0/791221902 >> 172.21.15.26:0/791221902 conn(0x7ffb880f0de0 msgr2=0x7ffb880fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:53:07.998 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.999+0000 7ffb8dae0700 1 -- 172.21.15.26:0/791221902 shutdown_connections 2021-11-03T17:53:07.998 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:07.999+0000 7ffb8dae0700 1 -- 172.21.15.26:0/791221902 wait complete. 2021-11-03T17:53:08.005 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:53:08.097 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.099+0000 7fc91ffff700 1 -- 172.21.15.26:0/829898676 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9200f5430 msgr2=0x7fc9200f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:53:08.098 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.099+0000 7fc91ffff700 1 --2- 172.21.15.26:0/829898676 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9200f5430 0x7fc9200f5850 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 rx=0x7fc910004660 tx=0x7fc910009b30).stop 2021-11-03T17:53:08.098 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.099+0000 7fc91ffff700 1 -- 172.21.15.26:0/829898676 shutdown_connections 2021-11-03T17:53:08.098 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.099+0000 7fc91ffff700 1 --2- 172.21.15.26:0/829898676 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9200f66d0 0x7fc9200f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:53:08.098 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.099+0000 7fc91ffff700 1 --2- 172.21.15.26:0/829898676 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9200f5430 0x7fc9200f5850 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:08.099 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.099+0000 7fc91ffff700 1 -- 172.21.15.26:0/829898676 >> 172.21.15.26:0/829898676 conn(0x7fc9200f0b90 msgr2=0x7fc9200f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:53:08.099 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.099+0000 7fc91ffff700 1 -- 172.21.15.26:0/829898676 shutdown_connections 2021-11-03T17:53:08.099 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.099+0000 7fc91ffff700 1 -- 172.21.15.26:0/829898676 wait complete. 2021-11-03T17:53:08.099 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.100+0000 7fc91ffff700 1 Processor -- start 2021-11-03T17:53:08.100 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.100+0000 7fc91ffff700 1 -- start start 2021-11-03T17:53:08.100 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.100+0000 7fc91ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9200f5430 0x7fc92010bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:53:08.100 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.100+0000 7fc91ffff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9200f66d0 0x7fc92010e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:53:08.100 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.100+0000 7fc91ffff700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9200602b0 con 0x7fc9200f5430 2021-11-03T17:53:08.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.100+0000 7fc91ffff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9200603f0 con 0x7fc9200f66d0 2021-11-03T17:53:08.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.100+0000 7fc91effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9200f5430 0x7fc92010bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:53:08.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.100+0000 7fc91effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9200f5430 0x7fc92010bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56906/0 (socket says 172.21.15.26:56906) 2021-11-03T17:53:08.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.100+0000 7fc91effd700 1 -- 172.21.15.26:0/2531827902 learned_addr learned my addr 172.21.15.26:0/2531827902 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:53:08.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.101+0000 7fc91effd700 1 -- 172.21.15.26:0/2531827902 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9200f66d0 msgr2=0x7fc92010e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:53:08.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.101+0000 7fc917fff700 1 --2- 172.21.15.26:0/2531827902 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9200f66d0 0x7fc92010e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:53:08.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.101+0000 7fc91effd700 1 --2- 172.21.15.26:0/2531827902 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9200f66d0 0x7fc92010e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:08.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.101+0000 7fc91effd700 1 -- 172.21.15.26:0/2531827902 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc910005040 con 0x7fc9200f5430 2021-11-03T17:53:08.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.101+0000 7fc917fff700 1 --2- 172.21.15.26:0/2531827902 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9200f66d0 0x7fc92010e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:53:08.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.101+0000 7fc91effd700 1 --2- 172.21.15.26:0/2531827902 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9200f5430 0x7fc92010bed0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7fc910004f60 tx=0x7fc910009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:53:08.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.101+0000 7fc9177fe700 1 -- 172.21.15.26:0/2531827902 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc910018070 con 0x7fc9200f5430 2021-11-03T17:53:08.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.101+0000 7fc9177fe700 1 -- 172.21.15.26:0/2531827902 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc910007ba0 con 0x7fc9200f5430 2021-11-03T17:53:08.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.101+0000 7fc91ffff700 1 -- 172.21.15.26:0/2531827902 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc92010e8c0 con 0x7fc9200f5430 2021-11-03T17:53:08.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.101+0000 7fc9177fe700 1 -- 172.21.15.26:0/2531827902 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc91001c620 con 0x7fc9200f5430 2021-11-03T17:53:08.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.101+0000 7fc91ffff700 1 -- 172.21.15.26:0/2531827902 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc92010ece0 con 0x7fc9200f5430 2021-11-03T17:53:08.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.102+0000 7fc91ffff700 1 -- 172.21.15.26:0/2531827902 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc920045ad0 con 0x7fc9200f5430 2021-11-03T17:53:08.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.102+0000 7fc9177fe700 1 -- 172.21.15.26:0/2531827902 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc91001d420 con 0x7fc9200f5430 2021-11-03T17:53:08.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.103+0000 7fc9177fe700 1 --2- 172.21.15.26:0/2531827902 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc90c064100 0x7fc90c0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:53:08.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.103+0000 7fc9177fe700 1 -- 172.21.15.26:0/2531827902 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc910082700 con 0x7fc9200f5430 2021-11-03T17:53:08.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.103+0000 7fc917fff700 1 --2- 172.21.15.26:0/2531827902 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc90c064100 0x7fc90c0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:53:08.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.103+0000 7fc917fff700 1 --2- 172.21.15.26:0/2531827902 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc90c064100 0x7fc90c0665c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7fc90800a7e0 tx=0x7fc908008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:53:08.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.107+0000 7fc9177fe700 1 -- 172.21.15.26:0/2531827902 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc910054b20 con 0x7fc9200f5430 2021-11-03T17:53:08.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.282+0000 7fc91ffff700 1 -- 172.21.15.26:0/2531827902 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9200fddf0 con 0x7fc90c064100 2021-11-03T17:53:08.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.296+0000 7fc9177fe700 1 -- 172.21.15.26:0/2531827902 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fc9200fddf0 con 0x7fc90c064100 2021-11-03T17:53:08.293 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:53:08.293 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (64m) 3m ago 65m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:53:08.293 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (56m) 3m ago 65m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:53:08.294 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (56m) 2m ago 64m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:53:08.294 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (64m) 3m ago 65m 41.4M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:53:08.294 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (57m) 3m ago 60m 25.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:53:08.294 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (57m) 3m ago 60m 26.0M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:53:08.294 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (60m) 2m ago 60m 26.2M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:53:08.295 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (60m) 2m ago 60m 26.5M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:53:08.295 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (58m) 3m ago 66m 547M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:53:08.295 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (57m) 2m ago 64m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:53:08.295 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (57m) 3m ago 67m 242M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:53:08.296 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (57m) 2m ago 64m 117M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:53:08.296 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (65m) 3m ago 65m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:53:08.296 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (64m) 2m ago 64m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:53:08.296 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (56m) 3m ago 64m 271M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:53:08.297 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (55m) 3m ago 63m 291M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:53:08.297 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (55m) 3m ago 63m 243M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:53:08.297 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (54m) 2m ago 62m 312M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:53:08.297 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (54m) 2m ago 62m 265M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:53:08.297 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (53m) 2m ago 62m 255M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:53:08.298 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (64m) 3m ago 64m 58.9M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:53:08.299 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.298+0000 7fc91ffff700 1 -- 172.21.15.26:0/2531827902 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc90c064100 msgr2=0x7fc90c0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:53:08.299 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.298+0000 7fc91ffff700 1 --2- 172.21.15.26:0/2531827902 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc90c064100 0x7fc90c0665c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7fc90800a7e0 tx=0x7fc908008040).stop 2021-11-03T17:53:08.299 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.298+0000 7fc91ffff700 1 -- 172.21.15.26:0/2531827902 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9200f5430 msgr2=0x7fc92010bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:53:08.299 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.298+0000 7fc91ffff700 1 --2- 172.21.15.26:0/2531827902 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9200f5430 0x7fc92010bed0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7fc910004f60 tx=0x7fc910009b30).stop 2021-11-03T17:53:08.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.298+0000 7fc91ffff700 1 -- 172.21.15.26:0/2531827902 shutdown_connections 2021-11-03T17:53:08.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.298+0000 7fc91ffff700 1 --2- 172.21.15.26:0/2531827902 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc90c064100 0x7fc90c0665c0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:08.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.298+0000 7fc91ffff700 1 --2- 172.21.15.26:0/2531827902 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9200f5430 0x7fc92010bed0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:08.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.298+0000 7fc91ffff700 1 --2- 172.21.15.26:0/2531827902 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9200f66d0 0x7fc92010e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:08.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.298+0000 7fc91ffff700 1 -- 172.21.15.26:0/2531827902 >> 172.21.15.26:0/2531827902 conn(0x7fc9200f0b90 msgr2=0x7fc9200fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:53:08.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.298+0000 7fc91ffff700 1 -- 172.21.15.26:0/2531827902 shutdown_connections 2021-11-03T17:53:08.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.298+0000 7fc91ffff700 1 -- 172.21.15.26:0/2531827902 wait complete. 2021-11-03T17:53:08.396 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.398+0000 7ffa5e309700 1 -- 172.21.15.26:0/2285054073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa58060370 msgr2=0x7ffa580f9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:53:08.396 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.398+0000 7ffa5e309700 1 --2- 172.21.15.26:0/2285054073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa58060370 0x7ffa580f9360 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7ffa4c004660 tx=0x7ffa4c009b30).stop 2021-11-03T17:53:08.396 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.398+0000 7ffa5e309700 1 -- 172.21.15.26:0/2285054073 shutdown_connections 2021-11-03T17:53:08.396 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.398+0000 7ffa5e309700 1 --2- 172.21.15.26:0/2285054073 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa580f9850 0x7ffa580fbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:53:08.397 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.398+0000 7ffa5e309700 1 --2- 172.21.15.26:0/2285054073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa58060370 0x7ffa580f9360 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:08.397 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.398+0000 7ffa5e309700 1 -- 172.21.15.26:0/2285054073 >> 172.21.15.26:0/2285054073 conn(0x7ffa580f0de0 msgr2=0x7ffa580f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:53:08.397 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.398+0000 7ffa5e309700 1 -- 172.21.15.26:0/2285054073 shutdown_connections 2021-11-03T17:53:08.397 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.398+0000 7ffa5e309700 1 -- 172.21.15.26:0/2285054073 wait complete. 2021-11-03T17:53:08.398 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.398+0000 7ffa5e309700 1 Processor -- start 2021-11-03T17:53:08.398 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.399+0000 7ffa5e309700 1 -- start start 2021-11-03T17:53:08.398 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.399+0000 7ffa5e309700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa58060370 0x7ffa58106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:53:08.398 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.399+0000 7ffa5e309700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa580f9850 0x7ffa58107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:53:08.399 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.399+0000 7ffa5e309700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa58107aa0 con 0x7ffa58060370 2021-11-03T17:53:08.399 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.399+0000 7ffa5e309700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa58108350 con 0x7ffa580f9850 2021-11-03T17:53:08.399 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.399+0000 7ffa57fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa58060370 0x7ffa58106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:53:08.399 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.399+0000 7ffa57fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa58060370 0x7ffa58106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56916/0 (socket says 172.21.15.26:56916) 2021-11-03T17:53:08.399 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.399+0000 7ffa57fff700 1 -- 172.21.15.26:0/3186357790 learned_addr learned my addr 172.21.15.26:0/3186357790 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:53:08.400 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.399+0000 7ffa577fe700 1 --2- 172.21.15.26:0/3186357790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa580f9850 0x7ffa58107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:53:08.400 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.399+0000 7ffa57fff700 1 -- 172.21.15.26:0/3186357790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa580f9850 msgr2=0x7ffa58107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:53:08.400 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.399+0000 7ffa57fff700 1 --2- 172.21.15.26:0/3186357790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa580f9850 0x7ffa58107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:08.400 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.399+0000 7ffa57fff700 1 -- 172.21.15.26:0/3186357790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa4c005040 con 0x7ffa58060370 2021-11-03T17:53:08.401 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.399+0000 7ffa577fe700 1 --2- 172.21.15.26:0/3186357790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa580f9850 0x7ffa58107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:53:08.401 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.399+0000 7ffa57fff700 1 --2- 172.21.15.26:0/3186357790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa58060370 0x7ffa58106f70 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7ffa4c004f60 tx=0x7ffa4c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:53:08.401 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.400+0000 7ffa54ff9700 1 -- 172.21.15.26:0/3186357790 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa4c018070 con 0x7ffa58060370 2021-11-03T17:53:08.401 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.400+0000 7ffa54ff9700 1 -- 172.21.15.26:0/3186357790 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ffa4c007ba0 con 0x7ffa58060370 2021-11-03T17:53:08.401 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.400+0000 7ffa5e309700 1 -- 172.21.15.26:0/3186357790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa581085d0 con 0x7ffa58060370 2021-11-03T17:53:08.402 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.400+0000 7ffa54ff9700 1 -- 172.21.15.26:0/3186357790 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa4c01c620 con 0x7ffa58060370 2021-11-03T17:53:08.402 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.400+0000 7ffa5e309700 1 -- 172.21.15.26:0/3186357790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa58108b30 con 0x7ffa58060370 2021-11-03T17:53:08.403 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.401+0000 7ffa5e309700 1 -- 172.21.15.26:0/3186357790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa580f4a70 con 0x7ffa58060370 2021-11-03T17:53:08.403 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.401+0000 7ffa54ff9700 1 -- 172.21.15.26:0/3186357790 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ffa4c01c8e0 con 0x7ffa58060370 2021-11-03T17:53:08.404 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.402+0000 7ffa54ff9700 1 --2- 172.21.15.26:0/3186357790 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffa400640b0 0x7ffa40066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:53:08.404 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.402+0000 7ffa54ff9700 1 -- 172.21.15.26:0/3186357790 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ffa4c0826e0 con 0x7ffa58060370 2021-11-03T17:53:08.404 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.402+0000 7ffa577fe700 1 --2- 172.21.15.26:0/3186357790 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffa400640b0 0x7ffa40066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:53:08.404 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.402+0000 7ffa577fe700 1 --2- 172.21.15.26:0/3186357790 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffa400640b0 0x7ffa40066570 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7ffa4800b830 tx=0x7ffa48008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:53:08.405 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.406+0000 7ffa54ff9700 1 -- 172.21.15.26:0/3186357790 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ffa4c054a40 con 0x7ffa58060370 2021-11-03T17:53:08.631 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.634+0000 7ffa5e309700 1 -- 172.21.15.26:0/3186357790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ffa580feff0 con 0x7ffa58060370 2021-11-03T17:53:08.631 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.635+0000 7ffa54ff9700 1 -- 172.21.15.26:0/3186357790 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7ffa4c054630 con 0x7ffa58060370 2021-11-03T17:53:08.632 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:53:08.632 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:53:08.632 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:53:08.632 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:53:08.633 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:53:08.633 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:53:08.633 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:53:08.633 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:53:08.634 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:53:08.634 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:53:08.634 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:53:08.634 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:53:08.635 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:53:08.635 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:53:08.635 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:53:08.635 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:53:08.636 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:53:08.636 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:53:08.637 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.636+0000 7ffa5e309700 1 -- 172.21.15.26:0/3186357790 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffa400640b0 msgr2=0x7ffa40066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:53:08.638 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.636+0000 7ffa5e309700 1 --2- 172.21.15.26:0/3186357790 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffa400640b0 0x7ffa40066570 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7ffa4800b830 tx=0x7ffa48008040).stop 2021-11-03T17:53:08.638 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.637+0000 7ffa5e309700 1 -- 172.21.15.26:0/3186357790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa58060370 msgr2=0x7ffa58106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:53:08.638 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.637+0000 7ffa5e309700 1 --2- 172.21.15.26:0/3186357790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa58060370 0x7ffa58106f70 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7ffa4c004f60 tx=0x7ffa4c009b30).stop 2021-11-03T17:53:08.638 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.637+0000 7ffa5e309700 1 -- 172.21.15.26:0/3186357790 shutdown_connections 2021-11-03T17:53:08.639 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.637+0000 7ffa5e309700 1 --2- 172.21.15.26:0/3186357790 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffa400640b0 0x7ffa40066570 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:08.639 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.637+0000 7ffa5e309700 1 --2- 172.21.15.26:0/3186357790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa58060370 0x7ffa58106f70 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:08.639 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.637+0000 7ffa5e309700 1 --2- 172.21.15.26:0/3186357790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa580f9850 0x7ffa58107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:08.639 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.637+0000 7ffa5e309700 1 -- 172.21.15.26:0/3186357790 >> 172.21.15.26:0/3186357790 conn(0x7ffa580f0de0 msgr2=0x7ffa580f31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:53:08.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.637+0000 7ffa5e309700 1 -- 172.21.15.26:0/3186357790 shutdown_connections 2021-11-03T17:53:08.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.637+0000 7ffa5e309700 1 -- 172.21.15.26:0/3186357790 wait complete. 2021-11-03T17:53:08.735 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.736+0000 7f2ff0db6700 1 -- 172.21.15.26:0/288112111 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fec0f66e0 msgr2=0x7f2fec0f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:53:08.735 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.736+0000 7f2ff0db6700 1 --2- 172.21.15.26:0/288112111 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fec0f66e0 0x7f2fec0f6b40 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7f2fe0004660 tx=0x7f2fe0009b30).stop 2021-11-03T17:53:08.735 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.736+0000 7f2ff0db6700 1 -- 172.21.15.26:0/288112111 shutdown_connections 2021-11-03T17:53:08.736 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.736+0000 7f2ff0db6700 1 --2- 172.21.15.26:0/288112111 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fec0f66e0 0x7f2fec0f6b40 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:08.736 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.736+0000 7f2ff0db6700 1 --2- 172.21.15.26:0/288112111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2fec0f5440 0x7f2fec0f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:08.736 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.736+0000 7f2ff0db6700 1 -- 172.21.15.26:0/288112111 >> 172.21.15.26:0/288112111 conn(0x7f2fec0f0ba0 msgr2=0x7f2fec0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:53:08.736 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.736+0000 7f2ff0db6700 1 -- 172.21.15.26:0/288112111 shutdown_connections 2021-11-03T17:53:08.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.736+0000 7f2ff0db6700 1 -- 172.21.15.26:0/288112111 wait complete. 2021-11-03T17:53:08.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.737+0000 7f2ff0db6700 1 Processor -- start 2021-11-03T17:53:08.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.737+0000 7f2ff0db6700 1 -- start start 2021-11-03T17:53:08.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.737+0000 7f2ff0db6700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2fec0f5440 0x7f2fec1099b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:53:08.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.737+0000 7f2ff0db6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fec0f66e0 0x7f2fec10beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:53:08.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.737+0000 7f2ff0db6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec0603e0 con 0x7f2fec0f66e0 2021-11-03T17:53:08.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.737+0000 7f2ff0db6700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec060520 con 0x7f2fec0f5440 2021-11-03T17:53:08.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.737+0000 7f2feaffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fec0f66e0 0x7f2fec10beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:53:08.739 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.737+0000 7f2feaffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fec0f66e0 0x7f2fec10beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56928/0 (socket says 172.21.15.26:56928) 2021-11-03T17:53:08.739 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.737+0000 7f2feaffd700 1 -- 172.21.15.26:0/4185951438 learned_addr learned my addr 172.21.15.26:0/4185951438 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:53:08.739 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.737+0000 7f2feb7fe700 1 --2- 172.21.15.26:0/4185951438 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2fec0f5440 0x7f2fec1099b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:53:08.740 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.738+0000 7f2feaffd700 1 -- 172.21.15.26:0/4185951438 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2fec0f5440 msgr2=0x7f2fec1099b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:53:08.740 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.738+0000 7f2feaffd700 1 --2- 172.21.15.26:0/4185951438 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2fec0f5440 0x7f2fec1099b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:08.740 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.738+0000 7f2feaffd700 1 -- 172.21.15.26:0/4185951438 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe0005040 con 0x7f2fec0f66e0 2021-11-03T17:53:08.740 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.738+0000 7f2feaffd700 1 --2- 172.21.15.26:0/4185951438 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fec0f66e0 0x7f2fec10beb0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7f2fe0009990 tx=0x7f2fe0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:53:08.740 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.738+0000 7f2fd3fff700 1 -- 172.21.15.26:0/4185951438 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fe0018070 con 0x7f2fec0f66e0 2021-11-03T17:53:08.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.738+0000 7f2ff0db6700 1 -- 172.21.15.26:0/4185951438 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fec10c400 con 0x7f2fec0f66e0 2021-11-03T17:53:08.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.738+0000 7f2fd3fff700 1 -- 172.21.15.26:0/4185951438 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2fe0007ba0 con 0x7f2fec0f66e0 2021-11-03T17:53:08.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.738+0000 7f2fd3fff700 1 -- 172.21.15.26:0/4185951438 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fe001c3c0 con 0x7f2fec0f66e0 2021-11-03T17:53:08.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.738+0000 7f2ff0db6700 1 -- 172.21.15.26:0/4185951438 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fec10c960 con 0x7f2fec0f66e0 2021-11-03T17:53:08.742 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.739+0000 7f2ff0db6700 1 -- 172.21.15.26:0/4185951438 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fec045ad0 con 0x7f2fec0f66e0 2021-11-03T17:53:08.743 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.739+0000 7f2fd3fff700 1 -- 172.21.15.26:0/4185951438 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f2fe001d420 con 0x7f2fec0f66e0 2021-11-03T17:53:08.743 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.740+0000 7f2fd3fff700 1 --2- 172.21.15.26:0/4185951438 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2fd4064100 0x7f2fd40665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:53:08.743 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.740+0000 7f2fd3fff700 1 -- 172.21.15.26:0/4185951438 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f2fe0082500 con 0x7f2fec0f66e0 2021-11-03T17:53:08.743 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.740+0000 7f2feb7fe700 1 --2- 172.21.15.26:0/4185951438 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2fd4064100 0x7f2fd40665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:53:08.744 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.740+0000 7f2feb7fe700 1 --2- 172.21.15.26:0/4185951438 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2fd4064100 0x7f2fd40665c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f2fec060060 tx=0x7f2fdc009c80).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:53:08.744 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.744+0000 7f2fd3fff700 1 -- 172.21.15.26:0/4185951438 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f2fe00548c0 con 0x7f2fec0f66e0 2021-11-03T17:53:08.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:08 smithi194 ceph-mon[65619]: pgmap v1754: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:08.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:08 smithi026 ceph-mon[96795]: pgmap v1754: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:08.943 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.947+0000 7f2ff0db6700 1 -- 172.21.15.26:0/4185951438 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2fec0fdca0 con 0x7f2fec0f66e0 2021-11-03T17:53:08.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.948+0000 7f2fd3fff700 1 -- 172.21.15.26:0/4185951438 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f2fe00544b0 con 0x7f2fec0f66e0 2021-11-03T17:53:08.944 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:53:08.945 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:53:08.945 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:53:08.945 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:53:08.946 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:53:08.946 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:53:08.946 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:53:08.946 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:53:08.947 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:53:08.947 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:53:08.947 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:53:08.947 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:53:08.948 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:53:08.948 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:53:08.948 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:53:08.948 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:53:08.948 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:53:08.949 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:53:08.949 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:53:08.949 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:53:08.950 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:53:08.950 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:53:08.950 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:53:08.950 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:53:08.951 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:53:08.951 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:53:08.951 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:53:08.951 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:53:08.952 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:53:08.952 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:53:08.952 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:53:08.952 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:53:08.952 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:53:08.953 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:53:08.953 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:53:08.953 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:53:08.953 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:53:08.954 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:53:08.954 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:53:08.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.949+0000 7f2ff0db6700 1 -- 172.21.15.26:0/4185951438 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2fd4064100 msgr2=0x7f2fd40665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:53:08.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.949+0000 7f2ff0db6700 1 --2- 172.21.15.26:0/4185951438 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2fd4064100 0x7f2fd40665c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f2fec060060 tx=0x7f2fdc009c80).stop 2021-11-03T17:53:08.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.949+0000 7f2ff0db6700 1 -- 172.21.15.26:0/4185951438 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fec0f66e0 msgr2=0x7f2fec10beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:53:08.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.949+0000 7f2ff0db6700 1 --2- 172.21.15.26:0/4185951438 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fec0f66e0 0x7f2fec10beb0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7f2fe0009990 tx=0x7f2fe0009b30).stop 2021-11-03T17:53:08.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.949+0000 7f2ff0db6700 1 -- 172.21.15.26:0/4185951438 shutdown_connections 2021-11-03T17:53:08.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.949+0000 7f2ff0db6700 1 --2- 172.21.15.26:0/4185951438 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2fd4064100 0x7f2fd40665c0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:08.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.949+0000 7f2ff0db6700 1 --2- 172.21.15.26:0/4185951438 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2fec0f5440 0x7f2fec1099b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:08.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.949+0000 7f2ff0db6700 1 --2- 172.21.15.26:0/4185951438 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fec0f66e0 0x7f2fec10beb0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:08.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.949+0000 7f2ff0db6700 1 -- 172.21.15.26:0/4185951438 >> 172.21.15.26:0/4185951438 conn(0x7f2fec0f0ba0 msgr2=0x7f2fec0fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:53:08.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.950+0000 7f2ff0db6700 1 -- 172.21.15.26:0/4185951438 shutdown_connections 2021-11-03T17:53:08.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:08.950+0000 7f2ff0db6700 1 -- 172.21.15.26:0/4185951438 wait complete. 2021-11-03T17:53:08.957 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:53:09.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:09 smithi194 ceph-mon[65619]: from='client.35948 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:53:09.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:09 smithi194 ceph-mon[65619]: from='client.35952 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:53:09.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:09 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3186357790' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:53:09.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:09 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/4185951438' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:53:09.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:09 smithi026 ceph-mon[96795]: from='client.35948 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:53:09.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:09 smithi026 ceph-mon[96795]: from='client.35952 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:53:09.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:09 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3186357790' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:53:09.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:09 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/4185951438' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:53:10.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:10 smithi194 ceph-mon[65619]: pgmap v1755: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:10.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:10 smithi026 ceph-mon[96795]: pgmap v1755: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:11.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:11 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:53:11.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:11 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:53:12.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:12 smithi194 ceph-mon[65619]: pgmap v1756: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:12.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:12 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:53:12.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:12 smithi026 ceph-mon[96795]: pgmap v1756: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:12.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:12 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:53:14.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:14 smithi194 ceph-mon[65619]: pgmap v1757: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:14.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:14 smithi026 ceph-mon[96795]: pgmap v1757: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:16.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:16 smithi194 ceph-mon[65619]: pgmap v1758: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:16.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:16 smithi026 ceph-mon[96795]: pgmap v1758: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:18.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:18 smithi026 ceph-mon[96795]: pgmap v1759: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:18.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:18 smithi194 ceph-mon[65619]: pgmap v1759: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:20.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:20 smithi026 ceph-mon[96795]: pgmap v1760: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:20.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:20 smithi194 ceph-mon[65619]: pgmap v1760: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:22.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:22 smithi026 ceph-mon[96795]: pgmap v1761: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:22.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:22 smithi194 ceph-mon[65619]: pgmap v1761: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:24.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:24 smithi026 ceph-mon[96795]: pgmap v1762: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:24.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:24 smithi194 ceph-mon[65619]: pgmap v1762: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:26.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:26 smithi026 ceph-mon[96795]: pgmap v1763: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:26.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:26 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:53:26.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:26 smithi194 ceph-mon[65619]: pgmap v1763: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:26.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:26 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:53:27.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:27 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:53:27.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:27 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:53:28.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:28 smithi026 ceph-mon[96795]: pgmap v1764: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:28.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:28 smithi194 ceph-mon[65619]: pgmap v1764: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:30.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:30 smithi026 ceph-mon[96795]: pgmap v1765: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:30.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:30 smithi194 ceph-mon[65619]: pgmap v1765: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:32.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:32 smithi026 ceph-mon[96795]: pgmap v1766: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:32.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:32 smithi194 ceph-mon[65619]: pgmap v1766: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:34.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:34 smithi026 ceph-mon[96795]: pgmap v1767: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:34.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:34 smithi194 ceph-mon[65619]: pgmap v1767: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:36.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:36 smithi026 ceph-mon[96795]: pgmap v1768: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:36.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:36 smithi194 ceph-mon[65619]: pgmap v1768: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:38.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:38 smithi026 ceph-mon[96795]: pgmap v1769: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:38.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:38 smithi194 ceph-mon[65619]: pgmap v1769: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:39.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.065+0000 7f088cded700 1 -- 172.21.15.26:0/2561346668 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08880f6ff0 msgr2=0x7f08880f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:53:39.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.065+0000 7f088cded700 1 --2- 172.21.15.26:0/2561346668 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08880f6ff0 0x7f08880f7a20 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7f0878004660 tx=0x7f0878009b30).stop 2021-11-03T17:53:39.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.066+0000 7f088cded700 1 -- 172.21.15.26:0/2561346668 shutdown_connections 2021-11-03T17:53:39.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.066+0000 7f088cded700 1 --2- 172.21.15.26:0/2561346668 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08880f6ff0 0x7f08880f7a20 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:39.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.066+0000 7f088cded700 1 --2- 172.21.15.26:0/2561346668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08880f66e0 0x7f08880f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:39.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.066+0000 7f088cded700 1 -- 172.21.15.26:0/2561346668 >> 172.21.15.26:0/2561346668 conn(0x7f08880f1f00 msgr2=0x7f08880f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:53:39.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.066+0000 7f088cded700 1 -- 172.21.15.26:0/2561346668 shutdown_connections 2021-11-03T17:53:39.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.066+0000 7f088cded700 1 -- 172.21.15.26:0/2561346668 wait complete. 2021-11-03T17:53:39.065 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.066+0000 7f088cded700 1 Processor -- start 2021-11-03T17:53:39.065 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.066+0000 7f088cded700 1 -- start start 2021-11-03T17:53:39.065 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.066+0000 7f088cded700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08880f66e0 0x7f0888106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:53:39.065 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.066+0000 7f088cded700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08880f6ff0 0x7f0888107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:53:39.065 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.066+0000 7f088cded700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0888107a10 con 0x7f08880f66e0 2021-11-03T17:53:39.066 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.066+0000 7f088cded700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0888107b50 con 0x7f08880f6ff0 2021-11-03T17:53:39.066 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.066+0000 7f088659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08880f66e0 0x7f0888106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:53:39.066 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.067+0000 7f088659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08880f66e0 0x7f0888106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56944/0 (socket says 172.21.15.26:56944) 2021-11-03T17:53:39.066 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.067+0000 7f088659c700 1 -- 172.21.15.26:0/129920270 learned_addr learned my addr 172.21.15.26:0/129920270 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:53:39.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.067+0000 7f0885d9b700 1 --2- 172.21.15.26:0/129920270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08880f6ff0 0x7f0888107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:53:39.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.067+0000 7f088659c700 1 -- 172.21.15.26:0/129920270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08880f6ff0 msgr2=0x7f0888107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:53:39.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.067+0000 7f088659c700 1 --2- 172.21.15.26:0/129920270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08880f6ff0 0x7f0888107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:39.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.067+0000 7f088659c700 1 -- 172.21.15.26:0/129920270 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0878005040 con 0x7f08880f66e0 2021-11-03T17:53:39.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.067+0000 7f0885d9b700 1 --2- 172.21.15.26:0/129920270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08880f6ff0 0x7f0888107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:53:39.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.067+0000 7f088659c700 1 --2- 172.21.15.26:0/129920270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08880f66e0 0x7f0888106f70 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7f08700026d0 tx=0x7f0870009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:53:39.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.067+0000 7f087effd700 1 -- 172.21.15.26:0/129920270 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0870009320 con 0x7f08880f66e0 2021-11-03T17:53:39.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.067+0000 7f087effd700 1 -- 172.21.15.26:0/129920270 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f087000f040 con 0x7f08880f66e0 2021-11-03T17:53:39.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.067+0000 7f088cded700 1 -- 172.21.15.26:0/129920270 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08881084f0 con 0x7f08880f66e0 2021-11-03T17:53:39.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.067+0000 7f087effd700 1 -- 172.21.15.26:0/129920270 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08700147e0 con 0x7f08880f66e0 2021-11-03T17:53:39.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.067+0000 7f088cded700 1 -- 172.21.15.26:0/129920270 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0888108ab0 con 0x7f08880f66e0 2021-11-03T17:53:39.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.068+0000 7f088cded700 1 -- 172.21.15.26:0/129920270 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0888045ad0 con 0x7f08880f66e0 2021-11-03T17:53:39.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.069+0000 7f087effd700 1 -- 172.21.15.26:0/129920270 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f0870009480 con 0x7f08880f66e0 2021-11-03T17:53:39.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.069+0000 7f087effd700 1 --2- 172.21.15.26:0/129920270 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f08740640b0 0x7f0874066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:53:39.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.069+0000 7f087effd700 1 -- 172.21.15.26:0/129920270 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f0870080f70 con 0x7f08880f66e0 2021-11-03T17:53:39.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.069+0000 7f0885d9b700 1 --2- 172.21.15.26:0/129920270 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f08740640b0 0x7f0874066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:53:39.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.070+0000 7f0885d9b700 1 --2- 172.21.15.26:0/129920270 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f08740640b0 0x7f0874066570 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f0878004630 tx=0x7f0878009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:53:39.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.073+0000 7f087effd700 1 -- 172.21.15.26:0/129920270 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f0870053210 con 0x7f08880f66e0 2021-11-03T17:53:39.248 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.253+0000 7f088cded700 1 -- 172.21.15.26:0/129920270 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0888108d30 con 0x7f08740640b0 2021-11-03T17:53:39.249 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.254+0000 7f087effd700 1 -- 172.21.15.26:0/129920270 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f0888108d30 con 0x7f08740640b0 2021-11-03T17:53:39.251 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.256+0000 7f088cded700 1 -- 172.21.15.26:0/129920270 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f08740640b0 msgr2=0x7f0874066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:53:39.251 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.256+0000 7f088cded700 1 --2- 172.21.15.26:0/129920270 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f08740640b0 0x7f0874066570 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f0878004630 tx=0x7f0878009b30).stop 2021-11-03T17:53:39.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.256+0000 7f088cded700 1 -- 172.21.15.26:0/129920270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08880f66e0 msgr2=0x7f0888106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:53:39.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.256+0000 7f088cded700 1 --2- 172.21.15.26:0/129920270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08880f66e0 0x7f0888106f70 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7f08700026d0 tx=0x7f0870009de0).stop 2021-11-03T17:53:39.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.256+0000 7f088cded700 1 -- 172.21.15.26:0/129920270 shutdown_connections 2021-11-03T17:53:39.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.256+0000 7f088cded700 1 --2- 172.21.15.26:0/129920270 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f08740640b0 0x7f0874066570 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:39.253 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.256+0000 7f088cded700 1 --2- 172.21.15.26:0/129920270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08880f66e0 0x7f0888106f70 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:39.253 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.256+0000 7f088cded700 1 --2- 172.21.15.26:0/129920270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08880f6ff0 0x7f0888107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:39.253 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.256+0000 7f088cded700 1 -- 172.21.15.26:0/129920270 >> 172.21.15.26:0/129920270 conn(0x7f08880f1f00 msgr2=0x7f08880fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:53:39.253 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.256+0000 7f088cded700 1 -- 172.21.15.26:0/129920270 shutdown_connections 2021-11-03T17:53:39.254 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.256+0000 7f088cded700 1 -- 172.21.15.26:0/129920270 wait complete. 2021-11-03T17:53:39.261 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:53:39.354 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.357+0000 7f5e9debe700 1 -- 172.21.15.26:0/2077566601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e98060270 msgr2=0x7f5e980f9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:53:39.354 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.357+0000 7f5e9debe700 1 --2- 172.21.15.26:0/2077566601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e98060270 0x7f5e980f9340 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7f5e88004660 tx=0x7f5e88009b30).stop 2021-11-03T17:53:39.355 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.357+0000 7f5e9debe700 1 -- 172.21.15.26:0/2077566601 shutdown_connections 2021-11-03T17:53:39.355 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.357+0000 7f5e9debe700 1 --2- 172.21.15.26:0/2077566601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e980f9830 0x7f5e980fbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:39.355 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.357+0000 7f5e9debe700 1 --2- 172.21.15.26:0/2077566601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e98060270 0x7f5e980f9340 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:39.355 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.357+0000 7f5e9debe700 1 -- 172.21.15.26:0/2077566601 >> 172.21.15.26:0/2077566601 conn(0x7f5e980f0d40 msgr2=0x7f5e980f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:53:39.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.357+0000 7f5e9debe700 1 -- 172.21.15.26:0/2077566601 shutdown_connections 2021-11-03T17:53:39.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.357+0000 7f5e9debe700 1 -- 172.21.15.26:0/2077566601 wait complete. 2021-11-03T17:53:39.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.357+0000 7f5e9debe700 1 Processor -- start 2021-11-03T17:53:39.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.358+0000 7f5e9debe700 1 -- start start 2021-11-03T17:53:39.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.358+0000 7f5e9debe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e98060270 0x7f5e980f6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:53:39.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.358+0000 7f5e9debe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e980f9830 0x7f5e980f5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:53:39.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.358+0000 7f5e9debe700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e980f57a0 con 0x7f5e980f9830 2021-11-03T17:53:39.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.358+0000 7f5e9debe700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e980f58e0 con 0x7f5e98060270 2021-11-03T17:53:39.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.358+0000 7f5e96ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e980f9830 0x7f5e980f5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:53:39.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.358+0000 7f5e96ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e980f9830 0x7f5e980f5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56956/0 (socket says 172.21.15.26:56956) 2021-11-03T17:53:39.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.358+0000 7f5e96ffd700 1 -- 172.21.15.26:0/1280255042 learned_addr learned my addr 172.21.15.26:0/1280255042 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:53:39.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.358+0000 7f5e977fe700 1 --2- 172.21.15.26:0/1280255042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e98060270 0x7f5e980f6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:53:39.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.358+0000 7f5e96ffd700 1 -- 172.21.15.26:0/1280255042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e98060270 msgr2=0x7f5e980f6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:53:39.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.358+0000 7f5e96ffd700 1 --2- 172.21.15.26:0/1280255042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e98060270 0x7f5e980f6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:39.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.358+0000 7f5e96ffd700 1 -- 172.21.15.26:0/1280255042 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e88005040 con 0x7f5e980f9830 2021-11-03T17:53:39.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.358+0000 7f5e96ffd700 1 --2- 172.21.15.26:0/1280255042 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e980f9830 0x7f5e980f5240 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7f5e8c002700 tx=0x7f5e8c009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:53:39.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.358+0000 7f5e7ffff700 1 -- 172.21.15.26:0/1280255042 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e8c009320 con 0x7f5e980f9830 2021-11-03T17:53:39.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.358+0000 7f5e7ffff700 1 -- 172.21.15.26:0/1280255042 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5e8c00f040 con 0x7f5e980f9830 2021-11-03T17:53:39.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.358+0000 7f5e9debe700 1 -- 172.21.15.26:0/1280255042 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e980f5bc0 con 0x7f5e980f9830 2021-11-03T17:53:39.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.358+0000 7f5e7ffff700 1 -- 172.21.15.26:0/1280255042 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e8c014810 con 0x7f5e980f9830 2021-11-03T17:53:39.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.358+0000 7f5e9debe700 1 -- 172.21.15.26:0/1280255042 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e9810ef90 con 0x7f5e980f9830 2021-11-03T17:53:39.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.360+0000 7f5e9debe700 1 -- 172.21.15.26:0/1280255042 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e98045ad0 con 0x7f5e980f9830 2021-11-03T17:53:39.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.360+0000 7f5e7ffff700 1 -- 172.21.15.26:0/1280255042 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f5e8c0077b0 con 0x7f5e980f9830 2021-11-03T17:53:39.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.360+0000 7f5e7ffff700 1 --2- 172.21.15.26:0/1280255042 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5e800640b0 0x7f5e80066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:53:39.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.360+0000 7f5e7ffff700 1 -- 172.21.15.26:0/1280255042 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f5e8c080d90 con 0x7f5e980f9830 2021-11-03T17:53:39.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.360+0000 7f5e977fe700 1 --2- 172.21.15.26:0/1280255042 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5e800640b0 0x7f5e80066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:53:39.363 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.361+0000 7f5e977fe700 1 --2- 172.21.15.26:0/1280255042 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5e800640b0 0x7f5e80066570 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f5e88004630 tx=0x7f5e88009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:53:39.363 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.364+0000 7f5e7ffff700 1 -- 172.21.15.26:0/1280255042 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f5e8c0530f0 con 0x7f5e980f9830 2021-11-03T17:53:39.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.540+0000 7f5e9debe700 1 -- 172.21.15.26:0/1280255042 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e980fefc0 con 0x7f5e800640b0 2021-11-03T17:53:39.550 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.554+0000 7f5e7ffff700 1 -- 172.21.15.26:0/1280255042 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f5e980fefc0 con 0x7f5e800640b0 2021-11-03T17:53:39.550 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:53:39.550 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (64m) 4m ago 66m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:53:39.551 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (57m) 4m ago 66m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:53:39.551 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (56m) 3m ago 65m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:53:39.551 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (64m) 4m ago 65m 41.4M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:53:39.551 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (57m) 4m ago 61m 25.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:53:39.552 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (58m) 4m ago 61m 26.0M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:53:39.552 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (61m) 3m ago 61m 26.2M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:53:39.552 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (61m) 3m ago 61m 26.5M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:53:39.552 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (58m) 4m ago 67m 547M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:53:39.553 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (58m) 3m ago 65m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:53:39.553 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (58m) 4m ago 67m 242M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:53:39.553 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (57m) 3m ago 65m 117M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:53:39.553 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (65m) 4m ago 65m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:53:39.553 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (65m) 3m ago 65m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:53:39.554 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (56m) 4m ago 64m 271M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:53:39.554 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (56m) 4m ago 64m 291M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:53:39.554 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (55m) 4m ago 63m 243M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:53:39.554 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (55m) 3m ago 63m 312M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:53:39.555 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (54m) 3m ago 63m 265M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:53:39.555 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (54m) 3m ago 62m 255M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:53:39.555 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (64m) 4m ago 65m 58.9M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:53:39.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.556+0000 7f5e9debe700 1 -- 172.21.15.26:0/1280255042 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5e800640b0 msgr2=0x7f5e80066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:53:39.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.556+0000 7f5e9debe700 1 --2- 172.21.15.26:0/1280255042 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5e800640b0 0x7f5e80066570 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f5e88004630 tx=0x7f5e88009b30).stop 2021-11-03T17:53:39.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.556+0000 7f5e9debe700 1 -- 172.21.15.26:0/1280255042 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e980f9830 msgr2=0x7f5e980f5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:53:39.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.556+0000 7f5e9debe700 1 --2- 172.21.15.26:0/1280255042 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e980f9830 0x7f5e980f5240 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7f5e8c002700 tx=0x7f5e8c009d60).stop 2021-11-03T17:53:39.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.556+0000 7f5e9debe700 1 -- 172.21.15.26:0/1280255042 shutdown_connections 2021-11-03T17:53:39.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.556+0000 7f5e9debe700 1 --2- 172.21.15.26:0/1280255042 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5e800640b0 0x7f5e80066570 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:39.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.556+0000 7f5e9debe700 1 --2- 172.21.15.26:0/1280255042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e98060270 0x7f5e980f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:39.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.556+0000 7f5e9debe700 1 --2- 172.21.15.26:0/1280255042 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e980f9830 0x7f5e980f5240 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:39.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.556+0000 7f5e9debe700 1 -- 172.21.15.26:0/1280255042 >> 172.21.15.26:0/1280255042 conn(0x7f5e980f0d40 msgr2=0x7f5e980f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:53:39.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.556+0000 7f5e9debe700 1 -- 172.21.15.26:0/1280255042 shutdown_connections 2021-11-03T17:53:39.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.556+0000 7f5e9debe700 1 -- 172.21.15.26:0/1280255042 wait complete. 2021-11-03T17:53:39.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.655+0000 7fc264b05700 1 -- 172.21.15.26:0/3421935292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2600f51a0 msgr2=0x7fc2600f7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:53:39.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.655+0000 7fc264b05700 1 --2- 172.21.15.26:0/3421935292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2600f51a0 0x7fc2600f7920 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7fc254004660 tx=0x7fc254009b30).stop 2021-11-03T17:53:39.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.655+0000 7fc264b05700 1 -- 172.21.15.26:0/3421935292 shutdown_connections 2021-11-03T17:53:39.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.655+0000 7fc264b05700 1 --2- 172.21.15.26:0/3421935292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2600f51a0 0x7fc2600f7920 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:39.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.655+0000 7fc264b05700 1 --2- 172.21.15.26:0/3421935292 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2600f4800 0x7fc2600f4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:39.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.655+0000 7fc264b05700 1 -- 172.21.15.26:0/3421935292 >> 172.21.15.26:0/3421935292 conn(0x7fc2600f0320 msgr2=0x7fc2600f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:53:39.654 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.655+0000 7fc264b05700 1 -- 172.21.15.26:0/3421935292 shutdown_connections 2021-11-03T17:53:39.654 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.655+0000 7fc264b05700 1 -- 172.21.15.26:0/3421935292 wait complete. 2021-11-03T17:53:39.654 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.656+0000 7fc264b05700 1 Processor -- start 2021-11-03T17:53:39.654 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.656+0000 7fc264b05700 1 -- start start 2021-11-03T17:53:39.655 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.656+0000 7fc264b05700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2600f4800 0x7fc260106db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:53:39.655 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.656+0000 7fc264b05700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2600f51a0 0x7fc2601072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:53:39.655 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.656+0000 7fc264b05700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2601078a0 con 0x7fc2600f51a0 2021-11-03T17:53:39.655 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.656+0000 7fc264b05700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2601080e0 con 0x7fc2600f4800 2021-11-03T17:53:39.655 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.656+0000 7fc25effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2600f51a0 0x7fc2601072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:53:39.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.656+0000 7fc25effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2600f51a0 0x7fc2601072a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56966/0 (socket says 172.21.15.26:56966) 2021-11-03T17:53:39.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.656+0000 7fc25effd700 1 -- 172.21.15.26:0/3383143894 learned_addr learned my addr 172.21.15.26:0/3383143894 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:53:39.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.657+0000 7fc25f7fe700 1 --2- 172.21.15.26:0/3383143894 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2600f4800 0x7fc260106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:53:39.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.657+0000 7fc25effd700 1 -- 172.21.15.26:0/3383143894 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2600f4800 msgr2=0x7fc260106db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:53:39.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.657+0000 7fc25effd700 1 --2- 172.21.15.26:0/3383143894 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2600f4800 0x7fc260106db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:39.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.657+0000 7fc25effd700 1 -- 172.21.15.26:0/3383143894 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc254005040 con 0x7fc2600f51a0 2021-11-03T17:53:39.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.657+0000 7fc25f7fe700 1 --2- 172.21.15.26:0/3383143894 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2600f4800 0x7fc260106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:53:39.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.657+0000 7fc25effd700 1 --2- 172.21.15.26:0/3383143894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2600f51a0 0x7fc2601072a0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 rx=0x7fc254013a70 tx=0x7fc254009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:53:39.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.657+0000 7fc247fff700 1 -- 172.21.15.26:0/3383143894 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc254018070 con 0x7fc2600f51a0 2021-11-03T17:53:39.658 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.657+0000 7fc247fff700 1 -- 172.21.15.26:0/3383143894 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc2540097d0 con 0x7fc2600f51a0 2021-11-03T17:53:39.658 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.657+0000 7fc264b05700 1 -- 172.21.15.26:0/3383143894 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc260108360 con 0x7fc2600f51a0 2021-11-03T17:53:39.658 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.657+0000 7fc247fff700 1 -- 172.21.15.26:0/3383143894 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc25401c3c0 con 0x7fc2600f51a0 2021-11-03T17:53:39.659 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.657+0000 7fc264b05700 1 -- 172.21.15.26:0/3383143894 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc260108840 con 0x7fc2600f51a0 2021-11-03T17:53:39.660 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.658+0000 7fc264b05700 1 -- 172.21.15.26:0/3383143894 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc260059100 con 0x7fc2600f51a0 2021-11-03T17:53:39.660 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.658+0000 7fc247fff700 1 -- 172.21.15.26:0/3383143894 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc254007ba0 con 0x7fc2600f51a0 2021-11-03T17:53:39.660 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.659+0000 7fc247fff700 1 --2- 172.21.15.26:0/3383143894 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc248064100 0x7fc2480665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:53:39.660 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.659+0000 7fc247fff700 1 -- 172.21.15.26:0/3383143894 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc2540824b0 con 0x7fc2600f51a0 2021-11-03T17:53:39.661 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.659+0000 7fc25f7fe700 1 --2- 172.21.15.26:0/3383143894 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc248064100 0x7fc2480665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:53:39.661 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.659+0000 7fc25f7fe700 1 --2- 172.21.15.26:0/3383143894 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc248064100 0x7fc2480665c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7fc260107b70 tx=0x7fc250009c00).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:53:39.661 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.663+0000 7fc247fff700 1 -- 172.21.15.26:0/3383143894 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc254054810 con 0x7fc2600f51a0 2021-11-03T17:53:39.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.894+0000 7fc264b05700 1 -- 172.21.15.26:0/3383143894 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc2600feeb0 con 0x7fc2600f51a0 2021-11-03T17:53:39.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.895+0000 7fc247fff700 1 -- 172.21.15.26:0/3383143894 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fc2600feeb0 con 0x7fc2600f51a0 2021-11-03T17:53:39.890 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:53:39.890 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:53:39.891 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:53:39.891 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:53:39.891 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:53:39.891 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:53:39.892 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:53:39.892 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:53:39.892 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:53:39.892 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:53:39.893 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:53:39.893 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:53:39.893 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:53:39.893 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:53:39.894 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:53:39.894 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:53:39.894 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:53:39.894 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:53:39.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.896+0000 7fc264b05700 1 -- 172.21.15.26:0/3383143894 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc248064100 msgr2=0x7fc2480665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:53:39.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.896+0000 7fc264b05700 1 --2- 172.21.15.26:0/3383143894 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc248064100 0x7fc2480665c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7fc260107b70 tx=0x7fc250009c00).stop 2021-11-03T17:53:39.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.896+0000 7fc264b05700 1 -- 172.21.15.26:0/3383143894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2600f51a0 msgr2=0x7fc2601072a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:53:39.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.896+0000 7fc264b05700 1 --2- 172.21.15.26:0/3383143894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2600f51a0 0x7fc2601072a0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 rx=0x7fc254013a70 tx=0x7fc254009b30).stop 2021-11-03T17:53:39.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.896+0000 7fc264b05700 1 -- 172.21.15.26:0/3383143894 shutdown_connections 2021-11-03T17:53:39.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.896+0000 7fc264b05700 1 --2- 172.21.15.26:0/3383143894 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc248064100 0x7fc2480665c0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:39.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.896+0000 7fc264b05700 1 --2- 172.21.15.26:0/3383143894 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2600f4800 0x7fc260106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:39.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.896+0000 7fc264b05700 1 --2- 172.21.15.26:0/3383143894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2600f51a0 0x7fc2601072a0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:39.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.896+0000 7fc264b05700 1 -- 172.21.15.26:0/3383143894 >> 172.21.15.26:0/3383143894 conn(0x7fc2600f0320 msgr2=0x7fc2600fb370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:53:39.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.896+0000 7fc264b05700 1 -- 172.21.15.26:0/3383143894 shutdown_connections 2021-11-03T17:53:39.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.897+0000 7fc264b05700 1 -- 172.21.15.26:0/3383143894 wait complete. 2021-11-03T17:53:39.994 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.997+0000 7f233fb6a700 1 -- 172.21.15.26:0/1528175476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23380f6860 msgr2=0x7f23380f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:53:39.994 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.997+0000 7f233fb6a700 1 --2- 172.21.15.26:0/1528175476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23380f6860 0x7f23380f6cc0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 rx=0x7f2334004660 tx=0x7f2334009b30).stop 2021-11-03T17:53:39.994 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.997+0000 7f233fb6a700 1 -- 172.21.15.26:0/1528175476 shutdown_connections 2021-11-03T17:53:39.994 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.997+0000 7f233fb6a700 1 --2- 172.21.15.26:0/1528175476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23380f6860 0x7f23380f6cc0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:39.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.997+0000 7f233fb6a700 1 --2- 172.21.15.26:0/1528175476 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23380f55c0 0x7f23380f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:39.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.997+0000 7f233fb6a700 1 -- 172.21.15.26:0/1528175476 >> 172.21.15.26:0/1528175476 conn(0x7f23380f0d40 msgr2=0x7f23380f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:53:39.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.997+0000 7f233fb6a700 1 -- 172.21.15.26:0/1528175476 shutdown_connections 2021-11-03T17:53:39.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.997+0000 7f233fb6a700 1 -- 172.21.15.26:0/1528175476 wait complete. 2021-11-03T17:53:39.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.997+0000 7f233fb6a700 1 Processor -- start 2021-11-03T17:53:39.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.997+0000 7f233fb6a700 1 -- start start 2021-11-03T17:53:39.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.998+0000 7f233fb6a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23380f55c0 0x7f2338109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:53:39.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.998+0000 7f233fb6a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23380f6860 0x7f233810c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:53:39.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.998+0000 7f233fb6a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23380603c0 con 0x7f23380f6860 2021-11-03T17:53:39.997 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.998+0000 7f233fb6a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2338060500 con 0x7f23380f55c0 2021-11-03T17:53:39.997 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.998+0000 7f233d105700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23380f6860 0x7f233810c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:53:39.997 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.998+0000 7f233d105700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23380f6860 0x7f233810c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56976/0 (socket says 172.21.15.26:56976) 2021-11-03T17:53:39.997 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.998+0000 7f233d105700 1 -- 172.21.15.26:0/3488138393 learned_addr learned my addr 172.21.15.26:0/3488138393 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:53:39.998 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.998+0000 7f233d906700 1 --2- 172.21.15.26:0/3488138393 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23380f55c0 0x7f2338109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:53:39.998 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.998+0000 7f233d105700 1 -- 172.21.15.26:0/3488138393 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23380f55c0 msgr2=0x7f2338109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:53:39.998 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.998+0000 7f233d105700 1 --2- 172.21.15.26:0/3488138393 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23380f55c0 0x7f2338109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:39.998 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.998+0000 7f233d105700 1 -- 172.21.15.26:0/3488138393 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2334005040 con 0x7f23380f6860 2021-11-03T17:53:39.998 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.998+0000 7f233d105700 1 --2- 172.21.15.26:0/3488138393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23380f6860 0x7f233810c170 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7f2334009990 tx=0x7f2334009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:53:39.999 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.998+0000 7f232e7fc700 1 -- 172.21.15.26:0/3488138393 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2334018070 con 0x7f23380f6860 2021-11-03T17:53:39.999 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.998+0000 7f232e7fc700 1 -- 172.21.15.26:0/3488138393 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2334007ba0 con 0x7f23380f6860 2021-11-03T17:53:39.999 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.998+0000 7f233fb6a700 1 -- 172.21.15.26:0/3488138393 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f233810c6c0 con 0x7f23380f6860 2021-11-03T17:53:39.999 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.998+0000 7f232e7fc700 1 -- 172.21.15.26:0/3488138393 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f233401c620 con 0x7f23380f6860 2021-11-03T17:53:40.001 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.998+0000 7f233fb6a700 1 -- 172.21.15.26:0/3488138393 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f233810cbf0 con 0x7f23380f6860 2021-11-03T17:53:40.001 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:39.999+0000 7f233fb6a700 1 -- 172.21.15.26:0/3488138393 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2338045ad0 con 0x7f23380f6860 2021-11-03T17:53:40.001 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:40.000+0000 7f232e7fc700 1 -- 172.21.15.26:0/3488138393 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f233401c8e0 con 0x7f23380f6860 2021-11-03T17:53:40.002 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:40.000+0000 7f232e7fc700 1 --2- 172.21.15.26:0/3488138393 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f23240640b0 0x7f2324066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:53:40.002 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:40.000+0000 7f232e7fc700 1 -- 172.21.15.26:0/3488138393 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f23340825e0 con 0x7f23380f6860 2021-11-03T17:53:40.002 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:40.000+0000 7f233d906700 1 --2- 172.21.15.26:0/3488138393 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f23240640b0 0x7f2324066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:53:40.002 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:40.001+0000 7f233d906700 1 --2- 172.21.15.26:0/3488138393 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f23240640b0 0x7f2324066570 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f2338060040 tx=0x7f2328009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:53:40.002 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:40.004+0000 7f232e7fc700 1 -- 172.21.15.26:0/3488138393 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f2334054a00 con 0x7f23380f6860 2021-11-03T17:53:40.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:40.207+0000 7f233fb6a700 1 -- 172.21.15.26:0/3488138393 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2338027a00 con 0x7f23380f6860 2021-11-03T17:53:40.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:40.208+0000 7f232e7fc700 1 -- 172.21.15.26:0/3488138393 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f23340545f0 con 0x7f23380f6860 2021-11-03T17:53:40.204 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:53:40.204 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:53:40.204 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:53:40.204 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:53:40.205 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:53:40.205 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:53:40.206 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:53:40.206 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:53:40.207 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:53:40.207 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:53:40.207 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:53:40.207 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:53:40.208 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:53:40.208 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:53:40.208 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:53:40.209 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:53:40.209 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:53:40.209 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:53:40.210 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:53:40.210 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:53:40.210 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:53:40.211 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:53:40.211 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:53:40.212 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:53:40.212 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:53:40.213 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:53:40.213 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:53:40.213 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:53:40.214 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:53:40.214 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:53:40.215 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:53:40.215 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:53:40.216 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:53:40.216 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:53:40.216 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:53:40.217 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:53:40.217 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:53:40.218 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:53:40.218 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:53:40.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:40.209+0000 7f233fb6a700 1 -- 172.21.15.26:0/3488138393 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f23240640b0 msgr2=0x7f2324066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:53:40.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:40.209+0000 7f233fb6a700 1 --2- 172.21.15.26:0/3488138393 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f23240640b0 0x7f2324066570 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f2338060040 tx=0x7f2328009040).stop 2021-11-03T17:53:40.221 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:40.209+0000 7f233fb6a700 1 -- 172.21.15.26:0/3488138393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23380f6860 msgr2=0x7f233810c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:53:40.221 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:40.209+0000 7f233fb6a700 1 --2- 172.21.15.26:0/3488138393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23380f6860 0x7f233810c170 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7f2334009990 tx=0x7f2334009b30).stop 2021-11-03T17:53:40.222 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:40.210+0000 7f233fb6a700 1 -- 172.21.15.26:0/3488138393 shutdown_connections 2021-11-03T17:53:40.222 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:40.210+0000 7f233fb6a700 1 --2- 172.21.15.26:0/3488138393 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f23240640b0 0x7f2324066570 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:40.223 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:40.210+0000 7f233fb6a700 1 --2- 172.21.15.26:0/3488138393 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23380f55c0 0x7f2338109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:40.223 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:40.210+0000 7f233fb6a700 1 --2- 172.21.15.26:0/3488138393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23380f6860 0x7f233810c170 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:53:40.223 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:40.210+0000 7f233fb6a700 1 -- 172.21.15.26:0/3488138393 >> 172.21.15.26:0/3488138393 conn(0x7f23380f0d40 msgr2=0x7f23380fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:53:40.224 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:40.210+0000 7f233fb6a700 1 -- 172.21.15.26:0/3488138393 shutdown_connections 2021-11-03T17:53:40.224 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:53:40.210+0000 7f233fb6a700 1 -- 172.21.15.26:0/3488138393 wait complete. 2021-11-03T17:53:40.225 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:53:40.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:40 smithi026 ceph-mon[96795]: from='client.35964 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:53:40.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:40 smithi026 ceph-mon[96795]: pgmap v1770: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:40.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:40 smithi026 ceph-mon[96795]: from='client.35968 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:53:40.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:40 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3383143894' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:53:40.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:40 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3488138393' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:53:40.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:40 smithi194 ceph-mon[65619]: from='client.35964 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:53:40.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:40 smithi194 ceph-mon[65619]: pgmap v1770: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:40.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:40 smithi194 ceph-mon[65619]: from='client.35968 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:53:40.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:40 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3383143894' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:53:40.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:40 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3488138393' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:53:41.672 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:53:41.740 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:53:43.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:42 smithi026 ceph-mon[96795]: pgmap v1771: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:43.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:42 smithi026 ceph-mon[96795]: poll took 60082.578 ms: 1 events 2021-11-03T17:53:43.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:53:43.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:53:43.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:53:43.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:53:43.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:53:43.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:53:43.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:42 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:53:43.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:53:43.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:42 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:53:43.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:42 smithi194 ceph-mon[65619]: pgmap v1771: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:43.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:42 smithi194 ceph-mon[65619]: poll took 60082.578 ms: 1 events 2021-11-03T17:53:43.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:53:43.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:53:43.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:53:43.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:53:43.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:53:43.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:53:43.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:42 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:53:43.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:53:43.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:42 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:53:45.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:44 smithi026 ceph-mon[96795]: pgmap v1772: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:45.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:44 smithi194 ceph-mon[65619]: pgmap v1772: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:47.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:46 smithi026 ceph-mon[96795]: pgmap v1773: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:47.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:46 smithi194 ceph-mon[65619]: pgmap v1773: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:49.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:48 smithi026 ceph-mon[96795]: pgmap v1774: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:49.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:53:49.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:53:49.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:48 smithi194 ceph-mon[65619]: pgmap v1774: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:49.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:53:49.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:53:51.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:50 smithi026 ceph-mon[96795]: pgmap v1775: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:51.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:50 smithi194 ceph-mon[65619]: pgmap v1775: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:53.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:52 smithi026 ceph-mon[96795]: pgmap v1776: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:53.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:52 smithi194 ceph-mon[65619]: pgmap v1776: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:55.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:54 smithi026 ceph-mon[96795]: pgmap v1777: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:55.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:54 smithi194 ceph-mon[65619]: pgmap v1777: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:57.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:56 smithi026 ceph-mon[96795]: pgmap v1778: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:57.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:56 smithi194 ceph-mon[65619]: pgmap v1778: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:58.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:57 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:53:58.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:57 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:53:58.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:57 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:53:58.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:57 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:53:59.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:53:58 smithi026 ceph-mon[96795]: pgmap v1779: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:53:59.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:53:58 smithi194 ceph-mon[65619]: pgmap v1779: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:01.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:00 smithi026 ceph-mon[96795]: pgmap v1780: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:01.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:00 smithi194 ceph-mon[65619]: pgmap v1780: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:03.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:02 smithi026 ceph-mon[96795]: pgmap v1781: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:03.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:02 smithi194 ceph-mon[65619]: pgmap v1781: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:05.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:04 smithi026 ceph-mon[96795]: pgmap v1782: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:05.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:04 smithi194 ceph-mon[65619]: pgmap v1782: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:07.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:06 smithi026 ceph-mon[96795]: pgmap v1783: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:07.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:06 smithi194 ceph-mon[65619]: pgmap v1783: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:08.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:07 smithi026 ceph-mon[96795]: pgmap v1784: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:08.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:07 smithi194 ceph-mon[65619]: pgmap v1784: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:10.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.325+0000 7f06d5dc5700 1 -- 172.21.15.26:0/2650932650 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06d00f6ff0 msgr2=0x7f06d00f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:54:10.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.325+0000 7f06d5dc5700 1 --2- 172.21.15.26:0/2650932650 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06d00f6ff0 0x7f06d00f7a20 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7f06c4004660 tx=0x7f06c4009b30).stop 2021-11-03T17:54:10.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.325+0000 7f06d5dc5700 1 -- 172.21.15.26:0/2650932650 shutdown_connections 2021-11-03T17:54:10.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.325+0000 7f06d5dc5700 1 --2- 172.21.15.26:0/2650932650 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06d00f6ff0 0x7f06d00f7a20 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:10.325 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.325+0000 7f06d5dc5700 1 --2- 172.21.15.26:0/2650932650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f06d00f66e0 0x7f06d00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:54:10.325 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.325+0000 7f06d5dc5700 1 -- 172.21.15.26:0/2650932650 >> 172.21.15.26:0/2650932650 conn(0x7f06d00f1f00 msgr2=0x7f06d00f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:54:10.325 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.325+0000 7f06d5dc5700 1 -- 172.21.15.26:0/2650932650 shutdown_connections 2021-11-03T17:54:10.325 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.325+0000 7f06d5dc5700 1 -- 172.21.15.26:0/2650932650 wait complete. 2021-11-03T17:54:10.326 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.326+0000 7f06d5dc5700 1 Processor -- start 2021-11-03T17:54:10.326 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.326+0000 7f06d5dc5700 1 -- start start 2021-11-03T17:54:10.326 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.326+0000 7f06d5dc5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06d00f66e0 0x7f06d0106fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:54:10.326 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.326+0000 7f06d5dc5700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f06d00f6ff0 0x7f06d0107490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:54:10.326 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.326+0000 7f06d5dc5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d0107ad0 con 0x7f06d00f66e0 2021-11-03T17:54:10.327 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.326+0000 7f06d5dc5700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d0108380 con 0x7f06d00f6ff0 2021-11-03T17:54:10.327 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.326+0000 7f06cf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06d00f66e0 0x7f06d0106fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:54:10.327 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.326+0000 7f06cf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06d00f66e0 0x7f06d0106fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56992/0 (socket says 172.21.15.26:56992) 2021-11-03T17:54:10.327 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.326+0000 7f06cf7fe700 1 -- 172.21.15.26:0/2213836810 learned_addr learned my addr 172.21.15.26:0/2213836810 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:54:10.327 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.327+0000 7f06ceffd700 1 --2- 172.21.15.26:0/2213836810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f06d00f6ff0 0x7f06d0107490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:54:10.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.327+0000 7f06cf7fe700 1 -- 172.21.15.26:0/2213836810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f06d00f6ff0 msgr2=0x7f06d0107490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:54:10.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.327+0000 7f06cf7fe700 1 --2- 172.21.15.26:0/2213836810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f06d00f6ff0 0x7f06d0107490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:10.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.327+0000 7f06cf7fe700 1 -- 172.21.15.26:0/2213836810 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c4005040 con 0x7f06d00f66e0 2021-11-03T17:54:10.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.327+0000 7f06ceffd700 1 --2- 172.21.15.26:0/2213836810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f06d00f6ff0 0x7f06d0107490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:54:10.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.327+0000 7f06cf7fe700 1 --2- 172.21.15.26:0/2213836810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06d00f66e0 0x7f06d0106fa0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 rx=0x7f06c000b410 tx=0x7f06c0006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:54:10.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.327+0000 7f06b7fff700 1 -- 172.21.15.26:0/2213836810 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06c00125f0 con 0x7f06d00f66e0 2021-11-03T17:54:10.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.327+0000 7f06d5dc5700 1 -- 172.21.15.26:0/2213836810 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d0108660 con 0x7f06d00f66e0 2021-11-03T17:54:10.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.327+0000 7f06b7fff700 1 -- 172.21.15.26:0/2213836810 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f06c0012c00 con 0x7f06d00f66e0 2021-11-03T17:54:10.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.327+0000 7f06b7fff700 1 -- 172.21.15.26:0/2213836810 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06c0002ae0 con 0x7f06d00f66e0 2021-11-03T17:54:10.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.327+0000 7f06d5dc5700 1 -- 172.21.15.26:0/2213836810 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d0108c20 con 0x7f06d00f66e0 2021-11-03T17:54:10.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.328+0000 7f06d5dc5700 1 -- 172.21.15.26:0/2213836810 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06d00f5b70 con 0x7f06d00f66e0 2021-11-03T17:54:10.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.329+0000 7f06b7fff700 1 -- 172.21.15.26:0/2213836810 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f06c000f030 con 0x7f06d00f66e0 2021-11-03T17:54:10.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.329+0000 7f06b7fff700 1 --2- 172.21.15.26:0/2213836810 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f06b80640b0 0x7f06b8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:54:10.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.329+0000 7f06b7fff700 1 -- 172.21.15.26:0/2213836810 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f06c0080cb0 con 0x7f06d00f66e0 2021-11-03T17:54:10.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.329+0000 7f06ceffd700 1 --2- 172.21.15.26:0/2213836810 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f06b80640b0 0x7f06b8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:54:10.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.330+0000 7f06ceffd700 1 --2- 172.21.15.26:0/2213836810 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f06b80640b0 0x7f06b8066570 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f06c4004e30 tx=0x7f06c4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:54:10.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.333+0000 7f06b7fff700 1 -- 172.21.15.26:0/2213836810 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f06c0053010 con 0x7f06d00f66e0 2021-11-03T17:54:10.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.514+0000 7f06d5dc5700 1 -- 172.21.15.26:0/2213836810 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f06d00fefc0 con 0x7f06b80640b0 2021-11-03T17:54:10.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.515+0000 7f06b7fff700 1 -- 172.21.15.26:0/2213836810 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f06d00fefc0 con 0x7f06b80640b0 2021-11-03T17:54:10.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.517+0000 7f06d5dc5700 1 -- 172.21.15.26:0/2213836810 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f06b80640b0 msgr2=0x7f06b8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:54:10.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.517+0000 7f06d5dc5700 1 --2- 172.21.15.26:0/2213836810 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f06b80640b0 0x7f06b8066570 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f06c4004e30 tx=0x7f06c4009b30).stop 2021-11-03T17:54:10.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.517+0000 7f06d5dc5700 1 -- 172.21.15.26:0/2213836810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06d00f66e0 msgr2=0x7f06d0106fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:54:10.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.517+0000 7f06d5dc5700 1 --2- 172.21.15.26:0/2213836810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06d00f66e0 0x7f06d0106fa0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 rx=0x7f06c000b410 tx=0x7f06c0006ef0).stop 2021-11-03T17:54:10.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.517+0000 7f06d5dc5700 1 -- 172.21.15.26:0/2213836810 shutdown_connections 2021-11-03T17:54:10.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.517+0000 7f06d5dc5700 1 --2- 172.21.15.26:0/2213836810 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f06b80640b0 0x7f06b8066570 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:10.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.517+0000 7f06d5dc5700 1 --2- 172.21.15.26:0/2213836810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06d00f66e0 0x7f06d0106fa0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:10.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.517+0000 7f06d5dc5700 1 --2- 172.21.15.26:0/2213836810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f06d00f6ff0 0x7f06d0107490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:10.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.517+0000 7f06d5dc5700 1 -- 172.21.15.26:0/2213836810 >> 172.21.15.26:0/2213836810 conn(0x7f06d00f1f00 msgr2=0x7f06d00fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:54:10.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.517+0000 7f06d5dc5700 1 -- 172.21.15.26:0/2213836810 shutdown_connections 2021-11-03T17:54:10.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.517+0000 7f06d5dc5700 1 -- 172.21.15.26:0/2213836810 wait complete. 2021-11-03T17:54:10.523 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:54:10.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.618+0000 7fa13e33c700 1 -- 172.21.15.26:0/2911252058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1380f55e0 msgr2=0x7fa1380f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:54:10.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.618+0000 7fa13e33c700 1 --2- 172.21.15.26:0/2911252058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1380f55e0 0x7fa1380f5a00 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7fa128004660 tx=0x7fa128009b30).stop 2021-11-03T17:54:10.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.618+0000 7fa13e33c700 1 -- 172.21.15.26:0/2911252058 shutdown_connections 2021-11-03T17:54:10.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.618+0000 7fa13e33c700 1 --2- 172.21.15.26:0/2911252058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1380f5ef0 0x7fa1380f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:54:10.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.618+0000 7fa13e33c700 1 --2- 172.21.15.26:0/2911252058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1380f55e0 0x7fa1380f5a00 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:10.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.618+0000 7fa13e33c700 1 -- 172.21.15.26:0/2911252058 >> 172.21.15.26:0/2911252058 conn(0x7fa1380f0de0 msgr2=0x7fa1380f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:54:10.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.618+0000 7fa13e33c700 1 -- 172.21.15.26:0/2911252058 shutdown_connections 2021-11-03T17:54:10.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.618+0000 7fa13e33c700 1 -- 172.21.15.26:0/2911252058 wait complete. 2021-11-03T17:54:10.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.619+0000 7fa13e33c700 1 Processor -- start 2021-11-03T17:54:10.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.619+0000 7fa13e33c700 1 -- start start 2021-11-03T17:54:10.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.619+0000 7fa13e33c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1380f55e0 0x7fa138105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:54:10.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.619+0000 7fa13e33c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1380f5ef0 0x7fa138106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:54:10.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.619+0000 7fa13e33c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1381069a0 con 0x7fa1380f55e0 2021-11-03T17:54:10.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.619+0000 7fa13e33c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa138107250 con 0x7fa1380f5ef0 2021-11-03T17:54:10.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.619+0000 7fa137fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1380f55e0 0x7fa138105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:54:10.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.619+0000 7fa137fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1380f55e0 0x7fa138105e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57002/0 (socket says 172.21.15.26:57002) 2021-11-03T17:54:10.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.619+0000 7fa137fff700 1 -- 172.21.15.26:0/4170335359 learned_addr learned my addr 172.21.15.26:0/4170335359 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:54:10.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.619+0000 7fa1377fe700 1 --2- 172.21.15.26:0/4170335359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1380f5ef0 0x7fa138106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:54:10.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.619+0000 7fa137fff700 1 -- 172.21.15.26:0/4170335359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1380f5ef0 msgr2=0x7fa138106360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:54:10.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.619+0000 7fa137fff700 1 --2- 172.21.15.26:0/4170335359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1380f5ef0 0x7fa138106360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:10.622 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.619+0000 7fa137fff700 1 -- 172.21.15.26:0/4170335359 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa128005040 con 0x7fa1380f55e0 2021-11-03T17:54:10.622 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.620+0000 7fa137fff700 1 --2- 172.21.15.26:0/4170335359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1380f55e0 0x7fa138105e70 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7fa128009990 tx=0x7fa128009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:54:10.622 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.620+0000 7fa134ff9700 1 -- 172.21.15.26:0/4170335359 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa12801a070 con 0x7fa1380f55e0 2021-11-03T17:54:10.623 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.620+0000 7fa13e33c700 1 -- 172.21.15.26:0/4170335359 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1381074d0 con 0x7fa1380f55e0 2021-11-03T17:54:10.623 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.620+0000 7fa134ff9700 1 -- 172.21.15.26:0/4170335359 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa128012a80 con 0x7fa1380f55e0 2021-11-03T17:54:10.624 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.620+0000 7fa134ff9700 1 -- 172.21.15.26:0/4170335359 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa12801f9a0 con 0x7fa1380f55e0 2021-11-03T17:54:10.624 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.620+0000 7fa13e33c700 1 -- 172.21.15.26:0/4170335359 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa138107a30 con 0x7fa1380f55e0 2021-11-03T17:54:10.625 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.621+0000 7fa13e33c700 1 -- 172.21.15.26:0/4170335359 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1380f4a70 con 0x7fa1380f55e0 2021-11-03T17:54:10.625 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.621+0000 7fa134ff9700 1 -- 172.21.15.26:0/4170335359 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fa128012bf0 con 0x7fa1380f55e0 2021-11-03T17:54:10.626 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.622+0000 7fa134ff9700 1 --2- 172.21.15.26:0/4170335359 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa1200640b0 0x7fa120066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:54:10.626 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.622+0000 7fa134ff9700 1 -- 172.21.15.26:0/4170335359 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fa128084b40 con 0x7fa1380f55e0 2021-11-03T17:54:10.626 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.622+0000 7fa1377fe700 1 --2- 172.21.15.26:0/4170335359 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa1200640b0 0x7fa120066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:54:10.626 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.622+0000 7fa1377fe700 1 --2- 172.21.15.26:0/4170335359 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa1200640b0 0x7fa120066570 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7fa12c00b790 tx=0x7fa12c008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:54:10.627 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.626+0000 7fa134ff9700 1 -- 172.21.15.26:0/4170335359 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fa128056de0 con 0x7fa1380f55e0 2021-11-03T17:54:10.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:10 smithi194 ceph-mon[65619]: pgmap v1785: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:10.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.798+0000 7fa13e33c700 1 -- 172.21.15.26:0/4170335359 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1380fe010 con 0x7fa1200640b0 2021-11-03T17:54:10.809 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.813+0000 7fa134ff9700 1 -- 172.21.15.26:0/4170335359 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fa1380fe010 con 0x7fa1200640b0 2021-11-03T17:54:10.810 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:54:10.810 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (65m) 4m ago 66m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:54:10.810 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (57m) 4m ago 66m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:54:10.810 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (57m) 3m ago 65m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:54:10.811 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (65m) 4m ago 66m 41.4M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:54:10.811 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (58m) 4m ago 61m 25.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:54:10.811 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (58m) 4m ago 61m 26.0M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:54:10.811 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (61m) 3m ago 61m 26.2M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:54:10.812 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (61m) 3m ago 61m 26.5M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:54:10.812 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (59m) 4m ago 68m 547M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:54:10.812 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (58m) 3m ago 65m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:54:10.812 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (58m) 4m ago 68m 242M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:54:10.813 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (58m) 3m ago 65m 117M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:54:10.813 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (66m) 4m ago 66m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:54:10.813 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (65m) 3m ago 65m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:54:10.813 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (57m) 4m ago 65m 271M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:54:10.813 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (56m) 4m ago 64m 291M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:54:10.814 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (56m) 4m ago 64m 243M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:54:10.814 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (55m) 3m ago 64m 312M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:54:10.814 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (55m) 3m ago 63m 265M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:54:10.814 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (54m) 3m ago 63m 255M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:54:10.815 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (65m) 4m ago 66m 58.9M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:54:10.816 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.814+0000 7fa13e33c700 1 -- 172.21.15.26:0/4170335359 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa1200640b0 msgr2=0x7fa120066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:54:10.816 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.814+0000 7fa13e33c700 1 --2- 172.21.15.26:0/4170335359 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa1200640b0 0x7fa120066570 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7fa12c00b790 tx=0x7fa12c008040).stop 2021-11-03T17:54:10.816 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.814+0000 7fa13e33c700 1 -- 172.21.15.26:0/4170335359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1380f55e0 msgr2=0x7fa138105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:54:10.817 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.815+0000 7fa13e33c700 1 --2- 172.21.15.26:0/4170335359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1380f55e0 0x7fa138105e70 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7fa128009990 tx=0x7fa128009b30).stop 2021-11-03T17:54:10.817 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.815+0000 7fa13e33c700 1 -- 172.21.15.26:0/4170335359 shutdown_connections 2021-11-03T17:54:10.817 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.815+0000 7fa13e33c700 1 --2- 172.21.15.26:0/4170335359 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa1200640b0 0x7fa120066570 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:10.817 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.815+0000 7fa13e33c700 1 --2- 172.21.15.26:0/4170335359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1380f55e0 0x7fa138105e70 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:10.817 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.815+0000 7fa13e33c700 1 --2- 172.21.15.26:0/4170335359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1380f5ef0 0x7fa138106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:10.818 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.815+0000 7fa13e33c700 1 -- 172.21.15.26:0/4170335359 >> 172.21.15.26:0/4170335359 conn(0x7fa1380f0de0 msgr2=0x7fa1380fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:54:10.818 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.815+0000 7fa13e33c700 1 -- 172.21.15.26:0/4170335359 shutdown_connections 2021-11-03T17:54:10.818 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.815+0000 7fa13e33c700 1 -- 172.21.15.26:0/4170335359 wait complete. 2021-11-03T17:54:10.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.914+0000 7f19959d7700 1 -- 172.21.15.26:0/257030123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19900f66e0 msgr2=0x7f19900f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:54:10.913 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.914+0000 7f19959d7700 1 --2- 172.21.15.26:0/257030123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19900f66e0 0x7f19900f6b00 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 rx=0x7f1980004660 tx=0x7f1980009b30).stop 2021-11-03T17:54:10.913 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.914+0000 7f19959d7700 1 -- 172.21.15.26:0/257030123 shutdown_connections 2021-11-03T17:54:10.913 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.914+0000 7f19959d7700 1 --2- 172.21.15.26:0/257030123 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19900f6ff0 0x7f19900f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:10.913 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.914+0000 7f19959d7700 1 --2- 172.21.15.26:0/257030123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19900f66e0 0x7f19900f6b00 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:10.914 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.914+0000 7f19959d7700 1 -- 172.21.15.26:0/257030123 >> 172.21.15.26:0/257030123 conn(0x7f19900f1f00 msgr2=0x7f19900f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:54:10.914 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.914+0000 7f19959d7700 1 -- 172.21.15.26:0/257030123 shutdown_connections 2021-11-03T17:54:10.914 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.914+0000 7f19959d7700 1 -- 172.21.15.26:0/257030123 wait complete. 2021-11-03T17:54:10.914 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.915+0000 7f19959d7700 1 Processor -- start 2021-11-03T17:54:10.915 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.915+0000 7f19959d7700 1 -- start start 2021-11-03T17:54:10.915 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.915+0000 7f19959d7700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19900f66e0 0x7f199006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:54:10.915 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.915+0000 7f19959d7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19900f6ff0 0x7f1990069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:54:10.915 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.915+0000 7f19959d7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199006a380 con 0x7f19900f6ff0 2021-11-03T17:54:10.916 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.915+0000 7f19959d7700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199006a4c0 con 0x7f19900f66e0 2021-11-03T17:54:10.916 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.915+0000 7f198e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19900f6ff0 0x7f1990069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:54:10.916 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.915+0000 7f198e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19900f6ff0 0x7f1990069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57014/0 (socket says 172.21.15.26:57014) 2021-11-03T17:54:10.916 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.915+0000 7f198e7fc700 1 -- 172.21.15.26:0/2464535340 learned_addr learned my addr 172.21.15.26:0/2464535340 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:54:10.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.915+0000 7f198effd700 1 --2- 172.21.15.26:0/2464535340 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19900f66e0 0x7f199006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:54:10.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.915+0000 7f198e7fc700 1 -- 172.21.15.26:0/2464535340 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19900f66e0 msgr2=0x7f199006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:54:10.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.915+0000 7f198e7fc700 1 --2- 172.21.15.26:0/2464535340 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19900f66e0 0x7f199006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:10.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.915+0000 7f198e7fc700 1 -- 172.21.15.26:0/2464535340 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1980005040 con 0x7f19900f6ff0 2021-11-03T17:54:10.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.916+0000 7f198e7fc700 1 --2- 172.21.15.26:0/2464535340 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19900f6ff0 0x7f1990069e20 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7f19840026d0 tx=0x7f1984009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:54:10.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.916+0000 7f19777fe700 1 -- 172.21.15.26:0/2464535340 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19840079c0 con 0x7f19900f6ff0 2021-11-03T17:54:10.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.916+0000 7f19777fe700 1 -- 172.21.15.26:0/2464535340 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f198400f040 con 0x7f19900f6ff0 2021-11-03T17:54:10.919 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.916+0000 7f19777fe700 1 -- 172.21.15.26:0/2464535340 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19840148b0 con 0x7f19900f6ff0 2021-11-03T17:54:10.919 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.916+0000 7f19959d7700 1 -- 172.21.15.26:0/2464535340 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f199006a7a0 con 0x7f19900f6ff0 2021-11-03T17:54:10.919 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.916+0000 7f19959d7700 1 -- 172.21.15.26:0/2464535340 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f199010ef90 con 0x7f19900f6ff0 2021-11-03T17:54:10.920 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.917+0000 7f19959d7700 1 -- 172.21.15.26:0/2464535340 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1990045ad0 con 0x7f19900f6ff0 2021-11-03T17:54:10.921 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.917+0000 7f19777fe700 1 -- 172.21.15.26:0/2464535340 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f1984007b20 con 0x7f19900f6ff0 2021-11-03T17:54:10.921 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.917+0000 7f19777fe700 1 --2- 172.21.15.26:0/2464535340 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f19780640b0 0x7f1978066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:54:10.921 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.918+0000 7f19777fe700 1 -- 172.21.15.26:0/2464535340 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f1984080670 con 0x7f19900f6ff0 2021-11-03T17:54:10.922 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.918+0000 7f198effd700 1 --2- 172.21.15.26:0/2464535340 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f19780640b0 0x7f1978066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:54:10.922 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.918+0000 7f198effd700 1 --2- 172.21.15.26:0/2464535340 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f19780640b0 0x7f1978066570 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f1980004630 tx=0x7f1980009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:54:10.922 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:10.921+0000 7f19777fe700 1 -- 172.21.15.26:0/2464535340 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f19840529d0 con 0x7f19900f6ff0 2021-11-03T17:54:10.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:10 smithi026 ceph-mon[96795]: pgmap v1785: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:11.150 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.154+0000 7f19959d7700 1 -- 172.21.15.26:0/2464535340 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1990027a00 con 0x7f19900f6ff0 2021-11-03T17:54:11.151 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.154+0000 7f19777fe700 1 -- 172.21.15.26:0/2464535340 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f19840525c0 con 0x7f19900f6ff0 2021-11-03T17:54:11.151 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:54:11.151 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:54:11.152 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:54:11.152 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:54:11.152 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:54:11.152 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:54:11.152 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:54:11.153 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:54:11.153 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:54:11.153 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:54:11.153 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:54:11.154 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:54:11.154 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:54:11.154 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:54:11.154 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:54:11.155 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:54:11.155 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:54:11.155 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:54:11.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.156+0000 7f19959d7700 1 -- 172.21.15.26:0/2464535340 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f19780640b0 msgr2=0x7f1978066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:54:11.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.156+0000 7f19959d7700 1 --2- 172.21.15.26:0/2464535340 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f19780640b0 0x7f1978066570 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f1980004630 tx=0x7f1980009b30).stop 2021-11-03T17:54:11.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.156+0000 7f19959d7700 1 -- 172.21.15.26:0/2464535340 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19900f6ff0 msgr2=0x7f1990069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:54:11.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.156+0000 7f19959d7700 1 --2- 172.21.15.26:0/2464535340 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19900f6ff0 0x7f1990069e20 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7f19840026d0 tx=0x7f1984009de0).stop 2021-11-03T17:54:11.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.156+0000 7f19959d7700 1 -- 172.21.15.26:0/2464535340 shutdown_connections 2021-11-03T17:54:11.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.156+0000 7f19959d7700 1 --2- 172.21.15.26:0/2464535340 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f19780640b0 0x7f1978066570 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:11.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.156+0000 7f19959d7700 1 --2- 172.21.15.26:0/2464535340 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19900f66e0 0x7f199006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:11.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.156+0000 7f19959d7700 1 --2- 172.21.15.26:0/2464535340 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19900f6ff0 0x7f1990069e20 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:11.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.156+0000 7f19959d7700 1 -- 172.21.15.26:0/2464535340 >> 172.21.15.26:0/2464535340 conn(0x7f19900f1f00 msgr2=0x7f19900fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:54:11.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.156+0000 7f19959d7700 1 -- 172.21.15.26:0/2464535340 shutdown_connections 2021-11-03T17:54:11.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.156+0000 7f19959d7700 1 -- 172.21.15.26:0/2464535340 wait complete. 2021-11-03T17:54:11.255 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.257+0000 7f12ac59f700 1 -- 172.21.15.26:0/1401600737 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12a40f66e0 msgr2=0x7f12a40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:54:11.255 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.257+0000 7f12ac59f700 1 --2- 172.21.15.26:0/1401600737 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12a40f66e0 0x7f12a40f6b00 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 rx=0x7f129c0099e0 tx=0x7f129c004d10).stop 2021-11-03T17:54:11.255 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.257+0000 7f12ac59f700 1 -- 172.21.15.26:0/1401600737 shutdown_connections 2021-11-03T17:54:11.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.257+0000 7f12ac59f700 1 --2- 172.21.15.26:0/1401600737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12a40f7980 0x7f12a40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:11.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.257+0000 7f12ac59f700 1 --2- 172.21.15.26:0/1401600737 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12a40f66e0 0x7f12a40f6b00 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:11.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.257+0000 7f12ac59f700 1 -- 172.21.15.26:0/1401600737 >> 172.21.15.26:0/1401600737 conn(0x7f12a40f1e40 msgr2=0x7f12a40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:54:11.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.257+0000 7f12ac59f700 1 -- 172.21.15.26:0/1401600737 shutdown_connections 2021-11-03T17:54:11.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.257+0000 7f12ac59f700 1 -- 172.21.15.26:0/1401600737 wait complete. 2021-11-03T17:54:11.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.257+0000 7f12ac59f700 1 Processor -- start 2021-11-03T17:54:11.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.258+0000 7f12ac59f700 1 -- start start 2021-11-03T17:54:11.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.258+0000 7f12ac59f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12a40f66e0 0x7f12a41070d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:54:11.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.258+0000 7f12ac59f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12a40f7980 0x7f12a41075c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:54:11.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.258+0000 7f12ac59f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a4107b70 con 0x7f12a40f7980 2021-11-03T17:54:11.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.258+0000 7f12ac59f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a4107cb0 con 0x7f12a40f66e0 2021-11-03T17:54:11.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.258+0000 7f12a9b3a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12a40f7980 0x7f12a41075c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:54:11.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.258+0000 7f12a9b3a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12a40f7980 0x7f12a41075c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57024/0 (socket says 172.21.15.26:57024) 2021-11-03T17:54:11.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.258+0000 7f12a9b3a700 1 -- 172.21.15.26:0/2745940063 learned_addr learned my addr 172.21.15.26:0/2745940063 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:54:11.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.258+0000 7f12aa33b700 1 --2- 172.21.15.26:0/2745940063 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12a40f66e0 0x7f12a41070d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:54:11.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.258+0000 7f12a9b3a700 1 -- 172.21.15.26:0/2745940063 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12a40f66e0 msgr2=0x7f12a41070d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:54:11.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.258+0000 7f12a9b3a700 1 --2- 172.21.15.26:0/2745940063 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12a40f66e0 0x7f12a41070d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:11.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.258+0000 7f12a9b3a700 1 -- 172.21.15.26:0/2745940063 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f129c009640 con 0x7f12a40f7980 2021-11-03T17:54:11.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.258+0000 7f12a9b3a700 1 --2- 172.21.15.26:0/2745940063 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12a40f7980 0x7f12a41075c0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7f1298002700 tx=0x7f1298009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:54:11.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.258+0000 7f12a2ffd700 1 -- 172.21.15.26:0/2745940063 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1298009320 con 0x7f12a40f7980 2021-11-03T17:54:11.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.259+0000 7f12a2ffd700 1 -- 172.21.15.26:0/2745940063 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f129800f040 con 0x7f12a40f7980 2021-11-03T17:54:11.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.259+0000 7f12a2ffd700 1 -- 172.21.15.26:0/2745940063 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1298014870 con 0x7f12a40f7980 2021-11-03T17:54:11.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.259+0000 7f12ac59f700 1 -- 172.21.15.26:0/2745940063 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12a4108650 con 0x7f12a40f7980 2021-11-03T17:54:11.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.259+0000 7f12ac59f700 1 -- 172.21.15.26:0/2745940063 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a4108b90 con 0x7f12a40f7980 2021-11-03T17:54:11.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.259+0000 7f12ac59f700 1 -- 172.21.15.26:0/2745940063 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12a4045ad0 con 0x7f12a40f7980 2021-11-03T17:54:11.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.261+0000 7f12a2ffd700 1 -- 172.21.15.26:0/2745940063 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f1298009480 con 0x7f12a40f7980 2021-11-03T17:54:11.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.261+0000 7f12a2ffd700 1 --2- 172.21.15.26:0/2745940063 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f128c0640b0 0x7f128c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:54:11.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.261+0000 7f12a2ffd700 1 -- 172.21.15.26:0/2745940063 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f1298080e10 con 0x7f12a40f7980 2021-11-03T17:54:11.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.261+0000 7f12aa33b700 1 --2- 172.21.15.26:0/2745940063 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f128c0640b0 0x7f128c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:54:11.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.261+0000 7f12aa33b700 1 --2- 172.21.15.26:0/2745940063 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f128c0640b0 0x7f128c066570 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f129c00b730 tx=0x7f129c004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:54:11.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.264+0000 7f12a2ffd700 1 -- 172.21.15.26:0/2745940063 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f1298053280 con 0x7f12a40f7980 2021-11-03T17:54:11.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.470+0000 7f12ac59f700 1 -- 172.21.15.26:0/2745940063 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f12a4027a00 con 0x7f12a40f7980 2021-11-03T17:54:11.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.470+0000 7f12a2ffd700 1 -- 172.21.15.26:0/2745940063 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f1298052e70 con 0x7f12a40f7980 2021-11-03T17:54:11.467 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:54:11.468 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:54:11.468 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:54:11.468 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:54:11.468 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:54:11.469 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:54:11.469 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:54:11.469 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:54:11.469 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:54:11.469 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:54:11.470 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:54:11.470 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:54:11.470 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:54:11.470 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:54:11.471 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:54:11.471 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:54:11.471 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:54:11.472 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:54:11.472 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:54:11.472 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:54:11.472 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:54:11.472 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:54:11.473 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:54:11.473 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:54:11.473 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:54:11.474 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:54:11.474 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:54:11.474 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:54:11.474 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:54:11.475 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:54:11.475 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:54:11.475 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:54:11.475 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:54:11.475 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:54:11.476 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:54:11.476 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:54:11.476 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:54:11.476 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:54:11.477 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:54:11.478 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.472+0000 7f12ac59f700 1 -- 172.21.15.26:0/2745940063 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f128c0640b0 msgr2=0x7f128c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:54:11.478 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.472+0000 7f12ac59f700 1 --2- 172.21.15.26:0/2745940063 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f128c0640b0 0x7f128c066570 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f129c00b730 tx=0x7f129c004d10).stop 2021-11-03T17:54:11.478 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.472+0000 7f12ac59f700 1 -- 172.21.15.26:0/2745940063 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12a40f7980 msgr2=0x7f12a41075c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:54:11.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.472+0000 7f12ac59f700 1 --2- 172.21.15.26:0/2745940063 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12a40f7980 0x7f12a41075c0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7f1298002700 tx=0x7f1298009e00).stop 2021-11-03T17:54:11.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.472+0000 7f12ac59f700 1 -- 172.21.15.26:0/2745940063 shutdown_connections 2021-11-03T17:54:11.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.472+0000 7f12ac59f700 1 --2- 172.21.15.26:0/2745940063 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f128c0640b0 0x7f128c066570 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:11.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.472+0000 7f12ac59f700 1 --2- 172.21.15.26:0/2745940063 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12a40f66e0 0x7f12a41070d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:11.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.472+0000 7f12ac59f700 1 --2- 172.21.15.26:0/2745940063 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12a40f7980 0x7f12a41075c0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:11.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.472+0000 7f12ac59f700 1 -- 172.21.15.26:0/2745940063 >> 172.21.15.26:0/2745940063 conn(0x7f12a40f1e40 msgr2=0x7f12a40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:54:11.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.472+0000 7f12ac59f700 1 -- 172.21.15.26:0/2745940063 shutdown_connections 2021-11-03T17:54:11.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:11.472+0000 7f12ac59f700 1 -- 172.21.15.26:0/2745940063 wait complete. 2021-11-03T17:54:11.480 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:54:11.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:11 smithi194 ceph-mon[65619]: from='client.35980 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:54:11.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:11 smithi194 ceph-mon[65619]: from='client.35984 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:54:11.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:11 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2464535340' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:54:11.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:11 smithi026 ceph-mon[96795]: from='client.35980 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:54:11.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:11 smithi026 ceph-mon[96795]: from='client.35984 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:54:11.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:11 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2464535340' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:54:12.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:12 smithi194 ceph-mon[65619]: pgmap v1786: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:12.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:12 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2745940063' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:54:12.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:12 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:54:12.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:12 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:54:12.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:12 smithi026 ceph-mon[96795]: pgmap v1786: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:12.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:12 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2745940063' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:54:12.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:12 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:54:12.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:12 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:54:14.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:14 smithi194 ceph-mon[65619]: pgmap v1787: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:14.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:14 smithi026 ceph-mon[96795]: pgmap v1787: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:16.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:16 smithi194 ceph-mon[65619]: pgmap v1788: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:16.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:16 smithi026 ceph-mon[96795]: pgmap v1788: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:18.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:18 smithi194 ceph-mon[65619]: pgmap v1789: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:18.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:18 smithi026 ceph-mon[96795]: pgmap v1789: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:20.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:20 smithi194 ceph-mon[65619]: pgmap v1790: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:20.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:20 smithi026 ceph-mon[96795]: pgmap v1790: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:22.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:22 smithi194 ceph-mon[65619]: pgmap v1791: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:22.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:22 smithi026 ceph-mon[96795]: pgmap v1791: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:24.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:24 smithi194 ceph-mon[65619]: pgmap v1792: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:24.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:24 smithi026 ceph-mon[96795]: pgmap v1792: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:26.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:26 smithi194 ceph-mon[65619]: pgmap v1793: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:26.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:26 smithi026 ceph-mon[96795]: pgmap v1793: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:27.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:27 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:54:27.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:27 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:54:28.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:28 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:54:28.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:28 smithi194 ceph-mon[65619]: pgmap v1794: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:28.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:28 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:54:28.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:28 smithi026 ceph-mon[96795]: pgmap v1794: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:30.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:30 smithi194 ceph-mon[65619]: pgmap v1795: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:30.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:30 smithi026 ceph-mon[96795]: pgmap v1795: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:32.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:32 smithi194 ceph-mon[65619]: pgmap v1796: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:32.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:32 smithi026 ceph-mon[96795]: pgmap v1796: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:34.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:34 smithi194 ceph-mon[65619]: pgmap v1797: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:34.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:34 smithi026 ceph-mon[96795]: pgmap v1797: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:36.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:36 smithi026 ceph-mon[96795]: pgmap v1798: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:36.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:36 smithi194 ceph-mon[65619]: pgmap v1798: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:38.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:38 smithi026 ceph-mon[96795]: pgmap v1799: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:38.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:38 smithi194 ceph-mon[65619]: pgmap v1799: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:40.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:40 smithi026 ceph-mon[96795]: pgmap v1800: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:40.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:40 smithi194 ceph-mon[65619]: pgmap v1800: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:41.584 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.588+0000 7f5b8edf1700 1 -- 172.21.15.26:0/4222525955 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b880f6540 msgr2=0x7f5b880f69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:54:41.584 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.588+0000 7f5b8edf1700 1 --2- 172.21.15.26:0/4222525955 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b880f6540 0x7f5b880f69c0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 rx=0x7f5b7c004660 tx=0x7f5b7c009b30).stop 2021-11-03T17:54:41.585 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.588+0000 7f5b8edf1700 1 -- 172.21.15.26:0/4222525955 shutdown_connections 2021-11-03T17:54:41.585 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.588+0000 7f5b8edf1700 1 --2- 172.21.15.26:0/4222525955 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b880f6540 0x7f5b880f69c0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:41.585 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.588+0000 7f5b8edf1700 1 --2- 172.21.15.26:0/4222525955 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b880f5c30 0x7f5b880f6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:41.585 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.588+0000 7f5b8edf1700 1 -- 172.21.15.26:0/4222525955 >> 172.21.15.26:0/4222525955 conn(0x7f5b880f0540 msgr2=0x7f5b880f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:54:41.586 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.588+0000 7f5b8edf1700 1 -- 172.21.15.26:0/4222525955 shutdown_connections 2021-11-03T17:54:41.586 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.588+0000 7f5b8edf1700 1 -- 172.21.15.26:0/4222525955 wait complete. 2021-11-03T17:54:41.586 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.589+0000 7f5b8edf1700 1 Processor -- start 2021-11-03T17:54:41.586 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.589+0000 7f5b8edf1700 1 -- start start 2021-11-03T17:54:41.589 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.589+0000 7f5b8edf1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b880f5c30 0x7f5b88109c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:54:41.589 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.589+0000 7f5b8edf1700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b880f6540 0x7f5b8810c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:54:41.589 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.589+0000 7f5b8edf1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b880f5700 con 0x7f5b880f5c30 2021-11-03T17:54:41.589 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.589+0000 7f5b8edf1700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b880f5840 con 0x7f5b880f6540 2021-11-03T17:54:41.590 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.589+0000 7f5b8cb8d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b880f5c30 0x7f5b88109c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:54:41.590 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.589+0000 7f5b8cb8d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b880f5c30 0x7f5b88109c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57040/0 (socket says 172.21.15.26:57040) 2021-11-03T17:54:41.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.589+0000 7f5b8cb8d700 1 -- 172.21.15.26:0/3087758101 learned_addr learned my addr 172.21.15.26:0/3087758101 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:54:41.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.589+0000 7f5b87fff700 1 --2- 172.21.15.26:0/3087758101 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b880f6540 0x7f5b8810c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:54:41.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.590+0000 7f5b8cb8d700 1 -- 172.21.15.26:0/3087758101 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b880f6540 msgr2=0x7f5b8810c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:54:41.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.590+0000 7f5b8cb8d700 1 --2- 172.21.15.26:0/3087758101 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b880f6540 0x7f5b8810c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:41.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.590+0000 7f5b8cb8d700 1 -- 172.21.15.26:0/3087758101 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b7c005040 con 0x7f5b880f5c30 2021-11-03T17:54:41.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.590+0000 7f5b8cb8d700 1 --2- 172.21.15.26:0/3087758101 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b880f5c30 0x7f5b88109c40 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7f5b8000c760 tx=0x7f5b80004d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:54:41.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.590+0000 7f5b857fa700 1 -- 172.21.15.26:0/3087758101 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b80004200 con 0x7f5b880f5c30 2021-11-03T17:54:41.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.590+0000 7f5b8edf1700 1 -- 172.21.15.26:0/3087758101 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b8810c6f0 con 0x7f5b880f5c30 2021-11-03T17:54:41.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.590+0000 7f5b857fa700 1 -- 172.21.15.26:0/3087758101 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5b800109c0 con 0x7f5b880f5c30 2021-11-03T17:54:41.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.590+0000 7f5b857fa700 1 -- 172.21.15.26:0/3087758101 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b80003980 con 0x7f5b880f5c30 2021-11-03T17:54:41.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.590+0000 7f5b8edf1700 1 -- 172.21.15.26:0/3087758101 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b8810cc80 con 0x7f5b880f5c30 2021-11-03T17:54:41.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.591+0000 7f5b8edf1700 1 -- 172.21.15.26:0/3087758101 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b88045ad0 con 0x7f5b880f5c30 2021-11-03T17:54:41.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.592+0000 7f5b857fa700 1 -- 172.21.15.26:0/3087758101 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f5b80018020 con 0x7f5b880f5c30 2021-11-03T17:54:41.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.592+0000 7f5b857fa700 1 --2- 172.21.15.26:0/3087758101 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5b700640b0 0x7f5b70066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:54:41.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.592+0000 7f5b857fa700 1 -- 172.21.15.26:0/3087758101 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f5b80080660 con 0x7f5b880f5c30 2021-11-03T17:54:41.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.592+0000 7f5b87fff700 1 --2- 172.21.15.26:0/3087758101 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5b700640b0 0x7f5b70066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:54:41.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.593+0000 7f5b87fff700 1 --2- 172.21.15.26:0/3087758101 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5b700640b0 0x7f5b70066570 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f5b7c004630 tx=0x7f5b7c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:54:41.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.596+0000 7f5b857fa700 1 -- 172.21.15.26:0/3087758101 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f5b800528d0 con 0x7f5b880f5c30 2021-11-03T17:54:41.770 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.775+0000 7f5b8edf1700 1 -- 172.21.15.26:0/3087758101 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b880fdef0 con 0x7f5b700640b0 2021-11-03T17:54:41.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.776+0000 7f5b857fa700 1 -- 172.21.15.26:0/3087758101 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f5b880fdef0 con 0x7f5b700640b0 2021-11-03T17:54:41.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.778+0000 7f5b8edf1700 1 -- 172.21.15.26:0/3087758101 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5b700640b0 msgr2=0x7f5b70066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:54:41.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.778+0000 7f5b8edf1700 1 --2- 172.21.15.26:0/3087758101 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5b700640b0 0x7f5b70066570 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f5b7c004630 tx=0x7f5b7c009b30).stop 2021-11-03T17:54:41.774 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.778+0000 7f5b8edf1700 1 -- 172.21.15.26:0/3087758101 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b880f5c30 msgr2=0x7f5b88109c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:54:41.774 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.778+0000 7f5b8edf1700 1 --2- 172.21.15.26:0/3087758101 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b880f5c30 0x7f5b88109c40 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7f5b8000c760 tx=0x7f5b80004d20).stop 2021-11-03T17:54:41.774 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.778+0000 7f5b8edf1700 1 -- 172.21.15.26:0/3087758101 shutdown_connections 2021-11-03T17:54:41.774 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.778+0000 7f5b8edf1700 1 --2- 172.21.15.26:0/3087758101 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5b700640b0 0x7f5b70066570 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:41.775 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.778+0000 7f5b8edf1700 1 --2- 172.21.15.26:0/3087758101 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b880f5c30 0x7f5b88109c40 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:41.775 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.778+0000 7f5b8edf1700 1 --2- 172.21.15.26:0/3087758101 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b880f6540 0x7f5b8810c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:41.775 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.778+0000 7f5b8edf1700 1 -- 172.21.15.26:0/3087758101 >> 172.21.15.26:0/3087758101 conn(0x7f5b880f0540 msgr2=0x7f5b880fa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:54:41.775 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.778+0000 7f5b8edf1700 1 -- 172.21.15.26:0/3087758101 shutdown_connections 2021-11-03T17:54:41.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.778+0000 7f5b8edf1700 1 -- 172.21.15.26:0/3087758101 wait complete. 2021-11-03T17:54:41.783 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:54:41.880 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.882+0000 7fc063d7a700 1 -- 172.21.15.26:0/2717037762 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc05c0f66e0 msgr2=0x7fc05c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:54:41.880 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.882+0000 7fc063d7a700 1 --2- 172.21.15.26:0/2717037762 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc05c0f66e0 0x7fc05c0f6b00 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7fc0540099e0 tx=0x7fc054004d10).stop 2021-11-03T17:54:41.880 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.882+0000 7fc063d7a700 1 -- 172.21.15.26:0/2717037762 shutdown_connections 2021-11-03T17:54:41.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.882+0000 7fc063d7a700 1 --2- 172.21.15.26:0/2717037762 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc05c0f7980 0x7fc05c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:41.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.882+0000 7fc063d7a700 1 --2- 172.21.15.26:0/2717037762 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc05c0f66e0 0x7fc05c0f6b00 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:41.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.882+0000 7fc063d7a700 1 -- 172.21.15.26:0/2717037762 >> 172.21.15.26:0/2717037762 conn(0x7fc05c0f1e40 msgr2=0x7fc05c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:54:41.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.882+0000 7fc063d7a700 1 -- 172.21.15.26:0/2717037762 shutdown_connections 2021-11-03T17:54:41.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.882+0000 7fc063d7a700 1 -- 172.21.15.26:0/2717037762 wait complete. 2021-11-03T17:54:41.882 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.882+0000 7fc063d7a700 1 Processor -- start 2021-11-03T17:54:41.882 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.882+0000 7fc063d7a700 1 -- start start 2021-11-03T17:54:41.882 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.883+0000 7fc063d7a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc05c0f66e0 0x7fc05c1070d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:54:41.883 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.883+0000 7fc063d7a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc05c0f7980 0x7fc05c1075c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:54:41.883 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.883+0000 7fc063d7a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c107b70 con 0x7fc05c0f7980 2021-11-03T17:54:41.883 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.883+0000 7fc063d7a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c107cb0 con 0x7fc05c0f66e0 2021-11-03T17:54:41.883 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.883+0000 7fc061315700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc05c0f7980 0x7fc05c1075c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:54:41.884 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.883+0000 7fc061315700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc05c0f7980 0x7fc05c1075c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57052/0 (socket says 172.21.15.26:57052) 2021-11-03T17:54:41.884 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.883+0000 7fc061315700 1 -- 172.21.15.26:0/3183423014 learned_addr learned my addr 172.21.15.26:0/3183423014 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:54:41.884 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.883+0000 7fc061b16700 1 --2- 172.21.15.26:0/3183423014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc05c0f66e0 0x7fc05c1070d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:54:41.884 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.883+0000 7fc061315700 1 -- 172.21.15.26:0/3183423014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc05c0f66e0 msgr2=0x7fc05c1070d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:54:41.884 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.883+0000 7fc061315700 1 --2- 172.21.15.26:0/3183423014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc05c0f66e0 0x7fc05c1070d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:41.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.883+0000 7fc061315700 1 -- 172.21.15.26:0/3183423014 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc054009640 con 0x7fc05c0f7980 2021-11-03T17:54:41.886 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.883+0000 7fc061315700 1 --2- 172.21.15.26:0/3183423014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc05c0f7980 0x7fc05c1075c0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 rx=0x7fc0500026d0 tx=0x7fc050009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:54:41.886 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.883+0000 7fc05a7fc700 1 -- 172.21.15.26:0/3183423014 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0500079c0 con 0x7fc05c0f7980 2021-11-03T17:54:41.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.883+0000 7fc05a7fc700 1 -- 172.21.15.26:0/3183423014 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc05000f040 con 0x7fc05c0f7980 2021-11-03T17:54:41.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.883+0000 7fc063d7a700 1 -- 172.21.15.26:0/3183423014 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc05c108650 con 0x7fc05c0f7980 2021-11-03T17:54:41.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.884+0000 7fc05a7fc700 1 -- 172.21.15.26:0/3183423014 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0500148b0 con 0x7fc05c0f7980 2021-11-03T17:54:41.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.884+0000 7fc063d7a700 1 -- 172.21.15.26:0/3183423014 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc05c108b90 con 0x7fc05c0f7980 2021-11-03T17:54:41.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.885+0000 7fc063d7a700 1 -- 172.21.15.26:0/3183423014 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc05c045ad0 con 0x7fc05c0f7980 2021-11-03T17:54:41.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.885+0000 7fc05a7fc700 1 -- 172.21.15.26:0/3183423014 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc050007b20 con 0x7fc05c0f7980 2021-11-03T17:54:41.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.885+0000 7fc05a7fc700 1 --2- 172.21.15.26:0/3183423014 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc0440640b0 0x7fc044066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:54:41.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.885+0000 7fc05a7fc700 1 -- 172.21.15.26:0/3183423014 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc050080730 con 0x7fc05c0f7980 2021-11-03T17:54:41.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.886+0000 7fc061b16700 1 --2- 172.21.15.26:0/3183423014 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc0440640b0 0x7fc044066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:54:41.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.886+0000 7fc061b16700 1 --2- 172.21.15.26:0/3183423014 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc0440640b0 0x7fc044066570 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7fc05400b730 tx=0x7fc054004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:54:41.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:41.893+0000 7fc05a7fc700 1 -- 172.21.15.26:0/3183423014 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc050052a90 con 0x7fc05c0f7980 2021-11-03T17:54:42.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.084+0000 7fc063d7a700 1 -- 172.21.15.26:0/3183423014 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc05c108e10 con 0x7fc0440640b0 2021-11-03T17:54:42.095 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.099+0000 7fc05a7fc700 1 -- 172.21.15.26:0/3183423014 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fc05c108e10 con 0x7fc0440640b0 2021-11-03T17:54:42.095 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:54:42.096 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (65m) 5m ago 67m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:54:42.096 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (58m) 5m ago 67m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:54:42.096 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (57m) 4m ago 66m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:54:42.096 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (65m) 5m ago 66m 41.4M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:54:42.096 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (58m) 5m ago 62m 25.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:54:42.097 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (59m) 5m ago 62m 26.0M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:54:42.097 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (62m) 4m ago 62m 26.2M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:54:42.097 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (62m) 4m ago 62m 26.5M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:54:42.097 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (59m) 5m ago 68m 547M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:54:42.098 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (59m) 4m ago 66m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:54:42.098 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (59m) 5m ago 68m 242M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:54:42.098 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (58m) 4m ago 66m 117M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:54:42.098 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (66m) 5m ago 66m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:54:42.099 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (66m) 4m ago 66m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:54:42.099 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (57m) 5m ago 65m 271M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:54:42.099 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (57m) 5m ago 65m 291M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:54:42.099 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (56m) 5m ago 64m 243M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:54:42.099 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (56m) 4m ago 64m 312M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:54:42.100 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (55m) 4m ago 64m 265M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:54:42.100 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (55m) 4m ago 63m 255M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:54:42.100 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (65m) 5m ago 66m 58.9M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:54:42.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.101+0000 7fc063d7a700 1 -- 172.21.15.26:0/3183423014 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc0440640b0 msgr2=0x7fc044066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:54:42.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.101+0000 7fc063d7a700 1 --2- 172.21.15.26:0/3183423014 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc0440640b0 0x7fc044066570 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7fc05400b730 tx=0x7fc054004d10).stop 2021-11-03T17:54:42.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.101+0000 7fc063d7a700 1 -- 172.21.15.26:0/3183423014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc05c0f7980 msgr2=0x7fc05c1075c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:54:42.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.101+0000 7fc063d7a700 1 --2- 172.21.15.26:0/3183423014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc05c0f7980 0x7fc05c1075c0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 rx=0x7fc0500026d0 tx=0x7fc050009de0).stop 2021-11-03T17:54:42.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.101+0000 7fc063d7a700 1 -- 172.21.15.26:0/3183423014 shutdown_connections 2021-11-03T17:54:42.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.101+0000 7fc063d7a700 1 --2- 172.21.15.26:0/3183423014 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc0440640b0 0x7fc044066570 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:42.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.101+0000 7fc063d7a700 1 --2- 172.21.15.26:0/3183423014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc05c0f66e0 0x7fc05c1070d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:42.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.101+0000 7fc063d7a700 1 --2- 172.21.15.26:0/3183423014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc05c0f7980 0x7fc05c1075c0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:42.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.101+0000 7fc063d7a700 1 -- 172.21.15.26:0/3183423014 >> 172.21.15.26:0/3183423014 conn(0x7fc05c0f1e40 msgr2=0x7fc05c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:54:42.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.101+0000 7fc063d7a700 1 -- 172.21.15.26:0/3183423014 shutdown_connections 2021-11-03T17:54:42.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.101+0000 7fc063d7a700 1 -- 172.21.15.26:0/3183423014 wait complete. 2021-11-03T17:54:42.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.205+0000 7f1fcf59e700 1 -- 172.21.15.26:0/4121217391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fd00f5430 msgr2=0x7f1fd00f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:54:42.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.205+0000 7f1fcf59e700 1 --2- 172.21.15.26:0/4121217391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fd00f5430 0x7f1fd00f5850 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 rx=0x7f1fc0004660 tx=0x7f1fc0009b30).stop 2021-11-03T17:54:42.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.205+0000 7f1fcf59e700 1 -- 172.21.15.26:0/4121217391 shutdown_connections 2021-11-03T17:54:42.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.205+0000 7f1fcf59e700 1 --2- 172.21.15.26:0/4121217391 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fd00f66d0 0x7f1fd00f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:42.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.205+0000 7f1fcf59e700 1 --2- 172.21.15.26:0/4121217391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fd00f5430 0x7f1fd00f5850 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:42.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.205+0000 7f1fcf59e700 1 -- 172.21.15.26:0/4121217391 >> 172.21.15.26:0/4121217391 conn(0x7f1fd00f0b90 msgr2=0x7f1fd00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:54:42.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.205+0000 7f1fcf59e700 1 -- 172.21.15.26:0/4121217391 shutdown_connections 2021-11-03T17:54:42.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.205+0000 7f1fcf59e700 1 -- 172.21.15.26:0/4121217391 wait complete. 2021-11-03T17:54:42.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.206+0000 7f1fcf59e700 1 Processor -- start 2021-11-03T17:54:42.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.206+0000 7f1fcf59e700 1 -- start start 2021-11-03T17:54:42.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.206+0000 7f1fcf59e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fd00f5430 0x7f1fd00f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:54:42.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.206+0000 7f1fcf59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fd00f66d0 0x7f1fd00f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:54:42.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.206+0000 7f1fcf59e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd00f7f70 con 0x7f1fd00f66d0 2021-11-03T17:54:42.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.206+0000 7f1fcf59e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd00f80b0 con 0x7f1fd00f5430 2021-11-03T17:54:42.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.206+0000 7f1fcdd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fd00f66d0 0x7f1fd00f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:54:42.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.206+0000 7f1fcdd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fd00f66d0 0x7f1fd00f7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57062/0 (socket says 172.21.15.26:57062) 2021-11-03T17:54:42.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.206+0000 7f1fcdd9b700 1 -- 172.21.15.26:0/2160961274 learned_addr learned my addr 172.21.15.26:0/2160961274 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:54:42.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.206+0000 7f1fce59c700 1 --2- 172.21.15.26:0/2160961274 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fd00f5430 0x7f1fd00f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:54:42.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.207+0000 7f1fcdd9b700 1 -- 172.21.15.26:0/2160961274 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fd00f5430 msgr2=0x7f1fd00f9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:54:42.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.207+0000 7f1fcdd9b700 1 --2- 172.21.15.26:0/2160961274 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fd00f5430 0x7f1fd00f9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:42.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.207+0000 7f1fcdd9b700 1 -- 172.21.15.26:0/2160961274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc0005040 con 0x7f1fd00f66d0 2021-11-03T17:54:42.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.207+0000 7f1fce59c700 1 --2- 172.21.15.26:0/2160961274 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fd00f5430 0x7f1fd00f9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-03T17:54:42.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.207+0000 7f1fcdd9b700 1 --2- 172.21.15.26:0/2160961274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fd00f66d0 0x7f1fd00f7a10 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7f1fc400c790 tx=0x7f1fc4007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:54:42.213 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.207+0000 7f1fbeffd700 1 -- 172.21.15.26:0/2160961274 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fc4002590 con 0x7f1fd00f66d0 2021-11-03T17:54:42.213 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.207+0000 7f1fcf59e700 1 -- 172.21.15.26:0/2160961274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fd00f8390 con 0x7f1fd00f66d0 2021-11-03T17:54:42.213 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.207+0000 7f1fcf59e700 1 -- 172.21.15.26:0/2160961274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fd010edd0 con 0x7f1fd00f66d0 2021-11-03T17:54:42.213 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.207+0000 7f1fbeffd700 1 -- 172.21.15.26:0/2160961274 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1fc4002ba0 con 0x7f1fd00f66d0 2021-11-03T17:54:42.214 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.207+0000 7f1fbeffd700 1 -- 172.21.15.26:0/2160961274 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fc4013d90 con 0x7f1fd00f66d0 2021-11-03T17:54:42.214 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.208+0000 7f1fbeffd700 1 -- 172.21.15.26:0/2160961274 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f1fc401a060 con 0x7f1fd00f66d0 2021-11-03T17:54:42.214 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.208+0000 7f1fcf59e700 1 -- 172.21.15.26:0/2160961274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb4004fa0 con 0x7f1fd00f66d0 2021-11-03T17:54:42.214 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.209+0000 7f1fbeffd700 1 --2- 172.21.15.26:0/2160961274 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1fb8064100 0x7f1fb80665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:54:42.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.209+0000 7f1fbeffd700 1 -- 172.21.15.26:0/2160961274 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f1fc40809c0 con 0x7f1fd00f66d0 2021-11-03T17:54:42.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.209+0000 7f1fce59c700 1 --2- 172.21.15.26:0/2160961274 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1fb8064100 0x7f1fb80665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:54:42.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.209+0000 7f1fce59c700 1 --2- 172.21.15.26:0/2160961274 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1fb8064100 0x7f1fb80665c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f1fc0013690 tx=0x7f1fc0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:54:42.216 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.213+0000 7f1fbeffd700 1 -- 172.21.15.26:0/2160961274 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f1fc4052c30 con 0x7f1fd00f66d0 2021-11-03T17:54:42.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.442+0000 7f1fcf59e700 1 -- 172.21.15.26:0/2160961274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1fb4005e80 con 0x7f1fd00f66d0 2021-11-03T17:54:42.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.442+0000 7f1fbeffd700 1 -- 172.21.15.26:0/2160961274 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f1fc40182e0 con 0x7f1fd00f66d0 2021-11-03T17:54:42.439 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:54:42.439 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:54:42.439 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:54:42.440 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:54:42.440 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:54:42.440 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:54:42.441 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:54:42.441 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:54:42.441 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:54:42.442 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:54:42.442 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:54:42.442 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:54:42.442 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:54:42.443 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:54:42.443 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:54:42.443 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:54:42.443 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:54:42.444 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:54:42.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.444+0000 7f1fcf59e700 1 -- 172.21.15.26:0/2160961274 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1fb8064100 msgr2=0x7f1fb80665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:54:42.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.444+0000 7f1fcf59e700 1 --2- 172.21.15.26:0/2160961274 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1fb8064100 0x7f1fb80665c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f1fc0013690 tx=0x7f1fc0009b30).stop 2021-11-03T17:54:42.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.444+0000 7f1fcf59e700 1 -- 172.21.15.26:0/2160961274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fd00f66d0 msgr2=0x7f1fd00f7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:54:42.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.444+0000 7f1fcf59e700 1 --2- 172.21.15.26:0/2160961274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fd00f66d0 0x7f1fd00f7a10 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7f1fc400c790 tx=0x7f1fc4007d70).stop 2021-11-03T17:54:42.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.444+0000 7f1fcf59e700 1 -- 172.21.15.26:0/2160961274 shutdown_connections 2021-11-03T17:54:42.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.444+0000 7f1fcf59e700 1 --2- 172.21.15.26:0/2160961274 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1fb8064100 0x7f1fb80665c0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:42.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.444+0000 7f1fcf59e700 1 --2- 172.21.15.26:0/2160961274 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fd00f5430 0x7f1fd00f9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:42.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.444+0000 7f1fcf59e700 1 --2- 172.21.15.26:0/2160961274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fd00f66d0 0x7f1fd00f7a10 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:42.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.444+0000 7f1fcf59e700 1 -- 172.21.15.26:0/2160961274 >> 172.21.15.26:0/2160961274 conn(0x7f1fd00f0b90 msgr2=0x7f1fd005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:54:42.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.444+0000 7f1fcf59e700 1 -- 172.21.15.26:0/2160961274 shutdown_connections 2021-11-03T17:54:42.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.444+0000 7f1fcf59e700 1 -- 172.21.15.26:0/2160961274 wait complete. 2021-11-03T17:54:42.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.545+0000 7ff847ca2700 1 -- 172.21.15.26:0/1275296987 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8400f6860 msgr2=0x7ff8400f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:54:42.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.545+0000 7ff847ca2700 1 --2- 172.21.15.26:0/1275296987 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8400f6860 0x7ff8400f6cc0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 rx=0x7ff83c004660 tx=0x7ff83c009b30).stop 2021-11-03T17:54:42.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.545+0000 7ff847ca2700 1 -- 172.21.15.26:0/1275296987 shutdown_connections 2021-11-03T17:54:42.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.545+0000 7ff847ca2700 1 --2- 172.21.15.26:0/1275296987 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8400f6860 0x7ff8400f6cc0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:42.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.545+0000 7ff847ca2700 1 --2- 172.21.15.26:0/1275296987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8400f55c0 0x7ff8400f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:42.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.545+0000 7ff847ca2700 1 -- 172.21.15.26:0/1275296987 >> 172.21.15.26:0/1275296987 conn(0x7ff8400f0d40 msgr2=0x7ff8400f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:54:42.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.545+0000 7ff847ca2700 1 -- 172.21.15.26:0/1275296987 shutdown_connections 2021-11-03T17:54:42.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.545+0000 7ff847ca2700 1 -- 172.21.15.26:0/1275296987 wait complete. 2021-11-03T17:54:42.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.545+0000 7ff847ca2700 1 Processor -- start 2021-11-03T17:54:42.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.545+0000 7ff847ca2700 1 -- start start 2021-11-03T17:54:42.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.546+0000 7ff847ca2700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8400f55c0 0x7ff840109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:54:42.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.546+0000 7ff847ca2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8400f6860 0x7ff84010c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:54:42.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.546+0000 7ff847ca2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8400603c0 con 0x7ff8400f6860 2021-11-03T17:54:42.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.546+0000 7ff847ca2700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff840060500 con 0x7ff8400f55c0 2021-11-03T17:54:42.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.546+0000 7ff84523d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8400f6860 0x7ff84010c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:54:42.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.546+0000 7ff84523d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8400f6860 0x7ff84010c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57072/0 (socket says 172.21.15.26:57072) 2021-11-03T17:54:42.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.546+0000 7ff84523d700 1 -- 172.21.15.26:0/2674217285 learned_addr learned my addr 172.21.15.26:0/2674217285 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:54:42.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.546+0000 7ff845a3e700 1 --2- 172.21.15.26:0/2674217285 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8400f55c0 0x7ff840109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:54:42.548 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.546+0000 7ff84523d700 1 -- 172.21.15.26:0/2674217285 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8400f55c0 msgr2=0x7ff840109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:54:42.548 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.546+0000 7ff84523d700 1 --2- 172.21.15.26:0/2674217285 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8400f55c0 0x7ff840109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:42.548 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.546+0000 7ff84523d700 1 -- 172.21.15.26:0/2674217285 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83c005040 con 0x7ff8400f6860 2021-11-03T17:54:42.548 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.546+0000 7ff845a3e700 1 --2- 172.21.15.26:0/2674217285 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8400f55c0 0x7ff840109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:54:42.548 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.546+0000 7ff84523d700 1 --2- 172.21.15.26:0/2674217285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8400f6860 0x7ff84010c170 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7ff83c009990 tx=0x7ff83c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:54:42.549 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.546+0000 7ff8327fc700 1 -- 172.21.15.26:0/2674217285 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff83c018070 con 0x7ff8400f6860 2021-11-03T17:54:42.549 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.546+0000 7ff847ca2700 1 -- 172.21.15.26:0/2674217285 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff84010c6c0 con 0x7ff8400f6860 2021-11-03T17:54:42.549 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.546+0000 7ff8327fc700 1 -- 172.21.15.26:0/2674217285 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff83c007ca0 con 0x7ff8400f6860 2021-11-03T17:54:42.549 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.546+0000 7ff8327fc700 1 -- 172.21.15.26:0/2674217285 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff83c01c620 con 0x7ff8400f6860 2021-11-03T17:54:42.550 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.546+0000 7ff847ca2700 1 -- 172.21.15.26:0/2674217285 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff84010cbf0 con 0x7ff8400f6860 2021-11-03T17:54:42.550 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.547+0000 7ff847ca2700 1 -- 172.21.15.26:0/2674217285 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8400f49b0 con 0x7ff8400f6860 2021-11-03T17:54:42.551 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.548+0000 7ff8327fc700 1 -- 172.21.15.26:0/2674217285 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ff83c01d960 con 0x7ff8400f6860 2021-11-03T17:54:42.551 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.548+0000 7ff8327fc700 1 --2- 172.21.15.26:0/2674217285 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff82c0640b0 0x7ff82c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:54:42.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.548+0000 7ff8327fc700 1 -- 172.21.15.26:0/2674217285 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ff83c082520 con 0x7ff8400f6860 2021-11-03T17:54:42.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.548+0000 7ff845a3e700 1 --2- 172.21.15.26:0/2674217285 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff82c0640b0 0x7ff82c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:54:42.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.549+0000 7ff845a3e700 1 --2- 172.21.15.26:0/2674217285 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff82c0640b0 0x7ff82c066570 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7ff840060040 tx=0x7ff834009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:54:42.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.552+0000 7ff8327fc700 1 -- 172.21.15.26:0/2674217285 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ff83c054940 con 0x7ff8400f6860 2021-11-03T17:54:42.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.754+0000 7ff847ca2700 1 -- 172.21.15.26:0/2674217285 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff840045ad0 con 0x7ff8400f6860 2021-11-03T17:54:42.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.755+0000 7ff8327fc700 1 -- 172.21.15.26:0/2674217285 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7ff83c054530 con 0x7ff8400f6860 2021-11-03T17:54:42.751 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:54:42.751 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:54:42.751 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:54:42.752 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:54:42.752 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:54:42.752 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:54:42.752 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:54:42.753 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:54:42.753 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:54:42.753 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:54:42.753 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:54:42.753 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:54:42.754 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:54:42.754 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:54:42.754 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:54:42.755 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:54:42.755 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:54:42.755 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:54:42.755 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:54:42.756 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:54:42.756 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:54:42.756 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:54:42.756 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:54:42.756 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:54:42.757 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:54:42.757 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:54:42.757 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:54:42.757 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:54:42.758 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:54:42.758 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:54:42.758 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:54:42.759 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:54:42.759 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:54:42.759 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:54:42.759 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:54:42.760 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:54:42.760 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:54:42.760 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:54:42.760 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:54:42.761 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.756+0000 7ff847ca2700 1 -- 172.21.15.26:0/2674217285 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff82c0640b0 msgr2=0x7ff82c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:54:42.762 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.756+0000 7ff847ca2700 1 --2- 172.21.15.26:0/2674217285 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff82c0640b0 0x7ff82c066570 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7ff840060040 tx=0x7ff834009040).stop 2021-11-03T17:54:42.762 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.756+0000 7ff847ca2700 1 -- 172.21.15.26:0/2674217285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8400f6860 msgr2=0x7ff84010c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:54:42.763 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.756+0000 7ff847ca2700 1 --2- 172.21.15.26:0/2674217285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8400f6860 0x7ff84010c170 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7ff83c009990 tx=0x7ff83c009b30).stop 2021-11-03T17:54:42.763 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.756+0000 7ff847ca2700 1 -- 172.21.15.26:0/2674217285 shutdown_connections 2021-11-03T17:54:42.763 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.756+0000 7ff847ca2700 1 --2- 172.21.15.26:0/2674217285 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff82c0640b0 0x7ff82c066570 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:42.763 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.756+0000 7ff847ca2700 1 --2- 172.21.15.26:0/2674217285 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8400f55c0 0x7ff840109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:42.763 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.756+0000 7ff847ca2700 1 --2- 172.21.15.26:0/2674217285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8400f6860 0x7ff84010c170 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:54:42.764 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.756+0000 7ff847ca2700 1 -- 172.21.15.26:0/2674217285 >> 172.21.15.26:0/2674217285 conn(0x7ff8400f0d40 msgr2=0x7ff8400fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:54:42.764 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.756+0000 7ff847ca2700 1 -- 172.21.15.26:0/2674217285 shutdown_connections 2021-11-03T17:54:42.764 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:54:42.756+0000 7ff847ca2700 1 -- 172.21.15.26:0/2674217285 wait complete. 2021-11-03T17:54:42.764 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:54:42.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:42 smithi026 ceph-mon[96795]: pgmap v1801: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:42.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:42 smithi026 ceph-mon[96795]: from='client.35996 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:54:42.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:54:42.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:54:42.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:54:42.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:54:42.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:54:42.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:54:42.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:54:42.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:54:42.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:42 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2160961274' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:54:42.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:42 smithi194 ceph-mon[65619]: pgmap v1801: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:42.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:42 smithi194 ceph-mon[65619]: from='client.35996 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:54:42.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:54:42.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:54:42.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:54:42.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:54:42.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:54:43.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:54:43.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:54:43.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:54:43.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:42 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2160961274' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:54:43.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:43 smithi194 ceph-mon[65619]: poll took 60062.606 ms: 1 events 2021-11-03T17:54:43.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:43 smithi194 ceph-mon[65619]: from='client.36000 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:54:43.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:43 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:54:43.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:43 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:54:43.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:43 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2674217285' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:54:43.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:43 smithi026 ceph-mon[96795]: poll took 60062.606 ms: 1 events 2021-11-03T17:54:43.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:43 smithi026 ceph-mon[96795]: from='client.36000 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:54:43.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:43 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:54:43.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:43 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:54:43.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:43 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2674217285' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:54:44.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:44 smithi026 ceph-mon[96795]: pgmap v1802: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:44.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:44 smithi194 ceph-mon[65619]: pgmap v1802: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:46.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:46 smithi026 ceph-mon[96795]: pgmap v1803: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:46.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:46 smithi194 ceph-mon[65619]: pgmap v1803: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:48.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:48 smithi026 ceph-mon[96795]: pgmap v1804: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:48.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:54:48.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:54:48.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:48 smithi194 ceph-mon[65619]: pgmap v1804: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:48.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:54:48.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:54:50.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:50 smithi026 ceph-mon[96795]: pgmap v1805: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:50.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:50 smithi194 ceph-mon[65619]: pgmap v1805: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:52.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:52 smithi026 ceph-mon[96795]: pgmap v1806: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:52.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:52 smithi194 ceph-mon[65619]: pgmap v1806: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:54.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:54 smithi026 ceph-mon[96795]: pgmap v1807: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:54.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:54 smithi194 ceph-mon[65619]: pgmap v1807: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:56.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:56 smithi026 ceph-mon[96795]: pgmap v1808: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:56.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:56 smithi194 ceph-mon[65619]: pgmap v1808: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:57.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:57 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:54:57.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:57 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:54:58.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:58 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:54:58.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:54:58 smithi026 ceph-mon[96795]: pgmap v1809: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:54:59.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:58 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:54:59.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:54:58 smithi194 ceph-mon[65619]: pgmap v1809: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:00.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:00 smithi026 ceph-mon[96795]: pgmap v1810: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:00.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:00 smithi194 ceph-mon[65619]: pgmap v1810: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:02.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:02 smithi026 ceph-mon[96795]: pgmap v1811: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:02.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:02 smithi194 ceph-mon[65619]: pgmap v1811: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:04.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:04 smithi026 ceph-mon[96795]: pgmap v1812: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:04.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:04 smithi194 ceph-mon[65619]: pgmap v1812: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:06.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:06 smithi026 ceph-mon[96795]: pgmap v1813: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:06.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:06 smithi194 ceph-mon[65619]: pgmap v1813: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:08.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:08 smithi026 ceph-mon[96795]: pgmap v1814: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:08.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:08 smithi194 ceph-mon[65619]: pgmap v1814: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:10.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:10 smithi026 ceph-mon[96795]: pgmap v1815: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:10.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:10 smithi194 ceph-mon[65619]: pgmap v1815: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:12.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:12.871+0000 7fd40d0a3700 1 -- 172.21.15.26:0/2482544664 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd408060250 msgr2=0x7fd4080f9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:55:12.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:12.871+0000 7fd40d0a3700 1 --2- 172.21.15.26:0/2482544664 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd408060250 0x7fd4080f9360 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7fd4000099e0 tx=0x7fd400004d10).stop 2021-11-03T17:55:12.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:12.871+0000 7fd40d0a3700 1 -- 172.21.15.26:0/2482544664 shutdown_connections 2021-11-03T17:55:12.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:12.871+0000 7fd40d0a3700 1 --2- 172.21.15.26:0/2482544664 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4080f9850 0x7fd4080fbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:12.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:12.871+0000 7fd40d0a3700 1 --2- 172.21.15.26:0/2482544664 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd408060250 0x7fd4080f9360 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:12.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:12.871+0000 7fd40d0a3700 1 -- 172.21.15.26:0/2482544664 >> 172.21.15.26:0/2482544664 conn(0x7fd4080f0d40 msgr2=0x7fd4080f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:55:12.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:12.871+0000 7fd40d0a3700 1 -- 172.21.15.26:0/2482544664 shutdown_connections 2021-11-03T17:55:12.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:12.871+0000 7fd40d0a3700 1 -- 172.21.15.26:0/2482544664 wait complete. 2021-11-03T17:55:12.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:12.872+0000 7fd40d0a3700 1 Processor -- start 2021-11-03T17:55:12.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:12.872+0000 7fd40d0a3700 1 -- start start 2021-11-03T17:55:12.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:12.872+0000 7fd40d0a3700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd408060250 0x7fd408107060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:55:12.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:12.872+0000 7fd40d0a3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4080f9850 0x7fd408107550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:55:12.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:12.872+0000 7fd40d0a3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd408107b00 con 0x7fd4080f9850 2021-11-03T17:55:12.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:12.872+0000 7fd40d0a3700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd408107c40 con 0x7fd408060250 2021-11-03T17:55:12.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:12.872+0000 7fd40659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4080f9850 0x7fd408107550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:55:12.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:12.872+0000 7fd40659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4080f9850 0x7fd408107550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57090/0 (socket says 172.21.15.26:57090) 2021-11-03T17:55:12.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:12.872+0000 7fd40659c700 1 -- 172.21.15.26:0/137287552 learned_addr learned my addr 172.21.15.26:0/137287552 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:55:12.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:12.872+0000 7fd406d9d700 1 --2- 172.21.15.26:0/137287552 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd408060250 0x7fd408107060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:55:12.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:12.872+0000 7fd40659c700 1 -- 172.21.15.26:0/137287552 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd408060250 msgr2=0x7fd408107060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:55:12.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:12.872+0000 7fd40659c700 1 --2- 172.21.15.26:0/137287552 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd408060250 0x7fd408107060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:12.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:12.872+0000 7fd40659c700 1 -- 172.21.15.26:0/137287552 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd400009640 con 0x7fd4080f9850 2021-11-03T17:55:12.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:12.873+0000 7fd40659c700 1 --2- 172.21.15.26:0/137287552 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4080f9850 0x7fd408107550 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 rx=0x7fd3f0002700 tx=0x7fd3f0009da0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:55:12.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:12.873+0000 7fd3ff7fe700 1 -- 172.21.15.26:0/137287552 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3f00079c0 con 0x7fd4080f9850 2021-11-03T17:55:12.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:12.873+0000 7fd3ff7fe700 1 -- 172.21.15.26:0/137287552 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd3f000f040 con 0x7fd4080f9850 2021-11-03T17:55:12.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:12.873+0000 7fd40d0a3700 1 -- 172.21.15.26:0/137287552 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4081085e0 con 0x7fd4080f9850 2021-11-03T17:55:12.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:12.873+0000 7fd3ff7fe700 1 -- 172.21.15.26:0/137287552 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3f0014840 con 0x7fd4080f9850 2021-11-03T17:55:12.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:12.873+0000 7fd40d0a3700 1 -- 172.21.15.26:0/137287552 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd408108b20 con 0x7fd4080f9850 2021-11-03T17:55:12.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:12.874+0000 7fd40d0a3700 1 -- 172.21.15.26:0/137287552 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd408045ad0 con 0x7fd4080f9850 2021-11-03T17:55:12.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:12.874+0000 7fd3ff7fe700 1 -- 172.21.15.26:0/137287552 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fd3f001b060 con 0x7fd4080f9850 2021-11-03T17:55:12.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:12.875+0000 7fd3ff7fe700 1 --2- 172.21.15.26:0/137287552 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd3f40640b0 0x7fd3f4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:55:12.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:12.875+0000 7fd3ff7fe700 1 -- 172.21.15.26:0/137287552 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fd3f00806b0 con 0x7fd4080f9850 2021-11-03T17:55:12.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:12.875+0000 7fd406d9d700 1 --2- 172.21.15.26:0/137287552 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd3f40640b0 0x7fd3f4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:55:12.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:12.875+0000 7fd406d9d700 1 --2- 172.21.15.26:0/137287552 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd3f40640b0 0x7fd3f4066570 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fd400003380 tx=0x7fd400004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:55:12.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:12.879+0000 7fd3ff7fe700 1 -- 172.21.15.26:0/137287552 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fd3f0052a10 con 0x7fd4080f9850 2021-11-03T17:55:12.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:12 smithi026 ceph-mon[96795]: pgmap v1816: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:12.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:12 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:55:12.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:12 smithi194 ceph-mon[65619]: pgmap v1816: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:12.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:12 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:55:13.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.060+0000 7fd40d0a3700 1 -- 172.21.15.26:0/137287552 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd408108da0 con 0x7fd3f40640b0 2021-11-03T17:55:13.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.062+0000 7fd3ff7fe700 1 -- 172.21.15.26:0/137287552 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fd408108da0 con 0x7fd3f40640b0 2021-11-03T17:55:13.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.064+0000 7fd40d0a3700 1 -- 172.21.15.26:0/137287552 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd3f40640b0 msgr2=0x7fd3f4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:55:13.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.064+0000 7fd40d0a3700 1 --2- 172.21.15.26:0/137287552 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd3f40640b0 0x7fd3f4066570 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fd400003380 tx=0x7fd400004d10).stop 2021-11-03T17:55:13.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.064+0000 7fd40d0a3700 1 -- 172.21.15.26:0/137287552 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4080f9850 msgr2=0x7fd408107550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:55:13.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.064+0000 7fd40d0a3700 1 --2- 172.21.15.26:0/137287552 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4080f9850 0x7fd408107550 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 rx=0x7fd3f0002700 tx=0x7fd3f0009da0).stop 2021-11-03T17:55:13.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.064+0000 7fd40d0a3700 1 -- 172.21.15.26:0/137287552 shutdown_connections 2021-11-03T17:55:13.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.064+0000 7fd40d0a3700 1 --2- 172.21.15.26:0/137287552 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd3f40640b0 0x7fd3f4066570 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:13.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.064+0000 7fd40d0a3700 1 --2- 172.21.15.26:0/137287552 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd408060250 0x7fd408107060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:13.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.064+0000 7fd40d0a3700 1 --2- 172.21.15.26:0/137287552 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4080f9850 0x7fd408107550 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:13.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.064+0000 7fd40d0a3700 1 -- 172.21.15.26:0/137287552 >> 172.21.15.26:0/137287552 conn(0x7fd4080f0d40 msgr2=0x7fd4080f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:55:13.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.064+0000 7fd40d0a3700 1 -- 172.21.15.26:0/137287552 shutdown_connections 2021-11-03T17:55:13.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.064+0000 7fd40d0a3700 1 -- 172.21.15.26:0/137287552 wait complete. 2021-11-03T17:55:13.070 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:55:13.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.164+0000 7f38a1add700 1 -- 172.21.15.26:0/2870411871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f389c0f6860 msgr2=0x7f389c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:55:13.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.164+0000 7f38a1add700 1 --2- 172.21.15.26:0/2870411871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f389c0f6860 0x7f389c0f6cc0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7f3890004660 tx=0x7f3890009b30).stop 2021-11-03T17:55:13.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.164+0000 7f38a1add700 1 -- 172.21.15.26:0/2870411871 shutdown_connections 2021-11-03T17:55:13.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.164+0000 7f38a1add700 1 --2- 172.21.15.26:0/2870411871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f389c0f6860 0x7f389c0f6cc0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:13.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.164+0000 7f38a1add700 1 --2- 172.21.15.26:0/2870411871 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f389c0f55c0 0x7f389c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:13.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.164+0000 7f38a1add700 1 -- 172.21.15.26:0/2870411871 >> 172.21.15.26:0/2870411871 conn(0x7f389c0f0d40 msgr2=0x7f389c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:55:13.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.164+0000 7f38a1add700 1 -- 172.21.15.26:0/2870411871 shutdown_connections 2021-11-03T17:55:13.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.164+0000 7f38a1add700 1 -- 172.21.15.26:0/2870411871 wait complete. 2021-11-03T17:55:13.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.164+0000 7f38a1add700 1 Processor -- start 2021-11-03T17:55:13.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.165+0000 7f38a1add700 1 -- start start 2021-11-03T17:55:13.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.165+0000 7f38a1add700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f389c0f55c0 0x7f389c109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:55:13.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.165+0000 7f38a1add700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f389c0f6860 0x7f389c10c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:55:13.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.165+0000 7f38a1add700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389c0603c0 con 0x7f389c0f55c0 2021-11-03T17:55:13.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.165+0000 7f38a1add700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389c060500 con 0x7f389c0f6860 2021-11-03T17:55:13.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.165+0000 7f389b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f389c0f55c0 0x7f389c109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:55:13.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.165+0000 7f389b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f389c0f55c0 0x7f389c109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57096/0 (socket says 172.21.15.26:57096) 2021-11-03T17:55:13.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.165+0000 7f389b7fe700 1 -- 172.21.15.26:0/3381343090 learned_addr learned my addr 172.21.15.26:0/3381343090 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:55:13.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.165+0000 7f389affd700 1 --2- 172.21.15.26:0/3381343090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f389c0f6860 0x7f389c10c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:55:13.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.165+0000 7f389b7fe700 1 -- 172.21.15.26:0/3381343090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f389c0f6860 msgr2=0x7f389c10c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:55:13.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.165+0000 7f389b7fe700 1 --2- 172.21.15.26:0/3381343090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f389c0f6860 0x7f389c10c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:13.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.165+0000 7f389b7fe700 1 -- 172.21.15.26:0/3381343090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3890005040 con 0x7f389c0f55c0 2021-11-03T17:55:13.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.165+0000 7f389b7fe700 1 --2- 172.21.15.26:0/3381343090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f389c0f55c0 0x7f389c109c70 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7f388c00c530 tx=0x7f388c007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:55:13.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.166+0000 7f3883fff700 1 -- 172.21.15.26:0/3381343090 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f388c00f650 con 0x7f389c0f55c0 2021-11-03T17:55:13.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.166+0000 7f3883fff700 1 -- 172.21.15.26:0/3381343090 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f388c00fc60 con 0x7f389c0f55c0 2021-11-03T17:55:13.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.166+0000 7f38a1add700 1 -- 172.21.15.26:0/3381343090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f389c10c720 con 0x7f389c0f55c0 2021-11-03T17:55:13.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.166+0000 7f3883fff700 1 -- 172.21.15.26:0/3381343090 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f388c012d20 con 0x7f389c0f55c0 2021-11-03T17:55:13.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.166+0000 7f38a1add700 1 -- 172.21.15.26:0/3381343090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f389c10ccb0 con 0x7f389c0f55c0 2021-11-03T17:55:13.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.167+0000 7f38a1add700 1 -- 172.21.15.26:0/3381343090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f389c0f49b0 con 0x7f389c0f55c0 2021-11-03T17:55:13.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.167+0000 7f3883fff700 1 -- 172.21.15.26:0/3381343090 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f388c019030 con 0x7f389c0f55c0 2021-11-03T17:55:13.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.167+0000 7f3883fff700 1 --2- 172.21.15.26:0/3381343090 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f38840640b0 0x7f3884066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:55:13.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.167+0000 7f3883fff700 1 -- 172.21.15.26:0/3381343090 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f388c080630 con 0x7f389c0f55c0 2021-11-03T17:55:13.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.167+0000 7f389affd700 1 --2- 172.21.15.26:0/3381343090 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f38840640b0 0x7f3884066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:55:13.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.168+0000 7f389affd700 1 --2- 172.21.15.26:0/3381343090 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f38840640b0 0x7f3884066570 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f3890004e30 tx=0x7f3890009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:55:13.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.171+0000 7f3883fff700 1 -- 172.21.15.26:0/3381343090 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f388c0529b0 con 0x7f389c0f55c0 2021-11-03T17:55:13.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.346+0000 7f38a1add700 1 -- 172.21.15.26:0/3381343090 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f389c057f10 con 0x7f38840640b0 2021-11-03T17:55:13.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.361+0000 7f3883fff700 1 -- 172.21.15.26:0/3381343090 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f389c057f10 con 0x7f38840640b0 2021-11-03T17:55:13.358 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:55:13.358 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (66m) 5m ago 67m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:55:13.358 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (58m) 5m ago 67m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:55:13.359 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (58m) 4m ago 66m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:55:13.359 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (66m) 5m ago 67m 41.4M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:55:13.359 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (59m) 5m ago 62m 25.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:55:13.360 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (59m) 5m ago 62m 26.0M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:55:13.360 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (62m) 4m ago 62m 26.2M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:55:13.360 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (62m) 4m ago 62m 26.5M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:55:13.360 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (60m) 5m ago 69m 547M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:55:13.360 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (59m) 4m ago 66m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:55:13.361 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (59m) 5m ago 69m 242M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:55:13.361 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (59m) 4m ago 66m 117M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:55:13.361 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (67m) 5m ago 67m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:55:13.361 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (66m) 4m ago 66m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:55:13.362 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (58m) 5m ago 66m 271M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:55:13.362 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (57m) 5m ago 65m 291M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:55:13.362 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (57m) 5m ago 65m 243M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:55:13.362 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (56m) 4m ago 65m 312M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:55:13.363 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (56m) 4m ago 64m 265M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:55:13.363 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (55m) 4m ago 64m 255M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:55:13.363 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (66m) 5m ago 67m 58.9M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:55:13.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.363+0000 7f38a1add700 1 -- 172.21.15.26:0/3381343090 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f38840640b0 msgr2=0x7f3884066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:55:13.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.363+0000 7f38a1add700 1 --2- 172.21.15.26:0/3381343090 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f38840640b0 0x7f3884066570 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f3890004e30 tx=0x7f3890009b30).stop 2021-11-03T17:55:13.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.363+0000 7f38a1add700 1 -- 172.21.15.26:0/3381343090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f389c0f55c0 msgr2=0x7f389c109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:55:13.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.363+0000 7f38a1add700 1 --2- 172.21.15.26:0/3381343090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f389c0f55c0 0x7f389c109c70 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7f388c00c530 tx=0x7f388c007e10).stop 2021-11-03T17:55:13.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.363+0000 7f38a1add700 1 -- 172.21.15.26:0/3381343090 shutdown_connections 2021-11-03T17:55:13.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.363+0000 7f38a1add700 1 --2- 172.21.15.26:0/3381343090 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f38840640b0 0x7f3884066570 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:13.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.363+0000 7f38a1add700 1 --2- 172.21.15.26:0/3381343090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f389c0f55c0 0x7f389c109c70 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:13.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.363+0000 7f38a1add700 1 --2- 172.21.15.26:0/3381343090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f389c0f6860 0x7f389c10c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:13.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.363+0000 7f38a1add700 1 -- 172.21.15.26:0/3381343090 >> 172.21.15.26:0/3381343090 conn(0x7f389c0f0d40 msgr2=0x7f389c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:55:13.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.363+0000 7f38a1add700 1 -- 172.21.15.26:0/3381343090 shutdown_connections 2021-11-03T17:55:13.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.363+0000 7f38a1add700 1 -- 172.21.15.26:0/3381343090 wait complete. 2021-11-03T17:55:13.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.463+0000 7fb20b59e700 1 -- 172.21.15.26:0/2642575956 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb20c0f5440 msgr2=0x7fb20c0f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:55:13.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.463+0000 7fb20b59e700 1 --2- 172.21.15.26:0/2642575956 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb20c0f5440 0x7fb20c0f5860 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7fb2040099e0 tx=0x7fb204004d10).stop 2021-11-03T17:55:13.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.463+0000 7fb20b59e700 1 -- 172.21.15.26:0/2642575956 shutdown_connections 2021-11-03T17:55:13.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.463+0000 7fb20b59e700 1 --2- 172.21.15.26:0/2642575956 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb20c0f66e0 0x7fb20c0f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:13.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.463+0000 7fb20b59e700 1 --2- 172.21.15.26:0/2642575956 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb20c0f5440 0x7fb20c0f5860 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:13.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.463+0000 7fb20b59e700 1 -- 172.21.15.26:0/2642575956 >> 172.21.15.26:0/2642575956 conn(0x7fb20c0f0ba0 msgr2=0x7fb20c0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:55:13.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.463+0000 7fb20b59e700 1 -- 172.21.15.26:0/2642575956 shutdown_connections 2021-11-03T17:55:13.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.463+0000 7fb20b59e700 1 -- 172.21.15.26:0/2642575956 wait complete. 2021-11-03T17:55:13.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.464+0000 7fb20b59e700 1 Processor -- start 2021-11-03T17:55:13.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.464+0000 7fb20b59e700 1 -- start start 2021-11-03T17:55:13.464 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.464+0000 7fb20b59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb20c0f5440 0x7fb20c109ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:55:13.464 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.464+0000 7fb20b59e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb20c0f66e0 0x7fb20c10c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:55:13.464 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.464+0000 7fb20b59e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c0603e0 con 0x7fb20c0f5440 2021-11-03T17:55:13.464 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.464+0000 7fb20b59e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c060520 con 0x7fb20c0f66e0 2021-11-03T17:55:13.464 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.464+0000 7fb20a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb20c0f5440 0x7fb20c109ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:55:13.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.464+0000 7fb20a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb20c0f5440 0x7fb20c109ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57106/0 (socket says 172.21.15.26:57106) 2021-11-03T17:55:13.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.464+0000 7fb20a59c700 1 -- 172.21.15.26:0/2939885135 learned_addr learned my addr 172.21.15.26:0/2939885135 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:55:13.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.464+0000 7fb209d9b700 1 --2- 172.21.15.26:0/2939885135 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb20c0f66e0 0x7fb20c10c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:55:13.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.464+0000 7fb20a59c700 1 -- 172.21.15.26:0/2939885135 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb20c0f66e0 msgr2=0x7fb20c10c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:55:13.466 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.464+0000 7fb20a59c700 1 --2- 172.21.15.26:0/2939885135 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb20c0f66e0 0x7fb20c10c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:13.466 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.464+0000 7fb20a59c700 1 -- 172.21.15.26:0/2939885135 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb204009640 con 0x7fb20c0f5440 2021-11-03T17:55:13.466 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.464+0000 7fb209d9b700 1 --2- 172.21.15.26:0/2939885135 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb20c0f66e0 0x7fb20c10c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:55:13.466 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.465+0000 7fb20a59c700 1 --2- 172.21.15.26:0/2939885135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb20c0f5440 0x7fb20c109ba0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7fb20400baa0 tx=0x7fb204004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:55:13.466 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.465+0000 7fb202ffd700 1 -- 172.21.15.26:0/2939885135 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb20400e070 con 0x7fb20c0f5440 2021-11-03T17:55:13.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.465+0000 7fb202ffd700 1 -- 172.21.15.26:0/2939885135 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb204007df0 con 0x7fb20c0f5440 2021-11-03T17:55:13.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.465+0000 7fb20b59e700 1 -- 172.21.15.26:0/2939885135 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb20c10c5f0 con 0x7fb20c0f5440 2021-11-03T17:55:13.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.465+0000 7fb202ffd700 1 -- 172.21.15.26:0/2939885135 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb204018070 con 0x7fb20c0f5440 2021-11-03T17:55:13.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.465+0000 7fb20b59e700 1 -- 172.21.15.26:0/2939885135 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb20c10cb50 con 0x7fb20c0f5440 2021-11-03T17:55:13.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.466+0000 7fb20b59e700 1 -- 172.21.15.26:0/2939885135 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb20c045ad0 con 0x7fb20c0f5440 2021-11-03T17:55:13.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.466+0000 7fb202ffd700 1 -- 172.21.15.26:0/2939885135 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fb204024060 con 0x7fb20c0f5440 2021-11-03T17:55:13.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.466+0000 7fb202ffd700 1 --2- 172.21.15.26:0/2939885135 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb1f8064100 0x7fb1f80665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:55:13.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.467+0000 7fb202ffd700 1 -- 172.21.15.26:0/2939885135 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fb204081f30 con 0x7fb20c0f5440 2021-11-03T17:55:13.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.467+0000 7fb209d9b700 1 --2- 172.21.15.26:0/2939885135 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb1f8064100 0x7fb1f80665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:55:13.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.467+0000 7fb209d9b700 1 --2- 172.21.15.26:0/2939885135 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb1f8064100 0x7fb1f80665c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7fb1f4007fc0 tx=0x7fb1f400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:55:13.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.471+0000 7fb202ffd700 1 -- 172.21.15.26:0/2939885135 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fb2040aedf0 con 0x7fb20c0f5440 2021-11-03T17:55:13.699 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.702+0000 7fb20b59e700 1 -- 172.21.15.26:0/2939885135 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb20c0fdc00 con 0x7fb20c0f5440 2021-11-03T17:55:13.701 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.703+0000 7fb202ffd700 1 -- 172.21.15.26:0/2939885135 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fb2040222e0 con 0x7fb20c0f5440 2021-11-03T17:55:13.701 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:55:13.701 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:55:13.702 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:55:13.702 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:55:13.702 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:55:13.702 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:55:13.703 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:55:13.703 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:55:13.703 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:55:13.703 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:55:13.704 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:55:13.704 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:55:13.704 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:55:13.704 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:55:13.704 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:55:13.705 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:55:13.705 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:55:13.705 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:55:13.706 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.704+0000 7fb20b59e700 1 -- 172.21.15.26:0/2939885135 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb1f8064100 msgr2=0x7fb1f80665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:55:13.706 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.704+0000 7fb20b59e700 1 --2- 172.21.15.26:0/2939885135 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb1f8064100 0x7fb1f80665c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7fb1f4007fc0 tx=0x7fb1f400b040).stop 2021-11-03T17:55:13.706 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.704+0000 7fb20b59e700 1 -- 172.21.15.26:0/2939885135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb20c0f5440 msgr2=0x7fb20c109ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:55:13.707 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.704+0000 7fb20b59e700 1 --2- 172.21.15.26:0/2939885135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb20c0f5440 0x7fb20c109ba0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7fb20400baa0 tx=0x7fb204004d10).stop 2021-11-03T17:55:13.707 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.704+0000 7fb20b59e700 1 -- 172.21.15.26:0/2939885135 shutdown_connections 2021-11-03T17:55:13.707 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.704+0000 7fb20b59e700 1 --2- 172.21.15.26:0/2939885135 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb1f8064100 0x7fb1f80665c0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:13.707 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.704+0000 7fb20b59e700 1 --2- 172.21.15.26:0/2939885135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb20c0f5440 0x7fb20c109ba0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:13.707 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.704+0000 7fb20b59e700 1 --2- 172.21.15.26:0/2939885135 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb20c0f66e0 0x7fb20c10c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:13.708 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.704+0000 7fb20b59e700 1 -- 172.21.15.26:0/2939885135 >> 172.21.15.26:0/2939885135 conn(0x7fb20c0f0ba0 msgr2=0x7fb20c0fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:55:13.708 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.704+0000 7fb20b59e700 1 -- 172.21.15.26:0/2939885135 shutdown_connections 2021-11-03T17:55:13.708 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.704+0000 7fb20b59e700 1 -- 172.21.15.26:0/2939885135 wait complete. 2021-11-03T17:55:13.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:13 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:55:13.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.804+0000 7f223e08b700 1 -- 172.21.15.26:0/1278052064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22380f5440 msgr2=0x7f22380f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:55:13.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.804+0000 7f223e08b700 1 --2- 172.21.15.26:0/1278052064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22380f5440 0x7f22380f5860 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 rx=0x7f2234004660 tx=0x7f2234009b30).stop 2021-11-03T17:55:13.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.804+0000 7f223e08b700 1 -- 172.21.15.26:0/1278052064 shutdown_connections 2021-11-03T17:55:13.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.804+0000 7f223e08b700 1 --2- 172.21.15.26:0/1278052064 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22380f66e0 0x7f22380f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:13.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.804+0000 7f223e08b700 1 --2- 172.21.15.26:0/1278052064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22380f5440 0x7f22380f5860 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:13.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.804+0000 7f223e08b700 1 -- 172.21.15.26:0/1278052064 >> 172.21.15.26:0/1278052064 conn(0x7f22380f0ba0 msgr2=0x7f22380f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:55:13.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.805+0000 7f223e08b700 1 -- 172.21.15.26:0/1278052064 shutdown_connections 2021-11-03T17:55:13.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.805+0000 7f223e08b700 1 -- 172.21.15.26:0/1278052064 wait complete. 2021-11-03T17:55:13.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.805+0000 7f223e08b700 1 Processor -- start 2021-11-03T17:55:13.805 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.805+0000 7f223e08b700 1 -- start start 2021-11-03T17:55:13.805 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.805+0000 7f223e08b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22380f5440 0x7f22380f95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:55:13.805 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.805+0000 7f223e08b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22380f66e0 0x7f22380f7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:55:13.805 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.805+0000 7f223e08b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22380f7f80 con 0x7f22380f66e0 2021-11-03T17:55:13.806 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.805+0000 7f223e08b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22380f80c0 con 0x7f22380f5440 2021-11-03T17:55:13.806 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.805+0000 7f223c888700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22380f66e0 0x7f22380f7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:55:13.806 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.805+0000 7f223c888700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22380f66e0 0x7f22380f7a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57118/0 (socket says 172.21.15.26:57118) 2021-11-03T17:55:13.806 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.805+0000 7f223c888700 1 -- 172.21.15.26:0/2195313946 learned_addr learned my addr 172.21.15.26:0/2195313946 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:55:13.806 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.806+0000 7f223d089700 1 --2- 172.21.15.26:0/2195313946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22380f5440 0x7f22380f95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:55:13.807 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.806+0000 7f223c888700 1 -- 172.21.15.26:0/2195313946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22380f5440 msgr2=0x7f22380f95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:55:13.807 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.806+0000 7f223c888700 1 --2- 172.21.15.26:0/2195313946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22380f5440 0x7f22380f95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:13.807 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.806+0000 7f223c888700 1 -- 172.21.15.26:0/2195313946 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2234005040 con 0x7f22380f66e0 2021-11-03T17:55:13.807 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.806+0000 7f223c888700 1 --2- 172.21.15.26:0/2195313946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22380f66e0 0x7f22380f7a20 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7f22280026d0 tx=0x7f2228009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:55:13.808 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.806+0000 7f222dffb700 1 -- 172.21.15.26:0/2195313946 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22280079c0 con 0x7f22380f66e0 2021-11-03T17:55:13.808 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.806+0000 7f223e08b700 1 -- 172.21.15.26:0/2195313946 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22380f83a0 con 0x7f22380f66e0 2021-11-03T17:55:13.808 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.806+0000 7f222dffb700 1 -- 172.21.15.26:0/2195313946 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f222800f040 con 0x7f22380f66e0 2021-11-03T17:55:13.808 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.806+0000 7f222dffb700 1 -- 172.21.15.26:0/2195313946 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22280148b0 con 0x7f22380f66e0 2021-11-03T17:55:13.808 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.806+0000 7f223e08b700 1 -- 172.21.15.26:0/2195313946 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f223810edd0 con 0x7f22380f66e0 2021-11-03T17:55:13.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.807+0000 7f223e08b700 1 -- 172.21.15.26:0/2195313946 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2238045ad0 con 0x7f22380f66e0 2021-11-03T17:55:13.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.808+0000 7f222dffb700 1 -- 172.21.15.26:0/2195313946 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f2228007b20 con 0x7f22380f66e0 2021-11-03T17:55:13.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.808+0000 7f222dffb700 1 --2- 172.21.15.26:0/2195313946 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2224064100 0x7f22240665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:55:13.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.808+0000 7f222dffb700 1 -- 172.21.15.26:0/2195313946 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f2228080730 con 0x7f22380f66e0 2021-11-03T17:55:13.811 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.808+0000 7f223d089700 1 --2- 172.21.15.26:0/2195313946 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2224064100 0x7f22240665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:55:13.811 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.808+0000 7f223d089700 1 --2- 172.21.15.26:0/2195313946 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2224064100 0x7f22240665c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f2234013690 tx=0x7f2234009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:55:13.811 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:13.812+0000 7f222dffb700 1 -- 172.21.15.26:0/2195313946 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f2228052a90 con 0x7f22380f66e0 2021-11-03T17:55:13.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:13 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:55:14.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:14.016+0000 7f223e08b700 1 -- 172.21.15.26:0/2195313946 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f22380fdc00 con 0x7f22380f66e0 2021-11-03T17:55:14.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:14.016+0000 7f222dffb700 1 -- 172.21.15.26:0/2195313946 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f2228052680 con 0x7f22380f66e0 2021-11-03T17:55:14.013 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:55:14.013 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:55:14.014 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:55:14.014 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:55:14.014 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:55:14.014 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:55:14.015 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:55:14.015 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:55:14.015 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:55:14.015 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:55:14.015 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:55:14.016 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:55:14.016 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:55:14.016 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:55:14.016 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:55:14.017 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:55:14.017 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:55:14.017 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:55:14.017 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:55:14.017 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:55:14.018 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:55:14.018 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:55:14.018 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:55:14.018 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:55:14.018 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:55:14.019 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:55:14.019 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:55:14.019 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:55:14.019 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:55:14.020 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:55:14.020 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:55:14.020 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:55:14.020 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:55:14.020 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:55:14.021 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:55:14.021 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:55:14.021 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:55:14.021 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:55:14.022 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:55:14.022 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:14.018+0000 7f223e08b700 1 -- 172.21.15.26:0/2195313946 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2224064100 msgr2=0x7f22240665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:55:14.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:14.018+0000 7f223e08b700 1 --2- 172.21.15.26:0/2195313946 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2224064100 0x7f22240665c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f2234013690 tx=0x7f2234009b30).stop 2021-11-03T17:55:14.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:14.018+0000 7f223e08b700 1 -- 172.21.15.26:0/2195313946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22380f66e0 msgr2=0x7f22380f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:55:14.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:14.018+0000 7f223e08b700 1 --2- 172.21.15.26:0/2195313946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22380f66e0 0x7f22380f7a20 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7f22280026d0 tx=0x7f2228009de0).stop 2021-11-03T17:55:14.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:14.018+0000 7f223e08b700 1 -- 172.21.15.26:0/2195313946 shutdown_connections 2021-11-03T17:55:14.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:14.018+0000 7f223e08b700 1 --2- 172.21.15.26:0/2195313946 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2224064100 0x7f22240665c0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:14.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:14.018+0000 7f223e08b700 1 --2- 172.21.15.26:0/2195313946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22380f5440 0x7f22380f95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:14.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:14.018+0000 7f223e08b700 1 --2- 172.21.15.26:0/2195313946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22380f66e0 0x7f22380f7a20 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:14.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:14.018+0000 7f223e08b700 1 -- 172.21.15.26:0/2195313946 >> 172.21.15.26:0/2195313946 conn(0x7f22380f0ba0 msgr2=0x7f223805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:55:14.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:14.018+0000 7f223e08b700 1 -- 172.21.15.26:0/2195313946 shutdown_connections 2021-11-03T17:55:14.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:14.018+0000 7f223e08b700 1 -- 172.21.15.26:0/2195313946 wait complete. 2021-11-03T17:55:14.025 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:55:14.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:14 smithi026 ceph-mon[96795]: from='client.36012 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:55:14.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:14 smithi026 ceph-mon[96795]: pgmap v1817: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:14.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:14 smithi026 ceph-mon[96795]: from='client.36016 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:55:14.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:14 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2939885135' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:55:14.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:14 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2195313946' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:55:14.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:14 smithi194 ceph-mon[65619]: from='client.36012 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:55:14.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:14 smithi194 ceph-mon[65619]: pgmap v1817: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:14.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:14 smithi194 ceph-mon[65619]: from='client.36016 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:55:14.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:14 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2939885135' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:55:14.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:14 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2195313946' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:55:16.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:16 smithi026 ceph-mon[96795]: pgmap v1818: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:16.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:16 smithi194 ceph-mon[65619]: pgmap v1818: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:18.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:18 smithi026 ceph-mon[96795]: pgmap v1819: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:18.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:18 smithi194 ceph-mon[65619]: pgmap v1819: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:20.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:20 smithi026 ceph-mon[96795]: pgmap v1820: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:20.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:20 smithi194 ceph-mon[65619]: pgmap v1820: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:22.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:22 smithi026 ceph-mon[96795]: pgmap v1821: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:22.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:22 smithi194 ceph-mon[65619]: pgmap v1821: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:24.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:24 smithi026 ceph-mon[96795]: pgmap v1822: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:24.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:24 smithi194 ceph-mon[65619]: pgmap v1822: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:26.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:26 smithi026 ceph-mon[96795]: pgmap v1823: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:26.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:26 smithi194 ceph-mon[65619]: pgmap v1823: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:27.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:27 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:55:27.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:27 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:55:28.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:28 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:55:28.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:28 smithi026 ceph-mon[96795]: pgmap v1824: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:28.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:28 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:55:28.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:28 smithi194 ceph-mon[65619]: pgmap v1824: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:30.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:30 smithi026 ceph-mon[96795]: pgmap v1825: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:30.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:30 smithi194 ceph-mon[65619]: pgmap v1825: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:32.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:32 smithi026 ceph-mon[96795]: pgmap v1826: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:32.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:32 smithi194 ceph-mon[65619]: pgmap v1826: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:34.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:34 smithi026 ceph-mon[96795]: pgmap v1827: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:34.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:34 smithi194 ceph-mon[65619]: pgmap v1827: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:36.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:36 smithi026 ceph-mon[96795]: pgmap v1828: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:36.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:36 smithi194 ceph-mon[65619]: pgmap v1828: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:38.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:38 smithi026 ceph-mon[96795]: pgmap v1829: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:38.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:38 smithi194 ceph-mon[65619]: pgmap v1829: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:40.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:40 smithi026 ceph-mon[96795]: pgmap v1830: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:40.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:40 smithi194 ceph-mon[65619]: pgmap v1830: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:42.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:42 smithi026 ceph-mon[96795]: pgmap v1831: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:42.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:55:42.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:42 smithi194 ceph-mon[65619]: pgmap v1831: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:42.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:55:43.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:43 smithi194 ceph-mon[65619]: poll took 60066.242 ms: 1 events 2021-11-03T17:55:43.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:43 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:55:43.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:43 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:55:43.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:43 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:55:43.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:43 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:55:43.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:43 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:55:43.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:43 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:55:43.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:43 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:55:43.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:43 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:55:43.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:43 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:55:43.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:43 smithi026 ceph-mon[96795]: poll took 60066.242 ms: 1 events 2021-11-03T17:55:43.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:43 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:55:43.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:43 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:55:43.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:43 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:55:43.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:43 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:55:43.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:43 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:55:43.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:43 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:55:43.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:43 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:55:43.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:43 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:55:43.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:43 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:55:44.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.133+0000 7f201733b700 1 -- 172.21.15.26:0/2601884115 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20100f55c0 msgr2=0x7f20100f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:55:44.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.133+0000 7f201733b700 1 --2- 172.21.15.26:0/2601884115 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20100f55c0 0x7f20100f59e0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7f20080099e0 tx=0x7f2008004d10).stop 2021-11-03T17:55:44.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.133+0000 7f201733b700 1 -- 172.21.15.26:0/2601884115 shutdown_connections 2021-11-03T17:55:44.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.133+0000 7f201733b700 1 --2- 172.21.15.26:0/2601884115 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20100f6860 0x7f20100f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:55:44.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.133+0000 7f201733b700 1 --2- 172.21.15.26:0/2601884115 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20100f55c0 0x7f20100f59e0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:44.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.133+0000 7f201733b700 1 -- 172.21.15.26:0/2601884115 >> 172.21.15.26:0/2601884115 conn(0x7f20100f0d40 msgr2=0x7f20100f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:55:44.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.133+0000 7f201733b700 1 -- 172.21.15.26:0/2601884115 shutdown_connections 2021-11-03T17:55:44.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.133+0000 7f201733b700 1 -- 172.21.15.26:0/2601884115 wait complete. 2021-11-03T17:55:44.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.134+0000 7f201733b700 1 Processor -- start 2021-11-03T17:55:44.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.134+0000 7f201733b700 1 -- start start 2021-11-03T17:55:44.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.134+0000 7f201733b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20100f55c0 0x7f201010c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:55:44.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.134+0000 7f201733b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20100f6860 0x7f201010e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:55:44.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.134+0000 7f201733b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20100602b0 con 0x7f20100f6860 2021-11-03T17:55:44.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.134+0000 7f201733b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20100603f0 con 0x7f20100f55c0 2021-11-03T17:55:44.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.134+0000 7f20148d6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20100f6860 0x7f201010e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:55:44.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.134+0000 7f20148d6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20100f6860 0x7f201010e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57138/0 (socket says 172.21.15.26:57138) 2021-11-03T17:55:44.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.134+0000 7f20148d6700 1 -- 172.21.15.26:0/3735497625 learned_addr learned my addr 172.21.15.26:0/3735497625 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:55:44.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.134+0000 7f20150d7700 1 --2- 172.21.15.26:0/3735497625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20100f55c0 0x7f201010c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:55:44.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.134+0000 7f20148d6700 1 -- 172.21.15.26:0/3735497625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20100f55c0 msgr2=0x7f201010c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:55:44.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.134+0000 7f20148d6700 1 --2- 172.21.15.26:0/3735497625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20100f55c0 0x7f201010c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:44.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.134+0000 7f20148d6700 1 -- 172.21.15.26:0/3735497625 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2008009640 con 0x7f20100f6860 2021-11-03T17:55:44.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.134+0000 7f20148d6700 1 --2- 172.21.15.26:0/3735497625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20100f6860 0x7f201010e750 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 rx=0x7f200000b410 tx=0x7f2000006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:55:44.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.135+0000 7f2005ffb700 1 -- 172.21.15.26:0/3735497625 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20000125f0 con 0x7f20100f6860 2021-11-03T17:55:44.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.135+0000 7f2005ffb700 1 -- 172.21.15.26:0/3735497625 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f200000be30 con 0x7f20100f6860 2021-11-03T17:55:44.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.135+0000 7f201733b700 1 -- 172.21.15.26:0/3735497625 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f201010ec40 con 0x7f20100f6860 2021-11-03T17:55:44.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.135+0000 7f2005ffb700 1 -- 172.21.15.26:0/3735497625 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2000002a70 con 0x7f20100f6860 2021-11-03T17:55:44.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.135+0000 7f201733b700 1 -- 172.21.15.26:0/3735497625 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f201010f0a0 con 0x7f20100f6860 2021-11-03T17:55:44.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.136+0000 7f201733b700 1 -- 172.21.15.26:0/3735497625 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2010045ad0 con 0x7f20100f6860 2021-11-03T17:55:44.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.136+0000 7f2005ffb700 1 -- 172.21.15.26:0/3735497625 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f200000f030 con 0x7f20100f6860 2021-11-03T17:55:44.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.137+0000 7f2005ffb700 1 --2- 172.21.15.26:0/3735497625 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1ffc0640b0 0x7f1ffc066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:55:44.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.137+0000 7f2005ffb700 1 -- 172.21.15.26:0/3735497625 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f2000080b20 con 0x7f20100f6860 2021-11-03T17:55:44.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.137+0000 7f20150d7700 1 --2- 172.21.15.26:0/3735497625 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1ffc0640b0 0x7f1ffc066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:55:44.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.137+0000 7f20150d7700 1 --2- 172.21.15.26:0/3735497625 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1ffc0640b0 0x7f1ffc066570 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f20080099b0 tx=0x7f2008004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:55:44.139 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.141+0000 7f2005ffb700 1 -- 172.21.15.26:0/3735497625 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f2000052e80 con 0x7f20100f6860 2021-11-03T17:55:44.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.320+0000 7f201733b700 1 -- 172.21.15.26:0/3735497625 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f20100fdf40 con 0x7f1ffc0640b0 2021-11-03T17:55:44.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.322+0000 7f2005ffb700 1 -- 172.21.15.26:0/3735497625 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f20100fdf40 con 0x7f1ffc0640b0 2021-11-03T17:55:44.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.323+0000 7f201733b700 1 -- 172.21.15.26:0/3735497625 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1ffc0640b0 msgr2=0x7f1ffc066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:55:44.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.324+0000 7f201733b700 1 --2- 172.21.15.26:0/3735497625 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1ffc0640b0 0x7f1ffc066570 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f20080099b0 tx=0x7f2008004d10).stop 2021-11-03T17:55:44.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.324+0000 7f201733b700 1 -- 172.21.15.26:0/3735497625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20100f6860 msgr2=0x7f201010e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:55:44.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.324+0000 7f201733b700 1 --2- 172.21.15.26:0/3735497625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20100f6860 0x7f201010e750 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 rx=0x7f200000b410 tx=0x7f2000006ef0).stop 2021-11-03T17:55:44.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.324+0000 7f201733b700 1 -- 172.21.15.26:0/3735497625 shutdown_connections 2021-11-03T17:55:44.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.324+0000 7f201733b700 1 --2- 172.21.15.26:0/3735497625 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1ffc0640b0 0x7f1ffc066570 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:44.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.324+0000 7f201733b700 1 --2- 172.21.15.26:0/3735497625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20100f55c0 0x7f201010c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:44.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.324+0000 7f201733b700 1 --2- 172.21.15.26:0/3735497625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20100f6860 0x7f201010e750 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:44.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.324+0000 7f201733b700 1 -- 172.21.15.26:0/3735497625 >> 172.21.15.26:0/3735497625 conn(0x7f20100f0d40 msgr2=0x7f20100fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:55:44.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.324+0000 7f201733b700 1 -- 172.21.15.26:0/3735497625 shutdown_connections 2021-11-03T17:55:44.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.324+0000 7f201733b700 1 -- 172.21.15.26:0/3735497625 wait complete. 2021-11-03T17:55:44.329 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:55:44.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.424+0000 7f7569dc9700 1 -- 172.21.15.26:0/1663699728 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75640f6ff0 msgr2=0x7f75640f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:55:44.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.424+0000 7f7569dc9700 1 --2- 172.21.15.26:0/1663699728 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75640f6ff0 0x7f75640f7a20 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7f754c004660 tx=0x7f754c009b30).stop 2021-11-03T17:55:44.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.424+0000 7f7569dc9700 1 -- 172.21.15.26:0/1663699728 shutdown_connections 2021-11-03T17:55:44.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.424+0000 7f7569dc9700 1 --2- 172.21.15.26:0/1663699728 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75640f6ff0 0x7f75640f7a20 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:44.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.424+0000 7f7569dc9700 1 --2- 172.21.15.26:0/1663699728 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75640f66e0 0x7f75640f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:44.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.424+0000 7f7569dc9700 1 -- 172.21.15.26:0/1663699728 >> 172.21.15.26:0/1663699728 conn(0x7f75640f1f00 msgr2=0x7f75640f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:55:44.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.424+0000 7f7569dc9700 1 -- 172.21.15.26:0/1663699728 shutdown_connections 2021-11-03T17:55:44.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.424+0000 7f7569dc9700 1 -- 172.21.15.26:0/1663699728 wait complete. 2021-11-03T17:55:44.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.424+0000 7f7569dc9700 1 Processor -- start 2021-11-03T17:55:44.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.424+0000 7f7569dc9700 1 -- start start 2021-11-03T17:55:44.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.425+0000 7f7569dc9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75640f66e0 0x7f7564106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:55:44.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.425+0000 7f7569dc9700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75640f6ff0 0x7f7564107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:55:44.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.425+0000 7f7569dc9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7564107a10 con 0x7f75640f66e0 2021-11-03T17:55:44.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.425+0000 7f7569dc9700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7564107b50 con 0x7f75640f6ff0 2021-11-03T17:55:44.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.425+0000 7f75637fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75640f66e0 0x7f7564106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:55:44.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.425+0000 7f75637fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75640f66e0 0x7f7564106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57146/0 (socket says 172.21.15.26:57146) 2021-11-03T17:55:44.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.425+0000 7f75637fe700 1 -- 172.21.15.26:0/1454167080 learned_addr learned my addr 172.21.15.26:0/1454167080 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:55:44.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.425+0000 7f7562ffd700 1 --2- 172.21.15.26:0/1454167080 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75640f6ff0 0x7f7564107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:55:44.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.425+0000 7f75637fe700 1 -- 172.21.15.26:0/1454167080 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75640f6ff0 msgr2=0x7f7564107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:55:44.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.425+0000 7f75637fe700 1 --2- 172.21.15.26:0/1454167080 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75640f6ff0 0x7f7564107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:44.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.425+0000 7f75637fe700 1 -- 172.21.15.26:0/1454167080 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f754c005040 con 0x7f75640f66e0 2021-11-03T17:55:44.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.425+0000 7f7562ffd700 1 --2- 172.21.15.26:0/1454167080 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75640f6ff0 0x7f7564107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:55:44.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.425+0000 7f75637fe700 1 --2- 172.21.15.26:0/1454167080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75640f66e0 0x7f7564106f70 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7f755c007fd0 tx=0x7f755c004ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:55:44.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.425+0000 7f755bfff700 1 -- 172.21.15.26:0/1454167080 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f755c00b5a0 con 0x7f75640f66e0 2021-11-03T17:55:44.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.425+0000 7f755bfff700 1 -- 172.21.15.26:0/1454167080 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f755c00f040 con 0x7f75640f66e0 2021-11-03T17:55:44.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.425+0000 7f7569dc9700 1 -- 172.21.15.26:0/1454167080 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75641084f0 con 0x7f75640f66e0 2021-11-03T17:55:44.428 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.425+0000 7f755bfff700 1 -- 172.21.15.26:0/1454167080 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f755c013b60 con 0x7f75640f66e0 2021-11-03T17:55:44.428 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.425+0000 7f7569dc9700 1 -- 172.21.15.26:0/1454167080 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7564108ab0 con 0x7f75640f66e0 2021-11-03T17:55:44.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.426+0000 7f7569dc9700 1 -- 172.21.15.26:0/1454167080 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7564045ad0 con 0x7f75640f66e0 2021-11-03T17:55:44.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.427+0000 7f755bfff700 1 -- 172.21.15.26:0/1454167080 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f755c01a030 con 0x7f75640f66e0 2021-11-03T17:55:44.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.427+0000 7f755bfff700 1 --2- 172.21.15.26:0/1454167080 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f75500640b0 0x7f7550066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:55:44.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.427+0000 7f755bfff700 1 -- 172.21.15.26:0/1454167080 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f755c0806f0 con 0x7f75640f66e0 2021-11-03T17:55:44.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.427+0000 7f7562ffd700 1 --2- 172.21.15.26:0/1454167080 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f75500640b0 0x7f7550066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:55:44.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.428+0000 7f7562ffd700 1 --2- 172.21.15.26:0/1454167080 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f75500640b0 0x7f7550066570 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f754c009da0 tx=0x7f754c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:55:44.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.431+0000 7f755bfff700 1 -- 172.21.15.26:0/1454167080 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f755c052a10 con 0x7f75640f66e0 2021-11-03T17:55:44.602 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.606+0000 7f7569dc9700 1 -- 172.21.15.26:0/1454167080 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f75640ff080 con 0x7f75500640b0 2021-11-03T17:55:44.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.621+0000 7f755bfff700 1 -- 172.21.15.26:0/1454167080 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f754c0092e0 con 0x7f75500640b0 2021-11-03T17:55:44.617 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:55:44.618 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (66m) 6m ago 68m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:55:44.618 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (59m) 6m ago 68m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:55:44.618 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (59m) 5m ago 67m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:55:44.618 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (66m) 6m ago 67m 41.4M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:55:44.619 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (59m) 6m ago 63m 25.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:55:44.619 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (60m) 6m ago 63m 26.0M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:55:44.619 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (63m) 5m ago 63m 26.2M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:55:44.619 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (63m) 5m ago 63m 26.5M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:55:44.620 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (60m) 6m ago 69m 547M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:55:44.620 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (60m) 5m ago 67m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:55:44.620 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (60m) 6m ago 69m 242M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:55:44.620 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (59m) 5m ago 67m 117M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:55:44.621 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (67m) 6m ago 67m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:55:44.622 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (67m) 5m ago 67m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:55:44.622 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (58m) 6m ago 66m 271M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:55:44.622 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (58m) 6m ago 66m 291M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:55:44.622 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (57m) 6m ago 65m 243M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:55:44.623 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (57m) 5m ago 65m 312M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:55:44.623 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (56m) 5m ago 65m 265M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:55:44.623 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (56m) 5m ago 64m 255M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:55:44.624 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (66m) 6m ago 67m 58.9M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:55:44.625 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.623+0000 7f7569dc9700 1 -- 172.21.15.26:0/1454167080 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f75500640b0 msgr2=0x7f7550066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:55:44.625 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.623+0000 7f7569dc9700 1 --2- 172.21.15.26:0/1454167080 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f75500640b0 0x7f7550066570 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f754c009da0 tx=0x7f754c009b30).stop 2021-11-03T17:55:44.625 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.623+0000 7f7569dc9700 1 -- 172.21.15.26:0/1454167080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75640f66e0 msgr2=0x7f7564106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:55:44.625 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.623+0000 7f7569dc9700 1 --2- 172.21.15.26:0/1454167080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75640f66e0 0x7f7564106f70 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7f755c007fd0 tx=0x7f755c004ee0).stop 2021-11-03T17:55:44.626 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.623+0000 7f7569dc9700 1 -- 172.21.15.26:0/1454167080 shutdown_connections 2021-11-03T17:55:44.626 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.623+0000 7f7569dc9700 1 --2- 172.21.15.26:0/1454167080 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f75500640b0 0x7f7550066570 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:44.626 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.623+0000 7f7569dc9700 1 --2- 172.21.15.26:0/1454167080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75640f66e0 0x7f7564106f70 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:44.626 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.623+0000 7f7569dc9700 1 --2- 172.21.15.26:0/1454167080 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75640f6ff0 0x7f7564107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:44.627 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.623+0000 7f7569dc9700 1 -- 172.21.15.26:0/1454167080 >> 172.21.15.26:0/1454167080 conn(0x7f75640f1f00 msgr2=0x7f75640fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:55:44.627 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.623+0000 7f7569dc9700 1 -- 172.21.15.26:0/1454167080 shutdown_connections 2021-11-03T17:55:44.627 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.623+0000 7f7569dc9700 1 -- 172.21.15.26:0/1454167080 wait complete. 2021-11-03T17:55:44.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.723+0000 7f37290c9700 1 -- 172.21.15.26:0/4020037496 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37240f6860 msgr2=0x7f37240f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:55:44.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.723+0000 7f37290c9700 1 --2- 172.21.15.26:0/4020037496 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37240f6860 0x7f37240f6cc0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7f370c004660 tx=0x7f370c009b30).stop 2021-11-03T17:55:44.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.723+0000 7f37290c9700 1 -- 172.21.15.26:0/4020037496 shutdown_connections 2021-11-03T17:55:44.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.723+0000 7f37290c9700 1 --2- 172.21.15.26:0/4020037496 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37240f6860 0x7f37240f6cc0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:44.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.723+0000 7f37290c9700 1 --2- 172.21.15.26:0/4020037496 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37240f55c0 0x7f37240f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:44.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.723+0000 7f37290c9700 1 -- 172.21.15.26:0/4020037496 >> 172.21.15.26:0/4020037496 conn(0x7f37240f0d40 msgr2=0x7f37240f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:55:44.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.723+0000 7f37290c9700 1 -- 172.21.15.26:0/4020037496 shutdown_connections 2021-11-03T17:55:44.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.723+0000 7f37290c9700 1 -- 172.21.15.26:0/4020037496 wait complete. 2021-11-03T17:55:44.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.723+0000 7f37290c9700 1 Processor -- start 2021-11-03T17:55:44.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.723+0000 7f37290c9700 1 -- start start 2021-11-03T17:55:44.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.723+0000 7f37290c9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37240f55c0 0x7f372410c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:55:44.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.724+0000 7f37290c9700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37240f6860 0x7f372410e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:55:44.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.724+0000 7f37290c9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37240602b0 con 0x7f37240f55c0 2021-11-03T17:55:44.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.724+0000 7f37290c9700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37240603f0 con 0x7f37240f6860 2021-11-03T17:55:44.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.724+0000 7f3722d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37240f55c0 0x7f372410c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:55:44.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.724+0000 7f3722d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37240f55c0 0x7f372410c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57156/0 (socket says 172.21.15.26:57156) 2021-11-03T17:55:44.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.724+0000 7f3722d9d700 1 -- 172.21.15.26:0/765260147 learned_addr learned my addr 172.21.15.26:0/765260147 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:55:44.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.724+0000 7f3722d9d700 1 -- 172.21.15.26:0/765260147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37240f6860 msgr2=0x7f372410e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:55:44.726 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.724+0000 7f372259c700 1 --2- 172.21.15.26:0/765260147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37240f6860 0x7f372410e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:55:44.726 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.724+0000 7f3722d9d700 1 --2- 172.21.15.26:0/765260147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37240f6860 0x7f372410e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:44.726 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.724+0000 7f3722d9d700 1 -- 172.21.15.26:0/765260147 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f370c005040 con 0x7f37240f55c0 2021-11-03T17:55:44.726 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.724+0000 7f3722d9d700 1 --2- 172.21.15.26:0/765260147 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37240f55c0 0x7f372410c070 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7f371c00c710 tx=0x7f371c004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:55:44.726 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.724+0000 7f371b7fe700 1 -- 172.21.15.26:0/765260147 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f371c0106f0 con 0x7f37240f55c0 2021-11-03T17:55:44.727 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.724+0000 7f371b7fe700 1 -- 172.21.15.26:0/765260147 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f371c010d00 con 0x7f37240f55c0 2021-11-03T17:55:44.727 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.724+0000 7f37290c9700 1 -- 172.21.15.26:0/765260147 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f372410ea60 con 0x7f37240f55c0 2021-11-03T17:55:44.727 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.724+0000 7f371b7fe700 1 -- 172.21.15.26:0/765260147 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f371c012d90 con 0x7f37240f55c0 2021-11-03T17:55:44.727 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.724+0000 7f37290c9700 1 -- 172.21.15.26:0/765260147 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f372410eee0 con 0x7f37240f55c0 2021-11-03T17:55:44.728 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.725+0000 7f37290c9700 1 -- 172.21.15.26:0/765260147 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3724045ad0 con 0x7f37240f55c0 2021-11-03T17:55:44.728 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.726+0000 7f371b7fe700 1 -- 172.21.15.26:0/765260147 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f371c010070 con 0x7f37240f55c0 2021-11-03T17:55:44.728 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.726+0000 7f371b7fe700 1 --2- 172.21.15.26:0/765260147 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f37100640b0 0x7f3710066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:55:44.728 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.726+0000 7f371b7fe700 1 -- 172.21.15.26:0/765260147 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f371c080d50 con 0x7f37240f55c0 2021-11-03T17:55:44.728 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.726+0000 7f372259c700 1 --2- 172.21.15.26:0/765260147 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f37100640b0 0x7f3710066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:55:44.729 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.726+0000 7f372259c700 1 --2- 172.21.15.26:0/765260147 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f37100640b0 0x7f3710066570 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f370c009da0 tx=0x7f370c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:55:44.729 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.730+0000 7f371b7fe700 1 -- 172.21.15.26:0/765260147 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f371c052fc0 con 0x7f37240f55c0 2021-11-03T17:55:44.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:44 smithi026 ceph-mon[96795]: pgmap v1832: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:44.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.958+0000 7f37290c9700 1 -- 172.21.15.26:0/765260147 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f37240586e0 con 0x7f37240f55c0 2021-11-03T17:55:44.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.958+0000 7f371b7fe700 1 -- 172.21.15.26:0/765260147 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f371c052bb0 con 0x7f37240f55c0 2021-11-03T17:55:44.954 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:55:44.955 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:55:44.955 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:55:44.955 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:55:44.955 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:55:44.956 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:55:44.956 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:55:44.956 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:55:44.956 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:55:44.957 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:55:44.957 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:55:44.957 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:55:44.957 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:55:44.958 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:55:44.958 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:55:44.958 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:55:44.958 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:55:44.959 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:55:44.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.960+0000 7f37290c9700 1 -- 172.21.15.26:0/765260147 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f37100640b0 msgr2=0x7f3710066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:55:44.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.960+0000 7f37290c9700 1 --2- 172.21.15.26:0/765260147 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f37100640b0 0x7f3710066570 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f370c009da0 tx=0x7f370c009b30).stop 2021-11-03T17:55:44.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.960+0000 7f37290c9700 1 -- 172.21.15.26:0/765260147 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37240f55c0 msgr2=0x7f372410c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:55:44.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.960+0000 7f37290c9700 1 --2- 172.21.15.26:0/765260147 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37240f55c0 0x7f372410c070 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7f371c00c710 tx=0x7f371c004d10).stop 2021-11-03T17:55:44.961 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.960+0000 7f37290c9700 1 -- 172.21.15.26:0/765260147 shutdown_connections 2021-11-03T17:55:44.961 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.960+0000 7f37290c9700 1 --2- 172.21.15.26:0/765260147 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f37100640b0 0x7f3710066570 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:44.961 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.960+0000 7f37290c9700 1 --2- 172.21.15.26:0/765260147 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37240f55c0 0x7f372410c070 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:44.961 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.960+0000 7f37290c9700 1 --2- 172.21.15.26:0/765260147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37240f6860 0x7f372410e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:44.962 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.960+0000 7f37290c9700 1 -- 172.21.15.26:0/765260147 >> 172.21.15.26:0/765260147 conn(0x7f37240f0d40 msgr2=0x7f37240fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:55:44.962 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.960+0000 7f37290c9700 1 -- 172.21.15.26:0/765260147 shutdown_connections 2021-11-03T17:55:44.962 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:44.960+0000 7f37290c9700 1 -- 172.21.15.26:0/765260147 wait complete. 2021-11-03T17:55:44.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:44 smithi194 ceph-mon[65619]: pgmap v1832: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:45.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.061+0000 7efdd13b7700 1 -- 172.21.15.26:0/3622825283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efdcc0f55c0 msgr2=0x7efdcc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:55:45.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.061+0000 7efdd13b7700 1 --2- 172.21.15.26:0/3622825283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efdcc0f55c0 0x7efdcc0f59e0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7efdb4004660 tx=0x7efdb4009b30).stop 2021-11-03T17:55:45.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.061+0000 7efdd13b7700 1 -- 172.21.15.26:0/3622825283 shutdown_connections 2021-11-03T17:55:45.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.061+0000 7efdd13b7700 1 --2- 172.21.15.26:0/3622825283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efdcc0f5ed0 0x7efdcc0f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:45.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.061+0000 7efdd13b7700 1 --2- 172.21.15.26:0/3622825283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efdcc0f55c0 0x7efdcc0f59e0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:45.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.061+0000 7efdd13b7700 1 -- 172.21.15.26:0/3622825283 >> 172.21.15.26:0/3622825283 conn(0x7efdcc0f0dc0 msgr2=0x7efdcc0f31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:55:45.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.061+0000 7efdd13b7700 1 -- 172.21.15.26:0/3622825283 shutdown_connections 2021-11-03T17:55:45.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.061+0000 7efdd13b7700 1 -- 172.21.15.26:0/3622825283 wait complete. 2021-11-03T17:55:45.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.062+0000 7efdd13b7700 1 Processor -- start 2021-11-03T17:55:45.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.062+0000 7efdd13b7700 1 -- start start 2021-11-03T17:55:45.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.062+0000 7efdd13b7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efdcc0f55c0 0x7efdcc105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:55:45.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.062+0000 7efdd13b7700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efdcc0f5ed0 0x7efdcc106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:55:45.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.062+0000 7efdd13b7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdcc106910 con 0x7efdcc0f55c0 2021-11-03T17:55:45.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.062+0000 7efdd13b7700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdcc106a50 con 0x7efdcc0f5ed0 2021-11-03T17:55:45.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.062+0000 7efdcaffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efdcc0f55c0 0x7efdcc105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:55:45.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.062+0000 7efdcaffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efdcc0f55c0 0x7efdcc105e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57166/0 (socket says 172.21.15.26:57166) 2021-11-03T17:55:45.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.062+0000 7efdcaffd700 1 -- 172.21.15.26:0/4044672927 learned_addr learned my addr 172.21.15.26:0/4044672927 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:55:45.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.062+0000 7efdcaffd700 1 -- 172.21.15.26:0/4044672927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efdcc0f5ed0 msgr2=0x7efdcc106360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:55:45.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.062+0000 7efdcaffd700 1 --2- 172.21.15.26:0/4044672927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efdcc0f5ed0 0x7efdcc106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:55:45.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.062+0000 7efdcaffd700 1 -- 172.21.15.26:0/4044672927 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb4005040 con 0x7efdcc0f55c0 2021-11-03T17:55:45.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.063+0000 7efdcaffd700 1 --2- 172.21.15.26:0/4044672927 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efdcc0f55c0 0x7efdcc105e70 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7efdb4009990 tx=0x7efdb4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:55:45.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.063+0000 7efdc37fe700 1 -- 172.21.15.26:0/4044672927 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdb4018070 con 0x7efdcc0f55c0 2021-11-03T17:55:45.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.063+0000 7efdc37fe700 1 -- 172.21.15.26:0/4044672927 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efdb4007ba0 con 0x7efdcc0f55c0 2021-11-03T17:55:45.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.063+0000 7efdc37fe700 1 -- 172.21.15.26:0/4044672927 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdb401c3c0 con 0x7efdcc0f55c0 2021-11-03T17:55:45.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.063+0000 7efdd13b7700 1 -- 172.21.15.26:0/4044672927 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdcc107390 con 0x7efdcc0f55c0 2021-11-03T17:55:45.065 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.063+0000 7efdd13b7700 1 -- 172.21.15.26:0/4044672927 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdcc1078f0 con 0x7efdcc0f55c0 2021-11-03T17:55:45.066 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.064+0000 7efdd13b7700 1 -- 172.21.15.26:0/4044672927 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdcc045ad0 con 0x7efdcc0f55c0 2021-11-03T17:55:45.066 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.064+0000 7efdc37fe700 1 -- 172.21.15.26:0/4044672927 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7efdb401d420 con 0x7efdcc0f55c0 2021-11-03T17:55:45.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.065+0000 7efdc37fe700 1 --2- 172.21.15.26:0/4044672927 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efdb80640b0 0x7efdb8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:55:45.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.065+0000 7efdc37fe700 1 -- 172.21.15.26:0/4044672927 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7efdb40825d0 con 0x7efdcc0f55c0 2021-11-03T17:55:45.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.065+0000 7efdca7fc700 1 --2- 172.21.15.26:0/4044672927 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efdb80640b0 0x7efdb8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:55:45.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.065+0000 7efdca7fc700 1 --2- 172.21.15.26:0/4044672927 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efdb80640b0 0x7efdb8066570 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7efdbc004a10 tx=0x7efdbc0099e0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:55:45.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.069+0000 7efdc37fe700 1 -- 172.21.15.26:0/4044672927 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7efdb4054990 con 0x7efdcc0f55c0 2021-11-03T17:55:45.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.273+0000 7efdd13b7700 1 -- 172.21.15.26:0/4044672927 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7efdcc107b10 con 0x7efdcc0f55c0 2021-11-03T17:55:45.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.273+0000 7efdc37fe700 1 -- 172.21.15.26:0/4044672927 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7efdb4054580 con 0x7efdcc0f55c0 2021-11-03T17:55:45.270 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:55:45.270 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:55:45.270 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:55:45.270 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:55:45.270 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:55:45.271 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:55:45.271 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:55:45.271 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:55:45.271 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:55:45.272 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:55:45.272 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:55:45.272 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:55:45.272 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:55:45.272 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:55:45.273 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:55:45.273 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:55:45.273 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:55:45.273 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:55:45.274 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:55:45.274 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:55:45.274 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:55:45.275 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:55:45.275 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:55:45.275 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:55:45.275 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:55:45.275 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:55:45.276 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:55:45.276 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:55:45.276 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:55:45.276 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:55:45.277 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:55:45.277 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:55:45.277 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:55:45.277 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:55:45.277 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:55:45.278 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:55:45.278 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:55:45.278 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:55:45.278 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:55:45.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.275+0000 7efdd13b7700 1 -- 172.21.15.26:0/4044672927 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efdb80640b0 msgr2=0x7efdb8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:55:45.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.275+0000 7efdd13b7700 1 --2- 172.21.15.26:0/4044672927 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efdb80640b0 0x7efdb8066570 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7efdbc004a10 tx=0x7efdbc0099e0).stop 2021-11-03T17:55:45.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.275+0000 7efdd13b7700 1 -- 172.21.15.26:0/4044672927 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efdcc0f55c0 msgr2=0x7efdcc105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:55:45.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.275+0000 7efdd13b7700 1 --2- 172.21.15.26:0/4044672927 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efdcc0f55c0 0x7efdcc105e70 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7efdb4009990 tx=0x7efdb4009b30).stop 2021-11-03T17:55:45.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.275+0000 7efdd13b7700 1 -- 172.21.15.26:0/4044672927 shutdown_connections 2021-11-03T17:55:45.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.275+0000 7efdd13b7700 1 --2- 172.21.15.26:0/4044672927 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efdb80640b0 0x7efdb8066570 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:45.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.275+0000 7efdd13b7700 1 --2- 172.21.15.26:0/4044672927 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efdcc0f55c0 0x7efdcc105e70 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:55:45.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.275+0000 7efdd13b7700 1 --2- 172.21.15.26:0/4044672927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efdcc0f5ed0 0x7efdcc106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:55:45.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.275+0000 7efdd13b7700 1 -- 172.21.15.26:0/4044672927 >> 172.21.15.26:0/4044672927 conn(0x7efdcc0f0dc0 msgr2=0x7efdcc0fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:55:45.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.275+0000 7efdd13b7700 1 -- 172.21.15.26:0/4044672927 shutdown_connections 2021-11-03T17:55:45.282 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:55:45.275+0000 7efdd13b7700 1 -- 172.21.15.26:0/4044672927 wait complete. 2021-11-03T17:55:45.282 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:55:45.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:45 smithi026 ceph-mon[96795]: from='client.36028 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:55:45.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:45 smithi026 ceph-mon[96795]: from='client.36032 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:55:45.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:45 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/765260147' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:55:45.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:45 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/4044672927' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:55:45.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:45 smithi194 ceph-mon[65619]: from='client.36028 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:55:45.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:45 smithi194 ceph-mon[65619]: from='client.36032 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:55:45.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:45 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/765260147' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:55:45.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:45 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/4044672927' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:55:46.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:46 smithi026 ceph-mon[96795]: pgmap v1833: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:46.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:46 smithi194 ceph-mon[65619]: pgmap v1833: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:48.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:48 smithi026 ceph-mon[96795]: pgmap v1834: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:48.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:55:48.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:55:48.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:48 smithi194 ceph-mon[65619]: pgmap v1834: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:48.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:55:48.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:55:50.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:50 smithi026 ceph-mon[96795]: pgmap v1835: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:50.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:50 smithi194 ceph-mon[65619]: pgmap v1835: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:52.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:52 smithi026 ceph-mon[96795]: pgmap v1836: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:52.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:52 smithi194 ceph-mon[65619]: pgmap v1836: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:54.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:54 smithi026 ceph-mon[96795]: pgmap v1837: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:54.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:54 smithi194 ceph-mon[65619]: pgmap v1837: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:56.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:56 smithi026 ceph-mon[96795]: pgmap v1838: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:56.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:56 smithi194 ceph-mon[65619]: pgmap v1838: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:58.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:58 smithi026 ceph-mon[96795]: pgmap v1839: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:58.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:58 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:55:58.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:55:58 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:55:58.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:58 smithi194 ceph-mon[65619]: pgmap v1839: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:55:58.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:58 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:55:58.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:55:58 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:56:00.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:00 smithi026 ceph-mon[96795]: pgmap v1840: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:00.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:00 smithi194 ceph-mon[65619]: pgmap v1840: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:02.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:02 smithi026 ceph-mon[96795]: pgmap v1841: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:02.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:02 smithi194 ceph-mon[65619]: pgmap v1841: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:04.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:04 smithi026 ceph-mon[96795]: pgmap v1842: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:04.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:04 smithi194 ceph-mon[65619]: pgmap v1842: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:06.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:06 smithi026 ceph-mon[96795]: pgmap v1843: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:06.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:06 smithi194 ceph-mon[65619]: pgmap v1843: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:08.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:08 smithi026 ceph-mon[96795]: pgmap v1844: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:08.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:08 smithi194 ceph-mon[65619]: pgmap v1844: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:10.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:10 smithi026 ceph-mon[96795]: pgmap v1845: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:10.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:10 smithi194 ceph-mon[65619]: pgmap v1845: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:12.922 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:12 smithi026 ceph-mon[96795]: pgmap v1846: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:12.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:12 smithi194 ceph-mon[65619]: pgmap v1846: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:13.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:13 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:56:13.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:13 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:56:14.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:13 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:56:14.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:13 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:56:14.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:14 smithi194 ceph-mon[65619]: pgmap v1847: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:15.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:14 smithi026 ceph-mon[96795]: pgmap v1847: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:15.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.390+0000 7fd8c559e700 1 -- 172.21.15.26:0/1401604249 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8c00f49a0 msgr2=0x7fd8c00f4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:56:15.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.390+0000 7fd8c559e700 1 --2- 172.21.15.26:0/1401604249 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8c00f49a0 0x7fd8c00f4dc0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7fd8b00099e0 tx=0x7fd8b0004d10).stop 2021-11-03T17:56:15.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.390+0000 7fd8c559e700 1 -- 172.21.15.26:0/1401604249 shutdown_connections 2021-11-03T17:56:15.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.390+0000 7fd8c559e700 1 --2- 172.21.15.26:0/1401604249 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8c00f5340 0x7fd8c00f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:15.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.390+0000 7fd8c559e700 1 --2- 172.21.15.26:0/1401604249 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8c00f49a0 0x7fd8c00f4dc0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:15.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.390+0000 7fd8c559e700 1 -- 172.21.15.26:0/1401604249 >> 172.21.15.26:0/1401604249 conn(0x7fd8c00f04c0 msgr2=0x7fd8c00f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:56:15.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.390+0000 7fd8c559e700 1 -- 172.21.15.26:0/1401604249 shutdown_connections 2021-11-03T17:56:15.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.390+0000 7fd8c559e700 1 -- 172.21.15.26:0/1401604249 wait complete. 2021-11-03T17:56:15.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.391+0000 7fd8c559e700 1 Processor -- start 2021-11-03T17:56:15.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.391+0000 7fd8c559e700 1 -- start start 2021-11-03T17:56:15.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.391+0000 7fd8c559e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8c00f49a0 0x7fd8c00f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:56:15.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.391+0000 7fd8c559e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8c00f5340 0x7fd8c00f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:56:15.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.391+0000 7fd8c559e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c00f5f30 con 0x7fd8c00f5340 2021-11-03T17:56:15.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.391+0000 7fd8c559e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c00f6070 con 0x7fd8c00f49a0 2021-11-03T17:56:15.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.391+0000 7fd8be7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8c00f5340 0x7fd8c00f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:56:15.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.391+0000 7fd8be7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8c00f5340 0x7fd8c00f59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57198/0 (socket says 172.21.15.26:57198) 2021-11-03T17:56:15.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.391+0000 7fd8be7fc700 1 -- 172.21.15.26:0/3386792321 learned_addr learned my addr 172.21.15.26:0/3386792321 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:56:15.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.391+0000 7fd8beffd700 1 --2- 172.21.15.26:0/3386792321 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8c00f49a0 0x7fd8c00f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:56:15.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.392+0000 7fd8be7fc700 1 -- 172.21.15.26:0/3386792321 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8c00f49a0 msgr2=0x7fd8c00f7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:56:15.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.392+0000 7fd8be7fc700 1 --2- 172.21.15.26:0/3386792321 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8c00f49a0 0x7fd8c00f7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:15.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.392+0000 7fd8be7fc700 1 -- 172.21.15.26:0/3386792321 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b0009640 con 0x7fd8c00f5340 2021-11-03T17:56:15.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.392+0000 7fd8be7fc700 1 --2- 172.21.15.26:0/3386792321 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8c00f5340 0x7fd8c00f59d0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 rx=0x7fd8a80026d0 tx=0x7fd8a8009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:56:15.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.392+0000 7fd8b77fe700 1 -- 172.21.15.26:0/3386792321 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8a80079c0 con 0x7fd8c00f5340 2021-11-03T17:56:15.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.392+0000 7fd8c559e700 1 -- 172.21.15.26:0/3386792321 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c00f6350 con 0x7fd8c00f5340 2021-11-03T17:56:15.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.392+0000 7fd8b77fe700 1 -- 172.21.15.26:0/3386792321 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd8a800f040 con 0x7fd8c00f5340 2021-11-03T17:56:15.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.392+0000 7fd8b77fe700 1 -- 172.21.15.26:0/3386792321 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8a8014850 con 0x7fd8c00f5340 2021-11-03T17:56:15.395 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.392+0000 7fd8c559e700 1 -- 172.21.15.26:0/3386792321 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c010f110 con 0x7fd8c00f5340 2021-11-03T17:56:15.395 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.393+0000 7fd8c559e700 1 -- 172.21.15.26:0/3386792321 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8c0045ad0 con 0x7fd8c00f5340 2021-11-03T17:56:15.395 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.393+0000 7fd8b77fe700 1 -- 172.21.15.26:0/3386792321 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fd8a8007b20 con 0x7fd8c00f5340 2021-11-03T17:56:15.395 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.394+0000 7fd8b77fe700 1 --2- 172.21.15.26:0/3386792321 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd8ac0640b0 0x7fd8ac066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:56:15.395 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.394+0000 7fd8b77fe700 1 -- 172.21.15.26:0/3386792321 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fd8a8080770 con 0x7fd8c00f5340 2021-11-03T17:56:15.396 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.394+0000 7fd8beffd700 1 --2- 172.21.15.26:0/3386792321 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd8ac0640b0 0x7fd8ac066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:56:15.396 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.394+0000 7fd8beffd700 1 --2- 172.21.15.26:0/3386792321 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd8ac0640b0 0x7fd8ac066570 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fd8b00099b0 tx=0x7fd8b0004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:56:15.396 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.398+0000 7fd8b77fe700 1 -- 172.21.15.26:0/3386792321 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fd8a8052ad0 con 0x7fd8c00f5340 2021-11-03T17:56:15.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.576+0000 7fd8c559e700 1 -- 172.21.15.26:0/3386792321 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd8c0057f10 con 0x7fd8ac0640b0 2021-11-03T17:56:15.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.578+0000 7fd8b77fe700 1 -- 172.21.15.26:0/3386792321 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fd8c0057f10 con 0x7fd8ac0640b0 2021-11-03T17:56:15.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.579+0000 7fd8c559e700 1 -- 172.21.15.26:0/3386792321 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd8ac0640b0 msgr2=0x7fd8ac066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:56:15.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.579+0000 7fd8c559e700 1 --2- 172.21.15.26:0/3386792321 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd8ac0640b0 0x7fd8ac066570 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fd8b00099b0 tx=0x7fd8b0004d10).stop 2021-11-03T17:56:15.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.579+0000 7fd8c559e700 1 -- 172.21.15.26:0/3386792321 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8c00f5340 msgr2=0x7fd8c00f59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:56:15.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.579+0000 7fd8c559e700 1 --2- 172.21.15.26:0/3386792321 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8c00f5340 0x7fd8c00f59d0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 rx=0x7fd8a80026d0 tx=0x7fd8a8009e00).stop 2021-11-03T17:56:15.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.580+0000 7fd8c559e700 1 -- 172.21.15.26:0/3386792321 shutdown_connections 2021-11-03T17:56:15.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.580+0000 7fd8c559e700 1 --2- 172.21.15.26:0/3386792321 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd8ac0640b0 0x7fd8ac066570 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:15.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.580+0000 7fd8c559e700 1 --2- 172.21.15.26:0/3386792321 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8c00f49a0 0x7fd8c00f7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:15.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.580+0000 7fd8c559e700 1 --2- 172.21.15.26:0/3386792321 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8c00f5340 0x7fd8c00f59d0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:15.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.580+0000 7fd8c559e700 1 -- 172.21.15.26:0/3386792321 >> 172.21.15.26:0/3386792321 conn(0x7fd8c00f04c0 msgr2=0x7fd8c00fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:56:15.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.580+0000 7fd8c559e700 1 -- 172.21.15.26:0/3386792321 shutdown_connections 2021-11-03T17:56:15.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.580+0000 7fd8c559e700 1 -- 172.21.15.26:0/3386792321 wait complete. 2021-11-03T17:56:15.585 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:56:15.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.680+0000 7fd73ab5e700 1 -- 172.21.15.26:0/3295565065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7340f4800 msgr2=0x7fd7340f4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:56:15.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.680+0000 7fd73ab5e700 1 --2- 172.21.15.26:0/3295565065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7340f4800 0x7fd7340f4c20 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 rx=0x7fd730004660 tx=0x7fd730009b30).stop 2021-11-03T17:56:15.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.681+0000 7fd73ab5e700 1 -- 172.21.15.26:0/3295565065 shutdown_connections 2021-11-03T17:56:15.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.681+0000 7fd73ab5e700 1 --2- 172.21.15.26:0/3295565065 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7340f51a0 0x7fd7340f7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:56:15.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.681+0000 7fd73ab5e700 1 --2- 172.21.15.26:0/3295565065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7340f4800 0x7fd7340f4c20 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:15.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.681+0000 7fd73ab5e700 1 -- 172.21.15.26:0/3295565065 >> 172.21.15.26:0/3295565065 conn(0x7fd7340f0320 msgr2=0x7fd7340f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:56:15.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.681+0000 7fd73ab5e700 1 -- 172.21.15.26:0/3295565065 shutdown_connections 2021-11-03T17:56:15.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.681+0000 7fd73ab5e700 1 -- 172.21.15.26:0/3295565065 wait complete. 2021-11-03T17:56:15.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.681+0000 7fd73ab5e700 1 Processor -- start 2021-11-03T17:56:15.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.681+0000 7fd73ab5e700 1 -- start start 2021-11-03T17:56:15.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.682+0000 7fd73ab5e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7340f4800 0x7fd734106e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:56:15.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.682+0000 7fd73ab5e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7340f51a0 0x7fd734107340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:56:15.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.682+0000 7fd73ab5e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7341079d0 con 0x7fd7340f51a0 2021-11-03T17:56:15.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.682+0000 7fd73ab5e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd734108150 con 0x7fd7340f4800 2021-11-03T17:56:15.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.682+0000 7fd73935b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7340f51a0 0x7fd734107340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:56:15.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.682+0000 7fd73935b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7340f51a0 0x7fd734107340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57208/0 (socket says 172.21.15.26:57208) 2021-11-03T17:56:15.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.682+0000 7fd73935b700 1 -- 172.21.15.26:0/2668914114 learned_addr learned my addr 172.21.15.26:0/2668914114 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:56:15.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.682+0000 7fd739b5c700 1 --2- 172.21.15.26:0/2668914114 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7340f4800 0x7fd734106e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:56:15.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.682+0000 7fd73935b700 1 -- 172.21.15.26:0/2668914114 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7340f4800 msgr2=0x7fd734106e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:56:15.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.682+0000 7fd73935b700 1 --2- 172.21.15.26:0/2668914114 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7340f4800 0x7fd734106e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:15.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.682+0000 7fd73935b700 1 -- 172.21.15.26:0/2668914114 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd730005040 con 0x7fd7340f51a0 2021-11-03T17:56:15.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.682+0000 7fd73935b700 1 --2- 172.21.15.26:0/2668914114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7340f51a0 0x7fd734107340 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7fd7240093f0 tx=0x7fd724006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:56:15.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.683+0000 7fd72a7fc700 1 -- 172.21.15.26:0/2668914114 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd724013640 con 0x7fd7340f51a0 2021-11-03T17:56:15.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.683+0000 7fd72a7fc700 1 -- 172.21.15.26:0/2668914114 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd724013c50 con 0x7fd7340f51a0 2021-11-03T17:56:15.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.683+0000 7fd73ab5e700 1 -- 172.21.15.26:0/2668914114 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7341083d0 con 0x7fd7340f51a0 2021-11-03T17:56:15.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.683+0000 7fd73ab5e700 1 -- 172.21.15.26:0/2668914114 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd734108990 con 0x7fd7340f51a0 2021-11-03T17:56:15.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.683+0000 7fd72a7fc700 1 -- 172.21.15.26:0/2668914114 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd724012c70 con 0x7fd7340f51a0 2021-11-03T17:56:15.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.684+0000 7fd73ab5e700 1 -- 172.21.15.26:0/2668914114 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd71c004fa0 con 0x7fd7340f51a0 2021-11-03T17:56:15.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.684+0000 7fd72a7fc700 1 -- 172.21.15.26:0/2668914114 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fd72401a060 con 0x7fd7340f51a0 2021-11-03T17:56:15.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.684+0000 7fd72a7fc700 1 --2- 172.21.15.26:0/2668914114 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd720064100 0x7fd7200665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:56:15.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.684+0000 7fd72a7fc700 1 -- 172.21.15.26:0/2668914114 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fd7240808c0 con 0x7fd7340f51a0 2021-11-03T17:56:15.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.684+0000 7fd739b5c700 1 --2- 172.21.15.26:0/2668914114 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd720064100 0x7fd7200665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:56:15.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.685+0000 7fd739b5c700 1 --2- 172.21.15.26:0/2668914114 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd720064100 0x7fd7200665c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7fd730013690 tx=0x7fd730009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:56:15.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.689+0000 7fd72a7fc700 1 -- 172.21.15.26:0/2668914114 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fd724052a70 con 0x7fd7340f51a0 2021-11-03T17:56:15.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.861+0000 7fd73ab5e700 1 -- 172.21.15.26:0/2668914114 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd71c000bc0 con 0x7fd720064100 2021-11-03T17:56:15.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.876+0000 7fd72a7fc700 1 -- 172.21.15.26:0/2668914114 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fd71c000bc0 con 0x7fd720064100 2021-11-03T17:56:15.873 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:56:15.873 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (67m) 6m ago 68m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:56:15.873 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (59m) 6m ago 68m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:56:15.874 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (59m) 5m ago 67m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:56:15.874 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (67m) 6m ago 68m 41.4M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:56:15.874 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (60m) 6m ago 63m 25.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:56:15.875 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (60m) 6m ago 63m 26.0M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:56:15.875 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (63m) 5m ago 63m 26.2M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:56:15.875 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (63m) 5m ago 63m 26.5M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:56:15.875 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (61m) 6m ago 70m 547M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:56:15.875 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (60m) 5m ago 67m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:56:15.876 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (60m) 6m ago 70m 242M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:56:15.876 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (60m) 5m ago 67m 117M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:56:15.876 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (68m) 6m ago 68m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:56:15.876 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (67m) 5m ago 67m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:56:15.877 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (59m) 6m ago 67m 271M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:56:15.877 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (58m) 6m ago 66m 291M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:56:15.877 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (58m) 6m ago 66m 243M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:56:15.877 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (57m) 5m ago 66m 312M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:56:15.878 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (57m) 5m ago 65m 265M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:56:15.878 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (56m) 5m ago 65m 255M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:56:15.878 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (67m) 6m ago 68m 58.9M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:56:15.879 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.878+0000 7fd73ab5e700 1 -- 172.21.15.26:0/2668914114 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd720064100 msgr2=0x7fd7200665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:56:15.879 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.878+0000 7fd73ab5e700 1 --2- 172.21.15.26:0/2668914114 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd720064100 0x7fd7200665c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7fd730013690 tx=0x7fd730009b30).stop 2021-11-03T17:56:15.880 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.878+0000 7fd73ab5e700 1 -- 172.21.15.26:0/2668914114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7340f51a0 msgr2=0x7fd734107340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:56:15.880 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.878+0000 7fd73ab5e700 1 --2- 172.21.15.26:0/2668914114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7340f51a0 0x7fd734107340 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7fd7240093f0 tx=0x7fd724006ec0).stop 2021-11-03T17:56:15.880 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.878+0000 7fd73ab5e700 1 -- 172.21.15.26:0/2668914114 shutdown_connections 2021-11-03T17:56:15.880 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.878+0000 7fd73ab5e700 1 --2- 172.21.15.26:0/2668914114 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd720064100 0x7fd7200665c0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:15.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.878+0000 7fd73ab5e700 1 --2- 172.21.15.26:0/2668914114 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7340f4800 0x7fd734106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:15.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.878+0000 7fd73ab5e700 1 --2- 172.21.15.26:0/2668914114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7340f51a0 0x7fd734107340 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:15.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.878+0000 7fd73ab5e700 1 -- 172.21.15.26:0/2668914114 >> 172.21.15.26:0/2668914114 conn(0x7fd7340f0320 msgr2=0x7fd7340fb370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:56:15.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.878+0000 7fd73ab5e700 1 -- 172.21.15.26:0/2668914114 shutdown_connections 2021-11-03T17:56:15.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.878+0000 7fd73ab5e700 1 -- 172.21.15.26:0/2668914114 wait complete. 2021-11-03T17:56:15.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.977+0000 7f716ba5f700 1 -- 172.21.15.26:0/848076973 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71640f7960 msgr2=0x7f71640f7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:56:15.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.977+0000 7f716ba5f700 1 --2- 172.21.15.26:0/848076973 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71640f7960 0x7f71640f7dc0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7f7158004660 tx=0x7f7158009b30).stop 2021-11-03T17:56:15.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.977+0000 7f716ba5f700 1 -- 172.21.15.26:0/848076973 shutdown_connections 2021-11-03T17:56:15.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.977+0000 7f716ba5f700 1 --2- 172.21.15.26:0/848076973 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71640f7960 0x7f71640f7dc0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:15.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.977+0000 7f716ba5f700 1 --2- 172.21.15.26:0/848076973 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71640f66c0 0x7f71640f6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:15.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.977+0000 7f716ba5f700 1 -- 172.21.15.26:0/848076973 >> 172.21.15.26:0/848076973 conn(0x7f71640f1e20 msgr2=0x7f71640f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:56:15.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.977+0000 7f716ba5f700 1 -- 172.21.15.26:0/848076973 shutdown_connections 2021-11-03T17:56:15.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.977+0000 7f716ba5f700 1 -- 172.21.15.26:0/848076973 wait complete. 2021-11-03T17:56:15.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.978+0000 7f716ba5f700 1 Processor -- start 2021-11-03T17:56:15.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.978+0000 7f716ba5f700 1 -- start start 2021-11-03T17:56:15.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.978+0000 7f716ba5f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71640f66c0 0x7f7164106f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:56:15.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.978+0000 7f716ba5f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71640f7960 0x7f7164107440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:56:15.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.978+0000 7f716ba5f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71641079f0 con 0x7f71640f66c0 2021-11-03T17:56:15.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.978+0000 7f716ba5f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7164107b30 con 0x7f71640f7960 2021-11-03T17:56:15.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.978+0000 7f71697fb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71640f66c0 0x7f7164106f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:56:15.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.978+0000 7f71697fb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71640f66c0 0x7f7164106f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57216/0 (socket says 172.21.15.26:57216) 2021-11-03T17:56:15.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.978+0000 7f71697fb700 1 -- 172.21.15.26:0/1351638229 learned_addr learned my addr 172.21.15.26:0/1351638229 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:56:15.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.979+0000 7f71697fb700 1 -- 172.21.15.26:0/1351638229 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71640f7960 msgr2=0x7f7164107440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:56:15.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.979+0000 7f7168ffa700 1 --2- 172.21.15.26:0/1351638229 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71640f7960 0x7f7164107440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:56:15.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.979+0000 7f71697fb700 1 --2- 172.21.15.26:0/1351638229 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71640f7960 0x7f7164107440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:15.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.979+0000 7f71697fb700 1 -- 172.21.15.26:0/1351638229 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7158005040 con 0x7f71640f66c0 2021-11-03T17:56:15.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.979+0000 7f71697fb700 1 --2- 172.21.15.26:0/1351638229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71640f66c0 0x7f7164106f50 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7f715c00c710 tx=0x7f715c004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:56:15.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.979+0000 7f7161ffb700 1 -- 172.21.15.26:0/1351638229 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f715c0106f0 con 0x7f71640f66c0 2021-11-03T17:56:15.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.979+0000 7f7161ffb700 1 -- 172.21.15.26:0/1351638229 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f715c010d00 con 0x7f71640f66c0 2021-11-03T17:56:15.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.979+0000 7f716ba5f700 1 -- 172.21.15.26:0/1351638229 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71641084d0 con 0x7f71640f66c0 2021-11-03T17:56:15.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.979+0000 7f7161ffb700 1 -- 172.21.15.26:0/1351638229 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f715c012d90 con 0x7f71640f66c0 2021-11-03T17:56:15.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.979+0000 7f716ba5f700 1 -- 172.21.15.26:0/1351638229 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7164108a90 con 0x7f71640f66c0 2021-11-03T17:56:15.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.980+0000 7f716ba5f700 1 -- 172.21.15.26:0/1351638229 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7164045ad0 con 0x7f71640f66c0 2021-11-03T17:56:15.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.981+0000 7f7161ffb700 1 -- 172.21.15.26:0/1351638229 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f715c010070 con 0x7f71640f66c0 2021-11-03T17:56:15.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.981+0000 7f7161ffb700 1 --2- 172.21.15.26:0/1351638229 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f714c0640b0 0x7f714c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:56:15.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.981+0000 7f7161ffb700 1 -- 172.21.15.26:0/1351638229 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f715c080e10 con 0x7f71640f66c0 2021-11-03T17:56:15.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.981+0000 7f7168ffa700 1 --2- 172.21.15.26:0/1351638229 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f714c0640b0 0x7f714c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:56:15.984 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.982+0000 7f7168ffa700 1 --2- 172.21.15.26:0/1351638229 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f714c0640b0 0x7f714c066570 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f7158009da0 tx=0x7f7158009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:56:15.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:15.985+0000 7f7161ffb700 1 -- 172.21.15.26:0/1351638229 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f715c053140 con 0x7f71640f66c0 2021-11-03T17:56:16.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.216+0000 7f716ba5f700 1 -- 172.21.15.26:0/1351638229 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7164108660 con 0x7f71640f66c0 2021-11-03T17:56:16.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.216+0000 7f7161ffb700 1 -- 172.21.15.26:0/1351638229 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f7164108660 con 0x7f71640f66c0 2021-11-03T17:56:16.213 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:56:16.213 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:56:16.213 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:56:16.213 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:56:16.214 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:56:16.214 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:56:16.214 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:56:16.215 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:56:16.215 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:56:16.215 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:56:16.215 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:56:16.216 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:56:16.216 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:56:16.216 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:56:16.217 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:56:16.217 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:56:16.218 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:56:16.218 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:56:16.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.218+0000 7f716ba5f700 1 -- 172.21.15.26:0/1351638229 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f714c0640b0 msgr2=0x7f714c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:56:16.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.218+0000 7f716ba5f700 1 --2- 172.21.15.26:0/1351638229 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f714c0640b0 0x7f714c066570 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f7158009da0 tx=0x7f7158009b30).stop 2021-11-03T17:56:16.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.218+0000 7f716ba5f700 1 -- 172.21.15.26:0/1351638229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71640f66c0 msgr2=0x7f7164106f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:56:16.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.218+0000 7f716ba5f700 1 --2- 172.21.15.26:0/1351638229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71640f66c0 0x7f7164106f50 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7f715c00c710 tx=0x7f715c004d10).stop 2021-11-03T17:56:16.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.218+0000 7f716ba5f700 1 -- 172.21.15.26:0/1351638229 shutdown_connections 2021-11-03T17:56:16.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.218+0000 7f716ba5f700 1 --2- 172.21.15.26:0/1351638229 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f714c0640b0 0x7f714c066570 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:16.221 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.218+0000 7f716ba5f700 1 --2- 172.21.15.26:0/1351638229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71640f66c0 0x7f7164106f50 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:16.221 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.218+0000 7f716ba5f700 1 --2- 172.21.15.26:0/1351638229 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71640f7960 0x7f7164107440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:16.221 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.218+0000 7f716ba5f700 1 -- 172.21.15.26:0/1351638229 >> 172.21.15.26:0/1351638229 conn(0x7f71640f1e20 msgr2=0x7f71640fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:56:16.222 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.218+0000 7f716ba5f700 1 -- 172.21.15.26:0/1351638229 shutdown_connections 2021-11-03T17:56:16.222 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.218+0000 7f716ba5f700 1 -- 172.21.15.26:0/1351638229 wait complete. 2021-11-03T17:56:16.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.318+0000 7fe1ba504700 1 -- 172.21.15.26:0/3783302454 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1b40f5ed0 msgr2=0x7fe1b40f6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:56:16.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.318+0000 7fe1ba504700 1 --2- 172.21.15.26:0/3783302454 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1b40f5ed0 0x7fe1b40f6900 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7fe1a4004660 tx=0x7fe1a4009b30).stop 2021-11-03T17:56:16.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.318+0000 7fe1ba504700 1 -- 172.21.15.26:0/3783302454 shutdown_connections 2021-11-03T17:56:16.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.318+0000 7fe1ba504700 1 --2- 172.21.15.26:0/3783302454 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1b40f5ed0 0x7fe1b40f6900 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:16.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.318+0000 7fe1ba504700 1 --2- 172.21.15.26:0/3783302454 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1b40f55c0 0x7fe1b40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:56:16.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.318+0000 7fe1ba504700 1 -- 172.21.15.26:0/3783302454 >> 172.21.15.26:0/3783302454 conn(0x7fe1b40f0de0 msgr2=0x7fe1b40f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:56:16.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.318+0000 7fe1ba504700 1 -- 172.21.15.26:0/3783302454 shutdown_connections 2021-11-03T17:56:16.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.318+0000 7fe1ba504700 1 -- 172.21.15.26:0/3783302454 wait complete. 2021-11-03T17:56:16.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.319+0000 7fe1ba504700 1 Processor -- start 2021-11-03T17:56:16.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.319+0000 7fe1ba504700 1 -- start start 2021-11-03T17:56:16.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.319+0000 7fe1ba504700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1b40f55c0 0x7fe1b4109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:56:16.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.319+0000 7fe1ba504700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1b40f5ed0 0x7fe1b410c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:56:16.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.319+0000 7fe1ba504700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b4060550 con 0x7fe1b40f5ed0 2021-11-03T17:56:16.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.319+0000 7fe1ba504700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b4060690 con 0x7fe1b40f55c0 2021-11-03T17:56:16.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.319+0000 7fe1b37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1b40f5ed0 0x7fe1b410c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:56:16.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.319+0000 7fe1b37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1b40f5ed0 0x7fe1b410c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57228/0 (socket says 172.21.15.26:57228) 2021-11-03T17:56:16.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.319+0000 7fe1b37fe700 1 -- 172.21.15.26:0/916315434 learned_addr learned my addr 172.21.15.26:0/916315434 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:56:16.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.319+0000 7fe1b3fff700 1 --2- 172.21.15.26:0/916315434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1b40f55c0 0x7fe1b4109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:56:16.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.319+0000 7fe1b37fe700 1 -- 172.21.15.26:0/916315434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1b40f55c0 msgr2=0x7fe1b4109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:56:16.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.319+0000 7fe1b37fe700 1 --2- 172.21.15.26:0/916315434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1b40f55c0 0x7fe1b4109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:16.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.319+0000 7fe1b37fe700 1 -- 172.21.15.26:0/916315434 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a4005040 con 0x7fe1b40f5ed0 2021-11-03T17:56:16.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.320+0000 7fe1b37fe700 1 --2- 172.21.15.26:0/916315434 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1b40f5ed0 0x7fe1b410c170 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 rx=0x7fe1a4009990 tx=0x7fe1a4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:56:16.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.320+0000 7fe1b0ff9700 1 -- 172.21.15.26:0/916315434 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1a4018070 con 0x7fe1b40f5ed0 2021-11-03T17:56:16.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.320+0000 7fe1b0ff9700 1 -- 172.21.15.26:0/916315434 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe1a4007ca0 con 0x7fe1b40f5ed0 2021-11-03T17:56:16.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.320+0000 7fe1ba504700 1 -- 172.21.15.26:0/916315434 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b410c770 con 0x7fe1b40f5ed0 2021-11-03T17:56:16.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.320+0000 7fe1b0ff9700 1 -- 172.21.15.26:0/916315434 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1a401c620 con 0x7fe1b40f5ed0 2021-11-03T17:56:16.323 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.320+0000 7fe1ba504700 1 -- 172.21.15.26:0/916315434 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b410cca0 con 0x7fe1b40f5ed0 2021-11-03T17:56:16.323 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.321+0000 7fe1ba504700 1 -- 172.21.15.26:0/916315434 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1b4045ad0 con 0x7fe1b40f5ed0 2021-11-03T17:56:16.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.322+0000 7fe1b0ff9700 1 -- 172.21.15.26:0/916315434 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fe1a401d960 con 0x7fe1b40f5ed0 2021-11-03T17:56:16.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.322+0000 7fe1b0ff9700 1 --2- 172.21.15.26:0/916315434 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe1a00640b0 0x7fe1a0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:56:16.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.322+0000 7fe1b0ff9700 1 -- 172.21.15.26:0/916315434 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fe1a4082650 con 0x7fe1b40f5ed0 2021-11-03T17:56:16.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.322+0000 7fe1b3fff700 1 --2- 172.21.15.26:0/916315434 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe1a00640b0 0x7fe1a0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:56:16.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.322+0000 7fe1b3fff700 1 --2- 172.21.15.26:0/916315434 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe1a00640b0 0x7fe1a0066570 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7fe1b4060140 tx=0x7fe19c008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:56:16.325 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.325+0000 7fe1b0ff9700 1 -- 172.21.15.26:0/916315434 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fe1a40549b0 con 0x7fe1b40f5ed0 2021-11-03T17:56:16.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.532+0000 7fe1ba504700 1 -- 172.21.15.26:0/916315434 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe1b40fdf70 con 0x7fe1b40f5ed0 2021-11-03T17:56:16.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.532+0000 7fe1b0ff9700 1 -- 172.21.15.26:0/916315434 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fe1a40545a0 con 0x7fe1b40f5ed0 2021-11-03T17:56:16.528 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:56:16.529 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:56:16.529 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:56:16.529 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:56:16.530 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:56:16.530 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:56:16.530 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:56:16.530 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:56:16.531 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:56:16.531 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:56:16.531 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:56:16.531 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:56:16.532 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:56:16.532 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:56:16.532 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:56:16.532 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:56:16.533 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:56:16.533 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:56:16.533 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:56:16.533 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:56:16.534 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:56:16.534 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:56:16.534 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:56:16.534 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:56:16.534 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:56:16.535 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:56:16.535 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:56:16.535 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:56:16.536 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:56:16.536 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:56:16.536 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:56:16.536 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:56:16.537 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:56:16.537 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:56:16.537 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:56:16.537 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:56:16.538 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:56:16.538 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:56:16.538 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:56:16.539 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.534+0000 7fe1ba504700 1 -- 172.21.15.26:0/916315434 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe1a00640b0 msgr2=0x7fe1a0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:56:16.539 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.534+0000 7fe1ba504700 1 --2- 172.21.15.26:0/916315434 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe1a00640b0 0x7fe1a0066570 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7fe1b4060140 tx=0x7fe19c008040).stop 2021-11-03T17:56:16.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.534+0000 7fe1ba504700 1 -- 172.21.15.26:0/916315434 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1b40f5ed0 msgr2=0x7fe1b410c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:56:16.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.534+0000 7fe1ba504700 1 --2- 172.21.15.26:0/916315434 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1b40f5ed0 0x7fe1b410c170 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 rx=0x7fe1a4009990 tx=0x7fe1a4009b30).stop 2021-11-03T17:56:16.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.534+0000 7fe1ba504700 1 -- 172.21.15.26:0/916315434 shutdown_connections 2021-11-03T17:56:16.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.534+0000 7fe1ba504700 1 --2- 172.21.15.26:0/916315434 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe1a00640b0 0x7fe1a0066570 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:16.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.534+0000 7fe1ba504700 1 --2- 172.21.15.26:0/916315434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1b40f55c0 0x7fe1b4109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:16.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.534+0000 7fe1ba504700 1 --2- 172.21.15.26:0/916315434 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1b40f5ed0 0x7fe1b410c170 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:16.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.534+0000 7fe1ba504700 1 -- 172.21.15.26:0/916315434 >> 172.21.15.26:0/916315434 conn(0x7fe1b40f0de0 msgr2=0x7fe1b40fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:56:16.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.534+0000 7fe1ba504700 1 -- 172.21.15.26:0/916315434 shutdown_connections 2021-11-03T17:56:16.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:16.534+0000 7fe1ba504700 1 -- 172.21.15.26:0/916315434 wait complete. 2021-11-03T17:56:16.542 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:56:16.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:16 smithi194 ceph-mon[65619]: pgmap v1848: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:16.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:16 smithi194 ceph-mon[65619]: from='client.36044 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:56:16.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:16 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1351638229' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:56:16.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:16 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/916315434' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:56:17.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:16 smithi026 ceph-mon[96795]: pgmap v1848: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:17.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:16 smithi026 ceph-mon[96795]: from='client.36044 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:56:17.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:16 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1351638229' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:56:17.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:16 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/916315434' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:56:17.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:17 smithi194 ceph-mon[65619]: from='client.36048 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:56:18.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:17 smithi026 ceph-mon[96795]: from='client.36048 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:56:18.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:18 smithi194 ceph-mon[65619]: pgmap v1849: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:19.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:18 smithi026 ceph-mon[96795]: pgmap v1849: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:20.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:20 smithi194 ceph-mon[65619]: pgmap v1850: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:21.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:20 smithi026 ceph-mon[96795]: pgmap v1850: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:22.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:22 smithi194 ceph-mon[65619]: pgmap v1851: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:23.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:22 smithi026 ceph-mon[96795]: pgmap v1851: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:24.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:24 smithi194 ceph-mon[65619]: pgmap v1852: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:25.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:24 smithi026 ceph-mon[96795]: pgmap v1852: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:26.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:26 smithi194 ceph-mon[65619]: pgmap v1853: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:27.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:26 smithi026 ceph-mon[96795]: pgmap v1853: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:27.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:27 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:56:28.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:27 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:56:28.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:28 smithi194 ceph-mon[65619]: pgmap v1854: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:28.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:28 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:56:29.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:28 smithi026 ceph-mon[96795]: pgmap v1854: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:29.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:28 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:56:30.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:30 smithi194 ceph-mon[65619]: pgmap v1855: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:31.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:30 smithi026 ceph-mon[96795]: pgmap v1855: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:32.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:32 smithi194 ceph-mon[65619]: pgmap v1856: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:33.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:32 smithi026 ceph-mon[96795]: pgmap v1856: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:34.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:34 smithi194 ceph-mon[65619]: pgmap v1857: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:35.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:34 smithi026 ceph-mon[96795]: pgmap v1857: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:36.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:36 smithi194 ceph-mon[65619]: pgmap v1858: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:37.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:36 smithi026 ceph-mon[96795]: pgmap v1858: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:38.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:38 smithi194 ceph-mon[65619]: pgmap v1859: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:39.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:38 smithi026 ceph-mon[96795]: pgmap v1859: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:40.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:40 smithi194 ceph-mon[65619]: pgmap v1860: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:41.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:40 smithi026 ceph-mon[96795]: pgmap v1860: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:42.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:42 smithi194 ceph-mon[65619]: pgmap v1861: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:42.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:56:43.075 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:42 smithi026 ceph-mon[96795]: pgmap v1861: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:43.076 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:56:43.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:43 smithi194 ceph-mon[65619]: poll took 60078.538 ms: 1 events 2021-11-03T17:56:43.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:43 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:56:43.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:43 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:56:43.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:43 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:56:43.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:43 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:56:44.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:43 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:56:44.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:43 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:56:44.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:43 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:56:44.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:43 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:56:44.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:43 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:56:44.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:43 smithi026 ceph-mon[96795]: poll took 60078.538 ms: 1 events 2021-11-03T17:56:44.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:43 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:56:44.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:43 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:56:44.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:43 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:56:44.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:43 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:56:44.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:43 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:56:44.180 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:43 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:56:44.181 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:43 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:56:44.181 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:43 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:56:44.181 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:43 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:56:44.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:44 smithi194 ceph-mon[65619]: pgmap v1862: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:44.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:44 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:56:44.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:44 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:56:45.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:44 smithi026 ceph-mon[96795]: pgmap v1862: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:45.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:44 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:56:45.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:44 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:56:46.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.648+0000 7f02116f1700 1 -- 172.21.15.26:0/2946920139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f020c0f77d0 msgr2=0x7f020c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:56:46.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.648+0000 7f02116f1700 1 --2- 172.21.15.26:0/2946920139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f020c0f77d0 0x7f020c0f7c30 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7f0200004660 tx=0x7f0200009b30).stop 2021-11-03T17:56:46.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.648+0000 7f02116f1700 1 -- 172.21.15.26:0/2946920139 shutdown_connections 2021-11-03T17:56:46.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.648+0000 7f02116f1700 1 --2- 172.21.15.26:0/2946920139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f020c0f77d0 0x7f020c0f7c30 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:46.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.648+0000 7f02116f1700 1 --2- 172.21.15.26:0/2946920139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f020c0f6530 0x7f020c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:46.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.648+0000 7f02116f1700 1 -- 172.21.15.26:0/2946920139 >> 172.21.15.26:0/2946920139 conn(0x7f020c0f1cd0 msgr2=0x7f020c0f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:56:46.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.648+0000 7f02116f1700 1 -- 172.21.15.26:0/2946920139 shutdown_connections 2021-11-03T17:56:46.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.648+0000 7f02116f1700 1 -- 172.21.15.26:0/2946920139 wait complete. 2021-11-03T17:56:46.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.649+0000 7f02116f1700 1 Processor -- start 2021-11-03T17:56:46.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.649+0000 7f02116f1700 1 -- start start 2021-11-03T17:56:46.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.649+0000 7f02116f1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f020c0f6530 0x7f020c106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:56:46.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.649+0000 7f02116f1700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f020c0f77d0 0x7f020c107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:56:46.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.649+0000 7f02116f1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020c107870 con 0x7f020c0f6530 2021-11-03T17:56:46.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.649+0000 7f02116f1700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020c108080 con 0x7f020c0f77d0 2021-11-03T17:56:46.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.649+0000 7f020bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f020c0f6530 0x7f020c106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:56:46.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.649+0000 7f020bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f020c0f6530 0x7f020c106d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57244/0 (socket says 172.21.15.26:57244) 2021-11-03T17:56:46.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.649+0000 7f020bfff700 1 -- 172.21.15.26:0/1767142493 learned_addr learned my addr 172.21.15.26:0/1767142493 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:56:46.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.649+0000 7f020b7fe700 1 --2- 172.21.15.26:0/1767142493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f020c0f77d0 0x7f020c107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:56:46.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.650+0000 7f020bfff700 1 -- 172.21.15.26:0/1767142493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f020c0f77d0 msgr2=0x7f020c107270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:56:46.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.650+0000 7f020bfff700 1 --2- 172.21.15.26:0/1767142493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f020c0f77d0 0x7f020c107270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:46.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.650+0000 7f020bfff700 1 -- 172.21.15.26:0/1767142493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0200005040 con 0x7f020c0f6530 2021-11-03T17:56:46.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.650+0000 7f020bfff700 1 --2- 172.21.15.26:0/1767142493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f020c0f6530 0x7f020c106d80 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7f01fc002700 tx=0x7f01fc009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:56:46.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.650+0000 7f0208ff9700 1 -- 172.21.15.26:0/1767142493 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01fc0079c0 con 0x7f020c0f6530 2021-11-03T17:56:46.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.650+0000 7f0208ff9700 1 -- 172.21.15.26:0/1767142493 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f01fc00f040 con 0x7f020c0f6530 2021-11-03T17:56:46.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.650+0000 7f02116f1700 1 -- 172.21.15.26:0/1767142493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f020c108300 con 0x7f020c0f6530 2021-11-03T17:56:46.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.650+0000 7f0208ff9700 1 -- 172.21.15.26:0/1767142493 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01fc014860 con 0x7f020c0f6530 2021-11-03T17:56:46.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.650+0000 7f02116f1700 1 -- 172.21.15.26:0/1767142493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f020c1088c0 con 0x7f020c0f6530 2021-11-03T17:56:46.654 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.651+0000 7f02116f1700 1 -- 172.21.15.26:0/1767142493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f020c059100 con 0x7f020c0f6530 2021-11-03T17:56:46.654 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.651+0000 7f0208ff9700 1 -- 172.21.15.26:0/1767142493 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f01fc01b060 con 0x7f020c0f6530 2021-11-03T17:56:46.654 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.652+0000 7f0208ff9700 1 --2- 172.21.15.26:0/1767142493 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f01f4064100 0x7f01f40665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:56:46.654 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.652+0000 7f0208ff9700 1 -- 172.21.15.26:0/1767142493 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f01fc080670 con 0x7f020c0f6530 2021-11-03T17:56:46.654 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.652+0000 7f020b7fe700 1 --2- 172.21.15.26:0/1767142493 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f01f4064100 0x7f01f40665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:56:46.655 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.652+0000 7f020b7fe700 1 --2- 172.21.15.26:0/1767142493 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f01f4064100 0x7f01f40665c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7f0200004630 tx=0x7f0200009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:56:46.655 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.656+0000 7f0208ff9700 1 -- 172.21.15.26:0/1767142493 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f01fc0529d0 con 0x7f020c0f6530 2021-11-03T17:56:46.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.840+0000 7f02116f1700 1 -- 172.21.15.26:0/1767142493 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f020c0fedd0 con 0x7f01f4064100 2021-11-03T17:56:46.837 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.841+0000 7f0208ff9700 1 -- 172.21.15.26:0/1767142493 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f020c0fedd0 con 0x7f01f4064100 2021-11-03T17:56:46.840 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.843+0000 7f02116f1700 1 -- 172.21.15.26:0/1767142493 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f01f4064100 msgr2=0x7f01f40665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:56:46.840 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.843+0000 7f02116f1700 1 --2- 172.21.15.26:0/1767142493 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f01f4064100 0x7f01f40665c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7f0200004630 tx=0x7f0200009b30).stop 2021-11-03T17:56:46.840 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.843+0000 7f02116f1700 1 -- 172.21.15.26:0/1767142493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f020c0f6530 msgr2=0x7f020c106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:56:46.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.843+0000 7f02116f1700 1 --2- 172.21.15.26:0/1767142493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f020c0f6530 0x7f020c106d80 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7f01fc002700 tx=0x7f01fc009d80).stop 2021-11-03T17:56:46.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.843+0000 7f02116f1700 1 -- 172.21.15.26:0/1767142493 shutdown_connections 2021-11-03T17:56:46.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.843+0000 7f02116f1700 1 --2- 172.21.15.26:0/1767142493 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f01f4064100 0x7f01f40665c0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:46.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.843+0000 7f02116f1700 1 --2- 172.21.15.26:0/1767142493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f020c0f6530 0x7f020c106d80 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:46.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.843+0000 7f02116f1700 1 --2- 172.21.15.26:0/1767142493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f020c0f77d0 0x7f020c107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:46.842 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.843+0000 7f02116f1700 1 -- 172.21.15.26:0/1767142493 >> 172.21.15.26:0/1767142493 conn(0x7f020c0f1cd0 msgr2=0x7f020c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:56:46.842 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.843+0000 7f02116f1700 1 -- 172.21.15.26:0/1767142493 shutdown_connections 2021-11-03T17:56:46.842 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.843+0000 7f02116f1700 1 -- 172.21.15.26:0/1767142493 wait complete. 2021-11-03T17:56:46.850 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:56:46.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.944+0000 7f7a47c23700 1 -- 172.21.15.26:0/1755434042 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a400f6860 msgr2=0x7f7a400f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:56:46.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.944+0000 7f7a47c23700 1 --2- 172.21.15.26:0/1755434042 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a400f6860 0x7f7a400f6cc0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 rx=0x7f7a30004660 tx=0x7f7a30009b30).stop 2021-11-03T17:56:46.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.944+0000 7f7a47c23700 1 -- 172.21.15.26:0/1755434042 shutdown_connections 2021-11-03T17:56:46.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.944+0000 7f7a47c23700 1 --2- 172.21.15.26:0/1755434042 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a400f6860 0x7f7a400f6cc0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:46.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.944+0000 7f7a47c23700 1 --2- 172.21.15.26:0/1755434042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a400f55c0 0x7f7a400f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:46.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.944+0000 7f7a47c23700 1 -- 172.21.15.26:0/1755434042 >> 172.21.15.26:0/1755434042 conn(0x7f7a400f0d40 msgr2=0x7f7a400f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:56:46.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.944+0000 7f7a47c23700 1 -- 172.21.15.26:0/1755434042 shutdown_connections 2021-11-03T17:56:46.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.944+0000 7f7a47c23700 1 -- 172.21.15.26:0/1755434042 wait complete. 2021-11-03T17:56:46.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.944+0000 7f7a47c23700 1 Processor -- start 2021-11-03T17:56:46.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.944+0000 7f7a47c23700 1 -- start start 2021-11-03T17:56:46.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.945+0000 7f7a47c23700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a400f55c0 0x7f7a40109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:56:46.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.945+0000 7f7a47c23700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a400f6860 0x7f7a4010c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:56:46.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.945+0000 7f7a47c23700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a400603e0 con 0x7f7a400f55c0 2021-11-03T17:56:46.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.945+0000 7f7a47c23700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a40060520 con 0x7f7a400f6860 2021-11-03T17:56:46.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.945+0000 7f7a459bf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a400f55c0 0x7f7a40109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:56:46.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.945+0000 7f7a459bf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a400f55c0 0x7f7a40109c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57254/0 (socket says 172.21.15.26:57254) 2021-11-03T17:56:46.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.945+0000 7f7a459bf700 1 -- 172.21.15.26:0/2404135611 learned_addr learned my addr 172.21.15.26:0/2404135611 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:56:46.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.945+0000 7f7a451be700 1 --2- 172.21.15.26:0/2404135611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a400f6860 0x7f7a4010c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:56:46.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.945+0000 7f7a459bf700 1 -- 172.21.15.26:0/2404135611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a400f6860 msgr2=0x7f7a4010c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:56:46.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.945+0000 7f7a459bf700 1 --2- 172.21.15.26:0/2404135611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a400f6860 0x7f7a4010c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:46.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.945+0000 7f7a459bf700 1 -- 172.21.15.26:0/2404135611 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a30005040 con 0x7f7a400f55c0 2021-11-03T17:56:46.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.945+0000 7f7a459bf700 1 --2- 172.21.15.26:0/2404135611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a400f55c0 0x7f7a40109c50 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7f7a3800c710 tx=0x7f7a38004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:56:46.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.945+0000 7f7a367fc700 1 -- 172.21.15.26:0/2404135611 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a3800e680 con 0x7f7a400f55c0 2021-11-03T17:56:46.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.945+0000 7f7a367fc700 1 -- 172.21.15.26:0/2404135611 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7a3800ec90 con 0x7f7a400f55c0 2021-11-03T17:56:46.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.945+0000 7f7a367fc700 1 -- 172.21.15.26:0/2404135611 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a38012d50 con 0x7f7a400f55c0 2021-11-03T17:56:46.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.945+0000 7f7a47c23700 1 -- 172.21.15.26:0/2404135611 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a4010c700 con 0x7f7a400f55c0 2021-11-03T17:56:46.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.946+0000 7f7a47c23700 1 -- 172.21.15.26:0/2404135611 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a4010ccc0 con 0x7f7a400f55c0 2021-11-03T17:56:46.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.947+0000 7f7a47c23700 1 -- 172.21.15.26:0/2404135611 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a40045ad0 con 0x7f7a400f55c0 2021-11-03T17:56:46.950 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.947+0000 7f7a367fc700 1 -- 172.21.15.26:0/2404135611 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f7a38019030 con 0x7f7a400f55c0 2021-11-03T17:56:46.950 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.947+0000 7f7a367fc700 1 --2- 172.21.15.26:0/2404135611 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7a2c0640b0 0x7f7a2c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:56:46.950 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.948+0000 7f7a367fc700 1 -- 172.21.15.26:0/2404135611 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f7a38080770 con 0x7f7a400f55c0 2021-11-03T17:56:46.950 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.948+0000 7f7a451be700 1 --2- 172.21.15.26:0/2404135611 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7a2c0640b0 0x7f7a2c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:56:46.951 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.948+0000 7f7a451be700 1 --2- 172.21.15.26:0/2404135611 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7a2c0640b0 0x7f7a2c066570 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f7a30004630 tx=0x7f7a30009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:56:46.951 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:46.952+0000 7f7a367fc700 1 -- 172.21.15.26:0/2404135611 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f7a380529d0 con 0x7f7a400f55c0 2021-11-03T17:56:46.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:46 smithi194 ceph-mon[65619]: pgmap v1863: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:47.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.123+0000 7f7a47c23700 1 -- 172.21.15.26:0/2404135611 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a400fdf30 con 0x7f7a2c0640b0 2021-11-03T17:56:47.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.138+0000 7f7a367fc700 1 -- 172.21.15.26:0/2404135611 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f7a30019040 con 0x7f7a2c0640b0 2021-11-03T17:56:47.135 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:56:47.135 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (68m) 7m ago 69m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:56:47.136 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (60m) 7m ago 69m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:56:47.136 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (60m) 6m ago 68m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:56:47.136 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (67m) 7m ago 68m 41.4M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:56:47.136 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (60m) 7m ago 64m 25.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:56:47.137 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (61m) 7m ago 64m 26.0M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:56:47.137 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (64m) 6m ago 64m 26.2M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:56:47.137 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (64m) 6m ago 64m 26.5M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:56:47.137 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (61m) 7m ago 70m 547M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:56:47.138 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (61m) 6m ago 68m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:56:47.138 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (61m) 7m ago 70m 242M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:56:47.138 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (60m) 6m ago 68m 117M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:56:47.138 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (68m) 7m ago 68m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:56:47.138 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (68m) 6m ago 68m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:56:47.139 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (59m) 7m ago 67m 271M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:56:47.139 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (59m) 7m ago 67m 291M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:56:47.139 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (58m) 7m ago 66m 243M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:56:47.139 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (58m) 6m ago 66m 312M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:56:47.140 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (57m) 6m ago 66m 265M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:56:47.140 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (57m) 6m ago 65m 255M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:56:47.140 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (67m) 7m ago 68m 58.9M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:56:47.141 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.139+0000 7f7a47c23700 1 -- 172.21.15.26:0/2404135611 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7a2c0640b0 msgr2=0x7f7a2c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:56:47.141 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.139+0000 7f7a47c23700 1 --2- 172.21.15.26:0/2404135611 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7a2c0640b0 0x7f7a2c066570 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f7a30004630 tx=0x7f7a30009b30).stop 2021-11-03T17:56:47.142 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.139+0000 7f7a47c23700 1 -- 172.21.15.26:0/2404135611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a400f55c0 msgr2=0x7f7a40109c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:56:47.142 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.139+0000 7f7a47c23700 1 --2- 172.21.15.26:0/2404135611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a400f55c0 0x7f7a40109c50 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7f7a3800c710 tx=0x7f7a38004d10).stop 2021-11-03T17:56:47.142 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.139+0000 7f7a47c23700 1 -- 172.21.15.26:0/2404135611 shutdown_connections 2021-11-03T17:56:47.142 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.139+0000 7f7a47c23700 1 --2- 172.21.15.26:0/2404135611 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7a2c0640b0 0x7f7a2c066570 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:47.143 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.139+0000 7f7a47c23700 1 --2- 172.21.15.26:0/2404135611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a400f55c0 0x7f7a40109c50 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:47.143 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.139+0000 7f7a47c23700 1 --2- 172.21.15.26:0/2404135611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a400f6860 0x7f7a4010c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:47.143 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.139+0000 7f7a47c23700 1 -- 172.21.15.26:0/2404135611 >> 172.21.15.26:0/2404135611 conn(0x7f7a400f0d40 msgr2=0x7f7a400fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:56:47.143 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.140+0000 7f7a47c23700 1 -- 172.21.15.26:0/2404135611 shutdown_connections 2021-11-03T17:56:47.144 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.140+0000 7f7a47c23700 1 -- 172.21.15.26:0/2404135611 wait complete. 2021-11-03T17:56:47.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:46 smithi026 ceph-mon[96795]: pgmap v1863: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:47.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.239+0000 7f3d14cfc700 1 -- 172.21.15.26:0/3713521713 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d100f66e0 msgr2=0x7f3d100f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:56:47.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.239+0000 7f3d14cfc700 1 --2- 172.21.15.26:0/3713521713 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d100f66e0 0x7f3d100f6b00 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7f3d080099e0 tx=0x7f3d08004d10).stop 2021-11-03T17:56:47.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.239+0000 7f3d14cfc700 1 -- 172.21.15.26:0/3713521713 shutdown_connections 2021-11-03T17:56:47.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.239+0000 7f3d14cfc700 1 --2- 172.21.15.26:0/3713521713 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d100f7980 0x7f3d100f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:47.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.239+0000 7f3d14cfc700 1 --2- 172.21.15.26:0/3713521713 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d100f66e0 0x7f3d100f6b00 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:47.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.239+0000 7f3d14cfc700 1 -- 172.21.15.26:0/3713521713 >> 172.21.15.26:0/3713521713 conn(0x7f3d100f1e40 msgr2=0x7f3d100f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:56:47.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.239+0000 7f3d14cfc700 1 -- 172.21.15.26:0/3713521713 shutdown_connections 2021-11-03T17:56:47.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.239+0000 7f3d14cfc700 1 -- 172.21.15.26:0/3713521713 wait complete. 2021-11-03T17:56:47.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.239+0000 7f3d14cfc700 1 Processor -- start 2021-11-03T17:56:47.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.240+0000 7f3d14cfc700 1 -- start start 2021-11-03T17:56:47.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.240+0000 7f3d14cfc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d100f66e0 0x7f3d101070d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:56:47.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.240+0000 7f3d14cfc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d100f7980 0x7f3d101075c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:56:47.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.240+0000 7f3d14cfc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d10107b70 con 0x7f3d100f7980 2021-11-03T17:56:47.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.240+0000 7f3d14cfc700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d10107cb0 con 0x7f3d100f66e0 2021-11-03T17:56:47.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.240+0000 7f3d0dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d100f7980 0x7f3d101075c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:56:47.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.240+0000 7f3d0dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d100f7980 0x7f3d101075c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57266/0 (socket says 172.21.15.26:57266) 2021-11-03T17:56:47.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.240+0000 7f3d0dd9b700 1 -- 172.21.15.26:0/2400796886 learned_addr learned my addr 172.21.15.26:0/2400796886 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:56:47.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.240+0000 7f3d0e59c700 1 --2- 172.21.15.26:0/2400796886 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d100f66e0 0x7f3d101070d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:56:47.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.240+0000 7f3d0dd9b700 1 -- 172.21.15.26:0/2400796886 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d100f66e0 msgr2=0x7f3d101070d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:56:47.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.240+0000 7f3d0dd9b700 1 --2- 172.21.15.26:0/2400796886 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d100f66e0 0x7f3d101070d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:47.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.240+0000 7f3d0dd9b700 1 -- 172.21.15.26:0/2400796886 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d08009640 con 0x7f3d100f7980 2021-11-03T17:56:47.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.240+0000 7f3d0e59c700 1 --2- 172.21.15.26:0/2400796886 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d100f66e0 0x7f3d101070d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:56:47.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.240+0000 7f3d0dd9b700 1 --2- 172.21.15.26:0/2400796886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d100f7980 0x7f3d101075c0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7f3cf80026d0 tx=0x7f3cf8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:56:47.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.240+0000 7f3d06ffd700 1 -- 172.21.15.26:0/2400796886 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cf8009320 con 0x7f3d100f7980 2021-11-03T17:56:47.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.240+0000 7f3d06ffd700 1 -- 172.21.15.26:0/2400796886 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3cf800f040 con 0x7f3d100f7980 2021-11-03T17:56:47.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.240+0000 7f3d14cfc700 1 -- 172.21.15.26:0/2400796886 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d10108650 con 0x7f3d100f7980 2021-11-03T17:56:47.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.240+0000 7f3d06ffd700 1 -- 172.21.15.26:0/2400796886 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cf80147e0 con 0x7f3d100f7980 2021-11-03T17:56:47.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.240+0000 7f3d14cfc700 1 -- 172.21.15.26:0/2400796886 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d10108b90 con 0x7f3d100f7980 2021-11-03T17:56:47.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.241+0000 7f3d14cfc700 1 -- 172.21.15.26:0/2400796886 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d10045ad0 con 0x7f3d100f7980 2021-11-03T17:56:47.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.242+0000 7f3d06ffd700 1 -- 172.21.15.26:0/2400796886 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f3cf8009480 con 0x7f3d100f7980 2021-11-03T17:56:47.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.242+0000 7f3d06ffd700 1 --2- 172.21.15.26:0/2400796886 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3cfc0640b0 0x7f3cfc066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:56:47.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.242+0000 7f3d06ffd700 1 -- 172.21.15.26:0/2400796886 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f3cf8080eb0 con 0x7f3d100f7980 2021-11-03T17:56:47.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.242+0000 7f3d0e59c700 1 --2- 172.21.15.26:0/2400796886 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3cfc0640b0 0x7f3cfc066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:56:47.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.243+0000 7f3d0e59c700 1 --2- 172.21.15.26:0/2400796886 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3cfc0640b0 0x7f3cfc066570 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f3d08009f50 tx=0x7f3d08004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:56:47.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.247+0000 7f3d06ffd700 1 -- 172.21.15.26:0/2400796886 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f3cf8053210 con 0x7f3d100f7980 2021-11-03T17:56:47.473 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.476+0000 7f3d14cfc700 1 -- 172.21.15.26:0/2400796886 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3d10027a00 con 0x7f3d100f7980 2021-11-03T17:56:47.474 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.477+0000 7f3d06ffd700 1 -- 172.21.15.26:0/2400796886 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f3cf8052e00 con 0x7f3d100f7980 2021-11-03T17:56:47.474 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:56:47.474 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:56:47.475 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:56:47.475 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:56:47.475 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:56:47.475 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:56:47.475 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:56:47.476 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:56:47.476 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:56:47.476 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:56:47.476 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:56:47.477 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:56:47.477 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:56:47.477 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:56:47.478 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:56:47.478 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:56:47.478 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:56:47.478 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:56:47.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.479+0000 7f3d14cfc700 1 -- 172.21.15.26:0/2400796886 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3cfc0640b0 msgr2=0x7f3cfc066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:56:47.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.479+0000 7f3d14cfc700 1 --2- 172.21.15.26:0/2400796886 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3cfc0640b0 0x7f3cfc066570 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f3d08009f50 tx=0x7f3d08004d10).stop 2021-11-03T17:56:47.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.479+0000 7f3d14cfc700 1 -- 172.21.15.26:0/2400796886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d100f7980 msgr2=0x7f3d101075c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:56:47.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.479+0000 7f3d14cfc700 1 --2- 172.21.15.26:0/2400796886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d100f7980 0x7f3d101075c0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7f3cf80026d0 tx=0x7f3cf8009de0).stop 2021-11-03T17:56:47.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.479+0000 7f3d14cfc700 1 -- 172.21.15.26:0/2400796886 shutdown_connections 2021-11-03T17:56:47.481 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.479+0000 7f3d14cfc700 1 --2- 172.21.15.26:0/2400796886 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3cfc0640b0 0x7f3cfc066570 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:47.481 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.479+0000 7f3d14cfc700 1 --2- 172.21.15.26:0/2400796886 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d100f66e0 0x7f3d101070d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:47.481 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.479+0000 7f3d14cfc700 1 --2- 172.21.15.26:0/2400796886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d100f7980 0x7f3d101075c0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:47.481 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.479+0000 7f3d14cfc700 1 -- 172.21.15.26:0/2400796886 >> 172.21.15.26:0/2400796886 conn(0x7f3d100f1e40 msgr2=0x7f3d100fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:56:47.481 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.479+0000 7f3d14cfc700 1 -- 172.21.15.26:0/2400796886 shutdown_connections 2021-11-03T17:56:47.482 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.479+0000 7f3d14cfc700 1 -- 172.21.15.26:0/2400796886 wait complete. 2021-11-03T17:56:47.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.580+0000 7fee81637700 1 -- 172.21.15.26:0/1719780627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee7c0f7980 msgr2=0x7fee7c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:56:47.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.580+0000 7fee81637700 1 --2- 172.21.15.26:0/1719780627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee7c0f7980 0x7fee7c0f7de0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 rx=0x7fee70004660 tx=0x7fee70009b30).stop 2021-11-03T17:56:47.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.580+0000 7fee81637700 1 -- 172.21.15.26:0/1719780627 shutdown_connections 2021-11-03T17:56:47.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.580+0000 7fee81637700 1 --2- 172.21.15.26:0/1719780627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee7c0f7980 0x7fee7c0f7de0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:47.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.580+0000 7fee81637700 1 --2- 172.21.15.26:0/1719780627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee7c0f66e0 0x7fee7c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:47.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.580+0000 7fee81637700 1 -- 172.21.15.26:0/1719780627 >> 172.21.15.26:0/1719780627 conn(0x7fee7c0f1e40 msgr2=0x7fee7c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:56:47.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.580+0000 7fee81637700 1 -- 172.21.15.26:0/1719780627 shutdown_connections 2021-11-03T17:56:47.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.580+0000 7fee81637700 1 -- 172.21.15.26:0/1719780627 wait complete. 2021-11-03T17:56:47.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.581+0000 7fee81637700 1 Processor -- start 2021-11-03T17:56:47.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.581+0000 7fee81637700 1 -- start start 2021-11-03T17:56:47.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.581+0000 7fee81637700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee7c0f66e0 0x7fee7c106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:56:47.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.581+0000 7fee81637700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee7c0f7980 0x7fee7c107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:56:47.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.581+0000 7fee81637700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c107a00 con 0x7fee7c0f7980 2021-11-03T17:56:47.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.581+0000 7fee81637700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c107b40 con 0x7fee7c0f66e0 2021-11-03T17:56:47.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.581+0000 7fee7a7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee7c0f7980 0x7fee7c107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:56:47.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.581+0000 7fee7a7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee7c0f7980 0x7fee7c107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57276/0 (socket says 172.21.15.26:57276) 2021-11-03T17:56:47.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.581+0000 7fee7a7fc700 1 -- 172.21.15.26:0/553837356 learned_addr learned my addr 172.21.15.26:0/553837356 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:56:47.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.581+0000 7fee7a7fc700 1 -- 172.21.15.26:0/553837356 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee7c0f66e0 msgr2=0x7fee7c106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:56:47.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.581+0000 7fee7a7fc700 1 --2- 172.21.15.26:0/553837356 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee7c0f66e0 0x7fee7c106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:56:47.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.581+0000 7fee7a7fc700 1 -- 172.21.15.26:0/553837356 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee70005040 con 0x7fee7c0f7980 2021-11-03T17:56:47.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.582+0000 7fee7a7fc700 1 --2- 172.21.15.26:0/553837356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee7c0f7980 0x7fee7c107450 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7fee70009830 tx=0x7fee70009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:56:47.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.582+0000 7fee637fe700 1 -- 172.21.15.26:0/553837356 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee70018070 con 0x7fee7c0f7980 2021-11-03T17:56:47.584 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.582+0000 7fee637fe700 1 -- 172.21.15.26:0/553837356 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fee70007ba0 con 0x7fee7c0f7980 2021-11-03T17:56:47.584 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.582+0000 7fee637fe700 1 -- 172.21.15.26:0/553837356 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee7001c620 con 0x7fee7c0f7980 2021-11-03T17:56:47.584 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.582+0000 7fee81637700 1 -- 172.21.15.26:0/553837356 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee7c108480 con 0x7fee7c0f7980 2021-11-03T17:56:47.584 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.582+0000 7fee81637700 1 -- 172.21.15.26:0/553837356 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee7c1089e0 con 0x7fee7c0f7980 2021-11-03T17:56:47.585 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.583+0000 7fee81637700 1 -- 172.21.15.26:0/553837356 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee7c045ad0 con 0x7fee7c0f7980 2021-11-03T17:56:47.585 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.583+0000 7fee637fe700 1 -- 172.21.15.26:0/553837356 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fee7001d420 con 0x7fee7c0f7980 2021-11-03T17:56:47.585 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.584+0000 7fee637fe700 1 --2- 172.21.15.26:0/553837356 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fee64064090 0x7fee64066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:56:47.585 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.584+0000 7fee637fe700 1 -- 172.21.15.26:0/553837356 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fee70082560 con 0x7fee7c0f7980 2021-11-03T17:56:47.585 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.584+0000 7fee7affd700 1 --2- 172.21.15.26:0/553837356 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fee64064090 0x7fee64066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:56:47.586 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.584+0000 7fee7affd700 1 --2- 172.21.15.26:0/553837356 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fee64064090 0x7fee64066550 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7fee7c0f77e0 tx=0x7fee74004b00).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:56:47.586 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.588+0000 7fee637fe700 1 -- 172.21.15.26:0/553837356 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fee70054980 con 0x7fee7c0f7980 2021-11-03T17:56:47.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.795+0000 7fee81637700 1 -- 172.21.15.26:0/553837356 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fee7c0fef70 con 0x7fee7c0f7980 2021-11-03T17:56:47.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.795+0000 7fee637fe700 1 -- 172.21.15.26:0/553837356 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fee70054570 con 0x7fee7c0f7980 2021-11-03T17:56:47.791 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:56:47.792 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:56:47.792 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:56:47.792 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:56:47.792 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:56:47.793 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:56:47.793 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:56:47.793 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:56:47.793 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:56:47.793 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:56:47.794 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:56:47.794 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:56:47.794 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:56:47.794 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:56:47.795 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:56:47.795 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:56:47.795 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:56:47.795 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:56:47.795 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:56:47.796 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:56:47.796 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:56:47.796 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:56:47.796 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:56:47.796 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:56:47.797 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:56:47.797 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:56:47.797 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:56:47.797 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:56:47.797 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:56:47.798 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:56:47.798 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:56:47.798 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:56:47.798 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:56:47.799 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:56:47.799 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:56:47.799 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:56:47.799 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:56:47.800 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:56:47.800 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:56:47.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.797+0000 7fee81637700 1 -- 172.21.15.26:0/553837356 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fee64064090 msgr2=0x7fee64066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:56:47.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.797+0000 7fee81637700 1 --2- 172.21.15.26:0/553837356 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fee64064090 0x7fee64066550 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7fee7c0f77e0 tx=0x7fee74004b00).stop 2021-11-03T17:56:47.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.797+0000 7fee81637700 1 -- 172.21.15.26:0/553837356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee7c0f7980 msgr2=0x7fee7c107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:56:47.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.797+0000 7fee81637700 1 --2- 172.21.15.26:0/553837356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee7c0f7980 0x7fee7c107450 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7fee70009830 tx=0x7fee70009b30).stop 2021-11-03T17:56:47.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.797+0000 7fee81637700 1 -- 172.21.15.26:0/553837356 shutdown_connections 2021-11-03T17:56:47.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.797+0000 7fee81637700 1 --2- 172.21.15.26:0/553837356 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fee64064090 0x7fee64066550 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:47.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.797+0000 7fee81637700 1 --2- 172.21.15.26:0/553837356 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee7c0f66e0 0x7fee7c106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:56:47.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.797+0000 7fee81637700 1 --2- 172.21.15.26:0/553837356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee7c0f7980 0x7fee7c107450 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:56:47.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.797+0000 7fee81637700 1 -- 172.21.15.26:0/553837356 >> 172.21.15.26:0/553837356 conn(0x7fee7c0f1e40 msgr2=0x7fee7c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:56:47.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.797+0000 7fee81637700 1 -- 172.21.15.26:0/553837356 shutdown_connections 2021-11-03T17:56:47.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:56:47.797+0000 7fee81637700 1 -- 172.21.15.26:0/553837356 wait complete. 2021-11-03T17:56:47.803 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:56:47.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:47 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2400796886' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:56:48.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:47 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2400796886' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:56:48.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:48 smithi194 ceph-mon[65619]: from='client.36060 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:56:49.029 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:48 smithi194 ceph-mon[65619]: from='client.36064 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:56:49.029 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:48 smithi194 ceph-mon[65619]: pgmap v1864: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:49.029 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:48 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/553837356' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:56:49.030 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:56:49.030 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:56:49.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:48 smithi026 ceph-mon[96795]: from='client.36060 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:56:49.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:48 smithi026 ceph-mon[96795]: from='client.36064 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:56:49.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:48 smithi026 ceph-mon[96795]: pgmap v1864: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:49.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:48 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/553837356' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:56:49.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:56:49.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:56:50.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:50 smithi194 ceph-mon[65619]: pgmap v1865: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:51.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:50 smithi026 ceph-mon[96795]: pgmap v1865: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:52.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:52 smithi194 ceph-mon[65619]: pgmap v1866: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:53.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:52 smithi026 ceph-mon[96795]: pgmap v1866: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:54.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:54 smithi194 ceph-mon[65619]: pgmap v1867: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:55.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:54 smithi026 ceph-mon[96795]: pgmap v1867: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:57.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:56 smithi026 ceph-mon[96795]: pgmap v1868: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:57.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:56 smithi194 ceph-mon[65619]: pgmap v1868: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:59.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:58 smithi026 ceph-mon[96795]: pgmap v1869: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:59.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:58 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:56:59.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:58 smithi194 ceph-mon[65619]: pgmap v1869: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:56:59.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:58 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:57:00.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:56:59 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:57:00.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:56:59 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:57:01.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:00 smithi026 ceph-mon[96795]: pgmap v1870: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:01.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:00 smithi194 ceph-mon[65619]: pgmap v1870: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:03.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:02 smithi026 ceph-mon[96795]: pgmap v1871: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:03.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:02 smithi194 ceph-mon[65619]: pgmap v1871: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:05.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:04 smithi026 ceph-mon[96795]: pgmap v1872: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:05.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:04 smithi194 ceph-mon[65619]: pgmap v1872: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:07.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:06 smithi026 ceph-mon[96795]: pgmap v1873: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:07.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:06 smithi194 ceph-mon[65619]: pgmap v1873: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:09.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:08 smithi026 ceph-mon[96795]: pgmap v1874: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:09.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:08 smithi194 ceph-mon[65619]: pgmap v1874: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:11.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:10 smithi026 ceph-mon[96795]: pgmap v1875: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:11.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:10 smithi194 ceph-mon[65619]: pgmap v1875: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:13.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:12 smithi026 ceph-mon[96795]: pgmap v1876: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:13.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:12 smithi194 ceph-mon[65619]: pgmap v1876: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:14.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:13 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:57:14.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:13 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:57:15.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:14 smithi026 ceph-mon[96795]: pgmap v1877: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:15.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:14 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:57:15.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:14 smithi194 ceph-mon[65619]: pgmap v1877: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:15.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:14 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:57:17.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:16 smithi026 ceph-mon[96795]: pgmap v1878: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:17.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:16 smithi194 ceph-mon[65619]: pgmap v1878: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:17.910 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:17.912+0000 7f4952148700 1 -- 172.21.15.26:0/157593065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f494c0f8610 msgr2=0x7f494c0f4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:57:17.910 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:17.912+0000 7f4952148700 1 --2- 172.21.15.26:0/157593065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f494c0f8610 0x7f494c0f4820 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7f4934004660 tx=0x7f4934009b30).stop 2021-11-03T17:57:17.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:17.912+0000 7f4952148700 1 -- 172.21.15.26:0/157593065 shutdown_connections 2021-11-03T17:57:17.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:17.912+0000 7f4952148700 1 --2- 172.21.15.26:0/157593065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f494c0f8610 0x7f494c0f4820 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:17.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:17.912+0000 7f4952148700 1 --2- 172.21.15.26:0/157593065 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f494c0f7d00 0x7f494c0f8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:57:17.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:17.912+0000 7f4952148700 1 -- 172.21.15.26:0/157593065 >> 172.21.15.26:0/157593065 conn(0x7f494c0f0540 msgr2=0x7f494c0f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:57:17.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:17.912+0000 7f4952148700 1 -- 172.21.15.26:0/157593065 shutdown_connections 2021-11-03T17:57:17.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:17.912+0000 7f4952148700 1 -- 172.21.15.26:0/157593065 wait complete. 2021-11-03T17:57:17.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:17.912+0000 7f4952148700 1 Processor -- start 2021-11-03T17:57:17.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:17.913+0000 7f4952148700 1 -- start start 2021-11-03T17:57:17.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:17.913+0000 7f4952148700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f494c0f7d00 0x7f494c0f75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:57:17.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:17.913+0000 7f4952148700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f494c0f8610 0x7f494c0f5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:57:17.913 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:17.913+0000 7f4952148700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c0f6040 con 0x7f494c0f7d00 2021-11-03T17:57:17.913 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:17.913+0000 7f4952148700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c0f6180 con 0x7f494c0f8610 2021-11-03T17:57:17.913 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:17.913+0000 7f494b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f494c0f7d00 0x7f494c0f75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:57:17.913 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:17.913+0000 7f494b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f494c0f7d00 0x7f494c0f75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57294/0 (socket says 172.21.15.26:57294) 2021-11-03T17:57:17.914 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:17.913+0000 7f494b7fe700 1 -- 172.21.15.26:0/2883209783 learned_addr learned my addr 172.21.15.26:0/2883209783 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:57:17.914 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:17.913+0000 7f494affd700 1 --2- 172.21.15.26:0/2883209783 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f494c0f8610 0x7f494c0f5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:57:17.914 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:17.913+0000 7f494b7fe700 1 -- 172.21.15.26:0/2883209783 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f494c0f8610 msgr2=0x7f494c0f5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:57:17.914 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:17.913+0000 7f494b7fe700 1 --2- 172.21.15.26:0/2883209783 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f494c0f8610 0x7f494c0f5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:17.914 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:17.913+0000 7f494b7fe700 1 -- 172.21.15.26:0/2883209783 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4934005040 con 0x7f494c0f7d00 2021-11-03T17:57:17.915 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:17.914+0000 7f494b7fe700 1 --2- 172.21.15.26:0/2883209783 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f494c0f7d00 0x7f494c0f75d0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7f494400b790 tx=0x7f49440092d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:57:17.915 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:17.914+0000 7f4943fff700 1 -- 172.21.15.26:0/2883209783 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f494400d680 con 0x7f494c0f7d00 2021-11-03T17:57:17.915 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:17.914+0000 7f4943fff700 1 -- 172.21.15.26:0/2883209783 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f494400dc90 con 0x7f494c0f7d00 2021-11-03T17:57:17.915 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:17.914+0000 7f4952148700 1 -- 172.21.15.26:0/2883209783 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f494c0f6460 con 0x7f494c0f7d00 2021-11-03T17:57:17.916 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:17.914+0000 7f4943fff700 1 -- 172.21.15.26:0/2883209783 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4944010d40 con 0x7f494c0f7d00 2021-11-03T17:57:17.916 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:17.914+0000 7f4952148700 1 -- 172.21.15.26:0/2883209783 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f494c10ef80 con 0x7f494c0f7d00 2021-11-03T17:57:17.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:17.915+0000 7f4952148700 1 -- 172.21.15.26:0/2883209783 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f494c045ad0 con 0x7f494c0f7d00 2021-11-03T17:57:17.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:17.915+0000 7f4943fff700 1 -- 172.21.15.26:0/2883209783 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f494400f070 con 0x7f494c0f7d00 2021-11-03T17:57:17.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:17.916+0000 7f4943fff700 1 --2- 172.21.15.26:0/2883209783 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f49380640b0 0x7f4938066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:57:17.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:17.916+0000 7f4943fff700 1 -- 172.21.15.26:0/2883209783 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f49440806a0 con 0x7f494c0f7d00 2021-11-03T17:57:17.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:17.916+0000 7f494affd700 1 --2- 172.21.15.26:0/2883209783 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f49380640b0 0x7f4938066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:57:17.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:17.916+0000 7f494affd700 1 --2- 172.21.15.26:0/2883209783 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f49380640b0 0x7f4938066570 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f4934004630 tx=0x7f4934009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:57:17.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:17.920+0000 7f4943fff700 1 -- 172.21.15.26:0/2883209783 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f4944052910 con 0x7f494c0f7d00 2021-11-03T17:57:18.096 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.100+0000 7f4952148700 1 -- 172.21.15.26:0/2883209783 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f494c0008d0 con 0x7f49380640b0 2021-11-03T17:57:18.098 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.103+0000 7f4943fff700 1 -- 172.21.15.26:0/2883209783 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f494c0008d0 con 0x7f49380640b0 2021-11-03T17:57:18.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.105+0000 7f4952148700 1 -- 172.21.15.26:0/2883209783 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f49380640b0 msgr2=0x7f4938066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:57:18.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.105+0000 7f4952148700 1 --2- 172.21.15.26:0/2883209783 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f49380640b0 0x7f4938066570 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f4934004630 tx=0x7f4934009b30).stop 2021-11-03T17:57:18.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.105+0000 7f4952148700 1 -- 172.21.15.26:0/2883209783 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f494c0f7d00 msgr2=0x7f494c0f75d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:57:18.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.105+0000 7f4952148700 1 --2- 172.21.15.26:0/2883209783 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f494c0f7d00 0x7f494c0f75d0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7f494400b790 tx=0x7f49440092d0).stop 2021-11-03T17:57:18.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.105+0000 7f4952148700 1 -- 172.21.15.26:0/2883209783 shutdown_connections 2021-11-03T17:57:18.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.105+0000 7f4952148700 1 --2- 172.21.15.26:0/2883209783 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f49380640b0 0x7f4938066570 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:18.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.105+0000 7f4952148700 1 --2- 172.21.15.26:0/2883209783 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f494c0f7d00 0x7f494c0f75d0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:18.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.105+0000 7f4952148700 1 --2- 172.21.15.26:0/2883209783 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f494c0f8610 0x7f494c0f5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:18.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.105+0000 7f4952148700 1 -- 172.21.15.26:0/2883209783 >> 172.21.15.26:0/2883209783 conn(0x7f494c0f0540 msgr2=0x7f494c0fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:57:18.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.105+0000 7f4952148700 1 -- 172.21.15.26:0/2883209783 shutdown_connections 2021-11-03T17:57:18.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.105+0000 7f4952148700 1 -- 172.21.15.26:0/2883209783 wait complete. 2021-11-03T17:57:18.111 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:57:18.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.205+0000 7f2a21094700 1 -- 172.21.15.26:0/3880827073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a1c0f4bc0 msgr2=0x7f2a1c0f4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:57:18.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.205+0000 7f2a21094700 1 --2- 172.21.15.26:0/3880827073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a1c0f4bc0 0x7f2a1c0f4fe0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 rx=0x7f2a0c004660 tx=0x7f2a0c009b30).stop 2021-11-03T17:57:18.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.205+0000 7f2a21094700 1 -- 172.21.15.26:0/3880827073 shutdown_connections 2021-11-03T17:57:18.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.205+0000 7f2a21094700 1 --2- 172.21.15.26:0/3880827073 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a1c0f5e60 0x7f2a1c0f62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:18.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.205+0000 7f2a21094700 1 --2- 172.21.15.26:0/3880827073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a1c0f4bc0 0x7f2a1c0f4fe0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:18.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.205+0000 7f2a21094700 1 -- 172.21.15.26:0/3880827073 >> 172.21.15.26:0/3880827073 conn(0x7f2a1c0f0320 msgr2=0x7f2a1c0f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:57:18.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.205+0000 7f2a21094700 1 -- 172.21.15.26:0/3880827073 shutdown_connections 2021-11-03T17:57:18.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.205+0000 7f2a21094700 1 -- 172.21.15.26:0/3880827073 wait complete. 2021-11-03T17:57:18.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.206+0000 7f2a21094700 1 Processor -- start 2021-11-03T17:57:18.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.206+0000 7f2a21094700 1 -- start start 2021-11-03T17:57:18.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.206+0000 7f2a21094700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a1c0f4bc0 0x7f2a1c109aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:57:18.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.206+0000 7f2a21094700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a1c0f5e60 0x7f2a1c10bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:57:18.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.206+0000 7f2a21094700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1c0f7e40 con 0x7f2a1c0f4bc0 2021-11-03T17:57:18.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.206+0000 7f2a21094700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1c0f7f80 con 0x7f2a1c0f5e60 2021-11-03T17:57:18.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.206+0000 7f2a1bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a1c0f4bc0 0x7f2a1c109aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:57:18.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.206+0000 7f2a1bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a1c0f4bc0 0x7f2a1c109aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57304/0 (socket says 172.21.15.26:57304) 2021-11-03T17:57:18.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.206+0000 7f2a1bfff700 1 -- 172.21.15.26:0/1213448976 learned_addr learned my addr 172.21.15.26:0/1213448976 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:57:18.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.207+0000 7f2a1bfff700 1 -- 172.21.15.26:0/1213448976 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a1c0f5e60 msgr2=0x7f2a1c10bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:57:18.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.207+0000 7f2a1b7fe700 1 --2- 172.21.15.26:0/1213448976 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a1c0f5e60 0x7f2a1c10bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:57:18.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.207+0000 7f2a1bfff700 1 --2- 172.21.15.26:0/1213448976 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a1c0f5e60 0x7f2a1c10bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:18.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.207+0000 7f2a1bfff700 1 -- 172.21.15.26:0/1213448976 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a0c005040 con 0x7f2a1c0f4bc0 2021-11-03T17:57:18.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.207+0000 7f2a1b7fe700 1 --2- 172.21.15.26:0/1213448976 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a1c0f5e60 0x7f2a1c10bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:57:18.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.207+0000 7f2a1bfff700 1 --2- 172.21.15.26:0/1213448976 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a1c0f4bc0 0x7f2a1c109aa0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7f2a0c004f60 tx=0x7f2a0c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:57:18.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.207+0000 7f2a18ff9700 1 -- 172.21.15.26:0/1213448976 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a0c018070 con 0x7f2a1c0f4bc0 2021-11-03T17:57:18.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.207+0000 7f2a18ff9700 1 -- 172.21.15.26:0/1213448976 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2a0c007ba0 con 0x7f2a1c0f4bc0 2021-11-03T17:57:18.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.207+0000 7f2a21094700 1 -- 172.21.15.26:0/1213448976 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a1c10c4f0 con 0x7f2a1c0f4bc0 2021-11-03T17:57:18.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.207+0000 7f2a18ff9700 1 -- 172.21.15.26:0/1213448976 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a0c01c620 con 0x7f2a1c0f4bc0 2021-11-03T17:57:18.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.207+0000 7f2a21094700 1 -- 172.21.15.26:0/1213448976 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a1c10ca50 con 0x7f2a1c0f4bc0 2021-11-03T17:57:18.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.208+0000 7f2a21094700 1 -- 172.21.15.26:0/1213448976 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a1c045ad0 con 0x7f2a1c0f4bc0 2021-11-03T17:57:18.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.208+0000 7f2a18ff9700 1 -- 172.21.15.26:0/1213448976 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f2a0c01c8e0 con 0x7f2a1c0f4bc0 2021-11-03T17:57:18.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.209+0000 7f2a18ff9700 1 --2- 172.21.15.26:0/1213448976 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2a04064100 0x7f2a040665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:57:18.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.209+0000 7f2a18ff9700 1 -- 172.21.15.26:0/1213448976 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f2a0c0826c0 con 0x7f2a1c0f4bc0 2021-11-03T17:57:18.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.209+0000 7f2a1b7fe700 1 --2- 172.21.15.26:0/1213448976 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2a04064100 0x7f2a040665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:57:18.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.209+0000 7f2a1b7fe700 1 --2- 172.21.15.26:0/1213448976 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2a04064100 0x7f2a040665c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f2a100041d0 tx=0x7f2a10009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:57:18.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.213+0000 7f2a18ff9700 1 -- 172.21.15.26:0/1213448976 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f2a0c054a20 con 0x7f2a1c0f4bc0 2021-11-03T17:57:18.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.388+0000 7f2a21094700 1 -- 172.21.15.26:0/1213448976 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a1c0fa8b0 con 0x7f2a04064100 2021-11-03T17:57:18.398 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.402+0000 7f2a18ff9700 1 -- 172.21.15.26:0/1213448976 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f2a1c0fa8b0 con 0x7f2a04064100 2021-11-03T17:57:18.399 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:57:18.399 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (68m) 7m ago 69m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:57:18.399 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (60m) 7m ago 69m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:57:18.400 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (60m) 6m ago 69m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:57:18.400 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (68m) 7m ago 69m 41.4M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:57:18.400 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (61m) 7m ago 64m 25.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:57:18.400 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (61m) 7m ago 64m 26.0M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:57:18.400 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (64m) 6m ago 64m 26.2M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:57:18.401 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (64m) 6m ago 64m 26.5M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:57:18.401 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (62m) 7m ago 71m 547M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:57:18.401 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (61m) 6m ago 68m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:57:18.401 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (61m) 7m ago 71m 242M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:57:18.401 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (61m) 6m ago 68m 117M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:57:18.402 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (69m) 7m ago 69m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:57:18.402 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (68m) 6m ago 68m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:57:18.402 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (60m) 7m ago 68m 271M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:57:18.402 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (59m) 7m ago 67m 291M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:57:18.403 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (59m) 7m ago 67m 243M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:57:18.403 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (58m) 6m ago 67m 312M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:57:18.403 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (58m) 6m ago 66m 265M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:57:18.403 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (57m) 6m ago 66m 255M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:57:18.403 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (68m) 7m ago 69m 58.9M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:57:18.404 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.404+0000 7f2a21094700 1 -- 172.21.15.26:0/1213448976 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2a04064100 msgr2=0x7f2a040665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:57:18.405 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.404+0000 7f2a21094700 1 --2- 172.21.15.26:0/1213448976 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2a04064100 0x7f2a040665c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f2a100041d0 tx=0x7f2a10009040).stop 2021-11-03T17:57:18.405 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.404+0000 7f2a21094700 1 -- 172.21.15.26:0/1213448976 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a1c0f4bc0 msgr2=0x7f2a1c109aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:57:18.405 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.404+0000 7f2a21094700 1 --2- 172.21.15.26:0/1213448976 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a1c0f4bc0 0x7f2a1c109aa0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7f2a0c004f60 tx=0x7f2a0c009b30).stop 2021-11-03T17:57:18.405 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.404+0000 7f2a21094700 1 -- 172.21.15.26:0/1213448976 shutdown_connections 2021-11-03T17:57:18.406 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.404+0000 7f2a21094700 1 --2- 172.21.15.26:0/1213448976 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2a04064100 0x7f2a040665c0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:18.406 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.404+0000 7f2a21094700 1 --2- 172.21.15.26:0/1213448976 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a1c0f4bc0 0x7f2a1c109aa0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:18.406 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.404+0000 7f2a21094700 1 --2- 172.21.15.26:0/1213448976 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a1c0f5e60 0x7f2a1c10bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:18.406 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.404+0000 7f2a21094700 1 -- 172.21.15.26:0/1213448976 >> 172.21.15.26:0/1213448976 conn(0x7f2a1c0f0320 msgr2=0x7f2a1c0fa1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:57:18.406 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.404+0000 7f2a21094700 1 -- 172.21.15.26:0/1213448976 shutdown_connections 2021-11-03T17:57:18.407 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.404+0000 7f2a21094700 1 -- 172.21.15.26:0/1213448976 wait complete. 2021-11-03T17:57:18.502 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.505+0000 7f5a608aa700 1 -- 172.21.15.26:0/2214135404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a5c0f55e0 msgr2=0x7f5a5c0f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:57:18.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.505+0000 7f5a608aa700 1 --2- 172.21.15.26:0/2214135404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a5c0f55e0 0x7f5a5c0f5a00 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7f5a4c004660 tx=0x7f5a4c009b30).stop 2021-11-03T17:57:18.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.505+0000 7f5a608aa700 1 -- 172.21.15.26:0/2214135404 shutdown_connections 2021-11-03T17:57:18.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.505+0000 7f5a608aa700 1 --2- 172.21.15.26:0/2214135404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a5c0f5ef0 0x7f5a5c0f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:18.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.505+0000 7f5a608aa700 1 --2- 172.21.15.26:0/2214135404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a5c0f55e0 0x7f5a5c0f5a00 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:18.504 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.505+0000 7f5a608aa700 1 -- 172.21.15.26:0/2214135404 >> 172.21.15.26:0/2214135404 conn(0x7f5a5c0f0de0 msgr2=0x7f5a5c0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:57:18.504 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.505+0000 7f5a608aa700 1 -- 172.21.15.26:0/2214135404 shutdown_connections 2021-11-03T17:57:18.504 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.505+0000 7f5a608aa700 1 -- 172.21.15.26:0/2214135404 wait complete. 2021-11-03T17:57:18.504 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.505+0000 7f5a608aa700 1 Processor -- start 2021-11-03T17:57:18.504 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.505+0000 7f5a608aa700 1 -- start start 2021-11-03T17:57:18.505 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.505+0000 7f5a608aa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a5c0f55e0 0x7f5a5c106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:57:18.505 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.505+0000 7f5a608aa700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a5c0f5ef0 0x7f5a5c107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:57:18.505 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.505+0000 7f5a608aa700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c107a10 con 0x7f5a5c0f55e0 2021-11-03T17:57:18.505 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.505+0000 7f5a608aa700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c107b50 con 0x7f5a5c0f5ef0 2021-11-03T17:57:18.506 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.505+0000 7f5a5a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a5c0f55e0 0x7f5a5c106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:57:18.506 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.506+0000 7f5a5a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a5c0f55e0 0x7f5a5c106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57314/0 (socket says 172.21.15.26:57314) 2021-11-03T17:57:18.506 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.506+0000 7f5a5a59c700 1 -- 172.21.15.26:0/2171517257 learned_addr learned my addr 172.21.15.26:0/2171517257 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:57:18.506 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.506+0000 7f5a5a59c700 1 -- 172.21.15.26:0/2171517257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a5c0f5ef0 msgr2=0x7f5a5c107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:57:18.507 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.506+0000 7f5a5a59c700 1 --2- 172.21.15.26:0/2171517257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a5c0f5ef0 0x7f5a5c107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:57:18.507 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.506+0000 7f5a5a59c700 1 -- 172.21.15.26:0/2171517257 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4c005040 con 0x7f5a5c0f55e0 2021-11-03T17:57:18.507 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.506+0000 7f5a5a59c700 1 --2- 172.21.15.26:0/2171517257 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a5c0f55e0 0x7f5a5c106f70 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7f5a4c009990 tx=0x7f5a4c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:57:18.507 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.506+0000 7f5a52ffd700 1 -- 172.21.15.26:0/2171517257 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a4c018070 con 0x7f5a5c0f55e0 2021-11-03T17:57:18.508 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.506+0000 7f5a52ffd700 1 -- 172.21.15.26:0/2171517257 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5a4c007ca0 con 0x7f5a5c0f55e0 2021-11-03T17:57:18.508 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.506+0000 7f5a608aa700 1 -- 172.21.15.26:0/2171517257 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a5c108490 con 0x7f5a5c0f55e0 2021-11-03T17:57:18.508 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.506+0000 7f5a52ffd700 1 -- 172.21.15.26:0/2171517257 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a4c01c620 con 0x7f5a5c0f55e0 2021-11-03T17:57:18.508 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.506+0000 7f5a608aa700 1 -- 172.21.15.26:0/2171517257 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a5c1089f0 con 0x7f5a5c0f55e0 2021-11-03T17:57:18.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.507+0000 7f5a608aa700 1 -- 172.21.15.26:0/2171517257 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a5c045ad0 con 0x7f5a5c0f55e0 2021-11-03T17:57:18.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.508+0000 7f5a52ffd700 1 -- 172.21.15.26:0/2171517257 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f5a4c01d960 con 0x7f5a5c0f55e0 2021-11-03T17:57:18.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.508+0000 7f5a52ffd700 1 --2- 172.21.15.26:0/2171517257 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5a480640b0 0x7f5a48066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:57:18.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.508+0000 7f5a52ffd700 1 -- 172.21.15.26:0/2171517257 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f5a4c082480 con 0x7f5a5c0f55e0 2021-11-03T17:57:18.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.508+0000 7f5a53fff700 1 --2- 172.21.15.26:0/2171517257 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5a480640b0 0x7f5a48066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:57:18.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.509+0000 7f5a53fff700 1 --2- 172.21.15.26:0/2171517257 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5a480640b0 0x7f5a48066570 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f5a440047d0 tx=0x7f5a44007a40).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:57:18.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.512+0000 7f5a52ffd700 1 -- 172.21.15.26:0/2171517257 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f5a4c0548a0 con 0x7f5a5c0f55e0 2021-11-03T17:57:18.736 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.741+0000 7f5a608aa700 1 -- 172.21.15.26:0/2171517257 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5a5c10d590 con 0x7f5a5c0f55e0 2021-11-03T17:57:18.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.741+0000 7f5a52ffd700 1 -- 172.21.15.26:0/2171517257 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f5a4c054490 con 0x7f5a5c0f55e0 2021-11-03T17:57:18.738 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:57:18.738 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:57:18.738 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:57:18.738 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:57:18.739 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:57:18.739 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:57:18.739 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:57:18.739 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:57:18.739 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:57:18.740 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:57:18.740 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:57:18.740 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:57:18.740 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:57:18.741 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:57:18.741 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:57:18.741 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:57:18.742 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:57:18.742 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:57:18.743 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.743+0000 7f5a608aa700 1 -- 172.21.15.26:0/2171517257 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5a480640b0 msgr2=0x7f5a48066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:57:18.744 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.743+0000 7f5a608aa700 1 --2- 172.21.15.26:0/2171517257 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5a480640b0 0x7f5a48066570 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f5a440047d0 tx=0x7f5a44007a40).stop 2021-11-03T17:57:18.744 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.743+0000 7f5a608aa700 1 -- 172.21.15.26:0/2171517257 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a5c0f55e0 msgr2=0x7f5a5c106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:57:18.744 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.743+0000 7f5a608aa700 1 --2- 172.21.15.26:0/2171517257 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a5c0f55e0 0x7f5a5c106f70 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7f5a4c009990 tx=0x7f5a4c009b30).stop 2021-11-03T17:57:18.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.743+0000 7f5a608aa700 1 -- 172.21.15.26:0/2171517257 shutdown_connections 2021-11-03T17:57:18.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.743+0000 7f5a608aa700 1 --2- 172.21.15.26:0/2171517257 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5a480640b0 0x7f5a48066570 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:18.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.743+0000 7f5a608aa700 1 --2- 172.21.15.26:0/2171517257 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a5c0f55e0 0x7f5a5c106f70 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:18.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.743+0000 7f5a608aa700 1 --2- 172.21.15.26:0/2171517257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a5c0f5ef0 0x7f5a5c107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:57:18.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.743+0000 7f5a608aa700 1 -- 172.21.15.26:0/2171517257 >> 172.21.15.26:0/2171517257 conn(0x7f5a5c0f0de0 msgr2=0x7f5a5c05f720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:57:18.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.743+0000 7f5a608aa700 1 -- 172.21.15.26:0/2171517257 shutdown_connections 2021-11-03T17:57:18.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.743+0000 7f5a608aa700 1 -- 172.21.15.26:0/2171517257 wait complete. 2021-11-03T17:57:18.845 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.844+0000 7f85cbc08700 1 -- 172.21.15.26:0/1364521566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85c40f66e0 msgr2=0x7f85c40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:57:18.845 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.844+0000 7f85cbc08700 1 --2- 172.21.15.26:0/1364521566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85c40f66e0 0x7f85c40f6b00 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 rx=0x7f85c0004660 tx=0x7f85c0009b30).stop 2021-11-03T17:57:18.846 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.844+0000 7f85cbc08700 1 -- 172.21.15.26:0/1364521566 shutdown_connections 2021-11-03T17:57:18.846 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.844+0000 7f85cbc08700 1 --2- 172.21.15.26:0/1364521566 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85c40f7980 0x7f85c40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:18.846 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.844+0000 7f85cbc08700 1 --2- 172.21.15.26:0/1364521566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85c40f66e0 0x7f85c40f6b00 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:18.847 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.844+0000 7f85cbc08700 1 -- 172.21.15.26:0/1364521566 >> 172.21.15.26:0/1364521566 conn(0x7f85c40f1e40 msgr2=0x7f85c40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:57:18.847 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.844+0000 7f85cbc08700 1 -- 172.21.15.26:0/1364521566 shutdown_connections 2021-11-03T17:57:18.847 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.844+0000 7f85cbc08700 1 -- 172.21.15.26:0/1364521566 wait complete. 2021-11-03T17:57:18.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.844+0000 7f85cbc08700 1 Processor -- start 2021-11-03T17:57:18.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.845+0000 7f85cbc08700 1 -- start start 2021-11-03T17:57:18.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.845+0000 7f85cbc08700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85c40f66e0 0x7f85c4106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:57:18.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.845+0000 7f85cbc08700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85c40f7980 0x7f85c41074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:57:18.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.845+0000 7f85cbc08700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c4107a50 con 0x7f85c40f7980 2021-11-03T17:57:18.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.845+0000 7f85cbc08700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c4107b90 con 0x7f85c40f66e0 2021-11-03T17:57:18.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.845+0000 7f85c91a3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85c40f7980 0x7f85c41074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:57:18.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.845+0000 7f85c91a3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85c40f7980 0x7f85c41074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57326/0 (socket says 172.21.15.26:57326) 2021-11-03T17:57:18.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.845+0000 7f85c91a3700 1 -- 172.21.15.26:0/4216472644 learned_addr learned my addr 172.21.15.26:0/4216472644 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:57:18.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.845+0000 7f85c99a4700 1 --2- 172.21.15.26:0/4216472644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85c40f66e0 0x7f85c4106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:57:18.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.845+0000 7f85c91a3700 1 -- 172.21.15.26:0/4216472644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85c40f66e0 msgr2=0x7f85c4106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:57:18.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.845+0000 7f85c91a3700 1 --2- 172.21.15.26:0/4216472644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85c40f66e0 0x7f85c4106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:18.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.845+0000 7f85c91a3700 1 -- 172.21.15.26:0/4216472644 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c0005040 con 0x7f85c40f7980 2021-11-03T17:57:18.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.845+0000 7f85c91a3700 1 --2- 172.21.15.26:0/4216472644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85c40f7980 0x7f85c41074a0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7f85b800c790 tx=0x7f85b8007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:57:18.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.845+0000 7f85b67fc700 1 -- 172.21.15.26:0/4216472644 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85b8002590 con 0x7f85c40f7980 2021-11-03T17:57:18.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.845+0000 7f85b67fc700 1 -- 172.21.15.26:0/4216472644 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f85b8002ba0 con 0x7f85c40f7980 2021-11-03T17:57:18.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.845+0000 7f85cbc08700 1 -- 172.21.15.26:0/4216472644 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c4108530 con 0x7f85c40f7980 2021-11-03T17:57:18.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.846+0000 7f85b67fc700 1 -- 172.21.15.26:0/4216472644 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85b8013d90 con 0x7f85c40f7980 2021-11-03T17:57:18.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.846+0000 7f85cbc08700 1 -- 172.21.15.26:0/4216472644 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c4108af0 con 0x7f85c40f7980 2021-11-03T17:57:18.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.846+0000 7f85cbc08700 1 -- 172.21.15.26:0/4216472644 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c4045ad0 con 0x7f85c40f7980 2021-11-03T17:57:18.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.847+0000 7f85b67fc700 1 -- 172.21.15.26:0/4216472644 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f85b801a060 con 0x7f85c40f7980 2021-11-03T17:57:18.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.847+0000 7f85b67fc700 1 --2- 172.21.15.26:0/4216472644 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85b00640b0 0x7f85b0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:57:18.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.848+0000 7f85b67fc700 1 -- 172.21.15.26:0/4216472644 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f85b8080b30 con 0x7f85c40f7980 2021-11-03T17:57:18.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.848+0000 7f85c99a4700 1 --2- 172.21.15.26:0/4216472644 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85b00640b0 0x7f85b0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:57:18.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.848+0000 7f85c99a4700 1 --2- 172.21.15.26:0/4216472644 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85b00640b0 0x7f85b0066570 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f85c0004630 tx=0x7f85c0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:57:18.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:18.851+0000 7f85b67fc700 1 -- 172.21.15.26:0/4216472644 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f85b8052d40 con 0x7f85c40f7980 2021-11-03T17:57:19.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:19.058+0000 7f85cbc08700 1 -- 172.21.15.26:0/4216472644 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f85c40fef40 con 0x7f85c40f7980 2021-11-03T17:57:19.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:19.058+0000 7f85b67fc700 1 -- 172.21.15.26:0/4216472644 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f85b8018070 con 0x7f85c40f7980 2021-11-03T17:57:19.056 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:57:19.056 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:57:19.056 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:57:19.056 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:57:19.057 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:57:19.057 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:57:19.057 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:57:19.057 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:57:19.058 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:57:19.058 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:57:19.058 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:57:19.058 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:57:19.059 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:57:19.059 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:57:19.059 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:57:19.059 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:57:19.060 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:57:19.060 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:57:19.060 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:57:19.060 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:57:19.061 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:57:19.061 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:57:19.061 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:57:19.061 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:57:19.062 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:57:19.062 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:57:19.062 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:57:19.062 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:57:19.063 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:57:19.064 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:57:19.064 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:57:19.064 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:57:19.064 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:57:19.065 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:57:19.065 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:57:19.066 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:57:19.066 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:57:19.066 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:57:19.067 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:57:19.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:19.060+0000 7f85cbc08700 1 -- 172.21.15.26:0/4216472644 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85b00640b0 msgr2=0x7f85b0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:57:19.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:19.060+0000 7f85cbc08700 1 --2- 172.21.15.26:0/4216472644 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85b00640b0 0x7f85b0066570 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f85c0004630 tx=0x7f85c0009b30).stop 2021-11-03T17:57:19.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:19.060+0000 7f85cbc08700 1 -- 172.21.15.26:0/4216472644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85c40f7980 msgr2=0x7f85c41074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:57:19.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:19.060+0000 7f85cbc08700 1 --2- 172.21.15.26:0/4216472644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85c40f7980 0x7f85c41074a0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7f85b800c790 tx=0x7f85b8007d70).stop 2021-11-03T17:57:19.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:19.060+0000 7f85cbc08700 1 -- 172.21.15.26:0/4216472644 shutdown_connections 2021-11-03T17:57:19.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:19.060+0000 7f85cbc08700 1 --2- 172.21.15.26:0/4216472644 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85b00640b0 0x7f85b0066570 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:19.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:19.060+0000 7f85cbc08700 1 --2- 172.21.15.26:0/4216472644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85c40f66e0 0x7f85c4106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:19.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:19.060+0000 7f85cbc08700 1 --2- 172.21.15.26:0/4216472644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85c40f7980 0x7f85c41074a0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:19.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:19.060+0000 7f85cbc08700 1 -- 172.21.15.26:0/4216472644 >> 172.21.15.26:0/4216472644 conn(0x7f85c40f1e40 msgr2=0x7f85c40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:57:19.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:19.060+0000 7f85cbc08700 1 -- 172.21.15.26:0/4216472644 shutdown_connections 2021-11-03T17:57:19.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:19.060+0000 7f85cbc08700 1 -- 172.21.15.26:0/4216472644 wait complete. 2021-11-03T17:57:19.070 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:57:19.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:18 smithi026 ceph-mon[96795]: pgmap v1879: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:19.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:18 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2171517257' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:57:19.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:18 smithi194 ceph-mon[65619]: pgmap v1879: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:19.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:18 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2171517257' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:57:20.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:19 smithi026 ceph-mon[96795]: from='client.36076 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:57:20.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:19 smithi026 ceph-mon[96795]: from='client.36080 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:57:20.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:19 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/4216472644' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:57:20.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:19 smithi194 ceph-mon[65619]: from='client.36076 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:57:20.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:19 smithi194 ceph-mon[65619]: from='client.36080 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:57:20.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:19 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/4216472644' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:57:21.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:20 smithi026 ceph-mon[96795]: pgmap v1880: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:21.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:20 smithi194 ceph-mon[65619]: pgmap v1880: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:23.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:22 smithi026 ceph-mon[96795]: pgmap v1881: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:23.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:22 smithi194 ceph-mon[65619]: pgmap v1881: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:25.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:24 smithi026 ceph-mon[96795]: pgmap v1882: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:25.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:24 smithi194 ceph-mon[65619]: pgmap v1882: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:27.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:26 smithi026 ceph-mon[96795]: pgmap v1883: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:27.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:26 smithi194 ceph-mon[65619]: pgmap v1883: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:29.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:28 smithi026 ceph-mon[96795]: pgmap v1884: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:29.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:57:29.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:28 smithi194 ceph-mon[65619]: pgmap v1884: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:29.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:57:30.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:29 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:57:30.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:29 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:57:31.172 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:30 smithi026 ceph-mon[96795]: pgmap v1885: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:31.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:30 smithi194 ceph-mon[65619]: pgmap v1885: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:33.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:32 smithi026 ceph-mon[96795]: pgmap v1886: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:33.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:32 smithi194 ceph-mon[65619]: pgmap v1886: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:35.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:34 smithi026 ceph-mon[96795]: pgmap v1887: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:35.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:34 smithi194 ceph-mon[65619]: pgmap v1887: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:37.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:36 smithi026 ceph-mon[96795]: pgmap v1888: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:37.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:36 smithi194 ceph-mon[65619]: pgmap v1888: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:39.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:38 smithi026 ceph-mon[96795]: pgmap v1889: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:39.256 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:38 smithi194 ceph-mon[65619]: pgmap v1889: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:41.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:40 smithi026 ceph-mon[96795]: pgmap v1890: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:41.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:40 smithi194 ceph-mon[65619]: pgmap v1890: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:43.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:42 smithi026 ceph-mon[96795]: pgmap v1891: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:43.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:42 smithi194 ceph-mon[65619]: pgmap v1891: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:44.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:43 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:57:44.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:43 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2021-11-03T17:57:44.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:43 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi026", "name": "osd_memory_target"}]: dispatch 2021-11-03T17:57:44.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:43 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:57:44.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:43 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:57:44.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:43 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:57:44.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:43 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:57:44.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:43 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:57:44.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:43 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:57:44.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:43 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:57:44.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:43 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:57:44.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:43 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2021-11-03T17:57:44.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:43 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi026", "name": "osd_memory_target"}]: dispatch 2021-11-03T17:57:44.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:43 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:57:44.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:43 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:57:44.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:43 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:57:44.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:43 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:57:44.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:43 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:57:44.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:43 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:57:44.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:43 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:57:45.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:44 smithi026 ceph-mon[96795]: pgmap v1892: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:45.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:44 smithi026 ceph-mon[96795]: poll took 60087.753 ms: 1 events 2021-11-03T17:57:45.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:44 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:57:45.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:44 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:57:45.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:44 smithi194 ceph-mon[65619]: pgmap v1892: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:45.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:44 smithi194 ceph-mon[65619]: poll took 60087.753 ms: 1 events 2021-11-03T17:57:45.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:44 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:57:45.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:44 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:57:47.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:46 smithi026 ceph-mon[96795]: pgmap v1893: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:47.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:46 smithi194 ceph-mon[65619]: pgmap v1893: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:48.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:47 smithi026 ceph-mon[96795]: pgmap v1894: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:48.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:47 smithi194 ceph-mon[65619]: pgmap v1894: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:49.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.175+0000 7f60020cd700 1 -- 172.21.15.26:0/3550012682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ffc0f55e0 msgr2=0x7f5ffc0f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:57:49.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.175+0000 7f60020cd700 1 --2- 172.21.15.26:0/3550012682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ffc0f55e0 0x7f5ffc0f5a00 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 rx=0x7f5fec004660 tx=0x7f5fec009b30).stop 2021-11-03T17:57:49.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.175+0000 7f60020cd700 1 -- 172.21.15.26:0/3550012682 shutdown_connections 2021-11-03T17:57:49.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.175+0000 7f60020cd700 1 --2- 172.21.15.26:0/3550012682 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ffc0f5ef0 0x7f5ffc0f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:49.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.175+0000 7f60020cd700 1 --2- 172.21.15.26:0/3550012682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ffc0f55e0 0x7f5ffc0f5a00 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:49.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.175+0000 7f60020cd700 1 -- 172.21.15.26:0/3550012682 >> 172.21.15.26:0/3550012682 conn(0x7f5ffc0f0de0 msgr2=0x7f5ffc0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:57:49.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.175+0000 7f60020cd700 1 -- 172.21.15.26:0/3550012682 shutdown_connections 2021-11-03T17:57:49.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.175+0000 7f60020cd700 1 -- 172.21.15.26:0/3550012682 wait complete. 2021-11-03T17:57:49.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:57:49.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:57:49.177 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.176+0000 7f60020cd700 1 Processor -- start 2021-11-03T17:57:49.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.176+0000 7f60020cd700 1 -- start start 2021-11-03T17:57:49.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.176+0000 7f60020cd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ffc0f55e0 0x7f5ffc106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:57:49.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.176+0000 7f60020cd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ffc0f5ef0 0x7f5ffc107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:57:49.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.176+0000 7f60020cd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc107a00 con 0x7f5ffc0f55e0 2021-11-03T17:57:49.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.176+0000 7f60020cd700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc107b40 con 0x7f5ffc0f5ef0 2021-11-03T17:57:49.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.176+0000 7f5ffb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ffc0f55e0 0x7f5ffc106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:57:49.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.176+0000 7f5ffb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ffc0f55e0 0x7f5ffc106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57342/0 (socket says 172.21.15.26:57342) 2021-11-03T17:57:49.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.176+0000 7f5ffb7fe700 1 -- 172.21.15.26:0/2768920072 learned_addr learned my addr 172.21.15.26:0/2768920072 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:57:49.180 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.176+0000 7f5ffb7fe700 1 -- 172.21.15.26:0/2768920072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ffc0f5ef0 msgr2=0x7f5ffc107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:57:49.180 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.176+0000 7f5ffaffd700 1 --2- 172.21.15.26:0/2768920072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ffc0f5ef0 0x7f5ffc107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:57:49.180 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.177+0000 7f5ffb7fe700 1 --2- 172.21.15.26:0/2768920072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ffc0f5ef0 0x7f5ffc107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:49.180 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.177+0000 7f5ffb7fe700 1 -- 172.21.15.26:0/2768920072 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fec005040 con 0x7f5ffc0f55e0 2021-11-03T17:57:49.181 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.177+0000 7f5ffaffd700 1 --2- 172.21.15.26:0/2768920072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ffc0f5ef0 0x7f5ffc107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:57:49.181 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.177+0000 7f5ffb7fe700 1 --2- 172.21.15.26:0/2768920072 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ffc0f55e0 0x7f5ffc106f60 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7f5fec009990 tx=0x7f5fec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:57:49.182 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.177+0000 7f5fe3fff700 1 -- 172.21.15.26:0/2768920072 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fec018070 con 0x7f5ffc0f55e0 2021-11-03T17:57:49.182 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.177+0000 7f60020cd700 1 -- 172.21.15.26:0/2768920072 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ffc108480 con 0x7f5ffc0f55e0 2021-11-03T17:57:49.182 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.177+0000 7f5fe3fff700 1 -- 172.21.15.26:0/2768920072 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5fec007ca0 con 0x7f5ffc0f55e0 2021-11-03T17:57:49.183 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.177+0000 7f5fe3fff700 1 -- 172.21.15.26:0/2768920072 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fec01c620 con 0x7f5ffc0f55e0 2021-11-03T17:57:49.183 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.178+0000 7f60020cd700 1 -- 172.21.15.26:0/2768920072 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ffc1089e0 con 0x7f5ffc0f55e0 2021-11-03T17:57:49.184 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.178+0000 7f5fe3fff700 1 -- 172.21.15.26:0/2768920072 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f5fec01d960 con 0x7f5ffc0f55e0 2021-11-03T17:57:49.184 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.178+0000 7f60020cd700 1 -- 172.21.15.26:0/2768920072 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ffc045ad0 con 0x7f5ffc0f55e0 2021-11-03T17:57:49.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.179+0000 7f5fe3fff700 1 --2- 172.21.15.26:0/2768920072 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5fe40640b0 0x7f5fe4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:57:49.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.179+0000 7f5fe3fff700 1 -- 172.21.15.26:0/2768920072 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f5fec081fe0 con 0x7f5ffc0f55e0 2021-11-03T17:57:49.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.179+0000 7f5ffaffd700 1 --2- 172.21.15.26:0/2768920072 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5fe40640b0 0x7f5fe4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:57:49.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.179+0000 7f5ffaffd700 1 --2- 172.21.15.26:0/2768920072 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5fe40640b0 0x7f5fe4066570 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f5ff00041d0 tx=0x7f5ff0009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:57:49.186 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.183+0000 7f5fe3fff700 1 -- 172.21.15.26:0/2768920072 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f5fec054340 con 0x7f5ffc0f55e0 2021-11-03T17:57:49.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:57:49.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:57:49.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.365+0000 7f60020cd700 1 -- 172.21.15.26:0/2768920072 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ffc0fad60 con 0x7f5fe40640b0 2021-11-03T17:57:49.363 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.366+0000 7f5fe3fff700 1 -- 172.21.15.26:0/2768920072 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f5ffc0fad60 con 0x7f5fe40640b0 2021-11-03T17:57:49.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.368+0000 7f60020cd700 1 -- 172.21.15.26:0/2768920072 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5fe40640b0 msgr2=0x7f5fe4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:57:49.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.368+0000 7f60020cd700 1 --2- 172.21.15.26:0/2768920072 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5fe40640b0 0x7f5fe4066570 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f5ff00041d0 tx=0x7f5ff0009040).stop 2021-11-03T17:57:49.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.368+0000 7f60020cd700 1 -- 172.21.15.26:0/2768920072 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ffc0f55e0 msgr2=0x7f5ffc106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:57:49.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.368+0000 7f60020cd700 1 --2- 172.21.15.26:0/2768920072 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ffc0f55e0 0x7f5ffc106f60 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7f5fec009990 tx=0x7f5fec009b30).stop 2021-11-03T17:57:49.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.368+0000 7f60020cd700 1 -- 172.21.15.26:0/2768920072 shutdown_connections 2021-11-03T17:57:49.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.368+0000 7f60020cd700 1 --2- 172.21.15.26:0/2768920072 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5fe40640b0 0x7f5fe4066570 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:49.367 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.368+0000 7f60020cd700 1 --2- 172.21.15.26:0/2768920072 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ffc0f55e0 0x7f5ffc106f60 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:49.367 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.368+0000 7f60020cd700 1 --2- 172.21.15.26:0/2768920072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ffc0f5ef0 0x7f5ffc107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:49.367 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.368+0000 7f60020cd700 1 -- 172.21.15.26:0/2768920072 >> 172.21.15.26:0/2768920072 conn(0x7f5ffc0f0de0 msgr2=0x7f5ffc05ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:57:49.367 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.368+0000 7f60020cd700 1 -- 172.21.15.26:0/2768920072 shutdown_connections 2021-11-03T17:57:49.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.368+0000 7f60020cd700 1 -- 172.21.15.26:0/2768920072 wait complete. 2021-11-03T17:57:49.375 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:57:49.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.468+0000 7f4e79370700 1 -- 172.21.15.26:0/3568225440 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e740f4a40 msgr2=0x7f4e740f4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:57:49.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.468+0000 7f4e79370700 1 --2- 172.21.15.26:0/3568225440 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e740f4a40 0x7f4e740f4e60 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7f4e64004660 tx=0x7f4e64009b30).stop 2021-11-03T17:57:49.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.468+0000 7f4e79370700 1 -- 172.21.15.26:0/3568225440 shutdown_connections 2021-11-03T17:57:49.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.468+0000 7f4e79370700 1 --2- 172.21.15.26:0/3568225440 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e740f53e0 0x7f4e740f7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:49.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.468+0000 7f4e79370700 1 --2- 172.21.15.26:0/3568225440 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e740f4a40 0x7f4e740f4e60 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:49.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.468+0000 7f4e79370700 1 -- 172.21.15.26:0/3568225440 >> 172.21.15.26:0/3568225440 conn(0x7f4e740f04c0 msgr2=0x7f4e740f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:57:49.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.468+0000 7f4e79370700 1 -- 172.21.15.26:0/3568225440 shutdown_connections 2021-11-03T17:57:49.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.468+0000 7f4e79370700 1 -- 172.21.15.26:0/3568225440 wait complete. 2021-11-03T17:57:49.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.469+0000 7f4e79370700 1 Processor -- start 2021-11-03T17:57:49.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.469+0000 7f4e79370700 1 -- start start 2021-11-03T17:57:49.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.469+0000 7f4e79370700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e740f4a40 0x7f4e740f7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:57:49.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.469+0000 7f4e79370700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e740f53e0 0x7f4e740f5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:57:49.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.469+0000 7f4e79370700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e740f6010 con 0x7f4e740f4a40 2021-11-03T17:57:49.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.469+0000 7f4e79370700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e740f6150 con 0x7f4e740f53e0 2021-11-03T17:57:49.472 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.469+0000 7f4e72ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e740f4a40 0x7f4e740f7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:57:49.472 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.469+0000 7f4e72ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e740f4a40 0x7f4e740f7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57352/0 (socket says 172.21.15.26:57352) 2021-11-03T17:57:49.472 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.469+0000 7f4e72ffd700 1 -- 172.21.15.26:0/2552177674 learned_addr learned my addr 172.21.15.26:0/2552177674 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:57:49.472 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.469+0000 7f4e727fc700 1 --2- 172.21.15.26:0/2552177674 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e740f53e0 0x7f4e740f5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:57:49.473 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.469+0000 7f4e72ffd700 1 -- 172.21.15.26:0/2552177674 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e740f53e0 msgr2=0x7f4e740f5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:57:49.473 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.469+0000 7f4e72ffd700 1 --2- 172.21.15.26:0/2552177674 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e740f53e0 0x7f4e740f5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:49.473 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.469+0000 7f4e72ffd700 1 -- 172.21.15.26:0/2552177674 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e64005040 con 0x7f4e740f4a40 2021-11-03T17:57:49.473 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.469+0000 7f4e72ffd700 1 --2- 172.21.15.26:0/2552177674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e740f4a40 0x7f4e740f7630 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 rx=0x7f4e64009990 tx=0x7f4e64009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:57:49.473 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.470+0000 7f4e6b7fe700 1 -- 172.21.15.26:0/2552177674 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e64018070 con 0x7f4e740f4a40 2021-11-03T17:57:49.474 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.470+0000 7f4e6b7fe700 1 -- 172.21.15.26:0/2552177674 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4e64007ba0 con 0x7f4e740f4a40 2021-11-03T17:57:49.474 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.470+0000 7f4e79370700 1 -- 172.21.15.26:0/2552177674 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e740f63d0 con 0x7f4e740f4a40 2021-11-03T17:57:49.474 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.470+0000 7f4e6b7fe700 1 -- 172.21.15.26:0/2552177674 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e6401c3c0 con 0x7f4e740f4a40 2021-11-03T17:57:49.474 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.470+0000 7f4e79370700 1 -- 172.21.15.26:0/2552177674 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e740f6930 con 0x7f4e740f4a40 2021-11-03T17:57:49.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.471+0000 7f4e79370700 1 -- 172.21.15.26:0/2552177674 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e74045ad0 con 0x7f4e740f4a40 2021-11-03T17:57:49.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.471+0000 7f4e6b7fe700 1 -- 172.21.15.26:0/2552177674 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f4e6401d420 con 0x7f4e740f4a40 2021-11-03T17:57:49.477 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.471+0000 7f4e6b7fe700 1 --2- 172.21.15.26:0/2552177674 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4e600640b0 0x7f4e60066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:57:49.477 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.472+0000 7f4e6b7fe700 1 -- 172.21.15.26:0/2552177674 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f4e64082410 con 0x7f4e740f4a40 2021-11-03T17:57:49.477 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.472+0000 7f4e727fc700 1 --2- 172.21.15.26:0/2552177674 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4e600640b0 0x7f4e60066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:57:49.477 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.472+0000 7f4e727fc700 1 --2- 172.21.15.26:0/2552177674 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4e600640b0 0x7f4e60066570 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f4e740f5860 tx=0x7f4e5c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:57:49.478 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.476+0000 7f4e6b7fe700 1 -- 172.21.15.26:0/2552177674 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f4e64054830 con 0x7f4e740f4a40 2021-11-03T17:57:49.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.652+0000 7f4e79370700 1 -- 172.21.15.26:0/2552177674 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e740ff0f0 con 0x7f4e600640b0 2021-11-03T17:57:49.663 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.666+0000 7f4e6b7fe700 1 -- 172.21.15.26:0/2552177674 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f4e740ff0f0 con 0x7f4e600640b0 2021-11-03T17:57:49.664 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:57:49.664 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (69m) 8m ago 70m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:57:49.664 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (61m) 8m ago 70m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:57:49.664 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (61m) 7m ago 69m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:57:49.665 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (68m) 8m ago 69m 41.4M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:57:49.665 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (62m) 8m ago 65m 25.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:57:49.665 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (62m) 8m ago 65m 26.0M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:57:49.665 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (65m) 7m ago 65m 26.2M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:57:49.666 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (65m) 7m ago 65m 26.5M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:57:49.666 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (62m) 8m ago 71m 547M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:57:49.666 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (62m) 7m ago 69m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:57:49.666 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (62m) 8m ago 71m 242M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:57:49.666 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (61m) 7m ago 69m 117M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:57:49.667 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (69m) 8m ago 69m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:57:49.667 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (69m) 7m ago 69m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:57:49.667 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (60m) 8m ago 68m 271M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:57:49.668 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (60m) 8m ago 68m 291M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:57:49.668 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (59m) 8m ago 67m 243M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:57:49.668 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (59m) 7m ago 67m 312M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:57:49.668 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (58m) 7m ago 67m 265M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:57:49.669 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (58m) 7m ago 67m 255M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:57:49.669 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (68m) 8m ago 69m 58.9M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:57:49.670 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.668+0000 7f4e79370700 1 -- 172.21.15.26:0/2552177674 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4e600640b0 msgr2=0x7f4e60066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:57:49.670 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.668+0000 7f4e79370700 1 --2- 172.21.15.26:0/2552177674 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4e600640b0 0x7f4e60066570 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f4e740f5860 tx=0x7f4e5c00b040).stop 2021-11-03T17:57:49.670 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.668+0000 7f4e79370700 1 -- 172.21.15.26:0/2552177674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e740f4a40 msgr2=0x7f4e740f7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:57:49.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.668+0000 7f4e79370700 1 --2- 172.21.15.26:0/2552177674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e740f4a40 0x7f4e740f7630 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 rx=0x7f4e64009990 tx=0x7f4e64009b30).stop 2021-11-03T17:57:49.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.668+0000 7f4e79370700 1 -- 172.21.15.26:0/2552177674 shutdown_connections 2021-11-03T17:57:49.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.668+0000 7f4e79370700 1 --2- 172.21.15.26:0/2552177674 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4e600640b0 0x7f4e60066570 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:49.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.668+0000 7f4e79370700 1 --2- 172.21.15.26:0/2552177674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e740f4a40 0x7f4e740f7630 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:49.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.668+0000 7f4e79370700 1 --2- 172.21.15.26:0/2552177674 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e740f53e0 0x7f4e740f5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:49.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.668+0000 7f4e79370700 1 -- 172.21.15.26:0/2552177674 >> 172.21.15.26:0/2552177674 conn(0x7f4e740f04c0 msgr2=0x7f4e740fb770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:57:49.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.668+0000 7f4e79370700 1 -- 172.21.15.26:0/2552177674 shutdown_connections 2021-11-03T17:57:49.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.668+0000 7f4e79370700 1 -- 172.21.15.26:0/2552177674 wait complete. 2021-11-03T17:57:49.770 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.767+0000 7ff5a884f700 1 -- 172.21.15.26:0/1873352964 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5a40f5ef0 msgr2=0x7ff5a40f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:57:49.770 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.767+0000 7ff5a884f700 1 --2- 172.21.15.26:0/1873352964 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5a40f5ef0 0x7ff5a40f6920 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7ff58c004660 tx=0x7ff58c009b30).stop 2021-11-03T17:57:49.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.767+0000 7ff5a884f700 1 -- 172.21.15.26:0/1873352964 shutdown_connections 2021-11-03T17:57:49.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.767+0000 7ff5a884f700 1 --2- 172.21.15.26:0/1873352964 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5a40f5ef0 0x7ff5a40f6920 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:49.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.767+0000 7ff5a884f700 1 --2- 172.21.15.26:0/1873352964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff5a40f55e0 0x7ff5a40f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:57:49.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.767+0000 7ff5a884f700 1 -- 172.21.15.26:0/1873352964 >> 172.21.15.26:0/1873352964 conn(0x7ff5a40f0de0 msgr2=0x7ff5a40f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:57:49.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.767+0000 7ff5a884f700 1 -- 172.21.15.26:0/1873352964 shutdown_connections 2021-11-03T17:57:49.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.767+0000 7ff5a884f700 1 -- 172.21.15.26:0/1873352964 wait complete. 2021-11-03T17:57:49.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.768+0000 7ff5a884f700 1 Processor -- start 2021-11-03T17:57:49.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.768+0000 7ff5a884f700 1 -- start start 2021-11-03T17:57:49.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.768+0000 7ff5a884f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff5a40f55e0 0x7ff5a4109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:57:49.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.768+0000 7ff5a884f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5a40f5ef0 0x7ff5a410c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:57:49.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.768+0000 7ff5a884f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a4060570 con 0x7ff5a40f5ef0 2021-11-03T17:57:49.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.768+0000 7ff5a884f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a40606b0 con 0x7ff5a40f55e0 2021-11-03T17:57:49.774 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.768+0000 7ff5a1d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5a40f5ef0 0x7ff5a410c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:57:49.774 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.768+0000 7ff5a1d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5a40f5ef0 0x7ff5a410c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57364/0 (socket says 172.21.15.26:57364) 2021-11-03T17:57:49.774 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.768+0000 7ff5a1d9b700 1 -- 172.21.15.26:0/1367049303 learned_addr learned my addr 172.21.15.26:0/1367049303 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:57:49.774 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.768+0000 7ff5a259c700 1 --2- 172.21.15.26:0/1367049303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff5a40f55e0 0x7ff5a4109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:57:49.775 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.768+0000 7ff5a1d9b700 1 -- 172.21.15.26:0/1367049303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff5a40f55e0 msgr2=0x7ff5a4109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:57:49.775 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.768+0000 7ff5a1d9b700 1 --2- 172.21.15.26:0/1367049303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff5a40f55e0 0x7ff5a4109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:49.775 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.768+0000 7ff5a1d9b700 1 -- 172.21.15.26:0/1367049303 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff58c005040 con 0x7ff5a40f5ef0 2021-11-03T17:57:49.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.768+0000 7ff5a1d9b700 1 --2- 172.21.15.26:0/1367049303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5a40f5ef0 0x7ff5a410c190 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7ff58c009990 tx=0x7ff58c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:57:49.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.769+0000 7ff59affd700 1 -- 172.21.15.26:0/1367049303 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff58c018070 con 0x7ff5a40f5ef0 2021-11-03T17:57:49.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.769+0000 7ff5a884f700 1 -- 172.21.15.26:0/1367049303 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a410c790 con 0x7ff5a40f5ef0 2021-11-03T17:57:49.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.769+0000 7ff59affd700 1 -- 172.21.15.26:0/1367049303 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff58c007ca0 con 0x7ff5a40f5ef0 2021-11-03T17:57:49.777 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.769+0000 7ff59affd700 1 -- 172.21.15.26:0/1367049303 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff58c01c620 con 0x7ff5a40f5ef0 2021-11-03T17:57:49.777 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.769+0000 7ff5a884f700 1 -- 172.21.15.26:0/1367049303 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a410ccc0 con 0x7ff5a40f5ef0 2021-11-03T17:57:49.777 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.769+0000 7ff5a884f700 1 -- 172.21.15.26:0/1367049303 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a40f4a70 con 0x7ff5a40f5ef0 2021-11-03T17:57:49.778 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.770+0000 7ff59affd700 1 -- 172.21.15.26:0/1367049303 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ff58c01d960 con 0x7ff5a40f5ef0 2021-11-03T17:57:49.778 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.770+0000 7ff59affd700 1 --2- 172.21.15.26:0/1367049303 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff5900640b0 0x7ff590066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:57:49.778 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.770+0000 7ff59affd700 1 -- 172.21.15.26:0/1367049303 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ff58c082520 con 0x7ff5a40f5ef0 2021-11-03T17:57:49.778 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.770+0000 7ff5a259c700 1 --2- 172.21.15.26:0/1367049303 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff5900640b0 0x7ff590066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:57:49.779 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.771+0000 7ff5a259c700 1 --2- 172.21.15.26:0/1367049303 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff5900640b0 0x7ff590066570 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7ff5a4060160 tx=0x7ff59c008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:57:49.779 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:49.774+0000 7ff59affd700 1 -- 172.21.15.26:0/1367049303 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ff58c054940 con 0x7ff5a40f5ef0 2021-11-03T17:57:50.001 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.003+0000 7ff5a884f700 1 -- 172.21.15.26:0/1367049303 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff5a4045ad0 con 0x7ff5a40f5ef0 2021-11-03T17:57:50.001 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.004+0000 7ff59affd700 1 -- 172.21.15.26:0/1367049303 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7ff58c054530 con 0x7ff5a40f5ef0 2021-11-03T17:57:50.001 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:57:50.002 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:57:50.002 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:57:50.002 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:57:50.002 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:57:50.002 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:57:50.003 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:57:50.004 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:57:50.004 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:57:50.005 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:57:50.005 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:57:50.006 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:57:50.006 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:57:50.006 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:57:50.007 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:57:50.007 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:57:50.007 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:57:50.007 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:57:50.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.005+0000 7ff5a884f700 1 -- 172.21.15.26:0/1367049303 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff5900640b0 msgr2=0x7ff590066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:57:50.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.005+0000 7ff5a884f700 1 --2- 172.21.15.26:0/1367049303 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff5900640b0 0x7ff590066570 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7ff5a4060160 tx=0x7ff59c008040).stop 2021-11-03T17:57:50.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.005+0000 7ff5a884f700 1 -- 172.21.15.26:0/1367049303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5a40f5ef0 msgr2=0x7ff5a410c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:57:50.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.005+0000 7ff5a884f700 1 --2- 172.21.15.26:0/1367049303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5a40f5ef0 0x7ff5a410c190 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7ff58c009990 tx=0x7ff58c009b30).stop 2021-11-03T17:57:50.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.005+0000 7ff5a884f700 1 -- 172.21.15.26:0/1367049303 shutdown_connections 2021-11-03T17:57:50.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.005+0000 7ff5a884f700 1 --2- 172.21.15.26:0/1367049303 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff5900640b0 0x7ff590066570 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:50.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.005+0000 7ff5a884f700 1 --2- 172.21.15.26:0/1367049303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff5a40f55e0 0x7ff5a4109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:50.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.005+0000 7ff5a884f700 1 --2- 172.21.15.26:0/1367049303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5a40f5ef0 0x7ff5a410c190 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:50.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.005+0000 7ff5a884f700 1 -- 172.21.15.26:0/1367049303 >> 172.21.15.26:0/1367049303 conn(0x7ff5a40f0de0 msgr2=0x7ff5a40fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:57:50.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.006+0000 7ff5a884f700 1 -- 172.21.15.26:0/1367049303 shutdown_connections 2021-11-03T17:57:50.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.006+0000 7ff5a884f700 1 -- 172.21.15.26:0/1367049303 wait complete. 2021-11-03T17:57:50.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.106+0000 7f8ef49de700 1 -- 172.21.15.26:0/3594442923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ef00f77d0 msgr2=0x7f8ef00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:57:50.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.106+0000 7f8ef49de700 1 --2- 172.21.15.26:0/3594442923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ef00f77d0 0x7f8ef00f7c30 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7f8ed8004660 tx=0x7f8ed8009b30).stop 2021-11-03T17:57:50.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.106+0000 7f8ef49de700 1 -- 172.21.15.26:0/3594442923 shutdown_connections 2021-11-03T17:57:50.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.106+0000 7f8ef49de700 1 --2- 172.21.15.26:0/3594442923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ef00f77d0 0x7f8ef00f7c30 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:50.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.106+0000 7f8ef49de700 1 --2- 172.21.15.26:0/3594442923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ef00f6530 0x7f8ef00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:50.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.106+0000 7f8ef49de700 1 -- 172.21.15.26:0/3594442923 >> 172.21.15.26:0/3594442923 conn(0x7f8ef00f1cd0 msgr2=0x7f8ef00f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:57:50.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.106+0000 7f8ef49de700 1 -- 172.21.15.26:0/3594442923 shutdown_connections 2021-11-03T17:57:50.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.106+0000 7f8ef49de700 1 -- 172.21.15.26:0/3594442923 wait complete. 2021-11-03T17:57:50.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.107+0000 7f8ef49de700 1 Processor -- start 2021-11-03T17:57:50.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.107+0000 7f8ef49de700 1 -- start start 2021-11-03T17:57:50.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.107+0000 7f8ef49de700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ef00f6530 0x7f8ef0106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:57:50.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.107+0000 7f8ef49de700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ef00f77d0 0x7f8ef0107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:57:50.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.107+0000 7f8ef49de700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef0107870 con 0x7f8ef00f77d0 2021-11-03T17:57:50.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.107+0000 7f8ef49de700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef0108080 con 0x7f8ef00f6530 2021-11-03T17:57:50.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.107+0000 7f8eee59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ef00f77d0 0x7f8ef0107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:57:50.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.107+0000 7f8eee59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ef00f77d0 0x7f8ef0107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57374/0 (socket says 172.21.15.26:57374) 2021-11-03T17:57:50.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.107+0000 7f8eee59c700 1 -- 172.21.15.26:0/1360245067 learned_addr learned my addr 172.21.15.26:0/1360245067 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:57:50.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.107+0000 7f8eee59c700 1 -- 172.21.15.26:0/1360245067 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ef00f6530 msgr2=0x7f8ef0106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:57:50.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.107+0000 7f8eee59c700 1 --2- 172.21.15.26:0/1360245067 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ef00f6530 0x7f8ef0106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:57:50.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.107+0000 7f8eee59c700 1 -- 172.21.15.26:0/1360245067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed8005040 con 0x7f8ef00f77d0 2021-11-03T17:57:50.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.108+0000 7f8eee59c700 1 --2- 172.21.15.26:0/1360245067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ef00f77d0 0x7f8ef0107270 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x7f8ed8009990 tx=0x7f8ed8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:57:50.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.108+0000 7f8ee77fe700 1 -- 172.21.15.26:0/1360245067 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ed8018070 con 0x7f8ef00f77d0 2021-11-03T17:57:50.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.108+0000 7f8ef49de700 1 -- 172.21.15.26:0/1360245067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ef01082a0 con 0x7f8ef00f77d0 2021-11-03T17:57:50.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.108+0000 7f8ee77fe700 1 -- 172.21.15.26:0/1360245067 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8ed8007ca0 con 0x7f8ef00f77d0 2021-11-03T17:57:50.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.108+0000 7f8ee77fe700 1 -- 172.21.15.26:0/1360245067 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ed801c620 con 0x7f8ef00f77d0 2021-11-03T17:57:50.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.108+0000 7f8ef49de700 1 -- 172.21.15.26:0/1360245067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ef0108800 con 0x7f8ef00f77d0 2021-11-03T17:57:50.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.109+0000 7f8ef49de700 1 -- 172.21.15.26:0/1360245067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ef0059100 con 0x7f8ef00f77d0 2021-11-03T17:57:50.113 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.109+0000 7f8ee77fe700 1 -- 172.21.15.26:0/1360245067 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f8ed801d960 con 0x7f8ef00f77d0 2021-11-03T17:57:50.113 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.110+0000 7f8ee77fe700 1 --2- 172.21.15.26:0/1360245067 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8edc064100 0x7f8edc0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:57:50.113 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.110+0000 7f8ee77fe700 1 -- 172.21.15.26:0/1360245067 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f8ed8082520 con 0x7f8ef00f77d0 2021-11-03T17:57:50.114 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.110+0000 7f8eeed9d700 1 --2- 172.21.15.26:0/1360245067 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8edc064100 0x7f8edc0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:57:50.114 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.110+0000 7f8eeed9d700 1 --2- 172.21.15.26:0/1360245067 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8edc064100 0x7f8edc0665c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f8ef0106af0 tx=0x7f8ee0007a60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:57:50.114 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.114+0000 7f8ee77fe700 1 -- 172.21.15.26:0/1360245067 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f8ed8054940 con 0x7f8ef00f77d0 2021-11-03T17:57:50.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.318+0000 7f8ef49de700 1 -- 172.21.15.26:0/1360245067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8ef00fedf0 con 0x7f8ef00f77d0 2021-11-03T17:57:50.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.319+0000 7f8ee77fe700 1 -- 172.21.15.26:0/1360245067 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f8ed8054530 con 0x7f8ef00f77d0 2021-11-03T17:57:50.316 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:57:50.317 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:57:50.317 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:57:50.317 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:57:50.317 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:57:50.318 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:57:50.318 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:57:50.318 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:57:50.318 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:57:50.318 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:57:50.319 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:57:50.319 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:57:50.319 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:57:50.319 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:57:50.320 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:57:50.320 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:57:50.320 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:57:50.320 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:57:50.321 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:57:50.321 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:57:50.321 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:57:50.321 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:57:50.321 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:57:50.322 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:57:50.322 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:57:50.322 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:57:50.322 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:57:50.323 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:57:50.323 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:57:50.323 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:57:50.323 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:57:50.324 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:57:50.324 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:57:50.324 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:57:50.324 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:57:50.324 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:57:50.325 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:57:50.325 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:57:50.325 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:57:50.326 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.320+0000 7f8ef49de700 1 -- 172.21.15.26:0/1360245067 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8edc064100 msgr2=0x7f8edc0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:57:50.326 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.320+0000 7f8ef49de700 1 --2- 172.21.15.26:0/1360245067 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8edc064100 0x7f8edc0665c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f8ef0106af0 tx=0x7f8ee0007a60).stop 2021-11-03T17:57:50.327 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.320+0000 7f8ef49de700 1 -- 172.21.15.26:0/1360245067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ef00f77d0 msgr2=0x7f8ef0107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:57:50.327 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.320+0000 7f8ef49de700 1 --2- 172.21.15.26:0/1360245067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ef00f77d0 0x7f8ef0107270 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x7f8ed8009990 tx=0x7f8ed8009b30).stop 2021-11-03T17:57:50.327 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.320+0000 7f8ef49de700 1 -- 172.21.15.26:0/1360245067 shutdown_connections 2021-11-03T17:57:50.327 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.320+0000 7f8ef49de700 1 --2- 172.21.15.26:0/1360245067 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8edc064100 0x7f8edc0665c0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:50.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.320+0000 7f8ef49de700 1 --2- 172.21.15.26:0/1360245067 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ef00f6530 0x7f8ef0106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:57:50.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.320+0000 7f8ef49de700 1 --2- 172.21.15.26:0/1360245067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ef00f77d0 0x7f8ef0107270 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:57:50.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.321+0000 7f8ef49de700 1 -- 172.21.15.26:0/1360245067 >> 172.21.15.26:0/1360245067 conn(0x7f8ef00f1cd0 msgr2=0x7f8ef00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:57:50.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.321+0000 7f8ef49de700 1 -- 172.21.15.26:0/1360245067 shutdown_connections 2021-11-03T17:57:50.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:57:50.321+0000 7f8ef49de700 1 -- 172.21.15.26:0/1360245067 wait complete. 2021-11-03T17:57:50.329 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:57:50.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:50 smithi026 ceph-mon[96795]: pgmap v1895: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:50.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:50 smithi026 ceph-mon[96795]: from='client.36092 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:57:50.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:50 smithi026 ceph-mon[96795]: from='client.36096 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:57:50.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:50 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1367049303' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:57:50.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:50 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1360245067' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:57:50.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:50 smithi194 ceph-mon[65619]: pgmap v1895: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:51.159 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:50 smithi194 ceph-mon[65619]: from='client.36092 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:57:51.160 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:50 smithi194 ceph-mon[65619]: from='client.36096 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:57:51.160 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:50 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1367049303' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:57:51.160 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:50 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1360245067' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:57:52.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:52 smithi026 ceph-mon[96795]: pgmap v1896: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:52.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:52 smithi194 ceph-mon[65619]: pgmap v1896: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:54.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:54 smithi026 ceph-mon[96795]: pgmap v1897: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:54.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:54 smithi194 ceph-mon[65619]: pgmap v1897: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:56.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:56 smithi026 ceph-mon[96795]: pgmap v1898: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:56.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:56 smithi194 ceph-mon[65619]: pgmap v1898: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:58.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:58 smithi026 ceph-mon[96795]: pgmap v1899: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:58.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:58 smithi194 ceph-mon[65619]: pgmap v1899: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:57:59.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:59 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:57:59.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:57:59 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:57:59.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:59 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:57:59.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:57:59 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:58:00.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:00 smithi026 ceph-mon[96795]: pgmap v1900: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:00.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:00 smithi194 ceph-mon[65619]: pgmap v1900: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:02.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:02 smithi026 ceph-mon[96795]: pgmap v1901: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:02.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:02 smithi194 ceph-mon[65619]: pgmap v1901: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:04.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:04 smithi026 ceph-mon[96795]: pgmap v1902: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:04.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:04 smithi194 ceph-mon[65619]: pgmap v1902: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:06.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:06 smithi026 ceph-mon[96795]: pgmap v1903: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:06.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:06 smithi194 ceph-mon[65619]: pgmap v1903: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:08.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:08 smithi026 ceph-mon[96795]: pgmap v1904: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:08.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:08 smithi194 ceph-mon[65619]: pgmap v1904: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:10.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:10 smithi026 ceph-mon[96795]: pgmap v1905: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:10.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:10 smithi194 ceph-mon[65619]: pgmap v1905: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:12.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:12 smithi026 ceph-mon[96795]: pgmap v1906: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:12.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:12 smithi194 ceph-mon[65619]: pgmap v1906: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:14.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:14 smithi026 ceph-mon[96795]: pgmap v1907: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:14.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:14 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:58:14.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:14 smithi194 ceph-mon[65619]: pgmap v1907: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:14.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:14 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:58:15.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:15 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:58:15.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:15 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:58:16.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:16 smithi026 ceph-mon[96795]: pgmap v1908: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:16.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:16 smithi194 ceph-mon[65619]: pgmap v1908: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:18.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:18 smithi026 ceph-mon[96795]: pgmap v1909: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:18.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:18 smithi194 ceph-mon[65619]: pgmap v1909: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:20.434 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.436+0000 7f6de0ff5700 1 -- 172.21.15.26:0/4194049794 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ddc0f55e0 msgr2=0x7f6ddc0f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:58:20.434 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.436+0000 7f6de0ff5700 1 --2- 172.21.15.26:0/4194049794 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ddc0f55e0 0x7f6ddc0f5a00 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7f6dcc004660 tx=0x7f6dcc009b30).stop 2021-11-03T17:58:20.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.436+0000 7f6de0ff5700 1 -- 172.21.15.26:0/4194049794 shutdown_connections 2021-11-03T17:58:20.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.436+0000 7f6de0ff5700 1 --2- 172.21.15.26:0/4194049794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ddc0f5ef0 0x7f6ddc0f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:20.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.436+0000 7f6de0ff5700 1 --2- 172.21.15.26:0/4194049794 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ddc0f55e0 0x7f6ddc0f5a00 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:20.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.436+0000 7f6de0ff5700 1 -- 172.21.15.26:0/4194049794 >> 172.21.15.26:0/4194049794 conn(0x7f6ddc0f0de0 msgr2=0x7f6ddc0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:58:20.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.436+0000 7f6de0ff5700 1 -- 172.21.15.26:0/4194049794 shutdown_connections 2021-11-03T17:58:20.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.436+0000 7f6de0ff5700 1 -- 172.21.15.26:0/4194049794 wait complete. 2021-11-03T17:58:20.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.437+0000 7f6de0ff5700 1 Processor -- start 2021-11-03T17:58:20.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.437+0000 7f6de0ff5700 1 -- start start 2021-11-03T17:58:20.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.437+0000 7f6de0ff5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ddc0f55e0 0x7f6ddc109150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:58:20.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.437+0000 7f6de0ff5700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ddc0f5ef0 0x7f6ddc109640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:58:20.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.437+0000 7f6de0ff5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc109bf0 con 0x7f6ddc0f55e0 2021-11-03T17:58:20.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.437+0000 7f6de0ff5700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc109d30 con 0x7f6ddc0f5ef0 2021-11-03T17:58:20.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.437+0000 7f6dda59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ddc0f55e0 0x7f6ddc109150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:58:20.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.437+0000 7f6dda59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ddc0f55e0 0x7f6ddc109150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57392/0 (socket says 172.21.15.26:57392) 2021-11-03T17:58:20.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.437+0000 7f6dda59c700 1 -- 172.21.15.26:0/3882001006 learned_addr learned my addr 172.21.15.26:0/3882001006 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:58:20.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.437+0000 7f6dd9d9b700 1 --2- 172.21.15.26:0/3882001006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ddc0f5ef0 0x7f6ddc109640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:58:20.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.437+0000 7f6dda59c700 1 -- 172.21.15.26:0/3882001006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ddc0f5ef0 msgr2=0x7f6ddc109640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:58:20.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.437+0000 7f6dda59c700 1 --2- 172.21.15.26:0/3882001006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ddc0f5ef0 0x7f6ddc109640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:20.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.437+0000 7f6dda59c700 1 -- 172.21.15.26:0/3882001006 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dcc005040 con 0x7f6ddc0f55e0 2021-11-03T17:58:20.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.438+0000 7f6dda59c700 1 --2- 172.21.15.26:0/3882001006 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ddc0f55e0 0x7f6ddc109150 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 rx=0x7f6dcc009da0 tx=0x7f6dcc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:58:20.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.438+0000 7f6dd2ffd700 1 -- 172.21.15.26:0/3882001006 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6dcc018070 con 0x7f6ddc0f55e0 2021-11-03T17:58:20.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.438+0000 7f6dd2ffd700 1 -- 172.21.15.26:0/3882001006 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6dcc007d70 con 0x7f6ddc0f55e0 2021-11-03T17:58:20.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.438+0000 7f6de0ff5700 1 -- 172.21.15.26:0/3882001006 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ddc10a670 con 0x7f6ddc0f55e0 2021-11-03T17:58:20.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.438+0000 7f6dd2ffd700 1 -- 172.21.15.26:0/3882001006 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6dcc01dea0 con 0x7f6ddc0f55e0 2021-11-03T17:58:20.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.438+0000 7f6de0ff5700 1 -- 172.21.15.26:0/3882001006 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ddc10abd0 con 0x7f6ddc0f55e0 2021-11-03T17:58:20.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.439+0000 7f6de0ff5700 1 -- 172.21.15.26:0/3882001006 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ddc045ad0 con 0x7f6ddc0f55e0 2021-11-03T17:58:20.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.439+0000 7f6dd2ffd700 1 -- 172.21.15.26:0/3882001006 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f6dcc01d420 con 0x7f6ddc0f55e0 2021-11-03T17:58:20.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.440+0000 7f6dd2ffd700 1 --2- 172.21.15.26:0/3882001006 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6dc8064090 0x7f6dc8066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:58:20.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.440+0000 7f6dd2ffd700 1 -- 172.21.15.26:0/3882001006 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f6dcc0825c0 con 0x7f6ddc0f55e0 2021-11-03T17:58:20.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.440+0000 7f6dd9d9b700 1 --2- 172.21.15.26:0/3882001006 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6dc8064090 0x7f6dc8066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:58:20.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.440+0000 7f6dd9d9b700 1 --2- 172.21.15.26:0/3882001006 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6dc8064090 0x7f6dc8066550 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f6dc40041d0 tx=0x7f6dc4009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:58:20.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.444+0000 7f6dd2ffd700 1 -- 172.21.15.26:0/3882001006 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f6dcc054920 con 0x7f6ddc0f55e0 2021-11-03T17:58:20.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.624+0000 7f6de0ff5700 1 -- 172.21.15.26:0/3882001006 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ddc0fab60 con 0x7f6dc8064090 2021-11-03T17:58:20.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.626+0000 7f6dd2ffd700 1 -- 172.21.15.26:0/3882001006 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f6ddc0fab60 con 0x7f6dc8064090 2021-11-03T17:58:20.624 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.627+0000 7f6de0ff5700 1 -- 172.21.15.26:0/3882001006 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6dc8064090 msgr2=0x7f6dc8066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:58:20.624 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.627+0000 7f6de0ff5700 1 --2- 172.21.15.26:0/3882001006 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6dc8064090 0x7f6dc8066550 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f6dc40041d0 tx=0x7f6dc4009040).stop 2021-11-03T17:58:20.624 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.627+0000 7f6de0ff5700 1 -- 172.21.15.26:0/3882001006 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ddc0f55e0 msgr2=0x7f6ddc109150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:58:20.624 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.627+0000 7f6de0ff5700 1 --2- 172.21.15.26:0/3882001006 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ddc0f55e0 0x7f6ddc109150 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 rx=0x7f6dcc009da0 tx=0x7f6dcc009b30).stop 2021-11-03T17:58:20.625 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.627+0000 7f6de0ff5700 1 -- 172.21.15.26:0/3882001006 shutdown_connections 2021-11-03T17:58:20.625 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.627+0000 7f6de0ff5700 1 --2- 172.21.15.26:0/3882001006 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6dc8064090 0x7f6dc8066550 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:20.625 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.627+0000 7f6de0ff5700 1 --2- 172.21.15.26:0/3882001006 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ddc0f55e0 0x7f6ddc109150 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:20.625 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.627+0000 7f6de0ff5700 1 --2- 172.21.15.26:0/3882001006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ddc0f5ef0 0x7f6ddc109640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:20.626 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.627+0000 7f6de0ff5700 1 -- 172.21.15.26:0/3882001006 >> 172.21.15.26:0/3882001006 conn(0x7f6ddc0f0de0 msgr2=0x7f6ddc05ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:58:20.626 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.627+0000 7f6de0ff5700 1 -- 172.21.15.26:0/3882001006 shutdown_connections 2021-11-03T17:58:20.626 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.627+0000 7f6de0ff5700 1 -- 172.21.15.26:0/3882001006 wait complete. 2021-11-03T17:58:20.633 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:58:20.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.727+0000 7fa28e715700 1 -- 172.21.15.26:0/2019459295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2880f6530 msgr2=0x7fa2880f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:58:20.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.727+0000 7fa28e715700 1 --2- 172.21.15.26:0/2019459295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2880f6530 0x7fa2880f6950 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7fa278004660 tx=0x7fa278009b30).stop 2021-11-03T17:58:20.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.727+0000 7fa28e715700 1 -- 172.21.15.26:0/2019459295 shutdown_connections 2021-11-03T17:58:20.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.727+0000 7fa28e715700 1 --2- 172.21.15.26:0/2019459295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2880f77d0 0x7fa2880f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:20.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.727+0000 7fa28e715700 1 --2- 172.21.15.26:0/2019459295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2880f6530 0x7fa2880f6950 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:20.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.727+0000 7fa28e715700 1 -- 172.21.15.26:0/2019459295 >> 172.21.15.26:0/2019459295 conn(0x7fa2880f1cd0 msgr2=0x7fa2880f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:58:20.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.727+0000 7fa28e715700 1 -- 172.21.15.26:0/2019459295 shutdown_connections 2021-11-03T17:58:20.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.727+0000 7fa28e715700 1 -- 172.21.15.26:0/2019459295 wait complete. 2021-11-03T17:58:20.728 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.728+0000 7fa28e715700 1 Processor -- start 2021-11-03T17:58:20.728 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.728+0000 7fa28e715700 1 -- start start 2021-11-03T17:58:20.728 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.728+0000 7fa28e715700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2880f6530 0x7fa288106db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:58:20.729 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.728+0000 7fa28e715700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2880f77d0 0x7fa2881072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:58:20.729 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.728+0000 7fa28e715700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2881078a0 con 0x7fa2880f6530 2021-11-03T17:58:20.729 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.728+0000 7fa28e715700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2881080e0 con 0x7fa2880f77d0 2021-11-03T17:58:20.729 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.728+0000 7fa28d713700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2880f6530 0x7fa288106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:58:20.730 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.728+0000 7fa28d713700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2880f6530 0x7fa288106db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57402/0 (socket says 172.21.15.26:57402) 2021-11-03T17:58:20.730 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.728+0000 7fa28d713700 1 -- 172.21.15.26:0/1556061769 learned_addr learned my addr 172.21.15.26:0/1556061769 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:58:20.730 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.728+0000 7fa28cf12700 1 --2- 172.21.15.26:0/1556061769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2880f77d0 0x7fa2881072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:58:20.730 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.728+0000 7fa28d713700 1 -- 172.21.15.26:0/1556061769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2880f77d0 msgr2=0x7fa2881072a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:58:20.731 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.728+0000 7fa28d713700 1 --2- 172.21.15.26:0/1556061769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2880f77d0 0x7fa2881072a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:20.731 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.729+0000 7fa28d713700 1 -- 172.21.15.26:0/1556061769 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa278005040 con 0x7fa2880f6530 2021-11-03T17:58:20.731 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.729+0000 7fa28cf12700 1 --2- 172.21.15.26:0/1556061769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2880f77d0 0x7fa2881072a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:58:20.731 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.729+0000 7fa28d713700 1 --2- 172.21.15.26:0/1556061769 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2880f6530 0x7fa288106db0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7fa278004f60 tx=0x7fa278009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:58:20.732 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.729+0000 7fa27dffb700 1 -- 172.21.15.26:0/1556061769 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa278018070 con 0x7fa2880f6530 2021-11-03T17:58:20.732 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.729+0000 7fa27dffb700 1 -- 172.21.15.26:0/1556061769 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa278007ba0 con 0x7fa2880f6530 2021-11-03T17:58:20.732 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.729+0000 7fa28e715700 1 -- 172.21.15.26:0/1556061769 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa288108360 con 0x7fa2880f6530 2021-11-03T17:58:20.732 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.729+0000 7fa27dffb700 1 -- 172.21.15.26:0/1556061769 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa27801c620 con 0x7fa2880f6530 2021-11-03T17:58:20.733 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.729+0000 7fa28e715700 1 -- 172.21.15.26:0/1556061769 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa288108840 con 0x7fa2880f6530 2021-11-03T17:58:20.733 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.730+0000 7fa28e715700 1 -- 172.21.15.26:0/1556061769 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa288059100 con 0x7fa2880f6530 2021-11-03T17:58:20.733 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.730+0000 7fa27dffb700 1 -- 172.21.15.26:0/1556061769 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fa27801c8e0 con 0x7fa2880f6530 2021-11-03T17:58:20.733 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.731+0000 7fa27dffb700 1 --2- 172.21.15.26:0/1556061769 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa274064100 0x7fa2740665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:58:20.733 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.731+0000 7fa27dffb700 1 -- 172.21.15.26:0/1556061769 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fa2780826e0 con 0x7fa2880f6530 2021-11-03T17:58:20.734 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.731+0000 7fa28cf12700 1 --2- 172.21.15.26:0/1556061769 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa274064100 0x7fa2740665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:58:20.734 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.731+0000 7fa28cf12700 1 --2- 172.21.15.26:0/1556061769 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa274064100 0x7fa2740665c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7fa288106b40 tx=0x7fa284009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:58:20.734 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.735+0000 7fa27dffb700 1 -- 172.21.15.26:0/1556061769 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fa278054a40 con 0x7fa2880f6530 2021-11-03T17:58:20.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.907+0000 7fa28e715700 1 -- 172.21.15.26:0/1556061769 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2880fecf0 con 0x7fa274064100 2021-11-03T17:58:20.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.921+0000 7fa27dffb700 1 -- 172.21.15.26:0/1556061769 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fa2880fecf0 con 0x7fa274064100 2021-11-03T17:58:20.918 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:58:20.918 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (69m) 8m ago 70m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:58:20.919 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (61m) 8m ago 70m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:58:20.919 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (61m) 7m ago 70m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:58:20.919 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (69m) 8m ago 70m 41.4M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:58:20.919 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (62m) 8m ago 65m 25.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:58:20.920 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (62m) 8m ago 65m 26.0M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:58:20.920 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (66m) 7m ago 66m 26.2M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:58:20.920 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (65m) 7m ago 65m 26.5M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:58:20.920 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (63m) 8m ago 72m 547M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:58:20.920 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (62m) 7m ago 70m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:58:20.921 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (62m) 8m ago 72m 242M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:58:20.921 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (62m) 7m ago 69m 117M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:58:20.921 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (70m) 8m ago 70m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:58:20.921 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (69m) 7m ago 69m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:58:20.922 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (61m) 8m ago 69m 271M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:58:20.922 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (60m) 8m ago 68m 291M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:58:20.922 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (60m) 8m ago 68m 243M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:58:20.922 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (59m) 7m ago 68m 312M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:58:20.923 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (59m) 7m ago 67m 265M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:58:20.923 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (59m) 7m ago 67m 255M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:58:20.923 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (69m) 8m ago 70m 58.9M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:58:20.924 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.923+0000 7fa28e715700 1 -- 172.21.15.26:0/1556061769 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa274064100 msgr2=0x7fa2740665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:58:20.924 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.923+0000 7fa28e715700 1 --2- 172.21.15.26:0/1556061769 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa274064100 0x7fa2740665c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7fa288106b40 tx=0x7fa284009040).stop 2021-11-03T17:58:20.925 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.923+0000 7fa28e715700 1 -- 172.21.15.26:0/1556061769 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2880f6530 msgr2=0x7fa288106db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:58:20.925 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.923+0000 7fa28e715700 1 --2- 172.21.15.26:0/1556061769 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2880f6530 0x7fa288106db0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7fa278004f60 tx=0x7fa278009b30).stop 2021-11-03T17:58:20.925 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.923+0000 7fa28e715700 1 -- 172.21.15.26:0/1556061769 shutdown_connections 2021-11-03T17:58:20.925 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.923+0000 7fa28e715700 1 --2- 172.21.15.26:0/1556061769 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa274064100 0x7fa2740665c0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:20.925 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.923+0000 7fa28e715700 1 --2- 172.21.15.26:0/1556061769 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2880f6530 0x7fa288106db0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:20.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.923+0000 7fa28e715700 1 --2- 172.21.15.26:0/1556061769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2880f77d0 0x7fa2881072a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:20.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.924+0000 7fa28e715700 1 -- 172.21.15.26:0/1556061769 >> 172.21.15.26:0/1556061769 conn(0x7fa2880f1cd0 msgr2=0x7fa2880fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:58:20.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.924+0000 7fa28e715700 1 -- 172.21.15.26:0/1556061769 shutdown_connections 2021-11-03T17:58:20.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:20.924+0000 7fa28e715700 1 -- 172.21.15.26:0/1556061769 wait complete. 2021-11-03T17:58:20.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:20 smithi026 ceph-mon[96795]: pgmap v1910: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:20.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:20 smithi194 ceph-mon[65619]: pgmap v1910: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:21.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.022+0000 7f9e3a456700 1 -- 172.21.15.26:0/3618763643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e340f7960 msgr2=0x7f9e340f7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:58:21.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.022+0000 7f9e3a456700 1 --2- 172.21.15.26:0/3618763643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e340f7960 0x7f9e340f7dc0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 rx=0x7f9e24004660 tx=0x7f9e24009b30).stop 2021-11-03T17:58:21.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.022+0000 7f9e3a456700 1 -- 172.21.15.26:0/3618763643 shutdown_connections 2021-11-03T17:58:21.021 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.022+0000 7f9e3a456700 1 --2- 172.21.15.26:0/3618763643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e340f7960 0x7f9e340f7dc0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:21.021 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.022+0000 7f9e3a456700 1 --2- 172.21.15.26:0/3618763643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e340f66c0 0x7f9e340f6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:21.021 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.022+0000 7f9e3a456700 1 -- 172.21.15.26:0/3618763643 >> 172.21.15.26:0/3618763643 conn(0x7f9e340f1e20 msgr2=0x7f9e340f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:58:21.021 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.022+0000 7f9e3a456700 1 -- 172.21.15.26:0/3618763643 shutdown_connections 2021-11-03T17:58:21.021 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.022+0000 7f9e3a456700 1 -- 172.21.15.26:0/3618763643 wait complete. 2021-11-03T17:58:21.022 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.023+0000 7f9e3a456700 1 Processor -- start 2021-11-03T17:58:21.022 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.023+0000 7f9e3a456700 1 -- start start 2021-11-03T17:58:21.022 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.023+0000 7f9e3a456700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e340f66c0 0x7f9e34106f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:58:21.022 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.023+0000 7f9e3a456700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e340f7960 0x7f9e34107430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:58:21.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.023+0000 7f9e3a456700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e341079e0 con 0x7f9e340f7960 2021-11-03T17:58:21.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.023+0000 7f9e3a456700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e34107b20 con 0x7f9e340f66c0 2021-11-03T17:58:21.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.023+0000 7f9e337fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e340f7960 0x7f9e34107430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:58:21.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.023+0000 7f9e337fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e340f7960 0x7f9e34107430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57414/0 (socket says 172.21.15.26:57414) 2021-11-03T17:58:21.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.023+0000 7f9e337fe700 1 -- 172.21.15.26:0/2324881615 learned_addr learned my addr 172.21.15.26:0/2324881615 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:58:21.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.023+0000 7f9e337fe700 1 -- 172.21.15.26:0/2324881615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e340f66c0 msgr2=0x7f9e34106f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:58:21.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.023+0000 7f9e337fe700 1 --2- 172.21.15.26:0/2324881615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e340f66c0 0x7f9e34106f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:58:21.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.023+0000 7f9e337fe700 1 -- 172.21.15.26:0/2324881615 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e24005040 con 0x7f9e340f7960 2021-11-03T17:58:21.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.024+0000 7f9e337fe700 1 --2- 172.21.15.26:0/2324881615 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e340f7960 0x7f9e34107430 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7f9e24009990 tx=0x7f9e24009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:58:21.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.024+0000 7f9e30ff9700 1 -- 172.21.15.26:0/2324881615 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e24018070 con 0x7f9e340f7960 2021-11-03T17:58:21.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.024+0000 7f9e3a456700 1 -- 172.21.15.26:0/2324881615 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e34108460 con 0x7f9e340f7960 2021-11-03T17:58:21.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.024+0000 7f9e30ff9700 1 -- 172.21.15.26:0/2324881615 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9e24007ca0 con 0x7f9e340f7960 2021-11-03T17:58:21.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.024+0000 7f9e30ff9700 1 -- 172.21.15.26:0/2324881615 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e2401c620 con 0x7f9e340f7960 2021-11-03T17:58:21.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.024+0000 7f9e3a456700 1 -- 172.21.15.26:0/2324881615 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e341089c0 con 0x7f9e340f7960 2021-11-03T17:58:21.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.025+0000 7f9e3a456700 1 -- 172.21.15.26:0/2324881615 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e34045ad0 con 0x7f9e340f7960 2021-11-03T17:58:21.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.026+0000 7f9e30ff9700 1 -- 172.21.15.26:0/2324881615 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f9e2401d960 con 0x7f9e340f7960 2021-11-03T17:58:21.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.026+0000 7f9e30ff9700 1 --2- 172.21.15.26:0/2324881615 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9e1c0640b0 0x7f9e1c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:58:21.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.026+0000 7f9e30ff9700 1 -- 172.21.15.26:0/2324881615 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f9e240826a0 con 0x7f9e340f7960 2021-11-03T17:58:21.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.026+0000 7f9e33fff700 1 --2- 172.21.15.26:0/2324881615 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9e1c0640b0 0x7f9e1c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:58:21.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.027+0000 7f9e33fff700 1 --2- 172.21.15.26:0/2324881615 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9e1c0640b0 0x7f9e1c066570 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f9e340f77c0 tx=0x7f9e28007a60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:58:21.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.029+0000 7f9e30ff9700 1 -- 172.21.15.26:0/2324881615 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f9e24054a00 con 0x7f9e340f7960 2021-11-03T17:58:21.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.256+0000 7f9e3a456700 1 -- 172.21.15.26:0/2324881615 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9e340fef90 con 0x7f9e340f7960 2021-11-03T17:58:21.253 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.257+0000 7f9e30ff9700 1 -- 172.21.15.26:0/2324881615 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f9e240545f0 con 0x7f9e340f7960 2021-11-03T17:58:21.253 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:58:21.254 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:58:21.254 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:58:21.254 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:58:21.254 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:58:21.255 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:58:21.255 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:58:21.255 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:58:21.255 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:58:21.256 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:58:21.256 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:58:21.256 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:58:21.256 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:58:21.256 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:58:21.257 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:58:21.257 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:58:21.257 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:58:21.257 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:58:21.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.258+0000 7f9e3a456700 1 -- 172.21.15.26:0/2324881615 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9e1c0640b0 msgr2=0x7f9e1c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:58:21.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.258+0000 7f9e3a456700 1 --2- 172.21.15.26:0/2324881615 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9e1c0640b0 0x7f9e1c066570 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f9e340f77c0 tx=0x7f9e28007a60).stop 2021-11-03T17:58:21.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.258+0000 7f9e3a456700 1 -- 172.21.15.26:0/2324881615 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e340f7960 msgr2=0x7f9e34107430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:58:21.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.258+0000 7f9e3a456700 1 --2- 172.21.15.26:0/2324881615 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e340f7960 0x7f9e34107430 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7f9e24009990 tx=0x7f9e24009b30).stop 2021-11-03T17:58:21.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.258+0000 7f9e3a456700 1 -- 172.21.15.26:0/2324881615 shutdown_connections 2021-11-03T17:58:21.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.258+0000 7f9e3a456700 1 --2- 172.21.15.26:0/2324881615 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9e1c0640b0 0x7f9e1c066570 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:21.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.258+0000 7f9e3a456700 1 --2- 172.21.15.26:0/2324881615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e340f66c0 0x7f9e34106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T17:58:21.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.258+0000 7f9e3a456700 1 --2- 172.21.15.26:0/2324881615 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e340f7960 0x7f9e34107430 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:21.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.258+0000 7f9e3a456700 1 -- 172.21.15.26:0/2324881615 >> 172.21.15.26:0/2324881615 conn(0x7f9e340f1e20 msgr2=0x7f9e340fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:58:21.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.258+0000 7f9e3a456700 1 -- 172.21.15.26:0/2324881615 shutdown_connections 2021-11-03T17:58:21.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.259+0000 7f9e3a456700 1 -- 172.21.15.26:0/2324881615 wait complete. 2021-11-03T17:58:21.355 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.358+0000 7f16fd5cf700 1 -- 172.21.15.26:0/672028805 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16f80f5790 msgr2=0x7f16f80f5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:58:21.355 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.358+0000 7f16fd5cf700 1 --2- 172.21.15.26:0/672028805 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16f80f5790 0x7f16f80f5c10 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 rx=0x7f16ec004660 tx=0x7f16ec009b30).stop 2021-11-03T17:58:21.355 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.358+0000 7f16fd5cf700 1 -- 172.21.15.26:0/672028805 shutdown_connections 2021-11-03T17:58:21.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.358+0000 7f16fd5cf700 1 --2- 172.21.15.26:0/672028805 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16f80f5790 0x7f16f80f5c10 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:21.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.358+0000 7f16fd5cf700 1 --2- 172.21.15.26:0/672028805 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16f80f6a40 0x7f16f80f6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:58:21.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.358+0000 7f16fd5cf700 1 -- 172.21.15.26:0/672028805 >> 172.21.15.26:0/672028805 conn(0x7f16f80f0320 msgr2=0x7f16f80f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:58:21.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.358+0000 7f16fd5cf700 1 -- 172.21.15.26:0/672028805 shutdown_connections 2021-11-03T17:58:21.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.358+0000 7f16fd5cf700 1 -- 172.21.15.26:0/672028805 wait complete. 2021-11-03T17:58:21.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.359+0000 7f16fd5cf700 1 Processor -- start 2021-11-03T17:58:21.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.359+0000 7f16fd5cf700 1 -- start start 2021-11-03T17:58:21.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.359+0000 7f16fd5cf700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16f80f5790 0x7f16f80f9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:58:21.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.359+0000 7f16fd5cf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16f80f6a40 0x7f16f80f7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:58:21.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.359+0000 7f16fd5cf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f80f80d0 con 0x7f16f80f6a40 2021-11-03T17:58:21.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.359+0000 7f16fd5cf700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f80f8210 con 0x7f16f80f5790 2021-11-03T17:58:21.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.359+0000 7f16f77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16f80f6a40 0x7f16f80f7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:58:21.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.359+0000 7f16f77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16f80f6a40 0x7f16f80f7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57424/0 (socket says 172.21.15.26:57424) 2021-11-03T17:58:21.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.359+0000 7f16f77fe700 1 -- 172.21.15.26:0/2084697314 learned_addr learned my addr 172.21.15.26:0/2084697314 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:58:21.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.360+0000 7f16f7fff700 1 --2- 172.21.15.26:0/2084697314 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16f80f5790 0x7f16f80f9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:58:21.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.360+0000 7f16f77fe700 1 -- 172.21.15.26:0/2084697314 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16f80f5790 msgr2=0x7f16f80f9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:58:21.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.360+0000 7f16f77fe700 1 --2- 172.21.15.26:0/2084697314 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16f80f5790 0x7f16f80f9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:21.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.360+0000 7f16f77fe700 1 -- 172.21.15.26:0/2084697314 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ec005040 con 0x7f16f80f6a40 2021-11-03T17:58:21.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.360+0000 7f16f7fff700 1 --2- 172.21.15.26:0/2084697314 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16f80f5790 0x7f16f80f9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:58:21.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.360+0000 7f16f77fe700 1 --2- 172.21.15.26:0/2084697314 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16f80f6a40 0x7f16f80f7ae0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7f16ec000c00 tx=0x7f16ec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:58:21.363 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.360+0000 7f16f4ff9700 1 -- 172.21.15.26:0/2084697314 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16ec018070 con 0x7f16f80f6a40 2021-11-03T17:58:21.363 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.360+0000 7f16f4ff9700 1 -- 172.21.15.26:0/2084697314 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f16ec007d70 con 0x7f16f80f6a40 2021-11-03T17:58:21.363 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.360+0000 7f16fd5cf700 1 -- 172.21.15.26:0/2084697314 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f80f8490 con 0x7f16f80f6a40 2021-11-03T17:58:21.363 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.360+0000 7f16f4ff9700 1 -- 172.21.15.26:0/2084697314 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16ec01c620 con 0x7f16f80f6a40 2021-11-03T17:58:21.363 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.360+0000 7f16fd5cf700 1 -- 172.21.15.26:0/2084697314 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f810ede0 con 0x7f16f80f6a40 2021-11-03T17:58:21.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.361+0000 7f16fd5cf700 1 -- 172.21.15.26:0/2084697314 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16f8045ad0 con 0x7f16f80f6a40 2021-11-03T17:58:21.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.362+0000 7f16f4ff9700 1 -- 172.21.15.26:0/2084697314 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f16ec01c860 con 0x7f16f80f6a40 2021-11-03T17:58:21.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.362+0000 7f16f4ff9700 1 --2- 172.21.15.26:0/2084697314 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f16e0064100 0x7f16e00665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:58:21.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.362+0000 7f16f4ff9700 1 -- 172.21.15.26:0/2084697314 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f16ec082690 con 0x7f16f80f6a40 2021-11-03T17:58:21.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.362+0000 7f16f7fff700 1 --2- 172.21.15.26:0/2084697314 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f16e0064100 0x7f16e00665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:58:21.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.362+0000 7f16f7fff700 1 --2- 172.21.15.26:0/2084697314 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f16e0064100 0x7f16e00665c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f16f80f93f0 tx=0x7f16e8008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:58:21.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.366+0000 7f16f4ff9700 1 -- 172.21.15.26:0/2084697314 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f16ec054ab0 con 0x7f16f80f6a40 2021-11-03T17:58:21.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.573+0000 7f16fd5cf700 1 -- 172.21.15.26:0/2084697314 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f16f810f430 con 0x7f16f80f6a40 2021-11-03T17:58:21.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.573+0000 7f16f4ff9700 1 -- 172.21.15.26:0/2084697314 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f16ec0546a0 con 0x7f16f80f6a40 2021-11-03T17:58:21.570 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:58:21.570 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:58:21.570 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:58:21.570 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:58:21.571 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:58:21.571 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:58:21.571 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:58:21.571 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:58:21.572 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:58:21.572 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:58:21.572 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:58:21.572 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:58:21.572 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:58:21.573 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:58:21.573 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:58:21.573 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:58:21.573 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:58:21.573 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:58:21.574 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:58:21.574 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:58:21.574 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:58:21.574 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:58:21.575 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:58:21.575 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:58:21.575 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:58:21.575 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:58:21.575 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:58:21.576 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:58:21.576 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:58:21.576 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:58:21.576 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:58:21.577 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:58:21.577 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:58:21.577 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:58:21.577 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:58:21.577 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:58:21.578 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:58:21.578 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:58:21.578 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:58:21.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.575+0000 7f16fd5cf700 1 -- 172.21.15.26:0/2084697314 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f16e0064100 msgr2=0x7f16e00665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:58:21.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.575+0000 7f16fd5cf700 1 --2- 172.21.15.26:0/2084697314 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f16e0064100 0x7f16e00665c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f16f80f93f0 tx=0x7f16e8008040).stop 2021-11-03T17:58:21.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.575+0000 7f16fd5cf700 1 -- 172.21.15.26:0/2084697314 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16f80f6a40 msgr2=0x7f16f80f7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:58:21.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.575+0000 7f16fd5cf700 1 --2- 172.21.15.26:0/2084697314 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16f80f6a40 0x7f16f80f7ae0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7f16ec000c00 tx=0x7f16ec009b30).stop 2021-11-03T17:58:21.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.575+0000 7f16fd5cf700 1 -- 172.21.15.26:0/2084697314 shutdown_connections 2021-11-03T17:58:21.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.575+0000 7f16fd5cf700 1 --2- 172.21.15.26:0/2084697314 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f16e0064100 0x7f16e00665c0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:21.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.575+0000 7f16fd5cf700 1 --2- 172.21.15.26:0/2084697314 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16f80f5790 0x7f16f80f9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:21.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.575+0000 7f16fd5cf700 1 --2- 172.21.15.26:0/2084697314 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16f80f6a40 0x7f16f80f7ae0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:21.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.575+0000 7f16fd5cf700 1 -- 172.21.15.26:0/2084697314 >> 172.21.15.26:0/2084697314 conn(0x7f16f80f0320 msgr2=0x7f16f80f4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:58:21.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.575+0000 7f16fd5cf700 1 -- 172.21.15.26:0/2084697314 shutdown_connections 2021-11-03T17:58:21.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:21.575+0000 7f16fd5cf700 1 -- 172.21.15.26:0/2084697314 wait complete. 2021-11-03T17:58:21.582 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:58:21.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:21 smithi026 ceph-mon[96795]: from='client.36108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:58:21.993 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:21 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2324881615' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:58:21.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:21 smithi194 ceph-mon[65619]: from='client.36108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:58:21.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:21 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2324881615' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:58:22.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:22 smithi026 ceph-mon[96795]: from='client.36112 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:58:22.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:22 smithi026 ceph-mon[96795]: pgmap v1911: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:22.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:22 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2084697314' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:58:22.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:22 smithi194 ceph-mon[65619]: from='client.36112 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:58:22.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:22 smithi194 ceph-mon[65619]: pgmap v1911: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:22.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:22 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2084697314' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:58:24.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:24 smithi026 ceph-mon[96795]: pgmap v1912: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:24.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:24 smithi194 ceph-mon[65619]: pgmap v1912: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:26.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:26 smithi026 ceph-mon[96795]: pgmap v1913: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:26.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:26 smithi194 ceph-mon[65619]: pgmap v1913: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:28.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:28 smithi026 ceph-mon[96795]: pgmap v1914: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:28.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:28 smithi194 ceph-mon[65619]: pgmap v1914: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:29.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:29 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:58:29.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:29 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:58:30.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:30 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:58:30.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:30 smithi026 ceph-mon[96795]: pgmap v1915: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:30.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:30 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:58:30.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:30 smithi194 ceph-mon[65619]: pgmap v1915: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:32.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:32 smithi026 ceph-mon[96795]: pgmap v1916: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:32.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:32 smithi194 ceph-mon[65619]: pgmap v1916: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:34.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:34 smithi026 ceph-mon[96795]: pgmap v1917: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:34.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:34 smithi194 ceph-mon[65619]: pgmap v1917: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:36.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:36 smithi026 ceph-mon[96795]: pgmap v1918: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:36.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:36 smithi194 ceph-mon[65619]: pgmap v1918: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:38.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:38 smithi026 ceph-mon[96795]: pgmap v1919: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:38.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:38 smithi194 ceph-mon[65619]: pgmap v1919: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:40.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:40 smithi026 ceph-mon[96795]: pgmap v1920: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:40.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:40 smithi194 ceph-mon[65619]: pgmap v1920: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:42.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:42 smithi026 ceph-mon[96795]: pgmap v1921: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:42.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:42 smithi194 ceph-mon[65619]: pgmap v1921: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:44.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:44 smithi026 ceph-mon[96795]: pgmap v1922: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:44.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:44 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:58:44.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:44 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:58:44.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:44 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:58:44.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:44 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:58:44.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:44 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:58:44.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:44 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:58:44.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:44 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:58:44.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:44 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:58:44.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:44 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:58:44.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:44 smithi194 ceph-mon[65619]: pgmap v1922: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:44.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:44 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:58:44.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:44 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:58:44.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:44 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:58:45.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:44 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:58:45.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:44 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:58:45.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:44 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:58:45.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:44 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:58:45.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:44 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:58:45.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:44 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:58:45.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:45 smithi026 ceph-mon[96795]: poll took 60066.626 ms: 1 events 2021-11-03T17:58:45.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:45 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:58:45.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:45 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:58:45.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:45 smithi194 ceph-mon[65619]: poll took 60066.626 ms: 1 events 2021-11-03T17:58:45.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:45 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:58:45.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:45 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:58:46.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:46 smithi026 ceph-mon[96795]: pgmap v1923: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:47.004 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:46 smithi194 ceph-mon[65619]: pgmap v1923: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:48.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:48 smithi026 ceph-mon[96795]: pgmap v1924: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:48.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:58:48.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:58:48.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:48 smithi194 ceph-mon[65619]: pgmap v1924: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:48.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:58:48.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:58:50.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:50 smithi026 ceph-mon[96795]: pgmap v1925: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:50.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:50 smithi194 ceph-mon[65619]: pgmap v1925: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:51.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.690+0000 7f927dd45700 1 -- 172.21.15.26:0/3435747620 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92780f66e0 msgr2=0x7f92780f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:58:51.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.690+0000 7f927dd45700 1 --2- 172.21.15.26:0/3435747620 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92780f66e0 0x7f92780f6b00 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7f9260004660 tx=0x7f9260009b30).stop 2021-11-03T17:58:51.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.691+0000 7f927dd45700 1 -- 172.21.15.26:0/3435747620 shutdown_connections 2021-11-03T17:58:51.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.691+0000 7f927dd45700 1 --2- 172.21.15.26:0/3435747620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92780f6ff0 0x7f92780f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:51.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.691+0000 7f927dd45700 1 --2- 172.21.15.26:0/3435747620 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92780f66e0 0x7f92780f6b00 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:51.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.691+0000 7f927dd45700 1 -- 172.21.15.26:0/3435747620 >> 172.21.15.26:0/3435747620 conn(0x7f92780f1f00 msgr2=0x7f92780f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:58:51.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.691+0000 7f927dd45700 1 -- 172.21.15.26:0/3435747620 shutdown_connections 2021-11-03T17:58:51.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.691+0000 7f927dd45700 1 -- 172.21.15.26:0/3435747620 wait complete. 2021-11-03T17:58:51.692 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.691+0000 7f927dd45700 1 Processor -- start 2021-11-03T17:58:51.692 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.691+0000 7f927dd45700 1 -- start start 2021-11-03T17:58:51.692 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.691+0000 7f927dd45700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92780f66e0 0x7f927806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:58:51.692 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.692+0000 7f927dd45700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92780f6ff0 0x7f9278069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:58:51.692 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.692+0000 7f927dd45700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927806a380 con 0x7f92780f6ff0 2021-11-03T17:58:51.693 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.692+0000 7f927dd45700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927806a4c0 con 0x7f92780f66e0 2021-11-03T17:58:51.693 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.692+0000 7f9276ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92780f6ff0 0x7f9278069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:58:51.693 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.692+0000 7f9276ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92780f6ff0 0x7f9278069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57442/0 (socket says 172.21.15.26:57442) 2021-11-03T17:58:51.693 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.692+0000 7f9276ffd700 1 -- 172.21.15.26:0/170209650 learned_addr learned my addr 172.21.15.26:0/170209650 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:58:51.694 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.692+0000 7f92777fe700 1 --2- 172.21.15.26:0/170209650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92780f66e0 0x7f927806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:58:51.694 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.692+0000 7f9276ffd700 1 -- 172.21.15.26:0/170209650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92780f66e0 msgr2=0x7f927806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:58:51.694 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.692+0000 7f9276ffd700 1 --2- 172.21.15.26:0/170209650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92780f66e0 0x7f927806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:51.694 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.692+0000 7f9276ffd700 1 -- 172.21.15.26:0/170209650 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9260005040 con 0x7f92780f6ff0 2021-11-03T17:58:51.694 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.692+0000 7f92777fe700 1 --2- 172.21.15.26:0/170209650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92780f66e0 0x7f927806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:58:51.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.692+0000 7f9276ffd700 1 --2- 172.21.15.26:0/170209650 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92780f6ff0 0x7f9278069e20 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7f9268002700 tx=0x7f9268009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:58:51.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.692+0000 7f926ffff700 1 -- 172.21.15.26:0/170209650 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9268009320 con 0x7f92780f6ff0 2021-11-03T17:58:51.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.692+0000 7f927dd45700 1 -- 172.21.15.26:0/170209650 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f927806a7a0 con 0x7f92780f6ff0 2021-11-03T17:58:51.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.692+0000 7f926ffff700 1 -- 172.21.15.26:0/170209650 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f926800f040 con 0x7f92780f6ff0 2021-11-03T17:58:51.696 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.692+0000 7f926ffff700 1 -- 172.21.15.26:0/170209650 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9268014820 con 0x7f92780f6ff0 2021-11-03T17:58:51.696 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.692+0000 7f927dd45700 1 -- 172.21.15.26:0/170209650 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f927810ef30 con 0x7f92780f6ff0 2021-11-03T17:58:51.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.693+0000 7f927dd45700 1 -- 172.21.15.26:0/170209650 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9278045ad0 con 0x7f92780f6ff0 2021-11-03T17:58:51.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.694+0000 7f926ffff700 1 -- 172.21.15.26:0/170209650 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f9268009480 con 0x7f92780f6ff0 2021-11-03T17:58:51.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.694+0000 7f926ffff700 1 --2- 172.21.15.26:0/170209650 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9264064090 0x7f9264066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:58:51.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.694+0000 7f926ffff700 1 -- 172.21.15.26:0/170209650 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f9268080a50 con 0x7f92780f6ff0 2021-11-03T17:58:51.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.694+0000 7f92777fe700 1 --2- 172.21.15.26:0/170209650 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9264064090 0x7f9264066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:58:51.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.695+0000 7f92777fe700 1 --2- 172.21.15.26:0/170209650 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9264064090 0x7f9264066550 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f9260009830 tx=0x7f9260009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:58:51.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.698+0000 7f926ffff700 1 -- 172.21.15.26:0/170209650 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f9268052d50 con 0x7f92780f6ff0 2021-11-03T17:58:51.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.878+0000 7f927dd45700 1 -- 172.21.15.26:0/170209650 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f92780008d0 con 0x7f9264064090 2021-11-03T17:58:51.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.880+0000 7f926ffff700 1 -- 172.21.15.26:0/170209650 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f92780008d0 con 0x7f9264064090 2021-11-03T17:58:51.879 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.882+0000 7f927dd45700 1 -- 172.21.15.26:0/170209650 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9264064090 msgr2=0x7f9264066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:58:51.879 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.882+0000 7f927dd45700 1 --2- 172.21.15.26:0/170209650 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9264064090 0x7f9264066550 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f9260009830 tx=0x7f9260009b30).stop 2021-11-03T17:58:51.880 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.882+0000 7f927dd45700 1 -- 172.21.15.26:0/170209650 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92780f6ff0 msgr2=0x7f9278069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:58:51.880 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.882+0000 7f927dd45700 1 --2- 172.21.15.26:0/170209650 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92780f6ff0 0x7f9278069e20 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7f9268002700 tx=0x7f9268009e00).stop 2021-11-03T17:58:51.880 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.882+0000 7f927dd45700 1 -- 172.21.15.26:0/170209650 shutdown_connections 2021-11-03T17:58:51.880 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.882+0000 7f927dd45700 1 --2- 172.21.15.26:0/170209650 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9264064090 0x7f9264066550 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:51.880 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.882+0000 7f927dd45700 1 --2- 172.21.15.26:0/170209650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92780f66e0 0x7f927806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:51.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.882+0000 7f927dd45700 1 --2- 172.21.15.26:0/170209650 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92780f6ff0 0x7f9278069e20 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:51.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.882+0000 7f927dd45700 1 -- 172.21.15.26:0/170209650 >> 172.21.15.26:0/170209650 conn(0x7f92780f1f00 msgr2=0x7f92780fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:58:51.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.882+0000 7f927dd45700 1 -- 172.21.15.26:0/170209650 shutdown_connections 2021-11-03T17:58:51.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.882+0000 7f927dd45700 1 -- 172.21.15.26:0/170209650 wait complete. 2021-11-03T17:58:51.889 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:58:51.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.982+0000 7fdfcc582700 1 -- 172.21.15.26:0/2662794859 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfc40f66e0 msgr2=0x7fdfc40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:58:51.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.982+0000 7fdfcc582700 1 --2- 172.21.15.26:0/2662794859 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfc40f66e0 0x7fdfc40f6b00 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 rx=0x7fdfb4004660 tx=0x7fdfb4009b30).stop 2021-11-03T17:58:51.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.982+0000 7fdfcc582700 1 -- 172.21.15.26:0/2662794859 shutdown_connections 2021-11-03T17:58:51.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.982+0000 7fdfcc582700 1 --2- 172.21.15.26:0/2662794859 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdfc40f6ff0 0x7fdfc40f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:51.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.982+0000 7fdfcc582700 1 --2- 172.21.15.26:0/2662794859 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfc40f66e0 0x7fdfc40f6b00 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:51.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.982+0000 7fdfcc582700 1 -- 172.21.15.26:0/2662794859 >> 172.21.15.26:0/2662794859 conn(0x7fdfc40f1f00 msgr2=0x7fdfc40f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:58:51.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.982+0000 7fdfcc582700 1 -- 172.21.15.26:0/2662794859 shutdown_connections 2021-11-03T17:58:51.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.982+0000 7fdfcc582700 1 -- 172.21.15.26:0/2662794859 wait complete. 2021-11-03T17:58:51.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.982+0000 7fdfcc582700 1 Processor -- start 2021-11-03T17:58:51.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.983+0000 7fdfcc582700 1 -- start start 2021-11-03T17:58:51.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.983+0000 7fdfcc582700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfc40f66e0 0x7fdfc4106f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:58:51.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.983+0000 7fdfcc582700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdfc40f6ff0 0x7fdfc41073f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:58:51.984 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.983+0000 7fdfcc582700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc41079a0 con 0x7fdfc40f66e0 2021-11-03T17:58:51.984 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.983+0000 7fdfcc582700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc4107ae0 con 0x7fdfc40f6ff0 2021-11-03T17:58:51.984 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.983+0000 7fdfca31e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfc40f66e0 0x7fdfc4106f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:58:51.984 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.983+0000 7fdfca31e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfc40f66e0 0x7fdfc4106f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57450/0 (socket says 172.21.15.26:57450) 2021-11-03T17:58:51.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.983+0000 7fdfca31e700 1 -- 172.21.15.26:0/1708320163 learned_addr learned my addr 172.21.15.26:0/1708320163 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:58:51.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.983+0000 7fdfc9b1d700 1 --2- 172.21.15.26:0/1708320163 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdfc40f6ff0 0x7fdfc41073f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:58:51.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.983+0000 7fdfca31e700 1 -- 172.21.15.26:0/1708320163 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdfc40f6ff0 msgr2=0x7fdfc41073f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:58:51.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.983+0000 7fdfca31e700 1 --2- 172.21.15.26:0/1708320163 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdfc40f6ff0 0x7fdfc41073f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:51.986 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.983+0000 7fdfca31e700 1 -- 172.21.15.26:0/1708320163 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb4005040 con 0x7fdfc40f66e0 2021-11-03T17:58:51.986 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.983+0000 7fdfca31e700 1 --2- 172.21.15.26:0/1708320163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfc40f66e0 0x7fdfc4106f00 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7fdfb4009990 tx=0x7fdfb4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:58:51.986 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.983+0000 7fdfbaffd700 1 -- 172.21.15.26:0/1708320163 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfb4018070 con 0x7fdfc40f66e0 2021-11-03T17:58:51.986 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.983+0000 7fdfbaffd700 1 -- 172.21.15.26:0/1708320163 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdfb4007ba0 con 0x7fdfc40f66e0 2021-11-03T17:58:51.986 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.983+0000 7fdfcc582700 1 -- 172.21.15.26:0/1708320163 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc4108420 con 0x7fdfc40f66e0 2021-11-03T17:58:51.987 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.983+0000 7fdfbaffd700 1 -- 172.21.15.26:0/1708320163 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfb401c3c0 con 0x7fdfc40f66e0 2021-11-03T17:58:51.987 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.984+0000 7fdfcc582700 1 -- 172.21.15.26:0/1708320163 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc4108980 con 0x7fdfc40f66e0 2021-11-03T17:58:51.988 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.984+0000 7fdfcc582700 1 -- 172.21.15.26:0/1708320163 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc4045ad0 con 0x7fdfc40f66e0 2021-11-03T17:58:51.988 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.985+0000 7fdfbaffd700 1 -- 172.21.15.26:0/1708320163 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fdfb401d420 con 0x7fdfc40f66e0 2021-11-03T17:58:51.989 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.985+0000 7fdfbaffd700 1 --2- 172.21.15.26:0/1708320163 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdfb00640b0 0x7fdfb0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:58:51.989 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.985+0000 7fdfbaffd700 1 -- 172.21.15.26:0/1708320163 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fdfb4082340 con 0x7fdfc40f66e0 2021-11-03T17:58:51.989 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.985+0000 7fdfc9b1d700 1 --2- 172.21.15.26:0/1708320163 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdfb00640b0 0x7fdfb0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:58:51.989 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.986+0000 7fdfc9b1d700 1 --2- 172.21.15.26:0/1708320163 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdfb00640b0 0x7fdfb0066570 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7fdfc0004ce0 tx=0x7fdfc000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:58:51.990 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:51.989+0000 7fdfbaffd700 1 -- 172.21.15.26:0/1708320163 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fdfb4054760 con 0x7fdfc40f66e0 2021-11-03T17:58:52.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.161+0000 7fdfcc582700 1 -- 172.21.15.26:0/1708320163 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdfc40ff080 con 0x7fdfb00640b0 2021-11-03T17:58:52.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.176+0000 7fdfbaffd700 1 -- 172.21.15.26:0/1708320163 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fdfc000f040 con 0x7fdfb00640b0 2021-11-03T17:58:52.174 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:58:52.174 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (70m) 9m ago 71m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:58:52.175 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (62m) 9m ago 71m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:58:52.175 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (62m) 8m ago 70m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:58:52.175 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (69m) 9m ago 71m 41.4M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:58:52.176 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (63m) 9m ago 66m 25.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:58:52.177 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (63m) 9m ago 66m 26.0M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:58:52.177 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (66m) 8m ago 66m 26.2M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:58:52.177 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (66m) 8m ago 66m 26.5M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:58:52.178 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (63m) 9m ago 72m 547M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:58:52.178 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (63m) 8m ago 70m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:58:52.178 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (63m) 9m ago 72m 242M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:58:52.179 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (62m) 8m ago 70m 117M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:58:52.179 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (70m) 9m ago 70m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:58:52.179 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (70m) 8m ago 70m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:58:52.180 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (61m) 9m ago 69m 271M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:58:52.180 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (61m) 9m ago 69m 291M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:58:52.181 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (60m) 9m ago 68m 243M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:58:52.181 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (60m) 8m ago 68m 312M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:58:52.182 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (59m) 8m ago 68m 265M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:58:52.182 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (59m) 8m ago 68m 255M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:58:52.184 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (69m) 9m ago 70m 58.9M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:58:52.186 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.178+0000 7fdfcc582700 1 -- 172.21.15.26:0/1708320163 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdfb00640b0 msgr2=0x7fdfb0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:58:52.186 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.178+0000 7fdfcc582700 1 --2- 172.21.15.26:0/1708320163 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdfb00640b0 0x7fdfb0066570 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7fdfc0004ce0 tx=0x7fdfc000b040).stop 2021-11-03T17:58:52.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.178+0000 7fdfcc582700 1 -- 172.21.15.26:0/1708320163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfc40f66e0 msgr2=0x7fdfc4106f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:58:52.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.178+0000 7fdfcc582700 1 --2- 172.21.15.26:0/1708320163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfc40f66e0 0x7fdfc4106f00 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7fdfb4009990 tx=0x7fdfb4009b30).stop 2021-11-03T17:58:52.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.178+0000 7fdfcc582700 1 -- 172.21.15.26:0/1708320163 shutdown_connections 2021-11-03T17:58:52.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.178+0000 7fdfcc582700 1 --2- 172.21.15.26:0/1708320163 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdfb00640b0 0x7fdfb0066570 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:52.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.178+0000 7fdfcc582700 1 --2- 172.21.15.26:0/1708320163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfc40f66e0 0x7fdfc4106f00 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:52.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.178+0000 7fdfcc582700 1 --2- 172.21.15.26:0/1708320163 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdfc40f6ff0 0x7fdfc41073f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:52.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.178+0000 7fdfcc582700 1 -- 172.21.15.26:0/1708320163 >> 172.21.15.26:0/1708320163 conn(0x7fdfc40f1f00 msgr2=0x7fdfc40fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:58:52.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.178+0000 7fdfcc582700 1 -- 172.21.15.26:0/1708320163 shutdown_connections 2021-11-03T17:58:52.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.178+0000 7fdfcc582700 1 -- 172.21.15.26:0/1708320163 wait complete. 2021-11-03T17:58:52.277 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.277+0000 7ffa7cf82700 1 -- 172.21.15.26:0/274875853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa780f66e0 msgr2=0x7ffa780f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:58:52.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.277+0000 7ffa7cf82700 1 --2- 172.21.15.26:0/274875853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa780f66e0 0x7ffa780f6b40 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 rx=0x7ffa600099e0 tx=0x7ffa60004d10).stop 2021-11-03T17:58:52.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.277+0000 7ffa7cf82700 1 -- 172.21.15.26:0/274875853 shutdown_connections 2021-11-03T17:58:52.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.277+0000 7ffa7cf82700 1 --2- 172.21.15.26:0/274875853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa780f66e0 0x7ffa780f6b40 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:52.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.277+0000 7ffa7cf82700 1 --2- 172.21.15.26:0/274875853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa780f5440 0x7ffa780f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:52.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.277+0000 7ffa7cf82700 1 -- 172.21.15.26:0/274875853 >> 172.21.15.26:0/274875853 conn(0x7ffa780f0ba0 msgr2=0x7ffa780f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:58:52.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.277+0000 7ffa7cf82700 1 -- 172.21.15.26:0/274875853 shutdown_connections 2021-11-03T17:58:52.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.278+0000 7ffa7cf82700 1 -- 172.21.15.26:0/274875853 wait complete. 2021-11-03T17:58:52.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.278+0000 7ffa7cf82700 1 Processor -- start 2021-11-03T17:58:52.282 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.278+0000 7ffa7cf82700 1 -- start start 2021-11-03T17:58:52.283 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.278+0000 7ffa7cf82700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa780f5440 0x7ffa7810c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:58:52.283 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.278+0000 7ffa7cf82700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa780602b0 0x7ffa7810e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:58:52.284 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.278+0000 7ffa7cf82700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa78107b70 con 0x7ffa780f5440 2021-11-03T17:58:52.284 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.278+0000 7ffa7cf82700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7810eb20 con 0x7ffa780602b0 2021-11-03T17:58:52.285 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.279+0000 7ffa777fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa780f5440 0x7ffa7810c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:58:52.285 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.279+0000 7ffa777fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa780f5440 0x7ffa7810c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57460/0 (socket says 172.21.15.26:57460) 2021-11-03T17:58:52.285 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.279+0000 7ffa777fe700 1 -- 172.21.15.26:0/2583172922 learned_addr learned my addr 172.21.15.26:0/2583172922 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:58:52.286 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.279+0000 7ffa76ffd700 1 --2- 172.21.15.26:0/2583172922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa780602b0 0x7ffa7810e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:58:52.286 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.279+0000 7ffa777fe700 1 -- 172.21.15.26:0/2583172922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa780602b0 msgr2=0x7ffa7810e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:58:52.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.279+0000 7ffa777fe700 1 --2- 172.21.15.26:0/2583172922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa780602b0 0x7ffa7810e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:52.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.279+0000 7ffa777fe700 1 -- 172.21.15.26:0/2583172922 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa60009640 con 0x7ffa780f5440 2021-11-03T17:58:52.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.279+0000 7ffa777fe700 1 --2- 172.21.15.26:0/2583172922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa780f5440 0x7ffa7810c130 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7ffa68002700 tx=0x7ffa68009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:58:52.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.279+0000 7ffa6ffff700 1 -- 172.21.15.26:0/2583172922 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa680079c0 con 0x7ffa780f5440 2021-11-03T17:58:52.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.279+0000 7ffa6ffff700 1 -- 172.21.15.26:0/2583172922 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ffa6800f040 con 0x7ffa780f5440 2021-11-03T17:58:52.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.279+0000 7ffa7cf82700 1 -- 172.21.15.26:0/2583172922 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa7810edb0 con 0x7ffa780f5440 2021-11-03T17:58:52.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.279+0000 7ffa6ffff700 1 -- 172.21.15.26:0/2583172922 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa68014860 con 0x7ffa780f5440 2021-11-03T17:58:52.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.279+0000 7ffa7cf82700 1 -- 172.21.15.26:0/2583172922 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa7810f260 con 0x7ffa780f5440 2021-11-03T17:58:52.290 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.280+0000 7ffa7cf82700 1 -- 172.21.15.26:0/2583172922 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa78045ad0 con 0x7ffa780f5440 2021-11-03T17:58:52.290 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.280+0000 7ffa6ffff700 1 -- 172.21.15.26:0/2583172922 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ffa6801b060 con 0x7ffa780f5440 2021-11-03T17:58:52.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.281+0000 7ffa6ffff700 1 --2- 172.21.15.26:0/2583172922 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffa64064100 0x7ffa640665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:58:52.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.281+0000 7ffa6ffff700 1 -- 172.21.15.26:0/2583172922 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ffa68080650 con 0x7ffa780f5440 2021-11-03T17:58:52.294 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.281+0000 7ffa76ffd700 1 --2- 172.21.15.26:0/2583172922 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffa64064100 0x7ffa640665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:58:52.294 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.281+0000 7ffa76ffd700 1 --2- 172.21.15.26:0/2583172922 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffa64064100 0x7ffa640665c0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7ffa60003380 tx=0x7ffa60004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:58:52.295 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.285+0000 7ffa6ffff700 1 -- 172.21.15.26:0/2583172922 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ffa680529b0 con 0x7ffa780f5440 2021-11-03T17:58:52.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.514+0000 7ffa7cf82700 1 -- 172.21.15.26:0/2583172922 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ffa78027a00 con 0x7ffa780f5440 2021-11-03T17:58:52.518 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.514+0000 7ffa6ffff700 1 -- 172.21.15.26:0/2583172922 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7ffa680192e0 con 0x7ffa780f5440 2021-11-03T17:58:52.520 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:58:52.521 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:58:52.527 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:58:52.530 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:58:52.531 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:58:52.533 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:58:52.535 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:58:52.536 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:58:52.540 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:58:52.540 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:58:52.541 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:58:52.541 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:58:52.541 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:58:52.541 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:58:52.542 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:58:52.542 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:58:52.542 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:58:52.542 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:58:52.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.516+0000 7ffa7cf82700 1 -- 172.21.15.26:0/2583172922 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffa64064100 msgr2=0x7ffa640665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:58:52.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.516+0000 7ffa7cf82700 1 --2- 172.21.15.26:0/2583172922 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffa64064100 0x7ffa640665c0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7ffa60003380 tx=0x7ffa60004d10).stop 2021-11-03T17:58:52.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.516+0000 7ffa7cf82700 1 -- 172.21.15.26:0/2583172922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa780f5440 msgr2=0x7ffa7810c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:58:52.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.516+0000 7ffa7cf82700 1 --2- 172.21.15.26:0/2583172922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa780f5440 0x7ffa7810c130 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7ffa68002700 tx=0x7ffa68009d80).stop 2021-11-03T17:58:52.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.516+0000 7ffa7cf82700 1 -- 172.21.15.26:0/2583172922 shutdown_connections 2021-11-03T17:58:52.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.516+0000 7ffa7cf82700 1 --2- 172.21.15.26:0/2583172922 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffa64064100 0x7ffa640665c0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:52.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.516+0000 7ffa7cf82700 1 --2- 172.21.15.26:0/2583172922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa780f5440 0x7ffa7810c130 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:52.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.516+0000 7ffa7cf82700 1 --2- 172.21.15.26:0/2583172922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa780602b0 0x7ffa7810e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:52.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.516+0000 7ffa7cf82700 1 -- 172.21.15.26:0/2583172922 >> 172.21.15.26:0/2583172922 conn(0x7ffa780f0ba0 msgr2=0x7ffa780fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:58:52.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.516+0000 7ffa7cf82700 1 -- 172.21.15.26:0/2583172922 shutdown_connections 2021-11-03T17:58:52.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.516+0000 7ffa7cf82700 1 -- 172.21.15.26:0/2583172922 wait complete. 2021-11-03T17:58:52.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.617+0000 7f9f8e5e1700 1 -- 172.21.15.26:0/3727702347 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f88060450 msgr2=0x7f9f880fb6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:58:52.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.617+0000 7f9f8e5e1700 1 --2- 172.21.15.26:0/3727702347 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f88060450 0x7f9f880fb6b0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7f9f78004660 tx=0x7f9f78009b30).stop 2021-11-03T17:58:52.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.617+0000 7f9f8e5e1700 1 -- 172.21.15.26:0/3727702347 shutdown_connections 2021-11-03T17:58:52.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.617+0000 7f9f8e5e1700 1 --2- 172.21.15.26:0/3727702347 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9f880fbba0 0x7f9f880fdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:52.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.617+0000 7f9f8e5e1700 1 --2- 172.21.15.26:0/3727702347 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f88060450 0x7f9f880fb6b0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:52.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.617+0000 7f9f8e5e1700 1 -- 172.21.15.26:0/3727702347 >> 172.21.15.26:0/3727702347 conn(0x7f9f880f0d70 msgr2=0x7f9f880f3190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:58:52.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.617+0000 7f9f8e5e1700 1 -- 172.21.15.26:0/3727702347 shutdown_connections 2021-11-03T17:58:52.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.617+0000 7f9f8e5e1700 1 -- 172.21.15.26:0/3727702347 wait complete. 2021-11-03T17:58:52.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.617+0000 7f9f8e5e1700 1 Processor -- start 2021-11-03T17:58:52.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.617+0000 7f9f8e5e1700 1 -- start start 2021-11-03T17:58:52.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.618+0000 7f9f8e5e1700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9f88060450 0x7f9f88109130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:58:52.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.618+0000 7f9f8e5e1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f880fbba0 0x7f9f88109620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:58:52.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.618+0000 7f9f8e5e1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f88109bd0 con 0x7f9f880fbba0 2021-11-03T17:58:52.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.618+0000 7f9f8e5e1700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f88109d10 con 0x7f9f88060450 2021-11-03T17:58:52.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.618+0000 7f9f877fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f880fbba0 0x7f9f88109620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:58:52.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.618+0000 7f9f877fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f880fbba0 0x7f9f88109620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57472/0 (socket says 172.21.15.26:57472) 2021-11-03T17:58:52.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.618+0000 7f9f877fe700 1 -- 172.21.15.26:0/4143989038 learned_addr learned my addr 172.21.15.26:0/4143989038 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:58:52.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.618+0000 7f9f87fff700 1 --2- 172.21.15.26:0/4143989038 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9f88060450 0x7f9f88109130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:58:52.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.618+0000 7f9f877fe700 1 -- 172.21.15.26:0/4143989038 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9f88060450 msgr2=0x7f9f88109130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:58:52.622 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.618+0000 7f9f877fe700 1 --2- 172.21.15.26:0/4143989038 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9f88060450 0x7f9f88109130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:52.622 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.618+0000 7f9f877fe700 1 -- 172.21.15.26:0/4143989038 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f78005040 con 0x7f9f880fbba0 2021-11-03T17:58:52.622 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.618+0000 7f9f877fe700 1 --2- 172.21.15.26:0/4143989038 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f880fbba0 0x7f9f88109620 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 rx=0x7f9f7c002700 tx=0x7f9f7c009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:58:52.622 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.619+0000 7f9f84ff9700 1 -- 172.21.15.26:0/4143989038 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f7c0079c0 con 0x7f9f880fbba0 2021-11-03T17:58:52.622 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.619+0000 7f9f8e5e1700 1 -- 172.21.15.26:0/4143989038 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f8810a6b0 con 0x7f9f880fbba0 2021-11-03T17:58:52.623 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.619+0000 7f9f84ff9700 1 -- 172.21.15.26:0/4143989038 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9f7c00f040 con 0x7f9f880fbba0 2021-11-03T17:58:52.623 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.619+0000 7f9f84ff9700 1 -- 172.21.15.26:0/4143989038 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f7c014740 con 0x7f9f880fbba0 2021-11-03T17:58:52.623 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.619+0000 7f9f8e5e1700 1 -- 172.21.15.26:0/4143989038 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f8810ac70 con 0x7f9f880fbba0 2021-11-03T17:58:52.623 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.620+0000 7f9f8e5e1700 1 -- 172.21.15.26:0/4143989038 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f88045ad0 con 0x7f9f880fbba0 2021-11-03T17:58:52.624 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.621+0000 7f9f84ff9700 1 -- 172.21.15.26:0/4143989038 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f9f7c01b060 con 0x7f9f880fbba0 2021-11-03T17:58:52.624 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.621+0000 7f9f84ff9700 1 --2- 172.21.15.26:0/4143989038 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9f700640b0 0x7f9f70066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:58:52.624 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.621+0000 7f9f84ff9700 1 -- 172.21.15.26:0/4143989038 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f9f7c0807e0 con 0x7f9f880fbba0 2021-11-03T17:58:52.624 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.621+0000 7f9f87fff700 1 --2- 172.21.15.26:0/4143989038 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9f700640b0 0x7f9f70066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:58:52.624 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.622+0000 7f9f87fff700 1 --2- 172.21.15.26:0/4143989038 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9f700640b0 0x7f9f70066570 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f9f78005010 tx=0x7f9f78009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:58:52.625 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.625+0000 7f9f84ff9700 1 -- 172.21.15.26:0/4143989038 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f9f7c052b60 con 0x7f9f880fbba0 2021-11-03T17:58:52.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.830+0000 7f9f8e5e1700 1 -- 172.21.15.26:0/4143989038 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9f88027a00 con 0x7f9f880fbba0 2021-11-03T17:58:52.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.830+0000 7f9f84ff9700 1 -- 172.21.15.26:0/4143989038 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f9f7c019070 con 0x7f9f880fbba0 2021-11-03T17:58:52.828 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:58:52.828 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:58:52.828 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:58:52.829 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:58:52.829 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:58:52.829 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:58:52.829 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:58:52.829 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:58:52.830 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:58:52.830 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:58:52.830 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:58:52.830 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:58:52.831 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:58:52.831 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:58:52.831 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:58:52.831 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:58:52.832 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:58:52.832 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:58:52.832 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:58:52.832 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:58:52.832 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:58:52.833 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:58:52.833 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:58:52.833 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:58:52.833 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:58:52.834 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:58:52.834 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:58:52.834 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:58:52.834 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:58:52.834 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:58:52.835 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:58:52.835 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:58:52.835 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:58:52.835 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:58:52.836 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:58:52.836 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:58:52.836 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:58:52.836 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:58:52.836 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:58:52.837 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.832+0000 7f9f8e5e1700 1 -- 172.21.15.26:0/4143989038 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9f700640b0 msgr2=0x7f9f70066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:58:52.837 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.832+0000 7f9f8e5e1700 1 --2- 172.21.15.26:0/4143989038 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9f700640b0 0x7f9f70066570 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f9f78005010 tx=0x7f9f78009b30).stop 2021-11-03T17:58:52.838 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.832+0000 7f9f8e5e1700 1 -- 172.21.15.26:0/4143989038 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f880fbba0 msgr2=0x7f9f88109620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:58:52.838 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.832+0000 7f9f8e5e1700 1 --2- 172.21.15.26:0/4143989038 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f880fbba0 0x7f9f88109620 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 rx=0x7f9f7c002700 tx=0x7f9f7c009d60).stop 2021-11-03T17:58:52.838 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.832+0000 7f9f8e5e1700 1 -- 172.21.15.26:0/4143989038 shutdown_connections 2021-11-03T17:58:52.838 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.832+0000 7f9f8e5e1700 1 --2- 172.21.15.26:0/4143989038 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9f700640b0 0x7f9f70066570 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:52.839 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.832+0000 7f9f8e5e1700 1 --2- 172.21.15.26:0/4143989038 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9f88060450 0x7f9f88109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:52.839 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.832+0000 7f9f8e5e1700 1 --2- 172.21.15.26:0/4143989038 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f880fbba0 0x7f9f88109620 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:58:52.839 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.832+0000 7f9f8e5e1700 1 -- 172.21.15.26:0/4143989038 >> 172.21.15.26:0/4143989038 conn(0x7f9f880f0d70 msgr2=0x7f9f880f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:58:52.839 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.832+0000 7f9f8e5e1700 1 -- 172.21.15.26:0/4143989038 shutdown_connections 2021-11-03T17:58:52.840 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:58:52.832+0000 7f9f8e5e1700 1 -- 172.21.15.26:0/4143989038 wait complete. 2021-11-03T17:58:52.840 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:58:52.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:52 smithi026 ceph-mon[96795]: pgmap v1926: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:52.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:52 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2583172922' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:58:52.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:52 smithi194 ceph-mon[65619]: pgmap v1926: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:52.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:52 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2583172922' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:58:53.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:53 smithi194 ceph-mon[65619]: from='client.36124 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:58:53.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:53 smithi194 ceph-mon[65619]: from='client.36128 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:58:53.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:53 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/4143989038' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:58:53.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:53 smithi026 ceph-mon[96795]: from='client.36124 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:58:53.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:53 smithi026 ceph-mon[96795]: from='client.36128 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:58:53.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:53 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/4143989038' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:58:54.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:54 smithi026 ceph-mon[96795]: pgmap v1927: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:54.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:54 smithi194 ceph-mon[65619]: pgmap v1927: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:56.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:56 smithi026 ceph-mon[96795]: pgmap v1928: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:56.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:56 smithi194 ceph-mon[65619]: pgmap v1928: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:58.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:58:58 smithi026 ceph-mon[96795]: pgmap v1929: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:58:58.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:58:58 smithi194 ceph-mon[65619]: pgmap v1929: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:00.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:00 smithi026 ceph-mon[96795]: pgmap v1930: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:00.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:00 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:59:00.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:00 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:59:00.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:00 smithi194 ceph-mon[65619]: pgmap v1930: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:00.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:00 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:59:00.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:00 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:59:02.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:02 smithi026 ceph-mon[96795]: pgmap v1931: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:02.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:02 smithi194 ceph-mon[65619]: pgmap v1931: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:04.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:04 smithi026 ceph-mon[96795]: pgmap v1932: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:04.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:04 smithi194 ceph-mon[65619]: pgmap v1932: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:06.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:06 smithi026 ceph-mon[96795]: pgmap v1933: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:06.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:06 smithi194 ceph-mon[65619]: pgmap v1933: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:08.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:08 smithi026 ceph-mon[96795]: pgmap v1934: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:08.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:08 smithi194 ceph-mon[65619]: pgmap v1934: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:10.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:10 smithi026 ceph-mon[96795]: pgmap v1935: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:10.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:10 smithi194 ceph-mon[65619]: pgmap v1935: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:12.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:12 smithi026 ceph-mon[96795]: pgmap v1936: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:12.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:12 smithi194 ceph-mon[65619]: pgmap v1936: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:14.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:14 smithi026 ceph-mon[96795]: pgmap v1937: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:14.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:14 smithi194 ceph-mon[65619]: pgmap v1937: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:15.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:15 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:59:15.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:15 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:59:15.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:15 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:59:15.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:15 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:59:16.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:16 smithi026 ceph-mon[96795]: pgmap v1938: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:16.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:16 smithi194 ceph-mon[65619]: pgmap v1938: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:18.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:18 smithi026 ceph-mon[96795]: pgmap v1939: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:18.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:18 smithi194 ceph-mon[65619]: pgmap v1939: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:20.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:20 smithi026 ceph-mon[96795]: pgmap v1940: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:20.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:20 smithi194 ceph-mon[65619]: pgmap v1940: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:22.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:22 smithi026 ceph-mon[96795]: pgmap v1941: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:22.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:22.948+0000 7f4d3959d700 1 -- 172.21.15.26:0/3180466404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d340f5ef0 msgr2=0x7f4d340f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:59:22.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:22.948+0000 7f4d3959d700 1 --2- 172.21.15.26:0/3180466404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d340f5ef0 0x7f4d340f6920 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 rx=0x7f4d1c004660 tx=0x7f4d1c009b30).stop 2021-11-03T17:59:22.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:22.948+0000 7f4d3959d700 1 -- 172.21.15.26:0/3180466404 shutdown_connections 2021-11-03T17:59:22.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:22.948+0000 7f4d3959d700 1 --2- 172.21.15.26:0/3180466404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d340f5ef0 0x7f4d340f6920 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:22.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:22.948+0000 7f4d3959d700 1 --2- 172.21.15.26:0/3180466404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d340f55e0 0x7f4d340f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:22.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:22.948+0000 7f4d3959d700 1 -- 172.21.15.26:0/3180466404 >> 172.21.15.26:0/3180466404 conn(0x7f4d340f0de0 msgr2=0x7f4d340f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:59:22.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:22.948+0000 7f4d3959d700 1 -- 172.21.15.26:0/3180466404 shutdown_connections 2021-11-03T17:59:22.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:22.948+0000 7f4d3959d700 1 -- 172.21.15.26:0/3180466404 wait complete. 2021-11-03T17:59:22.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:22.949+0000 7f4d3959d700 1 Processor -- start 2021-11-03T17:59:22.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:22.949+0000 7f4d3959d700 1 -- start start 2021-11-03T17:59:22.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:22.949+0000 7f4d3959d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d340f55e0 0x7f4d34105e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:59:22.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:22.949+0000 7f4d3959d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d340f5ef0 0x7f4d34106380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:59:22.950 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:22.949+0000 7f4d3959d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d34106930 con 0x7f4d340f5ef0 2021-11-03T17:59:22.950 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:22.949+0000 7f4d3959d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d34106a70 con 0x7f4d340f55e0 2021-11-03T17:59:22.950 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:22.949+0000 7f4d327fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d340f5ef0 0x7f4d34106380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:59:22.950 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:22.949+0000 7f4d327fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d340f5ef0 0x7f4d34106380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57496/0 (socket says 172.21.15.26:57496) 2021-11-03T17:59:22.951 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:22.949+0000 7f4d327fc700 1 -- 172.21.15.26:0/3416257537 learned_addr learned my addr 172.21.15.26:0/3416257537 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:59:22.951 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:22.949+0000 7f4d32ffd700 1 --2- 172.21.15.26:0/3416257537 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d340f55e0 0x7f4d34105e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:59:22.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:22.950+0000 7f4d327fc700 1 -- 172.21.15.26:0/3416257537 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d340f55e0 msgr2=0x7f4d34105e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:59:22.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:22.950+0000 7f4d327fc700 1 --2- 172.21.15.26:0/3416257537 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d340f55e0 0x7f4d34105e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:22.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:22.950+0000 7f4d327fc700 1 -- 172.21.15.26:0/3416257537 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d1c005040 con 0x7f4d340f5ef0 2021-11-03T17:59:22.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:22.950+0000 7f4d327fc700 1 --2- 172.21.15.26:0/3416257537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d340f5ef0 0x7f4d34106380 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7f4d1c009990 tx=0x7f4d1c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:59:22.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:22.950+0000 7f4d2b7fe700 1 -- 172.21.15.26:0/3416257537 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d1c018070 con 0x7f4d340f5ef0 2021-11-03T17:59:22.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:22.950+0000 7f4d2b7fe700 1 -- 172.21.15.26:0/3416257537 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4d1c007ba0 con 0x7f4d340f5ef0 2021-11-03T17:59:22.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:22.950+0000 7f4d3959d700 1 -- 172.21.15.26:0/3416257537 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d341073b0 con 0x7f4d340f5ef0 2021-11-03T17:59:22.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:22.950+0000 7f4d2b7fe700 1 -- 172.21.15.26:0/3416257537 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d1c01c3c0 con 0x7f4d340f5ef0 2021-11-03T17:59:22.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:22.950+0000 7f4d3959d700 1 -- 172.21.15.26:0/3416257537 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d34107910 con 0x7f4d340f5ef0 2021-11-03T17:59:22.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:22.951+0000 7f4d3959d700 1 -- 172.21.15.26:0/3416257537 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d34045ad0 con 0x7f4d340f5ef0 2021-11-03T17:59:22.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:22.951+0000 7f4d2b7fe700 1 -- 172.21.15.26:0/3416257537 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f4d1c01d420 con 0x7f4d340f5ef0 2021-11-03T17:59:22.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:22.952+0000 7f4d2b7fe700 1 --2- 172.21.15.26:0/3416257537 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4d200640b0 0x7f4d20066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:59:22.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:22.952+0000 7f4d2b7fe700 1 -- 172.21.15.26:0/3416257537 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f4d1c082360 con 0x7f4d340f5ef0 2021-11-03T17:59:22.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:22.952+0000 7f4d32ffd700 1 --2- 172.21.15.26:0/3416257537 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4d200640b0 0x7f4d20066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:59:22.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:22.953+0000 7f4d32ffd700 1 --2- 172.21.15.26:0/3416257537 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4d200640b0 0x7f4d20066570 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f4d2c004c40 tx=0x7f4d2c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:59:22.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:22.956+0000 7f4d2b7fe700 1 -- 172.21.15.26:0/3416257537 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f4d1c054720 con 0x7f4d340f5ef0 2021-11-03T17:59:22.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:22 smithi194 ceph-mon[65619]: pgmap v1941: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:23.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.137+0000 7f4d3959d700 1 -- 172.21.15.26:0/3416257537 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d340fde40 con 0x7f4d200640b0 2021-11-03T17:59:23.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.138+0000 7f4d2b7fe700 1 -- 172.21.15.26:0/3416257537 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f4d340fde40 con 0x7f4d200640b0 2021-11-03T17:59:23.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.140+0000 7f4d3959d700 1 -- 172.21.15.26:0/3416257537 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4d200640b0 msgr2=0x7f4d20066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:59:23.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.140+0000 7f4d3959d700 1 --2- 172.21.15.26:0/3416257537 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4d200640b0 0x7f4d20066570 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f4d2c004c40 tx=0x7f4d2c00b040).stop 2021-11-03T17:59:23.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.140+0000 7f4d3959d700 1 -- 172.21.15.26:0/3416257537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d340f5ef0 msgr2=0x7f4d34106380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:59:23.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.140+0000 7f4d3959d700 1 --2- 172.21.15.26:0/3416257537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d340f5ef0 0x7f4d34106380 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7f4d1c009990 tx=0x7f4d1c009b30).stop 2021-11-03T17:59:23.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.140+0000 7f4d3959d700 1 -- 172.21.15.26:0/3416257537 shutdown_connections 2021-11-03T17:59:23.139 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.140+0000 7f4d3959d700 1 --2- 172.21.15.26:0/3416257537 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4d200640b0 0x7f4d20066570 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:23.139 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.140+0000 7f4d3959d700 1 --2- 172.21.15.26:0/3416257537 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d340f55e0 0x7f4d34105e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:23.140 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.140+0000 7f4d3959d700 1 --2- 172.21.15.26:0/3416257537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d340f5ef0 0x7f4d34106380 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:23.140 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.140+0000 7f4d3959d700 1 -- 172.21.15.26:0/3416257537 >> 172.21.15.26:0/3416257537 conn(0x7f4d340f0de0 msgr2=0x7f4d340fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:59:23.141 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.140+0000 7f4d3959d700 1 -- 172.21.15.26:0/3416257537 shutdown_connections 2021-11-03T17:59:23.141 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.140+0000 7f4d3959d700 1 -- 172.21.15.26:0/3416257537 wait complete. 2021-11-03T17:59:23.146 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:59:23.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.240+0000 7fc0f48a3700 1 -- 172.21.15.26:0/2477205721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0f00f86e0 msgr2=0x7fc0f00f4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:59:23.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.240+0000 7fc0f48a3700 1 --2- 172.21.15.26:0/2477205721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0f00f86e0 0x7fc0f00f4860 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 rx=0x7fc0e4004660 tx=0x7fc0e4009b30).stop 2021-11-03T17:59:23.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.240+0000 7fc0f48a3700 1 -- 172.21.15.26:0/2477205721 shutdown_connections 2021-11-03T17:59:23.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.240+0000 7fc0f48a3700 1 --2- 172.21.15.26:0/2477205721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0f00f86e0 0x7fc0f00f4860 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:23.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.240+0000 7fc0f48a3700 1 --2- 172.21.15.26:0/2477205721 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0f00f7d40 0x7fc0f00f8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:23.247 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.240+0000 7fc0f48a3700 1 -- 172.21.15.26:0/2477205721 >> 172.21.15.26:0/2477205721 conn(0x7fc0f00f04c0 msgr2=0x7fc0f00f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:59:23.247 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.240+0000 7fc0f48a3700 1 -- 172.21.15.26:0/2477205721 shutdown_connections 2021-11-03T17:59:23.247 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.240+0000 7fc0f48a3700 1 -- 172.21.15.26:0/2477205721 wait complete. 2021-11-03T17:59:23.247 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.240+0000 7fc0f48a3700 1 Processor -- start 2021-11-03T17:59:23.248 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.241+0000 7fc0f48a3700 1 -- start start 2021-11-03T17:59:23.249 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.241+0000 7fc0f48a3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0f00f7d40 0x7fc0f00f7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:59:23.249 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.241+0000 7fc0f48a3700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0f00f86e0 0x7fc0f00f5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:59:23.249 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.241+0000 7fc0f48a3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f00f5ff0 con 0x7fc0f00f7d40 2021-11-03T17:59:23.249 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.241+0000 7fc0f48a3700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f00f6130 con 0x7fc0f00f86e0 2021-11-03T17:59:23.250 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.241+0000 7fc0ee59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0f00f7d40 0x7fc0f00f7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:59:23.250 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.241+0000 7fc0ee59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0f00f7d40 0x7fc0f00f7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57504/0 (socket says 172.21.15.26:57504) 2021-11-03T17:59:23.250 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.241+0000 7fc0ee59c700 1 -- 172.21.15.26:0/3635192947 learned_addr learned my addr 172.21.15.26:0/3635192947 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:59:23.251 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.241+0000 7fc0edd9b700 1 --2- 172.21.15.26:0/3635192947 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0f00f86e0 0x7fc0f00f5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:59:23.251 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.241+0000 7fc0ee59c700 1 -- 172.21.15.26:0/3635192947 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0f00f86e0 msgr2=0x7fc0f00f5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:59:23.251 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.241+0000 7fc0ee59c700 1 --2- 172.21.15.26:0/3635192947 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0f00f86e0 0x7fc0f00f5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:23.251 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.241+0000 7fc0ee59c700 1 -- 172.21.15.26:0/3635192947 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e4005040 con 0x7fc0f00f7d40 2021-11-03T17:59:23.251 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.241+0000 7fc0ee59c700 1 --2- 172.21.15.26:0/3635192947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0f00f7d40 0x7fc0f00f7610 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7fc0e800d7f0 tx=0x7fc0e8004e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:59:23.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.241+0000 7fc0deffd700 1 -- 172.21.15.26:0/3635192947 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0e800b4f0 con 0x7fc0f00f7d40 2021-11-03T17:59:23.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.241+0000 7fc0deffd700 1 -- 172.21.15.26:0/3635192947 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc0e800f040 con 0x7fc0f00f7d40 2021-11-03T17:59:23.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.241+0000 7fc0deffd700 1 -- 172.21.15.26:0/3635192947 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0e8013a50 con 0x7fc0f00f7d40 2021-11-03T17:59:23.253 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.241+0000 7fc0f48a3700 1 -- 172.21.15.26:0/3635192947 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0f00f6410 con 0x7fc0f00f7d40 2021-11-03T17:59:23.253 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.241+0000 7fc0f48a3700 1 -- 172.21.15.26:0/3635192947 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0f010f030 con 0x7fc0f00f7d40 2021-11-03T17:59:23.253 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.242+0000 7fc0f48a3700 1 -- 172.21.15.26:0/3635192947 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0f0045ad0 con 0x7fc0f00f7d40 2021-11-03T17:59:23.253 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.243+0000 7fc0deffd700 1 -- 172.21.15.26:0/3635192947 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc0e801a030 con 0x7fc0f00f7d40 2021-11-03T17:59:23.253 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.243+0000 7fc0deffd700 1 --2- 172.21.15.26:0/3635192947 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc0d80640b0 0x7fc0d8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:59:23.254 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.243+0000 7fc0deffd700 1 -- 172.21.15.26:0/3635192947 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc0e8080730 con 0x7fc0f00f7d40 2021-11-03T17:59:23.254 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.243+0000 7fc0edd9b700 1 --2- 172.21.15.26:0/3635192947 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc0d80640b0 0x7fc0d8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:59:23.254 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.244+0000 7fc0edd9b700 1 --2- 172.21.15.26:0/3635192947 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc0d80640b0 0x7fc0d8066570 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7fc0e4004630 tx=0x7fc0e4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:59:23.255 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.247+0000 7fc0deffd700 1 -- 172.21.15.26:0/3635192947 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc0e8052a50 con 0x7fc0f00f7d40 2021-11-03T17:59:23.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.419+0000 7fc0f48a3700 1 -- 172.21.15.26:0/3635192947 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0f00ff080 con 0x7fc0d80640b0 2021-11-03T17:59:23.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.434+0000 7fc0deffd700 1 -- 172.21.15.26:0/3635192947 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fc0e4019040 con 0x7fc0d80640b0 2021-11-03T17:59:23.431 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:59:23.431 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (70m) 9m ago 71m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:59:23.431 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (62m) 9m ago 71m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:59:23.431 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (62m) 8m ago 71m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:59:23.432 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (70m) 9m ago 71m 41.4M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:59:23.432 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (63m) 9m ago 67m 25.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:59:23.432 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (63m) 9m ago 66m 26.0M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:59:23.432 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (67m) 8m ago 67m 26.2M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:59:23.432 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (66m) 8m ago 66m 26.5M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:59:23.433 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (64m) 9m ago 73m 547M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:59:23.433 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (63m) 8m ago 71m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:59:23.433 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (63m) 9m ago 73m 242M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:59:23.433 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (63m) 8m ago 70m 117M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:59:23.434 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (71m) 9m ago 71m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:59:23.434 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (70m) 8m ago 70m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:59:23.434 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (62m) 9m ago 70m 271M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:59:23.434 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (61m) 9m ago 69m 291M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:59:23.434 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (61m) 9m ago 69m 243M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:59:23.435 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (60m) 8m ago 69m 312M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:59:23.435 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (60m) 8m ago 68m 265M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:59:23.435 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (60m) 8m ago 68m 255M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:59:23.435 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (70m) 9m ago 71m 58.9M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:59:23.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.435+0000 7fc0f48a3700 1 -- 172.21.15.26:0/3635192947 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc0d80640b0 msgr2=0x7fc0d8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:59:23.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.435+0000 7fc0f48a3700 1 --2- 172.21.15.26:0/3635192947 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc0d80640b0 0x7fc0d8066570 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7fc0e4004630 tx=0x7fc0e4009b30).stop 2021-11-03T17:59:23.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.435+0000 7fc0f48a3700 1 -- 172.21.15.26:0/3635192947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0f00f7d40 msgr2=0x7fc0f00f7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:59:23.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.435+0000 7fc0f48a3700 1 --2- 172.21.15.26:0/3635192947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0f00f7d40 0x7fc0f00f7610 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7fc0e800d7f0 tx=0x7fc0e8004e30).stop 2021-11-03T17:59:23.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.436+0000 7fc0f48a3700 1 -- 172.21.15.26:0/3635192947 shutdown_connections 2021-11-03T17:59:23.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.436+0000 7fc0f48a3700 1 --2- 172.21.15.26:0/3635192947 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc0d80640b0 0x7fc0d8066570 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:23.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.436+0000 7fc0f48a3700 1 --2- 172.21.15.26:0/3635192947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0f00f7d40 0x7fc0f00f7610 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:23.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.436+0000 7fc0f48a3700 1 --2- 172.21.15.26:0/3635192947 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0f00f86e0 0x7fc0f00f5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:23.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.436+0000 7fc0f48a3700 1 -- 172.21.15.26:0/3635192947 >> 172.21.15.26:0/3635192947 conn(0x7fc0f00f04c0 msgr2=0x7fc0f00fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:59:23.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.436+0000 7fc0f48a3700 1 -- 172.21.15.26:0/3635192947 shutdown_connections 2021-11-03T17:59:23.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.436+0000 7fc0f48a3700 1 -- 172.21.15.26:0/3635192947 wait complete. 2021-11-03T17:59:23.533 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.535+0000 7fa4e2696700 1 -- 172.21.15.26:0/2922021868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4dc0f66e0 msgr2=0x7fa4dc0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:59:23.533 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.535+0000 7fa4e2696700 1 --2- 172.21.15.26:0/2922021868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4dc0f66e0 0x7fa4dc0f6b00 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7fa4cc004660 tx=0x7fa4cc009b30).stop 2021-11-03T17:59:23.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.535+0000 7fa4e2696700 1 -- 172.21.15.26:0/2922021868 shutdown_connections 2021-11-03T17:59:23.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.535+0000 7fa4e2696700 1 --2- 172.21.15.26:0/2922021868 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4dc0f6ff0 0x7fa4dc0f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:23.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.535+0000 7fa4e2696700 1 --2- 172.21.15.26:0/2922021868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4dc0f66e0 0x7fa4dc0f6b00 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:23.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.535+0000 7fa4e2696700 1 -- 172.21.15.26:0/2922021868 >> 172.21.15.26:0/2922021868 conn(0x7fa4dc0f1f00 msgr2=0x7fa4dc0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:59:23.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.535+0000 7fa4e2696700 1 -- 172.21.15.26:0/2922021868 shutdown_connections 2021-11-03T17:59:23.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.535+0000 7fa4e2696700 1 -- 172.21.15.26:0/2922021868 wait complete. 2021-11-03T17:59:23.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.535+0000 7fa4e2696700 1 Processor -- start 2021-11-03T17:59:23.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.535+0000 7fa4e2696700 1 -- start start 2021-11-03T17:59:23.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.536+0000 7fa4e2696700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4dc0f66e0 0x7fa4dc106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:59:23.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.536+0000 7fa4e2696700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4dc0f6ff0 0x7fa4dc107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:59:23.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.536+0000 7fa4e2696700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc107a00 con 0x7fa4dc0f66e0 2021-11-03T17:59:23.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.536+0000 7fa4e2696700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc107b40 con 0x7fa4dc0f6ff0 2021-11-03T17:59:23.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.536+0000 7fa4dbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4dc0f66e0 0x7fa4dc106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:59:23.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.536+0000 7fa4dbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4dc0f66e0 0x7fa4dc106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57514/0 (socket says 172.21.15.26:57514) 2021-11-03T17:59:23.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.536+0000 7fa4dbfff700 1 -- 172.21.15.26:0/1544930469 learned_addr learned my addr 172.21.15.26:0/1544930469 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:59:23.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.536+0000 7fa4db7fe700 1 --2- 172.21.15.26:0/1544930469 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4dc0f6ff0 0x7fa4dc107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:59:23.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.536+0000 7fa4dbfff700 1 -- 172.21.15.26:0/1544930469 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4dc0f6ff0 msgr2=0x7fa4dc107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:59:23.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.536+0000 7fa4dbfff700 1 --2- 172.21.15.26:0/1544930469 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4dc0f6ff0 0x7fa4dc107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:23.538 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.536+0000 7fa4dbfff700 1 -- 172.21.15.26:0/1544930469 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4cc005040 con 0x7fa4dc0f66e0 2021-11-03T17:59:23.538 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.536+0000 7fa4dbfff700 1 --2- 172.21.15.26:0/1544930469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4dc0f66e0 0x7fa4dc106f60 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 rx=0x7fa4cc009990 tx=0x7fa4cc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:59:23.538 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.536+0000 7fa4d8ff9700 1 -- 172.21.15.26:0/1544930469 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4cc018070 con 0x7fa4dc0f66e0 2021-11-03T17:59:23.538 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.536+0000 7fa4d8ff9700 1 -- 172.21.15.26:0/1544930469 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa4cc007ca0 con 0x7fa4dc0f66e0 2021-11-03T17:59:23.539 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.536+0000 7fa4e2696700 1 -- 172.21.15.26:0/1544930469 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4dc108480 con 0x7fa4dc0f66e0 2021-11-03T17:59:23.539 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.536+0000 7fa4d8ff9700 1 -- 172.21.15.26:0/1544930469 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4cc01c620 con 0x7fa4dc0f66e0 2021-11-03T17:59:23.539 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.536+0000 7fa4e2696700 1 -- 172.21.15.26:0/1544930469 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4dc1089e0 con 0x7fa4dc0f66e0 2021-11-03T17:59:23.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.537+0000 7fa4e2696700 1 -- 172.21.15.26:0/1544930469 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4dc045ad0 con 0x7fa4dc0f66e0 2021-11-03T17:59:23.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.538+0000 7fa4d8ff9700 1 -- 172.21.15.26:0/1544930469 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fa4cc01d960 con 0x7fa4dc0f66e0 2021-11-03T17:59:23.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.538+0000 7fa4d8ff9700 1 --2- 172.21.15.26:0/1544930469 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa4c80640b0 0x7fa4c8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:59:23.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.538+0000 7fa4d8ff9700 1 -- 172.21.15.26:0/1544930469 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fa4cc082520 con 0x7fa4dc0f66e0 2021-11-03T17:59:23.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.538+0000 7fa4db7fe700 1 --2- 172.21.15.26:0/1544930469 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa4c80640b0 0x7fa4c8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:59:23.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.539+0000 7fa4db7fe700 1 --2- 172.21.15.26:0/1544930469 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa4c80640b0 0x7fa4c8066570 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7fa4c40049e0 tx=0x7fa4c4009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:59:23.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.542+0000 7fa4d8ff9700 1 -- 172.21.15.26:0/1544930469 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fa4cc054940 con 0x7fa4dc0f66e0 2021-11-03T17:59:23.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.773+0000 7fa4e2696700 1 -- 172.21.15.26:0/1544930469 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa4dc0feed0 con 0x7fa4dc0f66e0 2021-11-03T17:59:23.770 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.773+0000 7fa4d8ff9700 1 -- 172.21.15.26:0/1544930469 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fa4cc054530 con 0x7fa4dc0f66e0 2021-11-03T17:59:23.770 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:59:23.770 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:59:23.770 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:59:23.771 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:59:23.771 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:59:23.771 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:59:23.771 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:59:23.772 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:59:23.772 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:59:23.772 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:59:23.772 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:59:23.773 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:59:23.773 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:59:23.773 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:59:23.773 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:59:23.773 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:59:23.774 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:59:23.774 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:59:23.775 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.775+0000 7fa4e2696700 1 -- 172.21.15.26:0/1544930469 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa4c80640b0 msgr2=0x7fa4c8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:59:23.775 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.775+0000 7fa4e2696700 1 --2- 172.21.15.26:0/1544930469 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa4c80640b0 0x7fa4c8066570 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7fa4c40049e0 tx=0x7fa4c4009040).stop 2021-11-03T17:59:23.775 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.775+0000 7fa4e2696700 1 -- 172.21.15.26:0/1544930469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4dc0f66e0 msgr2=0x7fa4dc106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:59:23.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.775+0000 7fa4e2696700 1 --2- 172.21.15.26:0/1544930469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4dc0f66e0 0x7fa4dc106f60 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 rx=0x7fa4cc009990 tx=0x7fa4cc009b30).stop 2021-11-03T17:59:23.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.775+0000 7fa4e2696700 1 -- 172.21.15.26:0/1544930469 shutdown_connections 2021-11-03T17:59:23.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.775+0000 7fa4e2696700 1 --2- 172.21.15.26:0/1544930469 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa4c80640b0 0x7fa4c8066570 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:23.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.775+0000 7fa4e2696700 1 --2- 172.21.15.26:0/1544930469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4dc0f66e0 0x7fa4dc106f60 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:23.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.775+0000 7fa4e2696700 1 --2- 172.21.15.26:0/1544930469 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4dc0f6ff0 0x7fa4dc107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:23.777 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.775+0000 7fa4e2696700 1 -- 172.21.15.26:0/1544930469 >> 172.21.15.26:0/1544930469 conn(0x7fa4dc0f1f00 msgr2=0x7fa4dc0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:59:23.777 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.775+0000 7fa4e2696700 1 -- 172.21.15.26:0/1544930469 shutdown_connections 2021-11-03T17:59:23.777 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.775+0000 7fa4e2696700 1 -- 172.21.15.26:0/1544930469 wait complete. 2021-11-03T17:59:23.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.876+0000 7f27c0683700 1 -- 172.21.15.26:0/1593911712 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27b80f6860 msgr2=0x7f27b80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:59:23.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.876+0000 7f27c0683700 1 --2- 172.21.15.26:0/1593911712 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27b80f6860 0x7f27b80f6cc0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7f27b4004660 tx=0x7f27b4009b30).stop 2021-11-03T17:59:23.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.876+0000 7f27c0683700 1 -- 172.21.15.26:0/1593911712 shutdown_connections 2021-11-03T17:59:23.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.876+0000 7f27c0683700 1 --2- 172.21.15.26:0/1593911712 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27b80f6860 0x7f27b80f6cc0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:23.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.876+0000 7f27c0683700 1 --2- 172.21.15.26:0/1593911712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27b80f55c0 0x7f27b80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:23.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.876+0000 7f27c0683700 1 -- 172.21.15.26:0/1593911712 >> 172.21.15.26:0/1593911712 conn(0x7f27b80f0d20 msgr2=0x7f27b80f3140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:59:23.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.876+0000 7f27c0683700 1 -- 172.21.15.26:0/1593911712 shutdown_connections 2021-11-03T17:59:23.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.876+0000 7f27c0683700 1 -- 172.21.15.26:0/1593911712 wait complete. 2021-11-03T17:59:23.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.876+0000 7f27c0683700 1 Processor -- start 2021-11-03T17:59:23.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.877+0000 7f27c0683700 1 -- start start 2021-11-03T17:59:23.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.877+0000 7f27c0683700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27b80f55c0 0x7f27b8109bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:59:23.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.877+0000 7f27c0683700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27b80f6860 0x7f27b810c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:59:23.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.877+0000 7f27c0683700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b80605c0 con 0x7f27b80f55c0 2021-11-03T17:59:23.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.877+0000 7f27c0683700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b8060700 con 0x7f27b80f6860 2021-11-03T17:59:23.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.877+0000 7f27be41f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27b80f55c0 0x7f27b8109bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:59:23.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.877+0000 7f27be41f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27b80f55c0 0x7f27b8109bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57524/0 (socket says 172.21.15.26:57524) 2021-11-03T17:59:23.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.877+0000 7f27be41f700 1 -- 172.21.15.26:0/2544738847 learned_addr learned my addr 172.21.15.26:0/2544738847 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:59:23.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.877+0000 7f27bdc1e700 1 --2- 172.21.15.26:0/2544738847 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27b80f6860 0x7f27b810c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:59:23.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.877+0000 7f27be41f700 1 -- 172.21.15.26:0/2544738847 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27b80f6860 msgr2=0x7f27b810c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:59:23.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.877+0000 7f27be41f700 1 --2- 172.21.15.26:0/2544738847 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27b80f6860 0x7f27b810c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:23.879 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.877+0000 7f27be41f700 1 -- 172.21.15.26:0/2544738847 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b4005040 con 0x7f27b80f55c0 2021-11-03T17:59:23.879 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.877+0000 7f27be41f700 1 --2- 172.21.15.26:0/2544738847 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27b80f55c0 0x7f27b8109bf0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7f27a800c790 tx=0x7f27a8007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:59:23.879 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.877+0000 7f27aeffd700 1 -- 172.21.15.26:0/2544738847 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27a8013630 con 0x7f27b80f55c0 2021-11-03T17:59:23.879 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.877+0000 7f27aeffd700 1 -- 172.21.15.26:0/2544738847 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f27a8012860 con 0x7f27b80f55c0 2021-11-03T17:59:23.879 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.877+0000 7f27c0683700 1 -- 172.21.15.26:0/2544738847 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27b810c700 con 0x7f27b80f55c0 2021-11-03T17:59:23.880 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.877+0000 7f27aeffd700 1 -- 172.21.15.26:0/2544738847 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27a8002780 con 0x7f27b80f55c0 2021-11-03T17:59:23.880 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.878+0000 7f27c0683700 1 -- 172.21.15.26:0/2544738847 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27b810cc90 con 0x7f27b80f55c0 2021-11-03T17:59:23.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.878+0000 7f27c0683700 1 -- 172.21.15.26:0/2544738847 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27b80f49b0 con 0x7f27b80f55c0 2021-11-03T17:59:23.882 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.879+0000 7f27aeffd700 1 -- 172.21.15.26:0/2544738847 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f27a8010070 con 0x7f27b80f55c0 2021-11-03T17:59:23.882 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.879+0000 7f27aeffd700 1 --2- 172.21.15.26:0/2544738847 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f27a40640b0 0x7f27a4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:59:23.882 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.879+0000 7f27aeffd700 1 -- 172.21.15.26:0/2544738847 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f27a8080990 con 0x7f27b80f55c0 2021-11-03T17:59:23.883 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.879+0000 7f27bdc1e700 1 --2- 172.21.15.26:0/2544738847 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f27a40640b0 0x7f27a4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:59:23.883 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.880+0000 7f27bdc1e700 1 --2- 172.21.15.26:0/2544738847 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f27a40640b0 0x7f27a4066570 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f27b4004630 tx=0x7f27b4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:59:23.883 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:23.883+0000 7f27aeffd700 1 -- 172.21.15.26:0/2544738847 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f27a8052ba0 con 0x7f27b80f55c0 2021-11-03T17:59:24.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:24.086+0000 7f27c0683700 1 -- 172.21.15.26:0/2544738847 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f27b80fde50 con 0x7f27b80f55c0 2021-11-03T17:59:24.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:24.087+0000 7f27aeffd700 1 -- 172.21.15.26:0/2544738847 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f27a8052790 con 0x7f27b80f55c0 2021-11-03T17:59:24.084 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:59:24.084 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:59:24.084 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:59:24.085 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:59:24.085 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:59:24.085 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:59:24.085 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:59:24.086 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:59:24.086 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:59:24.086 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:59:24.086 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:59:24.087 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:59:24.087 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:59:24.087 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:59:24.087 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:59:24.087 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:59:24.088 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:59:24.088 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:59:24.088 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:59:24.088 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:59:24.089 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:59:24.089 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:59:24.089 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:59:24.089 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:59:24.089 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:59:24.090 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:59:24.090 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:59:24.090 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:59:24.090 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:59:24.091 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:59:24.091 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:59:24.091 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:59:24.091 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:59:24.092 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:59:24.092 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:59:24.092 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:59:24.092 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:59:24.093 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:59:24.093 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:59:24.094 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:24.088+0000 7f27c0683700 1 -- 172.21.15.26:0/2544738847 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f27a40640b0 msgr2=0x7f27a4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:59:24.094 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:24.088+0000 7f27c0683700 1 --2- 172.21.15.26:0/2544738847 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f27a40640b0 0x7f27a4066570 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f27b4004630 tx=0x7f27b4009b30).stop 2021-11-03T17:59:24.095 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:24.088+0000 7f27c0683700 1 -- 172.21.15.26:0/2544738847 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27b80f55c0 msgr2=0x7f27b8109bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:59:24.095 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:24.088+0000 7f27c0683700 1 --2- 172.21.15.26:0/2544738847 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27b80f55c0 0x7f27b8109bf0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7f27a800c790 tx=0x7f27a8007d90).stop 2021-11-03T17:59:24.095 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:24.088+0000 7f27c0683700 1 -- 172.21.15.26:0/2544738847 shutdown_connections 2021-11-03T17:59:24.095 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:24.088+0000 7f27c0683700 1 --2- 172.21.15.26:0/2544738847 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f27a40640b0 0x7f27a4066570 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:24.096 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:24.088+0000 7f27c0683700 1 --2- 172.21.15.26:0/2544738847 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27b80f55c0 0x7f27b8109bf0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:24.096 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:24.088+0000 7f27c0683700 1 --2- 172.21.15.26:0/2544738847 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27b80f6860 0x7f27b810c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:24.096 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:24.088+0000 7f27c0683700 1 -- 172.21.15.26:0/2544738847 >> 172.21.15.26:0/2544738847 conn(0x7f27b80f0d20 msgr2=0x7f27b80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:59:24.096 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:24.089+0000 7f27c0683700 1 -- 172.21.15.26:0/2544738847 shutdown_connections 2021-11-03T17:59:24.097 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:24.089+0000 7f27c0683700 1 -- 172.21.15.26:0/2544738847 wait complete. 2021-11-03T17:59:24.097 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:59:24.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:24 smithi026 ceph-mon[96795]: from='client.36140 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:59:24.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:24 smithi026 ceph-mon[96795]: pgmap v1942: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:24.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:24 smithi026 ceph-mon[96795]: from='client.36144 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:59:24.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:24 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1544930469' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:59:24.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:24 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2544738847' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:59:24.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:24 smithi194 ceph-mon[65619]: from='client.36140 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:59:24.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:24 smithi194 ceph-mon[65619]: pgmap v1942: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:24.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:24 smithi194 ceph-mon[65619]: from='client.36144 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:59:25.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:24 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1544930469' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:59:25.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:24 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2544738847' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:59:26.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:26 smithi026 ceph-mon[96795]: pgmap v1943: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:26.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:26 smithi194 ceph-mon[65619]: pgmap v1943: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:28.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:28 smithi026 ceph-mon[96795]: pgmap v1944: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:28.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:28 smithi194 ceph-mon[65619]: pgmap v1944: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:30.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:30 smithi026 ceph-mon[96795]: pgmap v1945: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:30.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:30 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:59:30.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:30 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:59:30.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:30 smithi194 ceph-mon[65619]: pgmap v1945: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:30.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:30 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:59:30.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:30 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:59:32.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:32 smithi026 ceph-mon[96795]: pgmap v1946: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:32.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:32 smithi194 ceph-mon[65619]: pgmap v1946: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:34.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:34 smithi026 ceph-mon[96795]: pgmap v1947: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:34.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:34 smithi194 ceph-mon[65619]: pgmap v1947: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:36.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:36 smithi026 ceph-mon[96795]: pgmap v1948: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:36.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:36 smithi194 ceph-mon[65619]: pgmap v1948: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:38.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:38 smithi026 ceph-mon[96795]: pgmap v1949: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:38.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:38 smithi194 ceph-mon[65619]: pgmap v1949: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:40.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:40 smithi026 ceph-mon[96795]: pgmap v1950: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:40.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:40 smithi194 ceph-mon[65619]: pgmap v1950: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:42.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:42 smithi026 ceph-mon[96795]: pgmap v1951: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:42.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:42 smithi194 ceph-mon[65619]: pgmap v1951: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:44.878 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:44 smithi194 ceph-mon[65619]: pgmap v1952: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:44.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:44 smithi026 ceph-mon[96795]: pgmap v1952: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:45.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:45 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:59:45.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:45 smithi026 ceph-mon[96795]: poll took 60044.804 ms: 1 events 2021-11-03T17:59:45.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:45 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:59:45.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:45 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:59:45.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:45 smithi194 ceph-mon[65619]: poll took 60044.804 ms: 1 events 2021-11-03T17:59:45.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:45 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:59:46.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:46 smithi026 ceph-mon[96795]: pgmap v1953: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:46.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:46 smithi194 ceph-mon[65619]: pgmap v1953: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:48.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:48 smithi026 ceph-mon[96795]: pgmap v1954: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:48.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:59:48.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:59:48.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:48 smithi194 ceph-mon[65619]: pgmap v1954: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:48.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T17:59:48.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T17:59:50.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:50 smithi026 ceph-mon[96795]: pgmap v1955: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:50.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:50 smithi026 ceph-mon[96795]: poll took 4335.908 ms: 1 events 2021-11-03T17:59:50.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:50 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:59:50.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:50 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:59:50.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:50 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:59:50.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:50 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:59:50.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:50 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:59:50.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:50 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:59:50.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:50 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:59:50.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:50 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:59:50.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:50 smithi194 ceph-mon[65619]: pgmap v1955: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:50.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:50 smithi194 ceph-mon[65619]: poll took 4335.908 ms: 1 events 2021-11-03T17:59:50.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:50 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:59:50.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:50 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T17:59:50.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:50 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T17:59:51.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:50 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:59:51.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:50 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:59:51.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:50 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:59:51.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:50 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:59:51.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:50 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T17:59:51.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:51 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:59:51.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:51 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:59:51.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:51 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T17:59:51.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:51 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T17:59:52.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:52 smithi026 ceph-mon[96795]: pgmap v1956: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:52.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:52 smithi194 ceph-mon[65619]: pgmap v1956: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:54.200 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.203+0000 7fc1b9c0e700 1 -- 172.21.15.26:0/1569888805 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1b40f77d0 msgr2=0x7fc1b40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:59:54.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.203+0000 7fc1b9c0e700 1 --2- 172.21.15.26:0/1569888805 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1b40f77d0 0x7fc1b40f7c30 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 rx=0x7fc1a0004660 tx=0x7fc1a0009b30).stop 2021-11-03T17:59:54.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.203+0000 7fc1b9c0e700 1 -- 172.21.15.26:0/1569888805 shutdown_connections 2021-11-03T17:59:54.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.203+0000 7fc1b9c0e700 1 --2- 172.21.15.26:0/1569888805 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1b40f77d0 0x7fc1b40f7c30 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:54.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.203+0000 7fc1b9c0e700 1 --2- 172.21.15.26:0/1569888805 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1b40f6530 0x7fc1b40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:54.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.203+0000 7fc1b9c0e700 1 -- 172.21.15.26:0/1569888805 >> 172.21.15.26:0/1569888805 conn(0x7fc1b40f1cd0 msgr2=0x7fc1b40f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:59:54.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.203+0000 7fc1b9c0e700 1 -- 172.21.15.26:0/1569888805 shutdown_connections 2021-11-03T17:59:54.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.203+0000 7fc1b9c0e700 1 -- 172.21.15.26:0/1569888805 wait complete. 2021-11-03T17:59:54.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.203+0000 7fc1b9c0e700 1 Processor -- start 2021-11-03T17:59:54.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.203+0000 7fc1b9c0e700 1 -- start start 2021-11-03T17:59:54.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.204+0000 7fc1b9c0e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1b40f6530 0x7fc1b4106da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:59:54.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.204+0000 7fc1b9c0e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1b40f77d0 0x7fc1b4107290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:59:54.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.204+0000 7fc1b9c0e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b4107890 con 0x7fc1b40f6530 2021-11-03T17:59:54.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.204+0000 7fc1b9c0e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b41080d0 con 0x7fc1b40f77d0 2021-11-03T17:59:54.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.204+0000 7fc1b8c0c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1b40f6530 0x7fc1b4106da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:59:54.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.204+0000 7fc1b8c0c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1b40f6530 0x7fc1b4106da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57542/0 (socket says 172.21.15.26:57542) 2021-11-03T17:59:54.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.204+0000 7fc1b8c0c700 1 -- 172.21.15.26:0/3868026180 learned_addr learned my addr 172.21.15.26:0/3868026180 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:59:54.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.204+0000 7fc1b3fff700 1 --2- 172.21.15.26:0/3868026180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1b40f77d0 0x7fc1b4107290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:59:54.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.204+0000 7fc1b8c0c700 1 -- 172.21.15.26:0/3868026180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1b40f77d0 msgr2=0x7fc1b4107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:59:54.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.204+0000 7fc1b8c0c700 1 --2- 172.21.15.26:0/3868026180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1b40f77d0 0x7fc1b4107290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:54.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.204+0000 7fc1b8c0c700 1 -- 172.21.15.26:0/3868026180 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a0005040 con 0x7fc1b40f6530 2021-11-03T17:59:54.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.204+0000 7fc1b8c0c700 1 --2- 172.21.15.26:0/3868026180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1b40f6530 0x7fc1b4106da0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7fc1a80026d0 tx=0x7fc1a8009dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:59:54.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.204+0000 7fc1b17fa700 1 -- 172.21.15.26:0/3868026180 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1a80079c0 con 0x7fc1b40f6530 2021-11-03T17:59:54.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.205+0000 7fc1b9c0e700 1 -- 172.21.15.26:0/3868026180 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1b41083b0 con 0x7fc1b40f6530 2021-11-03T17:59:54.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.205+0000 7fc1b17fa700 1 -- 172.21.15.26:0/3868026180 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc1a800f040 con 0x7fc1b40f6530 2021-11-03T17:59:54.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.205+0000 7fc1b17fa700 1 -- 172.21.15.26:0/3868026180 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1a8014840 con 0x7fc1b40f6530 2021-11-03T17:59:54.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.205+0000 7fc1b9c0e700 1 -- 172.21.15.26:0/3868026180 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b41088f0 con 0x7fc1b40f6530 2021-11-03T17:59:54.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.206+0000 7fc1b9c0e700 1 -- 172.21.15.26:0/3868026180 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1b4059100 con 0x7fc1b40f6530 2021-11-03T17:59:54.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.206+0000 7fc1b17fa700 1 -- 172.21.15.26:0/3868026180 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc1a801b060 con 0x7fc1b40f6530 2021-11-03T17:59:54.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.207+0000 7fc1b17fa700 1 --2- 172.21.15.26:0/3868026180 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc1a4064100 0x7fc1a40665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:59:54.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.207+0000 7fc1b17fa700 1 -- 172.21.15.26:0/3868026180 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc1a8080750 con 0x7fc1b40f6530 2021-11-03T17:59:54.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.207+0000 7fc1b3fff700 1 --2- 172.21.15.26:0/3868026180 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc1a4064100 0x7fc1a40665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:59:54.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.207+0000 7fc1b3fff700 1 --2- 172.21.15.26:0/3868026180 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc1a4064100 0x7fc1a40665c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7fc1a0004630 tx=0x7fc1a0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:59:54.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.211+0000 7fc1b17fa700 1 -- 172.21.15.26:0/3868026180 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc1a8052a50 con 0x7fc1b40f6530 2021-11-03T17:59:54.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.390+0000 7fc1b9c0e700 1 -- 172.21.15.26:0/3868026180 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc1b40fee20 con 0x7fc1a4064100 2021-11-03T17:59:54.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.391+0000 7fc1b17fa700 1 -- 172.21.15.26:0/3868026180 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fc1b40fee20 con 0x7fc1a4064100 2021-11-03T17:59:54.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.393+0000 7fc1b9c0e700 1 -- 172.21.15.26:0/3868026180 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc1a4064100 msgr2=0x7fc1a40665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:59:54.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.393+0000 7fc1b9c0e700 1 --2- 172.21.15.26:0/3868026180 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc1a4064100 0x7fc1a40665c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7fc1a0004630 tx=0x7fc1a0009b30).stop 2021-11-03T17:59:54.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.393+0000 7fc1b9c0e700 1 -- 172.21.15.26:0/3868026180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1b40f6530 msgr2=0x7fc1b4106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:59:54.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.393+0000 7fc1b9c0e700 1 --2- 172.21.15.26:0/3868026180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1b40f6530 0x7fc1b4106da0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7fc1a80026d0 tx=0x7fc1a8009dc0).stop 2021-11-03T17:59:54.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.393+0000 7fc1b9c0e700 1 -- 172.21.15.26:0/3868026180 shutdown_connections 2021-11-03T17:59:54.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.393+0000 7fc1b9c0e700 1 --2- 172.21.15.26:0/3868026180 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc1a4064100 0x7fc1a40665c0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:54.395 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.393+0000 7fc1b9c0e700 1 --2- 172.21.15.26:0/3868026180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1b40f6530 0x7fc1b4106da0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:54.395 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.393+0000 7fc1b9c0e700 1 --2- 172.21.15.26:0/3868026180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1b40f77d0 0x7fc1b4107290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:54.396 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.393+0000 7fc1b9c0e700 1 -- 172.21.15.26:0/3868026180 >> 172.21.15.26:0/3868026180 conn(0x7fc1b40f1cd0 msgr2=0x7fc1b40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:59:54.396 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.393+0000 7fc1b9c0e700 1 -- 172.21.15.26:0/3868026180 shutdown_connections 2021-11-03T17:59:54.396 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.393+0000 7fc1b9c0e700 1 -- 172.21.15.26:0/3868026180 wait complete. 2021-11-03T17:59:54.400 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T17:59:54.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.494+0000 7f2372b9b700 1 -- 172.21.15.26:0/3552685294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f236c0f5ef0 msgr2=0x7f236c0f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:59:54.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.494+0000 7f2372b9b700 1 --2- 172.21.15.26:0/3552685294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f236c0f5ef0 0x7f236c0f6920 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 rx=0x7f2360004660 tx=0x7f2360009b30).stop 2021-11-03T17:59:54.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.494+0000 7f2372b9b700 1 -- 172.21.15.26:0/3552685294 shutdown_connections 2021-11-03T17:59:54.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.494+0000 7f2372b9b700 1 --2- 172.21.15.26:0/3552685294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f236c0f5ef0 0x7f236c0f6920 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:54.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.494+0000 7f2372b9b700 1 --2- 172.21.15.26:0/3552685294 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f236c0f55e0 0x7f236c0f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:54.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.494+0000 7f2372b9b700 1 -- 172.21.15.26:0/3552685294 >> 172.21.15.26:0/3552685294 conn(0x7f236c0f0de0 msgr2=0x7f236c0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:59:54.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.494+0000 7f2372b9b700 1 -- 172.21.15.26:0/3552685294 shutdown_connections 2021-11-03T17:59:54.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.494+0000 7f2372b9b700 1 -- 172.21.15.26:0/3552685294 wait complete. 2021-11-03T17:59:54.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.494+0000 7f2372b9b700 1 Processor -- start 2021-11-03T17:59:54.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.494+0000 7f2372b9b700 1 -- start start 2021-11-03T17:59:54.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.495+0000 7f2372b9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f236c0f55e0 0x7f236c0f97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:59:54.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.495+0000 7f2372b9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f236c0f5ef0 0x7f236c0f7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:59:54.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.495+0000 7f2372b9b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236c0f81c0 con 0x7f236c0f55e0 2021-11-03T17:59:54.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.495+0000 7f2372b9b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236c0f8300 con 0x7f236c0f5ef0 2021-11-03T17:59:54.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.495+0000 7f2370937700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f236c0f55e0 0x7f236c0f97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:59:54.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.495+0000 7f2370937700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f236c0f55e0 0x7f236c0f97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57552/0 (socket says 172.21.15.26:57552) 2021-11-03T17:59:54.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.495+0000 7f2370937700 1 -- 172.21.15.26:0/446687460 learned_addr learned my addr 172.21.15.26:0/446687460 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:59:54.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.495+0000 7f236bfff700 1 --2- 172.21.15.26:0/446687460 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f236c0f5ef0 0x7f236c0f7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:59:54.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.495+0000 7f2370937700 1 -- 172.21.15.26:0/446687460 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f236c0f5ef0 msgr2=0x7f236c0f7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:59:54.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.495+0000 7f2370937700 1 --2- 172.21.15.26:0/446687460 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f236c0f5ef0 0x7f236c0f7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:54.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.495+0000 7f2370937700 1 -- 172.21.15.26:0/446687460 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2360005040 con 0x7f236c0f55e0 2021-11-03T17:59:54.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.495+0000 7f236bfff700 1 --2- 172.21.15.26:0/446687460 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f236c0f5ef0 0x7f236c0f7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T17:59:54.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.495+0000 7f2370937700 1 --2- 172.21.15.26:0/446687460 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f236c0f55e0 0x7f236c0f97e0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 rx=0x7f2364007fd0 tx=0x7f2364004ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:59:54.500 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.495+0000 7f23697fa700 1 -- 172.21.15.26:0/446687460 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f236400b5a0 con 0x7f236c0f55e0 2021-11-03T17:59:54.500 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.495+0000 7f2372b9b700 1 -- 172.21.15.26:0/446687460 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f236c0f85e0 con 0x7f236c0f55e0 2021-11-03T17:59:54.500 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.495+0000 7f23697fa700 1 -- 172.21.15.26:0/446687460 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f236400f040 con 0x7f236c0f55e0 2021-11-03T17:59:54.500 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.495+0000 7f23697fa700 1 -- 172.21.15.26:0/446687460 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2364013b60 con 0x7f236c0f55e0 2021-11-03T17:59:54.501 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.495+0000 7f2372b9b700 1 -- 172.21.15.26:0/446687460 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f236c10ef90 con 0x7f236c0f55e0 2021-11-03T17:59:54.501 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.496+0000 7f2372b9b700 1 -- 172.21.15.26:0/446687460 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f236c045ad0 con 0x7f236c0f55e0 2021-11-03T17:59:54.502 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.497+0000 7f23697fa700 1 -- 172.21.15.26:0/446687460 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f236401a030 con 0x7f236c0f55e0 2021-11-03T17:59:54.502 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.497+0000 7f23697fa700 1 --2- 172.21.15.26:0/446687460 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f23540640b0 0x7f2354066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:59:54.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.497+0000 7f23697fa700 1 -- 172.21.15.26:0/446687460 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f2364080740 con 0x7f236c0f55e0 2021-11-03T17:59:54.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.497+0000 7f236bfff700 1 --2- 172.21.15.26:0/446687460 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f23540640b0 0x7f2354066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:59:54.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.498+0000 7f236bfff700 1 --2- 172.21.15.26:0/446687460 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f23540640b0 0x7f2354066570 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f2360009da0 tx=0x7f2360009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:59:54.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.501+0000 7f23697fa700 1 -- 172.21.15.26:0/446687460 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f2364052a60 con 0x7f236c0f55e0 2021-11-03T17:59:54.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.676+0000 7f2372b9b700 1 -- 172.21.15.26:0/446687460 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f236c0fad60 con 0x7f23540640b0 2021-11-03T17:59:54.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.690+0000 7f23697fa700 1 -- 172.21.15.26:0/446687460 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f236c0fad60 con 0x7f23540640b0 2021-11-03T17:59:54.688 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T17:59:54.688 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (71m) 5s ago 72m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T17:59:54.688 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (63m) 5s ago 72m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T17:59:54.689 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (63m) 9m ago 71m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T17:59:54.689 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (70m) 5s ago 72m 41.7M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T17:59:54.689 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (64m) 5s ago 67m 25.6M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T17:59:54.689 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (64m) 5s ago 67m 26.2M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T17:59:54.690 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (67m) 9m ago 67m 26.2M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T17:59:54.690 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (67m) 9m ago 67m 26.5M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T17:59:54.690 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (64m) 5s ago 73m 561M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T17:59:54.690 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (64m) 9m ago 71m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T17:59:54.690 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (64m) 5s ago 73m 276M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T17:59:54.691 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (63m) 9m ago 71m 117M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T17:59:54.691 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (72m) 5s ago 72m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T17:59:54.691 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (71m) 9m ago 71m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T17:59:54.691 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (62m) 5s ago 70m 292M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T17:59:54.692 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (62m) 5s ago 70m 313M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T17:59:54.692 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (61m) 5s ago 70m 261M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T17:59:54.692 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (61m) 9m ago 69m 312M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T17:59:54.692 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (61m) 9m ago 69m 265M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T17:59:54.692 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (60m) 9m ago 69m 255M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T17:59:54.693 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (70m) 5s ago 71m 61.2M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T17:59:54.694 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.692+0000 7f2372b9b700 1 -- 172.21.15.26:0/446687460 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f23540640b0 msgr2=0x7f2354066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:59:54.694 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.692+0000 7f2372b9b700 1 --2- 172.21.15.26:0/446687460 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f23540640b0 0x7f2354066570 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f2360009da0 tx=0x7f2360009b30).stop 2021-11-03T17:59:54.694 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.692+0000 7f2372b9b700 1 -- 172.21.15.26:0/446687460 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f236c0f55e0 msgr2=0x7f236c0f97e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:59:54.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.692+0000 7f2372b9b700 1 --2- 172.21.15.26:0/446687460 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f236c0f55e0 0x7f236c0f97e0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 rx=0x7f2364007fd0 tx=0x7f2364004ee0).stop 2021-11-03T17:59:54.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.692+0000 7f2372b9b700 1 -- 172.21.15.26:0/446687460 shutdown_connections 2021-11-03T17:59:54.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.692+0000 7f2372b9b700 1 --2- 172.21.15.26:0/446687460 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f23540640b0 0x7f2354066570 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:54.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.692+0000 7f2372b9b700 1 --2- 172.21.15.26:0/446687460 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f236c0f55e0 0x7f236c0f97e0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:54.696 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.692+0000 7f2372b9b700 1 --2- 172.21.15.26:0/446687460 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f236c0f5ef0 0x7f236c0f7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:54.696 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.692+0000 7f2372b9b700 1 -- 172.21.15.26:0/446687460 >> 172.21.15.26:0/446687460 conn(0x7f236c0f0de0 msgr2=0x7f236c05ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:59:54.696 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.692+0000 7f2372b9b700 1 -- 172.21.15.26:0/446687460 shutdown_connections 2021-11-03T17:59:54.696 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.692+0000 7f2372b9b700 1 -- 172.21.15.26:0/446687460 wait complete. 2021-11-03T17:59:54.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.792+0000 7f3b31fa3700 1 -- 172.21.15.26:0/2328502286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b2c0f5bb0 msgr2=0x7f3b2c0f5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:59:54.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.792+0000 7f3b31fa3700 1 --2- 172.21.15.26:0/2328502286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b2c0f5bb0 0x7f3b2c0f5fd0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7f3b1c004660 tx=0x7f3b1c009b30).stop 2021-11-03T17:59:54.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.792+0000 7f3b31fa3700 1 -- 172.21.15.26:0/2328502286 shutdown_connections 2021-11-03T17:59:54.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.792+0000 7f3b31fa3700 1 --2- 172.21.15.26:0/2328502286 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b2c0f6550 0x7f3b2c0f69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T17:59:54.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.792+0000 7f3b31fa3700 1 --2- 172.21.15.26:0/2328502286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b2c0f5bb0 0x7f3b2c0f5fd0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:54.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.792+0000 7f3b31fa3700 1 -- 172.21.15.26:0/2328502286 >> 172.21.15.26:0/2328502286 conn(0x7f3b2c0f04c0 msgr2=0x7f3b2c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:59:54.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.792+0000 7f3b31fa3700 1 -- 172.21.15.26:0/2328502286 shutdown_connections 2021-11-03T17:59:54.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.792+0000 7f3b31fa3700 1 -- 172.21.15.26:0/2328502286 wait complete. 2021-11-03T17:59:54.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.792+0000 7f3b31fa3700 1 Processor -- start 2021-11-03T17:59:54.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.792+0000 7f3b31fa3700 1 -- start start 2021-11-03T17:59:54.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.793+0000 7f3b31fa3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b2c0f5bb0 0x7f3b2c109ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:59:54.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.793+0000 7f3b31fa3700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b2c0f6550 0x7f3b2c10c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:59:54.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.793+0000 7f3b31fa3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c0f5730 con 0x7f3b2c0f5bb0 2021-11-03T17:59:54.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.793+0000 7f3b31fa3700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c0f5870 con 0x7f3b2c0f6550 2021-11-03T17:59:54.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.793+0000 7f3b2b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b2c0f5bb0 0x7f3b2c109ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:59:54.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.793+0000 7f3b2b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b2c0f5bb0 0x7f3b2c109ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57562/0 (socket says 172.21.15.26:57562) 2021-11-03T17:59:54.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.793+0000 7f3b2b7fe700 1 -- 172.21.15.26:0/3818409417 learned_addr learned my addr 172.21.15.26:0/3818409417 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:59:54.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.793+0000 7f3b2affd700 1 --2- 172.21.15.26:0/3818409417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b2c0f6550 0x7f3b2c10c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:59:54.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.793+0000 7f3b2b7fe700 1 -- 172.21.15.26:0/3818409417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b2c0f6550 msgr2=0x7f3b2c10c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:59:54.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.793+0000 7f3b2b7fe700 1 --2- 172.21.15.26:0/3818409417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b2c0f6550 0x7f3b2c10c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:54.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.793+0000 7f3b2b7fe700 1 -- 172.21.15.26:0/3818409417 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b1c005040 con 0x7f3b2c0f5bb0 2021-11-03T17:59:54.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.793+0000 7f3b2b7fe700 1 --2- 172.21.15.26:0/3818409417 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b2c0f5bb0 0x7f3b2c109ce0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7f3b1c004f60 tx=0x7f3b1c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:59:54.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.793+0000 7f3b13fff700 1 -- 172.21.15.26:0/3818409417 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b1c018070 con 0x7f3b2c0f5bb0 2021-11-03T17:59:54.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.793+0000 7f3b31fa3700 1 -- 172.21.15.26:0/3818409417 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b2c10c7e0 con 0x7f3b2c0f5bb0 2021-11-03T17:59:54.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.793+0000 7f3b13fff700 1 -- 172.21.15.26:0/3818409417 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3b1c007ba0 con 0x7f3b2c0f5bb0 2021-11-03T17:59:54.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.793+0000 7f3b13fff700 1 -- 172.21.15.26:0/3818409417 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b1c01c620 con 0x7f3b2c0f5bb0 2021-11-03T17:59:54.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.793+0000 7f3b31fa3700 1 -- 172.21.15.26:0/3818409417 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b2c10cd10 con 0x7f3b2c0f5bb0 2021-11-03T17:59:54.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.794+0000 7f3b31fa3700 1 -- 172.21.15.26:0/3818409417 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b2c0f4150 con 0x7f3b2c0f5bb0 2021-11-03T17:59:54.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.795+0000 7f3b13fff700 1 -- 172.21.15.26:0/3818409417 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f3b1c01d420 con 0x7f3b2c0f5bb0 2021-11-03T17:59:54.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.795+0000 7f3b13fff700 1 --2- 172.21.15.26:0/3818409417 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3b140640b0 0x7f3b14066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:59:54.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.795+0000 7f3b13fff700 1 -- 172.21.15.26:0/3818409417 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f3b1c0825f0 con 0x7f3b2c0f5bb0 2021-11-03T17:59:54.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.795+0000 7f3b2affd700 1 --2- 172.21.15.26:0/3818409417 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3b140640b0 0x7f3b14066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:59:54.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.795+0000 7f3b2affd700 1 --2- 172.21.15.26:0/3818409417 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3b140640b0 0x7f3b14066570 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f3b2000a6f0 tx=0x7f3b20008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:59:54.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:54.799+0000 7f3b13fff700 1 -- 172.21.15.26:0/3818409417 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f3b1c054a10 con 0x7f3b2c0f5bb0 2021-11-03T17:59:54.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:54 smithi026 ceph-mon[96795]: pgmap v1957: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:54.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:54 smithi194 ceph-mon[65619]: pgmap v1957: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:55.022 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.025+0000 7f3b31fa3700 1 -- 172.21.15.26:0/3818409417 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3b2c0fde20 con 0x7f3b2c0f5bb0 2021-11-03T17:59:55.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.025+0000 7f3b13fff700 1 -- 172.21.15.26:0/3818409417 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f3b1c054600 con 0x7f3b2c0f5bb0 2021-11-03T17:59:55.023 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T17:59:55.024 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T17:59:55.024 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:59:55.024 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:59:55.024 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T17:59:55.025 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T17:59:55.025 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:59:55.025 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T17:59:55.025 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T17:59:55.026 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:59:55.026 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T17:59:55.026 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T17:59:55.026 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T17:59:55.027 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T17:59:55.027 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T17:59:55.027 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T17:59:55.027 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T17:59:55.028 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T17:59:55.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.027+0000 7f3b31fa3700 1 -- 172.21.15.26:0/3818409417 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3b140640b0 msgr2=0x7f3b14066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:59:55.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.027+0000 7f3b31fa3700 1 --2- 172.21.15.26:0/3818409417 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3b140640b0 0x7f3b14066570 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f3b2000a6f0 tx=0x7f3b20008040).stop 2021-11-03T17:59:55.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.027+0000 7f3b31fa3700 1 -- 172.21.15.26:0/3818409417 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b2c0f5bb0 msgr2=0x7f3b2c109ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:59:55.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.027+0000 7f3b31fa3700 1 --2- 172.21.15.26:0/3818409417 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b2c0f5bb0 0x7f3b2c109ce0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7f3b1c004f60 tx=0x7f3b1c009b30).stop 2021-11-03T17:59:55.030 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.027+0000 7f3b31fa3700 1 -- 172.21.15.26:0/3818409417 shutdown_connections 2021-11-03T17:59:55.030 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.027+0000 7f3b31fa3700 1 --2- 172.21.15.26:0/3818409417 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3b140640b0 0x7f3b14066570 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:55.030 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.027+0000 7f3b31fa3700 1 --2- 172.21.15.26:0/3818409417 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b2c0f5bb0 0x7f3b2c109ce0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:55.030 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.027+0000 7f3b31fa3700 1 --2- 172.21.15.26:0/3818409417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b2c0f6550 0x7f3b2c10c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:55.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.027+0000 7f3b31fa3700 1 -- 172.21.15.26:0/3818409417 >> 172.21.15.26:0/3818409417 conn(0x7f3b2c0f04c0 msgr2=0x7f3b2c0fa450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:59:55.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.027+0000 7f3b31fa3700 1 -- 172.21.15.26:0/3818409417 shutdown_connections 2021-11-03T17:59:55.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.027+0000 7f3b31fa3700 1 -- 172.21.15.26:0/3818409417 wait complete. 2021-11-03T17:59:55.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.127+0000 7f744359e700 1 -- 172.21.15.26:0/3158536528 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74440f5710 msgr2=0x7f74440f5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:59:55.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.127+0000 7f744359e700 1 --2- 172.21.15.26:0/3158536528 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74440f5710 0x7f74440f5b90 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7f7438004660 tx=0x7f7438009b30).stop 2021-11-03T17:59:55.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.127+0000 7f744359e700 1 -- 172.21.15.26:0/3158536528 shutdown_connections 2021-11-03T17:59:55.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.127+0000 7f744359e700 1 --2- 172.21.15.26:0/3158536528 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74440f5710 0x7f74440f5b90 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:55.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.127+0000 7f744359e700 1 --2- 172.21.15.26:0/3158536528 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74440f6a10 0x7f74440f6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:55.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.127+0000 7f744359e700 1 -- 172.21.15.26:0/3158536528 >> 172.21.15.26:0/3158536528 conn(0x7f74440f0320 msgr2=0x7f74440f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:59:55.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.127+0000 7f744359e700 1 -- 172.21.15.26:0/3158536528 shutdown_connections 2021-11-03T17:59:55.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.128+0000 7f744359e700 1 -- 172.21.15.26:0/3158536528 wait complete. 2021-11-03T17:59:55.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.128+0000 7f744359e700 1 Processor -- start 2021-11-03T17:59:55.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.128+0000 7f744359e700 1 -- start start 2021-11-03T17:59:55.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.128+0000 7f744359e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74440f5710 0x7f744410bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:59:55.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.128+0000 7f744359e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74440f6a10 0x7f744410e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:59:55.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.128+0000 7f744359e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74440f5290 con 0x7f74440f6a10 2021-11-03T17:59:55.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.128+0000 7f744359e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74440f53d0 con 0x7f74440f5710 2021-11-03T17:59:55.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.128+0000 7f7441d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74440f6a10 0x7f744410e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:59:55.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.128+0000 7f7441d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74440f6a10 0x7f744410e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57574/0 (socket says 172.21.15.26:57574) 2021-11-03T17:59:55.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.128+0000 7f7441d9b700 1 -- 172.21.15.26:0/1368818163 learned_addr learned my addr 172.21.15.26:0/1368818163 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T17:59:55.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.128+0000 7f744259c700 1 --2- 172.21.15.26:0/1368818163 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74440f5710 0x7f744410bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:59:55.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.129+0000 7f7441d9b700 1 -- 172.21.15.26:0/1368818163 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74440f5710 msgr2=0x7f744410bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:59:55.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.129+0000 7f7441d9b700 1 --2- 172.21.15.26:0/1368818163 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74440f5710 0x7f744410bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:55.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.129+0000 7f7441d9b700 1 -- 172.21.15.26:0/1368818163 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7438005040 con 0x7f74440f6a10 2021-11-03T17:59:55.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.129+0000 7f744259c700 1 --2- 172.21.15.26:0/1368818163 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74440f5710 0x7f744410bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T17:59:55.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.129+0000 7f7441d9b700 1 --2- 172.21.15.26:0/1368818163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74440f6a10 0x7f744410e3c0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 rx=0x7f7438013a70 tx=0x7f7438009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:59:55.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.129+0000 7f7432ffd700 1 -- 172.21.15.26:0/1368818163 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7438018070 con 0x7f74440f6a10 2021-11-03T17:59:55.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.129+0000 7f7432ffd700 1 -- 172.21.15.26:0/1368818163 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f74380097d0 con 0x7f74440f6a10 2021-11-03T17:59:55.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.129+0000 7f744359e700 1 -- 172.21.15.26:0/1368818163 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f744410e8b0 con 0x7f74440f6a10 2021-11-03T17:59:55.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.129+0000 7f7432ffd700 1 -- 172.21.15.26:0/1368818163 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f743801c3c0 con 0x7f74440f6a10 2021-11-03T17:59:55.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.129+0000 7f744359e700 1 -- 172.21.15.26:0/1368818163 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f744410ec80 con 0x7f74440f6a10 2021-11-03T17:59:55.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.130+0000 7f744359e700 1 -- 172.21.15.26:0/1368818163 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7444059100 con 0x7f74440f6a10 2021-11-03T17:59:55.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.130+0000 7f7432ffd700 1 -- 172.21.15.26:0/1368818163 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f7438007ba0 con 0x7f74440f6a10 2021-11-03T17:59:55.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.131+0000 7f7432ffd700 1 --2- 172.21.15.26:0/1368818163 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f742c064100 0x7f742c0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T17:59:55.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.131+0000 7f7432ffd700 1 -- 172.21.15.26:0/1368818163 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f7438082370 con 0x7f74440f6a10 2021-11-03T17:59:55.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.131+0000 7f744259c700 1 --2- 172.21.15.26:0/1368818163 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f742c064100 0x7f742c0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T17:59:55.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.131+0000 7f744259c700 1 --2- 172.21.15.26:0/1368818163 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f742c064100 0x7f742c0665c0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f74440f5020 tx=0x7f7434009c00).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T17:59:55.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.135+0000 7f7432ffd700 1 -- 172.21.15.26:0/1368818163 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f7438054790 con 0x7f74440f6a10 2021-11-03T17:59:55.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.337+0000 7f744359e700 1 -- 172.21.15.26:0/1368818163 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f74440fdc30 con 0x7f74440f6a10 2021-11-03T17:59:55.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.338+0000 7f7432ffd700 1 -- 172.21.15.26:0/1368818163 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f7438054380 con 0x7f74440f6a10 2021-11-03T17:59:55.336 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T17:59:55.336 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T17:59:55.337 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:59:55.337 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T17:59:55.337 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:59:55.337 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T17:59:55.338 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T17:59:55.338 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T17:59:55.338 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T17:59:55.338 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T17:59:55.339 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T17:59:55.339 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T17:59:55.339 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T17:59:55.339 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T17:59:55.340 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T17:59:55.340 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T17:59:55.340 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T17:59:55.340 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T17:59:55.340 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T17:59:55.341 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T17:59:55.341 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T17:59:55.341 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T17:59:55.341 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T17:59:55.342 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T17:59:55.342 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T17:59:55.342 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T17:59:55.342 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T17:59:55.343 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T17:59:55.343 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T17:59:55.343 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T17:59:55.343 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T17:59:55.343 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:59:55.344 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:59:55.344 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T17:59:55.344 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T17:59:55.344 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:59:55.345 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:59:55.345 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:59:55.345 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T17:59:55.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.340+0000 7f744359e700 1 -- 172.21.15.26:0/1368818163 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f742c064100 msgr2=0x7f742c0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:59:55.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.340+0000 7f744359e700 1 --2- 172.21.15.26:0/1368818163 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f742c064100 0x7f742c0665c0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f74440f5020 tx=0x7f7434009c00).stop 2021-11-03T17:59:55.347 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.340+0000 7f744359e700 1 -- 172.21.15.26:0/1368818163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74440f6a10 msgr2=0x7f744410e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T17:59:55.347 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.340+0000 7f744359e700 1 --2- 172.21.15.26:0/1368818163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74440f6a10 0x7f744410e3c0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 rx=0x7f7438013a70 tx=0x7f7438009b30).stop 2021-11-03T17:59:55.347 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.340+0000 7f744359e700 1 -- 172.21.15.26:0/1368818163 shutdown_connections 2021-11-03T17:59:55.348 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.340+0000 7f744359e700 1 --2- 172.21.15.26:0/1368818163 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f742c064100 0x7f742c0665c0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:55.348 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.340+0000 7f744359e700 1 --2- 172.21.15.26:0/1368818163 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74440f5710 0x7f744410bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:55.349 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.340+0000 7f744359e700 1 --2- 172.21.15.26:0/1368818163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74440f6a10 0x7f744410e3c0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T17:59:55.349 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.340+0000 7f744359e700 1 -- 172.21.15.26:0/1368818163 >> 172.21.15.26:0/1368818163 conn(0x7f74440f0320 msgr2=0x7f74440fa170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T17:59:55.349 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.340+0000 7f744359e700 1 -- 172.21.15.26:0/1368818163 shutdown_connections 2021-11-03T17:59:55.350 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T17:59:55.340+0000 7f744359e700 1 -- 172.21.15.26:0/1368818163 wait complete. 2021-11-03T17:59:55.350 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T17:59:55.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:55 smithi026 ceph-mon[96795]: from='client.36156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:59:55.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:55 smithi026 ceph-mon[96795]: from='client.36160 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:59:55.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:55 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3818409417' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:59:55.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:55 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1368818163' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:59:55.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:55 smithi194 ceph-mon[65619]: from='client.36156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:59:55.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:55 smithi194 ceph-mon[65619]: from='client.36160 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T17:59:55.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:55 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3818409417' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T17:59:55.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:55 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1368818163' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T17:59:56.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:56 smithi026 ceph-mon[96795]: pgmap v1958: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:56.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:56 smithi194 ceph-mon[65619]: pgmap v1958: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:58.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 17:59:58 smithi026 ceph-mon[96795]: pgmap v1959: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T17:59:58.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 17:59:58 smithi194 ceph-mon[65619]: pgmap v1959: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:00.423 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:00 smithi026 conmon[96772]: 2021-11-03T17:59:59.998+0000 7f27986f6700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 2 daemons have recently crashed 2021-11-03T18:00:00.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:00 smithi026 ceph-mon[96795]: pgmap v1960: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:00.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:00 smithi026 ceph-mon[96795]: overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 2 daemons have recently crashed 2021-11-03T18:00:00.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:00 smithi194 ceph-mon[65619]: pgmap v1960: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:00.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:00 smithi194 ceph-mon[65619]: overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 2 daemons have recently crashed 2021-11-03T18:00:02.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:02 smithi026 ceph-mon[96795]: pgmap v1961: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:02.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:02 smithi194 ceph-mon[65619]: pgmap v1961: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:04.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:04 smithi026 ceph-mon[96795]: pgmap v1962: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:04.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:04 smithi194 ceph-mon[65619]: pgmap v1962: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:05.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:05 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:00:05.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:05 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:00:06.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:06 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:00:06.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:06 smithi026 ceph-mon[96795]: pgmap v1963: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:06.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:06 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:00:06.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:06 smithi194 ceph-mon[65619]: pgmap v1963: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:08.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:08 smithi026 ceph-mon[96795]: pgmap v1964: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:08.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:08 smithi194 ceph-mon[65619]: pgmap v1964: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:10.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:10 smithi026 ceph-mon[96795]: pgmap v1965: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:10.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:10 smithi194 ceph-mon[65619]: pgmap v1965: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:12.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:12 smithi026 ceph-mon[96795]: pgmap v1966: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:12.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:12 smithi194 ceph-mon[65619]: pgmap v1966: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:14.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:14 smithi026 ceph-mon[96795]: pgmap v1967: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:14.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:14 smithi194 ceph-mon[65619]: pgmap v1967: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:16.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:16 smithi026 ceph-mon[96795]: pgmap v1968: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:16.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:16 smithi194 ceph-mon[65619]: pgmap v1968: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:18.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:18 smithi026 ceph-mon[96795]: pgmap v1969: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:18.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:18 smithi194 ceph-mon[65619]: pgmap v1969: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:20.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:20 smithi026 ceph-mon[96795]: pgmap v1970: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:20.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:20 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:00:20.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:20 smithi194 ceph-mon[65619]: pgmap v1970: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:20.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:20 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:00:21.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:21 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:00:21.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:21 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:00:22.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:22 smithi026 ceph-mon[96795]: pgmap v1971: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:22.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:22 smithi194 ceph-mon[65619]: pgmap v1971: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:24.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:24 smithi026 ceph-mon[96795]: pgmap v1972: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:24.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:24 smithi194 ceph-mon[65619]: pgmap v1972: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:25.453 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.455+0000 7f7617bf7700 1 -- 172.21.15.26:0/2995750767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76100f66e0 msgr2=0x7f76100f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:00:25.454 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.455+0000 7f7617bf7700 1 --2- 172.21.15.26:0/2995750767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76100f66e0 0x7f76100f6b00 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 rx=0x7f7600004660 tx=0x7f7600009b30).stop 2021-11-03T18:00:25.454 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.455+0000 7f7617bf7700 1 -- 172.21.15.26:0/2995750767 shutdown_connections 2021-11-03T18:00:25.454 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.455+0000 7f7617bf7700 1 --2- 172.21.15.26:0/2995750767 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76100f6ff0 0x7f76100f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:25.455 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.455+0000 7f7617bf7700 1 --2- 172.21.15.26:0/2995750767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76100f66e0 0x7f76100f6b00 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:25.455 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.455+0000 7f7617bf7700 1 -- 172.21.15.26:0/2995750767 >> 172.21.15.26:0/2995750767 conn(0x7f76100f1f00 msgr2=0x7f76100f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:00:25.455 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.455+0000 7f7617bf7700 1 -- 172.21.15.26:0/2995750767 shutdown_connections 2021-11-03T18:00:25.455 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.456+0000 7f7617bf7700 1 -- 172.21.15.26:0/2995750767 wait complete. 2021-11-03T18:00:25.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.456+0000 7f7617bf7700 1 Processor -- start 2021-11-03T18:00:25.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.456+0000 7f7617bf7700 1 -- start start 2021-11-03T18:00:25.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.456+0000 7f7617bf7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76100f66e0 0x7f7610106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:00:25.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.456+0000 7f7617bf7700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76100f6ff0 0x7f7610107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:00:25.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.456+0000 7f7617bf7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7610107a00 con 0x7f76100f66e0 2021-11-03T18:00:25.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.456+0000 7f7617bf7700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7610107b40 con 0x7f76100f6ff0 2021-11-03T18:00:25.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.456+0000 7f7615993700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76100f66e0 0x7f7610106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:00:25.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.456+0000 7f7615993700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76100f66e0 0x7f7610106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57590/0 (socket says 172.21.15.26:57590) 2021-11-03T18:00:25.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.456+0000 7f7615993700 1 -- 172.21.15.26:0/2632419095 learned_addr learned my addr 172.21.15.26:0/2632419095 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:00:25.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.457+0000 7f7615192700 1 --2- 172.21.15.26:0/2632419095 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76100f6ff0 0x7f7610107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:00:25.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.457+0000 7f7615993700 1 -- 172.21.15.26:0/2632419095 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76100f6ff0 msgr2=0x7f7610107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:00:25.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.457+0000 7f7615993700 1 --2- 172.21.15.26:0/2632419095 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76100f6ff0 0x7f7610107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:25.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.457+0000 7f7615993700 1 -- 172.21.15.26:0/2632419095 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7600005040 con 0x7f76100f66e0 2021-11-03T18:00:25.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.457+0000 7f7615993700 1 --2- 172.21.15.26:0/2632419095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76100f66e0 0x7f7610106f60 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7f7600009830 tx=0x7f7600009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:00:25.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.457+0000 7f76067fc700 1 -- 172.21.15.26:0/2632419095 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7600018070 con 0x7f76100f66e0 2021-11-03T18:00:25.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.457+0000 7f76067fc700 1 -- 172.21.15.26:0/2632419095 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7600007ba0 con 0x7f76100f66e0 2021-11-03T18:00:25.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.457+0000 7f76067fc700 1 -- 172.21.15.26:0/2632419095 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f760001c620 con 0x7f76100f66e0 2021-11-03T18:00:25.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.457+0000 7f7617bf7700 1 -- 172.21.15.26:0/2632419095 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7610108480 con 0x7f76100f66e0 2021-11-03T18:00:25.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.457+0000 7f7617bf7700 1 -- 172.21.15.26:0/2632419095 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76101089e0 con 0x7f76100f66e0 2021-11-03T18:00:25.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.458+0000 7f7617bf7700 1 -- 172.21.15.26:0/2632419095 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7610045ad0 con 0x7f76100f66e0 2021-11-03T18:00:25.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.459+0000 7f76067fc700 1 -- 172.21.15.26:0/2632419095 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f760001c850 con 0x7f76100f66e0 2021-11-03T18:00:25.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.459+0000 7f76067fc700 1 --2- 172.21.15.26:0/2632419095 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f75fc064090 0x7f75fc066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:00:25.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.459+0000 7f76067fc700 1 -- 172.21.15.26:0/2632419095 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f7600082440 con 0x7f76100f66e0 2021-11-03T18:00:25.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.459+0000 7f7615192700 1 --2- 172.21.15.26:0/2632419095 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f75fc064090 0x7f75fc066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:00:25.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.460+0000 7f7615192700 1 --2- 172.21.15.26:0/2632419095 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f75fc064090 0x7f75fc066550 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f760c004a70 tx=0x7f760c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:00:25.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.463+0000 7f76067fc700 1 -- 172.21.15.26:0/2632419095 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f7600054860 con 0x7f76100f66e0 2021-11-03T18:00:25.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.646+0000 7f7617bf7700 1 -- 172.21.15.26:0/2632419095 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f76100ff050 con 0x7f75fc064090 2021-11-03T18:00:25.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.647+0000 7f76067fc700 1 -- 172.21.15.26:0/2632419095 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f76100ff050 con 0x7f75fc064090 2021-11-03T18:00:25.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.649+0000 7f7617bf7700 1 -- 172.21.15.26:0/2632419095 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f75fc064090 msgr2=0x7f75fc066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:00:25.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.649+0000 7f7617bf7700 1 --2- 172.21.15.26:0/2632419095 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f75fc064090 0x7f75fc066550 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f760c004a70 tx=0x7f760c00b040).stop 2021-11-03T18:00:25.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.650+0000 7f7617bf7700 1 -- 172.21.15.26:0/2632419095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76100f66e0 msgr2=0x7f7610106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:00:25.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.650+0000 7f7617bf7700 1 --2- 172.21.15.26:0/2632419095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76100f66e0 0x7f7610106f60 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7f7600009830 tx=0x7f7600009b30).stop 2021-11-03T18:00:25.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.650+0000 7f7617bf7700 1 -- 172.21.15.26:0/2632419095 shutdown_connections 2021-11-03T18:00:25.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.650+0000 7f7617bf7700 1 --2- 172.21.15.26:0/2632419095 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f75fc064090 0x7f75fc066550 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:25.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.650+0000 7f7617bf7700 1 --2- 172.21.15.26:0/2632419095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76100f66e0 0x7f7610106f60 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:25.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.650+0000 7f7617bf7700 1 --2- 172.21.15.26:0/2632419095 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76100f6ff0 0x7f7610107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:25.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.650+0000 7f7617bf7700 1 -- 172.21.15.26:0/2632419095 >> 172.21.15.26:0/2632419095 conn(0x7f76100f1f00 msgr2=0x7f76100fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:00:25.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.650+0000 7f7617bf7700 1 -- 172.21.15.26:0/2632419095 shutdown_connections 2021-11-03T18:00:25.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.650+0000 7f7617bf7700 1 -- 172.21.15.26:0/2632419095 wait complete. 2021-11-03T18:00:25.656 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:00:25.748 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.749+0000 7fb352450700 1 -- 172.21.15.26:0/2443155658 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb34c060310 msgr2=0x7fb34c0f9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:00:25.748 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.749+0000 7fb352450700 1 --2- 172.21.15.26:0/2443155658 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb34c060310 0x7fb34c0f9120 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7fb348004660 tx=0x7fb348009b30).stop 2021-11-03T18:00:25.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.749+0000 7fb352450700 1 -- 172.21.15.26:0/2443155658 shutdown_connections 2021-11-03T18:00:25.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.749+0000 7fb352450700 1 --2- 172.21.15.26:0/2443155658 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb34c0f96a0 0x7fb34c0fbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:25.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.749+0000 7fb352450700 1 --2- 172.21.15.26:0/2443155658 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb34c060310 0x7fb34c0f9120 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:25.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.749+0000 7fb352450700 1 -- 172.21.15.26:0/2443155658 >> 172.21.15.26:0/2443155658 conn(0x7fb34c0f0ba0 msgr2=0x7fb34c0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:00:25.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.749+0000 7fb352450700 1 -- 172.21.15.26:0/2443155658 shutdown_connections 2021-11-03T18:00:25.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.750+0000 7fb352450700 1 -- 172.21.15.26:0/2443155658 wait complete. 2021-11-03T18:00:25.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.750+0000 7fb352450700 1 Processor -- start 2021-11-03T18:00:25.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.750+0000 7fb352450700 1 -- start start 2021-11-03T18:00:25.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.750+0000 7fb352450700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb34c060310 0x7fb34c0f6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:00:25.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.750+0000 7fb352450700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb34c0f96a0 0x7fb34c0f5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:00:25.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.750+0000 7fb352450700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c0f5580 con 0x7fb34c0f96a0 2021-11-03T18:00:25.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.750+0000 7fb352450700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c0f56c0 con 0x7fb34c060310 2021-11-03T18:00:25.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.750+0000 7fb350c4d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb34c0f96a0 0x7fb34c0f5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:00:25.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.750+0000 7fb350c4d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb34c0f96a0 0x7fb34c0f5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57602/0 (socket says 172.21.15.26:57602) 2021-11-03T18:00:25.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.750+0000 7fb350c4d700 1 -- 172.21.15.26:0/3392283689 learned_addr learned my addr 172.21.15.26:0/3392283689 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:00:25.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.750+0000 7fb35144e700 1 --2- 172.21.15.26:0/3392283689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb34c060310 0x7fb34c0f6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:00:25.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.751+0000 7fb350c4d700 1 -- 172.21.15.26:0/3392283689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb34c060310 msgr2=0x7fb34c0f6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:00:25.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.751+0000 7fb350c4d700 1 --2- 172.21.15.26:0/3392283689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb34c060310 0x7fb34c0f6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:25.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.751+0000 7fb350c4d700 1 -- 172.21.15.26:0/3392283689 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb348005040 con 0x7fb34c0f96a0 2021-11-03T18:00:25.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.751+0000 7fb350c4d700 1 --2- 172.21.15.26:0/3392283689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb34c0f96a0 0x7fb34c0f5020 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 rx=0x7fb33c002700 tx=0x7fb33c009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:00:25.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.751+0000 7fb341ffb700 1 -- 172.21.15.26:0/3392283689 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb33c0079c0 con 0x7fb34c0f96a0 2021-11-03T18:00:25.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.751+0000 7fb341ffb700 1 -- 172.21.15.26:0/3392283689 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb33c00f040 con 0x7fb34c0f96a0 2021-11-03T18:00:25.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.751+0000 7fb352450700 1 -- 172.21.15.26:0/3392283689 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb34c0f59a0 con 0x7fb34c0f96a0 2021-11-03T18:00:25.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.751+0000 7fb341ffb700 1 -- 172.21.15.26:0/3392283689 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb33c014740 con 0x7fb34c0f96a0 2021-11-03T18:00:25.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.751+0000 7fb352450700 1 -- 172.21.15.26:0/3392283689 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb34c10ed80 con 0x7fb34c0f96a0 2021-11-03T18:00:25.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.752+0000 7fb352450700 1 -- 172.21.15.26:0/3392283689 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb34c045ad0 con 0x7fb34c0f96a0 2021-11-03T18:00:25.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.752+0000 7fb341ffb700 1 -- 172.21.15.26:0/3392283689 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fb33c01b060 con 0x7fb34c0f96a0 2021-11-03T18:00:25.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.753+0000 7fb341ffb700 1 --2- 172.21.15.26:0/3392283689 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb338064100 0x7fb3380665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:00:25.757 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.753+0000 7fb341ffb700 1 -- 172.21.15.26:0/3392283689 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fb33c080580 con 0x7fb34c0f96a0 2021-11-03T18:00:25.757 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.753+0000 7fb35144e700 1 --2- 172.21.15.26:0/3392283689 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb338064100 0x7fb3380665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:00:25.757 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.753+0000 7fb35144e700 1 --2- 172.21.15.26:0/3392283689 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb338064100 0x7fb3380665c0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7fb348013690 tx=0x7fb348009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:00:25.758 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.757+0000 7fb341ffb700 1 -- 172.21.15.26:0/3392283689 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fb33c052880 con 0x7fb34c0f96a0 2021-11-03T18:00:25.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.930+0000 7fb352450700 1 -- 172.21.15.26:0/3392283689 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb34c0fee30 con 0x7fb338064100 2021-11-03T18:00:25.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.945+0000 7fb341ffb700 1 -- 172.21.15.26:0/3392283689 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fb34c0fee30 con 0x7fb338064100 2021-11-03T18:00:25.941 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:00:25.942 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (71m) 36s ago 72m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:00:25.942 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (63m) 36s ago 72m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:00:25.942 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (63m) 9m ago 72m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:00:25.943 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (71m) 36s ago 72m 41.7M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:00:25.943 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (64m) 36s ago 68m 25.6M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:00:25.943 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (64m) 36s ago 67m 26.2M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:00:25.943 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (68m) 9m ago 68m 26.2M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:00:25.944 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (68m) 9m ago 68m 26.5M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:00:25.944 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (65m) 36s ago 74m 561M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:00:25.944 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (64m) 9m ago 72m 421M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:00:25.944 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (64m) 36s ago 74m 276M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:00:25.945 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (64m) 9m ago 72m 117M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:00:25.945 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (72m) 36s ago 72m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:00:25.945 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (71m) 9m ago 71m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:00:25.945 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (63m) 36s ago 71m 292M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:00:25.946 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (62m) 36s ago 70m 313M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:00:25.946 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (62m) 36s ago 70m 261M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:00:25.946 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (61m) 9m ago 70m 312M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:00:25.946 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (61m) 9m ago 69m 265M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:00:25.947 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (61m) 9m ago 69m 255M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:00:25.947 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (71m) 36s ago 72m 61.2M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:00:25.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.946+0000 7fb352450700 1 -- 172.21.15.26:0/3392283689 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb338064100 msgr2=0x7fb3380665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:00:25.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.946+0000 7fb352450700 1 --2- 172.21.15.26:0/3392283689 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb338064100 0x7fb3380665c0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7fb348013690 tx=0x7fb348009b30).stop 2021-11-03T18:00:25.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.946+0000 7fb352450700 1 -- 172.21.15.26:0/3392283689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb34c0f96a0 msgr2=0x7fb34c0f5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:00:25.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.946+0000 7fb352450700 1 --2- 172.21.15.26:0/3392283689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb34c0f96a0 0x7fb34c0f5020 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 rx=0x7fb33c002700 tx=0x7fb33c009d60).stop 2021-11-03T18:00:25.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.946+0000 7fb352450700 1 -- 172.21.15.26:0/3392283689 shutdown_connections 2021-11-03T18:00:25.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.946+0000 7fb352450700 1 --2- 172.21.15.26:0/3392283689 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb338064100 0x7fb3380665c0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:25.950 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.946+0000 7fb352450700 1 --2- 172.21.15.26:0/3392283689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb34c060310 0x7fb34c0f6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:25.950 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.946+0000 7fb352450700 1 --2- 172.21.15.26:0/3392283689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb34c0f96a0 0x7fb34c0f5020 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:25.950 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.946+0000 7fb352450700 1 -- 172.21.15.26:0/3392283689 >> 172.21.15.26:0/3392283689 conn(0x7fb34c0f0ba0 msgr2=0x7fb34c0f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:00:25.950 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.947+0000 7fb352450700 1 -- 172.21.15.26:0/3392283689 shutdown_connections 2021-11-03T18:00:25.951 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:25.947+0000 7fb352450700 1 -- 172.21.15.26:0/3392283689 wait complete. 2021-11-03T18:00:26.045 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.046+0000 7f277d1f3700 1 -- 172.21.15.26:0/426588894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27780f55e0 msgr2=0x7f27780f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:00:26.045 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.046+0000 7f277d1f3700 1 --2- 172.21.15.26:0/426588894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27780f55e0 0x7f27780f5a00 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7f2770004660 tx=0x7f2770009b30).stop 2021-11-03T18:00:26.045 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.046+0000 7f277d1f3700 1 -- 172.21.15.26:0/426588894 shutdown_connections 2021-11-03T18:00:26.046 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.046+0000 7f277d1f3700 1 --2- 172.21.15.26:0/426588894 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27780f5ef0 0x7f27780f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:26.046 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.046+0000 7f277d1f3700 1 --2- 172.21.15.26:0/426588894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27780f55e0 0x7f27780f5a00 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:26.046 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.046+0000 7f277d1f3700 1 -- 172.21.15.26:0/426588894 >> 172.21.15.26:0/426588894 conn(0x7f27780f0de0 msgr2=0x7f27780f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:00:26.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.046+0000 7f277d1f3700 1 -- 172.21.15.26:0/426588894 shutdown_connections 2021-11-03T18:00:26.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.046+0000 7f277d1f3700 1 -- 172.21.15.26:0/426588894 wait complete. 2021-11-03T18:00:26.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.047+0000 7f277d1f3700 1 Processor -- start 2021-11-03T18:00:26.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.047+0000 7f277d1f3700 1 -- start start 2021-11-03T18:00:26.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.047+0000 7f277d1f3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27780f55e0 0x7f2778109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:00:26.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.047+0000 7f277d1f3700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27780f5ef0 0x7f277810c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:00:26.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.047+0000 7f277d1f3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2778060540 con 0x7f27780f55e0 2021-11-03T18:00:26.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.047+0000 7f277d1f3700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2778060680 con 0x7f27780f5ef0 2021-11-03T18:00:26.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.047+0000 7f2776d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27780f55e0 0x7f2778109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:00:26.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.047+0000 7f2776d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27780f55e0 0x7f2778109c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57610/0 (socket says 172.21.15.26:57610) 2021-11-03T18:00:26.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.047+0000 7f2776d9d700 1 -- 172.21.15.26:0/2943103292 learned_addr learned my addr 172.21.15.26:0/2943103292 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:00:26.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.047+0000 7f277659c700 1 --2- 172.21.15.26:0/2943103292 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27780f5ef0 0x7f277810c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:00:26.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.047+0000 7f2776d9d700 1 -- 172.21.15.26:0/2943103292 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27780f5ef0 msgr2=0x7f277810c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:00:26.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.047+0000 7f2776d9d700 1 --2- 172.21.15.26:0/2943103292 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27780f5ef0 0x7f277810c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:26.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.047+0000 7f2776d9d700 1 -- 172.21.15.26:0/2943103292 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2770005040 con 0x7f27780f55e0 2021-11-03T18:00:26.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.047+0000 7f277659c700 1 --2- 172.21.15.26:0/2943103292 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27780f5ef0 0x7f277810c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:00:26.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.048+0000 7f2776d9d700 1 --2- 172.21.15.26:0/2943103292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27780f55e0 0x7f2778109c50 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7f2770009990 tx=0x7f2770009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:00:26.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.048+0000 7f276f7fe700 1 -- 172.21.15.26:0/2943103292 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2770018070 con 0x7f27780f55e0 2021-11-03T18:00:26.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.048+0000 7f276f7fe700 1 -- 172.21.15.26:0/2943103292 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2770007ba0 con 0x7f27780f55e0 2021-11-03T18:00:26.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.048+0000 7f277d1f3700 1 -- 172.21.15.26:0/2943103292 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f277810c700 con 0x7f27780f55e0 2021-11-03T18:00:26.053 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.048+0000 7f276f7fe700 1 -- 172.21.15.26:0/2943103292 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f277001c3c0 con 0x7f27780f55e0 2021-11-03T18:00:26.053 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.048+0000 7f277d1f3700 1 -- 172.21.15.26:0/2943103292 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f277810cc30 con 0x7f27780f55e0 2021-11-03T18:00:26.053 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.049+0000 7f277d1f3700 1 -- 172.21.15.26:0/2943103292 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2778045ad0 con 0x7f27780f55e0 2021-11-03T18:00:26.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.049+0000 7f276f7fe700 1 -- 172.21.15.26:0/2943103292 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f277001d420 con 0x7f27780f55e0 2021-11-03T18:00:26.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.050+0000 7f276f7fe700 1 --2- 172.21.15.26:0/2943103292 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2764064180 0x7f2764066640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:00:26.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.050+0000 7f276f7fe700 1 -- 172.21.15.26:0/2943103292 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f2770082320 con 0x7f27780f55e0 2021-11-03T18:00:26.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.050+0000 7f277659c700 1 --2- 172.21.15.26:0/2943103292 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2764064180 0x7f2764066640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:00:26.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.050+0000 7f277659c700 1 --2- 172.21.15.26:0/2943103292 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2764064180 0x7f2764066640 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f2760009740 tx=0x7f2760009be0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:00:26.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.054+0000 7f276f7fe700 1 -- 172.21.15.26:0/2943103292 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f27700546a0 con 0x7f27780f55e0 2021-11-03T18:00:26.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.284+0000 7f277d1f3700 1 -- 172.21.15.26:0/2943103292 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f27780fdea0 con 0x7f27780f55e0 2021-11-03T18:00:26.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.284+0000 7f276f7fe700 1 -- 172.21.15.26:0/2943103292 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f2770054290 con 0x7f27780f55e0 2021-11-03T18:00:26.281 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:00:26.282 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:00:26.282 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:00:26.282 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:00:26.282 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:00:26.283 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:00:26.283 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:00:26.283 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:00:26.283 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:00:26.283 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:00:26.284 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:00:26.284 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:00:26.284 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:00:26.284 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:00:26.285 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:00:26.285 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:00:26.285 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:00:26.285 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:00:26.286 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.286+0000 7f277d1f3700 1 -- 172.21.15.26:0/2943103292 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2764064180 msgr2=0x7f2764066640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:00:26.286 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.286+0000 7f277d1f3700 1 --2- 172.21.15.26:0/2943103292 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2764064180 0x7f2764066640 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f2760009740 tx=0x7f2760009be0).stop 2021-11-03T18:00:26.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.286+0000 7f277d1f3700 1 -- 172.21.15.26:0/2943103292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27780f55e0 msgr2=0x7f2778109c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:00:26.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.286+0000 7f277d1f3700 1 --2- 172.21.15.26:0/2943103292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27780f55e0 0x7f2778109c50 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7f2770009990 tx=0x7f2770009b30).stop 2021-11-03T18:00:26.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.286+0000 7f277d1f3700 1 -- 172.21.15.26:0/2943103292 shutdown_connections 2021-11-03T18:00:26.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.286+0000 7f277d1f3700 1 --2- 172.21.15.26:0/2943103292 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2764064180 0x7f2764066640 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:26.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.286+0000 7f277d1f3700 1 --2- 172.21.15.26:0/2943103292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27780f55e0 0x7f2778109c50 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:26.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.286+0000 7f277d1f3700 1 --2- 172.21.15.26:0/2943103292 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27780f5ef0 0x7f277810c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:26.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.286+0000 7f277d1f3700 1 -- 172.21.15.26:0/2943103292 >> 172.21.15.26:0/2943103292 conn(0x7f27780f0de0 msgr2=0x7f27780fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:00:26.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.286+0000 7f277d1f3700 1 -- 172.21.15.26:0/2943103292 shutdown_connections 2021-11-03T18:00:26.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.286+0000 7f277d1f3700 1 -- 172.21.15.26:0/2943103292 wait complete. 2021-11-03T18:00:26.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.386+0000 7f71e97de700 1 -- 172.21.15.26:0/2033610500 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71e40f55e0 msgr2=0x7f71e40f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:00:26.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.386+0000 7f71e97de700 1 --2- 172.21.15.26:0/2033610500 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71e40f55e0 0x7f71e40f5a00 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7f71d8004660 tx=0x7f71d8009b30).stop 2021-11-03T18:00:26.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.386+0000 7f71e97de700 1 -- 172.21.15.26:0/2033610500 shutdown_connections 2021-11-03T18:00:26.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.386+0000 7f71e97de700 1 --2- 172.21.15.26:0/2033610500 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71e40f5ef0 0x7f71e40f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:26.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.386+0000 7f71e97de700 1 --2- 172.21.15.26:0/2033610500 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71e40f55e0 0x7f71e40f5a00 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:26.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.386+0000 7f71e97de700 1 -- 172.21.15.26:0/2033610500 >> 172.21.15.26:0/2033610500 conn(0x7f71e40f0de0 msgr2=0x7f71e40f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:00:26.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.386+0000 7f71e97de700 1 -- 172.21.15.26:0/2033610500 shutdown_connections 2021-11-03T18:00:26.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.386+0000 7f71e97de700 1 -- 172.21.15.26:0/2033610500 wait complete. 2021-11-03T18:00:26.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.387+0000 7f71e97de700 1 Processor -- start 2021-11-03T18:00:26.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.387+0000 7f71e97de700 1 -- start start 2021-11-03T18:00:26.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.387+0000 7f71e97de700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71e40f55e0 0x7f71e4106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:00:26.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.387+0000 7f71e97de700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71e40f5ef0 0x7f71e4107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:00:26.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.387+0000 7f71e97de700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e4107a10 con 0x7f71e40f55e0 2021-11-03T18:00:26.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.387+0000 7f71e97de700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e4107b50 con 0x7f71e40f5ef0 2021-11-03T18:00:26.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.387+0000 7f71e2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71e40f55e0 0x7f71e4106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:00:26.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.387+0000 7f71e2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71e40f55e0 0x7f71e4106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57620/0 (socket says 172.21.15.26:57620) 2021-11-03T18:00:26.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.387+0000 7f71e2ffd700 1 -- 172.21.15.26:0/1584032879 learned_addr learned my addr 172.21.15.26:0/1584032879 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:00:26.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.388+0000 7f71e27fc700 1 --2- 172.21.15.26:0/1584032879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71e40f5ef0 0x7f71e4107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:00:26.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.388+0000 7f71e2ffd700 1 -- 172.21.15.26:0/1584032879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71e40f5ef0 msgr2=0x7f71e4107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:00:26.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.388+0000 7f71e2ffd700 1 --2- 172.21.15.26:0/1584032879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71e40f5ef0 0x7f71e4107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:26.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.388+0000 7f71e2ffd700 1 -- 172.21.15.26:0/1584032879 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d8005040 con 0x7f71e40f55e0 2021-11-03T18:00:26.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.388+0000 7f71e27fc700 1 --2- 172.21.15.26:0/1584032879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71e40f5ef0 0x7f71e4107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:00:26.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.388+0000 7f71e2ffd700 1 --2- 172.21.15.26:0/1584032879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71e40f55e0 0x7f71e4106f70 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7f71d8009da0 tx=0x7f71d8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:00:26.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.388+0000 7f71cb7fe700 1 -- 172.21.15.26:0/1584032879 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71d8018070 con 0x7f71e40f55e0 2021-11-03T18:00:26.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.388+0000 7f71cb7fe700 1 -- 172.21.15.26:0/1584032879 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f71d8007d70 con 0x7f71e40f55e0 2021-11-03T18:00:26.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.388+0000 7f71e97de700 1 -- 172.21.15.26:0/1584032879 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71e4108490 con 0x7f71e40f55e0 2021-11-03T18:00:26.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.388+0000 7f71cb7fe700 1 -- 172.21.15.26:0/1584032879 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71d801dea0 con 0x7f71e40f55e0 2021-11-03T18:00:26.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.388+0000 7f71e97de700 1 -- 172.21.15.26:0/1584032879 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71e41089f0 con 0x7f71e40f55e0 2021-11-03T18:00:26.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.389+0000 7f71e97de700 1 -- 172.21.15.26:0/1584032879 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71e4045ad0 con 0x7f71e40f55e0 2021-11-03T18:00:26.395 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.389+0000 7f71cb7fe700 1 -- 172.21.15.26:0/1584032879 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f71d801d420 con 0x7f71e40f55e0 2021-11-03T18:00:26.395 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.390+0000 7f71cb7fe700 1 --2- 172.21.15.26:0/1584032879 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f71cc064090 0x7f71cc066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:00:26.395 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.390+0000 7f71cb7fe700 1 -- 172.21.15.26:0/1584032879 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f71d8082680 con 0x7f71e40f55e0 2021-11-03T18:00:26.395 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.390+0000 7f71e27fc700 1 --2- 172.21.15.26:0/1584032879 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f71cc064090 0x7f71cc066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:00:26.395 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.390+0000 7f71e27fc700 1 --2- 172.21.15.26:0/1584032879 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f71cc064090 0x7f71cc066550 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f71d40041d0 tx=0x7f71d4009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:00:26.396 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.394+0000 7f71cb7fe700 1 -- 172.21.15.26:0/1584032879 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f71d8054aa0 con 0x7f71e40f55e0 2021-11-03T18:00:26.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.600+0000 7f71e97de700 1 -- 172.21.15.26:0/1584032879 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f71e410d590 con 0x7f71e40f55e0 2021-11-03T18:00:26.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.600+0000 7f71cb7fe700 1 -- 172.21.15.26:0/1584032879 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f71d8054690 con 0x7f71e40f55e0 2021-11-03T18:00:26.597 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:00:26.597 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:00:26.598 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:00:26.598 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:00:26.598 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:00:26.598 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:00:26.599 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:00:26.599 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:00:26.599 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:00:26.600 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:00:26.600 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:00:26.600 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:00:26.600 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:00:26.600 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:00:26.601 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:00:26.601 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:00:26.601 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:00:26.601 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:00:26.602 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:00:26.602 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:00:26.602 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:00:26.602 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:00:26.602 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:00:26.603 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:00:26.603 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:00:26.603 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:00:26.603 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:00:26.604 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:00:26.604 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:00:26.604 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:00:26.604 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:00:26.604 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:00:26.605 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:00:26.605 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:00:26.605 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:00:26.605 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:00:26.606 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:00:26.606 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:00:26.606 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:00:26.607 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.602+0000 7f71e97de700 1 -- 172.21.15.26:0/1584032879 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f71cc064090 msgr2=0x7f71cc066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:00:26.607 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.602+0000 7f71e97de700 1 --2- 172.21.15.26:0/1584032879 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f71cc064090 0x7f71cc066550 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f71d40041d0 tx=0x7f71d4009040).stop 2021-11-03T18:00:26.608 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.602+0000 7f71e97de700 1 -- 172.21.15.26:0/1584032879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71e40f55e0 msgr2=0x7f71e4106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:00:26.608 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.602+0000 7f71e97de700 1 --2- 172.21.15.26:0/1584032879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71e40f55e0 0x7f71e4106f70 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7f71d8009da0 tx=0x7f71d8009b30).stop 2021-11-03T18:00:26.608 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.602+0000 7f71e97de700 1 -- 172.21.15.26:0/1584032879 shutdown_connections 2021-11-03T18:00:26.608 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.602+0000 7f71e97de700 1 --2- 172.21.15.26:0/1584032879 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f71cc064090 0x7f71cc066550 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:26.608 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.602+0000 7f71e97de700 1 --2- 172.21.15.26:0/1584032879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71e40f55e0 0x7f71e4106f70 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:26.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.602+0000 7f71e97de700 1 --2- 172.21.15.26:0/1584032879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71e40f5ef0 0x7f71e4107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:26.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.602+0000 7f71e97de700 1 -- 172.21.15.26:0/1584032879 >> 172.21.15.26:0/1584032879 conn(0x7f71e40f0de0 msgr2=0x7f71e405f740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:00:26.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.602+0000 7f71e97de700 1 -- 172.21.15.26:0/1584032879 shutdown_connections 2021-11-03T18:00:26.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:26.602+0000 7f71e97de700 1 -- 172.21.15.26:0/1584032879 wait complete. 2021-11-03T18:00:26.610 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:00:26.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:26 smithi026 ceph-mon[96795]: pgmap v1973: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:26.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:26 smithi026 ceph-mon[96795]: from='client.36172 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:00:26.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:26 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2943103292' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:00:26.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:26 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1584032879' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:00:26.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:26 smithi194 ceph-mon[65619]: pgmap v1973: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:26.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:26 smithi194 ceph-mon[65619]: from='client.36172 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:00:26.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:26 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2943103292' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:00:26.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:26 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1584032879' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:00:27.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:27 smithi026 ceph-mon[96795]: from='client.36176 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:00:27.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:27 smithi194 ceph-mon[65619]: from='client.36176 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:00:28.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:28 smithi026 ceph-mon[96795]: pgmap v1974: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:28.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:28 smithi194 ceph-mon[65619]: pgmap v1974: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:30.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:30 smithi026 ceph-mon[96795]: pgmap v1975: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:30.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:30 smithi194 ceph-mon[65619]: pgmap v1975: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:32.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:32 smithi026 ceph-mon[96795]: pgmap v1976: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:32.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:32 smithi194 ceph-mon[65619]: pgmap v1976: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:34.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:34 smithi026 ceph-mon[96795]: pgmap v1977: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:34.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:34 smithi194 ceph-mon[65619]: pgmap v1977: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:35.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:35 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:00:35.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:35 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:00:36.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:36 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:00:36.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:36 smithi026 ceph-mon[96795]: pgmap v1978: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:36.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:36 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:00:36.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:36 smithi194 ceph-mon[65619]: pgmap v1978: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:38.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:38 smithi026 ceph-mon[96795]: pgmap v1979: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:38.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:38 smithi194 ceph-mon[65619]: pgmap v1979: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:40.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:40 smithi026 ceph-mon[96795]: pgmap v1980: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:40.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:40 smithi194 ceph-mon[65619]: pgmap v1980: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:42.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:42 smithi194 ceph-mon[65619]: pgmap v1981: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:43.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:42 smithi026 ceph-mon[96795]: pgmap v1981: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:44.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:44 smithi194 ceph-mon[65619]: pgmap v1982: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:45.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:44 smithi026 ceph-mon[96795]: pgmap v1982: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:46.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:46 smithi194 ceph-mon[65619]: pgmap v1983: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:47.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:46 smithi026 ceph-mon[96795]: pgmap v1983: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:48.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:48 smithi194 ceph-mon[65619]: pgmap v1984: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:48.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:00:48.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:00:49.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:48 smithi026 ceph-mon[96795]: pgmap v1984: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:49.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:00:49.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:00:50.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:50 smithi194 ceph-mon[65619]: pgmap v1985: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:50.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:50 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:00:51.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:50 smithi026 ceph-mon[96795]: pgmap v1985: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:51.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:50 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:00:51.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:51 smithi194 ceph-mon[65619]: poll took 60062.640 ms: 1 events 2021-11-03T18:00:52.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:51 smithi026 ceph-mon[96795]: poll took 60062.640 ms: 1 events 2021-11-03T18:00:52.694 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:52 smithi194 ceph-mon[65619]: pgmap v1986: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:53.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:52 smithi026 ceph-mon[96795]: pgmap v1986: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:54.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:53 smithi026 ceph-mon[96795]: poll took 2541.793 ms: 1 events 2021-11-03T18:00:54.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:53 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:00:54.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:53 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:00:54.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:53 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:00:54.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:53 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:00:54.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:53 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:00:54.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:53 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:00:54.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:53 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:00:54.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:53 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:00:54.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:53 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:00:54.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:53 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:00:54.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:53 smithi026 ceph-mon[96795]: pgmap v1987: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:54.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:53 smithi194 ceph-mon[65619]: poll took 2541.793 ms: 1 events 2021-11-03T18:00:54.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:53 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:00:54.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:53 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:00:54.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:53 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:00:54.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:53 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:00:54.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:53 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:00:54.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:53 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:00:54.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:53 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:00:54.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:53 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:00:54.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:53 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:00:54.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:53 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:00:54.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:53 smithi194 ceph-mon[65619]: pgmap v1987: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:56.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.717+0000 7ff51bfff700 1 -- 172.21.15.26:0/4199964091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff51c0f6530 msgr2=0x7ff51c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:00:56.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.717+0000 7ff51bfff700 1 --2- 172.21.15.26:0/4199964091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff51c0f6530 0x7ff51c0f6950 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 rx=0x7ff5140099e0 tx=0x7ff514004d10).stop 2021-11-03T18:00:56.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.717+0000 7ff51bfff700 1 -- 172.21.15.26:0/4199964091 shutdown_connections 2021-11-03T18:00:56.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.717+0000 7ff51bfff700 1 --2- 172.21.15.26:0/4199964091 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff51c0f77d0 0x7ff51c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:56.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.717+0000 7ff51bfff700 1 --2- 172.21.15.26:0/4199964091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff51c0f6530 0x7ff51c0f6950 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:56.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.717+0000 7ff51bfff700 1 -- 172.21.15.26:0/4199964091 >> 172.21.15.26:0/4199964091 conn(0x7ff51c0f1cd0 msgr2=0x7ff51c0f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:00:56.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.717+0000 7ff51bfff700 1 -- 172.21.15.26:0/4199964091 shutdown_connections 2021-11-03T18:00:56.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.717+0000 7ff51bfff700 1 -- 172.21.15.26:0/4199964091 wait complete. 2021-11-03T18:00:56.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.717+0000 7ff51bfff700 1 Processor -- start 2021-11-03T18:00:56.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.718+0000 7ff51bfff700 1 -- start start 2021-11-03T18:00:56.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.718+0000 7ff51bfff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff51c0f6530 0x7ff51c106e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:00:56.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.718+0000 7ff51bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff51c0f77d0 0x7ff51c107360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:00:56.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.718+0000 7ff51bfff700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c107910 con 0x7ff51c0f77d0 2021-11-03T18:00:56.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.718+0000 7ff51bfff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c107a50 con 0x7ff51c0f6530 2021-11-03T18:00:56.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.718+0000 7ff51a7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff51c0f77d0 0x7ff51c107360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:00:56.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.718+0000 7ff51a7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff51c0f77d0 0x7ff51c107360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57640/0 (socket says 172.21.15.26:57640) 2021-11-03T18:00:56.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.718+0000 7ff51a7fc700 1 -- 172.21.15.26:0/2600995020 learned_addr learned my addr 172.21.15.26:0/2600995020 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:00:56.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.718+0000 7ff51affd700 1 --2- 172.21.15.26:0/2600995020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff51c0f6530 0x7ff51c106e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:00:56.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.718+0000 7ff51a7fc700 1 -- 172.21.15.26:0/2600995020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff51c0f6530 msgr2=0x7ff51c106e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:00:56.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.718+0000 7ff51a7fc700 1 --2- 172.21.15.26:0/2600995020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff51c0f6530 0x7ff51c106e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:56.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.718+0000 7ff51a7fc700 1 -- 172.21.15.26:0/2600995020 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff514009640 con 0x7ff51c0f77d0 2021-11-03T18:00:56.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.718+0000 7ff51a7fc700 1 --2- 172.21.15.26:0/2600995020 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff51c0f77d0 0x7ff51c107360 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 rx=0x7ff5100026d0 tx=0x7ff510009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:00:56.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.718+0000 7ff5037fe700 1 -- 172.21.15.26:0/2600995020 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5100079c0 con 0x7ff51c0f77d0 2021-11-03T18:00:56.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.719+0000 7ff51bfff700 1 -- 172.21.15.26:0/2600995020 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff51c1083f0 con 0x7ff51c0f77d0 2021-11-03T18:00:56.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.719+0000 7ff5037fe700 1 -- 172.21.15.26:0/2600995020 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff51000f040 con 0x7ff51c0f77d0 2021-11-03T18:00:56.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.719+0000 7ff5037fe700 1 -- 172.21.15.26:0/2600995020 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5100148b0 con 0x7ff51c0f77d0 2021-11-03T18:00:56.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.719+0000 7ff51bfff700 1 -- 172.21.15.26:0/2600995020 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff51c108930 con 0x7ff51c0f77d0 2021-11-03T18:00:56.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.720+0000 7ff51bfff700 1 -- 172.21.15.26:0/2600995020 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff51c045ad0 con 0x7ff51c0f77d0 2021-11-03T18:00:56.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.720+0000 7ff5037fe700 1 -- 172.21.15.26:0/2600995020 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ff510007b20 con 0x7ff51c0f77d0 2021-11-03T18:00:56.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.721+0000 7ff5037fe700 1 --2- 172.21.15.26:0/2600995020 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff504064100 0x7ff5040665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:00:56.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.721+0000 7ff5037fe700 1 -- 172.21.15.26:0/2600995020 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ff510080730 con 0x7ff51c0f77d0 2021-11-03T18:00:56.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.721+0000 7ff51affd700 1 --2- 172.21.15.26:0/2600995020 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff504064100 0x7ff5040665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:00:56.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.721+0000 7ff51affd700 1 --2- 172.21.15.26:0/2600995020 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff504064100 0x7ff5040665c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7ff51400b730 tx=0x7ff514004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:00:56.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.725+0000 7ff5037fe700 1 -- 172.21.15.26:0/2600995020 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ff510052a90 con 0x7ff51c0f77d0 2021-11-03T18:00:56.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.903+0000 7ff51bfff700 1 -- 172.21.15.26:0/2600995020 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff51c108bb0 con 0x7ff504064100 2021-11-03T18:00:56.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.904+0000 7ff5037fe700 1 -- 172.21.15.26:0/2600995020 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7ff51c108bb0 con 0x7ff504064100 2021-11-03T18:00:56.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.906+0000 7ff51bfff700 1 -- 172.21.15.26:0/2600995020 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff504064100 msgr2=0x7ff5040665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:00:56.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.906+0000 7ff51bfff700 1 --2- 172.21.15.26:0/2600995020 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff504064100 0x7ff5040665c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7ff51400b730 tx=0x7ff514004d10).stop 2021-11-03T18:00:56.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.906+0000 7ff51bfff700 1 -- 172.21.15.26:0/2600995020 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff51c0f77d0 msgr2=0x7ff51c107360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:00:56.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.906+0000 7ff51bfff700 1 --2- 172.21.15.26:0/2600995020 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff51c0f77d0 0x7ff51c107360 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 rx=0x7ff5100026d0 tx=0x7ff510009de0).stop 2021-11-03T18:00:56.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.907+0000 7ff51bfff700 1 -- 172.21.15.26:0/2600995020 shutdown_connections 2021-11-03T18:00:56.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.907+0000 7ff51bfff700 1 --2- 172.21.15.26:0/2600995020 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff504064100 0x7ff5040665c0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:56.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.907+0000 7ff51bfff700 1 --2- 172.21.15.26:0/2600995020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff51c0f6530 0x7ff51c106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:56.906 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.907+0000 7ff51bfff700 1 --2- 172.21.15.26:0/2600995020 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff51c0f77d0 0x7ff51c107360 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:56.906 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.907+0000 7ff51bfff700 1 -- 172.21.15.26:0/2600995020 >> 172.21.15.26:0/2600995020 conn(0x7ff51c0f1cd0 msgr2=0x7ff51c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:00:56.906 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.907+0000 7ff51bfff700 1 -- 172.21.15.26:0/2600995020 shutdown_connections 2021-11-03T18:00:56.906 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:56.907+0000 7ff51bfff700 1 -- 172.21.15.26:0/2600995020 wait complete. 2021-11-03T18:00:56.914 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:00:56.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:56 smithi026 ceph-mon[96795]: pgmap v1988: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:56.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:56 smithi194 ceph-mon[65619]: pgmap v1988: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:57.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.008+0000 7fac35916700 1 -- 172.21.15.26:0/1391186767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac3006a3b0 msgr2=0x7fac3006a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:00:57.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.008+0000 7fac35916700 1 --2- 172.21.15.26:0/1391186767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac3006a3b0 0x7fac3006a830 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 rx=0x7fac20004660 tx=0x7fac20009b30).stop 2021-11-03T18:00:57.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.008+0000 7fac35916700 1 -- 172.21.15.26:0/1391186767 shutdown_connections 2021-11-03T18:00:57.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.008+0000 7fac35916700 1 --2- 172.21.15.26:0/1391186767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac3006a3b0 0x7fac3006a830 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:57.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.008+0000 7fac35916700 1 --2- 172.21.15.26:0/1391186767 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac3006b9c0 0x7fac30069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:00:57.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.008+0000 7fac35916700 1 -- 172.21.15.26:0/1391186767 >> 172.21.15.26:0/1391186767 conn(0x7fac300f1cd0 msgr2=0x7fac300f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:00:57.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.008+0000 7fac35916700 1 -- 172.21.15.26:0/1391186767 shutdown_connections 2021-11-03T18:00:57.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.008+0000 7fac35916700 1 -- 172.21.15.26:0/1391186767 wait complete. 2021-11-03T18:00:57.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.009+0000 7fac35916700 1 Processor -- start 2021-11-03T18:00:57.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.009+0000 7fac35916700 1 -- start start 2021-11-03T18:00:57.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.009+0000 7fac35916700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac3006a3b0 0x7fac30108f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:00:57.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.009+0000 7fac35916700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac3006b9c0 0x7fac30109440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:00:57.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.009+0000 7fac35916700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac30109a80 con 0x7fac3006a3b0 2021-11-03T18:00:57.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.009+0000 7fac35916700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3010a330 con 0x7fac3006b9c0 2021-11-03T18:00:57.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.009+0000 7fac34914700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac3006a3b0 0x7fac30108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:00:57.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.009+0000 7fac34914700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac3006a3b0 0x7fac30108f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57648/0 (socket says 172.21.15.26:57648) 2021-11-03T18:00:57.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.009+0000 7fac34914700 1 -- 172.21.15.26:0/3771944221 learned_addr learned my addr 172.21.15.26:0/3771944221 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:00:57.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.010+0000 7fac34914700 1 -- 172.21.15.26:0/3771944221 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac3006b9c0 msgr2=0x7fac30109440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:00:57.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.010+0000 7fac34914700 1 --2- 172.21.15.26:0/3771944221 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac3006b9c0 0x7fac30109440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:00:57.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.010+0000 7fac34914700 1 -- 172.21.15.26:0/3771944221 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac20005040 con 0x7fac3006a3b0 2021-11-03T18:00:57.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.010+0000 7fac34914700 1 --2- 172.21.15.26:0/3771944221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac3006a3b0 0x7fac30108f50 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 rx=0x7fac2c00b790 tx=0x7fac2c0092d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:00:57.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.010+0000 7fac257fa700 1 -- 172.21.15.26:0/3771944221 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac2c00d780 con 0x7fac3006a3b0 2021-11-03T18:00:57.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.010+0000 7fac257fa700 1 -- 172.21.15.26:0/3771944221 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fac2c00dd90 con 0x7fac3006a3b0 2021-11-03T18:00:57.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.010+0000 7fac257fa700 1 -- 172.21.15.26:0/3771944221 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac2c00e360 con 0x7fac3006a3b0 2021-11-03T18:00:57.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.010+0000 7fac35916700 1 -- 172.21.15.26:0/3771944221 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac3010a610 con 0x7fac3006a3b0 2021-11-03T18:00:57.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.010+0000 7fac35916700 1 -- 172.21.15.26:0/3771944221 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac3010ab80 con 0x7fac3006a3b0 2021-11-03T18:00:57.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.011+0000 7fac35916700 1 -- 172.21.15.26:0/3771944221 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac30059100 con 0x7fac3006a3b0 2021-11-03T18:00:57.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.011+0000 7fac257fa700 1 -- 172.21.15.26:0/3771944221 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fac2c00d8e0 con 0x7fac3006a3b0 2021-11-03T18:00:57.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.012+0000 7fac257fa700 1 --2- 172.21.15.26:0/3771944221 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fac18064100 0x7fac180665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:00:57.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.012+0000 7fac257fa700 1 -- 172.21.15.26:0/3771944221 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fac2c0812f0 con 0x7fac3006a3b0 2021-11-03T18:00:57.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.012+0000 7fac27fff700 1 --2- 172.21.15.26:0/3771944221 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fac18064100 0x7fac180665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:00:57.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.012+0000 7fac27fff700 1 --2- 172.21.15.26:0/3771944221 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fac18064100 0x7fac180665c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7fac20004e30 tx=0x7fac20009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:00:57.018 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.016+0000 7fac257fa700 1 -- 172.21.15.26:0/3771944221 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fac2c053560 con 0x7fac3006a3b0 2021-11-03T18:00:57.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.189+0000 7fac35916700 1 -- 172.21.15.26:0/3771944221 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fac30101090 con 0x7fac18064100 2021-11-03T18:00:57.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.204+0000 7fac257fa700 1 -- 172.21.15.26:0/3771944221 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fac30101090 con 0x7fac18064100 2021-11-03T18:00:57.202 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:00:57.202 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (72m) 67s ago 73m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:00:57.202 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (64m) 67s ago 73m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:00:57.203 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (64m) 4s ago 72m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:00:57.203 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (72m) 67s ago 73m 41.7M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:00:57.203 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (65m) 67s ago 68m 25.6M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:00:57.203 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (65m) 67s ago 68m 26.2M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:00:57.204 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (68m) 4s ago 68m 26.4M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:00:57.204 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (68m) 4s ago 68m 26.8M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:00:57.204 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (65m) 67s ago 74m 561M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:00:57.204 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (65m) 4s ago 72m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:00:57.204 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (65m) 67s ago 74m 276M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:00:57.205 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (64m) 4s ago 72m 132M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:00:57.205 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (73m) 67s ago 73m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:00:57.205 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (72m) 4s ago 72m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:00:57.205 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (64m) 67s ago 71m 292M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:00:57.206 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (63m) 67s ago 71m 313M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:00:57.206 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (62m) 67s ago 71m 261M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:00:57.206 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (62m) 4s ago 70m 337M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:00:57.206 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (62m) 4s ago 70m 283M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:00:57.207 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (61m) 4s ago 70m 276M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:00:57.207 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (71m) 67s ago 72m 61.2M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:00:57.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.206+0000 7fac35916700 1 -- 172.21.15.26:0/3771944221 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fac18064100 msgr2=0x7fac180665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:00:57.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.206+0000 7fac35916700 1 --2- 172.21.15.26:0/3771944221 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fac18064100 0x7fac180665c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7fac20004e30 tx=0x7fac20009b30).stop 2021-11-03T18:00:57.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.206+0000 7fac35916700 1 -- 172.21.15.26:0/3771944221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac3006a3b0 msgr2=0x7fac30108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:00:57.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.206+0000 7fac35916700 1 --2- 172.21.15.26:0/3771944221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac3006a3b0 0x7fac30108f50 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 rx=0x7fac2c00b790 tx=0x7fac2c0092d0).stop 2021-11-03T18:00:57.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.206+0000 7fac35916700 1 -- 172.21.15.26:0/3771944221 shutdown_connections 2021-11-03T18:00:57.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.206+0000 7fac35916700 1 --2- 172.21.15.26:0/3771944221 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fac18064100 0x7fac180665c0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:57.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.206+0000 7fac35916700 1 --2- 172.21.15.26:0/3771944221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac3006a3b0 0x7fac30108f50 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:57.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.206+0000 7fac35916700 1 --2- 172.21.15.26:0/3771944221 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac3006b9c0 0x7fac30109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:00:57.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.206+0000 7fac35916700 1 -- 172.21.15.26:0/3771944221 >> 172.21.15.26:0/3771944221 conn(0x7fac300f1cd0 msgr2=0x7fac300fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:00:57.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.206+0000 7fac35916700 1 -- 172.21.15.26:0/3771944221 shutdown_connections 2021-11-03T18:00:57.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.206+0000 7fac35916700 1 -- 172.21.15.26:0/3771944221 wait complete. 2021-11-03T18:00:57.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.305+0000 7fa22f49d700 1 -- 172.21.15.26:0/2395177121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa22806a3b0 msgr2=0x7fa22806a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:00:57.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.305+0000 7fa22f49d700 1 --2- 172.21.15.26:0/2395177121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa22806a3b0 0x7fa22806a830 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7fa218004660 tx=0x7fa218009b30).stop 2021-11-03T18:00:57.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.306+0000 7fa22f49d700 1 -- 172.21.15.26:0/2395177121 shutdown_connections 2021-11-03T18:00:57.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.306+0000 7fa22f49d700 1 --2- 172.21.15.26:0/2395177121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa22806a3b0 0x7fa22806a830 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:57.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.306+0000 7fa22f49d700 1 --2- 172.21.15.26:0/2395177121 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa22806b9c0 0x7fa228069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:57.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.306+0000 7fa22f49d700 1 -- 172.21.15.26:0/2395177121 >> 172.21.15.26:0/2395177121 conn(0x7fa2280f1cd0 msgr2=0x7fa2280f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:00:57.307 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.306+0000 7fa22f49d700 1 -- 172.21.15.26:0/2395177121 shutdown_connections 2021-11-03T18:00:57.307 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.306+0000 7fa22f49d700 1 -- 172.21.15.26:0/2395177121 wait complete. 2021-11-03T18:00:57.307 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.306+0000 7fa22f49d700 1 Processor -- start 2021-11-03T18:00:57.307 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.306+0000 7fa22f49d700 1 -- start start 2021-11-03T18:00:57.308 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.306+0000 7fa22f49d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa22806a3b0 0x7fa22810d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:00:57.308 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.306+0000 7fa22f49d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa22806b9c0 0x7fa22810d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:00:57.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.306+0000 7fa22f49d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22810dda0 con 0x7fa22806b9c0 2021-11-03T18:00:57.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.306+0000 7fa22f49d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22810dee0 con 0x7fa22806a3b0 2021-11-03T18:00:57.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.306+0000 7fa22dc9a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa22806b9c0 0x7fa22810d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:00:57.310 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.306+0000 7fa22dc9a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa22806b9c0 0x7fa22810d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57660/0 (socket says 172.21.15.26:57660) 2021-11-03T18:00:57.310 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.306+0000 7fa22dc9a700 1 -- 172.21.15.26:0/1441819538 learned_addr learned my addr 172.21.15.26:0/1441819538 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:00:57.310 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.307+0000 7fa22e49b700 1 --2- 172.21.15.26:0/1441819538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa22806a3b0 0x7fa22810d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:00:57.310 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.307+0000 7fa22dc9a700 1 -- 172.21.15.26:0/1441819538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa22806a3b0 msgr2=0x7fa22810d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:00:57.310 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.307+0000 7fa22dc9a700 1 --2- 172.21.15.26:0/1441819538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa22806a3b0 0x7fa22810d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:57.311 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.307+0000 7fa22dc9a700 1 -- 172.21.15.26:0/1441819538 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa218005040 con 0x7fa22806b9c0 2021-11-03T18:00:57.311 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.307+0000 7fa22dc9a700 1 --2- 172.21.15.26:0/1441819538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa22806b9c0 0x7fa22810d7f0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7fa218009990 tx=0x7fa218009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:00:57.311 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.307+0000 7fa21effd700 1 -- 172.21.15.26:0/1441819538 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa218018070 con 0x7fa22806b9c0 2021-11-03T18:00:57.311 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.307+0000 7fa21effd700 1 -- 172.21.15.26:0/1441819538 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa218007ba0 con 0x7fa22806b9c0 2021-11-03T18:00:57.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.307+0000 7fa22f49d700 1 -- 172.21.15.26:0/1441819538 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa22810e820 con 0x7fa22806b9c0 2021-11-03T18:00:57.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.307+0000 7fa21effd700 1 -- 172.21.15.26:0/1441819538 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa21801c3c0 con 0x7fa22806b9c0 2021-11-03T18:00:57.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.307+0000 7fa22f49d700 1 -- 172.21.15.26:0/1441819538 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa22810ed80 con 0x7fa22806b9c0 2021-11-03T18:00:57.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.308+0000 7fa22f49d700 1 -- 172.21.15.26:0/1441819538 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa228045ad0 con 0x7fa22806b9c0 2021-11-03T18:00:57.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.308+0000 7fa21effd700 1 -- 172.21.15.26:0/1441819538 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fa21801d420 con 0x7fa22806b9c0 2021-11-03T18:00:57.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.309+0000 7fa21effd700 1 --2- 172.21.15.26:0/1441819538 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa214064100 0x7fa2140665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:00:57.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.309+0000 7fa21effd700 1 -- 172.21.15.26:0/1441819538 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fa218082430 con 0x7fa22806b9c0 2021-11-03T18:00:57.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.309+0000 7fa22e49b700 1 --2- 172.21.15.26:0/1441819538 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa214064100 0x7fa2140665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:00:57.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.309+0000 7fa22e49b700 1 --2- 172.21.15.26:0/1441819538 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa214064100 0x7fa2140665c0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7fa2240096c0 tx=0x7fa224009be0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:00:57.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.313+0000 7fa21effd700 1 -- 172.21.15.26:0/1441819538 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fa2180547f0 con 0x7fa22806b9c0 2021-11-03T18:00:57.539 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.542+0000 7fa22f49d700 1 -- 172.21.15.26:0/1441819538 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa228027a00 con 0x7fa22806b9c0 2021-11-03T18:00:57.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.542+0000 7fa21effd700 1 -- 172.21.15.26:0/1441819538 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fa2180543e0 con 0x7fa22806b9c0 2021-11-03T18:00:57.540 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:00:57.540 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:00:57.541 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:00:57.541 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:00:57.541 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:00:57.541 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:00:57.542 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:00:57.542 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:00:57.542 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:00:57.543 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:00:57.543 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:00:57.543 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:00:57.543 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:00:57.544 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:00:57.544 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:00:57.544 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:00:57.544 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:00:57.544 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:00:57.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.544+0000 7fa22f49d700 1 -- 172.21.15.26:0/1441819538 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa214064100 msgr2=0x7fa2140665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:00:57.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.544+0000 7fa22f49d700 1 --2- 172.21.15.26:0/1441819538 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa214064100 0x7fa2140665c0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7fa2240096c0 tx=0x7fa224009be0).stop 2021-11-03T18:00:57.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.544+0000 7fa22f49d700 1 -- 172.21.15.26:0/1441819538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa22806b9c0 msgr2=0x7fa22810d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:00:57.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.544+0000 7fa22f49d700 1 --2- 172.21.15.26:0/1441819538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa22806b9c0 0x7fa22810d7f0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7fa218009990 tx=0x7fa218009b30).stop 2021-11-03T18:00:57.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.544+0000 7fa22f49d700 1 -- 172.21.15.26:0/1441819538 shutdown_connections 2021-11-03T18:00:57.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.544+0000 7fa22f49d700 1 --2- 172.21.15.26:0/1441819538 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa214064100 0x7fa2140665c0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:57.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.544+0000 7fa22f49d700 1 --2- 172.21.15.26:0/1441819538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa22806a3b0 0x7fa22810d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:57.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.544+0000 7fa22f49d700 1 --2- 172.21.15.26:0/1441819538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa22806b9c0 0x7fa22810d7f0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:57.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.544+0000 7fa22f49d700 1 -- 172.21.15.26:0/1441819538 >> 172.21.15.26:0/1441819538 conn(0x7fa2280f1cd0 msgr2=0x7fa2280f8710 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:00:57.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.544+0000 7fa22f49d700 1 -- 172.21.15.26:0/1441819538 shutdown_connections 2021-11-03T18:00:57.548 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.544+0000 7fa22f49d700 1 -- 172.21.15.26:0/1441819538 wait complete. 2021-11-03T18:00:57.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.645+0000 7f119d4e6700 1 -- 172.21.15.26:0/2332968719 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11980f66e0 msgr2=0x7f11980f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:00:57.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.645+0000 7f119d4e6700 1 --2- 172.21.15.26:0/2332968719 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11980f66e0 0x7f11980f6b00 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 rx=0x7f11900099e0 tx=0x7f1190004d10).stop 2021-11-03T18:00:57.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.645+0000 7f119d4e6700 1 -- 172.21.15.26:0/2332968719 shutdown_connections 2021-11-03T18:00:57.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.645+0000 7f119d4e6700 1 --2- 172.21.15.26:0/2332968719 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11980f7980 0x7f11980f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:57.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.645+0000 7f119d4e6700 1 --2- 172.21.15.26:0/2332968719 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11980f66e0 0x7f11980f6b00 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:57.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.645+0000 7f119d4e6700 1 -- 172.21.15.26:0/2332968719 >> 172.21.15.26:0/2332968719 conn(0x7f11980f1e40 msgr2=0x7f11980f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:00:57.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.645+0000 7f119d4e6700 1 -- 172.21.15.26:0/2332968719 shutdown_connections 2021-11-03T18:00:57.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.645+0000 7f119d4e6700 1 -- 172.21.15.26:0/2332968719 wait complete. 2021-11-03T18:00:57.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.645+0000 7f119d4e6700 1 Processor -- start 2021-11-03T18:00:57.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.645+0000 7f119d4e6700 1 -- start start 2021-11-03T18:00:57.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.645+0000 7f119d4e6700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11980f66e0 0x7f119806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:00:57.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.645+0000 7f119d4e6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11980f7980 0x7f1198069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:00:57.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.645+0000 7f119d4e6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119806a380 con 0x7f11980f7980 2021-11-03T18:00:57.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.646+0000 7f119d4e6700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119806a4c0 con 0x7f11980f66e0 2021-11-03T18:00:57.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.646+0000 7f11967fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11980f7980 0x7f1198069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:00:57.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.646+0000 7f11967fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11980f7980 0x7f1198069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57670/0 (socket says 172.21.15.26:57670) 2021-11-03T18:00:57.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.646+0000 7f11967fc700 1 -- 172.21.15.26:0/74895031 learned_addr learned my addr 172.21.15.26:0/74895031 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:00:57.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.646+0000 7f1196ffd700 1 --2- 172.21.15.26:0/74895031 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11980f66e0 0x7f119806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:00:57.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.646+0000 7f11967fc700 1 -- 172.21.15.26:0/74895031 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11980f66e0 msgr2=0x7f119806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:00:57.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.646+0000 7f11967fc700 1 --2- 172.21.15.26:0/74895031 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11980f66e0 0x7f119806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:57.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.646+0000 7f11967fc700 1 -- 172.21.15.26:0/74895031 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1190009640 con 0x7f11980f7980 2021-11-03T18:00:57.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.646+0000 7f1196ffd700 1 --2- 172.21.15.26:0/74895031 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11980f66e0 0x7f119806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:00:57.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.646+0000 7f11967fc700 1 --2- 172.21.15.26:0/74895031 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11980f7980 0x7f1198069e20 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7f118c0026d0 tx=0x7f118c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:00:57.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.646+0000 7f117f7fe700 1 -- 172.21.15.26:0/74895031 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f118c009320 con 0x7f11980f7980 2021-11-03T18:00:57.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.646+0000 7f117f7fe700 1 -- 172.21.15.26:0/74895031 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f118c00f040 con 0x7f11980f7980 2021-11-03T18:00:57.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.646+0000 7f119d4e6700 1 -- 172.21.15.26:0/74895031 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f119806a7a0 con 0x7f11980f7980 2021-11-03T18:00:57.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.646+0000 7f117f7fe700 1 -- 172.21.15.26:0/74895031 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f118c0147e0 con 0x7f11980f7980 2021-11-03T18:00:57.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.646+0000 7f119d4e6700 1 -- 172.21.15.26:0/74895031 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f119810f100 con 0x7f11980f7980 2021-11-03T18:00:57.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.647+0000 7f119d4e6700 1 -- 172.21.15.26:0/74895031 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1198045ad0 con 0x7f11980f7980 2021-11-03T18:00:57.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.648+0000 7f117f7fe700 1 -- 172.21.15.26:0/74895031 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f118c009480 con 0x7f11980f7980 2021-11-03T18:00:57.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.648+0000 7f117f7fe700 1 --2- 172.21.15.26:0/74895031 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1180064090 0x7f1180066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:00:57.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.648+0000 7f117f7fe700 1 -- 172.21.15.26:0/74895031 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f118c080df0 con 0x7f11980f7980 2021-11-03T18:00:57.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.648+0000 7f1196ffd700 1 --2- 172.21.15.26:0/74895031 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1180064090 0x7f1180066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:00:57.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.649+0000 7f1196ffd700 1 --2- 172.21.15.26:0/74895031 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1180064090 0x7f1180066550 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f1190000f80 tx=0x7f1190004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:00:57.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.652+0000 7f117f7fe700 1 -- 172.21.15.26:0/74895031 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f118c053210 con 0x7f11980f7980 2021-11-03T18:00:57.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.856+0000 7f119d4e6700 1 -- 172.21.15.26:0/74895031 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1198027a00 con 0x7f11980f7980 2021-11-03T18:00:57.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.856+0000 7f117f7fe700 1 -- 172.21.15.26:0/74895031 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f118c052e00 con 0x7f11980f7980 2021-11-03T18:00:57.855 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:00:57.855 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:00:57.855 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:00:57.856 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:00:57.856 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:00:57.856 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:00:57.856 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:00:57.857 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:00:57.857 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:00:57.857 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:00:57.857 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:00:57.857 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:00:57.858 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:00:57.858 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:00:57.858 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:00:57.858 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:00:57.859 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:00:57.859 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:00:57.859 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:00:57.859 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:00:57.859 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:00:57.860 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:00:57.860 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:00:57.860 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:00:57.860 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:00:57.861 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:00:57.861 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:00:57.861 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:00:57.861 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:00:57.862 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:00:57.862 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:00:57.862 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:00:57.862 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:00:57.862 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:00:57.863 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:00:57.863 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:00:57.863 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:00:57.864 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:00:57.864 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:00:57.865 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.858+0000 7f119d4e6700 1 -- 172.21.15.26:0/74895031 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1180064090 msgr2=0x7f1180066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:00:57.865 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.858+0000 7f119d4e6700 1 --2- 172.21.15.26:0/74895031 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1180064090 0x7f1180066550 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f1190000f80 tx=0x7f1190004d10).stop 2021-11-03T18:00:57.865 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.858+0000 7f119d4e6700 1 -- 172.21.15.26:0/74895031 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11980f7980 msgr2=0x7f1198069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:00:57.866 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.858+0000 7f119d4e6700 1 --2- 172.21.15.26:0/74895031 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11980f7980 0x7f1198069e20 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7f118c0026d0 tx=0x7f118c009de0).stop 2021-11-03T18:00:57.866 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.858+0000 7f119d4e6700 1 -- 172.21.15.26:0/74895031 shutdown_connections 2021-11-03T18:00:57.866 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.858+0000 7f119d4e6700 1 --2- 172.21.15.26:0/74895031 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1180064090 0x7f1180066550 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:57.866 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.858+0000 7f119d4e6700 1 --2- 172.21.15.26:0/74895031 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11980f66e0 0x7f119806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:57.866 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.858+0000 7f119d4e6700 1 --2- 172.21.15.26:0/74895031 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11980f7980 0x7f1198069e20 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:00:57.867 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.858+0000 7f119d4e6700 1 -- 172.21.15.26:0/74895031 >> 172.21.15.26:0/74895031 conn(0x7f11980f1e40 msgr2=0x7f11980fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:00:57.867 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.858+0000 7f119d4e6700 1 -- 172.21.15.26:0/74895031 shutdown_connections 2021-11-03T18:00:57.867 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:00:57.858+0000 7f119d4e6700 1 -- 172.21.15.26:0/74895031 wait complete. 2021-11-03T18:00:57.867 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:00:57.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:57 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1441819538' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:00:57.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:57 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1441819538' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:00:58.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:58 smithi026 ceph-mon[96795]: from='client.36188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:00:58.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:58 smithi026 ceph-mon[96795]: from='client.36192 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:00:58.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:58 smithi026 ceph-mon[96795]: pgmap v1989: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:58.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:00:58 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/74895031' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:00:58.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:58 smithi194 ceph-mon[65619]: from='client.36188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:00:58.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:58 smithi194 ceph-mon[65619]: from='client.36192 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:00:58.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:58 smithi194 ceph-mon[65619]: pgmap v1989: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:00:58.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:00:58 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/74895031' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:01:00.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:00 smithi026 ceph-mon[96795]: pgmap v1990: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:00.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:00 smithi194 ceph-mon[65619]: pgmap v1990: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:02.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:02 smithi026 ceph-mon[96795]: pgmap v1991: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:02.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:02 smithi194 ceph-mon[65619]: pgmap v1991: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:04.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:04 smithi026 ceph-mon[96795]: pgmap v1992: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:04.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:04 smithi194 ceph-mon[65619]: pgmap v1992: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:06.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:06 smithi026 ceph-mon[96795]: pgmap v1993: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:06.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:06 smithi194 ceph-mon[65619]: pgmap v1993: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:08.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:08 smithi026 ceph-mon[96795]: pgmap v1994: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:08.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:08 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:01:08.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:08 smithi194 ceph-mon[65619]: pgmap v1994: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:09.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:08 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:01:09.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:09 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:01:09.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:09 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:01:10.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:10 smithi026 ceph-mon[96795]: pgmap v1995: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:10.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:10 smithi194 ceph-mon[65619]: pgmap v1995: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:12.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:12 smithi026 ceph-mon[96795]: pgmap v1996: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:12.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:12 smithi194 ceph-mon[65619]: pgmap v1996: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:14.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:14 smithi026 ceph-mon[96795]: pgmap v1997: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:14.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:14 smithi194 ceph-mon[65619]: pgmap v1997: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:16.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:16 smithi026 ceph-mon[96795]: pgmap v1998: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:16.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:16 smithi194 ceph-mon[65619]: pgmap v1998: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:18.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:18 smithi026 ceph-mon[96795]: pgmap v1999: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:18.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:18 smithi194 ceph-mon[65619]: pgmap v1999: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:20.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:20 smithi026 ceph-mon[96795]: pgmap v2000: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:20.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:20 smithi194 ceph-mon[65619]: pgmap v2000: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:22.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:22 smithi026 ceph-mon[96795]: pgmap v2001: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:22.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:22 smithi194 ceph-mon[65619]: pgmap v2001: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:23.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:23 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:01:23.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:23 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:01:24.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:24 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:01:24.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:24 smithi026 ceph-mon[96795]: pgmap v2002: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:24.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:24 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:01:24.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:24 smithi194 ceph-mon[65619]: pgmap v2002: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:26.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:26 smithi026 ceph-mon[96795]: pgmap v2003: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:26.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:26 smithi194 ceph-mon[65619]: pgmap v2003: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:27.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:27.975+0000 7f98aed99700 1 -- 172.21.15.26:0/1706865320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98a80f66e0 msgr2=0x7f98a80f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:01:27.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:27.975+0000 7f98aed99700 1 --2- 172.21.15.26:0/1706865320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98a80f66e0 0x7f98a80f6b40 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 rx=0x7f9898004660 tx=0x7f9898009b30).stop 2021-11-03T18:01:27.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:27.975+0000 7f98aed99700 1 -- 172.21.15.26:0/1706865320 shutdown_connections 2021-11-03T18:01:27.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:27.975+0000 7f98aed99700 1 --2- 172.21.15.26:0/1706865320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98a80f66e0 0x7f98a80f6b40 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:01:27.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:27.975+0000 7f98aed99700 1 --2- 172.21.15.26:0/1706865320 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98a80f5440 0x7f98a80f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:01:27.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:27.975+0000 7f98aed99700 1 -- 172.21.15.26:0/1706865320 >> 172.21.15.26:0/1706865320 conn(0x7f98a80f0ba0 msgr2=0x7f98a80f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:01:27.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:27.975+0000 7f98aed99700 1 -- 172.21.15.26:0/1706865320 shutdown_connections 2021-11-03T18:01:27.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:27.975+0000 7f98aed99700 1 -- 172.21.15.26:0/1706865320 wait complete. 2021-11-03T18:01:27.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:27.975+0000 7f98aed99700 1 Processor -- start 2021-11-03T18:01:27.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:27.975+0000 7f98aed99700 1 -- start start 2021-11-03T18:01:27.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:27.976+0000 7f98aed99700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98a80f5440 0x7f98a8109ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:01:27.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:27.976+0000 7f98aed99700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98a80f66e0 0x7f98a810bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:01:27.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:27.976+0000 7f98aed99700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a80603c0 con 0x7f98a80f5440 2021-11-03T18:01:27.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:27.976+0000 7f98aed99700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a8060500 con 0x7f98a80f66e0 2021-11-03T18:01:27.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:27.976+0000 7f98add97700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98a80f5440 0x7f98a8109ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:01:27.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:27.976+0000 7f98add97700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98a80f5440 0x7f98a8109ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57686/0 (socket says 172.21.15.26:57686) 2021-11-03T18:01:27.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:27.976+0000 7f98add97700 1 -- 172.21.15.26:0/1183087070 learned_addr learned my addr 172.21.15.26:0/1183087070 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:01:27.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:27.976+0000 7f98ad596700 1 --2- 172.21.15.26:0/1183087070 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98a80f66e0 0x7f98a810bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:01:27.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:27.976+0000 7f98add97700 1 -- 172.21.15.26:0/1183087070 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98a80f66e0 msgr2=0x7f98a810bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:01:27.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:27.976+0000 7f98add97700 1 --2- 172.21.15.26:0/1183087070 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98a80f66e0 0x7f98a810bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:01:27.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:27.976+0000 7f98add97700 1 -- 172.21.15.26:0/1183087070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9898005040 con 0x7f98a80f5440 2021-11-03T18:01:27.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:27.976+0000 7f98ad596700 1 --2- 172.21.15.26:0/1183087070 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98a80f66e0 0x7f98a810bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:01:27.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:27.976+0000 7f98add97700 1 --2- 172.21.15.26:0/1183087070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98a80f5440 0x7f98a8109ab0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7f98a400c530 tx=0x7f98a4007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:01:27.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:27.976+0000 7f989e7fc700 1 -- 172.21.15.26:0/1183087070 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98a400f650 con 0x7f98a80f5440 2021-11-03T18:01:27.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:27.976+0000 7f989e7fc700 1 -- 172.21.15.26:0/1183087070 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f98a400fc60 con 0x7f98a80f5440 2021-11-03T18:01:27.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:27.976+0000 7f98aed99700 1 -- 172.21.15.26:0/1183087070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a810c560 con 0x7f98a80f5440 2021-11-03T18:01:27.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:27.976+0000 7f989e7fc700 1 -- 172.21.15.26:0/1183087070 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98a4012d20 con 0x7f98a80f5440 2021-11-03T18:01:27.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:27.977+0000 7f98aed99700 1 -- 172.21.15.26:0/1183087070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a810caf0 con 0x7f98a80f5440 2021-11-03T18:01:27.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:27.977+0000 7f98aed99700 1 -- 172.21.15.26:0/1183087070 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98a8045ad0 con 0x7f98a80f5440 2021-11-03T18:01:27.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:27.978+0000 7f989e7fc700 1 -- 172.21.15.26:0/1183087070 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f98a4019030 con 0x7f98a80f5440 2021-11-03T18:01:27.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:27.978+0000 7f989e7fc700 1 --2- 172.21.15.26:0/1183087070 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9894064100 0x7f98940665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:01:27.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:27.978+0000 7f989e7fc700 1 -- 172.21.15.26:0/1183087070 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f98a4080600 con 0x7f98a80f5440 2021-11-03T18:01:27.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:27.978+0000 7f98ad596700 1 --2- 172.21.15.26:0/1183087070 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9894064100 0x7f98940665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:01:27.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:27.979+0000 7f98ad596700 1 --2- 172.21.15.26:0/1183087070 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9894064100 0x7f98940665c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f9898009da0 tx=0x7f9898009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:01:27.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:27.983+0000 7f989e7fc700 1 -- 172.21.15.26:0/1183087070 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f98a40528c0 con 0x7f98a80f5440 2021-11-03T18:01:28.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.158+0000 7f98aed99700 1 -- 172.21.15.26:0/1183087070 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f98a80fdd70 con 0x7f9894064100 2021-11-03T18:01:28.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.159+0000 7f989e7fc700 1 -- 172.21.15.26:0/1183087070 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f98a80fdd70 con 0x7f9894064100 2021-11-03T18:01:28.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.161+0000 7f98aed99700 1 -- 172.21.15.26:0/1183087070 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9894064100 msgr2=0x7f98940665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:01:28.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.161+0000 7f98aed99700 1 --2- 172.21.15.26:0/1183087070 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9894064100 0x7f98940665c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f9898009da0 tx=0x7f9898009b30).stop 2021-11-03T18:01:28.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.161+0000 7f98aed99700 1 -- 172.21.15.26:0/1183087070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98a80f5440 msgr2=0x7f98a8109ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:01:28.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.161+0000 7f98aed99700 1 --2- 172.21.15.26:0/1183087070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98a80f5440 0x7f98a8109ab0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7f98a400c530 tx=0x7f98a4007e10).stop 2021-11-03T18:01:28.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.161+0000 7f98aed99700 1 -- 172.21.15.26:0/1183087070 shutdown_connections 2021-11-03T18:01:28.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.161+0000 7f98aed99700 1 --2- 172.21.15.26:0/1183087070 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9894064100 0x7f98940665c0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:01:28.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.161+0000 7f98aed99700 1 --2- 172.21.15.26:0/1183087070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98a80f5440 0x7f98a8109ab0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:01:28.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.161+0000 7f98aed99700 1 --2- 172.21.15.26:0/1183087070 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98a80f66e0 0x7f98a810bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:01:28.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.161+0000 7f98aed99700 1 -- 172.21.15.26:0/1183087070 >> 172.21.15.26:0/1183087070 conn(0x7f98a80f0ba0 msgr2=0x7f98a80fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:01:28.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.161+0000 7f98aed99700 1 -- 172.21.15.26:0/1183087070 shutdown_connections 2021-11-03T18:01:28.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.161+0000 7f98aed99700 1 -- 172.21.15.26:0/1183087070 wait complete. 2021-11-03T18:01:28.168 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:01:28.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.261+0000 7fc4a1cbd700 1 -- 172.21.15.26:0/1249817923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc49c0f6530 msgr2=0x7fc49c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:01:28.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.261+0000 7fc4a1cbd700 1 --2- 172.21.15.26:0/1249817923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc49c0f6530 0x7fc49c0f6950 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7fc490004660 tx=0x7fc490009b30).stop 2021-11-03T18:01:28.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.261+0000 7fc4a1cbd700 1 -- 172.21.15.26:0/1249817923 shutdown_connections 2021-11-03T18:01:28.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.261+0000 7fc4a1cbd700 1 --2- 172.21.15.26:0/1249817923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc49c0f77d0 0x7fc49c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:01:28.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.261+0000 7fc4a1cbd700 1 --2- 172.21.15.26:0/1249817923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc49c0f6530 0x7fc49c0f6950 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:01:28.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.261+0000 7fc4a1cbd700 1 -- 172.21.15.26:0/1249817923 >> 172.21.15.26:0/1249817923 conn(0x7fc49c0f1cd0 msgr2=0x7fc49c0f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:01:28.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.261+0000 7fc4a1cbd700 1 -- 172.21.15.26:0/1249817923 shutdown_connections 2021-11-03T18:01:28.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.261+0000 7fc4a1cbd700 1 -- 172.21.15.26:0/1249817923 wait complete. 2021-11-03T18:01:28.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.262+0000 7fc4a1cbd700 1 Processor -- start 2021-11-03T18:01:28.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.262+0000 7fc4a1cbd700 1 -- start start 2021-11-03T18:01:28.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.262+0000 7fc4a1cbd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc49c0f6530 0x7fc49c106db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:01:28.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.262+0000 7fc4a1cbd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc49c0f77d0 0x7fc49c1072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:01:28.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.262+0000 7fc4a1cbd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c1078a0 con 0x7fc49c0f77d0 2021-11-03T18:01:28.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.262+0000 7fc4a1cbd700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c1080e0 con 0x7fc49c0f6530 2021-11-03T18:01:28.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.262+0000 7fc49bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc49c0f77d0 0x7fc49c1072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:01:28.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.262+0000 7fc49bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc49c0f77d0 0x7fc49c1072a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57698/0 (socket says 172.21.15.26:57698) 2021-11-03T18:01:28.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.262+0000 7fc49bfff700 1 -- 172.21.15.26:0/1798493961 learned_addr learned my addr 172.21.15.26:0/1798493961 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:01:28.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.263+0000 7fc4a0cbb700 1 --2- 172.21.15.26:0/1798493961 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc49c0f6530 0x7fc49c106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:01:28.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.263+0000 7fc49bfff700 1 -- 172.21.15.26:0/1798493961 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc49c0f6530 msgr2=0x7fc49c106db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:01:28.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.263+0000 7fc49bfff700 1 --2- 172.21.15.26:0/1798493961 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc49c0f6530 0x7fc49c106db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:01:28.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.263+0000 7fc49bfff700 1 -- 172.21.15.26:0/1798493961 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc490005040 con 0x7fc49c0f77d0 2021-11-03T18:01:28.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.263+0000 7fc49bfff700 1 --2- 172.21.15.26:0/1798493961 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc49c0f77d0 0x7fc49c1072a0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 rx=0x7fc48800c530 tx=0x7fc488007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:01:28.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.263+0000 7fc4997fa700 1 -- 172.21.15.26:0/1798493961 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc48800f650 con 0x7fc49c0f77d0 2021-11-03T18:01:28.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.263+0000 7fc4997fa700 1 -- 172.21.15.26:0/1798493961 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc48800fc60 con 0x7fc49c0f77d0 2021-11-03T18:01:28.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.263+0000 7fc4a1cbd700 1 -- 172.21.15.26:0/1798493961 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc49c1083c0 con 0x7fc49c0f77d0 2021-11-03T18:01:28.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.263+0000 7fc4997fa700 1 -- 172.21.15.26:0/1798493961 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc488012cd0 con 0x7fc49c0f77d0 2021-11-03T18:01:28.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.263+0000 7fc4a1cbd700 1 -- 172.21.15.26:0/1798493961 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc49c108900 con 0x7fc49c0f77d0 2021-11-03T18:01:28.268 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.264+0000 7fc4a1cbd700 1 -- 172.21.15.26:0/1798493961 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc49c059100 con 0x7fc49c0f77d0 2021-11-03T18:01:28.268 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.264+0000 7fc4997fa700 1 -- 172.21.15.26:0/1798493961 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc488010070 con 0x7fc49c0f77d0 2021-11-03T18:01:28.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.265+0000 7fc4997fa700 1 --2- 172.21.15.26:0/1798493961 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc48c064100 0x7fc48c0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:01:28.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.265+0000 7fc4997fa700 1 -- 172.21.15.26:0/1798493961 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc4880806e0 con 0x7fc49c0f77d0 2021-11-03T18:01:28.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.265+0000 7fc4a0cbb700 1 --2- 172.21.15.26:0/1798493961 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc48c064100 0x7fc48c0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:01:28.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.265+0000 7fc4a0cbb700 1 --2- 172.21.15.26:0/1798493961 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc48c064100 0x7fc48c0665c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7fc490009da0 tx=0x7fc490009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:01:28.270 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.269+0000 7fc4997fa700 1 -- 172.21.15.26:0/1798493961 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc488052950 con 0x7fc49c0f77d0 2021-11-03T18:01:28.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.441+0000 7fc4a1cbd700 1 -- 172.21.15.26:0/1798493961 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc49c0fee30 con 0x7fc48c064100 2021-11-03T18:01:28.452 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.456+0000 7fc4997fa700 1 -- 172.21.15.26:0/1798493961 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fc49c0fee30 con 0x7fc48c064100 2021-11-03T18:01:28.453 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:01:28.453 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (72m) 98s ago 73m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:01:28.453 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (64m) 98s ago 73m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:01:28.453 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (64m) 35s ago 73m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:01:28.454 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (72m) 98s ago 73m 41.7M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:01:28.454 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (65m) 98s ago 69m 25.6M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:01:28.454 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (66m) 98s ago 68m 26.2M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:01:28.454 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (69m) 35s ago 69m 26.4M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:01:28.455 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (69m) 35s ago 69m 26.8M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:01:28.455 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (66m) 98s ago 75m 561M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:01:28.455 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (66m) 35s ago 73m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:01:28.455 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (65m) 98s ago 75m 276M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:01:28.455 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (65m) 35s ago 73m 132M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:01:28.456 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (73m) 98s ago 73m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:01:28.456 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (72m) 35s ago 72m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:01:28.456 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (64m) 98s ago 72m 292M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:01:28.456 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (64m) 98s ago 71m 313M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:01:28.457 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (63m) 98s ago 71m 261M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:01:28.457 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (63m) 35s ago 71m 337M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:01:28.457 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (62m) 35s ago 70m 283M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:01:28.457 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (62m) 35s ago 70m 276M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:01:28.457 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (72m) 98s ago 73m 61.2M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:01:28.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.458+0000 7fc4a1cbd700 1 -- 172.21.15.26:0/1798493961 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc48c064100 msgr2=0x7fc48c0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:01:28.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.458+0000 7fc4a1cbd700 1 --2- 172.21.15.26:0/1798493961 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc48c064100 0x7fc48c0665c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7fc490009da0 tx=0x7fc490009b30).stop 2021-11-03T18:01:28.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.458+0000 7fc4a1cbd700 1 -- 172.21.15.26:0/1798493961 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc49c0f77d0 msgr2=0x7fc49c1072a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:01:28.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.458+0000 7fc4a1cbd700 1 --2- 172.21.15.26:0/1798493961 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc49c0f77d0 0x7fc49c1072a0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 rx=0x7fc48800c530 tx=0x7fc488007e20).stop 2021-11-03T18:01:28.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.458+0000 7fc4a1cbd700 1 -- 172.21.15.26:0/1798493961 shutdown_connections 2021-11-03T18:01:28.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.458+0000 7fc4a1cbd700 1 --2- 172.21.15.26:0/1798493961 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc48c064100 0x7fc48c0665c0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:01:28.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.458+0000 7fc4a1cbd700 1 --2- 172.21.15.26:0/1798493961 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc49c0f6530 0x7fc49c106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:01:28.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.458+0000 7fc4a1cbd700 1 --2- 172.21.15.26:0/1798493961 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc49c0f77d0 0x7fc49c1072a0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:01:28.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.458+0000 7fc4a1cbd700 1 -- 172.21.15.26:0/1798493961 >> 172.21.15.26:0/1798493961 conn(0x7fc49c0f1cd0 msgr2=0x7fc49c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:01:28.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.458+0000 7fc4a1cbd700 1 -- 172.21.15.26:0/1798493961 shutdown_connections 2021-11-03T18:01:28.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.458+0000 7fc4a1cbd700 1 -- 172.21.15.26:0/1798493961 wait complete. 2021-11-03T18:01:28.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.556+0000 7f4c9953c700 1 -- 172.21.15.26:0/2036401837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c940f6530 msgr2=0x7f4c940f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:01:28.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.556+0000 7f4c9953c700 1 --2- 172.21.15.26:0/2036401837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c940f6530 0x7f4c940f6950 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 rx=0x7f4c84004660 tx=0x7f4c84009b30).stop 2021-11-03T18:01:28.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.556+0000 7f4c9953c700 1 -- 172.21.15.26:0/2036401837 shutdown_connections 2021-11-03T18:01:28.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.556+0000 7f4c9953c700 1 --2- 172.21.15.26:0/2036401837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c940f77d0 0x7f4c940f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:01:28.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.556+0000 7f4c9953c700 1 --2- 172.21.15.26:0/2036401837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c940f6530 0x7f4c940f6950 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:01:28.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.556+0000 7f4c9953c700 1 -- 172.21.15.26:0/2036401837 >> 172.21.15.26:0/2036401837 conn(0x7f4c940f1cd0 msgr2=0x7f4c940f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:01:28.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.556+0000 7f4c9953c700 1 -- 172.21.15.26:0/2036401837 shutdown_connections 2021-11-03T18:01:28.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.556+0000 7f4c9953c700 1 -- 172.21.15.26:0/2036401837 wait complete. 2021-11-03T18:01:28.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.557+0000 7f4c9953c700 1 Processor -- start 2021-11-03T18:01:28.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.557+0000 7f4c9953c700 1 -- start start 2021-11-03T18:01:28.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.557+0000 7f4c9953c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c940f6530 0x7f4c9406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:01:28.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.557+0000 7f4c9953c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c940f77d0 0x7f4c94069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:01:28.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.557+0000 7f4c9953c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9406a410 con 0x7f4c940f77d0 2021-11-03T18:01:28.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.557+0000 7f4c9953c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9406a550 con 0x7f4c940f6530 2021-11-03T18:01:28.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.557+0000 7f4c937fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c940f77d0 0x7f4c94069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:01:28.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.557+0000 7f4c937fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c940f77d0 0x7f4c94069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57708/0 (socket says 172.21.15.26:57708) 2021-11-03T18:01:28.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.557+0000 7f4c937fe700 1 -- 172.21.15.26:0/1355729209 learned_addr learned my addr 172.21.15.26:0/1355729209 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:01:28.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.558+0000 7f4c93fff700 1 --2- 172.21.15.26:0/1355729209 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c940f6530 0x7f4c9406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:01:28.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.558+0000 7f4c937fe700 1 -- 172.21.15.26:0/1355729209 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c940f6530 msgr2=0x7f4c9406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:01:28.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.558+0000 7f4c937fe700 1 --2- 172.21.15.26:0/1355729209 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c940f6530 0x7f4c9406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:01:28.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.558+0000 7f4c937fe700 1 -- 172.21.15.26:0/1355729209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c84005040 con 0x7f4c940f77d0 2021-11-03T18:01:28.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.558+0000 7f4c937fe700 1 --2- 172.21.15.26:0/1355729209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c940f77d0 0x7f4c94069e20 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7f4c8800b410 tx=0x7f4c88006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:01:28.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.558+0000 7f4c90ff9700 1 -- 172.21.15.26:0/1355729209 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c880125f0 con 0x7f4c940f77d0 2021-11-03T18:01:28.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.558+0000 7f4c90ff9700 1 -- 172.21.15.26:0/1355729209 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4c88012c00 con 0x7f4c940f77d0 2021-11-03T18:01:28.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.558+0000 7f4c9953c700 1 -- 172.21.15.26:0/1355729209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c9406a830 con 0x7f4c940f77d0 2021-11-03T18:01:28.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.558+0000 7f4c90ff9700 1 -- 172.21.15.26:0/1355729209 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c88002ae0 con 0x7f4c940f77d0 2021-11-03T18:01:28.562 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.558+0000 7f4c9953c700 1 -- 172.21.15.26:0/1355729209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c9410ed80 con 0x7f4c940f77d0 2021-11-03T18:01:28.562 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.559+0000 7f4c9953c700 1 -- 172.21.15.26:0/1355729209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c94045ad0 con 0x7f4c940f77d0 2021-11-03T18:01:28.562 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.559+0000 7f4c90ff9700 1 -- 172.21.15.26:0/1355729209 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f4c8800f030 con 0x7f4c940f77d0 2021-11-03T18:01:28.563 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.560+0000 7f4c90ff9700 1 --2- 172.21.15.26:0/1355729209 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4c7c064100 0x7f4c7c0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:01:28.563 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.560+0000 7f4c90ff9700 1 -- 172.21.15.26:0/1355729209 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f4c88080be0 con 0x7f4c940f77d0 2021-11-03T18:01:28.563 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.560+0000 7f4c93fff700 1 --2- 172.21.15.26:0/1355729209 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4c7c064100 0x7f4c7c0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:01:28.563 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.560+0000 7f4c93fff700 1 --2- 172.21.15.26:0/1355729209 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4c7c064100 0x7f4c7c0665c0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f4c84004e30 tx=0x7f4c84009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:01:28.564 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.564+0000 7f4c90ff9700 1 -- 172.21.15.26:0/1355729209 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f4c88052f40 con 0x7f4c940f77d0 2021-11-03T18:01:28.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.794+0000 7f4c9953c700 1 -- 172.21.15.26:0/1355729209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4c940fee10 con 0x7f4c940f77d0 2021-11-03T18:01:28.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.795+0000 7f4c90ff9700 1 -- 172.21.15.26:0/1355729209 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f4c8804de60 con 0x7f4c940f77d0 2021-11-03T18:01:28.793 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:01:28.793 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:01:28.794 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:01:28.794 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:01:28.794 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:01:28.794 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:01:28.795 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:01:28.795 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:01:28.795 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:01:28.795 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:01:28.795 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:01:28.796 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:01:28.796 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:01:28.796 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:01:28.796 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:01:28.797 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:01:28.797 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:01:28.797 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:01:28.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.797+0000 7f4c9953c700 1 -- 172.21.15.26:0/1355729209 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4c7c064100 msgr2=0x7f4c7c0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:01:28.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.797+0000 7f4c9953c700 1 --2- 172.21.15.26:0/1355729209 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4c7c064100 0x7f4c7c0665c0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f4c84004e30 tx=0x7f4c84009b30).stop 2021-11-03T18:01:28.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.797+0000 7f4c9953c700 1 -- 172.21.15.26:0/1355729209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c940f77d0 msgr2=0x7f4c94069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:01:28.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.797+0000 7f4c9953c700 1 --2- 172.21.15.26:0/1355729209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c940f77d0 0x7f4c94069e20 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7f4c8800b410 tx=0x7f4c88006ef0).stop 2021-11-03T18:01:28.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.797+0000 7f4c9953c700 1 -- 172.21.15.26:0/1355729209 shutdown_connections 2021-11-03T18:01:28.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.797+0000 7f4c9953c700 1 --2- 172.21.15.26:0/1355729209 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4c7c064100 0x7f4c7c0665c0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:01:28.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.797+0000 7f4c9953c700 1 --2- 172.21.15.26:0/1355729209 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c940f6530 0x7f4c9406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:01:28.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.797+0000 7f4c9953c700 1 --2- 172.21.15.26:0/1355729209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c940f77d0 0x7f4c94069e20 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:01:28.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.797+0000 7f4c9953c700 1 -- 172.21.15.26:0/1355729209 >> 172.21.15.26:0/1355729209 conn(0x7f4c940f1cd0 msgr2=0x7f4c940fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:01:28.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.797+0000 7f4c9953c700 1 -- 172.21.15.26:0/1355729209 shutdown_connections 2021-11-03T18:01:28.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.797+0000 7f4c9953c700 1 -- 172.21.15.26:0/1355729209 wait complete. 2021-11-03T18:01:28.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.897+0000 7f1364d8f700 1 -- 172.21.15.26:0/725814236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13600f6530 msgr2=0x7f13600f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:01:28.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.897+0000 7f1364d8f700 1 --2- 172.21.15.26:0/725814236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13600f6530 0x7f13600f6950 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 rx=0x7f13580099e0 tx=0x7f1358004d10).stop 2021-11-03T18:01:28.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.897+0000 7f1364d8f700 1 -- 172.21.15.26:0/725814236 shutdown_connections 2021-11-03T18:01:28.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.897+0000 7f1364d8f700 1 --2- 172.21.15.26:0/725814236 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13600f77d0 0x7f13600f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:01:28.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.897+0000 7f1364d8f700 1 --2- 172.21.15.26:0/725814236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13600f6530 0x7f13600f6950 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:01:28.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.897+0000 7f1364d8f700 1 -- 172.21.15.26:0/725814236 >> 172.21.15.26:0/725814236 conn(0x7f13600f1cd0 msgr2=0x7f13600f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:01:28.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.897+0000 7f1364d8f700 1 -- 172.21.15.26:0/725814236 shutdown_connections 2021-11-03T18:01:28.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.897+0000 7f1364d8f700 1 -- 172.21.15.26:0/725814236 wait complete. 2021-11-03T18:01:28.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.898+0000 7f1364d8f700 1 Processor -- start 2021-11-03T18:01:28.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.898+0000 7f1364d8f700 1 -- start start 2021-11-03T18:01:28.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.898+0000 7f1364d8f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13600f6530 0x7f136006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:01:28.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.898+0000 7f1364d8f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13600f77d0 0x7f1360069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:01:28.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.898+0000 7f1364d8f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136006a410 con 0x7f13600f77d0 2021-11-03T18:01:28.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.898+0000 7f1364d8f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136006a550 con 0x7f13600f6530 2021-11-03T18:01:28.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.898+0000 7f135effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13600f77d0 0x7f1360069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:01:28.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.899+0000 7f135effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13600f77d0 0x7f1360069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57720/0 (socket says 172.21.15.26:57720) 2021-11-03T18:01:28.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.899+0000 7f135effd700 1 -- 172.21.15.26:0/194279987 learned_addr learned my addr 172.21.15.26:0/194279987 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:01:28.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.899+0000 7f135f7fe700 1 --2- 172.21.15.26:0/194279987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13600f6530 0x7f136006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:01:28.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.899+0000 7f135effd700 1 -- 172.21.15.26:0/194279987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13600f6530 msgr2=0x7f136006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:01:28.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.899+0000 7f135effd700 1 --2- 172.21.15.26:0/194279987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13600f6530 0x7f136006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:01:28.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.899+0000 7f135effd700 1 -- 172.21.15.26:0/194279987 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1358009640 con 0x7f13600f77d0 2021-11-03T18:01:28.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.899+0000 7f135effd700 1 --2- 172.21.15.26:0/194279987 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13600f77d0 0x7f1360069e20 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7f134800b410 tx=0x7f1348006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:01:28.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.899+0000 7f1357fff700 1 -- 172.21.15.26:0/194279987 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13480125f0 con 0x7f13600f77d0 2021-11-03T18:01:28.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.899+0000 7f1357fff700 1 -- 172.21.15.26:0/194279987 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1348012c00 con 0x7f13600f77d0 2021-11-03T18:01:28.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.899+0000 7f1364d8f700 1 -- 172.21.15.26:0/194279987 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f136006a830 con 0x7f13600f77d0 2021-11-03T18:01:28.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.899+0000 7f1357fff700 1 -- 172.21.15.26:0/194279987 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1348002ae0 con 0x7f13600f77d0 2021-11-03T18:01:28.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.899+0000 7f1364d8f700 1 -- 172.21.15.26:0/194279987 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f136010eef0 con 0x7f13600f77d0 2021-11-03T18:01:28.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.900+0000 7f1364d8f700 1 -- 172.21.15.26:0/194279987 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1360045ad0 con 0x7f13600f77d0 2021-11-03T18:01:28.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.901+0000 7f1357fff700 1 -- 172.21.15.26:0/194279987 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f134800f030 con 0x7f13600f77d0 2021-11-03T18:01:28.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.901+0000 7f1357fff700 1 --2- 172.21.15.26:0/194279987 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f134c064100 0x7f134c0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:01:28.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.901+0000 7f1357fff700 1 -- 172.21.15.26:0/194279987 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f1348080b90 con 0x7f13600f77d0 2021-11-03T18:01:28.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.901+0000 7f135f7fe700 1 --2- 172.21.15.26:0/194279987 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f134c064100 0x7f134c0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:01:28.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.901+0000 7f135f7fe700 1 --2- 172.21.15.26:0/194279987 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f134c064100 0x7f134c0665c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f135800b730 tx=0x7f1358004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:01:28.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:28.905+0000 7f1357fff700 1 -- 172.21.15.26:0/194279987 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f1348052ef0 con 0x7f13600f77d0 2021-11-03T18:01:28.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:28 smithi026 ceph-mon[96795]: pgmap v2004: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:28.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:28 smithi194 ceph-mon[65619]: pgmap v2004: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:29.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:29.115+0000 7f1364d8f700 1 -- 172.21.15.26:0/194279987 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1360027a00 con 0x7f13600f77d0 2021-11-03T18:01:29.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:29.115+0000 7f1357fff700 1 -- 172.21.15.26:0/194279987 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f1348052ae0 con 0x7f13600f77d0 2021-11-03T18:01:29.112 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:01:29.113 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:01:29.113 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:01:29.113 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:01:29.113 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:01:29.114 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:01:29.114 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:01:29.114 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:01:29.114 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:01:29.115 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:01:29.115 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:01:29.115 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:01:29.115 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:01:29.116 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:01:29.116 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:01:29.116 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:01:29.116 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:01:29.116 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:01:29.117 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:01:29.117 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:01:29.117 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:01:29.118 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:01:29.118 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:01:29.118 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:01:29.118 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:01:29.119 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:01:29.119 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:01:29.119 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:01:29.119 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:01:29.119 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:01:29.120 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:01:29.120 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:01:29.120 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:01:29.120 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:01:29.121 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:01:29.121 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:01:29.121 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:01:29.121 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:01:29.122 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:01:29.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:29.117+0000 7f1364d8f700 1 -- 172.21.15.26:0/194279987 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f134c064100 msgr2=0x7f134c0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:01:29.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:29.117+0000 7f1364d8f700 1 --2- 172.21.15.26:0/194279987 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f134c064100 0x7f134c0665c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f135800b730 tx=0x7f1358004d10).stop 2021-11-03T18:01:29.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:29.117+0000 7f1364d8f700 1 -- 172.21.15.26:0/194279987 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13600f77d0 msgr2=0x7f1360069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:01:29.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:29.117+0000 7f1364d8f700 1 --2- 172.21.15.26:0/194279987 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13600f77d0 0x7f1360069e20 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7f134800b410 tx=0x7f1348006ef0).stop 2021-11-03T18:01:29.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:29.117+0000 7f1364d8f700 1 -- 172.21.15.26:0/194279987 shutdown_connections 2021-11-03T18:01:29.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:29.117+0000 7f1364d8f700 1 --2- 172.21.15.26:0/194279987 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f134c064100 0x7f134c0665c0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:01:29.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:29.117+0000 7f1364d8f700 1 --2- 172.21.15.26:0/194279987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13600f6530 0x7f136006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:01:29.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:29.117+0000 7f1364d8f700 1 --2- 172.21.15.26:0/194279987 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13600f77d0 0x7f1360069e20 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:01:29.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:29.117+0000 7f1364d8f700 1 -- 172.21.15.26:0/194279987 >> 172.21.15.26:0/194279987 conn(0x7f13600f1cd0 msgr2=0x7f13600fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:01:29.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:29.117+0000 7f1364d8f700 1 -- 172.21.15.26:0/194279987 shutdown_connections 2021-11-03T18:01:29.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:29.117+0000 7f1364d8f700 1 -- 172.21.15.26:0/194279987 wait complete. 2021-11-03T18:01:29.125 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:01:29.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:29 smithi026 ceph-mon[96795]: from='client.36204 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:01:29.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:29 smithi026 ceph-mon[96795]: from='client.36208 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:01:29.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:29 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1355729209' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:01:29.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:29 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/194279987' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:01:29.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:29 smithi194 ceph-mon[65619]: from='client.36204 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:01:29.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:29 smithi194 ceph-mon[65619]: from='client.36208 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:01:30.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:29 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1355729209' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:01:30.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:29 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/194279987' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:01:30.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:30 smithi026 ceph-mon[96795]: pgmap v2005: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:30.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:30 smithi194 ceph-mon[65619]: pgmap v2005: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:32.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:32 smithi026 ceph-mon[96795]: pgmap v2006: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:32.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:32 smithi194 ceph-mon[65619]: pgmap v2006: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:34.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:34 smithi026 ceph-mon[96795]: pgmap v2007: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:34.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:34 smithi194 ceph-mon[65619]: pgmap v2007: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:36.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:36 smithi026 ceph-mon[96795]: pgmap v2008: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:36.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:36 smithi194 ceph-mon[65619]: pgmap v2008: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:38.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:38 smithi026 ceph-mon[96795]: pgmap v2009: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:38.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:38 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:01:38.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:38 smithi194 ceph-mon[65619]: pgmap v2009: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:39.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:38 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:01:39.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:39 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:01:39.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:39 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:01:40.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:40 smithi026 ceph-mon[96795]: pgmap v2010: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:40.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:40 smithi194 ceph-mon[65619]: pgmap v2010: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:42.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:42 smithi026 ceph-mon[96795]: pgmap v2011: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:42.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:42 smithi194 ceph-mon[65619]: pgmap v2011: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:44.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:44 smithi026 ceph-mon[96795]: pgmap v2012: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:44.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:44 smithi194 ceph-mon[65619]: pgmap v2012: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:46.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:46 smithi026 ceph-mon[96795]: pgmap v2013: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:46.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:46 smithi194 ceph-mon[65619]: pgmap v2013: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:48.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:48 smithi026 ceph-mon[96795]: pgmap v2014: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:48.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:01:48.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:01:48.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:48 smithi194 ceph-mon[65619]: pgmap v2014: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:48.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:01:48.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:01:50.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:50 smithi026 ceph-mon[96795]: pgmap v2015: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:50.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:50 smithi194 ceph-mon[65619]: pgmap v2015: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:52.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:52 smithi026 ceph-mon[96795]: pgmap v2016: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:52.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:52 smithi194 ceph-mon[65619]: pgmap v2016: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:53.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:53 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:01:53.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:53 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:01:54.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:54 smithi194 ceph-mon[65619]: poll took 60042.532 ms: 1 events 2021-11-03T18:01:54.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:54 smithi194 ceph-mon[65619]: pgmap v2017: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:55.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:01:55.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:01:55.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:01:55.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:01:55.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:01:55.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:01:55.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:54 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:01:55.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:01:55.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:54 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:01:55.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:54 smithi026 ceph-mon[96795]: poll took 60042.532 ms: 1 events 2021-11-03T18:01:55.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:54 smithi026 ceph-mon[96795]: pgmap v2017: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:55.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:01:55.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:01:55.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:01:55.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:01:55.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:01:55.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:01:55.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:54 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:01:55.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:01:55.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:54 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:01:56.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:56 smithi194 ceph-mon[65619]: pgmap v2018: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:57.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:56 smithi026 ceph-mon[96795]: pgmap v2018: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:58.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:01:58 smithi194 ceph-mon[65619]: pgmap v2019: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:59.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:01:58 smithi026 ceph-mon[96795]: pgmap v2019: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:01:59.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.232+0000 7f1eafb2f700 1 -- 172.21.15.26:0/2475352369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ea80f66e0 msgr2=0x7f1ea80f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:01:59.233 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.232+0000 7f1eafb2f700 1 --2- 172.21.15.26:0/2475352369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ea80f66e0 0x7f1ea80f6b00 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 rx=0x7f1ea40099e0 tx=0x7f1ea4004d10).stop 2021-11-03T18:01:59.233 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.232+0000 7f1eafb2f700 1 -- 172.21.15.26:0/2475352369 shutdown_connections 2021-11-03T18:01:59.233 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.232+0000 7f1eafb2f700 1 --2- 172.21.15.26:0/2475352369 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ea80f7980 0x7f1ea80f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:01:59.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.232+0000 7f1eafb2f700 1 --2- 172.21.15.26:0/2475352369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ea80f66e0 0x7f1ea80f6b00 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:01:59.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.232+0000 7f1eafb2f700 1 -- 172.21.15.26:0/2475352369 >> 172.21.15.26:0/2475352369 conn(0x7f1ea80f1e40 msgr2=0x7f1ea80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:01:59.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.232+0000 7f1eafb2f700 1 -- 172.21.15.26:0/2475352369 shutdown_connections 2021-11-03T18:01:59.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.232+0000 7f1eafb2f700 1 -- 172.21.15.26:0/2475352369 wait complete. 2021-11-03T18:01:59.235 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.233+0000 7f1eafb2f700 1 Processor -- start 2021-11-03T18:01:59.235 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.233+0000 7f1eafb2f700 1 -- start start 2021-11-03T18:01:59.235 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.233+0000 7f1eafb2f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ea80f66e0 0x7f1ea806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:01:59.236 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.233+0000 7f1eafb2f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ea80f7980 0x7f1ea8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:01:59.236 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.233+0000 7f1eafb2f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea806a380 con 0x7f1ea80f7980 2021-11-03T18:01:59.236 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.233+0000 7f1eafb2f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea806a4c0 con 0x7f1ea80f66e0 2021-11-03T18:01:59.236 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.233+0000 7f1ead0ca700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ea80f7980 0x7f1ea8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:01:59.236 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.233+0000 7f1ead0ca700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ea80f7980 0x7f1ea8069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57738/0 (socket says 172.21.15.26:57738) 2021-11-03T18:01:59.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.233+0000 7f1ead0ca700 1 -- 172.21.15.26:0/75691335 learned_addr learned my addr 172.21.15.26:0/75691335 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:01:59.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.233+0000 7f1ead0ca700 1 -- 172.21.15.26:0/75691335 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ea80f66e0 msgr2=0x7f1ea806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:01:59.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.234+0000 7f1ead0ca700 1 --2- 172.21.15.26:0/75691335 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ea80f66e0 0x7f1ea806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:01:59.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.234+0000 7f1ead0ca700 1 -- 172.21.15.26:0/75691335 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea4009640 con 0x7f1ea80f7980 2021-11-03T18:01:59.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.234+0000 7f1ead0ca700 1 --2- 172.21.15.26:0/75691335 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ea80f7980 0x7f1ea8069e20 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 rx=0x7f1e98002700 tx=0x7f1e98009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:01:59.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.234+0000 7f1e9e7fc700 1 -- 172.21.15.26:0/75691335 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e98009320 con 0x7f1ea80f7980 2021-11-03T18:01:59.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.234+0000 7f1eafb2f700 1 -- 172.21.15.26:0/75691335 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ea806a7a0 con 0x7f1ea80f7980 2021-11-03T18:01:59.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.234+0000 7f1e9e7fc700 1 -- 172.21.15.26:0/75691335 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1e9800f040 con 0x7f1ea80f7980 2021-11-03T18:01:59.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.234+0000 7f1e9e7fc700 1 -- 172.21.15.26:0/75691335 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e98014820 con 0x7f1ea80f7980 2021-11-03T18:01:59.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.234+0000 7f1eafb2f700 1 -- 172.21.15.26:0/75691335 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ea810f100 con 0x7f1ea80f7980 2021-11-03T18:01:59.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.235+0000 7f1eafb2f700 1 -- 172.21.15.26:0/75691335 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ea8045ad0 con 0x7f1ea80f7980 2021-11-03T18:01:59.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.235+0000 7f1e9e7fc700 1 -- 172.21.15.26:0/75691335 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f1e98009480 con 0x7f1ea80f7980 2021-11-03T18:01:59.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.236+0000 7f1e9e7fc700 1 --2- 172.21.15.26:0/75691335 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1e940640b0 0x7f1e94066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:01:59.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.236+0000 7f1e9e7fc700 1 -- 172.21.15.26:0/75691335 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f1e98080b10 con 0x7f1ea80f7980 2021-11-03T18:01:59.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.236+0000 7f1ead8cb700 1 --2- 172.21.15.26:0/75691335 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1e940640b0 0x7f1e94066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:01:59.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.236+0000 7f1ead8cb700 1 --2- 172.21.15.26:0/75691335 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1e940640b0 0x7f1e94066570 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f1ea806b730 tx=0x7f1ea4004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:01:59.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.240+0000 7f1e9e7fc700 1 -- 172.21.15.26:0/75691335 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f1e98052e70 con 0x7f1ea80f7980 2021-11-03T18:01:59.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.419+0000 7f1eafb2f700 1 -- 172.21.15.26:0/75691335 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ea80ff010 con 0x7f1e940640b0 2021-11-03T18:01:59.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.421+0000 7f1e9e7fc700 1 -- 172.21.15.26:0/75691335 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f1ea80ff010 con 0x7f1e940640b0 2021-11-03T18:01:59.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.422+0000 7f1eafb2f700 1 -- 172.21.15.26:0/75691335 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1e940640b0 msgr2=0x7f1e94066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:01:59.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.423+0000 7f1eafb2f700 1 --2- 172.21.15.26:0/75691335 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1e940640b0 0x7f1e94066570 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f1ea806b730 tx=0x7f1ea4004d10).stop 2021-11-03T18:01:59.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.423+0000 7f1eafb2f700 1 -- 172.21.15.26:0/75691335 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ea80f7980 msgr2=0x7f1ea8069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:01:59.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.423+0000 7f1eafb2f700 1 --2- 172.21.15.26:0/75691335 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ea80f7980 0x7f1ea8069e20 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 rx=0x7f1e98002700 tx=0x7f1e98009e00).stop 2021-11-03T18:01:59.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.423+0000 7f1eafb2f700 1 -- 172.21.15.26:0/75691335 shutdown_connections 2021-11-03T18:01:59.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.423+0000 7f1eafb2f700 1 --2- 172.21.15.26:0/75691335 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1e940640b0 0x7f1e94066570 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:01:59.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.423+0000 7f1eafb2f700 1 --2- 172.21.15.26:0/75691335 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ea80f66e0 0x7f1ea806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:01:59.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.423+0000 7f1eafb2f700 1 --2- 172.21.15.26:0/75691335 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ea80f7980 0x7f1ea8069e20 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:01:59.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.423+0000 7f1eafb2f700 1 -- 172.21.15.26:0/75691335 >> 172.21.15.26:0/75691335 conn(0x7f1ea80f1e40 msgr2=0x7f1ea80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:01:59.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.423+0000 7f1eafb2f700 1 -- 172.21.15.26:0/75691335 shutdown_connections 2021-11-03T18:01:59.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.423+0000 7f1eafb2f700 1 -- 172.21.15.26:0/75691335 wait complete. 2021-11-03T18:01:59.430 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:01:59.522 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.523+0000 7efc75881700 1 -- 172.21.15.26:0/2546265936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc700f6530 msgr2=0x7efc700f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:01:59.522 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.523+0000 7efc75881700 1 --2- 172.21.15.26:0/2546265936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc700f6530 0x7efc700f6950 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7efc64004660 tx=0x7efc64009b30).stop 2021-11-03T18:01:59.523 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.523+0000 7efc75881700 1 -- 172.21.15.26:0/2546265936 shutdown_connections 2021-11-03T18:01:59.523 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.523+0000 7efc75881700 1 --2- 172.21.15.26:0/2546265936 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc700f77d0 0x7efc700f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:01:59.523 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.523+0000 7efc75881700 1 --2- 172.21.15.26:0/2546265936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc700f6530 0x7efc700f6950 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:01:59.523 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.523+0000 7efc75881700 1 -- 172.21.15.26:0/2546265936 >> 172.21.15.26:0/2546265936 conn(0x7efc700f1cd0 msgr2=0x7efc700f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:01:59.524 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.523+0000 7efc75881700 1 -- 172.21.15.26:0/2546265936 shutdown_connections 2021-11-03T18:01:59.524 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.523+0000 7efc75881700 1 -- 172.21.15.26:0/2546265936 wait complete. 2021-11-03T18:01:59.524 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.524+0000 7efc75881700 1 Processor -- start 2021-11-03T18:01:59.524 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.524+0000 7efc75881700 1 -- start start 2021-11-03T18:01:59.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.524+0000 7efc75881700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc700f6530 0x7efc70106db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:01:59.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.524+0000 7efc75881700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc700f77d0 0x7efc701072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:01:59.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.524+0000 7efc75881700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc701078a0 con 0x7efc700f6530 2021-11-03T18:01:59.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.524+0000 7efc75881700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc701080e0 con 0x7efc700f77d0 2021-11-03T18:01:59.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.524+0000 7efc7487f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc700f6530 0x7efc70106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:01:59.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.524+0000 7efc7487f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc700f6530 0x7efc70106db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57746/0 (socket says 172.21.15.26:57746) 2021-11-03T18:01:59.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.524+0000 7efc7487f700 1 -- 172.21.15.26:0/1385234456 learned_addr learned my addr 172.21.15.26:0/1385234456 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:01:59.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.524+0000 7efc7487f700 1 -- 172.21.15.26:0/1385234456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc700f77d0 msgr2=0x7efc701072a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:01:59.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.524+0000 7efc7487f700 1 --2- 172.21.15.26:0/1385234456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc700f77d0 0x7efc701072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:01:59.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.524+0000 7efc7487f700 1 -- 172.21.15.26:0/1385234456 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc64005040 con 0x7efc700f6530 2021-11-03T18:01:59.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.524+0000 7efc7487f700 1 --2- 172.21.15.26:0/1385234456 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc700f6530 0x7efc70106db0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 rx=0x7efc64004f60 tx=0x7efc64009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:01:59.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.525+0000 7efc6d7fa700 1 -- 172.21.15.26:0/1385234456 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc64018070 con 0x7efc700f6530 2021-11-03T18:01:59.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.525+0000 7efc75881700 1 -- 172.21.15.26:0/1385234456 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc70108360 con 0x7efc700f6530 2021-11-03T18:01:59.530 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.525+0000 7efc6d7fa700 1 -- 172.21.15.26:0/1385234456 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efc64007ba0 con 0x7efc700f6530 2021-11-03T18:01:59.530 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.525+0000 7efc6d7fa700 1 -- 172.21.15.26:0/1385234456 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc6401c620 con 0x7efc700f6530 2021-11-03T18:01:59.530 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.525+0000 7efc75881700 1 -- 172.21.15.26:0/1385234456 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc70108840 con 0x7efc700f6530 2021-11-03T18:01:59.530 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.526+0000 7efc75881700 1 -- 172.21.15.26:0/1385234456 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc70059100 con 0x7efc700f6530 2021-11-03T18:01:59.531 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.526+0000 7efc6d7fa700 1 -- 172.21.15.26:0/1385234456 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7efc6401c8e0 con 0x7efc700f6530 2021-11-03T18:01:59.531 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.526+0000 7efc6d7fa700 1 --2- 172.21.15.26:0/1385234456 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efc60064100 0x7efc600665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:01:59.531 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.527+0000 7efc6d7fa700 1 -- 172.21.15.26:0/1385234456 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7efc640826c0 con 0x7efc700f6530 2021-11-03T18:01:59.531 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.527+0000 7efc6ffff700 1 --2- 172.21.15.26:0/1385234456 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efc60064100 0x7efc600665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:01:59.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.527+0000 7efc6ffff700 1 --2- 172.21.15.26:0/1385234456 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efc60064100 0x7efc600665c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7efc70106b40 tx=0x7efc5c007a40).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:01:59.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.531+0000 7efc6d7fa700 1 -- 172.21.15.26:0/1385234456 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7efc64054a20 con 0x7efc700f6530 2021-11-03T18:01:59.702 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.704+0000 7efc75881700 1 -- 172.21.15.26:0/1385234456 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7efc70108a60 con 0x7efc60064100 2021-11-03T18:01:59.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.718+0000 7efc6d7fa700 1 -- 172.21.15.26:0/1385234456 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7efc70108a60 con 0x7efc60064100 2021-11-03T18:01:59.716 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:01:59.717 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (73m) 2m ago 74m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:01:59.717 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (65m) 2m ago 74m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:01:59.717 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (65m) 66s ago 73m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:01:59.717 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (73m) 2m ago 74m 41.7M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:01:59.718 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (66m) 2m ago 69m 25.6M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:01:59.718 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (66m) 2m ago 69m 26.2M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:01:59.718 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (69m) 66s ago 69m 26.4M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:01:59.718 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (69m) 66s ago 69m 26.8M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:01:59.719 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (66m) 2m ago 75m 561M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:01:59.719 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (66m) 66s ago 73m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:01:59.719 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (66m) 2m ago 75m 276M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:01:59.719 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (66m) 66s ago 73m 132M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:01:59.720 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (74m) 2m ago 74m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:01:59.720 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (73m) 66s ago 73m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:01:59.720 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (65m) 2m ago 72m 292M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:01:59.720 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (64m) 2m ago 72m 313M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:01:59.721 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (64m) 2m ago 72m 261M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:01:59.721 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (63m) 66s ago 71m 337M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:01:59.721 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (63m) 66s ago 71m 283M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:01:59.721 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (62m) 66s ago 71m 276M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:01:59.721 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (72m) 2m ago 73m 61.2M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:01:59.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.720+0000 7efc75881700 1 -- 172.21.15.26:0/1385234456 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efc60064100 msgr2=0x7efc600665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:01:59.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.720+0000 7efc75881700 1 --2- 172.21.15.26:0/1385234456 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efc60064100 0x7efc600665c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7efc70106b40 tx=0x7efc5c007a40).stop 2021-11-03T18:01:59.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.720+0000 7efc75881700 1 -- 172.21.15.26:0/1385234456 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc700f6530 msgr2=0x7efc70106db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:01:59.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.720+0000 7efc75881700 1 --2- 172.21.15.26:0/1385234456 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc700f6530 0x7efc70106db0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 rx=0x7efc64004f60 tx=0x7efc64009b30).stop 2021-11-03T18:01:59.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.720+0000 7efc75881700 1 -- 172.21.15.26:0/1385234456 shutdown_connections 2021-11-03T18:01:59.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.720+0000 7efc75881700 1 --2- 172.21.15.26:0/1385234456 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efc60064100 0x7efc600665c0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:01:59.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.720+0000 7efc75881700 1 --2- 172.21.15.26:0/1385234456 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc700f6530 0x7efc70106db0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:01:59.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.720+0000 7efc75881700 1 --2- 172.21.15.26:0/1385234456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc700f77d0 0x7efc701072a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:01:59.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.720+0000 7efc75881700 1 -- 172.21.15.26:0/1385234456 >> 172.21.15.26:0/1385234456 conn(0x7efc700f1cd0 msgr2=0x7efc700fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:01:59.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.721+0000 7efc75881700 1 -- 172.21.15.26:0/1385234456 shutdown_connections 2021-11-03T18:01:59.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.721+0000 7efc75881700 1 -- 172.21.15.26:0/1385234456 wait complete. 2021-11-03T18:01:59.819 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.820+0000 7f4581d49700 1 -- 172.21.15.26:0/2846819908 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f457c0f9830 msgr2=0x7f457c0fbc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:01:59.819 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.820+0000 7f4581d49700 1 --2- 172.21.15.26:0/2846819908 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f457c0f9830 0x7f457c0fbc20 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 rx=0x7f4570004660 tx=0x7f4570009b30).stop 2021-11-03T18:01:59.820 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.820+0000 7f4581d49700 1 -- 172.21.15.26:0/2846819908 shutdown_connections 2021-11-03T18:01:59.820 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.820+0000 7f4581d49700 1 --2- 172.21.15.26:0/2846819908 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f457c0f9830 0x7f457c0fbc20 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:01:59.820 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.820+0000 7f4581d49700 1 --2- 172.21.15.26:0/2846819908 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f457c0603f0 0x7f457c0f9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:01:59.820 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.820+0000 7f4581d49700 1 -- 172.21.15.26:0/2846819908 >> 172.21.15.26:0/2846819908 conn(0x7f457c0f0dc0 msgr2=0x7f457c0f31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:01:59.820 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.820+0000 7f4581d49700 1 -- 172.21.15.26:0/2846819908 shutdown_connections 2021-11-03T18:01:59.821 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.820+0000 7f4581d49700 1 -- 172.21.15.26:0/2846819908 wait complete. 2021-11-03T18:01:59.821 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.820+0000 7f4581d49700 1 Processor -- start 2021-11-03T18:01:59.821 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.820+0000 7f4581d49700 1 -- start start 2021-11-03T18:01:59.821 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.821+0000 7f4581d49700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f457c0603f0 0x7f457c106f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:01:59.822 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.821+0000 7f4581d49700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f457c0f9830 0x7f457c107480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:01:59.822 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.821+0000 7f4581d49700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f457c107ac0 con 0x7f457c0603f0 2021-11-03T18:01:59.822 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.821+0000 7f4581d49700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f457c108370 con 0x7f457c0f9830 2021-11-03T18:01:59.822 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.821+0000 7f457b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f457c0603f0 0x7f457c106f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:01:59.822 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.821+0000 7f457b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f457c0603f0 0x7f457c106f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57756/0 (socket says 172.21.15.26:57756) 2021-11-03T18:01:59.823 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.821+0000 7f457b7fe700 1 -- 172.21.15.26:0/3325934379 learned_addr learned my addr 172.21.15.26:0/3325934379 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:01:59.823 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.821+0000 7f457affd700 1 --2- 172.21.15.26:0/3325934379 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f457c0f9830 0x7f457c107480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:01:59.823 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.821+0000 7f457b7fe700 1 -- 172.21.15.26:0/3325934379 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f457c0f9830 msgr2=0x7f457c107480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:01:59.823 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.821+0000 7f457b7fe700 1 --2- 172.21.15.26:0/3325934379 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f457c0f9830 0x7f457c107480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:01:59.824 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.821+0000 7f457b7fe700 1 -- 172.21.15.26:0/3325934379 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4570005040 con 0x7f457c0603f0 2021-11-03T18:01:59.824 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.821+0000 7f457b7fe700 1 --2- 172.21.15.26:0/3325934379 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f457c0603f0 0x7f457c106f90 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 rx=0x7f456c0093f0 tx=0x7f456c006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:01:59.824 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.821+0000 7f4563fff700 1 -- 172.21.15.26:0/3325934379 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f456c009ea0 con 0x7f457c0603f0 2021-11-03T18:01:59.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.821+0000 7f4581d49700 1 -- 172.21.15.26:0/3325934379 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f457c108650 con 0x7f457c0603f0 2021-11-03T18:01:59.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.821+0000 7f4563fff700 1 -- 172.21.15.26:0/3325934379 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f456c013af0 con 0x7f457c0603f0 2021-11-03T18:01:59.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.821+0000 7f4563fff700 1 -- 172.21.15.26:0/3325934379 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f456c00db10 con 0x7f457c0603f0 2021-11-03T18:01:59.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.821+0000 7f4581d49700 1 -- 172.21.15.26:0/3325934379 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f457c108c10 con 0x7f457c0603f0 2021-11-03T18:01:59.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.822+0000 7f4581d49700 1 -- 172.21.15.26:0/3325934379 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f457c0f4a50 con 0x7f457c0603f0 2021-11-03T18:01:59.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.823+0000 7f4563fff700 1 -- 172.21.15.26:0/3325934379 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f456c01a060 con 0x7f457c0603f0 2021-11-03T18:01:59.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.823+0000 7f4563fff700 1 --2- 172.21.15.26:0/3325934379 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f45640640b0 0x7f4564066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:01:59.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.823+0000 7f4563fff700 1 -- 172.21.15.26:0/3325934379 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f456c080900 con 0x7f457c0603f0 2021-11-03T18:01:59.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.823+0000 7f457affd700 1 --2- 172.21.15.26:0/3325934379 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f45640640b0 0x7f4564066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:01:59.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.824+0000 7f457affd700 1 --2- 172.21.15.26:0/3325934379 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f45640640b0 0x7f4564066570 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f4570004e30 tx=0x7f4570009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:01:59.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:01:59.827+0000 7f4563fff700 1 -- 172.21.15.26:0/3325934379 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f456c052b70 con 0x7f457c0603f0 2021-11-03T18:02:00.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.057+0000 7f4581d49700 1 -- 172.21.15.26:0/3325934379 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f457c0fef30 con 0x7f457c0603f0 2021-11-03T18:02:00.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.058+0000 7f4563fff700 1 -- 172.21.15.26:0/3325934379 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f456c052760 con 0x7f457c0603f0 2021-11-03T18:02:00.056 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:02:00.056 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:02:00.057 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:02:00.057 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:02:00.057 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:02:00.057 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:02:00.057 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:02:00.058 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:02:00.058 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:02:00.058 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:02:00.058 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:02:00.059 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:02:00.059 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:02:00.059 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:02:00.059 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:02:00.059 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:02:00.060 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:02:00.060 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:02:00.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.060+0000 7f4581d49700 1 -- 172.21.15.26:0/3325934379 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f45640640b0 msgr2=0x7f4564066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:02:00.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.060+0000 7f4581d49700 1 --2- 172.21.15.26:0/3325934379 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f45640640b0 0x7f4564066570 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f4570004e30 tx=0x7f4570009b30).stop 2021-11-03T18:02:00.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.060+0000 7f4581d49700 1 -- 172.21.15.26:0/3325934379 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f457c0603f0 msgr2=0x7f457c106f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:02:00.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.060+0000 7f4581d49700 1 --2- 172.21.15.26:0/3325934379 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f457c0603f0 0x7f457c106f90 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 rx=0x7f456c0093f0 tx=0x7f456c006ec0).stop 2021-11-03T18:02:00.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.060+0000 7f4581d49700 1 -- 172.21.15.26:0/3325934379 shutdown_connections 2021-11-03T18:02:00.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.060+0000 7f4581d49700 1 --2- 172.21.15.26:0/3325934379 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f45640640b0 0x7f4564066570 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:02:00.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.060+0000 7f4581d49700 1 --2- 172.21.15.26:0/3325934379 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f457c0603f0 0x7f457c106f90 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:02:00.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.060+0000 7f4581d49700 1 --2- 172.21.15.26:0/3325934379 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f457c0f9830 0x7f457c107480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:02:00.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.060+0000 7f4581d49700 1 -- 172.21.15.26:0/3325934379 >> 172.21.15.26:0/3325934379 conn(0x7f457c0f0dc0 msgr2=0x7f457c0f31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:02:00.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.060+0000 7f4581d49700 1 -- 172.21.15.26:0/3325934379 shutdown_connections 2021-11-03T18:02:00.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.060+0000 7f4581d49700 1 -- 172.21.15.26:0/3325934379 wait complete. 2021-11-03T18:02:00.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.159+0000 7f76dafb0700 1 -- 172.21.15.26:0/3095605739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76d40f5ef0 msgr2=0x7f76d40f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:02:00.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.159+0000 7f76dafb0700 1 --2- 172.21.15.26:0/3095605739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76d40f5ef0 0x7f76d40f6920 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 rx=0x7f76c0004660 tx=0x7f76c0009b30).stop 2021-11-03T18:02:00.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.160+0000 7f76dafb0700 1 -- 172.21.15.26:0/3095605739 shutdown_connections 2021-11-03T18:02:00.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.160+0000 7f76dafb0700 1 --2- 172.21.15.26:0/3095605739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76d40f5ef0 0x7f76d40f6920 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:02:00.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.160+0000 7f76dafb0700 1 --2- 172.21.15.26:0/3095605739 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76d40f55e0 0x7f76d40f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:02:00.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.160+0000 7f76dafb0700 1 -- 172.21.15.26:0/3095605739 >> 172.21.15.26:0/3095605739 conn(0x7f76d40f0de0 msgr2=0x7f76d40f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:02:00.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.160+0000 7f76dafb0700 1 -- 172.21.15.26:0/3095605739 shutdown_connections 2021-11-03T18:02:00.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.160+0000 7f76dafb0700 1 -- 172.21.15.26:0/3095605739 wait complete. 2021-11-03T18:02:00.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.160+0000 7f76dafb0700 1 Processor -- start 2021-11-03T18:02:00.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.160+0000 7f76dafb0700 1 -- start start 2021-11-03T18:02:00.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.160+0000 7f76dafb0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76d40f55e0 0x7f76d4106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:02:00.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.160+0000 7f76dafb0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76d40f5ef0 0x7f76d4107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:02:00.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.160+0000 7f76dafb0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d4107a00 con 0x7f76d40f5ef0 2021-11-03T18:02:00.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.160+0000 7f76dafb0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d4107b40 con 0x7f76d40f55e0 2021-11-03T18:02:00.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.161+0000 7f76d3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76d40f5ef0 0x7f76d4107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:02:00.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.161+0000 7f76d3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76d40f5ef0 0x7f76d4107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57768/0 (socket says 172.21.15.26:57768) 2021-11-03T18:02:00.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.161+0000 7f76d3fff700 1 -- 172.21.15.26:0/508838657 learned_addr learned my addr 172.21.15.26:0/508838657 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:02:00.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.161+0000 7f76d8d4c700 1 --2- 172.21.15.26:0/508838657 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76d40f55e0 0x7f76d4106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:02:00.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.161+0000 7f76d3fff700 1 -- 172.21.15.26:0/508838657 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76d40f55e0 msgr2=0x7f76d4106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:02:00.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.161+0000 7f76d3fff700 1 --2- 172.21.15.26:0/508838657 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76d40f55e0 0x7f76d4106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:02:00.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.161+0000 7f76d3fff700 1 -- 172.21.15.26:0/508838657 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c0005040 con 0x7f76d40f5ef0 2021-11-03T18:02:00.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.161+0000 7f76d8d4c700 1 --2- 172.21.15.26:0/508838657 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76d40f55e0 0x7f76d4106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:02:00.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.161+0000 7f76d3fff700 1 --2- 172.21.15.26:0/508838657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76d40f5ef0 0x7f76d4107450 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 rx=0x7f76c0009990 tx=0x7f76c0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:02:00.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.161+0000 7f76d17fa700 1 -- 172.21.15.26:0/508838657 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76c0018070 con 0x7f76d40f5ef0 2021-11-03T18:02:00.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.161+0000 7f76d17fa700 1 -- 172.21.15.26:0/508838657 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f76c0007ba0 con 0x7f76d40f5ef0 2021-11-03T18:02:00.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.161+0000 7f76dafb0700 1 -- 172.21.15.26:0/508838657 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76d4108480 con 0x7f76d40f5ef0 2021-11-03T18:02:00.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.161+0000 7f76d17fa700 1 -- 172.21.15.26:0/508838657 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76c001c3c0 con 0x7f76d40f5ef0 2021-11-03T18:02:00.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.161+0000 7f76dafb0700 1 -- 172.21.15.26:0/508838657 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76d41089e0 con 0x7f76d40f5ef0 2021-11-03T18:02:00.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.162+0000 7f76dafb0700 1 -- 172.21.15.26:0/508838657 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76d4045ad0 con 0x7f76d40f5ef0 2021-11-03T18:02:00.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.163+0000 7f76d17fa700 1 -- 172.21.15.26:0/508838657 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f76c001d420 con 0x7f76d40f5ef0 2021-11-03T18:02:00.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.163+0000 7f76d17fa700 1 --2- 172.21.15.26:0/508838657 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f76c40640b0 0x7f76c4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:02:00.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.163+0000 7f76d17fa700 1 -- 172.21.15.26:0/508838657 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f76c00825d0 con 0x7f76d40f5ef0 2021-11-03T18:02:00.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.163+0000 7f76d8d4c700 1 --2- 172.21.15.26:0/508838657 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f76c40640b0 0x7f76c4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:02:00.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.163+0000 7f76d8d4c700 1 --2- 172.21.15.26:0/508838657 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f76c40640b0 0x7f76c4066570 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f76c8009fd0 tx=0x7f76c800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:02:00.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.167+0000 7f76d17fa700 1 -- 172.21.15.26:0/508838657 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f76c0054990 con 0x7f76d40f5ef0 2021-11-03T18:02:00.372 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.374+0000 7f76dafb0700 1 -- 172.21.15.26:0/508838657 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f76d40fddd0 con 0x7f76d40f5ef0 2021-11-03T18:02:00.372 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.375+0000 7f76d17fa700 1 -- 172.21.15.26:0/508838657 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f76c0054580 con 0x7f76d40f5ef0 2021-11-03T18:02:00.373 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:02:00.373 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:02:00.373 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:02:00.373 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:02:00.374 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:02:00.374 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:02:00.374 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:02:00.374 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:02:00.374 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:02:00.375 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:02:00.375 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:02:00.375 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:02:00.376 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:02:00.376 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:02:00.376 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:02:00.376 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:02:00.376 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:02:00.377 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:02:00.377 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:02:00.377 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:02:00.377 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:02:00.378 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:02:00.378 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:02:00.378 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:02:00.378 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:02:00.379 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:02:00.379 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:02:00.379 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:02:00.379 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:02:00.379 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:02:00.380 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:02:00.380 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:02:00.380 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:02:00.380 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:02:00.380 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:02:00.381 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:02:00.381 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:02:00.381 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:02:00.381 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:02:00.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.376+0000 7f76dafb0700 1 -- 172.21.15.26:0/508838657 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f76c40640b0 msgr2=0x7f76c4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:02:00.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.376+0000 7f76dafb0700 1 --2- 172.21.15.26:0/508838657 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f76c40640b0 0x7f76c4066570 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f76c8009fd0 tx=0x7f76c800b040).stop 2021-11-03T18:02:00.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.376+0000 7f76dafb0700 1 -- 172.21.15.26:0/508838657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76d40f5ef0 msgr2=0x7f76d4107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:02:00.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.376+0000 7f76dafb0700 1 --2- 172.21.15.26:0/508838657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76d40f5ef0 0x7f76d4107450 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 rx=0x7f76c0009990 tx=0x7f76c0009b30).stop 2021-11-03T18:02:00.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.377+0000 7f76dafb0700 1 -- 172.21.15.26:0/508838657 shutdown_connections 2021-11-03T18:02:00.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.377+0000 7f76dafb0700 1 --2- 172.21.15.26:0/508838657 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f76c40640b0 0x7f76c4066570 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:02:00.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.377+0000 7f76dafb0700 1 --2- 172.21.15.26:0/508838657 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76d40f55e0 0x7f76d4106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:02:00.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.377+0000 7f76dafb0700 1 --2- 172.21.15.26:0/508838657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76d40f5ef0 0x7f76d4107450 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:02:00.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.377+0000 7f76dafb0700 1 -- 172.21.15.26:0/508838657 >> 172.21.15.26:0/508838657 conn(0x7f76d40f0de0 msgr2=0x7f76d405ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:02:00.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.377+0000 7f76dafb0700 1 -- 172.21.15.26:0/508838657 shutdown_connections 2021-11-03T18:02:00.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:00.377+0000 7f76dafb0700 1 -- 172.21.15.26:0/508838657 wait complete. 2021-11-03T18:02:00.385 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:02:00.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:00 smithi194 ceph-mon[65619]: from='client.36220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:02:00.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:00 smithi194 ceph-mon[65619]: pgmap v2020: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:00.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:00 smithi194 ceph-mon[65619]: from='client.36224 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:02:01.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:00 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3325934379' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:02:01.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:00 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/508838657' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:02:01.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:00 smithi026 ceph-mon[96795]: from='client.36220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:02:01.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:00 smithi026 ceph-mon[96795]: pgmap v2020: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:01.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:00 smithi026 ceph-mon[96795]: from='client.36224 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:02:01.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:00 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3325934379' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:02:01.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:00 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/508838657' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:02:02.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:02 smithi194 ceph-mon[65619]: pgmap v2021: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:03.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:02 smithi026 ceph-mon[96795]: pgmap v2021: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:04.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:04 smithi194 ceph-mon[65619]: pgmap v2022: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:05.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:04 smithi026 ceph-mon[96795]: pgmap v2022: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:06.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:06 smithi194 ceph-mon[65619]: pgmap v2023: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:07.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:06 smithi026 ceph-mon[96795]: pgmap v2023: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:08.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:08 smithi194 ceph-mon[65619]: pgmap v2024: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:09.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:08 smithi026 ceph-mon[96795]: pgmap v2024: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:09.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:09 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:02:09.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:09 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:02:10.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:09 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:02:10.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:09 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:02:10.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:10 smithi194 ceph-mon[65619]: pgmap v2025: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:11.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:10 smithi026 ceph-mon[96795]: pgmap v2025: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:12.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:12 smithi194 ceph-mon[65619]: pgmap v2026: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:13.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:12 smithi026 ceph-mon[96795]: pgmap v2026: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:14.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:14 smithi194 ceph-mon[65619]: pgmap v2027: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:15.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:14 smithi026 ceph-mon[96795]: pgmap v2027: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:16.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:16 smithi194 ceph-mon[65619]: pgmap v2028: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:17.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:16 smithi026 ceph-mon[96795]: pgmap v2028: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:18.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:18 smithi194 ceph-mon[65619]: pgmap v2029: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:19.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:18 smithi026 ceph-mon[96795]: pgmap v2029: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:20.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:20 smithi194 ceph-mon[65619]: pgmap v2030: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:21.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:20 smithi026 ceph-mon[96795]: pgmap v2030: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:22.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:22 smithi194 ceph-mon[65619]: pgmap v2031: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:23.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:22 smithi026 ceph-mon[96795]: pgmap v2031: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:23.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:23 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:02:24.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:23 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:02:24.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:24 smithi194 ceph-mon[65619]: pgmap v2032: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:24.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:24 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:02:25.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:24 smithi026 ceph-mon[96795]: pgmap v2032: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:25.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:24 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:02:26.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:26 smithi194 ceph-mon[65619]: pgmap v2033: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:27.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:26 smithi026 ceph-mon[96795]: pgmap v2033: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:28.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:28 smithi194 ceph-mon[65619]: pgmap v2034: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:29.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:28 smithi026 ceph-mon[96795]: pgmap v2034: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:30.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.492+0000 7f0222d2b700 1 -- 172.21.15.26:0/1126779763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f021c0f5ef0 msgr2=0x7f021c0f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:02:30.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.492+0000 7f0222d2b700 1 --2- 172.21.15.26:0/1126779763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f021c0f5ef0 0x7f021c0f6920 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 rx=0x7f0208004660 tx=0x7f0208009b30).stop 2021-11-03T18:02:30.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.492+0000 7f0222d2b700 1 -- 172.21.15.26:0/1126779763 shutdown_connections 2021-11-03T18:02:30.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.492+0000 7f0222d2b700 1 --2- 172.21.15.26:0/1126779763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f021c0f5ef0 0x7f021c0f6920 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:02:30.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.492+0000 7f0222d2b700 1 --2- 172.21.15.26:0/1126779763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f021c0f55e0 0x7f021c0f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:02:30.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.492+0000 7f0222d2b700 1 -- 172.21.15.26:0/1126779763 >> 172.21.15.26:0/1126779763 conn(0x7f021c0f0de0 msgr2=0x7f021c0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:02:30.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.493+0000 7f0222d2b700 1 -- 172.21.15.26:0/1126779763 shutdown_connections 2021-11-03T18:02:30.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.493+0000 7f0222d2b700 1 -- 172.21.15.26:0/1126779763 wait complete. 2021-11-03T18:02:30.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.493+0000 7f0222d2b700 1 Processor -- start 2021-11-03T18:02:30.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.493+0000 7f0222d2b700 1 -- start start 2021-11-03T18:02:30.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.493+0000 7f0222d2b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f021c0f55e0 0x7f021c105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:02:30.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.493+0000 7f0222d2b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f021c0f5ef0 0x7f021c1063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:02:30.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.494+0000 7f0222d2b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c106960 con 0x7f021c0f55e0 2021-11-03T18:02:30.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.494+0000 7f0222d2b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c107160 con 0x7f021c0f5ef0 2021-11-03T18:02:30.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.494+0000 7f0220ac7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f021c0f55e0 0x7f021c105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:02:30.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.494+0000 7f0220ac7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f021c0f55e0 0x7f021c105ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57784/0 (socket says 172.21.15.26:57784) 2021-11-03T18:02:30.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.494+0000 7f0220ac7700 1 -- 172.21.15.26:0/758593320 learned_addr learned my addr 172.21.15.26:0/758593320 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:02:30.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.494+0000 7f021bfff700 1 --2- 172.21.15.26:0/758593320 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f021c0f5ef0 0x7f021c1063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:02:30.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.494+0000 7f0220ac7700 1 -- 172.21.15.26:0/758593320 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f021c0f5ef0 msgr2=0x7f021c1063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:02:30.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.494+0000 7f0220ac7700 1 --2- 172.21.15.26:0/758593320 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f021c0f5ef0 0x7f021c1063b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:02:30.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.494+0000 7f0220ac7700 1 -- 172.21.15.26:0/758593320 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0208005040 con 0x7f021c0f55e0 2021-11-03T18:02:30.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.494+0000 7f0220ac7700 1 --2- 172.21.15.26:0/758593320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f021c0f55e0 0x7f021c105ec0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 rx=0x7f02100026d0 tx=0x7f0210009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:02:30.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.494+0000 7f02197fa700 1 -- 172.21.15.26:0/758593320 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02100079c0 con 0x7f021c0f55e0 2021-11-03T18:02:30.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.494+0000 7f02197fa700 1 -- 172.21.15.26:0/758593320 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f021000f040 con 0x7f021c0f55e0 2021-11-03T18:02:30.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.494+0000 7f0222d2b700 1 -- 172.21.15.26:0/758593320 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f021c107440 con 0x7f021c0f55e0 2021-11-03T18:02:30.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.494+0000 7f02197fa700 1 -- 172.21.15.26:0/758593320 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02100148b0 con 0x7f021c0f55e0 2021-11-03T18:02:30.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.494+0000 7f0222d2b700 1 -- 172.21.15.26:0/758593320 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f021c107a00 con 0x7f021c0f55e0 2021-11-03T18:02:30.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.495+0000 7f0222d2b700 1 -- 172.21.15.26:0/758593320 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f021c0f4a70 con 0x7f021c0f55e0 2021-11-03T18:02:30.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.496+0000 7f02197fa700 1 -- 172.21.15.26:0/758593320 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f0210007b20 con 0x7f021c0f55e0 2021-11-03T18:02:30.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.496+0000 7f02197fa700 1 --2- 172.21.15.26:0/758593320 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f020c0640b0 0x7f020c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:02:30.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.496+0000 7f02197fa700 1 -- 172.21.15.26:0/758593320 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f0210080730 con 0x7f021c0f55e0 2021-11-03T18:02:30.500 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.496+0000 7f021bfff700 1 --2- 172.21.15.26:0/758593320 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f020c0640b0 0x7f020c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:02:30.500 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.497+0000 7f021bfff700 1 --2- 172.21.15.26:0/758593320 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f020c0640b0 0x7f020c066570 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f0208004630 tx=0x7f0208009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:02:30.500 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.501+0000 7f02197fa700 1 -- 172.21.15.26:0/758593320 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f0210052a90 con 0x7f021c0f55e0 2021-11-03T18:02:30.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.679+0000 7f0222d2b700 1 -- 172.21.15.26:0/758593320 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f021c0fdf10 con 0x7f020c0640b0 2021-11-03T18:02:30.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.681+0000 7f02197fa700 1 -- 172.21.15.26:0/758593320 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f021c0fdf10 con 0x7f020c0640b0 2021-11-03T18:02:30.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.683+0000 7f0222d2b700 1 -- 172.21.15.26:0/758593320 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f020c0640b0 msgr2=0x7f020c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:02:30.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.683+0000 7f0222d2b700 1 --2- 172.21.15.26:0/758593320 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f020c0640b0 0x7f020c066570 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f0208004630 tx=0x7f0208009b30).stop 2021-11-03T18:02:30.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.683+0000 7f0222d2b700 1 -- 172.21.15.26:0/758593320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f021c0f55e0 msgr2=0x7f021c105ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:02:30.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.683+0000 7f0222d2b700 1 --2- 172.21.15.26:0/758593320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f021c0f55e0 0x7f021c105ec0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 rx=0x7f02100026d0 tx=0x7f0210009de0).stop 2021-11-03T18:02:30.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.683+0000 7f0222d2b700 1 -- 172.21.15.26:0/758593320 shutdown_connections 2021-11-03T18:02:30.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.683+0000 7f0222d2b700 1 --2- 172.21.15.26:0/758593320 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f020c0640b0 0x7f020c066570 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:02:30.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.683+0000 7f0222d2b700 1 --2- 172.21.15.26:0/758593320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f021c0f55e0 0x7f021c105ec0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:02:30.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.683+0000 7f0222d2b700 1 --2- 172.21.15.26:0/758593320 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f021c0f5ef0 0x7f021c1063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:02:30.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.683+0000 7f0222d2b700 1 -- 172.21.15.26:0/758593320 >> 172.21.15.26:0/758593320 conn(0x7f021c0f0de0 msgr2=0x7f021c0fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:02:30.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.683+0000 7f0222d2b700 1 -- 172.21.15.26:0/758593320 shutdown_connections 2021-11-03T18:02:30.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.683+0000 7f0222d2b700 1 -- 172.21.15.26:0/758593320 wait complete. 2021-11-03T18:02:30.689 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:02:30.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.785+0000 7f4762c95700 1 -- 172.21.15.26:0/2388813008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f475c0f66d0 msgr2=0x7f475c0f6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:02:30.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.785+0000 7f4762c95700 1 --2- 172.21.15.26:0/2388813008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f475c0f66d0 0x7f475c0f6af0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7f4750004660 tx=0x7f4750009b30).stop 2021-11-03T18:02:30.786 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.785+0000 7f4762c95700 1 -- 172.21.15.26:0/2388813008 shutdown_connections 2021-11-03T18:02:30.786 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.785+0000 7f4762c95700 1 --2- 172.21.15.26:0/2388813008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f475c0f7970 0x7f475c0f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:02:30.786 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.785+0000 7f4762c95700 1 --2- 172.21.15.26:0/2388813008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f475c0f66d0 0x7f475c0f6af0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:02:30.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.785+0000 7f4762c95700 1 -- 172.21.15.26:0/2388813008 >> 172.21.15.26:0/2388813008 conn(0x7f475c0f1e50 msgr2=0x7f475c0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:02:30.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.785+0000 7f4762c95700 1 -- 172.21.15.26:0/2388813008 shutdown_connections 2021-11-03T18:02:30.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.785+0000 7f4762c95700 1 -- 172.21.15.26:0/2388813008 wait complete. 2021-11-03T18:02:30.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.785+0000 7f4762c95700 1 Processor -- start 2021-11-03T18:02:30.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.786+0000 7f4762c95700 1 -- start start 2021-11-03T18:02:30.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.786+0000 7f4762c95700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f475c0f66d0 0x7f475c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:02:30.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.786+0000 7f4762c95700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f475c0f7970 0x7f475c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:02:30.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.786+0000 7f4762c95700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475c06a380 con 0x7f475c0f7970 2021-11-03T18:02:30.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.786+0000 7f4762c95700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475c06a4c0 con 0x7f475c0f66d0 2021-11-03T18:02:30.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.786+0000 7f475bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f475c0f7970 0x7f475c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:02:30.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.786+0000 7f475bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f475c0f7970 0x7f475c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57796/0 (socket says 172.21.15.26:57796) 2021-11-03T18:02:30.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.786+0000 7f475bfff700 1 -- 172.21.15.26:0/2806139487 learned_addr learned my addr 172.21.15.26:0/2806139487 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:02:30.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.786+0000 7f4760a31700 1 --2- 172.21.15.26:0/2806139487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f475c0f66d0 0x7f475c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:02:30.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.786+0000 7f475bfff700 1 -- 172.21.15.26:0/2806139487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f475c0f66d0 msgr2=0x7f475c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:02:30.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.786+0000 7f475bfff700 1 --2- 172.21.15.26:0/2806139487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f475c0f66d0 0x7f475c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:02:30.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.786+0000 7f475bfff700 1 -- 172.21.15.26:0/2806139487 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4750005040 con 0x7f475c0f7970 2021-11-03T18:02:30.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.786+0000 7f475bfff700 1 --2- 172.21.15.26:0/2806139487 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f475c0f7970 0x7f475c069e20 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 rx=0x7f47480026d0 tx=0x7f4748009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:02:30.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.787+0000 7f47597fa700 1 -- 172.21.15.26:0/2806139487 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47480079c0 con 0x7f475c0f7970 2021-11-03T18:02:30.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.787+0000 7f47597fa700 1 -- 172.21.15.26:0/2806139487 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f474800f040 con 0x7f475c0f7970 2021-11-03T18:02:30.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.787+0000 7f47597fa700 1 -- 172.21.15.26:0/2806139487 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47480148b0 con 0x7f475c0f7970 2021-11-03T18:02:30.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.787+0000 7f4762c95700 1 -- 172.21.15.26:0/2806139487 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f475c06a7a0 con 0x7f475c0f7970 2021-11-03T18:02:30.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.787+0000 7f4762c95700 1 -- 172.21.15.26:0/2806139487 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f475c10efb0 con 0x7f475c0f7970 2021-11-03T18:02:30.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.788+0000 7f4762c95700 1 -- 172.21.15.26:0/2806139487 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f475c045ad0 con 0x7f475c0f7970 2021-11-03T18:02:30.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.788+0000 7f47597fa700 1 -- 172.21.15.26:0/2806139487 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f4748007b20 con 0x7f475c0f7970 2021-11-03T18:02:30.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.789+0000 7f47597fa700 1 --2- 172.21.15.26:0/2806139487 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f474c0640b0 0x7f474c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:02:30.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.789+0000 7f47597fa700 1 -- 172.21.15.26:0/2806139487 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f4748080740 con 0x7f475c0f7970 2021-11-03T18:02:30.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.789+0000 7f4760a31700 1 --2- 172.21.15.26:0/2806139487 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f474c0640b0 0x7f474c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:02:30.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.789+0000 7f4760a31700 1 --2- 172.21.15.26:0/2806139487 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f474c0640b0 0x7f474c066570 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f4750013690 tx=0x7f4750009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:02:30.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.793+0000 7f47597fa700 1 -- 172.21.15.26:0/2806139487 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f4748052aa0 con 0x7f475c0f7970 2021-11-03T18:02:30.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.963+0000 7f4762c95700 1 -- 172.21.15.26:0/2806139487 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f475c0ff040 con 0x7f474c0640b0 2021-11-03T18:02:30.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.978+0000 7f47597fa700 1 -- 172.21.15.26:0/2806139487 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f4750019040 con 0x7f474c0640b0 2021-11-03T18:02:30.975 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:02:30.975 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (73m) 2m ago 75m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:02:30.976 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (65m) 2m ago 74m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:02:30.976 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (65m) 98s ago 74m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:02:30.976 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (73m) 2m ago 74m 41.7M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:02:30.976 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (66m) 2m ago 70m 25.6M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:02:30.977 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (67m) 2m ago 70m 26.2M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:02:30.977 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (70m) 98s ago 70m 26.4M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:02:30.977 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (70m) 98s ago 70m 26.8M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:02:30.977 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (67m) 2m ago 76m 561M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:02:30.978 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (67m) 98s ago 74m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:02:30.978 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (66m) 2m ago 76m 276M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:02:30.978 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (66m) 98s ago 74m 132M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:02:30.978 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (74m) 2m ago 74m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:02:30.978 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (73m) 98s ago 73m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:02:30.979 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (65m) 2m ago 73m 292M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:02:30.979 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (65m) 2m ago 73m 313M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:02:30.979 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (64m) 2m ago 72m 261M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:02:30.979 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (64m) 98s ago 72m 337M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:02:30.980 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (63m) 98s ago 72m 283M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:02:30.980 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (63m) 98s ago 71m 276M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:02:30.980 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (73m) 2m ago 74m 61.2M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:02:30.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.980+0000 7f4762c95700 1 -- 172.21.15.26:0/2806139487 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f474c0640b0 msgr2=0x7f474c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:02:30.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.980+0000 7f4762c95700 1 --2- 172.21.15.26:0/2806139487 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f474c0640b0 0x7f474c066570 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f4750013690 tx=0x7f4750009b30).stop 2021-11-03T18:02:30.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.980+0000 7f4762c95700 1 -- 172.21.15.26:0/2806139487 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f475c0f7970 msgr2=0x7f475c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:02:30.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.980+0000 7f4762c95700 1 --2- 172.21.15.26:0/2806139487 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f475c0f7970 0x7f475c069e20 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 rx=0x7f47480026d0 tx=0x7f4748009de0).stop 2021-11-03T18:02:30.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.980+0000 7f4762c95700 1 -- 172.21.15.26:0/2806139487 shutdown_connections 2021-11-03T18:02:30.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.980+0000 7f4762c95700 1 --2- 172.21.15.26:0/2806139487 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f474c0640b0 0x7f474c066570 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:02:30.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.980+0000 7f4762c95700 1 --2- 172.21.15.26:0/2806139487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f475c0f66d0 0x7f475c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:02:30.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.980+0000 7f4762c95700 1 --2- 172.21.15.26:0/2806139487 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f475c0f7970 0x7f475c069e20 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:02:30.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.980+0000 7f4762c95700 1 -- 172.21.15.26:0/2806139487 >> 172.21.15.26:0/2806139487 conn(0x7f475c0f1e50 msgr2=0x7f475c0fb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:02:30.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.980+0000 7f4762c95700 1 -- 172.21.15.26:0/2806139487 shutdown_connections 2021-11-03T18:02:30.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:30.980+0000 7f4762c95700 1 -- 172.21.15.26:0/2806139487 wait complete. 2021-11-03T18:02:30.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:30 smithi194 ceph-mon[65619]: pgmap v2035: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:31.078 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.080+0000 7f7ba3f1c700 1 -- 172.21.15.26:0/2011619923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7b9c0f6860 msgr2=0x7f7b9c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:02:31.078 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.080+0000 7f7ba3f1c700 1 --2- 172.21.15.26:0/2011619923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7b9c0f6860 0x7f7b9c0f6cc0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 rx=0x7f7b8c004660 tx=0x7f7b8c009b30).stop 2021-11-03T18:02:31.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.080+0000 7f7ba3f1c700 1 -- 172.21.15.26:0/2011619923 shutdown_connections 2021-11-03T18:02:31.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.080+0000 7f7ba3f1c700 1 --2- 172.21.15.26:0/2011619923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7b9c0f6860 0x7f7b9c0f6cc0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:02:31.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.080+0000 7f7ba3f1c700 1 --2- 172.21.15.26:0/2011619923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b9c0f55c0 0x7f7b9c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:02:31.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.080+0000 7f7ba3f1c700 1 -- 172.21.15.26:0/2011619923 >> 172.21.15.26:0/2011619923 conn(0x7f7b9c0f0d40 msgr2=0x7f7b9c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:02:31.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.080+0000 7f7ba3f1c700 1 -- 172.21.15.26:0/2011619923 shutdown_connections 2021-11-03T18:02:31.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.080+0000 7f7ba3f1c700 1 -- 172.21.15.26:0/2011619923 wait complete. 2021-11-03T18:02:31.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.080+0000 7f7ba3f1c700 1 Processor -- start 2021-11-03T18:02:31.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.080+0000 7f7ba3f1c700 1 -- start start 2021-11-03T18:02:31.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.081+0000 7f7ba3f1c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b9c0f55c0 0x7f7b9c10c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:02:31.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.081+0000 7f7ba3f1c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7b9c0f6860 0x7f7b9c10e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:02:31.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.081+0000 7f7ba3f1c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c0602b0 con 0x7f7b9c0f6860 2021-11-03T18:02:31.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.081+0000 7f7ba3f1c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c0603f0 con 0x7f7b9c0f55c0 2021-11-03T18:02:31.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.081+0000 7f7ba14b7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7b9c0f6860 0x7f7b9c10e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:02:31.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.081+0000 7f7ba14b7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7b9c0f6860 0x7f7b9c10e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57806/0 (socket says 172.21.15.26:57806) 2021-11-03T18:02:31.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.081+0000 7f7ba14b7700 1 -- 172.21.15.26:0/3165151292 learned_addr learned my addr 172.21.15.26:0/3165151292 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:02:31.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.081+0000 7f7ba14b7700 1 -- 172.21.15.26:0/3165151292 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b9c0f55c0 msgr2=0x7f7b9c10c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:02:31.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.081+0000 7f7ba14b7700 1 --2- 172.21.15.26:0/3165151292 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b9c0f55c0 0x7f7b9c10c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:02:31.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.081+0000 7f7ba14b7700 1 -- 172.21.15.26:0/3165151292 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b8c005040 con 0x7f7b9c0f6860 2021-11-03T18:02:31.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.081+0000 7f7ba14b7700 1 --2- 172.21.15.26:0/3165151292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7b9c0f6860 0x7f7b9c10e570 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 rx=0x7f7b8c009990 tx=0x7f7b8c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:02:31.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.081+0000 7f7b927fc700 1 -- 172.21.15.26:0/3165151292 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b8c018070 con 0x7f7b9c0f6860 2021-11-03T18:02:31.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.081+0000 7f7b927fc700 1 -- 172.21.15.26:0/3165151292 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7b8c007ba0 con 0x7f7b9c0f6860 2021-11-03T18:02:31.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.081+0000 7f7ba3f1c700 1 -- 172.21.15.26:0/3165151292 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b9c10ea60 con 0x7f7b9c0f6860 2021-11-03T18:02:31.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.081+0000 7f7b927fc700 1 -- 172.21.15.26:0/3165151292 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b8c01c3c0 con 0x7f7b9c0f6860 2021-11-03T18:02:31.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.081+0000 7f7ba3f1c700 1 -- 172.21.15.26:0/3165151292 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b9c10ee30 con 0x7f7b9c0f6860 2021-11-03T18:02:31.085 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.082+0000 7f7ba3f1c700 1 -- 172.21.15.26:0/3165151292 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b9c0f49b0 con 0x7f7b9c0f6860 2021-11-03T18:02:31.085 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.083+0000 7f7b927fc700 1 -- 172.21.15.26:0/3165151292 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f7b8c01d420 con 0x7f7b9c0f6860 2021-11-03T18:02:31.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.083+0000 7f7b927fc700 1 --2- 172.21.15.26:0/3165151292 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7b880640b0 0x7f7b88066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:02:31.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.083+0000 7f7b927fc700 1 -- 172.21.15.26:0/3165151292 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f7b8c0824e0 con 0x7f7b9c0f6860 2021-11-03T18:02:31.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.083+0000 7f7ba1cb8700 1 --2- 172.21.15.26:0/3165151292 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7b880640b0 0x7f7b88066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:02:31.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.083+0000 7f7ba1cb8700 1 --2- 172.21.15.26:0/3165151292 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7b880640b0 0x7f7b88066570 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f7b9c060040 tx=0x7f7b980099e0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:02:31.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.087+0000 7f7b927fc700 1 -- 172.21.15.26:0/3165151292 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f7b8c0548a0 con 0x7f7b9c0f6860 2021-11-03T18:02:31.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:30 smithi026 ceph-mon[96795]: pgmap v2035: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:31.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.316+0000 7f7ba3f1c700 1 -- 172.21.15.26:0/3165151292 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7b9c0fde50 con 0x7f7b9c0f6860 2021-11-03T18:02:31.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.316+0000 7f7b927fc700 1 -- 172.21.15.26:0/3165151292 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f7b8c054490 con 0x7f7b9c0f6860 2021-11-03T18:02:31.313 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:02:31.314 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:02:31.314 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:02:31.314 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:02:31.314 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:02:31.315 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:02:31.315 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:02:31.315 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:02:31.316 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:02:31.316 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:02:31.317 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:02:31.317 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:02:31.317 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:02:31.317 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:02:31.317 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:02:31.318 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:02:31.318 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:02:31.318 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:02:31.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.318+0000 7f7ba3f1c700 1 -- 172.21.15.26:0/3165151292 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7b880640b0 msgr2=0x7f7b88066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:02:31.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.318+0000 7f7ba3f1c700 1 --2- 172.21.15.26:0/3165151292 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7b880640b0 0x7f7b88066570 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f7b9c060040 tx=0x7f7b980099e0).stop 2021-11-03T18:02:31.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.318+0000 7f7ba3f1c700 1 -- 172.21.15.26:0/3165151292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7b9c0f6860 msgr2=0x7f7b9c10e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:02:31.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.318+0000 7f7ba3f1c700 1 --2- 172.21.15.26:0/3165151292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7b9c0f6860 0x7f7b9c10e570 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 rx=0x7f7b8c009990 tx=0x7f7b8c009b30).stop 2021-11-03T18:02:31.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.318+0000 7f7ba3f1c700 1 -- 172.21.15.26:0/3165151292 shutdown_connections 2021-11-03T18:02:31.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.318+0000 7f7ba3f1c700 1 --2- 172.21.15.26:0/3165151292 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7b880640b0 0x7f7b88066570 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:02:31.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.318+0000 7f7ba3f1c700 1 --2- 172.21.15.26:0/3165151292 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b9c0f55c0 0x7f7b9c10c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:02:31.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.318+0000 7f7ba3f1c700 1 --2- 172.21.15.26:0/3165151292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7b9c0f6860 0x7f7b9c10e570 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:02:31.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.318+0000 7f7ba3f1c700 1 -- 172.21.15.26:0/3165151292 >> 172.21.15.26:0/3165151292 conn(0x7f7b9c0f0d40 msgr2=0x7f7b9c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:02:31.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.318+0000 7f7ba3f1c700 1 -- 172.21.15.26:0/3165151292 shutdown_connections 2021-11-03T18:02:31.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.318+0000 7f7ba3f1c700 1 -- 172.21.15.26:0/3165151292 wait complete. 2021-11-03T18:02:31.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.418+0000 7f5b7dc10700 1 -- 172.21.15.26:0/208561763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b780f6860 msgr2=0x7f5b780f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:02:31.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.418+0000 7f5b7dc10700 1 --2- 172.21.15.26:0/208561763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b780f6860 0x7f5b780f6cc0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7f5b60004660 tx=0x7f5b60009b30).stop 2021-11-03T18:02:31.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.418+0000 7f5b7dc10700 1 -- 172.21.15.26:0/208561763 shutdown_connections 2021-11-03T18:02:31.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.418+0000 7f5b7dc10700 1 --2- 172.21.15.26:0/208561763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b780f6860 0x7f5b780f6cc0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:02:31.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.418+0000 7f5b7dc10700 1 --2- 172.21.15.26:0/208561763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b780f55c0 0x7f5b780f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:02:31.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.418+0000 7f5b7dc10700 1 -- 172.21.15.26:0/208561763 >> 172.21.15.26:0/208561763 conn(0x7f5b780f0d40 msgr2=0x7f5b780f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:02:31.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.418+0000 7f5b7dc10700 1 -- 172.21.15.26:0/208561763 shutdown_connections 2021-11-03T18:02:31.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.418+0000 7f5b7dc10700 1 -- 172.21.15.26:0/208561763 wait complete. 2021-11-03T18:02:31.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.418+0000 7f5b7dc10700 1 Processor -- start 2021-11-03T18:02:31.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.419+0000 7f5b7dc10700 1 -- start start 2021-11-03T18:02:31.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.419+0000 7f5b7dc10700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b780f55c0 0x7f5b7810c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:02:31.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.419+0000 7f5b7dc10700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b780f6860 0x7f5b7810e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:02:31.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.419+0000 7f5b7dc10700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b780602b0 con 0x7f5b780f6860 2021-11-03T18:02:31.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.419+0000 7f5b7dc10700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b780603f0 con 0x7f5b780f55c0 2021-11-03T18:02:31.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.419+0000 7f5b76ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b780f6860 0x7f5b7810e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:02:31.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.419+0000 7f5b76ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b780f6860 0x7f5b7810e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57816/0 (socket says 172.21.15.26:57816) 2021-11-03T18:02:31.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.419+0000 7f5b76ffd700 1 -- 172.21.15.26:0/657795664 learned_addr learned my addr 172.21.15.26:0/657795664 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:02:31.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.419+0000 7f5b777fe700 1 --2- 172.21.15.26:0/657795664 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b780f55c0 0x7f5b7810c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:02:31.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.419+0000 7f5b76ffd700 1 -- 172.21.15.26:0/657795664 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b780f55c0 msgr2=0x7f5b7810c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:02:31.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.419+0000 7f5b76ffd700 1 --2- 172.21.15.26:0/657795664 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b780f55c0 0x7f5b7810c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:02:31.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.419+0000 7f5b76ffd700 1 -- 172.21.15.26:0/657795664 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b60005040 con 0x7f5b780f6860 2021-11-03T18:02:31.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.419+0000 7f5b777fe700 1 --2- 172.21.15.26:0/657795664 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b780f55c0 0x7f5b7810c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:02:31.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.419+0000 7f5b76ffd700 1 --2- 172.21.15.26:0/657795664 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b780f6860 0x7f5b7810e570 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7f5b60009990 tx=0x7f5b60009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:02:31.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.420+0000 7f5b6ffff700 1 -- 172.21.15.26:0/657795664 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b60018070 con 0x7f5b780f6860 2021-11-03T18:02:31.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.420+0000 7f5b6ffff700 1 -- 172.21.15.26:0/657795664 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5b60007ba0 con 0x7f5b780f6860 2021-11-03T18:02:31.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.420+0000 7f5b7dc10700 1 -- 172.21.15.26:0/657795664 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b7810ea60 con 0x7f5b780f6860 2021-11-03T18:02:31.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.420+0000 7f5b6ffff700 1 -- 172.21.15.26:0/657795664 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b6001c3c0 con 0x7f5b780f6860 2021-11-03T18:02:31.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.420+0000 7f5b7dc10700 1 -- 172.21.15.26:0/657795664 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b7810ee30 con 0x7f5b780f6860 2021-11-03T18:02:31.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.421+0000 7f5b7dc10700 1 -- 172.21.15.26:0/657795664 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b78045ad0 con 0x7f5b780f6860 2021-11-03T18:02:31.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.421+0000 7f5b6ffff700 1 -- 172.21.15.26:0/657795664 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f5b6001d420 con 0x7f5b780f6860 2021-11-03T18:02:31.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.421+0000 7f5b6ffff700 1 --2- 172.21.15.26:0/657795664 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5b640640b0 0x7f5b64066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:02:31.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.422+0000 7f5b6ffff700 1 -- 172.21.15.26:0/657795664 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f5b600825b0 con 0x7f5b780f6860 2021-11-03T18:02:31.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.422+0000 7f5b777fe700 1 --2- 172.21.15.26:0/657795664 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5b640640b0 0x7f5b64066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:02:31.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.422+0000 7f5b777fe700 1 --2- 172.21.15.26:0/657795664 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5b640640b0 0x7f5b64066570 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f5b78060040 tx=0x7f5b70009c00).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:02:31.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.426+0000 7f5b6ffff700 1 -- 172.21.15.26:0/657795664 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f5b60054970 con 0x7f5b780f6860 2021-11-03T18:02:31.626 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.629+0000 7f5b7dc10700 1 -- 172.21.15.26:0/657795664 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5b78027a00 con 0x7f5b780f6860 2021-11-03T18:02:31.627 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.630+0000 7f5b6ffff700 1 -- 172.21.15.26:0/657795664 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f5b60054560 con 0x7f5b780f6860 2021-11-03T18:02:31.627 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:02:31.627 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:02:31.628 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:02:31.628 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:02:31.628 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:02:31.628 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:02:31.629 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:02:31.629 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:02:31.629 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:02:31.629 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:02:31.629 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:02:31.630 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:02:31.630 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:02:31.630 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:02:31.630 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:02:31.631 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:02:31.631 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:02:31.631 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:02:31.631 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:02:31.631 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:02:31.632 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:02:31.632 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:02:31.632 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:02:31.632 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:02:31.633 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:02:31.633 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:02:31.633 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:02:31.633 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:02:31.633 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:02:31.634 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:02:31.634 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:02:31.634 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:02:31.634 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:02:31.635 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:02:31.635 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:02:31.635 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:02:31.635 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:02:31.635 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:02:31.636 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:02:31.637 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.632+0000 7f5b7dc10700 1 -- 172.21.15.26:0/657795664 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5b640640b0 msgr2=0x7f5b64066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:02:31.637 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.632+0000 7f5b7dc10700 1 --2- 172.21.15.26:0/657795664 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5b640640b0 0x7f5b64066570 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f5b78060040 tx=0x7f5b70009c00).stop 2021-11-03T18:02:31.637 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.632+0000 7f5b7dc10700 1 -- 172.21.15.26:0/657795664 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b780f6860 msgr2=0x7f5b7810e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:02:31.638 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.632+0000 7f5b7dc10700 1 --2- 172.21.15.26:0/657795664 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b780f6860 0x7f5b7810e570 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7f5b60009990 tx=0x7f5b60009b30).stop 2021-11-03T18:02:31.638 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.632+0000 7f5b7dc10700 1 -- 172.21.15.26:0/657795664 shutdown_connections 2021-11-03T18:02:31.638 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.632+0000 7f5b7dc10700 1 --2- 172.21.15.26:0/657795664 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5b640640b0 0x7f5b64066570 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:02:31.638 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.632+0000 7f5b7dc10700 1 --2- 172.21.15.26:0/657795664 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b780f55c0 0x7f5b7810c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:02:31.638 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.632+0000 7f5b7dc10700 1 --2- 172.21.15.26:0/657795664 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b780f6860 0x7f5b7810e570 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:02:31.639 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.632+0000 7f5b7dc10700 1 -- 172.21.15.26:0/657795664 >> 172.21.15.26:0/657795664 conn(0x7f5b780f0d40 msgr2=0x7f5b780fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:02:31.639 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.632+0000 7f5b7dc10700 1 -- 172.21.15.26:0/657795664 shutdown_connections 2021-11-03T18:02:31.639 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:02:31.632+0000 7f5b7dc10700 1 -- 172.21.15.26:0/657795664 wait complete. 2021-11-03T18:02:31.639 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:02:31.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:31 smithi194 ceph-mon[65619]: from='client.36236 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:02:31.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:31 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3165151292' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:02:32.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:31 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/657795664' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:02:32.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:31 smithi026 ceph-mon[96795]: from='client.36236 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:02:32.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:31 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3165151292' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:02:32.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:31 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/657795664' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:02:32.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:32 smithi194 ceph-mon[65619]: from='client.36240 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:02:32.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:32 smithi194 ceph-mon[65619]: pgmap v2036: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:33.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:32 smithi026 ceph-mon[96795]: from='client.36240 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:02:33.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:32 smithi026 ceph-mon[96795]: pgmap v2036: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:34.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:34 smithi194 ceph-mon[65619]: pgmap v2037: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:35.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:34 smithi026 ceph-mon[96795]: pgmap v2037: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:36.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:36 smithi194 ceph-mon[65619]: pgmap v2038: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:37.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:36 smithi026 ceph-mon[96795]: pgmap v2038: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:39.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:38 smithi026 ceph-mon[96795]: pgmap v2039: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:39.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:38 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:02:39.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:38 smithi194 ceph-mon[65619]: pgmap v2039: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:39.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:38 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:02:40.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:39 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:02:40.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:39 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:02:41.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:40 smithi026 ceph-mon[96795]: pgmap v2040: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:41.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:40 smithi194 ceph-mon[65619]: pgmap v2040: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:43.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:42 smithi026 ceph-mon[96795]: pgmap v2041: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:43.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:42 smithi194 ceph-mon[65619]: pgmap v2041: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:45.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:44 smithi026 ceph-mon[96795]: pgmap v2042: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:45.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:44 smithi194 ceph-mon[65619]: pgmap v2042: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:47.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:46 smithi026 ceph-mon[96795]: pgmap v2043: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:47.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:46 smithi194 ceph-mon[65619]: pgmap v2043: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:49.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:48 smithi026 ceph-mon[96795]: pgmap v2044: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:49.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:02:49.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:02:49.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:48 smithi194 ceph-mon[65619]: pgmap v2044: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:49.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:02:49.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:02:51.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:50 smithi026 ceph-mon[96795]: pgmap v2045: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:51.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:50 smithi194 ceph-mon[65619]: pgmap v2045: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:53.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:52 smithi026 ceph-mon[96795]: pgmap v2046: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:53.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:52 smithi194 ceph-mon[65619]: pgmap v2046: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:54.097 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:53 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:02:54.130 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:53 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:02:55.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:54 smithi026 ceph-mon[96795]: pgmap v2047: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:55.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:54 smithi026 ceph-mon[96795]: poll took 60082.907 ms: 1 events 2021-11-03T18:02:55.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:02:55.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:02:55.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:02:55.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:02:55.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:02:55.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:02:55.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:02:55.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:54 smithi194 ceph-mon[65619]: pgmap v2047: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:55.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:54 smithi194 ceph-mon[65619]: poll took 60082.907 ms: 1 events 2021-11-03T18:02:55.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:02:55.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:02:55.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:02:55.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:02:55.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:02:55.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:02:55.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:02:55.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:55 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:02:55.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:55 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:02:56.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:55 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:02:56.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:55 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:02:57.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:56 smithi026 ceph-mon[96795]: pgmap v2048: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:57.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:56 smithi194 ceph-mon[65619]: pgmap v2048: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:59.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:02:58 smithi026 ceph-mon[96795]: pgmap v2049: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:02:59.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:02:58 smithi194 ceph-mon[65619]: pgmap v2049: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:01.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:00 smithi026 ceph-mon[96795]: pgmap v2050: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:01.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:00 smithi194 ceph-mon[65619]: pgmap v2050: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:01.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.746+0000 7f021b79a700 1 -- 172.21.15.26:0/1512679437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02140602d0 msgr2=0x7f02140f92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:03:01.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.746+0000 7f021b79a700 1 --2- 172.21.15.26:0/1512679437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02140602d0 0x7f02140f92e0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 rx=0x7f020c0099e0 tx=0x7f020c004d10).stop 2021-11-03T18:03:01.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.746+0000 7f021b79a700 1 -- 172.21.15.26:0/1512679437 shutdown_connections 2021-11-03T18:03:01.747 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.746+0000 7f021b79a700 1 --2- 172.21.15.26:0/1512679437 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02140f9860 0x7f02140fbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:01.747 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.746+0000 7f021b79a700 1 --2- 172.21.15.26:0/1512679437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02140602d0 0x7f02140f92e0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:01.747 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.746+0000 7f021b79a700 1 -- 172.21.15.26:0/1512679437 >> 172.21.15.26:0/1512679437 conn(0x7f02140f0d40 msgr2=0x7f02140f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:03:01.747 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.746+0000 7f021b79a700 1 -- 172.21.15.26:0/1512679437 shutdown_connections 2021-11-03T18:03:01.747 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.746+0000 7f021b79a700 1 -- 172.21.15.26:0/1512679437 wait complete. 2021-11-03T18:03:01.748 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.747+0000 7f021b79a700 1 Processor -- start 2021-11-03T18:03:01.748 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.747+0000 7f021b79a700 1 -- start start 2021-11-03T18:03:01.748 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.747+0000 7f021b79a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02140602d0 0x7f02140f6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:03:01.748 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.747+0000 7f021b79a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02140f9860 0x7f02140f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:03:01.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.747+0000 7f021b79a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02140f5740 con 0x7f02140f9860 2021-11-03T18:03:01.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.747+0000 7f021b79a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02140f5880 con 0x7f02140602d0 2021-11-03T18:03:01.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.747+0000 7f0218d35700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02140f9860 0x7f02140f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:03:01.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.747+0000 7f0218d35700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02140f9860 0x7f02140f51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57834/0 (socket says 172.21.15.26:57834) 2021-11-03T18:03:01.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.747+0000 7f0218d35700 1 -- 172.21.15.26:0/2277466372 learned_addr learned my addr 172.21.15.26:0/2277466372 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:03:01.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.747+0000 7f0219536700 1 --2- 172.21.15.26:0/2277466372 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02140602d0 0x7f02140f6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:03:01.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.747+0000 7f0218d35700 1 -- 172.21.15.26:0/2277466372 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02140602d0 msgr2=0x7f02140f6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:03:01.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.747+0000 7f0218d35700 1 --2- 172.21.15.26:0/2277466372 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02140602d0 0x7f02140f6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:01.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.747+0000 7f0218d35700 1 -- 172.21.15.26:0/2277466372 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020c009640 con 0x7f02140f9860 2021-11-03T18:03:01.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.747+0000 7f0219536700 1 --2- 172.21.15.26:0/2277466372 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02140602d0 0x7f02140f6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:03:01.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.747+0000 7f0218d35700 1 --2- 172.21.15.26:0/2277466372 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02140f9860 0x7f02140f51e0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7f020400c510 tx=0x7f0204007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:03:01.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.748+0000 7f0209ffb700 1 -- 172.21.15.26:0/2277466372 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f020400f650 con 0x7f02140f9860 2021-11-03T18:03:01.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.748+0000 7f0209ffb700 1 -- 172.21.15.26:0/2277466372 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f020400fc60 con 0x7f02140f9860 2021-11-03T18:03:01.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.748+0000 7f021b79a700 1 -- 172.21.15.26:0/2277466372 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02140f5b60 con 0x7f02140f9860 2021-11-03T18:03:01.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.748+0000 7f0209ffb700 1 -- 172.21.15.26:0/2277466372 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0204012cd0 con 0x7f02140f9860 2021-11-03T18:03:01.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.748+0000 7f021b79a700 1 -- 172.21.15.26:0/2277466372 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f021410f050 con 0x7f02140f9860 2021-11-03T18:03:01.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.749+0000 7f021b79a700 1 -- 172.21.15.26:0/2277466372 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0214045ad0 con 0x7f02140f9860 2021-11-03T18:03:01.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.749+0000 7f0209ffb700 1 -- 172.21.15.26:0/2277466372 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f0204010070 con 0x7f02140f9860 2021-11-03T18:03:01.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.750+0000 7f0209ffb700 1 --2- 172.21.15.26:0/2277466372 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f02000640b0 0x7f0200066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:03:01.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.750+0000 7f0209ffb700 1 -- 172.21.15.26:0/2277466372 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f02040806f0 con 0x7f02140f9860 2021-11-03T18:03:01.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.750+0000 7f0219536700 1 --2- 172.21.15.26:0/2277466372 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f02000640b0 0x7f0200066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:03:01.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.750+0000 7f0219536700 1 --2- 172.21.15.26:0/2277466372 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f02000640b0 0x7f0200066570 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f020c009f50 tx=0x7f020c004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:03:01.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.754+0000 7f0209ffb700 1 -- 172.21.15.26:0/2277466372 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f0204052a20 con 0x7f02140f9860 2021-11-03T18:03:01.932 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.934+0000 7f021b79a700 1 -- 172.21.15.26:0/2277466372 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f02140fefb0 con 0x7f02000640b0 2021-11-03T18:03:01.933 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.935+0000 7f0209ffb700 1 -- 172.21.15.26:0/2277466372 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f02140fefb0 con 0x7f02000640b0 2021-11-03T18:03:01.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.937+0000 7f021b79a700 1 -- 172.21.15.26:0/2277466372 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f02000640b0 msgr2=0x7f0200066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:03:01.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.937+0000 7f021b79a700 1 --2- 172.21.15.26:0/2277466372 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f02000640b0 0x7f0200066570 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f020c009f50 tx=0x7f020c004d10).stop 2021-11-03T18:03:01.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.937+0000 7f021b79a700 1 -- 172.21.15.26:0/2277466372 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02140f9860 msgr2=0x7f02140f51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:03:01.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.937+0000 7f021b79a700 1 --2- 172.21.15.26:0/2277466372 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02140f9860 0x7f02140f51e0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7f020400c510 tx=0x7f0204007df0).stop 2021-11-03T18:03:01.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.937+0000 7f021b79a700 1 -- 172.21.15.26:0/2277466372 shutdown_connections 2021-11-03T18:03:01.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.937+0000 7f021b79a700 1 --2- 172.21.15.26:0/2277466372 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f02000640b0 0x7f0200066570 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:01.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.937+0000 7f021b79a700 1 --2- 172.21.15.26:0/2277466372 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02140602d0 0x7f02140f6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:01.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.937+0000 7f021b79a700 1 --2- 172.21.15.26:0/2277466372 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02140f9860 0x7f02140f51e0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:01.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.937+0000 7f021b79a700 1 -- 172.21.15.26:0/2277466372 >> 172.21.15.26:0/2277466372 conn(0x7f02140f0d40 msgr2=0x7f02140f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:03:01.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.937+0000 7f021b79a700 1 -- 172.21.15.26:0/2277466372 shutdown_connections 2021-11-03T18:03:01.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:01.937+0000 7f021b79a700 1 -- 172.21.15.26:0/2277466372 wait complete. 2021-11-03T18:03:01.944 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:03:02.035 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.036+0000 7fe87ef57700 1 -- 172.21.15.26:0/743668975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8780f6860 msgr2=0x7fe8780f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:03:02.035 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.037+0000 7fe87ef57700 1 --2- 172.21.15.26:0/743668975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8780f6860 0x7fe8780f6cc0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7fe86c004660 tx=0x7fe86c009b30).stop 2021-11-03T18:03:02.035 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.037+0000 7fe87ef57700 1 -- 172.21.15.26:0/743668975 shutdown_connections 2021-11-03T18:03:02.035 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.037+0000 7fe87ef57700 1 --2- 172.21.15.26:0/743668975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8780f6860 0x7fe8780f6cc0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:02.036 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.037+0000 7fe87ef57700 1 --2- 172.21.15.26:0/743668975 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8780f55c0 0x7fe8780f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:02.036 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.037+0000 7fe87ef57700 1 -- 172.21.15.26:0/743668975 >> 172.21.15.26:0/743668975 conn(0x7fe8780f0d20 msgr2=0x7fe8780f3140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:03:02.036 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.037+0000 7fe87ef57700 1 -- 172.21.15.26:0/743668975 shutdown_connections 2021-11-03T18:03:02.036 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.037+0000 7fe87ef57700 1 -- 172.21.15.26:0/743668975 wait complete. 2021-11-03T18:03:02.037 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.037+0000 7fe87ef57700 1 Processor -- start 2021-11-03T18:03:02.037 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.037+0000 7fe87ef57700 1 -- start start 2021-11-03T18:03:02.039 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.037+0000 7fe87ef57700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8780f55c0 0x7fe878109c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:03:02.040 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.037+0000 7fe87ef57700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8780f6860 0x7fe87810c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:03:02.040 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.037+0000 7fe87ef57700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe878060540 con 0x7fe8780f6860 2021-11-03T18:03:02.040 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.037+0000 7fe87ef57700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe878060680 con 0x7fe8780f55c0 2021-11-03T18:03:02.040 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.038+0000 7fe877fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8780f6860 0x7fe87810c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:03:02.040 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.038+0000 7fe877fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8780f6860 0x7fe87810c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57844/0 (socket says 172.21.15.26:57844) 2021-11-03T18:03:02.041 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.038+0000 7fe877fff700 1 -- 172.21.15.26:0/4139689585 learned_addr learned my addr 172.21.15.26:0/4139689585 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:03:02.041 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.038+0000 7fe87ccf3700 1 --2- 172.21.15.26:0/4139689585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8780f55c0 0x7fe878109c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:03:02.041 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.038+0000 7fe877fff700 1 -- 172.21.15.26:0/4139689585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8780f55c0 msgr2=0x7fe878109c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:03:02.041 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.038+0000 7fe877fff700 1 --2- 172.21.15.26:0/4139689585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8780f55c0 0x7fe878109c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:02.042 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.038+0000 7fe877fff700 1 -- 172.21.15.26:0/4139689585 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe86c005040 con 0x7fe8780f6860 2021-11-03T18:03:02.042 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.038+0000 7fe87ccf3700 1 --2- 172.21.15.26:0/4139689585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8780f55c0 0x7fe878109c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:03:02.042 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.038+0000 7fe877fff700 1 --2- 172.21.15.26:0/4139689585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8780f6860 0x7fe87810c130 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 rx=0x7fe86c009990 tx=0x7fe86c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:03:02.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.038+0000 7fe8757fa700 1 -- 172.21.15.26:0/4139689585 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe86c018070 con 0x7fe8780f6860 2021-11-03T18:03:02.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.038+0000 7fe8757fa700 1 -- 172.21.15.26:0/4139689585 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe86c007ba0 con 0x7fe8780f6860 2021-11-03T18:03:02.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.038+0000 7fe8757fa700 1 -- 172.21.15.26:0/4139689585 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe86c01c3c0 con 0x7fe8780f6860 2021-11-03T18:03:02.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.038+0000 7fe87ef57700 1 -- 172.21.15.26:0/4139689585 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe87810c680 con 0x7fe8780f6860 2021-11-03T18:03:02.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.038+0000 7fe87ef57700 1 -- 172.21.15.26:0/4139689585 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe87810cb90 con 0x7fe8780f6860 2021-11-03T18:03:02.044 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.039+0000 7fe87ef57700 1 -- 172.21.15.26:0/4139689585 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe878045ad0 con 0x7fe8780f6860 2021-11-03T18:03:02.044 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.040+0000 7fe8757fa700 1 -- 172.21.15.26:0/4139689585 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fe86c01d420 con 0x7fe8780f6860 2021-11-03T18:03:02.044 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.040+0000 7fe8757fa700 1 --2- 172.21.15.26:0/4139689585 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe8600640b0 0x7fe860066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:03:02.044 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.040+0000 7fe8757fa700 1 -- 172.21.15.26:0/4139689585 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fe86c0825d0 con 0x7fe8780f6860 2021-11-03T18:03:02.044 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.040+0000 7fe87ccf3700 1 --2- 172.21.15.26:0/4139689585 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe8600640b0 0x7fe860066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:03:02.045 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.040+0000 7fe87ccf3700 1 --2- 172.21.15.26:0/4139689585 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe8600640b0 0x7fe860066570 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7fe8780601c0 tx=0x7fe870004d00).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:03:02.045 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.044+0000 7fe8757fa700 1 -- 172.21.15.26:0/4139689585 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fe86c054990 con 0x7fe8780f6860 2021-11-03T18:03:02.216 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.218+0000 7fe87ef57700 1 -- 172.21.15.26:0/4139689585 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe878057f10 con 0x7fe8600640b0 2021-11-03T18:03:02.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.233+0000 7fe8757fa700 1 -- 172.21.15.26:0/4139689585 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fe878057f10 con 0x7fe8600640b0 2021-11-03T18:03:02.231 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:03:02.231 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (74m) 3m ago 75m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:03:02.231 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (66m) 3m ago 75m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:03:02.232 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (66m) 2m ago 74m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:03:02.232 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (74m) 3m ago 75m 41.7M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:03:02.232 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (67m) 3m ago 70m 25.6M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:03:02.232 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (67m) 3m ago 70m 26.2M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:03:02.233 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (70m) 2m ago 70m 26.4M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:03:02.233 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (70m) 2m ago 70m 26.8M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:03:02.233 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (68m) 3m ago 76m 561M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:03:02.233 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (67m) 2m ago 74m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:03:02.234 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (67m) 3m ago 76m 276M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:03:02.234 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (67m) 2m ago 74m 132M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:03:02.234 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (75m) 3m ago 75m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:03:02.234 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (74m) 2m ago 74m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:03:02.235 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (66m) 3m ago 73m 292M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:03:02.235 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (65m) 3m ago 73m 313M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:03:02.235 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (65m) 3m ago 73m 261M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:03:02.235 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (64m) 2m ago 72m 337M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:03:02.235 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (64m) 2m ago 72m 283M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:03:02.236 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (63m) 2m ago 72m 276M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:03:02.236 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (73m) 3m ago 74m 61.2M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:03:02.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.235+0000 7fe87ef57700 1 -- 172.21.15.26:0/4139689585 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe8600640b0 msgr2=0x7fe860066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:03:02.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.235+0000 7fe87ef57700 1 --2- 172.21.15.26:0/4139689585 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe8600640b0 0x7fe860066570 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7fe8780601c0 tx=0x7fe870004d00).stop 2021-11-03T18:03:02.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.235+0000 7fe87ef57700 1 -- 172.21.15.26:0/4139689585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8780f6860 msgr2=0x7fe87810c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:03:02.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.235+0000 7fe87ef57700 1 --2- 172.21.15.26:0/4139689585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8780f6860 0x7fe87810c130 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 rx=0x7fe86c009990 tx=0x7fe86c009b30).stop 2021-11-03T18:03:02.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.235+0000 7fe87ef57700 1 -- 172.21.15.26:0/4139689585 shutdown_connections 2021-11-03T18:03:02.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.235+0000 7fe87ef57700 1 --2- 172.21.15.26:0/4139689585 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe8600640b0 0x7fe860066570 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:02.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.235+0000 7fe87ef57700 1 --2- 172.21.15.26:0/4139689585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8780f55c0 0x7fe878109c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:02.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.235+0000 7fe87ef57700 1 --2- 172.21.15.26:0/4139689585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8780f6860 0x7fe87810c130 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:02.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.235+0000 7fe87ef57700 1 -- 172.21.15.26:0/4139689585 >> 172.21.15.26:0/4139689585 conn(0x7fe8780f0d20 msgr2=0x7fe8780fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:03:02.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.235+0000 7fe87ef57700 1 -- 172.21.15.26:0/4139689585 shutdown_connections 2021-11-03T18:03:02.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.235+0000 7fe87ef57700 1 -- 172.21.15.26:0/4139689585 wait complete. 2021-11-03T18:03:02.334 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.334+0000 7fd775cfe700 1 -- 172.21.15.26:0/2424649255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7700f9850 msgr2=0x7fd7700fbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:03:02.334 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.334+0000 7fd775cfe700 1 --2- 172.21.15.26:0/2424649255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7700f9850 0x7fd7700fbc40 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7fd760004660 tx=0x7fd760009b30).stop 2021-11-03T18:03:02.334 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.334+0000 7fd775cfe700 1 -- 172.21.15.26:0/2424649255 shutdown_connections 2021-11-03T18:03:02.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.334+0000 7fd775cfe700 1 --2- 172.21.15.26:0/2424649255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7700f9850 0x7fd7700fbc40 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:02.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.334+0000 7fd775cfe700 1 --2- 172.21.15.26:0/2424649255 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd770060390 0x7fd7700f9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:02.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.334+0000 7fd775cfe700 1 -- 172.21.15.26:0/2424649255 >> 172.21.15.26:0/2424649255 conn(0x7fd7700f0de0 msgr2=0x7fd7700f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:03:02.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.334+0000 7fd775cfe700 1 -- 172.21.15.26:0/2424649255 shutdown_connections 2021-11-03T18:03:02.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.334+0000 7fd775cfe700 1 -- 172.21.15.26:0/2424649255 wait complete. 2021-11-03T18:03:02.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.335+0000 7fd775cfe700 1 Processor -- start 2021-11-03T18:03:02.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.335+0000 7fd775cfe700 1 -- start start 2021-11-03T18:03:02.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.335+0000 7fd775cfe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd770060390 0x7fd7700f6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:03:02.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.335+0000 7fd775cfe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7700f9850 0x7fd7700f5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:03:02.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.335+0000 7fd775cfe700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7700f57c0 con 0x7fd770060390 2021-11-03T18:03:02.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.335+0000 7fd775cfe700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7700f5900 con 0x7fd7700f9850 2021-11-03T18:03:02.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.335+0000 7fd76f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd770060390 0x7fd7700f6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:03:02.338 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.335+0000 7fd76f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd770060390 0x7fd7700f6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57852/0 (socket says 172.21.15.26:57852) 2021-11-03T18:03:02.338 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.335+0000 7fd76f7fe700 1 -- 172.21.15.26:0/2100602060 learned_addr learned my addr 172.21.15.26:0/2100602060 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:03:02.339 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.335+0000 7fd76effd700 1 --2- 172.21.15.26:0/2100602060 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7700f9850 0x7fd7700f5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:03:02.339 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.336+0000 7fd76f7fe700 1 -- 172.21.15.26:0/2100602060 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7700f9850 msgr2=0x7fd7700f5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:03:02.339 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.336+0000 7fd76f7fe700 1 --2- 172.21.15.26:0/2100602060 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7700f9850 0x7fd7700f5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:02.339 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.336+0000 7fd76f7fe700 1 -- 172.21.15.26:0/2100602060 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd760005040 con 0x7fd770060390 2021-11-03T18:03:02.339 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.336+0000 7fd76f7fe700 1 --2- 172.21.15.26:0/2100602060 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd770060390 0x7fd7700f6de0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 rx=0x7fd76400c790 tx=0x7fd764007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:03:02.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.336+0000 7fd757fff700 1 -- 172.21.15.26:0/2100602060 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd76400e680 con 0x7fd770060390 2021-11-03T18:03:02.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.336+0000 7fd757fff700 1 -- 172.21.15.26:0/2100602060 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd76400ec90 con 0x7fd770060390 2021-11-03T18:03:02.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.336+0000 7fd775cfe700 1 -- 172.21.15.26:0/2100602060 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7700f5be0 con 0x7fd770060390 2021-11-03T18:03:02.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.336+0000 7fd757fff700 1 -- 172.21.15.26:0/2100602060 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd764012d00 con 0x7fd770060390 2021-11-03T18:03:02.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.336+0000 7fd775cfe700 1 -- 172.21.15.26:0/2100602060 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd77010ef90 con 0x7fd770060390 2021-11-03T18:03:02.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.337+0000 7fd775cfe700 1 -- 172.21.15.26:0/2100602060 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd770045ad0 con 0x7fd770060390 2021-11-03T18:03:02.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.337+0000 7fd757fff700 1 -- 172.21.15.26:0/2100602060 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fd764010070 con 0x7fd770060390 2021-11-03T18:03:02.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.338+0000 7fd757fff700 1 --2- 172.21.15.26:0/2100602060 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd7580640b0 0x7fd758066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:03:02.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.338+0000 7fd757fff700 1 -- 172.21.15.26:0/2100602060 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fd764080a50 con 0x7fd770060390 2021-11-03T18:03:02.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.338+0000 7fd76effd700 1 --2- 172.21.15.26:0/2100602060 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd7580640b0 0x7fd758066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:03:02.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.338+0000 7fd76effd700 1 --2- 172.21.15.26:0/2100602060 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd7580640b0 0x7fd758066570 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7fd760004e30 tx=0x7fd760009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:03:02.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.342+0000 7fd757fff700 1 -- 172.21.15.26:0/2100602060 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fd764052c00 con 0x7fd770060390 2021-11-03T18:03:02.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.571+0000 7fd775cfe700 1 -- 172.21.15.26:0/2100602060 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd7700fef50 con 0x7fd770060390 2021-11-03T18:03:02.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.572+0000 7fd757fff700 1 -- 172.21.15.26:0/2100602060 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fd7640527f0 con 0x7fd770060390 2021-11-03T18:03:02.570 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:03:02.570 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:03:02.570 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:03:02.571 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:03:02.571 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:03:02.571 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:03:02.571 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:03:02.572 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:03:02.572 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:03:02.572 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:03:02.572 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:03:02.572 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:03:02.573 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:03:02.573 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:03:02.573 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:03:02.573 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:03:02.573 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:03:02.574 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:03:02.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.574+0000 7fd775cfe700 1 -- 172.21.15.26:0/2100602060 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd7580640b0 msgr2=0x7fd758066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:03:02.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.574+0000 7fd775cfe700 1 --2- 172.21.15.26:0/2100602060 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd7580640b0 0x7fd758066570 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7fd760004e30 tx=0x7fd760009b30).stop 2021-11-03T18:03:02.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.574+0000 7fd775cfe700 1 -- 172.21.15.26:0/2100602060 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd770060390 msgr2=0x7fd7700f6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:03:02.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.574+0000 7fd775cfe700 1 --2- 172.21.15.26:0/2100602060 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd770060390 0x7fd7700f6de0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 rx=0x7fd76400c790 tx=0x7fd764007d90).stop 2021-11-03T18:03:02.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.574+0000 7fd775cfe700 1 -- 172.21.15.26:0/2100602060 shutdown_connections 2021-11-03T18:03:02.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.574+0000 7fd775cfe700 1 --2- 172.21.15.26:0/2100602060 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd7580640b0 0x7fd758066570 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:02.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.574+0000 7fd775cfe700 1 --2- 172.21.15.26:0/2100602060 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd770060390 0x7fd7700f6de0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:02.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.574+0000 7fd775cfe700 1 --2- 172.21.15.26:0/2100602060 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7700f9850 0x7fd7700f5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:02.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.574+0000 7fd775cfe700 1 -- 172.21.15.26:0/2100602060 >> 172.21.15.26:0/2100602060 conn(0x7fd7700f0de0 msgr2=0x7fd7700f31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:03:02.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.574+0000 7fd775cfe700 1 -- 172.21.15.26:0/2100602060 shutdown_connections 2021-11-03T18:03:02.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.574+0000 7fd775cfe700 1 -- 172.21.15.26:0/2100602060 wait complete. 2021-11-03T18:03:02.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.674+0000 7f32302f9700 1 -- 172.21.15.26:0/2453105616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32280f9850 msgr2=0x7f32280fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:03:02.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.674+0000 7f32302f9700 1 --2- 172.21.15.26:0/2453105616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32280f9850 0x7f32280fbc80 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7f3224004660 tx=0x7f3224009b30).stop 2021-11-03T18:03:02.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.674+0000 7f32302f9700 1 -- 172.21.15.26:0/2453105616 shutdown_connections 2021-11-03T18:03:02.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.674+0000 7f32302f9700 1 --2- 172.21.15.26:0/2453105616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32280f9850 0x7f32280fbc80 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:02.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.674+0000 7f32302f9700 1 --2- 172.21.15.26:0/2453105616 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32280603f0 0x7f32280f9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:03:02.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.674+0000 7f32302f9700 1 -- 172.21.15.26:0/2453105616 >> 172.21.15.26:0/2453105616 conn(0x7f32280f0d20 msgr2=0x7f32280f3140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:03:02.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.674+0000 7f32302f9700 1 -- 172.21.15.26:0/2453105616 shutdown_connections 2021-11-03T18:03:02.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.674+0000 7f32302f9700 1 -- 172.21.15.26:0/2453105616 wait complete. 2021-11-03T18:03:02.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.675+0000 7f32302f9700 1 Processor -- start 2021-11-03T18:03:02.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.675+0000 7f32302f9700 1 -- start start 2021-11-03T18:03:02.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.675+0000 7f32302f9700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32280603f0 0x7f3228106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:03:02.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.675+0000 7f32302f9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32280f9850 0x7f3228107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:03:02.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.675+0000 7f32302f9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3228107ab0 con 0x7f32280f9850 2021-11-03T18:03:02.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.675+0000 7f32302f9700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3228108360 con 0x7f32280603f0 2021-11-03T18:03:02.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.675+0000 7f322d894700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32280f9850 0x7f3228107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:03:02.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.675+0000 7f322d894700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32280f9850 0x7f3228107470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57864/0 (socket says 172.21.15.26:57864) 2021-11-03T18:03:02.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.675+0000 7f322d894700 1 -- 172.21.15.26:0/2697578795 learned_addr learned my addr 172.21.15.26:0/2697578795 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:03:02.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.675+0000 7f322e095700 1 --2- 172.21.15.26:0/2697578795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32280603f0 0x7f3228106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:03:02.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.675+0000 7f322d894700 1 -- 172.21.15.26:0/2697578795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32280603f0 msgr2=0x7f3228106f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:03:02.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.675+0000 7f322d894700 1 --2- 172.21.15.26:0/2697578795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32280603f0 0x7f3228106f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:02.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.675+0000 7f322d894700 1 -- 172.21.15.26:0/2697578795 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3224005040 con 0x7f32280f9850 2021-11-03T18:03:02.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.675+0000 7f322d894700 1 --2- 172.21.15.26:0/2697578795 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32280f9850 0x7f3228107470 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7f3224000c00 tx=0x7f3224009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:03:02.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.676+0000 7f321effd700 1 -- 172.21.15.26:0/2697578795 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3224018070 con 0x7f32280f9850 2021-11-03T18:03:02.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.676+0000 7f321effd700 1 -- 172.21.15.26:0/2697578795 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f32240097d0 con 0x7f32280f9850 2021-11-03T18:03:02.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.676+0000 7f32302f9700 1 -- 172.21.15.26:0/2697578795 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32281085e0 con 0x7f32280f9850 2021-11-03T18:03:02.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.676+0000 7f321effd700 1 -- 172.21.15.26:0/2697578795 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f322401c3c0 con 0x7f32280f9850 2021-11-03T18:03:02.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.676+0000 7f32302f9700 1 -- 172.21.15.26:0/2697578795 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3228108b40 con 0x7f32280f9850 2021-11-03T18:03:02.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.677+0000 7f32302f9700 1 -- 172.21.15.26:0/2697578795 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32280f49b0 con 0x7f32280f9850 2021-11-03T18:03:02.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.677+0000 7f321effd700 1 -- 172.21.15.26:0/2697578795 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f322401d420 con 0x7f32280f9850 2021-11-03T18:03:02.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.678+0000 7f321effd700 1 --2- 172.21.15.26:0/2697578795 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f32140640b0 0x7f3214066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:03:02.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.678+0000 7f321effd700 1 -- 172.21.15.26:0/2697578795 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f32240824c0 con 0x7f32280f9850 2021-11-03T18:03:02.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.678+0000 7f322e095700 1 --2- 172.21.15.26:0/2697578795 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f32140640b0 0x7f3214066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:03:02.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.678+0000 7f322e095700 1 --2- 172.21.15.26:0/2697578795 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f32140640b0 0x7f3214066570 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7f321800b790 tx=0x7f3218008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:03:02.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.682+0000 7f321effd700 1 -- 172.21.15.26:0/2697578795 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f3224054820 con 0x7f32280f9850 2021-11-03T18:03:02.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.887+0000 7f32302f9700 1 -- 172.21.15.26:0/2697578795 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f32280fef10 con 0x7f32280f9850 2021-11-03T18:03:02.886 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.888+0000 7f321effd700 1 -- 172.21.15.26:0/2697578795 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f3224054410 con 0x7f32280f9850 2021-11-03T18:03:02.886 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:03:02.887 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:03:02.887 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:03:02.887 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:03:02.887 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:03:02.888 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:03:02.888 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:03:02.888 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:03:02.888 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:03:02.888 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:03:02.889 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:03:02.889 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:03:02.889 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:03:02.889 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:03:02.890 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:03:02.890 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:03:02.890 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:03:02.890 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:03:02.891 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:03:02.891 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:03:02.891 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:03:02.891 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:03:02.892 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:03:02.892 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:03:02.892 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:03:02.892 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:03:02.892 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:03:02.893 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:03:02.893 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:03:02.893 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:03:02.893 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:03:02.893 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:03:02.894 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:03:02.894 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:03:02.894 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:03:02.894 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:03:02.894 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:03:02.895 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:03:02.895 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:03:02.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.890+0000 7f32302f9700 1 -- 172.21.15.26:0/2697578795 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f32140640b0 msgr2=0x7f3214066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:03:02.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.890+0000 7f32302f9700 1 --2- 172.21.15.26:0/2697578795 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f32140640b0 0x7f3214066570 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7f321800b790 tx=0x7f3218008040).stop 2021-11-03T18:03:02.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.890+0000 7f32302f9700 1 -- 172.21.15.26:0/2697578795 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32280f9850 msgr2=0x7f3228107470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:03:02.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.890+0000 7f32302f9700 1 --2- 172.21.15.26:0/2697578795 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32280f9850 0x7f3228107470 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7f3224000c00 tx=0x7f3224009b30).stop 2021-11-03T18:03:02.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.890+0000 7f32302f9700 1 -- 172.21.15.26:0/2697578795 shutdown_connections 2021-11-03T18:03:02.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.890+0000 7f32302f9700 1 --2- 172.21.15.26:0/2697578795 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f32140640b0 0x7f3214066570 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:02.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.890+0000 7f32302f9700 1 --2- 172.21.15.26:0/2697578795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32280603f0 0x7f3228106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:02.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.890+0000 7f32302f9700 1 --2- 172.21.15.26:0/2697578795 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32280f9850 0x7f3228107470 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:02.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.890+0000 7f32302f9700 1 -- 172.21.15.26:0/2697578795 >> 172.21.15.26:0/2697578795 conn(0x7f32280f0d20 msgr2=0x7f32280f3110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:03:02.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.890+0000 7f32302f9700 1 -- 172.21.15.26:0/2697578795 shutdown_connections 2021-11-03T18:03:02.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:02.890+0000 7f32302f9700 1 -- 172.21.15.26:0/2697578795 wait complete. 2021-11-03T18:03:02.898 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:03:03.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:02 smithi026 ceph-mon[96795]: pgmap v2051: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:03.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:02 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2100602060' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:03:03.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:02 smithi194 ceph-mon[65619]: pgmap v2051: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:03.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:02 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2100602060' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:03:04.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:03 smithi026 ceph-mon[96795]: from='client.36252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:03:04.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:03 smithi026 ceph-mon[96795]: from='client.36256 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:03:04.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:03 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2697578795' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:03:04.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:03 smithi194 ceph-mon[65619]: from='client.36252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:03:04.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:03 smithi194 ceph-mon[65619]: from='client.36256 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:03:04.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:03 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2697578795' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:03:05.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:04 smithi026 ceph-mon[96795]: pgmap v2052: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:05.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:04 smithi194 ceph-mon[65619]: pgmap v2052: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:07.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:06 smithi026 ceph-mon[96795]: pgmap v2053: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:07.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:06 smithi194 ceph-mon[65619]: pgmap v2053: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:09.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:08 smithi026 ceph-mon[96795]: pgmap v2054: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:09.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:08 smithi194 ceph-mon[65619]: pgmap v2054: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:10.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:09 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:03:10.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:09 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:03:11.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:10 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:03:11.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:10 smithi026 ceph-mon[96795]: pgmap v2055: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:11.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:10 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:03:11.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:10 smithi194 ceph-mon[65619]: pgmap v2055: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:13.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:12 smithi026 ceph-mon[96795]: pgmap v2056: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:13.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:12 smithi194 ceph-mon[65619]: pgmap v2056: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:15.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:14 smithi026 ceph-mon[96795]: pgmap v2057: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:15.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:14 smithi194 ceph-mon[65619]: pgmap v2057: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:17.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:16 smithi026 ceph-mon[96795]: pgmap v2058: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:17.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:16 smithi194 ceph-mon[65619]: pgmap v2058: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:19.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:18 smithi026 ceph-mon[96795]: pgmap v2059: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:19.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:18 smithi194 ceph-mon[65619]: pgmap v2059: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:21.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:20 smithi026 ceph-mon[96795]: pgmap v2060: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:21.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:20 smithi194 ceph-mon[65619]: pgmap v2060: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:23.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:22 smithi026 ceph-mon[96795]: pgmap v2061: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:23.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:22 smithi194 ceph-mon[65619]: pgmap v2061: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:25.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:24 smithi026 ceph-mon[96795]: pgmap v2062: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:25.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:03:25.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:24 smithi194 ceph-mon[65619]: pgmap v2062: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:25.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:03:26.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:25 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:03:26.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:25 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:03:27.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:26 smithi026 ceph-mon[96795]: pgmap v2063: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:27.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:26 smithi194 ceph-mon[65619]: pgmap v2063: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:29.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:28 smithi026 ceph-mon[96795]: pgmap v2064: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:29.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:28 smithi194 ceph-mon[65619]: pgmap v2064: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:31.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:30 smithi026 ceph-mon[96795]: pgmap v2065: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:31.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:30 smithi194 ceph-mon[65619]: pgmap v2065: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:33.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.005+0000 7fa18006d700 1 -- 172.21.15.26:0/1569250786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1780f6ff0 msgr2=0x7fa1780f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:03:33.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.005+0000 7fa18006d700 1 --2- 172.21.15.26:0/1569250786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1780f6ff0 0x7fa1780f7a20 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7fa168004660 tx=0x7fa168009b30).stop 2021-11-03T18:03:33.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.005+0000 7fa18006d700 1 -- 172.21.15.26:0/1569250786 shutdown_connections 2021-11-03T18:03:33.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.005+0000 7fa18006d700 1 --2- 172.21.15.26:0/1569250786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1780f6ff0 0x7fa1780f7a20 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:33.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.005+0000 7fa18006d700 1 --2- 172.21.15.26:0/1569250786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1780f66e0 0x7fa1780f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:33.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.005+0000 7fa18006d700 1 -- 172.21.15.26:0/1569250786 >> 172.21.15.26:0/1569250786 conn(0x7fa1780f1f00 msgr2=0x7fa1780f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:03:33.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.005+0000 7fa18006d700 1 -- 172.21.15.26:0/1569250786 shutdown_connections 2021-11-03T18:03:33.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.005+0000 7fa18006d700 1 -- 172.21.15.26:0/1569250786 wait complete. 2021-11-03T18:03:33.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.006+0000 7fa18006d700 1 Processor -- start 2021-11-03T18:03:33.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.006+0000 7fa18006d700 1 -- start start 2021-11-03T18:03:33.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.006+0000 7fa18006d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1780f66e0 0x7fa178106f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:03:33.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.006+0000 7fa18006d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1780f6ff0 0x7fa1781073f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:03:33.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.006+0000 7fa18006d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1781079a0 con 0x7fa1780f6ff0 2021-11-03T18:03:33.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.006+0000 7fa18006d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa178107ae0 con 0x7fa1780f66e0 2021-11-03T18:03:33.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.006+0000 7fa17d608700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1780f6ff0 0x7fa1781073f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:03:33.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.006+0000 7fa17d608700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1780f6ff0 0x7fa1781073f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57882/0 (socket says 172.21.15.26:57882) 2021-11-03T18:03:33.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.006+0000 7fa17d608700 1 -- 172.21.15.26:0/3111017893 learned_addr learned my addr 172.21.15.26:0/3111017893 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:03:33.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.007+0000 7fa17de09700 1 --2- 172.21.15.26:0/3111017893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1780f66e0 0x7fa178106f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:03:33.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.007+0000 7fa17d608700 1 -- 172.21.15.26:0/3111017893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1780f66e0 msgr2=0x7fa178106f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:03:33.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.007+0000 7fa17d608700 1 --2- 172.21.15.26:0/3111017893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1780f66e0 0x7fa178106f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:33.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.007+0000 7fa17d608700 1 -- 172.21.15.26:0/3111017893 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa168005040 con 0x7fa1780f6ff0 2021-11-03T18:03:33.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.007+0000 7fa17d608700 1 --2- 172.21.15.26:0/3111017893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1780f6ff0 0x7fa1781073f0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 rx=0x7fa168009830 tx=0x7fa168009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:03:33.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.007+0000 7fa16e7fc700 1 -- 172.21.15.26:0/3111017893 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa168018070 con 0x7fa1780f6ff0 2021-11-03T18:03:33.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.007+0000 7fa16e7fc700 1 -- 172.21.15.26:0/3111017893 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa168007ba0 con 0x7fa1780f6ff0 2021-11-03T18:03:33.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.007+0000 7fa18006d700 1 -- 172.21.15.26:0/3111017893 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa178108420 con 0x7fa1780f6ff0 2021-11-03T18:03:33.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.007+0000 7fa16e7fc700 1 -- 172.21.15.26:0/3111017893 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa16801c620 con 0x7fa1780f6ff0 2021-11-03T18:03:33.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.007+0000 7fa18006d700 1 -- 172.21.15.26:0/3111017893 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa178108980 con 0x7fa1780f6ff0 2021-11-03T18:03:33.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.008+0000 7fa18006d700 1 -- 172.21.15.26:0/3111017893 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa178045ad0 con 0x7fa1780f6ff0 2021-11-03T18:03:33.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.008+0000 7fa16e7fc700 1 -- 172.21.15.26:0/3111017893 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fa168007d10 con 0x7fa1780f6ff0 2021-11-03T18:03:33.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.009+0000 7fa16e7fc700 1 --2- 172.21.15.26:0/3111017893 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa164064090 0x7fa164066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:03:33.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.009+0000 7fa16e7fc700 1 -- 172.21.15.26:0/3111017893 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fa168082500 con 0x7fa1780f6ff0 2021-11-03T18:03:33.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.009+0000 7fa17de09700 1 --2- 172.21.15.26:0/3111017893 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa164064090 0x7fa164066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:03:33.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.009+0000 7fa17de09700 1 --2- 172.21.15.26:0/3111017893 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa164064090 0x7fa164066550 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7fa1740096c0 tx=0x7fa174009be0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:03:33.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.013+0000 7fa16e7fc700 1 -- 172.21.15.26:0/3111017893 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fa168054920 con 0x7fa1780f6ff0 2021-11-03T18:03:33.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:32 smithi026 ceph-mon[96795]: pgmap v2066: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:33.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.195+0000 7fa18006d700 1 -- 172.21.15.26:0/3111017893 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1780ff040 con 0x7fa164064090 2021-11-03T18:03:33.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.196+0000 7fa16e7fc700 1 -- 172.21.15.26:0/3111017893 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fa1780ff040 con 0x7fa164064090 2021-11-03T18:03:33.194 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.198+0000 7fa18006d700 1 -- 172.21.15.26:0/3111017893 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa164064090 msgr2=0x7fa164066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:03:33.195 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.198+0000 7fa18006d700 1 --2- 172.21.15.26:0/3111017893 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa164064090 0x7fa164066550 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7fa1740096c0 tx=0x7fa174009be0).stop 2021-11-03T18:03:33.195 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.198+0000 7fa18006d700 1 -- 172.21.15.26:0/3111017893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1780f6ff0 msgr2=0x7fa1781073f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:03:33.195 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.198+0000 7fa18006d700 1 --2- 172.21.15.26:0/3111017893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1780f6ff0 0x7fa1781073f0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 rx=0x7fa168009830 tx=0x7fa168009b30).stop 2021-11-03T18:03:33.195 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.198+0000 7fa18006d700 1 -- 172.21.15.26:0/3111017893 shutdown_connections 2021-11-03T18:03:33.195 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.198+0000 7fa18006d700 1 --2- 172.21.15.26:0/3111017893 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa164064090 0x7fa164066550 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:33.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.198+0000 7fa18006d700 1 --2- 172.21.15.26:0/3111017893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1780f66e0 0x7fa178106f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:33.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.198+0000 7fa18006d700 1 --2- 172.21.15.26:0/3111017893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1780f6ff0 0x7fa1781073f0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:33.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.198+0000 7fa18006d700 1 -- 172.21.15.26:0/3111017893 >> 172.21.15.26:0/3111017893 conn(0x7fa1780f1f00 msgr2=0x7fa1780fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:03:33.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.198+0000 7fa18006d700 1 -- 172.21.15.26:0/3111017893 shutdown_connections 2021-11-03T18:03:33.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.198+0000 7fa18006d700 1 -- 172.21.15.26:0/3111017893 wait complete. 2021-11-03T18:03:33.204 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:03:33.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:32 smithi194 ceph-mon[65619]: pgmap v2066: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:33.296 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.298+0000 7fd933bec700 1 -- 172.21.15.26:0/285932849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd92c0f6ff0 msgr2=0x7fd92c0f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:03:33.297 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.298+0000 7fd933bec700 1 --2- 172.21.15.26:0/285932849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd92c0f6ff0 0x7fd92c0f7a20 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 rx=0x7fd928004660 tx=0x7fd928009b30).stop 2021-11-03T18:03:33.297 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.298+0000 7fd933bec700 1 -- 172.21.15.26:0/285932849 shutdown_connections 2021-11-03T18:03:33.297 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.298+0000 7fd933bec700 1 --2- 172.21.15.26:0/285932849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd92c0f6ff0 0x7fd92c0f7a20 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:33.298 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.298+0000 7fd933bec700 1 --2- 172.21.15.26:0/285932849 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd92c0f66e0 0x7fd92c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:03:33.298 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.298+0000 7fd933bec700 1 -- 172.21.15.26:0/285932849 >> 172.21.15.26:0/285932849 conn(0x7fd92c0f1f00 msgr2=0x7fd92c0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:03:33.298 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.298+0000 7fd933bec700 1 -- 172.21.15.26:0/285932849 shutdown_connections 2021-11-03T18:03:33.298 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.298+0000 7fd933bec700 1 -- 172.21.15.26:0/285932849 wait complete. 2021-11-03T18:03:33.298 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.298+0000 7fd933bec700 1 Processor -- start 2021-11-03T18:03:33.299 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.298+0000 7fd933bec700 1 -- start start 2021-11-03T18:03:33.299 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.299+0000 7fd933bec700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd92c0f66e0 0x7fd92c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:03:33.299 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.299+0000 7fd933bec700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd92c0f6ff0 0x7fd92c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:03:33.299 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.299+0000 7fd933bec700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd92c06a410 con 0x7fd92c0f6ff0 2021-11-03T18:03:33.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.299+0000 7fd933bec700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd92c06a550 con 0x7fd92c0f66e0 2021-11-03T18:03:33.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.299+0000 7fd931187700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd92c0f6ff0 0x7fd92c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:03:33.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.299+0000 7fd931187700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd92c0f6ff0 0x7fd92c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57892/0 (socket says 172.21.15.26:57892) 2021-11-03T18:03:33.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.299+0000 7fd931187700 1 -- 172.21.15.26:0/3638569348 learned_addr learned my addr 172.21.15.26:0/3638569348 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:03:33.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.299+0000 7fd931988700 1 --2- 172.21.15.26:0/3638569348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd92c0f66e0 0x7fd92c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:03:33.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.299+0000 7fd931187700 1 -- 172.21.15.26:0/3638569348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd92c0f66e0 msgr2=0x7fd92c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:03:33.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.299+0000 7fd931187700 1 --2- 172.21.15.26:0/3638569348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd92c0f66e0 0x7fd92c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:33.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.299+0000 7fd931187700 1 -- 172.21.15.26:0/3638569348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd928005040 con 0x7fd92c0f6ff0 2021-11-03T18:03:33.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.299+0000 7fd931988700 1 --2- 172.21.15.26:0/3638569348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd92c0f66e0 0x7fd92c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:03:33.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.299+0000 7fd931187700 1 --2- 172.21.15.26:0/3638569348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd92c0f6ff0 0x7fd92c069e20 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 rx=0x7fd928009990 tx=0x7fd928009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:03:33.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.299+0000 7fd9227fc700 1 -- 172.21.15.26:0/3638569348 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd928018070 con 0x7fd92c0f6ff0 2021-11-03T18:03:33.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.299+0000 7fd9227fc700 1 -- 172.21.15.26:0/3638569348 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd928007ca0 con 0x7fd92c0f6ff0 2021-11-03T18:03:33.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.299+0000 7fd933bec700 1 -- 172.21.15.26:0/3638569348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd92c06a7d0 con 0x7fd92c0f6ff0 2021-11-03T18:03:33.303 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.299+0000 7fd9227fc700 1 -- 172.21.15.26:0/3638569348 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd92801c620 con 0x7fd92c0f6ff0 2021-11-03T18:03:33.303 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.299+0000 7fd933bec700 1 -- 172.21.15.26:0/3638569348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd92c10efd0 con 0x7fd92c0f6ff0 2021-11-03T18:03:33.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.300+0000 7fd933bec700 1 -- 172.21.15.26:0/3638569348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd92c045ad0 con 0x7fd92c0f6ff0 2021-11-03T18:03:33.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.301+0000 7fd9227fc700 1 -- 172.21.15.26:0/3638569348 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fd92801d960 con 0x7fd92c0f6ff0 2021-11-03T18:03:33.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.301+0000 7fd9227fc700 1 --2- 172.21.15.26:0/3638569348 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd9180640b0 0x7fd918066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:03:33.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.301+0000 7fd9227fc700 1 -- 172.21.15.26:0/3638569348 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fd928082470 con 0x7fd92c0f6ff0 2021-11-03T18:03:33.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.301+0000 7fd931988700 1 --2- 172.21.15.26:0/3638569348 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd9180640b0 0x7fd918066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:03:33.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.302+0000 7fd931988700 1 --2- 172.21.15.26:0/3638569348 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd9180640b0 0x7fd918066570 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7fd92c06b730 tx=0x7fd91c008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:03:33.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.305+0000 7fd9227fc700 1 -- 172.21.15.26:0/3638569348 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fd928054890 con 0x7fd92c0f6ff0 2021-11-03T18:03:33.473 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.477+0000 7fd933bec700 1 -- 172.21.15.26:0/3638569348 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd92c0ff060 con 0x7fd9180640b0 2021-11-03T18:03:33.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.491+0000 7fd9227fc700 1 -- 172.21.15.26:0/3638569348 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fd92c0ff060 con 0x7fd9180640b0 2021-11-03T18:03:33.488 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:03:33.489 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (74m) 3m ago 76m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:03:33.489 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (67m) 3m ago 76m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:03:33.489 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (66m) 2m ago 75m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:03:33.490 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (74m) 3m ago 75m 41.7M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:03:33.490 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (67m) 3m ago 71m 25.6M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:03:33.490 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (68m) 3m ago 71m 26.2M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:03:33.490 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (71m) 2m ago 71m 26.4M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:03:33.491 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (71m) 2m ago 71m 26.8M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:03:33.491 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (68m) 3m ago 77m 561M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:03:33.491 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (68m) 2m ago 75m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:03:33.491 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (67m) 3m ago 77m 276M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:03:33.491 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (67m) 2m ago 75m 132M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:03:33.492 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (75m) 3m ago 75m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:03:33.492 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (75m) 2m ago 75m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:03:33.492 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (66m) 3m ago 74m 292M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:03:33.492 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (66m) 3m ago 74m 313M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:03:33.493 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (65m) 3m ago 73m 261M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:03:33.493 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (65m) 2m ago 73m 337M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:03:33.493 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (64m) 2m ago 73m 283M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:03:33.494 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (64m) 2m ago 72m 276M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:03:33.494 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (74m) 3m ago 75m 61.2M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:03:33.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.493+0000 7fd933bec700 1 -- 172.21.15.26:0/3638569348 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd9180640b0 msgr2=0x7fd918066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:03:33.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.493+0000 7fd933bec700 1 --2- 172.21.15.26:0/3638569348 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd9180640b0 0x7fd918066570 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7fd92c06b730 tx=0x7fd91c008040).stop 2021-11-03T18:03:33.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.493+0000 7fd933bec700 1 -- 172.21.15.26:0/3638569348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd92c0f6ff0 msgr2=0x7fd92c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:03:33.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.493+0000 7fd933bec700 1 --2- 172.21.15.26:0/3638569348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd92c0f6ff0 0x7fd92c069e20 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 rx=0x7fd928009990 tx=0x7fd928009b30).stop 2021-11-03T18:03:33.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.493+0000 7fd933bec700 1 -- 172.21.15.26:0/3638569348 shutdown_connections 2021-11-03T18:03:33.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.493+0000 7fd933bec700 1 --2- 172.21.15.26:0/3638569348 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd9180640b0 0x7fd918066570 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:33.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.493+0000 7fd933bec700 1 --2- 172.21.15.26:0/3638569348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd92c0f66e0 0x7fd92c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:33.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.493+0000 7fd933bec700 1 --2- 172.21.15.26:0/3638569348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd92c0f6ff0 0x7fd92c069e20 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:33.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.493+0000 7fd933bec700 1 -- 172.21.15.26:0/3638569348 >> 172.21.15.26:0/3638569348 conn(0x7fd92c0f1f00 msgr2=0x7fd92c0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:03:33.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.493+0000 7fd933bec700 1 -- 172.21.15.26:0/3638569348 shutdown_connections 2021-11-03T18:03:33.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.493+0000 7fd933bec700 1 -- 172.21.15.26:0/3638569348 wait complete. 2021-11-03T18:03:33.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.593+0000 7fe490ac1700 1 -- 172.21.15.26:0/3110381674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe48c0f74a0 msgr2=0x7fe48c0f5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:03:33.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.593+0000 7fe490ac1700 1 --2- 172.21.15.26:0/3110381674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe48c0f74a0 0x7fe48c0f5930 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7fe474004660 tx=0x7fe474009b30).stop 2021-11-03T18:03:33.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.593+0000 7fe490ac1700 1 -- 172.21.15.26:0/3110381674 shutdown_connections 2021-11-03T18:03:33.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.593+0000 7fe490ac1700 1 --2- 172.21.15.26:0/3110381674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe48c0f74a0 0x7fe48c0f5930 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:33.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.593+0000 7fe490ac1700 1 --2- 172.21.15.26:0/3110381674 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe48c0f6b90 0x7fe48c0f6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:33.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.593+0000 7fe490ac1700 1 -- 172.21.15.26:0/3110381674 >> 172.21.15.26:0/3110381674 conn(0x7fe48c0f0540 msgr2=0x7fe48c0f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:03:33.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.593+0000 7fe490ac1700 1 -- 172.21.15.26:0/3110381674 shutdown_connections 2021-11-03T18:03:33.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.593+0000 7fe490ac1700 1 -- 172.21.15.26:0/3110381674 wait complete. 2021-11-03T18:03:33.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.594+0000 7fe490ac1700 1 Processor -- start 2021-11-03T18:03:33.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.594+0000 7fe490ac1700 1 -- start start 2021-11-03T18:03:33.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.594+0000 7fe490ac1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe48c0f6b90 0x7fe48c0fd820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:03:33.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.594+0000 7fe490ac1700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe48c0f74a0 0x7fe48c0fbca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:03:33.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.594+0000 7fe490ac1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c0fc200 con 0x7fe48c0f6b90 2021-11-03T18:03:33.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.594+0000 7fe490ac1700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c0fc340 con 0x7fe48c0f74a0 2021-11-03T18:03:33.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.594+0000 7fe48a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe48c0f6b90 0x7fe48c0fd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:03:33.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.594+0000 7fe48a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe48c0f6b90 0x7fe48c0fd820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57900/0 (socket says 172.21.15.26:57900) 2021-11-03T18:03:33.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.594+0000 7fe48a59c700 1 -- 172.21.15.26:0/807976941 learned_addr learned my addr 172.21.15.26:0/807976941 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:03:33.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.594+0000 7fe48a59c700 1 -- 172.21.15.26:0/807976941 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe48c0f74a0 msgr2=0x7fe48c0fbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:03:33.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.594+0000 7fe48a59c700 1 --2- 172.21.15.26:0/807976941 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe48c0f74a0 0x7fe48c0fbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:03:33.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.594+0000 7fe48a59c700 1 -- 172.21.15.26:0/807976941 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe474005040 con 0x7fe48c0f6b90 2021-11-03T18:03:33.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.595+0000 7fe48a59c700 1 --2- 172.21.15.26:0/807976941 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe48c0f6b90 0x7fe48c0fd820 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7fe48400d8d0 tx=0x7fe484004f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:03:33.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.595+0000 7fe482ffd700 1 -- 172.21.15.26:0/807976941 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe48400de70 con 0x7fe48c0f6b90 2021-11-03T18:03:33.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.595+0000 7fe482ffd700 1 -- 172.21.15.26:0/807976941 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe48400f040 con 0x7fe48c0f6b90 2021-11-03T18:03:33.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.595+0000 7fe490ac1700 1 -- 172.21.15.26:0/807976941 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe48c0fc620 con 0x7fe48c0f6b90 2021-11-03T18:03:33.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.595+0000 7fe490ac1700 1 -- 172.21.15.26:0/807976941 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe48c10ef10 con 0x7fe48c0f6b90 2021-11-03T18:03:33.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.595+0000 7fe482ffd700 1 -- 172.21.15.26:0/807976941 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe484013a90 con 0x7fe48c0f6b90 2021-11-03T18:03:33.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.596+0000 7fe490ac1700 1 -- 172.21.15.26:0/807976941 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe470004fa0 con 0x7fe48c0f6b90 2021-11-03T18:03:33.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.596+0000 7fe482ffd700 1 -- 172.21.15.26:0/807976941 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fe48401a030 con 0x7fe48c0f6b90 2021-11-03T18:03:33.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.597+0000 7fe482ffd700 1 --2- 172.21.15.26:0/807976941 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe4780640b0 0x7fe478066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:03:33.600 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.597+0000 7fe482ffd700 1 -- 172.21.15.26:0/807976941 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fe484080800 con 0x7fe48c0f6b90 2021-11-03T18:03:33.600 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.597+0000 7fe489d9b700 1 --2- 172.21.15.26:0/807976941 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe4780640b0 0x7fe478066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:03:33.600 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.597+0000 7fe489d9b700 1 --2- 172.21.15.26:0/807976941 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe4780640b0 0x7fe478066570 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7fe474004e30 tx=0x7fe474009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:03:33.600 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.601+0000 7fe482ffd700 1 -- 172.21.15.26:0/807976941 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fe484052a70 con 0x7fe48c0f6b90 2021-11-03T18:03:33.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.831+0000 7fe490ac1700 1 -- 172.21.15.26:0/807976941 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe470005e80 con 0x7fe48c0f6b90 2021-11-03T18:03:33.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.832+0000 7fe482ffd700 1 -- 172.21.15.26:0/807976941 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fe484018070 con 0x7fe48c0f6b90 2021-11-03T18:03:33.829 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:03:33.829 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:03:33.829 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:03:33.829 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:03:33.830 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:03:33.830 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:03:33.830 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:03:33.830 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:03:33.831 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:03:33.831 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:03:33.831 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:03:33.831 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:03:33.832 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:03:33.832 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:03:33.832 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:03:33.832 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:03:33.832 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:03:33.833 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:03:33.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.833+0000 7fe490ac1700 1 -- 172.21.15.26:0/807976941 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe4780640b0 msgr2=0x7fe478066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:03:33.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.833+0000 7fe490ac1700 1 --2- 172.21.15.26:0/807976941 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe4780640b0 0x7fe478066570 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7fe474004e30 tx=0x7fe474009b30).stop 2021-11-03T18:03:33.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.833+0000 7fe490ac1700 1 -- 172.21.15.26:0/807976941 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe48c0f6b90 msgr2=0x7fe48c0fd820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:03:33.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.833+0000 7fe490ac1700 1 --2- 172.21.15.26:0/807976941 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe48c0f6b90 0x7fe48c0fd820 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7fe48400d8d0 tx=0x7fe484004f00).stop 2021-11-03T18:03:33.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.833+0000 7fe490ac1700 1 -- 172.21.15.26:0/807976941 shutdown_connections 2021-11-03T18:03:33.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.833+0000 7fe490ac1700 1 --2- 172.21.15.26:0/807976941 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe4780640b0 0x7fe478066570 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:33.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.833+0000 7fe490ac1700 1 --2- 172.21.15.26:0/807976941 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe48c0f6b90 0x7fe48c0fd820 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:33.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.833+0000 7fe490ac1700 1 --2- 172.21.15.26:0/807976941 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe48c0f74a0 0x7fe48c0fbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:03:33.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.833+0000 7fe490ac1700 1 -- 172.21.15.26:0/807976941 >> 172.21.15.26:0/807976941 conn(0x7fe48c0f0540 msgr2=0x7fe48c0fa390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:03:33.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.833+0000 7fe490ac1700 1 -- 172.21.15.26:0/807976941 shutdown_connections 2021-11-03T18:03:33.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.833+0000 7fe490ac1700 1 -- 172.21.15.26:0/807976941 wait complete. 2021-11-03T18:03:33.933 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.934+0000 7fa3f759e700 1 -- 172.21.15.26:0/2125135094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3f80f6a20 msgr2=0x7fa3f80f6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:03:33.933 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.934+0000 7fa3f759e700 1 --2- 172.21.15.26:0/2125135094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3f80f6a20 0x7fa3f80f6e40 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7fa3e80099e0 tx=0x7fa3e8004d10).stop 2021-11-03T18:03:33.933 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.934+0000 7fa3f759e700 1 -- 172.21.15.26:0/2125135094 shutdown_connections 2021-11-03T18:03:33.934 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.934+0000 7fa3f759e700 1 --2- 172.21.15.26:0/2125135094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3f80f73c0 0x7fa3f80f5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:33.934 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.934+0000 7fa3f759e700 1 --2- 172.21.15.26:0/2125135094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3f80f6a20 0x7fa3f80f6e40 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:33.934 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.934+0000 7fa3f759e700 1 -- 172.21.15.26:0/2125135094 >> 172.21.15.26:0/2125135094 conn(0x7fa3f80f0320 msgr2=0x7fa3f80f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:03:33.934 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.934+0000 7fa3f759e700 1 -- 172.21.15.26:0/2125135094 shutdown_connections 2021-11-03T18:03:33.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.934+0000 7fa3f759e700 1 -- 172.21.15.26:0/2125135094 wait complete. 2021-11-03T18:03:33.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.935+0000 7fa3f759e700 1 Processor -- start 2021-11-03T18:03:33.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.935+0000 7fa3f759e700 1 -- start start 2021-11-03T18:03:33.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.935+0000 7fa3f759e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3f80f6a20 0x7fa3f8106eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:03:33.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.935+0000 7fa3f759e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3f80f73c0 0x7fa3f81073a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:03:33.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.935+0000 7fa3f759e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f8107950 con 0x7fa3f80f6a20 2021-11-03T18:03:33.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.935+0000 7fa3f759e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f8107a90 con 0x7fa3f80f73c0 2021-11-03T18:03:33.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.935+0000 7fa3f659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3f80f6a20 0x7fa3f8106eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:03:33.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.935+0000 7fa3f659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3f80f6a20 0x7fa3f8106eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57910/0 (socket says 172.21.15.26:57910) 2021-11-03T18:03:33.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.935+0000 7fa3f659c700 1 -- 172.21.15.26:0/2310182156 learned_addr learned my addr 172.21.15.26:0/2310182156 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:03:33.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.935+0000 7fa3f5d9b700 1 --2- 172.21.15.26:0/2310182156 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3f80f73c0 0x7fa3f81073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:03:33.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.935+0000 7fa3f659c700 1 -- 172.21.15.26:0/2310182156 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3f80f73c0 msgr2=0x7fa3f81073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:03:33.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.935+0000 7fa3f659c700 1 --2- 172.21.15.26:0/2310182156 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3f80f73c0 0x7fa3f81073a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:33.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.935+0000 7fa3f659c700 1 -- 172.21.15.26:0/2310182156 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e8009640 con 0x7fa3f80f6a20 2021-11-03T18:03:33.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.936+0000 7fa3f659c700 1 --2- 172.21.15.26:0/2310182156 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3f80f6a20 0x7fa3f8106eb0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7fa3e800c010 tx=0x7fa3e8004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:03:33.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.936+0000 7fa3eeffd700 1 -- 172.21.15.26:0/2310182156 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3e800e070 con 0x7fa3f80f6a20 2021-11-03T18:03:33.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.936+0000 7fa3eeffd700 1 -- 172.21.15.26:0/2310182156 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa3e8007dc0 con 0x7fa3f80f6a20 2021-11-03T18:03:33.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.936+0000 7fa3f759e700 1 -- 172.21.15.26:0/2310182156 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3f81083d0 con 0x7fa3f80f6a20 2021-11-03T18:03:33.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.936+0000 7fa3eeffd700 1 -- 172.21.15.26:0/2310182156 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3e8018070 con 0x7fa3f80f6a20 2021-11-03T18:03:33.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.936+0000 7fa3f759e700 1 -- 172.21.15.26:0/2310182156 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f81088b0 con 0x7fa3f80f6a20 2021-11-03T18:03:33.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.937+0000 7fa3f759e700 1 -- 172.21.15.26:0/2310182156 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3f8045ad0 con 0x7fa3f80f6a20 2021-11-03T18:03:33.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.937+0000 7fa3eeffd700 1 -- 172.21.15.26:0/2310182156 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fa3e8024060 con 0x7fa3f80f6a20 2021-11-03T18:03:33.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.938+0000 7fa3eeffd700 1 --2- 172.21.15.26:0/2310182156 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa3e4064100 0x7fa3e40665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:03:33.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.938+0000 7fa3eeffd700 1 -- 172.21.15.26:0/2310182156 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fa3e80821e0 con 0x7fa3f80f6a20 2021-11-03T18:03:33.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.938+0000 7fa3f5d9b700 1 --2- 172.21.15.26:0/2310182156 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa3e4064100 0x7fa3e40665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:03:33.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.938+0000 7fa3f5d9b700 1 --2- 172.21.15.26:0/2310182156 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa3e4064100 0x7fa3e40665c0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7fa3f80f7800 tx=0x7fa3e0009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:03:33.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:33.942+0000 7fa3eeffd700 1 -- 172.21.15.26:0/2310182156 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fa3e8054540 con 0x7fa3f80f6a20 2021-11-03T18:03:34.143 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:34.146+0000 7fa3f759e700 1 -- 172.21.15.26:0/2310182156 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa3f8109000 con 0x7fa3f80f6a20 2021-11-03T18:03:34.144 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:34.146+0000 7fa3eeffd700 1 -- 172.21.15.26:0/2310182156 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fa3e8022710 con 0x7fa3f80f6a20 2021-11-03T18:03:34.144 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:03:34.145 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:03:34.145 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:03:34.145 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:03:34.146 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:03:34.146 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:03:34.147 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:03:34.147 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:03:34.148 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:03:34.148 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:03:34.148 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:03:34.149 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:03:34.149 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:03:34.150 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:03:34.150 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:03:34.151 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:03:34.151 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:03:34.151 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:03:34.152 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:03:34.152 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:03:34.153 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:03:34.153 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:03:34.153 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:03:34.154 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:03:34.154 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:03:34.155 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:03:34.155 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:03:34.156 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:03:34.156 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:03:34.156 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:03:34.157 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:03:34.157 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:03:34.158 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:03:34.158 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:03:34.159 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:03:34.159 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:03:34.159 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:03:34.160 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:03:34.160 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:03:34.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:34.148+0000 7fa3f759e700 1 -- 172.21.15.26:0/2310182156 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa3e4064100 msgr2=0x7fa3e40665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:03:34.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:34.148+0000 7fa3f759e700 1 --2- 172.21.15.26:0/2310182156 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa3e4064100 0x7fa3e40665c0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7fa3f80f7800 tx=0x7fa3e0009040).stop 2021-11-03T18:03:34.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:34.148+0000 7fa3f759e700 1 -- 172.21.15.26:0/2310182156 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3f80f6a20 msgr2=0x7fa3f8106eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:03:34.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:34.148+0000 7fa3f759e700 1 --2- 172.21.15.26:0/2310182156 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3f80f6a20 0x7fa3f8106eb0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7fa3e800c010 tx=0x7fa3e8004d10).stop 2021-11-03T18:03:34.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:34.148+0000 7fa3f759e700 1 -- 172.21.15.26:0/2310182156 shutdown_connections 2021-11-03T18:03:34.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:34.148+0000 7fa3f759e700 1 --2- 172.21.15.26:0/2310182156 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa3e4064100 0x7fa3e40665c0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:34.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:34.148+0000 7fa3f759e700 1 --2- 172.21.15.26:0/2310182156 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3f80f6a20 0x7fa3f8106eb0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:34.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:34.148+0000 7fa3f759e700 1 --2- 172.21.15.26:0/2310182156 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3f80f73c0 0x7fa3f81073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:03:34.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:34.148+0000 7fa3f759e700 1 -- 172.21.15.26:0/2310182156 >> 172.21.15.26:0/2310182156 conn(0x7fa3f80f0320 msgr2=0x7fa3f80f4700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:03:34.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:34.148+0000 7fa3f759e700 1 -- 172.21.15.26:0/2310182156 shutdown_connections 2021-11-03T18:03:34.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:03:34.148+0000 7fa3f759e700 1 -- 172.21.15.26:0/2310182156 wait complete. 2021-11-03T18:03:34.167 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:03:34.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:33 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/807976941' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:03:34.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:33 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/807976941' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:03:35.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:34 smithi026 ceph-mon[96795]: from='client.36268 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:03:35.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:34 smithi026 ceph-mon[96795]: pgmap v2067: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:35.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:34 smithi026 ceph-mon[96795]: from='client.36272 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:03:35.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:34 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2310182156' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:03:35.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:34 smithi194 ceph-mon[65619]: from='client.36268 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:03:35.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:34 smithi194 ceph-mon[65619]: pgmap v2067: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:35.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:34 smithi194 ceph-mon[65619]: from='client.36272 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:03:35.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:34 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2310182156' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:03:37.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:36 smithi026 ceph-mon[96795]: pgmap v2068: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:37.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:36 smithi194 ceph-mon[65619]: pgmap v2068: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:39.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:38 smithi026 ceph-mon[96795]: pgmap v2069: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:39.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:38 smithi194 ceph-mon[65619]: pgmap v2069: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:40.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:03:40.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:03:41.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:40 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:03:41.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:40 smithi026 ceph-mon[96795]: pgmap v2070: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:41.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:40 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:03:41.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:40 smithi194 ceph-mon[65619]: pgmap v2070: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:43.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:42 smithi026 ceph-mon[96795]: pgmap v2071: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:43.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:42 smithi194 ceph-mon[65619]: pgmap v2071: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:45.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:44 smithi026 ceph-mon[96795]: pgmap v2072: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:45.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:44 smithi194 ceph-mon[65619]: pgmap v2072: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:47.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:46 smithi026 ceph-mon[96795]: pgmap v2073: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:47.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:46 smithi194 ceph-mon[65619]: pgmap v2073: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:49.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:48 smithi026 ceph-mon[96795]: pgmap v2074: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:49.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:03:49.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:03:49.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:48 smithi194 ceph-mon[65619]: pgmap v2074: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:49.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:03:49.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:03:51.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:50 smithi026 ceph-mon[96795]: pgmap v2075: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:51.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:50 smithi194 ceph-mon[65619]: pgmap v2075: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:53.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:52 smithi026 ceph-mon[96795]: pgmap v2076: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:53.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:52 smithi194 ceph-mon[65619]: pgmap v2076: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:55.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:54 smithi026 ceph-mon[96795]: pgmap v2077: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:55.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:03:55.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:03:55.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:03:55.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:03:55.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:03:55.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:03:55.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:03:55.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:03:55.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:54 smithi194 ceph-mon[65619]: pgmap v2077: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:55.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:03:55.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:03:55.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:03:55.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:03:55.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:03:55.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:03:55.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:03:55.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:03:56.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:55 smithi026 ceph-mon[96795]: poll took 60058.258 ms: 1 events 2021-11-03T18:03:56.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:55 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:03:56.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:55 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:03:56.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:55 smithi194 ceph-mon[65619]: poll took 60058.258 ms: 1 events 2021-11-03T18:03:56.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:55 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:03:56.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:55 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:03:57.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:56 smithi026 ceph-mon[96795]: pgmap v2078: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:57.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:56 smithi194 ceph-mon[65619]: pgmap v2078: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:59.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:03:58 smithi026 ceph-mon[96795]: pgmap v2079: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:03:59.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:03:58 smithi194 ceph-mon[65619]: pgmap v2079: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:01.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:00 smithi026 ceph-mon[96795]: pgmap v2080: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:01.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:00 smithi194 ceph-mon[65619]: pgmap v2080: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:03.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:02 smithi026 ceph-mon[96795]: pgmap v2081: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:03.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:02 smithi194 ceph-mon[65619]: pgmap v2081: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:04.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:03 smithi194 ceph-mon[65619]: pgmap v2082: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:04.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.262+0000 7fbc7759e700 1 -- 172.21.15.26:0/1094074556 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc780f77d0 msgr2=0x7fbc780f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:04:04.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.262+0000 7fbc7759e700 1 --2- 172.21.15.26:0/1094074556 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc780f77d0 0x7fbc780f7c30 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 rx=0x7fbc68004660 tx=0x7fbc68009b30).stop 2021-11-03T18:04:04.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.262+0000 7fbc7759e700 1 -- 172.21.15.26:0/1094074556 shutdown_connections 2021-11-03T18:04:04.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.262+0000 7fbc7759e700 1 --2- 172.21.15.26:0/1094074556 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc780f77d0 0x7fbc780f7c30 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:04.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.262+0000 7fbc7759e700 1 --2- 172.21.15.26:0/1094074556 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc780f6530 0x7fbc780f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:04.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.262+0000 7fbc7759e700 1 -- 172.21.15.26:0/1094074556 >> 172.21.15.26:0/1094074556 conn(0x7fbc780f1cd0 msgr2=0x7fbc780f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:04:04.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.262+0000 7fbc7759e700 1 -- 172.21.15.26:0/1094074556 shutdown_connections 2021-11-03T18:04:04.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.262+0000 7fbc7759e700 1 -- 172.21.15.26:0/1094074556 wait complete. 2021-11-03T18:04:04.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.262+0000 7fbc7759e700 1 Processor -- start 2021-11-03T18:04:04.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.262+0000 7fbc7759e700 1 -- start start 2021-11-03T18:04:04.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.263+0000 7fbc7759e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc780f6530 0x7fbc78106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:04:04.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.263+0000 7fbc7759e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc780f77d0 0x7fbc78107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:04:04.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.263+0000 7fbc7759e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc78107870 con 0x7fbc780f77d0 2021-11-03T18:04:04.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.263+0000 7fbc7759e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc78108080 con 0x7fbc780f6530 2021-11-03T18:04:04.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.263+0000 7fbc75d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc780f77d0 0x7fbc78107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:04:04.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.263+0000 7fbc75d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc780f77d0 0x7fbc78107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57930/0 (socket says 172.21.15.26:57930) 2021-11-03T18:04:04.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.263+0000 7fbc75d9b700 1 -- 172.21.15.26:0/1130568980 learned_addr learned my addr 172.21.15.26:0/1130568980 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:04:04.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.263+0000 7fbc7659c700 1 --2- 172.21.15.26:0/1130568980 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc780f6530 0x7fbc78106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:04:04.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.263+0000 7fbc75d9b700 1 -- 172.21.15.26:0/1130568980 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc780f6530 msgr2=0x7fbc78106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:04:04.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.263+0000 7fbc75d9b700 1 --2- 172.21.15.26:0/1130568980 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc780f6530 0x7fbc78106d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:04.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.263+0000 7fbc75d9b700 1 -- 172.21.15.26:0/1130568980 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc68005040 con 0x7fbc780f77d0 2021-11-03T18:04:04.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.263+0000 7fbc75d9b700 1 --2- 172.21.15.26:0/1130568980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc780f77d0 0x7fbc78107270 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7fbc68009830 tx=0x7fbc68009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:04:04.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.263+0000 7fbc66ffd700 1 -- 172.21.15.26:0/1130568980 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc68018070 con 0x7fbc780f77d0 2021-11-03T18:04:04.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.263+0000 7fbc66ffd700 1 -- 172.21.15.26:0/1130568980 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbc68007ba0 con 0x7fbc780f77d0 2021-11-03T18:04:04.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.263+0000 7fbc7759e700 1 -- 172.21.15.26:0/1130568980 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc781082a0 con 0x7fbc780f77d0 2021-11-03T18:04:04.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.263+0000 7fbc66ffd700 1 -- 172.21.15.26:0/1130568980 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc6801c3c0 con 0x7fbc780f77d0 2021-11-03T18:04:04.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.264+0000 7fbc7759e700 1 -- 172.21.15.26:0/1130568980 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc78108800 con 0x7fbc780f77d0 2021-11-03T18:04:04.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.265+0000 7fbc7759e700 1 -- 172.21.15.26:0/1130568980 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc78059100 con 0x7fbc780f77d0 2021-11-03T18:04:04.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.265+0000 7fbc66ffd700 1 -- 172.21.15.26:0/1130568980 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fbc6801d420 con 0x7fbc780f77d0 2021-11-03T18:04:04.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.265+0000 7fbc66ffd700 1 --2- 172.21.15.26:0/1130568980 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbc60064100 0x7fbc600665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:04:04.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.266+0000 7fbc66ffd700 1 -- 172.21.15.26:0/1130568980 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fbc680822f0 con 0x7fbc780f77d0 2021-11-03T18:04:04.270 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.266+0000 7fbc7659c700 1 --2- 172.21.15.26:0/1130568980 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbc60064100 0x7fbc600665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:04:04.270 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.266+0000 7fbc7659c700 1 --2- 172.21.15.26:0/1130568980 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbc60064100 0x7fbc600665c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7fbc78106af0 tx=0x7fbc6c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:04:04.270 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.270+0000 7fbc66ffd700 1 -- 172.21.15.26:0/1130568980 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fbc68054650 con 0x7fbc780f77d0 2021-11-03T18:04:04.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:03 smithi026 ceph-mon[96795]: pgmap v2082: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:04.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.448+0000 7fbc7759e700 1 -- 172.21.15.26:0/1130568980 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc780fee80 con 0x7fbc60064100 2021-11-03T18:04:04.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.450+0000 7fbc66ffd700 1 -- 172.21.15.26:0/1130568980 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fbc780fee80 con 0x7fbc60064100 2021-11-03T18:04:04.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.452+0000 7fbc7759e700 1 -- 172.21.15.26:0/1130568980 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbc60064100 msgr2=0x7fbc600665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:04:04.450 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.452+0000 7fbc7759e700 1 --2- 172.21.15.26:0/1130568980 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbc60064100 0x7fbc600665c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7fbc78106af0 tx=0x7fbc6c00b040).stop 2021-11-03T18:04:04.450 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.452+0000 7fbc7759e700 1 -- 172.21.15.26:0/1130568980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc780f77d0 msgr2=0x7fbc78107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:04:04.450 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.452+0000 7fbc7759e700 1 --2- 172.21.15.26:0/1130568980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc780f77d0 0x7fbc78107270 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7fbc68009830 tx=0x7fbc68009b30).stop 2021-11-03T18:04:04.450 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.452+0000 7fbc7759e700 1 -- 172.21.15.26:0/1130568980 shutdown_connections 2021-11-03T18:04:04.451 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.452+0000 7fbc7759e700 1 --2- 172.21.15.26:0/1130568980 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbc60064100 0x7fbc600665c0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:04.451 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.452+0000 7fbc7759e700 1 --2- 172.21.15.26:0/1130568980 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc780f6530 0x7fbc78106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:04.451 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.452+0000 7fbc7759e700 1 --2- 172.21.15.26:0/1130568980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc780f77d0 0x7fbc78107270 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:04.452 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.452+0000 7fbc7759e700 1 -- 172.21.15.26:0/1130568980 >> 172.21.15.26:0/1130568980 conn(0x7fbc780f1cd0 msgr2=0x7fbc780fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:04:04.452 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.452+0000 7fbc7759e700 1 -- 172.21.15.26:0/1130568980 shutdown_connections 2021-11-03T18:04:04.452 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.452+0000 7fbc7759e700 1 -- 172.21.15.26:0/1130568980 wait complete. 2021-11-03T18:04:04.459 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:04:04.551 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.552+0000 7fa2b2192700 1 -- 172.21.15.26:0/2347986739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2ac0f66e0 msgr2=0x7fa2ac0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:04:04.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.552+0000 7fa2b2192700 1 --2- 172.21.15.26:0/2347986739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2ac0f66e0 0x7fa2ac0f6b00 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7fa2a0004660 tx=0x7fa2a0009b30).stop 2021-11-03T18:04:04.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.552+0000 7fa2b2192700 1 -- 172.21.15.26:0/2347986739 shutdown_connections 2021-11-03T18:04:04.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.552+0000 7fa2b2192700 1 --2- 172.21.15.26:0/2347986739 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2ac0f6ff0 0x7fa2ac0f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:04.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.552+0000 7fa2b2192700 1 --2- 172.21.15.26:0/2347986739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2ac0f66e0 0x7fa2ac0f6b00 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:04.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.552+0000 7fa2b2192700 1 -- 172.21.15.26:0/2347986739 >> 172.21.15.26:0/2347986739 conn(0x7fa2ac0f1f00 msgr2=0x7fa2ac0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:04:04.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.552+0000 7fa2b2192700 1 -- 172.21.15.26:0/2347986739 shutdown_connections 2021-11-03T18:04:04.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.552+0000 7fa2b2192700 1 -- 172.21.15.26:0/2347986739 wait complete. 2021-11-03T18:04:04.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.552+0000 7fa2b2192700 1 Processor -- start 2021-11-03T18:04:04.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.553+0000 7fa2b2192700 1 -- start start 2021-11-03T18:04:04.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.553+0000 7fa2b2192700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2ac0f66e0 0x7fa2ac106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:04:04.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.553+0000 7fa2b2192700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2ac0f6ff0 0x7fa2ac107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:04:04.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.553+0000 7fa2b2192700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac107a00 con 0x7fa2ac0f66e0 2021-11-03T18:04:04.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.553+0000 7fa2b2192700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac107b40 con 0x7fa2ac0f6ff0 2021-11-03T18:04:04.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.553+0000 7fa2ab7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2ac0f66e0 0x7fa2ac106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:04:04.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.553+0000 7fa2ab7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2ac0f66e0 0x7fa2ac106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57938/0 (socket says 172.21.15.26:57938) 2021-11-03T18:04:04.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.553+0000 7fa2ab7fe700 1 -- 172.21.15.26:0/3979901120 learned_addr learned my addr 172.21.15.26:0/3979901120 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:04:04.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.553+0000 7fa2aaffd700 1 --2- 172.21.15.26:0/3979901120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2ac0f6ff0 0x7fa2ac107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:04:04.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.553+0000 7fa2ab7fe700 1 -- 172.21.15.26:0/3979901120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2ac0f6ff0 msgr2=0x7fa2ac107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:04:04.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.553+0000 7fa2ab7fe700 1 --2- 172.21.15.26:0/3979901120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2ac0f6ff0 0x7fa2ac107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:04.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.553+0000 7fa2ab7fe700 1 -- 172.21.15.26:0/3979901120 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a0005040 con 0x7fa2ac0f66e0 2021-11-03T18:04:04.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.553+0000 7fa2aaffd700 1 --2- 172.21.15.26:0/3979901120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2ac0f6ff0 0x7fa2ac107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:04:04.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.553+0000 7fa2ab7fe700 1 --2- 172.21.15.26:0/3979901120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2ac0f66e0 0x7fa2ac106f60 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 rx=0x7fa2a0009990 tx=0x7fa2a0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:04:04.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.553+0000 7fa293fff700 1 -- 172.21.15.26:0/3979901120 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2a0018070 con 0x7fa2ac0f66e0 2021-11-03T18:04:04.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.554+0000 7fa2b2192700 1 -- 172.21.15.26:0/3979901120 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2ac108480 con 0x7fa2ac0f66e0 2021-11-03T18:04:04.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.554+0000 7fa293fff700 1 -- 172.21.15.26:0/3979901120 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa2a0007ca0 con 0x7fa2ac0f66e0 2021-11-03T18:04:04.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.554+0000 7fa293fff700 1 -- 172.21.15.26:0/3979901120 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2a001c620 con 0x7fa2ac0f66e0 2021-11-03T18:04:04.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.554+0000 7fa2b2192700 1 -- 172.21.15.26:0/3979901120 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2ac1089e0 con 0x7fa2ac0f66e0 2021-11-03T18:04:04.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.554+0000 7fa2b2192700 1 -- 172.21.15.26:0/3979901120 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2ac045ad0 con 0x7fa2ac0f66e0 2021-11-03T18:04:04.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.555+0000 7fa293fff700 1 -- 172.21.15.26:0/3979901120 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fa2a001d960 con 0x7fa2ac0f66e0 2021-11-03T18:04:04.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.556+0000 7fa293fff700 1 --2- 172.21.15.26:0/3979901120 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa2940640b0 0x7fa294066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:04:04.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.556+0000 7fa293fff700 1 -- 172.21.15.26:0/3979901120 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fa2a00826a0 con 0x7fa2ac0f66e0 2021-11-03T18:04:04.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.556+0000 7fa2aaffd700 1 --2- 172.21.15.26:0/3979901120 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa2940640b0 0x7fa294066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:04:04.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.556+0000 7fa2aaffd700 1 --2- 172.21.15.26:0/3979901120 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa2940640b0 0x7fa294066570 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7fa29c004a70 tx=0x7fa29c009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:04:04.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.559+0000 7fa293fff700 1 -- 172.21.15.26:0/3979901120 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fa2a0054a00 con 0x7fa2ac0f66e0 2021-11-03T18:04:04.730 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.732+0000 7fa2b2192700 1 -- 172.21.15.26:0/3979901120 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2ac0fefe0 con 0x7fa2940640b0 2021-11-03T18:04:04.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.747+0000 7fa293fff700 1 -- 172.21.15.26:0/3979901120 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fa2ac0fefe0 con 0x7fa2940640b0 2021-11-03T18:04:04.745 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:04:04.745 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (75m) 4m ago 76m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:04:04.746 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (67m) 4m ago 76m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:04:04.746 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (67m) 3m ago 75m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:04:04.746 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (75m) 4m ago 76m 41.7M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:04:04.747 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (68m) 4m ago 71m 25.6M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:04:04.747 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (68m) 4m ago 71m 26.2M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:04:04.747 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (71m) 3m ago 71m 26.4M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:04:04.747 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (71m) 3m ago 71m 26.8M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:04:04.748 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (69m) 4m ago 77m 561M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:04:04.748 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (68m) 3m ago 75m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:04:04.748 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (68m) 4m ago 78m 276M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:04:04.748 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (68m) 3m ago 75m 132M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:04:04.749 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (76m) 4m ago 76m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:04:04.749 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (75m) 3m ago 75m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:04:04.749 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (67m) 4m ago 74m 292M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:04:04.749 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (66m) 4m ago 74m 313M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:04:04.749 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (66m) 4m ago 74m 261M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:04:04.750 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (65m) 3m ago 73m 337M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:04:04.750 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (65m) 3m ago 73m 283M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:04:04.750 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (64m) 3m ago 73m 276M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:04:04.750 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (75m) 4m ago 75m 61.2M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:04:04.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.749+0000 7fa2b2192700 1 -- 172.21.15.26:0/3979901120 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa2940640b0 msgr2=0x7fa294066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:04:04.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.749+0000 7fa2b2192700 1 --2- 172.21.15.26:0/3979901120 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa2940640b0 0x7fa294066570 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7fa29c004a70 tx=0x7fa29c009040).stop 2021-11-03T18:04:04.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.749+0000 7fa2b2192700 1 -- 172.21.15.26:0/3979901120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2ac0f66e0 msgr2=0x7fa2ac106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:04:04.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.749+0000 7fa2b2192700 1 --2- 172.21.15.26:0/3979901120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2ac0f66e0 0x7fa2ac106f60 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 rx=0x7fa2a0009990 tx=0x7fa2a0009b30).stop 2021-11-03T18:04:04.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.749+0000 7fa2b2192700 1 -- 172.21.15.26:0/3979901120 shutdown_connections 2021-11-03T18:04:04.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.749+0000 7fa2b2192700 1 --2- 172.21.15.26:0/3979901120 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa2940640b0 0x7fa294066570 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:04.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.749+0000 7fa2b2192700 1 --2- 172.21.15.26:0/3979901120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2ac0f66e0 0x7fa2ac106f60 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:04.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.749+0000 7fa2b2192700 1 --2- 172.21.15.26:0/3979901120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2ac0f6ff0 0x7fa2ac107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:04.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.749+0000 7fa2b2192700 1 -- 172.21.15.26:0/3979901120 >> 172.21.15.26:0/3979901120 conn(0x7fa2ac0f1f00 msgr2=0x7fa2ac0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:04:04.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.749+0000 7fa2b2192700 1 -- 172.21.15.26:0/3979901120 shutdown_connections 2021-11-03T18:04:04.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.749+0000 7fa2b2192700 1 -- 172.21.15.26:0/3979901120 wait complete. 2021-11-03T18:04:04.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.848+0000 7f4a18d11700 1 -- 172.21.15.26:0/2592763398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a140f6b90 msgr2=0x7f4a140f6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:04:04.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.848+0000 7f4a18d11700 1 --2- 172.21.15.26:0/2592763398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a140f6b90 0x7f4a140f6fb0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 rx=0x7f4a0c0099e0 tx=0x7f4a0c004d10).stop 2021-11-03T18:04:04.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.848+0000 7f4a18d11700 1 -- 172.21.15.26:0/2592763398 shutdown_connections 2021-11-03T18:04:04.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.848+0000 7f4a18d11700 1 --2- 172.21.15.26:0/2592763398 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a140f74a0 0x7f4a140f5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:04:04.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.848+0000 7f4a18d11700 1 --2- 172.21.15.26:0/2592763398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a140f6b90 0x7f4a140f6fb0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:04.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.848+0000 7f4a18d11700 1 -- 172.21.15.26:0/2592763398 >> 172.21.15.26:0/2592763398 conn(0x7f4a140f0540 msgr2=0x7f4a140f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:04:04.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.848+0000 7f4a18d11700 1 -- 172.21.15.26:0/2592763398 shutdown_connections 2021-11-03T18:04:04.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.848+0000 7f4a18d11700 1 -- 172.21.15.26:0/2592763398 wait complete. 2021-11-03T18:04:04.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.849+0000 7f4a18d11700 1 Processor -- start 2021-11-03T18:04:04.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.849+0000 7f4a18d11700 1 -- start start 2021-11-03T18:04:04.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.849+0000 7f4a18d11700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a140f6b90 0x7f4a14106010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:04:04.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.849+0000 7f4a18d11700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a140f74a0 0x7f4a14106500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:04:04.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.849+0000 7f4a18d11700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a14106b40 con 0x7f4a140f74a0 2021-11-03T18:04:04.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.849+0000 7f4a18d11700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a141073f0 con 0x7f4a140f6b90 2021-11-03T18:04:04.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.849+0000 7f4a11d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a140f74a0 0x7f4a14106500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:04:04.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.849+0000 7f4a11d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a140f74a0 0x7f4a14106500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57950/0 (socket says 172.21.15.26:57950) 2021-11-03T18:04:04.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.849+0000 7f4a11d9b700 1 -- 172.21.15.26:0/354820033 learned_addr learned my addr 172.21.15.26:0/354820033 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:04:04.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.849+0000 7f4a1259c700 1 --2- 172.21.15.26:0/354820033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a140f6b90 0x7f4a14106010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:04:04.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.849+0000 7f4a11d9b700 1 -- 172.21.15.26:0/354820033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a140f6b90 msgr2=0x7f4a14106010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:04:04.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.849+0000 7f4a11d9b700 1 --2- 172.21.15.26:0/354820033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a140f6b90 0x7f4a14106010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:04.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.849+0000 7f4a11d9b700 1 -- 172.21.15.26:0/354820033 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a0c009640 con 0x7f4a140f74a0 2021-11-03T18:04:04.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.849+0000 7f4a1259c700 1 --2- 172.21.15.26:0/354820033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a140f6b90 0x7f4a14106010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:04:04.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.850+0000 7f4a11d9b700 1 --2- 172.21.15.26:0/354820033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a140f74a0 0x7f4a14106500 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 rx=0x7f49fc00d770 tx=0x7f49fc00db30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:04:04.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.850+0000 7f4a0affd700 1 -- 172.21.15.26:0/354820033 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49fc00ea60 con 0x7f4a140f74a0 2021-11-03T18:04:04.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.850+0000 7f4a0affd700 1 -- 172.21.15.26:0/354820033 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f49fc012070 con 0x7f4a140f74a0 2021-11-03T18:04:04.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.850+0000 7f4a18d11700 1 -- 172.21.15.26:0/354820033 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a14107670 con 0x7f4a140f74a0 2021-11-03T18:04:04.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.850+0000 7f4a0affd700 1 -- 172.21.15.26:0/354820033 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49fc015330 con 0x7f4a140f74a0 2021-11-03T18:04:04.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.850+0000 7f4a18d11700 1 -- 172.21.15.26:0/354820033 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a14107b50 con 0x7f4a140f74a0 2021-11-03T18:04:04.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.851+0000 7f4a18d11700 1 -- 172.21.15.26:0/354820033 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a14045ad0 con 0x7f4a140f74a0 2021-11-03T18:04:04.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.851+0000 7f4a0affd700 1 -- 172.21.15.26:0/354820033 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f49fc01e070 con 0x7f4a140f74a0 2021-11-03T18:04:04.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.852+0000 7f4a0affd700 1 --2- 172.21.15.26:0/354820033 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4a000640b0 0x7f4a00066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:04:04.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.852+0000 7f4a0affd700 1 -- 172.21.15.26:0/354820033 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f49fc082cc0 con 0x7f4a140f74a0 2021-11-03T18:04:04.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.852+0000 7f4a1259c700 1 --2- 172.21.15.26:0/354820033 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4a000640b0 0x7f4a00066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:04:04.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.852+0000 7f4a1259c700 1 --2- 172.21.15.26:0/354820033 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4a000640b0 0x7f4a00066570 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f4a0c009f50 tx=0x7f4a0c004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:04:04.858 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:04.856+0000 7f4a0affd700 1 -- 172.21.15.26:0/354820033 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f49fc054ed0 con 0x7f4a140f74a0 2021-11-03T18:04:05.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.082+0000 7f4a18d11700 1 -- 172.21.15.26:0/354820033 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4a141081f0 con 0x7f4a140f74a0 2021-11-03T18:04:05.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.083+0000 7f4a0affd700 1 -- 172.21.15.26:0/354820033 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f49fc01c070 con 0x7f4a140f74a0 2021-11-03T18:04:05.081 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:04:05.082 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:04:05.082 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:04:05.082 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:04:05.082 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:04:05.083 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:04:05.083 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:04:05.083 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:04:05.083 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:04:05.084 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:04:05.084 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:04:05.084 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:04:05.084 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:04:05.084 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:04:05.085 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:04:05.085 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:04:05.085 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:04:05.085 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:04:05.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.085+0000 7f4a18d11700 1 -- 172.21.15.26:0/354820033 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4a000640b0 msgr2=0x7f4a00066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:04:05.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.085+0000 7f4a18d11700 1 --2- 172.21.15.26:0/354820033 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4a000640b0 0x7f4a00066570 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f4a0c009f50 tx=0x7f4a0c004d10).stop 2021-11-03T18:04:05.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.085+0000 7f4a18d11700 1 -- 172.21.15.26:0/354820033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a140f74a0 msgr2=0x7f4a14106500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:04:05.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.085+0000 7f4a18d11700 1 --2- 172.21.15.26:0/354820033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a140f74a0 0x7f4a14106500 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 rx=0x7f49fc00d770 tx=0x7f49fc00db30).stop 2021-11-03T18:04:05.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.085+0000 7f4a18d11700 1 -- 172.21.15.26:0/354820033 shutdown_connections 2021-11-03T18:04:05.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.085+0000 7f4a18d11700 1 --2- 172.21.15.26:0/354820033 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4a000640b0 0x7f4a00066570 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:05.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.085+0000 7f4a18d11700 1 --2- 172.21.15.26:0/354820033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a140f6b90 0x7f4a14106010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:05.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.085+0000 7f4a18d11700 1 --2- 172.21.15.26:0/354820033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a140f74a0 0x7f4a14106500 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:05.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.085+0000 7f4a18d11700 1 -- 172.21.15.26:0/354820033 >> 172.21.15.26:0/354820033 conn(0x7f4a140f0540 msgr2=0x7f4a140fa390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:04:05.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.085+0000 7f4a18d11700 1 -- 172.21.15.26:0/354820033 shutdown_connections 2021-11-03T18:04:05.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.085+0000 7f4a18d11700 1 -- 172.21.15.26:0/354820033 wait complete. 2021-11-03T18:04:05.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.185+0000 7f25f9451700 1 -- 172.21.15.26:0/70073090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f40fcce0 msgr2=0x7f25f40fd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:04:05.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.185+0000 7f25f9451700 1 --2- 172.21.15.26:0/70073090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f40fcce0 0x7f25f40fd100 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 rx=0x7f25e4004660 tx=0x7f25e4009b30).stop 2021-11-03T18:04:05.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.185+0000 7f25f9451700 1 -- 172.21.15.26:0/70073090 shutdown_connections 2021-11-03T18:04:05.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.185+0000 7f25f9451700 1 --2- 172.21.15.26:0/70073090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25f40fdf80 0x7f25f40fe3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:05.186 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.185+0000 7f25f9451700 1 --2- 172.21.15.26:0/70073090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f40fcce0 0x7f25f40fd100 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:05.186 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.185+0000 7f25f9451700 1 -- 172.21.15.26:0/70073090 >> 172.21.15.26:0/70073090 conn(0x7f25f406c000 msgr2=0x7f25f406e420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:04:05.186 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.185+0000 7f25f9451700 1 -- 172.21.15.26:0/70073090 shutdown_connections 2021-11-03T18:04:05.186 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.185+0000 7f25f9451700 1 -- 172.21.15.26:0/70073090 wait complete. 2021-11-03T18:04:05.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.186+0000 7f25f9451700 1 Processor -- start 2021-11-03T18:04:05.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.186+0000 7f25f9451700 1 -- start start 2021-11-03T18:04:05.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.186+0000 7f25f9451700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f40fcce0 0x7f25f410d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:04:05.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.186+0000 7f25f9451700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25f40fdf80 0x7f25f410daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:04:05.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.186+0000 7f25f9451700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f410e050 con 0x7f25f40fcce0 2021-11-03T18:04:05.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.186+0000 7f25f9451700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f410e190 con 0x7f25f40fdf80 2021-11-03T18:04:05.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.186+0000 7f25f2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f40fcce0 0x7f25f410d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:04:05.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.186+0000 7f25f2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f40fcce0 0x7f25f410d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57958/0 (socket says 172.21.15.26:57958) 2021-11-03T18:04:05.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.186+0000 7f25f2ffd700 1 -- 172.21.15.26:0/4131291196 learned_addr learned my addr 172.21.15.26:0/4131291196 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:04:05.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.186+0000 7f25f2ffd700 1 -- 172.21.15.26:0/4131291196 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25f40fdf80 msgr2=0x7f25f410daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:04:05.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.186+0000 7f25f2ffd700 1 --2- 172.21.15.26:0/4131291196 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25f40fdf80 0x7f25f410daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:04:05.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.186+0000 7f25f2ffd700 1 -- 172.21.15.26:0/4131291196 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e4005040 con 0x7f25f40fcce0 2021-11-03T18:04:05.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.186+0000 7f25f2ffd700 1 --2- 172.21.15.26:0/4131291196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f40fcce0 0x7f25f410d5b0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7f25e4004f60 tx=0x7f25e4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:04:05.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.187+0000 7f25eb7fe700 1 -- 172.21.15.26:0/4131291196 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25e4018070 con 0x7f25f40fcce0 2021-11-03T18:04:05.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.187+0000 7f25eb7fe700 1 -- 172.21.15.26:0/4131291196 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f25e4007ba0 con 0x7f25f40fcce0 2021-11-03T18:04:05.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.187+0000 7f25f9451700 1 -- 172.21.15.26:0/4131291196 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25f410ead0 con 0x7f25f40fcce0 2021-11-03T18:04:05.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.187+0000 7f25eb7fe700 1 -- 172.21.15.26:0/4131291196 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25e401c620 con 0x7f25f40fcce0 2021-11-03T18:04:05.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.187+0000 7f25f9451700 1 -- 172.21.15.26:0/4131291196 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25f410f030 con 0x7f25f40fcce0 2021-11-03T18:04:05.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.188+0000 7f25f9451700 1 -- 172.21.15.26:0/4131291196 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25f4045ad0 con 0x7f25f40fcce0 2021-11-03T18:04:05.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.188+0000 7f25eb7fe700 1 -- 172.21.15.26:0/4131291196 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f25e401d420 con 0x7f25f40fcce0 2021-11-03T18:04:05.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.188+0000 7f25eb7fe700 1 --2- 172.21.15.26:0/4131291196 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f25e00640b0 0x7f25e0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:04:05.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.189+0000 7f25eb7fe700 1 -- 172.21.15.26:0/4131291196 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f25e4082690 con 0x7f25f40fcce0 2021-11-03T18:04:05.193 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.189+0000 7f25ebfff700 1 --2- 172.21.15.26:0/4131291196 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f25e00640b0 0x7f25e0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:04:05.193 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.189+0000 7f25ebfff700 1 --2- 172.21.15.26:0/4131291196 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f25e00640b0 0x7f25e0066570 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f25dc0047d0 tx=0x7f25dc007a40).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:04:05.193 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.193+0000 7f25eb7fe700 1 -- 172.21.15.26:0/4131291196 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f25e4054ab0 con 0x7f25f40fcce0 2021-11-03T18:04:05.395 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.398+0000 7f25f9451700 1 -- 172.21.15.26:0/4131291196 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f25f4027a00 con 0x7f25f40fcce0 2021-11-03T18:04:05.396 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.398+0000 7f25eb7fe700 1 -- 172.21.15.26:0/4131291196 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f25e40546a0 con 0x7f25f40fcce0 2021-11-03T18:04:05.396 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:04:05.397 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:04:05.397 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:04:05.397 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:04:05.397 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:04:05.398 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:04:05.398 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:04:05.398 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:04:05.398 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:04:05.399 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:04:05.399 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:04:05.399 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:04:05.399 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:04:05.399 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:04:05.400 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:04:05.400 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:04:05.400 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:04:05.400 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:04:05.401 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:04:05.401 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:04:05.401 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:04:05.401 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:04:05.402 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:04:05.402 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:04:05.402 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:04:05.402 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:04:05.403 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:04:05.403 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:04:05.403 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:04:05.403 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:04:05.403 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:04:05.404 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:04:05.404 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:04:05.404 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:04:05.404 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:04:05.405 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:04:05.405 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:04:05.405 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:04:05.405 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:04:05.406 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.400+0000 7f25f9451700 1 -- 172.21.15.26:0/4131291196 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f25e00640b0 msgr2=0x7f25e0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:04:05.406 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.400+0000 7f25f9451700 1 --2- 172.21.15.26:0/4131291196 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f25e00640b0 0x7f25e0066570 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f25dc0047d0 tx=0x7f25dc007a40).stop 2021-11-03T18:04:05.407 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.400+0000 7f25f9451700 1 -- 172.21.15.26:0/4131291196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f40fcce0 msgr2=0x7f25f410d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:04:05.407 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.400+0000 7f25f9451700 1 --2- 172.21.15.26:0/4131291196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f40fcce0 0x7f25f410d5b0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7f25e4004f60 tx=0x7f25e4009b30).stop 2021-11-03T18:04:05.407 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.400+0000 7f25f9451700 1 -- 172.21.15.26:0/4131291196 shutdown_connections 2021-11-03T18:04:05.407 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.400+0000 7f25f9451700 1 --2- 172.21.15.26:0/4131291196 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f25e00640b0 0x7f25e0066570 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:05.408 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.400+0000 7f25f9451700 1 --2- 172.21.15.26:0/4131291196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f40fcce0 0x7f25f410d5b0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:05.408 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.400+0000 7f25f9451700 1 --2- 172.21.15.26:0/4131291196 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25f40fdf80 0x7f25f410daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:04:05.408 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.400+0000 7f25f9451700 1 -- 172.21.15.26:0/4131291196 >> 172.21.15.26:0/4131291196 conn(0x7f25f406c000 msgr2=0x7f25f41019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:04:05.408 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.400+0000 7f25f9451700 1 -- 172.21.15.26:0/4131291196 shutdown_connections 2021-11-03T18:04:05.408 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:05.400+0000 7f25f9451700 1 -- 172.21.15.26:0/4131291196 wait complete. 2021-11-03T18:04:05.409 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:04:05.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:05 smithi026 ceph-mon[96795]: from='client.36284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:04:05.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:05 smithi026 ceph-mon[96795]: from='client.36288 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:04:05.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:05 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/354820033' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:04:05.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:05 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/4131291196' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:04:05.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:05 smithi194 ceph-mon[65619]: from='client.36284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:04:06.074 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:05 smithi194 ceph-mon[65619]: from='client.36288 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:04:06.075 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:05 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/354820033' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:04:06.075 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:05 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/4131291196' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:04:06.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:06 smithi026 ceph-mon[96795]: pgmap v2083: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:06.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:06 smithi194 ceph-mon[65619]: pgmap v2083: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:08.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:08 smithi026 ceph-mon[96795]: pgmap v2084: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:08.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:08 smithi194 ceph-mon[65619]: pgmap v2084: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:10.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:10 smithi026 ceph-mon[96795]: pgmap v2085: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:10.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:10 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:04:10.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:10 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:04:10.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:10 smithi194 ceph-mon[65619]: pgmap v2085: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:11.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:10 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:04:11.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:10 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:04:12.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:12 smithi026 ceph-mon[96795]: pgmap v2086: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:12.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:12 smithi194 ceph-mon[65619]: pgmap v2086: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:14.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:14 smithi026 ceph-mon[96795]: pgmap v2087: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:14.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:14 smithi194 ceph-mon[65619]: pgmap v2087: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:16.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:16 smithi026 ceph-mon[96795]: pgmap v2088: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:16.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:16 smithi194 ceph-mon[65619]: pgmap v2088: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:18.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:18 smithi026 ceph-mon[96795]: pgmap v2089: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:18.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:18 smithi194 ceph-mon[65619]: pgmap v2089: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:20.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:20 smithi026 ceph-mon[96795]: pgmap v2090: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:20.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:20 smithi194 ceph-mon[65619]: pgmap v2090: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:22.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:22 smithi026 ceph-mon[96795]: pgmap v2091: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:22.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:22 smithi194 ceph-mon[65619]: pgmap v2091: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:24.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:24 smithi026 ceph-mon[96795]: pgmap v2092: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:24.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:24 smithi194 ceph-mon[65619]: pgmap v2092: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:25.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:04:25.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:25 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:04:25.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:04:25.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:25 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:04:26.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:26 smithi026 ceph-mon[96795]: pgmap v2093: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:26.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:26 smithi194 ceph-mon[65619]: pgmap v2093: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:28.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:28 smithi026 ceph-mon[96795]: pgmap v2094: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:28.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:28 smithi194 ceph-mon[65619]: pgmap v2094: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:30.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:30 smithi026 ceph-mon[96795]: pgmap v2095: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:30.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:30 smithi194 ceph-mon[65619]: pgmap v2095: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:32.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:32 smithi026 ceph-mon[96795]: pgmap v2096: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:32.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:32 smithi194 ceph-mon[65619]: pgmap v2096: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:34.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:34 smithi026 ceph-mon[96795]: pgmap v2097: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:34.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:34 smithi194 ceph-mon[65619]: pgmap v2097: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:35.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.515+0000 7fb18da71700 1 -- 172.21.15.26:0/1384575074 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1880f55c0 msgr2=0x7fb1880f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:04:35.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.515+0000 7fb18da71700 1 --2- 172.21.15.26:0/1384575074 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1880f55c0 0x7fb1880f59e0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 rx=0x7fb1800099e0 tx=0x7fb180004d10).stop 2021-11-03T18:04:35.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.515+0000 7fb18da71700 1 -- 172.21.15.26:0/1384575074 shutdown_connections 2021-11-03T18:04:35.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.515+0000 7fb18da71700 1 --2- 172.21.15.26:0/1384575074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1880f6860 0x7fb1880f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:35.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.515+0000 7fb18da71700 1 --2- 172.21.15.26:0/1384575074 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1880f55c0 0x7fb1880f59e0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:35.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.515+0000 7fb18da71700 1 -- 172.21.15.26:0/1384575074 >> 172.21.15.26:0/1384575074 conn(0x7fb1880f0d40 msgr2=0x7fb1880f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:04:35.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.515+0000 7fb18da71700 1 -- 172.21.15.26:0/1384575074 shutdown_connections 2021-11-03T18:04:35.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.515+0000 7fb18da71700 1 -- 172.21.15.26:0/1384575074 wait complete. 2021-11-03T18:04:35.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.516+0000 7fb18da71700 1 Processor -- start 2021-11-03T18:04:35.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.516+0000 7fb18da71700 1 -- start start 2021-11-03T18:04:35.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.516+0000 7fb18da71700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1880f55c0 0x7fb188109d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:04:35.517 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.516+0000 7fb18da71700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1880f6860 0x7fb18810c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:04:35.517 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.516+0000 7fb18da71700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1880603e0 con 0x7fb1880f55c0 2021-11-03T18:04:35.517 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.516+0000 7fb18da71700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb188060520 con 0x7fb1880f6860 2021-11-03T18:04:35.517 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.516+0000 7fb1877fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1880f55c0 0x7fb188109d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:04:35.518 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.516+0000 7fb1877fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1880f55c0 0x7fb188109d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57976/0 (socket says 172.21.15.26:57976) 2021-11-03T18:04:35.518 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.516+0000 7fb1877fe700 1 -- 172.21.15.26:0/3395866215 learned_addr learned my addr 172.21.15.26:0/3395866215 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:04:35.518 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.516+0000 7fb186ffd700 1 --2- 172.21.15.26:0/3395866215 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1880f6860 0x7fb18810c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:04:35.518 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.516+0000 7fb1877fe700 1 -- 172.21.15.26:0/3395866215 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1880f6860 msgr2=0x7fb18810c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:04:35.518 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.516+0000 7fb1877fe700 1 --2- 172.21.15.26:0/3395866215 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1880f6860 0x7fb18810c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:35.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.516+0000 7fb1877fe700 1 -- 172.21.15.26:0/3395866215 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb180009640 con 0x7fb1880f55c0 2021-11-03T18:04:35.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.517+0000 7fb1877fe700 1 --2- 172.21.15.26:0/3395866215 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1880f55c0 0x7fb188109d60 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 rx=0x7fb18000c010 tx=0x7fb180004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:04:35.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.517+0000 7fb16ffff700 1 -- 172.21.15.26:0/3395866215 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb18000e070 con 0x7fb1880f55c0 2021-11-03T18:04:35.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.517+0000 7fb16ffff700 1 -- 172.21.15.26:0/3395866215 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb180007dc0 con 0x7fb1880f55c0 2021-11-03T18:04:35.520 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.517+0000 7fb18da71700 1 -- 172.21.15.26:0/3395866215 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb18810c7b0 con 0x7fb1880f55c0 2021-11-03T18:04:35.520 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.517+0000 7fb16ffff700 1 -- 172.21.15.26:0/3395866215 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb180018070 con 0x7fb1880f55c0 2021-11-03T18:04:35.520 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.517+0000 7fb18da71700 1 -- 172.21.15.26:0/3395866215 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb18810cc90 con 0x7fb1880f55c0 2021-11-03T18:04:35.521 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.518+0000 7fb18da71700 1 -- 172.21.15.26:0/3395866215 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb188045ad0 con 0x7fb1880f55c0 2021-11-03T18:04:35.521 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.519+0000 7fb16ffff700 1 -- 172.21.15.26:0/3395866215 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fb180024060 con 0x7fb1880f55c0 2021-11-03T18:04:35.522 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.519+0000 7fb16ffff700 1 --2- 172.21.15.26:0/3395866215 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb1700640b0 0x7fb170066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:04:35.522 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.519+0000 7fb16ffff700 1 -- 172.21.15.26:0/3395866215 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fb1800825f0 con 0x7fb1880f55c0 2021-11-03T18:04:35.522 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.519+0000 7fb186ffd700 1 --2- 172.21.15.26:0/3395866215 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb1700640b0 0x7fb170066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:04:35.523 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.520+0000 7fb186ffd700 1 --2- 172.21.15.26:0/3395866215 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb1700640b0 0x7fb170066570 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7fb17c0041d0 tx=0x7fb17c009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:04:35.523 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.523+0000 7fb16ffff700 1 -- 172.21.15.26:0/3395866215 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fb180054890 con 0x7fb1880f55c0 2021-11-03T18:04:35.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.705+0000 7fb18da71700 1 -- 172.21.15.26:0/3395866215 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1880fdef0 con 0x7fb1700640b0 2021-11-03T18:04:35.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.707+0000 7fb16ffff700 1 -- 172.21.15.26:0/3395866215 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fb1880fdef0 con 0x7fb1700640b0 2021-11-03T18:04:35.705 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.709+0000 7fb18da71700 1 -- 172.21.15.26:0/3395866215 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb1700640b0 msgr2=0x7fb170066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:04:35.706 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.709+0000 7fb18da71700 1 --2- 172.21.15.26:0/3395866215 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb1700640b0 0x7fb170066570 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7fb17c0041d0 tx=0x7fb17c009040).stop 2021-11-03T18:04:35.706 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.709+0000 7fb18da71700 1 -- 172.21.15.26:0/3395866215 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1880f55c0 msgr2=0x7fb188109d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:04:35.706 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.709+0000 7fb18da71700 1 --2- 172.21.15.26:0/3395866215 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1880f55c0 0x7fb188109d60 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 rx=0x7fb18000c010 tx=0x7fb180004d10).stop 2021-11-03T18:04:35.707 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.709+0000 7fb18da71700 1 -- 172.21.15.26:0/3395866215 shutdown_connections 2021-11-03T18:04:35.707 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.709+0000 7fb18da71700 1 --2- 172.21.15.26:0/3395866215 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb1700640b0 0x7fb170066570 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:35.707 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.709+0000 7fb18da71700 1 --2- 172.21.15.26:0/3395866215 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1880f55c0 0x7fb188109d60 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:35.707 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.709+0000 7fb18da71700 1 --2- 172.21.15.26:0/3395866215 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1880f6860 0x7fb18810c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:35.708 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.709+0000 7fb18da71700 1 -- 172.21.15.26:0/3395866215 >> 172.21.15.26:0/3395866215 conn(0x7fb1880f0d40 msgr2=0x7fb1880fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:04:35.708 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.709+0000 7fb18da71700 1 -- 172.21.15.26:0/3395866215 shutdown_connections 2021-11-03T18:04:35.708 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.709+0000 7fb18da71700 1 -- 172.21.15.26:0/3395866215 wait complete. 2021-11-03T18:04:35.715 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:04:35.808 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.809+0000 7f1b8b24d700 1 -- 172.21.15.26:0/811974439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b840f6860 msgr2=0x7f1b840f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:04:35.808 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.809+0000 7f1b8b24d700 1 --2- 172.21.15.26:0/811974439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b840f6860 0x7f1b840f6cc0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 rx=0x7f1b70004660 tx=0x7f1b70009b30).stop 2021-11-03T18:04:35.809 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.809+0000 7f1b8b24d700 1 -- 172.21.15.26:0/811974439 shutdown_connections 2021-11-03T18:04:35.809 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.809+0000 7f1b8b24d700 1 --2- 172.21.15.26:0/811974439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b840f6860 0x7f1b840f6cc0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:35.809 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.809+0000 7f1b8b24d700 1 --2- 172.21.15.26:0/811974439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b840f55c0 0x7f1b840f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:35.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.809+0000 7f1b8b24d700 1 -- 172.21.15.26:0/811974439 >> 172.21.15.26:0/811974439 conn(0x7f1b840f0d40 msgr2=0x7f1b840f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:04:35.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.809+0000 7f1b8b24d700 1 -- 172.21.15.26:0/811974439 shutdown_connections 2021-11-03T18:04:35.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.809+0000 7f1b8b24d700 1 -- 172.21.15.26:0/811974439 wait complete. 2021-11-03T18:04:35.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.809+0000 7f1b8b24d700 1 Processor -- start 2021-11-03T18:04:35.811 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.810+0000 7f1b8b24d700 1 -- start start 2021-11-03T18:04:35.811 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.810+0000 7f1b8b24d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b840f55c0 0x7f1b84105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:04:35.811 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.810+0000 7f1b8b24d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b840f6860 0x7f1b841063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:04:35.811 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.810+0000 7f1b8b24d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b841069b0 con 0x7f1b840f6860 2021-11-03T18:04:35.811 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.810+0000 7f1b8b24d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b841071c0 con 0x7f1b840f55c0 2021-11-03T18:04:35.812 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.810+0000 7f1b83fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b840f6860 0x7f1b841063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:04:35.812 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.810+0000 7f1b83fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b840f6860 0x7f1b841063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57988/0 (socket says 172.21.15.26:57988) 2021-11-03T18:04:35.812 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.810+0000 7f1b83fff700 1 -- 172.21.15.26:0/34900567 learned_addr learned my addr 172.21.15.26:0/34900567 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:04:35.813 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.810+0000 7f1b88fe9700 1 --2- 172.21.15.26:0/34900567 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b840f55c0 0x7f1b84105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:04:35.813 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.810+0000 7f1b83fff700 1 -- 172.21.15.26:0/34900567 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b840f55c0 msgr2=0x7f1b84105ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:04:35.813 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.810+0000 7f1b83fff700 1 --2- 172.21.15.26:0/34900567 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b840f55c0 0x7f1b84105ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:35.814 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.810+0000 7f1b83fff700 1 -- 172.21.15.26:0/34900567 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b70005040 con 0x7f1b840f6860 2021-11-03T18:04:35.814 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.810+0000 7f1b83fff700 1 --2- 172.21.15.26:0/34900567 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b840f6860 0x7f1b841063b0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 rx=0x7f1b70009990 tx=0x7f1b70009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:04:35.814 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.811+0000 7f1b817fa700 1 -- 172.21.15.26:0/34900567 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b7001a070 con 0x7f1b840f6860 2021-11-03T18:04:35.814 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.811+0000 7f1b817fa700 1 -- 172.21.15.26:0/34900567 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1b70012a80 con 0x7f1b840f6860 2021-11-03T18:04:35.814 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.811+0000 7f1b8b24d700 1 -- 172.21.15.26:0/34900567 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b841073e0 con 0x7f1b840f6860 2021-11-03T18:04:35.815 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.811+0000 7f1b817fa700 1 -- 172.21.15.26:0/34900567 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b7001f7e0 con 0x7f1b840f6860 2021-11-03T18:04:35.815 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.811+0000 7f1b8b24d700 1 -- 172.21.15.26:0/34900567 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b84107940 con 0x7f1b840f6860 2021-11-03T18:04:35.815 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.812+0000 7f1b8b24d700 1 -- 172.21.15.26:0/34900567 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b840f49b0 con 0x7f1b840f6860 2021-11-03T18:04:35.816 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.812+0000 7f1b817fa700 1 -- 172.21.15.26:0/34900567 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f1b70012bf0 con 0x7f1b840f6860 2021-11-03T18:04:35.817 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.812+0000 7f1b817fa700 1 --2- 172.21.15.26:0/34900567 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1b740640b0 0x7f1b74066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:04:35.817 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.813+0000 7f1b817fa700 1 -- 172.21.15.26:0/34900567 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f1b70084970 con 0x7f1b840f6860 2021-11-03T18:04:35.817 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.813+0000 7f1b88fe9700 1 --2- 172.21.15.26:0/34900567 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1b740640b0 0x7f1b74066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:04:35.818 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.813+0000 7f1b88fe9700 1 --2- 172.21.15.26:0/34900567 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1b740640b0 0x7f1b74066570 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f1b84105c30 tx=0x7f1b78009c00).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:04:35.818 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.817+0000 7f1b817fa700 1 -- 172.21.15.26:0/34900567 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f1b70056d90 con 0x7f1b840f6860 2021-11-03T18:04:35.986 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:35.989+0000 7f1b8b24d700 1 -- 172.21.15.26:0/34900567 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b840ff830 con 0x7f1b740640b0 2021-11-03T18:04:36.001 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.004+0000 7f1b817fa700 1 -- 172.21.15.26:0/34900567 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f1b840ff830 con 0x7f1b740640b0 2021-11-03T18:04:36.001 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:04:36.001 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (75m) 4m ago 77m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:04:36.002 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (68m) 4m ago 77m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:04:36.002 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (67m) 3m ago 76m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:04:36.002 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (75m) 4m ago 76m 41.7M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:04:36.003 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (68m) 4m ago 72m 25.6M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:04:36.003 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (69m) 4m ago 72m 26.2M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:04:36.003 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (72m) 3m ago 72m 26.4M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:04:36.003 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (72m) 3m ago 72m 26.8M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:04:36.003 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (69m) 4m ago 78m 561M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:04:36.004 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (69m) 3m ago 76m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:04:36.004 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (68m) 4m ago 78m 276M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:04:36.004 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (68m) 3m ago 76m 132M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:04:36.004 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (76m) 4m ago 76m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:04:36.005 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (76m) 3m ago 76m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:04:36.005 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (67m) 4m ago 75m 292M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:04:36.005 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (67m) 4m ago 75m 313M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:04:36.005 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (66m) 4m ago 74m 261M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:04:36.006 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (66m) 3m ago 74m 337M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:04:36.006 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (65m) 3m ago 74m 283M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:04:36.006 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (65m) 3m ago 73m 276M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:04:36.006 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (75m) 4m ago 76m 61.2M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:04:36.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.006+0000 7f1b8b24d700 1 -- 172.21.15.26:0/34900567 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1b740640b0 msgr2=0x7f1b74066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:04:36.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.006+0000 7f1b8b24d700 1 --2- 172.21.15.26:0/34900567 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1b740640b0 0x7f1b74066570 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f1b84105c30 tx=0x7f1b78009c00).stop 2021-11-03T18:04:36.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.006+0000 7f1b8b24d700 1 -- 172.21.15.26:0/34900567 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b840f6860 msgr2=0x7f1b841063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:04:36.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.006+0000 7f1b8b24d700 1 --2- 172.21.15.26:0/34900567 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b840f6860 0x7f1b841063b0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 rx=0x7f1b70009990 tx=0x7f1b70009b30).stop 2021-11-03T18:04:36.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.006+0000 7f1b8b24d700 1 -- 172.21.15.26:0/34900567 shutdown_connections 2021-11-03T18:04:36.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.006+0000 7f1b8b24d700 1 --2- 172.21.15.26:0/34900567 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1b740640b0 0x7f1b74066570 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:36.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.006+0000 7f1b8b24d700 1 --2- 172.21.15.26:0/34900567 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b840f55c0 0x7f1b84105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:36.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.006+0000 7f1b8b24d700 1 --2- 172.21.15.26:0/34900567 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b840f6860 0x7f1b841063b0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:36.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.006+0000 7f1b8b24d700 1 -- 172.21.15.26:0/34900567 >> 172.21.15.26:0/34900567 conn(0x7f1b840f0d40 msgr2=0x7f1b840fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:04:36.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.006+0000 7f1b8b24d700 1 -- 172.21.15.26:0/34900567 shutdown_connections 2021-11-03T18:04:36.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.006+0000 7f1b8b24d700 1 -- 172.21.15.26:0/34900567 wait complete. 2021-11-03T18:04:36.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.105+0000 7ff4e1ccb700 1 -- 172.21.15.26:0/532050365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4dc0f6860 msgr2=0x7ff4dc0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:04:36.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.105+0000 7ff4e1ccb700 1 --2- 172.21.15.26:0/532050365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4dc0f6860 0x7ff4dc0f6cc0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7ff4d0004660 tx=0x7ff4d0009b30).stop 2021-11-03T18:04:36.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.105+0000 7ff4e1ccb700 1 -- 172.21.15.26:0/532050365 shutdown_connections 2021-11-03T18:04:36.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.105+0000 7ff4e1ccb700 1 --2- 172.21.15.26:0/532050365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4dc0f6860 0x7ff4dc0f6cc0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:36.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.105+0000 7ff4e1ccb700 1 --2- 172.21.15.26:0/532050365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4dc0f55c0 0x7ff4dc0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:36.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.105+0000 7ff4e1ccb700 1 -- 172.21.15.26:0/532050365 >> 172.21.15.26:0/532050365 conn(0x7ff4dc0f0d40 msgr2=0x7ff4dc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:04:36.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.105+0000 7ff4e1ccb700 1 -- 172.21.15.26:0/532050365 shutdown_connections 2021-11-03T18:04:36.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.105+0000 7ff4e1ccb700 1 -- 172.21.15.26:0/532050365 wait complete. 2021-11-03T18:04:36.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.105+0000 7ff4e1ccb700 1 Processor -- start 2021-11-03T18:04:36.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.105+0000 7ff4e1ccb700 1 -- start start 2021-11-03T18:04:36.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.106+0000 7ff4e1ccb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4dc0f55c0 0x7ff4dc105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:04:36.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.106+0000 7ff4e1ccb700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4dc0f6860 0x7ff4dc1063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:04:36.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.106+0000 7ff4e1ccb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4dc1069b0 con 0x7ff4dc0f55c0 2021-11-03T18:04:36.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.106+0000 7ff4e1ccb700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4dc1071c0 con 0x7ff4dc0f6860 2021-11-03T18:04:36.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.106+0000 7ff4db7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4dc0f55c0 0x7ff4dc105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:04:36.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.106+0000 7ff4db7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4dc0f55c0 0x7ff4dc105ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57996/0 (socket says 172.21.15.26:57996) 2021-11-03T18:04:36.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.106+0000 7ff4db7fe700 1 -- 172.21.15.26:0/4109761457 learned_addr learned my addr 172.21.15.26:0/4109761457 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:04:36.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.106+0000 7ff4daffd700 1 --2- 172.21.15.26:0/4109761457 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4dc0f6860 0x7ff4dc1063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:04:36.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.106+0000 7ff4db7fe700 1 -- 172.21.15.26:0/4109761457 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4dc0f6860 msgr2=0x7ff4dc1063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:04:36.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.106+0000 7ff4db7fe700 1 --2- 172.21.15.26:0/4109761457 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4dc0f6860 0x7ff4dc1063b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:36.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.106+0000 7ff4db7fe700 1 -- 172.21.15.26:0/4109761457 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d0005040 con 0x7ff4dc0f55c0 2021-11-03T18:04:36.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.106+0000 7ff4db7fe700 1 --2- 172.21.15.26:0/4109761457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4dc0f55c0 0x7ff4dc105ec0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 rx=0x7ff4cc00fae0 tx=0x7ff4cc004e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:04:36.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.106+0000 7ff4c3fff700 1 -- 172.21.15.26:0/4109761457 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4cc00dae0 con 0x7ff4dc0f55c0 2021-11-03T18:04:36.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.106+0000 7ff4c3fff700 1 -- 172.21.15.26:0/4109761457 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff4cc00dc40 con 0x7ff4dc0f55c0 2021-11-03T18:04:36.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.106+0000 7ff4e1ccb700 1 -- 172.21.15.26:0/4109761457 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4dc1073e0 con 0x7ff4dc0f55c0 2021-11-03T18:04:36.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.106+0000 7ff4c3fff700 1 -- 172.21.15.26:0/4109761457 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4cc011620 con 0x7ff4dc0f55c0 2021-11-03T18:04:36.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.106+0000 7ff4e1ccb700 1 -- 172.21.15.26:0/4109761457 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4dc107970 con 0x7ff4dc0f55c0 2021-11-03T18:04:36.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.107+0000 7ff4e1ccb700 1 -- 172.21.15.26:0/4109761457 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4dc0f49b0 con 0x7ff4dc0f55c0 2021-11-03T18:04:36.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.108+0000 7ff4c3fff700 1 -- 172.21.15.26:0/4109761457 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ff4cc00e040 con 0x7ff4dc0f55c0 2021-11-03T18:04:36.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.108+0000 7ff4c3fff700 1 --2- 172.21.15.26:0/4109761457 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff4c40640b0 0x7ff4c4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:04:36.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.108+0000 7ff4c3fff700 1 -- 172.21.15.26:0/4109761457 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ff4cc083520 con 0x7ff4dc0f55c0 2021-11-03T18:04:36.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.108+0000 7ff4daffd700 1 --2- 172.21.15.26:0/4109761457 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff4c40640b0 0x7ff4c4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:04:36.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.109+0000 7ff4daffd700 1 --2- 172.21.15.26:0/4109761457 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff4c40640b0 0x7ff4c4066570 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7ff4d0004630 tx=0x7ff4d0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:04:36.113 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.112+0000 7ff4c3fff700 1 -- 172.21.15.26:0/4109761457 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ff4cc055840 con 0x7ff4dc0f55c0 2021-11-03T18:04:36.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.344+0000 7ff4e1ccb700 1 -- 172.21.15.26:0/4109761457 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff4dc0ff830 con 0x7ff4dc0f55c0 2021-11-03T18:04:36.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.345+0000 7ff4c3fff700 1 -- 172.21.15.26:0/4109761457 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7ff4cc0162e0 con 0x7ff4dc0f55c0 2021-11-03T18:04:36.342 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:04:36.342 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:04:36.343 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:04:36.343 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:04:36.343 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:04:36.343 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:04:36.344 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:04:36.344 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:04:36.344 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:04:36.344 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:04:36.344 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:04:36.345 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:04:36.345 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:04:36.345 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:04:36.345 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:04:36.345 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:04:36.346 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:04:36.346 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:04:36.347 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.346+0000 7ff4e1ccb700 1 -- 172.21.15.26:0/4109761457 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff4c40640b0 msgr2=0x7ff4c4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:04:36.347 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.346+0000 7ff4e1ccb700 1 --2- 172.21.15.26:0/4109761457 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff4c40640b0 0x7ff4c4066570 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7ff4d0004630 tx=0x7ff4d0009b30).stop 2021-11-03T18:04:36.347 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.346+0000 7ff4e1ccb700 1 -- 172.21.15.26:0/4109761457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4dc0f55c0 msgr2=0x7ff4dc105ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:04:36.348 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.346+0000 7ff4e1ccb700 1 --2- 172.21.15.26:0/4109761457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4dc0f55c0 0x7ff4dc105ec0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 rx=0x7ff4cc00fae0 tx=0x7ff4cc004e80).stop 2021-11-03T18:04:36.348 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.346+0000 7ff4e1ccb700 1 -- 172.21.15.26:0/4109761457 shutdown_connections 2021-11-03T18:04:36.348 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.346+0000 7ff4e1ccb700 1 --2- 172.21.15.26:0/4109761457 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff4c40640b0 0x7ff4c4066570 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:36.348 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.346+0000 7ff4e1ccb700 1 --2- 172.21.15.26:0/4109761457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4dc0f55c0 0x7ff4dc105ec0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:36.349 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.346+0000 7ff4e1ccb700 1 --2- 172.21.15.26:0/4109761457 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4dc0f6860 0x7ff4dc1063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:36.349 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.346+0000 7ff4e1ccb700 1 -- 172.21.15.26:0/4109761457 >> 172.21.15.26:0/4109761457 conn(0x7ff4dc0f0d40 msgr2=0x7ff4dc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:04:36.349 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.346+0000 7ff4e1ccb700 1 -- 172.21.15.26:0/4109761457 shutdown_connections 2021-11-03T18:04:36.349 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.346+0000 7ff4e1ccb700 1 -- 172.21.15.26:0/4109761457 wait complete. 2021-11-03T18:04:36.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.446+0000 7f6515b69700 1 -- 172.21.15.26:0/226895092 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65100f66e0 msgr2=0x7f65100f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:04:36.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.446+0000 7f6515b69700 1 --2- 172.21.15.26:0/226895092 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65100f66e0 0x7f65100f6b00 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7f6500004660 tx=0x7f6500009b30).stop 2021-11-03T18:04:36.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.446+0000 7f6515b69700 1 -- 172.21.15.26:0/226895092 shutdown_connections 2021-11-03T18:04:36.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.446+0000 7f6515b69700 1 --2- 172.21.15.26:0/226895092 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65100f6ff0 0x7f65100f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:36.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.446+0000 7f6515b69700 1 --2- 172.21.15.26:0/226895092 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65100f66e0 0x7f65100f6b00 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:36.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.446+0000 7f6515b69700 1 -- 172.21.15.26:0/226895092 >> 172.21.15.26:0/226895092 conn(0x7f65100f1f00 msgr2=0x7f65100f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:04:36.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.446+0000 7f6515b69700 1 -- 172.21.15.26:0/226895092 shutdown_connections 2021-11-03T18:04:36.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.446+0000 7f6515b69700 1 -- 172.21.15.26:0/226895092 wait complete. 2021-11-03T18:04:36.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.447+0000 7f6515b69700 1 Processor -- start 2021-11-03T18:04:36.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.447+0000 7f6515b69700 1 -- start start 2021-11-03T18:04:36.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.447+0000 7f6515b69700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65100f66e0 0x7f651006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:04:36.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.447+0000 7f6515b69700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65100f6ff0 0x7f6510069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:04:36.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.447+0000 7f6515b69700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f651006a380 con 0x7f65100f6ff0 2021-11-03T18:04:36.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.447+0000 7f6515b69700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f651006a4c0 con 0x7f65100f66e0 2021-11-03T18:04:36.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.447+0000 7f650effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65100f6ff0 0x7f6510069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:04:36.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.447+0000 7f650effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65100f6ff0 0x7f6510069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58008/0 (socket says 172.21.15.26:58008) 2021-11-03T18:04:36.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.447+0000 7f650effd700 1 -- 172.21.15.26:0/2828461660 learned_addr learned my addr 172.21.15.26:0/2828461660 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:04:36.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.447+0000 7f650f7fe700 1 --2- 172.21.15.26:0/2828461660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65100f66e0 0x7f651006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:04:36.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.448+0000 7f650effd700 1 -- 172.21.15.26:0/2828461660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65100f66e0 msgr2=0x7f651006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:04:36.450 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.448+0000 7f650effd700 1 --2- 172.21.15.26:0/2828461660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65100f66e0 0x7f651006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:36.450 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.448+0000 7f650effd700 1 -- 172.21.15.26:0/2828461660 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6500005040 con 0x7f65100f6ff0 2021-11-03T18:04:36.450 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.448+0000 7f650effd700 1 --2- 172.21.15.26:0/2828461660 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65100f6ff0 0x7f6510069e20 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 rx=0x7f65040026d0 tx=0x7f6504009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:04:36.450 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.448+0000 7f64f7fff700 1 -- 172.21.15.26:0/2828461660 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65040079c0 con 0x7f65100f6ff0 2021-11-03T18:04:36.451 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.448+0000 7f64f7fff700 1 -- 172.21.15.26:0/2828461660 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f650400f040 con 0x7f65100f6ff0 2021-11-03T18:04:36.451 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.448+0000 7f64f7fff700 1 -- 172.21.15.26:0/2828461660 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65040148b0 con 0x7f65100f6ff0 2021-11-03T18:04:36.451 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.448+0000 7f6515b69700 1 -- 172.21.15.26:0/2828461660 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f651006a7a0 con 0x7f65100f6ff0 2021-11-03T18:04:36.451 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.448+0000 7f6515b69700 1 -- 172.21.15.26:0/2828461660 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f651010ef90 con 0x7f65100f6ff0 2021-11-03T18:04:36.452 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.449+0000 7f6515b69700 1 -- 172.21.15.26:0/2828461660 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6510045ad0 con 0x7f65100f6ff0 2021-11-03T18:04:36.453 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.449+0000 7f64f7fff700 1 -- 172.21.15.26:0/2828461660 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f6504007b20 con 0x7f65100f6ff0 2021-11-03T18:04:36.453 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.450+0000 7f64f7fff700 1 --2- 172.21.15.26:0/2828461660 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f64f80640b0 0x7f64f8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:04:36.453 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.450+0000 7f64f7fff700 1 -- 172.21.15.26:0/2828461660 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f6504080730 con 0x7f65100f6ff0 2021-11-03T18:04:36.453 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.450+0000 7f650f7fe700 1 --2- 172.21.15.26:0/2828461660 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f64f80640b0 0x7f64f8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:04:36.454 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.450+0000 7f650f7fe700 1 --2- 172.21.15.26:0/2828461660 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f64f80640b0 0x7f64f8066570 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f6500004630 tx=0x7f6500009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:04:36.454 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.454+0000 7f64f7fff700 1 -- 172.21.15.26:0/2828461660 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f6504052a90 con 0x7f65100f6ff0 2021-11-03T18:04:36.664 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.667+0000 7f6515b69700 1 -- 172.21.15.26:0/2828461660 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6510027a00 con 0x7f65100f6ff0 2021-11-03T18:04:36.664 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.667+0000 7f64f7fff700 1 -- 172.21.15.26:0/2828461660 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f6504052680 con 0x7f65100f6ff0 2021-11-03T18:04:36.665 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:04:36.665 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:04:36.665 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:04:36.666 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:04:36.666 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:04:36.666 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:04:36.666 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:04:36.667 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:04:36.667 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:04:36.667 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:04:36.667 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:04:36.667 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:04:36.668 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:04:36.668 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:04:36.668 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:04:36.668 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:04:36.669 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:04:36.669 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:04:36.669 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:04:36.669 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:04:36.669 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:04:36.670 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:04:36.670 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:04:36.670 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:04:36.670 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:04:36.670 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:04:36.671 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:04:36.671 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:04:36.671 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:04:36.671 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:04:36.672 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:04:36.672 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:04:36.672 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:04:36.672 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:04:36.672 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:04:36.673 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:04:36.673 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:04:36.673 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:04:36.673 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:04:36.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.669+0000 7f6515b69700 1 -- 172.21.15.26:0/2828461660 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f64f80640b0 msgr2=0x7f64f8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:04:36.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.669+0000 7f6515b69700 1 --2- 172.21.15.26:0/2828461660 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f64f80640b0 0x7f64f8066570 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f6500004630 tx=0x7f6500009b30).stop 2021-11-03T18:04:36.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.669+0000 7f6515b69700 1 -- 172.21.15.26:0/2828461660 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65100f6ff0 msgr2=0x7f6510069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:04:36.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.669+0000 7f6515b69700 1 --2- 172.21.15.26:0/2828461660 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65100f6ff0 0x7f6510069e20 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 rx=0x7f65040026d0 tx=0x7f6504009de0).stop 2021-11-03T18:04:36.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.669+0000 7f6515b69700 1 -- 172.21.15.26:0/2828461660 shutdown_connections 2021-11-03T18:04:36.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.669+0000 7f6515b69700 1 --2- 172.21.15.26:0/2828461660 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f64f80640b0 0x7f64f8066570 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:36.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.669+0000 7f6515b69700 1 --2- 172.21.15.26:0/2828461660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65100f66e0 0x7f651006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:36.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.669+0000 7f6515b69700 1 --2- 172.21.15.26:0/2828461660 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65100f6ff0 0x7f6510069e20 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:04:36.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.669+0000 7f6515b69700 1 -- 172.21.15.26:0/2828461660 >> 172.21.15.26:0/2828461660 conn(0x7f65100f1f00 msgr2=0x7f65100fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:04:36.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.669+0000 7f6515b69700 1 -- 172.21.15.26:0/2828461660 shutdown_connections 2021-11-03T18:04:36.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:04:36.669+0000 7f6515b69700 1 -- 172.21.15.26:0/2828461660 wait complete. 2021-11-03T18:04:36.677 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:04:36.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:36 smithi026 ceph-mon[96795]: pgmap v2098: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:36.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:36 smithi026 ceph-mon[96795]: from='client.36300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:04:36.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:36 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/4109761457' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:04:36.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:36 smithi194 ceph-mon[65619]: pgmap v2098: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:37.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:36 smithi194 ceph-mon[65619]: from='client.36300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:04:37.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:36 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/4109761457' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:04:37.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:37 smithi026 ceph-mon[96795]: from='client.36304 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:04:37.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:37 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2828461660' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:04:37.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:37 smithi194 ceph-mon[65619]: from='client.36304 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:04:37.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:37 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2828461660' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:04:38.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:38 smithi026 ceph-mon[96795]: pgmap v2099: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:38.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:38 smithi194 ceph-mon[65619]: pgmap v2099: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:40.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:40 smithi026 ceph-mon[96795]: pgmap v2100: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:40.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:04:40.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:40 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:04:40.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:40 smithi194 ceph-mon[65619]: pgmap v2100: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:40.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:04:41.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:40 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:04:42.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:42 smithi026 ceph-mon[96795]: pgmap v2101: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:42.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:42 smithi194 ceph-mon[65619]: pgmap v2101: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:44.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:44 smithi026 ceph-mon[96795]: pgmap v2102: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:44.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:44 smithi194 ceph-mon[65619]: pgmap v2102: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:46.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:46 smithi026 ceph-mon[96795]: pgmap v2103: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:46.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:46 smithi194 ceph-mon[65619]: pgmap v2103: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:48.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:48 smithi026 ceph-mon[96795]: pgmap v2104: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:48.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:04:48.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:04:48.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:48 smithi194 ceph-mon[65619]: pgmap v2104: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:49.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:04:49.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:04:50.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:50 smithi026 ceph-mon[96795]: pgmap v2105: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:50.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:50 smithi194 ceph-mon[65619]: pgmap v2105: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:52.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:52 smithi026 ceph-mon[96795]: pgmap v2106: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:52.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:52 smithi194 ceph-mon[65619]: pgmap v2106: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:54.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:54 smithi026 ceph-mon[96795]: pgmap v2107: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:54.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:04:54.959 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:54 smithi194 ceph-mon[65619]: pgmap v2107: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:54.959 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:04:55.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:55 smithi026 ceph-mon[96795]: poll took 60053.223 ms: 1 events 2021-11-03T18:04:55.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:04:55.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:04:55.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:04:55.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:04:55.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:04:55.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:04:55.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:04:55.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:55 smithi194 ceph-mon[65619]: poll took 60053.223 ms: 1 events 2021-11-03T18:04:55.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:04:56.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:04:56.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:04:56.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:04:56.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:04:56.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:04:56.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:04:56.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:56 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:04:56.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:56 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:04:56.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:56 smithi026 ceph-mon[96795]: pgmap v2108: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:56.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:56 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:04:57.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:56 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:04:57.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:56 smithi194 ceph-mon[65619]: pgmap v2108: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:58.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:04:58 smithi026 ceph-mon[96795]: pgmap v2109: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:04:58.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:04:58 smithi194 ceph-mon[65619]: pgmap v2109: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:00.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:00 smithi026 ceph-mon[96795]: pgmap v2110: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:00.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:00 smithi194 ceph-mon[65619]: pgmap v2110: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:02.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:02 smithi026 ceph-mon[96795]: pgmap v2111: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:02.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:02 smithi194 ceph-mon[65619]: pgmap v2111: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:04.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:04 smithi026 ceph-mon[96795]: pgmap v2112: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:04.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:04 smithi194 ceph-mon[65619]: pgmap v2112: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:06.783 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.783+0000 7f3859e42700 1 -- 172.21.15.26:0/3613448392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38540f73b0 msgr2=0x7f38540f4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:05:06.783 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.783+0000 7f3859e42700 1 --2- 172.21.15.26:0/3613448392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38540f73b0 0x7f38540f4640 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 rx=0x7f3840004660 tx=0x7f3840009b30).stop 2021-11-03T18:05:06.783 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.783+0000 7f3859e42700 1 -- 172.21.15.26:0/3613448392 shutdown_connections 2021-11-03T18:05:06.784 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.783+0000 7f3859e42700 1 --2- 172.21.15.26:0/3613448392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38540f73b0 0x7f38540f4640 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:06.784 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.783+0000 7f3859e42700 1 --2- 172.21.15.26:0/3613448392 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38540f6a10 0x7f38540f6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:06.784 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.783+0000 7f3859e42700 1 -- 172.21.15.26:0/3613448392 >> 172.21.15.26:0/3613448392 conn(0x7f38540f0320 msgr2=0x7f38540f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:05:06.784 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.783+0000 7f3859e42700 1 -- 172.21.15.26:0/3613448392 shutdown_connections 2021-11-03T18:05:06.784 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.783+0000 7f3859e42700 1 -- 172.21.15.26:0/3613448392 wait complete. 2021-11-03T18:05:06.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.783+0000 7f3859e42700 1 Processor -- start 2021-11-03T18:05:06.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.784+0000 7f3859e42700 1 -- start start 2021-11-03T18:05:06.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.784+0000 7f3859e42700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38540f6a10 0x7f3854108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:05:06.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.784+0000 7f3859e42700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38540f73b0 0x7f3854109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:05:06.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.784+0000 7f3859e42700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38541099e0 con 0x7f38540f73b0 2021-11-03T18:05:06.786 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.784+0000 7f3859e42700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3854109b20 con 0x7f38540f6a10 2021-11-03T18:05:06.786 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.784+0000 7f3853fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38540f73b0 0x7f3854109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:05:06.786 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.784+0000 7f3853fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38540f73b0 0x7f3854109430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58026/0 (socket says 172.21.15.26:58026) 2021-11-03T18:05:06.786 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.784+0000 7f3853fff700 1 -- 172.21.15.26:0/869775681 learned_addr learned my addr 172.21.15.26:0/869775681 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:05:06.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.784+0000 7f3858e40700 1 --2- 172.21.15.26:0/869775681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38540f6a10 0x7f3854108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:05:06.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.784+0000 7f3853fff700 1 -- 172.21.15.26:0/869775681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38540f6a10 msgr2=0x7f3854108f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:05:06.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.784+0000 7f3853fff700 1 --2- 172.21.15.26:0/869775681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38540f6a10 0x7f3854108f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:06.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.784+0000 7f3853fff700 1 -- 172.21.15.26:0/869775681 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3840005040 con 0x7f38540f73b0 2021-11-03T18:05:06.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.785+0000 7f3853fff700 1 --2- 172.21.15.26:0/869775681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38540f73b0 0x7f3854109430 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 rx=0x7f3840009990 tx=0x7f3840009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:05:06.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.785+0000 7f38517fa700 1 -- 172.21.15.26:0/869775681 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3840018070 con 0x7f38540f73b0 2021-11-03T18:05:06.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.785+0000 7f3859e42700 1 -- 172.21.15.26:0/869775681 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f385410a460 con 0x7f38540f73b0 2021-11-03T18:05:06.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.785+0000 7f38517fa700 1 -- 172.21.15.26:0/869775681 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3840007ba0 con 0x7f38540f73b0 2021-11-03T18:05:06.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.785+0000 7f38517fa700 1 -- 172.21.15.26:0/869775681 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f384001c3c0 con 0x7f38540f73b0 2021-11-03T18:05:06.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.785+0000 7f3859e42700 1 -- 172.21.15.26:0/869775681 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f385410a9c0 con 0x7f38540f73b0 2021-11-03T18:05:06.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.786+0000 7f3859e42700 1 -- 172.21.15.26:0/869775681 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3854045ad0 con 0x7f38540f73b0 2021-11-03T18:05:06.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.786+0000 7f38517fa700 1 -- 172.21.15.26:0/869775681 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f384001d420 con 0x7f38540f73b0 2021-11-03T18:05:06.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.787+0000 7f38517fa700 1 --2- 172.21.15.26:0/869775681 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3844064100 0x7f38440665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:05:06.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.787+0000 7f38517fa700 1 -- 172.21.15.26:0/869775681 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f3840082410 con 0x7f38540f73b0 2021-11-03T18:05:06.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.787+0000 7f3858e40700 1 --2- 172.21.15.26:0/869775681 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3844064100 0x7f38440665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:05:06.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.787+0000 7f3858e40700 1 --2- 172.21.15.26:0/869775681 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3844064100 0x7f38440665c0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f3848004c40 tx=0x7f384800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:05:06.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.791+0000 7f38517fa700 1 -- 172.21.15.26:0/869775681 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f3840054830 con 0x7f38540f73b0 2021-11-03T18:05:06.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:06 smithi026 ceph-mon[96795]: pgmap v2113: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:06.970 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.972+0000 7f3859e42700 1 -- 172.21.15.26:0/869775681 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f385410abe0 con 0x7f3844064100 2021-11-03T18:05:06.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.973+0000 7f38517fa700 1 -- 172.21.15.26:0/869775681 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f385410abe0 con 0x7f3844064100 2021-11-03T18:05:06.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.975+0000 7f3859e42700 1 -- 172.21.15.26:0/869775681 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3844064100 msgr2=0x7f38440665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:05:06.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.975+0000 7f3859e42700 1 --2- 172.21.15.26:0/869775681 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3844064100 0x7f38440665c0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f3848004c40 tx=0x7f384800b040).stop 2021-11-03T18:05:06.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.975+0000 7f3859e42700 1 -- 172.21.15.26:0/869775681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38540f73b0 msgr2=0x7f3854109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:05:06.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.975+0000 7f3859e42700 1 --2- 172.21.15.26:0/869775681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38540f73b0 0x7f3854109430 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 rx=0x7f3840009990 tx=0x7f3840009b30).stop 2021-11-03T18:05:06.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.975+0000 7f3859e42700 1 -- 172.21.15.26:0/869775681 shutdown_connections 2021-11-03T18:05:06.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.975+0000 7f3859e42700 1 --2- 172.21.15.26:0/869775681 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3844064100 0x7f38440665c0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:06.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.975+0000 7f3859e42700 1 --2- 172.21.15.26:0/869775681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38540f6a10 0x7f3854108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:06.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.975+0000 7f3859e42700 1 --2- 172.21.15.26:0/869775681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38540f73b0 0x7f3854109430 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:06.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.975+0000 7f3859e42700 1 -- 172.21.15.26:0/869775681 >> 172.21.15.26:0/869775681 conn(0x7f38540f0320 msgr2=0x7f38540fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:05:06.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.975+0000 7f3859e42700 1 -- 172.21.15.26:0/869775681 shutdown_connections 2021-11-03T18:05:06.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:06.975+0000 7f3859e42700 1 -- 172.21.15.26:0/869775681 wait complete. 2021-11-03T18:05:06.983 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:05:06.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:06 smithi194 ceph-mon[65619]: pgmap v2113: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:07.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.075+0000 7fd35e1e3700 1 -- 172.21.15.26:0/1770352464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3580f5580 msgr2=0x7fd3580f59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:05:07.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.076+0000 7fd35e1e3700 1 --2- 172.21.15.26:0/1770352464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3580f5580 0x7fd3580f59a0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7fd348004660 tx=0x7fd348009b30).stop 2021-11-03T18:05:07.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.076+0000 7fd35e1e3700 1 -- 172.21.15.26:0/1770352464 shutdown_connections 2021-11-03T18:05:07.075 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.076+0000 7fd35e1e3700 1 --2- 172.21.15.26:0/1770352464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3580f6820 0x7fd3580f6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:07.075 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.076+0000 7fd35e1e3700 1 --2- 172.21.15.26:0/1770352464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3580f5580 0x7fd3580f59a0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:07.075 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.076+0000 7fd35e1e3700 1 -- 172.21.15.26:0/1770352464 >> 172.21.15.26:0/1770352464 conn(0x7fd3580f0ce0 msgr2=0x7fd3580f3100 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:05:07.075 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.076+0000 7fd35e1e3700 1 -- 172.21.15.26:0/1770352464 shutdown_connections 2021-11-03T18:05:07.076 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.076+0000 7fd35e1e3700 1 -- 172.21.15.26:0/1770352464 wait complete. 2021-11-03T18:05:07.076 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.076+0000 7fd35e1e3700 1 Processor -- start 2021-11-03T18:05:07.076 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.076+0000 7fd35e1e3700 1 -- start start 2021-11-03T18:05:07.078 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.077+0000 7fd35e1e3700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3580f5580 0x7fd358109bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:05:07.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.077+0000 7fd35e1e3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3580f6820 0x7fd35810c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:05:07.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.077+0000 7fd35e1e3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd358060500 con 0x7fd3580f6820 2021-11-03T18:05:07.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.077+0000 7fd35e1e3700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd358060640 con 0x7fd3580f5580 2021-11-03T18:05:07.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.077+0000 7fd356ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3580f6820 0x7fd35810c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:05:07.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.077+0000 7fd356ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3580f6820 0x7fd35810c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58036/0 (socket says 172.21.15.26:58036) 2021-11-03T18:05:07.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.077+0000 7fd356ffd700 1 -- 172.21.15.26:0/3634991881 learned_addr learned my addr 172.21.15.26:0/3634991881 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:05:07.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.077+0000 7fd3577fe700 1 --2- 172.21.15.26:0/3634991881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3580f5580 0x7fd358109bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:05:07.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.077+0000 7fd356ffd700 1 -- 172.21.15.26:0/3634991881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3580f5580 msgr2=0x7fd358109bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:05:07.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.077+0000 7fd356ffd700 1 --2- 172.21.15.26:0/3634991881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3580f5580 0x7fd358109bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:07.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.077+0000 7fd356ffd700 1 -- 172.21.15.26:0/3634991881 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd348005040 con 0x7fd3580f6820 2021-11-03T18:05:07.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.077+0000 7fd3577fe700 1 --2- 172.21.15.26:0/3634991881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3580f5580 0x7fd358109bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:05:07.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.077+0000 7fd356ffd700 1 --2- 172.21.15.26:0/3634991881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3580f6820 0x7fd35810c0f0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 rx=0x7fd34c00c790 tx=0x7fd34c007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:05:07.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.077+0000 7fd33ffff700 1 -- 172.21.15.26:0/3634991881 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd34c00e680 con 0x7fd3580f6820 2021-11-03T18:05:07.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.077+0000 7fd33ffff700 1 -- 172.21.15.26:0/3634991881 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd34c00ec90 con 0x7fd3580f6820 2021-11-03T18:05:07.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.077+0000 7fd35e1e3700 1 -- 172.21.15.26:0/3634991881 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd35810c6a0 con 0x7fd3580f6820 2021-11-03T18:05:07.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.077+0000 7fd33ffff700 1 -- 172.21.15.26:0/3634991881 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd34c013d60 con 0x7fd3580f6820 2021-11-03T18:05:07.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.077+0000 7fd35e1e3700 1 -- 172.21.15.26:0/3634991881 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd35810cc60 con 0x7fd3580f6820 2021-11-03T18:05:07.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.078+0000 7fd35e1e3700 1 -- 172.21.15.26:0/3634991881 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd358045ad0 con 0x7fd3580f6820 2021-11-03T18:05:07.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.079+0000 7fd33ffff700 1 -- 172.21.15.26:0/3634991881 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fd34c01a060 con 0x7fd3580f6820 2021-11-03T18:05:07.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.079+0000 7fd33ffff700 1 --2- 172.21.15.26:0/3634991881 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd340064100 0x7fd3400665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:05:07.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.079+0000 7fd33ffff700 1 -- 172.21.15.26:0/3634991881 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fd34c080b00 con 0x7fd3580f6820 2021-11-03T18:05:07.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.079+0000 7fd3577fe700 1 --2- 172.21.15.26:0/3634991881 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd340064100 0x7fd3400665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:05:07.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.079+0000 7fd3577fe700 1 --2- 172.21.15.26:0/3634991881 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd340064100 0x7fd3400665c0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7fd348004e30 tx=0x7fd348009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:05:07.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.083+0000 7fd33ffff700 1 -- 172.21.15.26:0/3634991881 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fd34c052d70 con 0x7fd3580f6820 2021-11-03T18:05:07.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.260+0000 7fd35e1e3700 1 -- 172.21.15.26:0/3634991881 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3580fdeb0 con 0x7fd340064100 2021-11-03T18:05:07.272 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.274+0000 7fd33ffff700 1 -- 172.21.15.26:0/3634991881 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fd3580fdeb0 con 0x7fd340064100 2021-11-03T18:05:07.273 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:05:07.273 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (76m) 5m ago 77m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:05:07.273 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (68m) 5m ago 77m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:05:07.273 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (68m) 4m ago 76m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:05:07.274 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (76m) 5m ago 77m 41.7M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:05:07.274 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (69m) 5m ago 72m 25.6M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:05:07.274 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (69m) 5m ago 72m 26.2M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:05:07.274 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (72m) 4m ago 72m 26.4M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:05:07.275 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (72m) 4m ago 72m 26.8M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:05:07.275 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (70m) 5m ago 78m 561M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:05:07.275 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (69m) 4m ago 76m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:05:07.275 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (69m) 5m ago 79m 276M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:05:07.276 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (69m) 4m ago 76m 132M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:05:07.276 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (77m) 5m ago 77m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:05:07.276 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (76m) 4m ago 76m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:05:07.276 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (68m) 5m ago 76m 292M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:05:07.276 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (67m) 5m ago 75m 313M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:05:07.277 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (67m) 5m ago 75m 261M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:05:07.277 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (66m) 4m ago 74m 337M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:05:07.277 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (66m) 4m ago 74m 283M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:05:07.277 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (65m) 4m ago 74m 276M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:05:07.278 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (76m) 5m ago 76m 61.2M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:05:07.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.276+0000 7fd35e1e3700 1 -- 172.21.15.26:0/3634991881 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd340064100 msgr2=0x7fd3400665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:05:07.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.276+0000 7fd35e1e3700 1 --2- 172.21.15.26:0/3634991881 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd340064100 0x7fd3400665c0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7fd348004e30 tx=0x7fd348009b30).stop 2021-11-03T18:05:07.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.276+0000 7fd35e1e3700 1 -- 172.21.15.26:0/3634991881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3580f6820 msgr2=0x7fd35810c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:05:07.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.276+0000 7fd35e1e3700 1 --2- 172.21.15.26:0/3634991881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3580f6820 0x7fd35810c0f0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 rx=0x7fd34c00c790 tx=0x7fd34c007d70).stop 2021-11-03T18:05:07.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.276+0000 7fd35e1e3700 1 -- 172.21.15.26:0/3634991881 shutdown_connections 2021-11-03T18:05:07.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.276+0000 7fd35e1e3700 1 --2- 172.21.15.26:0/3634991881 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd340064100 0x7fd3400665c0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:07.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.276+0000 7fd35e1e3700 1 --2- 172.21.15.26:0/3634991881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3580f5580 0x7fd358109bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:07.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.276+0000 7fd35e1e3700 1 --2- 172.21.15.26:0/3634991881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3580f6820 0x7fd35810c0f0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:07.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.276+0000 7fd35e1e3700 1 -- 172.21.15.26:0/3634991881 >> 172.21.15.26:0/3634991881 conn(0x7fd3580f0ce0 msgr2=0x7fd3580fa270 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:05:07.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.276+0000 7fd35e1e3700 1 -- 172.21.15.26:0/3634991881 shutdown_connections 2021-11-03T18:05:07.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.276+0000 7fd35e1e3700 1 -- 172.21.15.26:0/3634991881 wait complete. 2021-11-03T18:05:07.374 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.375+0000 7effd5e76700 1 -- 172.21.15.26:0/1486366372 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effd00f4800 msgr2=0x7effd00f4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:05:07.374 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.375+0000 7effd5e76700 1 --2- 172.21.15.26:0/1486366372 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effd00f4800 0x7effd00f4c20 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 rx=0x7effc4004660 tx=0x7effc4009b30).stop 2021-11-03T18:05:07.375 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.375+0000 7effd5e76700 1 -- 172.21.15.26:0/1486366372 shutdown_connections 2021-11-03T18:05:07.375 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.375+0000 7effd5e76700 1 --2- 172.21.15.26:0/1486366372 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effd00f51a0 0x7effd00f7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:07.375 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.375+0000 7effd5e76700 1 --2- 172.21.15.26:0/1486366372 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effd00f4800 0x7effd00f4c20 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:07.375 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.375+0000 7effd5e76700 1 -- 172.21.15.26:0/1486366372 >> 172.21.15.26:0/1486366372 conn(0x7effd00f0320 msgr2=0x7effd00f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:05:07.376 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.375+0000 7effd5e76700 1 -- 172.21.15.26:0/1486366372 shutdown_connections 2021-11-03T18:05:07.376 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.375+0000 7effd5e76700 1 -- 172.21.15.26:0/1486366372 wait complete. 2021-11-03T18:05:07.376 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.376+0000 7effd5e76700 1 Processor -- start 2021-11-03T18:05:07.376 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.376+0000 7effd5e76700 1 -- start start 2021-11-03T18:05:07.376 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.376+0000 7effd5e76700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effd00f4800 0x7effd00f73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:05:07.377 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.376+0000 7effd5e76700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effd00f51a0 0x7effd00f5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:05:07.377 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.376+0000 7effd5e76700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd00f5d90 con 0x7effd00f51a0 2021-11-03T18:05:07.377 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.376+0000 7effd5e76700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd00f5ed0 con 0x7effd00f4800 2021-11-03T18:05:07.377 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.376+0000 7effcffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effd00f51a0 0x7effd00f5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:05:07.378 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.376+0000 7effcffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effd00f51a0 0x7effd00f5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58044/0 (socket says 172.21.15.26:58044) 2021-11-03T18:05:07.378 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.376+0000 7effcffff700 1 -- 172.21.15.26:0/1892557341 learned_addr learned my addr 172.21.15.26:0/1892557341 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:05:07.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.377+0000 7effd4e74700 1 --2- 172.21.15.26:0/1892557341 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effd00f4800 0x7effd00f73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:05:07.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.377+0000 7effcffff700 1 -- 172.21.15.26:0/1892557341 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effd00f4800 msgr2=0x7effd00f73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:05:07.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.377+0000 7effcffff700 1 --2- 172.21.15.26:0/1892557341 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effd00f4800 0x7effd00f73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:07.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.377+0000 7effcffff700 1 -- 172.21.15.26:0/1892557341 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc4005040 con 0x7effd00f51a0 2021-11-03T18:05:07.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.377+0000 7effcffff700 1 --2- 172.21.15.26:0/1892557341 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effd00f51a0 0x7effd00f5830 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7effbc002700 tx=0x7effbc009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:05:07.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.377+0000 7effcd7fa700 1 -- 172.21.15.26:0/1892557341 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effbc009320 con 0x7effd00f51a0 2021-11-03T18:05:07.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.377+0000 7effcd7fa700 1 -- 172.21.15.26:0/1892557341 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7effbc00f040 con 0x7effd00f51a0 2021-11-03T18:05:07.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.377+0000 7effd5e76700 1 -- 172.21.15.26:0/1892557341 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd00f61b0 con 0x7effd00f51a0 2021-11-03T18:05:07.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.377+0000 7effcd7fa700 1 -- 172.21.15.26:0/1892557341 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effbc014810 con 0x7effd00f51a0 2021-11-03T18:05:07.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.377+0000 7effd5e76700 1 -- 172.21.15.26:0/1892557341 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd010eda0 con 0x7effd00f51a0 2021-11-03T18:05:07.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.378+0000 7effd5e76700 1 -- 172.21.15.26:0/1892557341 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effd0045ad0 con 0x7effd00f51a0 2021-11-03T18:05:07.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.379+0000 7effcd7fa700 1 -- 172.21.15.26:0/1892557341 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7effbc014ad0 con 0x7effd00f51a0 2021-11-03T18:05:07.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.379+0000 7effcd7fa700 1 --2- 172.21.15.26:0/1892557341 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7effc0064100 0x7effc00665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:05:07.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.379+0000 7effcd7fa700 1 -- 172.21.15.26:0/1892557341 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7effbc081120 con 0x7effd00f51a0 2021-11-03T18:05:07.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.379+0000 7effd4e74700 1 --2- 172.21.15.26:0/1892557341 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7effc0064100 0x7effc00665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:05:07.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.379+0000 7effd4e74700 1 --2- 172.21.15.26:0/1892557341 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7effc0064100 0x7effc00665c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7effc4004e30 tx=0x7effc4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:05:07.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.383+0000 7effcd7fa700 1 -- 172.21.15.26:0/1892557341 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7effbc053420 con 0x7effd00f51a0 2021-11-03T18:05:07.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.615+0000 7effd5e76700 1 -- 172.21.15.26:0/1892557341 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7effd0027a00 con 0x7effd00f51a0 2021-11-03T18:05:07.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.615+0000 7effcd7fa700 1 -- 172.21.15.26:0/1892557341 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7effbc053010 con 0x7effd00f51a0 2021-11-03T18:05:07.614 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:05:07.614 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:05:07.615 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:05:07.615 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:05:07.615 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:05:07.615 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:05:07.616 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:05:07.616 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:05:07.616 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:05:07.617 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:05:07.617 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:05:07.617 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:05:07.618 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:05:07.618 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:05:07.619 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:05:07.619 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:05:07.619 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:05:07.620 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:05:07.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.617+0000 7effd5e76700 1 -- 172.21.15.26:0/1892557341 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7effc0064100 msgr2=0x7effc00665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:05:07.622 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.617+0000 7effd5e76700 1 --2- 172.21.15.26:0/1892557341 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7effc0064100 0x7effc00665c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7effc4004e30 tx=0x7effc4009b30).stop 2021-11-03T18:05:07.622 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.617+0000 7effd5e76700 1 -- 172.21.15.26:0/1892557341 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effd00f51a0 msgr2=0x7effd00f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:05:07.622 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.617+0000 7effd5e76700 1 --2- 172.21.15.26:0/1892557341 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effd00f51a0 0x7effd00f5830 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7effbc002700 tx=0x7effbc009d60).stop 2021-11-03T18:05:07.623 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.617+0000 7effd5e76700 1 -- 172.21.15.26:0/1892557341 shutdown_connections 2021-11-03T18:05:07.623 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.617+0000 7effd5e76700 1 --2- 172.21.15.26:0/1892557341 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7effc0064100 0x7effc00665c0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:07.623 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.617+0000 7effd5e76700 1 --2- 172.21.15.26:0/1892557341 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effd00f4800 0x7effd00f73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:07.623 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.617+0000 7effd5e76700 1 --2- 172.21.15.26:0/1892557341 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effd00f51a0 0x7effd00f5830 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:07.624 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.617+0000 7effd5e76700 1 -- 172.21.15.26:0/1892557341 >> 172.21.15.26:0/1892557341 conn(0x7effd00f0320 msgr2=0x7effd00fb370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:05:07.624 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.617+0000 7effd5e76700 1 -- 172.21.15.26:0/1892557341 shutdown_connections 2021-11-03T18:05:07.624 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.617+0000 7effd5e76700 1 -- 172.21.15.26:0/1892557341 wait complete. 2021-11-03T18:05:07.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.718+0000 7f5b589de700 1 -- 172.21.15.26:0/630522274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b540f5ef0 msgr2=0x7f5b540f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:05:07.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.718+0000 7f5b589de700 1 --2- 172.21.15.26:0/630522274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b540f5ef0 0x7f5b540f6920 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7f5b3c004660 tx=0x7f5b3c009b30).stop 2021-11-03T18:05:07.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.718+0000 7f5b589de700 1 -- 172.21.15.26:0/630522274 shutdown_connections 2021-11-03T18:05:07.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.718+0000 7f5b589de700 1 --2- 172.21.15.26:0/630522274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b540f5ef0 0x7f5b540f6920 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:07.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.718+0000 7f5b589de700 1 --2- 172.21.15.26:0/630522274 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b540f55e0 0x7f5b540f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:07.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.718+0000 7f5b589de700 1 -- 172.21.15.26:0/630522274 >> 172.21.15.26:0/630522274 conn(0x7f5b540f0de0 msgr2=0x7f5b540f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:05:07.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.718+0000 7f5b589de700 1 -- 172.21.15.26:0/630522274 shutdown_connections 2021-11-03T18:05:07.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.718+0000 7f5b589de700 1 -- 172.21.15.26:0/630522274 wait complete. 2021-11-03T18:05:07.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.719+0000 7f5b589de700 1 Processor -- start 2021-11-03T18:05:07.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.719+0000 7f5b589de700 1 -- start start 2021-11-03T18:05:07.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.719+0000 7f5b589de700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b540f55e0 0x7f5b54106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:05:07.726 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.719+0000 7f5b589de700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b540f5ef0 0x7f5b54107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:05:07.726 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.719+0000 7f5b589de700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b54107a00 con 0x7f5b540f55e0 2021-11-03T18:05:07.726 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.719+0000 7f5b589de700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b54107b40 con 0x7f5b540f5ef0 2021-11-03T18:05:07.726 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.719+0000 7f5b5259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b540f55e0 0x7f5b54106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:05:07.727 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.719+0000 7f5b5259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b540f55e0 0x7f5b54106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58054/0 (socket says 172.21.15.26:58054) 2021-11-03T18:05:07.727 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.719+0000 7f5b5259c700 1 -- 172.21.15.26:0/421909946 learned_addr learned my addr 172.21.15.26:0/421909946 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:05:07.727 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.719+0000 7f5b51d9b700 1 --2- 172.21.15.26:0/421909946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b540f5ef0 0x7f5b54107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:05:07.728 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.719+0000 7f5b5259c700 1 -- 172.21.15.26:0/421909946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b540f5ef0 msgr2=0x7f5b54107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:05:07.728 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.719+0000 7f5b5259c700 1 --2- 172.21.15.26:0/421909946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b540f5ef0 0x7f5b54107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:07.728 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.719+0000 7f5b5259c700 1 -- 172.21.15.26:0/421909946 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b3c005040 con 0x7f5b540f55e0 2021-11-03T18:05:07.728 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.719+0000 7f5b5259c700 1 --2- 172.21.15.26:0/421909946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b540f55e0 0x7f5b54106f60 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 rx=0x7f5b440026d0 tx=0x7f5b44009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:05:07.729 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.720+0000 7f5b4affd700 1 -- 172.21.15.26:0/421909946 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b44009320 con 0x7f5b540f55e0 2021-11-03T18:05:07.729 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.720+0000 7f5b4affd700 1 -- 172.21.15.26:0/421909946 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5b4400f040 con 0x7f5b540f55e0 2021-11-03T18:05:07.729 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.720+0000 7f5b589de700 1 -- 172.21.15.26:0/421909946 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b541084e0 con 0x7f5b540f55e0 2021-11-03T18:05:07.729 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.720+0000 7f5b4affd700 1 -- 172.21.15.26:0/421909946 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b440147e0 con 0x7f5b540f55e0 2021-11-03T18:05:07.730 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.720+0000 7f5b589de700 1 -- 172.21.15.26:0/421909946 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b54108aa0 con 0x7f5b540f55e0 2021-11-03T18:05:07.730 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.721+0000 7f5b589de700 1 -- 172.21.15.26:0/421909946 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b54045ad0 con 0x7f5b540f55e0 2021-11-03T18:05:07.730 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.721+0000 7f5b4affd700 1 -- 172.21.15.26:0/421909946 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f5b44009480 con 0x7f5b540f55e0 2021-11-03T18:05:07.731 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.721+0000 7f5b4affd700 1 --2- 172.21.15.26:0/421909946 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5b400640b0 0x7f5b40066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:05:07.731 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.722+0000 7f5b4affd700 1 -- 172.21.15.26:0/421909946 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f5b44080eb0 con 0x7f5b540f55e0 2021-11-03T18:05:07.731 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.722+0000 7f5b51d9b700 1 --2- 172.21.15.26:0/421909946 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5b400640b0 0x7f5b40066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:05:07.731 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.722+0000 7f5b51d9b700 1 --2- 172.21.15.26:0/421909946 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5b400640b0 0x7f5b40066570 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f5b3c004630 tx=0x7f5b3c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:05:07.732 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.726+0000 7f5b4affd700 1 -- 172.21.15.26:0/421909946 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f5b44053210 con 0x7f5b540f55e0 2021-11-03T18:05:07.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:07 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1892557341' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:05:07.927 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.928+0000 7f5b589de700 1 -- 172.21.15.26:0/421909946 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5b540f7b40 con 0x7f5b540f55e0 2021-11-03T18:05:07.927 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.929+0000 7f5b4affd700 1 -- 172.21.15.26:0/421909946 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f5b44052e00 con 0x7f5b540f55e0 2021-11-03T18:05:07.927 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:05:07.928 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:05:07.928 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:05:07.928 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:05:07.928 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:05:07.929 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:05:07.929 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:05:07.929 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:05:07.929 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:05:07.929 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:05:07.930 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:05:07.930 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:05:07.930 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:05:07.930 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:05:07.931 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:05:07.931 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:05:07.931 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:05:07.931 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:05:07.931 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:05:07.932 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:05:07.932 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:05:07.932 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:05:07.932 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:05:07.933 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:05:07.933 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:05:07.933 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:05:07.933 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:05:07.933 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:05:07.934 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:05:07.934 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:05:07.934 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:05:07.934 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:05:07.935 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:05:07.935 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:05:07.935 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:05:07.935 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:05:07.935 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:05:07.936 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:05:07.936 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:05:07.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.931+0000 7f5b589de700 1 -- 172.21.15.26:0/421909946 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5b400640b0 msgr2=0x7f5b40066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:05:07.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.931+0000 7f5b589de700 1 --2- 172.21.15.26:0/421909946 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5b400640b0 0x7f5b40066570 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f5b3c004630 tx=0x7f5b3c009b30).stop 2021-11-03T18:05:07.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.931+0000 7f5b589de700 1 -- 172.21.15.26:0/421909946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b540f55e0 msgr2=0x7f5b54106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:05:07.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.931+0000 7f5b589de700 1 --2- 172.21.15.26:0/421909946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b540f55e0 0x7f5b54106f60 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 rx=0x7f5b440026d0 tx=0x7f5b44009de0).stop 2021-11-03T18:05:07.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.931+0000 7f5b589de700 1 -- 172.21.15.26:0/421909946 shutdown_connections 2021-11-03T18:05:07.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.931+0000 7f5b589de700 1 --2- 172.21.15.26:0/421909946 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5b400640b0 0x7f5b40066570 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:07.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.931+0000 7f5b589de700 1 --2- 172.21.15.26:0/421909946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b540f55e0 0x7f5b54106f60 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:07.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.931+0000 7f5b589de700 1 --2- 172.21.15.26:0/421909946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b540f5ef0 0x7f5b54107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:07.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.931+0000 7f5b589de700 1 -- 172.21.15.26:0/421909946 >> 172.21.15.26:0/421909946 conn(0x7f5b540f0de0 msgr2=0x7f5b5405ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:05:07.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.931+0000 7f5b589de700 1 -- 172.21.15.26:0/421909946 shutdown_connections 2021-11-03T18:05:07.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:07.931+0000 7f5b589de700 1 -- 172.21.15.26:0/421909946 wait complete. 2021-11-03T18:05:07.940 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:05:07.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:07 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1892557341' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:05:08.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:08 smithi026 ceph-mon[96795]: from='client.36316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:05:08.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:08 smithi026 ceph-mon[96795]: from='client.36320 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:05:08.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:08 smithi026 ceph-mon[96795]: pgmap v2114: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:08.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:08 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/421909946' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:05:08.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:08 smithi194 ceph-mon[65619]: from='client.36316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:05:09.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:08 smithi194 ceph-mon[65619]: from='client.36320 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:05:09.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:08 smithi194 ceph-mon[65619]: pgmap v2114: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:09.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:08 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/421909946' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:05:10.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:10 smithi026 ceph-mon[96795]: pgmap v2115: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:10.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:10 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:05:10.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:10 smithi194 ceph-mon[65619]: pgmap v2115: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:11.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:10 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:05:11.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:11 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:05:11.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:11 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:05:12.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:12 smithi026 ceph-mon[96795]: pgmap v2116: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:12.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:12 smithi194 ceph-mon[65619]: pgmap v2116: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:14.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:14 smithi026 ceph-mon[96795]: pgmap v2117: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:14.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:14 smithi194 ceph-mon[65619]: pgmap v2117: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:16.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:16 smithi026 ceph-mon[96795]: pgmap v2118: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:16.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:16 smithi194 ceph-mon[65619]: pgmap v2118: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:18.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:18 smithi026 ceph-mon[96795]: pgmap v2119: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:18.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:18 smithi194 ceph-mon[65619]: pgmap v2119: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:20.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:20 smithi026 ceph-mon[96795]: pgmap v2120: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:20.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:20 smithi194 ceph-mon[65619]: pgmap v2120: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:22.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:22 smithi026 ceph-mon[96795]: pgmap v2121: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:22.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:22 smithi194 ceph-mon[65619]: pgmap v2121: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:24.923 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:24 smithi026 ceph-mon[96795]: pgmap v2122: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:24.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:24 smithi194 ceph-mon[65619]: pgmap v2122: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:25.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:05:25.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:05:26.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:26 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:05:27.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:26 smithi194 ceph-mon[65619]: pgmap v2123: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:27.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:26 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:05:27.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:26 smithi026 ceph-mon[96795]: pgmap v2123: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:28.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:28 smithi194 ceph-mon[65619]: pgmap v2124: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:29.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:28 smithi026 ceph-mon[96795]: pgmap v2124: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:30.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:30 smithi194 ceph-mon[65619]: pgmap v2125: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:31.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:30 smithi026 ceph-mon[96795]: pgmap v2125: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:32.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:32 smithi194 ceph-mon[65619]: pgmap v2126: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:33.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:32 smithi026 ceph-mon[96795]: pgmap v2126: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:34.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:34 smithi194 ceph-mon[65619]: pgmap v2127: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:35.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:34 smithi026 ceph-mon[96795]: pgmap v2127: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:36.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:36 smithi194 ceph-mon[65619]: pgmap v2128: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:37.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:36 smithi026 ceph-mon[96795]: pgmap v2128: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:38.046 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.047+0000 7fa68c4a1700 1 -- 172.21.15.26:0/3274815556 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6840f55e0 msgr2=0x7fa6840f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:05:38.046 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.047+0000 7fa68c4a1700 1 --2- 172.21.15.26:0/3274815556 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6840f55e0 0x7fa6840f5a00 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 rx=0x7fa680004660 tx=0x7fa680009b30).stop 2021-11-03T18:05:38.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.047+0000 7fa68c4a1700 1 -- 172.21.15.26:0/3274815556 shutdown_connections 2021-11-03T18:05:38.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.047+0000 7fa68c4a1700 1 --2- 172.21.15.26:0/3274815556 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6840f5ef0 0x7fa6840f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:05:38.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.047+0000 7fa68c4a1700 1 --2- 172.21.15.26:0/3274815556 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6840f55e0 0x7fa6840f5a00 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:38.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.047+0000 7fa68c4a1700 1 -- 172.21.15.26:0/3274815556 >> 172.21.15.26:0/3274815556 conn(0x7fa6840f0de0 msgr2=0x7fa6840f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:05:38.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.047+0000 7fa68c4a1700 1 -- 172.21.15.26:0/3274815556 shutdown_connections 2021-11-03T18:05:38.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.047+0000 7fa68c4a1700 1 -- 172.21.15.26:0/3274815556 wait complete. 2021-11-03T18:05:38.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.048+0000 7fa68c4a1700 1 Processor -- start 2021-11-03T18:05:38.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.048+0000 7fa68c4a1700 1 -- start start 2021-11-03T18:05:38.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.048+0000 7fa68c4a1700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6840f55e0 0x7fa684106fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:05:38.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.048+0000 7fa68c4a1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6840f5ef0 0x7fa684107490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:05:38.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.048+0000 7fa68c4a1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa684107ad0 con 0x7fa6840f5ef0 2021-11-03T18:05:38.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.048+0000 7fa68c4a1700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa684108380 con 0x7fa6840f55e0 2021-11-03T18:05:38.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.048+0000 7fa689a3c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6840f5ef0 0x7fa684107490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:05:38.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.048+0000 7fa689a3c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6840f5ef0 0x7fa684107490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58074/0 (socket says 172.21.15.26:58074) 2021-11-03T18:05:38.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.048+0000 7fa689a3c700 1 -- 172.21.15.26:0/3893405873 learned_addr learned my addr 172.21.15.26:0/3893405873 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:05:38.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.048+0000 7fa68a23d700 1 --2- 172.21.15.26:0/3893405873 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6840f55e0 0x7fa684106fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:05:38.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.049+0000 7fa689a3c700 1 -- 172.21.15.26:0/3893405873 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6840f55e0 msgr2=0x7fa684106fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:05:38.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.049+0000 7fa689a3c700 1 --2- 172.21.15.26:0/3893405873 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6840f55e0 0x7fa684106fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:38.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.049+0000 7fa689a3c700 1 -- 172.21.15.26:0/3893405873 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa680005040 con 0x7fa6840f5ef0 2021-11-03T18:05:38.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.049+0000 7fa68a23d700 1 --2- 172.21.15.26:0/3893405873 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6840f55e0 0x7fa684106fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:05:38.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.049+0000 7fa689a3c700 1 --2- 172.21.15.26:0/3893405873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6840f5ef0 0x7fa684107490 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7fa67400b410 tx=0x7fa674006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:05:38.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.049+0000 7fa67affd700 1 -- 172.21.15.26:0/3893405873 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6740125f0 con 0x7fa6840f5ef0 2021-11-03T18:05:38.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.049+0000 7fa67affd700 1 -- 172.21.15.26:0/3893405873 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa674012c00 con 0x7fa6840f5ef0 2021-11-03T18:05:38.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.049+0000 7fa67affd700 1 -- 172.21.15.26:0/3893405873 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa674002ae0 con 0x7fa6840f5ef0 2021-11-03T18:05:38.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.049+0000 7fa68c4a1700 1 -- 172.21.15.26:0/3893405873 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa684108660 con 0x7fa6840f5ef0 2021-11-03T18:05:38.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.049+0000 7fa68c4a1700 1 -- 172.21.15.26:0/3893405873 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa684108c20 con 0x7fa6840f5ef0 2021-11-03T18:05:38.053 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.050+0000 7fa68c4a1700 1 -- 172.21.15.26:0/3893405873 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6840f4a70 con 0x7fa6840f5ef0 2021-11-03T18:05:38.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.050+0000 7fa67affd700 1 -- 172.21.15.26:0/3893405873 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fa67400f030 con 0x7fa6840f5ef0 2021-11-03T18:05:38.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.051+0000 7fa67affd700 1 --2- 172.21.15.26:0/3893405873 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa6700640b0 0x7fa670066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:05:38.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.051+0000 7fa67affd700 1 -- 172.21.15.26:0/3893405873 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fa674080bf0 con 0x7fa6840f5ef0 2021-11-03T18:05:38.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.051+0000 7fa68a23d700 1 --2- 172.21.15.26:0/3893405873 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa6700640b0 0x7fa670066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:05:38.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.051+0000 7fa68a23d700 1 --2- 172.21.15.26:0/3893405873 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa6700640b0 0x7fa670066570 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7fa680004e30 tx=0x7fa680009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:05:38.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.055+0000 7fa67affd700 1 -- 172.21.15.26:0/3893405873 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fa674052f50 con 0x7fa6840f5ef0 2021-11-03T18:05:38.229 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.232+0000 7fa68c4a1700 1 -- 172.21.15.26:0/3893405873 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa68405fe30 con 0x7fa6700640b0 2021-11-03T18:05:38.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.233+0000 7fa67affd700 1 -- 172.21.15.26:0/3893405873 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fa68405fe30 con 0x7fa6700640b0 2021-11-03T18:05:38.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.235+0000 7fa68c4a1700 1 -- 172.21.15.26:0/3893405873 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa6700640b0 msgr2=0x7fa670066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:05:38.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.235+0000 7fa68c4a1700 1 --2- 172.21.15.26:0/3893405873 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa6700640b0 0x7fa670066570 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7fa680004e30 tx=0x7fa680009b30).stop 2021-11-03T18:05:38.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.235+0000 7fa68c4a1700 1 -- 172.21.15.26:0/3893405873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6840f5ef0 msgr2=0x7fa684107490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:05:38.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.235+0000 7fa68c4a1700 1 --2- 172.21.15.26:0/3893405873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6840f5ef0 0x7fa684107490 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7fa67400b410 tx=0x7fa674006ef0).stop 2021-11-03T18:05:38.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.235+0000 7fa68c4a1700 1 -- 172.21.15.26:0/3893405873 shutdown_connections 2021-11-03T18:05:38.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.235+0000 7fa68c4a1700 1 --2- 172.21.15.26:0/3893405873 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa6700640b0 0x7fa670066570 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:38.307 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.235+0000 7fa68c4a1700 1 --2- 172.21.15.26:0/3893405873 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6840f55e0 0x7fa684106fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:38.307 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.235+0000 7fa68c4a1700 1 --2- 172.21.15.26:0/3893405873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6840f5ef0 0x7fa684107490 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:38.307 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.235+0000 7fa68c4a1700 1 -- 172.21.15.26:0/3893405873 >> 172.21.15.26:0/3893405873 conn(0x7fa6840f0de0 msgr2=0x7fa68405f720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:05:38.307 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.235+0000 7fa68c4a1700 1 -- 172.21.15.26:0/3893405873 shutdown_connections 2021-11-03T18:05:38.307 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.235+0000 7fa68c4a1700 1 -- 172.21.15.26:0/3893405873 wait complete. 2021-11-03T18:05:38.308 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:05:38.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.335+0000 7fde9db26700 1 -- 172.21.15.26:0/4243708189 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde980f66e0 msgr2=0x7fde980f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:05:38.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.335+0000 7fde9db26700 1 --2- 172.21.15.26:0/4243708189 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde980f66e0 0x7fde980f6b40 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 rx=0x7fde84004660 tx=0x7fde84009b30).stop 2021-11-03T18:05:38.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.335+0000 7fde9db26700 1 -- 172.21.15.26:0/4243708189 shutdown_connections 2021-11-03T18:05:38.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.335+0000 7fde9db26700 1 --2- 172.21.15.26:0/4243708189 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde980f66e0 0x7fde980f6b40 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:38.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.335+0000 7fde9db26700 1 --2- 172.21.15.26:0/4243708189 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde980f5440 0x7fde980f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:05:38.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.335+0000 7fde9db26700 1 -- 172.21.15.26:0/4243708189 >> 172.21.15.26:0/4243708189 conn(0x7fde980f0ba0 msgr2=0x7fde980f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:05:38.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.336+0000 7fde9db26700 1 -- 172.21.15.26:0/4243708189 shutdown_connections 2021-11-03T18:05:38.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.336+0000 7fde9db26700 1 -- 172.21.15.26:0/4243708189 wait complete. 2021-11-03T18:05:38.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.336+0000 7fde9db26700 1 Processor -- start 2021-11-03T18:05:38.338 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.336+0000 7fde9db26700 1 -- start start 2021-11-03T18:05:38.338 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.336+0000 7fde9db26700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde980f5440 0x7fde98106db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:05:38.338 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.336+0000 7fde9db26700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde980f66e0 0x7fde981072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:05:38.339 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.336+0000 7fde9db26700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde98107930 con 0x7fde980f5440 2021-11-03T18:05:38.339 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.336+0000 7fde9db26700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde981080e0 con 0x7fde980f66e0 2021-11-03T18:05:38.339 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.336+0000 7fde9cb24700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde980f5440 0x7fde98106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:05:38.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.337+0000 7fde9cb24700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde980f5440 0x7fde98106db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58082/0 (socket says 172.21.15.26:58082) 2021-11-03T18:05:38.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.337+0000 7fde9cb24700 1 -- 172.21.15.26:0/299332200 learned_addr learned my addr 172.21.15.26:0/299332200 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:05:38.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.337+0000 7fde97fff700 1 --2- 172.21.15.26:0/299332200 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde980f66e0 0x7fde981072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:05:38.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.337+0000 7fde9cb24700 1 -- 172.21.15.26:0/299332200 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde980f66e0 msgr2=0x7fde981072a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:05:38.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.337+0000 7fde9cb24700 1 --2- 172.21.15.26:0/299332200 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde980f66e0 0x7fde981072a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:38.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.337+0000 7fde9cb24700 1 -- 172.21.15.26:0/299332200 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde84005040 con 0x7fde980f5440 2021-11-03T18:05:38.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.337+0000 7fde9cb24700 1 --2- 172.21.15.26:0/299332200 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde980f5440 0x7fde98106db0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7fde8c0093f0 tx=0x7fde8c006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:05:38.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.337+0000 7fde957fa700 1 -- 172.21.15.26:0/299332200 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde8c009ea0 con 0x7fde980f5440 2021-11-03T18:05:38.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.337+0000 7fde957fa700 1 -- 172.21.15.26:0/299332200 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fde8c013af0 con 0x7fde980f5440 2021-11-03T18:05:38.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.337+0000 7fde9db26700 1 -- 172.21.15.26:0/299332200 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde981083c0 con 0x7fde980f5440 2021-11-03T18:05:38.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.337+0000 7fde957fa700 1 -- 172.21.15.26:0/299332200 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde8c00db10 con 0x7fde980f5440 2021-11-03T18:05:38.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.337+0000 7fde9db26700 1 -- 172.21.15.26:0/299332200 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde98108980 con 0x7fde980f5440 2021-11-03T18:05:38.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.338+0000 7fde9db26700 1 -- 172.21.15.26:0/299332200 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde98059100 con 0x7fde980f5440 2021-11-03T18:05:38.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.339+0000 7fde957fa700 1 -- 172.21.15.26:0/299332200 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fde8c01a060 con 0x7fde980f5440 2021-11-03T18:05:38.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.339+0000 7fde957fa700 1 --2- 172.21.15.26:0/299332200 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fde88064100 0x7fde880665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:05:38.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.339+0000 7fde957fa700 1 -- 172.21.15.26:0/299332200 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fde8c0808f0 con 0x7fde980f5440 2021-11-03T18:05:38.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.339+0000 7fde97fff700 1 --2- 172.21.15.26:0/299332200 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fde88064100 0x7fde880665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:05:38.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.339+0000 7fde97fff700 1 --2- 172.21.15.26:0/299332200 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fde88064100 0x7fde880665c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7fde84004e30 tx=0x7fde84009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:05:38.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.343+0000 7fde957fa700 1 -- 172.21.15.26:0/299332200 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fde8c052b60 con 0x7fde980f5440 2021-11-03T18:05:38.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.518+0000 7fde9db26700 1 -- 172.21.15.26:0/299332200 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fde9805fd50 con 0x7fde88064100 2021-11-03T18:05:38.530 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.532+0000 7fde957fa700 1 -- 172.21.15.26:0/299332200 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fde9805fd50 con 0x7fde88064100 2021-11-03T18:05:38.531 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:05:38.531 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (76m) 5m ago 78m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:05:38.532 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (69m) 5m ago 78m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:05:38.532 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (68m) 4m ago 77m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:05:38.532 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (76m) 5m ago 77m 41.7M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:05:38.532 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (69m) 5m ago 73m 25.6M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:05:38.533 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (70m) 5m ago 73m 26.2M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:05:38.533 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (73m) 4m ago 73m 26.4M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:05:38.533 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (73m) 4m ago 73m 26.8M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:05:38.533 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (70m) 5m ago 79m 561M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:05:38.534 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (70m) 4m ago 77m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:05:38.534 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (70m) 5m ago 79m 276M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:05:38.534 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (69m) 4m ago 77m 132M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:05:38.535 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (77m) 5m ago 77m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:05:38.535 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (77m) 4m ago 77m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:05:38.535 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (68m) 5m ago 76m 292M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:05:38.536 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (68m) 5m ago 76m 313M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:05:38.536 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (67m) 5m ago 75m 261M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:05:38.536 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (67m) 4m ago 75m 337M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:05:38.536 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (66m) 4m ago 75m 283M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:05:38.537 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (66m) 4m ago 74m 276M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:05:38.537 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (76m) 5m ago 77m 61.2M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:05:38.538 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.534+0000 7fde9db26700 1 -- 172.21.15.26:0/299332200 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fde88064100 msgr2=0x7fde880665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:05:38.538 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.534+0000 7fde9db26700 1 --2- 172.21.15.26:0/299332200 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fde88064100 0x7fde880665c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7fde84004e30 tx=0x7fde84009b30).stop 2021-11-03T18:05:38.538 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.534+0000 7fde9db26700 1 -- 172.21.15.26:0/299332200 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde980f5440 msgr2=0x7fde98106db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:05:38.538 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.534+0000 7fde9db26700 1 --2- 172.21.15.26:0/299332200 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde980f5440 0x7fde98106db0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7fde8c0093f0 tx=0x7fde8c006ec0).stop 2021-11-03T18:05:38.539 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.534+0000 7fde9db26700 1 -- 172.21.15.26:0/299332200 shutdown_connections 2021-11-03T18:05:38.539 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.534+0000 7fde9db26700 1 --2- 172.21.15.26:0/299332200 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fde88064100 0x7fde880665c0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:38.539 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.534+0000 7fde9db26700 1 --2- 172.21.15.26:0/299332200 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde980f5440 0x7fde98106db0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:38.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.534+0000 7fde9db26700 1 --2- 172.21.15.26:0/299332200 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde980f66e0 0x7fde981072a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:38.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.534+0000 7fde9db26700 1 -- 172.21.15.26:0/299332200 >> 172.21.15.26:0/299332200 conn(0x7fde980f0ba0 msgr2=0x7fde9805f640 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:05:38.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.534+0000 7fde9db26700 1 -- 172.21.15.26:0/299332200 shutdown_connections 2021-11-03T18:05:38.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.534+0000 7fde9db26700 1 -- 172.21.15.26:0/299332200 wait complete. 2021-11-03T18:05:38.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.633+0000 7f1ee5e4f700 1 -- 172.21.15.26:0/157975201 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ee00f66e0 msgr2=0x7f1ee00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:05:38.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.633+0000 7f1ee5e4f700 1 --2- 172.21.15.26:0/157975201 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ee00f66e0 0x7f1ee00f6b00 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 rx=0x7f1ed0004660 tx=0x7f1ed0009b30).stop 2021-11-03T18:05:38.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.633+0000 7f1ee5e4f700 1 -- 172.21.15.26:0/157975201 shutdown_connections 2021-11-03T18:05:38.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.633+0000 7f1ee5e4f700 1 --2- 172.21.15.26:0/157975201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ee00f6ff0 0x7f1ee00f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:38.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.633+0000 7f1ee5e4f700 1 --2- 172.21.15.26:0/157975201 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ee00f66e0 0x7f1ee00f6b00 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:38.634 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.633+0000 7f1ee5e4f700 1 -- 172.21.15.26:0/157975201 >> 172.21.15.26:0/157975201 conn(0x7f1ee00f1f00 msgr2=0x7f1ee00f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:05:38.634 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.633+0000 7f1ee5e4f700 1 -- 172.21.15.26:0/157975201 shutdown_connections 2021-11-03T18:05:38.634 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.633+0000 7f1ee5e4f700 1 -- 172.21.15.26:0/157975201 wait complete. 2021-11-03T18:05:38.634 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.634+0000 7f1ee5e4f700 1 Processor -- start 2021-11-03T18:05:38.635 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.634+0000 7f1ee5e4f700 1 -- start start 2021-11-03T18:05:38.635 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.634+0000 7f1ee5e4f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ee00f66e0 0x7f1ee0106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:05:38.635 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.634+0000 7f1ee5e4f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ee00f6ff0 0x7f1ee0107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:05:38.635 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.634+0000 7f1ee5e4f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee0107a00 con 0x7f1ee00f66e0 2021-11-03T18:05:38.635 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.634+0000 7f1ee5e4f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee0107b40 con 0x7f1ee00f6ff0 2021-11-03T18:05:38.636 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.634+0000 7f1edf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ee00f66e0 0x7f1ee0106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:05:38.636 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.634+0000 7f1edf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ee00f66e0 0x7f1ee0106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58092/0 (socket says 172.21.15.26:58092) 2021-11-03T18:05:38.636 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.634+0000 7f1edf7fe700 1 -- 172.21.15.26:0/190545754 learned_addr learned my addr 172.21.15.26:0/190545754 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:05:38.636 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.635+0000 7f1edeffd700 1 --2- 172.21.15.26:0/190545754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ee00f6ff0 0x7f1ee0107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:05:38.637 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.635+0000 7f1edf7fe700 1 -- 172.21.15.26:0/190545754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ee00f6ff0 msgr2=0x7f1ee0107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:05:38.637 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.635+0000 7f1edf7fe700 1 --2- 172.21.15.26:0/190545754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ee00f6ff0 0x7f1ee0107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:38.637 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.635+0000 7f1edf7fe700 1 -- 172.21.15.26:0/190545754 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed0005040 con 0x7f1ee00f66e0 2021-11-03T18:05:38.637 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.635+0000 7f1edeffd700 1 --2- 172.21.15.26:0/190545754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ee00f6ff0 0x7f1ee0107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:05:38.638 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.635+0000 7f1edf7fe700 1 --2- 172.21.15.26:0/190545754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ee00f66e0 0x7f1ee0106f60 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 rx=0x7f1ed0009990 tx=0x7f1ed0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:05:38.638 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.635+0000 7f1ec7fff700 1 -- 172.21.15.26:0/190545754 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ed0018070 con 0x7f1ee00f66e0 2021-11-03T18:05:38.638 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.635+0000 7f1ec7fff700 1 -- 172.21.15.26:0/190545754 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1ed0007ca0 con 0x7f1ee00f66e0 2021-11-03T18:05:38.638 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.635+0000 7f1ee5e4f700 1 -- 172.21.15.26:0/190545754 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ee0108480 con 0x7f1ee00f66e0 2021-11-03T18:05:38.639 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.635+0000 7f1ec7fff700 1 -- 172.21.15.26:0/190545754 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ed001c620 con 0x7f1ee00f66e0 2021-11-03T18:05:38.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.635+0000 7f1ee5e4f700 1 -- 172.21.15.26:0/190545754 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ee01089e0 con 0x7f1ee00f66e0 2021-11-03T18:05:38.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.636+0000 7f1ee5e4f700 1 -- 172.21.15.26:0/190545754 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ee0045ad0 con 0x7f1ee00f66e0 2021-11-03T18:05:38.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.636+0000 7f1ec7fff700 1 -- 172.21.15.26:0/190545754 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f1ed001d960 con 0x7f1ee00f66e0 2021-11-03T18:05:38.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.637+0000 7f1ec7fff700 1 --2- 172.21.15.26:0/190545754 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1ec80640b0 0x7f1ec8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:05:38.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.637+0000 7f1ec7fff700 1 -- 172.21.15.26:0/190545754 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f1ed0082520 con 0x7f1ee00f66e0 2021-11-03T18:05:38.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.637+0000 7f1edeffd700 1 --2- 172.21.15.26:0/190545754 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1ec80640b0 0x7f1ec8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:05:38.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.637+0000 7f1edeffd700 1 --2- 172.21.15.26:0/190545754 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1ec80640b0 0x7f1ec8066570 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f1ed4004a70 tx=0x7f1ed4009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:05:38.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.641+0000 7f1ec7fff700 1 -- 172.21.15.26:0/190545754 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f1ed0054940 con 0x7f1ee00f66e0 2021-11-03T18:05:38.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.873+0000 7f1ee5e4f700 1 -- 172.21.15.26:0/190545754 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1ee00feed0 con 0x7f1ee00f66e0 2021-11-03T18:05:38.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.873+0000 7f1ec7fff700 1 -- 172.21.15.26:0/190545754 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f1ed0054530 con 0x7f1ee00f66e0 2021-11-03T18:05:38.871 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:05:38.871 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:05:38.872 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:05:38.872 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:05:38.872 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:05:38.872 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:05:38.872 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:05:38.873 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:05:38.873 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:05:38.873 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:05:38.873 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:05:38.874 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:05:38.874 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:05:38.874 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:05:38.874 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:05:38.875 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:05:38.875 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:05:38.875 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:05:38.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.875+0000 7f1ee5e4f700 1 -- 172.21.15.26:0/190545754 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1ec80640b0 msgr2=0x7f1ec8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:05:38.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.875+0000 7f1ee5e4f700 1 --2- 172.21.15.26:0/190545754 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1ec80640b0 0x7f1ec8066570 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f1ed4004a70 tx=0x7f1ed4009040).stop 2021-11-03T18:05:38.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.875+0000 7f1ee5e4f700 1 -- 172.21.15.26:0/190545754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ee00f66e0 msgr2=0x7f1ee0106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:05:38.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.875+0000 7f1ee5e4f700 1 --2- 172.21.15.26:0/190545754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ee00f66e0 0x7f1ee0106f60 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 rx=0x7f1ed0009990 tx=0x7f1ed0009b30).stop 2021-11-03T18:05:38.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.875+0000 7f1ee5e4f700 1 -- 172.21.15.26:0/190545754 shutdown_connections 2021-11-03T18:05:38.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.875+0000 7f1ee5e4f700 1 --2- 172.21.15.26:0/190545754 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1ec80640b0 0x7f1ec8066570 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:38.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.875+0000 7f1ee5e4f700 1 --2- 172.21.15.26:0/190545754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ee00f66e0 0x7f1ee0106f60 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:38.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.875+0000 7f1ee5e4f700 1 --2- 172.21.15.26:0/190545754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ee00f6ff0 0x7f1ee0107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:38.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.875+0000 7f1ee5e4f700 1 -- 172.21.15.26:0/190545754 >> 172.21.15.26:0/190545754 conn(0x7f1ee00f1f00 msgr2=0x7f1ee00fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:05:38.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.875+0000 7f1ee5e4f700 1 -- 172.21.15.26:0/190545754 shutdown_connections 2021-11-03T18:05:38.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.875+0000 7f1ee5e4f700 1 -- 172.21.15.26:0/190545754 wait complete. 2021-11-03T18:05:38.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.975+0000 7f8f94dc4700 1 -- 172.21.15.26:0/1316875110 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f900f6860 msgr2=0x7f8f900f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:05:38.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.975+0000 7f8f94dc4700 1 --2- 172.21.15.26:0/1316875110 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f900f6860 0x7f8f900f6cc0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7f8f80004660 tx=0x7f8f80009b30).stop 2021-11-03T18:05:38.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.975+0000 7f8f94dc4700 1 -- 172.21.15.26:0/1316875110 shutdown_connections 2021-11-03T18:05:38.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.975+0000 7f8f94dc4700 1 --2- 172.21.15.26:0/1316875110 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f900f6860 0x7f8f900f6cc0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:38.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.975+0000 7f8f94dc4700 1 --2- 172.21.15.26:0/1316875110 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f900f55c0 0x7f8f900f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:38.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.975+0000 7f8f94dc4700 1 -- 172.21.15.26:0/1316875110 >> 172.21.15.26:0/1316875110 conn(0x7f8f900f0d20 msgr2=0x7f8f900f3140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:05:38.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.975+0000 7f8f94dc4700 1 -- 172.21.15.26:0/1316875110 shutdown_connections 2021-11-03T18:05:38.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.975+0000 7f8f94dc4700 1 -- 172.21.15.26:0/1316875110 wait complete. 2021-11-03T18:05:38.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.976+0000 7f8f94dc4700 1 Processor -- start 2021-11-03T18:05:38.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.976+0000 7f8f94dc4700 1 -- start start 2021-11-03T18:05:38.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.976+0000 7f8f94dc4700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f900f55c0 0x7f8f90105ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:05:38.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.976+0000 7f8f94dc4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f900f6860 0x7f8f901063c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:05:38.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.976+0000 7f8f94dc4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f90106970 con 0x7f8f900f6860 2021-11-03T18:05:38.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.976+0000 7f8f94dc4700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f90107170 con 0x7f8f900f55c0 2021-11-03T18:05:38.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.976+0000 7f8f8dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f900f6860 0x7f8f901063c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:05:38.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.976+0000 7f8f8dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f900f6860 0x7f8f901063c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58104/0 (socket says 172.21.15.26:58104) 2021-11-03T18:05:38.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.976+0000 7f8f8dd9b700 1 -- 172.21.15.26:0/2729364065 learned_addr learned my addr 172.21.15.26:0/2729364065 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:05:38.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.976+0000 7f8f8e59c700 1 --2- 172.21.15.26:0/2729364065 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f900f55c0 0x7f8f90105ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:05:38.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.976+0000 7f8f8dd9b700 1 -- 172.21.15.26:0/2729364065 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f900f55c0 msgr2=0x7f8f90105ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:05:38.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.976+0000 7f8f8dd9b700 1 --2- 172.21.15.26:0/2729364065 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f900f55c0 0x7f8f90105ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:38.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.976+0000 7f8f8dd9b700 1 -- 172.21.15.26:0/2729364065 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f80005040 con 0x7f8f900f6860 2021-11-03T18:05:38.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.977+0000 7f8f8dd9b700 1 --2- 172.21.15.26:0/2729364065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f900f6860 0x7f8f901063c0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7f8f80009990 tx=0x7f8f80009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:05:38.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.977+0000 7f8f86ffd700 1 -- 172.21.15.26:0/2729364065 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f80018070 con 0x7f8f900f6860 2021-11-03T18:05:38.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.977+0000 7f8f94dc4700 1 -- 172.21.15.26:0/2729364065 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f901073f0 con 0x7f8f900f6860 2021-11-03T18:05:38.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.977+0000 7f8f86ffd700 1 -- 172.21.15.26:0/2729364065 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8f80007ca0 con 0x7f8f900f6860 2021-11-03T18:05:38.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.977+0000 7f8f86ffd700 1 -- 172.21.15.26:0/2729364065 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f8001c620 con 0x7f8f900f6860 2021-11-03T18:05:38.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.977+0000 7f8f94dc4700 1 -- 172.21.15.26:0/2729364065 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f90107950 con 0x7f8f900f6860 2021-11-03T18:05:38.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.978+0000 7f8f94dc4700 1 -- 172.21.15.26:0/2729364065 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f900f49b0 con 0x7f8f900f6860 2021-11-03T18:05:38.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.978+0000 7f8f86ffd700 1 -- 172.21.15.26:0/2729364065 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f8f8001d960 con 0x7f8f900f6860 2021-11-03T18:05:38.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.978+0000 7f8f86ffd700 1 --2- 172.21.15.26:0/2729364065 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8f7c0640b0 0x7f8f7c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:05:38.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.979+0000 7f8f86ffd700 1 -- 172.21.15.26:0/2729364065 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f8f80082520 con 0x7f8f900f6860 2021-11-03T18:05:38.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.979+0000 7f8f8e59c700 1 --2- 172.21.15.26:0/2729364065 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8f7c0640b0 0x7f8f7c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:05:38.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.979+0000 7f8f8e59c700 1 --2- 172.21.15.26:0/2729364065 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8f7c0640b0 0x7f8f7c066570 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f8f900f66c0 tx=0x7f8f78009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:05:38.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:38.983+0000 7f8f86ffd700 1 -- 172.21.15.26:0/2729364065 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f8f80054940 con 0x7f8f900f6860 2021-11-03T18:05:38.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:38 smithi194 ceph-mon[65619]: pgmap v2129: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:39.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:38 smithi026 ceph-mon[96795]: pgmap v2129: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:39.184 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:39.187+0000 7f8f94dc4700 1 -- 172.21.15.26:0/2729364065 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8f900fdd80 con 0x7f8f900f6860 2021-11-03T18:05:39.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:39.188+0000 7f8f86ffd700 1 -- 172.21.15.26:0/2729364065 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f8f80054530 con 0x7f8f900f6860 2021-11-03T18:05:39.185 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:05:39.186 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:05:39.186 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:05:39.186 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:05:39.186 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:05:39.187 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:05:39.187 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:05:39.187 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:05:39.187 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:05:39.188 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:05:39.188 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:05:39.188 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:05:39.188 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:05:39.189 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:05:39.189 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:05:39.189 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:05:39.189 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:05:39.190 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:05:39.190 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:05:39.190 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:05:39.190 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:05:39.191 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:05:39.191 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:05:39.191 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:05:39.191 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:05:39.191 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:05:39.192 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:05:39.192 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:05:39.192 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:05:39.192 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:05:39.193 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:05:39.193 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:05:39.193 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:05:39.193 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:05:39.194 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:05:39.194 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:05:39.194 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:05:39.194 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:05:39.195 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:05:39.195 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:39.189+0000 7f8f94dc4700 1 -- 172.21.15.26:0/2729364065 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8f7c0640b0 msgr2=0x7f8f7c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:05:39.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:39.189+0000 7f8f94dc4700 1 --2- 172.21.15.26:0/2729364065 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8f7c0640b0 0x7f8f7c066570 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f8f900f66c0 tx=0x7f8f78009040).stop 2021-11-03T18:05:39.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:39.189+0000 7f8f94dc4700 1 -- 172.21.15.26:0/2729364065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f900f6860 msgr2=0x7f8f901063c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:05:39.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:39.189+0000 7f8f94dc4700 1 --2- 172.21.15.26:0/2729364065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f900f6860 0x7f8f901063c0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7f8f80009990 tx=0x7f8f80009b30).stop 2021-11-03T18:05:39.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:39.189+0000 7f8f94dc4700 1 -- 172.21.15.26:0/2729364065 shutdown_connections 2021-11-03T18:05:39.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:39.189+0000 7f8f94dc4700 1 --2- 172.21.15.26:0/2729364065 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8f7c0640b0 0x7f8f7c066570 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:39.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:39.189+0000 7f8f94dc4700 1 --2- 172.21.15.26:0/2729364065 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f900f55c0 0x7f8f90105ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:39.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:39.189+0000 7f8f94dc4700 1 --2- 172.21.15.26:0/2729364065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f900f6860 0x7f8f901063c0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:05:39.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:39.189+0000 7f8f94dc4700 1 -- 172.21.15.26:0/2729364065 >> 172.21.15.26:0/2729364065 conn(0x7f8f900f0d20 msgr2=0x7f8f900fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:05:39.198 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:39.190+0000 7f8f94dc4700 1 -- 172.21.15.26:0/2729364065 shutdown_connections 2021-11-03T18:05:39.198 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:05:39.190+0000 7f8f94dc4700 1 -- 172.21.15.26:0/2729364065 wait complete. 2021-11-03T18:05:39.198 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:05:39.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:39 smithi194 ceph-mon[65619]: from='client.36332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:05:40.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:39 smithi194 ceph-mon[65619]: from='client.36336 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:05:40.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:39 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/190545754' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:05:40.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:39 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2729364065' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:05:40.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:39 smithi026 ceph-mon[96795]: from='client.36332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:05:40.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:39 smithi026 ceph-mon[96795]: from='client.36336 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:05:40.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:39 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/190545754' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:05:40.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:39 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2729364065' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:05:40.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:40 smithi194 ceph-mon[65619]: pgmap v2130: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:41.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:05:41.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:40 smithi026 ceph-mon[96795]: pgmap v2130: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:41.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:05:41.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:41 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:05:42.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:41 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:05:42.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:42 smithi194 ceph-mon[65619]: pgmap v2131: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:43.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:42 smithi026 ceph-mon[96795]: pgmap v2131: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:44.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:44 smithi194 ceph-mon[65619]: pgmap v2132: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:45.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:44 smithi026 ceph-mon[96795]: pgmap v2132: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:46.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:46 smithi194 ceph-mon[65619]: pgmap v2133: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:47.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:46 smithi026 ceph-mon[96795]: pgmap v2133: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:48.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:48 smithi194 ceph-mon[65619]: pgmap v2134: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:49.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:05:49.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:05:49.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:48 smithi026 ceph-mon[96795]: pgmap v2134: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:49.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:05:49.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:05:50.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:50 smithi194 ceph-mon[65619]: pgmap v2135: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:51.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:50 smithi026 ceph-mon[96795]: pgmap v2135: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:52.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:52 smithi194 ceph-mon[65619]: pgmap v2136: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:53.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:52 smithi026 ceph-mon[96795]: pgmap v2136: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:54.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:54 smithi194 ceph-mon[65619]: pgmap v2137: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:55.096 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:54 smithi026 ceph-mon[96795]: pgmap v2137: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:55.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:05:56.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:05:56.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:05:56.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:05:56.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:05:56.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:05:56.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:05:56.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:05:56.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:05:56.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:05:56.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:05:56.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:05:56.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:05:56.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:05:56.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:05:56.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:05:56.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:56 smithi194 ceph-mon[65619]: poll took 60070.281 ms: 1 events 2021-11-03T18:05:57.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:56 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:05:57.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:56 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:05:57.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:56 smithi194 ceph-mon[65619]: pgmap v2138: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:57.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:56 smithi026 ceph-mon[96795]: poll took 60070.281 ms: 1 events 2021-11-03T18:05:57.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:56 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:05:57.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:56 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:05:57.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:56 smithi026 ceph-mon[96795]: pgmap v2138: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:58.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:05:58 smithi194 ceph-mon[65619]: pgmap v2139: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:05:59.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:05:58 smithi026 ceph-mon[96795]: pgmap v2139: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:00.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:00 smithi194 ceph-mon[65619]: pgmap v2140: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:01.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:00 smithi026 ceph-mon[96795]: pgmap v2140: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:02.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:02 smithi194 ceph-mon[65619]: pgmap v2141: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:03.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:02 smithi026 ceph-mon[96795]: pgmap v2141: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:04.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:04 smithi194 ceph-mon[65619]: pgmap v2142: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:05.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:04 smithi026 ceph-mon[96795]: pgmap v2142: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:06.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:06 smithi194 ceph-mon[65619]: pgmap v2143: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:07.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:06 smithi026 ceph-mon[96795]: pgmap v2143: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:08.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:08 smithi194 ceph-mon[65619]: pgmap v2144: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:09.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:08 smithi026 ceph-mon[96795]: pgmap v2144: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:09.303 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.304+0000 7f7fecfa1700 1 -- 172.21.15.26:0/2972730477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fe80f5440 msgr2=0x7f7fe80f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:06:09.303 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.304+0000 7f7fecfa1700 1 --2- 172.21.15.26:0/2972730477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fe80f5440 0x7f7fe80f5860 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7f7fd8004660 tx=0x7f7fd8009b30).stop 2021-11-03T18:06:09.303 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.304+0000 7f7fecfa1700 1 -- 172.21.15.26:0/2972730477 shutdown_connections 2021-11-03T18:06:09.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.304+0000 7f7fecfa1700 1 --2- 172.21.15.26:0/2972730477 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fe80f66e0 0x7f7fe80f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:09.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.304+0000 7f7fecfa1700 1 --2- 172.21.15.26:0/2972730477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fe80f5440 0x7f7fe80f5860 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:09.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.304+0000 7f7fecfa1700 1 -- 172.21.15.26:0/2972730477 >> 172.21.15.26:0/2972730477 conn(0x7f7fe80f0ba0 msgr2=0x7f7fe80f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:06:09.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.304+0000 7f7fecfa1700 1 -- 172.21.15.26:0/2972730477 shutdown_connections 2021-11-03T18:06:09.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.304+0000 7f7fecfa1700 1 -- 172.21.15.26:0/2972730477 wait complete. 2021-11-03T18:06:09.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.305+0000 7f7fecfa1700 1 Processor -- start 2021-11-03T18:06:09.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.305+0000 7f7fecfa1700 1 -- start start 2021-11-03T18:06:09.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.305+0000 7f7fecfa1700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fe80f5440 0x7f7fe8106e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:06:09.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.305+0000 7f7fecfa1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fe80f66e0 0x7f7fe8107300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:06:09.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.305+0000 7f7fecfa1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe8107900 con 0x7f7fe80f66e0 2021-11-03T18:06:09.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.305+0000 7f7fecfa1700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe8108110 con 0x7f7fe80f5440 2021-11-03T18:06:09.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.305+0000 7f7fe6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fe80f66e0 0x7f7fe8107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:06:09.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.305+0000 7f7fe6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fe80f66e0 0x7f7fe8107300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58122/0 (socket says 172.21.15.26:58122) 2021-11-03T18:06:09.307 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.305+0000 7f7fe6ffd700 1 -- 172.21.15.26:0/4170006175 learned_addr learned my addr 172.21.15.26:0/4170006175 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:06:09.307 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.305+0000 7f7fe77fe700 1 --2- 172.21.15.26:0/4170006175 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fe80f5440 0x7f7fe8106e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:06:09.307 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.306+0000 7f7fe6ffd700 1 -- 172.21.15.26:0/4170006175 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fe80f5440 msgr2=0x7f7fe8106e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:06:09.307 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.306+0000 7f7fe6ffd700 1 --2- 172.21.15.26:0/4170006175 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fe80f5440 0x7f7fe8106e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:09.308 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.306+0000 7f7fe6ffd700 1 -- 172.21.15.26:0/4170006175 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd8005040 con 0x7f7fe80f66e0 2021-11-03T18:06:09.308 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.306+0000 7f7fe77fe700 1 --2- 172.21.15.26:0/4170006175 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fe80f5440 0x7f7fe8106e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:06:09.308 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.306+0000 7f7fe6ffd700 1 --2- 172.21.15.26:0/4170006175 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fe80f66e0 0x7f7fe8107300 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 rx=0x7f7fdc0026d0 tx=0x7f7fdc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:06:09.308 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.306+0000 7f7fcffff700 1 -- 172.21.15.26:0/4170006175 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fdc009320 con 0x7f7fe80f66e0 2021-11-03T18:06:09.308 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.306+0000 7f7fecfa1700 1 -- 172.21.15.26:0/4170006175 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe8108390 con 0x7f7fe80f66e0 2021-11-03T18:06:09.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.306+0000 7f7fecfa1700 1 -- 172.21.15.26:0/4170006175 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe8108950 con 0x7f7fe80f66e0 2021-11-03T18:06:09.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.306+0000 7f7fcffff700 1 -- 172.21.15.26:0/4170006175 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7fdc00f040 con 0x7f7fe80f66e0 2021-11-03T18:06:09.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.306+0000 7f7fcffff700 1 -- 172.21.15.26:0/4170006175 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fdc0147e0 con 0x7f7fe80f66e0 2021-11-03T18:06:09.310 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.307+0000 7f7fecfa1700 1 -- 172.21.15.26:0/4170006175 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fc8004fa0 con 0x7f7fe80f66e0 2021-11-03T18:06:09.311 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.307+0000 7f7fcffff700 1 -- 172.21.15.26:0/4170006175 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f7fdc009480 con 0x7f7fe80f66e0 2021-11-03T18:06:09.311 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.308+0000 7f7fcffff700 1 --2- 172.21.15.26:0/4170006175 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7fd0064100 0x7f7fd00665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:06:09.311 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.308+0000 7f7fcffff700 1 -- 172.21.15.26:0/4170006175 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f7fdc080db0 con 0x7f7fe80f66e0 2021-11-03T18:06:09.311 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.308+0000 7f7fe77fe700 1 --2- 172.21.15.26:0/4170006175 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7fd0064100 0x7f7fd00665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:06:09.311 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.308+0000 7f7fe77fe700 1 --2- 172.21.15.26:0/4170006175 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7fd0064100 0x7f7fd00665c0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f7fd8004e30 tx=0x7f7fd8009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:06:09.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.312+0000 7f7fcffff700 1 -- 172.21.15.26:0/4170006175 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f7fdc0531d0 con 0x7f7fe80f66e0 2021-11-03T18:06:09.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.490+0000 7f7fecfa1700 1 -- 172.21.15.26:0/4170006175 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7fc8000bc0 con 0x7f7fd0064100 2021-11-03T18:06:09.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.491+0000 7f7fcffff700 1 -- 172.21.15.26:0/4170006175 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f7fc8000bc0 con 0x7f7fd0064100 2021-11-03T18:06:09.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.493+0000 7f7fecfa1700 1 -- 172.21.15.26:0/4170006175 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7fd0064100 msgr2=0x7f7fd00665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:06:09.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.493+0000 7f7fecfa1700 1 --2- 172.21.15.26:0/4170006175 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7fd0064100 0x7f7fd00665c0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f7fd8004e30 tx=0x7f7fd8009b30).stop 2021-11-03T18:06:09.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.493+0000 7f7fecfa1700 1 -- 172.21.15.26:0/4170006175 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fe80f66e0 msgr2=0x7f7fe8107300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:06:09.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.493+0000 7f7fecfa1700 1 --2- 172.21.15.26:0/4170006175 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fe80f66e0 0x7f7fe8107300 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 rx=0x7f7fdc0026d0 tx=0x7f7fdc009de0).stop 2021-11-03T18:06:09.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.493+0000 7f7fecfa1700 1 -- 172.21.15.26:0/4170006175 shutdown_connections 2021-11-03T18:06:09.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.493+0000 7f7fecfa1700 1 --2- 172.21.15.26:0/4170006175 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7fd0064100 0x7f7fd00665c0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:09.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.493+0000 7f7fecfa1700 1 --2- 172.21.15.26:0/4170006175 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fe80f5440 0x7f7fe8106e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:09.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.493+0000 7f7fecfa1700 1 --2- 172.21.15.26:0/4170006175 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fe80f66e0 0x7f7fe8107300 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:09.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.493+0000 7f7fecfa1700 1 -- 172.21.15.26:0/4170006175 >> 172.21.15.26:0/4170006175 conn(0x7f7fe80f0ba0 msgr2=0x7f7fe805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:06:09.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.493+0000 7f7fecfa1700 1 -- 172.21.15.26:0/4170006175 shutdown_connections 2021-11-03T18:06:09.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.493+0000 7f7fecfa1700 1 -- 172.21.15.26:0/4170006175 wait complete. 2021-11-03T18:06:09.500 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:06:09.590 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.593+0000 7faad1381700 1 -- 172.21.15.26:0/3809597072 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faacc0f66c0 msgr2=0x7faacc0f6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:06:09.590 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.593+0000 7faad1381700 1 --2- 172.21.15.26:0/3809597072 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faacc0f66c0 0x7faacc0f6ae0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7faabc004660 tx=0x7faabc009b30).stop 2021-11-03T18:06:09.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.593+0000 7faad1381700 1 -- 172.21.15.26:0/3809597072 shutdown_connections 2021-11-03T18:06:09.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.593+0000 7faad1381700 1 --2- 172.21.15.26:0/3809597072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faacc0f7960 0x7faacc0f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:09.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.593+0000 7faad1381700 1 --2- 172.21.15.26:0/3809597072 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faacc0f66c0 0x7faacc0f6ae0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:09.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.593+0000 7faad1381700 1 -- 172.21.15.26:0/3809597072 >> 172.21.15.26:0/3809597072 conn(0x7faacc0f1e20 msgr2=0x7faacc0f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:06:09.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.593+0000 7faad1381700 1 -- 172.21.15.26:0/3809597072 shutdown_connections 2021-11-03T18:06:09.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.593+0000 7faad1381700 1 -- 172.21.15.26:0/3809597072 wait complete. 2021-11-03T18:06:09.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.594+0000 7faad1381700 1 Processor -- start 2021-11-03T18:06:09.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.594+0000 7faad1381700 1 -- start start 2021-11-03T18:06:09.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.594+0000 7faad1381700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faacc0f66c0 0x7faacc106f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:06:09.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.594+0000 7faad1381700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faacc0f7960 0x7faacc107480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:06:09.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.594+0000 7faad1381700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faacc107a30 con 0x7faacc0f7960 2021-11-03T18:06:09.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.594+0000 7faad1381700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faacc107b70 con 0x7faacc0f66c0 2021-11-03T18:06:09.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.594+0000 7faaca7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faacc0f7960 0x7faacc107480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:06:09.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.594+0000 7faaca7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faacc0f7960 0x7faacc107480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58132/0 (socket says 172.21.15.26:58132) 2021-11-03T18:06:09.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.594+0000 7faaca7fc700 1 -- 172.21.15.26:0/3672533457 learned_addr learned my addr 172.21.15.26:0/3672533457 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:06:09.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.594+0000 7faacaffd700 1 --2- 172.21.15.26:0/3672533457 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faacc0f66c0 0x7faacc106f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:06:09.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.594+0000 7faaca7fc700 1 -- 172.21.15.26:0/3672533457 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faacc0f66c0 msgr2=0x7faacc106f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:06:09.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.594+0000 7faaca7fc700 1 --2- 172.21.15.26:0/3672533457 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faacc0f66c0 0x7faacc106f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:09.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.594+0000 7faaca7fc700 1 -- 172.21.15.26:0/3672533457 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faabc005040 con 0x7faacc0f7960 2021-11-03T18:06:09.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.594+0000 7faaca7fc700 1 --2- 172.21.15.26:0/3672533457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faacc0f7960 0x7faacc107480 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7faac00026d0 tx=0x7faac0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:06:09.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.594+0000 7faab37fe700 1 -- 172.21.15.26:0/3672533457 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faac00079c0 con 0x7faacc0f7960 2021-11-03T18:06:09.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.595+0000 7faab37fe700 1 -- 172.21.15.26:0/3672533457 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7faac000f040 con 0x7faacc0f7960 2021-11-03T18:06:09.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.595+0000 7faad1381700 1 -- 172.21.15.26:0/3672533457 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faacc108510 con 0x7faacc0f7960 2021-11-03T18:06:09.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.595+0000 7faab37fe700 1 -- 172.21.15.26:0/3672533457 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faac00148b0 con 0x7faacc0f7960 2021-11-03T18:06:09.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.595+0000 7faad1381700 1 -- 172.21.15.26:0/3672533457 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faacc108ad0 con 0x7faacc0f7960 2021-11-03T18:06:09.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.596+0000 7faad1381700 1 -- 172.21.15.26:0/3672533457 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faacc045ad0 con 0x7faacc0f7960 2021-11-03T18:06:09.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.596+0000 7faab37fe700 1 -- 172.21.15.26:0/3672533457 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7faac0007b20 con 0x7faacc0f7960 2021-11-03T18:06:09.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.597+0000 7faab37fe700 1 --2- 172.21.15.26:0/3672533457 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faab40640b0 0x7faab4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:06:09.600 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.597+0000 7faab37fe700 1 -- 172.21.15.26:0/3672533457 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7faac0080660 con 0x7faacc0f7960 2021-11-03T18:06:09.600 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.597+0000 7faacaffd700 1 --2- 172.21.15.26:0/3672533457 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faab40640b0 0x7faab4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:06:09.600 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.597+0000 7faacaffd700 1 --2- 172.21.15.26:0/3672533457 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faab40640b0 0x7faab4066570 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7faabc004630 tx=0x7faabc009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:06:09.601 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.601+0000 7faab37fe700 1 -- 172.21.15.26:0/3672533457 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7faac00529c0 con 0x7faacc0f7960 2021-11-03T18:06:09.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.775+0000 7faad1381700 1 -- 172.21.15.26:0/3672533457 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7faacc108da0 con 0x7faab40640b0 2021-11-03T18:06:09.786 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.790+0000 7faab37fe700 1 -- 172.21.15.26:0/3672533457 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7faacc108da0 con 0x7faab40640b0 2021-11-03T18:06:09.787 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:06:09.787 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (77m) 6m ago 78m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:06:09.787 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (69m) 6m ago 78m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:06:09.788 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (69m) 5m ago 77m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:06:09.788 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (77m) 6m ago 78m 41.7M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:06:09.788 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (70m) 6m ago 73m 25.6M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:06:09.788 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (70m) 6m ago 73m 26.2M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:06:09.789 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (73m) 5m ago 73m 26.4M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:06:09.789 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (73m) 5m ago 73m 26.8M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:06:09.789 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (71m) 6m ago 79m 561M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:06:09.789 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (70m) 5m ago 77m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:06:09.789 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (70m) 6m ago 80m 276M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:06:09.790 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (70m) 5m ago 77m 132M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:06:09.790 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (78m) 6m ago 78m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:06:09.790 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (77m) 5m ago 77m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:06:09.790 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (69m) 6m ago 77m 292M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:06:09.791 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (68m) 6m ago 76m 313M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:06:09.791 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (68m) 6m ago 76m 261M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:06:09.791 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (67m) 5m ago 75m 337M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:06:09.791 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (67m) 5m ago 75m 283M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:06:09.791 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (66m) 5m ago 75m 276M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:06:09.792 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (77m) 6m ago 78m 61.2M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:06:09.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.792+0000 7faad1381700 1 -- 172.21.15.26:0/3672533457 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faab40640b0 msgr2=0x7faab4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:06:09.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.792+0000 7faad1381700 1 --2- 172.21.15.26:0/3672533457 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faab40640b0 0x7faab4066570 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7faabc004630 tx=0x7faabc009b30).stop 2021-11-03T18:06:09.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.792+0000 7faad1381700 1 -- 172.21.15.26:0/3672533457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faacc0f7960 msgr2=0x7faacc107480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:06:09.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.792+0000 7faad1381700 1 --2- 172.21.15.26:0/3672533457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faacc0f7960 0x7faacc107480 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7faac00026d0 tx=0x7faac0009de0).stop 2021-11-03T18:06:09.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.792+0000 7faad1381700 1 -- 172.21.15.26:0/3672533457 shutdown_connections 2021-11-03T18:06:09.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.792+0000 7faad1381700 1 --2- 172.21.15.26:0/3672533457 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faab40640b0 0x7faab4066570 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:09.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.792+0000 7faad1381700 1 --2- 172.21.15.26:0/3672533457 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faacc0f66c0 0x7faacc106f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:09.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.792+0000 7faad1381700 1 --2- 172.21.15.26:0/3672533457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faacc0f7960 0x7faacc107480 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:09.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.792+0000 7faad1381700 1 -- 172.21.15.26:0/3672533457 >> 172.21.15.26:0/3672533457 conn(0x7faacc0f1e20 msgr2=0x7faacc0fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:06:09.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.792+0000 7faad1381700 1 -- 172.21.15.26:0/3672533457 shutdown_connections 2021-11-03T18:06:09.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.792+0000 7faad1381700 1 -- 172.21.15.26:0/3672533457 wait complete. 2021-11-03T18:06:09.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.891+0000 7fa04a532700 1 -- 172.21.15.26:0/3952261308 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0440f6ff0 msgr2=0x7fa0440f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:06:09.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.891+0000 7fa04a532700 1 --2- 172.21.15.26:0/3952261308 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0440f6ff0 0x7fa0440f7a20 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7fa034004660 tx=0x7fa034009b30).stop 2021-11-03T18:06:09.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.891+0000 7fa04a532700 1 -- 172.21.15.26:0/3952261308 shutdown_connections 2021-11-03T18:06:09.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.891+0000 7fa04a532700 1 --2- 172.21.15.26:0/3952261308 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0440f6ff0 0x7fa0440f7a20 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:09.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.891+0000 7fa04a532700 1 --2- 172.21.15.26:0/3952261308 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0440f66e0 0x7fa0440f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:09.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.891+0000 7fa04a532700 1 -- 172.21.15.26:0/3952261308 >> 172.21.15.26:0/3952261308 conn(0x7fa0440f1f00 msgr2=0x7fa0440f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:06:09.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.891+0000 7fa04a532700 1 -- 172.21.15.26:0/3952261308 shutdown_connections 2021-11-03T18:06:09.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.891+0000 7fa04a532700 1 -- 172.21.15.26:0/3952261308 wait complete. 2021-11-03T18:06:09.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.892+0000 7fa04a532700 1 Processor -- start 2021-11-03T18:06:09.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.892+0000 7fa04a532700 1 -- start start 2021-11-03T18:06:09.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.892+0000 7fa04a532700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0440f66e0 0x7fa04406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:06:09.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.892+0000 7fa04a532700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0440f6ff0 0x7fa044069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:06:09.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.892+0000 7fa04a532700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04406a380 con 0x7fa0440f66e0 2021-11-03T18:06:09.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.892+0000 7fa04a532700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04406a4c0 con 0x7fa0440f6ff0 2021-11-03T18:06:09.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.892+0000 7fa043fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0440f66e0 0x7fa04406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:06:09.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.892+0000 7fa043fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0440f66e0 0x7fa04406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58140/0 (socket says 172.21.15.26:58140) 2021-11-03T18:06:09.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.892+0000 7fa043fff700 1 -- 172.21.15.26:0/3690761849 learned_addr learned my addr 172.21.15.26:0/3690761849 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:06:09.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.893+0000 7fa0437fe700 1 --2- 172.21.15.26:0/3690761849 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0440f6ff0 0x7fa044069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:06:09.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.893+0000 7fa043fff700 1 -- 172.21.15.26:0/3690761849 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0440f6ff0 msgr2=0x7fa044069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:06:09.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.893+0000 7fa043fff700 1 --2- 172.21.15.26:0/3690761849 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0440f6ff0 0x7fa044069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:09.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.893+0000 7fa043fff700 1 -- 172.21.15.26:0/3690761849 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa034005040 con 0x7fa0440f66e0 2021-11-03T18:06:09.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.893+0000 7fa043fff700 1 --2- 172.21.15.26:0/3690761849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0440f66e0 0x7fa04406b9a0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 rx=0x7fa03800c790 tx=0x7fa038007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:06:09.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.893+0000 7fa040ff9700 1 -- 172.21.15.26:0/3690761849 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa03800e680 con 0x7fa0440f66e0 2021-11-03T18:06:09.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.893+0000 7fa040ff9700 1 -- 172.21.15.26:0/3690761849 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa03800ec90 con 0x7fa0440f66e0 2021-11-03T18:06:09.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.893+0000 7fa04a532700 1 -- 172.21.15.26:0/3690761849 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa04406a7a0 con 0x7fa0440f66e0 2021-11-03T18:06:09.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.893+0000 7fa040ff9700 1 -- 172.21.15.26:0/3690761849 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa038013d60 con 0x7fa0440f66e0 2021-11-03T18:06:09.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.893+0000 7fa04a532700 1 -- 172.21.15.26:0/3690761849 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa04410efa0 con 0x7fa0440f66e0 2021-11-03T18:06:09.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.894+0000 7fa04a532700 1 -- 172.21.15.26:0/3690761849 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa044045ad0 con 0x7fa0440f66e0 2021-11-03T18:06:09.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.894+0000 7fa040ff9700 1 -- 172.21.15.26:0/3690761849 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fa03801a060 con 0x7fa0440f66e0 2021-11-03T18:06:09.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.895+0000 7fa040ff9700 1 --2- 172.21.15.26:0/3690761849 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa02c0640b0 0x7fa02c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:06:09.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.895+0000 7fa040ff9700 1 -- 172.21.15.26:0/3690761849 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fa038080b00 con 0x7fa0440f66e0 2021-11-03T18:06:09.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.895+0000 7fa0437fe700 1 --2- 172.21.15.26:0/3690761849 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa02c0640b0 0x7fa02c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:06:09.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.895+0000 7fa0437fe700 1 --2- 172.21.15.26:0/3690761849 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa02c0640b0 0x7fa02c066570 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fa034004e30 tx=0x7fa034009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:06:09.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:09.899+0000 7fa040ff9700 1 -- 172.21.15.26:0/3690761849 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fa038052d70 con 0x7fa0440f66e0 2021-11-03T18:06:10.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.129+0000 7fa04a532700 1 -- 172.21.15.26:0/3690761849 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa0440feed0 con 0x7fa0440f66e0 2021-11-03T18:06:10.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.129+0000 7fa040ff9700 1 -- 172.21.15.26:0/3690761849 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fa038018070 con 0x7fa0440f66e0 2021-11-03T18:06:10.127 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:06:10.128 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:06:10.128 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:06:10.128 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:06:10.128 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:06:10.129 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:06:10.129 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:06:10.129 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:06:10.129 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:06:10.130 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:06:10.130 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:06:10.130 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:06:10.130 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:06:10.130 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:06:10.131 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:06:10.131 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:06:10.131 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:06:10.131 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:06:10.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.131+0000 7fa04a532700 1 -- 172.21.15.26:0/3690761849 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa02c0640b0 msgr2=0x7fa02c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:06:10.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.131+0000 7fa04a532700 1 --2- 172.21.15.26:0/3690761849 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa02c0640b0 0x7fa02c066570 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fa034004e30 tx=0x7fa034009b30).stop 2021-11-03T18:06:10.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.131+0000 7fa04a532700 1 -- 172.21.15.26:0/3690761849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0440f66e0 msgr2=0x7fa04406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:06:10.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.131+0000 7fa04a532700 1 --2- 172.21.15.26:0/3690761849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0440f66e0 0x7fa04406b9a0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 rx=0x7fa03800c790 tx=0x7fa038007d70).stop 2021-11-03T18:06:10.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.131+0000 7fa04a532700 1 -- 172.21.15.26:0/3690761849 shutdown_connections 2021-11-03T18:06:10.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.131+0000 7fa04a532700 1 --2- 172.21.15.26:0/3690761849 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa02c0640b0 0x7fa02c066570 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:10.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.131+0000 7fa04a532700 1 --2- 172.21.15.26:0/3690761849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0440f66e0 0x7fa04406b9a0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:10.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.131+0000 7fa04a532700 1 --2- 172.21.15.26:0/3690761849 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0440f6ff0 0x7fa044069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:10.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.131+0000 7fa04a532700 1 -- 172.21.15.26:0/3690761849 >> 172.21.15.26:0/3690761849 conn(0x7fa0440f1f00 msgr2=0x7fa0440fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:06:10.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.131+0000 7fa04a532700 1 -- 172.21.15.26:0/3690761849 shutdown_connections 2021-11-03T18:06:10.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.132+0000 7fa04a532700 1 -- 172.21.15.26:0/3690761849 wait complete. 2021-11-03T18:06:10.233 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.235+0000 7f9495fa2700 1 -- 172.21.15.26:0/1163759563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94900f66e0 msgr2=0x7f94900f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:06:10.233 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.235+0000 7f9495fa2700 1 --2- 172.21.15.26:0/1163759563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94900f66e0 0x7f94900f6b40 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7f947c004660 tx=0x7f947c009b30).stop 2021-11-03T18:06:10.233 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.235+0000 7f9495fa2700 1 -- 172.21.15.26:0/1163759563 shutdown_connections 2021-11-03T18:06:10.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.235+0000 7f9495fa2700 1 --2- 172.21.15.26:0/1163759563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94900f66e0 0x7f94900f6b40 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:10.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.235+0000 7f9495fa2700 1 --2- 172.21.15.26:0/1163759563 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94900f5440 0x7f94900f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:10.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.235+0000 7f9495fa2700 1 -- 172.21.15.26:0/1163759563 >> 172.21.15.26:0/1163759563 conn(0x7f94900f0ba0 msgr2=0x7f94900f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:06:10.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.235+0000 7f9495fa2700 1 -- 172.21.15.26:0/1163759563 shutdown_connections 2021-11-03T18:06:10.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.235+0000 7f9495fa2700 1 -- 172.21.15.26:0/1163759563 wait complete. 2021-11-03T18:06:10.235 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.236+0000 7f9495fa2700 1 Processor -- start 2021-11-03T18:06:10.235 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.236+0000 7f9495fa2700 1 -- start start 2021-11-03T18:06:10.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.236+0000 7f9495fa2700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94900f5440 0x7f9490109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:06:10.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.236+0000 7f9495fa2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94900f66e0 0x7f949010bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:06:10.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.236+0000 7f9495fa2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94900603e0 con 0x7f94900f66e0 2021-11-03T18:06:10.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.236+0000 7f9495fa2700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9490060520 con 0x7f94900f5440 2021-11-03T18:06:10.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.236+0000 7f948ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94900f66e0 0x7f949010bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:06:10.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.237+0000 7f948ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94900f66e0 0x7f949010bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58152/0 (socket says 172.21.15.26:58152) 2021-11-03T18:06:10.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.237+0000 7f948ffff700 1 -- 172.21.15.26:0/1627187384 learned_addr learned my addr 172.21.15.26:0/1627187384 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:06:10.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.237+0000 7f9494fa0700 1 --2- 172.21.15.26:0/1627187384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94900f5440 0x7f9490109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:06:10.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.237+0000 7f948ffff700 1 -- 172.21.15.26:0/1627187384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94900f5440 msgr2=0x7f9490109a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:06:10.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.237+0000 7f948ffff700 1 --2- 172.21.15.26:0/1627187384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94900f5440 0x7f9490109a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:10.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.237+0000 7f948ffff700 1 -- 172.21.15.26:0/1627187384 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947c005040 con 0x7f94900f66e0 2021-11-03T18:06:10.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.237+0000 7f948ffff700 1 --2- 172.21.15.26:0/1627187384 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94900f66e0 0x7f949010bf90 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 rx=0x7f947c009990 tx=0x7f947c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:06:10.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.237+0000 7f948d7fa700 1 -- 172.21.15.26:0/1627187384 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f947c018070 con 0x7f94900f66e0 2021-11-03T18:06:10.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.237+0000 7f948d7fa700 1 -- 172.21.15.26:0/1627187384 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f947c007ba0 con 0x7f94900f66e0 2021-11-03T18:06:10.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.237+0000 7f948d7fa700 1 -- 172.21.15.26:0/1627187384 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f947c01c3c0 con 0x7f94900f66e0 2021-11-03T18:06:10.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.237+0000 7f9495fa2700 1 -- 172.21.15.26:0/1627187384 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f949010c4e0 con 0x7f94900f66e0 2021-11-03T18:06:10.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.237+0000 7f9495fa2700 1 -- 172.21.15.26:0/1627187384 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f949010ca40 con 0x7f94900f66e0 2021-11-03T18:06:10.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.238+0000 7f9495fa2700 1 -- 172.21.15.26:0/1627187384 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9490045ad0 con 0x7f94900f66e0 2021-11-03T18:06:10.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.239+0000 7f948d7fa700 1 -- 172.21.15.26:0/1627187384 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f947c01d420 con 0x7f94900f66e0 2021-11-03T18:06:10.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.239+0000 7f948d7fa700 1 --2- 172.21.15.26:0/1627187384 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9480064100 0x7f94800665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:06:10.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.239+0000 7f948d7fa700 1 -- 172.21.15.26:0/1627187384 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f947c082430 con 0x7f94900f66e0 2021-11-03T18:06:10.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.239+0000 7f9494fa0700 1 --2- 172.21.15.26:0/1627187384 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9480064100 0x7f94800665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:06:10.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.239+0000 7f9494fa0700 1 --2- 172.21.15.26:0/1627187384 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9480064100 0x7f94800665c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f9490060060 tx=0x7f9484009c00).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:06:10.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.243+0000 7f948d7fa700 1 -- 172.21.15.26:0/1627187384 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f947c0547f0 con 0x7f94900f66e0 2021-11-03T18:06:10.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.448+0000 7f9495fa2700 1 -- 172.21.15.26:0/1627187384 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f94900fdcd0 con 0x7f94900f66e0 2021-11-03T18:06:10.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.448+0000 7f948d7fa700 1 -- 172.21.15.26:0/1627187384 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f947c0543e0 con 0x7f94900f66e0 2021-11-03T18:06:10.447 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:06:10.448 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:06:10.448 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:06:10.448 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:06:10.449 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:06:10.449 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:06:10.449 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:06:10.449 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:06:10.449 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:06:10.450 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:06:10.450 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:06:10.450 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:06:10.450 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:06:10.451 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:06:10.451 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:06:10.451 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:06:10.452 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:06:10.452 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:06:10.452 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:06:10.452 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:06:10.453 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:06:10.453 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:06:10.453 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:06:10.454 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:06:10.454 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:06:10.454 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:06:10.454 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:06:10.455 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:06:10.455 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:06:10.455 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:06:10.455 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:06:10.456 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:06:10.456 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:06:10.457 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:06:10.457 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:06:10.457 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:06:10.457 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:06:10.457 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:06:10.458 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:06:10.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.450+0000 7f9495fa2700 1 -- 172.21.15.26:0/1627187384 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9480064100 msgr2=0x7f94800665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:06:10.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.450+0000 7f9495fa2700 1 --2- 172.21.15.26:0/1627187384 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9480064100 0x7f94800665c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f9490060060 tx=0x7f9484009c00).stop 2021-11-03T18:06:10.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.450+0000 7f9495fa2700 1 -- 172.21.15.26:0/1627187384 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94900f66e0 msgr2=0x7f949010bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:06:10.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.450+0000 7f9495fa2700 1 --2- 172.21.15.26:0/1627187384 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94900f66e0 0x7f949010bf90 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 rx=0x7f947c009990 tx=0x7f947c009b30).stop 2021-11-03T18:06:10.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.450+0000 7f9495fa2700 1 -- 172.21.15.26:0/1627187384 shutdown_connections 2021-11-03T18:06:10.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.450+0000 7f9495fa2700 1 --2- 172.21.15.26:0/1627187384 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9480064100 0x7f94800665c0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:10.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.450+0000 7f9495fa2700 1 --2- 172.21.15.26:0/1627187384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94900f5440 0x7f9490109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:10.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.450+0000 7f9495fa2700 1 --2- 172.21.15.26:0/1627187384 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94900f66e0 0x7f949010bf90 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:10.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.450+0000 7f9495fa2700 1 -- 172.21.15.26:0/1627187384 >> 172.21.15.26:0/1627187384 conn(0x7f94900f0ba0 msgr2=0x7f94900fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:06:10.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.450+0000 7f9495fa2700 1 -- 172.21.15.26:0/1627187384 shutdown_connections 2021-11-03T18:06:10.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:10.450+0000 7f9495fa2700 1 -- 172.21.15.26:0/1627187384 wait complete. 2021-11-03T18:06:10.462 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:06:10.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:10 smithi194 ceph-mon[65619]: from='client.36348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:06:11.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:10 smithi194 ceph-mon[65619]: pgmap v2145: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:11.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:10 smithi194 ceph-mon[65619]: from='client.36352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:06:11.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:10 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3690761849' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:06:11.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:10 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1627187384' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:06:11.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:10 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:06:11.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:10 smithi026 ceph-mon[96795]: from='client.36348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:06:11.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:10 smithi026 ceph-mon[96795]: pgmap v2145: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:11.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:10 smithi026 ceph-mon[96795]: from='client.36352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:06:11.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:10 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3690761849' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:06:11.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:10 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1627187384' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:06:11.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:10 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:06:12.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:11 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:06:12.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:11 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:06:13.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:12 smithi026 ceph-mon[96795]: pgmap v2146: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:13.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:12 smithi194 ceph-mon[65619]: pgmap v2146: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:15.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:14 smithi026 ceph-mon[96795]: pgmap v2147: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:15.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:14 smithi194 ceph-mon[65619]: pgmap v2147: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:17.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:16 smithi026 ceph-mon[96795]: pgmap v2148: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:17.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:16 smithi194 ceph-mon[65619]: pgmap v2148: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:19.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:18 smithi026 ceph-mon[96795]: pgmap v2149: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:19.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:18 smithi194 ceph-mon[65619]: pgmap v2149: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:21.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:20 smithi026 ceph-mon[96795]: pgmap v2150: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:21.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:20 smithi194 ceph-mon[65619]: pgmap v2150: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:23.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:22 smithi026 ceph-mon[96795]: pgmap v2151: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:23.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:22 smithi194 ceph-mon[65619]: pgmap v2151: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:25.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:24 smithi026 ceph-mon[96795]: pgmap v2152: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:25.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:24 smithi194 ceph-mon[65619]: pgmap v2152: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:25.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:06:26.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:06:27.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:26 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:06:27.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:26 smithi026 ceph-mon[96795]: pgmap v2153: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:27.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:26 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:06:27.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:26 smithi194 ceph-mon[65619]: pgmap v2153: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:29.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:28 smithi026 ceph-mon[96795]: pgmap v2154: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:29.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:28 smithi194 ceph-mon[65619]: pgmap v2154: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:31.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:30 smithi026 ceph-mon[96795]: pgmap v2155: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:31.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:30 smithi194 ceph-mon[65619]: pgmap v2155: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:33.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:32 smithi026 ceph-mon[96795]: pgmap v2156: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:33.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:32 smithi194 ceph-mon[65619]: pgmap v2156: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:35.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:34 smithi026 ceph-mon[96795]: pgmap v2157: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:35.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:34 smithi194 ceph-mon[65619]: pgmap v2157: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:37.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:36 smithi026 ceph-mon[96795]: pgmap v2158: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:37.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:36 smithi194 ceph-mon[65619]: pgmap v2158: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:39.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:38 smithi026 ceph-mon[96795]: pgmap v2159: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:39.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:38 smithi194 ceph-mon[65619]: pgmap v2159: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:40.562 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.565+0000 7fb51e996700 1 -- 172.21.15.26:0/732139989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5180f55c0 msgr2=0x7fb5180f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:06:40.563 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.565+0000 7fb51e996700 1 --2- 172.21.15.26:0/732139989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5180f55c0 0x7fb5180f59e0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7fb50c004660 tx=0x7fb50c009b30).stop 2021-11-03T18:06:40.563 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.565+0000 7fb51e996700 1 -- 172.21.15.26:0/732139989 shutdown_connections 2021-11-03T18:06:40.563 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.565+0000 7fb51e996700 1 --2- 172.21.15.26:0/732139989 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5180f6860 0x7fb5180f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:40.564 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.565+0000 7fb51e996700 1 --2- 172.21.15.26:0/732139989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5180f55c0 0x7fb5180f59e0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:40.564 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.565+0000 7fb51e996700 1 -- 172.21.15.26:0/732139989 >> 172.21.15.26:0/732139989 conn(0x7fb5180f0d40 msgr2=0x7fb5180f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:06:40.564 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.565+0000 7fb51e996700 1 -- 172.21.15.26:0/732139989 shutdown_connections 2021-11-03T18:06:40.564 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.565+0000 7fb51e996700 1 -- 172.21.15.26:0/732139989 wait complete. 2021-11-03T18:06:40.564 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.565+0000 7fb51e996700 1 Processor -- start 2021-11-03T18:06:40.565 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.566+0000 7fb51e996700 1 -- start start 2021-11-03T18:06:40.567 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.566+0000 7fb51e996700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5180f55c0 0x7fb518105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:06:40.567 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.566+0000 7fb51e996700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5180f6860 0x7fb518106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:06:40.567 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.566+0000 7fb51e996700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb518106910 con 0x7fb5180f6860 2021-11-03T18:06:40.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.566+0000 7fb51e996700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb518106a50 con 0x7fb5180f55c0 2021-11-03T18:06:40.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.566+0000 7fb5177fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5180f6860 0x7fb518106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:06:40.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.566+0000 7fb5177fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5180f6860 0x7fb518106360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58170/0 (socket says 172.21.15.26:58170) 2021-11-03T18:06:40.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.566+0000 7fb5177fe700 1 -- 172.21.15.26:0/1078437238 learned_addr learned my addr 172.21.15.26:0/1078437238 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:06:40.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.566+0000 7fb517fff700 1 --2- 172.21.15.26:0/1078437238 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5180f55c0 0x7fb518105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:06:40.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.566+0000 7fb5177fe700 1 -- 172.21.15.26:0/1078437238 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5180f55c0 msgr2=0x7fb518105e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:06:40.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.566+0000 7fb5177fe700 1 --2- 172.21.15.26:0/1078437238 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5180f55c0 0x7fb518105e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:40.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.566+0000 7fb5177fe700 1 -- 172.21.15.26:0/1078437238 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb50c005040 con 0x7fb5180f6860 2021-11-03T18:06:40.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.566+0000 7fb5177fe700 1 --2- 172.21.15.26:0/1078437238 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5180f6860 0x7fb518106360 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7fb5080026d0 tx=0x7fb508009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:06:40.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.567+0000 7fb514ff9700 1 -- 172.21.15.26:0/1078437238 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5080079c0 con 0x7fb5180f6860 2021-11-03T18:06:40.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.567+0000 7fb514ff9700 1 -- 172.21.15.26:0/1078437238 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb50800f040 con 0x7fb5180f6860 2021-11-03T18:06:40.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.567+0000 7fb51e996700 1 -- 172.21.15.26:0/1078437238 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5181073f0 con 0x7fb5180f6860 2021-11-03T18:06:40.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.567+0000 7fb514ff9700 1 -- 172.21.15.26:0/1078437238 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5080148b0 con 0x7fb5180f6860 2021-11-03T18:06:40.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.567+0000 7fb51e996700 1 -- 172.21.15.26:0/1078437238 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5181079b0 con 0x7fb5180f6860 2021-11-03T18:06:40.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.568+0000 7fb51e996700 1 -- 172.21.15.26:0/1078437238 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb518045ad0 con 0x7fb5180f6860 2021-11-03T18:06:40.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.568+0000 7fb514ff9700 1 -- 172.21.15.26:0/1078437238 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fb508007b20 con 0x7fb5180f6860 2021-11-03T18:06:40.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.569+0000 7fb514ff9700 1 --2- 172.21.15.26:0/1078437238 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb5000640b0 0x7fb500066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:06:40.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.569+0000 7fb514ff9700 1 -- 172.21.15.26:0/1078437238 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fb508080800 con 0x7fb5180f6860 2021-11-03T18:06:40.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.569+0000 7fb517fff700 1 --2- 172.21.15.26:0/1078437238 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb5000640b0 0x7fb500066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:06:40.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.569+0000 7fb517fff700 1 --2- 172.21.15.26:0/1078437238 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb5000640b0 0x7fb500066570 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7fb50c004630 tx=0x7fb50c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:06:40.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.573+0000 7fb514ff9700 1 -- 172.21.15.26:0/1078437238 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fb508052aa0 con 0x7fb5180f6860 2021-11-03T18:06:40.748 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.751+0000 7fb51e996700 1 -- 172.21.15.26:0/1078437238 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5180ff800 con 0x7fb5000640b0 2021-11-03T18:06:40.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.752+0000 7fb514ff9700 1 -- 172.21.15.26:0/1078437238 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fb5180ff800 con 0x7fb5000640b0 2021-11-03T18:06:40.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.754+0000 7fb51e996700 1 -- 172.21.15.26:0/1078437238 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb5000640b0 msgr2=0x7fb500066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:06:40.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.754+0000 7fb51e996700 1 --2- 172.21.15.26:0/1078437238 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb5000640b0 0x7fb500066570 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7fb50c004630 tx=0x7fb50c009b30).stop 2021-11-03T18:06:40.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.754+0000 7fb51e996700 1 -- 172.21.15.26:0/1078437238 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5180f6860 msgr2=0x7fb518106360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:06:40.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.754+0000 7fb51e996700 1 --2- 172.21.15.26:0/1078437238 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5180f6860 0x7fb518106360 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7fb5080026d0 tx=0x7fb508009de0).stop 2021-11-03T18:06:40.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.754+0000 7fb51e996700 1 -- 172.21.15.26:0/1078437238 shutdown_connections 2021-11-03T18:06:40.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.754+0000 7fb51e996700 1 --2- 172.21.15.26:0/1078437238 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb5000640b0 0x7fb500066570 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:40.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.754+0000 7fb51e996700 1 --2- 172.21.15.26:0/1078437238 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5180f55c0 0x7fb518105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:40.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.754+0000 7fb51e996700 1 --2- 172.21.15.26:0/1078437238 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5180f6860 0x7fb518106360 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:40.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.754+0000 7fb51e996700 1 -- 172.21.15.26:0/1078437238 >> 172.21.15.26:0/1078437238 conn(0x7fb5180f0d40 msgr2=0x7fb5180fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:06:40.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.754+0000 7fb51e996700 1 -- 172.21.15.26:0/1078437238 shutdown_connections 2021-11-03T18:06:40.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.755+0000 7fb51e996700 1 -- 172.21.15.26:0/1078437238 wait complete. 2021-11-03T18:06:40.761 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:06:40.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.855+0000 7fafc7910700 1 -- 172.21.15.26:0/2575930909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafc00f7980 msgr2=0x7fafc00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:06:40.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.855+0000 7fafc7910700 1 --2- 172.21.15.26:0/2575930909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafc00f7980 0x7fafc00f7de0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7fafb4004660 tx=0x7fafb4009b30).stop 2021-11-03T18:06:40.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.855+0000 7fafc7910700 1 -- 172.21.15.26:0/2575930909 shutdown_connections 2021-11-03T18:06:40.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.855+0000 7fafc7910700 1 --2- 172.21.15.26:0/2575930909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafc00f7980 0x7fafc00f7de0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:40.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.855+0000 7fafc7910700 1 --2- 172.21.15.26:0/2575930909 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafc00f66e0 0x7fafc00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:06:40.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.855+0000 7fafc7910700 1 -- 172.21.15.26:0/2575930909 >> 172.21.15.26:0/2575930909 conn(0x7fafc00f1e40 msgr2=0x7fafc00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:06:40.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.855+0000 7fafc7910700 1 -- 172.21.15.26:0/2575930909 shutdown_connections 2021-11-03T18:06:40.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.855+0000 7fafc7910700 1 -- 172.21.15.26:0/2575930909 wait complete. 2021-11-03T18:06:40.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.856+0000 7fafc7910700 1 Processor -- start 2021-11-03T18:06:40.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.856+0000 7fafc7910700 1 -- start start 2021-11-03T18:06:40.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.856+0000 7fafc7910700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafc00f66e0 0x7fafc006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:06:40.858 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.856+0000 7fafc7910700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafc00f7980 0x7fafc0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:06:40.858 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.856+0000 7fafc7910700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc006a410 con 0x7fafc00f66e0 2021-11-03T18:06:40.858 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.856+0000 7fafc7910700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc006a550 con 0x7fafc00f7980 2021-11-03T18:06:40.858 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.856+0000 7fafc56ac700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafc00f66e0 0x7fafc006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:06:40.859 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.856+0000 7fafc56ac700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafc00f66e0 0x7fafc006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58178/0 (socket says 172.21.15.26:58178) 2021-11-03T18:06:40.859 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.856+0000 7fafc56ac700 1 -- 172.21.15.26:0/387135150 learned_addr learned my addr 172.21.15.26:0/387135150 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:06:40.859 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.856+0000 7fafc4eab700 1 --2- 172.21.15.26:0/387135150 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafc00f7980 0x7fafc0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:06:40.859 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.856+0000 7fafc56ac700 1 -- 172.21.15.26:0/387135150 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafc00f7980 msgr2=0x7fafc0069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:06:40.860 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.856+0000 7fafc56ac700 1 --2- 172.21.15.26:0/387135150 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafc00f7980 0x7fafc0069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:40.860 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.856+0000 7fafc56ac700 1 -- 172.21.15.26:0/387135150 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb4005040 con 0x7fafc00f66e0 2021-11-03T18:06:40.860 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.856+0000 7fafc56ac700 1 --2- 172.21.15.26:0/387135150 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafc00f66e0 0x7fafc006b9a0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 rx=0x7fafb80093f0 tx=0x7fafb8006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:06:40.860 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.857+0000 7fafbdffb700 1 -- 172.21.15.26:0/387135150 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafb8009ea0 con 0x7fafc00f66e0 2021-11-03T18:06:40.861 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.857+0000 7fafbdffb700 1 -- 172.21.15.26:0/387135150 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fafb8013af0 con 0x7fafc00f66e0 2021-11-03T18:06:40.861 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.857+0000 7fafc7910700 1 -- 172.21.15.26:0/387135150 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc006a830 con 0x7fafc00f66e0 2021-11-03T18:06:40.861 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.857+0000 7fafbdffb700 1 -- 172.21.15.26:0/387135150 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafb800db10 con 0x7fafc00f66e0 2021-11-03T18:06:40.861 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.857+0000 7fafc7910700 1 -- 172.21.15.26:0/387135150 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc010efe0 con 0x7fafc00f66e0 2021-11-03T18:06:40.861 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.858+0000 7fafc7910700 1 -- 172.21.15.26:0/387135150 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafc0045ad0 con 0x7fafc00f66e0 2021-11-03T18:06:40.862 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.858+0000 7fafbdffb700 1 -- 172.21.15.26:0/387135150 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fafb801a060 con 0x7fafc00f66e0 2021-11-03T18:06:40.862 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.858+0000 7fafbdffb700 1 --2- 172.21.15.26:0/387135150 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fafa80640b0 0x7fafa8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:06:40.862 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.859+0000 7fafbdffb700 1 -- 172.21.15.26:0/387135150 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fafb80808e0 con 0x7fafc00f66e0 2021-11-03T18:06:40.862 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.859+0000 7fafc4eab700 1 --2- 172.21.15.26:0/387135150 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fafa80640b0 0x7fafa8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:06:40.863 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.859+0000 7fafc4eab700 1 --2- 172.21.15.26:0/387135150 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fafa80640b0 0x7fafa8066570 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7fafb4004e30 tx=0x7fafb4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:06:40.863 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:40.863+0000 7fafbdffb700 1 -- 172.21.15.26:0/387135150 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fafb8052b50 con 0x7fafc00f66e0 2021-11-03T18:06:41.032 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.035+0000 7fafc7910700 1 -- 172.21.15.26:0/387135150 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fafc0057f10 con 0x7fafa80640b0 2021-11-03T18:06:41.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.050+0000 7fafbdffb700 1 -- 172.21.15.26:0/387135150 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fafc0057f10 con 0x7fafa80640b0 2021-11-03T18:06:41.047 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:06:41.048 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (77m) 6m ago 79m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:06:41.048 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (70m) 6m ago 79m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:06:41.048 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (69m) 5m ago 78m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:06:41.048 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (77m) 6m ago 78m 41.7M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:06:41.049 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (70m) 6m ago 74m 25.6M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:06:41.049 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (71m) 6m ago 74m 26.2M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:06:41.049 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (74m) 5m ago 74m 26.4M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:06:41.049 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (74m) 5m ago 74m 26.8M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:06:41.050 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (71m) 6m ago 80m 561M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:06:41.050 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (71m) 5m ago 78m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:06:41.050 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (71m) 6m ago 80m 276M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:06:41.050 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (70m) 5m ago 78m 132M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:06:41.051 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (78m) 6m ago 78m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:06:41.051 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (78m) 5m ago 78m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:06:41.051 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (69m) 6m ago 77m 292M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:06:41.051 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (69m) 6m ago 77m 313M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:06:41.052 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (68m) 6m ago 76m 261M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:06:41.052 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (68m) 5m ago 76m 337M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:06:41.052 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (67m) 5m ago 76m 283M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:06:41.052 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (67m) 5m ago 75m 276M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:06:41.052 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (77m) 6m ago 78m 61.2M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:06:41.053 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.052+0000 7fafc7910700 1 -- 172.21.15.26:0/387135150 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fafa80640b0 msgr2=0x7fafa8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:06:41.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.052+0000 7fafc7910700 1 --2- 172.21.15.26:0/387135150 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fafa80640b0 0x7fafa8066570 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7fafb4004e30 tx=0x7fafb4009b30).stop 2021-11-03T18:06:41.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.052+0000 7fafc7910700 1 -- 172.21.15.26:0/387135150 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafc00f66e0 msgr2=0x7fafc006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:06:41.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.052+0000 7fafc7910700 1 --2- 172.21.15.26:0/387135150 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafc00f66e0 0x7fafc006b9a0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 rx=0x7fafb80093f0 tx=0x7fafb8006ec0).stop 2021-11-03T18:06:41.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.052+0000 7fafc7910700 1 -- 172.21.15.26:0/387135150 shutdown_connections 2021-11-03T18:06:41.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.052+0000 7fafc7910700 1 --2- 172.21.15.26:0/387135150 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fafa80640b0 0x7fafa8066570 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:41.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.052+0000 7fafc7910700 1 --2- 172.21.15.26:0/387135150 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafc00f66e0 0x7fafc006b9a0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:41.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.052+0000 7fafc7910700 1 --2- 172.21.15.26:0/387135150 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafc00f7980 0x7fafc0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:41.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.052+0000 7fafc7910700 1 -- 172.21.15.26:0/387135150 >> 172.21.15.26:0/387135150 conn(0x7fafc00f1e40 msgr2=0x7fafc00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:06:41.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.052+0000 7fafc7910700 1 -- 172.21.15.26:0/387135150 shutdown_connections 2021-11-03T18:06:41.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.052+0000 7fafc7910700 1 -- 172.21.15.26:0/387135150 wait complete. 2021-11-03T18:06:41.149 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.151+0000 7fd3d26f0700 1 -- 172.21.15.26:0/600461946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3cc0f7d00 msgr2=0x7fd3cc0f8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:06:41.150 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.151+0000 7fd3d26f0700 1 --2- 172.21.15.26:0/600461946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3cc0f7d00 0x7fd3cc0f8120 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7fd3c0004660 tx=0x7fd3c0009b30).stop 2021-11-03T18:06:41.150 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.151+0000 7fd3d26f0700 1 -- 172.21.15.26:0/600461946 shutdown_connections 2021-11-03T18:06:41.150 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.151+0000 7fd3d26f0700 1 --2- 172.21.15.26:0/600461946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3cc0f8610 0x7fd3cc0f4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:06:41.151 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.151+0000 7fd3d26f0700 1 --2- 172.21.15.26:0/600461946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3cc0f7d00 0x7fd3cc0f8120 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:41.151 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.151+0000 7fd3d26f0700 1 -- 172.21.15.26:0/600461946 >> 172.21.15.26:0/600461946 conn(0x7fd3cc0f0540 msgr2=0x7fd3cc0f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:06:41.151 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.151+0000 7fd3d26f0700 1 -- 172.21.15.26:0/600461946 shutdown_connections 2021-11-03T18:06:41.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.151+0000 7fd3d26f0700 1 -- 172.21.15.26:0/600461946 wait complete. 2021-11-03T18:06:41.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.151+0000 7fd3d26f0700 1 Processor -- start 2021-11-03T18:06:41.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.152+0000 7fd3d26f0700 1 -- start start 2021-11-03T18:06:41.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.152+0000 7fd3d26f0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3cc0f7d00 0x7fd3cc0f75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:06:41.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.152+0000 7fd3d26f0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3cc0f8610 0x7fd3cc0f5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:06:41.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.152+0000 7fd3d26f0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc0f6040 con 0x7fd3cc0f8610 2021-11-03T18:06:41.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.152+0000 7fd3d26f0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc0f6180 con 0x7fd3cc0f7d00 2021-11-03T18:06:41.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.152+0000 7fd3cb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3cc0f8610 0x7fd3cc0f5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:06:41.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.152+0000 7fd3cb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3cc0f8610 0x7fd3cc0f5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58190/0 (socket says 172.21.15.26:58190) 2021-11-03T18:06:41.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.152+0000 7fd3cb7fe700 1 -- 172.21.15.26:0/3472767581 learned_addr learned my addr 172.21.15.26:0/3472767581 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:06:41.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.152+0000 7fd3cbfff700 1 --2- 172.21.15.26:0/3472767581 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3cc0f7d00 0x7fd3cc0f75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:06:41.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.152+0000 7fd3cb7fe700 1 -- 172.21.15.26:0/3472767581 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3cc0f7d00 msgr2=0x7fd3cc0f75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:06:41.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.152+0000 7fd3cb7fe700 1 --2- 172.21.15.26:0/3472767581 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3cc0f7d00 0x7fd3cc0f75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:41.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.152+0000 7fd3cb7fe700 1 -- 172.21.15.26:0/3472767581 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c0005040 con 0x7fd3cc0f8610 2021-11-03T18:06:41.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.152+0000 7fd3cb7fe700 1 --2- 172.21.15.26:0/3472767581 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3cc0f8610 0x7fd3cc0f5a50 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 rx=0x7fd3bc00b410 tx=0x7fd3bc006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:06:41.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.153+0000 7fd3c8ff9700 1 -- 172.21.15.26:0/3472767581 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3bc0125f0 con 0x7fd3cc0f8610 2021-11-03T18:06:41.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.153+0000 7fd3c8ff9700 1 -- 172.21.15.26:0/3472767581 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd3bc00be30 con 0x7fd3cc0f8610 2021-11-03T18:06:41.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.153+0000 7fd3d26f0700 1 -- 172.21.15.26:0/3472767581 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3cc0f6460 con 0x7fd3cc0f8610 2021-11-03T18:06:41.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.153+0000 7fd3c8ff9700 1 -- 172.21.15.26:0/3472767581 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3bc002a70 con 0x7fd3cc0f8610 2021-11-03T18:06:41.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.153+0000 7fd3d26f0700 1 -- 172.21.15.26:0/3472767581 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3cc10ef80 con 0x7fd3cc0f8610 2021-11-03T18:06:41.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.154+0000 7fd3d26f0700 1 -- 172.21.15.26:0/3472767581 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3cc045ad0 con 0x7fd3cc0f8610 2021-11-03T18:06:41.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.154+0000 7fd3c8ff9700 1 -- 172.21.15.26:0/3472767581 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fd3bc00f030 con 0x7fd3cc0f8610 2021-11-03T18:06:41.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.154+0000 7fd3c8ff9700 1 --2- 172.21.15.26:0/3472767581 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd3b40640b0 0x7fd3b4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:06:41.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.154+0000 7fd3c8ff9700 1 -- 172.21.15.26:0/3472767581 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fd3bc080bf0 con 0x7fd3cc0f8610 2021-11-03T18:06:41.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.155+0000 7fd3cbfff700 1 --2- 172.21.15.26:0/3472767581 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd3b40640b0 0x7fd3b4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:06:41.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.155+0000 7fd3cbfff700 1 --2- 172.21.15.26:0/3472767581 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd3b40640b0 0x7fd3b4066570 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7fd3c0004630 tx=0x7fd3c0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:06:41.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.158+0000 7fd3c8ff9700 1 -- 172.21.15.26:0/3472767581 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fd3bc052f50 con 0x7fd3cc0f8610 2021-11-03T18:06:41.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:40 smithi026 ceph-mon[96795]: pgmap v2160: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:41.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:06:41.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:40 smithi194 ceph-mon[65619]: pgmap v2160: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:41.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:06:41.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.385+0000 7fd3d26f0700 1 -- 172.21.15.26:0/3472767581 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd3cc027a00 con 0x7fd3cc0f8610 2021-11-03T18:06:41.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.385+0000 7fd3c8ff9700 1 -- 172.21.15.26:0/3472767581 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fd3bc052b40 con 0x7fd3cc0f8610 2021-11-03T18:06:41.383 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:06:41.383 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:06:41.384 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:06:41.384 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:06:41.384 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:06:41.384 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:06:41.385 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:06:41.385 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:06:41.385 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:06:41.385 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:06:41.385 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:06:41.386 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:06:41.386 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:06:41.386 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:06:41.386 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:06:41.387 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:06:41.387 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:06:41.387 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:06:41.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.387+0000 7fd3d26f0700 1 -- 172.21.15.26:0/3472767581 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd3b40640b0 msgr2=0x7fd3b4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:06:41.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.387+0000 7fd3d26f0700 1 --2- 172.21.15.26:0/3472767581 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd3b40640b0 0x7fd3b4066570 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7fd3c0004630 tx=0x7fd3c0009b30).stop 2021-11-03T18:06:41.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.387+0000 7fd3d26f0700 1 -- 172.21.15.26:0/3472767581 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3cc0f8610 msgr2=0x7fd3cc0f5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:06:41.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.387+0000 7fd3d26f0700 1 --2- 172.21.15.26:0/3472767581 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3cc0f8610 0x7fd3cc0f5a50 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 rx=0x7fd3bc00b410 tx=0x7fd3bc006ef0).stop 2021-11-03T18:06:41.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.387+0000 7fd3d26f0700 1 -- 172.21.15.26:0/3472767581 shutdown_connections 2021-11-03T18:06:41.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.387+0000 7fd3d26f0700 1 --2- 172.21.15.26:0/3472767581 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd3b40640b0 0x7fd3b4066570 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:41.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.387+0000 7fd3d26f0700 1 --2- 172.21.15.26:0/3472767581 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3cc0f7d00 0x7fd3cc0f75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:41.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.387+0000 7fd3d26f0700 1 --2- 172.21.15.26:0/3472767581 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3cc0f8610 0x7fd3cc0f5a50 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:41.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.387+0000 7fd3d26f0700 1 -- 172.21.15.26:0/3472767581 >> 172.21.15.26:0/3472767581 conn(0x7fd3cc0f0540 msgr2=0x7fd3cc0fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:06:41.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.387+0000 7fd3d26f0700 1 -- 172.21.15.26:0/3472767581 shutdown_connections 2021-11-03T18:06:41.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.387+0000 7fd3d26f0700 1 -- 172.21.15.26:0/3472767581 wait complete. 2021-11-03T18:06:41.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.487+0000 7fec8dbb0700 1 -- 172.21.15.26:0/482836051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec880f6a10 msgr2=0x7fec880f6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:06:41.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.487+0000 7fec8dbb0700 1 --2- 172.21.15.26:0/482836051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec880f6a10 0x7fec880f6e30 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7fec7c004660 tx=0x7fec7c009b30).stop 2021-11-03T18:06:41.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.487+0000 7fec8dbb0700 1 -- 172.21.15.26:0/482836051 shutdown_connections 2021-11-03T18:06:41.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.487+0000 7fec8dbb0700 1 --2- 172.21.15.26:0/482836051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec880f5710 0x7fec880f5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:41.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.487+0000 7fec8dbb0700 1 --2- 172.21.15.26:0/482836051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec880f6a10 0x7fec880f6e30 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:41.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.487+0000 7fec8dbb0700 1 -- 172.21.15.26:0/482836051 >> 172.21.15.26:0/482836051 conn(0x7fec880f0320 msgr2=0x7fec880f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:06:41.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.487+0000 7fec8dbb0700 1 -- 172.21.15.26:0/482836051 shutdown_connections 2021-11-03T18:06:41.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.487+0000 7fec8dbb0700 1 -- 172.21.15.26:0/482836051 wait complete. 2021-11-03T18:06:41.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.488+0000 7fec8dbb0700 1 Processor -- start 2021-11-03T18:06:41.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.488+0000 7fec8dbb0700 1 -- start start 2021-11-03T18:06:41.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.488+0000 7fec8dbb0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec880f5710 0x7fec88105d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:06:41.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.488+0000 7fec8dbb0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec880f6a10 0x7fec88106200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:06:41.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.488+0000 7fec8dbb0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec881067b0 con 0x7fec880f5710 2021-11-03T18:06:41.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.488+0000 7fec8dbb0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec88106fb0 con 0x7fec880f6a10 2021-11-03T18:06:41.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.488+0000 7fec8cbae700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec880f5710 0x7fec88105d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:06:41.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.488+0000 7fec8cbae700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec880f5710 0x7fec88105d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58196/0 (socket says 172.21.15.26:58196) 2021-11-03T18:06:41.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.488+0000 7fec8cbae700 1 -- 172.21.15.26:0/2898245148 learned_addr learned my addr 172.21.15.26:0/2898245148 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:06:41.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.489+0000 7fec87fff700 1 --2- 172.21.15.26:0/2898245148 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec880f6a10 0x7fec88106200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:06:41.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.489+0000 7fec8cbae700 1 -- 172.21.15.26:0/2898245148 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec880f6a10 msgr2=0x7fec88106200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:06:41.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.489+0000 7fec8cbae700 1 --2- 172.21.15.26:0/2898245148 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec880f6a10 0x7fec88106200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:41.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.489+0000 7fec8cbae700 1 -- 172.21.15.26:0/2898245148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7c005040 con 0x7fec880f5710 2021-11-03T18:06:41.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.489+0000 7fec8cbae700 1 --2- 172.21.15.26:0/2898245148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec880f5710 0x7fec88105d10 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 rx=0x7fec7c013a70 tx=0x7fec7c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:06:41.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.489+0000 7fec857fa700 1 -- 172.21.15.26:0/2898245148 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec7c018070 con 0x7fec880f5710 2021-11-03T18:06:41.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.489+0000 7fec857fa700 1 -- 172.21.15.26:0/2898245148 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fec7c0097d0 con 0x7fec880f5710 2021-11-03T18:06:41.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.489+0000 7fec857fa700 1 -- 172.21.15.26:0/2898245148 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec7c01c3c0 con 0x7fec880f5710 2021-11-03T18:06:41.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.489+0000 7fec8dbb0700 1 -- 172.21.15.26:0/2898245148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec88107230 con 0x7fec880f5710 2021-11-03T18:06:41.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.489+0000 7fec8dbb0700 1 -- 172.21.15.26:0/2898245148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec88107790 con 0x7fec880f5710 2021-11-03T18:06:41.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.490+0000 7fec8dbb0700 1 -- 172.21.15.26:0/2898245148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec88059100 con 0x7fec880f5710 2021-11-03T18:06:41.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.491+0000 7fec857fa700 1 -- 172.21.15.26:0/2898245148 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fec7c007ba0 con 0x7fec880f5710 2021-11-03T18:06:41.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.491+0000 7fec857fa700 1 --2- 172.21.15.26:0/2898245148 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fec78064100 0x7fec780665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:06:41.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.491+0000 7fec857fa700 1 -- 172.21.15.26:0/2898245148 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fec7c0827a0 con 0x7fec880f5710 2021-11-03T18:06:41.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.491+0000 7fec87fff700 1 --2- 172.21.15.26:0/2898245148 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fec78064100 0x7fec780665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:06:41.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.492+0000 7fec87fff700 1 --2- 172.21.15.26:0/2898245148 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fec78064100 0x7fec780665c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7fec880f67e0 tx=0x7fec7400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:06:41.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.495+0000 7fec857fa700 1 -- 172.21.15.26:0/2898245148 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fec7c054b80 con 0x7fec880f5710 2021-11-03T18:06:41.692 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.695+0000 7fec8dbb0700 1 -- 172.21.15.26:0/2898245148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fec88027a00 con 0x7fec880f5710 2021-11-03T18:06:41.693 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.696+0000 7fec857fa700 1 -- 172.21.15.26:0/2898245148 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fec7c054770 con 0x7fec880f5710 2021-11-03T18:06:41.693 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:06:41.694 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:06:41.694 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:06:41.694 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:06:41.694 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:06:41.695 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:06:41.695 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:06:41.695 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:06:41.695 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:06:41.696 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:06:41.696 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:06:41.696 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:06:41.696 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:06:41.696 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:06:41.697 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:06:41.697 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:06:41.697 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:06:41.697 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:06:41.698 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:06:41.698 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:06:41.698 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:06:41.698 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:06:41.699 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:06:41.699 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:06:41.699 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:06:41.699 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:06:41.700 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:06:41.700 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:06:41.700 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:06:41.700 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:06:41.700 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:06:41.701 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:06:41.701 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:06:41.701 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:06:41.701 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:06:41.702 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:06:41.702 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:06:41.702 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:06:41.702 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:06:41.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.697+0000 7fec8dbb0700 1 -- 172.21.15.26:0/2898245148 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fec78064100 msgr2=0x7fec780665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:06:41.704 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.697+0000 7fec8dbb0700 1 --2- 172.21.15.26:0/2898245148 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fec78064100 0x7fec780665c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7fec880f67e0 tx=0x7fec7400b040).stop 2021-11-03T18:06:41.704 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.697+0000 7fec8dbb0700 1 -- 172.21.15.26:0/2898245148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec880f5710 msgr2=0x7fec88105d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:06:41.704 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.697+0000 7fec8dbb0700 1 --2- 172.21.15.26:0/2898245148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec880f5710 0x7fec88105d10 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 rx=0x7fec7c013a70 tx=0x7fec7c009b30).stop 2021-11-03T18:06:41.704 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.698+0000 7fec8dbb0700 1 -- 172.21.15.26:0/2898245148 shutdown_connections 2021-11-03T18:06:41.704 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.698+0000 7fec8dbb0700 1 --2- 172.21.15.26:0/2898245148 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fec78064100 0x7fec780665c0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:41.705 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.698+0000 7fec8dbb0700 1 --2- 172.21.15.26:0/2898245148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec880f5710 0x7fec88105d10 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:41.705 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.698+0000 7fec8dbb0700 1 --2- 172.21.15.26:0/2898245148 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec880f6a10 0x7fec88106200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:06:41.705 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.698+0000 7fec8dbb0700 1 -- 172.21.15.26:0/2898245148 >> 172.21.15.26:0/2898245148 conn(0x7fec880f0320 msgr2=0x7fec880fa170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:06:41.705 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.698+0000 7fec8dbb0700 1 -- 172.21.15.26:0/2898245148 shutdown_connections 2021-11-03T18:06:41.706 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:06:41.698+0000 7fec8dbb0700 1 -- 172.21.15.26:0/2898245148 wait complete. 2021-11-03T18:06:41.706 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:06:42.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:41 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:06:42.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:41 smithi026 ceph-mon[96795]: from='client.36364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:06:42.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:41 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3472767581' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:06:42.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:41 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2898245148' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:06:42.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:41 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:06:42.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:41 smithi194 ceph-mon[65619]: from='client.36364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:06:42.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:41 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3472767581' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:06:42.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:41 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2898245148' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:06:43.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:42 smithi026 ceph-mon[96795]: from='client.36368 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:06:43.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:42 smithi026 ceph-mon[96795]: pgmap v2161: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:43.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:42 smithi194 ceph-mon[65619]: from='client.36368 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:06:43.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:42 smithi194 ceph-mon[65619]: pgmap v2161: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:45.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:44 smithi026 ceph-mon[96795]: pgmap v2162: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:45.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:44 smithi194 ceph-mon[65619]: pgmap v2162: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:47.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:46 smithi026 ceph-mon[96795]: pgmap v2163: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:47.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:46 smithi194 ceph-mon[65619]: pgmap v2163: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:49.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:48 smithi026 ceph-mon[96795]: pgmap v2164: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:49.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:06:49.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:06:49.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:48 smithi194 ceph-mon[65619]: pgmap v2164: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:49.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:06:49.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:06:51.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:50 smithi026 ceph-mon[96795]: pgmap v2165: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:51.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:50 smithi194 ceph-mon[65619]: pgmap v2165: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:53.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:52 smithi026 ceph-mon[96795]: pgmap v2166: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:53.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:52 smithi194 ceph-mon[65619]: pgmap v2166: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:55.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:54 smithi026 ceph-mon[96795]: pgmap v2167: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:55.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:54 smithi194 ceph-mon[65619]: pgmap v2167: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:56.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:06:56.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:06:57.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:56 smithi026 ceph-mon[96795]: poll took 60055.852 ms: 1 events 2021-11-03T18:06:57.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:56 smithi026 ceph-mon[96795]: pgmap v2168: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:57.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:56 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:06:57.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:56 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:06:57.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:56 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:06:57.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:56 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:06:57.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:56 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:06:57.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:56 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:06:57.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:56 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:06:57.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:56 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:06:57.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:56 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:06:57.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:56 smithi194 ceph-mon[65619]: poll took 60055.852 ms: 1 events 2021-11-03T18:06:57.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:56 smithi194 ceph-mon[65619]: pgmap v2168: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:57.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:56 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:06:57.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:56 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:06:57.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:56 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:06:57.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:56 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:06:57.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:56 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:06:57.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:56 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:06:57.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:56 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:06:57.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:56 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:06:57.255 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:56 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:06:59.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:06:58 smithi026 ceph-mon[96795]: pgmap v2169: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:06:59.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:06:58 smithi194 ceph-mon[65619]: pgmap v2169: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:01.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:00 smithi026 ceph-mon[96795]: pgmap v2170: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:01.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:00 smithi194 ceph-mon[65619]: pgmap v2170: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:03.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:02 smithi026 ceph-mon[96795]: pgmap v2171: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:03.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:02 smithi194 ceph-mon[65619]: pgmap v2171: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:05.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:04 smithi026 ceph-mon[96795]: pgmap v2172: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:05.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:04 smithi194 ceph-mon[65619]: pgmap v2172: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:07.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:06 smithi026 ceph-mon[96795]: pgmap v2173: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:07.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:06 smithi194 ceph-mon[65619]: pgmap v2173: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:09.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:08 smithi026 ceph-mon[96795]: pgmap v2174: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:09.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:08 smithi194 ceph-mon[65619]: pgmap v2174: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:11.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:10 smithi026 ceph-mon[96795]: pgmap v2175: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:11.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:10 smithi194 ceph-mon[65619]: pgmap v2175: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:11.812 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:11.812+0000 7f1b7b822700 1 -- 172.21.15.26:0/4182742355 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b740f5ef0 msgr2=0x7f1b740f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:07:11.812 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:11.812+0000 7f1b7b822700 1 --2- 172.21.15.26:0/4182742355 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b740f5ef0 0x7f1b740f6920 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 rx=0x7f1b64004660 tx=0x7f1b64009b30).stop 2021-11-03T18:07:11.812 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:11.813+0000 7f1b7b822700 1 -- 172.21.15.26:0/4182742355 shutdown_connections 2021-11-03T18:07:11.813 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:11.813+0000 7f1b7b822700 1 --2- 172.21.15.26:0/4182742355 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b740f5ef0 0x7f1b740f6920 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:11.813 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:11.813+0000 7f1b7b822700 1 --2- 172.21.15.26:0/4182742355 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b740f55e0 0x7f1b740f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:11.813 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:11.813+0000 7f1b7b822700 1 -- 172.21.15.26:0/4182742355 >> 172.21.15.26:0/4182742355 conn(0x7f1b740f0de0 msgr2=0x7f1b740f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:07:11.813 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:11.813+0000 7f1b7b822700 1 -- 172.21.15.26:0/4182742355 shutdown_connections 2021-11-03T18:07:11.814 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:11.813+0000 7f1b7b822700 1 -- 172.21.15.26:0/4182742355 wait complete. 2021-11-03T18:07:11.814 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:11.813+0000 7f1b7b822700 1 Processor -- start 2021-11-03T18:07:11.814 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:11.813+0000 7f1b7b822700 1 -- start start 2021-11-03T18:07:11.814 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:11.813+0000 7f1b7b822700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b740f55e0 0x7f1b740fa000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:07:11.815 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:11.813+0000 7f1b7b822700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b740f5ef0 0x7f1b740f8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:07:11.815 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:11.813+0000 7f1b7b822700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b740f89e0 con 0x7f1b740f55e0 2021-11-03T18:07:11.815 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:11.813+0000 7f1b7b822700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b740f8b20 con 0x7f1b740f5ef0 2021-11-03T18:07:11.815 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:11.814+0000 7f1b795be700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b740f55e0 0x7f1b740fa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:07:11.815 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:11.814+0000 7f1b795be700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b740f55e0 0x7f1b740fa000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58214/0 (socket says 172.21.15.26:58214) 2021-11-03T18:07:11.816 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:11.814+0000 7f1b795be700 1 -- 172.21.15.26:0/3262778852 learned_addr learned my addr 172.21.15.26:0/3262778852 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:07:11.816 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:11.814+0000 7f1b78dbd700 1 --2- 172.21.15.26:0/3262778852 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b740f5ef0 0x7f1b740f8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:07:11.816 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:11.814+0000 7f1b795be700 1 -- 172.21.15.26:0/3262778852 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b740f5ef0 msgr2=0x7f1b740f8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:07:11.816 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:11.814+0000 7f1b795be700 1 --2- 172.21.15.26:0/3262778852 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b740f5ef0 0x7f1b740f8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:11.817 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:11.814+0000 7f1b795be700 1 -- 172.21.15.26:0/3262778852 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b64005040 con 0x7f1b740f55e0 2021-11-03T18:07:11.817 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:11.814+0000 7f1b795be700 1 --2- 172.21.15.26:0/3262778852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b740f55e0 0x7f1b740fa000 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7f1b7000c790 tx=0x7f1b70007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:07:11.817 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:11.814+0000 7f1b69ffb700 1 -- 172.21.15.26:0/3262778852 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b7000e680 con 0x7f1b740f55e0 2021-11-03T18:07:11.817 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:11.814+0000 7f1b69ffb700 1 -- 172.21.15.26:0/3262778852 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1b7000ec90 con 0x7f1b740f55e0 2021-11-03T18:07:11.817 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:11.814+0000 7f1b7b822700 1 -- 172.21.15.26:0/3262778852 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b740f8e00 con 0x7f1b740f55e0 2021-11-03T18:07:11.818 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:11.814+0000 7f1b69ffb700 1 -- 172.21.15.26:0/3262778852 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b70013d60 con 0x7f1b740f55e0 2021-11-03T18:07:11.818 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:11.815+0000 7f1b7b822700 1 -- 172.21.15.26:0/3262778852 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b7410efa0 con 0x7f1b740f55e0 2021-11-03T18:07:11.819 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:11.816+0000 7f1b7b822700 1 -- 172.21.15.26:0/3262778852 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b74045ad0 con 0x7f1b740f55e0 2021-11-03T18:07:11.819 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:11.816+0000 7f1b69ffb700 1 -- 172.21.15.26:0/3262778852 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f1b7001a060 con 0x7f1b740f55e0 2021-11-03T18:07:11.820 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:11.817+0000 7f1b69ffb700 1 --2- 172.21.15.26:0/3262778852 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1b600640b0 0x7f1b60066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:07:11.820 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:11.817+0000 7f1b69ffb700 1 -- 172.21.15.26:0/3262778852 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f1b70080a50 con 0x7f1b740f55e0 2021-11-03T18:07:11.820 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:11.817+0000 7f1b78dbd700 1 --2- 172.21.15.26:0/3262778852 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1b600640b0 0x7f1b60066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:07:11.820 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:11.817+0000 7f1b78dbd700 1 --2- 172.21.15.26:0/3262778852 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1b600640b0 0x7f1b60066570 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f1b64004e30 tx=0x7f1b64009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:07:11.821 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:11.821+0000 7f1b69ffb700 1 -- 172.21.15.26:0/3262778852 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f1b70052c60 con 0x7f1b740f55e0 2021-11-03T18:07:11.998 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.001+0000 7f1b7b822700 1 -- 172.21.15.26:0/3262778852 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b7405fe30 con 0x7f1b600640b0 2021-11-03T18:07:11.999 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.002+0000 7f1b69ffb700 1 -- 172.21.15.26:0/3262778852 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f1b7405fe30 con 0x7f1b600640b0 2021-11-03T18:07:12.001 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.004+0000 7f1b7b822700 1 -- 172.21.15.26:0/3262778852 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1b600640b0 msgr2=0x7f1b60066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:07:12.002 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.004+0000 7f1b7b822700 1 --2- 172.21.15.26:0/3262778852 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1b600640b0 0x7f1b60066570 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f1b64004e30 tx=0x7f1b64009b30).stop 2021-11-03T18:07:12.002 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.004+0000 7f1b7b822700 1 -- 172.21.15.26:0/3262778852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b740f55e0 msgr2=0x7f1b740fa000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:07:12.002 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.004+0000 7f1b7b822700 1 --2- 172.21.15.26:0/3262778852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b740f55e0 0x7f1b740fa000 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7f1b7000c790 tx=0x7f1b70007d70).stop 2021-11-03T18:07:12.002 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.004+0000 7f1b7b822700 1 -- 172.21.15.26:0/3262778852 shutdown_connections 2021-11-03T18:07:12.003 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.004+0000 7f1b7b822700 1 --2- 172.21.15.26:0/3262778852 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1b600640b0 0x7f1b60066570 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:12.003 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.004+0000 7f1b7b822700 1 --2- 172.21.15.26:0/3262778852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b740f55e0 0x7f1b740fa000 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:12.003 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.004+0000 7f1b7b822700 1 --2- 172.21.15.26:0/3262778852 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b740f5ef0 0x7f1b740f8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:12.003 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.004+0000 7f1b7b822700 1 -- 172.21.15.26:0/3262778852 >> 172.21.15.26:0/3262778852 conn(0x7f1b740f0de0 msgr2=0x7f1b7405f720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:07:12.003 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.004+0000 7f1b7b822700 1 -- 172.21.15.26:0/3262778852 shutdown_connections 2021-11-03T18:07:12.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.004+0000 7f1b7b822700 1 -- 172.21.15.26:0/3262778852 wait complete. 2021-11-03T18:07:12.011 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:07:12.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.105+0000 7f6de759e700 1 -- 172.21.15.26:0/2870025605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6de80f6530 msgr2=0x7f6de80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:07:12.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.105+0000 7f6de759e700 1 --2- 172.21.15.26:0/2870025605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6de80f6530 0x7f6de80f6950 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 rx=0x7f6dd8004660 tx=0x7f6dd8009b30).stop 2021-11-03T18:07:12.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.105+0000 7f6de759e700 1 -- 172.21.15.26:0/2870025605 shutdown_connections 2021-11-03T18:07:12.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.105+0000 7f6de759e700 1 --2- 172.21.15.26:0/2870025605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6de80f77d0 0x7f6de80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:07:12.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.105+0000 7f6de759e700 1 --2- 172.21.15.26:0/2870025605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6de80f6530 0x7f6de80f6950 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:12.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.105+0000 7f6de759e700 1 -- 172.21.15.26:0/2870025605 >> 172.21.15.26:0/2870025605 conn(0x7f6de80f1cd0 msgr2=0x7f6de80f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:07:12.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.105+0000 7f6de759e700 1 -- 172.21.15.26:0/2870025605 shutdown_connections 2021-11-03T18:07:12.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.105+0000 7f6de759e700 1 -- 172.21.15.26:0/2870025605 wait complete. 2021-11-03T18:07:12.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.106+0000 7f6de759e700 1 Processor -- start 2021-11-03T18:07:12.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.106+0000 7f6de759e700 1 -- start start 2021-11-03T18:07:12.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.106+0000 7f6de759e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6de80f6530 0x7f6de8106da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:07:12.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.106+0000 7f6de759e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6de80f77d0 0x7f6de8107290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:07:12.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.106+0000 7f6de759e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de8107920 con 0x7f6de80f6530 2021-11-03T18:07:12.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.106+0000 7f6de759e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de81080d0 con 0x7f6de80f77d0 2021-11-03T18:07:12.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.106+0000 7f6de659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6de80f6530 0x7f6de8106da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:07:12.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.106+0000 7f6de659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6de80f6530 0x7f6de8106da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58224/0 (socket says 172.21.15.26:58224) 2021-11-03T18:07:12.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.106+0000 7f6de659c700 1 -- 172.21.15.26:0/849427837 learned_addr learned my addr 172.21.15.26:0/849427837 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:07:12.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.106+0000 7f6de5d9b700 1 --2- 172.21.15.26:0/849427837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6de80f77d0 0x7f6de8107290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:07:12.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.106+0000 7f6de659c700 1 -- 172.21.15.26:0/849427837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6de80f77d0 msgr2=0x7f6de8107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:07:12.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.106+0000 7f6de659c700 1 --2- 172.21.15.26:0/849427837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6de80f77d0 0x7f6de8107290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:12.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.106+0000 7f6de659c700 1 -- 172.21.15.26:0/849427837 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd8005040 con 0x7f6de80f6530 2021-11-03T18:07:12.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.106+0000 7f6de5d9b700 1 --2- 172.21.15.26:0/849427837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6de80f77d0 0x7f6de8107290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:07:12.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.107+0000 7f6de659c700 1 --2- 172.21.15.26:0/849427837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6de80f6530 0x7f6de8106da0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7f6dd8000c00 tx=0x7f6dd8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:07:12.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.107+0000 7f6dd6ffd700 1 -- 172.21.15.26:0/849427837 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6dd8018070 con 0x7f6de80f6530 2021-11-03T18:07:12.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.107+0000 7f6dd6ffd700 1 -- 172.21.15.26:0/849427837 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6dd8007d70 con 0x7f6de80f6530 2021-11-03T18:07:12.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.107+0000 7f6de759e700 1 -- 172.21.15.26:0/849427837 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6de8108350 con 0x7f6de80f6530 2021-11-03T18:07:12.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.107+0000 7f6dd6ffd700 1 -- 172.21.15.26:0/849427837 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6dd801c620 con 0x7f6de80f6530 2021-11-03T18:07:12.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.107+0000 7f6de759e700 1 -- 172.21.15.26:0/849427837 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de81088b0 con 0x7f6de80f6530 2021-11-03T18:07:12.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.108+0000 7f6de759e700 1 -- 172.21.15.26:0/849427837 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6de8059100 con 0x7f6de80f6530 2021-11-03T18:07:12.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.108+0000 7f6dd6ffd700 1 -- 172.21.15.26:0/849427837 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f6dd801d420 con 0x7f6de80f6530 2021-11-03T18:07:12.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.108+0000 7f6dd6ffd700 1 --2- 172.21.15.26:0/849427837 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6dd0064100 0x7f6dd00665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:07:12.113 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.109+0000 7f6dd6ffd700 1 -- 172.21.15.26:0/849427837 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f6dd8082590 con 0x7f6de80f6530 2021-11-03T18:07:12.113 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.109+0000 7f6de5d9b700 1 --2- 172.21.15.26:0/849427837 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6dd0064100 0x7f6dd00665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:07:12.113 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.109+0000 7f6de5d9b700 1 --2- 172.21.15.26:0/849427837 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6dd0064100 0x7f6dd00665c0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7f6de8106b30 tx=0x7f6ddc008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:07:12.113 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.113+0000 7f6dd6ffd700 1 -- 172.21.15.26:0/849427837 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f6dd80549b0 con 0x7f6de80f6530 2021-11-03T18:07:12.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:11 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:07:12.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:11 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:07:12.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:11 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:07:12.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:11 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:07:12.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.284+0000 7f6de759e700 1 -- 172.21.15.26:0/849427837 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6de80fee50 con 0x7f6dd0064100 2021-11-03T18:07:12.296 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.299+0000 7f6dd6ffd700 1 -- 172.21.15.26:0/849427837 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f6de80fee50 con 0x7f6dd0064100 2021-11-03T18:07:12.296 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:07:12.297 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (78m) 7m ago 79m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:07:12.297 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (70m) 7m ago 79m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:07:12.297 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (70m) 6m ago 78m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:07:12.297 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (78m) 7m ago 79m 41.7M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:07:12.297 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (71m) 7m ago 74m 25.6M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:07:12.298 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (71m) 7m ago 74m 26.2M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:07:12.298 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (74m) 6m ago 74m 26.4M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:07:12.298 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (74m) 6m ago 74m 26.8M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:07:12.298 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (72m) 7m ago 81m 561M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:07:12.299 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (71m) 6m ago 78m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:07:12.299 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (71m) 7m ago 81m 276M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:07:12.299 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (71m) 6m ago 78m 132M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:07:12.299 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (79m) 7m ago 79m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:07:12.299 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (78m) 6m ago 78m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:07:12.300 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (70m) 7m ago 78m 292M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:07:12.300 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (69m) 7m ago 77m 313M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:07:12.300 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (69m) 7m ago 77m 261M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:07:12.300 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (68m) 6m ago 77m 337M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:07:12.301 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (68m) 6m ago 76m 283M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:07:12.301 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (67m) 6m ago 76m 276M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:07:12.301 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (78m) 7m ago 79m 61.2M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:07:12.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.301+0000 7f6de759e700 1 -- 172.21.15.26:0/849427837 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6dd0064100 msgr2=0x7f6dd00665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:07:12.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.301+0000 7f6de759e700 1 --2- 172.21.15.26:0/849427837 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6dd0064100 0x7f6dd00665c0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7f6de8106b30 tx=0x7f6ddc008040).stop 2021-11-03T18:07:12.303 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.301+0000 7f6de759e700 1 -- 172.21.15.26:0/849427837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6de80f6530 msgr2=0x7f6de8106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:07:12.303 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.301+0000 7f6de759e700 1 --2- 172.21.15.26:0/849427837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6de80f6530 0x7f6de8106da0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7f6dd8000c00 tx=0x7f6dd8009b30).stop 2021-11-03T18:07:12.303 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.301+0000 7f6de759e700 1 -- 172.21.15.26:0/849427837 shutdown_connections 2021-11-03T18:07:12.303 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.301+0000 7f6de759e700 1 --2- 172.21.15.26:0/849427837 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6dd0064100 0x7f6dd00665c0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:12.303 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.301+0000 7f6de759e700 1 --2- 172.21.15.26:0/849427837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6de80f6530 0x7f6de8106da0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:12.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.301+0000 7f6de759e700 1 --2- 172.21.15.26:0/849427837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6de80f77d0 0x7f6de8107290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:12.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.301+0000 7f6de759e700 1 -- 172.21.15.26:0/849427837 >> 172.21.15.26:0/849427837 conn(0x7f6de80f1cd0 msgr2=0x7f6de80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:07:12.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.301+0000 7f6de759e700 1 -- 172.21.15.26:0/849427837 shutdown_connections 2021-11-03T18:07:12.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.301+0000 7f6de759e700 1 -- 172.21.15.26:0/849427837 wait complete. 2021-11-03T18:07:12.399 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.400+0000 7f1bffe44700 1 -- 172.21.15.26:0/3955097476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bf80f5ef0 msgr2=0x7f1bf80f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:07:12.400 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.400+0000 7f1bffe44700 1 --2- 172.21.15.26:0/3955097476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bf80f5ef0 0x7f1bf80f6920 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7f1bec004660 tx=0x7f1bec009b30).stop 2021-11-03T18:07:12.400 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.400+0000 7f1bffe44700 1 -- 172.21.15.26:0/3955097476 shutdown_connections 2021-11-03T18:07:12.400 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.400+0000 7f1bffe44700 1 --2- 172.21.15.26:0/3955097476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bf80f5ef0 0x7f1bf80f6920 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:12.400 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.400+0000 7f1bffe44700 1 --2- 172.21.15.26:0/3955097476 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bf80f55e0 0x7f1bf80f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:07:12.401 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.400+0000 7f1bffe44700 1 -- 172.21.15.26:0/3955097476 >> 172.21.15.26:0/3955097476 conn(0x7f1bf80f0de0 msgr2=0x7f1bf80f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:07:12.401 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.400+0000 7f1bffe44700 1 -- 172.21.15.26:0/3955097476 shutdown_connections 2021-11-03T18:07:12.401 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.400+0000 7f1bffe44700 1 -- 172.21.15.26:0/3955097476 wait complete. 2021-11-03T18:07:12.401 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.401+0000 7f1bffe44700 1 Processor -- start 2021-11-03T18:07:12.401 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.401+0000 7f1bffe44700 1 -- start start 2021-11-03T18:07:12.402 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.401+0000 7f1bffe44700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bf80f55e0 0x7f1bf8105e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:07:12.402 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.401+0000 7f1bffe44700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bf80f5ef0 0x7f1bf8106380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:07:12.402 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.401+0000 7f1bffe44700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf81069c0 con 0x7f1bf80f55e0 2021-11-03T18:07:12.402 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.401+0000 7f1bffe44700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf8107270 con 0x7f1bf80f5ef0 2021-11-03T18:07:12.403 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.401+0000 7f1bfdbe0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bf80f55e0 0x7f1bf8105e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:07:12.403 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.401+0000 7f1bfdbe0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bf80f55e0 0x7f1bf8105e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58234/0 (socket says 172.21.15.26:58234) 2021-11-03T18:07:12.403 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.401+0000 7f1bfdbe0700 1 -- 172.21.15.26:0/2859724230 learned_addr learned my addr 172.21.15.26:0/2859724230 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:07:12.403 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.401+0000 7f1bfd3df700 1 --2- 172.21.15.26:0/2859724230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bf80f5ef0 0x7f1bf8106380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:07:12.403 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.401+0000 7f1bfdbe0700 1 -- 172.21.15.26:0/2859724230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bf80f5ef0 msgr2=0x7f1bf8106380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:07:12.404 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.401+0000 7f1bfdbe0700 1 --2- 172.21.15.26:0/2859724230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bf80f5ef0 0x7f1bf8106380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:12.404 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.401+0000 7f1bfdbe0700 1 -- 172.21.15.26:0/2859724230 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bec005040 con 0x7f1bf80f55e0 2021-11-03T18:07:12.404 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.402+0000 7f1bfdbe0700 1 --2- 172.21.15.26:0/2859724230 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bf80f55e0 0x7f1bf8105e90 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f1bf000b790 tx=0x7f1bf00092d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:07:12.404 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.402+0000 7f1bf67fc700 1 -- 172.21.15.26:0/2859724230 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bf000d780 con 0x7f1bf80f55e0 2021-11-03T18:07:12.405 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.402+0000 7f1bffe44700 1 -- 172.21.15.26:0/2859724230 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bf8107550 con 0x7f1bf80f55e0 2021-11-03T18:07:12.405 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.402+0000 7f1bf67fc700 1 -- 172.21.15.26:0/2859724230 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1bf000dd90 con 0x7f1bf80f55e0 2021-11-03T18:07:12.405 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.402+0000 7f1bf67fc700 1 -- 172.21.15.26:0/2859724230 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bf000e360 con 0x7f1bf80f55e0 2021-11-03T18:07:12.405 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.402+0000 7f1bffe44700 1 -- 172.21.15.26:0/2859724230 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bf8107b10 con 0x7f1bf80f55e0 2021-11-03T18:07:12.406 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.403+0000 7f1bffe44700 1 -- 172.21.15.26:0/2859724230 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bf80f4a70 con 0x7f1bf80f55e0 2021-11-03T18:07:12.407 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.403+0000 7f1bf67fc700 1 -- 172.21.15.26:0/2859724230 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f1bf000d8e0 con 0x7f1bf80f55e0 2021-11-03T18:07:12.407 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.404+0000 7f1bf67fc700 1 --2- 172.21.15.26:0/2859724230 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1be00640b0 0x7f1be0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:07:12.407 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.404+0000 7f1bf67fc700 1 -- 172.21.15.26:0/2859724230 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f1bf00812d0 con 0x7f1bf80f55e0 2021-11-03T18:07:12.407 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.404+0000 7f1bfd3df700 1 --2- 172.21.15.26:0/2859724230 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1be00640b0 0x7f1be0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:07:12.408 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.404+0000 7f1bfd3df700 1 --2- 172.21.15.26:0/2859724230 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1be00640b0 0x7f1be0066570 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f1bec004e30 tx=0x7f1bec009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:07:12.408 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.408+0000 7f1bf67fc700 1 -- 172.21.15.26:0/2859724230 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f1bf0053540 con 0x7f1bf80f55e0 2021-11-03T18:07:12.635 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.638+0000 7f1bffe44700 1 -- 172.21.15.26:0/2859724230 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1bf80fde50 con 0x7f1bf80f55e0 2021-11-03T18:07:12.636 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.639+0000 7f1bf67fc700 1 -- 172.21.15.26:0/2859724230 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f1bf0053130 con 0x7f1bf80f55e0 2021-11-03T18:07:12.636 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:07:12.637 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:07:12.637 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:07:12.637 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:07:12.637 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:07:12.638 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:07:12.638 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:07:12.638 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:07:12.638 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:07:12.639 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:07:12.639 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:07:12.639 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:07:12.639 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:07:12.639 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:07:12.640 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:07:12.640 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:07:12.640 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:07:12.640 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:07:12.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.640+0000 7f1bffe44700 1 -- 172.21.15.26:0/2859724230 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1be00640b0 msgr2=0x7f1be0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:07:12.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.640+0000 7f1bffe44700 1 --2- 172.21.15.26:0/2859724230 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1be00640b0 0x7f1be0066570 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f1bec004e30 tx=0x7f1bec009b30).stop 2021-11-03T18:07:12.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.640+0000 7f1bffe44700 1 -- 172.21.15.26:0/2859724230 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bf80f55e0 msgr2=0x7f1bf8105e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:07:12.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.640+0000 7f1bffe44700 1 --2- 172.21.15.26:0/2859724230 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bf80f55e0 0x7f1bf8105e90 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f1bf000b790 tx=0x7f1bf00092d0).stop 2021-11-03T18:07:12.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.641+0000 7f1bffe44700 1 -- 172.21.15.26:0/2859724230 shutdown_connections 2021-11-03T18:07:12.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.641+0000 7f1bffe44700 1 --2- 172.21.15.26:0/2859724230 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1be00640b0 0x7f1be0066570 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:12.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.641+0000 7f1bffe44700 1 --2- 172.21.15.26:0/2859724230 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bf80f55e0 0x7f1bf8105e90 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:12.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.641+0000 7f1bffe44700 1 --2- 172.21.15.26:0/2859724230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bf80f5ef0 0x7f1bf8106380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:12.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.641+0000 7f1bffe44700 1 -- 172.21.15.26:0/2859724230 >> 172.21.15.26:0/2859724230 conn(0x7f1bf80f0de0 msgr2=0x7f1bf80fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:07:12.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.641+0000 7f1bffe44700 1 -- 172.21.15.26:0/2859724230 shutdown_connections 2021-11-03T18:07:12.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.641+0000 7f1bffe44700 1 -- 172.21.15.26:0/2859724230 wait complete. 2021-11-03T18:07:12.740 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.741+0000 7f02dfdaa700 1 -- 172.21.15.26:0/2514154403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02d80f4a40 msgr2=0x7f02d80f4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:07:12.740 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.741+0000 7f02dfdaa700 1 --2- 172.21.15.26:0/2514154403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02d80f4a40 0x7f02d80f4e60 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f02c8004660 tx=0x7f02c8009b30).stop 2021-11-03T18:07:12.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.741+0000 7f02dfdaa700 1 -- 172.21.15.26:0/2514154403 shutdown_connections 2021-11-03T18:07:12.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.741+0000 7f02dfdaa700 1 --2- 172.21.15.26:0/2514154403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02d80f53e0 0x7f02d80f7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:12.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.741+0000 7f02dfdaa700 1 --2- 172.21.15.26:0/2514154403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02d80f4a40 0x7f02d80f4e60 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:12.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.741+0000 7f02dfdaa700 1 -- 172.21.15.26:0/2514154403 >> 172.21.15.26:0/2514154403 conn(0x7f02d80f04c0 msgr2=0x7f02d80f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:07:12.742 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.741+0000 7f02dfdaa700 1 -- 172.21.15.26:0/2514154403 shutdown_connections 2021-11-03T18:07:12.742 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.741+0000 7f02dfdaa700 1 -- 172.21.15.26:0/2514154403 wait complete. 2021-11-03T18:07:12.742 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.741+0000 7f02dfdaa700 1 Processor -- start 2021-11-03T18:07:12.742 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.741+0000 7f02dfdaa700 1 -- start start 2021-11-03T18:07:12.742 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.742+0000 7f02dfdaa700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02d80f4a40 0x7f02d81071a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:07:12.743 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.742+0000 7f02dfdaa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02d80f53e0 0x7f02d8107690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:07:12.743 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.742+0000 7f02dfdaa700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d8107c40 con 0x7f02d80f53e0 2021-11-03T18:07:12.743 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.742+0000 7f02dfdaa700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d8107d80 con 0x7f02d80f4a40 2021-11-03T18:07:12.743 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.742+0000 7f02dd345700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02d80f53e0 0x7f02d8107690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:07:12.744 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.742+0000 7f02dd345700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02d80f53e0 0x7f02d8107690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58246/0 (socket says 172.21.15.26:58246) 2021-11-03T18:07:12.744 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.742+0000 7f02dd345700 1 -- 172.21.15.26:0/3135455943 learned_addr learned my addr 172.21.15.26:0/3135455943 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:07:12.744 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.742+0000 7f02ddb46700 1 --2- 172.21.15.26:0/3135455943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02d80f4a40 0x7f02d81071a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:07:12.744 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.742+0000 7f02dd345700 1 -- 172.21.15.26:0/3135455943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02d80f4a40 msgr2=0x7f02d81071a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:07:12.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.742+0000 7f02dd345700 1 --2- 172.21.15.26:0/3135455943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02d80f4a40 0x7f02d81071a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:12.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.742+0000 7f02dd345700 1 -- 172.21.15.26:0/3135455943 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c8005040 con 0x7f02d80f53e0 2021-11-03T18:07:12.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.742+0000 7f02dd345700 1 --2- 172.21.15.26:0/3135455943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02d80f53e0 0x7f02d8107690 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 rx=0x7f02d4002700 tx=0x7f02d4009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:07:12.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.742+0000 7f02ce7fc700 1 -- 172.21.15.26:0/3135455943 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02d40079c0 con 0x7f02d80f53e0 2021-11-03T18:07:12.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.742+0000 7f02ce7fc700 1 -- 172.21.15.26:0/3135455943 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f02d400f040 con 0x7f02d80f53e0 2021-11-03T18:07:12.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.742+0000 7f02dfdaa700 1 -- 172.21.15.26:0/3135455943 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02d8108720 con 0x7f02d80f53e0 2021-11-03T18:07:12.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.742+0000 7f02ce7fc700 1 -- 172.21.15.26:0/3135455943 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02d4014860 con 0x7f02d80f53e0 2021-11-03T18:07:12.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.742+0000 7f02dfdaa700 1 -- 172.21.15.26:0/3135455943 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02d8108ce0 con 0x7f02d80f53e0 2021-11-03T18:07:12.747 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.743+0000 7f02dfdaa700 1 -- 172.21.15.26:0/3135455943 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02d8045ad0 con 0x7f02d80f53e0 2021-11-03T18:07:12.748 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.744+0000 7f02ce7fc700 1 -- 172.21.15.26:0/3135455943 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f02d401b060 con 0x7f02d80f53e0 2021-11-03T18:07:12.748 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.744+0000 7f02ce7fc700 1 --2- 172.21.15.26:0/3135455943 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f02c40640b0 0x7f02c4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:07:12.748 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.745+0000 7f02ddb46700 1 --2- 172.21.15.26:0/3135455943 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f02c40640b0 0x7f02c4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:07:12.748 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.745+0000 7f02ce7fc700 1 -- 172.21.15.26:0/3135455943 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f02d4080670 con 0x7f02d80f53e0 2021-11-03T18:07:12.748 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.745+0000 7f02ddb46700 1 --2- 172.21.15.26:0/3135455943 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f02c40640b0 0x7f02c4066570 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f02c8004630 tx=0x7f02c8009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:07:12.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.749+0000 7f02ce7fc700 1 -- 172.21.15.26:0/3135455943 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f02d40529d0 con 0x7f02d80f53e0 2021-11-03T18:07:12.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.956+0000 7f02dfdaa700 1 -- 172.21.15.26:0/3135455943 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f02d80ff0f0 con 0x7f02d80f53e0 2021-11-03T18:07:12.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.956+0000 7f02ce7fc700 1 -- 172.21.15.26:0/3135455943 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f02d4019070 con 0x7f02d80f53e0 2021-11-03T18:07:12.954 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:07:12.954 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:07:12.954 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:07:12.955 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:07:12.955 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:07:12.955 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:07:12.955 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:07:12.956 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:07:12.956 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:07:12.956 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:07:12.956 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:07:12.956 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:07:12.957 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:07:12.957 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:07:12.957 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:07:12.957 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:07:12.958 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:07:12.958 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:07:12.958 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:07:12.958 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:07:12.959 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:07:12.959 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:07:12.959 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:07:12.959 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:07:12.959 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:07:12.960 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:07:12.960 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:07:12.960 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:07:12.960 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:07:12.961 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:07:12.961 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:07:12.961 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:07:12.961 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:07:12.962 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:07:12.962 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:07:12.962 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:07:12.962 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:07:12.962 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:07:12.963 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:07:12.964 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.958+0000 7f02dfdaa700 1 -- 172.21.15.26:0/3135455943 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f02c40640b0 msgr2=0x7f02c4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:07:12.964 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.958+0000 7f02dfdaa700 1 --2- 172.21.15.26:0/3135455943 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f02c40640b0 0x7f02c4066570 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f02c8004630 tx=0x7f02c8009b30).stop 2021-11-03T18:07:12.964 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.958+0000 7f02dfdaa700 1 -- 172.21.15.26:0/3135455943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02d80f53e0 msgr2=0x7f02d8107690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:07:12.964 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.958+0000 7f02dfdaa700 1 --2- 172.21.15.26:0/3135455943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02d80f53e0 0x7f02d8107690 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 rx=0x7f02d4002700 tx=0x7f02d4009d80).stop 2021-11-03T18:07:12.965 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.958+0000 7f02dfdaa700 1 -- 172.21.15.26:0/3135455943 shutdown_connections 2021-11-03T18:07:12.965 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.958+0000 7f02dfdaa700 1 --2- 172.21.15.26:0/3135455943 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f02c40640b0 0x7f02c4066570 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:12.965 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.958+0000 7f02dfdaa700 1 --2- 172.21.15.26:0/3135455943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02d80f4a40 0x7f02d81071a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:12.965 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.958+0000 7f02dfdaa700 1 --2- 172.21.15.26:0/3135455943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02d80f53e0 0x7f02d8107690 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:12.966 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.958+0000 7f02dfdaa700 1 -- 172.21.15.26:0/3135455943 >> 172.21.15.26:0/3135455943 conn(0x7f02d80f04c0 msgr2=0x7f02d80fb770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:07:12.966 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.958+0000 7f02dfdaa700 1 -- 172.21.15.26:0/3135455943 shutdown_connections 2021-11-03T18:07:12.966 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:12.958+0000 7f02dfdaa700 1 -- 172.21.15.26:0/3135455943 wait complete. 2021-11-03T18:07:12.966 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:07:13.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:12 smithi026 ceph-mon[96795]: pgmap v2176: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:13.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:12 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2859724230' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:07:13.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:12 smithi194 ceph-mon[65619]: pgmap v2176: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:13.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:12 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2859724230' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:07:14.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:13 smithi026 ceph-mon[96795]: from='client.36380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:07:14.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:13 smithi026 ceph-mon[96795]: from='client.36384 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:07:14.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:13 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3135455943' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:07:14.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:13 smithi194 ceph-mon[65619]: from='client.36380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:07:14.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:13 smithi194 ceph-mon[65619]: from='client.36384 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:07:14.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:13 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3135455943' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:07:15.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:14 smithi026 ceph-mon[96795]: pgmap v2177: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:15.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:14 smithi194 ceph-mon[65619]: pgmap v2177: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:17.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:16 smithi026 ceph-mon[96795]: pgmap v2178: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:17.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:16 smithi194 ceph-mon[65619]: pgmap v2178: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:19.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:18 smithi026 ceph-mon[96795]: pgmap v2179: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:19.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:18 smithi194 ceph-mon[65619]: pgmap v2179: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:21.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:20 smithi194 ceph-mon[65619]: pgmap v2180: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:21.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:20 smithi026 ceph-mon[96795]: pgmap v2180: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:23.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:22 smithi194 ceph-mon[65619]: pgmap v2181: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:23.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:22 smithi026 ceph-mon[96795]: pgmap v2181: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:25.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:24 smithi194 ceph-mon[65619]: pgmap v2182: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:25.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:24 smithi026 ceph-mon[96795]: pgmap v2182: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:26.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:07:26.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:07:27.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:26 smithi194 ceph-mon[65619]: pgmap v2183: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:27.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:26 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:07:27.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:26 smithi026 ceph-mon[96795]: pgmap v2183: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:27.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:26 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:07:29.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:28 smithi194 ceph-mon[65619]: pgmap v2184: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:29.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:28 smithi026 ceph-mon[96795]: pgmap v2184: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:31.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:30 smithi194 ceph-mon[65619]: pgmap v2185: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:31.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:30 smithi026 ceph-mon[96795]: pgmap v2185: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:33.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:32 smithi194 ceph-mon[65619]: pgmap v2186: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:33.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:32 smithi026 ceph-mon[96795]: pgmap v2186: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:35.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:34 smithi194 ceph-mon[65619]: pgmap v2187: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:35.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:34 smithi026 ceph-mon[96795]: pgmap v2187: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:37.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:36 smithi194 ceph-mon[65619]: pgmap v2188: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:37.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:36 smithi026 ceph-mon[96795]: pgmap v2188: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:38.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:37 smithi194 ceph-mon[65619]: pgmap v2189: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:38.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:37 smithi026 ceph-mon[96795]: pgmap v2189: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:40.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:40 smithi026 ceph-mon[96795]: pgmap v2190: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:40.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:40 smithi194 ceph-mon[65619]: pgmap v2190: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:41.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:07:41.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:41 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:07:41.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:07:42.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:41 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:07:42.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:42 smithi026 ceph-mon[96795]: pgmap v2191: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:42.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:42 smithi194 ceph-mon[65619]: pgmap v2191: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:43.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.072+0000 7f00ae857700 1 -- 172.21.15.26:0/79827402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00a80f7490 msgr2=0x7f00a80f9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:07:43.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.072+0000 7f00ae857700 1 --2- 172.21.15.26:0/79827402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00a80f7490 0x7f00a80f9920 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f0098004660 tx=0x7f0098009b30).stop 2021-11-03T18:07:43.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.072+0000 7f00ae857700 1 -- 172.21.15.26:0/79827402 shutdown_connections 2021-11-03T18:07:43.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.072+0000 7f00ae857700 1 --2- 172.21.15.26:0/79827402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00a80f7490 0x7f00a80f9920 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:43.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.072+0000 7f00ae857700 1 --2- 172.21.15.26:0/79827402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00a8060310 0x7f00a80f6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:43.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.072+0000 7f00ae857700 1 -- 172.21.15.26:0/79827402 >> 172.21.15.26:0/79827402 conn(0x7f00a80f0ba0 msgr2=0x7f00a80f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:07:43.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.072+0000 7f00ae857700 1 -- 172.21.15.26:0/79827402 shutdown_connections 2021-11-03T18:07:43.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.072+0000 7f00ae857700 1 -- 172.21.15.26:0/79827402 wait complete. 2021-11-03T18:07:43.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.072+0000 7f00ae857700 1 Processor -- start 2021-11-03T18:07:43.075 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.072+0000 7f00ae857700 1 -- start start 2021-11-03T18:07:43.075 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.073+0000 7f00ae857700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00a8060310 0x7f00a810d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:07:43.075 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.073+0000 7f00ae857700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00a80f7490 0x7f00a810d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:07:43.075 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.073+0000 7f00ae857700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a810dcc0 con 0x7f00a8060310 2021-11-03T18:07:43.076 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.073+0000 7f00ae857700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a810de00 con 0x7f00a80f7490 2021-11-03T18:07:43.076 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.073+0000 7f00ad855700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00a8060310 0x7f00a810d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:07:43.076 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.073+0000 7f00ad855700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00a8060310 0x7f00a810d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58262/0 (socket says 172.21.15.26:58262) 2021-11-03T18:07:43.076 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.073+0000 7f00ad855700 1 -- 172.21.15.26:0/4240398343 learned_addr learned my addr 172.21.15.26:0/4240398343 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:07:43.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.073+0000 7f00ad054700 1 --2- 172.21.15.26:0/4240398343 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00a80f7490 0x7f00a810d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:07:43.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.073+0000 7f00ad855700 1 -- 172.21.15.26:0/4240398343 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00a80f7490 msgr2=0x7f00a810d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:07:43.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.073+0000 7f00ad855700 1 --2- 172.21.15.26:0/4240398343 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00a80f7490 0x7f00a810d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:43.078 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.073+0000 7f00ad855700 1 -- 172.21.15.26:0/4240398343 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0098005040 con 0x7f00a8060310 2021-11-03T18:07:43.078 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.073+0000 7f00ad855700 1 --2- 172.21.15.26:0/4240398343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00a8060310 0x7f00a810d220 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7f00a400e7f0 tx=0x7f00a400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:07:43.078 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.073+0000 7f009e7fc700 1 -- 172.21.15.26:0/4240398343 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00a40092e0 con 0x7f00a8060310 2021-11-03T18:07:43.078 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.073+0000 7f00ae857700 1 -- 172.21.15.26:0/4240398343 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00a810e7a0 con 0x7f00a8060310 2021-11-03T18:07:43.078 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.073+0000 7f009e7fc700 1 -- 172.21.15.26:0/4240398343 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f00a400f040 con 0x7f00a8060310 2021-11-03T18:07:43.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.073+0000 7f009e7fc700 1 -- 172.21.15.26:0/4240398343 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00a4014750 con 0x7f00a8060310 2021-11-03T18:07:43.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.074+0000 7f00ae857700 1 -- 172.21.15.26:0/4240398343 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00a810ed60 con 0x7f00a8060310 2021-11-03T18:07:43.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.074+0000 7f00ae857700 1 -- 172.21.15.26:0/4240398343 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00a8045ad0 con 0x7f00a8060310 2021-11-03T18:07:43.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.075+0000 7f009e7fc700 1 -- 172.21.15.26:0/4240398343 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f00a401b030 con 0x7f00a8060310 2021-11-03T18:07:43.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.075+0000 7f009e7fc700 1 --2- 172.21.15.26:0/4240398343 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0094064100 0x7f00940665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:07:43.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.075+0000 7f009e7fc700 1 -- 172.21.15.26:0/4240398343 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f00a4080680 con 0x7f00a8060310 2021-11-03T18:07:43.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.075+0000 7f00ad054700 1 --2- 172.21.15.26:0/4240398343 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0094064100 0x7f00940665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:07:43.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.076+0000 7f00ad054700 1 --2- 172.21.15.26:0/4240398343 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0094064100 0x7f00940665c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f0098005010 tx=0x7f0098016040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:07:43.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.080+0000 7f009e7fc700 1 -- 172.21.15.26:0/4240398343 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f00a40529a0 con 0x7f00a8060310 2021-11-03T18:07:43.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.258+0000 7f00ae857700 1 -- 172.21.15.26:0/4240398343 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f00a81054a0 con 0x7f0094064100 2021-11-03T18:07:43.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.260+0000 7f009e7fc700 1 -- 172.21.15.26:0/4240398343 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f009800f070 con 0x7f0094064100 2021-11-03T18:07:43.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.261+0000 7f00ae857700 1 -- 172.21.15.26:0/4240398343 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0094064100 msgr2=0x7f00940665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:07:43.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.261+0000 7f00ae857700 1 --2- 172.21.15.26:0/4240398343 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0094064100 0x7f00940665c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f0098005010 tx=0x7f0098016040).stop 2021-11-03T18:07:43.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.261+0000 7f00ae857700 1 -- 172.21.15.26:0/4240398343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00a8060310 msgr2=0x7f00a810d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:07:43.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.261+0000 7f00ae857700 1 --2- 172.21.15.26:0/4240398343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00a8060310 0x7f00a810d220 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7f00a400e7f0 tx=0x7f00a400b040).stop 2021-11-03T18:07:43.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.261+0000 7f00ae857700 1 -- 172.21.15.26:0/4240398343 shutdown_connections 2021-11-03T18:07:43.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.261+0000 7f00ae857700 1 --2- 172.21.15.26:0/4240398343 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0094064100 0x7f00940665c0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:43.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.261+0000 7f00ae857700 1 --2- 172.21.15.26:0/4240398343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00a8060310 0x7f00a810d220 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:43.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.261+0000 7f00ae857700 1 --2- 172.21.15.26:0/4240398343 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00a80f7490 0x7f00a810d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:43.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.261+0000 7f00ae857700 1 -- 172.21.15.26:0/4240398343 >> 172.21.15.26:0/4240398343 conn(0x7f00a80f0ba0 msgr2=0x7f00a80f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:07:43.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.262+0000 7f00ae857700 1 -- 172.21.15.26:0/4240398343 shutdown_connections 2021-11-03T18:07:43.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.262+0000 7f00ae857700 1 -- 172.21.15.26:0/4240398343 wait complete. 2021-11-03T18:07:43.269 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:07:43.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.361+0000 7fc49ef4a700 1 -- 172.21.15.26:0/779818308 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4980f4a40 msgr2=0x7fc4980f4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:07:43.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.361+0000 7fc49ef4a700 1 --2- 172.21.15.26:0/779818308 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4980f4a40 0x7fc4980f4e60 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7fc48c004660 tx=0x7fc48c009b30).stop 2021-11-03T18:07:43.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.361+0000 7fc49ef4a700 1 -- 172.21.15.26:0/779818308 shutdown_connections 2021-11-03T18:07:43.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.361+0000 7fc49ef4a700 1 --2- 172.21.15.26:0/779818308 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4980f53e0 0x7fc4980f7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:43.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.361+0000 7fc49ef4a700 1 --2- 172.21.15.26:0/779818308 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4980f4a40 0x7fc4980f4e60 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:43.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.361+0000 7fc49ef4a700 1 -- 172.21.15.26:0/779818308 >> 172.21.15.26:0/779818308 conn(0x7fc4980f04c0 msgr2=0x7fc4980f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:07:43.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.361+0000 7fc49ef4a700 1 -- 172.21.15.26:0/779818308 shutdown_connections 2021-11-03T18:07:43.363 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.361+0000 7fc49ef4a700 1 -- 172.21.15.26:0/779818308 wait complete. 2021-11-03T18:07:43.363 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.362+0000 7fc49ef4a700 1 Processor -- start 2021-11-03T18:07:43.363 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.362+0000 7fc49ef4a700 1 -- start start 2021-11-03T18:07:43.363 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.362+0000 7fc49ef4a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4980f4a40 0x7fc4980f7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:07:43.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.362+0000 7fc49ef4a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4980f53e0 0x7fc4980f5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:07:43.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.362+0000 7fc49ef4a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4980f6010 con 0x7fc4980f4a40 2021-11-03T18:07:43.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.362+0000 7fc49ef4a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4980f6150 con 0x7fc4980f53e0 2021-11-03T18:07:43.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.362+0000 7fc49cce6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4980f4a40 0x7fc4980f7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:07:43.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.362+0000 7fc49cce6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4980f4a40 0x7fc4980f7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58272/0 (socket says 172.21.15.26:58272) 2021-11-03T18:07:43.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.362+0000 7fc49cce6700 1 -- 172.21.15.26:0/2773370221 learned_addr learned my addr 172.21.15.26:0/2773370221 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:07:43.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.363+0000 7fc49cce6700 1 -- 172.21.15.26:0/2773370221 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4980f53e0 msgr2=0x7fc4980f5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:07:43.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.363+0000 7fc49cce6700 1 --2- 172.21.15.26:0/2773370221 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4980f53e0 0x7fc4980f5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:07:43.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.363+0000 7fc49cce6700 1 -- 172.21.15.26:0/2773370221 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc48c005040 con 0x7fc4980f4a40 2021-11-03T18:07:43.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.363+0000 7fc49cce6700 1 --2- 172.21.15.26:0/2773370221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4980f4a40 0x7fc4980f7630 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 rx=0x7fc48c009990 tx=0x7fc48c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:07:43.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.363+0000 7fc4957fa700 1 -- 172.21.15.26:0/2773370221 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc48c018070 con 0x7fc4980f4a40 2021-11-03T18:07:43.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.363+0000 7fc4957fa700 1 -- 172.21.15.26:0/2773370221 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc48c007ba0 con 0x7fc4980f4a40 2021-11-03T18:07:43.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.363+0000 7fc49ef4a700 1 -- 172.21.15.26:0/2773370221 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4980f63d0 con 0x7fc4980f4a40 2021-11-03T18:07:43.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.363+0000 7fc4957fa700 1 -- 172.21.15.26:0/2773370221 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc48c01c3c0 con 0x7fc4980f4a40 2021-11-03T18:07:43.367 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.363+0000 7fc49ef4a700 1 -- 172.21.15.26:0/2773370221 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4980f6930 con 0x7fc4980f4a40 2021-11-03T18:07:43.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.364+0000 7fc49ef4a700 1 -- 172.21.15.26:0/2773370221 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc498045ad0 con 0x7fc4980f4a40 2021-11-03T18:07:43.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.365+0000 7fc4957fa700 1 -- 172.21.15.26:0/2773370221 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc48c01d420 con 0x7fc4980f4a40 2021-11-03T18:07:43.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.365+0000 7fc4957fa700 1 --2- 172.21.15.26:0/2773370221 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc4880640b0 0x7fc488066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:07:43.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.365+0000 7fc4957fa700 1 -- 172.21.15.26:0/2773370221 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc48c0823e0 con 0x7fc4980f4a40 2021-11-03T18:07:43.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.365+0000 7fc497fff700 1 --2- 172.21.15.26:0/2773370221 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc4880640b0 0x7fc488066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:07:43.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.365+0000 7fc497fff700 1 --2- 172.21.15.26:0/2773370221 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc4880640b0 0x7fc488066570 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7fc4980f5860 tx=0x7fc484009ad0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:07:43.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.369+0000 7fc4957fa700 1 -- 172.21.15.26:0/2773370221 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc48c0547a0 con 0x7fc4980f4a40 2021-11-03T18:07:43.538 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.540+0000 7fc49ef4a700 1 -- 172.21.15.26:0/2773370221 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc4980ff0f0 con 0x7fc4880640b0 2021-11-03T18:07:43.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.554+0000 7fc4957fa700 1 -- 172.21.15.26:0/2773370221 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fc4980ff0f0 con 0x7fc4880640b0 2021-11-03T18:07:43.553 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:07:43.553 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (78m) 7m ago 80m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:07:43.553 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (71m) 7m ago 80m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:07:43.554 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (71m) 6m ago 79m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:07:43.554 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (78m) 7m ago 79m 41.7M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:07:43.554 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (71m) 7m ago 75m 25.6M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:07:43.554 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (72m) 7m ago 75m 26.2M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:07:43.555 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (75m) 6m ago 75m 26.4M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:07:43.555 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (75m) 6m ago 75m 26.8M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:07:43.555 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (72m) 7m ago 81m 561M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:07:43.555 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (72m) 6m ago 79m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:07:43.556 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (72m) 7m ago 81m 276M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:07:43.556 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (71m) 6m ago 79m 132M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:07:43.556 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (79m) 7m ago 79m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:07:43.556 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (79m) 6m ago 79m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:07:43.556 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (70m) 7m ago 78m 292M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:07:43.557 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (70m) 7m ago 78m 313M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:07:43.557 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (69m) 7m ago 77m 261M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:07:43.557 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (69m) 6m ago 77m 337M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:07:43.557 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (68m) 6m ago 77m 283M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:07:43.558 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (68m) 6m ago 76m 276M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:07:43.558 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (78m) 7m ago 79m 61.2M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:07:43.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.556+0000 7fc49ef4a700 1 -- 172.21.15.26:0/2773370221 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc4880640b0 msgr2=0x7fc488066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:07:43.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.556+0000 7fc49ef4a700 1 --2- 172.21.15.26:0/2773370221 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc4880640b0 0x7fc488066570 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7fc4980f5860 tx=0x7fc484009ad0).stop 2021-11-03T18:07:43.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.556+0000 7fc49ef4a700 1 -- 172.21.15.26:0/2773370221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4980f4a40 msgr2=0x7fc4980f7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:07:43.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.556+0000 7fc49ef4a700 1 --2- 172.21.15.26:0/2773370221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4980f4a40 0x7fc4980f7630 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 rx=0x7fc48c009990 tx=0x7fc48c009b30).stop 2021-11-03T18:07:43.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.556+0000 7fc49ef4a700 1 -- 172.21.15.26:0/2773370221 shutdown_connections 2021-11-03T18:07:43.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.556+0000 7fc49ef4a700 1 --2- 172.21.15.26:0/2773370221 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc4880640b0 0x7fc488066570 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:43.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.556+0000 7fc49ef4a700 1 --2- 172.21.15.26:0/2773370221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4980f4a40 0x7fc4980f7630 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:43.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.556+0000 7fc49ef4a700 1 --2- 172.21.15.26:0/2773370221 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4980f53e0 0x7fc4980f5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:07:43.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.556+0000 7fc49ef4a700 1 -- 172.21.15.26:0/2773370221 >> 172.21.15.26:0/2773370221 conn(0x7fc4980f04c0 msgr2=0x7fc4980fb770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:07:43.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.556+0000 7fc49ef4a700 1 -- 172.21.15.26:0/2773370221 shutdown_connections 2021-11-03T18:07:43.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.556+0000 7fc49ef4a700 1 -- 172.21.15.26:0/2773370221 wait complete. 2021-11-03T18:07:43.655 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.655+0000 7f4b99793700 1 -- 172.21.15.26:0/1721042823 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b940f4800 msgr2=0x7f4b940f4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:07:43.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.655+0000 7f4b99793700 1 --2- 172.21.15.26:0/1721042823 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b940f4800 0x7f4b940f4c20 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 rx=0x7f4b84004660 tx=0x7f4b84009b30).stop 2021-11-03T18:07:43.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.655+0000 7f4b99793700 1 -- 172.21.15.26:0/1721042823 shutdown_connections 2021-11-03T18:07:43.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.655+0000 7f4b99793700 1 --2- 172.21.15.26:0/1721042823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b940f51a0 0x7f4b940f7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:07:43.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.655+0000 7f4b99793700 1 --2- 172.21.15.26:0/1721042823 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b940f4800 0x7f4b940f4c20 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:43.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.655+0000 7f4b99793700 1 -- 172.21.15.26:0/1721042823 >> 172.21.15.26:0/1721042823 conn(0x7f4b940f0320 msgr2=0x7f4b940f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:07:43.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.655+0000 7f4b99793700 1 -- 172.21.15.26:0/1721042823 shutdown_connections 2021-11-03T18:07:43.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.655+0000 7f4b99793700 1 -- 172.21.15.26:0/1721042823 wait complete. 2021-11-03T18:07:43.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.656+0000 7f4b99793700 1 Processor -- start 2021-11-03T18:07:43.658 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.656+0000 7f4b99793700 1 -- start start 2021-11-03T18:07:43.658 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.656+0000 7f4b99793700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b940f4800 0x7f4b94106e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:07:43.658 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.656+0000 7f4b99793700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b940f51a0 0x7f4b94107340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:07:43.658 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.656+0000 7f4b99793700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b941079d0 con 0x7f4b940f4800 2021-11-03T18:07:43.658 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.656+0000 7f4b99793700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b94108150 con 0x7f4b940f51a0 2021-11-03T18:07:43.659 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.656+0000 7f4b93fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b940f4800 0x7f4b94106e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:07:43.659 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.656+0000 7f4b93fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b940f4800 0x7f4b94106e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58282/0 (socket says 172.21.15.26:58282) 2021-11-03T18:07:43.659 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.656+0000 7f4b93fff700 1 -- 172.21.15.26:0/2589629125 learned_addr learned my addr 172.21.15.26:0/2589629125 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:07:43.659 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.656+0000 7f4b937fe700 1 --2- 172.21.15.26:0/2589629125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b940f51a0 0x7f4b94107340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:07:43.660 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.656+0000 7f4b93fff700 1 -- 172.21.15.26:0/2589629125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b940f51a0 msgr2=0x7f4b94107340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:07:43.660 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.657+0000 7f4b93fff700 1 --2- 172.21.15.26:0/2589629125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b940f51a0 0x7f4b94107340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:43.660 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.657+0000 7f4b93fff700 1 -- 172.21.15.26:0/2589629125 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b84005040 con 0x7f4b940f4800 2021-11-03T18:07:43.660 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.657+0000 7f4b937fe700 1 --2- 172.21.15.26:0/2589629125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b940f51a0 0x7f4b94107340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:07:43.661 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.657+0000 7f4b93fff700 1 --2- 172.21.15.26:0/2589629125 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b940f4800 0x7f4b94106e50 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7f4b84004f60 tx=0x7f4b84009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:07:43.661 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.657+0000 7f4b90ff9700 1 -- 172.21.15.26:0/2589629125 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b84018070 con 0x7f4b940f4800 2021-11-03T18:07:43.661 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.657+0000 7f4b99793700 1 -- 172.21.15.26:0/2589629125 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b94108370 con 0x7f4b940f4800 2021-11-03T18:07:43.661 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.657+0000 7f4b90ff9700 1 -- 172.21.15.26:0/2589629125 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4b84007ba0 con 0x7f4b940f4800 2021-11-03T18:07:43.661 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.657+0000 7f4b90ff9700 1 -- 172.21.15.26:0/2589629125 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b8401c620 con 0x7f4b940f4800 2021-11-03T18:07:43.662 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.657+0000 7f4b99793700 1 -- 172.21.15.26:0/2589629125 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b941088d0 con 0x7f4b940f4800 2021-11-03T18:07:43.663 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.658+0000 7f4b99793700 1 -- 172.21.15.26:0/2589629125 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b94059100 con 0x7f4b940f4800 2021-11-03T18:07:43.664 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.659+0000 7f4b90ff9700 1 -- 172.21.15.26:0/2589629125 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f4b8401c8e0 con 0x7f4b940f4800 2021-11-03T18:07:43.664 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.659+0000 7f4b90ff9700 1 --2- 172.21.15.26:0/2589629125 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4b7c064100 0x7f4b7c0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:07:43.664 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.659+0000 7f4b90ff9700 1 -- 172.21.15.26:0/2589629125 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f4b84082ba0 con 0x7f4b940f4800 2021-11-03T18:07:43.664 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.659+0000 7f4b937fe700 1 --2- 172.21.15.26:0/2589629125 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4b7c064100 0x7f4b7c0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:07:43.665 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.660+0000 7f4b937fe700 1 --2- 172.21.15.26:0/2589629125 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4b7c064100 0x7f4b7c0665c0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f4b940f55e0 tx=0x7f4b88008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:07:43.665 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.663+0000 7f4b90ff9700 1 -- 172.21.15.26:0/2589629125 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f4b84054f00 con 0x7f4b940f4800 2021-11-03T18:07:43.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.894+0000 7f4b99793700 1 -- 172.21.15.26:0/2589629125 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4b94027a00 con 0x7f4b940f4800 2021-11-03T18:07:43.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.895+0000 7f4b90ff9700 1 -- 172.21.15.26:0/2589629125 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f4b84054af0 con 0x7f4b940f4800 2021-11-03T18:07:43.894 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:07:43.894 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:07:43.894 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:07:43.895 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:07:43.895 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:07:43.895 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:07:43.895 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:07:43.896 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:07:43.896 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:07:43.896 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:07:43.896 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:07:43.897 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:07:43.897 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:07:43.897 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:07:43.897 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:07:43.898 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:07:43.898 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:07:43.898 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:07:43.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.897+0000 7f4b99793700 1 -- 172.21.15.26:0/2589629125 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4b7c064100 msgr2=0x7f4b7c0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:07:43.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.897+0000 7f4b99793700 1 --2- 172.21.15.26:0/2589629125 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4b7c064100 0x7f4b7c0665c0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f4b940f55e0 tx=0x7f4b88008040).stop 2021-11-03T18:07:43.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.897+0000 7f4b99793700 1 -- 172.21.15.26:0/2589629125 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b940f4800 msgr2=0x7f4b94106e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:07:43.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.897+0000 7f4b99793700 1 --2- 172.21.15.26:0/2589629125 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b940f4800 0x7f4b94106e50 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7f4b84004f60 tx=0x7f4b84009b30).stop 2021-11-03T18:07:43.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.897+0000 7f4b99793700 1 -- 172.21.15.26:0/2589629125 shutdown_connections 2021-11-03T18:07:43.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.897+0000 7f4b99793700 1 --2- 172.21.15.26:0/2589629125 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4b7c064100 0x7f4b7c0665c0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:43.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.897+0000 7f4b99793700 1 --2- 172.21.15.26:0/2589629125 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b940f4800 0x7f4b94106e50 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:43.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.897+0000 7f4b99793700 1 --2- 172.21.15.26:0/2589629125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b940f51a0 0x7f4b94107340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:43.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.897+0000 7f4b99793700 1 -- 172.21.15.26:0/2589629125 >> 172.21.15.26:0/2589629125 conn(0x7f4b940f0320 msgr2=0x7f4b940fb370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:07:43.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.897+0000 7f4b99793700 1 -- 172.21.15.26:0/2589629125 shutdown_connections 2021-11-03T18:07:43.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.897+0000 7f4b99793700 1 -- 172.21.15.26:0/2589629125 wait complete. 2021-11-03T18:07:43.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.996+0000 7f94f5dcf700 1 -- 172.21.15.26:0/179269304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94f00f5440 msgr2=0x7f94f00f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:07:43.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.996+0000 7f94f5dcf700 1 --2- 172.21.15.26:0/179269304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94f00f5440 0x7f94f00f5860 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 rx=0x7f94e4004660 tx=0x7f94e4009b30).stop 2021-11-03T18:07:43.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.996+0000 7f94f5dcf700 1 -- 172.21.15.26:0/179269304 shutdown_connections 2021-11-03T18:07:43.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.996+0000 7f94f5dcf700 1 --2- 172.21.15.26:0/179269304 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94f00f66e0 0x7f94f00f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:43.997 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.996+0000 7f94f5dcf700 1 --2- 172.21.15.26:0/179269304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94f00f5440 0x7f94f00f5860 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:43.997 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.996+0000 7f94f5dcf700 1 -- 172.21.15.26:0/179269304 >> 172.21.15.26:0/179269304 conn(0x7f94f00f0ba0 msgr2=0x7f94f00f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:07:43.997 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.996+0000 7f94f5dcf700 1 -- 172.21.15.26:0/179269304 shutdown_connections 2021-11-03T18:07:43.997 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.996+0000 7f94f5dcf700 1 -- 172.21.15.26:0/179269304 wait complete. 2021-11-03T18:07:43.998 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.997+0000 7f94f5dcf700 1 Processor -- start 2021-11-03T18:07:43.998 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.997+0000 7f94f5dcf700 1 -- start start 2021-11-03T18:07:44.002 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.997+0000 7f94f5dcf700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94f00f5440 0x7f94f0109ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:07:44.003 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.997+0000 7f94f5dcf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94f00f66e0 0x7f94f010bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:07:44.003 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.997+0000 7f94f5dcf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f00603c0 con 0x7f94f00f66e0 2021-11-03T18:07:44.003 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.997+0000 7f94f5dcf700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f0060500 con 0x7f94f00f5440 2021-11-03T18:07:44.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.998+0000 7f94effff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94f00f66e0 0x7f94f010bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:07:44.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.998+0000 7f94effff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94f00f66e0 0x7f94f010bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58296/0 (socket says 172.21.15.26:58296) 2021-11-03T18:07:44.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.998+0000 7f94effff700 1 -- 172.21.15.26:0/1497630867 learned_addr learned my addr 172.21.15.26:0/1497630867 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:07:44.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.998+0000 7f94f4dcd700 1 --2- 172.21.15.26:0/1497630867 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94f00f5440 0x7f94f0109ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:07:44.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.998+0000 7f94effff700 1 -- 172.21.15.26:0/1497630867 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94f00f5440 msgr2=0x7f94f0109ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:07:44.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.998+0000 7f94effff700 1 --2- 172.21.15.26:0/1497630867 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94f00f5440 0x7f94f0109ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:44.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.998+0000 7f94effff700 1 -- 172.21.15.26:0/1497630867 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e4005040 con 0x7f94f00f66e0 2021-11-03T18:07:44.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.998+0000 7f94effff700 1 --2- 172.21.15.26:0/1497630867 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94f00f66e0 0x7f94f010bfc0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7f94dc0026d0 tx=0x7f94dc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:07:44.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.998+0000 7f94ed7fa700 1 -- 172.21.15.26:0/1497630867 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94dc009320 con 0x7f94f00f66e0 2021-11-03T18:07:44.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.998+0000 7f94ed7fa700 1 -- 172.21.15.26:0/1497630867 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f94dc00f040 con 0x7f94f00f66e0 2021-11-03T18:07:44.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.998+0000 7f94f5dcf700 1 -- 172.21.15.26:0/1497630867 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94f010c570 con 0x7f94f00f66e0 2021-11-03T18:07:44.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.998+0000 7f94ed7fa700 1 -- 172.21.15.26:0/1497630867 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94dc0147e0 con 0x7f94f00f66e0 2021-11-03T18:07:44.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.998+0000 7f94f5dcf700 1 -- 172.21.15.26:0/1497630867 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94f010cb00 con 0x7f94f00f66e0 2021-11-03T18:07:44.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:43.999+0000 7f94f5dcf700 1 -- 172.21.15.26:0/1497630867 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94f0059100 con 0x7f94f00f66e0 2021-11-03T18:07:44.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:44.000+0000 7f94ed7fa700 1 -- 172.21.15.26:0/1497630867 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f94dc009480 con 0x7f94f00f66e0 2021-11-03T18:07:44.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:44.000+0000 7f94ed7fa700 1 --2- 172.21.15.26:0/1497630867 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f94e0064100 0x7f94e00665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:07:44.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:44.000+0000 7f94ed7fa700 1 -- 172.21.15.26:0/1497630867 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f94dc080df0 con 0x7f94f00f66e0 2021-11-03T18:07:44.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:44.000+0000 7f94f4dcd700 1 --2- 172.21.15.26:0/1497630867 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f94e0064100 0x7f94e00665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:07:44.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:44.000+0000 7f94f4dcd700 1 --2- 172.21.15.26:0/1497630867 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f94e0064100 0x7f94e00665c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f94e4004e30 tx=0x7f94e4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:07:44.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:44.004+0000 7f94ed7fa700 1 -- 172.21.15.26:0/1497630867 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f94dc053210 con 0x7f94f00f66e0 2021-11-03T18:07:44.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:44.208+0000 7f94f5dcf700 1 -- 172.21.15.26:0/1497630867 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f94f0045ad0 con 0x7f94f00f66e0 2021-11-03T18:07:44.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:44.208+0000 7f94ed7fa700 1 -- 172.21.15.26:0/1497630867 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f94dc052e00 con 0x7f94f00f66e0 2021-11-03T18:07:44.208 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:07:44.209 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:07:44.209 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:07:44.209 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:07:44.209 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:07:44.210 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:07:44.210 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:07:44.210 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:07:44.210 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:07:44.211 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:07:44.211 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:07:44.211 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:07:44.211 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:07:44.211 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:07:44.212 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:07:44.212 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:07:44.212 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:07:44.212 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:07:44.213 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:07:44.213 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:07:44.213 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:07:44.214 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:07:44.214 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:07:44.214 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:07:44.214 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:07:44.215 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:07:44.215 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:07:44.215 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:07:44.215 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:07:44.216 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:07:44.216 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:07:44.216 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:07:44.216 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:07:44.217 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:07:44.217 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:07:44.217 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:07:44.217 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:07:44.217 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:07:44.218 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:07:44.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:44.210+0000 7f94f5dcf700 1 -- 172.21.15.26:0/1497630867 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f94e0064100 msgr2=0x7f94e00665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:07:44.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:44.210+0000 7f94f5dcf700 1 --2- 172.21.15.26:0/1497630867 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f94e0064100 0x7f94e00665c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f94e4004e30 tx=0x7f94e4009b30).stop 2021-11-03T18:07:44.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:44.210+0000 7f94f5dcf700 1 -- 172.21.15.26:0/1497630867 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94f00f66e0 msgr2=0x7f94f010bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:07:44.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:44.210+0000 7f94f5dcf700 1 --2- 172.21.15.26:0/1497630867 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94f00f66e0 0x7f94f010bfc0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7f94dc0026d0 tx=0x7f94dc009de0).stop 2021-11-03T18:07:44.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:44.210+0000 7f94f5dcf700 1 -- 172.21.15.26:0/1497630867 shutdown_connections 2021-11-03T18:07:44.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:44.210+0000 7f94f5dcf700 1 --2- 172.21.15.26:0/1497630867 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f94e0064100 0x7f94e00665c0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:44.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:44.210+0000 7f94f5dcf700 1 --2- 172.21.15.26:0/1497630867 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94f00f5440 0x7f94f0109ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:44.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:44.210+0000 7f94f5dcf700 1 --2- 172.21.15.26:0/1497630867 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94f00f66e0 0x7f94f010bfc0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:07:44.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:44.210+0000 7f94f5dcf700 1 -- 172.21.15.26:0/1497630867 >> 172.21.15.26:0/1497630867 conn(0x7f94f00f0ba0 msgr2=0x7f94f00fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:07:44.221 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:44.210+0000 7f94f5dcf700 1 -- 172.21.15.26:0/1497630867 shutdown_connections 2021-11-03T18:07:44.221 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:07:44.210+0000 7f94f5dcf700 1 -- 172.21.15.26:0/1497630867 wait complete. 2021-11-03T18:07:44.221 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:07:44.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:44 smithi026 ceph-mon[96795]: from='client.36396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:07:44.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:44 smithi026 ceph-mon[96795]: pgmap v2192: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:44.928 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:44 smithi026 ceph-mon[96795]: from='client.36400 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:07:44.928 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:44 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2589629125' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:07:44.928 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:44 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1497630867' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:07:44.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:44 smithi194 ceph-mon[65619]: from='client.36396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:07:45.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:44 smithi194 ceph-mon[65619]: pgmap v2192: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:45.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:44 smithi194 ceph-mon[65619]: from='client.36400 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:07:45.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:44 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2589629125' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:07:45.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:44 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1497630867' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:07:46.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:46 smithi026 ceph-mon[96795]: pgmap v2193: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:46.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:46 smithi194 ceph-mon[65619]: pgmap v2193: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:48.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:48 smithi026 ceph-mon[96795]: pgmap v2194: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:48.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:07:48.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:07:48.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:48 smithi194 ceph-mon[65619]: pgmap v2194: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:49.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:07:49.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:07:50.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:50 smithi026 ceph-mon[96795]: pgmap v2195: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:50.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:50 smithi194 ceph-mon[65619]: pgmap v2195: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:52.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:52 smithi026 ceph-mon[96795]: pgmap v2196: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:53.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:52 smithi194 ceph-mon[65619]: pgmap v2196: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:54.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:54 smithi026 ceph-mon[96795]: pgmap v2197: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:54.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:54 smithi194 ceph-mon[65619]: pgmap v2197: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:56.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:56 smithi026 ceph-mon[96795]: pgmap v2198: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:56.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:56 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:07:56.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:56 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2021-11-03T18:07:56.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:56 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi026", "name": "osd_memory_target"}]: dispatch 2021-11-03T18:07:56.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:56 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:07:56.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:56 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:07:56.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:56 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:07:56.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:56 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:07:56.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:56 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:07:56.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:56 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:07:56.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:56 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:07:56.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:56 smithi194 ceph-mon[65619]: pgmap v2198: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:57.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:56 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:07:57.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:56 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2021-11-03T18:07:57.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:56 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi026", "name": "osd_memory_target"}]: dispatch 2021-11-03T18:07:57.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:56 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:07:57.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:56 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:07:57.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:56 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:07:57.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:56 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:07:57.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:56 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:07:57.002 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:56 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:07:57.002 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:56 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:07:57.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:57 smithi026 ceph-mon[96795]: poll took 60085.048 ms: 1 events 2021-11-03T18:07:57.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:57 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:07:57.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:57 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:07:58.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:57 smithi194 ceph-mon[65619]: poll took 60085.048 ms: 1 events 2021-11-03T18:07:58.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:57 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:07:58.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:57 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:07:58.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:07:58 smithi026 ceph-mon[96795]: pgmap v2199: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:07:59.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:07:58 smithi194 ceph-mon[65619]: pgmap v2199: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:00.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:00 smithi026 ceph-mon[96795]: pgmap v2200: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:00.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:00 smithi194 ceph-mon[65619]: pgmap v2200: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:03.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:02 smithi194 ceph-mon[65619]: pgmap v2201: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:03.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:02 smithi026 ceph-mon[96795]: pgmap v2201: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:04.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:04 smithi194 ceph-mon[65619]: pgmap v2202: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:05.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:04 smithi026 ceph-mon[96795]: pgmap v2202: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:06.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:06 smithi194 ceph-mon[65619]: pgmap v2203: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:07.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:06 smithi026 ceph-mon[96795]: pgmap v2203: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:08.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:08 smithi194 ceph-mon[65619]: pgmap v2204: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:09.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:08 smithi026 ceph-mon[96795]: pgmap v2204: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:10.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:10 smithi194 ceph-mon[65619]: pgmap v2205: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:11.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:10 smithi026 ceph-mon[96795]: pgmap v2205: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:11.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:11 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:08:12.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:11 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:08:12.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:12 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:08:13.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:12 smithi194 ceph-mon[65619]: pgmap v2206: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:13.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:12 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:08:13.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:12 smithi026 ceph-mon[96795]: pgmap v2206: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:14.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.325+0000 7fdca7f97700 1 -- 172.21.15.26:0/1744031592 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdca00f5ed0 msgr2=0x7fdca00f6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:08:14.325 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.325+0000 7fdca7f97700 1 --2- 172.21.15.26:0/1744031592 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdca00f5ed0 0x7fdca00f6900 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7fdc90004660 tx=0x7fdc90009b30).stop 2021-11-03T18:08:14.325 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.325+0000 7fdca7f97700 1 -- 172.21.15.26:0/1744031592 shutdown_connections 2021-11-03T18:08:14.325 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.325+0000 7fdca7f97700 1 --2- 172.21.15.26:0/1744031592 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdca00f5ed0 0x7fdca00f6900 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:14.325 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.325+0000 7fdca7f97700 1 --2- 172.21.15.26:0/1744031592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdca00f55c0 0x7fdca00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:14.325 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.325+0000 7fdca7f97700 1 -- 172.21.15.26:0/1744031592 >> 172.21.15.26:0/1744031592 conn(0x7fdca00f0de0 msgr2=0x7fdca00f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:08:14.326 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.325+0000 7fdca7f97700 1 -- 172.21.15.26:0/1744031592 shutdown_connections 2021-11-03T18:08:14.326 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.325+0000 7fdca7f97700 1 -- 172.21.15.26:0/1744031592 wait complete. 2021-11-03T18:08:14.326 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.326+0000 7fdca7f97700 1 Processor -- start 2021-11-03T18:08:14.326 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.326+0000 7fdca7f97700 1 -- start start 2021-11-03T18:08:14.327 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.326+0000 7fdca7f97700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdca00f55c0 0x7fdca010c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:08:14.327 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.326+0000 7fdca7f97700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdca00f5ed0 0x7fdca010e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:08:14.327 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.326+0000 7fdca7f97700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca0060390 con 0x7fdca00f55c0 2021-11-03T18:08:14.327 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.326+0000 7fdca7f97700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca00604d0 con 0x7fdca00f5ed0 2021-11-03T18:08:14.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.326+0000 7fdca5d33700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdca00f55c0 0x7fdca010c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:08:14.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.326+0000 7fdca5d33700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdca00f55c0 0x7fdca010c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58312/0 (socket says 172.21.15.26:58312) 2021-11-03T18:08:14.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.326+0000 7fdca5d33700 1 -- 172.21.15.26:0/846298555 learned_addr learned my addr 172.21.15.26:0/846298555 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:08:14.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.326+0000 7fdca5532700 1 --2- 172.21.15.26:0/846298555 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdca00f5ed0 0x7fdca010e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:08:14.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.326+0000 7fdca5d33700 1 -- 172.21.15.26:0/846298555 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdca00f5ed0 msgr2=0x7fdca010e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:08:14.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.327+0000 7fdca5d33700 1 --2- 172.21.15.26:0/846298555 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdca00f5ed0 0x7fdca010e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:14.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.327+0000 7fdca5d33700 1 -- 172.21.15.26:0/846298555 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc90005040 con 0x7fdca00f55c0 2021-11-03T18:08:14.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.327+0000 7fdca5d33700 1 --2- 172.21.15.26:0/846298555 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdca00f55c0 0x7fdca010c090 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 rx=0x7fdc9c00c530 tx=0x7fdc9c007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:08:14.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.327+0000 7fdc967fc700 1 -- 172.21.15.26:0/846298555 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc9c00f650 con 0x7fdca00f55c0 2021-11-03T18:08:14.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.327+0000 7fdca7f97700 1 -- 172.21.15.26:0/846298555 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca010ea80 con 0x7fdca00f55c0 2021-11-03T18:08:14.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.327+0000 7fdc967fc700 1 -- 172.21.15.26:0/846298555 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdc9c00fc60 con 0x7fdca00f55c0 2021-11-03T18:08:14.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.327+0000 7fdc967fc700 1 -- 172.21.15.26:0/846298555 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc9c012cd0 con 0x7fdca00f55c0 2021-11-03T18:08:14.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.327+0000 7fdca7f97700 1 -- 172.21.15.26:0/846298555 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca010ef00 con 0x7fdca00f55c0 2021-11-03T18:08:14.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.328+0000 7fdca7f97700 1 -- 172.21.15.26:0/846298555 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca0045ad0 con 0x7fdca00f55c0 2021-11-03T18:08:14.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.328+0000 7fdc967fc700 1 -- 172.21.15.26:0/846298555 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fdc9c010070 con 0x7fdca00f55c0 2021-11-03T18:08:14.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.329+0000 7fdc967fc700 1 --2- 172.21.15.26:0/846298555 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdc8c0640b0 0x7fdc8c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:08:14.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.329+0000 7fdc967fc700 1 -- 172.21.15.26:0/846298555 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fdc9c080710 con 0x7fdca00f55c0 2021-11-03T18:08:14.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.329+0000 7fdca5532700 1 --2- 172.21.15.26:0/846298555 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdc8c0640b0 0x7fdc8c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:08:14.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.329+0000 7fdca5532700 1 --2- 172.21.15.26:0/846298555 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdc8c0640b0 0x7fdc8c066570 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7fdc90004e30 tx=0x7fdc90009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:08:14.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.333+0000 7fdc967fc700 1 -- 172.21.15.26:0/846298555 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fdc9c052980 con 0x7fdca00f55c0 2021-11-03T18:08:14.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.513+0000 7fdca7f97700 1 -- 172.21.15.26:0/846298555 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdca0057f10 con 0x7fdc8c0640b0 2021-11-03T18:08:14.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.514+0000 7fdc967fc700 1 -- 172.21.15.26:0/846298555 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fdca0057f10 con 0x7fdc8c0640b0 2021-11-03T18:08:14.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.516+0000 7fdca7f97700 1 -- 172.21.15.26:0/846298555 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdc8c0640b0 msgr2=0x7fdc8c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:08:14.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.516+0000 7fdca7f97700 1 --2- 172.21.15.26:0/846298555 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdc8c0640b0 0x7fdc8c066570 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7fdc90004e30 tx=0x7fdc90009b30).stop 2021-11-03T18:08:14.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.516+0000 7fdca7f97700 1 -- 172.21.15.26:0/846298555 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdca00f55c0 msgr2=0x7fdca010c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:08:14.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.516+0000 7fdca7f97700 1 --2- 172.21.15.26:0/846298555 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdca00f55c0 0x7fdca010c090 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 rx=0x7fdc9c00c530 tx=0x7fdc9c007e20).stop 2021-11-03T18:08:14.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.516+0000 7fdca7f97700 1 -- 172.21.15.26:0/846298555 shutdown_connections 2021-11-03T18:08:14.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.516+0000 7fdca7f97700 1 --2- 172.21.15.26:0/846298555 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdc8c0640b0 0x7fdc8c066570 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:14.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.516+0000 7fdca7f97700 1 --2- 172.21.15.26:0/846298555 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdca00f55c0 0x7fdca010c090 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:14.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.516+0000 7fdca7f97700 1 --2- 172.21.15.26:0/846298555 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdca00f5ed0 0x7fdca010e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:14.517 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.516+0000 7fdca7f97700 1 -- 172.21.15.26:0/846298555 >> 172.21.15.26:0/846298555 conn(0x7fdca00f0de0 msgr2=0x7fdca00fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:08:14.517 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.516+0000 7fdca7f97700 1 -- 172.21.15.26:0/846298555 shutdown_connections 2021-11-03T18:08:14.517 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.516+0000 7fdca7f97700 1 -- 172.21.15.26:0/846298555 wait complete. 2021-11-03T18:08:14.523 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:08:14.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.616+0000 7ff500b68700 1 -- 172.21.15.26:0/3814170873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4fc0f55e0 msgr2=0x7ff4fc0f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:08:14.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.616+0000 7ff500b68700 1 --2- 172.21.15.26:0/3814170873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4fc0f55e0 0x7ff4fc0f5a00 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7ff4ec004660 tx=0x7ff4ec009b30).stop 2021-11-03T18:08:14.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.616+0000 7ff500b68700 1 -- 172.21.15.26:0/3814170873 shutdown_connections 2021-11-03T18:08:14.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.616+0000 7ff500b68700 1 --2- 172.21.15.26:0/3814170873 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4fc0f5ef0 0x7ff4fc0f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:14.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.616+0000 7ff500b68700 1 --2- 172.21.15.26:0/3814170873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4fc0f55e0 0x7ff4fc0f5a00 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:14.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.616+0000 7ff500b68700 1 -- 172.21.15.26:0/3814170873 >> 172.21.15.26:0/3814170873 conn(0x7ff4fc0f0de0 msgr2=0x7ff4fc0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:08:14.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.616+0000 7ff500b68700 1 -- 172.21.15.26:0/3814170873 shutdown_connections 2021-11-03T18:08:14.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.616+0000 7ff500b68700 1 -- 172.21.15.26:0/3814170873 wait complete. 2021-11-03T18:08:14.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.617+0000 7ff500b68700 1 Processor -- start 2021-11-03T18:08:14.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.617+0000 7ff500b68700 1 -- start start 2021-11-03T18:08:14.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.617+0000 7ff500b68700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4fc0f55e0 0x7ff4fc109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:08:14.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.617+0000 7ff500b68700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4fc0f5ef0 0x7ff4fc10c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:08:14.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.617+0000 7ff500b68700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4fc0604e0 con 0x7ff4fc0f55e0 2021-11-03T18:08:14.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.617+0000 7ff500b68700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4fc060620 con 0x7ff4fc0f5ef0 2021-11-03T18:08:14.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.617+0000 7ff4fa59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4fc0f55e0 0x7ff4fc109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:08:14.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.617+0000 7ff4fa59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4fc0f55e0 0x7ff4fc109cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58322/0 (socket says 172.21.15.26:58322) 2021-11-03T18:08:14.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.617+0000 7ff4fa59c700 1 -- 172.21.15.26:0/2385508390 learned_addr learned my addr 172.21.15.26:0/2385508390 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:08:14.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.617+0000 7ff4f9d9b700 1 --2- 172.21.15.26:0/2385508390 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4fc0f5ef0 0x7ff4fc10c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:08:14.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.617+0000 7ff4fa59c700 1 -- 172.21.15.26:0/2385508390 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4fc0f5ef0 msgr2=0x7ff4fc10c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:08:14.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.617+0000 7ff4fa59c700 1 --2- 172.21.15.26:0/2385508390 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4fc0f5ef0 0x7ff4fc10c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:14.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.617+0000 7ff4fa59c700 1 -- 172.21.15.26:0/2385508390 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ec005040 con 0x7ff4fc0f55e0 2021-11-03T18:08:14.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.617+0000 7ff4f9d9b700 1 --2- 172.21.15.26:0/2385508390 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4fc0f5ef0 0x7ff4fc10c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:08:14.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.617+0000 7ff4fa59c700 1 --2- 172.21.15.26:0/2385508390 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4fc0f55e0 0x7ff4fc109cb0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7ff4ec009990 tx=0x7ff4ec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:08:14.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.617+0000 7ff4f2ffd700 1 -- 172.21.15.26:0/2385508390 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4ec018070 con 0x7ff4fc0f55e0 2021-11-03T18:08:14.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.618+0000 7ff4f2ffd700 1 -- 172.21.15.26:0/2385508390 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff4ec007ba0 con 0x7ff4fc0f55e0 2021-11-03T18:08:14.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.618+0000 7ff500b68700 1 -- 172.21.15.26:0/2385508390 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4fc10c700 con 0x7ff4fc0f55e0 2021-11-03T18:08:14.622 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.618+0000 7ff4f2ffd700 1 -- 172.21.15.26:0/2385508390 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4ec01c3c0 con 0x7ff4fc0f55e0 2021-11-03T18:08:14.622 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.618+0000 7ff500b68700 1 -- 172.21.15.26:0/2385508390 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4fc10cc30 con 0x7ff4fc0f55e0 2021-11-03T18:08:14.622 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.619+0000 7ff500b68700 1 -- 172.21.15.26:0/2385508390 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4fc0f4a70 con 0x7ff4fc0f55e0 2021-11-03T18:08:14.622 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.619+0000 7ff4f2ffd700 1 -- 172.21.15.26:0/2385508390 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ff4ec01d420 con 0x7ff4fc0f55e0 2021-11-03T18:08:14.622 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.619+0000 7ff4f2ffd700 1 --2- 172.21.15.26:0/2385508390 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff4e80640b0 0x7ff4e8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:08:14.623 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.619+0000 7ff4f2ffd700 1 -- 172.21.15.26:0/2385508390 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ff4ec0823e0 con 0x7ff4fc0f55e0 2021-11-03T18:08:14.623 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.619+0000 7ff4f9d9b700 1 --2- 172.21.15.26:0/2385508390 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff4e80640b0 0x7ff4e8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:08:14.623 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.620+0000 7ff4f9d9b700 1 --2- 172.21.15.26:0/2385508390 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff4e80640b0 0x7ff4e8066570 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7ff4e4009740 tx=0x7ff4e4009be0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:08:14.623 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.624+0000 7ff4f2ffd700 1 -- 172.21.15.26:0/2385508390 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ff4ec0547a0 con 0x7ff4fc0f55e0 2021-11-03T18:08:14.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.796+0000 7ff500b68700 1 -- 172.21.15.26:0/2385508390 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4fc0fdf40 con 0x7ff4e80640b0 2021-11-03T18:08:14.808 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.811+0000 7ff4f2ffd700 1 -- 172.21.15.26:0/2385508390 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7ff4fc0fdf40 con 0x7ff4e80640b0 2021-11-03T18:08:14.809 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:08:14.809 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (79m) 8m ago 80m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:08:14.809 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (71m) 8m ago 80m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:08:14.810 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (71m) 7m ago 79m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:08:14.810 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (79m) 8m ago 80m 41.7M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:08:14.810 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (72m) 8m ago 75m 25.6M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:08:14.810 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (72m) 8m ago 75m 26.2M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:08:14.811 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (75m) 7m ago 75m 26.4M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:08:14.811 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (75m) 7m ago 75m 26.8M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:08:14.811 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (73m) 8m ago 82m 561M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:08:14.811 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (72m) 7m ago 79m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:08:14.811 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (72m) 8m ago 82m 276M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:08:14.812 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (72m) 7m ago 79m 132M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:08:14.812 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (80m) 8m ago 80m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:08:14.812 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (79m) 7m ago 79m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:08:14.812 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (71m) 8m ago 79m 292M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:08:14.813 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (70m) 8m ago 78m 313M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:08:14.813 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (70m) 8m ago 78m 261M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:08:14.813 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (69m) 7m ago 78m 337M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:08:14.813 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (69m) 7m ago 77m 283M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:08:14.813 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (68m) 7m ago 77m 276M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:08:14.814 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (79m) 8m ago 80m 61.2M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:08:14.814 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.813+0000 7ff500b68700 1 -- 172.21.15.26:0/2385508390 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff4e80640b0 msgr2=0x7ff4e8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:08:14.815 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.813+0000 7ff500b68700 1 --2- 172.21.15.26:0/2385508390 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff4e80640b0 0x7ff4e8066570 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7ff4e4009740 tx=0x7ff4e4009be0).stop 2021-11-03T18:08:14.815 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.813+0000 7ff500b68700 1 -- 172.21.15.26:0/2385508390 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4fc0f55e0 msgr2=0x7ff4fc109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:08:14.815 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.813+0000 7ff500b68700 1 --2- 172.21.15.26:0/2385508390 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4fc0f55e0 0x7ff4fc109cb0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7ff4ec009990 tx=0x7ff4ec009b30).stop 2021-11-03T18:08:14.815 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.813+0000 7ff500b68700 1 -- 172.21.15.26:0/2385508390 shutdown_connections 2021-11-03T18:08:14.816 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.813+0000 7ff500b68700 1 --2- 172.21.15.26:0/2385508390 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff4e80640b0 0x7ff4e8066570 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:14.816 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.813+0000 7ff500b68700 1 --2- 172.21.15.26:0/2385508390 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4fc0f55e0 0x7ff4fc109cb0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:14.816 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.813+0000 7ff500b68700 1 --2- 172.21.15.26:0/2385508390 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4fc0f5ef0 0x7ff4fc10c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:14.816 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.813+0000 7ff500b68700 1 -- 172.21.15.26:0/2385508390 >> 172.21.15.26:0/2385508390 conn(0x7ff4fc0f0de0 msgr2=0x7ff4fc0fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:08:14.816 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.813+0000 7ff500b68700 1 -- 172.21.15.26:0/2385508390 shutdown_connections 2021-11-03T18:08:14.817 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.813+0000 7ff500b68700 1 -- 172.21.15.26:0/2385508390 wait complete. 2021-11-03T18:08:14.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.912+0000 7fed914b0700 1 -- 172.21.15.26:0/1217318052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed8c0f6860 msgr2=0x7fed8c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:08:14.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.912+0000 7fed914b0700 1 --2- 172.21.15.26:0/1217318052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed8c0f6860 0x7fed8c0f6cc0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7fed80004660 tx=0x7fed80009b30).stop 2021-11-03T18:08:14.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.912+0000 7fed914b0700 1 -- 172.21.15.26:0/1217318052 shutdown_connections 2021-11-03T18:08:14.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.912+0000 7fed914b0700 1 --2- 172.21.15.26:0/1217318052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed8c0f6860 0x7fed8c0f6cc0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:14.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.912+0000 7fed914b0700 1 --2- 172.21.15.26:0/1217318052 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed8c0f55c0 0x7fed8c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:08:14.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.912+0000 7fed914b0700 1 -- 172.21.15.26:0/1217318052 >> 172.21.15.26:0/1217318052 conn(0x7fed8c0f0d40 msgr2=0x7fed8c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:08:14.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.912+0000 7fed914b0700 1 -- 172.21.15.26:0/1217318052 shutdown_connections 2021-11-03T18:08:14.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.912+0000 7fed914b0700 1 -- 172.21.15.26:0/1217318052 wait complete. 2021-11-03T18:08:14.913 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.912+0000 7fed914b0700 1 Processor -- start 2021-11-03T18:08:14.913 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.913+0000 7fed914b0700 1 -- start start 2021-11-03T18:08:14.913 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.913+0000 7fed914b0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed8c0f55c0 0x7fed8c105eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:08:14.913 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.913+0000 7fed914b0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed8c0f6860 0x7fed8c1063a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:08:14.914 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.913+0000 7fed914b0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c1069e0 con 0x7fed8c0f55c0 2021-11-03T18:08:14.914 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.913+0000 7fed914b0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c107290 con 0x7fed8c0f6860 2021-11-03T18:08:14.914 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.913+0000 7fed8affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed8c0f55c0 0x7fed8c105eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:08:14.914 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.913+0000 7fed8affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed8c0f55c0 0x7fed8c105eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58332/0 (socket says 172.21.15.26:58332) 2021-11-03T18:08:14.914 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.913+0000 7fed8affd700 1 -- 172.21.15.26:0/2485201305 learned_addr learned my addr 172.21.15.26:0/2485201305 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:08:14.915 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.913+0000 7fed8a7fc700 1 --2- 172.21.15.26:0/2485201305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed8c0f6860 0x7fed8c1063a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:08:14.915 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.913+0000 7fed8affd700 1 -- 172.21.15.26:0/2485201305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed8c0f6860 msgr2=0x7fed8c1063a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:08:14.915 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.913+0000 7fed8affd700 1 --2- 172.21.15.26:0/2485201305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed8c0f6860 0x7fed8c1063a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:14.915 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.913+0000 7fed8affd700 1 -- 172.21.15.26:0/2485201305 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed80005040 con 0x7fed8c0f55c0 2021-11-03T18:08:14.916 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.913+0000 7fed8affd700 1 --2- 172.21.15.26:0/2485201305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed8c0f55c0 0x7fed8c105eb0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 rx=0x7fed8400b790 tx=0x7fed840092b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:08:14.916 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.913+0000 7fed737fe700 1 -- 172.21.15.26:0/2485201305 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed8400d680 con 0x7fed8c0f55c0 2021-11-03T18:08:14.916 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.913+0000 7fed914b0700 1 -- 172.21.15.26:0/2485201305 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed8c107570 con 0x7fed8c0f55c0 2021-11-03T18:08:14.916 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.913+0000 7fed737fe700 1 -- 172.21.15.26:0/2485201305 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fed8400dc90 con 0x7fed8c0f55c0 2021-11-03T18:08:14.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.913+0000 7fed737fe700 1 -- 172.21.15.26:0/2485201305 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed84010cf0 con 0x7fed8c0f55c0 2021-11-03T18:08:14.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.914+0000 7fed914b0700 1 -- 172.21.15.26:0/2485201305 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed8c107b30 con 0x7fed8c0f55c0 2021-11-03T18:08:14.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.914+0000 7fed914b0700 1 -- 172.21.15.26:0/2485201305 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed8c045ad0 con 0x7fed8c0f55c0 2021-11-03T18:08:14.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.915+0000 7fed737fe700 1 -- 172.21.15.26:0/2485201305 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fed8400f070 con 0x7fed8c0f55c0 2021-11-03T18:08:14.919 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.915+0000 7fed737fe700 1 --2- 172.21.15.26:0/2485201305 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fed740640b0 0x7fed74066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:08:14.919 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.915+0000 7fed737fe700 1 -- 172.21.15.26:0/2485201305 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fed840806a0 con 0x7fed8c0f55c0 2021-11-03T18:08:14.919 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.915+0000 7fed8a7fc700 1 --2- 172.21.15.26:0/2485201305 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fed740640b0 0x7fed74066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:08:14.919 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.916+0000 7fed8a7fc700 1 --2- 172.21.15.26:0/2485201305 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fed740640b0 0x7fed74066570 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7fed80004630 tx=0x7fed80009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:08:14.919 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:14.920+0000 7fed737fe700 1 -- 172.21.15.26:0/2485201305 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fed84052910 con 0x7fed8c0f55c0 2021-11-03T18:08:14.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:14 smithi194 ceph-mon[65619]: pgmap v2207: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:15.146 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.149+0000 7fed914b0700 1 -- 172.21.15.26:0/2485201305 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fed8c1080e0 con 0x7fed8c0f55c0 2021-11-03T18:08:15.147 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.150+0000 7fed737fe700 1 -- 172.21.15.26:0/2485201305 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fed840162e0 con 0x7fed8c0f55c0 2021-11-03T18:08:15.147 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:08:15.148 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:08:15.148 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:08:15.148 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:08:15.148 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:08:15.149 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:08:15.149 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:08:15.149 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:08:15.149 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:08:15.150 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:08:15.150 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:08:15.150 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:08:15.150 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:08:15.151 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:08:15.151 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:08:15.151 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:08:15.151 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:08:15.152 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:08:15.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.151+0000 7fed914b0700 1 -- 172.21.15.26:0/2485201305 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fed740640b0 msgr2=0x7fed74066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:08:15.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.151+0000 7fed914b0700 1 --2- 172.21.15.26:0/2485201305 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fed740640b0 0x7fed74066570 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7fed80004630 tx=0x7fed80009b30).stop 2021-11-03T18:08:15.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.151+0000 7fed914b0700 1 -- 172.21.15.26:0/2485201305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed8c0f55c0 msgr2=0x7fed8c105eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:08:15.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.151+0000 7fed914b0700 1 --2- 172.21.15.26:0/2485201305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed8c0f55c0 0x7fed8c105eb0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 rx=0x7fed8400b790 tx=0x7fed840092b0).stop 2021-11-03T18:08:15.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.151+0000 7fed914b0700 1 -- 172.21.15.26:0/2485201305 shutdown_connections 2021-11-03T18:08:15.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.151+0000 7fed914b0700 1 --2- 172.21.15.26:0/2485201305 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fed740640b0 0x7fed74066570 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:15.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.151+0000 7fed914b0700 1 --2- 172.21.15.26:0/2485201305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed8c0f55c0 0x7fed8c105eb0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:15.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.151+0000 7fed914b0700 1 --2- 172.21.15.26:0/2485201305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed8c0f6860 0x7fed8c1063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:15.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.151+0000 7fed914b0700 1 -- 172.21.15.26:0/2485201305 >> 172.21.15.26:0/2485201305 conn(0x7fed8c0f0d40 msgr2=0x7fed8c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:08:15.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.151+0000 7fed914b0700 1 -- 172.21.15.26:0/2485201305 shutdown_connections 2021-11-03T18:08:15.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.151+0000 7fed914b0700 1 -- 172.21.15.26:0/2485201305 wait complete. 2021-11-03T18:08:15.173 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:14 smithi026 ceph-mon[96795]: pgmap v2207: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:15.250 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.251+0000 7fcc9b950700 1 -- 172.21.15.26:0/3999348237 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc940f6b90 msgr2=0x7fcc940f6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:08:15.251 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.251+0000 7fcc9b950700 1 --2- 172.21.15.26:0/3999348237 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc940f6b90 0x7fcc940f6fb0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7fcc90004660 tx=0x7fcc90009b30).stop 2021-11-03T18:08:15.251 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.251+0000 7fcc9b950700 1 -- 172.21.15.26:0/3999348237 shutdown_connections 2021-11-03T18:08:15.251 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.251+0000 7fcc9b950700 1 --2- 172.21.15.26:0/3999348237 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc940f74a0 0x7fcc940f5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:08:15.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.251+0000 7fcc9b950700 1 --2- 172.21.15.26:0/3999348237 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc940f6b90 0x7fcc940f6fb0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:15.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.251+0000 7fcc9b950700 1 -- 172.21.15.26:0/3999348237 >> 172.21.15.26:0/3999348237 conn(0x7fcc940f0540 msgr2=0x7fcc940f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:08:15.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.251+0000 7fcc9b950700 1 -- 172.21.15.26:0/3999348237 shutdown_connections 2021-11-03T18:08:15.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.251+0000 7fcc9b950700 1 -- 172.21.15.26:0/3999348237 wait complete. 2021-11-03T18:08:15.253 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.252+0000 7fcc9b950700 1 Processor -- start 2021-11-03T18:08:15.253 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.252+0000 7fcc9b950700 1 -- start start 2021-11-03T18:08:15.253 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.252+0000 7fcc9b950700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc940f6b90 0x7fcc94109cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:08:15.253 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.252+0000 7fcc9b950700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc940f74a0 0x7fcc9410c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:08:15.253 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.252+0000 7fcc9b950700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc940f5650 con 0x7fcc940f6b90 2021-11-03T18:08:15.254 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.252+0000 7fcc9b950700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc940f5790 con 0x7fcc940f74a0 2021-11-03T18:08:15.254 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.252+0000 7fcc996ec700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc940f6b90 0x7fcc94109cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:08:15.254 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.252+0000 7fcc996ec700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc940f6b90 0x7fcc94109cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58342/0 (socket says 172.21.15.26:58342) 2021-11-03T18:08:15.254 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.252+0000 7fcc996ec700 1 -- 172.21.15.26:0/2472706346 learned_addr learned my addr 172.21.15.26:0/2472706346 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:08:15.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.252+0000 7fcc98eeb700 1 --2- 172.21.15.26:0/2472706346 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc940f74a0 0x7fcc9410c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:08:15.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.252+0000 7fcc996ec700 1 -- 172.21.15.26:0/2472706346 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc940f74a0 msgr2=0x7fcc9410c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:08:15.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.252+0000 7fcc996ec700 1 --2- 172.21.15.26:0/2472706346 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc940f74a0 0x7fcc9410c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:15.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.252+0000 7fcc996ec700 1 -- 172.21.15.26:0/2472706346 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc90005040 con 0x7fcc940f6b90 2021-11-03T18:08:15.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.252+0000 7fcc98eeb700 1 --2- 172.21.15.26:0/2472706346 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc940f74a0 0x7fcc9410c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:08:15.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.253+0000 7fcc996ec700 1 --2- 172.21.15.26:0/2472706346 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc940f6b90 0x7fcc94109cc0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7fcc90004f60 tx=0x7fcc90009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:08:15.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.253+0000 7fcc89ffb700 1 -- 172.21.15.26:0/2472706346 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc90018070 con 0x7fcc940f6b90 2021-11-03T18:08:15.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.253+0000 7fcc89ffb700 1 -- 172.21.15.26:0/2472706346 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcc90007ba0 con 0x7fcc940f6b90 2021-11-03T18:08:15.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.253+0000 7fcc9b950700 1 -- 172.21.15.26:0/2472706346 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc9410c770 con 0x7fcc940f6b90 2021-11-03T18:08:15.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.253+0000 7fcc89ffb700 1 -- 172.21.15.26:0/2472706346 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc9001dea0 con 0x7fcc940f6b90 2021-11-03T18:08:15.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.253+0000 7fcc9b950700 1 -- 172.21.15.26:0/2472706346 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc9410ccd0 con 0x7fcc940f6b90 2021-11-03T18:08:15.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.254+0000 7fcc9b950700 1 -- 172.21.15.26:0/2472706346 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc94045ad0 con 0x7fcc940f6b90 2021-11-03T18:08:15.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.254+0000 7fcc89ffb700 1 -- 172.21.15.26:0/2472706346 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fcc9001d420 con 0x7fcc940f6b90 2021-11-03T18:08:15.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.255+0000 7fcc89ffb700 1 --2- 172.21.15.26:0/2472706346 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcc800640b0 0x7fcc80066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:08:15.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.255+0000 7fcc89ffb700 1 -- 172.21.15.26:0/2472706346 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fcc900827a0 con 0x7fcc940f6b90 2021-11-03T18:08:15.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.255+0000 7fcc98eeb700 1 --2- 172.21.15.26:0/2472706346 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcc800640b0 0x7fcc80066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:08:15.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.255+0000 7fcc98eeb700 1 --2- 172.21.15.26:0/2472706346 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcc800640b0 0x7fcc80066570 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7fcc8400b830 tx=0x7fcc84008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:08:15.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.259+0000 7fcc89ffb700 1 -- 172.21.15.26:0/2472706346 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fcc90054b00 con 0x7fcc940f6b90 2021-11-03T18:08:15.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.461+0000 7fcc9b950700 1 -- 172.21.15.26:0/2472706346 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcc940fdec0 con 0x7fcc940f6b90 2021-11-03T18:08:15.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.462+0000 7fcc89ffb700 1 -- 172.21.15.26:0/2472706346 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fcc900546f0 con 0x7fcc940f6b90 2021-11-03T18:08:15.459 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:08:15.460 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:08:15.460 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:08:15.460 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:08:15.461 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:08:15.461 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:08:15.461 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:08:15.461 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:08:15.461 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:08:15.462 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:08:15.462 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:08:15.462 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:08:15.462 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:08:15.463 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:08:15.463 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:08:15.463 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:08:15.463 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:08:15.464 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:08:15.464 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:08:15.464 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:08:15.464 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:08:15.464 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:08:15.465 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:08:15.465 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:08:15.465 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:08:15.465 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:08:15.465 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:08:15.466 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:08:15.466 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:08:15.466 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:08:15.466 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:08:15.467 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:08:15.467 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:08:15.467 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:08:15.467 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:08:15.468 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:08:15.468 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:08:15.468 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:08:15.468 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:08:15.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.464+0000 7fcc9b950700 1 -- 172.21.15.26:0/2472706346 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcc800640b0 msgr2=0x7fcc80066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:08:15.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.464+0000 7fcc9b950700 1 --2- 172.21.15.26:0/2472706346 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcc800640b0 0x7fcc80066570 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7fcc8400b830 tx=0x7fcc84008040).stop 2021-11-03T18:08:15.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.464+0000 7fcc9b950700 1 -- 172.21.15.26:0/2472706346 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc940f6b90 msgr2=0x7fcc94109cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:08:15.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.464+0000 7fcc9b950700 1 --2- 172.21.15.26:0/2472706346 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc940f6b90 0x7fcc94109cc0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7fcc90004f60 tx=0x7fcc90009b30).stop 2021-11-03T18:08:15.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.464+0000 7fcc9b950700 1 -- 172.21.15.26:0/2472706346 shutdown_connections 2021-11-03T18:08:15.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.464+0000 7fcc9b950700 1 --2- 172.21.15.26:0/2472706346 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcc800640b0 0x7fcc80066570 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:15.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.464+0000 7fcc9b950700 1 --2- 172.21.15.26:0/2472706346 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc940f6b90 0x7fcc94109cc0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:15.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.464+0000 7fcc9b950700 1 --2- 172.21.15.26:0/2472706346 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc940f74a0 0x7fcc9410c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:15.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.464+0000 7fcc9b950700 1 -- 172.21.15.26:0/2472706346 >> 172.21.15.26:0/2472706346 conn(0x7fcc940f0540 msgr2=0x7fcc940fa390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:08:15.472 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.464+0000 7fcc9b950700 1 -- 172.21.15.26:0/2472706346 shutdown_connections 2021-11-03T18:08:15.472 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:15.464+0000 7fcc9b950700 1 -- 172.21.15.26:0/2472706346 wait complete. 2021-11-03T18:08:15.472 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:08:15.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:15 smithi026 ceph-mon[96795]: from='client.36412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:08:15.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:15 smithi026 ceph-mon[96795]: from='client.36416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:08:15.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:15 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2485201305' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:08:15.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:15 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2472706346' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:08:15.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:15 smithi194 ceph-mon[65619]: from='client.36412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:08:16.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:15 smithi194 ceph-mon[65619]: from='client.36416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:08:16.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:15 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2485201305' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:08:16.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:15 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2472706346' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:08:16.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:16 smithi194 ceph-mon[65619]: pgmap v2208: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:17.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:16 smithi026 ceph-mon[96795]: pgmap v2208: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:18.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:18 smithi194 ceph-mon[65619]: pgmap v2209: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:19.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:18 smithi026 ceph-mon[96795]: pgmap v2209: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:20.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:20 smithi194 ceph-mon[65619]: pgmap v2210: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:21.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:20 smithi026 ceph-mon[96795]: pgmap v2210: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:22.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:22 smithi194 ceph-mon[65619]: pgmap v2211: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:23.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:22 smithi026 ceph-mon[96795]: pgmap v2211: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:24.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:24 smithi194 ceph-mon[65619]: pgmap v2212: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:25.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:24 smithi026 ceph-mon[96795]: pgmap v2212: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:26.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:26 smithi194 ceph-mon[65619]: pgmap v2213: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:27.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:26 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:08:27.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:26 smithi026 ceph-mon[96795]: pgmap v2213: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:27.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:26 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:08:27.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:27 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:08:28.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:27 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:08:28.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:28 smithi194 ceph-mon[65619]: pgmap v2214: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:29.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:28 smithi026 ceph-mon[96795]: pgmap v2214: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:31.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:30 smithi194 ceph-mon[65619]: pgmap v2215: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:31.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:30 smithi026 ceph-mon[96795]: pgmap v2215: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:33.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:32 smithi194 ceph-mon[65619]: pgmap v2216: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:33.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:32 smithi026 ceph-mon[96795]: pgmap v2216: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:34.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:34 smithi194 ceph-mon[65619]: pgmap v2217: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:35.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:34 smithi026 ceph-mon[96795]: pgmap v2217: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:36.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:36 smithi194 ceph-mon[65619]: pgmap v2218: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:37.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:36 smithi026 ceph-mon[96795]: pgmap v2218: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:38.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:38 smithi194 ceph-mon[65619]: pgmap v2219: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:39.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:38 smithi026 ceph-mon[96795]: pgmap v2219: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:41.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:40 smithi194 ceph-mon[65619]: pgmap v2220: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:41.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:40 smithi026 ceph-mon[96795]: pgmap v2220: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:41.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:08:42.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:08:42.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:42 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:08:43.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:42 smithi194 ceph-mon[65619]: pgmap v2221: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:43.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:42 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:08:43.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:42 smithi026 ceph-mon[96795]: pgmap v2221: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:45.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:44 smithi026 ceph-mon[96795]: pgmap v2222: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:45.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:44 smithi194 ceph-mon[65619]: pgmap v2222: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:45.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.579+0000 7fac0b298700 1 -- 172.21.15.26:0/2274104777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac040f77d0 msgr2=0x7fac040f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:08:45.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.579+0000 7fac0b298700 1 --2- 172.21.15.26:0/2274104777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac040f77d0 0x7fac040f7c30 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7fabf4004660 tx=0x7fabf4009b30).stop 2021-11-03T18:08:45.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.579+0000 7fac0b298700 1 -- 172.21.15.26:0/2274104777 shutdown_connections 2021-11-03T18:08:45.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.579+0000 7fac0b298700 1 --2- 172.21.15.26:0/2274104777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac040f77d0 0x7fac040f7c30 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:45.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.579+0000 7fac0b298700 1 --2- 172.21.15.26:0/2274104777 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac040f6530 0x7fac040f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:45.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.579+0000 7fac0b298700 1 -- 172.21.15.26:0/2274104777 >> 172.21.15.26:0/2274104777 conn(0x7fac040f1c90 msgr2=0x7fac040f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:08:45.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.579+0000 7fac0b298700 1 -- 172.21.15.26:0/2274104777 shutdown_connections 2021-11-03T18:08:45.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.579+0000 7fac0b298700 1 -- 172.21.15.26:0/2274104777 wait complete. 2021-11-03T18:08:45.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.580+0000 7fac0b298700 1 Processor -- start 2021-11-03T18:08:45.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.580+0000 7fac0b298700 1 -- start start 2021-11-03T18:08:45.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.580+0000 7fac0b298700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac040f6530 0x7fac04106d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:08:45.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.580+0000 7fac0b298700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac040f77d0 0x7fac04107230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:08:45.584 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.580+0000 7fac0b298700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac04107830 con 0x7fac040f6530 2021-11-03T18:08:45.584 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.580+0000 7fac0b298700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac04108040 con 0x7fac040f77d0 2021-11-03T18:08:45.584 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.580+0000 7fac0a296700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac040f6530 0x7fac04106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:08:45.584 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.580+0000 7fac0a296700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac040f6530 0x7fac04106d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58360/0 (socket says 172.21.15.26:58360) 2021-11-03T18:08:45.585 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.580+0000 7fac0a296700 1 -- 172.21.15.26:0/3094764311 learned_addr learned my addr 172.21.15.26:0/3094764311 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:08:45.585 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.581+0000 7fac09a95700 1 --2- 172.21.15.26:0/3094764311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac040f77d0 0x7fac04107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:08:45.585 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.581+0000 7fac0a296700 1 -- 172.21.15.26:0/3094764311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac040f77d0 msgr2=0x7fac04107230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:08:45.585 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.581+0000 7fac0a296700 1 --2- 172.21.15.26:0/3094764311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac040f77d0 0x7fac04107230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:45.586 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.581+0000 7fac0a296700 1 -- 172.21.15.26:0/3094764311 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf4005040 con 0x7fac040f6530 2021-11-03T18:08:45.586 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.581+0000 7fac09a95700 1 --2- 172.21.15.26:0/3094764311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac040f77d0 0x7fac04107230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:08:45.586 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.581+0000 7fac0a296700 1 --2- 172.21.15.26:0/3094764311 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac040f6530 0x7fac04106d40 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 rx=0x7fac00002700 tx=0x7fac00009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:08:45.587 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.581+0000 7fabfaffd700 1 -- 172.21.15.26:0/3094764311 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac00009320 con 0x7fac040f6530 2021-11-03T18:08:45.587 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.581+0000 7fabfaffd700 1 -- 172.21.15.26:0/3094764311 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fac0000f040 con 0x7fac040f6530 2021-11-03T18:08:45.587 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.581+0000 7fac0b298700 1 -- 172.21.15.26:0/3094764311 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac041082c0 con 0x7fac040f6530 2021-11-03T18:08:45.587 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.581+0000 7fabfaffd700 1 -- 172.21.15.26:0/3094764311 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac000148e0 con 0x7fac040f6530 2021-11-03T18:08:45.588 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.581+0000 7fac0b298700 1 -- 172.21.15.26:0/3094764311 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac04108880 con 0x7fac040f6530 2021-11-03T18:08:45.588 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.582+0000 7fac0b298700 1 -- 172.21.15.26:0/3094764311 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac04059100 con 0x7fac040f6530 2021-11-03T18:08:45.588 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.583+0000 7fabfaffd700 1 -- 172.21.15.26:0/3094764311 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fac00009480 con 0x7fac040f6530 2021-11-03T18:08:45.589 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.583+0000 7fabfaffd700 1 --2- 172.21.15.26:0/3094764311 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fabf0064100 0x7fabf00665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:08:45.589 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.583+0000 7fabfaffd700 1 -- 172.21.15.26:0/3094764311 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fac00080a30 con 0x7fac040f6530 2021-11-03T18:08:45.589 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.583+0000 7fac09a95700 1 --2- 172.21.15.26:0/3094764311 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fabf0064100 0x7fabf00665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:08:45.589 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.584+0000 7fac09a95700 1 --2- 172.21.15.26:0/3094764311 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fabf0064100 0x7fabf00665c0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7fabf4009da0 tx=0x7fabf4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:08:45.590 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.587+0000 7fabfaffd700 1 -- 172.21.15.26:0/3094764311 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fac00052d90 con 0x7fac040f6530 2021-11-03T18:08:45.763 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.765+0000 7fac0b298700 1 -- 172.21.15.26:0/3094764311 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fac040fee80 con 0x7fabf0064100 2021-11-03T18:08:45.764 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.766+0000 7fabfaffd700 1 -- 172.21.15.26:0/3094764311 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fac040fee80 con 0x7fabf0064100 2021-11-03T18:08:45.766 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.768+0000 7fac0b298700 1 -- 172.21.15.26:0/3094764311 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fabf0064100 msgr2=0x7fabf00665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:08:45.766 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.768+0000 7fac0b298700 1 --2- 172.21.15.26:0/3094764311 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fabf0064100 0x7fabf00665c0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7fabf4009da0 tx=0x7fabf4009b30).stop 2021-11-03T18:08:45.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.768+0000 7fac0b298700 1 -- 172.21.15.26:0/3094764311 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac040f6530 msgr2=0x7fac04106d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:08:45.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.768+0000 7fac0b298700 1 --2- 172.21.15.26:0/3094764311 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac040f6530 0x7fac04106d40 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 rx=0x7fac00002700 tx=0x7fac00009e00).stop 2021-11-03T18:08:45.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.768+0000 7fac0b298700 1 -- 172.21.15.26:0/3094764311 shutdown_connections 2021-11-03T18:08:45.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.768+0000 7fac0b298700 1 --2- 172.21.15.26:0/3094764311 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fabf0064100 0x7fabf00665c0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:45.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.768+0000 7fac0b298700 1 --2- 172.21.15.26:0/3094764311 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac040f6530 0x7fac04106d40 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:45.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.768+0000 7fac0b298700 1 --2- 172.21.15.26:0/3094764311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac040f77d0 0x7fac04107230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:45.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.768+0000 7fac0b298700 1 -- 172.21.15.26:0/3094764311 >> 172.21.15.26:0/3094764311 conn(0x7fac040f1c90 msgr2=0x7fac040fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:08:45.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.768+0000 7fac0b298700 1 -- 172.21.15.26:0/3094764311 shutdown_connections 2021-11-03T18:08:45.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.768+0000 7fac0b298700 1 -- 172.21.15.26:0/3094764311 wait complete. 2021-11-03T18:08:45.776 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:08:45.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.868+0000 7fd9ccc3a700 1 -- 172.21.15.26:0/3006486368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9c80f5ef0 msgr2=0x7fd9c80f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:08:45.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.868+0000 7fd9ccc3a700 1 --2- 172.21.15.26:0/3006486368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9c80f5ef0 0x7fd9c80f6920 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7fd9bc004660 tx=0x7fd9bc009b30).stop 2021-11-03T18:08:45.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.868+0000 7fd9ccc3a700 1 -- 172.21.15.26:0/3006486368 shutdown_connections 2021-11-03T18:08:45.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.868+0000 7fd9ccc3a700 1 --2- 172.21.15.26:0/3006486368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9c80f5ef0 0x7fd9c80f6920 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:45.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.868+0000 7fd9ccc3a700 1 --2- 172.21.15.26:0/3006486368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9c80f55e0 0x7fd9c80f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:45.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.868+0000 7fd9ccc3a700 1 -- 172.21.15.26:0/3006486368 >> 172.21.15.26:0/3006486368 conn(0x7fd9c80f0de0 msgr2=0x7fd9c80f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:08:45.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.868+0000 7fd9ccc3a700 1 -- 172.21.15.26:0/3006486368 shutdown_connections 2021-11-03T18:08:45.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.868+0000 7fd9ccc3a700 1 -- 172.21.15.26:0/3006486368 wait complete. 2021-11-03T18:08:45.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.869+0000 7fd9ccc3a700 1 Processor -- start 2021-11-03T18:08:45.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.869+0000 7fd9ccc3a700 1 -- start start 2021-11-03T18:08:45.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.869+0000 7fd9ccc3a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9c80f55e0 0x7fd9c8109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:08:45.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.869+0000 7fd9ccc3a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9c80f5ef0 0x7fd9c810c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:08:45.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.869+0000 7fd9ccc3a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c80604e0 con 0x7fd9c80f55e0 2021-11-03T18:08:45.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.869+0000 7fd9ccc3a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c8060620 con 0x7fd9c80f5ef0 2021-11-03T18:08:45.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.869+0000 7fd9c659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9c80f55e0 0x7fd9c8109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:08:45.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.869+0000 7fd9c659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9c80f55e0 0x7fd9c8109cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58370/0 (socket says 172.21.15.26:58370) 2021-11-03T18:08:45.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.869+0000 7fd9c659c700 1 -- 172.21.15.26:0/1075458245 learned_addr learned my addr 172.21.15.26:0/1075458245 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:08:45.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.869+0000 7fd9c5d9b700 1 --2- 172.21.15.26:0/1075458245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9c80f5ef0 0x7fd9c810c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:08:45.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.869+0000 7fd9c659c700 1 -- 172.21.15.26:0/1075458245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9c80f5ef0 msgr2=0x7fd9c810c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:08:45.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.869+0000 7fd9c659c700 1 --2- 172.21.15.26:0/1075458245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9c80f5ef0 0x7fd9c810c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:45.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.869+0000 7fd9c659c700 1 -- 172.21.15.26:0/1075458245 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9bc005040 con 0x7fd9c80f55e0 2021-11-03T18:08:45.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.869+0000 7fd9c5d9b700 1 --2- 172.21.15.26:0/1075458245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9c80f5ef0 0x7fd9c810c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:08:45.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.869+0000 7fd9c659c700 1 --2- 172.21.15.26:0/1075458245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9c80f55e0 0x7fd9c8109cb0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7fd9b800c790 tx=0x7fd9b8007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:08:45.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.869+0000 7fd9b6ffd700 1 -- 172.21.15.26:0/1075458245 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9b800e680 con 0x7fd9c80f55e0 2021-11-03T18:08:45.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.870+0000 7fd9ccc3a700 1 -- 172.21.15.26:0/1075458245 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9c810c760 con 0x7fd9c80f55e0 2021-11-03T18:08:45.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.870+0000 7fd9b6ffd700 1 -- 172.21.15.26:0/1075458245 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd9b800ec90 con 0x7fd9c80f55e0 2021-11-03T18:08:45.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.870+0000 7fd9b6ffd700 1 -- 172.21.15.26:0/1075458245 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9b8013d60 con 0x7fd9c80f55e0 2021-11-03T18:08:45.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.870+0000 7fd9ccc3a700 1 -- 172.21.15.26:0/1075458245 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9c810ccf0 con 0x7fd9c80f55e0 2021-11-03T18:08:45.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.870+0000 7fd9ccc3a700 1 -- 172.21.15.26:0/1075458245 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9c80f4a70 con 0x7fd9c80f55e0 2021-11-03T18:08:45.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.871+0000 7fd9b6ffd700 1 -- 172.21.15.26:0/1075458245 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fd9b801a060 con 0x7fd9c80f55e0 2021-11-03T18:08:45.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.871+0000 7fd9b6ffd700 1 --2- 172.21.15.26:0/1075458245 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd9b00640b0 0x7fd9b0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:08:45.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.871+0000 7fd9b6ffd700 1 -- 172.21.15.26:0/1075458245 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fd9b8080b10 con 0x7fd9c80f55e0 2021-11-03T18:08:45.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.871+0000 7fd9c5d9b700 1 --2- 172.21.15.26:0/1075458245 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd9b00640b0 0x7fd9b0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:08:45.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.872+0000 7fd9c5d9b700 1 --2- 172.21.15.26:0/1075458245 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd9b00640b0 0x7fd9b0066570 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7fd9bc004e30 tx=0x7fd9bc009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:08:45.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:45.875+0000 7fd9b6ffd700 1 -- 172.21.15.26:0/1075458245 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fd9b8052d80 con 0x7fd9c80f55e0 2021-11-03T18:08:46.045 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.047+0000 7fd9ccc3a700 1 -- 172.21.15.26:0/1075458245 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9c80fdf60 con 0x7fd9b00640b0 2021-11-03T18:08:46.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.062+0000 7fd9b6ffd700 1 -- 172.21.15.26:0/1075458245 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fd9c80fdf60 con 0x7fd9b00640b0 2021-11-03T18:08:46.061 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:08:46.061 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (80m) 8m ago 81m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:08:46.061 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (72m) 8m ago 81m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:08:46.062 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (72m) 7m ago 80m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:08:46.062 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (79m) 8m ago 80m 41.7M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:08:46.062 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (72m) 8m ago 76m 25.6M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:08:46.063 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (73m) 8m ago 76m 26.2M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:08:46.063 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (76m) 7m ago 76m 26.4M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:08:46.064 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (76m) 7m ago 76m 26.8M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:08:46.064 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (73m) 8m ago 82m 561M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:08:46.064 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (73m) 7m ago 80m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:08:46.065 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (73m) 8m ago 82m 276M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:08:46.065 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (72m) 7m ago 80m 132M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:08:46.066 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (80m) 8m ago 80m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:08:46.066 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (80m) 7m ago 80m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:08:46.066 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (71m) 8m ago 79m 292M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:08:46.067 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (71m) 8m ago 79m 313M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:08:46.067 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (70m) 8m ago 78m 261M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:08:46.067 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (70m) 7m ago 78m 337M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:08:46.068 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (69m) 7m ago 78m 283M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:08:46.068 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (69m) 7m ago 77m 276M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:08:46.068 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (79m) 8m ago 80m 61.2M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:08:46.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.064+0000 7fd9ccc3a700 1 -- 172.21.15.26:0/1075458245 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd9b00640b0 msgr2=0x7fd9b0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:08:46.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.064+0000 7fd9ccc3a700 1 --2- 172.21.15.26:0/1075458245 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd9b00640b0 0x7fd9b0066570 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7fd9bc004e30 tx=0x7fd9bc009b30).stop 2021-11-03T18:08:46.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.064+0000 7fd9ccc3a700 1 -- 172.21.15.26:0/1075458245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9c80f55e0 msgr2=0x7fd9c8109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:08:46.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.064+0000 7fd9ccc3a700 1 --2- 172.21.15.26:0/1075458245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9c80f55e0 0x7fd9c8109cb0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7fd9b800c790 tx=0x7fd9b8007d70).stop 2021-11-03T18:08:46.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.064+0000 7fd9ccc3a700 1 -- 172.21.15.26:0/1075458245 shutdown_connections 2021-11-03T18:08:46.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.064+0000 7fd9ccc3a700 1 --2- 172.21.15.26:0/1075458245 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd9b00640b0 0x7fd9b0066570 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:46.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.064+0000 7fd9ccc3a700 1 --2- 172.21.15.26:0/1075458245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9c80f55e0 0x7fd9c8109cb0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:46.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.064+0000 7fd9ccc3a700 1 --2- 172.21.15.26:0/1075458245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9c80f5ef0 0x7fd9c810c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:46.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.064+0000 7fd9ccc3a700 1 -- 172.21.15.26:0/1075458245 >> 172.21.15.26:0/1075458245 conn(0x7fd9c80f0de0 msgr2=0x7fd9c80fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:08:46.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.064+0000 7fd9ccc3a700 1 -- 172.21.15.26:0/1075458245 shutdown_connections 2021-11-03T18:08:46.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.064+0000 7fd9ccc3a700 1 -- 172.21.15.26:0/1075458245 wait complete. 2021-11-03T18:08:46.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.164+0000 7f9e4b664700 1 -- 172.21.15.26:0/2110255728 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e440f55e0 msgr2=0x7f9e440f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:08:46.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.164+0000 7f9e4b664700 1 --2- 172.21.15.26:0/2110255728 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e440f55e0 0x7f9e440f5a00 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 rx=0x7f9e40004660 tx=0x7f9e40009b30).stop 2021-11-03T18:08:46.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.164+0000 7f9e4b664700 1 -- 172.21.15.26:0/2110255728 shutdown_connections 2021-11-03T18:08:46.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.164+0000 7f9e4b664700 1 --2- 172.21.15.26:0/2110255728 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e440f5ef0 0x7f9e440f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:46.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.164+0000 7f9e4b664700 1 --2- 172.21.15.26:0/2110255728 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e440f55e0 0x7f9e440f5a00 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:46.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.164+0000 7f9e4b664700 1 -- 172.21.15.26:0/2110255728 >> 172.21.15.26:0/2110255728 conn(0x7f9e440f0de0 msgr2=0x7f9e440f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:08:46.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.164+0000 7f9e4b664700 1 -- 172.21.15.26:0/2110255728 shutdown_connections 2021-11-03T18:08:46.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.164+0000 7f9e4b664700 1 -- 172.21.15.26:0/2110255728 wait complete. 2021-11-03T18:08:46.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.165+0000 7f9e4b664700 1 Processor -- start 2021-11-03T18:08:46.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.165+0000 7f9e4b664700 1 -- start start 2021-11-03T18:08:46.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.165+0000 7f9e4b664700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e440f55e0 0x7f9e44106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:08:46.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.165+0000 7f9e4b664700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e440f5ef0 0x7f9e44107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:08:46.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.165+0000 7f9e4b664700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e44107a00 con 0x7f9e440f5ef0 2021-11-03T18:08:46.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.165+0000 7f9e4b664700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e44107b40 con 0x7f9e440f55e0 2021-11-03T18:08:46.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.165+0000 7f9e48bff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e440f5ef0 0x7f9e44107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:08:46.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.165+0000 7f9e48bff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e440f5ef0 0x7f9e44107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58382/0 (socket says 172.21.15.26:58382) 2021-11-03T18:08:46.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.165+0000 7f9e48bff700 1 -- 172.21.15.26:0/240719227 learned_addr learned my addr 172.21.15.26:0/240719227 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:08:46.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.166+0000 7f9e48bff700 1 -- 172.21.15.26:0/240719227 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e440f55e0 msgr2=0x7f9e44106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:08:46.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.166+0000 7f9e48bff700 1 --2- 172.21.15.26:0/240719227 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e440f55e0 0x7f9e44106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:08:46.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.166+0000 7f9e48bff700 1 -- 172.21.15.26:0/240719227 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e40005040 con 0x7f9e440f5ef0 2021-11-03T18:08:46.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.166+0000 7f9e48bff700 1 --2- 172.21.15.26:0/240719227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e440f5ef0 0x7f9e44107450 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 rx=0x7f9e340026d0 tx=0x7f9e34009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:08:46.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.166+0000 7f9e39ffb700 1 -- 172.21.15.26:0/240719227 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e34009320 con 0x7f9e440f5ef0 2021-11-03T18:08:46.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.166+0000 7f9e39ffb700 1 -- 172.21.15.26:0/240719227 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9e3400f040 con 0x7f9e440f5ef0 2021-11-03T18:08:46.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.166+0000 7f9e39ffb700 1 -- 172.21.15.26:0/240719227 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e340147e0 con 0x7f9e440f5ef0 2021-11-03T18:08:46.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.166+0000 7f9e4b664700 1 -- 172.21.15.26:0/240719227 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e441084e0 con 0x7f9e440f5ef0 2021-11-03T18:08:46.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.166+0000 7f9e4b664700 1 -- 172.21.15.26:0/240719227 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e44108aa0 con 0x7f9e440f5ef0 2021-11-03T18:08:46.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.167+0000 7f9e4b664700 1 -- 172.21.15.26:0/240719227 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e44045ad0 con 0x7f9e440f5ef0 2021-11-03T18:08:46.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.167+0000 7f9e39ffb700 1 -- 172.21.15.26:0/240719227 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f9e34009480 con 0x7f9e440f5ef0 2021-11-03T18:08:46.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.168+0000 7f9e39ffb700 1 --2- 172.21.15.26:0/240719227 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9e300640b0 0x7f9e30066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:08:46.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.168+0000 7f9e39ffb700 1 -- 172.21.15.26:0/240719227 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f9e34080df0 con 0x7f9e440f5ef0 2021-11-03T18:08:46.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.168+0000 7f9e49400700 1 --2- 172.21.15.26:0/240719227 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9e300640b0 0x7f9e30066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:08:46.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.168+0000 7f9e49400700 1 --2- 172.21.15.26:0/240719227 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9e300640b0 0x7f9e30066570 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f9e40004e30 tx=0x7f9e40009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:08:46.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.172+0000 7f9e39ffb700 1 -- 172.21.15.26:0/240719227 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f9e34053210 con 0x7f9e440f5ef0 2021-11-03T18:08:46.403 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.404+0000 7f9e4b664700 1 -- 172.21.15.26:0/240719227 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9e4410d580 con 0x7f9e440f5ef0 2021-11-03T18:08:46.404 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.405+0000 7f9e39ffb700 1 -- 172.21.15.26:0/240719227 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f9e34052e00 con 0x7f9e440f5ef0 2021-11-03T18:08:46.405 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:08:46.406 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:08:46.406 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:08:46.407 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:08:46.407 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:08:46.408 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:08:46.408 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:08:46.409 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:08:46.409 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:08:46.409 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:08:46.410 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:08:46.411 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:08:46.411 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:08:46.412 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:08:46.412 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:08:46.412 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:08:46.413 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:08:46.413 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:08:46.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.406+0000 7f9e4b664700 1 -- 172.21.15.26:0/240719227 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9e300640b0 msgr2=0x7f9e30066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:08:46.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.406+0000 7f9e4b664700 1 --2- 172.21.15.26:0/240719227 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9e300640b0 0x7f9e30066570 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f9e40004e30 tx=0x7f9e40009b30).stop 2021-11-03T18:08:46.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.406+0000 7f9e4b664700 1 -- 172.21.15.26:0/240719227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e440f5ef0 msgr2=0x7f9e44107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:08:46.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.406+0000 7f9e4b664700 1 --2- 172.21.15.26:0/240719227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e440f5ef0 0x7f9e44107450 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 rx=0x7f9e340026d0 tx=0x7f9e34009de0).stop 2021-11-03T18:08:46.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.407+0000 7f9e4b664700 1 -- 172.21.15.26:0/240719227 shutdown_connections 2021-11-03T18:08:46.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.407+0000 7f9e4b664700 1 --2- 172.21.15.26:0/240719227 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9e300640b0 0x7f9e30066570 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:46.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.407+0000 7f9e4b664700 1 --2- 172.21.15.26:0/240719227 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e440f55e0 0x7f9e44106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:08:46.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.407+0000 7f9e4b664700 1 --2- 172.21.15.26:0/240719227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e440f5ef0 0x7f9e44107450 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:46.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.407+0000 7f9e4b664700 1 -- 172.21.15.26:0/240719227 >> 172.21.15.26:0/240719227 conn(0x7f9e440f0de0 msgr2=0x7f9e4405ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:08:46.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.407+0000 7f9e4b664700 1 -- 172.21.15.26:0/240719227 shutdown_connections 2021-11-03T18:08:46.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.407+0000 7f9e4b664700 1 -- 172.21.15.26:0/240719227 wait complete. 2021-11-03T18:08:46.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.508+0000 7ff8d6c53700 1 -- 172.21.15.26:0/1423669080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8d00f9860 msgr2=0x7ff8d00fbc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:08:46.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.508+0000 7ff8d6c53700 1 --2- 172.21.15.26:0/1423669080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8d00f9860 0x7ff8d00fbc90 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7ff8bc004660 tx=0x7ff8bc009b30).stop 2021-11-03T18:08:46.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.508+0000 7ff8d6c53700 1 -- 172.21.15.26:0/1423669080 shutdown_connections 2021-11-03T18:08:46.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.508+0000 7ff8d6c53700 1 --2- 172.21.15.26:0/1423669080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8d00f9860 0x7ff8d00fbc90 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:46.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.508+0000 7ff8d6c53700 1 --2- 172.21.15.26:0/1423669080 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8d0060410 0x7ff8d00f92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:08:46.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.508+0000 7ff8d6c53700 1 -- 172.21.15.26:0/1423669080 >> 172.21.15.26:0/1423669080 conn(0x7ff8d00f0d40 msgr2=0x7ff8d00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:08:46.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.508+0000 7ff8d6c53700 1 -- 172.21.15.26:0/1423669080 shutdown_connections 2021-11-03T18:08:46.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.508+0000 7ff8d6c53700 1 -- 172.21.15.26:0/1423669080 wait complete. 2021-11-03T18:08:46.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.508+0000 7ff8d6c53700 1 Processor -- start 2021-11-03T18:08:46.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.508+0000 7ff8d6c53700 1 -- start start 2021-11-03T18:08:46.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.509+0000 7ff8d6c53700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8d0060410 0x7ff8d00f6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:08:46.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.509+0000 7ff8d6c53700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8d00f9860 0x7ff8d00f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:08:46.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.509+0000 7ff8d6c53700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d00f57d0 con 0x7ff8d0060410 2021-11-03T18:08:46.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.509+0000 7ff8d6c53700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d00f5910 con 0x7ff8d00f9860 2021-11-03T18:08:46.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.509+0000 7ff8d49ef700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8d0060410 0x7ff8d00f6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:08:46.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.509+0000 7ff8d49ef700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8d0060410 0x7ff8d00f6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58390/0 (socket says 172.21.15.26:58390) 2021-11-03T18:08:46.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.509+0000 7ff8d49ef700 1 -- 172.21.15.26:0/2821862296 learned_addr learned my addr 172.21.15.26:0/2821862296 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:08:46.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.509+0000 7ff8cffff700 1 --2- 172.21.15.26:0/2821862296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8d00f9860 0x7ff8d00f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:08:46.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.509+0000 7ff8d49ef700 1 -- 172.21.15.26:0/2821862296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8d00f9860 msgr2=0x7ff8d00f51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:08:46.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.509+0000 7ff8d49ef700 1 --2- 172.21.15.26:0/2821862296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8d00f9860 0x7ff8d00f51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:46.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.509+0000 7ff8d49ef700 1 -- 172.21.15.26:0/2821862296 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8bc005040 con 0x7ff8d0060410 2021-11-03T18:08:46.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.509+0000 7ff8cffff700 1 --2- 172.21.15.26:0/2821862296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8d00f9860 0x7ff8d00f51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:08:46.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.509+0000 7ff8d49ef700 1 --2- 172.21.15.26:0/2821862296 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8d0060410 0x7ff8d00f6d60 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 rx=0x7ff8c400b410 tx=0x7ff8c4006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:08:46.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.509+0000 7ff8cd7fa700 1 -- 172.21.15.26:0/2821862296 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8c40125f0 con 0x7ff8d0060410 2021-11-03T18:08:46.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.509+0000 7ff8cd7fa700 1 -- 172.21.15.26:0/2821862296 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff8c4012c00 con 0x7ff8d0060410 2021-11-03T18:08:46.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.509+0000 7ff8d6c53700 1 -- 172.21.15.26:0/2821862296 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8d00f5bf0 con 0x7ff8d0060410 2021-11-03T18:08:46.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.509+0000 7ff8cd7fa700 1 -- 172.21.15.26:0/2821862296 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8c4002ae0 con 0x7ff8d0060410 2021-11-03T18:08:46.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.510+0000 7ff8d6c53700 1 -- 172.21.15.26:0/2821862296 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d010efc0 con 0x7ff8d0060410 2021-11-03T18:08:46.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.510+0000 7ff8d6c53700 1 -- 172.21.15.26:0/2821862296 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8d0045ad0 con 0x7ff8d0060410 2021-11-03T18:08:46.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.511+0000 7ff8cd7fa700 1 -- 172.21.15.26:0/2821862296 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ff8c400f030 con 0x7ff8d0060410 2021-11-03T18:08:46.517 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.511+0000 7ff8cd7fa700 1 --2- 172.21.15.26:0/2821862296 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff8c0064090 0x7ff8c0066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:08:46.517 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.511+0000 7ff8cd7fa700 1 -- 172.21.15.26:0/2821862296 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ff8c4080810 con 0x7ff8d0060410 2021-11-03T18:08:46.518 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.511+0000 7ff8cffff700 1 --2- 172.21.15.26:0/2821862296 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff8c0064090 0x7ff8c0066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:08:46.518 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.512+0000 7ff8cffff700 1 --2- 172.21.15.26:0/2821862296 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff8c0064090 0x7ff8c0066550 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7ff8bc013690 tx=0x7ff8bc009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:08:46.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.515+0000 7ff8cd7fa700 1 -- 172.21.15.26:0/2821862296 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ff8c4052b50 con 0x7ff8d0060410 2021-11-03T18:08:46.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.720+0000 7ff8d6c53700 1 -- 172.21.15.26:0/2821862296 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff8d0027a00 con 0x7ff8d0060410 2021-11-03T18:08:46.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.720+0000 7ff8cd7fa700 1 -- 172.21.15.26:0/2821862296 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7ff8c4052740 con 0x7ff8d0060410 2021-11-03T18:08:46.720 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:08:46.720 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:08:46.720 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:08:46.721 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:08:46.721 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:08:46.721 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:08:46.721 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:08:46.722 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:08:46.722 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:08:46.722 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:08:46.722 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:08:46.723 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:08:46.723 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:08:46.723 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:08:46.724 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:08:46.724 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:08:46.724 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:08:46.724 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:08:46.725 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:08:46.725 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:08:46.725 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:08:46.725 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:08:46.725 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:08:46.726 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:08:46.726 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:08:46.726 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:08:46.726 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:08:46.727 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:08:46.727 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:08:46.727 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:08:46.727 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:08:46.728 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:08:46.728 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:08:46.728 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:08:46.728 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:08:46.729 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:08:46.729 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:08:46.729 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:08:46.729 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:08:46.731 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.722+0000 7ff8d6c53700 1 -- 172.21.15.26:0/2821862296 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff8c0064090 msgr2=0x7ff8c0066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:08:46.731 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.722+0000 7ff8d6c53700 1 --2- 172.21.15.26:0/2821862296 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff8c0064090 0x7ff8c0066550 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7ff8bc013690 tx=0x7ff8bc009b30).stop 2021-11-03T18:08:46.731 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.722+0000 7ff8d6c53700 1 -- 172.21.15.26:0/2821862296 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8d0060410 msgr2=0x7ff8d00f6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:08:46.732 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.722+0000 7ff8d6c53700 1 --2- 172.21.15.26:0/2821862296 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8d0060410 0x7ff8d00f6d60 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 rx=0x7ff8c400b410 tx=0x7ff8c4006ef0).stop 2021-11-03T18:08:46.732 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.722+0000 7ff8d6c53700 1 -- 172.21.15.26:0/2821862296 shutdown_connections 2021-11-03T18:08:46.732 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.722+0000 7ff8d6c53700 1 --2- 172.21.15.26:0/2821862296 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff8c0064090 0x7ff8c0066550 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:46.732 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.722+0000 7ff8d6c53700 1 --2- 172.21.15.26:0/2821862296 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8d0060410 0x7ff8d00f6d60 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:46.732 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.722+0000 7ff8d6c53700 1 --2- 172.21.15.26:0/2821862296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8d00f9860 0x7ff8d00f51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:08:46.733 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.722+0000 7ff8d6c53700 1 -- 172.21.15.26:0/2821862296 >> 172.21.15.26:0/2821862296 conn(0x7ff8d00f0d40 msgr2=0x7ff8d00f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:08:46.733 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.722+0000 7ff8d6c53700 1 -- 172.21.15.26:0/2821862296 shutdown_connections 2021-11-03T18:08:46.733 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:08:46.722+0000 7ff8d6c53700 1 -- 172.21.15.26:0/2821862296 wait complete. 2021-11-03T18:08:46.733 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:08:47.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:46 smithi026 ceph-mon[96795]: pgmap v2223: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:47.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:46 smithi026 ceph-mon[96795]: from='client.36428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:08:47.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:46 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/240719227' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:08:47.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:46 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2821862296' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:08:47.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:46 smithi194 ceph-mon[65619]: pgmap v2223: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:47.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:46 smithi194 ceph-mon[65619]: from='client.36428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:08:47.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:46 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/240719227' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:08:47.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:46 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2821862296' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:08:48.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:47 smithi026 ceph-mon[96795]: from='client.36432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:08:48.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:47 smithi194 ceph-mon[65619]: from='client.36432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:08:49.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:48 smithi026 ceph-mon[96795]: pgmap v2224: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:49.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:08:49.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:08:49.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:48 smithi194 ceph-mon[65619]: pgmap v2224: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:49.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:08:49.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:08:51.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:50 smithi026 ceph-mon[96795]: pgmap v2225: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:51.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:50 smithi194 ceph-mon[65619]: pgmap v2225: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:53.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:52 smithi026 ceph-mon[96795]: pgmap v2226: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:53.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:52 smithi194 ceph-mon[65619]: pgmap v2226: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:55.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:54 smithi026 ceph-mon[96795]: pgmap v2227: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:55.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:54 smithi194 ceph-mon[65619]: pgmap v2227: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:57.066 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:56 smithi026 ceph-mon[96795]: pgmap v2228: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:57.066 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:56 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:08:57.066 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:56 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:08:57.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:56 smithi194 ceph-mon[65619]: pgmap v2228: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:57.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:56 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:08:57.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:56 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:08:58.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:57 smithi026 ceph-mon[96795]: poll took 60067.418 ms: 1 events 2021-11-03T18:08:58.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:57 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:08:58.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:57 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:08:58.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:57 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:08:58.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:57 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:08:58.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:57 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:08:58.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:57 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:08:58.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:57 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:08:58.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:57 smithi194 ceph-mon[65619]: poll took 60067.418 ms: 1 events 2021-11-03T18:08:58.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:57 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:08:58.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:57 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:08:58.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:57 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:08:58.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:57 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:08:58.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:57 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:08:58.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:57 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:08:58.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:57 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:08:59.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:58 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:08:59.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:58 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:08:59.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:08:58 smithi026 ceph-mon[96795]: pgmap v2229: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:08:59.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:58 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:08:59.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:58 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:08:59.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:08:58 smithi194 ceph-mon[65619]: pgmap v2229: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:01.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:00 smithi026 ceph-mon[96795]: pgmap v2230: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:01.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:00 smithi194 ceph-mon[65619]: pgmap v2230: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:03.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:02 smithi026 ceph-mon[96795]: pgmap v2231: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:03.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:02 smithi194 ceph-mon[65619]: pgmap v2231: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:05.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:04 smithi026 ceph-mon[96795]: pgmap v2232: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:05.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:04 smithi194 ceph-mon[65619]: pgmap v2232: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:07.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:06 smithi026 ceph-mon[96795]: pgmap v2233: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:07.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:06 smithi194 ceph-mon[65619]: pgmap v2233: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:09.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:08 smithi026 ceph-mon[96795]: pgmap v2234: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:09.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:08 smithi194 ceph-mon[65619]: pgmap v2234: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:11.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:10 smithi026 ceph-mon[96795]: pgmap v2235: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:11.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:10 smithi194 ceph-mon[65619]: pgmap v2235: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:13.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:12 smithi026 ceph-mon[96795]: pgmap v2236: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:13.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:12 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:09:13.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:12 smithi194 ceph-mon[65619]: pgmap v2236: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:13.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:12 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:09:14.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:13 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:09:14.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:13 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:09:15.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:14 smithi026 ceph-mon[96795]: pgmap v2237: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:15.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:14 smithi194 ceph-mon[65619]: pgmap v2237: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:16.838 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:16.840+0000 7f88aa6bd700 1 -- 172.21.15.26:0/407689860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a40f6530 msgr2=0x7f88a40f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:09:16.839 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:16.840+0000 7f88aa6bd700 1 --2- 172.21.15.26:0/407689860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a40f6530 0x7f88a40f6950 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7f88a0004660 tx=0x7f88a0009b30).stop 2021-11-03T18:09:16.839 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:16.840+0000 7f88aa6bd700 1 -- 172.21.15.26:0/407689860 shutdown_connections 2021-11-03T18:09:16.839 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:16.840+0000 7f88aa6bd700 1 --2- 172.21.15.26:0/407689860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88a40f77d0 0x7f88a40f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:16.839 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:16.840+0000 7f88aa6bd700 1 --2- 172.21.15.26:0/407689860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a40f6530 0x7f88a40f6950 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:16.840 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:16.840+0000 7f88aa6bd700 1 -- 172.21.15.26:0/407689860 >> 172.21.15.26:0/407689860 conn(0x7f88a40f1cd0 msgr2=0x7f88a40f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:09:16.840 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:16.840+0000 7f88aa6bd700 1 -- 172.21.15.26:0/407689860 shutdown_connections 2021-11-03T18:09:16.840 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:16.840+0000 7f88aa6bd700 1 -- 172.21.15.26:0/407689860 wait complete. 2021-11-03T18:09:16.840 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:16.840+0000 7f88aa6bd700 1 Processor -- start 2021-11-03T18:09:16.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:16.840+0000 7f88aa6bd700 1 -- start start 2021-11-03T18:09:16.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:16.840+0000 7f88aa6bd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88a40f6530 0x7f88a406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:09:16.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:16.840+0000 7f88aa6bd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a40f77d0 0x7f88a4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:09:16.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:16.840+0000 7f88aa6bd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a406a380 con 0x7f88a40f77d0 2021-11-03T18:09:16.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:16.840+0000 7f88aa6bd700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a406a4c0 con 0x7f88a40f6530 2021-11-03T18:09:16.842 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:16.841+0000 7f88a8eba700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a40f77d0 0x7f88a4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:09:16.842 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:16.841+0000 7f88a8eba700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a40f77d0 0x7f88a4069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58414/0 (socket says 172.21.15.26:58414) 2021-11-03T18:09:16.842 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:16.841+0000 7f88a8eba700 1 -- 172.21.15.26:0/2669153345 learned_addr learned my addr 172.21.15.26:0/2669153345 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:09:16.842 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:16.841+0000 7f88a96bb700 1 --2- 172.21.15.26:0/2669153345 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88a40f6530 0x7f88a406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:09:16.843 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:16.841+0000 7f88a8eba700 1 -- 172.21.15.26:0/2669153345 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88a40f6530 msgr2=0x7f88a406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:09:16.843 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:16.841+0000 7f88a8eba700 1 --2- 172.21.15.26:0/2669153345 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88a40f6530 0x7f88a406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:16.843 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:16.841+0000 7f88a8eba700 1 -- 172.21.15.26:0/2669153345 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a0005040 con 0x7f88a40f77d0 2021-11-03T18:09:16.843 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:16.841+0000 7f88a8eba700 1 --2- 172.21.15.26:0/2669153345 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a40f77d0 0x7f88a4069e20 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 rx=0x7f889400c530 tx=0x7f8894007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:09:16.843 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:16.841+0000 7f8899ffb700 1 -- 172.21.15.26:0/2669153345 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f889400f650 con 0x7f88a40f77d0 2021-11-03T18:09:16.844 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:16.841+0000 7f88aa6bd700 1 -- 172.21.15.26:0/2669153345 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88a406a7a0 con 0x7f88a40f77d0 2021-11-03T18:09:16.844 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:16.841+0000 7f8899ffb700 1 -- 172.21.15.26:0/2669153345 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f889400fc60 con 0x7f88a40f77d0 2021-11-03T18:09:16.844 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:16.841+0000 7f8899ffb700 1 -- 172.21.15.26:0/2669153345 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8894012c20 con 0x7f88a40f77d0 2021-11-03T18:09:16.845 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:16.842+0000 7f88aa6bd700 1 -- 172.21.15.26:0/2669153345 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88a410ed90 con 0x7f88a40f77d0 2021-11-03T18:09:16.846 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:16.843+0000 7f88aa6bd700 1 -- 172.21.15.26:0/2669153345 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88a4045ad0 con 0x7f88a40f77d0 2021-11-03T18:09:16.846 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:16.843+0000 7f8899ffb700 1 -- 172.21.15.26:0/2669153345 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f8894010070 con 0x7f88a40f77d0 2021-11-03T18:09:16.846 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:16.843+0000 7f8899ffb700 1 --2- 172.21.15.26:0/2669153345 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8890064100 0x7f88900665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:09:16.846 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:16.843+0000 7f8899ffb700 1 -- 172.21.15.26:0/2669153345 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f8894080680 con 0x7f88a40f77d0 2021-11-03T18:09:16.847 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:16.843+0000 7f88a96bb700 1 --2- 172.21.15.26:0/2669153345 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8890064100 0x7f88900665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:09:16.847 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:16.844+0000 7f88a96bb700 1 --2- 172.21.15.26:0/2669153345 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8890064100 0x7f88900665c0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f88a0013690 tx=0x7f88a0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:09:16.847 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:16.847+0000 7f8899ffb700 1 -- 172.21.15.26:0/2669153345 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f88940528f0 con 0x7f88a40f77d0 2021-11-03T18:09:17.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.028+0000 7f88aa6bd700 1 -- 172.21.15.26:0/2669153345 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f88a40fee00 con 0x7f8890064100 2021-11-03T18:09:17.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.029+0000 7f8899ffb700 1 -- 172.21.15.26:0/2669153345 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f88a40fee00 con 0x7f8890064100 2021-11-03T18:09:17.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.031+0000 7f88aa6bd700 1 -- 172.21.15.26:0/2669153345 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8890064100 msgr2=0x7f88900665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:09:17.030 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.031+0000 7f88aa6bd700 1 --2- 172.21.15.26:0/2669153345 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8890064100 0x7f88900665c0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f88a0013690 tx=0x7f88a0009b30).stop 2021-11-03T18:09:17.030 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.031+0000 7f88aa6bd700 1 -- 172.21.15.26:0/2669153345 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a40f77d0 msgr2=0x7f88a4069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:09:17.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.031+0000 7f88aa6bd700 1 --2- 172.21.15.26:0/2669153345 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a40f77d0 0x7f88a4069e20 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 rx=0x7f889400c530 tx=0x7f8894007e20).stop 2021-11-03T18:09:17.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.031+0000 7f88aa6bd700 1 -- 172.21.15.26:0/2669153345 shutdown_connections 2021-11-03T18:09:17.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.031+0000 7f88aa6bd700 1 --2- 172.21.15.26:0/2669153345 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8890064100 0x7f88900665c0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:17.032 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.031+0000 7f88aa6bd700 1 --2- 172.21.15.26:0/2669153345 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88a40f6530 0x7f88a406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:17.032 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.031+0000 7f88aa6bd700 1 --2- 172.21.15.26:0/2669153345 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a40f77d0 0x7f88a4069e20 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:17.033 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.031+0000 7f88aa6bd700 1 -- 172.21.15.26:0/2669153345 >> 172.21.15.26:0/2669153345 conn(0x7f88a40f1cd0 msgr2=0x7f88a40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:09:17.034 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.031+0000 7f88aa6bd700 1 -- 172.21.15.26:0/2669153345 shutdown_connections 2021-11-03T18:09:17.034 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.031+0000 7f88aa6bd700 1 -- 172.21.15.26:0/2669153345 wait complete. 2021-11-03T18:09:17.038 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:09:17.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.131+0000 7fc4d88c9700 1 -- 172.21.15.26:0/42758997 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4d40f7550 msgr2=0x7fc4d40f47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:09:17.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.131+0000 7fc4d88c9700 1 --2- 172.21.15.26:0/42758997 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4d40f7550 0x7fc4d40f47e0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 rx=0x7fc4c8004660 tx=0x7fc4c8009b30).stop 2021-11-03T18:09:17.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.132+0000 7fc4d88c9700 1 -- 172.21.15.26:0/42758997 shutdown_connections 2021-11-03T18:09:17.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.132+0000 7fc4d88c9700 1 --2- 172.21.15.26:0/42758997 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4d40f7550 0x7fc4d40f47e0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:17.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.132+0000 7fc4d88c9700 1 --2- 172.21.15.26:0/42758997 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4d40f6bb0 0x7fc4d40f6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:09:17.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.132+0000 7fc4d88c9700 1 -- 172.21.15.26:0/42758997 >> 172.21.15.26:0/42758997 conn(0x7fc4d40f04c0 msgr2=0x7fc4d40f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:09:17.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.132+0000 7fc4d88c9700 1 -- 172.21.15.26:0/42758997 shutdown_connections 2021-11-03T18:09:17.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.132+0000 7fc4d88c9700 1 -- 172.21.15.26:0/42758997 wait complete. 2021-11-03T18:09:17.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.132+0000 7fc4d88c9700 1 Processor -- start 2021-11-03T18:09:17.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.132+0000 7fc4d88c9700 1 -- start start 2021-11-03T18:09:17.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.132+0000 7fc4d88c9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4d40f6bb0 0x7fc4d4109160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:09:17.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.132+0000 7fc4d88c9700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4d40f7550 0x7fc4d4109650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:09:17.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.132+0000 7fc4d88c9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d4109c90 con 0x7fc4d40f6bb0 2021-11-03T18:09:17.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.132+0000 7fc4d88c9700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d410a540 con 0x7fc4d40f7550 2021-11-03T18:09:17.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.132+0000 7fc4d259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4d40f6bb0 0x7fc4d4109160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:09:17.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.132+0000 7fc4d259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4d40f6bb0 0x7fc4d4109160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58422/0 (socket says 172.21.15.26:58422) 2021-11-03T18:09:17.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.132+0000 7fc4d259c700 1 -- 172.21.15.26:0/1990491536 learned_addr learned my addr 172.21.15.26:0/1990491536 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:09:17.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.133+0000 7fc4d1d9b700 1 --2- 172.21.15.26:0/1990491536 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4d40f7550 0x7fc4d4109650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:09:17.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.133+0000 7fc4d259c700 1 -- 172.21.15.26:0/1990491536 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4d40f7550 msgr2=0x7fc4d4109650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:09:17.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.133+0000 7fc4d259c700 1 --2- 172.21.15.26:0/1990491536 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4d40f7550 0x7fc4d4109650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:17.139 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.133+0000 7fc4d259c700 1 -- 172.21.15.26:0/1990491536 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c8005040 con 0x7fc4d40f6bb0 2021-11-03T18:09:17.139 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.133+0000 7fc4d259c700 1 --2- 172.21.15.26:0/1990491536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4d40f6bb0 0x7fc4d4109160 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 rx=0x7fc4c400b410 tx=0x7fc4c4006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:09:17.139 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.133+0000 7fc4c2ffd700 1 -- 172.21.15.26:0/1990491536 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4c40125f0 con 0x7fc4d40f6bb0 2021-11-03T18:09:17.139 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.133+0000 7fc4c2ffd700 1 -- 172.21.15.26:0/1990491536 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc4c4012c00 con 0x7fc4d40f6bb0 2021-11-03T18:09:17.140 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.133+0000 7fc4d88c9700 1 -- 172.21.15.26:0/1990491536 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4d410a820 con 0x7fc4d40f6bb0 2021-11-03T18:09:17.140 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.133+0000 7fc4c2ffd700 1 -- 172.21.15.26:0/1990491536 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4c4002ae0 con 0x7fc4d40f6bb0 2021-11-03T18:09:17.141 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.133+0000 7fc4d88c9700 1 -- 172.21.15.26:0/1990491536 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4d410ade0 con 0x7fc4d40f6bb0 2021-11-03T18:09:17.141 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.134+0000 7fc4d88c9700 1 -- 172.21.15.26:0/1990491536 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4d40f4150 con 0x7fc4d40f6bb0 2021-11-03T18:09:17.142 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.134+0000 7fc4c2ffd700 1 -- 172.21.15.26:0/1990491536 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc4c400f030 con 0x7fc4d40f6bb0 2021-11-03T18:09:17.142 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.135+0000 7fc4c2ffd700 1 --2- 172.21.15.26:0/1990491536 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc4bc0640b0 0x7fc4bc066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:09:17.143 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.135+0000 7fc4c2ffd700 1 -- 172.21.15.26:0/1990491536 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc4c4080cb0 con 0x7fc4d40f6bb0 2021-11-03T18:09:17.143 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.135+0000 7fc4d1d9b700 1 --2- 172.21.15.26:0/1990491536 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc4bc0640b0 0x7fc4bc066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:09:17.143 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.135+0000 7fc4d1d9b700 1 --2- 172.21.15.26:0/1990491536 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc4bc0640b0 0x7fc4bc066570 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7fc4c8004e30 tx=0x7fc4c8009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:09:17.144 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.139+0000 7fc4c2ffd700 1 -- 172.21.15.26:0/1990491536 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc4c4053010 con 0x7fc4d40f6bb0 2021-11-03T18:09:17.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:16 smithi026 ceph-mon[96795]: pgmap v2238: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:17.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:16 smithi194 ceph-mon[65619]: pgmap v2238: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:17.311 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.313+0000 7fc4d88c9700 1 -- 172.21.15.26:0/1990491536 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc4d4101110 con 0x7fc4bc0640b0 2021-11-03T18:09:17.326 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.328+0000 7fc4c2ffd700 1 -- 172.21.15.26:0/1990491536 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fc4d4101110 con 0x7fc4bc0640b0 2021-11-03T18:09:17.326 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:09:17.327 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (80m) 9m ago 81m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:09:17.327 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (72m) 9m ago 81m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:09:17.327 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (72m) 8m ago 81m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:09:17.328 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (80m) 9m ago 81m 41.7M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:09:17.329 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (73m) 9m ago 76m 25.6M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:09:17.329 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (73m) 9m ago 76m 26.2M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:09:17.329 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (76m) 8m ago 76m 26.4M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:09:17.329 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (76m) 8m ago 76m 26.8M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:09:17.329 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (74m) 9m ago 83m 561M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:09:17.330 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (73m) 8m ago 80m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:09:17.330 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (73m) 9m ago 83m 276M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:09:17.330 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (73m) 8m ago 80m 132M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:09:17.331 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (81m) 9m ago 81m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:09:17.331 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (80m) 8m ago 80m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:09:17.331 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (72m) 9m ago 80m 292M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:09:17.332 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (71m) 9m ago 79m 313M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:09:17.332 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (71m) 9m ago 79m 261M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:09:17.332 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (70m) 8m ago 79m 337M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:09:17.332 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (70m) 8m ago 78m 283M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:09:17.333 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (69m) 8m ago 78m 276M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:09:17.333 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (80m) 9m ago 81m 61.2M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:09:17.334 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.330+0000 7fc4d88c9700 1 -- 172.21.15.26:0/1990491536 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc4bc0640b0 msgr2=0x7fc4bc066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:09:17.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.330+0000 7fc4d88c9700 1 --2- 172.21.15.26:0/1990491536 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc4bc0640b0 0x7fc4bc066570 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7fc4c8004e30 tx=0x7fc4c8009b30).stop 2021-11-03T18:09:17.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.330+0000 7fc4d88c9700 1 -- 172.21.15.26:0/1990491536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4d40f6bb0 msgr2=0x7fc4d4109160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:09:17.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.330+0000 7fc4d88c9700 1 --2- 172.21.15.26:0/1990491536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4d40f6bb0 0x7fc4d4109160 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 rx=0x7fc4c400b410 tx=0x7fc4c4006ef0).stop 2021-11-03T18:09:17.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.330+0000 7fc4d88c9700 1 -- 172.21.15.26:0/1990491536 shutdown_connections 2021-11-03T18:09:17.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.330+0000 7fc4d88c9700 1 --2- 172.21.15.26:0/1990491536 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc4bc0640b0 0x7fc4bc066570 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:17.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.330+0000 7fc4d88c9700 1 --2- 172.21.15.26:0/1990491536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4d40f6bb0 0x7fc4d4109160 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:17.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.330+0000 7fc4d88c9700 1 --2- 172.21.15.26:0/1990491536 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4d40f7550 0x7fc4d4109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:17.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.330+0000 7fc4d88c9700 1 -- 172.21.15.26:0/1990491536 >> 172.21.15.26:0/1990491536 conn(0x7fc4d40f04c0 msgr2=0x7fc4d40fe700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:09:17.338 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.330+0000 7fc4d88c9700 1 -- 172.21.15.26:0/1990491536 shutdown_connections 2021-11-03T18:09:17.338 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.330+0000 7fc4d88c9700 1 -- 172.21.15.26:0/1990491536 wait complete. 2021-11-03T18:09:17.428 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.429+0000 7fc220dae700 1 -- 172.21.15.26:0/2319521539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc21c0f66e0 msgr2=0x7fc21c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:09:17.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.429+0000 7fc220dae700 1 --2- 172.21.15.26:0/2319521539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc21c0f66e0 0x7fc21c0f6b00 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 rx=0x7fc2140099e0 tx=0x7fc214004d10).stop 2021-11-03T18:09:17.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.429+0000 7fc220dae700 1 -- 172.21.15.26:0/2319521539 shutdown_connections 2021-11-03T18:09:17.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.429+0000 7fc220dae700 1 --2- 172.21.15.26:0/2319521539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc21c0f6ff0 0x7fc21c0f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:09:17.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.429+0000 7fc220dae700 1 --2- 172.21.15.26:0/2319521539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc21c0f66e0 0x7fc21c0f6b00 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:17.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.429+0000 7fc220dae700 1 -- 172.21.15.26:0/2319521539 >> 172.21.15.26:0/2319521539 conn(0x7fc21c0f1f00 msgr2=0x7fc21c0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:09:17.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.429+0000 7fc220dae700 1 -- 172.21.15.26:0/2319521539 shutdown_connections 2021-11-03T18:09:17.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.429+0000 7fc220dae700 1 -- 172.21.15.26:0/2319521539 wait complete. 2021-11-03T18:09:17.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.429+0000 7fc220dae700 1 Processor -- start 2021-11-03T18:09:17.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.429+0000 7fc220dae700 1 -- start start 2021-11-03T18:09:17.432 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.430+0000 7fc220dae700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc21c0f66e0 0x7fc21c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:09:17.432 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.430+0000 7fc220dae700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc21c0f6ff0 0x7fc21c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:09:17.432 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.430+0000 7fc220dae700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c06a410 con 0x7fc21c0f6ff0 2021-11-03T18:09:17.433 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.430+0000 7fc220dae700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c06a550 con 0x7fc21c0f66e0 2021-11-03T18:09:17.433 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.430+0000 7fc219d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc21c0f6ff0 0x7fc21c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:09:17.433 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.430+0000 7fc219d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc21c0f6ff0 0x7fc21c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58434/0 (socket says 172.21.15.26:58434) 2021-11-03T18:09:17.433 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.430+0000 7fc219d9b700 1 -- 172.21.15.26:0/1079659834 learned_addr learned my addr 172.21.15.26:0/1079659834 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:09:17.434 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.430+0000 7fc21a59c700 1 --2- 172.21.15.26:0/1079659834 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc21c0f66e0 0x7fc21c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:09:17.434 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.430+0000 7fc219d9b700 1 -- 172.21.15.26:0/1079659834 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc21c0f66e0 msgr2=0x7fc21c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:09:17.434 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.430+0000 7fc219d9b700 1 --2- 172.21.15.26:0/1079659834 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc21c0f66e0 0x7fc21c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:17.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.430+0000 7fc219d9b700 1 -- 172.21.15.26:0/1079659834 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc214009640 con 0x7fc21c0f6ff0 2021-11-03T18:09:17.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.430+0000 7fc21a59c700 1 --2- 172.21.15.26:0/1079659834 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc21c0f66e0 0x7fc21c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:09:17.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.430+0000 7fc219d9b700 1 --2- 172.21.15.26:0/1079659834 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc21c0f6ff0 0x7fc21c069e20 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 rx=0x7fc20400b410 tx=0x7fc204006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:09:17.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.430+0000 7fc212ffd700 1 -- 172.21.15.26:0/1079659834 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2040125f0 con 0x7fc21c0f6ff0 2021-11-03T18:09:17.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.430+0000 7fc212ffd700 1 -- 172.21.15.26:0/1079659834 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc204012c00 con 0x7fc21c0f6ff0 2021-11-03T18:09:17.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.430+0000 7fc212ffd700 1 -- 172.21.15.26:0/1079659834 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc204002ae0 con 0x7fc21c0f6ff0 2021-11-03T18:09:17.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.430+0000 7fc220dae700 1 -- 172.21.15.26:0/1079659834 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc21c06a830 con 0x7fc21c0f6ff0 2021-11-03T18:09:17.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.430+0000 7fc220dae700 1 -- 172.21.15.26:0/1079659834 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc21c10f120 con 0x7fc21c0f6ff0 2021-11-03T18:09:17.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.431+0000 7fc220dae700 1 -- 172.21.15.26:0/1079659834 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc21c045ad0 con 0x7fc21c0f6ff0 2021-11-03T18:09:17.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.432+0000 7fc212ffd700 1 -- 172.21.15.26:0/1079659834 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc20400f030 con 0x7fc21c0f6ff0 2021-11-03T18:09:17.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.432+0000 7fc212ffd700 1 --2- 172.21.15.26:0/1079659834 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc2080640b0 0x7fc208066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:09:17.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.432+0000 7fc212ffd700 1 -- 172.21.15.26:0/1079659834 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc204080bf0 con 0x7fc21c0f6ff0 2021-11-03T18:09:17.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.432+0000 7fc21a59c700 1 --2- 172.21.15.26:0/1079659834 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc2080640b0 0x7fc208066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:09:17.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.433+0000 7fc21a59c700 1 --2- 172.21.15.26:0/1079659834 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc2080640b0 0x7fc208066570 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7fc214009f50 tx=0x7fc214004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:09:17.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.436+0000 7fc212ffd700 1 -- 172.21.15.26:0/1079659834 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc204052f50 con 0x7fc21c0f6ff0 2021-11-03T18:09:17.661 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.664+0000 7fc220dae700 1 -- 172.21.15.26:0/1079659834 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc21c0008d0 con 0x7fc21c0f6ff0 2021-11-03T18:09:17.662 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.665+0000 7fc212ffd700 1 -- 172.21.15.26:0/1079659834 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fc204052b40 con 0x7fc21c0f6ff0 2021-11-03T18:09:17.663 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:09:17.663 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:09:17.664 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:09:17.664 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:09:17.664 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:09:17.664 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:09:17.664 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:09:17.665 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:09:17.665 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:09:17.665 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:09:17.665 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:09:17.666 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:09:17.667 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:09:17.668 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:09:17.668 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:09:17.669 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:09:17.669 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:09:17.670 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:09:17.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.666+0000 7fc220dae700 1 -- 172.21.15.26:0/1079659834 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc2080640b0 msgr2=0x7fc208066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:09:17.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.666+0000 7fc220dae700 1 --2- 172.21.15.26:0/1079659834 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc2080640b0 0x7fc208066570 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7fc214009f50 tx=0x7fc214004d10).stop 2021-11-03T18:09:17.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.666+0000 7fc220dae700 1 -- 172.21.15.26:0/1079659834 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc21c0f6ff0 msgr2=0x7fc21c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:09:17.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.666+0000 7fc220dae700 1 --2- 172.21.15.26:0/1079659834 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc21c0f6ff0 0x7fc21c069e20 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 rx=0x7fc20400b410 tx=0x7fc204006ef0).stop 2021-11-03T18:09:17.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.667+0000 7fc220dae700 1 -- 172.21.15.26:0/1079659834 shutdown_connections 2021-11-03T18:09:17.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.667+0000 7fc220dae700 1 --2- 172.21.15.26:0/1079659834 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc2080640b0 0x7fc208066570 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:17.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.667+0000 7fc220dae700 1 --2- 172.21.15.26:0/1079659834 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc21c0f66e0 0x7fc21c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:17.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.667+0000 7fc220dae700 1 --2- 172.21.15.26:0/1079659834 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc21c0f6ff0 0x7fc21c069e20 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:17.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.667+0000 7fc220dae700 1 -- 172.21.15.26:0/1079659834 >> 172.21.15.26:0/1079659834 conn(0x7fc21c0f1f00 msgr2=0x7fc21c0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:09:17.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.667+0000 7fc220dae700 1 -- 172.21.15.26:0/1079659834 shutdown_connections 2021-11-03T18:09:17.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.667+0000 7fc220dae700 1 -- 172.21.15.26:0/1079659834 wait complete. 2021-11-03T18:09:17.764 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.766+0000 7ff4cdb84700 1 -- 172.21.15.26:0/1254762480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4c80f9850 msgr2=0x7ff4c80fbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:09:17.765 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.766+0000 7ff4cdb84700 1 --2- 172.21.15.26:0/1254762480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4c80f9850 0x7ff4c80fbc40 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 rx=0x7ff4bc004660 tx=0x7ff4bc009b30).stop 2021-11-03T18:09:17.765 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.767+0000 7ff4cdb84700 1 -- 172.21.15.26:0/1254762480 shutdown_connections 2021-11-03T18:09:17.765 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.767+0000 7ff4cdb84700 1 --2- 172.21.15.26:0/1254762480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4c80f9850 0x7ff4c80fbc40 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:17.765 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.767+0000 7ff4cdb84700 1 --2- 172.21.15.26:0/1254762480 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4c8060370 0x7ff4c80f9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:17.765 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.767+0000 7ff4cdb84700 1 -- 172.21.15.26:0/1254762480 >> 172.21.15.26:0/1254762480 conn(0x7ff4c80f0de0 msgr2=0x7ff4c80f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:09:17.766 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.767+0000 7ff4cdb84700 1 -- 172.21.15.26:0/1254762480 shutdown_connections 2021-11-03T18:09:17.766 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.767+0000 7ff4cdb84700 1 -- 172.21.15.26:0/1254762480 wait complete. 2021-11-03T18:09:17.766 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.767+0000 7ff4cdb84700 1 Processor -- start 2021-11-03T18:09:17.766 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.767+0000 7ff4cdb84700 1 -- start start 2021-11-03T18:09:17.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.767+0000 7ff4cdb84700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4c8060370 0x7ff4c80f6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:09:17.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.768+0000 7ff4cdb84700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4c80f9850 0x7ff4c80f5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:09:17.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.768+0000 7ff4cdb84700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c80f57c0 con 0x7ff4c80f9850 2021-11-03T18:09:17.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.768+0000 7ff4cdb84700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c80f5900 con 0x7ff4c8060370 2021-11-03T18:09:17.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.768+0000 7ff4c6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4c80f9850 0x7ff4c80f5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:09:17.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.768+0000 7ff4c6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4c80f9850 0x7ff4c80f5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58444/0 (socket says 172.21.15.26:58444) 2021-11-03T18:09:17.770 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.768+0000 7ff4c6ffd700 1 -- 172.21.15.26:0/2481996643 learned_addr learned my addr 172.21.15.26:0/2481996643 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:09:17.770 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.768+0000 7ff4c77fe700 1 --2- 172.21.15.26:0/2481996643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4c8060370 0x7ff4c80f6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:09:17.770 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.768+0000 7ff4c6ffd700 1 -- 172.21.15.26:0/2481996643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4c8060370 msgr2=0x7ff4c80f6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:09:17.770 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.768+0000 7ff4c6ffd700 1 --2- 172.21.15.26:0/2481996643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4c8060370 0x7ff4c80f6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:17.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.768+0000 7ff4c6ffd700 1 -- 172.21.15.26:0/2481996643 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4bc005040 con 0x7ff4c80f9850 2021-11-03T18:09:17.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.768+0000 7ff4c6ffd700 1 --2- 172.21.15.26:0/2481996643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4c80f9850 0x7ff4c80f5260 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7ff4bc0043c0 tx=0x7ff4bc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:09:17.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.768+0000 7ff4affff700 1 -- 172.21.15.26:0/2481996643 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4bc018070 con 0x7ff4c80f9850 2021-11-03T18:09:17.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.768+0000 7ff4cdb84700 1 -- 172.21.15.26:0/2481996643 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c80f5b80 con 0x7ff4c80f9850 2021-11-03T18:09:17.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.768+0000 7ff4affff700 1 -- 172.21.15.26:0/2481996643 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff4bc009630 con 0x7ff4c80f9850 2021-11-03T18:09:17.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.768+0000 7ff4affff700 1 -- 172.21.15.26:0/2481996643 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4bc01d6a0 con 0x7ff4c80f9850 2021-11-03T18:09:17.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.768+0000 7ff4cdb84700 1 -- 172.21.15.26:0/2481996643 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c80f60e0 con 0x7ff4c80f9850 2021-11-03T18:09:17.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.770+0000 7ff4cdb84700 1 -- 172.21.15.26:0/2481996643 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c8045ad0 con 0x7ff4c80f9850 2021-11-03T18:09:17.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.770+0000 7ff4affff700 1 -- 172.21.15.26:0/2481996643 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ff4bc0125d0 con 0x7ff4c80f9850 2021-11-03T18:09:17.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.770+0000 7ff4affff700 1 --2- 172.21.15.26:0/2481996643 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff4b00640b0 0x7ff4b0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:09:17.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.770+0000 7ff4affff700 1 -- 172.21.15.26:0/2481996643 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ff4bc082660 con 0x7ff4c80f9850 2021-11-03T18:09:17.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.770+0000 7ff4c77fe700 1 --2- 172.21.15.26:0/2481996643 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff4b00640b0 0x7ff4b0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:09:17.774 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.771+0000 7ff4c77fe700 1 --2- 172.21.15.26:0/2481996643 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff4b00640b0 0x7ff4b0066570 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7ff4c80f6b70 tx=0x7ff4b800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:09:17.774 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.774+0000 7ff4affff700 1 -- 172.21.15.26:0/2481996643 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ff4bc0549c0 con 0x7ff4c80f9850 2021-11-03T18:09:17.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.977+0000 7ff4cdb84700 1 -- 172.21.15.26:0/2481996643 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff4c8027a00 con 0x7ff4c80f9850 2021-11-03T18:09:17.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.977+0000 7ff4affff700 1 -- 172.21.15.26:0/2481996643 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7ff4bc0545b0 con 0x7ff4c80f9850 2021-11-03T18:09:17.976 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:09:17.977 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:09:17.977 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:09:17.978 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:09:17.978 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:09:17.979 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:09:17.979 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:09:17.979 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:09:17.980 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:09:17.980 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:09:17.981 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:09:17.981 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:09:17.982 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:09:17.982 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:09:17.982 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:09:17.983 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:09:17.983 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:09:17.984 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:09:17.984 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:09:17.985 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:09:17.985 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:09:17.985 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:09:17.986 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:09:17.986 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:09:17.987 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:09:17.987 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:09:17.987 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:09:17.987 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:09:17.988 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:09:17.988 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:09:17.988 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:09:17.988 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:09:17.989 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:09:17.989 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:09:17.989 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:09:17.989 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:09:17.991 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:09:17.991 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:09:17.991 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:09:17.992 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.979+0000 7ff4cdb84700 1 -- 172.21.15.26:0/2481996643 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff4b00640b0 msgr2=0x7ff4b0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:09:17.993 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.979+0000 7ff4cdb84700 1 --2- 172.21.15.26:0/2481996643 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff4b00640b0 0x7ff4b0066570 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7ff4c80f6b70 tx=0x7ff4b800b040).stop 2021-11-03T18:09:17.993 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.979+0000 7ff4cdb84700 1 -- 172.21.15.26:0/2481996643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4c80f9850 msgr2=0x7ff4c80f5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:09:17.993 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.979+0000 7ff4cdb84700 1 --2- 172.21.15.26:0/2481996643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4c80f9850 0x7ff4c80f5260 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7ff4bc0043c0 tx=0x7ff4bc009b30).stop 2021-11-03T18:09:17.993 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.979+0000 7ff4cdb84700 1 -- 172.21.15.26:0/2481996643 shutdown_connections 2021-11-03T18:09:17.994 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.979+0000 7ff4cdb84700 1 --2- 172.21.15.26:0/2481996643 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff4b00640b0 0x7ff4b0066570 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:17.994 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.979+0000 7ff4cdb84700 1 --2- 172.21.15.26:0/2481996643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4c8060370 0x7ff4c80f6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:17.994 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.979+0000 7ff4cdb84700 1 --2- 172.21.15.26:0/2481996643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4c80f9850 0x7ff4c80f5260 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:17.994 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.979+0000 7ff4cdb84700 1 -- 172.21.15.26:0/2481996643 >> 172.21.15.26:0/2481996643 conn(0x7ff4c80f0de0 msgr2=0x7ff4c80f31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:09:17.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.979+0000 7ff4cdb84700 1 -- 172.21.15.26:0/2481996643 shutdown_connections 2021-11-03T18:09:17.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:17.979+0000 7ff4cdb84700 1 -- 172.21.15.26:0/2481996643 wait complete. 2021-11-03T18:09:17.995 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:09:18.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:17 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1079659834' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:09:18.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:17 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1079659834' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:09:19.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:18 smithi026 ceph-mon[96795]: from='client.36444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:09:19.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:18 smithi026 ceph-mon[96795]: from='client.36448 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:09:19.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:18 smithi026 ceph-mon[96795]: pgmap v2239: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:19.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:18 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2481996643' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:09:19.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:18 smithi194 ceph-mon[65619]: from='client.36444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:09:19.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:18 smithi194 ceph-mon[65619]: from='client.36448 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:09:19.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:18 smithi194 ceph-mon[65619]: pgmap v2239: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:19.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:18 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2481996643' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:09:21.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:20 smithi026 ceph-mon[96795]: pgmap v2240: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:21.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:20 smithi194 ceph-mon[65619]: pgmap v2240: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:23.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:22 smithi026 ceph-mon[96795]: pgmap v2241: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:23.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:22 smithi194 ceph-mon[65619]: pgmap v2241: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:25.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:24 smithi026 ceph-mon[96795]: pgmap v2242: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:25.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:24 smithi194 ceph-mon[65619]: pgmap v2242: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:27.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:26 smithi026 ceph-mon[96795]: pgmap v2243: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:27.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:26 smithi194 ceph-mon[65619]: pgmap v2243: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:28.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:27 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:09:28.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:27 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:09:29.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:28 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:09:29.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:28 smithi026 ceph-mon[96795]: pgmap v2244: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:29.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:28 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:09:29.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:28 smithi194 ceph-mon[65619]: pgmap v2244: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:31.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:30 smithi026 ceph-mon[96795]: pgmap v2245: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:31.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:30 smithi194 ceph-mon[65619]: pgmap v2245: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:33.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:32 smithi026 ceph-mon[96795]: pgmap v2246: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:33.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:32 smithi194 ceph-mon[65619]: pgmap v2246: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:35.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:34 smithi026 ceph-mon[96795]: pgmap v2247: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:35.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:34 smithi194 ceph-mon[65619]: pgmap v2247: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:37.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:36 smithi026 ceph-mon[96795]: pgmap v2248: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:37.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:36 smithi194 ceph-mon[65619]: pgmap v2248: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:39.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:38 smithi026 ceph-mon[96795]: pgmap v2249: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:39.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:38 smithi194 ceph-mon[65619]: pgmap v2249: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:41.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:40 smithi026 ceph-mon[96795]: pgmap v2250: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:41.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:40 smithi194 ceph-mon[65619]: pgmap v2250: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:43.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:42 smithi026 ceph-mon[96795]: pgmap v2251: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:43.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:09:43.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:42 smithi194 ceph-mon[65619]: pgmap v2251: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:43.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:09:44.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:43 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:09:44.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:43 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:09:45.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:44 smithi026 ceph-mon[96795]: pgmap v2252: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:45.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:44 smithi194 ceph-mon[65619]: pgmap v2252: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:47.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:46 smithi026 ceph-mon[96795]: pgmap v2253: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:47.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:46 smithi194 ceph-mon[65619]: pgmap v2253: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:48.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.091+0000 7f485e423700 1 -- 172.21.15.26:0/284817621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48580f5440 msgr2=0x7f48580f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:09:48.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.091+0000 7f485e423700 1 --2- 172.21.15.26:0/284817621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48580f5440 0x7f48580f5860 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7f4854004660 tx=0x7f4854009b30).stop 2021-11-03T18:09:48.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.091+0000 7f485e423700 1 -- 172.21.15.26:0/284817621 shutdown_connections 2021-11-03T18:09:48.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.091+0000 7f485e423700 1 --2- 172.21.15.26:0/284817621 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48580f66e0 0x7f48580f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:48.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.091+0000 7f485e423700 1 --2- 172.21.15.26:0/284817621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48580f5440 0x7f48580f5860 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:48.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.091+0000 7f485e423700 1 -- 172.21.15.26:0/284817621 >> 172.21.15.26:0/284817621 conn(0x7f48580f0ba0 msgr2=0x7f48580f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:09:48.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.091+0000 7f485e423700 1 -- 172.21.15.26:0/284817621 shutdown_connections 2021-11-03T18:09:48.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.091+0000 7f485e423700 1 -- 172.21.15.26:0/284817621 wait complete. 2021-11-03T18:09:48.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.091+0000 7f485e423700 1 Processor -- start 2021-11-03T18:09:48.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.091+0000 7f485e423700 1 -- start start 2021-11-03T18:09:48.094 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.092+0000 7f485e423700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48580f5440 0x7f4858105d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:09:48.094 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.092+0000 7f485e423700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48580f66e0 0x7f4858106230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:09:48.094 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.092+0000 7f485e423700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48581067e0 con 0x7f48580f66e0 2021-11-03T18:09:48.094 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.092+0000 7f485e423700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4858106fe0 con 0x7f48580f5440 2021-11-03T18:09:48.095 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.092+0000 7f485cc20700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48580f66e0 0x7f4858106230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:09:48.095 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.092+0000 7f485cc20700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48580f66e0 0x7f4858106230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58462/0 (socket says 172.21.15.26:58462) 2021-11-03T18:09:48.095 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.092+0000 7f485cc20700 1 -- 172.21.15.26:0/3803874765 learned_addr learned my addr 172.21.15.26:0/3803874765 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:09:48.095 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.092+0000 7f485d421700 1 --2- 172.21.15.26:0/3803874765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48580f5440 0x7f4858105d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:09:48.096 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.092+0000 7f485cc20700 1 -- 172.21.15.26:0/3803874765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48580f5440 msgr2=0x7f4858105d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:09:48.096 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.092+0000 7f485cc20700 1 --2- 172.21.15.26:0/3803874765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48580f5440 0x7f4858105d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:48.096 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.092+0000 7f485cc20700 1 -- 172.21.15.26:0/3803874765 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4854005040 con 0x7f48580f66e0 2021-11-03T18:09:48.096 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.092+0000 7f485cc20700 1 --2- 172.21.15.26:0/3803874765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48580f66e0 0x7f4858106230 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7f484800c790 tx=0x7f4848007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:09:48.097 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.092+0000 7f484dffb700 1 -- 172.21.15.26:0/3803874765 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4848002590 con 0x7f48580f66e0 2021-11-03T18:09:48.097 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.093+0000 7f484dffb700 1 -- 172.21.15.26:0/3803874765 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4848002ba0 con 0x7f48580f66e0 2021-11-03T18:09:48.097 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.093+0000 7f485e423700 1 -- 172.21.15.26:0/3803874765 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48581072c0 con 0x7f48580f66e0 2021-11-03T18:09:48.097 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.093+0000 7f484dffb700 1 -- 172.21.15.26:0/3803874765 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4848013d90 con 0x7f48580f66e0 2021-11-03T18:09:48.098 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.093+0000 7f485e423700 1 -- 172.21.15.26:0/3803874765 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4858107880 con 0x7f48580f66e0 2021-11-03T18:09:48.099 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.094+0000 7f485e423700 1 -- 172.21.15.26:0/3803874765 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4858059100 con 0x7f48580f66e0 2021-11-03T18:09:48.099 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.094+0000 7f484dffb700 1 -- 172.21.15.26:0/3803874765 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f484801a060 con 0x7f48580f66e0 2021-11-03T18:09:48.100 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.095+0000 7f484dffb700 1 --2- 172.21.15.26:0/3803874765 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4844064100 0x7f48440665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:09:48.100 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.095+0000 7f484dffb700 1 -- 172.21.15.26:0/3803874765 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f4848080b40 con 0x7f48580f66e0 2021-11-03T18:09:48.100 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.095+0000 7f485d421700 1 --2- 172.21.15.26:0/3803874765 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4844064100 0x7f48440665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:09:48.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.095+0000 7f485d421700 1 --2- 172.21.15.26:0/3803874765 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4844064100 0x7f48440665c0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f4854004630 tx=0x7f4854009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:09:48.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.099+0000 7f484dffb700 1 -- 172.21.15.26:0/3803874765 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f4848052c90 con 0x7f48580f66e0 2021-11-03T18:09:48.277 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.279+0000 7f485e423700 1 -- 172.21.15.26:0/3803874765 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f48580fdc70 con 0x7f4844064100 2021-11-03T18:09:48.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.280+0000 7f484dffb700 1 -- 172.21.15.26:0/3803874765 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f48580fdc70 con 0x7f4844064100 2021-11-03T18:09:48.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.282+0000 7f485e423700 1 -- 172.21.15.26:0/3803874765 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4844064100 msgr2=0x7f48440665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:09:48.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.282+0000 7f485e423700 1 --2- 172.21.15.26:0/3803874765 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4844064100 0x7f48440665c0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f4854004630 tx=0x7f4854009b30).stop 2021-11-03T18:09:48.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.282+0000 7f485e423700 1 -- 172.21.15.26:0/3803874765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48580f66e0 msgr2=0x7f4858106230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:09:48.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.282+0000 7f485e423700 1 --2- 172.21.15.26:0/3803874765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48580f66e0 0x7f4858106230 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7f484800c790 tx=0x7f4848007d70).stop 2021-11-03T18:09:48.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.282+0000 7f485e423700 1 -- 172.21.15.26:0/3803874765 shutdown_connections 2021-11-03T18:09:48.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.282+0000 7f485e423700 1 --2- 172.21.15.26:0/3803874765 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4844064100 0x7f48440665c0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:48.282 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.282+0000 7f485e423700 1 --2- 172.21.15.26:0/3803874765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48580f5440 0x7f4858105d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:48.282 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.282+0000 7f485e423700 1 --2- 172.21.15.26:0/3803874765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48580f66e0 0x7f4858106230 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:48.282 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.282+0000 7f485e423700 1 -- 172.21.15.26:0/3803874765 >> 172.21.15.26:0/3803874765 conn(0x7f48580f0ba0 msgr2=0x7f48580fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:09:48.282 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.282+0000 7f485e423700 1 -- 172.21.15.26:0/3803874765 shutdown_connections 2021-11-03T18:09:48.283 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.282+0000 7f485e423700 1 -- 172.21.15.26:0/3803874765 wait complete. 2021-11-03T18:09:48.290 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:09:48.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.384+0000 7f32cfef4700 1 -- 172.21.15.26:0/4245846155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32c80f55c0 msgr2=0x7f32c80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:09:48.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.384+0000 7f32cfef4700 1 --2- 172.21.15.26:0/4245846155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32c80f55c0 0x7f32c80f59e0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7f32b8004660 tx=0x7f32b8009b30).stop 2021-11-03T18:09:48.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.384+0000 7f32cfef4700 1 -- 172.21.15.26:0/4245846155 shutdown_connections 2021-11-03T18:09:48.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.384+0000 7f32cfef4700 1 --2- 172.21.15.26:0/4245846155 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32c80f5ed0 0x7f32c80f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:09:48.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.384+0000 7f32cfef4700 1 --2- 172.21.15.26:0/4245846155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32c80f55c0 0x7f32c80f59e0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:48.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.384+0000 7f32cfef4700 1 -- 172.21.15.26:0/4245846155 >> 172.21.15.26:0/4245846155 conn(0x7f32c80f0de0 msgr2=0x7f32c80f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:09:48.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.384+0000 7f32cfef4700 1 -- 172.21.15.26:0/4245846155 shutdown_connections 2021-11-03T18:09:48.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.384+0000 7f32cfef4700 1 -- 172.21.15.26:0/4245846155 wait complete. 2021-11-03T18:09:48.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.385+0000 7f32cfef4700 1 Processor -- start 2021-11-03T18:09:48.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.385+0000 7f32cfef4700 1 -- start start 2021-11-03T18:09:48.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.385+0000 7f32cfef4700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32c80f55c0 0x7f32c8106f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:09:48.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.385+0000 7f32cfef4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32c80f5ed0 0x7f32c8107440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:09:48.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.385+0000 7f32cfef4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c8107a80 con 0x7f32c80f5ed0 2021-11-03T18:09:48.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.385+0000 7f32cfef4700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c8108330 con 0x7f32c80f55c0 2021-11-03T18:09:48.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.385+0000 7f32cd48f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32c80f5ed0 0x7f32c8107440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:09:48.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.385+0000 7f32cd48f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32c80f5ed0 0x7f32c8107440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58472/0 (socket says 172.21.15.26:58472) 2021-11-03T18:09:48.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.385+0000 7f32cd48f700 1 -- 172.21.15.26:0/4068354971 learned_addr learned my addr 172.21.15.26:0/4068354971 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:09:48.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.385+0000 7f32cdc90700 1 --2- 172.21.15.26:0/4068354971 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32c80f55c0 0x7f32c8106f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:09:48.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.385+0000 7f32cd48f700 1 -- 172.21.15.26:0/4068354971 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32c80f55c0 msgr2=0x7f32c8106f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:09:48.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.385+0000 7f32cd48f700 1 --2- 172.21.15.26:0/4068354971 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32c80f55c0 0x7f32c8106f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:48.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.385+0000 7f32cd48f700 1 -- 172.21.15.26:0/4068354971 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b8005040 con 0x7f32c80f5ed0 2021-11-03T18:09:48.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.386+0000 7f32cd48f700 1 --2- 172.21.15.26:0/4068354971 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32c80f5ed0 0x7f32c8107440 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 rx=0x7f32c400b410 tx=0x7f32c4006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:09:48.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.386+0000 7f32be7fc700 1 -- 172.21.15.26:0/4068354971 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32c40125f0 con 0x7f32c80f5ed0 2021-11-03T18:09:48.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.386+0000 7f32be7fc700 1 -- 172.21.15.26:0/4068354971 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f32c400be30 con 0x7f32c80f5ed0 2021-11-03T18:09:48.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.386+0000 7f32cfef4700 1 -- 172.21.15.26:0/4068354971 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c8108610 con 0x7f32c80f5ed0 2021-11-03T18:09:48.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.386+0000 7f32be7fc700 1 -- 172.21.15.26:0/4068354971 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32c4002a70 con 0x7f32c80f5ed0 2021-11-03T18:09:48.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.386+0000 7f32cfef4700 1 -- 172.21.15.26:0/4068354971 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c8108bd0 con 0x7f32c80f5ed0 2021-11-03T18:09:48.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.387+0000 7f32cfef4700 1 -- 172.21.15.26:0/4068354971 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32c80f4a50 con 0x7f32c80f5ed0 2021-11-03T18:09:48.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.387+0000 7f32be7fc700 1 -- 172.21.15.26:0/4068354971 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f32c400f030 con 0x7f32c80f5ed0 2021-11-03T18:09:48.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.387+0000 7f32be7fc700 1 --2- 172.21.15.26:0/4068354971 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f32b40640b0 0x7f32b4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:09:48.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.388+0000 7f32be7fc700 1 -- 172.21.15.26:0/4068354971 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f32c4080b20 con 0x7f32c80f5ed0 2021-11-03T18:09:48.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.388+0000 7f32cdc90700 1 --2- 172.21.15.26:0/4068354971 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f32b40640b0 0x7f32b4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:09:48.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.388+0000 7f32cdc90700 1 --2- 172.21.15.26:0/4068354971 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f32b40640b0 0x7f32b4066570 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f32b8004630 tx=0x7f32b8009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:09:48.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.391+0000 7f32be7fc700 1 -- 172.21.15.26:0/4068354971 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f32c4052e80 con 0x7f32c80f5ed0 2021-11-03T18:09:48.565 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.567+0000 7f32cfef4700 1 -- 172.21.15.26:0/4068354971 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f32c80fad40 con 0x7f32b40640b0 2021-11-03T18:09:48.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.582+0000 7f32be7fc700 1 -- 172.21.15.26:0/4068354971 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f32c80fad40 con 0x7f32b40640b0 2021-11-03T18:09:48.581 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:09:48.581 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (81m) 9m ago 82m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:09:48.581 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (73m) 9m ago 82m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:09:48.582 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (73m) 8m ago 81m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:09:48.582 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (80m) 9m ago 81m 41.7M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:09:48.582 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (74m) 9m ago 77m 25.6M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:09:48.582 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (74m) 9m ago 77m 26.2M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:09:48.583 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (77m) 8m ago 77m 26.4M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:09:48.583 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (77m) 8m ago 77m 26.8M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:09:48.583 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (74m) 9m ago 83m 561M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:09:48.583 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (74m) 8m ago 81m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:09:48.584 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (74m) 9m ago 83m 276M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:09:48.584 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (73m) 8m ago 81m 132M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:09:48.584 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (81m) 9m ago 81m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:09:48.584 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (81m) 8m ago 81m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:09:48.584 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (72m) 9m ago 80m 292M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:09:48.585 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (72m) 9m ago 80m 313M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:09:48.585 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (71m) 9m ago 79m 261M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:09:48.585 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (71m) 8m ago 79m 337M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:09:48.585 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (70m) 8m ago 79m 283M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:09:48.586 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (70m) 8m ago 79m 276M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:09:48.586 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (80m) 9m ago 81m 61.2M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:09:48.587 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.584+0000 7f32cfef4700 1 -- 172.21.15.26:0/4068354971 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f32b40640b0 msgr2=0x7f32b4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:09:48.587 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.584+0000 7f32cfef4700 1 --2- 172.21.15.26:0/4068354971 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f32b40640b0 0x7f32b4066570 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f32b8004630 tx=0x7f32b8009b30).stop 2021-11-03T18:09:48.587 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.584+0000 7f32cfef4700 1 -- 172.21.15.26:0/4068354971 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32c80f5ed0 msgr2=0x7f32c8107440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:09:48.588 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.584+0000 7f32cfef4700 1 --2- 172.21.15.26:0/4068354971 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32c80f5ed0 0x7f32c8107440 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 rx=0x7f32c400b410 tx=0x7f32c4006ef0).stop 2021-11-03T18:09:48.588 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.584+0000 7f32cfef4700 1 -- 172.21.15.26:0/4068354971 shutdown_connections 2021-11-03T18:09:48.589 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.584+0000 7f32cfef4700 1 --2- 172.21.15.26:0/4068354971 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f32b40640b0 0x7f32b4066570 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:48.589 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.584+0000 7f32cfef4700 1 --2- 172.21.15.26:0/4068354971 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32c80f55c0 0x7f32c8106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:48.589 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.584+0000 7f32cfef4700 1 --2- 172.21.15.26:0/4068354971 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32c80f5ed0 0x7f32c8107440 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:48.589 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.584+0000 7f32cfef4700 1 -- 172.21.15.26:0/4068354971 >> 172.21.15.26:0/4068354971 conn(0x7f32c80f0de0 msgr2=0x7f32c805ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:09:48.590 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.584+0000 7f32cfef4700 1 -- 172.21.15.26:0/4068354971 shutdown_connections 2021-11-03T18:09:48.590 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.584+0000 7f32cfef4700 1 -- 172.21.15.26:0/4068354971 wait complete. 2021-11-03T18:09:48.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.683+0000 7f262c220700 1 -- 172.21.15.26:0/4207515742 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26240f66e0 msgr2=0x7f26240f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:09:48.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.683+0000 7f262c220700 1 --2- 172.21.15.26:0/4207515742 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26240f66e0 0x7f26240f6b00 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7f261c0099e0 tx=0x7f261c004d10).stop 2021-11-03T18:09:48.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.683+0000 7f262c220700 1 -- 172.21.15.26:0/4207515742 shutdown_connections 2021-11-03T18:09:48.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.683+0000 7f262c220700 1 --2- 172.21.15.26:0/4207515742 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26240f7980 0x7f26240f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:48.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.683+0000 7f262c220700 1 --2- 172.21.15.26:0/4207515742 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26240f66e0 0x7f26240f6b00 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:48.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.683+0000 7f262c220700 1 -- 172.21.15.26:0/4207515742 >> 172.21.15.26:0/4207515742 conn(0x7f26240f1e40 msgr2=0x7f26240f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:09:48.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.683+0000 7f262c220700 1 -- 172.21.15.26:0/4207515742 shutdown_connections 2021-11-03T18:09:48.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.683+0000 7f262c220700 1 -- 172.21.15.26:0/4207515742 wait complete. 2021-11-03T18:09:48.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.683+0000 7f262c220700 1 Processor -- start 2021-11-03T18:09:48.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.683+0000 7f262c220700 1 -- start start 2021-11-03T18:09:48.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.684+0000 7f262c220700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26240f66e0 0x7f262406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:09:48.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.684+0000 7f262c220700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26240f7980 0x7f2624069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:09:48.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.684+0000 7f262c220700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262406a380 con 0x7f26240f7980 2021-11-03T18:09:48.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.684+0000 7f262c220700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262406a4c0 con 0x7f26240f66e0 2021-11-03T18:09:48.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.684+0000 7f26297bb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26240f7980 0x7f2624069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:09:48.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.684+0000 7f26297bb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26240f7980 0x7f2624069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58482/0 (socket says 172.21.15.26:58482) 2021-11-03T18:09:48.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.684+0000 7f26297bb700 1 -- 172.21.15.26:0/3356357509 learned_addr learned my addr 172.21.15.26:0/3356357509 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:09:48.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.684+0000 7f2629fbc700 1 --2- 172.21.15.26:0/3356357509 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26240f66e0 0x7f262406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:09:48.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.684+0000 7f26297bb700 1 -- 172.21.15.26:0/3356357509 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26240f66e0 msgr2=0x7f262406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:09:48.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.684+0000 7f26297bb700 1 --2- 172.21.15.26:0/3356357509 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26240f66e0 0x7f262406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:48.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.684+0000 7f26297bb700 1 -- 172.21.15.26:0/3356357509 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261c009640 con 0x7f26240f7980 2021-11-03T18:09:48.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.684+0000 7f2629fbc700 1 --2- 172.21.15.26:0/3356357509 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26240f66e0 0x7f262406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:09:48.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.684+0000 7f26297bb700 1 --2- 172.21.15.26:0/3356357509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26240f7980 0x7f2624069e20 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x7f2614002700 tx=0x7f2614009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:09:48.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.684+0000 7f261a7fc700 1 -- 172.21.15.26:0/3356357509 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2614009320 con 0x7f26240f7980 2021-11-03T18:09:48.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.684+0000 7f261a7fc700 1 -- 172.21.15.26:0/3356357509 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f261400f040 con 0x7f26240f7980 2021-11-03T18:09:48.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.684+0000 7f262c220700 1 -- 172.21.15.26:0/3356357509 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f262406a7a0 con 0x7f26240f7980 2021-11-03T18:09:48.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.684+0000 7f261a7fc700 1 -- 172.21.15.26:0/3356357509 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2614014820 con 0x7f26240f7980 2021-11-03T18:09:48.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.684+0000 7f262c220700 1 -- 172.21.15.26:0/3356357509 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f262410f100 con 0x7f26240f7980 2021-11-03T18:09:48.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.685+0000 7f262c220700 1 -- 172.21.15.26:0/3356357509 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2624045ad0 con 0x7f26240f7980 2021-11-03T18:09:48.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.686+0000 7f261a7fc700 1 -- 172.21.15.26:0/3356357509 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f2614009480 con 0x7f26240f7980 2021-11-03T18:09:48.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.686+0000 7f261a7fc700 1 --2- 172.21.15.26:0/3356357509 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f26100640b0 0x7f2610066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:09:48.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.686+0000 7f261a7fc700 1 -- 172.21.15.26:0/3356357509 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f2614080a50 con 0x7f26240f7980 2021-11-03T18:09:48.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.686+0000 7f2629fbc700 1 --2- 172.21.15.26:0/3356357509 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f26100640b0 0x7f2610066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:09:48.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.687+0000 7f2629fbc700 1 --2- 172.21.15.26:0/3356357509 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f26100640b0 0x7f2610066570 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f261c000f80 tx=0x7f261c004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:09:48.692 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.690+0000 7f261a7fc700 1 -- 172.21.15.26:0/3356357509 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f2614052d50 con 0x7f26240f7980 2021-11-03T18:09:48.919 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.921+0000 7f262c220700 1 -- 172.21.15.26:0/3356357509 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f26240fefa0 con 0x7f26240f7980 2021-11-03T18:09:48.920 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.922+0000 7f261a7fc700 1 -- 172.21.15.26:0/3356357509 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f2614052940 con 0x7f26240f7980 2021-11-03T18:09:48.921 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:09:48.921 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:09:48.921 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:09:48.921 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:09:48.922 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:09:48.922 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:09:48.922 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:09:48.922 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:09:48.923 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:09:48.923 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:09:48.923 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:09:48.923 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:09:48.923 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:09:48.924 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:09:48.924 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:09:48.924 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:09:48.924 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:09:48.924 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:09:48.925 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.924+0000 7f262c220700 1 -- 172.21.15.26:0/3356357509 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f26100640b0 msgr2=0x7f2610066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:09:48.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.924+0000 7f262c220700 1 --2- 172.21.15.26:0/3356357509 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f26100640b0 0x7f2610066570 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f261c000f80 tx=0x7f261c004d10).stop 2021-11-03T18:09:48.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.924+0000 7f262c220700 1 -- 172.21.15.26:0/3356357509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26240f7980 msgr2=0x7f2624069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:09:48.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.924+0000 7f262c220700 1 --2- 172.21.15.26:0/3356357509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26240f7980 0x7f2624069e20 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x7f2614002700 tx=0x7f2614009e00).stop 2021-11-03T18:09:48.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.924+0000 7f262c220700 1 -- 172.21.15.26:0/3356357509 shutdown_connections 2021-11-03T18:09:48.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.924+0000 7f262c220700 1 --2- 172.21.15.26:0/3356357509 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f26100640b0 0x7f2610066570 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:48.927 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.924+0000 7f262c220700 1 --2- 172.21.15.26:0/3356357509 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26240f66e0 0x7f262406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:48.927 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.924+0000 7f262c220700 1 --2- 172.21.15.26:0/3356357509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26240f7980 0x7f2624069e20 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:48.927 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.924+0000 7f262c220700 1 -- 172.21.15.26:0/3356357509 >> 172.21.15.26:0/3356357509 conn(0x7f26240f1e40 msgr2=0x7f26240fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:09:48.927 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.924+0000 7f262c220700 1 -- 172.21.15.26:0/3356357509 shutdown_connections 2021-11-03T18:09:48.928 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:48.924+0000 7f262c220700 1 -- 172.21.15.26:0/3356357509 wait complete. 2021-11-03T18:09:49.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.024+0000 7fbeffa2a700 1 -- 172.21.15.26:0/1621307341 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbef80f66e0 msgr2=0x7fbef80f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:09:49.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.024+0000 7fbeffa2a700 1 --2- 172.21.15.26:0/1621307341 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbef80f66e0 0x7fbef80f6b00 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7fbef4004660 tx=0x7fbef4009b30).stop 2021-11-03T18:09:49.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.024+0000 7fbeffa2a700 1 -- 172.21.15.26:0/1621307341 shutdown_connections 2021-11-03T18:09:49.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.024+0000 7fbeffa2a700 1 --2- 172.21.15.26:0/1621307341 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbef80f7980 0x7fbef80f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:09:49.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.024+0000 7fbeffa2a700 1 --2- 172.21.15.26:0/1621307341 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbef80f66e0 0x7fbef80f6b00 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:49.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.024+0000 7fbeffa2a700 1 -- 172.21.15.26:0/1621307341 >> 172.21.15.26:0/1621307341 conn(0x7fbef80f1e40 msgr2=0x7fbef80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:09:49.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.024+0000 7fbeffa2a700 1 -- 172.21.15.26:0/1621307341 shutdown_connections 2021-11-03T18:09:49.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.024+0000 7fbeffa2a700 1 -- 172.21.15.26:0/1621307341 wait complete. 2021-11-03T18:09:49.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.025+0000 7fbeffa2a700 1 Processor -- start 2021-11-03T18:09:49.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.025+0000 7fbeffa2a700 1 -- start start 2021-11-03T18:09:49.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.025+0000 7fbeffa2a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbef80f66e0 0x7fbef806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:09:49.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.025+0000 7fbeffa2a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbef80f7980 0x7fbef8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:09:49.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.025+0000 7fbeffa2a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef806a410 con 0x7fbef80f7980 2021-11-03T18:09:49.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.025+0000 7fbeffa2a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef806a550 con 0x7fbef80f66e0 2021-11-03T18:09:49.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.025+0000 7fbefcfc5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbef80f7980 0x7fbef8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:09:49.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.025+0000 7fbefcfc5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbef80f7980 0x7fbef8069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58492/0 (socket says 172.21.15.26:58492) 2021-11-03T18:09:49.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.025+0000 7fbefd7c6700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbef80f66e0 0x7fbef806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:09:49.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.025+0000 7fbefcfc5700 1 -- 172.21.15.26:0/3140347145 learned_addr learned my addr 172.21.15.26:0/3140347145 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:09:49.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.025+0000 7fbefcfc5700 1 -- 172.21.15.26:0/3140347145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbef80f66e0 msgr2=0x7fbef806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:09:49.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.025+0000 7fbefcfc5700 1 --2- 172.21.15.26:0/3140347145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbef80f66e0 0x7fbef806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:49.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.025+0000 7fbefcfc5700 1 -- 172.21.15.26:0/3140347145 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef4005040 con 0x7fbef80f7980 2021-11-03T18:09:49.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.025+0000 7fbefcfc5700 1 --2- 172.21.15.26:0/3140347145 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbef80f7980 0x7fbef8069e20 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 rx=0x7fbeec00b410 tx=0x7fbeec006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:09:49.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.026+0000 7fbee9ffb700 1 -- 172.21.15.26:0/3140347145 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbeec0125f0 con 0x7fbef80f7980 2021-11-03T18:09:49.030 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.026+0000 7fbee9ffb700 1 -- 172.21.15.26:0/3140347145 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbeec00be30 con 0x7fbef80f7980 2021-11-03T18:09:49.030 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.026+0000 7fbeffa2a700 1 -- 172.21.15.26:0/3140347145 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbef806a830 con 0x7fbef80f7980 2021-11-03T18:09:49.030 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.026+0000 7fbee9ffb700 1 -- 172.21.15.26:0/3140347145 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbeec002a70 con 0x7fbef80f7980 2021-11-03T18:09:49.030 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.026+0000 7fbeffa2a700 1 -- 172.21.15.26:0/3140347145 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbef810efe0 con 0x7fbef80f7980 2021-11-03T18:09:49.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.027+0000 7fbeffa2a700 1 -- 172.21.15.26:0/3140347145 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbef8045ad0 con 0x7fbef80f7980 2021-11-03T18:09:49.032 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.027+0000 7fbee9ffb700 1 -- 172.21.15.26:0/3140347145 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fbeec00f030 con 0x7fbef80f7980 2021-11-03T18:09:49.032 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.028+0000 7fbee9ffb700 1 --2- 172.21.15.26:0/3140347145 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbee40640b0 0x7fbee4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:09:49.032 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.028+0000 7fbee9ffb700 1 -- 172.21.15.26:0/3140347145 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fbeec080b10 con 0x7fbef80f7980 2021-11-03T18:09:49.032 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.028+0000 7fbefd7c6700 1 --2- 172.21.15.26:0/3140347145 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbee40640b0 0x7fbee4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:09:49.033 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.028+0000 7fbefd7c6700 1 --2- 172.21.15.26:0/3140347145 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbee40640b0 0x7fbee4066570 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7fbef4013690 tx=0x7fbef4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:09:49.033 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.032+0000 7fbee9ffb700 1 -- 172.21.15.26:0/3140347145 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fbeec052e70 con 0x7fbef80f7980 2021-11-03T18:09:49.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:48 smithi026 ceph-mon[96795]: pgmap v2254: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:49.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:09:49.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:09:49.235 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.237+0000 7fbeffa2a700 1 -- 172.21.15.26:0/3140347145 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbef8027a00 con 0x7fbef80f7980 2021-11-03T18:09:49.236 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.237+0000 7fbee9ffb700 1 -- 172.21.15.26:0/3140347145 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fbeec052a60 con 0x7fbef80f7980 2021-11-03T18:09:49.236 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:09:49.236 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:09:49.237 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:09:49.237 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:09:49.237 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:09:49.237 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:09:49.238 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:09:49.238 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:09:49.238 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:09:49.238 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:09:49.239 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:09:49.239 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:09:49.239 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:09:49.239 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:09:49.239 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:09:49.240 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:09:49.240 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:09:49.240 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:09:49.241 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:09:49.241 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:09:49.241 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:09:49.242 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:09:49.242 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:09:49.242 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:09:49.242 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:09:49.243 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:09:49.243 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:09:49.243 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:09:49.244 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:09:49.244 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:09:49.244 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:09:49.245 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:09:49.245 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:09:49.245 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:09:49.245 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:09:49.246 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:09:49.246 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:09:49.246 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:09:49.246 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:09:49.248 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.239+0000 7fbeffa2a700 1 -- 172.21.15.26:0/3140347145 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbee40640b0 msgr2=0x7fbee4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:09:49.248 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.239+0000 7fbeffa2a700 1 --2- 172.21.15.26:0/3140347145 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbee40640b0 0x7fbee4066570 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7fbef4013690 tx=0x7fbef4009b30).stop 2021-11-03T18:09:49.248 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.239+0000 7fbeffa2a700 1 -- 172.21.15.26:0/3140347145 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbef80f7980 msgr2=0x7fbef8069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:09:49.248 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.239+0000 7fbeffa2a700 1 --2- 172.21.15.26:0/3140347145 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbef80f7980 0x7fbef8069e20 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 rx=0x7fbeec00b410 tx=0x7fbeec006ef0).stop 2021-11-03T18:09:49.249 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.239+0000 7fbeffa2a700 1 -- 172.21.15.26:0/3140347145 shutdown_connections 2021-11-03T18:09:49.249 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.239+0000 7fbeffa2a700 1 --2- 172.21.15.26:0/3140347145 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbee40640b0 0x7fbee4066570 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:49.249 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.239+0000 7fbeffa2a700 1 --2- 172.21.15.26:0/3140347145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbef80f66e0 0x7fbef806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:49.249 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.239+0000 7fbeffa2a700 1 --2- 172.21.15.26:0/3140347145 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbef80f7980 0x7fbef8069e20 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:09:49.249 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.239+0000 7fbeffa2a700 1 -- 172.21.15.26:0/3140347145 >> 172.21.15.26:0/3140347145 conn(0x7fbef80f1e40 msgr2=0x7fbef80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:09:49.250 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.240+0000 7fbeffa2a700 1 -- 172.21.15.26:0/3140347145 shutdown_connections 2021-11-03T18:09:49.250 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:09:49.240+0000 7fbeffa2a700 1 -- 172.21.15.26:0/3140347145 wait complete. 2021-11-03T18:09:49.250 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:09:49.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:48 smithi194 ceph-mon[65619]: pgmap v2254: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:49.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:09:49.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:09:50.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:49 smithi026 ceph-mon[96795]: from='client.36460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:09:50.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:49 smithi026 ceph-mon[96795]: from='client.36464 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:09:50.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:49 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3356357509' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:09:50.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:49 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3140347145' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:09:50.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:49 smithi194 ceph-mon[65619]: from='client.36460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:09:50.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:49 smithi194 ceph-mon[65619]: from='client.36464 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:09:50.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:49 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3356357509' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:09:50.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:49 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3140347145' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:09:51.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:50 smithi026 ceph-mon[96795]: pgmap v2255: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:51.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:50 smithi194 ceph-mon[65619]: pgmap v2255: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:53.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:52 smithi026 ceph-mon[96795]: pgmap v2256: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:53.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:52 smithi194 ceph-mon[65619]: pgmap v2256: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:55.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:54 smithi026 ceph-mon[96795]: pgmap v2257: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:55.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:54 smithi194 ceph-mon[65619]: pgmap v2257: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:57.173 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:56 smithi194 ceph-mon[65619]: pgmap v2258: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:57.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:56 smithi026 ceph-mon[96795]: pgmap v2258: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:58.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:57 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:09:58.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:57 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:09:58.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:57 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:09:58.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:57 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:09:59.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:58 smithi026 ceph-mon[96795]: poll took 60074.773 ms: 1 events 2021-11-03T18:09:59.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:09:58 smithi026 ceph-mon[96795]: pgmap v2259: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:09:59.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:58 smithi194 ceph-mon[65619]: poll took 60074.773 ms: 1 events 2021-11-03T18:09:59.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:09:58 smithi194 ceph-mon[65619]: pgmap v2259: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:00.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:00 smithi026 conmon[96772]: 2021-11-03T18:09:59.999+0000 7f27986f6700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 2 daemons have recently crashed 2021-11-03T18:10:01.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:00 smithi026 ceph-mon[96795]: pgmap v2260: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:01.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:00 smithi026 ceph-mon[96795]: overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 2 daemons have recently crashed 2021-11-03T18:10:01.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:00 smithi194 ceph-mon[65619]: pgmap v2260: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:01.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:00 smithi194 ceph-mon[65619]: overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 2 daemons have recently crashed 2021-11-03T18:10:03.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:02 smithi026 ceph-mon[96795]: pgmap v2261: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:03.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:02 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:10:03.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:02 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:10:03.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:02 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:10:03.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:02 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:10:03.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:02 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:10:03.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:02 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:10:03.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:02 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:10:03.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:02 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:10:03.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:02 smithi194 ceph-mon[65619]: pgmap v2261: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:03.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:02 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:10:03.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:02 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:10:03.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:02 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:10:03.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:02 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:10:03.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:02 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:10:03.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:02 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:10:03.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:02 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:10:03.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:02 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:10:04.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:03 smithi026 ceph-mon[96795]: poll took 4345.604 ms: 1 events 2021-11-03T18:10:04.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:03 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:10:04.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:03 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:10:04.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:03 smithi194 ceph-mon[65619]: poll took 4345.604 ms: 1 events 2021-11-03T18:10:04.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:03 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:10:04.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:03 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:10:05.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:04 smithi026 ceph-mon[96795]: pgmap v2262: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:05.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:04 smithi194 ceph-mon[65619]: pgmap v2262: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:07.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:06 smithi026 ceph-mon[96795]: pgmap v2263: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:07.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:06 smithi194 ceph-mon[65619]: pgmap v2263: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:09.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:08 smithi026 ceph-mon[96795]: pgmap v2264: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:09.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:08 smithi194 ceph-mon[65619]: pgmap v2264: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:11.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:10 smithi026 ceph-mon[96795]: pgmap v2265: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:11.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:10 smithi194 ceph-mon[65619]: pgmap v2265: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:13.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:12 smithi026 ceph-mon[96795]: pgmap v2266: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:13.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:12 smithi194 ceph-mon[65619]: pgmap v2266: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:15.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:14 smithi026 ceph-mon[96795]: pgmap v2267: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:15.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:14 smithi194 ceph-mon[65619]: pgmap v2267: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:17.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:16 smithi026 ceph-mon[96795]: pgmap v2268: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:17.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:16 smithi194 ceph-mon[65619]: pgmap v2268: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:18.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:17 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:10:18.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:17 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:10:19.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:18 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:10:19.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:18 smithi026 ceph-mon[96795]: pgmap v2269: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:19.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:18 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:10:19.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:18 smithi194 ceph-mon[65619]: pgmap v2269: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:19.355 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.356+0000 7ff43ad56700 1 -- 172.21.15.26:0/1774192815 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4340f77d0 msgr2=0x7ff4340f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:10:19.355 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.356+0000 7ff43ad56700 1 --2- 172.21.15.26:0/1774192815 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4340f77d0 0x7ff4340f7c30 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 rx=0x7ff424004660 tx=0x7ff424009b30).stop 2021-11-03T18:10:19.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.356+0000 7ff43ad56700 1 -- 172.21.15.26:0/1774192815 shutdown_connections 2021-11-03T18:10:19.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.356+0000 7ff43ad56700 1 --2- 172.21.15.26:0/1774192815 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4340f77d0 0x7ff4340f7c30 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:19.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.356+0000 7ff43ad56700 1 --2- 172.21.15.26:0/1774192815 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4340f6530 0x7ff4340f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:19.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.356+0000 7ff43ad56700 1 -- 172.21.15.26:0/1774192815 >> 172.21.15.26:0/1774192815 conn(0x7ff4340f1cd0 msgr2=0x7ff4340f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:10:19.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.356+0000 7ff43ad56700 1 -- 172.21.15.26:0/1774192815 shutdown_connections 2021-11-03T18:10:19.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.356+0000 7ff43ad56700 1 -- 172.21.15.26:0/1774192815 wait complete. 2021-11-03T18:10:19.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.357+0000 7ff43ad56700 1 Processor -- start 2021-11-03T18:10:19.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.357+0000 7ff43ad56700 1 -- start start 2021-11-03T18:10:19.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.357+0000 7ff43ad56700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4340f6530 0x7ff434106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:10:19.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.357+0000 7ff43ad56700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4340f77d0 0x7ff434107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:10:19.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.357+0000 7ff43ad56700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff434107870 con 0x7ff4340f6530 2021-11-03T18:10:19.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.357+0000 7ff43ad56700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff434108080 con 0x7ff4340f77d0 2021-11-03T18:10:19.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.357+0000 7ff439d54700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4340f6530 0x7ff434106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:10:19.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.357+0000 7ff439d54700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4340f6530 0x7ff434106d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58508/0 (socket says 172.21.15.26:58508) 2021-11-03T18:10:19.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.357+0000 7ff439d54700 1 -- 172.21.15.26:0/124843448 learned_addr learned my addr 172.21.15.26:0/124843448 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:10:19.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.357+0000 7ff439553700 1 --2- 172.21.15.26:0/124843448 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4340f77d0 0x7ff434107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:10:19.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.357+0000 7ff439d54700 1 -- 172.21.15.26:0/124843448 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4340f77d0 msgr2=0x7ff434107270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:10:19.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.357+0000 7ff439d54700 1 --2- 172.21.15.26:0/124843448 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4340f77d0 0x7ff434107270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:19.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.357+0000 7ff439d54700 1 -- 172.21.15.26:0/124843448 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff424005040 con 0x7ff4340f6530 2021-11-03T18:10:19.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.357+0000 7ff439d54700 1 --2- 172.21.15.26:0/124843448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4340f6530 0x7ff434106d80 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7ff430002700 tx=0x7ff430009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:10:19.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.358+0000 7ff42a7fc700 1 -- 172.21.15.26:0/124843448 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4300079c0 con 0x7ff4340f6530 2021-11-03T18:10:19.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.358+0000 7ff42a7fc700 1 -- 172.21.15.26:0/124843448 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff43000f040 con 0x7ff4340f6530 2021-11-03T18:10:19.363 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.358+0000 7ff43ad56700 1 -- 172.21.15.26:0/124843448 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff434108300 con 0x7ff4340f6530 2021-11-03T18:10:19.363 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.358+0000 7ff42a7fc700 1 -- 172.21.15.26:0/124843448 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff430014860 con 0x7ff4340f6530 2021-11-03T18:10:19.363 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.358+0000 7ff43ad56700 1 -- 172.21.15.26:0/124843448 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4341088c0 con 0x7ff4340f6530 2021-11-03T18:10:19.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.359+0000 7ff43ad56700 1 -- 172.21.15.26:0/124843448 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff434059100 con 0x7ff4340f6530 2021-11-03T18:10:19.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.359+0000 7ff42a7fc700 1 -- 172.21.15.26:0/124843448 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ff43001b060 con 0x7ff4340f6530 2021-11-03T18:10:19.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.359+0000 7ff42a7fc700 1 --2- 172.21.15.26:0/124843448 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff420064100 0x7ff4200665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:10:19.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.359+0000 7ff42a7fc700 1 -- 172.21.15.26:0/124843448 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ff430080670 con 0x7ff4340f6530 2021-11-03T18:10:19.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.360+0000 7ff439553700 1 --2- 172.21.15.26:0/124843448 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff420064100 0x7ff4200665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:10:19.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.360+0000 7ff439553700 1 --2- 172.21.15.26:0/124843448 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff420064100 0x7ff4200665c0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7ff424004630 tx=0x7ff424009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:10:19.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.364+0000 7ff42a7fc700 1 -- 172.21.15.26:0/124843448 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ff4300529d0 con 0x7ff4340f6530 2021-11-03T18:10:19.538 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.541+0000 7ff43ad56700 1 -- 172.21.15.26:0/124843448 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4340fedd0 con 0x7ff420064100 2021-11-03T18:10:19.539 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.542+0000 7ff42a7fc700 1 -- 172.21.15.26:0/124843448 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7ff4340fedd0 con 0x7ff420064100 2021-11-03T18:10:19.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.544+0000 7ff43ad56700 1 -- 172.21.15.26:0/124843448 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff420064100 msgr2=0x7ff4200665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:10:19.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.544+0000 7ff43ad56700 1 --2- 172.21.15.26:0/124843448 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff420064100 0x7ff4200665c0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7ff424004630 tx=0x7ff424009b30).stop 2021-11-03T18:10:19.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.544+0000 7ff43ad56700 1 -- 172.21.15.26:0/124843448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4340f6530 msgr2=0x7ff434106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:10:19.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.544+0000 7ff43ad56700 1 --2- 172.21.15.26:0/124843448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4340f6530 0x7ff434106d80 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7ff430002700 tx=0x7ff430009d80).stop 2021-11-03T18:10:19.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.544+0000 7ff43ad56700 1 -- 172.21.15.26:0/124843448 shutdown_connections 2021-11-03T18:10:19.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.544+0000 7ff43ad56700 1 --2- 172.21.15.26:0/124843448 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff420064100 0x7ff4200665c0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:19.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.544+0000 7ff43ad56700 1 --2- 172.21.15.26:0/124843448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4340f6530 0x7ff434106d80 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:19.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.544+0000 7ff43ad56700 1 --2- 172.21.15.26:0/124843448 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4340f77d0 0x7ff434107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:19.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.544+0000 7ff43ad56700 1 -- 172.21.15.26:0/124843448 >> 172.21.15.26:0/124843448 conn(0x7ff4340f1cd0 msgr2=0x7ff4340fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:10:19.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.544+0000 7ff43ad56700 1 -- 172.21.15.26:0/124843448 shutdown_connections 2021-11-03T18:10:19.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.544+0000 7ff43ad56700 1 -- 172.21.15.26:0/124843448 wait complete. 2021-11-03T18:10:19.551 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:10:19.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.645+0000 7f70e1c30700 1 -- 172.21.15.26:0/1787798835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70dc0f49a0 msgr2=0x7f70dc0f4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:10:19.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.645+0000 7f70e1c30700 1 --2- 172.21.15.26:0/1787798835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70dc0f49a0 0x7f70dc0f4dc0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 rx=0x7f70cc004660 tx=0x7f70cc009b30).stop 2021-11-03T18:10:19.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.645+0000 7f70e1c30700 1 -- 172.21.15.26:0/1787798835 shutdown_connections 2021-11-03T18:10:19.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.645+0000 7f70e1c30700 1 --2- 172.21.15.26:0/1787798835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70dc0f5340 0x7f70dc0f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:19.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.645+0000 7f70e1c30700 1 --2- 172.21.15.26:0/1787798835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70dc0f49a0 0x7f70dc0f4dc0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:19.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.645+0000 7f70e1c30700 1 -- 172.21.15.26:0/1787798835 >> 172.21.15.26:0/1787798835 conn(0x7f70dc0f04c0 msgr2=0x7f70dc0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:10:19.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.645+0000 7f70e1c30700 1 -- 172.21.15.26:0/1787798835 shutdown_connections 2021-11-03T18:10:19.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.645+0000 7f70e1c30700 1 -- 172.21.15.26:0/1787798835 wait complete. 2021-11-03T18:10:19.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.645+0000 7f70e1c30700 1 Processor -- start 2021-11-03T18:10:19.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.645+0000 7f70e1c30700 1 -- start start 2021-11-03T18:10:19.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.646+0000 7f70e1c30700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70dc0f49a0 0x7f70dc106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:10:19.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.646+0000 7f70e1c30700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70dc0f5340 0x7f70dc1074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:10:19.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.646+0000 7f70e1c30700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc107a50 con 0x7f70dc0f49a0 2021-11-03T18:10:19.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.646+0000 7f70e1c30700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc107b90 con 0x7f70dc0f5340 2021-11-03T18:10:19.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.646+0000 7f70db7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70dc0f49a0 0x7f70dc106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:10:19.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.646+0000 7f70db7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70dc0f49a0 0x7f70dc106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58518/0 (socket says 172.21.15.26:58518) 2021-11-03T18:10:19.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.646+0000 7f70db7fe700 1 -- 172.21.15.26:0/443343952 learned_addr learned my addr 172.21.15.26:0/443343952 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:10:19.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.646+0000 7f70daffd700 1 --2- 172.21.15.26:0/443343952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70dc0f5340 0x7f70dc1074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:10:19.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.646+0000 7f70db7fe700 1 -- 172.21.15.26:0/443343952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70dc0f5340 msgr2=0x7f70dc1074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:10:19.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.646+0000 7f70db7fe700 1 --2- 172.21.15.26:0/443343952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70dc0f5340 0x7f70dc1074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:19.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.646+0000 7f70db7fe700 1 -- 172.21.15.26:0/443343952 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70cc005040 con 0x7f70dc0f49a0 2021-11-03T18:10:19.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.646+0000 7f70db7fe700 1 --2- 172.21.15.26:0/443343952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70dc0f49a0 0x7f70dc106fb0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 rx=0x7f70cc013a70 tx=0x7f70cc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:10:19.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.646+0000 7f70c3fff700 1 -- 172.21.15.26:0/443343952 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70cc018070 con 0x7f70dc0f49a0 2021-11-03T18:10:19.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.646+0000 7f70c3fff700 1 -- 172.21.15.26:0/443343952 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f70cc0097d0 con 0x7f70dc0f49a0 2021-11-03T18:10:19.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.646+0000 7f70e1c30700 1 -- 172.21.15.26:0/443343952 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70dc1084d0 con 0x7f70dc0f49a0 2021-11-03T18:10:19.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.647+0000 7f70c3fff700 1 -- 172.21.15.26:0/443343952 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70cc01de80 con 0x7f70dc0f49a0 2021-11-03T18:10:19.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.647+0000 7f70e1c30700 1 -- 172.21.15.26:0/443343952 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70dc108a30 con 0x7f70dc0f49a0 2021-11-03T18:10:19.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.647+0000 7f70e1c30700 1 -- 172.21.15.26:0/443343952 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70dc045ad0 con 0x7f70dc0f49a0 2021-11-03T18:10:19.654 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.648+0000 7f70c3fff700 1 -- 172.21.15.26:0/443343952 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f70cc007ba0 con 0x7f70dc0f49a0 2021-11-03T18:10:19.654 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.648+0000 7f70c3fff700 1 --2- 172.21.15.26:0/443343952 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f70c40640b0 0x7f70c4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:10:19.654 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.649+0000 7f70c3fff700 1 -- 172.21.15.26:0/443343952 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f70cc0823d0 con 0x7f70dc0f49a0 2021-11-03T18:10:19.654 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.649+0000 7f70daffd700 1 --2- 172.21.15.26:0/443343952 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f70c40640b0 0x7f70c4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:10:19.655 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.649+0000 7f70daffd700 1 --2- 172.21.15.26:0/443343952 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f70c40640b0 0x7f70c4066570 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f70dc0f5780 tx=0x7f70d000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:10:19.655 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.653+0000 7f70c3fff700 1 -- 172.21.15.26:0/443343952 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f70cc0547f0 con 0x7f70dc0f49a0 2021-11-03T18:10:19.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.827+0000 7f70e1c30700 1 -- 172.21.15.26:0/443343952 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f70dc108c50 con 0x7f70c40640b0 2021-11-03T18:10:19.840 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.842+0000 7f70c3fff700 1 -- 172.21.15.26:0/443343952 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f70dc108c50 con 0x7f70c40640b0 2021-11-03T18:10:19.841 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:10:19.841 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (81m) 17s ago 82m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:10:19.842 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (73m) 17s ago 82m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:10:19.842 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (73m) 9m ago 82m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:10:19.842 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (81m) 17s ago 82m 42.0M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:10:19.843 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (74m) 17s ago 77m 25.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:10:19.843 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (74m) 17s ago 77m 26.4M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:10:19.844 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (78m) 9m ago 78m 26.4M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:10:19.844 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (77m) 9m ago 77m 26.8M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:10:19.845 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (75m) 17s ago 84m 574M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:10:19.845 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (74m) 9m ago 81m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:10:19.845 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (74m) 17s ago 84m 308M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:10:19.846 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (74m) 9m ago 81m 132M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:10:19.846 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (82m) 17s ago 82m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:10:19.847 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (81m) 9m ago 81m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:10:19.847 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (73m) 17s ago 81m 312M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:10:19.848 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (72m) 17s ago 80m 335M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:10:19.849 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (72m) 17s ago 80m 279M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:10:19.849 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (71m) 9m ago 80m 337M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:10:19.850 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (71m) 9m ago 79m 283M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:10:19.850 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (70m) 9m ago 79m 276M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:10:19.850 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (81m) 17s ago 82m 63.4M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:10:19.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.844+0000 7f70e1c30700 1 -- 172.21.15.26:0/443343952 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f70c40640b0 msgr2=0x7f70c4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:10:19.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.844+0000 7f70e1c30700 1 --2- 172.21.15.26:0/443343952 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f70c40640b0 0x7f70c4066570 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f70dc0f5780 tx=0x7f70d000b040).stop 2021-11-03T18:10:19.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.844+0000 7f70e1c30700 1 -- 172.21.15.26:0/443343952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70dc0f49a0 msgr2=0x7f70dc106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:10:19.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.844+0000 7f70e1c30700 1 --2- 172.21.15.26:0/443343952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70dc0f49a0 0x7f70dc106fb0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 rx=0x7f70cc013a70 tx=0x7f70cc009b30).stop 2021-11-03T18:10:19.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.844+0000 7f70e1c30700 1 -- 172.21.15.26:0/443343952 shutdown_connections 2021-11-03T18:10:19.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.844+0000 7f70e1c30700 1 --2- 172.21.15.26:0/443343952 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f70c40640b0 0x7f70c4066570 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:19.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.844+0000 7f70e1c30700 1 --2- 172.21.15.26:0/443343952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70dc0f49a0 0x7f70dc106fb0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:19.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.844+0000 7f70e1c30700 1 --2- 172.21.15.26:0/443343952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70dc0f5340 0x7f70dc1074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:19.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.844+0000 7f70e1c30700 1 -- 172.21.15.26:0/443343952 >> 172.21.15.26:0/443343952 conn(0x7f70dc0f04c0 msgr2=0x7f70dc0fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:10:19.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.844+0000 7f70e1c30700 1 -- 172.21.15.26:0/443343952 shutdown_connections 2021-11-03T18:10:19.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.844+0000 7f70e1c30700 1 -- 172.21.15.26:0/443343952 wait complete. 2021-11-03T18:10:19.943 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.944+0000 7f2223f3f700 1 -- 172.21.15.26:0/3892362914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f221c0f5ef0 msgr2=0x7f221c0f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:10:19.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.944+0000 7f2223f3f700 1 --2- 172.21.15.26:0/3892362914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f221c0f5ef0 0x7f221c0f6920 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 rx=0x7f2210004660 tx=0x7f2210009b30).stop 2021-11-03T18:10:19.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.944+0000 7f2223f3f700 1 -- 172.21.15.26:0/3892362914 shutdown_connections 2021-11-03T18:10:19.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.944+0000 7f2223f3f700 1 --2- 172.21.15.26:0/3892362914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f221c0f5ef0 0x7f221c0f6920 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:19.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.944+0000 7f2223f3f700 1 --2- 172.21.15.26:0/3892362914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f221c0f55e0 0x7f221c0f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:19.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.944+0000 7f2223f3f700 1 -- 172.21.15.26:0/3892362914 >> 172.21.15.26:0/3892362914 conn(0x7f221c0f0de0 msgr2=0x7f221c0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:10:19.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.944+0000 7f2223f3f700 1 -- 172.21.15.26:0/3892362914 shutdown_connections 2021-11-03T18:10:19.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.944+0000 7f2223f3f700 1 -- 172.21.15.26:0/3892362914 wait complete. 2021-11-03T18:10:19.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.945+0000 7f2223f3f700 1 Processor -- start 2021-11-03T18:10:19.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.945+0000 7f2223f3f700 1 -- start start 2021-11-03T18:10:19.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.945+0000 7f2223f3f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f221c0f55e0 0x7f221c10c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:10:19.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.945+0000 7f2223f3f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f221c0f5ef0 0x7f221c10e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:10:19.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.945+0000 7f2223f3f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221c0603d0 con 0x7f221c0f5ef0 2021-11-03T18:10:19.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.945+0000 7f2223f3f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221c060510 con 0x7f221c0f55e0 2021-11-03T18:10:19.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.945+0000 7f22214da700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f221c0f5ef0 0x7f221c10e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:10:19.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.945+0000 7f22214da700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f221c0f5ef0 0x7f221c10e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58530/0 (socket says 172.21.15.26:58530) 2021-11-03T18:10:19.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.945+0000 7f22214da700 1 -- 172.21.15.26:0/1216102504 learned_addr learned my addr 172.21.15.26:0/1216102504 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:10:19.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.945+0000 7f2221cdb700 1 --2- 172.21.15.26:0/1216102504 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f221c0f55e0 0x7f221c10c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:10:19.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.945+0000 7f22214da700 1 -- 172.21.15.26:0/1216102504 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f221c0f55e0 msgr2=0x7f221c10c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:10:19.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.946+0000 7f22214da700 1 --2- 172.21.15.26:0/1216102504 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f221c0f55e0 0x7f221c10c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:19.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.946+0000 7f22214da700 1 -- 172.21.15.26:0/1216102504 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2210005040 con 0x7f221c0f5ef0 2021-11-03T18:10:19.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.946+0000 7f22214da700 1 --2- 172.21.15.26:0/1216102504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f221c0f5ef0 0x7f221c10e5b0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 rx=0x7f2210009990 tx=0x7f2210009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:10:19.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.946+0000 7f221a7fc700 1 -- 172.21.15.26:0/1216102504 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2210018070 con 0x7f221c0f5ef0 2021-11-03T18:10:19.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.946+0000 7f221a7fc700 1 -- 172.21.15.26:0/1216102504 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2210007ba0 con 0x7f221c0f5ef0 2021-11-03T18:10:19.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.946+0000 7f221a7fc700 1 -- 172.21.15.26:0/1216102504 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f221001c620 con 0x7f221c0f5ef0 2021-11-03T18:10:19.950 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.946+0000 7f2223f3f700 1 -- 172.21.15.26:0/1216102504 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f221c10eaa0 con 0x7f221c0f5ef0 2021-11-03T18:10:19.950 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.946+0000 7f2223f3f700 1 -- 172.21.15.26:0/1216102504 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f221c10ee70 con 0x7f221c0f5ef0 2021-11-03T18:10:19.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.947+0000 7f2223f3f700 1 -- 172.21.15.26:0/1216102504 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f221c0f4a70 con 0x7f221c0f5ef0 2021-11-03T18:10:19.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.947+0000 7f221a7fc700 1 -- 172.21.15.26:0/1216102504 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f221001c8e0 con 0x7f221c0f5ef0 2021-11-03T18:10:19.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.947+0000 7f221a7fc700 1 --2- 172.21.15.26:0/1216102504 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f22040640b0 0x7f2204066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:10:19.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.948+0000 7f221a7fc700 1 -- 172.21.15.26:0/1216102504 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f22100825e0 con 0x7f221c0f5ef0 2021-11-03T18:10:19.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.948+0000 7f2221cdb700 1 --2- 172.21.15.26:0/1216102504 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f22040640b0 0x7f2204066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:10:19.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.948+0000 7f2221cdb700 1 --2- 172.21.15.26:0/1216102504 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f22040640b0 0x7f2204066570 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f220c004550 tx=0x7f220c009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:10:19.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:19.952+0000 7f221a7fc700 1 -- 172.21.15.26:0/1216102504 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f2210054a00 con 0x7f221c0f5ef0 2021-11-03T18:10:20.182 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.184+0000 7f2223f3f700 1 -- 172.21.15.26:0/1216102504 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f221c045ad0 con 0x7f221c0f5ef0 2021-11-03T18:10:20.183 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.185+0000 7f221a7fc700 1 -- 172.21.15.26:0/1216102504 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f22100545f0 con 0x7f221c0f5ef0 2021-11-03T18:10:20.184 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:10:20.185 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:10:20.185 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:10:20.186 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:10:20.186 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:10:20.186 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:10:20.187 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:10:20.187 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:10:20.188 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:10:20.188 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:10:20.189 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:10:20.189 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:10:20.189 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:10:20.190 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:10:20.190 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:10:20.191 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:10:20.191 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:10:20.192 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:10:20.193 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.187+0000 7f2223f3f700 1 -- 172.21.15.26:0/1216102504 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f22040640b0 msgr2=0x7f2204066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:10:20.195 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.187+0000 7f2223f3f700 1 --2- 172.21.15.26:0/1216102504 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f22040640b0 0x7f2204066570 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f220c004550 tx=0x7f220c009040).stop 2021-11-03T18:10:20.195 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.187+0000 7f2223f3f700 1 -- 172.21.15.26:0/1216102504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f221c0f5ef0 msgr2=0x7f221c10e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:10:20.195 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.187+0000 7f2223f3f700 1 --2- 172.21.15.26:0/1216102504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f221c0f5ef0 0x7f221c10e5b0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 rx=0x7f2210009990 tx=0x7f2210009b30).stop 2021-11-03T18:10:20.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.187+0000 7f2223f3f700 1 -- 172.21.15.26:0/1216102504 shutdown_connections 2021-11-03T18:10:20.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.187+0000 7f2223f3f700 1 --2- 172.21.15.26:0/1216102504 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f22040640b0 0x7f2204066570 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:20.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.187+0000 7f2223f3f700 1 --2- 172.21.15.26:0/1216102504 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f221c0f55e0 0x7f221c10c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:20.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.187+0000 7f2223f3f700 1 --2- 172.21.15.26:0/1216102504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f221c0f5ef0 0x7f221c10e5b0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:20.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.187+0000 7f2223f3f700 1 -- 172.21.15.26:0/1216102504 >> 172.21.15.26:0/1216102504 conn(0x7f221c0f0de0 msgr2=0x7f221c0fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:10:20.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.187+0000 7f2223f3f700 1 -- 172.21.15.26:0/1216102504 shutdown_connections 2021-11-03T18:10:20.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.187+0000 7f2223f3f700 1 -- 172.21.15.26:0/1216102504 wait complete. 2021-11-03T18:10:20.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.289+0000 7fdb5977e700 1 -- 172.21.15.26:0/1830922537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb540f5340 msgr2=0x7fdb540f7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:10:20.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.289+0000 7fdb5977e700 1 --2- 172.21.15.26:0/1830922537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb540f5340 0x7fdb540f7ac0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7fdb3c004660 tx=0x7fdb3c009b30).stop 2021-11-03T18:10:20.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.289+0000 7fdb5977e700 1 -- 172.21.15.26:0/1830922537 shutdown_connections 2021-11-03T18:10:20.290 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.289+0000 7fdb5977e700 1 --2- 172.21.15.26:0/1830922537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb540f5340 0x7fdb540f7ac0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:20.290 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.289+0000 7fdb5977e700 1 --2- 172.21.15.26:0/1830922537 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb540f49a0 0x7fdb540f4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:20.290 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.289+0000 7fdb5977e700 1 -- 172.21.15.26:0/1830922537 >> 172.21.15.26:0/1830922537 conn(0x7fdb540f04c0 msgr2=0x7fdb540f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:10:20.290 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.290+0000 7fdb5977e700 1 -- 172.21.15.26:0/1830922537 shutdown_connections 2021-11-03T18:10:20.291 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.290+0000 7fdb5977e700 1 -- 172.21.15.26:0/1830922537 wait complete. 2021-11-03T18:10:20.291 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.290+0000 7fdb5977e700 1 Processor -- start 2021-11-03T18:10:20.291 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.290+0000 7fdb5977e700 1 -- start start 2021-11-03T18:10:20.291 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.290+0000 7fdb5977e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb540f49a0 0x7fdb54106f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:10:20.291 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.290+0000 7fdb5977e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb540f5340 0x7fdb54107420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:10:20.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.290+0000 7fdb5977e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb541079d0 con 0x7fdb540f5340 2021-11-03T18:10:20.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.290+0000 7fdb5977e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb54107b10 con 0x7fdb540f49a0 2021-11-03T18:10:20.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.291+0000 7fdb527fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb540f5340 0x7fdb54107420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:10:20.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.291+0000 7fdb52ffd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb540f49a0 0x7fdb54106f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:10:20.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.291+0000 7fdb527fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb540f5340 0x7fdb54107420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58540/0 (socket says 172.21.15.26:58540) 2021-11-03T18:10:20.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.291+0000 7fdb52ffd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb540f49a0 0x7fdb54106f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.26:34512/0 (socket says 172.21.15.26:34512) 2021-11-03T18:10:20.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.291+0000 7fdb527fc700 1 -- 172.21.15.26:0/2346621050 learned_addr learned my addr 172.21.15.26:0/2346621050 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:10:20.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.291+0000 7fdb527fc700 1 -- 172.21.15.26:0/2346621050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb540f49a0 msgr2=0x7fdb54106f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:10:20.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.291+0000 7fdb527fc700 1 --2- 172.21.15.26:0/2346621050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb540f49a0 0x7fdb54106f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:20.294 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.291+0000 7fdb527fc700 1 -- 172.21.15.26:0/2346621050 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb3c005040 con 0x7fdb540f5340 2021-11-03T18:10:20.294 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.291+0000 7fdb527fc700 1 --2- 172.21.15.26:0/2346621050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb540f5340 0x7fdb54107420 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 rx=0x7fdb3c014040 tx=0x7fdb3c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:10:20.294 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.291+0000 7fdb4b7fe700 1 -- 172.21.15.26:0/2346621050 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb3c019070 con 0x7fdb540f5340 2021-11-03T18:10:20.294 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.291+0000 7fdb4b7fe700 1 -- 172.21.15.26:0/2346621050 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdb3c007e70 con 0x7fdb540f5340 2021-11-03T18:10:20.295 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.291+0000 7fdb5977e700 1 -- 172.21.15.26:0/2346621050 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb54108450 con 0x7fdb540f5340 2021-11-03T18:10:20.295 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.291+0000 7fdb4b7fe700 1 -- 172.21.15.26:0/2346621050 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb3c014d10 con 0x7fdb540f5340 2021-11-03T18:10:20.295 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.291+0000 7fdb5977e700 1 -- 172.21.15.26:0/2346621050 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb541089b0 con 0x7fdb540f5340 2021-11-03T18:10:20.296 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.292+0000 7fdb5977e700 1 -- 172.21.15.26:0/2346621050 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb54045ad0 con 0x7fdb540f5340 2021-11-03T18:10:20.296 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.293+0000 7fdb4b7fe700 1 -- 172.21.15.26:0/2346621050 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fdb3c025070 con 0x7fdb540f5340 2021-11-03T18:10:20.297 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.293+0000 7fdb4b7fe700 1 --2- 172.21.15.26:0/2346621050 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdb400640b0 0x7fdb40066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:10:20.297 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.293+0000 7fdb4b7fe700 1 -- 172.21.15.26:0/2346621050 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fdb3c081820 con 0x7fdb540f5340 2021-11-03T18:10:20.297 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.293+0000 7fdb52ffd700 1 --2- 172.21.15.26:0/2346621050 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdb400640b0 0x7fdb40066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:10:20.297 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.293+0000 7fdb52ffd700 1 --2- 172.21.15.26:0/2346621050 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdb400640b0 0x7fdb40066570 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7fdb4c009fd0 tx=0x7fdb4c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:10:20.298 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.297+0000 7fdb4b7fe700 1 -- 172.21.15.26:0/2346621050 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fdb3c053b00 con 0x7fdb540f5340 2021-11-03T18:10:20.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.500+0000 7fdb5977e700 1 -- 172.21.15.26:0/2346621050 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdb54027a00 con 0x7fdb540f5340 2021-11-03T18:10:20.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.501+0000 7fdb4b7fe700 1 -- 172.21.15.26:0/2346621050 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fdb3c023020 con 0x7fdb540f5340 2021-11-03T18:10:20.499 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:10:20.500 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:10:20.500 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:10:20.501 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:10:20.501 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:10:20.501 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:10:20.502 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:10:20.503 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:10:20.503 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:10:20.503 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:10:20.503 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:10:20.504 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:10:20.504 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:10:20.504 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:10:20.504 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:10:20.504 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:10:20.505 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:10:20.505 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:10:20.505 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:10:20.505 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:10:20.506 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:10:20.506 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:10:20.506 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:10:20.506 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:10:20.506 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:10:20.507 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:10:20.507 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:10:20.507 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:10:20.507 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:10:20.508 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:10:20.508 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:10:20.508 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:10:20.508 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:10:20.508 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:10:20.509 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:10:20.509 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:10:20.510 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:10:20.510 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:10:20.510 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:10:20.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.503+0000 7fdb5977e700 1 -- 172.21.15.26:0/2346621050 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdb400640b0 msgr2=0x7fdb40066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:10:20.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.503+0000 7fdb5977e700 1 --2- 172.21.15.26:0/2346621050 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdb400640b0 0x7fdb40066570 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7fdb4c009fd0 tx=0x7fdb4c00b040).stop 2021-11-03T18:10:20.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.503+0000 7fdb5977e700 1 -- 172.21.15.26:0/2346621050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb540f5340 msgr2=0x7fdb54107420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:10:20.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.503+0000 7fdb5977e700 1 --2- 172.21.15.26:0/2346621050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb540f5340 0x7fdb54107420 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 rx=0x7fdb3c014040 tx=0x7fdb3c00b040).stop 2021-11-03T18:10:20.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.503+0000 7fdb5977e700 1 -- 172.21.15.26:0/2346621050 shutdown_connections 2021-11-03T18:10:20.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.503+0000 7fdb5977e700 1 --2- 172.21.15.26:0/2346621050 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdb400640b0 0x7fdb40066570 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:20.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.503+0000 7fdb5977e700 1 --2- 172.21.15.26:0/2346621050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb540f49a0 0x7fdb54106f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:20.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.503+0000 7fdb5977e700 1 --2- 172.21.15.26:0/2346621050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb540f5340 0x7fdb54107420 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:20.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.503+0000 7fdb5977e700 1 -- 172.21.15.26:0/2346621050 >> 172.21.15.26:0/2346621050 conn(0x7fdb540f04c0 msgr2=0x7fdb540fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:10:20.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.503+0000 7fdb5977e700 1 -- 172.21.15.26:0/2346621050 shutdown_connections 2021-11-03T18:10:20.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:20.503+0000 7fdb5977e700 1 -- 172.21.15.26:0/2346621050 wait complete. 2021-11-03T18:10:20.514 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:10:21.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:20 smithi026 ceph-mon[96795]: from='client.36476 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:10:21.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:20 smithi026 ceph-mon[96795]: pgmap v2270: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:21.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:20 smithi026 ceph-mon[96795]: from='client.36480 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:10:21.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:20 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1216102504' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:10:21.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:20 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2346621050' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:10:21.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:20 smithi194 ceph-mon[65619]: from='client.36476 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:10:21.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:20 smithi194 ceph-mon[65619]: pgmap v2270: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:21.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:20 smithi194 ceph-mon[65619]: from='client.36480 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:10:21.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:20 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1216102504' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:10:21.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:20 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2346621050' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:10:23.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:22 smithi026 ceph-mon[96795]: pgmap v2271: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:23.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:22 smithi194 ceph-mon[65619]: pgmap v2271: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:25.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:24 smithi194 ceph-mon[65619]: pgmap v2272: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:25.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:24 smithi026 ceph-mon[96795]: pgmap v2272: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:27.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:26 smithi194 ceph-mon[65619]: pgmap v2273: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:27.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:26 smithi026 ceph-mon[96795]: pgmap v2273: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:29.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:28 smithi194 ceph-mon[65619]: pgmap v2274: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:29.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:28 smithi026 ceph-mon[96795]: pgmap v2274: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:31.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:30 smithi194 ceph-mon[65619]: pgmap v2275: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:31.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:30 smithi026 ceph-mon[96795]: pgmap v2275: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:33.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:32 smithi194 ceph-mon[65619]: pgmap v2276: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:33.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:32 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:10:33.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:32 smithi026 ceph-mon[96795]: pgmap v2276: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:33.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:32 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:10:34.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:33 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:10:34.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:33 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:10:35.255 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:34 smithi194 ceph-mon[65619]: pgmap v2277: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:35.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:34 smithi026 ceph-mon[96795]: pgmap v2277: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:37.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:36 smithi194 ceph-mon[65619]: pgmap v2278: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:37.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:36 smithi026 ceph-mon[96795]: pgmap v2278: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:39.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:38 smithi194 ceph-mon[65619]: pgmap v2279: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:39.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:38 smithi026 ceph-mon[96795]: pgmap v2279: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:41.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:40 smithi194 ceph-mon[65619]: pgmap v2280: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:41.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:40 smithi026 ceph-mon[96795]: pgmap v2280: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:43.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:42 smithi194 ceph-mon[65619]: pgmap v2281: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:43.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:42 smithi026 ceph-mon[96795]: pgmap v2281: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:45.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:44 smithi194 ceph-mon[65619]: pgmap v2282: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:45.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:44 smithi026 ceph-mon[96795]: pgmap v2282: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:47.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:46 smithi194 ceph-mon[65619]: pgmap v2283: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:47.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:46 smithi026 ceph-mon[96795]: pgmap v2283: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:48.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:47 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:10:48.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:47 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:10:49.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:48 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:10:49.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:48 smithi194 ceph-mon[65619]: pgmap v2284: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:49.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:10:49.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:10:49.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:48 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:10:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:48 smithi026 ceph-mon[96795]: pgmap v2284: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:10:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:10:50.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.616+0000 7f42491fd700 1 -- 172.21.15.26:0/3457446797 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42440f55e0 msgr2=0x7f42440f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:10:50.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.616+0000 7f42491fd700 1 --2- 172.21.15.26:0/3457446797 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42440f55e0 0x7f42440f5a00 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 rx=0x7f423c0099e0 tx=0x7f423c004d10).stop 2021-11-03T18:10:50.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.616+0000 7f42491fd700 1 -- 172.21.15.26:0/3457446797 shutdown_connections 2021-11-03T18:10:50.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.616+0000 7f42491fd700 1 --2- 172.21.15.26:0/3457446797 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42440f5ef0 0x7f42440f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:50.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.616+0000 7f42491fd700 1 --2- 172.21.15.26:0/3457446797 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42440f55e0 0x7f42440f5a00 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:50.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.616+0000 7f42491fd700 1 -- 172.21.15.26:0/3457446797 >> 172.21.15.26:0/3457446797 conn(0x7f42440f0de0 msgr2=0x7f42440f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:10:50.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.616+0000 7f42491fd700 1 -- 172.21.15.26:0/3457446797 shutdown_connections 2021-11-03T18:10:50.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.616+0000 7f42491fd700 1 -- 172.21.15.26:0/3457446797 wait complete. 2021-11-03T18:10:50.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.617+0000 7f42491fd700 1 Processor -- start 2021-11-03T18:10:50.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.617+0000 7f42491fd700 1 -- start start 2021-11-03T18:10:50.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.617+0000 7f42491fd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42440f55e0 0x7f4244109d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:10:50.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.617+0000 7f42491fd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42440f5ef0 0x7f424410c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:10:50.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.617+0000 7f42491fd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4244060540 con 0x7f42440f55e0 2021-11-03T18:10:50.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.617+0000 7f42491fd700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4244060680 con 0x7f42440f5ef0 2021-11-03T18:10:50.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.617+0000 7f4242d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42440f55e0 0x7f4244109d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:10:50.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.618+0000 7f4242d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42440f55e0 0x7f4244109d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58572/0 (socket says 172.21.15.26:58572) 2021-11-03T18:10:50.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.618+0000 7f4242d9d700 1 -- 172.21.15.26:0/3763582515 learned_addr learned my addr 172.21.15.26:0/3763582515 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:10:50.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.618+0000 7f4242d9d700 1 -- 172.21.15.26:0/3763582515 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42440f5ef0 msgr2=0x7f424410c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:10:50.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.618+0000 7f424259c700 1 --2- 172.21.15.26:0/3763582515 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42440f5ef0 0x7f424410c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:10:50.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.618+0000 7f4242d9d700 1 --2- 172.21.15.26:0/3763582515 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42440f5ef0 0x7f424410c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:50.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.618+0000 7f4242d9d700 1 -- 172.21.15.26:0/3763582515 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f423c009640 con 0x7f42440f55e0 2021-11-03T18:10:50.622 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.618+0000 7f424259c700 1 --2- 172.21.15.26:0/3763582515 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42440f5ef0 0x7f424410c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:10:50.622 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.618+0000 7f4242d9d700 1 --2- 172.21.15.26:0/3763582515 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42440f55e0 0x7f4244109d20 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7f423c004b70 tx=0x7f423c004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:10:50.622 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.618+0000 7f423b7fe700 1 -- 172.21.15.26:0/3763582515 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f423c00e030 con 0x7f42440f55e0 2021-11-03T18:10:50.622 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.618+0000 7f423b7fe700 1 -- 172.21.15.26:0/3763582515 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f423c0049b0 con 0x7f42440f55e0 2021-11-03T18:10:50.622 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.618+0000 7f423b7fe700 1 -- 172.21.15.26:0/3763582515 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f423c018070 con 0x7f42440f55e0 2021-11-03T18:10:50.623 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.618+0000 7f42491fd700 1 -- 172.21.15.26:0/3763582515 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f424410c7d0 con 0x7f42440f55e0 2021-11-03T18:10:50.623 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.618+0000 7f42491fd700 1 -- 172.21.15.26:0/3763582515 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f424410cc80 con 0x7f42440f55e0 2021-11-03T18:10:50.624 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.619+0000 7f42491fd700 1 -- 172.21.15.26:0/3763582515 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42440f4a70 con 0x7f42440f55e0 2021-11-03T18:10:50.624 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.620+0000 7f423b7fe700 1 -- 172.21.15.26:0/3763582515 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f423c01db40 con 0x7f42440f55e0 2021-11-03T18:10:50.625 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.620+0000 7f423b7fe700 1 --2- 172.21.15.26:0/3763582515 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f42300640b0 0x7f4230066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:10:50.625 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.620+0000 7f423b7fe700 1 -- 172.21.15.26:0/3763582515 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f423c0827c0 con 0x7f42440f55e0 2021-11-03T18:10:50.625 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.620+0000 7f424259c700 1 --2- 172.21.15.26:0/3763582515 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f42300640b0 0x7f4230066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:10:50.625 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.621+0000 7f424259c700 1 --2- 172.21.15.26:0/3763582515 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f42300640b0 0x7f4230066570 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f422c0041d0 tx=0x7f422c009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:10:50.625 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.624+0000 7f423b7fe700 1 -- 172.21.15.26:0/3763582515 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f423c054ac0 con 0x7f42440f55e0 2021-11-03T18:10:50.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.804+0000 7f42491fd700 1 -- 172.21.15.26:0/3763582515 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f42440fdf50 con 0x7f42300640b0 2021-11-03T18:10:50.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.806+0000 7f423b7fe700 1 -- 172.21.15.26:0/3763582515 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f42440fdf50 con 0x7f42300640b0 2021-11-03T18:10:50.806 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.808+0000 7f42491fd700 1 -- 172.21.15.26:0/3763582515 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f42300640b0 msgr2=0x7f4230066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:10:50.807 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.808+0000 7f42491fd700 1 --2- 172.21.15.26:0/3763582515 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f42300640b0 0x7f4230066570 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f422c0041d0 tx=0x7f422c009040).stop 2021-11-03T18:10:50.807 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.808+0000 7f42491fd700 1 -- 172.21.15.26:0/3763582515 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42440f55e0 msgr2=0x7f4244109d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:10:50.807 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.808+0000 7f42491fd700 1 --2- 172.21.15.26:0/3763582515 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42440f55e0 0x7f4244109d20 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7f423c004b70 tx=0x7f423c004d10).stop 2021-11-03T18:10:50.807 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.808+0000 7f42491fd700 1 -- 172.21.15.26:0/3763582515 shutdown_connections 2021-11-03T18:10:50.808 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.808+0000 7f42491fd700 1 --2- 172.21.15.26:0/3763582515 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f42300640b0 0x7f4230066570 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:50.808 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.808+0000 7f42491fd700 1 --2- 172.21.15.26:0/3763582515 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42440f55e0 0x7f4244109d20 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:50.808 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.808+0000 7f42491fd700 1 --2- 172.21.15.26:0/3763582515 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42440f5ef0 0x7f424410c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:50.809 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.808+0000 7f42491fd700 1 -- 172.21.15.26:0/3763582515 >> 172.21.15.26:0/3763582515 conn(0x7f42440f0de0 msgr2=0x7f42440fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:10:50.809 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.808+0000 7f42491fd700 1 -- 172.21.15.26:0/3763582515 shutdown_connections 2021-11-03T18:10:50.809 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.808+0000 7f42491fd700 1 -- 172.21.15.26:0/3763582515 wait complete. 2021-11-03T18:10:50.816 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:10:50.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.908+0000 7f84eb9b9700 1 -- 172.21.15.26:0/917568556 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84e40f6860 msgr2=0x7f84e40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:10:50.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.908+0000 7f84eb9b9700 1 --2- 172.21.15.26:0/917568556 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84e40f6860 0x7f84e40f6cc0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7f84e0004660 tx=0x7f84e0009b30).stop 2021-11-03T18:10:50.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.908+0000 7f84eb9b9700 1 -- 172.21.15.26:0/917568556 shutdown_connections 2021-11-03T18:10:50.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.908+0000 7f84eb9b9700 1 --2- 172.21.15.26:0/917568556 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84e40f6860 0x7f84e40f6cc0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:50.913 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.908+0000 7f84eb9b9700 1 --2- 172.21.15.26:0/917568556 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84e40f55c0 0x7f84e40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:50.914 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.908+0000 7f84eb9b9700 1 -- 172.21.15.26:0/917568556 >> 172.21.15.26:0/917568556 conn(0x7f84e40f0d40 msgr2=0x7f84e40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:10:50.914 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.908+0000 7f84eb9b9700 1 -- 172.21.15.26:0/917568556 shutdown_connections 2021-11-03T18:10:50.915 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.908+0000 7f84eb9b9700 1 -- 172.21.15.26:0/917568556 wait complete. 2021-11-03T18:10:50.915 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.908+0000 7f84eb9b9700 1 Processor -- start 2021-11-03T18:10:50.916 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.909+0000 7f84eb9b9700 1 -- start start 2021-11-03T18:10:50.916 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.909+0000 7f84eb9b9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84e40f55c0 0x7f84e4106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:10:50.916 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.909+0000 7f84eb9b9700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84e40f6860 0x7f84e4107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:10:50.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.909+0000 7f84eb9b9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e4107a10 con 0x7f84e40f55c0 2021-11-03T18:10:50.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.909+0000 7f84eb9b9700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e4107b50 con 0x7f84e40f6860 2021-11-03T18:10:50.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.909+0000 7f84e9755700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84e40f55c0 0x7f84e4106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:10:50.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.909+0000 7f84e9755700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84e40f55c0 0x7f84e4106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58582/0 (socket says 172.21.15.26:58582) 2021-11-03T18:10:50.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.909+0000 7f84e9755700 1 -- 172.21.15.26:0/3704161749 learned_addr learned my addr 172.21.15.26:0/3704161749 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:10:50.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.909+0000 7f84e8f54700 1 --2- 172.21.15.26:0/3704161749 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84e40f6860 0x7f84e4107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:10:50.919 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.909+0000 7f84e9755700 1 -- 172.21.15.26:0/3704161749 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84e40f6860 msgr2=0x7f84e4107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:10:50.919 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.909+0000 7f84e9755700 1 --2- 172.21.15.26:0/3704161749 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84e40f6860 0x7f84e4107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:50.920 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.909+0000 7f84e9755700 1 -- 172.21.15.26:0/3704161749 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e0005040 con 0x7f84e40f55c0 2021-11-03T18:10:50.920 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.909+0000 7f84e9755700 1 --2- 172.21.15.26:0/3704161749 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84e40f55c0 0x7f84e4106f70 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 rx=0x7f84d800c530 tx=0x7f84d8007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:10:50.921 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.909+0000 7f84d5ffb700 1 -- 172.21.15.26:0/3704161749 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84d800f650 con 0x7f84e40f55c0 2021-11-03T18:10:50.921 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.909+0000 7f84d5ffb700 1 -- 172.21.15.26:0/3704161749 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f84d800fc60 con 0x7f84e40f55c0 2021-11-03T18:10:50.921 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.909+0000 7f84eb9b9700 1 -- 172.21.15.26:0/3704161749 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84e41084f0 con 0x7f84e40f55c0 2021-11-03T18:10:50.922 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.909+0000 7f84d5ffb700 1 -- 172.21.15.26:0/3704161749 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84d8012d20 con 0x7f84e40f55c0 2021-11-03T18:10:50.923 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.910+0000 7f84eb9b9700 1 -- 172.21.15.26:0/3704161749 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84e4108ab0 con 0x7f84e40f55c0 2021-11-03T18:10:50.923 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.911+0000 7f84eb9b9700 1 -- 172.21.15.26:0/3704161749 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84e4045ad0 con 0x7f84e40f55c0 2021-11-03T18:10:50.923 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.911+0000 7f84d5ffb700 1 -- 172.21.15.26:0/3704161749 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f84d8019030 con 0x7f84e40f55c0 2021-11-03T18:10:50.923 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.911+0000 7f84d5ffb700 1 --2- 172.21.15.26:0/3704161749 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f84d00640b0 0x7f84d0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:10:50.924 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.911+0000 7f84d5ffb700 1 -- 172.21.15.26:0/3704161749 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f84d8080620 con 0x7f84e40f55c0 2021-11-03T18:10:50.924 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.912+0000 7f84e8f54700 1 --2- 172.21.15.26:0/3704161749 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f84d00640b0 0x7f84d0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:10:50.924 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.912+0000 7f84e8f54700 1 --2- 172.21.15.26:0/3704161749 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f84d00640b0 0x7f84d0066570 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f84e0009da0 tx=0x7f84e0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:10:50.925 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:50.916+0000 7f84d5ffb700 1 -- 172.21.15.26:0/3704161749 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f84d80529a0 con 0x7f84e40f55c0 2021-11-03T18:10:51.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.090+0000 7f84eb9b9700 1 -- 172.21.15.26:0/3704161749 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f84e405fd30 con 0x7f84d00640b0 2021-11-03T18:10:51.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.105+0000 7f84d5ffb700 1 -- 172.21.15.26:0/3704161749 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f84e405fd30 con 0x7f84d00640b0 2021-11-03T18:10:51.104 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:10:51.104 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (82m) 48s ago 83m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:10:51.104 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (74m) 48s ago 83m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:10:51.104 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (74m) 9m ago 82m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:10:51.105 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (81m) 48s ago 83m 42.0M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:10:51.105 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (75m) 48s ago 78m 25.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:10:51.105 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (75m) 48s ago 78m 26.4M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:10:51.105 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (78m) 9m ago 78m 26.4M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:10:51.106 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (78m) 9m ago 78m 26.8M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:10:51.106 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (75m) 48s ago 84m 574M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:10:51.106 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (75m) 9m ago 82m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:10:51.106 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (75m) 48s ago 84m 308M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:10:51.107 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (74m) 9m ago 82m 132M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:10:51.107 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (82m) 48s ago 82m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:10:51.107 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (82m) 9m ago 82m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:10:51.107 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (73m) 48s ago 81m 312M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:10:51.107 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (73m) 48s ago 81m 335M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:10:51.108 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (72m) 48s ago 80m 279M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:10:51.108 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (72m) 9m ago 80m 337M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:10:51.108 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (71m) 9m ago 80m 283M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:10:51.108 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (71m) 9m ago 80m 276M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:10:51.109 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (81m) 48s ago 82m 63.4M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:10:51.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.107+0000 7f84eb9b9700 1 -- 172.21.15.26:0/3704161749 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f84d00640b0 msgr2=0x7f84d0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:10:51.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.107+0000 7f84eb9b9700 1 --2- 172.21.15.26:0/3704161749 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f84d00640b0 0x7f84d0066570 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f84e0009da0 tx=0x7f84e0009b30).stop 2021-11-03T18:10:51.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.107+0000 7f84eb9b9700 1 -- 172.21.15.26:0/3704161749 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84e40f55c0 msgr2=0x7f84e4106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:10:51.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.107+0000 7f84eb9b9700 1 --2- 172.21.15.26:0/3704161749 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84e40f55c0 0x7f84e4106f70 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 rx=0x7f84d800c530 tx=0x7f84d8007e10).stop 2021-11-03T18:10:51.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.107+0000 7f84eb9b9700 1 -- 172.21.15.26:0/3704161749 shutdown_connections 2021-11-03T18:10:51.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.107+0000 7f84eb9b9700 1 --2- 172.21.15.26:0/3704161749 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f84d00640b0 0x7f84d0066570 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:51.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.107+0000 7f84eb9b9700 1 --2- 172.21.15.26:0/3704161749 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84e40f55c0 0x7f84e4106f70 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:51.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.107+0000 7f84eb9b9700 1 --2- 172.21.15.26:0/3704161749 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84e40f6860 0x7f84e4107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:51.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.107+0000 7f84eb9b9700 1 -- 172.21.15.26:0/3704161749 >> 172.21.15.26:0/3704161749 conn(0x7f84e40f0d40 msgr2=0x7f84e405f620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:10:51.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.107+0000 7f84eb9b9700 1 -- 172.21.15.26:0/3704161749 shutdown_connections 2021-11-03T18:10:51.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.107+0000 7f84eb9b9700 1 -- 172.21.15.26:0/3704161749 wait complete. 2021-11-03T18:10:51.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.206+0000 7f36a31f5700 1 -- 172.21.15.26:0/4242823515 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f369c0f6bb0 msgr2=0x7f369c0f6fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:10:51.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.206+0000 7f36a31f5700 1 --2- 172.21.15.26:0/4242823515 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f369c0f6bb0 0x7f369c0f6fd0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 rx=0x7f36940099e0 tx=0x7f3694004d10).stop 2021-11-03T18:10:51.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.206+0000 7f36a31f5700 1 -- 172.21.15.26:0/4242823515 shutdown_connections 2021-11-03T18:10:51.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.206+0000 7f36a31f5700 1 --2- 172.21.15.26:0/4242823515 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f369c0f58b0 0x7f369c0f5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:51.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.206+0000 7f36a31f5700 1 --2- 172.21.15.26:0/4242823515 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f369c0f6bb0 0x7f369c0f6fd0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:51.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.206+0000 7f36a31f5700 1 -- 172.21.15.26:0/4242823515 >> 172.21.15.26:0/4242823515 conn(0x7f369c0f04c0 msgr2=0x7f369c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:10:51.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.206+0000 7f36a31f5700 1 -- 172.21.15.26:0/4242823515 shutdown_connections 2021-11-03T18:10:51.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.206+0000 7f36a31f5700 1 -- 172.21.15.26:0/4242823515 wait complete. 2021-11-03T18:10:51.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.206+0000 7f36a31f5700 1 Processor -- start 2021-11-03T18:10:51.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.206+0000 7f36a31f5700 1 -- start start 2021-11-03T18:10:51.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.206+0000 7f36a31f5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f369c0f58b0 0x7f369c0f9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:10:51.213 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.207+0000 7f36a31f5700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f369c0f6bb0 0x7f369c0f8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:10:51.213 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.207+0000 7f36a31f5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369c0f8980 con 0x7f369c0f58b0 2021-11-03T18:10:51.214 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.207+0000 7f36a31f5700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369c0f8ac0 con 0x7f369c0f6bb0 2021-11-03T18:10:51.214 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.207+0000 7f36a0f91700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f369c0f58b0 0x7f369c0f9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:10:51.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.207+0000 7f36a0f91700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f369c0f58b0 0x7f369c0f9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58592/0 (socket says 172.21.15.26:58592) 2021-11-03T18:10:51.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.207+0000 7f36a0f91700 1 -- 172.21.15.26:0/2197725791 learned_addr learned my addr 172.21.15.26:0/2197725791 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:10:51.216 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.207+0000 7f369bfff700 1 --2- 172.21.15.26:0/2197725791 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f369c0f6bb0 0x7f369c0f8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:10:51.216 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.207+0000 7f36a0f91700 1 -- 172.21.15.26:0/2197725791 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f369c0f6bb0 msgr2=0x7f369c0f8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:10:51.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.207+0000 7f36a0f91700 1 --2- 172.21.15.26:0/2197725791 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f369c0f6bb0 0x7f369c0f8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:51.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.207+0000 7f36a0f91700 1 -- 172.21.15.26:0/2197725791 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3694009640 con 0x7f369c0f58b0 2021-11-03T18:10:51.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.207+0000 7f369bfff700 1 --2- 172.21.15.26:0/2197725791 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f369c0f6bb0 0x7f369c0f8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:10:51.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.207+0000 7f36a0f91700 1 --2- 172.21.15.26:0/2197725791 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f369c0f58b0 0x7f369c0f9fa0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 rx=0x7f369400c010 tx=0x7f3694004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:10:51.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.207+0000 7f36997fa700 1 -- 172.21.15.26:0/2197725791 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f369400e070 con 0x7f369c0f58b0 2021-11-03T18:10:51.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.207+0000 7f36997fa700 1 -- 172.21.15.26:0/2197725791 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3694007dc0 con 0x7f369c0f58b0 2021-11-03T18:10:51.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.207+0000 7f36a31f5700 1 -- 172.21.15.26:0/2197725791 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f369c0f8d40 con 0x7f369c0f58b0 2021-11-03T18:10:51.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.207+0000 7f36997fa700 1 -- 172.21.15.26:0/2197725791 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3694018070 con 0x7f369c0f58b0 2021-11-03T18:10:51.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.207+0000 7f36a31f5700 1 -- 172.21.15.26:0/2197725791 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f369c0f9220 con 0x7f369c0f58b0 2021-11-03T18:10:51.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.208+0000 7f36a31f5700 1 -- 172.21.15.26:0/2197725791 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f369c045ad0 con 0x7f369c0f58b0 2021-11-03T18:10:51.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.209+0000 7f36997fa700 1 -- 172.21.15.26:0/2197725791 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f3694024060 con 0x7f369c0f58b0 2021-11-03T18:10:51.221 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.209+0000 7f36997fa700 1 --2- 172.21.15.26:0/2197725791 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f36840640b0 0x7f3684066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:10:51.222 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.209+0000 7f36997fa700 1 -- 172.21.15.26:0/2197725791 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f36940822c0 con 0x7f369c0f58b0 2021-11-03T18:10:51.222 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.209+0000 7f369bfff700 1 --2- 172.21.15.26:0/2197725791 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f36840640b0 0x7f3684066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:10:51.223 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.209+0000 7f369bfff700 1 --2- 172.21.15.26:0/2197725791 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f36840640b0 0x7f3684066570 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f369c0f6980 tx=0x7f3690009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:10:51.223 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.213+0000 7f36997fa700 1 -- 172.21.15.26:0/2197725791 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f3694054620 con 0x7f369c0f58b0 2021-11-03T18:10:51.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:50 smithi194 ceph-mon[65619]: pgmap v2285: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:51.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:50 smithi026 ceph-mon[96795]: pgmap v2285: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:51.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.442+0000 7f36a31f5700 1 -- 172.21.15.26:0/2197725791 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f369c10f690 con 0x7f369c0f58b0 2021-11-03T18:10:51.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.443+0000 7f36997fa700 1 -- 172.21.15.26:0/2197725791 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f3694054210 con 0x7f369c0f58b0 2021-11-03T18:10:51.442 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:10:51.442 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:10:51.442 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:10:51.443 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:10:51.443 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:10:51.443 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:10:51.443 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:10:51.443 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:10:51.444 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:10:51.444 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:10:51.444 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:10:51.444 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:10:51.445 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:10:51.445 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:10:51.445 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:10:51.445 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:10:51.446 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:10:51.446 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:10:51.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.444+0000 7f36a31f5700 1 -- 172.21.15.26:0/2197725791 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f36840640b0 msgr2=0x7f3684066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:10:51.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.444+0000 7f36a31f5700 1 --2- 172.21.15.26:0/2197725791 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f36840640b0 0x7f3684066570 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f369c0f6980 tx=0x7f3690009040).stop 2021-11-03T18:10:51.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.444+0000 7f36a31f5700 1 -- 172.21.15.26:0/2197725791 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f369c0f58b0 msgr2=0x7f369c0f9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:10:51.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.444+0000 7f36a31f5700 1 --2- 172.21.15.26:0/2197725791 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f369c0f58b0 0x7f369c0f9fa0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 rx=0x7f369400c010 tx=0x7f3694004d10).stop 2021-11-03T18:10:51.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.445+0000 7f36a31f5700 1 -- 172.21.15.26:0/2197725791 shutdown_connections 2021-11-03T18:10:51.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.445+0000 7f36a31f5700 1 --2- 172.21.15.26:0/2197725791 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f36840640b0 0x7f3684066570 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:51.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.445+0000 7f36a31f5700 1 --2- 172.21.15.26:0/2197725791 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f369c0f58b0 0x7f369c0f9fa0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:51.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.445+0000 7f36a31f5700 1 --2- 172.21.15.26:0/2197725791 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f369c0f6bb0 0x7f369c0f8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:51.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.445+0000 7f36a31f5700 1 -- 172.21.15.26:0/2197725791 >> 172.21.15.26:0/2197725791 conn(0x7f369c0f04c0 msgr2=0x7f369c0f47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:10:51.450 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.445+0000 7f36a31f5700 1 -- 172.21.15.26:0/2197725791 shutdown_connections 2021-11-03T18:10:51.450 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.445+0000 7f36a31f5700 1 -- 172.21.15.26:0/2197725791 wait complete. 2021-11-03T18:10:51.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.545+0000 7f4e39dce700 1 -- 172.21.15.26:0/669574779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e340f66e0 msgr2=0x7f4e340f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:10:51.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.545+0000 7f4e39dce700 1 --2- 172.21.15.26:0/669574779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e340f66e0 0x7f4e340f6b00 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 rx=0x7f4e28004660 tx=0x7f4e28009b30).stop 2021-11-03T18:10:51.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.545+0000 7f4e39dce700 1 -- 172.21.15.26:0/669574779 shutdown_connections 2021-11-03T18:10:51.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.545+0000 7f4e39dce700 1 --2- 172.21.15.26:0/669574779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e340f6ff0 0x7f4e340f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:51.548 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.545+0000 7f4e39dce700 1 --2- 172.21.15.26:0/669574779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e340f66e0 0x7f4e340f6b00 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:51.548 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.545+0000 7f4e39dce700 1 -- 172.21.15.26:0/669574779 >> 172.21.15.26:0/669574779 conn(0x7f4e340f1f00 msgr2=0x7f4e340f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:10:51.548 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.545+0000 7f4e39dce700 1 -- 172.21.15.26:0/669574779 shutdown_connections 2021-11-03T18:10:51.549 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.545+0000 7f4e39dce700 1 -- 172.21.15.26:0/669574779 wait complete. 2021-11-03T18:10:51.549 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.545+0000 7f4e39dce700 1 Processor -- start 2021-11-03T18:10:51.549 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.546+0000 7f4e39dce700 1 -- start start 2021-11-03T18:10:51.550 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.546+0000 7f4e39dce700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e340f66e0 0x7f4e3406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:10:51.550 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.546+0000 7f4e39dce700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e340f6ff0 0x7f4e34069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:10:51.551 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.546+0000 7f4e39dce700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3406a380 con 0x7f4e340f6ff0 2021-11-03T18:10:51.551 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.546+0000 7f4e39dce700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3406a4c0 con 0x7f4e340f66e0 2021-11-03T18:10:51.551 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.546+0000 7f4e32ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e340f6ff0 0x7f4e34069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:10:51.551 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.546+0000 7f4e32ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e340f6ff0 0x7f4e34069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58604/0 (socket says 172.21.15.26:58604) 2021-11-03T18:10:51.551 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.546+0000 7f4e32ffd700 1 -- 172.21.15.26:0/2905861494 learned_addr learned my addr 172.21.15.26:0/2905861494 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:10:51.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.546+0000 7f4e337fe700 1 --2- 172.21.15.26:0/2905861494 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e340f66e0 0x7f4e3406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:10:51.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.546+0000 7f4e32ffd700 1 -- 172.21.15.26:0/2905861494 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e340f66e0 msgr2=0x7f4e3406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:10:51.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.546+0000 7f4e32ffd700 1 --2- 172.21.15.26:0/2905861494 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e340f66e0 0x7f4e3406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:51.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.546+0000 7f4e32ffd700 1 -- 172.21.15.26:0/2905861494 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e28005040 con 0x7f4e340f6ff0 2021-11-03T18:10:51.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.547+0000 7f4e32ffd700 1 --2- 172.21.15.26:0/2905861494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e340f6ff0 0x7f4e34069e20 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 rx=0x7f4e2400c530 tx=0x7f4e24007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:10:51.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.547+0000 7f4e1bfff700 1 -- 172.21.15.26:0/2905861494 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e2400f650 con 0x7f4e340f6ff0 2021-11-03T18:10:51.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.547+0000 7f4e1bfff700 1 -- 172.21.15.26:0/2905861494 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4e2400fc60 con 0x7f4e340f6ff0 2021-11-03T18:10:51.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.547+0000 7f4e39dce700 1 -- 172.21.15.26:0/2905861494 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e3406a7a0 con 0x7f4e340f6ff0 2021-11-03T18:10:51.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.547+0000 7f4e1bfff700 1 -- 172.21.15.26:0/2905861494 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e24012c20 con 0x7f4e340f6ff0 2021-11-03T18:10:51.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.547+0000 7f4e39dce700 1 -- 172.21.15.26:0/2905861494 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e3410ef90 con 0x7f4e340f6ff0 2021-11-03T18:10:51.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.548+0000 7f4e39dce700 1 -- 172.21.15.26:0/2905861494 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e34045ad0 con 0x7f4e340f6ff0 2021-11-03T18:10:51.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.548+0000 7f4e1bfff700 1 -- 172.21.15.26:0/2905861494 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f4e24010070 con 0x7f4e340f6ff0 2021-11-03T18:10:51.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.549+0000 7f4e1bfff700 1 --2- 172.21.15.26:0/2905861494 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4e1c0640b0 0x7f4e1c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:10:51.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.549+0000 7f4e1bfff700 1 -- 172.21.15.26:0/2905861494 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f4e24080610 con 0x7f4e340f6ff0 2021-11-03T18:10:51.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.549+0000 7f4e337fe700 1 --2- 172.21.15.26:0/2905861494 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4e1c0640b0 0x7f4e1c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:10:51.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.549+0000 7f4e337fe700 1 --2- 172.21.15.26:0/2905861494 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4e1c0640b0 0x7f4e1c066570 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f4e28004630 tx=0x7f4e28009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:10:51.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.553+0000 7f4e1bfff700 1 -- 172.21.15.26:0/2905861494 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f4e240527c0 con 0x7f4e340f6ff0 2021-11-03T18:10:51.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.756+0000 7f4e39dce700 1 -- 172.21.15.26:0/2905861494 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4e34027a00 con 0x7f4e340f6ff0 2021-11-03T18:10:51.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.757+0000 7f4e1bfff700 1 -- 172.21.15.26:0/2905861494 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f4e240523b0 con 0x7f4e340f6ff0 2021-11-03T18:10:51.756 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:10:51.756 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:10:51.756 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:10:51.756 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:10:51.757 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:10:51.757 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:10:51.757 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:10:51.758 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:10:51.758 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:10:51.758 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:10:51.758 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:10:51.759 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:10:51.759 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:10:51.759 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:10:51.760 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:10:51.760 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:10:51.760 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:10:51.761 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:10:51.761 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:10:51.761 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:10:51.761 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:10:51.761 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:10:51.762 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:10:51.762 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:10:51.762 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:10:51.762 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:10:51.763 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:10:51.763 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:10:51.763 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:10:51.763 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:10:51.763 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:10:51.764 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:10:51.764 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:10:51.764 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:10:51.764 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:10:51.765 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:10:51.765 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:10:51.765 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:10:51.765 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:10:51.766 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.758+0000 7f4e39dce700 1 -- 172.21.15.26:0/2905861494 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4e1c0640b0 msgr2=0x7f4e1c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:10:51.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.758+0000 7f4e39dce700 1 --2- 172.21.15.26:0/2905861494 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4e1c0640b0 0x7f4e1c066570 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f4e28004630 tx=0x7f4e28009b30).stop 2021-11-03T18:10:51.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.758+0000 7f4e39dce700 1 -- 172.21.15.26:0/2905861494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e340f6ff0 msgr2=0x7f4e34069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:10:51.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.758+0000 7f4e39dce700 1 --2- 172.21.15.26:0/2905861494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e340f6ff0 0x7f4e34069e20 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 rx=0x7f4e2400c530 tx=0x7f4e24007e20).stop 2021-11-03T18:10:51.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.758+0000 7f4e39dce700 1 -- 172.21.15.26:0/2905861494 shutdown_connections 2021-11-03T18:10:51.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.758+0000 7f4e39dce700 1 --2- 172.21.15.26:0/2905861494 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4e1c0640b0 0x7f4e1c066570 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:51.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.758+0000 7f4e39dce700 1 --2- 172.21.15.26:0/2905861494 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e340f66e0 0x7f4e3406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:51.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.758+0000 7f4e39dce700 1 --2- 172.21.15.26:0/2905861494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e340f6ff0 0x7f4e34069e20 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:10:51.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.758+0000 7f4e39dce700 1 -- 172.21.15.26:0/2905861494 >> 172.21.15.26:0/2905861494 conn(0x7f4e340f1f00 msgr2=0x7f4e340fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:10:51.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.758+0000 7f4e39dce700 1 -- 172.21.15.26:0/2905861494 shutdown_connections 2021-11-03T18:10:51.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:10:51.759+0000 7f4e39dce700 1 -- 172.21.15.26:0/2905861494 wait complete. 2021-11-03T18:10:51.769 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:10:52.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:51 smithi194 ceph-mon[65619]: from='client.36492 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:10:52.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:51 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2197725791' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:10:52.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:51 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2905861494' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:10:52.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:51 smithi026 ceph-mon[96795]: from='client.36492 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:10:52.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:51 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2197725791' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:10:52.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:51 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2905861494' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:10:53.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:52 smithi194 ceph-mon[65619]: from='client.36496 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:10:53.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:52 smithi194 ceph-mon[65619]: pgmap v2286: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:53.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:52 smithi026 ceph-mon[96795]: from='client.36496 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:10:53.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:52 smithi026 ceph-mon[96795]: pgmap v2286: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:55.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:54 smithi194 ceph-mon[65619]: pgmap v2287: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:55.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:54 smithi026 ceph-mon[96795]: pgmap v2287: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:57.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:56 smithi194 ceph-mon[65619]: pgmap v2288: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:57.430 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:56 smithi026 ceph-mon[96795]: pgmap v2288: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:59.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:10:58 smithi194 ceph-mon[65619]: pgmap v2289: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:10:59.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:10:58 smithi026 ceph-mon[96795]: pgmap v2289: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:01.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:00 smithi194 ceph-mon[65619]: pgmap v2290: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:01.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:00 smithi026 ceph-mon[96795]: pgmap v2290: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:03.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:02 smithi194 ceph-mon[65619]: pgmap v2291: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:03.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:02 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:11:03.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:02 smithi026 ceph-mon[96795]: pgmap v2291: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:03.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:02 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:11:04.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:04 smithi194 ceph-mon[65619]: poll took 60067.588 ms: 1 events 2021-11-03T18:11:04.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:04 smithi194 ceph-mon[65619]: pgmap v2292: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:04.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:03 smithi026 ceph-mon[96795]: poll took 60067.588 ms: 1 events 2021-11-03T18:11:04.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:03 smithi026 ceph-mon[96795]: pgmap v2292: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:06.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:06 smithi194 ceph-mon[65619]: poll took 2467.773 ms: 1 events 2021-11-03T18:11:06.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:06 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:11:06.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:06 smithi194 ceph-mon[65619]: pgmap v2293: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:06.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:06 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:11:06.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:06 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:11:06.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:06 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:11:06.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:06 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:11:06.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:06 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:11:06.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:06 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:11:06.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:06 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:11:06.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:06 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:11:06.754 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:06 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:11:06.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:06 smithi026 ceph-mon[96795]: poll took 2467.773 ms: 1 events 2021-11-03T18:11:06.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:06 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:11:06.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:06 smithi026 ceph-mon[96795]: pgmap v2293: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:06.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:06 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:11:06.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:06 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:11:06.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:06 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:11:06.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:06 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:11:06.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:06 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:11:06.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:06 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:11:06.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:06 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:11:06.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:06 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:11:06.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:06 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:11:08.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:08 smithi026 ceph-mon[96795]: pgmap v2294: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:09.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:08 smithi194 ceph-mon[65619]: pgmap v2294: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:11.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:10 smithi194 ceph-mon[65619]: pgmap v2295: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:11.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:10 smithi026 ceph-mon[96795]: pgmap v2295: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:13.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:12 smithi194 ceph-mon[65619]: pgmap v2296: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:13.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:12 smithi026 ceph-mon[96795]: pgmap v2296: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:15.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:14 smithi194 ceph-mon[65619]: pgmap v2297: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:15.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:14 smithi026 ceph-mon[96795]: pgmap v2297: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:17.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:16 smithi194 ceph-mon[65619]: pgmap v2298: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:17.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:16 smithi026 ceph-mon[96795]: pgmap v2298: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:19.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:18 smithi194 ceph-mon[65619]: pgmap v2299: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:19.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:18 smithi026 ceph-mon[96795]: pgmap v2299: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:21.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:20 smithi194 ceph-mon[65619]: pgmap v2300: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:21.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:20 smithi026 ceph-mon[96795]: pgmap v2300: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:21.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:21.875+0000 7ff70dcca700 1 -- 172.21.15.26:0/3069671702 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7080f55c0 msgr2=0x7ff7080f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:11:21.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:21.875+0000 7ff70dcca700 1 --2- 172.21.15.26:0/3069671702 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7080f55c0 0x7ff7080f59e0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 rx=0x7ff6f8004660 tx=0x7ff6f8009b30).stop 2021-11-03T18:11:21.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:21.875+0000 7ff70dcca700 1 -- 172.21.15.26:0/3069671702 shutdown_connections 2021-11-03T18:11:21.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:21.875+0000 7ff70dcca700 1 --2- 172.21.15.26:0/3069671702 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7080f6860 0x7ff7080f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:21.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:21.875+0000 7ff70dcca700 1 --2- 172.21.15.26:0/3069671702 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7080f55c0 0x7ff7080f59e0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:21.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:21.875+0000 7ff70dcca700 1 -- 172.21.15.26:0/3069671702 >> 172.21.15.26:0/3069671702 conn(0x7ff7080f0d40 msgr2=0x7ff7080f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:11:21.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:21.875+0000 7ff70dcca700 1 -- 172.21.15.26:0/3069671702 shutdown_connections 2021-11-03T18:11:21.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:21.875+0000 7ff70dcca700 1 -- 172.21.15.26:0/3069671702 wait complete. 2021-11-03T18:11:21.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:21.876+0000 7ff70dcca700 1 Processor -- start 2021-11-03T18:11:21.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:21.876+0000 7ff70dcca700 1 -- start start 2021-11-03T18:11:21.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:21.876+0000 7ff70dcca700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7080f55c0 0x7ff708109c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:11:21.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:21.877+0000 7ff70dcca700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7080f6860 0x7ff70810c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:11:21.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:21.877+0000 7ff70dcca700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7080603c0 con 0x7ff7080f55c0 2021-11-03T18:11:21.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:21.877+0000 7ff70dcca700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff708060500 con 0x7ff7080f6860 2021-11-03T18:11:21.879 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:21.877+0000 7ff7077fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7080f55c0 0x7ff708109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:11:21.879 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:21.877+0000 7ff7077fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7080f55c0 0x7ff708109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58620/0 (socket says 172.21.15.26:58620) 2021-11-03T18:11:21.879 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:21.877+0000 7ff7077fe700 1 -- 172.21.15.26:0/2482212054 learned_addr learned my addr 172.21.15.26:0/2482212054 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:11:21.879 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:21.877+0000 7ff706ffd700 1 --2- 172.21.15.26:0/2482212054 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7080f6860 0x7ff70810c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:11:21.879 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:21.877+0000 7ff7077fe700 1 -- 172.21.15.26:0/2482212054 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7080f6860 msgr2=0x7ff70810c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:11:21.880 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:21.877+0000 7ff7077fe700 1 --2- 172.21.15.26:0/2482212054 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7080f6860 0x7ff70810c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:21.880 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:21.877+0000 7ff7077fe700 1 -- 172.21.15.26:0/2482212054 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f8005040 con 0x7ff7080f55c0 2021-11-03T18:11:21.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:21.877+0000 7ff7077fe700 1 --2- 172.21.15.26:0/2482212054 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7080f55c0 0x7ff708109c10 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 rx=0x7ff6f8013a70 tx=0x7ff6f8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:11:21.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:21.877+0000 7ff6effff700 1 -- 172.21.15.26:0/2482212054 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6f8018070 con 0x7ff7080f55c0 2021-11-03T18:11:21.882 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:21.877+0000 7ff6effff700 1 -- 172.21.15.26:0/2482212054 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff6f80097d0 con 0x7ff7080f55c0 2021-11-03T18:11:21.882 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:21.877+0000 7ff70dcca700 1 -- 172.21.15.26:0/2482212054 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff70810c660 con 0x7ff7080f55c0 2021-11-03T18:11:21.882 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:21.877+0000 7ff6effff700 1 -- 172.21.15.26:0/2482212054 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6f801c3c0 con 0x7ff7080f55c0 2021-11-03T18:11:21.882 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:21.877+0000 7ff70dcca700 1 -- 172.21.15.26:0/2482212054 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff70810cb90 con 0x7ff7080f55c0 2021-11-03T18:11:21.883 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:21.878+0000 7ff70dcca700 1 -- 172.21.15.26:0/2482212054 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff708045ad0 con 0x7ff7080f55c0 2021-11-03T18:11:21.884 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:21.879+0000 7ff6effff700 1 -- 172.21.15.26:0/2482212054 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ff6f8007ba0 con 0x7ff7080f55c0 2021-11-03T18:11:21.884 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:21.879+0000 7ff6effff700 1 --2- 172.21.15.26:0/2482212054 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff6f00640b0 0x7ff6f0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:11:21.884 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:21.879+0000 7ff6effff700 1 -- 172.21.15.26:0/2482212054 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ff6f8082370 con 0x7ff7080f55c0 2021-11-03T18:11:21.884 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:21.879+0000 7ff706ffd700 1 --2- 172.21.15.26:0/2482212054 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff6f00640b0 0x7ff6f0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:11:21.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:21.880+0000 7ff706ffd700 1 --2- 172.21.15.26:0/2482212054 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff6f00640b0 0x7ff6f0066570 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7ff6fc009740 tx=0x7ff6fc009c60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:11:21.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:21.883+0000 7ff6effff700 1 -- 172.21.15.26:0/2482212054 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ff6f8054790 con 0x7ff7080f55c0 2021-11-03T18:11:22.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:21 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:11:22.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:21 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:11:22.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.062+0000 7ff70dcca700 1 -- 172.21.15.26:0/2482212054 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff7080fdec0 con 0x7ff6f00640b0 2021-11-03T18:11:22.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.063+0000 7ff6effff700 1 -- 172.21.15.26:0/2482212054 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7ff7080fdec0 con 0x7ff6f00640b0 2021-11-03T18:11:22.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.065+0000 7ff70dcca700 1 -- 172.21.15.26:0/2482212054 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff6f00640b0 msgr2=0x7ff6f0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:11:22.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.065+0000 7ff70dcca700 1 --2- 172.21.15.26:0/2482212054 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff6f00640b0 0x7ff6f0066570 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7ff6fc009740 tx=0x7ff6fc009c60).stop 2021-11-03T18:11:22.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.065+0000 7ff70dcca700 1 -- 172.21.15.26:0/2482212054 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7080f55c0 msgr2=0x7ff708109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:11:22.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.065+0000 7ff70dcca700 1 --2- 172.21.15.26:0/2482212054 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7080f55c0 0x7ff708109c10 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 rx=0x7ff6f8013a70 tx=0x7ff6f8009b30).stop 2021-11-03T18:11:22.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.065+0000 7ff70dcca700 1 -- 172.21.15.26:0/2482212054 shutdown_connections 2021-11-03T18:11:22.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.065+0000 7ff70dcca700 1 --2- 172.21.15.26:0/2482212054 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff6f00640b0 0x7ff6f0066570 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:22.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.065+0000 7ff70dcca700 1 --2- 172.21.15.26:0/2482212054 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7080f55c0 0x7ff708109c10 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:22.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.065+0000 7ff70dcca700 1 --2- 172.21.15.26:0/2482212054 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7080f6860 0x7ff70810c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:22.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.065+0000 7ff70dcca700 1 -- 172.21.15.26:0/2482212054 >> 172.21.15.26:0/2482212054 conn(0x7ff7080f0d40 msgr2=0x7ff7080fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:11:22.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.065+0000 7ff70dcca700 1 -- 172.21.15.26:0/2482212054 shutdown_connections 2021-11-03T18:11:22.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.065+0000 7ff70dcca700 1 -- 172.21.15.26:0/2482212054 wait complete. 2021-11-03T18:11:22.072 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:11:22.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.165+0000 7fdf920af700 1 -- 172.21.15.26:0/4183292469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf8c0f66e0 msgr2=0x7fdf8c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:11:22.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.165+0000 7fdf920af700 1 --2- 172.21.15.26:0/4183292469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf8c0f66e0 0x7fdf8c0f6b00 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7fdf7c004660 tx=0x7fdf7c009b30).stop 2021-11-03T18:11:22.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.165+0000 7fdf920af700 1 -- 172.21.15.26:0/4183292469 shutdown_connections 2021-11-03T18:11:22.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.165+0000 7fdf920af700 1 --2- 172.21.15.26:0/4183292469 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf8c0f7980 0x7fdf8c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:22.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.165+0000 7fdf920af700 1 --2- 172.21.15.26:0/4183292469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf8c0f66e0 0x7fdf8c0f6b00 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:22.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.165+0000 7fdf920af700 1 -- 172.21.15.26:0/4183292469 >> 172.21.15.26:0/4183292469 conn(0x7fdf8c0f1e40 msgr2=0x7fdf8c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:11:22.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.165+0000 7fdf920af700 1 -- 172.21.15.26:0/4183292469 shutdown_connections 2021-11-03T18:11:22.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.165+0000 7fdf920af700 1 -- 172.21.15.26:0/4183292469 wait complete. 2021-11-03T18:11:22.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.165+0000 7fdf920af700 1 Processor -- start 2021-11-03T18:11:22.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.166+0000 7fdf920af700 1 -- start start 2021-11-03T18:11:22.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.166+0000 7fdf920af700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf8c0f66e0 0x7fdf8c106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:11:22.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.166+0000 7fdf920af700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf8c0f7980 0x7fdf8c1074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:11:22.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.166+0000 7fdf920af700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c107a50 con 0x7fdf8c0f7980 2021-11-03T18:11:22.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.166+0000 7fdf920af700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c107b90 con 0x7fdf8c0f66e0 2021-11-03T18:11:22.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.166+0000 7fdf8affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf8c0f7980 0x7fdf8c1074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:11:22.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.166+0000 7fdf8affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf8c0f7980 0x7fdf8c1074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58632/0 (socket says 172.21.15.26:58632) 2021-11-03T18:11:22.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.166+0000 7fdf8affd700 1 -- 172.21.15.26:0/1209339333 learned_addr learned my addr 172.21.15.26:0/1209339333 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:11:22.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.166+0000 7fdf8b7fe700 1 --2- 172.21.15.26:0/1209339333 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf8c0f66e0 0x7fdf8c106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:11:22.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.166+0000 7fdf8affd700 1 -- 172.21.15.26:0/1209339333 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf8c0f66e0 msgr2=0x7fdf8c106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:11:22.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.166+0000 7fdf8affd700 1 --2- 172.21.15.26:0/1209339333 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf8c0f66e0 0x7fdf8c106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:22.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.166+0000 7fdf8affd700 1 -- 172.21.15.26:0/1209339333 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7c005040 con 0x7fdf8c0f7980 2021-11-03T18:11:22.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.166+0000 7fdf8affd700 1 --2- 172.21.15.26:0/1209339333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf8c0f7980 0x7fdf8c1074a0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 rx=0x7fdf800026d0 tx=0x7fdf80009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:11:22.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.167+0000 7fdf73fff700 1 -- 172.21.15.26:0/1209339333 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf80009320 con 0x7fdf8c0f7980 2021-11-03T18:11:22.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.167+0000 7fdf73fff700 1 -- 172.21.15.26:0/1209339333 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdf8000f040 con 0x7fdf8c0f7980 2021-11-03T18:11:22.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.167+0000 7fdf920af700 1 -- 172.21.15.26:0/1209339333 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf8c108530 con 0x7fdf8c0f7980 2021-11-03T18:11:22.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.167+0000 7fdf73fff700 1 -- 172.21.15.26:0/1209339333 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf800147e0 con 0x7fdf8c0f7980 2021-11-03T18:11:22.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.167+0000 7fdf920af700 1 -- 172.21.15.26:0/1209339333 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf8c108af0 con 0x7fdf8c0f7980 2021-11-03T18:11:22.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.168+0000 7fdf920af700 1 -- 172.21.15.26:0/1209339333 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf8c045ad0 con 0x7fdf8c0f7980 2021-11-03T18:11:22.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.168+0000 7fdf73fff700 1 -- 172.21.15.26:0/1209339333 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fdf80009480 con 0x7fdf8c0f7980 2021-11-03T18:11:22.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.169+0000 7fdf73fff700 1 --2- 172.21.15.26:0/1209339333 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdf740640b0 0x7fdf74066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:11:22.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.169+0000 7fdf73fff700 1 -- 172.21.15.26:0/1209339333 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fdf80080df0 con 0x7fdf8c0f7980 2021-11-03T18:11:22.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.169+0000 7fdf8b7fe700 1 --2- 172.21.15.26:0/1209339333 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdf740640b0 0x7fdf74066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:11:22.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.169+0000 7fdf8b7fe700 1 --2- 172.21.15.26:0/1209339333 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdf740640b0 0x7fdf74066570 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7fdf7c004630 tx=0x7fdf7c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:11:22.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.173+0000 7fdf73fff700 1 -- 172.21.15.26:0/1209339333 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fdf80053210 con 0x7fdf8c0f7980 2021-11-03T18:11:22.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:21 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:11:22.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:21 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:11:22.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.345+0000 7fdf920af700 1 -- 172.21.15.26:0/1209339333 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf8c0ff010 con 0x7fdf740640b0 2021-11-03T18:11:22.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.359+0000 7fdf73fff700 1 -- 172.21.15.26:0/1209339333 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fdf8c0ff010 con 0x7fdf740640b0 2021-11-03T18:11:22.357 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:11:22.357 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (82m) 80s ago 83m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:11:22.358 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (74m) 80s ago 83m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:11:22.358 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (74m) 16s ago 83m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:11:22.358 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (82m) 80s ago 83m 42.0M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:11:22.358 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (75m) 80s ago 78m 25.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:11:22.359 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (75m) 80s ago 78m 26.4M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:11:22.359 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (79m) 16s ago 79m 26.6M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:11:22.359 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (78m) 16s ago 78m 27.0M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:11:22.359 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (76m) 80s ago 85m 574M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:11:22.359 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (75m) 16s ago 83m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:11:22.360 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (75m) 80s ago 85m 308M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:11:22.360 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (75m) 16s ago 82m 145M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:11:22.360 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (83m) 80s ago 83m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:11:22.360 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (82m) 16s ago 82m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:11:22.361 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (74m) 80s ago 82m 312M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:11:22.361 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (73m) 80s ago 81m 335M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:11:22.362 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (73m) 80s ago 81m 279M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:11:22.362 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (72m) 16s ago 81m 362M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:11:22.362 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (72m) 16s ago 80m 302M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:11:22.362 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (72m) 16s ago 80m 296M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:11:22.362 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (82m) 80s ago 83m 63.4M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:11:22.363 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.361+0000 7fdf920af700 1 -- 172.21.15.26:0/1209339333 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdf740640b0 msgr2=0x7fdf74066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:11:22.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.361+0000 7fdf920af700 1 --2- 172.21.15.26:0/1209339333 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdf740640b0 0x7fdf74066570 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7fdf7c004630 tx=0x7fdf7c009b30).stop 2021-11-03T18:11:22.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.361+0000 7fdf920af700 1 -- 172.21.15.26:0/1209339333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf8c0f7980 msgr2=0x7fdf8c1074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:11:22.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.361+0000 7fdf920af700 1 --2- 172.21.15.26:0/1209339333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf8c0f7980 0x7fdf8c1074a0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 rx=0x7fdf800026d0 tx=0x7fdf80009de0).stop 2021-11-03T18:11:22.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.361+0000 7fdf920af700 1 -- 172.21.15.26:0/1209339333 shutdown_connections 2021-11-03T18:11:22.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.361+0000 7fdf920af700 1 --2- 172.21.15.26:0/1209339333 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdf740640b0 0x7fdf74066570 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:22.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.361+0000 7fdf920af700 1 --2- 172.21.15.26:0/1209339333 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf8c0f66e0 0x7fdf8c106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:22.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.361+0000 7fdf920af700 1 --2- 172.21.15.26:0/1209339333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf8c0f7980 0x7fdf8c1074a0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:22.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.361+0000 7fdf920af700 1 -- 172.21.15.26:0/1209339333 >> 172.21.15.26:0/1209339333 conn(0x7fdf8c0f1e40 msgr2=0x7fdf8c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:11:22.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.361+0000 7fdf920af700 1 -- 172.21.15.26:0/1209339333 shutdown_connections 2021-11-03T18:11:22.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.361+0000 7fdf920af700 1 -- 172.21.15.26:0/1209339333 wait complete. 2021-11-03T18:11:22.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.461+0000 7f6850056700 1 -- 172.21.15.26:0/887991320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68480f7620 msgr2=0x7f68480f9ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:11:22.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.461+0000 7f6850056700 1 --2- 172.21.15.26:0/887991320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68480f7620 0x7f68480f9ab0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 rx=0x7f6838004660 tx=0x7f6838009b30).stop 2021-11-03T18:11:22.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.461+0000 7f6850056700 1 -- 172.21.15.26:0/887991320 shutdown_connections 2021-11-03T18:11:22.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.461+0000 7f6850056700 1 --2- 172.21.15.26:0/887991320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68480f7620 0x7f68480f9ab0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:22.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.461+0000 7f6850056700 1 --2- 172.21.15.26:0/887991320 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6848060410 0x7f68480f70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:22.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.461+0000 7f6850056700 1 -- 172.21.15.26:0/887991320 >> 172.21.15.26:0/887991320 conn(0x7f68480f0d30 msgr2=0x7f68480f3150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:11:22.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.461+0000 7f6850056700 1 -- 172.21.15.26:0/887991320 shutdown_connections 2021-11-03T18:11:22.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.461+0000 7f6850056700 1 -- 172.21.15.26:0/887991320 wait complete. 2021-11-03T18:11:22.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.461+0000 7f6850056700 1 Processor -- start 2021-11-03T18:11:22.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.462+0000 7f6850056700 1 -- start start 2021-11-03T18:11:22.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.462+0000 7f6850056700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6848060410 0x7f684810d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:11:22.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.462+0000 7f6850056700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68480f7620 0x7f684810da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:11:22.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.462+0000 7f6850056700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684810dfc0 con 0x7f6848060410 2021-11-03T18:11:22.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.462+0000 7f6850056700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684810e100 con 0x7f68480f7620 2021-11-03T18:11:22.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.462+0000 7f684ddf2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6848060410 0x7f684810d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:11:22.464 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.462+0000 7f684ddf2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6848060410 0x7f684810d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58640/0 (socket says 172.21.15.26:58640) 2021-11-03T18:11:22.464 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.462+0000 7f684ddf2700 1 -- 172.21.15.26:0/1501923296 learned_addr learned my addr 172.21.15.26:0/1501923296 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:11:22.464 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.462+0000 7f684d5f1700 1 --2- 172.21.15.26:0/1501923296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68480f7620 0x7f684810da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:11:22.464 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.462+0000 7f684ddf2700 1 -- 172.21.15.26:0/1501923296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68480f7620 msgr2=0x7f684810da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:11:22.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.462+0000 7f684ddf2700 1 --2- 172.21.15.26:0/1501923296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68480f7620 0x7f684810da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:22.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.462+0000 7f684ddf2700 1 -- 172.21.15.26:0/1501923296 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6838005040 con 0x7f6848060410 2021-11-03T18:11:22.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.462+0000 7f684ddf2700 1 --2- 172.21.15.26:0/1501923296 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6848060410 0x7f684810d520 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 rx=0x7f68440026d0 tx=0x7f6844009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:11:22.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.462+0000 7f683e7fc700 1 -- 172.21.15.26:0/1501923296 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68440079c0 con 0x7f6848060410 2021-11-03T18:11:22.466 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.462+0000 7f683e7fc700 1 -- 172.21.15.26:0/1501923296 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f684400f040 con 0x7f6848060410 2021-11-03T18:11:22.466 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.462+0000 7f6850056700 1 -- 172.21.15.26:0/1501923296 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f684810eaa0 con 0x7f6848060410 2021-11-03T18:11:22.466 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.463+0000 7f6850056700 1 -- 172.21.15.26:0/1501923296 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f684810f060 con 0x7f6848060410 2021-11-03T18:11:22.466 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.463+0000 7f683e7fc700 1 -- 172.21.15.26:0/1501923296 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68440148b0 con 0x7f6848060410 2021-11-03T18:11:22.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.464+0000 7f6850056700 1 -- 172.21.15.26:0/1501923296 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6848045ad0 con 0x7f6848060410 2021-11-03T18:11:22.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.464+0000 7f683e7fc700 1 -- 172.21.15.26:0/1501923296 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f6844007b20 con 0x7f6848060410 2021-11-03T18:11:22.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.464+0000 7f683e7fc700 1 --2- 172.21.15.26:0/1501923296 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6834064090 0x7f6834066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:11:22.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.464+0000 7f683e7fc700 1 -- 172.21.15.26:0/1501923296 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f6844080720 con 0x7f6848060410 2021-11-03T18:11:22.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.464+0000 7f684d5f1700 1 --2- 172.21.15.26:0/1501923296 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6834064090 0x7f6834066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:11:22.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.465+0000 7f684d5f1700 1 --2- 172.21.15.26:0/1501923296 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6834064090 0x7f6834066550 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7f6838004e30 tx=0x7f6838009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:11:22.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.468+0000 7f683e7fc700 1 -- 172.21.15.26:0/1501923296 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f68440529c0 con 0x7f6848060410 2021-11-03T18:11:22.696 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.698+0000 7f6850056700 1 -- 172.21.15.26:0/1501923296 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6848105590 con 0x7f6848060410 2021-11-03T18:11:22.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.699+0000 7f683e7fc700 1 -- 172.21.15.26:0/1501923296 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f68440525b0 con 0x7f6848060410 2021-11-03T18:11:22.697 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:11:22.697 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:11:22.697 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:11:22.698 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:11:22.698 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:11:22.698 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:11:22.698 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:11:22.699 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:11:22.699 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:11:22.699 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:11:22.699 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:11:22.700 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:11:22.700 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:11:22.700 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:11:22.700 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:11:22.700 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:11:22.701 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:11:22.701 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:11:22.702 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.701+0000 7f6850056700 1 -- 172.21.15.26:0/1501923296 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6834064090 msgr2=0x7f6834066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:11:22.702 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.701+0000 7f6850056700 1 --2- 172.21.15.26:0/1501923296 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6834064090 0x7f6834066550 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7f6838004e30 tx=0x7f6838009b30).stop 2021-11-03T18:11:22.702 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.701+0000 7f6850056700 1 -- 172.21.15.26:0/1501923296 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6848060410 msgr2=0x7f684810d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:11:22.702 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.701+0000 7f6850056700 1 --2- 172.21.15.26:0/1501923296 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6848060410 0x7f684810d520 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 rx=0x7f68440026d0 tx=0x7f6844009de0).stop 2021-11-03T18:11:22.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.701+0000 7f6850056700 1 -- 172.21.15.26:0/1501923296 shutdown_connections 2021-11-03T18:11:22.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.701+0000 7f6850056700 1 --2- 172.21.15.26:0/1501923296 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6834064090 0x7f6834066550 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:22.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.701+0000 7f6850056700 1 --2- 172.21.15.26:0/1501923296 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6848060410 0x7f684810d520 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:22.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.701+0000 7f6850056700 1 --2- 172.21.15.26:0/1501923296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68480f7620 0x7f684810da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:22.704 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.701+0000 7f6850056700 1 -- 172.21.15.26:0/1501923296 >> 172.21.15.26:0/1501923296 conn(0x7f68480f0d30 msgr2=0x7f68480f3120 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:11:22.704 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.701+0000 7f6850056700 1 -- 172.21.15.26:0/1501923296 shutdown_connections 2021-11-03T18:11:22.704 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.701+0000 7f6850056700 1 -- 172.21.15.26:0/1501923296 wait complete. 2021-11-03T18:11:22.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.800+0000 7fcddd6d9700 1 -- 172.21.15.26:0/384512890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdd80f66e0 msgr2=0x7fcdd80f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:11:22.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.800+0000 7fcddd6d9700 1 --2- 172.21.15.26:0/384512890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdd80f66e0 0x7fcdd80f6b40 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7fcdcc004660 tx=0x7fcdcc009b30).stop 2021-11-03T18:11:22.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.800+0000 7fcddd6d9700 1 -- 172.21.15.26:0/384512890 shutdown_connections 2021-11-03T18:11:22.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.800+0000 7fcddd6d9700 1 --2- 172.21.15.26:0/384512890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdd80f66e0 0x7fcdd80f6b40 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:22.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.800+0000 7fcddd6d9700 1 --2- 172.21.15.26:0/384512890 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcdd80f5440 0x7fcdd80f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:22.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.800+0000 7fcddd6d9700 1 -- 172.21.15.26:0/384512890 >> 172.21.15.26:0/384512890 conn(0x7fcdd80f0ba0 msgr2=0x7fcdd80f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:11:22.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.800+0000 7fcddd6d9700 1 -- 172.21.15.26:0/384512890 shutdown_connections 2021-11-03T18:11:22.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.800+0000 7fcddd6d9700 1 -- 172.21.15.26:0/384512890 wait complete. 2021-11-03T18:11:22.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.801+0000 7fcddd6d9700 1 Processor -- start 2021-11-03T18:11:22.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.801+0000 7fcddd6d9700 1 -- start start 2021-11-03T18:11:22.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.801+0000 7fcddd6d9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdd80f5440 0x7fcdd8109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:11:22.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.801+0000 7fcddd6d9700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcdd80f66e0 0x7fcdd810bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:11:22.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.801+0000 7fcddd6d9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd80603e0 con 0x7fcdd80f5440 2021-11-03T18:11:22.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.801+0000 7fcddd6d9700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd8060520 con 0x7fcdd80f66e0 2021-11-03T18:11:22.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.801+0000 7fcdd7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdd80f5440 0x7fcdd8109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:11:22.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.801+0000 7fcdd7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdd80f5440 0x7fcdd8109a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58650/0 (socket says 172.21.15.26:58650) 2021-11-03T18:11:22.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.801+0000 7fcdd7fff700 1 -- 172.21.15.26:0/3394184136 learned_addr learned my addr 172.21.15.26:0/3394184136 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:11:22.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.802+0000 7fcdd7fff700 1 -- 172.21.15.26:0/3394184136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcdd80f66e0 msgr2=0x7fcdd810bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:11:22.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.802+0000 7fcdd7fff700 1 --2- 172.21.15.26:0/3394184136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcdd80f66e0 0x7fcdd810bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:11:22.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.802+0000 7fcdd7fff700 1 -- 172.21.15.26:0/3394184136 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdcc005040 con 0x7fcdd80f5440 2021-11-03T18:11:22.805 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.802+0000 7fcdd7fff700 1 --2- 172.21.15.26:0/3394184136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdd80f5440 0x7fcdd8109a90 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 rx=0x7fcdc800c790 tx=0x7fcdc8007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:11:22.805 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.802+0000 7fcdd4ff9700 1 -- 172.21.15.26:0/3394184136 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdc800e680 con 0x7fcdd80f5440 2021-11-03T18:11:22.805 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.802+0000 7fcdd4ff9700 1 -- 172.21.15.26:0/3394184136 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcdc800ec90 con 0x7fcdd80f5440 2021-11-03T18:11:22.805 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.802+0000 7fcdd4ff9700 1 -- 172.21.15.26:0/3394184136 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdc8012d00 con 0x7fcdd80f5440 2021-11-03T18:11:22.805 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.802+0000 7fcddd6d9700 1 -- 172.21.15.26:0/3394184136 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdd810c540 con 0x7fcdd80f5440 2021-11-03T18:11:22.806 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.802+0000 7fcddd6d9700 1 -- 172.21.15.26:0/3394184136 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdd810cb00 con 0x7fcdd80f5440 2021-11-03T18:11:22.806 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.803+0000 7fcddd6d9700 1 -- 172.21.15.26:0/3394184136 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdd8045ad0 con 0x7fcdd80f5440 2021-11-03T18:11:22.806 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.803+0000 7fcdd4ff9700 1 -- 172.21.15.26:0/3394184136 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fcdc8010070 con 0x7fcdd80f5440 2021-11-03T18:11:22.806 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.804+0000 7fcdd4ff9700 1 --2- 172.21.15.26:0/3394184136 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcdc0064100 0x7fcdc00665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:11:22.807 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.804+0000 7fcdd4ff9700 1 -- 172.21.15.26:0/3394184136 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fcdc8080990 con 0x7fcdd80f5440 2021-11-03T18:11:22.807 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.804+0000 7fcdd77fe700 1 --2- 172.21.15.26:0/3394184136 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcdc0064100 0x7fcdc00665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:11:22.807 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.804+0000 7fcdd77fe700 1 --2- 172.21.15.26:0/3394184136 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcdc0064100 0x7fcdc00665c0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7fcdcc004e30 tx=0x7fcdcc009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:11:22.808 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:22.808+0000 7fcdd4ff9700 1 -- 172.21.15.26:0/3394184136 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fcdc8052c00 con 0x7fcdd80f5440 2021-11-03T18:11:23.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:22 smithi194 ceph-mon[65619]: pgmap v2301: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:23.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:22 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1501923296' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:11:23.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:23.010+0000 7fcddd6d9700 1 -- 172.21.15.26:0/3394184136 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcdd80fdd50 con 0x7fcdd80f5440 2021-11-03T18:11:23.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:23.010+0000 7fcdd4ff9700 1 -- 172.21.15.26:0/3394184136 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fcdc80527f0 con 0x7fcdd80f5440 2021-11-03T18:11:23.008 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:11:23.008 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:11:23.008 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:11:23.009 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:11:23.009 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:11:23.009 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:11:23.009 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:11:23.010 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:11:23.010 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:11:23.010 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:11:23.011 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:11:23.011 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:11:23.011 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:11:23.011 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:11:23.012 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:11:23.012 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:11:23.012 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:11:23.012 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:11:23.013 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:11:23.013 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:11:23.013 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:11:23.014 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:11:23.014 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:11:23.014 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:11:23.014 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:11:23.015 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:11:23.015 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:11:23.015 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:11:23.016 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:11:23.016 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:11:23.016 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:11:23.016 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:11:23.016 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:11:23.017 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:11:23.017 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:11:23.017 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:11:23.017 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:11:23.018 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:11:23.018 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:11:23.019 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:23.012+0000 7fcddd6d9700 1 -- 172.21.15.26:0/3394184136 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcdc0064100 msgr2=0x7fcdc00665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:11:23.019 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:23.012+0000 7fcddd6d9700 1 --2- 172.21.15.26:0/3394184136 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcdc0064100 0x7fcdc00665c0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7fcdcc004e30 tx=0x7fcdcc009b30).stop 2021-11-03T18:11:23.019 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:23.012+0000 7fcddd6d9700 1 -- 172.21.15.26:0/3394184136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdd80f5440 msgr2=0x7fcdd8109a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:11:23.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:23.012+0000 7fcddd6d9700 1 --2- 172.21.15.26:0/3394184136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdd80f5440 0x7fcdd8109a90 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 rx=0x7fcdc800c790 tx=0x7fcdc8007d90).stop 2021-11-03T18:11:23.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:23.012+0000 7fcddd6d9700 1 -- 172.21.15.26:0/3394184136 shutdown_connections 2021-11-03T18:11:23.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:23.012+0000 7fcddd6d9700 1 --2- 172.21.15.26:0/3394184136 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcdc0064100 0x7fcdc00665c0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:23.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:23.012+0000 7fcddd6d9700 1 --2- 172.21.15.26:0/3394184136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdd80f5440 0x7fcdd8109a90 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:23.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:23.012+0000 7fcddd6d9700 1 --2- 172.21.15.26:0/3394184136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcdd80f66e0 0x7fcdd810bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:11:23.021 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:23.012+0000 7fcddd6d9700 1 -- 172.21.15.26:0/3394184136 >> 172.21.15.26:0/3394184136 conn(0x7fcdd80f0ba0 msgr2=0x7fcdd80fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:11:23.021 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:23.012+0000 7fcddd6d9700 1 -- 172.21.15.26:0/3394184136 shutdown_connections 2021-11-03T18:11:23.021 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:23.012+0000 7fcddd6d9700 1 -- 172.21.15.26:0/3394184136 wait complete. 2021-11-03T18:11:23.021 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:11:23.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:22 smithi026 ceph-mon[96795]: pgmap v2301: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:23.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:22 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1501923296' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:11:23.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:23 smithi194 ceph-mon[65619]: from='client.36508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:11:23.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:23 smithi194 ceph-mon[65619]: from='client.36512 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:11:23.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:23 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3394184136' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:11:24.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:23 smithi026 ceph-mon[96795]: from='client.36508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:11:24.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:23 smithi026 ceph-mon[96795]: from='client.36512 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:11:24.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:23 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3394184136' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:11:25.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:24 smithi194 ceph-mon[65619]: pgmap v2302: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:25.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:24 smithi026 ceph-mon[96795]: pgmap v2302: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:27.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:26 smithi194 ceph-mon[65619]: pgmap v2303: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:27.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:26 smithi026 ceph-mon[96795]: pgmap v2303: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:29.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:28 smithi194 ceph-mon[65619]: pgmap v2304: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:29.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:28 smithi026 ceph-mon[96795]: pgmap v2304: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:31.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:30 smithi194 ceph-mon[65619]: pgmap v2305: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:31.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:30 smithi026 ceph-mon[96795]: pgmap v2305: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:33.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:32 smithi194 ceph-mon[65619]: pgmap v2306: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:33.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:32 smithi026 ceph-mon[96795]: pgmap v2306: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:35.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:34 smithi194 ceph-mon[65619]: pgmap v2307: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:35.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:34 smithi026 ceph-mon[96795]: pgmap v2307: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:37.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:36 smithi194 ceph-mon[65619]: pgmap v2308: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:37.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:36 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:11:37.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:36 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:11:37.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:36 smithi026 ceph-mon[96795]: pgmap v2308: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:37.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:36 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:11:37.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:36 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:11:39.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:38 smithi194 ceph-mon[65619]: pgmap v2309: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:39.178 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:38 smithi026 ceph-mon[96795]: pgmap v2309: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:41.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:40 smithi194 ceph-mon[65619]: pgmap v2310: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:41.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:40 smithi026 ceph-mon[96795]: pgmap v2310: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:43.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:42 smithi194 ceph-mon[65619]: pgmap v2311: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:43.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:42 smithi026 ceph-mon[96795]: pgmap v2311: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:45.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:44 smithi194 ceph-mon[65619]: pgmap v2312: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:45.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:44 smithi026 ceph-mon[96795]: pgmap v2312: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:47.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:46 smithi194 ceph-mon[65619]: pgmap v2313: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:47.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:46 smithi026 ceph-mon[96795]: pgmap v2313: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:49.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:48 smithi194 ceph-mon[65619]: pgmap v2314: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:49.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:11:49.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:11:49.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:48 smithi026 ceph-mon[96795]: pgmap v2314: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:49.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:11:49.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:11:51.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:50 smithi194 ceph-mon[65619]: pgmap v2315: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:51.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:50 smithi026 ceph-mon[96795]: pgmap v2315: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:52.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:51 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:11:52.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:51 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:11:52.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:51 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:11:52.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:51 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:11:53.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.124+0000 7f1cc6959700 1 -- 172.21.15.26:0/1562899116 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cc00f6ff0 msgr2=0x7f1cc00f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:11:53.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.124+0000 7f1cc6959700 1 --2- 172.21.15.26:0/1562899116 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cc00f6ff0 0x7f1cc00f7a20 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 rx=0x7f1ca8004660 tx=0x7f1ca8009b30).stop 2021-11-03T18:11:53.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.124+0000 7f1cc6959700 1 -- 172.21.15.26:0/1562899116 shutdown_connections 2021-11-03T18:11:53.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.124+0000 7f1cc6959700 1 --2- 172.21.15.26:0/1562899116 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cc00f6ff0 0x7f1cc00f7a20 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:53.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.124+0000 7f1cc6959700 1 --2- 172.21.15.26:0/1562899116 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cc00f66e0 0x7f1cc00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:53.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.124+0000 7f1cc6959700 1 -- 172.21.15.26:0/1562899116 >> 172.21.15.26:0/1562899116 conn(0x7f1cc00f1f00 msgr2=0x7f1cc00f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:11:53.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.124+0000 7f1cc6959700 1 -- 172.21.15.26:0/1562899116 shutdown_connections 2021-11-03T18:11:53.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.124+0000 7f1cc6959700 1 -- 172.21.15.26:0/1562899116 wait complete. 2021-11-03T18:11:53.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.125+0000 7f1cc6959700 1 Processor -- start 2021-11-03T18:11:53.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.125+0000 7f1cc6959700 1 -- start start 2021-11-03T18:11:53.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.125+0000 7f1cc6959700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cc00f66e0 0x7f1cc0106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:11:53.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.125+0000 7f1cc6959700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cc00f6ff0 0x7f1cc0107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:11:53.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.125+0000 7f1cc6959700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc0107a10 con 0x7f1cc00f66e0 2021-11-03T18:11:53.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.125+0000 7f1cc6959700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc0107b50 con 0x7f1cc00f6ff0 2021-11-03T18:11:53.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.125+0000 7f1cbffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cc00f66e0 0x7f1cc0106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:11:53.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.125+0000 7f1cbffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cc00f66e0 0x7f1cc0106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58670/0 (socket says 172.21.15.26:58670) 2021-11-03T18:11:53.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.125+0000 7f1cbffff700 1 -- 172.21.15.26:0/3555955348 learned_addr learned my addr 172.21.15.26:0/3555955348 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:11:53.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.126+0000 7f1cbf7fe700 1 --2- 172.21.15.26:0/3555955348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cc00f6ff0 0x7f1cc0107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:11:53.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.126+0000 7f1cbffff700 1 -- 172.21.15.26:0/3555955348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cc00f6ff0 msgr2=0x7f1cc0107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:11:53.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.126+0000 7f1cbffff700 1 --2- 172.21.15.26:0/3555955348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cc00f6ff0 0x7f1cc0107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:53.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.126+0000 7f1cbffff700 1 -- 172.21.15.26:0/3555955348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca8005040 con 0x7f1cc00f66e0 2021-11-03T18:11:53.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.126+0000 7f1cbf7fe700 1 --2- 172.21.15.26:0/3555955348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cc00f6ff0 0x7f1cc0107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:11:53.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.126+0000 7f1cbffff700 1 --2- 172.21.15.26:0/3555955348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cc00f66e0 0x7f1cc0106f70 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 rx=0x7f1cb00026d0 tx=0x7f1cb0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:11:53.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.126+0000 7f1cbcff9700 1 -- 172.21.15.26:0/3555955348 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cb0009320 con 0x7f1cc00f66e0 2021-11-03T18:11:53.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.126+0000 7f1cbcff9700 1 -- 172.21.15.26:0/3555955348 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1cb000f040 con 0x7f1cc00f66e0 2021-11-03T18:11:53.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.126+0000 7f1cbcff9700 1 -- 172.21.15.26:0/3555955348 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cb00147e0 con 0x7f1cc00f66e0 2021-11-03T18:11:53.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.126+0000 7f1cc6959700 1 -- 172.21.15.26:0/3555955348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc01084f0 con 0x7f1cc00f66e0 2021-11-03T18:11:53.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.126+0000 7f1cc6959700 1 -- 172.21.15.26:0/3555955348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc0108ab0 con 0x7f1cc00f66e0 2021-11-03T18:11:53.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.127+0000 7f1cc6959700 1 -- 172.21.15.26:0/3555955348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cc0045ad0 con 0x7f1cc00f66e0 2021-11-03T18:11:53.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.128+0000 7f1cbcff9700 1 -- 172.21.15.26:0/3555955348 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f1cb0009480 con 0x7f1cc00f66e0 2021-11-03T18:11:53.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.128+0000 7f1cbcff9700 1 --2- 172.21.15.26:0/3555955348 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1cac0640b0 0x7f1cac066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:11:53.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.128+0000 7f1cbcff9700 1 -- 172.21.15.26:0/3555955348 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f1cb0080df0 con 0x7f1cc00f66e0 2021-11-03T18:11:53.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.128+0000 7f1cbf7fe700 1 --2- 172.21.15.26:0/3555955348 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1cac0640b0 0x7f1cac066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:11:53.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.129+0000 7f1cbf7fe700 1 --2- 172.21.15.26:0/3555955348 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1cac0640b0 0x7f1cac066570 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f1ca8009da0 tx=0x7f1ca8009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:11:53.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.132+0000 7f1cbcff9700 1 -- 172.21.15.26:0/3555955348 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f1cb0053210 con 0x7f1cc00f66e0 2021-11-03T18:11:53.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:52 smithi026 ceph-mon[96795]: pgmap v2316: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:53.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:52 smithi194 ceph-mon[65619]: pgmap v2316: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:53.307 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.309+0000 7f1cc6959700 1 -- 172.21.15.26:0/3555955348 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1cc0108d80 con 0x7f1cac0640b0 2021-11-03T18:11:53.308 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.310+0000 7f1cbcff9700 1 -- 172.21.15.26:0/3555955348 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f1cc0108d80 con 0x7f1cac0640b0 2021-11-03T18:11:53.311 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.312+0000 7f1cc6959700 1 -- 172.21.15.26:0/3555955348 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1cac0640b0 msgr2=0x7f1cac066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:11:53.311 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.312+0000 7f1cc6959700 1 --2- 172.21.15.26:0/3555955348 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1cac0640b0 0x7f1cac066570 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f1ca8009da0 tx=0x7f1ca8009b30).stop 2021-11-03T18:11:53.311 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.312+0000 7f1cc6959700 1 -- 172.21.15.26:0/3555955348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cc00f66e0 msgr2=0x7f1cc0106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:11:53.311 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.312+0000 7f1cc6959700 1 --2- 172.21.15.26:0/3555955348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cc00f66e0 0x7f1cc0106f70 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 rx=0x7f1cb00026d0 tx=0x7f1cb0009de0).stop 2021-11-03T18:11:53.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.312+0000 7f1cc6959700 1 -- 172.21.15.26:0/3555955348 shutdown_connections 2021-11-03T18:11:53.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.312+0000 7f1cc6959700 1 --2- 172.21.15.26:0/3555955348 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1cac0640b0 0x7f1cac066570 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:53.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.312+0000 7f1cc6959700 1 --2- 172.21.15.26:0/3555955348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cc00f66e0 0x7f1cc0106f70 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:53.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.312+0000 7f1cc6959700 1 --2- 172.21.15.26:0/3555955348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cc00f6ff0 0x7f1cc0107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:53.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.312+0000 7f1cc6959700 1 -- 172.21.15.26:0/3555955348 >> 172.21.15.26:0/3555955348 conn(0x7f1cc00f1f00 msgr2=0x7f1cc00fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:11:53.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.312+0000 7f1cc6959700 1 -- 172.21.15.26:0/3555955348 shutdown_connections 2021-11-03T18:11:53.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.312+0000 7f1cc6959700 1 -- 172.21.15.26:0/3555955348 wait complete. 2021-11-03T18:11:53.320 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:11:53.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.412+0000 7fec365a0700 1 -- 172.21.15.26:0/3601071779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec300f7980 msgr2=0x7fec300f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:11:53.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.412+0000 7fec365a0700 1 --2- 172.21.15.26:0/3601071779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec300f7980 0x7fec300f7de0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 rx=0x7fec18004660 tx=0x7fec18009b30).stop 2021-11-03T18:11:53.413 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.412+0000 7fec365a0700 1 -- 172.21.15.26:0/3601071779 shutdown_connections 2021-11-03T18:11:53.413 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.412+0000 7fec365a0700 1 --2- 172.21.15.26:0/3601071779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec300f7980 0x7fec300f7de0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:53.413 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.412+0000 7fec365a0700 1 --2- 172.21.15.26:0/3601071779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec300f66e0 0x7fec300f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:53.413 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.412+0000 7fec365a0700 1 -- 172.21.15.26:0/3601071779 >> 172.21.15.26:0/3601071779 conn(0x7fec300f1e40 msgr2=0x7fec300f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:11:53.414 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.412+0000 7fec365a0700 1 -- 172.21.15.26:0/3601071779 shutdown_connections 2021-11-03T18:11:53.414 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.412+0000 7fec365a0700 1 -- 172.21.15.26:0/3601071779 wait complete. 2021-11-03T18:11:53.414 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.413+0000 7fec365a0700 1 Processor -- start 2021-11-03T18:11:53.414 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.413+0000 7fec365a0700 1 -- start start 2021-11-03T18:11:53.414 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.413+0000 7fec365a0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec300f66e0 0x7fec30106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:11:53.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.413+0000 7fec365a0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec300f7980 0x7fec30107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:11:53.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.413+0000 7fec365a0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec30107a00 con 0x7fec300f7980 2021-11-03T18:11:53.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.413+0000 7fec365a0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec30107b40 con 0x7fec300f66e0 2021-11-03T18:11:53.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.413+0000 7fec2f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec300f7980 0x7fec30107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:11:53.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.413+0000 7fec2f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec300f7980 0x7fec30107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58682/0 (socket says 172.21.15.26:58682) 2021-11-03T18:11:53.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.413+0000 7fec2f7fe700 1 -- 172.21.15.26:0/3332723953 learned_addr learned my addr 172.21.15.26:0/3332723953 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:11:53.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.413+0000 7fec2ffff700 1 --2- 172.21.15.26:0/3332723953 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec300f66e0 0x7fec30106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:11:53.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.413+0000 7fec2f7fe700 1 -- 172.21.15.26:0/3332723953 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec300f66e0 msgr2=0x7fec30106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:11:53.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.413+0000 7fec2f7fe700 1 --2- 172.21.15.26:0/3332723953 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec300f66e0 0x7fec30106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:53.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.413+0000 7fec2f7fe700 1 -- 172.21.15.26:0/3332723953 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec18005040 con 0x7fec300f7980 2021-11-03T18:11:53.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.413+0000 7fec2f7fe700 1 --2- 172.21.15.26:0/3332723953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec300f7980 0x7fec30107450 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 rx=0x7fec18009830 tx=0x7fec18009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:11:53.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.414+0000 7fec2cff9700 1 -- 172.21.15.26:0/3332723953 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec18018070 con 0x7fec300f7980 2021-11-03T18:11:53.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.414+0000 7fec365a0700 1 -- 172.21.15.26:0/3332723953 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec30108480 con 0x7fec300f7980 2021-11-03T18:11:53.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.414+0000 7fec2cff9700 1 -- 172.21.15.26:0/3332723953 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fec18007ba0 con 0x7fec300f7980 2021-11-03T18:11:53.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.414+0000 7fec2cff9700 1 -- 172.21.15.26:0/3332723953 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec1801c620 con 0x7fec300f7980 2021-11-03T18:11:53.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.414+0000 7fec365a0700 1 -- 172.21.15.26:0/3332723953 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec301089e0 con 0x7fec300f7980 2021-11-03T18:11:53.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.414+0000 7fec365a0700 1 -- 172.21.15.26:0/3332723953 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec30045ad0 con 0x7fec300f7980 2021-11-03T18:11:53.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.415+0000 7fec2cff9700 1 -- 172.21.15.26:0/3332723953 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fec18007d10 con 0x7fec300f7980 2021-11-03T18:11:53.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.415+0000 7fec2cff9700 1 --2- 172.21.15.26:0/3332723953 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fec1c064090 0x7fec1c066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:11:53.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.416+0000 7fec2cff9700 1 -- 172.21.15.26:0/3332723953 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fec18082500 con 0x7fec300f7980 2021-11-03T18:11:53.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.416+0000 7fec2ffff700 1 --2- 172.21.15.26:0/3332723953 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fec1c064090 0x7fec1c066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:11:53.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.416+0000 7fec2ffff700 1 --2- 172.21.15.26:0/3332723953 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fec1c064090 0x7fec1c066550 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7fec300f77e0 tx=0x7fec20009c00).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:11:53.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.420+0000 7fec2cff9700 1 -- 172.21.15.26:0/3332723953 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fec18054920 con 0x7fec300f7980 2021-11-03T18:11:53.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.593+0000 7fec365a0700 1 -- 172.21.15.26:0/3332723953 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fec30108c00 con 0x7fec1c064090 2021-11-03T18:11:53.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.607+0000 7fec2cff9700 1 -- 172.21.15.26:0/3332723953 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fec30108c00 con 0x7fec1c064090 2021-11-03T18:11:53.606 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:11:53.606 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (83m) 111s ago 84m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:11:53.607 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (75m) 111s ago 84m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:11:53.607 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (75m) 48s ago 83m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:11:53.607 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (82m) 111s ago 84m 42.0M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:11:53.608 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (76m) 111s ago 79m 25.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:11:53.608 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (76m) 111s ago 79m 26.4M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:11:53.608 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (79m) 48s ago 79m 26.6M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:11:53.608 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (79m) 48s ago 79m 27.0M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:11:53.609 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (76m) 111s ago 85m 574M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:11:53.609 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (76m) 48s ago 83m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:11:53.609 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (76m) 111s ago 85m 308M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:11:53.609 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (75m) 48s ago 83m 145M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:11:53.609 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (84m) 111s ago 83m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:11:53.610 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (83m) 48s ago 83m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:11:53.610 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (74m) 111s ago 82m 312M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:11:53.610 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (74m) 111s ago 82m 335M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:11:53.611 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (73m) 111s ago 82m 279M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:11:53.611 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (73m) 48s ago 81m 362M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:11:53.611 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (72m) 48s ago 81m 302M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:11:53.611 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (72m) 48s ago 81m 296M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:11:53.612 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (82m) 111s ago 83m 63.4M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:11:53.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.609+0000 7fec365a0700 1 -- 172.21.15.26:0/3332723953 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fec1c064090 msgr2=0x7fec1c066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:11:53.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.609+0000 7fec365a0700 1 --2- 172.21.15.26:0/3332723953 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fec1c064090 0x7fec1c066550 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7fec300f77e0 tx=0x7fec20009c00).stop 2021-11-03T18:11:53.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.609+0000 7fec365a0700 1 -- 172.21.15.26:0/3332723953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec300f7980 msgr2=0x7fec30107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:11:53.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.609+0000 7fec365a0700 1 --2- 172.21.15.26:0/3332723953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec300f7980 0x7fec30107450 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 rx=0x7fec18009830 tx=0x7fec18009b30).stop 2021-11-03T18:11:53.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.609+0000 7fec365a0700 1 -- 172.21.15.26:0/3332723953 shutdown_connections 2021-11-03T18:11:53.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.609+0000 7fec365a0700 1 --2- 172.21.15.26:0/3332723953 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fec1c064090 0x7fec1c066550 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:53.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.609+0000 7fec365a0700 1 --2- 172.21.15.26:0/3332723953 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec300f66e0 0x7fec30106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:53.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.609+0000 7fec365a0700 1 --2- 172.21.15.26:0/3332723953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec300f7980 0x7fec30107450 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:53.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.609+0000 7fec365a0700 1 -- 172.21.15.26:0/3332723953 >> 172.21.15.26:0/3332723953 conn(0x7fec300f1e40 msgr2=0x7fec300fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:11:53.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.610+0000 7fec365a0700 1 -- 172.21.15.26:0/3332723953 shutdown_connections 2021-11-03T18:11:53.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.610+0000 7fec365a0700 1 -- 172.21.15.26:0/3332723953 wait complete. 2021-11-03T18:11:53.707 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.709+0000 7f7c4969b700 1 -- 172.21.15.26:0/447244409 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c440f5340 msgr2=0x7f7c440f7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:11:53.708 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.709+0000 7f7c4969b700 1 --2- 172.21.15.26:0/447244409 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c440f5340 0x7f7c440f7ac0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7f7c2c004660 tx=0x7f7c2c009b30).stop 2021-11-03T18:11:53.708 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.709+0000 7f7c4969b700 1 -- 172.21.15.26:0/447244409 shutdown_connections 2021-11-03T18:11:53.708 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.709+0000 7f7c4969b700 1 --2- 172.21.15.26:0/447244409 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c440f5340 0x7f7c440f7ac0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:53.708 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.709+0000 7f7c4969b700 1 --2- 172.21.15.26:0/447244409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c440f49a0 0x7f7c440f4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:53.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.709+0000 7f7c4969b700 1 -- 172.21.15.26:0/447244409 >> 172.21.15.26:0/447244409 conn(0x7f7c440f04c0 msgr2=0x7f7c440f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:11:53.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.709+0000 7f7c4969b700 1 -- 172.21.15.26:0/447244409 shutdown_connections 2021-11-03T18:11:53.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.709+0000 7f7c4969b700 1 -- 172.21.15.26:0/447244409 wait complete. 2021-11-03T18:11:53.712 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.710+0000 7f7c4969b700 1 Processor -- start 2021-11-03T18:11:53.712 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.710+0000 7f7c4969b700 1 -- start start 2021-11-03T18:11:53.712 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.710+0000 7f7c4969b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c440f49a0 0x7f7c44106fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:11:53.712 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.710+0000 7f7c4969b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c440f5340 0x7f7c44107490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:11:53.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.710+0000 7f7c4969b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c44107a40 con 0x7f7c440f49a0 2021-11-03T18:11:53.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.710+0000 7f7c4969b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c44107b80 con 0x7f7c440f5340 2021-11-03T18:11:53.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.710+0000 7f7c42ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c440f49a0 0x7f7c44106fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:11:53.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.710+0000 7f7c42ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c440f49a0 0x7f7c44106fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58690/0 (socket says 172.21.15.26:58690) 2021-11-03T18:11:53.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.710+0000 7f7c42ffd700 1 -- 172.21.15.26:0/967900256 learned_addr learned my addr 172.21.15.26:0/967900256 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:11:53.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.710+0000 7f7c427fc700 1 --2- 172.21.15.26:0/967900256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c440f5340 0x7f7c44107490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:11:53.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.710+0000 7f7c42ffd700 1 -- 172.21.15.26:0/967900256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c440f5340 msgr2=0x7f7c44107490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:11:53.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.710+0000 7f7c42ffd700 1 --2- 172.21.15.26:0/967900256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c440f5340 0x7f7c44107490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:53.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.710+0000 7f7c42ffd700 1 -- 172.21.15.26:0/967900256 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2c005040 con 0x7f7c440f49a0 2021-11-03T18:11:53.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.710+0000 7f7c427fc700 1 --2- 172.21.15.26:0/967900256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c440f5340 0x7f7c44107490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:11:53.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.710+0000 7f7c42ffd700 1 --2- 172.21.15.26:0/967900256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c440f49a0 0x7f7c44106fa0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7f7c3c00d7f0 tx=0x7f7c3c004e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:11:53.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.711+0000 7f7c3b7fe700 1 -- 172.21.15.26:0/967900256 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c3c00b4f0 con 0x7f7c440f49a0 2021-11-03T18:11:53.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.711+0000 7f7c3b7fe700 1 -- 172.21.15.26:0/967900256 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7c3c00f040 con 0x7f7c440f49a0 2021-11-03T18:11:53.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.711+0000 7f7c4969b700 1 -- 172.21.15.26:0/967900256 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c44108520 con 0x7f7c440f49a0 2021-11-03T18:11:53.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.711+0000 7f7c3b7fe700 1 -- 172.21.15.26:0/967900256 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c3c013980 con 0x7f7c440f49a0 2021-11-03T18:11:53.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.711+0000 7f7c4969b700 1 -- 172.21.15.26:0/967900256 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c44108ae0 con 0x7f7c440f49a0 2021-11-03T18:11:53.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.712+0000 7f7c4969b700 1 -- 172.21.15.26:0/967900256 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c44045ad0 con 0x7f7c440f49a0 2021-11-03T18:11:53.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.712+0000 7f7c3b7fe700 1 -- 172.21.15.26:0/967900256 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f7c3c01a030 con 0x7f7c440f49a0 2021-11-03T18:11:53.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.712+0000 7f7c3b7fe700 1 --2- 172.21.15.26:0/967900256 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7c300640b0 0x7f7c30066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:11:53.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.713+0000 7f7c3b7fe700 1 -- 172.21.15.26:0/967900256 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f7c3c080830 con 0x7f7c440f49a0 2021-11-03T18:11:53.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.713+0000 7f7c427fc700 1 --2- 172.21.15.26:0/967900256 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7c300640b0 0x7f7c30066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:11:53.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.713+0000 7f7c427fc700 1 --2- 172.21.15.26:0/967900256 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7c300640b0 0x7f7c30066570 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f7c2c005010 tx=0x7f7c2c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:11:53.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.717+0000 7f7c3b7fe700 1 -- 172.21.15.26:0/967900256 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f7c3c052aa0 con 0x7f7c440f49a0 2021-11-03T18:11:53.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.947+0000 7f7c4969b700 1 -- 172.21.15.26:0/967900256 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7c44027a00 con 0x7f7c440f49a0 2021-11-03T18:11:53.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.948+0000 7f7c3b7fe700 1 -- 172.21.15.26:0/967900256 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f7c3c0182e0 con 0x7f7c440f49a0 2021-11-03T18:11:53.948 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:11:53.948 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:11:53.948 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:11:53.949 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:11:53.949 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:11:53.949 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:11:53.949 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:11:53.949 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:11:53.950 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:11:53.950 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:11:53.950 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:11:53.951 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:11:53.951 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:11:53.951 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:11:53.951 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:11:53.951 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:11:53.952 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:11:53.952 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:11:53.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.950+0000 7f7c4969b700 1 -- 172.21.15.26:0/967900256 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7c300640b0 msgr2=0x7f7c30066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:11:53.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.950+0000 7f7c4969b700 1 --2- 172.21.15.26:0/967900256 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7c300640b0 0x7f7c30066570 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f7c2c005010 tx=0x7f7c2c009b30).stop 2021-11-03T18:11:53.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.950+0000 7f7c4969b700 1 -- 172.21.15.26:0/967900256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c440f49a0 msgr2=0x7f7c44106fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:11:53.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.950+0000 7f7c4969b700 1 --2- 172.21.15.26:0/967900256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c440f49a0 0x7f7c44106fa0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7f7c3c00d7f0 tx=0x7f7c3c004e80).stop 2021-11-03T18:11:53.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.950+0000 7f7c4969b700 1 -- 172.21.15.26:0/967900256 shutdown_connections 2021-11-03T18:11:53.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.950+0000 7f7c4969b700 1 --2- 172.21.15.26:0/967900256 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7c300640b0 0x7f7c30066570 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:53.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.950+0000 7f7c4969b700 1 --2- 172.21.15.26:0/967900256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c440f49a0 0x7f7c44106fa0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:53.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.950+0000 7f7c4969b700 1 --2- 172.21.15.26:0/967900256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c440f5340 0x7f7c44107490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:53.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.950+0000 7f7c4969b700 1 -- 172.21.15.26:0/967900256 >> 172.21.15.26:0/967900256 conn(0x7f7c440f04c0 msgr2=0x7f7c440fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:11:53.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.950+0000 7f7c4969b700 1 -- 172.21.15.26:0/967900256 shutdown_connections 2021-11-03T18:11:53.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:53.950+0000 7f7c4969b700 1 -- 172.21.15.26:0/967900256 wait complete. 2021-11-03T18:11:54.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.050+0000 7f5a4fb2e700 1 -- 172.21.15.26:0/3966243838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a480f66e0 msgr2=0x7f5a480f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:11:54.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.050+0000 7f5a4fb2e700 1 --2- 172.21.15.26:0/3966243838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a480f66e0 0x7f5a480f6b00 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 rx=0x7f5a400099e0 tx=0x7f5a40004d10).stop 2021-11-03T18:11:54.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.050+0000 7f5a4fb2e700 1 -- 172.21.15.26:0/3966243838 shutdown_connections 2021-11-03T18:11:54.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.050+0000 7f5a4fb2e700 1 --2- 172.21.15.26:0/3966243838 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a480f7980 0x7f5a480f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:11:54.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.050+0000 7f5a4fb2e700 1 --2- 172.21.15.26:0/3966243838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a480f66e0 0x7f5a480f6b00 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:54.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.050+0000 7f5a4fb2e700 1 -- 172.21.15.26:0/3966243838 >> 172.21.15.26:0/3966243838 conn(0x7f5a480f1e40 msgr2=0x7f5a480f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:11:54.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.050+0000 7f5a4fb2e700 1 -- 172.21.15.26:0/3966243838 shutdown_connections 2021-11-03T18:11:54.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.050+0000 7f5a4fb2e700 1 -- 172.21.15.26:0/3966243838 wait complete. 2021-11-03T18:11:54.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.050+0000 7f5a4fb2e700 1 Processor -- start 2021-11-03T18:11:54.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.050+0000 7f5a4fb2e700 1 -- start start 2021-11-03T18:11:54.053 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.051+0000 7f5a4fb2e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a480f66e0 0x7f5a48107120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:11:54.053 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.051+0000 7f5a4fb2e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a480f7980 0x7f5a48107610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:11:54.053 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.051+0000 7f5a4fb2e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a48107c50 con 0x7f5a480f66e0 2021-11-03T18:11:54.053 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.051+0000 7f5a4fb2e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a48108500 con 0x7f5a480f7980 2021-11-03T18:11:54.053 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.051+0000 7f5a4d8ca700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a480f66e0 0x7f5a48107120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:11:54.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.051+0000 7f5a4d8ca700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a480f66e0 0x7f5a48107120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58700/0 (socket says 172.21.15.26:58700) 2021-11-03T18:11:54.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.051+0000 7f5a4d8ca700 1 -- 172.21.15.26:0/104778539 learned_addr learned my addr 172.21.15.26:0/104778539 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:11:54.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.051+0000 7f5a4d8ca700 1 -- 172.21.15.26:0/104778539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a480f7980 msgr2=0x7f5a48107610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:11:54.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.051+0000 7f5a4d8ca700 1 --2- 172.21.15.26:0/104778539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a480f7980 0x7f5a48107610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:11:54.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.051+0000 7f5a4d8ca700 1 -- 172.21.15.26:0/104778539 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a40009640 con 0x7f5a480f66e0 2021-11-03T18:11:54.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.051+0000 7f5a4d8ca700 1 --2- 172.21.15.26:0/104778539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a480f66e0 0x7f5a48107120 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7f5a4000c010 tx=0x7f5a40004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:11:54.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.051+0000 7f5a467fc700 1 -- 172.21.15.26:0/104778539 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a4000e070 con 0x7f5a480f66e0 2021-11-03T18:11:54.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.051+0000 7f5a4fb2e700 1 -- 172.21.15.26:0/104778539 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a48108780 con 0x7f5a480f66e0 2021-11-03T18:11:54.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.051+0000 7f5a467fc700 1 -- 172.21.15.26:0/104778539 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5a40007dc0 con 0x7f5a480f66e0 2021-11-03T18:11:54.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.051+0000 7f5a467fc700 1 -- 172.21.15.26:0/104778539 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a40018070 con 0x7f5a480f66e0 2021-11-03T18:11:54.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.051+0000 7f5a4fb2e700 1 -- 172.21.15.26:0/104778539 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a48108c60 con 0x7f5a480f66e0 2021-11-03T18:11:54.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.052+0000 7f5a4fb2e700 1 -- 172.21.15.26:0/104778539 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a480f5ad0 con 0x7f5a480f66e0 2021-11-03T18:11:54.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.053+0000 7f5a467fc700 1 -- 172.21.15.26:0/104778539 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f5a40024060 con 0x7f5a480f66e0 2021-11-03T18:11:54.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.053+0000 7f5a467fc700 1 --2- 172.21.15.26:0/104778539 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5a300640b0 0x7f5a30066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:11:54.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.054+0000 7f5a467fc700 1 -- 172.21.15.26:0/104778539 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f5a40082450 con 0x7f5a480f66e0 2021-11-03T18:11:54.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.054+0000 7f5a4d0c9700 1 --2- 172.21.15.26:0/104778539 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5a300640b0 0x7f5a30066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:11:54.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.054+0000 7f5a4d0c9700 1 --2- 172.21.15.26:0/104778539 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5a300640b0 0x7f5a30066570 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f5a3c009610 tx=0x7f5a3c006ab0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:11:54.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.057+0000 7f5a467fc700 1 -- 172.21.15.26:0/104778539 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f5a400547b0 con 0x7f5a480f66e0 2021-11-03T18:11:54.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.263+0000 7f5a4fb2e700 1 -- 172.21.15.26:0/104778539 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5a48027a00 con 0x7f5a480f66e0 2021-11-03T18:11:54.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.264+0000 7f5a467fc700 1 -- 172.21.15.26:0/104778539 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f5a40022070 con 0x7f5a480f66e0 2021-11-03T18:11:54.263 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:11:54.263 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:11:54.263 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:11:54.263 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:11:54.264 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:11:54.264 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:11:54.264 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:11:54.264 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:11:54.264 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:11:54.265 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:11:54.265 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:11:54.265 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:11:54.266 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:11:54.266 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:11:54.266 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:11:54.266 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:11:54.266 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:11:54.267 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:11:54.267 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:11:54.267 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:11:54.267 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:11:54.268 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:11:54.268 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:11:54.268 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:11:54.269 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:11:54.269 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:11:54.270 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:11:54.270 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:11:54.270 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:11:54.270 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:11:54.271 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:11:54.271 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:11:54.271 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:11:54.271 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:11:54.272 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:11:54.272 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:11:54.272 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:11:54.272 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:11:54.273 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:11:54.274 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.265+0000 7f5a4fb2e700 1 -- 172.21.15.26:0/104778539 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5a300640b0 msgr2=0x7f5a30066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:11:54.274 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.265+0000 7f5a4fb2e700 1 --2- 172.21.15.26:0/104778539 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5a300640b0 0x7f5a30066570 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f5a3c009610 tx=0x7f5a3c006ab0).stop 2021-11-03T18:11:54.274 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.265+0000 7f5a4fb2e700 1 -- 172.21.15.26:0/104778539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a480f66e0 msgr2=0x7f5a48107120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:11:54.274 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.265+0000 7f5a4fb2e700 1 --2- 172.21.15.26:0/104778539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a480f66e0 0x7f5a48107120 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7f5a4000c010 tx=0x7f5a40004d10).stop 2021-11-03T18:11:54.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.265+0000 7f5a4fb2e700 1 -- 172.21.15.26:0/104778539 shutdown_connections 2021-11-03T18:11:54.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.265+0000 7f5a4fb2e700 1 --2- 172.21.15.26:0/104778539 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5a300640b0 0x7f5a30066570 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:54.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.265+0000 7f5a4fb2e700 1 --2- 172.21.15.26:0/104778539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a480f66e0 0x7f5a48107120 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:11:54.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.265+0000 7f5a4fb2e700 1 --2- 172.21.15.26:0/104778539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a480f7980 0x7f5a48107610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:11:54.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.265+0000 7f5a4fb2e700 1 -- 172.21.15.26:0/104778539 >> 172.21.15.26:0/104778539 conn(0x7f5a480f1e40 msgr2=0x7f5a480fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:11:54.276 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.265+0000 7f5a4fb2e700 1 -- 172.21.15.26:0/104778539 shutdown_connections 2021-11-03T18:11:54.276 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:11:54.265+0000 7f5a4fb2e700 1 -- 172.21.15.26:0/104778539 wait complete. 2021-11-03T18:11:54.276 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:11:55.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:54 smithi026 ceph-mon[96795]: from='client.36524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:11:55.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:54 smithi026 ceph-mon[96795]: from='client.36528 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:11:55.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:54 smithi026 ceph-mon[96795]: pgmap v2317: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:55.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:54 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/967900256' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:11:55.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:54 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/104778539' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:11:55.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:54 smithi194 ceph-mon[65619]: from='client.36524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:11:55.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:54 smithi194 ceph-mon[65619]: from='client.36528 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:11:55.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:54 smithi194 ceph-mon[65619]: pgmap v2317: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:55.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:54 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/967900256' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:11:55.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:54 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/104778539' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:11:57.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:56 smithi026 ceph-mon[96795]: pgmap v2318: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:57.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:56 smithi194 ceph-mon[65619]: pgmap v2318: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:59.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:11:58 smithi026 ceph-mon[96795]: pgmap v2319: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:11:59.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:11:58 smithi194 ceph-mon[65619]: pgmap v2319: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:01.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:00 smithi026 ceph-mon[96795]: pgmap v2320: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:01.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:00 smithi194 ceph-mon[65619]: pgmap v2320: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:03.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:02 smithi026 ceph-mon[96795]: pgmap v2321: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:03.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:02 smithi194 ceph-mon[65619]: pgmap v2321: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:05.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:04 smithi026 ceph-mon[96795]: pgmap v2322: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:05.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:04 smithi194 ceph-mon[65619]: pgmap v2322: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:07.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:06 smithi026 ceph-mon[96795]: pgmap v2323: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:07.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:06 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:12:07.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:06 smithi026 ceph-mon[96795]: poll took 60074.486 ms: 1 events 2021-11-03T18:12:07.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:06 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:12:07.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:06 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:12:07.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:06 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:12:07.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:06 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:12:07.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:06 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:12:07.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:06 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:12:07.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:06 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:12:07.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:06 smithi194 ceph-mon[65619]: pgmap v2323: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:07.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:06 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:12:07.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:06 smithi194 ceph-mon[65619]: poll took 60074.486 ms: 1 events 2021-11-03T18:12:07.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:06 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:12:07.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:06 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:12:07.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:06 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:12:07.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:06 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:12:07.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:06 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:12:07.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:06 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:12:07.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:06 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:12:08.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:07 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:12:08.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:07 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:12:08.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:07 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:12:08.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:07 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:12:09.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:08 smithi026 ceph-mon[96795]: pgmap v2324: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:09.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:08 smithi194 ceph-mon[65619]: pgmap v2324: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:11.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:10 smithi026 ceph-mon[96795]: pgmap v2325: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:11.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:10 smithi194 ceph-mon[65619]: pgmap v2325: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:13.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:12 smithi026 ceph-mon[96795]: pgmap v2326: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:13.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:12 smithi194 ceph-mon[65619]: pgmap v2326: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:15.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:14 smithi026 ceph-mon[96795]: pgmap v2327: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:15.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:14 smithi194 ceph-mon[65619]: pgmap v2327: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:17.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:16 smithi026 ceph-mon[96795]: pgmap v2328: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:17.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:16 smithi194 ceph-mon[65619]: pgmap v2328: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:19.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:18 smithi026 ceph-mon[96795]: pgmap v2329: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:19.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:18 smithi194 ceph-mon[65619]: pgmap v2329: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:21.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:20 smithi026 ceph-mon[96795]: pgmap v2330: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:21.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:20 smithi194 ceph-mon[65619]: pgmap v2330: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:22.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:21 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:12:22.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:21 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:12:23.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:22 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:12:23.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:22 smithi026 ceph-mon[96795]: pgmap v2331: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:23.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:22 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:12:23.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:22 smithi194 ceph-mon[65619]: pgmap v2331: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:24.379 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.381+0000 7f77c8b58700 1 -- 172.21.15.26:0/849502915 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77c40f6530 msgr2=0x7f77c40f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:12:24.379 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.381+0000 7f77c8b58700 1 --2- 172.21.15.26:0/849502915 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77c40f6530 0x7f77c40f6950 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 rx=0x7f77b8004660 tx=0x7f77b8009b30).stop 2021-11-03T18:12:24.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.381+0000 7f77c8b58700 1 -- 172.21.15.26:0/849502915 shutdown_connections 2021-11-03T18:12:24.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.381+0000 7f77c8b58700 1 --2- 172.21.15.26:0/849502915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77c40f77d0 0x7f77c40f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:24.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.381+0000 7f77c8b58700 1 --2- 172.21.15.26:0/849502915 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77c40f6530 0x7f77c40f6950 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:24.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.381+0000 7f77c8b58700 1 -- 172.21.15.26:0/849502915 >> 172.21.15.26:0/849502915 conn(0x7f77c40f1c90 msgr2=0x7f77c40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:12:24.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.381+0000 7f77c8b58700 1 -- 172.21.15.26:0/849502915 shutdown_connections 2021-11-03T18:12:24.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.381+0000 7f77c8b58700 1 -- 172.21.15.26:0/849502915 wait complete. 2021-11-03T18:12:24.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.382+0000 7f77c8b58700 1 Processor -- start 2021-11-03T18:12:24.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.382+0000 7f77c8b58700 1 -- start start 2021-11-03T18:12:24.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.382+0000 7f77c8b58700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77c40f6530 0x7f77c4106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:12:24.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.382+0000 7f77c8b58700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77c40f77d0 0x7f77c4107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:12:24.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.382+0000 7f77c8b58700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c4107880 con 0x7f77c40f77d0 2021-11-03T18:12:24.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.382+0000 7f77c8b58700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c4108090 con 0x7f77c40f6530 2021-11-03T18:12:24.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.382+0000 7f77c2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77c40f77d0 0x7f77c4107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:12:24.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.382+0000 7f77c2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77c40f77d0 0x7f77c4107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58722/0 (socket says 172.21.15.26:58722) 2021-11-03T18:12:24.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.382+0000 7f77c2ffd700 1 -- 172.21.15.26:0/2658889075 learned_addr learned my addr 172.21.15.26:0/2658889075 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:12:24.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.382+0000 7f77c37fe700 1 --2- 172.21.15.26:0/2658889075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77c40f6530 0x7f77c4106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:12:24.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.382+0000 7f77c2ffd700 1 -- 172.21.15.26:0/2658889075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77c40f6530 msgr2=0x7f77c4106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:12:24.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.382+0000 7f77c2ffd700 1 --2- 172.21.15.26:0/2658889075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77c40f6530 0x7f77c4106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:24.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.382+0000 7f77c2ffd700 1 -- 172.21.15.26:0/2658889075 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b8005040 con 0x7f77c40f77d0 2021-11-03T18:12:24.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.383+0000 7f77c37fe700 1 --2- 172.21.15.26:0/2658889075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77c40f6530 0x7f77c4106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:12:24.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.383+0000 7f77c2ffd700 1 --2- 172.21.15.26:0/2658889075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77c40f77d0 0x7f77c4107280 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 rx=0x7f77b4002700 tx=0x7f77b4009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:12:24.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.383+0000 7f77abfff700 1 -- 172.21.15.26:0/2658889075 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77b4009320 con 0x7f77c40f77d0 2021-11-03T18:12:24.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.383+0000 7f77c8b58700 1 -- 172.21.15.26:0/2658889075 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c4108310 con 0x7f77c40f77d0 2021-11-03T18:12:24.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.383+0000 7f77abfff700 1 -- 172.21.15.26:0/2658889075 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f77b400f040 con 0x7f77c40f77d0 2021-11-03T18:12:24.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.383+0000 7f77abfff700 1 -- 172.21.15.26:0/2658889075 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77b4014820 con 0x7f77c40f77d0 2021-11-03T18:12:24.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.383+0000 7f77c8b58700 1 -- 172.21.15.26:0/2658889075 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77c41088d0 con 0x7f77c40f77d0 2021-11-03T18:12:24.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.384+0000 7f77c8b58700 1 -- 172.21.15.26:0/2658889075 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77c4059100 con 0x7f77c40f77d0 2021-11-03T18:12:24.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.384+0000 7f77abfff700 1 -- 172.21.15.26:0/2658889075 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f77b4009480 con 0x7f77c40f77d0 2021-11-03T18:12:24.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.385+0000 7f77abfff700 1 --2- 172.21.15.26:0/2658889075 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f77ac064100 0x7f77ac0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:12:24.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.385+0000 7f77abfff700 1 -- 172.21.15.26:0/2658889075 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f77b4080b10 con 0x7f77c40f77d0 2021-11-03T18:12:24.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.385+0000 7f77c37fe700 1 --2- 172.21.15.26:0/2658889075 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f77ac064100 0x7f77ac0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:12:24.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.385+0000 7f77c37fe700 1 --2- 172.21.15.26:0/2658889075 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f77ac064100 0x7f77ac0665c0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f77b8004e30 tx=0x7f77b8009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:12:24.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.389+0000 7f77abfff700 1 -- 172.21.15.26:0/2658889075 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f77b4052e70 con 0x7f77c40f77d0 2021-11-03T18:12:24.566 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.568+0000 7f77c8b58700 1 -- 172.21.15.26:0/2658889075 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f77c40fee60 con 0x7f77ac064100 2021-11-03T18:12:24.567 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.570+0000 7f77abfff700 1 -- 172.21.15.26:0/2658889075 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f77c40fee60 con 0x7f77ac064100 2021-11-03T18:12:24.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.571+0000 7f77c8b58700 1 -- 172.21.15.26:0/2658889075 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f77ac064100 msgr2=0x7f77ac0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:12:24.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.571+0000 7f77c8b58700 1 --2- 172.21.15.26:0/2658889075 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f77ac064100 0x7f77ac0665c0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f77b8004e30 tx=0x7f77b8009b30).stop 2021-11-03T18:12:24.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.571+0000 7f77c8b58700 1 -- 172.21.15.26:0/2658889075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77c40f77d0 msgr2=0x7f77c4107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:12:24.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.571+0000 7f77c8b58700 1 --2- 172.21.15.26:0/2658889075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77c40f77d0 0x7f77c4107280 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 rx=0x7f77b4002700 tx=0x7f77b4009e00).stop 2021-11-03T18:12:24.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.571+0000 7f77c8b58700 1 -- 172.21.15.26:0/2658889075 shutdown_connections 2021-11-03T18:12:24.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.571+0000 7f77c8b58700 1 --2- 172.21.15.26:0/2658889075 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f77ac064100 0x7f77ac0665c0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:24.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.571+0000 7f77c8b58700 1 --2- 172.21.15.26:0/2658889075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77c40f6530 0x7f77c4106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:24.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.571+0000 7f77c8b58700 1 --2- 172.21.15.26:0/2658889075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77c40f77d0 0x7f77c4107280 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:24.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.571+0000 7f77c8b58700 1 -- 172.21.15.26:0/2658889075 >> 172.21.15.26:0/2658889075 conn(0x7f77c40f1c90 msgr2=0x7f77c40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:12:24.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.572+0000 7f77c8b58700 1 -- 172.21.15.26:0/2658889075 shutdown_connections 2021-11-03T18:12:24.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.572+0000 7f77c8b58700 1 -- 172.21.15.26:0/2658889075 wait complete. 2021-11-03T18:12:24.579 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:12:24.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.672+0000 7f4dcf3c8700 1 -- 172.21.15.26:0/1250242185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dc80f7980 msgr2=0x7f4dc80f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:12:24.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.672+0000 7f4dcf3c8700 1 --2- 172.21.15.26:0/1250242185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dc80f7980 0x7f4dc80f7de0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7f4dc4004660 tx=0x7f4dc4009b30).stop 2021-11-03T18:12:24.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.672+0000 7f4dcf3c8700 1 -- 172.21.15.26:0/1250242185 shutdown_connections 2021-11-03T18:12:24.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.672+0000 7f4dcf3c8700 1 --2- 172.21.15.26:0/1250242185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dc80f7980 0x7f4dc80f7de0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:24.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.672+0000 7f4dcf3c8700 1 --2- 172.21.15.26:0/1250242185 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dc80f66e0 0x7f4dc80f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:24.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.672+0000 7f4dcf3c8700 1 -- 172.21.15.26:0/1250242185 >> 172.21.15.26:0/1250242185 conn(0x7f4dc80f1e40 msgr2=0x7f4dc80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:12:24.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.672+0000 7f4dcf3c8700 1 -- 172.21.15.26:0/1250242185 shutdown_connections 2021-11-03T18:12:24.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.672+0000 7f4dcf3c8700 1 -- 172.21.15.26:0/1250242185 wait complete. 2021-11-03T18:12:24.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.672+0000 7f4dcf3c8700 1 Processor -- start 2021-11-03T18:12:24.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.673+0000 7f4dcf3c8700 1 -- start start 2021-11-03T18:12:24.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.673+0000 7f4dcf3c8700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dc80f66e0 0x7f4dc806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:12:24.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.673+0000 7f4dcf3c8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dc80f7980 0x7f4dc8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:12:24.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.673+0000 7f4dcf3c8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc806a380 con 0x7f4dc80f7980 2021-11-03T18:12:24.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.673+0000 7f4dcf3c8700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc806a4c0 con 0x7f4dc80f66e0 2021-11-03T18:12:24.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.673+0000 7f4dcc963700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dc80f7980 0x7f4dc8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:12:24.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.673+0000 7f4dcc963700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dc80f7980 0x7f4dc8069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58732/0 (socket says 172.21.15.26:58732) 2021-11-03T18:12:24.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.673+0000 7f4dcc963700 1 -- 172.21.15.26:0/2003751974 learned_addr learned my addr 172.21.15.26:0/2003751974 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:12:24.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.673+0000 7f4dcd164700 1 --2- 172.21.15.26:0/2003751974 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dc80f66e0 0x7f4dc806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:12:24.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.673+0000 7f4dcc963700 1 -- 172.21.15.26:0/2003751974 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dc80f66e0 msgr2=0x7f4dc806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:12:24.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.673+0000 7f4dcc963700 1 --2- 172.21.15.26:0/2003751974 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dc80f66e0 0x7f4dc806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:24.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.673+0000 7f4dcc963700 1 -- 172.21.15.26:0/2003751974 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc4005040 con 0x7f4dc80f7980 2021-11-03T18:12:24.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.673+0000 7f4dcc963700 1 --2- 172.21.15.26:0/2003751974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dc80f7980 0x7f4dc8069e20 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7f4dc4009990 tx=0x7f4dc4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:12:24.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.673+0000 7f4dbdffb700 1 -- 172.21.15.26:0/2003751974 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4dc4018070 con 0x7f4dc80f7980 2021-11-03T18:12:24.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.673+0000 7f4dbdffb700 1 -- 172.21.15.26:0/2003751974 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4dc4007ba0 con 0x7f4dc80f7980 2021-11-03T18:12:24.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.673+0000 7f4dcf3c8700 1 -- 172.21.15.26:0/2003751974 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dc806a740 con 0x7f4dc80f7980 2021-11-03T18:12:24.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.673+0000 7f4dbdffb700 1 -- 172.21.15.26:0/2003751974 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4dc401c3c0 con 0x7f4dc80f7980 2021-11-03T18:12:24.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.674+0000 7f4dcf3c8700 1 -- 172.21.15.26:0/2003751974 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc806aca0 con 0x7f4dc80f7980 2021-11-03T18:12:24.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.674+0000 7f4dcf3c8700 1 -- 172.21.15.26:0/2003751974 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc8045ad0 con 0x7f4dc80f7980 2021-11-03T18:12:24.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.675+0000 7f4dbdffb700 1 -- 172.21.15.26:0/2003751974 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f4dc401d420 con 0x7f4dc80f7980 2021-11-03T18:12:24.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.675+0000 7f4dbdffb700 1 --2- 172.21.15.26:0/2003751974 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4db40640b0 0x7f4db4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:12:24.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.675+0000 7f4dbdffb700 1 -- 172.21.15.26:0/2003751974 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f4dc40824d0 con 0x7f4dc80f7980 2021-11-03T18:12:24.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.676+0000 7f4dcd164700 1 --2- 172.21.15.26:0/2003751974 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4db40640b0 0x7f4db4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:12:24.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.676+0000 7f4dcd164700 1 --2- 172.21.15.26:0/2003751974 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4db40640b0 0x7f4db4066570 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7f4dc806b730 tx=0x7f4db800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:12:24.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.679+0000 7f4dbdffb700 1 -- 172.21.15.26:0/2003751974 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f4dc4054710 con 0x7f4dc80f7980 2021-11-03T18:12:24.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.854+0000 7f4dcf3c8700 1 -- 172.21.15.26:0/2003751974 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4dc80fefb0 con 0x7f4db40640b0 2021-11-03T18:12:24.866 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.868+0000 7f4dbdffb700 1 -- 172.21.15.26:0/2003751974 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f4dc80fefb0 con 0x7f4db40640b0 2021-11-03T18:12:24.866 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:12:24.867 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (83m) 2m ago 84m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:12:24.867 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (75m) 2m ago 84m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:12:24.867 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (75m) 79s ago 84m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:12:24.867 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (83m) 2m ago 84m 42.0M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:12:24.868 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (76m) 2m ago 80m 25.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:12:24.868 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (76m) 2m ago 79m 26.4M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:12:24.868 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (80m) 79s ago 80m 26.6M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:12:24.868 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (79m) 79s ago 79m 27.0M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:12:24.869 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (77m) 2m ago 86m 574M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:12:24.869 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (76m) 79s ago 84m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:12:24.869 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (76m) 2m ago 86m 308M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:12:24.869 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (76m) 79s ago 84m 145M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:12:24.869 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (84m) 2m ago 84m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:12:24.870 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (83m) 79s ago 83m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:12:24.870 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (75m) 2m ago 83m 312M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:12:24.870 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (74m) 2m ago 82m 335M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:12:24.870 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (74m) 2m ago 82m 279M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:12:24.871 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (73m) 79s ago 82m 362M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:12:24.871 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (73m) 79s ago 81m 302M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:12:24.871 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (73m) 79s ago 81m 296M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:12:24.871 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (83m) 2m ago 84m 63.4M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:12:24.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.870+0000 7f4dcf3c8700 1 -- 172.21.15.26:0/2003751974 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4db40640b0 msgr2=0x7f4db4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:12:24.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.870+0000 7f4dcf3c8700 1 --2- 172.21.15.26:0/2003751974 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4db40640b0 0x7f4db4066570 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7f4dc806b730 tx=0x7f4db800b040).stop 2021-11-03T18:12:24.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.870+0000 7f4dcf3c8700 1 -- 172.21.15.26:0/2003751974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dc80f7980 msgr2=0x7f4dc8069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:12:24.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.870+0000 7f4dcf3c8700 1 --2- 172.21.15.26:0/2003751974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dc80f7980 0x7f4dc8069e20 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7f4dc4009990 tx=0x7f4dc4009b30).stop 2021-11-03T18:12:24.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.870+0000 7f4dcf3c8700 1 -- 172.21.15.26:0/2003751974 shutdown_connections 2021-11-03T18:12:24.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.870+0000 7f4dcf3c8700 1 --2- 172.21.15.26:0/2003751974 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4db40640b0 0x7f4db4066570 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:24.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.870+0000 7f4dcf3c8700 1 --2- 172.21.15.26:0/2003751974 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dc80f66e0 0x7f4dc806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:24.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.870+0000 7f4dcf3c8700 1 --2- 172.21.15.26:0/2003751974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dc80f7980 0x7f4dc8069e20 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:24.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.870+0000 7f4dcf3c8700 1 -- 172.21.15.26:0/2003751974 >> 172.21.15.26:0/2003751974 conn(0x7f4dc80f1e40 msgr2=0x7f4dc80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:12:24.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.870+0000 7f4dcf3c8700 1 -- 172.21.15.26:0/2003751974 shutdown_connections 2021-11-03T18:12:24.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.870+0000 7f4dcf3c8700 1 -- 172.21.15.26:0/2003751974 wait complete. 2021-11-03T18:12:24.967 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.969+0000 7fc3aa591700 1 -- 172.21.15.26:0/1703615682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3a40603f0 msgr2=0x7fc3a40f9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:12:24.967 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.969+0000 7fc3aa591700 1 --2- 172.21.15.26:0/1703615682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3a40603f0 0x7fc3a40f9340 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7fc38c004660 tx=0x7fc38c009b30).stop 2021-11-03T18:12:24.967 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.969+0000 7fc3aa591700 1 -- 172.21.15.26:0/1703615682 shutdown_connections 2021-11-03T18:12:24.968 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.969+0000 7fc3aa591700 1 --2- 172.21.15.26:0/1703615682 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3a40f9830 0x7fc3a40fbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:24.968 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.969+0000 7fc3aa591700 1 --2- 172.21.15.26:0/1703615682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3a40603f0 0x7fc3a40f9340 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:24.968 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.969+0000 7fc3aa591700 1 -- 172.21.15.26:0/1703615682 >> 172.21.15.26:0/1703615682 conn(0x7fc3a40f0dc0 msgr2=0x7fc3a40f31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:12:24.968 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.969+0000 7fc3aa591700 1 -- 172.21.15.26:0/1703615682 shutdown_connections 2021-11-03T18:12:24.968 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.969+0000 7fc3aa591700 1 -- 172.21.15.26:0/1703615682 wait complete. 2021-11-03T18:12:24.969 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.970+0000 7fc3aa591700 1 Processor -- start 2021-11-03T18:12:24.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.970+0000 7fc3aa591700 1 -- start start 2021-11-03T18:12:24.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.970+0000 7fc3aa591700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3a40603f0 0x7fc3a4106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:12:24.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.970+0000 7fc3aa591700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3a40f9830 0x7fc3a4107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:12:24.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.970+0000 7fc3aa591700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a4107a00 con 0x7fc3a40f9830 2021-11-03T18:12:24.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.970+0000 7fc3aa591700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a4107b40 con 0x7fc3a40603f0 2021-11-03T18:12:24.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.970+0000 7fc3a37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3a40f9830 0x7fc3a4107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:12:24.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.970+0000 7fc3a37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3a40f9830 0x7fc3a4107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58742/0 (socket says 172.21.15.26:58742) 2021-11-03T18:12:24.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.970+0000 7fc3a37fe700 1 -- 172.21.15.26:0/957034909 learned_addr learned my addr 172.21.15.26:0/957034909 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:12:24.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.970+0000 7fc3a3fff700 1 --2- 172.21.15.26:0/957034909 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3a40603f0 0x7fc3a4106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:12:24.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.970+0000 7fc3a37fe700 1 -- 172.21.15.26:0/957034909 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3a40603f0 msgr2=0x7fc3a4106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:12:24.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.970+0000 7fc3a37fe700 1 --2- 172.21.15.26:0/957034909 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3a40603f0 0x7fc3a4106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:24.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.970+0000 7fc3a37fe700 1 -- 172.21.15.26:0/957034909 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc38c005040 con 0x7fc3a40f9830 2021-11-03T18:12:24.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.971+0000 7fc3a37fe700 1 --2- 172.21.15.26:0/957034909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3a40f9830 0x7fc3a4107450 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 rx=0x7fc39400c530 tx=0x7fc394007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:12:24.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.971+0000 7fc3a0ff9700 1 -- 172.21.15.26:0/957034909 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc39400f650 con 0x7fc3a40f9830 2021-11-03T18:12:24.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.971+0000 7fc3aa591700 1 -- 172.21.15.26:0/957034909 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3a41084e0 con 0x7fc3a40f9830 2021-11-03T18:12:24.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.971+0000 7fc3a0ff9700 1 -- 172.21.15.26:0/957034909 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc39400fc60 con 0x7fc3a40f9830 2021-11-03T18:12:24.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.971+0000 7fc3a0ff9700 1 -- 172.21.15.26:0/957034909 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc394012c20 con 0x7fc3a40f9830 2021-11-03T18:12:24.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.971+0000 7fc3aa591700 1 -- 172.21.15.26:0/957034909 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a4108aa0 con 0x7fc3a40f9830 2021-11-03T18:12:24.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.972+0000 7fc3aa591700 1 -- 172.21.15.26:0/957034909 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3a4045ad0 con 0x7fc3a40f9830 2021-11-03T18:12:24.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.972+0000 7fc3a0ff9700 1 -- 172.21.15.26:0/957034909 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc394010070 con 0x7fc3a40f9830 2021-11-03T18:12:24.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.973+0000 7fc3a0ff9700 1 --2- 172.21.15.26:0/957034909 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc390064090 0x7fc390066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:12:24.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.973+0000 7fc3a0ff9700 1 -- 172.21.15.26:0/957034909 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc394080660 con 0x7fc3a40f9830 2021-11-03T18:12:24.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.973+0000 7fc3a3fff700 1 --2- 172.21.15.26:0/957034909 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc390064090 0x7fc390066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:12:24.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.973+0000 7fc3a3fff700 1 --2- 172.21.15.26:0/957034909 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc390064090 0x7fc390066550 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7fc38c013690 tx=0x7fc38c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:12:24.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:24.977+0000 7fc3a0ff9700 1 -- 172.21.15.26:0/957034909 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc3940528d0 con 0x7fc3a40f9830 2021-11-03T18:12:25.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:24 smithi026 ceph-mon[96795]: pgmap v2332: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:25.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.208+0000 7fc3aa591700 1 -- 172.21.15.26:0/957034909 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc3a4027a00 con 0x7fc3a40f9830 2021-11-03T18:12:25.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.208+0000 7fc3a0ff9700 1 -- 172.21.15.26:0/957034909 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fc3940524c0 con 0x7fc3a40f9830 2021-11-03T18:12:25.206 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:12:25.207 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:12:25.207 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:12:25.207 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:12:25.207 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:12:25.208 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:12:25.208 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:12:25.208 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:12:25.209 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:12:25.209 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:12:25.209 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:12:25.210 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:12:25.210 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:12:25.210 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:12:25.210 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:12:25.211 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:12:25.211 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:12:25.211 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:12:25.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.210+0000 7fc3aa591700 1 -- 172.21.15.26:0/957034909 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc390064090 msgr2=0x7fc390066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:12:25.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.210+0000 7fc3aa591700 1 --2- 172.21.15.26:0/957034909 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc390064090 0x7fc390066550 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7fc38c013690 tx=0x7fc38c009b30).stop 2021-11-03T18:12:25.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.210+0000 7fc3aa591700 1 -- 172.21.15.26:0/957034909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3a40f9830 msgr2=0x7fc3a4107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:12:25.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.210+0000 7fc3aa591700 1 --2- 172.21.15.26:0/957034909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3a40f9830 0x7fc3a4107450 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 rx=0x7fc39400c530 tx=0x7fc394007e20).stop 2021-11-03T18:12:25.216 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.210+0000 7fc3aa591700 1 -- 172.21.15.26:0/957034909 shutdown_connections 2021-11-03T18:12:25.216 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.210+0000 7fc3aa591700 1 --2- 172.21.15.26:0/957034909 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc390064090 0x7fc390066550 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:25.216 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.210+0000 7fc3aa591700 1 --2- 172.21.15.26:0/957034909 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3a40603f0 0x7fc3a4106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:25.216 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.210+0000 7fc3aa591700 1 --2- 172.21.15.26:0/957034909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3a40f9830 0x7fc3a4107450 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:25.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.210+0000 7fc3aa591700 1 -- 172.21.15.26:0/957034909 >> 172.21.15.26:0/957034909 conn(0x7fc3a40f0dc0 msgr2=0x7fc3a40f31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:12:25.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.210+0000 7fc3aa591700 1 -- 172.21.15.26:0/957034909 shutdown_connections 2021-11-03T18:12:25.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.210+0000 7fc3aa591700 1 -- 172.21.15.26:0/957034909 wait complete. 2021-11-03T18:12:25.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:24 smithi194 ceph-mon[65619]: pgmap v2332: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:25.310 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.310+0000 7f146f2a0700 1 -- 172.21.15.26:0/562122120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14680f6530 msgr2=0x7f14680f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:12:25.310 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.310+0000 7f146f2a0700 1 --2- 172.21.15.26:0/562122120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14680f6530 0x7f14680f6950 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7f1464004660 tx=0x7f1464009b30).stop 2021-11-03T18:12:25.310 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.310+0000 7f146f2a0700 1 -- 172.21.15.26:0/562122120 shutdown_connections 2021-11-03T18:12:25.310 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.310+0000 7f146f2a0700 1 --2- 172.21.15.26:0/562122120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14680f77d0 0x7f14680f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:12:25.311 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.310+0000 7f146f2a0700 1 --2- 172.21.15.26:0/562122120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14680f6530 0x7f14680f6950 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:25.311 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.310+0000 7f146f2a0700 1 -- 172.21.15.26:0/562122120 >> 172.21.15.26:0/562122120 conn(0x7f14680f1c90 msgr2=0x7f14680f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:12:25.311 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.310+0000 7f146f2a0700 1 -- 172.21.15.26:0/562122120 shutdown_connections 2021-11-03T18:12:25.311 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.310+0000 7f146f2a0700 1 -- 172.21.15.26:0/562122120 wait complete. 2021-11-03T18:12:25.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.311+0000 7f146f2a0700 1 Processor -- start 2021-11-03T18:12:25.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.311+0000 7f146f2a0700 1 -- start start 2021-11-03T18:12:25.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.311+0000 7f146f2a0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14680f6530 0x7f1468106e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:12:25.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.311+0000 7f146f2a0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14680f77d0 0x7f1468107300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:12:25.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.311+0000 7f146f2a0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1468107990 con 0x7f14680f6530 2021-11-03T18:12:25.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.311+0000 7f146f2a0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1468108110 con 0x7f14680f77d0 2021-11-03T18:12:25.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.311+0000 7f146e29e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14680f6530 0x7f1468106e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:12:25.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.311+0000 7f146e29e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14680f6530 0x7f1468106e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58750/0 (socket says 172.21.15.26:58750) 2021-11-03T18:12:25.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.311+0000 7f146e29e700 1 -- 172.21.15.26:0/2184164011 learned_addr learned my addr 172.21.15.26:0/2184164011 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:12:25.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.311+0000 7f146da9d700 1 --2- 172.21.15.26:0/2184164011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14680f77d0 0x7f1468107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:12:25.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.311+0000 7f146e29e700 1 -- 172.21.15.26:0/2184164011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14680f77d0 msgr2=0x7f1468107300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:12:25.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.311+0000 7f146e29e700 1 --2- 172.21.15.26:0/2184164011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14680f77d0 0x7f1468107300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:25.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.311+0000 7f146e29e700 1 -- 172.21.15.26:0/2184164011 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1464005040 con 0x7f14680f6530 2021-11-03T18:12:25.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.311+0000 7f146da9d700 1 --2- 172.21.15.26:0/2184164011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14680f77d0 0x7f1468107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:12:25.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.312+0000 7f146e29e700 1 --2- 172.21.15.26:0/2184164011 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14680f6530 0x7f1468106e10 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 rx=0x7f1464004f60 tx=0x7f1464009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:12:25.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.312+0000 7f145affd700 1 -- 172.21.15.26:0/2184164011 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1464018070 con 0x7f14680f6530 2021-11-03T18:12:25.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.312+0000 7f145affd700 1 -- 172.21.15.26:0/2184164011 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1464007ba0 con 0x7f14680f6530 2021-11-03T18:12:25.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.312+0000 7f145affd700 1 -- 172.21.15.26:0/2184164011 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f146401c620 con 0x7f14680f6530 2021-11-03T18:12:25.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.312+0000 7f146f2a0700 1 -- 172.21.15.26:0/2184164011 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1468108330 con 0x7f14680f6530 2021-11-03T18:12:25.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.312+0000 7f146f2a0700 1 -- 172.21.15.26:0/2184164011 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1468108890 con 0x7f14680f6530 2021-11-03T18:12:25.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.313+0000 7f146f2a0700 1 -- 172.21.15.26:0/2184164011 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1468045ad0 con 0x7f14680f6530 2021-11-03T18:12:25.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.313+0000 7f145affd700 1 -- 172.21.15.26:0/2184164011 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f146401d420 con 0x7f14680f6530 2021-11-03T18:12:25.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.314+0000 7f145affd700 1 --2- 172.21.15.26:0/2184164011 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1454064100 0x7f14540665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:12:25.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.314+0000 7f145affd700 1 -- 172.21.15.26:0/2184164011 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f1464082610 con 0x7f14680f6530 2021-11-03T18:12:25.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.314+0000 7f146da9d700 1 --2- 172.21.15.26:0/2184164011 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1454064100 0x7f14540665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:12:25.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.314+0000 7f146da9d700 1 --2- 172.21.15.26:0/2184164011 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1454064100 0x7f14540665c0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f145c00a7e0 tx=0x7f145c008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:12:25.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.318+0000 7f145affd700 1 -- 172.21.15.26:0/2184164011 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f1464054a30 con 0x7f14680f6530 2021-11-03T18:12:25.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.521+0000 7f146f2a0700 1 -- 172.21.15.26:0/2184164011 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f14680feef0 con 0x7f14680f6530 2021-11-03T18:12:25.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.521+0000 7f145affd700 1 -- 172.21.15.26:0/2184164011 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f1464054620 con 0x7f14680f6530 2021-11-03T18:12:25.519 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:12:25.520 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:12:25.520 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:12:25.520 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:12:25.520 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:12:25.521 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:12:25.521 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:12:25.521 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:12:25.521 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:12:25.522 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:12:25.522 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:12:25.522 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:12:25.522 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:12:25.523 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:12:25.523 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:12:25.523 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:12:25.523 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:12:25.523 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:12:25.524 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:12:25.524 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:12:25.524 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:12:25.524 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:12:25.525 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:12:25.525 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:12:25.525 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:12:25.525 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:12:25.526 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:12:25.526 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:12:25.526 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:12:25.526 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:12:25.527 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:12:25.527 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:12:25.527 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:12:25.527 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:12:25.528 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:12:25.528 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:12:25.528 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:12:25.528 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:12:25.528 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:12:25.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.523+0000 7f146f2a0700 1 -- 172.21.15.26:0/2184164011 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1454064100 msgr2=0x7f14540665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:12:25.530 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.523+0000 7f146f2a0700 1 --2- 172.21.15.26:0/2184164011 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1454064100 0x7f14540665c0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f145c00a7e0 tx=0x7f145c008040).stop 2021-11-03T18:12:25.530 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.523+0000 7f146f2a0700 1 -- 172.21.15.26:0/2184164011 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14680f6530 msgr2=0x7f1468106e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:12:25.530 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.523+0000 7f146f2a0700 1 --2- 172.21.15.26:0/2184164011 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14680f6530 0x7f1468106e10 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 rx=0x7f1464004f60 tx=0x7f1464009b30).stop 2021-11-03T18:12:25.531 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.523+0000 7f146f2a0700 1 -- 172.21.15.26:0/2184164011 shutdown_connections 2021-11-03T18:12:25.531 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.523+0000 7f146f2a0700 1 --2- 172.21.15.26:0/2184164011 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1454064100 0x7f14540665c0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:25.531 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.523+0000 7f146f2a0700 1 --2- 172.21.15.26:0/2184164011 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14680f6530 0x7f1468106e10 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:25.531 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.523+0000 7f146f2a0700 1 --2- 172.21.15.26:0/2184164011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14680f77d0 0x7f1468107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:25.531 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.523+0000 7f146f2a0700 1 -- 172.21.15.26:0/2184164011 >> 172.21.15.26:0/2184164011 conn(0x7f14680f1c90 msgr2=0x7f14680fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:12:25.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.523+0000 7f146f2a0700 1 -- 172.21.15.26:0/2184164011 shutdown_connections 2021-11-03T18:12:25.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:25.523+0000 7f146f2a0700 1 -- 172.21.15.26:0/2184164011 wait complete. 2021-11-03T18:12:25.532 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:12:25.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:25 smithi026 ceph-mon[96795]: from='client.36540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:12:25.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:25 smithi026 ceph-mon[96795]: from='client.36544 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:12:25.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:25 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/957034909' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:12:25.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:25 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2184164011' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:12:26.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:25 smithi194 ceph-mon[65619]: from='client.36540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:12:26.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:25 smithi194 ceph-mon[65619]: from='client.36544 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:12:26.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:25 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/957034909' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:12:26.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:25 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2184164011' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:12:27.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:26 smithi026 ceph-mon[96795]: pgmap v2333: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:27.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:26 smithi194 ceph-mon[65619]: pgmap v2333: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:29.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:28 smithi026 ceph-mon[96795]: pgmap v2334: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:29.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:28 smithi194 ceph-mon[65619]: pgmap v2334: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:31.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:30 smithi026 ceph-mon[96795]: pgmap v2335: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:31.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:30 smithi194 ceph-mon[65619]: pgmap v2335: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:33.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:32 smithi026 ceph-mon[96795]: pgmap v2336: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:33.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:32 smithi194 ceph-mon[65619]: pgmap v2336: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:35.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:34 smithi026 ceph-mon[96795]: pgmap v2337: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:35.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:34 smithi194 ceph-mon[65619]: pgmap v2337: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:37.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:36 smithi026 ceph-mon[96795]: pgmap v2338: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:37.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:36 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:12:37.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:36 smithi194 ceph-mon[65619]: pgmap v2338: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:37.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:36 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:12:38.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:37 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:12:38.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:37 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:12:39.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:38 smithi026 ceph-mon[96795]: pgmap v2339: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:39.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:38 smithi194 ceph-mon[65619]: pgmap v2339: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:41.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:40 smithi026 ceph-mon[96795]: pgmap v2340: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:41.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:40 smithi194 ceph-mon[65619]: pgmap v2340: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:43.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:42 smithi026 ceph-mon[96795]: pgmap v2341: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:43.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:42 smithi194 ceph-mon[65619]: pgmap v2341: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:45.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:44 smithi026 ceph-mon[96795]: pgmap v2342: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:45.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:44 smithi194 ceph-mon[65619]: pgmap v2342: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:47.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:46 smithi026 ceph-mon[96795]: pgmap v2343: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:47.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:46 smithi194 ceph-mon[65619]: pgmap v2343: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:49.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:48 smithi026 ceph-mon[96795]: pgmap v2344: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:49.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:12:49.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:12:49.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:48 smithi194 ceph-mon[65619]: pgmap v2344: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:49.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:12:49.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:12:51.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:50 smithi026 ceph-mon[96795]: pgmap v2345: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:51.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:50 smithi194 ceph-mon[65619]: pgmap v2345: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:52.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:51 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:12:52.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:51 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:12:53.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:52 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:12:53.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:52 smithi026 ceph-mon[96795]: pgmap v2346: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:53.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:52 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:12:53.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:52 smithi194 ceph-mon[65619]: pgmap v2346: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:55.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:54 smithi026 ceph-mon[96795]: pgmap v2347: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:55.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:54 smithi194 ceph-mon[65619]: pgmap v2347: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:55.636 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.637+0000 7f206ff79700 1 -- 172.21.15.26:0/264116661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20680f6860 msgr2=0x7f20680f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:12:55.636 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.637+0000 7f206ff79700 1 --2- 172.21.15.26:0/264116661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20680f6860 0x7f20680f6cc0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7f2058004660 tx=0x7f2058009b30).stop 2021-11-03T18:12:55.636 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.637+0000 7f206ff79700 1 -- 172.21.15.26:0/264116661 shutdown_connections 2021-11-03T18:12:55.636 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.637+0000 7f206ff79700 1 --2- 172.21.15.26:0/264116661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20680f6860 0x7f20680f6cc0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:55.637 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.637+0000 7f206ff79700 1 --2- 172.21.15.26:0/264116661 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20680f55c0 0x7f20680f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:55.637 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.637+0000 7f206ff79700 1 -- 172.21.15.26:0/264116661 >> 172.21.15.26:0/264116661 conn(0x7f20680f0d40 msgr2=0x7f20680f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:12:55.637 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.637+0000 7f206ff79700 1 -- 172.21.15.26:0/264116661 shutdown_connections 2021-11-03T18:12:55.637 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.637+0000 7f206ff79700 1 -- 172.21.15.26:0/264116661 wait complete. 2021-11-03T18:12:55.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.638+0000 7f206ff79700 1 Processor -- start 2021-11-03T18:12:55.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.638+0000 7f206ff79700 1 -- start start 2021-11-03T18:12:55.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.638+0000 7f206ff79700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20680f55c0 0x7f2068106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:12:55.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.638+0000 7f206ff79700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20680f6860 0x7f2068107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:12:55.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.638+0000 7f206ff79700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2068107a10 con 0x7f20680f55c0 2021-11-03T18:12:55.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.638+0000 7f206ff79700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2068107b50 con 0x7f20680f6860 2021-11-03T18:12:55.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.638+0000 7f206dd15700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20680f55c0 0x7f2068106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:12:55.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.638+0000 7f206dd15700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20680f55c0 0x7f2068106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58770/0 (socket says 172.21.15.26:58770) 2021-11-03T18:12:55.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.638+0000 7f206dd15700 1 -- 172.21.15.26:0/4147936542 learned_addr learned my addr 172.21.15.26:0/4147936542 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:12:55.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.638+0000 7f206d514700 1 --2- 172.21.15.26:0/4147936542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20680f6860 0x7f2068107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:12:55.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.638+0000 7f206dd15700 1 -- 172.21.15.26:0/4147936542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20680f6860 msgr2=0x7f2068107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:12:55.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.638+0000 7f206dd15700 1 --2- 172.21.15.26:0/4147936542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20680f6860 0x7f2068107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:55.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.638+0000 7f206dd15700 1 -- 172.21.15.26:0/4147936542 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2058005040 con 0x7f20680f55c0 2021-11-03T18:12:55.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.639+0000 7f206dd15700 1 --2- 172.21.15.26:0/4147936542 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20680f55c0 0x7f2068106f70 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7f206400c530 tx=0x7f2064007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:12:55.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.639+0000 7f205e7fc700 1 -- 172.21.15.26:0/4147936542 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f206400f650 con 0x7f20680f55c0 2021-11-03T18:12:55.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.639+0000 7f206ff79700 1 -- 172.21.15.26:0/4147936542 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20681084f0 con 0x7f20680f55c0 2021-11-03T18:12:55.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.639+0000 7f205e7fc700 1 -- 172.21.15.26:0/4147936542 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f206400fc60 con 0x7f20680f55c0 2021-11-03T18:12:55.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.639+0000 7f205e7fc700 1 -- 172.21.15.26:0/4147936542 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2064012d20 con 0x7f20680f55c0 2021-11-03T18:12:55.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.639+0000 7f206ff79700 1 -- 172.21.15.26:0/4147936542 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2068108ab0 con 0x7f20680f55c0 2021-11-03T18:12:55.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.640+0000 7f206ff79700 1 -- 172.21.15.26:0/4147936542 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2068045ad0 con 0x7f20680f55c0 2021-11-03T18:12:55.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.640+0000 7f205e7fc700 1 -- 172.21.15.26:0/4147936542 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f2064019030 con 0x7f20680f55c0 2021-11-03T18:12:55.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.641+0000 7f205e7fc700 1 --2- 172.21.15.26:0/4147936542 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f20540640b0 0x7f2054066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:12:55.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.641+0000 7f205e7fc700 1 -- 172.21.15.26:0/4147936542 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f2064080630 con 0x7f20680f55c0 2021-11-03T18:12:55.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.641+0000 7f206d514700 1 --2- 172.21.15.26:0/4147936542 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f20540640b0 0x7f2054066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:12:55.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.641+0000 7f206d514700 1 --2- 172.21.15.26:0/4147936542 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f20540640b0 0x7f2054066570 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f2058004e30 tx=0x7f2058009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:12:55.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.645+0000 7f205e7fc700 1 -- 172.21.15.26:0/4147936542 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f20640529b0 con 0x7f20680f55c0 2021-11-03T18:12:55.823 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.824+0000 7f206ff79700 1 -- 172.21.15.26:0/4147936542 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f206805fd30 con 0x7f20540640b0 2021-11-03T18:12:55.823 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.825+0000 7f205e7fc700 1 -- 172.21.15.26:0/4147936542 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f206805fd30 con 0x7f20540640b0 2021-11-03T18:12:55.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.827+0000 7f206ff79700 1 -- 172.21.15.26:0/4147936542 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f20540640b0 msgr2=0x7f2054066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:12:55.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.827+0000 7f206ff79700 1 --2- 172.21.15.26:0/4147936542 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f20540640b0 0x7f2054066570 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f2058004e30 tx=0x7f2058009b30).stop 2021-11-03T18:12:55.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.827+0000 7f206ff79700 1 -- 172.21.15.26:0/4147936542 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20680f55c0 msgr2=0x7f2068106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:12:55.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.827+0000 7f206ff79700 1 --2- 172.21.15.26:0/4147936542 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20680f55c0 0x7f2068106f70 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7f206400c530 tx=0x7f2064007e10).stop 2021-11-03T18:12:55.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.827+0000 7f206ff79700 1 -- 172.21.15.26:0/4147936542 shutdown_connections 2021-11-03T18:12:55.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.827+0000 7f206ff79700 1 --2- 172.21.15.26:0/4147936542 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f20540640b0 0x7f2054066570 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:55.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.827+0000 7f206ff79700 1 --2- 172.21.15.26:0/4147936542 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20680f55c0 0x7f2068106f70 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:55.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.827+0000 7f206ff79700 1 --2- 172.21.15.26:0/4147936542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20680f6860 0x7f2068107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:55.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.827+0000 7f206ff79700 1 -- 172.21.15.26:0/4147936542 >> 172.21.15.26:0/4147936542 conn(0x7f20680f0d40 msgr2=0x7f206805f620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:12:55.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.827+0000 7f206ff79700 1 -- 172.21.15.26:0/4147936542 shutdown_connections 2021-11-03T18:12:55.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.827+0000 7f206ff79700 1 -- 172.21.15.26:0/4147936542 wait complete. 2021-11-03T18:12:55.835 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:12:55.928 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.927+0000 7f647a0f9700 1 -- 172.21.15.26:0/2046564390 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64740f6530 msgr2=0x7f64740f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:12:55.928 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.927+0000 7f647a0f9700 1 --2- 172.21.15.26:0/2046564390 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64740f6530 0x7f64740f6950 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 rx=0x7f646c0099e0 tx=0x7f646c004d10).stop 2021-11-03T18:12:55.929 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.927+0000 7f647a0f9700 1 -- 172.21.15.26:0/2046564390 shutdown_connections 2021-11-03T18:12:55.929 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.927+0000 7f647a0f9700 1 --2- 172.21.15.26:0/2046564390 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64740f77d0 0x7f64740f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:55.929 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.927+0000 7f647a0f9700 1 --2- 172.21.15.26:0/2046564390 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64740f6530 0x7f64740f6950 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:55.929 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.927+0000 7f647a0f9700 1 -- 172.21.15.26:0/2046564390 >> 172.21.15.26:0/2046564390 conn(0x7f64740f1cd0 msgr2=0x7f64740f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:12:55.930 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.928+0000 7f647a0f9700 1 -- 172.21.15.26:0/2046564390 shutdown_connections 2021-11-03T18:12:55.930 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.928+0000 7f647a0f9700 1 -- 172.21.15.26:0/2046564390 wait complete. 2021-11-03T18:12:55.930 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.928+0000 7f647a0f9700 1 Processor -- start 2021-11-03T18:12:55.931 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.928+0000 7f647a0f9700 1 -- start start 2021-11-03T18:12:55.931 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.928+0000 7f647a0f9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64740f6530 0x7f647406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:12:55.931 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.928+0000 7f647a0f9700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64740f77d0 0x7f6474069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:12:55.931 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.928+0000 7f647a0f9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647406a380 con 0x7f64740f6530 2021-11-03T18:12:55.931 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.928+0000 7f647a0f9700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647406a4c0 con 0x7f64740f77d0 2021-11-03T18:12:55.932 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.928+0000 7f64790f7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64740f6530 0x7f647406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:12:55.932 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.928+0000 7f64790f7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64740f6530 0x7f647406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58780/0 (socket says 172.21.15.26:58780) 2021-11-03T18:12:55.932 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.928+0000 7f64790f7700 1 -- 172.21.15.26:0/1691529834 learned_addr learned my addr 172.21.15.26:0/1691529834 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:12:55.932 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.929+0000 7f64788f6700 1 --2- 172.21.15.26:0/1691529834 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64740f77d0 0x7f6474069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:12:55.933 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.929+0000 7f64790f7700 1 -- 172.21.15.26:0/1691529834 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64740f77d0 msgr2=0x7f6474069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:12:55.933 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.929+0000 7f64790f7700 1 --2- 172.21.15.26:0/1691529834 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64740f77d0 0x7f6474069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:55.933 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.929+0000 7f64790f7700 1 -- 172.21.15.26:0/1691529834 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646c009640 con 0x7f64740f6530 2021-11-03T18:12:55.933 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.929+0000 7f64788f6700 1 --2- 172.21.15.26:0/1691529834 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64740f77d0 0x7f6474069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:12:55.933 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.929+0000 7f64790f7700 1 --2- 172.21.15.26:0/1691529834 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64740f6530 0x7f647406b9a0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 rx=0x7f646c00c010 tx=0x7f646c004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:12:55.934 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.929+0000 7f6469ffb700 1 -- 172.21.15.26:0/1691529834 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f646c00e070 con 0x7f64740f6530 2021-11-03T18:12:55.934 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.929+0000 7f6469ffb700 1 -- 172.21.15.26:0/1691529834 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f646c007dc0 con 0x7f64740f6530 2021-11-03T18:12:55.934 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.929+0000 7f647a0f9700 1 -- 172.21.15.26:0/1691529834 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f647406a740 con 0x7f64740f6530 2021-11-03T18:12:55.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.929+0000 7f6469ffb700 1 -- 172.21.15.26:0/1691529834 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f646c018070 con 0x7f64740f6530 2021-11-03T18:12:55.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.929+0000 7f647a0f9700 1 -- 172.21.15.26:0/1691529834 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f647406ac20 con 0x7f64740f6530 2021-11-03T18:12:55.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.930+0000 7f647a0f9700 1 -- 172.21.15.26:0/1691529834 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6474045ad0 con 0x7f64740f6530 2021-11-03T18:12:55.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.931+0000 7f6469ffb700 1 -- 172.21.15.26:0/1691529834 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f646c024060 con 0x7f64740f6530 2021-11-03T18:12:55.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.931+0000 7f6469ffb700 1 --2- 172.21.15.26:0/1691529834 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6460064100 0x7f64600665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:12:55.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.931+0000 7f6469ffb700 1 -- 172.21.15.26:0/1691529834 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f646c0820d0 con 0x7f64740f6530 2021-11-03T18:12:55.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.931+0000 7f64788f6700 1 --2- 172.21.15.26:0/1691529834 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6460064100 0x7f64600665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:12:55.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.931+0000 7f64788f6700 1 --2- 172.21.15.26:0/1691529834 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6460064100 0x7f64600665c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f6464009780 tx=0x7f6464009c80).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:12:55.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:55.935+0000 7f6469ffb700 1 -- 172.21.15.26:0/1691529834 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f646c054430 con 0x7f64740f6530 2021-11-03T18:12:56.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.106+0000 7f647a0f9700 1 -- 172.21.15.26:0/1691529834 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f64740008d0 con 0x7f6460064100 2021-11-03T18:12:56.119 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.121+0000 7f6469ffb700 1 -- 172.21.15.26:0/1691529834 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f64740008d0 con 0x7f6460064100 2021-11-03T18:12:56.119 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:12:56.120 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (84m) 2m ago 85m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:12:56.120 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (76m) 2m ago 85m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:12:56.120 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (76m) 110s ago 84m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:12:56.120 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (83m) 2m ago 85m 42.0M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:12:56.121 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (77m) 2m ago 80m 25.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:12:56.121 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (77m) 2m ago 80m 26.4M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:12:56.121 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (80m) 110s ago 80m 26.6M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:12:56.121 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (80m) 110s ago 80m 27.0M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:12:56.122 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (77m) 2m ago 86m 574M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:12:56.122 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (77m) 110s ago 84m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:12:56.122 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (77m) 2m ago 86m 308M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:12:56.122 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (76m) 110s ago 84m 145M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:12:56.122 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (85m) 2m ago 85m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:12:56.123 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (84m) 110s ago 84m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:12:56.123 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (75m) 2m ago 83m 312M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:12:56.123 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (75m) 2m ago 83m 335M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:12:56.123 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (74m) 2m ago 83m 279M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:12:56.124 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (74m) 110s ago 82m 362M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:12:56.124 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (74m) 110s ago 82m 302M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:12:56.124 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (73m) 110s ago 82m 296M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:12:56.124 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (83m) 2m ago 84m 63.4M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:12:56.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.122+0000 7f647a0f9700 1 -- 172.21.15.26:0/1691529834 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6460064100 msgr2=0x7f64600665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:12:56.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.122+0000 7f647a0f9700 1 --2- 172.21.15.26:0/1691529834 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6460064100 0x7f64600665c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f6464009780 tx=0x7f6464009c80).stop 2021-11-03T18:12:56.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.122+0000 7f647a0f9700 1 -- 172.21.15.26:0/1691529834 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64740f6530 msgr2=0x7f647406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:12:56.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.122+0000 7f647a0f9700 1 --2- 172.21.15.26:0/1691529834 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64740f6530 0x7f647406b9a0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 rx=0x7f646c00c010 tx=0x7f646c004d10).stop 2021-11-03T18:12:56.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.122+0000 7f647a0f9700 1 -- 172.21.15.26:0/1691529834 shutdown_connections 2021-11-03T18:12:56.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.122+0000 7f647a0f9700 1 --2- 172.21.15.26:0/1691529834 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6460064100 0x7f64600665c0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:56.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.122+0000 7f647a0f9700 1 --2- 172.21.15.26:0/1691529834 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64740f6530 0x7f647406b9a0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:56.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.122+0000 7f647a0f9700 1 --2- 172.21.15.26:0/1691529834 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64740f77d0 0x7f6474069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:56.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.122+0000 7f647a0f9700 1 -- 172.21.15.26:0/1691529834 >> 172.21.15.26:0/1691529834 conn(0x7f64740f1cd0 msgr2=0x7f64740fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:12:56.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.123+0000 7f647a0f9700 1 -- 172.21.15.26:0/1691529834 shutdown_connections 2021-11-03T18:12:56.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.123+0000 7f647a0f9700 1 -- 172.21.15.26:0/1691529834 wait complete. 2021-11-03T18:12:56.222 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.222+0000 7f9a3f656700 1 -- 172.21.15.26:0/3326826244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a380f55e0 msgr2=0x7f9a380f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:12:56.223 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.222+0000 7f9a3f656700 1 --2- 172.21.15.26:0/3326826244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a380f55e0 0x7f9a380f5a00 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7f9a300099e0 tx=0x7f9a30004d10).stop 2021-11-03T18:12:56.223 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.222+0000 7f9a3f656700 1 -- 172.21.15.26:0/3326826244 shutdown_connections 2021-11-03T18:12:56.223 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.222+0000 7f9a3f656700 1 --2- 172.21.15.26:0/3326826244 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a380f5ef0 0x7f9a380f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:56.224 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.222+0000 7f9a3f656700 1 --2- 172.21.15.26:0/3326826244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a380f55e0 0x7f9a380f5a00 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:56.224 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.222+0000 7f9a3f656700 1 -- 172.21.15.26:0/3326826244 >> 172.21.15.26:0/3326826244 conn(0x7f9a380f0de0 msgr2=0x7f9a380f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:12:56.224 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.222+0000 7f9a3f656700 1 -- 172.21.15.26:0/3326826244 shutdown_connections 2021-11-03T18:12:56.224 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.222+0000 7f9a3f656700 1 -- 172.21.15.26:0/3326826244 wait complete. 2021-11-03T18:12:56.224 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.223+0000 7f9a3f656700 1 Processor -- start 2021-11-03T18:12:56.225 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.223+0000 7f9a3f656700 1 -- start start 2021-11-03T18:12:56.225 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.223+0000 7f9a3f656700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a380f55e0 0x7f9a38109d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:12:56.225 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.223+0000 7f9a3f656700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a380f5ef0 0x7f9a3810c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:12:56.225 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.223+0000 7f9a3f656700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a380604c0 con 0x7f9a380f55e0 2021-11-03T18:12:56.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.223+0000 7f9a3f656700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a38060600 con 0x7f9a380f5ef0 2021-11-03T18:12:56.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.223+0000 7f9a3d3f2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a380f55e0 0x7f9a38109d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:12:56.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.223+0000 7f9a3d3f2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a380f55e0 0x7f9a38109d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58790/0 (socket says 172.21.15.26:58790) 2021-11-03T18:12:56.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.223+0000 7f9a3d3f2700 1 -- 172.21.15.26:0/504904035 learned_addr learned my addr 172.21.15.26:0/504904035 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:12:56.227 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.223+0000 7f9a3cbf1700 1 --2- 172.21.15.26:0/504904035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a380f5ef0 0x7f9a3810c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:12:56.227 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.223+0000 7f9a3d3f2700 1 -- 172.21.15.26:0/504904035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a380f5ef0 msgr2=0x7f9a3810c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:12:56.227 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.223+0000 7f9a3d3f2700 1 --2- 172.21.15.26:0/504904035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a380f5ef0 0x7f9a3810c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:56.227 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.223+0000 7f9a3d3f2700 1 -- 172.21.15.26:0/504904035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a30009640 con 0x7f9a380f55e0 2021-11-03T18:12:56.227 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.223+0000 7f9a3cbf1700 1 --2- 172.21.15.26:0/504904035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a380f5ef0 0x7f9a3810c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:12:56.228 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.223+0000 7f9a3d3f2700 1 --2- 172.21.15.26:0/504904035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a380f55e0 0x7f9a38109d80 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 rx=0x7f9a30003380 tx=0x7f9a30004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:12:56.228 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.224+0000 7f9a35ffb700 1 -- 172.21.15.26:0/504904035 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a3000e070 con 0x7f9a380f55e0 2021-11-03T18:12:56.228 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.224+0000 7f9a35ffb700 1 -- 172.21.15.26:0/504904035 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9a30007dc0 con 0x7f9a380f55e0 2021-11-03T18:12:56.228 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.224+0000 7f9a3f656700 1 -- 172.21.15.26:0/504904035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a3810c7d0 con 0x7f9a380f55e0 2021-11-03T18:12:56.229 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.224+0000 7f9a35ffb700 1 -- 172.21.15.26:0/504904035 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a30018070 con 0x7f9a380f55e0 2021-11-03T18:12:56.229 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.224+0000 7f9a3f656700 1 -- 172.21.15.26:0/504904035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a3810cd00 con 0x7f9a380f55e0 2021-11-03T18:12:56.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.225+0000 7f9a3f656700 1 -- 172.21.15.26:0/504904035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a380f4a70 con 0x7f9a380f55e0 2021-11-03T18:12:56.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.225+0000 7f9a35ffb700 1 -- 172.21.15.26:0/504904035 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f9a300139d0 con 0x7f9a380f55e0 2021-11-03T18:12:56.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.226+0000 7f9a35ffb700 1 --2- 172.21.15.26:0/504904035 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9a200640b0 0x7f9a20066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:12:56.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.226+0000 7f9a35ffb700 1 -- 172.21.15.26:0/504904035 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f9a300820e0 con 0x7f9a380f55e0 2021-11-03T18:12:56.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.226+0000 7f9a3cbf1700 1 --2- 172.21.15.26:0/504904035 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9a200640b0 0x7f9a20066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:12:56.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.226+0000 7f9a3cbf1700 1 --2- 172.21.15.26:0/504904035 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9a200640b0 0x7f9a20066570 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f9a2c007fc0 tx=0x7f9a2c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:12:56.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.230+0000 7f9a35ffb700 1 -- 172.21.15.26:0/504904035 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f9a30054440 con 0x7f9a380f55e0 2021-11-03T18:12:56.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.460+0000 7f9a3f656700 1 -- 172.21.15.26:0/504904035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9a38045ad0 con 0x7f9a380f55e0 2021-11-03T18:12:56.502 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.460+0000 7f9a35ffb700 1 -- 172.21.15.26:0/504904035 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f9a30054030 con 0x7f9a380f55e0 2021-11-03T18:12:56.503 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:12:56.503 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:12:56.504 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:12:56.504 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:12:56.505 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:12:56.506 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:12:56.507 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:12:56.507 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:12:56.508 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:12:56.509 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:12:56.509 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:12:56.509 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:12:56.510 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:12:56.511 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:12:56.512 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:12:56.512 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:12:56.512 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:12:56.513 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:12:56.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.462+0000 7f9a3f656700 1 -- 172.21.15.26:0/504904035 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9a200640b0 msgr2=0x7f9a20066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:12:56.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.462+0000 7f9a3f656700 1 --2- 172.21.15.26:0/504904035 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9a200640b0 0x7f9a20066570 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f9a2c007fc0 tx=0x7f9a2c00b040).stop 2021-11-03T18:12:56.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.462+0000 7f9a3f656700 1 -- 172.21.15.26:0/504904035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a380f55e0 msgr2=0x7f9a38109d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:12:56.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.462+0000 7f9a3f656700 1 --2- 172.21.15.26:0/504904035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a380f55e0 0x7f9a38109d80 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 rx=0x7f9a30003380 tx=0x7f9a30004d10).stop 2021-11-03T18:12:56.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.462+0000 7f9a3f656700 1 -- 172.21.15.26:0/504904035 shutdown_connections 2021-11-03T18:12:56.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.462+0000 7f9a3f656700 1 --2- 172.21.15.26:0/504904035 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9a200640b0 0x7f9a20066570 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:56.517 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.462+0000 7f9a3f656700 1 --2- 172.21.15.26:0/504904035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a380f55e0 0x7f9a38109d80 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:56.517 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.462+0000 7f9a3f656700 1 --2- 172.21.15.26:0/504904035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a380f5ef0 0x7f9a3810c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:56.517 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.462+0000 7f9a3f656700 1 -- 172.21.15.26:0/504904035 >> 172.21.15.26:0/504904035 conn(0x7f9a380f0de0 msgr2=0x7f9a380fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:12:56.518 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.462+0000 7f9a3f656700 1 -- 172.21.15.26:0/504904035 shutdown_connections 2021-11-03T18:12:56.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.462+0000 7f9a3f656700 1 -- 172.21.15.26:0/504904035 wait complete. 2021-11-03T18:12:56.562 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.562+0000 7fae17857700 1 -- 172.21.15.26:0/3778288549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae100f7dc0 msgr2=0x7fae100f81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:12:56.563 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.562+0000 7fae17857700 1 --2- 172.21.15.26:0/3778288549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae100f7dc0 0x7fae100f81e0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7fae00004660 tx=0x7fae00009b30).stop 2021-11-03T18:12:56.563 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.562+0000 7fae17857700 1 -- 172.21.15.26:0/3778288549 shutdown_connections 2021-11-03T18:12:56.563 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.562+0000 7fae17857700 1 --2- 172.21.15.26:0/3778288549 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae100f86d0 0x7fae100f48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:56.563 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.562+0000 7fae17857700 1 --2- 172.21.15.26:0/3778288549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae100f7dc0 0x7fae100f81e0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:56.564 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.562+0000 7fae17857700 1 -- 172.21.15.26:0/3778288549 >> 172.21.15.26:0/3778288549 conn(0x7fae100f0540 msgr2=0x7fae100f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:12:56.564 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.562+0000 7fae17857700 1 -- 172.21.15.26:0/3778288549 shutdown_connections 2021-11-03T18:12:56.564 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.562+0000 7fae17857700 1 -- 172.21.15.26:0/3778288549 wait complete. 2021-11-03T18:12:56.564 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.563+0000 7fae17857700 1 Processor -- start 2021-11-03T18:12:56.564 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.563+0000 7fae17857700 1 -- start start 2021-11-03T18:12:56.565 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.563+0000 7fae17857700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae100f7dc0 0x7fae10106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:12:56.565 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.563+0000 7fae17857700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae100f86d0 0x7fae10107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:12:56.565 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.563+0000 7fae17857700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae10107a10 con 0x7fae100f86d0 2021-11-03T18:12:56.565 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.563+0000 7fae17857700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae10107b50 con 0x7fae100f7dc0 2021-11-03T18:12:56.566 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.563+0000 7fae14df2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae100f86d0 0x7fae10107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:12:56.566 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.563+0000 7fae14df2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae100f86d0 0x7fae10107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58802/0 (socket says 172.21.15.26:58802) 2021-11-03T18:12:56.566 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.563+0000 7fae14df2700 1 -- 172.21.15.26:0/265670219 learned_addr learned my addr 172.21.15.26:0/265670219 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:12:56.566 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.563+0000 7fae155f3700 1 --2- 172.21.15.26:0/265670219 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae100f7dc0 0x7fae10106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:12:56.566 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.563+0000 7fae14df2700 1 -- 172.21.15.26:0/265670219 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae100f7dc0 msgr2=0x7fae10106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:12:56.567 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.563+0000 7fae14df2700 1 --2- 172.21.15.26:0/265670219 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae100f7dc0 0x7fae10106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:56.567 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.563+0000 7fae14df2700 1 -- 172.21.15.26:0/265670219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae00005040 con 0x7fae100f86d0 2021-11-03T18:12:56.567 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.563+0000 7fae14df2700 1 --2- 172.21.15.26:0/265670219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae100f86d0 0x7fae10107460 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 rx=0x7fae0c00c530 tx=0x7fae0c007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:12:56.567 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.563+0000 7fae05ffb700 1 -- 172.21.15.26:0/265670219 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae0c00f650 con 0x7fae100f86d0 2021-11-03T18:12:56.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.564+0000 7fae05ffb700 1 -- 172.21.15.26:0/265670219 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fae0c00fc60 con 0x7fae100f86d0 2021-11-03T18:12:56.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.564+0000 7fae17857700 1 -- 172.21.15.26:0/265670219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae101084f0 con 0x7fae100f86d0 2021-11-03T18:12:56.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.564+0000 7fae05ffb700 1 -- 172.21.15.26:0/265670219 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae0c012c20 con 0x7fae100f86d0 2021-11-03T18:12:56.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.564+0000 7fae17857700 1 -- 172.21.15.26:0/265670219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae10108ab0 con 0x7fae100f86d0 2021-11-03T18:12:56.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.565+0000 7fae17857700 1 -- 172.21.15.26:0/265670219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae10045ad0 con 0x7fae100f86d0 2021-11-03T18:12:56.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.565+0000 7fae05ffb700 1 -- 172.21.15.26:0/265670219 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fae0c010070 con 0x7fae100f86d0 2021-11-03T18:12:56.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.565+0000 7fae05ffb700 1 --2- 172.21.15.26:0/265670219 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fadfc064090 0x7fadfc066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:12:56.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.565+0000 7fae05ffb700 1 -- 172.21.15.26:0/265670219 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fae0c080550 con 0x7fae100f86d0 2021-11-03T18:12:56.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.566+0000 7fae155f3700 1 --2- 172.21.15.26:0/265670219 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fadfc064090 0x7fadfc066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:12:56.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.566+0000 7fae155f3700 1 --2- 172.21.15.26:0/265670219 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fadfc064090 0x7fadfc066550 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7fae00004e30 tx=0x7fae00009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:12:56.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.569+0000 7fae05ffb700 1 -- 172.21.15.26:0/265670219 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fae0c0527c0 con 0x7fae100f86d0 2021-11-03T18:12:56.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.772+0000 7fae17857700 1 -- 172.21.15.26:0/265670219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fae10027a00 con 0x7fae100f86d0 2021-11-03T18:12:56.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.773+0000 7fae05ffb700 1 -- 172.21.15.26:0/265670219 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fae0c0523b0 con 0x7fae100f86d0 2021-11-03T18:12:56.773 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:12:56.773 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:12:56.774 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:12:56.774 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:12:56.775 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:12:56.775 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:12:56.775 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:12:56.776 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:12:56.776 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:12:56.777 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:12:56.777 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:12:56.778 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:12:56.778 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:12:56.779 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:12:56.779 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:12:56.779 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:12:56.780 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:12:56.780 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:12:56.781 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:12:56.781 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:12:56.782 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:12:56.782 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:12:56.782 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:12:56.783 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:12:56.783 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:12:56.784 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:12:56.784 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:12:56.785 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:12:56.785 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:12:56.785 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:12:56.786 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:12:56.786 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:12:56.787 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:12:56.787 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:12:56.788 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:12:56.788 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:12:56.788 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:12:56.789 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:12:56.789 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:12:56.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.774+0000 7fae17857700 1 -- 172.21.15.26:0/265670219 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fadfc064090 msgr2=0x7fadfc066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:12:56.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.774+0000 7fae17857700 1 --2- 172.21.15.26:0/265670219 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fadfc064090 0x7fadfc066550 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7fae00004e30 tx=0x7fae00009b30).stop 2021-11-03T18:12:56.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.774+0000 7fae17857700 1 -- 172.21.15.26:0/265670219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae100f86d0 msgr2=0x7fae10107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:12:56.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.774+0000 7fae17857700 1 --2- 172.21.15.26:0/265670219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae100f86d0 0x7fae10107460 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 rx=0x7fae0c00c530 tx=0x7fae0c007e20).stop 2021-11-03T18:12:56.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.775+0000 7fae17857700 1 -- 172.21.15.26:0/265670219 shutdown_connections 2021-11-03T18:12:56.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.775+0000 7fae17857700 1 --2- 172.21.15.26:0/265670219 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fadfc064090 0x7fadfc066550 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:56.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.775+0000 7fae17857700 1 --2- 172.21.15.26:0/265670219 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae100f7dc0 0x7fae10106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:56.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.775+0000 7fae17857700 1 --2- 172.21.15.26:0/265670219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae100f86d0 0x7fae10107460 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:12:56.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.775+0000 7fae17857700 1 -- 172.21.15.26:0/265670219 >> 172.21.15.26:0/265670219 conn(0x7fae100f0540 msgr2=0x7fae100fb650 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:12:56.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.775+0000 7fae17857700 1 -- 172.21.15.26:0/265670219 shutdown_connections 2021-11-03T18:12:56.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:12:56.775+0000 7fae17857700 1 -- 172.21.15.26:0/265670219 wait complete. 2021-11-03T18:12:56.796 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:12:57.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:56 smithi026 ceph-mon[96795]: pgmap v2348: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:57.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:56 smithi026 ceph-mon[96795]: from='client.36556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:12:57.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:56 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/504904035' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:12:57.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:56 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/265670219' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:12:57.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:56 smithi194 ceph-mon[65619]: pgmap v2348: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:57.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:56 smithi194 ceph-mon[65619]: from='client.36556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:12:57.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:56 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/504904035' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:12:57.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:56 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/265670219' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:12:58.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:57 smithi026 ceph-mon[96795]: from='client.36560 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:12:58.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:57 smithi194 ceph-mon[65619]: from='client.36560 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:12:59.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:12:58 smithi026 ceph-mon[96795]: pgmap v2349: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:12:59.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:12:58 smithi194 ceph-mon[65619]: pgmap v2349: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:01.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:00 smithi026 ceph-mon[96795]: pgmap v2350: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:01.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:00 smithi194 ceph-mon[65619]: pgmap v2350: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:03.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:02 smithi026 ceph-mon[96795]: pgmap v2351: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:03.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:02 smithi194 ceph-mon[65619]: pgmap v2351: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:05.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:04 smithi026 ceph-mon[96795]: pgmap v2352: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:05.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:04 smithi194 ceph-mon[65619]: pgmap v2352: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:07.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:06 smithi026 ceph-mon[96795]: pgmap v2353: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:07.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:06 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:13:07.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:06 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:13:07.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:06 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:13:07.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:06 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:13:07.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:06 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:13:07.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:06 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:13:07.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:06 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:13:07.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:06 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:13:07.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:06 smithi194 ceph-mon[65619]: pgmap v2353: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:07.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:06 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:13:07.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:06 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:13:07.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:06 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:13:07.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:06 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:13:07.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:06 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:13:07.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:06 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:13:07.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:06 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:13:07.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:06 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:13:08.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:07 smithi026 ceph-mon[96795]: poll took 60071.551 ms: 1 events 2021-11-03T18:13:08.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:07 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:13:08.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:07 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:13:08.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:07 smithi194 ceph-mon[65619]: poll took 60071.551 ms: 1 events 2021-11-03T18:13:08.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:07 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:13:08.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:07 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:13:09.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:08 smithi026 ceph-mon[96795]: pgmap v2354: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:09.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:08 smithi194 ceph-mon[65619]: pgmap v2354: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:11.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:10 smithi026 ceph-mon[96795]: pgmap v2355: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:11.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:10 smithi194 ceph-mon[65619]: pgmap v2355: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:13.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:12 smithi026 ceph-mon[96795]: pgmap v2356: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:13.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:12 smithi194 ceph-mon[65619]: pgmap v2356: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:15.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:14 smithi026 ceph-mon[96795]: pgmap v2357: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:15.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:14 smithi194 ceph-mon[65619]: pgmap v2357: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:17.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:16 smithi026 ceph-mon[96795]: pgmap v2358: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:17.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:16 smithi194 ceph-mon[65619]: pgmap v2358: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:19.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:18 smithi026 ceph-mon[96795]: pgmap v2359: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:19.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:18 smithi194 ceph-mon[65619]: pgmap v2359: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:21.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:20 smithi026 ceph-mon[96795]: pgmap v2360: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:21.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:20 smithi194 ceph-mon[65619]: pgmap v2360: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:22.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:21 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:13:22.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:21 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:13:23.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:22 smithi026 ceph-mon[96795]: pgmap v2361: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:23.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:22 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:13:23.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:22 smithi194 ceph-mon[65619]: pgmap v2361: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:23.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:22 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:13:25.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:24 smithi026 ceph-mon[96795]: pgmap v2362: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:25.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:24 smithi194 ceph-mon[65619]: pgmap v2362: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:26.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:26.891+0000 7f1355887700 1 -- 172.21.15.26:0/3718843711 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13500f55c0 msgr2=0x7f13500f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:13:26.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:26.891+0000 7f1355887700 1 --2- 172.21.15.26:0/3718843711 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13500f55c0 0x7f13500f59e0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 rx=0x7f1348004660 tx=0x7f1348009b30).stop 2021-11-03T18:13:26.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:26.891+0000 7f1355887700 1 -- 172.21.15.26:0/3718843711 shutdown_connections 2021-11-03T18:13:26.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:26.891+0000 7f1355887700 1 --2- 172.21.15.26:0/3718843711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13500f6860 0x7f13500f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:26.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:26.891+0000 7f1355887700 1 --2- 172.21.15.26:0/3718843711 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13500f55c0 0x7f13500f59e0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:26.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:26.891+0000 7f1355887700 1 -- 172.21.15.26:0/3718843711 >> 172.21.15.26:0/3718843711 conn(0x7f13500f0d40 msgr2=0x7f13500f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:13:26.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:26.891+0000 7f1355887700 1 -- 172.21.15.26:0/3718843711 shutdown_connections 2021-11-03T18:13:26.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:26.891+0000 7f1355887700 1 -- 172.21.15.26:0/3718843711 wait complete. 2021-11-03T18:13:26.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:26.892+0000 7f1355887700 1 Processor -- start 2021-11-03T18:13:26.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:26.892+0000 7f1355887700 1 -- start start 2021-11-03T18:13:26.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:26.892+0000 7f1355887700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13500f55c0 0x7f1350106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:13:26.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:26.892+0000 7f1355887700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13500f6860 0x7f1350107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:13:26.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:26.892+0000 7f1355887700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1350107a10 con 0x7f13500f55c0 2021-11-03T18:13:26.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:26.892+0000 7f1355887700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1350107b50 con 0x7f13500f6860 2021-11-03T18:13:26.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:26.892+0000 7f134effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13500f55c0 0x7f1350106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:13:26.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:26.892+0000 7f134effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13500f55c0 0x7f1350106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58818/0 (socket says 172.21.15.26:58818) 2021-11-03T18:13:26.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:26.892+0000 7f134effd700 1 -- 172.21.15.26:0/313576576 learned_addr learned my addr 172.21.15.26:0/313576576 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:13:26.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:26.893+0000 7f134e7fc700 1 --2- 172.21.15.26:0/313576576 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13500f6860 0x7f1350107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:13:26.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:26.893+0000 7f134effd700 1 -- 172.21.15.26:0/313576576 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13500f6860 msgr2=0x7f1350107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:13:26.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:26.893+0000 7f134effd700 1 --2- 172.21.15.26:0/313576576 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13500f6860 0x7f1350107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:26.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:26.893+0000 7f134effd700 1 -- 172.21.15.26:0/313576576 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1348005040 con 0x7f13500f55c0 2021-11-03T18:13:26.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:26.893+0000 7f134effd700 1 --2- 172.21.15.26:0/313576576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13500f55c0 0x7f1350106f70 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 rx=0x7f1348013a70 tx=0x7f1348009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:13:26.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:26.893+0000 7f13477fe700 1 -- 172.21.15.26:0/313576576 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1348018070 con 0x7f13500f55c0 2021-11-03T18:13:26.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:26.893+0000 7f13477fe700 1 -- 172.21.15.26:0/313576576 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f13480097d0 con 0x7f13500f55c0 2021-11-03T18:13:26.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:26.893+0000 7f1355887700 1 -- 172.21.15.26:0/313576576 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1350108490 con 0x7f13500f55c0 2021-11-03T18:13:26.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:26.893+0000 7f13477fe700 1 -- 172.21.15.26:0/313576576 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f134801de80 con 0x7f13500f55c0 2021-11-03T18:13:26.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:26.893+0000 7f1355887700 1 -- 172.21.15.26:0/313576576 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13501089f0 con 0x7f13500f55c0 2021-11-03T18:13:26.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:26.894+0000 7f1355887700 1 -- 172.21.15.26:0/313576576 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1350045ad0 con 0x7f13500f55c0 2021-11-03T18:13:26.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:26.895+0000 7f13477fe700 1 -- 172.21.15.26:0/313576576 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f1348007ba0 con 0x7f13500f55c0 2021-11-03T18:13:26.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:26.895+0000 7f13477fe700 1 --2- 172.21.15.26:0/313576576 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f133c0640b0 0x7f133c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:13:26.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:26.895+0000 7f13477fe700 1 -- 172.21.15.26:0/313576576 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f13480823d0 con 0x7f13500f55c0 2021-11-03T18:13:26.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:26.895+0000 7f134e7fc700 1 --2- 172.21.15.26:0/313576576 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f133c0640b0 0x7f133c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:13:26.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:26.895+0000 7f134e7fc700 1 --2- 172.21.15.26:0/313576576 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f133c0640b0 0x7f133c066570 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7f1338004c40 tx=0x7f133800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:13:26.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:26.899+0000 7f13477fe700 1 -- 172.21.15.26:0/313576576 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f13480547f0 con 0x7f13500f55c0 2021-11-03T18:13:27.078 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.080+0000 7f1355887700 1 -- 172.21.15.26:0/313576576 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f13500ff000 con 0x7f133c0640b0 2021-11-03T18:13:27.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.082+0000 7f13477fe700 1 -- 172.21.15.26:0/313576576 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f13500ff000 con 0x7f133c0640b0 2021-11-03T18:13:27.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.083+0000 7f1355887700 1 -- 172.21.15.26:0/313576576 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f133c0640b0 msgr2=0x7f133c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:13:27.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.083+0000 7f1355887700 1 --2- 172.21.15.26:0/313576576 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f133c0640b0 0x7f133c066570 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7f1338004c40 tx=0x7f133800b040).stop 2021-11-03T18:13:27.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.083+0000 7f1355887700 1 -- 172.21.15.26:0/313576576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13500f55c0 msgr2=0x7f1350106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:13:27.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.083+0000 7f1355887700 1 --2- 172.21.15.26:0/313576576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13500f55c0 0x7f1350106f70 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 rx=0x7f1348013a70 tx=0x7f1348009b30).stop 2021-11-03T18:13:27.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.083+0000 7f1355887700 1 -- 172.21.15.26:0/313576576 shutdown_connections 2021-11-03T18:13:27.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.083+0000 7f1355887700 1 --2- 172.21.15.26:0/313576576 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f133c0640b0 0x7f133c066570 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:27.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.083+0000 7f1355887700 1 --2- 172.21.15.26:0/313576576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13500f55c0 0x7f1350106f70 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:27.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.083+0000 7f1355887700 1 --2- 172.21.15.26:0/313576576 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13500f6860 0x7f1350107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:27.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.083+0000 7f1355887700 1 -- 172.21.15.26:0/313576576 >> 172.21.15.26:0/313576576 conn(0x7f13500f0d40 msgr2=0x7f13500fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:13:27.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.083+0000 7f1355887700 1 -- 172.21.15.26:0/313576576 shutdown_connections 2021-11-03T18:13:27.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.083+0000 7f1355887700 1 -- 172.21.15.26:0/313576576 wait complete. 2021-11-03T18:13:27.095 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:13:27.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:26 smithi026 ceph-mon[96795]: pgmap v2363: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:27.181 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.184+0000 7f8c044a9700 1 -- 172.21.15.26:0/3456621719 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bfc0f7980 msgr2=0x7f8bfc0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:13:27.182 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.184+0000 7f8c044a9700 1 --2- 172.21.15.26:0/3456621719 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bfc0f7980 0x7f8bfc0f7de0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 rx=0x7f8bf8004660 tx=0x7f8bf8009b30).stop 2021-11-03T18:13:27.182 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.184+0000 7f8c044a9700 1 -- 172.21.15.26:0/3456621719 shutdown_connections 2021-11-03T18:13:27.182 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.184+0000 7f8c044a9700 1 --2- 172.21.15.26:0/3456621719 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bfc0f7980 0x7f8bfc0f7de0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:27.182 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.184+0000 7f8c044a9700 1 --2- 172.21.15.26:0/3456621719 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8bfc0f66e0 0x7f8bfc0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:27.183 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.184+0000 7f8c044a9700 1 -- 172.21.15.26:0/3456621719 >> 172.21.15.26:0/3456621719 conn(0x7f8bfc0f1e40 msgr2=0x7f8bfc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:13:27.183 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.184+0000 7f8c044a9700 1 -- 172.21.15.26:0/3456621719 shutdown_connections 2021-11-03T18:13:27.183 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.184+0000 7f8c044a9700 1 -- 172.21.15.26:0/3456621719 wait complete. 2021-11-03T18:13:27.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.184+0000 7f8c044a9700 1 Processor -- start 2021-11-03T18:13:27.186 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.184+0000 7f8c044a9700 1 -- start start 2021-11-03T18:13:27.186 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.185+0000 7f8c044a9700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8bfc0f66e0 0x7f8bfc106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:13:27.186 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.185+0000 7f8c044a9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bfc0f7980 0x7f8bfc107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:13:27.186 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.185+0000 7f8c044a9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc107a00 con 0x7f8bfc0f7980 2021-11-03T18:13:27.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.185+0000 7f8c044a9700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc107b40 con 0x7f8bfc0f66e0 2021-11-03T18:13:27.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.185+0000 7f8c01a44700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bfc0f7980 0x7f8bfc107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:13:27.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.185+0000 7f8c01a44700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bfc0f7980 0x7f8bfc107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58830/0 (socket says 172.21.15.26:58830) 2021-11-03T18:13:27.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.185+0000 7f8c01a44700 1 -- 172.21.15.26:0/242386688 learned_addr learned my addr 172.21.15.26:0/242386688 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:13:27.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.185+0000 7f8c02245700 1 --2- 172.21.15.26:0/242386688 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8bfc0f66e0 0x7f8bfc106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:13:27.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.185+0000 7f8c01a44700 1 -- 172.21.15.26:0/242386688 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8bfc0f66e0 msgr2=0x7f8bfc106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:13:27.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.185+0000 7f8c01a44700 1 --2- 172.21.15.26:0/242386688 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8bfc0f66e0 0x7f8bfc106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:27.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.185+0000 7f8c01a44700 1 -- 172.21.15.26:0/242386688 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf8005040 con 0x7f8bfc0f7980 2021-11-03T18:13:27.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.185+0000 7f8c01a44700 1 --2- 172.21.15.26:0/242386688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bfc0f7980 0x7f8bfc107450 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 rx=0x7f8bf8009990 tx=0x7f8bf8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:13:27.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.185+0000 7f8bf2ffd700 1 -- 172.21.15.26:0/242386688 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bf8018070 con 0x7f8bfc0f7980 2021-11-03T18:13:27.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.185+0000 7f8bf2ffd700 1 -- 172.21.15.26:0/242386688 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8bf8007ba0 con 0x7f8bfc0f7980 2021-11-03T18:13:27.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.185+0000 7f8c044a9700 1 -- 172.21.15.26:0/242386688 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bfc108480 con 0x7f8bfc0f7980 2021-11-03T18:13:27.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.185+0000 7f8bf2ffd700 1 -- 172.21.15.26:0/242386688 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bf801c3c0 con 0x7f8bfc0f7980 2021-11-03T18:13:27.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.185+0000 7f8c044a9700 1 -- 172.21.15.26:0/242386688 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bfc1089e0 con 0x7f8bfc0f7980 2021-11-03T18:13:27.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.186+0000 7f8c044a9700 1 -- 172.21.15.26:0/242386688 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bfc045ad0 con 0x7f8bfc0f7980 2021-11-03T18:13:27.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.187+0000 7f8bf2ffd700 1 -- 172.21.15.26:0/242386688 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f8bf801d420 con 0x7f8bfc0f7980 2021-11-03T18:13:27.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.187+0000 7f8bf2ffd700 1 --2- 172.21.15.26:0/242386688 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8be80640b0 0x7f8be8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:13:27.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.187+0000 7f8bf2ffd700 1 -- 172.21.15.26:0/242386688 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f8bf8082340 con 0x7f8bfc0f7980 2021-11-03T18:13:27.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.187+0000 7f8c02245700 1 --2- 172.21.15.26:0/242386688 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8be80640b0 0x7f8be8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:13:27.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.187+0000 7f8c02245700 1 --2- 172.21.15.26:0/242386688 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8be80640b0 0x7f8be8066570 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f8bfc0f77e0 tx=0x7f8bec00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:13:27.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.191+0000 7f8bf2ffd700 1 -- 172.21.15.26:0/242386688 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f8bf8054760 con 0x7f8bfc0f7980 2021-11-03T18:13:27.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:26 smithi194 ceph-mon[65619]: pgmap v2363: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:27.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.363+0000 7f8c044a9700 1 -- 172.21.15.26:0/242386688 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8bfc108c50 con 0x7f8be80640b0 2021-11-03T18:13:27.375 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.378+0000 7f8bf2ffd700 1 -- 172.21.15.26:0/242386688 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f8bfc108c50 con 0x7f8be80640b0 2021-11-03T18:13:27.376 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:13:27.458 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (84m) 3m ago 85m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:13:27.459 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (76m) 3m ago 85m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:13:27.459 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (76m) 2m ago 85m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:13:27.459 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (84m) 3m ago 85m 42.0M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:13:27.459 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (77m) 3m ago 81m 25.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:13:27.460 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (77m) 3m ago 80m 26.4M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:13:27.460 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (81m) 2m ago 81m 26.6M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:13:27.460 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (81m) 2m ago 81m 27.0M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:13:27.460 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (78m) 3m ago 87m 574M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:13:27.461 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (78m) 2m ago 85m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:13:27.461 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (77m) 3m ago 87m 308M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:13:27.461 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (77m) 2m ago 85m 145M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:13:27.461 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (85m) 3m ago 85m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:13:27.461 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (84m) 2m ago 84m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:13:27.462 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (76m) 3m ago 84m 312M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:13:27.462 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (76m) 3m ago 83m 335M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:13:27.462 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (75m) 3m ago 83m 279M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:13:27.463 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (75m) 2m ago 83m 362M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:13:27.463 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (74m) 2m ago 82m 302M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:13:27.464 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (74m) 2m ago 82m 296M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:13:27.464 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (84m) 3m ago 85m 63.4M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:13:27.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.380+0000 7f8c044a9700 1 -- 172.21.15.26:0/242386688 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8be80640b0 msgr2=0x7f8be8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:13:27.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.380+0000 7f8c044a9700 1 --2- 172.21.15.26:0/242386688 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8be80640b0 0x7f8be8066570 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f8bfc0f77e0 tx=0x7f8bec00b040).stop 2021-11-03T18:13:27.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.380+0000 7f8c044a9700 1 -- 172.21.15.26:0/242386688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bfc0f7980 msgr2=0x7f8bfc107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:13:27.466 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.380+0000 7f8c044a9700 1 --2- 172.21.15.26:0/242386688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bfc0f7980 0x7f8bfc107450 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 rx=0x7f8bf8009990 tx=0x7f8bf8009b30).stop 2021-11-03T18:13:27.466 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.380+0000 7f8c044a9700 1 -- 172.21.15.26:0/242386688 shutdown_connections 2021-11-03T18:13:27.466 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.380+0000 7f8c044a9700 1 --2- 172.21.15.26:0/242386688 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8be80640b0 0x7f8be8066570 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:27.466 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.380+0000 7f8c044a9700 1 --2- 172.21.15.26:0/242386688 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8bfc0f66e0 0x7f8bfc106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:27.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.380+0000 7f8c044a9700 1 --2- 172.21.15.26:0/242386688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8bfc0f7980 0x7f8bfc107450 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:27.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.380+0000 7f8c044a9700 1 -- 172.21.15.26:0/242386688 >> 172.21.15.26:0/242386688 conn(0x7f8bfc0f1e40 msgr2=0x7f8bfc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:13:27.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.380+0000 7f8c044a9700 1 -- 172.21.15.26:0/242386688 shutdown_connections 2021-11-03T18:13:27.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.380+0000 7f8c044a9700 1 -- 172.21.15.26:0/242386688 wait complete. 2021-11-03T18:13:27.476 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.479+0000 7f90f3a89700 1 -- 172.21.15.26:0/661047694 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90ec0f49a0 msgr2=0x7f90ec0f4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:13:27.477 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.479+0000 7f90f3a89700 1 --2- 172.21.15.26:0/661047694 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90ec0f49a0 0x7f90ec0f4dc0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 rx=0x7f90e8004660 tx=0x7f90e8009b30).stop 2021-11-03T18:13:27.477 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.479+0000 7f90f3a89700 1 -- 172.21.15.26:0/661047694 shutdown_connections 2021-11-03T18:13:27.477 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.479+0000 7f90f3a89700 1 --2- 172.21.15.26:0/661047694 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90ec0f5340 0x7f90ec0f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:27.477 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.479+0000 7f90f3a89700 1 --2- 172.21.15.26:0/661047694 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90ec0f49a0 0x7f90ec0f4dc0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:27.477 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.479+0000 7f90f3a89700 1 -- 172.21.15.26:0/661047694 >> 172.21.15.26:0/661047694 conn(0x7f90ec0f04c0 msgr2=0x7f90ec0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:13:27.478 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.479+0000 7f90f3a89700 1 -- 172.21.15.26:0/661047694 shutdown_connections 2021-11-03T18:13:27.478 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.479+0000 7f90f3a89700 1 -- 172.21.15.26:0/661047694 wait complete. 2021-11-03T18:13:27.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.479+0000 7f90f3a89700 1 Processor -- start 2021-11-03T18:13:27.481 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.479+0000 7f90f3a89700 1 -- start start 2021-11-03T18:13:27.481 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.480+0000 7f90f3a89700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90ec0f49a0 0x7f90ec107050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:13:27.481 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.480+0000 7f90f3a89700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90ec0f5340 0x7f90ec107540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:13:27.481 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.480+0000 7f90f3a89700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec107af0 con 0x7f90ec0f5340 2021-11-03T18:13:27.482 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.480+0000 7f90f3a89700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec107c30 con 0x7f90ec0f49a0 2021-11-03T18:13:27.482 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.480+0000 7f90f1024700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90ec0f5340 0x7f90ec107540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:13:27.482 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.480+0000 7f90f1024700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90ec0f5340 0x7f90ec107540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58840/0 (socket says 172.21.15.26:58840) 2021-11-03T18:13:27.482 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.480+0000 7f90f1024700 1 -- 172.21.15.26:0/2743457178 learned_addr learned my addr 172.21.15.26:0/2743457178 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:13:27.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.480+0000 7f90f1825700 1 --2- 172.21.15.26:0/2743457178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90ec0f49a0 0x7f90ec107050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:13:27.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.480+0000 7f90f1024700 1 -- 172.21.15.26:0/2743457178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90ec0f49a0 msgr2=0x7f90ec107050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:13:27.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.480+0000 7f90f1024700 1 --2- 172.21.15.26:0/2743457178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90ec0f49a0 0x7f90ec107050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:27.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.480+0000 7f90f1024700 1 -- 172.21.15.26:0/2743457178 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e8005040 con 0x7f90ec0f5340 2021-11-03T18:13:27.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.480+0000 7f90f1024700 1 --2- 172.21.15.26:0/2743457178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90ec0f5340 0x7f90ec107540 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 rx=0x7f90dc00c510 tx=0x7f90dc007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:13:27.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.480+0000 7f90e27fc700 1 -- 172.21.15.26:0/2743457178 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90dc00f650 con 0x7f90ec0f5340 2021-11-03T18:13:27.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.480+0000 7f90e27fc700 1 -- 172.21.15.26:0/2743457178 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f90dc00fc60 con 0x7f90ec0f5340 2021-11-03T18:13:27.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.480+0000 7f90f3a89700 1 -- 172.21.15.26:0/2743457178 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90ec1085d0 con 0x7f90ec0f5340 2021-11-03T18:13:27.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.480+0000 7f90e27fc700 1 -- 172.21.15.26:0/2743457178 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90dc012cd0 con 0x7f90ec0f5340 2021-11-03T18:13:27.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.480+0000 7f90f3a89700 1 -- 172.21.15.26:0/2743457178 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90ec108b90 con 0x7f90ec0f5340 2021-11-03T18:13:27.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.481+0000 7f90f3a89700 1 -- 172.21.15.26:0/2743457178 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90ec045ad0 con 0x7f90ec0f5340 2021-11-03T18:13:27.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.482+0000 7f90e27fc700 1 -- 172.21.15.26:0/2743457178 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f90dc010070 con 0x7f90ec0f5340 2021-11-03T18:13:27.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.482+0000 7f90e27fc700 1 --2- 172.21.15.26:0/2743457178 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f90d8064090 0x7f90d8066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:13:27.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.482+0000 7f90e27fc700 1 -- 172.21.15.26:0/2743457178 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f90dc0806c0 con 0x7f90ec0f5340 2021-11-03T18:13:27.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.482+0000 7f90f1825700 1 --2- 172.21.15.26:0/2743457178 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f90d8064090 0x7f90d8066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:13:27.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.483+0000 7f90f1825700 1 --2- 172.21.15.26:0/2743457178 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f90d8064090 0x7f90d8066550 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f90e8004e30 tx=0x7f90e8009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:13:27.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.486+0000 7f90e27fc700 1 -- 172.21.15.26:0/2743457178 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f90dc052930 con 0x7f90ec0f5340 2021-11-03T18:13:27.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.718+0000 7f90f3a89700 1 -- 172.21.15.26:0/2743457178 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f90ec108db0 con 0x7f90ec0f5340 2021-11-03T18:13:27.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.719+0000 7f90e27fc700 1 -- 172.21.15.26:0/2743457178 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f90dc052520 con 0x7f90ec0f5340 2021-11-03T18:13:27.717 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:13:27.717 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:13:27.718 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:13:27.718 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:13:27.718 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:13:27.719 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:13:27.719 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:13:27.719 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:13:27.719 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:13:27.720 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:13:27.720 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:13:27.720 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:13:27.720 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:13:27.720 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:13:27.721 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:13:27.721 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:13:27.721 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:13:27.721 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:13:27.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.721+0000 7f90f3a89700 1 -- 172.21.15.26:0/2743457178 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f90d8064090 msgr2=0x7f90d8066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:13:27.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.721+0000 7f90f3a89700 1 --2- 172.21.15.26:0/2743457178 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f90d8064090 0x7f90d8066550 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f90e8004e30 tx=0x7f90e8009b30).stop 2021-11-03T18:13:27.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.721+0000 7f90f3a89700 1 -- 172.21.15.26:0/2743457178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90ec0f5340 msgr2=0x7f90ec107540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:13:27.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.721+0000 7f90f3a89700 1 --2- 172.21.15.26:0/2743457178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90ec0f5340 0x7f90ec107540 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 rx=0x7f90dc00c510 tx=0x7f90dc007df0).stop 2021-11-03T18:13:27.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.721+0000 7f90f3a89700 1 -- 172.21.15.26:0/2743457178 shutdown_connections 2021-11-03T18:13:27.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.721+0000 7f90f3a89700 1 --2- 172.21.15.26:0/2743457178 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f90d8064090 0x7f90d8066550 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:27.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.721+0000 7f90f3a89700 1 --2- 172.21.15.26:0/2743457178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90ec0f49a0 0x7f90ec107050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:27.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.721+0000 7f90f3a89700 1 --2- 172.21.15.26:0/2743457178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90ec0f5340 0x7f90ec107540 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:27.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.721+0000 7f90f3a89700 1 -- 172.21.15.26:0/2743457178 >> 172.21.15.26:0/2743457178 conn(0x7f90ec0f04c0 msgr2=0x7f90ec0fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:13:27.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.721+0000 7f90f3a89700 1 -- 172.21.15.26:0/2743457178 shutdown_connections 2021-11-03T18:13:27.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.721+0000 7f90f3a89700 1 -- 172.21.15.26:0/2743457178 wait complete. 2021-11-03T18:13:27.820 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.821+0000 7fd30dfeb700 1 -- 172.21.15.26:0/3377240007 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3080f66e0 msgr2=0x7fd3080f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:13:27.821 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.821+0000 7fd30dfeb700 1 --2- 172.21.15.26:0/3377240007 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3080f66e0 0x7fd3080f6b00 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 rx=0x7fd2fc004660 tx=0x7fd2fc009b30).stop 2021-11-03T18:13:27.821 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.821+0000 7fd30dfeb700 1 -- 172.21.15.26:0/3377240007 shutdown_connections 2021-11-03T18:13:27.821 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.821+0000 7fd30dfeb700 1 --2- 172.21.15.26:0/3377240007 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3080f6ff0 0x7fd3080f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:27.822 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.821+0000 7fd30dfeb700 1 --2- 172.21.15.26:0/3377240007 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3080f66e0 0x7fd3080f6b00 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:27.822 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.821+0000 7fd30dfeb700 1 -- 172.21.15.26:0/3377240007 >> 172.21.15.26:0/3377240007 conn(0x7fd3080f1f00 msgr2=0x7fd3080f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:13:27.822 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.821+0000 7fd30dfeb700 1 -- 172.21.15.26:0/3377240007 shutdown_connections 2021-11-03T18:13:27.822 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.821+0000 7fd30dfeb700 1 -- 172.21.15.26:0/3377240007 wait complete. 2021-11-03T18:13:27.823 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.821+0000 7fd30dfeb700 1 Processor -- start 2021-11-03T18:13:27.823 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.822+0000 7fd30dfeb700 1 -- start start 2021-11-03T18:13:27.823 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.822+0000 7fd30dfeb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3080f66e0 0x7fd308106f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:13:27.823 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.822+0000 7fd30dfeb700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3080f6ff0 0x7fd3081073f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:13:27.824 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.822+0000 7fd30dfeb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3081079a0 con 0x7fd3080f66e0 2021-11-03T18:13:27.824 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.822+0000 7fd30dfeb700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd308107ae0 con 0x7fd3080f6ff0 2021-11-03T18:13:27.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.822+0000 7fd3077fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3080f66e0 0x7fd308106f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:13:27.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.822+0000 7fd3077fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3080f66e0 0x7fd308106f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58846/0 (socket says 172.21.15.26:58846) 2021-11-03T18:13:27.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.822+0000 7fd3077fe700 1 -- 172.21.15.26:0/2379370285 learned_addr learned my addr 172.21.15.26:0/2379370285 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:13:27.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.822+0000 7fd306ffd700 1 --2- 172.21.15.26:0/2379370285 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3080f6ff0 0x7fd3081073f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:13:27.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.822+0000 7fd3077fe700 1 -- 172.21.15.26:0/2379370285 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3080f6ff0 msgr2=0x7fd3081073f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:13:27.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.822+0000 7fd3077fe700 1 --2- 172.21.15.26:0/2379370285 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3080f6ff0 0x7fd3081073f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:27.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.822+0000 7fd3077fe700 1 -- 172.21.15.26:0/2379370285 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2fc005040 con 0x7fd3080f66e0 2021-11-03T18:13:27.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.822+0000 7fd3077fe700 1 --2- 172.21.15.26:0/2379370285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3080f66e0 0x7fd308106f00 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 rx=0x7fd2fc009990 tx=0x7fd2fc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:13:27.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.823+0000 7fd2effff700 1 -- 172.21.15.26:0/2379370285 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2fc018070 con 0x7fd3080f66e0 2021-11-03T18:13:27.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.823+0000 7fd30dfeb700 1 -- 172.21.15.26:0/2379370285 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd308108420 con 0x7fd3080f66e0 2021-11-03T18:13:27.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.823+0000 7fd2effff700 1 -- 172.21.15.26:0/2379370285 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd2fc007ba0 con 0x7fd3080f66e0 2021-11-03T18:13:27.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.823+0000 7fd2effff700 1 -- 172.21.15.26:0/2379370285 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2fc01c3c0 con 0x7fd3080f66e0 2021-11-03T18:13:27.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.823+0000 7fd30dfeb700 1 -- 172.21.15.26:0/2379370285 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd308108980 con 0x7fd3080f66e0 2021-11-03T18:13:27.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.824+0000 7fd30dfeb700 1 -- 172.21.15.26:0/2379370285 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd308045ad0 con 0x7fd3080f66e0 2021-11-03T18:13:27.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.824+0000 7fd2effff700 1 -- 172.21.15.26:0/2379370285 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fd2fc01d420 con 0x7fd3080f66e0 2021-11-03T18:13:27.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.824+0000 7fd2effff700 1 --2- 172.21.15.26:0/2379370285 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd2f00640b0 0x7fd2f0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:13:27.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.825+0000 7fd2effff700 1 -- 172.21.15.26:0/2379370285 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fd2fc0825d0 con 0x7fd3080f66e0 2021-11-03T18:13:27.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.825+0000 7fd306ffd700 1 --2- 172.21.15.26:0/2379370285 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd2f00640b0 0x7fd2f0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:13:27.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.825+0000 7fd306ffd700 1 --2- 172.21.15.26:0/2379370285 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd2f00640b0 0x7fd2f0066570 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7fd2f8009740 tx=0x7fd2f8009c60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:13:27.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:27.828+0000 7fd2effff700 1 -- 172.21.15.26:0/2379370285 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fd2fc054990 con 0x7fd3080f66e0 2021-11-03T18:13:28.033 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:28.036+0000 7fd30dfeb700 1 -- 172.21.15.26:0/2379370285 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd3080fef70 con 0x7fd3080f66e0 2021-11-03T18:13:28.034 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:28.036+0000 7fd2effff700 1 -- 172.21.15.26:0/2379370285 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fd2fc054580 con 0x7fd3080f66e0 2021-11-03T18:13:28.035 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:13:28.035 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:13:28.035 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:13:28.036 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:13:28.036 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:13:28.036 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:13:28.036 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:13:28.036 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:13:28.037 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:13:28.037 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:13:28.037 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:13:28.037 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:13:28.038 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:13:28.038 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:13:28.038 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:13:28.038 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:13:28.039 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:13:28.039 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:13:28.039 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:13:28.039 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:13:28.039 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:13:28.040 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:13:28.040 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:13:28.040 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:13:28.040 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:13:28.040 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:13:28.041 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:13:28.041 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:13:28.041 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:13:28.041 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:13:28.042 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:13:28.042 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:13:28.042 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:13:28.042 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:13:28.043 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:13:28.043 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:13:28.043 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:13:28.043 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:13:28.044 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:13:28.045 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:28.038+0000 7fd30dfeb700 1 -- 172.21.15.26:0/2379370285 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd2f00640b0 msgr2=0x7fd2f0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:13:28.045 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:28.038+0000 7fd30dfeb700 1 --2- 172.21.15.26:0/2379370285 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd2f00640b0 0x7fd2f0066570 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7fd2f8009740 tx=0x7fd2f8009c60).stop 2021-11-03T18:13:28.045 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:28.038+0000 7fd30dfeb700 1 -- 172.21.15.26:0/2379370285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3080f66e0 msgr2=0x7fd308106f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:13:28.046 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:28.038+0000 7fd30dfeb700 1 --2- 172.21.15.26:0/2379370285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3080f66e0 0x7fd308106f00 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 rx=0x7fd2fc009990 tx=0x7fd2fc009b30).stop 2021-11-03T18:13:28.046 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:28.038+0000 7fd30dfeb700 1 -- 172.21.15.26:0/2379370285 shutdown_connections 2021-11-03T18:13:28.046 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:28.038+0000 7fd30dfeb700 1 --2- 172.21.15.26:0/2379370285 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd2f00640b0 0x7fd2f0066570 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:28.046 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:28.038+0000 7fd30dfeb700 1 --2- 172.21.15.26:0/2379370285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3080f66e0 0x7fd308106f00 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:28.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:28.038+0000 7fd30dfeb700 1 --2- 172.21.15.26:0/2379370285 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3080f6ff0 0x7fd3081073f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:28.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:28.038+0000 7fd30dfeb700 1 -- 172.21.15.26:0/2379370285 >> 172.21.15.26:0/2379370285 conn(0x7fd3080f1f00 msgr2=0x7fd3080fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:13:28.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:28.038+0000 7fd30dfeb700 1 -- 172.21.15.26:0/2379370285 shutdown_connections 2021-11-03T18:13:28.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:28.038+0000 7fd30dfeb700 1 -- 172.21.15.26:0/2379370285 wait complete. 2021-11-03T18:13:28.047 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:13:28.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:27 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2743457178' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:13:28.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:27 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2743457178' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:13:29.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:28 smithi194 ceph-mon[65619]: from='client.36572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:13:29.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:28 smithi194 ceph-mon[65619]: from='client.36576 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:13:29.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:28 smithi194 ceph-mon[65619]: pgmap v2364: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:29.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:28 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2379370285' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:13:29.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:28 smithi026 ceph-mon[96795]: from='client.36572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:13:29.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:28 smithi026 ceph-mon[96795]: from='client.36576 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:13:29.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:28 smithi026 ceph-mon[96795]: pgmap v2364: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:29.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:28 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2379370285' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:13:31.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:30 smithi194 ceph-mon[65619]: pgmap v2365: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:31.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:30 smithi026 ceph-mon[96795]: pgmap v2365: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:33.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:32 smithi194 ceph-mon[65619]: pgmap v2366: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:33.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:32 smithi026 ceph-mon[96795]: pgmap v2366: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:35.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:34 smithi194 ceph-mon[65619]: pgmap v2367: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:35.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:34 smithi026 ceph-mon[96795]: pgmap v2367: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:37.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:36 smithi194 ceph-mon[65619]: pgmap v2368: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:37.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:36 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:13:37.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:36 smithi026 ceph-mon[96795]: pgmap v2368: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:37.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:36 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:13:38.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:37 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:13:38.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:37 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:13:39.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:38 smithi194 ceph-mon[65619]: pgmap v2369: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:39.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:38 smithi026 ceph-mon[96795]: pgmap v2369: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:41.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:40 smithi194 ceph-mon[65619]: pgmap v2370: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:41.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:40 smithi026 ceph-mon[96795]: pgmap v2370: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:43.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:42 smithi194 ceph-mon[65619]: pgmap v2371: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:43.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:42 smithi026 ceph-mon[96795]: pgmap v2371: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:45.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:44 smithi194 ceph-mon[65619]: pgmap v2372: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:45.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:44 smithi026 ceph-mon[96795]: pgmap v2372: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:47.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:46 smithi194 ceph-mon[65619]: pgmap v2373: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:47.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:46 smithi026 ceph-mon[96795]: pgmap v2373: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:49.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:48 smithi194 ceph-mon[65619]: pgmap v2374: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:49.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:13:49.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:13:49.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:48 smithi026 ceph-mon[96795]: pgmap v2374: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:13:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:13:51.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:50 smithi194 ceph-mon[65619]: pgmap v2375: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:51.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:50 smithi026 ceph-mon[96795]: pgmap v2375: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:52.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:51 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:13:52.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:51 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:13:53.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:52 smithi194 ceph-mon[65619]: pgmap v2376: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:53.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:52 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:13:53.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:52 smithi026 ceph-mon[96795]: pgmap v2376: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:53.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:52 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:13:55.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:54 smithi194 ceph-mon[65619]: pgmap v2377: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:55.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:54 smithi026 ceph-mon[96795]: pgmap v2377: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:57.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:56 smithi194 ceph-mon[65619]: pgmap v2378: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:57.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:56 smithi026 ceph-mon[96795]: pgmap v2378: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:58.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.153+0000 7f0ddd680700 1 -- 172.21.15.26:0/1028778316 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dd80f6530 msgr2=0x7f0dd80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:13:58.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.153+0000 7f0ddd680700 1 --2- 172.21.15.26:0/1028778316 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dd80f6530 0x7f0dd80f6950 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 rx=0x7f0dc0004660 tx=0x7f0dc0009b30).stop 2021-11-03T18:13:58.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.153+0000 7f0ddd680700 1 -- 172.21.15.26:0/1028778316 shutdown_connections 2021-11-03T18:13:58.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.153+0000 7f0ddd680700 1 --2- 172.21.15.26:0/1028778316 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0dd80f77d0 0x7f0dd80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:13:58.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.153+0000 7f0ddd680700 1 --2- 172.21.15.26:0/1028778316 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dd80f6530 0x7f0dd80f6950 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:58.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.153+0000 7f0ddd680700 1 -- 172.21.15.26:0/1028778316 >> 172.21.15.26:0/1028778316 conn(0x7f0dd80f1cd0 msgr2=0x7f0dd80f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:13:58.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.153+0000 7f0ddd680700 1 -- 172.21.15.26:0/1028778316 shutdown_connections 2021-11-03T18:13:58.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.153+0000 7f0ddd680700 1 -- 172.21.15.26:0/1028778316 wait complete. 2021-11-03T18:13:58.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.153+0000 7f0ddd680700 1 Processor -- start 2021-11-03T18:13:58.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.153+0000 7f0ddd680700 1 -- start start 2021-11-03T18:13:58.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.154+0000 7f0ddd680700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dd80f6530 0x7f0dd8106da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:13:58.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.154+0000 7f0ddd680700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0dd80f77d0 0x7f0dd8107290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:13:58.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.154+0000 7f0ddd680700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd8107920 con 0x7f0dd80f6530 2021-11-03T18:13:58.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.154+0000 7f0ddd680700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd81080d0 con 0x7f0dd80f77d0 2021-11-03T18:13:58.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.154+0000 7f0dd7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dd80f6530 0x7f0dd8106da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:13:58.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.154+0000 7f0dd7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dd80f6530 0x7f0dd8106da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58864/0 (socket says 172.21.15.26:58864) 2021-11-03T18:13:58.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.154+0000 7f0dd7fff700 1 -- 172.21.15.26:0/1324536054 learned_addr learned my addr 172.21.15.26:0/1324536054 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:13:58.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.154+0000 7f0dd77fe700 1 --2- 172.21.15.26:0/1324536054 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0dd80f77d0 0x7f0dd8107290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:13:58.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.154+0000 7f0dd7fff700 1 -- 172.21.15.26:0/1324536054 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0dd80f77d0 msgr2=0x7f0dd8107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:13:58.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.154+0000 7f0dd7fff700 1 --2- 172.21.15.26:0/1324536054 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0dd80f77d0 0x7f0dd8107290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:58.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.154+0000 7f0dd7fff700 1 -- 172.21.15.26:0/1324536054 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc0005040 con 0x7f0dd80f6530 2021-11-03T18:13:58.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.154+0000 7f0dd77fe700 1 --2- 172.21.15.26:0/1324536054 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0dd80f77d0 0x7f0dd8107290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:13:58.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.154+0000 7f0dd7fff700 1 --2- 172.21.15.26:0/1324536054 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dd80f6530 0x7f0dd8106da0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 rx=0x7f0dc0004f60 tx=0x7f0dc0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:13:58.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.154+0000 7f0dd4ff9700 1 -- 172.21.15.26:0/1324536054 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0dc0018070 con 0x7f0dd80f6530 2021-11-03T18:13:58.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.155+0000 7f0dd4ff9700 1 -- 172.21.15.26:0/1324536054 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0dc0007ba0 con 0x7f0dd80f6530 2021-11-03T18:13:58.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.155+0000 7f0dd4ff9700 1 -- 172.21.15.26:0/1324536054 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0dc001c620 con 0x7f0dd80f6530 2021-11-03T18:13:58.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.155+0000 7f0ddd680700 1 -- 172.21.15.26:0/1324536054 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dd8108350 con 0x7f0dd80f6530 2021-11-03T18:13:58.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.155+0000 7f0ddd680700 1 -- 172.21.15.26:0/1324536054 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dd8108860 con 0x7f0dd80f6530 2021-11-03T18:13:58.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.155+0000 7f0ddd680700 1 -- 172.21.15.26:0/1324536054 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dd8059100 con 0x7f0dd80f6530 2021-11-03T18:13:58.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.156+0000 7f0dd4ff9700 1 -- 172.21.15.26:0/1324536054 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f0dc001c8e0 con 0x7f0dd80f6530 2021-11-03T18:13:58.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.156+0000 7f0dd4ff9700 1 --2- 172.21.15.26:0/1324536054 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0dc4064100 0x7f0dc40665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:13:58.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.156+0000 7f0dd4ff9700 1 -- 172.21.15.26:0/1324536054 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f0dc00826e0 con 0x7f0dd80f6530 2021-11-03T18:13:58.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.157+0000 7f0dd77fe700 1 --2- 172.21.15.26:0/1324536054 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0dc4064100 0x7f0dc40665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:13:58.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.157+0000 7f0dd77fe700 1 --2- 172.21.15.26:0/1324536054 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0dc4064100 0x7f0dc40665c0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f0dd8106b30 tx=0x7f0dc8008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:13:58.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.161+0000 7f0dd4ff9700 1 -- 172.21.15.26:0/1324536054 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f0dc0054a40 con 0x7f0dd80f6530 2021-11-03T18:13:58.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.338+0000 7f0ddd680700 1 -- 172.21.15.26:0/1324536054 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0dd80fede0 con 0x7f0dc4064100 2021-11-03T18:13:58.338 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.340+0000 7f0dd4ff9700 1 -- 172.21.15.26:0/1324536054 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f0dd80fede0 con 0x7f0dc4064100 2021-11-03T18:13:58.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.341+0000 7f0ddd680700 1 -- 172.21.15.26:0/1324536054 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0dc4064100 msgr2=0x7f0dc40665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:13:58.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.341+0000 7f0ddd680700 1 --2- 172.21.15.26:0/1324536054 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0dc4064100 0x7f0dc40665c0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f0dd8106b30 tx=0x7f0dc8008040).stop 2021-11-03T18:13:58.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.341+0000 7f0ddd680700 1 -- 172.21.15.26:0/1324536054 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dd80f6530 msgr2=0x7f0dd8106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:13:58.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.342+0000 7f0ddd680700 1 --2- 172.21.15.26:0/1324536054 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dd80f6530 0x7f0dd8106da0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 rx=0x7f0dc0004f60 tx=0x7f0dc0009b30).stop 2021-11-03T18:13:58.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.342+0000 7f0ddd680700 1 -- 172.21.15.26:0/1324536054 shutdown_connections 2021-11-03T18:13:58.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.342+0000 7f0ddd680700 1 --2- 172.21.15.26:0/1324536054 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0dc4064100 0x7f0dc40665c0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:58.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.342+0000 7f0ddd680700 1 --2- 172.21.15.26:0/1324536054 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dd80f6530 0x7f0dd8106da0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:58.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.342+0000 7f0ddd680700 1 --2- 172.21.15.26:0/1324536054 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0dd80f77d0 0x7f0dd8107290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:58.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.342+0000 7f0ddd680700 1 -- 172.21.15.26:0/1324536054 >> 172.21.15.26:0/1324536054 conn(0x7f0dd80f1cd0 msgr2=0x7f0dd80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:13:58.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.342+0000 7f0ddd680700 1 -- 172.21.15.26:0/1324536054 shutdown_connections 2021-11-03T18:13:58.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.342+0000 7f0ddd680700 1 -- 172.21.15.26:0/1324536054 wait complete. 2021-11-03T18:13:58.350 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:13:58.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.442+0000 7f0a6e4d1700 1 -- 172.21.15.26:0/2312773088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a680f7980 msgr2=0x7f0a680f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:13:58.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.442+0000 7f0a6e4d1700 1 --2- 172.21.15.26:0/2312773088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a680f7980 0x7f0a680f7de0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 rx=0x7f0a5c004660 tx=0x7f0a5c009b30).stop 2021-11-03T18:13:58.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.442+0000 7f0a6e4d1700 1 -- 172.21.15.26:0/2312773088 shutdown_connections 2021-11-03T18:13:58.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.442+0000 7f0a6e4d1700 1 --2- 172.21.15.26:0/2312773088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a680f7980 0x7f0a680f7de0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:58.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.442+0000 7f0a6e4d1700 1 --2- 172.21.15.26:0/2312773088 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0a680f66e0 0x7f0a680f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:13:58.444 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.442+0000 7f0a6e4d1700 1 -- 172.21.15.26:0/2312773088 >> 172.21.15.26:0/2312773088 conn(0x7f0a680f1e40 msgr2=0x7f0a680f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:13:58.444 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.442+0000 7f0a6e4d1700 1 -- 172.21.15.26:0/2312773088 shutdown_connections 2021-11-03T18:13:58.444 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.442+0000 7f0a6e4d1700 1 -- 172.21.15.26:0/2312773088 wait complete. 2021-11-03T18:13:58.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.442+0000 7f0a6e4d1700 1 Processor -- start 2021-11-03T18:13:58.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.443+0000 7f0a6e4d1700 1 -- start start 2021-11-03T18:13:58.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.443+0000 7f0a6e4d1700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0a680f66e0 0x7f0a6806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:13:58.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.443+0000 7f0a6e4d1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a680f7980 0x7f0a68069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:13:58.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.443+0000 7f0a6e4d1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6806a410 con 0x7f0a680f7980 2021-11-03T18:13:58.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.443+0000 7f0a6e4d1700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6806a550 con 0x7f0a680f66e0 2021-11-03T18:13:58.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.443+0000 7f0a677fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a680f7980 0x7f0a68069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:13:58.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.443+0000 7f0a677fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a680f7980 0x7f0a68069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58876/0 (socket says 172.21.15.26:58876) 2021-11-03T18:13:58.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.443+0000 7f0a677fe700 1 -- 172.21.15.26:0/2170211312 learned_addr learned my addr 172.21.15.26:0/2170211312 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:13:58.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.443+0000 7f0a67fff700 1 --2- 172.21.15.26:0/2170211312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0a680f66e0 0x7f0a6806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:13:58.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.443+0000 7f0a677fe700 1 -- 172.21.15.26:0/2170211312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0a680f66e0 msgr2=0x7f0a6806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:13:58.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.443+0000 7f0a677fe700 1 --2- 172.21.15.26:0/2170211312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0a680f66e0 0x7f0a6806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:58.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.443+0000 7f0a677fe700 1 -- 172.21.15.26:0/2170211312 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a5c005040 con 0x7f0a680f7980 2021-11-03T18:13:58.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.443+0000 7f0a67fff700 1 --2- 172.21.15.26:0/2170211312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0a680f66e0 0x7f0a6806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:13:58.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.443+0000 7f0a677fe700 1 --2- 172.21.15.26:0/2170211312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a680f7980 0x7f0a68069e20 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 rx=0x7f0a5c009990 tx=0x7f0a5c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:13:58.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.444+0000 7f0a64ff9700 1 -- 172.21.15.26:0/2170211312 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a5c018070 con 0x7f0a680f7980 2021-11-03T18:13:58.448 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.444+0000 7f0a64ff9700 1 -- 172.21.15.26:0/2170211312 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0a5c007ca0 con 0x7f0a680f7980 2021-11-03T18:13:58.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.444+0000 7f0a6e4d1700 1 -- 172.21.15.26:0/2170211312 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a6806a7d0 con 0x7f0a680f7980 2021-11-03T18:13:58.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.444+0000 7f0a64ff9700 1 -- 172.21.15.26:0/2170211312 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a5c01c620 con 0x7f0a680f7980 2021-11-03T18:13:58.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.444+0000 7f0a6e4d1700 1 -- 172.21.15.26:0/2170211312 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a6810ef70 con 0x7f0a680f7980 2021-11-03T18:13:58.450 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.445+0000 7f0a6e4d1700 1 -- 172.21.15.26:0/2170211312 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a68045ad0 con 0x7f0a680f7980 2021-11-03T18:13:58.450 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.445+0000 7f0a64ff9700 1 -- 172.21.15.26:0/2170211312 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f0a5c01d960 con 0x7f0a680f7980 2021-11-03T18:13:58.451 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.445+0000 7f0a64ff9700 1 --2- 172.21.15.26:0/2170211312 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0a500640b0 0x7f0a50066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:13:58.451 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.445+0000 7f0a64ff9700 1 -- 172.21.15.26:0/2170211312 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f0a5c082520 con 0x7f0a680f7980 2021-11-03T18:13:58.451 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.445+0000 7f0a67fff700 1 --2- 172.21.15.26:0/2170211312 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0a500640b0 0x7f0a50066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:13:58.451 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.446+0000 7f0a67fff700 1 --2- 172.21.15.26:0/2170211312 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0a500640b0 0x7f0a50066570 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f0a6806b730 tx=0x7f0a58008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:13:58.452 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.450+0000 7f0a64ff9700 1 -- 172.21.15.26:0/2170211312 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f0a5c054940 con 0x7f0a680f7980 2021-11-03T18:13:58.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.621+0000 7f0a6e4d1700 1 -- 172.21.15.26:0/2170211312 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a680ff050 con 0x7f0a500640b0 2021-11-03T18:13:58.634 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.636+0000 7f0a64ff9700 1 -- 172.21.15.26:0/2170211312 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f0a680ff050 con 0x7f0a500640b0 2021-11-03T18:13:58.634 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:13:58.635 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (85m) 3m ago 86m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:13:58.635 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (77m) 3m ago 86m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:13:58.635 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (77m) 2m ago 85m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:13:58.635 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (85m) 3m ago 86m 42.0M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:13:58.636 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (78m) 3m ago 81m 25.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:13:58.636 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (78m) 3m ago 81m 26.4M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:13:58.636 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (81m) 2m ago 81m 26.6M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:13:58.636 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (81m) 2m ago 81m 27.0M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:13:58.637 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (78m) 3m ago 87m 574M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:13:58.637 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (78m) 2m ago 85m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:13:58.637 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (78m) 3m ago 87m 308M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:13:58.637 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (77m) 2m ago 85m 145M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:13:58.637 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (86m) 3m ago 86m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:13:58.638 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (85m) 2m ago 85m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:13:58.638 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (77m) 3m ago 84m 312M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:13:58.638 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (76m) 3m ago 84m 335M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:13:58.638 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (76m) 3m ago 84m 279M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:13:58.639 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (75m) 2m ago 83m 362M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:13:58.639 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (75m) 2m ago 83m 302M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:13:58.639 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (74m) 2m ago 83m 296M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:13:58.639 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (84m) 3m ago 85m 63.4M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:13:58.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.637+0000 7f0a6e4d1700 1 -- 172.21.15.26:0/2170211312 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0a500640b0 msgr2=0x7f0a50066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:13:58.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.637+0000 7f0a6e4d1700 1 --2- 172.21.15.26:0/2170211312 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0a500640b0 0x7f0a50066570 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f0a6806b730 tx=0x7f0a58008040).stop 2021-11-03T18:13:58.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.637+0000 7f0a6e4d1700 1 -- 172.21.15.26:0/2170211312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a680f7980 msgr2=0x7f0a68069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:13:58.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.637+0000 7f0a6e4d1700 1 --2- 172.21.15.26:0/2170211312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a680f7980 0x7f0a68069e20 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 rx=0x7f0a5c009990 tx=0x7f0a5c009b30).stop 2021-11-03T18:13:58.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.638+0000 7f0a6e4d1700 1 -- 172.21.15.26:0/2170211312 shutdown_connections 2021-11-03T18:13:58.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.638+0000 7f0a6e4d1700 1 --2- 172.21.15.26:0/2170211312 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0a500640b0 0x7f0a50066570 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:58.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.638+0000 7f0a6e4d1700 1 --2- 172.21.15.26:0/2170211312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0a680f66e0 0x7f0a6806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:58.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.638+0000 7f0a6e4d1700 1 --2- 172.21.15.26:0/2170211312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a680f7980 0x7f0a68069e20 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:58.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.638+0000 7f0a6e4d1700 1 -- 172.21.15.26:0/2170211312 >> 172.21.15.26:0/2170211312 conn(0x7f0a680f1e40 msgr2=0x7f0a680fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:13:58.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.638+0000 7f0a6e4d1700 1 -- 172.21.15.26:0/2170211312 shutdown_connections 2021-11-03T18:13:58.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.638+0000 7f0a6e4d1700 1 -- 172.21.15.26:0/2170211312 wait complete. 2021-11-03T18:13:58.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.736+0000 7fbafb59e700 1 -- 172.21.15.26:0/498488514 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbafc0f6a10 msgr2=0x7fbafc0f6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:13:58.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.736+0000 7fbafb59e700 1 --2- 172.21.15.26:0/498488514 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbafc0f6a10 0x7fbafc0f6e30 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 rx=0x7fbaec0099e0 tx=0x7fbaec004d10).stop 2021-11-03T18:13:58.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.736+0000 7fbafb59e700 1 -- 172.21.15.26:0/498488514 shutdown_connections 2021-11-03T18:13:58.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.736+0000 7fbafb59e700 1 --2- 172.21.15.26:0/498488514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbafc0f5710 0x7fbafc0f5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:58.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.736+0000 7fbafb59e700 1 --2- 172.21.15.26:0/498488514 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbafc0f6a10 0x7fbafc0f6e30 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:58.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.736+0000 7fbafb59e700 1 -- 172.21.15.26:0/498488514 >> 172.21.15.26:0/498488514 conn(0x7fbafc0f0320 msgr2=0x7fbafc0f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:13:58.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.737+0000 7fbafb59e700 1 -- 172.21.15.26:0/498488514 shutdown_connections 2021-11-03T18:13:58.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.737+0000 7fbafb59e700 1 -- 172.21.15.26:0/498488514 wait complete. 2021-11-03T18:13:58.739 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.737+0000 7fbafb59e700 1 Processor -- start 2021-11-03T18:13:58.739 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.737+0000 7fbafb59e700 1 -- start start 2021-11-03T18:13:58.739 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.737+0000 7fbafb59e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbafc0f5710 0x7fbafc109b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:13:58.739 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.737+0000 7fbafb59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbafc0f6a10 0x7fbafc10c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:13:58.740 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.737+0000 7fbafb59e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbafc0f5400 con 0x7fbafc0f6a10 2021-11-03T18:13:58.740 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.737+0000 7fbafb59e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbafc0f5540 con 0x7fbafc0f5710 2021-11-03T18:13:58.740 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.737+0000 7fbaf9d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbafc0f6a10 0x7fbafc10c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:13:58.740 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.737+0000 7fbaf9d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbafc0f6a10 0x7fbafc10c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58886/0 (socket says 172.21.15.26:58886) 2021-11-03T18:13:58.740 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.737+0000 7fbaf9d9b700 1 -- 172.21.15.26:0/925663021 learned_addr learned my addr 172.21.15.26:0/925663021 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:13:58.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.738+0000 7fbafa59c700 1 --2- 172.21.15.26:0/925663021 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbafc0f5710 0x7fbafc109b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:13:58.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.738+0000 7fbaf9d9b700 1 -- 172.21.15.26:0/925663021 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbafc0f5710 msgr2=0x7fbafc109b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:13:58.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.738+0000 7fbaf9d9b700 1 --2- 172.21.15.26:0/925663021 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbafc0f5710 0x7fbafc109b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:58.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.738+0000 7fbaf9d9b700 1 -- 172.21.15.26:0/925663021 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaec009640 con 0x7fbafc0f6a10 2021-11-03T18:13:58.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.738+0000 7fbafa59c700 1 --2- 172.21.15.26:0/925663021 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbafc0f5710 0x7fbafc109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:13:58.742 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.738+0000 7fbaf9d9b700 1 --2- 172.21.15.26:0/925663021 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbafc0f6a10 0x7fbafc10c000 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7fbae400e7c0 tx=0x7fbae400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:13:58.742 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.738+0000 7fbaf2ffd700 1 -- 172.21.15.26:0/925663021 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbae40092e0 con 0x7fbafc0f6a10 2021-11-03T18:13:58.742 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.738+0000 7fbafb59e700 1 -- 172.21.15.26:0/925663021 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbafc10c610 con 0x7fbafc0f6a10 2021-11-03T18:13:58.742 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.738+0000 7fbaf2ffd700 1 -- 172.21.15.26:0/925663021 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbae400f040 con 0x7fbafc0f6a10 2021-11-03T18:13:58.742 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.738+0000 7fbaf2ffd700 1 -- 172.21.15.26:0/925663021 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbae4014750 con 0x7fbafc0f6a10 2021-11-03T18:13:58.743 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.738+0000 7fbafb59e700 1 -- 172.21.15.26:0/925663021 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbafc10cba0 con 0x7fbafc0f6a10 2021-11-03T18:13:58.744 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.739+0000 7fbafb59e700 1 -- 172.21.15.26:0/925663021 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbafc059100 con 0x7fbafc0f6a10 2021-11-03T18:13:58.744 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.739+0000 7fbaf2ffd700 1 -- 172.21.15.26:0/925663021 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fbae401b030 con 0x7fbafc0f6a10 2021-11-03T18:13:58.744 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.740+0000 7fbaf2ffd700 1 --2- 172.21.15.26:0/925663021 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbae8064100 0x7fbae80665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:13:58.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.740+0000 7fbaf2ffd700 1 -- 172.21.15.26:0/925663021 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fbae4080a00 con 0x7fbafc0f6a10 2021-11-03T18:13:58.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.740+0000 7fbafa59c700 1 --2- 172.21.15.26:0/925663021 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbae8064100 0x7fbae80665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:13:58.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.740+0000 7fbafa59c700 1 --2- 172.21.15.26:0/925663021 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbae8064100 0x7fbae80665c0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7fbaec000f80 tx=0x7fbaec004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:13:58.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.744+0000 7fbaf2ffd700 1 -- 172.21.15.26:0/925663021 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fbae4052bb0 con 0x7fbafc0f6a10 2021-11-03T18:13:58.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.973+0000 7fbafb59e700 1 -- 172.21.15.26:0/925663021 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbafc0fddb0 con 0x7fbafc0f6a10 2021-11-03T18:13:58.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.973+0000 7fbaf2ffd700 1 -- 172.21.15.26:0/925663021 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fbae40527a0 con 0x7fbafc0f6a10 2021-11-03T18:13:58.973 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:13:58.973 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:13:58.973 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:13:58.973 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:13:58.973 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:13:58.974 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:13:58.974 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:13:58.974 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:13:58.975 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:13:58.975 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:13:58.975 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:13:58.975 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:13:58.976 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:13:58.976 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:13:58.976 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:13:58.976 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:13:58.977 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:13:58.977 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:13:58.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.975+0000 7fbafb59e700 1 -- 172.21.15.26:0/925663021 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbae8064100 msgr2=0x7fbae80665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:13:58.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.975+0000 7fbafb59e700 1 --2- 172.21.15.26:0/925663021 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbae8064100 0x7fbae80665c0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7fbaec000f80 tx=0x7fbaec004d10).stop 2021-11-03T18:13:58.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.975+0000 7fbafb59e700 1 -- 172.21.15.26:0/925663021 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbafc0f6a10 msgr2=0x7fbafc10c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:13:58.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.975+0000 7fbafb59e700 1 --2- 172.21.15.26:0/925663021 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbafc0f6a10 0x7fbafc10c000 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7fbae400e7c0 tx=0x7fbae400b040).stop 2021-11-03T18:13:58.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.975+0000 7fbafb59e700 1 -- 172.21.15.26:0/925663021 shutdown_connections 2021-11-03T18:13:58.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.975+0000 7fbafb59e700 1 --2- 172.21.15.26:0/925663021 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbae8064100 0x7fbae80665c0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:58.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.975+0000 7fbafb59e700 1 --2- 172.21.15.26:0/925663021 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbafc0f5710 0x7fbafc109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:58.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.975+0000 7fbafb59e700 1 --2- 172.21.15.26:0/925663021 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbafc0f6a10 0x7fbafc10c000 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:58.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.975+0000 7fbafb59e700 1 -- 172.21.15.26:0/925663021 >> 172.21.15.26:0/925663021 conn(0x7fbafc0f0320 msgr2=0x7fbafc0fa170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:13:58.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.975+0000 7fbafb59e700 1 -- 172.21.15.26:0/925663021 shutdown_connections 2021-11-03T18:13:58.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:58.975+0000 7fbafb59e700 1 -- 172.21.15.26:0/925663021 wait complete. 2021-11-03T18:13:59.076 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.075+0000 7f24aa808700 1 -- 172.21.15.26:0/919436361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24a40f77d0 msgr2=0x7f24a40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:13:59.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.075+0000 7f24aa808700 1 --2- 172.21.15.26:0/919436361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24a40f77d0 0x7f24a40f7c30 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 rx=0x7f2494004660 tx=0x7f2494009b30).stop 2021-11-03T18:13:59.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.075+0000 7f24aa808700 1 -- 172.21.15.26:0/919436361 shutdown_connections 2021-11-03T18:13:59.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.075+0000 7f24aa808700 1 --2- 172.21.15.26:0/919436361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24a40f77d0 0x7f24a40f7c30 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:59.078 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.075+0000 7f24aa808700 1 --2- 172.21.15.26:0/919436361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24a40f6530 0x7f24a40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:59.078 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.076+0000 7f24aa808700 1 -- 172.21.15.26:0/919436361 >> 172.21.15.26:0/919436361 conn(0x7f24a40f1cd0 msgr2=0x7f24a40f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:13:59.078 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.076+0000 7f24aa808700 1 -- 172.21.15.26:0/919436361 shutdown_connections 2021-11-03T18:13:59.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.076+0000 7f24aa808700 1 -- 172.21.15.26:0/919436361 wait complete. 2021-11-03T18:13:59.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.076+0000 7f24aa808700 1 Processor -- start 2021-11-03T18:13:59.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.076+0000 7f24aa808700 1 -- start start 2021-11-03T18:13:59.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.076+0000 7f24aa808700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24a40f6530 0x7f24a406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:13:59.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.076+0000 7f24aa808700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24a40f77d0 0x7f24a4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:13:59.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.076+0000 7f24aa808700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a406a380 con 0x7f24a40f77d0 2021-11-03T18:13:59.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.076+0000 7f24aa808700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a406a4c0 con 0x7f24a40f6530 2021-11-03T18:13:59.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.076+0000 7f24a9005700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24a40f77d0 0x7f24a4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:13:59.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.076+0000 7f24a9005700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24a40f77d0 0x7f24a4069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58898/0 (socket says 172.21.15.26:58898) 2021-11-03T18:13:59.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.076+0000 7f24a9005700 1 -- 172.21.15.26:0/2223995405 learned_addr learned my addr 172.21.15.26:0/2223995405 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:13:59.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.077+0000 7f24a9806700 1 --2- 172.21.15.26:0/2223995405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24a40f6530 0x7f24a406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:13:59.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.077+0000 7f24a9005700 1 -- 172.21.15.26:0/2223995405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24a40f6530 msgr2=0x7f24a406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:13:59.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.077+0000 7f24a9005700 1 --2- 172.21.15.26:0/2223995405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24a40f6530 0x7f24a406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:59.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.077+0000 7f24a9005700 1 -- 172.21.15.26:0/2223995405 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2494005040 con 0x7f24a40f77d0 2021-11-03T18:13:59.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.077+0000 7f24a9806700 1 --2- 172.21.15.26:0/2223995405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24a40f6530 0x7f24a406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:13:59.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.077+0000 7f24a9005700 1 --2- 172.21.15.26:0/2223995405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24a40f77d0 0x7f24a4069e20 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 rx=0x7f2494000c00 tx=0x7f249400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:13:59.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.077+0000 7f249a7fc700 1 -- 172.21.15.26:0/2223995405 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2494019070 con 0x7f24a40f77d0 2021-11-03T18:13:59.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.077+0000 7f24aa808700 1 -- 172.21.15.26:0/2223995405 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a406a740 con 0x7f24a40f77d0 2021-11-03T18:13:59.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.077+0000 7f249a7fc700 1 -- 172.21.15.26:0/2223995405 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2494007e70 con 0x7f24a40f77d0 2021-11-03T18:13:59.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.077+0000 7f249a7fc700 1 -- 172.21.15.26:0/2223995405 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2494014d90 con 0x7f24a40f77d0 2021-11-03T18:13:59.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.077+0000 7f24aa808700 1 -- 172.21.15.26:0/2223995405 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a406aca0 con 0x7f24a40f77d0 2021-11-03T18:13:59.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.078+0000 7f24aa808700 1 -- 172.21.15.26:0/2223995405 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24a4045ad0 con 0x7f24a40f77d0 2021-11-03T18:13:59.085 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.078+0000 7f249a7fc700 1 -- 172.21.15.26:0/2223995405 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f2494025070 con 0x7f24a40f77d0 2021-11-03T18:13:59.085 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.079+0000 7f249a7fc700 1 --2- 172.21.15.26:0/2223995405 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2490064100 0x7f24900665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:13:59.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.079+0000 7f249a7fc700 1 -- 172.21.15.26:0/2223995405 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f24940817a0 con 0x7f24a40f77d0 2021-11-03T18:13:59.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.079+0000 7f24a9806700 1 --2- 172.21.15.26:0/2223995405 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2490064100 0x7f24900665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:13:59.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.079+0000 7f24a9806700 1 --2- 172.21.15.26:0/2223995405 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2490064100 0x7f24900665c0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f24a0009da0 tx=0x7f24a000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:13:59.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.083+0000 7f249a7fc700 1 -- 172.21.15.26:0/2223995405 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f2494053b00 con 0x7f24a40f77d0 2021-11-03T18:13:59.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:58 smithi194 ceph-mon[65619]: pgmap v2379: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:59.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:58 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/925663021' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:13:59.285 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.287+0000 7f24aa808700 1 -- 172.21.15.26:0/2223995405 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f24a4027a00 con 0x7f24a40f77d0 2021-11-03T18:13:59.286 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.287+0000 7f249a7fc700 1 -- 172.21.15.26:0/2223995405 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f2494023020 con 0x7f24a40f77d0 2021-11-03T18:13:59.287 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:13:59.287 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:13:59.287 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:13:59.287 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:13:59.288 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:13:59.288 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:13:59.288 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:13:59.289 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:13:59.289 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:13:59.289 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:13:59.290 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:13:59.290 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:13:59.291 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:13:59.291 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:13:59.291 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:13:59.292 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:13:59.292 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:13:59.293 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:13:59.293 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:13:59.293 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:13:59.293 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:13:59.294 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:13:59.294 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:13:59.294 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:13:59.294 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:13:59.294 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:13:59.295 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:13:59.295 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:13:59.295 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:13:59.295 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:13:59.296 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:13:59.296 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:13:59.296 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:13:59.296 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:13:59.297 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:13:59.297 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:13:59.297 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:13:59.298 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:13:59.298 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:13:59.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.289+0000 7f24aa808700 1 -- 172.21.15.26:0/2223995405 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2490064100 msgr2=0x7f24900665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:13:59.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.289+0000 7f24aa808700 1 --2- 172.21.15.26:0/2223995405 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2490064100 0x7f24900665c0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f24a0009da0 tx=0x7f24a000b040).stop 2021-11-03T18:13:59.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.289+0000 7f24aa808700 1 -- 172.21.15.26:0/2223995405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24a40f77d0 msgr2=0x7f24a4069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:13:59.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.289+0000 7f24aa808700 1 --2- 172.21.15.26:0/2223995405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24a40f77d0 0x7f24a4069e20 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 rx=0x7f2494000c00 tx=0x7f249400b040).stop 2021-11-03T18:13:59.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.289+0000 7f24aa808700 1 -- 172.21.15.26:0/2223995405 shutdown_connections 2021-11-03T18:13:59.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.289+0000 7f24aa808700 1 --2- 172.21.15.26:0/2223995405 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2490064100 0x7f24900665c0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:59.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.289+0000 7f24aa808700 1 --2- 172.21.15.26:0/2223995405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24a40f6530 0x7f24a406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:59.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.289+0000 7f24aa808700 1 --2- 172.21.15.26:0/2223995405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24a40f77d0 0x7f24a4069e20 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:13:59.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.289+0000 7f24aa808700 1 -- 172.21.15.26:0/2223995405 >> 172.21.15.26:0/2223995405 conn(0x7f24a40f1cd0 msgr2=0x7f24a40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:13:59.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.289+0000 7f24aa808700 1 -- 172.21.15.26:0/2223995405 shutdown_connections 2021-11-03T18:13:59.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:13:59.289+0000 7f24aa808700 1 -- 172.21.15.26:0/2223995405 wait complete. 2021-11-03T18:13:59.302 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:13:59.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:58 smithi026 ceph-mon[96795]: pgmap v2379: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:13:59.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:58 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/925663021' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:14:00.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:59 smithi194 ceph-mon[65619]: from='client.36588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:14:00.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:59 smithi194 ceph-mon[65619]: from='client.36592 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:14:00.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:13:59 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2223995405' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:14:00.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:59 smithi026 ceph-mon[96795]: from='client.36588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:14:00.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:59 smithi026 ceph-mon[96795]: from='client.36592 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:14:00.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:13:59 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2223995405' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:14:01.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:00 smithi194 ceph-mon[65619]: pgmap v2380: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:01.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:00 smithi026 ceph-mon[96795]: pgmap v2380: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:03.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:02 smithi194 ceph-mon[65619]: pgmap v2381: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:03.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:02 smithi026 ceph-mon[96795]: pgmap v2381: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:05.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:04 smithi194 ceph-mon[65619]: pgmap v2382: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:05.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:04 smithi026 ceph-mon[96795]: pgmap v2382: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:07.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:07 smithi194 ceph-mon[65619]: pgmap v2383: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:07.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:07 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:14:07.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:07 smithi026 ceph-mon[96795]: pgmap v2383: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:07.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:07 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:14:08.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:08 smithi194 ceph-mon[65619]: poll took 60065.057 ms: 1 events 2021-11-03T18:14:08.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:08 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:14:08.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:08 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:14:08.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:08 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:14:08.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:08 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:14:08.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:08 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:14:08.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:08 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:14:08.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:08 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:14:08.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:08 smithi026 ceph-mon[96795]: poll took 60065.057 ms: 1 events 2021-11-03T18:14:08.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:08 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:14:08.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:08 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:14:08.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:08 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:14:08.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:08 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:14:08.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:08 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:14:08.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:08 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:14:08.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:08 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:14:09.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:09 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:14:09.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:09 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:14:09.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:09 smithi026 ceph-mon[96795]: pgmap v2384: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:09.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:09 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:14:09.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:09 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:14:09.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:09 smithi194 ceph-mon[65619]: pgmap v2384: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:11.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:11 smithi026 ceph-mon[96795]: pgmap v2385: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:11.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:11 smithi194 ceph-mon[65619]: pgmap v2385: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:13.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:13 smithi026 ceph-mon[96795]: pgmap v2386: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:13.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:13 smithi194 ceph-mon[65619]: pgmap v2386: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:15.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:15 smithi026 ceph-mon[96795]: pgmap v2387: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:15.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:15 smithi194 ceph-mon[65619]: pgmap v2387: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:17.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:17 smithi026 ceph-mon[96795]: pgmap v2388: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:17.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:17 smithi194 ceph-mon[65619]: pgmap v2388: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:19.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:19 smithi026 ceph-mon[96795]: pgmap v2389: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:19.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:19 smithi194 ceph-mon[65619]: pgmap v2389: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:21.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:21 smithi026 ceph-mon[96795]: pgmap v2390: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:21.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:21 smithi194 ceph-mon[65619]: pgmap v2390: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:23.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:23 smithi026 ceph-mon[96795]: pgmap v2391: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:23.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:23 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:14:23.473 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:23 smithi194 ceph-mon[65619]: pgmap v2391: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:23.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:23 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:14:24.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:24 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:14:24.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:24 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:14:25.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:25 smithi026 ceph-mon[96795]: pgmap v2392: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:25.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:25 smithi194 ceph-mon[65619]: pgmap v2392: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:27.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:27 smithi026 ceph-mon[96795]: pgmap v2393: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:27.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:27 smithi194 ceph-mon[65619]: pgmap v2393: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:29.405 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.405+0000 7ff2eb6b0700 1 -- 172.21.15.26:0/920141291 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2e40f6c30 msgr2=0x7ff2e40f7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:14:29.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.405+0000 7ff2eb6b0700 1 --2- 172.21.15.26:0/920141291 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2e40f6c30 0x7ff2e40f7050 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7ff2d4009a10 tx=0x7ff2d4004d10).stop 2021-11-03T18:14:29.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.405+0000 7ff2eb6b0700 1 -- 172.21.15.26:0/920141291 shutdown_connections 2021-11-03T18:14:29.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.405+0000 7ff2eb6b0700 1 --2- 172.21.15.26:0/920141291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2e40f7540 0x7ff2e40fdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:14:29.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.405+0000 7ff2eb6b0700 1 --2- 172.21.15.26:0/920141291 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2e40f6c30 0x7ff2e40f7050 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:14:29.428 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.405+0000 7ff2eb6b0700 1 -- 172.21.15.26:0/920141291 >> 172.21.15.26:0/920141291 conn(0x7ff2e40f0540 msgr2=0x7ff2e40f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:14:29.428 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.405+0000 7ff2eb6b0700 1 -- 172.21.15.26:0/920141291 shutdown_connections 2021-11-03T18:14:29.428 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.405+0000 7ff2eb6b0700 1 -- 172.21.15.26:0/920141291 wait complete. 2021-11-03T18:14:29.428 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.405+0000 7ff2eb6b0700 1 Processor -- start 2021-11-03T18:14:29.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.406+0000 7ff2eb6b0700 1 -- start start 2021-11-03T18:14:29.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.406+0000 7ff2eb6b0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2e40f6c30 0x7ff2e4109260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:14:29.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.406+0000 7ff2eb6b0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2e40f7540 0x7ff2e4109750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:14:29.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.406+0000 7ff2eb6b0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e4109d00 con 0x7ff2e40f6c30 2021-11-03T18:14:29.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.406+0000 7ff2eb6b0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e4109e40 con 0x7ff2e40f7540 2021-11-03T18:14:29.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.406+0000 7ff2e944c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2e40f6c30 0x7ff2e4109260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:14:29.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.406+0000 7ff2e944c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2e40f6c30 0x7ff2e4109260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58914/0 (socket says 172.21.15.26:58914) 2021-11-03T18:14:29.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.406+0000 7ff2e944c700 1 -- 172.21.15.26:0/1826565690 learned_addr learned my addr 172.21.15.26:0/1826565690 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:14:29.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.406+0000 7ff2e8c4b700 1 --2- 172.21.15.26:0/1826565690 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2e40f7540 0x7ff2e4109750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:14:29.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.406+0000 7ff2e944c700 1 -- 172.21.15.26:0/1826565690 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2e40f7540 msgr2=0x7ff2e4109750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:14:29.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.406+0000 7ff2e944c700 1 --2- 172.21.15.26:0/1826565690 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2e40f7540 0x7ff2e4109750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:14:29.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.406+0000 7ff2e944c700 1 -- 172.21.15.26:0/1826565690 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d4009640 con 0x7ff2e40f6c30 2021-11-03T18:14:29.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.406+0000 7ff2e8c4b700 1 --2- 172.21.15.26:0/1826565690 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2e40f7540 0x7ff2e4109750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:14:29.432 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.406+0000 7ff2e944c700 1 --2- 172.21.15.26:0/1826565690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2e40f6c30 0x7ff2e4109260 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 rx=0x7ff2d4004750 tx=0x7ff2d4004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:14:29.432 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.406+0000 7ff2e1ffb700 1 -- 172.21.15.26:0/1826565690 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2d400e070 con 0x7ff2e40f6c30 2021-11-03T18:14:29.432 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.407+0000 7ff2e1ffb700 1 -- 172.21.15.26:0/1826565690 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff2d4007dc0 con 0x7ff2e40f6c30 2021-11-03T18:14:29.432 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.407+0000 7ff2eb6b0700 1 -- 172.21.15.26:0/1826565690 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e410a780 con 0x7ff2e40f6c30 2021-11-03T18:14:29.433 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.407+0000 7ff2e1ffb700 1 -- 172.21.15.26:0/1826565690 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2d4018070 con 0x7ff2e40f6c30 2021-11-03T18:14:29.433 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.407+0000 7ff2eb6b0700 1 -- 172.21.15.26:0/1826565690 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e410ac60 con 0x7ff2e40f6c30 2021-11-03T18:14:29.433 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.408+0000 7ff2eb6b0700 1 -- 172.21.15.26:0/1826565690 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e4045ad0 con 0x7ff2e40f6c30 2021-11-03T18:14:29.434 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.408+0000 7ff2e1ffb700 1 -- 172.21.15.26:0/1826565690 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ff2d4024060 con 0x7ff2e40f6c30 2021-11-03T18:14:29.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.409+0000 7ff2e1ffb700 1 --2- 172.21.15.26:0/1826565690 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff2cc0640b0 0x7ff2cc066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:14:29.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.409+0000 7ff2e1ffb700 1 -- 172.21.15.26:0/1826565690 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ff2d4081eb0 con 0x7ff2e40f6c30 2021-11-03T18:14:29.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.409+0000 7ff2e8c4b700 1 --2- 172.21.15.26:0/1826565690 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff2cc0640b0 0x7ff2cc066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:14:29.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.409+0000 7ff2e8c4b700 1 --2- 172.21.15.26:0/1826565690 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff2cc0640b0 0x7ff2cc066570 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7ff2d8007800 tx=0x7ff2d8009d00).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:14:29.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.413+0000 7ff2e1ffb700 1 -- 172.21.15.26:0/1826565690 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ff2d4054210 con 0x7ff2e40f6c30 2021-11-03T18:14:29.436 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:29 smithi026 ceph-mon[96795]: pgmap v2394: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:29.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:29 smithi194 ceph-mon[65619]: pgmap v2394: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:29.588 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.590+0000 7ff2eb6b0700 1 -- 172.21.15.26:0/1826565690 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2e41011f0 con 0x7ff2cc0640b0 2021-11-03T18:14:29.589 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.592+0000 7ff2e1ffb700 1 -- 172.21.15.26:0/1826565690 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7ff2e41011f0 con 0x7ff2cc0640b0 2021-11-03T18:14:29.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.593+0000 7ff2eb6b0700 1 -- 172.21.15.26:0/1826565690 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff2cc0640b0 msgr2=0x7ff2cc066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:14:29.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.593+0000 7ff2eb6b0700 1 --2- 172.21.15.26:0/1826565690 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff2cc0640b0 0x7ff2cc066570 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7ff2d8007800 tx=0x7ff2d8009d00).stop 2021-11-03T18:14:29.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.593+0000 7ff2eb6b0700 1 -- 172.21.15.26:0/1826565690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2e40f6c30 msgr2=0x7ff2e4109260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:14:29.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.593+0000 7ff2eb6b0700 1 --2- 172.21.15.26:0/1826565690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2e40f6c30 0x7ff2e4109260 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 rx=0x7ff2d4004750 tx=0x7ff2d4004d10).stop 2021-11-03T18:14:29.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.593+0000 7ff2eb6b0700 1 -- 172.21.15.26:0/1826565690 shutdown_connections 2021-11-03T18:14:29.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.593+0000 7ff2eb6b0700 1 --2- 172.21.15.26:0/1826565690 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff2cc0640b0 0x7ff2cc066570 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:14:29.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.593+0000 7ff2eb6b0700 1 --2- 172.21.15.26:0/1826565690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2e40f6c30 0x7ff2e4109260 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:14:29.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.593+0000 7ff2eb6b0700 1 --2- 172.21.15.26:0/1826565690 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2e40f7540 0x7ff2e4109750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:14:29.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.594+0000 7ff2eb6b0700 1 -- 172.21.15.26:0/1826565690 >> 172.21.15.26:0/1826565690 conn(0x7ff2e40f0540 msgr2=0x7ff2e40f2930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:14:29.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.594+0000 7ff2eb6b0700 1 -- 172.21.15.26:0/1826565690 shutdown_connections 2021-11-03T18:14:29.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.594+0000 7ff2eb6b0700 1 -- 172.21.15.26:0/1826565690 wait complete. 2021-11-03T18:14:29.601 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:14:29.693 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.693+0000 7f17b0b8d700 1 -- 172.21.15.26:0/1220906585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17ac0f66c0 msgr2=0x7f17ac0f6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:14:29.693 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.693+0000 7f17b0b8d700 1 --2- 172.21.15.26:0/1220906585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17ac0f66c0 0x7f17ac0f6b20 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 rx=0x7f1794004660 tx=0x7f1794009b30).stop 2021-11-03T18:14:29.693 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.693+0000 7f17b0b8d700 1 -- 172.21.15.26:0/1220906585 shutdown_connections 2021-11-03T18:14:29.693 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.693+0000 7f17b0b8d700 1 --2- 172.21.15.26:0/1220906585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17ac0f66c0 0x7f17ac0f6b20 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:14:29.694 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.693+0000 7f17b0b8d700 1 --2- 172.21.15.26:0/1220906585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17ac0f5420 0x7f17ac0f5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:14:29.694 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.693+0000 7f17b0b8d700 1 -- 172.21.15.26:0/1220906585 >> 172.21.15.26:0/1220906585 conn(0x7f17ac0f0b60 msgr2=0x7f17ac0f2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:14:29.694 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.693+0000 7f17b0b8d700 1 -- 172.21.15.26:0/1220906585 shutdown_connections 2021-11-03T18:14:29.694 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.693+0000 7f17b0b8d700 1 -- 172.21.15.26:0/1220906585 wait complete. 2021-11-03T18:14:29.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.694+0000 7f17b0b8d700 1 Processor -- start 2021-11-03T18:14:29.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.694+0000 7f17b0b8d700 1 -- start start 2021-11-03T18:14:29.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.694+0000 7f17b0b8d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17ac0f5420 0x7f17ac104b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:14:29.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.694+0000 7f17b0b8d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17ac0f66c0 0x7f17ac105010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:14:29.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.694+0000 7f17b0b8d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ac1055c0 con 0x7f17ac0f66c0 2021-11-03T18:14:29.696 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.694+0000 7f17b0b8d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ac105700 con 0x7f17ac0f5420 2021-11-03T18:14:29.696 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.694+0000 7f17a3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17ac0f66c0 0x7f17ac105010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:14:29.696 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.694+0000 7f17a3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17ac0f66c0 0x7f17ac105010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58926/0 (socket says 172.21.15.26:58926) 2021-11-03T18:14:29.696 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.694+0000 7f17a3fff700 1 -- 172.21.15.26:0/2041157896 learned_addr learned my addr 172.21.15.26:0/2041157896 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:14:29.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.694+0000 7f17ab7fe700 1 --2- 172.21.15.26:0/2041157896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17ac0f5420 0x7f17ac104b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:14:29.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.695+0000 7f17a3fff700 1 -- 172.21.15.26:0/2041157896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17ac0f5420 msgr2=0x7f17ac104b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:14:29.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.695+0000 7f17a3fff700 1 --2- 172.21.15.26:0/2041157896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17ac0f5420 0x7f17ac104b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:14:29.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.695+0000 7f17a3fff700 1 -- 172.21.15.26:0/2041157896 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1794005040 con 0x7f17ac0f66c0 2021-11-03T18:14:29.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.695+0000 7f17a3fff700 1 --2- 172.21.15.26:0/2041157896 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17ac0f66c0 0x7f17ac105010 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 rx=0x7f1794009990 tx=0x7f1794009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:14:29.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.695+0000 7f17a8ff9700 1 -- 172.21.15.26:0/2041157896 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1794018070 con 0x7f17ac0f66c0 2021-11-03T18:14:29.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.695+0000 7f17b0b8d700 1 -- 172.21.15.26:0/2041157896 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17ac106040 con 0x7f17ac0f66c0 2021-11-03T18:14:29.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.695+0000 7f17a8ff9700 1 -- 172.21.15.26:0/2041157896 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1794007ca0 con 0x7f17ac0f66c0 2021-11-03T18:14:29.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.695+0000 7f17a8ff9700 1 -- 172.21.15.26:0/2041157896 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f179401c620 con 0x7f17ac0f66c0 2021-11-03T18:14:29.699 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.695+0000 7f17b0b8d700 1 -- 172.21.15.26:0/2041157896 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17ac1065a0 con 0x7f17ac0f66c0 2021-11-03T18:14:29.700 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.696+0000 7f17b0b8d700 1 -- 172.21.15.26:0/2041157896 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17ac045ad0 con 0x7f17ac0f66c0 2021-11-03T18:14:29.700 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.696+0000 7f17a8ff9700 1 -- 172.21.15.26:0/2041157896 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f179401d960 con 0x7f17ac0f66c0 2021-11-03T18:14:29.700 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.697+0000 7f17a8ff9700 1 --2- 172.21.15.26:0/2041157896 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1798066310 0x7f17980687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:14:29.701 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.697+0000 7f17a8ff9700 1 -- 172.21.15.26:0/2041157896 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f1794082520 con 0x7f17ac0f66c0 2021-11-03T18:14:29.701 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.697+0000 7f17ab7fe700 1 --2- 172.21.15.26:0/2041157896 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1798066310 0x7f17980687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:14:29.701 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.697+0000 7f17ab7fe700 1 --2- 172.21.15.26:0/2041157896 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1798066310 0x7f17980687d0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7f17ac0f6520 tx=0x7f179c009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:14:29.701 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.701+0000 7f17a8ff9700 1 -- 172.21.15.26:0/2041157896 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f1794054940 con 0x7f17ac0f66c0 2021-11-03T18:14:29.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.872+0000 7f17b0b8d700 1 -- 172.21.15.26:0/2041157896 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f17ac1067c0 con 0x7f1798066310 2021-11-03T18:14:29.884 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.886+0000 7f17a8ff9700 1 -- 172.21.15.26:0/2041157896 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f17ac1067c0 con 0x7f1798066310 2021-11-03T18:14:29.884 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:14:29.885 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (85m) 4m ago 87m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:14:29.885 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (77m) 4m ago 86m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:14:29.885 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (77m) 3m ago 86m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:14:29.885 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (85m) 4m ago 86m 42.0M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:14:29.886 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (78m) 4m ago 82m 25.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:14:29.886 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (79m) 4m ago 82m 26.4M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:14:29.886 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (82m) 3m ago 82m 26.6M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:14:29.886 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (82m) 3m ago 82m 27.0M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:14:29.887 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (79m) 4m ago 88m 574M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:14:29.887 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (79m) 3m ago 86m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:14:29.887 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (78m) 4m ago 88m 308M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:14:29.887 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (78m) 3m ago 86m 145M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:14:29.888 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (86m) 4m ago 86m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:14:29.888 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (85m) 3m ago 85m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:14:29.888 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (77m) 4m ago 85m 312M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:14:29.888 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (77m) 4m ago 85m 335M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:14:29.888 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (76m) 4m ago 84m 279M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:14:29.889 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (76m) 3m ago 84m 362M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:14:29.889 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (75m) 3m ago 84m 302M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:14:29.889 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (75m) 3m ago 83m 296M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:14:29.889 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (85m) 4m ago 86m 63.4M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:14:29.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.888+0000 7f17b0b8d700 1 -- 172.21.15.26:0/2041157896 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1798066310 msgr2=0x7f17980687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:14:29.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.888+0000 7f17b0b8d700 1 --2- 172.21.15.26:0/2041157896 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1798066310 0x7f17980687d0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7f17ac0f6520 tx=0x7f179c009040).stop 2021-11-03T18:14:29.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.888+0000 7f17b0b8d700 1 -- 172.21.15.26:0/2041157896 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17ac0f66c0 msgr2=0x7f17ac105010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:14:29.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.888+0000 7f17b0b8d700 1 --2- 172.21.15.26:0/2041157896 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17ac0f66c0 0x7f17ac105010 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 rx=0x7f1794009990 tx=0x7f1794009b30).stop 2021-11-03T18:14:29.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.889+0000 7f17b0b8d700 1 -- 172.21.15.26:0/2041157896 shutdown_connections 2021-11-03T18:14:29.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.889+0000 7f17b0b8d700 1 --2- 172.21.15.26:0/2041157896 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1798066310 0x7f17980687d0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:14:29.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.889+0000 7f17b0b8d700 1 --2- 172.21.15.26:0/2041157896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17ac0f5420 0x7f17ac104b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:14:29.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.889+0000 7f17b0b8d700 1 --2- 172.21.15.26:0/2041157896 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17ac0f66c0 0x7f17ac105010 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:14:29.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.889+0000 7f17b0b8d700 1 -- 172.21.15.26:0/2041157896 >> 172.21.15.26:0/2041157896 conn(0x7f17ac0f0b60 msgr2=0x7f17ac0fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:14:29.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.889+0000 7f17b0b8d700 1 -- 172.21.15.26:0/2041157896 shutdown_connections 2021-11-03T18:14:29.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.889+0000 7f17b0b8d700 1 -- 172.21.15.26:0/2041157896 wait complete. 2021-11-03T18:14:29.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.987+0000 7fed85020700 1 -- 172.21.15.26:0/3873578351 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed800f5240 msgr2=0x7fed800f7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:14:29.986 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.987+0000 7fed85020700 1 --2- 172.21.15.26:0/3873578351 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed800f5240 0x7fed800f7b80 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7fed74004660 tx=0x7fed74009b30).stop 2021-11-03T18:14:29.986 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.987+0000 7fed85020700 1 -- 172.21.15.26:0/3873578351 shutdown_connections 2021-11-03T18:14:29.986 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.987+0000 7fed85020700 1 --2- 172.21.15.26:0/3873578351 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed800f5240 0x7fed800f7b80 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:14:29.986 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.987+0000 7fed85020700 1 --2- 172.21.15.26:0/3873578351 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed800f48a0 0x7fed800f4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:14:29.987 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.987+0000 7fed85020700 1 -- 172.21.15.26:0/3873578351 >> 172.21.15.26:0/3873578351 conn(0x7fed800f0320 msgr2=0x7fed800f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:14:29.987 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.987+0000 7fed85020700 1 -- 172.21.15.26:0/3873578351 shutdown_connections 2021-11-03T18:14:29.987 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.987+0000 7fed85020700 1 -- 172.21.15.26:0/3873578351 wait complete. 2021-11-03T18:14:29.987 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.988+0000 7fed85020700 1 Processor -- start 2021-11-03T18:14:29.988 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.988+0000 7fed85020700 1 -- start start 2021-11-03T18:14:29.990 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.988+0000 7fed85020700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed800f48a0 0x7fed80106ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:14:29.990 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.988+0000 7fed85020700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed800f5240 0x7fed801073b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:14:29.990 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.988+0000 7fed85020700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed80107960 con 0x7fed800f5240 2021-11-03T18:14:29.991 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.988+0000 7fed85020700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed80107aa0 con 0x7fed800f48a0 2021-11-03T18:14:29.991 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.989+0000 7fed7f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed800f5240 0x7fed801073b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:14:29.991 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.989+0000 7fed7f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed800f5240 0x7fed801073b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58936/0 (socket says 172.21.15.26:58936) 2021-11-03T18:14:29.991 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.989+0000 7fed7f7fe700 1 -- 172.21.15.26:0/4054012433 learned_addr learned my addr 172.21.15.26:0/4054012433 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:14:29.991 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.989+0000 7fed7ffff700 1 --2- 172.21.15.26:0/4054012433 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed800f48a0 0x7fed80106ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:14:29.992 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.989+0000 7fed7f7fe700 1 -- 172.21.15.26:0/4054012433 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed800f48a0 msgr2=0x7fed80106ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:14:29.992 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.989+0000 7fed7f7fe700 1 --2- 172.21.15.26:0/4054012433 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed800f48a0 0x7fed80106ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:14:29.992 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.989+0000 7fed7f7fe700 1 -- 172.21.15.26:0/4054012433 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed74005040 con 0x7fed800f5240 2021-11-03T18:14:29.992 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.989+0000 7fed7f7fe700 1 --2- 172.21.15.26:0/4054012433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed800f5240 0x7fed801073b0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 rx=0x7fed74013a70 tx=0x7fed74009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:14:29.993 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.989+0000 7fed7cff9700 1 -- 172.21.15.26:0/4054012433 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed74018070 con 0x7fed800f5240 2021-11-03T18:14:29.993 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.989+0000 7fed7cff9700 1 -- 172.21.15.26:0/4054012433 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fed740097d0 con 0x7fed800f5240 2021-11-03T18:14:29.993 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.989+0000 7fed85020700 1 -- 172.21.15.26:0/4054012433 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed801083e0 con 0x7fed800f5240 2021-11-03T18:14:29.994 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.989+0000 7fed7cff9700 1 -- 172.21.15.26:0/4054012433 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed7401de80 con 0x7fed800f5240 2021-11-03T18:14:29.994 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.989+0000 7fed85020700 1 -- 172.21.15.26:0/4054012433 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed80108940 con 0x7fed800f5240 2021-11-03T18:14:29.994 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.990+0000 7fed85020700 1 -- 172.21.15.26:0/4054012433 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed80045ad0 con 0x7fed800f5240 2021-11-03T18:14:29.994 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.991+0000 7fed7cff9700 1 -- 172.21.15.26:0/4054012433 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fed74007ba0 con 0x7fed800f5240 2021-11-03T18:14:29.994 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.991+0000 7fed7cff9700 1 --2- 172.21.15.26:0/4054012433 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fed68064100 0x7fed680665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:14:29.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.991+0000 7fed7cff9700 1 -- 172.21.15.26:0/4054012433 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fed740823d0 con 0x7fed800f5240 2021-11-03T18:14:29.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.991+0000 7fed7ffff700 1 --2- 172.21.15.26:0/4054012433 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fed68064100 0x7fed680665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:14:29.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.991+0000 7fed7ffff700 1 --2- 172.21.15.26:0/4054012433 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fed68064100 0x7fed680665c0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7fed70004ce0 tx=0x7fed7000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:14:29.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:29.995+0000 7fed7cff9700 1 -- 172.21.15.26:0/4054012433 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fed740547f0 con 0x7fed800f5240 2021-11-03T18:14:30.225 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.227+0000 7fed85020700 1 -- 172.21.15.26:0/4054012433 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fed800fef50 con 0x7fed800f5240 2021-11-03T18:14:30.225 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.228+0000 7fed7cff9700 1 -- 172.21.15.26:0/4054012433 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fed740543e0 con 0x7fed800f5240 2021-11-03T18:14:30.226 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:14:30.226 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:14:30.227 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:14:30.227 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:14:30.227 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:14:30.227 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:14:30.227 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:14:30.228 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:14:30.228 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:14:30.228 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:14:30.228 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:14:30.229 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:14:30.229 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:14:30.229 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:14:30.229 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:14:30.229 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:14:30.230 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:14:30.230 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:14:30.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.229+0000 7fed85020700 1 -- 172.21.15.26:0/4054012433 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fed68064100 msgr2=0x7fed680665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:14:30.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.229+0000 7fed85020700 1 --2- 172.21.15.26:0/4054012433 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fed68064100 0x7fed680665c0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7fed70004ce0 tx=0x7fed7000b040).stop 2021-11-03T18:14:30.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.229+0000 7fed85020700 1 -- 172.21.15.26:0/4054012433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed800f5240 msgr2=0x7fed801073b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:14:30.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.229+0000 7fed85020700 1 --2- 172.21.15.26:0/4054012433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed800f5240 0x7fed801073b0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 rx=0x7fed74013a70 tx=0x7fed74009b30).stop 2021-11-03T18:14:30.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.230+0000 7fed85020700 1 -- 172.21.15.26:0/4054012433 shutdown_connections 2021-11-03T18:14:30.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.230+0000 7fed85020700 1 --2- 172.21.15.26:0/4054012433 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fed68064100 0x7fed680665c0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:14:30.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.230+0000 7fed85020700 1 --2- 172.21.15.26:0/4054012433 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed800f48a0 0x7fed80106ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:14:30.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.230+0000 7fed85020700 1 --2- 172.21.15.26:0/4054012433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed800f5240 0x7fed801073b0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:14:30.233 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.230+0000 7fed85020700 1 -- 172.21.15.26:0/4054012433 >> 172.21.15.26:0/4054012433 conn(0x7fed800f0320 msgr2=0x7fed800fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:14:30.233 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.230+0000 7fed85020700 1 -- 172.21.15.26:0/4054012433 shutdown_connections 2021-11-03T18:14:30.233 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.230+0000 7fed85020700 1 -- 172.21.15.26:0/4054012433 wait complete. 2021-11-03T18:14:30.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.331+0000 7f62bb043700 1 -- 172.21.15.26:0/2891476475 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62b40f5ed0 msgr2=0x7f62b40f6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:14:30.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.331+0000 7f62bb043700 1 --2- 172.21.15.26:0/2891476475 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62b40f5ed0 0x7f62b40f6900 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7f62a0004660 tx=0x7f62a0009b30).stop 2021-11-03T18:14:30.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.331+0000 7f62bb043700 1 -- 172.21.15.26:0/2891476475 shutdown_connections 2021-11-03T18:14:30.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.331+0000 7f62bb043700 1 --2- 172.21.15.26:0/2891476475 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62b40f5ed0 0x7f62b40f6900 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:14:30.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.331+0000 7f62bb043700 1 --2- 172.21.15.26:0/2891476475 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62b40f55c0 0x7f62b40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:14:30.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.331+0000 7f62bb043700 1 -- 172.21.15.26:0/2891476475 >> 172.21.15.26:0/2891476475 conn(0x7f62b40f0dc0 msgr2=0x7f62b40f31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:14:30.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.331+0000 7f62bb043700 1 -- 172.21.15.26:0/2891476475 shutdown_connections 2021-11-03T18:14:30.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.331+0000 7f62bb043700 1 -- 172.21.15.26:0/2891476475 wait complete. 2021-11-03T18:14:30.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.332+0000 7f62bb043700 1 Processor -- start 2021-11-03T18:14:30.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.332+0000 7f62bb043700 1 -- start start 2021-11-03T18:14:30.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.332+0000 7f62bb043700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62b40f55c0 0x7f62b4109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:14:30.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.332+0000 7f62bb043700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62b40f5ed0 0x7f62b410c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:14:30.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.332+0000 7f62bb043700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b4060540 con 0x7f62b40f55c0 2021-11-03T18:14:30.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.332+0000 7f62bb043700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b4060680 con 0x7f62b40f5ed0 2021-11-03T18:14:30.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.332+0000 7f62b8ddf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62b40f55c0 0x7f62b4109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:14:30.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.332+0000 7f62b8ddf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62b40f55c0 0x7f62b4109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58944/0 (socket says 172.21.15.26:58944) 2021-11-03T18:14:30.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.332+0000 7f62b8ddf700 1 -- 172.21.15.26:0/4199792369 learned_addr learned my addr 172.21.15.26:0/4199792369 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:14:30.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.332+0000 7f62b3fff700 1 --2- 172.21.15.26:0/4199792369 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62b40f5ed0 0x7f62b410c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:14:30.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.333+0000 7f62b8ddf700 1 -- 172.21.15.26:0/4199792369 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62b40f5ed0 msgr2=0x7f62b410c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:14:30.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.333+0000 7f62b8ddf700 1 --2- 172.21.15.26:0/4199792369 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62b40f5ed0 0x7f62b410c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:14:30.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.333+0000 7f62b8ddf700 1 -- 172.21.15.26:0/4199792369 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a0005040 con 0x7f62b40f55c0 2021-11-03T18:14:30.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.333+0000 7f62b3fff700 1 --2- 172.21.15.26:0/4199792369 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62b40f5ed0 0x7f62b410c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:14:30.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.333+0000 7f62b8ddf700 1 --2- 172.21.15.26:0/4199792369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62b40f55c0 0x7f62b4109c90 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 rx=0x7f62a800c530 tx=0x7f62a8007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:14:30.338 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.333+0000 7f62b17fa700 1 -- 172.21.15.26:0/4199792369 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62a800f650 con 0x7f62b40f55c0 2021-11-03T18:14:30.338 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.333+0000 7f62b17fa700 1 -- 172.21.15.26:0/4199792369 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f62a800fc60 con 0x7f62b40f55c0 2021-11-03T18:14:30.339 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.333+0000 7f62bb043700 1 -- 172.21.15.26:0/4199792369 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b410c740 con 0x7f62b40f55c0 2021-11-03T18:14:30.339 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.333+0000 7f62b17fa700 1 -- 172.21.15.26:0/4199792369 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62a8012cd0 con 0x7f62b40f55c0 2021-11-03T18:14:30.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.333+0000 7f62bb043700 1 -- 172.21.15.26:0/4199792369 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b410ccd0 con 0x7f62b40f55c0 2021-11-03T18:14:30.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.334+0000 7f62bb043700 1 -- 172.21.15.26:0/4199792369 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62b40f4a50 con 0x7f62b40f55c0 2021-11-03T18:14:30.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.334+0000 7f62b17fa700 1 -- 172.21.15.26:0/4199792369 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f62a8010070 con 0x7f62b40f55c0 2021-11-03T18:14:30.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.335+0000 7f62b17fa700 1 --2- 172.21.15.26:0/4199792369 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f62a4064090 0x7f62a4066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:14:30.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.335+0000 7f62b17fa700 1 -- 172.21.15.26:0/4199792369 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f62a8080610 con 0x7f62b40f55c0 2021-11-03T18:14:30.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.335+0000 7f62b3fff700 1 --2- 172.21.15.26:0/4199792369 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f62a4064090 0x7f62a4066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:14:30.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.335+0000 7f62b3fff700 1 --2- 172.21.15.26:0/4199792369 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f62a4064090 0x7f62a4066550 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f62a0004e30 tx=0x7f62a0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:14:30.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.339+0000 7f62b17fa700 1 -- 172.21.15.26:0/4199792369 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f62a8052880 con 0x7f62b40f55c0 2021-11-03T18:14:30.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.546+0000 7f62bb043700 1 -- 172.21.15.26:0/4199792369 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f62b4027a00 con 0x7f62b40f55c0 2021-11-03T18:14:30.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.546+0000 7f62b17fa700 1 -- 172.21.15.26:0/4199792369 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f62a8052470 con 0x7f62b40f55c0 2021-11-03T18:14:30.545 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:14:30.545 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:14:30.545 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:14:30.546 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:14:30.546 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:14:30.546 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:14:30.546 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:14:30.547 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:14:30.547 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:14:30.547 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:14:30.547 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:14:30.548 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:14:30.548 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:14:30.548 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:14:30.548 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:14:30.549 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:14:30.549 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:14:30.549 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:14:30.549 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:14:30.550 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:14:30.550 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:14:30.550 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:14:30.551 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:14:30.551 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:14:30.551 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:14:30.551 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:14:30.552 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:14:30.552 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:14:30.552 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:14:30.552 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:14:30.552 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:14:30.553 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:14:30.553 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:14:30.553 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:14:30.553 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:14:30.554 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:14:30.554 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:14:30.554 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:14:30.554 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:14:30.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.548+0000 7f62bb043700 1 -- 172.21.15.26:0/4199792369 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f62a4064090 msgr2=0x7f62a4066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:14:30.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.548+0000 7f62bb043700 1 --2- 172.21.15.26:0/4199792369 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f62a4064090 0x7f62a4066550 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f62a0004e30 tx=0x7f62a0009b30).stop 2021-11-03T18:14:30.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.548+0000 7f62bb043700 1 -- 172.21.15.26:0/4199792369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62b40f55c0 msgr2=0x7f62b4109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:14:30.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.548+0000 7f62bb043700 1 --2- 172.21.15.26:0/4199792369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62b40f55c0 0x7f62b4109c90 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 rx=0x7f62a800c530 tx=0x7f62a8007e20).stop 2021-11-03T18:14:30.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.548+0000 7f62bb043700 1 -- 172.21.15.26:0/4199792369 shutdown_connections 2021-11-03T18:14:30.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.548+0000 7f62bb043700 1 --2- 172.21.15.26:0/4199792369 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f62a4064090 0x7f62a4066550 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:14:30.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.548+0000 7f62bb043700 1 --2- 172.21.15.26:0/4199792369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62b40f55c0 0x7f62b4109c90 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:14:30.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.548+0000 7f62bb043700 1 --2- 172.21.15.26:0/4199792369 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62b40f5ed0 0x7f62b410c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:14:30.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.548+0000 7f62bb043700 1 -- 172.21.15.26:0/4199792369 >> 172.21.15.26:0/4199792369 conn(0x7f62b40f0dc0 msgr2=0x7f62b40fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:14:30.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.548+0000 7f62bb043700 1 -- 172.21.15.26:0/4199792369 shutdown_connections 2021-11-03T18:14:30.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:14:30.548+0000 7f62bb043700 1 -- 172.21.15.26:0/4199792369 wait complete. 2021-11-03T18:14:30.558 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:14:31.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:30 smithi194 ceph-mon[65619]: from='client.36604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:14:31.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:30 smithi194 ceph-mon[65619]: pgmap v2395: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:31.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:30 smithi194 ceph-mon[65619]: from='client.36608 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:14:31.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:30 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/4054012433' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:14:31.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:30 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/4199792369' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:14:31.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:30 smithi026 ceph-mon[96795]: from='client.36604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:14:31.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:30 smithi026 ceph-mon[96795]: pgmap v2395: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:31.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:30 smithi026 ceph-mon[96795]: from='client.36608 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:14:31.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:30 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/4054012433' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:14:31.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:30 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/4199792369' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:14:33.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:32 smithi194 ceph-mon[65619]: pgmap v2396: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:33.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:32 smithi026 ceph-mon[96795]: pgmap v2396: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:35.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:34 smithi194 ceph-mon[65619]: pgmap v2397: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:35.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:34 smithi026 ceph-mon[96795]: pgmap v2397: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:37.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:36 smithi194 ceph-mon[65619]: pgmap v2398: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:37.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:36 smithi026 ceph-mon[96795]: pgmap v2398: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:38.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:37 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:14:38.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:37 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:14:39.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:38 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:14:39.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:38 smithi194 ceph-mon[65619]: pgmap v2399: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:39.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:38 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:14:39.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:38 smithi026 ceph-mon[96795]: pgmap v2399: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:41.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:40 smithi194 ceph-mon[65619]: pgmap v2400: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:41.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:40 smithi026 ceph-mon[96795]: pgmap v2400: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:43.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:42 smithi194 ceph-mon[65619]: pgmap v2401: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:43.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:42 smithi026 ceph-mon[96795]: pgmap v2401: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:45.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:44 smithi026 ceph-mon[96795]: pgmap v2402: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:45.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:44 smithi194 ceph-mon[65619]: pgmap v2402: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:47.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:46 smithi026 ceph-mon[96795]: pgmap v2403: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:47.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:46 smithi194 ceph-mon[65619]: pgmap v2403: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:49.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:48 smithi026 ceph-mon[96795]: pgmap v2404: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:49.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:14:49.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:14:49.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:48 smithi194 ceph-mon[65619]: pgmap v2404: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:49.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:14:49.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:14:51.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:50 smithi026 ceph-mon[96795]: pgmap v2405: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:51.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:50 smithi194 ceph-mon[65619]: pgmap v2405: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:53.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:52 smithi026 ceph-mon[96795]: pgmap v2406: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:53.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:52 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:14:53.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:52 smithi194 ceph-mon[65619]: pgmap v2406: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:53.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:52 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:14:54.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:53 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:14:54.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:53 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:14:55.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:54 smithi026 ceph-mon[96795]: pgmap v2407: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:55.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:54 smithi194 ceph-mon[65619]: pgmap v2407: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:57.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:56 smithi026 ceph-mon[96795]: pgmap v2408: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:57.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:56 smithi194 ceph-mon[65619]: pgmap v2408: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:59.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:14:58 smithi026 ceph-mon[96795]: pgmap v2409: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:14:59.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:14:58 smithi194 ceph-mon[65619]: pgmap v2409: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:00.663 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.662+0000 7f08ea8b8700 1 -- 172.21.15.26:0/4236333167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08e406a330 msgr2=0x7f08e406a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:15:00.663 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.662+0000 7f08ea8b8700 1 --2- 172.21.15.26:0/4236333167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08e406a330 0x7f08e406a7b0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 rx=0x7f08d8004660 tx=0x7f08d8009b30).stop 2021-11-03T18:15:00.663 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.662+0000 7f08ea8b8700 1 -- 172.21.15.26:0/4236333167 shutdown_connections 2021-11-03T18:15:00.663 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.662+0000 7f08ea8b8700 1 --2- 172.21.15.26:0/4236333167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08e406a330 0x7f08e406a7b0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:00.664 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.662+0000 7f08ea8b8700 1 --2- 172.21.15.26:0/4236333167 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08e406b8a0 0x7f08e4069e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:00.664 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.662+0000 7f08ea8b8700 1 -- 172.21.15.26:0/4236333167 >> 172.21.15.26:0/4236333167 conn(0x7f08e40f1f00 msgr2=0x7f08e40f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:15:00.664 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.662+0000 7f08ea8b8700 1 -- 172.21.15.26:0/4236333167 shutdown_connections 2021-11-03T18:15:00.664 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.662+0000 7f08ea8b8700 1 -- 172.21.15.26:0/4236333167 wait complete. 2021-11-03T18:15:00.665 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.663+0000 7f08ea8b8700 1 Processor -- start 2021-11-03T18:15:00.665 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.663+0000 7f08ea8b8700 1 -- start start 2021-11-03T18:15:00.665 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.663+0000 7f08ea8b8700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08e406a330 0x7f08e41091a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:15:00.665 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.663+0000 7f08ea8b8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08e406b8a0 0x7f08e4109690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:15:00.666 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.663+0000 7f08ea8b8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e4109c40 con 0x7f08e406b8a0 2021-11-03T18:15:00.666 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.663+0000 7f08ea8b8700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e4109d80 con 0x7f08e406a330 2021-11-03T18:15:00.666 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.663+0000 7f08e37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08e406b8a0 0x7f08e4109690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:15:00.666 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.663+0000 7f08e37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08e406b8a0 0x7f08e4109690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58964/0 (socket says 172.21.15.26:58964) 2021-11-03T18:15:00.666 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.663+0000 7f08e37fe700 1 -- 172.21.15.26:0/600642827 learned_addr learned my addr 172.21.15.26:0/600642827 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:15:00.667 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.663+0000 7f08e3fff700 1 --2- 172.21.15.26:0/600642827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08e406a330 0x7f08e41091a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:15:00.667 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.663+0000 7f08e37fe700 1 -- 172.21.15.26:0/600642827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08e406a330 msgr2=0x7f08e41091a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:15:00.667 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.663+0000 7f08e37fe700 1 --2- 172.21.15.26:0/600642827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08e406a330 0x7f08e41091a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:00.667 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.664+0000 7f08e37fe700 1 -- 172.21.15.26:0/600642827 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d8005040 con 0x7f08e406b8a0 2021-11-03T18:15:00.668 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.664+0000 7f08e37fe700 1 --2- 172.21.15.26:0/600642827 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08e406b8a0 0x7f08e4109690 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 rx=0x7f08d8009830 tx=0x7f08d8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:15:00.668 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.664+0000 7f08e0ff9700 1 -- 172.21.15.26:0/600642827 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08d8018070 con 0x7f08e406b8a0 2021-11-03T18:15:00.668 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.664+0000 7f08e0ff9700 1 -- 172.21.15.26:0/600642827 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f08d8007ba0 con 0x7f08e406b8a0 2021-11-03T18:15:00.668 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.664+0000 7f08ea8b8700 1 -- 172.21.15.26:0/600642827 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e410a6c0 con 0x7f08e406b8a0 2021-11-03T18:15:00.668 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.664+0000 7f08e0ff9700 1 -- 172.21.15.26:0/600642827 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08d801c3c0 con 0x7f08e406b8a0 2021-11-03T18:15:00.670 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.664+0000 7f08ea8b8700 1 -- 172.21.15.26:0/600642827 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e410ac20 con 0x7f08e406b8a0 2021-11-03T18:15:00.670 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.666+0000 7f08e0ff9700 1 -- 172.21.15.26:0/600642827 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f08d8007d10 con 0x7f08e406b8a0 2021-11-03T18:15:00.670 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.666+0000 7f08ea8b8700 1 -- 172.21.15.26:0/600642827 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08e4045ad0 con 0x7f08e406b8a0 2021-11-03T18:15:00.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.666+0000 7f08e0ff9700 1 --2- 172.21.15.26:0/600642827 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f08cc064090 0x7f08cc066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:15:00.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.666+0000 7f08e0ff9700 1 -- 172.21.15.26:0/600642827 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f08d80820a0 con 0x7f08e406b8a0 2021-11-03T18:15:00.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.666+0000 7f08e3fff700 1 --2- 172.21.15.26:0/600642827 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f08cc064090 0x7f08cc066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:15:00.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.667+0000 7f08e3fff700 1 --2- 172.21.15.26:0/600642827 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f08cc064090 0x7f08cc066550 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f08e406b670 tx=0x7f08d400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:15:00.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.670+0000 7f08e0ff9700 1 -- 172.21.15.26:0/600642827 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f08d80544c0 con 0x7f08e406b8a0 2021-11-03T18:15:00.847 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.848+0000 7f08ea8b8700 1 -- 172.21.15.26:0/600642827 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f08e410ae10 con 0x7f08cc064090 2021-11-03T18:15:00.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.850+0000 7f08e0ff9700 1 -- 172.21.15.26:0/600642827 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f08e410ae10 con 0x7f08cc064090 2021-11-03T18:15:00.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.852+0000 7f08ea8b8700 1 -- 172.21.15.26:0/600642827 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f08cc064090 msgr2=0x7f08cc066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:15:00.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.852+0000 7f08ea8b8700 1 --2- 172.21.15.26:0/600642827 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f08cc064090 0x7f08cc066550 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f08e406b670 tx=0x7f08d400b040).stop 2021-11-03T18:15:00.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.852+0000 7f08ea8b8700 1 -- 172.21.15.26:0/600642827 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08e406b8a0 msgr2=0x7f08e4109690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:15:00.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.852+0000 7f08ea8b8700 1 --2- 172.21.15.26:0/600642827 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08e406b8a0 0x7f08e4109690 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 rx=0x7f08d8009830 tx=0x7f08d8009b30).stop 2021-11-03T18:15:00.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.852+0000 7f08ea8b8700 1 -- 172.21.15.26:0/600642827 shutdown_connections 2021-11-03T18:15:00.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.852+0000 7f08ea8b8700 1 --2- 172.21.15.26:0/600642827 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f08cc064090 0x7f08cc066550 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:00.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.852+0000 7f08ea8b8700 1 --2- 172.21.15.26:0/600642827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08e406a330 0x7f08e41091a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:00.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.852+0000 7f08ea8b8700 1 --2- 172.21.15.26:0/600642827 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08e406b8a0 0x7f08e4109690 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:00.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.852+0000 7f08ea8b8700 1 -- 172.21.15.26:0/600642827 >> 172.21.15.26:0/600642827 conn(0x7f08e40f1f00 msgr2=0x7f08e40fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:15:00.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.852+0000 7f08ea8b8700 1 -- 172.21.15.26:0/600642827 shutdown_connections 2021-11-03T18:15:00.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.852+0000 7f08ea8b8700 1 -- 172.21.15.26:0/600642827 wait complete. 2021-11-03T18:15:00.860 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:15:00.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.951+0000 7f261afdc700 1 -- 172.21.15.26:0/1676644672 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26140f5ed0 msgr2=0x7f26140f6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:15:00.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.952+0000 7f261afdc700 1 --2- 172.21.15.26:0/1676644672 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26140f5ed0 0x7f26140f6900 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7f2600004660 tx=0x7f2600009b30).stop 2021-11-03T18:15:00.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.952+0000 7f261afdc700 1 -- 172.21.15.26:0/1676644672 shutdown_connections 2021-11-03T18:15:00.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.952+0000 7f261afdc700 1 --2- 172.21.15.26:0/1676644672 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26140f5ed0 0x7f26140f6900 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:00.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.952+0000 7f261afdc700 1 --2- 172.21.15.26:0/1676644672 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26140f55c0 0x7f26140f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:00.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.952+0000 7f261afdc700 1 -- 172.21.15.26:0/1676644672 >> 172.21.15.26:0/1676644672 conn(0x7f26140f0de0 msgr2=0x7f26140f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:15:00.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.952+0000 7f261afdc700 1 -- 172.21.15.26:0/1676644672 shutdown_connections 2021-11-03T18:15:00.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.952+0000 7f261afdc700 1 -- 172.21.15.26:0/1676644672 wait complete. 2021-11-03T18:15:00.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.952+0000 7f261afdc700 1 Processor -- start 2021-11-03T18:15:00.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.952+0000 7f261afdc700 1 -- start start 2021-11-03T18:15:00.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.952+0000 7f261afdc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26140f55c0 0x7f2614105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:15:00.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.953+0000 7f261afdc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26140f5ed0 0x7f2614106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:15:00.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.953+0000 7f261afdc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2614106910 con 0x7f26140f55c0 2021-11-03T18:15:00.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.953+0000 7f261afdc700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2614106a50 con 0x7f26140f5ed0 2021-11-03T18:15:00.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.953+0000 7f2618d78700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26140f55c0 0x7f2614105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:15:00.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.953+0000 7f2618d78700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26140f55c0 0x7f2614105e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58972/0 (socket says 172.21.15.26:58972) 2021-11-03T18:15:00.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.953+0000 7f2618d78700 1 -- 172.21.15.26:0/2800122291 learned_addr learned my addr 172.21.15.26:0/2800122291 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:15:00.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.953+0000 7f2613fff700 1 --2- 172.21.15.26:0/2800122291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26140f5ed0 0x7f2614106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:15:00.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.953+0000 7f2618d78700 1 -- 172.21.15.26:0/2800122291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26140f5ed0 msgr2=0x7f2614106360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:15:00.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.953+0000 7f2618d78700 1 --2- 172.21.15.26:0/2800122291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26140f5ed0 0x7f2614106360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:00.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.953+0000 7f2618d78700 1 -- 172.21.15.26:0/2800122291 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2600005040 con 0x7f26140f55c0 2021-11-03T18:15:00.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.953+0000 7f2618d78700 1 --2- 172.21.15.26:0/2800122291 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26140f55c0 0x7f2614105e70 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 rx=0x7f26080026d0 tx=0x7f2608009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:15:00.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.953+0000 7f26117fa700 1 -- 172.21.15.26:0/2800122291 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26080079c0 con 0x7f26140f55c0 2021-11-03T18:15:00.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.953+0000 7f26117fa700 1 -- 172.21.15.26:0/2800122291 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f260800f040 con 0x7f26140f55c0 2021-11-03T18:15:00.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.953+0000 7f26117fa700 1 -- 172.21.15.26:0/2800122291 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26080148b0 con 0x7f26140f55c0 2021-11-03T18:15:00.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.953+0000 7f261afdc700 1 -- 172.21.15.26:0/2800122291 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26141073f0 con 0x7f26140f55c0 2021-11-03T18:15:00.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.953+0000 7f261afdc700 1 -- 172.21.15.26:0/2800122291 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26141079b0 con 0x7f26140f55c0 2021-11-03T18:15:00.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.954+0000 7f261afdc700 1 -- 172.21.15.26:0/2800122291 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2614045ad0 con 0x7f26140f55c0 2021-11-03T18:15:00.961 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.955+0000 7f26117fa700 1 -- 172.21.15.26:0/2800122291 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f2608007b20 con 0x7f26140f55c0 2021-11-03T18:15:00.962 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.955+0000 7f26117fa700 1 --2- 172.21.15.26:0/2800122291 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f26040640b0 0x7f2604066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:15:00.962 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.955+0000 7f26117fa700 1 -- 172.21.15.26:0/2800122291 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f2608080660 con 0x7f26140f55c0 2021-11-03T18:15:00.962 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.955+0000 7f2613fff700 1 --2- 172.21.15.26:0/2800122291 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f26040640b0 0x7f2604066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:15:00.963 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.956+0000 7f2613fff700 1 --2- 172.21.15.26:0/2800122291 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f26040640b0 0x7f2604066570 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7f2600004630 tx=0x7f2600009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:15:00.963 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:00.959+0000 7f26117fa700 1 -- 172.21.15.26:0/2800122291 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f26080529c0 con 0x7f26140f55c0 2021-11-03T18:15:01.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.132+0000 7f261afdc700 1 -- 172.21.15.26:0/2800122291 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f26140ff8d0 con 0x7f26040640b0 2021-11-03T18:15:01.145 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.147+0000 7f26117fa700 1 -- 172.21.15.26:0/2800122291 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f26140ff8d0 con 0x7f26040640b0 2021-11-03T18:15:01.146 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:15:01.146 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (86m) 4m ago 87m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:15:01.146 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (78m) 4m ago 87m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:15:01.147 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (78m) 3m ago 86m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:15:01.147 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (86m) 4m ago 87m 42.0M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:15:01.147 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (79m) 4m ago 82m 25.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:15:01.147 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (79m) 4m ago 82m 26.4M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:15:01.148 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (82m) 3m ago 82m 26.6M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:15:01.148 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (82m) 3m ago 82m 27.0M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:15:01.149 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (79m) 4m ago 88m 574M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:15:01.149 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (79m) 3m ago 86m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:15:01.149 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (79m) 4m ago 88m 308M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:15:01.149 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (79m) 3m ago 86m 145M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:15:01.150 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (87m) 4m ago 87m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:15:01.150 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (86m) 3m ago 86m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:15:01.150 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (78m) 4m ago 85m 312M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:15:01.150 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (77m) 4m ago 85m 335M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:15:01.150 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (77m) 4m ago 85m 279M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:15:01.151 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (76m) 3m ago 84m 362M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:15:01.151 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (76m) 3m ago 84m 302M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:15:01.151 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (75m) 3m ago 84m 296M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:15:01.151 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (85m) 4m ago 86m 63.4M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:15:01.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.148+0000 7f261afdc700 1 -- 172.21.15.26:0/2800122291 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f26040640b0 msgr2=0x7f2604066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:15:01.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.148+0000 7f261afdc700 1 --2- 172.21.15.26:0/2800122291 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f26040640b0 0x7f2604066570 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7f2600004630 tx=0x7f2600009b30).stop 2021-11-03T18:15:01.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.148+0000 7f261afdc700 1 -- 172.21.15.26:0/2800122291 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26140f55c0 msgr2=0x7f2614105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:15:01.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.148+0000 7f261afdc700 1 --2- 172.21.15.26:0/2800122291 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26140f55c0 0x7f2614105e70 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 rx=0x7f26080026d0 tx=0x7f2608009de0).stop 2021-11-03T18:15:01.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.149+0000 7f261afdc700 1 -- 172.21.15.26:0/2800122291 shutdown_connections 2021-11-03T18:15:01.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.149+0000 7f261afdc700 1 --2- 172.21.15.26:0/2800122291 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f26040640b0 0x7f2604066570 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:01.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.149+0000 7f261afdc700 1 --2- 172.21.15.26:0/2800122291 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26140f55c0 0x7f2614105e70 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:01.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.149+0000 7f261afdc700 1 --2- 172.21.15.26:0/2800122291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26140f5ed0 0x7f2614106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:01.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.149+0000 7f261afdc700 1 -- 172.21.15.26:0/2800122291 >> 172.21.15.26:0/2800122291 conn(0x7f26140f0de0 msgr2=0x7f26140fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:15:01.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.149+0000 7f261afdc700 1 -- 172.21.15.26:0/2800122291 shutdown_connections 2021-11-03T18:15:01.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.149+0000 7f261afdc700 1 -- 172.21.15.26:0/2800122291 wait complete. 2021-11-03T18:15:01.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:00 smithi026 ceph-mon[96795]: pgmap v2410: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:01.249 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.248+0000 7fc40f585700 1 -- 172.21.15.26:0/2287519571 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4080f55c0 msgr2=0x7fc4080f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:15:01.249 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.248+0000 7fc40f585700 1 --2- 172.21.15.26:0/2287519571 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4080f55c0 0x7fc4080f59e0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 rx=0x7fc4000099e0 tx=0x7fc400004d10).stop 2021-11-03T18:15:01.249 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.248+0000 7fc40f585700 1 -- 172.21.15.26:0/2287519571 shutdown_connections 2021-11-03T18:15:01.249 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.248+0000 7fc40f585700 1 --2- 172.21.15.26:0/2287519571 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4080f6860 0x7fc4080f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:01.250 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.248+0000 7fc40f585700 1 --2- 172.21.15.26:0/2287519571 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4080f55c0 0x7fc4080f59e0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:01.250 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.248+0000 7fc40f585700 1 -- 172.21.15.26:0/2287519571 >> 172.21.15.26:0/2287519571 conn(0x7fc4080f0d40 msgr2=0x7fc4080f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:15:01.250 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.248+0000 7fc40f585700 1 -- 172.21.15.26:0/2287519571 shutdown_connections 2021-11-03T18:15:01.251 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.248+0000 7fc40f585700 1 -- 172.21.15.26:0/2287519571 wait complete. 2021-11-03T18:15:01.251 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.249+0000 7fc40f585700 1 Processor -- start 2021-11-03T18:15:01.251 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.249+0000 7fc40f585700 1 -- start start 2021-11-03T18:15:01.251 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.249+0000 7fc40f585700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4080f55c0 0x7fc408107060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:15:01.251 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.249+0000 7fc40f585700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4080f6860 0x7fc408107550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:15:01.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.249+0000 7fc40f585700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc408107b00 con 0x7fc4080f6860 2021-11-03T18:15:01.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.249+0000 7fc40f585700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc408107c40 con 0x7fc4080f55c0 2021-11-03T18:15:01.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.249+0000 7fc40cb20700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4080f6860 0x7fc408107550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:15:01.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.249+0000 7fc40cb20700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4080f6860 0x7fc408107550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58984/0 (socket says 172.21.15.26:58984) 2021-11-03T18:15:01.253 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.249+0000 7fc40cb20700 1 -- 172.21.15.26:0/346261643 learned_addr learned my addr 172.21.15.26:0/346261643 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:15:01.253 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.249+0000 7fc40d321700 1 --2- 172.21.15.26:0/346261643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4080f55c0 0x7fc408107060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:15:01.253 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.249+0000 7fc40cb20700 1 -- 172.21.15.26:0/346261643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4080f55c0 msgr2=0x7fc408107060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:15:01.253 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.249+0000 7fc40cb20700 1 --2- 172.21.15.26:0/346261643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4080f55c0 0x7fc408107060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:01.254 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.249+0000 7fc40cb20700 1 -- 172.21.15.26:0/346261643 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc400009640 con 0x7fc4080f6860 2021-11-03T18:15:01.254 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.249+0000 7fc40cb20700 1 --2- 172.21.15.26:0/346261643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4080f6860 0x7fc408107550 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7fc3fc00c790 tx=0x7fc3fc007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:15:01.254 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.250+0000 7fc405ffb700 1 -- 172.21.15.26:0/346261643 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3fc00e680 con 0x7fc4080f6860 2021-11-03T18:15:01.254 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.250+0000 7fc405ffb700 1 -- 172.21.15.26:0/346261643 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc3fc00ec90 con 0x7fc4080f6860 2021-11-03T18:15:01.255 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.250+0000 7fc40f585700 1 -- 172.21.15.26:0/346261643 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4081085e0 con 0x7fc4080f6860 2021-11-03T18:15:01.255 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.250+0000 7fc405ffb700 1 -- 172.21.15.26:0/346261643 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3fc013d60 con 0x7fc4080f6860 2021-11-03T18:15:01.255 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.250+0000 7fc40f585700 1 -- 172.21.15.26:0/346261643 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc408108b20 con 0x7fc4080f6860 2021-11-03T18:15:01.256 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:00 smithi194 ceph-mon[65619]: pgmap v2410: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:01.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.251+0000 7fc40f585700 1 -- 172.21.15.26:0/346261643 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc408045ad0 con 0x7fc4080f6860 2021-11-03T18:15:01.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.251+0000 7fc405ffb700 1 -- 172.21.15.26:0/346261643 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc3fc01a060 con 0x7fc4080f6860 2021-11-03T18:15:01.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.251+0000 7fc405ffb700 1 --2- 172.21.15.26:0/346261643 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3f00640b0 0x7fc3f0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:15:01.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.251+0000 7fc405ffb700 1 -- 172.21.15.26:0/346261643 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc3fc080b00 con 0x7fc4080f6860 2021-11-03T18:15:01.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.252+0000 7fc40d321700 1 --2- 172.21.15.26:0/346261643 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3f00640b0 0x7fc3f0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:15:01.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.252+0000 7fc40d321700 1 --2- 172.21.15.26:0/346261643 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3f00640b0 0x7fc3f0066570 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7fc400009f50 tx=0x7fc400004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:15:01.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.256+0000 7fc405ffb700 1 -- 172.21.15.26:0/346261643 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc3fc052d70 con 0x7fc4080f6860 2021-11-03T18:15:01.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.487+0000 7fc40f585700 1 -- 172.21.15.26:0/346261643 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc408109160 con 0x7fc4080f6860 2021-11-03T18:15:01.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.488+0000 7fc405ffb700 1 -- 172.21.15.26:0/346261643 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fc3fc018070 con 0x7fc4080f6860 2021-11-03T18:15:01.487 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:15:01.488 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:15:01.488 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:15:01.488 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:15:01.488 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:15:01.489 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:15:01.489 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:15:01.489 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:15:01.489 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:15:01.490 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:15:01.490 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:15:01.490 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:15:01.490 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:15:01.490 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:15:01.491 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:15:01.491 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:15:01.491 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:15:01.491 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:15:01.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.490+0000 7fc40f585700 1 -- 172.21.15.26:0/346261643 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3f00640b0 msgr2=0x7fc3f0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:15:01.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.490+0000 7fc40f585700 1 --2- 172.21.15.26:0/346261643 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3f00640b0 0x7fc3f0066570 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7fc400009f50 tx=0x7fc400004d10).stop 2021-11-03T18:15:01.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.490+0000 7fc40f585700 1 -- 172.21.15.26:0/346261643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4080f6860 msgr2=0x7fc408107550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:15:01.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.490+0000 7fc40f585700 1 --2- 172.21.15.26:0/346261643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4080f6860 0x7fc408107550 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7fc3fc00c790 tx=0x7fc3fc007d70).stop 2021-11-03T18:15:01.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.490+0000 7fc40f585700 1 -- 172.21.15.26:0/346261643 shutdown_connections 2021-11-03T18:15:01.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.490+0000 7fc40f585700 1 --2- 172.21.15.26:0/346261643 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3f00640b0 0x7fc3f0066570 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:01.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.490+0000 7fc40f585700 1 --2- 172.21.15.26:0/346261643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4080f55c0 0x7fc408107060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:01.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.490+0000 7fc40f585700 1 --2- 172.21.15.26:0/346261643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4080f6860 0x7fc408107550 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:01.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.490+0000 7fc40f585700 1 -- 172.21.15.26:0/346261643 >> 172.21.15.26:0/346261643 conn(0x7fc4080f0d40 msgr2=0x7fc40805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:15:01.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.490+0000 7fc40f585700 1 -- 172.21.15.26:0/346261643 shutdown_connections 2021-11-03T18:15:01.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.490+0000 7fc40f585700 1 -- 172.21.15.26:0/346261643 wait complete. 2021-11-03T18:15:01.590 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.590+0000 7fa410d94700 1 -- 172.21.15.26:0/4121836539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa40c0f4de0 msgr2=0x7fa40c0f5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:15:01.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.590+0000 7fa410d94700 1 --2- 172.21.15.26:0/4121836539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa40c0f4de0 0x7fa40c0f5200 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 rx=0x7fa3fc004770 tx=0x7fa3fc00ac40).stop 2021-11-03T18:15:01.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.590+0000 7fa410d94700 1 -- 172.21.15.26:0/4121836539 shutdown_connections 2021-11-03T18:15:01.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.590+0000 7fa410d94700 1 --2- 172.21.15.26:0/4121836539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa40c0f5fe0 0x7fa40c0f6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:01.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.590+0000 7fa410d94700 1 --2- 172.21.15.26:0/4121836539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa40c0f4de0 0x7fa40c0f5200 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:01.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.590+0000 7fa410d94700 1 -- 172.21.15.26:0/4121836539 >> 172.21.15.26:0/4121836539 conn(0x7fa40c0f0540 msgr2=0x7fa40c0f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:15:01.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.590+0000 7fa410d94700 1 -- 172.21.15.26:0/4121836539 shutdown_connections 2021-11-03T18:15:01.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.590+0000 7fa410d94700 1 -- 172.21.15.26:0/4121836539 wait complete. 2021-11-03T18:15:01.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.590+0000 7fa410d94700 1 Processor -- start 2021-11-03T18:15:01.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.591+0000 7fa410d94700 1 -- start start 2021-11-03T18:15:01.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.591+0000 7fa410d94700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa40c0f4de0 0x7fa40c106f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:15:01.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.591+0000 7fa410d94700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa40c0f5fe0 0x7fa40c107420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:15:01.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.591+0000 7fa410d94700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c1079d0 con 0x7fa40c0f4de0 2021-11-03T18:15:01.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.591+0000 7fa410d94700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c107b10 con 0x7fa40c0f5fe0 2021-11-03T18:15:01.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.591+0000 7fa40a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa40c0f4de0 0x7fa40c106f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:15:01.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.591+0000 7fa40a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa40c0f4de0 0x7fa40c106f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58990/0 (socket says 172.21.15.26:58990) 2021-11-03T18:15:01.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.591+0000 7fa40a59c700 1 -- 172.21.15.26:0/2188482926 learned_addr learned my addr 172.21.15.26:0/2188482926 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:15:01.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.591+0000 7fa409d9b700 1 --2- 172.21.15.26:0/2188482926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa40c0f5fe0 0x7fa40c107420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:15:01.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.591+0000 7fa40a59c700 1 -- 172.21.15.26:0/2188482926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa40c0f5fe0 msgr2=0x7fa40c107420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:15:01.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.591+0000 7fa40a59c700 1 --2- 172.21.15.26:0/2188482926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa40c0f5fe0 0x7fa40c107420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:01.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.591+0000 7fa40a59c700 1 -- 172.21.15.26:0/2188482926 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3fc005040 con 0x7fa40c0f4de0 2021-11-03T18:15:01.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.591+0000 7fa40a59c700 1 --2- 172.21.15.26:0/2188482926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa40c0f4de0 0x7fa40c106f30 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 rx=0x7fa3fc014450 tx=0x7fa3fc00ac40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:15:01.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.591+0000 7fa402ffd700 1 -- 172.21.15.26:0/2188482926 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3fc00f030 con 0x7fa40c0f4de0 2021-11-03T18:15:01.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.591+0000 7fa402ffd700 1 -- 172.21.15.26:0/2188482926 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa3fc007c60 con 0x7fa40c0f4de0 2021-11-03T18:15:01.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.591+0000 7fa402ffd700 1 -- 172.21.15.26:0/2188482926 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3fc019070 con 0x7fa40c0f4de0 2021-11-03T18:15:01.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.591+0000 7fa410d94700 1 -- 172.21.15.26:0/2188482926 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa40c108450 con 0x7fa40c0f4de0 2021-11-03T18:15:01.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.592+0000 7fa410d94700 1 -- 172.21.15.26:0/2188482926 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa40c1089b0 con 0x7fa40c0f4de0 2021-11-03T18:15:01.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.592+0000 7fa410d94700 1 -- 172.21.15.26:0/2188482926 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa40c045ad0 con 0x7fa40c0f4de0 2021-11-03T18:15:01.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.593+0000 7fa402ffd700 1 -- 172.21.15.26:0/2188482926 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fa3fc0085d0 con 0x7fa40c0f4de0 2021-11-03T18:15:01.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.593+0000 7fa402ffd700 1 --2- 172.21.15.26:0/2188482926 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa3f8064090 0x7fa3f8066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:15:01.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.594+0000 7fa402ffd700 1 -- 172.21.15.26:0/2188482926 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fa3fc082410 con 0x7fa40c0f4de0 2021-11-03T18:15:01.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.594+0000 7fa409d9b700 1 --2- 172.21.15.26:0/2188482926 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa3f8064090 0x7fa3f8066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:15:01.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.594+0000 7fa409d9b700 1 --2- 172.21.15.26:0/2188482926 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa3f8064090 0x7fa3f8066550 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7fa3f4004a70 tx=0x7fa3f400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:15:01.600 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.598+0000 7fa402ffd700 1 -- 172.21.15.26:0/2188482926 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fa3fc054770 con 0x7fa40c0f4de0 2021-11-03T18:15:01.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.805+0000 7fa410d94700 1 -- 172.21.15.26:0/2188482926 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa40c027a00 con 0x7fa40c0f4de0 2021-11-03T18:15:01.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.805+0000 7fa402ffd700 1 -- 172.21.15.26:0/2188482926 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fa3fc054360 con 0x7fa40c0f4de0 2021-11-03T18:15:01.804 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:15:01.805 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:15:01.805 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:15:01.805 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:15:01.805 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:15:01.806 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:15:01.806 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:15:01.806 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:15:01.806 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:15:01.806 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:15:01.807 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:15:01.807 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:15:01.807 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:15:01.808 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:15:01.808 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:15:01.808 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:15:01.809 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:15:01.809 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:15:01.809 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:15:01.809 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:15:01.810 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:15:01.810 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:15:01.810 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:15:01.810 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:15:01.811 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:15:01.811 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:15:01.812 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:15:01.812 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:15:01.812 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:15:01.813 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:15:01.813 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:15:01.814 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:15:01.814 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:15:01.814 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:15:01.815 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:15:01.815 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:15:01.815 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:15:01.816 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:15:01.817 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:15:01.818 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.807+0000 7fa410d94700 1 -- 172.21.15.26:0/2188482926 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa3f8064090 msgr2=0x7fa3f8066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:15:01.818 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.807+0000 7fa410d94700 1 --2- 172.21.15.26:0/2188482926 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa3f8064090 0x7fa3f8066550 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7fa3f4004a70 tx=0x7fa3f400b040).stop 2021-11-03T18:15:01.819 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.807+0000 7fa410d94700 1 -- 172.21.15.26:0/2188482926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa40c0f4de0 msgr2=0x7fa40c106f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:15:01.819 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.807+0000 7fa410d94700 1 --2- 172.21.15.26:0/2188482926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa40c0f4de0 0x7fa40c106f30 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 rx=0x7fa3fc014450 tx=0x7fa3fc00ac40).stop 2021-11-03T18:15:01.820 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.807+0000 7fa410d94700 1 -- 172.21.15.26:0/2188482926 shutdown_connections 2021-11-03T18:15:01.820 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.807+0000 7fa410d94700 1 --2- 172.21.15.26:0/2188482926 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa3f8064090 0x7fa3f8066550 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:01.821 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.807+0000 7fa410d94700 1 --2- 172.21.15.26:0/2188482926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa40c0f4de0 0x7fa40c106f30 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:01.821 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.807+0000 7fa410d94700 1 --2- 172.21.15.26:0/2188482926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa40c0f5fe0 0x7fa40c107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:01.821 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.807+0000 7fa410d94700 1 -- 172.21.15.26:0/2188482926 >> 172.21.15.26:0/2188482926 conn(0x7fa40c0f0540 msgr2=0x7fa40c0f9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:15:01.822 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.807+0000 7fa410d94700 1 -- 172.21.15.26:0/2188482926 shutdown_connections 2021-11-03T18:15:01.822 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:01.807+0000 7fa410d94700 1 -- 172.21.15.26:0/2188482926 wait complete. 2021-11-03T18:15:01.823 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:15:02.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:01 smithi026 ceph-mon[96795]: from='client.36620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:15:02.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:01 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/346261643' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:15:02.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:01 smithi194 ceph-mon[65619]: from='client.36620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:15:02.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:01 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/346261643' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:15:03.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:02 smithi026 ceph-mon[96795]: from='client.36624 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:15:03.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:02 smithi026 ceph-mon[96795]: pgmap v2411: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:03.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:02 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2188482926' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:15:03.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:02 smithi194 ceph-mon[65619]: from='client.36624 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:15:03.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:02 smithi194 ceph-mon[65619]: pgmap v2411: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:03.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:02 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2188482926' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:15:05.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:04 smithi026 ceph-mon[96795]: pgmap v2412: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:05.255 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:04 smithi194 ceph-mon[65619]: pgmap v2412: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:07.153 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:06 smithi194 ceph-mon[65619]: pgmap v2413: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:07.154 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:06 smithi026 ceph-mon[96795]: pgmap v2413: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:07.789 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:07 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:15:08.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:07 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:15:08.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:07 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:15:08.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:07 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:15:08.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:07 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:15:08.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:07 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:15:08.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:07 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:15:08.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:07 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:15:08.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:07 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:15:08.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:07 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:15:08.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:07 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:15:08.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:07 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:15:08.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:07 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:15:08.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:07 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:15:08.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:07 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:15:08.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:07 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:15:09.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:08 smithi026 ceph-mon[96795]: poll took 60063.770 ms: 1 events 2021-11-03T18:15:09.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:08 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:15:09.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:08 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:15:09.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:08 smithi026 ceph-mon[96795]: pgmap v2414: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:09.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:08 smithi194 ceph-mon[65619]: poll took 60063.770 ms: 1 events 2021-11-03T18:15:09.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:08 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:15:09.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:08 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:15:09.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:08 smithi194 ceph-mon[65619]: pgmap v2414: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:11.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:10 smithi026 ceph-mon[96795]: pgmap v2415: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:11.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:10 smithi194 ceph-mon[65619]: pgmap v2415: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:13.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:12 smithi026 ceph-mon[96795]: pgmap v2416: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:13.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:12 smithi194 ceph-mon[65619]: pgmap v2416: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:15.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:14 smithi026 ceph-mon[96795]: pgmap v2417: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:15.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:14 smithi194 ceph-mon[65619]: pgmap v2417: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:17.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:16 smithi026 ceph-mon[96795]: pgmap v2418: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:17.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:16 smithi194 ceph-mon[65619]: pgmap v2418: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:19.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:18 smithi026 ceph-mon[96795]: pgmap v2419: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:19.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:18 smithi194 ceph-mon[65619]: pgmap v2419: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:21.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:20 smithi026 ceph-mon[96795]: pgmap v2420: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:21.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:20 smithi194 ceph-mon[65619]: pgmap v2420: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:23.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:22 smithi026 ceph-mon[96795]: pgmap v2421: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:23.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:22 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:15:23.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:22 smithi194 ceph-mon[65619]: pgmap v2421: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:23.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:22 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:15:24.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:23 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:15:24.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:23 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:15:25.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:24 smithi026 ceph-mon[96795]: pgmap v2422: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:25.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:24 smithi194 ceph-mon[65619]: pgmap v2422: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:27.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:26 smithi026 ceph-mon[96795]: pgmap v2423: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:27.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:26 smithi194 ceph-mon[65619]: pgmap v2423: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:29.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:28 smithi026 ceph-mon[96795]: pgmap v2424: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:29.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:28 smithi194 ceph-mon[65619]: pgmap v2424: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:31.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:30 smithi026 ceph-mon[96795]: pgmap v2425: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:31.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:30 smithi194 ceph-mon[65619]: pgmap v2425: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:31.922 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:31.922+0000 7f6ef6f90700 1 -- 172.21.15.26:0/3643252886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ef00f6860 msgr2=0x7f6ef00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:15:31.922 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:31.922+0000 7f6ef6f90700 1 --2- 172.21.15.26:0/3643252886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ef00f6860 0x7f6ef00f6cc0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7f6edc004660 tx=0x7f6edc009b30).stop 2021-11-03T18:15:31.923 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:31.922+0000 7f6ef6f90700 1 -- 172.21.15.26:0/3643252886 shutdown_connections 2021-11-03T18:15:31.923 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:31.922+0000 7f6ef6f90700 1 --2- 172.21.15.26:0/3643252886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ef00f6860 0x7f6ef00f6cc0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:31.923 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:31.922+0000 7f6ef6f90700 1 --2- 172.21.15.26:0/3643252886 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ef00f55c0 0x7f6ef00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:31.923 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:31.922+0000 7f6ef6f90700 1 -- 172.21.15.26:0/3643252886 >> 172.21.15.26:0/3643252886 conn(0x7f6ef00f0d40 msgr2=0x7f6ef00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:15:31.923 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:31.922+0000 7f6ef6f90700 1 -- 172.21.15.26:0/3643252886 shutdown_connections 2021-11-03T18:15:31.924 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:31.922+0000 7f6ef6f90700 1 -- 172.21.15.26:0/3643252886 wait complete. 2021-11-03T18:15:31.924 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:31.923+0000 7f6ef6f90700 1 Processor -- start 2021-11-03T18:15:31.924 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:31.923+0000 7f6ef6f90700 1 -- start start 2021-11-03T18:15:31.924 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:31.923+0000 7f6ef6f90700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ef00f55c0 0x7f6ef0109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:15:31.925 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:31.923+0000 7f6ef6f90700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ef00f6860 0x7f6ef010c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:15:31.925 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:31.923+0000 7f6ef6f90700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef00603c0 con 0x7f6ef00f55c0 2021-11-03T18:15:31.925 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:31.923+0000 7f6ef6f90700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef0060500 con 0x7f6ef00f6860 2021-11-03T18:15:31.925 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:31.924+0000 7f6ef4d2c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ef00f55c0 0x7f6ef0109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:15:31.925 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:31.924+0000 7f6ef4d2c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ef00f55c0 0x7f6ef0109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59008/0 (socket says 172.21.15.26:59008) 2021-11-03T18:15:31.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:31.924+0000 7f6ef4d2c700 1 -- 172.21.15.26:0/923278024 learned_addr learned my addr 172.21.15.26:0/923278024 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:15:31.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:31.924+0000 7f6eeffff700 1 --2- 172.21.15.26:0/923278024 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ef00f6860 0x7f6ef010c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:15:31.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:31.924+0000 7f6ef4d2c700 1 -- 172.21.15.26:0/923278024 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ef00f6860 msgr2=0x7f6ef010c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:15:31.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:31.924+0000 7f6ef4d2c700 1 --2- 172.21.15.26:0/923278024 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ef00f6860 0x7f6ef010c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:31.927 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:31.924+0000 7f6ef4d2c700 1 -- 172.21.15.26:0/923278024 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6edc005040 con 0x7f6ef00f55c0 2021-11-03T18:15:31.927 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:31.924+0000 7f6ef4d2c700 1 --2- 172.21.15.26:0/923278024 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ef00f55c0 0x7f6ef0109c70 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 rx=0x7f6ee4002700 tx=0x7f6ee4009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:15:31.927 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:31.924+0000 7f6eed7fa700 1 -- 172.21.15.26:0/923278024 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ee4009320 con 0x7f6ef00f55c0 2021-11-03T18:15:31.928 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:31.924+0000 7f6eed7fa700 1 -- 172.21.15.26:0/923278024 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6ee400f040 con 0x7f6ef00f55c0 2021-11-03T18:15:31.928 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:31.924+0000 7f6ef6f90700 1 -- 172.21.15.26:0/923278024 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ef010c720 con 0x7f6ef00f55c0 2021-11-03T18:15:31.928 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:31.924+0000 7f6eed7fa700 1 -- 172.21.15.26:0/923278024 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ee4014900 con 0x7f6ef00f55c0 2021-11-03T18:15:31.928 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:31.924+0000 7f6ef6f90700 1 -- 172.21.15.26:0/923278024 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ef010ccb0 con 0x7f6ef00f55c0 2021-11-03T18:15:31.930 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:31.925+0000 7f6ef6f90700 1 -- 172.21.15.26:0/923278024 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ef00f49b0 con 0x7f6ef00f55c0 2021-11-03T18:15:31.931 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:31.926+0000 7f6eed7fa700 1 -- 172.21.15.26:0/923278024 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f6ee4009480 con 0x7f6ef00f55c0 2021-11-03T18:15:31.931 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:31.926+0000 7f6eed7fa700 1 --2- 172.21.15.26:0/923278024 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6ee00640b0 0x7f6ee0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:15:31.931 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:31.926+0000 7f6eed7fa700 1 -- 172.21.15.26:0/923278024 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f6ee4080970 con 0x7f6ef00f55c0 2021-11-03T18:15:31.931 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:31.926+0000 7f6eeffff700 1 --2- 172.21.15.26:0/923278024 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6ee00640b0 0x7f6ee0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:15:31.932 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:31.927+0000 7f6eeffff700 1 --2- 172.21.15.26:0/923278024 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6ee00640b0 0x7f6ee0066570 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f6edc004630 tx=0x7f6edc009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:15:31.932 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:31.930+0000 7f6eed7fa700 1 -- 172.21.15.26:0/923278024 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f6ee4052cd0 con 0x7f6ef00f55c0 2021-11-03T18:15:32.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.108+0000 7f6ef6f90700 1 -- 172.21.15.26:0/923278024 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ef0057f10 con 0x7f6ee00640b0 2021-11-03T18:15:32.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.110+0000 7f6eed7fa700 1 -- 172.21.15.26:0/923278024 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f6ef0057f10 con 0x7f6ee00640b0 2021-11-03T18:15:32.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.111+0000 7f6ef6f90700 1 -- 172.21.15.26:0/923278024 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6ee00640b0 msgr2=0x7f6ee0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:15:32.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.111+0000 7f6ef6f90700 1 --2- 172.21.15.26:0/923278024 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6ee00640b0 0x7f6ee0066570 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f6edc004630 tx=0x7f6edc009b30).stop 2021-11-03T18:15:32.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.111+0000 7f6ef6f90700 1 -- 172.21.15.26:0/923278024 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ef00f55c0 msgr2=0x7f6ef0109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:15:32.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.111+0000 7f6ef6f90700 1 --2- 172.21.15.26:0/923278024 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ef00f55c0 0x7f6ef0109c70 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 rx=0x7f6ee4002700 tx=0x7f6ee4009d80).stop 2021-11-03T18:15:32.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.112+0000 7f6ef6f90700 1 -- 172.21.15.26:0/923278024 shutdown_connections 2021-11-03T18:15:32.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.112+0000 7f6ef6f90700 1 --2- 172.21.15.26:0/923278024 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6ee00640b0 0x7f6ee0066570 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:32.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.112+0000 7f6ef6f90700 1 --2- 172.21.15.26:0/923278024 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ef00f55c0 0x7f6ef0109c70 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:32.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.112+0000 7f6ef6f90700 1 --2- 172.21.15.26:0/923278024 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ef00f6860 0x7f6ef010c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:32.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.112+0000 7f6ef6f90700 1 -- 172.21.15.26:0/923278024 >> 172.21.15.26:0/923278024 conn(0x7f6ef00f0d40 msgr2=0x7f6ef00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:15:32.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.112+0000 7f6ef6f90700 1 -- 172.21.15.26:0/923278024 shutdown_connections 2021-11-03T18:15:32.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.112+0000 7f6ef6f90700 1 -- 172.21.15.26:0/923278024 wait complete. 2021-11-03T18:15:32.119 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:15:32.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.212+0000 7fdd9e269700 1 -- 172.21.15.26:0/1249959690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd980f6ff0 msgr2=0x7fdd980f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:15:32.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.212+0000 7fdd9e269700 1 --2- 172.21.15.26:0/1249959690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd980f6ff0 0x7fdd980f7a20 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7fdd88004660 tx=0x7fdd88009b30).stop 2021-11-03T18:15:32.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.212+0000 7fdd9e269700 1 -- 172.21.15.26:0/1249959690 shutdown_connections 2021-11-03T18:15:32.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.212+0000 7fdd9e269700 1 --2- 172.21.15.26:0/1249959690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd980f6ff0 0x7fdd980f7a20 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:32.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.212+0000 7fdd9e269700 1 --2- 172.21.15.26:0/1249959690 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd980f66e0 0x7fdd980f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:32.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.212+0000 7fdd9e269700 1 -- 172.21.15.26:0/1249959690 >> 172.21.15.26:0/1249959690 conn(0x7fdd980f1f00 msgr2=0x7fdd980f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:15:32.213 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.212+0000 7fdd9e269700 1 -- 172.21.15.26:0/1249959690 shutdown_connections 2021-11-03T18:15:32.213 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.212+0000 7fdd9e269700 1 -- 172.21.15.26:0/1249959690 wait complete. 2021-11-03T18:15:32.213 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.212+0000 7fdd9e269700 1 Processor -- start 2021-11-03T18:15:32.213 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.213+0000 7fdd9e269700 1 -- start start 2021-11-03T18:15:32.214 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.213+0000 7fdd9e269700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd980f66e0 0x7fdd98106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:15:32.214 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.213+0000 7fdd9e269700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd980f6ff0 0x7fdd98107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:15:32.214 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.213+0000 7fdd9e269700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd98107a10 con 0x7fdd980f66e0 2021-11-03T18:15:32.214 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.213+0000 7fdd9e269700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd98107b50 con 0x7fdd980f6ff0 2021-11-03T18:15:32.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.213+0000 7fdd97fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd980f66e0 0x7fdd98106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:15:32.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.213+0000 7fdd97fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd980f66e0 0x7fdd98106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59018/0 (socket says 172.21.15.26:59018) 2021-11-03T18:15:32.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.213+0000 7fdd97fff700 1 -- 172.21.15.26:0/3730609957 learned_addr learned my addr 172.21.15.26:0/3730609957 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:15:32.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.213+0000 7fdd977fe700 1 --2- 172.21.15.26:0/3730609957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd980f6ff0 0x7fdd98107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:15:32.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.213+0000 7fdd97fff700 1 -- 172.21.15.26:0/3730609957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd980f6ff0 msgr2=0x7fdd98107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:15:32.216 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.213+0000 7fdd97fff700 1 --2- 172.21.15.26:0/3730609957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd980f6ff0 0x7fdd98107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:32.216 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.213+0000 7fdd97fff700 1 -- 172.21.15.26:0/3730609957 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd88005040 con 0x7fdd980f66e0 2021-11-03T18:15:32.216 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.213+0000 7fdd97fff700 1 --2- 172.21.15.26:0/3730609957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd980f66e0 0x7fdd98106f70 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 rx=0x7fdd8c0026d0 tx=0x7fdd8c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:15:32.216 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.213+0000 7fdd94ff9700 1 -- 172.21.15.26:0/3730609957 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd8c0079c0 con 0x7fdd980f66e0 2021-11-03T18:15:32.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.213+0000 7fdd9e269700 1 -- 172.21.15.26:0/3730609957 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd981084f0 con 0x7fdd980f66e0 2021-11-03T18:15:32.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.213+0000 7fdd94ff9700 1 -- 172.21.15.26:0/3730609957 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdd8c00f040 con 0x7fdd980f66e0 2021-11-03T18:15:32.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.214+0000 7fdd94ff9700 1 -- 172.21.15.26:0/3730609957 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd8c0148b0 con 0x7fdd980f66e0 2021-11-03T18:15:32.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.214+0000 7fdd9e269700 1 -- 172.21.15.26:0/3730609957 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd98108ab0 con 0x7fdd980f66e0 2021-11-03T18:15:32.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.215+0000 7fdd9e269700 1 -- 172.21.15.26:0/3730609957 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd98045ad0 con 0x7fdd980f66e0 2021-11-03T18:15:32.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.215+0000 7fdd94ff9700 1 -- 172.21.15.26:0/3730609957 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fdd8c007b20 con 0x7fdd980f66e0 2021-11-03T18:15:32.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.215+0000 7fdd94ff9700 1 --2- 172.21.15.26:0/3730609957 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdd80064090 0x7fdd80066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:15:32.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.215+0000 7fdd94ff9700 1 -- 172.21.15.26:0/3730609957 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fdd8c080730 con 0x7fdd980f66e0 2021-11-03T18:15:32.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.215+0000 7fdd977fe700 1 --2- 172.21.15.26:0/3730609957 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdd80064090 0x7fdd80066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:15:32.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.216+0000 7fdd977fe700 1 --2- 172.21.15.26:0/3730609957 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdd80064090 0x7fdd80066550 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7fdd88004e30 tx=0x7fdd88009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:15:32.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.219+0000 7fdd94ff9700 1 -- 172.21.15.26:0/3730609957 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fdd8c052a90 con 0x7fdd980f66e0 2021-11-03T18:15:32.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.395+0000 7fdd9e269700 1 -- 172.21.15.26:0/3730609957 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdd980ff050 con 0x7fdd80064090 2021-11-03T18:15:32.407 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.409+0000 7fdd94ff9700 1 -- 172.21.15.26:0/3730609957 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fdd980ff050 con 0x7fdd80064090 2021-11-03T18:15:32.408 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:15:32.408 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (86m) 5m ago 88m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:15:32.408 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (78m) 5m ago 87m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:15:32.408 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (78m) 4m ago 87m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:15:32.409 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (86m) 5m ago 87m 42.0M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:15:32.409 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (79m) 5m ago 83m 25.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:15:32.409 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (80m) 5m ago 83m 26.4M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:15:32.409 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (83m) 4m ago 83m 26.6M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:15:32.409 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (83m) 4m ago 83m 27.0M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:15:32.410 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (80m) 5m ago 89m 574M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:15:32.410 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (80m) 4m ago 87m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:15:32.410 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (79m) 5m ago 89m 308M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:15:32.410 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (79m) 4m ago 87m 145M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:15:32.411 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (87m) 5m ago 87m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:15:32.411 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (87m) 4m ago 86m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:15:32.411 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (78m) 5m ago 86m 312M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:15:32.411 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (78m) 5m ago 86m 335M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:15:32.412 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (77m) 5m ago 85m 279M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:15:32.412 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (77m) 4m ago 85m 362M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:15:32.412 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (76m) 4m ago 85m 302M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:15:32.412 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (76m) 4m ago 84m 296M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:15:32.412 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (86m) 5m ago 87m 63.4M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:15:32.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.411+0000 7fdd9e269700 1 -- 172.21.15.26:0/3730609957 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdd80064090 msgr2=0x7fdd80066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:15:32.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.411+0000 7fdd9e269700 1 --2- 172.21.15.26:0/3730609957 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdd80064090 0x7fdd80066550 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7fdd88004e30 tx=0x7fdd88009b30).stop 2021-11-03T18:15:32.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.411+0000 7fdd9e269700 1 -- 172.21.15.26:0/3730609957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd980f66e0 msgr2=0x7fdd98106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:15:32.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.411+0000 7fdd9e269700 1 --2- 172.21.15.26:0/3730609957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd980f66e0 0x7fdd98106f70 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 rx=0x7fdd8c0026d0 tx=0x7fdd8c009de0).stop 2021-11-03T18:15:32.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.411+0000 7fdd9e269700 1 -- 172.21.15.26:0/3730609957 shutdown_connections 2021-11-03T18:15:32.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.411+0000 7fdd9e269700 1 --2- 172.21.15.26:0/3730609957 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdd80064090 0x7fdd80066550 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:32.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.411+0000 7fdd9e269700 1 --2- 172.21.15.26:0/3730609957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd980f66e0 0x7fdd98106f70 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:32.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.411+0000 7fdd9e269700 1 --2- 172.21.15.26:0/3730609957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd980f6ff0 0x7fdd98107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:32.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.411+0000 7fdd9e269700 1 -- 172.21.15.26:0/3730609957 >> 172.21.15.26:0/3730609957 conn(0x7fdd980f1f00 msgr2=0x7fdd980fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:15:32.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.411+0000 7fdd9e269700 1 -- 172.21.15.26:0/3730609957 shutdown_connections 2021-11-03T18:15:32.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.411+0000 7fdd9e269700 1 -- 172.21.15.26:0/3730609957 wait complete. 2021-11-03T18:15:32.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.510+0000 7fa9611a6700 1 -- 172.21.15.26:0/276863525 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa95c0f6ff0 msgr2=0x7fa95c0f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:15:32.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.510+0000 7fa9611a6700 1 --2- 172.21.15.26:0/276863525 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa95c0f6ff0 0x7fa95c0f7a20 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 rx=0x7fa944004660 tx=0x7fa944009b30).stop 2021-11-03T18:15:32.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.510+0000 7fa9611a6700 1 -- 172.21.15.26:0/276863525 shutdown_connections 2021-11-03T18:15:32.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.510+0000 7fa9611a6700 1 --2- 172.21.15.26:0/276863525 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa95c0f6ff0 0x7fa95c0f7a20 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:32.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.510+0000 7fa9611a6700 1 --2- 172.21.15.26:0/276863525 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa95c0f66e0 0x7fa95c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:32.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.510+0000 7fa9611a6700 1 -- 172.21.15.26:0/276863525 >> 172.21.15.26:0/276863525 conn(0x7fa95c0f1f00 msgr2=0x7fa95c0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:15:32.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.510+0000 7fa9611a6700 1 -- 172.21.15.26:0/276863525 shutdown_connections 2021-11-03T18:15:32.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.510+0000 7fa9611a6700 1 -- 172.21.15.26:0/276863525 wait complete. 2021-11-03T18:15:32.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.511+0000 7fa9611a6700 1 Processor -- start 2021-11-03T18:15:32.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.511+0000 7fa9611a6700 1 -- start start 2021-11-03T18:15:32.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.511+0000 7fa9611a6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa95c0f66e0 0x7fa95c106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:15:32.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.511+0000 7fa9611a6700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa95c0f6ff0 0x7fa95c107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:15:32.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.511+0000 7fa9611a6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa95c107a10 con 0x7fa95c0f66e0 2021-11-03T18:15:32.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.511+0000 7fa9611a6700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa95c107b50 con 0x7fa95c0f6ff0 2021-11-03T18:15:32.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.511+0000 7fa95ad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa95c0f66e0 0x7fa95c106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:15:32.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.511+0000 7fa95ad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa95c0f66e0 0x7fa95c106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59028/0 (socket says 172.21.15.26:59028) 2021-11-03T18:15:32.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.511+0000 7fa95ad9d700 1 -- 172.21.15.26:0/2649245411 learned_addr learned my addr 172.21.15.26:0/2649245411 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:15:32.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.511+0000 7fa95a59c700 1 --2- 172.21.15.26:0/2649245411 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa95c0f6ff0 0x7fa95c107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:15:32.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.512+0000 7fa95ad9d700 1 -- 172.21.15.26:0/2649245411 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa95c0f6ff0 msgr2=0x7fa95c107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:15:32.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.512+0000 7fa95ad9d700 1 --2- 172.21.15.26:0/2649245411 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa95c0f6ff0 0x7fa95c107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:32.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.512+0000 7fa95ad9d700 1 -- 172.21.15.26:0/2649245411 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa944005040 con 0x7fa95c0f66e0 2021-11-03T18:15:32.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.512+0000 7fa95a59c700 1 --2- 172.21.15.26:0/2649245411 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa95c0f6ff0 0x7fa95c107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:15:32.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.512+0000 7fa95ad9d700 1 --2- 172.21.15.26:0/2649245411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa95c0f66e0 0x7fa95c106f70 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 rx=0x7fa954007fd0 tx=0x7fa954004ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:15:32.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.512+0000 7fa9537fe700 1 -- 172.21.15.26:0/2649245411 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa95400b5a0 con 0x7fa95c0f66e0 2021-11-03T18:15:32.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.512+0000 7fa9611a6700 1 -- 172.21.15.26:0/2649245411 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa95c1084f0 con 0x7fa95c0f66e0 2021-11-03T18:15:32.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.512+0000 7fa9537fe700 1 -- 172.21.15.26:0/2649245411 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa95400f040 con 0x7fa95c0f66e0 2021-11-03T18:15:32.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.512+0000 7fa9537fe700 1 -- 172.21.15.26:0/2649245411 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa954013b60 con 0x7fa95c0f66e0 2021-11-03T18:15:32.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.512+0000 7fa9611a6700 1 -- 172.21.15.26:0/2649245411 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa95c108ab0 con 0x7fa95c0f66e0 2021-11-03T18:15:32.518 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.513+0000 7fa9611a6700 1 -- 172.21.15.26:0/2649245411 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa95c045ad0 con 0x7fa95c0f66e0 2021-11-03T18:15:32.518 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.513+0000 7fa9537fe700 1 -- 172.21.15.26:0/2649245411 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fa95401a030 con 0x7fa95c0f66e0 2021-11-03T18:15:32.518 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.514+0000 7fa9537fe700 1 --2- 172.21.15.26:0/2649245411 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa9480640b0 0x7fa948066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:15:32.518 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.514+0000 7fa9537fe700 1 -- 172.21.15.26:0/2649245411 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fa954080740 con 0x7fa95c0f66e0 2021-11-03T18:15:32.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.514+0000 7fa95a59c700 1 --2- 172.21.15.26:0/2649245411 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa9480640b0 0x7fa948066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:15:32.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.514+0000 7fa95a59c700 1 --2- 172.21.15.26:0/2649245411 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa9480640b0 0x7fa948066570 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7fa944004630 tx=0x7fa944009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:15:32.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.518+0000 7fa9537fe700 1 -- 172.21.15.26:0/2649245411 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fa954052a60 con 0x7fa95c0f66e0 2021-11-03T18:15:32.742 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.744+0000 7fa9611a6700 1 -- 172.21.15.26:0/2649245411 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa95c0fefe0 con 0x7fa95c0f66e0 2021-11-03T18:15:32.743 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.745+0000 7fa9537fe700 1 -- 172.21.15.26:0/2649245411 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fa954018070 con 0x7fa95c0f66e0 2021-11-03T18:15:32.743 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:15:32.743 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:15:32.744 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:15:32.744 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:15:32.744 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:15:32.744 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:15:32.745 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:15:32.745 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:15:32.745 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:15:32.745 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:15:32.746 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:15:32.746 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:15:32.746 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:15:32.747 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:15:32.747 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:15:32.747 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:15:32.747 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:15:32.748 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:15:32.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.746+0000 7fa9611a6700 1 -- 172.21.15.26:0/2649245411 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa9480640b0 msgr2=0x7fa948066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:15:32.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.746+0000 7fa9611a6700 1 --2- 172.21.15.26:0/2649245411 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa9480640b0 0x7fa948066570 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7fa944004630 tx=0x7fa944009b30).stop 2021-11-03T18:15:32.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.746+0000 7fa9611a6700 1 -- 172.21.15.26:0/2649245411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa95c0f66e0 msgr2=0x7fa95c106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:15:32.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.746+0000 7fa9611a6700 1 --2- 172.21.15.26:0/2649245411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa95c0f66e0 0x7fa95c106f70 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 rx=0x7fa954007fd0 tx=0x7fa954004ee0).stop 2021-11-03T18:15:32.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.746+0000 7fa9611a6700 1 -- 172.21.15.26:0/2649245411 shutdown_connections 2021-11-03T18:15:32.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.746+0000 7fa9611a6700 1 --2- 172.21.15.26:0/2649245411 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa9480640b0 0x7fa948066570 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:32.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.746+0000 7fa9611a6700 1 --2- 172.21.15.26:0/2649245411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa95c0f66e0 0x7fa95c106f70 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:32.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.746+0000 7fa9611a6700 1 --2- 172.21.15.26:0/2649245411 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa95c0f6ff0 0x7fa95c107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:32.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.746+0000 7fa9611a6700 1 -- 172.21.15.26:0/2649245411 >> 172.21.15.26:0/2649245411 conn(0x7fa95c0f1f00 msgr2=0x7fa95c0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:15:32.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.746+0000 7fa9611a6700 1 -- 172.21.15.26:0/2649245411 shutdown_connections 2021-11-03T18:15:32.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.746+0000 7fa9611a6700 1 -- 172.21.15.26:0/2649245411 wait complete. 2021-11-03T18:15:32.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.850+0000 7fe0ddb4e700 1 -- 172.21.15.26:0/3639627879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0d80f6ff0 msgr2=0x7fe0d80f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:15:32.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.850+0000 7fe0ddb4e700 1 --2- 172.21.15.26:0/3639627879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0d80f6ff0 0x7fe0d80f7a20 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7fe0cc004660 tx=0x7fe0cc009b30).stop 2021-11-03T18:15:32.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.850+0000 7fe0ddb4e700 1 -- 172.21.15.26:0/3639627879 shutdown_connections 2021-11-03T18:15:32.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.850+0000 7fe0ddb4e700 1 --2- 172.21.15.26:0/3639627879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0d80f6ff0 0x7fe0d80f7a20 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:32.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.850+0000 7fe0ddb4e700 1 --2- 172.21.15.26:0/3639627879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0d80f66e0 0x7fe0d80f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:15:32.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.850+0000 7fe0ddb4e700 1 -- 172.21.15.26:0/3639627879 >> 172.21.15.26:0/3639627879 conn(0x7fe0d80f1f00 msgr2=0x7fe0d80f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:15:32.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.850+0000 7fe0ddb4e700 1 -- 172.21.15.26:0/3639627879 shutdown_connections 2021-11-03T18:15:32.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.850+0000 7fe0ddb4e700 1 -- 172.21.15.26:0/3639627879 wait complete. 2021-11-03T18:15:32.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.851+0000 7fe0ddb4e700 1 Processor -- start 2021-11-03T18:15:32.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.851+0000 7fe0ddb4e700 1 -- start start 2021-11-03T18:15:32.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.851+0000 7fe0ddb4e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0d80f66e0 0x7fe0d8106fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:15:32.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.851+0000 7fe0ddb4e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0d80f6ff0 0x7fe0d8107490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:15:32.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.851+0000 7fe0ddb4e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d8107ad0 con 0x7fe0d80f66e0 2021-11-03T18:15:32.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.851+0000 7fe0ddb4e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d8108380 con 0x7fe0d80f6ff0 2021-11-03T18:15:32.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.851+0000 7fe0d77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0d80f66e0 0x7fe0d8106fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:15:32.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.851+0000 7fe0d77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0d80f66e0 0x7fe0d8106fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59038/0 (socket says 172.21.15.26:59038) 2021-11-03T18:15:32.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.851+0000 7fe0d77fe700 1 -- 172.21.15.26:0/4064291385 learned_addr learned my addr 172.21.15.26:0/4064291385 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:15:32.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.851+0000 7fe0d6ffd700 1 --2- 172.21.15.26:0/4064291385 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0d80f6ff0 0x7fe0d8107490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:15:32.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.851+0000 7fe0d77fe700 1 -- 172.21.15.26:0/4064291385 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0d80f6ff0 msgr2=0x7fe0d8107490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:15:32.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.851+0000 7fe0d77fe700 1 --2- 172.21.15.26:0/4064291385 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0d80f6ff0 0x7fe0d8107490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:32.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.852+0000 7fe0d77fe700 1 -- 172.21.15.26:0/4064291385 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0cc005040 con 0x7fe0d80f66e0 2021-11-03T18:15:32.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.852+0000 7fe0d77fe700 1 --2- 172.21.15.26:0/4064291385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0d80f66e0 0x7fe0d8106fa0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 rx=0x7fe0c800b410 tx=0x7fe0c8006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:15:32.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.852+0000 7fe0bffff700 1 -- 172.21.15.26:0/4064291385 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0c80125f0 con 0x7fe0d80f66e0 2021-11-03T18:15:32.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.852+0000 7fe0bffff700 1 -- 172.21.15.26:0/4064291385 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe0c8012c00 con 0x7fe0d80f66e0 2021-11-03T18:15:32.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.852+0000 7fe0ddb4e700 1 -- 172.21.15.26:0/4064291385 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0d8108660 con 0x7fe0d80f66e0 2021-11-03T18:15:32.858 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.852+0000 7fe0bffff700 1 -- 172.21.15.26:0/4064291385 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0c8002ae0 con 0x7fe0d80f66e0 2021-11-03T18:15:32.858 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.852+0000 7fe0ddb4e700 1 -- 172.21.15.26:0/4064291385 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0d8108c20 con 0x7fe0d80f66e0 2021-11-03T18:15:32.863 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.853+0000 7fe0ddb4e700 1 -- 172.21.15.26:0/4064291385 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0d80f5b70 con 0x7fe0d80f66e0 2021-11-03T18:15:32.863 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.853+0000 7fe0bffff700 1 -- 172.21.15.26:0/4064291385 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fe0c800f030 con 0x7fe0d80f66e0 2021-11-03T18:15:32.863 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.854+0000 7fe0bffff700 1 --2- 172.21.15.26:0/4064291385 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe0c0064090 0x7fe0c0066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:15:32.864 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.854+0000 7fe0bffff700 1 -- 172.21.15.26:0/4064291385 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fe0c8080c80 con 0x7fe0d80f66e0 2021-11-03T18:15:32.864 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.854+0000 7fe0d6ffd700 1 --2- 172.21.15.26:0/4064291385 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe0c0064090 0x7fe0c0066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:15:32.864 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.854+0000 7fe0d6ffd700 1 --2- 172.21.15.26:0/4064291385 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe0c0064090 0x7fe0c0066550 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7fe0cc000c00 tx=0x7fe0cc009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:15:32.864 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:32.858+0000 7fe0bffff700 1 -- 172.21.15.26:0/4064291385 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fe0c8052fe0 con 0x7fe0d80f66e0 2021-11-03T18:15:33.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:33.063+0000 7fe0ddb4e700 1 -- 172.21.15.26:0/4064291385 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe0d8045ad0 con 0x7fe0d80f66e0 2021-11-03T18:15:33.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:33.064+0000 7fe0bffff700 1 -- 172.21.15.26:0/4064291385 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fe0c8002d50 con 0x7fe0d80f66e0 2021-11-03T18:15:33.062 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:15:33.062 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:15:33.063 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:15:33.063 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:15:33.063 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:15:33.063 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:15:33.064 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:15:33.064 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:15:33.064 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:15:33.064 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:15:33.065 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:15:33.065 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:15:33.065 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:15:33.065 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:15:33.066 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:15:33.066 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:15:33.066 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:15:33.067 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:15:33.067 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:15:33.067 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:15:33.067 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:15:33.067 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:15:33.068 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:15:33.068 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:15:33.068 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:15:33.068 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:15:33.069 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:15:33.069 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:15:33.069 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:15:33.069 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:15:33.069 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:15:33.070 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:15:33.070 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:15:33.070 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:15:33.071 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:15:33.071 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:15:33.071 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:15:33.071 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:15:33.071 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:15:33.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:33.066+0000 7fe0ddb4e700 1 -- 172.21.15.26:0/4064291385 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe0c0064090 msgr2=0x7fe0c0066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:15:33.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:33.066+0000 7fe0ddb4e700 1 --2- 172.21.15.26:0/4064291385 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe0c0064090 0x7fe0c0066550 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7fe0cc000c00 tx=0x7fe0cc009b30).stop 2021-11-03T18:15:33.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:33.066+0000 7fe0ddb4e700 1 -- 172.21.15.26:0/4064291385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0d80f66e0 msgr2=0x7fe0d8106fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:15:33.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:33.066+0000 7fe0ddb4e700 1 --2- 172.21.15.26:0/4064291385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0d80f66e0 0x7fe0d8106fa0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 rx=0x7fe0c800b410 tx=0x7fe0c8006ef0).stop 2021-11-03T18:15:33.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:33.066+0000 7fe0ddb4e700 1 -- 172.21.15.26:0/4064291385 shutdown_connections 2021-11-03T18:15:33.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:33.066+0000 7fe0ddb4e700 1 --2- 172.21.15.26:0/4064291385 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe0c0064090 0x7fe0c0066550 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:33.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:33.066+0000 7fe0ddb4e700 1 --2- 172.21.15.26:0/4064291385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0d80f66e0 0x7fe0d8106fa0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:33.075 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:33.066+0000 7fe0ddb4e700 1 --2- 172.21.15.26:0/4064291385 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0d80f6ff0 0x7fe0d8107490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:15:33.075 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:33.066+0000 7fe0ddb4e700 1 -- 172.21.15.26:0/4064291385 >> 172.21.15.26:0/4064291385 conn(0x7fe0d80f1f00 msgr2=0x7fe0d80fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:15:33.075 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:33.066+0000 7fe0ddb4e700 1 -- 172.21.15.26:0/4064291385 shutdown_connections 2021-11-03T18:15:33.075 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:15:33.066+0000 7fe0ddb4e700 1 -- 172.21.15.26:0/4064291385 wait complete. 2021-11-03T18:15:33.075 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:15:33.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:32 smithi026 ceph-mon[96795]: pgmap v2426: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:33.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:32 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2649245411' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:15:33.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:32 smithi194 ceph-mon[65619]: pgmap v2426: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:33.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:32 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2649245411' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:15:34.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:33 smithi026 ceph-mon[96795]: from='client.36636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:15:34.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:33 smithi026 ceph-mon[96795]: from='client.36640 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:15:34.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:33 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/4064291385' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:15:34.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:33 smithi194 ceph-mon[65619]: from='client.36636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:15:34.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:33 smithi194 ceph-mon[65619]: from='client.36640 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:15:34.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:33 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/4064291385' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:15:35.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:34 smithi026 ceph-mon[96795]: pgmap v2427: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:35.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:34 smithi194 ceph-mon[65619]: pgmap v2427: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:37.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:36 smithi026 ceph-mon[96795]: pgmap v2428: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:37.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:36 smithi194 ceph-mon[65619]: pgmap v2428: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:38.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:37 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:15:38.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:37 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:15:39.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:38 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:15:39.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:38 smithi026 ceph-mon[96795]: pgmap v2429: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:39.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:38 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:15:39.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:38 smithi194 ceph-mon[65619]: pgmap v2429: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:41.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:40 smithi026 ceph-mon[96795]: pgmap v2430: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:41.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:40 smithi194 ceph-mon[65619]: pgmap v2430: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:43.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:42 smithi026 ceph-mon[96795]: pgmap v2431: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:43.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:42 smithi194 ceph-mon[65619]: pgmap v2431: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:45.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:44 smithi026 ceph-mon[96795]: pgmap v2432: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:45.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:44 smithi194 ceph-mon[65619]: pgmap v2432: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:47.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:46 smithi026 ceph-mon[96795]: pgmap v2433: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:47.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:46 smithi194 ceph-mon[65619]: pgmap v2433: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:49.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:48 smithi026 ceph-mon[96795]: pgmap v2434: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:49.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:15:49.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:15:49.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:48 smithi194 ceph-mon[65619]: pgmap v2434: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:49.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:15:49.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:15:51.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:50 smithi026 ceph-mon[96795]: pgmap v2435: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:51.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:50 smithi194 ceph-mon[65619]: pgmap v2435: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:53.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:52 smithi026 ceph-mon[96795]: pgmap v2436: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:53.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:52 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:15:53.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:52 smithi194 ceph-mon[65619]: pgmap v2436: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:53.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:52 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:15:54.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:53 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:15:54.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:53 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:15:55.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:54 smithi026 ceph-mon[96795]: pgmap v2437: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:55.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:54 smithi194 ceph-mon[65619]: pgmap v2437: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:57.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:56 smithi026 ceph-mon[96795]: pgmap v2438: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:57.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:56 smithi194 ceph-mon[65619]: pgmap v2438: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:59.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:15:58 smithi026 ceph-mon[96795]: pgmap v2439: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:15:59.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:15:58 smithi194 ceph-mon[65619]: pgmap v2439: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:01.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:00 smithi026 ceph-mon[96795]: pgmap v2440: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:01.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:00 smithi194 ceph-mon[65619]: pgmap v2440: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:03.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:02 smithi026 ceph-mon[96795]: pgmap v2441: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:03.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.180+0000 7f657359e700 1 -- 172.21.15.26:0/3466755353 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65740f77d0 msgr2=0x7f65740f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:16:03.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.181+0000 7f657359e700 1 --2- 172.21.15.26:0/3466755353 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65740f77d0 0x7f65740f7c30 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7f6568004660 tx=0x7f6568009b30).stop 2021-11-03T18:16:03.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.181+0000 7f657359e700 1 -- 172.21.15.26:0/3466755353 shutdown_connections 2021-11-03T18:16:03.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.181+0000 7f657359e700 1 --2- 172.21.15.26:0/3466755353 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65740f77d0 0x7f65740f7c30 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:03.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.181+0000 7f657359e700 1 --2- 172.21.15.26:0/3466755353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65740f6530 0x7f65740f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:03.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.181+0000 7f657359e700 1 -- 172.21.15.26:0/3466755353 >> 172.21.15.26:0/3466755353 conn(0x7f65740f1cd0 msgr2=0x7f65740f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:16:03.180 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.181+0000 7f657359e700 1 -- 172.21.15.26:0/3466755353 shutdown_connections 2021-11-03T18:16:03.180 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.181+0000 7f657359e700 1 -- 172.21.15.26:0/3466755353 wait complete. 2021-11-03T18:16:03.182 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.181+0000 7f657359e700 1 Processor -- start 2021-11-03T18:16:03.183 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.181+0000 7f657359e700 1 -- start start 2021-11-03T18:16:03.183 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.181+0000 7f657359e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65740f6530 0x7f6574106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:16:03.183 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.181+0000 7f657359e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65740f77d0 0x7f6574107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:16:03.183 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.181+0000 7f657359e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6574107870 con 0x7f65740f77d0 2021-11-03T18:16:03.183 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.181+0000 7f657359e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6574108080 con 0x7f65740f6530 2021-11-03T18:16:03.184 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.182+0000 7f6571d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65740f77d0 0x7f6574107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:16:03.184 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.182+0000 7f6571d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65740f77d0 0x7f6574107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59058/0 (socket says 172.21.15.26:59058) 2021-11-03T18:16:03.184 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.182+0000 7f6571d9b700 1 -- 172.21.15.26:0/875437356 learned_addr learned my addr 172.21.15.26:0/875437356 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:16:03.184 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.182+0000 7f657259c700 1 --2- 172.21.15.26:0/875437356 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65740f6530 0x7f6574106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:16:03.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.182+0000 7f6571d9b700 1 -- 172.21.15.26:0/875437356 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65740f6530 msgr2=0x7f6574106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:16:03.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.182+0000 7f6571d9b700 1 --2- 172.21.15.26:0/875437356 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65740f6530 0x7f6574106d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:03.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.182+0000 7f6571d9b700 1 -- 172.21.15.26:0/875437356 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6568005040 con 0x7f65740f77d0 2021-11-03T18:16:03.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.182+0000 7f6571d9b700 1 --2- 172.21.15.26:0/875437356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65740f77d0 0x7f6574107270 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7f6568009990 tx=0x7f6568009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:16:03.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.182+0000 7f6562ffd700 1 -- 172.21.15.26:0/875437356 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6568018070 con 0x7f65740f77d0 2021-11-03T18:16:03.186 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.182+0000 7f6562ffd700 1 -- 172.21.15.26:0/875437356 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6568007ba0 con 0x7f65740f77d0 2021-11-03T18:16:03.186 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.182+0000 7f657359e700 1 -- 172.21.15.26:0/875437356 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65741082a0 con 0x7f65740f77d0 2021-11-03T18:16:03.186 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.182+0000 7f6562ffd700 1 -- 172.21.15.26:0/875437356 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f656801c3c0 con 0x7f65740f77d0 2021-11-03T18:16:03.186 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.182+0000 7f657359e700 1 -- 172.21.15.26:0/875437356 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6574108800 con 0x7f65740f77d0 2021-11-03T18:16:03.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.183+0000 7f657359e700 1 -- 172.21.15.26:0/875437356 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6574059100 con 0x7f65740f77d0 2021-11-03T18:16:03.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.184+0000 7f6562ffd700 1 -- 172.21.15.26:0/875437356 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f656801d420 con 0x7f65740f77d0 2021-11-03T18:16:03.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.184+0000 7f6562ffd700 1 --2- 172.21.15.26:0/875437356 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f655c064100 0x7f655c0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:16:03.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.184+0000 7f6562ffd700 1 -- 172.21.15.26:0/875437356 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f6568082340 con 0x7f65740f77d0 2021-11-03T18:16:03.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.184+0000 7f657259c700 1 --2- 172.21.15.26:0/875437356 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f655c064100 0x7f655c0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:16:03.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.185+0000 7f657259c700 1 --2- 172.21.15.26:0/875437356 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f655c064100 0x7f655c0665c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f6574106af0 tx=0x7f656400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:16:03.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.188+0000 7f6562ffd700 1 -- 172.21.15.26:0/875437356 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f6568054760 con 0x7f65740f77d0 2021-11-03T18:16:03.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:02 smithi194 ceph-mon[65619]: pgmap v2441: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:03.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.367+0000 7f657359e700 1 -- 172.21.15.26:0/875437356 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f65740fee80 con 0x7f655c064100 2021-11-03T18:16:03.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.369+0000 7f6562ffd700 1 -- 172.21.15.26:0/875437356 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f65740fee80 con 0x7f655c064100 2021-11-03T18:16:03.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.370+0000 7f657359e700 1 -- 172.21.15.26:0/875437356 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f655c064100 msgr2=0x7f655c0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:16:03.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.370+0000 7f657359e700 1 --2- 172.21.15.26:0/875437356 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f655c064100 0x7f655c0665c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f6574106af0 tx=0x7f656400b040).stop 2021-11-03T18:16:03.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.370+0000 7f657359e700 1 -- 172.21.15.26:0/875437356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65740f77d0 msgr2=0x7f6574107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:16:03.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.370+0000 7f657359e700 1 --2- 172.21.15.26:0/875437356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65740f77d0 0x7f6574107270 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7f6568009990 tx=0x7f6568009b30).stop 2021-11-03T18:16:03.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.370+0000 7f657359e700 1 -- 172.21.15.26:0/875437356 shutdown_connections 2021-11-03T18:16:03.370 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.370+0000 7f657359e700 1 --2- 172.21.15.26:0/875437356 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f655c064100 0x7f655c0665c0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:03.370 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.370+0000 7f657359e700 1 --2- 172.21.15.26:0/875437356 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65740f6530 0x7f6574106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:03.370 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.370+0000 7f657359e700 1 --2- 172.21.15.26:0/875437356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65740f77d0 0x7f6574107270 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:03.370 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.370+0000 7f657359e700 1 -- 172.21.15.26:0/875437356 >> 172.21.15.26:0/875437356 conn(0x7f65740f1cd0 msgr2=0x7f65740fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:16:03.371 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.371+0000 7f657359e700 1 -- 172.21.15.26:0/875437356 shutdown_connections 2021-11-03T18:16:03.371 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.371+0000 7f657359e700 1 -- 172.21.15.26:0/875437356 wait complete. 2021-11-03T18:16:03.378 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:16:03.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.471+0000 7f8439ced700 1 -- 172.21.15.26:0/2199297457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84340f6b90 msgr2=0x7f84340f6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:16:03.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.471+0000 7f8439ced700 1 --2- 172.21.15.26:0/2199297457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84340f6b90 0x7f84340f6fb0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 rx=0x7f8424004660 tx=0x7f8424009b30).stop 2021-11-03T18:16:03.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.471+0000 7f8439ced700 1 -- 172.21.15.26:0/2199297457 shutdown_connections 2021-11-03T18:16:03.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.471+0000 7f8439ced700 1 --2- 172.21.15.26:0/2199297457 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84340f74a0 0x7f84340f5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:03.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.471+0000 7f8439ced700 1 --2- 172.21.15.26:0/2199297457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84340f6b90 0x7f84340f6fb0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:03.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.471+0000 7f8439ced700 1 -- 172.21.15.26:0/2199297457 >> 172.21.15.26:0/2199297457 conn(0x7f84340f0540 msgr2=0x7f84340f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:16:03.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.471+0000 7f8439ced700 1 -- 172.21.15.26:0/2199297457 shutdown_connections 2021-11-03T18:16:03.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.471+0000 7f8439ced700 1 -- 172.21.15.26:0/2199297457 wait complete. 2021-11-03T18:16:03.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.471+0000 7f8439ced700 1 Processor -- start 2021-11-03T18:16:03.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.471+0000 7f8439ced700 1 -- start start 2021-11-03T18:16:03.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.472+0000 7f8439ced700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84340f6b90 0x7f84340f9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:16:03.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.472+0000 7f8439ced700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84340f74a0 0x7f84340f7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:16:03.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.472+0000 7f8439ced700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84340f81e0 con 0x7f84340f6b90 2021-11-03T18:16:03.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.472+0000 7f8439ced700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84340f8320 con 0x7f84340f74a0 2021-11-03T18:16:03.476 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.472+0000 7f84337fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84340f6b90 0x7f84340f9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:16:03.476 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.472+0000 7f84337fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84340f6b90 0x7f84340f9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59066/0 (socket says 172.21.15.26:59066) 2021-11-03T18:16:03.476 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.472+0000 7f84337fe700 1 -- 172.21.15.26:0/2764979023 learned_addr learned my addr 172.21.15.26:0/2764979023 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:16:03.476 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.472+0000 7f8432ffd700 1 --2- 172.21.15.26:0/2764979023 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84340f74a0 0x7f84340f7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:16:03.477 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.472+0000 7f84337fe700 1 -- 172.21.15.26:0/2764979023 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84340f74a0 msgr2=0x7f84340f7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:16:03.477 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.472+0000 7f84337fe700 1 --2- 172.21.15.26:0/2764979023 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84340f74a0 0x7f84340f7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:03.477 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.472+0000 7f84337fe700 1 -- 172.21.15.26:0/2764979023 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8424005040 con 0x7f84340f6b90 2021-11-03T18:16:03.477 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.472+0000 7f84337fe700 1 --2- 172.21.15.26:0/2764979023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84340f6b90 0x7f84340f9800 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7f8424013a70 tx=0x7f8424009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:16:03.477 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.472+0000 7f841bfff700 1 -- 172.21.15.26:0/2764979023 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8424018070 con 0x7f84340f6b90 2021-11-03T18:16:03.478 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.472+0000 7f841bfff700 1 -- 172.21.15.26:0/2764979023 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f84240097d0 con 0x7f84340f6b90 2021-11-03T18:16:03.478 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.472+0000 7f8439ced700 1 -- 172.21.15.26:0/2764979023 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84340f85a0 con 0x7f84340f6b90 2021-11-03T18:16:03.478 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.472+0000 7f841bfff700 1 -- 172.21.15.26:0/2764979023 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f842401c3c0 con 0x7f84340f6b90 2021-11-03T18:16:03.478 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.473+0000 7f8439ced700 1 -- 172.21.15.26:0/2764979023 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84340f8b00 con 0x7f84340f6b90 2021-11-03T18:16:03.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.473+0000 7f8439ced700 1 -- 172.21.15.26:0/2764979023 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8434045ad0 con 0x7f84340f6b90 2021-11-03T18:16:03.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.474+0000 7f841bfff700 1 -- 172.21.15.26:0/2764979023 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f8424007ba0 con 0x7f84340f6b90 2021-11-03T18:16:03.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.474+0000 7f841bfff700 1 --2- 172.21.15.26:0/2764979023 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f841c0640b0 0x7f841c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:16:03.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.474+0000 7f841bfff700 1 -- 172.21.15.26:0/2764979023 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f8424082470 con 0x7f84340f6b90 2021-11-03T18:16:03.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.474+0000 7f8432ffd700 1 --2- 172.21.15.26:0/2764979023 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f841c0640b0 0x7f841c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:16:03.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.475+0000 7f8432ffd700 1 --2- 172.21.15.26:0/2764979023 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f841c0640b0 0x7f841c066570 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7f8428009760 tx=0x7f8428009c60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:16:03.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.478+0000 7f841bfff700 1 -- 172.21.15.26:0/2764979023 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f84240547d0 con 0x7f84340f6b90 2021-11-03T18:16:03.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.651+0000 7f8439ced700 1 -- 172.21.15.26:0/2764979023 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f84340fad80 con 0x7f841c0640b0 2021-11-03T18:16:03.663 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.666+0000 7f841bfff700 1 -- 172.21.15.26:0/2764979023 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f84340fad80 con 0x7f841c0640b0 2021-11-03T18:16:03.664 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:16:03.664 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (87m) 6m ago 88m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:16:03.664 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (79m) 6m ago 88m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:16:03.665 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (79m) 4m ago 87m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:16:03.665 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (87m) 6m ago 88m 42.0M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:16:03.665 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (80m) 6m ago 83m 25.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:16:03.665 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (80m) 6m ago 83m 26.4M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:16:03.666 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (83m) 4m ago 83m 26.6M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:16:03.666 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (83m) 4m ago 83m 27.0M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:16:03.666 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (81m) 6m ago 89m 574M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:16:03.666 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (80m) 4m ago 87m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:16:03.666 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (80m) 6m ago 90m 308M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:16:03.667 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (80m) 4m ago 87m 145M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:16:03.667 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (88m) 6m ago 88m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:16:03.667 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (87m) 4m ago 87m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:16:03.667 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (79m) 6m ago 86m 312M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:16:03.668 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (78m) 6m ago 86m 335M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:16:03.668 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (78m) 6m ago 86m 279M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:16:03.668 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (77m) 4m ago 85m 362M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:16:03.668 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (77m) 4m ago 85m 302M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:16:03.669 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (76m) 4m ago 85m 296M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:16:03.669 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (87m) 6m ago 87m 63.4M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:16:03.670 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.668+0000 7f8439ced700 1 -- 172.21.15.26:0/2764979023 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f841c0640b0 msgr2=0x7f841c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:16:03.670 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.668+0000 7f8439ced700 1 --2- 172.21.15.26:0/2764979023 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f841c0640b0 0x7f841c066570 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7f8428009760 tx=0x7f8428009c60).stop 2021-11-03T18:16:03.670 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.668+0000 7f8439ced700 1 -- 172.21.15.26:0/2764979023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84340f6b90 msgr2=0x7f84340f9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:16:03.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.668+0000 7f8439ced700 1 --2- 172.21.15.26:0/2764979023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84340f6b90 0x7f84340f9800 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7f8424013a70 tx=0x7f8424009b30).stop 2021-11-03T18:16:03.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.668+0000 7f8439ced700 1 -- 172.21.15.26:0/2764979023 shutdown_connections 2021-11-03T18:16:03.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.668+0000 7f8439ced700 1 --2- 172.21.15.26:0/2764979023 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f841c0640b0 0x7f841c066570 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:03.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.668+0000 7f8439ced700 1 --2- 172.21.15.26:0/2764979023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84340f6b90 0x7f84340f9800 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:03.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.668+0000 7f8439ced700 1 --2- 172.21.15.26:0/2764979023 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84340f74a0 0x7f84340f7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:03.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.668+0000 7f8439ced700 1 -- 172.21.15.26:0/2764979023 >> 172.21.15.26:0/2764979023 conn(0x7f84340f0540 msgr2=0x7f84340f5040 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:16:03.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.668+0000 7f8439ced700 1 -- 172.21.15.26:0/2764979023 shutdown_connections 2021-11-03T18:16:03.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.668+0000 7f8439ced700 1 -- 172.21.15.26:0/2764979023 wait complete. 2021-11-03T18:16:03.766 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.768+0000 7f13f9e9c700 1 -- 172.21.15.26:0/2981361137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13f40f49a0 msgr2=0x7f13f40f4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:16:03.766 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.768+0000 7f13f9e9c700 1 --2- 172.21.15.26:0/2981361137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13f40f49a0 0x7f13f40f4dc0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 rx=0x7f13dc004660 tx=0x7f13dc009b30).stop 2021-11-03T18:16:03.766 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.768+0000 7f13f9e9c700 1 -- 172.21.15.26:0/2981361137 shutdown_connections 2021-11-03T18:16:03.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.768+0000 7f13f9e9c700 1 --2- 172.21.15.26:0/2981361137 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13f40f5340 0x7f13f40f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:16:03.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.768+0000 7f13f9e9c700 1 --2- 172.21.15.26:0/2981361137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13f40f49a0 0x7f13f40f4dc0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:03.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.768+0000 7f13f9e9c700 1 -- 172.21.15.26:0/2981361137 >> 172.21.15.26:0/2981361137 conn(0x7f13f40f04c0 msgr2=0x7f13f40f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:16:03.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.768+0000 7f13f9e9c700 1 -- 172.21.15.26:0/2981361137 shutdown_connections 2021-11-03T18:16:03.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.768+0000 7f13f9e9c700 1 -- 172.21.15.26:0/2981361137 wait complete. 2021-11-03T18:16:03.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.768+0000 7f13f9e9c700 1 Processor -- start 2021-11-03T18:16:03.770 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.769+0000 7f13f9e9c700 1 -- start start 2021-11-03T18:16:03.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.769+0000 7f13f9e9c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13f40f49a0 0x7f13f4106fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:16:03.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.769+0000 7f13f9e9c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13f40f5340 0x7f13f41074b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:16:03.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.769+0000 7f13f9e9c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f4107af0 con 0x7f13f40f49a0 2021-11-03T18:16:03.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.769+0000 7f13f9e9c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f41083a0 con 0x7f13f40f5340 2021-11-03T18:16:03.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.769+0000 7f13f37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13f40f49a0 0x7f13f4106fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:16:03.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.769+0000 7f13f37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13f40f49a0 0x7f13f4106fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59076/0 (socket says 172.21.15.26:59076) 2021-11-03T18:16:03.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.769+0000 7f13f37fe700 1 -- 172.21.15.26:0/3130586678 learned_addr learned my addr 172.21.15.26:0/3130586678 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:16:03.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.769+0000 7f13f37fe700 1 -- 172.21.15.26:0/3130586678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13f40f5340 msgr2=0x7f13f41074b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:16:03.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.769+0000 7f13f2ffd700 1 --2- 172.21.15.26:0/3130586678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13f40f5340 0x7f13f41074b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:16:03.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.769+0000 7f13f37fe700 1 --2- 172.21.15.26:0/3130586678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13f40f5340 0x7f13f41074b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:03.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.769+0000 7f13f37fe700 1 -- 172.21.15.26:0/3130586678 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13dc005040 con 0x7f13f40f49a0 2021-11-03T18:16:03.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.769+0000 7f13f2ffd700 1 --2- 172.21.15.26:0/3130586678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13f40f5340 0x7f13f41074b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:16:03.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.769+0000 7f13f37fe700 1 --2- 172.21.15.26:0/3130586678 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13f40f49a0 0x7f13f4106fc0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 rx=0x7f13dc004f60 tx=0x7f13dc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:16:03.774 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.769+0000 7f13ebfff700 1 -- 172.21.15.26:0/3130586678 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13dc018070 con 0x7f13f40f49a0 2021-11-03T18:16:03.774 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.770+0000 7f13ebfff700 1 -- 172.21.15.26:0/3130586678 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f13dc007ba0 con 0x7f13f40f49a0 2021-11-03T18:16:03.774 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.770+0000 7f13f9e9c700 1 -- 172.21.15.26:0/3130586678 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13f4108620 con 0x7f13f40f49a0 2021-11-03T18:16:03.774 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.770+0000 7f13ebfff700 1 -- 172.21.15.26:0/3130586678 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13dc01c620 con 0x7f13f40f49a0 2021-11-03T18:16:03.775 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.770+0000 7f13f9e9c700 1 -- 172.21.15.26:0/3130586678 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13f4108b80 con 0x7f13f40f49a0 2021-11-03T18:16:03.775 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.770+0000 7f13f9e9c700 1 -- 172.21.15.26:0/3130586678 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13f40f4150 con 0x7f13f40f49a0 2021-11-03T18:16:03.775 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.771+0000 7f13ebfff700 1 -- 172.21.15.26:0/3130586678 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f13dc01c8e0 con 0x7f13f40f49a0 2021-11-03T18:16:03.775 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.771+0000 7f13ebfff700 1 --2- 172.21.15.26:0/3130586678 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f13e00640b0 0x7f13e0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:16:03.775 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.772+0000 7f13ebfff700 1 -- 172.21.15.26:0/3130586678 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f13dc0827a0 con 0x7f13f40f49a0 2021-11-03T18:16:03.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.772+0000 7f13f2ffd700 1 --2- 172.21.15.26:0/3130586678 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f13e00640b0 0x7f13e0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:16:03.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.772+0000 7f13f2ffd700 1 --2- 172.21.15.26:0/3130586678 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f13e00640b0 0x7f13e0066570 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f13f40f5780 tx=0x7f13e4008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:16:03.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:03.775+0000 7f13ebfff700 1 -- 172.21.15.26:0/3130586678 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f13dc054a40 con 0x7f13f40f49a0 2021-11-03T18:16:04.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.006+0000 7f13f9e9c700 1 -- 172.21.15.26:0/3130586678 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f13f40ff050 con 0x7f13f40f49a0 2021-11-03T18:16:04.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.006+0000 7f13ebfff700 1 -- 172.21.15.26:0/3130586678 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f13dc054630 con 0x7f13f40f49a0 2021-11-03T18:16:04.006 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:16:04.006 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:16:04.006 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:16:04.006 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:16:04.007 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:16:04.007 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:16:04.007 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:16:04.007 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:16:04.008 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:16:04.008 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:16:04.008 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:16:04.008 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:16:04.009 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:16:04.009 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:16:04.010 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:16:04.010 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:16:04.010 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:16:04.010 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:16:04.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.008+0000 7f13f9e9c700 1 -- 172.21.15.26:0/3130586678 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f13e00640b0 msgr2=0x7f13e0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:16:04.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.008+0000 7f13f9e9c700 1 --2- 172.21.15.26:0/3130586678 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f13e00640b0 0x7f13e0066570 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f13f40f5780 tx=0x7f13e4008040).stop 2021-11-03T18:16:04.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.008+0000 7f13f9e9c700 1 -- 172.21.15.26:0/3130586678 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13f40f49a0 msgr2=0x7f13f4106fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:16:04.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.008+0000 7f13f9e9c700 1 --2- 172.21.15.26:0/3130586678 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13f40f49a0 0x7f13f4106fc0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 rx=0x7f13dc004f60 tx=0x7f13dc009b30).stop 2021-11-03T18:16:04.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.008+0000 7f13f9e9c700 1 -- 172.21.15.26:0/3130586678 shutdown_connections 2021-11-03T18:16:04.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.008+0000 7f13f9e9c700 1 --2- 172.21.15.26:0/3130586678 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f13e00640b0 0x7f13e0066570 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:04.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.008+0000 7f13f9e9c700 1 --2- 172.21.15.26:0/3130586678 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13f40f49a0 0x7f13f4106fc0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:04.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.008+0000 7f13f9e9c700 1 --2- 172.21.15.26:0/3130586678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13f40f5340 0x7f13f41074b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:04.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.008+0000 7f13f9e9c700 1 -- 172.21.15.26:0/3130586678 >> 172.21.15.26:0/3130586678 conn(0x7f13f40f04c0 msgr2=0x7f13f40fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:16:04.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.008+0000 7f13f9e9c700 1 -- 172.21.15.26:0/3130586678 shutdown_connections 2021-11-03T18:16:04.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.008+0000 7f13f9e9c700 1 -- 172.21.15.26:0/3130586678 wait complete. 2021-11-03T18:16:04.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.108+0000 7f20967a2700 1 -- 172.21.15.26:0/126451608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20900f5ef0 msgr2=0x7f20900f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:16:04.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.108+0000 7f20967a2700 1 --2- 172.21.15.26:0/126451608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20900f5ef0 0x7f20900f6920 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 rx=0x7f2078004660 tx=0x7f2078009b30).stop 2021-11-03T18:16:04.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.108+0000 7f20967a2700 1 -- 172.21.15.26:0/126451608 shutdown_connections 2021-11-03T18:16:04.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.108+0000 7f20967a2700 1 --2- 172.21.15.26:0/126451608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20900f5ef0 0x7f20900f6920 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:04.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.108+0000 7f20967a2700 1 --2- 172.21.15.26:0/126451608 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20900f55e0 0x7f20900f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:16:04.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.108+0000 7f20967a2700 1 -- 172.21.15.26:0/126451608 >> 172.21.15.26:0/126451608 conn(0x7f20900f0de0 msgr2=0x7f20900f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:16:04.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.108+0000 7f20967a2700 1 -- 172.21.15.26:0/126451608 shutdown_connections 2021-11-03T18:16:04.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.108+0000 7f20967a2700 1 -- 172.21.15.26:0/126451608 wait complete. 2021-11-03T18:16:04.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.109+0000 7f20967a2700 1 Processor -- start 2021-11-03T18:16:04.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.109+0000 7f20967a2700 1 -- start start 2021-11-03T18:16:04.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.109+0000 7f20967a2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20900f55e0 0x7f209010c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:16:04.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.109+0000 7f20967a2700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20900f5ef0 0x7f209010e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:16:04.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.109+0000 7f20967a2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20900603d0 con 0x7f20900f55e0 2021-11-03T18:16:04.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.109+0000 7f20967a2700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2090060510 con 0x7f20900f5ef0 2021-11-03T18:16:04.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.109+0000 7f208ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20900f55e0 0x7f209010c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:16:04.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.109+0000 7f208ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20900f55e0 0x7f209010c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59086/0 (socket says 172.21.15.26:59086) 2021-11-03T18:16:04.113 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.109+0000 7f208ffff700 1 -- 172.21.15.26:0/3732550093 learned_addr learned my addr 172.21.15.26:0/3732550093 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:16:04.113 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.109+0000 7f208f7fe700 1 --2- 172.21.15.26:0/3732550093 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20900f5ef0 0x7f209010e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:16:04.113 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.109+0000 7f208ffff700 1 -- 172.21.15.26:0/3732550093 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20900f5ef0 msgr2=0x7f209010e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:16:04.113 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.109+0000 7f208ffff700 1 --2- 172.21.15.26:0/3732550093 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20900f5ef0 0x7f209010e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:04.114 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.109+0000 7f208ffff700 1 -- 172.21.15.26:0/3732550093 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2078005040 con 0x7f20900f55e0 2021-11-03T18:16:04.114 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.109+0000 7f208f7fe700 1 --2- 172.21.15.26:0/3732550093 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20900f5ef0 0x7f209010e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:16:04.114 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.109+0000 7f208ffff700 1 --2- 172.21.15.26:0/3732550093 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20900f55e0 0x7f209010c0b0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7f208000b410 tx=0x7f2080006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:16:04.114 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.110+0000 7f208cff9700 1 -- 172.21.15.26:0/3732550093 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20800125f0 con 0x7f20900f55e0 2021-11-03T18:16:04.115 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.110+0000 7f20967a2700 1 -- 172.21.15.26:0/3732550093 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f209010eaa0 con 0x7f20900f55e0 2021-11-03T18:16:04.115 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.110+0000 7f208cff9700 1 -- 172.21.15.26:0/3732550093 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2080012c00 con 0x7f20900f55e0 2021-11-03T18:16:04.115 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.110+0000 7f208cff9700 1 -- 172.21.15.26:0/3732550093 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2080002ae0 con 0x7f20900f55e0 2021-11-03T18:16:04.115 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.110+0000 7f20967a2700 1 -- 172.21.15.26:0/3732550093 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f209010ef80 con 0x7f20900f55e0 2021-11-03T18:16:04.116 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.111+0000 7f20967a2700 1 -- 172.21.15.26:0/3732550093 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2090045ad0 con 0x7f20900f55e0 2021-11-03T18:16:04.117 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.111+0000 7f208cff9700 1 -- 172.21.15.26:0/3732550093 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f208000f030 con 0x7f20900f55e0 2021-11-03T18:16:04.117 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.112+0000 7f208cff9700 1 --2- 172.21.15.26:0/3732550093 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f207c0640b0 0x7f207c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:16:04.117 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.112+0000 7f208cff9700 1 -- 172.21.15.26:0/3732550093 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f2080080d20 con 0x7f20900f55e0 2021-11-03T18:16:04.118 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.112+0000 7f208f7fe700 1 --2- 172.21.15.26:0/3732550093 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f207c0640b0 0x7f207c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:16:04.118 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.112+0000 7f208f7fe700 1 --2- 172.21.15.26:0/3732550093 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f207c0640b0 0x7f207c066570 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7f2078009da0 tx=0x7f2078009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:16:04.118 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.116+0000 7f208cff9700 1 -- 172.21.15.26:0/3732550093 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f2080052fc0 con 0x7f20900f55e0 2021-11-03T18:16:04.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.319+0000 7f20967a2700 1 -- 172.21.15.26:0/3732550093 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f20900fdf50 con 0x7f20900f55e0 2021-11-03T18:16:04.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.319+0000 7f208cff9700 1 -- 172.21.15.26:0/3732550093 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f2080052bb0 con 0x7f20900f55e0 2021-11-03T18:16:04.318 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:16:04.319 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:16:04.319 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:16:04.319 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:16:04.319 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:16:04.320 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:16:04.320 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:16:04.320 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:16:04.320 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:16:04.321 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:16:04.321 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:16:04.321 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:16:04.321 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:16:04.322 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:16:04.322 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:16:04.322 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:16:04.322 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:16:04.323 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:16:04.323 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:16:04.323 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:16:04.323 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:16:04.324 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:16:04.324 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:16:04.324 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:16:04.324 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:16:04.324 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:16:04.325 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:16:04.325 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:16:04.325 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:16:04.325 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:16:04.326 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:16:04.326 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:16:04.326 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:16:04.326 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:16:04.326 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:16:04.327 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:16:04.327 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:16:04.327 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:16:04.327 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:16:04.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.321+0000 7f20967a2700 1 -- 172.21.15.26:0/3732550093 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f207c0640b0 msgr2=0x7f207c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:16:04.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.321+0000 7f20967a2700 1 --2- 172.21.15.26:0/3732550093 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f207c0640b0 0x7f207c066570 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7f2078009da0 tx=0x7f2078009b30).stop 2021-11-03T18:16:04.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.321+0000 7f20967a2700 1 -- 172.21.15.26:0/3732550093 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20900f55e0 msgr2=0x7f209010c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:16:04.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.321+0000 7f20967a2700 1 --2- 172.21.15.26:0/3732550093 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20900f55e0 0x7f209010c0b0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7f208000b410 tx=0x7f2080006ef0).stop 2021-11-03T18:16:04.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.321+0000 7f20967a2700 1 -- 172.21.15.26:0/3732550093 shutdown_connections 2021-11-03T18:16:04.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.321+0000 7f20967a2700 1 --2- 172.21.15.26:0/3732550093 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f207c0640b0 0x7f207c066570 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:04.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.321+0000 7f20967a2700 1 --2- 172.21.15.26:0/3732550093 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20900f55e0 0x7f209010c0b0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:04.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.321+0000 7f20967a2700 1 --2- 172.21.15.26:0/3732550093 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20900f5ef0 0x7f209010e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:04.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.321+0000 7f20967a2700 1 -- 172.21.15.26:0/3732550093 >> 172.21.15.26:0/3732550093 conn(0x7f20900f0de0 msgr2=0x7f20900fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:16:04.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.321+0000 7f20967a2700 1 -- 172.21.15.26:0/3732550093 shutdown_connections 2021-11-03T18:16:04.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:04.321+0000 7f20967a2700 1 -- 172.21.15.26:0/3732550093 wait complete. 2021-11-03T18:16:04.331 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:16:05.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:04 smithi026 ceph-mon[96795]: from='client.36652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:16:05.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:04 smithi026 ceph-mon[96795]: from='client.36656 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:16:05.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:04 smithi026 ceph-mon[96795]: pgmap v2442: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:05.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:04 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3130586678' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:16:05.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:04 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3732550093' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:16:05.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:04 smithi194 ceph-mon[65619]: from='client.36652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:16:05.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:04 smithi194 ceph-mon[65619]: from='client.36656 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:16:05.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:04 smithi194 ceph-mon[65619]: pgmap v2442: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:05.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:04 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3130586678' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:16:05.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:04 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3732550093' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:16:07.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:06 smithi026 ceph-mon[96795]: pgmap v2443: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:07.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:06 smithi194 ceph-mon[65619]: pgmap v2443: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:08.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:07 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:16:08.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:07 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:16:09.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:08 smithi194 ceph-mon[65619]: poll took 60084.747 ms: 1 events 2021-11-03T18:16:09.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:08 smithi194 ceph-mon[65619]: pgmap v2444: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:09.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:08 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:16:09.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:08 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:16:09.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:08 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:16:09.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:08 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:16:09.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:08 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:16:09.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:08 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:16:09.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:08 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:16:09.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:08 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:16:09.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:08 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:16:09.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:08 smithi026 ceph-mon[96795]: poll took 60084.747 ms: 1 events 2021-11-03T18:16:09.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:08 smithi026 ceph-mon[96795]: pgmap v2444: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:09.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:08 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:16:09.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:08 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:16:09.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:08 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:16:09.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:08 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:16:09.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:08 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:16:09.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:08 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:16:09.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:08 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:16:09.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:08 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:16:09.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:08 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:16:11.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:10 smithi194 ceph-mon[65619]: pgmap v2445: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:11.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:10 smithi026 ceph-mon[96795]: pgmap v2445: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:13.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:12 smithi194 ceph-mon[65619]: pgmap v2446: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:13.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:12 smithi026 ceph-mon[96795]: pgmap v2446: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:15.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:14 smithi194 ceph-mon[65619]: pgmap v2447: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:15.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:14 smithi026 ceph-mon[96795]: pgmap v2447: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:17.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:16 smithi194 ceph-mon[65619]: pgmap v2448: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:17.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:16 smithi026 ceph-mon[96795]: pgmap v2448: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:19.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:18 smithi194 ceph-mon[65619]: pgmap v2449: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:19.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:18 smithi026 ceph-mon[96795]: pgmap v2449: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:21.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:20 smithi194 ceph-mon[65619]: pgmap v2450: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:21.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:20 smithi026 ceph-mon[96795]: pgmap v2450: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:23.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:22 smithi194 ceph-mon[65619]: pgmap v2451: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:23.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:22 smithi026 ceph-mon[96795]: pgmap v2451: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:24.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:23 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:16:24.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:23 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:16:24.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:23 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:16:24.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:23 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:16:25.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:24 smithi194 ceph-mon[65619]: pgmap v2452: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:25.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:24 smithi026 ceph-mon[96795]: pgmap v2452: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:27.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:26 smithi194 ceph-mon[65619]: pgmap v2453: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:27.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:26 smithi026 ceph-mon[96795]: pgmap v2453: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:29.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:28 smithi194 ceph-mon[65619]: pgmap v2454: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:29.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:28 smithi026 ceph-mon[96795]: pgmap v2454: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:31.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:30 smithi194 ceph-mon[65619]: pgmap v2455: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:31.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:30 smithi026 ceph-mon[96795]: pgmap v2455: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:33.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:32 smithi194 ceph-mon[65619]: pgmap v2456: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:33.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:32 smithi026 ceph-mon[96795]: pgmap v2456: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:34.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.436+0000 7ff0a77de700 1 -- 172.21.15.26:0/1696607694 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0a00f55c0 msgr2=0x7ff0a00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:16:34.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.436+0000 7ff0a77de700 1 --2- 172.21.15.26:0/1696607694 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0a00f55c0 0x7ff0a00f59e0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7ff0980099e0 tx=0x7ff098004d10).stop 2021-11-03T18:16:34.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.436+0000 7ff0a77de700 1 -- 172.21.15.26:0/1696607694 shutdown_connections 2021-11-03T18:16:34.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.436+0000 7ff0a77de700 1 --2- 172.21.15.26:0/1696607694 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0a00f5ed0 0x7ff0a00f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:34.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.436+0000 7ff0a77de700 1 --2- 172.21.15.26:0/1696607694 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0a00f55c0 0x7ff0a00f59e0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:34.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.436+0000 7ff0a77de700 1 -- 172.21.15.26:0/1696607694 >> 172.21.15.26:0/1696607694 conn(0x7ff0a00f0de0 msgr2=0x7ff0a00f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:16:34.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.436+0000 7ff0a77de700 1 -- 172.21.15.26:0/1696607694 shutdown_connections 2021-11-03T18:16:34.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.436+0000 7ff0a77de700 1 -- 172.21.15.26:0/1696607694 wait complete. 2021-11-03T18:16:34.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.437+0000 7ff0a77de700 1 Processor -- start 2021-11-03T18:16:34.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.437+0000 7ff0a77de700 1 -- start start 2021-11-03T18:16:34.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.437+0000 7ff0a77de700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0a00f55c0 0x7ff0a00f9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:16:34.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.437+0000 7ff0a77de700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0a00f5ed0 0x7ff0a00f8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:16:34.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.437+0000 7ff0a77de700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a00f89c0 con 0x7ff0a00f5ed0 2021-11-03T18:16:34.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.437+0000 7ff0a77de700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a00f8b00 con 0x7ff0a00f55c0 2021-11-03T18:16:34.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.437+0000 7ff0a4d79700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0a00f5ed0 0x7ff0a00f8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:16:34.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.437+0000 7ff0a4d79700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0a00f5ed0 0x7ff0a00f8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59104/0 (socket says 172.21.15.26:59104) 2021-11-03T18:16:34.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.437+0000 7ff0a4d79700 1 -- 172.21.15.26:0/1470957219 learned_addr learned my addr 172.21.15.26:0/1470957219 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:16:34.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.437+0000 7ff0a557a700 1 --2- 172.21.15.26:0/1470957219 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0a00f55c0 0x7ff0a00f9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:16:34.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.438+0000 7ff0a4d79700 1 -- 172.21.15.26:0/1470957219 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0a00f55c0 msgr2=0x7ff0a00f9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:16:34.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.438+0000 7ff0a4d79700 1 --2- 172.21.15.26:0/1470957219 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0a00f55c0 0x7ff0a00f9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:34.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.438+0000 7ff0a4d79700 1 -- 172.21.15.26:0/1470957219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff098009640 con 0x7ff0a00f5ed0 2021-11-03T18:16:34.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.438+0000 7ff0a4d79700 1 --2- 172.21.15.26:0/1470957219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0a00f5ed0 0x7ff0a00f8460 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7ff0940026d0 tx=0x7ff094009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:16:34.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.438+0000 7ff09dffb700 1 -- 172.21.15.26:0/1470957219 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0940079c0 con 0x7ff0a00f5ed0 2021-11-03T18:16:34.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.438+0000 7ff0a77de700 1 -- 172.21.15.26:0/1470957219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0a00f8de0 con 0x7ff0a00f5ed0 2021-11-03T18:16:34.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.438+0000 7ff09dffb700 1 -- 172.21.15.26:0/1470957219 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff09400f040 con 0x7ff0a00f5ed0 2021-11-03T18:16:34.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.438+0000 7ff09dffb700 1 -- 172.21.15.26:0/1470957219 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0940148b0 con 0x7ff0a00f5ed0 2021-11-03T18:16:34.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.438+0000 7ff0a77de700 1 -- 172.21.15.26:0/1470957219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0a010f0a0 con 0x7ff0a00f5ed0 2021-11-03T18:16:34.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.439+0000 7ff0a77de700 1 -- 172.21.15.26:0/1470957219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0a0045ad0 con 0x7ff0a00f5ed0 2021-11-03T18:16:34.444 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.440+0000 7ff09dffb700 1 -- 172.21.15.26:0/1470957219 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ff094007b20 con 0x7ff0a00f5ed0 2021-11-03T18:16:34.444 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.440+0000 7ff09dffb700 1 --2- 172.21.15.26:0/1470957219 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff0880640b0 0x7ff088066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:16:34.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.440+0000 7ff09dffb700 1 -- 172.21.15.26:0/1470957219 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ff094080740 con 0x7ff0a00f5ed0 2021-11-03T18:16:34.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.440+0000 7ff0a557a700 1 --2- 172.21.15.26:0/1470957219 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff0880640b0 0x7ff088066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:16:34.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.441+0000 7ff0a557a700 1 --2- 172.21.15.26:0/1470957219 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff0880640b0 0x7ff088066570 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7ff09800b730 tx=0x7ff098004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:16:34.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.444+0000 7ff09dffb700 1 -- 172.21.15.26:0/1470957219 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ff094052aa0 con 0x7ff0a00f5ed0 2021-11-03T18:16:34.623 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.625+0000 7ff0a77de700 1 -- 172.21.15.26:0/1470957219 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0a005fe90 con 0x7ff0880640b0 2021-11-03T18:16:34.623 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.626+0000 7ff09dffb700 1 -- 172.21.15.26:0/1470957219 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7ff0a005fe90 con 0x7ff0880640b0 2021-11-03T18:16:34.626 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.628+0000 7ff0a77de700 1 -- 172.21.15.26:0/1470957219 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff0880640b0 msgr2=0x7ff088066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:16:34.626 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.628+0000 7ff0a77de700 1 --2- 172.21.15.26:0/1470957219 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff0880640b0 0x7ff088066570 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7ff09800b730 tx=0x7ff098004d10).stop 2021-11-03T18:16:34.626 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.628+0000 7ff0a77de700 1 -- 172.21.15.26:0/1470957219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0a00f5ed0 msgr2=0x7ff0a00f8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:16:34.626 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.628+0000 7ff0a77de700 1 --2- 172.21.15.26:0/1470957219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0a00f5ed0 0x7ff0a00f8460 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7ff0940026d0 tx=0x7ff094009de0).stop 2021-11-03T18:16:34.627 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.628+0000 7ff0a77de700 1 -- 172.21.15.26:0/1470957219 shutdown_connections 2021-11-03T18:16:34.627 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.628+0000 7ff0a77de700 1 --2- 172.21.15.26:0/1470957219 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff0880640b0 0x7ff088066570 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:34.627 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.628+0000 7ff0a77de700 1 --2- 172.21.15.26:0/1470957219 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0a00f55c0 0x7ff0a00f9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:34.627 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.628+0000 7ff0a77de700 1 --2- 172.21.15.26:0/1470957219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0a00f5ed0 0x7ff0a00f8460 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:34.627 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.628+0000 7ff0a77de700 1 -- 172.21.15.26:0/1470957219 >> 172.21.15.26:0/1470957219 conn(0x7ff0a00f0de0 msgr2=0x7ff0a005f780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:16:34.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.628+0000 7ff0a77de700 1 -- 172.21.15.26:0/1470957219 shutdown_connections 2021-11-03T18:16:34.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.628+0000 7ff0a77de700 1 -- 172.21.15.26:0/1470957219 wait complete. 2021-11-03T18:16:34.635 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:16:34.728 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.729+0000 7f536e95a700 1 -- 172.21.15.26:0/648617791 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53680f77d0 msgr2=0x7f53680f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:16:34.728 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.729+0000 7f536e95a700 1 --2- 172.21.15.26:0/648617791 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53680f77d0 0x7f53680f7c30 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 rx=0x7f535c004660 tx=0x7f535c009b30).stop 2021-11-03T18:16:34.729 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.729+0000 7f536e95a700 1 -- 172.21.15.26:0/648617791 shutdown_connections 2021-11-03T18:16:34.729 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.729+0000 7f536e95a700 1 --2- 172.21.15.26:0/648617791 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53680f77d0 0x7f53680f7c30 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:34.729 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.729+0000 7f536e95a700 1 --2- 172.21.15.26:0/648617791 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53680f6530 0x7f53680f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:34.729 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.729+0000 7f536e95a700 1 -- 172.21.15.26:0/648617791 >> 172.21.15.26:0/648617791 conn(0x7f53680f1cd0 msgr2=0x7f53680f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:16:34.730 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.729+0000 7f536e95a700 1 -- 172.21.15.26:0/648617791 shutdown_connections 2021-11-03T18:16:34.730 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.729+0000 7f536e95a700 1 -- 172.21.15.26:0/648617791 wait complete. 2021-11-03T18:16:34.730 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.729+0000 7f536e95a700 1 Processor -- start 2021-11-03T18:16:34.730 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.729+0000 7f536e95a700 1 -- start start 2021-11-03T18:16:34.731 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.729+0000 7f536e95a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53680f6530 0x7f536806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:16:34.731 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.729+0000 7f536e95a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53680f77d0 0x7f5368069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:16:34.731 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.729+0000 7f536e95a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536806a380 con 0x7f53680f6530 2021-11-03T18:16:34.731 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.729+0000 7f536e95a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536806a4c0 con 0x7f53680f77d0 2021-11-03T18:16:34.732 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.730+0000 7f536d958700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53680f6530 0x7f536806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:16:34.732 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.730+0000 7f536d958700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53680f6530 0x7f536806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59112/0 (socket says 172.21.15.26:59112) 2021-11-03T18:16:34.733 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.730+0000 7f536d958700 1 -- 172.21.15.26:0/894112965 learned_addr learned my addr 172.21.15.26:0/894112965 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:16:34.733 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.730+0000 7f536d157700 1 --2- 172.21.15.26:0/894112965 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53680f77d0 0x7f5368069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:16:34.733 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.730+0000 7f536d958700 1 -- 172.21.15.26:0/894112965 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53680f77d0 msgr2=0x7f5368069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:16:34.733 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.730+0000 7f536d958700 1 --2- 172.21.15.26:0/894112965 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53680f77d0 0x7f5368069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:34.734 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.730+0000 7f536d958700 1 -- 172.21.15.26:0/894112965 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f535c005040 con 0x7f53680f6530 2021-11-03T18:16:34.734 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.730+0000 7f536d157700 1 --2- 172.21.15.26:0/894112965 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53680f77d0 0x7f5368069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:16:34.734 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.730+0000 7f536d958700 1 --2- 172.21.15.26:0/894112965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53680f6530 0x7f536806b9a0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7f536000e7c0 tx=0x7f536000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:16:34.734 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.730+0000 7f53667fc700 1 -- 172.21.15.26:0/894112965 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53600092e0 con 0x7f53680f6530 2021-11-03T18:16:34.735 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.730+0000 7f53667fc700 1 -- 172.21.15.26:0/894112965 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f536000f040 con 0x7f53680f6530 2021-11-03T18:16:34.735 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.730+0000 7f536e95a700 1 -- 172.21.15.26:0/894112965 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f536806a7a0 con 0x7f53680f6530 2021-11-03T18:16:34.735 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.730+0000 7f53667fc700 1 -- 172.21.15.26:0/894112965 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5360014750 con 0x7f53680f6530 2021-11-03T18:16:34.735 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.730+0000 7f536e95a700 1 -- 172.21.15.26:0/894112965 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f536810ecb0 con 0x7f53680f6530 2021-11-03T18:16:34.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.731+0000 7f536e95a700 1 -- 172.21.15.26:0/894112965 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5368045ad0 con 0x7f53680f6530 2021-11-03T18:16:34.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.732+0000 7f53667fc700 1 -- 172.21.15.26:0/894112965 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f536001b030 con 0x7f53680f6530 2021-11-03T18:16:34.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.732+0000 7f53667fc700 1 --2- 172.21.15.26:0/894112965 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5350064100 0x7f53500665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:16:34.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.732+0000 7f53667fc700 1 -- 172.21.15.26:0/894112965 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f53600808c0 con 0x7f53680f6530 2021-11-03T18:16:34.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.732+0000 7f536d157700 1 --2- 172.21.15.26:0/894112965 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5350064100 0x7f53500665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:16:34.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.733+0000 7f536d157700 1 --2- 172.21.15.26:0/894112965 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5350064100 0x7f53500665c0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f535c005010 tx=0x7f535c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:16:34.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.736+0000 7f53667fc700 1 -- 172.21.15.26:0/894112965 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f5360052ad0 con 0x7f53680f6530 2021-11-03T18:16:34.907 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.909+0000 7f536e95a700 1 -- 172.21.15.26:0/894112965 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f53680fee60 con 0x7f5350064100 2021-11-03T18:16:34.922 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.924+0000 7f53667fc700 1 -- 172.21.15.26:0/894112965 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f53680fee60 con 0x7f5350064100 2021-11-03T18:16:34.922 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:16:34.922 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (87m) 6m ago 89m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:16:34.923 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (80m) 6m ago 89m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:16:34.923 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (79m) 5m ago 88m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:16:34.923 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (87m) 6m ago 88m 42.0M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:16:34.923 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (80m) 6m ago 84m 25.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:16:34.924 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (81m) 6m ago 84m 26.4M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:16:34.924 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (84m) 5m ago 84m 26.6M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:16:34.924 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (84m) 5m ago 84m 27.0M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:16:34.924 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (81m) 6m ago 90m 574M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:16:34.925 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (81m) 5m ago 88m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:16:34.925 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (80m) 6m ago 90m 308M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:16:34.925 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (80m) 5m ago 88m 145M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:16:34.925 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (88m) 6m ago 88m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:16:34.926 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (88m) 5m ago 88m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:16:34.926 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (79m) 6m ago 87m 312M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:16:34.926 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (79m) 6m ago 87m 335M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:16:34.926 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (78m) 6m ago 86m 279M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:16:34.927 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (78m) 5m ago 86m 362M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:16:34.927 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (77m) 5m ago 86m 302M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:16:34.927 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (77m) 5m ago 85m 296M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:16:34.927 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (87m) 6m ago 88m 63.4M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:16:34.929 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.925+0000 7f536e95a700 1 -- 172.21.15.26:0/894112965 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5350064100 msgr2=0x7f53500665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:16:34.929 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.925+0000 7f536e95a700 1 --2- 172.21.15.26:0/894112965 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5350064100 0x7f53500665c0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f535c005010 tx=0x7f535c00b040).stop 2021-11-03T18:16:34.929 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.925+0000 7f536e95a700 1 -- 172.21.15.26:0/894112965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53680f6530 msgr2=0x7f536806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:16:34.930 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.925+0000 7f536e95a700 1 --2- 172.21.15.26:0/894112965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53680f6530 0x7f536806b9a0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7f536000e7c0 tx=0x7f536000b040).stop 2021-11-03T18:16:34.930 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.926+0000 7f536e95a700 1 -- 172.21.15.26:0/894112965 shutdown_connections 2021-11-03T18:16:34.931 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.926+0000 7f536e95a700 1 --2- 172.21.15.26:0/894112965 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5350064100 0x7f53500665c0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:34.931 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.926+0000 7f536e95a700 1 --2- 172.21.15.26:0/894112965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53680f6530 0x7f536806b9a0 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:34.932 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.926+0000 7f536e95a700 1 --2- 172.21.15.26:0/894112965 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53680f77d0 0x7f5368069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:34.932 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.926+0000 7f536e95a700 1 -- 172.21.15.26:0/894112965 >> 172.21.15.26:0/894112965 conn(0x7f53680f1cd0 msgr2=0x7f53680fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:16:34.932 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.926+0000 7f536e95a700 1 -- 172.21.15.26:0/894112965 shutdown_connections 2021-11-03T18:16:34.933 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:34.926+0000 7f536e95a700 1 -- 172.21.15.26:0/894112965 wait complete. 2021-11-03T18:16:35.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.026+0000 7f0f7b59e700 1 -- 172.21.15.26:0/3616556477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f7c0f73b0 msgr2=0x7f0f7c0f4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:16:35.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.026+0000 7f0f7b59e700 1 --2- 172.21.15.26:0/3616556477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f7c0f73b0 0x7f0f7c0f4640 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7f0f70004660 tx=0x7f0f70009b30).stop 2021-11-03T18:16:35.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.026+0000 7f0f7b59e700 1 -- 172.21.15.26:0/3616556477 shutdown_connections 2021-11-03T18:16:35.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.026+0000 7f0f7b59e700 1 --2- 172.21.15.26:0/3616556477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f7c0f73b0 0x7f0f7c0f4640 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:35.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.026+0000 7f0f7b59e700 1 --2- 172.21.15.26:0/3616556477 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f7c0f6a10 0x7f0f7c0f6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:35.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.026+0000 7f0f7b59e700 1 -- 172.21.15.26:0/3616556477 >> 172.21.15.26:0/3616556477 conn(0x7f0f7c0f0320 msgr2=0x7f0f7c0f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:16:35.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.026+0000 7f0f7b59e700 1 -- 172.21.15.26:0/3616556477 shutdown_connections 2021-11-03T18:16:35.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.026+0000 7f0f7b59e700 1 -- 172.21.15.26:0/3616556477 wait complete. 2021-11-03T18:16:35.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.026+0000 7f0f7b59e700 1 Processor -- start 2021-11-03T18:16:35.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.026+0000 7f0f7b59e700 1 -- start start 2021-11-03T18:16:35.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.026+0000 7f0f7b59e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f7c0f6a10 0x7f0f7c108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:16:35.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.026+0000 7f0f7b59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f7c0f73b0 0x7f0f7c1093c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:16:35.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.026+0000 7f0f7b59e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c109970 con 0x7f0f7c0f73b0 2021-11-03T18:16:35.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.026+0000 7f0f7b59e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c109ab0 con 0x7f0f7c0f6a10 2021-11-03T18:16:35.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.026+0000 7f0f79d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f7c0f73b0 0x7f0f7c1093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:16:35.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.027+0000 7f0f79d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f7c0f73b0 0x7f0f7c1093c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59124/0 (socket says 172.21.15.26:59124) 2021-11-03T18:16:35.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.027+0000 7f0f79d9b700 1 -- 172.21.15.26:0/3759990512 learned_addr learned my addr 172.21.15.26:0/3759990512 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:16:35.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.027+0000 7f0f7a59c700 1 --2- 172.21.15.26:0/3759990512 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f7c0f6a10 0x7f0f7c108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:16:35.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.027+0000 7f0f79d9b700 1 -- 172.21.15.26:0/3759990512 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f7c0f6a10 msgr2=0x7f0f7c108ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:16:35.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.027+0000 7f0f79d9b700 1 --2- 172.21.15.26:0/3759990512 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f7c0f6a10 0x7f0f7c108ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:35.030 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.027+0000 7f0f79d9b700 1 -- 172.21.15.26:0/3759990512 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f70005040 con 0x7f0f7c0f73b0 2021-11-03T18:16:35.030 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.027+0000 7f0f79d9b700 1 --2- 172.21.15.26:0/3759990512 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f7c0f73b0 0x7f0f7c1093c0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7f0f70009830 tx=0x7f0f70009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:16:35.030 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.027+0000 7f0f6affd700 1 -- 172.21.15.26:0/3759990512 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f70018070 con 0x7f0f7c0f73b0 2021-11-03T18:16:35.030 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.027+0000 7f0f7b59e700 1 -- 172.21.15.26:0/3759990512 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f7c10a3f0 con 0x7f0f7c0f73b0 2021-11-03T18:16:35.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.027+0000 7f0f6affd700 1 -- 172.21.15.26:0/3759990512 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0f70007ba0 con 0x7f0f7c0f73b0 2021-11-03T18:16:35.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.027+0000 7f0f6affd700 1 -- 172.21.15.26:0/3759990512 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f7001c3c0 con 0x7f0f7c0f73b0 2021-11-03T18:16:35.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.027+0000 7f0f7b59e700 1 -- 172.21.15.26:0/3759990512 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f7c10a950 con 0x7f0f7c0f73b0 2021-11-03T18:16:35.032 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.028+0000 7f0f7b59e700 1 -- 172.21.15.26:0/3759990512 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f7c045ad0 con 0x7f0f7c0f73b0 2021-11-03T18:16:35.033 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.029+0000 7f0f6affd700 1 -- 172.21.15.26:0/3759990512 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f0f70007d10 con 0x7f0f7c0f73b0 2021-11-03T18:16:35.033 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.029+0000 7f0f6affd700 1 --2- 172.21.15.26:0/3759990512 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0f64064100 0x7f0f640665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:16:35.033 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.029+0000 7f0f6affd700 1 -- 172.21.15.26:0/3759990512 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f0f700823a0 con 0x7f0f7c0f73b0 2021-11-03T18:16:35.033 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.029+0000 7f0f7a59c700 1 --2- 172.21.15.26:0/3759990512 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0f64064100 0x7f0f640665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:16:35.034 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.029+0000 7f0f7a59c700 1 --2- 172.21.15.26:0/3759990512 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0f64064100 0x7f0f640665c0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7f0f6c004c40 tx=0x7f0f6c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:16:35.034 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.033+0000 7f0f6affd700 1 -- 172.21.15.26:0/3759990512 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f0f70054700 con 0x7f0f7c0f73b0 2021-11-03T18:16:35.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:34 smithi194 ceph-mon[65619]: pgmap v2457: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:35.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.262+0000 7f0f7b59e700 1 -- 172.21.15.26:0/3759990512 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0f7c027a00 con 0x7f0f7c0f73b0 2021-11-03T18:16:35.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.262+0000 7f0f6affd700 1 -- 172.21.15.26:0/3759990512 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f0f700542f0 con 0x7f0f7c0f73b0 2021-11-03T18:16:35.260 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:16:35.261 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:16:35.261 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:16:35.261 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:16:35.261 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:16:35.262 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:16:35.262 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:16:35.262 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:16:35.262 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:16:35.263 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:16:35.263 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:16:35.263 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:16:35.263 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:16:35.263 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:16:35.264 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:16:35.264 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:16:35.264 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:16:35.264 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:16:35.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.264+0000 7f0f7b59e700 1 -- 172.21.15.26:0/3759990512 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0f64064100 msgr2=0x7f0f640665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:16:35.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.264+0000 7f0f7b59e700 1 --2- 172.21.15.26:0/3759990512 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0f64064100 0x7f0f640665c0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7f0f6c004c40 tx=0x7f0f6c00b040).stop 2021-11-03T18:16:35.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.264+0000 7f0f7b59e700 1 -- 172.21.15.26:0/3759990512 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f7c0f73b0 msgr2=0x7f0f7c1093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:16:35.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.264+0000 7f0f7b59e700 1 --2- 172.21.15.26:0/3759990512 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f7c0f73b0 0x7f0f7c1093c0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7f0f70009830 tx=0x7f0f70009b30).stop 2021-11-03T18:16:35.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.264+0000 7f0f7b59e700 1 -- 172.21.15.26:0/3759990512 shutdown_connections 2021-11-03T18:16:35.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.264+0000 7f0f7b59e700 1 --2- 172.21.15.26:0/3759990512 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0f64064100 0x7f0f640665c0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:35.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.264+0000 7f0f7b59e700 1 --2- 172.21.15.26:0/3759990512 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f7c0f6a10 0x7f0f7c108ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:35.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.264+0000 7f0f7b59e700 1 --2- 172.21.15.26:0/3759990512 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f7c0f73b0 0x7f0f7c1093c0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:35.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.264+0000 7f0f7b59e700 1 -- 172.21.15.26:0/3759990512 >> 172.21.15.26:0/3759990512 conn(0x7f0f7c0f0320 msgr2=0x7f0f7c0fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:16:35.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.264+0000 7f0f7b59e700 1 -- 172.21.15.26:0/3759990512 shutdown_connections 2021-11-03T18:16:35.268 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.264+0000 7f0f7b59e700 1 -- 172.21.15.26:0/3759990512 wait complete. 2021-11-03T18:16:35.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.365+0000 7f5c91e76700 1 -- 172.21.15.26:0/1877059823 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c8c0f55c0 msgr2=0x7f5c8c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:16:35.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.365+0000 7f5c91e76700 1 --2- 172.21.15.26:0/1877059823 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c8c0f55c0 0x7f5c8c0f59e0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 rx=0x7f5c7c004660 tx=0x7f5c7c009b30).stop 2021-11-03T18:16:35.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.365+0000 7f5c91e76700 1 -- 172.21.15.26:0/1877059823 shutdown_connections 2021-11-03T18:16:35.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.365+0000 7f5c91e76700 1 --2- 172.21.15.26:0/1877059823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c8c0f5ed0 0x7f5c8c0f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:35.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.365+0000 7f5c91e76700 1 --2- 172.21.15.26:0/1877059823 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c8c0f55c0 0x7f5c8c0f59e0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:35.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.365+0000 7f5c91e76700 1 -- 172.21.15.26:0/1877059823 >> 172.21.15.26:0/1877059823 conn(0x7f5c8c0f0dc0 msgr2=0x7f5c8c0f31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:16:35.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.365+0000 7f5c91e76700 1 -- 172.21.15.26:0/1877059823 shutdown_connections 2021-11-03T18:16:35.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.365+0000 7f5c91e76700 1 -- 172.21.15.26:0/1877059823 wait complete. 2021-11-03T18:16:35.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.365+0000 7f5c91e76700 1 Processor -- start 2021-11-03T18:16:35.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.365+0000 7f5c91e76700 1 -- start start 2021-11-03T18:16:35.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.366+0000 7f5c91e76700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c8c0f55c0 0x7f5c8c109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:16:35.367 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.366+0000 7f5c91e76700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c8c0f5ed0 0x7f5c8c10c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:16:35.367 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.366+0000 7f5c91e76700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8c060560 con 0x7f5c8c0f5ed0 2021-11-03T18:16:35.367 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.366+0000 7f5c91e76700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8c0606a0 con 0x7f5c8c0f55c0 2021-11-03T18:16:35.367 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.366+0000 7f5c8affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c8c0f5ed0 0x7f5c8c10c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:16:35.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.366+0000 7f5c8affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c8c0f5ed0 0x7f5c8c10c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59134/0 (socket says 172.21.15.26:59134) 2021-11-03T18:16:35.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.366+0000 7f5c8affd700 1 -- 172.21.15.26:0/1104660986 learned_addr learned my addr 172.21.15.26:0/1104660986 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:16:35.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.366+0000 7f5c8b7fe700 1 --2- 172.21.15.26:0/1104660986 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c8c0f55c0 0x7f5c8c109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:16:35.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.366+0000 7f5c8affd700 1 -- 172.21.15.26:0/1104660986 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c8c0f55c0 msgr2=0x7f5c8c109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:16:35.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.366+0000 7f5c8affd700 1 --2- 172.21.15.26:0/1104660986 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c8c0f55c0 0x7f5c8c109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:35.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.366+0000 7f5c8affd700 1 -- 172.21.15.26:0/1104660986 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c7c005040 con 0x7f5c8c0f5ed0 2021-11-03T18:16:35.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.366+0000 7f5c8b7fe700 1 --2- 172.21.15.26:0/1104660986 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c8c0f55c0 0x7f5c8c109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:16:35.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.366+0000 7f5c8affd700 1 --2- 172.21.15.26:0/1104660986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c8c0f5ed0 0x7f5c8c10c170 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 rx=0x7f5c800026d0 tx=0x7f5c80009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:16:35.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.366+0000 7f5c73fff700 1 -- 172.21.15.26:0/1104660986 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c80009320 con 0x7f5c8c0f5ed0 2021-11-03T18:16:35.370 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.366+0000 7f5c91e76700 1 -- 172.21.15.26:0/1104660986 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c8c10c720 con 0x7f5c8c0f5ed0 2021-11-03T18:16:35.370 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.366+0000 7f5c73fff700 1 -- 172.21.15.26:0/1104660986 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5c8000f040 con 0x7f5c8c0f5ed0 2021-11-03T18:16:35.370 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.366+0000 7f5c73fff700 1 -- 172.21.15.26:0/1104660986 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c800147e0 con 0x7f5c8c0f5ed0 2021-11-03T18:16:35.370 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.366+0000 7f5c91e76700 1 -- 172.21.15.26:0/1104660986 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c8c10cce0 con 0x7f5c8c0f5ed0 2021-11-03T18:16:35.371 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.367+0000 7f5c91e76700 1 -- 172.21.15.26:0/1104660986 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c8c045ad0 con 0x7f5c8c0f5ed0 2021-11-03T18:16:35.372 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.368+0000 7f5c73fff700 1 -- 172.21.15.26:0/1104660986 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f5c80009480 con 0x7f5c8c0f5ed0 2021-11-03T18:16:35.372 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.368+0000 7f5c73fff700 1 --2- 172.21.15.26:0/1104660986 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5c740640b0 0x7f5c74066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:16:35.372 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.368+0000 7f5c73fff700 1 -- 172.21.15.26:0/1104660986 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f5c80080f70 con 0x7f5c8c0f5ed0 2021-11-03T18:16:35.372 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.368+0000 7f5c8b7fe700 1 --2- 172.21.15.26:0/1104660986 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5c740640b0 0x7f5c74066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:16:35.373 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.369+0000 7f5c8b7fe700 1 --2- 172.21.15.26:0/1104660986 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5c740640b0 0x7f5c74066570 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f5c7c005010 tx=0x7f5c7c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:16:35.373 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.372+0000 7f5c73fff700 1 -- 172.21.15.26:0/1104660986 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f5c80053210 con 0x7f5c8c0f5ed0 2021-11-03T18:16:35.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:34 smithi026 ceph-mon[96795]: pgmap v2457: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:35.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.582+0000 7f5c91e76700 1 -- 172.21.15.26:0/1104660986 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5c8c027a00 con 0x7f5c8c0f5ed0 2021-11-03T18:16:35.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.582+0000 7f5c73fff700 1 -- 172.21.15.26:0/1104660986 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f5c80052e00 con 0x7f5c8c0f5ed0 2021-11-03T18:16:35.582 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:16:35.582 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:16:35.583 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:16:35.583 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:16:35.584 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:16:35.584 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:16:35.585 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:16:35.585 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:16:35.585 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:16:35.586 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:16:35.586 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:16:35.587 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:16:35.587 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:16:35.588 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:16:35.588 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:16:35.588 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:16:35.589 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:16:35.589 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:16:35.589 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:16:35.590 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:16:35.590 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:16:35.590 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:16:35.590 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:16:35.591 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:16:35.591 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:16:35.591 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:16:35.591 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:16:35.592 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:16:35.592 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:16:35.592 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:16:35.592 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:16:35.593 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:16:35.593 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:16:35.593 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:16:35.593 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:16:35.593 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:16:35.594 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:16:35.594 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:16:35.594 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:16:35.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.584+0000 7f5c91e76700 1 -- 172.21.15.26:0/1104660986 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5c740640b0 msgr2=0x7f5c74066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:16:35.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.584+0000 7f5c91e76700 1 --2- 172.21.15.26:0/1104660986 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5c740640b0 0x7f5c74066570 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f5c7c005010 tx=0x7f5c7c009b30).stop 2021-11-03T18:16:35.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.584+0000 7f5c91e76700 1 -- 172.21.15.26:0/1104660986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c8c0f5ed0 msgr2=0x7f5c8c10c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:16:35.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.584+0000 7f5c91e76700 1 --2- 172.21.15.26:0/1104660986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c8c0f5ed0 0x7f5c8c10c170 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 rx=0x7f5c800026d0 tx=0x7f5c80009de0).stop 2021-11-03T18:16:35.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.584+0000 7f5c91e76700 1 -- 172.21.15.26:0/1104660986 shutdown_connections 2021-11-03T18:16:35.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.584+0000 7f5c91e76700 1 --2- 172.21.15.26:0/1104660986 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5c740640b0 0x7f5c74066570 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:35.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.584+0000 7f5c91e76700 1 --2- 172.21.15.26:0/1104660986 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c8c0f55c0 0x7f5c8c109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:35.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.584+0000 7f5c91e76700 1 --2- 172.21.15.26:0/1104660986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c8c0f5ed0 0x7f5c8c10c170 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:16:35.600 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.584+0000 7f5c91e76700 1 -- 172.21.15.26:0/1104660986 >> 172.21.15.26:0/1104660986 conn(0x7f5c8c0f0dc0 msgr2=0x7f5c8c0fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:16:35.600 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.584+0000 7f5c91e76700 1 -- 172.21.15.26:0/1104660986 shutdown_connections 2021-11-03T18:16:35.601 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:16:35.584+0000 7f5c91e76700 1 -- 172.21.15.26:0/1104660986 wait complete. 2021-11-03T18:16:35.601 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:16:36.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:35 smithi194 ceph-mon[65619]: from='client.36668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:16:36.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:35 smithi194 ceph-mon[65619]: from='client.36672 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:16:36.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:35 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3759990512' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:16:36.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:35 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1104660986' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:16:36.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:35 smithi026 ceph-mon[96795]: from='client.36668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:16:36.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:35 smithi026 ceph-mon[96795]: from='client.36672 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:16:36.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:35 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3759990512' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:16:36.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:35 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1104660986' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:16:37.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:36 smithi194 ceph-mon[65619]: pgmap v2458: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:37.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:36 smithi026 ceph-mon[96795]: pgmap v2458: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:38.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:37 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:16:38.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:37 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:16:39.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:38 smithi194 ceph-mon[65619]: pgmap v2459: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:39.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:38 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:16:39.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:38 smithi026 ceph-mon[96795]: pgmap v2459: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:39.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:38 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:16:41.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:40 smithi194 ceph-mon[65619]: pgmap v2460: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:41.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:40 smithi026 ceph-mon[96795]: pgmap v2460: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:43.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:42 smithi194 ceph-mon[65619]: pgmap v2461: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:43.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:42 smithi026 ceph-mon[96795]: pgmap v2461: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:45.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:45 smithi194 ceph-mon[65619]: pgmap v2462: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:45.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:44 smithi026 ceph-mon[96795]: pgmap v2462: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:47.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:47 smithi194 ceph-mon[65619]: pgmap v2463: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:47.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:47 smithi026 ceph-mon[96795]: pgmap v2463: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:49.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:49 smithi026 ceph-mon[96795]: pgmap v2464: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:16:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:16:49.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:49 smithi194 ceph-mon[65619]: pgmap v2464: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:49.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:16:49.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:16:51.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:51 smithi026 ceph-mon[96795]: pgmap v2465: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:51.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:51 smithi194 ceph-mon[65619]: pgmap v2465: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:53.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:53 smithi026 ceph-mon[96795]: pgmap v2466: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:53.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:53 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:16:53.473 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:53 smithi194 ceph-mon[65619]: pgmap v2466: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:53.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:53 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:16:54.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:54 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:16:54.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:54 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:16:55.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:55 smithi026 ceph-mon[96795]: pgmap v2467: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:55.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:55 smithi194 ceph-mon[65619]: pgmap v2467: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:57.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:57 smithi026 ceph-mon[96795]: pgmap v2468: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:57.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:57 smithi194 ceph-mon[65619]: pgmap v2468: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:59.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:16:59 smithi026 ceph-mon[96795]: pgmap v2469: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:16:59.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:16:59 smithi194 ceph-mon[65619]: pgmap v2469: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:01.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:01 smithi026 ceph-mon[96795]: pgmap v2470: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:01.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:01 smithi194 ceph-mon[65619]: pgmap v2470: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:03.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:03 smithi026 ceph-mon[96795]: pgmap v2471: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:03.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:03 smithi194 ceph-mon[65619]: pgmap v2471: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:05.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:05 smithi026 ceph-mon[96795]: pgmap v2472: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:05.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:05 smithi194 ceph-mon[65619]: pgmap v2472: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:05.699 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.698+0000 7fae784a4700 1 -- 172.21.15.26:0/4178961389 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae700f49a0 msgr2=0x7fae700f4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:17:05.699 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.698+0000 7fae784a4700 1 --2- 172.21.15.26:0/4178961389 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae700f49a0 0x7fae700f4dc0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7fae6c004660 tx=0x7fae6c009b30).stop 2021-11-03T18:17:05.699 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.698+0000 7fae784a4700 1 -- 172.21.15.26:0/4178961389 shutdown_connections 2021-11-03T18:17:05.700 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.698+0000 7fae784a4700 1 --2- 172.21.15.26:0/4178961389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae700f5340 0x7fae700f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:05.700 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.698+0000 7fae784a4700 1 --2- 172.21.15.26:0/4178961389 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae700f49a0 0x7fae700f4dc0 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:05.700 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.698+0000 7fae784a4700 1 -- 172.21.15.26:0/4178961389 >> 172.21.15.26:0/4178961389 conn(0x7fae700f04c0 msgr2=0x7fae700f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:17:05.700 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.698+0000 7fae784a4700 1 -- 172.21.15.26:0/4178961389 shutdown_connections 2021-11-03T18:17:05.701 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.698+0000 7fae784a4700 1 -- 172.21.15.26:0/4178961389 wait complete. 2021-11-03T18:17:05.701 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.699+0000 7fae784a4700 1 Processor -- start 2021-11-03T18:17:05.701 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.699+0000 7fae784a4700 1 -- start start 2021-11-03T18:17:05.701 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.699+0000 7fae784a4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae700f49a0 0x7fae70106fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:17:05.701 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.699+0000 7fae784a4700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae700f5340 0x7fae701074b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:17:05.702 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.699+0000 7fae784a4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae70107a60 con 0x7fae700f49a0 2021-11-03T18:17:05.702 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.699+0000 7fae784a4700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae70107ba0 con 0x7fae700f5340 2021-11-03T18:17:05.702 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.699+0000 7fae76240700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae700f49a0 0x7fae70106fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:17:05.702 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.699+0000 7fae76240700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae700f49a0 0x7fae70106fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59150/0 (socket says 172.21.15.26:59150) 2021-11-03T18:17:05.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.699+0000 7fae76240700 1 -- 172.21.15.26:0/1521888856 learned_addr learned my addr 172.21.15.26:0/1521888856 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:17:05.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.700+0000 7fae75a3f700 1 --2- 172.21.15.26:0/1521888856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae700f5340 0x7fae701074b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:17:05.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.700+0000 7fae76240700 1 -- 172.21.15.26:0/1521888856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae700f5340 msgr2=0x7fae701074b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:17:05.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.700+0000 7fae76240700 1 --2- 172.21.15.26:0/1521888856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae700f5340 0x7fae701074b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:05.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.700+0000 7fae76240700 1 -- 172.21.15.26:0/1521888856 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6c005040 con 0x7fae700f49a0 2021-11-03T18:17:05.704 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.700+0000 7fae75a3f700 1 --2- 172.21.15.26:0/1521888856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae700f5340 0x7fae701074b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:17:05.704 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.700+0000 7fae76240700 1 --2- 172.21.15.26:0/1521888856 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae700f49a0 0x7fae70106fc0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 rx=0x7fae6c013a70 tx=0x7fae6c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:17:05.704 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.700+0000 7fae66ffd700 1 -- 172.21.15.26:0/1521888856 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae6c018070 con 0x7fae700f49a0 2021-11-03T18:17:05.704 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.700+0000 7fae66ffd700 1 -- 172.21.15.26:0/1521888856 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fae6c0097d0 con 0x7fae700f49a0 2021-11-03T18:17:05.705 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.700+0000 7fae784a4700 1 -- 172.21.15.26:0/1521888856 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae701084e0 con 0x7fae700f49a0 2021-11-03T18:17:05.705 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.700+0000 7fae66ffd700 1 -- 172.21.15.26:0/1521888856 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae6c01c3c0 con 0x7fae700f49a0 2021-11-03T18:17:05.705 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.700+0000 7fae784a4700 1 -- 172.21.15.26:0/1521888856 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae70108a40 con 0x7fae700f49a0 2021-11-03T18:17:05.705 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.701+0000 7fae784a4700 1 -- 172.21.15.26:0/1521888856 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae70045ad0 con 0x7fae700f49a0 2021-11-03T18:17:05.706 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.701+0000 7fae66ffd700 1 -- 172.21.15.26:0/1521888856 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fae6c007ba0 con 0x7fae700f49a0 2021-11-03T18:17:05.707 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.702+0000 7fae66ffd700 1 --2- 172.21.15.26:0/1521888856 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fae5c0640b0 0x7fae5c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:17:05.707 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.702+0000 7fae66ffd700 1 -- 172.21.15.26:0/1521888856 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fae6c0823a0 con 0x7fae700f49a0 2021-11-03T18:17:05.707 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.702+0000 7fae75a3f700 1 --2- 172.21.15.26:0/1521888856 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fae5c0640b0 0x7fae5c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:17:05.707 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.702+0000 7fae75a3f700 1 --2- 172.21.15.26:0/1521888856 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fae5c0640b0 0x7fae5c066570 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7fae60009fd0 tx=0x7fae6000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:17:05.708 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.706+0000 7fae66ffd700 1 -- 172.21.15.26:0/1521888856 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fae6c0547c0 con 0x7fae700f49a0 2021-11-03T18:17:05.882 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.885+0000 7fae784a4700 1 -- 172.21.15.26:0/1521888856 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fae700ff090 con 0x7fae5c0640b0 2021-11-03T18:17:05.884 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.886+0000 7fae66ffd700 1 -- 172.21.15.26:0/1521888856 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fae6000f040 con 0x7fae5c0640b0 2021-11-03T18:17:05.886 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.888+0000 7fae784a4700 1 -- 172.21.15.26:0/1521888856 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fae5c0640b0 msgr2=0x7fae5c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:17:05.886 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.888+0000 7fae784a4700 1 --2- 172.21.15.26:0/1521888856 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fae5c0640b0 0x7fae5c066570 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7fae60009fd0 tx=0x7fae6000b040).stop 2021-11-03T18:17:05.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.888+0000 7fae784a4700 1 -- 172.21.15.26:0/1521888856 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae700f49a0 msgr2=0x7fae70106fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:17:05.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.888+0000 7fae784a4700 1 --2- 172.21.15.26:0/1521888856 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae700f49a0 0x7fae70106fc0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 rx=0x7fae6c013a70 tx=0x7fae6c009b30).stop 2021-11-03T18:17:05.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.888+0000 7fae784a4700 1 -- 172.21.15.26:0/1521888856 shutdown_connections 2021-11-03T18:17:05.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.888+0000 7fae784a4700 1 --2- 172.21.15.26:0/1521888856 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fae5c0640b0 0x7fae5c066570 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:05.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.888+0000 7fae784a4700 1 --2- 172.21.15.26:0/1521888856 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae700f49a0 0x7fae70106fc0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:05.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.888+0000 7fae784a4700 1 --2- 172.21.15.26:0/1521888856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae700f5340 0x7fae701074b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:05.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.888+0000 7fae784a4700 1 -- 172.21.15.26:0/1521888856 >> 172.21.15.26:0/1521888856 conn(0x7fae700f04c0 msgr2=0x7fae700fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:17:05.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.888+0000 7fae784a4700 1 -- 172.21.15.26:0/1521888856 shutdown_connections 2021-11-03T18:17:05.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.888+0000 7fae784a4700 1 -- 172.21.15.26:0/1521888856 wait complete. 2021-11-03T18:17:05.895 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:17:05.988 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.988+0000 7f262b500700 1 -- 172.21.15.26:0/2009054214 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26240f77d0 msgr2=0x7f26240f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:17:05.988 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.988+0000 7f262b500700 1 --2- 172.21.15.26:0/2009054214 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26240f77d0 0x7f26240f7c30 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 rx=0x7f2618004660 tx=0x7f2618009b30).stop 2021-11-03T18:17:05.988 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.988+0000 7f262b500700 1 -- 172.21.15.26:0/2009054214 shutdown_connections 2021-11-03T18:17:05.989 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.988+0000 7f262b500700 1 --2- 172.21.15.26:0/2009054214 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26240f77d0 0x7f26240f7c30 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:05.989 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.988+0000 7f262b500700 1 --2- 172.21.15.26:0/2009054214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26240f6530 0x7f26240f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:05.989 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.988+0000 7f262b500700 1 -- 172.21.15.26:0/2009054214 >> 172.21.15.26:0/2009054214 conn(0x7f26240f1cd0 msgr2=0x7f26240f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:17:05.989 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.988+0000 7f262b500700 1 -- 172.21.15.26:0/2009054214 shutdown_connections 2021-11-03T18:17:05.990 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.989+0000 7f262b500700 1 -- 172.21.15.26:0/2009054214 wait complete. 2021-11-03T18:17:05.990 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.989+0000 7f262b500700 1 Processor -- start 2021-11-03T18:17:05.990 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.989+0000 7f262b500700 1 -- start start 2021-11-03T18:17:05.990 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.989+0000 7f262b500700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26240f6530 0x7f262406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:17:05.990 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.989+0000 7f262b500700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26240f77d0 0x7f2624069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:17:05.991 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.989+0000 7f262b500700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262406a380 con 0x7f26240f77d0 2021-11-03T18:17:05.991 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.989+0000 7f262b500700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262406a4c0 con 0x7f26240f6530 2021-11-03T18:17:05.991 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.989+0000 7f2629cfd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26240f77d0 0x7f2624069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:17:05.991 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.989+0000 7f2629cfd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26240f77d0 0x7f2624069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59162/0 (socket says 172.21.15.26:59162) 2021-11-03T18:17:05.992 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.989+0000 7f2629cfd700 1 -- 172.21.15.26:0/784047777 learned_addr learned my addr 172.21.15.26:0/784047777 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:17:05.992 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.990+0000 7f262a4fe700 1 --2- 172.21.15.26:0/784047777 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26240f6530 0x7f262406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:17:05.992 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.990+0000 7f2629cfd700 1 -- 172.21.15.26:0/784047777 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26240f6530 msgr2=0x7f262406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:17:05.992 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.990+0000 7f2629cfd700 1 --2- 172.21.15.26:0/784047777 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26240f6530 0x7f262406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:05.992 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.990+0000 7f2629cfd700 1 -- 172.21.15.26:0/784047777 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2618005040 con 0x7f26240f77d0 2021-11-03T18:17:05.993 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.990+0000 7f2629cfd700 1 --2- 172.21.15.26:0/784047777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26240f77d0 0x7f2624069e20 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 rx=0x7f2618009990 tx=0x7f2618009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:17:05.993 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.990+0000 7f2622ffd700 1 -- 172.21.15.26:0/784047777 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2618018070 con 0x7f26240f77d0 2021-11-03T18:17:05.993 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.990+0000 7f2622ffd700 1 -- 172.21.15.26:0/784047777 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2618007ca0 con 0x7f26240f77d0 2021-11-03T18:17:05.993 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.990+0000 7f2622ffd700 1 -- 172.21.15.26:0/784047777 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f261801c620 con 0x7f26240f77d0 2021-11-03T18:17:05.993 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.990+0000 7f262b500700 1 -- 172.21.15.26:0/784047777 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f262406a740 con 0x7f26240f77d0 2021-11-03T18:17:05.994 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.990+0000 7f262b500700 1 -- 172.21.15.26:0/784047777 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f262406aca0 con 0x7f26240f77d0 2021-11-03T18:17:05.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.991+0000 7f262b500700 1 -- 172.21.15.26:0/784047777 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2624045ad0 con 0x7f26240f77d0 2021-11-03T18:17:05.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.992+0000 7f2622ffd700 1 -- 172.21.15.26:0/784047777 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f261801d960 con 0x7f26240f77d0 2021-11-03T18:17:05.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.992+0000 7f2622ffd700 1 --2- 172.21.15.26:0/784047777 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f260c064100 0x7f260c0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:17:05.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.992+0000 7f2622ffd700 1 -- 172.21.15.26:0/784047777 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f26180825c0 con 0x7f26240f77d0 2021-11-03T18:17:05.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.992+0000 7f262a4fe700 1 --2- 172.21.15.26:0/784047777 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f260c064100 0x7f260c0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:17:05.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.993+0000 7f262a4fe700 1 --2- 172.21.15.26:0/784047777 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f260c064100 0x7f260c0665c0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f262406b730 tx=0x7f2614009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:17:05.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:05.996+0000 7f2622ffd700 1 -- 172.21.15.26:0/784047777 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f26180549a0 con 0x7f26240f77d0 2021-11-03T18:17:06.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.172+0000 7f262b500700 1 -- 172.21.15.26:0/784047777 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f26240feea0 con 0x7f260c064100 2021-11-03T18:17:06.184 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.186+0000 7f2622ffd700 1 -- 172.21.15.26:0/784047777 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f2614007860 con 0x7f260c064100 2021-11-03T18:17:06.184 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:17:06.185 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (88m) 7m ago 89m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:17:06.185 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (80m) 7m ago 89m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:17:06.185 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (80m) 6m ago 88m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:17:06.185 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (88m) 7m ago 89m 42.0M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:17:06.185 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (81m) 7m ago 84m 25.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:17:06.186 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (81m) 7m ago 84m 26.4M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:17:06.186 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (84m) 6m ago 84m 26.6M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:17:06.186 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (84m) 6m ago 84m 27.0M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:17:06.186 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (82m) 7m ago 90m 574M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:17:06.187 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (81m) 6m ago 88m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:17:06.187 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (81m) 7m ago 91m 308M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:17:06.187 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (81m) 6m ago 88m 145M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:17:06.187 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (89m) 7m ago 89m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:17:06.187 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (88m) 6m ago 88m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:17:06.188 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (80m) 7m ago 87m 312M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:17:06.188 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (79m) 7m ago 87m 335M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:17:06.188 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (79m) 7m ago 87m 279M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:17:06.188 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (78m) 6m ago 86m 362M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:17:06.189 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (78m) 6m ago 86m 302M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:17:06.189 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (77m) 6m ago 86m 296M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:17:06.189 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (88m) 7m ago 88m 63.4M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:17:06.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.188+0000 7f262b500700 1 -- 172.21.15.26:0/784047777 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f260c064100 msgr2=0x7f260c0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:17:06.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.188+0000 7f262b500700 1 --2- 172.21.15.26:0/784047777 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f260c064100 0x7f260c0665c0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f262406b730 tx=0x7f2614009040).stop 2021-11-03T18:17:06.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.188+0000 7f262b500700 1 -- 172.21.15.26:0/784047777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26240f77d0 msgr2=0x7f2624069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:17:06.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.188+0000 7f262b500700 1 --2- 172.21.15.26:0/784047777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26240f77d0 0x7f2624069e20 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 rx=0x7f2618009990 tx=0x7f2618009b30).stop 2021-11-03T18:17:06.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.188+0000 7f262b500700 1 -- 172.21.15.26:0/784047777 shutdown_connections 2021-11-03T18:17:06.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.188+0000 7f262b500700 1 --2- 172.21.15.26:0/784047777 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f260c064100 0x7f260c0665c0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:06.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.188+0000 7f262b500700 1 --2- 172.21.15.26:0/784047777 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26240f6530 0x7f262406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:06.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.188+0000 7f262b500700 1 --2- 172.21.15.26:0/784047777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26240f77d0 0x7f2624069e20 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:06.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.188+0000 7f262b500700 1 -- 172.21.15.26:0/784047777 >> 172.21.15.26:0/784047777 conn(0x7f26240f1cd0 msgr2=0x7f26240fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:17:06.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.188+0000 7f262b500700 1 -- 172.21.15.26:0/784047777 shutdown_connections 2021-11-03T18:17:06.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.188+0000 7f262b500700 1 -- 172.21.15.26:0/784047777 wait complete. 2021-11-03T18:17:06.286 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.287+0000 7f2222e24700 1 -- 172.21.15.26:0/2573073140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f221c0f74a0 msgr2=0x7f221c0f5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:17:06.286 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.287+0000 7f2222e24700 1 --2- 172.21.15.26:0/2573073140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f221c0f74a0 0x7f221c0f5930 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 rx=0x7f2210004660 tx=0x7f2210009b30).stop 2021-11-03T18:17:06.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.287+0000 7f2222e24700 1 -- 172.21.15.26:0/2573073140 shutdown_connections 2021-11-03T18:17:06.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.287+0000 7f2222e24700 1 --2- 172.21.15.26:0/2573073140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f221c0f74a0 0x7f221c0f5930 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:06.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.287+0000 7f2222e24700 1 --2- 172.21.15.26:0/2573073140 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f221c0f6b90 0x7f221c0f6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:06.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.287+0000 7f2222e24700 1 -- 172.21.15.26:0/2573073140 >> 172.21.15.26:0/2573073140 conn(0x7f221c0f0540 msgr2=0x7f221c0f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:17:06.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.287+0000 7f2222e24700 1 -- 172.21.15.26:0/2573073140 shutdown_connections 2021-11-03T18:17:06.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.287+0000 7f2222e24700 1 -- 172.21.15.26:0/2573073140 wait complete. 2021-11-03T18:17:06.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.288+0000 7f2222e24700 1 Processor -- start 2021-11-03T18:17:06.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.288+0000 7f2222e24700 1 -- start start 2021-11-03T18:17:06.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.288+0000 7f2222e24700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f221c0f6b90 0x7f221c10c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:17:06.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.288+0000 7f2222e24700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f221c0f74a0 0x7f221c10e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:17:06.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.288+0000 7f2222e24700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221c0f54b0 con 0x7f221c0f74a0 2021-11-03T18:17:06.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.288+0000 7f2222e24700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221c0f55f0 con 0x7f221c0f6b90 2021-11-03T18:17:06.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.288+0000 7f221bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f221c0f74a0 0x7f221c10e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:17:06.290 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.288+0000 7f221bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f221c0f74a0 0x7f221c10e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59172/0 (socket says 172.21.15.26:59172) 2021-11-03T18:17:06.290 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.288+0000 7f221bfff700 1 -- 172.21.15.26:0/3147668088 learned_addr learned my addr 172.21.15.26:0/3147668088 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:17:06.290 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.288+0000 7f2220bc0700 1 --2- 172.21.15.26:0/3147668088 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f221c0f6b90 0x7f221c10c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:17:06.290 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.288+0000 7f221bfff700 1 -- 172.21.15.26:0/3147668088 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f221c0f6b90 msgr2=0x7f221c10c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:17:06.291 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.288+0000 7f221bfff700 1 --2- 172.21.15.26:0/3147668088 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f221c0f6b90 0x7f221c10c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:06.291 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.288+0000 7f221bfff700 1 -- 172.21.15.26:0/3147668088 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2210005040 con 0x7f221c0f74a0 2021-11-03T18:17:06.291 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.288+0000 7f221bfff700 1 --2- 172.21.15.26:0/3147668088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f221c0f74a0 0x7f221c10e510 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 rx=0x7f2210000c00 tx=0x7f221000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:17:06.291 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.289+0000 7f22197fa700 1 -- 172.21.15.26:0/3147668088 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2210019070 con 0x7f221c0f74a0 2021-11-03T18:17:06.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.289+0000 7f2222e24700 1 -- 172.21.15.26:0/3147668088 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f221c10ea00 con 0x7f221c0f74a0 2021-11-03T18:17:06.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.289+0000 7f22197fa700 1 -- 172.21.15.26:0/3147668088 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2210007e70 con 0x7f221c0f74a0 2021-11-03T18:17:06.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.289+0000 7f22197fa700 1 -- 172.21.15.26:0/3147668088 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2210014d90 con 0x7f221c0f74a0 2021-11-03T18:17:06.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.289+0000 7f2222e24700 1 -- 172.21.15.26:0/3147668088 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f221c10edd0 con 0x7f221c0f74a0 2021-11-03T18:17:06.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.290+0000 7f2222e24700 1 -- 172.21.15.26:0/3147668088 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f221c045ad0 con 0x7f221c0f74a0 2021-11-03T18:17:06.294 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.290+0000 7f22197fa700 1 -- 172.21.15.26:0/3147668088 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f2210025070 con 0x7f221c0f74a0 2021-11-03T18:17:06.294 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.290+0000 7f22197fa700 1 --2- 172.21.15.26:0/3147668088 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f22040640b0 0x7f2204066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:17:06.294 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.290+0000 7f22197fa700 1 -- 172.21.15.26:0/3147668088 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f22100817c0 con 0x7f221c0f74a0 2021-11-03T18:17:06.294 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.291+0000 7f2220bc0700 1 --2- 172.21.15.26:0/3147668088 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f22040640b0 0x7f2204066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:17:06.295 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.291+0000 7f2220bc0700 1 --2- 172.21.15.26:0/3147668088 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f22040640b0 0x7f2204066570 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f221c0f5240 tx=0x7f221400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:17:06.295 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.294+0000 7f22197fa700 1 -- 172.21.15.26:0/3147668088 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f2210053ac0 con 0x7f221c0f74a0 2021-11-03T18:17:06.521 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.523+0000 7f2222e24700 1 -- 172.21.15.26:0/3147668088 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f221c0fde70 con 0x7f221c0f74a0 2021-11-03T18:17:06.522 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.524+0000 7f22197fa700 1 -- 172.21.15.26:0/3147668088 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f2210023070 con 0x7f221c0f74a0 2021-11-03T18:17:06.522 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:17:06.522 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:17:06.523 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:17:06.523 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:17:06.523 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:17:06.523 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:17:06.524 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:17:06.524 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:17:06.524 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:17:06.524 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:17:06.524 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:17:06.525 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:17:06.525 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:17:06.525 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:17:06.525 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:17:06.526 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:17:06.526 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:17:06.526 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:17:06.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.526+0000 7f2222e24700 1 -- 172.21.15.26:0/3147668088 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f22040640b0 msgr2=0x7f2204066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:17:06.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.526+0000 7f2222e24700 1 --2- 172.21.15.26:0/3147668088 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f22040640b0 0x7f2204066570 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f221c0f5240 tx=0x7f221400b040).stop 2021-11-03T18:17:06.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.526+0000 7f2222e24700 1 -- 172.21.15.26:0/3147668088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f221c0f74a0 msgr2=0x7f221c10e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:17:06.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.526+0000 7f2222e24700 1 --2- 172.21.15.26:0/3147668088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f221c0f74a0 0x7f221c10e510 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 rx=0x7f2210000c00 tx=0x7f221000b040).stop 2021-11-03T18:17:06.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.526+0000 7f2222e24700 1 -- 172.21.15.26:0/3147668088 shutdown_connections 2021-11-03T18:17:06.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.526+0000 7f2222e24700 1 --2- 172.21.15.26:0/3147668088 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f22040640b0 0x7f2204066570 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:06.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.526+0000 7f2222e24700 1 --2- 172.21.15.26:0/3147668088 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f221c0f6b90 0x7f221c10c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:06.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.526+0000 7f2222e24700 1 --2- 172.21.15.26:0/3147668088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f221c0f74a0 0x7f221c10e510 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:06.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.526+0000 7f2222e24700 1 -- 172.21.15.26:0/3147668088 >> 172.21.15.26:0/3147668088 conn(0x7f221c0f0540 msgr2=0x7f221c0fa390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:17:06.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.526+0000 7f2222e24700 1 -- 172.21.15.26:0/3147668088 shutdown_connections 2021-11-03T18:17:06.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.526+0000 7f2222e24700 1 -- 172.21.15.26:0/3147668088 wait complete. 2021-11-03T18:17:06.625 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.625+0000 7f389c909700 1 -- 172.21.15.26:0/2140377708 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38980f73b0 msgr2=0x7f38980f4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:17:06.626 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.625+0000 7f389c909700 1 --2- 172.21.15.26:0/2140377708 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38980f73b0 0x7f38980f4640 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 rx=0x7f3888004660 tx=0x7f3888009b30).stop 2021-11-03T18:17:06.626 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.625+0000 7f389c909700 1 -- 172.21.15.26:0/2140377708 shutdown_connections 2021-11-03T18:17:06.626 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.625+0000 7f389c909700 1 --2- 172.21.15.26:0/2140377708 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38980f73b0 0x7f38980f4640 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:06.627 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.625+0000 7f389c909700 1 --2- 172.21.15.26:0/2140377708 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38980f6a10 0x7f38980f6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:06.627 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.625+0000 7f389c909700 1 -- 172.21.15.26:0/2140377708 >> 172.21.15.26:0/2140377708 conn(0x7f38980f0320 msgr2=0x7f38980f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:17:06.627 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.625+0000 7f389c909700 1 -- 172.21.15.26:0/2140377708 shutdown_connections 2021-11-03T18:17:06.627 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.625+0000 7f389c909700 1 -- 172.21.15.26:0/2140377708 wait complete. 2021-11-03T18:17:06.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.626+0000 7f389c909700 1 Processor -- start 2021-11-03T18:17:06.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.626+0000 7f389c909700 1 -- start start 2021-11-03T18:17:06.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.626+0000 7f389c909700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38980f6a10 0x7f3898108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:17:06.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.626+0000 7f389c909700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38980f73b0 0x7f3898109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:17:06.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.626+0000 7f389c909700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38981099e0 con 0x7f38980f6a10 2021-11-03T18:17:06.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.626+0000 7f389c909700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3898109b20 con 0x7f38980f73b0 2021-11-03T18:17:06.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.626+0000 7f38977fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38980f6a10 0x7f3898108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:17:06.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.626+0000 7f38977fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38980f6a10 0x7f3898108f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59180/0 (socket says 172.21.15.26:59180) 2021-11-03T18:17:06.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.626+0000 7f38977fe700 1 -- 172.21.15.26:0/2349201593 learned_addr learned my addr 172.21.15.26:0/2349201593 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:17:06.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.626+0000 7f3896ffd700 1 --2- 172.21.15.26:0/2349201593 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38980f73b0 0x7f3898109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:17:06.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.627+0000 7f38977fe700 1 -- 172.21.15.26:0/2349201593 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38980f73b0 msgr2=0x7f3898109430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:17:06.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.627+0000 7f38977fe700 1 --2- 172.21.15.26:0/2349201593 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38980f73b0 0x7f3898109430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:06.631 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.627+0000 7f38977fe700 1 -- 172.21.15.26:0/2349201593 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3888005040 con 0x7f38980f6a10 2021-11-03T18:17:06.631 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.627+0000 7f38977fe700 1 --2- 172.21.15.26:0/2349201593 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38980f6a10 0x7f3898108f40 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7f388c0026d0 tx=0x7f388c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:17:06.631 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.627+0000 7f387ffff700 1 -- 172.21.15.26:0/2349201593 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f388c0079c0 con 0x7f38980f6a10 2021-11-03T18:17:06.631 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.627+0000 7f389c909700 1 -- 172.21.15.26:0/2349201593 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f389810a4c0 con 0x7f38980f6a10 2021-11-03T18:17:06.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.627+0000 7f387ffff700 1 -- 172.21.15.26:0/2349201593 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f388c00f040 con 0x7f38980f6a10 2021-11-03T18:17:06.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.627+0000 7f387ffff700 1 -- 172.21.15.26:0/2349201593 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f388c0148b0 con 0x7f38980f6a10 2021-11-03T18:17:06.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.627+0000 7f389c909700 1 -- 172.21.15.26:0/2349201593 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f389810aa80 con 0x7f38980f6a10 2021-11-03T18:17:06.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.628+0000 7f389c909700 1 -- 172.21.15.26:0/2349201593 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3898045ad0 con 0x7f38980f6a10 2021-11-03T18:17:06.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.628+0000 7f387ffff700 1 -- 172.21.15.26:0/2349201593 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f388c007b20 con 0x7f38980f6a10 2021-11-03T18:17:06.634 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.629+0000 7f387ffff700 1 --2- 172.21.15.26:0/2349201593 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3880064100 0x7f38800665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:17:06.634 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.629+0000 7f387ffff700 1 -- 172.21.15.26:0/2349201593 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f388c080730 con 0x7f38980f6a10 2021-11-03T18:17:06.634 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.629+0000 7f3896ffd700 1 --2- 172.21.15.26:0/2349201593 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3880064100 0x7f38800665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:17:06.634 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.629+0000 7f3896ffd700 1 --2- 172.21.15.26:0/2349201593 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3880064100 0x7f38800665c0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7f3888004630 tx=0x7f3888009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:17:06.635 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.633+0000 7f387ffff700 1 -- 172.21.15.26:0/2349201593 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f388c052a90 con 0x7f38980f6a10 2021-11-03T18:17:06.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.837+0000 7f389c909700 1 -- 172.21.15.26:0/2349201593 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3898101030 con 0x7f38980f6a10 2021-11-03T18:17:06.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.837+0000 7f387ffff700 1 -- 172.21.15.26:0/2349201593 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f388c052680 con 0x7f38980f6a10 2021-11-03T18:17:06.836 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:17:06.836 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:17:06.836 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:17:06.836 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:17:06.837 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:17:06.837 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:17:06.837 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:17:06.837 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:17:06.838 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:17:06.838 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:17:06.838 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:17:06.838 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:17:06.839 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:17:06.839 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:17:06.839 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:17:06.839 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:17:06.840 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:17:06.840 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:17:06.840 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:17:06.840 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:17:06.841 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:17:06.841 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:17:06.841 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:17:06.841 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:17:06.841 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:17:06.842 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:17:06.842 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:17:06.842 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:17:06.842 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:17:06.843 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:17:06.843 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:17:06.843 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:17:06.843 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:17:06.844 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:17:06.844 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:17:06.845 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:17:06.845 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:17:06.845 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:17:06.846 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:17:06.847 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.839+0000 7f389c909700 1 -- 172.21.15.26:0/2349201593 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3880064100 msgr2=0x7f38800665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:17:06.847 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.839+0000 7f389c909700 1 --2- 172.21.15.26:0/2349201593 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3880064100 0x7f38800665c0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7f3888004630 tx=0x7f3888009b30).stop 2021-11-03T18:17:06.847 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.839+0000 7f389c909700 1 -- 172.21.15.26:0/2349201593 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38980f6a10 msgr2=0x7f3898108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:17:06.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.839+0000 7f389c909700 1 --2- 172.21.15.26:0/2349201593 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38980f6a10 0x7f3898108f40 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7f388c0026d0 tx=0x7f388c009de0).stop 2021-11-03T18:17:06.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.839+0000 7f389c909700 1 -- 172.21.15.26:0/2349201593 shutdown_connections 2021-11-03T18:17:06.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.839+0000 7f389c909700 1 --2- 172.21.15.26:0/2349201593 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3880064100 0x7f38800665c0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:06.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.839+0000 7f389c909700 1 --2- 172.21.15.26:0/2349201593 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38980f6a10 0x7f3898108f40 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:06.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.839+0000 7f389c909700 1 --2- 172.21.15.26:0/2349201593 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38980f73b0 0x7f3898109430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:06.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.839+0000 7f389c909700 1 -- 172.21.15.26:0/2349201593 >> 172.21.15.26:0/2349201593 conn(0x7f38980f0320 msgr2=0x7f38980fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:17:06.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.839+0000 7f389c909700 1 -- 172.21.15.26:0/2349201593 shutdown_connections 2021-11-03T18:17:06.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:06.839+0000 7f389c909700 1 -- 172.21.15.26:0/2349201593 wait complete. 2021-11-03T18:17:06.850 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:17:07.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:07 smithi026 ceph-mon[96795]: pgmap v2473: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:07.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:07 smithi026 ceph-mon[96795]: from='client.36684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:17:07.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:07 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3147668088' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:17:07.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:07 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2349201593' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:17:07.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:07 smithi194 ceph-mon[65619]: pgmap v2473: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:07.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:07 smithi194 ceph-mon[65619]: from='client.36684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:17:07.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:07 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3147668088' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:17:07.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:07 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2349201593' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:17:08.325 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:08 smithi194 ceph-mon[65619]: from='client.36688 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:17:08.325 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:08 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:17:08.349 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:08 smithi026 ceph-mon[96795]: from='client.36688 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:17:08.349 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:08 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:17:09.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:09 smithi026 ceph-mon[96795]: pgmap v2474: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:09.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:09 smithi026 ceph-mon[96795]: poll took 60048.705 ms: 1 events 2021-11-03T18:17:09.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:09 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:17:09.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:09 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:17:09.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:09 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:17:09.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:09 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:17:09.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:09 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:17:09.428 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:09 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:17:09.431 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:09 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:17:09.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:09 smithi194 ceph-mon[65619]: pgmap v2474: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:09.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:09 smithi194 ceph-mon[65619]: poll took 60048.705 ms: 1 events 2021-11-03T18:17:09.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:09 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:17:09.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:09 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:17:09.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:09 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:17:09.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:09 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:17:09.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:09 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:17:09.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:09 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:17:09.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:09 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:17:10.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:10 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:17:10.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:10 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:17:10.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:10 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:17:10.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:10 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:17:11.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:11 smithi026 ceph-mon[96795]: pgmap v2475: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:11.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:11 smithi194 ceph-mon[65619]: pgmap v2475: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:13.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:13 smithi026 ceph-mon[96795]: pgmap v2476: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:13.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:13 smithi194 ceph-mon[65619]: pgmap v2476: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:15.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:15 smithi026 ceph-mon[96795]: pgmap v2477: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:15.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:15 smithi194 ceph-mon[65619]: pgmap v2477: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:17.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:17 smithi026 ceph-mon[96795]: pgmap v2478: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:17.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:17 smithi194 ceph-mon[65619]: pgmap v2478: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:19.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:19 smithi026 ceph-mon[96795]: pgmap v2479: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:19.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:19 smithi194 ceph-mon[65619]: pgmap v2479: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:21.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:21 smithi026 ceph-mon[96795]: pgmap v2480: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:21.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:21 smithi194 ceph-mon[65619]: pgmap v2480: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:23.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:23 smithi026 ceph-mon[96795]: pgmap v2481: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:23.473 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:23 smithi194 ceph-mon[65619]: pgmap v2481: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:24.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:17:24.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:17:25.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:25 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:17:25.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:25 smithi026 ceph-mon[96795]: pgmap v2482: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:25.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:25 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:17:25.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:25 smithi194 ceph-mon[65619]: pgmap v2482: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:26.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:26 smithi026 ceph-mon[96795]: pgmap v2483: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:26.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:26 smithi194 ceph-mon[65619]: pgmap v2483: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:29.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:28 smithi026 ceph-mon[96795]: pgmap v2484: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:29.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:28 smithi194 ceph-mon[65619]: pgmap v2484: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:31.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:30 smithi026 ceph-mon[96795]: pgmap v2485: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:31.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:30 smithi194 ceph-mon[65619]: pgmap v2485: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:33.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:32 smithi026 ceph-mon[96795]: pgmap v2486: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:33.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:32 smithi194 ceph-mon[65619]: pgmap v2486: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:35.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:34 smithi026 ceph-mon[96795]: pgmap v2487: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:35.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:34 smithi194 ceph-mon[65619]: pgmap v2487: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:36.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:36.953+0000 7f4a8bdf9700 1 -- 172.21.15.26:0/903169254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a840f55c0 msgr2=0x7f4a840f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:17:36.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:36.953+0000 7f4a8bdf9700 1 --2- 172.21.15.26:0/903169254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a840f55c0 0x7f4a840f59e0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7f4a80004660 tx=0x7f4a80009b30).stop 2021-11-03T18:17:36.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:36.953+0000 7f4a8bdf9700 1 -- 172.21.15.26:0/903169254 shutdown_connections 2021-11-03T18:17:36.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:36.953+0000 7f4a8bdf9700 1 --2- 172.21.15.26:0/903169254 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a840f5ed0 0x7f4a840f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:17:36.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:36.953+0000 7f4a8bdf9700 1 --2- 172.21.15.26:0/903169254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a840f55c0 0x7f4a840f59e0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:36.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:36.953+0000 7f4a8bdf9700 1 -- 172.21.15.26:0/903169254 >> 172.21.15.26:0/903169254 conn(0x7f4a840f0dc0 msgr2=0x7f4a840f31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:17:36.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:36.953+0000 7f4a8bdf9700 1 -- 172.21.15.26:0/903169254 shutdown_connections 2021-11-03T18:17:36.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:36.954+0000 7f4a8bdf9700 1 -- 172.21.15.26:0/903169254 wait complete. 2021-11-03T18:17:36.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:36.954+0000 7f4a8bdf9700 1 Processor -- start 2021-11-03T18:17:36.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:36.954+0000 7f4a8bdf9700 1 -- start start 2021-11-03T18:17:36.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:36.954+0000 7f4a8bdf9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a840f55c0 0x7f4a84106f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:17:36.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:36.954+0000 7f4a8bdf9700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a840f5ed0 0x7f4a84107440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:17:36.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:36.954+0000 7f4a8bdf9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a84107a80 con 0x7f4a840f55c0 2021-11-03T18:17:36.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:36.954+0000 7f4a8bdf9700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a84108330 con 0x7f4a840f5ed0 2021-11-03T18:17:36.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:36.954+0000 7f4a89b95700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a840f55c0 0x7f4a84106f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:17:36.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:36.954+0000 7f4a89b95700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a840f55c0 0x7f4a84106f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59198/0 (socket says 172.21.15.26:59198) 2021-11-03T18:17:36.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:36.954+0000 7f4a89b95700 1 -- 172.21.15.26:0/783552159 learned_addr learned my addr 172.21.15.26:0/783552159 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:17:36.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:36.955+0000 7f4a89394700 1 --2- 172.21.15.26:0/783552159 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a840f5ed0 0x7f4a84107440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:17:36.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:36.955+0000 7f4a89b95700 1 -- 172.21.15.26:0/783552159 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a840f5ed0 msgr2=0x7f4a84107440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:17:36.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:36.955+0000 7f4a89b95700 1 --2- 172.21.15.26:0/783552159 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a840f5ed0 0x7f4a84107440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:36.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:36.955+0000 7f4a89b95700 1 -- 172.21.15.26:0/783552159 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a80005040 con 0x7f4a840f55c0 2021-11-03T18:17:36.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:36.955+0000 7f4a89394700 1 --2- 172.21.15.26:0/783552159 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a840f5ed0 0x7f4a84107440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:17:36.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:36.955+0000 7f4a89b95700 1 --2- 172.21.15.26:0/783552159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a840f55c0 0x7f4a84106f50 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7f4a80009990 tx=0x7f4a80009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:17:36.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:36.955+0000 7f4a7a7fc700 1 -- 172.21.15.26:0/783552159 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a80018070 con 0x7f4a840f55c0 2021-11-03T18:17:36.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:36.955+0000 7f4a7a7fc700 1 -- 172.21.15.26:0/783552159 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4a80007ca0 con 0x7f4a840f55c0 2021-11-03T18:17:36.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:36.955+0000 7f4a8bdf9700 1 -- 172.21.15.26:0/783552159 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a841085b0 con 0x7f4a840f55c0 2021-11-03T18:17:36.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:36.955+0000 7f4a7a7fc700 1 -- 172.21.15.26:0/783552159 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a8001c620 con 0x7f4a840f55c0 2021-11-03T18:17:36.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:36.955+0000 7f4a8bdf9700 1 -- 172.21.15.26:0/783552159 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a84108b10 con 0x7f4a840f55c0 2021-11-03T18:17:36.961 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:36.956+0000 7f4a8bdf9700 1 -- 172.21.15.26:0/783552159 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a840f4a50 con 0x7f4a840f55c0 2021-11-03T18:17:36.962 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:36.957+0000 7f4a7a7fc700 1 -- 172.21.15.26:0/783552159 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f4a8001d960 con 0x7f4a840f55c0 2021-11-03T18:17:36.962 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:36.957+0000 7f4a7a7fc700 1 --2- 172.21.15.26:0/783552159 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4a700640b0 0x7f4a70066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:17:36.962 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:36.957+0000 7f4a7a7fc700 1 -- 172.21.15.26:0/783552159 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f4a80082540 con 0x7f4a840f55c0 2021-11-03T18:17:36.962 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:36.957+0000 7f4a89394700 1 --2- 172.21.15.26:0/783552159 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4a700640b0 0x7f4a70066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:17:36.963 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:36.958+0000 7f4a89394700 1 --2- 172.21.15.26:0/783552159 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4a700640b0 0x7f4a70066570 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f4a7400a7e0 tx=0x7f4a74008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:17:36.963 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:36.961+0000 7f4a7a7fc700 1 -- 172.21.15.26:0/783552159 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f4a80054960 con 0x7f4a840f55c0 2021-11-03T18:17:37.141 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.142+0000 7f4a8bdf9700 1 -- 172.21.15.26:0/783552159 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a840fad40 con 0x7f4a700640b0 2021-11-03T18:17:37.142 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.143+0000 7f4a7a7fc700 1 -- 172.21.15.26:0/783552159 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f4a840fad40 con 0x7f4a700640b0 2021-11-03T18:17:37.145 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.146+0000 7f4a8bdf9700 1 -- 172.21.15.26:0/783552159 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4a700640b0 msgr2=0x7f4a70066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:17:37.145 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.146+0000 7f4a8bdf9700 1 --2- 172.21.15.26:0/783552159 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4a700640b0 0x7f4a70066570 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f4a7400a7e0 tx=0x7f4a74008040).stop 2021-11-03T18:17:37.146 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.146+0000 7f4a8bdf9700 1 -- 172.21.15.26:0/783552159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a840f55c0 msgr2=0x7f4a84106f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:17:37.146 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.146+0000 7f4a8bdf9700 1 --2- 172.21.15.26:0/783552159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a840f55c0 0x7f4a84106f50 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7f4a80009990 tx=0x7f4a80009b30).stop 2021-11-03T18:17:37.147 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.146+0000 7f4a8bdf9700 1 -- 172.21.15.26:0/783552159 shutdown_connections 2021-11-03T18:17:37.147 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.146+0000 7f4a8bdf9700 1 --2- 172.21.15.26:0/783552159 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4a700640b0 0x7f4a70066570 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:37.148 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.146+0000 7f4a8bdf9700 1 --2- 172.21.15.26:0/783552159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a840f55c0 0x7f4a84106f50 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:37.148 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.146+0000 7f4a8bdf9700 1 --2- 172.21.15.26:0/783552159 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a840f5ed0 0x7f4a84107440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:37.148 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.146+0000 7f4a8bdf9700 1 -- 172.21.15.26:0/783552159 >> 172.21.15.26:0/783552159 conn(0x7f4a840f0dc0 msgr2=0x7f4a8405ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:17:37.149 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.146+0000 7f4a8bdf9700 1 -- 172.21.15.26:0/783552159 shutdown_connections 2021-11-03T18:17:37.149 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.146+0000 7f4a8bdf9700 1 -- 172.21.15.26:0/783552159 wait complete. 2021-11-03T18:17:37.153 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:17:37.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:36 smithi026 ceph-mon[96795]: pgmap v2488: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:37.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.245+0000 7f6a13a05700 1 -- 172.21.15.26:0/516505794 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a0c0f6860 msgr2=0x7f6a0c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:17:37.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.245+0000 7f6a13a05700 1 --2- 172.21.15.26:0/516505794 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a0c0f6860 0x7f6a0c0f6cc0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 rx=0x7f6a08004660 tx=0x7f6a08009b30).stop 2021-11-03T18:17:37.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.245+0000 7f6a13a05700 1 -- 172.21.15.26:0/516505794 shutdown_connections 2021-11-03T18:17:37.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.245+0000 7f6a13a05700 1 --2- 172.21.15.26:0/516505794 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a0c0f6860 0x7f6a0c0f6cc0 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:37.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.245+0000 7f6a13a05700 1 --2- 172.21.15.26:0/516505794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a0c0f55c0 0x7f6a0c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:37.247 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.245+0000 7f6a13a05700 1 -- 172.21.15.26:0/516505794 >> 172.21.15.26:0/516505794 conn(0x7f6a0c0f0d40 msgr2=0x7f6a0c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:17:37.255 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.245+0000 7f6a13a05700 1 -- 172.21.15.26:0/516505794 shutdown_connections 2021-11-03T18:17:37.255 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.245+0000 7f6a13a05700 1 -- 172.21.15.26:0/516505794 wait complete. 2021-11-03T18:17:37.255 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.245+0000 7f6a13a05700 1 Processor -- start 2021-11-03T18:17:37.255 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.245+0000 7f6a13a05700 1 -- start start 2021-11-03T18:17:37.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.246+0000 7f6a13a05700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a0c0f55c0 0x7f6a0c109c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:17:37.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.246+0000 7f6a13a05700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a0c0f6860 0x7f6a0c10c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:17:37.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.246+0000 7f6a13a05700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c060420 con 0x7f6a0c0f6860 2021-11-03T18:17:37.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.246+0000 7f6a13a05700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c060560 con 0x7f6a0c0f55c0 2021-11-03T18:17:37.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.246+0000 7f6a10fa0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a0c0f6860 0x7f6a0c10c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:17:37.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.246+0000 7f6a10fa0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a0c0f6860 0x7f6a0c10c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59210/0 (socket says 172.21.15.26:59210) 2021-11-03T18:17:37.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.246+0000 7f6a10fa0700 1 -- 172.21.15.26:0/290696569 learned_addr learned my addr 172.21.15.26:0/290696569 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:17:37.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.246+0000 7f6a117a1700 1 --2- 172.21.15.26:0/290696569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a0c0f55c0 0x7f6a0c109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:17:37.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.246+0000 7f6a10fa0700 1 -- 172.21.15.26:0/290696569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a0c0f55c0 msgr2=0x7f6a0c109c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:17:37.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.246+0000 7f6a10fa0700 1 --2- 172.21.15.26:0/290696569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a0c0f55c0 0x7f6a0c109c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:37.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.246+0000 7f6a10fa0700 1 -- 172.21.15.26:0/290696569 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a08005040 con 0x7f6a0c0f6860 2021-11-03T18:17:37.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.246+0000 7f6a10fa0700 1 --2- 172.21.15.26:0/290696569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a0c0f6860 0x7f6a0c10c110 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7f6a08009990 tx=0x7f6a08009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:17:37.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.246+0000 7f6a01ffb700 1 -- 172.21.15.26:0/290696569 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a08018070 con 0x7f6a0c0f6860 2021-11-03T18:17:37.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.246+0000 7f6a01ffb700 1 -- 172.21.15.26:0/290696569 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6a08007ba0 con 0x7f6a0c0f6860 2021-11-03T18:17:37.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.246+0000 7f6a13a05700 1 -- 172.21.15.26:0/290696569 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a0c10c6c0 con 0x7f6a0c0f6860 2021-11-03T18:17:37.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.246+0000 7f6a01ffb700 1 -- 172.21.15.26:0/290696569 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a0801c620 con 0x7f6a0c0f6860 2021-11-03T18:17:37.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.247+0000 7f6a13a05700 1 -- 172.21.15.26:0/290696569 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a0c10cbf0 con 0x7f6a0c0f6860 2021-11-03T18:17:37.261 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:36 smithi194 ceph-mon[65619]: pgmap v2488: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:37.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.248+0000 7f6a13a05700 1 -- 172.21.15.26:0/290696569 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a0c0f49b0 con 0x7f6a0c0f6860 2021-11-03T18:17:37.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.248+0000 7f6a01ffb700 1 -- 172.21.15.26:0/290696569 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f6a0801c890 con 0x7f6a0c0f6860 2021-11-03T18:17:37.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.248+0000 7f6a01ffb700 1 --2- 172.21.15.26:0/290696569 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f69f80640b0 0x7f69f8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:17:37.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.249+0000 7f6a01ffb700 1 -- 172.21.15.26:0/290696569 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f6a08082520 con 0x7f6a0c0f6860 2021-11-03T18:17:37.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.249+0000 7f6a117a1700 1 --2- 172.21.15.26:0/290696569 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f69f80640b0 0x7f69f8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:17:37.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.249+0000 7f6a117a1700 1 --2- 172.21.15.26:0/290696569 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f69f80640b0 0x7f69f8066570 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f6a0c0600a0 tx=0x7f69fc009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:17:37.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.254+0000 7f6a01ffb700 1 -- 172.21.15.26:0/290696569 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f6a08054940 con 0x7f6a0c0f6860 2021-11-03T18:17:37.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.425+0000 7f6a13a05700 1 -- 172.21.15.26:0/290696569 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a0c0fde60 con 0x7f69f80640b0 2021-11-03T18:17:37.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.440+0000 7f6a01ffb700 1 -- 172.21.15.26:0/290696569 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f6a0c0fde60 con 0x7f69f80640b0 2021-11-03T18:17:37.439 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:17:37.439 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (88m) 7m ago 90m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:17:37.439 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (81m) 7m ago 90m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:17:37.440 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (80m) 6m ago 89m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:17:37.440 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (88m) 7m ago 89m 42.0M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:17:37.440 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (81m) 7m ago 85m 25.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:17:37.441 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (82m) 7m ago 85m 26.4M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:17:37.441 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (85m) 6m ago 85m 26.6M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:17:37.441 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (85m) 6m ago 85m 27.0M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:17:37.441 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (82m) 7m ago 91m 574M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:17:37.442 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (82m) 6m ago 89m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:17:37.442 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (81m) 7m ago 91m 308M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:17:37.442 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (81m) 6m ago 89m 145M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:17:37.442 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (89m) 7m ago 89m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:17:37.443 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (89m) 6m ago 89m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:17:37.443 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (80m) 7m ago 88m 312M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:17:37.443 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (80m) 7m ago 88m 335M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:17:37.443 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (79m) 7m ago 87m 279M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:17:37.443 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (79m) 6m ago 87m 362M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:17:37.444 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (78m) 6m ago 87m 302M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:17:37.444 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (78m) 6m ago 86m 296M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:17:37.444 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (88m) 7m ago 89m 63.4M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:17:37.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.442+0000 7f6a13a05700 1 -- 172.21.15.26:0/290696569 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f69f80640b0 msgr2=0x7f69f8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:17:37.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.442+0000 7f6a13a05700 1 --2- 172.21.15.26:0/290696569 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f69f80640b0 0x7f69f8066570 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f6a0c0600a0 tx=0x7f69fc009040).stop 2021-11-03T18:17:37.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.442+0000 7f6a13a05700 1 -- 172.21.15.26:0/290696569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a0c0f6860 msgr2=0x7f6a0c10c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:17:37.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.442+0000 7f6a13a05700 1 --2- 172.21.15.26:0/290696569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a0c0f6860 0x7f6a0c10c110 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7f6a08009990 tx=0x7f6a08009b30).stop 2021-11-03T18:17:37.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.442+0000 7f6a13a05700 1 -- 172.21.15.26:0/290696569 shutdown_connections 2021-11-03T18:17:37.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.442+0000 7f6a13a05700 1 --2- 172.21.15.26:0/290696569 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f69f80640b0 0x7f69f8066570 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:37.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.442+0000 7f6a13a05700 1 --2- 172.21.15.26:0/290696569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a0c0f55c0 0x7f6a0c109c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:37.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.442+0000 7f6a13a05700 1 --2- 172.21.15.26:0/290696569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a0c0f6860 0x7f6a0c10c110 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:37.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.442+0000 7f6a13a05700 1 -- 172.21.15.26:0/290696569 >> 172.21.15.26:0/290696569 conn(0x7f6a0c0f0d40 msgr2=0x7f6a0c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:17:37.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.442+0000 7f6a13a05700 1 -- 172.21.15.26:0/290696569 shutdown_connections 2021-11-03T18:17:37.447 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.442+0000 7f6a13a05700 1 -- 172.21.15.26:0/290696569 wait complete. 2021-11-03T18:17:37.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.540+0000 7f13fa284700 1 -- 172.21.15.26:0/1106153634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13f40f77d0 msgr2=0x7f13f40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:17:37.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.540+0000 7f13fa284700 1 --2- 172.21.15.26:0/1106153634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13f40f77d0 0x7f13f40f7c30 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 rx=0x7f13e4004660 tx=0x7f13e4009b30).stop 2021-11-03T18:17:37.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.540+0000 7f13fa284700 1 -- 172.21.15.26:0/1106153634 shutdown_connections 2021-11-03T18:17:37.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.540+0000 7f13fa284700 1 --2- 172.21.15.26:0/1106153634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13f40f77d0 0x7f13f40f7c30 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:37.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.540+0000 7f13fa284700 1 --2- 172.21.15.26:0/1106153634 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13f40f6530 0x7f13f40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:37.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.540+0000 7f13fa284700 1 -- 172.21.15.26:0/1106153634 >> 172.21.15.26:0/1106153634 conn(0x7f13f40f1cd0 msgr2=0x7f13f40f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:17:37.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.541+0000 7f13fa284700 1 -- 172.21.15.26:0/1106153634 shutdown_connections 2021-11-03T18:17:37.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.541+0000 7f13fa284700 1 -- 172.21.15.26:0/1106153634 wait complete. 2021-11-03T18:17:37.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.541+0000 7f13fa284700 1 Processor -- start 2021-11-03T18:17:37.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.541+0000 7f13fa284700 1 -- start start 2021-11-03T18:17:37.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.541+0000 7f13fa284700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13f40f6530 0x7f13f4106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:17:37.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.541+0000 7f13fa284700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13f40f77d0 0x7f13f4107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:17:37.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.541+0000 7f13fa284700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f4107870 con 0x7f13f40f6530 2021-11-03T18:17:37.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.541+0000 7f13fa284700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f4108080 con 0x7f13f40f77d0 2021-11-03T18:17:37.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.541+0000 7f13f9282700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13f40f6530 0x7f13f4106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:17:37.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.542+0000 7f13f9282700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13f40f6530 0x7f13f4106d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59218/0 (socket says 172.21.15.26:59218) 2021-11-03T18:17:37.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.542+0000 7f13f9282700 1 -- 172.21.15.26:0/3231031348 learned_addr learned my addr 172.21.15.26:0/3231031348 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:17:37.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.542+0000 7f13f9282700 1 -- 172.21.15.26:0/3231031348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13f40f77d0 msgr2=0x7f13f4107270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:17:37.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.542+0000 7f13f9282700 1 --2- 172.21.15.26:0/3231031348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13f40f77d0 0x7f13f4107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:17:37.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.542+0000 7f13f9282700 1 -- 172.21.15.26:0/3231031348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e4005040 con 0x7f13f40f6530 2021-11-03T18:17:37.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.542+0000 7f13f9282700 1 --2- 172.21.15.26:0/3231031348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13f40f6530 0x7f13f4106d80 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 rx=0x7f13f0002700 tx=0x7f13f0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:17:37.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.542+0000 7f13e9ffb700 1 -- 172.21.15.26:0/3231031348 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13f0009320 con 0x7f13f40f6530 2021-11-03T18:17:37.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.542+0000 7f13fa284700 1 -- 172.21.15.26:0/3231031348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13f4108300 con 0x7f13f40f6530 2021-11-03T18:17:37.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.542+0000 7f13e9ffb700 1 -- 172.21.15.26:0/3231031348 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f13f000f040 con 0x7f13f40f6530 2021-11-03T18:17:37.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.542+0000 7f13e9ffb700 1 -- 172.21.15.26:0/3231031348 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13f0014900 con 0x7f13f40f6530 2021-11-03T18:17:37.548 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.542+0000 7f13fa284700 1 -- 172.21.15.26:0/3231031348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13f41088c0 con 0x7f13f40f6530 2021-11-03T18:17:37.548 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.543+0000 7f13fa284700 1 -- 172.21.15.26:0/3231031348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13f4059100 con 0x7f13f40f6530 2021-11-03T18:17:37.549 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.544+0000 7f13e9ffb700 1 -- 172.21.15.26:0/3231031348 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f13f00077b0 con 0x7f13f40f6530 2021-11-03T18:17:37.549 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.544+0000 7f13e9ffb700 1 --2- 172.21.15.26:0/3231031348 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f13e0064100 0x7f13e00665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:17:37.550 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.544+0000 7f13e9ffb700 1 -- 172.21.15.26:0/3231031348 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f13f0080a40 con 0x7f13f40f6530 2021-11-03T18:17:37.550 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.544+0000 7f13f8a81700 1 --2- 172.21.15.26:0/3231031348 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f13e0064100 0x7f13e00665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:17:37.550 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.545+0000 7f13f8a81700 1 --2- 172.21.15.26:0/3231031348 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f13e0064100 0x7f13e00665c0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7f13e4004e30 tx=0x7f13e4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:17:37.550 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.549+0000 7f13e9ffb700 1 -- 172.21.15.26:0/3231031348 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f13f0052da0 con 0x7f13f40f6530 2021-11-03T18:17:37.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.778+0000 7f13fa284700 1 -- 172.21.15.26:0/3231031348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f13f40fee30 con 0x7f13f40f6530 2021-11-03T18:17:37.778 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.778+0000 7f13e9ffb700 1 -- 172.21.15.26:0/3231031348 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f13f0052990 con 0x7f13f40f6530 2021-11-03T18:17:37.778 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:17:37.779 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:17:37.779 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:17:37.779 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:17:37.779 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:17:37.780 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:17:37.780 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:17:37.780 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:17:37.780 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:17:37.781 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:17:37.781 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:17:37.782 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:17:37.782 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:17:37.782 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:17:37.782 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:17:37.783 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:17:37.783 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:17:37.783 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:17:37.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.780+0000 7f13fa284700 1 -- 172.21.15.26:0/3231031348 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f13e0064100 msgr2=0x7f13e00665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:17:37.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.780+0000 7f13fa284700 1 --2- 172.21.15.26:0/3231031348 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f13e0064100 0x7f13e00665c0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7f13e4004e30 tx=0x7f13e4009b30).stop 2021-11-03T18:17:37.786 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.780+0000 7f13fa284700 1 -- 172.21.15.26:0/3231031348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13f40f6530 msgr2=0x7f13f4106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:17:37.786 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.780+0000 7f13fa284700 1 --2- 172.21.15.26:0/3231031348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13f40f6530 0x7f13f4106d80 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 rx=0x7f13f0002700 tx=0x7f13f0009d80).stop 2021-11-03T18:17:37.786 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.780+0000 7f13fa284700 1 -- 172.21.15.26:0/3231031348 shutdown_connections 2021-11-03T18:17:37.786 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.780+0000 7f13fa284700 1 --2- 172.21.15.26:0/3231031348 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f13e0064100 0x7f13e00665c0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:37.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.780+0000 7f13fa284700 1 --2- 172.21.15.26:0/3231031348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13f40f6530 0x7f13f4106d80 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:37.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.780+0000 7f13fa284700 1 --2- 172.21.15.26:0/3231031348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13f40f77d0 0x7f13f4107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:17:37.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.780+0000 7f13fa284700 1 -- 172.21.15.26:0/3231031348 >> 172.21.15.26:0/3231031348 conn(0x7f13f40f1cd0 msgr2=0x7f13f40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:17:37.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.780+0000 7f13fa284700 1 -- 172.21.15.26:0/3231031348 shutdown_connections 2021-11-03T18:17:37.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.780+0000 7f13fa284700 1 -- 172.21.15.26:0/3231031348 wait complete. 2021-11-03T18:17:37.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.880+0000 7facd7bdc700 1 -- 172.21.15.26:0/949063968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facd00f6ff0 msgr2=0x7facd00f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:17:37.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.880+0000 7facd7bdc700 1 --2- 172.21.15.26:0/949063968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facd00f6ff0 0x7facd00f7a20 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7facc0004660 tx=0x7facc0009b30).stop 2021-11-03T18:17:37.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.881+0000 7facd7bdc700 1 -- 172.21.15.26:0/949063968 shutdown_connections 2021-11-03T18:17:37.882 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.881+0000 7facd7bdc700 1 --2- 172.21.15.26:0/949063968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facd00f6ff0 0x7facd00f7a20 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:37.882 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.881+0000 7facd7bdc700 1 --2- 172.21.15.26:0/949063968 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7facd00f66e0 0x7facd00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:37.882 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.881+0000 7facd7bdc700 1 -- 172.21.15.26:0/949063968 >> 172.21.15.26:0/949063968 conn(0x7facd00f1f00 msgr2=0x7facd00f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:17:37.882 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.881+0000 7facd7bdc700 1 -- 172.21.15.26:0/949063968 shutdown_connections 2021-11-03T18:17:37.883 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.881+0000 7facd7bdc700 1 -- 172.21.15.26:0/949063968 wait complete. 2021-11-03T18:17:37.883 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.881+0000 7facd7bdc700 1 Processor -- start 2021-11-03T18:17:37.883 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.881+0000 7facd7bdc700 1 -- start start 2021-11-03T18:17:37.883 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.881+0000 7facd7bdc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facd00f66e0 0x7facd0106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:17:37.883 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.881+0000 7facd7bdc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7facd00f6ff0 0x7facd0107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:17:37.884 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.881+0000 7facd7bdc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd0107a10 con 0x7facd00f66e0 2021-11-03T18:17:37.884 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.881+0000 7facd7bdc700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd0107b50 con 0x7facd00f6ff0 2021-11-03T18:17:37.884 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.882+0000 7facd5978700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facd00f66e0 0x7facd0106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:17:37.884 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.882+0000 7facd5978700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facd00f66e0 0x7facd0106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59228/0 (socket says 172.21.15.26:59228) 2021-11-03T18:17:37.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.882+0000 7facd5978700 1 -- 172.21.15.26:0/3749210527 learned_addr learned my addr 172.21.15.26:0/3749210527 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:17:37.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.882+0000 7facd5177700 1 --2- 172.21.15.26:0/3749210527 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7facd00f6ff0 0x7facd0107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:17:37.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.882+0000 7facd5978700 1 -- 172.21.15.26:0/3749210527 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7facd00f6ff0 msgr2=0x7facd0107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:17:37.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.882+0000 7facd5978700 1 --2- 172.21.15.26:0/3749210527 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7facd00f6ff0 0x7facd0107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:37.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.882+0000 7facd5978700 1 -- 172.21.15.26:0/3749210527 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc0005040 con 0x7facd00f66e0 2021-11-03T18:17:37.886 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.882+0000 7facd5177700 1 --2- 172.21.15.26:0/3749210527 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7facd00f6ff0 0x7facd0107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:17:37.886 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.882+0000 7facd5978700 1 --2- 172.21.15.26:0/3749210527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facd00f66e0 0x7facd0106f70 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7faccc00c530 tx=0x7faccc007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:17:37.886 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.882+0000 7facc67fc700 1 -- 172.21.15.26:0/3749210527 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faccc00f650 con 0x7facd00f66e0 2021-11-03T18:17:37.886 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.882+0000 7facc67fc700 1 -- 172.21.15.26:0/3749210527 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7faccc00fc60 con 0x7facd00f66e0 2021-11-03T18:17:37.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.882+0000 7facc67fc700 1 -- 172.21.15.26:0/3749210527 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faccc012cd0 con 0x7facd00f66e0 2021-11-03T18:17:37.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.882+0000 7facd7bdc700 1 -- 172.21.15.26:0/3749210527 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facd01084f0 con 0x7facd00f66e0 2021-11-03T18:17:37.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.882+0000 7facd7bdc700 1 -- 172.21.15.26:0/3749210527 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facd0108ab0 con 0x7facd00f66e0 2021-11-03T18:17:37.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.883+0000 7facd7bdc700 1 -- 172.21.15.26:0/3749210527 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facd0045ad0 con 0x7facd00f66e0 2021-11-03T18:17:37.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.884+0000 7facc67fc700 1 -- 172.21.15.26:0/3749210527 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7faccc010070 con 0x7facd00f66e0 2021-11-03T18:17:37.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.884+0000 7facc67fc700 1 --2- 172.21.15.26:0/3749210527 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7facbc0640b0 0x7facbc066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:17:37.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.884+0000 7facc67fc700 1 -- 172.21.15.26:0/3749210527 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7faccc080640 con 0x7facd00f66e0 2021-11-03T18:17:37.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.884+0000 7facd5177700 1 --2- 172.21.15.26:0/3749210527 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7facbc0640b0 0x7facbc066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:17:37.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.884+0000 7facd5177700 1 --2- 172.21.15.26:0/3749210527 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7facbc0640b0 0x7facbc066570 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7facc0009da0 tx=0x7facc0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:17:37.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:37.889+0000 7facc67fc700 1 -- 172.21.15.26:0/3749210527 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7faccc0528b0 con 0x7facd00f66e0 2021-11-03T18:17:38.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:38.094+0000 7facd7bdc700 1 -- 172.21.15.26:0/3749210527 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7facd0027a00 con 0x7facd00f66e0 2021-11-03T18:17:38.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:38.094+0000 7facc67fc700 1 -- 172.21.15.26:0/3749210527 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7faccc0524a0 con 0x7facd00f66e0 2021-11-03T18:17:38.094 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:17:38.094 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:17:38.094 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:17:38.094 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:17:38.095 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:17:38.095 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:17:38.095 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:17:38.095 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:17:38.096 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:17:38.096 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:17:38.096 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:17:38.096 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:17:38.096 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:17:38.097 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:17:38.097 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:17:38.097 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:17:38.097 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:17:38.098 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:17:38.098 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:17:38.098 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:17:38.098 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:17:38.098 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:17:38.099 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:17:38.099 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:17:38.099 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:17:38.099 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:17:38.099 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:17:38.100 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:17:38.100 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:17:38.100 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:17:38.100 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:17:38.101 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:17:38.101 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:17:38.101 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:17:38.101 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:17:38.101 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:17:38.102 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:17:38.102 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:17:38.102 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:17:38.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:38.096+0000 7facd7bdc700 1 -- 172.21.15.26:0/3749210527 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7facbc0640b0 msgr2=0x7facbc066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:17:38.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:38.096+0000 7facd7bdc700 1 --2- 172.21.15.26:0/3749210527 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7facbc0640b0 0x7facbc066570 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7facc0009da0 tx=0x7facc0009b30).stop 2021-11-03T18:17:38.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:38.096+0000 7facd7bdc700 1 -- 172.21.15.26:0/3749210527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facd00f66e0 msgr2=0x7facd0106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:17:38.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:38.096+0000 7facd7bdc700 1 --2- 172.21.15.26:0/3749210527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facd00f66e0 0x7facd0106f70 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7faccc00c530 tx=0x7faccc007e20).stop 2021-11-03T18:17:38.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:38.096+0000 7facd7bdc700 1 -- 172.21.15.26:0/3749210527 shutdown_connections 2021-11-03T18:17:38.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:38.096+0000 7facd7bdc700 1 --2- 172.21.15.26:0/3749210527 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7facbc0640b0 0x7facbc066570 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:38.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:38.096+0000 7facd7bdc700 1 --2- 172.21.15.26:0/3749210527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7facd00f66e0 0x7facd0106f70 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:38.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:38.096+0000 7facd7bdc700 1 --2- 172.21.15.26:0/3749210527 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7facd00f6ff0 0x7facd0107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:17:38.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:38.096+0000 7facd7bdc700 1 -- 172.21.15.26:0/3749210527 >> 172.21.15.26:0/3749210527 conn(0x7facd00f1f00 msgr2=0x7facd00fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:17:38.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:38.097+0000 7facd7bdc700 1 -- 172.21.15.26:0/3749210527 shutdown_connections 2021-11-03T18:17:38.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:17:38.097+0000 7facd7bdc700 1 -- 172.21.15.26:0/3749210527 wait complete. 2021-11-03T18:17:38.106 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:17:38.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:37 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3231031348' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:17:38.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:37 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3231031348' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:17:39.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:38 smithi026 ceph-mon[96795]: from='client.36700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:17:39.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:38 smithi026 ceph-mon[96795]: from='client.36704 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:17:39.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:38 smithi026 ceph-mon[96795]: pgmap v2489: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:39.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:38 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3749210527' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:17:39.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:38 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:17:39.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:38 smithi194 ceph-mon[65619]: from='client.36700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:17:39.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:38 smithi194 ceph-mon[65619]: from='client.36704 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:17:39.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:38 smithi194 ceph-mon[65619]: pgmap v2489: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:39.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:38 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3749210527' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:17:39.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:38 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:17:40.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:39 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:17:40.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:39 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:17:41.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:40 smithi026 ceph-mon[96795]: pgmap v2490: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:41.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:40 smithi194 ceph-mon[65619]: pgmap v2490: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:43.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:42 smithi026 ceph-mon[96795]: pgmap v2491: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:43.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:42 smithi194 ceph-mon[65619]: pgmap v2491: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:45.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:44 smithi026 ceph-mon[96795]: pgmap v2492: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:45.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:44 smithi194 ceph-mon[65619]: pgmap v2492: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:47.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:46 smithi026 ceph-mon[96795]: pgmap v2493: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:47.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:46 smithi194 ceph-mon[65619]: pgmap v2493: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:49.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:48 smithi026 ceph-mon[96795]: pgmap v2494: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:49.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:17:49.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:17:49.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:48 smithi194 ceph-mon[65619]: pgmap v2494: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:49.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:17:49.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:17:51.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:50 smithi026 ceph-mon[96795]: pgmap v2495: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:51.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:50 smithi194 ceph-mon[65619]: pgmap v2495: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:53.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:52 smithi026 ceph-mon[96795]: pgmap v2496: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:53.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:52 smithi194 ceph-mon[65619]: pgmap v2496: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:54.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:53 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:17:54.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:53 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:17:55.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:54 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:17:55.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:54 smithi026 ceph-mon[96795]: pgmap v2497: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:55.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:54 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:17:55.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:54 smithi194 ceph-mon[65619]: pgmap v2497: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:57.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:56 smithi026 ceph-mon[96795]: pgmap v2498: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:57.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:56 smithi194 ceph-mon[65619]: pgmap v2498: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:59.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:17:58 smithi026 ceph-mon[96795]: pgmap v2499: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:17:59.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:17:58 smithi194 ceph-mon[65619]: pgmap v2499: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:01.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:00 smithi026 ceph-mon[96795]: pgmap v2500: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:01.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:00 smithi194 ceph-mon[65619]: pgmap v2500: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:03.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:02 smithi026 ceph-mon[96795]: pgmap v2501: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:03.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:02 smithi194 ceph-mon[65619]: pgmap v2501: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:05.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:04 smithi026 ceph-mon[96795]: pgmap v2502: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:05.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:04 smithi194 ceph-mon[65619]: pgmap v2502: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:07.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:06 smithi026 ceph-mon[96795]: pgmap v2503: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:07.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:06 smithi194 ceph-mon[65619]: pgmap v2503: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:08.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.213+0000 7f7db3fff700 1 -- 172.21.15.26:0/1548812012 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7db40f77d0 msgr2=0x7f7db40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:18:08.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.213+0000 7f7db3fff700 1 --2- 172.21.15.26:0/1548812012 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7db40f77d0 0x7f7db40f7c30 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 rx=0x7f7d9c004660 tx=0x7f7d9c009b30).stop 2021-11-03T18:18:08.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.213+0000 7f7db3fff700 1 -- 172.21.15.26:0/1548812012 shutdown_connections 2021-11-03T18:18:08.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.213+0000 7f7db3fff700 1 --2- 172.21.15.26:0/1548812012 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7db40f77d0 0x7f7db40f7c30 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:08.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.213+0000 7f7db3fff700 1 --2- 172.21.15.26:0/1548812012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7db40f6530 0x7f7db40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:18:08.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.213+0000 7f7db3fff700 1 -- 172.21.15.26:0/1548812012 >> 172.21.15.26:0/1548812012 conn(0x7f7db40f1cd0 msgr2=0x7f7db40f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:18:08.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.213+0000 7f7db3fff700 1 -- 172.21.15.26:0/1548812012 shutdown_connections 2021-11-03T18:18:08.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.213+0000 7f7db3fff700 1 -- 172.21.15.26:0/1548812012 wait complete. 2021-11-03T18:18:08.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.213+0000 7f7db3fff700 1 Processor -- start 2021-11-03T18:18:08.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.213+0000 7f7db3fff700 1 -- start start 2021-11-03T18:18:08.216 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.214+0000 7f7db3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7db40f6530 0x7f7db4106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:18:08.216 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.214+0000 7f7db3fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7db40f77d0 0x7f7db4107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:18:08.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.214+0000 7f7db3fff700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db4107900 con 0x7f7db40f6530 2021-11-03T18:18:08.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.214+0000 7f7db3fff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db41080b0 con 0x7f7db40f77d0 2021-11-03T18:18:08.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.214+0000 7f7db2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7db40f6530 0x7f7db4106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:18:08.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.214+0000 7f7db2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7db40f6530 0x7f7db4106d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59248/0 (socket says 172.21.15.26:59248) 2021-11-03T18:18:08.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.214+0000 7f7db2ffd700 1 -- 172.21.15.26:0/1269575904 learned_addr learned my addr 172.21.15.26:0/1269575904 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:18:08.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.214+0000 7f7db27fc700 1 --2- 172.21.15.26:0/1269575904 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7db40f77d0 0x7f7db4107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:18:08.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.214+0000 7f7db2ffd700 1 -- 172.21.15.26:0/1269575904 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7db40f77d0 msgr2=0x7f7db4107270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:18:08.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.214+0000 7f7db2ffd700 1 --2- 172.21.15.26:0/1269575904 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7db40f77d0 0x7f7db4107270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:08.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.214+0000 7f7db2ffd700 1 -- 172.21.15.26:0/1269575904 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d9c005040 con 0x7f7db40f6530 2021-11-03T18:18:08.221 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.214+0000 7f7db2ffd700 1 --2- 172.21.15.26:0/1269575904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7db40f6530 0x7f7db4106d80 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 rx=0x7f7da400b790 tx=0x7f7da40092b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:18:08.221 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.214+0000 7f7dab7fe700 1 -- 172.21.15.26:0/1269575904 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7da400d680 con 0x7f7db40f6530 2021-11-03T18:18:08.222 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.214+0000 7f7db3fff700 1 -- 172.21.15.26:0/1269575904 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7db4108390 con 0x7f7db40f6530 2021-11-03T18:18:08.222 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.214+0000 7f7dab7fe700 1 -- 172.21.15.26:0/1269575904 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7da400dc90 con 0x7f7db40f6530 2021-11-03T18:18:08.222 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.215+0000 7f7dab7fe700 1 -- 172.21.15.26:0/1269575904 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7da4010cf0 con 0x7f7db40f6530 2021-11-03T18:18:08.223 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.215+0000 7f7db3fff700 1 -- 172.21.15.26:0/1269575904 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7db4108950 con 0x7f7db40f6530 2021-11-03T18:18:08.224 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.215+0000 7f7db3fff700 1 -- 172.21.15.26:0/1269575904 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7db4059100 con 0x7f7db40f6530 2021-11-03T18:18:08.224 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.216+0000 7f7dab7fe700 1 -- 172.21.15.26:0/1269575904 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f7da400f070 con 0x7f7db40f6530 2021-11-03T18:18:08.225 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.216+0000 7f7dab7fe700 1 --2- 172.21.15.26:0/1269575904 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7da0064100 0x7f7da00665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:18:08.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.216+0000 7f7dab7fe700 1 -- 172.21.15.26:0/1269575904 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f7da40806c0 con 0x7f7db40f6530 2021-11-03T18:18:08.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.216+0000 7f7db27fc700 1 --2- 172.21.15.26:0/1269575904 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7da0064100 0x7f7da00665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:18:08.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.217+0000 7f7db27fc700 1 --2- 172.21.15.26:0/1269575904 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7da0064100 0x7f7da00665c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7f7d9c004630 tx=0x7f7d9c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:18:08.227 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.221+0000 7f7dab7fe700 1 -- 172.21.15.26:0/1269575904 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f7da4052930 con 0x7f7db40f6530 2021-11-03T18:18:08.395 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.398+0000 7f7db3fff700 1 -- 172.21.15.26:0/1269575904 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7db40008d0 con 0x7f7da0064100 2021-11-03T18:18:08.396 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.399+0000 7f7dab7fe700 1 -- 172.21.15.26:0/1269575904 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f7db40008d0 con 0x7f7da0064100 2021-11-03T18:18:08.399 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.401+0000 7f7db3fff700 1 -- 172.21.15.26:0/1269575904 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7da0064100 msgr2=0x7f7da00665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:18:08.399 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.401+0000 7f7db3fff700 1 --2- 172.21.15.26:0/1269575904 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7da0064100 0x7f7da00665c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7f7d9c004630 tx=0x7f7d9c009b30).stop 2021-11-03T18:18:08.399 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.401+0000 7f7db3fff700 1 -- 172.21.15.26:0/1269575904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7db40f6530 msgr2=0x7f7db4106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:18:08.400 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.401+0000 7f7db3fff700 1 --2- 172.21.15.26:0/1269575904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7db40f6530 0x7f7db4106d80 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 rx=0x7f7da400b790 tx=0x7f7da40092b0).stop 2021-11-03T18:18:08.400 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.401+0000 7f7db3fff700 1 -- 172.21.15.26:0/1269575904 shutdown_connections 2021-11-03T18:18:08.400 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.401+0000 7f7db3fff700 1 --2- 172.21.15.26:0/1269575904 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7da0064100 0x7f7da00665c0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:08.400 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.401+0000 7f7db3fff700 1 --2- 172.21.15.26:0/1269575904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7db40f6530 0x7f7db4106d80 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:08.400 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.401+0000 7f7db3fff700 1 --2- 172.21.15.26:0/1269575904 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7db40f77d0 0x7f7db4107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:08.401 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.401+0000 7f7db3fff700 1 -- 172.21.15.26:0/1269575904 >> 172.21.15.26:0/1269575904 conn(0x7f7db40f1cd0 msgr2=0x7f7db40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:18:08.401 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.401+0000 7f7db3fff700 1 -- 172.21.15.26:0/1269575904 shutdown_connections 2021-11-03T18:18:08.401 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.401+0000 7f7db3fff700 1 -- 172.21.15.26:0/1269575904 wait complete. 2021-11-03T18:18:08.408 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:18:08.502 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.504+0000 7f99191c8700 1 -- 172.21.15.26:0/2242403624 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99140f55c0 msgr2=0x7f99140f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:18:08.502 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.504+0000 7f99191c8700 1 --2- 172.21.15.26:0/2242403624 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99140f55c0 0x7f99140f59e0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7f99040099e0 tx=0x7f9904004d10).stop 2021-11-03T18:18:08.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.504+0000 7f99191c8700 1 -- 172.21.15.26:0/2242403624 shutdown_connections 2021-11-03T18:18:08.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.504+0000 7f99191c8700 1 --2- 172.21.15.26:0/2242403624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99140f6860 0x7f99140f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:08.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.504+0000 7f99191c8700 1 --2- 172.21.15.26:0/2242403624 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99140f55c0 0x7f99140f59e0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:08.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.504+0000 7f99191c8700 1 -- 172.21.15.26:0/2242403624 >> 172.21.15.26:0/2242403624 conn(0x7f99140f0d20 msgr2=0x7f99140f3140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:18:08.504 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.504+0000 7f99191c8700 1 -- 172.21.15.26:0/2242403624 shutdown_connections 2021-11-03T18:18:08.504 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.504+0000 7f99191c8700 1 -- 172.21.15.26:0/2242403624 wait complete. 2021-11-03T18:18:08.506 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.505+0000 7f99191c8700 1 Processor -- start 2021-11-03T18:18:08.507 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.505+0000 7f99191c8700 1 -- start start 2021-11-03T18:18:08.507 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.505+0000 7f99191c8700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99140f55c0 0x7f9914109df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:18:08.507 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.505+0000 7f99191c8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99140f6860 0x7f991410c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:18:08.507 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.505+0000 7f99191c8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9914060520 con 0x7f99140f6860 2021-11-03T18:18:08.508 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.505+0000 7f99191c8700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9914060660 con 0x7f99140f55c0 2021-11-03T18:18:08.508 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.505+0000 7f991259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99140f6860 0x7f991410c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:18:08.508 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.505+0000 7f991259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99140f6860 0x7f991410c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59260/0 (socket says 172.21.15.26:59260) 2021-11-03T18:18:08.508 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.505+0000 7f991259c700 1 -- 172.21.15.26:0/483947537 learned_addr learned my addr 172.21.15.26:0/483947537 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:18:08.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.505+0000 7f9912d9d700 1 --2- 172.21.15.26:0/483947537 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99140f55c0 0x7f9914109df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:18:08.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.506+0000 7f991259c700 1 -- 172.21.15.26:0/483947537 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99140f55c0 msgr2=0x7f9914109df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:18:08.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.506+0000 7f991259c700 1 --2- 172.21.15.26:0/483947537 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99140f55c0 0x7f9914109df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:08.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.506+0000 7f991259c700 1 -- 172.21.15.26:0/483947537 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9904009640 con 0x7f99140f6860 2021-11-03T18:18:08.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.506+0000 7f991259c700 1 --2- 172.21.15.26:0/483947537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99140f6860 0x7f991410c2f0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 rx=0x7f98fc0026d0 tx=0x7f98fc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:18:08.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.506+0000 7f990b7fe700 1 -- 172.21.15.26:0/483947537 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98fc0079c0 con 0x7f99140f6860 2021-11-03T18:18:08.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.506+0000 7f990b7fe700 1 -- 172.21.15.26:0/483947537 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f98fc00f040 con 0x7f99140f6860 2021-11-03T18:18:08.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.506+0000 7f99191c8700 1 -- 172.21.15.26:0/483947537 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f991410c8a0 con 0x7f99140f6860 2021-11-03T18:18:08.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.506+0000 7f990b7fe700 1 -- 172.21.15.26:0/483947537 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98fc0148b0 con 0x7f99140f6860 2021-11-03T18:18:08.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.506+0000 7f99191c8700 1 -- 172.21.15.26:0/483947537 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f991410cdb0 con 0x7f99140f6860 2021-11-03T18:18:08.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.507+0000 7f99191c8700 1 -- 172.21.15.26:0/483947537 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99140f49b0 con 0x7f99140f6860 2021-11-03T18:18:08.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.507+0000 7f990b7fe700 1 -- 172.21.15.26:0/483947537 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f98fc014a10 con 0x7f99140f6860 2021-11-03T18:18:08.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.508+0000 7f990b7fe700 1 --2- 172.21.15.26:0/483947537 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f99000640b0 0x7f9900066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:18:08.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.508+0000 7f990b7fe700 1 -- 172.21.15.26:0/483947537 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f98fc080750 con 0x7f99140f6860 2021-11-03T18:18:08.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.508+0000 7f9912d9d700 1 --2- 172.21.15.26:0/483947537 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f99000640b0 0x7f9900066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:18:08.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.508+0000 7f9912d9d700 1 --2- 172.21.15.26:0/483947537 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f99000640b0 0x7f9900066570 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7f99040099b0 tx=0x7f9904004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:18:08.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.512+0000 7f990b7fe700 1 -- 172.21.15.26:0/483947537 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f98fc052ab0 con 0x7f99140f6860 2021-11-03T18:18:08.694 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.696+0000 7f99191c8700 1 -- 172.21.15.26:0/483947537 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f99140fdf00 con 0x7f99000640b0 2021-11-03T18:18:08.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.711+0000 7f990b7fe700 1 -- 172.21.15.26:0/483947537 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f99140fdf00 con 0x7f99000640b0 2021-11-03T18:18:08.709 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:18:08.710 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (89m) 8m ago 90m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:18:08.710 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (81m) 8m ago 90m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:18:08.710 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (81m) 7m ago 89m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:18:08.710 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (89m) 8m ago 90m 42.0M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:18:08.711 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (82m) 8m ago 85m 25.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:18:08.711 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (82m) 8m ago 85m 26.4M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:18:08.711 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (85m) 7m ago 85m 26.6M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:18:08.712 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (85m) 7m ago 85m 27.0M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:18:08.712 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (83m) 8m ago 91m 574M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:18:08.712 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (82m) 7m ago 89m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:18:08.712 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (82m) 8m ago 92m 308M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:18:08.713 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (82m) 7m ago 89m 145M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:18:08.713 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (90m) 8m ago 90m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:18:08.713 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (89m) 7m ago 89m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:18:08.713 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (81m) 8m ago 89m 312M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:18:08.713 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (80m) 8m ago 88m 335M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:18:08.714 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (80m) 8m ago 88m 279M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:18:08.714 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (79m) 7m ago 87m 362M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:18:08.714 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (79m) 7m ago 87m 302M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:18:08.715 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (78m) 7m ago 87m 296M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:18:08.715 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (89m) 8m ago 90m 63.4M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:18:08.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.713+0000 7f99191c8700 1 -- 172.21.15.26:0/483947537 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f99000640b0 msgr2=0x7f9900066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:18:08.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.713+0000 7f99191c8700 1 --2- 172.21.15.26:0/483947537 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f99000640b0 0x7f9900066570 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7f99040099b0 tx=0x7f9904004d10).stop 2021-11-03T18:18:08.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.713+0000 7f99191c8700 1 -- 172.21.15.26:0/483947537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99140f6860 msgr2=0x7f991410c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:18:08.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.713+0000 7f99191c8700 1 --2- 172.21.15.26:0/483947537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99140f6860 0x7f991410c2f0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 rx=0x7f98fc0026d0 tx=0x7f98fc009de0).stop 2021-11-03T18:18:08.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.713+0000 7f99191c8700 1 -- 172.21.15.26:0/483947537 shutdown_connections 2021-11-03T18:18:08.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.713+0000 7f99191c8700 1 --2- 172.21.15.26:0/483947537 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f99000640b0 0x7f9900066570 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:08.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.713+0000 7f99191c8700 1 --2- 172.21.15.26:0/483947537 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99140f55c0 0x7f9914109df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:08.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.713+0000 7f99191c8700 1 --2- 172.21.15.26:0/483947537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99140f6860 0x7f991410c2f0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:08.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.713+0000 7f99191c8700 1 -- 172.21.15.26:0/483947537 >> 172.21.15.26:0/483947537 conn(0x7f99140f0d20 msgr2=0x7f99140fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:18:08.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.713+0000 7f99191c8700 1 -- 172.21.15.26:0/483947537 shutdown_connections 2021-11-03T18:18:08.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.713+0000 7f99191c8700 1 -- 172.21.15.26:0/483947537 wait complete. 2021-11-03T18:18:08.817 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.818+0000 7f0911b0b700 1 -- 172.21.15.26:0/3974452928 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f090c0f55c0 msgr2=0x7f090c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:18:08.818 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.818+0000 7f0911b0b700 1 --2- 172.21.15.26:0/3974452928 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f090c0f55c0 0x7f090c0f59e0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 rx=0x7f09040099e0 tx=0x7f0904004d10).stop 2021-11-03T18:18:08.818 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.818+0000 7f0911b0b700 1 -- 172.21.15.26:0/3974452928 shutdown_connections 2021-11-03T18:18:08.819 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.818+0000 7f0911b0b700 1 --2- 172.21.15.26:0/3974452928 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f090c0f6860 0x7f090c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:08.819 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.818+0000 7f0911b0b700 1 --2- 172.21.15.26:0/3974452928 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f090c0f55c0 0x7f090c0f59e0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:08.819 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.818+0000 7f0911b0b700 1 -- 172.21.15.26:0/3974452928 >> 172.21.15.26:0/3974452928 conn(0x7f090c0f0d40 msgr2=0x7f090c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:18:08.820 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.818+0000 7f0911b0b700 1 -- 172.21.15.26:0/3974452928 shutdown_connections 2021-11-03T18:18:08.820 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.818+0000 7f0911b0b700 1 -- 172.21.15.26:0/3974452928 wait complete. 2021-11-03T18:18:08.820 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.818+0000 7f0911b0b700 1 Processor -- start 2021-11-03T18:18:08.820 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.818+0000 7f0911b0b700 1 -- start start 2021-11-03T18:18:08.821 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.819+0000 7f0911b0b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f090c0f55c0 0x7f090c105f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:18:08.821 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.819+0000 7f0911b0b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f090c0f6860 0x7f090c106450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:18:08.821 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.819+0000 7f0911b0b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090c106a00 con 0x7f090c0f6860 2021-11-03T18:18:08.821 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.819+0000 7f0911b0b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090c106b40 con 0x7f090c0f55c0 2021-11-03T18:18:08.822 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.819+0000 7f090affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f090c0f6860 0x7f090c106450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:18:08.822 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.819+0000 7f090affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f090c0f6860 0x7f090c106450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59270/0 (socket says 172.21.15.26:59270) 2021-11-03T18:18:08.822 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.819+0000 7f090affd700 1 -- 172.21.15.26:0/2078234739 learned_addr learned my addr 172.21.15.26:0/2078234739 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:18:08.822 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.819+0000 7f090b7fe700 1 --2- 172.21.15.26:0/2078234739 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f090c0f55c0 0x7f090c105f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:18:08.822 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.819+0000 7f090affd700 1 -- 172.21.15.26:0/2078234739 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f090c0f55c0 msgr2=0x7f090c105f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:18:08.823 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.819+0000 7f090affd700 1 --2- 172.21.15.26:0/2078234739 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f090c0f55c0 0x7f090c105f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:08.823 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.819+0000 7f090affd700 1 -- 172.21.15.26:0/2078234739 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0904009640 con 0x7f090c0f6860 2021-11-03T18:18:08.823 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.819+0000 7f090affd700 1 --2- 172.21.15.26:0/2078234739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f090c0f6860 0x7f090c106450 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7f08f40026d0 tx=0x7f08f4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:18:08.823 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.819+0000 7f0903fff700 1 -- 172.21.15.26:0/2078234739 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08f40079c0 con 0x7f090c0f6860 2021-11-03T18:18:08.824 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.819+0000 7f0903fff700 1 -- 172.21.15.26:0/2078234739 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f08f400f040 con 0x7f090c0f6860 2021-11-03T18:18:08.824 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.819+0000 7f0911b0b700 1 -- 172.21.15.26:0/2078234739 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f090c1074e0 con 0x7f090c0f6860 2021-11-03T18:18:08.824 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.819+0000 7f0903fff700 1 -- 172.21.15.26:0/2078234739 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08f40148b0 con 0x7f090c0f6860 2021-11-03T18:18:08.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.819+0000 7f0911b0b700 1 -- 172.21.15.26:0/2078234739 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f090c107a20 con 0x7f090c0f6860 2021-11-03T18:18:08.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.821+0000 7f0911b0b700 1 -- 172.21.15.26:0/2078234739 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f090c045ad0 con 0x7f090c0f6860 2021-11-03T18:18:08.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.821+0000 7f0903fff700 1 -- 172.21.15.26:0/2078234739 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f08f4007b20 con 0x7f090c0f6860 2021-11-03T18:18:08.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.821+0000 7f0903fff700 1 --2- 172.21.15.26:0/2078234739 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f08f80640b0 0x7f08f8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:18:08.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.821+0000 7f0903fff700 1 -- 172.21.15.26:0/2078234739 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f08f4080740 con 0x7f090c0f6860 2021-11-03T18:18:08.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.821+0000 7f090b7fe700 1 --2- 172.21.15.26:0/2078234739 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f08f80640b0 0x7f08f8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:18:08.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.822+0000 7f090b7fe700 1 --2- 172.21.15.26:0/2078234739 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f08f80640b0 0x7f08f8066570 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f090400b730 tx=0x7f0904004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:18:08.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:08.825+0000 7f0903fff700 1 -- 172.21.15.26:0/2078234739 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f08f4052aa0 con 0x7f090c0f6860 2021-11-03T18:18:09.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.058+0000 7f0911b0b700 1 -- 172.21.15.26:0/2078234739 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f090c1080c0 con 0x7f090c0f6860 2021-11-03T18:18:09.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.058+0000 7f0903fff700 1 -- 172.21.15.26:0/2078234739 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f08f4052690 con 0x7f090c0f6860 2021-11-03T18:18:09.057 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:18:09.057 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:18:09.057 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:18:09.057 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:18:09.058 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:18:09.058 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:18:09.058 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:18:09.058 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:18:09.058 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:18:09.059 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:18:09.059 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:18:09.059 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:18:09.059 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:18:09.060 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:18:09.060 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:18:09.060 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:18:09.060 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:18:09.060 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:18:09.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.060+0000 7f0911b0b700 1 -- 172.21.15.26:0/2078234739 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f08f80640b0 msgr2=0x7f08f8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:18:09.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.060+0000 7f0911b0b700 1 --2- 172.21.15.26:0/2078234739 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f08f80640b0 0x7f08f8066570 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f090400b730 tx=0x7f0904004d10).stop 2021-11-03T18:18:09.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.060+0000 7f0911b0b700 1 -- 172.21.15.26:0/2078234739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f090c0f6860 msgr2=0x7f090c106450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:18:09.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.060+0000 7f0911b0b700 1 --2- 172.21.15.26:0/2078234739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f090c0f6860 0x7f090c106450 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7f08f40026d0 tx=0x7f08f4009de0).stop 2021-11-03T18:18:09.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.060+0000 7f0911b0b700 1 -- 172.21.15.26:0/2078234739 shutdown_connections 2021-11-03T18:18:09.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.060+0000 7f0911b0b700 1 --2- 172.21.15.26:0/2078234739 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f08f80640b0 0x7f08f8066570 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:09.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.060+0000 7f0911b0b700 1 --2- 172.21.15.26:0/2078234739 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f090c0f55c0 0x7f090c105f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:09.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.060+0000 7f0911b0b700 1 --2- 172.21.15.26:0/2078234739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f090c0f6860 0x7f090c106450 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:09.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.060+0000 7f0911b0b700 1 -- 172.21.15.26:0/2078234739 >> 172.21.15.26:0/2078234739 conn(0x7f090c0f0d40 msgr2=0x7f090c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:18:09.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.060+0000 7f0911b0b700 1 -- 172.21.15.26:0/2078234739 shutdown_connections 2021-11-03T18:18:09.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.060+0000 7f0911b0b700 1 -- 172.21.15.26:0/2078234739 wait complete. 2021-11-03T18:18:09.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.160+0000 7f45550e8700 1 -- 172.21.15.26:0/3548579310 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45500f5ef0 msgr2=0x7f45500f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:18:09.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.160+0000 7f45550e8700 1 --2- 172.21.15.26:0/3548579310 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45500f5ef0 0x7f45500f6920 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7f4544004660 tx=0x7f4544009b30).stop 2021-11-03T18:18:09.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.160+0000 7f45550e8700 1 -- 172.21.15.26:0/3548579310 shutdown_connections 2021-11-03T18:18:09.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.160+0000 7f45550e8700 1 --2- 172.21.15.26:0/3548579310 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45500f5ef0 0x7f45500f6920 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:09.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.160+0000 7f45550e8700 1 --2- 172.21.15.26:0/3548579310 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45500f55e0 0x7f45500f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:09.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.160+0000 7f45550e8700 1 -- 172.21.15.26:0/3548579310 >> 172.21.15.26:0/3548579310 conn(0x7f45500f0de0 msgr2=0x7f45500f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:18:09.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.160+0000 7f45550e8700 1 -- 172.21.15.26:0/3548579310 shutdown_connections 2021-11-03T18:18:09.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.160+0000 7f45550e8700 1 -- 172.21.15.26:0/3548579310 wait complete. 2021-11-03T18:18:09.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.161+0000 7f45550e8700 1 Processor -- start 2021-11-03T18:18:09.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.161+0000 7f45550e8700 1 -- start start 2021-11-03T18:18:09.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.161+0000 7f45550e8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45500f55e0 0x7f4550109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:18:09.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.161+0000 7f45550e8700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45500f5ef0 0x7f455010c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:18:09.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.161+0000 7f45550e8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45500604e0 con 0x7f45500f55e0 2021-11-03T18:18:09.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.161+0000 7f45550e8700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4550060620 con 0x7f45500f5ef0 2021-11-03T18:18:09.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.161+0000 7f454ed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45500f55e0 0x7f4550109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:18:09.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.161+0000 7f454ed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45500f55e0 0x7f4550109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59278/0 (socket says 172.21.15.26:59278) 2021-11-03T18:18:09.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.161+0000 7f454ed9d700 1 -- 172.21.15.26:0/1669654669 learned_addr learned my addr 172.21.15.26:0/1669654669 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:18:09.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.162+0000 7f454e59c700 1 --2- 172.21.15.26:0/1669654669 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45500f5ef0 0x7f455010c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:18:09.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.162+0000 7f454ed9d700 1 -- 172.21.15.26:0/1669654669 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45500f5ef0 msgr2=0x7f455010c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:18:09.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.162+0000 7f454ed9d700 1 --2- 172.21.15.26:0/1669654669 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45500f5ef0 0x7f455010c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:09.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.162+0000 7f454ed9d700 1 -- 172.21.15.26:0/1669654669 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4544005040 con 0x7f45500f55e0 2021-11-03T18:18:09.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.162+0000 7f454e59c700 1 --2- 172.21.15.26:0/1669654669 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45500f5ef0 0x7f455010c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:18:09.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.162+0000 7f454ed9d700 1 --2- 172.21.15.26:0/1669654669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45500f55e0 0x7f4550109c90 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 rx=0x7f454000c530 tx=0x7f4540007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:18:09.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.162+0000 7f45377fe700 1 -- 172.21.15.26:0/1669654669 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f454000f650 con 0x7f45500f55e0 2021-11-03T18:18:09.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.162+0000 7f45377fe700 1 -- 172.21.15.26:0/1669654669 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f454000fc60 con 0x7f45500f55e0 2021-11-03T18:18:09.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.162+0000 7f45550e8700 1 -- 172.21.15.26:0/1669654669 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f455010c740 con 0x7f45500f55e0 2021-11-03T18:18:09.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.162+0000 7f45377fe700 1 -- 172.21.15.26:0/1669654669 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4540012cd0 con 0x7f45500f55e0 2021-11-03T18:18:09.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.162+0000 7f45550e8700 1 -- 172.21.15.26:0/1669654669 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f455010cd00 con 0x7f45500f55e0 2021-11-03T18:18:09.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.163+0000 7f45550e8700 1 -- 172.21.15.26:0/1669654669 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4550045ad0 con 0x7f45500f55e0 2021-11-03T18:18:09.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.163+0000 7f45377fe700 1 -- 172.21.15.26:0/1669654669 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f4540010070 con 0x7f45500f55e0 2021-11-03T18:18:09.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.164+0000 7f45377fe700 1 --2- 172.21.15.26:0/1669654669 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f45380640b0 0x7f4538066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:18:09.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.164+0000 7f45377fe700 1 -- 172.21.15.26:0/1669654669 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f45400806e0 con 0x7f45500f55e0 2021-11-03T18:18:09.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.164+0000 7f454e59c700 1 --2- 172.21.15.26:0/1669654669 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f45380640b0 0x7f4538066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:18:09.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.164+0000 7f454e59c700 1 --2- 172.21.15.26:0/1669654669 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f45380640b0 0x7f4538066570 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7f4544009da0 tx=0x7f4544009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:18:09.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.168+0000 7f45377fe700 1 -- 172.21.15.26:0/1669654669 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f4540052950 con 0x7f45500f55e0 2021-11-03T18:18:09.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:08 smithi026 ceph-mon[96795]: pgmap v2504: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:09.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:08 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:18:09.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:08 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2021-11-03T18:18:09.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:08 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi026", "name": "osd_memory_target"}]: dispatch 2021-11-03T18:18:09.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:08 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:18:09.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:08 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:18:09.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:08 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:18:09.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:08 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:18:09.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:08 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:18:09.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:08 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:18:09.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:08 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:18:09.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:08 smithi194 ceph-mon[65619]: pgmap v2504: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:09.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:08 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:18:09.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:08 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2021-11-03T18:18:09.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:08 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi026", "name": "osd_memory_target"}]: dispatch 2021-11-03T18:18:09.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:08 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:18:09.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:08 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:18:09.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:08 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:18:09.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:08 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:18:09.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:08 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:18:09.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:08 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:18:09.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:08 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:18:09.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.370+0000 7f45550e8700 1 -- 172.21.15.26:0/1669654669 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f45500fdea0 con 0x7f45500f55e0 2021-11-03T18:18:09.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.370+0000 7f45377fe700 1 -- 172.21.15.26:0/1669654669 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f4540052540 con 0x7f45500f55e0 2021-11-03T18:18:09.369 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:18:09.370 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:18:09.370 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:18:09.371 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:18:09.371 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:18:09.372 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:18:09.372 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:18:09.372 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:18:09.373 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:18:09.373 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:18:09.374 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:18:09.374 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:18:09.375 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:18:09.375 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:18:09.375 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:18:09.376 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:18:09.376 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:18:09.377 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:18:09.377 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:18:09.378 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:18:09.378 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:18:09.379 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:18:09.379 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:18:09.379 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:18:09.380 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:18:09.380 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:18:09.381 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:18:09.381 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:18:09.382 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:18:09.382 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:18:09.382 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:18:09.383 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:18:09.383 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:18:09.384 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:18:09.384 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:18:09.385 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:18:09.385 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:18:09.385 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:18:09.386 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:18:09.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.372+0000 7f45550e8700 1 -- 172.21.15.26:0/1669654669 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f45380640b0 msgr2=0x7f4538066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:18:09.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.372+0000 7f45550e8700 1 --2- 172.21.15.26:0/1669654669 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f45380640b0 0x7f4538066570 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7f4544009da0 tx=0x7f4544009b30).stop 2021-11-03T18:18:09.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.372+0000 7f45550e8700 1 -- 172.21.15.26:0/1669654669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45500f55e0 msgr2=0x7f4550109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:18:09.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.372+0000 7f45550e8700 1 --2- 172.21.15.26:0/1669654669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45500f55e0 0x7f4550109c90 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 rx=0x7f454000c530 tx=0x7f4540007e20).stop 2021-11-03T18:18:09.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.372+0000 7f45550e8700 1 -- 172.21.15.26:0/1669654669 shutdown_connections 2021-11-03T18:18:09.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.372+0000 7f45550e8700 1 --2- 172.21.15.26:0/1669654669 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f45380640b0 0x7f4538066570 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:09.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.372+0000 7f45550e8700 1 --2- 172.21.15.26:0/1669654669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45500f55e0 0x7f4550109c90 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:09.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.372+0000 7f45550e8700 1 --2- 172.21.15.26:0/1669654669 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45500f5ef0 0x7f455010c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:09.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.372+0000 7f45550e8700 1 -- 172.21.15.26:0/1669654669 >> 172.21.15.26:0/1669654669 conn(0x7f45500f0de0 msgr2=0x7f45500fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:18:09.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.372+0000 7f45550e8700 1 -- 172.21.15.26:0/1669654669 shutdown_connections 2021-11-03T18:18:09.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:09.372+0000 7f45550e8700 1 -- 172.21.15.26:0/1669654669 wait complete. 2021-11-03T18:18:09.392 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:18:10.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:09 smithi026 ceph-mon[96795]: from='client.36716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:18:10.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:09 smithi026 ceph-mon[96795]: poll took 60072.582 ms: 1 events 2021-11-03T18:18:10.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:09 smithi026 ceph-mon[96795]: from='client.36720 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:18:10.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:09 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:18:10.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:09 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:18:10.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:09 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2078234739' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:18:10.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:09 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1669654669' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:18:10.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:09 smithi194 ceph-mon[65619]: from='client.36716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:18:10.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:09 smithi194 ceph-mon[65619]: poll took 60072.582 ms: 1 events 2021-11-03T18:18:10.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:09 smithi194 ceph-mon[65619]: from='client.36720 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:18:10.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:09 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:18:10.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:09 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:18:10.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:09 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2078234739' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:18:10.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:09 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1669654669' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:18:11.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:10 smithi026 ceph-mon[96795]: pgmap v2505: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:11.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:10 smithi194 ceph-mon[65619]: pgmap v2505: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:13.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:12 smithi026 ceph-mon[96795]: pgmap v2506: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:13.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:12 smithi194 ceph-mon[65619]: pgmap v2506: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:15.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:14 smithi026 ceph-mon[96795]: pgmap v2507: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:15.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:14 smithi194 ceph-mon[65619]: pgmap v2507: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:17.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:16 smithi026 ceph-mon[96795]: pgmap v2508: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:17.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:16 smithi194 ceph-mon[65619]: pgmap v2508: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:19.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:18 smithi026 ceph-mon[96795]: pgmap v2509: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:19.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:18 smithi194 ceph-mon[65619]: pgmap v2509: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:21.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:20 smithi026 ceph-mon[96795]: pgmap v2510: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:21.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:20 smithi194 ceph-mon[65619]: pgmap v2510: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:23.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:22 smithi026 ceph-mon[96795]: pgmap v2511: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:23.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:22 smithi194 ceph-mon[65619]: pgmap v2511: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:24.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:23 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:18:24.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:23 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:18:25.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:24 smithi026 ceph-mon[96795]: pgmap v2512: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:25.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:24 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:18:25.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:24 smithi194 ceph-mon[65619]: pgmap v2512: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:25.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:24 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:18:27.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:26 smithi026 ceph-mon[96795]: pgmap v2513: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:27.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:26 smithi194 ceph-mon[65619]: pgmap v2513: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:29.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:28 smithi026 ceph-mon[96795]: pgmap v2514: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:29.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:28 smithi194 ceph-mon[65619]: pgmap v2514: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:31.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:30 smithi026 ceph-mon[96795]: pgmap v2515: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:31.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:30 smithi194 ceph-mon[65619]: pgmap v2515: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:33.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:32 smithi026 ceph-mon[96795]: pgmap v2516: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:33.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:32 smithi194 ceph-mon[65619]: pgmap v2516: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:35.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:34 smithi026 ceph-mon[96795]: pgmap v2517: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:35.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:34 smithi194 ceph-mon[65619]: pgmap v2517: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:37.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:36 smithi026 ceph-mon[96795]: pgmap v2518: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:37.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:36 smithi194 ceph-mon[65619]: pgmap v2518: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:39.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:38 smithi026 ceph-mon[96795]: pgmap v2519: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:39.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:38 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:18:39.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:38 smithi194 ceph-mon[65619]: pgmap v2519: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:39.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:38 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:18:39.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.487+0000 7f64b359e700 1 -- 172.21.15.26:0/2049684682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64b40f5440 msgr2=0x7f64b40f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:18:39.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.487+0000 7f64b359e700 1 --2- 172.21.15.26:0/2049684682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64b40f5440 0x7f64b40f5860 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 rx=0x7f64a4004660 tx=0x7f64a4009b30).stop 2021-11-03T18:18:39.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.488+0000 7f64b359e700 1 -- 172.21.15.26:0/2049684682 shutdown_connections 2021-11-03T18:18:39.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.488+0000 7f64b359e700 1 --2- 172.21.15.26:0/2049684682 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64b40f66e0 0x7f64b40f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:39.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.488+0000 7f64b359e700 1 --2- 172.21.15.26:0/2049684682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64b40f5440 0x7f64b40f5860 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:39.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.488+0000 7f64b359e700 1 -- 172.21.15.26:0/2049684682 >> 172.21.15.26:0/2049684682 conn(0x7f64b40f0ba0 msgr2=0x7f64b40f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:18:39.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.488+0000 7f64b359e700 1 -- 172.21.15.26:0/2049684682 shutdown_connections 2021-11-03T18:18:39.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.488+0000 7f64b359e700 1 -- 172.21.15.26:0/2049684682 wait complete. 2021-11-03T18:18:39.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.488+0000 7f64b359e700 1 Processor -- start 2021-11-03T18:18:39.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.488+0000 7f64b359e700 1 -- start start 2021-11-03T18:18:39.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.488+0000 7f64b359e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64b40f5440 0x7f64b40f9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:18:39.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.488+0000 7f64b359e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64b40f66e0 0x7f64b40f8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:18:39.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.488+0000 7f64b359e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b40f87a0 con 0x7f64b40f5440 2021-11-03T18:18:39.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.488+0000 7f64b359e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b40f88e0 con 0x7f64b40f66e0 2021-11-03T18:18:39.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.489+0000 7f64b259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64b40f5440 0x7f64b40f9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:18:39.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.489+0000 7f64b259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64b40f5440 0x7f64b40f9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59296/0 (socket says 172.21.15.26:59296) 2021-11-03T18:18:39.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.489+0000 7f64b259c700 1 -- 172.21.15.26:0/2140781064 learned_addr learned my addr 172.21.15.26:0/2140781064 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:18:39.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.489+0000 7f64b1d9b700 1 --2- 172.21.15.26:0/2140781064 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64b40f66e0 0x7f64b40f8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:18:39.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.489+0000 7f64b259c700 1 -- 172.21.15.26:0/2140781064 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64b40f66e0 msgr2=0x7f64b40f8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:18:39.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.489+0000 7f64b259c700 1 --2- 172.21.15.26:0/2140781064 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64b40f66e0 0x7f64b40f8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:39.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.489+0000 7f64b259c700 1 -- 172.21.15.26:0/2140781064 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a4005040 con 0x7f64b40f5440 2021-11-03T18:18:39.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.489+0000 7f64b259c700 1 --2- 172.21.15.26:0/2140781064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64b40f5440 0x7f64b40f9dc0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 rx=0x7f64a4004f60 tx=0x7f64a4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:18:39.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.489+0000 7f64a2ffd700 1 -- 172.21.15.26:0/2140781064 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64a4018070 con 0x7f64b40f5440 2021-11-03T18:18:39.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.489+0000 7f64a2ffd700 1 -- 172.21.15.26:0/2140781064 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f64a4007ba0 con 0x7f64b40f5440 2021-11-03T18:18:39.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.489+0000 7f64a2ffd700 1 -- 172.21.15.26:0/2140781064 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64a401c620 con 0x7f64b40f5440 2021-11-03T18:18:39.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.489+0000 7f64b359e700 1 -- 172.21.15.26:0/2140781064 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64b40f8b60 con 0x7f64b40f5440 2021-11-03T18:18:39.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.489+0000 7f64b359e700 1 -- 172.21.15.26:0/2140781064 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64b40f90c0 con 0x7f64b40f5440 2021-11-03T18:18:39.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.490+0000 7f64b359e700 1 -- 172.21.15.26:0/2140781064 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64b4045ad0 con 0x7f64b40f5440 2021-11-03T18:18:39.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.491+0000 7f64a2ffd700 1 -- 172.21.15.26:0/2140781064 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f64a401d420 con 0x7f64b40f5440 2021-11-03T18:18:39.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.491+0000 7f64a2ffd700 1 --2- 172.21.15.26:0/2140781064 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f649c064100 0x7f649c0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:18:39.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.491+0000 7f64a2ffd700 1 -- 172.21.15.26:0/2140781064 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f64a4082620 con 0x7f64b40f5440 2021-11-03T18:18:39.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.491+0000 7f64b1d9b700 1 --2- 172.21.15.26:0/2140781064 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f649c064100 0x7f649c0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:18:39.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.491+0000 7f64b1d9b700 1 --2- 172.21.15.26:0/2140781064 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f649c064100 0x7f649c0665c0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7f64a80049e0 tx=0x7f64a8009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:18:39.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.495+0000 7f64a2ffd700 1 -- 172.21.15.26:0/2140781064 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f64a4054a40 con 0x7f64b40f5440 2021-11-03T18:18:39.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.676+0000 7f64b359e700 1 -- 172.21.15.26:0/2140781064 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f64b405fd30 con 0x7f649c064100 2021-11-03T18:18:39.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.677+0000 7f64a2ffd700 1 -- 172.21.15.26:0/2140781064 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f64b405fd30 con 0x7f649c064100 2021-11-03T18:18:39.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.679+0000 7f64b359e700 1 -- 172.21.15.26:0/2140781064 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f649c064100 msgr2=0x7f649c0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:18:39.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.679+0000 7f64b359e700 1 --2- 172.21.15.26:0/2140781064 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f649c064100 0x7f649c0665c0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7f64a80049e0 tx=0x7f64a8009040).stop 2021-11-03T18:18:39.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.679+0000 7f64b359e700 1 -- 172.21.15.26:0/2140781064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64b40f5440 msgr2=0x7f64b40f9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:18:39.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.679+0000 7f64b359e700 1 --2- 172.21.15.26:0/2140781064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64b40f5440 0x7f64b40f9dc0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 rx=0x7f64a4004f60 tx=0x7f64a4009b30).stop 2021-11-03T18:18:39.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.679+0000 7f64b359e700 1 -- 172.21.15.26:0/2140781064 shutdown_connections 2021-11-03T18:18:39.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.679+0000 7f64b359e700 1 --2- 172.21.15.26:0/2140781064 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f649c064100 0x7f649c0665c0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:39.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.679+0000 7f64b359e700 1 --2- 172.21.15.26:0/2140781064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64b40f5440 0x7f64b40f9dc0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:39.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.679+0000 7f64b359e700 1 --2- 172.21.15.26:0/2140781064 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64b40f66e0 0x7f64b40f8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:39.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.679+0000 7f64b359e700 1 -- 172.21.15.26:0/2140781064 >> 172.21.15.26:0/2140781064 conn(0x7f64b40f0ba0 msgr2=0x7f64b405f620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:18:39.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.679+0000 7f64b359e700 1 -- 172.21.15.26:0/2140781064 shutdown_connections 2021-11-03T18:18:39.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.679+0000 7f64b359e700 1 -- 172.21.15.26:0/2140781064 wait complete. 2021-11-03T18:18:39.687 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:18:39.779 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.779+0000 7f85d05eb700 1 -- 172.21.15.26:0/17602859 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85c80f6ff0 msgr2=0x7f85c80f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:18:39.780 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.779+0000 7f85d05eb700 1 --2- 172.21.15.26:0/17602859 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85c80f6ff0 0x7f85c80f7a20 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 rx=0x7f85c4004660 tx=0x7f85c4009b30).stop 2021-11-03T18:18:39.780 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.779+0000 7f85d05eb700 1 -- 172.21.15.26:0/17602859 shutdown_connections 2021-11-03T18:18:39.780 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.779+0000 7f85d05eb700 1 --2- 172.21.15.26:0/17602859 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85c80f6ff0 0x7f85c80f7a20 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:39.780 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.779+0000 7f85d05eb700 1 --2- 172.21.15.26:0/17602859 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85c80f66e0 0x7f85c80f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:39.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.779+0000 7f85d05eb700 1 -- 172.21.15.26:0/17602859 >> 172.21.15.26:0/17602859 conn(0x7f85c80f1f00 msgr2=0x7f85c80f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:18:39.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.779+0000 7f85d05eb700 1 -- 172.21.15.26:0/17602859 shutdown_connections 2021-11-03T18:18:39.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.779+0000 7f85d05eb700 1 -- 172.21.15.26:0/17602859 wait complete. 2021-11-03T18:18:39.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.779+0000 7f85d05eb700 1 Processor -- start 2021-11-03T18:18:39.782 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.779+0000 7f85d05eb700 1 -- start start 2021-11-03T18:18:39.782 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.779+0000 7f85d05eb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85c80f66e0 0x7f85c806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:18:39.782 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.779+0000 7f85d05eb700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85c80f6ff0 0x7f85c8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:18:39.782 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.780+0000 7f85d05eb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c806a380 con 0x7f85c80f66e0 2021-11-03T18:18:39.783 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.780+0000 7f85d05eb700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c806a4c0 con 0x7f85c80f6ff0 2021-11-03T18:18:39.783 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.780+0000 7f85ce387700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85c80f66e0 0x7f85c806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:18:39.783 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.780+0000 7f85ce387700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85c80f66e0 0x7f85c806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59306/0 (socket says 172.21.15.26:59306) 2021-11-03T18:18:39.783 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.780+0000 7f85ce387700 1 -- 172.21.15.26:0/2985422146 learned_addr learned my addr 172.21.15.26:0/2985422146 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:18:39.784 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.780+0000 7f85cdb86700 1 --2- 172.21.15.26:0/2985422146 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85c80f6ff0 0x7f85c8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:18:39.784 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.780+0000 7f85ce387700 1 -- 172.21.15.26:0/2985422146 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85c80f6ff0 msgr2=0x7f85c8069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:18:39.784 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.780+0000 7f85ce387700 1 --2- 172.21.15.26:0/2985422146 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85c80f6ff0 0x7f85c8069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:39.784 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.780+0000 7f85ce387700 1 -- 172.21.15.26:0/2985422146 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c4005040 con 0x7f85c80f66e0 2021-11-03T18:18:39.784 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.780+0000 7f85ce387700 1 --2- 172.21.15.26:0/2985422146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85c80f66e0 0x7f85c806b9a0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 rx=0x7f85b800c530 tx=0x7f85b8007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:18:39.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.780+0000 7f85beffd700 1 -- 172.21.15.26:0/2985422146 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85b800f650 con 0x7f85c80f66e0 2021-11-03T18:18:39.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.780+0000 7f85beffd700 1 -- 172.21.15.26:0/2985422146 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f85b800fc60 con 0x7f85c80f66e0 2021-11-03T18:18:39.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.780+0000 7f85d05eb700 1 -- 172.21.15.26:0/2985422146 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c806a7a0 con 0x7f85c80f66e0 2021-11-03T18:18:39.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.780+0000 7f85beffd700 1 -- 172.21.15.26:0/2985422146 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85b8012cd0 con 0x7f85c80f66e0 2021-11-03T18:18:39.786 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.780+0000 7f85d05eb700 1 -- 172.21.15.26:0/2985422146 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c810efa0 con 0x7f85c80f66e0 2021-11-03T18:18:39.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.781+0000 7f85d05eb700 1 -- 172.21.15.26:0/2985422146 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c8045ad0 con 0x7f85c80f66e0 2021-11-03T18:18:39.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.782+0000 7f85beffd700 1 -- 172.21.15.26:0/2985422146 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f85b8010070 con 0x7f85c80f66e0 2021-11-03T18:18:39.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.782+0000 7f85beffd700 1 --2- 172.21.15.26:0/2985422146 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85b4064090 0x7f85b4066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:18:39.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.782+0000 7f85beffd700 1 -- 172.21.15.26:0/2985422146 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f85b8080640 con 0x7f85c80f66e0 2021-11-03T18:18:39.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.782+0000 7f85cdb86700 1 --2- 172.21.15.26:0/2985422146 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85b4064090 0x7f85b4066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:18:39.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.783+0000 7f85cdb86700 1 --2- 172.21.15.26:0/2985422146 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85b4064090 0x7f85b4066550 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7f85c4004e30 tx=0x7f85c4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:18:39.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.787+0000 7f85beffd700 1 -- 172.21.15.26:0/2985422146 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f85b80528b0 con 0x7f85c80f66e0 2021-11-03T18:18:39.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.961+0000 7f85d05eb700 1 -- 172.21.15.26:0/2985422146 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f85c80ff010 con 0x7f85b4064090 2021-11-03T18:18:39.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.976+0000 7f85beffd700 1 -- 172.21.15.26:0/2985422146 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f85c80ff010 con 0x7f85b4064090 2021-11-03T18:18:39.975 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:18:39.975 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (89m) 8m ago 91m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:18:39.975 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (82m) 8m ago 91m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:18:39.976 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (81m) 7m ago 90m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:18:39.976 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (89m) 8m ago 90m 42.0M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:18:39.976 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (82m) 8m ago 86m 25.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:18:39.976 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (83m) 8m ago 86m 26.4M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:18:39.977 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (86m) 7m ago 86m 26.6M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:18:39.977 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (86m) 7m ago 86m 27.0M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:18:39.977 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (83m) 8m ago 92m 574M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:18:39.977 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (83m) 7m ago 90m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:18:39.977 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (83m) 8m ago 92m 308M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:18:39.978 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (82m) 7m ago 90m 145M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:18:39.978 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (90m) 8m ago 90m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:18:39.978 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (90m) 7m ago 90m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:18:39.978 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (81m) 8m ago 89m 312M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:18:39.979 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (81m) 8m ago 89m 335M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:18:39.979 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (80m) 8m ago 88m 279M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:18:39.979 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (80m) 7m ago 88m 362M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:18:39.979 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (79m) 7m ago 88m 302M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:18:39.979 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (79m) 7m ago 87m 296M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:18:39.980 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (89m) 8m ago 90m 63.4M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:18:39.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.978+0000 7f85d05eb700 1 -- 172.21.15.26:0/2985422146 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85b4064090 msgr2=0x7f85b4066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:18:39.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.978+0000 7f85d05eb700 1 --2- 172.21.15.26:0/2985422146 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85b4064090 0x7f85b4066550 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7f85c4004e30 tx=0x7f85c4009b30).stop 2021-11-03T18:18:39.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.978+0000 7f85d05eb700 1 -- 172.21.15.26:0/2985422146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85c80f66e0 msgr2=0x7f85c806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:18:39.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.978+0000 7f85d05eb700 1 --2- 172.21.15.26:0/2985422146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85c80f66e0 0x7f85c806b9a0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 rx=0x7f85b800c530 tx=0x7f85b8007e20).stop 2021-11-03T18:18:39.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.978+0000 7f85d05eb700 1 -- 172.21.15.26:0/2985422146 shutdown_connections 2021-11-03T18:18:39.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.978+0000 7f85d05eb700 1 --2- 172.21.15.26:0/2985422146 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f85b4064090 0x7f85b4066550 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:39.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.978+0000 7f85d05eb700 1 --2- 172.21.15.26:0/2985422146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85c80f66e0 0x7f85c806b9a0 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:39.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.978+0000 7f85d05eb700 1 --2- 172.21.15.26:0/2985422146 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85c80f6ff0 0x7f85c8069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:39.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.978+0000 7f85d05eb700 1 -- 172.21.15.26:0/2985422146 >> 172.21.15.26:0/2985422146 conn(0x7f85c80f1f00 msgr2=0x7f85c80fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:18:39.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.978+0000 7f85d05eb700 1 -- 172.21.15.26:0/2985422146 shutdown_connections 2021-11-03T18:18:39.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:39.978+0000 7f85d05eb700 1 -- 172.21.15.26:0/2985422146 wait complete. 2021-11-03T18:18:40.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.077+0000 7f95af646700 1 -- 172.21.15.26:0/3721650451 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95a80f55e0 msgr2=0x7f95a80f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:18:40.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.077+0000 7f95af646700 1 --2- 172.21.15.26:0/3721650451 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95a80f55e0 0x7f95a80f5a00 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 rx=0x7f9598004660 tx=0x7f9598009b30).stop 2021-11-03T18:18:40.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.077+0000 7f95af646700 1 -- 172.21.15.26:0/3721650451 shutdown_connections 2021-11-03T18:18:40.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.077+0000 7f95af646700 1 --2- 172.21.15.26:0/3721650451 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95a80f5ef0 0x7f95a80f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:40.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.077+0000 7f95af646700 1 --2- 172.21.15.26:0/3721650451 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95a80f55e0 0x7f95a80f5a00 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:40.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.077+0000 7f95af646700 1 -- 172.21.15.26:0/3721650451 >> 172.21.15.26:0/3721650451 conn(0x7f95a80f0de0 msgr2=0x7f95a80f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:18:40.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.077+0000 7f95af646700 1 -- 172.21.15.26:0/3721650451 shutdown_connections 2021-11-03T18:18:40.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.077+0000 7f95af646700 1 -- 172.21.15.26:0/3721650451 wait complete. 2021-11-03T18:18:40.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.078+0000 7f95af646700 1 Processor -- start 2021-11-03T18:18:40.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.078+0000 7f95af646700 1 -- start start 2021-11-03T18:18:40.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.078+0000 7f95af646700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95a80f55e0 0x7f95a80fa000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:18:40.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.078+0000 7f95af646700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95a80f5ef0 0x7f95a80f8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:18:40.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.078+0000 7f95af646700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a80f89e0 con 0x7f95a80f55e0 2021-11-03T18:18:40.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.078+0000 7f95af646700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a80f8b20 con 0x7f95a80f5ef0 2021-11-03T18:18:40.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.078+0000 7f95ad3e2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95a80f55e0 0x7f95a80fa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:18:40.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.078+0000 7f95ad3e2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95a80f55e0 0x7f95a80fa000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59316/0 (socket says 172.21.15.26:59316) 2021-11-03T18:18:40.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.078+0000 7f95ad3e2700 1 -- 172.21.15.26:0/3990732768 learned_addr learned my addr 172.21.15.26:0/3990732768 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:18:40.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.078+0000 7f95acbe1700 1 --2- 172.21.15.26:0/3990732768 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95a80f5ef0 0x7f95a80f8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:18:40.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.078+0000 7f95ad3e2700 1 -- 172.21.15.26:0/3990732768 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95a80f5ef0 msgr2=0x7f95a80f8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:18:40.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.078+0000 7f95ad3e2700 1 --2- 172.21.15.26:0/3990732768 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95a80f5ef0 0x7f95a80f8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:40.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.078+0000 7f95ad3e2700 1 -- 172.21.15.26:0/3990732768 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9598005040 con 0x7f95a80f55e0 2021-11-03T18:18:40.085 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.079+0000 7f95ad3e2700 1 --2- 172.21.15.26:0/3990732768 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95a80f55e0 0x7f95a80fa000 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 rx=0x7f9598009990 tx=0x7f9598009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:18:40.085 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.079+0000 7f959dffb700 1 -- 172.21.15.26:0/3990732768 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9598018070 con 0x7f95a80f55e0 2021-11-03T18:18:40.085 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.079+0000 7f959dffb700 1 -- 172.21.15.26:0/3990732768 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9598007ba0 con 0x7f95a80f55e0 2021-11-03T18:18:40.085 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.079+0000 7f95af646700 1 -- 172.21.15.26:0/3990732768 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95a80f8da0 con 0x7f95a80f55e0 2021-11-03T18:18:40.085 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.079+0000 7f959dffb700 1 -- 172.21.15.26:0/3990732768 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f959801c3c0 con 0x7f95a80f55e0 2021-11-03T18:18:40.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.079+0000 7f95af646700 1 -- 172.21.15.26:0/3990732768 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95a80f9300 con 0x7f95a80f55e0 2021-11-03T18:18:40.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.080+0000 7f95af646700 1 -- 172.21.15.26:0/3990732768 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95a8045ad0 con 0x7f95a80f55e0 2021-11-03T18:18:40.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.080+0000 7f959dffb700 1 -- 172.21.15.26:0/3990732768 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f959801d420 con 0x7f95a80f55e0 2021-11-03T18:18:40.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.081+0000 7f959dffb700 1 --2- 172.21.15.26:0/3990732768 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f95940640b0 0x7f9594066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:18:40.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.081+0000 7f959dffb700 1 -- 172.21.15.26:0/3990732768 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f95980825c0 con 0x7f95a80f55e0 2021-11-03T18:18:40.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.081+0000 7f95acbe1700 1 --2- 172.21.15.26:0/3990732768 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f95940640b0 0x7f9594066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:18:40.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.081+0000 7f95acbe1700 1 --2- 172.21.15.26:0/3990732768 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f95940640b0 0x7f9594066570 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7f95a4009880 tx=0x7f95a400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:18:40.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.085+0000 7f959dffb700 1 -- 172.21.15.26:0/3990732768 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f95980548c0 con 0x7f95a80f55e0 2021-11-03T18:18:40.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:39 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:18:40.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:39 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:18:40.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.319+0000 7f95af646700 1 -- 172.21.15.26:0/3990732768 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f95a810f660 con 0x7f95a80f55e0 2021-11-03T18:18:40.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.319+0000 7f959dffb700 1 -- 172.21.15.26:0/3990732768 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f95980544b0 con 0x7f95a80f55e0 2021-11-03T18:18:40.319 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:18:40.319 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:18:40.319 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:18:40.320 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:18:40.320 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:18:40.320 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:18:40.320 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:18:40.321 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:18:40.321 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:18:40.321 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:18:40.321 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:18:40.322 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:18:40.322 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:18:40.322 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:18:40.322 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:18:40.323 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:18:40.323 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:18:40.323 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:18:40.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.321+0000 7f95af646700 1 -- 172.21.15.26:0/3990732768 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f95940640b0 msgr2=0x7f9594066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:18:40.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.321+0000 7f95af646700 1 --2- 172.21.15.26:0/3990732768 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f95940640b0 0x7f9594066570 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7f95a4009880 tx=0x7f95a400b040).stop 2021-11-03T18:18:40.325 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.321+0000 7f95af646700 1 -- 172.21.15.26:0/3990732768 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95a80f55e0 msgr2=0x7f95a80fa000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:18:40.325 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.321+0000 7f95af646700 1 --2- 172.21.15.26:0/3990732768 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95a80f55e0 0x7f95a80fa000 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 rx=0x7f9598009990 tx=0x7f9598009b30).stop 2021-11-03T18:18:40.325 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.321+0000 7f95af646700 1 -- 172.21.15.26:0/3990732768 shutdown_connections 2021-11-03T18:18:40.325 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.321+0000 7f95af646700 1 --2- 172.21.15.26:0/3990732768 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f95940640b0 0x7f9594066570 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:40.326 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.321+0000 7f95af646700 1 --2- 172.21.15.26:0/3990732768 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95a80f55e0 0x7f95a80fa000 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:40.326 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.321+0000 7f95af646700 1 --2- 172.21.15.26:0/3990732768 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95a80f5ef0 0x7f95a80f8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:40.326 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.321+0000 7f95af646700 1 -- 172.21.15.26:0/3990732768 >> 172.21.15.26:0/3990732768 conn(0x7f95a80f0de0 msgr2=0x7f95a805f740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:18:40.326 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.321+0000 7f95af646700 1 -- 172.21.15.26:0/3990732768 shutdown_connections 2021-11-03T18:18:40.326 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.321+0000 7f95af646700 1 -- 172.21.15.26:0/3990732768 wait complete. 2021-11-03T18:18:40.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.421+0000 7fcf37c9a700 1 -- 172.21.15.26:0/1413222467 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf300f66c0 msgr2=0x7fcf300f6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:18:40.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.421+0000 7fcf37c9a700 1 --2- 172.21.15.26:0/1413222467 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf300f66c0 0x7fcf300f6ae0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 rx=0x7fcf20004660 tx=0x7fcf20009b30).stop 2021-11-03T18:18:40.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.421+0000 7fcf37c9a700 1 -- 172.21.15.26:0/1413222467 shutdown_connections 2021-11-03T18:18:40.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.421+0000 7fcf37c9a700 1 --2- 172.21.15.26:0/1413222467 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf300f7960 0x7fcf300f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:40.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.421+0000 7fcf37c9a700 1 --2- 172.21.15.26:0/1413222467 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf300f66c0 0x7fcf300f6ae0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:40.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.421+0000 7fcf37c9a700 1 -- 172.21.15.26:0/1413222467 >> 172.21.15.26:0/1413222467 conn(0x7fcf300f1e20 msgr2=0x7fcf300f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:18:40.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.421+0000 7fcf37c9a700 1 -- 172.21.15.26:0/1413222467 shutdown_connections 2021-11-03T18:18:40.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.421+0000 7fcf37c9a700 1 -- 172.21.15.26:0/1413222467 wait complete. 2021-11-03T18:18:40.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.422+0000 7fcf37c9a700 1 Processor -- start 2021-11-03T18:18:40.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.422+0000 7fcf37c9a700 1 -- start start 2021-11-03T18:18:40.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.422+0000 7fcf37c9a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf300f66c0 0x7fcf30106f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:18:40.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.422+0000 7fcf37c9a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf300f7960 0x7fcf30107480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:18:40.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.422+0000 7fcf37c9a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf30107a30 con 0x7fcf300f66c0 2021-11-03T18:18:40.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.422+0000 7fcf37c9a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf30107b70 con 0x7fcf300f7960 2021-11-03T18:18:40.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.422+0000 7fcf35a36700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf300f66c0 0x7fcf30106f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:18:40.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.422+0000 7fcf35a36700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf300f66c0 0x7fcf30106f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59326/0 (socket says 172.21.15.26:59326) 2021-11-03T18:18:40.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.422+0000 7fcf35a36700 1 -- 172.21.15.26:0/3624792475 learned_addr learned my addr 172.21.15.26:0/3624792475 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:18:40.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.422+0000 7fcf35a36700 1 -- 172.21.15.26:0/3624792475 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf300f7960 msgr2=0x7fcf30107480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:18:40.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.422+0000 7fcf35a36700 1 --2- 172.21.15.26:0/3624792475 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf300f7960 0x7fcf30107480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:18:40.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.422+0000 7fcf35a36700 1 -- 172.21.15.26:0/3624792475 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf20005040 con 0x7fcf300f66c0 2021-11-03T18:18:40.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.422+0000 7fcf35a36700 1 --2- 172.21.15.26:0/3624792475 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf300f66c0 0x7fcf30106f90 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 rx=0x7fcf20013a70 tx=0x7fcf20009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:18:40.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.422+0000 7fcf267fc700 1 -- 172.21.15.26:0/3624792475 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf20018070 con 0x7fcf300f66c0 2021-11-03T18:18:40.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.423+0000 7fcf267fc700 1 -- 172.21.15.26:0/3624792475 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcf200097d0 con 0x7fcf300f66c0 2021-11-03T18:18:40.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.423+0000 7fcf37c9a700 1 -- 172.21.15.26:0/3624792475 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf301084b0 con 0x7fcf300f66c0 2021-11-03T18:18:40.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.423+0000 7fcf267fc700 1 -- 172.21.15.26:0/3624792475 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf2001c3c0 con 0x7fcf300f66c0 2021-11-03T18:18:40.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.423+0000 7fcf37c9a700 1 -- 172.21.15.26:0/3624792475 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf30108a10 con 0x7fcf300f66c0 2021-11-03T18:18:40.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.423+0000 7fcf37c9a700 1 -- 172.21.15.26:0/3624792475 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf30045ad0 con 0x7fcf300f66c0 2021-11-03T18:18:40.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.424+0000 7fcf267fc700 1 -- 172.21.15.26:0/3624792475 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fcf20007ba0 con 0x7fcf300f66c0 2021-11-03T18:18:40.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.424+0000 7fcf267fc700 1 --2- 172.21.15.26:0/3624792475 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcf1c0640b0 0x7fcf1c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:18:40.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.424+0000 7fcf267fc700 1 -- 172.21.15.26:0/3624792475 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fcf20082470 con 0x7fcf300f66c0 2021-11-03T18:18:40.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.424+0000 7fcf35235700 1 --2- 172.21.15.26:0/3624792475 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcf1c0640b0 0x7fcf1c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:18:40.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.425+0000 7fcf35235700 1 --2- 172.21.15.26:0/3624792475 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcf1c0640b0 0x7fcf1c066570 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7fcf2c004a10 tx=0x7fcf2c0099e0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:18:40.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.428+0000 7fcf267fc700 1 -- 172.21.15.26:0/3624792475 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fcf200547d0 con 0x7fcf300f66c0 2021-11-03T18:18:40.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.633+0000 7fcf37c9a700 1 -- 172.21.15.26:0/3624792475 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcf30027a00 con 0x7fcf300f66c0 2021-11-03T18:18:40.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.633+0000 7fcf267fc700 1 -- 172.21.15.26:0/3624792475 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fcf200543c0 con 0x7fcf300f66c0 2021-11-03T18:18:40.633 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:18:40.634 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:18:40.634 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:18:40.634 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:18:40.635 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:18:40.635 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:18:40.635 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:18:40.635 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:18:40.636 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:18:40.636 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:18:40.636 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:18:40.636 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:18:40.636 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:18:40.637 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:18:40.637 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:18:40.637 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:18:40.638 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:18:40.638 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:18:40.638 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:18:40.638 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:18:40.638 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:18:40.639 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:18:40.639 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:18:40.639 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:18:40.639 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:18:40.640 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:18:40.640 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:18:40.640 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:18:40.640 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:18:40.640 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:18:40.641 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:18:40.641 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:18:40.641 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:18:40.641 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:18:40.641 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:18:40.642 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:18:40.642 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:18:40.642 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:18:40.642 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:18:40.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.635+0000 7fcf37c9a700 1 -- 172.21.15.26:0/3624792475 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcf1c0640b0 msgr2=0x7fcf1c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:18:40.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.635+0000 7fcf37c9a700 1 --2- 172.21.15.26:0/3624792475 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcf1c0640b0 0x7fcf1c066570 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7fcf2c004a10 tx=0x7fcf2c0099e0).stop 2021-11-03T18:18:40.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.635+0000 7fcf37c9a700 1 -- 172.21.15.26:0/3624792475 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf300f66c0 msgr2=0x7fcf30106f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:18:40.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.635+0000 7fcf37c9a700 1 --2- 172.21.15.26:0/3624792475 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf300f66c0 0x7fcf30106f90 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 rx=0x7fcf20013a70 tx=0x7fcf20009b30).stop 2021-11-03T18:18:40.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.635+0000 7fcf37c9a700 1 -- 172.21.15.26:0/3624792475 shutdown_connections 2021-11-03T18:18:40.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.635+0000 7fcf37c9a700 1 --2- 172.21.15.26:0/3624792475 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcf1c0640b0 0x7fcf1c066570 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:40.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.635+0000 7fcf37c9a700 1 --2- 172.21.15.26:0/3624792475 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf300f66c0 0x7fcf30106f90 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:18:40.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.635+0000 7fcf37c9a700 1 --2- 172.21.15.26:0/3624792475 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf300f7960 0x7fcf30107480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:18:40.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.635+0000 7fcf37c9a700 1 -- 172.21.15.26:0/3624792475 >> 172.21.15.26:0/3624792475 conn(0x7fcf300f1e20 msgr2=0x7fcf300fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:18:40.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.635+0000 7fcf37c9a700 1 -- 172.21.15.26:0/3624792475 shutdown_connections 2021-11-03T18:18:40.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:18:40.635+0000 7fcf37c9a700 1 -- 172.21.15.26:0/3624792475 wait complete. 2021-11-03T18:18:40.646 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:18:41.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:40 smithi026 ceph-mon[96795]: from='client.36732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:18:41.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:40 smithi026 ceph-mon[96795]: pgmap v2520: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:41.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:40 smithi026 ceph-mon[96795]: from='client.36736 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:18:41.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:40 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3990732768' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:18:41.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:40 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3624792475' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:18:41.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:40 smithi194 ceph-mon[65619]: from='client.36732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:18:41.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:40 smithi194 ceph-mon[65619]: pgmap v2520: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:41.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:40 smithi194 ceph-mon[65619]: from='client.36736 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:18:41.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:40 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3990732768' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:18:41.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:40 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3624792475' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:18:43.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:42 smithi026 ceph-mon[96795]: pgmap v2521: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:43.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:42 smithi194 ceph-mon[65619]: pgmap v2521: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:45.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:44 smithi026 ceph-mon[96795]: pgmap v2522: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:45.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:44 smithi194 ceph-mon[65619]: pgmap v2522: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:47.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:46 smithi026 ceph-mon[96795]: pgmap v2523: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:47.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:46 smithi194 ceph-mon[65619]: pgmap v2523: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:49.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:48 smithi026 ceph-mon[96795]: pgmap v2524: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:49.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:18:49.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:18:49.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:48 smithi194 ceph-mon[65619]: pgmap v2524: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:49.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:18:49.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:18:51.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:50 smithi026 ceph-mon[96795]: pgmap v2525: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:51.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:50 smithi194 ceph-mon[65619]: pgmap v2525: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:53.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:52 smithi026 ceph-mon[96795]: pgmap v2526: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:53.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:52 smithi194 ceph-mon[65619]: pgmap v2526: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:54.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:53 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:18:54.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:53 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:18:55.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:54 smithi026 ceph-mon[96795]: pgmap v2527: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:55.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:54 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:18:55.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:54 smithi194 ceph-mon[65619]: pgmap v2527: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:55.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:54 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:18:57.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:56 smithi026 ceph-mon[96795]: pgmap v2528: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:57.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:56 smithi194 ceph-mon[65619]: pgmap v2528: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:59.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:18:58 smithi194 ceph-mon[65619]: pgmap v2529: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:18:59.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:18:58 smithi026 ceph-mon[96795]: pgmap v2529: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:01.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:00 smithi194 ceph-mon[65619]: pgmap v2530: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:01.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:00 smithi026 ceph-mon[96795]: pgmap v2530: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:03.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:02 smithi194 ceph-mon[65619]: pgmap v2531: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:03.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:02 smithi026 ceph-mon[96795]: pgmap v2531: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:05.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:04 smithi194 ceph-mon[65619]: pgmap v2532: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:05.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:04 smithi026 ceph-mon[96795]: pgmap v2532: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:07.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:06 smithi194 ceph-mon[65619]: pgmap v2533: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:07.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:06 smithi026 ceph-mon[96795]: pgmap v2533: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:09.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:08 smithi026 ceph-mon[96795]: pgmap v2534: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:09.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:08 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:19:09.175 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:08 smithi194 ceph-mon[65619]: pgmap v2534: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:09.175 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:08 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:19:10.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:09 smithi194 ceph-mon[65619]: poll took 60046.803 ms: 1 events 2021-11-03T18:19:10.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:09 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:19:10.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:09 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:19:10.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:09 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:19:10.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:09 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:19:10.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:09 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:19:10.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:09 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:19:10.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:09 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:19:10.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:09 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:19:10.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:09 smithi026 ceph-mon[96795]: poll took 60046.803 ms: 1 events 2021-11-03T18:19:10.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:09 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:19:10.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:09 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:19:10.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:09 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:19:10.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:09 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:19:10.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:09 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:19:10.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:09 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:19:10.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:09 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:19:10.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:09 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:19:10.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.751+0000 7f3d281ca700 1 -- 172.21.15.26:0/410927016 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d20060370 msgr2=0x7f3d200fb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:19:10.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.751+0000 7f3d281ca700 1 --2- 172.21.15.26:0/410927016 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d20060370 0x7f3d200fb760 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 rx=0x7f3d18004690 tx=0x7f3d18009b30).stop 2021-11-03T18:19:10.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.751+0000 7f3d281ca700 1 -- 172.21.15.26:0/410927016 shutdown_connections 2021-11-03T18:19:10.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.751+0000 7f3d281ca700 1 --2- 172.21.15.26:0/410927016 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d200fbc50 0x7f3d200fe040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:10.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.751+0000 7f3d281ca700 1 --2- 172.21.15.26:0/410927016 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d20060370 0x7f3d200fb760 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:10.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.751+0000 7f3d281ca700 1 -- 172.21.15.26:0/410927016 >> 172.21.15.26:0/410927016 conn(0x7f3d200f0de0 msgr2=0x7f3d200f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:19:10.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.751+0000 7f3d281ca700 1 -- 172.21.15.26:0/410927016 shutdown_connections 2021-11-03T18:19:10.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.751+0000 7f3d281ca700 1 -- 172.21.15.26:0/410927016 wait complete. 2021-11-03T18:19:10.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.752+0000 7f3d281ca700 1 Processor -- start 2021-11-03T18:19:10.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.752+0000 7f3d281ca700 1 -- start start 2021-11-03T18:19:10.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.752+0000 7f3d281ca700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d20060370 0x7f3d20109140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:19:10.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.752+0000 7f3d281ca700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d200fbc50 0x7f3d20109630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:19:10.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.752+0000 7f3d281ca700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d20109be0 con 0x7f3d200fbc50 2021-11-03T18:19:10.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.752+0000 7f3d281ca700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d20109d20 con 0x7f3d20060370 2021-11-03T18:19:10.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.752+0000 7f3d25765700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d200fbc50 0x7f3d20109630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:19:10.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.752+0000 7f3d25765700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d200fbc50 0x7f3d20109630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59350/0 (socket says 172.21.15.26:59350) 2021-11-03T18:19:10.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.752+0000 7f3d25765700 1 -- 172.21.15.26:0/1647700544 learned_addr learned my addr 172.21.15.26:0/1647700544 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:19:10.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.752+0000 7f3d25f66700 1 --2- 172.21.15.26:0/1647700544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d20060370 0x7f3d20109140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:19:10.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.752+0000 7f3d25765700 1 -- 172.21.15.26:0/1647700544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d20060370 msgr2=0x7f3d20109140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:19:10.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.752+0000 7f3d25765700 1 --2- 172.21.15.26:0/1647700544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d20060370 0x7f3d20109140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:10.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.752+0000 7f3d25765700 1 -- 172.21.15.26:0/1647700544 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d18005040 con 0x7f3d200fbc50 2021-11-03T18:19:10.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.753+0000 7f3d25765700 1 --2- 172.21.15.26:0/1647700544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d200fbc50 0x7f3d20109630 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 rx=0x7f3d1400e7f0 tx=0x7f3d1400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:19:10.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.753+0000 7f3d1e7fc700 1 -- 172.21.15.26:0/1647700544 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d140092e0 con 0x7f3d200fbc50 2021-11-03T18:19:10.757 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.753+0000 7f3d1e7fc700 1 -- 172.21.15.26:0/1647700544 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3d1400f040 con 0x7f3d200fbc50 2021-11-03T18:19:10.757 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.753+0000 7f3d1e7fc700 1 -- 172.21.15.26:0/1647700544 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d14014750 con 0x7f3d200fbc50 2021-11-03T18:19:10.757 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.753+0000 7f3d281ca700 1 -- 172.21.15.26:0/1647700544 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d2010a6c0 con 0x7f3d200fbc50 2021-11-03T18:19:10.757 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.753+0000 7f3d281ca700 1 -- 172.21.15.26:0/1647700544 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d2010ac00 con 0x7f3d200fbc50 2021-11-03T18:19:10.758 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.754+0000 7f3d281ca700 1 -- 172.21.15.26:0/1647700544 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d20045ad0 con 0x7f3d200fbc50 2021-11-03T18:19:10.758 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.754+0000 7f3d1e7fc700 1 -- 172.21.15.26:0/1647700544 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f3d1401b030 con 0x7f3d200fbc50 2021-11-03T18:19:10.758 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.755+0000 7f3d1e7fc700 1 --2- 172.21.15.26:0/1647700544 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3d080640b0 0x7f3d08066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:19:10.759 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.755+0000 7f3d1e7fc700 1 -- 172.21.15.26:0/1647700544 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f3d14080580 con 0x7f3d200fbc50 2021-11-03T18:19:10.759 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.755+0000 7f3d25f66700 1 --2- 172.21.15.26:0/1647700544 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3d080640b0 0x7f3d08066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:19:10.759 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.755+0000 7f3d25f66700 1 --2- 172.21.15.26:0/1647700544 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3d080640b0 0x7f3d08066570 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7f3d18005010 tx=0x7f3d1800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:19:10.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.759+0000 7f3d1e7fc700 1 -- 172.21.15.26:0/1647700544 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f3d140528a0 con 0x7f3d200fbc50 2021-11-03T18:19:10.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.937+0000 7f3d281ca700 1 -- 172.21.15.26:0/1647700544 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3d2010ae70 con 0x7f3d080640b0 2021-11-03T18:19:10.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.938+0000 7f3d1e7fc700 1 -- 172.21.15.26:0/1647700544 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f3d2010ae70 con 0x7f3d080640b0 2021-11-03T18:19:10.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.940+0000 7f3d281ca700 1 -- 172.21.15.26:0/1647700544 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3d080640b0 msgr2=0x7f3d08066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:19:10.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.940+0000 7f3d281ca700 1 --2- 172.21.15.26:0/1647700544 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3d080640b0 0x7f3d08066570 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7f3d18005010 tx=0x7f3d1800b040).stop 2021-11-03T18:19:10.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.940+0000 7f3d281ca700 1 -- 172.21.15.26:0/1647700544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d200fbc50 msgr2=0x7f3d20109630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:19:10.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.940+0000 7f3d281ca700 1 --2- 172.21.15.26:0/1647700544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d200fbc50 0x7f3d20109630 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 rx=0x7f3d1400e7f0 tx=0x7f3d1400b040).stop 2021-11-03T18:19:10.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.940+0000 7f3d281ca700 1 -- 172.21.15.26:0/1647700544 shutdown_connections 2021-11-03T18:19:10.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.940+0000 7f3d281ca700 1 --2- 172.21.15.26:0/1647700544 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3d080640b0 0x7f3d08066570 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:10.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.940+0000 7f3d281ca700 1 --2- 172.21.15.26:0/1647700544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d20060370 0x7f3d20109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:10.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.940+0000 7f3d281ca700 1 --2- 172.21.15.26:0/1647700544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d200fbc50 0x7f3d20109630 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:10.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.940+0000 7f3d281ca700 1 -- 172.21.15.26:0/1647700544 >> 172.21.15.26:0/1647700544 conn(0x7f3d200f0de0 msgr2=0x7f3d200f31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:19:10.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.940+0000 7f3d281ca700 1 -- 172.21.15.26:0/1647700544 shutdown_connections 2021-11-03T18:19:10.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:10.940+0000 7f3d281ca700 1 -- 172.21.15.26:0/1647700544 wait complete. 2021-11-03T18:19:10.948 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:19:11.041 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.041+0000 7f86e7ee9700 1 -- 172.21.15.26:0/2940075411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86e00f6860 msgr2=0x7f86e00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:19:11.041 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.041+0000 7f86e7ee9700 1 --2- 172.21.15.26:0/2940075411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86e00f6860 0x7f86e00f6cc0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 rx=0x7f86dc004660 tx=0x7f86dc009b30).stop 2021-11-03T18:19:11.041 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.041+0000 7f86e7ee9700 1 -- 172.21.15.26:0/2940075411 shutdown_connections 2021-11-03T18:19:11.041 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.041+0000 7f86e7ee9700 1 --2- 172.21.15.26:0/2940075411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86e00f6860 0x7f86e00f6cc0 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:11.042 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.041+0000 7f86e7ee9700 1 --2- 172.21.15.26:0/2940075411 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86e00f55c0 0x7f86e00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:19:11.042 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.041+0000 7f86e7ee9700 1 -- 172.21.15.26:0/2940075411 >> 172.21.15.26:0/2940075411 conn(0x7f86e00f0d40 msgr2=0x7f86e00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:19:11.042 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.041+0000 7f86e7ee9700 1 -- 172.21.15.26:0/2940075411 shutdown_connections 2021-11-03T18:19:11.042 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.041+0000 7f86e7ee9700 1 -- 172.21.15.26:0/2940075411 wait complete. 2021-11-03T18:19:11.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.041+0000 7f86e7ee9700 1 Processor -- start 2021-11-03T18:19:11.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.041+0000 7f86e7ee9700 1 -- start start 2021-11-03T18:19:11.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.042+0000 7f86e7ee9700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86e00f55c0 0x7f86e010c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:19:11.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.042+0000 7f86e7ee9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86e00f6860 0x7f86e010e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:19:11.044 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.042+0000 7f86e7ee9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e00602b0 con 0x7f86e00f6860 2021-11-03T18:19:11.044 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.042+0000 7f86e7ee9700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e00603f0 con 0x7f86e00f55c0 2021-11-03T18:19:11.044 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.042+0000 7f86e5484700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86e00f6860 0x7f86e010e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:19:11.044 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.042+0000 7f86e5484700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86e00f6860 0x7f86e010e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59360/0 (socket says 172.21.15.26:59360) 2021-11-03T18:19:11.045 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.042+0000 7f86e5484700 1 -- 172.21.15.26:0/4165117067 learned_addr learned my addr 172.21.15.26:0/4165117067 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:19:11.045 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.042+0000 7f86e5c85700 1 --2- 172.21.15.26:0/4165117067 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86e00f55c0 0x7f86e010c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:19:11.045 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.042+0000 7f86e5484700 1 -- 172.21.15.26:0/4165117067 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86e00f55c0 msgr2=0x7f86e010c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:19:11.045 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.042+0000 7f86e5484700 1 --2- 172.21.15.26:0/4165117067 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86e00f55c0 0x7f86e010c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:11.045 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.042+0000 7f86e5484700 1 -- 172.21.15.26:0/4165117067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86dc005040 con 0x7f86e00f6860 2021-11-03T18:19:11.046 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.042+0000 7f86e5c85700 1 --2- 172.21.15.26:0/4165117067 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86e00f55c0 0x7f86e010c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:19:11.046 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.042+0000 7f86e5484700 1 --2- 172.21.15.26:0/4165117067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86e00f6860 0x7f86e010e5d0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7f86dc009990 tx=0x7f86dc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:19:11.046 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.042+0000 7f86d27fc700 1 -- 172.21.15.26:0/4165117067 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86dc018070 con 0x7f86e00f6860 2021-11-03T18:19:11.046 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.042+0000 7f86d27fc700 1 -- 172.21.15.26:0/4165117067 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f86dc007ca0 con 0x7f86e00f6860 2021-11-03T18:19:11.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.042+0000 7f86e7ee9700 1 -- 172.21.15.26:0/4165117067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e010eac0 con 0x7f86e00f6860 2021-11-03T18:19:11.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.042+0000 7f86d27fc700 1 -- 172.21.15.26:0/4165117067 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86dc01c620 con 0x7f86e00f6860 2021-11-03T18:19:11.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.042+0000 7f86e7ee9700 1 -- 172.21.15.26:0/4165117067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e010eee0 con 0x7f86e00f6860 2021-11-03T18:19:11.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.043+0000 7f86e7ee9700 1 -- 172.21.15.26:0/4165117067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e0045ad0 con 0x7f86e00f6860 2021-11-03T18:19:11.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.044+0000 7f86d27fc700 1 -- 172.21.15.26:0/4165117067 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f86dc01d960 con 0x7f86e00f6860 2021-11-03T18:19:11.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.044+0000 7f86d27fc700 1 --2- 172.21.15.26:0/4165117067 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f86cc0640b0 0x7f86cc066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:19:11.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.044+0000 7f86d27fc700 1 -- 172.21.15.26:0/4165117067 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f86dc082520 con 0x7f86e00f6860 2021-11-03T18:19:11.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.044+0000 7f86e5c85700 1 --2- 172.21.15.26:0/4165117067 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f86cc0640b0 0x7f86cc066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:19:11.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.045+0000 7f86e5c85700 1 --2- 172.21.15.26:0/4165117067 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f86cc0640b0 0x7f86cc066570 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f86e0060040 tx=0x7f86d4008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:19:11.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.048+0000 7f86d27fc700 1 -- 172.21.15.26:0/4165117067 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f86dc054940 con 0x7f86e00f6860 2021-11-03T18:19:11.221 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.223+0000 7f86e7ee9700 1 -- 172.21.15.26:0/4165117067 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f86e00fdf60 con 0x7f86cc0640b0 2021-11-03T18:19:11.235 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.238+0000 7f86d27fc700 1 -- 172.21.15.26:0/4165117067 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f86e00fdf60 con 0x7f86cc0640b0 2021-11-03T18:19:11.236 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:19:11.236 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (90m) 9m ago 91m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:19:11.236 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (82m) 9m ago 91m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:19:11.237 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (82m) 8m ago 90m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:19:11.237 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (90m) 9m ago 91m 42.0M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:19:11.237 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (83m) 9m ago 86m 25.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:19:11.237 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (83m) 9m ago 86m 26.4M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:19:11.237 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (86m) 8m ago 86m 26.6M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:19:11.238 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (86m) 8m ago 86m 27.0M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:19:11.238 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (84m) 9m ago 93m 574M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:19:11.238 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (83m) 8m ago 90m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:19:11.238 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (83m) 9m ago 93m 308M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:19:11.239 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (83m) 8m ago 90m 145M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:19:11.239 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (91m) 9m ago 91m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:19:11.239 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (90m) 8m ago 90m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:19:11.239 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (82m) 9m ago 90m 312M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:19:11.240 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (81m) 9m ago 89m 335M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:19:11.240 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (81m) 9m ago 89m 279M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:19:11.240 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (80m) 8m ago 89m 362M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:19:11.240 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (80m) 8m ago 88m 302M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:19:11.240 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (79m) 8m ago 88m 296M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:19:11.241 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (90m) 9m ago 91m 63.4M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:19:11.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.239+0000 7f86e7ee9700 1 -- 172.21.15.26:0/4165117067 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f86cc0640b0 msgr2=0x7f86cc066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:19:11.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.239+0000 7f86e7ee9700 1 --2- 172.21.15.26:0/4165117067 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f86cc0640b0 0x7f86cc066570 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f86e0060040 tx=0x7f86d4008040).stop 2021-11-03T18:19:11.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.239+0000 7f86e7ee9700 1 -- 172.21.15.26:0/4165117067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86e00f6860 msgr2=0x7f86e010e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:19:11.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.239+0000 7f86e7ee9700 1 --2- 172.21.15.26:0/4165117067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86e00f6860 0x7f86e010e5d0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7f86dc009990 tx=0x7f86dc009b30).stop 2021-11-03T18:19:11.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.239+0000 7f86e7ee9700 1 -- 172.21.15.26:0/4165117067 shutdown_connections 2021-11-03T18:19:11.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.239+0000 7f86e7ee9700 1 --2- 172.21.15.26:0/4165117067 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f86cc0640b0 0x7f86cc066570 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:11.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.239+0000 7f86e7ee9700 1 --2- 172.21.15.26:0/4165117067 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86e00f55c0 0x7f86e010c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:11.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.239+0000 7f86e7ee9700 1 --2- 172.21.15.26:0/4165117067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86e00f6860 0x7f86e010e5d0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:11.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.239+0000 7f86e7ee9700 1 -- 172.21.15.26:0/4165117067 >> 172.21.15.26:0/4165117067 conn(0x7f86e00f0d40 msgr2=0x7f86e00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:19:11.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.240+0000 7f86e7ee9700 1 -- 172.21.15.26:0/4165117067 shutdown_connections 2021-11-03T18:19:11.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.240+0000 7f86e7ee9700 1 -- 172.21.15.26:0/4165117067 wait complete. 2021-11-03T18:19:11.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:10 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:19:11.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:10 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:19:11.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:10 smithi194 ceph-mon[65619]: pgmap v2535: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:11.339 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.339+0000 7efd4dc4e700 1 -- 172.21.15.26:0/571461603 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd480f7980 msgr2=0x7efd480f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:19:11.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.339+0000 7efd4dc4e700 1 --2- 172.21.15.26:0/571461603 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd480f7980 0x7efd480f7de0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 rx=0x7efd3c004660 tx=0x7efd3c009b30).stop 2021-11-03T18:19:11.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.339+0000 7efd4dc4e700 1 -- 172.21.15.26:0/571461603 shutdown_connections 2021-11-03T18:19:11.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.339+0000 7efd4dc4e700 1 --2- 172.21.15.26:0/571461603 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd480f7980 0x7efd480f7de0 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:11.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.339+0000 7efd4dc4e700 1 --2- 172.21.15.26:0/571461603 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd480f66e0 0x7efd480f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:11.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.339+0000 7efd4dc4e700 1 -- 172.21.15.26:0/571461603 >> 172.21.15.26:0/571461603 conn(0x7efd480f1e40 msgr2=0x7efd480f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:19:11.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.339+0000 7efd4dc4e700 1 -- 172.21.15.26:0/571461603 shutdown_connections 2021-11-03T18:19:11.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.339+0000 7efd4dc4e700 1 -- 172.21.15.26:0/571461603 wait complete. 2021-11-03T18:19:11.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.339+0000 7efd4dc4e700 1 Processor -- start 2021-11-03T18:19:11.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.339+0000 7efd4dc4e700 1 -- start start 2021-11-03T18:19:11.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.340+0000 7efd4dc4e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd480f66e0 0x7efd4806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:19:11.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.340+0000 7efd4dc4e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd480f7980 0x7efd48069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:19:11.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.340+0000 7efd4dc4e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd4806a380 con 0x7efd480f66e0 2021-11-03T18:19:11.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.340+0000 7efd4dc4e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd4806a4c0 con 0x7efd480f7980 2021-11-03T18:19:11.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.340+0000 7efd477fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd480f66e0 0x7efd4806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:19:11.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.340+0000 7efd477fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd480f66e0 0x7efd4806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59368/0 (socket says 172.21.15.26:59368) 2021-11-03T18:19:11.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.340+0000 7efd477fe700 1 -- 172.21.15.26:0/312876614 learned_addr learned my addr 172.21.15.26:0/312876614 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:19:11.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.340+0000 7efd46ffd700 1 --2- 172.21.15.26:0/312876614 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd480f7980 0x7efd48069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:19:11.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.340+0000 7efd477fe700 1 -- 172.21.15.26:0/312876614 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd480f7980 msgr2=0x7efd48069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:19:11.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.340+0000 7efd477fe700 1 --2- 172.21.15.26:0/312876614 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd480f7980 0x7efd48069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:11.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.340+0000 7efd477fe700 1 -- 172.21.15.26:0/312876614 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd3c005040 con 0x7efd480f66e0 2021-11-03T18:19:11.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.340+0000 7efd46ffd700 1 --2- 172.21.15.26:0/312876614 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd480f7980 0x7efd48069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:19:11.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.340+0000 7efd477fe700 1 --2- 172.21.15.26:0/312876614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd480f66e0 0x7efd4806b9a0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 rx=0x7efd38002700 tx=0x7efd38009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:19:11.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.340+0000 7efd2ffff700 1 -- 172.21.15.26:0/312876614 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd38009320 con 0x7efd480f66e0 2021-11-03T18:19:11.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.340+0000 7efd4dc4e700 1 -- 172.21.15.26:0/312876614 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd4806a7a0 con 0x7efd480f66e0 2021-11-03T18:19:11.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.340+0000 7efd2ffff700 1 -- 172.21.15.26:0/312876614 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efd3800f040 con 0x7efd480f66e0 2021-11-03T18:19:11.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.340+0000 7efd2ffff700 1 -- 172.21.15.26:0/312876614 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd38014900 con 0x7efd480f66e0 2021-11-03T18:19:11.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.341+0000 7efd4dc4e700 1 -- 172.21.15.26:0/312876614 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd4810ef90 con 0x7efd480f66e0 2021-11-03T18:19:11.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.341+0000 7efd4dc4e700 1 -- 172.21.15.26:0/312876614 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd48045ad0 con 0x7efd480f66e0 2021-11-03T18:19:11.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.342+0000 7efd2ffff700 1 -- 172.21.15.26:0/312876614 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7efd38009480 con 0x7efd480f66e0 2021-11-03T18:19:11.347 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.342+0000 7efd2ffff700 1 --2- 172.21.15.26:0/312876614 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efd300640b0 0x7efd30066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:19:11.347 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.342+0000 7efd2ffff700 1 -- 172.21.15.26:0/312876614 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7efd38080a50 con 0x7efd480f66e0 2021-11-03T18:19:11.348 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.342+0000 7efd46ffd700 1 --2- 172.21.15.26:0/312876614 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efd300640b0 0x7efd30066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:19:11.348 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.343+0000 7efd46ffd700 1 --2- 172.21.15.26:0/312876614 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efd300640b0 0x7efd30066570 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7efd3c004630 tx=0x7efd3c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:19:11.348 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.346+0000 7efd2ffff700 1 -- 172.21.15.26:0/312876614 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7efd38052db0 con 0x7efd480f66e0 2021-11-03T18:19:11.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:10 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:19:11.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:10 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:19:11.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:10 smithi026 ceph-mon[96795]: pgmap v2535: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:11.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.576+0000 7efd4dc4e700 1 -- 172.21.15.26:0/312876614 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efd480ff020 con 0x7efd480f66e0 2021-11-03T18:19:11.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.576+0000 7efd2ffff700 1 -- 172.21.15.26:0/312876614 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7efd380529a0 con 0x7efd480f66e0 2021-11-03T18:19:11.574 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:19:11.575 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:19:11.575 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:19:11.575 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:19:11.575 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:19:11.576 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:19:11.576 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:19:11.576 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:19:11.576 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:19:11.577 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:19:11.577 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:19:11.577 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:19:11.577 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:19:11.577 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:19:11.578 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:19:11.578 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:19:11.578 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:19:11.578 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:19:11.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.578+0000 7efd4dc4e700 1 -- 172.21.15.26:0/312876614 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efd300640b0 msgr2=0x7efd30066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:19:11.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.578+0000 7efd4dc4e700 1 --2- 172.21.15.26:0/312876614 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efd300640b0 0x7efd30066570 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7efd3c004630 tx=0x7efd3c009b30).stop 2021-11-03T18:19:11.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.578+0000 7efd4dc4e700 1 -- 172.21.15.26:0/312876614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd480f66e0 msgr2=0x7efd4806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:19:11.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.578+0000 7efd4dc4e700 1 --2- 172.21.15.26:0/312876614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd480f66e0 0x7efd4806b9a0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 rx=0x7efd38002700 tx=0x7efd38009d80).stop 2021-11-03T18:19:11.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.578+0000 7efd4dc4e700 1 -- 172.21.15.26:0/312876614 shutdown_connections 2021-11-03T18:19:11.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.578+0000 7efd4dc4e700 1 --2- 172.21.15.26:0/312876614 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efd300640b0 0x7efd30066570 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:11.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.578+0000 7efd4dc4e700 1 --2- 172.21.15.26:0/312876614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd480f66e0 0x7efd4806b9a0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:11.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.578+0000 7efd4dc4e700 1 --2- 172.21.15.26:0/312876614 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd480f7980 0x7efd48069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:11.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.578+0000 7efd4dc4e700 1 -- 172.21.15.26:0/312876614 >> 172.21.15.26:0/312876614 conn(0x7efd480f1e40 msgr2=0x7efd480fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:19:11.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.578+0000 7efd4dc4e700 1 -- 172.21.15.26:0/312876614 shutdown_connections 2021-11-03T18:19:11.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.578+0000 7efd4dc4e700 1 -- 172.21.15.26:0/312876614 wait complete. 2021-11-03T18:19:11.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.678+0000 7f009e363700 1 -- 172.21.15.26:0/3203277126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00980f5ef0 msgr2=0x7f00980f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:19:11.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.678+0000 7f009e363700 1 --2- 172.21.15.26:0/3203277126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00980f5ef0 0x7f00980f6920 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7f0088004660 tx=0x7f0088009b30).stop 2021-11-03T18:19:11.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.678+0000 7f009e363700 1 -- 172.21.15.26:0/3203277126 shutdown_connections 2021-11-03T18:19:11.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.678+0000 7f009e363700 1 --2- 172.21.15.26:0/3203277126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00980f5ef0 0x7f00980f6920 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:11.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.678+0000 7f009e363700 1 --2- 172.21.15.26:0/3203277126 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00980f55e0 0x7f00980f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:11.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.678+0000 7f009e363700 1 -- 172.21.15.26:0/3203277126 >> 172.21.15.26:0/3203277126 conn(0x7f00980f0de0 msgr2=0x7f00980f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:19:11.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.678+0000 7f009e363700 1 -- 172.21.15.26:0/3203277126 shutdown_connections 2021-11-03T18:19:11.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.678+0000 7f009e363700 1 -- 172.21.15.26:0/3203277126 wait complete. 2021-11-03T18:19:11.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.679+0000 7f009e363700 1 Processor -- start 2021-11-03T18:19:11.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.679+0000 7f009e363700 1 -- start start 2021-11-03T18:19:11.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.679+0000 7f009e363700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00980f55e0 0x7f0098109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:19:11.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.679+0000 7f009e363700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00980f5ef0 0x7f009810c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:19:11.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.679+0000 7f009e363700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00980604e0 con 0x7f00980f55e0 2021-11-03T18:19:11.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.679+0000 7f009e363700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0098060620 con 0x7f00980f5ef0 2021-11-03T18:19:11.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.679+0000 7f0097fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00980f55e0 0x7f0098109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:19:11.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.679+0000 7f0097fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00980f55e0 0x7f0098109cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59378/0 (socket says 172.21.15.26:59378) 2021-11-03T18:19:11.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.679+0000 7f0097fff700 1 -- 172.21.15.26:0/628644780 learned_addr learned my addr 172.21.15.26:0/628644780 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:19:11.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.679+0000 7f00977fe700 1 --2- 172.21.15.26:0/628644780 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00980f5ef0 0x7f009810c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:19:11.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.679+0000 7f0097fff700 1 -- 172.21.15.26:0/628644780 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00980f5ef0 msgr2=0x7f009810c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:19:11.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.679+0000 7f0097fff700 1 --2- 172.21.15.26:0/628644780 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00980f5ef0 0x7f009810c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:11.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.679+0000 7f0097fff700 1 -- 172.21.15.26:0/628644780 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0088005040 con 0x7f00980f55e0 2021-11-03T18:19:11.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.679+0000 7f00977fe700 1 --2- 172.21.15.26:0/628644780 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00980f5ef0 0x7f009810c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:19:11.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.680+0000 7f0097fff700 1 --2- 172.21.15.26:0/628644780 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00980f55e0 0x7f0098109cb0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 rx=0x7f008c00c530 tx=0x7f008c007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:19:11.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.680+0000 7f0094ff9700 1 -- 172.21.15.26:0/628644780 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f008c00f650 con 0x7f00980f55e0 2021-11-03T18:19:11.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.680+0000 7f0094ff9700 1 -- 172.21.15.26:0/628644780 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f008c00fc60 con 0x7f00980f55e0 2021-11-03T18:19:11.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.680+0000 7f009e363700 1 -- 172.21.15.26:0/628644780 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f009810c760 con 0x7f00980f55e0 2021-11-03T18:19:11.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.680+0000 7f0094ff9700 1 -- 172.21.15.26:0/628644780 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f008c012cd0 con 0x7f00980f55e0 2021-11-03T18:19:11.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.680+0000 7f009e363700 1 -- 172.21.15.26:0/628644780 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f009810ccf0 con 0x7f00980f55e0 2021-11-03T18:19:11.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.681+0000 7f009e363700 1 -- 172.21.15.26:0/628644780 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0098045ad0 con 0x7f00980f55e0 2021-11-03T18:19:11.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.682+0000 7f0094ff9700 1 -- 172.21.15.26:0/628644780 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f008c010070 con 0x7f00980f55e0 2021-11-03T18:19:11.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.682+0000 7f0094ff9700 1 --2- 172.21.15.26:0/628644780 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f00800640b0 0x7f0080066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:19:11.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.682+0000 7f0094ff9700 1 -- 172.21.15.26:0/628644780 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f008c080f40 con 0x7f00980f55e0 2021-11-03T18:19:11.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.682+0000 7f00977fe700 1 --2- 172.21.15.26:0/628644780 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f00800640b0 0x7f0080066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:19:11.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.682+0000 7f00977fe700 1 --2- 172.21.15.26:0/628644780 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f00800640b0 0x7f0080066570 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7f0088004e30 tx=0x7f0088009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:19:11.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.686+0000 7f0094ff9700 1 -- 172.21.15.26:0/628644780 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f008c0531b0 con 0x7f00980f55e0 2021-11-03T18:19:11.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.891+0000 7f009e363700 1 -- 172.21.15.26:0/628644780 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f00980586e0 con 0x7f00980f55e0 2021-11-03T18:19:11.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.892+0000 7f0094ff9700 1 -- 172.21.15.26:0/628644780 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f008c020070 con 0x7f00980f55e0 2021-11-03T18:19:11.890 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:19:11.890 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:19:11.891 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:19:11.891 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:19:11.891 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:19:11.891 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:19:11.892 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:19:11.892 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:19:11.892 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:19:11.892 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:19:11.893 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:19:11.893 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:19:11.893 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:19:11.894 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:19:11.894 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:19:11.894 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:19:11.895 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:19:11.895 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:19:11.895 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:19:11.895 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:19:11.896 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:19:11.896 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:19:11.896 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:19:11.896 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:19:11.897 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:19:11.897 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:19:11.897 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:19:11.897 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:19:11.897 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:19:11.898 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:19:11.898 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:19:11.898 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:19:11.898 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:19:11.899 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:19:11.899 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:19:11.899 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:19:11.899 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:19:11.900 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:19:11.900 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:19:11.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.893+0000 7f009e363700 1 -- 172.21.15.26:0/628644780 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f00800640b0 msgr2=0x7f0080066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:19:11.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.893+0000 7f009e363700 1 --2- 172.21.15.26:0/628644780 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f00800640b0 0x7f0080066570 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7f0088004e30 tx=0x7f0088009b30).stop 2021-11-03T18:19:11.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.893+0000 7f009e363700 1 -- 172.21.15.26:0/628644780 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00980f55e0 msgr2=0x7f0098109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:19:11.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.893+0000 7f009e363700 1 --2- 172.21.15.26:0/628644780 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00980f55e0 0x7f0098109cb0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 rx=0x7f008c00c530 tx=0x7f008c007e20).stop 2021-11-03T18:19:11.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.893+0000 7f009e363700 1 -- 172.21.15.26:0/628644780 shutdown_connections 2021-11-03T18:19:11.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.893+0000 7f009e363700 1 --2- 172.21.15.26:0/628644780 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f00800640b0 0x7f0080066570 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:11.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.893+0000 7f009e363700 1 --2- 172.21.15.26:0/628644780 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00980f55e0 0x7f0098109cb0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:11.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.893+0000 7f009e363700 1 --2- 172.21.15.26:0/628644780 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00980f5ef0 0x7f009810c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:11.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.893+0000 7f009e363700 1 -- 172.21.15.26:0/628644780 >> 172.21.15.26:0/628644780 conn(0x7f00980f0de0 msgr2=0x7f00980fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:19:11.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.894+0000 7f009e363700 1 -- 172.21.15.26:0/628644780 shutdown_connections 2021-11-03T18:19:11.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:11.894+0000 7f009e363700 1 -- 172.21.15.26:0/628644780 wait complete. 2021-11-03T18:19:11.903 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:19:12.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:11 smithi194 ceph-mon[65619]: from='client.36748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:19:12.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:11 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/312876614' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:19:12.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:11 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/628644780' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:19:12.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:11 smithi026 ceph-mon[96795]: from='client.36748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:19:12.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:11 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/312876614' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:19:12.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:11 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/628644780' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:19:13.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:12 smithi194 ceph-mon[65619]: from='client.36752 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:19:13.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:12 smithi194 ceph-mon[65619]: pgmap v2536: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:13.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:12 smithi026 ceph-mon[96795]: from='client.36752 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:19:13.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:12 smithi026 ceph-mon[96795]: pgmap v2536: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:15.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:14 smithi194 ceph-mon[65619]: pgmap v2537: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:15.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:14 smithi026 ceph-mon[96795]: pgmap v2537: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:17.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:16 smithi194 ceph-mon[65619]: pgmap v2538: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:17.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:16 smithi026 ceph-mon[96795]: pgmap v2538: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:19.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:18 smithi194 ceph-mon[65619]: pgmap v2539: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:19.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:18 smithi026 ceph-mon[96795]: pgmap v2539: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:21.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:20 smithi194 ceph-mon[65619]: pgmap v2540: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:21.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:20 smithi026 ceph-mon[96795]: pgmap v2540: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:23.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:22 smithi194 ceph-mon[65619]: pgmap v2541: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:23.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:22 smithi026 ceph-mon[96795]: pgmap v2541: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:25.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:24 smithi194 ceph-mon[65619]: pgmap v2542: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:25.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:19:25.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:24 smithi026 ceph-mon[96795]: pgmap v2542: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:25.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:19:26.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:25 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:19:26.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:25 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:19:27.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:26 smithi194 ceph-mon[65619]: pgmap v2543: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:27.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:26 smithi026 ceph-mon[96795]: pgmap v2543: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:29.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:28 smithi194 ceph-mon[65619]: pgmap v2544: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:29.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:28 smithi026 ceph-mon[96795]: pgmap v2544: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:31.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:30 smithi194 ceph-mon[65619]: pgmap v2545: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:31.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:30 smithi026 ceph-mon[96795]: pgmap v2545: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:33.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:32 smithi194 ceph-mon[65619]: pgmap v2546: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:33.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:32 smithi026 ceph-mon[96795]: pgmap v2546: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:35.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:34 smithi194 ceph-mon[65619]: pgmap v2547: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:35.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:34 smithi026 ceph-mon[96795]: pgmap v2547: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:37.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:36 smithi194 ceph-mon[65619]: pgmap v2548: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:37.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:36 smithi026 ceph-mon[96795]: pgmap v2548: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:39.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:38 smithi194 ceph-mon[65619]: pgmap v2549: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:39.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:38 smithi026 ceph-mon[96795]: pgmap v2549: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:40.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:19:40.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:19:41.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:40 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:19:41.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:40 smithi194 ceph-mon[65619]: pgmap v2550: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:41.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:40 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:19:41.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:40 smithi026 ceph-mon[96795]: pgmap v2550: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:42.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.007+0000 7f6ff43f9700 1 -- 172.21.15.26:0/3737788927 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fec0f6860 msgr2=0x7f6fec0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:19:42.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.007+0000 7f6ff43f9700 1 --2- 172.21.15.26:0/3737788927 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fec0f6860 0x7f6fec0f6cc0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 rx=0x7f6fe0004660 tx=0x7f6fe0009b30).stop 2021-11-03T18:19:42.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.007+0000 7f6ff43f9700 1 -- 172.21.15.26:0/3737788927 shutdown_connections 2021-11-03T18:19:42.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.007+0000 7f6ff43f9700 1 --2- 172.21.15.26:0/3737788927 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fec0f6860 0x7f6fec0f6cc0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:42.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.007+0000 7f6ff43f9700 1 --2- 172.21.15.26:0/3737788927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fec0f55c0 0x7f6fec0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:42.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.007+0000 7f6ff43f9700 1 -- 172.21.15.26:0/3737788927 >> 172.21.15.26:0/3737788927 conn(0x7f6fec0f0d40 msgr2=0x7f6fec0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:19:42.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.007+0000 7f6ff43f9700 1 -- 172.21.15.26:0/3737788927 shutdown_connections 2021-11-03T18:19:42.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.007+0000 7f6ff43f9700 1 -- 172.21.15.26:0/3737788927 wait complete. 2021-11-03T18:19:42.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.008+0000 7f6ff43f9700 1 Processor -- start 2021-11-03T18:19:42.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.008+0000 7f6ff43f9700 1 -- start start 2021-11-03T18:19:42.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.008+0000 7f6ff43f9700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fec0f55c0 0x7f6fec10c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:19:42.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.008+0000 7f6ff43f9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fec0f6860 0x7f6fec10e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:19:42.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.008+0000 7f6ff43f9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec0602b0 con 0x7f6fec0f6860 2021-11-03T18:19:42.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.008+0000 7f6ff43f9700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec0603f0 con 0x7f6fec0f55c0 2021-11-03T18:19:42.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.008+0000 7f6ff1994700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fec0f6860 0x7f6fec10e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:19:42.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.008+0000 7f6ff1994700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fec0f6860 0x7f6fec10e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59398/0 (socket says 172.21.15.26:59398) 2021-11-03T18:19:42.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.008+0000 7f6ff1994700 1 -- 172.21.15.26:0/3050150604 learned_addr learned my addr 172.21.15.26:0/3050150604 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:19:42.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.008+0000 7f6ff2195700 1 --2- 172.21.15.26:0/3050150604 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fec0f55c0 0x7f6fec10c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:19:42.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.008+0000 7f6ff1994700 1 -- 172.21.15.26:0/3050150604 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fec0f55c0 msgr2=0x7f6fec10c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:19:42.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.008+0000 7f6ff1994700 1 --2- 172.21.15.26:0/3050150604 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fec0f55c0 0x7f6fec10c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:42.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.008+0000 7f6ff1994700 1 -- 172.21.15.26:0/3050150604 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe0005040 con 0x7f6fec0f6860 2021-11-03T18:19:42.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.008+0000 7f6ff2195700 1 --2- 172.21.15.26:0/3050150604 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fec0f55c0 0x7f6fec10c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:19:42.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.008+0000 7f6ff1994700 1 --2- 172.21.15.26:0/3050150604 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fec0f6860 0x7f6fec10e570 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7f6fe0009990 tx=0x7f6fe0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:19:42.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.009+0000 7f6feaffd700 1 -- 172.21.15.26:0/3050150604 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fe0018070 con 0x7f6fec0f6860 2021-11-03T18:19:42.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.009+0000 7f6ff43f9700 1 -- 172.21.15.26:0/3050150604 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fec10ea60 con 0x7f6fec0f6860 2021-11-03T18:19:42.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.009+0000 7f6feaffd700 1 -- 172.21.15.26:0/3050150604 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6fe0007ca0 con 0x7f6fec0f6860 2021-11-03T18:19:42.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.009+0000 7f6feaffd700 1 -- 172.21.15.26:0/3050150604 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fe001c620 con 0x7f6fec0f6860 2021-11-03T18:19:42.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.009+0000 7f6ff43f9700 1 -- 172.21.15.26:0/3050150604 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fec10ee30 con 0x7f6fec0f6860 2021-11-03T18:19:42.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.010+0000 7f6ff43f9700 1 -- 172.21.15.26:0/3050150604 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fec0f49b0 con 0x7f6fec0f6860 2021-11-03T18:19:42.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.010+0000 7f6feaffd700 1 -- 172.21.15.26:0/3050150604 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f6fe001d960 con 0x7f6fec0f6860 2021-11-03T18:19:42.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.011+0000 7f6feaffd700 1 --2- 172.21.15.26:0/3050150604 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6fd40640b0 0x7f6fd4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:19:42.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.011+0000 7f6feaffd700 1 -- 172.21.15.26:0/3050150604 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f6fe0082520 con 0x7f6fec0f6860 2021-11-03T18:19:42.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.011+0000 7f6ff2195700 1 --2- 172.21.15.26:0/3050150604 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6fd40640b0 0x7f6fd4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:19:42.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.011+0000 7f6ff2195700 1 --2- 172.21.15.26:0/3050150604 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6fd40640b0 0x7f6fd4066570 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f6fec060040 tx=0x7f6fe4009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:19:42.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.015+0000 7f6feaffd700 1 -- 172.21.15.26:0/3050150604 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f6fe0054940 con 0x7f6fec0f6860 2021-11-03T18:19:42.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.197+0000 7f6ff43f9700 1 -- 172.21.15.26:0/3050150604 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6fec0fde50 con 0x7f6fd40640b0 2021-11-03T18:19:42.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.199+0000 7f6feaffd700 1 -- 172.21.15.26:0/3050150604 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f6fec0fde50 con 0x7f6fd40640b0 2021-11-03T18:19:42.199 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.200+0000 7f6ff43f9700 1 -- 172.21.15.26:0/3050150604 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6fd40640b0 msgr2=0x7f6fd4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:19:42.200 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.200+0000 7f6ff43f9700 1 --2- 172.21.15.26:0/3050150604 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6fd40640b0 0x7f6fd4066570 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f6fec060040 tx=0x7f6fe4009040).stop 2021-11-03T18:19:42.200 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.200+0000 7f6ff43f9700 1 -- 172.21.15.26:0/3050150604 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fec0f6860 msgr2=0x7f6fec10e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:19:42.200 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.200+0000 7f6ff43f9700 1 --2- 172.21.15.26:0/3050150604 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fec0f6860 0x7f6fec10e570 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7f6fe0009990 tx=0x7f6fe0009b30).stop 2021-11-03T18:19:42.200 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.201+0000 7f6ff43f9700 1 -- 172.21.15.26:0/3050150604 shutdown_connections 2021-11-03T18:19:42.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.201+0000 7f6ff43f9700 1 --2- 172.21.15.26:0/3050150604 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6fd40640b0 0x7f6fd4066570 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:42.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.201+0000 7f6ff43f9700 1 --2- 172.21.15.26:0/3050150604 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fec0f55c0 0x7f6fec10c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:42.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.201+0000 7f6ff43f9700 1 --2- 172.21.15.26:0/3050150604 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fec0f6860 0x7f6fec10e570 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:42.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.201+0000 7f6ff43f9700 1 -- 172.21.15.26:0/3050150604 >> 172.21.15.26:0/3050150604 conn(0x7f6fec0f0d40 msgr2=0x7f6fec0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:19:42.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.201+0000 7f6ff43f9700 1 -- 172.21.15.26:0/3050150604 shutdown_connections 2021-11-03T18:19:42.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.201+0000 7f6ff43f9700 1 -- 172.21.15.26:0/3050150604 wait complete. 2021-11-03T18:19:42.209 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:19:42.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.301+0000 7ffabc254700 1 -- 172.21.15.26:0/1852351784 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffab40f9880 msgr2=0x7ffab40fbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:19:42.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.301+0000 7ffabc254700 1 --2- 172.21.15.26:0/1852351784 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffab40f9880 0x7ffab40fbc70 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7ffab0004660 tx=0x7ffab0009b30).stop 2021-11-03T18:19:42.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.301+0000 7ffabc254700 1 -- 172.21.15.26:0/1852351784 shutdown_connections 2021-11-03T18:19:42.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.301+0000 7ffabc254700 1 --2- 172.21.15.26:0/1852351784 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffab40f9880 0x7ffab40fbc70 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:42.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.301+0000 7ffabc254700 1 --2- 172.21.15.26:0/1852351784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffab40602b0 0x7ffab40f9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:19:42.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.301+0000 7ffabc254700 1 -- 172.21.15.26:0/1852351784 >> 172.21.15.26:0/1852351784 conn(0x7ffab40f0d40 msgr2=0x7ffab40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:19:42.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.301+0000 7ffabc254700 1 -- 172.21.15.26:0/1852351784 shutdown_connections 2021-11-03T18:19:42.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.301+0000 7ffabc254700 1 -- 172.21.15.26:0/1852351784 wait complete. 2021-11-03T18:19:42.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.302+0000 7ffabc254700 1 Processor -- start 2021-11-03T18:19:42.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.302+0000 7ffabc254700 1 -- start start 2021-11-03T18:19:42.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.302+0000 7ffabc254700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffab40602b0 0x7ffab4106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:19:42.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.302+0000 7ffabc254700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffab40f9880 0x7ffab4107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:19:42.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.302+0000 7ffabc254700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab4107a90 con 0x7ffab40602b0 2021-11-03T18:19:42.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.302+0000 7ffabc254700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab4108340 con 0x7ffab40f9880 2021-11-03T18:19:42.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.302+0000 7ffab9ff0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffab40602b0 0x7ffab4106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:19:42.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.302+0000 7ffab9ff0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffab40602b0 0x7ffab4106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59406/0 (socket says 172.21.15.26:59406) 2021-11-03T18:19:42.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.302+0000 7ffab9ff0700 1 -- 172.21.15.26:0/2697681952 learned_addr learned my addr 172.21.15.26:0/2697681952 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:19:42.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.302+0000 7ffab9ff0700 1 -- 172.21.15.26:0/2697681952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffab40f9880 msgr2=0x7ffab4107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:19:42.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.302+0000 7ffab9ff0700 1 --2- 172.21.15.26:0/2697681952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffab40f9880 0x7ffab4107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:19:42.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.302+0000 7ffab9ff0700 1 -- 172.21.15.26:0/2697681952 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab0005040 con 0x7ffab40602b0 2021-11-03T18:19:42.307 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.302+0000 7ffab9ff0700 1 --2- 172.21.15.26:0/2697681952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffab40602b0 0x7ffab4106f60 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 rx=0x7ffaa400b410 tx=0x7ffaa4006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:19:42.307 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.302+0000 7ffaaa7fc700 1 -- 172.21.15.26:0/2697681952 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaa40125f0 con 0x7ffab40602b0 2021-11-03T18:19:42.307 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.302+0000 7ffabc254700 1 -- 172.21.15.26:0/2697681952 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab4108620 con 0x7ffab40602b0 2021-11-03T18:19:42.307 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.302+0000 7ffaaa7fc700 1 -- 172.21.15.26:0/2697681952 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ffaa4012c00 con 0x7ffab40602b0 2021-11-03T18:19:42.308 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.302+0000 7ffaaa7fc700 1 -- 172.21.15.26:0/2697681952 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaa4002ae0 con 0x7ffab40602b0 2021-11-03T18:19:42.308 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.303+0000 7ffabc254700 1 -- 172.21.15.26:0/2697681952 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab4108be0 con 0x7ffab40602b0 2021-11-03T18:19:42.308 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.304+0000 7ffabc254700 1 -- 172.21.15.26:0/2697681952 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab40f49b0 con 0x7ffab40602b0 2021-11-03T18:19:42.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.304+0000 7ffaaa7fc700 1 -- 172.21.15.26:0/2697681952 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ffaa400f030 con 0x7ffab40602b0 2021-11-03T18:19:42.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.304+0000 7ffaaa7fc700 1 --2- 172.21.15.26:0/2697681952 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffaa00640b0 0x7ffaa0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:19:42.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.304+0000 7ffaaa7fc700 1 -- 172.21.15.26:0/2697681952 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ffaa4080c80 con 0x7ffab40602b0 2021-11-03T18:19:42.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.304+0000 7ffab97ef700 1 --2- 172.21.15.26:0/2697681952 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffaa00640b0 0x7ffaa0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:19:42.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.305+0000 7ffab97ef700 1 --2- 172.21.15.26:0/2697681952 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffaa00640b0 0x7ffaa0066570 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7ffab0004e30 tx=0x7ffab0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:19:42.310 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.308+0000 7ffaaa7fc700 1 -- 172.21.15.26:0/2697681952 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ffaa4052fe0 con 0x7ffab40602b0 2021-11-03T18:19:42.482 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.484+0000 7ffabc254700 1 -- 172.21.15.26:0/2697681952 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ffab40ff030 con 0x7ffaa00640b0 2021-11-03T18:19:42.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.498+0000 7ffaaa7fc700 1 -- 172.21.15.26:0/2697681952 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7ffab40ff030 con 0x7ffaa00640b0 2021-11-03T18:19:42.497 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:19:42.498 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (90m) 9m ago 92m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:19:42.498 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (83m) 9m ago 92m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:19:42.498 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (82m) 8m ago 91m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:19:42.499 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (90m) 9m ago 91m 42.0M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:19:42.499 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (83m) 9m ago 87m 25.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:19:42.499 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (84m) 9m ago 87m 26.4M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:19:42.499 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (87m) 8m ago 87m 26.6M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:19:42.499 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (87m) 8m ago 87m 27.0M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:19:42.500 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (84m) 9m ago 93m 574M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:19:42.500 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (84m) 8m ago 91m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:19:42.500 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (84m) 9m ago 93m 308M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:19:42.500 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (83m) 8m ago 91m 145M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:19:42.501 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (91m) 9m ago 91m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:19:42.501 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (91m) 8m ago 91m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:19:42.501 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (82m) 9m ago 90m 312M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:19:42.501 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (82m) 9m ago 90m 335M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:19:42.502 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (81m) 9m ago 89m 279M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:19:42.502 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (81m) 8m ago 89m 362M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:19:42.502 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (80m) 8m ago 89m 302M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:19:42.502 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (80m) 8m ago 88m 296M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:19:42.503 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (90m) 9m ago 91m 63.4M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:19:42.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.500+0000 7ffabc254700 1 -- 172.21.15.26:0/2697681952 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffaa00640b0 msgr2=0x7ffaa0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:19:42.504 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.500+0000 7ffabc254700 1 --2- 172.21.15.26:0/2697681952 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffaa00640b0 0x7ffaa0066570 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7ffab0004e30 tx=0x7ffab0009b30).stop 2021-11-03T18:19:42.504 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.500+0000 7ffabc254700 1 -- 172.21.15.26:0/2697681952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffab40602b0 msgr2=0x7ffab4106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:19:42.504 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.500+0000 7ffabc254700 1 --2- 172.21.15.26:0/2697681952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffab40602b0 0x7ffab4106f60 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 rx=0x7ffaa400b410 tx=0x7ffaa4006ef0).stop 2021-11-03T18:19:42.505 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.500+0000 7ffabc254700 1 -- 172.21.15.26:0/2697681952 shutdown_connections 2021-11-03T18:19:42.505 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.500+0000 7ffabc254700 1 --2- 172.21.15.26:0/2697681952 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffaa00640b0 0x7ffaa0066570 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:42.505 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.500+0000 7ffabc254700 1 --2- 172.21.15.26:0/2697681952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffab40602b0 0x7ffab4106f60 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:42.505 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.500+0000 7ffabc254700 1 --2- 172.21.15.26:0/2697681952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffab40f9880 0x7ffab4107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:19:42.506 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.500+0000 7ffabc254700 1 -- 172.21.15.26:0/2697681952 >> 172.21.15.26:0/2697681952 conn(0x7ffab40f0d40 msgr2=0x7ffab40f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:19:42.506 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.501+0000 7ffabc254700 1 -- 172.21.15.26:0/2697681952 shutdown_connections 2021-11-03T18:19:42.506 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.501+0000 7ffabc254700 1 -- 172.21.15.26:0/2697681952 wait complete. 2021-11-03T18:19:42.602 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.600+0000 7f7a84c41700 1 -- 172.21.15.26:0/2587470220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a800f5340 msgr2=0x7f7a800f7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:19:42.602 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.600+0000 7f7a84c41700 1 --2- 172.21.15.26:0/2587470220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a800f5340 0x7f7a800f7ac0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 rx=0x7f7a74004660 tx=0x7f7a74009b30).stop 2021-11-03T18:19:42.603 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.600+0000 7f7a84c41700 1 -- 172.21.15.26:0/2587470220 shutdown_connections 2021-11-03T18:19:42.603 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.600+0000 7f7a84c41700 1 --2- 172.21.15.26:0/2587470220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a800f5340 0x7f7a800f7ac0 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:42.603 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.600+0000 7f7a84c41700 1 --2- 172.21.15.26:0/2587470220 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a800f49a0 0x7f7a800f4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:42.603 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.600+0000 7f7a84c41700 1 -- 172.21.15.26:0/2587470220 >> 172.21.15.26:0/2587470220 conn(0x7f7a800f04c0 msgr2=0x7f7a800f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:19:42.604 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.600+0000 7f7a84c41700 1 -- 172.21.15.26:0/2587470220 shutdown_connections 2021-11-03T18:19:42.604 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.600+0000 7f7a84c41700 1 -- 172.21.15.26:0/2587470220 wait complete. 2021-11-03T18:19:42.604 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.601+0000 7f7a84c41700 1 Processor -- start 2021-11-03T18:19:42.604 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.601+0000 7f7a84c41700 1 -- start start 2021-11-03T18:19:42.604 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.601+0000 7f7a84c41700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a800f49a0 0x7f7a80106f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:19:42.605 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.601+0000 7f7a84c41700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a800f5340 0x7f7a80107420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:19:42.605 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.601+0000 7f7a84c41700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a801079d0 con 0x7f7a800f5340 2021-11-03T18:19:42.605 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.601+0000 7f7a84c41700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a80107b10 con 0x7f7a800f49a0 2021-11-03T18:19:42.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.601+0000 7f7a7dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a800f5340 0x7f7a80107420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:19:42.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.601+0000 7f7a7dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a800f5340 0x7f7a80107420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59418/0 (socket says 172.21.15.26:59418) 2021-11-03T18:19:42.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.601+0000 7f7a7dd9b700 1 -- 172.21.15.26:0/853315552 learned_addr learned my addr 172.21.15.26:0/853315552 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:19:42.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.601+0000 7f7a7e59c700 1 --2- 172.21.15.26:0/853315552 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a800f49a0 0x7f7a80106f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:19:42.607 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.601+0000 7f7a7dd9b700 1 -- 172.21.15.26:0/853315552 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a800f49a0 msgr2=0x7f7a80106f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:19:42.607 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.601+0000 7f7a7dd9b700 1 --2- 172.21.15.26:0/853315552 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a800f49a0 0x7f7a80106f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:42.607 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.601+0000 7f7a7dd9b700 1 -- 172.21.15.26:0/853315552 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a74005040 con 0x7f7a800f5340 2021-11-03T18:19:42.607 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.601+0000 7f7a7e59c700 1 --2- 172.21.15.26:0/853315552 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a800f49a0 0x7f7a80106f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:19:42.607 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.602+0000 7f7a7dd9b700 1 --2- 172.21.15.26:0/853315552 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a800f5340 0x7f7a80107420 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7f7a74013a70 tx=0x7f7a74009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:19:42.608 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.602+0000 7f7a6effd700 1 -- 172.21.15.26:0/853315552 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a74018070 con 0x7f7a800f5340 2021-11-03T18:19:42.608 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.602+0000 7f7a6effd700 1 -- 172.21.15.26:0/853315552 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7a740097d0 con 0x7f7a800f5340 2021-11-03T18:19:42.608 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.602+0000 7f7a84c41700 1 -- 172.21.15.26:0/853315552 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a80108450 con 0x7f7a800f5340 2021-11-03T18:19:42.608 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.602+0000 7f7a6effd700 1 -- 172.21.15.26:0/853315552 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a7401c3c0 con 0x7f7a800f5340 2021-11-03T18:19:42.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.602+0000 7f7a84c41700 1 -- 172.21.15.26:0/853315552 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a801089b0 con 0x7f7a800f5340 2021-11-03T18:19:42.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.603+0000 7f7a84c41700 1 -- 172.21.15.26:0/853315552 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a80045ad0 con 0x7f7a800f5340 2021-11-03T18:19:42.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.603+0000 7f7a6effd700 1 -- 172.21.15.26:0/853315552 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f7a74007ba0 con 0x7f7a800f5340 2021-11-03T18:19:42.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.604+0000 7f7a6effd700 1 --2- 172.21.15.26:0/853315552 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7a680640b0 0x7f7a68066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:19:42.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.604+0000 7f7a6effd700 1 -- 172.21.15.26:0/853315552 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f7a740823a0 con 0x7f7a800f5340 2021-11-03T18:19:42.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.604+0000 7f7a7e59c700 1 --2- 172.21.15.26:0/853315552 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7a680640b0 0x7f7a68066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:19:42.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.604+0000 7f7a7e59c700 1 --2- 172.21.15.26:0/853315552 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7a680640b0 0x7f7a68066570 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f7a8005f520 tx=0x7f7a78004d80).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:19:42.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.608+0000 7f7a6effd700 1 -- 172.21.15.26:0/853315552 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f7a740547c0 con 0x7f7a800f5340 2021-11-03T18:19:42.840 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.841+0000 7f7a84c41700 1 -- 172.21.15.26:0/853315552 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7a80027a00 con 0x7f7a800f5340 2021-11-03T18:19:42.840 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.841+0000 7f7a6effd700 1 -- 172.21.15.26:0/853315552 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f7a740543b0 con 0x7f7a800f5340 2021-11-03T18:19:42.841 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:19:42.841 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:19:42.841 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:19:42.841 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:19:42.842 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:19:42.842 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:19:42.842 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:19:42.842 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:19:42.843 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:19:42.843 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:19:42.843 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:19:42.843 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:19:42.844 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:19:42.844 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:19:42.844 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:19:42.844 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:19:42.845 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:19:42.845 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:19:42.846 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.843+0000 7f7a84c41700 1 -- 172.21.15.26:0/853315552 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7a680640b0 msgr2=0x7f7a68066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:19:42.846 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.843+0000 7f7a84c41700 1 --2- 172.21.15.26:0/853315552 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7a680640b0 0x7f7a68066570 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f7a8005f520 tx=0x7f7a78004d80).stop 2021-11-03T18:19:42.846 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.843+0000 7f7a84c41700 1 -- 172.21.15.26:0/853315552 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a800f5340 msgr2=0x7f7a80107420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:19:42.846 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.843+0000 7f7a84c41700 1 --2- 172.21.15.26:0/853315552 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a800f5340 0x7f7a80107420 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7f7a74013a70 tx=0x7f7a74009b30).stop 2021-11-03T18:19:42.847 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.843+0000 7f7a84c41700 1 -- 172.21.15.26:0/853315552 shutdown_connections 2021-11-03T18:19:42.847 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.843+0000 7f7a84c41700 1 --2- 172.21.15.26:0/853315552 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7a680640b0 0x7f7a68066570 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:42.847 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.843+0000 7f7a84c41700 1 --2- 172.21.15.26:0/853315552 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a800f49a0 0x7f7a80106f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:42.847 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.843+0000 7f7a84c41700 1 --2- 172.21.15.26:0/853315552 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a800f5340 0x7f7a80107420 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:42.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.843+0000 7f7a84c41700 1 -- 172.21.15.26:0/853315552 >> 172.21.15.26:0/853315552 conn(0x7f7a800f04c0 msgr2=0x7f7a800fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:19:42.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.843+0000 7f7a84c41700 1 -- 172.21.15.26:0/853315552 shutdown_connections 2021-11-03T18:19:42.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.843+0000 7f7a84c41700 1 -- 172.21.15.26:0/853315552 wait complete. 2021-11-03T18:19:42.943 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.943+0000 7fe928294700 1 -- 172.21.15.26:0/4078287959 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9200f6860 msgr2=0x7fe9200f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:19:42.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.943+0000 7fe928294700 1 --2- 172.21.15.26:0/4078287959 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9200f6860 0x7fe9200f6cc0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7fe9100046e0 tx=0x7fe910009b30).stop 2021-11-03T18:19:42.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.943+0000 7fe928294700 1 -- 172.21.15.26:0/4078287959 shutdown_connections 2021-11-03T18:19:42.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.943+0000 7fe928294700 1 --2- 172.21.15.26:0/4078287959 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9200f6860 0x7fe9200f6cc0 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:42.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.943+0000 7fe928294700 1 --2- 172.21.15.26:0/4078287959 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9200f55c0 0x7fe9200f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:42.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.943+0000 7fe928294700 1 -- 172.21.15.26:0/4078287959 >> 172.21.15.26:0/4078287959 conn(0x7fe9200f0d40 msgr2=0x7fe9200f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:19:42.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.943+0000 7fe928294700 1 -- 172.21.15.26:0/4078287959 shutdown_connections 2021-11-03T18:19:42.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.943+0000 7fe928294700 1 -- 172.21.15.26:0/4078287959 wait complete. 2021-11-03T18:19:42.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.943+0000 7fe928294700 1 Processor -- start 2021-11-03T18:19:42.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.943+0000 7fe928294700 1 -- start start 2021-11-03T18:19:42.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.943+0000 7fe928294700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9200f55c0 0x7fe920104d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:19:42.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.944+0000 7fe928294700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9200f6860 0x7fe920105280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:19:42.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.944+0000 7fe928294700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe920105880 con 0x7fe9200f55c0 2021-11-03T18:19:42.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.944+0000 7fe928294700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9201060c0 con 0x7fe9200f6860 2021-11-03T18:19:42.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.944+0000 7fe926030700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9200f55c0 0x7fe920104d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:19:42.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.944+0000 7fe926030700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9200f55c0 0x7fe920104d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59426/0 (socket says 172.21.15.26:59426) 2021-11-03T18:19:42.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.944+0000 7fe926030700 1 -- 172.21.15.26:0/1997674397 learned_addr learned my addr 172.21.15.26:0/1997674397 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:19:42.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.944+0000 7fe92582f700 1 --2- 172.21.15.26:0/1997674397 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9200f6860 0x7fe920105280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:19:42.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.944+0000 7fe926030700 1 -- 172.21.15.26:0/1997674397 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9200f6860 msgr2=0x7fe920105280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:19:42.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.944+0000 7fe926030700 1 --2- 172.21.15.26:0/1997674397 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9200f6860 0x7fe920105280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:42.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.944+0000 7fe926030700 1 -- 172.21.15.26:0/1997674397 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe910005040 con 0x7fe9200f55c0 2021-11-03T18:19:42.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.944+0000 7fe926030700 1 --2- 172.21.15.26:0/1997674397 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9200f55c0 0x7fe920104d90 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 rx=0x7fe91800d7f0 tx=0x7fe918004e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:19:42.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.944+0000 7fe916ffd700 1 -- 172.21.15.26:0/1997674397 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe91800f490 con 0x7fe9200f55c0 2021-11-03T18:19:42.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.944+0000 7fe916ffd700 1 -- 172.21.15.26:0/1997674397 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe91800f040 con 0x7fe9200f55c0 2021-11-03T18:19:42.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.944+0000 7fe916ffd700 1 -- 172.21.15.26:0/1997674397 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9180139b0 con 0x7fe9200f55c0 2021-11-03T18:19:42.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.944+0000 7fe928294700 1 -- 172.21.15.26:0/1997674397 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9201063a0 con 0x7fe9200f55c0 2021-11-03T18:19:42.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.944+0000 7fe928294700 1 -- 172.21.15.26:0/1997674397 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9201068b0 con 0x7fe9200f55c0 2021-11-03T18:19:42.951 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.945+0000 7fe928294700 1 -- 172.21.15.26:0/1997674397 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9200f49b0 con 0x7fe9200f55c0 2021-11-03T18:19:42.951 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.946+0000 7fe916ffd700 1 -- 172.21.15.26:0/1997674397 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fe91801a030 con 0x7fe9200f55c0 2021-11-03T18:19:42.951 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.946+0000 7fe916ffd700 1 --2- 172.21.15.26:0/1997674397 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe90c0640b0 0x7fe90c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:19:42.951 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.946+0000 7fe916ffd700 1 -- 172.21.15.26:0/1997674397 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fe9180806e0 con 0x7fe9200f55c0 2021-11-03T18:19:42.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.946+0000 7fe92582f700 1 --2- 172.21.15.26:0/1997674397 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe90c0640b0 0x7fe90c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:19:42.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.946+0000 7fe92582f700 1 --2- 172.21.15.26:0/1997674397 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe90c0640b0 0x7fe90c066570 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7fe9100117c0 tx=0x7fe910009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:19:42.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:42.950+0000 7fe916ffd700 1 -- 172.21.15.26:0/1997674397 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fe918052950 con 0x7fe9200f55c0 2021-11-03T18:19:43.151 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:43.152+0000 7fe928294700 1 -- 172.21.15.26:0/1997674397 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe9200008d0 con 0x7fe9200f55c0 2021-11-03T18:19:43.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:43.153+0000 7fe916ffd700 1 -- 172.21.15.26:0/1997674397 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fe918018020 con 0x7fe9200f55c0 2021-11-03T18:19:43.152 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:19:43.153 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:19:43.153 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:19:43.153 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:19:43.153 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:19:43.154 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:19:43.154 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:19:43.154 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:19:43.154 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:19:43.154 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:19:43.155 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:19:43.155 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:19:43.155 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:19:43.155 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:19:43.156 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:19:43.156 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:19:43.156 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:19:43.156 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:19:43.156 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:19:43.157 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:19:43.157 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:19:43.157 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:19:43.157 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:19:43.157 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:19:43.158 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:19:43.158 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:19:43.158 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:19:43.158 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:19:43.159 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:19:43.159 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:19:43.159 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:19:43.159 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:19:43.159 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:19:43.160 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:19:43.160 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:19:43.161 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:19:43.161 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:19:43.161 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:19:43.161 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:19:43.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:43.154+0000 7fe928294700 1 -- 172.21.15.26:0/1997674397 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe90c0640b0 msgr2=0x7fe90c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:19:43.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:43.154+0000 7fe928294700 1 --2- 172.21.15.26:0/1997674397 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe90c0640b0 0x7fe90c066570 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7fe9100117c0 tx=0x7fe910009b30).stop 2021-11-03T18:19:43.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:43.154+0000 7fe928294700 1 -- 172.21.15.26:0/1997674397 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9200f55c0 msgr2=0x7fe920104d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:19:43.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:43.154+0000 7fe928294700 1 --2- 172.21.15.26:0/1997674397 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9200f55c0 0x7fe920104d90 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 rx=0x7fe91800d7f0 tx=0x7fe918004e80).stop 2021-11-03T18:19:43.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:43.155+0000 7fe928294700 1 -- 172.21.15.26:0/1997674397 shutdown_connections 2021-11-03T18:19:43.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:43.155+0000 7fe928294700 1 --2- 172.21.15.26:0/1997674397 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe90c0640b0 0x7fe90c066570 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:43.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:43.155+0000 7fe928294700 1 --2- 172.21.15.26:0/1997674397 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9200f55c0 0x7fe920104d90 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:43.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:43.155+0000 7fe928294700 1 --2- 172.21.15.26:0/1997674397 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9200f6860 0x7fe920105280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:19:43.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:43.155+0000 7fe928294700 1 -- 172.21.15.26:0/1997674397 >> 172.21.15.26:0/1997674397 conn(0x7fe9200f0d40 msgr2=0x7fe9200fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:19:43.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:43.155+0000 7fe928294700 1 -- 172.21.15.26:0/1997674397 shutdown_connections 2021-11-03T18:19:43.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:19:43.155+0000 7fe928294700 1 -- 172.21.15.26:0/1997674397 wait complete. 2021-11-03T18:19:43.165 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:19:43.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:43 smithi194 ceph-mon[65619]: pgmap v2551: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:43.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:43 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/853315552' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:19:43.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:43 smithi026 ceph-mon[96795]: pgmap v2551: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:43.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:43 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/853315552' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:19:44.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:44 smithi026 ceph-mon[96795]: from='client.36764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:19:44.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:44 smithi026 ceph-mon[96795]: from='client.36768 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:19:44.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:44 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1997674397' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:19:44.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:44 smithi194 ceph-mon[65619]: from='client.36764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:19:44.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:44 smithi194 ceph-mon[65619]: from='client.36768 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:19:44.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:44 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1997674397' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:19:45.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:45 smithi026 ceph-mon[96795]: pgmap v2552: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:45.508 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:45 smithi194 ceph-mon[65619]: pgmap v2552: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:47.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:47 smithi026 ceph-mon[96795]: pgmap v2553: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:47.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:47 smithi194 ceph-mon[65619]: pgmap v2553: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:49.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:49 smithi026 ceph-mon[96795]: pgmap v2554: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:19:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:19:49.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:49 smithi194 ceph-mon[65619]: pgmap v2554: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:19:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:19:51.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:51 smithi026 ceph-mon[96795]: pgmap v2555: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:51.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:51 smithi194 ceph-mon[65619]: pgmap v2555: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:53.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:53 smithi026 ceph-mon[96795]: pgmap v2556: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:53.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:53 smithi194 ceph-mon[65619]: pgmap v2556: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:55.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:55 smithi026 ceph-mon[96795]: pgmap v2557: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:55.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:19:55.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:55 smithi194 ceph-mon[65619]: pgmap v2557: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:55.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:19:56.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:56 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:19:56.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:56 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:19:57.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:57 smithi026 ceph-mon[96795]: pgmap v2558: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:57.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:57 smithi194 ceph-mon[65619]: pgmap v2558: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:59.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:19:59 smithi026 ceph-mon[96795]: pgmap v2559: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:19:59.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:19:59 smithi194 ceph-mon[65619]: pgmap v2559: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:00.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:00 smithi026 conmon[96772]: 2021-11-03T18:19:59.999+0000 7f27986f6700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 2 daemons have recently crashed 2021-11-03T18:20:01.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:00 smithi026 ceph-mon[96795]: pgmap v2560: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:01.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:00 smithi026 ceph-mon[96795]: overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 2 daemons have recently crashed 2021-11-03T18:20:01.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:00 smithi194 ceph-mon[65619]: pgmap v2560: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:01.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:00 smithi194 ceph-mon[65619]: overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 2 daemons have recently crashed 2021-11-03T18:20:03.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:02 smithi026 ceph-mon[96795]: pgmap v2561: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:03.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:02 smithi194 ceph-mon[65619]: pgmap v2561: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:05.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:04 smithi026 ceph-mon[96795]: pgmap v2562: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:05.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:04 smithi194 ceph-mon[65619]: pgmap v2562: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:07.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:06 smithi026 ceph-mon[96795]: pgmap v2563: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:07.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:06 smithi194 ceph-mon[65619]: pgmap v2563: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:09.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:08 smithi026 ceph-mon[96795]: pgmap v2564: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:09.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:08 smithi194 ceph-mon[65619]: pgmap v2564: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:09.853 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:09 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:20:09.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:09 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:20:11.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:10 smithi026 ceph-mon[96795]: poll took 60043.029 ms: 1 events 2021-11-03T18:20:11.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:10 smithi026 ceph-mon[96795]: pgmap v2565: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:11.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:10 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:20:11.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:10 smithi194 ceph-mon[65619]: poll took 60043.029 ms: 1 events 2021-11-03T18:20:11.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:10 smithi194 ceph-mon[65619]: pgmap v2565: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:11.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:10 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:20:13.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:12 smithi026 ceph-mon[96795]: pgmap v2566: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:13.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:12 smithi194 ceph-mon[65619]: pgmap v2566: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:13.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.260+0000 7f2f3c95d700 1 -- 172.21.15.26:0/2192674293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f380f5430 msgr2=0x7f2f380f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:20:13.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.260+0000 7f2f3c95d700 1 --2- 172.21.15.26:0/2192674293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f380f5430 0x7f2f380f5850 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7f2f28004660 tx=0x7f2f28009b30).stop 2021-11-03T18:20:13.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.260+0000 7f2f3c95d700 1 -- 172.21.15.26:0/2192674293 shutdown_connections 2021-11-03T18:20:13.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.260+0000 7f2f3c95d700 1 --2- 172.21.15.26:0/2192674293 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f380f66d0 0x7f2f380f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:13.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.260+0000 7f2f3c95d700 1 --2- 172.21.15.26:0/2192674293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f380f5430 0x7f2f380f5850 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:13.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.260+0000 7f2f3c95d700 1 -- 172.21.15.26:0/2192674293 >> 172.21.15.26:0/2192674293 conn(0x7f2f380f0b90 msgr2=0x7f2f380f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:20:13.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.260+0000 7f2f3c95d700 1 -- 172.21.15.26:0/2192674293 shutdown_connections 2021-11-03T18:20:13.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.260+0000 7f2f3c95d700 1 -- 172.21.15.26:0/2192674293 wait complete. 2021-11-03T18:20:13.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.261+0000 7f2f3c95d700 1 Processor -- start 2021-11-03T18:20:13.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.261+0000 7f2f3c95d700 1 -- start start 2021-11-03T18:20:13.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.261+0000 7f2f3c95d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f380f5430 0x7f2f38109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:20:13.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.261+0000 7f2f3c95d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f380f66d0 0x7f2f3810bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:20:13.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.261+0000 7f2f3c95d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f380603e0 con 0x7f2f380f66d0 2021-11-03T18:20:13.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.261+0000 7f2f3c95d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f38060520 con 0x7f2f380f5430 2021-11-03T18:20:13.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.261+0000 7f2f36ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f380f66d0 0x7f2f3810bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:20:13.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.261+0000 7f2f36ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f380f66d0 0x7f2f3810bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59444/0 (socket says 172.21.15.26:59444) 2021-11-03T18:20:13.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.262+0000 7f2f36ffd700 1 -- 172.21.15.26:0/1926122408 learned_addr learned my addr 172.21.15.26:0/1926122408 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:20:13.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.262+0000 7f2f377fe700 1 --2- 172.21.15.26:0/1926122408 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f380f5430 0x7f2f38109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:20:13.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.262+0000 7f2f36ffd700 1 -- 172.21.15.26:0/1926122408 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f380f5430 msgr2=0x7f2f38109a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:20:13.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.262+0000 7f2f36ffd700 1 --2- 172.21.15.26:0/1926122408 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f380f5430 0x7f2f38109a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:13.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.262+0000 7f2f36ffd700 1 -- 172.21.15.26:0/1926122408 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f28005040 con 0x7f2f380f66d0 2021-11-03T18:20:13.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.262+0000 7f2f36ffd700 1 --2- 172.21.15.26:0/1926122408 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f380f66d0 0x7f2f3810bf90 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7f2f2c0026d0 tx=0x7f2f2c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:20:13.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.262+0000 7f2f1ffff700 1 -- 172.21.15.26:0/1926122408 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f2c009320 con 0x7f2f380f66d0 2021-11-03T18:20:13.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.262+0000 7f2f3c95d700 1 -- 172.21.15.26:0/1926122408 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f3810c540 con 0x7f2f380f66d0 2021-11-03T18:20:13.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.262+0000 7f2f1ffff700 1 -- 172.21.15.26:0/1926122408 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2f2c00f040 con 0x7f2f380f66d0 2021-11-03T18:20:13.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.262+0000 7f2f1ffff700 1 -- 172.21.15.26:0/1926122408 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f2c0147e0 con 0x7f2f380f66d0 2021-11-03T18:20:13.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.262+0000 7f2f3c95d700 1 -- 172.21.15.26:0/1926122408 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f3810cb00 con 0x7f2f380f66d0 2021-11-03T18:20:13.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.263+0000 7f2f3c95d700 1 -- 172.21.15.26:0/1926122408 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f38045ad0 con 0x7f2f380f66d0 2021-11-03T18:20:13.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.264+0000 7f2f1ffff700 1 -- 172.21.15.26:0/1926122408 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f2f2c014aa0 con 0x7f2f380f66d0 2021-11-03T18:20:13.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.264+0000 7f2f1ffff700 1 --2- 172.21.15.26:0/1926122408 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2f20064100 0x7f2f200665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:20:13.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.264+0000 7f2f1ffff700 1 -- 172.21.15.26:0/1926122408 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f2f2c080ee0 con 0x7f2f380f66d0 2021-11-03T18:20:13.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.264+0000 7f2f377fe700 1 --2- 172.21.15.26:0/1926122408 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2f20064100 0x7f2f200665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:20:13.268 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.265+0000 7f2f377fe700 1 --2- 172.21.15.26:0/1926122408 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2f20064100 0x7f2f200665c0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7f2f28004e30 tx=0x7f2f28009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:20:13.268 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.269+0000 7f2f1ffff700 1 -- 172.21.15.26:0/1926122408 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f2f2c053240 con 0x7f2f380f66d0 2021-11-03T18:20:13.454 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.454+0000 7f2f3c95d700 1 -- 172.21.15.26:0/1926122408 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f38057f10 con 0x7f2f20064100 2021-11-03T18:20:13.454 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.455+0000 7f2f1ffff700 1 -- 172.21.15.26:0/1926122408 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f2f38057f10 con 0x7f2f20064100 2021-11-03T18:20:13.455 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.457+0000 7f2f3c95d700 1 -- 172.21.15.26:0/1926122408 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2f20064100 msgr2=0x7f2f200665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:20:13.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.457+0000 7f2f3c95d700 1 --2- 172.21.15.26:0/1926122408 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2f20064100 0x7f2f200665c0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7f2f28004e30 tx=0x7f2f28009b30).stop 2021-11-03T18:20:13.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.457+0000 7f2f3c95d700 1 -- 172.21.15.26:0/1926122408 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f380f66d0 msgr2=0x7f2f3810bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:20:13.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.457+0000 7f2f3c95d700 1 --2- 172.21.15.26:0/1926122408 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f380f66d0 0x7f2f3810bf90 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7f2f2c0026d0 tx=0x7f2f2c009de0).stop 2021-11-03T18:20:13.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.457+0000 7f2f3c95d700 1 -- 172.21.15.26:0/1926122408 shutdown_connections 2021-11-03T18:20:13.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.457+0000 7f2f3c95d700 1 --2- 172.21.15.26:0/1926122408 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2f20064100 0x7f2f200665c0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:13.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.457+0000 7f2f3c95d700 1 --2- 172.21.15.26:0/1926122408 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f380f5430 0x7f2f38109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:13.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.457+0000 7f2f3c95d700 1 --2- 172.21.15.26:0/1926122408 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f380f66d0 0x7f2f3810bf90 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:13.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.457+0000 7f2f3c95d700 1 -- 172.21.15.26:0/1926122408 >> 172.21.15.26:0/1926122408 conn(0x7f2f380f0b90 msgr2=0x7f2f380fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:20:13.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.457+0000 7f2f3c95d700 1 -- 172.21.15.26:0/1926122408 shutdown_connections 2021-11-03T18:20:13.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.457+0000 7f2f3c95d700 1 -- 172.21.15.26:0/1926122408 wait complete. 2021-11-03T18:20:13.465 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:20:13.564 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.564+0000 7f08f4a9f700 1 -- 172.21.15.26:0/465916270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08f00f5440 msgr2=0x7f08f00f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:20:13.564 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.564+0000 7f08f4a9f700 1 --2- 172.21.15.26:0/465916270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08f00f5440 0x7f08f00f5860 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7f08e0004660 tx=0x7f08e0009b30).stop 2021-11-03T18:20:13.564 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.564+0000 7f08f4a9f700 1 -- 172.21.15.26:0/465916270 shutdown_connections 2021-11-03T18:20:13.565 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.564+0000 7f08f4a9f700 1 --2- 172.21.15.26:0/465916270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08f00f66e0 0x7f08f00f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:13.565 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.564+0000 7f08f4a9f700 1 --2- 172.21.15.26:0/465916270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08f00f5440 0x7f08f00f5860 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:13.565 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.564+0000 7f08f4a9f700 1 -- 172.21.15.26:0/465916270 >> 172.21.15.26:0/465916270 conn(0x7f08f00f0ba0 msgr2=0x7f08f00f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:20:13.565 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.564+0000 7f08f4a9f700 1 -- 172.21.15.26:0/465916270 shutdown_connections 2021-11-03T18:20:13.566 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.564+0000 7f08f4a9f700 1 -- 172.21.15.26:0/465916270 wait complete. 2021-11-03T18:20:13.566 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.565+0000 7f08f4a9f700 1 Processor -- start 2021-11-03T18:20:13.566 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.565+0000 7f08f4a9f700 1 -- start start 2021-11-03T18:20:13.567 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.565+0000 7f08f4a9f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08f00f5440 0x7f08f0106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:20:13.567 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.565+0000 7f08f4a9f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08f00f66e0 0x7f08f0107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:20:13.567 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.565+0000 7f08f4a9f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f0107880 con 0x7f08f00f66e0 2021-11-03T18:20:13.567 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.565+0000 7f08f4a9f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f0108090 con 0x7f08f00f5440 2021-11-03T18:20:13.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.565+0000 7f08eeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08f00f66e0 0x7f08f0107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:20:13.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.565+0000 7f08eeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08f00f66e0 0x7f08f0107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59454/0 (socket says 172.21.15.26:59454) 2021-11-03T18:20:13.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.565+0000 7f08eeffd700 1 -- 172.21.15.26:0/3861277497 learned_addr learned my addr 172.21.15.26:0/3861277497 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:20:13.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.565+0000 7f08ef7fe700 1 --2- 172.21.15.26:0/3861277497 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08f00f5440 0x7f08f0106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:20:13.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.566+0000 7f08eeffd700 1 -- 172.21.15.26:0/3861277497 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08f00f5440 msgr2=0x7f08f0106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:20:13.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.566+0000 7f08eeffd700 1 --2- 172.21.15.26:0/3861277497 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08f00f5440 0x7f08f0106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:13.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.566+0000 7f08eeffd700 1 -- 172.21.15.26:0/3861277497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e0005040 con 0x7f08f00f66e0 2021-11-03T18:20:13.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.566+0000 7f08eeffd700 1 --2- 172.21.15.26:0/3861277497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08f00f66e0 0x7f08f0107280 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 rx=0x7f08e400e7f0 tx=0x7f08e400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:20:13.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.566+0000 7f08d7fff700 1 -- 172.21.15.26:0/3861277497 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08e40092e0 con 0x7f08f00f66e0 2021-11-03T18:20:13.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.566+0000 7f08d7fff700 1 -- 172.21.15.26:0/3861277497 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f08e400f040 con 0x7f08f00f66e0 2021-11-03T18:20:13.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.566+0000 7f08d7fff700 1 -- 172.21.15.26:0/3861277497 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08e4014750 con 0x7f08f00f66e0 2021-11-03T18:20:13.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.566+0000 7f08f4a9f700 1 -- 172.21.15.26:0/3861277497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f0108310 con 0x7f08f00f66e0 2021-11-03T18:20:13.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.566+0000 7f08f4a9f700 1 -- 172.21.15.26:0/3861277497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f0108880 con 0x7f08f00f66e0 2021-11-03T18:20:13.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.567+0000 7f08f4a9f700 1 -- 172.21.15.26:0/3861277497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08f0059100 con 0x7f08f00f66e0 2021-11-03T18:20:13.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.568+0000 7f08d7fff700 1 -- 172.21.15.26:0/3861277497 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f08e401b030 con 0x7f08f00f66e0 2021-11-03T18:20:13.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.568+0000 7f08d7fff700 1 --2- 172.21.15.26:0/3861277497 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f08d8064100 0x7f08d80665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:20:13.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.568+0000 7f08d7fff700 1 -- 172.21.15.26:0/3861277497 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f08e4080670 con 0x7f08f00f66e0 2021-11-03T18:20:13.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.568+0000 7f08ef7fe700 1 --2- 172.21.15.26:0/3861277497 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f08d8064100 0x7f08d80665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:20:13.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.569+0000 7f08ef7fe700 1 --2- 172.21.15.26:0/3861277497 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f08d8064100 0x7f08d80665c0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7f08e0000c00 tx=0x7f08e000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:20:13.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.573+0000 7f08d7fff700 1 -- 172.21.15.26:0/3861277497 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f08e4052990 con 0x7f08f00f66e0 2021-11-03T18:20:13.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.769+0000 7f08f4a9f700 1 -- 172.21.15.26:0/3861277497 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f08f005fd30 con 0x7f08d8064100 2021-11-03T18:20:13.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.783+0000 7f08d7fff700 1 -- 172.21.15.26:0/3861277497 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f08f005fd30 con 0x7f08d8064100 2021-11-03T18:20:13.782 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:20:13.782 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (91m) 10m ago 92m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:20:13.782 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (83m) 10m ago 92m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:20:13.783 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (83m) 9m ago 91m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:20:13.783 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (91m) 10m ago 92m 42.0M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:20:13.783 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (84m) 10m ago 87m 25.8M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:20:13.783 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (84m) 10m ago 87m 26.4M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:20:13.784 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (87m) 9m ago 87m 26.6M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:20:13.784 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (87m) 9m ago 87m 27.0M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:20:13.784 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (85m) 10m ago 94m 574M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:20:13.784 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (84m) 9m ago 91m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:20:13.785 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (84m) 10m ago 94m 308M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:20:13.785 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (84m) 9m ago 91m 145M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:20:13.785 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (92m) 10m ago 92m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:20:13.785 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (91m) 9m ago 91m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:20:13.786 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (83m) 10m ago 91m 312M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:20:13.786 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (82m) 10m ago 90m 335M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:20:13.786 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (82m) 10m ago 90m 279M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:20:13.786 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (81m) 9m ago 90m 362M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:20:13.787 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (81m) 9m ago 89m 302M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:20:13.787 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (80m) 9m ago 89m 296M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:20:13.787 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (91m) 10m ago 92m 63.4M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:20:13.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.785+0000 7f08f4a9f700 1 -- 172.21.15.26:0/3861277497 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f08d8064100 msgr2=0x7f08d80665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:20:13.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.785+0000 7f08f4a9f700 1 --2- 172.21.15.26:0/3861277497 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f08d8064100 0x7f08d80665c0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7f08e0000c00 tx=0x7f08e000b040).stop 2021-11-03T18:20:13.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.785+0000 7f08f4a9f700 1 -- 172.21.15.26:0/3861277497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08f00f66e0 msgr2=0x7f08f0107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:20:13.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.785+0000 7f08f4a9f700 1 --2- 172.21.15.26:0/3861277497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08f00f66e0 0x7f08f0107280 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 rx=0x7f08e400e7f0 tx=0x7f08e400b040).stop 2021-11-03T18:20:13.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.786+0000 7f08f4a9f700 1 -- 172.21.15.26:0/3861277497 shutdown_connections 2021-11-03T18:20:13.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.786+0000 7f08f4a9f700 1 --2- 172.21.15.26:0/3861277497 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f08d8064100 0x7f08d80665c0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:13.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.786+0000 7f08f4a9f700 1 --2- 172.21.15.26:0/3861277497 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08f00f5440 0x7f08f0106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:13.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.786+0000 7f08f4a9f700 1 --2- 172.21.15.26:0/3861277497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08f00f66e0 0x7f08f0107280 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:13.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.786+0000 7f08f4a9f700 1 -- 172.21.15.26:0/3861277497 >> 172.21.15.26:0/3861277497 conn(0x7f08f00f0ba0 msgr2=0x7f08f005f620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:20:13.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.786+0000 7f08f4a9f700 1 -- 172.21.15.26:0/3861277497 shutdown_connections 2021-11-03T18:20:13.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.786+0000 7f08f4a9f700 1 -- 172.21.15.26:0/3861277497 wait complete. 2021-11-03T18:20:13.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.901+0000 7f77e3bc2700 1 -- 172.21.15.26:0/145196059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77dc0f55e0 msgr2=0x7f77dc0f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:20:13.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.901+0000 7f77e3bc2700 1 --2- 172.21.15.26:0/145196059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77dc0f55e0 0x7f77dc0f5a00 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 rx=0x7f77d8004660 tx=0x7f77d8009b30).stop 2021-11-03T18:20:13.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.902+0000 7f77e3bc2700 1 -- 172.21.15.26:0/145196059 shutdown_connections 2021-11-03T18:20:13.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.902+0000 7f77e3bc2700 1 --2- 172.21.15.26:0/145196059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77dc0f5ef0 0x7f77dc0f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:20:13.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.902+0000 7f77e3bc2700 1 --2- 172.21.15.26:0/145196059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77dc0f55e0 0x7f77dc0f5a00 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:13.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.902+0000 7f77e3bc2700 1 -- 172.21.15.26:0/145196059 >> 172.21.15.26:0/145196059 conn(0x7f77dc0f0de0 msgr2=0x7f77dc0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:20:13.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.902+0000 7f77e3bc2700 1 -- 172.21.15.26:0/145196059 shutdown_connections 2021-11-03T18:20:13.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.902+0000 7f77e3bc2700 1 -- 172.21.15.26:0/145196059 wait complete. 2021-11-03T18:20:13.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.902+0000 7f77e3bc2700 1 Processor -- start 2021-11-03T18:20:13.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.902+0000 7f77e3bc2700 1 -- start start 2021-11-03T18:20:13.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.903+0000 7f77e3bc2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77dc0f55e0 0x7f77dc10c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:20:13.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.903+0000 7f77e3bc2700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77dc0f5ef0 0x7f77dc10e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:20:13.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.903+0000 7f77e3bc2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77dc0603b0 con 0x7f77dc0f55e0 2021-11-03T18:20:13.906 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.903+0000 7f77e3bc2700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77dc0604f0 con 0x7f77dc0f5ef0 2021-11-03T18:20:13.906 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.903+0000 7f77e195e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77dc0f55e0 0x7f77dc10c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:20:13.906 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.903+0000 7f77e195e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77dc0f55e0 0x7f77dc10c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59462/0 (socket says 172.21.15.26:59462) 2021-11-03T18:20:13.906 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.903+0000 7f77e195e700 1 -- 172.21.15.26:0/3072906107 learned_addr learned my addr 172.21.15.26:0/3072906107 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:20:13.907 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.903+0000 7f77e115d700 1 --2- 172.21.15.26:0/3072906107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77dc0f5ef0 0x7f77dc10e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:20:13.907 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.903+0000 7f77e195e700 1 -- 172.21.15.26:0/3072906107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77dc0f5ef0 msgr2=0x7f77dc10e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:20:13.907 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.903+0000 7f77e195e700 1 --2- 172.21.15.26:0/3072906107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77dc0f5ef0 0x7f77dc10e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:13.907 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.903+0000 7f77e195e700 1 -- 172.21.15.26:0/3072906107 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d8005040 con 0x7f77dc0f55e0 2021-11-03T18:20:13.907 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.903+0000 7f77e115d700 1 --2- 172.21.15.26:0/3072906107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77dc0f5ef0 0x7f77dc10e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:20:13.908 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.903+0000 7f77e195e700 1 --2- 172.21.15.26:0/3072906107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77dc0f55e0 0x7f77dc10c090 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 rx=0x7f77d8009990 tx=0x7f77d8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:20:13.908 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.903+0000 7f77d27fc700 1 -- 172.21.15.26:0/3072906107 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77d8018070 con 0x7f77dc0f55e0 2021-11-03T18:20:13.908 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.904+0000 7f77e3bc2700 1 -- 172.21.15.26:0/3072906107 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77dc10ea80 con 0x7f77dc0f55e0 2021-11-03T18:20:13.908 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.904+0000 7f77e3bc2700 1 -- 172.21.15.26:0/3072906107 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77dc10eea0 con 0x7f77dc0f55e0 2021-11-03T18:20:13.909 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.905+0000 7f77d27fc700 1 -- 172.21.15.26:0/3072906107 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f77d8004490 con 0x7f77dc0f55e0 2021-11-03T18:20:13.909 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.905+0000 7f77d27fc700 1 -- 172.21.15.26:0/3072906107 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77d801c620 con 0x7f77dc0f55e0 2021-11-03T18:20:13.909 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.905+0000 7f77e3bc2700 1 -- 172.21.15.26:0/3072906107 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77c4004fa0 con 0x7f77dc0f55e0 2021-11-03T18:20:13.909 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.906+0000 7f77d27fc700 1 -- 172.21.15.26:0/3072906107 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f77d801c8e0 con 0x7f77dc0f55e0 2021-11-03T18:20:13.909 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.906+0000 7f77d27fc700 1 --2- 172.21.15.26:0/3072906107 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f77c80640b0 0x7f77c8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:20:13.910 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.907+0000 7f77d27fc700 1 -- 172.21.15.26:0/3072906107 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f77d8082590 con 0x7f77dc0f55e0 2021-11-03T18:20:13.910 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.907+0000 7f77e115d700 1 --2- 172.21.15.26:0/3072906107 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f77c80640b0 0x7f77c8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:20:13.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.907+0000 7f77e115d700 1 --2- 172.21.15.26:0/3072906107 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f77c80640b0 0x7f77c8066570 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f77cc00a7e0 tx=0x7f77cc008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:20:13.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:13.911+0000 7f77d27fc700 1 -- 172.21.15.26:0/3072906107 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f77d80548f0 con 0x7f77dc0f55e0 2021-11-03T18:20:14.151 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.153+0000 7f77e3bc2700 1 -- 172.21.15.26:0/3072906107 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f77c4005e80 con 0x7f77dc0f55e0 2021-11-03T18:20:14.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.154+0000 7f77d27fc700 1 -- 172.21.15.26:0/3072906107 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f77d80544e0 con 0x7f77dc0f55e0 2021-11-03T18:20:14.152 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:20:14.153 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:20:14.153 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:20:14.153 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:20:14.153 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:20:14.154 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:20:14.154 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:20:14.154 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:20:14.154 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:20:14.154 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:20:14.155 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:20:14.155 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:20:14.155 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:20:14.155 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:20:14.156 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:20:14.156 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:20:14.156 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:20:14.156 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:20:14.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.156+0000 7f77e3bc2700 1 -- 172.21.15.26:0/3072906107 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f77c80640b0 msgr2=0x7f77c8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:20:14.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.156+0000 7f77e3bc2700 1 --2- 172.21.15.26:0/3072906107 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f77c80640b0 0x7f77c8066570 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f77cc00a7e0 tx=0x7f77cc008040).stop 2021-11-03T18:20:14.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.156+0000 7f77e3bc2700 1 -- 172.21.15.26:0/3072906107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77dc0f55e0 msgr2=0x7f77dc10c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:20:14.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.156+0000 7f77e3bc2700 1 --2- 172.21.15.26:0/3072906107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77dc0f55e0 0x7f77dc10c090 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 rx=0x7f77d8009990 tx=0x7f77d8009b30).stop 2021-11-03T18:20:14.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.156+0000 7f77e3bc2700 1 -- 172.21.15.26:0/3072906107 shutdown_connections 2021-11-03T18:20:14.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.156+0000 7f77e3bc2700 1 --2- 172.21.15.26:0/3072906107 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f77c80640b0 0x7f77c8066570 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:14.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.156+0000 7f77e3bc2700 1 --2- 172.21.15.26:0/3072906107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77dc0f55e0 0x7f77dc10c090 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:14.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.156+0000 7f77e3bc2700 1 --2- 172.21.15.26:0/3072906107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77dc0f5ef0 0x7f77dc10e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:14.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.156+0000 7f77e3bc2700 1 -- 172.21.15.26:0/3072906107 >> 172.21.15.26:0/3072906107 conn(0x7f77dc0f0de0 msgr2=0x7f77dc0fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:20:14.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.156+0000 7f77e3bc2700 1 -- 172.21.15.26:0/3072906107 shutdown_connections 2021-11-03T18:20:14.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.156+0000 7f77e3bc2700 1 -- 172.21.15.26:0/3072906107 wait complete. 2021-11-03T18:20:14.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.258+0000 7f7f569ca700 1 -- 172.21.15.26:0/1212636147 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f500f66d0 msgr2=0x7f7f500f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:20:14.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.258+0000 7f7f569ca700 1 --2- 172.21.15.26:0/1212636147 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f500f66d0 0x7f7f500f6b30 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 rx=0x7f7f40004660 tx=0x7f7f40009b30).stop 2021-11-03T18:20:14.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.258+0000 7f7f569ca700 1 -- 172.21.15.26:0/1212636147 shutdown_connections 2021-11-03T18:20:14.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.258+0000 7f7f569ca700 1 --2- 172.21.15.26:0/1212636147 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f500f66d0 0x7f7f500f6b30 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:14.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.258+0000 7f7f569ca700 1 --2- 172.21.15.26:0/1212636147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f500f5430 0x7f7f500f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:14.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.258+0000 7f7f569ca700 1 -- 172.21.15.26:0/1212636147 >> 172.21.15.26:0/1212636147 conn(0x7f7f500f0b90 msgr2=0x7f7f500f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:20:14.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.258+0000 7f7f569ca700 1 -- 172.21.15.26:0/1212636147 shutdown_connections 2021-11-03T18:20:14.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.258+0000 7f7f569ca700 1 -- 172.21.15.26:0/1212636147 wait complete. 2021-11-03T18:20:14.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.258+0000 7f7f569ca700 1 Processor -- start 2021-11-03T18:20:14.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.258+0000 7f7f569ca700 1 -- start start 2021-11-03T18:20:14.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.259+0000 7f7f569ca700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f500f5430 0x7f7f500f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:20:14.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.259+0000 7f7f569ca700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f500f66d0 0x7f7f500f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:20:14.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.259+0000 7f7f569ca700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5010a9c0 con 0x7f7f500f66d0 2021-11-03T18:20:14.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.259+0000 7f7f569ca700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5010ab00 con 0x7f7f500f5430 2021-11-03T18:20:14.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.259+0000 7f7f559c8700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f500f5430 0x7f7f500f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:20:14.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.259+0000 7f7f559c8700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f500f5430 0x7f7f500f9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.26:35446/0 (socket says 172.21.15.26:35446) 2021-11-03T18:20:14.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.259+0000 7f7f559c8700 1 -- 172.21.15.26:0/2638016163 learned_addr learned my addr 172.21.15.26:0/2638016163 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:20:14.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.259+0000 7f7f551c7700 1 --2- 172.21.15.26:0/2638016163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f500f66d0 0x7f7f500f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:20:14.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.259+0000 7f7f559c8700 1 -- 172.21.15.26:0/2638016163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f500f66d0 msgr2=0x7f7f500f7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:20:14.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.259+0000 7f7f559c8700 1 --2- 172.21.15.26:0/2638016163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f500f66d0 0x7f7f500f7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:14.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.259+0000 7f7f559c8700 1 -- 172.21.15.26:0/2638016163 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f40005040 con 0x7f7f500f5430 2021-11-03T18:20:14.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.259+0000 7f7f559c8700 1 --2- 172.21.15.26:0/2638016163 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f500f5430 0x7f7f500f9590 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f7f4c002700 tx=0x7f7f4c009d80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:20:14.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.260+0000 7f7f467fc700 1 -- 172.21.15.26:0/2638016163 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f4c0079c0 con 0x7f7f500f5430 2021-11-03T18:20:14.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.260+0000 7f7f569ca700 1 -- 172.21.15.26:0/2638016163 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f500f7fc0 con 0x7f7f500f5430 2021-11-03T18:20:14.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.260+0000 7f7f467fc700 1 -- 172.21.15.26:0/2638016163 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7f4c00f040 con 0x7f7f500f5430 2021-11-03T18:20:14.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.260+0000 7f7f467fc700 1 -- 172.21.15.26:0/2638016163 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f4c014860 con 0x7f7f500f5430 2021-11-03T18:20:14.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.260+0000 7f7f569ca700 1 -- 172.21.15.26:0/2638016163 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f500f8580 con 0x7f7f500f5430 2021-11-03T18:20:14.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.261+0000 7f7f569ca700 1 -- 172.21.15.26:0/2638016163 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f50059100 con 0x7f7f500f5430 2021-11-03T18:20:14.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.261+0000 7f7f467fc700 1 -- 172.21.15.26:0/2638016163 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f7f4c01b060 con 0x7f7f500f5430 2021-11-03T18:20:14.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.262+0000 7f7f467fc700 1 --2- 172.21.15.26:0/2638016163 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7f3c064100 0x7f7f3c0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:20:14.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.262+0000 7f7f467fc700 1 -- 172.21.15.26:0/2638016163 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f7f4c080660 con 0x7f7f500f5430 2021-11-03T18:20:14.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.262+0000 7f7f551c7700 1 --2- 172.21.15.26:0/2638016163 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7f3c064100 0x7f7f3c0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:20:14.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.262+0000 7f7f551c7700 1 --2- 172.21.15.26:0/2638016163 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7f3c064100 0x7f7f3c0665c0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7f7f40004630 tx=0x7f7f40009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:20:14.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.266+0000 7f7f467fc700 1 -- 172.21.15.26:0/2638016163 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f7f4c0529c0 con 0x7f7f500f5430 2021-11-03T18:20:14.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.492+0000 7f7f569ca700 1 -- 172.21.15.26:0/2638016163 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7f50113970 con 0x7f7f500f5430 2021-11-03T18:20:14.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.493+0000 7f7f467fc700 1 -- 172.21.15.26:0/2638016163 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f7f4c019070 con 0x7f7f500f5430 2021-11-03T18:20:14.491 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:20:14.492 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:20:14.492 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:20:14.492 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:20:14.492 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:20:14.493 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:20:14.493 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:20:14.493 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:20:14.493 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:20:14.494 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:20:14.494 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:20:14.494 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:20:14.494 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:20:14.495 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:20:14.495 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:20:14.495 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:20:14.495 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:20:14.495 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:20:14.496 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:20:14.496 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:20:14.496 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:20:14.496 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:20:14.497 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:20:14.497 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:20:14.497 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:20:14.497 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:20:14.498 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:20:14.498 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:20:14.498 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:20:14.498 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:20:14.498 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:20:14.499 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:20:14.499 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:20:14.499 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:20:14.499 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:20:14.500 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:20:14.500 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:20:14.500 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:20:14.500 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:20:14.501 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.495+0000 7f7f569ca700 1 -- 172.21.15.26:0/2638016163 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7f3c064100 msgr2=0x7f7f3c0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:20:14.501 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.495+0000 7f7f569ca700 1 --2- 172.21.15.26:0/2638016163 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7f3c064100 0x7f7f3c0665c0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7f7f40004630 tx=0x7f7f40009b30).stop 2021-11-03T18:20:14.502 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.495+0000 7f7f569ca700 1 -- 172.21.15.26:0/2638016163 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f500f5430 msgr2=0x7f7f500f9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:20:14.502 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.495+0000 7f7f569ca700 1 --2- 172.21.15.26:0/2638016163 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f500f5430 0x7f7f500f9590 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f7f4c002700 tx=0x7f7f4c009d80).stop 2021-11-03T18:20:14.502 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.495+0000 7f7f569ca700 1 -- 172.21.15.26:0/2638016163 shutdown_connections 2021-11-03T18:20:14.502 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.495+0000 7f7f569ca700 1 --2- 172.21.15.26:0/2638016163 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7f3c064100 0x7f7f3c0665c0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:14.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.495+0000 7f7f569ca700 1 --2- 172.21.15.26:0/2638016163 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f500f5430 0x7f7f500f9590 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:14.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.495+0000 7f7f569ca700 1 --2- 172.21.15.26:0/2638016163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f500f66d0 0x7f7f500f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:14.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.495+0000 7f7f569ca700 1 -- 172.21.15.26:0/2638016163 >> 172.21.15.26:0/2638016163 conn(0x7f7f500f0b90 msgr2=0x7f7f5005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:20:14.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.495+0000 7f7f569ca700 1 -- 172.21.15.26:0/2638016163 shutdown_connections 2021-11-03T18:20:14.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:14.495+0000 7f7f569ca700 1 -- 172.21.15.26:0/2638016163 wait complete. 2021-11-03T18:20:14.504 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:20:14.924 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:14 smithi026 ceph-mon[96795]: from='client.36780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:20:14.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:14 smithi026 ceph-mon[96795]: pgmap v2567: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:14.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:14 smithi026 ceph-mon[96795]: from='client.36784 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:20:14.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:14 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3072906107' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:20:14.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:14 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2638016163' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:20:14.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:14 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:20:15.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:14 smithi194 ceph-mon[65619]: from='client.36780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:20:15.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:14 smithi194 ceph-mon[65619]: pgmap v2567: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:15.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:14 smithi194 ceph-mon[65619]: from='client.36784 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:20:15.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:14 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3072906107' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:20:15.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:14 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2638016163' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:20:15.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:14 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:20:16.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:16 smithi026 ceph-mon[96795]: poll took 4443.121 ms: 1 events 2021-11-03T18:20:16.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:16 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:20:16.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:16 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:20:16.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:16 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:20:16.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:16 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:20:16.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:16 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:20:16.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:16 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:20:16.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:16 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:20:16.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:16 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:20:16.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:16 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:20:16.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:16 smithi194 ceph-mon[65619]: poll took 4443.121 ms: 1 events 2021-11-03T18:20:16.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:16 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:20:16.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:16 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:20:16.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:16 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:20:16.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:16 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:20:16.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:16 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:20:16.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:16 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:20:16.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:16 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:20:16.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:16 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:20:16.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:16 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:20:17.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:17 smithi026 ceph-mon[96795]: pgmap v2568: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:17.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:17 smithi194 ceph-mon[65619]: pgmap v2568: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:19.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:19 smithi026 ceph-mon[96795]: pgmap v2569: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:19.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:19 smithi194 ceph-mon[65619]: pgmap v2569: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:21.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:21 smithi026 ceph-mon[96795]: pgmap v2570: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:21.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:21 smithi194 ceph-mon[65619]: pgmap v2570: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:23.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:23 smithi026 ceph-mon[96795]: pgmap v2571: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:23.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:23 smithi194 ceph-mon[65619]: pgmap v2571: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:25.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:25 smithi026 ceph-mon[96795]: pgmap v2572: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:25.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:25 smithi194 ceph-mon[65619]: pgmap v2572: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:27.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:27 smithi026 ceph-mon[96795]: pgmap v2573: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:27.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:27 smithi194 ceph-mon[65619]: pgmap v2573: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:29.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:29 smithi026 ceph-mon[96795]: pgmap v2574: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:29.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:29 smithi194 ceph-mon[65619]: pgmap v2574: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:31.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:30 smithi026 ceph-mon[96795]: pgmap v2575: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:31.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:30 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:20:31.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:30 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:20:31.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:30 smithi194 ceph-mon[65619]: pgmap v2575: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:31.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:30 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:20:31.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:30 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:20:33.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:32 smithi026 ceph-mon[96795]: pgmap v2576: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:33.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:32 smithi194 ceph-mon[65619]: pgmap v2576: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:35.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:34 smithi026 ceph-mon[96795]: pgmap v2577: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:35.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:34 smithi194 ceph-mon[65619]: pgmap v2577: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:37.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:36 smithi026 ceph-mon[96795]: pgmap v2578: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:37.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:36 smithi194 ceph-mon[65619]: pgmap v2578: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:39.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:38 smithi026 ceph-mon[96795]: pgmap v2579: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:39.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:38 smithi194 ceph-mon[65619]: pgmap v2579: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:41.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:40 smithi026 ceph-mon[96795]: pgmap v2580: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:41.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:40 smithi194 ceph-mon[65619]: pgmap v2580: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:43.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:42 smithi026 ceph-mon[96795]: pgmap v2581: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:43.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:42 smithi194 ceph-mon[65619]: pgmap v2581: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:44.610 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.608+0000 7f21f2c06700 1 -- 172.21.15.26:0/3435014974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21ec0f5340 msgr2=0x7f21ec0f7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:20:44.610 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.608+0000 7f21f2c06700 1 --2- 172.21.15.26:0/3435014974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21ec0f5340 0x7f21ec0f7ac0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 rx=0x7f21dc0099e0 tx=0x7f21dc004d10).stop 2021-11-03T18:20:44.610 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.608+0000 7f21f2c06700 1 -- 172.21.15.26:0/3435014974 shutdown_connections 2021-11-03T18:20:44.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.608+0000 7f21f2c06700 1 --2- 172.21.15.26:0/3435014974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21ec0f5340 0x7f21ec0f7ac0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:44.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.608+0000 7f21f2c06700 1 --2- 172.21.15.26:0/3435014974 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21ec0f49a0 0x7f21ec0f4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:44.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.608+0000 7f21f2c06700 1 -- 172.21.15.26:0/3435014974 >> 172.21.15.26:0/3435014974 conn(0x7f21ec0f04c0 msgr2=0x7f21ec0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:20:44.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.608+0000 7f21f2c06700 1 -- 172.21.15.26:0/3435014974 shutdown_connections 2021-11-03T18:20:44.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.608+0000 7f21f2c06700 1 -- 172.21.15.26:0/3435014974 wait complete. 2021-11-03T18:20:44.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.609+0000 7f21f2c06700 1 Processor -- start 2021-11-03T18:20:44.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.609+0000 7f21f2c06700 1 -- start start 2021-11-03T18:20:44.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.609+0000 7f21f2c06700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21ec0f49a0 0x7f21ec0f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:20:44.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.609+0000 7f21f2c06700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21ec0f5340 0x7f21ec0f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:20:44.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.609+0000 7f21f2c06700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ec0f5f30 con 0x7f21ec0f5340 2021-11-03T18:20:44.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.609+0000 7f21f2c06700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ec0f6070 con 0x7f21ec0f49a0 2021-11-03T18:20:44.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.609+0000 7f21ebfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21ec0f5340 0x7f21ec0f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:20:44.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.609+0000 7f21ebfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21ec0f5340 0x7f21ec0f59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59490/0 (socket says 172.21.15.26:59490) 2021-11-03T18:20:44.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.609+0000 7f21ebfff700 1 -- 172.21.15.26:0/1803787166 learned_addr learned my addr 172.21.15.26:0/1803787166 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:20:44.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.610+0000 7f21f09a2700 1 --2- 172.21.15.26:0/1803787166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21ec0f49a0 0x7f21ec0f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:20:44.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.610+0000 7f21ebfff700 1 -- 172.21.15.26:0/1803787166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21ec0f49a0 msgr2=0x7f21ec0f7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:20:44.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.610+0000 7f21ebfff700 1 --2- 172.21.15.26:0/1803787166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21ec0f49a0 0x7f21ec0f7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:44.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.610+0000 7f21ebfff700 1 -- 172.21.15.26:0/1803787166 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21dc009640 con 0x7f21ec0f5340 2021-11-03T18:20:44.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.610+0000 7f21f09a2700 1 --2- 172.21.15.26:0/1803787166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21ec0f49a0 0x7f21ec0f7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:20:44.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.610+0000 7f21ebfff700 1 --2- 172.21.15.26:0/1803787166 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21ec0f5340 0x7f21ec0f59d0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 rx=0x7f21dc00c010 tx=0x7f21dc004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:20:44.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.610+0000 7f21e97fa700 1 -- 172.21.15.26:0/1803787166 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21dc00e070 con 0x7f21ec0f5340 2021-11-03T18:20:44.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.610+0000 7f21e97fa700 1 -- 172.21.15.26:0/1803787166 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f21dc007dc0 con 0x7f21ec0f5340 2021-11-03T18:20:44.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.610+0000 7f21e97fa700 1 -- 172.21.15.26:0/1803787166 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21dc018070 con 0x7f21ec0f5340 2021-11-03T18:20:44.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.610+0000 7f21f2c06700 1 -- 172.21.15.26:0/1803787166 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21ec0f62f0 con 0x7f21ec0f5340 2021-11-03T18:20:44.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.610+0000 7f21f2c06700 1 -- 172.21.15.26:0/1803787166 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21ec0f67d0 con 0x7f21ec0f5340 2021-11-03T18:20:44.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.611+0000 7f21f2c06700 1 -- 172.21.15.26:0/1803787166 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21ec045ad0 con 0x7f21ec0f5340 2021-11-03T18:20:44.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.611+0000 7f21e97fa700 1 -- 172.21.15.26:0/1803787166 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f21dc024060 con 0x7f21ec0f5340 2021-11-03T18:20:44.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.612+0000 7f21e97fa700 1 --2- 172.21.15.26:0/1803787166 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f21d80640b0 0x7f21d8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:20:44.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.612+0000 7f21e97fa700 1 -- 172.21.15.26:0/1803787166 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f21dc082220 con 0x7f21ec0f5340 2021-11-03T18:20:44.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.612+0000 7f21f09a2700 1 --2- 172.21.15.26:0/1803787166 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f21d80640b0 0x7f21d8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:20:44.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.612+0000 7f21f09a2700 1 --2- 172.21.15.26:0/1803787166 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f21d80640b0 0x7f21d8066570 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7f21e4007fd0 tx=0x7f21e4009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:20:44.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.616+0000 7f21e97fa700 1 -- 172.21.15.26:0/1803787166 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f21dc054580 con 0x7f21ec0f5340 2021-11-03T18:20:44.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.795+0000 7f21f2c06700 1 -- 172.21.15.26:0/1803787166 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f21ec057f10 con 0x7f21d80640b0 2021-11-03T18:20:44.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.796+0000 7f21e97fa700 1 -- 172.21.15.26:0/1803787166 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f21ec057f10 con 0x7f21d80640b0 2021-11-03T18:20:44.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.798+0000 7f21f2c06700 1 -- 172.21.15.26:0/1803787166 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f21d80640b0 msgr2=0x7f21d8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:20:44.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.798+0000 7f21f2c06700 1 --2- 172.21.15.26:0/1803787166 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f21d80640b0 0x7f21d8066570 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7f21e4007fd0 tx=0x7f21e4009040).stop 2021-11-03T18:20:44.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.798+0000 7f21f2c06700 1 -- 172.21.15.26:0/1803787166 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21ec0f5340 msgr2=0x7f21ec0f59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:20:44.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.798+0000 7f21f2c06700 1 --2- 172.21.15.26:0/1803787166 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21ec0f5340 0x7f21ec0f59d0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 rx=0x7f21dc00c010 tx=0x7f21dc004d10).stop 2021-11-03T18:20:44.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.798+0000 7f21f2c06700 1 -- 172.21.15.26:0/1803787166 shutdown_connections 2021-11-03T18:20:44.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.798+0000 7f21f2c06700 1 --2- 172.21.15.26:0/1803787166 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f21d80640b0 0x7f21d8066570 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:44.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.798+0000 7f21f2c06700 1 --2- 172.21.15.26:0/1803787166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21ec0f49a0 0x7f21ec0f7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:44.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.798+0000 7f21f2c06700 1 --2- 172.21.15.26:0/1803787166 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21ec0f5340 0x7f21ec0f59d0 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:44.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.798+0000 7f21f2c06700 1 -- 172.21.15.26:0/1803787166 >> 172.21.15.26:0/1803787166 conn(0x7f21ec0f04c0 msgr2=0x7f21ec0fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:20:44.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.798+0000 7f21f2c06700 1 -- 172.21.15.26:0/1803787166 shutdown_connections 2021-11-03T18:20:44.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.798+0000 7f21f2c06700 1 -- 172.21.15.26:0/1803787166 wait complete. 2021-11-03T18:20:44.807 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:20:44.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.899+0000 7ffb20ac5700 1 -- 172.21.15.26:0/4268681734 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb1c0f6ff0 msgr2=0x7ffb1c0f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:20:44.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.899+0000 7ffb20ac5700 1 --2- 172.21.15.26:0/4268681734 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb1c0f6ff0 0x7ffb1c0f7a20 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 rx=0x7ffb04004660 tx=0x7ffb04009b30).stop 2021-11-03T18:20:44.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.899+0000 7ffb20ac5700 1 -- 172.21.15.26:0/4268681734 shutdown_connections 2021-11-03T18:20:44.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.899+0000 7ffb20ac5700 1 --2- 172.21.15.26:0/4268681734 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb1c0f6ff0 0x7ffb1c0f7a20 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:44.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.899+0000 7ffb20ac5700 1 --2- 172.21.15.26:0/4268681734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb1c0f66e0 0x7ffb1c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:44.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.899+0000 7ffb20ac5700 1 -- 172.21.15.26:0/4268681734 >> 172.21.15.26:0/4268681734 conn(0x7ffb1c0f1f00 msgr2=0x7ffb1c0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:20:44.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.899+0000 7ffb20ac5700 1 -- 172.21.15.26:0/4268681734 shutdown_connections 2021-11-03T18:20:44.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.899+0000 7ffb20ac5700 1 -- 172.21.15.26:0/4268681734 wait complete. 2021-11-03T18:20:44.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.900+0000 7ffb20ac5700 1 Processor -- start 2021-11-03T18:20:44.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.900+0000 7ffb20ac5700 1 -- start start 2021-11-03T18:20:44.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.900+0000 7ffb20ac5700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb1c0f66e0 0x7ffb1c106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:20:44.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.900+0000 7ffb20ac5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb1c0f6ff0 0x7ffb1c107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:20:44.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.900+0000 7ffb20ac5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c107a10 con 0x7ffb1c0f6ff0 2021-11-03T18:20:44.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.900+0000 7ffb20ac5700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c107b50 con 0x7ffb1c0f66e0 2021-11-03T18:20:44.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.900+0000 7ffb13fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb1c0f6ff0 0x7ffb1c107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:20:44.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.900+0000 7ffb13fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb1c0f6ff0 0x7ffb1c107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59500/0 (socket says 172.21.15.26:59500) 2021-11-03T18:20:44.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.900+0000 7ffb13fff700 1 -- 172.21.15.26:0/1468662427 learned_addr learned my addr 172.21.15.26:0/1468662427 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:20:44.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.900+0000 7ffb1a59c700 1 --2- 172.21.15.26:0/1468662427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb1c0f66e0 0x7ffb1c106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:20:44.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.900+0000 7ffb13fff700 1 -- 172.21.15.26:0/1468662427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb1c0f66e0 msgr2=0x7ffb1c106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:20:44.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.900+0000 7ffb13fff700 1 --2- 172.21.15.26:0/1468662427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb1c0f66e0 0x7ffb1c106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:44.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.901+0000 7ffb13fff700 1 -- 172.21.15.26:0/1468662427 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb04005040 con 0x7ffb1c0f6ff0 2021-11-03T18:20:44.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.901+0000 7ffb13fff700 1 --2- 172.21.15.26:0/1468662427 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb1c0f6ff0 0x7ffb1c107460 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7ffb04009990 tx=0x7ffb04009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:20:44.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.901+0000 7ffb12ffd700 1 -- 172.21.15.26:0/1468662427 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb04018070 con 0x7ffb1c0f6ff0 2021-11-03T18:20:44.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.901+0000 7ffb12ffd700 1 -- 172.21.15.26:0/1468662427 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ffb04007ba0 con 0x7ffb1c0f6ff0 2021-11-03T18:20:44.906 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.901+0000 7ffb20ac5700 1 -- 172.21.15.26:0/1468662427 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb1c108490 con 0x7ffb1c0f6ff0 2021-11-03T18:20:44.906 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.901+0000 7ffb12ffd700 1 -- 172.21.15.26:0/1468662427 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb0401c3c0 con 0x7ffb1c0f6ff0 2021-11-03T18:20:44.906 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.901+0000 7ffb20ac5700 1 -- 172.21.15.26:0/1468662427 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb1c1089f0 con 0x7ffb1c0f6ff0 2021-11-03T18:20:44.907 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.902+0000 7ffb20ac5700 1 -- 172.21.15.26:0/1468662427 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb1c045ad0 con 0x7ffb1c0f6ff0 2021-11-03T18:20:44.908 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.902+0000 7ffb12ffd700 1 -- 172.21.15.26:0/1468662427 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ffb0401d420 con 0x7ffb1c0f6ff0 2021-11-03T18:20:44.908 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.903+0000 7ffb12ffd700 1 --2- 172.21.15.26:0/1468662427 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffb080640b0 0x7ffb08066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:20:44.908 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.903+0000 7ffb12ffd700 1 -- 172.21.15.26:0/1468662427 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ffb04082510 con 0x7ffb1c0f6ff0 2021-11-03T18:20:44.908 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.903+0000 7ffb1a59c700 1 --2- 172.21.15.26:0/1468662427 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffb080640b0 0x7ffb08066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:20:44.909 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.903+0000 7ffb1a59c700 1 --2- 172.21.15.26:0/1468662427 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffb080640b0 0x7ffb08066570 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7ffb0c004c40 tx=0x7ffb0c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:20:44.909 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:44.907+0000 7ffb12ffd700 1 -- 172.21.15.26:0/1468662427 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ffb04054930 con 0x7ffb1c0f6ff0 2021-11-03T18:20:45.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.081+0000 7ffb20ac5700 1 -- 172.21.15.26:0/1468662427 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb1c0ff040 con 0x7ffb080640b0 2021-11-03T18:20:45.095 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.096+0000 7ffb12ffd700 1 -- 172.21.15.26:0/1468662427 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7ffb1c0ff040 con 0x7ffb080640b0 2021-11-03T18:20:45.095 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:20:45.095 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (91m) 30s ago 93m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:20:45.095 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (84m) 30s ago 93m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:20:45.096 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (84m) 9m ago 92m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:20:45.096 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (91m) 30s ago 92m 42.2M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:20:45.096 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (84m) 30s ago 88m 26.0M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:20:45.096 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (85m) 30s ago 88m 26.6M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:20:45.097 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (88m) 9m ago 88m 26.6M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:20:45.097 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (88m) 9m ago 88m 27.0M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:20:45.097 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (85m) 30s ago 94m 588M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:20:45.098 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (85m) 9m ago 92m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:20:45.098 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (85m) 30s ago 94m 341M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:20:45.098 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (84m) 9m ago 92m 145M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:20:45.098 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (92m) 30s ago 92m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:20:45.099 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (92m) 9m ago 92m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:20:45.099 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (83m) 30s ago 91m 332M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:20:45.099 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (83m) 30s ago 91m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:20:45.099 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (82m) 30s ago 90m 296M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:20:45.100 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (82m) 9m ago 90m 362M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:20:45.100 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (81m) 9m ago 90m 302M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:20:45.100 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (81m) 9m ago 89m 296M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:20:45.100 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (91m) 30s ago 92m 65.7M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:20:45.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.098+0000 7ffb20ac5700 1 -- 172.21.15.26:0/1468662427 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffb080640b0 msgr2=0x7ffb08066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:20:45.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.098+0000 7ffb20ac5700 1 --2- 172.21.15.26:0/1468662427 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffb080640b0 0x7ffb08066570 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7ffb0c004c40 tx=0x7ffb0c00b040).stop 2021-11-03T18:20:45.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.098+0000 7ffb20ac5700 1 -- 172.21.15.26:0/1468662427 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb1c0f6ff0 msgr2=0x7ffb1c107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:20:45.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.098+0000 7ffb20ac5700 1 --2- 172.21.15.26:0/1468662427 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb1c0f6ff0 0x7ffb1c107460 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7ffb04009990 tx=0x7ffb04009b30).stop 2021-11-03T18:20:45.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.098+0000 7ffb20ac5700 1 -- 172.21.15.26:0/1468662427 shutdown_connections 2021-11-03T18:20:45.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.098+0000 7ffb20ac5700 1 --2- 172.21.15.26:0/1468662427 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffb080640b0 0x7ffb08066570 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:45.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.098+0000 7ffb20ac5700 1 --2- 172.21.15.26:0/1468662427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb1c0f66e0 0x7ffb1c106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:45.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.098+0000 7ffb20ac5700 1 --2- 172.21.15.26:0/1468662427 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb1c0f6ff0 0x7ffb1c107460 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:45.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.098+0000 7ffb20ac5700 1 -- 172.21.15.26:0/1468662427 >> 172.21.15.26:0/1468662427 conn(0x7ffb1c0f1f00 msgr2=0x7ffb1c0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:20:45.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.098+0000 7ffb20ac5700 1 -- 172.21.15.26:0/1468662427 shutdown_connections 2021-11-03T18:20:45.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.098+0000 7ffb20ac5700 1 -- 172.21.15.26:0/1468662427 wait complete. 2021-11-03T18:20:45.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:44 smithi026 ceph-mon[96795]: pgmap v2582: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:45.200 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.197+0000 7f159cde8700 1 -- 172.21.15.26:0/3343510666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15980f5ef0 msgr2=0x7f15980f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:20:45.200 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.197+0000 7f159cde8700 1 --2- 172.21.15.26:0/3343510666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15980f5ef0 0x7f15980f6920 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 rx=0x7f158c004660 tx=0x7f158c009b30).stop 2021-11-03T18:20:45.200 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.197+0000 7f159cde8700 1 -- 172.21.15.26:0/3343510666 shutdown_connections 2021-11-03T18:20:45.200 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.197+0000 7f159cde8700 1 --2- 172.21.15.26:0/3343510666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15980f5ef0 0x7f15980f6920 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:45.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.197+0000 7f159cde8700 1 --2- 172.21.15.26:0/3343510666 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15980f55e0 0x7f15980f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:45.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.197+0000 7f159cde8700 1 -- 172.21.15.26:0/3343510666 >> 172.21.15.26:0/3343510666 conn(0x7f15980f0de0 msgr2=0x7f15980f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:20:45.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.197+0000 7f159cde8700 1 -- 172.21.15.26:0/3343510666 shutdown_connections 2021-11-03T18:20:45.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.197+0000 7f159cde8700 1 -- 172.21.15.26:0/3343510666 wait complete. 2021-11-03T18:20:45.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.198+0000 7f159cde8700 1 Processor -- start 2021-11-03T18:20:45.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.198+0000 7f159cde8700 1 -- start start 2021-11-03T18:20:45.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.198+0000 7f159cde8700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15980f55e0 0x7f159810c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:20:45.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.198+0000 7f159cde8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15980f5ef0 0x7f159810e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:20:45.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.198+0000 7f159cde8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15980603d0 con 0x7f15980f5ef0 2021-11-03T18:20:45.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.198+0000 7f159cde8700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1598060510 con 0x7f15980f55e0 2021-11-03T18:20:45.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.198+0000 7f1595d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15980f5ef0 0x7f159810e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:20:45.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.198+0000 7f1595d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15980f5ef0 0x7f159810e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59510/0 (socket says 172.21.15.26:59510) 2021-11-03T18:20:45.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.198+0000 7f1595d9b700 1 -- 172.21.15.26:0/1147292035 learned_addr learned my addr 172.21.15.26:0/1147292035 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:20:45.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.198+0000 7f159659c700 1 --2- 172.21.15.26:0/1147292035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15980f55e0 0x7f159810c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:20:45.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.198+0000 7f1595d9b700 1 -- 172.21.15.26:0/1147292035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15980f55e0 msgr2=0x7f159810c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:20:45.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.198+0000 7f1595d9b700 1 --2- 172.21.15.26:0/1147292035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15980f55e0 0x7f159810c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:45.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.198+0000 7f1595d9b700 1 -- 172.21.15.26:0/1147292035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f158c005040 con 0x7f15980f5ef0 2021-11-03T18:20:45.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.198+0000 7f1595d9b700 1 --2- 172.21.15.26:0/1147292035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15980f5ef0 0x7f159810e5b0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 rx=0x7f158c009990 tx=0x7f158c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:20:45.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.199+0000 7f1586ffd700 1 -- 172.21.15.26:0/1147292035 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f158c018070 con 0x7f15980f5ef0 2021-11-03T18:20:45.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.199+0000 7f159cde8700 1 -- 172.21.15.26:0/1147292035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f159810eaa0 con 0x7f15980f5ef0 2021-11-03T18:20:45.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.199+0000 7f1586ffd700 1 -- 172.21.15.26:0/1147292035 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f158c007ca0 con 0x7f15980f5ef0 2021-11-03T18:20:45.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.199+0000 7f1586ffd700 1 -- 172.21.15.26:0/1147292035 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f158c01c620 con 0x7f15980f5ef0 2021-11-03T18:20:45.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.199+0000 7f159cde8700 1 -- 172.21.15.26:0/1147292035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f159810ee70 con 0x7f15980f5ef0 2021-11-03T18:20:45.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.200+0000 7f159cde8700 1 -- 172.21.15.26:0/1147292035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1598045ad0 con 0x7f15980f5ef0 2021-11-03T18:20:45.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.200+0000 7f1586ffd700 1 -- 172.21.15.26:0/1147292035 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f158c01d960 con 0x7f15980f5ef0 2021-11-03T18:20:45.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.200+0000 7f1586ffd700 1 --2- 172.21.15.26:0/1147292035 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f15800640b0 0x7f1580066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:20:45.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.200+0000 7f1586ffd700 1 -- 172.21.15.26:0/1147292035 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f158c0825e0 con 0x7f15980f5ef0 2021-11-03T18:20:45.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.201+0000 7f159659c700 1 --2- 172.21.15.26:0/1147292035 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f15800640b0 0x7f1580066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:20:45.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.201+0000 7f159659c700 1 --2- 172.21.15.26:0/1147292035 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f15800640b0 0x7f1580066570 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7f1598060160 tx=0x7f1588009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:20:45.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.205+0000 7f1586ffd700 1 -- 172.21.15.26:0/1147292035 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f158c054940 con 0x7f15980f5ef0 2021-11-03T18:20:45.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:44 smithi194 ceph-mon[65619]: pgmap v2582: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:45.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.438+0000 7f159cde8700 1 -- 172.21.15.26:0/1147292035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f15980fde60 con 0x7f15980f5ef0 2021-11-03T18:20:45.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.439+0000 7f1586ffd700 1 -- 172.21.15.26:0/1147292035 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f158c054530 con 0x7f15980f5ef0 2021-11-03T18:20:45.438 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:20:45.438 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:20:45.439 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:20:45.439 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:20:45.439 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:20:45.439 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:20:45.440 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:20:45.440 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:20:45.440 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:20:45.440 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:20:45.441 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:20:45.441 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:20:45.441 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:20:45.441 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:20:45.441 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:20:45.442 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:20:45.442 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:20:45.443 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:20:45.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.441+0000 7f159cde8700 1 -- 172.21.15.26:0/1147292035 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f15800640b0 msgr2=0x7f1580066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:20:45.444 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.441+0000 7f159cde8700 1 --2- 172.21.15.26:0/1147292035 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f15800640b0 0x7f1580066570 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7f1598060160 tx=0x7f1588009040).stop 2021-11-03T18:20:45.444 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.441+0000 7f159cde8700 1 -- 172.21.15.26:0/1147292035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15980f5ef0 msgr2=0x7f159810e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:20:45.444 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.441+0000 7f159cde8700 1 --2- 172.21.15.26:0/1147292035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15980f5ef0 0x7f159810e5b0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 rx=0x7f158c009990 tx=0x7f158c009b30).stop 2021-11-03T18:20:45.444 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.441+0000 7f159cde8700 1 -- 172.21.15.26:0/1147292035 shutdown_connections 2021-11-03T18:20:45.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.441+0000 7f159cde8700 1 --2- 172.21.15.26:0/1147292035 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f15800640b0 0x7f1580066570 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:45.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.441+0000 7f159cde8700 1 --2- 172.21.15.26:0/1147292035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15980f55e0 0x7f159810c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:45.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.441+0000 7f159cde8700 1 --2- 172.21.15.26:0/1147292035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15980f5ef0 0x7f159810e5b0 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:45.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.441+0000 7f159cde8700 1 -- 172.21.15.26:0/1147292035 >> 172.21.15.26:0/1147292035 conn(0x7f15980f0de0 msgr2=0x7f15980fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:20:45.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.441+0000 7f159cde8700 1 -- 172.21.15.26:0/1147292035 shutdown_connections 2021-11-03T18:20:45.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.441+0000 7f159cde8700 1 -- 172.21.15.26:0/1147292035 wait complete. 2021-11-03T18:20:45.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.540+0000 7ff6be0f4700 1 -- 172.21.15.26:0/3371266876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6b80602f0 msgr2=0x7ff6b80f93a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:20:45.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.540+0000 7ff6be0f4700 1 --2- 172.21.15.26:0/3371266876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6b80602f0 0x7ff6b80f93a0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 rx=0x7ff6a8004660 tx=0x7ff6a8009b30).stop 2021-11-03T18:20:45.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.541+0000 7ff6be0f4700 1 -- 172.21.15.26:0/3371266876 shutdown_connections 2021-11-03T18:20:45.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.541+0000 7ff6be0f4700 1 --2- 172.21.15.26:0/3371266876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6b80f9890 0x7ff6b80fbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:45.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.541+0000 7ff6be0f4700 1 --2- 172.21.15.26:0/3371266876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6b80602f0 0x7ff6b80f93a0 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:45.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.541+0000 7ff6be0f4700 1 -- 172.21.15.26:0/3371266876 >> 172.21.15.26:0/3371266876 conn(0x7ff6b80f0de0 msgr2=0x7ff6b80f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:20:45.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.541+0000 7ff6be0f4700 1 -- 172.21.15.26:0/3371266876 shutdown_connections 2021-11-03T18:20:45.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.541+0000 7ff6be0f4700 1 -- 172.21.15.26:0/3371266876 wait complete. 2021-11-03T18:20:45.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.541+0000 7ff6be0f4700 1 Processor -- start 2021-11-03T18:20:45.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.541+0000 7ff6be0f4700 1 -- start start 2021-11-03T18:20:45.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.541+0000 7ff6be0f4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6b80602f0 0x7ff6b8106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:20:45.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.542+0000 7ff6be0f4700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6b80f9890 0x7ff6b81074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:20:45.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.542+0000 7ff6be0f4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b8107a50 con 0x7ff6b80602f0 2021-11-03T18:20:45.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.542+0000 7ff6be0f4700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b8107b90 con 0x7ff6b80f9890 2021-11-03T18:20:45.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.542+0000 7ff6b77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6b80602f0 0x7ff6b8106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:20:45.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.542+0000 7ff6b77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6b80602f0 0x7ff6b8106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59518/0 (socket says 172.21.15.26:59518) 2021-11-03T18:20:45.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.542+0000 7ff6b77fe700 1 -- 172.21.15.26:0/3723231109 learned_addr learned my addr 172.21.15.26:0/3723231109 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:20:45.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.542+0000 7ff6b77fe700 1 -- 172.21.15.26:0/3723231109 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6b80f9890 msgr2=0x7ff6b81074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:20:45.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.542+0000 7ff6b77fe700 1 --2- 172.21.15.26:0/3723231109 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6b80f9890 0x7ff6b81074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:20:45.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.542+0000 7ff6b77fe700 1 -- 172.21.15.26:0/3723231109 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a8005040 con 0x7ff6b80602f0 2021-11-03T18:20:45.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.542+0000 7ff6b77fe700 1 --2- 172.21.15.26:0/3723231109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6b80602f0 0x7ff6b8106fb0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 rx=0x7ff6a8013a70 tx=0x7ff6a8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:20:45.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.542+0000 7ff69ffff700 1 -- 172.21.15.26:0/3723231109 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6a8018070 con 0x7ff6b80602f0 2021-11-03T18:20:45.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.542+0000 7ff69ffff700 1 -- 172.21.15.26:0/3723231109 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff6a80097d0 con 0x7ff6b80602f0 2021-11-03T18:20:45.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.542+0000 7ff69ffff700 1 -- 172.21.15.26:0/3723231109 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6a801c3c0 con 0x7ff6b80602f0 2021-11-03T18:20:45.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.542+0000 7ff6be0f4700 1 -- 172.21.15.26:0/3723231109 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b81084d0 con 0x7ff6b80602f0 2021-11-03T18:20:45.548 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.542+0000 7ff6be0f4700 1 -- 172.21.15.26:0/3723231109 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b81089e0 con 0x7ff6b80602f0 2021-11-03T18:20:45.548 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.543+0000 7ff6be0f4700 1 -- 172.21.15.26:0/3723231109 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6b8045ad0 con 0x7ff6b80602f0 2021-11-03T18:20:45.548 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.544+0000 7ff69ffff700 1 -- 172.21.15.26:0/3723231109 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ff6a8007ba0 con 0x7ff6b80602f0 2021-11-03T18:20:45.549 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.544+0000 7ff69ffff700 1 --2- 172.21.15.26:0/3723231109 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff6a00640b0 0x7ff6a0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:20:45.549 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.544+0000 7ff69ffff700 1 -- 172.21.15.26:0/3723231109 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ff6a80824b0 con 0x7ff6b80602f0 2021-11-03T18:20:45.549 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.544+0000 7ff6b6ffd700 1 --2- 172.21.15.26:0/3723231109 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff6a00640b0 0x7ff6a0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:20:45.549 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.544+0000 7ff6b6ffd700 1 --2- 172.21.15.26:0/3723231109 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff6a00640b0 0x7ff6a0066570 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7ff6ac004a10 tx=0x7ff6ac0099e0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:20:45.549 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.548+0000 7ff69ffff700 1 -- 172.21.15.26:0/3723231109 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ff6a8054810 con 0x7ff6b80602f0 2021-11-03T18:20:45.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.755+0000 7ff6be0f4700 1 -- 172.21.15.26:0/3723231109 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff6b8027a00 con 0x7ff6b80602f0 2021-11-03T18:20:45.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.756+0000 7ff69ffff700 1 -- 172.21.15.26:0/3723231109 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7ff6a8054400 con 0x7ff6b80602f0 2021-11-03T18:20:45.755 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:20:45.755 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:20:45.756 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:20:45.756 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:20:45.756 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:20:45.756 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:20:45.757 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:20:45.757 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:20:45.757 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:20:45.757 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:20:45.758 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:20:45.758 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:20:45.758 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:20:45.758 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:20:45.759 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:20:45.759 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:20:45.759 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:20:45.759 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:20:45.759 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:20:45.760 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:20:45.760 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:20:45.760 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:20:45.760 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:20:45.760 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:20:45.761 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:20:45.761 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:20:45.761 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:20:45.761 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:20:45.762 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:20:45.762 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:20:45.762 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:20:45.762 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:20:45.762 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:20:45.763 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:20:45.763 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:20:45.763 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:20:45.763 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:20:45.764 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:20:45.764 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:20:45.765 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.757+0000 7ff6be0f4700 1 -- 172.21.15.26:0/3723231109 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff6a00640b0 msgr2=0x7ff6a0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:20:45.765 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.757+0000 7ff6be0f4700 1 --2- 172.21.15.26:0/3723231109 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff6a00640b0 0x7ff6a0066570 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7ff6ac004a10 tx=0x7ff6ac0099e0).stop 2021-11-03T18:20:45.765 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.757+0000 7ff6be0f4700 1 -- 172.21.15.26:0/3723231109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6b80602f0 msgr2=0x7ff6b8106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:20:45.765 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.757+0000 7ff6be0f4700 1 --2- 172.21.15.26:0/3723231109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6b80602f0 0x7ff6b8106fb0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 rx=0x7ff6a8013a70 tx=0x7ff6a8009b30).stop 2021-11-03T18:20:45.766 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.757+0000 7ff6be0f4700 1 -- 172.21.15.26:0/3723231109 shutdown_connections 2021-11-03T18:20:45.766 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.757+0000 7ff6be0f4700 1 --2- 172.21.15.26:0/3723231109 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff6a00640b0 0x7ff6a0066570 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:45.766 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.757+0000 7ff6be0f4700 1 --2- 172.21.15.26:0/3723231109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6b80602f0 0x7ff6b8106fb0 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:20:45.766 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.757+0000 7ff6be0f4700 1 --2- 172.21.15.26:0/3723231109 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6b80f9890 0x7ff6b81074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:20:45.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.757+0000 7ff6be0f4700 1 -- 172.21.15.26:0/3723231109 >> 172.21.15.26:0/3723231109 conn(0x7ff6b80f0de0 msgr2=0x7ff6b80f31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:20:45.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.758+0000 7ff6be0f4700 1 -- 172.21.15.26:0/3723231109 shutdown_connections 2021-11-03T18:20:45.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:20:45.758+0000 7ff6be0f4700 1 -- 172.21.15.26:0/3723231109 wait complete. 2021-11-03T18:20:45.767 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:20:46.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:45 smithi026 ceph-mon[96795]: from='client.36796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:20:46.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:45 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:20:46.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:45 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:20:46.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:45 smithi026 ceph-mon[96795]: from='client.36800 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:20:46.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:45 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1147292035' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:20:46.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:45 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3723231109' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:20:46.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:45 smithi194 ceph-mon[65619]: from='client.36796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:20:46.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:45 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:20:46.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:45 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:20:46.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:45 smithi194 ceph-mon[65619]: from='client.36800 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:20:46.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:45 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1147292035' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:20:46.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:45 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3723231109' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:20:47.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:46 smithi026 ceph-mon[96795]: pgmap v2583: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:47.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:46 smithi194 ceph-mon[65619]: pgmap v2583: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:49.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:48 smithi026 ceph-mon[96795]: pgmap v2584: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:49.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:20:49.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:20:49.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:48 smithi194 ceph-mon[65619]: pgmap v2584: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:49.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:20:49.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:20:51.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:50 smithi026 ceph-mon[96795]: pgmap v2585: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:51.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:50 smithi194 ceph-mon[65619]: pgmap v2585: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:53.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:52 smithi026 ceph-mon[96795]: pgmap v2586: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:53.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:52 smithi194 ceph-mon[65619]: pgmap v2586: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:55.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:54 smithi026 ceph-mon[96795]: pgmap v2587: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:55.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:54 smithi194 ceph-mon[65619]: pgmap v2587: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:57.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:56 smithi026 ceph-mon[96795]: pgmap v2588: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:57.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:56 smithi194 ceph-mon[65619]: pgmap v2588: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:59.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:20:58 smithi026 ceph-mon[96795]: pgmap v2589: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:20:59.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:20:58 smithi194 ceph-mon[65619]: pgmap v2589: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:01.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:00 smithi026 ceph-mon[96795]: pgmap v2590: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:01.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:00 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:21:01.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:00 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:21:01.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:00 smithi194 ceph-mon[65619]: pgmap v2590: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:01.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:00 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:21:01.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:00 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:21:03.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:02 smithi026 ceph-mon[96795]: pgmap v2591: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:03.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:02 smithi194 ceph-mon[65619]: pgmap v2591: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:05.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:04 smithi026 ceph-mon[96795]: pgmap v2592: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:05.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:04 smithi194 ceph-mon[65619]: pgmap v2592: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:07.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:06 smithi026 ceph-mon[96795]: pgmap v2593: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:07.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:06 smithi194 ceph-mon[65619]: pgmap v2593: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:09.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:08 smithi026 ceph-mon[96795]: pgmap v2594: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:09.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:08 smithi194 ceph-mon[65619]: pgmap v2594: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:11.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:10 smithi026 ceph-mon[96795]: pgmap v2595: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:11.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:10 smithi194 ceph-mon[65619]: pgmap v2595: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:13.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:12 smithi026 ceph-mon[96795]: pgmap v2596: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:13.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:12 smithi194 ceph-mon[65619]: pgmap v2596: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:15.136 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:14 smithi026 ceph-mon[96795]: pgmap v2597: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:15.137 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:14 smithi194 ceph-mon[65619]: pgmap v2597: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:15.867 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:15.866+0000 7fec04d29700 1 -- 172.21.15.26:0/1260416774 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec000f55c0 msgr2=0x7fec000f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:21:15.867 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:15.866+0000 7fec04d29700 1 --2- 172.21.15.26:0/1260416774 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec000f55c0 0x7fec000f59e0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7febf4004660 tx=0x7febf4009b30).stop 2021-11-03T18:21:15.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:15.866+0000 7fec04d29700 1 -- 172.21.15.26:0/1260416774 shutdown_connections 2021-11-03T18:21:15.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:15.866+0000 7fec04d29700 1 --2- 172.21.15.26:0/1260416774 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec000f5ed0 0x7fec000f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:15.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:15.866+0000 7fec04d29700 1 --2- 172.21.15.26:0/1260416774 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec000f55c0 0x7fec000f59e0 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:15.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:15.866+0000 7fec04d29700 1 -- 172.21.15.26:0/1260416774 >> 172.21.15.26:0/1260416774 conn(0x7fec000f0de0 msgr2=0x7fec000f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:21:15.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:15.866+0000 7fec04d29700 1 -- 172.21.15.26:0/1260416774 shutdown_connections 2021-11-03T18:21:15.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:15.866+0000 7fec04d29700 1 -- 172.21.15.26:0/1260416774 wait complete. 2021-11-03T18:21:15.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:15.867+0000 7fec04d29700 1 Processor -- start 2021-11-03T18:21:15.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:15.867+0000 7fec04d29700 1 -- start start 2021-11-03T18:21:15.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:15.867+0000 7fec04d29700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec000f55c0 0x7fec00109bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:21:15.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:15.867+0000 7fec04d29700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec000f5ed0 0x7fec0010c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:21:15.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:15.867+0000 7fec04d29700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec000604a0 con 0x7fec000f5ed0 2021-11-03T18:21:15.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:15.867+0000 7fec04d29700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec000605e0 con 0x7fec000f55c0 2021-11-03T18:21:15.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:15.867+0000 7febfdd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec000f5ed0 0x7fec0010c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:21:15.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:15.867+0000 7febfdd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec000f5ed0 0x7fec0010c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59536/0 (socket says 172.21.15.26:59536) 2021-11-03T18:21:15.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:15.867+0000 7febfdd9b700 1 -- 172.21.15.26:0/2854128453 learned_addr learned my addr 172.21.15.26:0/2854128453 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:21:15.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:15.867+0000 7febfe59c700 1 --2- 172.21.15.26:0/2854128453 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec000f55c0 0x7fec00109bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:21:15.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:15.867+0000 7febfdd9b700 1 -- 172.21.15.26:0/2854128453 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec000f55c0 msgr2=0x7fec00109bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:21:15.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:15.867+0000 7febfdd9b700 1 --2- 172.21.15.26:0/2854128453 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec000f55c0 0x7fec00109bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:15.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:15.867+0000 7febfdd9b700 1 -- 172.21.15.26:0/2854128453 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf4005040 con 0x7fec000f5ed0 2021-11-03T18:21:15.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:15.868+0000 7febfdd9b700 1 --2- 172.21.15.26:0/2854128453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec000f5ed0 0x7fec0010c0f0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 rx=0x7febf0002700 tx=0x7febf0009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:21:15.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:15.868+0000 7febeeffd700 1 -- 172.21.15.26:0/2854128453 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febf0009320 con 0x7fec000f5ed0 2021-11-03T18:21:15.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:15.868+0000 7fec04d29700 1 -- 172.21.15.26:0/2854128453 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec0010c6a0 con 0x7fec000f5ed0 2021-11-03T18:21:15.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:15.868+0000 7febeeffd700 1 -- 172.21.15.26:0/2854128453 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7febf000f040 con 0x7fec000f5ed0 2021-11-03T18:21:15.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:15.868+0000 7febeeffd700 1 -- 172.21.15.26:0/2854128453 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febf0014870 con 0x7fec000f5ed0 2021-11-03T18:21:15.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:15.868+0000 7fec04d29700 1 -- 172.21.15.26:0/2854128453 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec0010cc30 con 0x7fec000f5ed0 2021-11-03T18:21:15.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:15.869+0000 7fec04d29700 1 -- 172.21.15.26:0/2854128453 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec00045ad0 con 0x7fec000f5ed0 2021-11-03T18:21:15.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:15.869+0000 7febeeffd700 1 -- 172.21.15.26:0/2854128453 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7febf0009480 con 0x7fec000f5ed0 2021-11-03T18:21:15.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:15.870+0000 7febeeffd700 1 --2- 172.21.15.26:0/2854128453 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7febe80640b0 0x7febe8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:21:15.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:15.870+0000 7febeeffd700 1 -- 172.21.15.26:0/2854128453 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7febf0080a50 con 0x7fec000f5ed0 2021-11-03T18:21:15.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:15.870+0000 7febfe59c700 1 --2- 172.21.15.26:0/2854128453 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7febe80640b0 0x7febe8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:21:15.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:15.870+0000 7febfe59c700 1 --2- 172.21.15.26:0/2854128453 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7febe80640b0 0x7febe8066570 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7febf4004630 tx=0x7febf4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:21:15.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:15.874+0000 7febeeffd700 1 -- 172.21.15.26:0/2854128453 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7febf0052db0 con 0x7fec000f5ed0 2021-11-03T18:21:16.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.053+0000 7fec04d29700 1 -- 172.21.15.26:0/2854128453 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fec00057f10 con 0x7febe80640b0 2021-11-03T18:21:16.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.055+0000 7febeeffd700 1 -- 172.21.15.26:0/2854128453 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fec00057f10 con 0x7febe80640b0 2021-11-03T18:21:16.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.057+0000 7fec04d29700 1 -- 172.21.15.26:0/2854128453 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7febe80640b0 msgr2=0x7febe8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:21:16.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.057+0000 7fec04d29700 1 --2- 172.21.15.26:0/2854128453 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7febe80640b0 0x7febe8066570 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7febf4004630 tx=0x7febf4009b30).stop 2021-11-03T18:21:16.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.057+0000 7fec04d29700 1 -- 172.21.15.26:0/2854128453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec000f5ed0 msgr2=0x7fec0010c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:21:16.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.057+0000 7fec04d29700 1 --2- 172.21.15.26:0/2854128453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec000f5ed0 0x7fec0010c0f0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 rx=0x7febf0002700 tx=0x7febf0009e00).stop 2021-11-03T18:21:16.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.057+0000 7fec04d29700 1 -- 172.21.15.26:0/2854128453 shutdown_connections 2021-11-03T18:21:16.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.057+0000 7fec04d29700 1 --2- 172.21.15.26:0/2854128453 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7febe80640b0 0x7febe8066570 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:16.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.057+0000 7fec04d29700 1 --2- 172.21.15.26:0/2854128453 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec000f55c0 0x7fec00109bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:16.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.057+0000 7fec04d29700 1 --2- 172.21.15.26:0/2854128453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec000f5ed0 0x7fec0010c0f0 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:16.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.057+0000 7fec04d29700 1 -- 172.21.15.26:0/2854128453 >> 172.21.15.26:0/2854128453 conn(0x7fec000f0de0 msgr2=0x7fec000fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:21:16.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.057+0000 7fec04d29700 1 -- 172.21.15.26:0/2854128453 shutdown_connections 2021-11-03T18:21:16.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.057+0000 7fec04d29700 1 -- 172.21.15.26:0/2854128453 wait complete. 2021-11-03T18:21:16.064 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:21:16.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.157+0000 7f4a76516700 1 -- 172.21.15.26:0/3217852738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a700f55e0 msgr2=0x7f4a700f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:21:16.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.157+0000 7f4a76516700 1 --2- 172.21.15.26:0/3217852738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a700f55e0 0x7f4a700f5a00 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7f4a64004660 tx=0x7f4a64009b30).stop 2021-11-03T18:21:16.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.157+0000 7f4a76516700 1 -- 172.21.15.26:0/3217852738 shutdown_connections 2021-11-03T18:21:16.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.157+0000 7f4a76516700 1 --2- 172.21.15.26:0/3217852738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a700f5ef0 0x7f4a700f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:16.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.157+0000 7f4a76516700 1 --2- 172.21.15.26:0/3217852738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a700f55e0 0x7f4a700f5a00 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:16.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.157+0000 7f4a76516700 1 -- 172.21.15.26:0/3217852738 >> 172.21.15.26:0/3217852738 conn(0x7f4a700f0de0 msgr2=0x7f4a700f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:21:16.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.157+0000 7f4a76516700 1 -- 172.21.15.26:0/3217852738 shutdown_connections 2021-11-03T18:21:16.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.157+0000 7f4a76516700 1 -- 172.21.15.26:0/3217852738 wait complete. 2021-11-03T18:21:16.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.158+0000 7f4a76516700 1 Processor -- start 2021-11-03T18:21:16.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.158+0000 7f4a76516700 1 -- start start 2021-11-03T18:21:16.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.158+0000 7f4a76516700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a700f55e0 0x7f4a7010c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:21:16.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.158+0000 7f4a76516700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a700f5ef0 0x7f4a7010e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:21:16.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.158+0000 7f4a76516700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a700603d0 con 0x7f4a700f55e0 2021-11-03T18:21:16.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.158+0000 7f4a76516700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a70060510 con 0x7f4a700f5ef0 2021-11-03T18:21:16.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.158+0000 7f4a6ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a700f55e0 0x7f4a7010c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:21:16.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.158+0000 7f4a6ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a700f55e0 0x7f4a7010c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59542/0 (socket says 172.21.15.26:59542) 2021-11-03T18:21:16.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.158+0000 7f4a6ffff700 1 -- 172.21.15.26:0/2875540543 learned_addr learned my addr 172.21.15.26:0/2875540543 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:21:16.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.158+0000 7f4a6f7fe700 1 --2- 172.21.15.26:0/2875540543 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a700f5ef0 0x7f4a7010e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:21:16.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.159+0000 7f4a6ffff700 1 -- 172.21.15.26:0/2875540543 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a700f5ef0 msgr2=0x7f4a7010e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:21:16.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.159+0000 7f4a6ffff700 1 --2- 172.21.15.26:0/2875540543 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a700f5ef0 0x7f4a7010e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:16.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.159+0000 7f4a6ffff700 1 -- 172.21.15.26:0/2875540543 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a64005040 con 0x7f4a700f55e0 2021-11-03T18:21:16.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.159+0000 7f4a6ffff700 1 --2- 172.21.15.26:0/2875540543 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a700f55e0 0x7f4a7010c000 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 rx=0x7f4a64000c00 tx=0x7f4a6400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:21:16.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.159+0000 7f4a6cff9700 1 -- 172.21.15.26:0/2875540543 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a64019070 con 0x7f4a700f55e0 2021-11-03T18:21:16.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.159+0000 7f4a76516700 1 -- 172.21.15.26:0/2875540543 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a7010e9f0 con 0x7f4a700f55e0 2021-11-03T18:21:16.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.159+0000 7f4a6cff9700 1 -- 172.21.15.26:0/2875540543 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4a64007e70 con 0x7f4a700f55e0 2021-11-03T18:21:16.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.159+0000 7f4a6cff9700 1 -- 172.21.15.26:0/2875540543 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a64014ce0 con 0x7f4a700f55e0 2021-11-03T18:21:16.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.159+0000 7f4a76516700 1 -- 172.21.15.26:0/2875540543 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a7010edc0 con 0x7f4a700f55e0 2021-11-03T18:21:16.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.160+0000 7f4a76516700 1 -- 172.21.15.26:0/2875540543 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a70045ad0 con 0x7f4a700f55e0 2021-11-03T18:21:16.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.160+0000 7f4a6cff9700 1 -- 172.21.15.26:0/2875540543 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f4a64025070 con 0x7f4a700f55e0 2021-11-03T18:21:16.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.161+0000 7f4a6cff9700 1 --2- 172.21.15.26:0/2875540543 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4a580640b0 0x7f4a58066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:21:16.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.161+0000 7f4a6cff9700 1 -- 172.21.15.26:0/2875540543 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f4a64081770 con 0x7f4a700f55e0 2021-11-03T18:21:16.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.161+0000 7f4a6f7fe700 1 --2- 172.21.15.26:0/2875540543 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4a580640b0 0x7f4a58066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:21:16.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.161+0000 7f4a6f7fe700 1 --2- 172.21.15.26:0/2875540543 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4a580640b0 0x7f4a58066570 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7f4a60009fd0 tx=0x7f4a6000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:21:16.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.165+0000 7f4a6cff9700 1 -- 172.21.15.26:0/2875540543 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f4a64053ad0 con 0x7f4a700f55e0 2021-11-03T18:21:16.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:15 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:21:16.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:15 smithi026 ceph-mon[96795]: poll took 60061.477 ms: 1 events 2021-11-03T18:21:16.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:15 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:21:16.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:15 smithi194 ceph-mon[65619]: poll took 60061.477 ms: 1 events 2021-11-03T18:21:16.334 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.337+0000 7f4a76516700 1 -- 172.21.15.26:0/2875540543 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a700fdf80 con 0x7f4a580640b0 2021-11-03T18:21:16.349 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.351+0000 7f4a6cff9700 1 -- 172.21.15.26:0/2875540543 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f4a6000f040 con 0x7f4a580640b0 2021-11-03T18:21:16.349 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:21:16.350 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (92m) 61s ago 93m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:21:16.350 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (84m) 61s ago 93m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:21:16.350 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (84m) 10m ago 92m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:21:16.350 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (92m) 61s ago 93m 42.2M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:21:16.351 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (85m) 61s ago 88m 26.0M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:21:16.351 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (85m) 61s ago 88m 26.6M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:21:16.351 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (88m) 10m ago 88m 26.6M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:21:16.351 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (88m) 10m ago 88m 27.0M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:21:16.352 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (86m) 61s ago 95m 588M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:21:16.352 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (85m) 10m ago 92m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:21:16.352 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (85m) 61s ago 95m 341M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:21:16.352 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (85m) 10m ago 92m 145M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:21:16.353 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (93m) 61s ago 93m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:21:16.353 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (92m) 10m ago 92m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:21:16.353 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (84m) 61s ago 92m 332M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:21:16.353 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (83m) 61s ago 91m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:21:16.353 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (83m) 61s ago 91m 296M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:21:16.354 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (82m) 10m ago 91m 362M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:21:16.354 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (82m) 10m ago 90m 302M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:21:16.354 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (81m) 10m ago 90m 296M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:21:16.354 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (92m) 61s ago 93m 65.7M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:21:16.355 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.353+0000 7f4a76516700 1 -- 172.21.15.26:0/2875540543 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4a580640b0 msgr2=0x7f4a58066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:21:16.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.353+0000 7f4a76516700 1 --2- 172.21.15.26:0/2875540543 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4a580640b0 0x7f4a58066570 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7f4a60009fd0 tx=0x7f4a6000b040).stop 2021-11-03T18:21:16.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.353+0000 7f4a76516700 1 -- 172.21.15.26:0/2875540543 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a700f55e0 msgr2=0x7f4a7010c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:21:16.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.353+0000 7f4a76516700 1 --2- 172.21.15.26:0/2875540543 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a700f55e0 0x7f4a7010c000 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 rx=0x7f4a64000c00 tx=0x7f4a6400b040).stop 2021-11-03T18:21:16.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.353+0000 7f4a76516700 1 -- 172.21.15.26:0/2875540543 shutdown_connections 2021-11-03T18:21:16.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.353+0000 7f4a76516700 1 --2- 172.21.15.26:0/2875540543 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4a580640b0 0x7f4a58066570 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:16.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.353+0000 7f4a76516700 1 --2- 172.21.15.26:0/2875540543 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4a700f55e0 0x7f4a7010c000 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:16.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.353+0000 7f4a76516700 1 --2- 172.21.15.26:0/2875540543 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a700f5ef0 0x7f4a7010e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:16.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.353+0000 7f4a76516700 1 -- 172.21.15.26:0/2875540543 >> 172.21.15.26:0/2875540543 conn(0x7f4a700f0de0 msgr2=0x7f4a700fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:21:16.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.354+0000 7f4a76516700 1 -- 172.21.15.26:0/2875540543 shutdown_connections 2021-11-03T18:21:16.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.354+0000 7f4a76516700 1 -- 172.21.15.26:0/2875540543 wait complete. 2021-11-03T18:21:16.454 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.454+0000 7fb1cc399700 1 -- 172.21.15.26:0/2447097369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1c40f55e0 msgr2=0x7fb1c40f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:21:16.454 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.454+0000 7fb1cc399700 1 --2- 172.21.15.26:0/2447097369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1c40f55e0 0x7fb1c40f5a00 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 rx=0x7fb1bc0099e0 tx=0x7fb1bc004d10).stop 2021-11-03T18:21:16.454 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.454+0000 7fb1cc399700 1 -- 172.21.15.26:0/2447097369 shutdown_connections 2021-11-03T18:21:16.455 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.454+0000 7fb1cc399700 1 --2- 172.21.15.26:0/2447097369 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1c40f5ef0 0x7fb1c40f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:16.455 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.454+0000 7fb1cc399700 1 --2- 172.21.15.26:0/2447097369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1c40f55e0 0x7fb1c40f5a00 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:16.455 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.454+0000 7fb1cc399700 1 -- 172.21.15.26:0/2447097369 >> 172.21.15.26:0/2447097369 conn(0x7fb1c40f0de0 msgr2=0x7fb1c40f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:21:16.455 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.454+0000 7fb1cc399700 1 -- 172.21.15.26:0/2447097369 shutdown_connections 2021-11-03T18:21:16.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.454+0000 7fb1cc399700 1 -- 172.21.15.26:0/2447097369 wait complete. 2021-11-03T18:21:16.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.454+0000 7fb1cc399700 1 Processor -- start 2021-11-03T18:21:16.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.454+0000 7fb1cc399700 1 -- start start 2021-11-03T18:21:16.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.455+0000 7fb1cc399700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1c40f55e0 0x7fb1c4109d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:21:16.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.455+0000 7fb1cc399700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1c40f5ef0 0x7fb1c410c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:21:16.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.455+0000 7fb1cc399700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c40604c0 con 0x7fb1c40f55e0 2021-11-03T18:21:16.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.455+0000 7fb1cc399700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c4060600 con 0x7fb1c40f5ef0 2021-11-03T18:21:16.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.455+0000 7fb1ca135700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1c40f55e0 0x7fb1c4109d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:21:16.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.455+0000 7fb1ca135700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1c40f55e0 0x7fb1c4109d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59552/0 (socket says 172.21.15.26:59552) 2021-11-03T18:21:16.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.455+0000 7fb1ca135700 1 -- 172.21.15.26:0/496813926 learned_addr learned my addr 172.21.15.26:0/496813926 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:21:16.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.455+0000 7fb1c9934700 1 --2- 172.21.15.26:0/496813926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1c40f5ef0 0x7fb1c410c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:21:16.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.455+0000 7fb1ca135700 1 -- 172.21.15.26:0/496813926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1c40f5ef0 msgr2=0x7fb1c410c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:21:16.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.455+0000 7fb1ca135700 1 --2- 172.21.15.26:0/496813926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1c40f5ef0 0x7fb1c410c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:16.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.455+0000 7fb1ca135700 1 -- 172.21.15.26:0/496813926 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1bc009640 con 0x7fb1c40f55e0 2021-11-03T18:21:16.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.455+0000 7fb1ca135700 1 --2- 172.21.15.26:0/496813926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1c40f55e0 0x7fb1c4109d80 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7fb1bc00b3b0 tx=0x7fb1bc004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:21:16.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.455+0000 7fb1c2ffd700 1 -- 172.21.15.26:0/496813926 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1bc00e030 con 0x7fb1c40f55e0 2021-11-03T18:21:16.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.455+0000 7fb1c2ffd700 1 -- 172.21.15.26:0/496813926 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb1bc0049b0 con 0x7fb1c40f55e0 2021-11-03T18:21:16.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.455+0000 7fb1cc399700 1 -- 172.21.15.26:0/496813926 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c410c7d0 con 0x7fb1c40f55e0 2021-11-03T18:21:16.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.455+0000 7fb1c2ffd700 1 -- 172.21.15.26:0/496813926 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1bc018070 con 0x7fb1c40f55e0 2021-11-03T18:21:16.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.456+0000 7fb1cc399700 1 -- 172.21.15.26:0/496813926 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c410cc80 con 0x7fb1c40f55e0 2021-11-03T18:21:16.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.456+0000 7fb1cc399700 1 -- 172.21.15.26:0/496813926 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1c4045ad0 con 0x7fb1c40f55e0 2021-11-03T18:21:16.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.457+0000 7fb1c2ffd700 1 -- 172.21.15.26:0/496813926 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fb1bc007c90 con 0x7fb1c40f55e0 2021-11-03T18:21:16.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.457+0000 7fb1c2ffd700 1 --2- 172.21.15.26:0/496813926 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb1ac0640b0 0x7fb1ac066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:21:16.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.457+0000 7fb1c2ffd700 1 -- 172.21.15.26:0/496813926 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fb1bc082470 con 0x7fb1c40f55e0 2021-11-03T18:21:16.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.457+0000 7fb1c9934700 1 --2- 172.21.15.26:0/496813926 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb1ac0640b0 0x7fb1ac066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:21:16.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.458+0000 7fb1c9934700 1 --2- 172.21.15.26:0/496813926 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb1ac0640b0 0x7fb1ac066570 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7fb1b8004c40 tx=0x7fb1b800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:21:16.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.461+0000 7fb1c2ffd700 1 -- 172.21.15.26:0/496813926 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fb1bc0547d0 con 0x7fb1c40f55e0 2021-11-03T18:21:16.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.691+0000 7fb1cc399700 1 -- 172.21.15.26:0/496813926 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb1c40fde70 con 0x7fb1c40f55e0 2021-11-03T18:21:16.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.691+0000 7fb1c2ffd700 1 -- 172.21.15.26:0/496813926 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fb1bc0543c0 con 0x7fb1c40f55e0 2021-11-03T18:21:16.690 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:21:16.690 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:21:16.690 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:21:16.691 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:21:16.691 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:21:16.691 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:21:16.692 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:21:16.692 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:21:16.693 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:21:16.693 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:21:16.693 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:21:16.693 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:21:16.694 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:21:16.695 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:21:16.695 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:21:16.695 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:21:16.696 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:21:16.696 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:21:16.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.693+0000 7fb1cc399700 1 -- 172.21.15.26:0/496813926 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb1ac0640b0 msgr2=0x7fb1ac066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:21:16.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.693+0000 7fb1cc399700 1 --2- 172.21.15.26:0/496813926 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb1ac0640b0 0x7fb1ac066570 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7fb1b8004c40 tx=0x7fb1b800b040).stop 2021-11-03T18:21:16.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.693+0000 7fb1cc399700 1 -- 172.21.15.26:0/496813926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1c40f55e0 msgr2=0x7fb1c4109d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:21:16.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.693+0000 7fb1cc399700 1 --2- 172.21.15.26:0/496813926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1c40f55e0 0x7fb1c4109d80 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7fb1bc00b3b0 tx=0x7fb1bc004d10).stop 2021-11-03T18:21:16.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.693+0000 7fb1cc399700 1 -- 172.21.15.26:0/496813926 shutdown_connections 2021-11-03T18:21:16.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.693+0000 7fb1cc399700 1 --2- 172.21.15.26:0/496813926 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb1ac0640b0 0x7fb1ac066570 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:16.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.693+0000 7fb1cc399700 1 --2- 172.21.15.26:0/496813926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1c40f55e0 0x7fb1c4109d80 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:16.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.693+0000 7fb1cc399700 1 --2- 172.21.15.26:0/496813926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1c40f5ef0 0x7fb1c410c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:16.699 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.693+0000 7fb1cc399700 1 -- 172.21.15.26:0/496813926 >> 172.21.15.26:0/496813926 conn(0x7fb1c40f0de0 msgr2=0x7fb1c40fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:21:16.699 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.693+0000 7fb1cc399700 1 -- 172.21.15.26:0/496813926 shutdown_connections 2021-11-03T18:21:16.699 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.693+0000 7fb1cc399700 1 -- 172.21.15.26:0/496813926 wait complete. 2021-11-03T18:21:16.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.793+0000 7f3171a9b700 1 -- 172.21.15.26:0/2025705567 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f316c0f5ef0 msgr2=0x7f316c0f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:21:16.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.793+0000 7f3171a9b700 1 --2- 172.21.15.26:0/2025705567 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f316c0f5ef0 0x7f316c0f6920 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 rx=0x7f3160004660 tx=0x7f3160009b30).stop 2021-11-03T18:21:16.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.793+0000 7f3171a9b700 1 -- 172.21.15.26:0/2025705567 shutdown_connections 2021-11-03T18:21:16.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.793+0000 7f3171a9b700 1 --2- 172.21.15.26:0/2025705567 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f316c0f5ef0 0x7f316c0f6920 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:16.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.793+0000 7f3171a9b700 1 --2- 172.21.15.26:0/2025705567 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f316c0f55e0 0x7f316c0f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:16.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.793+0000 7f3171a9b700 1 -- 172.21.15.26:0/2025705567 >> 172.21.15.26:0/2025705567 conn(0x7f316c0f0de0 msgr2=0x7f316c0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:21:16.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.793+0000 7f3171a9b700 1 -- 172.21.15.26:0/2025705567 shutdown_connections 2021-11-03T18:21:16.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.793+0000 7f3171a9b700 1 -- 172.21.15.26:0/2025705567 wait complete. 2021-11-03T18:21:16.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.794+0000 7f3171a9b700 1 Processor -- start 2021-11-03T18:21:16.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.794+0000 7f3171a9b700 1 -- start start 2021-11-03T18:21:16.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.794+0000 7f3171a9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f316c0f55e0 0x7f316c0f97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:21:16.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.794+0000 7f3171a9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f316c0f5ef0 0x7f316c0f7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:21:16.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.794+0000 7f3171a9b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f316c0f81c0 con 0x7f316c0f5ef0 2021-11-03T18:21:16.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.794+0000 7f3171a9b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f316c0f8300 con 0x7f316c0f55e0 2021-11-03T18:21:16.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.794+0000 7f316affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f316c0f5ef0 0x7f316c0f7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:21:16.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.794+0000 7f316affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f316c0f5ef0 0x7f316c0f7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59564/0 (socket says 172.21.15.26:59564) 2021-11-03T18:21:16.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.794+0000 7f316affd700 1 -- 172.21.15.26:0/2917338287 learned_addr learned my addr 172.21.15.26:0/2917338287 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:21:16.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.794+0000 7f316b7fe700 1 --2- 172.21.15.26:0/2917338287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f316c0f55e0 0x7f316c0f97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:21:16.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.794+0000 7f316affd700 1 -- 172.21.15.26:0/2917338287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f316c0f55e0 msgr2=0x7f316c0f97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:21:16.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.794+0000 7f316affd700 1 --2- 172.21.15.26:0/2917338287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f316c0f55e0 0x7f316c0f97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:16.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.794+0000 7f316affd700 1 -- 172.21.15.26:0/2917338287 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3160005040 con 0x7f316c0f5ef0 2021-11-03T18:21:16.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.794+0000 7f316affd700 1 --2- 172.21.15.26:0/2917338287 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f316c0f5ef0 0x7f316c0f7c60 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7f3160000c00 tx=0x7f316000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:21:16.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.795+0000 7f3153fff700 1 -- 172.21.15.26:0/2917338287 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3160019070 con 0x7f316c0f5ef0 2021-11-03T18:21:16.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.795+0000 7f3153fff700 1 -- 172.21.15.26:0/2917338287 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3160007e70 con 0x7f316c0f5ef0 2021-11-03T18:21:16.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.795+0000 7f3171a9b700 1 -- 172.21.15.26:0/2917338287 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f316c0f8580 con 0x7f316c0f5ef0 2021-11-03T18:21:16.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.795+0000 7f3153fff700 1 -- 172.21.15.26:0/2917338287 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3160014ce0 con 0x7f316c0f5ef0 2021-11-03T18:21:16.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.795+0000 7f3171a9b700 1 -- 172.21.15.26:0/2917338287 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f316c0f8ae0 con 0x7f316c0f5ef0 2021-11-03T18:21:16.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.796+0000 7f3171a9b700 1 -- 172.21.15.26:0/2917338287 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f316c045ad0 con 0x7f316c0f5ef0 2021-11-03T18:21:16.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.796+0000 7f3153fff700 1 -- 172.21.15.26:0/2917338287 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f3160025070 con 0x7f316c0f5ef0 2021-11-03T18:21:16.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.797+0000 7f3153fff700 1 --2- 172.21.15.26:0/2917338287 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f31540640b0 0x7f3154066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:21:16.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.797+0000 7f3153fff700 1 -- 172.21.15.26:0/2917338287 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f3160081750 con 0x7f316c0f5ef0 2021-11-03T18:21:16.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.797+0000 7f316b7fe700 1 --2- 172.21.15.26:0/2917338287 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f31540640b0 0x7f3154066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:21:16.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.797+0000 7f316b7fe700 1 --2- 172.21.15.26:0/2917338287 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f31540640b0 0x7f3154066570 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7f316c0f9570 tx=0x7f315c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:21:16.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:16.801+0000 7f3153fff700 1 -- 172.21.15.26:0/2917338287 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f3160053ab0 con 0x7f316c0f5ef0 2021-11-03T18:21:17.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:17.007+0000 7f3171a9b700 1 -- 172.21.15.26:0/2917338287 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f316c0fddd0 con 0x7f316c0f5ef0 2021-11-03T18:21:17.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:17.007+0000 7f3153fff700 1 -- 172.21.15.26:0/2917338287 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f3160023020 con 0x7f316c0f5ef0 2021-11-03T18:21:17.006 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:21:17.006 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:21:17.007 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:21:17.007 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:21:17.007 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:21:17.007 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:21:17.008 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:21:17.008 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:21:17.008 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:21:17.008 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:21:17.009 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:21:17.009 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:21:17.009 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:21:17.009 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:21:17.009 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:21:17.010 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:21:17.010 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:21:17.010 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:21:17.011 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:21:17.011 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:21:17.011 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:21:17.011 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:21:17.012 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:21:17.012 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:21:17.012 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:21:17.012 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:21:17.013 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:21:17.013 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:21:17.013 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:21:17.013 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:21:17.014 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:21:17.014 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:21:17.014 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:21:17.014 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:21:17.014 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:21:17.015 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:21:17.015 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:21:17.015 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:21:17.015 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:21:17.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:17.009+0000 7f3171a9b700 1 -- 172.21.15.26:0/2917338287 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f31540640b0 msgr2=0x7f3154066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:21:17.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:17.009+0000 7f3171a9b700 1 --2- 172.21.15.26:0/2917338287 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f31540640b0 0x7f3154066570 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7f316c0f9570 tx=0x7f315c00b040).stop 2021-11-03T18:21:17.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:17.009+0000 7f3171a9b700 1 -- 172.21.15.26:0/2917338287 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f316c0f5ef0 msgr2=0x7f316c0f7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:21:17.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:17.009+0000 7f3171a9b700 1 --2- 172.21.15.26:0/2917338287 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f316c0f5ef0 0x7f316c0f7c60 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7f3160000c00 tx=0x7f316000b040).stop 2021-11-03T18:21:17.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:17.009+0000 7f3171a9b700 1 -- 172.21.15.26:0/2917338287 shutdown_connections 2021-11-03T18:21:17.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:17.009+0000 7f3171a9b700 1 --2- 172.21.15.26:0/2917338287 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f31540640b0 0x7f3154066570 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:17.018 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:17.009+0000 7f3171a9b700 1 --2- 172.21.15.26:0/2917338287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f316c0f55e0 0x7f316c0f97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:17.018 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:17.009+0000 7f3171a9b700 1 --2- 172.21.15.26:0/2917338287 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f316c0f5ef0 0x7f316c0f7c60 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:17.018 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:17.009+0000 7f3171a9b700 1 -- 172.21.15.26:0/2917338287 >> 172.21.15.26:0/2917338287 conn(0x7f316c0f0de0 msgr2=0x7f316c05ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:21:17.018 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:17.010+0000 7f3171a9b700 1 -- 172.21.15.26:0/2917338287 shutdown_connections 2021-11-03T18:21:17.019 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:17.010+0000 7f3171a9b700 1 -- 172.21.15.26:0/2917338287 wait complete. 2021-11-03T18:21:17.019 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:21:17.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:16 smithi026 ceph-mon[96795]: pgmap v2598: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:17.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:16 smithi026 ceph-mon[96795]: from='client.36812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:21:17.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:16 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/496813926' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:21:17.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:16 smithi194 ceph-mon[65619]: pgmap v2598: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:17.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:16 smithi194 ceph-mon[65619]: from='client.36812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:21:17.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:16 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/496813926' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:21:18.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:17 smithi194 ceph-mon[65619]: from='client.36816 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:21:18.146 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:17 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2917338287' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:21:18.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:17 smithi026 ceph-mon[96795]: from='client.36816 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:21:18.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:17 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2917338287' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:21:19.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:18 smithi026 ceph-mon[96795]: pgmap v2599: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:19.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:18 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:21:19.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:18 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:21:19.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:18 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:21:19.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:18 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:21:19.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:18 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:21:19.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:18 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:21:19.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:18 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:21:19.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:18 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:21:19.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:18 smithi194 ceph-mon[65619]: pgmap v2599: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:19.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:18 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:21:19.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:18 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:21:19.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:18 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:21:19.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:18 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:21:19.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:18 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:21:19.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:18 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:21:19.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:18 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:21:19.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:18 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:21:20.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:19 smithi026 ceph-mon[96795]: poll took 2697.736 ms: 1 events 2021-11-03T18:21:20.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:19 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:21:20.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:19 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:21:20.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:19 smithi194 ceph-mon[65619]: poll took 2697.736 ms: 1 events 2021-11-03T18:21:20.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:19 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:21:20.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:19 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:21:21.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:20 smithi026 ceph-mon[96795]: pgmap v2600: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:21.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:20 smithi194 ceph-mon[65619]: pgmap v2600: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:23.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:22 smithi026 ceph-mon[96795]: pgmap v2601: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:23.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:22 smithi194 ceph-mon[65619]: pgmap v2601: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:25.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:24 smithi026 ceph-mon[96795]: pgmap v2602: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:25.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:24 smithi194 ceph-mon[65619]: pgmap v2602: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:27.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:26 smithi026 ceph-mon[96795]: pgmap v2603: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:27.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:26 smithi194 ceph-mon[65619]: pgmap v2603: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:29.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:28 smithi026 ceph-mon[96795]: pgmap v2604: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:29.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:28 smithi194 ceph-mon[65619]: pgmap v2604: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:31.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:30 smithi026 ceph-mon[96795]: pgmap v2605: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:31.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:30 smithi194 ceph-mon[65619]: pgmap v2605: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:33.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:32 smithi026 ceph-mon[96795]: pgmap v2606: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:33.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:32 smithi194 ceph-mon[65619]: pgmap v2606: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:34.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:33 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:21:34.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:33 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:21:35.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:34 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:21:35.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:34 smithi026 ceph-mon[96795]: pgmap v2607: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:35.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:34 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:21:35.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:34 smithi194 ceph-mon[65619]: pgmap v2607: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:37.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:36 smithi026 ceph-mon[96795]: pgmap v2608: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:37.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:36 smithi194 ceph-mon[65619]: pgmap v2608: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:39.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:38 smithi026 ceph-mon[96795]: pgmap v2609: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:39.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:38 smithi194 ceph-mon[65619]: pgmap v2609: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:41.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:40 smithi194 ceph-mon[65619]: pgmap v2610: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:41.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:40 smithi026 ceph-mon[96795]: pgmap v2610: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:43.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:42 smithi194 ceph-mon[65619]: pgmap v2611: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:43.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:42 smithi026 ceph-mon[96795]: pgmap v2611: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:45.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:44 smithi194 ceph-mon[65619]: pgmap v2612: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:45.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:44 smithi026 ceph-mon[96795]: pgmap v2612: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:47.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.123+0000 7fa3fd7d5700 1 -- 172.21.15.26:0/3878807050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3f80f66e0 msgr2=0x7fa3f80f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:21:47.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.123+0000 7fa3fd7d5700 1 --2- 172.21.15.26:0/3878807050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3f80f66e0 0x7fa3f80f6b00 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7fa3f00099e0 tx=0x7fa3f0004d10).stop 2021-11-03T18:21:47.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.123+0000 7fa3fd7d5700 1 -- 172.21.15.26:0/3878807050 shutdown_connections 2021-11-03T18:21:47.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.123+0000 7fa3fd7d5700 1 --2- 172.21.15.26:0/3878807050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3f80f7980 0x7fa3f80f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:47.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.123+0000 7fa3fd7d5700 1 --2- 172.21.15.26:0/3878807050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3f80f66e0 0x7fa3f80f6b00 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:47.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.123+0000 7fa3fd7d5700 1 -- 172.21.15.26:0/3878807050 >> 172.21.15.26:0/3878807050 conn(0x7fa3f80f1e40 msgr2=0x7fa3f80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:21:47.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.123+0000 7fa3fd7d5700 1 -- 172.21.15.26:0/3878807050 shutdown_connections 2021-11-03T18:21:47.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.123+0000 7fa3fd7d5700 1 -- 172.21.15.26:0/3878807050 wait complete. 2021-11-03T18:21:47.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.124+0000 7fa3fd7d5700 1 Processor -- start 2021-11-03T18:21:47.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.124+0000 7fa3fd7d5700 1 -- start start 2021-11-03T18:21:47.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.124+0000 7fa3fd7d5700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3f80f66e0 0x7fa3f81070d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:21:47.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.124+0000 7fa3fd7d5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3f80f7980 0x7fa3f81075c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:21:47.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.124+0000 7fa3fd7d5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f8107b70 con 0x7fa3f80f7980 2021-11-03T18:21:47.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.124+0000 7fa3fd7d5700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f8107cb0 con 0x7fa3f80f66e0 2021-11-03T18:21:47.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.124+0000 7fa3f67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3f80f7980 0x7fa3f81075c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:21:47.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.124+0000 7fa3f67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3f80f7980 0x7fa3f81075c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59582/0 (socket says 172.21.15.26:59582) 2021-11-03T18:21:47.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.124+0000 7fa3f67fc700 1 -- 172.21.15.26:0/3131845283 learned_addr learned my addr 172.21.15.26:0/3131845283 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:21:47.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.124+0000 7fa3f6ffd700 1 --2- 172.21.15.26:0/3131845283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3f80f66e0 0x7fa3f81070d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:21:47.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.124+0000 7fa3f67fc700 1 -- 172.21.15.26:0/3131845283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3f80f66e0 msgr2=0x7fa3f81070d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:21:47.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.124+0000 7fa3f67fc700 1 --2- 172.21.15.26:0/3131845283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3f80f66e0 0x7fa3f81070d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:47.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.124+0000 7fa3f67fc700 1 -- 172.21.15.26:0/3131845283 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f0009640 con 0x7fa3f80f7980 2021-11-03T18:21:47.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.124+0000 7fa3f67fc700 1 --2- 172.21.15.26:0/3131845283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3f80f7980 0x7fa3f81075c0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 rx=0x7fa3e00026d0 tx=0x7fa3e0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:21:47.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.125+0000 7fa3ef7fe700 1 -- 172.21.15.26:0/3131845283 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3e00079c0 con 0x7fa3f80f7980 2021-11-03T18:21:47.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.125+0000 7fa3ef7fe700 1 -- 172.21.15.26:0/3131845283 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa3e000f040 con 0x7fa3f80f7980 2021-11-03T18:21:47.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.125+0000 7fa3ef7fe700 1 -- 172.21.15.26:0/3131845283 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3e00148b0 con 0x7fa3f80f7980 2021-11-03T18:21:47.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.125+0000 7fa3fd7d5700 1 -- 172.21.15.26:0/3131845283 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3f8108650 con 0x7fa3f80f7980 2021-11-03T18:21:47.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.125+0000 7fa3fd7d5700 1 -- 172.21.15.26:0/3131845283 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f8108b90 con 0x7fa3f80f7980 2021-11-03T18:21:47.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.126+0000 7fa3fd7d5700 1 -- 172.21.15.26:0/3131845283 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3f8045ad0 con 0x7fa3f80f7980 2021-11-03T18:21:47.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.126+0000 7fa3ef7fe700 1 -- 172.21.15.26:0/3131845283 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fa3e0007b20 con 0x7fa3f80f7980 2021-11-03T18:21:47.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.127+0000 7fa3ef7fe700 1 --2- 172.21.15.26:0/3131845283 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa3e40640b0 0x7fa3e4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:21:47.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.127+0000 7fa3ef7fe700 1 -- 172.21.15.26:0/3131845283 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fa3e0080730 con 0x7fa3f80f7980 2021-11-03T18:21:47.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.127+0000 7fa3f6ffd700 1 --2- 172.21.15.26:0/3131845283 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa3e40640b0 0x7fa3e4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:21:47.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.127+0000 7fa3f6ffd700 1 --2- 172.21.15.26:0/3131845283 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa3e40640b0 0x7fa3e4066570 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7fa3f000b730 tx=0x7fa3f0004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:21:47.139 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.131+0000 7fa3ef7fe700 1 -- 172.21.15.26:0/3131845283 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fa3e0052a90 con 0x7fa3f80f7980 2021-11-03T18:21:47.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:46 smithi194 ceph-mon[65619]: pgmap v2613: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:47.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.310+0000 7fa3fd7d5700 1 -- 172.21.15.26:0/3131845283 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3f8108e10 con 0x7fa3e40640b0 2021-11-03T18:21:47.310 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.311+0000 7fa3ef7fe700 1 -- 172.21.15.26:0/3131845283 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fa3f8108e10 con 0x7fa3e40640b0 2021-11-03T18:21:47.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.313+0000 7fa3fd7d5700 1 -- 172.21.15.26:0/3131845283 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa3e40640b0 msgr2=0x7fa3e4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:21:47.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.313+0000 7fa3fd7d5700 1 --2- 172.21.15.26:0/3131845283 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa3e40640b0 0x7fa3e4066570 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7fa3f000b730 tx=0x7fa3f0004d10).stop 2021-11-03T18:21:47.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.313+0000 7fa3fd7d5700 1 -- 172.21.15.26:0/3131845283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3f80f7980 msgr2=0x7fa3f81075c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:21:47.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.313+0000 7fa3fd7d5700 1 --2- 172.21.15.26:0/3131845283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3f80f7980 0x7fa3f81075c0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 rx=0x7fa3e00026d0 tx=0x7fa3e0009de0).stop 2021-11-03T18:21:47.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.313+0000 7fa3fd7d5700 1 -- 172.21.15.26:0/3131845283 shutdown_connections 2021-11-03T18:21:47.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.313+0000 7fa3fd7d5700 1 --2- 172.21.15.26:0/3131845283 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa3e40640b0 0x7fa3e4066570 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:47.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.313+0000 7fa3fd7d5700 1 --2- 172.21.15.26:0/3131845283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3f80f66e0 0x7fa3f81070d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:47.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.313+0000 7fa3fd7d5700 1 --2- 172.21.15.26:0/3131845283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3f80f7980 0x7fa3f81075c0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:47.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.313+0000 7fa3fd7d5700 1 -- 172.21.15.26:0/3131845283 >> 172.21.15.26:0/3131845283 conn(0x7fa3f80f1e40 msgr2=0x7fa3f80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:21:47.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.313+0000 7fa3fd7d5700 1 -- 172.21.15.26:0/3131845283 shutdown_connections 2021-11-03T18:21:47.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.313+0000 7fa3fd7d5700 1 -- 172.21.15.26:0/3131845283 wait complete. 2021-11-03T18:21:47.322 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:21:47.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.413+0000 7fc3de889700 1 -- 172.21.15.26:0/3831445037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3d80f66e0 msgr2=0x7fc3d80f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:21:47.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.413+0000 7fc3de889700 1 --2- 172.21.15.26:0/3831445037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3d80f66e0 0x7fc3d80f6b40 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 rx=0x7fc3cc004660 tx=0x7fc3cc009b30).stop 2021-11-03T18:21:47.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.413+0000 7fc3de889700 1 -- 172.21.15.26:0/3831445037 shutdown_connections 2021-11-03T18:21:47.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.413+0000 7fc3de889700 1 --2- 172.21.15.26:0/3831445037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3d80f66e0 0x7fc3d80f6b40 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:47.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.413+0000 7fc3de889700 1 --2- 172.21.15.26:0/3831445037 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3d80f5440 0x7fc3d80f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:47.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.413+0000 7fc3de889700 1 -- 172.21.15.26:0/3831445037 >> 172.21.15.26:0/3831445037 conn(0x7fc3d80f0ba0 msgr2=0x7fc3d80f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:21:47.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.413+0000 7fc3de889700 1 -- 172.21.15.26:0/3831445037 shutdown_connections 2021-11-03T18:21:47.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.413+0000 7fc3de889700 1 -- 172.21.15.26:0/3831445037 wait complete. 2021-11-03T18:21:47.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.414+0000 7fc3de889700 1 Processor -- start 2021-11-03T18:21:47.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.414+0000 7fc3de889700 1 -- start start 2021-11-03T18:21:47.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.414+0000 7fc3de889700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3d80f5440 0x7fc3d8109a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:21:47.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.414+0000 7fc3de889700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3d80f66e0 0x7fc3d810bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:21:47.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.414+0000 7fc3de889700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d8060420 con 0x7fc3d80f66e0 2021-11-03T18:21:47.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.414+0000 7fc3de889700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d8060560 con 0x7fc3d80f5440 2021-11-03T18:21:47.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.414+0000 7fc3dd086700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3d80f66e0 0x7fc3d810bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:21:47.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.414+0000 7fc3dd086700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3d80f66e0 0x7fc3d810bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59592/0 (socket says 172.21.15.26:59592) 2021-11-03T18:21:47.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.414+0000 7fc3dd086700 1 -- 172.21.15.26:0/4143968750 learned_addr learned my addr 172.21.15.26:0/4143968750 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:21:47.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.414+0000 7fc3dd086700 1 -- 172.21.15.26:0/4143968750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3d80f5440 msgr2=0x7fc3d8109a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:21:47.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.414+0000 7fc3dd887700 1 --2- 172.21.15.26:0/4143968750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3d80f5440 0x7fc3d8109a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:21:47.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.414+0000 7fc3dd086700 1 --2- 172.21.15.26:0/4143968750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3d80f5440 0x7fc3d8109a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:47.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.414+0000 7fc3dd086700 1 -- 172.21.15.26:0/4143968750 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3cc005040 con 0x7fc3d80f66e0 2021-11-03T18:21:47.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.414+0000 7fc3dd887700 1 --2- 172.21.15.26:0/4143968750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3d80f5440 0x7fc3d8109a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:21:47.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.415+0000 7fc3dd086700 1 --2- 172.21.15.26:0/4143968750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3d80f66e0 0x7fc3d810bf50 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7fc3cc009990 tx=0x7fc3cc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:21:47.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.415+0000 7fc3ca7fc700 1 -- 172.21.15.26:0/4143968750 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3cc018070 con 0x7fc3d80f66e0 2021-11-03T18:21:47.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.415+0000 7fc3ca7fc700 1 -- 172.21.15.26:0/4143968750 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc3cc007ca0 con 0x7fc3d80f66e0 2021-11-03T18:21:47.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.415+0000 7fc3de889700 1 -- 172.21.15.26:0/4143968750 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3d810c500 con 0x7fc3d80f66e0 2021-11-03T18:21:47.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.415+0000 7fc3ca7fc700 1 -- 172.21.15.26:0/4143968750 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3cc01c620 con 0x7fc3d80f66e0 2021-11-03T18:21:47.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.415+0000 7fc3de889700 1 -- 172.21.15.26:0/4143968750 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3d810ca30 con 0x7fc3d80f66e0 2021-11-03T18:21:47.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.416+0000 7fc3de889700 1 -- 172.21.15.26:0/4143968750 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3d8045ad0 con 0x7fc3d80f66e0 2021-11-03T18:21:47.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.416+0000 7fc3ca7fc700 1 -- 172.21.15.26:0/4143968750 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc3cc01d960 con 0x7fc3d80f66e0 2021-11-03T18:21:47.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.417+0000 7fc3ca7fc700 1 --2- 172.21.15.26:0/4143968750 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3c4064100 0x7fc3c40665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:21:47.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.417+0000 7fc3ca7fc700 1 -- 172.21.15.26:0/4143968750 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc3cc082540 con 0x7fc3d80f66e0 2021-11-03T18:21:47.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.417+0000 7fc3dd887700 1 --2- 172.21.15.26:0/4143968750 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3c4064100 0x7fc3c40665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:21:47.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.417+0000 7fc3dd887700 1 --2- 172.21.15.26:0/4143968750 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3c4064100 0x7fc3c40665c0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7fc3d80600a0 tx=0x7fc3d4009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:21:47.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.421+0000 7fc3ca7fc700 1 -- 172.21.15.26:0/4143968750 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc3cc054960 con 0x7fc3d80f66e0 2021-11-03T18:21:47.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:46 smithi026 ceph-mon[96795]: pgmap v2613: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:47.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.592+0000 7fc3de889700 1 -- 172.21.15.26:0/4143968750 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3d80fdd80 con 0x7fc3c4064100 2021-11-03T18:21:47.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.606+0000 7fc3ca7fc700 1 -- 172.21.15.26:0/4143968750 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fc3d80fdd80 con 0x7fc3c4064100 2021-11-03T18:21:47.606 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:21:47.607 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (93m) 92s ago 94m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:21:47.607 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (85m) 92s ago 94m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:21:47.607 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (85m) 29s ago 93m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:21:47.607 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (92m) 92s ago 93m 42.2M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:21:47.608 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (86m) 92s ago 89m 26.0M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:21:47.608 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (86m) 92s ago 89m 26.6M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:21:47.608 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (89m) 29s ago 89m 26.8M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:21:47.608 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (89m) 29s ago 89m 27.2M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:21:47.609 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (86m) 92s ago 95m 588M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:21:47.609 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (86m) 29s ago 93m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:21:47.609 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (86m) 92s ago 95m 341M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:21:47.609 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (85m) 29s ago 93m 158M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:21:47.609 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (93m) 92s ago 93m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:21:47.610 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (93m) 29s ago 93m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:21:47.610 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (84m) 92s ago 92m 332M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:21:47.610 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (84m) 92s ago 92m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:21:47.610 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (83m) 92s ago 91m 296M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:21:47.611 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (83m) 29s ago 91m 387M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:21:47.611 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (82m) 29s ago 91m 320M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:21:47.611 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (82m) 29s ago 90m 316M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:21:47.611 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (92m) 92s ago 93m 65.7M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:21:47.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.608+0000 7fc3de889700 1 -- 172.21.15.26:0/4143968750 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3c4064100 msgr2=0x7fc3c40665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:21:47.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.608+0000 7fc3de889700 1 --2- 172.21.15.26:0/4143968750 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3c4064100 0x7fc3c40665c0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7fc3d80600a0 tx=0x7fc3d4009040).stop 2021-11-03T18:21:47.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.608+0000 7fc3de889700 1 -- 172.21.15.26:0/4143968750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3d80f66e0 msgr2=0x7fc3d810bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:21:47.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.608+0000 7fc3de889700 1 --2- 172.21.15.26:0/4143968750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3d80f66e0 0x7fc3d810bf50 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7fc3cc009990 tx=0x7fc3cc009b30).stop 2021-11-03T18:21:47.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.608+0000 7fc3de889700 1 -- 172.21.15.26:0/4143968750 shutdown_connections 2021-11-03T18:21:47.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.608+0000 7fc3de889700 1 --2- 172.21.15.26:0/4143968750 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3c4064100 0x7fc3c40665c0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:47.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.608+0000 7fc3de889700 1 --2- 172.21.15.26:0/4143968750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3d80f5440 0x7fc3d8109a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:47.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.608+0000 7fc3de889700 1 --2- 172.21.15.26:0/4143968750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3d80f66e0 0x7fc3d810bf50 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:47.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.608+0000 7fc3de889700 1 -- 172.21.15.26:0/4143968750 >> 172.21.15.26:0/4143968750 conn(0x7fc3d80f0ba0 msgr2=0x7fc3d80fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:21:47.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.608+0000 7fc3de889700 1 -- 172.21.15.26:0/4143968750 shutdown_connections 2021-11-03T18:21:47.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.608+0000 7fc3de889700 1 -- 172.21.15.26:0/4143968750 wait complete. 2021-11-03T18:21:47.712 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.708+0000 7fc094b28700 1 -- 172.21.15.26:0/2760410806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0900f5ef0 msgr2=0x7fc0900f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:21:47.712 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.708+0000 7fc094b28700 1 --2- 172.21.15.26:0/2760410806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0900f5ef0 0x7fc0900f6920 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 rx=0x7fc078004660 tx=0x7fc078009b30).stop 2021-11-03T18:21:47.712 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.708+0000 7fc094b28700 1 -- 172.21.15.26:0/2760410806 shutdown_connections 2021-11-03T18:21:47.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.708+0000 7fc094b28700 1 --2- 172.21.15.26:0/2760410806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0900f5ef0 0x7fc0900f6920 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:47.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.708+0000 7fc094b28700 1 --2- 172.21.15.26:0/2760410806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0900f55e0 0x7fc0900f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:47.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.708+0000 7fc094b28700 1 -- 172.21.15.26:0/2760410806 >> 172.21.15.26:0/2760410806 conn(0x7fc0900f0de0 msgr2=0x7fc0900f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:21:47.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.708+0000 7fc094b28700 1 -- 172.21.15.26:0/2760410806 shutdown_connections 2021-11-03T18:21:47.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.708+0000 7fc094b28700 1 -- 172.21.15.26:0/2760410806 wait complete. 2021-11-03T18:21:47.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.709+0000 7fc094b28700 1 Processor -- start 2021-11-03T18:21:47.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.709+0000 7fc094b28700 1 -- start start 2021-11-03T18:21:47.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.709+0000 7fc094b28700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0900f55e0 0x7fc090106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:21:47.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.709+0000 7fc094b28700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0900f5ef0 0x7fc090107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:21:47.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.709+0000 7fc094b28700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc090107a10 con 0x7fc0900f55e0 2021-11-03T18:21:47.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.709+0000 7fc094b28700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc090107b50 con 0x7fc0900f5ef0 2021-11-03T18:21:47.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.709+0000 7fc08e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0900f55e0 0x7fc090106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:21:47.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.709+0000 7fc08e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0900f55e0 0x7fc090106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59600/0 (socket says 172.21.15.26:59600) 2021-11-03T18:21:47.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.709+0000 7fc08e59c700 1 -- 172.21.15.26:0/4036854480 learned_addr learned my addr 172.21.15.26:0/4036854480 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:21:47.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.709+0000 7fc08dd9b700 1 --2- 172.21.15.26:0/4036854480 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0900f5ef0 0x7fc090107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:21:47.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.709+0000 7fc08e59c700 1 -- 172.21.15.26:0/4036854480 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0900f5ef0 msgr2=0x7fc090107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:21:47.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.709+0000 7fc08e59c700 1 --2- 172.21.15.26:0/4036854480 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0900f5ef0 0x7fc090107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:47.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.709+0000 7fc08e59c700 1 -- 172.21.15.26:0/4036854480 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc078005040 con 0x7fc0900f55e0 2021-11-03T18:21:47.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.709+0000 7fc08e59c700 1 --2- 172.21.15.26:0/4036854480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0900f55e0 0x7fc090106f70 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7fc088007fd0 tx=0x7fc088004ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:21:47.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.710+0000 7fc086ffd700 1 -- 172.21.15.26:0/4036854480 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc08800b5a0 con 0x7fc0900f55e0 2021-11-03T18:21:47.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.710+0000 7fc094b28700 1 -- 172.21.15.26:0/4036854480 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0901084f0 con 0x7fc0900f55e0 2021-11-03T18:21:47.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.710+0000 7fc086ffd700 1 -- 172.21.15.26:0/4036854480 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc08800f040 con 0x7fc0900f55e0 2021-11-03T18:21:47.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.710+0000 7fc086ffd700 1 -- 172.21.15.26:0/4036854480 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc088013b60 con 0x7fc0900f55e0 2021-11-03T18:21:47.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.710+0000 7fc094b28700 1 -- 172.21.15.26:0/4036854480 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc090108ab0 con 0x7fc0900f55e0 2021-11-03T18:21:47.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.711+0000 7fc094b28700 1 -- 172.21.15.26:0/4036854480 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc090045ad0 con 0x7fc0900f55e0 2021-11-03T18:21:47.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.711+0000 7fc086ffd700 1 -- 172.21.15.26:0/4036854480 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc08801a030 con 0x7fc0900f55e0 2021-11-03T18:21:47.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.711+0000 7fc086ffd700 1 --2- 172.21.15.26:0/4036854480 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc07c0640b0 0x7fc07c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:21:47.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.712+0000 7fc086ffd700 1 -- 172.21.15.26:0/4036854480 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc088080740 con 0x7fc0900f55e0 2021-11-03T18:21:47.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.712+0000 7fc08dd9b700 1 --2- 172.21.15.26:0/4036854480 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc07c0640b0 0x7fc07c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:21:47.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.712+0000 7fc08dd9b700 1 --2- 172.21.15.26:0/4036854480 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc07c0640b0 0x7fc07c066570 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x7fc078004630 tx=0x7fc078009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:21:47.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.716+0000 7fc086ffd700 1 -- 172.21.15.26:0/4036854480 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc088052a60 con 0x7fc0900f55e0 2021-11-03T18:21:47.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.945+0000 7fc094b28700 1 -- 172.21.15.26:0/4036854480 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc09010d590 con 0x7fc0900f55e0 2021-11-03T18:21:47.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.945+0000 7fc086ffd700 1 -- 172.21.15.26:0/4036854480 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fc088018070 con 0x7fc0900f55e0 2021-11-03T18:21:47.945 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:21:47.945 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:21:47.945 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:21:47.945 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:21:47.946 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:21:47.946 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:21:47.946 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:21:47.946 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:21:47.947 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:21:47.947 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:21:47.947 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:21:47.947 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:21:47.947 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:21:47.948 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:21:47.948 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:21:47.948 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:21:47.948 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:21:47.949 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:21:47.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.947+0000 7fc094b28700 1 -- 172.21.15.26:0/4036854480 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc07c0640b0 msgr2=0x7fc07c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:21:47.950 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.947+0000 7fc094b28700 1 --2- 172.21.15.26:0/4036854480 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc07c0640b0 0x7fc07c066570 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x7fc078004630 tx=0x7fc078009b30).stop 2021-11-03T18:21:47.950 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.947+0000 7fc094b28700 1 -- 172.21.15.26:0/4036854480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0900f55e0 msgr2=0x7fc090106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:21:47.950 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.947+0000 7fc094b28700 1 --2- 172.21.15.26:0/4036854480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0900f55e0 0x7fc090106f70 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7fc088007fd0 tx=0x7fc088004ee0).stop 2021-11-03T18:21:47.950 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.947+0000 7fc094b28700 1 -- 172.21.15.26:0/4036854480 shutdown_connections 2021-11-03T18:21:47.951 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.947+0000 7fc094b28700 1 --2- 172.21.15.26:0/4036854480 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc07c0640b0 0x7fc07c066570 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:47.951 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.947+0000 7fc094b28700 1 --2- 172.21.15.26:0/4036854480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0900f55e0 0x7fc090106f70 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:47.951 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.947+0000 7fc094b28700 1 --2- 172.21.15.26:0/4036854480 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0900f5ef0 0x7fc090107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:47.951 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.947+0000 7fc094b28700 1 -- 172.21.15.26:0/4036854480 >> 172.21.15.26:0/4036854480 conn(0x7fc0900f0de0 msgr2=0x7fc09005f720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:21:47.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.947+0000 7fc094b28700 1 -- 172.21.15.26:0/4036854480 shutdown_connections 2021-11-03T18:21:47.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:47.947+0000 7fc094b28700 1 -- 172.21.15.26:0/4036854480 wait complete. 2021-11-03T18:21:48.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.047+0000 7f411bb1b700 1 -- 172.21.15.26:0/3182367487 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41140f55e0 msgr2=0x7f41140f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:21:48.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.047+0000 7f411bb1b700 1 --2- 172.21.15.26:0/3182367487 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41140f55e0 0x7f41140f5a00 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 rx=0x7f4104004660 tx=0x7f4104009b30).stop 2021-11-03T18:21:48.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.047+0000 7f411bb1b700 1 -- 172.21.15.26:0/3182367487 shutdown_connections 2021-11-03T18:21:48.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.047+0000 7f411bb1b700 1 --2- 172.21.15.26:0/3182367487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41140f5ef0 0x7f41140f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:48.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.047+0000 7f411bb1b700 1 --2- 172.21.15.26:0/3182367487 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41140f55e0 0x7f41140f5a00 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:48.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.047+0000 7f411bb1b700 1 -- 172.21.15.26:0/3182367487 >> 172.21.15.26:0/3182367487 conn(0x7f41140f0de0 msgr2=0x7f41140f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:21:48.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.047+0000 7f411bb1b700 1 -- 172.21.15.26:0/3182367487 shutdown_connections 2021-11-03T18:21:48.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.047+0000 7f411bb1b700 1 -- 172.21.15.26:0/3182367487 wait complete. 2021-11-03T18:21:48.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.048+0000 7f411bb1b700 1 Processor -- start 2021-11-03T18:21:48.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.048+0000 7f411bb1b700 1 -- start start 2021-11-03T18:21:48.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.048+0000 7f411bb1b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41140f55e0 0x7f4114109c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:21:48.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.048+0000 7f411bb1b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41140f5ef0 0x7f411410c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:21:48.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.048+0000 7f411bb1b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41140604c0 con 0x7f41140f55e0 2021-11-03T18:21:48.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.048+0000 7f411bb1b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4114060600 con 0x7f41140f5ef0 2021-11-03T18:21:48.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.048+0000 7f41198b7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41140f55e0 0x7f4114109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:21:48.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.048+0000 7f41198b7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41140f55e0 0x7f4114109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59610/0 (socket says 172.21.15.26:59610) 2021-11-03T18:21:48.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.048+0000 7f41198b7700 1 -- 172.21.15.26:0/2294362862 learned_addr learned my addr 172.21.15.26:0/2294362862 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:21:48.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.048+0000 7f41198b7700 1 -- 172.21.15.26:0/2294362862 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41140f5ef0 msgr2=0x7f411410c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:21:48.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.048+0000 7f41190b6700 1 --2- 172.21.15.26:0/2294362862 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41140f5ef0 0x7f411410c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:21:48.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.048+0000 7f41198b7700 1 --2- 172.21.15.26:0/2294362862 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41140f5ef0 0x7f411410c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:48.053 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.048+0000 7f41198b7700 1 -- 172.21.15.26:0/2294362862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4104005040 con 0x7f41140f55e0 2021-11-03T18:21:48.053 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.049+0000 7f41190b6700 1 --2- 172.21.15.26:0/2294362862 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41140f5ef0 0x7f411410c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:21:48.053 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.049+0000 7f41198b7700 1 --2- 172.21.15.26:0/2294362862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41140f55e0 0x7f4114109c10 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x7f4104009990 tx=0x7f4104009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:21:48.053 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.049+0000 7f410a7fc700 1 -- 172.21.15.26:0/2294362862 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4104018070 con 0x7f41140f55e0 2021-11-03T18:21:48.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.049+0000 7f410a7fc700 1 -- 172.21.15.26:0/2294362862 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4104007ba0 con 0x7f41140f55e0 2021-11-03T18:21:48.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.049+0000 7f410a7fc700 1 -- 172.21.15.26:0/2294362862 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f410401c3c0 con 0x7f41140f55e0 2021-11-03T18:21:48.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.049+0000 7f411bb1b700 1 -- 172.21.15.26:0/2294362862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f411410c660 con 0x7f41140f55e0 2021-11-03T18:21:48.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.049+0000 7f411bb1b700 1 -- 172.21.15.26:0/2294362862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f411410cb90 con 0x7f41140f55e0 2021-11-03T18:21:48.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.050+0000 7f411bb1b700 1 -- 172.21.15.26:0/2294362862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41140f4a70 con 0x7f41140f55e0 2021-11-03T18:21:48.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.050+0000 7f410a7fc700 1 -- 172.21.15.26:0/2294362862 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f410401d420 con 0x7f41140f55e0 2021-11-03T18:21:48.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.051+0000 7f410a7fc700 1 --2- 172.21.15.26:0/2294362862 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f41000640b0 0x7f4100066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:21:48.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.051+0000 7f410a7fc700 1 -- 172.21.15.26:0/2294362862 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f41040825b0 con 0x7f41140f55e0 2021-11-03T18:21:48.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.051+0000 7f41190b6700 1 --2- 172.21.15.26:0/2294362862 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f41000640b0 0x7f4100066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:21:48.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.051+0000 7f41190b6700 1 --2- 172.21.15.26:0/2294362862 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f41000640b0 0x7f4100066570 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7f4110009880 tx=0x7f411000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:21:48.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.055+0000 7f410a7fc700 1 -- 172.21.15.26:0/2294362862 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f4104054970 con 0x7f41140f55e0 2021-11-03T18:21:48.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.264+0000 7f411bb1b700 1 -- 172.21.15.26:0/2294362862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f41140fdea0 con 0x7f41140f55e0 2021-11-03T18:21:48.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.264+0000 7f410a7fc700 1 -- 172.21.15.26:0/2294362862 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f4104054560 con 0x7f41140f55e0 2021-11-03T18:21:48.264 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:21:48.264 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:21:48.264 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:21:48.265 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:21:48.265 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:21:48.265 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:21:48.265 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:21:48.266 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:21:48.266 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:21:48.266 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:21:48.266 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:21:48.267 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:21:48.267 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:21:48.267 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:21:48.267 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:21:48.267 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:21:48.268 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:21:48.268 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:21:48.268 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:21:48.269 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:21:48.269 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:21:48.269 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:21:48.270 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:21:48.270 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:21:48.270 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:21:48.271 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:21:48.271 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:21:48.271 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:21:48.271 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:21:48.272 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:21:48.272 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:21:48.272 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:21:48.272 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:21:48.273 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:21:48.273 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:21:48.273 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:21:48.273 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:21:48.273 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:21:48.274 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:21:48.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.266+0000 7f411bb1b700 1 -- 172.21.15.26:0/2294362862 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f41000640b0 msgr2=0x7f4100066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:21:48.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.266+0000 7f411bb1b700 1 --2- 172.21.15.26:0/2294362862 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f41000640b0 0x7f4100066570 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7f4110009880 tx=0x7f411000b040).stop 2021-11-03T18:21:48.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.266+0000 7f411bb1b700 1 -- 172.21.15.26:0/2294362862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41140f55e0 msgr2=0x7f4114109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:21:48.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.266+0000 7f411bb1b700 1 --2- 172.21.15.26:0/2294362862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41140f55e0 0x7f4114109c10 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x7f4104009990 tx=0x7f4104009b30).stop 2021-11-03T18:21:48.276 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.266+0000 7f411bb1b700 1 -- 172.21.15.26:0/2294362862 shutdown_connections 2021-11-03T18:21:48.276 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.266+0000 7f411bb1b700 1 --2- 172.21.15.26:0/2294362862 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f41000640b0 0x7f4100066570 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:48.276 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.266+0000 7f411bb1b700 1 --2- 172.21.15.26:0/2294362862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41140f55e0 0x7f4114109c10 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:48.276 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.266+0000 7f411bb1b700 1 --2- 172.21.15.26:0/2294362862 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41140f5ef0 0x7f411410c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:21:48.277 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.266+0000 7f411bb1b700 1 -- 172.21.15.26:0/2294362862 >> 172.21.15.26:0/2294362862 conn(0x7f41140f0de0 msgr2=0x7f41140fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:21:48.277 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.266+0000 7f411bb1b700 1 -- 172.21.15.26:0/2294362862 shutdown_connections 2021-11-03T18:21:48.277 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:21:48.266+0000 7f411bb1b700 1 -- 172.21.15.26:0/2294362862 wait complete. 2021-11-03T18:21:48.277 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:21:49.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:48 smithi194 ceph-mon[65619]: from='client.36828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:21:49.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:48 smithi194 ceph-mon[65619]: from='client.36832 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:21:49.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:48 smithi194 ceph-mon[65619]: pgmap v2614: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:49.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:48 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/4036854480' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:21:49.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:48 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2294362862' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:21:49.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:21:49.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:21:49.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:21:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:48 smithi026 ceph-mon[96795]: from='client.36828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:21:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:48 smithi026 ceph-mon[96795]: from='client.36832 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:21:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:48 smithi026 ceph-mon[96795]: pgmap v2614: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:49.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:48 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/4036854480' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:21:49.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:48 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2294362862' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:21:49.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:21:49.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:21:49.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:21:50.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:49 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:21:50.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:49 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:21:51.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:50 smithi194 ceph-mon[65619]: pgmap v2615: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:51.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:50 smithi026 ceph-mon[96795]: pgmap v2615: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:53.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:52 smithi194 ceph-mon[65619]: pgmap v2616: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:53.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:52 smithi026 ceph-mon[96795]: pgmap v2616: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:55.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:54 smithi194 ceph-mon[65619]: pgmap v2617: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:55.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:54 smithi026 ceph-mon[96795]: pgmap v2617: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:57.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:56 smithi194 ceph-mon[65619]: pgmap v2618: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:57.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:56 smithi026 ceph-mon[96795]: pgmap v2618: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:59.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:21:58 smithi194 ceph-mon[65619]: pgmap v2619: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:21:59.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:21:58 smithi026 ceph-mon[96795]: pgmap v2619: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:01.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:00 smithi194 ceph-mon[65619]: pgmap v2620: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:01.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:00 smithi026 ceph-mon[96795]: pgmap v2620: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:03.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:02 smithi194 ceph-mon[65619]: pgmap v2621: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:03.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:02 smithi026 ceph-mon[96795]: pgmap v2621: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:04.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:03 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:22:04.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:03 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:22:05.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:04 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:22:05.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:04 smithi194 ceph-mon[65619]: pgmap v2622: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:05.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:04 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:22:05.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:04 smithi026 ceph-mon[96795]: pgmap v2622: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:07.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:06 smithi194 ceph-mon[65619]: pgmap v2623: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:07.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:06 smithi026 ceph-mon[96795]: pgmap v2623: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:09.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:08 smithi194 ceph-mon[65619]: pgmap v2624: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:09.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:08 smithi026 ceph-mon[96795]: pgmap v2624: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:11.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:10 smithi194 ceph-mon[65619]: pgmap v2625: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:11.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:10 smithi026 ceph-mon[96795]: pgmap v2625: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:13.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:12 smithi194 ceph-mon[65619]: pgmap v2626: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:13.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:12 smithi026 ceph-mon[96795]: pgmap v2626: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:15.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:14 smithi194 ceph-mon[65619]: pgmap v2627: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:15.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:14 smithi026 ceph-mon[96795]: pgmap v2627: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:17.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:16 smithi194 ceph-mon[65619]: pgmap v2628: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:17.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:16 smithi026 ceph-mon[96795]: pgmap v2628: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:18.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.382+0000 7fd503535700 1 -- 172.21.15.26:0/1327893052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4fc0f7980 msgr2=0x7fd4fc0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:22:18.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.382+0000 7fd503535700 1 --2- 172.21.15.26:0/1327893052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4fc0f7980 0x7fd4fc0f7de0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7fd4f0004660 tx=0x7fd4f0009b30).stop 2021-11-03T18:22:18.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.382+0000 7fd503535700 1 -- 172.21.15.26:0/1327893052 shutdown_connections 2021-11-03T18:22:18.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.382+0000 7fd503535700 1 --2- 172.21.15.26:0/1327893052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4fc0f7980 0x7fd4fc0f7de0 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:18.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.382+0000 7fd503535700 1 --2- 172.21.15.26:0/1327893052 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4fc0f66e0 0x7fd4fc0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:18.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.382+0000 7fd503535700 1 -- 172.21.15.26:0/1327893052 >> 172.21.15.26:0/1327893052 conn(0x7fd4fc0f1e40 msgr2=0x7fd4fc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:22:18.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.382+0000 7fd503535700 1 -- 172.21.15.26:0/1327893052 shutdown_connections 2021-11-03T18:22:18.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.382+0000 7fd503535700 1 -- 172.21.15.26:0/1327893052 wait complete. 2021-11-03T18:22:18.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.383+0000 7fd503535700 1 Processor -- start 2021-11-03T18:22:18.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.383+0000 7fd503535700 1 -- start start 2021-11-03T18:22:18.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.383+0000 7fd503535700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4fc0f66e0 0x7fd4fc106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:22:18.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.383+0000 7fd503535700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4fc0f7980 0x7fd4fc107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:22:18.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.383+0000 7fd503535700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc107a00 con 0x7fd4fc0f7980 2021-11-03T18:22:18.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.383+0000 7fd503535700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc107b40 con 0x7fd4fc0f66e0 2021-11-03T18:22:18.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.383+0000 7fd500ad0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4fc0f7980 0x7fd4fc107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:22:18.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.383+0000 7fd500ad0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4fc0f7980 0x7fd4fc107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59630/0 (socket says 172.21.15.26:59630) 2021-11-03T18:22:18.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.383+0000 7fd500ad0700 1 -- 172.21.15.26:0/1232949447 learned_addr learned my addr 172.21.15.26:0/1232949447 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:22:18.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.383+0000 7fd5012d1700 1 --2- 172.21.15.26:0/1232949447 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4fc0f66e0 0x7fd4fc106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:22:18.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.383+0000 7fd500ad0700 1 -- 172.21.15.26:0/1232949447 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4fc0f66e0 msgr2=0x7fd4fc106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:22:18.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.383+0000 7fd500ad0700 1 --2- 172.21.15.26:0/1232949447 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4fc0f66e0 0x7fd4fc106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:18.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.383+0000 7fd500ad0700 1 -- 172.21.15.26:0/1232949447 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f0005040 con 0x7fd4fc0f7980 2021-11-03T18:22:18.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.383+0000 7fd500ad0700 1 --2- 172.21.15.26:0/1232949447 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4fc0f7980 0x7fd4fc107450 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 rx=0x7fd4f0009990 tx=0x7fd4f0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:22:18.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.384+0000 7fd4f9ffb700 1 -- 172.21.15.26:0/1232949447 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4f0018070 con 0x7fd4fc0f7980 2021-11-03T18:22:18.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.384+0000 7fd503535700 1 -- 172.21.15.26:0/1232949447 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4fc108480 con 0x7fd4fc0f7980 2021-11-03T18:22:18.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.384+0000 7fd4f9ffb700 1 -- 172.21.15.26:0/1232949447 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd4f0007ba0 con 0x7fd4fc0f7980 2021-11-03T18:22:18.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.384+0000 7fd4f9ffb700 1 -- 172.21.15.26:0/1232949447 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4f001c3c0 con 0x7fd4fc0f7980 2021-11-03T18:22:18.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.384+0000 7fd503535700 1 -- 172.21.15.26:0/1232949447 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4fc1089e0 con 0x7fd4fc0f7980 2021-11-03T18:22:18.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.385+0000 7fd503535700 1 -- 172.21.15.26:0/1232949447 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4fc045ad0 con 0x7fd4fc0f7980 2021-11-03T18:22:18.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.385+0000 7fd4f9ffb700 1 -- 172.21.15.26:0/1232949447 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fd4f001d420 con 0x7fd4fc0f7980 2021-11-03T18:22:18.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.386+0000 7fd4f9ffb700 1 --2- 172.21.15.26:0/1232949447 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd4e40640b0 0x7fd4e4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:22:18.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.386+0000 7fd4f9ffb700 1 -- 172.21.15.26:0/1232949447 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fd4f0082360 con 0x7fd4fc0f7980 2021-11-03T18:22:18.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.386+0000 7fd5012d1700 1 --2- 172.21.15.26:0/1232949447 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd4e40640b0 0x7fd4e4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:22:18.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.386+0000 7fd5012d1700 1 --2- 172.21.15.26:0/1232949447 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd4e40640b0 0x7fd4e4066570 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7fd4fc0f77e0 tx=0x7fd4f4009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:22:18.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.390+0000 7fd4f9ffb700 1 -- 172.21.15.26:0/1232949447 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fd4f0054720 con 0x7fd4fc0f7980 2021-11-03T18:22:18.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.578+0000 7fd503535700 1 -- 172.21.15.26:0/1232949447 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4fc0fefb0 con 0x7fd4e40640b0 2021-11-03T18:22:18.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.579+0000 7fd4f9ffb700 1 -- 172.21.15.26:0/1232949447 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fd4fc0fefb0 con 0x7fd4e40640b0 2021-11-03T18:22:18.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.581+0000 7fd503535700 1 -- 172.21.15.26:0/1232949447 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd4e40640b0 msgr2=0x7fd4e4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:22:18.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.581+0000 7fd503535700 1 --2- 172.21.15.26:0/1232949447 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd4e40640b0 0x7fd4e4066570 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7fd4fc0f77e0 tx=0x7fd4f4009040).stop 2021-11-03T18:22:18.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.581+0000 7fd503535700 1 -- 172.21.15.26:0/1232949447 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4fc0f7980 msgr2=0x7fd4fc107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:22:18.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.581+0000 7fd503535700 1 --2- 172.21.15.26:0/1232949447 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4fc0f7980 0x7fd4fc107450 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 rx=0x7fd4f0009990 tx=0x7fd4f0009b30).stop 2021-11-03T18:22:18.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.581+0000 7fd503535700 1 -- 172.21.15.26:0/1232949447 shutdown_connections 2021-11-03T18:22:18.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.581+0000 7fd503535700 1 --2- 172.21.15.26:0/1232949447 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd4e40640b0 0x7fd4e4066570 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:18.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.581+0000 7fd503535700 1 --2- 172.21.15.26:0/1232949447 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4fc0f66e0 0x7fd4fc106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:18.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.581+0000 7fd503535700 1 --2- 172.21.15.26:0/1232949447 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4fc0f7980 0x7fd4fc107450 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:18.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.581+0000 7fd503535700 1 -- 172.21.15.26:0/1232949447 >> 172.21.15.26:0/1232949447 conn(0x7fd4fc0f1e40 msgr2=0x7fd4fc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:22:18.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.581+0000 7fd503535700 1 -- 172.21.15.26:0/1232949447 shutdown_connections 2021-11-03T18:22:18.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.582+0000 7fd503535700 1 -- 172.21.15.26:0/1232949447 wait complete. 2021-11-03T18:22:18.589 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:22:18.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.686+0000 7f9ce469f700 1 -- 172.21.15.26:0/3675782906 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cdc0f7980 msgr2=0x7f9cdc0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:22:18.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.686+0000 7f9ce469f700 1 --2- 172.21.15.26:0/3675782906 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cdc0f7980 0x7f9cdc0f7de0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 rx=0x7f9cd8004660 tx=0x7f9cd8009b30).stop 2021-11-03T18:22:18.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.686+0000 7f9ce469f700 1 -- 172.21.15.26:0/3675782906 shutdown_connections 2021-11-03T18:22:18.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.686+0000 7f9ce469f700 1 --2- 172.21.15.26:0/3675782906 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cdc0f7980 0x7f9cdc0f7de0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:18.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.686+0000 7f9ce469f700 1 --2- 172.21.15.26:0/3675782906 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cdc0f66e0 0x7f9cdc0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:18.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.686+0000 7f9ce469f700 1 -- 172.21.15.26:0/3675782906 >> 172.21.15.26:0/3675782906 conn(0x7f9cdc0f1e40 msgr2=0x7f9cdc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:22:18.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.686+0000 7f9ce469f700 1 -- 172.21.15.26:0/3675782906 shutdown_connections 2021-11-03T18:22:18.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.686+0000 7f9ce469f700 1 -- 172.21.15.26:0/3675782906 wait complete. 2021-11-03T18:22:18.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.687+0000 7f9ce469f700 1 Processor -- start 2021-11-03T18:22:18.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.687+0000 7f9ce469f700 1 -- start start 2021-11-03T18:22:18.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.687+0000 7f9ce469f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cdc0f66e0 0x7f9cdc106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:22:18.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.687+0000 7f9ce469f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cdc0f7980 0x7f9cdc107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:22:18.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.687+0000 7f9ce469f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cdc1079b0 con 0x7f9cdc0f66e0 2021-11-03T18:22:18.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.687+0000 7f9ce469f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cdc107af0 con 0x7f9cdc0f7980 2021-11-03T18:22:18.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.687+0000 7f9ce243b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cdc0f66e0 0x7f9cdc106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:22:18.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.687+0000 7f9ce243b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cdc0f66e0 0x7f9cdc106f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59638/0 (socket says 172.21.15.26:59638) 2021-11-03T18:22:18.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.687+0000 7f9ce243b700 1 -- 172.21.15.26:0/1970188219 learned_addr learned my addr 172.21.15.26:0/1970188219 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:22:18.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.687+0000 7f9ce1c3a700 1 --2- 172.21.15.26:0/1970188219 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cdc0f7980 0x7f9cdc107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:22:18.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.687+0000 7f9ce243b700 1 -- 172.21.15.26:0/1970188219 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cdc0f7980 msgr2=0x7f9cdc107400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:22:18.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.687+0000 7f9ce243b700 1 --2- 172.21.15.26:0/1970188219 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cdc0f7980 0x7f9cdc107400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:18.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.687+0000 7f9ce243b700 1 -- 172.21.15.26:0/1970188219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd8005040 con 0x7f9cdc0f66e0 2021-11-03T18:22:18.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.687+0000 7f9ce243b700 1 --2- 172.21.15.26:0/1970188219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cdc0f66e0 0x7f9cdc106f10 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7f9ccc00e7c0 tx=0x7f9ccc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:22:18.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.688+0000 7f9cd2ffd700 1 -- 172.21.15.26:0/1970188219 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ccc0092e0 con 0x7f9cdc0f66e0 2021-11-03T18:22:18.692 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.688+0000 7f9cd2ffd700 1 -- 172.21.15.26:0/1970188219 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9ccc00f040 con 0x7f9cdc0f66e0 2021-11-03T18:22:18.692 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.688+0000 7f9ce469f700 1 -- 172.21.15.26:0/1970188219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cdc108490 con 0x7f9cdc0f66e0 2021-11-03T18:22:18.692 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.688+0000 7f9cd2ffd700 1 -- 172.21.15.26:0/1970188219 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ccc0147e0 con 0x7f9cdc0f66e0 2021-11-03T18:22:18.692 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.688+0000 7f9ce469f700 1 -- 172.21.15.26:0/1970188219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cdc108a50 con 0x7f9cdc0f66e0 2021-11-03T18:22:18.694 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.689+0000 7f9ce469f700 1 -- 172.21.15.26:0/1970188219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cdc045ad0 con 0x7f9cdc0f66e0 2021-11-03T18:22:18.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.689+0000 7f9cd2ffd700 1 -- 172.21.15.26:0/1970188219 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f9ccc01b030 con 0x7f9cdc0f66e0 2021-11-03T18:22:18.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.689+0000 7f9cd2ffd700 1 --2- 172.21.15.26:0/1970188219 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9cc80640b0 0x7f9cc8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:22:18.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.690+0000 7f9cd2ffd700 1 -- 172.21.15.26:0/1970188219 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f9ccc080790 con 0x7f9cdc0f66e0 2021-11-03T18:22:18.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.690+0000 7f9ce1c3a700 1 --2- 172.21.15.26:0/1970188219 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9cc80640b0 0x7f9cc8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:22:18.696 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.690+0000 7f9ce1c3a700 1 --2- 172.21.15.26:0/1970188219 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9cc80640b0 0x7f9cc8066570 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7f9cd8005010 tx=0x7f9cd8016040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:22:18.696 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.694+0000 7f9cd2ffd700 1 -- 172.21.15.26:0/1970188219 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f9ccc052a00 con 0x7f9cdc0f66e0 2021-11-03T18:22:18.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.874+0000 7f9ce469f700 1 -- 172.21.15.26:0/1970188219 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9cdc108d30 con 0x7f9cc80640b0 2021-11-03T18:22:18.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.889+0000 7f9cd2ffd700 1 -- 172.21.15.26:0/1970188219 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f9cdc108d30 con 0x7f9cc80640b0 2021-11-03T18:22:18.888 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:22:18.888 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (93m) 2m ago 94m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:22:18.889 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (85m) 2m ago 94m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:22:18.889 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (85m) 60s ago 94m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:22:18.889 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (93m) 2m ago 94m 42.2M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:22:18.890 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (86m) 2m ago 89m 26.0M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:22:18.890 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (86m) 2m ago 89m 26.6M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:22:18.890 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (89m) 60s ago 89m 26.8M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:22:18.890 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (89m) 60s ago 89m 27.2M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:22:18.890 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (87m) 2m ago 96m 588M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:22:18.891 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (86m) 60s ago 93m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:22:18.891 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (86m) 2m ago 96m 341M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:22:18.891 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (86m) 60s ago 93m 158M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:22:18.891 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (94m) 2m ago 94m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:22:18.892 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (93m) 60s ago 93m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:22:18.892 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (85m) 2m ago 93m 332M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:22:18.892 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (84m) 2m ago 92m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:22:18.892 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (84m) 2m ago 92m 296M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:22:18.893 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (83m) 60s ago 92m 387M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:22:18.893 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (83m) 60s ago 91m 320M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:22:18.893 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (82m) 60s ago 91m 316M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:22:18.893 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (93m) 2m ago 94m 65.7M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:22:18.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.891+0000 7f9ce469f700 1 -- 172.21.15.26:0/1970188219 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9cc80640b0 msgr2=0x7f9cc8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:22:18.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.891+0000 7f9ce469f700 1 --2- 172.21.15.26:0/1970188219 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9cc80640b0 0x7f9cc8066570 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7f9cd8005010 tx=0x7f9cd8016040).stop 2021-11-03T18:22:18.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.891+0000 7f9ce469f700 1 -- 172.21.15.26:0/1970188219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cdc0f66e0 msgr2=0x7f9cdc106f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:22:18.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.891+0000 7f9ce469f700 1 --2- 172.21.15.26:0/1970188219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cdc0f66e0 0x7f9cdc106f10 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7f9ccc00e7c0 tx=0x7f9ccc00b040).stop 2021-11-03T18:22:18.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.892+0000 7f9ce469f700 1 -- 172.21.15.26:0/1970188219 shutdown_connections 2021-11-03T18:22:18.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.892+0000 7f9ce469f700 1 --2- 172.21.15.26:0/1970188219 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9cc80640b0 0x7f9cc8066570 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:18.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.892+0000 7f9ce469f700 1 --2- 172.21.15.26:0/1970188219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cdc0f66e0 0x7f9cdc106f10 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:18.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.892+0000 7f9ce469f700 1 --2- 172.21.15.26:0/1970188219 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cdc0f7980 0x7f9cdc107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:18.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.892+0000 7f9ce469f700 1 -- 172.21.15.26:0/1970188219 >> 172.21.15.26:0/1970188219 conn(0x7f9cdc0f1e40 msgr2=0x7f9cdc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:22:18.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.892+0000 7f9ce469f700 1 -- 172.21.15.26:0/1970188219 shutdown_connections 2021-11-03T18:22:18.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:18.892+0000 7f9ce469f700 1 -- 172.21.15.26:0/1970188219 wait complete. 2021-11-03T18:22:19.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.007+0000 7f5fa54e9700 1 -- 172.21.15.26:0/150138605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fa00f55c0 msgr2=0x7f5fa00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:22:19.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.007+0000 7f5fa54e9700 1 --2- 172.21.15.26:0/150138605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fa00f55c0 0x7f5fa00f59e0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7f5f980099e0 tx=0x7f5f98004d10).stop 2021-11-03T18:22:19.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.007+0000 7f5fa54e9700 1 -- 172.21.15.26:0/150138605 shutdown_connections 2021-11-03T18:22:19.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.007+0000 7f5fa54e9700 1 --2- 172.21.15.26:0/150138605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5fa00f6860 0x7f5fa00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:19.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.007+0000 7f5fa54e9700 1 --2- 172.21.15.26:0/150138605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fa00f55c0 0x7f5fa00f59e0 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:19.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.007+0000 7f5fa54e9700 1 -- 172.21.15.26:0/150138605 >> 172.21.15.26:0/150138605 conn(0x7f5fa00f0d40 msgr2=0x7f5fa00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:22:19.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.007+0000 7f5fa54e9700 1 -- 172.21.15.26:0/150138605 shutdown_connections 2021-11-03T18:22:19.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.007+0000 7f5fa54e9700 1 -- 172.21.15.26:0/150138605 wait complete. 2021-11-03T18:22:19.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.008+0000 7f5fa54e9700 1 Processor -- start 2021-11-03T18:22:19.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.008+0000 7f5fa54e9700 1 -- start start 2021-11-03T18:22:19.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.008+0000 7f5fa54e9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fa00f55c0 0x7f5fa0105f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:22:19.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.008+0000 7f5fa54e9700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5fa00f6860 0x7f5fa0106450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:22:19.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.008+0000 7f5fa54e9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa0106a00 con 0x7f5fa00f55c0 2021-11-03T18:22:19.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.008+0000 7f5fa54e9700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa0106b40 con 0x7f5fa00f6860 2021-11-03T18:22:19.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.009+0000 7f5f9effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fa00f55c0 0x7f5fa0105f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:22:19.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.009+0000 7f5f9effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fa00f55c0 0x7f5fa0105f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59648/0 (socket says 172.21.15.26:59648) 2021-11-03T18:22:19.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.009+0000 7f5f9effd700 1 -- 172.21.15.26:0/963972361 learned_addr learned my addr 172.21.15.26:0/963972361 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:22:19.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.009+0000 7f5f9e7fc700 1 --2- 172.21.15.26:0/963972361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5fa00f6860 0x7f5fa0106450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:22:19.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.009+0000 7f5f9effd700 1 -- 172.21.15.26:0/963972361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5fa00f6860 msgr2=0x7f5fa0106450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:22:19.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.009+0000 7f5f9effd700 1 --2- 172.21.15.26:0/963972361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5fa00f6860 0x7f5fa0106450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:19.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.009+0000 7f5f9effd700 1 -- 172.21.15.26:0/963972361 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f98009640 con 0x7f5fa00f55c0 2021-11-03T18:22:19.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.009+0000 7f5f9effd700 1 --2- 172.21.15.26:0/963972361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fa00f55c0 0x7f5fa0105f60 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 rx=0x7f5f9800bb10 tx=0x7f5f98004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:22:19.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.009+0000 7f5f977fe700 1 -- 172.21.15.26:0/963972361 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f9800e070 con 0x7f5fa00f55c0 2021-11-03T18:22:19.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.009+0000 7f5f977fe700 1 -- 172.21.15.26:0/963972361 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5f98015d50 con 0x7f5fa00f55c0 2021-11-03T18:22:19.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.009+0000 7f5f977fe700 1 -- 172.21.15.26:0/963972361 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f9801a070 con 0x7f5fa00f55c0 2021-11-03T18:22:19.018 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.009+0000 7f5fa54e9700 1 -- 172.21.15.26:0/963972361 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fa0107480 con 0x7f5fa00f55c0 2021-11-03T18:22:19.018 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.009+0000 7f5fa54e9700 1 -- 172.21.15.26:0/963972361 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fa0107910 con 0x7f5fa00f55c0 2021-11-03T18:22:19.019 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.010+0000 7f5fa54e9700 1 -- 172.21.15.26:0/963972361 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fa0045ad0 con 0x7f5fa00f55c0 2021-11-03T18:22:19.019 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.011+0000 7f5f977fe700 1 -- 172.21.15.26:0/963972361 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f5f98026060 con 0x7f5fa00f55c0 2021-11-03T18:22:19.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.012+0000 7f5f977fe700 1 --2- 172.21.15.26:0/963972361 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5f8c064090 0x7f5f8c066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:22:19.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.012+0000 7f5f977fe700 1 -- 172.21.15.26:0/963972361 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f5f98084330 con 0x7f5fa00f55c0 2021-11-03T18:22:19.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.012+0000 7f5f9e7fc700 1 --2- 172.21.15.26:0/963972361 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5f8c064090 0x7f5f8c066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:22:19.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.012+0000 7f5f9e7fc700 1 --2- 172.21.15.26:0/963972361 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5f8c064090 0x7f5f8c066550 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7f5f88004c40 tx=0x7f5f8800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:22:19.021 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.015+0000 7f5f977fe700 1 -- 172.21.15.26:0/963972361 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f5f980565d0 con 0x7f5fa00f55c0 2021-11-03T18:22:19.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:18 smithi194 ceph-mon[65619]: pgmap v2629: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:19.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:18 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:22:19.255 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.257+0000 7f5fa54e9700 1 -- 172.21.15.26:0/963972361 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5fa00ffd90 con 0x7f5fa00f55c0 2021-11-03T18:22:19.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.258+0000 7f5f977fe700 1 -- 172.21.15.26:0/963972361 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f5f980561c0 con 0x7f5fa00f55c0 2021-11-03T18:22:19.256 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:22:19.256 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:22:19.257 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:22:19.257 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:22:19.257 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:22:19.257 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:22:19.258 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:22:19.258 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:22:19.258 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:22:19.258 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:22:19.259 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:22:19.259 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:22:19.259 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:22:19.259 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:22:19.260 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:22:19.260 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:22:19.260 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:22:19.260 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:22:19.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.260+0000 7f5fa54e9700 1 -- 172.21.15.26:0/963972361 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5f8c064090 msgr2=0x7f5f8c066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:22:19.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.260+0000 7f5fa54e9700 1 --2- 172.21.15.26:0/963972361 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5f8c064090 0x7f5f8c066550 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7f5f88004c40 tx=0x7f5f8800b040).stop 2021-11-03T18:22:19.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.260+0000 7f5fa54e9700 1 -- 172.21.15.26:0/963972361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fa00f55c0 msgr2=0x7f5fa0105f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:22:19.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.260+0000 7f5fa54e9700 1 --2- 172.21.15.26:0/963972361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fa00f55c0 0x7f5fa0105f60 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 rx=0x7f5f9800bb10 tx=0x7f5f98004d10).stop 2021-11-03T18:22:19.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.260+0000 7f5fa54e9700 1 -- 172.21.15.26:0/963972361 shutdown_connections 2021-11-03T18:22:19.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.260+0000 7f5fa54e9700 1 --2- 172.21.15.26:0/963972361 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5f8c064090 0x7f5f8c066550 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:19.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.260+0000 7f5fa54e9700 1 --2- 172.21.15.26:0/963972361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fa00f55c0 0x7f5fa0105f60 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:19.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.260+0000 7f5fa54e9700 1 --2- 172.21.15.26:0/963972361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5fa00f6860 0x7f5fa0106450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:19.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.260+0000 7f5fa54e9700 1 -- 172.21.15.26:0/963972361 >> 172.21.15.26:0/963972361 conn(0x7f5fa00f0d40 msgr2=0x7f5fa00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:22:19.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.260+0000 7f5fa54e9700 1 -- 172.21.15.26:0/963972361 shutdown_connections 2021-11-03T18:22:19.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.260+0000 7f5fa54e9700 1 -- 172.21.15.26:0/963972361 wait complete. 2021-11-03T18:22:19.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.368+0000 7f2a86057700 1 -- 172.21.15.26:0/3640212438 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a800f55c0 msgr2=0x7f2a800f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:22:19.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.368+0000 7f2a86057700 1 --2- 172.21.15.26:0/3640212438 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a800f55c0 0x7f2a800f59e0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7f2a70004660 tx=0x7f2a70009b30).stop 2021-11-03T18:22:19.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.368+0000 7f2a86057700 1 -- 172.21.15.26:0/3640212438 shutdown_connections 2021-11-03T18:22:19.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.368+0000 7f2a86057700 1 --2- 172.21.15.26:0/3640212438 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a800f5ed0 0x7f2a800f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:19.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.368+0000 7f2a86057700 1 --2- 172.21.15.26:0/3640212438 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a800f55c0 0x7f2a800f59e0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:19.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.368+0000 7f2a86057700 1 -- 172.21.15.26:0/3640212438 >> 172.21.15.26:0/3640212438 conn(0x7f2a800f0dc0 msgr2=0x7f2a800f31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:22:19.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.368+0000 7f2a86057700 1 -- 172.21.15.26:0/3640212438 shutdown_connections 2021-11-03T18:22:19.370 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.368+0000 7f2a86057700 1 -- 172.21.15.26:0/3640212438 wait complete. 2021-11-03T18:22:19.370 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.368+0000 7f2a86057700 1 Processor -- start 2021-11-03T18:22:19.370 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.369+0000 7f2a86057700 1 -- start start 2021-11-03T18:22:19.370 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.369+0000 7f2a86057700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a800f55c0 0x7f2a80109bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:22:19.370 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.369+0000 7f2a86057700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a800f5ed0 0x7f2a8010c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:22:19.371 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.369+0000 7f2a86057700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a80060560 con 0x7f2a800f5ed0 2021-11-03T18:22:19.371 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.369+0000 7f2a86057700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a800606a0 con 0x7f2a800f55c0 2021-11-03T18:22:19.371 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.369+0000 7f2a7effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a800f5ed0 0x7f2a8010c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:22:19.372 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.369+0000 7f2a7effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a800f5ed0 0x7f2a8010c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59660/0 (socket says 172.21.15.26:59660) 2021-11-03T18:22:19.372 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.369+0000 7f2a7effd700 1 -- 172.21.15.26:0/4259903744 learned_addr learned my addr 172.21.15.26:0/4259903744 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:22:19.372 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.369+0000 7f2a7f7fe700 1 --2- 172.21.15.26:0/4259903744 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a800f55c0 0x7f2a80109bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:22:19.372 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.369+0000 7f2a7effd700 1 -- 172.21.15.26:0/4259903744 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a800f55c0 msgr2=0x7f2a80109bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:22:19.372 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.369+0000 7f2a7effd700 1 --2- 172.21.15.26:0/4259903744 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a800f55c0 0x7f2a80109bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:19.373 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.369+0000 7f2a7effd700 1 -- 172.21.15.26:0/4259903744 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a70005040 con 0x7f2a800f5ed0 2021-11-03T18:22:19.373 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.369+0000 7f2a7f7fe700 1 --2- 172.21.15.26:0/4259903744 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a800f55c0 0x7f2a80109bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-03T18:22:19.374 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.369+0000 7f2a7effd700 1 --2- 172.21.15.26:0/4259903744 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a800f5ed0 0x7f2a8010c0d0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 rx=0x7f2a74002700 tx=0x7f2a74009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:22:19.374 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.370+0000 7f2a67fff700 1 -- 172.21.15.26:0/4259903744 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a74009320 con 0x7f2a800f5ed0 2021-11-03T18:22:19.374 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.370+0000 7f2a86057700 1 -- 172.21.15.26:0/4259903744 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a8010c680 con 0x7f2a800f5ed0 2021-11-03T18:22:19.374 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.370+0000 7f2a67fff700 1 -- 172.21.15.26:0/4259903744 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2a7400f040 con 0x7f2a800f5ed0 2021-11-03T18:22:19.375 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.370+0000 7f2a67fff700 1 -- 172.21.15.26:0/4259903744 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a74014870 con 0x7f2a800f5ed0 2021-11-03T18:22:19.375 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.370+0000 7f2a86057700 1 -- 172.21.15.26:0/4259903744 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a8010cc40 con 0x7f2a800f5ed0 2021-11-03T18:22:19.376 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.371+0000 7f2a86057700 1 -- 172.21.15.26:0/4259903744 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a80045ad0 con 0x7f2a800f5ed0 2021-11-03T18:22:19.376 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.371+0000 7f2a67fff700 1 -- 172.21.15.26:0/4259903744 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f2a74009480 con 0x7f2a800f5ed0 2021-11-03T18:22:19.376 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.371+0000 7f2a67fff700 1 --2- 172.21.15.26:0/4259903744 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2a680640b0 0x7f2a68066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:22:19.377 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.372+0000 7f2a67fff700 1 -- 172.21.15.26:0/4259903744 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f2a74080a70 con 0x7f2a800f5ed0 2021-11-03T18:22:19.377 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.372+0000 7f2a7f7fe700 1 --2- 172.21.15.26:0/4259903744 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2a680640b0 0x7f2a68066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:22:19.377 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.372+0000 7f2a7f7fe700 1 --2- 172.21.15.26:0/4259903744 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2a680640b0 0x7f2a68066570 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7f2a70013690 tx=0x7f2a70009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:22:19.377 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.376+0000 7f2a67fff700 1 -- 172.21.15.26:0/4259903744 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f2a74052dd0 con 0x7f2a800f5ed0 2021-11-03T18:22:19.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:18 smithi026 ceph-mon[96795]: pgmap v2629: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:19.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:18 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:22:19.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.600+0000 7f2a86057700 1 -- 172.21.15.26:0/4259903744 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2a80027a00 con 0x7f2a800f5ed0 2021-11-03T18:22:19.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.601+0000 7f2a67fff700 1 -- 172.21.15.26:0/4259903744 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f2a74080e60 con 0x7f2a800f5ed0 2021-11-03T18:22:19.599 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:22:19.600 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:22:19.600 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:22:19.600 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:22:19.601 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:22:19.601 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:22:19.601 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:22:19.601 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:22:19.602 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:22:19.602 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:22:19.602 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:22:19.602 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:22:19.602 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:22:19.603 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:22:19.603 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:22:19.603 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:22:19.603 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:22:19.604 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:22:19.604 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:22:19.604 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:22:19.604 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:22:19.604 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:22:19.605 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:22:19.605 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:22:19.605 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:22:19.605 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:22:19.605 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:22:19.606 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:22:19.606 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:22:19.606 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:22:19.606 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:22:19.607 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:22:19.607 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:22:19.607 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:22:19.607 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:22:19.607 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:22:19.608 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:22:19.608 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:22:19.608 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:22:19.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.602+0000 7f2a86057700 1 -- 172.21.15.26:0/4259903744 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2a680640b0 msgr2=0x7f2a68066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:22:19.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.602+0000 7f2a86057700 1 --2- 172.21.15.26:0/4259903744 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2a680640b0 0x7f2a68066570 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7f2a70013690 tx=0x7f2a70009b30).stop 2021-11-03T18:22:19.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.602+0000 7f2a86057700 1 -- 172.21.15.26:0/4259903744 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a800f5ed0 msgr2=0x7f2a8010c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:22:19.610 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.602+0000 7f2a86057700 1 --2- 172.21.15.26:0/4259903744 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a800f5ed0 0x7f2a8010c0d0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 rx=0x7f2a74002700 tx=0x7f2a74009e00).stop 2021-11-03T18:22:19.610 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.602+0000 7f2a86057700 1 -- 172.21.15.26:0/4259903744 shutdown_connections 2021-11-03T18:22:19.610 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.602+0000 7f2a86057700 1 --2- 172.21.15.26:0/4259903744 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2a680640b0 0x7f2a68066570 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:19.610 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.602+0000 7f2a86057700 1 --2- 172.21.15.26:0/4259903744 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a800f55c0 0x7f2a80109bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:19.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.602+0000 7f2a86057700 1 --2- 172.21.15.26:0/4259903744 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a800f5ed0 0x7f2a8010c0d0 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:19.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.602+0000 7f2a86057700 1 -- 172.21.15.26:0/4259903744 >> 172.21.15.26:0/4259903744 conn(0x7f2a800f0dc0 msgr2=0x7f2a800fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:22:19.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.603+0000 7f2a86057700 1 -- 172.21.15.26:0/4259903744 shutdown_connections 2021-11-03T18:22:19.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:19.603+0000 7f2a86057700 1 -- 172.21.15.26:0/4259903744 wait complete. 2021-11-03T18:22:19.612 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:22:20.149 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:19 smithi026 ceph-mon[96795]: poll took 60057.258 ms: 1 events 2021-11-03T18:22:20.150 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:19 smithi026 ceph-mon[96795]: from='client.36844 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:22:20.150 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:19 smithi026 ceph-mon[96795]: from='client.36848 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:22:20.150 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:19 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/963972361' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:22:20.151 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:19 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/4259903744' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:22:20.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:19 smithi194 ceph-mon[65619]: poll took 60057.258 ms: 1 events 2021-11-03T18:22:20.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:19 smithi194 ceph-mon[65619]: from='client.36844 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:22:20.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:19 smithi194 ceph-mon[65619]: from='client.36848 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:22:20.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:19 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/963972361' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:22:20.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:19 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/4259903744' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:22:21.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:20 smithi026 ceph-mon[96795]: pgmap v2630: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:21.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:20 smithi194 ceph-mon[65619]: pgmap v2630: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:23.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:23 smithi194 ceph-mon[65619]: pgmap v2631: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:23.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:23 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:22:23.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:23 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:22:23.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:23 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:22:23.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:23 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:22:23.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:23 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:22:23.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:23 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:22:23.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:23 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:22:23.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:23 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:22:23.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:23 smithi026 ceph-mon[96795]: pgmap v2631: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:23.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:23 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:22:23.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:23 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:22:23.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:23 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:22:23.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:23 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:22:23.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:23 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:22:23.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:23 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:22:23.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:23 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:22:23.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:23 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:22:24.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:24 smithi026 ceph-mon[96795]: poll took 3178.433 ms: 1 events 2021-11-03T18:22:24.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:24 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:22:24.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:24 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:22:24.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:24 smithi194 ceph-mon[65619]: poll took 3178.433 ms: 1 events 2021-11-03T18:22:24.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:24 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:22:24.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:24 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:22:25.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:25 smithi026 ceph-mon[96795]: pgmap v2632: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:25.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:25 smithi194 ceph-mon[65619]: pgmap v2632: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:27.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:27 smithi026 ceph-mon[96795]: pgmap v2633: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:27.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:27 smithi194 ceph-mon[65619]: pgmap v2633: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:29.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:29 smithi026 ceph-mon[96795]: pgmap v2634: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:29.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:29 smithi194 ceph-mon[65619]: pgmap v2634: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:31.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:31 smithi026 ceph-mon[96795]: pgmap v2635: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:31.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:31 smithi194 ceph-mon[65619]: pgmap v2635: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:33.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:33 smithi026 ceph-mon[96795]: pgmap v2636: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:33.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:33 smithi194 ceph-mon[65619]: pgmap v2636: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:35.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:35 smithi026 ceph-mon[96795]: pgmap v2637: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:35.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:35 smithi194 ceph-mon[65619]: pgmap v2637: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:37.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:37 smithi026 ceph-mon[96795]: pgmap v2638: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:37.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:37 smithi194 ceph-mon[65619]: pgmap v2638: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:38.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:38 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:22:38.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:38 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:22:39.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:39 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:22:39.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:39 smithi026 ceph-mon[96795]: pgmap v2639: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:39.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:39 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:22:39.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:39 smithi194 ceph-mon[65619]: pgmap v2639: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:41.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:41 smithi026 ceph-mon[96795]: pgmap v2640: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:41.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:41 smithi194 ceph-mon[65619]: pgmap v2640: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:43.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:43 smithi026 ceph-mon[96795]: pgmap v2641: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:43.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:43 smithi194 ceph-mon[65619]: pgmap v2641: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:45.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:45 smithi026 ceph-mon[96795]: pgmap v2642: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:45.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:45 smithi194 ceph-mon[65619]: pgmap v2642: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:47.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:47 smithi026 ceph-mon[96795]: pgmap v2643: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:47.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:47 smithi194 ceph-mon[65619]: pgmap v2643: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:49 smithi026 ceph-mon[96795]: pgmap v2644: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:22:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:22:49.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:49 smithi194 ceph-mon[65619]: pgmap v2644: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:22:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:22:49.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.716+0000 7fd85c8f9700 1 -- 172.21.15.26:0/111296772 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8580f6530 msgr2=0x7fd8580f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:22:49.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.716+0000 7fd85c8f9700 1 --2- 172.21.15.26:0/111296772 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8580f6530 0x7fd8580f6950 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 rx=0x7fd848004660 tx=0x7fd848009b30).stop 2021-11-03T18:22:49.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.716+0000 7fd85c8f9700 1 -- 172.21.15.26:0/111296772 shutdown_connections 2021-11-03T18:22:49.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.716+0000 7fd85c8f9700 1 --2- 172.21.15.26:0/111296772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8580f77d0 0x7fd8580f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:49.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.716+0000 7fd85c8f9700 1 --2- 172.21.15.26:0/111296772 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8580f6530 0x7fd8580f6950 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:49.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.716+0000 7fd85c8f9700 1 -- 172.21.15.26:0/111296772 >> 172.21.15.26:0/111296772 conn(0x7fd8580f1cd0 msgr2=0x7fd8580f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:22:49.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.716+0000 7fd85c8f9700 1 -- 172.21.15.26:0/111296772 shutdown_connections 2021-11-03T18:22:49.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.716+0000 7fd85c8f9700 1 -- 172.21.15.26:0/111296772 wait complete. 2021-11-03T18:22:49.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.717+0000 7fd85c8f9700 1 Processor -- start 2021-11-03T18:22:49.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.717+0000 7fd85c8f9700 1 -- start start 2021-11-03T18:22:49.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.717+0000 7fd85c8f9700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8580f6530 0x7fd85806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:22:49.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.717+0000 7fd85c8f9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8580f77d0 0x7fd858069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:22:49.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.717+0000 7fd85c8f9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85806a380 con 0x7fd8580f77d0 2021-11-03T18:22:49.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.717+0000 7fd85c8f9700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85806a4c0 con 0x7fd8580f6530 2021-11-03T18:22:49.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.718+0000 7fd85659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8580f77d0 0x7fd858069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:22:49.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.718+0000 7fd85659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8580f77d0 0x7fd858069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59678/0 (socket says 172.21.15.26:59678) 2021-11-03T18:22:49.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.718+0000 7fd85659c700 1 -- 172.21.15.26:0/3057285925 learned_addr learned my addr 172.21.15.26:0/3057285925 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:22:49.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.718+0000 7fd856d9d700 1 --2- 172.21.15.26:0/3057285925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8580f6530 0x7fd85806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:22:49.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.718+0000 7fd85659c700 1 -- 172.21.15.26:0/3057285925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8580f6530 msgr2=0x7fd85806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:22:49.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.718+0000 7fd85659c700 1 --2- 172.21.15.26:0/3057285925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8580f6530 0x7fd85806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:49.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.718+0000 7fd85659c700 1 -- 172.21.15.26:0/3057285925 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd848005040 con 0x7fd8580f77d0 2021-11-03T18:22:49.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.718+0000 7fd85659c700 1 --2- 172.21.15.26:0/3057285925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8580f77d0 0x7fd858069e20 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7fd84c00c530 tx=0x7fd84c007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:22:49.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.718+0000 7fd83f7fe700 1 -- 172.21.15.26:0/3057285925 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd84c00f650 con 0x7fd8580f77d0 2021-11-03T18:22:49.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.718+0000 7fd83f7fe700 1 -- 172.21.15.26:0/3057285925 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd84c00fc60 con 0x7fd8580f77d0 2021-11-03T18:22:49.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.718+0000 7fd83f7fe700 1 -- 172.21.15.26:0/3057285925 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd84c012c20 con 0x7fd8580f77d0 2021-11-03T18:22:49.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.718+0000 7fd85c8f9700 1 -- 172.21.15.26:0/3057285925 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd85806a7a0 con 0x7fd8580f77d0 2021-11-03T18:22:49.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.718+0000 7fd85c8f9700 1 -- 172.21.15.26:0/3057285925 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd85810ed90 con 0x7fd8580f77d0 2021-11-03T18:22:49.726 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.720+0000 7fd85c8f9700 1 -- 172.21.15.26:0/3057285925 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd858045ad0 con 0x7fd8580f77d0 2021-11-03T18:22:49.726 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.720+0000 7fd83f7fe700 1 -- 172.21.15.26:0/3057285925 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fd84c010070 con 0x7fd8580f77d0 2021-11-03T18:22:49.726 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.720+0000 7fd83f7fe700 1 --2- 172.21.15.26:0/3057285925 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd840064100 0x7fd8400665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:22:49.726 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.720+0000 7fd83f7fe700 1 -- 172.21.15.26:0/3057285925 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fd84c080660 con 0x7fd8580f77d0 2021-11-03T18:22:49.727 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.720+0000 7fd856d9d700 1 --2- 172.21.15.26:0/3057285925 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd840064100 0x7fd8400665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:22:49.727 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.721+0000 7fd856d9d700 1 --2- 172.21.15.26:0/3057285925 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd840064100 0x7fd8400665c0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7fd848013690 tx=0x7fd848009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:22:49.727 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.725+0000 7fd83f7fe700 1 -- 172.21.15.26:0/3057285925 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fd84c0528d0 con 0x7fd8580f77d0 2021-11-03T18:22:49.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.906+0000 7fd85c8f9700 1 -- 172.21.15.26:0/3057285925 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd8580fee00 con 0x7fd840064100 2021-11-03T18:22:49.906 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.907+0000 7fd83f7fe700 1 -- 172.21.15.26:0/3057285925 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fd8580fee00 con 0x7fd840064100 2021-11-03T18:22:49.908 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.909+0000 7fd85c8f9700 1 -- 172.21.15.26:0/3057285925 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd840064100 msgr2=0x7fd8400665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:22:49.909 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.909+0000 7fd85c8f9700 1 --2- 172.21.15.26:0/3057285925 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd840064100 0x7fd8400665c0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7fd848013690 tx=0x7fd848009b30).stop 2021-11-03T18:22:49.909 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.909+0000 7fd85c8f9700 1 -- 172.21.15.26:0/3057285925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8580f77d0 msgr2=0x7fd858069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:22:49.910 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.909+0000 7fd85c8f9700 1 --2- 172.21.15.26:0/3057285925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8580f77d0 0x7fd858069e20 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7fd84c00c530 tx=0x7fd84c007e20).stop 2021-11-03T18:22:49.910 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.909+0000 7fd85c8f9700 1 -- 172.21.15.26:0/3057285925 shutdown_connections 2021-11-03T18:22:49.910 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.909+0000 7fd85c8f9700 1 --2- 172.21.15.26:0/3057285925 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd840064100 0x7fd8400665c0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:49.910 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.909+0000 7fd85c8f9700 1 --2- 172.21.15.26:0/3057285925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8580f6530 0x7fd85806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:49.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.909+0000 7fd85c8f9700 1 --2- 172.21.15.26:0/3057285925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8580f77d0 0x7fd858069e20 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:49.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.909+0000 7fd85c8f9700 1 -- 172.21.15.26:0/3057285925 >> 172.21.15.26:0/3057285925 conn(0x7fd8580f1cd0 msgr2=0x7fd8580fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:22:49.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.909+0000 7fd85c8f9700 1 -- 172.21.15.26:0/3057285925 shutdown_connections 2021-11-03T18:22:49.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:49.909+0000 7fd85c8f9700 1 -- 172.21.15.26:0/3057285925 wait complete. 2021-11-03T18:22:49.918 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:22:50.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.009+0000 7f1b04a77700 1 -- 172.21.15.26:0/1204386376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b000f55e0 msgr2=0x7f1b000f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:22:50.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.009+0000 7f1b04a77700 1 --2- 172.21.15.26:0/1204386376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b000f55e0 0x7f1b000f5a00 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 rx=0x7f1af0004660 tx=0x7f1af0009b30).stop 2021-11-03T18:22:50.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.010+0000 7f1b04a77700 1 -- 172.21.15.26:0/1204386376 shutdown_connections 2021-11-03T18:22:50.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.010+0000 7f1b04a77700 1 --2- 172.21.15.26:0/1204386376 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b000f6880 0x7f1b000f6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:22:50.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.010+0000 7f1b04a77700 1 --2- 172.21.15.26:0/1204386376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b000f55e0 0x7f1b000f5a00 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:50.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.010+0000 7f1b04a77700 1 -- 172.21.15.26:0/1204386376 >> 172.21.15.26:0/1204386376 conn(0x7f1b000f0d40 msgr2=0x7f1b000f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:22:50.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.010+0000 7f1b04a77700 1 -- 172.21.15.26:0/1204386376 shutdown_connections 2021-11-03T18:22:50.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.010+0000 7f1b04a77700 1 -- 172.21.15.26:0/1204386376 wait complete. 2021-11-03T18:22:50.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.010+0000 7f1b04a77700 1 Processor -- start 2021-11-03T18:22:50.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.010+0000 7f1b04a77700 1 -- start start 2021-11-03T18:22:50.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.010+0000 7f1b04a77700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b000f55e0 0x7f1b00106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:22:50.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.010+0000 7f1b04a77700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b000f6880 0x7f1b00107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:22:50.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.010+0000 7f1b04a77700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b00107a90 con 0x7f1b000f6880 2021-11-03T18:22:50.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.010+0000 7f1b04a77700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b00108340 con 0x7f1b000f55e0 2021-11-03T18:22:50.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.010+0000 7f1afdd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b000f6880 0x7f1b00107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:22:50.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.011+0000 7f1afdd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b000f6880 0x7f1b00107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59688/0 (socket says 172.21.15.26:59688) 2021-11-03T18:22:50.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.011+0000 7f1afdd9b700 1 -- 172.21.15.26:0/4142889191 learned_addr learned my addr 172.21.15.26:0/4142889191 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:22:50.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.011+0000 7f1afe59c700 1 --2- 172.21.15.26:0/4142889191 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b000f55e0 0x7f1b00106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:22:50.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.011+0000 7f1afdd9b700 1 -- 172.21.15.26:0/4142889191 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b000f55e0 msgr2=0x7f1b00106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:22:50.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.011+0000 7f1afdd9b700 1 --2- 172.21.15.26:0/4142889191 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b000f55e0 0x7f1b00106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:50.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.011+0000 7f1afdd9b700 1 -- 172.21.15.26:0/4142889191 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af0005040 con 0x7f1b000f6880 2021-11-03T18:22:50.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.011+0000 7f1afe59c700 1 --2- 172.21.15.26:0/4142889191 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b000f55e0 0x7f1b00106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:22:50.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.011+0000 7f1afdd9b700 1 --2- 172.21.15.26:0/4142889191 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b000f6880 0x7f1b00107450 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7f1af400b410 tx=0x7f1af4006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:22:50.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.011+0000 7f1aeeffd700 1 -- 172.21.15.26:0/4142889191 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1af40125f0 con 0x7f1b000f6880 2021-11-03T18:22:50.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.011+0000 7f1aeeffd700 1 -- 172.21.15.26:0/4142889191 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1af4012c00 con 0x7f1b000f6880 2021-11-03T18:22:50.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.011+0000 7f1aeeffd700 1 -- 172.21.15.26:0/4142889191 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1af4002ae0 con 0x7f1b000f6880 2021-11-03T18:22:50.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.011+0000 7f1b04a77700 1 -- 172.21.15.26:0/4142889191 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b00108620 con 0x7f1b000f6880 2021-11-03T18:22:50.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.011+0000 7f1b04a77700 1 -- 172.21.15.26:0/4142889191 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b00108be0 con 0x7f1b000f6880 2021-11-03T18:22:50.018 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.012+0000 7f1b04a77700 1 -- 172.21.15.26:0/4142889191 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b000f49d0 con 0x7f1b000f6880 2021-11-03T18:22:50.018 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.013+0000 7f1aeeffd700 1 -- 172.21.15.26:0/4142889191 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f1af400f030 con 0x7f1b000f6880 2021-11-03T18:22:50.019 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.013+0000 7f1aeeffd700 1 --2- 172.21.15.26:0/4142889191 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1ae80640b0 0x7f1ae8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:22:50.019 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.013+0000 7f1aeeffd700 1 -- 172.21.15.26:0/4142889191 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f1af4080bf0 con 0x7f1b000f6880 2021-11-03T18:22:50.019 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.013+0000 7f1afe59c700 1 --2- 172.21.15.26:0/4142889191 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1ae80640b0 0x7f1ae8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:22:50.019 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.013+0000 7f1afe59c700 1 --2- 172.21.15.26:0/4142889191 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1ae80640b0 0x7f1ae8066570 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7f1af0009da0 tx=0x7f1af0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:22:50.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.017+0000 7f1aeeffd700 1 -- 172.21.15.26:0/4142889191 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f1af4052f50 con 0x7f1b000f6880 2021-11-03T18:22:50.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.191+0000 7f1b04a77700 1 -- 172.21.15.26:0/4142889191 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b000facc0 con 0x7f1ae80640b0 2021-11-03T18:22:50.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.205+0000 7f1aeeffd700 1 -- 172.21.15.26:0/4142889191 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f1b000facc0 con 0x7f1ae80640b0 2021-11-03T18:22:50.205 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:22:50.205 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (94m) 2m ago 95m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:22:50.205 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (86m) 2m ago 95m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:22:50.205 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (86m) 92s ago 94m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:22:50.206 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (93m) 2m ago 95m 42.2M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:22:50.206 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (87m) 2m ago 90m 26.0M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:22:50.206 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (87m) 2m ago 90m 26.6M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:22:50.206 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (90m) 92s ago 90m 26.8M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:22:50.206 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (90m) 92s ago 90m 27.2M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:22:50.207 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (87m) 2m ago 96m 588M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:22:50.207 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (87m) 92s ago 94m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:22:50.207 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (87m) 2m ago 96m 341M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:22:50.207 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (86m) 92s ago 94m 158M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:22:50.208 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (94m) 2m ago 94m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:22:50.208 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (94m) 92s ago 94m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:22:50.208 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (85m) 2m ago 93m 332M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:22:50.208 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (85m) 2m ago 93m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:22:50.209 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (84m) 2m ago 92m 296M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:22:50.209 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (84m) 92s ago 92m 387M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:22:50.209 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (83m) 92s ago 92m 320M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:22:50.209 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (83m) 92s ago 92m 316M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:22:50.209 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (93m) 2m ago 94m 65.7M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:22:50.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.207+0000 7f1b04a77700 1 -- 172.21.15.26:0/4142889191 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1ae80640b0 msgr2=0x7f1ae8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:22:50.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.207+0000 7f1b04a77700 1 --2- 172.21.15.26:0/4142889191 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1ae80640b0 0x7f1ae8066570 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7f1af0009da0 tx=0x7f1af0009b30).stop 2021-11-03T18:22:50.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.207+0000 7f1b04a77700 1 -- 172.21.15.26:0/4142889191 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b000f6880 msgr2=0x7f1b00107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:22:50.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.207+0000 7f1b04a77700 1 --2- 172.21.15.26:0/4142889191 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b000f6880 0x7f1b00107450 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7f1af400b410 tx=0x7f1af4006ef0).stop 2021-11-03T18:22:50.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.207+0000 7f1b04a77700 1 -- 172.21.15.26:0/4142889191 shutdown_connections 2021-11-03T18:22:50.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.207+0000 7f1b04a77700 1 --2- 172.21.15.26:0/4142889191 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1ae80640b0 0x7f1ae8066570 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:50.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.207+0000 7f1b04a77700 1 --2- 172.21.15.26:0/4142889191 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b000f55e0 0x7f1b00106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:50.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.207+0000 7f1b04a77700 1 --2- 172.21.15.26:0/4142889191 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b000f6880 0x7f1b00107450 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:50.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.207+0000 7f1b04a77700 1 -- 172.21.15.26:0/4142889191 >> 172.21.15.26:0/4142889191 conn(0x7f1b000f0d40 msgr2=0x7f1b0005ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:22:50.213 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.207+0000 7f1b04a77700 1 -- 172.21.15.26:0/4142889191 shutdown_connections 2021-11-03T18:22:50.213 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.207+0000 7f1b04a77700 1 -- 172.21.15.26:0/4142889191 wait complete. 2021-11-03T18:22:50.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.308+0000 7f8ce9db4700 1 -- 172.21.15.26:0/3610178592 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ce40f6860 msgr2=0x7f8ce40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:22:50.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.308+0000 7f8ce9db4700 1 --2- 172.21.15.26:0/3610178592 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ce40f6860 0x7f8ce40f6cc0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 rx=0x7f8cd8004660 tx=0x7f8cd8009b30).stop 2021-11-03T18:22:50.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.308+0000 7f8ce9db4700 1 -- 172.21.15.26:0/3610178592 shutdown_connections 2021-11-03T18:22:50.310 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.308+0000 7f8ce9db4700 1 --2- 172.21.15.26:0/3610178592 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ce40f6860 0x7f8ce40f6cc0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:50.310 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.308+0000 7f8ce9db4700 1 --2- 172.21.15.26:0/3610178592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ce40f55c0 0x7f8ce40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:50.310 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.308+0000 7f8ce9db4700 1 -- 172.21.15.26:0/3610178592 >> 172.21.15.26:0/3610178592 conn(0x7f8ce40f0d40 msgr2=0x7f8ce40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:22:50.310 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.308+0000 7f8ce9db4700 1 -- 172.21.15.26:0/3610178592 shutdown_connections 2021-11-03T18:22:50.310 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.308+0000 7f8ce9db4700 1 -- 172.21.15.26:0/3610178592 wait complete. 2021-11-03T18:22:50.311 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.309+0000 7f8ce9db4700 1 Processor -- start 2021-11-03T18:22:50.311 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.309+0000 7f8ce9db4700 1 -- start start 2021-11-03T18:22:50.311 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.309+0000 7f8ce9db4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ce40f55c0 0x7f8ce4109bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:22:50.311 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.309+0000 7f8ce9db4700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ce40f6860 0x7f8ce410c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:22:50.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.309+0000 7f8ce9db4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce4060500 con 0x7f8ce40f55c0 2021-11-03T18:22:50.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.309+0000 7f8ce9db4700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce4060640 con 0x7f8ce40f6860 2021-11-03T18:22:50.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.309+0000 7f8ce37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ce40f55c0 0x7f8ce4109bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:22:50.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.309+0000 7f8ce37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ce40f55c0 0x7f8ce4109bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59696/0 (socket says 172.21.15.26:59696) 2021-11-03T18:22:50.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.309+0000 7f8ce37fe700 1 -- 172.21.15.26:0/3556532436 learned_addr learned my addr 172.21.15.26:0/3556532436 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:22:50.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.309+0000 7f8ce2ffd700 1 --2- 172.21.15.26:0/3556532436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ce40f6860 0x7f8ce410c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:22:50.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.309+0000 7f8ce37fe700 1 -- 172.21.15.26:0/3556532436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ce40f6860 msgr2=0x7f8ce410c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:22:50.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.309+0000 7f8ce37fe700 1 --2- 172.21.15.26:0/3556532436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ce40f6860 0x7f8ce410c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:50.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.309+0000 7f8ce37fe700 1 -- 172.21.15.26:0/3556532436 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd8005040 con 0x7f8ce40f55c0 2021-11-03T18:22:50.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.310+0000 7f8ce37fe700 1 --2- 172.21.15.26:0/3556532436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ce40f55c0 0x7f8ce4109bc0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7f8cd4002700 tx=0x7f8cd4009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:22:50.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.310+0000 7f8ccbfff700 1 -- 172.21.15.26:0/3556532436 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cd4009320 con 0x7f8ce40f55c0 2021-11-03T18:22:50.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.310+0000 7f8ccbfff700 1 -- 172.21.15.26:0/3556532436 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8cd400f040 con 0x7f8ce40f55c0 2021-11-03T18:22:50.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.310+0000 7f8ccbfff700 1 -- 172.21.15.26:0/3556532436 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cd40148e0 con 0x7f8ce40f55c0 2021-11-03T18:22:50.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.310+0000 7f8ce9db4700 1 -- 172.21.15.26:0/3556532436 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce410c670 con 0x7f8ce40f55c0 2021-11-03T18:22:50.413 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.310+0000 7f8ce9db4700 1 -- 172.21.15.26:0/3556532436 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce410cc30 con 0x7f8ce40f55c0 2021-11-03T18:22:50.414 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.311+0000 7f8ce9db4700 1 -- 172.21.15.26:0/3556532436 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ce4045ad0 con 0x7f8ce40f55c0 2021-11-03T18:22:50.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.311+0000 7f8ccbfff700 1 -- 172.21.15.26:0/3556532436 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f8cd4009480 con 0x7f8ce40f55c0 2021-11-03T18:22:50.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.312+0000 7f8ccbfff700 1 --2- 172.21.15.26:0/3556532436 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8ccc064090 0x7f8ccc066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:22:50.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.312+0000 7f8ccbfff700 1 -- 172.21.15.26:0/3556532436 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f8cd40809f0 con 0x7f8ce40f55c0 2021-11-03T18:22:50.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.312+0000 7f8ce2ffd700 1 --2- 172.21.15.26:0/3556532436 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8ccc064090 0x7f8ccc066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:22:50.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.312+0000 7f8ce2ffd700 1 --2- 172.21.15.26:0/3556532436 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8ccc064090 0x7f8ccc066550 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7f8cd8004e30 tx=0x7f8cd8009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:22:50.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.316+0000 7f8ccbfff700 1 -- 172.21.15.26:0/3556532436 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f8cd4082e60 con 0x7f8ce40f55c0 2021-11-03T18:22:50.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.546+0000 7f8ce9db4700 1 -- 172.21.15.26:0/3556532436 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8ce4027a00 con 0x7f8ce40f55c0 2021-11-03T18:22:50.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.547+0000 7f8ccbfff700 1 -- 172.21.15.26:0/3556532436 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f8cd4052d50 con 0x7f8ce40f55c0 2021-11-03T18:22:50.546 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:22:50.547 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:22:50.547 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:22:50.547 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:22:50.547 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:22:50.548 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:22:50.548 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:22:50.548 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:22:50.548 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:22:50.548 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:22:50.549 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:22:50.549 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:22:50.549 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:22:50.549 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:22:50.550 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:22:50.550 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:22:50.550 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:22:50.550 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:22:50.551 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.548+0000 7f8ce9db4700 1 -- 172.21.15.26:0/3556532436 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8ccc064090 msgr2=0x7f8ccc066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:22:50.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.548+0000 7f8ce9db4700 1 --2- 172.21.15.26:0/3556532436 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8ccc064090 0x7f8ccc066550 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7f8cd8004e30 tx=0x7f8cd8009b30).stop 2021-11-03T18:22:50.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.548+0000 7f8ce9db4700 1 -- 172.21.15.26:0/3556532436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ce40f55c0 msgr2=0x7f8ce4109bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:22:50.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.548+0000 7f8ce9db4700 1 --2- 172.21.15.26:0/3556532436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ce40f55c0 0x7f8ce4109bc0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7f8cd4002700 tx=0x7f8cd4009e00).stop 2021-11-03T18:22:50.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.548+0000 7f8ce9db4700 1 -- 172.21.15.26:0/3556532436 shutdown_connections 2021-11-03T18:22:50.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.548+0000 7f8ce9db4700 1 --2- 172.21.15.26:0/3556532436 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8ccc064090 0x7f8ccc066550 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:50.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.548+0000 7f8ce9db4700 1 --2- 172.21.15.26:0/3556532436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ce40f55c0 0x7f8ce4109bc0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:50.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.548+0000 7f8ce9db4700 1 --2- 172.21.15.26:0/3556532436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ce40f6860 0x7f8ce410c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:50.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.548+0000 7f8ce9db4700 1 -- 172.21.15.26:0/3556532436 >> 172.21.15.26:0/3556532436 conn(0x7f8ce40f0d40 msgr2=0x7f8ce40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:22:50.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.549+0000 7f8ce9db4700 1 -- 172.21.15.26:0/3556532436 shutdown_connections 2021-11-03T18:22:50.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.549+0000 7f8ce9db4700 1 -- 172.21.15.26:0/3556532436 wait complete. 2021-11-03T18:22:50.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.648+0000 7fb8d8ce9700 1 -- 172.21.15.26:0/4191991651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8d40f55c0 msgr2=0x7fb8d40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:22:50.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.648+0000 7fb8d8ce9700 1 --2- 172.21.15.26:0/4191991651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8d40f55c0 0x7fb8d40f59e0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 rx=0x7fb8cc0099e0 tx=0x7fb8cc004d10).stop 2021-11-03T18:22:50.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.648+0000 7fb8d8ce9700 1 -- 172.21.15.26:0/4191991651 shutdown_connections 2021-11-03T18:22:50.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.648+0000 7fb8d8ce9700 1 --2- 172.21.15.26:0/4191991651 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8d40f6860 0x7fb8d40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:22:50.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.648+0000 7fb8d8ce9700 1 --2- 172.21.15.26:0/4191991651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8d40f55c0 0x7fb8d40f59e0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:50.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.648+0000 7fb8d8ce9700 1 -- 172.21.15.26:0/4191991651 >> 172.21.15.26:0/4191991651 conn(0x7fb8d40f0d40 msgr2=0x7fb8d40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:22:50.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.648+0000 7fb8d8ce9700 1 -- 172.21.15.26:0/4191991651 shutdown_connections 2021-11-03T18:22:50.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.648+0000 7fb8d8ce9700 1 -- 172.21.15.26:0/4191991651 wait complete. 2021-11-03T18:22:50.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.648+0000 7fb8d8ce9700 1 Processor -- start 2021-11-03T18:22:50.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.648+0000 7fb8d8ce9700 1 -- start start 2021-11-03T18:22:50.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.648+0000 7fb8d8ce9700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8d40f55c0 0x7fb8d410c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:22:50.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.648+0000 7fb8d8ce9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8d40f6860 0x7fb8d410e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:22:50.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.648+0000 7fb8d8ce9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d40602b0 con 0x7fb8d40f6860 2021-11-03T18:22:50.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.648+0000 7fb8d8ce9700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d40603f0 con 0x7fb8d40f55c0 2021-11-03T18:22:50.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.649+0000 7fb8d1d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8d40f6860 0x7fb8d410e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:22:50.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.649+0000 7fb8d1d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8d40f6860 0x7fb8d410e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59708/0 (socket says 172.21.15.26:59708) 2021-11-03T18:22:50.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.649+0000 7fb8d1d9b700 1 -- 172.21.15.26:0/1677368854 learned_addr learned my addr 172.21.15.26:0/1677368854 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:22:50.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.649+0000 7fb8d259c700 1 --2- 172.21.15.26:0/1677368854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8d40f55c0 0x7fb8d410c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:22:50.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.649+0000 7fb8d1d9b700 1 -- 172.21.15.26:0/1677368854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8d40f55c0 msgr2=0x7fb8d410c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:22:50.654 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.649+0000 7fb8d1d9b700 1 --2- 172.21.15.26:0/1677368854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8d40f55c0 0x7fb8d410c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:50.654 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.649+0000 7fb8d1d9b700 1 -- 172.21.15.26:0/1677368854 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8cc009640 con 0x7fb8d40f6860 2021-11-03T18:22:50.654 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.649+0000 7fb8d1d9b700 1 --2- 172.21.15.26:0/1677368854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8d40f6860 0x7fb8d410e750 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7fb8c800b410 tx=0x7fb8c8006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:22:50.655 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.649+0000 7fb8c2ffd700 1 -- 172.21.15.26:0/1677368854 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8c80125f0 con 0x7fb8d40f6860 2021-11-03T18:22:50.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.649+0000 7fb8c2ffd700 1 -- 172.21.15.26:0/1677368854 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb8c800be30 con 0x7fb8d40f6860 2021-11-03T18:22:50.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.649+0000 7fb8d8ce9700 1 -- 172.21.15.26:0/1677368854 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8d410ec40 con 0x7fb8d40f6860 2021-11-03T18:22:50.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.649+0000 7fb8c2ffd700 1 -- 172.21.15.26:0/1677368854 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8c8002a70 con 0x7fb8d40f6860 2021-11-03T18:22:50.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.649+0000 7fb8d8ce9700 1 -- 172.21.15.26:0/1677368854 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8d410f0a0 con 0x7fb8d40f6860 2021-11-03T18:22:50.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.650+0000 7fb8d8ce9700 1 -- 172.21.15.26:0/1677368854 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8d4045ad0 con 0x7fb8d40f6860 2021-11-03T18:22:50.658 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.651+0000 7fb8c2ffd700 1 -- 172.21.15.26:0/1677368854 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fb8c800f030 con 0x7fb8d40f6860 2021-11-03T18:22:50.658 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.651+0000 7fb8c2ffd700 1 --2- 172.21.15.26:0/1677368854 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb8bc064090 0x7fb8bc066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:22:50.658 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.651+0000 7fb8c2ffd700 1 -- 172.21.15.26:0/1677368854 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fb8c8080af0 con 0x7fb8d40f6860 2021-11-03T18:22:50.659 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.651+0000 7fb8d259c700 1 --2- 172.21.15.26:0/1677368854 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb8bc064090 0x7fb8bc066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:22:50.659 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.652+0000 7fb8d259c700 1 --2- 172.21.15.26:0/1677368854 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb8bc064090 0x7fb8bc066550 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7fb8cc00b730 tx=0x7fb8cc004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:22:50.659 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.655+0000 7fb8c2ffd700 1 -- 172.21.15.26:0/1677368854 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fb8c8052e50 con 0x7fb8d40f6860 2021-11-03T18:22:50.858 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.859+0000 7fb8d8ce9700 1 -- 172.21.15.26:0/1677368854 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb8d4027a00 con 0x7fb8d40f6860 2021-11-03T18:22:50.858 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.859+0000 7fb8c2ffd700 1 -- 172.21.15.26:0/1677368854 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fb8c8052a40 con 0x7fb8d40f6860 2021-11-03T18:22:50.859 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:22:50.859 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:22:50.859 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:22:50.860 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:22:50.860 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:22:50.860 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:22:50.860 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:22:50.861 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:22:50.861 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:22:50.861 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:22:50.861 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:22:50.861 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:22:50.862 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:22:50.862 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:22:50.862 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:22:50.863 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:22:50.863 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:22:50.863 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:22:50.863 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:22:50.863 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:22:50.864 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:22:50.864 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:22:50.864 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:22:50.864 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:22:50.864 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:22:50.865 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:22:50.865 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:22:50.865 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:22:50.865 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:22:50.865 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:22:50.866 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:22:50.866 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:22:50.866 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:22:50.866 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:22:50.867 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:22:50.867 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:22:50.867 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:22:50.867 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:22:50.867 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:22:50.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.861+0000 7fb8d8ce9700 1 -- 172.21.15.26:0/1677368854 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb8bc064090 msgr2=0x7fb8bc066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:22:50.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.861+0000 7fb8d8ce9700 1 --2- 172.21.15.26:0/1677368854 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb8bc064090 0x7fb8bc066550 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7fb8cc00b730 tx=0x7fb8cc004d10).stop 2021-11-03T18:22:50.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.861+0000 7fb8d8ce9700 1 -- 172.21.15.26:0/1677368854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8d40f6860 msgr2=0x7fb8d410e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:22:50.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.861+0000 7fb8d8ce9700 1 --2- 172.21.15.26:0/1677368854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8d40f6860 0x7fb8d410e750 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7fb8c800b410 tx=0x7fb8c8006ef0).stop 2021-11-03T18:22:50.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.861+0000 7fb8d8ce9700 1 -- 172.21.15.26:0/1677368854 shutdown_connections 2021-11-03T18:22:50.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.861+0000 7fb8d8ce9700 1 --2- 172.21.15.26:0/1677368854 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb8bc064090 0x7fb8bc066550 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:50.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.861+0000 7fb8d8ce9700 1 --2- 172.21.15.26:0/1677368854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8d40f55c0 0x7fb8d410c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:50.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.861+0000 7fb8d8ce9700 1 --2- 172.21.15.26:0/1677368854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8d40f6860 0x7fb8d410e750 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:22:50.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.861+0000 7fb8d8ce9700 1 -- 172.21.15.26:0/1677368854 >> 172.21.15.26:0/1677368854 conn(0x7fb8d40f0d40 msgr2=0x7fb8d40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:22:50.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.861+0000 7fb8d8ce9700 1 -- 172.21.15.26:0/1677368854 shutdown_connections 2021-11-03T18:22:50.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:22:50.861+0000 7fb8d8ce9700 1 -- 172.21.15.26:0/1677368854 wait complete. 2021-11-03T18:22:50.871 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:22:51.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:51 smithi026 ceph-mon[96795]: pgmap v2645: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:51.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:51 smithi026 ceph-mon[96795]: from='client.36860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:22:51.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:51 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3556532436' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:22:51.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:51 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1677368854' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:22:51.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:51 smithi194 ceph-mon[65619]: pgmap v2645: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:51.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:51 smithi194 ceph-mon[65619]: from='client.36860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:22:51.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:51 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3556532436' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:22:51.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:51 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1677368854' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:22:52.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:52 smithi026 ceph-mon[96795]: from='client.36864 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:22:52.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:52 smithi194 ceph-mon[65619]: from='client.36864 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:22:53.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:53 smithi026 ceph-mon[96795]: pgmap v2646: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:53.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:53 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:22:53.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:53 smithi194 ceph-mon[65619]: pgmap v2646: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:53.475 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:53 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:22:54.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:54 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:22:54.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:54 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:22:55.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:55 smithi026 ceph-mon[96795]: pgmap v2647: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:55.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:55 smithi194 ceph-mon[65619]: pgmap v2647: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:57.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:57 smithi026 ceph-mon[96795]: pgmap v2648: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:57.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:57 smithi194 ceph-mon[65619]: pgmap v2648: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:59.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:22:59 smithi026 ceph-mon[96795]: pgmap v2649: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:22:59.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:22:59 smithi194 ceph-mon[65619]: pgmap v2649: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:01.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:01 smithi026 ceph-mon[96795]: pgmap v2650: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:01.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:01 smithi194 ceph-mon[65619]: pgmap v2650: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:03.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:03 smithi026 ceph-mon[96795]: pgmap v2651: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:03.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:03 smithi194 ceph-mon[65619]: pgmap v2651: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:05.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:05 smithi026 ceph-mon[96795]: pgmap v2652: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:05.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:05 smithi194 ceph-mon[65619]: pgmap v2652: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:07.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:07 smithi026 ceph-mon[96795]: pgmap v2653: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:07.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:07 smithi194 ceph-mon[65619]: pgmap v2653: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:08.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:08 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:23:08.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:08 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:23:09.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:09 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:23:09.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:09 smithi026 ceph-mon[96795]: pgmap v2654: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:09.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:09 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:23:09.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:09 smithi194 ceph-mon[65619]: pgmap v2654: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:11.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:11 smithi026 ceph-mon[96795]: pgmap v2655: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:11.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:11 smithi194 ceph-mon[65619]: pgmap v2655: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:13.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:13 smithi026 ceph-mon[96795]: pgmap v2656: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:13.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:13 smithi194 ceph-mon[65619]: pgmap v2656: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:15.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:15 smithi026 ceph-mon[96795]: pgmap v2657: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:15.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:15 smithi194 ceph-mon[65619]: pgmap v2657: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:17.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:17 smithi026 ceph-mon[96795]: pgmap v2658: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:17.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:17 smithi194 ceph-mon[65619]: pgmap v2658: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:19.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:19 smithi026 ceph-mon[96795]: pgmap v2659: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:19.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:19 smithi194 ceph-mon[65619]: pgmap v2659: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:20.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:20.977+0000 7f94f289e700 1 -- 172.21.15.26:0/2186144513 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94ec0f66e0 msgr2=0x7f94ec0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:23:20.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:20.977+0000 7f94f289e700 1 --2- 172.21.15.26:0/2186144513 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94ec0f66e0 0x7f94ec0f6b00 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7f94dc004660 tx=0x7f94dc009b30).stop 2021-11-03T18:23:20.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:20.977+0000 7f94f289e700 1 -- 172.21.15.26:0/2186144513 shutdown_connections 2021-11-03T18:23:20.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:20.977+0000 7f94f289e700 1 --2- 172.21.15.26:0/2186144513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94ec0f7980 0x7f94ec0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:20.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:20.977+0000 7f94f289e700 1 --2- 172.21.15.26:0/2186144513 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94ec0f66e0 0x7f94ec0f6b00 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:20.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:20.977+0000 7f94f289e700 1 -- 172.21.15.26:0/2186144513 >> 172.21.15.26:0/2186144513 conn(0x7f94ec0f1e40 msgr2=0x7f94ec0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:23:20.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:20.977+0000 7f94f289e700 1 -- 172.21.15.26:0/2186144513 shutdown_connections 2021-11-03T18:23:20.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:20.978+0000 7f94f289e700 1 -- 172.21.15.26:0/2186144513 wait complete. 2021-11-03T18:23:20.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:20.978+0000 7f94f289e700 1 Processor -- start 2021-11-03T18:23:20.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:20.978+0000 7f94f289e700 1 -- start start 2021-11-03T18:23:20.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:20.978+0000 7f94f289e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94ec0f66e0 0x7f94ec06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:23:20.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:20.978+0000 7f94f289e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94ec0f7980 0x7f94ec069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:23:20.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:20.978+0000 7f94f289e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec06a380 con 0x7f94ec0f66e0 2021-11-03T18:23:20.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:20.978+0000 7f94f289e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec06a4c0 con 0x7f94ec0f7980 2021-11-03T18:23:20.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:20.979+0000 7f94ebfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94ec0f66e0 0x7f94ec06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:23:20.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:20.979+0000 7f94ebfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94ec0f66e0 0x7f94ec06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59724/0 (socket says 172.21.15.26:59724) 2021-11-03T18:23:20.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:20.979+0000 7f94ebfff700 1 -- 172.21.15.26:0/1190169335 learned_addr learned my addr 172.21.15.26:0/1190169335 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:23:20.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:20.979+0000 7f94ebfff700 1 -- 172.21.15.26:0/1190169335 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94ec0f7980 msgr2=0x7f94ec069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:23:20.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:20.979+0000 7f94eb7fe700 1 --2- 172.21.15.26:0/1190169335 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94ec0f7980 0x7f94ec069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:23:20.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:20.979+0000 7f94ebfff700 1 --2- 172.21.15.26:0/1190169335 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94ec0f7980 0x7f94ec069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:20.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:20.979+0000 7f94ebfff700 1 -- 172.21.15.26:0/1190169335 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94dc005040 con 0x7f94ec0f66e0 2021-11-03T18:23:20.984 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:20.979+0000 7f94ebfff700 1 --2- 172.21.15.26:0/1190169335 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94ec0f66e0 0x7f94ec06b9a0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 rx=0x7f94dc013a70 tx=0x7f94dc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:23:20.984 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:20.979+0000 7f94e8ff9700 1 -- 172.21.15.26:0/1190169335 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94dc018070 con 0x7f94ec0f66e0 2021-11-03T18:23:20.984 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:20.979+0000 7f94f289e700 1 -- 172.21.15.26:0/1190169335 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94ec06a740 con 0x7f94ec0f66e0 2021-11-03T18:23:20.984 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:20.979+0000 7f94e8ff9700 1 -- 172.21.15.26:0/1190169335 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f94dc0097d0 con 0x7f94ec0f66e0 2021-11-03T18:23:20.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:20.979+0000 7f94e8ff9700 1 -- 172.21.15.26:0/1190169335 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94dc01c3c0 con 0x7f94ec0f66e0 2021-11-03T18:23:20.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:20.979+0000 7f94f289e700 1 -- 172.21.15.26:0/1190169335 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94ec06aca0 con 0x7f94ec0f66e0 2021-11-03T18:23:20.986 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:20.980+0000 7f94f289e700 1 -- 172.21.15.26:0/1190169335 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94ec045ad0 con 0x7f94ec0f66e0 2021-11-03T18:23:20.987 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:20.981+0000 7f94e8ff9700 1 -- 172.21.15.26:0/1190169335 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f94dc007ba0 con 0x7f94ec0f66e0 2021-11-03T18:23:20.987 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:20.981+0000 7f94e8ff9700 1 --2- 172.21.15.26:0/1190169335 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f94d40640b0 0x7f94d4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:23:20.987 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:20.981+0000 7f94e8ff9700 1 -- 172.21.15.26:0/1190169335 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f94dc082470 con 0x7f94ec0f66e0 2021-11-03T18:23:20.987 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:20.981+0000 7f94eb7fe700 1 --2- 172.21.15.26:0/1190169335 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f94d40640b0 0x7f94d4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:23:20.988 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:20.982+0000 7f94eb7fe700 1 --2- 172.21.15.26:0/1190169335 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f94d40640b0 0x7f94d4066570 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7f94e0004b00 tx=0x7f94e000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:23:20.988 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:20.985+0000 7f94e8ff9700 1 -- 172.21.15.26:0/1190169335 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f94dc0547d0 con 0x7f94ec0f66e0 2021-11-03T18:23:21.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.168+0000 7f94f289e700 1 -- 172.21.15.26:0/1190169335 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f94ec0ff010 con 0x7f94d40640b0 2021-11-03T18:23:21.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.169+0000 7f94e8ff9700 1 -- 172.21.15.26:0/1190169335 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f94ec0ff010 con 0x7f94d40640b0 2021-11-03T18:23:21.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.171+0000 7f94f289e700 1 -- 172.21.15.26:0/1190169335 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f94d40640b0 msgr2=0x7f94d4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:23:21.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.171+0000 7f94f289e700 1 --2- 172.21.15.26:0/1190169335 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f94d40640b0 0x7f94d4066570 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7f94e0004b00 tx=0x7f94e000b040).stop 2021-11-03T18:23:21.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.171+0000 7f94f289e700 1 -- 172.21.15.26:0/1190169335 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94ec0f66e0 msgr2=0x7f94ec06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:23:21.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.171+0000 7f94f289e700 1 --2- 172.21.15.26:0/1190169335 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94ec0f66e0 0x7f94ec06b9a0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 rx=0x7f94dc013a70 tx=0x7f94dc009b30).stop 2021-11-03T18:23:21.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.171+0000 7f94f289e700 1 -- 172.21.15.26:0/1190169335 shutdown_connections 2021-11-03T18:23:21.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.171+0000 7f94f289e700 1 --2- 172.21.15.26:0/1190169335 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f94d40640b0 0x7f94d4066570 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:21.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.171+0000 7f94f289e700 1 --2- 172.21.15.26:0/1190169335 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94ec0f66e0 0x7f94ec06b9a0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:21.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.171+0000 7f94f289e700 1 --2- 172.21.15.26:0/1190169335 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94ec0f7980 0x7f94ec069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:21.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.171+0000 7f94f289e700 1 -- 172.21.15.26:0/1190169335 >> 172.21.15.26:0/1190169335 conn(0x7f94ec0f1e40 msgr2=0x7f94ec0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:23:21.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.171+0000 7f94f289e700 1 -- 172.21.15.26:0/1190169335 shutdown_connections 2021-11-03T18:23:21.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.171+0000 7f94f289e700 1 -- 172.21.15.26:0/1190169335 wait complete. 2021-11-03T18:23:21.179 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:23:21.272 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.272+0000 7f659f547700 1 -- 172.21.15.26:0/2857840326 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65980f5ef0 msgr2=0x7f65980f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:23:21.273 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.272+0000 7f659f547700 1 --2- 172.21.15.26:0/2857840326 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65980f5ef0 0x7f65980f6920 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7f6594004660 tx=0x7f6594009b30).stop 2021-11-03T18:23:21.273 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.272+0000 7f659f547700 1 -- 172.21.15.26:0/2857840326 shutdown_connections 2021-11-03T18:23:21.273 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.272+0000 7f659f547700 1 --2- 172.21.15.26:0/2857840326 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65980f5ef0 0x7f65980f6920 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:21.274 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.272+0000 7f659f547700 1 --2- 172.21.15.26:0/2857840326 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65980f55e0 0x7f65980f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:21.274 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.272+0000 7f659f547700 1 -- 172.21.15.26:0/2857840326 >> 172.21.15.26:0/2857840326 conn(0x7f65980f0de0 msgr2=0x7f65980f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:23:21.274 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.272+0000 7f659f547700 1 -- 172.21.15.26:0/2857840326 shutdown_connections 2021-11-03T18:23:21.274 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.272+0000 7f659f547700 1 -- 172.21.15.26:0/2857840326 wait complete. 2021-11-03T18:23:21.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.273+0000 7f659f547700 1 Processor -- start 2021-11-03T18:23:21.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.273+0000 7f659f547700 1 -- start start 2021-11-03T18:23:21.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.273+0000 7f659f547700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65980f55e0 0x7f6598109c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:23:21.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.273+0000 7f659f547700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65980f5ef0 0x7f659810c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:23:21.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.273+0000 7f659f547700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6598060520 con 0x7f65980f5ef0 2021-11-03T18:23:21.276 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.273+0000 7f659f547700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6598060660 con 0x7f65980f55e0 2021-11-03T18:23:21.276 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.273+0000 7f659cae2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65980f5ef0 0x7f659810c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:23:21.276 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.273+0000 7f659cae2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65980f5ef0 0x7f659810c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59736/0 (socket says 172.21.15.26:59736) 2021-11-03T18:23:21.276 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.273+0000 7f659cae2700 1 -- 172.21.15.26:0/90994959 learned_addr learned my addr 172.21.15.26:0/90994959 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:23:21.277 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.273+0000 7f659d2e3700 1 --2- 172.21.15.26:0/90994959 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65980f55e0 0x7f6598109c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:23:21.277 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.273+0000 7f659cae2700 1 -- 172.21.15.26:0/90994959 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65980f55e0 msgr2=0x7f6598109c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:23:21.277 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.273+0000 7f659cae2700 1 --2- 172.21.15.26:0/90994959 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65980f55e0 0x7f6598109c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:21.277 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.273+0000 7f659cae2700 1 -- 172.21.15.26:0/90994959 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6594005040 con 0x7f65980f5ef0 2021-11-03T18:23:21.277 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.274+0000 7f659cae2700 1 --2- 172.21.15.26:0/90994959 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65980f5ef0 0x7f659810c140 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 rx=0x7f6594009990 tx=0x7f6594009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:23:21.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.274+0000 7f658dffb700 1 -- 172.21.15.26:0/90994959 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6594018070 con 0x7f65980f5ef0 2021-11-03T18:23:21.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.274+0000 7f658dffb700 1 -- 172.21.15.26:0/90994959 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6594007ba0 con 0x7f65980f5ef0 2021-11-03T18:23:21.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.274+0000 7f659f547700 1 -- 172.21.15.26:0/90994959 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f659810c6f0 con 0x7f65980f5ef0 2021-11-03T18:23:21.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.274+0000 7f658dffb700 1 -- 172.21.15.26:0/90994959 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f659401c3c0 con 0x7f65980f5ef0 2021-11-03T18:23:21.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.274+0000 7f659f547700 1 -- 172.21.15.26:0/90994959 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f659810cc20 con 0x7f65980f5ef0 2021-11-03T18:23:21.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.275+0000 7f659f547700 1 -- 172.21.15.26:0/90994959 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65980f4a70 con 0x7f65980f5ef0 2021-11-03T18:23:21.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.275+0000 7f658dffb700 1 -- 172.21.15.26:0/90994959 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f659401d420 con 0x7f65980f5ef0 2021-11-03T18:23:21.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.276+0000 7f658dffb700 1 --2- 172.21.15.26:0/90994959 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f65840640b0 0x7f6584066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:23:21.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.276+0000 7f658dffb700 1 -- 172.21.15.26:0/90994959 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f65940823f0 con 0x7f65980f5ef0 2021-11-03T18:23:21.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.276+0000 7f659d2e3700 1 --2- 172.21.15.26:0/90994959 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f65840640b0 0x7f6584066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:23:21.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.276+0000 7f659d2e3700 1 --2- 172.21.15.26:0/90994959 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f65840640b0 0x7f6584066570 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7f65980601a0 tx=0x7f658800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:23:21.282 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.280+0000 7f658dffb700 1 -- 172.21.15.26:0/90994959 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f65940546f0 con 0x7f65980f5ef0 2021-11-03T18:23:21.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:21 smithi026 ceph-mon[96795]: pgmap v2660: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:21.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.451+0000 7f659f547700 1 -- 172.21.15.26:0/90994959 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f65980fdf60 con 0x7f65840640b0 2021-11-03T18:23:21.466 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.468+0000 7f658dffb700 1 -- 172.21.15.26:0/90994959 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f65980fdf60 con 0x7f65840640b0 2021-11-03T18:23:21.467 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:23:21.467 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (94m) 3m ago 95m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:23:21.468 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (86m) 3m ago 95m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:23:21.468 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (86m) 2m ago 95m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:23:21.468 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (94m) 3m ago 95m 42.2M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:23:21.469 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (87m) 3m ago 90m 26.0M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:23:21.469 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (87m) 3m ago 90m 26.6M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:23:21.470 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (91m) 2m ago 91m 26.8M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:23:21.470 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (90m) 2m ago 90m 27.2M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:23:21.470 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (88m) 3m ago 97m 588M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:23:21.471 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (87m) 2m ago 95m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:23:21.471 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (87m) 3m ago 97m 341M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:23:21.472 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (87m) 2m ago 94m 158M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:23:21.472 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (95m) 3m ago 95m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:23:21.472 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (94m) 2m ago 94m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:23:21.473 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (86m) 3m ago 94m 332M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:23:21.473 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (85m) 3m ago 93m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:23:21.474 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (85m) 3m ago 93m 296M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:23:21.474 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (84m) 2m ago 93m 387M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:23:21.475 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (84m) 2m ago 92m 320M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:23:21.475 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (84m) 2m ago 92m 316M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:23:21.476 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (94m) 3m ago 95m 65.7M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:23:21.477 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.470+0000 7f659f547700 1 -- 172.21.15.26:0/90994959 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f65840640b0 msgr2=0x7f6584066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:23:21.477 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.470+0000 7f659f547700 1 --2- 172.21.15.26:0/90994959 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f65840640b0 0x7f6584066570 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7f65980601a0 tx=0x7f658800b040).stop 2021-11-03T18:23:21.477 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.470+0000 7f659f547700 1 -- 172.21.15.26:0/90994959 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65980f5ef0 msgr2=0x7f659810c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:23:21.478 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.470+0000 7f659f547700 1 --2- 172.21.15.26:0/90994959 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65980f5ef0 0x7f659810c140 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 rx=0x7f6594009990 tx=0x7f6594009b30).stop 2021-11-03T18:23:21.478 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.470+0000 7f659f547700 1 -- 172.21.15.26:0/90994959 shutdown_connections 2021-11-03T18:23:21.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.470+0000 7f659f547700 1 --2- 172.21.15.26:0/90994959 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f65840640b0 0x7f6584066570 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:21.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.470+0000 7f659f547700 1 --2- 172.21.15.26:0/90994959 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65980f55e0 0x7f6598109c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:21.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.470+0000 7f659f547700 1 --2- 172.21.15.26:0/90994959 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65980f5ef0 0x7f659810c140 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:21.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.470+0000 7f659f547700 1 -- 172.21.15.26:0/90994959 >> 172.21.15.26:0/90994959 conn(0x7f65980f0de0 msgr2=0x7f65980fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:23:21.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.470+0000 7f659f547700 1 -- 172.21.15.26:0/90994959 shutdown_connections 2021-11-03T18:23:21.481 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.470+0000 7f659f547700 1 -- 172.21.15.26:0/90994959 wait complete. 2021-11-03T18:23:21.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:21 smithi194 ceph-mon[65619]: pgmap v2660: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:21.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.569+0000 7f1e6c4e6700 1 -- 172.21.15.26:0/3743709147 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e640f5ef0 msgr2=0x7f1e640f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:23:21.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.569+0000 7f1e6c4e6700 1 --2- 172.21.15.26:0/3743709147 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e640f5ef0 0x7f1e640f6920 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 rx=0x7f1e58004660 tx=0x7f1e58009b30).stop 2021-11-03T18:23:21.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.569+0000 7f1e6c4e6700 1 -- 172.21.15.26:0/3743709147 shutdown_connections 2021-11-03T18:23:21.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.569+0000 7f1e6c4e6700 1 --2- 172.21.15.26:0/3743709147 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e640f5ef0 0x7f1e640f6920 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:21.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.569+0000 7f1e6c4e6700 1 --2- 172.21.15.26:0/3743709147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e640f55e0 0x7f1e640f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:21.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.569+0000 7f1e6c4e6700 1 -- 172.21.15.26:0/3743709147 >> 172.21.15.26:0/3743709147 conn(0x7f1e640f0de0 msgr2=0x7f1e640f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:23:21.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.569+0000 7f1e6c4e6700 1 -- 172.21.15.26:0/3743709147 shutdown_connections 2021-11-03T18:23:21.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.569+0000 7f1e6c4e6700 1 -- 172.21.15.26:0/3743709147 wait complete. 2021-11-03T18:23:21.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.570+0000 7f1e6c4e6700 1 Processor -- start 2021-11-03T18:23:21.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.570+0000 7f1e6c4e6700 1 -- start start 2021-11-03T18:23:21.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.570+0000 7f1e6c4e6700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e640f55e0 0x7f1e64109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:23:21.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.570+0000 7f1e6c4e6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e640f5ef0 0x7f1e6410c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:23:21.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.570+0000 7f1e6c4e6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e64060500 con 0x7f1e640f5ef0 2021-11-03T18:23:21.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.570+0000 7f1e6c4e6700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e64060640 con 0x7f1e640f55e0 2021-11-03T18:23:21.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.570+0000 7f1e69a81700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e640f5ef0 0x7f1e6410c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:23:21.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.570+0000 7f1e69a81700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e640f5ef0 0x7f1e6410c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59746/0 (socket says 172.21.15.26:59746) 2021-11-03T18:23:21.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.570+0000 7f1e69a81700 1 -- 172.21.15.26:0/2482843595 learned_addr learned my addr 172.21.15.26:0/2482843595 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:23:21.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.570+0000 7f1e6a282700 1 --2- 172.21.15.26:0/2482843595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e640f55e0 0x7f1e64109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:23:21.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.571+0000 7f1e69a81700 1 -- 172.21.15.26:0/2482843595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e640f55e0 msgr2=0x7f1e64109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:23:21.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.571+0000 7f1e69a81700 1 --2- 172.21.15.26:0/2482843595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e640f55e0 0x7f1e64109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:21.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.571+0000 7f1e69a81700 1 -- 172.21.15.26:0/2482843595 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e58005040 con 0x7f1e640f5ef0 2021-11-03T18:23:21.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.571+0000 7f1e69a81700 1 --2- 172.21.15.26:0/2482843595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e640f5ef0 0x7f1e6410c190 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7f1e58009990 tx=0x7f1e58009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:23:21.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.571+0000 7f1e62ffd700 1 -- 172.21.15.26:0/2482843595 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e58018070 con 0x7f1e640f5ef0 2021-11-03T18:23:21.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.571+0000 7f1e6c4e6700 1 -- 172.21.15.26:0/2482843595 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e6410c6e0 con 0x7f1e640f5ef0 2021-11-03T18:23:21.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.571+0000 7f1e62ffd700 1 -- 172.21.15.26:0/2482843595 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1e58007ba0 con 0x7f1e640f5ef0 2021-11-03T18:23:21.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.571+0000 7f1e62ffd700 1 -- 172.21.15.26:0/2482843595 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e5801c3c0 con 0x7f1e640f5ef0 2021-11-03T18:23:21.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.571+0000 7f1e6c4e6700 1 -- 172.21.15.26:0/2482843595 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e6410cc40 con 0x7f1e640f5ef0 2021-11-03T18:23:21.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.572+0000 7f1e6c4e6700 1 -- 172.21.15.26:0/2482843595 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e44004fa0 con 0x7f1e640f5ef0 2021-11-03T18:23:21.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.572+0000 7f1e62ffd700 1 -- 172.21.15.26:0/2482843595 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f1e5801d420 con 0x7f1e640f5ef0 2021-11-03T18:23:21.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.573+0000 7f1e62ffd700 1 --2- 172.21.15.26:0/2482843595 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1e4c0640b0 0x7f1e4c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:23:21.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.573+0000 7f1e62ffd700 1 -- 172.21.15.26:0/2482843595 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f1e580823e0 con 0x7f1e640f5ef0 2021-11-03T18:23:21.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.573+0000 7f1e6a282700 1 --2- 172.21.15.26:0/2482843595 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1e4c0640b0 0x7f1e4c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:23:21.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.573+0000 7f1e6a282700 1 --2- 172.21.15.26:0/2482843595 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1e4c0640b0 0x7f1e4c066570 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f1e64060180 tx=0x7f1e5c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:23:21.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.577+0000 7f1e62ffd700 1 -- 172.21.15.26:0/2482843595 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f1e58054740 con 0x7f1e640f5ef0 2021-11-03T18:23:21.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.804+0000 7f1e6c4e6700 1 -- 172.21.15.26:0/2482843595 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1e44005e80 con 0x7f1e640f5ef0 2021-11-03T18:23:21.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.805+0000 7f1e62ffd700 1 -- 172.21.15.26:0/2482843595 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f1e58054330 con 0x7f1e640f5ef0 2021-11-03T18:23:21.804 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:23:21.804 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:23:21.804 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:23:21.804 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:23:21.805 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:23:21.805 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:23:21.805 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:23:21.805 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:23:21.805 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:23:21.806 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:23:21.806 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:23:21.806 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:23:21.806 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:23:21.807 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:23:21.807 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:23:21.807 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:23:21.807 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:23:21.808 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:23:21.808 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.807+0000 7f1e6c4e6700 1 -- 172.21.15.26:0/2482843595 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1e4c0640b0 msgr2=0x7f1e4c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:23:21.809 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.807+0000 7f1e6c4e6700 1 --2- 172.21.15.26:0/2482843595 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1e4c0640b0 0x7f1e4c066570 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f1e64060180 tx=0x7f1e5c00b040).stop 2021-11-03T18:23:21.809 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.807+0000 7f1e6c4e6700 1 -- 172.21.15.26:0/2482843595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e640f5ef0 msgr2=0x7f1e6410c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:23:21.809 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.807+0000 7f1e6c4e6700 1 --2- 172.21.15.26:0/2482843595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e640f5ef0 0x7f1e6410c190 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7f1e58009990 tx=0x7f1e58009b30).stop 2021-11-03T18:23:21.809 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.807+0000 7f1e6c4e6700 1 -- 172.21.15.26:0/2482843595 shutdown_connections 2021-11-03T18:23:21.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.807+0000 7f1e6c4e6700 1 --2- 172.21.15.26:0/2482843595 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1e4c0640b0 0x7f1e4c066570 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:21.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.807+0000 7f1e6c4e6700 1 --2- 172.21.15.26:0/2482843595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e640f55e0 0x7f1e64109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:21.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.807+0000 7f1e6c4e6700 1 --2- 172.21.15.26:0/2482843595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e640f5ef0 0x7f1e6410c190 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:21.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.807+0000 7f1e6c4e6700 1 -- 172.21.15.26:0/2482843595 >> 172.21.15.26:0/2482843595 conn(0x7f1e640f0de0 msgr2=0x7f1e640fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:23:21.811 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.807+0000 7f1e6c4e6700 1 -- 172.21.15.26:0/2482843595 shutdown_connections 2021-11-03T18:23:21.811 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.807+0000 7f1e6c4e6700 1 -- 172.21.15.26:0/2482843595 wait complete. 2021-11-03T18:23:21.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.907+0000 7f072a5f8700 1 -- 172.21.15.26:0/133670478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07240f53e0 msgr2=0x7f07240f7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:23:21.906 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.907+0000 7f072a5f8700 1 --2- 172.21.15.26:0/133670478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07240f53e0 0x7f07240f7d20 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 rx=0x7f0718004660 tx=0x7f0718009b30).stop 2021-11-03T18:23:21.906 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.907+0000 7f072a5f8700 1 -- 172.21.15.26:0/133670478 shutdown_connections 2021-11-03T18:23:21.906 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.907+0000 7f072a5f8700 1 --2- 172.21.15.26:0/133670478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07240f53e0 0x7f07240f7d20 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:21.906 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.907+0000 7f072a5f8700 1 --2- 172.21.15.26:0/133670478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07240f4a40 0x7f07240f4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:21.907 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.907+0000 7f072a5f8700 1 -- 172.21.15.26:0/133670478 >> 172.21.15.26:0/133670478 conn(0x7f07240f04c0 msgr2=0x7f07240f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:23:21.907 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.907+0000 7f072a5f8700 1 -- 172.21.15.26:0/133670478 shutdown_connections 2021-11-03T18:23:21.907 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.907+0000 7f072a5f8700 1 -- 172.21.15.26:0/133670478 wait complete. 2021-11-03T18:23:21.908 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.907+0000 7f072a5f8700 1 Processor -- start 2021-11-03T18:23:21.908 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.907+0000 7f072a5f8700 1 -- start start 2021-11-03T18:23:21.910 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.908+0000 7f072a5f8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07240f4a40 0x7f0724107180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:23:21.910 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.908+0000 7f072a5f8700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07240f53e0 0x7f0724107670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:23:21.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.908+0000 7f072a5f8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0724107c20 con 0x7f07240f4a40 2021-11-03T18:23:21.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.908+0000 7f072a5f8700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0724107d60 con 0x7f07240f53e0 2021-11-03T18:23:21.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.908+0000 7f0723fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07240f4a40 0x7f0724107180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:23:21.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.908+0000 7f0723fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07240f4a40 0x7f0724107180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59754/0 (socket says 172.21.15.26:59754) 2021-11-03T18:23:21.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.908+0000 7f0723fff700 1 -- 172.21.15.26:0/3954695899 learned_addr learned my addr 172.21.15.26:0/3954695899 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:23:21.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.908+0000 7f07237fe700 1 --2- 172.21.15.26:0/3954695899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07240f53e0 0x7f0724107670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:23:21.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.908+0000 7f0723fff700 1 -- 172.21.15.26:0/3954695899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07240f53e0 msgr2=0x7f0724107670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:23:21.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.908+0000 7f0723fff700 1 --2- 172.21.15.26:0/3954695899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07240f53e0 0x7f0724107670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:21.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.908+0000 7f0723fff700 1 -- 172.21.15.26:0/3954695899 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0718005040 con 0x7f07240f4a40 2021-11-03T18:23:21.913 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.908+0000 7f07237fe700 1 --2- 172.21.15.26:0/3954695899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07240f53e0 0x7f0724107670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:23:21.913 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.908+0000 7f0723fff700 1 --2- 172.21.15.26:0/3954695899 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07240f4a40 0x7f0724107180 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 rx=0x7f07140026d0 tx=0x7f0714009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:23:21.913 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.908+0000 7f0720ff9700 1 -- 172.21.15.26:0/3954695899 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0714009320 con 0x7f07240f4a40 2021-11-03T18:23:21.913 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.908+0000 7f0720ff9700 1 -- 172.21.15.26:0/3954695899 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f071400f040 con 0x7f07240f4a40 2021-11-03T18:23:21.914 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.908+0000 7f072a5f8700 1 -- 172.21.15.26:0/3954695899 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0724108700 con 0x7f07240f4a40 2021-11-03T18:23:21.914 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.908+0000 7f0720ff9700 1 -- 172.21.15.26:0/3954695899 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07140147e0 con 0x7f07240f4a40 2021-11-03T18:23:21.914 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.908+0000 7f072a5f8700 1 -- 172.21.15.26:0/3954695899 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0724108cc0 con 0x7f07240f4a40 2021-11-03T18:23:21.914 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.909+0000 7f072a5f8700 1 -- 172.21.15.26:0/3954695899 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0724045ad0 con 0x7f07240f4a40 2021-11-03T18:23:21.915 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.910+0000 7f0720ff9700 1 -- 172.21.15.26:0/3954695899 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f0714009480 con 0x7f07240f4a40 2021-11-03T18:23:21.915 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.910+0000 7f0720ff9700 1 --2- 172.21.15.26:0/3954695899 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f070c0640b0 0x7f070c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:23:21.916 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.910+0000 7f0720ff9700 1 -- 172.21.15.26:0/3954695899 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f0714080ee0 con 0x7f07240f4a40 2021-11-03T18:23:21.916 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.910+0000 7f07237fe700 1 --2- 172.21.15.26:0/3954695899 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f070c0640b0 0x7f070c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:23:21.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.911+0000 7f07237fe700 1 --2- 172.21.15.26:0/3954695899 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f070c0640b0 0x7f070c066570 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7f0718005010 tx=0x7f0718009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:23:21.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:21.914+0000 7f0720ff9700 1 -- 172.21.15.26:0/3954695899 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f0714053240 con 0x7f07240f4a40 2021-11-03T18:23:22.118 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:22.120+0000 7f072a5f8700 1 -- 172.21.15.26:0/3954695899 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f07240ff0f0 con 0x7f07240f4a40 2021-11-03T18:23:22.119 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:22.120+0000 7f0720ff9700 1 -- 172.21.15.26:0/3954695899 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f0714052e30 con 0x7f07240f4a40 2021-11-03T18:23:22.119 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:23:22.119 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:23:22.120 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:23:22.120 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:23:22.120 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:23:22.120 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:23:22.120 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:23:22.121 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:23:22.121 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:23:22.121 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:23:22.121 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:23:22.122 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:23:22.122 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:23:22.122 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:23:22.122 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:23:22.123 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:23:22.123 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:23:22.123 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:23:22.124 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:23:22.124 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:23:22.124 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:23:22.124 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:23:22.125 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:23:22.125 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:23:22.125 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:23:22.125 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:23:22.125 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:23:22.126 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:23:22.126 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:23:22.126 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:23:22.126 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:23:22.127 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:23:22.127 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:23:22.127 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:23:22.127 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:23:22.127 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:23:22.128 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:23:22.128 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:23:22.128 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:23:22.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:22.122+0000 7f072a5f8700 1 -- 172.21.15.26:0/3954695899 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f070c0640b0 msgr2=0x7f070c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:23:22.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:22.122+0000 7f072a5f8700 1 --2- 172.21.15.26:0/3954695899 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f070c0640b0 0x7f070c066570 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7f0718005010 tx=0x7f0718009b30).stop 2021-11-03T18:23:22.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:22.122+0000 7f072a5f8700 1 -- 172.21.15.26:0/3954695899 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07240f4a40 msgr2=0x7f0724107180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:23:22.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:22.122+0000 7f072a5f8700 1 --2- 172.21.15.26:0/3954695899 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07240f4a40 0x7f0724107180 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 rx=0x7f07140026d0 tx=0x7f0714009de0).stop 2021-11-03T18:23:22.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:22.122+0000 7f072a5f8700 1 -- 172.21.15.26:0/3954695899 shutdown_connections 2021-11-03T18:23:22.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:22.122+0000 7f072a5f8700 1 --2- 172.21.15.26:0/3954695899 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f070c0640b0 0x7f070c066570 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:22.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:22.122+0000 7f072a5f8700 1 --2- 172.21.15.26:0/3954695899 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07240f4a40 0x7f0724107180 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:22.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:22.122+0000 7f072a5f8700 1 --2- 172.21.15.26:0/3954695899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07240f53e0 0x7f0724107670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:22.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:22.122+0000 7f072a5f8700 1 -- 172.21.15.26:0/3954695899 >> 172.21.15.26:0/3954695899 conn(0x7f07240f04c0 msgr2=0x7f07240fb770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:23:22.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:22.122+0000 7f072a5f8700 1 -- 172.21.15.26:0/3954695899 shutdown_connections 2021-11-03T18:23:22.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:22.122+0000 7f072a5f8700 1 -- 172.21.15.26:0/3954695899 wait complete. 2021-11-03T18:23:22.132 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:23:22.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:22 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2482843595' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:23:22.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:22 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2482843595' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:23:23.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:23 smithi026 ceph-mon[96795]: from='client.36876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:23:23.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:23 smithi026 ceph-mon[96795]: from='client.36880 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:23:23.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:23 smithi026 ceph-mon[96795]: pgmap v2661: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:23.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:23 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3954695899' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:23:23.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:23 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:23:23.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:23 smithi194 ceph-mon[65619]: from='client.36876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:23:23.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:23 smithi194 ceph-mon[65619]: from='client.36880 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:23:23.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:23 smithi194 ceph-mon[65619]: pgmap v2661: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:23.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:23 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3954695899' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:23:23.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:23 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:23:24.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:24 smithi026 ceph-mon[96795]: poll took 60077.702 ms: 1 events 2021-11-03T18:23:24.489 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:24 smithi194 ceph-mon[65619]: poll took 60077.702 ms: 1 events 2021-11-03T18:23:25.371 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:25 smithi194 ceph-mon[65619]: pgmap v2662: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:25.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:25 smithi026 ceph-mon[96795]: pgmap v2662: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:27.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:26 smithi026 ceph-mon[96795]: poll took 2567.519 ms: 1 events 2021-11-03T18:23:27.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:26 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:23:27.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:26 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:23:27.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:26 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:23:27.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:26 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:23:27.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:26 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:23:27.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:26 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:23:27.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:26 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:23:27.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:26 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:23:27.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:26 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:23:27.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:26 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:23:27.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:26 smithi026 ceph-mon[96795]: pgmap v2663: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:27.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:26 smithi194 ceph-mon[65619]: poll took 2567.519 ms: 1 events 2021-11-03T18:23:27.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:26 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:23:27.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:26 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:23:27.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:26 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:23:27.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:26 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:23:27.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:26 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:23:27.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:26 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:23:27.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:26 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:23:27.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:26 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:23:27.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:26 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:23:27.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:26 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:23:27.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:26 smithi194 ceph-mon[65619]: pgmap v2663: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:29.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:28 smithi026 ceph-mon[96795]: pgmap v2664: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:29.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:28 smithi194 ceph-mon[65619]: pgmap v2664: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:31.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:30 smithi026 ceph-mon[96795]: pgmap v2665: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:31.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:30 smithi194 ceph-mon[65619]: pgmap v2665: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:33.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:32 smithi026 ceph-mon[96795]: pgmap v2666: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:33.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:32 smithi194 ceph-mon[65619]: pgmap v2666: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:35.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:34 smithi026 ceph-mon[96795]: pgmap v2667: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:35.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:34 smithi194 ceph-mon[65619]: pgmap v2667: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:37.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:36 smithi026 ceph-mon[96795]: pgmap v2668: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:37.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:36 smithi194 ceph-mon[65619]: pgmap v2668: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:39.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:38 smithi026 ceph-mon[96795]: pgmap v2669: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:39.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:38 smithi194 ceph-mon[65619]: pgmap v2669: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:41.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:40 smithi026 ceph-mon[96795]: pgmap v2670: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:41.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:23:41.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:40 smithi194 ceph-mon[65619]: pgmap v2670: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:41.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:23:42.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:41 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:23:42.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:41 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:23:43.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:42 smithi026 ceph-mon[96795]: pgmap v2671: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:43.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:42 smithi194 ceph-mon[65619]: pgmap v2671: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:45.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:44 smithi026 ceph-mon[96795]: pgmap v2672: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:45.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:44 smithi194 ceph-mon[65619]: pgmap v2672: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:47.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:46 smithi026 ceph-mon[96795]: pgmap v2673: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:47.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:46 smithi194 ceph-mon[65619]: pgmap v2673: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:49.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:48 smithi026 ceph-mon[96795]: pgmap v2674: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:49.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:23:49.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:23:49.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:48 smithi194 ceph-mon[65619]: pgmap v2674: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:49.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:23:49.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:23:51.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:50 smithi026 ceph-mon[96795]: pgmap v2675: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:51.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:50 smithi194 ceph-mon[65619]: pgmap v2675: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:52.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.236+0000 7f5478c95700 1 -- 172.21.15.26:0/2737486372 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54740f98b0 msgr2=0x7f54740fbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:23:52.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.236+0000 7f5478c95700 1 --2- 172.21.15.26:0/2737486372 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54740f98b0 0x7f54740fbca0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 rx=0x7f545c004660 tx=0x7f545c009b30).stop 2021-11-03T18:23:52.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.236+0000 7f5478c95700 1 -- 172.21.15.26:0/2737486372 shutdown_connections 2021-11-03T18:23:52.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.236+0000 7f5478c95700 1 --2- 172.21.15.26:0/2737486372 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54740f98b0 0x7f54740fbca0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:52.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.236+0000 7f5478c95700 1 --2- 172.21.15.26:0/2737486372 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5474060330 0x7f54740f93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:52.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.236+0000 7f5478c95700 1 -- 172.21.15.26:0/2737486372 >> 172.21.15.26:0/2737486372 conn(0x7f54740f0de0 msgr2=0x7f54740f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:23:52.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.237+0000 7f5478c95700 1 -- 172.21.15.26:0/2737486372 shutdown_connections 2021-11-03T18:23:52.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.237+0000 7f5478c95700 1 -- 172.21.15.26:0/2737486372 wait complete. 2021-11-03T18:23:52.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.237+0000 7f5478c95700 1 Processor -- start 2021-11-03T18:23:52.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.237+0000 7f5478c95700 1 -- start start 2021-11-03T18:23:52.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.237+0000 7f5478c95700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5474060330 0x7f54740f6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:23:52.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.237+0000 7f5478c95700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54740f98b0 0x7f54740f52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:23:52.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.237+0000 7f5478c95700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54740f5820 con 0x7f54740f98b0 2021-11-03T18:23:52.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.237+0000 7f5478c95700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54740f5960 con 0x7f5474060330 2021-11-03T18:23:52.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.237+0000 7f5471d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54740f98b0 0x7f54740f52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:23:52.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.237+0000 7f5471d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54740f98b0 0x7f54740f52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59774/0 (socket says 172.21.15.26:59774) 2021-11-03T18:23:52.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.237+0000 7f5471d9b700 1 -- 172.21.15.26:0/1686832844 learned_addr learned my addr 172.21.15.26:0/1686832844 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:23:52.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.238+0000 7f547259c700 1 --2- 172.21.15.26:0/1686832844 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5474060330 0x7f54740f6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:23:52.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.238+0000 7f5471d9b700 1 -- 172.21.15.26:0/1686832844 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5474060330 msgr2=0x7f54740f6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:23:52.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.238+0000 7f5471d9b700 1 --2- 172.21.15.26:0/1686832844 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5474060330 0x7f54740f6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:52.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.238+0000 7f5471d9b700 1 -- 172.21.15.26:0/1686832844 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f545c005040 con 0x7f54740f98b0 2021-11-03T18:23:52.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.238+0000 7f5471d9b700 1 --2- 172.21.15.26:0/1686832844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54740f98b0 0x7f54740f52c0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 rx=0x7f545c009990 tx=0x7f545c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:23:52.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.238+0000 7f546affd700 1 -- 172.21.15.26:0/1686832844 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f545c018070 con 0x7f54740f98b0 2021-11-03T18:23:52.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.238+0000 7f546affd700 1 -- 172.21.15.26:0/1686832844 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f545c007ba0 con 0x7f54740f98b0 2021-11-03T18:23:52.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.238+0000 7f5478c95700 1 -- 172.21.15.26:0/1686832844 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54740f5be0 con 0x7f54740f98b0 2021-11-03T18:23:52.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.238+0000 7f546affd700 1 -- 172.21.15.26:0/1686832844 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f545c01c3c0 con 0x7f54740f98b0 2021-11-03T18:23:52.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.239+0000 7f5478c95700 1 -- 172.21.15.26:0/1686832844 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54740f6140 con 0x7f54740f98b0 2021-11-03T18:23:52.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.239+0000 7f5478c95700 1 -- 172.21.15.26:0/1686832844 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5474045ad0 con 0x7f54740f98b0 2021-11-03T18:23:52.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.240+0000 7f546affd700 1 -- 172.21.15.26:0/1686832844 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f545c01d420 con 0x7f54740f98b0 2021-11-03T18:23:52.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.240+0000 7f546affd700 1 --2- 172.21.15.26:0/1686832844 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f54600640b0 0x7f5460066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:23:52.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.240+0000 7f546affd700 1 -- 172.21.15.26:0/1686832844 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f545c081f20 con 0x7f54740f98b0 2021-11-03T18:23:52.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.240+0000 7f547259c700 1 --2- 172.21.15.26:0/1686832844 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f54600640b0 0x7f5460066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:23:52.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.240+0000 7f547259c700 1 --2- 172.21.15.26:0/1686832844 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f54600640b0 0x7f5460066570 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f54740f6bd0 tx=0x7f546c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:23:52.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.244+0000 7f546affd700 1 -- 172.21.15.26:0/1686832844 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f545c054260 con 0x7f54740f98b0 2021-11-03T18:23:52.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.423+0000 7f5478c95700 1 -- 172.21.15.26:0/1686832844 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5474057f10 con 0x7f54600640b0 2021-11-03T18:23:52.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.424+0000 7f546affd700 1 -- 172.21.15.26:0/1686832844 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f5474057f10 con 0x7f54600640b0 2021-11-03T18:23:52.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.426+0000 7f5478c95700 1 -- 172.21.15.26:0/1686832844 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f54600640b0 msgr2=0x7f5460066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:23:52.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.426+0000 7f5478c95700 1 --2- 172.21.15.26:0/1686832844 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f54600640b0 0x7f5460066570 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f54740f6bd0 tx=0x7f546c00b040).stop 2021-11-03T18:23:52.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.426+0000 7f5478c95700 1 -- 172.21.15.26:0/1686832844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54740f98b0 msgr2=0x7f54740f52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:23:52.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.426+0000 7f5478c95700 1 --2- 172.21.15.26:0/1686832844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54740f98b0 0x7f54740f52c0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 rx=0x7f545c009990 tx=0x7f545c009b30).stop 2021-11-03T18:23:52.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.426+0000 7f5478c95700 1 -- 172.21.15.26:0/1686832844 shutdown_connections 2021-11-03T18:23:52.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.426+0000 7f5478c95700 1 --2- 172.21.15.26:0/1686832844 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f54600640b0 0x7f5460066570 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:52.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.426+0000 7f5478c95700 1 --2- 172.21.15.26:0/1686832844 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5474060330 0x7f54740f6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:52.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.426+0000 7f5478c95700 1 --2- 172.21.15.26:0/1686832844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54740f98b0 0x7f54740f52c0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:52.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.426+0000 7f5478c95700 1 -- 172.21.15.26:0/1686832844 >> 172.21.15.26:0/1686832844 conn(0x7f54740f0de0 msgr2=0x7f54740f31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:23:52.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.426+0000 7f5478c95700 1 -- 172.21.15.26:0/1686832844 shutdown_connections 2021-11-03T18:23:52.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.426+0000 7f5478c95700 1 -- 172.21.15.26:0/1686832844 wait complete. 2021-11-03T18:23:52.434 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:23:52.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.526+0000 7f61c2a6b700 1 -- 172.21.15.26:0/3067108106 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61bc0f55e0 msgr2=0x7f61bc0f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:23:52.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.526+0000 7f61c2a6b700 1 --2- 172.21.15.26:0/3067108106 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61bc0f55e0 0x7f61bc0f5a00 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 rx=0x7f61b0004660 tx=0x7f61b0009b30).stop 2021-11-03T18:23:52.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.526+0000 7f61c2a6b700 1 -- 172.21.15.26:0/3067108106 shutdown_connections 2021-11-03T18:23:52.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.526+0000 7f61c2a6b700 1 --2- 172.21.15.26:0/3067108106 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61bc0f5ef0 0x7f61bc0f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:52.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.526+0000 7f61c2a6b700 1 --2- 172.21.15.26:0/3067108106 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61bc0f55e0 0x7f61bc0f5a00 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:52.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.526+0000 7f61c2a6b700 1 -- 172.21.15.26:0/3067108106 >> 172.21.15.26:0/3067108106 conn(0x7f61bc0f0de0 msgr2=0x7f61bc0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:23:52.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.526+0000 7f61c2a6b700 1 -- 172.21.15.26:0/3067108106 shutdown_connections 2021-11-03T18:23:52.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.526+0000 7f61c2a6b700 1 -- 172.21.15.26:0/3067108106 wait complete. 2021-11-03T18:23:52.530 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.527+0000 7f61c2a6b700 1 Processor -- start 2021-11-03T18:23:52.530 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.527+0000 7f61c2a6b700 1 -- start start 2021-11-03T18:23:52.530 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.527+0000 7f61c2a6b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61bc0f55e0 0x7f61bc109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:23:52.530 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.527+0000 7f61c2a6b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61bc0f5ef0 0x7f61bc10c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:23:52.531 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.527+0000 7f61c2a6b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61bc060500 con 0x7f61bc0f55e0 2021-11-03T18:23:52.531 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.527+0000 7f61c2a6b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61bc060640 con 0x7f61bc0f5ef0 2021-11-03T18:23:52.531 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.527+0000 7f61c0807700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61bc0f55e0 0x7f61bc109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:23:52.531 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.527+0000 7f61c0807700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61bc0f55e0 0x7f61bc109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59784/0 (socket says 172.21.15.26:59784) 2021-11-03T18:23:52.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.527+0000 7f61c0807700 1 -- 172.21.15.26:0/2048301874 learned_addr learned my addr 172.21.15.26:0/2048301874 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:23:52.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.527+0000 7f61bbfff700 1 --2- 172.21.15.26:0/2048301874 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61bc0f5ef0 0x7f61bc10c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:23:52.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.528+0000 7f61c0807700 1 -- 172.21.15.26:0/2048301874 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61bc0f5ef0 msgr2=0x7f61bc10c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:23:52.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.528+0000 7f61c0807700 1 --2- 172.21.15.26:0/2048301874 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61bc0f5ef0 0x7f61bc10c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:52.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.528+0000 7f61c0807700 1 -- 172.21.15.26:0/2048301874 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b0005040 con 0x7f61bc0f55e0 2021-11-03T18:23:52.533 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.528+0000 7f61c0807700 1 --2- 172.21.15.26:0/2048301874 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61bc0f55e0 0x7f61bc109c90 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 rx=0x7f61b0009990 tx=0x7f61b0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:23:52.533 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.528+0000 7f61b97fa700 1 -- 172.21.15.26:0/2048301874 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61b0018070 con 0x7f61bc0f55e0 2021-11-03T18:23:52.533 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.528+0000 7f61c2a6b700 1 -- 172.21.15.26:0/2048301874 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61bc10c6e0 con 0x7f61bc0f55e0 2021-11-03T18:23:52.533 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.528+0000 7f61b97fa700 1 -- 172.21.15.26:0/2048301874 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f61b0007ba0 con 0x7f61bc0f55e0 2021-11-03T18:23:52.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.528+0000 7f61b97fa700 1 -- 172.21.15.26:0/2048301874 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61b001c3c0 con 0x7f61bc0f55e0 2021-11-03T18:23:52.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.528+0000 7f61c2a6b700 1 -- 172.21.15.26:0/2048301874 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61bc10cc40 con 0x7f61bc0f55e0 2021-11-03T18:23:52.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.529+0000 7f61c2a6b700 1 -- 172.21.15.26:0/2048301874 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61bc045ad0 con 0x7f61bc0f55e0 2021-11-03T18:23:52.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.529+0000 7f61b97fa700 1 -- 172.21.15.26:0/2048301874 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f61b001d420 con 0x7f61bc0f55e0 2021-11-03T18:23:52.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.530+0000 7f61b97fa700 1 --2- 172.21.15.26:0/2048301874 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f61ac0640b0 0x7f61ac066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:23:52.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.530+0000 7f61b97fa700 1 -- 172.21.15.26:0/2048301874 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f61b0082500 con 0x7f61bc0f55e0 2021-11-03T18:23:52.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.530+0000 7f61bbfff700 1 --2- 172.21.15.26:0/2048301874 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f61ac0640b0 0x7f61ac066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:23:52.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.530+0000 7f61bbfff700 1 --2- 172.21.15.26:0/2048301874 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f61ac0640b0 0x7f61ac066570 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7f61a80096c0 tx=0x7f61a8009be0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:23:52.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.534+0000 7f61b97fa700 1 -- 172.21.15.26:0/2048301874 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f61b00548c0 con 0x7f61bc0f55e0 2021-11-03T18:23:52.705 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.706+0000 7f61c2a6b700 1 -- 172.21.15.26:0/2048301874 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f61bc0fdf40 con 0x7f61ac0640b0 2021-11-03T18:23:52.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.721+0000 7f61b97fa700 1 -- 172.21.15.26:0/2048301874 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f61bc0fdf40 con 0x7f61ac0640b0 2021-11-03T18:23:52.720 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:23:52.721 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (95m) 3m ago 96m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:23:52.721 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (87m) 3m ago 96m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:23:52.721 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (87m) 2m ago 95m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:23:52.721 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (94m) 3m ago 96m 42.2M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:23:52.722 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (88m) 3m ago 91m 26.0M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:23:52.722 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (88m) 3m ago 91m 26.6M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:23:52.722 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (91m) 2m ago 91m 26.8M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:23:52.723 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (91m) 2m ago 91m 27.2M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:23:52.723 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (88m) 3m ago 97m 588M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:23:52.723 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (88m) 2m ago 95m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:23:52.723 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (88m) 3m ago 97m 341M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:23:52.723 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (87m) 2m ago 95m 158M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:23:52.724 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (95m) 3m ago 95m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:23:52.724 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (95m) 2m ago 95m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:23:52.724 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (86m) 3m ago 94m 332M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:23:52.724 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (86m) 3m ago 94m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:23:52.725 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (85m) 3m ago 94m 296M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:23:52.725 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (85m) 2m ago 93m 387M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:23:52.725 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (84m) 2m ago 93m 320M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:23:52.726 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (84m) 2m ago 93m 316M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:23:52.726 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (94m) 3m ago 95m 65.7M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:23:52.727 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.723+0000 7f61c2a6b700 1 -- 172.21.15.26:0/2048301874 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f61ac0640b0 msgr2=0x7f61ac066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:23:52.727 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.723+0000 7f61c2a6b700 1 --2- 172.21.15.26:0/2048301874 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f61ac0640b0 0x7f61ac066570 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7f61a80096c0 tx=0x7f61a8009be0).stop 2021-11-03T18:23:52.727 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.723+0000 7f61c2a6b700 1 -- 172.21.15.26:0/2048301874 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61bc0f55e0 msgr2=0x7f61bc109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:23:52.727 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.723+0000 7f61c2a6b700 1 --2- 172.21.15.26:0/2048301874 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61bc0f55e0 0x7f61bc109c90 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 rx=0x7f61b0009990 tx=0x7f61b0009b30).stop 2021-11-03T18:23:52.728 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.723+0000 7f61c2a6b700 1 -- 172.21.15.26:0/2048301874 shutdown_connections 2021-11-03T18:23:52.728 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.723+0000 7f61c2a6b700 1 --2- 172.21.15.26:0/2048301874 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f61ac0640b0 0x7f61ac066570 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:52.728 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.723+0000 7f61c2a6b700 1 --2- 172.21.15.26:0/2048301874 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61bc0f55e0 0x7f61bc109c90 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:52.728 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.723+0000 7f61c2a6b700 1 --2- 172.21.15.26:0/2048301874 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61bc0f5ef0 0x7f61bc10c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:52.729 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.723+0000 7f61c2a6b700 1 -- 172.21.15.26:0/2048301874 >> 172.21.15.26:0/2048301874 conn(0x7f61bc0f0de0 msgr2=0x7f61bc0fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:23:52.729 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.723+0000 7f61c2a6b700 1 -- 172.21.15.26:0/2048301874 shutdown_connections 2021-11-03T18:23:52.729 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.723+0000 7f61c2a6b700 1 -- 172.21.15.26:0/2048301874 wait complete. 2021-11-03T18:23:52.823 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.822+0000 7fa1e1690700 1 -- 172.21.15.26:0/1443424587 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1dc0f5440 msgr2=0x7fa1dc0f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:23:52.824 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.822+0000 7fa1e1690700 1 --2- 172.21.15.26:0/1443424587 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1dc0f5440 0x7fa1dc0f5860 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7fa1cc004660 tx=0x7fa1cc009b30).stop 2021-11-03T18:23:52.824 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.822+0000 7fa1e1690700 1 -- 172.21.15.26:0/1443424587 shutdown_connections 2021-11-03T18:23:52.824 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.823+0000 7fa1e1690700 1 --2- 172.21.15.26:0/1443424587 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1dc0f66e0 0x7fa1dc0f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:52.824 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.823+0000 7fa1e1690700 1 --2- 172.21.15.26:0/1443424587 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1dc0f5440 0x7fa1dc0f5860 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:52.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.823+0000 7fa1e1690700 1 -- 172.21.15.26:0/1443424587 >> 172.21.15.26:0/1443424587 conn(0x7fa1dc0f0ba0 msgr2=0x7fa1dc0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:23:52.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.823+0000 7fa1e1690700 1 -- 172.21.15.26:0/1443424587 shutdown_connections 2021-11-03T18:23:52.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.823+0000 7fa1e1690700 1 -- 172.21.15.26:0/1443424587 wait complete. 2021-11-03T18:23:52.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.823+0000 7fa1e1690700 1 Processor -- start 2021-11-03T18:23:52.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.823+0000 7fa1e1690700 1 -- start start 2021-11-03T18:23:52.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.823+0000 7fa1e1690700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1dc0f5440 0x7fa1dc106e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:23:52.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.823+0000 7fa1e1690700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1dc0f66e0 0x7fa1dc107320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:23:52.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.823+0000 7fa1e1690700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc107920 con 0x7fa1dc0f5440 2021-11-03T18:23:52.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.823+0000 7fa1e1690700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc108130 con 0x7fa1dc0f66e0 2021-11-03T18:23:52.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.824+0000 7fa1dbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1dc0f5440 0x7fa1dc106e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:23:52.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.824+0000 7fa1dbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1dc0f5440 0x7fa1dc106e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59792/0 (socket says 172.21.15.26:59792) 2021-11-03T18:23:52.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.824+0000 7fa1dbfff700 1 -- 172.21.15.26:0/2512663213 learned_addr learned my addr 172.21.15.26:0/2512663213 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:23:52.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.824+0000 7fa1dbfff700 1 -- 172.21.15.26:0/2512663213 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1dc0f66e0 msgr2=0x7fa1dc107320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:23:52.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.824+0000 7fa1dbfff700 1 --2- 172.21.15.26:0/2512663213 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1dc0f66e0 0x7fa1dc107320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:23:52.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.824+0000 7fa1dbfff700 1 -- 172.21.15.26:0/2512663213 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1cc005040 con 0x7fa1dc0f5440 2021-11-03T18:23:52.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.824+0000 7fa1dbfff700 1 --2- 172.21.15.26:0/2512663213 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1dc0f5440 0x7fa1dc106e30 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 rx=0x7fa1cc013a70 tx=0x7fa1cc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:23:52.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.824+0000 7fa1d8ff9700 1 -- 172.21.15.26:0/2512663213 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1cc018070 con 0x7fa1dc0f5440 2021-11-03T18:23:52.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.824+0000 7fa1e1690700 1 -- 172.21.15.26:0/2512663213 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1dc108350 con 0x7fa1dc0f5440 2021-11-03T18:23:52.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.824+0000 7fa1d8ff9700 1 -- 172.21.15.26:0/2512663213 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa1cc0097d0 con 0x7fa1dc0f5440 2021-11-03T18:23:52.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.824+0000 7fa1d8ff9700 1 -- 172.21.15.26:0/2512663213 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1cc01c3c0 con 0x7fa1dc0f5440 2021-11-03T18:23:52.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.824+0000 7fa1e1690700 1 -- 172.21.15.26:0/2512663213 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1dc1088b0 con 0x7fa1dc0f5440 2021-11-03T18:23:52.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.825+0000 7fa1e1690700 1 -- 172.21.15.26:0/2512663213 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1dc059100 con 0x7fa1dc0f5440 2021-11-03T18:23:52.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.825+0000 7fa1d8ff9700 1 -- 172.21.15.26:0/2512663213 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fa1cc007ba0 con 0x7fa1dc0f5440 2021-11-03T18:23:52.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.826+0000 7fa1d8ff9700 1 --2- 172.21.15.26:0/2512663213 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa1c4064100 0x7fa1c40665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:23:52.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.826+0000 7fa1d8ff9700 1 -- 172.21.15.26:0/2512663213 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fa1cc082470 con 0x7fa1dc0f5440 2021-11-03T18:23:52.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.826+0000 7fa1db7fe700 1 --2- 172.21.15.26:0/2512663213 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa1c4064100 0x7fa1c40665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:23:52.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.826+0000 7fa1db7fe700 1 --2- 172.21.15.26:0/2512663213 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa1c4064100 0x7fa1c40665c0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7fa1d0004a10 tx=0x7fa1d00099e0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:23:52.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:52.830+0000 7fa1d8ff9700 1 -- 172.21.15.26:0/2512663213 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fa1cc0547d0 con 0x7fa1dc0f5440 2021-11-03T18:23:53.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.065+0000 7fa1e1690700 1 -- 172.21.15.26:0/2512663213 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa1dc045ad0 con 0x7fa1dc0f5440 2021-11-03T18:23:53.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.065+0000 7fa1d8ff9700 1 -- 172.21.15.26:0/2512663213 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fa1cc0543c0 con 0x7fa1dc0f5440 2021-11-03T18:23:53.065 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:23:53.065 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:23:53.065 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:23:53.065 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:23:53.066 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:23:53.066 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:23:53.066 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:23:53.067 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:23:53.067 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:23:53.067 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:23:53.067 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:23:53.067 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:23:53.068 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:23:53.068 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:23:53.068 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:23:53.068 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:23:53.069 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:23:53.069 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:23:53.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.067+0000 7fa1e1690700 1 -- 172.21.15.26:0/2512663213 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa1c4064100 msgr2=0x7fa1c40665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:23:53.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.067+0000 7fa1e1690700 1 --2- 172.21.15.26:0/2512663213 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa1c4064100 0x7fa1c40665c0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7fa1d0004a10 tx=0x7fa1d00099e0).stop 2021-11-03T18:23:53.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.067+0000 7fa1e1690700 1 -- 172.21.15.26:0/2512663213 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1dc0f5440 msgr2=0x7fa1dc106e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:23:53.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.067+0000 7fa1e1690700 1 --2- 172.21.15.26:0/2512663213 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1dc0f5440 0x7fa1dc106e30 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 rx=0x7fa1cc013a70 tx=0x7fa1cc009b30).stop 2021-11-03T18:23:53.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.067+0000 7fa1e1690700 1 -- 172.21.15.26:0/2512663213 shutdown_connections 2021-11-03T18:23:53.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.067+0000 7fa1e1690700 1 --2- 172.21.15.26:0/2512663213 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa1c4064100 0x7fa1c40665c0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:53.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.067+0000 7fa1e1690700 1 --2- 172.21.15.26:0/2512663213 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1dc0f5440 0x7fa1dc106e30 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:53.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.067+0000 7fa1e1690700 1 --2- 172.21.15.26:0/2512663213 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1dc0f66e0 0x7fa1dc107320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:23:53.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.067+0000 7fa1e1690700 1 -- 172.21.15.26:0/2512663213 >> 172.21.15.26:0/2512663213 conn(0x7fa1dc0f0ba0 msgr2=0x7fa1dc05f620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:23:53.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.067+0000 7fa1e1690700 1 -- 172.21.15.26:0/2512663213 shutdown_connections 2021-11-03T18:23:53.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.067+0000 7fa1e1690700 1 -- 172.21.15.26:0/2512663213 wait complete. 2021-11-03T18:23:53.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.168+0000 7efc209b0700 1 -- 172.21.15.26:0/3366309266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc1c0f55c0 msgr2=0x7efc1c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:23:53.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.168+0000 7efc209b0700 1 --2- 172.21.15.26:0/3366309266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc1c0f55c0 0x7efc1c0f59e0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7efc140099e0 tx=0x7efc14004d10).stop 2021-11-03T18:23:53.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.168+0000 7efc209b0700 1 -- 172.21.15.26:0/3366309266 shutdown_connections 2021-11-03T18:23:53.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.168+0000 7efc209b0700 1 --2- 172.21.15.26:0/3366309266 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc1c0f6860 0x7efc1c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:23:53.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.168+0000 7efc209b0700 1 --2- 172.21.15.26:0/3366309266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc1c0f55c0 0x7efc1c0f59e0 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:53.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.168+0000 7efc209b0700 1 -- 172.21.15.26:0/3366309266 >> 172.21.15.26:0/3366309266 conn(0x7efc1c0f0d40 msgr2=0x7efc1c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:23:53.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.168+0000 7efc209b0700 1 -- 172.21.15.26:0/3366309266 shutdown_connections 2021-11-03T18:23:53.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.168+0000 7efc209b0700 1 -- 172.21.15.26:0/3366309266 wait complete. 2021-11-03T18:23:53.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.168+0000 7efc209b0700 1 Processor -- start 2021-11-03T18:23:53.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.168+0000 7efc209b0700 1 -- start start 2021-11-03T18:23:53.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.169+0000 7efc209b0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc1c0f55c0 0x7efc1c107100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:23:53.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.169+0000 7efc209b0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc1c0f6860 0x7efc1c1075f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:23:53.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.169+0000 7efc209b0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c107c30 con 0x7efc1c0f6860 2021-11-03T18:23:53.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.169+0000 7efc209b0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c1084e0 con 0x7efc1c0f55c0 2021-11-03T18:23:53.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.169+0000 7efc19d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc1c0f6860 0x7efc1c1075f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:23:53.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.169+0000 7efc19d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc1c0f6860 0x7efc1c1075f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59806/0 (socket says 172.21.15.26:59806) 2021-11-03T18:23:53.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.169+0000 7efc19d9b700 1 -- 172.21.15.26:0/595368047 learned_addr learned my addr 172.21.15.26:0/595368047 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:23:53.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.169+0000 7efc1a59c700 1 --2- 172.21.15.26:0/595368047 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc1c0f55c0 0x7efc1c107100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:23:53.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.169+0000 7efc19d9b700 1 -- 172.21.15.26:0/595368047 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc1c0f55c0 msgr2=0x7efc1c107100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:23:53.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.169+0000 7efc19d9b700 1 --2- 172.21.15.26:0/595368047 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc1c0f55c0 0x7efc1c107100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:53.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.169+0000 7efc19d9b700 1 -- 172.21.15.26:0/595368047 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc14009640 con 0x7efc1c0f6860 2021-11-03T18:23:53.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.169+0000 7efc19d9b700 1 --2- 172.21.15.26:0/595368047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc1c0f6860 0x7efc1c1075f0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 rx=0x7efc0400b410 tx=0x7efc04006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:23:53.175 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.169+0000 7efc12ffd700 1 -- 172.21.15.26:0/595368047 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc040125f0 con 0x7efc1c0f6860 2021-11-03T18:23:53.175 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.169+0000 7efc209b0700 1 -- 172.21.15.26:0/595368047 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc1c1087c0 con 0x7efc1c0f6860 2021-11-03T18:23:53.175 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.169+0000 7efc12ffd700 1 -- 172.21.15.26:0/595368047 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efc0400be30 con 0x7efc1c0f6860 2021-11-03T18:23:53.175 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.169+0000 7efc12ffd700 1 -- 172.21.15.26:0/595368047 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc04002a70 con 0x7efc1c0f6860 2021-11-03T18:23:53.176 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.169+0000 7efc209b0700 1 -- 172.21.15.26:0/595368047 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc1c108d00 con 0x7efc1c0f6860 2021-11-03T18:23:53.176 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.170+0000 7efc209b0700 1 -- 172.21.15.26:0/595368047 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc1c0f49b0 con 0x7efc1c0f6860 2021-11-03T18:23:53.177 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.171+0000 7efc12ffd700 1 -- 172.21.15.26:0/595368047 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7efc0400f030 con 0x7efc1c0f6860 2021-11-03T18:23:53.177 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.171+0000 7efc12ffd700 1 --2- 172.21.15.26:0/595368047 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efc080640b0 0x7efc08066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:23:53.177 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.171+0000 7efc12ffd700 1 -- 172.21.15.26:0/595368047 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7efc04080bf0 con 0x7efc1c0f6860 2021-11-03T18:23:53.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.171+0000 7efc1a59c700 1 --2- 172.21.15.26:0/595368047 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efc080640b0 0x7efc08066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:23:53.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.172+0000 7efc1a59c700 1 --2- 172.21.15.26:0/595368047 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efc080640b0 0x7efc08066570 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7efc1400b730 tx=0x7efc14004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:23:53.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.175+0000 7efc12ffd700 1 -- 172.21.15.26:0/595368047 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7efc04052f50 con 0x7efc1c0f6860 2021-11-03T18:23:53.179 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:52 smithi026 ceph-mon[96795]: pgmap v2676: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:53.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:52 smithi194 ceph-mon[65619]: pgmap v2676: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:53.379 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.380+0000 7efc209b0700 1 -- 172.21.15.26:0/595368047 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7efc1c109340 con 0x7efc1c0f6860 2021-11-03T18:23:53.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.380+0000 7efc12ffd700 1 -- 172.21.15.26:0/595368047 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7efc04052b40 con 0x7efc1c0f6860 2021-11-03T18:23:53.380 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:23:53.380 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:23:53.381 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:23:53.381 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:23:53.381 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:23:53.381 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:23:53.382 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:23:53.382 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:23:53.382 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:23:53.382 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:23:53.383 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:23:53.383 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:23:53.383 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:23:53.383 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:23:53.383 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:23:53.384 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:23:53.384 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:23:53.384 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:23:53.384 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:23:53.384 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:23:53.385 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:23:53.385 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:23:53.385 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:23:53.385 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:23:53.386 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:23:53.386 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:23:53.386 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:23:53.386 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:23:53.386 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:23:53.387 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:23:53.387 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:23:53.387 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:23:53.387 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:23:53.388 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:23:53.388 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:23:53.388 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:23:53.388 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:23:53.388 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:23:53.389 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:23:53.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.382+0000 7efc209b0700 1 -- 172.21.15.26:0/595368047 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efc080640b0 msgr2=0x7efc08066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:23:53.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.382+0000 7efc209b0700 1 --2- 172.21.15.26:0/595368047 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efc080640b0 0x7efc08066570 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7efc1400b730 tx=0x7efc14004d10).stop 2021-11-03T18:23:53.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.382+0000 7efc209b0700 1 -- 172.21.15.26:0/595368047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc1c0f6860 msgr2=0x7efc1c1075f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:23:53.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.382+0000 7efc209b0700 1 --2- 172.21.15.26:0/595368047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc1c0f6860 0x7efc1c1075f0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 rx=0x7efc0400b410 tx=0x7efc04006ef0).stop 2021-11-03T18:23:53.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.382+0000 7efc209b0700 1 -- 172.21.15.26:0/595368047 shutdown_connections 2021-11-03T18:23:53.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.382+0000 7efc209b0700 1 --2- 172.21.15.26:0/595368047 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efc080640b0 0x7efc08066570 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:53.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.382+0000 7efc209b0700 1 --2- 172.21.15.26:0/595368047 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc1c0f55c0 0x7efc1c107100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:53.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.382+0000 7efc209b0700 1 --2- 172.21.15.26:0/595368047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc1c0f6860 0x7efc1c1075f0 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:23:53.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.382+0000 7efc209b0700 1 -- 172.21.15.26:0/595368047 >> 172.21.15.26:0/595368047 conn(0x7efc1c0f0d40 msgr2=0x7efc1c05f620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:23:53.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.382+0000 7efc209b0700 1 -- 172.21.15.26:0/595368047 shutdown_connections 2021-11-03T18:23:53.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:23:53.383+0000 7efc209b0700 1 -- 172.21.15.26:0/595368047 wait complete. 2021-11-03T18:23:53.392 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:23:54.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:53 smithi026 ceph-mon[96795]: from='client.36892 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:23:54.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:53 smithi026 ceph-mon[96795]: from='client.36896 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:23:54.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:53 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2512663213' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:23:54.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:53 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/595368047' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:23:54.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:53 smithi194 ceph-mon[65619]: from='client.36892 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:23:54.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:53 smithi194 ceph-mon[65619]: from='client.36896 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:23:54.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:53 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2512663213' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:23:54.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:53 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/595368047' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:23:55.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:54 smithi026 ceph-mon[96795]: pgmap v2677: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:55.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:54 smithi194 ceph-mon[65619]: pgmap v2677: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:56.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:23:56.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:23:57.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:56 smithi026 ceph-mon[96795]: pgmap v2678: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:57.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:56 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:23:57.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:56 smithi194 ceph-mon[65619]: pgmap v2678: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:57.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:56 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:23:59.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:23:58 smithi026 ceph-mon[96795]: pgmap v2679: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:23:59.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:23:58 smithi194 ceph-mon[65619]: pgmap v2679: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:01.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:00 smithi026 ceph-mon[96795]: pgmap v2680: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:01.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:00 smithi194 ceph-mon[65619]: pgmap v2680: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:03.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:02 smithi026 ceph-mon[96795]: pgmap v2681: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:03.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:02 smithi194 ceph-mon[65619]: pgmap v2681: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:05.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:04 smithi194 ceph-mon[65619]: pgmap v2682: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:05.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:04 smithi026 ceph-mon[96795]: pgmap v2682: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:07.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:06 smithi194 ceph-mon[65619]: pgmap v2683: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:07.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:06 smithi026 ceph-mon[96795]: pgmap v2683: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:09.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:08 smithi194 ceph-mon[65619]: pgmap v2684: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:09.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:08 smithi026 ceph-mon[96795]: pgmap v2684: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:11.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:10 smithi194 ceph-mon[65619]: pgmap v2685: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:11.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:10 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:24:11.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:10 smithi026 ceph-mon[96795]: pgmap v2685: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:11.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:10 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:24:12.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:11 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:24:12.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:11 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:24:13.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:12 smithi194 ceph-mon[65619]: pgmap v2686: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:13.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:12 smithi026 ceph-mon[96795]: pgmap v2686: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:15.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:14 smithi194 ceph-mon[65619]: pgmap v2687: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:15.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:14 smithi026 ceph-mon[96795]: pgmap v2687: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:17.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:16 smithi194 ceph-mon[65619]: pgmap v2688: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:17.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:16 smithi026 ceph-mon[96795]: pgmap v2688: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:19.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:18 smithi194 ceph-mon[65619]: pgmap v2689: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:19.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:18 smithi026 ceph-mon[96795]: pgmap v2689: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:21.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:20 smithi194 ceph-mon[65619]: pgmap v2690: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:21.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:20 smithi026 ceph-mon[96795]: pgmap v2690: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:23.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:22 smithi194 ceph-mon[65619]: pgmap v2691: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:23.499 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:22 smithi026 ceph-mon[96795]: pgmap v2691: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:23.502 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.497+0000 7fc602059700 1 -- 172.21.15.26:0/1443228007 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5fc0f6530 msgr2=0x7fc5fc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:24:23.502 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.497+0000 7fc602059700 1 --2- 172.21.15.26:0/1443228007 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5fc0f6530 0x7fc5fc0f6950 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 rx=0x7fc5f8004660 tx=0x7fc5f8009b30).stop 2021-11-03T18:24:23.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.497+0000 7fc602059700 1 -- 172.21.15.26:0/1443228007 shutdown_connections 2021-11-03T18:24:23.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.498+0000 7fc602059700 1 --2- 172.21.15.26:0/1443228007 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5fc0f77d0 0x7fc5fc0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:23.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.498+0000 7fc602059700 1 --2- 172.21.15.26:0/1443228007 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5fc0f6530 0x7fc5fc0f6950 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:23.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.498+0000 7fc602059700 1 -- 172.21.15.26:0/1443228007 >> 172.21.15.26:0/1443228007 conn(0x7fc5fc0f1cd0 msgr2=0x7fc5fc0f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:24:23.504 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.498+0000 7fc602059700 1 -- 172.21.15.26:0/1443228007 shutdown_connections 2021-11-03T18:24:23.504 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.498+0000 7fc602059700 1 -- 172.21.15.26:0/1443228007 wait complete. 2021-11-03T18:24:23.504 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.498+0000 7fc602059700 1 Processor -- start 2021-11-03T18:24:23.504 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.498+0000 7fc602059700 1 -- start start 2021-11-03T18:24:23.505 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.498+0000 7fc602059700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5fc0f6530 0x7fc5fc106db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:24:23.505 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.498+0000 7fc602059700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5fc0f77d0 0x7fc5fc1072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:24:23.505 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.498+0000 7fc602059700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc1078a0 con 0x7fc5fc0f6530 2021-11-03T18:24:23.505 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.498+0000 7fc602059700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc1080e0 con 0x7fc5fc0f77d0 2021-11-03T18:24:23.505 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.499+0000 7fc601057700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5fc0f6530 0x7fc5fc106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:24:23.506 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.499+0000 7fc601057700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5fc0f6530 0x7fc5fc106db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59822/0 (socket says 172.21.15.26:59822) 2021-11-03T18:24:23.506 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.499+0000 7fc601057700 1 -- 172.21.15.26:0/1447570299 learned_addr learned my addr 172.21.15.26:0/1447570299 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:24:23.506 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.499+0000 7fc601057700 1 -- 172.21.15.26:0/1447570299 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5fc0f77d0 msgr2=0x7fc5fc1072a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:24:23.506 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.499+0000 7fc601057700 1 --2- 172.21.15.26:0/1447570299 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5fc0f77d0 0x7fc5fc1072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:24:23.507 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.499+0000 7fc601057700 1 -- 172.21.15.26:0/1447570299 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f8005040 con 0x7fc5fc0f6530 2021-11-03T18:24:23.507 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.499+0000 7fc601057700 1 --2- 172.21.15.26:0/1447570299 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5fc0f6530 0x7fc5fc106db0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7fc5f8013a70 tx=0x7fc5f8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:24:23.507 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.499+0000 7fc5f1ffb700 1 -- 172.21.15.26:0/1447570299 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5f8018070 con 0x7fc5fc0f6530 2021-11-03T18:24:23.507 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.499+0000 7fc5f1ffb700 1 -- 172.21.15.26:0/1447570299 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc5f80097d0 con 0x7fc5fc0f6530 2021-11-03T18:24:23.508 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.499+0000 7fc602059700 1 -- 172.21.15.26:0/1447570299 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5fc108360 con 0x7fc5fc0f6530 2021-11-03T18:24:23.508 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.499+0000 7fc5f1ffb700 1 -- 172.21.15.26:0/1447570299 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5f801c3c0 con 0x7fc5fc0f6530 2021-11-03T18:24:23.508 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.500+0000 7fc602059700 1 -- 172.21.15.26:0/1447570299 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5fc108840 con 0x7fc5fc0f6530 2021-11-03T18:24:23.508 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.501+0000 7fc602059700 1 -- 172.21.15.26:0/1447570299 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5fc059100 con 0x7fc5fc0f6530 2021-11-03T18:24:23.508 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.501+0000 7fc5f1ffb700 1 -- 172.21.15.26:0/1447570299 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc5f8007ba0 con 0x7fc5fc0f6530 2021-11-03T18:24:23.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.501+0000 7fc5f1ffb700 1 --2- 172.21.15.26:0/1447570299 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc5e8064100 0x7fc5e80665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:24:23.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.501+0000 7fc5f1ffb700 1 -- 172.21.15.26:0/1447570299 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc5f80823a0 con 0x7fc5fc0f6530 2021-11-03T18:24:23.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.502+0000 7fc600856700 1 --2- 172.21.15.26:0/1447570299 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc5e8064100 0x7fc5e80665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:24:23.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.502+0000 7fc600856700 1 --2- 172.21.15.26:0/1447570299 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc5e8064100 0x7fc5e80665c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7fc5fc106b40 tx=0x7fc5ec0099e0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:24:23.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.506+0000 7fc5f1ffb700 1 -- 172.21.15.26:0/1447570299 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc5f80547c0 con 0x7fc5fc0f6530 2021-11-03T18:24:23.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.683+0000 7fc602059700 1 -- 172.21.15.26:0/1447570299 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5fc0fee20 con 0x7fc5e8064100 2021-11-03T18:24:23.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.685+0000 7fc5f1ffb700 1 -- 172.21.15.26:0/1447570299 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fc5fc0fee20 con 0x7fc5e8064100 2021-11-03T18:24:23.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.686+0000 7fc602059700 1 -- 172.21.15.26:0/1447570299 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc5e8064100 msgr2=0x7fc5e80665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:24:23.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.686+0000 7fc602059700 1 --2- 172.21.15.26:0/1447570299 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc5e8064100 0x7fc5e80665c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7fc5fc106b40 tx=0x7fc5ec0099e0).stop 2021-11-03T18:24:23.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.686+0000 7fc602059700 1 -- 172.21.15.26:0/1447570299 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5fc0f6530 msgr2=0x7fc5fc106db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:24:23.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.686+0000 7fc602059700 1 --2- 172.21.15.26:0/1447570299 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5fc0f6530 0x7fc5fc106db0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7fc5f8013a70 tx=0x7fc5f8009b30).stop 2021-11-03T18:24:23.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.686+0000 7fc602059700 1 -- 172.21.15.26:0/1447570299 shutdown_connections 2021-11-03T18:24:23.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.686+0000 7fc602059700 1 --2- 172.21.15.26:0/1447570299 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc5e8064100 0x7fc5e80665c0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:23.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.686+0000 7fc602059700 1 --2- 172.21.15.26:0/1447570299 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5fc0f6530 0x7fc5fc106db0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:23.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.686+0000 7fc602059700 1 --2- 172.21.15.26:0/1447570299 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5fc0f77d0 0x7fc5fc1072a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:24:23.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.686+0000 7fc602059700 1 -- 172.21.15.26:0/1447570299 >> 172.21.15.26:0/1447570299 conn(0x7fc5fc0f1cd0 msgr2=0x7fc5fc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:24:23.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.687+0000 7fc602059700 1 -- 172.21.15.26:0/1447570299 shutdown_connections 2021-11-03T18:24:23.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.687+0000 7fc602059700 1 -- 172.21.15.26:0/1447570299 wait complete. 2021-11-03T18:24:23.694 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:24:23.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.787+0000 7f268a97a700 1 -- 172.21.15.26:0/1076396231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26840f77d0 msgr2=0x7f26840f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:24:23.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.787+0000 7f268a97a700 1 --2- 172.21.15.26:0/1076396231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26840f77d0 0x7f26840f7c30 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 rx=0x7f2680004660 tx=0x7f2680009b30).stop 2021-11-03T18:24:23.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.787+0000 7f268a97a700 1 -- 172.21.15.26:0/1076396231 shutdown_connections 2021-11-03T18:24:23.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.787+0000 7f268a97a700 1 --2- 172.21.15.26:0/1076396231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26840f77d0 0x7f26840f7c30 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:23.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.787+0000 7f268a97a700 1 --2- 172.21.15.26:0/1076396231 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26840f6530 0x7f26840f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:23.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.787+0000 7f268a97a700 1 -- 172.21.15.26:0/1076396231 >> 172.21.15.26:0/1076396231 conn(0x7f26840f1cd0 msgr2=0x7f26840f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:24:23.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.787+0000 7f268a97a700 1 -- 172.21.15.26:0/1076396231 shutdown_connections 2021-11-03T18:24:23.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.787+0000 7f268a97a700 1 -- 172.21.15.26:0/1076396231 wait complete. 2021-11-03T18:24:23.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.788+0000 7f268a97a700 1 Processor -- start 2021-11-03T18:24:23.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.788+0000 7f268a97a700 1 -- start start 2021-11-03T18:24:23.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.788+0000 7f268a97a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26840f6530 0x7f268406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:24:23.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.788+0000 7f268a97a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26840f77d0 0x7f2684069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:24:23.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.788+0000 7f268a97a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268406a380 con 0x7f26840f6530 2021-11-03T18:24:23.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.788+0000 7f268a97a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268406a4c0 con 0x7f26840f77d0 2021-11-03T18:24:23.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.788+0000 7f2689978700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26840f6530 0x7f268406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:24:23.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.788+0000 7f2689978700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26840f6530 0x7f268406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59832/0 (socket says 172.21.15.26:59832) 2021-11-03T18:24:23.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.788+0000 7f2689978700 1 -- 172.21.15.26:0/3484541058 learned_addr learned my addr 172.21.15.26:0/3484541058 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:24:23.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.788+0000 7f2689177700 1 --2- 172.21.15.26:0/3484541058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26840f77d0 0x7f2684069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:24:23.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.788+0000 7f2689978700 1 -- 172.21.15.26:0/3484541058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26840f77d0 msgr2=0x7f2684069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:24:23.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.788+0000 7f2689978700 1 --2- 172.21.15.26:0/3484541058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26840f77d0 0x7f2684069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:23.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.788+0000 7f2689978700 1 -- 172.21.15.26:0/3484541058 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2680005040 con 0x7f26840f6530 2021-11-03T18:24:23.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.789+0000 7f2689177700 1 --2- 172.21.15.26:0/3484541058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26840f77d0 0x7f2684069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:24:23.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.789+0000 7f2689978700 1 --2- 172.21.15.26:0/3484541058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26840f6530 0x7f268406b9a0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7f2678002700 tx=0x7f2678009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:24:23.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.789+0000 7f26767fc700 1 -- 172.21.15.26:0/3484541058 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2678009320 con 0x7f26840f6530 2021-11-03T18:24:23.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.789+0000 7f26767fc700 1 -- 172.21.15.26:0/3484541058 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f267800f040 con 0x7f26840f6530 2021-11-03T18:24:23.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.789+0000 7f26767fc700 1 -- 172.21.15.26:0/3484541058 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2678014900 con 0x7f26840f6530 2021-11-03T18:24:23.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.789+0000 7f268a97a700 1 -- 172.21.15.26:0/3484541058 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f268406a7a0 con 0x7f26840f6530 2021-11-03T18:24:23.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.789+0000 7f268a97a700 1 -- 172.21.15.26:0/3484541058 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f268410ed40 con 0x7f26840f6530 2021-11-03T18:24:23.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.790+0000 7f268a97a700 1 -- 172.21.15.26:0/3484541058 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2684045ad0 con 0x7f26840f6530 2021-11-03T18:24:23.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.790+0000 7f26767fc700 1 -- 172.21.15.26:0/3484541058 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f2678009480 con 0x7f26840f6530 2021-11-03T18:24:23.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.791+0000 7f26767fc700 1 --2- 172.21.15.26:0/3484541058 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2670064100 0x7f26700665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:24:23.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.791+0000 7f26767fc700 1 -- 172.21.15.26:0/3484541058 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f2678080a50 con 0x7f26840f6530 2021-11-03T18:24:23.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.791+0000 7f2689177700 1 --2- 172.21.15.26:0/3484541058 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2670064100 0x7f26700665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:24:23.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.791+0000 7f2689177700 1 --2- 172.21.15.26:0/3484541058 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2670064100 0x7f26700665c0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7f2680009da0 tx=0x7f2680009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:24:23.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.795+0000 7f26767fc700 1 -- 172.21.15.26:0/3484541058 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f2678052db0 con 0x7f26840f6530 2021-11-03T18:24:23.965 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.967+0000 7f268a97a700 1 -- 172.21.15.26:0/3484541058 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2684057f10 con 0x7f2670064100 2021-11-03T18:24:23.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.982+0000 7f26767fc700 1 -- 172.21.15.26:0/3484541058 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f2684057f10 con 0x7f2670064100 2021-11-03T18:24:23.980 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:24:23.980 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (95m) 4m ago 96m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:24:23.981 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (87m) 4m ago 96m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:24:23.981 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (87m) 3m ago 96m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:24:23.981 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (95m) 4m ago 96m 42.2M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:24:23.981 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (88m) 4m ago 92m 26.0M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:24:23.982 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (88m) 4m ago 91m 26.6M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:24:23.982 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (92m) 3m ago 92m 26.8M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:24:23.982 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (91m) 3m ago 91m 27.2M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:24:23.982 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (89m) 4m ago 98m 588M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:24:23.982 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (88m) 3m ago 96m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:24:23.983 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (88m) 4m ago 98m 341M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:24:23.983 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (88m) 3m ago 95m 158M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:24:23.983 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (96m) 4m ago 96m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:24:23.983 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (95m) 3m ago 95m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:24:23.984 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (87m) 4m ago 95m 332M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:24:23.984 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (86m) 4m ago 94m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:24:23.984 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (86m) 4m ago 94m 296M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:24:23.984 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (85m) 3m ago 94m 387M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:24:23.984 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (85m) 3m ago 93m 320M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:24:23.985 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (85m) 3m ago 93m 316M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:24:23.985 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (95m) 4m ago 96m 65.7M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:24:23.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.984+0000 7f268a97a700 1 -- 172.21.15.26:0/3484541058 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2670064100 msgr2=0x7f26700665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:24:23.986 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.984+0000 7f268a97a700 1 --2- 172.21.15.26:0/3484541058 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2670064100 0x7f26700665c0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7f2680009da0 tx=0x7f2680009b30).stop 2021-11-03T18:24:23.986 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.984+0000 7f268a97a700 1 -- 172.21.15.26:0/3484541058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26840f6530 msgr2=0x7f268406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:24:23.986 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.984+0000 7f268a97a700 1 --2- 172.21.15.26:0/3484541058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26840f6530 0x7f268406b9a0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7f2678002700 tx=0x7f2678009d80).stop 2021-11-03T18:24:23.986 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.984+0000 7f268a97a700 1 -- 172.21.15.26:0/3484541058 shutdown_connections 2021-11-03T18:24:23.987 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.984+0000 7f268a97a700 1 --2- 172.21.15.26:0/3484541058 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2670064100 0x7f26700665c0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:23.987 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.984+0000 7f268a97a700 1 --2- 172.21.15.26:0/3484541058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26840f6530 0x7f268406b9a0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:23.987 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.984+0000 7f268a97a700 1 --2- 172.21.15.26:0/3484541058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26840f77d0 0x7f2684069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:23.987 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.984+0000 7f268a97a700 1 -- 172.21.15.26:0/3484541058 >> 172.21.15.26:0/3484541058 conn(0x7f26840f1cd0 msgr2=0x7f26840fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:24:23.987 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.984+0000 7f268a97a700 1 -- 172.21.15.26:0/3484541058 shutdown_connections 2021-11-03T18:24:23.988 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:23.984+0000 7f268a97a700 1 -- 172.21.15.26:0/3484541058 wait complete. 2021-11-03T18:24:24.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.083+0000 7f54cccb8700 1 -- 172.21.15.26:0/3101501970 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54c80f5ed0 msgr2=0x7f54c80f6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:24:24.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.083+0000 7f54cccb8700 1 --2- 172.21.15.26:0/3101501970 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54c80f5ed0 0x7f54c80f6900 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 rx=0x7f54bc004660 tx=0x7f54bc009b30).stop 2021-11-03T18:24:24.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.084+0000 7f54cccb8700 1 -- 172.21.15.26:0/3101501970 shutdown_connections 2021-11-03T18:24:24.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.084+0000 7f54cccb8700 1 --2- 172.21.15.26:0/3101501970 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54c80f5ed0 0x7f54c80f6900 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:24.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.084+0000 7f54cccb8700 1 --2- 172.21.15.26:0/3101501970 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54c80f55c0 0x7f54c80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:24.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.084+0000 7f54cccb8700 1 -- 172.21.15.26:0/3101501970 >> 172.21.15.26:0/3101501970 conn(0x7f54c80f0de0 msgr2=0x7f54c80f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:24:24.085 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.084+0000 7f54cccb8700 1 -- 172.21.15.26:0/3101501970 shutdown_connections 2021-11-03T18:24:24.085 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.084+0000 7f54cccb8700 1 -- 172.21.15.26:0/3101501970 wait complete. 2021-11-03T18:24:24.085 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.084+0000 7f54cccb8700 1 Processor -- start 2021-11-03T18:24:24.085 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.084+0000 7f54cccb8700 1 -- start start 2021-11-03T18:24:24.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.084+0000 7f54cccb8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54c80f55c0 0x7f54c8105e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:24:24.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.084+0000 7f54cccb8700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54c80f5ed0 0x7f54c8106330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:24:24.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.084+0000 7f54cccb8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c8106930 con 0x7f54c80f55c0 2021-11-03T18:24:24.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.084+0000 7f54cccb8700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c8107140 con 0x7f54c80f5ed0 2021-11-03T18:24:24.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.084+0000 7f54c659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54c80f55c0 0x7f54c8105e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:24:24.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.084+0000 7f54c659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54c80f55c0 0x7f54c8105e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59842/0 (socket says 172.21.15.26:59842) 2021-11-03T18:24:24.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.084+0000 7f54c659c700 1 -- 172.21.15.26:0/2760671192 learned_addr learned my addr 172.21.15.26:0/2760671192 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:24:24.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.085+0000 7f54c5d9b700 1 --2- 172.21.15.26:0/2760671192 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54c80f5ed0 0x7f54c8106330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:24:24.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.085+0000 7f54c659c700 1 -- 172.21.15.26:0/2760671192 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54c80f5ed0 msgr2=0x7f54c8106330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:24:24.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.085+0000 7f54c659c700 1 --2- 172.21.15.26:0/2760671192 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54c80f5ed0 0x7f54c8106330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:24.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.085+0000 7f54c659c700 1 -- 172.21.15.26:0/2760671192 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54bc005040 con 0x7f54c80f55c0 2021-11-03T18:24:24.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.085+0000 7f54c5d9b700 1 --2- 172.21.15.26:0/2760671192 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54c80f5ed0 0x7f54c8106330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:24:24.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.085+0000 7f54c659c700 1 --2- 172.21.15.26:0/2760671192 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54c80f55c0 0x7f54c8105e40 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7f54b8010a00 tx=0x7f54b800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:24:24.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.085+0000 7f54b6ffd700 1 -- 172.21.15.26:0/2760671192 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54b80094c0 con 0x7f54c80f55c0 2021-11-03T18:24:24.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.085+0000 7f54b6ffd700 1 -- 172.21.15.26:0/2760671192 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f54b8009620 con 0x7f54c80f55c0 2021-11-03T18:24:24.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.085+0000 7f54cccb8700 1 -- 172.21.15.26:0/2760671192 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c8107360 con 0x7f54c80f55c0 2021-11-03T18:24:24.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.085+0000 7f54b6ffd700 1 -- 172.21.15.26:0/2760671192 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54b8007e50 con 0x7f54c80f55c0 2021-11-03T18:24:24.090 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.085+0000 7f54cccb8700 1 -- 172.21.15.26:0/2760671192 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c81078f0 con 0x7f54c80f55c0 2021-11-03T18:24:24.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.086+0000 7f54cccb8700 1 -- 172.21.15.26:0/2760671192 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54c80f4a50 con 0x7f54c80f55c0 2021-11-03T18:24:24.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.086+0000 7f54b6ffd700 1 -- 172.21.15.26:0/2760671192 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f54b8022070 con 0x7f54c80f55c0 2021-11-03T18:24:24.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.087+0000 7f54b6ffd700 1 --2- 172.21.15.26:0/2760671192 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f54b00640b0 0x7f54b0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:24:24.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.087+0000 7f54b6ffd700 1 -- 172.21.15.26:0/2760671192 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f54b80831b0 con 0x7f54c80f55c0 2021-11-03T18:24:24.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.087+0000 7f54c5d9b700 1 --2- 172.21.15.26:0/2760671192 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f54b00640b0 0x7f54b0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:24:24.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.087+0000 7f54c5d9b700 1 --2- 172.21.15.26:0/2760671192 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f54b00640b0 0x7f54b0066570 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7f54bc0043d0 tx=0x7f54bc00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:24:24.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.091+0000 7f54b6ffd700 1 -- 172.21.15.26:0/2760671192 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f54b8055420 con 0x7f54c80f55c0 2021-11-03T18:24:24.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.321+0000 7f54cccb8700 1 -- 172.21.15.26:0/2760671192 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f54c80ff7c0 con 0x7f54c80f55c0 2021-11-03T18:24:24.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.322+0000 7f54b6ffd700 1 -- 172.21.15.26:0/2760671192 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f54b8055010 con 0x7f54c80f55c0 2021-11-03T18:24:24.321 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:24:24.321 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:24:24.321 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:24:24.321 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:24:24.322 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:24:24.322 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:24:24.322 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:24:24.322 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:24:24.322 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:24:24.323 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:24:24.323 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:24:24.323 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:24:24.323 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:24:24.324 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:24:24.324 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:24:24.324 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:24:24.324 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:24:24.324 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:24:24.325 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.324+0000 7f54cccb8700 1 -- 172.21.15.26:0/2760671192 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f54b00640b0 msgr2=0x7f54b0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:24:24.326 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.324+0000 7f54cccb8700 1 --2- 172.21.15.26:0/2760671192 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f54b00640b0 0x7f54b0066570 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7f54bc0043d0 tx=0x7f54bc00b040).stop 2021-11-03T18:24:24.326 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.324+0000 7f54cccb8700 1 -- 172.21.15.26:0/2760671192 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54c80f55c0 msgr2=0x7f54c8105e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:24:24.326 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.324+0000 7f54cccb8700 1 --2- 172.21.15.26:0/2760671192 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54c80f55c0 0x7f54c8105e40 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7f54b8010a00 tx=0x7f54b800b040).stop 2021-11-03T18:24:24.326 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.324+0000 7f54cccb8700 1 -- 172.21.15.26:0/2760671192 shutdown_connections 2021-11-03T18:24:24.327 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.324+0000 7f54cccb8700 1 --2- 172.21.15.26:0/2760671192 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f54b00640b0 0x7f54b0066570 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:24.327 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.324+0000 7f54cccb8700 1 --2- 172.21.15.26:0/2760671192 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54c80f55c0 0x7f54c8105e40 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:24.327 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.324+0000 7f54cccb8700 1 --2- 172.21.15.26:0/2760671192 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54c80f5ed0 0x7f54c8106330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:24.327 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.324+0000 7f54cccb8700 1 -- 172.21.15.26:0/2760671192 >> 172.21.15.26:0/2760671192 conn(0x7f54c80f0de0 msgr2=0x7f54c80fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:24:24.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.324+0000 7f54cccb8700 1 -- 172.21.15.26:0/2760671192 shutdown_connections 2021-11-03T18:24:24.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.324+0000 7f54cccb8700 1 -- 172.21.15.26:0/2760671192 wait complete. 2021-11-03T18:24:24.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.424+0000 7fde6cf4b700 1 -- 172.21.15.26:0/3407944192 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde680f6860 msgr2=0x7fde680f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:24:24.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.424+0000 7fde6cf4b700 1 --2- 172.21.15.26:0/3407944192 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde680f6860 0x7fde680f6cc0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 rx=0x7fde50004660 tx=0x7fde50009b30).stop 2021-11-03T18:24:24.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.424+0000 7fde6cf4b700 1 -- 172.21.15.26:0/3407944192 shutdown_connections 2021-11-03T18:24:24.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.424+0000 7fde6cf4b700 1 --2- 172.21.15.26:0/3407944192 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde680f6860 0x7fde680f6cc0 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:24.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.424+0000 7fde6cf4b700 1 --2- 172.21.15.26:0/3407944192 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde680f55c0 0x7fde680f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:24:24.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.424+0000 7fde6cf4b700 1 -- 172.21.15.26:0/3407944192 >> 172.21.15.26:0/3407944192 conn(0x7fde680f0d40 msgr2=0x7fde680f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:24:24.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.424+0000 7fde6cf4b700 1 -- 172.21.15.26:0/3407944192 shutdown_connections 2021-11-03T18:24:24.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.424+0000 7fde6cf4b700 1 -- 172.21.15.26:0/3407944192 wait complete. 2021-11-03T18:24:24.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.424+0000 7fde6cf4b700 1 Processor -- start 2021-11-03T18:24:24.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.424+0000 7fde6cf4b700 1 -- start start 2021-11-03T18:24:24.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.425+0000 7fde6cf4b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde680f55c0 0x7fde68109cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:24:24.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.425+0000 7fde6cf4b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde680f6860 0x7fde6810c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:24:24.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.425+0000 7fde6cf4b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde68060450 con 0x7fde680f55c0 2021-11-03T18:24:24.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.425+0000 7fde6cf4b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde68060590 con 0x7fde680f6860 2021-11-03T18:24:24.428 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.425+0000 7fde6659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde680f55c0 0x7fde68109cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:24:24.428 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.425+0000 7fde6659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde680f55c0 0x7fde68109cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59852/0 (socket says 172.21.15.26:59852) 2021-11-03T18:24:24.428 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.425+0000 7fde6659c700 1 -- 172.21.15.26:0/1900034144 learned_addr learned my addr 172.21.15.26:0/1900034144 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:24:24.428 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.425+0000 7fde5ffff700 1 --2- 172.21.15.26:0/1900034144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde680f6860 0x7fde6810c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:24:24.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.425+0000 7fde6659c700 1 -- 172.21.15.26:0/1900034144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde680f6860 msgr2=0x7fde6810c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:24:24.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.425+0000 7fde6659c700 1 --2- 172.21.15.26:0/1900034144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde680f6860 0x7fde6810c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:24.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.425+0000 7fde6659c700 1 -- 172.21.15.26:0/1900034144 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde50005040 con 0x7fde680f55c0 2021-11-03T18:24:24.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.425+0000 7fde6659c700 1 --2- 172.21.15.26:0/1900034144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde680f55c0 0x7fde68109cd0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 rx=0x7fde580093f0 tx=0x7fde58006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:24:24.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.425+0000 7fde5effd700 1 -- 172.21.15.26:0/1900034144 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde58013640 con 0x7fde680f55c0 2021-11-03T18:24:24.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.425+0000 7fde5effd700 1 -- 172.21.15.26:0/1900034144 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fde58009e40 con 0x7fde680f55c0 2021-11-03T18:24:24.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.425+0000 7fde6cf4b700 1 -- 172.21.15.26:0/1900034144 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde6810c7e0 con 0x7fde680f55c0 2021-11-03T18:24:24.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.425+0000 7fde5effd700 1 -- 172.21.15.26:0/1900034144 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde5800dbf0 con 0x7fde680f55c0 2021-11-03T18:24:24.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.425+0000 7fde6cf4b700 1 -- 172.21.15.26:0/1900034144 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde6810cda0 con 0x7fde680f55c0 2021-11-03T18:24:24.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.426+0000 7fde6cf4b700 1 -- 172.21.15.26:0/1900034144 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde68045ad0 con 0x7fde680f55c0 2021-11-03T18:24:24.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.427+0000 7fde5effd700 1 -- 172.21.15.26:0/1900034144 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fde5801a060 con 0x7fde680f55c0 2021-11-03T18:24:24.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.427+0000 7fde5effd700 1 --2- 172.21.15.26:0/1900034144 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fde540640b0 0x7fde54066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:24:24.432 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.427+0000 7fde5effd700 1 -- 172.21.15.26:0/1900034144 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fde58080920 con 0x7fde680f55c0 2021-11-03T18:24:24.432 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.427+0000 7fde5ffff700 1 --2- 172.21.15.26:0/1900034144 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fde540640b0 0x7fde54066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:24:24.432 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.428+0000 7fde5ffff700 1 --2- 172.21.15.26:0/1900034144 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fde540640b0 0x7fde54066570 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7fde50004e30 tx=0x7fde50009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:24:24.433 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.431+0000 7fde5effd700 1 -- 172.21.15.26:0/1900034144 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fde58052b10 con 0x7fde680f55c0 2021-11-03T18:24:24.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.635+0000 7fde6cf4b700 1 -- 172.21.15.26:0/1900034144 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fde68027a00 con 0x7fde680f55c0 2021-11-03T18:24:24.634 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.636+0000 7fde5effd700 1 -- 172.21.15.26:0/1900034144 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fde58018710 con 0x7fde680f55c0 2021-11-03T18:24:24.634 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:24:24.635 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:24:24.635 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:24:24.635 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:24:24.636 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:24:24.636 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:24:24.636 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:24:24.636 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:24:24.636 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:24:24.637 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:24:24.637 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:24:24.637 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:24:24.637 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:24:24.638 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:24:24.638 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:24:24.638 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:24:24.638 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:24:24.639 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:24:24.639 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:24:24.639 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:24:24.639 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:24:24.640 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:24:24.640 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:24:24.640 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:24:24.640 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:24:24.641 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:24:24.641 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:24:24.641 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:24:24.641 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:24:24.641 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:24:24.642 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:24:24.642 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:24:24.642 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:24:24.642 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:24:24.643 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:24:24.643 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:24:24.643 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:24:24.643 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:24:24.643 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:24:24.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.637+0000 7fde6cf4b700 1 -- 172.21.15.26:0/1900034144 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fde540640b0 msgr2=0x7fde54066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:24:24.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.637+0000 7fde6cf4b700 1 --2- 172.21.15.26:0/1900034144 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fde540640b0 0x7fde54066570 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7fde50004e30 tx=0x7fde50009b30).stop 2021-11-03T18:24:24.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.637+0000 7fde6cf4b700 1 -- 172.21.15.26:0/1900034144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde680f55c0 msgr2=0x7fde68109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:24:24.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.637+0000 7fde6cf4b700 1 --2- 172.21.15.26:0/1900034144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde680f55c0 0x7fde68109cd0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 rx=0x7fde580093f0 tx=0x7fde58006ec0).stop 2021-11-03T18:24:24.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.638+0000 7fde6cf4b700 1 -- 172.21.15.26:0/1900034144 shutdown_connections 2021-11-03T18:24:24.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.638+0000 7fde6cf4b700 1 --2- 172.21.15.26:0/1900034144 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fde540640b0 0x7fde54066570 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:24.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.638+0000 7fde6cf4b700 1 --2- 172.21.15.26:0/1900034144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde680f55c0 0x7fde68109cd0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:24.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.638+0000 7fde6cf4b700 1 --2- 172.21.15.26:0/1900034144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde680f6860 0x7fde6810c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:24.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.638+0000 7fde6cf4b700 1 -- 172.21.15.26:0/1900034144 >> 172.21.15.26:0/1900034144 conn(0x7fde680f0d40 msgr2=0x7fde680fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:24:24.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.638+0000 7fde6cf4b700 1 -- 172.21.15.26:0/1900034144 shutdown_connections 2021-11-03T18:24:24.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:24.638+0000 7fde6cf4b700 1 -- 172.21.15.26:0/1900034144 wait complete. 2021-11-03T18:24:24.647 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:24:25.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:24 smithi194 ceph-mon[65619]: from='client.36908 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:24:25.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:24 smithi194 ceph-mon[65619]: pgmap v2692: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:25.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:24 smithi194 ceph-mon[65619]: from='client.36912 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:24:25.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:24 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2760671192' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:24:25.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:24 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1900034144' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:24:25.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:24 smithi026 ceph-mon[96795]: from='client.36908 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:24:25.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:24 smithi026 ceph-mon[96795]: pgmap v2692: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:25.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:24 smithi026 ceph-mon[96795]: from='client.36912 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:24:25.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:24 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2760671192' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:24:25.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:24 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1900034144' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:24:26.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:24:26.215 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:24:27.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:26 smithi194 ceph-mon[65619]: pgmap v2693: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:27.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:26 smithi194 ceph-mon[65619]: poll took 60081.452 ms: 1 events 2021-11-03T18:24:27.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:26 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:24:27.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:26 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:24:27.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:26 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:24:27.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:26 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:24:27.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:26 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:24:27.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:26 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:24:27.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:26 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:24:27.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:26 smithi026 ceph-mon[96795]: pgmap v2693: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:27.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:26 smithi026 ceph-mon[96795]: poll took 60081.452 ms: 1 events 2021-11-03T18:24:27.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:26 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:24:27.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:26 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:24:27.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:26 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:24:27.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:26 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:24:27.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:26 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:24:27.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:26 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:24:27.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:26 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:24:28.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:27 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:24:28.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:27 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:24:28.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:27 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:24:28.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:27 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:24:29.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:28 smithi194 ceph-mon[65619]: pgmap v2694: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:29.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:28 smithi026 ceph-mon[96795]: pgmap v2694: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:31.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:30 smithi194 ceph-mon[65619]: pgmap v2695: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:31.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:30 smithi026 ceph-mon[96795]: pgmap v2695: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:33.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:32 smithi194 ceph-mon[65619]: pgmap v2696: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:33.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:32 smithi026 ceph-mon[96795]: pgmap v2696: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:35.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:34 smithi194 ceph-mon[65619]: pgmap v2697: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:35.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:34 smithi026 ceph-mon[96795]: pgmap v2697: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:37.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:36 smithi194 ceph-mon[65619]: pgmap v2698: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:37.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:36 smithi026 ceph-mon[96795]: pgmap v2698: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:39.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:38 smithi194 ceph-mon[65619]: pgmap v2699: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:39.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:38 smithi026 ceph-mon[96795]: pgmap v2699: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:41.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:40 smithi194 ceph-mon[65619]: pgmap v2700: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:41.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:40 smithi026 ceph-mon[96795]: pgmap v2700: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:42.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:24:42.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:24:43.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:42 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:24:43.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:42 smithi194 ceph-mon[65619]: pgmap v2701: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:43.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:42 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:24:43.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:42 smithi026 ceph-mon[96795]: pgmap v2701: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:45.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:44 smithi194 ceph-mon[65619]: pgmap v2702: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:45.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:44 smithi026 ceph-mon[96795]: pgmap v2702: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:47.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:47 smithi194 ceph-mon[65619]: pgmap v2703: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:47.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:47 smithi026 ceph-mon[96795]: pgmap v2703: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:49 smithi026 ceph-mon[96795]: pgmap v2704: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:49.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:24:49.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:24:49.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:49 smithi194 ceph-mon[65619]: pgmap v2704: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:24:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:24:51.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:51 smithi026 ceph-mon[96795]: pgmap v2705: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:51.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:51 smithi194 ceph-mon[65619]: pgmap v2705: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:53.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:53 smithi026 ceph-mon[96795]: pgmap v2706: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:53.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:53 smithi194 ceph-mon[65619]: pgmap v2706: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:54.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.751+0000 7fc55e8ac700 1 -- 172.21.15.26:0/3657466543 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5580f6ff0 msgr2=0x7fc5580f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:24:54.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.751+0000 7fc55e8ac700 1 --2- 172.21.15.26:0/3657466543 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5580f6ff0 0x7fc5580f7a20 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 rx=0x7fc548004660 tx=0x7fc548009b30).stop 2021-11-03T18:24:54.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.751+0000 7fc55e8ac700 1 -- 172.21.15.26:0/3657466543 shutdown_connections 2021-11-03T18:24:54.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.751+0000 7fc55e8ac700 1 --2- 172.21.15.26:0/3657466543 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5580f6ff0 0x7fc5580f7a20 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:54.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.751+0000 7fc55e8ac700 1 --2- 172.21.15.26:0/3657466543 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5580f66e0 0x7fc5580f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:54.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.751+0000 7fc55e8ac700 1 -- 172.21.15.26:0/3657466543 >> 172.21.15.26:0/3657466543 conn(0x7fc5580f1f00 msgr2=0x7fc5580f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:24:54.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.751+0000 7fc55e8ac700 1 -- 172.21.15.26:0/3657466543 shutdown_connections 2021-11-03T18:24:54.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.751+0000 7fc55e8ac700 1 -- 172.21.15.26:0/3657466543 wait complete. 2021-11-03T18:24:54.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.752+0000 7fc55e8ac700 1 Processor -- start 2021-11-03T18:24:54.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.752+0000 7fc55e8ac700 1 -- start start 2021-11-03T18:24:54.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.752+0000 7fc55e8ac700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5580f66e0 0x7fc558106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:24:54.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.752+0000 7fc55e8ac700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5580f6ff0 0x7fc558107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:24:54.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.752+0000 7fc55e8ac700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc558107a10 con 0x7fc5580f6ff0 2021-11-03T18:24:54.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.752+0000 7fc55e8ac700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc558107b50 con 0x7fc5580f66e0 2021-11-03T18:24:54.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.752+0000 7fc5577fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5580f6ff0 0x7fc558107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:24:54.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.752+0000 7fc5577fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5580f6ff0 0x7fc558107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59872/0 (socket says 172.21.15.26:59872) 2021-11-03T18:24:54.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.752+0000 7fc5577fe700 1 -- 172.21.15.26:0/230720104 learned_addr learned my addr 172.21.15.26:0/230720104 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:24:54.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.752+0000 7fc557fff700 1 --2- 172.21.15.26:0/230720104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5580f66e0 0x7fc558106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:24:54.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.752+0000 7fc5577fe700 1 -- 172.21.15.26:0/230720104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5580f66e0 msgr2=0x7fc558106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:24:54.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.752+0000 7fc5577fe700 1 --2- 172.21.15.26:0/230720104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5580f66e0 0x7fc558106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:54.757 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.752+0000 7fc5577fe700 1 -- 172.21.15.26:0/230720104 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc548005040 con 0x7fc5580f6ff0 2021-11-03T18:24:54.757 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.753+0000 7fc557fff700 1 --2- 172.21.15.26:0/230720104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5580f66e0 0x7fc558106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:24:54.757 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.753+0000 7fc5577fe700 1 --2- 172.21.15.26:0/230720104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5580f6ff0 0x7fc558107460 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7fc548009da0 tx=0x7fc548009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:24:54.757 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.753+0000 7fc554ff9700 1 -- 172.21.15.26:0/230720104 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc548018070 con 0x7fc5580f6ff0 2021-11-03T18:24:54.758 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.753+0000 7fc554ff9700 1 -- 172.21.15.26:0/230720104 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc548007d70 con 0x7fc5580f6ff0 2021-11-03T18:24:54.758 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.753+0000 7fc55e8ac700 1 -- 172.21.15.26:0/230720104 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc558108490 con 0x7fc5580f6ff0 2021-11-03T18:24:54.758 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.753+0000 7fc554ff9700 1 -- 172.21.15.26:0/230720104 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc54801dea0 con 0x7fc5580f6ff0 2021-11-03T18:24:54.758 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.753+0000 7fc55e8ac700 1 -- 172.21.15.26:0/230720104 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5581089f0 con 0x7fc5580f6ff0 2021-11-03T18:24:54.759 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.754+0000 7fc55e8ac700 1 -- 172.21.15.26:0/230720104 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc558045ad0 con 0x7fc5580f6ff0 2021-11-03T18:24:54.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.754+0000 7fc554ff9700 1 -- 172.21.15.26:0/230720104 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc54801d420 con 0x7fc5580f6ff0 2021-11-03T18:24:54.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.755+0000 7fc554ff9700 1 --2- 172.21.15.26:0/230720104 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc540064090 0x7fc540066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:24:54.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.755+0000 7fc554ff9700 1 -- 172.21.15.26:0/230720104 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc548082570 con 0x7fc5580f6ff0 2021-11-03T18:24:54.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.755+0000 7fc557fff700 1 --2- 172.21.15.26:0/230720104 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc540064090 0x7fc540066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:24:54.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.755+0000 7fc557fff700 1 --2- 172.21.15.26:0/230720104 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc540064090 0x7fc540066550 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7fc54c0041d0 tx=0x7fc54c009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:24:54.761 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.759+0000 7fc554ff9700 1 -- 172.21.15.26:0/230720104 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc548054990 con 0x7fc5580f6ff0 2021-11-03T18:24:54.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.939+0000 7fc55e8ac700 1 -- 172.21.15.26:0/230720104 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5580fefe0 con 0x7fc540064090 2021-11-03T18:24:54.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.941+0000 7fc554ff9700 1 -- 172.21.15.26:0/230720104 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fc5580fefe0 con 0x7fc540064090 2021-11-03T18:24:54.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.943+0000 7fc55e8ac700 1 -- 172.21.15.26:0/230720104 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc540064090 msgr2=0x7fc540066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:24:54.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.943+0000 7fc55e8ac700 1 --2- 172.21.15.26:0/230720104 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc540064090 0x7fc540066550 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7fc54c0041d0 tx=0x7fc54c009040).stop 2021-11-03T18:24:54.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.943+0000 7fc55e8ac700 1 -- 172.21.15.26:0/230720104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5580f6ff0 msgr2=0x7fc558107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:24:54.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.943+0000 7fc55e8ac700 1 --2- 172.21.15.26:0/230720104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5580f6ff0 0x7fc558107460 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7fc548009da0 tx=0x7fc548009b30).stop 2021-11-03T18:24:54.943 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.943+0000 7fc55e8ac700 1 -- 172.21.15.26:0/230720104 shutdown_connections 2021-11-03T18:24:54.943 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.943+0000 7fc55e8ac700 1 --2- 172.21.15.26:0/230720104 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc540064090 0x7fc540066550 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:54.943 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.943+0000 7fc55e8ac700 1 --2- 172.21.15.26:0/230720104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5580f66e0 0x7fc558106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:54.943 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.943+0000 7fc55e8ac700 1 --2- 172.21.15.26:0/230720104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5580f6ff0 0x7fc558107460 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:54.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.943+0000 7fc55e8ac700 1 -- 172.21.15.26:0/230720104 >> 172.21.15.26:0/230720104 conn(0x7fc5580f1f00 msgr2=0x7fc5580fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:24:54.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.943+0000 7fc55e8ac700 1 -- 172.21.15.26:0/230720104 shutdown_connections 2021-11-03T18:24:54.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:54.943+0000 7fc55e8ac700 1 -- 172.21.15.26:0/230720104 wait complete. 2021-11-03T18:24:54.951 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:24:55.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.043+0000 7f7ae5bd2700 1 -- 172.21.15.26:0/2753725742 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ae00f96a0 msgr2=0x7f7ae00fbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:24:55.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.043+0000 7f7ae5bd2700 1 --2- 172.21.15.26:0/2753725742 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ae00f96a0 0x7f7ae00fbaf0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7f7ad0004660 tx=0x7f7ad0009b30).stop 2021-11-03T18:24:55.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.043+0000 7f7ae5bd2700 1 -- 172.21.15.26:0/2753725742 shutdown_connections 2021-11-03T18:24:55.044 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.043+0000 7f7ae5bd2700 1 --2- 172.21.15.26:0/2753725742 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ae00f96a0 0x7f7ae00fbaf0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:55.044 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.043+0000 7f7ae5bd2700 1 --2- 172.21.15.26:0/2753725742 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ae0060310 0x7f7ae00f9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:55.044 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.043+0000 7f7ae5bd2700 1 -- 172.21.15.26:0/2753725742 >> 172.21.15.26:0/2753725742 conn(0x7f7ae00f0ba0 msgr2=0x7f7ae00f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:24:55.044 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.043+0000 7f7ae5bd2700 1 -- 172.21.15.26:0/2753725742 shutdown_connections 2021-11-03T18:24:55.045 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.043+0000 7f7ae5bd2700 1 -- 172.21.15.26:0/2753725742 wait complete. 2021-11-03T18:24:55.045 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.044+0000 7f7ae5bd2700 1 Processor -- start 2021-11-03T18:24:55.045 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.044+0000 7f7ae5bd2700 1 -- start start 2021-11-03T18:24:55.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.044+0000 7f7ae5bd2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ae0060310 0x7f7ae00f6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:24:55.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.044+0000 7f7ae5bd2700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ae00f96a0 0x7f7ae00f5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:24:55.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.044+0000 7f7ae5bd2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae00f5580 con 0x7f7ae0060310 2021-11-03T18:24:55.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.044+0000 7f7ae5bd2700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae00f56c0 con 0x7f7ae00f96a0 2021-11-03T18:24:55.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.045+0000 7f7ae4bd0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ae0060310 0x7f7ae00f6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:24:55.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.045+0000 7f7ae4bd0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ae0060310 0x7f7ae00f6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59880/0 (socket says 172.21.15.26:59880) 2021-11-03T18:24:55.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.045+0000 7f7ae4bd0700 1 -- 172.21.15.26:0/2782443542 learned_addr learned my addr 172.21.15.26:0/2782443542 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:24:55.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.045+0000 7f7adffff700 1 --2- 172.21.15.26:0/2782443542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ae00f96a0 0x7f7ae00f5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:24:55.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.045+0000 7f7ae4bd0700 1 -- 172.21.15.26:0/2782443542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ae00f96a0 msgr2=0x7f7ae00f5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:24:55.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.045+0000 7f7ae4bd0700 1 --2- 172.21.15.26:0/2782443542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ae00f96a0 0x7f7ae00f5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:55.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.045+0000 7f7ae4bd0700 1 -- 172.21.15.26:0/2782443542 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad0005040 con 0x7f7ae0060310 2021-11-03T18:24:55.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.045+0000 7f7adffff700 1 --2- 172.21.15.26:0/2782443542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ae00f96a0 0x7f7ae00f5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:24:55.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.045+0000 7f7ae4bd0700 1 --2- 172.21.15.26:0/2782443542 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ae0060310 0x7f7ae00f6ba0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 rx=0x7f7ad800c760 tx=0x7f7ad8004d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:24:55.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.045+0000 7f7add7fa700 1 -- 172.21.15.26:0/2782443542 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ad8004200 con 0x7f7ae0060310 2021-11-03T18:24:55.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.045+0000 7f7add7fa700 1 -- 172.21.15.26:0/2782443542 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7ad80109c0 con 0x7f7ae0060310 2021-11-03T18:24:55.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.045+0000 7f7ae5bd2700 1 -- 172.21.15.26:0/2782443542 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae00f59a0 con 0x7f7ae0060310 2021-11-03T18:24:55.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.045+0000 7f7add7fa700 1 -- 172.21.15.26:0/2782443542 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ad8003920 con 0x7f7ae0060310 2021-11-03T18:24:55.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.045+0000 7f7ae5bd2700 1 -- 172.21.15.26:0/2782443542 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae010ed70 con 0x7f7ae0060310 2021-11-03T18:24:55.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.046+0000 7f7ae5bd2700 1 -- 172.21.15.26:0/2782443542 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae0045ad0 con 0x7f7ae0060310 2021-11-03T18:24:55.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.047+0000 7f7add7fa700 1 -- 172.21.15.26:0/2782443542 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f7ad8018020 con 0x7f7ae0060310 2021-11-03T18:24:55.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.047+0000 7f7add7fa700 1 --2- 172.21.15.26:0/2782443542 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7acc064100 0x7f7acc0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:24:55.053 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.047+0000 7f7add7fa700 1 -- 172.21.15.26:0/2782443542 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f7ad8080680 con 0x7f7ae0060310 2021-11-03T18:24:55.053 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.047+0000 7f7adffff700 1 --2- 172.21.15.26:0/2782443542 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7acc064100 0x7f7acc0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:24:55.053 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.048+0000 7f7adffff700 1 --2- 172.21.15.26:0/2782443542 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7acc064100 0x7f7acc0665c0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7f7ad0009da0 tx=0x7f7ad0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:24:55.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.051+0000 7f7add7fa700 1 -- 172.21.15.26:0/2782443542 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f7ad8052a40 con 0x7f7ae0060310 2021-11-03T18:24:55.222 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.223+0000 7f7ae5bd2700 1 -- 172.21.15.26:0/2782443542 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ae00fee40 con 0x7f7acc064100 2021-11-03T18:24:55.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.238+0000 7f7add7fa700 1 -- 172.21.15.26:0/2782443542 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f7ae00fee40 con 0x7f7acc064100 2021-11-03T18:24:55.237 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:24:55.237 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (96m) 4m ago 97m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:24:55.238 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (88m) 4m ago 97m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:24:55.238 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (88m) 3m ago 96m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:24:55.238 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (95m) 4m ago 97m 42.2M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:24:55.238 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (89m) 4m ago 92m 26.0M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:24:55.239 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (89m) 4m ago 92m 26.6M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:24:55.239 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (92m) 3m ago 92m 26.8M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:24:55.239 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (92m) 3m ago 92m 27.2M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:24:55.239 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (89m) 4m ago 98m 588M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:24:55.239 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (89m) 3m ago 96m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:24:55.240 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (89m) 4m ago 98m 341M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:24:55.240 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (88m) 3m ago 96m 158M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:24:55.240 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (97m) 4m ago 97m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:24:55.241 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (96m) 3m ago 96m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:24:55.241 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (87m) 4m ago 95m 332M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:24:55.241 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (87m) 4m ago 95m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:24:55.241 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (86m) 4m ago 95m 296M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:24:55.242 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (86m) 3m ago 94m 387M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:24:55.242 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (86m) 3m ago 94m 320M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:24:55.242 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (85m) 3m ago 94m 316M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:24:55.242 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (95m) 4m ago 96m 65.7M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:24:55.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.240+0000 7f7ae5bd2700 1 -- 172.21.15.26:0/2782443542 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7acc064100 msgr2=0x7f7acc0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:24:55.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.240+0000 7f7ae5bd2700 1 --2- 172.21.15.26:0/2782443542 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7acc064100 0x7f7acc0665c0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7f7ad0009da0 tx=0x7f7ad0009b30).stop 2021-11-03T18:24:55.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.240+0000 7f7ae5bd2700 1 -- 172.21.15.26:0/2782443542 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ae0060310 msgr2=0x7f7ae00f6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:24:55.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.240+0000 7f7ae5bd2700 1 --2- 172.21.15.26:0/2782443542 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ae0060310 0x7f7ae00f6ba0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 rx=0x7f7ad800c760 tx=0x7f7ad8004d20).stop 2021-11-03T18:24:55.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.240+0000 7f7ae5bd2700 1 -- 172.21.15.26:0/2782443542 shutdown_connections 2021-11-03T18:24:55.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.240+0000 7f7ae5bd2700 1 --2- 172.21.15.26:0/2782443542 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7acc064100 0x7f7acc0665c0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:55.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.240+0000 7f7ae5bd2700 1 --2- 172.21.15.26:0/2782443542 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ae0060310 0x7f7ae00f6ba0 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:55.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.240+0000 7f7ae5bd2700 1 --2- 172.21.15.26:0/2782443542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ae00f96a0 0x7f7ae00f5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:55.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.240+0000 7f7ae5bd2700 1 -- 172.21.15.26:0/2782443542 >> 172.21.15.26:0/2782443542 conn(0x7f7ae00f0ba0 msgr2=0x7f7ae00f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:24:55.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.240+0000 7f7ae5bd2700 1 -- 172.21.15.26:0/2782443542 shutdown_connections 2021-11-03T18:24:55.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.240+0000 7f7ae5bd2700 1 -- 172.21.15.26:0/2782443542 wait complete. 2021-11-03T18:24:55.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.339+0000 7f86283a9700 1 -- 172.21.15.26:0/2055068243 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86200f6860 msgr2=0x7f86200f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:24:55.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.339+0000 7f86283a9700 1 --2- 172.21.15.26:0/2055068243 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86200f6860 0x7f86200f6cc0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 rx=0x7f8614004660 tx=0x7f8614009b30).stop 2021-11-03T18:24:55.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.339+0000 7f86283a9700 1 -- 172.21.15.26:0/2055068243 shutdown_connections 2021-11-03T18:24:55.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.339+0000 7f86283a9700 1 --2- 172.21.15.26:0/2055068243 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86200f6860 0x7f86200f6cc0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:55.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.339+0000 7f86283a9700 1 --2- 172.21.15.26:0/2055068243 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86200f55c0 0x7f86200f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:55.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.339+0000 7f86283a9700 1 -- 172.21.15.26:0/2055068243 >> 172.21.15.26:0/2055068243 conn(0x7f86200f0d40 msgr2=0x7f86200f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:24:55.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.339+0000 7f86283a9700 1 -- 172.21.15.26:0/2055068243 shutdown_connections 2021-11-03T18:24:55.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.339+0000 7f86283a9700 1 -- 172.21.15.26:0/2055068243 wait complete. 2021-11-03T18:24:55.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.339+0000 7f86283a9700 1 Processor -- start 2021-11-03T18:24:55.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.339+0000 7f86283a9700 1 -- start start 2021-11-03T18:24:55.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.340+0000 7f86283a9700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86200f55c0 0x7f8620106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:24:55.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.340+0000 7f86283a9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86200f6860 0x7f8620107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:24:55.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.340+0000 7f86283a9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8620107a10 con 0x7f86200f6860 2021-11-03T18:24:55.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.340+0000 7f86283a9700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8620107b50 con 0x7f86200f55c0 2021-11-03T18:24:55.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.340+0000 7f8625944700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86200f6860 0x7f8620107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:24:55.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.340+0000 7f8625944700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86200f6860 0x7f8620107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59892/0 (socket says 172.21.15.26:59892) 2021-11-03T18:24:55.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.340+0000 7f8625944700 1 -- 172.21.15.26:0/3116119026 learned_addr learned my addr 172.21.15.26:0/3116119026 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:24:55.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.340+0000 7f8626145700 1 --2- 172.21.15.26:0/3116119026 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86200f55c0 0x7f8620106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:24:55.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.340+0000 7f8625944700 1 -- 172.21.15.26:0/3116119026 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86200f55c0 msgr2=0x7f8620106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:24:55.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.340+0000 7f8625944700 1 --2- 172.21.15.26:0/3116119026 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86200f55c0 0x7f8620106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:55.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.340+0000 7f8625944700 1 -- 172.21.15.26:0/3116119026 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8614005040 con 0x7f86200f6860 2021-11-03T18:24:55.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.340+0000 7f8626145700 1 --2- 172.21.15.26:0/3116119026 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86200f55c0 0x7f8620106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:24:55.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.340+0000 7f8625944700 1 --2- 172.21.15.26:0/3116119026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86200f6860 0x7f8620107460 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 rx=0x7f8614009990 tx=0x7f8614009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:24:55.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.340+0000 7f861effd700 1 -- 172.21.15.26:0/3116119026 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8614018070 con 0x7f86200f6860 2021-11-03T18:24:55.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.340+0000 7f861effd700 1 -- 172.21.15.26:0/3116119026 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8614007ca0 con 0x7f86200f6860 2021-11-03T18:24:55.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.340+0000 7f86283a9700 1 -- 172.21.15.26:0/3116119026 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8620108490 con 0x7f86200f6860 2021-11-03T18:24:55.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.340+0000 7f861effd700 1 -- 172.21.15.26:0/3116119026 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f861401c620 con 0x7f86200f6860 2021-11-03T18:24:55.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.340+0000 7f86283a9700 1 -- 172.21.15.26:0/3116119026 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86201089f0 con 0x7f86200f6860 2021-11-03T18:24:55.347 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.341+0000 7f86283a9700 1 -- 172.21.15.26:0/3116119026 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8620045ad0 con 0x7f86200f6860 2021-11-03T18:24:55.348 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.342+0000 7f861effd700 1 -- 172.21.15.26:0/3116119026 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f861401d960 con 0x7f86200f6860 2021-11-03T18:24:55.348 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.342+0000 7f861effd700 1 --2- 172.21.15.26:0/3116119026 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f86080640b0 0x7f8608066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:24:55.348 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.342+0000 7f861effd700 1 -- 172.21.15.26:0/3116119026 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f8614082480 con 0x7f86200f6860 2021-11-03T18:24:55.348 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.342+0000 7f8626145700 1 --2- 172.21.15.26:0/3116119026 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f86080640b0 0x7f8608066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:24:55.349 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.343+0000 7f8626145700 1 --2- 172.21.15.26:0/3116119026 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f86080640b0 0x7f8608066570 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f8618004fd0 tx=0x7f8618009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:24:55.349 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.346+0000 7f861effd700 1 -- 172.21.15.26:0/3116119026 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f86140548a0 con 0x7f86200f6860 2021-11-03T18:24:55.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:55 smithi026 ceph-mon[96795]: pgmap v2707: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:55.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:55 smithi194 ceph-mon[65619]: pgmap v2707: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:55.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.575+0000 7f86283a9700 1 -- 172.21.15.26:0/3116119026 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f862010d590 con 0x7f86200f6860 2021-11-03T18:24:55.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.576+0000 7f861effd700 1 -- 172.21.15.26:0/3116119026 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f8614054490 con 0x7f86200f6860 2021-11-03T18:24:55.575 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:24:55.576 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:24:55.576 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:24:55.576 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:24:55.577 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:24:55.577 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:24:55.577 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:24:55.577 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:24:55.578 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:24:55.578 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:24:55.578 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:24:55.578 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:24:55.579 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:24:55.579 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:24:55.579 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:24:55.579 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:24:55.579 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:24:55.580 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:24:55.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.578+0000 7f86283a9700 1 -- 172.21.15.26:0/3116119026 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f86080640b0 msgr2=0x7f8608066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:24:55.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.578+0000 7f86283a9700 1 --2- 172.21.15.26:0/3116119026 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f86080640b0 0x7f8608066570 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f8618004fd0 tx=0x7f8618009040).stop 2021-11-03T18:24:55.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.578+0000 7f86283a9700 1 -- 172.21.15.26:0/3116119026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86200f6860 msgr2=0x7f8620107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:24:55.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.578+0000 7f86283a9700 1 --2- 172.21.15.26:0/3116119026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86200f6860 0x7f8620107460 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 rx=0x7f8614009990 tx=0x7f8614009b30).stop 2021-11-03T18:24:55.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.578+0000 7f86283a9700 1 -- 172.21.15.26:0/3116119026 shutdown_connections 2021-11-03T18:24:55.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.578+0000 7f86283a9700 1 --2- 172.21.15.26:0/3116119026 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f86080640b0 0x7f8608066570 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:55.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.578+0000 7f86283a9700 1 --2- 172.21.15.26:0/3116119026 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86200f55c0 0x7f8620106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:55.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.578+0000 7f86283a9700 1 --2- 172.21.15.26:0/3116119026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86200f6860 0x7f8620107460 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:55.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.578+0000 7f86283a9700 1 -- 172.21.15.26:0/3116119026 >> 172.21.15.26:0/3116119026 conn(0x7f86200f0d40 msgr2=0x7f862005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:24:55.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.578+0000 7f86283a9700 1 -- 172.21.15.26:0/3116119026 shutdown_connections 2021-11-03T18:24:55.584 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.578+0000 7f86283a9700 1 -- 172.21.15.26:0/3116119026 wait complete. 2021-11-03T18:24:55.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.679+0000 7fc6b2afb700 1 -- 172.21.15.26:0/568881694 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6ac0f6ff0 msgr2=0x7fc6ac0f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:24:55.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.679+0000 7fc6b2afb700 1 --2- 172.21.15.26:0/568881694 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6ac0f6ff0 0x7fc6ac0f7a20 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 rx=0x7fc698004660 tx=0x7fc698009b30).stop 2021-11-03T18:24:55.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.679+0000 7fc6b2afb700 1 -- 172.21.15.26:0/568881694 shutdown_connections 2021-11-03T18:24:55.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.679+0000 7fc6b2afb700 1 --2- 172.21.15.26:0/568881694 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6ac0f6ff0 0x7fc6ac0f7a20 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:55.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.679+0000 7fc6b2afb700 1 --2- 172.21.15.26:0/568881694 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6ac0f66e0 0x7fc6ac0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:55.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.679+0000 7fc6b2afb700 1 -- 172.21.15.26:0/568881694 >> 172.21.15.26:0/568881694 conn(0x7fc6ac0f1f00 msgr2=0x7fc6ac0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:24:55.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.679+0000 7fc6b2afb700 1 -- 172.21.15.26:0/568881694 shutdown_connections 2021-11-03T18:24:55.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.679+0000 7fc6b2afb700 1 -- 172.21.15.26:0/568881694 wait complete. 2021-11-03T18:24:55.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.680+0000 7fc6b2afb700 1 Processor -- start 2021-11-03T18:24:55.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.680+0000 7fc6b2afb700 1 -- start start 2021-11-03T18:24:55.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.680+0000 7fc6b2afb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6ac0f66e0 0x7fc6ac106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:24:55.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.680+0000 7fc6b2afb700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6ac0f6ff0 0x7fc6ac107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:24:55.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.680+0000 7fc6b2afb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac107a10 con 0x7fc6ac0f66e0 2021-11-03T18:24:55.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.680+0000 7fc6b2afb700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac107b50 con 0x7fc6ac0f6ff0 2021-11-03T18:24:55.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.680+0000 7fc6b0897700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6ac0f66e0 0x7fc6ac106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:24:55.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.680+0000 7fc6b0897700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6ac0f66e0 0x7fc6ac106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59900/0 (socket says 172.21.15.26:59900) 2021-11-03T18:24:55.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.680+0000 7fc6b0897700 1 -- 172.21.15.26:0/4144903245 learned_addr learned my addr 172.21.15.26:0/4144903245 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:24:55.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.681+0000 7fc6abfff700 1 --2- 172.21.15.26:0/4144903245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6ac0f6ff0 0x7fc6ac107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:24:55.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.681+0000 7fc6b0897700 1 -- 172.21.15.26:0/4144903245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6ac0f6ff0 msgr2=0x7fc6ac107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:24:55.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.681+0000 7fc6b0897700 1 --2- 172.21.15.26:0/4144903245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6ac0f6ff0 0x7fc6ac107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:55.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.681+0000 7fc6b0897700 1 -- 172.21.15.26:0/4144903245 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc698005040 con 0x7fc6ac0f66e0 2021-11-03T18:24:55.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.681+0000 7fc6abfff700 1 --2- 172.21.15.26:0/4144903245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6ac0f6ff0 0x7fc6ac107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:24:55.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.681+0000 7fc6b0897700 1 --2- 172.21.15.26:0/4144903245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6ac0f66e0 0x7fc6ac106f70 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7fc6a00026d0 tx=0x7fc6a0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:24:55.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.681+0000 7fc6a97fa700 1 -- 172.21.15.26:0/4144903245 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6a0009320 con 0x7fc6ac0f66e0 2021-11-03T18:24:55.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.681+0000 7fc6b2afb700 1 -- 172.21.15.26:0/4144903245 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6ac1084f0 con 0x7fc6ac0f66e0 2021-11-03T18:24:55.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.681+0000 7fc6a97fa700 1 -- 172.21.15.26:0/4144903245 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc6a000f040 con 0x7fc6ac0f66e0 2021-11-03T18:24:55.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.681+0000 7fc6a97fa700 1 -- 172.21.15.26:0/4144903245 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6a00147e0 con 0x7fc6ac0f66e0 2021-11-03T18:24:55.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.681+0000 7fc6b2afb700 1 -- 172.21.15.26:0/4144903245 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6ac108ab0 con 0x7fc6ac0f66e0 2021-11-03T18:24:55.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.682+0000 7fc6a97fa700 1 -- 172.21.15.26:0/4144903245 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc6a0009480 con 0x7fc6ac0f66e0 2021-11-03T18:24:55.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.682+0000 7fc6b2afb700 1 -- 172.21.15.26:0/4144903245 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6ac045ad0 con 0x7fc6ac0f66e0 2021-11-03T18:24:55.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.683+0000 7fc6a97fa700 1 --2- 172.21.15.26:0/4144903245 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc69c0640b0 0x7fc69c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:24:55.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.683+0000 7fc6a97fa700 1 -- 172.21.15.26:0/4144903245 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc6a0080ee0 con 0x7fc6ac0f66e0 2021-11-03T18:24:55.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.683+0000 7fc6abfff700 1 --2- 172.21.15.26:0/4144903245 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc69c0640b0 0x7fc69c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:24:55.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.683+0000 7fc6abfff700 1 --2- 172.21.15.26:0/4144903245 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc69c0640b0 0x7fc69c066570 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7fc698009da0 tx=0x7fc698009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:24:55.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.687+0000 7fc6a97fa700 1 -- 172.21.15.26:0/4144903245 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc6a0053240 con 0x7fc6ac0f66e0 2021-11-03T18:24:55.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.889+0000 7fc6b2afb700 1 -- 172.21.15.26:0/4144903245 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc6ac0fefd0 con 0x7fc6ac0f66e0 2021-11-03T18:24:55.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.889+0000 7fc6a97fa700 1 -- 172.21.15.26:0/4144903245 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fc6a0052e30 con 0x7fc6ac0f66e0 2021-11-03T18:24:55.889 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:24:55.889 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:24:55.889 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:24:55.889 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:24:55.890 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:24:55.890 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:24:55.890 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:24:55.890 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:24:55.891 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:24:55.891 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:24:55.891 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:24:55.891 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:24:55.892 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:24:55.892 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:24:55.892 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:24:55.892 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:24:55.893 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:24:55.893 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:24:55.893 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:24:55.893 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:24:55.894 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:24:55.894 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:24:55.894 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:24:55.894 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:24:55.894 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:24:55.895 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:24:55.895 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:24:55.895 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:24:55.895 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:24:55.896 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:24:55.896 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:24:55.896 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:24:55.896 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:24:55.897 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:24:55.897 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:24:55.897 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:24:55.897 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:24:55.898 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:24:55.898 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:24:55.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.891+0000 7fc6b2afb700 1 -- 172.21.15.26:0/4144903245 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc69c0640b0 msgr2=0x7fc69c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:24:55.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.891+0000 7fc6b2afb700 1 --2- 172.21.15.26:0/4144903245 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc69c0640b0 0x7fc69c066570 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7fc698009da0 tx=0x7fc698009b30).stop 2021-11-03T18:24:55.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.891+0000 7fc6b2afb700 1 -- 172.21.15.26:0/4144903245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6ac0f66e0 msgr2=0x7fc6ac106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:24:55.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.891+0000 7fc6b2afb700 1 --2- 172.21.15.26:0/4144903245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6ac0f66e0 0x7fc6ac106f70 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7fc6a00026d0 tx=0x7fc6a0009de0).stop 2021-11-03T18:24:55.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.891+0000 7fc6b2afb700 1 -- 172.21.15.26:0/4144903245 shutdown_connections 2021-11-03T18:24:55.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.891+0000 7fc6b2afb700 1 --2- 172.21.15.26:0/4144903245 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc69c0640b0 0x7fc69c066570 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:55.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.891+0000 7fc6b2afb700 1 --2- 172.21.15.26:0/4144903245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6ac0f66e0 0x7fc6ac106f70 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:55.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.891+0000 7fc6b2afb700 1 --2- 172.21.15.26:0/4144903245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6ac0f6ff0 0x7fc6ac107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:24:55.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.891+0000 7fc6b2afb700 1 -- 172.21.15.26:0/4144903245 >> 172.21.15.26:0/4144903245 conn(0x7fc6ac0f1f00 msgr2=0x7fc6ac0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:24:55.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.891+0000 7fc6b2afb700 1 -- 172.21.15.26:0/4144903245 shutdown_connections 2021-11-03T18:24:55.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:24:55.891+0000 7fc6b2afb700 1 -- 172.21.15.26:0/4144903245 wait complete. 2021-11-03T18:24:55.902 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:24:56.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:56 smithi026 ceph-mon[96795]: from='client.36924 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:24:56.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:56 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3116119026' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:24:56.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:56 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/4144903245' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:24:56.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:56 smithi194 ceph-mon[65619]: from='client.36924 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:24:56.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:56 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3116119026' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:24:56.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:56 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/4144903245' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:24:57.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:57 smithi026 ceph-mon[96795]: from='client.36928 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:24:57.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:57 smithi026 ceph-mon[96795]: pgmap v2708: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:57.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:57 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:24:57.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:57 smithi194 ceph-mon[65619]: from='client.36928 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:24:57.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:57 smithi194 ceph-mon[65619]: pgmap v2708: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:57.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:57 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:24:58.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:58 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:24:58.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:58 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:24:59.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:24:59 smithi026 ceph-mon[96795]: pgmap v2709: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:24:59.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:24:59 smithi194 ceph-mon[65619]: pgmap v2709: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:01.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:01 smithi026 ceph-mon[96795]: pgmap v2710: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:01.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:01 smithi194 ceph-mon[65619]: pgmap v2710: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:03.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:03 smithi026 ceph-mon[96795]: pgmap v2711: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:03.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:03 smithi194 ceph-mon[65619]: pgmap v2711: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:05.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:05 smithi026 ceph-mon[96795]: pgmap v2712: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:05.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:05 smithi194 ceph-mon[65619]: pgmap v2712: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:07.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:07 smithi026 ceph-mon[96795]: pgmap v2713: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:07.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:07 smithi194 ceph-mon[65619]: pgmap v2713: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:09.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:09 smithi026 ceph-mon[96795]: pgmap v2714: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:09.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:09 smithi194 ceph-mon[65619]: pgmap v2714: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:11.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:11 smithi026 ceph-mon[96795]: pgmap v2715: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:11.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:11 smithi194 ceph-mon[65619]: pgmap v2715: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:12.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:12 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:25:12.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:12 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:25:13.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:13 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:25:13.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:13 smithi026 ceph-mon[96795]: pgmap v2716: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:13.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:13 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:25:13.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:13 smithi194 ceph-mon[65619]: pgmap v2716: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:15.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:15 smithi026 ceph-mon[96795]: pgmap v2717: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:15.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:15 smithi194 ceph-mon[65619]: pgmap v2717: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:17.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:17 smithi026 ceph-mon[96795]: pgmap v2718: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:17.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:17 smithi194 ceph-mon[65619]: pgmap v2718: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:19.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:19 smithi026 ceph-mon[96795]: pgmap v2719: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:19.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:19 smithi194 ceph-mon[65619]: pgmap v2719: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:21.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:21 smithi026 ceph-mon[96795]: pgmap v2720: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:21.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:21 smithi194 ceph-mon[65619]: pgmap v2720: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:23.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:23 smithi026 ceph-mon[96795]: pgmap v2721: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:23.473 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:23 smithi194 ceph-mon[65619]: pgmap v2721: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:25.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:25 smithi026 ceph-mon[96795]: pgmap v2722: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:25.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:25 smithi194 ceph-mon[65619]: pgmap v2722: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:26.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.006+0000 7f549d953700 1 -- 172.21.15.26:0/2672934668 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54980f6860 msgr2=0x7f54980f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:25:26.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.006+0000 7f549d953700 1 --2- 172.21.15.26:0/2672934668 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54980f6860 0x7f54980f6cc0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 rx=0x7f5480004660 tx=0x7f5480009b30).stop 2021-11-03T18:25:26.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.006+0000 7f549d953700 1 -- 172.21.15.26:0/2672934668 shutdown_connections 2021-11-03T18:25:26.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.006+0000 7f549d953700 1 --2- 172.21.15.26:0/2672934668 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54980f6860 0x7f54980f6cc0 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:26.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.006+0000 7f549d953700 1 --2- 172.21.15.26:0/2672934668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54980f55c0 0x7f54980f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:26.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.006+0000 7f549d953700 1 -- 172.21.15.26:0/2672934668 >> 172.21.15.26:0/2672934668 conn(0x7f54980f0d40 msgr2=0x7f54980f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:25:26.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.006+0000 7f549d953700 1 -- 172.21.15.26:0/2672934668 shutdown_connections 2021-11-03T18:25:26.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.006+0000 7f549d953700 1 -- 172.21.15.26:0/2672934668 wait complete. 2021-11-03T18:25:26.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.007+0000 7f549d953700 1 Processor -- start 2021-11-03T18:25:26.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.007+0000 7f549d953700 1 -- start start 2021-11-03T18:25:26.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.007+0000 7f549d953700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54980f55c0 0x7f54980f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:25:26.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.007+0000 7f549d953700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54980f6860 0x7f54980f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:25:26.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.007+0000 7f549d953700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54980f8100 con 0x7f54980f6860 2021-11-03T18:25:26.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.007+0000 7f549d953700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54980f8240 con 0x7f54980f55c0 2021-11-03T18:25:26.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.007+0000 7f54967fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54980f6860 0x7f54980f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:25:26.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.007+0000 7f54967fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54980f6860 0x7f54980f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59920/0 (socket says 172.21.15.26:59920) 2021-11-03T18:25:26.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.007+0000 7f54967fc700 1 -- 172.21.15.26:0/949058194 learned_addr learned my addr 172.21.15.26:0/949058194 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:25:26.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.007+0000 7f5496ffd700 1 --2- 172.21.15.26:0/949058194 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54980f55c0 0x7f54980f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:25:26.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.007+0000 7f54967fc700 1 -- 172.21.15.26:0/949058194 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54980f55c0 msgr2=0x7f54980f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:25:26.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.007+0000 7f54967fc700 1 --2- 172.21.15.26:0/949058194 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54980f55c0 0x7f54980f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:26.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.007+0000 7f54967fc700 1 -- 172.21.15.26:0/949058194 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5480005040 con 0x7f54980f6860 2021-11-03T18:25:26.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.008+0000 7f54967fc700 1 --2- 172.21.15.26:0/949058194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54980f6860 0x7f54980f7ba0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7f5480009990 tx=0x7f5480009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:25:26.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.008+0000 7f548f7fe700 1 -- 172.21.15.26:0/949058194 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5480018070 con 0x7f54980f6860 2021-11-03T18:25:26.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.008+0000 7f548f7fe700 1 -- 172.21.15.26:0/949058194 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5480007ca0 con 0x7f54980f6860 2021-11-03T18:25:26.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.008+0000 7f548f7fe700 1 -- 172.21.15.26:0/949058194 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f548001c620 con 0x7f54980f6860 2021-11-03T18:25:26.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.008+0000 7f549d953700 1 -- 172.21.15.26:0/949058194 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54980f84c0 con 0x7f54980f6860 2021-11-03T18:25:26.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.008+0000 7f549d953700 1 -- 172.21.15.26:0/949058194 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54980f8a20 con 0x7f54980f6860 2021-11-03T18:25:26.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.009+0000 7f549d953700 1 -- 172.21.15.26:0/949058194 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5498045ad0 con 0x7f54980f6860 2021-11-03T18:25:26.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.009+0000 7f548f7fe700 1 -- 172.21.15.26:0/949058194 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f548001d960 con 0x7f54980f6860 2021-11-03T18:25:26.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.010+0000 7f548f7fe700 1 --2- 172.21.15.26:0/949058194 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f54840640b0 0x7f5484066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:25:26.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.010+0000 7f548f7fe700 1 -- 172.21.15.26:0/949058194 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f5480082470 con 0x7f54980f6860 2021-11-03T18:25:26.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.010+0000 7f5496ffd700 1 --2- 172.21.15.26:0/949058194 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f54840640b0 0x7f5484066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:25:26.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.010+0000 7f5496ffd700 1 --2- 172.21.15.26:0/949058194 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f54840640b0 0x7f5484066570 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f54980f94b0 tx=0x7f5490009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:25:26.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.014+0000 7f548f7fe700 1 -- 172.21.15.26:0/949058194 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f5480054890 con 0x7f54980f6860 2021-11-03T18:25:26.193 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.195+0000 7f549d953700 1 -- 172.21.15.26:0/949058194 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f54980faca0 con 0x7f54840640b0 2021-11-03T18:25:26.194 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.197+0000 7f548f7fe700 1 -- 172.21.15.26:0/949058194 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f54980faca0 con 0x7f54840640b0 2021-11-03T18:25:26.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.198+0000 7f549d953700 1 -- 172.21.15.26:0/949058194 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f54840640b0 msgr2=0x7f5484066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:25:26.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.198+0000 7f549d953700 1 --2- 172.21.15.26:0/949058194 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f54840640b0 0x7f5484066570 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f54980f94b0 tx=0x7f5490009040).stop 2021-11-03T18:25:26.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.198+0000 7f549d953700 1 -- 172.21.15.26:0/949058194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54980f6860 msgr2=0x7f54980f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:25:26.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.198+0000 7f549d953700 1 --2- 172.21.15.26:0/949058194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54980f6860 0x7f54980f7ba0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7f5480009990 tx=0x7f5480009b30).stop 2021-11-03T18:25:26.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.198+0000 7f549d953700 1 -- 172.21.15.26:0/949058194 shutdown_connections 2021-11-03T18:25:26.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.198+0000 7f549d953700 1 --2- 172.21.15.26:0/949058194 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f54840640b0 0x7f5484066570 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:26.198 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.198+0000 7f549d953700 1 --2- 172.21.15.26:0/949058194 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54980f55c0 0x7f54980f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:26.198 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.198+0000 7f549d953700 1 --2- 172.21.15.26:0/949058194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54980f6860 0x7f54980f7ba0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:26.198 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.198+0000 7f549d953700 1 -- 172.21.15.26:0/949058194 >> 172.21.15.26:0/949058194 conn(0x7f54980f0d40 msgr2=0x7f549805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:25:26.198 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.198+0000 7f549d953700 1 -- 172.21.15.26:0/949058194 shutdown_connections 2021-11-03T18:25:26.199 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.198+0000 7f549d953700 1 -- 172.21.15.26:0/949058194 wait complete. 2021-11-03T18:25:26.206 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:25:26.299 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.300+0000 7fde7c818700 1 -- 172.21.15.26:0/4024569409 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde780f5390 msgr2=0x7fde780f57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:25:26.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.300+0000 7fde7c818700 1 --2- 172.21.15.26:0/4024569409 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde780f5390 0x7fde780f57b0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 rx=0x7fde680099e0 tx=0x7fde68004d10).stop 2021-11-03T18:25:26.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.300+0000 7fde7c818700 1 -- 172.21.15.26:0/4024569409 shutdown_connections 2021-11-03T18:25:26.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.300+0000 7fde7c818700 1 --2- 172.21.15.26:0/4024569409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde780f6630 0x7fde780f6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:26.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.300+0000 7fde7c818700 1 --2- 172.21.15.26:0/4024569409 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde780f5390 0x7fde780f57b0 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:26.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.300+0000 7fde7c818700 1 -- 172.21.15.26:0/4024569409 >> 172.21.15.26:0/4024569409 conn(0x7fde780f0ad0 msgr2=0x7fde780f2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:25:26.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.300+0000 7fde7c818700 1 -- 172.21.15.26:0/4024569409 shutdown_connections 2021-11-03T18:25:26.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.300+0000 7fde7c818700 1 -- 172.21.15.26:0/4024569409 wait complete. 2021-11-03T18:25:26.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.301+0000 7fde7c818700 1 Processor -- start 2021-11-03T18:25:26.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.301+0000 7fde7c818700 1 -- start start 2021-11-03T18:25:26.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.301+0000 7fde7c818700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde780f5390 0x7fde78109b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:25:26.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.301+0000 7fde7c818700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde780f6630 0x7fde7810c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:25:26.303 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.301+0000 7fde7c818700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde780603c0 con 0x7fde780f5390 2021-11-03T18:25:26.303 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.301+0000 7fde7c818700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde78060500 con 0x7fde780f6630 2021-11-03T18:25:26.303 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.301+0000 7fde777fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde780f5390 0x7fde78109b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:25:26.303 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.301+0000 7fde777fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde780f5390 0x7fde78109b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59928/0 (socket says 172.21.15.26:59928) 2021-11-03T18:25:26.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.301+0000 7fde777fe700 1 -- 172.21.15.26:0/3687022183 learned_addr learned my addr 172.21.15.26:0/3687022183 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:25:26.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.301+0000 7fde76ffd700 1 --2- 172.21.15.26:0/3687022183 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde780f6630 0x7fde7810c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:25:26.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.301+0000 7fde777fe700 1 -- 172.21.15.26:0/3687022183 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde780f6630 msgr2=0x7fde7810c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:25:26.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.301+0000 7fde777fe700 1 --2- 172.21.15.26:0/3687022183 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde780f6630 0x7fde7810c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:26.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.301+0000 7fde777fe700 1 -- 172.21.15.26:0/3687022183 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde68009640 con 0x7fde780f5390 2021-11-03T18:25:26.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.301+0000 7fde777fe700 1 --2- 172.21.15.26:0/3687022183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde780f5390 0x7fde78109b50 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 rx=0x7fde6800c010 tx=0x7fde68004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:25:26.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.302+0000 7fde6ffff700 1 -- 172.21.15.26:0/3687022183 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde6800e070 con 0x7fde780f5390 2021-11-03T18:25:26.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.302+0000 7fde6ffff700 1 -- 172.21.15.26:0/3687022183 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fde68007dc0 con 0x7fde780f5390 2021-11-03T18:25:26.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.302+0000 7fde7c818700 1 -- 172.21.15.26:0/3687022183 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde7810c5a0 con 0x7fde780f5390 2021-11-03T18:25:26.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.302+0000 7fde6ffff700 1 -- 172.21.15.26:0/3687022183 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde68018070 con 0x7fde780f5390 2021-11-03T18:25:26.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.302+0000 7fde7c818700 1 -- 172.21.15.26:0/3687022183 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde7810ca50 con 0x7fde780f5390 2021-11-03T18:25:26.307 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.303+0000 7fde7c818700 1 -- 172.21.15.26:0/3687022183 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde78045ad0 con 0x7fde780f5390 2021-11-03T18:25:26.307 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.304+0000 7fde6ffff700 1 -- 172.21.15.26:0/3687022183 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fde68024060 con 0x7fde780f5390 2021-11-03T18:25:26.308 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.304+0000 7fde6ffff700 1 --2- 172.21.15.26:0/3687022183 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fde64064100 0x7fde640665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:25:26.308 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.304+0000 7fde6ffff700 1 -- 172.21.15.26:0/3687022183 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fde68082140 con 0x7fde780f5390 2021-11-03T18:25:26.308 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.304+0000 7fde76ffd700 1 --2- 172.21.15.26:0/3687022183 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fde64064100 0x7fde640665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:25:26.308 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.305+0000 7fde76ffd700 1 --2- 172.21.15.26:0/3687022183 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fde64064100 0x7fde640665c0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7fde600096c0 tx=0x7fde60009be0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:25:26.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.308+0000 7fde6ffff700 1 -- 172.21.15.26:0/3687022183 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fde680543e0 con 0x7fde780f5390 2021-11-03T18:25:26.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.482+0000 7fde7c818700 1 -- 172.21.15.26:0/3687022183 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fde780fdd00 con 0x7fde64064100 2021-11-03T18:25:26.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.497+0000 7fde6ffff700 1 -- 172.21.15.26:0/3687022183 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fde60009e20 con 0x7fde64064100 2021-11-03T18:25:26.496 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:25:26.496 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (96m) 5m ago 97m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:25:26.496 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (88m) 5m ago 97m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:25:26.496 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (88m) 4m ago 97m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:25:26.497 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (96m) 5m ago 97m 42.2M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:25:26.497 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (89m) 5m ago 93m 26.0M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:25:26.497 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (89m) 5m ago 92m 26.6M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:25:26.497 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (93m) 4m ago 93m 26.8M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:25:26.498 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (93m) 4m ago 93m 27.2M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:25:26.498 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (90m) 5m ago 99m 588M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:25:26.498 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (90m) 4m ago 97m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:25:26.499 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (89m) 5m ago 99m 341M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:25:26.499 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (89m) 4m ago 97m 158M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:25:26.500 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (97m) 5m ago 97m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:25:26.500 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (96m) 4m ago 96m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:25:26.500 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (88m) 5m ago 96m 332M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:25:26.501 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (87m) 5m ago 95m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:25:26.501 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (87m) 5m ago 95m 296M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:25:26.501 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (86m) 4m ago 95m 387M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:25:26.501 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (86m) 4m ago 94m 320M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:25:26.502 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (86m) 4m ago 94m 316M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:25:26.502 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (96m) 5m ago 97m 65.7M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:25:26.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.500+0000 7fde7c818700 1 -- 172.21.15.26:0/3687022183 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fde64064100 msgr2=0x7fde640665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:25:26.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.500+0000 7fde7c818700 1 --2- 172.21.15.26:0/3687022183 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fde64064100 0x7fde640665c0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7fde600096c0 tx=0x7fde60009be0).stop 2021-11-03T18:25:26.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.500+0000 7fde7c818700 1 -- 172.21.15.26:0/3687022183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde780f5390 msgr2=0x7fde78109b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:25:26.504 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.500+0000 7fde7c818700 1 --2- 172.21.15.26:0/3687022183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde780f5390 0x7fde78109b50 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 rx=0x7fde6800c010 tx=0x7fde68004d10).stop 2021-11-03T18:25:26.504 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.500+0000 7fde7c818700 1 -- 172.21.15.26:0/3687022183 shutdown_connections 2021-11-03T18:25:26.504 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.500+0000 7fde7c818700 1 --2- 172.21.15.26:0/3687022183 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fde64064100 0x7fde640665c0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:26.504 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.500+0000 7fde7c818700 1 --2- 172.21.15.26:0/3687022183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde780f5390 0x7fde78109b50 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:26.505 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.500+0000 7fde7c818700 1 --2- 172.21.15.26:0/3687022183 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde780f6630 0x7fde7810c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:26.505 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.500+0000 7fde7c818700 1 -- 172.21.15.26:0/3687022183 >> 172.21.15.26:0/3687022183 conn(0x7fde780f0ad0 msgr2=0x7fde780fa080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:25:26.505 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.500+0000 7fde7c818700 1 -- 172.21.15.26:0/3687022183 shutdown_connections 2021-11-03T18:25:26.505 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.500+0000 7fde7c818700 1 -- 172.21.15.26:0/3687022183 wait complete. 2021-11-03T18:25:26.603 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.605+0000 7f9042553700 1 -- 172.21.15.26:0/2630271676 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f903c0f6860 msgr2=0x7f903c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:25:26.604 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.605+0000 7f9042553700 1 --2- 172.21.15.26:0/2630271676 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f903c0f6860 0x7f903c0f6cc0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 rx=0x7f9030004660 tx=0x7f9030009b30).stop 2021-11-03T18:25:26.604 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.605+0000 7f9042553700 1 -- 172.21.15.26:0/2630271676 shutdown_connections 2021-11-03T18:25:26.605 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.605+0000 7f9042553700 1 --2- 172.21.15.26:0/2630271676 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f903c0f6860 0x7f903c0f6cc0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:26.605 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.605+0000 7f9042553700 1 --2- 172.21.15.26:0/2630271676 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f903c0f55c0 0x7f903c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:26.605 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.605+0000 7f9042553700 1 -- 172.21.15.26:0/2630271676 >> 172.21.15.26:0/2630271676 conn(0x7f903c0f0d40 msgr2=0x7f903c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:25:26.605 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.605+0000 7f9042553700 1 -- 172.21.15.26:0/2630271676 shutdown_connections 2021-11-03T18:25:26.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.605+0000 7f9042553700 1 -- 172.21.15.26:0/2630271676 wait complete. 2021-11-03T18:25:26.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.605+0000 7f9042553700 1 Processor -- start 2021-11-03T18:25:26.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.605+0000 7f9042553700 1 -- start start 2021-11-03T18:25:26.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.606+0000 7f9042553700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f903c0f55c0 0x7f903c105ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:25:26.607 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.606+0000 7f9042553700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f903c0f6860 0x7f903c1063c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:25:26.607 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.606+0000 7f9042553700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903c1069c0 con 0x7f903c0f55c0 2021-11-03T18:25:26.607 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.606+0000 7f9042553700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903c1071d0 con 0x7f903c0f6860 2021-11-03T18:25:26.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.606+0000 7f903bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f903c0f55c0 0x7f903c105ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:25:26.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.606+0000 7f903bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f903c0f55c0 0x7f903c105ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59938/0 (socket says 172.21.15.26:59938) 2021-11-03T18:25:26.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.606+0000 7f903bfff700 1 -- 172.21.15.26:0/1965404511 learned_addr learned my addr 172.21.15.26:0/1965404511 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:25:26.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.606+0000 7f903b7fe700 1 --2- 172.21.15.26:0/1965404511 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f903c0f6860 0x7f903c1063c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:25:26.610 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.606+0000 7f903bfff700 1 -- 172.21.15.26:0/1965404511 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f903c0f6860 msgr2=0x7f903c1063c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:25:26.610 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.606+0000 7f903bfff700 1 --2- 172.21.15.26:0/1965404511 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f903c0f6860 0x7f903c1063c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:26.610 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.606+0000 7f903bfff700 1 -- 172.21.15.26:0/1965404511 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9030005040 con 0x7f903c0f55c0 2021-11-03T18:25:26.610 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.606+0000 7f903bfff700 1 --2- 172.21.15.26:0/1965404511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f903c0f55c0 0x7f903c105ed0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 rx=0x7f902c002700 tx=0x7f902c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:25:26.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.606+0000 7f9038ff9700 1 -- 172.21.15.26:0/1965404511 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f902c0079c0 con 0x7f903c0f55c0 2021-11-03T18:25:26.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.607+0000 7f9042553700 1 -- 172.21.15.26:0/1965404511 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f903c107450 con 0x7f903c0f55c0 2021-11-03T18:25:26.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.607+0000 7f9038ff9700 1 -- 172.21.15.26:0/1965404511 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f902c00f040 con 0x7f903c0f55c0 2021-11-03T18:25:26.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.607+0000 7f9038ff9700 1 -- 172.21.15.26:0/1965404511 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f902c014860 con 0x7f903c0f55c0 2021-11-03T18:25:26.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.607+0000 7f9042553700 1 -- 172.21.15.26:0/1965404511 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f903c107a10 con 0x7f903c0f55c0 2021-11-03T18:25:26.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.608+0000 7f9042553700 1 -- 172.21.15.26:0/1965404511 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f903c0f49b0 con 0x7f903c0f55c0 2021-11-03T18:25:26.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.608+0000 7f9038ff9700 1 -- 172.21.15.26:0/1965404511 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f902c01b060 con 0x7f903c0f55c0 2021-11-03T18:25:26.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.608+0000 7f9038ff9700 1 --2- 172.21.15.26:0/1965404511 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f90240640b0 0x7f9024066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:25:26.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.609+0000 7f9038ff9700 1 -- 172.21.15.26:0/1965404511 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f902c080670 con 0x7f903c0f55c0 2021-11-03T18:25:26.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.609+0000 7f903b7fe700 1 --2- 172.21.15.26:0/1965404511 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f90240640b0 0x7f9024066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:25:26.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.609+0000 7f903b7fe700 1 --2- 172.21.15.26:0/1965404511 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f90240640b0 0x7f9024066570 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7f9030004630 tx=0x7f9030009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:25:26.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.613+0000 7f9038ff9700 1 -- 172.21.15.26:0/1965404511 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f902c0529d0 con 0x7f903c0f55c0 2021-11-03T18:25:26.845 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.847+0000 7f9042553700 1 -- 172.21.15.26:0/1965404511 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f903c045ad0 con 0x7f903c0f55c0 2021-11-03T18:25:26.845 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.847+0000 7f9038ff9700 1 -- 172.21.15.26:0/1965404511 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f902c0192e0 con 0x7f903c0f55c0 2021-11-03T18:25:26.846 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:25:26.846 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:25:26.846 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:25:26.847 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:25:26.847 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:25:26.847 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:25:26.847 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:25:26.847 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:25:26.848 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:25:26.848 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:25:26.848 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:25:26.848 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:25:26.848 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:25:26.849 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:25:26.849 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:25:26.849 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:25:26.849 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:25:26.850 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:25:26.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.849+0000 7f9042553700 1 -- 172.21.15.26:0/1965404511 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f90240640b0 msgr2=0x7f9024066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:25:26.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.849+0000 7f9042553700 1 --2- 172.21.15.26:0/1965404511 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f90240640b0 0x7f9024066570 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7f9030004630 tx=0x7f9030009b30).stop 2021-11-03T18:25:26.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.849+0000 7f9042553700 1 -- 172.21.15.26:0/1965404511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f903c0f55c0 msgr2=0x7f903c105ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:25:26.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.849+0000 7f9042553700 1 --2- 172.21.15.26:0/1965404511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f903c0f55c0 0x7f903c105ed0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 rx=0x7f902c002700 tx=0x7f902c009d80).stop 2021-11-03T18:25:26.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.849+0000 7f9042553700 1 -- 172.21.15.26:0/1965404511 shutdown_connections 2021-11-03T18:25:26.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.849+0000 7f9042553700 1 --2- 172.21.15.26:0/1965404511 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f90240640b0 0x7f9024066570 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:26.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.849+0000 7f9042553700 1 --2- 172.21.15.26:0/1965404511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f903c0f55c0 0x7f903c105ed0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:26.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.849+0000 7f9042553700 1 --2- 172.21.15.26:0/1965404511 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f903c0f6860 0x7f903c1063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:26.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.849+0000 7f9042553700 1 -- 172.21.15.26:0/1965404511 >> 172.21.15.26:0/1965404511 conn(0x7f903c0f0d40 msgr2=0x7f903c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:25:26.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.849+0000 7f9042553700 1 -- 172.21.15.26:0/1965404511 shutdown_connections 2021-11-03T18:25:26.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.849+0000 7f9042553700 1 -- 172.21.15.26:0/1965404511 wait complete. 2021-11-03T18:25:26.950 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.950+0000 7fd4b6734700 1 -- 172.21.15.26:0/1285402862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4b00f66e0 msgr2=0x7fd4b00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:25:26.951 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.950+0000 7fd4b6734700 1 --2- 172.21.15.26:0/1285402862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4b00f66e0 0x7fd4b00f6b00 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 rx=0x7fd4a0004660 tx=0x7fd4a0009b30).stop 2021-11-03T18:25:26.951 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.950+0000 7fd4b6734700 1 -- 172.21.15.26:0/1285402862 shutdown_connections 2021-11-03T18:25:26.951 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.950+0000 7fd4b6734700 1 --2- 172.21.15.26:0/1285402862 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4b00f7980 0x7fd4b00f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:26.951 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.950+0000 7fd4b6734700 1 --2- 172.21.15.26:0/1285402862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4b00f66e0 0x7fd4b00f6b00 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:26.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.950+0000 7fd4b6734700 1 -- 172.21.15.26:0/1285402862 >> 172.21.15.26:0/1285402862 conn(0x7fd4b00f1e40 msgr2=0x7fd4b00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:25:26.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.950+0000 7fd4b6734700 1 -- 172.21.15.26:0/1285402862 shutdown_connections 2021-11-03T18:25:26.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.950+0000 7fd4b6734700 1 -- 172.21.15.26:0/1285402862 wait complete. 2021-11-03T18:25:26.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.950+0000 7fd4b6734700 1 Processor -- start 2021-11-03T18:25:26.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.951+0000 7fd4b6734700 1 -- start start 2021-11-03T18:25:26.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.951+0000 7fd4b6734700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4b00f66e0 0x7fd4b0106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:25:26.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.951+0000 7fd4b6734700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4b00f7980 0x7fd4b01074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:25:26.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.951+0000 7fd4b6734700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b0107a50 con 0x7fd4b00f7980 2021-11-03T18:25:26.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.951+0000 7fd4b6734700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b0107b90 con 0x7fd4b00f66e0 2021-11-03T18:25:26.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.951+0000 7fd4af7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4b00f7980 0x7fd4b01074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:25:26.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.951+0000 7fd4af7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4b00f7980 0x7fd4b01074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59950/0 (socket says 172.21.15.26:59950) 2021-11-03T18:25:26.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.951+0000 7fd4af7fe700 1 -- 172.21.15.26:0/3616150540 learned_addr learned my addr 172.21.15.26:0/3616150540 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:25:26.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.951+0000 7fd4affff700 1 --2- 172.21.15.26:0/3616150540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4b00f66e0 0x7fd4b0106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:25:26.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.951+0000 7fd4af7fe700 1 -- 172.21.15.26:0/3616150540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4b00f66e0 msgr2=0x7fd4b0106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:25:26.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.951+0000 7fd4af7fe700 1 --2- 172.21.15.26:0/3616150540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4b00f66e0 0x7fd4b0106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:26.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.951+0000 7fd4af7fe700 1 -- 172.21.15.26:0/3616150540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a0005040 con 0x7fd4b00f7980 2021-11-03T18:25:26.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.951+0000 7fd4affff700 1 --2- 172.21.15.26:0/3616150540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4b00f66e0 0x7fd4b0106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:25:26.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.951+0000 7fd4af7fe700 1 --2- 172.21.15.26:0/3616150540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4b00f7980 0x7fd4b01074a0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7fd4980026d0 tx=0x7fd498009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:25:26.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.952+0000 7fd4acff9700 1 -- 172.21.15.26:0/3616150540 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd498009320 con 0x7fd4b00f7980 2021-11-03T18:25:26.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.952+0000 7fd4acff9700 1 -- 172.21.15.26:0/3616150540 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd49800f040 con 0x7fd4b00f7980 2021-11-03T18:25:26.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.952+0000 7fd4b6734700 1 -- 172.21.15.26:0/3616150540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4b0108530 con 0x7fd4b00f7980 2021-11-03T18:25:26.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.952+0000 7fd4acff9700 1 -- 172.21.15.26:0/3616150540 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4980147e0 con 0x7fd4b00f7980 2021-11-03T18:25:26.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.952+0000 7fd4b6734700 1 -- 172.21.15.26:0/3616150540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4b0108af0 con 0x7fd4b00f7980 2021-11-03T18:25:26.957 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.953+0000 7fd4b6734700 1 -- 172.21.15.26:0/3616150540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4b0045ad0 con 0x7fd4b00f7980 2021-11-03T18:25:26.958 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.953+0000 7fd4acff9700 1 -- 172.21.15.26:0/3616150540 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fd498009480 con 0x7fd4b00f7980 2021-11-03T18:25:26.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.954+0000 7fd4acff9700 1 --2- 172.21.15.26:0/3616150540 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd49c0640b0 0x7fd49c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:25:26.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.954+0000 7fd4acff9700 1 -- 172.21.15.26:0/3616150540 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fd498080ee0 con 0x7fd4b00f7980 2021-11-03T18:25:26.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.954+0000 7fd4affff700 1 --2- 172.21.15.26:0/3616150540 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd49c0640b0 0x7fd49c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:25:26.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.954+0000 7fd4affff700 1 --2- 172.21.15.26:0/3616150540 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd49c0640b0 0x7fd49c066570 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7fd4a0005010 tx=0x7fd4a0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:25:26.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:26.958+0000 7fd4acff9700 1 -- 172.21.15.26:0/3616150540 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fd498053240 con 0x7fd4b00f7980 2021-11-03T18:25:27.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:27.162+0000 7fd4b6734700 1 -- 172.21.15.26:0/3616150540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd4b0027a00 con 0x7fd4b00f7980 2021-11-03T18:25:27.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:27.162+0000 7fd4acff9700 1 -- 172.21.15.26:0/3616150540 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fd498052e30 con 0x7fd4b00f7980 2021-11-03T18:25:27.161 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:25:27.161 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:25:27.161 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:25:27.161 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:25:27.162 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:25:27.162 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:25:27.162 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:25:27.162 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:25:27.162 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:25:27.163 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:25:27.163 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:25:27.163 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:25:27.163 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:25:27.164 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:25:27.164 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:25:27.164 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:25:27.164 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:25:27.164 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:25:27.165 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:25:27.165 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:25:27.165 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:25:27.165 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:25:27.166 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:25:27.166 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:25:27.166 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:25:27.166 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:25:27.167 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:25:27.167 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:25:27.167 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:25:27.167 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:25:27.167 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:25:27.168 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:25:27.168 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:25:27.168 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:25:27.168 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:25:27.169 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:25:27.169 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:25:27.169 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:25:27.169 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:25:27.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:27.164+0000 7fd4b6734700 1 -- 172.21.15.26:0/3616150540 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd49c0640b0 msgr2=0x7fd49c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:25:27.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:27.164+0000 7fd4b6734700 1 --2- 172.21.15.26:0/3616150540 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd49c0640b0 0x7fd49c066570 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7fd4a0005010 tx=0x7fd4a0009b30).stop 2021-11-03T18:25:27.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:27.164+0000 7fd4b6734700 1 -- 172.21.15.26:0/3616150540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4b00f7980 msgr2=0x7fd4b01074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:25:27.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:27.164+0000 7fd4b6734700 1 --2- 172.21.15.26:0/3616150540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4b00f7980 0x7fd4b01074a0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7fd4980026d0 tx=0x7fd498009de0).stop 2021-11-03T18:25:27.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:27.164+0000 7fd4b6734700 1 -- 172.21.15.26:0/3616150540 shutdown_connections 2021-11-03T18:25:27.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:27.164+0000 7fd4b6734700 1 --2- 172.21.15.26:0/3616150540 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd49c0640b0 0x7fd49c066570 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:27.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:27.164+0000 7fd4b6734700 1 --2- 172.21.15.26:0/3616150540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4b00f66e0 0x7fd4b0106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:27.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:27.164+0000 7fd4b6734700 1 --2- 172.21.15.26:0/3616150540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4b00f7980 0x7fd4b01074a0 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:27.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:27.164+0000 7fd4b6734700 1 -- 172.21.15.26:0/3616150540 >> 172.21.15.26:0/3616150540 conn(0x7fd4b00f1e40 msgr2=0x7fd4b00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:25:27.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:27.164+0000 7fd4b6734700 1 -- 172.21.15.26:0/3616150540 shutdown_connections 2021-11-03T18:25:27.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:27.164+0000 7fd4b6734700 1 -- 172.21.15.26:0/3616150540 wait complete. 2021-11-03T18:25:27.173 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:25:27.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:27 smithi026 ceph-mon[96795]: pgmap v2723: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:27.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:27 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:25:27.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:27 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:25:27.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:27 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:25:27.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:27 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:25:27.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:27 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:25:27.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:27 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:25:27.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:27 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:25:27.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:27 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:25:27.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:27 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1965404511' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:25:27.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:27 smithi194 ceph-mon[65619]: pgmap v2723: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:27.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:27 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:25:27.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:27 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:25:27.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:27 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:25:27.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:27 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:25:27.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:27 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:25:27.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:27 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:25:27.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:27 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:25:27.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:27 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:25:27.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:27 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1965404511' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:25:28.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:28 smithi026 ceph-mon[96795]: from='client.36940 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:25:28.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:28 smithi026 ceph-mon[96795]: poll took 60058.729 ms: 1 events 2021-11-03T18:25:28.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:28 smithi026 ceph-mon[96795]: from='client.36944 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:25:28.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:28 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:25:28.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:28 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:25:28.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:28 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3616150540' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:25:28.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:28 smithi194 ceph-mon[65619]: from='client.36940 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:25:28.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:28 smithi194 ceph-mon[65619]: poll took 60058.729 ms: 1 events 2021-11-03T18:25:28.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:28 smithi194 ceph-mon[65619]: from='client.36944 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:25:28.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:28 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:25:28.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:28 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:25:28.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:28 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3616150540' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:25:29.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:29 smithi026 ceph-mon[96795]: pgmap v2724: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:29.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:29 smithi194 ceph-mon[65619]: pgmap v2724: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:31.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:31 smithi026 ceph-mon[96795]: pgmap v2725: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:31.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:31 smithi194 ceph-mon[65619]: pgmap v2725: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:33.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:33 smithi026 ceph-mon[96795]: pgmap v2726: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:33.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:33 smithi194 ceph-mon[65619]: pgmap v2726: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:35.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:35 smithi026 ceph-mon[96795]: pgmap v2727: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:35.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:35 smithi194 ceph-mon[65619]: pgmap v2727: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:37.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:37 smithi026 ceph-mon[96795]: pgmap v2728: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:37.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:37 smithi194 ceph-mon[65619]: pgmap v2728: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:39.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:39 smithi026 ceph-mon[96795]: pgmap v2729: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:39.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:39 smithi194 ceph-mon[65619]: pgmap v2729: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:41.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:41 smithi026 ceph-mon[96795]: pgmap v2730: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:41.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:41 smithi194 ceph-mon[65619]: pgmap v2730: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:42.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:25:42.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:25:43.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:43 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:25:43.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:43 smithi026 ceph-mon[96795]: pgmap v2731: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:43.473 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:43 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:25:43.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:43 smithi194 ceph-mon[65619]: pgmap v2731: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:45.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:45 smithi026 ceph-mon[96795]: pgmap v2732: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:45.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:45 smithi194 ceph-mon[65619]: pgmap v2732: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:47.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:47 smithi026 ceph-mon[96795]: pgmap v2733: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:47.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:47 smithi194 ceph-mon[65619]: pgmap v2733: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:49.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:49 smithi026 ceph-mon[96795]: pgmap v2734: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:25:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:25:49.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:49 smithi194 ceph-mon[65619]: pgmap v2734: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:25:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:25:51.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:51 smithi026 ceph-mon[96795]: pgmap v2735: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:51.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:51 smithi194 ceph-mon[65619]: pgmap v2735: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:53.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:53 smithi026 ceph-mon[96795]: pgmap v2736: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:53.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:53 smithi194 ceph-mon[65619]: pgmap v2736: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:55.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:55 smithi026 ceph-mon[96795]: pgmap v2737: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:55.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:55 smithi194 ceph-mon[65619]: pgmap v2737: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:57.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.278+0000 7fc6973bc700 1 -- 172.21.15.26:0/14279028 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6900f6540 msgr2=0x7fc6900f69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:25:57.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.278+0000 7fc6973bc700 1 --2- 172.21.15.26:0/14279028 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6900f6540 0x7fc6900f69c0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 rx=0x7fc68c004660 tx=0x7fc68c009b30).stop 2021-11-03T18:25:57.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.278+0000 7fc6973bc700 1 -- 172.21.15.26:0/14279028 shutdown_connections 2021-11-03T18:25:57.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.278+0000 7fc6973bc700 1 --2- 172.21.15.26:0/14279028 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6900f6540 0x7fc6900f69c0 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:57.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.278+0000 7fc6973bc700 1 --2- 172.21.15.26:0/14279028 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6900f5c30 0x7fc6900f6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:57.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.278+0000 7fc6973bc700 1 -- 172.21.15.26:0/14279028 >> 172.21.15.26:0/14279028 conn(0x7fc6900f0540 msgr2=0x7fc6900f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:25:57.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.278+0000 7fc6973bc700 1 -- 172.21.15.26:0/14279028 shutdown_connections 2021-11-03T18:25:57.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.278+0000 7fc6973bc700 1 -- 172.21.15.26:0/14279028 wait complete. 2021-11-03T18:25:57.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.279+0000 7fc6973bc700 1 Processor -- start 2021-11-03T18:25:57.282 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.279+0000 7fc6973bc700 1 -- start start 2021-11-03T18:25:57.282 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.279+0000 7fc6973bc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6900f5c30 0x7fc690109c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:25:57.282 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.279+0000 7fc6973bc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6900f6540 0x7fc69010c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:25:57.282 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.279+0000 7fc6973bc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900f5720 con 0x7fc6900f5c30 2021-11-03T18:25:57.282 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.279+0000 7fc6973bc700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900f5860 con 0x7fc6900f6540 2021-11-03T18:25:57.283 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.279+0000 7fc695158700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6900f5c30 0x7fc690109c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:25:57.283 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.279+0000 7fc695158700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6900f5c30 0x7fc690109c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59980/0 (socket says 172.21.15.26:59980) 2021-11-03T18:25:57.283 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.279+0000 7fc695158700 1 -- 172.21.15.26:0/3714508292 learned_addr learned my addr 172.21.15.26:0/3714508292 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:25:57.283 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.280+0000 7fc694957700 1 --2- 172.21.15.26:0/3714508292 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6900f6540 0x7fc69010c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:25:57.284 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.280+0000 7fc695158700 1 -- 172.21.15.26:0/3714508292 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6900f6540 msgr2=0x7fc69010c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:25:57.284 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.280+0000 7fc695158700 1 --2- 172.21.15.26:0/3714508292 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6900f6540 0x7fc69010c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:57.284 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.280+0000 7fc695158700 1 -- 172.21.15.26:0/3714508292 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc68c005040 con 0x7fc6900f5c30 2021-11-03T18:25:57.284 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.280+0000 7fc695158700 1 --2- 172.21.15.26:0/3714508292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6900f5c30 0x7fc690109c20 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7fc6800026d0 tx=0x7fc680009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:25:57.285 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.280+0000 7fc685ffb700 1 -- 172.21.15.26:0/3714508292 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc680009320 con 0x7fc6900f5c30 2021-11-03T18:25:57.285 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.280+0000 7fc6973bc700 1 -- 172.21.15.26:0/3714508292 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc69010c6d0 con 0x7fc6900f5c30 2021-11-03T18:25:57.285 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.280+0000 7fc685ffb700 1 -- 172.21.15.26:0/3714508292 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc68000f040 con 0x7fc6900f5c30 2021-11-03T18:25:57.285 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.280+0000 7fc685ffb700 1 -- 172.21.15.26:0/3714508292 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6800147e0 con 0x7fc6900f5c30 2021-11-03T18:25:57.285 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.280+0000 7fc6973bc700 1 -- 172.21.15.26:0/3714508292 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc69010cc90 con 0x7fc6900f5c30 2021-11-03T18:25:57.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.281+0000 7fc6973bc700 1 -- 172.21.15.26:0/3714508292 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc690045ad0 con 0x7fc6900f5c30 2021-11-03T18:25:57.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.282+0000 7fc685ffb700 1 -- 172.21.15.26:0/3714508292 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc680009480 con 0x7fc6900f5c30 2021-11-03T18:25:57.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.282+0000 7fc685ffb700 1 --2- 172.21.15.26:0/3714508292 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc67c0640b0 0x7fc67c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:25:57.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.282+0000 7fc685ffb700 1 -- 172.21.15.26:0/3714508292 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc680080eb0 con 0x7fc6900f5c30 2021-11-03T18:25:57.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.282+0000 7fc694957700 1 --2- 172.21.15.26:0/3714508292 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc67c0640b0 0x7fc67c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:25:57.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.282+0000 7fc694957700 1 --2- 172.21.15.26:0/3714508292 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc67c0640b0 0x7fc67c066570 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7fc68c004630 tx=0x7fc68c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:25:57.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.286+0000 7fc685ffb700 1 -- 172.21.15.26:0/3714508292 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc680053210 con 0x7fc6900f5c30 2021-11-03T18:25:57.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:57 smithi026 ceph-mon[96795]: pgmap v2738: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:57.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:57 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:25:57.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.465+0000 7fc6973bc700 1 -- 172.21.15.26:0/3714508292 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6900fdf60 con 0x7fc67c0640b0 2021-11-03T18:25:57.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.466+0000 7fc685ffb700 1 -- 172.21.15.26:0/3714508292 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fc68c019040 con 0x7fc67c0640b0 2021-11-03T18:25:57.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.468+0000 7fc6973bc700 1 -- 172.21.15.26:0/3714508292 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc67c0640b0 msgr2=0x7fc67c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:25:57.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.468+0000 7fc6973bc700 1 --2- 172.21.15.26:0/3714508292 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc67c0640b0 0x7fc67c066570 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7fc68c004630 tx=0x7fc68c009b30).stop 2021-11-03T18:25:57.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.468+0000 7fc6973bc700 1 -- 172.21.15.26:0/3714508292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6900f5c30 msgr2=0x7fc690109c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:25:57.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.468+0000 7fc6973bc700 1 --2- 172.21.15.26:0/3714508292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6900f5c30 0x7fc690109c20 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7fc6800026d0 tx=0x7fc680009de0).stop 2021-11-03T18:25:57.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.468+0000 7fc6973bc700 1 -- 172.21.15.26:0/3714508292 shutdown_connections 2021-11-03T18:25:57.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.468+0000 7fc6973bc700 1 --2- 172.21.15.26:0/3714508292 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc67c0640b0 0x7fc67c066570 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:57.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.468+0000 7fc6973bc700 1 --2- 172.21.15.26:0/3714508292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6900f5c30 0x7fc690109c20 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:57.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.468+0000 7fc6973bc700 1 --2- 172.21.15.26:0/3714508292 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6900f6540 0x7fc69010c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:57.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.468+0000 7fc6973bc700 1 -- 172.21.15.26:0/3714508292 >> 172.21.15.26:0/3714508292 conn(0x7fc6900f0540 msgr2=0x7fc6900fa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:25:57.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.468+0000 7fc6973bc700 1 -- 172.21.15.26:0/3714508292 shutdown_connections 2021-11-03T18:25:57.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.468+0000 7fc6973bc700 1 -- 172.21.15.26:0/3714508292 wait complete. 2021-11-03T18:25:57.476 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:25:57.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:57 smithi194 ceph-mon[65619]: pgmap v2738: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:57.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:57 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:25:57.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.568+0000 7f8eeb61e700 1 -- 172.21.15.26:0/308768766 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ee40f6ff0 msgr2=0x7f8ee40f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:25:57.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.568+0000 7f8eeb61e700 1 --2- 172.21.15.26:0/308768766 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ee40f6ff0 0x7f8ee40f7a20 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 rx=0x7f8ee0004660 tx=0x7f8ee0009b30).stop 2021-11-03T18:25:57.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.568+0000 7f8eeb61e700 1 -- 172.21.15.26:0/308768766 shutdown_connections 2021-11-03T18:25:57.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.568+0000 7f8eeb61e700 1 --2- 172.21.15.26:0/308768766 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ee40f6ff0 0x7f8ee40f7a20 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:57.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.568+0000 7f8eeb61e700 1 --2- 172.21.15.26:0/308768766 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ee40f66e0 0x7f8ee40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:25:57.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.568+0000 7f8eeb61e700 1 -- 172.21.15.26:0/308768766 >> 172.21.15.26:0/308768766 conn(0x7f8ee40f1f00 msgr2=0x7f8ee40f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:25:57.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.568+0000 7f8eeb61e700 1 -- 172.21.15.26:0/308768766 shutdown_connections 2021-11-03T18:25:57.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.568+0000 7f8eeb61e700 1 -- 172.21.15.26:0/308768766 wait complete. 2021-11-03T18:25:57.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.568+0000 7f8eeb61e700 1 Processor -- start 2021-11-03T18:25:57.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.569+0000 7f8eeb61e700 1 -- start start 2021-11-03T18:25:57.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.569+0000 7f8eeb61e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ee40f66e0 0x7f8ee4106fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:25:57.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.569+0000 7f8eeb61e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ee40f6ff0 0x7f8ee4107490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:25:57.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.569+0000 7f8eeb61e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee4107ad0 con 0x7f8ee40f6ff0 2021-11-03T18:25:57.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.569+0000 7f8eeb61e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee4108380 con 0x7f8ee40f66e0 2021-11-03T18:25:57.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.569+0000 7f8ee8bb9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ee40f6ff0 0x7f8ee4107490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:25:57.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.569+0000 7f8ee8bb9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ee40f6ff0 0x7f8ee4107490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59992/0 (socket says 172.21.15.26:59992) 2021-11-03T18:25:57.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.569+0000 7f8ee8bb9700 1 -- 172.21.15.26:0/2494490164 learned_addr learned my addr 172.21.15.26:0/2494490164 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:25:57.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.569+0000 7f8ee93ba700 1 --2- 172.21.15.26:0/2494490164 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ee40f66e0 0x7f8ee4106fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:25:57.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.569+0000 7f8ee8bb9700 1 -- 172.21.15.26:0/2494490164 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ee40f66e0 msgr2=0x7f8ee4106fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:25:57.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.569+0000 7f8ee8bb9700 1 --2- 172.21.15.26:0/2494490164 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ee40f66e0 0x7f8ee4106fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:57.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.569+0000 7f8ee8bb9700 1 -- 172.21.15.26:0/2494490164 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee0005040 con 0x7f8ee40f6ff0 2021-11-03T18:25:57.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.569+0000 7f8ee8bb9700 1 --2- 172.21.15.26:0/2494490164 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ee40f6ff0 0x7f8ee4107490 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 rx=0x7f8ee0009990 tx=0x7f8ee0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:25:57.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.569+0000 7f8ed9ffb700 1 -- 172.21.15.26:0/2494490164 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ee0018070 con 0x7f8ee40f6ff0 2021-11-03T18:25:57.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.569+0000 7f8ed9ffb700 1 -- 172.21.15.26:0/2494490164 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8ee0007ca0 con 0x7f8ee40f6ff0 2021-11-03T18:25:57.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.569+0000 7f8eeb61e700 1 -- 172.21.15.26:0/2494490164 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ee4108600 con 0x7f8ee40f6ff0 2021-11-03T18:25:57.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.570+0000 7f8ed9ffb700 1 -- 172.21.15.26:0/2494490164 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ee001c620 con 0x7f8ee40f6ff0 2021-11-03T18:25:57.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.570+0000 7f8eeb61e700 1 -- 172.21.15.26:0/2494490164 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ee4108b60 con 0x7f8ee40f6ff0 2021-11-03T18:25:57.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.571+0000 7f8eeb61e700 1 -- 172.21.15.26:0/2494490164 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ee40f5b70 con 0x7f8ee40f6ff0 2021-11-03T18:25:57.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.571+0000 7f8ed9ffb700 1 -- 172.21.15.26:0/2494490164 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f8ee001d960 con 0x7f8ee40f6ff0 2021-11-03T18:25:57.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.571+0000 7f8ed9ffb700 1 --2- 172.21.15.26:0/2494490164 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8ed00640b0 0x7f8ed0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:25:57.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.571+0000 7f8ed9ffb700 1 -- 172.21.15.26:0/2494490164 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f8ee00825e0 con 0x7f8ee40f6ff0 2021-11-03T18:25:57.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.572+0000 7f8ee93ba700 1 --2- 172.21.15.26:0/2494490164 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8ed00640b0 0x7f8ed0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:25:57.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.572+0000 7f8ee93ba700 1 --2- 172.21.15.26:0/2494490164 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8ed00640b0 0x7f8ed0066570 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f8ed400b790 tx=0x7f8ed4008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:25:57.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.576+0000 7f8ed9ffb700 1 -- 172.21.15.26:0/2494490164 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f8ee0054940 con 0x7f8ee40f6ff0 2021-11-03T18:25:57.747 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.748+0000 7f8eeb61e700 1 -- 172.21.15.26:0/2494490164 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ee40fef50 con 0x7f8ed00640b0 2021-11-03T18:25:57.762 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.763+0000 7f8ed9ffb700 1 -- 172.21.15.26:0/2494490164 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f8ee40fef50 con 0x7f8ed00640b0 2021-11-03T18:25:57.762 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:25:57.763 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (97m) 5m ago 98m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:25:57.763 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (89m) 5m ago 98m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:25:57.763 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (89m) 4m ago 97m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:25:57.763 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (97m) 5m ago 98m 42.2M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:25:57.764 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (90m) 5m ago 93m 26.0M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:25:57.764 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (90m) 5m ago 93m 26.6M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:25:57.764 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (93m) 4m ago 93m 26.8M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:25:57.764 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (93m) 4m ago 93m 27.2M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:25:57.765 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (90m) 5m ago 99m 588M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:25:57.765 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (90m) 4m ago 97m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:25:57.765 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (90m) 5m ago 99m 341M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:25:57.765 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (89m) 4m ago 97m 158M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:25:57.766 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (98m) 5m ago 98m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:25:57.766 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (97m) 4m ago 97m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:25:57.766 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (89m) 5m ago 96m 332M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:25:57.766 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (88m) 5m ago 96m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:25:57.766 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (87m) 5m ago 96m 296M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:25:57.767 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (87m) 4m ago 95m 387M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:25:57.767 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (87m) 4m ago 95m 320M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:25:57.767 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (86m) 4m ago 95m 316M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:25:57.767 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (96m) 5m ago 97m 65.7M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:25:57.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.765+0000 7f8eeb61e700 1 -- 172.21.15.26:0/2494490164 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8ed00640b0 msgr2=0x7f8ed0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:25:57.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.765+0000 7f8eeb61e700 1 --2- 172.21.15.26:0/2494490164 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8ed00640b0 0x7f8ed0066570 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f8ed400b790 tx=0x7f8ed4008040).stop 2021-11-03T18:25:57.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.765+0000 7f8eeb61e700 1 -- 172.21.15.26:0/2494490164 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ee40f6ff0 msgr2=0x7f8ee4107490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:25:57.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.765+0000 7f8eeb61e700 1 --2- 172.21.15.26:0/2494490164 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ee40f6ff0 0x7f8ee4107490 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 rx=0x7f8ee0009990 tx=0x7f8ee0009b30).stop 2021-11-03T18:25:57.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.765+0000 7f8eeb61e700 1 -- 172.21.15.26:0/2494490164 shutdown_connections 2021-11-03T18:25:57.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.765+0000 7f8eeb61e700 1 --2- 172.21.15.26:0/2494490164 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8ed00640b0 0x7f8ed0066570 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:57.770 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.765+0000 7f8eeb61e700 1 --2- 172.21.15.26:0/2494490164 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ee40f66e0 0x7f8ee4106fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:57.770 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.765+0000 7f8eeb61e700 1 --2- 172.21.15.26:0/2494490164 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ee40f6ff0 0x7f8ee4107490 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:57.770 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.765+0000 7f8eeb61e700 1 -- 172.21.15.26:0/2494490164 >> 172.21.15.26:0/2494490164 conn(0x7f8ee40f1f00 msgr2=0x7f8ee40fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:25:57.770 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.765+0000 7f8eeb61e700 1 -- 172.21.15.26:0/2494490164 shutdown_connections 2021-11-03T18:25:57.771 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.765+0000 7f8eeb61e700 1 -- 172.21.15.26:0/2494490164 wait complete. 2021-11-03T18:25:57.865 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.864+0000 7fbc0807b700 1 -- 172.21.15.26:0/4233049912 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc000f6870 msgr2=0x7fbc000f6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:25:57.866 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.864+0000 7fbc0807b700 1 --2- 172.21.15.26:0/4233049912 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc000f6870 0x7fbc000f6cd0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 rx=0x7fbbf4004660 tx=0x7fbbf4009b30).stop 2021-11-03T18:25:57.866 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.864+0000 7fbc0807b700 1 -- 172.21.15.26:0/4233049912 shutdown_connections 2021-11-03T18:25:57.866 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.864+0000 7fbc0807b700 1 --2- 172.21.15.26:0/4233049912 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc000f6870 0x7fbc000f6cd0 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:57.866 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.864+0000 7fbc0807b700 1 --2- 172.21.15.26:0/4233049912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc000f55d0 0x7fbc000f59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:57.867 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.864+0000 7fbc0807b700 1 -- 172.21.15.26:0/4233049912 >> 172.21.15.26:0/4233049912 conn(0x7fbc000f0d70 msgr2=0x7fbc000f3190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:25:57.867 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.864+0000 7fbc0807b700 1 -- 172.21.15.26:0/4233049912 shutdown_connections 2021-11-03T18:25:57.867 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.864+0000 7fbc0807b700 1 -- 172.21.15.26:0/4233049912 wait complete. 2021-11-03T18:25:57.867 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.865+0000 7fbc0807b700 1 Processor -- start 2021-11-03T18:25:57.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.865+0000 7fbc0807b700 1 -- start start 2021-11-03T18:25:57.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.865+0000 7fbc0807b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc000f55d0 0x7fbc00109c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:25:57.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.865+0000 7fbc0807b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc000f6870 0x7fbc0010c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:25:57.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.865+0000 7fbc0807b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc00060520 con 0x7fbc000f6870 2021-11-03T18:25:57.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.865+0000 7fbc0807b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc00060660 con 0x7fbc000f55d0 2021-11-03T18:25:57.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.865+0000 7fbc05616700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc000f6870 0x7fbc0010c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:25:57.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.865+0000 7fbc05616700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc000f6870 0x7fbc0010c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60002/0 (socket says 172.21.15.26:60002) 2021-11-03T18:25:57.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.865+0000 7fbc05616700 1 -- 172.21.15.26:0/3295811660 learned_addr learned my addr 172.21.15.26:0/3295811660 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:25:57.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.865+0000 7fbc05e17700 1 --2- 172.21.15.26:0/3295811660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc000f55d0 0x7fbc00109c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:25:57.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.865+0000 7fbc05616700 1 -- 172.21.15.26:0/3295811660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc000f55d0 msgr2=0x7fbc00109c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:25:57.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.865+0000 7fbc05616700 1 --2- 172.21.15.26:0/3295811660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc000f55d0 0x7fbc00109c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:57.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.865+0000 7fbc05616700 1 -- 172.21.15.26:0/3295811660 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf4005040 con 0x7fbc000f6870 2021-11-03T18:25:57.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.865+0000 7fbc05e17700 1 --2- 172.21.15.26:0/3295811660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc000f55d0 0x7fbc00109c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:25:57.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.866+0000 7fbc05616700 1 --2- 172.21.15.26:0/3295811660 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc000f6870 0x7fbc0010c120 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7fbbf4009990 tx=0x7fbbf4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:25:57.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.866+0000 7fbbfe7fc700 1 -- 172.21.15.26:0/3295811660 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbf4018070 con 0x7fbc000f6870 2021-11-03T18:25:57.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.866+0000 7fbbfe7fc700 1 -- 172.21.15.26:0/3295811660 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbbf4007ca0 con 0x7fbc000f6870 2021-11-03T18:25:57.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.866+0000 7fbc0807b700 1 -- 172.21.15.26:0/3295811660 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc0010c670 con 0x7fbc000f6870 2021-11-03T18:25:57.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.866+0000 7fbbfe7fc700 1 -- 172.21.15.26:0/3295811660 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbf401c620 con 0x7fbc000f6870 2021-11-03T18:25:57.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.866+0000 7fbc0807b700 1 -- 172.21.15.26:0/3295811660 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc0010cbd0 con 0x7fbc000f6870 2021-11-03T18:25:57.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.867+0000 7fbc0807b700 1 -- 172.21.15.26:0/3295811660 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc00045ad0 con 0x7fbc000f6870 2021-11-03T18:25:57.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.867+0000 7fbbfe7fc700 1 -- 172.21.15.26:0/3295811660 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fbbf401d960 con 0x7fbc000f6870 2021-11-03T18:25:57.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.868+0000 7fbbfe7fc700 1 --2- 172.21.15.26:0/3295811660 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbbe80640b0 0x7fbbe8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:25:57.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.868+0000 7fbbfe7fc700 1 -- 172.21.15.26:0/3295811660 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fbbf4082470 con 0x7fbc000f6870 2021-11-03T18:25:57.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.868+0000 7fbc05e17700 1 --2- 172.21.15.26:0/3295811660 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbbe80640b0 0x7fbbe8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:25:57.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.868+0000 7fbc05e17700 1 --2- 172.21.15.26:0/3295811660 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbbe80640b0 0x7fbbe8066570 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7fbbf8007fd0 tx=0x7fbbf8009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:25:57.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:57.872+0000 7fbbfe7fc700 1 -- 172.21.15.26:0/3295811660 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fbbf4054890 con 0x7fbc000f6870 2021-11-03T18:25:58.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.105+0000 7fbc0807b700 1 -- 172.21.15.26:0/3295811660 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbc00027a00 con 0x7fbc000f6870 2021-11-03T18:25:58.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.106+0000 7fbbfe7fc700 1 -- 172.21.15.26:0/3295811660 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fbbf4054480 con 0x7fbc000f6870 2021-11-03T18:25:58.105 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:25:58.106 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:25:58.106 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:25:58.106 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:25:58.106 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:25:58.107 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:25:58.107 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:25:58.107 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:25:58.107 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:25:58.108 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:25:58.108 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:25:58.108 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:25:58.108 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:25:58.108 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:25:58.109 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:25:58.109 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:25:58.109 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:25:58.109 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:25:58.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.108+0000 7fbc0807b700 1 -- 172.21.15.26:0/3295811660 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbbe80640b0 msgr2=0x7fbbe8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:25:58.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.108+0000 7fbc0807b700 1 --2- 172.21.15.26:0/3295811660 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbbe80640b0 0x7fbbe8066570 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7fbbf8007fd0 tx=0x7fbbf8009040).stop 2021-11-03T18:25:58.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.108+0000 7fbc0807b700 1 -- 172.21.15.26:0/3295811660 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc000f6870 msgr2=0x7fbc0010c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:25:58.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.108+0000 7fbc0807b700 1 --2- 172.21.15.26:0/3295811660 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc000f6870 0x7fbc0010c120 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7fbbf4009990 tx=0x7fbbf4009b30).stop 2021-11-03T18:25:58.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.108+0000 7fbc0807b700 1 -- 172.21.15.26:0/3295811660 shutdown_connections 2021-11-03T18:25:58.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.108+0000 7fbc0807b700 1 --2- 172.21.15.26:0/3295811660 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbbe80640b0 0x7fbbe8066570 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:58.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.108+0000 7fbc0807b700 1 --2- 172.21.15.26:0/3295811660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc000f55d0 0x7fbc00109c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:58.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.108+0000 7fbc0807b700 1 --2- 172.21.15.26:0/3295811660 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc000f6870 0x7fbc0010c120 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:58.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.108+0000 7fbc0807b700 1 -- 172.21.15.26:0/3295811660 >> 172.21.15.26:0/3295811660 conn(0x7fbc000f0d70 msgr2=0x7fbc000fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:25:58.113 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.108+0000 7fbc0807b700 1 -- 172.21.15.26:0/3295811660 shutdown_connections 2021-11-03T18:25:58.113 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.108+0000 7fbc0807b700 1 -- 172.21.15.26:0/3295811660 wait complete. 2021-11-03T18:25:58.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.211+0000 7fda1625f700 1 -- 172.21.15.26:0/2381508840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda100f7960 msgr2=0x7fda100f7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:25:58.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.211+0000 7fda1625f700 1 --2- 172.21.15.26:0/2381508840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda100f7960 0x7fda100f7dc0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 rx=0x7fd9f8004660 tx=0x7fd9f8009b30).stop 2021-11-03T18:25:58.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.211+0000 7fda1625f700 1 -- 172.21.15.26:0/2381508840 shutdown_connections 2021-11-03T18:25:58.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.211+0000 7fda1625f700 1 --2- 172.21.15.26:0/2381508840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda100f7960 0x7fda100f7dc0 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:58.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.211+0000 7fda1625f700 1 --2- 172.21.15.26:0/2381508840 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda100f66c0 0x7fda100f6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:58.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.211+0000 7fda1625f700 1 -- 172.21.15.26:0/2381508840 >> 172.21.15.26:0/2381508840 conn(0x7fda100f1e20 msgr2=0x7fda100f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:25:58.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.211+0000 7fda1625f700 1 -- 172.21.15.26:0/2381508840 shutdown_connections 2021-11-03T18:25:58.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.211+0000 7fda1625f700 1 -- 172.21.15.26:0/2381508840 wait complete. 2021-11-03T18:25:58.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.212+0000 7fda1625f700 1 Processor -- start 2021-11-03T18:25:58.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.212+0000 7fda1625f700 1 -- start start 2021-11-03T18:25:58.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.212+0000 7fda1625f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda100f66c0 0x7fda1006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:25:58.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.212+0000 7fda1625f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda100f7960 0x7fda10069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:25:58.216 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.212+0000 7fda1625f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1006a380 con 0x7fda100f66c0 2021-11-03T18:25:58.216 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.212+0000 7fda1625f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1006a4c0 con 0x7fda100f7960 2021-11-03T18:25:58.216 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.212+0000 7fda0f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda100f66c0 0x7fda1006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:25:58.216 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.212+0000 7fda0f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda100f66c0 0x7fda1006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60008/0 (socket says 172.21.15.26:60008) 2021-11-03T18:25:58.216 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.212+0000 7fda0f7fe700 1 -- 172.21.15.26:0/2248117513 learned_addr learned my addr 172.21.15.26:0/2248117513 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:25:58.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.212+0000 7fda0effd700 1 --2- 172.21.15.26:0/2248117513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda100f7960 0x7fda10069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:25:58.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.213+0000 7fda0f7fe700 1 -- 172.21.15.26:0/2248117513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda100f7960 msgr2=0x7fda10069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:25:58.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.213+0000 7fda0f7fe700 1 --2- 172.21.15.26:0/2248117513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda100f7960 0x7fda10069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:58.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.213+0000 7fda0f7fe700 1 -- 172.21.15.26:0/2248117513 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f8005040 con 0x7fda100f66c0 2021-11-03T18:25:58.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.213+0000 7fda0effd700 1 --2- 172.21.15.26:0/2248117513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda100f7960 0x7fda10069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:25:58.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.213+0000 7fda0f7fe700 1 --2- 172.21.15.26:0/2248117513 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda100f66c0 0x7fda1006b9a0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7fda0000c510 tx=0x7fda00007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:25:58.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.213+0000 7fda07fff700 1 -- 172.21.15.26:0/2248117513 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda0000f650 con 0x7fda100f66c0 2021-11-03T18:25:58.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.213+0000 7fda1625f700 1 -- 172.21.15.26:0/2248117513 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda1006a7a0 con 0x7fda100f66c0 2021-11-03T18:25:58.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.213+0000 7fda07fff700 1 -- 172.21.15.26:0/2248117513 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fda0000fc60 con 0x7fda100f66c0 2021-11-03T18:25:58.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.213+0000 7fda07fff700 1 -- 172.21.15.26:0/2248117513 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda00012cb0 con 0x7fda100f66c0 2021-11-03T18:25:58.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.213+0000 7fda1625f700 1 -- 172.21.15.26:0/2248117513 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda1010efc0 con 0x7fda100f66c0 2021-11-03T18:25:58.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.214+0000 7fda1625f700 1 -- 172.21.15.26:0/2248117513 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda10045ad0 con 0x7fda100f66c0 2021-11-03T18:25:58.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.214+0000 7fda07fff700 1 -- 172.21.15.26:0/2248117513 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fda00010070 con 0x7fda100f66c0 2021-11-03T18:25:58.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.215+0000 7fda07fff700 1 --2- 172.21.15.26:0/2248117513 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd9fc0640b0 0x7fd9fc066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:25:58.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.215+0000 7fda07fff700 1 -- 172.21.15.26:0/2248117513 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fda00080370 con 0x7fda100f66c0 2021-11-03T18:25:58.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.215+0000 7fda0effd700 1 --2- 172.21.15.26:0/2248117513 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd9fc0640b0 0x7fd9fc066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:25:58.220 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.215+0000 7fda0effd700 1 --2- 172.21.15.26:0/2248117513 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd9fc0640b0 0x7fd9fc066570 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7fd9f8004e30 tx=0x7fd9f8009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:25:58.221 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.219+0000 7fda07fff700 1 -- 172.21.15.26:0/2248117513 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fda00052690 con 0x7fda100f66c0 2021-11-03T18:25:58.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.423+0000 7fda1625f700 1 -- 172.21.15.26:0/2248117513 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fda100ff020 con 0x7fda100f66c0 2021-11-03T18:25:58.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.424+0000 7fda07fff700 1 -- 172.21.15.26:0/2248117513 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fda00017710 con 0x7fda100f66c0 2021-11-03T18:25:58.423 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:25:58.424 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:25:58.424 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:25:58.424 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:25:58.424 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:25:58.425 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:25:58.425 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:25:58.425 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:25:58.425 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:25:58.425 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:25:58.426 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:25:58.426 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:25:58.426 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:25:58.426 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:25:58.427 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:25:58.427 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:25:58.427 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:25:58.427 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:25:58.428 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:25:58.428 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:25:58.428 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:25:58.428 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:25:58.428 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:25:58.429 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:25:58.429 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:25:58.429 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:25:58.429 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:25:58.430 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:25:58.430 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:25:58.430 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:25:58.430 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:25:58.431 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:25:58.431 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:25:58.431 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:25:58.431 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:25:58.431 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:25:58.432 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:25:58.432 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:25:58.432 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:25:58.433 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:58 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:25:58.433 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:58 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3295811660' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:25:58.434 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.426+0000 7fda1625f700 1 -- 172.21.15.26:0/2248117513 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd9fc0640b0 msgr2=0x7fd9fc066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:25:58.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.426+0000 7fda1625f700 1 --2- 172.21.15.26:0/2248117513 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd9fc0640b0 0x7fd9fc066570 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7fd9f8004e30 tx=0x7fd9f8009b30).stop 2021-11-03T18:25:58.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.426+0000 7fda1625f700 1 -- 172.21.15.26:0/2248117513 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda100f66c0 msgr2=0x7fda1006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:25:58.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.426+0000 7fda1625f700 1 --2- 172.21.15.26:0/2248117513 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda100f66c0 0x7fda1006b9a0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7fda0000c510 tx=0x7fda00007df0).stop 2021-11-03T18:25:58.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.426+0000 7fda1625f700 1 -- 172.21.15.26:0/2248117513 shutdown_connections 2021-11-03T18:25:58.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.426+0000 7fda1625f700 1 --2- 172.21.15.26:0/2248117513 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd9fc0640b0 0x7fd9fc066570 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:58.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.426+0000 7fda1625f700 1 --2- 172.21.15.26:0/2248117513 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda100f66c0 0x7fda1006b9a0 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:58.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.426+0000 7fda1625f700 1 --2- 172.21.15.26:0/2248117513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda100f7960 0x7fda10069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:25:58.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.426+0000 7fda1625f700 1 -- 172.21.15.26:0/2248117513 >> 172.21.15.26:0/2248117513 conn(0x7fda100f1e20 msgr2=0x7fda100fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:25:58.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.426+0000 7fda1625f700 1 -- 172.21.15.26:0/2248117513 shutdown_connections 2021-11-03T18:25:58.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:25:58.426+0000 7fda1625f700 1 -- 172.21.15.26:0/2248117513 wait complete. 2021-11-03T18:25:58.437 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:25:58.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:58 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:25:58.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:58 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3295811660' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:25:59.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:59 smithi026 ceph-mon[96795]: from='client.36956 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:25:59.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:59 smithi026 ceph-mon[96795]: from='client.36960 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:25:59.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:59 smithi026 ceph-mon[96795]: pgmap v2739: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:59.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:25:59 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2248117513' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:25:59.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:59 smithi194 ceph-mon[65619]: from='client.36956 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:25:59.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:59 smithi194 ceph-mon[65619]: from='client.36960 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:25:59.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:59 smithi194 ceph-mon[65619]: pgmap v2739: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:25:59.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:25:59 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2248117513' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:26:01.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:01 smithi026 ceph-mon[96795]: pgmap v2740: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:01.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:01 smithi194 ceph-mon[65619]: pgmap v2740: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:03.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:03 smithi026 ceph-mon[96795]: pgmap v2741: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:03.473 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:03 smithi194 ceph-mon[65619]: pgmap v2741: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:05.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:05 smithi026 ceph-mon[96795]: pgmap v2742: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:05.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:05 smithi194 ceph-mon[65619]: pgmap v2742: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:07.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:07 smithi026 ceph-mon[96795]: pgmap v2743: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:07.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:07 smithi194 ceph-mon[65619]: pgmap v2743: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:09.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:09 smithi026 ceph-mon[96795]: pgmap v2744: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:09.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:09 smithi194 ceph-mon[65619]: pgmap v2744: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:11.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:11 smithi026 ceph-mon[96795]: pgmap v2745: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:11.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:11 smithi194 ceph-mon[65619]: pgmap v2745: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:12.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:12 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:26:12.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:12 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:26:13.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:13 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:26:13.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:13 smithi026 ceph-mon[96795]: pgmap v2746: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:13.473 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:13 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:26:13.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:13 smithi194 ceph-mon[65619]: pgmap v2746: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:15.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:15 smithi026 ceph-mon[96795]: pgmap v2747: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:15.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:15 smithi194 ceph-mon[65619]: pgmap v2747: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:17.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:17 smithi026 ceph-mon[96795]: pgmap v2748: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:17.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:17 smithi194 ceph-mon[65619]: pgmap v2748: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:19.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:19 smithi026 ceph-mon[96795]: pgmap v2749: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:19.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:19 smithi194 ceph-mon[65619]: pgmap v2749: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:21.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:21 smithi026 ceph-mon[96795]: pgmap v2750: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:21.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:21 smithi194 ceph-mon[65619]: pgmap v2750: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:22.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:22 smithi194 ceph-mon[65619]: pgmap v2751: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:22.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:22 smithi026 ceph-mon[96795]: pgmap v2751: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:25.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:24 smithi026 ceph-mon[96795]: pgmap v2752: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:25.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:24 smithi194 ceph-mon[65619]: pgmap v2752: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:27.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:26 smithi194 ceph-mon[65619]: pgmap v2753: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:27.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:26 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:26:27.053 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:26 smithi026 ceph-mon[96795]: pgmap v2753: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:27.054 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:26 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:26:28.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:28 smithi026 ceph-mon[96795]: poll took 60066.156 ms: 1 events 2021-11-03T18:26:28.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:26:28.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:26:28.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:26:28.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:26:28.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:26:28.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:26:28.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:28 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:26:28.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:26:28.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:28 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:26:28.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:28 smithi194 ceph-mon[65619]: poll took 60066.156 ms: 1 events 2021-11-03T18:26:28.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:26:28.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:26:28.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:26:28.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:26:28.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:26:28.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:26:28.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:28 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:26:28.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:26:28.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:28 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:26:28.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.542+0000 7f8c2f59e700 1 -- 172.21.15.26:0/1090863483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c300f66e0 msgr2=0x7f8c300f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:26:28.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.542+0000 7f8c2f59e700 1 --2- 172.21.15.26:0/1090863483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c300f66e0 0x7f8c300f6b40 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 rx=0x7f8c24004660 tx=0x7f8c24009b30).stop 2021-11-03T18:26:28.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.542+0000 7f8c2f59e700 1 -- 172.21.15.26:0/1090863483 shutdown_connections 2021-11-03T18:26:28.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.542+0000 7f8c2f59e700 1 --2- 172.21.15.26:0/1090863483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c300f66e0 0x7f8c300f6b40 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:26:28.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.542+0000 7f8c2f59e700 1 --2- 172.21.15.26:0/1090863483 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c300f5440 0x7f8c300f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:26:28.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.542+0000 7f8c2f59e700 1 -- 172.21.15.26:0/1090863483 >> 172.21.15.26:0/1090863483 conn(0x7f8c300f0ba0 msgr2=0x7f8c300f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:26:28.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.542+0000 7f8c2f59e700 1 -- 172.21.15.26:0/1090863483 shutdown_connections 2021-11-03T18:26:28.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.542+0000 7f8c2f59e700 1 -- 172.21.15.26:0/1090863483 wait complete. 2021-11-03T18:26:28.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.542+0000 7f8c2f59e700 1 Processor -- start 2021-11-03T18:26:28.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.542+0000 7f8c2f59e700 1 -- start start 2021-11-03T18:26:28.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.543+0000 7f8c2f59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c300f5440 0x7f8c30109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:26:28.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.543+0000 7f8c2f59e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c300f66e0 0x7f8c3010bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:26:28.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.543+0000 7f8c2f59e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c300603e0 con 0x7f8c300f5440 2021-11-03T18:26:28.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.543+0000 7f8c2f59e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c30060520 con 0x7f8c300f66e0 2021-11-03T18:26:28.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.543+0000 7f8c2e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c300f5440 0x7f8c30109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:26:28.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.543+0000 7f8c2e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c300f5440 0x7f8c30109a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60026/0 (socket says 172.21.15.26:60026) 2021-11-03T18:26:28.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.543+0000 7f8c2e59c700 1 -- 172.21.15.26:0/3838424801 learned_addr learned my addr 172.21.15.26:0/3838424801 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:26:28.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.543+0000 7f8c2dd9b700 1 --2- 172.21.15.26:0/3838424801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c300f66e0 0x7f8c3010bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:26:28.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.543+0000 7f8c2e59c700 1 -- 172.21.15.26:0/3838424801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c300f66e0 msgr2=0x7f8c3010bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:26:28.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.543+0000 7f8c2e59c700 1 --2- 172.21.15.26:0/3838424801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c300f66e0 0x7f8c3010bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:26:28.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.543+0000 7f8c2e59c700 1 -- 172.21.15.26:0/3838424801 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c24005040 con 0x7f8c300f5440 2021-11-03T18:26:28.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.543+0000 7f8c2e59c700 1 --2- 172.21.15.26:0/3838424801 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c300f5440 0x7f8c30109a90 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 rx=0x7f8c2000c530 tx=0x7f8c20007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:26:28.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.543+0000 7f8c1effd700 1 -- 172.21.15.26:0/3838424801 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c2000f650 con 0x7f8c300f5440 2021-11-03T18:26:28.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.543+0000 7f8c2f59e700 1 -- 172.21.15.26:0/3838424801 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c3010c540 con 0x7f8c300f5440 2021-11-03T18:26:28.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.543+0000 7f8c1effd700 1 -- 172.21.15.26:0/3838424801 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8c2000fc60 con 0x7f8c300f5440 2021-11-03T18:26:28.548 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.543+0000 7f8c1effd700 1 -- 172.21.15.26:0/3838424801 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c20012cb0 con 0x7f8c300f5440 2021-11-03T18:26:28.548 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.544+0000 7f8c2f59e700 1 -- 172.21.15.26:0/3838424801 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c3010cb00 con 0x7f8c300f5440 2021-11-03T18:26:28.549 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.544+0000 7f8c2f59e700 1 -- 172.21.15.26:0/3838424801 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c30045ad0 con 0x7f8c300f5440 2021-11-03T18:26:28.549 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.545+0000 7f8c1effd700 1 -- 172.21.15.26:0/3838424801 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f8c20019030 con 0x7f8c300f5440 2021-11-03T18:26:28.549 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.545+0000 7f8c1effd700 1 --2- 172.21.15.26:0/3838424801 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8c18064100 0x7f8c180665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:26:28.550 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.546+0000 7f8c1effd700 1 -- 172.21.15.26:0/3838424801 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f8c20080580 con 0x7f8c300f5440 2021-11-03T18:26:28.550 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.546+0000 7f8c2dd9b700 1 --2- 172.21.15.26:0/3838424801 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8c18064100 0x7f8c180665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:26:28.550 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.546+0000 7f8c2dd9b700 1 --2- 172.21.15.26:0/3838424801 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8c18064100 0x7f8c180665c0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7f8c24004630 tx=0x7f8c24009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:26:28.551 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.550+0000 7f8c1effd700 1 -- 172.21.15.26:0/3838424801 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f8c20052840 con 0x7f8c300f5440 2021-11-03T18:26:28.726 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.728+0000 7f8c2f59e700 1 -- 172.21.15.26:0/3838424801 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c30057f10 con 0x7f8c18064100 2021-11-03T18:26:28.727 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.730+0000 7f8c1effd700 1 -- 172.21.15.26:0/3838424801 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f8c30057f10 con 0x7f8c18064100 2021-11-03T18:26:28.730 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.731+0000 7f8c2f59e700 1 -- 172.21.15.26:0/3838424801 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8c18064100 msgr2=0x7f8c180665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:26:28.730 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.731+0000 7f8c2f59e700 1 --2- 172.21.15.26:0/3838424801 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8c18064100 0x7f8c180665c0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7f8c24004630 tx=0x7f8c24009b30).stop 2021-11-03T18:26:28.730 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.731+0000 7f8c2f59e700 1 -- 172.21.15.26:0/3838424801 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c300f5440 msgr2=0x7f8c30109a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:26:28.731 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.731+0000 7f8c2f59e700 1 --2- 172.21.15.26:0/3838424801 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c300f5440 0x7f8c30109a90 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 rx=0x7f8c2000c530 tx=0x7f8c20007e10).stop 2021-11-03T18:26:28.731 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.732+0000 7f8c2f59e700 1 -- 172.21.15.26:0/3838424801 shutdown_connections 2021-11-03T18:26:28.731 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.732+0000 7f8c2f59e700 1 --2- 172.21.15.26:0/3838424801 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8c18064100 0x7f8c180665c0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:26:28.731 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.732+0000 7f8c2f59e700 1 --2- 172.21.15.26:0/3838424801 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c300f5440 0x7f8c30109a90 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:26:28.732 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.732+0000 7f8c2f59e700 1 --2- 172.21.15.26:0/3838424801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c300f66e0 0x7f8c3010bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:26:28.732 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.732+0000 7f8c2f59e700 1 -- 172.21.15.26:0/3838424801 >> 172.21.15.26:0/3838424801 conn(0x7f8c300f0ba0 msgr2=0x7f8c300fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:26:28.732 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.732+0000 7f8c2f59e700 1 -- 172.21.15.26:0/3838424801 shutdown_connections 2021-11-03T18:26:28.732 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.732+0000 7f8c2f59e700 1 -- 172.21.15.26:0/3838424801 wait complete. 2021-11-03T18:26:28.739 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:26:28.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.832+0000 7fa1ad112700 1 -- 172.21.15.26:0/3833901141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1a80f7980 msgr2=0x7fa1a80f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:26:28.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.832+0000 7fa1ad112700 1 --2- 172.21.15.26:0/3833901141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1a80f7980 0x7fa1a80f7de0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7fa198004660 tx=0x7fa198009b30).stop 2021-11-03T18:26:28.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.832+0000 7fa1ad112700 1 -- 172.21.15.26:0/3833901141 shutdown_connections 2021-11-03T18:26:28.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.832+0000 7fa1ad112700 1 --2- 172.21.15.26:0/3833901141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1a80f7980 0x7fa1a80f7de0 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:26:28.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.832+0000 7fa1ad112700 1 --2- 172.21.15.26:0/3833901141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1a80f66e0 0x7fa1a80f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:26:28.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.832+0000 7fa1ad112700 1 -- 172.21.15.26:0/3833901141 >> 172.21.15.26:0/3833901141 conn(0x7fa1a80f1e40 msgr2=0x7fa1a80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:26:28.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.832+0000 7fa1ad112700 1 -- 172.21.15.26:0/3833901141 shutdown_connections 2021-11-03T18:26:28.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.832+0000 7fa1ad112700 1 -- 172.21.15.26:0/3833901141 wait complete. 2021-11-03T18:26:28.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.833+0000 7fa1ad112700 1 Processor -- start 2021-11-03T18:26:28.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.833+0000 7fa1ad112700 1 -- start start 2021-11-03T18:26:28.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.833+0000 7fa1ad112700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1a80f66e0 0x7fa1a8106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:26:28.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.833+0000 7fa1ad112700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1a80f7980 0x7fa1a8107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:26:28.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.833+0000 7fa1ad112700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a8107a00 con 0x7fa1a80f66e0 2021-11-03T18:26:28.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.833+0000 7fa1ad112700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a8107b40 con 0x7fa1a80f7980 2021-11-03T18:26:28.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.833+0000 7fa1a6d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1a80f66e0 0x7fa1a8106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:26:28.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.833+0000 7fa1a6d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1a80f66e0 0x7fa1a8106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60036/0 (socket says 172.21.15.26:60036) 2021-11-03T18:26:28.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.833+0000 7fa1a6d9d700 1 -- 172.21.15.26:0/1856216018 learned_addr learned my addr 172.21.15.26:0/1856216018 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:26:28.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.833+0000 7fa1a659c700 1 --2- 172.21.15.26:0/1856216018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1a80f7980 0x7fa1a8107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:26:28.837 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.833+0000 7fa1a6d9d700 1 -- 172.21.15.26:0/1856216018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1a80f7980 msgr2=0x7fa1a8107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:26:28.837 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.833+0000 7fa1a6d9d700 1 --2- 172.21.15.26:0/1856216018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1a80f7980 0x7fa1a8107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:26:28.837 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.833+0000 7fa1a6d9d700 1 -- 172.21.15.26:0/1856216018 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa198005040 con 0x7fa1a80f66e0 2021-11-03T18:26:28.837 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.834+0000 7fa1a6d9d700 1 --2- 172.21.15.26:0/1856216018 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1a80f66e0 0x7fa1a8106f60 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 rx=0x7fa19c002700 tx=0x7fa19c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:26:28.838 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.834+0000 7fa18f7fe700 1 -- 172.21.15.26:0/1856216018 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa19c0079c0 con 0x7fa1a80f66e0 2021-11-03T18:26:28.838 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.834+0000 7fa18f7fe700 1 -- 172.21.15.26:0/1856216018 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa19c00f040 con 0x7fa1a80f66e0 2021-11-03T18:26:28.838 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.834+0000 7fa1ad112700 1 -- 172.21.15.26:0/1856216018 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1a81084e0 con 0x7fa1a80f66e0 2021-11-03T18:26:28.838 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.834+0000 7fa18f7fe700 1 -- 172.21.15.26:0/1856216018 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa19c014860 con 0x7fa1a80f66e0 2021-11-03T18:26:28.838 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.834+0000 7fa1ad112700 1 -- 172.21.15.26:0/1856216018 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1a8108aa0 con 0x7fa1a80f66e0 2021-11-03T18:26:28.839 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.835+0000 7fa1ad112700 1 -- 172.21.15.26:0/1856216018 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1a8045ad0 con 0x7fa1a80f66e0 2021-11-03T18:26:28.839 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.835+0000 7fa18f7fe700 1 -- 172.21.15.26:0/1856216018 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fa19c01b060 con 0x7fa1a80f66e0 2021-11-03T18:26:28.839 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.836+0000 7fa18f7fe700 1 --2- 172.21.15.26:0/1856216018 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa1900640b0 0x7fa190066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:26:28.839 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.836+0000 7fa18f7fe700 1 -- 172.21.15.26:0/1856216018 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fa19c080670 con 0x7fa1a80f66e0 2021-11-03T18:26:28.840 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.836+0000 7fa1a659c700 1 --2- 172.21.15.26:0/1856216018 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa1900640b0 0x7fa190066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:26:28.840 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.836+0000 7fa1a659c700 1 --2- 172.21.15.26:0/1856216018 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa1900640b0 0x7fa190066570 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7fa198004630 tx=0x7fa198009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:26:28.840 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:28.840+0000 7fa18f7fe700 1 -- 172.21.15.26:0/1856216018 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fa19c0529d0 con 0x7fa1a80f66e0 2021-11-03T18:26:29.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.012+0000 7fa1ad112700 1 -- 172.21.15.26:0/1856216018 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1a8108d20 con 0x7fa1900640b0 2021-11-03T18:26:29.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.027+0000 7fa18f7fe700 1 -- 172.21.15.26:0/1856216018 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fa1a8108d20 con 0x7fa1900640b0 2021-11-03T18:26:29.025 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:26:29.025 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (97m) 6m ago 98m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:26:29.025 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (89m) 6m ago 98m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:26:29.026 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (89m) 5m ago 98m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:26:29.026 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (97m) 6m ago 98m 42.2M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:26:29.026 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (90m) 6m ago 94m 26.0M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:26:29.026 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (91m) 6m ago 93m 26.6M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:26:29.027 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (94m) 5m ago 94m 26.8M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:26:29.027 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (94m) 5m ago 94m 27.2M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:26:29.027 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (91m) 6m ago 100m 588M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:26:29.028 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (91m) 5m ago 98m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:26:29.028 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (90m) 6m ago 100m 341M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:26:29.028 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (90m) 5m ago 98m 158M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:26:29.029 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (98m) 6m ago 98m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:26:29.029 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (97m) 5m ago 97m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:26:29.029 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (89m) 6m ago 97m 332M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:26:29.030 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (89m) 6m ago 96m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:26:29.030 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (88m) 6m ago 96m 296M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:26:29.030 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (88m) 5m ago 96m 387M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:26:29.030 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (87m) 5m ago 96m 320M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:26:29.031 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (87m) 5m ago 95m 316M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:26:29.031 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (97m) 6m ago 98m 65.7M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:26:29.033 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.028+0000 7fa1ad112700 1 -- 172.21.15.26:0/1856216018 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa1900640b0 msgr2=0x7fa190066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:26:29.033 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.028+0000 7fa1ad112700 1 --2- 172.21.15.26:0/1856216018 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa1900640b0 0x7fa190066570 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7fa198004630 tx=0x7fa198009b30).stop 2021-11-03T18:26:29.034 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.028+0000 7fa1ad112700 1 -- 172.21.15.26:0/1856216018 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1a80f66e0 msgr2=0x7fa1a8106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:26:29.034 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.028+0000 7fa1ad112700 1 --2- 172.21.15.26:0/1856216018 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1a80f66e0 0x7fa1a8106f60 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 rx=0x7fa19c002700 tx=0x7fa19c009d80).stop 2021-11-03T18:26:29.034 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.028+0000 7fa1ad112700 1 -- 172.21.15.26:0/1856216018 shutdown_connections 2021-11-03T18:26:29.035 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.028+0000 7fa1ad112700 1 --2- 172.21.15.26:0/1856216018 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa1900640b0 0x7fa190066570 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:26:29.035 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.028+0000 7fa1ad112700 1 --2- 172.21.15.26:0/1856216018 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1a80f66e0 0x7fa1a8106f60 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:26:29.036 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.028+0000 7fa1ad112700 1 --2- 172.21.15.26:0/1856216018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1a80f7980 0x7fa1a8107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:26:29.036 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.028+0000 7fa1ad112700 1 -- 172.21.15.26:0/1856216018 >> 172.21.15.26:0/1856216018 conn(0x7fa1a80f1e40 msgr2=0x7fa1a80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:26:29.037 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.028+0000 7fa1ad112700 1 -- 172.21.15.26:0/1856216018 shutdown_connections 2021-11-03T18:26:29.037 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.029+0000 7fa1ad112700 1 -- 172.21.15.26:0/1856216018 wait complete. 2021-11-03T18:26:29.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.129+0000 7fd95568b700 1 -- 172.21.15.26:0/1070470449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9500f7980 msgr2=0x7fd9500f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:26:29.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.129+0000 7fd95568b700 1 --2- 172.21.15.26:0/1070470449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9500f7980 0x7fd9500f7de0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 rx=0x7fd938004660 tx=0x7fd938009b30).stop 2021-11-03T18:26:29.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.129+0000 7fd95568b700 1 -- 172.21.15.26:0/1070470449 shutdown_connections 2021-11-03T18:26:29.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.129+0000 7fd95568b700 1 --2- 172.21.15.26:0/1070470449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9500f7980 0x7fd9500f7de0 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:26:29.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.129+0000 7fd95568b700 1 --2- 172.21.15.26:0/1070470449 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9500f66e0 0x7fd9500f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:26:29.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.129+0000 7fd95568b700 1 -- 172.21.15.26:0/1070470449 >> 172.21.15.26:0/1070470449 conn(0x7fd9500f1e40 msgr2=0x7fd9500f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:26:29.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.129+0000 7fd95568b700 1 -- 172.21.15.26:0/1070470449 shutdown_connections 2021-11-03T18:26:29.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.129+0000 7fd95568b700 1 -- 172.21.15.26:0/1070470449 wait complete. 2021-11-03T18:26:29.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.130+0000 7fd95568b700 1 Processor -- start 2021-11-03T18:26:29.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.130+0000 7fd95568b700 1 -- start start 2021-11-03T18:26:29.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.130+0000 7fd95568b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9500f66e0 0x7fd950106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:26:29.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.130+0000 7fd95568b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9500f7980 0x7fd950107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:26:29.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.130+0000 7fd95568b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd950107a00 con 0x7fd9500f66e0 2021-11-03T18:26:29.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.130+0000 7fd95568b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd950107b40 con 0x7fd9500f7980 2021-11-03T18:26:29.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.130+0000 7fd94effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9500f66e0 0x7fd950106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:26:29.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.130+0000 7fd94effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9500f66e0 0x7fd950106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60048/0 (socket says 172.21.15.26:60048) 2021-11-03T18:26:29.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.130+0000 7fd94effd700 1 -- 172.21.15.26:0/2677466880 learned_addr learned my addr 172.21.15.26:0/2677466880 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:26:29.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.130+0000 7fd94e7fc700 1 --2- 172.21.15.26:0/2677466880 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9500f7980 0x7fd950107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:26:29.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.130+0000 7fd94effd700 1 -- 172.21.15.26:0/2677466880 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9500f7980 msgr2=0x7fd950107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:26:29.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.130+0000 7fd94effd700 1 --2- 172.21.15.26:0/2677466880 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9500f7980 0x7fd950107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:26:29.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.130+0000 7fd94effd700 1 -- 172.21.15.26:0/2677466880 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd938005040 con 0x7fd9500f66e0 2021-11-03T18:26:29.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.130+0000 7fd94effd700 1 --2- 172.21.15.26:0/2677466880 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9500f66e0 0x7fd950106f60 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 rx=0x7fd94800c710 tx=0x7fd948004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:26:29.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.131+0000 7fd9477fe700 1 -- 172.21.15.26:0/2677466880 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd94800e680 con 0x7fd9500f66e0 2021-11-03T18:26:29.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.131+0000 7fd9477fe700 1 -- 172.21.15.26:0/2677466880 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd94800ec90 con 0x7fd9500f66e0 2021-11-03T18:26:29.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.131+0000 7fd95568b700 1 -- 172.21.15.26:0/2677466880 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9501084e0 con 0x7fd9500f66e0 2021-11-03T18:26:29.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.131+0000 7fd9477fe700 1 -- 172.21.15.26:0/2677466880 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd948012d50 con 0x7fd9500f66e0 2021-11-03T18:26:29.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.131+0000 7fd95568b700 1 -- 172.21.15.26:0/2677466880 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd950108aa0 con 0x7fd9500f66e0 2021-11-03T18:26:29.139 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.132+0000 7fd95568b700 1 -- 172.21.15.26:0/2677466880 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd950045ad0 con 0x7fd9500f66e0 2021-11-03T18:26:29.140 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.132+0000 7fd9477fe700 1 -- 172.21.15.26:0/2677466880 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fd948019030 con 0x7fd9500f66e0 2021-11-03T18:26:29.140 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.132+0000 7fd9477fe700 1 --2- 172.21.15.26:0/2677466880 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd93c0640b0 0x7fd93c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:26:29.141 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.133+0000 7fd9477fe700 1 -- 172.21.15.26:0/2677466880 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fd9480806b0 con 0x7fd9500f66e0 2021-11-03T18:26:29.141 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.133+0000 7fd94e7fc700 1 --2- 172.21.15.26:0/2677466880 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd93c0640b0 0x7fd93c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:26:29.142 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.133+0000 7fd94e7fc700 1 --2- 172.21.15.26:0/2677466880 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd93c0640b0 0x7fd93c066570 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7fd938004630 tx=0x7fd938009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:26:29.142 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.136+0000 7fd9477fe700 1 -- 172.21.15.26:0/2677466880 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fd9480529d0 con 0x7fd9500f66e0 2021-11-03T18:26:29.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.363+0000 7fd95568b700 1 -- 172.21.15.26:0/2677466880 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd9500ff020 con 0x7fd9500f66e0 2021-11-03T18:26:29.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.364+0000 7fd9477fe700 1 -- 172.21.15.26:0/2677466880 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fd9480172e0 con 0x7fd9500f66e0 2021-11-03T18:26:29.362 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:26:29.363 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:26:29.363 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:26:29.363 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:26:29.364 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:26:29.364 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:26:29.365 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:26:29.365 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:26:29.365 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:26:29.365 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:26:29.365 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:26:29.366 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:26:29.366 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:26:29.366 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:26:29.366 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:26:29.367 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:26:29.367 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:26:29.367 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:26:29.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.366+0000 7fd95568b700 1 -- 172.21.15.26:0/2677466880 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd93c0640b0 msgr2=0x7fd93c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:26:29.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.366+0000 7fd95568b700 1 --2- 172.21.15.26:0/2677466880 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd93c0640b0 0x7fd93c066570 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7fd938004630 tx=0x7fd938009b30).stop 2021-11-03T18:26:29.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.366+0000 7fd95568b700 1 -- 172.21.15.26:0/2677466880 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9500f66e0 msgr2=0x7fd950106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:26:29.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.366+0000 7fd95568b700 1 --2- 172.21.15.26:0/2677466880 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9500f66e0 0x7fd950106f60 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 rx=0x7fd94800c710 tx=0x7fd948004d10).stop 2021-11-03T18:26:29.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.366+0000 7fd95568b700 1 -- 172.21.15.26:0/2677466880 shutdown_connections 2021-11-03T18:26:29.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.366+0000 7fd95568b700 1 --2- 172.21.15.26:0/2677466880 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd93c0640b0 0x7fd93c066570 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:26:29.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.366+0000 7fd95568b700 1 --2- 172.21.15.26:0/2677466880 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9500f66e0 0x7fd950106f60 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:26:29.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.366+0000 7fd95568b700 1 --2- 172.21.15.26:0/2677466880 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9500f7980 0x7fd950107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:26:29.370 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.366+0000 7fd95568b700 1 -- 172.21.15.26:0/2677466880 >> 172.21.15.26:0/2677466880 conn(0x7fd9500f1e40 msgr2=0x7fd9500fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:26:29.370 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.366+0000 7fd95568b700 1 -- 172.21.15.26:0/2677466880 shutdown_connections 2021-11-03T18:26:29.370 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.366+0000 7fd95568b700 1 -- 172.21.15.26:0/2677466880 wait complete. 2021-11-03T18:26:29.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:29 smithi026 ceph-mon[96795]: pgmap v2754: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:29.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.466+0000 7f8e4128a700 1 -- 172.21.15.26:0/1209697712 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e3c0f6bb0 msgr2=0x7f8e3c0f6fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:26:29.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.466+0000 7f8e4128a700 1 --2- 172.21.15.26:0/1209697712 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e3c0f6bb0 0x7f8e3c0f6fd0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 rx=0x7f8e24004660 tx=0x7f8e24009b30).stop 2021-11-03T18:26:29.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.466+0000 7f8e4128a700 1 -- 172.21.15.26:0/1209697712 shutdown_connections 2021-11-03T18:26:29.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.466+0000 7f8e4128a700 1 --2- 172.21.15.26:0/1209697712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e3c0f58b0 0x7f8e3c0f5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:26:29.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.466+0000 7f8e4128a700 1 --2- 172.21.15.26:0/1209697712 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e3c0f6bb0 0x7f8e3c0f6fd0 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:26:29.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.466+0000 7f8e4128a700 1 -- 172.21.15.26:0/1209697712 >> 172.21.15.26:0/1209697712 conn(0x7f8e3c0f04c0 msgr2=0x7f8e3c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:26:29.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.466+0000 7f8e4128a700 1 -- 172.21.15.26:0/1209697712 shutdown_connections 2021-11-03T18:26:29.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.466+0000 7f8e4128a700 1 -- 172.21.15.26:0/1209697712 wait complete. 2021-11-03T18:26:29.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.467+0000 7f8e4128a700 1 Processor -- start 2021-11-03T18:26:29.476 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.467+0000 7f8e4128a700 1 -- start start 2021-11-03T18:26:29.476 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.467+0000 7f8e4128a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e3c0f58b0 0x7f8e3c106fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:26:29.476 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.467+0000 7f8e4128a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e3c0f6bb0 0x7f8e3c1074d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:26:29.476 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.467+0000 7f8e4128a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3c107b10 con 0x7f8e3c0f6bb0 2021-11-03T18:26:29.477 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.467+0000 7f8e4128a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3c1083c0 con 0x7f8e3c0f58b0 2021-11-03T18:26:29.477 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.467+0000 7f8e3a7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e3c0f6bb0 0x7f8e3c1074d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:26:29.477 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.467+0000 7f8e3a7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e3c0f6bb0 0x7f8e3c1074d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60060/0 (socket says 172.21.15.26:60060) 2021-11-03T18:26:29.478 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.467+0000 7f8e3a7fc700 1 -- 172.21.15.26:0/2459120594 learned_addr learned my addr 172.21.15.26:0/2459120594 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:26:29.478 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.467+0000 7f8e3affd700 1 --2- 172.21.15.26:0/2459120594 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e3c0f58b0 0x7f8e3c106fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:26:29.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.467+0000 7f8e3a7fc700 1 -- 172.21.15.26:0/2459120594 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e3c0f58b0 msgr2=0x7f8e3c106fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:26:29.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.467+0000 7f8e3a7fc700 1 --2- 172.21.15.26:0/2459120594 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e3c0f58b0 0x7f8e3c106fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:26:29.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.467+0000 7f8e3a7fc700 1 -- 172.21.15.26:0/2459120594 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e24005040 con 0x7f8e3c0f6bb0 2021-11-03T18:26:29.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.468+0000 7f8e3a7fc700 1 --2- 172.21.15.26:0/2459120594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e3c0f6bb0 0x7f8e3c1074d0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7f8e2c0093f0 tx=0x7f8e2c006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:26:29.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.468+0000 7f8e337fe700 1 -- 172.21.15.26:0/2459120594 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e2c009ea0 con 0x7f8e3c0f6bb0 2021-11-03T18:26:29.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.468+0000 7f8e4128a700 1 -- 172.21.15.26:0/2459120594 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e3c1086a0 con 0x7f8e3c0f6bb0 2021-11-03T18:26:29.480 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.468+0000 7f8e337fe700 1 -- 172.21.15.26:0/2459120594 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8e2c013af0 con 0x7f8e3c0f6bb0 2021-11-03T18:26:29.481 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.468+0000 7f8e337fe700 1 -- 172.21.15.26:0/2459120594 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e2c00db10 con 0x7f8e3c0f6bb0 2021-11-03T18:26:29.481 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.468+0000 7f8e4128a700 1 -- 172.21.15.26:0/2459120594 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e3c108c60 con 0x7f8e3c0f6bb0 2021-11-03T18:26:29.481 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.469+0000 7f8e4128a700 1 -- 172.21.15.26:0/2459120594 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e3c0f4150 con 0x7f8e3c0f6bb0 2021-11-03T18:26:29.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.469+0000 7f8e337fe700 1 -- 172.21.15.26:0/2459120594 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f8e2c01a060 con 0x7f8e3c0f6bb0 2021-11-03T18:26:29.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.470+0000 7f8e337fe700 1 --2- 172.21.15.26:0/2459120594 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8e280640b0 0x7f8e28066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:26:29.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.470+0000 7f8e337fe700 1 -- 172.21.15.26:0/2459120594 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f8e2c080910 con 0x7f8e3c0f6bb0 2021-11-03T18:26:29.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.470+0000 7f8e3affd700 1 --2- 172.21.15.26:0/2459120594 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8e280640b0 0x7f8e28066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:26:29.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.470+0000 7f8e3affd700 1 --2- 172.21.15.26:0/2459120594 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8e280640b0 0x7f8e28066570 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7f8e24004e30 tx=0x7f8e24009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:26:29.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.474+0000 7f8e337fe700 1 -- 172.21.15.26:0/2459120594 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f8e2c052b80 con 0x7f8e3c0f6bb0 2021-11-03T18:26:29.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:29 smithi194 ceph-mon[65619]: pgmap v2754: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:29.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.678+0000 7f8e4128a700 1 -- 172.21.15.26:0/2459120594 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8e3c10d6c0 con 0x7f8e3c0f6bb0 2021-11-03T18:26:29.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.678+0000 7f8e337fe700 1 -- 172.21.15.26:0/2459120594 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f8e2c018710 con 0x7f8e3c0f6bb0 2021-11-03T18:26:29.677 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:26:29.677 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:26:29.677 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:26:29.677 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:26:29.678 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:26:29.678 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:26:29.678 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:26:29.678 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:26:29.679 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:26:29.679 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:26:29.679 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:26:29.679 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:26:29.680 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:26:29.680 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:26:29.680 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:26:29.680 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:26:29.681 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:26:29.681 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:26:29.681 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:26:29.681 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:26:29.681 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:26:29.682 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:26:29.682 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:26:29.683 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:26:29.683 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:26:29.683 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:26:29.683 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:26:29.684 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:26:29.684 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:26:29.684 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:26:29.684 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:26:29.685 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:26:29.685 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:26:29.685 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:26:29.685 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:26:29.685 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:26:29.686 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:26:29.686 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:26:29.686 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:26:29.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.680+0000 7f8e4128a700 1 -- 172.21.15.26:0/2459120594 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8e280640b0 msgr2=0x7f8e28066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:26:29.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.680+0000 7f8e4128a700 1 --2- 172.21.15.26:0/2459120594 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8e280640b0 0x7f8e28066570 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7f8e24004e30 tx=0x7f8e24009b30).stop 2021-11-03T18:26:29.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.680+0000 7f8e4128a700 1 -- 172.21.15.26:0/2459120594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e3c0f6bb0 msgr2=0x7f8e3c1074d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:26:29.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.680+0000 7f8e4128a700 1 --2- 172.21.15.26:0/2459120594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e3c0f6bb0 0x7f8e3c1074d0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7f8e2c0093f0 tx=0x7f8e2c006ec0).stop 2021-11-03T18:26:29.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.680+0000 7f8e4128a700 1 -- 172.21.15.26:0/2459120594 shutdown_connections 2021-11-03T18:26:29.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.680+0000 7f8e4128a700 1 --2- 172.21.15.26:0/2459120594 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8e280640b0 0x7f8e28066570 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:26:29.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.680+0000 7f8e4128a700 1 --2- 172.21.15.26:0/2459120594 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e3c0f58b0 0x7f8e3c106fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:26:29.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.680+0000 7f8e4128a700 1 --2- 172.21.15.26:0/2459120594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e3c0f6bb0 0x7f8e3c1074d0 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:26:29.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.680+0000 7f8e4128a700 1 -- 172.21.15.26:0/2459120594 >> 172.21.15.26:0/2459120594 conn(0x7f8e3c0f04c0 msgr2=0x7f8e3c0f4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:26:29.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.680+0000 7f8e4128a700 1 -- 172.21.15.26:0/2459120594 shutdown_connections 2021-11-03T18:26:29.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:29.680+0000 7f8e4128a700 1 -- 172.21.15.26:0/2459120594 wait complete. 2021-11-03T18:26:29.690 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:26:30.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:30 smithi026 ceph-mon[96795]: from='client.36972 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:26:30.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:30 smithi026 ceph-mon[96795]: from='client.36976 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:26:30.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:30 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2677466880' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:26:30.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:30 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2459120594' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:26:30.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:30 smithi194 ceph-mon[65619]: from='client.36972 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:26:30.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:30 smithi194 ceph-mon[65619]: from='client.36976 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:26:30.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:30 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2677466880' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:26:30.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:30 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2459120594' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:26:31.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:31 smithi026 ceph-mon[96795]: pgmap v2755: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:31.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:31 smithi194 ceph-mon[65619]: pgmap v2755: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:33.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:33 smithi026 ceph-mon[96795]: pgmap v2756: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:33.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:33 smithi194 ceph-mon[65619]: pgmap v2756: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:35.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:35 smithi026 ceph-mon[96795]: pgmap v2757: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:35.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:35 smithi194 ceph-mon[65619]: pgmap v2757: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:37.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:37 smithi026 ceph-mon[96795]: pgmap v2758: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:37.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:37 smithi194 ceph-mon[65619]: pgmap v2758: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:39.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:39 smithi026 ceph-mon[96795]: pgmap v2759: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:39.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:39 smithi194 ceph-mon[65619]: pgmap v2759: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:41.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:41 smithi026 ceph-mon[96795]: pgmap v2760: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:41.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:41 smithi194 ceph-mon[65619]: pgmap v2760: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:43.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:43 smithi026 ceph-mon[96795]: pgmap v2761: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:43.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:43 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:26:43.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:43 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:26:43.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:43 smithi194 ceph-mon[65619]: pgmap v2761: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:43.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:43 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:26:43.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:43 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:26:45.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:45 smithi026 ceph-mon[96795]: pgmap v2762: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:45.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:45 smithi194 ceph-mon[65619]: pgmap v2762: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:47.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:47 smithi026 ceph-mon[96795]: pgmap v2763: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:47.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:47 smithi194 ceph-mon[65619]: pgmap v2763: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:49 smithi026 ceph-mon[96795]: pgmap v2764: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:26:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:26:49.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:49 smithi194 ceph-mon[65619]: pgmap v2764: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:26:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:26:51.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:51 smithi026 ceph-mon[96795]: pgmap v2765: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:51.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:51 smithi194 ceph-mon[65619]: pgmap v2765: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:53.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:53 smithi026 ceph-mon[96795]: pgmap v2766: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:53.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:53 smithi194 ceph-mon[65619]: pgmap v2766: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:55.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:55 smithi026 ceph-mon[96795]: pgmap v2767: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:55.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:55 smithi194 ceph-mon[65619]: pgmap v2767: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:57.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:57 smithi026 ceph-mon[96795]: pgmap v2768: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:57.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:57 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:26:57.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:57 smithi194 ceph-mon[65619]: pgmap v2768: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:57.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:57 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:26:58.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:58 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:26:58.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:58 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:26:59.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:26:59 smithi026 ceph-mon[96795]: pgmap v2769: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:59.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:26:59 smithi194 ceph-mon[65619]: pgmap v2769: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:26:59.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.794+0000 7fc07bbbd700 1 -- 172.21.15.26:0/839249671 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc07406a3b0 msgr2=0x7fc07406a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:26:59.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.794+0000 7fc07bbbd700 1 --2- 172.21.15.26:0/839249671 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc07406a3b0 0x7fc07406a830 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7fc064004660 tx=0x7fc064009b30).stop 2021-11-03T18:26:59.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.794+0000 7fc07bbbd700 1 -- 172.21.15.26:0/839249671 shutdown_connections 2021-11-03T18:26:59.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.794+0000 7fc07bbbd700 1 --2- 172.21.15.26:0/839249671 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc07406a3b0 0x7fc07406a830 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:26:59.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.794+0000 7fc07bbbd700 1 --2- 172.21.15.26:0/839249671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc07406b9c0 0x7fc074069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:26:59.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.794+0000 7fc07bbbd700 1 -- 172.21.15.26:0/839249671 >> 172.21.15.26:0/839249671 conn(0x7fc0740f1e20 msgr2=0x7fc0740f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:26:59.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.795+0000 7fc07bbbd700 1 -- 172.21.15.26:0/839249671 shutdown_connections 2021-11-03T18:26:59.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.795+0000 7fc07bbbd700 1 -- 172.21.15.26:0/839249671 wait complete. 2021-11-03T18:26:59.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.795+0000 7fc07bbbd700 1 Processor -- start 2021-11-03T18:26:59.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.795+0000 7fc07bbbd700 1 -- start start 2021-11-03T18:26:59.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.795+0000 7fc07bbbd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc07406a3b0 0x7fc07410d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:26:59.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.795+0000 7fc07bbbd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc07406b9c0 0x7fc07410da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:26:59.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.795+0000 7fc07bbbd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07410dfe0 con 0x7fc07406a3b0 2021-11-03T18:26:59.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.795+0000 7fc07bbbd700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07410e120 con 0x7fc07406b9c0 2021-11-03T18:26:59.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.796+0000 7fc079959700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc07406a3b0 0x7fc07410d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:26:59.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.796+0000 7fc079959700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc07406a3b0 0x7fc07410d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60076/0 (socket says 172.21.15.26:60076) 2021-11-03T18:26:59.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.796+0000 7fc079959700 1 -- 172.21.15.26:0/3321770640 learned_addr learned my addr 172.21.15.26:0/3321770640 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:26:59.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.796+0000 7fc079158700 1 --2- 172.21.15.26:0/3321770640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc07406b9c0 0x7fc07410da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:26:59.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.796+0000 7fc079959700 1 -- 172.21.15.26:0/3321770640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc07406b9c0 msgr2=0x7fc07410da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:26:59.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.796+0000 7fc079959700 1 --2- 172.21.15.26:0/3321770640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc07406b9c0 0x7fc07410da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:26:59.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.796+0000 7fc079959700 1 -- 172.21.15.26:0/3321770640 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc064005040 con 0x7fc07406a3b0 2021-11-03T18:26:59.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.796+0000 7fc079158700 1 --2- 172.21.15.26:0/3321770640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc07406b9c0 0x7fc07410da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:26:59.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.796+0000 7fc079959700 1 --2- 172.21.15.26:0/3321770640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc07406a3b0 0x7fc07410d540 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 rx=0x7fc07000c530 tx=0x7fc070007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:26:59.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.796+0000 7fc06a7fc700 1 -- 172.21.15.26:0/3321770640 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc07000f650 con 0x7fc07406a3b0 2021-11-03T18:26:59.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.796+0000 7fc06a7fc700 1 -- 172.21.15.26:0/3321770640 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc07000fc60 con 0x7fc07406a3b0 2021-11-03T18:26:59.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.796+0000 7fc07bbbd700 1 -- 172.21.15.26:0/3321770640 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc07410eac0 con 0x7fc07406a3b0 2021-11-03T18:26:59.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.796+0000 7fc06a7fc700 1 -- 172.21.15.26:0/3321770640 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc070012cd0 con 0x7fc07406a3b0 2021-11-03T18:26:59.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.796+0000 7fc07bbbd700 1 -- 172.21.15.26:0/3321770640 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc07410f080 con 0x7fc07406a3b0 2021-11-03T18:26:59.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.797+0000 7fc07bbbd700 1 -- 172.21.15.26:0/3321770640 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc074045ad0 con 0x7fc07406a3b0 2021-11-03T18:26:59.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.798+0000 7fc06a7fc700 1 -- 172.21.15.26:0/3321770640 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc070010070 con 0x7fc07406a3b0 2021-11-03T18:26:59.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.798+0000 7fc06a7fc700 1 --2- 172.21.15.26:0/3321770640 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc0600640b0 0x7fc060066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:26:59.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.798+0000 7fc06a7fc700 1 -- 172.21.15.26:0/3321770640 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc070080640 con 0x7fc07406a3b0 2021-11-03T18:26:59.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.798+0000 7fc079158700 1 --2- 172.21.15.26:0/3321770640 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc0600640b0 0x7fc060066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:26:59.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.799+0000 7fc079158700 1 --2- 172.21.15.26:0/3321770640 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc0600640b0 0x7fc060066570 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7fc064004e30 tx=0x7fc064009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:26:59.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.802+0000 7fc06a7fc700 1 -- 172.21.15.26:0/3321770640 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc0700528b0 con 0x7fc07406a3b0 2021-11-03T18:26:59.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.981+0000 7fc07bbbd700 1 -- 172.21.15.26:0/3321770640 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0741055f0 con 0x7fc0600640b0 2021-11-03T18:26:59.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.983+0000 7fc06a7fc700 1 -- 172.21.15.26:0/3321770640 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fc0741055f0 con 0x7fc0600640b0 2021-11-03T18:26:59.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.984+0000 7fc07bbbd700 1 -- 172.21.15.26:0/3321770640 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc0600640b0 msgr2=0x7fc060066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:26:59.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.984+0000 7fc07bbbd700 1 --2- 172.21.15.26:0/3321770640 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc0600640b0 0x7fc060066570 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7fc064004e30 tx=0x7fc064009b30).stop 2021-11-03T18:26:59.984 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.984+0000 7fc07bbbd700 1 -- 172.21.15.26:0/3321770640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc07406a3b0 msgr2=0x7fc07410d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:26:59.984 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.984+0000 7fc07bbbd700 1 --2- 172.21.15.26:0/3321770640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc07406a3b0 0x7fc07410d540 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 rx=0x7fc07000c530 tx=0x7fc070007e20).stop 2021-11-03T18:26:59.984 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.984+0000 7fc07bbbd700 1 -- 172.21.15.26:0/3321770640 shutdown_connections 2021-11-03T18:26:59.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.984+0000 7fc07bbbd700 1 --2- 172.21.15.26:0/3321770640 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc0600640b0 0x7fc060066570 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:26:59.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.984+0000 7fc07bbbd700 1 --2- 172.21.15.26:0/3321770640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc07406a3b0 0x7fc07410d540 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:26:59.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.984+0000 7fc07bbbd700 1 --2- 172.21.15.26:0/3321770640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc07406b9c0 0x7fc07410da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:26:59.986 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.985+0000 7fc07bbbd700 1 -- 172.21.15.26:0/3321770640 >> 172.21.15.26:0/3321770640 conn(0x7fc0740f1e20 msgr2=0x7fc0740f88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:26:59.986 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.985+0000 7fc07bbbd700 1 -- 172.21.15.26:0/3321770640 shutdown_connections 2021-11-03T18:26:59.986 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:26:59.985+0000 7fc07bbbd700 1 -- 172.21.15.26:0/3321770640 wait complete. 2021-11-03T18:26:59.992 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:27:00.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.084+0000 7f8ba4e03700 1 -- 172.21.15.26:0/135823080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ba00f4800 msgr2=0x7f8ba00f4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:27:00.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.084+0000 7f8ba4e03700 1 --2- 172.21.15.26:0/135823080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ba00f4800 0x7f8ba00f4c20 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 rx=0x7f8b90004660 tx=0x7f8b90009b30).stop 2021-11-03T18:27:00.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.084+0000 7f8ba4e03700 1 -- 172.21.15.26:0/135823080 shutdown_connections 2021-11-03T18:27:00.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.084+0000 7f8ba4e03700 1 --2- 172.21.15.26:0/135823080 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ba00f51a0 0x7f8ba00f7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:27:00.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.084+0000 7f8ba4e03700 1 --2- 172.21.15.26:0/135823080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ba00f4800 0x7f8ba00f4c20 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:27:00.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.084+0000 7f8ba4e03700 1 -- 172.21.15.26:0/135823080 >> 172.21.15.26:0/135823080 conn(0x7f8ba00f0320 msgr2=0x7f8ba00f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:27:00.085 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.085+0000 7f8ba4e03700 1 -- 172.21.15.26:0/135823080 shutdown_connections 2021-11-03T18:27:00.085 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.085+0000 7f8ba4e03700 1 -- 172.21.15.26:0/135823080 wait complete. 2021-11-03T18:27:00.085 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.085+0000 7f8ba4e03700 1 Processor -- start 2021-11-03T18:27:00.085 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.085+0000 7f8ba4e03700 1 -- start start 2021-11-03T18:27:00.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.085+0000 7f8ba4e03700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ba00f4800 0x7f8ba0106dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:27:00.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.085+0000 7f8ba4e03700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ba00f51a0 0x7f8ba01072b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:27:00.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.085+0000 7f8ba4e03700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba01078b0 con 0x7f8ba00f4800 2021-11-03T18:27:00.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.085+0000 7f8ba4e03700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba01080f0 con 0x7f8ba00f51a0 2021-11-03T18:27:00.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.086+0000 7f8b9f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ba00f4800 0x7f8ba0106dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:27:00.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.086+0000 7f8b9f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ba00f4800 0x7f8ba0106dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60086/0 (socket says 172.21.15.26:60086) 2021-11-03T18:27:00.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.086+0000 7f8b9f7fe700 1 -- 172.21.15.26:0/744951695 learned_addr learned my addr 172.21.15.26:0/744951695 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:27:00.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.086+0000 7f8b9f7fe700 1 -- 172.21.15.26:0/744951695 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ba00f51a0 msgr2=0x7f8ba01072b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:27:00.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.086+0000 7f8b9f7fe700 1 --2- 172.21.15.26:0/744951695 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ba00f51a0 0x7f8ba01072b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:27:00.090 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.086+0000 7f8b9f7fe700 1 -- 172.21.15.26:0/744951695 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b90005040 con 0x7f8ba00f4800 2021-11-03T18:27:00.090 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.086+0000 7f8b9f7fe700 1 --2- 172.21.15.26:0/744951695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ba00f4800 0x7f8ba0106dc0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7f8b90013a70 tx=0x7f8b90009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:27:00.090 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.086+0000 7f8b97fff700 1 -- 172.21.15.26:0/744951695 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b90018070 con 0x7f8ba00f4800 2021-11-03T18:27:00.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.086+0000 7f8ba4e03700 1 -- 172.21.15.26:0/744951695 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ba0108370 con 0x7f8ba00f4800 2021-11-03T18:27:00.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.086+0000 7f8b97fff700 1 -- 172.21.15.26:0/744951695 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8b900097d0 con 0x7f8ba00f4800 2021-11-03T18:27:00.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.086+0000 7f8b97fff700 1 -- 172.21.15.26:0/744951695 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b9001c3c0 con 0x7f8ba00f4800 2021-11-03T18:27:00.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.086+0000 7f8ba4e03700 1 -- 172.21.15.26:0/744951695 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ba0108850 con 0x7f8ba00f4800 2021-11-03T18:27:00.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.087+0000 7f8ba4e03700 1 -- 172.21.15.26:0/744951695 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ba0059100 con 0x7f8ba00f4800 2021-11-03T18:27:00.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.088+0000 7f8b97fff700 1 -- 172.21.15.26:0/744951695 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f8b90007ba0 con 0x7f8ba00f4800 2021-11-03T18:27:00.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.088+0000 7f8b97fff700 1 --2- 172.21.15.26:0/744951695 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8b8c064100 0x7f8b8c0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:27:00.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.088+0000 7f8b97fff700 1 -- 172.21.15.26:0/744951695 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f8b90082470 con 0x7f8ba00f4800 2021-11-03T18:27:00.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.088+0000 7f8b9effd700 1 --2- 172.21.15.26:0/744951695 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8b8c064100 0x7f8b8c0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:27:00.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.089+0000 7f8b9effd700 1 --2- 172.21.15.26:0/744951695 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8b8c064100 0x7f8b8c0665c0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7f8ba0106b50 tx=0x7f8b880099e0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:27:00.094 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.092+0000 7f8b97fff700 1 -- 172.21.15.26:0/744951695 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f8b900547d0 con 0x7f8ba00f4800 2021-11-03T18:27:00.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.268+0000 7f8ba4e03700 1 -- 172.21.15.26:0/744951695 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ba00fee70 con 0x7f8b8c064100 2021-11-03T18:27:00.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.283+0000 7f8b97fff700 1 -- 172.21.15.26:0/744951695 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f8ba00fee70 con 0x7f8b8c064100 2021-11-03T18:27:00.281 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:27:00.282 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (98m) 6m ago 99m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:27:00.282 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (90m) 6m ago 99m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:27:00.282 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (90m) 5m ago 98m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:27:00.282 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (98m) 6m ago 99m 42.2M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:27:00.283 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (91m) 6m ago 94m 26.0M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:27:00.283 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (91m) 6m ago 94m 26.6M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:27:00.283 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (94m) 5m ago 94m 26.8M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:27:00.283 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (94m) 5m ago 94m 27.2M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:27:00.284 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (91m) 6m ago 100m 588M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:27:00.284 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (91m) 5m ago 98m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:27:00.284 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (91m) 6m ago 100m 341M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:27:00.284 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (91m) 5m ago 98m 158M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:27:00.284 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (99m) 6m ago 99m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:27:00.285 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (98m) 5m ago 98m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:27:00.285 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (90m) 6m ago 97m 332M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:27:00.285 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (89m) 6m ago 97m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:27:00.285 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (89m) 6m ago 97m 296M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:27:00.286 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (88m) 5m ago 96m 387M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:27:00.286 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (88m) 5m ago 96m 320M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:27:00.286 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (87m) 5m ago 96m 316M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:27:00.286 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (97m) 6m ago 98m 65.7M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:27:00.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.285+0000 7f8ba4e03700 1 -- 172.21.15.26:0/744951695 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8b8c064100 msgr2=0x7f8b8c0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:27:00.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.285+0000 7f8ba4e03700 1 --2- 172.21.15.26:0/744951695 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8b8c064100 0x7f8b8c0665c0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7f8ba0106b50 tx=0x7f8b880099e0).stop 2021-11-03T18:27:00.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.285+0000 7f8ba4e03700 1 -- 172.21.15.26:0/744951695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ba00f4800 msgr2=0x7f8ba0106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:27:00.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.285+0000 7f8ba4e03700 1 --2- 172.21.15.26:0/744951695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ba00f4800 0x7f8ba0106dc0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7f8b90013a70 tx=0x7f8b90009b30).stop 2021-11-03T18:27:00.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.285+0000 7f8ba4e03700 1 -- 172.21.15.26:0/744951695 shutdown_connections 2021-11-03T18:27:00.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.285+0000 7f8ba4e03700 1 --2- 172.21.15.26:0/744951695 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8b8c064100 0x7f8b8c0665c0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:27:00.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.285+0000 7f8ba4e03700 1 --2- 172.21.15.26:0/744951695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ba00f4800 0x7f8ba0106dc0 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:27:00.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.285+0000 7f8ba4e03700 1 --2- 172.21.15.26:0/744951695 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ba00f51a0 0x7f8ba01072b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:27:00.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.285+0000 7f8ba4e03700 1 -- 172.21.15.26:0/744951695 >> 172.21.15.26:0/744951695 conn(0x7f8ba00f0320 msgr2=0x7f8ba00fb370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:27:00.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.286+0000 7f8ba4e03700 1 -- 172.21.15.26:0/744951695 shutdown_connections 2021-11-03T18:27:00.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.286+0000 7f8ba4e03700 1 -- 172.21.15.26:0/744951695 wait complete. 2021-11-03T18:27:00.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.385+0000 7f88ad664700 1 -- 172.21.15.26:0/1029992133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a8060310 msgr2=0x7f88a80f92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:27:00.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.385+0000 7f88ad664700 1 --2- 172.21.15.26:0/1029992133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a8060310 0x7f88a80f92a0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 rx=0x7f88a00099e0 tx=0x7f88a0004d10).stop 2021-11-03T18:27:00.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.385+0000 7f88ad664700 1 -- 172.21.15.26:0/1029992133 shutdown_connections 2021-11-03T18:27:00.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.385+0000 7f88ad664700 1 --2- 172.21.15.26:0/1029992133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88a80f9820 0x7f88a80fbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:27:00.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.385+0000 7f88ad664700 1 --2- 172.21.15.26:0/1029992133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a8060310 0x7f88a80f92a0 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:27:00.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.385+0000 7f88ad664700 1 -- 172.21.15.26:0/1029992133 >> 172.21.15.26:0/1029992133 conn(0x7f88a80f0d40 msgr2=0x7f88a80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:27:00.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.385+0000 7f88ad664700 1 -- 172.21.15.26:0/1029992133 shutdown_connections 2021-11-03T18:27:00.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.385+0000 7f88ad664700 1 -- 172.21.15.26:0/1029992133 wait complete. 2021-11-03T18:27:00.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.385+0000 7f88ad664700 1 Processor -- start 2021-11-03T18:27:00.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.385+0000 7f88ad664700 1 -- start start 2021-11-03T18:27:00.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.386+0000 7f88ad664700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88a8060310 0x7f88a8107050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:27:00.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.386+0000 7f88ad664700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a80f9820 0x7f88a8107540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:27:00.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.386+0000 7f88ad664700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a8107af0 con 0x7f88a80f9820 2021-11-03T18:27:00.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.386+0000 7f88ad664700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a8107c30 con 0x7f88a8060310 2021-11-03T18:27:00.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.386+0000 7f88a67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a80f9820 0x7f88a8107540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:27:00.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.386+0000 7f88a67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a80f9820 0x7f88a8107540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60098/0 (socket says 172.21.15.26:60098) 2021-11-03T18:27:00.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.386+0000 7f88a67fc700 1 -- 172.21.15.26:0/530425347 learned_addr learned my addr 172.21.15.26:0/530425347 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:27:00.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.386+0000 7f88a6ffd700 1 --2- 172.21.15.26:0/530425347 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88a8060310 0x7f88a8107050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:27:00.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.386+0000 7f88a67fc700 1 -- 172.21.15.26:0/530425347 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88a8060310 msgr2=0x7f88a8107050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:27:00.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.386+0000 7f88a67fc700 1 --2- 172.21.15.26:0/530425347 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88a8060310 0x7f88a8107050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:27:00.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.386+0000 7f88a67fc700 1 -- 172.21.15.26:0/530425347 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a0009640 con 0x7f88a80f9820 2021-11-03T18:27:00.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.386+0000 7f88a67fc700 1 --2- 172.21.15.26:0/530425347 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a80f9820 0x7f88a8107540 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 rx=0x7f8890002700 tx=0x7f8890009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:27:00.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.386+0000 7f889f7fe700 1 -- 172.21.15.26:0/530425347 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88900079c0 con 0x7f88a80f9820 2021-11-03T18:27:00.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.386+0000 7f889f7fe700 1 -- 172.21.15.26:0/530425347 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f889000f040 con 0x7f88a80f9820 2021-11-03T18:27:00.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.386+0000 7f889f7fe700 1 -- 172.21.15.26:0/530425347 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8890014740 con 0x7f88a80f9820 2021-11-03T18:27:00.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.386+0000 7f88ad664700 1 -- 172.21.15.26:0/530425347 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88a81085d0 con 0x7f88a80f9820 2021-11-03T18:27:00.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.386+0000 7f88ad664700 1 -- 172.21.15.26:0/530425347 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88a8108b10 con 0x7f88a80f9820 2021-11-03T18:27:00.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.387+0000 7f88ad664700 1 -- 172.21.15.26:0/530425347 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88a8045ad0 con 0x7f88a80f9820 2021-11-03T18:27:00.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.388+0000 7f889f7fe700 1 -- 172.21.15.26:0/530425347 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f889001b060 con 0x7f88a80f9820 2021-11-03T18:27:00.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.388+0000 7f889f7fe700 1 --2- 172.21.15.26:0/530425347 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f88940640b0 0x7f8894066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:27:00.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.388+0000 7f889f7fe700 1 -- 172.21.15.26:0/530425347 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f8890080690 con 0x7f88a80f9820 2021-11-03T18:27:00.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.388+0000 7f88a6ffd700 1 --2- 172.21.15.26:0/530425347 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f88940640b0 0x7f8894066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:27:00.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.389+0000 7f88a6ffd700 1 --2- 172.21.15.26:0/530425347 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f88940640b0 0x7f8894066570 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7f88a0003380 tx=0x7f88a0004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:27:00.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.392+0000 7f889f7fe700 1 -- 172.21.15.26:0/530425347 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f8890052990 con 0x7f88a80f9820 2021-11-03T18:27:00.627 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.630+0000 7f88ad664700 1 -- 172.21.15.26:0/530425347 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f88a80fefa0 con 0x7f88a80f9820 2021-11-03T18:27:00.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.630+0000 7f889f7fe700 1 -- 172.21.15.26:0/530425347 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f88900192e0 con 0x7f88a80f9820 2021-11-03T18:27:00.629 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:27:00.629 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:27:00.629 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:27:00.629 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:27:00.630 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:27:00.630 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:27:00.630 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:27:00.630 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:27:00.631 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:27:00.631 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:27:00.631 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:27:00.631 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:27:00.632 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:27:00.632 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:27:00.632 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:27:00.632 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:27:00.633 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:27:00.633 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:27:00.634 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.632+0000 7f88ad664700 1 -- 172.21.15.26:0/530425347 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f88940640b0 msgr2=0x7f8894066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:27:00.634 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.632+0000 7f88ad664700 1 --2- 172.21.15.26:0/530425347 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f88940640b0 0x7f8894066570 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7f88a0003380 tx=0x7f88a0004d10).stop 2021-11-03T18:27:00.634 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.632+0000 7f88ad664700 1 -- 172.21.15.26:0/530425347 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a80f9820 msgr2=0x7f88a8107540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:27:00.635 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.632+0000 7f88ad664700 1 --2- 172.21.15.26:0/530425347 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a80f9820 0x7f88a8107540 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 rx=0x7f8890002700 tx=0x7f8890009d60).stop 2021-11-03T18:27:00.635 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.632+0000 7f88ad664700 1 -- 172.21.15.26:0/530425347 shutdown_connections 2021-11-03T18:27:00.635 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.632+0000 7f88ad664700 1 --2- 172.21.15.26:0/530425347 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f88940640b0 0x7f8894066570 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:27:00.635 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.632+0000 7f88ad664700 1 --2- 172.21.15.26:0/530425347 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88a8060310 0x7f88a8107050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:27:00.636 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.632+0000 7f88ad664700 1 --2- 172.21.15.26:0/530425347 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a80f9820 0x7f88a8107540 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:27:00.636 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.632+0000 7f88ad664700 1 -- 172.21.15.26:0/530425347 >> 172.21.15.26:0/530425347 conn(0x7f88a80f0d40 msgr2=0x7f88a80f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:27:00.636 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.632+0000 7f88ad664700 1 -- 172.21.15.26:0/530425347 shutdown_connections 2021-11-03T18:27:00.636 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.632+0000 7f88ad664700 1 -- 172.21.15.26:0/530425347 wait complete. 2021-11-03T18:27:00.732 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.732+0000 7fc2cd73c700 1 -- 172.21.15.26:0/2915024285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2c80f5ef0 msgr2=0x7fc2c80f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:27:00.732 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.732+0000 7fc2cd73c700 1 --2- 172.21.15.26:0/2915024285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2c80f5ef0 0x7fc2c80f6920 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 rx=0x7fc2b8004660 tx=0x7fc2b8009b30).stop 2021-11-03T18:27:00.733 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.732+0000 7fc2cd73c700 1 -- 172.21.15.26:0/2915024285 shutdown_connections 2021-11-03T18:27:00.733 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.732+0000 7fc2cd73c700 1 --2- 172.21.15.26:0/2915024285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2c80f5ef0 0x7fc2c80f6920 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:27:00.733 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.732+0000 7fc2cd73c700 1 --2- 172.21.15.26:0/2915024285 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2c80f55e0 0x7fc2c80f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:27:00.733 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.732+0000 7fc2cd73c700 1 -- 172.21.15.26:0/2915024285 >> 172.21.15.26:0/2915024285 conn(0x7fc2c80f0de0 msgr2=0x7fc2c80f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:27:00.734 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.732+0000 7fc2cd73c700 1 -- 172.21.15.26:0/2915024285 shutdown_connections 2021-11-03T18:27:00.734 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.732+0000 7fc2cd73c700 1 -- 172.21.15.26:0/2915024285 wait complete. 2021-11-03T18:27:00.734 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.733+0000 7fc2cd73c700 1 Processor -- start 2021-11-03T18:27:00.734 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.733+0000 7fc2cd73c700 1 -- start start 2021-11-03T18:27:00.735 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.733+0000 7fc2cd73c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2c80f55e0 0x7fc2c8109c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:27:00.735 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.733+0000 7fc2cd73c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2c80f5ef0 0x7fc2c810c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:27:00.735 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.733+0000 7fc2cd73c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c80604e0 con 0x7fc2c80f5ef0 2021-11-03T18:27:00.735 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.733+0000 7fc2cd73c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c8060620 con 0x7fc2c80f55e0 2021-11-03T18:27:00.735 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.733+0000 7fc2c67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2c80f5ef0 0x7fc2c810c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:27:00.736 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.733+0000 7fc2c67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2c80f5ef0 0x7fc2c810c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60108/0 (socket says 172.21.15.26:60108) 2021-11-03T18:27:00.736 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.733+0000 7fc2c67fc700 1 -- 172.21.15.26:0/1159940605 learned_addr learned my addr 172.21.15.26:0/1159940605 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:27:00.736 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.734+0000 7fc2c6ffd700 1 --2- 172.21.15.26:0/1159940605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2c80f55e0 0x7fc2c8109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:27:00.736 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.734+0000 7fc2c67fc700 1 -- 172.21.15.26:0/1159940605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2c80f55e0 msgr2=0x7fc2c8109c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:27:00.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.734+0000 7fc2c67fc700 1 --2- 172.21.15.26:0/1159940605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2c80f55e0 0x7fc2c8109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:27:00.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.734+0000 7fc2c67fc700 1 -- 172.21.15.26:0/1159940605 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b8005040 con 0x7fc2c80f5ef0 2021-11-03T18:27:00.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.734+0000 7fc2c67fc700 1 --2- 172.21.15.26:0/1159940605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2c80f5ef0 0x7fc2c810c110 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 rx=0x7fc2b8009990 tx=0x7fc2b8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:27:00.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.734+0000 7fc2af7fe700 1 -- 172.21.15.26:0/1159940605 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2b8018070 con 0x7fc2c80f5ef0 2021-11-03T18:27:00.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.734+0000 7fc2af7fe700 1 -- 172.21.15.26:0/1159940605 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc2b8007ba0 con 0x7fc2c80f5ef0 2021-11-03T18:27:00.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.734+0000 7fc2cd73c700 1 -- 172.21.15.26:0/1159940605 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2c810c660 con 0x7fc2c80f5ef0 2021-11-03T18:27:00.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.734+0000 7fc2af7fe700 1 -- 172.21.15.26:0/1159940605 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2b801c3c0 con 0x7fc2c80f5ef0 2021-11-03T18:27:00.739 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.734+0000 7fc2cd73c700 1 -- 172.21.15.26:0/1159940605 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2c810cb90 con 0x7fc2c80f5ef0 2021-11-03T18:27:00.740 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.735+0000 7fc2cd73c700 1 -- 172.21.15.26:0/1159940605 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2c8045ad0 con 0x7fc2c80f5ef0 2021-11-03T18:27:00.740 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.736+0000 7fc2af7fe700 1 -- 172.21.15.26:0/1159940605 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc2b801d420 con 0x7fc2c80f5ef0 2021-11-03T18:27:00.740 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.736+0000 7fc2af7fe700 1 --2- 172.21.15.26:0/1159940605 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc2b00640b0 0x7fc2b0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:27:00.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.736+0000 7fc2af7fe700 1 -- 172.21.15.26:0/1159940605 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc2b80824e0 con 0x7fc2c80f5ef0 2021-11-03T18:27:00.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.736+0000 7fc2c6ffd700 1 --2- 172.21.15.26:0/1159940605 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc2b00640b0 0x7fc2b0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:27:00.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.737+0000 7fc2c6ffd700 1 --2- 172.21.15.26:0/1159940605 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc2b00640b0 0x7fc2b0066570 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7fc2bc009880 tx=0x7fc2bc00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:27:00.742 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.740+0000 7fc2af7fe700 1 -- 172.21.15.26:0/1159940605 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc2b80548a0 con 0x7fc2c80f5ef0 2021-11-03T18:27:00.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.942+0000 7fc2cd73c700 1 -- 172.21.15.26:0/1159940605 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc2c80fdf10 con 0x7fc2c80f5ef0 2021-11-03T18:27:00.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.943+0000 7fc2af7fe700 1 -- 172.21.15.26:0/1159940605 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fc2b8054490 con 0x7fc2c80f5ef0 2021-11-03T18:27:00.942 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:27:00.943 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:27:00.943 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:27:00.943 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:27:00.943 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:27:00.944 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:27:00.944 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:27:00.944 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:27:00.944 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:27:00.945 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:27:00.945 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:27:00.945 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:27:00.945 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:27:00.945 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:27:00.946 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:27:00.946 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:27:00.946 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:27:00.946 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:27:00.946 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:27:00.947 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:27:00.947 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:27:00.947 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:27:00.947 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:27:00.948 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:27:00.948 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:27:00.948 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:27:00.948 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:27:00.948 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:27:00.949 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:27:00.949 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:27:00.949 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:27:00.949 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:27:00.950 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:27:00.950 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:27:00.950 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:27:00.950 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:27:00.951 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:27:00.951 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:27:00.951 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:27:00.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.945+0000 7fc2cd73c700 1 -- 172.21.15.26:0/1159940605 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc2b00640b0 msgr2=0x7fc2b0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:27:00.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.945+0000 7fc2cd73c700 1 --2- 172.21.15.26:0/1159940605 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc2b00640b0 0x7fc2b0066570 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7fc2bc009880 tx=0x7fc2bc00b040).stop 2021-11-03T18:27:00.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.945+0000 7fc2cd73c700 1 -- 172.21.15.26:0/1159940605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2c80f5ef0 msgr2=0x7fc2c810c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:27:00.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.945+0000 7fc2cd73c700 1 --2- 172.21.15.26:0/1159940605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2c80f5ef0 0x7fc2c810c110 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 rx=0x7fc2b8009990 tx=0x7fc2b8009b30).stop 2021-11-03T18:27:00.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.945+0000 7fc2cd73c700 1 -- 172.21.15.26:0/1159940605 shutdown_connections 2021-11-03T18:27:00.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.945+0000 7fc2cd73c700 1 --2- 172.21.15.26:0/1159940605 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc2b00640b0 0x7fc2b0066570 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:27:00.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.945+0000 7fc2cd73c700 1 --2- 172.21.15.26:0/1159940605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2c80f55e0 0x7fc2c8109c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:27:00.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.945+0000 7fc2cd73c700 1 --2- 172.21.15.26:0/1159940605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2c80f5ef0 0x7fc2c810c110 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:27:00.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.945+0000 7fc2cd73c700 1 -- 172.21.15.26:0/1159940605 >> 172.21.15.26:0/1159940605 conn(0x7fc2c80f0de0 msgr2=0x7fc2c80fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:27:00.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.945+0000 7fc2cd73c700 1 -- 172.21.15.26:0/1159940605 shutdown_connections 2021-11-03T18:27:00.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:00.945+0000 7fc2cd73c700 1 -- 172.21.15.26:0/1159940605 wait complete. 2021-11-03T18:27:00.954 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:27:01.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:01 smithi026 ceph-mon[96795]: pgmap v2770: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:01.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:01 smithi026 ceph-mon[96795]: from='client.36988 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:27:01.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:01 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/530425347' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:27:01.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:01 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1159940605' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:27:01.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:01 smithi194 ceph-mon[65619]: pgmap v2770: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:01.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:01 smithi194 ceph-mon[65619]: from='client.36988 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:27:01.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:01 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/530425347' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:27:01.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:01 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1159940605' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:27:02.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:02 smithi026 ceph-mon[96795]: from='client.36992 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:27:02.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:02 smithi194 ceph-mon[65619]: from='client.36992 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:27:03.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:03 smithi026 ceph-mon[96795]: pgmap v2771: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:03.473 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:03 smithi194 ceph-mon[65619]: pgmap v2771: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:05.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:05 smithi026 ceph-mon[96795]: pgmap v2772: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:05.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:05 smithi194 ceph-mon[65619]: pgmap v2772: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:07.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:07 smithi026 ceph-mon[96795]: pgmap v2773: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:07.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:07 smithi194 ceph-mon[65619]: pgmap v2773: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:09.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:09 smithi026 ceph-mon[96795]: pgmap v2774: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:09.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:09 smithi194 ceph-mon[65619]: pgmap v2774: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:11.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:11 smithi026 ceph-mon[96795]: pgmap v2775: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:11.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:11 smithi194 ceph-mon[65619]: pgmap v2775: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:12.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:12 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:27:12.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:12 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:27:13.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:13 smithi026 ceph-mon[96795]: pgmap v2776: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:13.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:13 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:27:13.473 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:13 smithi194 ceph-mon[65619]: pgmap v2776: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:13.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:13 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:27:15.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:15 smithi026 ceph-mon[96795]: pgmap v2777: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:15.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:15 smithi194 ceph-mon[65619]: pgmap v2777: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:17.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:17 smithi026 ceph-mon[96795]: pgmap v2778: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:17.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:17 smithi194 ceph-mon[65619]: pgmap v2778: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:19.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:19 smithi026 ceph-mon[96795]: pgmap v2779: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:19.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:19 smithi194 ceph-mon[65619]: pgmap v2779: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:21.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:21 smithi026 ceph-mon[96795]: pgmap v2780: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:21.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:21 smithi194 ceph-mon[65619]: pgmap v2780: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:23.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:23 smithi026 ceph-mon[96795]: pgmap v2781: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:23.473 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:23 smithi194 ceph-mon[65619]: pgmap v2781: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:25.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:25 smithi026 ceph-mon[96795]: pgmap v2782: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:25.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:25 smithi194 ceph-mon[65619]: pgmap v2782: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:27.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:27 smithi026 ceph-mon[96795]: pgmap v2783: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:27.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:27 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:27:27.468 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:27 smithi194 ceph-mon[65619]: pgmap v2783: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:27.469 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:27 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:27:28.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:28 smithi026 ceph-mon[96795]: poll took 60066.068 ms: 1 events 2021-11-03T18:27:28.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:27:28.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:27:28.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:27:28.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:27:28.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:27:28.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:27:28.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:27:28.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:27:28.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:27:28.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:28 smithi194 ceph-mon[65619]: poll took 60066.068 ms: 1 events 2021-11-03T18:27:28.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:27:28.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:27:28.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:27:28.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:27:28.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:27:28.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:27:28.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:27:28.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:27:28.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:27:29.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:29 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:27:29.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:29 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:27:29.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:29 smithi026 ceph-mon[96795]: pgmap v2784: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:29.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:29 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:27:29.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:29 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:27:29.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:29 smithi194 ceph-mon[65619]: pgmap v2784: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:31.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.059+0000 7f4fe87bb700 1 -- 172.21.15.26:0/29126978 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fe00f66e0 msgr2=0x7f4fe00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:27:31.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.060+0000 7f4fe87bb700 1 --2- 172.21.15.26:0/29126978 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fe00f66e0 0x7f4fe00f6b00 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 rx=0x7f4fdc004660 tx=0x7f4fdc009b30).stop 2021-11-03T18:27:31.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.060+0000 7f4fe87bb700 1 -- 172.21.15.26:0/29126978 shutdown_connections 2021-11-03T18:27:31.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.060+0000 7f4fe87bb700 1 --2- 172.21.15.26:0/29126978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4fe00f6ff0 0x7f4fe00f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:27:31.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.060+0000 7f4fe87bb700 1 --2- 172.21.15.26:0/29126978 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fe00f66e0 0x7f4fe00f6b00 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:27:31.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.060+0000 7f4fe87bb700 1 -- 172.21.15.26:0/29126978 >> 172.21.15.26:0/29126978 conn(0x7f4fe00f1f00 msgr2=0x7f4fe00f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:27:31.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.060+0000 7f4fe87bb700 1 -- 172.21.15.26:0/29126978 shutdown_connections 2021-11-03T18:27:31.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.060+0000 7f4fe87bb700 1 -- 172.21.15.26:0/29126978 wait complete. 2021-11-03T18:27:31.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.060+0000 7f4fe87bb700 1 Processor -- start 2021-11-03T18:27:31.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.060+0000 7f4fe87bb700 1 -- start start 2021-11-03T18:27:31.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.060+0000 7f4fe87bb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fe00f66e0 0x7f4fe0106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:27:31.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.060+0000 7f4fe87bb700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4fe00f6ff0 0x7f4fe0107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:27:31.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.061+0000 7f4fe87bb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe0107a00 con 0x7f4fe00f66e0 2021-11-03T18:27:31.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.061+0000 7f4fe87bb700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe0107b40 con 0x7f4fe00f6ff0 2021-11-03T18:27:31.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.061+0000 7f4fe6557700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fe00f66e0 0x7f4fe0106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:27:31.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.061+0000 7f4fe6557700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fe00f66e0 0x7f4fe0106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60124/0 (socket says 172.21.15.26:60124) 2021-11-03T18:27:31.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.061+0000 7f4fe6557700 1 -- 172.21.15.26:0/975930746 learned_addr learned my addr 172.21.15.26:0/975930746 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:27:31.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.061+0000 7f4fe6557700 1 -- 172.21.15.26:0/975930746 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4fe00f6ff0 msgr2=0x7f4fe0107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:27:31.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.061+0000 7f4fe6557700 1 --2- 172.21.15.26:0/975930746 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4fe00f6ff0 0x7f4fe0107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:27:31.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.061+0000 7f4fe6557700 1 -- 172.21.15.26:0/975930746 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fdc005040 con 0x7f4fe00f66e0 2021-11-03T18:27:31.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.061+0000 7f4fe6557700 1 --2- 172.21.15.26:0/975930746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fe00f66e0 0x7f4fe0106f60 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 rx=0x7f4fdc009990 tx=0x7f4fdc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:27:31.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.061+0000 7f4fd6ffd700 1 -- 172.21.15.26:0/975930746 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fdc018070 con 0x7f4fe00f66e0 2021-11-03T18:27:31.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.061+0000 7f4fd6ffd700 1 -- 172.21.15.26:0/975930746 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4fdc007ba0 con 0x7f4fe00f66e0 2021-11-03T18:27:31.065 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.061+0000 7f4fe87bb700 1 -- 172.21.15.26:0/975930746 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fe0108480 con 0x7f4fe00f66e0 2021-11-03T18:27:31.065 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.061+0000 7f4fd6ffd700 1 -- 172.21.15.26:0/975930746 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fdc01c3c0 con 0x7f4fe00f66e0 2021-11-03T18:27:31.065 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.061+0000 7f4fe87bb700 1 -- 172.21.15.26:0/975930746 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fe01089e0 con 0x7f4fe00f66e0 2021-11-03T18:27:31.066 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.062+0000 7f4fe87bb700 1 -- 172.21.15.26:0/975930746 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fe0045ad0 con 0x7f4fe00f66e0 2021-11-03T18:27:31.066 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.063+0000 7f4fd6ffd700 1 -- 172.21.15.26:0/975930746 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f4fdc01d420 con 0x7f4fe00f66e0 2021-11-03T18:27:31.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.063+0000 7f4fd6ffd700 1 --2- 172.21.15.26:0/975930746 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4fcc0640b0 0x7f4fcc066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:27:31.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.063+0000 7f4fd6ffd700 1 -- 172.21.15.26:0/975930746 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f4fdc0825c0 con 0x7f4fe00f66e0 2021-11-03T18:27:31.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.063+0000 7f4fe5d56700 1 --2- 172.21.15.26:0/975930746 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4fcc0640b0 0x7f4fcc066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:27:31.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.064+0000 7f4fe5d56700 1 --2- 172.21.15.26:0/975930746 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4fcc0640b0 0x7f4fcc066570 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7f4fd0004a10 tx=0x7f4fd00099e0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:27:31.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.067+0000 7f4fd6ffd700 1 -- 172.21.15.26:0/975930746 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f4fdc0548c0 con 0x7f4fe00f66e0 2021-11-03T18:27:31.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.245+0000 7f4fe87bb700 1 -- 172.21.15.26:0/975930746 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4fe00ff050 con 0x7f4fcc0640b0 2021-11-03T18:27:31.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.246+0000 7f4fd6ffd700 1 -- 172.21.15.26:0/975930746 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f4fe00ff050 con 0x7f4fcc0640b0 2021-11-03T18:27:31.247 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.248+0000 7f4fe87bb700 1 -- 172.21.15.26:0/975930746 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4fcc0640b0 msgr2=0x7f4fcc066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:27:31.247 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.248+0000 7f4fe87bb700 1 --2- 172.21.15.26:0/975930746 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4fcc0640b0 0x7f4fcc066570 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7f4fd0004a10 tx=0x7f4fd00099e0).stop 2021-11-03T18:27:31.247 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.248+0000 7f4fe87bb700 1 -- 172.21.15.26:0/975930746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fe00f66e0 msgr2=0x7f4fe0106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:27:31.247 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.248+0000 7f4fe87bb700 1 --2- 172.21.15.26:0/975930746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fe00f66e0 0x7f4fe0106f60 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 rx=0x7f4fdc009990 tx=0x7f4fdc009b30).stop 2021-11-03T18:27:31.248 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.248+0000 7f4fe87bb700 1 -- 172.21.15.26:0/975930746 shutdown_connections 2021-11-03T18:27:31.248 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.248+0000 7f4fe87bb700 1 --2- 172.21.15.26:0/975930746 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4fcc0640b0 0x7f4fcc066570 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:27:31.248 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.248+0000 7f4fe87bb700 1 --2- 172.21.15.26:0/975930746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fe00f66e0 0x7f4fe0106f60 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:27:31.248 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.248+0000 7f4fe87bb700 1 --2- 172.21.15.26:0/975930746 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4fe00f6ff0 0x7f4fe0107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:27:31.249 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.248+0000 7f4fe87bb700 1 -- 172.21.15.26:0/975930746 >> 172.21.15.26:0/975930746 conn(0x7f4fe00f1f00 msgr2=0x7f4fe00fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:27:31.249 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.248+0000 7f4fe87bb700 1 -- 172.21.15.26:0/975930746 shutdown_connections 2021-11-03T18:27:31.249 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.248+0000 7f4fe87bb700 1 -- 172.21.15.26:0/975930746 wait complete. 2021-11-03T18:27:31.256 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:27:31.348 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.348+0000 7f4c93ace700 1 -- 172.21.15.26:0/4071305425 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c8c0f6b90 msgr2=0x7f4c8c0f6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:27:31.349 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.348+0000 7f4c93ace700 1 --2- 172.21.15.26:0/4071305425 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c8c0f6b90 0x7f4c8c0f6fb0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 rx=0x7f4c7c004660 tx=0x7f4c7c009b30).stop 2021-11-03T18:27:31.349 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.348+0000 7f4c93ace700 1 -- 172.21.15.26:0/4071305425 shutdown_connections 2021-11-03T18:27:31.349 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.348+0000 7f4c93ace700 1 --2- 172.21.15.26:0/4071305425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c8c0f74a0 0x7f4c8c0f5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:27:31.349 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.348+0000 7f4c93ace700 1 --2- 172.21.15.26:0/4071305425 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c8c0f6b90 0x7f4c8c0f6fb0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:27:31.350 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.348+0000 7f4c93ace700 1 -- 172.21.15.26:0/4071305425 >> 172.21.15.26:0/4071305425 conn(0x7f4c8c0f0540 msgr2=0x7f4c8c0f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:27:31.350 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.348+0000 7f4c93ace700 1 -- 172.21.15.26:0/4071305425 shutdown_connections 2021-11-03T18:27:31.350 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.348+0000 7f4c93ace700 1 -- 172.21.15.26:0/4071305425 wait complete. 2021-11-03T18:27:31.350 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.349+0000 7f4c93ace700 1 Processor -- start 2021-11-03T18:27:31.350 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.349+0000 7f4c93ace700 1 -- start start 2021-11-03T18:27:31.351 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.349+0000 7f4c93ace700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c8c0f6b90 0x7f4c8c10c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:27:31.351 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.349+0000 7f4c93ace700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c8c0f74a0 0x7f4c8c10e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:27:31.351 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.349+0000 7f4c93ace700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c0f54b0 con 0x7f4c8c0f6b90 2021-11-03T18:27:31.351 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.349+0000 7f4c93ace700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c0f55f0 con 0x7f4c8c0f74a0 2021-11-03T18:27:31.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.349+0000 7f4c9186a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c8c0f6b90 0x7f4c8c10c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:27:31.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.349+0000 7f4c9186a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c8c0f6b90 0x7f4c8c10c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60134/0 (socket says 172.21.15.26:60134) 2021-11-03T18:27:31.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.349+0000 7f4c9186a700 1 -- 172.21.15.26:0/2886750225 learned_addr learned my addr 172.21.15.26:0/2886750225 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:27:31.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.349+0000 7f4c91069700 1 --2- 172.21.15.26:0/2886750225 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c8c0f74a0 0x7f4c8c10e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:27:31.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.349+0000 7f4c9186a700 1 -- 172.21.15.26:0/2886750225 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c8c0f74a0 msgr2=0x7f4c8c10e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:27:31.353 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.349+0000 7f4c9186a700 1 --2- 172.21.15.26:0/2886750225 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c8c0f74a0 0x7f4c8c10e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:27:31.353 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.349+0000 7f4c9186a700 1 -- 172.21.15.26:0/2886750225 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7c005040 con 0x7f4c8c0f6b90 2021-11-03T18:27:31.353 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.349+0000 7f4c9186a700 1 --2- 172.21.15.26:0/2886750225 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c8c0f6b90 0x7f4c8c10c0c0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7f4c7c004f60 tx=0x7f4c7c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:27:31.353 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.350+0000 7f4c827fc700 1 -- 172.21.15.26:0/2886750225 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c7c018070 con 0x7f4c8c0f6b90 2021-11-03T18:27:31.354 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.350+0000 7f4c827fc700 1 -- 172.21.15.26:0/2886750225 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4c7c009770 con 0x7f4c8c0f6b90 2021-11-03T18:27:31.354 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.350+0000 7f4c93ace700 1 -- 172.21.15.26:0/2886750225 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c8c10eab0 con 0x7f4c8c0f6b90 2021-11-03T18:27:31.354 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.350+0000 7f4c827fc700 1 -- 172.21.15.26:0/2886750225 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c7c01c3c0 con 0x7f4c8c0f6b90 2021-11-03T18:27:31.354 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.350+0000 7f4c93ace700 1 -- 172.21.15.26:0/2886750225 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c8c10eed0 con 0x7f4c8c0f6b90 2021-11-03T18:27:31.355 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.350+0000 7f4c93ace700 1 -- 172.21.15.26:0/2886750225 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c8c045ad0 con 0x7f4c8c0f6b90 2021-11-03T18:27:31.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.351+0000 7f4c827fc700 1 -- 172.21.15.26:0/2886750225 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f4c7c01d420 con 0x7f4c8c0f6b90 2021-11-03T18:27:31.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.351+0000 7f4c827fc700 1 --2- 172.21.15.26:0/2886750225 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4c780640b0 0x7f4c78066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:27:31.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.351+0000 7f4c827fc700 1 -- 172.21.15.26:0/2886750225 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f4c7c082510 con 0x7f4c8c0f6b90 2021-11-03T18:27:31.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.351+0000 7f4c91069700 1 --2- 172.21.15.26:0/2886750225 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4c780640b0 0x7f4c78066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:27:31.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.352+0000 7f4c91069700 1 --2- 172.21.15.26:0/2886750225 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4c780640b0 0x7f4c78066570 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 rx=0x7f4c88006fd0 tx=0x7f4c88008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:27:31.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.355+0000 7f4c827fc700 1 -- 172.21.15.26:0/2886750225 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f4c7c054930 con 0x7f4c8c0f6b90 2021-11-03T18:27:31.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:31 smithi026 ceph-mon[96795]: pgmap v2785: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:31.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:31 smithi194 ceph-mon[65619]: pgmap v2785: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:31.525 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.528+0000 7f4c93ace700 1 -- 172.21.15.26:0/2886750225 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c8c0fdf30 con 0x7f4c780640b0 2021-11-03T18:27:31.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.542+0000 7f4c827fc700 1 -- 172.21.15.26:0/2886750225 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f4c8c0fdf30 con 0x7f4c780640b0 2021-11-03T18:27:31.540 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:27:31.541 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (98m) 7m ago 100m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:27:31.541 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (90m) 7m ago 99m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:27:31.541 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (90m) 6m ago 99m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:27:31.541 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (98m) 7m ago 99m 42.2M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:27:31.542 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (91m) 7m ago 95m 26.0M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:27:31.542 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (92m) 7m ago 95m 26.6M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:27:31.542 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (95m) 6m ago 95m 26.8M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:27:31.542 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (95m) 6m ago 95m 27.2M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:27:31.543 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (92m) 7m ago 101m 588M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:27:31.543 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (92m) 6m ago 99m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:27:31.543 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (91m) 7m ago 101m 341M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:27:31.543 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (91m) 6m ago 99m 158M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:27:31.544 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (99m) 7m ago 99m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:27:31.544 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (98m) 6m ago 98m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:27:31.544 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (90m) 7m ago 98m 332M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:27:31.545 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (90m) 7m ago 98m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:27:31.545 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (89m) 7m ago 97m 296M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:27:31.546 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (89m) 6m ago 97m 387M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:27:31.546 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (88m) 6m ago 97m 320M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:27:31.546 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (88m) 6m ago 96m 316M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:27:31.546 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (98m) 7m ago 99m 65.7M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:27:31.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.544+0000 7f4c93ace700 1 -- 172.21.15.26:0/2886750225 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4c780640b0 msgr2=0x7f4c78066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:27:31.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.544+0000 7f4c93ace700 1 --2- 172.21.15.26:0/2886750225 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4c780640b0 0x7f4c78066570 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 rx=0x7f4c88006fd0 tx=0x7f4c88008040).stop 2021-11-03T18:27:31.548 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.544+0000 7f4c93ace700 1 -- 172.21.15.26:0/2886750225 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c8c0f6b90 msgr2=0x7f4c8c10c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:27:31.548 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.544+0000 7f4c93ace700 1 --2- 172.21.15.26:0/2886750225 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c8c0f6b90 0x7f4c8c10c0c0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7f4c7c004f60 tx=0x7f4c7c009b30).stop 2021-11-03T18:27:31.548 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.544+0000 7f4c93ace700 1 -- 172.21.15.26:0/2886750225 shutdown_connections 2021-11-03T18:27:31.549 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.544+0000 7f4c93ace700 1 --2- 172.21.15.26:0/2886750225 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4c780640b0 0x7f4c78066570 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:27:31.549 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.544+0000 7f4c93ace700 1 --2- 172.21.15.26:0/2886750225 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c8c0f6b90 0x7f4c8c10c0c0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:27:31.549 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.544+0000 7f4c93ace700 1 --2- 172.21.15.26:0/2886750225 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c8c0f74a0 0x7f4c8c10e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:27:31.549 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.544+0000 7f4c93ace700 1 -- 172.21.15.26:0/2886750225 >> 172.21.15.26:0/2886750225 conn(0x7f4c8c0f0540 msgr2=0x7f4c8c0fa390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:27:31.549 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.544+0000 7f4c93ace700 1 -- 172.21.15.26:0/2886750225 shutdown_connections 2021-11-03T18:27:31.550 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.544+0000 7f4c93ace700 1 -- 172.21.15.26:0/2886750225 wait complete. 2021-11-03T18:27:31.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.643+0000 7f51a232e700 1 -- 172.21.15.26:0/832691137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f519c0f6530 msgr2=0x7f519c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:27:31.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.643+0000 7f51a232e700 1 --2- 172.21.15.26:0/832691137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f519c0f6530 0x7f519c0f6950 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 rx=0x7f5198004660 tx=0x7f5198009b30).stop 2021-11-03T18:27:31.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.643+0000 7f51a232e700 1 -- 172.21.15.26:0/832691137 shutdown_connections 2021-11-03T18:27:31.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.643+0000 7f51a232e700 1 --2- 172.21.15.26:0/832691137 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f519c0f77d0 0x7f519c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:27:31.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.643+0000 7f51a232e700 1 --2- 172.21.15.26:0/832691137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f519c0f6530 0x7f519c0f6950 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:27:31.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.643+0000 7f51a232e700 1 -- 172.21.15.26:0/832691137 >> 172.21.15.26:0/832691137 conn(0x7f519c0f1cd0 msgr2=0x7f519c0f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:27:31.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.644+0000 7f51a232e700 1 -- 172.21.15.26:0/832691137 shutdown_connections 2021-11-03T18:27:31.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.644+0000 7f51a232e700 1 -- 172.21.15.26:0/832691137 wait complete. 2021-11-03T18:27:31.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.644+0000 7f51a232e700 1 Processor -- start 2021-11-03T18:27:31.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.644+0000 7f51a232e700 1 -- start start 2021-11-03T18:27:31.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.644+0000 7f51a232e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f519c0f6530 0x7f519c106d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:27:31.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.644+0000 7f51a232e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f519c0f77d0 0x7f519c107260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:27:31.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.644+0000 7f51a232e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519c107860 con 0x7f519c0f6530 2021-11-03T18:27:31.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.644+0000 7f51a232e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519c108070 con 0x7f519c0f77d0 2021-11-03T18:27:31.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.644+0000 7f51a132c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f519c0f6530 0x7f519c106d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:27:31.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.644+0000 7f51a132c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f519c0f6530 0x7f519c106d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60144/0 (socket says 172.21.15.26:60144) 2021-11-03T18:27:31.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.644+0000 7f51a132c700 1 -- 172.21.15.26:0/2852291268 learned_addr learned my addr 172.21.15.26:0/2852291268 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:27:31.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.644+0000 7f51a0b2b700 1 --2- 172.21.15.26:0/2852291268 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f519c0f77d0 0x7f519c107260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:27:31.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.645+0000 7f51a132c700 1 -- 172.21.15.26:0/2852291268 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f519c0f77d0 msgr2=0x7f519c107260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:27:31.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.645+0000 7f51a132c700 1 --2- 172.21.15.26:0/2852291268 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f519c0f77d0 0x7f519c107260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:27:31.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.645+0000 7f51a132c700 1 -- 172.21.15.26:0/2852291268 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5198005040 con 0x7f519c0f6530 2021-11-03T18:27:31.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.645+0000 7f51a132c700 1 --2- 172.21.15.26:0/2852291268 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f519c0f6530 0x7f519c106d70 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 rx=0x7f5198013a70 tx=0x7f5198009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:27:31.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.645+0000 7f5191ffb700 1 -- 172.21.15.26:0/2852291268 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5198018070 con 0x7f519c0f6530 2021-11-03T18:27:31.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.645+0000 7f5191ffb700 1 -- 172.21.15.26:0/2852291268 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f51980097d0 con 0x7f519c0f6530 2021-11-03T18:27:31.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.645+0000 7f51a232e700 1 -- 172.21.15.26:0/2852291268 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f519c108290 con 0x7f519c0f6530 2021-11-03T18:27:31.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.645+0000 7f5191ffb700 1 -- 172.21.15.26:0/2852291268 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f519801de80 con 0x7f519c0f6530 2021-11-03T18:27:31.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.645+0000 7f51a232e700 1 -- 172.21.15.26:0/2852291268 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f519c1087f0 con 0x7f519c0f6530 2021-11-03T18:27:31.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.646+0000 7f51a232e700 1 -- 172.21.15.26:0/2852291268 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f519c059100 con 0x7f519c0f6530 2021-11-03T18:27:31.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.647+0000 7f5191ffb700 1 -- 172.21.15.26:0/2852291268 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f5198007ba0 con 0x7f519c0f6530 2021-11-03T18:27:31.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.647+0000 7f5191ffb700 1 --2- 172.21.15.26:0/2852291268 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5188064100 0x7f51880665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:27:31.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.647+0000 7f5191ffb700 1 -- 172.21.15.26:0/2852291268 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f5198082300 con 0x7f519c0f6530 2021-11-03T18:27:31.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.647+0000 7f51a0b2b700 1 --2- 172.21.15.26:0/2852291268 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5188064100 0x7f51880665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:27:31.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.648+0000 7f51a0b2b700 1 --2- 172.21.15.26:0/2852291268 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5188064100 0x7f51880665c0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7f518c004ce0 tx=0x7f518c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:27:31.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.651+0000 7f5191ffb700 1 -- 172.21.15.26:0/2852291268 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f5198054720 con 0x7f519c0f6530 2021-11-03T18:27:31.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.880+0000 7f51a232e700 1 -- 172.21.15.26:0/2852291268 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f519c0fed90 con 0x7f519c0f6530 2021-11-03T18:27:31.879 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.881+0000 7f5191ffb700 1 -- 172.21.15.26:0/2852291268 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f5198054310 con 0x7f519c0f6530 2021-11-03T18:27:31.879 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:27:31.879 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:27:31.880 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:27:31.880 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:27:31.880 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:27:31.880 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:27:31.880 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:27:31.881 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:27:31.881 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:27:31.881 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:27:31.881 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:27:31.881 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:27:31.882 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:27:31.882 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:27:31.882 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:27:31.883 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:27:31.883 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:27:31.883 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:27:31.884 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.882+0000 7f51a232e700 1 -- 172.21.15.26:0/2852291268 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5188064100 msgr2=0x7f51880665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:27:31.884 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.882+0000 7f51a232e700 1 --2- 172.21.15.26:0/2852291268 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5188064100 0x7f51880665c0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7f518c004ce0 tx=0x7f518c00b040).stop 2021-11-03T18:27:31.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.882+0000 7f51a232e700 1 -- 172.21.15.26:0/2852291268 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f519c0f6530 msgr2=0x7f519c106d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:27:31.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.882+0000 7f51a232e700 1 --2- 172.21.15.26:0/2852291268 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f519c0f6530 0x7f519c106d70 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 rx=0x7f5198013a70 tx=0x7f5198009b30).stop 2021-11-03T18:27:31.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.882+0000 7f51a232e700 1 -- 172.21.15.26:0/2852291268 shutdown_connections 2021-11-03T18:27:31.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.882+0000 7f51a232e700 1 --2- 172.21.15.26:0/2852291268 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5188064100 0x7f51880665c0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:27:31.886 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.882+0000 7f51a232e700 1 --2- 172.21.15.26:0/2852291268 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f519c0f6530 0x7f519c106d70 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:27:31.886 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.882+0000 7f51a232e700 1 --2- 172.21.15.26:0/2852291268 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f519c0f77d0 0x7f519c107260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:27:31.886 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.882+0000 7f51a232e700 1 -- 172.21.15.26:0/2852291268 >> 172.21.15.26:0/2852291268 conn(0x7f519c0f1cd0 msgr2=0x7f519c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:27:31.886 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.882+0000 7f51a232e700 1 -- 172.21.15.26:0/2852291268 shutdown_connections 2021-11-03T18:27:31.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.882+0000 7f51a232e700 1 -- 172.21.15.26:0/2852291268 wait complete. 2021-11-03T18:27:31.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.982+0000 7ffb852a4700 1 -- 172.21.15.26:0/2661849914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb800f6530 msgr2=0x7ffb800f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:27:31.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.982+0000 7ffb852a4700 1 --2- 172.21.15.26:0/2661849914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb800f6530 0x7ffb800f6950 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 rx=0x7ffb70004660 tx=0x7ffb70009b30).stop 2021-11-03T18:27:31.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.982+0000 7ffb852a4700 1 -- 172.21.15.26:0/2661849914 shutdown_connections 2021-11-03T18:27:31.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.982+0000 7ffb852a4700 1 --2- 172.21.15.26:0/2661849914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb800f77d0 0x7ffb800f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:27:31.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.982+0000 7ffb852a4700 1 --2- 172.21.15.26:0/2661849914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb800f6530 0x7ffb800f6950 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:27:31.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.982+0000 7ffb852a4700 1 -- 172.21.15.26:0/2661849914 >> 172.21.15.26:0/2661849914 conn(0x7ffb800f1cd0 msgr2=0x7ffb800f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:27:31.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.982+0000 7ffb852a4700 1 -- 172.21.15.26:0/2661849914 shutdown_connections 2021-11-03T18:27:31.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.982+0000 7ffb852a4700 1 -- 172.21.15.26:0/2661849914 wait complete. 2021-11-03T18:27:31.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.983+0000 7ffb852a4700 1 Processor -- start 2021-11-03T18:27:31.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.983+0000 7ffb852a4700 1 -- start start 2021-11-03T18:27:31.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.983+0000 7ffb852a4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb800f6530 0x7ffb80106db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:27:31.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.983+0000 7ffb852a4700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb800f77d0 0x7ffb801072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:27:31.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.983+0000 7ffb852a4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb801078a0 con 0x7ffb800f6530 2021-11-03T18:27:31.986 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.983+0000 7ffb852a4700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb801080e0 con 0x7ffb800f77d0 2021-11-03T18:27:31.986 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.983+0000 7ffb7ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb800f6530 0x7ffb80106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:27:31.986 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.983+0000 7ffb7ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb800f6530 0x7ffb80106db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60154/0 (socket says 172.21.15.26:60154) 2021-11-03T18:27:31.986 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.983+0000 7ffb7ffff700 1 -- 172.21.15.26:0/2843949065 learned_addr learned my addr 172.21.15.26:0/2843949065 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:27:31.987 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.984+0000 7ffb7f7fe700 1 --2- 172.21.15.26:0/2843949065 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb800f77d0 0x7ffb801072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:27:31.987 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.984+0000 7ffb7ffff700 1 -- 172.21.15.26:0/2843949065 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb800f77d0 msgr2=0x7ffb801072a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:27:31.987 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.984+0000 7ffb7ffff700 1 --2- 172.21.15.26:0/2843949065 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb800f77d0 0x7ffb801072a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:27:31.987 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.984+0000 7ffb7ffff700 1 -- 172.21.15.26:0/2843949065 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb70005040 con 0x7ffb800f6530 2021-11-03T18:27:31.987 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.984+0000 7ffb7ffff700 1 --2- 172.21.15.26:0/2843949065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb800f6530 0x7ffb80106db0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 rx=0x7ffb70013a70 tx=0x7ffb70009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:27:31.988 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.984+0000 7ffb7cff9700 1 -- 172.21.15.26:0/2843949065 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb70018070 con 0x7ffb800f6530 2021-11-03T18:27:31.988 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.984+0000 7ffb852a4700 1 -- 172.21.15.26:0/2843949065 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb80108360 con 0x7ffb800f6530 2021-11-03T18:27:31.988 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.984+0000 7ffb7cff9700 1 -- 172.21.15.26:0/2843949065 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ffb700097d0 con 0x7ffb800f6530 2021-11-03T18:27:31.988 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.984+0000 7ffb7cff9700 1 -- 172.21.15.26:0/2843949065 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb7001c3c0 con 0x7ffb800f6530 2021-11-03T18:27:31.989 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.984+0000 7ffb852a4700 1 -- 172.21.15.26:0/2843949065 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb80108840 con 0x7ffb800f6530 2021-11-03T18:27:31.989 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.985+0000 7ffb852a4700 1 -- 172.21.15.26:0/2843949065 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb80059100 con 0x7ffb800f6530 2021-11-03T18:27:31.989 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.986+0000 7ffb7cff9700 1 -- 172.21.15.26:0/2843949065 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ffb70007ba0 con 0x7ffb800f6530 2021-11-03T18:27:31.989 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.986+0000 7ffb7cff9700 1 --2- 172.21.15.26:0/2843949065 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffb68064100 0x7ffb680665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:27:31.989 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.986+0000 7ffb7cff9700 1 -- 172.21.15.26:0/2843949065 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ffb70082470 con 0x7ffb800f6530 2021-11-03T18:27:31.990 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.986+0000 7ffb7f7fe700 1 --2- 172.21.15.26:0/2843949065 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffb68064100 0x7ffb680665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:27:31.990 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.986+0000 7ffb7f7fe700 1 --2- 172.21.15.26:0/2843949065 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffb68064100 0x7ffb680665c0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7ffb80106b40 tx=0x7ffb74009be0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:27:31.990 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:31.990+0000 7ffb7cff9700 1 -- 172.21.15.26:0/2843949065 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ffb700547d0 con 0x7ffb800f6530 2021-11-03T18:27:32.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:32.193+0000 7ffb852a4700 1 -- 172.21.15.26:0/2843949065 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ffb800fecf0 con 0x7ffb800f6530 2021-11-03T18:27:32.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:32.194+0000 7ffb7cff9700 1 -- 172.21.15.26:0/2843949065 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7ffb700543c0 con 0x7ffb800f6530 2021-11-03T18:27:32.192 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:27:32.193 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:27:32.193 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:27:32.193 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:27:32.193 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:27:32.193 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:27:32.194 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:27:32.194 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:27:32.194 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:27:32.194 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:27:32.194 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:27:32.195 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:27:32.195 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:27:32.195 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:27:32.195 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:27:32.195 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:27:32.196 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:27:32.196 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:27:32.196 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:27:32.196 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:27:32.196 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:27:32.197 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:27:32.197 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:27:32.197 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:27:32.197 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:27:32.197 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:27:32.198 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:27:32.198 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:27:32.198 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:27:32.199 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:27:32.199 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:27:32.199 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:27:32.199 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:27:32.200 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:27:32.200 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:27:32.200 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:27:32.200 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:27:32.200 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:27:32.201 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:27:32.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:32.196+0000 7ffb852a4700 1 -- 172.21.15.26:0/2843949065 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffb68064100 msgr2=0x7ffb680665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:27:32.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:32.196+0000 7ffb852a4700 1 --2- 172.21.15.26:0/2843949065 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffb68064100 0x7ffb680665c0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7ffb80106b40 tx=0x7ffb74009be0).stop 2021-11-03T18:27:32.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:32.196+0000 7ffb852a4700 1 -- 172.21.15.26:0/2843949065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb800f6530 msgr2=0x7ffb80106db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:27:32.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:32.196+0000 7ffb852a4700 1 --2- 172.21.15.26:0/2843949065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb800f6530 0x7ffb80106db0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 rx=0x7ffb70013a70 tx=0x7ffb70009b30).stop 2021-11-03T18:27:32.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:32.196+0000 7ffb852a4700 1 -- 172.21.15.26:0/2843949065 shutdown_connections 2021-11-03T18:27:32.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:32.196+0000 7ffb852a4700 1 --2- 172.21.15.26:0/2843949065 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffb68064100 0x7ffb680665c0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:27:32.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:32.196+0000 7ffb852a4700 1 --2- 172.21.15.26:0/2843949065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb800f6530 0x7ffb80106db0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:27:32.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:32.196+0000 7ffb852a4700 1 --2- 172.21.15.26:0/2843949065 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb800f77d0 0x7ffb801072a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:27:32.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:32.196+0000 7ffb852a4700 1 -- 172.21.15.26:0/2843949065 >> 172.21.15.26:0/2843949065 conn(0x7ffb800f1cd0 msgr2=0x7ffb800fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:27:32.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:32.196+0000 7ffb852a4700 1 -- 172.21.15.26:0/2843949065 shutdown_connections 2021-11-03T18:27:32.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:27:32.196+0000 7ffb852a4700 1 -- 172.21.15.26:0/2843949065 wait complete. 2021-11-03T18:27:32.204 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:27:32.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:32 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2852291268' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:27:32.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:32 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2852291268' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:27:33.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:33 smithi026 ceph-mon[96795]: from='client.37004 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:27:33.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:33 smithi026 ceph-mon[96795]: from='client.37008 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:27:33.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:33 smithi026 ceph-mon[96795]: pgmap v2786: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:33.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:33 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2843949065' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:27:33.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:33 smithi194 ceph-mon[65619]: from='client.37004 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:27:33.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:33 smithi194 ceph-mon[65619]: from='client.37008 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:27:33.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:33 smithi194 ceph-mon[65619]: pgmap v2786: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:33.475 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:33 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2843949065' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:27:35.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:35 smithi194 ceph-mon[65619]: pgmap v2787: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:35.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:35 smithi026 ceph-mon[96795]: pgmap v2787: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:36.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:36 smithi194 ceph-mon[65619]: pgmap v2788: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:36.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:36 smithi026 ceph-mon[96795]: pgmap v2788: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:39.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:38 smithi194 ceph-mon[65619]: pgmap v2789: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:39.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:38 smithi026 ceph-mon[96795]: pgmap v2789: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:41.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:40 smithi194 ceph-mon[65619]: pgmap v2790: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:41.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:40 smithi026 ceph-mon[96795]: pgmap v2790: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:43.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:42 smithi194 ceph-mon[65619]: pgmap v2791: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:43.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:27:43.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:42 smithi026 ceph-mon[96795]: pgmap v2791: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:43.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:27:44.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:43 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:27:44.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:43 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:27:45.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:44 smithi194 ceph-mon[65619]: pgmap v2792: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:45.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:44 smithi026 ceph-mon[96795]: pgmap v2792: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:47.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:46 smithi194 ceph-mon[65619]: pgmap v2793: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:47.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:46 smithi026 ceph-mon[96795]: pgmap v2793: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:49.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:48 smithi194 ceph-mon[65619]: pgmap v2794: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:49.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:27:49.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:27:49.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:48 smithi026 ceph-mon[96795]: pgmap v2794: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:27:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:27:51.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:50 smithi194 ceph-mon[65619]: pgmap v2795: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:51.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:50 smithi026 ceph-mon[96795]: pgmap v2795: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:53.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:52 smithi194 ceph-mon[65619]: pgmap v2796: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:53.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:52 smithi026 ceph-mon[96795]: pgmap v2796: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:55.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:54 smithi194 ceph-mon[65619]: pgmap v2797: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:55.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:54 smithi026 ceph-mon[96795]: pgmap v2797: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:57.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:56 smithi194 ceph-mon[65619]: pgmap v2798: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:57.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:56 smithi026 ceph-mon[96795]: pgmap v2798: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:58.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:57 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:27:58.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:57 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:27:59.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:58 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:27:59.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:27:58 smithi194 ceph-mon[65619]: pgmap v2799: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:27:59.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:58 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:27:59.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:27:58 smithi026 ceph-mon[96795]: pgmap v2799: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:01.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:00 smithi194 ceph-mon[65619]: pgmap v2800: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:01.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:00 smithi026 ceph-mon[96795]: pgmap v2800: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:02.310 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.311+0000 7fc3aab6d700 1 -- 172.21.15.26:0/358580249 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3a40f5440 msgr2=0x7fc3a40f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:28:02.311 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.311+0000 7fc3aab6d700 1 --2- 172.21.15.26:0/358580249 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3a40f5440 0x7fc3a40f5860 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 rx=0x7fc3a0004660 tx=0x7fc3a0009b30).stop 2021-11-03T18:28:02.311 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.311+0000 7fc3aab6d700 1 -- 172.21.15.26:0/358580249 shutdown_connections 2021-11-03T18:28:02.311 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.311+0000 7fc3aab6d700 1 --2- 172.21.15.26:0/358580249 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3a40f66e0 0x7fc3a40f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:02.311 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.311+0000 7fc3aab6d700 1 --2- 172.21.15.26:0/358580249 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3a40f5440 0x7fc3a40f5860 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:02.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.311+0000 7fc3aab6d700 1 -- 172.21.15.26:0/358580249 >> 172.21.15.26:0/358580249 conn(0x7fc3a40f0ba0 msgr2=0x7fc3a40f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:28:02.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.311+0000 7fc3aab6d700 1 -- 172.21.15.26:0/358580249 shutdown_connections 2021-11-03T18:28:02.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.311+0000 7fc3aab6d700 1 -- 172.21.15.26:0/358580249 wait complete. 2021-11-03T18:28:02.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.311+0000 7fc3aab6d700 1 Processor -- start 2021-11-03T18:28:02.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.311+0000 7fc3aab6d700 1 -- start start 2021-11-03T18:28:02.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.312+0000 7fc3aab6d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3a40f5440 0x7fc3a410bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:28:02.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.312+0000 7fc3aab6d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3a40f66e0 0x7fc3a410e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:28:02.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.312+0000 7fc3aab6d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a40602b0 con 0x7fc3a40f66e0 2021-11-03T18:28:02.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.312+0000 7fc3aab6d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a40603f0 con 0x7fc3a40f5440 2021-11-03T18:28:02.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.312+0000 7fc3a936a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3a40f66e0 0x7fc3a410e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:28:02.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.312+0000 7fc3a936a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3a40f66e0 0x7fc3a410e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60176/0 (socket says 172.21.15.26:60176) 2021-11-03T18:28:02.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.312+0000 7fc3a936a700 1 -- 172.21.15.26:0/524717042 learned_addr learned my addr 172.21.15.26:0/524717042 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:28:02.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.312+0000 7fc3a9b6b700 1 --2- 172.21.15.26:0/524717042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3a40f5440 0x7fc3a410bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:28:02.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.312+0000 7fc3a936a700 1 -- 172.21.15.26:0/524717042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3a40f5440 msgr2=0x7fc3a410bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:28:02.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.312+0000 7fc3a936a700 1 --2- 172.21.15.26:0/524717042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3a40f5440 0x7fc3a410bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:02.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.312+0000 7fc3a936a700 1 -- 172.21.15.26:0/524717042 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a0005040 con 0x7fc3a40f66e0 2021-11-03T18:28:02.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.312+0000 7fc3a936a700 1 --2- 172.21.15.26:0/524717042 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3a40f66e0 0x7fc3a410e3c0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7fc3940026d0 tx=0x7fc394009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:28:02.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.312+0000 7fc39a7fc700 1 -- 172.21.15.26:0/524717042 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3940079c0 con 0x7fc3a40f66e0 2021-11-03T18:28:02.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.312+0000 7fc3aab6d700 1 -- 172.21.15.26:0/524717042 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3a410e8b0 con 0x7fc3a40f66e0 2021-11-03T18:28:02.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.312+0000 7fc39a7fc700 1 -- 172.21.15.26:0/524717042 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc39400f040 con 0x7fc3a40f66e0 2021-11-03T18:28:02.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.312+0000 7fc39a7fc700 1 -- 172.21.15.26:0/524717042 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3940148b0 con 0x7fc3a40f66e0 2021-11-03T18:28:02.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.312+0000 7fc3aab6d700 1 -- 172.21.15.26:0/524717042 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a410ed30 con 0x7fc3a40f66e0 2021-11-03T18:28:02.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.314+0000 7fc3aab6d700 1 -- 172.21.15.26:0/524717042 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3a4045ad0 con 0x7fc3a40f66e0 2021-11-03T18:28:02.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.314+0000 7fc39a7fc700 1 -- 172.21.15.26:0/524717042 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc394007b20 con 0x7fc3a40f66e0 2021-11-03T18:28:02.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.314+0000 7fc39a7fc700 1 --2- 172.21.15.26:0/524717042 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc390064100 0x7fc3900665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:28:02.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.315+0000 7fc39a7fc700 1 -- 172.21.15.26:0/524717042 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc394080720 con 0x7fc3a40f66e0 2021-11-03T18:28:02.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.315+0000 7fc3a9b6b700 1 --2- 172.21.15.26:0/524717042 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc390064100 0x7fc3900665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:28:02.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.315+0000 7fc3a9b6b700 1 --2- 172.21.15.26:0/524717042 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc390064100 0x7fc3900665c0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7fc3a0013690 tx=0x7fc3a0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:28:02.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.319+0000 7fc39a7fc700 1 -- 172.21.15.26:0/524717042 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc394052a80 con 0x7fc3a40f66e0 2021-11-03T18:28:02.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.497+0000 7fc3aab6d700 1 -- 172.21.15.26:0/524717042 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3a4057f10 con 0x7fc390064100 2021-11-03T18:28:02.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.498+0000 7fc39a7fc700 1 -- 172.21.15.26:0/524717042 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fc3a4057f10 con 0x7fc390064100 2021-11-03T18:28:02.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.500+0000 7fc3aab6d700 1 -- 172.21.15.26:0/524717042 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc390064100 msgr2=0x7fc3900665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:28:02.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.500+0000 7fc3aab6d700 1 --2- 172.21.15.26:0/524717042 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc390064100 0x7fc3900665c0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7fc3a0013690 tx=0x7fc3a0009b30).stop 2021-11-03T18:28:02.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.500+0000 7fc3aab6d700 1 -- 172.21.15.26:0/524717042 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3a40f66e0 msgr2=0x7fc3a410e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:28:02.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.500+0000 7fc3aab6d700 1 --2- 172.21.15.26:0/524717042 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3a40f66e0 0x7fc3a410e3c0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7fc3940026d0 tx=0x7fc394009de0).stop 2021-11-03T18:28:02.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.500+0000 7fc3aab6d700 1 -- 172.21.15.26:0/524717042 shutdown_connections 2021-11-03T18:28:02.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.500+0000 7fc3aab6d700 1 --2- 172.21.15.26:0/524717042 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc390064100 0x7fc3900665c0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:02.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.500+0000 7fc3aab6d700 1 --2- 172.21.15.26:0/524717042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3a40f5440 0x7fc3a410bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:02.500 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.500+0000 7fc3aab6d700 1 --2- 172.21.15.26:0/524717042 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3a40f66e0 0x7fc3a410e3c0 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:02.500 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.500+0000 7fc3aab6d700 1 -- 172.21.15.26:0/524717042 >> 172.21.15.26:0/524717042 conn(0x7fc3a40f0ba0 msgr2=0x7fc3a40fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:28:02.500 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.500+0000 7fc3aab6d700 1 -- 172.21.15.26:0/524717042 shutdown_connections 2021-11-03T18:28:02.500 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.500+0000 7fc3aab6d700 1 -- 172.21.15.26:0/524717042 wait complete. 2021-11-03T18:28:02.508 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:28:02.603 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.601+0000 7f4e2369c700 1 -- 172.21.15.26:0/1021831721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e1c0f6ff0 msgr2=0x7f4e1c0f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:28:02.604 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.601+0000 7f4e2369c700 1 --2- 172.21.15.26:0/1021831721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e1c0f6ff0 0x7f4e1c0f7a20 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 rx=0x7f4e18004660 tx=0x7f4e18009b30).stop 2021-11-03T18:28:02.604 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.601+0000 7f4e2369c700 1 -- 172.21.15.26:0/1021831721 shutdown_connections 2021-11-03T18:28:02.604 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.601+0000 7f4e2369c700 1 --2- 172.21.15.26:0/1021831721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e1c0f6ff0 0x7f4e1c0f7a20 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:02.604 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.601+0000 7f4e2369c700 1 --2- 172.21.15.26:0/1021831721 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e1c0f66e0 0x7f4e1c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:02.605 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.601+0000 7f4e2369c700 1 -- 172.21.15.26:0/1021831721 >> 172.21.15.26:0/1021831721 conn(0x7f4e1c0f1f00 msgr2=0x7f4e1c0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:28:02.605 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.601+0000 7f4e2369c700 1 -- 172.21.15.26:0/1021831721 shutdown_connections 2021-11-03T18:28:02.605 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.601+0000 7f4e2369c700 1 -- 172.21.15.26:0/1021831721 wait complete. 2021-11-03T18:28:02.605 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.601+0000 7f4e2369c700 1 Processor -- start 2021-11-03T18:28:02.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.601+0000 7f4e2369c700 1 -- start start 2021-11-03T18:28:02.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.601+0000 7f4e2369c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e1c0f66e0 0x7f4e1c106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:28:02.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.601+0000 7f4e2369c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e1c0f6ff0 0x7f4e1c107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:28:02.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.602+0000 7f4e2369c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1c107a10 con 0x7f4e1c0f66e0 2021-11-03T18:28:02.607 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.602+0000 7f4e2369c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1c107b50 con 0x7f4e1c0f6ff0 2021-11-03T18:28:02.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.602+0000 7f4e21438700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e1c0f66e0 0x7f4e1c106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:28:02.611 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.602+0000 7f4e21438700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e1c0f66e0 0x7f4e1c106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60184/0 (socket says 172.21.15.26:60184) 2021-11-03T18:28:02.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.602+0000 7f4e21438700 1 -- 172.21.15.26:0/2570185289 learned_addr learned my addr 172.21.15.26:0/2570185289 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:28:02.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.602+0000 7f4e20c37700 1 --2- 172.21.15.26:0/2570185289 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e1c0f6ff0 0x7f4e1c107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:28:02.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.602+0000 7f4e21438700 1 -- 172.21.15.26:0/2570185289 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e1c0f6ff0 msgr2=0x7f4e1c107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:28:02.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.602+0000 7f4e21438700 1 --2- 172.21.15.26:0/2570185289 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e1c0f6ff0 0x7f4e1c107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:02.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.602+0000 7f4e21438700 1 -- 172.21.15.26:0/2570185289 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e18005040 con 0x7f4e1c0f66e0 2021-11-03T18:28:02.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.602+0000 7f4e21438700 1 --2- 172.21.15.26:0/2570185289 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e1c0f66e0 0x7f4e1c106f70 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 rx=0x7f4e0c0026d0 tx=0x7f4e0c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:28:02.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.602+0000 7f4e11ffb700 1 -- 172.21.15.26:0/2570185289 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e0c0079c0 con 0x7f4e1c0f66e0 2021-11-03T18:28:02.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.602+0000 7f4e11ffb700 1 -- 172.21.15.26:0/2570185289 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4e0c00f040 con 0x7f4e1c0f66e0 2021-11-03T18:28:02.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.602+0000 7f4e2369c700 1 -- 172.21.15.26:0/2570185289 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e1c1084f0 con 0x7f4e1c0f66e0 2021-11-03T18:28:02.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.602+0000 7f4e11ffb700 1 -- 172.21.15.26:0/2570185289 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e0c0148b0 con 0x7f4e1c0f66e0 2021-11-03T18:28:02.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.602+0000 7f4e2369c700 1 -- 172.21.15.26:0/2570185289 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e1c108ab0 con 0x7f4e1c0f66e0 2021-11-03T18:28:02.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.603+0000 7f4e2369c700 1 -- 172.21.15.26:0/2570185289 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e1c045ad0 con 0x7f4e1c0f66e0 2021-11-03T18:28:02.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.604+0000 7f4e11ffb700 1 -- 172.21.15.26:0/2570185289 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f4e0c007b20 con 0x7f4e1c0f66e0 2021-11-03T18:28:02.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.604+0000 7f4e11ffb700 1 --2- 172.21.15.26:0/2570185289 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4e080640b0 0x7f4e08066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:28:02.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.604+0000 7f4e11ffb700 1 -- 172.21.15.26:0/2570185289 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f4e0c080730 con 0x7f4e1c0f66e0 2021-11-03T18:28:02.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.604+0000 7f4e20c37700 1 --2- 172.21.15.26:0/2570185289 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4e080640b0 0x7f4e08066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:28:02.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.605+0000 7f4e20c37700 1 --2- 172.21.15.26:0/2570185289 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4e080640b0 0x7f4e08066570 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7f4e18004630 tx=0x7f4e18009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:28:02.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.608+0000 7f4e11ffb700 1 -- 172.21.15.26:0/2570185289 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f4e0c052a90 con 0x7f4e1c0f66e0 2021-11-03T18:28:02.778 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.780+0000 7f4e2369c700 1 -- 172.21.15.26:0/2570185289 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e1c0ff050 con 0x7f4e080640b0 2021-11-03T18:28:02.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.795+0000 7f4e11ffb700 1 -- 172.21.15.26:0/2570185289 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7f4e1c0ff050 con 0x7f4e080640b0 2021-11-03T18:28:02.793 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:28:02.793 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (99m) 7m ago 100m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:28:02.793 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (91m) 7m ago 100m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:28:02.794 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (91m) 6m ago 99m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:28:02.794 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (99m) 7m ago 100m 42.2M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:28:02.794 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (92m) 7m ago 95m 26.0M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:28:02.794 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (92m) 7m ago 95m 26.6M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:28:02.795 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (95m) 6m ago 95m 26.8M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:28:02.795 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (95m) 6m ago 95m 27.2M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:28:02.795 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (93m) 7m ago 101m 588M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:28:02.795 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (92m) 6m ago 99m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:28:02.795 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (92m) 7m ago 102m 341M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:28:02.796 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (92m) 6m ago 99m 158M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:28:02.796 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (100m) 7m ago 100m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:28:02.796 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (99m) 6m ago 99m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:28:02.796 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (91m) 7m ago 98m 332M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:28:02.797 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (90m) 7m ago 98m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:28:02.797 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (90m) 7m ago 98m 296M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:28:02.797 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (89m) 6m ago 97m 387M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:28:02.797 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (89m) 6m ago 97m 320M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:28:02.798 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (88m) 6m ago 97m 316M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:28:02.798 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (99m) 7m ago 99m 65.7M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:28:02.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.796+0000 7f4e2369c700 1 -- 172.21.15.26:0/2570185289 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4e080640b0 msgr2=0x7f4e08066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:28:02.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.796+0000 7f4e2369c700 1 --2- 172.21.15.26:0/2570185289 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4e080640b0 0x7f4e08066570 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7f4e18004630 tx=0x7f4e18009b30).stop 2021-11-03T18:28:02.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.797+0000 7f4e2369c700 1 -- 172.21.15.26:0/2570185289 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e1c0f66e0 msgr2=0x7f4e1c106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:28:02.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.797+0000 7f4e2369c700 1 --2- 172.21.15.26:0/2570185289 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e1c0f66e0 0x7f4e1c106f70 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 rx=0x7f4e0c0026d0 tx=0x7f4e0c009de0).stop 2021-11-03T18:28:02.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.797+0000 7f4e2369c700 1 -- 172.21.15.26:0/2570185289 shutdown_connections 2021-11-03T18:28:02.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.797+0000 7f4e2369c700 1 --2- 172.21.15.26:0/2570185289 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4e080640b0 0x7f4e08066570 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:02.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.797+0000 7f4e2369c700 1 --2- 172.21.15.26:0/2570185289 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e1c0f66e0 0x7f4e1c106f70 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:02.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.797+0000 7f4e2369c700 1 --2- 172.21.15.26:0/2570185289 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e1c0f6ff0 0x7f4e1c107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:02.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.797+0000 7f4e2369c700 1 -- 172.21.15.26:0/2570185289 >> 172.21.15.26:0/2570185289 conn(0x7f4e1c0f1f00 msgr2=0x7f4e1c0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:28:02.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.797+0000 7f4e2369c700 1 -- 172.21.15.26:0/2570185289 shutdown_connections 2021-11-03T18:28:02.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.797+0000 7f4e2369c700 1 -- 172.21.15.26:0/2570185289 wait complete. 2021-11-03T18:28:02.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.896+0000 7f445893c700 1 -- 172.21.15.26:0/1798050218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44540f5ed0 msgr2=0x7f44540f6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:28:02.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.896+0000 7f445893c700 1 --2- 172.21.15.26:0/1798050218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44540f5ed0 0x7f44540f6900 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 rx=0x7f443c004660 tx=0x7f443c009b30).stop 2021-11-03T18:28:02.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.896+0000 7f445893c700 1 -- 172.21.15.26:0/1798050218 shutdown_connections 2021-11-03T18:28:02.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.896+0000 7f445893c700 1 --2- 172.21.15.26:0/1798050218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44540f5ed0 0x7f44540f6900 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:02.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.896+0000 7f445893c700 1 --2- 172.21.15.26:0/1798050218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44540f55c0 0x7f44540f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:28:02.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.896+0000 7f445893c700 1 -- 172.21.15.26:0/1798050218 >> 172.21.15.26:0/1798050218 conn(0x7f44540f0de0 msgr2=0x7f44540f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:28:02.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.896+0000 7f445893c700 1 -- 172.21.15.26:0/1798050218 shutdown_connections 2021-11-03T18:28:02.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.896+0000 7f445893c700 1 -- 172.21.15.26:0/1798050218 wait complete. 2021-11-03T18:28:02.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.897+0000 7f445893c700 1 Processor -- start 2021-11-03T18:28:02.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.897+0000 7f445893c700 1 -- start start 2021-11-03T18:28:02.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.897+0000 7f445893c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44540f55c0 0x7f4454106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:28:02.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.897+0000 7f445893c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44540f5ed0 0x7f4454107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:28:02.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.897+0000 7f445893c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4454107ab0 con 0x7f44540f55c0 2021-11-03T18:28:02.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.897+0000 7f445893c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4454108360 con 0x7f44540f5ed0 2021-11-03T18:28:02.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.897+0000 7f445259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44540f55c0 0x7f4454106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:28:02.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.897+0000 7f445259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44540f55c0 0x7f4454106f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60194/0 (socket says 172.21.15.26:60194) 2021-11-03T18:28:02.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.897+0000 7f445259c700 1 -- 172.21.15.26:0/3160817926 learned_addr learned my addr 172.21.15.26:0/3160817926 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:28:02.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.897+0000 7f4451d9b700 1 --2- 172.21.15.26:0/3160817926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44540f5ed0 0x7f4454107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:28:02.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.897+0000 7f445259c700 1 -- 172.21.15.26:0/3160817926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44540f5ed0 msgr2=0x7f4454107470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:28:02.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.897+0000 7f445259c700 1 --2- 172.21.15.26:0/3160817926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44540f5ed0 0x7f4454107470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:02.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.897+0000 7f445259c700 1 -- 172.21.15.26:0/3160817926 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f443c005040 con 0x7f44540f55c0 2021-11-03T18:28:02.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.897+0000 7f445259c700 1 --2- 172.21.15.26:0/3160817926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44540f55c0 0x7f4454106f80 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 rx=0x7f444c00b790 tx=0x7f444c0092d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:28:02.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.898+0000 7f444affd700 1 -- 172.21.15.26:0/3160817926 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f444c00d780 con 0x7f44540f55c0 2021-11-03T18:28:02.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.898+0000 7f444affd700 1 -- 172.21.15.26:0/3160817926 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f444c00dd90 con 0x7f44540f55c0 2021-11-03T18:28:02.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.898+0000 7f445893c700 1 -- 172.21.15.26:0/3160817926 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4454108640 con 0x7f44540f55c0 2021-11-03T18:28:02.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.898+0000 7f444affd700 1 -- 172.21.15.26:0/3160817926 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f444c00e360 con 0x7f44540f55c0 2021-11-03T18:28:02.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.898+0000 7f445893c700 1 -- 172.21.15.26:0/3160817926 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4454108c00 con 0x7f44540f55c0 2021-11-03T18:28:02.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.899+0000 7f445893c700 1 -- 172.21.15.26:0/3160817926 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44540f4a50 con 0x7f44540f55c0 2021-11-03T18:28:02.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.899+0000 7f444affd700 1 -- 172.21.15.26:0/3160817926 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f444c00d8e0 con 0x7f44540f55c0 2021-11-03T18:28:02.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.900+0000 7f444affd700 1 --2- 172.21.15.26:0/3160817926 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f44400640b0 0x7f4440066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:28:02.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.900+0000 7f444affd700 1 -- 172.21.15.26:0/3160817926 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f444c0812f0 con 0x7f44540f55c0 2021-11-03T18:28:02.906 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.900+0000 7f4451d9b700 1 --2- 172.21.15.26:0/3160817926 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f44400640b0 0x7f4440066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:28:02.906 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.900+0000 7f4451d9b700 1 --2- 172.21.15.26:0/3160817926 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f44400640b0 0x7f4440066570 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7f443c004e30 tx=0x7f443c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:28:02.906 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:02.904+0000 7f444affd700 1 -- 172.21.15.26:0/3160817926 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f444c0534a0 con 0x7f44540f55c0 2021-11-03T18:28:03.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.135+0000 7f445893c700 1 -- 172.21.15.26:0/3160817926 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f445410d700 con 0x7f44540f55c0 2021-11-03T18:28:03.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.135+0000 7f444affd700 1 -- 172.21.15.26:0/3160817926 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f444c053090 con 0x7f44540f55c0 2021-11-03T18:28:03.134 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:28:03.134 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:28:03.134 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:28:03.135 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:28:03.135 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:28:03.135 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:28:03.135 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:28:03.136 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:28:03.136 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:28:03.136 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:28:03.136 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:28:03.136 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:28:03.137 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:28:03.137 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:28:03.137 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:28:03.137 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:28:03.137 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:28:03.138 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:28:03.139 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.137+0000 7f445893c700 1 -- 172.21.15.26:0/3160817926 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f44400640b0 msgr2=0x7f4440066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:28:03.139 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.137+0000 7f445893c700 1 --2- 172.21.15.26:0/3160817926 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f44400640b0 0x7f4440066570 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7f443c004e30 tx=0x7f443c009b30).stop 2021-11-03T18:28:03.139 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.137+0000 7f445893c700 1 -- 172.21.15.26:0/3160817926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44540f55c0 msgr2=0x7f4454106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:28:03.139 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.137+0000 7f445893c700 1 --2- 172.21.15.26:0/3160817926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44540f55c0 0x7f4454106f80 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 rx=0x7f444c00b790 tx=0x7f444c0092d0).stop 2021-11-03T18:28:03.140 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.137+0000 7f445893c700 1 -- 172.21.15.26:0/3160817926 shutdown_connections 2021-11-03T18:28:03.140 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.137+0000 7f445893c700 1 --2- 172.21.15.26:0/3160817926 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f44400640b0 0x7f4440066570 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:03.140 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.137+0000 7f445893c700 1 --2- 172.21.15.26:0/3160817926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44540f55c0 0x7f4454106f80 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:03.140 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.137+0000 7f445893c700 1 --2- 172.21.15.26:0/3160817926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44540f5ed0 0x7f4454107470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:03.141 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.137+0000 7f445893c700 1 -- 172.21.15.26:0/3160817926 >> 172.21.15.26:0/3160817926 conn(0x7f44540f0de0 msgr2=0x7f445405f700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:28:03.141 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.137+0000 7f445893c700 1 -- 172.21.15.26:0/3160817926 shutdown_connections 2021-11-03T18:28:03.141 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.137+0000 7f445893c700 1 -- 172.21.15.26:0/3160817926 wait complete. 2021-11-03T18:28:03.236 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.238+0000 7efc91803700 1 -- 172.21.15.26:0/3581556267 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc8c0f6700 msgr2=0x7efc8c0f6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:28:03.236 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.238+0000 7efc91803700 1 --2- 172.21.15.26:0/3581556267 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc8c0f6700 0x7efc8c0f6b60 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7efc74004660 tx=0x7efc74009b30).stop 2021-11-03T18:28:03.236 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.238+0000 7efc91803700 1 -- 172.21.15.26:0/3581556267 shutdown_connections 2021-11-03T18:28:03.236 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.238+0000 7efc91803700 1 --2- 172.21.15.26:0/3581556267 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc8c0f6700 0x7efc8c0f6b60 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:03.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.238+0000 7efc91803700 1 --2- 172.21.15.26:0/3581556267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc8c0f5460 0x7efc8c0f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:03.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.238+0000 7efc91803700 1 -- 172.21.15.26:0/3581556267 >> 172.21.15.26:0/3581556267 conn(0x7efc8c0f0bc0 msgr2=0x7efc8c0f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:28:03.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.238+0000 7efc91803700 1 -- 172.21.15.26:0/3581556267 shutdown_connections 2021-11-03T18:28:03.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.238+0000 7efc91803700 1 -- 172.21.15.26:0/3581556267 wait complete. 2021-11-03T18:28:03.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.238+0000 7efc91803700 1 Processor -- start 2021-11-03T18:28:03.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.239+0000 7efc91803700 1 -- start start 2021-11-03T18:28:03.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.239+0000 7efc91803700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc8c0f5460 0x7efc8c109ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:28:03.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.239+0000 7efc91803700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc8c0f6700 0x7efc8c10bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:28:03.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.239+0000 7efc91803700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc8c0603e0 con 0x7efc8c0f5460 2021-11-03T18:28:03.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.239+0000 7efc91803700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc8c060520 con 0x7efc8c0f6700 2021-11-03T18:28:03.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.239+0000 7efc8affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc8c0f5460 0x7efc8c109ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:28:03.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.239+0000 7efc8affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc8c0f5460 0x7efc8c109ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60204/0 (socket says 172.21.15.26:60204) 2021-11-03T18:28:03.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.239+0000 7efc8affd700 1 -- 172.21.15.26:0/1663262398 learned_addr learned my addr 172.21.15.26:0/1663262398 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:28:03.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.239+0000 7efc8a7fc700 1 --2- 172.21.15.26:0/1663262398 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc8c0f6700 0x7efc8c10bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:28:03.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.239+0000 7efc8affd700 1 -- 172.21.15.26:0/1663262398 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc8c0f6700 msgr2=0x7efc8c10bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:28:03.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.239+0000 7efc8affd700 1 --2- 172.21.15.26:0/1663262398 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc8c0f6700 0x7efc8c10bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:03.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.239+0000 7efc8affd700 1 -- 172.21.15.26:0/1663262398 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc74005040 con 0x7efc8c0f5460 2021-11-03T18:28:03.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.239+0000 7efc8affd700 1 --2- 172.21.15.26:0/1663262398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc8c0f5460 0x7efc8c109ab0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 rx=0x7efc7c00d7f0 tx=0x7efc7c004e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:28:03.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.239+0000 7efc837fe700 1 -- 172.21.15.26:0/1663262398 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc7c00f490 con 0x7efc8c0f5460 2021-11-03T18:28:03.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.239+0000 7efc837fe700 1 -- 172.21.15.26:0/1663262398 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efc7c00f040 con 0x7efc8c0f5460 2021-11-03T18:28:03.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.239+0000 7efc91803700 1 -- 172.21.15.26:0/1663262398 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc8c10c560 con 0x7efc8c0f5460 2021-11-03T18:28:03.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.240+0000 7efc837fe700 1 -- 172.21.15.26:0/1663262398 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc7c0139b0 con 0x7efc8c0f5460 2021-11-03T18:28:03.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.240+0000 7efc91803700 1 -- 172.21.15.26:0/1663262398 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc8c10cb20 con 0x7efc8c0f5460 2021-11-03T18:28:03.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.241+0000 7efc91803700 1 -- 172.21.15.26:0/1663262398 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc8c045ad0 con 0x7efc8c0f5460 2021-11-03T18:28:03.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.241+0000 7efc837fe700 1 -- 172.21.15.26:0/1663262398 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7efc7c01a030 con 0x7efc8c0f5460 2021-11-03T18:28:03.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.241+0000 7efc837fe700 1 --2- 172.21.15.26:0/1663262398 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efc78064100 0x7efc780665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:28:03.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.241+0000 7efc837fe700 1 -- 172.21.15.26:0/1663262398 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7efc7c0806e0 con 0x7efc8c0f5460 2021-11-03T18:28:03.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.242+0000 7efc8a7fc700 1 --2- 172.21.15.26:0/1663262398 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efc78064100 0x7efc780665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:28:03.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.242+0000 7efc8a7fc700 1 --2- 172.21.15.26:0/1663262398 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efc78064100 0x7efc780665c0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7efc74004630 tx=0x7efc74009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:28:03.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.245+0000 7efc837fe700 1 -- 172.21.15.26:0/1663262398 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7efc7c052950 con 0x7efc8c0f5460 2021-11-03T18:28:03.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:02 smithi194 ceph-mon[65619]: pgmap v2801: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:03.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:02 smithi026 ceph-mon[96795]: pgmap v2801: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:03.445 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.448+0000 7efc91803700 1 -- 172.21.15.26:0/1663262398 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7efc8c0fdc20 con 0x7efc8c0f5460 2021-11-03T18:28:03.446 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.448+0000 7efc837fe700 1 -- 172.21.15.26:0/1663262398 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7efc7c018020 con 0x7efc8c0f5460 2021-11-03T18:28:03.447 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:28:03.447 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:28:03.447 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:28:03.447 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:28:03.448 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:28:03.448 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:28:03.448 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:28:03.448 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:28:03.448 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:28:03.449 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:28:03.449 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:28:03.449 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:28:03.449 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:28:03.450 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:28:03.450 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:28:03.450 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:28:03.450 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:28:03.450 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:28:03.451 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:28:03.451 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:28:03.451 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:28:03.451 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:28:03.452 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:28:03.452 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:28:03.452 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:28:03.452 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:28:03.452 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:28:03.453 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:28:03.453 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:28:03.453 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:28:03.453 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:28:03.454 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:28:03.454 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:28:03.454 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:28:03.454 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:28:03.454 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:28:03.455 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:28:03.455 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:28:03.455 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:28:03.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.450+0000 7efc91803700 1 -- 172.21.15.26:0/1663262398 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efc78064100 msgr2=0x7efc780665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:28:03.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.450+0000 7efc91803700 1 --2- 172.21.15.26:0/1663262398 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efc78064100 0x7efc780665c0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7efc74004630 tx=0x7efc74009b30).stop 2021-11-03T18:28:03.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.450+0000 7efc91803700 1 -- 172.21.15.26:0/1663262398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc8c0f5460 msgr2=0x7efc8c109ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:28:03.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.450+0000 7efc91803700 1 --2- 172.21.15.26:0/1663262398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc8c0f5460 0x7efc8c109ab0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 rx=0x7efc7c00d7f0 tx=0x7efc7c004e80).stop 2021-11-03T18:28:03.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.450+0000 7efc91803700 1 -- 172.21.15.26:0/1663262398 shutdown_connections 2021-11-03T18:28:03.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.450+0000 7efc91803700 1 --2- 172.21.15.26:0/1663262398 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efc78064100 0x7efc780665c0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:03.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.450+0000 7efc91803700 1 --2- 172.21.15.26:0/1663262398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc8c0f5460 0x7efc8c109ab0 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:03.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.450+0000 7efc91803700 1 --2- 172.21.15.26:0/1663262398 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc8c0f6700 0x7efc8c10bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:03.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.450+0000 7efc91803700 1 -- 172.21.15.26:0/1663262398 >> 172.21.15.26:0/1663262398 conn(0x7efc8c0f0bc0 msgr2=0x7efc8c0fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:28:03.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.450+0000 7efc91803700 1 -- 172.21.15.26:0/1663262398 shutdown_connections 2021-11-03T18:28:03.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:03.450+0000 7efc91803700 1 -- 172.21.15.26:0/1663262398 wait complete. 2021-11-03T18:28:03.459 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:28:04.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:03 smithi194 ceph-mon[65619]: from='client.37020 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:28:04.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:03 smithi194 ceph-mon[65619]: from='client.37024 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:28:04.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:03 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3160817926' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:28:04.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:03 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1663262398' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:28:04.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:03 smithi026 ceph-mon[96795]: from='client.37020 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:28:04.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:03 smithi026 ceph-mon[96795]: from='client.37024 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:28:04.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:03 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3160817926' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:28:04.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:03 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1663262398' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:28:05.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:04 smithi194 ceph-mon[65619]: pgmap v2802: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:05.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:04 smithi026 ceph-mon[96795]: pgmap v2802: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:07.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:06 smithi194 ceph-mon[65619]: pgmap v2803: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:07.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:06 smithi026 ceph-mon[96795]: pgmap v2803: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:09.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:08 smithi194 ceph-mon[65619]: pgmap v2804: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:09.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:08 smithi026 ceph-mon[96795]: pgmap v2804: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:11.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:10 smithi194 ceph-mon[65619]: pgmap v2805: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:11.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:10 smithi026 ceph-mon[96795]: pgmap v2805: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:13.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:12 smithi194 ceph-mon[65619]: pgmap v2806: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:13.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:12 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:28:13.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:13 smithi026 ceph-mon[96795]: pgmap v2806: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:13.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:13 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:28:14.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:14 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:28:14.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:14 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:28:15.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:15 smithi026 ceph-mon[96795]: pgmap v2807: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:15.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:15 smithi194 ceph-mon[65619]: pgmap v2807: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:17.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:17 smithi026 ceph-mon[96795]: pgmap v2808: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:17.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:17 smithi194 ceph-mon[65619]: pgmap v2808: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:19.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:19 smithi026 ceph-mon[96795]: pgmap v2809: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:19.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:19 smithi194 ceph-mon[65619]: pgmap v2809: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:21.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:21 smithi026 ceph-mon[96795]: pgmap v2810: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:21.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:21 smithi194 ceph-mon[65619]: pgmap v2810: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:23.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:23 smithi026 ceph-mon[96795]: pgmap v2811: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:23.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:23 smithi194 ceph-mon[65619]: pgmap v2811: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:25.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:25 smithi026 ceph-mon[96795]: pgmap v2812: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:25.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:25 smithi194 ceph-mon[65619]: pgmap v2812: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:27.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:27 smithi026 ceph-mon[96795]: pgmap v2813: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:27.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:27 smithi194 ceph-mon[65619]: pgmap v2813: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:28.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:28 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:28:28.180 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:28 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:28:29.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:29 smithi026 ceph-mon[96795]: poll took 60065.542 ms: 1 events 2021-11-03T18:28:29.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:29 smithi026 ceph-mon[96795]: pgmap v2814: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:29.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:29 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2021-11-03T18:28:29.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:29 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi026", "name": "osd_memory_target"}]: dispatch 2021-11-03T18:28:29.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:29 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:28:29.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:29 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:28:29.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:29 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:28:29.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:29 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:28:29.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:29 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:28:29.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:29 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:28:29.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:29 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:28:29.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:29 smithi194 ceph-mon[65619]: poll took 60065.542 ms: 1 events 2021-11-03T18:28:29.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:29 smithi194 ceph-mon[65619]: pgmap v2814: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:29.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:29 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2021-11-03T18:28:29.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:29 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi026", "name": "osd_memory_target"}]: dispatch 2021-11-03T18:28:29.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:29 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:28:29.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:29 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:28:29.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:29 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:28:29.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:29 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:28:29.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:29 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:28:29.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:29 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:28:29.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:29 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:28:30.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:30 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:28:30.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:30 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:28:30.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:30 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:28:30.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:30 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:28:31.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:31 smithi026 ceph-mon[96795]: pgmap v2815: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:31.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:31 smithi194 ceph-mon[65619]: pgmap v2815: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:33.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:33 smithi026 ceph-mon[96795]: pgmap v2816: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:33.473 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:33 smithi194 ceph-mon[65619]: pgmap v2816: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:33.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.559+0000 7fa819024700 1 -- 172.21.15.26:0/3727672197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8140f55c0 msgr2=0x7fa8140f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:28:33.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.559+0000 7fa819024700 1 --2- 172.21.15.26:0/3727672197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8140f55c0 0x7fa8140f59e0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 rx=0x7fa80c0099e0 tx=0x7fa80c004d10).stop 2021-11-03T18:28:33.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.559+0000 7fa819024700 1 -- 172.21.15.26:0/3727672197 shutdown_connections 2021-11-03T18:28:33.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.559+0000 7fa819024700 1 --2- 172.21.15.26:0/3727672197 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8140f6860 0x7fa8140f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:33.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.559+0000 7fa819024700 1 --2- 172.21.15.26:0/3727672197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8140f55c0 0x7fa8140f59e0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:33.562 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.559+0000 7fa819024700 1 -- 172.21.15.26:0/3727672197 >> 172.21.15.26:0/3727672197 conn(0x7fa8140f0d40 msgr2=0x7fa8140f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:28:33.562 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.559+0000 7fa819024700 1 -- 172.21.15.26:0/3727672197 shutdown_connections 2021-11-03T18:28:33.562 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.559+0000 7fa819024700 1 -- 172.21.15.26:0/3727672197 wait complete. 2021-11-03T18:28:33.562 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.560+0000 7fa819024700 1 Processor -- start 2021-11-03T18:28:33.562 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.560+0000 7fa819024700 1 -- start start 2021-11-03T18:28:33.563 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.560+0000 7fa819024700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8140f55c0 0x7fa814107060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:28:33.563 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.560+0000 7fa819024700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8140f6860 0x7fa814107550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:28:33.563 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.560+0000 7fa819024700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa814107b00 con 0x7fa8140f6860 2021-11-03T18:28:33.563 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.560+0000 7fa819024700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa814107c40 con 0x7fa8140f55c0 2021-11-03T18:28:33.563 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.560+0000 7fa81259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8140f6860 0x7fa814107550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:28:33.564 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.560+0000 7fa81259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8140f6860 0x7fa814107550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60226/0 (socket says 172.21.15.26:60226) 2021-11-03T18:28:33.564 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.560+0000 7fa81259c700 1 -- 172.21.15.26:0/1875135193 learned_addr learned my addr 172.21.15.26:0/1875135193 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:28:33.564 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.560+0000 7fa812d9d700 1 --2- 172.21.15.26:0/1875135193 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8140f55c0 0x7fa814107060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:28:33.564 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.560+0000 7fa81259c700 1 -- 172.21.15.26:0/1875135193 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8140f55c0 msgr2=0x7fa814107060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:28:33.565 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.560+0000 7fa81259c700 1 --2- 172.21.15.26:0/1875135193 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8140f55c0 0x7fa814107060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:33.565 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.560+0000 7fa81259c700 1 -- 172.21.15.26:0/1875135193 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa80c009640 con 0x7fa8140f6860 2021-11-03T18:28:33.565 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.560+0000 7fa81259c700 1 --2- 172.21.15.26:0/1875135193 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8140f6860 0x7fa814107550 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7fa7fc0026d0 tx=0x7fa7fc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:28:33.565 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.561+0000 7fa80b7fe700 1 -- 172.21.15.26:0/1875135193 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7fc0079c0 con 0x7fa8140f6860 2021-11-03T18:28:33.565 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.561+0000 7fa80b7fe700 1 -- 172.21.15.26:0/1875135193 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa7fc00f040 con 0x7fa8140f6860 2021-11-03T18:28:33.566 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.561+0000 7fa819024700 1 -- 172.21.15.26:0/1875135193 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8141085e0 con 0x7fa8140f6860 2021-11-03T18:28:33.566 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.561+0000 7fa80b7fe700 1 -- 172.21.15.26:0/1875135193 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7fc0148b0 con 0x7fa8140f6860 2021-11-03T18:28:33.566 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.561+0000 7fa819024700 1 -- 172.21.15.26:0/1875135193 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa814108b20 con 0x7fa8140f6860 2021-11-03T18:28:33.566 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.562+0000 7fa819024700 1 -- 172.21.15.26:0/1875135193 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa814045ad0 con 0x7fa8140f6860 2021-11-03T18:28:33.567 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.562+0000 7fa80b7fe700 1 -- 172.21.15.26:0/1875135193 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fa7fc007b20 con 0x7fa8140f6860 2021-11-03T18:28:33.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.562+0000 7fa80b7fe700 1 --2- 172.21.15.26:0/1875135193 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa800064090 0x7fa800066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:28:33.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.562+0000 7fa80b7fe700 1 -- 172.21.15.26:0/1875135193 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fa7fc080660 con 0x7fa8140f6860 2021-11-03T18:28:33.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.563+0000 7fa812d9d700 1 --2- 172.21.15.26:0/1875135193 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa800064090 0x7fa800066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:28:33.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.563+0000 7fa812d9d700 1 --2- 172.21.15.26:0/1875135193 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa800064090 0x7fa800066550 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7fa80c00b3b0 tx=0x7fa80c004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:28:33.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.567+0000 7fa80b7fe700 1 -- 172.21.15.26:0/1875135193 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fa7fc0529c0 con 0x7fa8140f6860 2021-11-03T18:28:33.747 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.748+0000 7fa819024700 1 -- 172.21.15.26:0/1875135193 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8140faca0 con 0x7fa800064090 2021-11-03T18:28:33.748 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.750+0000 7fa80b7fe700 1 -- 172.21.15.26:0/1875135193 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fa8140faca0 con 0x7fa800064090 2021-11-03T18:28:33.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.751+0000 7fa819024700 1 -- 172.21.15.26:0/1875135193 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa800064090 msgr2=0x7fa800066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:28:33.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.751+0000 7fa819024700 1 --2- 172.21.15.26:0/1875135193 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa800064090 0x7fa800066550 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7fa80c00b3b0 tx=0x7fa80c004d10).stop 2021-11-03T18:28:33.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.751+0000 7fa819024700 1 -- 172.21.15.26:0/1875135193 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8140f6860 msgr2=0x7fa814107550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:28:33.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.751+0000 7fa819024700 1 --2- 172.21.15.26:0/1875135193 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8140f6860 0x7fa814107550 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7fa7fc0026d0 tx=0x7fa7fc009de0).stop 2021-11-03T18:28:33.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.751+0000 7fa819024700 1 -- 172.21.15.26:0/1875135193 shutdown_connections 2021-11-03T18:28:33.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.751+0000 7fa819024700 1 --2- 172.21.15.26:0/1875135193 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa800064090 0x7fa800066550 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:33.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.751+0000 7fa819024700 1 --2- 172.21.15.26:0/1875135193 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8140f55c0 0x7fa814107060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:33.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.751+0000 7fa819024700 1 --2- 172.21.15.26:0/1875135193 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8140f6860 0x7fa814107550 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:33.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.751+0000 7fa819024700 1 -- 172.21.15.26:0/1875135193 >> 172.21.15.26:0/1875135193 conn(0x7fa8140f0d40 msgr2=0x7fa81405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:28:33.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.752+0000 7fa819024700 1 -- 172.21.15.26:0/1875135193 shutdown_connections 2021-11-03T18:28:33.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.752+0000 7fa819024700 1 -- 172.21.15.26:0/1875135193 wait complete. 2021-11-03T18:28:33.760 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:28:33.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.851+0000 7ff0ac891700 1 -- 172.21.15.26:0/3731799634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0a80f77d0 msgr2=0x7ff0a80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:28:33.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.851+0000 7ff0ac891700 1 --2- 172.21.15.26:0/3731799634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0a80f77d0 0x7ff0a80f7c30 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 rx=0x7ff09c004660 tx=0x7ff09c009b30).stop 2021-11-03T18:28:33.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.851+0000 7ff0ac891700 1 -- 172.21.15.26:0/3731799634 shutdown_connections 2021-11-03T18:28:33.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.851+0000 7ff0ac891700 1 --2- 172.21.15.26:0/3731799634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0a80f77d0 0x7ff0a80f7c30 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:33.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.851+0000 7ff0ac891700 1 --2- 172.21.15.26:0/3731799634 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0a80f6530 0x7ff0a80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:33.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.851+0000 7ff0ac891700 1 -- 172.21.15.26:0/3731799634 >> 172.21.15.26:0/3731799634 conn(0x7ff0a80f1cd0 msgr2=0x7ff0a80f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:28:33.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.851+0000 7ff0ac891700 1 -- 172.21.15.26:0/3731799634 shutdown_connections 2021-11-03T18:28:33.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.851+0000 7ff0ac891700 1 -- 172.21.15.26:0/3731799634 wait complete. 2021-11-03T18:28:33.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.852+0000 7ff0ac891700 1 Processor -- start 2021-11-03T18:28:33.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.852+0000 7ff0ac891700 1 -- start start 2021-11-03T18:28:33.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.852+0000 7ff0ac891700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0a80f6530 0x7ff0a806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:28:33.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.852+0000 7ff0ac891700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0a80f77d0 0x7ff0a8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:28:33.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.852+0000 7ff0ac891700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a806a380 con 0x7ff0a80f77d0 2021-11-03T18:28:33.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.852+0000 7ff0ac891700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a806a4c0 con 0x7ff0a80f6530 2021-11-03T18:28:33.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.852+0000 7ff0a659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0a80f77d0 0x7ff0a8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:28:33.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.852+0000 7ff0a659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0a80f77d0 0x7ff0a8069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60236/0 (socket says 172.21.15.26:60236) 2021-11-03T18:28:33.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.852+0000 7ff0a659c700 1 -- 172.21.15.26:0/2666267330 learned_addr learned my addr 172.21.15.26:0/2666267330 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:28:33.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.852+0000 7ff0a6d9d700 1 --2- 172.21.15.26:0/2666267330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0a80f6530 0x7ff0a806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:28:33.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.853+0000 7ff0a659c700 1 -- 172.21.15.26:0/2666267330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0a80f6530 msgr2=0x7ff0a806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:28:33.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.853+0000 7ff0a659c700 1 --2- 172.21.15.26:0/2666267330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0a80f6530 0x7ff0a806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:33.858 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.853+0000 7ff0a659c700 1 -- 172.21.15.26:0/2666267330 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09c005040 con 0x7ff0a80f77d0 2021-11-03T18:28:33.858 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.853+0000 7ff0a659c700 1 --2- 172.21.15.26:0/2666267330 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0a80f77d0 0x7ff0a8069e20 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 rx=0x7ff09c009990 tx=0x7ff09c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:28:33.858 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.853+0000 7ff08f7fe700 1 -- 172.21.15.26:0/2666267330 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff09c018070 con 0x7ff0a80f77d0 2021-11-03T18:28:33.858 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.853+0000 7ff0ac891700 1 -- 172.21.15.26:0/2666267330 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0a806a740 con 0x7ff0a80f77d0 2021-11-03T18:28:33.859 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.853+0000 7ff08f7fe700 1 -- 172.21.15.26:0/2666267330 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff09c007ba0 con 0x7ff0a80f77d0 2021-11-03T18:28:33.859 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.853+0000 7ff08f7fe700 1 -- 172.21.15.26:0/2666267330 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff09c01c620 con 0x7ff0a80f77d0 2021-11-03T18:28:33.859 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.853+0000 7ff0ac891700 1 -- 172.21.15.26:0/2666267330 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0a806aca0 con 0x7ff0a80f77d0 2021-11-03T18:28:33.859 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.854+0000 7ff0ac891700 1 -- 172.21.15.26:0/2666267330 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0a8045ad0 con 0x7ff0a80f77d0 2021-11-03T18:28:33.859 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.854+0000 7ff08f7fe700 1 -- 172.21.15.26:0/2666267330 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ff09c01c8e0 con 0x7ff0a80f77d0 2021-11-03T18:28:33.860 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.855+0000 7ff08f7fe700 1 --2- 172.21.15.26:0/2666267330 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff090064100 0x7ff0900665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:28:33.860 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.855+0000 7ff08f7fe700 1 -- 172.21.15.26:0/2666267330 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ff09c0825e0 con 0x7ff0a80f77d0 2021-11-03T18:28:33.860 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.855+0000 7ff0a6d9d700 1 --2- 172.21.15.26:0/2666267330 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff090064100 0x7ff0900665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:28:33.860 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.855+0000 7ff0a6d9d700 1 --2- 172.21.15.26:0/2666267330 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff090064100 0x7ff0900665c0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7ff0a806b730 tx=0x7ff098009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:28:33.861 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:33.859+0000 7ff08f7fe700 1 -- 172.21.15.26:0/2666267330 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ff09c054a00 con 0x7ff0a80f77d0 2021-11-03T18:28:34.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.032+0000 7ff0ac891700 1 -- 172.21.15.26:0/2666267330 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0a80008d0 con 0x7ff090064100 2021-11-03T18:28:34.046 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.047+0000 7ff08f7fe700 1 -- 172.21.15.26:0/2666267330 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7ff0a80008d0 con 0x7ff090064100 2021-11-03T18:28:34.047 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:28:34.047 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (99m) 8m ago 101m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:28:34.047 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (92m) 8m ago 101m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:28:34.048 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (91m) 7m ago 100m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:28:34.048 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (99m) 8m ago 100m 42.2M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:28:34.048 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (92m) 8m ago 96m 26.0M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:28:34.048 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (93m) 8m ago 96m 26.6M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:28:34.049 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (96m) 7m ago 96m 26.8M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:28:34.050 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (96m) 7m ago 96m 27.2M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:28:34.050 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (93m) 8m ago 102m 588M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:28:34.051 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (93m) 7m ago 100m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:28:34.051 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (92m) 8m ago 102m 341M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:28:34.052 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (92m) 7m ago 100m 158M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:28:34.052 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (100m) 8m ago 100m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:28:34.052 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (100m) 7m ago 100m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:28:34.053 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (91m) 8m ago 99m 332M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:28:34.053 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (91m) 8m ago 99m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:28:34.053 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (90m) 8m ago 98m 296M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:28:34.053 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (90m) 7m ago 98m 387M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:28:34.054 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (89m) 7m ago 98m 320M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:28:34.054 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (89m) 7m ago 97m 316M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:28:34.054 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (99m) 8m ago 100m 65.7M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:28:34.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.049+0000 7ff0ac891700 1 -- 172.21.15.26:0/2666267330 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff090064100 msgr2=0x7ff0900665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:28:34.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.049+0000 7ff0ac891700 1 --2- 172.21.15.26:0/2666267330 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff090064100 0x7ff0900665c0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7ff0a806b730 tx=0x7ff098009040).stop 2021-11-03T18:28:34.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.049+0000 7ff0ac891700 1 -- 172.21.15.26:0/2666267330 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0a80f77d0 msgr2=0x7ff0a8069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:28:34.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.049+0000 7ff0ac891700 1 --2- 172.21.15.26:0/2666267330 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0a80f77d0 0x7ff0a8069e20 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 rx=0x7ff09c009990 tx=0x7ff09c009b30).stop 2021-11-03T18:28:34.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.049+0000 7ff0ac891700 1 -- 172.21.15.26:0/2666267330 shutdown_connections 2021-11-03T18:28:34.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.049+0000 7ff0ac891700 1 --2- 172.21.15.26:0/2666267330 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff090064100 0x7ff0900665c0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:34.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.049+0000 7ff0ac891700 1 --2- 172.21.15.26:0/2666267330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0a80f6530 0x7ff0a806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:34.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.049+0000 7ff0ac891700 1 --2- 172.21.15.26:0/2666267330 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0a80f77d0 0x7ff0a8069e20 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:34.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.049+0000 7ff0ac891700 1 -- 172.21.15.26:0/2666267330 >> 172.21.15.26:0/2666267330 conn(0x7ff0a80f1cd0 msgr2=0x7ff0a80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:28:34.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.049+0000 7ff0ac891700 1 -- 172.21.15.26:0/2666267330 shutdown_connections 2021-11-03T18:28:34.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.049+0000 7ff0ac891700 1 -- 172.21.15.26:0/2666267330 wait complete. 2021-11-03T18:28:34.147 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.148+0000 7f4d9d7be700 1 -- 172.21.15.26:0/405367986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d980f53e0 msgr2=0x7f4d980f7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:28:34.148 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.148+0000 7f4d9d7be700 1 --2- 172.21.15.26:0/405367986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d980f53e0 0x7f4d980f7d20 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7f4d8c004660 tx=0x7f4d8c009b30).stop 2021-11-03T18:28:34.148 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.148+0000 7f4d9d7be700 1 -- 172.21.15.26:0/405367986 shutdown_connections 2021-11-03T18:28:34.148 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.148+0000 7f4d9d7be700 1 --2- 172.21.15.26:0/405367986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d980f53e0 0x7f4d980f7d20 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:34.148 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.148+0000 7f4d9d7be700 1 --2- 172.21.15.26:0/405367986 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d980f4a40 0x7f4d980f4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:34.148 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.148+0000 7f4d9d7be700 1 -- 172.21.15.26:0/405367986 >> 172.21.15.26:0/405367986 conn(0x7f4d980f04c0 msgr2=0x7f4d980f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:28:34.149 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.148+0000 7f4d9d7be700 1 -- 172.21.15.26:0/405367986 shutdown_connections 2021-11-03T18:28:34.149 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.148+0000 7f4d9d7be700 1 -- 172.21.15.26:0/405367986 wait complete. 2021-11-03T18:28:34.151 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.149+0000 7f4d9d7be700 1 Processor -- start 2021-11-03T18:28:34.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.149+0000 7f4d9d7be700 1 -- start start 2021-11-03T18:28:34.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.149+0000 7f4d9d7be700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d980f4a40 0x7f4d98107180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:28:34.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.149+0000 7f4d9d7be700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d980f53e0 0x7f4d98107670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:28:34.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.149+0000 7f4d9d7be700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d98107c20 con 0x7f4d980f53e0 2021-11-03T18:28:34.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.149+0000 7f4d9d7be700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d98107d60 con 0x7f4d980f4a40 2021-11-03T18:28:34.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.149+0000 7f4d967fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d980f53e0 0x7f4d98107670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:28:34.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.149+0000 7f4d967fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d980f53e0 0x7f4d98107670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60246/0 (socket says 172.21.15.26:60246) 2021-11-03T18:28:34.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.149+0000 7f4d967fc700 1 -- 172.21.15.26:0/1817227580 learned_addr learned my addr 172.21.15.26:0/1817227580 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:28:34.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.149+0000 7f4d967fc700 1 -- 172.21.15.26:0/1817227580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d980f4a40 msgr2=0x7f4d98107180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:28:34.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.149+0000 7f4d967fc700 1 --2- 172.21.15.26:0/1817227580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d980f4a40 0x7f4d98107180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:28:34.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.150+0000 7f4d967fc700 1 -- 172.21.15.26:0/1817227580 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8c005040 con 0x7f4d980f53e0 2021-11-03T18:28:34.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.150+0000 7f4d967fc700 1 --2- 172.21.15.26:0/1817227580 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d980f53e0 0x7f4d98107670 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7f4d8c004f60 tx=0x7f4d8c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:28:34.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.150+0000 7f4d7f7fe700 1 -- 172.21.15.26:0/1817227580 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d8c018070 con 0x7f4d980f53e0 2021-11-03T18:28:34.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.150+0000 7f4d9d7be700 1 -- 172.21.15.26:0/1817227580 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d981086a0 con 0x7f4d980f53e0 2021-11-03T18:28:34.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.150+0000 7f4d7f7fe700 1 -- 172.21.15.26:0/1817227580 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4d8c007ba0 con 0x7f4d980f53e0 2021-11-03T18:28:34.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.150+0000 7f4d7f7fe700 1 -- 172.21.15.26:0/1817227580 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d8c01c620 con 0x7f4d980f53e0 2021-11-03T18:28:34.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.150+0000 7f4d9d7be700 1 -- 172.21.15.26:0/1817227580 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d98108c00 con 0x7f4d980f53e0 2021-11-03T18:28:34.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.151+0000 7f4d9d7be700 1 -- 172.21.15.26:0/1817227580 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d98045ad0 con 0x7f4d980f53e0 2021-11-03T18:28:34.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.151+0000 7f4d7f7fe700 1 -- 172.21.15.26:0/1817227580 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f4d8c01c8e0 con 0x7f4d980f53e0 2021-11-03T18:28:34.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.151+0000 7f4d7f7fe700 1 --2- 172.21.15.26:0/1817227580 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4d800640b0 0x7f4d80066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:28:34.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.152+0000 7f4d7f7fe700 1 -- 172.21.15.26:0/1817227580 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f4d8c0826e0 con 0x7f4d980f53e0 2021-11-03T18:28:34.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.152+0000 7f4d96ffd700 1 --2- 172.21.15.26:0/1817227580 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4d800640b0 0x7f4d80066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:28:34.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.152+0000 7f4d96ffd700 1 --2- 172.21.15.26:0/1817227580 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4d800640b0 0x7f4d80066570 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7f4d880047d0 tx=0x7f4d88007a40).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:28:34.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.156+0000 7f4d7f7fe700 1 -- 172.21.15.26:0/1817227580 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f4d8c054a40 con 0x7f4d980f53e0 2021-11-03T18:28:34.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.386+0000 7f4d9d7be700 1 -- 172.21.15.26:0/1817227580 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4d9805f540 con 0x7f4d980f53e0 2021-11-03T18:28:34.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.387+0000 7f4d7f7fe700 1 -- 172.21.15.26:0/1817227580 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f4d8c054630 con 0x7f4d980f53e0 2021-11-03T18:28:34.386 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:28:34.387 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:28:34.387 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:28:34.387 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:28:34.387 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:28:34.388 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:28:34.388 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:28:34.388 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:28:34.388 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:28:34.390 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:28:34.390 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:28:34.390 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:28:34.391 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:28:34.391 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:28:34.391 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:28:34.391 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:28:34.392 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:28:34.392 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:28:34.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.388+0000 7f4d9d7be700 1 -- 172.21.15.26:0/1817227580 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4d800640b0 msgr2=0x7f4d80066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:28:34.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.388+0000 7f4d9d7be700 1 --2- 172.21.15.26:0/1817227580 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4d800640b0 0x7f4d80066570 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7f4d880047d0 tx=0x7f4d88007a40).stop 2021-11-03T18:28:34.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.388+0000 7f4d9d7be700 1 -- 172.21.15.26:0/1817227580 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d980f53e0 msgr2=0x7f4d98107670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:28:34.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.388+0000 7f4d9d7be700 1 --2- 172.21.15.26:0/1817227580 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d980f53e0 0x7f4d98107670 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7f4d8c004f60 tx=0x7f4d8c009b30).stop 2021-11-03T18:28:34.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.389+0000 7f4d9d7be700 1 -- 172.21.15.26:0/1817227580 shutdown_connections 2021-11-03T18:28:34.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.389+0000 7f4d9d7be700 1 --2- 172.21.15.26:0/1817227580 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4d800640b0 0x7f4d80066570 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:34.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.389+0000 7f4d9d7be700 1 --2- 172.21.15.26:0/1817227580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d980f4a40 0x7f4d98107180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:28:34.395 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.389+0000 7f4d9d7be700 1 --2- 172.21.15.26:0/1817227580 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d980f53e0 0x7f4d98107670 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:34.395 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.389+0000 7f4d9d7be700 1 -- 172.21.15.26:0/1817227580 >> 172.21.15.26:0/1817227580 conn(0x7f4d980f04c0 msgr2=0x7f4d980fb770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:28:34.395 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.389+0000 7f4d9d7be700 1 -- 172.21.15.26:0/1817227580 shutdown_connections 2021-11-03T18:28:34.395 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.389+0000 7f4d9d7be700 1 -- 172.21.15.26:0/1817227580 wait complete. 2021-11-03T18:28:34.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.490+0000 7ff73fcb3700 1 -- 172.21.15.26:0/2693046522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7380f8610 msgr2=0x7ff7380f4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:28:34.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.490+0000 7ff73fcb3700 1 --2- 172.21.15.26:0/2693046522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7380f8610 0x7ff7380f4820 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 rx=0x7ff72c004660 tx=0x7ff72c009b30).stop 2021-11-03T18:28:34.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.490+0000 7ff73fcb3700 1 -- 172.21.15.26:0/2693046522 shutdown_connections 2021-11-03T18:28:34.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.490+0000 7ff73fcb3700 1 --2- 172.21.15.26:0/2693046522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7380f8610 0x7ff7380f4820 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:34.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.490+0000 7ff73fcb3700 1 --2- 172.21.15.26:0/2693046522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7380f7d00 0x7ff7380f8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:34.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.490+0000 7ff73fcb3700 1 -- 172.21.15.26:0/2693046522 >> 172.21.15.26:0/2693046522 conn(0x7ff7380f0540 msgr2=0x7ff7380f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:28:34.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.490+0000 7ff73fcb3700 1 -- 172.21.15.26:0/2693046522 shutdown_connections 2021-11-03T18:28:34.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.490+0000 7ff73fcb3700 1 -- 172.21.15.26:0/2693046522 wait complete. 2021-11-03T18:28:34.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.490+0000 7ff73fcb3700 1 Processor -- start 2021-11-03T18:28:34.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.490+0000 7ff73fcb3700 1 -- start start 2021-11-03T18:28:34.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.491+0000 7ff73fcb3700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7380f7d00 0x7ff738106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:28:34.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.491+0000 7ff73fcb3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7380f8610 0x7ff738107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:28:34.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.491+0000 7ff73fcb3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7381079b0 con 0x7ff7380f8610 2021-11-03T18:28:34.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.491+0000 7ff73fcb3700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff738107af0 con 0x7ff7380f7d00 2021-11-03T18:28:34.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.491+0000 7ff73d24e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7380f8610 0x7ff738107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:28:34.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.491+0000 7ff73d24e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7380f8610 0x7ff738107400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60256/0 (socket says 172.21.15.26:60256) 2021-11-03T18:28:34.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.491+0000 7ff73d24e700 1 -- 172.21.15.26:0/2976348820 learned_addr learned my addr 172.21.15.26:0/2976348820 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:28:34.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.491+0000 7ff73da4f700 1 --2- 172.21.15.26:0/2976348820 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7380f7d00 0x7ff738106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:28:34.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.491+0000 7ff73d24e700 1 -- 172.21.15.26:0/2976348820 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7380f7d00 msgr2=0x7ff738106f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:28:34.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.491+0000 7ff73d24e700 1 --2- 172.21.15.26:0/2976348820 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7380f7d00 0x7ff738106f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:34.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.491+0000 7ff73d24e700 1 -- 172.21.15.26:0/2976348820 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff72c005040 con 0x7ff7380f8610 2021-11-03T18:28:34.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.491+0000 7ff73da4f700 1 --2- 172.21.15.26:0/2976348820 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7380f7d00 0x7ff738106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:28:34.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.491+0000 7ff73d24e700 1 --2- 172.21.15.26:0/2976348820 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7380f8610 0x7ff738107400 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 rx=0x7ff72c009990 tx=0x7ff72c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:28:34.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.491+0000 7ff7367fc700 1 -- 172.21.15.26:0/2976348820 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff72c018070 con 0x7ff7380f8610 2021-11-03T18:28:34.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.491+0000 7ff73fcb3700 1 -- 172.21.15.26:0/2976348820 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff738108430 con 0x7ff7380f8610 2021-11-03T18:28:34.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.491+0000 7ff7367fc700 1 -- 172.21.15.26:0/2976348820 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff72c007ba0 con 0x7ff7380f8610 2021-11-03T18:28:34.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.491+0000 7ff7367fc700 1 -- 172.21.15.26:0/2976348820 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff72c01c3c0 con 0x7ff7380f8610 2021-11-03T18:28:34.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.491+0000 7ff73fcb3700 1 -- 172.21.15.26:0/2976348820 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff738108990 con 0x7ff7380f8610 2021-11-03T18:28:34.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.492+0000 7ff73fcb3700 1 -- 172.21.15.26:0/2976348820 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff738045ad0 con 0x7ff7380f8610 2021-11-03T18:28:34.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.493+0000 7ff7367fc700 1 -- 172.21.15.26:0/2976348820 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ff72c01d420 con 0x7ff7380f8610 2021-11-03T18:28:34.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.493+0000 7ff7367fc700 1 --2- 172.21.15.26:0/2976348820 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff7200640b0 0x7ff720066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:28:34.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.493+0000 7ff7367fc700 1 -- 172.21.15.26:0/2976348820 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ff72c082500 con 0x7ff7380f8610 2021-11-03T18:28:34.500 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.493+0000 7ff73da4f700 1 --2- 172.21.15.26:0/2976348820 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff7200640b0 0x7ff720066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:28:34.500 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.493+0000 7ff73da4f700 1 --2- 172.21.15.26:0/2976348820 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff7200640b0 0x7ff720066570 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7ff730007d50 tx=0x7ff730004d00).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:28:34.500 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.497+0000 7ff7367fc700 1 -- 172.21.15.26:0/2976348820 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ff72c0548c0 con 0x7ff7380f8610 2021-11-03T18:28:34.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.704+0000 7ff73fcb3700 1 -- 172.21.15.26:0/2976348820 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff7380fef50 con 0x7ff7380f8610 2021-11-03T18:28:34.704 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.705+0000 7ff7367fc700 1 -- 172.21.15.26:0/2976348820 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7ff72c0544b0 con 0x7ff7380f8610 2021-11-03T18:28:34.704 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:28:34.704 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:28:34.704 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:28:34.705 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:28:34.705 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:28:34.705 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:28:34.705 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:28:34.706 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:28:34.706 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:28:34.706 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:28:34.706 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:28:34.707 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:28:34.707 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:28:34.707 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:28:34.707 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:28:34.707 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:28:34.708 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:28:34.708 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:28:34.708 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:28:34.708 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:28:34.709 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:28:34.709 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:28:34.709 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:28:34.709 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:28:34.709 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:28:34.710 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:28:34.710 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:28:34.710 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:28:34.710 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:28:34.711 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:28:34.711 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:28:34.711 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:28:34.711 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:28:34.712 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:28:34.712 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:28:34.712 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:28:34.712 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:28:34.712 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:28:34.713 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:28:34.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.706+0000 7ff73fcb3700 1 -- 172.21.15.26:0/2976348820 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff7200640b0 msgr2=0x7ff720066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:28:34.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.706+0000 7ff73fcb3700 1 --2- 172.21.15.26:0/2976348820 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff7200640b0 0x7ff720066570 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7ff730007d50 tx=0x7ff730004d00).stop 2021-11-03T18:28:34.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.706+0000 7ff73fcb3700 1 -- 172.21.15.26:0/2976348820 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7380f8610 msgr2=0x7ff738107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:28:34.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.706+0000 7ff73fcb3700 1 --2- 172.21.15.26:0/2976348820 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7380f8610 0x7ff738107400 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 rx=0x7ff72c009990 tx=0x7ff72c009b30).stop 2021-11-03T18:28:34.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.706+0000 7ff73fcb3700 1 -- 172.21.15.26:0/2976348820 shutdown_connections 2021-11-03T18:28:34.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.706+0000 7ff73fcb3700 1 --2- 172.21.15.26:0/2976348820 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff7200640b0 0x7ff720066570 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:34.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.706+0000 7ff73fcb3700 1 --2- 172.21.15.26:0/2976348820 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7380f7d00 0x7ff738106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:34.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.706+0000 7ff73fcb3700 1 --2- 172.21.15.26:0/2976348820 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7380f8610 0x7ff738107400 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:28:34.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.706+0000 7ff73fcb3700 1 -- 172.21.15.26:0/2976348820 >> 172.21.15.26:0/2976348820 conn(0x7ff7380f0540 msgr2=0x7ff7380fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:28:34.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.706+0000 7ff73fcb3700 1 -- 172.21.15.26:0/2976348820 shutdown_connections 2021-11-03T18:28:34.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:28:34.707+0000 7ff73fcb3700 1 -- 172.21.15.26:0/2976348820 wait complete. 2021-11-03T18:28:34.716 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:28:35.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:35 smithi026 ceph-mon[96795]: from='client.37036 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:28:35.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:35 smithi026 ceph-mon[96795]: pgmap v2817: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:35.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:35 smithi026 ceph-mon[96795]: from='client.37040 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:28:35.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:35 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1817227580' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:28:35.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:35 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2976348820' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:28:35.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:35 smithi194 ceph-mon[65619]: from='client.37036 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:28:35.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:35 smithi194 ceph-mon[65619]: pgmap v2817: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:35.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:35 smithi194 ceph-mon[65619]: from='client.37040 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:28:35.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:35 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1817227580' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:28:35.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:35 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2976348820' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:28:37.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:37 smithi026 ceph-mon[96795]: pgmap v2818: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:37.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:37 smithi194 ceph-mon[65619]: pgmap v2818: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:39.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:39 smithi026 ceph-mon[96795]: pgmap v2819: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:39.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:39 smithi194 ceph-mon[65619]: pgmap v2819: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:41.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:41 smithi026 ceph-mon[96795]: pgmap v2820: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:41.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:41 smithi194 ceph-mon[65619]: pgmap v2820: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:43.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:43 smithi026 ceph-mon[96795]: pgmap v2821: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:43.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:43 smithi194 ceph-mon[65619]: pgmap v2821: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:44.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:44 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:28:44.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:44 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:28:45.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:45 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:28:45.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:45 smithi026 ceph-mon[96795]: pgmap v2822: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:45.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:45 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:28:45.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:45 smithi194 ceph-mon[65619]: pgmap v2822: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:47.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:47 smithi026 ceph-mon[96795]: pgmap v2823: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:47.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:47 smithi194 ceph-mon[65619]: pgmap v2823: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:49.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:49 smithi026 ceph-mon[96795]: pgmap v2824: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:28:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:28:49.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:49 smithi194 ceph-mon[65619]: pgmap v2824: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:49.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:28:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:28:51.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:51 smithi026 ceph-mon[96795]: pgmap v2825: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:51.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:51 smithi194 ceph-mon[65619]: pgmap v2825: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:53.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:53 smithi026 ceph-mon[96795]: pgmap v2826: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:53.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:53 smithi194 ceph-mon[65619]: pgmap v2826: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:55.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:55 smithi026 ceph-mon[96795]: pgmap v2827: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:55.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:55 smithi194 ceph-mon[65619]: pgmap v2827: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:57.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:57 smithi026 ceph-mon[96795]: pgmap v2828: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:57.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:57 smithi194 ceph-mon[65619]: pgmap v2828: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:59.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:59 smithi026 ceph-mon[96795]: pgmap v2829: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:59.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:28:59 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:28:59.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:59 smithi194 ceph-mon[65619]: pgmap v2829: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:28:59.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:28:59 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:29:00.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:00 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:29:00.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:00 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:29:01.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:01 smithi026 ceph-mon[96795]: pgmap v2830: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:01.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:01 smithi194 ceph-mon[65619]: pgmap v2830: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:03.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:03 smithi026 ceph-mon[96795]: pgmap v2831: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:03.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:03 smithi194 ceph-mon[65619]: pgmap v2831: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:04.821 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:04.822+0000 7efe9eb2a700 1 -- 172.21.15.26:0/683920253 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe980f6860 msgr2=0x7efe980f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:29:04.821 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:04.822+0000 7efe9eb2a700 1 --2- 172.21.15.26:0/683920253 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe980f6860 0x7efe980f6cc0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7efe84004660 tx=0x7efe84009b30).stop 2021-11-03T18:29:04.822 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:04.822+0000 7efe9eb2a700 1 -- 172.21.15.26:0/683920253 shutdown_connections 2021-11-03T18:29:04.822 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:04.822+0000 7efe9eb2a700 1 --2- 172.21.15.26:0/683920253 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe980f6860 0x7efe980f6cc0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:04.822 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:04.822+0000 7efe9eb2a700 1 --2- 172.21.15.26:0/683920253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe980f55c0 0x7efe980f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:04.822 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:04.822+0000 7efe9eb2a700 1 -- 172.21.15.26:0/683920253 >> 172.21.15.26:0/683920253 conn(0x7efe980f0d20 msgr2=0x7efe980f3140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:29:04.823 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:04.823+0000 7efe9eb2a700 1 -- 172.21.15.26:0/683920253 shutdown_connections 2021-11-03T18:29:04.823 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:04.823+0000 7efe9eb2a700 1 -- 172.21.15.26:0/683920253 wait complete. 2021-11-03T18:29:04.823 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:04.823+0000 7efe9eb2a700 1 Processor -- start 2021-11-03T18:29:04.823 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:04.823+0000 7efe9eb2a700 1 -- start start 2021-11-03T18:29:04.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:04.824+0000 7efe9eb2a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe980f55c0 0x7efe9810c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:29:04.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:04.824+0000 7efe9eb2a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe980f6860 0x7efe9810e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:29:04.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:04.824+0000 7efe9eb2a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe98060410 con 0x7efe980f6860 2021-11-03T18:29:04.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:04.824+0000 7efe9eb2a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe98060550 con 0x7efe980f55c0 2021-11-03T18:29:04.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:04.824+0000 7efe97fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe980f6860 0x7efe9810e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:29:04.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:04.824+0000 7efe97fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe980f6860 0x7efe9810e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60278/0 (socket says 172.21.15.26:60278) 2021-11-03T18:29:04.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:04.824+0000 7efe97fff700 1 -- 172.21.15.26:0/1267319678 learned_addr learned my addr 172.21.15.26:0/1267319678 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:29:04.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:04.824+0000 7efe9c8c6700 1 --2- 172.21.15.26:0/1267319678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe980f55c0 0x7efe9810c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:29:04.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:04.824+0000 7efe97fff700 1 -- 172.21.15.26:0/1267319678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe980f55c0 msgr2=0x7efe9810c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:29:04.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:04.824+0000 7efe97fff700 1 --2- 172.21.15.26:0/1267319678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe980f55c0 0x7efe9810c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:04.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:04.824+0000 7efe97fff700 1 -- 172.21.15.26:0/1267319678 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe84005040 con 0x7efe980f6860 2021-11-03T18:29:04.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:04.824+0000 7efe97fff700 1 --2- 172.21.15.26:0/1267319678 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe980f6860 0x7efe9810e550 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 rx=0x7efe84009990 tx=0x7efe84009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:29:04.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:04.825+0000 7efe957fa700 1 -- 172.21.15.26:0/1267319678 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe84018070 con 0x7efe980f6860 2021-11-03T18:29:04.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:04.825+0000 7efe957fa700 1 -- 172.21.15.26:0/1267319678 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efe84007ba0 con 0x7efe980f6860 2021-11-03T18:29:04.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:04.825+0000 7efe957fa700 1 -- 172.21.15.26:0/1267319678 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe8401c3c0 con 0x7efe980f6860 2021-11-03T18:29:04.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:04.825+0000 7efe9eb2a700 1 -- 172.21.15.26:0/1267319678 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe9810ea40 con 0x7efe980f6860 2021-11-03T18:29:04.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:04.825+0000 7efe9eb2a700 1 -- 172.21.15.26:0/1267319678 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe9810ee10 con 0x7efe980f6860 2021-11-03T18:29:04.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:04.826+0000 7efe9eb2a700 1 -- 172.21.15.26:0/1267319678 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe98045ad0 con 0x7efe980f6860 2021-11-03T18:29:04.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:04.826+0000 7efe957fa700 1 -- 172.21.15.26:0/1267319678 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7efe8401d420 con 0x7efe980f6860 2021-11-03T18:29:04.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:04.827+0000 7efe957fa700 1 --2- 172.21.15.26:0/1267319678 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efe880640b0 0x7efe88066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:29:04.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:04.827+0000 7efe957fa700 1 -- 172.21.15.26:0/1267319678 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7efe84082390 con 0x7efe980f6860 2021-11-03T18:29:04.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:04.827+0000 7efe9c8c6700 1 --2- 172.21.15.26:0/1267319678 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efe880640b0 0x7efe88066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:29:04.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:04.827+0000 7efe9c8c6700 1 --2- 172.21.15.26:0/1267319678 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efe880640b0 0x7efe88066570 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7efe980601a0 tx=0x7efe8c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:29:04.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:04.831+0000 7efe957fa700 1 -- 172.21.15.26:0/1267319678 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7efe840547b0 con 0x7efe980f6860 2021-11-03T18:29:05.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.011+0000 7efe9eb2a700 1 -- 172.21.15.26:0/1267319678 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efe98057f10 con 0x7efe880640b0 2021-11-03T18:29:05.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.013+0000 7efe957fa700 1 -- 172.21.15.26:0/1267319678 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7efe98057f10 con 0x7efe880640b0 2021-11-03T18:29:05.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.014+0000 7efe9eb2a700 1 -- 172.21.15.26:0/1267319678 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efe880640b0 msgr2=0x7efe88066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:29:05.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.014+0000 7efe9eb2a700 1 --2- 172.21.15.26:0/1267319678 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efe880640b0 0x7efe88066570 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7efe980601a0 tx=0x7efe8c00b040).stop 2021-11-03T18:29:05.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.014+0000 7efe9eb2a700 1 -- 172.21.15.26:0/1267319678 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe980f6860 msgr2=0x7efe9810e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:29:05.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.014+0000 7efe9eb2a700 1 --2- 172.21.15.26:0/1267319678 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe980f6860 0x7efe9810e550 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 rx=0x7efe84009990 tx=0x7efe84009b30).stop 2021-11-03T18:29:05.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.014+0000 7efe9eb2a700 1 -- 172.21.15.26:0/1267319678 shutdown_connections 2021-11-03T18:29:05.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.014+0000 7efe9eb2a700 1 --2- 172.21.15.26:0/1267319678 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efe880640b0 0x7efe88066570 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:05.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.014+0000 7efe9eb2a700 1 --2- 172.21.15.26:0/1267319678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe980f55c0 0x7efe9810c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:05.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.014+0000 7efe9eb2a700 1 --2- 172.21.15.26:0/1267319678 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe980f6860 0x7efe9810e550 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:05.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.014+0000 7efe9eb2a700 1 -- 172.21.15.26:0/1267319678 >> 172.21.15.26:0/1267319678 conn(0x7efe980f0d20 msgr2=0x7efe980fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:29:05.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.015+0000 7efe9eb2a700 1 -- 172.21.15.26:0/1267319678 shutdown_connections 2021-11-03T18:29:05.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.015+0000 7efe9eb2a700 1 -- 172.21.15.26:0/1267319678 wait complete. 2021-11-03T18:29:05.022 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:29:05.116 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.116+0000 7f418b9c3700 1 -- 172.21.15.26:0/1703117737 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41840f6ff0 msgr2=0x7f41840f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:29:05.116 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.116+0000 7f418b9c3700 1 --2- 172.21.15.26:0/1703117737 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41840f6ff0 0x7f41840f7a20 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 rx=0x7f4178004660 tx=0x7f4178009b30).stop 2021-11-03T18:29:05.116 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.116+0000 7f418b9c3700 1 -- 172.21.15.26:0/1703117737 shutdown_connections 2021-11-03T18:29:05.116 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.116+0000 7f418b9c3700 1 --2- 172.21.15.26:0/1703117737 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41840f6ff0 0x7f41840f7a20 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:05.117 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.116+0000 7f418b9c3700 1 --2- 172.21.15.26:0/1703117737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41840f66e0 0x7f41840f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:05.117 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.116+0000 7f418b9c3700 1 -- 172.21.15.26:0/1703117737 >> 172.21.15.26:0/1703117737 conn(0x7f41840f1f00 msgr2=0x7f41840f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:29:05.117 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.116+0000 7f418b9c3700 1 -- 172.21.15.26:0/1703117737 shutdown_connections 2021-11-03T18:29:05.117 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.116+0000 7f418b9c3700 1 -- 172.21.15.26:0/1703117737 wait complete. 2021-11-03T18:29:05.117 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.117+0000 7f418b9c3700 1 Processor -- start 2021-11-03T18:29:05.118 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.117+0000 7f418b9c3700 1 -- start start 2021-11-03T18:29:05.118 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.117+0000 7f418b9c3700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41840f66e0 0x7f4184106f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:29:05.118 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.117+0000 7f418b9c3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41840f6ff0 0x7f4184107480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:29:05.118 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.117+0000 7f418b9c3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4184107a30 con 0x7f41840f6ff0 2021-11-03T18:29:05.118 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.117+0000 7f418b9c3700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4184107b70 con 0x7f41840f66e0 2021-11-03T18:29:05.119 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.117+0000 7f4188f5e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41840f6ff0 0x7f4184107480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:29:05.119 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.117+0000 7f4188f5e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41840f6ff0 0x7f4184107480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60288/0 (socket says 172.21.15.26:60288) 2021-11-03T18:29:05.119 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.117+0000 7f4188f5e700 1 -- 172.21.15.26:0/3964056474 learned_addr learned my addr 172.21.15.26:0/3964056474 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:29:05.119 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.117+0000 7f418975f700 1 --2- 172.21.15.26:0/3964056474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41840f66e0 0x7f4184106f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:29:05.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.117+0000 7f4188f5e700 1 -- 172.21.15.26:0/3964056474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41840f66e0 msgr2=0x7f4184106f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:29:05.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.117+0000 7f4188f5e700 1 --2- 172.21.15.26:0/3964056474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41840f66e0 0x7f4184106f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:05.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.117+0000 7f4188f5e700 1 -- 172.21.15.26:0/3964056474 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4178005040 con 0x7f41840f6ff0 2021-11-03T18:29:05.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.117+0000 7f418975f700 1 --2- 172.21.15.26:0/3964056474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41840f66e0 0x7f4184106f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:29:05.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.118+0000 7f4188f5e700 1 --2- 172.21.15.26:0/3964056474 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41840f6ff0 0x7f4184107480 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7f4178009990 tx=0x7f4178009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:29:05.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.118+0000 7f4181ffb700 1 -- 172.21.15.26:0/3964056474 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4178018070 con 0x7f41840f6ff0 2021-11-03T18:29:05.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.118+0000 7f4181ffb700 1 -- 172.21.15.26:0/3964056474 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4178007ca0 con 0x7f41840f6ff0 2021-11-03T18:29:05.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.118+0000 7f418b9c3700 1 -- 172.21.15.26:0/3964056474 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41841084b0 con 0x7f41840f6ff0 2021-11-03T18:29:05.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.118+0000 7f4181ffb700 1 -- 172.21.15.26:0/3964056474 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f417801c620 con 0x7f41840f6ff0 2021-11-03T18:29:05.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.118+0000 7f418b9c3700 1 -- 172.21.15.26:0/3964056474 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4184108a10 con 0x7f41840f6ff0 2021-11-03T18:29:05.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.119+0000 7f418b9c3700 1 -- 172.21.15.26:0/3964056474 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4184045ad0 con 0x7f41840f6ff0 2021-11-03T18:29:05.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.119+0000 7f4181ffb700 1 -- 172.21.15.26:0/3964056474 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f417801d960 con 0x7f41840f6ff0 2021-11-03T18:29:05.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.120+0000 7f4181ffb700 1 --2- 172.21.15.26:0/3964056474 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f416c0640b0 0x7f416c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:29:05.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.120+0000 7f4181ffb700 1 -- 172.21.15.26:0/3964056474 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f4178082520 con 0x7f41840f6ff0 2021-11-03T18:29:05.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.120+0000 7f418975f700 1 --2- 172.21.15.26:0/3964056474 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f416c0640b0 0x7f416c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:29:05.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.120+0000 7f418975f700 1 --2- 172.21.15.26:0/3964056474 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f416c0640b0 0x7f416c066570 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7f417c004550 tx=0x7f417c009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:29:05.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.124+0000 7f4181ffb700 1 -- 172.21.15.26:0/3964056474 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f4178054940 con 0x7f41840f6ff0 2021-11-03T18:29:05.295 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.297+0000 7f418b9c3700 1 -- 172.21.15.26:0/3964056474 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f41840ff000 con 0x7f416c0640b0 2021-11-03T18:29:05.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.312+0000 7f4181ffb700 1 -- 172.21.15.26:0/3964056474 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7f41840ff000 con 0x7f416c0640b0 2021-11-03T18:29:05.310 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:29:05.310 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (100m) 8m ago 101m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:29:05.310 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (92m) 8m ago 101m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:29:05.310 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (92m) 7m ago 100m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:29:05.311 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (100m) 8m ago 101m 42.2M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:29:05.311 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (93m) 8m ago 96m 26.0M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:29:05.311 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (93m) 8m ago 96m 26.6M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:29:05.311 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (96m) 7m ago 96m 26.8M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:29:05.312 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (96m) 7m ago 96m 27.2M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:29:05.312 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (94m) 8m ago 102m 588M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:29:05.312 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (93m) 7m ago 100m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:29:05.312 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (93m) 8m ago 103m 341M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:29:05.312 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (93m) 7m ago 100m 158M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:29:05.313 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (101m) 8m ago 101m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:29:05.313 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (100m) 7m ago 100m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:29:05.313 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (92m) 8m ago 99m 332M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:29:05.313 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (91m) 8m ago 99m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:29:05.314 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (91m) 8m ago 99m 296M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:29:05.314 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (90m) 7m ago 98m 387M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:29:05.314 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (90m) 7m ago 98m 320M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:29:05.314 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (89m) 7m ago 98m 316M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:29:05.314 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (100m) 8m ago 100m 65.7M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:29:05.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.313+0000 7f418b9c3700 1 -- 172.21.15.26:0/3964056474 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f416c0640b0 msgr2=0x7f416c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:29:05.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.313+0000 7f418b9c3700 1 --2- 172.21.15.26:0/3964056474 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f416c0640b0 0x7f416c066570 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7f417c004550 tx=0x7f417c009040).stop 2021-11-03T18:29:05.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.313+0000 7f418b9c3700 1 -- 172.21.15.26:0/3964056474 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41840f6ff0 msgr2=0x7f4184107480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:29:05.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.313+0000 7f418b9c3700 1 --2- 172.21.15.26:0/3964056474 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41840f6ff0 0x7f4184107480 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7f4178009990 tx=0x7f4178009b30).stop 2021-11-03T18:29:05.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.313+0000 7f418b9c3700 1 -- 172.21.15.26:0/3964056474 shutdown_connections 2021-11-03T18:29:05.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.313+0000 7f418b9c3700 1 --2- 172.21.15.26:0/3964056474 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f416c0640b0 0x7f416c066570 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:05.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.313+0000 7f418b9c3700 1 --2- 172.21.15.26:0/3964056474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41840f66e0 0x7f4184106f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:05.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.313+0000 7f418b9c3700 1 --2- 172.21.15.26:0/3964056474 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41840f6ff0 0x7f4184107480 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:05.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.313+0000 7f418b9c3700 1 -- 172.21.15.26:0/3964056474 >> 172.21.15.26:0/3964056474 conn(0x7f41840f1f00 msgr2=0x7f41840fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:29:05.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.313+0000 7f418b9c3700 1 -- 172.21.15.26:0/3964056474 shutdown_connections 2021-11-03T18:29:05.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.314+0000 7f418b9c3700 1 -- 172.21.15.26:0/3964056474 wait complete. 2021-11-03T18:29:05.411 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.412+0000 7f8226e31700 1 -- 172.21.15.26:0/1114330522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82200f55e0 msgr2=0x7f82200f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:29:05.411 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.412+0000 7f8226e31700 1 --2- 172.21.15.26:0/1114330522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82200f55e0 0x7f82200f5a00 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 rx=0x7f8208004660 tx=0x7f8208009b30).stop 2021-11-03T18:29:05.411 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.412+0000 7f8226e31700 1 -- 172.21.15.26:0/1114330522 shutdown_connections 2021-11-03T18:29:05.411 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.412+0000 7f8226e31700 1 --2- 172.21.15.26:0/1114330522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82200f5ef0 0x7f82200f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:29:05.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.412+0000 7f8226e31700 1 --2- 172.21.15.26:0/1114330522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82200f55e0 0x7f82200f5a00 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:05.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.412+0000 7f8226e31700 1 -- 172.21.15.26:0/1114330522 >> 172.21.15.26:0/1114330522 conn(0x7f82200f0de0 msgr2=0x7f82200f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:29:05.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.412+0000 7f8226e31700 1 -- 172.21.15.26:0/1114330522 shutdown_connections 2021-11-03T18:29:05.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.412+0000 7f8226e31700 1 -- 172.21.15.26:0/1114330522 wait complete. 2021-11-03T18:29:05.413 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.413+0000 7f8226e31700 1 Processor -- start 2021-11-03T18:29:05.413 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.413+0000 7f8226e31700 1 -- start start 2021-11-03T18:29:05.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.413+0000 7f8226e31700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82200f55e0 0x7f8220109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:29:05.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.413+0000 7f8226e31700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82200f5ef0 0x7f822010c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:29:05.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.413+0000 7f8226e31700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8220060570 con 0x7f82200f55e0 2021-11-03T18:29:05.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.413+0000 7f8226e31700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82200606b0 con 0x7f82200f5ef0 2021-11-03T18:29:05.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.413+0000 7f8224bcd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82200f55e0 0x7f8220109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:29:05.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.413+0000 7f8224bcd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82200f55e0 0x7f8220109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60296/0 (socket says 172.21.15.26:60296) 2021-11-03T18:29:05.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.413+0000 7f8224bcd700 1 -- 172.21.15.26:0/1232521679 learned_addr learned my addr 172.21.15.26:0/1232521679 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:29:05.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.414+0000 7f821ffff700 1 --2- 172.21.15.26:0/1232521679 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82200f5ef0 0x7f822010c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:29:05.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.414+0000 7f8224bcd700 1 -- 172.21.15.26:0/1232521679 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82200f5ef0 msgr2=0x7f822010c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:29:05.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.414+0000 7f8224bcd700 1 --2- 172.21.15.26:0/1232521679 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82200f5ef0 0x7f822010c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:05.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.414+0000 7f8224bcd700 1 -- 172.21.15.26:0/1232521679 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8208005040 con 0x7f82200f55e0 2021-11-03T18:29:05.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.414+0000 7f821ffff700 1 --2- 172.21.15.26:0/1232521679 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82200f5ef0 0x7f822010c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:29:05.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.414+0000 7f8224bcd700 1 --2- 172.21.15.26:0/1232521679 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82200f55e0 0x7f8220109c70 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 rx=0x7f8208009990 tx=0x7f8208009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:29:05.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.414+0000 7f821d7fa700 1 -- 172.21.15.26:0/1232521679 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8208018070 con 0x7f82200f55e0 2021-11-03T18:29:05.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.414+0000 7f8226e31700 1 -- 172.21.15.26:0/1232521679 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f822010c770 con 0x7f82200f55e0 2021-11-03T18:29:05.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.414+0000 7f821d7fa700 1 -- 172.21.15.26:0/1232521679 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8208007ca0 con 0x7f82200f55e0 2021-11-03T18:29:05.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.414+0000 7f821d7fa700 1 -- 172.21.15.26:0/1232521679 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f820801c620 con 0x7f82200f55e0 2021-11-03T18:29:05.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.414+0000 7f8226e31700 1 -- 172.21.15.26:0/1232521679 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f822010cca0 con 0x7f82200f55e0 2021-11-03T18:29:05.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.415+0000 7f8226e31700 1 -- 172.21.15.26:0/1232521679 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82200f4a70 con 0x7f82200f55e0 2021-11-03T18:29:05.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.415+0000 7f821d7fa700 1 -- 172.21.15.26:0/1232521679 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f820801d960 con 0x7f82200f55e0 2021-11-03T18:29:05.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.416+0000 7f821d7fa700 1 --2- 172.21.15.26:0/1232521679 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f820c0640b0 0x7f820c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:29:05.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.416+0000 7f821d7fa700 1 -- 172.21.15.26:0/1232521679 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f8208082540 con 0x7f82200f55e0 2021-11-03T18:29:05.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.416+0000 7f821ffff700 1 --2- 172.21.15.26:0/1232521679 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f820c0640b0 0x7f820c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:29:05.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.416+0000 7f821ffff700 1 --2- 172.21.15.26:0/1232521679 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f820c0640b0 0x7f820c066570 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7f821000a7e0 tx=0x7f8210008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:29:05.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.420+0000 7f821d7fa700 1 -- 172.21.15.26:0/1232521679 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f8208054960 con 0x7f82200f55e0 2021-11-03T18:29:05.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:05 smithi026 ceph-mon[96795]: pgmap v2832: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:05.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:05 smithi194 ceph-mon[65619]: pgmap v2832: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:05.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.648+0000 7f8226e31700 1 -- 172.21.15.26:0/1232521679 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8220045ad0 con 0x7f82200f55e0 2021-11-03T18:29:05.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.648+0000 7f821d7fa700 1 -- 172.21.15.26:0/1232521679 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f8208054550 con 0x7f82200f55e0 2021-11-03T18:29:05.647 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:29:05.647 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:29:05.647 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:29:05.647 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:29:05.647 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:29:05.648 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:29:05.648 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:29:05.648 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:29:05.648 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:29:05.649 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:29:05.649 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:29:05.649 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:29:05.649 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:29:05.650 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:29:05.650 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:29:05.650 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:29:05.650 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:29:05.651 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:29:05.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.650+0000 7f8226e31700 1 -- 172.21.15.26:0/1232521679 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f820c0640b0 msgr2=0x7f820c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:29:05.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.650+0000 7f8226e31700 1 --2- 172.21.15.26:0/1232521679 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f820c0640b0 0x7f820c066570 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7f821000a7e0 tx=0x7f8210008040).stop 2021-11-03T18:29:05.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.650+0000 7f8226e31700 1 -- 172.21.15.26:0/1232521679 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82200f55e0 msgr2=0x7f8220109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:29:05.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.650+0000 7f8226e31700 1 --2- 172.21.15.26:0/1232521679 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82200f55e0 0x7f8220109c70 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 rx=0x7f8208009990 tx=0x7f8208009b30).stop 2021-11-03T18:29:05.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.650+0000 7f8226e31700 1 -- 172.21.15.26:0/1232521679 shutdown_connections 2021-11-03T18:29:05.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.650+0000 7f8226e31700 1 --2- 172.21.15.26:0/1232521679 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f820c0640b0 0x7f820c066570 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:05.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.650+0000 7f8226e31700 1 --2- 172.21.15.26:0/1232521679 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82200f55e0 0x7f8220109c70 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:05.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.650+0000 7f8226e31700 1 --2- 172.21.15.26:0/1232521679 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82200f5ef0 0x7f822010c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:05.654 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.650+0000 7f8226e31700 1 -- 172.21.15.26:0/1232521679 >> 172.21.15.26:0/1232521679 conn(0x7f82200f0de0 msgr2=0x7f82200fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:29:05.654 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.650+0000 7f8226e31700 1 -- 172.21.15.26:0/1232521679 shutdown_connections 2021-11-03T18:29:05.654 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.650+0000 7f8226e31700 1 -- 172.21.15.26:0/1232521679 wait complete. 2021-11-03T18:29:05.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.750+0000 7fd3bc763700 1 -- 172.21.15.26:0/4038462468 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3b40f66e0 msgr2=0x7fd3b40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:29:05.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.750+0000 7fd3bc763700 1 --2- 172.21.15.26:0/4038462468 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3b40f66e0 0x7fd3b40f6b00 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 rx=0x7fd3a4004660 tx=0x7fd3a4009b30).stop 2021-11-03T18:29:05.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.750+0000 7fd3bc763700 1 -- 172.21.15.26:0/4038462468 shutdown_connections 2021-11-03T18:29:05.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.750+0000 7fd3bc763700 1 --2- 172.21.15.26:0/4038462468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3b40f7980 0x7fd3b40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:05.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.750+0000 7fd3bc763700 1 --2- 172.21.15.26:0/4038462468 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3b40f66e0 0x7fd3b40f6b00 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:05.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.750+0000 7fd3bc763700 1 -- 172.21.15.26:0/4038462468 >> 172.21.15.26:0/4038462468 conn(0x7fd3b40f1e40 msgr2=0x7fd3b40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:29:05.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.750+0000 7fd3bc763700 1 -- 172.21.15.26:0/4038462468 shutdown_connections 2021-11-03T18:29:05.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.750+0000 7fd3bc763700 1 -- 172.21.15.26:0/4038462468 wait complete. 2021-11-03T18:29:05.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.750+0000 7fd3bc763700 1 Processor -- start 2021-11-03T18:29:05.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.750+0000 7fd3bc763700 1 -- start start 2021-11-03T18:29:05.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.751+0000 7fd3bc763700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3b40f66e0 0x7fd3b406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:29:05.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.751+0000 7fd3bc763700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3b40f7980 0x7fd3b4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:29:05.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.751+0000 7fd3bc763700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b406a380 con 0x7fd3b40f66e0 2021-11-03T18:29:05.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.751+0000 7fd3bc763700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b406a4c0 con 0x7fd3b40f7980 2021-11-03T18:29:05.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.751+0000 7fd3ba4ff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3b40f66e0 0x7fd3b406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:29:05.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.751+0000 7fd3ba4ff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3b40f66e0 0x7fd3b406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60306/0 (socket says 172.21.15.26:60306) 2021-11-03T18:29:05.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.751+0000 7fd3ba4ff700 1 -- 172.21.15.26:0/1637526315 learned_addr learned my addr 172.21.15.26:0/1637526315 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:29:05.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.751+0000 7fd3ba4ff700 1 -- 172.21.15.26:0/1637526315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3b40f7980 msgr2=0x7fd3b4069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:29:05.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.751+0000 7fd3b9cfe700 1 --2- 172.21.15.26:0/1637526315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3b40f7980 0x7fd3b4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:29:05.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.751+0000 7fd3ba4ff700 1 --2- 172.21.15.26:0/1637526315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3b40f7980 0x7fd3b4069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:05.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.751+0000 7fd3ba4ff700 1 -- 172.21.15.26:0/1637526315 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a4005040 con 0x7fd3b40f66e0 2021-11-03T18:29:05.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.751+0000 7fd3ba4ff700 1 --2- 172.21.15.26:0/1637526315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3b40f66e0 0x7fd3b406b9a0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 rx=0x7fd3a4013a70 tx=0x7fd3a4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:29:05.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.751+0000 7fd3aaffd700 1 -- 172.21.15.26:0/1637526315 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3a4018070 con 0x7fd3b40f66e0 2021-11-03T18:29:05.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.751+0000 7fd3aaffd700 1 -- 172.21.15.26:0/1637526315 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd3a40097d0 con 0x7fd3b40f66e0 2021-11-03T18:29:05.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.751+0000 7fd3bc763700 1 -- 172.21.15.26:0/1637526315 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3b406a740 con 0x7fd3b40f66e0 2021-11-03T18:29:05.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.751+0000 7fd3aaffd700 1 -- 172.21.15.26:0/1637526315 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3a401c3c0 con 0x7fd3b40f66e0 2021-11-03T18:29:05.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.751+0000 7fd3bc763700 1 -- 172.21.15.26:0/1637526315 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3b406aca0 con 0x7fd3b40f66e0 2021-11-03T18:29:05.757 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.752+0000 7fd3bc763700 1 -- 172.21.15.26:0/1637526315 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3b4045ad0 con 0x7fd3b40f66e0 2021-11-03T18:29:05.758 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.753+0000 7fd3aaffd700 1 -- 172.21.15.26:0/1637526315 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fd3a4007ba0 con 0x7fd3b40f66e0 2021-11-03T18:29:05.758 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.753+0000 7fd3aaffd700 1 --2- 172.21.15.26:0/1637526315 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd3a00640b0 0x7fd3a0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:29:05.758 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.753+0000 7fd3aaffd700 1 -- 172.21.15.26:0/1637526315 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fd3a40823a0 con 0x7fd3b40f66e0 2021-11-03T18:29:05.758 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.753+0000 7fd3b9cfe700 1 --2- 172.21.15.26:0/1637526315 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd3a00640b0 0x7fd3a0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:29:05.759 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.754+0000 7fd3b9cfe700 1 --2- 172.21.15.26:0/1637526315 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd3a00640b0 0x7fd3a0066570 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7fd3b0009880 tx=0x7fd3b000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:29:05.759 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.757+0000 7fd3aaffd700 1 -- 172.21.15.26:0/1637526315 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fd3a40547c0 con 0x7fd3b40f66e0 2021-11-03T18:29:05.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.962+0000 7fd3bc763700 1 -- 172.21.15.26:0/1637526315 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd3b4027a00 con 0x7fd3b40f66e0 2021-11-03T18:29:05.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.962+0000 7fd3aaffd700 1 -- 172.21.15.26:0/1637526315 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fd3a40543b0 con 0x7fd3b40f66e0 2021-11-03T18:29:05.961 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:29:05.961 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:29:05.961 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:29:05.961 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:29:05.962 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:29:05.962 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:29:05.962 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:29:05.962 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:29:05.963 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:29:05.963 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:29:05.963 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:29:05.963 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:29:05.963 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:29:05.964 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:29:05.964 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:29:05.964 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:29:05.964 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:29:05.965 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:29:05.965 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:29:05.965 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:29:05.965 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:29:05.965 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:29:05.966 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:29:05.966 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:29:05.966 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:29:05.966 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:29:05.967 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:29:05.967 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:29:05.967 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:29:05.967 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:29:05.968 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:29:05.968 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:29:05.968 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:29:05.968 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:29:05.968 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:29:05.969 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:29:05.969 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:29:05.969 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:29:05.969 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:29:05.970 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.964+0000 7fd3bc763700 1 -- 172.21.15.26:0/1637526315 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd3a00640b0 msgr2=0x7fd3a0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:29:05.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.964+0000 7fd3bc763700 1 --2- 172.21.15.26:0/1637526315 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd3a00640b0 0x7fd3a0066570 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7fd3b0009880 tx=0x7fd3b000b040).stop 2021-11-03T18:29:05.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.964+0000 7fd3bc763700 1 -- 172.21.15.26:0/1637526315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3b40f66e0 msgr2=0x7fd3b406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:29:05.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.964+0000 7fd3bc763700 1 --2- 172.21.15.26:0/1637526315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3b40f66e0 0x7fd3b406b9a0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 rx=0x7fd3a4013a70 tx=0x7fd3a4009b30).stop 2021-11-03T18:29:05.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.964+0000 7fd3bc763700 1 -- 172.21.15.26:0/1637526315 shutdown_connections 2021-11-03T18:29:05.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.964+0000 7fd3bc763700 1 --2- 172.21.15.26:0/1637526315 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd3a00640b0 0x7fd3a0066570 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:05.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.964+0000 7fd3bc763700 1 --2- 172.21.15.26:0/1637526315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3b40f66e0 0x7fd3b406b9a0 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:05.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.964+0000 7fd3bc763700 1 --2- 172.21.15.26:0/1637526315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3b40f7980 0x7fd3b4069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:05.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.964+0000 7fd3bc763700 1 -- 172.21.15.26:0/1637526315 >> 172.21.15.26:0/1637526315 conn(0x7fd3b40f1e40 msgr2=0x7fd3b40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:29:05.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.964+0000 7fd3bc763700 1 -- 172.21.15.26:0/1637526315 shutdown_connections 2021-11-03T18:29:05.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:05.964+0000 7fd3bc763700 1 -- 172.21.15.26:0/1637526315 wait complete. 2021-11-03T18:29:05.973 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:29:06.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:06 smithi026 ceph-mon[96795]: from='client.37052 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:29:06.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:06 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1232521679' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:29:06.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:06 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1637526315' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:29:06.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:06 smithi194 ceph-mon[65619]: from='client.37052 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:29:06.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:06 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1232521679' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:29:06.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:06 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1637526315' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:29:07.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:07 smithi026 ceph-mon[96795]: from='client.37056 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:29:07.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:07 smithi026 ceph-mon[96795]: pgmap v2833: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:07.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:07 smithi194 ceph-mon[65619]: from='client.37056 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:29:07.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:07 smithi194 ceph-mon[65619]: pgmap v2833: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:09.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:09 smithi026 ceph-mon[96795]: pgmap v2834: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:09.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:09 smithi194 ceph-mon[65619]: pgmap v2834: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:11.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:11 smithi026 ceph-mon[96795]: pgmap v2835: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:11.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:11 smithi194 ceph-mon[65619]: pgmap v2835: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:13.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:13 smithi026 ceph-mon[96795]: pgmap v2836: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:13.473 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:13 smithi194 ceph-mon[65619]: pgmap v2836: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:14.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:14 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:29:14.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:14 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:29:15.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:15 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:29:15.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:15 smithi026 ceph-mon[96795]: pgmap v2837: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:15.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:15 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:29:15.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:15 smithi194 ceph-mon[65619]: pgmap v2837: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:17.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:17 smithi026 ceph-mon[96795]: pgmap v2838: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:17.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:17 smithi194 ceph-mon[65619]: pgmap v2838: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:19.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:19 smithi026 ceph-mon[96795]: pgmap v2839: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:19.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:19 smithi194 ceph-mon[65619]: pgmap v2839: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:21.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:21 smithi026 ceph-mon[96795]: pgmap v2840: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:21.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:21 smithi194 ceph-mon[65619]: pgmap v2840: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:23.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:23 smithi026 ceph-mon[96795]: pgmap v2841: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:23.473 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:23 smithi194 ceph-mon[65619]: pgmap v2841: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:25.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:25 smithi026 ceph-mon[96795]: pgmap v2842: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:25.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:25 smithi194 ceph-mon[65619]: pgmap v2842: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:27.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:27 smithi026 ceph-mon[96795]: pgmap v2843: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:27.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:27 smithi194 ceph-mon[65619]: pgmap v2843: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:29.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:29 smithi026 ceph-mon[96795]: pgmap v2844: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:29.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:29 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:29:29.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:29 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:29:29.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:29 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:29:29.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:29 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:29:29.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:29 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:29:29.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:29 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:29:29.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:29 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:29:29.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:29 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:29:29.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:29 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:29:29.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:29 smithi194 ceph-mon[65619]: pgmap v2844: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:29.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:29 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:29:29.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:29 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:29:29.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:29 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:29:29.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:29 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:29:29.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:29 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:29:29.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:29 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:29:29.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:29 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:29:29.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:29 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:29:29.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:29 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:29:30.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:30 smithi026 ceph-mon[96795]: poll took 60070.169 ms: 1 events 2021-11-03T18:29:30.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:30 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:29:30.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:30 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:29:30.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:30 smithi194 ceph-mon[65619]: poll took 60070.169 ms: 1 events 2021-11-03T18:29:30.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:30 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:29:30.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:30 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:29:31.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:31 smithi026 ceph-mon[96795]: pgmap v2845: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:31.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:31 smithi194 ceph-mon[65619]: pgmap v2845: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:33.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:33 smithi026 ceph-mon[96795]: pgmap v2846: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:33.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:33 smithi194 ceph-mon[65619]: pgmap v2846: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:35.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:35 smithi026 ceph-mon[96795]: pgmap v2847: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:35.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:35 smithi194 ceph-mon[65619]: pgmap v2847: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:36.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.078+0000 7f050584b700 1 -- 172.21.15.26:0/2826746428 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05000f5340 msgr2=0x7f05000f7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:29:36.078 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.078+0000 7f050584b700 1 --2- 172.21.15.26:0/2826746428 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05000f5340 0x7f05000f7ac0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 rx=0x7f04f0004660 tx=0x7f04f0009b30).stop 2021-11-03T18:29:36.078 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.078+0000 7f050584b700 1 -- 172.21.15.26:0/2826746428 shutdown_connections 2021-11-03T18:29:36.078 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.078+0000 7f050584b700 1 --2- 172.21.15.26:0/2826746428 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05000f5340 0x7f05000f7ac0 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:36.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.078+0000 7f050584b700 1 --2- 172.21.15.26:0/2826746428 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05000f49a0 0x7f05000f4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:36.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.078+0000 7f050584b700 1 -- 172.21.15.26:0/2826746428 >> 172.21.15.26:0/2826746428 conn(0x7f05000f04c0 msgr2=0x7f05000f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:29:36.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.078+0000 7f050584b700 1 -- 172.21.15.26:0/2826746428 shutdown_connections 2021-11-03T18:29:36.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.079+0000 7f050584b700 1 -- 172.21.15.26:0/2826746428 wait complete. 2021-11-03T18:29:36.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.079+0000 7f050584b700 1 Processor -- start 2021-11-03T18:29:36.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.079+0000 7f050584b700 1 -- start start 2021-11-03T18:29:36.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.079+0000 7f050584b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05000f49a0 0x7f05000f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:29:36.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.079+0000 7f050584b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05000f5340 0x7f05000f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:29:36.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.079+0000 7f050584b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05000f5f30 con 0x7f05000f49a0 2021-11-03T18:29:36.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.080+0000 7f050584b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05000f6070 con 0x7f05000f5340 2021-11-03T18:29:36.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.080+0000 7f04feffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05000f49a0 0x7f05000f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:29:36.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.080+0000 7f04feffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05000f49a0 0x7f05000f7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60324/0 (socket says 172.21.15.26:60324) 2021-11-03T18:29:36.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.080+0000 7f04feffd700 1 -- 172.21.15.26:0/1828659607 learned_addr learned my addr 172.21.15.26:0/1828659607 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:29:36.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.080+0000 7f04fe7fc700 1 --2- 172.21.15.26:0/1828659607 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05000f5340 0x7f05000f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:29:36.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.080+0000 7f04feffd700 1 -- 172.21.15.26:0/1828659607 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05000f5340 msgr2=0x7f05000f59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:29:36.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.080+0000 7f04feffd700 1 --2- 172.21.15.26:0/1828659607 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05000f5340 0x7f05000f59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:36.085 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.080+0000 7f04feffd700 1 -- 172.21.15.26:0/1828659607 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f0005040 con 0x7f05000f49a0 2021-11-03T18:29:36.085 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.080+0000 7f04feffd700 1 --2- 172.21.15.26:0/1828659607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05000f49a0 0x7f05000f7550 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 rx=0x7f04e8002700 tx=0x7f04e8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:29:36.085 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.080+0000 7f04f77fe700 1 -- 172.21.15.26:0/1828659607 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04e80079c0 con 0x7f05000f49a0 2021-11-03T18:29:36.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.080+0000 7f050584b700 1 -- 172.21.15.26:0/1828659607 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05000f6350 con 0x7f05000f49a0 2021-11-03T18:29:36.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.080+0000 7f04f77fe700 1 -- 172.21.15.26:0/1828659607 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f04e800f040 con 0x7f05000f49a0 2021-11-03T18:29:36.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.080+0000 7f04f77fe700 1 -- 172.21.15.26:0/1828659607 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04e8014860 con 0x7f05000f49a0 2021-11-03T18:29:36.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.080+0000 7f050584b700 1 -- 172.21.15.26:0/1828659607 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f050010efd0 con 0x7f05000f49a0 2021-11-03T18:29:36.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.081+0000 7f050584b700 1 -- 172.21.15.26:0/1828659607 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0500045ad0 con 0x7f05000f49a0 2021-11-03T18:29:36.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.082+0000 7f04f77fe700 1 -- 172.21.15.26:0/1828659607 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f04e801b060 con 0x7f05000f49a0 2021-11-03T18:29:36.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.082+0000 7f04f77fe700 1 --2- 172.21.15.26:0/1828659607 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f04ec064090 0x7f04ec066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:29:36.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.082+0000 7f04f77fe700 1 -- 172.21.15.26:0/1828659607 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f04e8080670 con 0x7f05000f49a0 2021-11-03T18:29:36.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.082+0000 7f04fe7fc700 1 --2- 172.21.15.26:0/1828659607 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f04ec064090 0x7f04ec066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:29:36.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.083+0000 7f04fe7fc700 1 --2- 172.21.15.26:0/1828659607 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f04ec064090 0x7f04ec066550 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7f04f0013690 tx=0x7f04f0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:29:36.088 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.086+0000 7f04f77fe700 1 -- 172.21.15.26:0/1828659607 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f04e80529d0 con 0x7f05000f49a0 2021-11-03T18:29:36.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.267+0000 7f050584b700 1 -- 172.21.15.26:0/1828659607 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0500057f10 con 0x7f04ec064090 2021-11-03T18:29:36.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.269+0000 7f04f77fe700 1 -- 172.21.15.26:0/1828659607 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f0500057f10 con 0x7f04ec064090 2021-11-03T18:29:36.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.270+0000 7f050584b700 1 -- 172.21.15.26:0/1828659607 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f04ec064090 msgr2=0x7f04ec066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:29:36.272 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.270+0000 7f050584b700 1 --2- 172.21.15.26:0/1828659607 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f04ec064090 0x7f04ec066550 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7f04f0013690 tx=0x7f04f0009b30).stop 2021-11-03T18:29:36.272 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.270+0000 7f050584b700 1 -- 172.21.15.26:0/1828659607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05000f49a0 msgr2=0x7f05000f7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:29:36.272 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.270+0000 7f050584b700 1 --2- 172.21.15.26:0/1828659607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05000f49a0 0x7f05000f7550 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 rx=0x7f04e8002700 tx=0x7f04e8009d80).stop 2021-11-03T18:29:36.272 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.271+0000 7f050584b700 1 -- 172.21.15.26:0/1828659607 shutdown_connections 2021-11-03T18:29:36.272 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.271+0000 7f050584b700 1 --2- 172.21.15.26:0/1828659607 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f04ec064090 0x7f04ec066550 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:36.273 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.271+0000 7f050584b700 1 --2- 172.21.15.26:0/1828659607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05000f49a0 0x7f05000f7550 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:36.273 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.271+0000 7f050584b700 1 --2- 172.21.15.26:0/1828659607 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05000f5340 0x7f05000f59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:36.273 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.271+0000 7f050584b700 1 -- 172.21.15.26:0/1828659607 >> 172.21.15.26:0/1828659607 conn(0x7f05000f04c0 msgr2=0x7f05000fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:29:36.273 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.271+0000 7f050584b700 1 -- 172.21.15.26:0/1828659607 shutdown_connections 2021-11-03T18:29:36.274 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.271+0000 7f050584b700 1 -- 172.21.15.26:0/1828659607 wait complete. 2021-11-03T18:29:36.279 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:29:36.372 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.371+0000 7f5adf4f9700 1 -- 172.21.15.26:0/147755336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ad80f5340 msgr2=0x7f5ad80f7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:29:36.372 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.371+0000 7f5adf4f9700 1 --2- 172.21.15.26:0/147755336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ad80f5340 0x7f5ad80f7ac0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 rx=0x7f5acc004660 tx=0x7f5acc009b30).stop 2021-11-03T18:29:36.372 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.371+0000 7f5adf4f9700 1 -- 172.21.15.26:0/147755336 shutdown_connections 2021-11-03T18:29:36.373 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.371+0000 7f5adf4f9700 1 --2- 172.21.15.26:0/147755336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ad80f5340 0x7f5ad80f7ac0 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:36.373 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.371+0000 7f5adf4f9700 1 --2- 172.21.15.26:0/147755336 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ad80f49a0 0x7f5ad80f4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:36.373 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.371+0000 7f5adf4f9700 1 -- 172.21.15.26:0/147755336 >> 172.21.15.26:0/147755336 conn(0x7f5ad80f04c0 msgr2=0x7f5ad80f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:29:36.373 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.371+0000 7f5adf4f9700 1 -- 172.21.15.26:0/147755336 shutdown_connections 2021-11-03T18:29:36.373 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.371+0000 7f5adf4f9700 1 -- 172.21.15.26:0/147755336 wait complete. 2021-11-03T18:29:36.374 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.371+0000 7f5adf4f9700 1 Processor -- start 2021-11-03T18:29:36.374 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.372+0000 7f5adf4f9700 1 -- start start 2021-11-03T18:29:36.374 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.372+0000 7f5adf4f9700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ad80f49a0 0x7f5ad8107050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:29:36.374 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.372+0000 7f5adf4f9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ad80f5340 0x7f5ad8107540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:29:36.375 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.372+0000 7f5adf4f9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad8107af0 con 0x7f5ad80f5340 2021-11-03T18:29:36.375 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.372+0000 7f5adf4f9700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad8107c30 con 0x7f5ad80f49a0 2021-11-03T18:29:36.375 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.372+0000 7f5adca94700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ad80f5340 0x7f5ad8107540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:29:36.376 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.372+0000 7f5adca94700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ad80f5340 0x7f5ad8107540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60336/0 (socket says 172.21.15.26:60336) 2021-11-03T18:29:36.376 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.372+0000 7f5adca94700 1 -- 172.21.15.26:0/2960782313 learned_addr learned my addr 172.21.15.26:0/2960782313 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:29:36.376 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.372+0000 7f5add295700 1 --2- 172.21.15.26:0/2960782313 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ad80f49a0 0x7f5ad8107050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:29:36.377 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.372+0000 7f5adca94700 1 -- 172.21.15.26:0/2960782313 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ad80f49a0 msgr2=0x7f5ad8107050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:29:36.377 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.372+0000 7f5adca94700 1 --2- 172.21.15.26:0/2960782313 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ad80f49a0 0x7f5ad8107050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:36.377 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.372+0000 7f5adca94700 1 -- 172.21.15.26:0/2960782313 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5acc005040 con 0x7f5ad80f5340 2021-11-03T18:29:36.377 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.372+0000 7f5adca94700 1 --2- 172.21.15.26:0/2960782313 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ad80f5340 0x7f5ad8107540 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 rx=0x7f5acc009d80 tx=0x7f5acc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:29:36.378 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.372+0000 7f5ad5ffb700 1 -- 172.21.15.26:0/2960782313 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5acc018070 con 0x7f5ad80f5340 2021-11-03T18:29:36.378 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.372+0000 7f5ad5ffb700 1 -- 172.21.15.26:0/2960782313 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5acc007ba0 con 0x7f5ad80f5340 2021-11-03T18:29:36.378 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.372+0000 7f5adf4f9700 1 -- 172.21.15.26:0/2960782313 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad8108570 con 0x7f5ad80f5340 2021-11-03T18:29:36.378 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.372+0000 7f5ad5ffb700 1 -- 172.21.15.26:0/2960782313 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5acc01c620 con 0x7f5ad80f5340 2021-11-03T18:29:36.378 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.373+0000 7f5adf4f9700 1 -- 172.21.15.26:0/2960782313 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad8108ad0 con 0x7f5ad80f5340 2021-11-03T18:29:36.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.374+0000 7f5adf4f9700 1 -- 172.21.15.26:0/2960782313 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ad8045ad0 con 0x7f5ad80f5340 2021-11-03T18:29:36.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.374+0000 7f5ad5ffb700 1 -- 172.21.15.26:0/2960782313 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f5acc01d420 con 0x7f5ad80f5340 2021-11-03T18:29:36.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.374+0000 7f5ad5ffb700 1 --2- 172.21.15.26:0/2960782313 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5ac00640b0 0x7f5ac0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:29:36.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.375+0000 7f5ad5ffb700 1 -- 172.21.15.26:0/2960782313 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f5acc082500 con 0x7f5ad80f5340 2021-11-03T18:29:36.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.375+0000 7f5add295700 1 --2- 172.21.15.26:0/2960782313 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5ac00640b0 0x7f5ac0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:29:36.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.375+0000 7f5add295700 1 --2- 172.21.15.26:0/2960782313 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5ac00640b0 0x7f5ac0066570 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7f5ad805eb60 tx=0x7f5ad0009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:29:36.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.379+0000 7f5ad5ffb700 1 -- 172.21.15.26:0/2960782313 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f5acc054800 con 0x7f5ad80f5340 2021-11-03T18:29:36.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.554+0000 7f5adf4f9700 1 -- 172.21.15.26:0/2960782313 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ad80fefd0 con 0x7f5ac00640b0 2021-11-03T18:29:36.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.569+0000 7f5ad5ffb700 1 -- 172.21.15.26:0/2960782313 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7f5ad80fefd0 con 0x7f5ac00640b0 2021-11-03T18:29:36.569 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:29:36.569 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (100m) 9m ago 102m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:29:36.569 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (93m) 9m ago 102m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:29:36.569 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (92m) 8m ago 101m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:29:36.570 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (100m) 9m ago 101m 42.2M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:29:36.570 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (93m) 9m ago 97m 26.0M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:29:36.570 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (94m) 9m ago 97m 26.6M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:29:36.570 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (97m) 8m ago 97m 26.8M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:29:36.571 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (97m) 8m ago 97m 27.2M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:29:36.571 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (94m) 9m ago 103m 588M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:29:36.571 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (94m) 8m ago 101m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:29:36.571 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (93m) 9m ago 103m 341M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:29:36.572 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (93m) 8m ago 101m 158M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:29:36.572 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (101m) 9m ago 101m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:29:36.572 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (101m) 8m ago 101m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:29:36.572 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (92m) 9m ago 100m 332M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:29:36.572 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (92m) 9m ago 100m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:29:36.573 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (91m) 9m ago 99m 296M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:29:36.573 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (91m) 8m ago 99m 387M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:29:36.573 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (90m) 8m ago 99m 320M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:29:36.573 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (90m) 8m ago 98m 316M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:29:36.574 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (100m) 9m ago 101m 65.7M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:29:36.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.571+0000 7f5adf4f9700 1 -- 172.21.15.26:0/2960782313 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5ac00640b0 msgr2=0x7f5ac0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:29:36.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.571+0000 7f5adf4f9700 1 --2- 172.21.15.26:0/2960782313 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5ac00640b0 0x7f5ac0066570 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7f5ad805eb60 tx=0x7f5ad0009040).stop 2021-11-03T18:29:36.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.571+0000 7f5adf4f9700 1 -- 172.21.15.26:0/2960782313 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ad80f5340 msgr2=0x7f5ad8107540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:29:36.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.571+0000 7f5adf4f9700 1 --2- 172.21.15.26:0/2960782313 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ad80f5340 0x7f5ad8107540 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 rx=0x7f5acc009d80 tx=0x7f5acc009b30).stop 2021-11-03T18:29:36.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.571+0000 7f5adf4f9700 1 -- 172.21.15.26:0/2960782313 shutdown_connections 2021-11-03T18:29:36.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.571+0000 7f5adf4f9700 1 --2- 172.21.15.26:0/2960782313 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5ac00640b0 0x7f5ac0066570 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:36.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.571+0000 7f5adf4f9700 1 --2- 172.21.15.26:0/2960782313 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ad80f49a0 0x7f5ad8107050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:36.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.571+0000 7f5adf4f9700 1 --2- 172.21.15.26:0/2960782313 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ad80f5340 0x7f5ad8107540 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:36.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.571+0000 7f5adf4f9700 1 -- 172.21.15.26:0/2960782313 >> 172.21.15.26:0/2960782313 conn(0x7f5ad80f04c0 msgr2=0x7f5ad80fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:29:36.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.571+0000 7f5adf4f9700 1 -- 172.21.15.26:0/2960782313 shutdown_connections 2021-11-03T18:29:36.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.571+0000 7f5adf4f9700 1 -- 172.21.15.26:0/2960782313 wait complete. 2021-11-03T18:29:36.670 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.669+0000 7f63265e5700 1 -- 172.21.15.26:0/1236636735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63200f77d0 msgr2=0x7f63200f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:29:36.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.669+0000 7f63265e5700 1 --2- 172.21.15.26:0/1236636735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63200f77d0 0x7f63200f7c30 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 rx=0x7f63140099e0 tx=0x7f6314004d10).stop 2021-11-03T18:29:36.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.670+0000 7f63265e5700 1 -- 172.21.15.26:0/1236636735 shutdown_connections 2021-11-03T18:29:36.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.670+0000 7f63265e5700 1 --2- 172.21.15.26:0/1236636735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63200f77d0 0x7f63200f7c30 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:36.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.670+0000 7f63265e5700 1 --2- 172.21.15.26:0/1236636735 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63200f6530 0x7f63200f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:36.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.670+0000 7f63265e5700 1 -- 172.21.15.26:0/1236636735 >> 172.21.15.26:0/1236636735 conn(0x7f63200f1cd0 msgr2=0x7f63200f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:29:36.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.670+0000 7f63265e5700 1 -- 172.21.15.26:0/1236636735 shutdown_connections 2021-11-03T18:29:36.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.670+0000 7f63265e5700 1 -- 172.21.15.26:0/1236636735 wait complete. 2021-11-03T18:29:36.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.670+0000 7f63265e5700 1 Processor -- start 2021-11-03T18:29:36.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.670+0000 7f63265e5700 1 -- start start 2021-11-03T18:29:36.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.670+0000 7f63265e5700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63200f6530 0x7f632006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:29:36.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.670+0000 7f63265e5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6320069e20 0x7f632006a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:29:36.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.670+0000 7f63265e5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632006a790 con 0x7f6320069e20 2021-11-03T18:29:36.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.670+0000 7f63265e5700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632006a8d0 con 0x7f63200f6530 2021-11-03T18:29:36.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.670+0000 7f6324de2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6320069e20 0x7f632006a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:29:36.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.671+0000 7f6324de2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6320069e20 0x7f632006a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60346/0 (socket says 172.21.15.26:60346) 2021-11-03T18:29:36.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.671+0000 7f6324de2700 1 -- 172.21.15.26:0/3566288350 learned_addr learned my addr 172.21.15.26:0/3566288350 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:29:36.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.671+0000 7f63255e3700 1 --2- 172.21.15.26:0/3566288350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63200f6530 0x7f632006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:29:36.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.671+0000 7f6324de2700 1 -- 172.21.15.26:0/3566288350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63200f6530 msgr2=0x7f632006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:29:36.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.671+0000 7f6324de2700 1 --2- 172.21.15.26:0/3566288350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63200f6530 0x7f632006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:36.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.671+0000 7f6324de2700 1 -- 172.21.15.26:0/3566288350 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6314009640 con 0x7f6320069e20 2021-11-03T18:29:36.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.671+0000 7f63255e3700 1 --2- 172.21.15.26:0/3566288350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63200f6530 0x7f632006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:29:36.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.671+0000 7f6324de2700 1 --2- 172.21.15.26:0/3566288350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6320069e20 0x7f632006a2a0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7f6314004750 tx=0x7f6314004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:29:36.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.671+0000 7f631dffb700 1 -- 172.21.15.26:0/3566288350 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6314017070 con 0x7f6320069e20 2021-11-03T18:29:36.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.671+0000 7f631dffb700 1 -- 172.21.15.26:0/3566288350 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6314018040 con 0x7f6320069e20 2021-11-03T18:29:36.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.671+0000 7f63265e5700 1 -- 172.21.15.26:0/3566288350 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f632006ab20 con 0x7f6320069e20 2021-11-03T18:29:36.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.671+0000 7f631dffb700 1 -- 172.21.15.26:0/3566288350 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f631400e070 con 0x7f6320069e20 2021-11-03T18:29:36.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.671+0000 7f63265e5700 1 -- 172.21.15.26:0/3566288350 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f632010f240 con 0x7f6320069e20 2021-11-03T18:29:36.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.672+0000 7f63265e5700 1 -- 172.21.15.26:0/3566288350 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6320045ad0 con 0x7f6320069e20 2021-11-03T18:29:36.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.673+0000 7f631dffb700 1 -- 172.21.15.26:0/3566288350 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f6314007d40 con 0x7f6320069e20 2021-11-03T18:29:36.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.673+0000 7f631dffb700 1 --2- 172.21.15.26:0/3566288350 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6308064100 0x7f63080665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:29:36.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.673+0000 7f631dffb700 1 -- 172.21.15.26:0/3566288350 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f6314081ee0 con 0x7f6320069e20 2021-11-03T18:29:36.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.673+0000 7f63255e3700 1 --2- 172.21.15.26:0/3566288350 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6308064100 0x7f63080665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:29:36.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.674+0000 7f63255e3700 1 --2- 172.21.15.26:0/3566288350 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6308064100 0x7f63080665c0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7f6310009fd0 tx=0x7f631000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:29:36.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.677+0000 7f631dffb700 1 -- 172.21.15.26:0/3566288350 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f63140541e0 con 0x7f6320069e20 2021-11-03T18:29:36.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.902+0000 7f63265e5700 1 -- 172.21.15.26:0/3566288350 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f63200fedc0 con 0x7f6320069e20 2021-11-03T18:29:36.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.903+0000 7f631dffb700 1 -- 172.21.15.26:0/3566288350 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f6314053dd0 con 0x7f6320069e20 2021-11-03T18:29:36.903 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:29:36.903 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:29:36.903 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:29:36.904 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:29:36.904 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:29:36.904 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:29:36.905 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:29:36.905 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:29:36.905 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:29:36.906 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:29:36.906 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:29:36.906 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:29:36.907 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:29:36.907 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:29:36.907 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:29:36.907 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:29:36.908 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:29:36.908 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:29:36.909 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.904+0000 7f63265e5700 1 -- 172.21.15.26:0/3566288350 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6308064100 msgr2=0x7f63080665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:29:36.910 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.905+0000 7f63265e5700 1 --2- 172.21.15.26:0/3566288350 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6308064100 0x7f63080665c0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7f6310009fd0 tx=0x7f631000b040).stop 2021-11-03T18:29:36.910 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.905+0000 7f63265e5700 1 -- 172.21.15.26:0/3566288350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6320069e20 msgr2=0x7f632006a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:29:36.910 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.905+0000 7f63265e5700 1 --2- 172.21.15.26:0/3566288350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6320069e20 0x7f632006a2a0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7f6314004750 tx=0x7f6314004d10).stop 2021-11-03T18:29:36.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.905+0000 7f63265e5700 1 -- 172.21.15.26:0/3566288350 shutdown_connections 2021-11-03T18:29:36.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.905+0000 7f63265e5700 1 --2- 172.21.15.26:0/3566288350 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6308064100 0x7f63080665c0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:36.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.905+0000 7f63265e5700 1 --2- 172.21.15.26:0/3566288350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63200f6530 0x7f632006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:36.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.905+0000 7f63265e5700 1 --2- 172.21.15.26:0/3566288350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6320069e20 0x7f632006a2a0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:36.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.905+0000 7f63265e5700 1 -- 172.21.15.26:0/3566288350 >> 172.21.15.26:0/3566288350 conn(0x7f63200f1cd0 msgr2=0x7f63200fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:29:36.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.905+0000 7f63265e5700 1 -- 172.21.15.26:0/3566288350 shutdown_connections 2021-11-03T18:29:36.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:36.905+0000 7f63265e5700 1 -- 172.21.15.26:0/3566288350 wait complete. 2021-11-03T18:29:37.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.005+0000 7f9c5aa34700 1 -- 172.21.15.26:0/913519651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c540f43c0 msgr2=0x7f9c540f47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:29:37.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.005+0000 7f9c5aa34700 1 --2- 172.21.15.26:0/913519651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c540f43c0 0x7f9c540f47e0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 rx=0x7f9c44004690 tx=0x7f9c44009b30).stop 2021-11-03T18:29:37.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.005+0000 7f9c5aa34700 1 -- 172.21.15.26:0/913519651 shutdown_connections 2021-11-03T18:29:37.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.005+0000 7f9c5aa34700 1 --2- 172.21.15.26:0/913519651 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c540f4cd0 0x7f9c540fbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:37.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.005+0000 7f9c5aa34700 1 --2- 172.21.15.26:0/913519651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c540f43c0 0x7f9c540f47e0 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:37.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.005+0000 7f9c5aa34700 1 -- 172.21.15.26:0/913519651 >> 172.21.15.26:0/913519651 conn(0x7f9c540f0080 msgr2=0x7f9c540f24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:29:37.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.005+0000 7f9c5aa34700 1 -- 172.21.15.26:0/913519651 shutdown_connections 2021-11-03T18:29:37.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.005+0000 7f9c5aa34700 1 -- 172.21.15.26:0/913519651 wait complete. 2021-11-03T18:29:37.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.005+0000 7f9c5aa34700 1 Processor -- start 2021-11-03T18:29:37.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.006+0000 7f9c5aa34700 1 -- start start 2021-11-03T18:29:37.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.006+0000 7f9c5aa34700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c540f43c0 0x7f9c54106ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:29:37.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.006+0000 7f9c5aa34700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c540f4cd0 0x7f9c541073b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:29:37.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.006+0000 7f9c5aa34700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c54107960 con 0x7f9c540f43c0 2021-11-03T18:29:37.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.006+0000 7f9c5aa34700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c54107aa0 con 0x7f9c540f4cd0 2021-11-03T18:29:37.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.006+0000 7f9c53fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c540f43c0 0x7f9c54106ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:29:37.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.006+0000 7f9c53fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c540f43c0 0x7f9c54106ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60354/0 (socket says 172.21.15.26:60354) 2021-11-03T18:29:37.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.006+0000 7f9c53fff700 1 -- 172.21.15.26:0/3992225540 learned_addr learned my addr 172.21.15.26:0/3992225540 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:29:37.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.006+0000 7f9c537fe700 1 --2- 172.21.15.26:0/3992225540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c540f4cd0 0x7f9c541073b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:29:37.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.006+0000 7f9c53fff700 1 -- 172.21.15.26:0/3992225540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c540f4cd0 msgr2=0x7f9c541073b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:29:37.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.006+0000 7f9c53fff700 1 --2- 172.21.15.26:0/3992225540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c540f4cd0 0x7f9c541073b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:37.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.006+0000 7f9c53fff700 1 -- 172.21.15.26:0/3992225540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c44005040 con 0x7f9c540f43c0 2021-11-03T18:29:37.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.007+0000 7f9c53fff700 1 --2- 172.21.15.26:0/3992225540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c540f43c0 0x7f9c54106ec0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 rx=0x7f9c440079e0 tx=0x7f9c44009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:29:37.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.007+0000 7f9c50ff9700 1 -- 172.21.15.26:0/3992225540 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c44018070 con 0x7f9c540f43c0 2021-11-03T18:29:37.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.007+0000 7f9c50ff9700 1 -- 172.21.15.26:0/3992225540 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9c44013e40 con 0x7f9c540f43c0 2021-11-03T18:29:37.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.007+0000 7f9c5aa34700 1 -- 172.21.15.26:0/3992225540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c541083e0 con 0x7f9c540f43c0 2021-11-03T18:29:37.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.007+0000 7f9c50ff9700 1 -- 172.21.15.26:0/3992225540 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c4401c3c0 con 0x7f9c540f43c0 2021-11-03T18:29:37.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.007+0000 7f9c5aa34700 1 -- 172.21.15.26:0/3992225540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c54108940 con 0x7f9c540f43c0 2021-11-03T18:29:37.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.008+0000 7f9c5aa34700 1 -- 172.21.15.26:0/3992225540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c54045ad0 con 0x7f9c540f43c0 2021-11-03T18:29:37.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.008+0000 7f9c50ff9700 1 -- 172.21.15.26:0/3992225540 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f9c4401d420 con 0x7f9c540f43c0 2021-11-03T18:29:37.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.009+0000 7f9c50ff9700 1 --2- 172.21.15.26:0/3992225540 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9c400640b0 0x7f9c40066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:29:37.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.009+0000 7f9c50ff9700 1 -- 172.21.15.26:0/3992225540 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f9c44082340 con 0x7f9c540f43c0 2021-11-03T18:29:37.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.009+0000 7f9c537fe700 1 --2- 172.21.15.26:0/3992225540 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9c400640b0 0x7f9c40066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:29:37.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.009+0000 7f9c537fe700 1 --2- 172.21.15.26:0/3992225540 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9c400640b0 0x7f9c40066570 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7f9c3c004c40 tx=0x7f9c3c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:29:37.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.013+0000 7f9c50ff9700 1 -- 172.21.15.26:0/3992225540 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f9c440546a0 con 0x7f9c540f43c0 2021-11-03T18:29:37.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.220+0000 7f9c5aa34700 1 -- 172.21.15.26:0/3992225540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9c540fef40 con 0x7f9c540f43c0 2021-11-03T18:29:37.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.220+0000 7f9c50ff9700 1 -- 172.21.15.26:0/3992225540 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f9c44054290 con 0x7f9c540f43c0 2021-11-03T18:29:37.220 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:29:37.220 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:29:37.220 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:29:37.220 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:29:37.221 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:29:37.221 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:29:37.221 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:29:37.221 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:29:37.221 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:29:37.222 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:29:37.222 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:29:37.222 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:29:37.222 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:29:37.223 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:29:37.223 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:29:37.223 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:29:37.223 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:29:37.224 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:29:37.224 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:29:37.224 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:29:37.224 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:29:37.224 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:29:37.225 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:29:37.225 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:29:37.225 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:29:37.225 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:29:37.226 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:29:37.226 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:29:37.226 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:29:37.226 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:29:37.226 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:29:37.227 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:29:37.227 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:29:37.227 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:29:37.227 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:29:37.228 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:29:37.228 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:29:37.228 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:29:37.228 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:29:37.229 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.222+0000 7f9c5aa34700 1 -- 172.21.15.26:0/3992225540 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9c400640b0 msgr2=0x7f9c40066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:29:37.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.222+0000 7f9c5aa34700 1 --2- 172.21.15.26:0/3992225540 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9c400640b0 0x7f9c40066570 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7f9c3c004c40 tx=0x7f9c3c00b040).stop 2021-11-03T18:29:37.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.222+0000 7f9c5aa34700 1 -- 172.21.15.26:0/3992225540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c540f43c0 msgr2=0x7f9c54106ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:29:37.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.222+0000 7f9c5aa34700 1 --2- 172.21.15.26:0/3992225540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c540f43c0 0x7f9c54106ec0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 rx=0x7f9c440079e0 tx=0x7f9c44009b30).stop 2021-11-03T18:29:37.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.222+0000 7f9c5aa34700 1 -- 172.21.15.26:0/3992225540 shutdown_connections 2021-11-03T18:29:37.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.222+0000 7f9c5aa34700 1 --2- 172.21.15.26:0/3992225540 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9c400640b0 0x7f9c40066570 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:37.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.222+0000 7f9c5aa34700 1 --2- 172.21.15.26:0/3992225540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c540f43c0 0x7f9c54106ec0 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:37.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.222+0000 7f9c5aa34700 1 --2- 172.21.15.26:0/3992225540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c540f4cd0 0x7f9c541073b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:29:37.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.222+0000 7f9c5aa34700 1 -- 172.21.15.26:0/3992225540 >> 172.21.15.26:0/3992225540 conn(0x7f9c540f0080 msgr2=0x7f9c540f8790 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:29:37.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.222+0000 7f9c5aa34700 1 -- 172.21.15.26:0/3992225540 shutdown_connections 2021-11-03T18:29:37.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:29:37.222+0000 7f9c5aa34700 1 -- 172.21.15.26:0/3992225540 wait complete. 2021-11-03T18:29:37.232 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:29:37.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:37 smithi026 ceph-mon[96795]: pgmap v2848: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:37.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:37 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3566288350' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:29:37.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:37 smithi194 ceph-mon[65619]: pgmap v2848: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:37.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:37 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3566288350' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:29:38.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:38 smithi026 ceph-mon[96795]: from='client.37068 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:29:38.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:38 smithi026 ceph-mon[96795]: from='client.37072 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:29:38.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:38 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3992225540' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:29:38.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:38 smithi194 ceph-mon[65619]: from='client.37068 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:29:38.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:38 smithi194 ceph-mon[65619]: from='client.37072 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:29:38.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:38 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3992225540' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:29:39.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:39 smithi026 ceph-mon[96795]: pgmap v2849: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:39.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:39 smithi194 ceph-mon[65619]: pgmap v2849: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:41.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:41 smithi026 ceph-mon[96795]: pgmap v2850: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:41.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:41 smithi194 ceph-mon[65619]: pgmap v2850: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:43.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:43 smithi026 ceph-mon[96795]: pgmap v2851: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:43.473 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:43 smithi194 ceph-mon[65619]: pgmap v2851: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:44.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:44 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:29:44.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:44 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:29:45.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:45 smithi026 ceph-mon[96795]: pgmap v2852: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:45.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:45 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:29:45.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:45 smithi194 ceph-mon[65619]: pgmap v2852: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:45.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:45 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:29:47.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:47 smithi026 ceph-mon[96795]: pgmap v2853: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:47.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:47 smithi194 ceph-mon[65619]: pgmap v2853: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:49.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:49 smithi194 ceph-mon[65619]: pgmap v2854: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:29:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:29:49.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:49 smithi026 ceph-mon[96795]: pgmap v2854: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:49.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:29:49.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:29:51.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:51 smithi194 ceph-mon[65619]: pgmap v2855: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:51.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:51 smithi026 ceph-mon[96795]: pgmap v2855: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:53.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:53 smithi194 ceph-mon[65619]: pgmap v2856: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:53.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:53 smithi026 ceph-mon[96795]: pgmap v2856: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:55.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:55 smithi194 ceph-mon[65619]: pgmap v2857: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:55.576 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:55 smithi026 ceph-mon[96795]: pgmap v2857: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:57.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:57 smithi194 ceph-mon[65619]: pgmap v2858: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:57.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:57 smithi026 ceph-mon[96795]: pgmap v2858: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:59.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:59 smithi194 ceph-mon[65619]: pgmap v2859: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:59.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:29:59 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:29:59.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:59 smithi026 ceph-mon[96795]: pgmap v2859: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:29:59.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:29:59 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:30:00.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:00 smithi026 conmon[96772]: 2021-11-03T18:29:59.999+0000 7f27986f6700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 2 daemons have recently crashed 2021-11-03T18:30:00.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:00 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:30:00.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:00 smithi026 ceph-mon[96795]: overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 2 daemons have recently crashed 2021-11-03T18:30:00.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:00 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:30:00.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:00 smithi194 ceph-mon[65619]: overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 2 daemons have recently crashed 2021-11-03T18:30:01.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:01 smithi194 ceph-mon[65619]: pgmap v2860: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:01.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:01 smithi026 ceph-mon[96795]: pgmap v2860: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:03.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:03 smithi194 ceph-mon[65619]: pgmap v2861: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:03.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:03 smithi026 ceph-mon[96795]: pgmap v2861: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:05.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:05 smithi194 ceph-mon[65619]: pgmap v2862: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:05.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:05 smithi026 ceph-mon[96795]: pgmap v2862: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:06.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:06 smithi194 ceph-mon[65619]: pgmap v2863: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:06.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:06 smithi026 ceph-mon[96795]: pgmap v2863: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:07.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.337+0000 7f092b6da700 1 -- 172.21.15.26:0/2404570045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09240f6ff0 msgr2=0x7f09240f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:30:07.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.337+0000 7f092b6da700 1 --2- 172.21.15.26:0/2404570045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09240f6ff0 0x7f09240f7a20 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 rx=0x7f0918004660 tx=0x7f0918009b30).stop 2021-11-03T18:30:07.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.337+0000 7f092b6da700 1 -- 172.21.15.26:0/2404570045 shutdown_connections 2021-11-03T18:30:07.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.337+0000 7f092b6da700 1 --2- 172.21.15.26:0/2404570045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09240f6ff0 0x7f09240f7a20 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:30:07.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.337+0000 7f092b6da700 1 --2- 172.21.15.26:0/2404570045 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09240f66e0 0x7f09240f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:30:07.338 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.337+0000 7f092b6da700 1 -- 172.21.15.26:0/2404570045 >> 172.21.15.26:0/2404570045 conn(0x7f09240f1f00 msgr2=0x7f09240f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:30:07.338 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.337+0000 7f092b6da700 1 -- 172.21.15.26:0/2404570045 shutdown_connections 2021-11-03T18:30:07.338 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.337+0000 7f092b6da700 1 -- 172.21.15.26:0/2404570045 wait complete. 2021-11-03T18:30:07.338 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.338+0000 7f092b6da700 1 Processor -- start 2021-11-03T18:30:07.339 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.338+0000 7f092b6da700 1 -- start start 2021-11-03T18:30:07.339 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.338+0000 7f092b6da700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09240f66e0 0x7f0924106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:30:07.339 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.338+0000 7f092b6da700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09240f6ff0 0x7f0924107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:30:07.339 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.338+0000 7f092b6da700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0924107a10 con 0x7f09240f66e0 2021-11-03T18:30:07.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.338+0000 7f092b6da700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0924107b50 con 0x7f09240f6ff0 2021-11-03T18:30:07.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.338+0000 7f0929476700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09240f66e0 0x7f0924106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:30:07.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.338+0000 7f0929476700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09240f66e0 0x7f0924106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60372/0 (socket says 172.21.15.26:60372) 2021-11-03T18:30:07.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.338+0000 7f0929476700 1 -- 172.21.15.26:0/2751124127 learned_addr learned my addr 172.21.15.26:0/2751124127 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:30:07.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.338+0000 7f0928c75700 1 --2- 172.21.15.26:0/2751124127 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09240f6ff0 0x7f0924107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:30:07.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.338+0000 7f0929476700 1 -- 172.21.15.26:0/2751124127 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09240f6ff0 msgr2=0x7f0924107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:30:07.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.338+0000 7f0929476700 1 --2- 172.21.15.26:0/2751124127 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09240f6ff0 0x7f0924107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:30:07.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.338+0000 7f0929476700 1 -- 172.21.15.26:0/2751124127 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0918005040 con 0x7f09240f66e0 2021-11-03T18:30:07.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.338+0000 7f0929476700 1 --2- 172.21.15.26:0/2751124127 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09240f66e0 0x7f0924106f70 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 rx=0x7f091c00c760 tx=0x7f091c004d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:30:07.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.339+0000 7f0921ffb700 1 -- 172.21.15.26:0/2751124127 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f091c004200 con 0x7f09240f66e0 2021-11-03T18:30:07.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.339+0000 7f0921ffb700 1 -- 172.21.15.26:0/2751124127 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f091c0109c0 con 0x7f09240f66e0 2021-11-03T18:30:07.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.339+0000 7f092b6da700 1 -- 172.21.15.26:0/2751124127 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09241084f0 con 0x7f09240f66e0 2021-11-03T18:30:07.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.339+0000 7f0921ffb700 1 -- 172.21.15.26:0/2751124127 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f091c003980 con 0x7f09240f66e0 2021-11-03T18:30:07.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.339+0000 7f092b6da700 1 -- 172.21.15.26:0/2751124127 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0924108ab0 con 0x7f09240f66e0 2021-11-03T18:30:07.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.340+0000 7f092b6da700 1 -- 172.21.15.26:0/2751124127 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0924045ad0 con 0x7f09240f66e0 2021-11-03T18:30:07.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.341+0000 7f0921ffb700 1 -- 172.21.15.26:0/2751124127 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f091c018020 con 0x7f09240f66e0 2021-11-03T18:30:07.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.341+0000 7f0921ffb700 1 --2- 172.21.15.26:0/2751124127 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f090c0640b0 0x7f090c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:30:07.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.341+0000 7f0921ffb700 1 -- 172.21.15.26:0/2751124127 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f091c080a70 con 0x7f09240f66e0 2021-11-03T18:30:07.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.341+0000 7f0928c75700 1 --2- 172.21.15.26:0/2751124127 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f090c0640b0 0x7f090c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:30:07.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.342+0000 7f0928c75700 1 --2- 172.21.15.26:0/2751124127 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f090c0640b0 0x7f090c066570 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7f0918004630 tx=0x7f0918009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:30:07.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.345+0000 7f0921ffb700 1 -- 172.21.15.26:0/2751124127 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f091c052d60 con 0x7f09240f66e0 2021-11-03T18:30:07.521 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.524+0000 7f092b6da700 1 -- 172.21.15.26:0/2751124127 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0924108de0 con 0x7f090c0640b0 2021-11-03T18:30:07.523 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.525+0000 7f0921ffb700 1 -- 172.21.15.26:0/2751124127 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f0924108de0 con 0x7f090c0640b0 2021-11-03T18:30:07.525 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.527+0000 7f092b6da700 1 -- 172.21.15.26:0/2751124127 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f090c0640b0 msgr2=0x7f090c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:30:07.525 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.527+0000 7f092b6da700 1 --2- 172.21.15.26:0/2751124127 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f090c0640b0 0x7f090c066570 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7f0918004630 tx=0x7f0918009b30).stop 2021-11-03T18:30:07.525 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.527+0000 7f092b6da700 1 -- 172.21.15.26:0/2751124127 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09240f66e0 msgr2=0x7f0924106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:30:07.525 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.527+0000 7f092b6da700 1 --2- 172.21.15.26:0/2751124127 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09240f66e0 0x7f0924106f70 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 rx=0x7f091c00c760 tx=0x7f091c004d20).stop 2021-11-03T18:30:07.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.527+0000 7f092b6da700 1 -- 172.21.15.26:0/2751124127 shutdown_connections 2021-11-03T18:30:07.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.527+0000 7f092b6da700 1 --2- 172.21.15.26:0/2751124127 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f090c0640b0 0x7f090c066570 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:30:07.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.527+0000 7f092b6da700 1 --2- 172.21.15.26:0/2751124127 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09240f66e0 0x7f0924106f70 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:30:07.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.527+0000 7f092b6da700 1 --2- 172.21.15.26:0/2751124127 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09240f6ff0 0x7f0924107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:30:07.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.527+0000 7f092b6da700 1 -- 172.21.15.26:0/2751124127 >> 172.21.15.26:0/2751124127 conn(0x7f09240f1f00 msgr2=0x7f09240fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:30:07.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.527+0000 7f092b6da700 1 -- 172.21.15.26:0/2751124127 shutdown_connections 2021-11-03T18:30:07.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.527+0000 7f092b6da700 1 -- 172.21.15.26:0/2751124127 wait complete. 2021-11-03T18:30:07.534 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:30:07.627 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.627+0000 7fbcc540a700 1 -- 172.21.15.26:0/1598710991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbcc00f96c0 msgr2=0x7fbcc00fbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:30:07.627 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.627+0000 7fbcc540a700 1 --2- 172.21.15.26:0/1598710991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbcc00f96c0 0x7fbcc00fbb10 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 rx=0x7fbcb4004660 tx=0x7fbcb4009b30).stop 2021-11-03T18:30:07.627 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.627+0000 7fbcc540a700 1 -- 172.21.15.26:0/1598710991 shutdown_connections 2021-11-03T18:30:07.627 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.627+0000 7fbcc540a700 1 --2- 172.21.15.26:0/1598710991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbcc00f96c0 0x7fbcc00fbb10 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:30:07.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.627+0000 7fbcc540a700 1 --2- 172.21.15.26:0/1598710991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbcc0060310 0x7fbcc00f9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:30:07.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.627+0000 7fbcc540a700 1 -- 172.21.15.26:0/1598710991 >> 172.21.15.26:0/1598710991 conn(0x7fbcc00f0bc0 msgr2=0x7fbcc00f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:30:07.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.627+0000 7fbcc540a700 1 -- 172.21.15.26:0/1598710991 shutdown_connections 2021-11-03T18:30:07.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.627+0000 7fbcc540a700 1 -- 172.21.15.26:0/1598710991 wait complete. 2021-11-03T18:30:07.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.627+0000 7fbcc540a700 1 Processor -- start 2021-11-03T18:30:07.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.627+0000 7fbcc540a700 1 -- start start 2021-11-03T18:30:07.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.627+0000 7fbcc540a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbcc0060310 0x7fbcc00f6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:30:07.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.627+0000 7fbcc540a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbcc00f96c0 0x7fbcc00f5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:30:07.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.627+0000 7fbcc540a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc00f55a0 con 0x7fbcc0060310 2021-11-03T18:30:07.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.627+0000 7fbcc540a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc00f56e0 con 0x7fbcc00f96c0 2021-11-03T18:30:07.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.628+0000 7fbcbeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbcc0060310 0x7fbcc00f6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:30:07.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.628+0000 7fbcbeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbcc0060310 0x7fbcc00f6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60382/0 (socket says 172.21.15.26:60382) 2021-11-03T18:30:07.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.628+0000 7fbcbeffd700 1 -- 172.21.15.26:0/3515001258 learned_addr learned my addr 172.21.15.26:0/3515001258 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:30:07.631 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.628+0000 7fbcbeffd700 1 -- 172.21.15.26:0/3515001258 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbcc00f96c0 msgr2=0x7fbcc00f5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:30:07.631 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.628+0000 7fbcbeffd700 1 --2- 172.21.15.26:0/3515001258 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbcc00f96c0 0x7fbcc00f5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:30:07.631 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.628+0000 7fbcbeffd700 1 -- 172.21.15.26:0/3515001258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb4005040 con 0x7fbcc0060310 2021-11-03T18:30:07.631 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.628+0000 7fbcbeffd700 1 --2- 172.21.15.26:0/3515001258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbcc0060310 0x7fbcc00f6bc0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 rx=0x7fbcb800c760 tx=0x7fbcb8004d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:30:07.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.628+0000 7fbca77fe700 1 -- 172.21.15.26:0/3515001258 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcb8004200 con 0x7fbcc0060310 2021-11-03T18:30:07.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.628+0000 7fbca77fe700 1 -- 172.21.15.26:0/3515001258 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbcb80109c0 con 0x7fbcc0060310 2021-11-03T18:30:07.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.628+0000 7fbcc540a700 1 -- 172.21.15.26:0/3515001258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcc00f59c0 con 0x7fbcc0060310 2021-11-03T18:30:07.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.628+0000 7fbca77fe700 1 -- 172.21.15.26:0/3515001258 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcb8003920 con 0x7fbcc0060310 2021-11-03T18:30:07.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.628+0000 7fbcc540a700 1 -- 172.21.15.26:0/3515001258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcc010edc0 con 0x7fbcc0060310 2021-11-03T18:30:07.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.629+0000 7fbcc540a700 1 -- 172.21.15.26:0/3515001258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcc0045ad0 con 0x7fbcc0060310 2021-11-03T18:30:07.634 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.630+0000 7fbca77fe700 1 -- 172.21.15.26:0/3515001258 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fbcb8018020 con 0x7fbcc0060310 2021-11-03T18:30:07.634 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.630+0000 7fbca77fe700 1 --2- 172.21.15.26:0/3515001258 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbca8064100 0x7fbca80665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:30:07.634 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.630+0000 7fbca77fe700 1 -- 172.21.15.26:0/3515001258 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fbcb80806d0 con 0x7fbcc0060310 2021-11-03T18:30:07.635 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.630+0000 7fbcbe7fc700 1 --2- 172.21.15.26:0/3515001258 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbca8064100 0x7fbca80665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:30:07.635 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.631+0000 7fbcbe7fc700 1 --2- 172.21.15.26:0/3515001258 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbca8064100 0x7fbca80665c0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7fbcb4009f50 tx=0x7fbcb4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:30:07.635 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.634+0000 7fbca77fe700 1 -- 172.21.15.26:0/3515001258 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fbcb8052940 con 0x7fbcc0060310 2021-11-03T18:30:07.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.806+0000 7fbcc540a700 1 -- 172.21.15.26:0/3515001258 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbcc00fee60 con 0x7fbca8064100 2021-11-03T18:30:07.819 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.821+0000 7fbca77fe700 1 -- 172.21.15.26:0/3515001258 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7fbcc00fee60 con 0x7fbca8064100 2021-11-03T18:30:07.819 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:30:07.819 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (101m) 9m ago 102m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:30:07.820 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (93m) 9m ago 102m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:30:07.820 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (93m) 8m ago 101m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:30:07.820 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (101m) 9m ago 102m 42.2M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:30:07.820 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (94m) 9m ago 97m 26.0M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:30:07.821 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (94m) 9m ago 97m 26.6M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:30:07.821 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (97m) 8m ago 97m 26.8M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:30:07.821 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (97m) 8m ago 97m 27.2M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:30:07.821 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (95m) 9m ago 103m 588M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:30:07.821 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (94m) 8m ago 101m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:30:07.822 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (94m) 9m ago 104m 341M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:30:07.822 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (94m) 8m ago 101m 158M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:30:07.822 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (102m) 9m ago 102m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:30:07.822 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (101m) 8m ago 101m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:30:07.823 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (93m) 9m ago 101m 332M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:30:07.823 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (92m) 9m ago 100m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:30:07.823 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (92m) 9m ago 100m 296M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:30:07.823 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (91m) 8m ago 99m 387M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:30:07.823 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (91m) 8m ago 99m 320M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:30:07.824 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (90m) 8m ago 99m 316M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:30:07.824 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (101m) 9m ago 101m 65.7M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:30:07.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.823+0000 7fbcc540a700 1 -- 172.21.15.26:0/3515001258 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbca8064100 msgr2=0x7fbca80665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:30:07.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.823+0000 7fbcc540a700 1 --2- 172.21.15.26:0/3515001258 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbca8064100 0x7fbca80665c0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7fbcb4009f50 tx=0x7fbcb4009b30).stop 2021-11-03T18:30:07.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.823+0000 7fbcc540a700 1 -- 172.21.15.26:0/3515001258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbcc0060310 msgr2=0x7fbcc00f6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:30:07.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.823+0000 7fbcc540a700 1 --2- 172.21.15.26:0/3515001258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbcc0060310 0x7fbcc00f6bc0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 rx=0x7fbcb800c760 tx=0x7fbcb8004d20).stop 2021-11-03T18:30:07.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.823+0000 7fbcc540a700 1 -- 172.21.15.26:0/3515001258 shutdown_connections 2021-11-03T18:30:07.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.823+0000 7fbcc540a700 1 --2- 172.21.15.26:0/3515001258 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbca8064100 0x7fbca80665c0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:30:07.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.823+0000 7fbcc540a700 1 --2- 172.21.15.26:0/3515001258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbcc0060310 0x7fbcc00f6bc0 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:30:07.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.823+0000 7fbcc540a700 1 --2- 172.21.15.26:0/3515001258 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbcc00f96c0 0x7fbcc00f5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:30:07.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.823+0000 7fbcc540a700 1 -- 172.21.15.26:0/3515001258 >> 172.21.15.26:0/3515001258 conn(0x7fbcc00f0bc0 msgr2=0x7fbcc00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:30:07.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.823+0000 7fbcc540a700 1 -- 172.21.15.26:0/3515001258 shutdown_connections 2021-11-03T18:30:07.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.823+0000 7fbcc540a700 1 -- 172.21.15.26:0/3515001258 wait complete. 2021-11-03T18:30:07.921 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.922+0000 7f0632bcc700 1 -- 172.21.15.26:0/2851024053 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f062c0f7980 msgr2=0x7f062c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:30:07.922 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.922+0000 7f0632bcc700 1 --2- 172.21.15.26:0/2851024053 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f062c0f7980 0x7f062c0f7de0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 rx=0x7f0620004660 tx=0x7f0620009b30).stop 2021-11-03T18:30:07.922 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.922+0000 7f0632bcc700 1 -- 172.21.15.26:0/2851024053 shutdown_connections 2021-11-03T18:30:07.922 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.922+0000 7f0632bcc700 1 --2- 172.21.15.26:0/2851024053 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f062c0f7980 0x7f062c0f7de0 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:30:07.922 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.922+0000 7f0632bcc700 1 --2- 172.21.15.26:0/2851024053 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f062c0f66e0 0x7f062c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:30:07.923 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.922+0000 7f0632bcc700 1 -- 172.21.15.26:0/2851024053 >> 172.21.15.26:0/2851024053 conn(0x7f062c0f1e40 msgr2=0x7f062c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:30:07.923 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.922+0000 7f0632bcc700 1 -- 172.21.15.26:0/2851024053 shutdown_connections 2021-11-03T18:30:07.923 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.922+0000 7f0632bcc700 1 -- 172.21.15.26:0/2851024053 wait complete. 2021-11-03T18:30:07.923 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.922+0000 7f0632bcc700 1 Processor -- start 2021-11-03T18:30:07.924 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.922+0000 7f0632bcc700 1 -- start start 2021-11-03T18:30:07.924 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.923+0000 7f0632bcc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f062c0f66e0 0x7f062c106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:30:07.924 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.923+0000 7f0632bcc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f062c0f7980 0x7f062c107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:30:07.924 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.923+0000 7f0632bcc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062c107a00 con 0x7f062c0f7980 2021-11-03T18:30:07.925 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.923+0000 7f0632bcc700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062c107b40 con 0x7f062c0f66e0 2021-11-03T18:30:07.925 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.923+0000 7f062bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f062c0f7980 0x7f062c107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:30:07.925 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.923+0000 7f062bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f062c0f7980 0x7f062c107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60394/0 (socket says 172.21.15.26:60394) 2021-11-03T18:30:07.925 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.923+0000 7f062bfff700 1 -- 172.21.15.26:0/1963131232 learned_addr learned my addr 172.21.15.26:0/1963131232 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:30:07.925 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.923+0000 7f0630968700 1 --2- 172.21.15.26:0/1963131232 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f062c0f66e0 0x7f062c106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:30:07.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.923+0000 7f062bfff700 1 -- 172.21.15.26:0/1963131232 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f062c0f66e0 msgr2=0x7f062c106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:30:07.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.923+0000 7f062bfff700 1 --2- 172.21.15.26:0/1963131232 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f062c0f66e0 0x7f062c106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:30:07.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.923+0000 7f062bfff700 1 -- 172.21.15.26:0/1963131232 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0620005040 con 0x7f062c0f7980 2021-11-03T18:30:07.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.923+0000 7f0630968700 1 --2- 172.21.15.26:0/1963131232 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f062c0f66e0 0x7f062c106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:30:07.927 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.923+0000 7f062bfff700 1 --2- 172.21.15.26:0/1963131232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f062c0f7980 0x7f062c107450 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7f0620009990 tx=0x7f0620009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:30:07.927 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.923+0000 7f06297fa700 1 -- 172.21.15.26:0/1963131232 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0620018070 con 0x7f062c0f7980 2021-11-03T18:30:07.927 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.924+0000 7f0632bcc700 1 -- 172.21.15.26:0/1963131232 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f062c108480 con 0x7f062c0f7980 2021-11-03T18:30:07.927 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.924+0000 7f06297fa700 1 -- 172.21.15.26:0/1963131232 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0620007ca0 con 0x7f062c0f7980 2021-11-03T18:30:07.928 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.924+0000 7f06297fa700 1 -- 172.21.15.26:0/1963131232 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f062001c620 con 0x7f062c0f7980 2021-11-03T18:30:07.929 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.924+0000 7f0632bcc700 1 -- 172.21.15.26:0/1963131232 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f062c1089e0 con 0x7f062c0f7980 2021-11-03T18:30:07.929 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.925+0000 7f0632bcc700 1 -- 172.21.15.26:0/1963131232 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f062c045ad0 con 0x7f062c0f7980 2021-11-03T18:30:07.929 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.925+0000 7f06297fa700 1 -- 172.21.15.26:0/1963131232 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f062001d960 con 0x7f062c0f7980 2021-11-03T18:30:07.930 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.925+0000 7f06297fa700 1 --2- 172.21.15.26:0/1963131232 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f06140640b0 0x7f0614066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:30:07.930 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.925+0000 7f06297fa700 1 -- 172.21.15.26:0/1963131232 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f0620082540 con 0x7f062c0f7980 2021-11-03T18:30:07.930 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.926+0000 7f0630968700 1 --2- 172.21.15.26:0/1963131232 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f06140640b0 0x7f0614066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:30:07.930 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.926+0000 7f0630968700 1 --2- 172.21.15.26:0/1963131232 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f06140640b0 0x7f0614066570 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7f062c0f77e0 tx=0x7f0624009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:30:07.930 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:07.930+0000 7f06297fa700 1 -- 172.21.15.26:0/1963131232 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f0620054960 con 0x7f062c0f7980 2021-11-03T18:30:08.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.161+0000 7f0632bcc700 1 -- 172.21.15.26:0/1963131232 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f062c027a00 con 0x7f062c0f7980 2021-11-03T18:30:08.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.162+0000 7f06297fa700 1 -- 172.21.15.26:0/1963131232 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f0620054550 con 0x7f062c0f7980 2021-11-03T18:30:08.160 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:30:08.161 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:30:08.161 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:30:08.161 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:30:08.161 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:30:08.161 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:30:08.162 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:30:08.162 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:30:08.162 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:30:08.162 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:30:08.163 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:30:08.163 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:30:08.163 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:30:08.163 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:30:08.164 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:30:08.164 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:30:08.164 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:30:08.164 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:30:08.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.164+0000 7f0632bcc700 1 -- 172.21.15.26:0/1963131232 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f06140640b0 msgr2=0x7f0614066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:30:08.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.164+0000 7f0632bcc700 1 --2- 172.21.15.26:0/1963131232 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f06140640b0 0x7f0614066570 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7f062c0f77e0 tx=0x7f0624009040).stop 2021-11-03T18:30:08.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.164+0000 7f0632bcc700 1 -- 172.21.15.26:0/1963131232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f062c0f7980 msgr2=0x7f062c107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:30:08.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.164+0000 7f0632bcc700 1 --2- 172.21.15.26:0/1963131232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f062c0f7980 0x7f062c107450 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7f0620009990 tx=0x7f0620009b30).stop 2021-11-03T18:30:08.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.164+0000 7f0632bcc700 1 -- 172.21.15.26:0/1963131232 shutdown_connections 2021-11-03T18:30:08.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.164+0000 7f0632bcc700 1 --2- 172.21.15.26:0/1963131232 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f06140640b0 0x7f0614066570 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:30:08.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.164+0000 7f0632bcc700 1 --2- 172.21.15.26:0/1963131232 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f062c0f66e0 0x7f062c106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:30:08.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.164+0000 7f0632bcc700 1 --2- 172.21.15.26:0/1963131232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f062c0f7980 0x7f062c107450 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:30:08.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.164+0000 7f0632bcc700 1 -- 172.21.15.26:0/1963131232 >> 172.21.15.26:0/1963131232 conn(0x7f062c0f1e40 msgr2=0x7f062c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:30:08.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.164+0000 7f0632bcc700 1 -- 172.21.15.26:0/1963131232 shutdown_connections 2021-11-03T18:30:08.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.164+0000 7f0632bcc700 1 -- 172.21.15.26:0/1963131232 wait complete. 2021-11-03T18:30:08.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.265+0000 7fca6ab7d700 1 -- 172.21.15.26:0/3036900063 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca640f55c0 msgr2=0x7fca640f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:30:08.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.265+0000 7fca6ab7d700 1 --2- 172.21.15.26:0/3036900063 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca640f55c0 0x7fca640f59e0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7fca5c0099e0 tx=0x7fca5c004d10).stop 2021-11-03T18:30:08.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.265+0000 7fca6ab7d700 1 -- 172.21.15.26:0/3036900063 shutdown_connections 2021-11-03T18:30:08.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.265+0000 7fca6ab7d700 1 --2- 172.21.15.26:0/3036900063 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca640f6860 0x7fca640f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:30:08.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.265+0000 7fca6ab7d700 1 --2- 172.21.15.26:0/3036900063 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca640f55c0 0x7fca640f59e0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:30:08.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.265+0000 7fca6ab7d700 1 -- 172.21.15.26:0/3036900063 >> 172.21.15.26:0/3036900063 conn(0x7fca640f0d40 msgr2=0x7fca640f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:30:08.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.265+0000 7fca6ab7d700 1 -- 172.21.15.26:0/3036900063 shutdown_connections 2021-11-03T18:30:08.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.265+0000 7fca6ab7d700 1 -- 172.21.15.26:0/3036900063 wait complete. 2021-11-03T18:30:08.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.265+0000 7fca6ab7d700 1 Processor -- start 2021-11-03T18:30:08.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.265+0000 7fca6ab7d700 1 -- start start 2021-11-03T18:30:08.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.266+0000 7fca6ab7d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca640f55c0 0x7fca640f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:30:08.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.266+0000 7fca6ab7d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca640f6860 0x7fca640f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:30:08.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.266+0000 7fca6ab7d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca640f8100 con 0x7fca640f55c0 2021-11-03T18:30:08.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.266+0000 7fca6ab7d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca640f8240 con 0x7fca640f6860 2021-11-03T18:30:08.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.266+0000 7fca68919700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca640f55c0 0x7fca640f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:30:08.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.266+0000 7fca68919700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca640f55c0 0x7fca640f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60404/0 (socket says 172.21.15.26:60404) 2021-11-03T18:30:08.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.266+0000 7fca68919700 1 -- 172.21.15.26:0/141779160 learned_addr learned my addr 172.21.15.26:0/141779160 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:30:08.268 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.266+0000 7fca68919700 1 -- 172.21.15.26:0/141779160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca640f6860 msgr2=0x7fca640f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:30:08.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.266+0000 7fca68919700 1 --2- 172.21.15.26:0/141779160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca640f6860 0x7fca640f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:30:08.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.266+0000 7fca68919700 1 -- 172.21.15.26:0/141779160 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca5c009640 con 0x7fca640f55c0 2021-11-03T18:30:08.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.266+0000 7fca68919700 1 --2- 172.21.15.26:0/141779160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca640f55c0 0x7fca640f9720 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 rx=0x7fca5c00bb10 tx=0x7fca5c004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:30:08.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.266+0000 7fca617fa700 1 -- 172.21.15.26:0/141779160 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca5c00e070 con 0x7fca640f55c0 2021-11-03T18:30:08.270 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.266+0000 7fca617fa700 1 -- 172.21.15.26:0/141779160 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fca5c01d8d0 con 0x7fca640f55c0 2021-11-03T18:30:08.270 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.266+0000 7fca6ab7d700 1 -- 172.21.15.26:0/141779160 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca640f84c0 con 0x7fca640f55c0 2021-11-03T18:30:08.270 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.266+0000 7fca617fa700 1 -- 172.21.15.26:0/141779160 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca5c018070 con 0x7fca640f55c0 2021-11-03T18:30:08.270 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.266+0000 7fca6ab7d700 1 -- 172.21.15.26:0/141779160 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca640f89a0 con 0x7fca640f55c0 2021-11-03T18:30:08.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.267+0000 7fca6ab7d700 1 -- 172.21.15.26:0/141779160 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca64045ad0 con 0x7fca640f55c0 2021-11-03T18:30:08.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.268+0000 7fca617fa700 1 -- 172.21.15.26:0/141779160 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fca5c024060 con 0x7fca640f55c0 2021-11-03T18:30:08.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.268+0000 7fca617fa700 1 --2- 172.21.15.26:0/141779160 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fca4c064090 0x7fca4c066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:30:08.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.268+0000 7fca617fa700 1 -- 172.21.15.26:0/141779160 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fca5c082150 con 0x7fca640f55c0 2021-11-03T18:30:08.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.268+0000 7fca63fff700 1 --2- 172.21.15.26:0/141779160 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fca4c064090 0x7fca4c066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:30:08.272 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.269+0000 7fca63fff700 1 --2- 172.21.15.26:0/141779160 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fca4c064090 0x7fca4c066550 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7fca58004880 tx=0x7fca58007ae0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:30:08.272 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.273+0000 7fca617fa700 1 -- 172.21.15.26:0/141779160 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fca5c0544b0 con 0x7fca640f55c0 2021-11-03T18:30:08.477 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.479+0000 7fca6ab7d700 1 -- 172.21.15.26:0/141779160 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fca6410f660 con 0x7fca640f55c0 2021-11-03T18:30:08.478 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.480+0000 7fca617fa700 1 -- 172.21.15.26:0/141779160 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fca5c022710 con 0x7fca640f55c0 2021-11-03T18:30:08.478 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:30:08.479 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:30:08.479 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:30:08.479 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:30:08.479 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:30:08.480 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:30:08.480 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:30:08.480 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:30:08.480 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:30:08.481 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:30:08.481 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:30:08.481 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:30:08.481 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:30:08.481 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:30:08.482 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:30:08.482 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:30:08.482 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:30:08.482 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:30:08.483 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:30:08.483 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:30:08.483 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:30:08.483 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:30:08.484 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:30:08.484 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:30:08.484 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:30:08.484 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:30:08.484 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:30:08.485 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:30:08.485 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:30:08.485 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:30:08.485 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:30:08.486 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:30:08.486 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:30:08.486 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:30:08.486 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:30:08.486 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:30:08.487 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:30:08.487 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:30:08.487 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:30:08.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.482+0000 7fca6ab7d700 1 -- 172.21.15.26:0/141779160 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fca4c064090 msgr2=0x7fca4c066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:30:08.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.482+0000 7fca6ab7d700 1 --2- 172.21.15.26:0/141779160 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fca4c064090 0x7fca4c066550 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7fca58004880 tx=0x7fca58007ae0).stop 2021-11-03T18:30:08.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.482+0000 7fca6ab7d700 1 -- 172.21.15.26:0/141779160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca640f55c0 msgr2=0x7fca640f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:30:08.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.482+0000 7fca6ab7d700 1 --2- 172.21.15.26:0/141779160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca640f55c0 0x7fca640f9720 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 rx=0x7fca5c00bb10 tx=0x7fca5c004d10).stop 2021-11-03T18:30:08.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.482+0000 7fca6ab7d700 1 -- 172.21.15.26:0/141779160 shutdown_connections 2021-11-03T18:30:08.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.482+0000 7fca6ab7d700 1 --2- 172.21.15.26:0/141779160 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fca4c064090 0x7fca4c066550 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:30:08.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.482+0000 7fca6ab7d700 1 --2- 172.21.15.26:0/141779160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca640f55c0 0x7fca640f9720 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:30:08.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.482+0000 7fca6ab7d700 1 --2- 172.21.15.26:0/141779160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca640f6860 0x7fca640f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:30:08.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.482+0000 7fca6ab7d700 1 -- 172.21.15.26:0/141779160 >> 172.21.15.26:0/141779160 conn(0x7fca640f0d40 msgr2=0x7fca6405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:30:08.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.482+0000 7fca6ab7d700 1 -- 172.21.15.26:0/141779160 shutdown_connections 2021-11-03T18:30:08.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:08.482+0000 7fca6ab7d700 1 -- 172.21.15.26:0/141779160 wait complete. 2021-11-03T18:30:08.491 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:30:09.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:08 smithi194 ceph-mon[65619]: from='client.37084 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:30:09.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:08 smithi194 ceph-mon[65619]: from='client.37088 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:30:09.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:08 smithi194 ceph-mon[65619]: pgmap v2864: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:09.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:08 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1963131232' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:30:09.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:08 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/141779160' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:30:09.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:08 smithi026 ceph-mon[96795]: from='client.37084 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:30:09.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:08 smithi026 ceph-mon[96795]: from='client.37088 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:30:09.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:08 smithi026 ceph-mon[96795]: pgmap v2864: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:09.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:08 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1963131232' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:30:09.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:08 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/141779160' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:30:11.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:10 smithi194 ceph-mon[65619]: pgmap v2865: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:11.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:10 smithi026 ceph-mon[96795]: pgmap v2865: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:13.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:12 smithi194 ceph-mon[65619]: pgmap v2866: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:13.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:12 smithi026 ceph-mon[96795]: pgmap v2866: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:15.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:14 smithi194 ceph-mon[65619]: pgmap v2867: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:15.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:14 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:30:15.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:14 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:30:15.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:14 smithi026 ceph-mon[96795]: pgmap v2867: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:15.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:14 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:30:15.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:14 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:30:17.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:16 smithi194 ceph-mon[65619]: pgmap v2868: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:17.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:16 smithi026 ceph-mon[96795]: pgmap v2868: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:19.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:18 smithi194 ceph-mon[65619]: pgmap v2869: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:19.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:18 smithi026 ceph-mon[96795]: pgmap v2869: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:21.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:21 smithi194 ceph-mon[65619]: pgmap v2870: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:21.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:21 smithi026 ceph-mon[96795]: pgmap v2870: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:23.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:23 smithi026 ceph-mon[96795]: pgmap v2871: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:23.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:23 smithi194 ceph-mon[65619]: pgmap v2871: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:25.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:25 smithi026 ceph-mon[96795]: pgmap v2872: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:25.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:25 smithi194 ceph-mon[65619]: pgmap v2872: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:27.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:27 smithi026 ceph-mon[96795]: pgmap v2873: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:27.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:27 smithi194 ceph-mon[65619]: pgmap v2873: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:29.324 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:29 smithi194 ceph-mon[65619]: pgmap v2874: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:29.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:29 smithi026 ceph-mon[96795]: pgmap v2874: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:30.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:30 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:30:30.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:30 smithi026 ceph-mon[96795]: poll took 60084.257 ms: 1 events 2021-11-03T18:30:30.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:30 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:30:30.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:30 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:30:30.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:30 smithi194 ceph-mon[65619]: poll took 60084.257 ms: 1 events 2021-11-03T18:30:30.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:30 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:30:31.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:31 smithi026 ceph-mon[96795]: pgmap v2875: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:31.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:31 smithi194 ceph-mon[65619]: pgmap v2875: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:33.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:33 smithi026 ceph-mon[96795]: pgmap v2876: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:33.475 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:33 smithi194 ceph-mon[65619]: pgmap v2876: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:35.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:35 smithi194 ceph-mon[65619]: pgmap v2877: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:35.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:35 smithi194 ceph-mon[65619]: poll took 4495.629 ms: 1 events 2021-11-03T18:30:35.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:35 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:30:35.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:35 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:30:35.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:35 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:30:35.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:35 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:30:35.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:35 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:30:35.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:35 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:30:35.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:35 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:30:35.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:35 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:30:35.578 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:35 smithi026 ceph-mon[96795]: pgmap v2877: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:35.579 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:35 smithi026 ceph-mon[96795]: poll took 4495.629 ms: 1 events 2021-11-03T18:30:35.579 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:35 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:30:35.579 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:35 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:30:35.579 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:35 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:30:35.580 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:35 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:30:35.580 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:35 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:30:35.580 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:35 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:30:35.581 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:35 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:30:35.581 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:35 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:30:36.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:36 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:30:36.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:36 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:30:36.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:36 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:30:36.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:36 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:30:37.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:37 smithi194 ceph-mon[65619]: pgmap v2878: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:37.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:37 smithi026 ceph-mon[96795]: pgmap v2878: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:38.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.597+0000 7fcfaf71c700 1 -- 172.21.15.26:0/1186780256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfa80602b0 msgr2=0x7fcfa80f9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:30:38.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.597+0000 7fcfaf71c700 1 --2- 172.21.15.26:0/1186780256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfa80602b0 0x7fcfa80f9300 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 rx=0x7fcfa00099e0 tx=0x7fcfa0004d10).stop 2021-11-03T18:30:38.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.597+0000 7fcfaf71c700 1 -- 172.21.15.26:0/1186780256 shutdown_connections 2021-11-03T18:30:38.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.597+0000 7fcfaf71c700 1 --2- 172.21.15.26:0/1186780256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfa80f9880 0x7fcfa80fbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:30:38.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.597+0000 7fcfaf71c700 1 --2- 172.21.15.26:0/1186780256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfa80602b0 0x7fcfa80f9300 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:30:38.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.597+0000 7fcfaf71c700 1 -- 172.21.15.26:0/1186780256 >> 172.21.15.26:0/1186780256 conn(0x7fcfa80f0d40 msgr2=0x7fcfa80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:30:38.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.597+0000 7fcfaf71c700 1 -- 172.21.15.26:0/1186780256 shutdown_connections 2021-11-03T18:30:38.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.597+0000 7fcfaf71c700 1 -- 172.21.15.26:0/1186780256 wait complete. 2021-11-03T18:30:38.600 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.598+0000 7fcfaf71c700 1 Processor -- start 2021-11-03T18:30:38.600 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.598+0000 7fcfaf71c700 1 -- start start 2021-11-03T18:30:38.601 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.598+0000 7fcfaf71c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfa80602b0 0x7fcfa80f6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:30:38.601 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.598+0000 7fcfaf71c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfa80f9880 0x7fcfa80f5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:30:38.601 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.598+0000 7fcfaf71c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa80f5760 con 0x7fcfa80602b0 2021-11-03T18:30:38.601 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.598+0000 7fcfaf71c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa80f58a0 con 0x7fcfa80f9880 2021-11-03T18:30:38.602 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.598+0000 7fcfad4b8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfa80602b0 0x7fcfa80f6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:30:38.602 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.598+0000 7fcfad4b8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfa80602b0 0x7fcfa80f6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60422/0 (socket says 172.21.15.26:60422) 2021-11-03T18:30:38.602 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.598+0000 7fcfad4b8700 1 -- 172.21.15.26:0/281555523 learned_addr learned my addr 172.21.15.26:0/281555523 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:30:38.602 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.598+0000 7fcfaccb7700 1 --2- 172.21.15.26:0/281555523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfa80f9880 0x7fcfa80f5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:30:38.603 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.598+0000 7fcfad4b8700 1 -- 172.21.15.26:0/281555523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfa80f9880 msgr2=0x7fcfa80f5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:30:38.603 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.598+0000 7fcfad4b8700 1 --2- 172.21.15.26:0/281555523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfa80f9880 0x7fcfa80f5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:30:38.603 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.598+0000 7fcfad4b8700 1 -- 172.21.15.26:0/281555523 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa0009640 con 0x7fcfa80602b0 2021-11-03T18:30:38.603 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.599+0000 7fcfad4b8700 1 --2- 172.21.15.26:0/281555523 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfa80602b0 0x7fcfa80f6d80 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7fcfa0004b70 tx=0x7fcfa0004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:30:38.603 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.599+0000 7fcfa5ffb700 1 -- 172.21.15.26:0/281555523 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfa000e030 con 0x7fcfa80602b0 2021-11-03T18:30:38.604 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.599+0000 7fcfa5ffb700 1 -- 172.21.15.26:0/281555523 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcfa00049b0 con 0x7fcfa80602b0 2021-11-03T18:30:38.604 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.599+0000 7fcfaf71c700 1 -- 172.21.15.26:0/281555523 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa80f5b20 con 0x7fcfa80602b0 2021-11-03T18:30:38.604 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.599+0000 7fcfa5ffb700 1 -- 172.21.15.26:0/281555523 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfa0018070 con 0x7fcfa80602b0 2021-11-03T18:30:38.604 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.599+0000 7fcfaf71c700 1 -- 172.21.15.26:0/281555523 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa80f6000 con 0x7fcfa80602b0 2021-11-03T18:30:38.604 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.600+0000 7fcfaf71c700 1 -- 172.21.15.26:0/281555523 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa8045ad0 con 0x7fcfa80602b0 2021-11-03T18:30:38.605 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.600+0000 7fcfa5ffb700 1 -- 172.21.15.26:0/281555523 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fcfa001db40 con 0x7fcfa80602b0 2021-11-03T18:30:38.605 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.601+0000 7fcfa5ffb700 1 --2- 172.21.15.26:0/281555523 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcf900640b0 0x7fcf90066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:30:38.605 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.601+0000 7fcfa5ffb700 1 -- 172.21.15.26:0/281555523 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fcfa00827c0 con 0x7fcfa80602b0 2021-11-03T18:30:38.605 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.601+0000 7fcfaccb7700 1 --2- 172.21.15.26:0/281555523 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcf900640b0 0x7fcf90066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:30:38.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.601+0000 7fcfaccb7700 1 --2- 172.21.15.26:0/281555523 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcf900640b0 0x7fcf90066570 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7fcf9c0041d0 tx=0x7fcf9c009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:30:38.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.605+0000 7fcfa5ffb700 1 -- 172.21.15.26:0/281555523 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fcfa0054ac0 con 0x7fcfa80602b0 2021-11-03T18:30:38.784 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.786+0000 7fcfaf71c700 1 -- 172.21.15.26:0/281555523 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcfa80008d0 con 0x7fcf900640b0 2021-11-03T18:30:38.786 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.787+0000 7fcfa5ffb700 1 -- 172.21.15.26:0/281555523 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fcfa80008d0 con 0x7fcf900640b0 2021-11-03T18:30:38.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.789+0000 7fcfaf71c700 1 -- 172.21.15.26:0/281555523 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcf900640b0 msgr2=0x7fcf90066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:30:38.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.789+0000 7fcfaf71c700 1 --2- 172.21.15.26:0/281555523 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcf900640b0 0x7fcf90066570 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7fcf9c0041d0 tx=0x7fcf9c009040).stop 2021-11-03T18:30:38.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.789+0000 7fcfaf71c700 1 -- 172.21.15.26:0/281555523 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfa80602b0 msgr2=0x7fcfa80f6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:30:38.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.789+0000 7fcfaf71c700 1 --2- 172.21.15.26:0/281555523 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfa80602b0 0x7fcfa80f6d80 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7fcfa0004b70 tx=0x7fcfa0004d10).stop 2021-11-03T18:30:38.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.789+0000 7fcfaf71c700 1 -- 172.21.15.26:0/281555523 shutdown_connections 2021-11-03T18:30:38.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.789+0000 7fcfaf71c700 1 --2- 172.21.15.26:0/281555523 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcf900640b0 0x7fcf90066570 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:30:38.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.789+0000 7fcfaf71c700 1 --2- 172.21.15.26:0/281555523 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfa80602b0 0x7fcfa80f6d80 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:30:38.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.789+0000 7fcfaf71c700 1 --2- 172.21.15.26:0/281555523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfa80f9880 0x7fcfa80f5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:30:38.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.789+0000 7fcfaf71c700 1 -- 172.21.15.26:0/281555523 >> 172.21.15.26:0/281555523 conn(0x7fcfa80f0d40 msgr2=0x7fcfa80f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:30:38.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.789+0000 7fcfaf71c700 1 -- 172.21.15.26:0/281555523 shutdown_connections 2021-11-03T18:30:38.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.789+0000 7fcfaf71c700 1 -- 172.21.15.26:0/281555523 wait complete. 2021-11-03T18:30:38.797 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:30:38.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.889+0000 7f8aa8bf4700 1 -- 172.21.15.26:0/320260837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8aa40f55c0 msgr2=0x7f8aa40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:30:38.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.889+0000 7f8aa8bf4700 1 --2- 172.21.15.26:0/320260837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8aa40f55c0 0x7f8aa40f59e0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 rx=0x7f8a9c004660 tx=0x7f8a9c009b30).stop 2021-11-03T18:30:38.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.889+0000 7f8aa8bf4700 1 -- 172.21.15.26:0/320260837 shutdown_connections 2021-11-03T18:30:38.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.889+0000 7f8aa8bf4700 1 --2- 172.21.15.26:0/320260837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8aa40f6860 0x7f8aa40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:30:38.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.889+0000 7f8aa8bf4700 1 --2- 172.21.15.26:0/320260837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8aa40f55c0 0x7f8aa40f59e0 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:30:38.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.889+0000 7f8aa8bf4700 1 -- 172.21.15.26:0/320260837 >> 172.21.15.26:0/320260837 conn(0x7f8aa40f0d40 msgr2=0x7f8aa40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:30:38.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.889+0000 7f8aa8bf4700 1 -- 172.21.15.26:0/320260837 shutdown_connections 2021-11-03T18:30:38.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.889+0000 7f8aa8bf4700 1 -- 172.21.15.26:0/320260837 wait complete. 2021-11-03T18:30:38.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.889+0000 7f8aa8bf4700 1 Processor -- start 2021-11-03T18:30:38.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.889+0000 7f8aa8bf4700 1 -- start start 2021-11-03T18:30:38.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.890+0000 7f8aa8bf4700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8aa40f55c0 0x7f8aa4106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:30:38.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.890+0000 7f8aa8bf4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8aa40f6860 0x7f8aa4107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:30:38.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.890+0000 7f8aa8bf4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa4107a10 con 0x7f8aa40f6860 2021-11-03T18:30:38.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.890+0000 7f8aa8bf4700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa4107b50 con 0x7f8aa40f55c0 2021-11-03T18:30:38.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.890+0000 7f8aa1d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8aa40f6860 0x7f8aa4107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:30:38.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.890+0000 7f8aa1d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8aa40f6860 0x7f8aa4107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60434/0 (socket says 172.21.15.26:60434) 2021-11-03T18:30:38.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.890+0000 7f8aa1d9b700 1 -- 172.21.15.26:0/3042179836 learned_addr learned my addr 172.21.15.26:0/3042179836 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:30:38.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.890+0000 7f8aa259c700 1 --2- 172.21.15.26:0/3042179836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8aa40f55c0 0x7f8aa4106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:30:38.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.890+0000 7f8aa1d9b700 1 -- 172.21.15.26:0/3042179836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8aa40f55c0 msgr2=0x7f8aa4106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:30:38.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.890+0000 7f8aa1d9b700 1 --2- 172.21.15.26:0/3042179836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8aa40f55c0 0x7f8aa4106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:30:38.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.890+0000 7f8aa1d9b700 1 -- 172.21.15.26:0/3042179836 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a9c005040 con 0x7f8aa40f6860 2021-11-03T18:30:38.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.890+0000 7f8aa259c700 1 --2- 172.21.15.26:0/3042179836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8aa40f55c0 0x7f8aa4106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:30:38.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.890+0000 7f8aa1d9b700 1 --2- 172.21.15.26:0/3042179836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8aa40f6860 0x7f8aa4107460 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 rx=0x7f8a9800c790 tx=0x7f8a98007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:30:38.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.890+0000 7f8a92ffd700 1 -- 172.21.15.26:0/3042179836 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a9800e680 con 0x7f8aa40f6860 2021-11-03T18:30:38.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.890+0000 7f8a92ffd700 1 -- 172.21.15.26:0/3042179836 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8a9800ec90 con 0x7f8aa40f6860 2021-11-03T18:30:38.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.890+0000 7f8aa8bf4700 1 -- 172.21.15.26:0/3042179836 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa41084f0 con 0x7f8aa40f6860 2021-11-03T18:30:38.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.890+0000 7f8a92ffd700 1 -- 172.21.15.26:0/3042179836 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a98013d60 con 0x7f8aa40f6860 2021-11-03T18:30:38.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.891+0000 7f8aa8bf4700 1 -- 172.21.15.26:0/3042179836 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa4108ab0 con 0x7f8aa40f6860 2021-11-03T18:30:38.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.891+0000 7f8aa8bf4700 1 -- 172.21.15.26:0/3042179836 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aa4045ad0 con 0x7f8aa40f6860 2021-11-03T18:30:38.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.892+0000 7f8a92ffd700 1 -- 172.21.15.26:0/3042179836 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f8a9801a060 con 0x7f8aa40f6860 2021-11-03T18:30:38.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.892+0000 7f8a92ffd700 1 --2- 172.21.15.26:0/3042179836 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8a8c0640b0 0x7f8a8c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:30:38.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.892+0000 7f8a92ffd700 1 -- 172.21.15.26:0/3042179836 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f8a98080ae0 con 0x7f8aa40f6860 2021-11-03T18:30:38.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.892+0000 7f8aa259c700 1 --2- 172.21.15.26:0/3042179836 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8a8c0640b0 0x7f8a8c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:30:38.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.893+0000 7f8aa259c700 1 --2- 172.21.15.26:0/3042179836 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8a8c0640b0 0x7f8a8c066570 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7f8a9c009da0 tx=0x7f8a9c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:30:38.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:38.896+0000 7f8a92ffd700 1 -- 172.21.15.26:0/3042179836 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f8a98052c30 con 0x7f8aa40f6860 2021-11-03T18:30:39.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.070+0000 7f8aa8bf4700 1 -- 172.21.15.26:0/3042179836 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8aa40faca0 con 0x7f8a8c0640b0 2021-11-03T18:30:39.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.085+0000 7f8a92ffd700 1 -- 172.21.15.26:0/3042179836 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7f8aa40faca0 con 0x7f8a8c0640b0 2021-11-03T18:30:39.084 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:30:39.084 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (101m) 4s ago 103m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:30:39.085 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (94m) 4s ago 103m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:30:39.085 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (93m) 9m ago 102m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:30:39.085 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (101m) 4s ago 102m 42.3M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:30:39.085 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (94m) 4s ago 98m 26.2M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:30:39.085 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (95m) 4s ago 98m 26.8M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:30:39.086 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (98m) 9m ago 98m 26.8M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:30:39.086 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (98m) 9m ago 98m 27.2M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:30:39.086 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (95m) 4s ago 104m 601M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:30:39.086 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (95m) 9m ago 102m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:30:39.087 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (95m) 4s ago 104m 374M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:30:39.087 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (94m) 9m ago 102m 158M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:30:39.087 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (102m) 4s ago 102m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:30:39.087 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (102m) 9m ago 102m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:30:39.088 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (93m) 4s ago 101m 352M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:30:39.088 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (93m) 4s ago 101m 379M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:30:39.088 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (92m) 4s ago 100m 314M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:30:39.088 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (92m) 9m ago 100m 387M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:30:39.088 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (91m) 9m ago 100m 320M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:30:39.089 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (91m) 9m ago 99m 316M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:30:39.089 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (101m) 4s ago 102m 68.0M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:30:39.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.086+0000 7f8aa8bf4700 1 -- 172.21.15.26:0/3042179836 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8a8c0640b0 msgr2=0x7f8a8c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:30:39.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.086+0000 7f8aa8bf4700 1 --2- 172.21.15.26:0/3042179836 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8a8c0640b0 0x7f8a8c066570 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7f8a9c009da0 tx=0x7f8a9c009b30).stop 2021-11-03T18:30:39.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.087+0000 7f8aa8bf4700 1 -- 172.21.15.26:0/3042179836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8aa40f6860 msgr2=0x7f8aa4107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:30:39.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.087+0000 7f8aa8bf4700 1 --2- 172.21.15.26:0/3042179836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8aa40f6860 0x7f8aa4107460 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 rx=0x7f8a9800c790 tx=0x7f8a98007d70).stop 2021-11-03T18:30:39.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.087+0000 7f8aa8bf4700 1 -- 172.21.15.26:0/3042179836 shutdown_connections 2021-11-03T18:30:39.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.087+0000 7f8aa8bf4700 1 --2- 172.21.15.26:0/3042179836 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8a8c0640b0 0x7f8a8c066570 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:30:39.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.087+0000 7f8aa8bf4700 1 --2- 172.21.15.26:0/3042179836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8aa40f55c0 0x7f8aa4106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:30:39.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.087+0000 7f8aa8bf4700 1 --2- 172.21.15.26:0/3042179836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8aa40f6860 0x7f8aa4107460 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:30:39.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.087+0000 7f8aa8bf4700 1 -- 172.21.15.26:0/3042179836 >> 172.21.15.26:0/3042179836 conn(0x7f8aa40f0d40 msgr2=0x7f8aa405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:30:39.094 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.087+0000 7f8aa8bf4700 1 -- 172.21.15.26:0/3042179836 shutdown_connections 2021-11-03T18:30:39.094 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.087+0000 7f8aa8bf4700 1 -- 172.21.15.26:0/3042179836 wait complete. 2021-11-03T18:30:39.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.186+0000 7f9815479700 1 -- 172.21.15.26:0/3371336730 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98100f5f60 msgr2=0x7f98100f63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:30:39.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.186+0000 7f9815479700 1 --2- 172.21.15.26:0/3371336730 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98100f5f60 0x7f98100f63e0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7f97f8004660 tx=0x7f97f8009b30).stop 2021-11-03T18:30:39.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.186+0000 7f9815479700 1 -- 172.21.15.26:0/3371336730 shutdown_connections 2021-11-03T18:30:39.186 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.186+0000 7f9815479700 1 --2- 172.21.15.26:0/3371336730 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98100f5f60 0x7f98100f63e0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:30:39.186 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.186+0000 7f9815479700 1 --2- 172.21.15.26:0/3371336730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98100f4d60 0x7f98100f5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:30:39.186 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.186+0000 7f9815479700 1 -- 172.21.15.26:0/3371336730 >> 172.21.15.26:0/3371336730 conn(0x7f98100f04c0 msgr2=0x7f98100f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:30:39.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.186+0000 7f9815479700 1 -- 172.21.15.26:0/3371336730 shutdown_connections 2021-11-03T18:30:39.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.186+0000 7f9815479700 1 -- 172.21.15.26:0/3371336730 wait complete. 2021-11-03T18:30:39.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.186+0000 7f9815479700 1 Processor -- start 2021-11-03T18:30:39.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.187+0000 7f9815479700 1 -- start start 2021-11-03T18:30:39.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.187+0000 7f9815479700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98100f4d60 0x7f9810109b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:30:39.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.187+0000 7f9815479700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98100f5f60 0x7f981010c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:30:39.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.187+0000 7f9815479700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98100f8010 con 0x7f98100f5f60 2021-11-03T18:30:39.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.187+0000 7f9815479700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98100f8150 con 0x7f98100f4d60 2021-11-03T18:30:39.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.187+0000 7f980e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98100f5f60 0x7f981010c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:30:39.193 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.187+0000 7f980e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98100f5f60 0x7f981010c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60444/0 (socket says 172.21.15.26:60444) 2021-11-03T18:30:39.193 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.187+0000 7f980e7fc700 1 -- 172.21.15.26:0/1788389547 learned_addr learned my addr 172.21.15.26:0/1788389547 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:30:39.193 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.187+0000 7f980effd700 1 --2- 172.21.15.26:0/1788389547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98100f4d60 0x7f9810109b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:30:39.193 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.187+0000 7f980e7fc700 1 -- 172.21.15.26:0/1788389547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98100f4d60 msgr2=0x7f9810109b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:30:39.194 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.187+0000 7f980e7fc700 1 --2- 172.21.15.26:0/1788389547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98100f4d60 0x7f9810109b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:30:39.194 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.187+0000 7f980e7fc700 1 -- 172.21.15.26:0/1788389547 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f8005040 con 0x7f98100f5f60 2021-11-03T18:30:39.194 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.187+0000 7f980e7fc700 1 --2- 172.21.15.26:0/1788389547 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98100f5f60 0x7f981010c060 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 rx=0x7f97f8009990 tx=0x7f97f8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:30:39.195 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.187+0000 7f98077fe700 1 -- 172.21.15.26:0/1788389547 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97f8018070 con 0x7f98100f5f60 2021-11-03T18:30:39.195 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.187+0000 7f98077fe700 1 -- 172.21.15.26:0/1788389547 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f97f8007ba0 con 0x7f98100f5f60 2021-11-03T18:30:39.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.187+0000 7f9815479700 1 -- 172.21.15.26:0/1788389547 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f981010c610 con 0x7f98100f5f60 2021-11-03T18:30:39.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.188+0000 7f98077fe700 1 -- 172.21.15.26:0/1788389547 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97f801c3c0 con 0x7f98100f5f60 2021-11-03T18:30:39.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.188+0000 7f9815479700 1 -- 172.21.15.26:0/1788389547 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f981010cb40 con 0x7f98100f5f60 2021-11-03T18:30:39.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.188+0000 7f9815479700 1 -- 172.21.15.26:0/1788389547 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98100f4150 con 0x7f98100f5f60 2021-11-03T18:30:39.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.189+0000 7f98077fe700 1 -- 172.21.15.26:0/1788389547 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f97f801d420 con 0x7f98100f5f60 2021-11-03T18:30:39.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.189+0000 7f98077fe700 1 --2- 172.21.15.26:0/1788389547 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f97fc0640b0 0x7f97fc066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:30:39.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.190+0000 7f98077fe700 1 -- 172.21.15.26:0/1788389547 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f97f80824e0 con 0x7f98100f5f60 2021-11-03T18:30:39.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.190+0000 7f980effd700 1 --2- 172.21.15.26:0/1788389547 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f97fc0640b0 0x7f97fc066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:30:39.198 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.190+0000 7f980effd700 1 --2- 172.21.15.26:0/1788389547 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f97fc0640b0 0x7f97fc066570 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7f98100f7c90 tx=0x7f9808009c60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:30:39.198 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.194+0000 7f98077fe700 1 -- 172.21.15.26:0/1788389547 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f97f80548a0 con 0x7f98100f5f60 2021-11-03T18:30:39.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.424+0000 7f9815479700 1 -- 172.21.15.26:0/1788389547 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9810045ad0 con 0x7f98100f5f60 2021-11-03T18:30:39.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.425+0000 7f98077fe700 1 -- 172.21.15.26:0/1788389547 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f97f8054490 con 0x7f98100f5f60 2021-11-03T18:30:39.424 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:30:39.425 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:30:39.425 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:30:39.425 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:30:39.425 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:30:39.426 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:30:39.426 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:30:39.426 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:30:39.426 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:30:39.426 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:30:39.427 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:30:39.427 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:30:39.427 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:30:39.427 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:30:39.428 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:30:39.428 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:30:39.428 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:30:39.428 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:30:39.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.427+0000 7f9815479700 1 -- 172.21.15.26:0/1788389547 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f97fc0640b0 msgr2=0x7f97fc066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:30:39.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.427+0000 7f9815479700 1 --2- 172.21.15.26:0/1788389547 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f97fc0640b0 0x7f97fc066570 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7f98100f7c90 tx=0x7f9808009c60).stop 2021-11-03T18:30:39.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.427+0000 7f9815479700 1 -- 172.21.15.26:0/1788389547 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98100f5f60 msgr2=0x7f981010c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:30:39.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.427+0000 7f9815479700 1 --2- 172.21.15.26:0/1788389547 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98100f5f60 0x7f981010c060 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 rx=0x7f97f8009990 tx=0x7f97f8009b30).stop 2021-11-03T18:30:39.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.427+0000 7f9815479700 1 -- 172.21.15.26:0/1788389547 shutdown_connections 2021-11-03T18:30:39.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.427+0000 7f9815479700 1 --2- 172.21.15.26:0/1788389547 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f97fc0640b0 0x7f97fc066570 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:30:39.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.427+0000 7f9815479700 1 --2- 172.21.15.26:0/1788389547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98100f4d60 0x7f9810109b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:30:39.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.427+0000 7f9815479700 1 --2- 172.21.15.26:0/1788389547 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98100f5f60 0x7f981010c060 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:30:39.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.427+0000 7f9815479700 1 -- 172.21.15.26:0/1788389547 >> 172.21.15.26:0/1788389547 conn(0x7f98100f04c0 msgr2=0x7f98100fa330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:30:39.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.427+0000 7f9815479700 1 -- 172.21.15.26:0/1788389547 shutdown_connections 2021-11-03T18:30:39.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.427+0000 7f9815479700 1 -- 172.21.15.26:0/1788389547 wait complete. 2021-11-03T18:30:39.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:39 smithi194 ceph-mon[65619]: pgmap v2879: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:39.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.527+0000 7ff48d793700 1 -- 172.21.15.26:0/371779018 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4880f6700 msgr2=0x7ff4880f6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:30:39.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.527+0000 7ff48d793700 1 --2- 172.21.15.26:0/371779018 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4880f6700 0x7ff4880f6b60 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 rx=0x7ff47c004660 tx=0x7ff47c009b30).stop 2021-11-03T18:30:39.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.527+0000 7ff48d793700 1 -- 172.21.15.26:0/371779018 shutdown_connections 2021-11-03T18:30:39.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.527+0000 7ff48d793700 1 --2- 172.21.15.26:0/371779018 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4880f6700 0x7ff4880f6b60 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:30:39.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.527+0000 7ff48d793700 1 --2- 172.21.15.26:0/371779018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4880f5460 0x7ff4880f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:30:39.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.527+0000 7ff48d793700 1 -- 172.21.15.26:0/371779018 >> 172.21.15.26:0/371779018 conn(0x7ff4880f0bc0 msgr2=0x7ff4880f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:30:39.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.527+0000 7ff48d793700 1 -- 172.21.15.26:0/371779018 shutdown_connections 2021-11-03T18:30:39.530 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.527+0000 7ff48d793700 1 -- 172.21.15.26:0/371779018 wait complete. 2021-11-03T18:30:39.530 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.528+0000 7ff48d793700 1 Processor -- start 2021-11-03T18:30:39.530 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.528+0000 7ff48d793700 1 -- start start 2021-11-03T18:30:39.530 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.528+0000 7ff48d793700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4880f5460 0x7ff488106e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:30:39.531 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.528+0000 7ff48d793700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4880f6700 0x7ff488107300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:30:39.531 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.528+0000 7ff48d793700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff488107990 con 0x7ff4880f6700 2021-11-03T18:30:39.531 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.528+0000 7ff48d793700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff488108110 con 0x7ff4880f5460 2021-11-03T18:30:39.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.528+0000 7ff4867fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4880f6700 0x7ff488107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:30:39.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.528+0000 7ff4867fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4880f6700 0x7ff488107300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60454/0 (socket says 172.21.15.26:60454) 2021-11-03T18:30:39.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.528+0000 7ff4867fc700 1 -- 172.21.15.26:0/220693777 learned_addr learned my addr 172.21.15.26:0/220693777 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:30:39.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.529+0000 7ff4867fc700 1 -- 172.21.15.26:0/220693777 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4880f5460 msgr2=0x7ff488106e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:30:39.533 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.529+0000 7ff4867fc700 1 --2- 172.21.15.26:0/220693777 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4880f5460 0x7ff488106e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:30:39.533 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.529+0000 7ff4867fc700 1 -- 172.21.15.26:0/220693777 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff47c005040 con 0x7ff4880f6700 2021-11-03T18:30:39.533 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.529+0000 7ff4867fc700 1 --2- 172.21.15.26:0/220693777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4880f6700 0x7ff488107300 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 rx=0x7ff47c009990 tx=0x7ff47c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:30:39.533 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.529+0000 7ff46f7fe700 1 -- 172.21.15.26:0/220693777 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff47c018070 con 0x7ff4880f6700 2021-11-03T18:30:39.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.529+0000 7ff48d793700 1 -- 172.21.15.26:0/220693777 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff488108330 con 0x7ff4880f6700 2021-11-03T18:30:39.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.529+0000 7ff46f7fe700 1 -- 172.21.15.26:0/220693777 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff47c007ca0 con 0x7ff4880f6700 2021-11-03T18:30:39.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.529+0000 7ff46f7fe700 1 -- 172.21.15.26:0/220693777 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff47c01c620 con 0x7ff4880f6700 2021-11-03T18:30:39.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.529+0000 7ff48d793700 1 -- 172.21.15.26:0/220693777 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff488108890 con 0x7ff4880f6700 2021-11-03T18:30:39.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.530+0000 7ff48d793700 1 -- 172.21.15.26:0/220693777 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff488045ad0 con 0x7ff4880f6700 2021-11-03T18:30:39.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.530+0000 7ff46f7fe700 1 -- 172.21.15.26:0/220693777 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ff47c01d960 con 0x7ff4880f6700 2021-11-03T18:30:39.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.531+0000 7ff46f7fe700 1 --2- 172.21.15.26:0/220693777 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff470064100 0x7ff4700665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:30:39.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.531+0000 7ff46f7fe700 1 -- 172.21.15.26:0/220693777 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ff47c082540 con 0x7ff4880f6700 2021-11-03T18:30:39.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.531+0000 7ff486ffd700 1 --2- 172.21.15.26:0/220693777 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff470064100 0x7ff4700665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:30:39.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.531+0000 7ff486ffd700 1 --2- 172.21.15.26:0/220693777 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff470064100 0x7ff4700665c0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7ff488106b80 tx=0x7ff478006ab0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:30:39.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.535+0000 7ff46f7fe700 1 -- 172.21.15.26:0/220693777 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ff47c054960 con 0x7ff4880f6700 2021-11-03T18:30:39.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:39 smithi026 ceph-mon[96795]: pgmap v2879: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:39.742 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.743+0000 7ff48d793700 1 -- 172.21.15.26:0/220693777 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff488108ab0 con 0x7ff4880f6700 2021-11-03T18:30:39.743 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.744+0000 7ff46f7fe700 1 -- 172.21.15.26:0/220693777 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7ff47c054550 con 0x7ff4880f6700 2021-11-03T18:30:39.743 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:30:39.744 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:30:39.744 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:30:39.744 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:30:39.744 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:30:39.745 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:30:39.745 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:30:39.745 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:30:39.745 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:30:39.745 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:30:39.746 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:30:39.746 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:30:39.746 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:30:39.746 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:30:39.747 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:30:39.747 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:30:39.747 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:30:39.747 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:30:39.748 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:30:39.748 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:30:39.748 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:30:39.748 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:30:39.749 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:30:39.749 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:30:39.749 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:30:39.749 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:30:39.749 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:30:39.750 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:30:39.750 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:30:39.750 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:30:39.750 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:30:39.751 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:30:39.751 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:30:39.751 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:30:39.751 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:30:39.752 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:30:39.752 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:30:39.752 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:30:39.752 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:30:39.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.746+0000 7ff48d793700 1 -- 172.21.15.26:0/220693777 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff470064100 msgr2=0x7ff4700665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:30:39.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.746+0000 7ff48d793700 1 --2- 172.21.15.26:0/220693777 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff470064100 0x7ff4700665c0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7ff488106b80 tx=0x7ff478006ab0).stop 2021-11-03T18:30:39.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.746+0000 7ff48d793700 1 -- 172.21.15.26:0/220693777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4880f6700 msgr2=0x7ff488107300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:30:39.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.746+0000 7ff48d793700 1 --2- 172.21.15.26:0/220693777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4880f6700 0x7ff488107300 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 rx=0x7ff47c009990 tx=0x7ff47c009b30).stop 2021-11-03T18:30:39.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.746+0000 7ff48d793700 1 -- 172.21.15.26:0/220693777 shutdown_connections 2021-11-03T18:30:39.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.746+0000 7ff48d793700 1 --2- 172.21.15.26:0/220693777 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff470064100 0x7ff4700665c0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:30:39.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.746+0000 7ff48d793700 1 --2- 172.21.15.26:0/220693777 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4880f5460 0x7ff488106e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:30:39.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.746+0000 7ff48d793700 1 --2- 172.21.15.26:0/220693777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4880f6700 0x7ff488107300 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:30:39.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.746+0000 7ff48d793700 1 -- 172.21.15.26:0/220693777 >> 172.21.15.26:0/220693777 conn(0x7ff4880f0bc0 msgr2=0x7ff4880fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:30:39.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.746+0000 7ff48d793700 1 -- 172.21.15.26:0/220693777 shutdown_connections 2021-11-03T18:30:39.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:30:39.746+0000 7ff48d793700 1 -- 172.21.15.26:0/220693777 wait complete. 2021-11-03T18:30:39.756 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:30:40.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:40 smithi194 ceph-mon[65619]: from='client.37100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:30:40.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:40 smithi194 ceph-mon[65619]: from='client.37104 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:30:40.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:40 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1788389547' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:30:40.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:40 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/220693777' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:30:40.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:40 smithi026 ceph-mon[96795]: from='client.37100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:30:40.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:40 smithi026 ceph-mon[96795]: from='client.37104 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:30:40.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:40 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1788389547' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:30:40.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:40 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/220693777' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:30:41.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:41 smithi194 ceph-mon[65619]: pgmap v2880: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:41.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:41 smithi026 ceph-mon[96795]: pgmap v2880: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:43.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:43 smithi194 ceph-mon[65619]: pgmap v2881: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:43.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:43 smithi026 ceph-mon[96795]: pgmap v2881: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:45.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:45 smithi194 ceph-mon[65619]: pgmap v2882: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:45.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:45 smithi026 ceph-mon[96795]: pgmap v2882: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:47.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:47 smithi194 ceph-mon[65619]: pgmap v2883: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:47.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:47 smithi026 ceph-mon[96795]: pgmap v2883: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:48.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:48 smithi194 ceph-mon[65619]: pgmap v2884: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:48.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:48 smithi026 ceph-mon[96795]: pgmap v2884: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:49.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:30:49.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:30:49.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:30:49.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:30:50.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:50 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:30:50.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:50 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:30:50.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:50 smithi194 ceph-mon[65619]: pgmap v2885: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:50.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:50 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:30:50.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:50 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:30:50.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:50 smithi026 ceph-mon[96795]: pgmap v2885: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:53.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:52 smithi194 ceph-mon[65619]: pgmap v2886: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:53.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:52 smithi026 ceph-mon[96795]: pgmap v2886: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:55.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:54 smithi194 ceph-mon[65619]: pgmap v2887: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:55.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:54 smithi026 ceph-mon[96795]: pgmap v2887: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:57.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:57 smithi194 ceph-mon[65619]: pgmap v2888: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:57.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:57 smithi026 ceph-mon[96795]: pgmap v2888: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:59.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:30:59 smithi026 ceph-mon[96795]: pgmap v2889: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:30:59.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:30:59 smithi194 ceph-mon[65619]: pgmap v2889: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:01.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:01 smithi026 ceph-mon[96795]: pgmap v2890: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:01.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:01 smithi194 ceph-mon[65619]: pgmap v2890: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:03.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:03 smithi026 ceph-mon[96795]: pgmap v2891: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:03.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:03 smithi194 ceph-mon[65619]: pgmap v2891: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:05.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:05 smithi026 ceph-mon[96795]: pgmap v2892: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:05.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:05 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:31:05.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:05 smithi194 ceph-mon[65619]: pgmap v2892: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:05.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:05 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:31:06.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:06 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:31:06.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:06 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:31:07.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:07 smithi026 ceph-mon[96795]: pgmap v2893: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:07.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:07 smithi194 ceph-mon[65619]: pgmap v2893: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:09.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:09 smithi026 ceph-mon[96795]: pgmap v2894: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:09.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:09 smithi194 ceph-mon[65619]: pgmap v2894: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:09.860 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:09.862+0000 7f9257f84700 1 -- 172.21.15.26:0/3172472029 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92500f6860 msgr2=0x7f92500f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:31:09.861 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:09.862+0000 7f9257f84700 1 --2- 172.21.15.26:0/3172472029 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92500f6860 0x7f92500f6cc0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 rx=0x7f9244004660 tx=0x7f9244009b30).stop 2021-11-03T18:31:09.861 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:09.862+0000 7f9257f84700 1 -- 172.21.15.26:0/3172472029 shutdown_connections 2021-11-03T18:31:09.861 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:09.862+0000 7f9257f84700 1 --2- 172.21.15.26:0/3172472029 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92500f6860 0x7f92500f6cc0 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:09.861 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:09.862+0000 7f9257f84700 1 --2- 172.21.15.26:0/3172472029 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92500f55c0 0x7f92500f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:09.862 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:09.862+0000 7f9257f84700 1 -- 172.21.15.26:0/3172472029 >> 172.21.15.26:0/3172472029 conn(0x7f92500f0d40 msgr2=0x7f92500f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:31:09.862 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:09.862+0000 7f9257f84700 1 -- 172.21.15.26:0/3172472029 shutdown_connections 2021-11-03T18:31:09.862 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:09.862+0000 7f9257f84700 1 -- 172.21.15.26:0/3172472029 wait complete. 2021-11-03T18:31:09.862 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:09.863+0000 7f9257f84700 1 Processor -- start 2021-11-03T18:31:09.863 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:09.863+0000 7f9257f84700 1 -- start start 2021-11-03T18:31:09.865 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:09.863+0000 7f9257f84700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92500f55c0 0x7f9250105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:31:09.865 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:09.863+0000 7f9257f84700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92500f6860 0x7f92501063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:31:09.866 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:09.863+0000 7f9257f84700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92501069b0 con 0x7f92500f55c0 2021-11-03T18:31:09.866 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:09.863+0000 7f9257f84700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92501071c0 con 0x7f92500f6860 2021-11-03T18:31:09.866 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:09.863+0000 7f9255d20700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92500f55c0 0x7f9250105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:31:09.866 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:09.863+0000 7f9255d20700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92500f55c0 0x7f9250105ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60470/0 (socket says 172.21.15.26:60470) 2021-11-03T18:31:09.867 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:09.863+0000 7f9255d20700 1 -- 172.21.15.26:0/2715498123 learned_addr learned my addr 172.21.15.26:0/2715498123 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:31:09.867 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:09.863+0000 7f925551f700 1 --2- 172.21.15.26:0/2715498123 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92500f6860 0x7f92501063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:31:09.867 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:09.863+0000 7f9255d20700 1 -- 172.21.15.26:0/2715498123 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92500f6860 msgr2=0x7f92501063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:31:09.867 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:09.863+0000 7f9255d20700 1 --2- 172.21.15.26:0/2715498123 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92500f6860 0x7f92501063b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:09.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:09.863+0000 7f9255d20700 1 -- 172.21.15.26:0/2715498123 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9244005040 con 0x7f92500f55c0 2021-11-03T18:31:09.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:09.863+0000 7f925551f700 1 --2- 172.21.15.26:0/2715498123 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92500f6860 0x7f92501063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:31:09.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:09.864+0000 7f9255d20700 1 --2- 172.21.15.26:0/2715498123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92500f55c0 0x7f9250105ec0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 rx=0x7f924800c810 tx=0x7f9248004d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:31:09.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:09.864+0000 7f924e7fc700 1 -- 172.21.15.26:0/2715498123 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f924800a700 con 0x7f92500f55c0 2021-11-03T18:31:09.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:09.864+0000 7f924e7fc700 1 -- 172.21.15.26:0/2715498123 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f924800ad10 con 0x7f92500f55c0 2021-11-03T18:31:09.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:09.864+0000 7f9257f84700 1 -- 172.21.15.26:0/2715498123 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9250107440 con 0x7f92500f55c0 2021-11-03T18:31:09.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:09.864+0000 7f924e7fc700 1 -- 172.21.15.26:0/2715498123 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9248012e50 con 0x7f92500f55c0 2021-11-03T18:31:09.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:09.864+0000 7f9257f84700 1 -- 172.21.15.26:0/2715498123 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9250107a00 con 0x7f92500f55c0 2021-11-03T18:31:09.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:09.865+0000 7f9257f84700 1 -- 172.21.15.26:0/2715498123 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92500f49b0 con 0x7f92500f55c0 2021-11-03T18:31:09.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:09.865+0000 7f924e7fc700 1 -- 172.21.15.26:0/2715498123 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f9248019030 con 0x7f92500f55c0 2021-11-03T18:31:09.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:09.866+0000 7f924e7fc700 1 --2- 172.21.15.26:0/2715498123 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f92380640b0 0x7f9238066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:31:09.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:09.866+0000 7f924e7fc700 1 -- 172.21.15.26:0/2715498123 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f92480809e0 con 0x7f92500f55c0 2021-11-03T18:31:09.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:09.866+0000 7f925551f700 1 --2- 172.21.15.26:0/2715498123 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f92380640b0 0x7f9238066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:31:09.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:09.866+0000 7f925551f700 1 --2- 172.21.15.26:0/2715498123 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f92380640b0 0x7f9238066570 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7f9244004e30 tx=0x7f9244009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:31:09.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:09.870+0000 7f924e7fc700 1 -- 172.21.15.26:0/2715498123 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f9248052d00 con 0x7f92500f55c0 2021-11-03T18:31:10.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.054+0000 7f9257f84700 1 -- 172.21.15.26:0/2715498123 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f92500fde60 con 0x7f92380640b0 2021-11-03T18:31:10.053 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.055+0000 7f924e7fc700 1 -- 172.21.15.26:0/2715498123 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f92500fde60 con 0x7f92380640b0 2021-11-03T18:31:10.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.057+0000 7f9257f84700 1 -- 172.21.15.26:0/2715498123 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f92380640b0 msgr2=0x7f9238066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:31:10.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.057+0000 7f9257f84700 1 --2- 172.21.15.26:0/2715498123 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f92380640b0 0x7f9238066570 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7f9244004e30 tx=0x7f9244009b30).stop 2021-11-03T18:31:10.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.057+0000 7f9257f84700 1 -- 172.21.15.26:0/2715498123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92500f55c0 msgr2=0x7f9250105ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:31:10.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.057+0000 7f9257f84700 1 --2- 172.21.15.26:0/2715498123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92500f55c0 0x7f9250105ec0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 rx=0x7f924800c810 tx=0x7f9248004d90).stop 2021-11-03T18:31:10.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.057+0000 7f9257f84700 1 -- 172.21.15.26:0/2715498123 shutdown_connections 2021-11-03T18:31:10.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.057+0000 7f9257f84700 1 --2- 172.21.15.26:0/2715498123 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f92380640b0 0x7f9238066570 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:10.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.057+0000 7f9257f84700 1 --2- 172.21.15.26:0/2715498123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92500f55c0 0x7f9250105ec0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:10.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.057+0000 7f9257f84700 1 --2- 172.21.15.26:0/2715498123 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92500f6860 0x7f92501063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:10.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.057+0000 7f9257f84700 1 -- 172.21.15.26:0/2715498123 >> 172.21.15.26:0/2715498123 conn(0x7f92500f0d40 msgr2=0x7f92500fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:31:10.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.057+0000 7f9257f84700 1 -- 172.21.15.26:0/2715498123 shutdown_connections 2021-11-03T18:31:10.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.057+0000 7f9257f84700 1 -- 172.21.15.26:0/2715498123 wait complete. 2021-11-03T18:31:10.064 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:31:10.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.158+0000 7f87063b3700 1 -- 172.21.15.26:0/3137035815 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87000f66e0 msgr2=0x7f87000f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:31:10.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.158+0000 7f87063b3700 1 --2- 172.21.15.26:0/3137035815 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87000f66e0 0x7f87000f6b00 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 rx=0x7f86f0004660 tx=0x7f86f0009b30).stop 2021-11-03T18:31:10.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.158+0000 7f87063b3700 1 -- 172.21.15.26:0/3137035815 shutdown_connections 2021-11-03T18:31:10.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.158+0000 7f87063b3700 1 --2- 172.21.15.26:0/3137035815 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87000f7980 0x7f87000f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:10.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.158+0000 7f87063b3700 1 --2- 172.21.15.26:0/3137035815 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87000f66e0 0x7f87000f6b00 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:10.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.158+0000 7f87063b3700 1 -- 172.21.15.26:0/3137035815 >> 172.21.15.26:0/3137035815 conn(0x7f87000f1e40 msgr2=0x7f87000f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:31:10.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.158+0000 7f87063b3700 1 -- 172.21.15.26:0/3137035815 shutdown_connections 2021-11-03T18:31:10.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.158+0000 7f87063b3700 1 -- 172.21.15.26:0/3137035815 wait complete. 2021-11-03T18:31:10.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.158+0000 7f87063b3700 1 Processor -- start 2021-11-03T18:31:10.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.159+0000 7f87063b3700 1 -- start start 2021-11-03T18:31:10.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.159+0000 7f87063b3700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87000f66e0 0x7f8700106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:31:10.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.159+0000 7f87063b3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87000f7980 0x7f87001074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:31:10.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.159+0000 7f87063b3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8700107a50 con 0x7f87000f7980 2021-11-03T18:31:10.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.159+0000 7f87063b3700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8700107b90 con 0x7f87000f66e0 2021-11-03T18:31:10.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.159+0000 7f86ff7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87000f7980 0x7f87001074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:31:10.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.159+0000 7f86ff7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87000f7980 0x7f87001074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60482/0 (socket says 172.21.15.26:60482) 2021-11-03T18:31:10.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.159+0000 7f86ff7fe700 1 -- 172.21.15.26:0/3667928619 learned_addr learned my addr 172.21.15.26:0/3667928619 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:31:10.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.159+0000 7f86fffff700 1 --2- 172.21.15.26:0/3667928619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87000f66e0 0x7f8700106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:31:10.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.159+0000 7f86ff7fe700 1 -- 172.21.15.26:0/3667928619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87000f66e0 msgr2=0x7f8700106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:31:10.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.159+0000 7f86ff7fe700 1 --2- 172.21.15.26:0/3667928619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87000f66e0 0x7f8700106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:10.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.159+0000 7f86ff7fe700 1 -- 172.21.15.26:0/3667928619 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f0005040 con 0x7f87000f7980 2021-11-03T18:31:10.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.159+0000 7f86ff7fe700 1 --2- 172.21.15.26:0/3667928619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87000f7980 0x7f87001074a0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 rx=0x7f86f40026d0 tx=0x7f86f4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:31:10.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.159+0000 7f86fcff9700 1 -- 172.21.15.26:0/3667928619 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86f4009320 con 0x7f87000f7980 2021-11-03T18:31:10.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.159+0000 7f87063b3700 1 -- 172.21.15.26:0/3667928619 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8700108530 con 0x7f87000f7980 2021-11-03T18:31:10.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.159+0000 7f86fcff9700 1 -- 172.21.15.26:0/3667928619 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f86f400f040 con 0x7f87000f7980 2021-11-03T18:31:10.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.159+0000 7f86fcff9700 1 -- 172.21.15.26:0/3667928619 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86f40147e0 con 0x7f87000f7980 2021-11-03T18:31:10.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.160+0000 7f87063b3700 1 -- 172.21.15.26:0/3667928619 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8700108af0 con 0x7f87000f7980 2021-11-03T18:31:10.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.160+0000 7f87063b3700 1 -- 172.21.15.26:0/3667928619 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8700045ad0 con 0x7f87000f7980 2021-11-03T18:31:10.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.161+0000 7f86fcff9700 1 -- 172.21.15.26:0/3667928619 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f86f4009480 con 0x7f87000f7980 2021-11-03T18:31:10.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.162+0000 7f86fcff9700 1 --2- 172.21.15.26:0/3667928619 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f86e80640b0 0x7f86e8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:31:10.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.162+0000 7f86fcff9700 1 -- 172.21.15.26:0/3667928619 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f86f40811b0 con 0x7f87000f7980 2021-11-03T18:31:10.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.162+0000 7f86fffff700 1 --2- 172.21.15.26:0/3667928619 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f86e80640b0 0x7f86e8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:31:10.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.162+0000 7f86fffff700 1 --2- 172.21.15.26:0/3667928619 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f86e80640b0 0x7f86e8066570 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7f86f0009da0 tx=0x7f86f0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:31:10.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.165+0000 7f86fcff9700 1 -- 172.21.15.26:0/3667928619 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f86f4053510 con 0x7f87000f7980 2021-11-03T18:31:10.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.339+0000 7f87063b3700 1 -- 172.21.15.26:0/3667928619 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8700108d70 con 0x7f86e80640b0 2021-11-03T18:31:10.353 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.354+0000 7f86fcff9700 1 -- 172.21.15.26:0/3667928619 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7f8700108d70 con 0x7f86e80640b0 2021-11-03T18:31:10.353 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:31:10.354 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (102m) 36s ago 103m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:31:10.354 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (94m) 36s ago 103m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:31:10.355 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (94m) 9m ago 102m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:31:10.355 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (102m) 36s ago 103m 42.3M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:31:10.355 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (95m) 36s ago 98m 26.2M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:31:10.355 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (95m) 36s ago 98m 26.8M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:31:10.356 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (98m) 9m ago 98m 26.8M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:31:10.356 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (98m) 9m ago 98m 27.2M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:31:10.356 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (96m) 36s ago 104m 601M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:31:10.356 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (95m) 9m ago 102m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:31:10.357 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (95m) 36s ago 105m 374M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:31:10.357 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (95m) 9m ago 102m 158M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:31:10.357 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (103m) 36s ago 103m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:31:10.357 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (102m) 9m ago 102m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:31:10.357 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (94m) 36s ago 102m 352M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:31:10.358 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (93m) 36s ago 101m 379M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:31:10.358 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (93m) 36s ago 101m 314M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:31:10.358 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (92m) 9m ago 101m 387M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:31:10.358 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (92m) 9m ago 100m 320M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:31:10.359 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (91m) 9m ago 100m 316M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:31:10.359 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (102m) 36s ago 103m 68.0M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:31:10.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.356+0000 7f87063b3700 1 -- 172.21.15.26:0/3667928619 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f86e80640b0 msgr2=0x7f86e8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:31:10.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.356+0000 7f87063b3700 1 --2- 172.21.15.26:0/3667928619 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f86e80640b0 0x7f86e8066570 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7f86f0009da0 tx=0x7f86f0009b30).stop 2021-11-03T18:31:10.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.356+0000 7f87063b3700 1 -- 172.21.15.26:0/3667928619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87000f7980 msgr2=0x7f87001074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:31:10.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.356+0000 7f87063b3700 1 --2- 172.21.15.26:0/3667928619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87000f7980 0x7f87001074a0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 rx=0x7f86f40026d0 tx=0x7f86f4009de0).stop 2021-11-03T18:31:10.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.356+0000 7f87063b3700 1 -- 172.21.15.26:0/3667928619 shutdown_connections 2021-11-03T18:31:10.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.356+0000 7f87063b3700 1 --2- 172.21.15.26:0/3667928619 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f86e80640b0 0x7f86e8066570 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:10.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.356+0000 7f87063b3700 1 --2- 172.21.15.26:0/3667928619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87000f66e0 0x7f8700106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:10.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.356+0000 7f87063b3700 1 --2- 172.21.15.26:0/3667928619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87000f7980 0x7f87001074a0 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:10.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.356+0000 7f87063b3700 1 -- 172.21.15.26:0/3667928619 >> 172.21.15.26:0/3667928619 conn(0x7f87000f1e40 msgr2=0x7f87000fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:31:10.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.356+0000 7f87063b3700 1 -- 172.21.15.26:0/3667928619 shutdown_connections 2021-11-03T18:31:10.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.356+0000 7f87063b3700 1 -- 172.21.15.26:0/3667928619 wait complete. 2021-11-03T18:31:10.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.456+0000 7f3012293700 1 -- 172.21.15.26:0/2015397485 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f300c0f6530 msgr2=0x7f300c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:31:10.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.456+0000 7f3012293700 1 --2- 172.21.15.26:0/2015397485 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f300c0f6530 0x7f300c0f6950 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 rx=0x7f3008004660 tx=0x7f3008009b30).stop 2021-11-03T18:31:10.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.456+0000 7f3012293700 1 -- 172.21.15.26:0/2015397485 shutdown_connections 2021-11-03T18:31:10.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.456+0000 7f3012293700 1 --2- 172.21.15.26:0/2015397485 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f300c0f77d0 0x7f300c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:10.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.456+0000 7f3012293700 1 --2- 172.21.15.26:0/2015397485 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f300c0f6530 0x7f300c0f6950 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:10.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.456+0000 7f3012293700 1 -- 172.21.15.26:0/2015397485 >> 172.21.15.26:0/2015397485 conn(0x7f300c0f1c90 msgr2=0x7f300c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:31:10.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.456+0000 7f3012293700 1 -- 172.21.15.26:0/2015397485 shutdown_connections 2021-11-03T18:31:10.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.456+0000 7f3012293700 1 -- 172.21.15.26:0/2015397485 wait complete. 2021-11-03T18:31:10.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.456+0000 7f3012293700 1 Processor -- start 2021-11-03T18:31:10.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.456+0000 7f3012293700 1 -- start start 2021-11-03T18:31:10.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.457+0000 7f3012293700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f300c0f6530 0x7f300c106dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:31:10.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.457+0000 7f3012293700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f300c0f77d0 0x7f300c1072c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:31:10.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.457+0000 7f3012293700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300c1078c0 con 0x7f300c0f6530 2021-11-03T18:31:10.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.457+0000 7f3012293700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300c108100 con 0x7f300c0f77d0 2021-11-03T18:31:10.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.457+0000 7f3011291700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f300c0f6530 0x7f300c106dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:31:10.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.457+0000 7f3011291700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f300c0f6530 0x7f300c106dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60490/0 (socket says 172.21.15.26:60490) 2021-11-03T18:31:10.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.457+0000 7f3011291700 1 -- 172.21.15.26:0/814702036 learned_addr learned my addr 172.21.15.26:0/814702036 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:31:10.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.457+0000 7f3011291700 1 -- 172.21.15.26:0/814702036 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f300c0f77d0 msgr2=0x7f300c1072c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:31:10.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.457+0000 7f3010a90700 1 --2- 172.21.15.26:0/814702036 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f300c0f77d0 0x7f300c1072c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:31:10.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.457+0000 7f3011291700 1 --2- 172.21.15.26:0/814702036 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f300c0f77d0 0x7f300c1072c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:10.464 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.457+0000 7f3011291700 1 -- 172.21.15.26:0/814702036 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3008005040 con 0x7f300c0f6530 2021-11-03T18:31:10.464 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.457+0000 7f3011291700 1 --2- 172.21.15.26:0/814702036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f300c0f6530 0x7f300c106dd0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 rx=0x7f3008004f60 tx=0x7f3008009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:31:10.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.457+0000 7f3001ffb700 1 -- 172.21.15.26:0/814702036 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3008018070 con 0x7f300c0f6530 2021-11-03T18:31:10.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.457+0000 7f3012293700 1 -- 172.21.15.26:0/814702036 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f300c108380 con 0x7f300c0f6530 2021-11-03T18:31:10.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.457+0000 7f3001ffb700 1 -- 172.21.15.26:0/814702036 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3008007ba0 con 0x7f300c0f6530 2021-11-03T18:31:10.466 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.457+0000 7f3001ffb700 1 -- 172.21.15.26:0/814702036 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f300801c620 con 0x7f300c0f6530 2021-11-03T18:31:10.466 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.458+0000 7f3012293700 1 -- 172.21.15.26:0/814702036 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f300c108860 con 0x7f300c0f6530 2021-11-03T18:31:10.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.458+0000 7f3012293700 1 -- 172.21.15.26:0/814702036 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f300c059100 con 0x7f300c0f6530 2021-11-03T18:31:10.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.459+0000 7f3001ffb700 1 -- 172.21.15.26:0/814702036 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f300801c8e0 con 0x7f300c0f6530 2021-11-03T18:31:10.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.459+0000 7f3001ffb700 1 --2- 172.21.15.26:0/814702036 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2ff8064100 0x7f2ff80665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:31:10.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.459+0000 7f3001ffb700 1 -- 172.21.15.26:0/814702036 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f30080826e0 con 0x7f300c0f6530 2021-11-03T18:31:10.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.459+0000 7f3010a90700 1 --2- 172.21.15.26:0/814702036 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2ff8064100 0x7f2ff80665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:31:10.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.460+0000 7f3010a90700 1 --2- 172.21.15.26:0/814702036 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2ff8064100 0x7f2ff80665c0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7f300c106b60 tx=0x7f2ffc009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:31:10.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.464+0000 7f3001ffb700 1 -- 172.21.15.26:0/814702036 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f3008054a40 con 0x7f300c0f6530 2021-11-03T18:31:10.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.693+0000 7f3012293700 1 -- 172.21.15.26:0/814702036 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f300c045ad0 con 0x7f300c0f6530 2021-11-03T18:31:10.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.693+0000 7f3001ffb700 1 -- 172.21.15.26:0/814702036 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f3008054630 con 0x7f300c0f6530 2021-11-03T18:31:10.692 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:31:10.692 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:31:10.692 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:31:10.693 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:31:10.693 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:31:10.693 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:31:10.693 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:31:10.694 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:31:10.694 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:31:10.694 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:31:10.694 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:31:10.694 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:31:10.695 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:31:10.695 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:31:10.695 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:31:10.695 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:31:10.696 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:31:10.696 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:31:10.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.695+0000 7f3012293700 1 -- 172.21.15.26:0/814702036 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2ff8064100 msgr2=0x7f2ff80665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:31:10.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.695+0000 7f3012293700 1 --2- 172.21.15.26:0/814702036 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2ff8064100 0x7f2ff80665c0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7f300c106b60 tx=0x7f2ffc009040).stop 2021-11-03T18:31:10.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.695+0000 7f3012293700 1 -- 172.21.15.26:0/814702036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f300c0f6530 msgr2=0x7f300c106dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:31:10.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.695+0000 7f3012293700 1 --2- 172.21.15.26:0/814702036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f300c0f6530 0x7f300c106dd0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 rx=0x7f3008004f60 tx=0x7f3008009b30).stop 2021-11-03T18:31:10.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.695+0000 7f3012293700 1 -- 172.21.15.26:0/814702036 shutdown_connections 2021-11-03T18:31:10.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.695+0000 7f3012293700 1 --2- 172.21.15.26:0/814702036 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2ff8064100 0x7f2ff80665c0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:10.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.695+0000 7f3012293700 1 --2- 172.21.15.26:0/814702036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f300c0f6530 0x7f300c106dd0 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:10.699 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.695+0000 7f3012293700 1 --2- 172.21.15.26:0/814702036 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f300c0f77d0 0x7f300c1072c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:10.699 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.695+0000 7f3012293700 1 -- 172.21.15.26:0/814702036 >> 172.21.15.26:0/814702036 conn(0x7f300c0f1c90 msgr2=0x7f300c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:31:10.699 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.695+0000 7f3012293700 1 -- 172.21.15.26:0/814702036 shutdown_connections 2021-11-03T18:31:10.699 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.695+0000 7f3012293700 1 -- 172.21.15.26:0/814702036 wait complete. 2021-11-03T18:31:10.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.795+0000 7f1ee9bb8700 1 -- 172.21.15.26:0/1937231701 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ee40f77d0 msgr2=0x7f1ee40f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:31:10.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.795+0000 7f1ee9bb8700 1 --2- 172.21.15.26:0/1937231701 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ee40f77d0 0x7f1ee40f7c30 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 rx=0x7f1ed0004660 tx=0x7f1ed0009b30).stop 2021-11-03T18:31:10.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.795+0000 7f1ee9bb8700 1 -- 172.21.15.26:0/1937231701 shutdown_connections 2021-11-03T18:31:10.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.795+0000 7f1ee9bb8700 1 --2- 172.21.15.26:0/1937231701 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ee40f77d0 0x7f1ee40f7c30 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:10.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.795+0000 7f1ee9bb8700 1 --2- 172.21.15.26:0/1937231701 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ee40f6530 0x7f1ee40f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:10.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.795+0000 7f1ee9bb8700 1 -- 172.21.15.26:0/1937231701 >> 172.21.15.26:0/1937231701 conn(0x7f1ee40f1cd0 msgr2=0x7f1ee40f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:31:10.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.795+0000 7f1ee9bb8700 1 -- 172.21.15.26:0/1937231701 shutdown_connections 2021-11-03T18:31:10.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.795+0000 7f1ee9bb8700 1 -- 172.21.15.26:0/1937231701 wait complete. 2021-11-03T18:31:10.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.796+0000 7f1ee9bb8700 1 Processor -- start 2021-11-03T18:31:10.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.796+0000 7f1ee9bb8700 1 -- start start 2021-11-03T18:31:10.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.796+0000 7f1ee9bb8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ee40f6530 0x7f1ee4106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:31:10.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.796+0000 7f1ee9bb8700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ee40f77d0 0x7f1ee4107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:31:10.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.796+0000 7f1ee9bb8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee4107870 con 0x7f1ee40f6530 2021-11-03T18:31:10.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.796+0000 7f1ee9bb8700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee4108080 con 0x7f1ee40f77d0 2021-11-03T18:31:10.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.796+0000 7f1ee8bb6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ee40f6530 0x7f1ee4106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:31:10.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.796+0000 7f1ee8bb6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ee40f6530 0x7f1ee4106d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60500/0 (socket says 172.21.15.26:60500) 2021-11-03T18:31:10.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.796+0000 7f1ee8bb6700 1 -- 172.21.15.26:0/2339311126 learned_addr learned my addr 172.21.15.26:0/2339311126 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:31:10.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.796+0000 7f1ee3fff700 1 --2- 172.21.15.26:0/2339311126 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ee40f77d0 0x7f1ee4107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:31:10.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.797+0000 7f1ee8bb6700 1 -- 172.21.15.26:0/2339311126 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ee40f77d0 msgr2=0x7f1ee4107270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:31:10.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.797+0000 7f1ee8bb6700 1 --2- 172.21.15.26:0/2339311126 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ee40f77d0 0x7f1ee4107270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:10.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.797+0000 7f1ee8bb6700 1 -- 172.21.15.26:0/2339311126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed0005040 con 0x7f1ee40f6530 2021-11-03T18:31:10.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.797+0000 7f1ee8bb6700 1 --2- 172.21.15.26:0/2339311126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ee40f6530 0x7f1ee4106d80 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 rx=0x7f1ed8002700 tx=0x7f1ed8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:31:10.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.797+0000 7f1ee17fa700 1 -- 172.21.15.26:0/2339311126 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ed80079c0 con 0x7f1ee40f6530 2021-11-03T18:31:10.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.797+0000 7f1ee17fa700 1 -- 172.21.15.26:0/2339311126 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1ed800f040 con 0x7f1ee40f6530 2021-11-03T18:31:10.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.797+0000 7f1ee9bb8700 1 -- 172.21.15.26:0/2339311126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ee4108300 con 0x7f1ee40f6530 2021-11-03T18:31:10.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.797+0000 7f1ee17fa700 1 -- 172.21.15.26:0/2339311126 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ed8014860 con 0x7f1ee40f6530 2021-11-03T18:31:10.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.797+0000 7f1ee9bb8700 1 -- 172.21.15.26:0/2339311126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ee41088c0 con 0x7f1ee40f6530 2021-11-03T18:31:10.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.798+0000 7f1ee9bb8700 1 -- 172.21.15.26:0/2339311126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ee4059100 con 0x7f1ee40f6530 2021-11-03T18:31:10.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.799+0000 7f1ee17fa700 1 -- 172.21.15.26:0/2339311126 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f1ed801b060 con 0x7f1ee40f6530 2021-11-03T18:31:10.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.799+0000 7f1ee17fa700 1 --2- 172.21.15.26:0/2339311126 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1ed4064100 0x7f1ed40665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:31:10.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.799+0000 7f1ee17fa700 1 -- 172.21.15.26:0/2339311126 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f1ed8080870 con 0x7f1ee40f6530 2021-11-03T18:31:10.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.799+0000 7f1ee3fff700 1 --2- 172.21.15.26:0/2339311126 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1ed4064100 0x7f1ed40665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:31:10.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.800+0000 7f1ee3fff700 1 --2- 172.21.15.26:0/2339311126 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1ed4064100 0x7f1ed40665c0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7f1ed0004630 tx=0x7f1ed0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:31:10.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:10.803+0000 7f1ee17fa700 1 -- 172.21.15.26:0/2339311126 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f1ed8052bd0 con 0x7f1ee40f6530 2021-11-03T18:31:11.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:11.006+0000 7f1ee9bb8700 1 -- 172.21.15.26:0/2339311126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1ee4027a00 con 0x7f1ee40f6530 2021-11-03T18:31:11.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:11.006+0000 7f1ee17fa700 1 -- 172.21.15.26:0/2339311126 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f1ed8019710 con 0x7f1ee40f6530 2021-11-03T18:31:11.005 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:31:11.005 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:31:11.005 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:31:11.006 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:31:11.006 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:31:11.006 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:31:11.006 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:31:11.007 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:31:11.007 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:31:11.007 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:31:11.007 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:31:11.008 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:31:11.008 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:31:11.008 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:31:11.008 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:31:11.009 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:31:11.009 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:31:11.009 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:31:11.009 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:31:11.009 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:31:11.010 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:31:11.010 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:31:11.010 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:31:11.010 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:31:11.011 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:31:11.011 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:31:11.011 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:31:11.011 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:31:11.011 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:31:11.012 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:31:11.012 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:31:11.012 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:31:11.012 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:31:11.013 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:31:11.013 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:31:11.013 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:31:11.013 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:31:11.013 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:31:11.014 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:31:11.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:11.008+0000 7f1ee9bb8700 1 -- 172.21.15.26:0/2339311126 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1ed4064100 msgr2=0x7f1ed40665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:31:11.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:11.008+0000 7f1ee9bb8700 1 --2- 172.21.15.26:0/2339311126 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1ed4064100 0x7f1ed40665c0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7f1ed0004630 tx=0x7f1ed0009b30).stop 2021-11-03T18:31:11.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:11.008+0000 7f1ee9bb8700 1 -- 172.21.15.26:0/2339311126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ee40f6530 msgr2=0x7f1ee4106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:31:11.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:11.008+0000 7f1ee9bb8700 1 --2- 172.21.15.26:0/2339311126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ee40f6530 0x7f1ee4106d80 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 rx=0x7f1ed8002700 tx=0x7f1ed8009d80).stop 2021-11-03T18:31:11.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:11.008+0000 7f1ee9bb8700 1 -- 172.21.15.26:0/2339311126 shutdown_connections 2021-11-03T18:31:11.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:11.008+0000 7f1ee9bb8700 1 --2- 172.21.15.26:0/2339311126 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1ed4064100 0x7f1ed40665c0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:11.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:11.008+0000 7f1ee9bb8700 1 --2- 172.21.15.26:0/2339311126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ee40f6530 0x7f1ee4106d80 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:11.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:11.008+0000 7f1ee9bb8700 1 --2- 172.21.15.26:0/2339311126 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ee40f77d0 0x7f1ee4107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:11.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:11.008+0000 7f1ee9bb8700 1 -- 172.21.15.26:0/2339311126 >> 172.21.15.26:0/2339311126 conn(0x7f1ee40f1cd0 msgr2=0x7f1ee40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:31:11.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:11.008+0000 7f1ee9bb8700 1 -- 172.21.15.26:0/2339311126 shutdown_connections 2021-11-03T18:31:11.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:11.009+0000 7f1ee9bb8700 1 -- 172.21.15.26:0/2339311126 wait complete. 2021-11-03T18:31:11.017 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:31:11.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:11 smithi026 ceph-mon[96795]: pgmap v2895: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:11.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:11 smithi026 ceph-mon[96795]: from='client.37116 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:31:11.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:11 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/814702036' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:31:11.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:11 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2339311126' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:31:11.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:11 smithi194 ceph-mon[65619]: pgmap v2895: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:11.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:11 smithi194 ceph-mon[65619]: from='client.37116 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:31:11.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:11 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/814702036' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:31:11.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:11 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2339311126' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:31:12.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:12 smithi026 ceph-mon[96795]: from='client.37120 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:31:12.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:12 smithi194 ceph-mon[65619]: from='client.37120 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:31:13.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:13 smithi026 ceph-mon[96795]: pgmap v2896: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:13.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:13 smithi194 ceph-mon[65619]: pgmap v2896: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:15.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:15 smithi026 ceph-mon[96795]: pgmap v2897: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:15.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:15 smithi194 ceph-mon[65619]: pgmap v2897: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:17.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:17 smithi026 ceph-mon[96795]: pgmap v2898: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:17.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:17 smithi194 ceph-mon[65619]: pgmap v2898: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:19.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:19 smithi026 ceph-mon[96795]: pgmap v2899: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:19.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:19 smithi194 ceph-mon[65619]: pgmap v2899: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:20.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:20 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:31:20.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:20 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:31:21.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:21 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:31:21.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:21 smithi026 ceph-mon[96795]: pgmap v2900: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:21.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:21 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:31:21.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:21 smithi194 ceph-mon[65619]: pgmap v2900: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:23.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:23 smithi026 ceph-mon[96795]: pgmap v2901: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:23.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:23 smithi194 ceph-mon[65619]: pgmap v2901: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:25.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:25 smithi026 ceph-mon[96795]: pgmap v2902: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:25.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:25 smithi194 ceph-mon[65619]: pgmap v2902: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:27.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:27 smithi026 ceph-mon[96795]: pgmap v2903: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:27.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:27 smithi194 ceph-mon[65619]: pgmap v2903: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:29.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:29 smithi026 ceph-mon[96795]: pgmap v2904: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:29.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:29 smithi194 ceph-mon[65619]: pgmap v2904: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:31.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:30 smithi194 ceph-mon[65619]: pgmap v2905: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:31.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:30 smithi026 ceph-mon[96795]: pgmap v2905: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:33.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:32 smithi194 ceph-mon[65619]: pgmap v2906: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:33.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:32 smithi026 ceph-mon[96795]: pgmap v2906: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:35.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:34 smithi194 ceph-mon[65619]: pgmap v2907: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:35.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:34 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:31:35.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:34 smithi026 ceph-mon[96795]: pgmap v2907: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:35.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:34 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:31:36.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:35 smithi194 ceph-mon[65619]: poll took 60054.074 ms: 1 events 2021-11-03T18:31:36.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:35 smithi026 ceph-mon[96795]: poll took 60054.074 ms: 1 events 2021-11-03T18:31:37.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:36 smithi194 ceph-mon[65619]: pgmap v2908: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:37.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:36 smithi026 ceph-mon[96795]: pgmap v2908: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:38.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:38 smithi026 ceph-mon[96795]: poll took 2620.311 ms: 1 events 2021-11-03T18:31:38.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:38 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:31:38.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:38 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:31:38.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:38 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:31:38.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:38 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:31:38.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:38 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:31:38.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:38 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:31:38.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:38 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:31:38.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:38 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:31:38.927 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:38 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:31:38.928 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:38 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:31:38.928 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:38 smithi026 ceph-mon[96795]: pgmap v2909: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:39.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:38 smithi194 ceph-mon[65619]: poll took 2620.311 ms: 1 events 2021-11-03T18:31:39.002 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:38 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:31:39.002 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:38 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:31:39.002 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:38 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:31:39.003 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:38 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:31:39.003 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:38 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:31:39.003 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:38 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:31:39.003 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:38 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:31:39.003 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:38 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:31:39.004 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:38 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:31:39.004 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:38 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:31:39.004 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:38 smithi194 ceph-mon[65619]: pgmap v2909: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:41.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.122+0000 7fa165585700 1 -- 172.21.15.26:0/2554225111 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1600f5ef0 msgr2=0x7fa1600f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:31:41.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.122+0000 7fa165585700 1 --2- 172.21.15.26:0/2554225111 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1600f5ef0 0x7fa1600f6920 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 rx=0x7fa150004660 tx=0x7fa150009b30).stop 2021-11-03T18:31:41.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.122+0000 7fa165585700 1 -- 172.21.15.26:0/2554225111 shutdown_connections 2021-11-03T18:31:41.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.122+0000 7fa165585700 1 --2- 172.21.15.26:0/2554225111 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1600f5ef0 0x7fa1600f6920 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:41.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.122+0000 7fa165585700 1 --2- 172.21.15.26:0/2554225111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1600f55e0 0x7fa1600f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:41.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.122+0000 7fa165585700 1 -- 172.21.15.26:0/2554225111 >> 172.21.15.26:0/2554225111 conn(0x7fa1600f0de0 msgr2=0x7fa1600f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:31:41.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.122+0000 7fa165585700 1 -- 172.21.15.26:0/2554225111 shutdown_connections 2021-11-03T18:31:41.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.122+0000 7fa165585700 1 -- 172.21.15.26:0/2554225111 wait complete. 2021-11-03T18:31:41.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.123+0000 7fa165585700 1 Processor -- start 2021-11-03T18:31:41.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.123+0000 7fa165585700 1 -- start start 2021-11-03T18:31:41.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.123+0000 7fa165585700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1600f55e0 0x7fa160109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:31:41.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.123+0000 7fa165585700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1600f5ef0 0x7fa16010c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:31:41.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.123+0000 7fa165585700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1600604c0 con 0x7fa1600f5ef0 2021-11-03T18:31:41.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.123+0000 7fa165585700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa160060600 con 0x7fa1600f55e0 2021-11-03T18:31:41.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.123+0000 7fa15e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1600f5ef0 0x7fa16010c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:31:41.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.124+0000 7fa15e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1600f5ef0 0x7fa16010c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60520/0 (socket says 172.21.15.26:60520) 2021-11-03T18:31:41.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.124+0000 7fa15e7fc700 1 -- 172.21.15.26:0/1335132846 learned_addr learned my addr 172.21.15.26:0/1335132846 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:31:41.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.124+0000 7fa15effd700 1 --2- 172.21.15.26:0/1335132846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1600f55e0 0x7fa160109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:31:41.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.124+0000 7fa15e7fc700 1 -- 172.21.15.26:0/1335132846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1600f55e0 msgr2=0x7fa160109cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:31:41.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.124+0000 7fa15e7fc700 1 --2- 172.21.15.26:0/1335132846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1600f55e0 0x7fa160109cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:41.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.124+0000 7fa15e7fc700 1 -- 172.21.15.26:0/1335132846 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa150005040 con 0x7fa1600f5ef0 2021-11-03T18:31:41.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.124+0000 7fa15e7fc700 1 --2- 172.21.15.26:0/1335132846 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1600f5ef0 0x7fa16010c1b0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 rx=0x7fa150009990 tx=0x7fa150009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:31:41.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.124+0000 7fa1577fe700 1 -- 172.21.15.26:0/1335132846 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa150018070 con 0x7fa1600f5ef0 2021-11-03T18:31:41.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.124+0000 7fa1577fe700 1 -- 172.21.15.26:0/1335132846 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa150007ba0 con 0x7fa1600f5ef0 2021-11-03T18:31:41.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.124+0000 7fa1577fe700 1 -- 172.21.15.26:0/1335132846 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa15001c3c0 con 0x7fa1600f5ef0 2021-11-03T18:31:41.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.124+0000 7fa165585700 1 -- 172.21.15.26:0/1335132846 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa16010c700 con 0x7fa1600f5ef0 2021-11-03T18:31:41.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.124+0000 7fa165585700 1 -- 172.21.15.26:0/1335132846 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa16010cc30 con 0x7fa1600f5ef0 2021-11-03T18:31:41.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.125+0000 7fa165585700 1 -- 172.21.15.26:0/1335132846 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1600f4a70 con 0x7fa1600f5ef0 2021-11-03T18:31:41.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.126+0000 7fa1577fe700 1 -- 172.21.15.26:0/1335132846 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fa15001d420 con 0x7fa1600f5ef0 2021-11-03T18:31:41.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.126+0000 7fa1577fe700 1 --2- 172.21.15.26:0/1335132846 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa14c0640b0 0x7fa14c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:31:41.139 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.126+0000 7fa1577fe700 1 -- 172.21.15.26:0/1335132846 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fa150082390 con 0x7fa1600f5ef0 2021-11-03T18:31:41.139 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.126+0000 7fa15effd700 1 --2- 172.21.15.26:0/1335132846 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa14c0640b0 0x7fa14c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:31:41.140 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.127+0000 7fa15effd700 1 --2- 172.21.15.26:0/1335132846 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa14c0640b0 0x7fa14c066570 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7fa160060140 tx=0x7fa14800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:31:41.141 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.130+0000 7fa1577fe700 1 -- 172.21.15.26:0/1335132846 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fa1500547b0 con 0x7fa1600f5ef0 2021-11-03T18:31:41.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:40 smithi194 ceph-mon[65619]: pgmap v2910: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:41.308 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.309+0000 7fa165585700 1 -- 172.21.15.26:0/1335132846 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1600fdf40 con 0x7fa14c0640b0 2021-11-03T18:31:41.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.310+0000 7fa1577fe700 1 -- 172.21.15.26:0/1335132846 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fa1600fdf40 con 0x7fa14c0640b0 2021-11-03T18:31:41.311 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.312+0000 7fa165585700 1 -- 172.21.15.26:0/1335132846 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa14c0640b0 msgr2=0x7fa14c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:31:41.311 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.312+0000 7fa165585700 1 --2- 172.21.15.26:0/1335132846 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa14c0640b0 0x7fa14c066570 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7fa160060140 tx=0x7fa14800b040).stop 2021-11-03T18:31:41.311 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.312+0000 7fa165585700 1 -- 172.21.15.26:0/1335132846 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1600f5ef0 msgr2=0x7fa16010c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:31:41.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.312+0000 7fa165585700 1 --2- 172.21.15.26:0/1335132846 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1600f5ef0 0x7fa16010c1b0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 rx=0x7fa150009990 tx=0x7fa150009b30).stop 2021-11-03T18:31:41.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.312+0000 7fa165585700 1 -- 172.21.15.26:0/1335132846 shutdown_connections 2021-11-03T18:31:41.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.312+0000 7fa165585700 1 --2- 172.21.15.26:0/1335132846 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa14c0640b0 0x7fa14c066570 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:41.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.312+0000 7fa165585700 1 --2- 172.21.15.26:0/1335132846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1600f55e0 0x7fa160109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:41.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.312+0000 7fa165585700 1 --2- 172.21.15.26:0/1335132846 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1600f5ef0 0x7fa16010c1b0 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:41.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.312+0000 7fa165585700 1 -- 172.21.15.26:0/1335132846 >> 172.21.15.26:0/1335132846 conn(0x7fa1600f0de0 msgr2=0x7fa1600fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:31:41.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.312+0000 7fa165585700 1 -- 172.21.15.26:0/1335132846 shutdown_connections 2021-11-03T18:31:41.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.312+0000 7fa165585700 1 -- 172.21.15.26:0/1335132846 wait complete. 2021-11-03T18:31:41.321 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:31:41.414 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.413+0000 7f857b91e700 1 -- 172.21.15.26:0/540756235 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85740f6ff0 msgr2=0x7f85740f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:31:41.414 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.413+0000 7f857b91e700 1 --2- 172.21.15.26:0/540756235 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85740f6ff0 0x7f85740f7a20 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 rx=0x7f8570004660 tx=0x7f8570009b30).stop 2021-11-03T18:31:41.414 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.413+0000 7f857b91e700 1 -- 172.21.15.26:0/540756235 shutdown_connections 2021-11-03T18:31:41.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.413+0000 7f857b91e700 1 --2- 172.21.15.26:0/540756235 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85740f6ff0 0x7f85740f7a20 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:41.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.413+0000 7f857b91e700 1 --2- 172.21.15.26:0/540756235 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85740f66e0 0x7f85740f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:41.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.413+0000 7f857b91e700 1 -- 172.21.15.26:0/540756235 >> 172.21.15.26:0/540756235 conn(0x7f85740f1f00 msgr2=0x7f85740f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:31:41.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.413+0000 7f857b91e700 1 -- 172.21.15.26:0/540756235 shutdown_connections 2021-11-03T18:31:41.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.413+0000 7f857b91e700 1 -- 172.21.15.26:0/540756235 wait complete. 2021-11-03T18:31:41.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.413+0000 7f857b91e700 1 Processor -- start 2021-11-03T18:31:41.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.413+0000 7f857b91e700 1 -- start start 2021-11-03T18:31:41.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.414+0000 7f857b91e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85740f66e0 0x7f85741070f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:31:41.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.414+0000 7f857b91e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85741075e0 0x7f85741084d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:31:41.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.414+0000 7f857b91e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8574107ab0 con 0x7f85740f66e0 2021-11-03T18:31:41.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.414+0000 7f857b91e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8574107bf0 con 0x7f85741075e0 2021-11-03T18:31:41.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.414+0000 7f85796ba700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85740f66e0 0x7f85741070f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:31:41.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.414+0000 7f85796ba700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85740f66e0 0x7f85741070f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60528/0 (socket says 172.21.15.26:60528) 2021-11-03T18:31:41.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.414+0000 7f85796ba700 1 -- 172.21.15.26:0/3527276619 learned_addr learned my addr 172.21.15.26:0/3527276619 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:31:41.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.414+0000 7f8578eb9700 1 --2- 172.21.15.26:0/3527276619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85741075e0 0x7f85741084d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:31:41.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.414+0000 7f85796ba700 1 -- 172.21.15.26:0/3527276619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85741075e0 msgr2=0x7f85741084d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:31:41.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.414+0000 7f85796ba700 1 --2- 172.21.15.26:0/3527276619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85741075e0 0x7f85741084d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:41.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.414+0000 7f85796ba700 1 -- 172.21.15.26:0/3527276619 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8570005040 con 0x7f85740f66e0 2021-11-03T18:31:41.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.414+0000 7f8578eb9700 1 --2- 172.21.15.26:0/3527276619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85741075e0 0x7f85741084d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:31:41.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.414+0000 7f85796ba700 1 --2- 172.21.15.26:0/3527276619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85740f66e0 0x7f85741070f0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 rx=0x7f856400c530 tx=0x7f8564007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:31:41.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.414+0000 7f8569ffb700 1 -- 172.21.15.26:0/3527276619 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f856400f650 con 0x7f85740f66e0 2021-11-03T18:31:41.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.414+0000 7f8569ffb700 1 -- 172.21.15.26:0/3527276619 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f856400fc60 con 0x7f85740f66e0 2021-11-03T18:31:41.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.414+0000 7f857b91e700 1 -- 172.21.15.26:0/3527276619 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8574108a80 con 0x7f85740f66e0 2021-11-03T18:31:41.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.414+0000 7f8569ffb700 1 -- 172.21.15.26:0/3527276619 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8564012cd0 con 0x7f85740f66e0 2021-11-03T18:31:41.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.415+0000 7f857b91e700 1 -- 172.21.15.26:0/3527276619 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8574109040 con 0x7f85740f66e0 2021-11-03T18:31:41.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.416+0000 7f857b91e700 1 -- 172.21.15.26:0/3527276619 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8574045ad0 con 0x7f85740f66e0 2021-11-03T18:31:41.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.416+0000 7f8569ffb700 1 -- 172.21.15.26:0/3527276619 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f8564010070 con 0x7f85740f66e0 2021-11-03T18:31:41.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.416+0000 7f8569ffb700 1 --2- 172.21.15.26:0/3527276619 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8560064180 0x7f8560066640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:31:41.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.416+0000 7f8569ffb700 1 -- 172.21.15.26:0/3527276619 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f8564080560 con 0x7f85740f66e0 2021-11-03T18:31:41.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.416+0000 7f8578eb9700 1 --2- 172.21.15.26:0/3527276619 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8560064180 0x7f8560066640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:31:41.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.417+0000 7f8578eb9700 1 --2- 172.21.15.26:0/3527276619 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8560064180 0x7f8560066640 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7f8570000c00 tx=0x7f8570009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:31:41.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.420+0000 7f8569ffb700 1 -- 172.21.15.26:0/3527276619 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f85640529a0 con 0x7f85740f66e0 2021-11-03T18:31:41.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:40 smithi026 ceph-mon[96795]: pgmap v2910: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:41.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.593+0000 7f857b91e700 1 -- 172.21.15.26:0/3527276619 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f85740feed0 con 0x7f8560064180 2021-11-03T18:31:41.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.607+0000 7f8569ffb700 1 -- 172.21.15.26:0/3527276619 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7f85740feed0 con 0x7f8560064180 2021-11-03T18:31:41.607 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:31:41.607 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (102m) 67s ago 104m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:31:41.607 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (95m) 67s ago 104m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:31:41.608 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (94m) 4s ago 103m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:31:41.608 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (102m) 67s ago 103m 42.3M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:31:41.608 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (95m) 67s ago 99m 26.2M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:31:41.608 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (96m) 67s ago 99m 26.8M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:31:41.609 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (99m) 4s ago 99m 27.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:31:41.609 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (99m) 4s ago 99m 27.4M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:31:41.609 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (96m) 67s ago 105m 601M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:31:41.609 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (96m) 4s ago 103m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:31:41.610 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (96m) 67s ago 105m 374M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:31:41.610 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (95m) 4s ago 103m 171M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:31:41.610 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (103m) 67s ago 103m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:31:41.610 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (103m) 4s ago 103m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:31:41.610 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (94m) 67s ago 102m 352M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:31:41.611 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (94m) 67s ago 102m 379M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:31:41.611 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (93m) 67s ago 101m 314M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:31:41.611 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (93m) 4s ago 101m 413M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:31:41.611 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (92m) 4s ago 101m 339M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:31:41.612 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (92m) 4s ago 100m 337M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:31:41.612 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (102m) 67s ago 103m 68.0M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:31:41.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.609+0000 7f857b91e700 1 -- 172.21.15.26:0/3527276619 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8560064180 msgr2=0x7f8560066640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:31:41.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.609+0000 7f857b91e700 1 --2- 172.21.15.26:0/3527276619 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8560064180 0x7f8560066640 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7f8570000c00 tx=0x7f8570009b30).stop 2021-11-03T18:31:41.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.609+0000 7f857b91e700 1 -- 172.21.15.26:0/3527276619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85740f66e0 msgr2=0x7f85741070f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:31:41.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.609+0000 7f857b91e700 1 --2- 172.21.15.26:0/3527276619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85740f66e0 0x7f85741070f0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 rx=0x7f856400c530 tx=0x7f8564007e20).stop 2021-11-03T18:31:41.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.609+0000 7f857b91e700 1 -- 172.21.15.26:0/3527276619 shutdown_connections 2021-11-03T18:31:41.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.609+0000 7f857b91e700 1 --2- 172.21.15.26:0/3527276619 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8560064180 0x7f8560066640 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:41.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.609+0000 7f857b91e700 1 --2- 172.21.15.26:0/3527276619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85740f66e0 0x7f85741070f0 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:41.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.609+0000 7f857b91e700 1 --2- 172.21.15.26:0/3527276619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85741075e0 0x7f85741084d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:41.615 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.609+0000 7f857b91e700 1 -- 172.21.15.26:0/3527276619 >> 172.21.15.26:0/3527276619 conn(0x7f85740f1f00 msgr2=0x7f85740fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:31:41.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.609+0000 7f857b91e700 1 -- 172.21.15.26:0/3527276619 shutdown_connections 2021-11-03T18:31:41.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.609+0000 7f857b91e700 1 -- 172.21.15.26:0/3527276619 wait complete. 2021-11-03T18:31:41.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.709+0000 7f1248386700 1 -- 172.21.15.26:0/739693419 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12400f6ff0 msgr2=0x7f12400f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:31:41.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.709+0000 7f1248386700 1 --2- 172.21.15.26:0/739693419 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12400f6ff0 0x7f12400f7a20 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 rx=0x7f1234004660 tx=0x7f1234009b30).stop 2021-11-03T18:31:41.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.709+0000 7f1248386700 1 -- 172.21.15.26:0/739693419 shutdown_connections 2021-11-03T18:31:41.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.709+0000 7f1248386700 1 --2- 172.21.15.26:0/739693419 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12400f6ff0 0x7f12400f7a20 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:41.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.709+0000 7f1248386700 1 --2- 172.21.15.26:0/739693419 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12400f66e0 0x7f12400f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.709+0000 7f1248386700 1 -- 172.21.15.26:0/739693419 >> 172.21.15.26:0/739693419 conn(0x7f12400f1f00 msgr2=0x7f12400f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:31:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.709+0000 7f1248386700 1 -- 172.21.15.26:0/739693419 shutdown_connections 2021-11-03T18:31:41.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.709+0000 7f1248386700 1 -- 172.21.15.26:0/739693419 wait complete. 2021-11-03T18:31:41.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.709+0000 7f1248386700 1 Processor -- start 2021-11-03T18:31:41.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.709+0000 7f1248386700 1 -- start start 2021-11-03T18:31:41.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.709+0000 7f1248386700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12400f66e0 0x7f1240106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:31:41.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.709+0000 7f1248386700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12400f6ff0 0x7f1240107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:31:41.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.709+0000 7f1248386700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12401079b0 con 0x7f12400f6ff0 2021-11-03T18:31:41.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.709+0000 7f1248386700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1240107af0 con 0x7f12400f66e0 2021-11-03T18:31:41.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.710+0000 7f1245921700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12400f6ff0 0x7f1240107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:31:41.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.710+0000 7f1245921700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12400f6ff0 0x7f1240107400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60540/0 (socket says 172.21.15.26:60540) 2021-11-03T18:31:41.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.710+0000 7f1245921700 1 -- 172.21.15.26:0/1359330291 learned_addr learned my addr 172.21.15.26:0/1359330291 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:31:41.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.710+0000 7f1246122700 1 --2- 172.21.15.26:0/1359330291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12400f66e0 0x7f1240106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:31:41.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.710+0000 7f1245921700 1 -- 172.21.15.26:0/1359330291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12400f66e0 msgr2=0x7f1240106f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:31:41.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.710+0000 7f1245921700 1 --2- 172.21.15.26:0/1359330291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12400f66e0 0x7f1240106f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:41.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.710+0000 7f1245921700 1 -- 172.21.15.26:0/1359330291 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1234005040 con 0x7f12400f6ff0 2021-11-03T18:31:41.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.710+0000 7f1245921700 1 --2- 172.21.15.26:0/1359330291 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12400f6ff0 0x7f1240107400 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 rx=0x7f1234009990 tx=0x7f1234009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:31:41.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.710+0000 7f123effd700 1 -- 172.21.15.26:0/1359330291 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1234018070 con 0x7f12400f6ff0 2021-11-03T18:31:41.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.710+0000 7f123effd700 1 -- 172.21.15.26:0/1359330291 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1234007ba0 con 0x7f12400f6ff0 2021-11-03T18:31:41.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.710+0000 7f1248386700 1 -- 172.21.15.26:0/1359330291 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1240108430 con 0x7f12400f6ff0 2021-11-03T18:31:41.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.710+0000 7f123effd700 1 -- 172.21.15.26:0/1359330291 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f123401c3c0 con 0x7f12400f6ff0 2021-11-03T18:31:41.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.710+0000 7f1248386700 1 -- 172.21.15.26:0/1359330291 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1240108990 con 0x7f12400f6ff0 2021-11-03T18:31:41.726 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.711+0000 7f1248386700 1 -- 172.21.15.26:0/1359330291 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1240045ad0 con 0x7f12400f6ff0 2021-11-03T18:31:41.726 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.712+0000 7f123effd700 1 -- 172.21.15.26:0/1359330291 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f123401d420 con 0x7f12400f6ff0 2021-11-03T18:31:41.727 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.712+0000 7f123effd700 1 --2- 172.21.15.26:0/1359330291 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f12280640b0 0x7f1228066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:31:41.727 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.712+0000 7f123effd700 1 -- 172.21.15.26:0/1359330291 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f1234082340 con 0x7f12400f6ff0 2021-11-03T18:31:41.728 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.712+0000 7f1246122700 1 --2- 172.21.15.26:0/1359330291 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f12280640b0 0x7f1228066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:31:41.728 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.712+0000 7f1246122700 1 --2- 172.21.15.26:0/1359330291 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f12280640b0 0x7f1228066570 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7f1238004ce0 tx=0x7f123800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:31:41.729 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.716+0000 7f123effd700 1 -- 172.21.15.26:0/1359330291 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f1234054760 con 0x7f12400f6ff0 2021-11-03T18:31:41.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.946+0000 7f1248386700 1 -- 172.21.15.26:0/1359330291 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1240027a00 con 0x7f12400f6ff0 2021-11-03T18:31:41.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.947+0000 7f123effd700 1 -- 172.21.15.26:0/1359330291 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f1234054350 con 0x7f12400f6ff0 2021-11-03T18:31:41.946 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:31:41.946 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:31:41.947 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:31:41.947 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:31:41.947 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:31:41.947 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:31:41.947 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:31:41.948 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:31:41.948 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:31:41.948 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:31:41.948 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:31:41.949 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:31:41.949 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:31:41.949 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:31:41.949 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:31:41.949 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:31:41.950 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:31:41.950 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:31:41.951 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.948+0000 7f1248386700 1 -- 172.21.15.26:0/1359330291 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f12280640b0 msgr2=0x7f1228066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:31:41.951 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.948+0000 7f1248386700 1 --2- 172.21.15.26:0/1359330291 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f12280640b0 0x7f1228066570 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7f1238004ce0 tx=0x7f123800b040).stop 2021-11-03T18:31:41.951 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.948+0000 7f1248386700 1 -- 172.21.15.26:0/1359330291 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12400f6ff0 msgr2=0x7f1240107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:31:41.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.948+0000 7f1248386700 1 --2- 172.21.15.26:0/1359330291 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12400f6ff0 0x7f1240107400 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 rx=0x7f1234009990 tx=0x7f1234009b30).stop 2021-11-03T18:31:41.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.948+0000 7f1248386700 1 -- 172.21.15.26:0/1359330291 shutdown_connections 2021-11-03T18:31:41.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.948+0000 7f1248386700 1 --2- 172.21.15.26:0/1359330291 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f12280640b0 0x7f1228066570 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:41.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.948+0000 7f1248386700 1 --2- 172.21.15.26:0/1359330291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12400f66e0 0x7f1240106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:41.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.948+0000 7f1248386700 1 --2- 172.21.15.26:0/1359330291 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12400f6ff0 0x7f1240107400 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:41.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.948+0000 7f1248386700 1 -- 172.21.15.26:0/1359330291 >> 172.21.15.26:0/1359330291 conn(0x7f12400f1f00 msgr2=0x7f12400fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:31:41.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.949+0000 7f1248386700 1 -- 172.21.15.26:0/1359330291 shutdown_connections 2021-11-03T18:31:41.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:41.949+0000 7f1248386700 1 -- 172.21.15.26:0/1359330291 wait complete. 2021-11-03T18:31:42.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.049+0000 7fc548f0c700 1 -- 172.21.15.26:0/3929104309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5440f5440 msgr2=0x7fc5440f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:31:42.053 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.049+0000 7fc548f0c700 1 --2- 172.21.15.26:0/3929104309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5440f5440 0x7fc5440f5860 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 rx=0x7fc534004660 tx=0x7fc534009b30).stop 2021-11-03T18:31:42.053 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.049+0000 7fc548f0c700 1 -- 172.21.15.26:0/3929104309 shutdown_connections 2021-11-03T18:31:42.053 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.049+0000 7fc548f0c700 1 --2- 172.21.15.26:0/3929104309 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5440f66e0 0x7fc5440f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:42.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.049+0000 7fc548f0c700 1 --2- 172.21.15.26:0/3929104309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5440f5440 0x7fc5440f5860 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:42.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.049+0000 7fc548f0c700 1 -- 172.21.15.26:0/3929104309 >> 172.21.15.26:0/3929104309 conn(0x7fc5440f0ba0 msgr2=0x7fc5440f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:31:42.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.049+0000 7fc548f0c700 1 -- 172.21.15.26:0/3929104309 shutdown_connections 2021-11-03T18:31:42.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.049+0000 7fc548f0c700 1 -- 172.21.15.26:0/3929104309 wait complete. 2021-11-03T18:31:42.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.050+0000 7fc548f0c700 1 Processor -- start 2021-11-03T18:31:42.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.050+0000 7fc548f0c700 1 -- start start 2021-11-03T18:31:42.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.050+0000 7fc548f0c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5440f5440 0x7fc544106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:31:42.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.050+0000 7fc548f0c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5440f66e0 0x7fc544107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:31:42.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.050+0000 7fc548f0c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc544107870 con 0x7fc5440f66e0 2021-11-03T18:31:42.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.050+0000 7fc548f0c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5441080b0 con 0x7fc5440f5440 2021-11-03T18:31:42.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.050+0000 7fc542ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5440f66e0 0x7fc544107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:31:42.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.050+0000 7fc542ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5440f66e0 0x7fc544107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60550/0 (socket says 172.21.15.26:60550) 2021-11-03T18:31:42.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.050+0000 7fc542ffd700 1 -- 172.21.15.26:0/2304298116 learned_addr learned my addr 172.21.15.26:0/2304298116 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:31:42.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.050+0000 7fc5437fe700 1 --2- 172.21.15.26:0/2304298116 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5440f5440 0x7fc544106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:31:42.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.050+0000 7fc542ffd700 1 -- 172.21.15.26:0/2304298116 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5440f5440 msgr2=0x7fc544106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:31:42.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.050+0000 7fc542ffd700 1 --2- 172.21.15.26:0/2304298116 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5440f5440 0x7fc544106d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:42.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.050+0000 7fc542ffd700 1 -- 172.21.15.26:0/2304298116 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc534005040 con 0x7fc5440f66e0 2021-11-03T18:31:42.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.051+0000 7fc5437fe700 1 --2- 172.21.15.26:0/2304298116 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5440f5440 0x7fc544106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:31:42.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.051+0000 7fc542ffd700 1 --2- 172.21.15.26:0/2304298116 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5440f66e0 0x7fc544107270 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 rx=0x7fc53800c790 tx=0x7fc538007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:31:42.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.051+0000 7fc52bfff700 1 -- 172.21.15.26:0/2304298116 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc53800e680 con 0x7fc5440f66e0 2021-11-03T18:31:42.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.051+0000 7fc52bfff700 1 -- 172.21.15.26:0/2304298116 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc53800ec90 con 0x7fc5440f66e0 2021-11-03T18:31:42.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.051+0000 7fc548f0c700 1 -- 172.21.15.26:0/2304298116 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc544108390 con 0x7fc5440f66e0 2021-11-03T18:31:42.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.051+0000 7fc52bfff700 1 -- 172.21.15.26:0/2304298116 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc538013d60 con 0x7fc5440f66e0 2021-11-03T18:31:42.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.051+0000 7fc548f0c700 1 -- 172.21.15.26:0/2304298116 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5441088d0 con 0x7fc5440f66e0 2021-11-03T18:31:42.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.052+0000 7fc548f0c700 1 -- 172.21.15.26:0/2304298116 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc544059100 con 0x7fc5440f66e0 2021-11-03T18:31:42.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.052+0000 7fc52bfff700 1 -- 172.21.15.26:0/2304298116 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc53801a060 con 0x7fc5440f66e0 2021-11-03T18:31:42.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.053+0000 7fc52bfff700 1 --2- 172.21.15.26:0/2304298116 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc52c064100 0x7fc52c0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:31:42.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.053+0000 7fc52bfff700 1 -- 172.21.15.26:0/2304298116 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc538080b00 con 0x7fc5440f66e0 2021-11-03T18:31:42.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.053+0000 7fc5437fe700 1 --2- 172.21.15.26:0/2304298116 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc52c064100 0x7fc52c0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:31:42.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.053+0000 7fc5437fe700 1 --2- 172.21.15.26:0/2304298116 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc52c064100 0x7fc52c0665c0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7fc534004e30 tx=0x7fc534009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:31:42.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.057+0000 7fc52bfff700 1 -- 172.21.15.26:0/2304298116 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc538052d70 con 0x7fc5440f66e0 2021-11-03T18:31:42.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:41 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1359330291' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:31:42.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.261+0000 7fc548f0c700 1 -- 172.21.15.26:0/2304298116 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc544108f10 con 0x7fc5440f66e0 2021-11-03T18:31:42.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.261+0000 7fc52bfff700 1 -- 172.21.15.26:0/2304298116 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fc538018020 con 0x7fc5440f66e0 2021-11-03T18:31:42.260 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:31:42.261 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:31:42.261 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:31:42.261 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:31:42.261 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:31:42.262 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:31:42.262 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:31:42.262 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:31:42.262 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:31:42.263 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:31:42.263 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:31:42.263 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:31:42.263 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:31:42.264 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:31:42.264 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:31:42.264 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:31:42.265 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:31:42.265 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:31:42.265 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:31:42.265 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:31:42.265 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:31:42.266 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:31:42.266 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:31:42.266 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:31:42.266 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:31:42.267 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:31:42.267 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:31:42.267 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:31:42.267 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:31:42.268 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:31:42.268 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:31:42.268 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:31:42.268 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:31:42.268 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:31:42.269 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:31:42.269 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:31:42.269 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:31:42.270 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:31:42.270 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:31:42.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.263+0000 7fc548f0c700 1 -- 172.21.15.26:0/2304298116 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc52c064100 msgr2=0x7fc52c0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:31:42.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.263+0000 7fc548f0c700 1 --2- 172.21.15.26:0/2304298116 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc52c064100 0x7fc52c0665c0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7fc534004e30 tx=0x7fc534009b30).stop 2021-11-03T18:31:42.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.263+0000 7fc548f0c700 1 -- 172.21.15.26:0/2304298116 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5440f66e0 msgr2=0x7fc544107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:31:42.272 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.263+0000 7fc548f0c700 1 --2- 172.21.15.26:0/2304298116 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5440f66e0 0x7fc544107270 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 rx=0x7fc53800c790 tx=0x7fc538007d70).stop 2021-11-03T18:31:42.272 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.263+0000 7fc548f0c700 1 -- 172.21.15.26:0/2304298116 shutdown_connections 2021-11-03T18:31:42.273 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.263+0000 7fc548f0c700 1 --2- 172.21.15.26:0/2304298116 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc52c064100 0x7fc52c0665c0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:42.273 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.263+0000 7fc548f0c700 1 --2- 172.21.15.26:0/2304298116 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5440f5440 0x7fc544106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:42.273 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.263+0000 7fc548f0c700 1 --2- 172.21.15.26:0/2304298116 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5440f66e0 0x7fc544107270 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:31:42.273 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.263+0000 7fc548f0c700 1 -- 172.21.15.26:0/2304298116 >> 172.21.15.26:0/2304298116 conn(0x7fc5440f0ba0 msgr2=0x7fc54405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:31:42.273 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.263+0000 7fc548f0c700 1 -- 172.21.15.26:0/2304298116 shutdown_connections 2021-11-03T18:31:42.274 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:31:42.263+0000 7fc548f0c700 1 -- 172.21.15.26:0/2304298116 wait complete. 2021-11-03T18:31:42.274 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:31:42.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:41 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1359330291' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:31:43.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:42 smithi194 ceph-mon[65619]: from='client.37132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:31:43.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:42 smithi194 ceph-mon[65619]: from='client.37136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:31:43.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:42 smithi194 ceph-mon[65619]: pgmap v2911: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:43.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:42 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2304298116' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:31:43.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:42 smithi026 ceph-mon[96795]: from='client.37132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:31:43.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:42 smithi026 ceph-mon[96795]: from='client.37136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:31:43.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:42 smithi026 ceph-mon[96795]: pgmap v2911: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:43.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:42 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2304298116' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:31:45.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:44 smithi194 ceph-mon[65619]: pgmap v2912: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:45.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:44 smithi026 ceph-mon[96795]: pgmap v2912: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:47.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:46 smithi194 ceph-mon[65619]: pgmap v2913: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:47.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:46 smithi026 ceph-mon[96795]: pgmap v2913: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:49.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:48 smithi194 ceph-mon[65619]: pgmap v2914: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:49.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:31:49.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:31:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:48 smithi026 ceph-mon[96795]: pgmap v2914: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:31:49.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:31:51.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:50 smithi194 ceph-mon[65619]: pgmap v2915: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:51.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:50 smithi026 ceph-mon[96795]: pgmap v2915: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:53.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:52 smithi194 ceph-mon[65619]: pgmap v2916: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:53.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:52 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:31:53.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:52 smithi026 ceph-mon[96795]: pgmap v2916: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:53.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:52 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:31:54.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:53 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:31:54.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:53 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:31:55.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:54 smithi194 ceph-mon[65619]: pgmap v2917: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:55.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:54 smithi026 ceph-mon[96795]: pgmap v2917: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:57.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:56 smithi194 ceph-mon[65619]: pgmap v2918: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:57.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:56 smithi026 ceph-mon[96795]: pgmap v2918: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:59.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:31:58 smithi194 ceph-mon[65619]: pgmap v2919: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:31:59.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:31:58 smithi026 ceph-mon[96795]: pgmap v2919: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:01.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:00 smithi194 ceph-mon[65619]: pgmap v2920: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:01.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:00 smithi026 ceph-mon[96795]: pgmap v2920: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:03.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:02 smithi194 ceph-mon[65619]: pgmap v2921: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:03.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:02 smithi026 ceph-mon[96795]: pgmap v2921: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:05.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:04 smithi194 ceph-mon[65619]: pgmap v2922: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:05.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:04 smithi026 ceph-mon[96795]: pgmap v2922: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:07.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:06 smithi194 ceph-mon[65619]: pgmap v2923: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:07.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:06 smithi026 ceph-mon[96795]: pgmap v2923: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:08.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:07 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:32:08.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:07 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:32:09.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:08 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:32:09.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:08 smithi194 ceph-mon[65619]: pgmap v2924: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:09.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:08 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:32:09.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:08 smithi026 ceph-mon[96795]: pgmap v2924: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:11.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:10 smithi194 ceph-mon[65619]: pgmap v2925: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:11.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:10 smithi026 ceph-mon[96795]: pgmap v2925: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:12.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.380+0000 7ff33beb0700 1 -- 172.21.15.26:0/4180364146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3340f66e0 msgr2=0x7ff3340f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:32:12.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.380+0000 7ff33beb0700 1 --2- 172.21.15.26:0/4180364146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3340f66e0 0x7ff3340f6b00 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 rx=0x7ff32c0099e0 tx=0x7ff32c004d10).stop 2021-11-03T18:32:12.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.380+0000 7ff33beb0700 1 -- 172.21.15.26:0/4180364146 shutdown_connections 2021-11-03T18:32:12.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.380+0000 7ff33beb0700 1 --2- 172.21.15.26:0/4180364146 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3340f7980 0x7ff3340f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:12.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.380+0000 7ff33beb0700 1 --2- 172.21.15.26:0/4180364146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3340f66e0 0x7ff3340f6b00 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:12.385 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.380+0000 7ff33beb0700 1 -- 172.21.15.26:0/4180364146 >> 172.21.15.26:0/4180364146 conn(0x7ff3340f1e40 msgr2=0x7ff3340f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:32:12.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.380+0000 7ff33beb0700 1 -- 172.21.15.26:0/4180364146 shutdown_connections 2021-11-03T18:32:12.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.381+0000 7ff33beb0700 1 -- 172.21.15.26:0/4180364146 wait complete. 2021-11-03T18:32:12.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.381+0000 7ff33beb0700 1 Processor -- start 2021-11-03T18:32:12.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.381+0000 7ff33beb0700 1 -- start start 2021-11-03T18:32:12.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.381+0000 7ff33beb0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3340f66e0 0x7ff3341070d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:32:12.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.381+0000 7ff33beb0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3340f7980 0x7ff3341075c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:32:12.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.381+0000 7ff33beb0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff334107b70 con 0x7ff3340f7980 2021-11-03T18:32:12.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.381+0000 7ff33beb0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff334107cb0 con 0x7ff3340f66e0 2021-11-03T18:32:12.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.381+0000 7ff33944b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3340f7980 0x7ff3341075c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:32:12.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.381+0000 7ff33944b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3340f7980 0x7ff3341075c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60568/0 (socket says 172.21.15.26:60568) 2021-11-03T18:32:12.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.381+0000 7ff33944b700 1 -- 172.21.15.26:0/732742402 learned_addr learned my addr 172.21.15.26:0/732742402 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:32:12.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.381+0000 7ff339c4c700 1 --2- 172.21.15.26:0/732742402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3340f66e0 0x7ff3341070d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:32:12.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.382+0000 7ff33944b700 1 -- 172.21.15.26:0/732742402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3340f66e0 msgr2=0x7ff3341070d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:32:12.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.382+0000 7ff33944b700 1 --2- 172.21.15.26:0/732742402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3340f66e0 0x7ff3341070d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:12.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.382+0000 7ff33944b700 1 -- 172.21.15.26:0/732742402 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff32c009640 con 0x7ff3340f7980 2021-11-03T18:32:12.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.382+0000 7ff339c4c700 1 --2- 172.21.15.26:0/732742402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3340f66e0 0x7ff3341070d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:32:12.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.382+0000 7ff33944b700 1 --2- 172.21.15.26:0/732742402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3340f7980 0x7ff3341075c0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 rx=0x7ff32800e7f0 tx=0x7ff32800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:32:12.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.382+0000 7ff3327fc700 1 -- 172.21.15.26:0/732742402 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3280092e0 con 0x7ff3340f7980 2021-11-03T18:32:12.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.382+0000 7ff3327fc700 1 -- 172.21.15.26:0/732742402 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff32800f040 con 0x7ff3340f7980 2021-11-03T18:32:12.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.382+0000 7ff33beb0700 1 -- 172.21.15.26:0/732742402 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff334108650 con 0x7ff3340f7980 2021-11-03T18:32:12.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.382+0000 7ff3327fc700 1 -- 172.21.15.26:0/732742402 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff328014750 con 0x7ff3340f7980 2021-11-03T18:32:12.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.382+0000 7ff33beb0700 1 -- 172.21.15.26:0/732742402 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff334108c10 con 0x7ff3340f7980 2021-11-03T18:32:12.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.383+0000 7ff33beb0700 1 -- 172.21.15.26:0/732742402 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff334045ad0 con 0x7ff3340f7980 2021-11-03T18:32:12.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.383+0000 7ff3327fc700 1 -- 172.21.15.26:0/732742402 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ff32801b030 con 0x7ff3340f7980 2021-11-03T18:32:12.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.384+0000 7ff3327fc700 1 --2- 172.21.15.26:0/732742402 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff31c0640b0 0x7ff31c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:32:12.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.384+0000 7ff3327fc700 1 -- 172.21.15.26:0/732742402 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ff3280806d0 con 0x7ff3340f7980 2021-11-03T18:32:12.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.384+0000 7ff339c4c700 1 --2- 172.21.15.26:0/732742402 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff31c0640b0 0x7ff31c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:32:12.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.384+0000 7ff339c4c700 1 --2- 172.21.15.26:0/732742402 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff31c0640b0 0x7ff31c066570 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 rx=0x7ff32c00b620 tx=0x7ff32c004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:32:12.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.388+0000 7ff3327fc700 1 -- 172.21.15.26:0/732742402 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ff328052970 con 0x7ff3340f7980 2021-11-03T18:32:12.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.575+0000 7ff33beb0700 1 -- 172.21.15.26:0/732742402 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff334108e30 con 0x7ff31c0640b0 2021-11-03T18:32:12.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.577+0000 7ff3327fc700 1 -- 172.21.15.26:0/732742402 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7ff334108e30 con 0x7ff31c0640b0 2021-11-03T18:32:12.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.578+0000 7ff33beb0700 1 -- 172.21.15.26:0/732742402 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff31c0640b0 msgr2=0x7ff31c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:32:12.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.578+0000 7ff33beb0700 1 --2- 172.21.15.26:0/732742402 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff31c0640b0 0x7ff31c066570 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 rx=0x7ff32c00b620 tx=0x7ff32c004d10).stop 2021-11-03T18:32:12.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.578+0000 7ff33beb0700 1 -- 172.21.15.26:0/732742402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3340f7980 msgr2=0x7ff3341075c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:32:12.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.578+0000 7ff33beb0700 1 --2- 172.21.15.26:0/732742402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3340f7980 0x7ff3341075c0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 rx=0x7ff32800e7f0 tx=0x7ff32800b040).stop 2021-11-03T18:32:12.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.579+0000 7ff33beb0700 1 -- 172.21.15.26:0/732742402 shutdown_connections 2021-11-03T18:32:12.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.579+0000 7ff33beb0700 1 --2- 172.21.15.26:0/732742402 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff31c0640b0 0x7ff31c066570 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:12.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.579+0000 7ff33beb0700 1 --2- 172.21.15.26:0/732742402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3340f66e0 0x7ff3341070d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:12.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.579+0000 7ff33beb0700 1 --2- 172.21.15.26:0/732742402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3340f7980 0x7ff3341075c0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:12.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.579+0000 7ff33beb0700 1 -- 172.21.15.26:0/732742402 >> 172.21.15.26:0/732742402 conn(0x7ff3340f1e40 msgr2=0x7ff3340fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:32:12.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.579+0000 7ff33beb0700 1 -- 172.21.15.26:0/732742402 shutdown_connections 2021-11-03T18:32:12.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.579+0000 7ff33beb0700 1 -- 172.21.15.26:0/732742402 wait complete. 2021-11-03T18:32:12.586 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:32:12.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.678+0000 7f777e7a9700 1 -- 172.21.15.26:0/3280956156 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77780f98d0 msgr2=0x7f77780fbcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:32:12.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.678+0000 7f777e7a9700 1 --2- 172.21.15.26:0/3280956156 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77780f98d0 0x7f77780fbcc0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 rx=0x7f7768004660 tx=0x7f7768009b30).stop 2021-11-03T18:32:12.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.679+0000 7f777e7a9700 1 -- 172.21.15.26:0/3280956156 shutdown_connections 2021-11-03T18:32:12.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.679+0000 7f777e7a9700 1 --2- 172.21.15.26:0/3280956156 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77780f98d0 0x7f77780fbcc0 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:12.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.679+0000 7f777e7a9700 1 --2- 172.21.15.26:0/3280956156 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77780602f0 0x7f77780f93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:12.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.679+0000 7f777e7a9700 1 -- 172.21.15.26:0/3280956156 >> 172.21.15.26:0/3280956156 conn(0x7f77780f0de0 msgr2=0x7f77780f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:32:12.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.679+0000 7f777e7a9700 1 -- 172.21.15.26:0/3280956156 shutdown_connections 2021-11-03T18:32:12.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.679+0000 7f777e7a9700 1 -- 172.21.15.26:0/3280956156 wait complete. 2021-11-03T18:32:12.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.679+0000 7f777e7a9700 1 Processor -- start 2021-11-03T18:32:12.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.679+0000 7f777e7a9700 1 -- start start 2021-11-03T18:32:12.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.679+0000 7f777e7a9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77780602f0 0x7f7778106fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:32:12.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.679+0000 7f777e7a9700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77780f98d0 0x7f7778107490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:32:12.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.680+0000 7f777e7a9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7778107a40 con 0x7f77780602f0 2021-11-03T18:32:12.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.680+0000 7f777e7a9700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7778107b80 con 0x7f77780f98d0 2021-11-03T18:32:12.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.680+0000 7f7777fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77780602f0 0x7f7778106fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:32:12.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.680+0000 7f7777fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77780602f0 0x7f7778106fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60576/0 (socket says 172.21.15.26:60576) 2021-11-03T18:32:12.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.680+0000 7f7777fff700 1 -- 172.21.15.26:0/1827394891 learned_addr learned my addr 172.21.15.26:0/1827394891 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:32:12.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.680+0000 7f7777fff700 1 -- 172.21.15.26:0/1827394891 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77780f98d0 msgr2=0x7f7778107490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:32:12.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.680+0000 7f7777fff700 1 --2- 172.21.15.26:0/1827394891 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77780f98d0 0x7f7778107490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:32:12.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.680+0000 7f7777fff700 1 -- 172.21.15.26:0/1827394891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7768005040 con 0x7f77780602f0 2021-11-03T18:32:12.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.680+0000 7f7777fff700 1 --2- 172.21.15.26:0/1827394891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77780602f0 0x7f7778106fa0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 rx=0x7f776c002700 tx=0x7f776c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:32:12.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.680+0000 7f7774ff9700 1 -- 172.21.15.26:0/1827394891 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f776c009320 con 0x7f77780602f0 2021-11-03T18:32:12.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.680+0000 7f777e7a9700 1 -- 172.21.15.26:0/1827394891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7778108520 con 0x7f77780602f0 2021-11-03T18:32:12.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.680+0000 7f7774ff9700 1 -- 172.21.15.26:0/1827394891 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f776c00f040 con 0x7f77780602f0 2021-11-03T18:32:12.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.680+0000 7f7774ff9700 1 -- 172.21.15.26:0/1827394891 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f776c014900 con 0x7f77780602f0 2021-11-03T18:32:12.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.680+0000 7f777e7a9700 1 -- 172.21.15.26:0/1827394891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7778108ae0 con 0x7f77780602f0 2021-11-03T18:32:12.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.681+0000 7f777e7a9700 1 -- 172.21.15.26:0/1827394891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7778045ad0 con 0x7f77780602f0 2021-11-03T18:32:12.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.682+0000 7f7774ff9700 1 -- 172.21.15.26:0/1827394891 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f776c009480 con 0x7f77780602f0 2021-11-03T18:32:12.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.682+0000 7f7774ff9700 1 --2- 172.21.15.26:0/1827394891 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7760064090 0x7f7760066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:32:12.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.682+0000 7f7774ff9700 1 -- 172.21.15.26:0/1827394891 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f776c080a80 con 0x7f77780602f0 2021-11-03T18:32:12.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.682+0000 7f77777fe700 1 --2- 172.21.15.26:0/1827394891 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7760064090 0x7f7760066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:32:12.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.682+0000 7f77777fe700 1 --2- 172.21.15.26:0/1827394891 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7760064090 0x7f7760066550 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7f7768009f50 tx=0x7f7768009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:32:12.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.686+0000 7f7774ff9700 1 -- 172.21.15.26:0/1827394891 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f776c052de0 con 0x7f77780602f0 2021-11-03T18:32:12.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.858+0000 7f777e7a9700 1 -- 172.21.15.26:0/1827394891 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7778108dc0 con 0x7f7760064090 2021-11-03T18:32:12.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.873+0000 7f7774ff9700 1 -- 172.21.15.26:0/1827394891 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7f7778108dc0 con 0x7f7760064090 2021-11-03T18:32:12.872 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:32:12.873 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (103m) 98s ago 104m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:32:12.873 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (95m) 98s ago 104m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:32:12.874 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (95m) 35s ago 103m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:32:12.874 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (103m) 98s ago 104m 42.3M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:32:12.875 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (96m) 98s ago 99m 26.2M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:32:12.875 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (96m) 98s ago 99m 26.8M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:32:12.875 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (99m) 35s ago 99m 27.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:32:12.876 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (99m) 35s ago 99m 27.4M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:32:12.876 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (97m) 98s ago 106m 601M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:32:12.877 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (96m) 35s ago 103m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:32:12.877 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (96m) 98s ago 106m 374M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:32:12.878 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (96m) 35s ago 103m 171M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:32:12.878 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (104m) 98s ago 104m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:32:12.879 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (103m) 35s ago 103m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:32:12.879 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (95m) 98s ago 103m 352M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:32:12.879 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (94m) 98s ago 102m 379M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:32:12.880 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (94m) 98s ago 102m 314M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:32:12.880 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (93m) 35s ago 102m 413M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:32:12.881 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (93m) 35s ago 101m 339M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:32:12.881 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (92m) 35s ago 101m 337M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:32:12.881 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (103m) 98s ago 104m 68.0M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:32:12.883 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.875+0000 7f777e7a9700 1 -- 172.21.15.26:0/1827394891 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7760064090 msgr2=0x7f7760066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:32:12.883 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.875+0000 7f777e7a9700 1 --2- 172.21.15.26:0/1827394891 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7760064090 0x7f7760066550 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7f7768009f50 tx=0x7f7768009b30).stop 2021-11-03T18:32:12.884 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.875+0000 7f777e7a9700 1 -- 172.21.15.26:0/1827394891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77780602f0 msgr2=0x7f7778106fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:32:12.884 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.875+0000 7f777e7a9700 1 --2- 172.21.15.26:0/1827394891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77780602f0 0x7f7778106fa0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 rx=0x7f776c002700 tx=0x7f776c009d80).stop 2021-11-03T18:32:12.884 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.875+0000 7f777e7a9700 1 -- 172.21.15.26:0/1827394891 shutdown_connections 2021-11-03T18:32:12.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.875+0000 7f777e7a9700 1 --2- 172.21.15.26:0/1827394891 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7760064090 0x7f7760066550 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:12.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.875+0000 7f777e7a9700 1 --2- 172.21.15.26:0/1827394891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77780602f0 0x7f7778106fa0 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:12.886 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.875+0000 7f777e7a9700 1 --2- 172.21.15.26:0/1827394891 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77780f98d0 0x7f7778107490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:32:12.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.875+0000 7f777e7a9700 1 -- 172.21.15.26:0/1827394891 >> 172.21.15.26:0/1827394891 conn(0x7f77780f0de0 msgr2=0x7f77780f31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:32:12.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.875+0000 7f777e7a9700 1 -- 172.21.15.26:0/1827394891 shutdown_connections 2021-11-03T18:32:12.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.875+0000 7f777e7a9700 1 -- 172.21.15.26:0/1827394891 wait complete. 2021-11-03T18:32:12.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.974+0000 7fbfdaf42700 1 -- 172.21.15.26:0/1245943343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfd40f96a0 msgr2=0x7fbfd40fbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:32:12.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.974+0000 7fbfdaf42700 1 --2- 172.21.15.26:0/1245943343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfd40f96a0 0x7fbfd40fbaf0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 rx=0x7fbfc4004660 tx=0x7fbfc4009b30).stop 2021-11-03T18:32:12.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.975+0000 7fbfdaf42700 1 -- 172.21.15.26:0/1245943343 shutdown_connections 2021-11-03T18:32:12.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.975+0000 7fbfdaf42700 1 --2- 172.21.15.26:0/1245943343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfd40f96a0 0x7fbfd40fbaf0 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:12.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.975+0000 7fbfdaf42700 1 --2- 172.21.15.26:0/1245943343 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfd4060310 0x7fbfd40f9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:12.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.975+0000 7fbfdaf42700 1 -- 172.21.15.26:0/1245943343 >> 172.21.15.26:0/1245943343 conn(0x7fbfd40f0ba0 msgr2=0x7fbfd40f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:32:12.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.975+0000 7fbfdaf42700 1 -- 172.21.15.26:0/1245943343 shutdown_connections 2021-11-03T18:32:12.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.975+0000 7fbfdaf42700 1 -- 172.21.15.26:0/1245943343 wait complete. 2021-11-03T18:32:12.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.975+0000 7fbfdaf42700 1 Processor -- start 2021-11-03T18:32:12.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.975+0000 7fbfdaf42700 1 -- start start 2021-11-03T18:32:12.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.975+0000 7fbfdaf42700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfd4060310 0x7fbfd4106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:32:12.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.975+0000 7fbfdaf42700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfd40f96a0 0x7fbfd4107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:32:12.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.975+0000 7fbfdaf42700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd4107880 con 0x7fbfd40f96a0 2021-11-03T18:32:12.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.975+0000 7fbfdaf42700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd41080c0 con 0x7fbfd4060310 2021-11-03T18:32:12.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.975+0000 7fbfd973f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfd40f96a0 0x7fbfd4107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:32:12.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.976+0000 7fbfd973f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfd40f96a0 0x7fbfd4107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60588/0 (socket says 172.21.15.26:60588) 2021-11-03T18:32:12.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.976+0000 7fbfd973f700 1 -- 172.21.15.26:0/3892557334 learned_addr learned my addr 172.21.15.26:0/3892557334 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:32:12.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.976+0000 7fbfd9f40700 1 --2- 172.21.15.26:0/3892557334 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfd4060310 0x7fbfd4106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:32:12.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.976+0000 7fbfd973f700 1 -- 172.21.15.26:0/3892557334 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfd4060310 msgr2=0x7fbfd4106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:32:12.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.976+0000 7fbfd973f700 1 --2- 172.21.15.26:0/3892557334 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfd4060310 0x7fbfd4106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:12.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.976+0000 7fbfd973f700 1 -- 172.21.15.26:0/3892557334 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc4005040 con 0x7fbfd40f96a0 2021-11-03T18:32:12.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.976+0000 7fbfd973f700 1 --2- 172.21.15.26:0/3892557334 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfd40f96a0 0x7fbfd4107280 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 rx=0x7fbfc4013a70 tx=0x7fbfc4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:32:12.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.976+0000 7fbfca7fc700 1 -- 172.21.15.26:0/3892557334 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfc4018070 con 0x7fbfd40f96a0 2021-11-03T18:32:12.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.976+0000 7fbfca7fc700 1 -- 172.21.15.26:0/3892557334 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbfc40097d0 con 0x7fbfd40f96a0 2021-11-03T18:32:12.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.976+0000 7fbfdaf42700 1 -- 172.21.15.26:0/3892557334 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd4108340 con 0x7fbfd40f96a0 2021-11-03T18:32:12.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.976+0000 7fbfca7fc700 1 -- 172.21.15.26:0/3892557334 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfc401de80 con 0x7fbfd40f96a0 2021-11-03T18:32:12.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.976+0000 7fbfdaf42700 1 -- 172.21.15.26:0/3892557334 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd4108820 con 0x7fbfd40f96a0 2021-11-03T18:32:12.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.977+0000 7fbfdaf42700 1 -- 172.21.15.26:0/3892557334 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfd4059100 con 0x7fbfd40f96a0 2021-11-03T18:32:12.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.978+0000 7fbfca7fc700 1 -- 172.21.15.26:0/3892557334 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fbfc4007ba0 con 0x7fbfd40f96a0 2021-11-03T18:32:12.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.978+0000 7fbfca7fc700 1 --2- 172.21.15.26:0/3892557334 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbfc0064100 0x7fbfc00665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:32:12.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.978+0000 7fbfca7fc700 1 -- 172.21.15.26:0/3892557334 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fbfc40822e0 con 0x7fbfd40f96a0 2021-11-03T18:32:12.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.978+0000 7fbfd9f40700 1 --2- 172.21.15.26:0/3892557334 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbfc0064100 0x7fbfc00665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:32:12.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.978+0000 7fbfd9f40700 1 --2- 172.21.15.26:0/3892557334 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbfc0064100 0x7fbfc00665c0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7fbfd4107b50 tx=0x7fbfd000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:32:12.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:12.982+0000 7fbfca7fc700 1 -- 172.21.15.26:0/3892557334 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fbfc4054700 con 0x7fbfd40f96a0 2021-11-03T18:32:13.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.212+0000 7fbfdaf42700 1 -- 172.21.15.26:0/3892557334 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbfd40fed30 con 0x7fbfd40f96a0 2021-11-03T18:32:13.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.213+0000 7fbfca7fc700 1 -- 172.21.15.26:0/3892557334 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fbfc40542f0 con 0x7fbfd40f96a0 2021-11-03T18:32:13.211 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:32:13.212 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:32:13.212 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:32:13.212 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:32:13.212 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:32:13.212 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:32:13.213 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:32:13.213 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:32:13.213 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:32:13.213 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:32:13.214 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:32:13.214 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:32:13.214 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:32:13.214 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:32:13.214 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:32:13.215 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:32:13.215 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:32:13.216 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:32:13.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.214+0000 7fbfdaf42700 1 -- 172.21.15.26:0/3892557334 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbfc0064100 msgr2=0x7fbfc00665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:32:13.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.214+0000 7fbfdaf42700 1 --2- 172.21.15.26:0/3892557334 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbfc0064100 0x7fbfc00665c0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7fbfd4107b50 tx=0x7fbfd000b040).stop 2021-11-03T18:32:13.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.214+0000 7fbfdaf42700 1 -- 172.21.15.26:0/3892557334 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfd40f96a0 msgr2=0x7fbfd4107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:32:13.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.214+0000 7fbfdaf42700 1 --2- 172.21.15.26:0/3892557334 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfd40f96a0 0x7fbfd4107280 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 rx=0x7fbfc4013a70 tx=0x7fbfc4009b30).stop 2021-11-03T18:32:13.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.214+0000 7fbfdaf42700 1 -- 172.21.15.26:0/3892557334 shutdown_connections 2021-11-03T18:32:13.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.214+0000 7fbfdaf42700 1 --2- 172.21.15.26:0/3892557334 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbfc0064100 0x7fbfc00665c0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:13.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.214+0000 7fbfdaf42700 1 --2- 172.21.15.26:0/3892557334 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfd4060310 0x7fbfd4106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:13.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.214+0000 7fbfdaf42700 1 --2- 172.21.15.26:0/3892557334 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfd40f96a0 0x7fbfd4107280 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:13.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.214+0000 7fbfdaf42700 1 -- 172.21.15.26:0/3892557334 >> 172.21.15.26:0/3892557334 conn(0x7fbfd40f0ba0 msgr2=0x7fbfd40f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:32:13.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.215+0000 7fbfdaf42700 1 -- 172.21.15.26:0/3892557334 shutdown_connections 2021-11-03T18:32:13.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.215+0000 7fbfdaf42700 1 -- 172.21.15.26:0/3892557334 wait complete. 2021-11-03T18:32:13.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:12 smithi194 ceph-mon[65619]: pgmap v2926: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:13.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.314+0000 7f6a33079700 1 -- 172.21.15.26:0/4132131674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a2c0f51a0 msgr2=0x7f6a2c0f7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:32:13.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.314+0000 7f6a33079700 1 --2- 172.21.15.26:0/4132131674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a2c0f51a0 0x7f6a2c0f7920 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 rx=0x7f6a1c004660 tx=0x7f6a1c009b30).stop 2021-11-03T18:32:13.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.314+0000 7f6a33079700 1 -- 172.21.15.26:0/4132131674 shutdown_connections 2021-11-03T18:32:13.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.314+0000 7f6a33079700 1 --2- 172.21.15.26:0/4132131674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a2c0f51a0 0x7f6a2c0f7920 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:13.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.314+0000 7f6a33079700 1 --2- 172.21.15.26:0/4132131674 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a2c0f4800 0x7f6a2c0f4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:13.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.314+0000 7f6a33079700 1 -- 172.21.15.26:0/4132131674 >> 172.21.15.26:0/4132131674 conn(0x7f6a2c0f0320 msgr2=0x7f6a2c0f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:32:13.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.315+0000 7f6a33079700 1 -- 172.21.15.26:0/4132131674 shutdown_connections 2021-11-03T18:32:13.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.315+0000 7f6a33079700 1 -- 172.21.15.26:0/4132131674 wait complete. 2021-11-03T18:32:13.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.315+0000 7f6a33079700 1 Processor -- start 2021-11-03T18:32:13.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.315+0000 7f6a33079700 1 -- start start 2021-11-03T18:32:13.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.315+0000 7f6a33079700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a2c0f4800 0x7f6a2c0f73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:32:13.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.315+0000 7f6a33079700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a2c0f51a0 0x7f6a2c0f5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:32:13.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.315+0000 7f6a33079700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c0f5d90 con 0x7f6a2c0f51a0 2021-11-03T18:32:13.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.315+0000 7f6a33079700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c0f5ed0 con 0x7f6a2c0f4800 2021-11-03T18:32:13.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.315+0000 7f6a31876700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a2c0f51a0 0x7f6a2c0f5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:32:13.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.315+0000 7f6a31876700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a2c0f51a0 0x7f6a2c0f5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60598/0 (socket says 172.21.15.26:60598) 2021-11-03T18:32:13.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.315+0000 7f6a31876700 1 -- 172.21.15.26:0/1756229608 learned_addr learned my addr 172.21.15.26:0/1756229608 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:32:13.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.316+0000 7f6a32077700 1 --2- 172.21.15.26:0/1756229608 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a2c0f4800 0x7f6a2c0f73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:32:13.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.316+0000 7f6a31876700 1 -- 172.21.15.26:0/1756229608 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a2c0f4800 msgr2=0x7f6a2c0f73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:32:13.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.316+0000 7f6a31876700 1 --2- 172.21.15.26:0/1756229608 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a2c0f4800 0x7f6a2c0f73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:13.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.316+0000 7f6a31876700 1 -- 172.21.15.26:0/1756229608 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a1c005040 con 0x7f6a2c0f51a0 2021-11-03T18:32:13.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.316+0000 7f6a31876700 1 --2- 172.21.15.26:0/1756229608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a2c0f51a0 0x7f6a2c0f5830 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7f6a1c013a70 tx=0x7f6a1c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:32:13.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.316+0000 7f6a22ffd700 1 -- 172.21.15.26:0/1756229608 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a1c018070 con 0x7f6a2c0f51a0 2021-11-03T18:32:13.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.316+0000 7f6a33079700 1 -- 172.21.15.26:0/1756229608 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a2c0f6150 con 0x7f6a2c0f51a0 2021-11-03T18:32:13.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.316+0000 7f6a22ffd700 1 -- 172.21.15.26:0/1756229608 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6a1c0097d0 con 0x7f6a2c0f51a0 2021-11-03T18:32:13.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.316+0000 7f6a22ffd700 1 -- 172.21.15.26:0/1756229608 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a1c01c3c0 con 0x7f6a2c0f51a0 2021-11-03T18:32:13.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.316+0000 7f6a33079700 1 -- 172.21.15.26:0/1756229608 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a2c0f66b0 con 0x7f6a2c0f51a0 2021-11-03T18:32:13.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.317+0000 7f6a33079700 1 -- 172.21.15.26:0/1756229608 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a2c045ad0 con 0x7f6a2c0f51a0 2021-11-03T18:32:13.323 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.318+0000 7f6a22ffd700 1 -- 172.21.15.26:0/1756229608 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f6a1c007ba0 con 0x7f6a2c0f51a0 2021-11-03T18:32:13.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.318+0000 7f6a22ffd700 1 --2- 172.21.15.26:0/1756229608 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6a18064100 0x7f6a180665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:32:13.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.318+0000 7f6a22ffd700 1 -- 172.21.15.26:0/1756229608 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f6a1c0824b0 con 0x7f6a2c0f51a0 2021-11-03T18:32:13.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.318+0000 7f6a32077700 1 --2- 172.21.15.26:0/1756229608 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6a18064100 0x7f6a180665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:32:13.325 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.318+0000 7f6a32077700 1 --2- 172.21.15.26:0/1756229608 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6a18064100 0x7f6a180665c0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7f6a28009880 tx=0x7f6a2800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:32:13.325 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.322+0000 7f6a22ffd700 1 -- 172.21.15.26:0/1756229608 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f6a1c054810 con 0x7f6a2c0f51a0 2021-11-03T18:32:13.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:12 smithi026 ceph-mon[96795]: pgmap v2926: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:13.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.528+0000 7f6a33079700 1 -- 172.21.15.26:0/1756229608 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6a2c027a00 con 0x7f6a2c0f51a0 2021-11-03T18:32:13.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.529+0000 7f6a22ffd700 1 -- 172.21.15.26:0/1756229608 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f6a1c054400 con 0x7f6a2c0f51a0 2021-11-03T18:32:13.527 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:32:13.527 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:32:13.528 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:32:13.528 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:32:13.528 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:32:13.528 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:32:13.529 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:32:13.529 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:32:13.529 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:32:13.529 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:32:13.530 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:32:13.530 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:32:13.530 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:32:13.530 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:32:13.531 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:32:13.531 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:32:13.531 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:32:13.531 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:32:13.532 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:32:13.532 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:32:13.532 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:32:13.532 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:32:13.533 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:32:13.533 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:32:13.533 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:32:13.533 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:32:13.533 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:32:13.534 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:32:13.534 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:32:13.534 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:32:13.535 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:32:13.535 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:32:13.535 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:32:13.536 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:32:13.536 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:32:13.536 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:32:13.536 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:32:13.537 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:32:13.537 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:32:13.538 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.531+0000 7f6a33079700 1 -- 172.21.15.26:0/1756229608 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6a18064100 msgr2=0x7f6a180665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:32:13.538 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.531+0000 7f6a33079700 1 --2- 172.21.15.26:0/1756229608 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6a18064100 0x7f6a180665c0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7f6a28009880 tx=0x7f6a2800b040).stop 2021-11-03T18:32:13.538 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.531+0000 7f6a33079700 1 -- 172.21.15.26:0/1756229608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a2c0f51a0 msgr2=0x7f6a2c0f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:32:13.539 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.531+0000 7f6a33079700 1 --2- 172.21.15.26:0/1756229608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a2c0f51a0 0x7f6a2c0f5830 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7f6a1c013a70 tx=0x7f6a1c009b30).stop 2021-11-03T18:32:13.539 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.531+0000 7f6a33079700 1 -- 172.21.15.26:0/1756229608 shutdown_connections 2021-11-03T18:32:13.539 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.531+0000 7f6a33079700 1 --2- 172.21.15.26:0/1756229608 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6a18064100 0x7f6a180665c0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:13.539 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.531+0000 7f6a33079700 1 --2- 172.21.15.26:0/1756229608 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a2c0f4800 0x7f6a2c0f73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:13.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.531+0000 7f6a33079700 1 --2- 172.21.15.26:0/1756229608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a2c0f51a0 0x7f6a2c0f5830 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:13.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.531+0000 7f6a33079700 1 -- 172.21.15.26:0/1756229608 >> 172.21.15.26:0/1756229608 conn(0x7f6a2c0f0320 msgr2=0x7f6a2c0fb370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:32:13.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.531+0000 7f6a33079700 1 -- 172.21.15.26:0/1756229608 shutdown_connections 2021-11-03T18:32:13.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:13.531+0000 7f6a33079700 1 -- 172.21.15.26:0/1756229608 wait complete. 2021-11-03T18:32:13.540 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:32:14.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:13 smithi194 ceph-mon[65619]: from='client.37148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:32:14.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:13 smithi194 ceph-mon[65619]: from='client.37152 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:32:14.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:13 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3892557334' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:32:14.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:13 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1756229608' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:32:14.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:13 smithi026 ceph-mon[96795]: from='client.37148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:32:14.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:13 smithi026 ceph-mon[96795]: from='client.37152 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:32:14.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:13 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3892557334' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:32:14.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:13 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1756229608' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:32:15.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:14 smithi194 ceph-mon[65619]: pgmap v2927: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:15.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:14 smithi026 ceph-mon[96795]: pgmap v2927: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:17.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:16 smithi194 ceph-mon[65619]: pgmap v2928: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:17.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:16 smithi026 ceph-mon[96795]: pgmap v2928: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:19.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:18 smithi194 ceph-mon[65619]: pgmap v2929: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:19.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:18 smithi026 ceph-mon[96795]: pgmap v2929: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:21.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:20 smithi194 ceph-mon[65619]: pgmap v2930: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:21.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:20 smithi026 ceph-mon[96795]: pgmap v2930: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:23.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:22 smithi194 ceph-mon[65619]: pgmap v2931: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:23.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:22 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:32:23.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:22 smithi026 ceph-mon[96795]: pgmap v2931: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:23.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:22 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:32:24.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:23 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:32:24.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:23 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:32:25.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:24 smithi194 ceph-mon[65619]: pgmap v2932: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:25.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:24 smithi026 ceph-mon[96795]: pgmap v2932: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:27.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:26 smithi194 ceph-mon[65619]: pgmap v2933: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:27.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:26 smithi026 ceph-mon[96795]: pgmap v2933: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:29.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:28 smithi194 ceph-mon[65619]: pgmap v2934: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:29.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:28 smithi026 ceph-mon[96795]: pgmap v2934: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:31.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:30 smithi194 ceph-mon[65619]: pgmap v2935: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:31.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:30 smithi026 ceph-mon[96795]: pgmap v2935: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:33.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:32 smithi194 ceph-mon[65619]: pgmap v2936: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:33.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:32 smithi026 ceph-mon[96795]: pgmap v2936: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:35.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:34 smithi194 ceph-mon[65619]: pgmap v2937: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:35.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:34 smithi026 ceph-mon[96795]: pgmap v2937: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:37.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:36 smithi194 ceph-mon[65619]: pgmap v2938: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:37.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:36 smithi026 ceph-mon[96795]: pgmap v2938: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:38.346 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:38 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:32:38.360 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:38 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:32:39.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:39 smithi026 ceph-mon[96795]: pgmap v2939: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:39.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:39 smithi026 ceph-mon[96795]: poll took 60063.186 ms: 1 events 2021-11-03T18:32:39.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:32:39.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:32:39.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:32:39.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:32:39.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:32:39.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:32:39.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:32:39.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:39 smithi194 ceph-mon[65619]: pgmap v2939: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:39.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:39 smithi194 ceph-mon[65619]: poll took 60063.186 ms: 1 events 2021-11-03T18:32:39.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:32:39.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:32:39.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:32:39.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:32:39.505 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:32:39.505 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:32:39.505 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:32:40.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:40 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:32:40.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:40 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:32:40.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:40 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:32:40.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:40 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:32:41.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:41 smithi026 ceph-mon[96795]: pgmap v2940: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:41.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:41 smithi194 ceph-mon[65619]: pgmap v2940: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:43.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:43 smithi026 ceph-mon[96795]: pgmap v2941: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:43.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:43 smithi194 ceph-mon[65619]: pgmap v2941: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:43.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.644+0000 7f094e788700 1 -- 172.21.15.26:0/841310649 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09480f66e0 msgr2=0x7f09480f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:32:43.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.644+0000 7f094e788700 1 --2- 172.21.15.26:0/841310649 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09480f66e0 0x7f09480f6b00 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 rx=0x7f0938004660 tx=0x7f0938009b30).stop 2021-11-03T18:32:43.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.644+0000 7f094e788700 1 -- 172.21.15.26:0/841310649 shutdown_connections 2021-11-03T18:32:43.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.644+0000 7f094e788700 1 --2- 172.21.15.26:0/841310649 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09480f6ff0 0x7f09480f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:43.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.644+0000 7f094e788700 1 --2- 172.21.15.26:0/841310649 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09480f66e0 0x7f09480f6b00 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:43.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.644+0000 7f094e788700 1 -- 172.21.15.26:0/841310649 >> 172.21.15.26:0/841310649 conn(0x7f09480f1f00 msgr2=0x7f09480f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:32:43.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.645+0000 7f094e788700 1 -- 172.21.15.26:0/841310649 shutdown_connections 2021-11-03T18:32:43.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.645+0000 7f094e788700 1 -- 172.21.15.26:0/841310649 wait complete. 2021-11-03T18:32:43.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.645+0000 7f094e788700 1 Processor -- start 2021-11-03T18:32:43.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.645+0000 7f094e788700 1 -- start start 2021-11-03T18:32:43.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.645+0000 7f094e788700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09480f66e0 0x7f0948106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:32:43.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.645+0000 7f094e788700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09480f6ff0 0x7f0948107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:32:43.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.646+0000 7f094e788700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0948107a00 con 0x7f09480f66e0 2021-11-03T18:32:43.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.646+0000 7f094e788700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0948107b40 con 0x7f09480f6ff0 2021-11-03T18:32:43.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.646+0000 7f0947fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09480f66e0 0x7f0948106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:32:43.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.646+0000 7f0947fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09480f66e0 0x7f0948106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60614/0 (socket says 172.21.15.26:60614) 2021-11-03T18:32:43.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.646+0000 7f0947fff700 1 -- 172.21.15.26:0/3681904210 learned_addr learned my addr 172.21.15.26:0/3681904210 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:32:43.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.646+0000 7f09477fe700 1 --2- 172.21.15.26:0/3681904210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09480f6ff0 0x7f0948107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:32:43.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.646+0000 7f0947fff700 1 -- 172.21.15.26:0/3681904210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09480f6ff0 msgr2=0x7f0948107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:32:43.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.646+0000 7f0947fff700 1 --2- 172.21.15.26:0/3681904210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09480f6ff0 0x7f0948107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:43.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.646+0000 7f0947fff700 1 -- 172.21.15.26:0/3681904210 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0938005040 con 0x7f09480f66e0 2021-11-03T18:32:43.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.646+0000 7f0947fff700 1 --2- 172.21.15.26:0/3681904210 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09480f66e0 0x7f0948106f60 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 rx=0x7f0938009990 tx=0x7f0938009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:32:43.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.646+0000 7f0944ff9700 1 -- 172.21.15.26:0/3681904210 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0938018070 con 0x7f09480f66e0 2021-11-03T18:32:43.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.646+0000 7f0944ff9700 1 -- 172.21.15.26:0/3681904210 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0938007ba0 con 0x7f09480f66e0 2021-11-03T18:32:43.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.646+0000 7f094e788700 1 -- 172.21.15.26:0/3681904210 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0948108480 con 0x7f09480f66e0 2021-11-03T18:32:43.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.646+0000 7f0944ff9700 1 -- 172.21.15.26:0/3681904210 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f093801c3c0 con 0x7f09480f66e0 2021-11-03T18:32:43.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.646+0000 7f094e788700 1 -- 172.21.15.26:0/3681904210 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09481089e0 con 0x7f09480f66e0 2021-11-03T18:32:43.654 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.647+0000 7f094e788700 1 -- 172.21.15.26:0/3681904210 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0948045ad0 con 0x7f09480f66e0 2021-11-03T18:32:43.655 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.648+0000 7f0944ff9700 1 -- 172.21.15.26:0/3681904210 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f093801d420 con 0x7f09480f66e0 2021-11-03T18:32:43.655 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.649+0000 7f0944ff9700 1 --2- 172.21.15.26:0/3681904210 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f09300640b0 0x7f0930066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:32:43.655 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.649+0000 7f0944ff9700 1 -- 172.21.15.26:0/3681904210 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f09380827a0 con 0x7f09480f66e0 2021-11-03T18:32:43.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.649+0000 7f09477fe700 1 --2- 172.21.15.26:0/3681904210 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f09300640b0 0x7f0930066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:32:43.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.649+0000 7f09477fe700 1 --2- 172.21.15.26:0/3681904210 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f09300640b0 0x7f0930066570 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7f093c004c40 tx=0x7f093c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:32:43.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.652+0000 7f0944ff9700 1 -- 172.21.15.26:0/3681904210 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f0938054a40 con 0x7f09480f66e0 2021-11-03T18:32:43.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.833+0000 7f094e788700 1 -- 172.21.15.26:0/3681904210 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f09480ff010 con 0x7f09300640b0 2021-11-03T18:32:43.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.834+0000 7f0944ff9700 1 -- 172.21.15.26:0/3681904210 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f09480ff010 con 0x7f09300640b0 2021-11-03T18:32:43.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.836+0000 7f094e788700 1 -- 172.21.15.26:0/3681904210 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f09300640b0 msgr2=0x7f0930066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:32:43.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.836+0000 7f094e788700 1 --2- 172.21.15.26:0/3681904210 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f09300640b0 0x7f0930066570 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7f093c004c40 tx=0x7f093c00b040).stop 2021-11-03T18:32:43.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.836+0000 7f094e788700 1 -- 172.21.15.26:0/3681904210 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09480f66e0 msgr2=0x7f0948106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:32:43.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.836+0000 7f094e788700 1 --2- 172.21.15.26:0/3681904210 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09480f66e0 0x7f0948106f60 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 rx=0x7f0938009990 tx=0x7f0938009b30).stop 2021-11-03T18:32:43.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.836+0000 7f094e788700 1 -- 172.21.15.26:0/3681904210 shutdown_connections 2021-11-03T18:32:43.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.836+0000 7f094e788700 1 --2- 172.21.15.26:0/3681904210 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f09300640b0 0x7f0930066570 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:43.837 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.836+0000 7f094e788700 1 --2- 172.21.15.26:0/3681904210 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09480f66e0 0x7f0948106f60 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:43.837 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.836+0000 7f094e788700 1 --2- 172.21.15.26:0/3681904210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09480f6ff0 0x7f0948107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:43.837 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.836+0000 7f094e788700 1 -- 172.21.15.26:0/3681904210 >> 172.21.15.26:0/3681904210 conn(0x7f09480f1f00 msgr2=0x7f09480fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:32:43.837 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.837+0000 7f094e788700 1 -- 172.21.15.26:0/3681904210 shutdown_connections 2021-11-03T18:32:43.838 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.837+0000 7f094e788700 1 -- 172.21.15.26:0/3681904210 wait complete. 2021-11-03T18:32:43.845 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:32:43.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.937+0000 7f50723b1700 1 -- 172.21.15.26:0/1644035916 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f506c0f6ff0 msgr2=0x7f506c0f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:32:43.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.937+0000 7f50723b1700 1 --2- 172.21.15.26:0/1644035916 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f506c0f6ff0 0x7f506c0f7a20 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7f5060004660 tx=0x7f5060009b30).stop 2021-11-03T18:32:43.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.937+0000 7f50723b1700 1 -- 172.21.15.26:0/1644035916 shutdown_connections 2021-11-03T18:32:43.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.937+0000 7f50723b1700 1 --2- 172.21.15.26:0/1644035916 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f506c0f6ff0 0x7f506c0f7a20 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:43.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.937+0000 7f50723b1700 1 --2- 172.21.15.26:0/1644035916 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f506c0f66e0 0x7f506c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:43.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.937+0000 7f50723b1700 1 -- 172.21.15.26:0/1644035916 >> 172.21.15.26:0/1644035916 conn(0x7f506c0f1f00 msgr2=0x7f506c0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:32:43.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.937+0000 7f50723b1700 1 -- 172.21.15.26:0/1644035916 shutdown_connections 2021-11-03T18:32:43.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.937+0000 7f50723b1700 1 -- 172.21.15.26:0/1644035916 wait complete. 2021-11-03T18:32:43.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.938+0000 7f50723b1700 1 Processor -- start 2021-11-03T18:32:43.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.938+0000 7f50723b1700 1 -- start start 2021-11-03T18:32:43.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.938+0000 7f50723b1700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f506c0f66e0 0x7f506c106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:32:43.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.938+0000 7f50723b1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f506c0f6ff0 0x7f506c107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:32:43.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.938+0000 7f50723b1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506c107a10 con 0x7f506c0f6ff0 2021-11-03T18:32:43.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.938+0000 7f50723b1700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506c107b50 con 0x7f506c0f66e0 2021-11-03T18:32:43.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.938+0000 7f506b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f506c0f6ff0 0x7f506c107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:32:43.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.938+0000 7f506b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f506c0f6ff0 0x7f506c107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60626/0 (socket says 172.21.15.26:60626) 2021-11-03T18:32:43.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.938+0000 7f506b7fe700 1 -- 172.21.15.26:0/1546508905 learned_addr learned my addr 172.21.15.26:0/1546508905 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:32:43.943 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.938+0000 7f506bfff700 1 --2- 172.21.15.26:0/1546508905 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f506c0f66e0 0x7f506c106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:32:43.943 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.938+0000 7f506b7fe700 1 -- 172.21.15.26:0/1546508905 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f506c0f66e0 msgr2=0x7f506c106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:32:43.943 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.938+0000 7f506b7fe700 1 --2- 172.21.15.26:0/1546508905 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f506c0f66e0 0x7f506c106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:43.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.938+0000 7f506b7fe700 1 -- 172.21.15.26:0/1546508905 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5060005040 con 0x7f506c0f6ff0 2021-11-03T18:32:43.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.938+0000 7f506bfff700 1 --2- 172.21.15.26:0/1546508905 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f506c0f66e0 0x7f506c106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:32:43.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.938+0000 7f506b7fe700 1 --2- 172.21.15.26:0/1546508905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f506c0f6ff0 0x7f506c107460 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 rx=0x7f5060009990 tx=0x7f5060009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:32:43.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.939+0000 7f5068ff9700 1 -- 172.21.15.26:0/1546508905 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5060018070 con 0x7f506c0f6ff0 2021-11-03T18:32:43.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.939+0000 7f5068ff9700 1 -- 172.21.15.26:0/1546508905 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5060007ba0 con 0x7f506c0f6ff0 2021-11-03T18:32:43.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.939+0000 7f50723b1700 1 -- 172.21.15.26:0/1546508905 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f506c108490 con 0x7f506c0f6ff0 2021-11-03T18:32:43.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.939+0000 7f5068ff9700 1 -- 172.21.15.26:0/1546508905 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f506001c3c0 con 0x7f506c0f6ff0 2021-11-03T18:32:43.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.939+0000 7f50723b1700 1 -- 172.21.15.26:0/1546508905 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f506c1089f0 con 0x7f506c0f6ff0 2021-11-03T18:32:43.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.940+0000 7f50723b1700 1 -- 172.21.15.26:0/1546508905 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f506c045ad0 con 0x7f506c0f6ff0 2021-11-03T18:32:43.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.940+0000 7f5068ff9700 1 -- 172.21.15.26:0/1546508905 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f506001d420 con 0x7f506c0f6ff0 2021-11-03T18:32:43.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.940+0000 7f5068ff9700 1 --2- 172.21.15.26:0/1546508905 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f50540640b0 0x7f5054066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:32:43.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.941+0000 7f5068ff9700 1 -- 172.21.15.26:0/1546508905 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f50600825c0 con 0x7f506c0f6ff0 2021-11-03T18:32:43.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.941+0000 7f506bfff700 1 --2- 172.21.15.26:0/1546508905 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f50540640b0 0x7f5054066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:32:43.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.941+0000 7f506bfff700 1 --2- 172.21.15.26:0/1546508905 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f50540640b0 0x7f5054066570 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7f505c009740 tx=0x7f505c009be0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:32:43.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:43.945+0000 7f5068ff9700 1 -- 172.21.15.26:0/1546508905 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f50600548c0 con 0x7f506c0f6ff0 2021-11-03T18:32:44.117 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.118+0000 7f50723b1700 1 -- 172.21.15.26:0/1546508905 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f506c0fefe0 con 0x7f50540640b0 2021-11-03T18:32:44.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.133+0000 7f5068ff9700 1 -- 172.21.15.26:0/1546508905 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7f506c0fefe0 con 0x7f50540640b0 2021-11-03T18:32:44.132 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:32:44.132 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (103m) 2m ago 105m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:32:44.133 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (96m) 2m ago 105m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:32:44.133 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (96m) 66s ago 104m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:32:44.133 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (103m) 2m ago 104m 42.3M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:32:44.133 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (96m) 2m ago 100m 26.2M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:32:44.134 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (97m) 2m ago 100m 26.8M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:32:44.134 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (100m) 66s ago 100m 27.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:32:44.134 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (100m) 66s ago 100m 27.4M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:32:44.134 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (97m) 2m ago 106m 601M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:32:44.135 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (97m) 66s ago 104m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:32:44.135 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (97m) 2m ago 106m 374M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:32:44.135 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (96m) 66s ago 104m 171M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:32:44.135 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (104m) 2m ago 104m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:32:44.136 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (104m) 66s ago 104m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:32:44.136 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (95m) 2m ago 103m 352M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:32:44.136 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (95m) 2m ago 103m 379M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:32:44.136 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (94m) 2m ago 102m 314M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:32:44.136 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (94m) 66s ago 102m 413M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:32:44.137 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (93m) 66s ago 102m 339M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:32:44.137 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (93m) 66s ago 101m 337M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:32:44.137 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (103m) 2m ago 104m 68.0M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:32:44.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.135+0000 7f50723b1700 1 -- 172.21.15.26:0/1546508905 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f50540640b0 msgr2=0x7f5054066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:32:44.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.135+0000 7f50723b1700 1 --2- 172.21.15.26:0/1546508905 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f50540640b0 0x7f5054066570 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7f505c009740 tx=0x7f505c009be0).stop 2021-11-03T18:32:44.139 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.135+0000 7f50723b1700 1 -- 172.21.15.26:0/1546508905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f506c0f6ff0 msgr2=0x7f506c107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:32:44.139 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.135+0000 7f50723b1700 1 --2- 172.21.15.26:0/1546508905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f506c0f6ff0 0x7f506c107460 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 rx=0x7f5060009990 tx=0x7f5060009b30).stop 2021-11-03T18:32:44.139 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.135+0000 7f50723b1700 1 -- 172.21.15.26:0/1546508905 shutdown_connections 2021-11-03T18:32:44.139 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.135+0000 7f50723b1700 1 --2- 172.21.15.26:0/1546508905 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f50540640b0 0x7f5054066570 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:44.140 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.135+0000 7f50723b1700 1 --2- 172.21.15.26:0/1546508905 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f506c0f66e0 0x7f506c106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:44.140 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.135+0000 7f50723b1700 1 --2- 172.21.15.26:0/1546508905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f506c0f6ff0 0x7f506c107460 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:44.140 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.135+0000 7f50723b1700 1 -- 172.21.15.26:0/1546508905 >> 172.21.15.26:0/1546508905 conn(0x7f506c0f1f00 msgr2=0x7f506c0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:32:44.140 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.135+0000 7f50723b1700 1 -- 172.21.15.26:0/1546508905 shutdown_connections 2021-11-03T18:32:44.141 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.135+0000 7f50723b1700 1 -- 172.21.15.26:0/1546508905 wait complete. 2021-11-03T18:32:44.235 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.234+0000 7fcaae440700 1 -- 172.21.15.26:0/2396488885 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcaa8060310 msgr2=0x7fcaa80f93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:32:44.236 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.234+0000 7fcaae440700 1 --2- 172.21.15.26:0/2396488885 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcaa8060310 0x7fcaa80f93c0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 rx=0x7fca9c004660 tx=0x7fca9c009b30).stop 2021-11-03T18:32:44.236 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.234+0000 7fcaae440700 1 -- 172.21.15.26:0/2396488885 shutdown_connections 2021-11-03T18:32:44.236 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.234+0000 7fcaae440700 1 --2- 172.21.15.26:0/2396488885 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcaa80f98b0 0x7fcaa80fbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:44.236 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.234+0000 7fcaae440700 1 --2- 172.21.15.26:0/2396488885 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcaa8060310 0x7fcaa80f93c0 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:44.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.234+0000 7fcaae440700 1 -- 172.21.15.26:0/2396488885 >> 172.21.15.26:0/2396488885 conn(0x7fcaa80f0de0 msgr2=0x7fcaa80f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:32:44.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.234+0000 7fcaae440700 1 -- 172.21.15.26:0/2396488885 shutdown_connections 2021-11-03T18:32:44.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.234+0000 7fcaae440700 1 -- 172.21.15.26:0/2396488885 wait complete. 2021-11-03T18:32:44.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.235+0000 7fcaae440700 1 Processor -- start 2021-11-03T18:32:44.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.235+0000 7fcaae440700 1 -- start start 2021-11-03T18:32:44.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.235+0000 7fcaae440700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcaa8060310 0x7fcaa8106fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:32:44.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.235+0000 7fcaae440700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcaa80f98b0 0x7fcaa81074c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:32:44.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.235+0000 7fcaae440700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa8107a70 con 0x7fcaa8060310 2021-11-03T18:32:44.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.235+0000 7fcaae440700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa8107bb0 con 0x7fcaa80f98b0 2021-11-03T18:32:44.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.235+0000 7fcaa7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcaa8060310 0x7fcaa8106fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:32:44.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.235+0000 7fcaa7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcaa8060310 0x7fcaa8106fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60636/0 (socket says 172.21.15.26:60636) 2021-11-03T18:32:44.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.235+0000 7fcaa7fff700 1 -- 172.21.15.26:0/1140716933 learned_addr learned my addr 172.21.15.26:0/1140716933 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:32:44.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.235+0000 7fcaa77fe700 1 --2- 172.21.15.26:0/1140716933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcaa80f98b0 0x7fcaa81074c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:32:44.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.236+0000 7fcaa7fff700 1 -- 172.21.15.26:0/1140716933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcaa80f98b0 msgr2=0x7fcaa81074c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:32:44.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.236+0000 7fcaa7fff700 1 --2- 172.21.15.26:0/1140716933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcaa80f98b0 0x7fcaa81074c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:44.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.236+0000 7fcaa7fff700 1 -- 172.21.15.26:0/1140716933 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9c005040 con 0x7fcaa8060310 2021-11-03T18:32:44.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.236+0000 7fcaa7fff700 1 --2- 172.21.15.26:0/1140716933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcaa8060310 0x7fcaa8106fd0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7fca9c013a70 tx=0x7fca9c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:32:44.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.236+0000 7fcaa4ff9700 1 -- 172.21.15.26:0/1140716933 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca9c018070 con 0x7fcaa8060310 2021-11-03T18:32:44.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.236+0000 7fcaa4ff9700 1 -- 172.21.15.26:0/1140716933 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fca9c0097d0 con 0x7fcaa8060310 2021-11-03T18:32:44.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.236+0000 7fcaae440700 1 -- 172.21.15.26:0/1140716933 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa81084f0 con 0x7fcaa8060310 2021-11-03T18:32:44.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.236+0000 7fcaa4ff9700 1 -- 172.21.15.26:0/1140716933 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca9c01de80 con 0x7fcaa8060310 2021-11-03T18:32:44.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.236+0000 7fcaae440700 1 -- 172.21.15.26:0/1140716933 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa8108a50 con 0x7fcaa8060310 2021-11-03T18:32:44.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.237+0000 7fcaae440700 1 -- 172.21.15.26:0/1140716933 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaa8045ad0 con 0x7fcaa8060310 2021-11-03T18:32:44.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.237+0000 7fcaa4ff9700 1 -- 172.21.15.26:0/1140716933 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fca9c007ba0 con 0x7fcaa8060310 2021-11-03T18:32:44.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.238+0000 7fcaa4ff9700 1 --2- 172.21.15.26:0/1140716933 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fca900640b0 0x7fca90066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:32:44.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.238+0000 7fcaa4ff9700 1 -- 172.21.15.26:0/1140716933 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fca9c0823d0 con 0x7fcaa8060310 2021-11-03T18:32:44.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.238+0000 7fcaa77fe700 1 --2- 172.21.15.26:0/1140716933 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fca900640b0 0x7fca90066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:32:44.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.238+0000 7fcaa77fe700 1 --2- 172.21.15.26:0/1140716933 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fca900640b0 0x7fca90066570 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7fca98004c40 tx=0x7fca9800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:32:44.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.242+0000 7fcaa4ff9700 1 -- 172.21.15.26:0/1140716933 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fca9c0547f0 con 0x7fcaa8060310 2021-11-03T18:32:44.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.471+0000 7fcaae440700 1 -- 172.21.15.26:0/1140716933 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcaa80fefc0 con 0x7fcaa8060310 2021-11-03T18:32:44.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.472+0000 7fcaa4ff9700 1 -- 172.21.15.26:0/1140716933 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fca9c0543e0 con 0x7fcaa8060310 2021-11-03T18:32:44.471 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:32:44.472 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:32:44.472 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:32:44.472 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:32:44.472 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:32:44.473 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:32:44.473 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:32:44.473 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:32:44.474 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:32:44.474 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:32:44.474 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:32:44.474 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:32:44.475 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:32:44.475 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:32:44.475 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:32:44.475 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:32:44.476 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:32:44.476 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:32:44.477 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.473+0000 7fcaae440700 1 -- 172.21.15.26:0/1140716933 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fca900640b0 msgr2=0x7fca90066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:32:44.477 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.473+0000 7fcaae440700 1 --2- 172.21.15.26:0/1140716933 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fca900640b0 0x7fca90066570 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7fca98004c40 tx=0x7fca9800b040).stop 2021-11-03T18:32:44.477 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.473+0000 7fcaae440700 1 -- 172.21.15.26:0/1140716933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcaa8060310 msgr2=0x7fcaa8106fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:32:44.478 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.473+0000 7fcaae440700 1 --2- 172.21.15.26:0/1140716933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcaa8060310 0x7fcaa8106fd0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7fca9c013a70 tx=0x7fca9c009b30).stop 2021-11-03T18:32:44.478 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.473+0000 7fcaae440700 1 -- 172.21.15.26:0/1140716933 shutdown_connections 2021-11-03T18:32:44.478 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.473+0000 7fcaae440700 1 --2- 172.21.15.26:0/1140716933 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fca900640b0 0x7fca90066570 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:44.478 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.473+0000 7fcaae440700 1 --2- 172.21.15.26:0/1140716933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcaa8060310 0x7fcaa8106fd0 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:44.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.473+0000 7fcaae440700 1 --2- 172.21.15.26:0/1140716933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcaa80f98b0 0x7fcaa81074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:44.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.473+0000 7fcaae440700 1 -- 172.21.15.26:0/1140716933 >> 172.21.15.26:0/1140716933 conn(0x7fcaa80f0de0 msgr2=0x7fcaa80f31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:32:44.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.474+0000 7fcaae440700 1 -- 172.21.15.26:0/1140716933 shutdown_connections 2021-11-03T18:32:44.479 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.474+0000 7fcaae440700 1 -- 172.21.15.26:0/1140716933 wait complete. 2021-11-03T18:32:44.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.573+0000 7fa7277f0700 1 -- 172.21.15.26:0/1637614598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7200f55d0 msgr2=0x7fa7200f59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:32:44.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.573+0000 7fa7277f0700 1 --2- 172.21.15.26:0/1637614598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7200f55d0 0x7fa7200f59f0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 rx=0x7fa71c004660 tx=0x7fa71c009b30).stop 2021-11-03T18:32:44.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.574+0000 7fa7277f0700 1 -- 172.21.15.26:0/1637614598 shutdown_connections 2021-11-03T18:32:44.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.574+0000 7fa7277f0700 1 --2- 172.21.15.26:0/1637614598 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7200f6870 0x7fa7200f6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:44.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.574+0000 7fa7277f0700 1 --2- 172.21.15.26:0/1637614598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7200f55d0 0x7fa7200f59f0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:44.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.574+0000 7fa7277f0700 1 -- 172.21.15.26:0/1637614598 >> 172.21.15.26:0/1637614598 conn(0x7fa7200f0d30 msgr2=0x7fa7200f3150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:32:44.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.574+0000 7fa7277f0700 1 -- 172.21.15.26:0/1637614598 shutdown_connections 2021-11-03T18:32:44.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.574+0000 7fa7277f0700 1 -- 172.21.15.26:0/1637614598 wait complete. 2021-11-03T18:32:44.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.574+0000 7fa7277f0700 1 Processor -- start 2021-11-03T18:32:44.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.574+0000 7fa7277f0700 1 -- start start 2021-11-03T18:32:44.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.574+0000 7fa7277f0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7200f55d0 0x7fa72010c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:32:44.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.574+0000 7fa7277f0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7200f6870 0x7fa72010e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:32:44.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.574+0000 7fa7277f0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7200603b0 con 0x7fa7200f55d0 2021-11-03T18:32:44.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.574+0000 7fa7277f0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7200604f0 con 0x7fa7200f6870 2021-11-03T18:32:44.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.575+0000 7fa72558c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7200f55d0 0x7fa72010c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:32:44.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.575+0000 7fa72558c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7200f55d0 0x7fa72010c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60646/0 (socket says 172.21.15.26:60646) 2021-11-03T18:32:44.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.575+0000 7fa72558c700 1 -- 172.21.15.26:0/3096390473 learned_addr learned my addr 172.21.15.26:0/3096390473 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:32:44.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.575+0000 7fa72558c700 1 -- 172.21.15.26:0/3096390473 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7200f6870 msgr2=0x7fa72010e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:32:44.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.575+0000 7fa72558c700 1 --2- 172.21.15.26:0/3096390473 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7200f6870 0x7fa72010e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:32:44.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.575+0000 7fa72558c700 1 -- 172.21.15.26:0/3096390473 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa71c005040 con 0x7fa7200f55d0 2021-11-03T18:32:44.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.575+0000 7fa72558c700 1 --2- 172.21.15.26:0/3096390473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7200f55d0 0x7fa72010c090 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 rx=0x7fa71c013a70 tx=0x7fa71c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:32:44.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.575+0000 7fa711ffb700 1 -- 172.21.15.26:0/3096390473 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa71c018070 con 0x7fa7200f55d0 2021-11-03T18:32:44.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.575+0000 7fa711ffb700 1 -- 172.21.15.26:0/3096390473 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa71c0097d0 con 0x7fa7200f55d0 2021-11-03T18:32:44.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.575+0000 7fa7277f0700 1 -- 172.21.15.26:0/3096390473 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa72010ea80 con 0x7fa7200f55d0 2021-11-03T18:32:44.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.575+0000 7fa711ffb700 1 -- 172.21.15.26:0/3096390473 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa71c01c3c0 con 0x7fa7200f55d0 2021-11-03T18:32:44.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.575+0000 7fa7277f0700 1 -- 172.21.15.26:0/3096390473 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa72010ee50 con 0x7fa7200f55d0 2021-11-03T18:32:44.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.576+0000 7fa7277f0700 1 -- 172.21.15.26:0/3096390473 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7200f49c0 con 0x7fa7200f55d0 2021-11-03T18:32:44.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.577+0000 7fa711ffb700 1 -- 172.21.15.26:0/3096390473 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fa71c007ba0 con 0x7fa7200f55d0 2021-11-03T18:32:44.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.577+0000 7fa711ffb700 1 --2- 172.21.15.26:0/3096390473 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa70c0640b0 0x7fa70c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:32:44.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.577+0000 7fa711ffb700 1 -- 172.21.15.26:0/3096390473 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fa71c082430 con 0x7fa7200f55d0 2021-11-03T18:32:44.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.577+0000 7fa724d8b700 1 --2- 172.21.15.26:0/3096390473 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa70c0640b0 0x7fa70c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:32:44.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.578+0000 7fa724d8b700 1 --2- 172.21.15.26:0/3096390473 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa70c0640b0 0x7fa70c066570 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7fa714004a10 tx=0x7fa7140099e0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:32:44.584 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.581+0000 7fa711ffb700 1 -- 172.21.15.26:0/3096390473 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fa71c054790 con 0x7fa7200f55d0 2021-11-03T18:32:44.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.786+0000 7fa7277f0700 1 -- 172.21.15.26:0/3096390473 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa720045ad0 con 0x7fa7200f55d0 2021-11-03T18:32:44.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.787+0000 7fa711ffb700 1 -- 172.21.15.26:0/3096390473 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fa71c054380 con 0x7fa7200f55d0 2021-11-03T18:32:44.786 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:32:44.786 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:32:44.786 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:32:44.787 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:32:44.787 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:32:44.787 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:32:44.787 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:32:44.788 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:32:44.788 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:32:44.789 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:32:44.790 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:32:44.790 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:32:44.790 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:32:44.791 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:32:44.791 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:32:44.791 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:32:44.791 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:32:44.792 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:32:44.792 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:32:44.792 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:32:44.792 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:32:44.792 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:32:44.793 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:32:44.793 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:32:44.793 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:32:44.793 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:32:44.793 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:32:44.794 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:32:44.794 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:32:44.794 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:32:44.794 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:32:44.795 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:32:44.795 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:32:44.795 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:32:44.795 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:32:44.796 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:32:44.796 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:32:44.796 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:32:44.796 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:32:44.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.788+0000 7fa7277f0700 1 -- 172.21.15.26:0/3096390473 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa70c0640b0 msgr2=0x7fa70c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:32:44.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.788+0000 7fa7277f0700 1 --2- 172.21.15.26:0/3096390473 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa70c0640b0 0x7fa70c066570 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7fa714004a10 tx=0x7fa7140099e0).stop 2021-11-03T18:32:44.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.788+0000 7fa7277f0700 1 -- 172.21.15.26:0/3096390473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7200f55d0 msgr2=0x7fa72010c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:32:44.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.788+0000 7fa7277f0700 1 --2- 172.21.15.26:0/3096390473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7200f55d0 0x7fa72010c090 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 rx=0x7fa71c013a70 tx=0x7fa71c009b30).stop 2021-11-03T18:32:44.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.789+0000 7fa7277f0700 1 -- 172.21.15.26:0/3096390473 shutdown_connections 2021-11-03T18:32:44.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.789+0000 7fa7277f0700 1 --2- 172.21.15.26:0/3096390473 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa70c0640b0 0x7fa70c066570 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:44.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.789+0000 7fa7277f0700 1 --2- 172.21.15.26:0/3096390473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7200f55d0 0x7fa72010c090 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:32:44.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.789+0000 7fa7277f0700 1 --2- 172.21.15.26:0/3096390473 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7200f6870 0x7fa72010e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:32:44.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.789+0000 7fa7277f0700 1 -- 172.21.15.26:0/3096390473 >> 172.21.15.26:0/3096390473 conn(0x7fa7200f0d30 msgr2=0x7fa7200fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:32:44.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.789+0000 7fa7277f0700 1 -- 172.21.15.26:0/3096390473 shutdown_connections 2021-11-03T18:32:44.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:32:44.789+0000 7fa7277f0700 1 -- 172.21.15.26:0/3096390473 wait complete. 2021-11-03T18:32:44.800 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:32:45.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:45 smithi026 ceph-mon[96795]: from='client.37164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:32:45.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:45 smithi026 ceph-mon[96795]: pgmap v2942: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:45.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:45 smithi026 ceph-mon[96795]: from='client.37168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:32:45.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:45 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1140716933' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:32:45.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:45 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3096390473' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:32:45.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:45 smithi194 ceph-mon[65619]: from='client.37164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:32:45.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:45 smithi194 ceph-mon[65619]: pgmap v2942: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:45.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:45 smithi194 ceph-mon[65619]: from='client.37168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:32:45.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:45 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1140716933' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:32:45.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:45 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3096390473' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:32:47.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:47 smithi026 ceph-mon[96795]: pgmap v2943: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:47.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:47 smithi194 ceph-mon[65619]: pgmap v2943: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:49 smithi026 ceph-mon[96795]: pgmap v2944: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:32:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:32:49.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:49 smithi194 ceph-mon[65619]: pgmap v2944: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:32:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:32:51.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:50 smithi194 ceph-mon[65619]: pgmap v2945: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:51.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:50 smithi026 ceph-mon[96795]: pgmap v2945: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:53.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:53 smithi026 ceph-mon[96795]: pgmap v2946: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:53.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:53 smithi194 ceph-mon[65619]: pgmap v2946: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:54.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:32:54.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:32:55.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:55 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:32:55.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:55 smithi026 ceph-mon[96795]: pgmap v2947: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:55.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:55 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:32:55.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:55 smithi194 ceph-mon[65619]: pgmap v2947: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:57.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:57 smithi026 ceph-mon[96795]: pgmap v2948: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:57.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:57 smithi194 ceph-mon[65619]: pgmap v2948: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:59.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:32:59 smithi026 ceph-mon[96795]: pgmap v2949: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:32:59.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:32:59 smithi194 ceph-mon[65619]: pgmap v2949: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:01.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:00 smithi194 ceph-mon[65619]: pgmap v2950: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:01.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:00 smithi026 ceph-mon[96795]: pgmap v2950: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:03.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:03 smithi026 ceph-mon[96795]: pgmap v2951: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:03.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:03 smithi194 ceph-mon[65619]: pgmap v2951: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:05.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:05 smithi026 ceph-mon[96795]: pgmap v2952: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:05.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:05 smithi194 ceph-mon[65619]: pgmap v2952: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:07.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:07 smithi026 ceph-mon[96795]: pgmap v2953: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:07.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:07 smithi194 ceph-mon[65619]: pgmap v2953: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:09.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:09 smithi026 ceph-mon[96795]: pgmap v2954: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:09.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:09 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:33:09.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:09 smithi194 ceph-mon[65619]: pgmap v2954: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:09.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:09 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:33:10.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:10 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:33:10.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:10 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:33:11.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:11 smithi026 ceph-mon[96795]: pgmap v2955: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:11.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:11 smithi194 ceph-mon[65619]: pgmap v2955: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:13.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:13 smithi026 ceph-mon[96795]: pgmap v2956: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:13.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:13 smithi194 ceph-mon[65619]: pgmap v2956: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:14.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:14.904+0000 7fed6eaee700 1 -- 172.21.15.26:0/3142575633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed680f7980 msgr2=0x7fed680f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:33:14.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:14.904+0000 7fed6eaee700 1 --2- 172.21.15.26:0/3142575633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed680f7980 0x7fed680f7de0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 rx=0x7fed580099e0 tx=0x7fed58004d10).stop 2021-11-03T18:33:14.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:14.904+0000 7fed6eaee700 1 -- 172.21.15.26:0/3142575633 shutdown_connections 2021-11-03T18:33:14.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:14.904+0000 7fed6eaee700 1 --2- 172.21.15.26:0/3142575633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed680f7980 0x7fed680f7de0 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:14.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:14.904+0000 7fed6eaee700 1 --2- 172.21.15.26:0/3142575633 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed680f66e0 0x7fed680f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:14.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:14.904+0000 7fed6eaee700 1 -- 172.21.15.26:0/3142575633 >> 172.21.15.26:0/3142575633 conn(0x7fed680f1e40 msgr2=0x7fed680f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:33:14.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:14.904+0000 7fed6eaee700 1 -- 172.21.15.26:0/3142575633 shutdown_connections 2021-11-03T18:33:14.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:14.904+0000 7fed6eaee700 1 -- 172.21.15.26:0/3142575633 wait complete. 2021-11-03T18:33:14.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:14.905+0000 7fed6eaee700 1 Processor -- start 2021-11-03T18:33:14.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:14.905+0000 7fed6eaee700 1 -- start start 2021-11-03T18:33:14.907 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:14.905+0000 7fed6eaee700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed680f66e0 0x7fed68107080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:33:14.907 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:14.905+0000 7fed6eaee700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed680f7980 0x7fed68107570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:33:14.907 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:14.905+0000 7fed6eaee700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed68107b20 con 0x7fed680f7980 2021-11-03T18:33:14.908 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:14.905+0000 7fed6eaee700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed68107c60 con 0x7fed680f66e0 2021-11-03T18:33:14.908 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:14.905+0000 7fed67fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed680f7980 0x7fed68107570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:33:14.908 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:14.905+0000 7fed67fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed680f7980 0x7fed68107570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60666/0 (socket says 172.21.15.26:60666) 2021-11-03T18:33:14.908 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:14.905+0000 7fed67fff700 1 -- 172.21.15.26:0/1056066662 learned_addr learned my addr 172.21.15.26:0/1056066662 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:33:14.909 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:14.905+0000 7fed6c88a700 1 --2- 172.21.15.26:0/1056066662 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed680f66e0 0x7fed68107080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:33:14.909 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:14.905+0000 7fed67fff700 1 -- 172.21.15.26:0/1056066662 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed680f66e0 msgr2=0x7fed68107080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:33:14.909 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:14.905+0000 7fed67fff700 1 --2- 172.21.15.26:0/1056066662 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed680f66e0 0x7fed68107080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:14.909 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:14.905+0000 7fed67fff700 1 -- 172.21.15.26:0/1056066662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed58009640 con 0x7fed680f7980 2021-11-03T18:33:14.910 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:14.906+0000 7fed67fff700 1 --2- 172.21.15.26:0/1056066662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed680f7980 0x7fed68107570 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 rx=0x7fed5800b3b0 tx=0x7fed58004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:33:14.910 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:14.906+0000 7fed657fa700 1 -- 172.21.15.26:0/1056066662 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed5800e030 con 0x7fed680f7980 2021-11-03T18:33:14.910 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:14.906+0000 7fed657fa700 1 -- 172.21.15.26:0/1056066662 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fed580049b0 con 0x7fed680f7980 2021-11-03T18:33:14.910 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:14.906+0000 7fed657fa700 1 -- 172.21.15.26:0/1056066662 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed58018070 con 0x7fed680f7980 2021-11-03T18:33:14.910 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:14.906+0000 7fed6eaee700 1 -- 172.21.15.26:0/1056066662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed681085a0 con 0x7fed680f7980 2021-11-03T18:33:14.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:14.906+0000 7fed6eaee700 1 -- 172.21.15.26:0/1056066662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed68108a30 con 0x7fed680f7980 2021-11-03T18:33:14.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:14.907+0000 7fed6eaee700 1 -- 172.21.15.26:0/1056066662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed68045ad0 con 0x7fed680f7980 2021-11-03T18:33:14.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:14.907+0000 7fed657fa700 1 -- 172.21.15.26:0/1056066662 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fed58007d40 con 0x7fed680f7980 2021-11-03T18:33:14.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:14.908+0000 7fed657fa700 1 --2- 172.21.15.26:0/1056066662 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fed540640b0 0x7fed54066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:33:14.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:14.908+0000 7fed657fa700 1 -- 172.21.15.26:0/1056066662 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fed58082540 con 0x7fed680f7980 2021-11-03T18:33:14.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:14.908+0000 7fed6c88a700 1 --2- 172.21.15.26:0/1056066662 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fed540640b0 0x7fed54066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:33:14.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:14.908+0000 7fed6c88a700 1 --2- 172.21.15.26:0/1056066662 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fed540640b0 0x7fed54066570 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7fed680f77e0 tx=0x7fed60009c00).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:33:14.913 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:14.912+0000 7fed657fa700 1 -- 172.21.15.26:0/1056066662 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fed580548a0 con 0x7fed680f7980 2021-11-03T18:33:15.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.095+0000 7fed6eaee700 1 -- 172.21.15.26:0/1056066662 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fed68108ca0 con 0x7fed540640b0 2021-11-03T18:33:15.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.096+0000 7fed657fa700 1 -- 172.21.15.26:0/1056066662 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fed68108ca0 con 0x7fed540640b0 2021-11-03T18:33:15.096 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.098+0000 7fed6eaee700 1 -- 172.21.15.26:0/1056066662 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fed540640b0 msgr2=0x7fed54066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:33:15.096 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.098+0000 7fed6eaee700 1 --2- 172.21.15.26:0/1056066662 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fed540640b0 0x7fed54066570 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7fed680f77e0 tx=0x7fed60009c00).stop 2021-11-03T18:33:15.096 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.098+0000 7fed6eaee700 1 -- 172.21.15.26:0/1056066662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed680f7980 msgr2=0x7fed68107570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:33:15.097 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.098+0000 7fed6eaee700 1 --2- 172.21.15.26:0/1056066662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed680f7980 0x7fed68107570 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 rx=0x7fed5800b3b0 tx=0x7fed58004d10).stop 2021-11-03T18:33:15.097 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.098+0000 7fed6eaee700 1 -- 172.21.15.26:0/1056066662 shutdown_connections 2021-11-03T18:33:15.097 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.098+0000 7fed6eaee700 1 --2- 172.21.15.26:0/1056066662 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fed540640b0 0x7fed54066570 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:15.097 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.098+0000 7fed6eaee700 1 --2- 172.21.15.26:0/1056066662 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed680f66e0 0x7fed68107080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:15.098 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.098+0000 7fed6eaee700 1 --2- 172.21.15.26:0/1056066662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed680f7980 0x7fed68107570 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:15.098 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.098+0000 7fed6eaee700 1 -- 172.21.15.26:0/1056066662 >> 172.21.15.26:0/1056066662 conn(0x7fed680f1e40 msgr2=0x7fed680fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:33:15.098 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.098+0000 7fed6eaee700 1 -- 172.21.15.26:0/1056066662 shutdown_connections 2021-11-03T18:33:15.098 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.098+0000 7fed6eaee700 1 -- 172.21.15.26:0/1056066662 wait complete. 2021-11-03T18:33:15.106 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:33:15.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.198+0000 7f30f12c5700 1 -- 172.21.15.26:0/3540918643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30ec0f6ff0 msgr2=0x7f30ec0f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:33:15.198 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.198+0000 7f30f12c5700 1 --2- 172.21.15.26:0/3540918643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30ec0f6ff0 0x7f30ec0f7a20 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 rx=0x7f30d4004660 tx=0x7f30d4009b30).stop 2021-11-03T18:33:15.198 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.198+0000 7f30f12c5700 1 -- 172.21.15.26:0/3540918643 shutdown_connections 2021-11-03T18:33:15.198 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.198+0000 7f30f12c5700 1 --2- 172.21.15.26:0/3540918643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30ec0f6ff0 0x7f30ec0f7a20 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:15.199 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.198+0000 7f30f12c5700 1 --2- 172.21.15.26:0/3540918643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30ec0f66e0 0x7f30ec0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:15.199 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.198+0000 7f30f12c5700 1 -- 172.21.15.26:0/3540918643 >> 172.21.15.26:0/3540918643 conn(0x7f30ec0f1f00 msgr2=0x7f30ec0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:33:15.200 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.198+0000 7f30f12c5700 1 -- 172.21.15.26:0/3540918643 shutdown_connections 2021-11-03T18:33:15.200 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.198+0000 7f30f12c5700 1 -- 172.21.15.26:0/3540918643 wait complete. 2021-11-03T18:33:15.200 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.199+0000 7f30f12c5700 1 Processor -- start 2021-11-03T18:33:15.200 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.199+0000 7f30f12c5700 1 -- start start 2021-11-03T18:33:15.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.199+0000 7f30f12c5700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30ec0f66e0 0x7f30ec06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:33:15.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.199+0000 7f30f12c5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30ec0f6ff0 0x7f30ec069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:33:15.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.199+0000 7f30f12c5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ec06a380 con 0x7f30ec0f6ff0 2021-11-03T18:33:15.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.199+0000 7f30f12c5700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ec06a4c0 con 0x7f30ec0f66e0 2021-11-03T18:33:15.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.199+0000 7f30ea7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30ec0f6ff0 0x7f30ec069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:33:15.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.199+0000 7f30ea7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30ec0f6ff0 0x7f30ec069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60676/0 (socket says 172.21.15.26:60676) 2021-11-03T18:33:15.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.199+0000 7f30ea7fc700 1 -- 172.21.15.26:0/3386115503 learned_addr learned my addr 172.21.15.26:0/3386115503 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:33:15.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.199+0000 7f30eaffd700 1 --2- 172.21.15.26:0/3386115503 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30ec0f66e0 0x7f30ec06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:33:15.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.199+0000 7f30ea7fc700 1 -- 172.21.15.26:0/3386115503 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30ec0f66e0 msgr2=0x7f30ec06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:33:15.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.199+0000 7f30ea7fc700 1 --2- 172.21.15.26:0/3386115503 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30ec0f66e0 0x7f30ec06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:15.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.199+0000 7f30ea7fc700 1 -- 172.21.15.26:0/3386115503 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d4005040 con 0x7f30ec0f6ff0 2021-11-03T18:33:15.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.199+0000 7f30ea7fc700 1 --2- 172.21.15.26:0/3386115503 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30ec0f6ff0 0x7f30ec069e20 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 rx=0x7f30d4009990 tx=0x7f30d4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:33:15.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.199+0000 7f30e37fe700 1 -- 172.21.15.26:0/3386115503 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30d4018070 con 0x7f30ec0f6ff0 2021-11-03T18:33:15.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.200+0000 7f30e37fe700 1 -- 172.21.15.26:0/3386115503 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f30d4007ba0 con 0x7f30ec0f6ff0 2021-11-03T18:33:15.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.200+0000 7f30e37fe700 1 -- 172.21.15.26:0/3386115503 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30d401c620 con 0x7f30ec0f6ff0 2021-11-03T18:33:15.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.200+0000 7f30f12c5700 1 -- 172.21.15.26:0/3386115503 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30ec06a740 con 0x7f30ec0f6ff0 2021-11-03T18:33:15.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.200+0000 7f30f12c5700 1 -- 172.21.15.26:0/3386115503 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30ec06aca0 con 0x7f30ec0f6ff0 2021-11-03T18:33:15.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.200+0000 7f30f12c5700 1 -- 172.21.15.26:0/3386115503 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30ec045ad0 con 0x7f30ec0f6ff0 2021-11-03T18:33:15.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.201+0000 7f30e37fe700 1 -- 172.21.15.26:0/3386115503 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f30d401c8e0 con 0x7f30ec0f6ff0 2021-11-03T18:33:15.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.201+0000 7f30e37fe700 1 --2- 172.21.15.26:0/3386115503 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f30d80640b0 0x7f30d8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:33:15.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.201+0000 7f30e37fe700 1 -- 172.21.15.26:0/3386115503 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f30d4082600 con 0x7f30ec0f6ff0 2021-11-03T18:33:15.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.201+0000 7f30eaffd700 1 --2- 172.21.15.26:0/3386115503 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f30d80640b0 0x7f30d8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:33:15.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.202+0000 7f30eaffd700 1 --2- 172.21.15.26:0/3386115503 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f30d80640b0 0x7f30d8066570 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7f30e4004550 tx=0x7f30e4009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:33:15.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.205+0000 7f30e37fe700 1 -- 172.21.15.26:0/3386115503 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f30d4054a20 con 0x7f30ec0f6ff0 2021-11-03T18:33:15.376 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.378+0000 7f30f12c5700 1 -- 172.21.15.26:0/3386115503 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f30ec0ff040 con 0x7f30d80640b0 2021-11-03T18:33:15.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.393+0000 7f30e37fe700 1 -- 172.21.15.26:0/3386115503 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7f30ec0ff040 con 0x7f30d80640b0 2021-11-03T18:33:15.392 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:33:15.392 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (104m) 2m ago 105m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:33:15.393 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (96m) 2m ago 105m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:33:15.393 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (96m) 97s ago 104m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:33:15.394 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (104m) 2m ago 105m 42.3M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:33:15.394 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (97m) 2m ago 100m 26.2M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:33:15.395 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (97m) 2m ago 100m 26.8M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:33:15.395 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (100m) 97s ago 100m 27.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:33:15.396 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (100m) 97s ago 100m 27.4M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:33:15.396 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (98m) 2m ago 107m 601M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:33:15.396 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (97m) 97s ago 104m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:33:15.397 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (97m) 2m ago 107m 374M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:33:15.397 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (97m) 97s ago 104m 171M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:33:15.397 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (105m) 2m ago 105m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:33:15.398 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (104m) 97s ago 104m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:33:15.398 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (96m) 2m ago 104m 352M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:33:15.399 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (95m) 2m ago 103m 379M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:33:15.399 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (95m) 2m ago 103m 314M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:33:15.400 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (94m) 97s ago 103m 413M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:33:15.400 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (94m) 97s ago 102m 339M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:33:15.400 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (93m) 97s ago 102m 337M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:33:15.401 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (104m) 2m ago 105m 68.0M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:33:15.403 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.394+0000 7f30f12c5700 1 -- 172.21.15.26:0/3386115503 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f30d80640b0 msgr2=0x7f30d8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:33:15.403 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.395+0000 7f30f12c5700 1 --2- 172.21.15.26:0/3386115503 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f30d80640b0 0x7f30d8066570 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7f30e4004550 tx=0x7f30e4009040).stop 2021-11-03T18:33:15.404 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.395+0000 7f30f12c5700 1 -- 172.21.15.26:0/3386115503 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30ec0f6ff0 msgr2=0x7f30ec069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:33:15.404 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.395+0000 7f30f12c5700 1 --2- 172.21.15.26:0/3386115503 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30ec0f6ff0 0x7f30ec069e20 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 rx=0x7f30d4009990 tx=0x7f30d4009b30).stop 2021-11-03T18:33:15.404 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.395+0000 7f30f12c5700 1 -- 172.21.15.26:0/3386115503 shutdown_connections 2021-11-03T18:33:15.405 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.395+0000 7f30f12c5700 1 --2- 172.21.15.26:0/3386115503 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f30d80640b0 0x7f30d8066570 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:15.405 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.395+0000 7f30f12c5700 1 --2- 172.21.15.26:0/3386115503 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30ec0f66e0 0x7f30ec06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:15.406 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.395+0000 7f30f12c5700 1 --2- 172.21.15.26:0/3386115503 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30ec0f6ff0 0x7f30ec069e20 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:15.406 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.395+0000 7f30f12c5700 1 -- 172.21.15.26:0/3386115503 >> 172.21.15.26:0/3386115503 conn(0x7f30ec0f1f00 msgr2=0x7f30ec0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:33:15.406 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.395+0000 7f30f12c5700 1 -- 172.21.15.26:0/3386115503 shutdown_connections 2021-11-03T18:33:15.407 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.395+0000 7f30f12c5700 1 -- 172.21.15.26:0/3386115503 wait complete. 2021-11-03T18:33:15.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:15 smithi026 ceph-mon[96795]: pgmap v2957: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:15.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.495+0000 7f1437691700 1 -- 172.21.15.26:0/1096002294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14300f55e0 msgr2=0x7f14300f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:33:15.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.495+0000 7f1437691700 1 --2- 172.21.15.26:0/1096002294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14300f55e0 0x7f14300f5a00 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 rx=0x7f14280099e0 tx=0x7f1428004d10).stop 2021-11-03T18:33:15.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.495+0000 7f1437691700 1 -- 172.21.15.26:0/1096002294 shutdown_connections 2021-11-03T18:33:15.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.495+0000 7f1437691700 1 --2- 172.21.15.26:0/1096002294 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14300f5ef0 0x7f14300f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:15.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.495+0000 7f1437691700 1 --2- 172.21.15.26:0/1096002294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14300f55e0 0x7f14300f5a00 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:15.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.495+0000 7f1437691700 1 -- 172.21.15.26:0/1096002294 >> 172.21.15.26:0/1096002294 conn(0x7f14300f0de0 msgr2=0x7f14300f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:33:15.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.495+0000 7f1437691700 1 -- 172.21.15.26:0/1096002294 shutdown_connections 2021-11-03T18:33:15.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.495+0000 7f1437691700 1 -- 172.21.15.26:0/1096002294 wait complete. 2021-11-03T18:33:15.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.495+0000 7f1437691700 1 Processor -- start 2021-11-03T18:33:15.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.495+0000 7f1437691700 1 -- start start 2021-11-03T18:33:15.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.496+0000 7f1437691700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14300f55e0 0x7f143010c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:33:15.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.496+0000 7f1437691700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14300f5ef0 0x7f143010e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:33:15.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.496+0000 7f1437691700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14300603d0 con 0x7f14300f55e0 2021-11-03T18:33:15.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.496+0000 7f1437691700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1430060510 con 0x7f14300f5ef0 2021-11-03T18:33:15.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.496+0000 7f143542d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14300f55e0 0x7f143010c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:33:15.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.496+0000 7f143542d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14300f55e0 0x7f143010c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60684/0 (socket says 172.21.15.26:60684) 2021-11-03T18:33:15.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.496+0000 7f143542d700 1 -- 172.21.15.26:0/467184137 learned_addr learned my addr 172.21.15.26:0/467184137 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:33:15.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.496+0000 7f143542d700 1 -- 172.21.15.26:0/467184137 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14300f5ef0 msgr2=0x7f143010e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:33:15.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.496+0000 7f1434c2c700 1 --2- 172.21.15.26:0/467184137 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14300f5ef0 0x7f143010e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:33:15.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.496+0000 7f143542d700 1 --2- 172.21.15.26:0/467184137 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14300f5ef0 0x7f143010e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:15.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.496+0000 7f143542d700 1 -- 172.21.15.26:0/467184137 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1428009640 con 0x7f14300f55e0 2021-11-03T18:33:15.499 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.496+0000 7f143542d700 1 --2- 172.21.15.26:0/467184137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14300f55e0 0x7f143010c180 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 rx=0x7f1428003380 tx=0x7f1428004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:33:15.500 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.496+0000 7f142dffb700 1 -- 172.21.15.26:0/467184137 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f142800e030 con 0x7f14300f55e0 2021-11-03T18:33:15.500 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.496+0000 7f142dffb700 1 -- 172.21.15.26:0/467184137 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1428007dd0 con 0x7f14300f55e0 2021-11-03T18:33:15.500 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.496+0000 7f1437691700 1 -- 172.21.15.26:0/467184137 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f143010eb70 con 0x7f14300f55e0 2021-11-03T18:33:15.500 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.496+0000 7f142dffb700 1 -- 172.21.15.26:0/467184137 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1428018070 con 0x7f14300f55e0 2021-11-03T18:33:15.500 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.496+0000 7f1437691700 1 -- 172.21.15.26:0/467184137 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f143010ef40 con 0x7f14300f55e0 2021-11-03T18:33:15.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:15 smithi194 ceph-mon[65619]: pgmap v2957: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:15.502 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.497+0000 7f1437691700 1 -- 172.21.15.26:0/467184137 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14300f4a70 con 0x7f14300f55e0 2021-11-03T18:33:15.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.498+0000 7f142dffb700 1 -- 172.21.15.26:0/467184137 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f1428024060 con 0x7f14300f55e0 2021-11-03T18:33:15.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.498+0000 7f142dffb700 1 --2- 172.21.15.26:0/467184137 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1418064090 0x7f1418066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:33:15.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.498+0000 7f142dffb700 1 -- 172.21.15.26:0/467184137 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f1428082210 con 0x7f14300f55e0 2021-11-03T18:33:15.503 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.498+0000 7f1434c2c700 1 --2- 172.21.15.26:0/467184137 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1418064090 0x7f1418066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:33:15.504 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.499+0000 7f1434c2c700 1 --2- 172.21.15.26:0/467184137 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1418064090 0x7f1418066550 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f1424009da0 tx=0x7f142400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:33:15.504 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.502+0000 7f142dffb700 1 -- 172.21.15.26:0/467184137 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f1428054510 con 0x7f14300f55e0 2021-11-03T18:33:15.732 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.734+0000 7f1437691700 1 -- 172.21.15.26:0/467184137 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f14300fdef0 con 0x7f14300f55e0 2021-11-03T18:33:15.732 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.735+0000 7f142dffb700 1 -- 172.21.15.26:0/467184137 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f1428054100 con 0x7f14300f55e0 2021-11-03T18:33:15.733 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:33:15.733 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:33:15.733 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:33:15.734 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:33:15.734 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:33:15.734 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:33:15.734 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:33:15.734 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:33:15.735 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:33:15.735 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:33:15.735 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:33:15.735 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:33:15.736 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:33:15.736 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:33:15.736 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:33:15.736 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:33:15.736 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:33:15.737 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:33:15.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.736+0000 7f1437691700 1 -- 172.21.15.26:0/467184137 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1418064090 msgr2=0x7f1418066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:33:15.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.736+0000 7f1437691700 1 --2- 172.21.15.26:0/467184137 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1418064090 0x7f1418066550 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f1424009da0 tx=0x7f142400b040).stop 2021-11-03T18:33:15.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.736+0000 7f1437691700 1 -- 172.21.15.26:0/467184137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14300f55e0 msgr2=0x7f143010c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:33:15.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.736+0000 7f1437691700 1 --2- 172.21.15.26:0/467184137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14300f55e0 0x7f143010c180 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 rx=0x7f1428003380 tx=0x7f1428004d10).stop 2021-11-03T18:33:15.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.736+0000 7f1437691700 1 -- 172.21.15.26:0/467184137 shutdown_connections 2021-11-03T18:33:15.739 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.736+0000 7f1437691700 1 --2- 172.21.15.26:0/467184137 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1418064090 0x7f1418066550 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:15.739 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.736+0000 7f1437691700 1 --2- 172.21.15.26:0/467184137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14300f55e0 0x7f143010c180 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:15.739 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.736+0000 7f1437691700 1 --2- 172.21.15.26:0/467184137 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14300f5ef0 0x7f143010e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:15.739 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.736+0000 7f1437691700 1 -- 172.21.15.26:0/467184137 >> 172.21.15.26:0/467184137 conn(0x7f14300f0de0 msgr2=0x7f14300fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:33:15.740 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.736+0000 7f1437691700 1 -- 172.21.15.26:0/467184137 shutdown_connections 2021-11-03T18:33:15.740 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.736+0000 7f1437691700 1 -- 172.21.15.26:0/467184137 wait complete. 2021-11-03T18:33:15.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.836+0000 7fb3faf45700 1 -- 172.21.15.26:0/360862345 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3f40f6880 msgr2=0x7fb3f40f6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:33:15.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.836+0000 7fb3faf45700 1 --2- 172.21.15.26:0/360862345 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3f40f6880 0x7fb3f40f6ce0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 rx=0x7fb3e0004660 tx=0x7fb3e0009b30).stop 2021-11-03T18:33:15.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.836+0000 7fb3faf45700 1 -- 172.21.15.26:0/360862345 shutdown_connections 2021-11-03T18:33:15.837 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.836+0000 7fb3faf45700 1 --2- 172.21.15.26:0/360862345 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3f40f6880 0x7fb3f40f6ce0 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:15.837 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.836+0000 7fb3faf45700 1 --2- 172.21.15.26:0/360862345 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3f40f55e0 0x7fb3f40f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:33:15.837 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.836+0000 7fb3faf45700 1 -- 172.21.15.26:0/360862345 >> 172.21.15.26:0/360862345 conn(0x7fb3f40f0d40 msgr2=0x7fb3f40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:33:15.837 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.836+0000 7fb3faf45700 1 -- 172.21.15.26:0/360862345 shutdown_connections 2021-11-03T18:33:15.838 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.836+0000 7fb3faf45700 1 -- 172.21.15.26:0/360862345 wait complete. 2021-11-03T18:33:15.838 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.837+0000 7fb3faf45700 1 Processor -- start 2021-11-03T18:33:15.838 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.837+0000 7fb3faf45700 1 -- start start 2021-11-03T18:33:15.838 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.837+0000 7fb3faf45700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3f40f55e0 0x7fb3f4109c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:33:15.839 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.837+0000 7fb3faf45700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3f40f6880 0x7fb3f410c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:33:15.839 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.837+0000 7fb3faf45700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f4060590 con 0x7fb3f40f55e0 2021-11-03T18:33:15.839 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.837+0000 7fb3faf45700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f40606d0 con 0x7fb3f40f6880 2021-11-03T18:33:15.839 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.837+0000 7fb3f8ce1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3f40f55e0 0x7fb3f4109c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:33:15.840 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.837+0000 7fb3f8ce1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3f40f55e0 0x7fb3f4109c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60694/0 (socket says 172.21.15.26:60694) 2021-11-03T18:33:15.840 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.837+0000 7fb3f8ce1700 1 -- 172.21.15.26:0/3615833394 learned_addr learned my addr 172.21.15.26:0/3615833394 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:33:15.840 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.837+0000 7fb3f3fff700 1 --2- 172.21.15.26:0/3615833394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3f40f6880 0x7fb3f410c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:33:15.840 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.837+0000 7fb3f8ce1700 1 -- 172.21.15.26:0/3615833394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3f40f6880 msgr2=0x7fb3f410c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:33:15.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.837+0000 7fb3f8ce1700 1 --2- 172.21.15.26:0/3615833394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3f40f6880 0x7fb3f410c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:15.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.837+0000 7fb3f8ce1700 1 -- 172.21.15.26:0/3615833394 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e0005040 con 0x7fb3f40f55e0 2021-11-03T18:33:15.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.838+0000 7fb3f8ce1700 1 --2- 172.21.15.26:0/3615833394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3f40f55e0 0x7fb3f4109c60 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 rx=0x7fb3e80093f0 tx=0x7fb3e8006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:33:15.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.838+0000 7fb3f17fa700 1 -- 172.21.15.26:0/3615833394 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3e8013640 con 0x7fb3f40f55e0 2021-11-03T18:33:15.842 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.838+0000 7fb3faf45700 1 -- 172.21.15.26:0/3615833394 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3f410c7c0 con 0x7fb3f40f55e0 2021-11-03T18:33:15.842 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.838+0000 7fb3f17fa700 1 -- 172.21.15.26:0/3615833394 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb3e8013c50 con 0x7fb3f40f55e0 2021-11-03T18:33:15.842 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.838+0000 7fb3f17fa700 1 -- 172.21.15.26:0/3615833394 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3e8012c70 con 0x7fb3f40f55e0 2021-11-03T18:33:15.842 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.838+0000 7fb3faf45700 1 -- 172.21.15.26:0/3615833394 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3f410cd50 con 0x7fb3f40f55e0 2021-11-03T18:33:15.843 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.839+0000 7fb3faf45700 1 -- 172.21.15.26:0/3615833394 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3f40f49d0 con 0x7fb3f40f55e0 2021-11-03T18:33:15.844 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.839+0000 7fb3f17fa700 1 -- 172.21.15.26:0/3615833394 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fb3e801a060 con 0x7fb3f40f55e0 2021-11-03T18:33:15.844 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.839+0000 7fb3f17fa700 1 --2- 172.21.15.26:0/3615833394 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb3e40640b0 0x7fb3e4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:33:15.844 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.840+0000 7fb3f17fa700 1 -- 172.21.15.26:0/3615833394 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fb3e8080980 con 0x7fb3f40f55e0 2021-11-03T18:33:15.844 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.840+0000 7fb3f3fff700 1 --2- 172.21.15.26:0/3615833394 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb3e40640b0 0x7fb3e4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:33:15.845 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.840+0000 7fb3f3fff700 1 --2- 172.21.15.26:0/3615833394 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb3e40640b0 0x7fb3e4066570 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7fb3e0004630 tx=0x7fb3e0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:33:15.845 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:15.844+0000 7fb3f17fa700 1 -- 172.21.15.26:0/3615833394 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fb3e8052ad0 con 0x7fb3f40f55e0 2021-11-03T18:33:16.046 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:16.048+0000 7fb3faf45700 1 -- 172.21.15.26:0/3615833394 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb3f4045ad0 con 0x7fb3f40f55e0 2021-11-03T18:33:16.046 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:16.048+0000 7fb3f17fa700 1 -- 172.21.15.26:0/3615833394 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fb3e8018710 con 0x7fb3f40f55e0 2021-11-03T18:33:16.047 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:33:16.047 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:33:16.047 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:33:16.047 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:33:16.047 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:33:16.048 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:33:16.048 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:33:16.048 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:33:16.048 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:33:16.049 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:33:16.049 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:33:16.049 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:33:16.049 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:33:16.050 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:33:16.050 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:33:16.050 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:33:16.050 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:33:16.050 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:33:16.051 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:33:16.051 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:33:16.051 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:33:16.051 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:33:16.052 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:33:16.052 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:33:16.052 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:33:16.052 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:33:16.053 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:33:16.053 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:33:16.053 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:33:16.053 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:33:16.054 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:33:16.054 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:33:16.054 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:33:16.054 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:33:16.054 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:33:16.055 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:33:16.055 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:33:16.055 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:33:16.055 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:33:16.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:16.050+0000 7fb3faf45700 1 -- 172.21.15.26:0/3615833394 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb3e40640b0 msgr2=0x7fb3e4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:33:16.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:16.050+0000 7fb3faf45700 1 --2- 172.21.15.26:0/3615833394 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb3e40640b0 0x7fb3e4066570 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7fb3e0004630 tx=0x7fb3e0009b30).stop 2021-11-03T18:33:16.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:16.050+0000 7fb3faf45700 1 -- 172.21.15.26:0/3615833394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3f40f55e0 msgr2=0x7fb3f4109c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:33:16.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:16.050+0000 7fb3faf45700 1 --2- 172.21.15.26:0/3615833394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3f40f55e0 0x7fb3f4109c60 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 rx=0x7fb3e80093f0 tx=0x7fb3e8006ec0).stop 2021-11-03T18:33:16.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:16.050+0000 7fb3faf45700 1 -- 172.21.15.26:0/3615833394 shutdown_connections 2021-11-03T18:33:16.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:16.050+0000 7fb3faf45700 1 --2- 172.21.15.26:0/3615833394 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb3e40640b0 0x7fb3e4066570 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:16.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:16.050+0000 7fb3faf45700 1 --2- 172.21.15.26:0/3615833394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3f40f55e0 0x7fb3f4109c60 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:16.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:16.050+0000 7fb3faf45700 1 --2- 172.21.15.26:0/3615833394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3f40f6880 0x7fb3f410c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:16.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:16.050+0000 7fb3faf45700 1 -- 172.21.15.26:0/3615833394 >> 172.21.15.26:0/3615833394 conn(0x7fb3f40f0d40 msgr2=0x7fb3f40fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:33:16.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:16.050+0000 7fb3faf45700 1 -- 172.21.15.26:0/3615833394 shutdown_connections 2021-11-03T18:33:16.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:16.050+0000 7fb3faf45700 1 -- 172.21.15.26:0/3615833394 wait complete. 2021-11-03T18:33:16.059 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:33:16.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:16 smithi026 ceph-mon[96795]: from='client.37180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:33:16.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:16 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/467184137' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:33:16.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:16 smithi194 ceph-mon[65619]: from='client.37180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:33:16.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:16 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/467184137' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:33:17.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:17 smithi026 ceph-mon[96795]: from='client.37184 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:33:17.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:17 smithi026 ceph-mon[96795]: pgmap v2958: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:17.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:17 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3615833394' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:33:17.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:17 smithi194 ceph-mon[65619]: from='client.37184 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:33:17.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:17 smithi194 ceph-mon[65619]: pgmap v2958: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:17.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:17 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3615833394' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:33:19.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:19 smithi026 ceph-mon[96795]: pgmap v2959: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:19.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:19 smithi194 ceph-mon[65619]: pgmap v2959: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:21.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:20 smithi194 ceph-mon[65619]: pgmap v2960: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:21.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:20 smithi026 ceph-mon[96795]: pgmap v2960: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:23.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:23 smithi026 ceph-mon[96795]: pgmap v2961: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:23.473 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:23 smithi194 ceph-mon[65619]: pgmap v2961: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:24.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:33:24.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:33:25.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:25 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:33:25.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:25 smithi026 ceph-mon[96795]: pgmap v2962: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:25.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:25 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:33:25.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:25 smithi194 ceph-mon[65619]: pgmap v2962: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:27.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:27 smithi026 ceph-mon[96795]: pgmap v2963: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:27.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:27 smithi194 ceph-mon[65619]: pgmap v2963: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:29.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:29 smithi026 ceph-mon[96795]: pgmap v2964: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:29.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:29 smithi194 ceph-mon[65619]: pgmap v2964: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:31.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:30 smithi194 ceph-mon[65619]: pgmap v2965: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:31.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:30 smithi026 ceph-mon[96795]: pgmap v2965: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:33.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:33 smithi026 ceph-mon[96795]: pgmap v2966: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:33.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:33 smithi194 ceph-mon[65619]: pgmap v2966: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:35.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:35 smithi026 ceph-mon[96795]: pgmap v2967: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:35.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:35 smithi194 ceph-mon[65619]: pgmap v2967: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:37.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:37 smithi026 ceph-mon[96795]: pgmap v2968: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:37.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:37 smithi194 ceph-mon[65619]: pgmap v2968: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:39.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:39 smithi026 ceph-mon[96795]: pgmap v2969: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:39.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:33:39.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:33:39.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:33:39.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:33:39.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:33:39.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:33:39.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:33:39.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:33:39.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:39 smithi194 ceph-mon[65619]: pgmap v2969: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:39.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:33:39.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:33:39.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:33:39.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:33:39.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:33:39.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:33:39.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:33:39.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:33:40.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:40 smithi026 ceph-mon[96795]: poll took 60051.409 ms: 1 events 2021-11-03T18:33:40.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:40 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:33:40.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:40 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:33:40.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:40 smithi194 ceph-mon[65619]: poll took 60051.409 ms: 1 events 2021-11-03T18:33:40.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:40 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:33:40.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:40 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:33:41.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:41 smithi026 ceph-mon[96795]: pgmap v2970: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:41.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:41 smithi194 ceph-mon[65619]: pgmap v2970: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:43.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:43 smithi026 ceph-mon[96795]: pgmap v2971: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:43.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:43 smithi194 ceph-mon[65619]: pgmap v2971: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:45.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:45 smithi026 ceph-mon[96795]: pgmap v2972: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:45.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:45 smithi194 ceph-mon[65619]: pgmap v2972: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:46.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.164+0000 7f3967f63700 1 -- 172.21.15.26:0/1352942292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39600f7980 msgr2=0x7f39600f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:33:46.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.164+0000 7f3967f63700 1 --2- 172.21.15.26:0/1352942292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39600f7980 0x7f39600f7de0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 rx=0x7f395c004660 tx=0x7f395c009b30).stop 2021-11-03T18:33:46.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.164+0000 7f3967f63700 1 -- 172.21.15.26:0/1352942292 shutdown_connections 2021-11-03T18:33:46.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.164+0000 7f3967f63700 1 --2- 172.21.15.26:0/1352942292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39600f7980 0x7f39600f7de0 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:46.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.164+0000 7f3967f63700 1 --2- 172.21.15.26:0/1352942292 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39600f66e0 0x7f39600f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:46.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.164+0000 7f3967f63700 1 -- 172.21.15.26:0/1352942292 >> 172.21.15.26:0/1352942292 conn(0x7f39600f1e40 msgr2=0x7f39600f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:33:46.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.164+0000 7f3967f63700 1 -- 172.21.15.26:0/1352942292 shutdown_connections 2021-11-03T18:33:46.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.164+0000 7f3967f63700 1 -- 172.21.15.26:0/1352942292 wait complete. 2021-11-03T18:33:46.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.165+0000 7f3967f63700 1 Processor -- start 2021-11-03T18:33:46.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.165+0000 7f3967f63700 1 -- start start 2021-11-03T18:33:46.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.165+0000 7f3967f63700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39600f66e0 0x7f3960106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:33:46.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.165+0000 7f3967f63700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39600f7980 0x7f3960107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:33:46.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.165+0000 7f3967f63700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3960107a00 con 0x7f39600f66e0 2021-11-03T18:33:46.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.165+0000 7f3967f63700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3960107b40 con 0x7f39600f7980 2021-11-03T18:33:46.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.165+0000 7f3965cff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39600f66e0 0x7f3960106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:33:46.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.165+0000 7f3965cff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39600f66e0 0x7f3960106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60712/0 (socket says 172.21.15.26:60712) 2021-11-03T18:33:46.169 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.165+0000 7f3965cff700 1 -- 172.21.15.26:0/1936801560 learned_addr learned my addr 172.21.15.26:0/1936801560 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:33:46.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.165+0000 7f39654fe700 1 --2- 172.21.15.26:0/1936801560 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39600f7980 0x7f3960107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:33:46.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.165+0000 7f3965cff700 1 -- 172.21.15.26:0/1936801560 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39600f7980 msgr2=0x7f3960107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:33:46.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.165+0000 7f3965cff700 1 --2- 172.21.15.26:0/1936801560 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39600f7980 0x7f3960107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:46.170 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.166+0000 7f3965cff700 1 -- 172.21.15.26:0/1936801560 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f395c005040 con 0x7f39600f66e0 2021-11-03T18:33:46.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.166+0000 7f3965cff700 1 --2- 172.21.15.26:0/1936801560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39600f66e0 0x7f3960106f60 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7f395000c790 tx=0x7f3950007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:33:46.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.166+0000 7f39567fc700 1 -- 172.21.15.26:0/1936801560 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3950013630 con 0x7f39600f66e0 2021-11-03T18:33:46.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.166+0000 7f39567fc700 1 -- 172.21.15.26:0/1936801560 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3950012860 con 0x7f39600f66e0 2021-11-03T18:33:46.171 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.166+0000 7f3967f63700 1 -- 172.21.15.26:0/1936801560 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39601084e0 con 0x7f39600f66e0 2021-11-03T18:33:46.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.166+0000 7f39567fc700 1 -- 172.21.15.26:0/1936801560 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3950002780 con 0x7f39600f66e0 2021-11-03T18:33:46.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.166+0000 7f3967f63700 1 -- 172.21.15.26:0/1936801560 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3960108aa0 con 0x7f39600f66e0 2021-11-03T18:33:46.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.167+0000 7f3967f63700 1 -- 172.21.15.26:0/1936801560 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3960045ad0 con 0x7f39600f66e0 2021-11-03T18:33:46.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.167+0000 7f39567fc700 1 -- 172.21.15.26:0/1936801560 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f3950010070 con 0x7f39600f66e0 2021-11-03T18:33:46.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.168+0000 7f39567fc700 1 --2- 172.21.15.26:0/1936801560 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f394c0640b0 0x7f394c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:33:46.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.168+0000 7f39567fc700 1 -- 172.21.15.26:0/1936801560 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f39500808b0 con 0x7f39600f66e0 2021-11-03T18:33:46.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.168+0000 7f39654fe700 1 --2- 172.21.15.26:0/1936801560 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f394c0640b0 0x7f394c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:33:46.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.168+0000 7f39654fe700 1 --2- 172.21.15.26:0/1936801560 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f394c0640b0 0x7f394c066570 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7f395c004630 tx=0x7f395c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:33:46.175 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.172+0000 7f39567fc700 1 -- 172.21.15.26:0/1936801560 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f3950052ac0 con 0x7f39600f66e0 2021-11-03T18:33:46.351 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.352+0000 7f3967f63700 1 -- 172.21.15.26:0/1936801560 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f39600fefe0 con 0x7f394c0640b0 2021-11-03T18:33:46.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.354+0000 7f39567fc700 1 -- 172.21.15.26:0/1936801560 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f39600fefe0 con 0x7f394c0640b0 2021-11-03T18:33:46.354 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.356+0000 7f3967f63700 1 -- 172.21.15.26:0/1936801560 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f394c0640b0 msgr2=0x7f394c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:33:46.355 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.356+0000 7f3967f63700 1 --2- 172.21.15.26:0/1936801560 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f394c0640b0 0x7f394c066570 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7f395c004630 tx=0x7f395c009b30).stop 2021-11-03T18:33:46.355 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.356+0000 7f3967f63700 1 -- 172.21.15.26:0/1936801560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39600f66e0 msgr2=0x7f3960106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:33:46.355 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.356+0000 7f3967f63700 1 --2- 172.21.15.26:0/1936801560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39600f66e0 0x7f3960106f60 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7f395000c790 tx=0x7f3950007d90).stop 2021-11-03T18:33:46.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.356+0000 7f3967f63700 1 -- 172.21.15.26:0/1936801560 shutdown_connections 2021-11-03T18:33:46.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.356+0000 7f3967f63700 1 --2- 172.21.15.26:0/1936801560 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f394c0640b0 0x7f394c066570 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:46.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.356+0000 7f3967f63700 1 --2- 172.21.15.26:0/1936801560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39600f66e0 0x7f3960106f60 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:46.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.356+0000 7f3967f63700 1 --2- 172.21.15.26:0/1936801560 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39600f7980 0x7f3960107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:46.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.356+0000 7f3967f63700 1 -- 172.21.15.26:0/1936801560 >> 172.21.15.26:0/1936801560 conn(0x7f39600f1e40 msgr2=0x7f39600fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:33:46.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.356+0000 7f3967f63700 1 -- 172.21.15.26:0/1936801560 shutdown_connections 2021-11-03T18:33:46.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.356+0000 7f3967f63700 1 -- 172.21.15.26:0/1936801560 wait complete. 2021-11-03T18:33:46.364 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:33:46.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.456+0000 7f3944baf700 1 -- 172.21.15.26:0/1372129683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39400f55e0 msgr2=0x7f39400f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:33:46.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.456+0000 7f3944baf700 1 --2- 172.21.15.26:0/1372129683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39400f55e0 0x7f39400f5a00 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 rx=0x7f3930004660 tx=0x7f3930009b30).stop 2021-11-03T18:33:46.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.456+0000 7f3944baf700 1 -- 172.21.15.26:0/1372129683 shutdown_connections 2021-11-03T18:33:46.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.456+0000 7f3944baf700 1 --2- 172.21.15.26:0/1372129683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39400f6880 0x7f39400f6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:46.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.456+0000 7f3944baf700 1 --2- 172.21.15.26:0/1372129683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39400f55e0 0x7f39400f5a00 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:46.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.456+0000 7f3944baf700 1 -- 172.21.15.26:0/1372129683 >> 172.21.15.26:0/1372129683 conn(0x7f39400f0d40 msgr2=0x7f39400f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:33:46.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.456+0000 7f3944baf700 1 -- 172.21.15.26:0/1372129683 shutdown_connections 2021-11-03T18:33:46.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.456+0000 7f3944baf700 1 -- 172.21.15.26:0/1372129683 wait complete. 2021-11-03T18:33:46.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.456+0000 7f3944baf700 1 Processor -- start 2021-11-03T18:33:46.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.456+0000 7f3944baf700 1 -- start start 2021-11-03T18:33:46.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.456+0000 7f3944baf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39400f55e0 0x7f3940106fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:33:46.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.456+0000 7f3944baf700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39400f6880 0x7f39401074b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:33:46.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.456+0000 7f3944baf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3940107a60 con 0x7f39400f55e0 2021-11-03T18:33:46.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.456+0000 7f3944baf700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3940107ba0 con 0x7f39400f6880 2021-11-03T18:33:46.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.457+0000 7f393e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39400f55e0 0x7f3940106fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:33:46.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.457+0000 7f393e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39400f55e0 0x7f3940106fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60722/0 (socket says 172.21.15.26:60722) 2021-11-03T18:33:46.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.457+0000 7f393e59c700 1 -- 172.21.15.26:0/1833467499 learned_addr learned my addr 172.21.15.26:0/1833467499 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:33:46.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.457+0000 7f393dd9b700 1 --2- 172.21.15.26:0/1833467499 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39400f6880 0x7f39401074b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:33:46.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.457+0000 7f393e59c700 1 -- 172.21.15.26:0/1833467499 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39400f6880 msgr2=0x7f39401074b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:33:46.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.457+0000 7f393e59c700 1 --2- 172.21.15.26:0/1833467499 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39400f6880 0x7f39401074b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:46.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.457+0000 7f393e59c700 1 -- 172.21.15.26:0/1833467499 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3930005040 con 0x7f39400f55e0 2021-11-03T18:33:46.464 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.457+0000 7f393e59c700 1 --2- 172.21.15.26:0/1833467499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39400f55e0 0x7f3940106fc0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 rx=0x7f3930009830 tx=0x7f3930009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:33:46.464 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.457+0000 7f392effd700 1 -- 172.21.15.26:0/1833467499 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3930018070 con 0x7f39400f55e0 2021-11-03T18:33:46.464 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.457+0000 7f392effd700 1 -- 172.21.15.26:0/1833467499 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3930007ba0 con 0x7f39400f55e0 2021-11-03T18:33:46.464 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.457+0000 7f3944baf700 1 -- 172.21.15.26:0/1833467499 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39401084e0 con 0x7f39400f55e0 2021-11-03T18:33:46.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.457+0000 7f392effd700 1 -- 172.21.15.26:0/1833467499 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f393001de60 con 0x7f39400f55e0 2021-11-03T18:33:46.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.457+0000 7f3944baf700 1 -- 172.21.15.26:0/1833467499 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3940108a40 con 0x7f39400f55e0 2021-11-03T18:33:46.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.458+0000 7f3944baf700 1 -- 172.21.15.26:0/1833467499 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3940045ad0 con 0x7f39400f55e0 2021-11-03T18:33:46.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.459+0000 7f392effd700 1 -- 172.21.15.26:0/1833467499 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f3930007d10 con 0x7f39400f55e0 2021-11-03T18:33:46.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.459+0000 7f392effd700 1 --2- 172.21.15.26:0/1833467499 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3928064090 0x7f3928066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:33:46.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.459+0000 7f392effd700 1 -- 172.21.15.26:0/1833467499 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f3930082390 con 0x7f39400f55e0 2021-11-03T18:33:46.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.459+0000 7f393dd9b700 1 --2- 172.21.15.26:0/1833467499 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3928064090 0x7f3928066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:33:46.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.460+0000 7f393dd9b700 1 --2- 172.21.15.26:0/1833467499 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3928064090 0x7f3928066550 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f3934004c40 tx=0x7f393400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:33:46.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.463+0000 7f392effd700 1 -- 172.21.15.26:0/1833467499 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f3930054750 con 0x7f39400f55e0 2021-11-03T18:33:46.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.634+0000 7f3944baf700 1 -- 172.21.15.26:0/1833467499 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f394005fe50 con 0x7f3928064090 2021-11-03T18:33:46.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.648+0000 7f392effd700 1 -- 172.21.15.26:0/1833467499 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7f394005fe50 con 0x7f3928064090 2021-11-03T18:33:46.648 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:33:46.648 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (105m) 3m ago 106m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:33:46.648 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (97m) 3m ago 106m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:33:46.649 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (97m) 2m ago 105m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:33:46.649 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (104m) 3m ago 105m 42.3M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:33:46.649 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (97m) 3m ago 101m 26.2M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:33:46.649 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (98m) 3m ago 101m 26.8M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:33:46.650 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (101m) 2m ago 101m 27.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:33:46.650 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (101m) 2m ago 101m 27.4M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:33:46.650 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (98m) 3m ago 107m 601M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:33:46.651 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (98m) 2m ago 105m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:33:46.651 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (98m) 3m ago 107m 374M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:33:46.651 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (97m) 2m ago 105m 171M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:33:46.651 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (105m) 3m ago 105m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:33:46.652 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (105m) 2m ago 105m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:33:46.652 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (96m) 3m ago 104m 352M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:33:46.652 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (96m) 3m ago 104m 379M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:33:46.652 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (95m) 3m ago 103m 314M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:33:46.653 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (95m) 2m ago 103m 413M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:33:46.653 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (94m) 2m ago 103m 339M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:33:46.653 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (94m) 2m ago 102m 337M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:33:46.653 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (104m) 3m ago 105m 68.0M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:33:46.654 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.650+0000 7f3944baf700 1 -- 172.21.15.26:0/1833467499 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3928064090 msgr2=0x7f3928066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:33:46.655 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.650+0000 7f3944baf700 1 --2- 172.21.15.26:0/1833467499 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3928064090 0x7f3928066550 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f3934004c40 tx=0x7f393400b040).stop 2021-11-03T18:33:46.655 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.650+0000 7f3944baf700 1 -- 172.21.15.26:0/1833467499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39400f55e0 msgr2=0x7f3940106fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:33:46.655 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.650+0000 7f3944baf700 1 --2- 172.21.15.26:0/1833467499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39400f55e0 0x7f3940106fc0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 rx=0x7f3930009830 tx=0x7f3930009b30).stop 2021-11-03T18:33:46.655 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.650+0000 7f3944baf700 1 -- 172.21.15.26:0/1833467499 shutdown_connections 2021-11-03T18:33:46.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.650+0000 7f3944baf700 1 --2- 172.21.15.26:0/1833467499 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3928064090 0x7f3928066550 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:46.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.650+0000 7f3944baf700 1 --2- 172.21.15.26:0/1833467499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39400f55e0 0x7f3940106fc0 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:46.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.650+0000 7f3944baf700 1 --2- 172.21.15.26:0/1833467499 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39400f6880 0x7f39401074b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:46.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.650+0000 7f3944baf700 1 -- 172.21.15.26:0/1833467499 >> 172.21.15.26:0/1833467499 conn(0x7f39400f0d40 msgr2=0x7f394005f740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:33:46.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.650+0000 7f3944baf700 1 -- 172.21.15.26:0/1833467499 shutdown_connections 2021-11-03T18:33:46.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.650+0000 7f3944baf700 1 -- 172.21.15.26:0/1833467499 wait complete. 2021-11-03T18:33:46.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.749+0000 7f16e9c81700 1 -- 172.21.15.26:0/2686916712 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16e40f66e0 msgr2=0x7f16e40f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:33:46.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.749+0000 7f16e9c81700 1 --2- 172.21.15.26:0/2686916712 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16e40f66e0 0x7f16e40f6b40 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7f16d0004660 tx=0x7f16d0009b30).stop 2021-11-03T18:33:46.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.749+0000 7f16e9c81700 1 -- 172.21.15.26:0/2686916712 shutdown_connections 2021-11-03T18:33:46.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.749+0000 7f16e9c81700 1 --2- 172.21.15.26:0/2686916712 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16e40f66e0 0x7f16e40f6b40 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:46.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.749+0000 7f16e9c81700 1 --2- 172.21.15.26:0/2686916712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16e40f5440 0x7f16e40f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:46.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.749+0000 7f16e9c81700 1 -- 172.21.15.26:0/2686916712 >> 172.21.15.26:0/2686916712 conn(0x7f16e40f0ba0 msgr2=0x7f16e40f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:33:46.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.749+0000 7f16e9c81700 1 -- 172.21.15.26:0/2686916712 shutdown_connections 2021-11-03T18:33:46.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.750+0000 7f16e9c81700 1 -- 172.21.15.26:0/2686916712 wait complete. 2021-11-03T18:33:46.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.750+0000 7f16e9c81700 1 Processor -- start 2021-11-03T18:33:46.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.750+0000 7f16e9c81700 1 -- start start 2021-11-03T18:33:46.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.750+0000 7f16e9c81700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16e40f5440 0x7f16e41099b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:33:46.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.750+0000 7f16e9c81700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16e40f66e0 0x7f16e410beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:33:46.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.750+0000 7f16e9c81700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e40603e0 con 0x7f16e40f66e0 2021-11-03T18:33:46.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.750+0000 7f16e9c81700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e4060520 con 0x7f16e40f5440 2021-11-03T18:33:46.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.750+0000 7f16e3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16e40f66e0 0x7f16e410beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:33:46.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.750+0000 7f16e3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16e40f66e0 0x7f16e410beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60734/0 (socket says 172.21.15.26:60734) 2021-11-03T18:33:46.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.750+0000 7f16e3fff700 1 -- 172.21.15.26:0/796219642 learned_addr learned my addr 172.21.15.26:0/796219642 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:33:46.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.751+0000 7f16e8c7f700 1 --2- 172.21.15.26:0/796219642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16e40f5440 0x7f16e41099b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:33:46.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.751+0000 7f16e3fff700 1 -- 172.21.15.26:0/796219642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16e40f5440 msgr2=0x7f16e41099b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:33:46.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.751+0000 7f16e3fff700 1 --2- 172.21.15.26:0/796219642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16e40f5440 0x7f16e41099b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:46.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.751+0000 7f16e3fff700 1 -- 172.21.15.26:0/796219642 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d0005040 con 0x7f16e40f66e0 2021-11-03T18:33:46.757 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.751+0000 7f16e3fff700 1 --2- 172.21.15.26:0/796219642 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16e40f66e0 0x7f16e410beb0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 rx=0x7f16d0009990 tx=0x7f16d0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:33:46.757 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.751+0000 7f16e17fa700 1 -- 172.21.15.26:0/796219642 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16d0018070 con 0x7f16e40f66e0 2021-11-03T18:33:46.757 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.751+0000 7f16e17fa700 1 -- 172.21.15.26:0/796219642 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f16d0007ba0 con 0x7f16e40f66e0 2021-11-03T18:33:46.757 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.751+0000 7f16e9c81700 1 -- 172.21.15.26:0/796219642 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16e410c400 con 0x7f16e40f66e0 2021-11-03T18:33:46.758 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.751+0000 7f16e17fa700 1 -- 172.21.15.26:0/796219642 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16d001c3c0 con 0x7f16e40f66e0 2021-11-03T18:33:46.758 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.751+0000 7f16e9c81700 1 -- 172.21.15.26:0/796219642 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16e410c960 con 0x7f16e40f66e0 2021-11-03T18:33:46.759 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.752+0000 7f16e9c81700 1 -- 172.21.15.26:0/796219642 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16e4045ad0 con 0x7f16e40f66e0 2021-11-03T18:33:46.759 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.753+0000 7f16e17fa700 1 -- 172.21.15.26:0/796219642 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f16d001d420 con 0x7f16e40f66e0 2021-11-03T18:33:46.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.753+0000 7f16e17fa700 1 --2- 172.21.15.26:0/796219642 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f16d4064100 0x7f16d40665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:33:46.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.753+0000 7f16e17fa700 1 -- 172.21.15.26:0/796219642 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f16d0082500 con 0x7f16e40f66e0 2021-11-03T18:33:46.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.753+0000 7f16e8c7f700 1 --2- 172.21.15.26:0/796219642 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f16d4064100 0x7f16d40665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:33:46.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.753+0000 7f16e8c7f700 1 --2- 172.21.15.26:0/796219642 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f16d4064100 0x7f16d40665c0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7f16e4060060 tx=0x7f16d8009c80).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:33:46.761 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.757+0000 7f16e17fa700 1 -- 172.21.15.26:0/796219642 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f16d00548c0 con 0x7f16e40f66e0 2021-11-03T18:33:46.988 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.988+0000 7f16e9c81700 1 -- 172.21.15.26:0/796219642 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f16e4027a00 con 0x7f16e40f66e0 2021-11-03T18:33:46.988 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.989+0000 7f16e17fa700 1 -- 172.21.15.26:0/796219642 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f16d00544b0 con 0x7f16e40f66e0 2021-11-03T18:33:46.988 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:33:46.989 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:33:46.989 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:33:46.989 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:33:46.989 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:33:46.990 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:33:46.990 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:33:46.990 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:33:46.990 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:33:46.991 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:33:46.991 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:33:46.991 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:33:46.991 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:33:46.991 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:33:46.992 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:33:46.992 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:33:46.992 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:33:46.992 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:33:46.993 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.990+0000 7f16e9c81700 1 -- 172.21.15.26:0/796219642 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f16d4064100 msgr2=0x7f16d40665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:33:46.994 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.990+0000 7f16e9c81700 1 --2- 172.21.15.26:0/796219642 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f16d4064100 0x7f16d40665c0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7f16e4060060 tx=0x7f16d8009c80).stop 2021-11-03T18:33:46.994 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.990+0000 7f16e9c81700 1 -- 172.21.15.26:0/796219642 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16e40f66e0 msgr2=0x7f16e410beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:33:46.994 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.990+0000 7f16e9c81700 1 --2- 172.21.15.26:0/796219642 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16e40f66e0 0x7f16e410beb0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 rx=0x7f16d0009990 tx=0x7f16d0009b30).stop 2021-11-03T18:33:46.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.990+0000 7f16e9c81700 1 -- 172.21.15.26:0/796219642 shutdown_connections 2021-11-03T18:33:46.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.991+0000 7f16e9c81700 1 --2- 172.21.15.26:0/796219642 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f16d4064100 0x7f16d40665c0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:46.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.991+0000 7f16e9c81700 1 --2- 172.21.15.26:0/796219642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16e40f5440 0x7f16e41099b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:46.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.991+0000 7f16e9c81700 1 --2- 172.21.15.26:0/796219642 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16e40f66e0 0x7f16e410beb0 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:46.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.991+0000 7f16e9c81700 1 -- 172.21.15.26:0/796219642 >> 172.21.15.26:0/796219642 conn(0x7f16e40f0ba0 msgr2=0x7f16e40fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:33:46.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.991+0000 7f16e9c81700 1 -- 172.21.15.26:0/796219642 shutdown_connections 2021-11-03T18:33:46.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:46.991+0000 7f16e9c81700 1 -- 172.21.15.26:0/796219642 wait complete. 2021-11-03T18:33:47.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.091+0000 7f66a0e0b700 1 -- 172.21.15.26:0/651440799 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f669c0f7980 msgr2=0x7f669c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:33:47.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.091+0000 7f66a0e0b700 1 --2- 172.21.15.26:0/651440799 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f669c0f7980 0x7f669c0f7de0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7f6690004660 tx=0x7f6690009b30).stop 2021-11-03T18:33:47.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.091+0000 7f66a0e0b700 1 -- 172.21.15.26:0/651440799 shutdown_connections 2021-11-03T18:33:47.094 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.091+0000 7f66a0e0b700 1 --2- 172.21.15.26:0/651440799 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f669c0f7980 0x7f669c0f7de0 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:47.094 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.091+0000 7f66a0e0b700 1 --2- 172.21.15.26:0/651440799 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f669c0f66e0 0x7f669c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:47.094 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.091+0000 7f66a0e0b700 1 -- 172.21.15.26:0/651440799 >> 172.21.15.26:0/651440799 conn(0x7f669c0f1e40 msgr2=0x7f669c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:33:47.095 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.091+0000 7f66a0e0b700 1 -- 172.21.15.26:0/651440799 shutdown_connections 2021-11-03T18:33:47.095 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.091+0000 7f66a0e0b700 1 -- 172.21.15.26:0/651440799 wait complete. 2021-11-03T18:33:47.095 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.091+0000 7f66a0e0b700 1 Processor -- start 2021-11-03T18:33:47.096 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.091+0000 7f66a0e0b700 1 -- start start 2021-11-03T18:33:47.096 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.091+0000 7f66a0e0b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f669c0f66e0 0x7f669c106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:33:47.096 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.091+0000 7f66a0e0b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f669c0f7980 0x7f669c107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:33:47.097 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.091+0000 7f66a0e0b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669c107a00 con 0x7f669c0f7980 2021-11-03T18:33:47.097 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.091+0000 7f66a0e0b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669c107b40 con 0x7f669c0f66e0 2021-11-03T18:33:47.097 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.092+0000 7f6699d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f669c0f7980 0x7f669c107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:33:47.097 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.092+0000 7f6699d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f669c0f7980 0x7f669c107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60744/0 (socket says 172.21.15.26:60744) 2021-11-03T18:33:47.098 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.092+0000 7f6699d9b700 1 -- 172.21.15.26:0/3769417349 learned_addr learned my addr 172.21.15.26:0/3769417349 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:33:47.098 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.092+0000 7f669a59c700 1 --2- 172.21.15.26:0/3769417349 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f669c0f66e0 0x7f669c106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:33:47.098 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.092+0000 7f6699d9b700 1 -- 172.21.15.26:0/3769417349 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f669c0f66e0 msgr2=0x7f669c106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:33:47.098 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.092+0000 7f6699d9b700 1 --2- 172.21.15.26:0/3769417349 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f669c0f66e0 0x7f669c106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:47.099 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.092+0000 7f6699d9b700 1 -- 172.21.15.26:0/3769417349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6690005040 con 0x7f669c0f7980 2021-11-03T18:33:47.099 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.092+0000 7f6699d9b700 1 --2- 172.21.15.26:0/3769417349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f669c0f7980 0x7f669c107450 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 rx=0x7f6690009990 tx=0x7f6690009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:33:47.099 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.092+0000 7f668affd700 1 -- 172.21.15.26:0/3769417349 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6690018070 con 0x7f669c0f7980 2021-11-03T18:33:47.099 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.092+0000 7f668affd700 1 -- 172.21.15.26:0/3769417349 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6690007ba0 con 0x7f669c0f7980 2021-11-03T18:33:47.100 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.092+0000 7f668affd700 1 -- 172.21.15.26:0/3769417349 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f669001c3c0 con 0x7f669c0f7980 2021-11-03T18:33:47.100 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.092+0000 7f66a0e0b700 1 -- 172.21.15.26:0/3769417349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f669c108480 con 0x7f669c0f7980 2021-11-03T18:33:47.100 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.092+0000 7f66a0e0b700 1 -- 172.21.15.26:0/3769417349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f669c1089e0 con 0x7f669c0f7980 2021-11-03T18:33:47.100 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.093+0000 7f66a0e0b700 1 -- 172.21.15.26:0/3769417349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f669c045ad0 con 0x7f669c0f7980 2021-11-03T18:33:47.100 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.093+0000 7f668affd700 1 -- 172.21.15.26:0/3769417349 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f669001d420 con 0x7f669c0f7980 2021-11-03T18:33:47.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.094+0000 7f668affd700 1 --2- 172.21.15.26:0/3769417349 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f66840640b0 0x7f6684066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:33:47.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.094+0000 7f668affd700 1 -- 172.21.15.26:0/3769417349 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f6690082430 con 0x7f669c0f7980 2021-11-03T18:33:47.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.094+0000 7f669a59c700 1 --2- 172.21.15.26:0/3769417349 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f66840640b0 0x7f6684066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:33:47.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.094+0000 7f669a59c700 1 --2- 172.21.15.26:0/3769417349 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f66840640b0 0x7f6684066570 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7f669c0f77e0 tx=0x7f6694004d00).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:33:47.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.098+0000 7f668affd700 1 -- 172.21.15.26:0/3769417349 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f66900547f0 con 0x7f669c0f7980 2021-11-03T18:33:47.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.301+0000 7f66a0e0b700 1 -- 172.21.15.26:0/3769417349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f669c027a00 con 0x7f669c0f7980 2021-11-03T18:33:47.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.302+0000 7f668affd700 1 -- 172.21.15.26:0/3769417349 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f66900543e0 con 0x7f669c0f7980 2021-11-03T18:33:47.301 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:33:47.302 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:33:47.302 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:33:47.302 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:33:47.302 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:33:47.303 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:33:47.303 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:33:47.303 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:33:47.303 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:33:47.304 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:33:47.304 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:33:47.304 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:33:47.304 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:33:47.304 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:33:47.305 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:33:47.305 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:33:47.305 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:33:47.305 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:33:47.305 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:33:47.306 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:33:47.306 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:33:47.306 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:33:47.306 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:33:47.307 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:33:47.307 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:33:47.307 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:33:47.307 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:33:47.308 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:33:47.308 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:33:47.308 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:33:47.309 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:33:47.309 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:33:47.309 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:33:47.309 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:33:47.309 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:33:47.310 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:33:47.310 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:33:47.310 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:33:47.310 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:33:47.311 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.303+0000 7f66a0e0b700 1 -- 172.21.15.26:0/3769417349 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f66840640b0 msgr2=0x7f6684066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:33:47.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.303+0000 7f66a0e0b700 1 --2- 172.21.15.26:0/3769417349 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f66840640b0 0x7f6684066570 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7f669c0f77e0 tx=0x7f6694004d00).stop 2021-11-03T18:33:47.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.303+0000 7f66a0e0b700 1 -- 172.21.15.26:0/3769417349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f669c0f7980 msgr2=0x7f669c107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:33:47.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.303+0000 7f66a0e0b700 1 --2- 172.21.15.26:0/3769417349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f669c0f7980 0x7f669c107450 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 rx=0x7f6690009990 tx=0x7f6690009b30).stop 2021-11-03T18:33:47.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.303+0000 7f66a0e0b700 1 -- 172.21.15.26:0/3769417349 shutdown_connections 2021-11-03T18:33:47.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.303+0000 7f66a0e0b700 1 --2- 172.21.15.26:0/3769417349 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f66840640b0 0x7f6684066570 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:47.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.303+0000 7f66a0e0b700 1 --2- 172.21.15.26:0/3769417349 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f669c0f66e0 0x7f669c106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:47.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.303+0000 7f66a0e0b700 1 --2- 172.21.15.26:0/3769417349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f669c0f7980 0x7f669c107450 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:33:47.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.303+0000 7f66a0e0b700 1 -- 172.21.15.26:0/3769417349 >> 172.21.15.26:0/3769417349 conn(0x7f669c0f1e40 msgr2=0x7f669c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:33:47.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.304+0000 7f66a0e0b700 1 -- 172.21.15.26:0/3769417349 shutdown_connections 2021-11-03T18:33:47.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:33:47.304+0000 7f66a0e0b700 1 -- 172.21.15.26:0/3769417349 wait complete. 2021-11-03T18:33:47.314 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:33:47.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:47 smithi026 ceph-mon[96795]: pgmap v2973: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:47.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:47 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/796219642' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:33:47.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:47 smithi194 ceph-mon[65619]: pgmap v2973: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:47.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:47 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/796219642' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:33:48.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:48 smithi026 ceph-mon[96795]: from='client.37196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:33:48.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:48 smithi026 ceph-mon[96795]: from='client.37200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:33:48.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:48 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3769417349' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:33:48.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:48 smithi194 ceph-mon[65619]: from='client.37196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:33:48.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:48 smithi194 ceph-mon[65619]: from='client.37200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:33:48.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:48 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3769417349' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:33:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:49 smithi026 ceph-mon[96795]: pgmap v2974: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:33:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:33:49.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:49 smithi194 ceph-mon[65619]: pgmap v2974: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:33:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:33:51.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:50 smithi194 ceph-mon[65619]: pgmap v2975: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:51.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:50 smithi026 ceph-mon[96795]: pgmap v2975: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:53.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:53 smithi026 ceph-mon[96795]: pgmap v2976: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:53.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:53 smithi194 ceph-mon[65619]: pgmap v2976: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:54.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:33:54.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:33:55.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:55 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:33:55.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:55 smithi026 ceph-mon[96795]: pgmap v2977: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:55.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:55 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:33:55.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:55 smithi194 ceph-mon[65619]: pgmap v2977: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:57.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:57 smithi026 ceph-mon[96795]: pgmap v2978: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:57.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:57 smithi194 ceph-mon[65619]: pgmap v2978: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:59.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:33:59 smithi026 ceph-mon[96795]: pgmap v2979: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:33:59.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:33:59 smithi194 ceph-mon[65619]: pgmap v2979: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:01.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:00 smithi194 ceph-mon[65619]: pgmap v2980: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:01.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:00 smithi026 ceph-mon[96795]: pgmap v2980: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:03.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:03 smithi026 ceph-mon[96795]: pgmap v2981: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:03.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:03 smithi194 ceph-mon[65619]: pgmap v2981: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:05.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:05 smithi026 ceph-mon[96795]: pgmap v2982: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:05.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:05 smithi194 ceph-mon[65619]: pgmap v2982: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:07.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:07 smithi026 ceph-mon[96795]: pgmap v2983: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:07.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:07 smithi194 ceph-mon[65619]: pgmap v2983: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:09.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:09 smithi026 ceph-mon[96795]: pgmap v2984: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:09.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:09 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:34:09.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:09 smithi194 ceph-mon[65619]: pgmap v2984: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:09.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:09 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:34:10.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:10 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:34:10.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:10 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:34:11.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:11 smithi026 ceph-mon[96795]: pgmap v2985: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:11.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:11 smithi194 ceph-mon[65619]: pgmap v2985: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:13.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:13 smithi026 ceph-mon[96795]: pgmap v2986: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:13.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:13 smithi194 ceph-mon[65619]: pgmap v2986: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:15.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:15 smithi026 ceph-mon[96795]: pgmap v2987: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:15.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:15 smithi194 ceph-mon[65619]: pgmap v2987: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:17.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.419+0000 7fa1acaf0700 1 -- 172.21.15.26:0/1481206554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1a80602b0 msgr2=0x7fa1a80f9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:34:17.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.419+0000 7fa1acaf0700 1 --2- 172.21.15.26:0/1481206554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1a80602b0 0x7fa1a80f9170 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 rx=0x7fa1a00099e0 tx=0x7fa1a0004d10).stop 2021-11-03T18:34:17.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.419+0000 7fa1acaf0700 1 -- 172.21.15.26:0/1481206554 shutdown_connections 2021-11-03T18:34:17.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.419+0000 7fa1acaf0700 1 --2- 172.21.15.26:0/1481206554 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1a80f96f0 0x7fa1a80fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:17.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.419+0000 7fa1acaf0700 1 --2- 172.21.15.26:0/1481206554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1a80602b0 0x7fa1a80f9170 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:17.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.419+0000 7fa1acaf0700 1 -- 172.21.15.26:0/1481206554 >> 172.21.15.26:0/1481206554 conn(0x7fa1a80f0b90 msgr2=0x7fa1a80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:34:17.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.419+0000 7fa1acaf0700 1 -- 172.21.15.26:0/1481206554 shutdown_connections 2021-11-03T18:34:17.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.419+0000 7fa1acaf0700 1 -- 172.21.15.26:0/1481206554 wait complete. 2021-11-03T18:34:17.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.420+0000 7fa1acaf0700 1 Processor -- start 2021-11-03T18:34:17.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.420+0000 7fa1acaf0700 1 -- start start 2021-11-03T18:34:17.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.420+0000 7fa1acaf0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1a80602b0 0x7fa1a8106ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:34:17.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.420+0000 7fa1acaf0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1a80f96f0 0x7fa1a81073b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:34:17.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.420+0000 7fa1acaf0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a81079b0 con 0x7fa1a80f96f0 2021-11-03T18:34:17.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.420+0000 7fa1acaf0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a81081c0 con 0x7fa1a80602b0 2021-11-03T18:34:17.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.420+0000 7fa1a6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1a80f96f0 0x7fa1a81073b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:34:17.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.420+0000 7fa1a6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1a80f96f0 0x7fa1a81073b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60760/0 (socket says 172.21.15.26:60760) 2021-11-03T18:34:17.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.420+0000 7fa1a6ffd700 1 -- 172.21.15.26:0/393693090 learned_addr learned my addr 172.21.15.26:0/393693090 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:34:17.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.421+0000 7fa1a77fe700 1 --2- 172.21.15.26:0/393693090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1a80602b0 0x7fa1a8106ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:34:17.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.421+0000 7fa1a6ffd700 1 -- 172.21.15.26:0/393693090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1a80602b0 msgr2=0x7fa1a8106ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:34:17.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.421+0000 7fa1a6ffd700 1 --2- 172.21.15.26:0/393693090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1a80602b0 0x7fa1a8106ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:17.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.421+0000 7fa1a6ffd700 1 -- 172.21.15.26:0/393693090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a0009640 con 0x7fa1a80f96f0 2021-11-03T18:34:17.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.421+0000 7fa1a6ffd700 1 --2- 172.21.15.26:0/393693090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1a80f96f0 0x7fa1a81073b0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7fa1900026d0 tx=0x7fa190009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:34:17.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.421+0000 7fa19ffff700 1 -- 172.21.15.26:0/393693090 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa190009320 con 0x7fa1a80f96f0 2021-11-03T18:34:17.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.421+0000 7fa1acaf0700 1 -- 172.21.15.26:0/393693090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1a8108440 con 0x7fa1a80f96f0 2021-11-03T18:34:17.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.421+0000 7fa19ffff700 1 -- 172.21.15.26:0/393693090 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa19000f040 con 0x7fa1a80f96f0 2021-11-03T18:34:17.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.421+0000 7fa19ffff700 1 -- 172.21.15.26:0/393693090 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa190014870 con 0x7fa1a80f96f0 2021-11-03T18:34:17.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.421+0000 7fa1acaf0700 1 -- 172.21.15.26:0/393693090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1a8108980 con 0x7fa1a80f96f0 2021-11-03T18:34:17.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.422+0000 7fa1acaf0700 1 -- 172.21.15.26:0/393693090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1a8059100 con 0x7fa1a80f96f0 2021-11-03T18:34:17.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.423+0000 7fa19ffff700 1 -- 172.21.15.26:0/393693090 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fa190009480 con 0x7fa1a80f96f0 2021-11-03T18:34:17.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.423+0000 7fa19ffff700 1 --2- 172.21.15.26:0/393693090 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa194064100 0x7fa1940665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:34:17.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.423+0000 7fa19ffff700 1 -- 172.21.15.26:0/393693090 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fa190080b00 con 0x7fa1a80f96f0 2021-11-03T18:34:17.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.423+0000 7fa1a77fe700 1 --2- 172.21.15.26:0/393693090 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa194064100 0x7fa1940665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:34:17.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.424+0000 7fa1a77fe700 1 --2- 172.21.15.26:0/393693090 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa194064100 0x7fa1940665c0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7fa1a0000f80 tx=0x7fa1a0004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:34:17.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:17 smithi026 ceph-mon[96795]: pgmap v2988: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:17.428 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.428+0000 7fa19ffff700 1 -- 172.21.15.26:0/393693090 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fa190052e60 con 0x7fa1a80f96f0 2021-11-03T18:34:17.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:17 smithi194 ceph-mon[65619]: pgmap v2988: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:17.605 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.607+0000 7fa1acaf0700 1 -- 172.21.15.26:0/393693090 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1a80008d0 con 0x7fa194064100 2021-11-03T18:34:17.606 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.608+0000 7fa19ffff700 1 -- 172.21.15.26:0/393693090 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fa1a80008d0 con 0x7fa194064100 2021-11-03T18:34:17.608 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.610+0000 7fa1acaf0700 1 -- 172.21.15.26:0/393693090 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa194064100 msgr2=0x7fa1940665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:34:17.608 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.610+0000 7fa1acaf0700 1 --2- 172.21.15.26:0/393693090 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa194064100 0x7fa1940665c0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7fa1a0000f80 tx=0x7fa1a0004d10).stop 2021-11-03T18:34:17.608 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.610+0000 7fa1acaf0700 1 -- 172.21.15.26:0/393693090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1a80f96f0 msgr2=0x7fa1a81073b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:34:17.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.610+0000 7fa1acaf0700 1 --2- 172.21.15.26:0/393693090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1a80f96f0 0x7fa1a81073b0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7fa1900026d0 tx=0x7fa190009e00).stop 2021-11-03T18:34:17.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.610+0000 7fa1acaf0700 1 -- 172.21.15.26:0/393693090 shutdown_connections 2021-11-03T18:34:17.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.610+0000 7fa1acaf0700 1 --2- 172.21.15.26:0/393693090 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa194064100 0x7fa1940665c0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:17.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.610+0000 7fa1acaf0700 1 --2- 172.21.15.26:0/393693090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1a80602b0 0x7fa1a8106ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:17.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.610+0000 7fa1acaf0700 1 --2- 172.21.15.26:0/393693090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1a80f96f0 0x7fa1a81073b0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:17.610 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.610+0000 7fa1acaf0700 1 -- 172.21.15.26:0/393693090 >> 172.21.15.26:0/393693090 conn(0x7fa1a80f0b90 msgr2=0x7fa1a80f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:34:17.610 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.610+0000 7fa1acaf0700 1 -- 172.21.15.26:0/393693090 shutdown_connections 2021-11-03T18:34:17.610 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.610+0000 7fa1acaf0700 1 -- 172.21.15.26:0/393693090 wait complete. 2021-11-03T18:34:17.618 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:34:17.712 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.710+0000 7ff7cdd48700 1 -- 172.21.15.26:0/2201898269 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7c80f66e0 msgr2=0x7ff7c80f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:34:17.712 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.710+0000 7ff7cdd48700 1 --2- 172.21.15.26:0/2201898269 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7c80f66e0 0x7ff7c80f6b00 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 rx=0x7ff7bc004660 tx=0x7ff7bc009b30).stop 2021-11-03T18:34:17.712 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.710+0000 7ff7cdd48700 1 -- 172.21.15.26:0/2201898269 shutdown_connections 2021-11-03T18:34:17.712 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.710+0000 7ff7cdd48700 1 --2- 172.21.15.26:0/2201898269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7c80f7980 0x7ff7c80f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:17.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.710+0000 7ff7cdd48700 1 --2- 172.21.15.26:0/2201898269 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7c80f66e0 0x7ff7c80f6b00 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:17.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.710+0000 7ff7cdd48700 1 -- 172.21.15.26:0/2201898269 >> 172.21.15.26:0/2201898269 conn(0x7ff7c80f1e40 msgr2=0x7ff7c80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:34:17.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.710+0000 7ff7cdd48700 1 -- 172.21.15.26:0/2201898269 shutdown_connections 2021-11-03T18:34:17.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.710+0000 7ff7cdd48700 1 -- 172.21.15.26:0/2201898269 wait complete. 2021-11-03T18:34:17.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.710+0000 7ff7cdd48700 1 Processor -- start 2021-11-03T18:34:17.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.710+0000 7ff7cdd48700 1 -- start start 2021-11-03T18:34:17.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.711+0000 7ff7cdd48700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7c80f66e0 0x7ff7c806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:34:17.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.711+0000 7ff7cdd48700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7c80f7980 0x7ff7c8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:34:17.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.711+0000 7ff7cdd48700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c806a380 con 0x7ff7c80f7980 2021-11-03T18:34:17.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.711+0000 7ff7cdd48700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c806a4c0 con 0x7ff7c80f66e0 2021-11-03T18:34:17.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.711+0000 7ff7c6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7c80f7980 0x7ff7c8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:34:17.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.711+0000 7ff7c6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7c80f7980 0x7ff7c8069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60772/0 (socket says 172.21.15.26:60772) 2021-11-03T18:34:17.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.711+0000 7ff7c6ffd700 1 -- 172.21.15.26:0/1453357662 learned_addr learned my addr 172.21.15.26:0/1453357662 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:34:17.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.711+0000 7ff7c77fe700 1 --2- 172.21.15.26:0/1453357662 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7c80f66e0 0x7ff7c806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:34:17.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.711+0000 7ff7c6ffd700 1 -- 172.21.15.26:0/1453357662 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7c80f66e0 msgr2=0x7ff7c806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:34:17.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.711+0000 7ff7c6ffd700 1 --2- 172.21.15.26:0/1453357662 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7c80f66e0 0x7ff7c806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:17.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.711+0000 7ff7c6ffd700 1 -- 172.21.15.26:0/1453357662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7bc005040 con 0x7ff7c80f7980 2021-11-03T18:34:17.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.711+0000 7ff7c6ffd700 1 --2- 172.21.15.26:0/1453357662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7c80f7980 0x7ff7c8069e20 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 rx=0x7ff7b80026d0 tx=0x7ff7b8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:34:17.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.711+0000 7ff7affff700 1 -- 172.21.15.26:0/1453357662 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7b80079c0 con 0x7ff7c80f7980 2021-11-03T18:34:17.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.711+0000 7ff7affff700 1 -- 172.21.15.26:0/1453357662 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff7b800f040 con 0x7ff7c80f7980 2021-11-03T18:34:17.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.711+0000 7ff7cdd48700 1 -- 172.21.15.26:0/1453357662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c806a7a0 con 0x7ff7c80f7980 2021-11-03T18:34:17.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.712+0000 7ff7affff700 1 -- 172.21.15.26:0/1453357662 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7b80148b0 con 0x7ff7c80f7980 2021-11-03T18:34:17.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.712+0000 7ff7cdd48700 1 -- 172.21.15.26:0/1453357662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c810efe0 con 0x7ff7c80f7980 2021-11-03T18:34:17.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.713+0000 7ff7cdd48700 1 -- 172.21.15.26:0/1453357662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c8045ad0 con 0x7ff7c80f7980 2021-11-03T18:34:17.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.713+0000 7ff7affff700 1 -- 172.21.15.26:0/1453357662 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ff7b8007b20 con 0x7ff7c80f7980 2021-11-03T18:34:17.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.713+0000 7ff7affff700 1 --2- 172.21.15.26:0/1453357662 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff7b00640b0 0x7ff7b0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:34:17.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.713+0000 7ff7affff700 1 -- 172.21.15.26:0/1453357662 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ff7b8080670 con 0x7ff7c80f7980 2021-11-03T18:34:17.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.713+0000 7ff7c77fe700 1 --2- 172.21.15.26:0/1453357662 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff7b00640b0 0x7ff7b0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:34:17.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.714+0000 7ff7c77fe700 1 --2- 172.21.15.26:0/1453357662 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff7b00640b0 0x7ff7b0066570 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7ff7bc013690 tx=0x7ff7bc009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:34:17.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.717+0000 7ff7affff700 1 -- 172.21.15.26:0/1453357662 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ff7b80529d0 con 0x7ff7c80f7980 2021-11-03T18:34:17.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.891+0000 7ff7cdd48700 1 -- 172.21.15.26:0/1453357662 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff7c8057f10 con 0x7ff7b00640b0 2021-11-03T18:34:17.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.905+0000 7ff7affff700 1 -- 172.21.15.26:0/1453357662 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7ff7c8057f10 con 0x7ff7b00640b0 2021-11-03T18:34:17.904 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:34:17.904 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (105m) 3m ago 106m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:34:17.904 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (97m) 3m ago 106m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:34:17.904 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (97m) 2m ago 106m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:34:17.905 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (105m) 3m ago 106m 42.3M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:34:17.905 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (98m) 3m ago 101m 26.2M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:34:17.905 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (98m) 3m ago 101m 26.8M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:34:17.905 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (101m) 2m ago 101m 27.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:34:17.906 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (101m) 2m ago 101m 27.4M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:34:17.906 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (99m) 3m ago 108m 601M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:34:17.906 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (98m) 2m ago 105m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:34:17.906 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (98m) 3m ago 108m 374M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:34:17.907 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (98m) 2m ago 105m 171M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:34:17.907 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (106m) 3m ago 106m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:34:17.907 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (105m) 2m ago 105m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:34:17.907 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (97m) 3m ago 105m 352M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:34:17.908 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (96m) 3m ago 104m 379M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:34:17.908 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (96m) 3m ago 104m 314M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:34:17.908 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (95m) 2m ago 104m 413M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:34:17.908 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (95m) 2m ago 103m 339M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:34:17.909 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (94m) 2m ago 103m 337M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:34:17.909 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (105m) 3m ago 106m 68.0M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:34:17.910 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.907+0000 7ff7cdd48700 1 -- 172.21.15.26:0/1453357662 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff7b00640b0 msgr2=0x7ff7b0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:34:17.910 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.907+0000 7ff7cdd48700 1 --2- 172.21.15.26:0/1453357662 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff7b00640b0 0x7ff7b0066570 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7ff7bc013690 tx=0x7ff7bc009b30).stop 2021-11-03T18:34:17.910 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.907+0000 7ff7cdd48700 1 -- 172.21.15.26:0/1453357662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7c80f7980 msgr2=0x7ff7c8069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:34:17.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.907+0000 7ff7cdd48700 1 --2- 172.21.15.26:0/1453357662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7c80f7980 0x7ff7c8069e20 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 rx=0x7ff7b80026d0 tx=0x7ff7b8009de0).stop 2021-11-03T18:34:17.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.907+0000 7ff7cdd48700 1 -- 172.21.15.26:0/1453357662 shutdown_connections 2021-11-03T18:34:17.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.907+0000 7ff7cdd48700 1 --2- 172.21.15.26:0/1453357662 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff7b00640b0 0x7ff7b0066570 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:17.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.907+0000 7ff7cdd48700 1 --2- 172.21.15.26:0/1453357662 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7c80f66e0 0x7ff7c806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:17.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.907+0000 7ff7cdd48700 1 --2- 172.21.15.26:0/1453357662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7c80f7980 0x7ff7c8069e20 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:17.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.907+0000 7ff7cdd48700 1 -- 172.21.15.26:0/1453357662 >> 172.21.15.26:0/1453357662 conn(0x7ff7c80f1e40 msgr2=0x7ff7c80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:34:17.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.907+0000 7ff7cdd48700 1 -- 172.21.15.26:0/1453357662 shutdown_connections 2021-11-03T18:34:17.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:17.907+0000 7ff7cdd48700 1 -- 172.21.15.26:0/1453357662 wait complete. 2021-11-03T18:34:18.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.007+0000 7fb0d4080700 1 -- 172.21.15.26:0/774273877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0cc0f6ff0 msgr2=0x7fb0cc0f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:34:18.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.007+0000 7fb0d4080700 1 --2- 172.21.15.26:0/774273877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0cc0f6ff0 0x7fb0cc0f7a20 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 rx=0x7fb0c0004660 tx=0x7fb0c0009b30).stop 2021-11-03T18:34:18.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.007+0000 7fb0d4080700 1 -- 172.21.15.26:0/774273877 shutdown_connections 2021-11-03T18:34:18.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.007+0000 7fb0d4080700 1 --2- 172.21.15.26:0/774273877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0cc0f6ff0 0x7fb0cc0f7a20 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:18.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.007+0000 7fb0d4080700 1 --2- 172.21.15.26:0/774273877 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0cc0f66e0 0x7fb0cc0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:18.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.007+0000 7fb0d4080700 1 -- 172.21.15.26:0/774273877 >> 172.21.15.26:0/774273877 conn(0x7fb0cc0f1f00 msgr2=0x7fb0cc0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:34:18.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.007+0000 7fb0d4080700 1 -- 172.21.15.26:0/774273877 shutdown_connections 2021-11-03T18:34:18.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.007+0000 7fb0d4080700 1 -- 172.21.15.26:0/774273877 wait complete. 2021-11-03T18:34:18.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.008+0000 7fb0d4080700 1 Processor -- start 2021-11-03T18:34:18.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.008+0000 7fb0d4080700 1 -- start start 2021-11-03T18:34:18.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.008+0000 7fb0d4080700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0cc0f66e0 0x7fb0cc106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:34:18.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.008+0000 7fb0d4080700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0cc0f6ff0 0x7fb0cc107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:34:18.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.008+0000 7fb0d4080700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0cc107a10 con 0x7fb0cc0f6ff0 2021-11-03T18:34:18.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.008+0000 7fb0d4080700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0cc107b50 con 0x7fb0cc0f66e0 2021-11-03T18:34:18.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.008+0000 7fb0d161b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0cc0f6ff0 0x7fb0cc107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:34:18.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.008+0000 7fb0d161b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0cc0f6ff0 0x7fb0cc107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60782/0 (socket says 172.21.15.26:60782) 2021-11-03T18:34:18.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.008+0000 7fb0d161b700 1 -- 172.21.15.26:0/2409535357 learned_addr learned my addr 172.21.15.26:0/2409535357 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:34:18.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.008+0000 7fb0d1e1c700 1 --2- 172.21.15.26:0/2409535357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0cc0f66e0 0x7fb0cc106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:34:18.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.008+0000 7fb0d161b700 1 -- 172.21.15.26:0/2409535357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0cc0f66e0 msgr2=0x7fb0cc106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:34:18.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.008+0000 7fb0d161b700 1 --2- 172.21.15.26:0/2409535357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0cc0f66e0 0x7fb0cc106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:18.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.008+0000 7fb0d161b700 1 -- 172.21.15.26:0/2409535357 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c0005040 con 0x7fb0cc0f6ff0 2021-11-03T18:34:18.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.008+0000 7fb0d161b700 1 --2- 172.21.15.26:0/2409535357 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0cc0f6ff0 0x7fb0cc107460 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 rx=0x7fb0c0009990 tx=0x7fb0c0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:34:18.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.008+0000 7fb0ca7fc700 1 -- 172.21.15.26:0/2409535357 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0c0018070 con 0x7fb0cc0f6ff0 2021-11-03T18:34:18.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.009+0000 7fb0d4080700 1 -- 172.21.15.26:0/2409535357 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0cc108490 con 0x7fb0cc0f6ff0 2021-11-03T18:34:18.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.009+0000 7fb0ca7fc700 1 -- 172.21.15.26:0/2409535357 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb0c0007ca0 con 0x7fb0cc0f6ff0 2021-11-03T18:34:18.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.009+0000 7fb0ca7fc700 1 -- 172.21.15.26:0/2409535357 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0c001c620 con 0x7fb0cc0f6ff0 2021-11-03T18:34:18.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.009+0000 7fb0d4080700 1 -- 172.21.15.26:0/2409535357 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0cc1089f0 con 0x7fb0cc0f6ff0 2021-11-03T18:34:18.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.010+0000 7fb0d4080700 1 -- 172.21.15.26:0/2409535357 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0cc045ad0 con 0x7fb0cc0f6ff0 2021-11-03T18:34:18.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.010+0000 7fb0ca7fc700 1 -- 172.21.15.26:0/2409535357 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fb0c001d960 con 0x7fb0cc0f6ff0 2021-11-03T18:34:18.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.010+0000 7fb0ca7fc700 1 --2- 172.21.15.26:0/2409535357 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb0b40640b0 0x7fb0b4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:34:18.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.010+0000 7fb0ca7fc700 1 -- 172.21.15.26:0/2409535357 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fb0c0082520 con 0x7fb0cc0f6ff0 2021-11-03T18:34:18.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.011+0000 7fb0d1e1c700 1 --2- 172.21.15.26:0/2409535357 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb0b40640b0 0x7fb0b4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:34:18.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.011+0000 7fb0d1e1c700 1 --2- 172.21.15.26:0/2409535357 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb0b40640b0 0x7fb0b4066570 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7fb0c4004fd0 tx=0x7fb0c4009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:34:18.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.015+0000 7fb0ca7fc700 1 -- 172.21.15.26:0/2409535357 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fb0c0054940 con 0x7fb0cc0f6ff0 2021-11-03T18:34:18.256 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.258+0000 7fb0d4080700 1 -- 172.21.15.26:0/2409535357 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb0cc0feed0 con 0x7fb0cc0f6ff0 2021-11-03T18:34:18.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.258+0000 7fb0ca7fc700 1 -- 172.21.15.26:0/2409535357 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fb0c0054530 con 0x7fb0cc0f6ff0 2021-11-03T18:34:18.257 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:34:18.257 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:34:18.257 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:34:18.258 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:34:18.258 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:34:18.258 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:34:18.258 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:34:18.259 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:34:18.259 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:34:18.259 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:34:18.259 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:34:18.259 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:34:18.260 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:34:18.260 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:34:18.260 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:34:18.260 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:34:18.261 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:34:18.261 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:34:18.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.260+0000 7fb0d4080700 1 -- 172.21.15.26:0/2409535357 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb0b40640b0 msgr2=0x7fb0b4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:34:18.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.260+0000 7fb0d4080700 1 --2- 172.21.15.26:0/2409535357 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb0b40640b0 0x7fb0b4066570 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7fb0c4004fd0 tx=0x7fb0c4009040).stop 2021-11-03T18:34:18.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.260+0000 7fb0d4080700 1 -- 172.21.15.26:0/2409535357 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0cc0f6ff0 msgr2=0x7fb0cc107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:34:18.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.260+0000 7fb0d4080700 1 --2- 172.21.15.26:0/2409535357 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0cc0f6ff0 0x7fb0cc107460 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 rx=0x7fb0c0009990 tx=0x7fb0c0009b30).stop 2021-11-03T18:34:18.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.260+0000 7fb0d4080700 1 -- 172.21.15.26:0/2409535357 shutdown_connections 2021-11-03T18:34:18.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.260+0000 7fb0d4080700 1 --2- 172.21.15.26:0/2409535357 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb0b40640b0 0x7fb0b4066570 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:18.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.260+0000 7fb0d4080700 1 --2- 172.21.15.26:0/2409535357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0cc0f66e0 0x7fb0cc106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:18.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.260+0000 7fb0d4080700 1 --2- 172.21.15.26:0/2409535357 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0cc0f6ff0 0x7fb0cc107460 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:18.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.260+0000 7fb0d4080700 1 -- 172.21.15.26:0/2409535357 >> 172.21.15.26:0/2409535357 conn(0x7fb0cc0f1f00 msgr2=0x7fb0cc0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:34:18.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.260+0000 7fb0d4080700 1 -- 172.21.15.26:0/2409535357 shutdown_connections 2021-11-03T18:34:18.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.260+0000 7fb0d4080700 1 -- 172.21.15.26:0/2409535357 wait complete. 2021-11-03T18:34:18.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.360+0000 7ffb225fb700 1 -- 172.21.15.26:0/2821540258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb1c0f8610 msgr2=0x7ffb1c0f4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:34:18.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.361+0000 7ffb225fb700 1 --2- 172.21.15.26:0/2821540258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb1c0f8610 0x7ffb1c0f4820 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 rx=0x7ffb10004660 tx=0x7ffb10009b30).stop 2021-11-03T18:34:18.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.361+0000 7ffb225fb700 1 -- 172.21.15.26:0/2821540258 shutdown_connections 2021-11-03T18:34:18.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.361+0000 7ffb225fb700 1 --2- 172.21.15.26:0/2821540258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb1c0f8610 0x7ffb1c0f4820 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:18.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.361+0000 7ffb225fb700 1 --2- 172.21.15.26:0/2821540258 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb1c0f7d00 0x7ffb1c0f8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:18.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.361+0000 7ffb225fb700 1 -- 172.21.15.26:0/2821540258 >> 172.21.15.26:0/2821540258 conn(0x7ffb1c0f0540 msgr2=0x7ffb1c0f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:34:18.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.361+0000 7ffb225fb700 1 -- 172.21.15.26:0/2821540258 shutdown_connections 2021-11-03T18:34:18.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.361+0000 7ffb225fb700 1 -- 172.21.15.26:0/2821540258 wait complete. 2021-11-03T18:34:18.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.361+0000 7ffb225fb700 1 Processor -- start 2021-11-03T18:34:18.363 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.361+0000 7ffb225fb700 1 -- start start 2021-11-03T18:34:18.363 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.361+0000 7ffb225fb700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb1c0f7d00 0x7ffb1c106ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:34:18.363 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.361+0000 7ffb225fb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb1c0f8610 0x7ffb1c1073b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:34:18.363 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.361+0000 7ffb225fb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c107960 con 0x7ffb1c0f8610 2021-11-03T18:34:18.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.361+0000 7ffb225fb700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c107aa0 con 0x7ffb1c0f7d00 2021-11-03T18:34:18.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.362+0000 7ffb1b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb1c0f8610 0x7ffb1c1073b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:34:18.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.362+0000 7ffb1b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb1c0f8610 0x7ffb1c1073b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60792/0 (socket says 172.21.15.26:60792) 2021-11-03T18:34:18.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.362+0000 7ffb1b7fe700 1 -- 172.21.15.26:0/2477922691 learned_addr learned my addr 172.21.15.26:0/2477922691 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:34:18.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.362+0000 7ffb1bfff700 1 --2- 172.21.15.26:0/2477922691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb1c0f7d00 0x7ffb1c106ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:34:18.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.362+0000 7ffb1b7fe700 1 -- 172.21.15.26:0/2477922691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb1c0f7d00 msgr2=0x7ffb1c106ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:34:18.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.362+0000 7ffb1b7fe700 1 --2- 172.21.15.26:0/2477922691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb1c0f7d00 0x7ffb1c106ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:18.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.362+0000 7ffb1b7fe700 1 -- 172.21.15.26:0/2477922691 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb10005040 con 0x7ffb1c0f8610 2021-11-03T18:34:18.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.362+0000 7ffb1b7fe700 1 --2- 172.21.15.26:0/2477922691 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb1c0f8610 0x7ffb1c1073b0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 rx=0x7ffb10000c00 tx=0x7ffb1000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:34:18.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.362+0000 7ffb18ff9700 1 -- 172.21.15.26:0/2477922691 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb10019070 con 0x7ffb1c0f8610 2021-11-03T18:34:18.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.362+0000 7ffb18ff9700 1 -- 172.21.15.26:0/2477922691 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ffb10007e70 con 0x7ffb1c0f8610 2021-11-03T18:34:18.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.362+0000 7ffb225fb700 1 -- 172.21.15.26:0/2477922691 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb1c1083e0 con 0x7ffb1c0f8610 2021-11-03T18:34:18.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.362+0000 7ffb18ff9700 1 -- 172.21.15.26:0/2477922691 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb10014ce0 con 0x7ffb1c0f8610 2021-11-03T18:34:18.367 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.362+0000 7ffb225fb700 1 -- 172.21.15.26:0/2477922691 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb1c108940 con 0x7ffb1c0f8610 2021-11-03T18:34:18.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.363+0000 7ffb225fb700 1 -- 172.21.15.26:0/2477922691 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb1c045ad0 con 0x7ffb1c0f8610 2021-11-03T18:34:18.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.364+0000 7ffb18ff9700 1 -- 172.21.15.26:0/2477922691 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ffb10025070 con 0x7ffb1c0f8610 2021-11-03T18:34:18.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.364+0000 7ffb18ff9700 1 --2- 172.21.15.26:0/2477922691 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffb040640b0 0x7ffb04066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:34:18.368 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.364+0000 7ffb18ff9700 1 -- 172.21.15.26:0/2477922691 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ffb10081650 con 0x7ffb1c0f8610 2021-11-03T18:34:18.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.364+0000 7ffb1bfff700 1 --2- 172.21.15.26:0/2477922691 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffb040640b0 0x7ffb04066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:34:18.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.365+0000 7ffb1bfff700 1 --2- 172.21.15.26:0/2477922691 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffb040640b0 0x7ffb04066570 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7ffb0c009fd0 tx=0x7ffb0c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:34:18.369 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.368+0000 7ffb18ff9700 1 -- 172.21.15.26:0/2477922691 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ffb100539b0 con 0x7ffb1c0f8610 2021-11-03T18:34:18.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.573+0000 7ffb225fb700 1 -- 172.21.15.26:0/2477922691 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ffb1c027a00 con 0x7ffb1c0f8610 2021-11-03T18:34:18.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.574+0000 7ffb18ff9700 1 -- 172.21.15.26:0/2477922691 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7ffb10023020 con 0x7ffb1c0f8610 2021-11-03T18:34:18.580 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:34:18.580 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:34:18.581 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:34:18.581 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:34:18.581 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:34:18.581 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:34:18.582 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:34:18.582 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:34:18.582 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:34:18.582 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:34:18.583 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:34:18.583 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:34:18.583 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:34:18.583 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:34:18.583 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:34:18.584 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:34:18.584 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:34:18.584 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:34:18.584 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:34:18.585 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:34:18.585 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:34:18.585 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:34:18.585 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:34:18.586 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:34:18.586 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:34:18.586 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:34:18.586 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:34:18.587 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:34:18.587 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:34:18.587 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:34:18.587 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:34:18.588 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:34:18.588 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:34:18.588 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:34:18.588 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:34:18.589 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:34:18.589 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:34:18.589 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:34:18.589 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:34:18.590 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.576+0000 7ffb225fb700 1 -- 172.21.15.26:0/2477922691 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffb040640b0 msgr2=0x7ffb04066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:34:18.590 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.576+0000 7ffb225fb700 1 --2- 172.21.15.26:0/2477922691 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffb040640b0 0x7ffb04066570 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7ffb0c009fd0 tx=0x7ffb0c00b040).stop 2021-11-03T18:34:18.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.576+0000 7ffb225fb700 1 -- 172.21.15.26:0/2477922691 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb1c0f8610 msgr2=0x7ffb1c1073b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:34:18.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.576+0000 7ffb225fb700 1 --2- 172.21.15.26:0/2477922691 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb1c0f8610 0x7ffb1c1073b0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 rx=0x7ffb10000c00 tx=0x7ffb1000b040).stop 2021-11-03T18:34:18.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.576+0000 7ffb225fb700 1 -- 172.21.15.26:0/2477922691 shutdown_connections 2021-11-03T18:34:18.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.576+0000 7ffb225fb700 1 --2- 172.21.15.26:0/2477922691 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffb040640b0 0x7ffb04066570 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:18.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.576+0000 7ffb225fb700 1 --2- 172.21.15.26:0/2477922691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb1c0f7d00 0x7ffb1c106ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:18.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.576+0000 7ffb225fb700 1 --2- 172.21.15.26:0/2477922691 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb1c0f8610 0x7ffb1c1073b0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:18.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.576+0000 7ffb225fb700 1 -- 172.21.15.26:0/2477922691 >> 172.21.15.26:0/2477922691 conn(0x7ffb1c0f0540 msgr2=0x7ffb1c0fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:34:18.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.576+0000 7ffb225fb700 1 -- 172.21.15.26:0/2477922691 shutdown_connections 2021-11-03T18:34:18.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:18.576+0000 7ffb225fb700 1 -- 172.21.15.26:0/2477922691 wait complete. 2021-11-03T18:34:18.593 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:34:19.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:19 smithi026 ceph-mon[96795]: from='client.37212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:34:19.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:19 smithi026 ceph-mon[96795]: from='client.37216 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:34:19.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:19 smithi026 ceph-mon[96795]: pgmap v2989: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:19.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:19 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2409535357' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:34:19.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:19 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2477922691' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:34:19.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:19 smithi194 ceph-mon[65619]: from='client.37212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:34:19.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:19 smithi194 ceph-mon[65619]: from='client.37216 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:34:19.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:19 smithi194 ceph-mon[65619]: pgmap v2989: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:19.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:19 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2409535357' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:34:19.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:19 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2477922691' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:34:21.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:20 smithi194 ceph-mon[65619]: pgmap v2990: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:21.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:20 smithi026 ceph-mon[96795]: pgmap v2990: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:23.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:23 smithi026 ceph-mon[96795]: pgmap v2991: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:23.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:23 smithi194 ceph-mon[65619]: pgmap v2991: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:24.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:34:24.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:34:25.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:25 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:34:25.455 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:25 smithi026 ceph-mon[96795]: pgmap v2992: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:25.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:25 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:34:25.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:25 smithi194 ceph-mon[65619]: pgmap v2992: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:27.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:27 smithi026 ceph-mon[96795]: pgmap v2993: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:27.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:27 smithi194 ceph-mon[65619]: pgmap v2993: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:29.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:29 smithi026 ceph-mon[96795]: pgmap v2994: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:29.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:29 smithi194 ceph-mon[65619]: pgmap v2994: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:31.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:30 smithi194 ceph-mon[65619]: pgmap v2995: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:31.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:30 smithi026 ceph-mon[96795]: pgmap v2995: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:33.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:33 smithi026 ceph-mon[96795]: pgmap v2996: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:33.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:33 smithi194 ceph-mon[65619]: pgmap v2996: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:35.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:35 smithi026 ceph-mon[96795]: pgmap v2997: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:35.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:35 smithi194 ceph-mon[65619]: pgmap v2997: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:37.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:37 smithi026 ceph-mon[96795]: pgmap v2998: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:37.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:37 smithi194 ceph-mon[65619]: pgmap v2998: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:39.174 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:39 smithi026 ceph-mon[96795]: pgmap v2999: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:39.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:34:39.183 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:39 smithi194 ceph-mon[65619]: pgmap v2999: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:39.184 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:34:40.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:40 smithi194 ceph-mon[65619]: poll took 60053.974 ms: 1 events 2021-11-03T18:34:40.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:34:40.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:34:40.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:34:40.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:34:40.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:34:40.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:34:40.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:40 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:34:40.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:34:40.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:40 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:34:40.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:40 smithi026 ceph-mon[96795]: poll took 60053.974 ms: 1 events 2021-11-03T18:34:40.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:34:40.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:34:40.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:34:40.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:34:40.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:34:40.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:34:40.677 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:40 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:34:40.677 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:34:40.677 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:40 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:34:41.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:41 smithi194 ceph-mon[65619]: pgmap v3000: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:41.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:41 smithi026 ceph-mon[96795]: pgmap v3000: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:43.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:43 smithi194 ceph-mon[65619]: pgmap v3001: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:43.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:43 smithi026 ceph-mon[96795]: pgmap v3001: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:45.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:45 smithi194 ceph-mon[65619]: pgmap v3002: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:45.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:45 smithi026 ceph-mon[96795]: pgmap v3002: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:47.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:47 smithi194 ceph-mon[65619]: pgmap v3003: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:47.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:47 smithi026 ceph-mon[96795]: pgmap v3003: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:48.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.689+0000 7f3e02fb6700 1 -- 172.21.15.26:0/758048365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3dfc0f7490 msgr2=0x7f3dfc0f9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:34:48.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.689+0000 7f3e02fb6700 1 --2- 172.21.15.26:0/758048365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3dfc0f7490 0x7f3dfc0f9920 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 rx=0x7f3dec004660 tx=0x7f3dec009b30).stop 2021-11-03T18:34:48.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.689+0000 7f3e02fb6700 1 -- 172.21.15.26:0/758048365 shutdown_connections 2021-11-03T18:34:48.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.689+0000 7f3e02fb6700 1 --2- 172.21.15.26:0/758048365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3dfc0f7490 0x7f3dfc0f9920 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:48.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.689+0000 7f3e02fb6700 1 --2- 172.21.15.26:0/758048365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3dfc060310 0x7f3dfc0f6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:48.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.689+0000 7f3e02fb6700 1 -- 172.21.15.26:0/758048365 >> 172.21.15.26:0/758048365 conn(0x7f3dfc0f0ba0 msgr2=0x7f3dfc0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:34:48.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.689+0000 7f3e02fb6700 1 -- 172.21.15.26:0/758048365 shutdown_connections 2021-11-03T18:34:48.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.689+0000 7f3e02fb6700 1 -- 172.21.15.26:0/758048365 wait complete. 2021-11-03T18:34:48.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.689+0000 7f3e02fb6700 1 Processor -- start 2021-11-03T18:34:48.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.689+0000 7f3e02fb6700 1 -- start start 2021-11-03T18:34:48.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.690+0000 7f3e02fb6700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3dfc060310 0x7f3dfc10d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:34:48.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.690+0000 7f3e02fb6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3dfc0f7490 0x7f3dfc10d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:34:48.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.690+0000 7f3e02fb6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc10dda0 con 0x7f3dfc0f7490 2021-11-03T18:34:48.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.690+0000 7f3e02fb6700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc10dee0 con 0x7f3dfc060310 2021-11-03T18:34:48.692 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.690+0000 7f3e017b3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3dfc0f7490 0x7f3dfc10d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:34:48.692 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.690+0000 7f3e017b3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3dfc0f7490 0x7f3dfc10d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60808/0 (socket says 172.21.15.26:60808) 2021-11-03T18:34:48.692 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.690+0000 7f3e017b3700 1 -- 172.21.15.26:0/1114951889 learned_addr learned my addr 172.21.15.26:0/1114951889 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:34:48.692 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.690+0000 7f3e01fb4700 1 --2- 172.21.15.26:0/1114951889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3dfc060310 0x7f3dfc10d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:34:48.694 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.690+0000 7f3e017b3700 1 -- 172.21.15.26:0/1114951889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3dfc060310 msgr2=0x7f3dfc10d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:34:48.694 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.690+0000 7f3e017b3700 1 --2- 172.21.15.26:0/1114951889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3dfc060310 0x7f3dfc10d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:48.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.690+0000 7f3e017b3700 1 -- 172.21.15.26:0/1114951889 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dec005040 con 0x7f3dfc0f7490 2021-11-03T18:34:48.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.690+0000 7f3e017b3700 1 --2- 172.21.15.26:0/1114951889 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3dfc0f7490 0x7f3dfc10d7f0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7f3dec009990 tx=0x7f3dec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:34:48.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.690+0000 7f3df27fc700 1 -- 172.21.15.26:0/1114951889 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3dec018070 con 0x7f3dfc0f7490 2021-11-03T18:34:48.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.690+0000 7f3e02fb6700 1 -- 172.21.15.26:0/1114951889 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dfc10e820 con 0x7f3dfc0f7490 2021-11-03T18:34:48.696 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.690+0000 7f3df27fc700 1 -- 172.21.15.26:0/1114951889 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3dec007ba0 con 0x7f3dfc0f7490 2021-11-03T18:34:48.696 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.690+0000 7f3df27fc700 1 -- 172.21.15.26:0/1114951889 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3dec01c620 con 0x7f3dfc0f7490 2021-11-03T18:34:48.696 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.690+0000 7f3e02fb6700 1 -- 172.21.15.26:0/1114951889 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dfc10ed80 con 0x7f3dfc0f7490 2021-11-03T18:34:48.696 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.691+0000 7f3e02fb6700 1 -- 172.21.15.26:0/1114951889 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dfc045ad0 con 0x7f3dfc0f7490 2021-11-03T18:34:48.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.692+0000 7f3df27fc700 1 -- 172.21.15.26:0/1114951889 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f3dec01c8e0 con 0x7f3dfc0f7490 2021-11-03T18:34:48.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.692+0000 7f3df27fc700 1 --2- 172.21.15.26:0/1114951889 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3de8064100 0x7f3de80665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:34:48.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.692+0000 7f3df27fc700 1 -- 172.21.15.26:0/1114951889 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f3dec0826c0 con 0x7f3dfc0f7490 2021-11-03T18:34:48.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.692+0000 7f3e01fb4700 1 --2- 172.21.15.26:0/1114951889 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3de8064100 0x7f3de80665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:34:48.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.693+0000 7f3e01fb4700 1 --2- 172.21.15.26:0/1114951889 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3de8064100 0x7f3de80665c0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7f3df80041d0 tx=0x7f3df8009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:34:48.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.697+0000 7f3df27fc700 1 -- 172.21.15.26:0/1114951889 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f3dec054a20 con 0x7f3dfc0f7490 2021-11-03T18:34:48.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.874+0000 7f3e02fb6700 1 -- 172.21.15.26:0/1114951889 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3dfc10efa0 con 0x7f3de8064100 2021-11-03T18:34:48.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.876+0000 7f3df27fc700 1 -- 172.21.15.26:0/1114951889 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f3dfc10efa0 con 0x7f3de8064100 2021-11-03T18:34:48.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.877+0000 7f3e02fb6700 1 -- 172.21.15.26:0/1114951889 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3de8064100 msgr2=0x7f3de80665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:34:48.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.877+0000 7f3e02fb6700 1 --2- 172.21.15.26:0/1114951889 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3de8064100 0x7f3de80665c0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7f3df80041d0 tx=0x7f3df8009040).stop 2021-11-03T18:34:48.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.877+0000 7f3e02fb6700 1 -- 172.21.15.26:0/1114951889 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3dfc0f7490 msgr2=0x7f3dfc10d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:34:48.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.877+0000 7f3e02fb6700 1 --2- 172.21.15.26:0/1114951889 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3dfc0f7490 0x7f3dfc10d7f0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7f3dec009990 tx=0x7f3dec009b30).stop 2021-11-03T18:34:48.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.878+0000 7f3e02fb6700 1 -- 172.21.15.26:0/1114951889 shutdown_connections 2021-11-03T18:34:48.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.878+0000 7f3e02fb6700 1 --2- 172.21.15.26:0/1114951889 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3de8064100 0x7f3de80665c0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:48.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.878+0000 7f3e02fb6700 1 --2- 172.21.15.26:0/1114951889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3dfc060310 0x7f3dfc10d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:48.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.878+0000 7f3e02fb6700 1 --2- 172.21.15.26:0/1114951889 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3dfc0f7490 0x7f3dfc10d7f0 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:48.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.878+0000 7f3e02fb6700 1 -- 172.21.15.26:0/1114951889 >> 172.21.15.26:0/1114951889 conn(0x7f3dfc0f0ba0 msgr2=0x7f3dfc0f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:34:48.879 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.878+0000 7f3e02fb6700 1 -- 172.21.15.26:0/1114951889 shutdown_connections 2021-11-03T18:34:48.879 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.878+0000 7f3e02fb6700 1 -- 172.21.15.26:0/1114951889 wait complete. 2021-11-03T18:34:48.886 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:34:48.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.977+0000 7f4c434bb700 1 -- 172.21.15.26:0/2349412919 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c3c0f8610 msgr2=0x7f4c3c0f4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:34:48.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.977+0000 7f4c434bb700 1 --2- 172.21.15.26:0/2349412919 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c3c0f8610 0x7f4c3c0f4820 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 rx=0x7f4c2c004660 tx=0x7f4c2c009b30).stop 2021-11-03T18:34:48.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.977+0000 7f4c434bb700 1 -- 172.21.15.26:0/2349412919 shutdown_connections 2021-11-03T18:34:48.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.977+0000 7f4c434bb700 1 --2- 172.21.15.26:0/2349412919 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c3c0f8610 0x7f4c3c0f4820 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:48.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.977+0000 7f4c434bb700 1 --2- 172.21.15.26:0/2349412919 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c3c0f7d00 0x7f4c3c0f8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:34:48.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.977+0000 7f4c434bb700 1 -- 172.21.15.26:0/2349412919 >> 172.21.15.26:0/2349412919 conn(0x7f4c3c0f0540 msgr2=0x7f4c3c0f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:34:48.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.978+0000 7f4c434bb700 1 -- 172.21.15.26:0/2349412919 shutdown_connections 2021-11-03T18:34:48.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.978+0000 7f4c434bb700 1 -- 172.21.15.26:0/2349412919 wait complete. 2021-11-03T18:34:48.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.978+0000 7f4c434bb700 1 Processor -- start 2021-11-03T18:34:48.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.978+0000 7f4c434bb700 1 -- start start 2021-11-03T18:34:48.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.978+0000 7f4c434bb700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c3c0f7d00 0x7f4c3c0f75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:34:48.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.978+0000 7f4c434bb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c3c0f8610 0x7f4c3c0f5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:34:48.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.978+0000 7f4c434bb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3c0f6040 con 0x7f4c3c0f8610 2021-11-03T18:34:48.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.978+0000 7f4c434bb700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3c0f6180 con 0x7f4c3c0f7d00 2021-11-03T18:34:48.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.979+0000 7f4c40a56700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c3c0f8610 0x7f4c3c0f5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:34:48.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.979+0000 7f4c40a56700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c3c0f8610 0x7f4c3c0f5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60818/0 (socket says 172.21.15.26:60818) 2021-11-03T18:34:48.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.979+0000 7f4c40a56700 1 -- 172.21.15.26:0/2306645013 learned_addr learned my addr 172.21.15.26:0/2306645013 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:34:48.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.979+0000 7f4c41257700 1 --2- 172.21.15.26:0/2306645013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c3c0f7d00 0x7f4c3c0f75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:34:48.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.979+0000 7f4c40a56700 1 -- 172.21.15.26:0/2306645013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c3c0f7d00 msgr2=0x7f4c3c0f75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:34:48.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.979+0000 7f4c40a56700 1 --2- 172.21.15.26:0/2306645013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c3c0f7d00 0x7f4c3c0f75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:48.983 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.979+0000 7f4c40a56700 1 -- 172.21.15.26:0/2306645013 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c2c005040 con 0x7f4c3c0f8610 2021-11-03T18:34:48.984 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.979+0000 7f4c41257700 1 --2- 172.21.15.26:0/2306645013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c3c0f7d00 0x7f4c3c0f75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:34:48.984 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.979+0000 7f4c40a56700 1 --2- 172.21.15.26:0/2306645013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c3c0f8610 0x7f4c3c0f5a50 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 rx=0x7f4c2c009990 tx=0x7f4c2c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:34:48.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.979+0000 7f4c31ffb700 1 -- 172.21.15.26:0/2306645013 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c2c018070 con 0x7f4c3c0f8610 2021-11-03T18:34:48.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.979+0000 7f4c31ffb700 1 -- 172.21.15.26:0/2306645013 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4c2c007ca0 con 0x7f4c3c0f8610 2021-11-03T18:34:48.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.979+0000 7f4c434bb700 1 -- 172.21.15.26:0/2306645013 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c3c0f6400 con 0x7f4c3c0f8610 2021-11-03T18:34:48.986 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.979+0000 7f4c31ffb700 1 -- 172.21.15.26:0/2306645013 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c2c01c620 con 0x7f4c3c0f8610 2021-11-03T18:34:48.986 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.979+0000 7f4c434bb700 1 -- 172.21.15.26:0/2306645013 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c3c10ef80 con 0x7f4c3c0f8610 2021-11-03T18:34:48.987 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.980+0000 7f4c434bb700 1 -- 172.21.15.26:0/2306645013 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c3c045ad0 con 0x7f4c3c0f8610 2021-11-03T18:34:48.987 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.981+0000 7f4c31ffb700 1 -- 172.21.15.26:0/2306645013 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f4c2c01d960 con 0x7f4c3c0f8610 2021-11-03T18:34:48.988 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.981+0000 7f4c31ffb700 1 --2- 172.21.15.26:0/2306645013 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4c280640b0 0x7f4c28066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:34:48.990 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.981+0000 7f4c31ffb700 1 -- 172.21.15.26:0/2306645013 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f4c2c082520 con 0x7f4c3c0f8610 2021-11-03T18:34:48.990 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.981+0000 7f4c41257700 1 --2- 172.21.15.26:0/2306645013 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4c280640b0 0x7f4c28066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:34:48.990 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.982+0000 7f4c41257700 1 --2- 172.21.15.26:0/2306645013 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4c280640b0 0x7f4c28066570 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7f4c3c0f7360 tx=0x7f4c38008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:34:48.990 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:48.985+0000 7f4c31ffb700 1 -- 172.21.15.26:0/2306645013 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f4c2c054940 con 0x7f4c3c0f8610 2021-11-03T18:34:49.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.161+0000 7f4c434bb700 1 -- 172.21.15.26:0/2306645013 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c3c0ff040 con 0x7f4c280640b0 2021-11-03T18:34:49.175 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.176+0000 7f4c31ffb700 1 -- 172.21.15.26:0/2306645013 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7f4c3c0ff040 con 0x7f4c280640b0 2021-11-03T18:34:49.175 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:34:49.175 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (106m) 4m ago 107m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:34:49.176 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (98m) 4m ago 107m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:34:49.176 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (98m) 3m ago 106m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:34:49.176 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (105m) 4m ago 106m 42.3M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:34:49.176 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (99m) 4m ago 102m 26.2M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:34:49.177 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (99m) 4m ago 102m 26.8M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:34:49.177 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (102m) 3m ago 102m 27.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:34:49.177 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (102m) 3m ago 102m 27.4M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:34:49.177 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (99m) 4m ago 108m 601M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:34:49.177 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (99m) 3m ago 106m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:34:49.178 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (99m) 4m ago 108m 374M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:34:49.178 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (98m) 3m ago 106m 171M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:34:49.178 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (106m) 4m ago 106m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:34:49.178 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (106m) 3m ago 106m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:34:49.179 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (97m) 4m ago 105m 352M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:34:49.179 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (97m) 4m ago 105m 379M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:34:49.179 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (96m) 4m ago 104m 314M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:34:49.179 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (96m) 3m ago 104m 413M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:34:49.179 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (95m) 3m ago 104m 339M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:34:49.180 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (95m) 3m ago 104m 337M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:34:49.180 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (105m) 4m ago 106m 68.0M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:34:49.181 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.178+0000 7f4c434bb700 1 -- 172.21.15.26:0/2306645013 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4c280640b0 msgr2=0x7f4c28066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:34:49.181 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.178+0000 7f4c434bb700 1 --2- 172.21.15.26:0/2306645013 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4c280640b0 0x7f4c28066570 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7f4c3c0f7360 tx=0x7f4c38008040).stop 2021-11-03T18:34:49.182 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.178+0000 7f4c434bb700 1 -- 172.21.15.26:0/2306645013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c3c0f8610 msgr2=0x7f4c3c0f5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:34:49.182 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.178+0000 7f4c434bb700 1 --2- 172.21.15.26:0/2306645013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c3c0f8610 0x7f4c3c0f5a50 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 rx=0x7f4c2c009990 tx=0x7f4c2c009b30).stop 2021-11-03T18:34:49.182 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.178+0000 7f4c434bb700 1 -- 172.21.15.26:0/2306645013 shutdown_connections 2021-11-03T18:34:49.182 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.178+0000 7f4c434bb700 1 --2- 172.21.15.26:0/2306645013 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4c280640b0 0x7f4c28066570 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:49.183 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.178+0000 7f4c434bb700 1 --2- 172.21.15.26:0/2306645013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c3c0f7d00 0x7f4c3c0f75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:49.183 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.178+0000 7f4c434bb700 1 --2- 172.21.15.26:0/2306645013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c3c0f8610 0x7f4c3c0f5a50 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:49.183 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.178+0000 7f4c434bb700 1 -- 172.21.15.26:0/2306645013 >> 172.21.15.26:0/2306645013 conn(0x7f4c3c0f0540 msgr2=0x7f4c3c0fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:34:49.183 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.178+0000 7f4c434bb700 1 -- 172.21.15.26:0/2306645013 shutdown_connections 2021-11-03T18:34:49.184 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.178+0000 7f4c434bb700 1 -- 172.21.15.26:0/2306645013 wait complete. 2021-11-03T18:34:49.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.278+0000 7f03c859e700 1 -- 172.21.15.26:0/212963017 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03c00f66e0 msgr2=0x7f03c00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:34:49.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.278+0000 7f03c859e700 1 --2- 172.21.15.26:0/212963017 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03c00f66e0 0x7f03c00f6b00 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7f03b80099e0 tx=0x7f03b8004d10).stop 2021-11-03T18:34:49.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.278+0000 7f03c859e700 1 -- 172.21.15.26:0/212963017 shutdown_connections 2021-11-03T18:34:49.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.278+0000 7f03c859e700 1 --2- 172.21.15.26:0/212963017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03c00f6ff0 0x7f03c00f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:49.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.278+0000 7f03c859e700 1 --2- 172.21.15.26:0/212963017 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03c00f66e0 0x7f03c00f6b00 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:49.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.278+0000 7f03c859e700 1 -- 172.21.15.26:0/212963017 >> 172.21.15.26:0/212963017 conn(0x7f03c00f1f00 msgr2=0x7f03c00f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:34:49.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.278+0000 7f03c859e700 1 -- 172.21.15.26:0/212963017 shutdown_connections 2021-11-03T18:34:49.281 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.278+0000 7f03c859e700 1 -- 172.21.15.26:0/212963017 wait complete. 2021-11-03T18:34:49.282 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.279+0000 7f03c859e700 1 Processor -- start 2021-11-03T18:34:49.282 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.279+0000 7f03c859e700 1 -- start start 2021-11-03T18:34:49.282 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.279+0000 7f03c859e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03c00f66e0 0x7f03c0107070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:34:49.283 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.279+0000 7f03c859e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03c00f6ff0 0x7f03c0107560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:34:49.283 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.279+0000 7f03c859e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c0107b10 con 0x7f03c00f6ff0 2021-11-03T18:34:49.283 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.279+0000 7f03c859e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c0107c50 con 0x7f03c00f66e0 2021-11-03T18:34:49.283 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.279+0000 7f03c5b39700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03c00f6ff0 0x7f03c0107560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:34:49.283 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.279+0000 7f03c5b39700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03c00f6ff0 0x7f03c0107560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60828/0 (socket says 172.21.15.26:60828) 2021-11-03T18:34:49.284 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.279+0000 7f03c5b39700 1 -- 172.21.15.26:0/687851934 learned_addr learned my addr 172.21.15.26:0/687851934 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:34:49.284 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.279+0000 7f03c633a700 1 --2- 172.21.15.26:0/687851934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03c00f66e0 0x7f03c0107070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:34:49.284 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.279+0000 7f03c5b39700 1 -- 172.21.15.26:0/687851934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03c00f66e0 msgr2=0x7f03c0107070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:34:49.285 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.279+0000 7f03c5b39700 1 --2- 172.21.15.26:0/687851934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03c00f66e0 0x7f03c0107070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:49.285 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.279+0000 7f03c5b39700 1 -- 172.21.15.26:0/687851934 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b8009640 con 0x7f03c00f6ff0 2021-11-03T18:34:49.285 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.279+0000 7f03c5b39700 1 --2- 172.21.15.26:0/687851934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03c00f6ff0 0x7f03c0107560 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 rx=0x7f03b40026d0 tx=0x7f03b4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:34:49.286 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.279+0000 7f03beffd700 1 -- 172.21.15.26:0/687851934 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03b40079c0 con 0x7f03c00f6ff0 2021-11-03T18:34:49.286 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.280+0000 7f03beffd700 1 -- 172.21.15.26:0/687851934 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f03b400f040 con 0x7f03c00f6ff0 2021-11-03T18:34:49.286 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.280+0000 7f03c859e700 1 -- 172.21.15.26:0/687851934 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03c01085f0 con 0x7f03c00f6ff0 2021-11-03T18:34:49.286 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.280+0000 7f03beffd700 1 -- 172.21.15.26:0/687851934 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03b40148b0 con 0x7f03c00f6ff0 2021-11-03T18:34:49.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.280+0000 7f03c859e700 1 -- 172.21.15.26:0/687851934 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c0108b30 con 0x7f03c00f6ff0 2021-11-03T18:34:49.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.281+0000 7f03c859e700 1 -- 172.21.15.26:0/687851934 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03c0045ad0 con 0x7f03c00f6ff0 2021-11-03T18:34:49.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.281+0000 7f03beffd700 1 -- 172.21.15.26:0/687851934 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f03b4007b20 con 0x7f03c00f6ff0 2021-11-03T18:34:49.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.281+0000 7f03beffd700 1 --2- 172.21.15.26:0/687851934 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f03a80640b0 0x7f03a8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:34:49.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.281+0000 7f03beffd700 1 -- 172.21.15.26:0/687851934 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f03b4080740 con 0x7f03c00f6ff0 2021-11-03T18:34:49.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.281+0000 7f03c633a700 1 --2- 172.21.15.26:0/687851934 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f03a80640b0 0x7f03a8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:34:49.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.282+0000 7f03c633a700 1 --2- 172.21.15.26:0/687851934 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f03a80640b0 0x7f03a8066570 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7f03b8003380 tx=0x7f03b8004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:34:49.290 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.285+0000 7f03beffd700 1 -- 172.21.15.26:0/687851934 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f03b4052aa0 con 0x7f03c00f6ff0 2021-11-03T18:34:49.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:49 smithi194 ceph-mon[65619]: pgmap v3004: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:34:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:34:49.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.515+0000 7f03c859e700 1 -- 172.21.15.26:0/687851934 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f03c0027a00 con 0x7f03c00f6ff0 2021-11-03T18:34:49.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.515+0000 7f03beffd700 1 -- 172.21.15.26:0/687851934 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f03b4052690 con 0x7f03c00f6ff0 2021-11-03T18:34:49.515 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:34:49.515 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:34:49.515 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:34:49.516 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:34:49.516 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:34:49.516 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:34:49.516 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:34:49.517 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:34:49.517 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:34:49.517 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:34:49.517 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:34:49.517 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:34:49.518 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:34:49.518 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:34:49.518 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:34:49.518 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:34:49.519 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:34:49.519 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:34:49.520 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.517+0000 7f03c859e700 1 -- 172.21.15.26:0/687851934 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f03a80640b0 msgr2=0x7f03a8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:34:49.520 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.517+0000 7f03c859e700 1 --2- 172.21.15.26:0/687851934 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f03a80640b0 0x7f03a8066570 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7f03b8003380 tx=0x7f03b8004d10).stop 2021-11-03T18:34:49.520 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.517+0000 7f03c859e700 1 -- 172.21.15.26:0/687851934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03c00f6ff0 msgr2=0x7f03c0107560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:34:49.520 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.517+0000 7f03c859e700 1 --2- 172.21.15.26:0/687851934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03c00f6ff0 0x7f03c0107560 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 rx=0x7f03b40026d0 tx=0x7f03b4009de0).stop 2021-11-03T18:34:49.521 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.517+0000 7f03c859e700 1 -- 172.21.15.26:0/687851934 shutdown_connections 2021-11-03T18:34:49.521 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.517+0000 7f03c859e700 1 --2- 172.21.15.26:0/687851934 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f03a80640b0 0x7f03a8066570 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:49.521 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.517+0000 7f03c859e700 1 --2- 172.21.15.26:0/687851934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03c00f66e0 0x7f03c0107070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:49.521 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.517+0000 7f03c859e700 1 --2- 172.21.15.26:0/687851934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03c00f6ff0 0x7f03c0107560 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:49.521 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.517+0000 7f03c859e700 1 -- 172.21.15.26:0/687851934 >> 172.21.15.26:0/687851934 conn(0x7f03c00f1f00 msgr2=0x7f03c00fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:34:49.522 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.517+0000 7f03c859e700 1 -- 172.21.15.26:0/687851934 shutdown_connections 2021-11-03T18:34:49.522 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.517+0000 7f03c859e700 1 -- 172.21.15.26:0/687851934 wait complete. 2021-11-03T18:34:49.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.617+0000 7f985ca1c700 1 -- 172.21.15.26:0/1511792521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98580f5ef0 msgr2=0x7f98580f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:34:49.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.617+0000 7f985ca1c700 1 --2- 172.21.15.26:0/1511792521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98580f5ef0 0x7f98580f6920 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 rx=0x7f984c004660 tx=0x7f984c009b30).stop 2021-11-03T18:34:49.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.617+0000 7f985ca1c700 1 -- 172.21.15.26:0/1511792521 shutdown_connections 2021-11-03T18:34:49.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.617+0000 7f985ca1c700 1 --2- 172.21.15.26:0/1511792521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98580f5ef0 0x7f98580f6920 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:49.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.617+0000 7f985ca1c700 1 --2- 172.21.15.26:0/1511792521 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98580f55e0 0x7f98580f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:49.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.617+0000 7f985ca1c700 1 -- 172.21.15.26:0/1511792521 >> 172.21.15.26:0/1511792521 conn(0x7f98580f0de0 msgr2=0x7f98580f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:34:49.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.617+0000 7f985ca1c700 1 -- 172.21.15.26:0/1511792521 shutdown_connections 2021-11-03T18:34:49.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.617+0000 7f985ca1c700 1 -- 172.21.15.26:0/1511792521 wait complete. 2021-11-03T18:34:49.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.618+0000 7f985ca1c700 1 Processor -- start 2021-11-03T18:34:49.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.618+0000 7f985ca1c700 1 -- start start 2021-11-03T18:34:49.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.618+0000 7f985ca1c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98580f55e0 0x7f98580f97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:34:49.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.618+0000 7f985ca1c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98580f5ef0 0x7f98580f7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:34:49.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.618+0000 7f985ca1c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98580f81c0 con 0x7f98580f55e0 2021-11-03T18:34:49.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.618+0000 7f985ca1c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98580f8300 con 0x7f98580f5ef0 2021-11-03T18:34:49.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.618+0000 7f985659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98580f55e0 0x7f98580f97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:34:49.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.618+0000 7f985659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98580f55e0 0x7f98580f97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60836/0 (socket says 172.21.15.26:60836) 2021-11-03T18:34:49.622 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.618+0000 7f985659c700 1 -- 172.21.15.26:0/3458711382 learned_addr learned my addr 172.21.15.26:0/3458711382 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:34:49.622 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.618+0000 7f9855d9b700 1 --2- 172.21.15.26:0/3458711382 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98580f5ef0 0x7f98580f7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:34:49.622 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.618+0000 7f985659c700 1 -- 172.21.15.26:0/3458711382 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98580f5ef0 msgr2=0x7f98580f7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:34:49.623 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.618+0000 7f985659c700 1 --2- 172.21.15.26:0/3458711382 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98580f5ef0 0x7f98580f7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:49.623 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.618+0000 7f985659c700 1 -- 172.21.15.26:0/3458711382 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f984c005040 con 0x7f98580f55e0 2021-11-03T18:34:49.623 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.618+0000 7f985659c700 1 --2- 172.21.15.26:0/3458711382 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98580f55e0 0x7f98580f97e0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 rx=0x7f98480026d0 tx=0x7f9848009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:34:49.623 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.619+0000 7f9846ffd700 1 -- 172.21.15.26:0/3458711382 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9848009320 con 0x7f98580f55e0 2021-11-03T18:34:49.624 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.619+0000 7f9846ffd700 1 -- 172.21.15.26:0/3458711382 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f984800f040 con 0x7f98580f55e0 2021-11-03T18:34:49.625 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.619+0000 7f985ca1c700 1 -- 172.21.15.26:0/3458711382 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98580f85e0 con 0x7f98580f55e0 2021-11-03T18:34:49.625 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.619+0000 7f9846ffd700 1 -- 172.21.15.26:0/3458711382 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98480147e0 con 0x7f98580f55e0 2021-11-03T18:34:49.626 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.619+0000 7f985ca1c700 1 -- 172.21.15.26:0/3458711382 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f985810ef90 con 0x7f98580f55e0 2021-11-03T18:34:49.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.620+0000 7f985ca1c700 1 -- 172.21.15.26:0/3458711382 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9858045ad0 con 0x7f98580f55e0 2021-11-03T18:34:49.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.620+0000 7f9846ffd700 1 -- 172.21.15.26:0/3458711382 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f9848009480 con 0x7f98580f55e0 2021-11-03T18:34:49.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.620+0000 7f9846ffd700 1 --2- 172.21.15.26:0/3458711382 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f98400640b0 0x7f9840066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:34:49.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.621+0000 7f9846ffd700 1 -- 172.21.15.26:0/3458711382 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f9848080df0 con 0x7f98580f55e0 2021-11-03T18:34:49.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.621+0000 7f9855d9b700 1 --2- 172.21.15.26:0/3458711382 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f98400640b0 0x7f9840066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:34:49.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.621+0000 7f9855d9b700 1 --2- 172.21.15.26:0/3458711382 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f98400640b0 0x7f9840066570 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7f984c004630 tx=0x7f984c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:34:49.631 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.625+0000 7f9846ffd700 1 -- 172.21.15.26:0/3458711382 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f9848053210 con 0x7f98580f55e0 2021-11-03T18:34:49.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:49 smithi026 ceph-mon[96795]: pgmap v3004: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:49.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:34:49.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:34:49.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.826+0000 7f985ca1c700 1 -- 172.21.15.26:0/3458711382 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f985810f710 con 0x7f98580f55e0 2021-11-03T18:34:49.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.827+0000 7f9846ffd700 1 -- 172.21.15.26:0/3458711382 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f9848052e00 con 0x7f98580f55e0 2021-11-03T18:34:49.828 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:34:49.828 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:34:49.828 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:34:49.829 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:34:49.829 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:34:49.829 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:34:49.829 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:34:49.829 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:34:49.830 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:34:49.830 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:34:49.830 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:34:49.831 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:34:49.832 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:34:49.833 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:34:49.833 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:34:49.834 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:34:49.834 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:34:49.834 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:34:49.834 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:34:49.835 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:34:49.835 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:34:49.835 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:34:49.836 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:34:49.836 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:34:49.836 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:34:49.837 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:34:49.837 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:34:49.837 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:34:49.837 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:34:49.837 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:34:49.838 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:34:49.838 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:34:49.838 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:34:49.838 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:34:49.839 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:34:49.839 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:34:49.839 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:34:49.839 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:34:49.840 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:34:49.840 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.829+0000 7f985ca1c700 1 -- 172.21.15.26:0/3458711382 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f98400640b0 msgr2=0x7f9840066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:34:49.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.829+0000 7f985ca1c700 1 --2- 172.21.15.26:0/3458711382 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f98400640b0 0x7f9840066570 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7f984c004630 tx=0x7f984c009b30).stop 2021-11-03T18:34:49.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.829+0000 7f985ca1c700 1 -- 172.21.15.26:0/3458711382 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98580f55e0 msgr2=0x7f98580f97e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:34:49.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.829+0000 7f985ca1c700 1 --2- 172.21.15.26:0/3458711382 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98580f55e0 0x7f98580f97e0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 rx=0x7f98480026d0 tx=0x7f9848009de0).stop 2021-11-03T18:34:49.841 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.829+0000 7f985ca1c700 1 -- 172.21.15.26:0/3458711382 shutdown_connections 2021-11-03T18:34:49.842 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.829+0000 7f985ca1c700 1 --2- 172.21.15.26:0/3458711382 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f98400640b0 0x7f9840066570 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:49.842 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.829+0000 7f985ca1c700 1 --2- 172.21.15.26:0/3458711382 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98580f55e0 0x7f98580f97e0 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:49.842 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.829+0000 7f985ca1c700 1 --2- 172.21.15.26:0/3458711382 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98580f5ef0 0x7f98580f7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:34:49.842 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.829+0000 7f985ca1c700 1 -- 172.21.15.26:0/3458711382 >> 172.21.15.26:0/3458711382 conn(0x7f98580f0de0 msgr2=0x7f985805ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:34:49.843 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.829+0000 7f985ca1c700 1 -- 172.21.15.26:0/3458711382 shutdown_connections 2021-11-03T18:34:49.843 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:34:49.829+0000 7f985ca1c700 1 -- 172.21.15.26:0/3458711382 wait complete. 2021-11-03T18:34:49.843 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:34:50.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:50 smithi194 ceph-mon[65619]: from='client.37228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:34:50.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:50 smithi194 ceph-mon[65619]: from='client.37232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:34:50.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:50 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/687851934' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:34:50.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:50 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3458711382' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:34:50.674 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:50 smithi026 ceph-mon[96795]: from='client.37228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:34:50.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:50 smithi026 ceph-mon[96795]: from='client.37232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:34:50.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:50 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/687851934' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:34:50.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:50 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3458711382' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:34:51.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:51 smithi194 ceph-mon[65619]: pgmap v3005: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:51.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:51 smithi026 ceph-mon[96795]: pgmap v3005: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:53.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:53 smithi194 ceph-mon[65619]: pgmap v3006: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:53.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:53 smithi026 ceph-mon[96795]: pgmap v3006: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:54.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:34:54.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:34:55.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:55 smithi194 ceph-mon[65619]: pgmap v3007: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:55.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:55 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:34:55.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:55 smithi026 ceph-mon[96795]: pgmap v3007: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:55.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:55 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:34:57.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:57 smithi194 ceph-mon[65619]: pgmap v3008: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:57.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:57 smithi026 ceph-mon[96795]: pgmap v3008: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:59.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:34:59 smithi194 ceph-mon[65619]: pgmap v3009: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:34:59.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:34:59 smithi026 ceph-mon[96795]: pgmap v3009: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:01.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:01 smithi194 ceph-mon[65619]: pgmap v3010: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:01.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:01 smithi026 ceph-mon[96795]: pgmap v3010: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:03.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:03 smithi026 ceph-mon[96795]: pgmap v3011: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:03.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:03 smithi194 ceph-mon[65619]: pgmap v3011: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:05.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:05 smithi026 ceph-mon[96795]: pgmap v3012: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:05.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:05 smithi194 ceph-mon[65619]: pgmap v3012: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:07.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:07 smithi026 ceph-mon[96795]: pgmap v3013: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:07.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:07 smithi194 ceph-mon[65619]: pgmap v3013: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:09.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:09 smithi026 ceph-mon[96795]: pgmap v3014: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:09.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:09 smithi194 ceph-mon[65619]: pgmap v3014: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:10.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:10 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:35:10.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:10 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:35:10.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:10 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:35:10.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:10 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:35:11.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:11 smithi026 ceph-mon[96795]: pgmap v3015: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:11.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:11 smithi194 ceph-mon[65619]: pgmap v3015: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:13.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:13 smithi026 ceph-mon[96795]: pgmap v3016: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:13.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:13 smithi194 ceph-mon[65619]: pgmap v3016: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:15.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:15 smithi026 ceph-mon[96795]: pgmap v3017: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:15.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:15 smithi194 ceph-mon[65619]: pgmap v3017: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:17.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:17 smithi026 ceph-mon[96795]: pgmap v3018: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:17.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:17 smithi194 ceph-mon[65619]: pgmap v3018: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:19.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:19 smithi026 ceph-mon[96795]: pgmap v3019: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:19.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:19 smithi194 ceph-mon[65619]: pgmap v3019: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:19.943 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:19.943+0000 7fe202e15700 1 -- 172.21.15.26:0/227205133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1fc0f6ff0 msgr2=0x7fe1fc0f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:35:19.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:19.943+0000 7fe202e15700 1 --2- 172.21.15.26:0/227205133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1fc0f6ff0 0x7fe1fc0f7a20 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 rx=0x7fe1ec0099e0 tx=0x7fe1ec004d10).stop 2021-11-03T18:35:19.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:19.943+0000 7fe202e15700 1 -- 172.21.15.26:0/227205133 shutdown_connections 2021-11-03T18:35:19.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:19.943+0000 7fe202e15700 1 --2- 172.21.15.26:0/227205133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1fc0f6ff0 0x7fe1fc0f7a20 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:19.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:19.943+0000 7fe202e15700 1 --2- 172.21.15.26:0/227205133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1fc0f66e0 0x7fe1fc0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:19.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:19.943+0000 7fe202e15700 1 -- 172.21.15.26:0/227205133 >> 172.21.15.26:0/227205133 conn(0x7fe1fc0f1f00 msgr2=0x7fe1fc0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:35:19.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:19.944+0000 7fe202e15700 1 -- 172.21.15.26:0/227205133 shutdown_connections 2021-11-03T18:35:19.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:19.944+0000 7fe202e15700 1 -- 172.21.15.26:0/227205133 wait complete. 2021-11-03T18:35:19.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:19.944+0000 7fe202e15700 1 Processor -- start 2021-11-03T18:35:19.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:19.944+0000 7fe202e15700 1 -- start start 2021-11-03T18:35:19.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:19.945+0000 7fe202e15700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1fc0f66e0 0x7fe1fc107060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:35:19.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:19.945+0000 7fe202e15700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1fc0f6ff0 0x7fe1fc107550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:35:19.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:19.945+0000 7fe202e15700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc107b00 con 0x7fe1fc0f6ff0 2021-11-03T18:35:19.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:19.945+0000 7fe202e15700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc107c40 con 0x7fe1fc0f66e0 2021-11-03T18:35:19.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:19.945+0000 7fe1fbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1fc0f6ff0 0x7fe1fc107550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:35:19.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:19.945+0000 7fe1fbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1fc0f6ff0 0x7fe1fc107550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60856/0 (socket says 172.21.15.26:60856) 2021-11-03T18:35:19.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:19.945+0000 7fe1fbfff700 1 -- 172.21.15.26:0/458744895 learned_addr learned my addr 172.21.15.26:0/458744895 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:35:19.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:19.945+0000 7fe200bb1700 1 --2- 172.21.15.26:0/458744895 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1fc0f66e0 0x7fe1fc107060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:35:19.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:19.945+0000 7fe1fbfff700 1 -- 172.21.15.26:0/458744895 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1fc0f66e0 msgr2=0x7fe1fc107060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:35:19.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:19.945+0000 7fe1fbfff700 1 --2- 172.21.15.26:0/458744895 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1fc0f66e0 0x7fe1fc107060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:19.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:19.945+0000 7fe1fbfff700 1 -- 172.21.15.26:0/458744895 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ec009640 con 0x7fe1fc0f6ff0 2021-11-03T18:35:19.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:19.945+0000 7fe1fbfff700 1 --2- 172.21.15.26:0/458744895 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1fc0f6ff0 0x7fe1fc107550 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 rx=0x7fe1ec004b70 tx=0x7fe1ec004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:35:19.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:19.945+0000 7fe1f97fa700 1 -- 172.21.15.26:0/458744895 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1ec00e030 con 0x7fe1fc0f6ff0 2021-11-03T18:35:19.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:19.945+0000 7fe202e15700 1 -- 172.21.15.26:0/458744895 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1fc108580 con 0x7fe1fc0f6ff0 2021-11-03T18:35:19.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:19.945+0000 7fe1f97fa700 1 -- 172.21.15.26:0/458744895 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe1ec0049b0 con 0x7fe1fc0f6ff0 2021-11-03T18:35:19.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:19.945+0000 7fe1f97fa700 1 -- 172.21.15.26:0/458744895 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1ec018070 con 0x7fe1fc0f6ff0 2021-11-03T18:35:19.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:19.946+0000 7fe202e15700 1 -- 172.21.15.26:0/458744895 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1fc108a60 con 0x7fe1fc0f6ff0 2021-11-03T18:35:19.951 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:19.947+0000 7fe202e15700 1 -- 172.21.15.26:0/458744895 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1fc045ad0 con 0x7fe1fc0f6ff0 2021-11-03T18:35:19.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:19.947+0000 7fe1f97fa700 1 -- 172.21.15.26:0/458744895 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fe1ec01db40 con 0x7fe1fc0f6ff0 2021-11-03T18:35:19.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:19.947+0000 7fe1f97fa700 1 --2- 172.21.15.26:0/458744895 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe1e80640b0 0x7fe1e8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:35:19.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:19.947+0000 7fe1f97fa700 1 -- 172.21.15.26:0/458744895 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fe1ec0826b0 con 0x7fe1fc0f6ff0 2021-11-03T18:35:19.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:19.948+0000 7fe200bb1700 1 --2- 172.21.15.26:0/458744895 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe1e80640b0 0x7fe1e8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:35:19.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:19.948+0000 7fe200bb1700 1 --2- 172.21.15.26:0/458744895 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe1e80640b0 0x7fe1e8066570 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7fe1f4007fd0 tx=0x7fe1f4009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:35:19.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:19.952+0000 7fe1f97fa700 1 -- 172.21.15.26:0/458744895 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fe1ec054a70 con 0x7fe1fc0f6ff0 2021-11-03T18:35:20.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.130+0000 7fe202e15700 1 -- 172.21.15.26:0/458744895 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1fc0fefe0 con 0x7fe1e80640b0 2021-11-03T18:35:20.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.131+0000 7fe1f97fa700 1 -- 172.21.15.26:0/458744895 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fe1fc0fefe0 con 0x7fe1e80640b0 2021-11-03T18:35:20.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.133+0000 7fe202e15700 1 -- 172.21.15.26:0/458744895 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe1e80640b0 msgr2=0x7fe1e8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:35:20.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.133+0000 7fe202e15700 1 --2- 172.21.15.26:0/458744895 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe1e80640b0 0x7fe1e8066570 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7fe1f4007fd0 tx=0x7fe1f4009040).stop 2021-11-03T18:35:20.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.133+0000 7fe202e15700 1 -- 172.21.15.26:0/458744895 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1fc0f6ff0 msgr2=0x7fe1fc107550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:35:20.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.133+0000 7fe202e15700 1 --2- 172.21.15.26:0/458744895 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1fc0f6ff0 0x7fe1fc107550 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 rx=0x7fe1ec004b70 tx=0x7fe1ec004d10).stop 2021-11-03T18:35:20.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.133+0000 7fe202e15700 1 -- 172.21.15.26:0/458744895 shutdown_connections 2021-11-03T18:35:20.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.133+0000 7fe202e15700 1 --2- 172.21.15.26:0/458744895 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe1e80640b0 0x7fe1e8066570 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:20.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.133+0000 7fe202e15700 1 --2- 172.21.15.26:0/458744895 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1fc0f66e0 0x7fe1fc107060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:20.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.133+0000 7fe202e15700 1 --2- 172.21.15.26:0/458744895 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1fc0f6ff0 0x7fe1fc107550 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:20.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.133+0000 7fe202e15700 1 -- 172.21.15.26:0/458744895 >> 172.21.15.26:0/458744895 conn(0x7fe1fc0f1f00 msgr2=0x7fe1fc0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:35:20.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.133+0000 7fe202e15700 1 -- 172.21.15.26:0/458744895 shutdown_connections 2021-11-03T18:35:20.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.133+0000 7fe202e15700 1 -- 172.21.15.26:0/458744895 wait complete. 2021-11-03T18:35:20.141 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:35:20.236 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.236+0000 7fea8ffff700 1 -- 172.21.15.26:0/3365081765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea900f5440 msgr2=0x7fea900f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:35:20.236 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.236+0000 7fea8ffff700 1 --2- 172.21.15.26:0/3365081765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea900f5440 0x7fea900f5860 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 rx=0x7fea80004660 tx=0x7fea80009b30).stop 2021-11-03T18:35:20.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.236+0000 7fea8ffff700 1 -- 172.21.15.26:0/3365081765 shutdown_connections 2021-11-03T18:35:20.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.236+0000 7fea8ffff700 1 --2- 172.21.15.26:0/3365081765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea900f66e0 0x7fea900f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:35:20.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.236+0000 7fea8ffff700 1 --2- 172.21.15.26:0/3365081765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea900f5440 0x7fea900f5860 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:20.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.236+0000 7fea8ffff700 1 -- 172.21.15.26:0/3365081765 >> 172.21.15.26:0/3365081765 conn(0x7fea900f0ba0 msgr2=0x7fea900f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:35:20.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.236+0000 7fea8ffff700 1 -- 172.21.15.26:0/3365081765 shutdown_connections 2021-11-03T18:35:20.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.236+0000 7fea8ffff700 1 -- 172.21.15.26:0/3365081765 wait complete. 2021-11-03T18:35:20.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.237+0000 7fea8ffff700 1 Processor -- start 2021-11-03T18:35:20.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.237+0000 7fea8ffff700 1 -- start start 2021-11-03T18:35:20.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.237+0000 7fea8ffff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea900f5440 0x7fea90105d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:35:20.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.237+0000 7fea8ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea900f66e0 0x7fea90106210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:35:20.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.237+0000 7fea8ffff700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea90106850 con 0x7fea900f66e0 2021-11-03T18:35:20.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.237+0000 7fea8ffff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea90106fc0 con 0x7fea900f5440 2021-11-03T18:35:20.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.237+0000 7fea8e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea900f66e0 0x7fea90106210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:35:20.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.237+0000 7fea8e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea900f66e0 0x7fea90106210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60866/0 (socket says 172.21.15.26:60866) 2021-11-03T18:35:20.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.237+0000 7fea8e7fc700 1 -- 172.21.15.26:0/2647922071 learned_addr learned my addr 172.21.15.26:0/2647922071 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:35:20.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.237+0000 7fea8effd700 1 --2- 172.21.15.26:0/2647922071 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea900f5440 0x7fea90105d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:35:20.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.237+0000 7fea8e7fc700 1 -- 172.21.15.26:0/2647922071 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea900f5440 msgr2=0x7fea90105d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:35:20.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.237+0000 7fea8e7fc700 1 --2- 172.21.15.26:0/2647922071 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea900f5440 0x7fea90105d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:20.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.237+0000 7fea8e7fc700 1 -- 172.21.15.26:0/2647922071 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea80005040 con 0x7fea900f66e0 2021-11-03T18:35:20.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.238+0000 7fea8e7fc700 1 --2- 172.21.15.26:0/2647922071 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea900f66e0 0x7fea90106210 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7fea8400d770 tx=0x7fea8400db30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:35:20.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.238+0000 7fea777fe700 1 -- 172.21.15.26:0/2647922071 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea8400ea60 con 0x7fea900f66e0 2021-11-03T18:35:20.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.238+0000 7fea777fe700 1 -- 172.21.15.26:0/2647922071 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fea84012070 con 0x7fea900f66e0 2021-11-03T18:35:20.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.238+0000 7fea8ffff700 1 -- 172.21.15.26:0/2647922071 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea901072a0 con 0x7fea900f66e0 2021-11-03T18:35:20.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.238+0000 7fea777fe700 1 -- 172.21.15.26:0/2647922071 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea84015330 con 0x7fea900f66e0 2021-11-03T18:35:20.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.238+0000 7fea8ffff700 1 -- 172.21.15.26:0/2647922071 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea90107860 con 0x7fea900f66e0 2021-11-03T18:35:20.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.239+0000 7fea8ffff700 1 -- 172.21.15.26:0/2647922071 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea90045ad0 con 0x7fea900f66e0 2021-11-03T18:35:20.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.239+0000 7fea777fe700 1 -- 172.21.15.26:0/2647922071 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fea8401e070 con 0x7fea900f66e0 2021-11-03T18:35:20.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.240+0000 7fea777fe700 1 --2- 172.21.15.26:0/2647922071 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fea78064100 0x7fea780665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:35:20.245 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.240+0000 7fea777fe700 1 -- 172.21.15.26:0/2647922071 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fea84082c90 con 0x7fea900f66e0 2021-11-03T18:35:20.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.240+0000 7fea8effd700 1 --2- 172.21.15.26:0/2647922071 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fea78064100 0x7fea780665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:35:20.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.240+0000 7fea8effd700 1 --2- 172.21.15.26:0/2647922071 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fea78064100 0x7fea780665c0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 rx=0x7fea80004e30 tx=0x7fea80009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:35:20.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.244+0000 7fea777fe700 1 -- 172.21.15.26:0/2647922071 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fea84054f00 con 0x7fea900f66e0 2021-11-03T18:35:20.414 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.416+0000 7fea8ffff700 1 -- 172.21.15.26:0/2647922071 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fea900ff700 con 0x7fea78064100 2021-11-03T18:35:20.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.431+0000 7fea777fe700 1 -- 172.21.15.26:0/2647922071 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7fea900ff700 con 0x7fea78064100 2021-11-03T18:35:20.429 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:35:20.430 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (106m) 4m ago 107m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:35:20.430 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (98m) 4m ago 107m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:35:20.430 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (98m) 3m ago 107m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:35:20.430 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (106m) 4m ago 107m 42.3M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:35:20.431 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (99m) 4m ago 102m 26.2M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:35:20.431 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (99m) 4m ago 102m 26.8M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:35:20.431 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (103m) 3m ago 103m 27.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:35:20.431 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (102m) 3m ago 102m 27.4M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:35:20.432 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (100m) 4m ago 109m 601M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:35:20.432 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (99m) 3m ago 107m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:35:20.432 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (99m) 4m ago 109m 374M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:35:20.432 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (99m) 3m ago 106m 171M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:35:20.432 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (107m) 4m ago 107m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:35:20.433 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (106m) 3m ago 106m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:35:20.433 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (98m) 4m ago 106m 352M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:35:20.433 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (97m) 4m ago 105m 379M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:35:20.433 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (97m) 4m ago 105m 314M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:35:20.434 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (96m) 3m ago 105m 413M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:35:20.434 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (96m) 3m ago 104m 339M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:35:20.434 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (96m) 3m ago 104m 337M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:35:20.434 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (106m) 4m ago 107m 68.0M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:35:20.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.433+0000 7fea8ffff700 1 -- 172.21.15.26:0/2647922071 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fea78064100 msgr2=0x7fea780665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:35:20.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.433+0000 7fea8ffff700 1 --2- 172.21.15.26:0/2647922071 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fea78064100 0x7fea780665c0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 rx=0x7fea80004e30 tx=0x7fea80009b30).stop 2021-11-03T18:35:20.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.433+0000 7fea8ffff700 1 -- 172.21.15.26:0/2647922071 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea900f66e0 msgr2=0x7fea90106210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:35:20.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.433+0000 7fea8ffff700 1 --2- 172.21.15.26:0/2647922071 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea900f66e0 0x7fea90106210 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7fea8400d770 tx=0x7fea8400db30).stop 2021-11-03T18:35:20.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.433+0000 7fea8ffff700 1 -- 172.21.15.26:0/2647922071 shutdown_connections 2021-11-03T18:35:20.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.433+0000 7fea8ffff700 1 --2- 172.21.15.26:0/2647922071 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fea78064100 0x7fea780665c0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:20.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.433+0000 7fea8ffff700 1 --2- 172.21.15.26:0/2647922071 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea900f5440 0x7fea90105d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:20.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.433+0000 7fea8ffff700 1 --2- 172.21.15.26:0/2647922071 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea900f66e0 0x7fea90106210 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:20.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.433+0000 7fea8ffff700 1 -- 172.21.15.26:0/2647922071 >> 172.21.15.26:0/2647922071 conn(0x7fea900f0ba0 msgr2=0x7fea900fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:35:20.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.433+0000 7fea8ffff700 1 -- 172.21.15.26:0/2647922071 shutdown_connections 2021-11-03T18:35:20.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.433+0000 7fea8ffff700 1 -- 172.21.15.26:0/2647922071 wait complete. 2021-11-03T18:35:20.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.532+0000 7fdbd9670700 1 -- 172.21.15.26:0/1778187434 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbd40f5ef0 msgr2=0x7fdbd40f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:35:20.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.532+0000 7fdbd9670700 1 --2- 172.21.15.26:0/1778187434 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbd40f5ef0 0x7fdbd40f6920 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 rx=0x7fdbbc004660 tx=0x7fdbbc009b30).stop 2021-11-03T18:35:20.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.532+0000 7fdbd9670700 1 -- 172.21.15.26:0/1778187434 shutdown_connections 2021-11-03T18:35:20.533 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.532+0000 7fdbd9670700 1 --2- 172.21.15.26:0/1778187434 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbd40f5ef0 0x7fdbd40f6920 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:20.533 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.532+0000 7fdbd9670700 1 --2- 172.21.15.26:0/1778187434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbd40f55e0 0x7fdbd40f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:20.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.532+0000 7fdbd9670700 1 -- 172.21.15.26:0/1778187434 >> 172.21.15.26:0/1778187434 conn(0x7fdbd40f0de0 msgr2=0x7fdbd40f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:35:20.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.532+0000 7fdbd9670700 1 -- 172.21.15.26:0/1778187434 shutdown_connections 2021-11-03T18:35:20.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.532+0000 7fdbd9670700 1 -- 172.21.15.26:0/1778187434 wait complete. 2021-11-03T18:35:20.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.533+0000 7fdbd9670700 1 Processor -- start 2021-11-03T18:35:20.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.533+0000 7fdbd9670700 1 -- start start 2021-11-03T18:35:20.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.533+0000 7fdbd9670700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbd40f55e0 0x7fdbd4106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:35:20.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.533+0000 7fdbd9670700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbd40f5ef0 0x7fdbd41073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:35:20.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.533+0000 7fdbd9670700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd4107990 con 0x7fdbd40f55e0 2021-11-03T18:35:20.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.533+0000 7fdbd9670700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd4107ad0 con 0x7fdbd40f5ef0 2021-11-03T18:35:20.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.533+0000 7fdbd2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbd40f55e0 0x7fdbd4106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:35:20.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.533+0000 7fdbd2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbd40f55e0 0x7fdbd4106ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60874/0 (socket says 172.21.15.26:60874) 2021-11-03T18:35:20.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.533+0000 7fdbd2ffd700 1 -- 172.21.15.26:0/3702075872 learned_addr learned my addr 172.21.15.26:0/3702075872 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:35:20.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.533+0000 7fdbd2ffd700 1 -- 172.21.15.26:0/3702075872 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbd40f5ef0 msgr2=0x7fdbd41073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:35:20.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.533+0000 7fdbd2ffd700 1 --2- 172.21.15.26:0/3702075872 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbd40f5ef0 0x7fdbd41073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:35:20.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.533+0000 7fdbd2ffd700 1 -- 172.21.15.26:0/3702075872 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbbc005040 con 0x7fdbd40f55e0 2021-11-03T18:35:20.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.534+0000 7fdbd2ffd700 1 --2- 172.21.15.26:0/3702075872 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbd40f55e0 0x7fdbd4106ef0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7fdbcc00d8a0 tx=0x7fdbcc004f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:35:20.537 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.534+0000 7fdbcb7fe700 1 -- 172.21.15.26:0/3702075872 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbcc00b5a0 con 0x7fdbd40f55e0 2021-11-03T18:35:20.538 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.534+0000 7fdbcb7fe700 1 -- 172.21.15.26:0/3702075872 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdbcc00f040 con 0x7fdbd40f55e0 2021-11-03T18:35:20.538 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.534+0000 7fdbd9670700 1 -- 172.21.15.26:0/3702075872 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbd4108470 con 0x7fdbd40f55e0 2021-11-03T18:35:20.538 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.534+0000 7fdbcb7fe700 1 -- 172.21.15.26:0/3702075872 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbcc013b40 con 0x7fdbd40f55e0 2021-11-03T18:35:20.538 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.534+0000 7fdbd9670700 1 -- 172.21.15.26:0/3702075872 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbd4108a30 con 0x7fdbd40f55e0 2021-11-03T18:35:20.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.535+0000 7fdbd9670700 1 -- 172.21.15.26:0/3702075872 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbd4045ad0 con 0x7fdbd40f55e0 2021-11-03T18:35:20.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.535+0000 7fdbcb7fe700 1 -- 172.21.15.26:0/3702075872 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fdbcc01a030 con 0x7fdbd40f55e0 2021-11-03T18:35:20.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.535+0000 7fdbcb7fe700 1 --2- 172.21.15.26:0/3702075872 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdbc00640b0 0x7fdbc0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:35:20.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.536+0000 7fdbcb7fe700 1 -- 172.21.15.26:0/3702075872 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fdbcc080700 con 0x7fdbd40f55e0 2021-11-03T18:35:20.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.536+0000 7fdbd27fc700 1 --2- 172.21.15.26:0/3702075872 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdbc00640b0 0x7fdbc0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:35:20.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.536+0000 7fdbd27fc700 1 --2- 172.21.15.26:0/3702075872 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdbc00640b0 0x7fdbc0066570 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7fdbbc004e30 tx=0x7fdbbc009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:35:20.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.540+0000 7fdbcb7fe700 1 -- 172.21.15.26:0/3702075872 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fdbcc052a20 con 0x7fdbd40f55e0 2021-11-03T18:35:20.765 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.767+0000 7fdbd9670700 1 -- 172.21.15.26:0/3702075872 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdbd4109120 con 0x7fdbd40f55e0 2021-11-03T18:35:20.766 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.768+0000 7fdbcb7fe700 1 -- 172.21.15.26:0/3702075872 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fdbcc0182e0 con 0x7fdbd40f55e0 2021-11-03T18:35:20.767 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:35:20.767 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:35:20.767 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:35:20.768 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:35:20.768 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:35:20.768 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:35:20.768 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:35:20.769 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:35:20.769 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:35:20.769 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:35:20.769 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:35:20.770 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:35:20.770 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:35:20.770 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:35:20.770 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:35:20.770 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:35:20.771 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:35:20.771 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:35:20.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.770+0000 7fdbd9670700 1 -- 172.21.15.26:0/3702075872 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdbc00640b0 msgr2=0x7fdbc0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:35:20.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.770+0000 7fdbd9670700 1 --2- 172.21.15.26:0/3702075872 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdbc00640b0 0x7fdbc0066570 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7fdbbc004e30 tx=0x7fdbbc009b30).stop 2021-11-03T18:35:20.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.770+0000 7fdbd9670700 1 -- 172.21.15.26:0/3702075872 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbd40f55e0 msgr2=0x7fdbd4106ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:35:20.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.770+0000 7fdbd9670700 1 --2- 172.21.15.26:0/3702075872 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbd40f55e0 0x7fdbd4106ef0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7fdbcc00d8a0 tx=0x7fdbcc004f00).stop 2021-11-03T18:35:20.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.770+0000 7fdbd9670700 1 -- 172.21.15.26:0/3702075872 shutdown_connections 2021-11-03T18:35:20.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.770+0000 7fdbd9670700 1 --2- 172.21.15.26:0/3702075872 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdbc00640b0 0x7fdbc0066570 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:20.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.770+0000 7fdbd9670700 1 --2- 172.21.15.26:0/3702075872 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbd40f55e0 0x7fdbd4106ef0 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:20.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.770+0000 7fdbd9670700 1 --2- 172.21.15.26:0/3702075872 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbd40f5ef0 0x7fdbd41073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:35:20.774 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.770+0000 7fdbd9670700 1 -- 172.21.15.26:0/3702075872 >> 172.21.15.26:0/3702075872 conn(0x7fdbd40f0de0 msgr2=0x7fdbd405ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:35:20.774 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.770+0000 7fdbd9670700 1 -- 172.21.15.26:0/3702075872 shutdown_connections 2021-11-03T18:35:20.774 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.770+0000 7fdbd9670700 1 -- 172.21.15.26:0/3702075872 wait complete. 2021-11-03T18:35:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.870+0000 7f3273867700 1 -- 172.21.15.26:0/1919941887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f326c0f66e0 msgr2=0x7f326c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:35:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.870+0000 7f3273867700 1 --2- 172.21.15.26:0/1919941887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f326c0f66e0 0x7f326c0f6b00 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 rx=0x7f3268004660 tx=0x7f3268009b30).stop 2021-11-03T18:35:20.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.870+0000 7f3273867700 1 -- 172.21.15.26:0/1919941887 shutdown_connections 2021-11-03T18:35:20.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.870+0000 7f3273867700 1 --2- 172.21.15.26:0/1919941887 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f326c0f6ff0 0x7f326c0f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:20.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.870+0000 7f3273867700 1 --2- 172.21.15.26:0/1919941887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f326c0f66e0 0x7f326c0f6b00 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:20.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.870+0000 7f3273867700 1 -- 172.21.15.26:0/1919941887 >> 172.21.15.26:0/1919941887 conn(0x7f326c0f1f00 msgr2=0x7f326c0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:35:20.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.870+0000 7f3273867700 1 -- 172.21.15.26:0/1919941887 shutdown_connections 2021-11-03T18:35:20.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.870+0000 7f3273867700 1 -- 172.21.15.26:0/1919941887 wait complete. 2021-11-03T18:35:20.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.870+0000 7f3273867700 1 Processor -- start 2021-11-03T18:35:20.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.870+0000 7f3273867700 1 -- start start 2021-11-03T18:35:20.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.871+0000 7f3273867700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f326c0f66e0 0x7f326c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:35:20.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.871+0000 7f3273867700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f326c0f6ff0 0x7f326c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:35:20.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.871+0000 7f3273867700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f326c06a380 con 0x7f326c0f66e0 2021-11-03T18:35:20.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.871+0000 7f3273867700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f326c06a4c0 con 0x7f326c0f6ff0 2021-11-03T18:35:20.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.871+0000 7f3271603700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f326c0f66e0 0x7f326c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:35:20.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.871+0000 7f3271603700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f326c0f66e0 0x7f326c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60884/0 (socket says 172.21.15.26:60884) 2021-11-03T18:35:20.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.871+0000 7f3271603700 1 -- 172.21.15.26:0/2442523442 learned_addr learned my addr 172.21.15.26:0/2442523442 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:35:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.871+0000 7f3270e02700 1 --2- 172.21.15.26:0/2442523442 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f326c0f6ff0 0x7f326c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:35:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.871+0000 7f3271603700 1 -- 172.21.15.26:0/2442523442 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f326c0f6ff0 msgr2=0x7f326c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:35:20.880 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.871+0000 7f3271603700 1 --2- 172.21.15.26:0/2442523442 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f326c0f6ff0 0x7f326c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:20.880 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.871+0000 7f3271603700 1 -- 172.21.15.26:0/2442523442 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3268005040 con 0x7f326c0f66e0 2021-11-03T18:35:20.880 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.871+0000 7f3270e02700 1 --2- 172.21.15.26:0/2442523442 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f326c0f6ff0 0x7f326c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:35:20.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.871+0000 7f3271603700 1 --2- 172.21.15.26:0/2442523442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f326c0f66e0 0x7f326c06b9a0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 rx=0x7f3268009990 tx=0x7f3268009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:35:20.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.871+0000 7f3261ffb700 1 -- 172.21.15.26:0/2442523442 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3268018070 con 0x7f326c0f66e0 2021-11-03T18:35:20.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.871+0000 7f3273867700 1 -- 172.21.15.26:0/2442523442 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f326c06a740 con 0x7f326c0f66e0 2021-11-03T18:35:20.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.871+0000 7f3261ffb700 1 -- 172.21.15.26:0/2442523442 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3268007ba0 con 0x7f326c0f66e0 2021-11-03T18:35:20.882 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.871+0000 7f3261ffb700 1 -- 172.21.15.26:0/2442523442 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f326801c3c0 con 0x7f326c0f66e0 2021-11-03T18:35:20.882 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.871+0000 7f3273867700 1 -- 172.21.15.26:0/2442523442 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f326c06aca0 con 0x7f326c0f66e0 2021-11-03T18:35:20.882 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.872+0000 7f3273867700 1 -- 172.21.15.26:0/2442523442 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f326c045ad0 con 0x7f326c0f66e0 2021-11-03T18:35:20.882 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.873+0000 7f3261ffb700 1 -- 172.21.15.26:0/2442523442 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f326801d420 con 0x7f326c0f66e0 2021-11-03T18:35:20.883 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.873+0000 7f3261ffb700 1 --2- 172.21.15.26:0/2442523442 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f32580640b0 0x7f3258066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:35:20.883 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.873+0000 7f3261ffb700 1 -- 172.21.15.26:0/2442523442 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f3268082430 con 0x7f326c0f66e0 2021-11-03T18:35:20.883 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.873+0000 7f3270e02700 1 --2- 172.21.15.26:0/2442523442 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f32580640b0 0x7f3258066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:35:20.883 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.874+0000 7f3270e02700 1 --2- 172.21.15.26:0/2442523442 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f32580640b0 0x7f3258066570 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7f325c009880 tx=0x7f325c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:35:20.884 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:20.877+0000 7f3261ffb700 1 -- 172.21.15.26:0/2442523442 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f32680547f0 con 0x7f326c0f66e0 2021-11-03T18:35:21.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:21.082+0000 7f3273867700 1 -- 172.21.15.26:0/2442523442 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f326c0fef70 con 0x7f326c0f66e0 2021-11-03T18:35:21.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:21.082+0000 7f3261ffb700 1 -- 172.21.15.26:0/2442523442 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f32680543e0 con 0x7f326c0f66e0 2021-11-03T18:35:21.081 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:35:21.081 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:35:21.082 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:35:21.082 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:35:21.082 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:35:21.082 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:35:21.083 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:35:21.083 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:35:21.083 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:35:21.083 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:35:21.083 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:35:21.084 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:35:21.084 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:35:21.084 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:35:21.084 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:35:21.085 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:35:21.085 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:35:21.085 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:35:21.085 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:35:21.085 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:35:21.086 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:35:21.086 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:35:21.086 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:35:21.086 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:35:21.087 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:35:21.087 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:35:21.087 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:35:21.087 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:35:21.087 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:35:21.088 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:35:21.088 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:35:21.088 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:35:21.088 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:35:21.088 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:35:21.089 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:35:21.089 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:35:21.089 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:35:21.089 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:35:21.090 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:35:21.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:21.084+0000 7f3273867700 1 -- 172.21.15.26:0/2442523442 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f32580640b0 msgr2=0x7f3258066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:35:21.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:21.084+0000 7f3273867700 1 --2- 172.21.15.26:0/2442523442 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f32580640b0 0x7f3258066570 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7f325c009880 tx=0x7f325c00b040).stop 2021-11-03T18:35:21.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:21.084+0000 7f3273867700 1 -- 172.21.15.26:0/2442523442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f326c0f66e0 msgr2=0x7f326c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:35:21.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:21.084+0000 7f3273867700 1 --2- 172.21.15.26:0/2442523442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f326c0f66e0 0x7f326c06b9a0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 rx=0x7f3268009990 tx=0x7f3268009b30).stop 2021-11-03T18:35:21.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:21.084+0000 7f3273867700 1 -- 172.21.15.26:0/2442523442 shutdown_connections 2021-11-03T18:35:21.092 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:21.084+0000 7f3273867700 1 --2- 172.21.15.26:0/2442523442 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f32580640b0 0x7f3258066570 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:21.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:21.084+0000 7f3273867700 1 --2- 172.21.15.26:0/2442523442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f326c0f66e0 0x7f326c06b9a0 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:21.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:21.084+0000 7f3273867700 1 --2- 172.21.15.26:0/2442523442 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f326c0f6ff0 0x7f326c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:21.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:21.084+0000 7f3273867700 1 -- 172.21.15.26:0/2442523442 >> 172.21.15.26:0/2442523442 conn(0x7f326c0f1f00 msgr2=0x7f326c0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:35:21.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:21.084+0000 7f3273867700 1 -- 172.21.15.26:0/2442523442 shutdown_connections 2021-11-03T18:35:21.093 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:21.084+0000 7f3273867700 1 -- 172.21.15.26:0/2442523442 wait complete. 2021-11-03T18:35:21.094 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:35:21.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:21 smithi026 ceph-mon[96795]: pgmap v3020: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:21.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:21 smithi026 ceph-mon[96795]: from='client.37244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:35:21.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:21 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3702075872' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:35:21.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:21 smithi194 ceph-mon[65619]: pgmap v3020: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:21.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:21 smithi194 ceph-mon[65619]: from='client.37244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:35:21.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:21 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3702075872' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:35:22.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:22 smithi026 ceph-mon[96795]: from='client.37248 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:35:22.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:22 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2442523442' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:35:22.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:22 smithi194 ceph-mon[65619]: from='client.37248 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:35:22.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:22 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2442523442' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:35:23.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:23 smithi026 ceph-mon[96795]: pgmap v3021: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:23.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:23 smithi194 ceph-mon[65619]: pgmap v3021: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:25.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:25 smithi026 ceph-mon[96795]: pgmap v3022: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:25.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:35:25.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:25 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:35:25.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:25 smithi194 ceph-mon[65619]: pgmap v3022: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:25.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:35:25.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:25 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:35:27.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:27 smithi026 ceph-mon[96795]: pgmap v3023: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:27.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:27 smithi194 ceph-mon[65619]: pgmap v3023: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:29.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:29 smithi026 ceph-mon[96795]: pgmap v3024: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:29.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:29 smithi194 ceph-mon[65619]: pgmap v3024: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:31.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:31 smithi026 ceph-mon[96795]: pgmap v3025: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:31.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:31 smithi194 ceph-mon[65619]: pgmap v3025: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:33.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:33 smithi026 ceph-mon[96795]: pgmap v3026: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:33.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:33 smithi194 ceph-mon[65619]: pgmap v3026: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:35.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:35 smithi026 ceph-mon[96795]: pgmap v3027: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:35.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:35 smithi194 ceph-mon[65619]: pgmap v3027: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:37.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:37 smithi026 ceph-mon[96795]: pgmap v3028: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:37.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:37 smithi194 ceph-mon[65619]: pgmap v3028: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:39.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:39 smithi026 ceph-mon[96795]: pgmap v3029: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:39.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:39 smithi194 ceph-mon[65619]: pgmap v3029: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:40.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:35:40.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:40 smithi026 ceph-mon[96795]: poll took 60051.818 ms: 1 events 2021-11-03T18:35:40.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:35:40.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:35:40.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:35:40.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:35:40.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:35:40.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:35:40.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:35:40.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:35:40.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:40 smithi194 ceph-mon[65619]: poll took 60051.818 ms: 1 events 2021-11-03T18:35:40.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:35:40.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:35:40.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:35:40.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:35:40.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:35:40.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:35:40.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:35:41.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:41 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:35:41.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:41 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:35:41.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:41 smithi026 ceph-mon[96795]: pgmap v3030: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:41.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:41 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:35:41.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:41 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:35:41.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:41 smithi194 ceph-mon[65619]: pgmap v3030: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:43.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:43 smithi026 ceph-mon[96795]: pgmap v3031: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:43.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:43 smithi194 ceph-mon[65619]: pgmap v3031: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:45.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:45 smithi026 ceph-mon[96795]: pgmap v3032: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:45.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:45 smithi194 ceph-mon[65619]: pgmap v3032: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:47.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:47 smithi026 ceph-mon[96795]: pgmap v3033: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:47.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:47 smithi194 ceph-mon[65619]: pgmap v3033: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:49 smithi026 ceph-mon[96795]: pgmap v3034: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:35:49.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:35:49.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:49 smithi194 ceph-mon[65619]: pgmap v3034: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:35:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:35:51.199 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.198+0000 7f8442afa700 1 -- 172.21.15.26:0/1046427359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f843c0f5420 msgr2=0x7f843c0fbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:35:51.199 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.198+0000 7f8442afa700 1 --2- 172.21.15.26:0/1046427359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f843c0f5420 0x7f843c0fbd30 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 rx=0x7f8424004660 tx=0x7f8424009b30).stop 2021-11-03T18:35:51.200 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.198+0000 7f8442afa700 1 -- 172.21.15.26:0/1046427359 shutdown_connections 2021-11-03T18:35:51.200 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.198+0000 7f8442afa700 1 --2- 172.21.15.26:0/1046427359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f843c0f5420 0x7f843c0fbd30 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:51.200 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.198+0000 7f8442afa700 1 --2- 172.21.15.26:0/1046427359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f843c0f4a80 0x7f843c0f4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:51.200 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.198+0000 7f8442afa700 1 -- 172.21.15.26:0/1046427359 >> 172.21.15.26:0/1046427359 conn(0x7f843c0f04c0 msgr2=0x7f843c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:35:51.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.198+0000 7f8442afa700 1 -- 172.21.15.26:0/1046427359 shutdown_connections 2021-11-03T18:35:51.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.199+0000 7f8442afa700 1 -- 172.21.15.26:0/1046427359 wait complete. 2021-11-03T18:35:51.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.199+0000 7f8442afa700 1 Processor -- start 2021-11-03T18:35:51.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.199+0000 7f8442afa700 1 -- start start 2021-11-03T18:35:51.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.200+0000 7f8442afa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f843c0f4a80 0x7f843c106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:35:51.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.200+0000 7f8442afa700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f843c0f5420 0x7f843c107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:35:51.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.200+0000 7f8442afa700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843c1079b0 con 0x7f843c0f4a80 2021-11-03T18:35:51.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.200+0000 7f8442afa700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843c107af0 con 0x7f843c0f5420 2021-11-03T18:35:51.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.200+0000 7f8440896700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f843c0f4a80 0x7f843c106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:35:51.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.200+0000 7f8440896700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f843c0f4a80 0x7f843c106f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60902/0 (socket says 172.21.15.26:60902) 2021-11-03T18:35:51.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.200+0000 7f8440896700 1 -- 172.21.15.26:0/3138881174 learned_addr learned my addr 172.21.15.26:0/3138881174 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:35:51.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.200+0000 7f843bfff700 1 --2- 172.21.15.26:0/3138881174 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f843c0f5420 0x7f843c107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:35:51.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.200+0000 7f8440896700 1 -- 172.21.15.26:0/3138881174 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f843c0f5420 msgr2=0x7f843c107400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:35:51.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.200+0000 7f8440896700 1 --2- 172.21.15.26:0/3138881174 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f843c0f5420 0x7f843c107400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:51.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.200+0000 7f8440896700 1 -- 172.21.15.26:0/3138881174 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8424005040 con 0x7f843c0f4a80 2021-11-03T18:35:51.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.200+0000 7f8440896700 1 --2- 172.21.15.26:0/3138881174 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f843c0f4a80 0x7f843c106f10 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 rx=0x7f843400d7f0 tx=0x7f8434004e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:35:51.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.200+0000 7f84397fa700 1 -- 172.21.15.26:0/3138881174 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f843400f490 con 0x7f843c0f4a80 2021-11-03T18:35:51.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.200+0000 7f84397fa700 1 -- 172.21.15.26:0/3138881174 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f843400f040 con 0x7f843c0f4a80 2021-11-03T18:35:51.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.200+0000 7f8442afa700 1 -- 172.21.15.26:0/3138881174 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f843c108490 con 0x7f843c0f4a80 2021-11-03T18:35:51.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.200+0000 7f84397fa700 1 -- 172.21.15.26:0/3138881174 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84340139b0 con 0x7f843c0f4a80 2021-11-03T18:35:51.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.200+0000 7f8442afa700 1 -- 172.21.15.26:0/3138881174 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f843c108a50 con 0x7f843c0f4a80 2021-11-03T18:35:51.207 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.202+0000 7f8442afa700 1 -- 172.21.15.26:0/3138881174 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f843c045ad0 con 0x7f843c0f4a80 2021-11-03T18:35:51.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.202+0000 7f84397fa700 1 -- 172.21.15.26:0/3138881174 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f843401a030 con 0x7f843c0f4a80 2021-11-03T18:35:51.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.202+0000 7f84397fa700 1 --2- 172.21.15.26:0/3138881174 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f84280640b0 0x7f8428066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:35:51.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.203+0000 7f84397fa700 1 -- 172.21.15.26:0/3138881174 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f84340807d0 con 0x7f843c0f4a80 2021-11-03T18:35:51.208 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.203+0000 7f843bfff700 1 --2- 172.21.15.26:0/3138881174 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f84280640b0 0x7f8428066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:35:51.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.203+0000 7f843bfff700 1 --2- 172.21.15.26:0/3138881174 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f84280640b0 0x7f8428066570 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7f8424004630 tx=0x7f8424009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:35:51.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.207+0000 7f84397fa700 1 -- 172.21.15.26:0/3138881174 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f8434052a40 con 0x7f843c0f4a80 2021-11-03T18:35:51.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.384+0000 7f8442afa700 1 -- 172.21.15.26:0/3138881174 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f843c0008d0 con 0x7f84280640b0 2021-11-03T18:35:51.384 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.386+0000 7f84397fa700 1 -- 172.21.15.26:0/3138881174 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f843c0008d0 con 0x7f84280640b0 2021-11-03T18:35:51.386 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.387+0000 7f8442afa700 1 -- 172.21.15.26:0/3138881174 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f84280640b0 msgr2=0x7f8428066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:35:51.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.387+0000 7f8442afa700 1 --2- 172.21.15.26:0/3138881174 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f84280640b0 0x7f8428066570 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7f8424004630 tx=0x7f8424009b30).stop 2021-11-03T18:35:51.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.387+0000 7f8442afa700 1 -- 172.21.15.26:0/3138881174 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f843c0f4a80 msgr2=0x7f843c106f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:35:51.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.387+0000 7f8442afa700 1 --2- 172.21.15.26:0/3138881174 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f843c0f4a80 0x7f843c106f10 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 rx=0x7f843400d7f0 tx=0x7f8434004e80).stop 2021-11-03T18:35:51.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.387+0000 7f8442afa700 1 -- 172.21.15.26:0/3138881174 shutdown_connections 2021-11-03T18:35:51.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.387+0000 7f8442afa700 1 --2- 172.21.15.26:0/3138881174 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f84280640b0 0x7f8428066570 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:51.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.387+0000 7f8442afa700 1 --2- 172.21.15.26:0/3138881174 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f843c0f4a80 0x7f843c106f10 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:51.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.387+0000 7f8442afa700 1 --2- 172.21.15.26:0/3138881174 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f843c0f5420 0x7f843c107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:51.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.387+0000 7f8442afa700 1 -- 172.21.15.26:0/3138881174 >> 172.21.15.26:0/3138881174 conn(0x7f843c0f04c0 msgr2=0x7f843c0f8530 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:35:51.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.387+0000 7f8442afa700 1 -- 172.21.15.26:0/3138881174 shutdown_connections 2021-11-03T18:35:51.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.387+0000 7f8442afa700 1 -- 172.21.15.26:0/3138881174 wait complete. 2021-11-03T18:35:51.396 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:35:51.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:51 smithi026 ceph-mon[96795]: pgmap v3035: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:51.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.488+0000 7fcd921a8700 1 -- 172.21.15.26:0/956875520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd8c0f98b0 msgr2=0x7fcd8c0fbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:35:51.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.488+0000 7fcd921a8700 1 --2- 172.21.15.26:0/956875520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd8c0f98b0 0x7fcd8c0fbca0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 rx=0x7fcd80004660 tx=0x7fcd80009b30).stop 2021-11-03T18:35:51.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.488+0000 7fcd921a8700 1 -- 172.21.15.26:0/956875520 shutdown_connections 2021-11-03T18:35:51.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.488+0000 7fcd921a8700 1 --2- 172.21.15.26:0/956875520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd8c0f98b0 0x7fcd8c0fbca0 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:51.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.488+0000 7fcd921a8700 1 --2- 172.21.15.26:0/956875520 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd8c060310 0x7fcd8c0f93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:51.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.488+0000 7fcd921a8700 1 -- 172.21.15.26:0/956875520 >> 172.21.15.26:0/956875520 conn(0x7fcd8c0f0de0 msgr2=0x7fcd8c0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:35:51.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.488+0000 7fcd921a8700 1 -- 172.21.15.26:0/956875520 shutdown_connections 2021-11-03T18:35:51.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.488+0000 7fcd921a8700 1 -- 172.21.15.26:0/956875520 wait complete. 2021-11-03T18:35:51.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.488+0000 7fcd921a8700 1 Processor -- start 2021-11-03T18:35:51.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.488+0000 7fcd921a8700 1 -- start start 2021-11-03T18:35:51.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.489+0000 7fcd921a8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd8c060310 0x7fcd8c106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:35:51.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.489+0000 7fcd921a8700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd8c0f98b0 0x7fcd8c107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:35:51.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.489+0000 7fcd921a8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c107a10 con 0x7fcd8c060310 2021-11-03T18:35:51.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.489+0000 7fcd921a8700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c107b50 con 0x7fcd8c0f98b0 2021-11-03T18:35:51.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.489+0000 7fcd8b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd8c060310 0x7fcd8c106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:35:51.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.489+0000 7fcd8b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd8c060310 0x7fcd8c106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60912/0 (socket says 172.21.15.26:60912) 2021-11-03T18:35:51.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.489+0000 7fcd8b7fe700 1 -- 172.21.15.26:0/1165713706 learned_addr learned my addr 172.21.15.26:0/1165713706 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:35:51.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.489+0000 7fcd8affd700 1 --2- 172.21.15.26:0/1165713706 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd8c0f98b0 0x7fcd8c107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:35:51.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.489+0000 7fcd8b7fe700 1 -- 172.21.15.26:0/1165713706 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd8c0f98b0 msgr2=0x7fcd8c107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:35:51.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.489+0000 7fcd8b7fe700 1 --2- 172.21.15.26:0/1165713706 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd8c0f98b0 0x7fcd8c107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:51.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.489+0000 7fcd8b7fe700 1 -- 172.21.15.26:0/1165713706 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd80005040 con 0x7fcd8c060310 2021-11-03T18:35:51.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.489+0000 7fcd8b7fe700 1 --2- 172.21.15.26:0/1165713706 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd8c060310 0x7fcd8c106f70 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 rx=0x7fcd7c002700 tx=0x7fcd7c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:35:51.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.489+0000 7fcd73fff700 1 -- 172.21.15.26:0/1165713706 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd7c009320 con 0x7fcd8c060310 2021-11-03T18:35:51.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.489+0000 7fcd921a8700 1 -- 172.21.15.26:0/1165713706 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd8c1084f0 con 0x7fcd8c060310 2021-11-03T18:35:51.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.489+0000 7fcd73fff700 1 -- 172.21.15.26:0/1165713706 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcd7c00f040 con 0x7fcd8c060310 2021-11-03T18:35:51.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.489+0000 7fcd921a8700 1 -- 172.21.15.26:0/1165713706 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd8c108ab0 con 0x7fcd8c060310 2021-11-03T18:35:51.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.489+0000 7fcd73fff700 1 -- 172.21.15.26:0/1165713706 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd7c014900 con 0x7fcd8c060310 2021-11-03T18:35:51.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.490+0000 7fcd921a8700 1 -- 172.21.15.26:0/1165713706 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd8c045ad0 con 0x7fcd8c060310 2021-11-03T18:35:51.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.491+0000 7fcd73fff700 1 -- 172.21.15.26:0/1165713706 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fcd7c009480 con 0x7fcd8c060310 2021-11-03T18:35:51.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.491+0000 7fcd73fff700 1 --2- 172.21.15.26:0/1165713706 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcd740640b0 0x7fcd74066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:35:51.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.491+0000 7fcd73fff700 1 -- 172.21.15.26:0/1165713706 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fcd7c080a80 con 0x7fcd8c060310 2021-11-03T18:35:51.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.491+0000 7fcd8affd700 1 --2- 172.21.15.26:0/1165713706 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcd740640b0 0x7fcd74066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:35:51.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.492+0000 7fcd8affd700 1 --2- 172.21.15.26:0/1165713706 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcd740640b0 0x7fcd74066570 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7fcd80009da0 tx=0x7fcd80009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:35:51.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.495+0000 7fcd73fff700 1 -- 172.21.15.26:0/1165713706 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fcd7c052de0 con 0x7fcd8c060310 2021-11-03T18:35:51.505 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:51 smithi194 ceph-mon[65619]: pgmap v3035: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:51.669 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.670+0000 7fcd921a8700 1 -- 172.21.15.26:0/1165713706 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd8c0ff030 con 0x7fcd740640b0 2021-11-03T18:35:51.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.685+0000 7fcd73fff700 1 -- 172.21.15.26:0/1165713706 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7fcd8c0ff030 con 0x7fcd740640b0 2021-11-03T18:35:51.684 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:35:51.685 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (107m) 5m ago 108m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:35:51.685 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (99m) 5m ago 108m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:35:51.685 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (99m) 4m ago 107m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:35:51.685 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (106m) 5m ago 108m 42.3M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:35:51.686 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (100m) 5m ago 103m 26.2M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:35:51.686 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (100m) 5m ago 103m 26.8M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:35:51.686 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (103m) 4m ago 103m 27.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:35:51.686 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (103m) 4m ago 103m 27.4M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:35:51.686 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (100m) 5m ago 109m 601M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:35:51.687 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (100m) 4m ago 107m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:35:51.687 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (100m) 5m ago 109m 374M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:35:51.687 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (99m) 4m ago 107m 171M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:35:51.687 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (107m) 5m ago 107m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:35:51.688 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (107m) 4m ago 107m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:35:51.688 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (98m) 5m ago 106m 352M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:35:51.688 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (98m) 5m ago 106m 379M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:35:51.688 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (97m) 5m ago 105m 314M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:35:51.689 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (97m) 4m ago 105m 413M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:35:51.689 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (96m) 4m ago 105m 339M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:35:51.689 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (96m) 4m ago 105m 337M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:35:51.689 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (106m) 5m ago 107m 68.0M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:35:51.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.687+0000 7fcd921a8700 1 -- 172.21.15.26:0/1165713706 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcd740640b0 msgr2=0x7fcd74066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:35:51.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.687+0000 7fcd921a8700 1 --2- 172.21.15.26:0/1165713706 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcd740640b0 0x7fcd74066570 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7fcd80009da0 tx=0x7fcd80009b30).stop 2021-11-03T18:35:51.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.687+0000 7fcd921a8700 1 -- 172.21.15.26:0/1165713706 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd8c060310 msgr2=0x7fcd8c106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:35:51.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.687+0000 7fcd921a8700 1 --2- 172.21.15.26:0/1165713706 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd8c060310 0x7fcd8c106f70 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 rx=0x7fcd7c002700 tx=0x7fcd7c009d80).stop 2021-11-03T18:35:51.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.687+0000 7fcd921a8700 1 -- 172.21.15.26:0/1165713706 shutdown_connections 2021-11-03T18:35:51.692 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.687+0000 7fcd921a8700 1 --2- 172.21.15.26:0/1165713706 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcd740640b0 0x7fcd74066570 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:51.692 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.687+0000 7fcd921a8700 1 --2- 172.21.15.26:0/1165713706 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd8c060310 0x7fcd8c106f70 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:51.692 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.687+0000 7fcd921a8700 1 --2- 172.21.15.26:0/1165713706 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd8c0f98b0 0x7fcd8c107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:51.692 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.687+0000 7fcd921a8700 1 -- 172.21.15.26:0/1165713706 >> 172.21.15.26:0/1165713706 conn(0x7fcd8c0f0de0 msgr2=0x7fcd8c0f31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:35:51.692 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.687+0000 7fcd921a8700 1 -- 172.21.15.26:0/1165713706 shutdown_connections 2021-11-03T18:35:51.693 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.687+0000 7fcd921a8700 1 -- 172.21.15.26:0/1165713706 wait complete. 2021-11-03T18:35:51.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.786+0000 7f8875ef8700 1 -- 172.21.15.26:0/2052234636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88700f6ff0 msgr2=0x7f88700f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:35:51.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.786+0000 7f8875ef8700 1 --2- 172.21.15.26:0/2052234636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88700f6ff0 0x7f88700f7a20 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 rx=0x7f8864004660 tx=0x7f8864009b30).stop 2021-11-03T18:35:51.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.786+0000 7f8875ef8700 1 -- 172.21.15.26:0/2052234636 shutdown_connections 2021-11-03T18:35:51.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.786+0000 7f8875ef8700 1 --2- 172.21.15.26:0/2052234636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88700f6ff0 0x7f88700f7a20 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:51.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.786+0000 7f8875ef8700 1 --2- 172.21.15.26:0/2052234636 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88700f66e0 0x7f88700f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:51.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.786+0000 7f8875ef8700 1 -- 172.21.15.26:0/2052234636 >> 172.21.15.26:0/2052234636 conn(0x7f88700f1f00 msgr2=0x7f88700f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:35:51.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.786+0000 7f8875ef8700 1 -- 172.21.15.26:0/2052234636 shutdown_connections 2021-11-03T18:35:51.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.786+0000 7f8875ef8700 1 -- 172.21.15.26:0/2052234636 wait complete. 2021-11-03T18:35:51.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.787+0000 7f8875ef8700 1 Processor -- start 2021-11-03T18:35:51.790 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.787+0000 7f8875ef8700 1 -- start start 2021-11-03T18:35:51.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.787+0000 7f8875ef8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88700f66e0 0x7f8870106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:35:51.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.787+0000 7f8875ef8700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88700f6ff0 0x7f8870107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:35:51.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.787+0000 7f8875ef8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8870107a10 con 0x7f88700f66e0 2021-11-03T18:35:51.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.787+0000 7f8875ef8700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8870107b50 con 0x7f88700f6ff0 2021-11-03T18:35:51.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.787+0000 7f886f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88700f66e0 0x7f8870106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:35:51.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.787+0000 7f886f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88700f66e0 0x7f8870106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60922/0 (socket says 172.21.15.26:60922) 2021-11-03T18:35:51.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.787+0000 7f886f7fe700 1 -- 172.21.15.26:0/2287820595 learned_addr learned my addr 172.21.15.26:0/2287820595 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:35:51.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.787+0000 7f886effd700 1 --2- 172.21.15.26:0/2287820595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88700f6ff0 0x7f8870107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:35:51.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.788+0000 7f886f7fe700 1 -- 172.21.15.26:0/2287820595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88700f6ff0 msgr2=0x7f8870107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:35:51.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.788+0000 7f886f7fe700 1 --2- 172.21.15.26:0/2287820595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88700f6ff0 0x7f8870107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:51.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.788+0000 7f886f7fe700 1 -- 172.21.15.26:0/2287820595 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8864005040 con 0x7f88700f66e0 2021-11-03T18:35:51.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.788+0000 7f886effd700 1 --2- 172.21.15.26:0/2287820595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88700f6ff0 0x7f8870107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:35:51.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.788+0000 7f886f7fe700 1 --2- 172.21.15.26:0/2287820595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88700f66e0 0x7f8870106f70 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 rx=0x7f88600026d0 tx=0x7f8860009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:35:51.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.788+0000 7f8857fff700 1 -- 172.21.15.26:0/2287820595 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8860009320 con 0x7f88700f66e0 2021-11-03T18:35:51.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.788+0000 7f8875ef8700 1 -- 172.21.15.26:0/2287820595 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88701084f0 con 0x7f88700f66e0 2021-11-03T18:35:51.795 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.788+0000 7f8857fff700 1 -- 172.21.15.26:0/2287820595 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f886000f040 con 0x7f88700f66e0 2021-11-03T18:35:51.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.788+0000 7f8857fff700 1 -- 172.21.15.26:0/2287820595 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88600147e0 con 0x7f88700f66e0 2021-11-03T18:35:51.796 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.788+0000 7f8875ef8700 1 -- 172.21.15.26:0/2287820595 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8870108ab0 con 0x7f88700f66e0 2021-11-03T18:35:51.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.789+0000 7f8875ef8700 1 -- 172.21.15.26:0/2287820595 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8870045ad0 con 0x7f88700f66e0 2021-11-03T18:35:51.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.789+0000 7f8857fff700 1 -- 172.21.15.26:0/2287820595 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f8860009480 con 0x7f88700f66e0 2021-11-03T18:35:51.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.790+0000 7f8857fff700 1 --2- 172.21.15.26:0/2287820595 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8858064090 0x7f8858066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:35:51.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.790+0000 7f8857fff700 1 -- 172.21.15.26:0/2287820595 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f8860080ee0 con 0x7f88700f66e0 2021-11-03T18:35:51.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.790+0000 7f886effd700 1 --2- 172.21.15.26:0/2287820595 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8858064090 0x7f8858066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:35:51.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.790+0000 7f886effd700 1 --2- 172.21.15.26:0/2287820595 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8858064090 0x7f8858066550 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7f8864004e30 tx=0x7f8864009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:35:51.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:51.794+0000 7f8857fff700 1 -- 172.21.15.26:0/2287820595 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f8860053240 con 0x7f88700f66e0 2021-11-03T18:35:52.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.025+0000 7f8875ef8700 1 -- 172.21.15.26:0/2287820595 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f88700fef70 con 0x7f88700f66e0 2021-11-03T18:35:52.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.025+0000 7f8857fff700 1 -- 172.21.15.26:0/2287820595 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f8860052e30 con 0x7f88700f66e0 2021-11-03T18:35:52.025 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:35:52.025 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:35:52.025 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:35:52.025 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:35:52.026 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:35:52.026 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:35:52.026 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:35:52.026 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:35:52.027 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:35:52.027 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:35:52.027 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:35:52.027 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:35:52.028 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:35:52.028 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:35:52.028 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:35:52.028 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:35:52.028 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:35:52.029 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:35:52.030 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.027+0000 7f8875ef8700 1 -- 172.21.15.26:0/2287820595 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8858064090 msgr2=0x7f8858066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:35:52.030 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.027+0000 7f8875ef8700 1 --2- 172.21.15.26:0/2287820595 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8858064090 0x7f8858066550 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7f8864004e30 tx=0x7f8864009b30).stop 2021-11-03T18:35:52.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.027+0000 7f8875ef8700 1 -- 172.21.15.26:0/2287820595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88700f66e0 msgr2=0x7f8870106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:35:52.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.027+0000 7f8875ef8700 1 --2- 172.21.15.26:0/2287820595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88700f66e0 0x7f8870106f70 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 rx=0x7f88600026d0 tx=0x7f8860009de0).stop 2021-11-03T18:35:52.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.027+0000 7f8875ef8700 1 -- 172.21.15.26:0/2287820595 shutdown_connections 2021-11-03T18:35:52.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.027+0000 7f8875ef8700 1 --2- 172.21.15.26:0/2287820595 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8858064090 0x7f8858066550 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:52.032 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.027+0000 7f8875ef8700 1 --2- 172.21.15.26:0/2287820595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88700f66e0 0x7f8870106f70 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:52.032 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.027+0000 7f8875ef8700 1 --2- 172.21.15.26:0/2287820595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88700f6ff0 0x7f8870107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:52.032 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.027+0000 7f8875ef8700 1 -- 172.21.15.26:0/2287820595 >> 172.21.15.26:0/2287820595 conn(0x7f88700f1f00 msgr2=0x7f88700fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:35:52.032 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.027+0000 7f8875ef8700 1 -- 172.21.15.26:0/2287820595 shutdown_connections 2021-11-03T18:35:52.033 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.027+0000 7f8875ef8700 1 -- 172.21.15.26:0/2287820595 wait complete. 2021-11-03T18:35:52.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.128+0000 7eff10cbd700 1 -- 172.21.15.26:0/1534856286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff0c0f6860 msgr2=0x7eff0c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:35:52.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.128+0000 7eff10cbd700 1 --2- 172.21.15.26:0/1534856286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff0c0f6860 0x7eff0c0f6cc0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 rx=0x7efef4004660 tx=0x7efef4009b30).stop 2021-11-03T18:35:52.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.128+0000 7eff10cbd700 1 -- 172.21.15.26:0/1534856286 shutdown_connections 2021-11-03T18:35:52.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.128+0000 7eff10cbd700 1 --2- 172.21.15.26:0/1534856286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff0c0f6860 0x7eff0c0f6cc0 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:52.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.128+0000 7eff10cbd700 1 --2- 172.21.15.26:0/1534856286 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff0c0f55c0 0x7eff0c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:52.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.128+0000 7eff10cbd700 1 -- 172.21.15.26:0/1534856286 >> 172.21.15.26:0/1534856286 conn(0x7eff0c0f0d40 msgr2=0x7eff0c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:35:52.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.128+0000 7eff10cbd700 1 -- 172.21.15.26:0/1534856286 shutdown_connections 2021-11-03T18:35:52.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.128+0000 7eff10cbd700 1 -- 172.21.15.26:0/1534856286 wait complete. 2021-11-03T18:35:52.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.129+0000 7eff10cbd700 1 Processor -- start 2021-11-03T18:35:52.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.129+0000 7eff10cbd700 1 -- start start 2021-11-03T18:35:52.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.129+0000 7eff10cbd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff0c0f55c0 0x7eff0c10c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:35:52.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.129+0000 7eff10cbd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff0c0f6860 0x7eff0c10e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:35:52.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.129+0000 7eff10cbd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c0603b0 con 0x7eff0c0f55c0 2021-11-03T18:35:52.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.129+0000 7eff10cbd700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c0604f0 con 0x7eff0c0f6860 2021-11-03T18:35:52.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.129+0000 7eff0a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff0c0f55c0 0x7eff0c10c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:35:52.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.129+0000 7eff0a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff0c0f55c0 0x7eff0c10c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60932/0 (socket says 172.21.15.26:60932) 2021-11-03T18:35:52.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.129+0000 7eff0a59c700 1 -- 172.21.15.26:0/4187698017 learned_addr learned my addr 172.21.15.26:0/4187698017 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:35:52.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.129+0000 7eff09d9b700 1 --2- 172.21.15.26:0/4187698017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff0c0f6860 0x7eff0c10e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:35:52.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.129+0000 7eff0a59c700 1 -- 172.21.15.26:0/4187698017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff0c0f6860 msgr2=0x7eff0c10e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:35:52.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.129+0000 7eff0a59c700 1 --2- 172.21.15.26:0/4187698017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff0c0f6860 0x7eff0c10e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:52.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.129+0000 7eff0a59c700 1 -- 172.21.15.26:0/4187698017 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef4005040 con 0x7eff0c0f55c0 2021-11-03T18:35:52.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.129+0000 7eff0a59c700 1 --2- 172.21.15.26:0/4187698017 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff0c0f55c0 0x7eff0c10c050 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 rx=0x7eff0400d7f0 tx=0x7eff04004e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:35:52.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.130+0000 7eff02ffd700 1 -- 172.21.15.26:0/4187698017 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff0400b4f0 con 0x7eff0c0f55c0 2021-11-03T18:35:52.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.130+0000 7eff02ffd700 1 -- 172.21.15.26:0/4187698017 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7eff0400f040 con 0x7eff0c0f55c0 2021-11-03T18:35:52.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.130+0000 7eff02ffd700 1 -- 172.21.15.26:0/4187698017 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff04013980 con 0x7eff0c0f55c0 2021-11-03T18:35:52.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.130+0000 7eff10cbd700 1 -- 172.21.15.26:0/4187698017 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff0c10ea40 con 0x7eff0c0f55c0 2021-11-03T18:35:52.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.130+0000 7eff10cbd700 1 -- 172.21.15.26:0/4187698017 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff0c10eec0 con 0x7eff0c0f55c0 2021-11-03T18:35:52.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.131+0000 7eff10cbd700 1 -- 172.21.15.26:0/4187698017 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff0c045ad0 con 0x7eff0c0f55c0 2021-11-03T18:35:52.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.131+0000 7eff02ffd700 1 -- 172.21.15.26:0/4187698017 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7eff0401a030 con 0x7eff0c0f55c0 2021-11-03T18:35:52.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.132+0000 7eff02ffd700 1 --2- 172.21.15.26:0/4187698017 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efef80640b0 0x7efef8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:35:52.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.132+0000 7eff02ffd700 1 -- 172.21.15.26:0/4187698017 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7eff04080780 con 0x7eff0c0f55c0 2021-11-03T18:35:52.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.132+0000 7eff09d9b700 1 --2- 172.21.15.26:0/4187698017 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efef80640b0 0x7efef8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:35:52.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.132+0000 7eff09d9b700 1 --2- 172.21.15.26:0/4187698017 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efef80640b0 0x7efef8066570 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7efef4004630 tx=0x7efef4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:35:52.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.136+0000 7eff02ffd700 1 -- 172.21.15.26:0/4187698017 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7eff040529f0 con 0x7eff0c0f55c0 2021-11-03T18:35:52.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.341+0000 7eff10cbd700 1 -- 172.21.15.26:0/4187698017 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7eff0c0fde80 con 0x7eff0c0f55c0 2021-11-03T18:35:52.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.342+0000 7eff02ffd700 1 -- 172.21.15.26:0/4187698017 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7eff04018070 con 0x7eff0c0f55c0 2021-11-03T18:35:52.341 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:35:52.342 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:35:52.342 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:35:52.342 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:35:52.342 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:35:52.342 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:35:52.343 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:35:52.343 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:35:52.343 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:35:52.343 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:35:52.344 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:35:52.344 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:35:52.344 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:35:52.345 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:35:52.345 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:35:52.345 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:35:52.345 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:35:52.345 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:35:52.346 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:35:52.346 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:35:52.346 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:35:52.346 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:35:52.347 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:35:52.347 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:35:52.347 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:35:52.347 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:35:52.347 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:35:52.348 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:35:52.348 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:35:52.348 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:35:52.348 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:35:52.348 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:35:52.349 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:35:52.349 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:35:52.349 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:35:52.349 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:35:52.350 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:35:52.350 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:35:52.350 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:35:52.351 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.344+0000 7eff10cbd700 1 -- 172.21.15.26:0/4187698017 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efef80640b0 msgr2=0x7efef8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:35:52.351 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.344+0000 7eff10cbd700 1 --2- 172.21.15.26:0/4187698017 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efef80640b0 0x7efef8066570 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7efef4004630 tx=0x7efef4009b30).stop 2021-11-03T18:35:52.351 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.344+0000 7eff10cbd700 1 -- 172.21.15.26:0/4187698017 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff0c0f55c0 msgr2=0x7eff0c10c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:35:52.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.344+0000 7eff10cbd700 1 --2- 172.21.15.26:0/4187698017 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff0c0f55c0 0x7eff0c10c050 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 rx=0x7eff0400d7f0 tx=0x7eff04004e80).stop 2021-11-03T18:35:52.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.344+0000 7eff10cbd700 1 -- 172.21.15.26:0/4187698017 shutdown_connections 2021-11-03T18:35:52.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.344+0000 7eff10cbd700 1 --2- 172.21.15.26:0/4187698017 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7efef80640b0 0x7efef8066570 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:52.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.344+0000 7eff10cbd700 1 --2- 172.21.15.26:0/4187698017 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff0c0f55c0 0x7eff0c10c050 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:52.353 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.344+0000 7eff10cbd700 1 --2- 172.21.15.26:0/4187698017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff0c0f6860 0x7eff0c10e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:35:52.353 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.344+0000 7eff10cbd700 1 -- 172.21.15.26:0/4187698017 >> 172.21.15.26:0/4187698017 conn(0x7eff0c0f0d40 msgr2=0x7eff0c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:35:52.353 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.344+0000 7eff10cbd700 1 -- 172.21.15.26:0/4187698017 shutdown_connections 2021-11-03T18:35:52.353 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:35:52.344+0000 7eff10cbd700 1 -- 172.21.15.26:0/4187698017 wait complete. 2021-11-03T18:35:52.353 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:35:52.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:52 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2287820595' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:35:52.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:52 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2287820595' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:35:53.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:53 smithi026 ceph-mon[96795]: from='client.37260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:35:53.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:53 smithi026 ceph-mon[96795]: from='client.37264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:35:53.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:53 smithi026 ceph-mon[96795]: pgmap v3036: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:53.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:53 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/4187698017' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:35:53.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:53 smithi194 ceph-mon[65619]: from='client.37260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:35:53.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:53 smithi194 ceph-mon[65619]: from='client.37264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:35:53.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:53 smithi194 ceph-mon[65619]: pgmap v3036: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:53.475 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:53 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/4187698017' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:35:55.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:55 smithi026 ceph-mon[96795]: pgmap v3037: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:55.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:35:55.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:55 smithi194 ceph-mon[65619]: pgmap v3037: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:55.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:35:56.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:56 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:35:56.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:56 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:35:57.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:57 smithi026 ceph-mon[96795]: pgmap v3038: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:57.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:57 smithi194 ceph-mon[65619]: pgmap v3038: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:59.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:35:59 smithi026 ceph-mon[96795]: pgmap v3039: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:35:59.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:35:59 smithi194 ceph-mon[65619]: pgmap v3039: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:01.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:01 smithi026 ceph-mon[96795]: pgmap v3040: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:01.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:01 smithi194 ceph-mon[65619]: pgmap v3040: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:03.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:03 smithi026 ceph-mon[96795]: pgmap v3041: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:03.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:03 smithi194 ceph-mon[65619]: pgmap v3041: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:05.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:05 smithi026 ceph-mon[96795]: pgmap v3042: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:05.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:05 smithi194 ceph-mon[65619]: pgmap v3042: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:07.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:07 smithi026 ceph-mon[96795]: pgmap v3043: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:07.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:07 smithi194 ceph-mon[65619]: pgmap v3043: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:09.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:09 smithi026 ceph-mon[96795]: pgmap v3044: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:09.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:09 smithi194 ceph-mon[65619]: pgmap v3044: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:10.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:10 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:36:10.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:10 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:36:11.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:11 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:36:11.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:11 smithi026 ceph-mon[96795]: pgmap v3045: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:11.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:11 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:36:11.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:11 smithi194 ceph-mon[65619]: pgmap v3045: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:13.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:13 smithi026 ceph-mon[96795]: pgmap v3046: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:13.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:13 smithi194 ceph-mon[65619]: pgmap v3046: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:15.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:15 smithi026 ceph-mon[96795]: pgmap v3047: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:15.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:15 smithi194 ceph-mon[65619]: pgmap v3047: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:17.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:17 smithi026 ceph-mon[96795]: pgmap v3048: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:17.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:17 smithi194 ceph-mon[65619]: pgmap v3048: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:19.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:19 smithi026 ceph-mon[96795]: pgmap v3049: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:19.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:19 smithi194 ceph-mon[65619]: pgmap v3049: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:21.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:21 smithi026 ceph-mon[96795]: pgmap v3050: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:21.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:21 smithi194 ceph-mon[65619]: pgmap v3050: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:22.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.460+0000 7fa641b09700 1 -- 172.21.15.26:0/2976087776 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa63c0f4800 msgr2=0x7fa63c0f4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:36:22.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.460+0000 7fa641b09700 1 --2- 172.21.15.26:0/2976087776 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa63c0f4800 0x7fa63c0f4c20 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 rx=0x7fa630004660 tx=0x7fa630009b30).stop 2021-11-03T18:36:22.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.460+0000 7fa641b09700 1 -- 172.21.15.26:0/2976087776 shutdown_connections 2021-11-03T18:36:22.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.460+0000 7fa641b09700 1 --2- 172.21.15.26:0/2976087776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa63c0f51a0 0x7fa63c0f7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:22.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.460+0000 7fa641b09700 1 --2- 172.21.15.26:0/2976087776 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa63c0f4800 0x7fa63c0f4c20 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:22.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.460+0000 7fa641b09700 1 -- 172.21.15.26:0/2976087776 >> 172.21.15.26:0/2976087776 conn(0x7fa63c0f0320 msgr2=0x7fa63c0f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:36:22.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.460+0000 7fa641b09700 1 -- 172.21.15.26:0/2976087776 shutdown_connections 2021-11-03T18:36:22.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.460+0000 7fa641b09700 1 -- 172.21.15.26:0/2976087776 wait complete. 2021-11-03T18:36:22.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.460+0000 7fa641b09700 1 Processor -- start 2021-11-03T18:36:22.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.460+0000 7fa641b09700 1 -- start start 2021-11-03T18:36:22.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.461+0000 7fa641b09700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa63c0f4800 0x7fa63c106dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:36:22.464 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.461+0000 7fa641b09700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa63c0f51a0 0x7fa63c1072b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:36:22.464 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.461+0000 7fa641b09700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c1078b0 con 0x7fa63c0f51a0 2021-11-03T18:36:22.464 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.461+0000 7fa641b09700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c1080f0 con 0x7fa63c0f4800 2021-11-03T18:36:22.464 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.461+0000 7fa63bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa63c0f51a0 0x7fa63c1072b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:36:22.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.461+0000 7fa63bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa63c0f51a0 0x7fa63c1072b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60952/0 (socket says 172.21.15.26:60952) 2021-11-03T18:36:22.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.461+0000 7fa63bfff700 1 -- 172.21.15.26:0/2980652162 learned_addr learned my addr 172.21.15.26:0/2980652162 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:36:22.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.461+0000 7fa640b07700 1 --2- 172.21.15.26:0/2980652162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa63c0f4800 0x7fa63c106dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:36:22.465 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.461+0000 7fa63bfff700 1 -- 172.21.15.26:0/2980652162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa63c0f4800 msgr2=0x7fa63c106dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:36:22.466 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.461+0000 7fa63bfff700 1 --2- 172.21.15.26:0/2980652162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa63c0f4800 0x7fa63c106dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:22.466 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.461+0000 7fa63bfff700 1 -- 172.21.15.26:0/2980652162 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa630005040 con 0x7fa63c0f51a0 2021-11-03T18:36:22.466 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.461+0000 7fa640b07700 1 --2- 172.21.15.26:0/2980652162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa63c0f4800 0x7fa63c106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:36:22.466 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.461+0000 7fa63bfff700 1 --2- 172.21.15.26:0/2980652162 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa63c0f51a0 0x7fa63c1072b0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 rx=0x7fa62800c510 tx=0x7fa628007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:36:22.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.462+0000 7fa6397fa700 1 -- 172.21.15.26:0/2980652162 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa62800f650 con 0x7fa63c0f51a0 2021-11-03T18:36:22.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.462+0000 7fa641b09700 1 -- 172.21.15.26:0/2980652162 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa63c1083d0 con 0x7fa63c0f51a0 2021-11-03T18:36:22.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.462+0000 7fa6397fa700 1 -- 172.21.15.26:0/2980652162 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa62800fc60 con 0x7fa63c0f51a0 2021-11-03T18:36:22.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.462+0000 7fa6397fa700 1 -- 172.21.15.26:0/2980652162 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa628012cd0 con 0x7fa63c0f51a0 2021-11-03T18:36:22.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.462+0000 7fa641b09700 1 -- 172.21.15.26:0/2980652162 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa63c108910 con 0x7fa63c0f51a0 2021-11-03T18:36:22.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.463+0000 7fa641b09700 1 -- 172.21.15.26:0/2980652162 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa63c059100 con 0x7fa63c0f51a0 2021-11-03T18:36:22.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.463+0000 7fa6397fa700 1 -- 172.21.15.26:0/2980652162 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fa628010070 con 0x7fa63c0f51a0 2021-11-03T18:36:22.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.463+0000 7fa6397fa700 1 --2- 172.21.15.26:0/2980652162 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa62c064100 0x7fa62c0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:36:22.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.464+0000 7fa6397fa700 1 -- 172.21.15.26:0/2980652162 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fa6280806f0 con 0x7fa63c0f51a0 2021-11-03T18:36:22.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.464+0000 7fa640b07700 1 --2- 172.21.15.26:0/2980652162 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa62c064100 0x7fa62c0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:36:22.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.464+0000 7fa640b07700 1 --2- 172.21.15.26:0/2980652162 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa62c064100 0x7fa62c0665c0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7fa630004e30 tx=0x7fa630009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:36:22.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.468+0000 7fa6397fa700 1 -- 172.21.15.26:0/2980652162 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fa628052a20 con 0x7fa63c0f51a0 2021-11-03T18:36:22.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.647+0000 7fa641b09700 1 -- 172.21.15.26:0/2980652162 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa63c0fee50 con 0x7fa62c064100 2021-11-03T18:36:22.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.648+0000 7fa6397fa700 1 -- 172.21.15.26:0/2980652162 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fa63c0fee50 con 0x7fa62c064100 2021-11-03T18:36:22.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.650+0000 7fa641b09700 1 -- 172.21.15.26:0/2980652162 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa62c064100 msgr2=0x7fa62c0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:36:22.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.650+0000 7fa641b09700 1 --2- 172.21.15.26:0/2980652162 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa62c064100 0x7fa62c0665c0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7fa630004e30 tx=0x7fa630009b30).stop 2021-11-03T18:36:22.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.650+0000 7fa641b09700 1 -- 172.21.15.26:0/2980652162 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa63c0f51a0 msgr2=0x7fa63c1072b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:36:22.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.650+0000 7fa641b09700 1 --2- 172.21.15.26:0/2980652162 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa63c0f51a0 0x7fa63c1072b0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 rx=0x7fa62800c510 tx=0x7fa628007df0).stop 2021-11-03T18:36:22.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.650+0000 7fa641b09700 1 -- 172.21.15.26:0/2980652162 shutdown_connections 2021-11-03T18:36:22.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.650+0000 7fa641b09700 1 --2- 172.21.15.26:0/2980652162 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa62c064100 0x7fa62c0665c0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:22.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.650+0000 7fa641b09700 1 --2- 172.21.15.26:0/2980652162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa63c0f4800 0x7fa63c106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:22.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.650+0000 7fa641b09700 1 --2- 172.21.15.26:0/2980652162 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa63c0f51a0 0x7fa63c1072b0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:22.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.650+0000 7fa641b09700 1 -- 172.21.15.26:0/2980652162 >> 172.21.15.26:0/2980652162 conn(0x7fa63c0f0320 msgr2=0x7fa63c0fb370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:36:22.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.650+0000 7fa641b09700 1 -- 172.21.15.26:0/2980652162 shutdown_connections 2021-11-03T18:36:22.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.650+0000 7fa641b09700 1 -- 172.21.15.26:0/2980652162 wait complete. 2021-11-03T18:36:22.658 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:36:22.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.750+0000 7f12a81b4700 1 -- 172.21.15.26:0/19809895 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12a006b920 msgr2=0x7f12a0069ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:36:22.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.750+0000 7f12a81b4700 1 --2- 172.21.15.26:0/19809895 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12a006b920 0x7f12a0069ec0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 rx=0x7f129c004660 tx=0x7f129c009b30).stop 2021-11-03T18:36:22.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.750+0000 7f12a81b4700 1 -- 172.21.15.26:0/19809895 shutdown_connections 2021-11-03T18:36:22.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.750+0000 7f12a81b4700 1 --2- 172.21.15.26:0/19809895 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12a006a3b0 0x7f12a006a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:22.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.750+0000 7f12a81b4700 1 --2- 172.21.15.26:0/19809895 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12a006b920 0x7f12a0069ec0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:22.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.750+0000 7f12a81b4700 1 -- 172.21.15.26:0/19809895 >> 172.21.15.26:0/19809895 conn(0x7f12a00f1f00 msgr2=0x7f12a00f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:36:22.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.751+0000 7f12a81b4700 1 -- 172.21.15.26:0/19809895 shutdown_connections 2021-11-03T18:36:22.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.751+0000 7f12a81b4700 1 -- 172.21.15.26:0/19809895 wait complete. 2021-11-03T18:36:22.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.751+0000 7f12a81b4700 1 Processor -- start 2021-11-03T18:36:22.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.751+0000 7f12a81b4700 1 -- start start 2021-11-03T18:36:22.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.751+0000 7f12a81b4700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12a006a3b0 0x7f12a010d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:36:22.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.751+0000 7f12a81b4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12a006b920 0x7f12a010dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:36:22.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.751+0000 7f12a81b4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a010e070 con 0x7f12a006b920 2021-11-03T18:36:22.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.751+0000 7f12a81b4700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a010e1b0 con 0x7f12a006a3b0 2021-11-03T18:36:22.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.751+0000 7f12a574f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12a006b920 0x7f12a010dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:36:22.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.751+0000 7f12a574f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12a006b920 0x7f12a010dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60962/0 (socket says 172.21.15.26:60962) 2021-11-03T18:36:22.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.751+0000 7f12a574f700 1 -- 172.21.15.26:0/2826299301 learned_addr learned my addr 172.21.15.26:0/2826299301 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:36:22.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.752+0000 7f12a574f700 1 -- 172.21.15.26:0/2826299301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12a006a3b0 msgr2=0x7f12a010d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:36:22.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.752+0000 7f12a5f50700 1 --2- 172.21.15.26:0/2826299301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12a006a3b0 0x7f12a010d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:36:22.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.752+0000 7f12a574f700 1 --2- 172.21.15.26:0/2826299301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12a006a3b0 0x7f12a010d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:22.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.752+0000 7f12a574f700 1 -- 172.21.15.26:0/2826299301 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f129c005040 con 0x7f12a006b920 2021-11-03T18:36:22.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.752+0000 7f12a574f700 1 --2- 172.21.15.26:0/2826299301 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12a006b920 0x7f12a010dac0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 rx=0x7f129000c530 tx=0x7f1290007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:36:22.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.752+0000 7f12967fc700 1 -- 172.21.15.26:0/2826299301 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f129000f650 con 0x7f12a006b920 2021-11-03T18:36:22.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.752+0000 7f12967fc700 1 -- 172.21.15.26:0/2826299301 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f129000fc60 con 0x7f12a006b920 2021-11-03T18:36:22.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.752+0000 7f12a81b4700 1 -- 172.21.15.26:0/2826299301 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12a010eb50 con 0x7f12a006b920 2021-11-03T18:36:22.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.752+0000 7f12967fc700 1 -- 172.21.15.26:0/2826299301 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1290012cd0 con 0x7f12a006b920 2021-11-03T18:36:22.758 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.752+0000 7f12a81b4700 1 -- 172.21.15.26:0/2826299301 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a010f110 con 0x7f12a006b920 2021-11-03T18:36:22.758 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.753+0000 7f12a81b4700 1 -- 172.21.15.26:0/2826299301 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12a0045ad0 con 0x7f12a006b920 2021-11-03T18:36:22.758 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.754+0000 7f12967fc700 1 -- 172.21.15.26:0/2826299301 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f1290010070 con 0x7f12a006b920 2021-11-03T18:36:22.758 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.754+0000 7f12967fc700 1 --2- 172.21.15.26:0/2826299301 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f128c0640b0 0x7f128c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:36:22.759 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.754+0000 7f12967fc700 1 -- 172.21.15.26:0/2826299301 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f1290080640 con 0x7f12a006b920 2021-11-03T18:36:22.759 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.754+0000 7f12a5f50700 1 --2- 172.21.15.26:0/2826299301 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f128c0640b0 0x7f128c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:36:22.759 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.754+0000 7f12a5f50700 1 --2- 172.21.15.26:0/2826299301 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f128c0640b0 0x7f128c066570 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7f129c004e30 tx=0x7f129c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:36:22.759 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.758+0000 7f12967fc700 1 -- 172.21.15.26:0/2826299301 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f12900528b0 con 0x7f12a006b920 2021-11-03T18:36:22.932 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.933+0000 7f12a81b4700 1 -- 172.21.15.26:0/2826299301 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f12a0105680 con 0x7f128c0640b0 2021-11-03T18:36:22.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.948+0000 7f12967fc700 1 -- 172.21.15.26:0/2826299301 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7f129c013410 con 0x7f128c0640b0 2021-11-03T18:36:22.946 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:36:22.947 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (107m) 5m ago 108m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:36:22.947 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (99m) 5m ago 108m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:36:22.947 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (99m) 4m ago 108m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:36:22.947 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (107m) 5m ago 108m 42.3M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:36:22.948 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (100m) 5m ago 103m 26.2M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:36:22.948 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (100m) 5m ago 103m 26.8M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:36:22.948 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (104m) 4m ago 104m 27.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:36:22.949 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (103m) 4m ago 103m 27.4M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:36:22.949 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (101m) 5m ago 110m 601M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:36:22.949 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (100m) 4m ago 108m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:36:22.949 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (100m) 5m ago 110m 374M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:36:22.950 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (100m) 4m ago 107m 171M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:36:22.950 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (108m) 5m ago 108m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:36:22.950 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (107m) 4m ago 107m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:36:22.950 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (99m) 5m ago 107m 352M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:36:22.951 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (98m) 5m ago 106m 379M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:36:22.951 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (98m) 5m ago 106m 314M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:36:22.951 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (97m) 4m ago 106m 413M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:36:22.951 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (97m) 4m ago 105m 339M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:36:22.951 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (97m) 4m ago 105m 337M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:36:22.952 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (107m) 5m ago 108m 68.0M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:36:22.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.950+0000 7f12a81b4700 1 -- 172.21.15.26:0/2826299301 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f128c0640b0 msgr2=0x7f128c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:36:22.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.950+0000 7f12a81b4700 1 --2- 172.21.15.26:0/2826299301 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f128c0640b0 0x7f128c066570 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7f129c004e30 tx=0x7f129c009b30).stop 2021-11-03T18:36:22.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.950+0000 7f12a81b4700 1 -- 172.21.15.26:0/2826299301 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12a006b920 msgr2=0x7f12a010dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:36:22.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.950+0000 7f12a81b4700 1 --2- 172.21.15.26:0/2826299301 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12a006b920 0x7f12a010dac0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 rx=0x7f129000c530 tx=0x7f1290007e20).stop 2021-11-03T18:36:22.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.950+0000 7f12a81b4700 1 -- 172.21.15.26:0/2826299301 shutdown_connections 2021-11-03T18:36:22.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.950+0000 7f12a81b4700 1 --2- 172.21.15.26:0/2826299301 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f128c0640b0 0x7f128c066570 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:22.954 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.950+0000 7f12a81b4700 1 --2- 172.21.15.26:0/2826299301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12a006a3b0 0x7f12a010d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:22.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.950+0000 7f12a81b4700 1 --2- 172.21.15.26:0/2826299301 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12a006b920 0x7f12a010dac0 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:22.955 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.950+0000 7f12a81b4700 1 -- 172.21.15.26:0/2826299301 >> 172.21.15.26:0/2826299301 conn(0x7f12a00f1f00 msgr2=0x7f12a00f8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:36:22.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.950+0000 7f12a81b4700 1 -- 172.21.15.26:0/2826299301 shutdown_connections 2021-11-03T18:36:22.956 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:22.950+0000 7f12a81b4700 1 -- 172.21.15.26:0/2826299301 wait complete. 2021-11-03T18:36:23.046 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.048+0000 7f22fa704700 1 -- 172.21.15.26:0/3408618471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22f40f5e60 msgr2=0x7f22f40f62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:36:23.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.048+0000 7f22fa704700 1 --2- 172.21.15.26:0/3408618471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22f40f5e60 0x7f22f40f62c0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 rx=0x7f22e8004660 tx=0x7f22e8009b30).stop 2021-11-03T18:36:23.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.048+0000 7f22fa704700 1 -- 172.21.15.26:0/3408618471 shutdown_connections 2021-11-03T18:36:23.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.048+0000 7f22fa704700 1 --2- 172.21.15.26:0/3408618471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22f40f5e60 0x7f22f40f62c0 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:23.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.048+0000 7f22fa704700 1 --2- 172.21.15.26:0/3408618471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22f40f4bc0 0x7f22f40f4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:23.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.048+0000 7f22fa704700 1 -- 172.21.15.26:0/3408618471 >> 172.21.15.26:0/3408618471 conn(0x7f22f40f0320 msgr2=0x7f22f40f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:36:23.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.048+0000 7f22fa704700 1 -- 172.21.15.26:0/3408618471 shutdown_connections 2021-11-03T18:36:23.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.048+0000 7f22fa704700 1 -- 172.21.15.26:0/3408618471 wait complete. 2021-11-03T18:36:23.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.049+0000 7f22fa704700 1 Processor -- start 2021-11-03T18:36:23.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.049+0000 7f22fa704700 1 -- start start 2021-11-03T18:36:23.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.049+0000 7f22fa704700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22f40f4bc0 0x7f22f40f9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:36:23.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.049+0000 7f22fa704700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22f40f5e60 0x7f22f40f79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:36:23.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.049+0000 7f22fa704700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f410a9c0 con 0x7f22f40f4bc0 2021-11-03T18:36:23.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.049+0000 7f22fa704700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f410ab00 con 0x7f22f40f5e60 2021-11-03T18:36:23.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.049+0000 7f22f9702700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22f40f4bc0 0x7f22f40f9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:36:23.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.049+0000 7f22f9702700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22f40f4bc0 0x7f22f40f9540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60972/0 (socket says 172.21.15.26:60972) 2021-11-03T18:36:23.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.049+0000 7f22f9702700 1 -- 172.21.15.26:0/3620263781 learned_addr learned my addr 172.21.15.26:0/3620263781 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:36:23.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.050+0000 7f22f8f01700 1 --2- 172.21.15.26:0/3620263781 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22f40f5e60 0x7f22f40f79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:36:23.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.050+0000 7f22f9702700 1 -- 172.21.15.26:0/3620263781 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22f40f5e60 msgr2=0x7f22f40f79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:36:23.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.050+0000 7f22f9702700 1 --2- 172.21.15.26:0/3620263781 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22f40f5e60 0x7f22f40f79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:23.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.050+0000 7f22f9702700 1 -- 172.21.15.26:0/3620263781 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e8005040 con 0x7f22f40f4bc0 2021-11-03T18:36:23.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.050+0000 7f22f9702700 1 --2- 172.21.15.26:0/3620263781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22f40f4bc0 0x7f22f40f9540 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 rx=0x7f22e400d810 tx=0x7f22e400c040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:36:23.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.050+0000 7f22f1ffb700 1 -- 172.21.15.26:0/3620263781 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22e400f040 con 0x7f22f40f4bc0 2021-11-03T18:36:23.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.050+0000 7f22fa704700 1 -- 172.21.15.26:0/3620263781 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22f40f7f70 con 0x7f22f40f4bc0 2021-11-03T18:36:23.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.050+0000 7f22f1ffb700 1 -- 172.21.15.26:0/3620263781 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f22e400fb10 con 0x7f22f40f4bc0 2021-11-03T18:36:23.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.050+0000 7f22f1ffb700 1 -- 172.21.15.26:0/3620263781 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22e4014bf0 con 0x7f22f40f4bc0 2021-11-03T18:36:23.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.050+0000 7f22fa704700 1 -- 172.21.15.26:0/3620263781 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f40f8530 con 0x7f22f40f4bc0 2021-11-03T18:36:23.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.051+0000 7f22fa704700 1 -- 172.21.15.26:0/3620263781 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22f4045ad0 con 0x7f22f40f4bc0 2021-11-03T18:36:23.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.052+0000 7f22f1ffb700 1 -- 172.21.15.26:0/3620263781 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f22e4014430 con 0x7f22f40f4bc0 2021-11-03T18:36:23.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.052+0000 7f22f1ffb700 1 --2- 172.21.15.26:0/3620263781 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f22dc064100 0x7f22dc0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:36:23.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.052+0000 7f22f1ffb700 1 -- 172.21.15.26:0/3620263781 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f22e4080d70 con 0x7f22f40f4bc0 2021-11-03T18:36:23.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.052+0000 7f22f8f01700 1 --2- 172.21.15.26:0/3620263781 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f22dc064100 0x7f22dc0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:36:23.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.052+0000 7f22f8f01700 1 --2- 172.21.15.26:0/3620263781 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f22dc064100 0x7f22dc0665c0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7f22e8004630 tx=0x7f22e8009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:36:23.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.056+0000 7f22f1ffb700 1 -- 172.21.15.26:0/3620263781 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f22e4052fe0 con 0x7f22f40f4bc0 2021-11-03T18:36:23.283 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.285+0000 7f22fa704700 1 -- 172.21.15.26:0/3620263781 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f22f40f8750 con 0x7f22f40f4bc0 2021-11-03T18:36:23.283 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.285+0000 7f22f1ffb700 1 -- 172.21.15.26:0/3620263781 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f22e4052bd0 con 0x7f22f40f4bc0 2021-11-03T18:36:23.284 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:36:23.284 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:36:23.284 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:36:23.285 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:36:23.285 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:36:23.285 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:36:23.285 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:36:23.285 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:36:23.286 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:36:23.286 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:36:23.286 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:36:23.286 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:36:23.287 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:36:23.287 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:36:23.287 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:36:23.287 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:36:23.288 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:36:23.288 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:36:23.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.287+0000 7f22fa704700 1 -- 172.21.15.26:0/3620263781 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f22dc064100 msgr2=0x7f22dc0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:36:23.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.287+0000 7f22fa704700 1 --2- 172.21.15.26:0/3620263781 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f22dc064100 0x7f22dc0665c0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7f22e8004630 tx=0x7f22e8009b30).stop 2021-11-03T18:36:23.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.287+0000 7f22fa704700 1 -- 172.21.15.26:0/3620263781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22f40f4bc0 msgr2=0x7f22f40f9540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:36:23.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.287+0000 7f22fa704700 1 --2- 172.21.15.26:0/3620263781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22f40f4bc0 0x7f22f40f9540 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 rx=0x7f22e400d810 tx=0x7f22e400c040).stop 2021-11-03T18:36:23.290 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.287+0000 7f22fa704700 1 -- 172.21.15.26:0/3620263781 shutdown_connections 2021-11-03T18:36:23.290 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.287+0000 7f22fa704700 1 --2- 172.21.15.26:0/3620263781 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f22dc064100 0x7f22dc0665c0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:23.290 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.287+0000 7f22fa704700 1 --2- 172.21.15.26:0/3620263781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22f40f4bc0 0x7f22f40f9540 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:23.290 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.287+0000 7f22fa704700 1 --2- 172.21.15.26:0/3620263781 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22f40f5e60 0x7f22f40f79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:23.291 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.287+0000 7f22fa704700 1 -- 172.21.15.26:0/3620263781 >> 172.21.15.26:0/3620263781 conn(0x7f22f40f0320 msgr2=0x7f22f40f9ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:36:23.291 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.288+0000 7f22fa704700 1 -- 172.21.15.26:0/3620263781 shutdown_connections 2021-11-03T18:36:23.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.288+0000 7f22fa704700 1 -- 172.21.15.26:0/3620263781 wait complete. 2021-11-03T18:36:23.387 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.387+0000 7fe87f1b6700 1 -- 172.21.15.26:0/4045568896 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe878060310 msgr2=0x7fe8780f92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:36:23.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.387+0000 7fe87f1b6700 1 --2- 172.21.15.26:0/4045568896 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe878060310 0x7fe8780f92a0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 rx=0x7fe8700099e0 tx=0x7fe870004d10).stop 2021-11-03T18:36:23.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.387+0000 7fe87f1b6700 1 -- 172.21.15.26:0/4045568896 shutdown_connections 2021-11-03T18:36:23.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.387+0000 7fe87f1b6700 1 --2- 172.21.15.26:0/4045568896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8780f9820 0x7fe8780fbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:23.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.387+0000 7fe87f1b6700 1 --2- 172.21.15.26:0/4045568896 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe878060310 0x7fe8780f92a0 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:23.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.387+0000 7fe87f1b6700 1 -- 172.21.15.26:0/4045568896 >> 172.21.15.26:0/4045568896 conn(0x7fe8780f0d40 msgr2=0x7fe8780f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:36:23.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.387+0000 7fe87f1b6700 1 -- 172.21.15.26:0/4045568896 shutdown_connections 2021-11-03T18:36:23.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.387+0000 7fe87f1b6700 1 -- 172.21.15.26:0/4045568896 wait complete. 2021-11-03T18:36:23.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.387+0000 7fe87f1b6700 1 Processor -- start 2021-11-03T18:36:23.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.387+0000 7fe87f1b6700 1 -- start start 2021-11-03T18:36:23.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.388+0000 7fe87f1b6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe878060310 0x7fe8780f6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:36:23.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.388+0000 7fe87f1b6700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8780f9820 0x7fe8780f51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:36:23.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.388+0000 7fe87f1b6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8780f5700 con 0x7fe878060310 2021-11-03T18:36:23.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.388+0000 7fe87f1b6700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8780f5840 con 0x7fe8780f9820 2021-11-03T18:36:23.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.388+0000 7fe87cf52700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe878060310 0x7fe8780f6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:36:23.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.388+0000 7fe87cf52700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe878060310 0x7fe8780f6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60982/0 (socket says 172.21.15.26:60982) 2021-11-03T18:36:23.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.388+0000 7fe87cf52700 1 -- 172.21.15.26:0/3892585407 learned_addr learned my addr 172.21.15.26:0/3892585407 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:36:23.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.388+0000 7fe877fff700 1 --2- 172.21.15.26:0/3892585407 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8780f9820 0x7fe8780f51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:36:23.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.388+0000 7fe87cf52700 1 -- 172.21.15.26:0/3892585407 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8780f9820 msgr2=0x7fe8780f51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:36:23.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.388+0000 7fe87cf52700 1 --2- 172.21.15.26:0/3892585407 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8780f9820 0x7fe8780f51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:23.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.388+0000 7fe87cf52700 1 -- 172.21.15.26:0/3892585407 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe870009640 con 0x7fe878060310 2021-11-03T18:36:23.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.388+0000 7fe87cf52700 1 --2- 172.21.15.26:0/3892585407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe878060310 0x7fe8780f6d20 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 rx=0x7fe87000c010 tx=0x7fe870004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:36:23.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.388+0000 7fe8757fa700 1 -- 172.21.15.26:0/3892585407 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe87000e070 con 0x7fe878060310 2021-11-03T18:36:23.395 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.388+0000 7fe8757fa700 1 -- 172.21.15.26:0/3892585407 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe87001d8d0 con 0x7fe878060310 2021-11-03T18:36:23.395 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.388+0000 7fe8757fa700 1 -- 172.21.15.26:0/3892585407 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe870018070 con 0x7fe878060310 2021-11-03T18:36:23.395 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.388+0000 7fe87f1b6700 1 -- 172.21.15.26:0/3892585407 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8780f5ac0 con 0x7fe878060310 2021-11-03T18:36:23.396 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.389+0000 7fe87f1b6700 1 -- 172.21.15.26:0/3892585407 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8780f5fa0 con 0x7fe878060310 2021-11-03T18:36:23.396 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.389+0000 7fe87f1b6700 1 -- 172.21.15.26:0/3892585407 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe878045ad0 con 0x7fe878060310 2021-11-03T18:36:23.397 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.390+0000 7fe8757fa700 1 -- 172.21.15.26:0/3892585407 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fe870024060 con 0x7fe878060310 2021-11-03T18:36:23.397 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.390+0000 7fe8757fa700 1 --2- 172.21.15.26:0/3892585407 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe860064090 0x7fe860066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:36:23.398 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.390+0000 7fe8757fa700 1 -- 172.21.15.26:0/3892585407 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fe870082160 con 0x7fe878060310 2021-11-03T18:36:23.398 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.390+0000 7fe877fff700 1 --2- 172.21.15.26:0/3892585407 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe860064090 0x7fe860066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:36:23.398 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.391+0000 7fe877fff700 1 --2- 172.21.15.26:0/3892585407 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe860064090 0x7fe860066550 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7fe86c0041d0 tx=0x7fe86c009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:36:23.398 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.394+0000 7fe8757fa700 1 -- 172.21.15.26:0/3892585407 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fe8700544c0 con 0x7fe878060310 2021-11-03T18:36:23.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:23 smithi026 ceph-mon[96795]: pgmap v3051: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:23.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:23 smithi194 ceph-mon[65619]: pgmap v3051: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:23.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.596+0000 7fe87f1b6700 1 -- 172.21.15.26:0/3892585407 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe8780fef70 con 0x7fe878060310 2021-11-03T18:36:23.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.597+0000 7fe8757fa700 1 -- 172.21.15.26:0/3892585407 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fe8700540b0 con 0x7fe878060310 2021-11-03T18:36:23.596 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:36:23.597 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:36:23.597 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:36:23.597 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:36:23.598 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:36:23.598 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:36:23.598 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:36:23.598 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:36:23.598 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:36:23.599 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:36:23.599 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:36:23.599 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:36:23.599 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:36:23.600 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:36:23.600 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:36:23.600 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:36:23.600 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:36:23.601 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:36:23.602 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:36:23.602 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:36:23.602 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:36:23.603 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:36:23.603 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:36:23.603 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:36:23.603 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:36:23.603 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:36:23.604 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:36:23.604 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:36:23.604 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:36:23.604 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:36:23.605 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:36:23.605 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:36:23.605 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:36:23.605 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:36:23.605 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:36:23.606 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:36:23.606 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:36:23.606 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:36:23.606 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:36:23.607 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.599+0000 7fe87f1b6700 1 -- 172.21.15.26:0/3892585407 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe860064090 msgr2=0x7fe860066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:36:23.608 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.599+0000 7fe87f1b6700 1 --2- 172.21.15.26:0/3892585407 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe860064090 0x7fe860066550 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7fe86c0041d0 tx=0x7fe86c009040).stop 2021-11-03T18:36:23.608 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.599+0000 7fe87f1b6700 1 -- 172.21.15.26:0/3892585407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe878060310 msgr2=0x7fe8780f6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:36:23.608 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.599+0000 7fe87f1b6700 1 --2- 172.21.15.26:0/3892585407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe878060310 0x7fe8780f6d20 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 rx=0x7fe87000c010 tx=0x7fe870004d10).stop 2021-11-03T18:36:23.608 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.599+0000 7fe87f1b6700 1 -- 172.21.15.26:0/3892585407 shutdown_connections 2021-11-03T18:36:23.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.599+0000 7fe87f1b6700 1 --2- 172.21.15.26:0/3892585407 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe860064090 0x7fe860066550 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:23.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.599+0000 7fe87f1b6700 1 --2- 172.21.15.26:0/3892585407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe878060310 0x7fe8780f6d20 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:23.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.599+0000 7fe87f1b6700 1 --2- 172.21.15.26:0/3892585407 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8780f9820 0x7fe8780f51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:23.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.599+0000 7fe87f1b6700 1 -- 172.21.15.26:0/3892585407 >> 172.21.15.26:0/3892585407 conn(0x7fe8780f0d40 msgr2=0x7fe8780f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:36:23.609 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.599+0000 7fe87f1b6700 1 -- 172.21.15.26:0/3892585407 shutdown_connections 2021-11-03T18:36:23.610 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:23.599+0000 7fe87f1b6700 1 -- 172.21.15.26:0/3892585407 wait complete. 2021-11-03T18:36:23.610 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:36:24.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:24 smithi026 ceph-mon[96795]: from='client.37276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:36:24.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:24 smithi026 ceph-mon[96795]: from='client.37280 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:36:24.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:24 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3620263781' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:36:24.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:24 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3892585407' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:36:24.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:24 smithi194 ceph-mon[65619]: from='client.37276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:36:24.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:24 smithi194 ceph-mon[65619]: from='client.37280 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:36:24.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:24 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3620263781' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:36:24.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:24 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3892585407' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:36:25.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:25 smithi026 ceph-mon[96795]: pgmap v3052: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:25.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:36:25.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:25 smithi194 ceph-mon[65619]: pgmap v3052: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:25.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:36:26.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:26 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:36:26.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:26 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:36:27.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:27 smithi026 ceph-mon[96795]: pgmap v3053: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:27.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:27 smithi194 ceph-mon[65619]: pgmap v3053: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:29.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:29 smithi026 ceph-mon[96795]: pgmap v3054: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:29.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:29 smithi194 ceph-mon[65619]: pgmap v3054: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:31.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:31 smithi026 ceph-mon[96795]: pgmap v3055: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:31.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:31 smithi194 ceph-mon[65619]: pgmap v3055: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:33.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:33 smithi026 ceph-mon[96795]: pgmap v3056: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:33.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:33 smithi194 ceph-mon[65619]: pgmap v3056: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:35.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:35 smithi026 ceph-mon[96795]: pgmap v3057: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:35.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:35 smithi194 ceph-mon[65619]: pgmap v3057: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:37.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:37 smithi026 ceph-mon[96795]: pgmap v3058: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:37.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:37 smithi194 ceph-mon[65619]: pgmap v3058: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:39.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:39 smithi026 ceph-mon[96795]: pgmap v3059: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:39.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:39 smithi194 ceph-mon[65619]: pgmap v3059: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:40.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:36:40.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:36:40.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:36:40.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:36:40.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:36:40.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:36:40.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:36:40.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:36:40.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:36:40.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:36:40.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:36:40.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:36:40.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:36:40.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:36:40.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:36:40.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:36:41.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:41 smithi026 ceph-mon[96795]: poll took 60060.516 ms: 1 events 2021-11-03T18:36:41.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:41 smithi026 ceph-mon[96795]: pgmap v3060: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:41.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:41 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:36:41.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:41 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:36:41.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:41 smithi194 ceph-mon[65619]: poll took 60060.516 ms: 1 events 2021-11-03T18:36:41.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:41 smithi194 ceph-mon[65619]: pgmap v3060: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:41.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:41 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:36:41.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:41 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:36:43.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:43 smithi026 ceph-mon[96795]: pgmap v3061: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:43.475 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:43 smithi194 ceph-mon[65619]: pgmap v3061: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:45.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:45 smithi026 ceph-mon[96795]: pgmap v3062: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:45.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:45 smithi194 ceph-mon[65619]: pgmap v3062: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:47.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:47 smithi026 ceph-mon[96795]: pgmap v3063: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:47.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:47 smithi194 ceph-mon[65619]: pgmap v3063: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:49 smithi026 ceph-mon[96795]: pgmap v3064: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:36:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:36:49.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:49 smithi194 ceph-mon[65619]: pgmap v3064: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:36:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:36:51.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:51 smithi026 ceph-mon[96795]: pgmap v3065: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:51.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:51 smithi194 ceph-mon[65619]: pgmap v3065: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:53.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:53 smithi026 ceph-mon[96795]: pgmap v3066: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:53.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:53 smithi194 ceph-mon[65619]: pgmap v3066: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:53.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.712+0000 7fe3e80e0700 1 -- 172.21.15.26:0/1191400325 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3e006b9c0 msgr2=0x7fe3e0069ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:36:53.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.712+0000 7fe3e80e0700 1 --2- 172.21.15.26:0/1191400325 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3e006b9c0 0x7fe3e0069ec0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 rx=0x7fe3d80099e0 tx=0x7fe3d8004d10).stop 2021-11-03T18:36:53.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.712+0000 7fe3e80e0700 1 -- 172.21.15.26:0/1191400325 shutdown_connections 2021-11-03T18:36:53.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.712+0000 7fe3e80e0700 1 --2- 172.21.15.26:0/1191400325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3e006a3b0 0x7fe3e006a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:53.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.712+0000 7fe3e80e0700 1 --2- 172.21.15.26:0/1191400325 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3e006b9c0 0x7fe3e0069ec0 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:53.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.712+0000 7fe3e80e0700 1 -- 172.21.15.26:0/1191400325 >> 172.21.15.26:0/1191400325 conn(0x7fe3e00f1e40 msgr2=0x7fe3e00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:36:53.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.712+0000 7fe3e80e0700 1 -- 172.21.15.26:0/1191400325 shutdown_connections 2021-11-03T18:36:53.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.712+0000 7fe3e80e0700 1 -- 172.21.15.26:0/1191400325 wait complete. 2021-11-03T18:36:53.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.713+0000 7fe3e80e0700 1 Processor -- start 2021-11-03T18:36:53.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.713+0000 7fe3e80e0700 1 -- start start 2021-11-03T18:36:53.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.713+0000 7fe3e80e0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3e006a3b0 0x7fe3e0109270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:36:53.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.713+0000 7fe3e80e0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3e006b9c0 0x7fe3e0109760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:36:53.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.713+0000 7fe3e80e0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e0109d10 con 0x7fe3e006a3b0 2021-11-03T18:36:53.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.713+0000 7fe3e80e0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e0109e50 con 0x7fe3e006b9c0 2021-11-03T18:36:53.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.713+0000 7fe3e5e7c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3e006a3b0 0x7fe3e0109270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:36:53.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.713+0000 7fe3e5e7c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3e006a3b0 0x7fe3e0109270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32768/0 (socket says 172.21.15.26:32768) 2021-11-03T18:36:53.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.713+0000 7fe3e5e7c700 1 -- 172.21.15.26:0/1314309630 learned_addr learned my addr 172.21.15.26:0/1314309630 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:36:53.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.713+0000 7fe3e567b700 1 --2- 172.21.15.26:0/1314309630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3e006b9c0 0x7fe3e0109760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:36:53.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.713+0000 7fe3e5e7c700 1 -- 172.21.15.26:0/1314309630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3e006b9c0 msgr2=0x7fe3e0109760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:36:53.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.713+0000 7fe3e5e7c700 1 --2- 172.21.15.26:0/1314309630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3e006b9c0 0x7fe3e0109760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:53.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.713+0000 7fe3e5e7c700 1 -- 172.21.15.26:0/1314309630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d8009640 con 0x7fe3e006a3b0 2021-11-03T18:36:53.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.713+0000 7fe3e567b700 1 --2- 172.21.15.26:0/1314309630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3e006b9c0 0x7fe3e0109760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:36:53.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.713+0000 7fe3e5e7c700 1 --2- 172.21.15.26:0/1314309630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3e006a3b0 0x7fe3e0109270 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 rx=0x7fe3d8004b70 tx=0x7fe3d8004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:36:53.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.714+0000 7fe3d67fc700 1 -- 172.21.15.26:0/1314309630 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3d800e030 con 0x7fe3e006a3b0 2021-11-03T18:36:53.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.714+0000 7fe3d67fc700 1 -- 172.21.15.26:0/1314309630 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe3d80049b0 con 0x7fe3e006a3b0 2021-11-03T18:36:53.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.714+0000 7fe3e80e0700 1 -- 172.21.15.26:0/1314309630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3e010a790 con 0x7fe3e006a3b0 2021-11-03T18:36:53.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.714+0000 7fe3d67fc700 1 -- 172.21.15.26:0/1314309630 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3d8018070 con 0x7fe3e006a3b0 2021-11-03T18:36:53.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.714+0000 7fe3e80e0700 1 -- 172.21.15.26:0/1314309630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3e010ac70 con 0x7fe3e006a3b0 2021-11-03T18:36:53.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.715+0000 7fe3e80e0700 1 -- 172.21.15.26:0/1314309630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3e0045ad0 con 0x7fe3e006a3b0 2021-11-03T18:36:53.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.715+0000 7fe3d67fc700 1 -- 172.21.15.26:0/1314309630 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fe3d801db40 con 0x7fe3e006a3b0 2021-11-03T18:36:53.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.716+0000 7fe3d67fc700 1 --2- 172.21.15.26:0/1314309630 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe3cc0640b0 0x7fe3cc066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:36:53.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.716+0000 7fe3d67fc700 1 -- 172.21.15.26:0/1314309630 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fe3d80827c0 con 0x7fe3e006a3b0 2021-11-03T18:36:53.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.716+0000 7fe3e567b700 1 --2- 172.21.15.26:0/1314309630 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe3cc0640b0 0x7fe3cc066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:36:53.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.716+0000 7fe3e567b700 1 --2- 172.21.15.26:0/1314309630 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe3cc0640b0 0x7fe3cc066570 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7fe3d00041d0 tx=0x7fe3d0009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:36:53.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.720+0000 7fe3d67fc700 1 -- 172.21.15.26:0/1314309630 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fe3d8054ac0 con 0x7fe3e006a3b0 2021-11-03T18:36:53.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.899+0000 7fe3e80e0700 1 -- 172.21.15.26:0/1314309630 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe3e01030b0 con 0x7fe3cc0640b0 2021-11-03T18:36:53.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.900+0000 7fe3d67fc700 1 -- 172.21.15.26:0/1314309630 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fe3e01030b0 con 0x7fe3cc0640b0 2021-11-03T18:36:53.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.902+0000 7fe3e80e0700 1 -- 172.21.15.26:0/1314309630 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe3cc0640b0 msgr2=0x7fe3cc066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:36:53.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.902+0000 7fe3e80e0700 1 --2- 172.21.15.26:0/1314309630 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe3cc0640b0 0x7fe3cc066570 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7fe3d00041d0 tx=0x7fe3d0009040).stop 2021-11-03T18:36:53.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.902+0000 7fe3e80e0700 1 -- 172.21.15.26:0/1314309630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3e006a3b0 msgr2=0x7fe3e0109270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:36:53.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.902+0000 7fe3e80e0700 1 --2- 172.21.15.26:0/1314309630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3e006a3b0 0x7fe3e0109270 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 rx=0x7fe3d8004b70 tx=0x7fe3d8004d10).stop 2021-11-03T18:36:53.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.902+0000 7fe3e80e0700 1 -- 172.21.15.26:0/1314309630 shutdown_connections 2021-11-03T18:36:53.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.902+0000 7fe3e80e0700 1 --2- 172.21.15.26:0/1314309630 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe3cc0640b0 0x7fe3cc066570 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:53.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.902+0000 7fe3e80e0700 1 --2- 172.21.15.26:0/1314309630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3e006a3b0 0x7fe3e0109270 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:53.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.902+0000 7fe3e80e0700 1 --2- 172.21.15.26:0/1314309630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3e006b9c0 0x7fe3e0109760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:53.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.902+0000 7fe3e80e0700 1 -- 172.21.15.26:0/1314309630 >> 172.21.15.26:0/1314309630 conn(0x7fe3e00f1e40 msgr2=0x7fe3e00fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:36:53.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.902+0000 7fe3e80e0700 1 -- 172.21.15.26:0/1314309630 shutdown_connections 2021-11-03T18:36:53.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:53.902+0000 7fe3e80e0700 1 -- 172.21.15.26:0/1314309630 wait complete. 2021-11-03T18:36:53.910 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:36:54.003 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.002+0000 7fe4f0535700 1 -- 172.21.15.26:0/401852103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4e80f55e0 msgr2=0x7fe4e80f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:36:54.003 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.002+0000 7fe4f0535700 1 --2- 172.21.15.26:0/401852103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4e80f55e0 0x7fe4e80f5a00 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 rx=0x7fe4d8004660 tx=0x7fe4d8009b30).stop 2021-11-03T18:36:54.003 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.002+0000 7fe4f0535700 1 -- 172.21.15.26:0/401852103 shutdown_connections 2021-11-03T18:36:54.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.002+0000 7fe4f0535700 1 --2- 172.21.15.26:0/401852103 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4e80f5ef0 0x7fe4e80f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:54.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.002+0000 7fe4f0535700 1 --2- 172.21.15.26:0/401852103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4e80f55e0 0x7fe4e80f5a00 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:54.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.002+0000 7fe4f0535700 1 -- 172.21.15.26:0/401852103 >> 172.21.15.26:0/401852103 conn(0x7fe4e80f0de0 msgr2=0x7fe4e80f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:36:54.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.002+0000 7fe4f0535700 1 -- 172.21.15.26:0/401852103 shutdown_connections 2021-11-03T18:36:54.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.002+0000 7fe4f0535700 1 -- 172.21.15.26:0/401852103 wait complete. 2021-11-03T18:36:54.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.002+0000 7fe4f0535700 1 Processor -- start 2021-11-03T18:36:54.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.002+0000 7fe4f0535700 1 -- start start 2021-11-03T18:36:54.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.003+0000 7fe4f0535700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4e80f55e0 0x7fe4e8109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:36:54.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.003+0000 7fe4f0535700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4e80f5ef0 0x7fe4e810c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:36:54.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.003+0000 7fe4f0535700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e8060500 con 0x7fe4e80f5ef0 2021-11-03T18:36:54.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.003+0000 7fe4f0535700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e8060640 con 0x7fe4e80f55e0 2021-11-03T18:36:54.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.003+0000 7fe4edad0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4e80f5ef0 0x7fe4e810c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:36:54.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.003+0000 7fe4edad0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4e80f5ef0 0x7fe4e810c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32780/0 (socket says 172.21.15.26:32780) 2021-11-03T18:36:54.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.003+0000 7fe4edad0700 1 -- 172.21.15.26:0/2541744837 learned_addr learned my addr 172.21.15.26:0/2541744837 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:36:54.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.003+0000 7fe4ee2d1700 1 --2- 172.21.15.26:0/2541744837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4e80f55e0 0x7fe4e8109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:36:54.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.003+0000 7fe4edad0700 1 -- 172.21.15.26:0/2541744837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4e80f55e0 msgr2=0x7fe4e8109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:36:54.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.003+0000 7fe4edad0700 1 --2- 172.21.15.26:0/2541744837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4e80f55e0 0x7fe4e8109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:54.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.003+0000 7fe4edad0700 1 -- 172.21.15.26:0/2541744837 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d8005040 con 0x7fe4e80f5ef0 2021-11-03T18:36:54.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.003+0000 7fe4edad0700 1 --2- 172.21.15.26:0/2541744837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4e80f5ef0 0x7fe4e810c190 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 rx=0x7fe4e40026d0 tx=0x7fe4e4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:36:54.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.003+0000 7fe4deffd700 1 -- 172.21.15.26:0/2541744837 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4e40079c0 con 0x7fe4e80f5ef0 2021-11-03T18:36:54.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.003+0000 7fe4deffd700 1 -- 172.21.15.26:0/2541744837 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe4e400f040 con 0x7fe4e80f5ef0 2021-11-03T18:36:54.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.003+0000 7fe4f0535700 1 -- 172.21.15.26:0/2541744837 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4e810c740 con 0x7fe4e80f5ef0 2021-11-03T18:36:54.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.003+0000 7fe4deffd700 1 -- 172.21.15.26:0/2541744837 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4e40148b0 con 0x7fe4e80f5ef0 2021-11-03T18:36:54.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.003+0000 7fe4f0535700 1 -- 172.21.15.26:0/2541744837 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4e810cd00 con 0x7fe4e80f5ef0 2021-11-03T18:36:54.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.004+0000 7fe4f0535700 1 -- 172.21.15.26:0/2541744837 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4e8045ad0 con 0x7fe4e80f5ef0 2021-11-03T18:36:54.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.005+0000 7fe4deffd700 1 -- 172.21.15.26:0/2541744837 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fe4e4007b20 con 0x7fe4e80f5ef0 2021-11-03T18:36:54.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.005+0000 7fe4deffd700 1 --2- 172.21.15.26:0/2541744837 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe4d40640b0 0x7fe4d4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:36:54.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.005+0000 7fe4deffd700 1 -- 172.21.15.26:0/2541744837 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fe4e40807f0 con 0x7fe4e80f5ef0 2021-11-03T18:36:54.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.005+0000 7fe4ee2d1700 1 --2- 172.21.15.26:0/2541744837 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe4d40640b0 0x7fe4d4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:36:54.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.006+0000 7fe4ee2d1700 1 --2- 172.21.15.26:0/2541744837 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe4d40640b0 0x7fe4d4066570 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7fe4d8004630 tx=0x7fe4d8009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:36:54.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.009+0000 7fe4deffd700 1 -- 172.21.15.26:0/2541744837 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fe4e4052a90 con 0x7fe4e80f5ef0 2021-11-03T18:36:54.182 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.183+0000 7fe4f0535700 1 -- 172.21.15.26:0/2541744837 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4e80fdf80 con 0x7fe4d40640b0 2021-11-03T18:36:54.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.198+0000 7fe4deffd700 1 -- 172.21.15.26:0/2541744837 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7fe4d8019040 con 0x7fe4d40640b0 2021-11-03T18:36:54.197 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:36:54.197 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (108m) 6m ago 109m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:36:54.198 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (100m) 6m ago 109m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:36:54.198 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (100m) 5m ago 108m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:36:54.198 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (107m) 6m ago 109m 42.3M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:36:54.199 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (101m) 6m ago 104m 26.2M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:36:54.199 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (101m) 6m ago 104m 26.8M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:36:54.199 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (104m) 5m ago 104m 27.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:36:54.199 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (104m) 5m ago 104m 27.4M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:36:54.199 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (101m) 6m ago 110m 601M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:36:54.200 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (101m) 5m ago 108m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:36:54.200 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (101m) 6m ago 110m 374M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:36:54.200 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (100m) 5m ago 108m 171M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:36:54.200 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (109m) 6m ago 109m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:36:54.201 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (108m) 5m ago 108m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:36:54.201 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (99m) 6m ago 107m 352M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:36:54.201 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (99m) 6m ago 107m 379M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:36:54.201 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (98m) 6m ago 107m 314M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:36:54.202 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (98m) 5m ago 106m 413M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:36:54.202 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (98m) 5m ago 106m 339M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:36:54.202 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (97m) 5m ago 106m 337M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:36:54.202 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (107m) 6m ago 108m 68.0M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:36:54.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.199+0000 7fe4f0535700 1 -- 172.21.15.26:0/2541744837 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe4d40640b0 msgr2=0x7fe4d4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:36:54.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.199+0000 7fe4f0535700 1 --2- 172.21.15.26:0/2541744837 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe4d40640b0 0x7fe4d4066570 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7fe4d8004630 tx=0x7fe4d8009b30).stop 2021-11-03T18:36:54.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.199+0000 7fe4f0535700 1 -- 172.21.15.26:0/2541744837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4e80f5ef0 msgr2=0x7fe4e810c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:36:54.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.199+0000 7fe4f0535700 1 --2- 172.21.15.26:0/2541744837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4e80f5ef0 0x7fe4e810c190 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 rx=0x7fe4e40026d0 tx=0x7fe4e4009de0).stop 2021-11-03T18:36:54.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.199+0000 7fe4f0535700 1 -- 172.21.15.26:0/2541744837 shutdown_connections 2021-11-03T18:36:54.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.199+0000 7fe4f0535700 1 --2- 172.21.15.26:0/2541744837 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe4d40640b0 0x7fe4d4066570 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:54.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.200+0000 7fe4f0535700 1 --2- 172.21.15.26:0/2541744837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4e80f55e0 0x7fe4e8109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:54.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.200+0000 7fe4f0535700 1 --2- 172.21.15.26:0/2541744837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4e80f5ef0 0x7fe4e810c190 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:54.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.200+0000 7fe4f0535700 1 -- 172.21.15.26:0/2541744837 >> 172.21.15.26:0/2541744837 conn(0x7fe4e80f0de0 msgr2=0x7fe4e80fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:36:54.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.200+0000 7fe4f0535700 1 -- 172.21.15.26:0/2541744837 shutdown_connections 2021-11-03T18:36:54.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.200+0000 7fe4f0535700 1 -- 172.21.15.26:0/2541744837 wait complete. 2021-11-03T18:36:54.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.298+0000 7f1722f30700 1 -- 172.21.15.26:0/868527911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f171c0f7980 msgr2=0x7f171c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:36:54.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.298+0000 7f1722f30700 1 --2- 172.21.15.26:0/868527911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f171c0f7980 0x7f171c0f7de0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 rx=0x7f1708004660 tx=0x7f1708009b30).stop 2021-11-03T18:36:54.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.298+0000 7f1722f30700 1 -- 172.21.15.26:0/868527911 shutdown_connections 2021-11-03T18:36:54.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.298+0000 7f1722f30700 1 --2- 172.21.15.26:0/868527911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f171c0f7980 0x7f171c0f7de0 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:54.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.298+0000 7f1722f30700 1 --2- 172.21.15.26:0/868527911 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f171c0f66e0 0x7f171c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:36:54.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.298+0000 7f1722f30700 1 -- 172.21.15.26:0/868527911 >> 172.21.15.26:0/868527911 conn(0x7f171c0f1e40 msgr2=0x7f171c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:36:54.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.298+0000 7f1722f30700 1 -- 172.21.15.26:0/868527911 shutdown_connections 2021-11-03T18:36:54.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.299+0000 7f1722f30700 1 -- 172.21.15.26:0/868527911 wait complete. 2021-11-03T18:36:54.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.299+0000 7f1722f30700 1 Processor -- start 2021-11-03T18:36:54.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.299+0000 7f1722f30700 1 -- start start 2021-11-03T18:36:54.303 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.299+0000 7f1722f30700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f171c0f66e0 0x7f171c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:36:54.303 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.299+0000 7f1722f30700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f171c0f7980 0x7f171c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:36:54.303 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.299+0000 7f1722f30700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f171c06a410 con 0x7f171c0f66e0 2021-11-03T18:36:54.303 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.299+0000 7f1722f30700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f171c06a550 con 0x7f171c0f7980 2021-11-03T18:36:54.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.299+0000 7f1720ccc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f171c0f66e0 0x7f171c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:36:54.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.299+0000 7f1720ccc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f171c0f66e0 0x7f171c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32788/0 (socket says 172.21.15.26:32788) 2021-11-03T18:36:54.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.300+0000 7f1720ccc700 1 -- 172.21.15.26:0/1207377492 learned_addr learned my addr 172.21.15.26:0/1207377492 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:36:54.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.300+0000 7f171bfff700 1 --2- 172.21.15.26:0/1207377492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f171c0f7980 0x7f171c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:36:54.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.300+0000 7f1720ccc700 1 -- 172.21.15.26:0/1207377492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f171c0f7980 msgr2=0x7f171c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:36:54.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.300+0000 7f1720ccc700 1 --2- 172.21.15.26:0/1207377492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f171c0f7980 0x7f171c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:54.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.300+0000 7f1720ccc700 1 -- 172.21.15.26:0/1207377492 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1708005040 con 0x7f171c0f66e0 2021-11-03T18:36:54.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.300+0000 7f1720ccc700 1 --2- 172.21.15.26:0/1207377492 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f171c0f66e0 0x7f171c06b9a0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 rx=0x7f17100093f0 tx=0x7f1710006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:36:54.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.300+0000 7f17197fa700 1 -- 172.21.15.26:0/1207377492 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1710009ea0 con 0x7f171c0f66e0 2021-11-03T18:36:54.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.300+0000 7f17197fa700 1 -- 172.21.15.26:0/1207377492 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1710013af0 con 0x7f171c0f66e0 2021-11-03T18:36:54.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.300+0000 7f17197fa700 1 -- 172.21.15.26:0/1207377492 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f171000db10 con 0x7f171c0f66e0 2021-11-03T18:36:54.307 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.300+0000 7f1722f30700 1 -- 172.21.15.26:0/1207377492 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f171c06a830 con 0x7f171c0f66e0 2021-11-03T18:36:54.307 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.300+0000 7f1722f30700 1 -- 172.21.15.26:0/1207377492 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f171c10efb0 con 0x7f171c0f66e0 2021-11-03T18:36:54.308 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.301+0000 7f1722f30700 1 -- 172.21.15.26:0/1207377492 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f171c045ad0 con 0x7f171c0f66e0 2021-11-03T18:36:54.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.301+0000 7f17197fa700 1 -- 172.21.15.26:0/1207377492 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f171001a060 con 0x7f171c0f66e0 2021-11-03T18:36:54.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.302+0000 7f17197fa700 1 --2- 172.21.15.26:0/1207377492 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f170c0640b0 0x7f170c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:36:54.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.302+0000 7f17197fa700 1 -- 172.21.15.26:0/1207377492 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f1710080810 con 0x7f171c0f66e0 2021-11-03T18:36:54.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.302+0000 7f171bfff700 1 --2- 172.21.15.26:0/1207377492 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f170c0640b0 0x7f170c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:36:54.310 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.302+0000 7f171bfff700 1 --2- 172.21.15.26:0/1207377492 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f170c0640b0 0x7f170c066570 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7f1708004e30 tx=0x7f1708009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:36:54.310 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.306+0000 7f17197fa700 1 -- 172.21.15.26:0/1207377492 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f1710052a80 con 0x7f171c0f66e0 2021-11-03T18:36:54.535 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.536+0000 7f1722f30700 1 -- 172.21.15.26:0/1207377492 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f171c027a00 con 0x7f171c0f66e0 2021-11-03T18:36:54.536 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.537+0000 7f17197fa700 1 -- 172.21.15.26:0/1207377492 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f171007ee60 con 0x7f171c0f66e0 2021-11-03T18:36:54.536 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:36:54.537 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:36:54.537 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:36:54.537 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:36:54.537 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:36:54.538 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:36:54.538 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:36:54.538 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:36:54.539 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:36:54.539 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:36:54.539 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:36:54.539 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:36:54.540 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:36:54.540 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:36:54.540 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:36:54.540 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:36:54.541 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:36:54.541 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:36:54.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.539+0000 7f1722f30700 1 -- 172.21.15.26:0/1207377492 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f170c0640b0 msgr2=0x7f170c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:36:54.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.539+0000 7f1722f30700 1 --2- 172.21.15.26:0/1207377492 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f170c0640b0 0x7f170c066570 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7f1708004e30 tx=0x7f1708009b30).stop 2021-11-03T18:36:54.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.539+0000 7f1722f30700 1 -- 172.21.15.26:0/1207377492 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f171c0f66e0 msgr2=0x7f171c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:36:54.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.539+0000 7f1722f30700 1 --2- 172.21.15.26:0/1207377492 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f171c0f66e0 0x7f171c06b9a0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 rx=0x7f17100093f0 tx=0x7f1710006ec0).stop 2021-11-03T18:36:54.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.539+0000 7f1722f30700 1 -- 172.21.15.26:0/1207377492 shutdown_connections 2021-11-03T18:36:54.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.539+0000 7f1722f30700 1 --2- 172.21.15.26:0/1207377492 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f170c0640b0 0x7f170c066570 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:54.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.539+0000 7f1722f30700 1 --2- 172.21.15.26:0/1207377492 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f171c0f66e0 0x7f171c06b9a0 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:54.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.539+0000 7f1722f30700 1 --2- 172.21.15.26:0/1207377492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f171c0f7980 0x7f171c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:54.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.539+0000 7f1722f30700 1 -- 172.21.15.26:0/1207377492 >> 172.21.15.26:0/1207377492 conn(0x7f171c0f1e40 msgr2=0x7f171c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:36:54.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.539+0000 7f1722f30700 1 -- 172.21.15.26:0/1207377492 shutdown_connections 2021-11-03T18:36:54.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.539+0000 7f1722f30700 1 -- 172.21.15.26:0/1207377492 wait complete. 2021-11-03T18:36:54.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.639+0000 7fb3ec827700 1 -- 172.21.15.26:0/2925727667 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3e80602b0 msgr2=0x7fb3e80f9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:36:54.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.639+0000 7fb3ec827700 1 --2- 172.21.15.26:0/2925727667 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3e80602b0 0x7fb3e80f9300 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 rx=0x7fb3e00099e0 tx=0x7fb3e0004d10).stop 2021-11-03T18:36:54.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.639+0000 7fb3ec827700 1 -- 172.21.15.26:0/2925727667 shutdown_connections 2021-11-03T18:36:54.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.639+0000 7fb3ec827700 1 --2- 172.21.15.26:0/2925727667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3e80f9880 0x7fb3e80fbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:54.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.639+0000 7fb3ec827700 1 --2- 172.21.15.26:0/2925727667 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3e80602b0 0x7fb3e80f9300 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:54.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.639+0000 7fb3ec827700 1 -- 172.21.15.26:0/2925727667 >> 172.21.15.26:0/2925727667 conn(0x7fb3e80f0d40 msgr2=0x7fb3e80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:36:54.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.639+0000 7fb3ec827700 1 -- 172.21.15.26:0/2925727667 shutdown_connections 2021-11-03T18:36:54.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.639+0000 7fb3ec827700 1 -- 172.21.15.26:0/2925727667 wait complete. 2021-11-03T18:36:54.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.639+0000 7fb3ec827700 1 Processor -- start 2021-11-03T18:36:54.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.639+0000 7fb3ec827700 1 -- start start 2021-11-03T18:36:54.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.640+0000 7fb3ec827700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3e80602b0 0x7fb3e8107020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:36:54.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.640+0000 7fb3ec827700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3e80f9880 0x7fb3e8107510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:36:54.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.640+0000 7fb3ec827700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e8107ac0 con 0x7fb3e80602b0 2021-11-03T18:36:54.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.640+0000 7fb3ec827700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e8107c00 con 0x7fb3e80f9880 2021-11-03T18:36:54.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.640+0000 7fb3e659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3e80602b0 0x7fb3e8107020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:36:54.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.640+0000 7fb3e659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3e80602b0 0x7fb3e8107020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32798/0 (socket says 172.21.15.26:32798) 2021-11-03T18:36:54.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.640+0000 7fb3e659c700 1 -- 172.21.15.26:0/3703610620 learned_addr learned my addr 172.21.15.26:0/3703610620 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:36:54.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.640+0000 7fb3e5d9b700 1 --2- 172.21.15.26:0/3703610620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3e80f9880 0x7fb3e8107510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:36:54.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.640+0000 7fb3e659c700 1 -- 172.21.15.26:0/3703610620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3e80f9880 msgr2=0x7fb3e8107510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:36:54.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.640+0000 7fb3e659c700 1 --2- 172.21.15.26:0/3703610620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3e80f9880 0x7fb3e8107510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:54.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.640+0000 7fb3e659c700 1 -- 172.21.15.26:0/3703610620 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e0009640 con 0x7fb3e80602b0 2021-11-03T18:36:54.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.640+0000 7fb3e659c700 1 --2- 172.21.15.26:0/3703610620 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3e80602b0 0x7fb3e8107020 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 rx=0x7fb3e000b3b0 tx=0x7fb3e0004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:36:54.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.640+0000 7fb3d6ffd700 1 -- 172.21.15.26:0/3703610620 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3e000e030 con 0x7fb3e80602b0 2021-11-03T18:36:54.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.640+0000 7fb3d6ffd700 1 -- 172.21.15.26:0/3703610620 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb3e00049b0 con 0x7fb3e80602b0 2021-11-03T18:36:54.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.640+0000 7fb3ec827700 1 -- 172.21.15.26:0/3703610620 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3e8108540 con 0x7fb3e80602b0 2021-11-03T18:36:54.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.640+0000 7fb3d6ffd700 1 -- 172.21.15.26:0/3703610620 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3e0018070 con 0x7fb3e80602b0 2021-11-03T18:36:54.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.640+0000 7fb3ec827700 1 -- 172.21.15.26:0/3703610620 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3e8108a20 con 0x7fb3e80602b0 2021-11-03T18:36:54.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.641+0000 7fb3ec827700 1 -- 172.21.15.26:0/3703610620 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3e8045ad0 con 0x7fb3e80602b0 2021-11-03T18:36:54.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.642+0000 7fb3d6ffd700 1 -- 172.21.15.26:0/3703610620 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fb3e0007d40 con 0x7fb3e80602b0 2021-11-03T18:36:54.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.642+0000 7fb3d6ffd700 1 --2- 172.21.15.26:0/3703610620 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb3d00640b0 0x7fb3d0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:36:54.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.642+0000 7fb3d6ffd700 1 -- 172.21.15.26:0/3703610620 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fb3e0082520 con 0x7fb3e80602b0 2021-11-03T18:36:54.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.642+0000 7fb3e5d9b700 1 --2- 172.21.15.26:0/3703610620 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb3d00640b0 0x7fb3d0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:36:54.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.643+0000 7fb3e5d9b700 1 --2- 172.21.15.26:0/3703610620 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb3d00640b0 0x7fb3d0066570 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7fb3e8060080 tx=0x7fb3dc009be0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:36:54.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.646+0000 7fb3d6ffd700 1 -- 172.21.15.26:0/3703610620 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fb3e0054760 con 0x7fb3e80602b0 2021-11-03T18:36:54.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.849+0000 7fb3ec827700 1 -- 172.21.15.26:0/3703610620 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb3e80fef70 con 0x7fb3e80602b0 2021-11-03T18:36:54.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.849+0000 7fb3d6ffd700 1 -- 172.21.15.26:0/3703610620 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fb3e0054350 con 0x7fb3e80602b0 2021-11-03T18:36:54.849 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:36:54.849 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:36:54.849 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:36:54.850 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:36:54.850 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:36:54.850 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:36:54.850 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:36:54.851 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:36:54.851 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:36:54.851 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:36:54.851 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:36:54.852 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:36:54.852 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:36:54.852 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:36:54.852 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:36:54.852 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:36:54.853 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:36:54.853 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:36:54.853 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:36:54.853 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:36:54.853 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:36:54.854 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:36:54.854 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:36:54.854 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:36:54.854 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:36:54.855 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:36:54.855 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:36:54.855 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:36:54.855 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:36:54.855 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:36:54.856 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:36:54.856 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:36:54.856 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:36:54.856 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:36:54.857 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:36:54.857 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:36:54.857 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:36:54.857 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:36:54.857 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:36:54.858 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.851+0000 7fb3ec827700 1 -- 172.21.15.26:0/3703610620 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb3d00640b0 msgr2=0x7fb3d0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:36:54.859 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.851+0000 7fb3ec827700 1 --2- 172.21.15.26:0/3703610620 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb3d00640b0 0x7fb3d0066570 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7fb3e8060080 tx=0x7fb3dc009be0).stop 2021-11-03T18:36:54.859 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.851+0000 7fb3ec827700 1 -- 172.21.15.26:0/3703610620 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3e80602b0 msgr2=0x7fb3e8107020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:36:54.859 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.851+0000 7fb3ec827700 1 --2- 172.21.15.26:0/3703610620 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3e80602b0 0x7fb3e8107020 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 rx=0x7fb3e000b3b0 tx=0x7fb3e0004d10).stop 2021-11-03T18:36:54.859 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.851+0000 7fb3ec827700 1 -- 172.21.15.26:0/3703610620 shutdown_connections 2021-11-03T18:36:54.860 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.851+0000 7fb3ec827700 1 --2- 172.21.15.26:0/3703610620 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb3d00640b0 0x7fb3d0066570 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:54.860 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.851+0000 7fb3ec827700 1 --2- 172.21.15.26:0/3703610620 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3e80602b0 0x7fb3e8107020 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:54.860 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.851+0000 7fb3ec827700 1 --2- 172.21.15.26:0/3703610620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3e80f9880 0x7fb3e8107510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:36:54.860 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.851+0000 7fb3ec827700 1 -- 172.21.15.26:0/3703610620 >> 172.21.15.26:0/3703610620 conn(0x7fb3e80f0d40 msgr2=0x7fb3e80f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:36:54.860 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.851+0000 7fb3ec827700 1 -- 172.21.15.26:0/3703610620 shutdown_connections 2021-11-03T18:36:54.861 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:36:54.851+0000 7fb3ec827700 1 -- 172.21.15.26:0/3703610620 wait complete. 2021-11-03T18:36:54.861 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:36:55.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:55 smithi026 ceph-mon[96795]: from='client.37292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:36:55.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:55 smithi026 ceph-mon[96795]: pgmap v3067: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:55.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:55 smithi026 ceph-mon[96795]: from='client.37296 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:36:55.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:55 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1207377492' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:36:55.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:55 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3703610620' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:36:55.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:36:55.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:55 smithi194 ceph-mon[65619]: from='client.37292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:36:55.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:55 smithi194 ceph-mon[65619]: pgmap v3067: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:55.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:55 smithi194 ceph-mon[65619]: from='client.37296 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:36:55.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:55 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1207377492' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:36:55.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:55 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3703610620' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:36:55.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:36:56.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:56 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:36:56.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:56 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:36:57.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:57 smithi026 ceph-mon[96795]: pgmap v3068: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:57.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:57 smithi194 ceph-mon[65619]: pgmap v3068: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:59.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:36:59 smithi026 ceph-mon[96795]: pgmap v3069: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:36:59.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:36:59 smithi194 ceph-mon[65619]: pgmap v3069: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:01.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:01 smithi026 ceph-mon[96795]: pgmap v3070: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:01.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:01 smithi194 ceph-mon[65619]: pgmap v3070: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:03.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:03 smithi026 ceph-mon[96795]: pgmap v3071: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:03.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:03 smithi194 ceph-mon[65619]: pgmap v3071: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:05.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:05 smithi026 ceph-mon[96795]: pgmap v3072: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:05.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:05 smithi194 ceph-mon[65619]: pgmap v3072: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:07.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:07 smithi026 ceph-mon[96795]: pgmap v3073: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:07.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:07 smithi194 ceph-mon[65619]: pgmap v3073: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:09.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:09 smithi026 ceph-mon[96795]: pgmap v3074: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:09.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:09 smithi194 ceph-mon[65619]: pgmap v3074: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:11.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:11 smithi026 ceph-mon[96795]: pgmap v3075: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:11.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:11 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:37:11.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:11 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:37:11.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:11 smithi194 ceph-mon[65619]: pgmap v3075: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:11.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:11 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:37:11.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:11 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:37:13.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:13 smithi026 ceph-mon[96795]: pgmap v3076: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:13.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:13 smithi194 ceph-mon[65619]: pgmap v3076: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:15.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:15 smithi026 ceph-mon[96795]: pgmap v3077: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:15.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:15 smithi194 ceph-mon[65619]: pgmap v3077: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:17.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:17 smithi026 ceph-mon[96795]: pgmap v3078: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:17.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:17 smithi194 ceph-mon[65619]: pgmap v3078: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:19.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:19 smithi026 ceph-mon[96795]: pgmap v3079: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:19.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:19 smithi194 ceph-mon[65619]: pgmap v3079: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:21.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:21 smithi026 ceph-mon[96795]: pgmap v3080: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:21.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:21 smithi194 ceph-mon[65619]: pgmap v3080: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:23.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:23 smithi026 ceph-mon[96795]: pgmap v3081: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:23.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:23 smithi194 ceph-mon[65619]: pgmap v3081: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:24.967 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:24.967+0000 7ff33cc64700 1 -- 172.21.15.26:0/2398670476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3380f6ff0 msgr2=0x7ff3380f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:37:24.968 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:24.967+0000 7ff33cc64700 1 --2- 172.21.15.26:0/2398670476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3380f6ff0 0x7ff3380f7a20 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 rx=0x7ff320004660 tx=0x7ff320009b30).stop 2021-11-03T18:37:24.968 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:24.968+0000 7ff33cc64700 1 -- 172.21.15.26:0/2398670476 shutdown_connections 2021-11-03T18:37:24.968 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:24.968+0000 7ff33cc64700 1 --2- 172.21.15.26:0/2398670476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3380f6ff0 0x7ff3380f7a20 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:24.969 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:24.968+0000 7ff33cc64700 1 --2- 172.21.15.26:0/2398670476 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3380f66e0 0x7ff3380f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:24.969 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:24.968+0000 7ff33cc64700 1 -- 172.21.15.26:0/2398670476 >> 172.21.15.26:0/2398670476 conn(0x7ff3380f1f00 msgr2=0x7ff3380f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:37:24.969 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:24.968+0000 7ff33cc64700 1 -- 172.21.15.26:0/2398670476 shutdown_connections 2021-11-03T18:37:24.969 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:24.968+0000 7ff33cc64700 1 -- 172.21.15.26:0/2398670476 wait complete. 2021-11-03T18:37:24.969 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:24.968+0000 7ff33cc64700 1 Processor -- start 2021-11-03T18:37:24.970 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:24.968+0000 7ff33cc64700 1 -- start start 2021-11-03T18:37:24.970 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:24.968+0000 7ff33cc64700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3380f66e0 0x7ff338106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:37:24.970 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:24.968+0000 7ff33cc64700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3380f6ff0 0x7ff338107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:37:24.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:24.968+0000 7ff33cc64700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff338107a10 con 0x7ff3380f6ff0 2021-11-03T18:37:24.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:24.968+0000 7ff33cc64700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff338107b50 con 0x7ff3380f66e0 2021-11-03T18:37:24.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:24.969+0000 7ff335d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3380f6ff0 0x7ff338107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:37:24.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:24.969+0000 7ff335d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3380f6ff0 0x7ff338107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32818/0 (socket says 172.21.15.26:32818) 2021-11-03T18:37:24.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:24.969+0000 7ff335d9b700 1 -- 172.21.15.26:0/3320085264 learned_addr learned my addr 172.21.15.26:0/3320085264 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:37:24.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:24.969+0000 7ff33659c700 1 --2- 172.21.15.26:0/3320085264 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3380f66e0 0x7ff338106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:37:24.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:24.969+0000 7ff335d9b700 1 -- 172.21.15.26:0/3320085264 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3380f66e0 msgr2=0x7ff338106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:37:24.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:24.969+0000 7ff335d9b700 1 --2- 172.21.15.26:0/3320085264 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3380f66e0 0x7ff338106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:24.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:24.969+0000 7ff335d9b700 1 -- 172.21.15.26:0/3320085264 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff320005040 con 0x7ff3380f6ff0 2021-11-03T18:37:24.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:24.969+0000 7ff335d9b700 1 --2- 172.21.15.26:0/3320085264 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3380f6ff0 0x7ff338107460 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 rx=0x7ff320009990 tx=0x7ff320009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:37:24.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:24.969+0000 7ff32effd700 1 -- 172.21.15.26:0/3320085264 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff320018070 con 0x7ff3380f6ff0 2021-11-03T18:37:24.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:24.969+0000 7ff33cc64700 1 -- 172.21.15.26:0/3320085264 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff338108490 con 0x7ff3380f6ff0 2021-11-03T18:37:24.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:24.969+0000 7ff32effd700 1 -- 172.21.15.26:0/3320085264 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff320007ba0 con 0x7ff3380f6ff0 2021-11-03T18:37:24.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:24.969+0000 7ff32effd700 1 -- 172.21.15.26:0/3320085264 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff32001c620 con 0x7ff3380f6ff0 2021-11-03T18:37:24.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:24.969+0000 7ff33cc64700 1 -- 172.21.15.26:0/3320085264 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3381089f0 con 0x7ff3380f6ff0 2021-11-03T18:37:24.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:24.970+0000 7ff33cc64700 1 -- 172.21.15.26:0/3320085264 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff338045ad0 con 0x7ff3380f6ff0 2021-11-03T18:37:24.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:24.971+0000 7ff32effd700 1 -- 172.21.15.26:0/3320085264 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ff32001c8e0 con 0x7ff3380f6ff0 2021-11-03T18:37:24.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:24.971+0000 7ff32effd700 1 --2- 172.21.15.26:0/3320085264 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff3240640b0 0x7ff324066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:37:24.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:24.971+0000 7ff32effd700 1 -- 172.21.15.26:0/3320085264 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ff320082600 con 0x7ff3380f6ff0 2021-11-03T18:37:24.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:24.971+0000 7ff33659c700 1 --2- 172.21.15.26:0/3320085264 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff3240640b0 0x7ff324066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:37:24.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:24.972+0000 7ff33659c700 1 --2- 172.21.15.26:0/3320085264 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff3240640b0 0x7ff324066570 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7ff328004fd0 tx=0x7ff328009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:37:24.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:24.975+0000 7ff32effd700 1 -- 172.21.15.26:0/3320085264 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ff320054a20 con 0x7ff3380f6ff0 2021-11-03T18:37:25.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.155+0000 7ff33cc64700 1 -- 172.21.15.26:0/3320085264 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff3380fefe0 con 0x7ff3240640b0 2021-11-03T18:37:25.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.156+0000 7ff32effd700 1 -- 172.21.15.26:0/3320085264 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7ff3380fefe0 con 0x7ff3240640b0 2021-11-03T18:37:25.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.158+0000 7ff33cc64700 1 -- 172.21.15.26:0/3320085264 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff3240640b0 msgr2=0x7ff324066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:37:25.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.158+0000 7ff33cc64700 1 --2- 172.21.15.26:0/3320085264 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff3240640b0 0x7ff324066570 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7ff328004fd0 tx=0x7ff328009040).stop 2021-11-03T18:37:25.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.158+0000 7ff33cc64700 1 -- 172.21.15.26:0/3320085264 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3380f6ff0 msgr2=0x7ff338107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:37:25.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.158+0000 7ff33cc64700 1 --2- 172.21.15.26:0/3320085264 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3380f6ff0 0x7ff338107460 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 rx=0x7ff320009990 tx=0x7ff320009b30).stop 2021-11-03T18:37:25.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.158+0000 7ff33cc64700 1 -- 172.21.15.26:0/3320085264 shutdown_connections 2021-11-03T18:37:25.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.158+0000 7ff33cc64700 1 --2- 172.21.15.26:0/3320085264 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff3240640b0 0x7ff324066570 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:25.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.158+0000 7ff33cc64700 1 --2- 172.21.15.26:0/3320085264 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3380f66e0 0x7ff338106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:25.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.158+0000 7ff33cc64700 1 --2- 172.21.15.26:0/3320085264 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3380f6ff0 0x7ff338107460 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:25.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.158+0000 7ff33cc64700 1 -- 172.21.15.26:0/3320085264 >> 172.21.15.26:0/3320085264 conn(0x7ff3380f1f00 msgr2=0x7ff3380fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:37:25.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.158+0000 7ff33cc64700 1 -- 172.21.15.26:0/3320085264 shutdown_connections 2021-11-03T18:37:25.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.158+0000 7ff33cc64700 1 -- 172.21.15.26:0/3320085264 wait complete. 2021-11-03T18:37:25.166 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:37:25.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.258+0000 7f1378951700 1 -- 172.21.15.26:0/1831755634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13740f73b0 msgr2=0x7f13740f4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:37:25.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.258+0000 7f1378951700 1 --2- 172.21.15.26:0/1831755634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13740f73b0 0x7f13740f4640 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 rx=0x7f1368004660 tx=0x7f1368009b30).stop 2021-11-03T18:37:25.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.258+0000 7f1378951700 1 -- 172.21.15.26:0/1831755634 shutdown_connections 2021-11-03T18:37:25.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.258+0000 7f1378951700 1 --2- 172.21.15.26:0/1831755634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13740f73b0 0x7f13740f4640 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:25.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.258+0000 7f1378951700 1 --2- 172.21.15.26:0/1831755634 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13740f6a10 0x7f13740f6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:25.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.258+0000 7f1378951700 1 -- 172.21.15.26:0/1831755634 >> 172.21.15.26:0/1831755634 conn(0x7f13740f0320 msgr2=0x7f13740f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:37:25.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.258+0000 7f1378951700 1 -- 172.21.15.26:0/1831755634 shutdown_connections 2021-11-03T18:37:25.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.259+0000 7f1378951700 1 -- 172.21.15.26:0/1831755634 wait complete. 2021-11-03T18:37:25.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.259+0000 7f1378951700 1 Processor -- start 2021-11-03T18:37:25.260 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.259+0000 7f1378951700 1 -- start start 2021-11-03T18:37:25.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.259+0000 7f1378951700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13740f6a10 0x7f1374108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:37:25.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.259+0000 7f1378951700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13740f73b0 0x7f1374109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:37:25.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.259+0000 7f1378951700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13741099e0 con 0x7f13740f6a10 2021-11-03T18:37:25.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.259+0000 7f1378951700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1374109b20 con 0x7f13740f73b0 2021-11-03T18:37:25.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.259+0000 7f13737fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13740f6a10 0x7f1374108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:37:25.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.259+0000 7f13737fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13740f6a10 0x7f1374108f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32826/0 (socket says 172.21.15.26:32826) 2021-11-03T18:37:25.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.259+0000 7f13737fe700 1 -- 172.21.15.26:0/1073584453 learned_addr learned my addr 172.21.15.26:0/1073584453 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:37:25.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.260+0000 7f1372ffd700 1 --2- 172.21.15.26:0/1073584453 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13740f73b0 0x7f1374109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:37:25.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.260+0000 7f13737fe700 1 -- 172.21.15.26:0/1073584453 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13740f73b0 msgr2=0x7f1374109430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:37:25.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.260+0000 7f13737fe700 1 --2- 172.21.15.26:0/1073584453 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13740f73b0 0x7f1374109430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:25.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.260+0000 7f13737fe700 1 -- 172.21.15.26:0/1073584453 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1368005040 con 0x7f13740f6a10 2021-11-03T18:37:25.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.260+0000 7f1372ffd700 1 --2- 172.21.15.26:0/1073584453 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13740f73b0 0x7f1374109430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:37:25.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.260+0000 7f13737fe700 1 --2- 172.21.15.26:0/1073584453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13740f6a10 0x7f1374108f40 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 rx=0x7f13640026d0 tx=0x7f1364009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:37:25.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.260+0000 7f135bfff700 1 -- 172.21.15.26:0/1073584453 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1364009320 con 0x7f13740f6a10 2021-11-03T18:37:25.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.260+0000 7f135bfff700 1 -- 172.21.15.26:0/1073584453 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f136400f040 con 0x7f13740f6a10 2021-11-03T18:37:25.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.260+0000 7f1378951700 1 -- 172.21.15.26:0/1073584453 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f137410a4c0 con 0x7f13740f6a10 2021-11-03T18:37:25.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.260+0000 7f135bfff700 1 -- 172.21.15.26:0/1073584453 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13640147e0 con 0x7f13740f6a10 2021-11-03T18:37:25.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.260+0000 7f1378951700 1 -- 172.21.15.26:0/1073584453 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f137410aa80 con 0x7f13740f6a10 2021-11-03T18:37:25.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.261+0000 7f1378951700 1 -- 172.21.15.26:0/1073584453 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1374045ad0 con 0x7f13740f6a10 2021-11-03T18:37:25.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.262+0000 7f135bfff700 1 -- 172.21.15.26:0/1073584453 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f1364009480 con 0x7f13740f6a10 2021-11-03T18:37:25.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.262+0000 7f135bfff700 1 --2- 172.21.15.26:0/1073584453 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f135c064100 0x7f135c0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:37:25.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.262+0000 7f135bfff700 1 -- 172.21.15.26:0/1073584453 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f1364080ee0 con 0x7f13740f6a10 2021-11-03T18:37:25.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.262+0000 7f1372ffd700 1 --2- 172.21.15.26:0/1073584453 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f135c064100 0x7f135c0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:37:25.268 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.262+0000 7f1372ffd700 1 --2- 172.21.15.26:0/1073584453 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f135c064100 0x7f135c0665c0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7f1368004630 tx=0x7f1368009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:37:25.268 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.266+0000 7f135bfff700 1 -- 172.21.15.26:0/1073584453 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f1364053240 con 0x7f13740f6a10 2021-11-03T18:37:25.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:25 smithi026 ceph-mon[96795]: pgmap v3082: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:25.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.437+0000 7f1378951700 1 -- 172.21.15.26:0/1073584453 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f137410ad60 con 0x7f135c064100 2021-11-03T18:37:25.450 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.452+0000 7f135bfff700 1 -- 172.21.15.26:0/1073584453 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7f137410ad60 con 0x7f135c064100 2021-11-03T18:37:25.450 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:37:25.451 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (108m) 6m ago 109m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:37:25.451 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (100m) 6m ago 109m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:37:25.451 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (100m) 5m ago 109m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:37:25.451 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (108m) 6m ago 109m 42.3M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:37:25.452 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (101m) 6m ago 105m 26.2M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:37:25.452 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (101m) 6m ago 104m 26.8M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:37:25.452 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (105m) 5m ago 105m 27.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:37:25.452 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (105m) 5m ago 104m 27.4M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:37:25.452 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (102m) 6m ago 111m 601M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:37:25.453 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (101m) 5m ago 109m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:37:25.453 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (101m) 6m ago 111m 374M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:37:25.453 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (101m) 5m ago 109m 171M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:37:25.453 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (109m) 6m ago 109m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:37:25.454 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (108m) 5m ago 108m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:37:25.454 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (100m) 6m ago 108m 352M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:37:25.454 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (99m) 6m ago 107m 379M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:37:25.454 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (99m) 6m ago 107m 314M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:37:25.455 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (98m) 5m ago 107m 413M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:37:25.455 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (98m) 5m ago 106m 339M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:37:25.455 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (98m) 5m ago 106m 337M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:37:25.455 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (108m) 6m ago 109m 68.0M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:37:25.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.454+0000 7f1378951700 1 -- 172.21.15.26:0/1073584453 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f135c064100 msgr2=0x7f135c0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:37:25.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.454+0000 7f1378951700 1 --2- 172.21.15.26:0/1073584453 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f135c064100 0x7f135c0665c0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7f1368004630 tx=0x7f1368009b30).stop 2021-11-03T18:37:25.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.454+0000 7f1378951700 1 -- 172.21.15.26:0/1073584453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13740f6a10 msgr2=0x7f1374108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:37:25.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.454+0000 7f1378951700 1 --2- 172.21.15.26:0/1073584453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13740f6a10 0x7f1374108f40 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 rx=0x7f13640026d0 tx=0x7f1364009de0).stop 2021-11-03T18:37:25.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.454+0000 7f1378951700 1 -- 172.21.15.26:0/1073584453 shutdown_connections 2021-11-03T18:37:25.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.454+0000 7f1378951700 1 --2- 172.21.15.26:0/1073584453 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f135c064100 0x7f135c0665c0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:25.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.454+0000 7f1378951700 1 --2- 172.21.15.26:0/1073584453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13740f6a10 0x7f1374108f40 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:25.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.454+0000 7f1378951700 1 --2- 172.21.15.26:0/1073584453 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13740f73b0 0x7f1374109430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:25.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.454+0000 7f1378951700 1 -- 172.21.15.26:0/1073584453 >> 172.21.15.26:0/1073584453 conn(0x7f13740f0320 msgr2=0x7f13740fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:37:25.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.454+0000 7f1378951700 1 -- 172.21.15.26:0/1073584453 shutdown_connections 2021-11-03T18:37:25.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.454+0000 7f1378951700 1 -- 172.21.15.26:0/1073584453 wait complete. 2021-11-03T18:37:25.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:25 smithi194 ceph-mon[65619]: pgmap v3082: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:25.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.553+0000 7ff3bf2bd700 1 -- 172.21.15.26:0/3535043763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3b80f5ed0 msgr2=0x7ff3b80f6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:37:25.556 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.553+0000 7ff3bf2bd700 1 --2- 172.21.15.26:0/3535043763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3b80f5ed0 0x7ff3b80f6900 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 rx=0x7ff3ac004660 tx=0x7ff3ac009b30).stop 2021-11-03T18:37:25.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.553+0000 7ff3bf2bd700 1 -- 172.21.15.26:0/3535043763 shutdown_connections 2021-11-03T18:37:25.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.553+0000 7ff3bf2bd700 1 --2- 172.21.15.26:0/3535043763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3b80f5ed0 0x7ff3b80f6900 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:25.557 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.553+0000 7ff3bf2bd700 1 --2- 172.21.15.26:0/3535043763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3b80f55c0 0x7ff3b80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:25.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.553+0000 7ff3bf2bd700 1 -- 172.21.15.26:0/3535043763 >> 172.21.15.26:0/3535043763 conn(0x7ff3b80f0de0 msgr2=0x7ff3b80f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:37:25.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.553+0000 7ff3bf2bd700 1 -- 172.21.15.26:0/3535043763 shutdown_connections 2021-11-03T18:37:25.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.553+0000 7ff3bf2bd700 1 -- 172.21.15.26:0/3535043763 wait complete. 2021-11-03T18:37:25.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.554+0000 7ff3bf2bd700 1 Processor -- start 2021-11-03T18:37:25.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.554+0000 7ff3bf2bd700 1 -- start start 2021-11-03T18:37:25.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.554+0000 7ff3bf2bd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3b80f55c0 0x7ff3b8106f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:37:25.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.554+0000 7ff3bf2bd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3b80f5ed0 0x7ff3b8107440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:37:25.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.554+0000 7ff3bf2bd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b81079f0 con 0x7ff3b80f5ed0 2021-11-03T18:37:25.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.554+0000 7ff3bf2bd700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b8107b30 con 0x7ff3b80f55c0 2021-11-03T18:37:25.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.554+0000 7ff3bc858700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3b80f5ed0 0x7ff3b8107440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:37:25.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.554+0000 7ff3bc858700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3b80f5ed0 0x7ff3b8107440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32838/0 (socket says 172.21.15.26:32838) 2021-11-03T18:37:25.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.554+0000 7ff3bc858700 1 -- 172.21.15.26:0/485160417 learned_addr learned my addr 172.21.15.26:0/485160417 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:37:25.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.554+0000 7ff3bd059700 1 --2- 172.21.15.26:0/485160417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3b80f55c0 0x7ff3b8106f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:37:25.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.554+0000 7ff3bc858700 1 -- 172.21.15.26:0/485160417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3b80f55c0 msgr2=0x7ff3b8106f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:37:25.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.555+0000 7ff3bc858700 1 --2- 172.21.15.26:0/485160417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3b80f55c0 0x7ff3b8106f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:25.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.555+0000 7ff3bc858700 1 -- 172.21.15.26:0/485160417 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3ac005040 con 0x7ff3b80f5ed0 2021-11-03T18:37:25.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.555+0000 7ff3bc858700 1 --2- 172.21.15.26:0/485160417 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3b80f5ed0 0x7ff3b8107440 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 rx=0x7ff3ac009da0 tx=0x7ff3ac009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:37:25.562 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.555+0000 7ff3b5ffb700 1 -- 172.21.15.26:0/485160417 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3ac018070 con 0x7ff3b80f5ed0 2021-11-03T18:37:25.562 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.555+0000 7ff3b5ffb700 1 -- 172.21.15.26:0/485160417 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff3ac007d70 con 0x7ff3b80f5ed0 2021-11-03T18:37:25.563 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.555+0000 7ff3bf2bd700 1 -- 172.21.15.26:0/485160417 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3b8108470 con 0x7ff3b80f5ed0 2021-11-03T18:37:25.563 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.555+0000 7ff3b5ffb700 1 -- 172.21.15.26:0/485160417 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3ac01dea0 con 0x7ff3b80f5ed0 2021-11-03T18:37:25.563 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.555+0000 7ff3bf2bd700 1 -- 172.21.15.26:0/485160417 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3b81089d0 con 0x7ff3b80f5ed0 2021-11-03T18:37:25.563 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.556+0000 7ff3bf2bd700 1 -- 172.21.15.26:0/485160417 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3b8045ad0 con 0x7ff3b80f5ed0 2021-11-03T18:37:25.564 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.556+0000 7ff3b5ffb700 1 -- 172.21.15.26:0/485160417 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ff3ac01d420 con 0x7ff3b80f5ed0 2021-11-03T18:37:25.564 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.557+0000 7ff3b5ffb700 1 --2- 172.21.15.26:0/485160417 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff3a0064090 0x7ff3a0066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:37:25.564 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.557+0000 7ff3b5ffb700 1 -- 172.21.15.26:0/485160417 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ff3ac082570 con 0x7ff3b80f5ed0 2021-11-03T18:37:25.564 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.557+0000 7ff3bd059700 1 --2- 172.21.15.26:0/485160417 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff3a0064090 0x7ff3a0066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:37:25.565 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.557+0000 7ff3bd059700 1 --2- 172.21.15.26:0/485160417 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff3a0064090 0x7ff3a0066550 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7ff3b0004fd0 tx=0x7ff3b0009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:37:25.565 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.561+0000 7ff3b5ffb700 1 -- 172.21.15.26:0/485160417 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ff3ac054990 con 0x7ff3b80f5ed0 2021-11-03T18:37:25.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.794+0000 7ff3bf2bd700 1 -- 172.21.15.26:0/485160417 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff3b8109120 con 0x7ff3b80f5ed0 2021-11-03T18:37:25.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.795+0000 7ff3b5ffb700 1 -- 172.21.15.26:0/485160417 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7ff3ac054580 con 0x7ff3b80f5ed0 2021-11-03T18:37:25.793 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:37:25.794 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:37:25.794 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:37:25.794 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:37:25.794 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:37:25.795 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:37:25.795 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:37:25.795 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:37:25.795 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:37:25.796 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:37:25.796 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:37:25.796 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:37:25.796 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:37:25.796 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:37:25.797 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:37:25.797 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:37:25.797 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:37:25.797 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:37:25.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.796+0000 7ff3bf2bd700 1 -- 172.21.15.26:0/485160417 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff3a0064090 msgr2=0x7ff3a0066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:37:25.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.796+0000 7ff3bf2bd700 1 --2- 172.21.15.26:0/485160417 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff3a0064090 0x7ff3a0066550 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7ff3b0004fd0 tx=0x7ff3b0009040).stop 2021-11-03T18:37:25.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.796+0000 7ff3bf2bd700 1 -- 172.21.15.26:0/485160417 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3b80f5ed0 msgr2=0x7ff3b8107440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:37:25.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.796+0000 7ff3bf2bd700 1 --2- 172.21.15.26:0/485160417 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3b80f5ed0 0x7ff3b8107440 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 rx=0x7ff3ac009da0 tx=0x7ff3ac009b30).stop 2021-11-03T18:37:25.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.797+0000 7ff3bf2bd700 1 -- 172.21.15.26:0/485160417 shutdown_connections 2021-11-03T18:37:25.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.797+0000 7ff3bf2bd700 1 --2- 172.21.15.26:0/485160417 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff3a0064090 0x7ff3a0066550 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:25.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.797+0000 7ff3bf2bd700 1 --2- 172.21.15.26:0/485160417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3b80f55c0 0x7ff3b8106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:25.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.797+0000 7ff3bf2bd700 1 --2- 172.21.15.26:0/485160417 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3b80f5ed0 0x7ff3b8107440 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:25.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.797+0000 7ff3bf2bd700 1 -- 172.21.15.26:0/485160417 >> 172.21.15.26:0/485160417 conn(0x7ff3b80f0de0 msgr2=0x7ff3b805f700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:37:25.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.797+0000 7ff3bf2bd700 1 -- 172.21.15.26:0/485160417 shutdown_connections 2021-11-03T18:37:25.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.797+0000 7ff3bf2bd700 1 -- 172.21.15.26:0/485160417 wait complete. 2021-11-03T18:37:25.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.896+0000 7fd8cf3da700 1 -- 172.21.15.26:0/1743276776 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8c80f5410 msgr2=0x7fd8c80fbcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:37:25.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.896+0000 7fd8cf3da700 1 --2- 172.21.15.26:0/1743276776 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8c80f5410 0x7fd8c80fbcf0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 rx=0x7fd8b8004690 tx=0x7fd8b8009b30).stop 2021-11-03T18:37:25.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.896+0000 7fd8cf3da700 1 -- 172.21.15.26:0/1743276776 shutdown_connections 2021-11-03T18:37:25.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.896+0000 7fd8cf3da700 1 --2- 172.21.15.26:0/1743276776 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8c80f5410 0x7fd8c80fbcf0 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:25.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.896+0000 7fd8cf3da700 1 --2- 172.21.15.26:0/1743276776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8c80f4ae0 0x7fd8c80f4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:25.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.896+0000 7fd8cf3da700 1 -- 172.21.15.26:0/1743276776 >> 172.21.15.26:0/1743276776 conn(0x7fd8c80f0540 msgr2=0x7fd8c80f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:37:25.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.897+0000 7fd8cf3da700 1 -- 172.21.15.26:0/1743276776 shutdown_connections 2021-11-03T18:37:25.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.897+0000 7fd8cf3da700 1 -- 172.21.15.26:0/1743276776 wait complete. 2021-11-03T18:37:25.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.897+0000 7fd8cf3da700 1 Processor -- start 2021-11-03T18:37:25.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.897+0000 7fd8cf3da700 1 -- start start 2021-11-03T18:37:25.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.897+0000 7fd8cf3da700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8c80f4ae0 0x7fd8c80f76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:37:25.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.897+0000 7fd8cf3da700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8c80f5410 0x7fd8c80f5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:37:25.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.897+0000 7fd8cf3da700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c80f60b0 con 0x7fd8c80f4ae0 2021-11-03T18:37:25.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.897+0000 7fd8cf3da700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c80f61f0 con 0x7fd8c80f5410 2021-11-03T18:37:25.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.897+0000 7fd8cd176700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8c80f4ae0 0x7fd8c80f76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:37:25.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.897+0000 7fd8cd176700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8c80f4ae0 0x7fd8c80f76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32846/0 (socket says 172.21.15.26:32846) 2021-11-03T18:37:25.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.897+0000 7fd8cd176700 1 -- 172.21.15.26:0/1584376513 learned_addr learned my addr 172.21.15.26:0/1584376513 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:37:25.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.898+0000 7fd8cc975700 1 --2- 172.21.15.26:0/1584376513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8c80f5410 0x7fd8c80f5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:37:25.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.898+0000 7fd8cd176700 1 -- 172.21.15.26:0/1584376513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8c80f5410 msgr2=0x7fd8c80f5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:37:25.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.898+0000 7fd8cd176700 1 --2- 172.21.15.26:0/1584376513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8c80f5410 0x7fd8c80f5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:25.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.898+0000 7fd8cd176700 1 -- 172.21.15.26:0/1584376513 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b8005040 con 0x7fd8c80f4ae0 2021-11-03T18:37:25.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.898+0000 7fd8cc975700 1 --2- 172.21.15.26:0/1584376513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8c80f5410 0x7fd8c80f5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:37:25.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.898+0000 7fd8cd176700 1 --2- 172.21.15.26:0/1584376513 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8c80f4ae0 0x7fd8c80f76d0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 rx=0x7fd8c4002700 tx=0x7fd8c4009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:37:25.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.898+0000 7fd8bdffb700 1 -- 172.21.15.26:0/1584376513 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8c4009320 con 0x7fd8c80f4ae0 2021-11-03T18:37:25.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.898+0000 7fd8bdffb700 1 -- 172.21.15.26:0/1584376513 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd8c400f040 con 0x7fd8c80f4ae0 2021-11-03T18:37:25.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.898+0000 7fd8bdffb700 1 -- 172.21.15.26:0/1584376513 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8c4014900 con 0x7fd8c80f4ae0 2021-11-03T18:37:25.902 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.898+0000 7fd8cf3da700 1 -- 172.21.15.26:0/1584376513 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c80f64d0 con 0x7fd8c80f4ae0 2021-11-03T18:37:25.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.898+0000 7fd8cf3da700 1 -- 172.21.15.26:0/1584376513 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c810eed0 con 0x7fd8c80f4ae0 2021-11-03T18:37:25.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.899+0000 7fd8cf3da700 1 -- 172.21.15.26:0/1584376513 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8c8045ad0 con 0x7fd8c80f4ae0 2021-11-03T18:37:25.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.900+0000 7fd8bdffb700 1 -- 172.21.15.26:0/1584376513 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fd8c4009480 con 0x7fd8c80f4ae0 2021-11-03T18:37:25.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.900+0000 7fd8bdffb700 1 --2- 172.21.15.26:0/1584376513 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd8b4064180 0x7fd8b4066640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:37:25.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.900+0000 7fd8bdffb700 1 -- 172.21.15.26:0/1584376513 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fd8c40808a0 con 0x7fd8c80f4ae0 2021-11-03T18:37:25.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.900+0000 7fd8cc975700 1 --2- 172.21.15.26:0/1584376513 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd8b4064180 0x7fd8b4066640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:37:25.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.900+0000 7fd8cc975700 1 --2- 172.21.15.26:0/1584376513 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd8b4064180 0x7fd8b4066640 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7fd8b8005010 tx=0x7fd8b8009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:37:25.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:25.904+0000 7fd8bdffb700 1 -- 172.21.15.26:0/1584376513 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fd8c4052d40 con 0x7fd8c80f4ae0 2021-11-03T18:37:26.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:26.109+0000 7fd8cf3da700 1 -- 172.21.15.26:0/1584376513 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd8c80fef80 con 0x7fd8c80f4ae0 2021-11-03T18:37:26.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:26.110+0000 7fd8bdffb700 1 -- 172.21.15.26:0/1584376513 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fd8c4052930 con 0x7fd8c80f4ae0 2021-11-03T18:37:26.108 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:37:26.109 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:37:26.109 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:37:26.109 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:37:26.109 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:37:26.109 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:37:26.110 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:37:26.110 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:37:26.110 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:37:26.111 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:37:26.111 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:37:26.111 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:37:26.111 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:37:26.112 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:37:26.112 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:37:26.112 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:37:26.112 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:37:26.112 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:37:26.113 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:37:26.113 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:37:26.113 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:37:26.113 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:37:26.114 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:37:26.114 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:37:26.114 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:37:26.114 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:37:26.114 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:37:26.115 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:37:26.115 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:37:26.115 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:37:26.115 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:37:26.116 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:37:26.116 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:37:26.116 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:37:26.116 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:37:26.116 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:37:26.117 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:37:26.117 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:37:26.117 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:37:26.118 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:26.112+0000 7fd8cf3da700 1 -- 172.21.15.26:0/1584376513 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd8b4064180 msgr2=0x7fd8b4066640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:37:26.118 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:26.112+0000 7fd8cf3da700 1 --2- 172.21.15.26:0/1584376513 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd8b4064180 0x7fd8b4066640 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7fd8b8005010 tx=0x7fd8b8009b30).stop 2021-11-03T18:37:26.118 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:26.112+0000 7fd8cf3da700 1 -- 172.21.15.26:0/1584376513 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8c80f4ae0 msgr2=0x7fd8c80f76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:37:26.119 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:26.112+0000 7fd8cf3da700 1 --2- 172.21.15.26:0/1584376513 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8c80f4ae0 0x7fd8c80f76d0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 rx=0x7fd8c4002700 tx=0x7fd8c4009d80).stop 2021-11-03T18:37:26.119 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:26.112+0000 7fd8cf3da700 1 -- 172.21.15.26:0/1584376513 shutdown_connections 2021-11-03T18:37:26.119 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:26.112+0000 7fd8cf3da700 1 --2- 172.21.15.26:0/1584376513 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd8b4064180 0x7fd8b4066640 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:26.119 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:26.112+0000 7fd8cf3da700 1 --2- 172.21.15.26:0/1584376513 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8c80f4ae0 0x7fd8c80f76d0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:26.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:26.112+0000 7fd8cf3da700 1 --2- 172.21.15.26:0/1584376513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8c80f5410 0x7fd8c80f5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:26.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:26.112+0000 7fd8cf3da700 1 -- 172.21.15.26:0/1584376513 >> 172.21.15.26:0/1584376513 conn(0x7fd8c80f0540 msgr2=0x7fd8c80f84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:37:26.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:26.112+0000 7fd8cf3da700 1 -- 172.21.15.26:0/1584376513 shutdown_connections 2021-11-03T18:37:26.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:26.112+0000 7fd8cf3da700 1 -- 172.21.15.26:0/1584376513 wait complete. 2021-11-03T18:37:26.121 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:37:26.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:26 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:37:26.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:26 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:37:26.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:26 smithi026 ceph-mon[96795]: from='client.37308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:37:26.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:26 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/485160417' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:37:26.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:26 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:37:26.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:26 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:37:26.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:26 smithi194 ceph-mon[65619]: from='client.37308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:37:26.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:26 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/485160417' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:37:27.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:27 smithi026 ceph-mon[96795]: from='client.37312 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:37:27.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:27 smithi026 ceph-mon[96795]: pgmap v3083: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:27.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:27 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1584376513' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:37:27.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:27 smithi194 ceph-mon[65619]: from='client.37312 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:37:27.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:27 smithi194 ceph-mon[65619]: pgmap v3083: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:27.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:27 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1584376513' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:37:29.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:29 smithi026 ceph-mon[96795]: pgmap v3084: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:29.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:29 smithi194 ceph-mon[65619]: pgmap v3084: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:31.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:31 smithi026 ceph-mon[96795]: pgmap v3085: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:31.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:31 smithi194 ceph-mon[65619]: pgmap v3085: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:33.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:33 smithi026 ceph-mon[96795]: pgmap v3086: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:33.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:33 smithi194 ceph-mon[65619]: pgmap v3086: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:35.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:35 smithi026 ceph-mon[96795]: pgmap v3087: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:35.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:35 smithi194 ceph-mon[65619]: pgmap v3087: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:37.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:37 smithi026 ceph-mon[96795]: pgmap v3088: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:37.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:37 smithi194 ceph-mon[65619]: pgmap v3088: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:39.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:39 smithi026 ceph-mon[96795]: pgmap v3089: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:39.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:39 smithi194 ceph-mon[65619]: pgmap v3089: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:41.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:41 smithi026 ceph-mon[96795]: pgmap v3090: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:41.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:37:41.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:41 smithi026 ceph-mon[96795]: poll took 60067.973 ms: 1 events 2021-11-03T18:37:41.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:37:41.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:37:41.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:37:41.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:37:41.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:37:41.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:37:41.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:37:41.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:41 smithi194 ceph-mon[65619]: pgmap v3090: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:41.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:37:41.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:41 smithi194 ceph-mon[65619]: poll took 60067.973 ms: 1 events 2021-11-03T18:37:41.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:37:41.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:37:41.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:37:41.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:37:41.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:37:41.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:37:41.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:37:42.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:42 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:37:42.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:42 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:37:42.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:42 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:37:42.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:42 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:37:43.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:43 smithi026 ceph-mon[96795]: pgmap v3091: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:43.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:43 smithi194 ceph-mon[65619]: pgmap v3091: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:45.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:45 smithi026 ceph-mon[96795]: pgmap v3092: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:45.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:45 smithi194 ceph-mon[65619]: pgmap v3092: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:47.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:47 smithi026 ceph-mon[96795]: pgmap v3093: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:47.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:47 smithi194 ceph-mon[65619]: pgmap v3093: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:49 smithi026 ceph-mon[96795]: pgmap v3094: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:37:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:37:49.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:49 smithi194 ceph-mon[65619]: pgmap v3094: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:37:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:37:51.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:51 smithi026 ceph-mon[96795]: pgmap v3095: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:51.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:51 smithi194 ceph-mon[65619]: pgmap v3095: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:53.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:53 smithi026 ceph-mon[96795]: pgmap v3096: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:53.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:53 smithi194 ceph-mon[65619]: pgmap v3096: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:55.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:55 smithi026 ceph-mon[96795]: pgmap v3097: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:55.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:55 smithi194 ceph-mon[65619]: pgmap v3097: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:56.224 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.225+0000 7f6226648700 1 -- 172.21.15.26:0/3387810233 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62200f6ff0 msgr2=0x7f62200f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:37:56.224 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.225+0000 7f6226648700 1 --2- 172.21.15.26:0/3387810233 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62200f6ff0 0x7f62200f7a20 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 rx=0x7f6214004660 tx=0x7f6214009b30).stop 2021-11-03T18:37:56.225 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.225+0000 7f6226648700 1 -- 172.21.15.26:0/3387810233 shutdown_connections 2021-11-03T18:37:56.225 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.225+0000 7f6226648700 1 --2- 172.21.15.26:0/3387810233 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62200f6ff0 0x7f62200f7a20 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:56.225 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.225+0000 7f6226648700 1 --2- 172.21.15.26:0/3387810233 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62200f66e0 0x7f62200f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:56.225 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.225+0000 7f6226648700 1 -- 172.21.15.26:0/3387810233 >> 172.21.15.26:0/3387810233 conn(0x7f62200f1f00 msgr2=0x7f62200f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:37:56.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.225+0000 7f6226648700 1 -- 172.21.15.26:0/3387810233 shutdown_connections 2021-11-03T18:37:56.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.225+0000 7f6226648700 1 -- 172.21.15.26:0/3387810233 wait complete. 2021-11-03T18:37:56.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.225+0000 7f6226648700 1 Processor -- start 2021-11-03T18:37:56.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.226+0000 7f6226648700 1 -- start start 2021-11-03T18:37:56.228 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.226+0000 7f6226648700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62200f66e0 0x7f6220106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:37:56.229 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.226+0000 7f6226648700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62200f6ff0 0x7f6220107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:37:56.229 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.226+0000 7f6226648700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6220107a10 con 0x7f62200f66e0 2021-11-03T18:37:56.229 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.226+0000 7f6226648700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6220107b50 con 0x7f62200f6ff0 2021-11-03T18:37:56.229 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.226+0000 7f621ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62200f66e0 0x7f6220106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:37:56.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.226+0000 7f621ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62200f66e0 0x7f6220106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32864/0 (socket says 172.21.15.26:32864) 2021-11-03T18:37:56.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.226+0000 7f621ffff700 1 -- 172.21.15.26:0/1233367991 learned_addr learned my addr 172.21.15.26:0/1233367991 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:37:56.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.226+0000 7f621f7fe700 1 --2- 172.21.15.26:0/1233367991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62200f6ff0 0x7f6220107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:37:56.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.226+0000 7f621ffff700 1 -- 172.21.15.26:0/1233367991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62200f6ff0 msgr2=0x7f6220107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:37:56.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.226+0000 7f621ffff700 1 --2- 172.21.15.26:0/1233367991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62200f6ff0 0x7f6220107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:56.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.226+0000 7f621ffff700 1 -- 172.21.15.26:0/1233367991 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6214005040 con 0x7f62200f66e0 2021-11-03T18:37:56.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.226+0000 7f621ffff700 1 --2- 172.21.15.26:0/1233367991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62200f66e0 0x7f6220106f70 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 rx=0x7f621000c790 tx=0x7f6210007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:37:56.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.226+0000 7f621cff9700 1 -- 172.21.15.26:0/1233367991 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f621000e680 con 0x7f62200f66e0 2021-11-03T18:37:56.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.227+0000 7f6226648700 1 -- 172.21.15.26:0/1233367991 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62201084f0 con 0x7f62200f66e0 2021-11-03T18:37:56.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.227+0000 7f621cff9700 1 -- 172.21.15.26:0/1233367991 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f621000ec90 con 0x7f62200f66e0 2021-11-03T18:37:56.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.227+0000 7f621cff9700 1 -- 172.21.15.26:0/1233367991 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6210013d60 con 0x7f62200f66e0 2021-11-03T18:37:56.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.227+0000 7f6226648700 1 -- 172.21.15.26:0/1233367991 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6220108ab0 con 0x7f62200f66e0 2021-11-03T18:37:56.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.228+0000 7f6226648700 1 -- 172.21.15.26:0/1233367991 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6220045ad0 con 0x7f62200f66e0 2021-11-03T18:37:56.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.228+0000 7f621cff9700 1 -- 172.21.15.26:0/1233367991 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f621001a060 con 0x7f62200f66e0 2021-11-03T18:37:56.233 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.228+0000 7f621cff9700 1 --2- 172.21.15.26:0/1233367991 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f62080640b0 0x7f6208066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:37:56.233 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.228+0000 7f621cff9700 1 -- 172.21.15.26:0/1233367991 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f6210080b90 con 0x7f62200f66e0 2021-11-03T18:37:56.233 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.229+0000 7f621f7fe700 1 --2- 172.21.15.26:0/1233367991 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f62080640b0 0x7f6208066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:37:56.233 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.229+0000 7f621f7fe700 1 --2- 172.21.15.26:0/1233367991 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f62080640b0 0x7f6208066570 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7f6214009da0 tx=0x7f6214009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:37:56.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.233+0000 7f621cff9700 1 -- 172.21.15.26:0/1233367991 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f6210052d40 con 0x7f62200f66e0 2021-11-03T18:37:56.411 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.412+0000 7f6226648700 1 -- 172.21.15.26:0/1233367991 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f62200ff010 con 0x7f62080640b0 2021-11-03T18:37:56.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.413+0000 7f621cff9700 1 -- 172.21.15.26:0/1233367991 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f62200ff010 con 0x7f62080640b0 2021-11-03T18:37:56.414 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.415+0000 7f6226648700 1 -- 172.21.15.26:0/1233367991 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f62080640b0 msgr2=0x7f6208066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:37:56.414 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.415+0000 7f6226648700 1 --2- 172.21.15.26:0/1233367991 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f62080640b0 0x7f6208066570 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7f6214009da0 tx=0x7f6214009b30).stop 2021-11-03T18:37:56.414 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.415+0000 7f6226648700 1 -- 172.21.15.26:0/1233367991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62200f66e0 msgr2=0x7f6220106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:37:56.414 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.415+0000 7f6226648700 1 --2- 172.21.15.26:0/1233367991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62200f66e0 0x7f6220106f70 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 rx=0x7f621000c790 tx=0x7f6210007d70).stop 2021-11-03T18:37:56.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.415+0000 7f6226648700 1 -- 172.21.15.26:0/1233367991 shutdown_connections 2021-11-03T18:37:56.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.415+0000 7f6226648700 1 --2- 172.21.15.26:0/1233367991 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f62080640b0 0x7f6208066570 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:56.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.415+0000 7f6226648700 1 --2- 172.21.15.26:0/1233367991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62200f66e0 0x7f6220106f70 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:56.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.415+0000 7f6226648700 1 --2- 172.21.15.26:0/1233367991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62200f6ff0 0x7f6220107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:56.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.415+0000 7f6226648700 1 -- 172.21.15.26:0/1233367991 >> 172.21.15.26:0/1233367991 conn(0x7f62200f1f00 msgr2=0x7f62200fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:37:56.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.415+0000 7f6226648700 1 -- 172.21.15.26:0/1233367991 shutdown_connections 2021-11-03T18:37:56.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.415+0000 7f6226648700 1 -- 172.21.15.26:0/1233367991 wait complete. 2021-11-03T18:37:56.423 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:37:56.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:56 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:37:56.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:56 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:37:56.517 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.515+0000 7f983e252700 1 -- 172.21.15.26:0/2490586156 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98380f5ef0 msgr2=0x7f98380f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:37:56.517 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.515+0000 7f983e252700 1 --2- 172.21.15.26:0/2490586156 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98380f5ef0 0x7f98380f6920 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 rx=0x7f982c004660 tx=0x7f982c009b30).stop 2021-11-03T18:37:56.517 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.515+0000 7f983e252700 1 -- 172.21.15.26:0/2490586156 shutdown_connections 2021-11-03T18:37:56.518 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.515+0000 7f983e252700 1 --2- 172.21.15.26:0/2490586156 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98380f5ef0 0x7f98380f6920 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:56.518 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.515+0000 7f983e252700 1 --2- 172.21.15.26:0/2490586156 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98380f55e0 0x7f98380f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:56.518 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.515+0000 7f983e252700 1 -- 172.21.15.26:0/2490586156 >> 172.21.15.26:0/2490586156 conn(0x7f98380f0de0 msgr2=0x7f98380f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:37:56.518 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.515+0000 7f983e252700 1 -- 172.21.15.26:0/2490586156 shutdown_connections 2021-11-03T18:37:56.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.515+0000 7f983e252700 1 -- 172.21.15.26:0/2490586156 wait complete. 2021-11-03T18:37:56.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.516+0000 7f983e252700 1 Processor -- start 2021-11-03T18:37:56.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.516+0000 7f983e252700 1 -- start start 2021-11-03T18:37:56.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.516+0000 7f983e252700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98380f55e0 0x7f9838105e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:37:56.520 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.516+0000 7f983e252700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98380f5ef0 0x7f9838106350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:37:56.520 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.516+0000 7f983e252700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9838106950 con 0x7f98380f5ef0 2021-11-03T18:37:56.520 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.516+0000 7f983e252700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9838107160 con 0x7f98380f55e0 2021-11-03T18:37:56.520 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.516+0000 7f9836ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98380f5ef0 0x7f9838106350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:37:56.520 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.516+0000 7f9836ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98380f5ef0 0x7f9838106350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32876/0 (socket says 172.21.15.26:32876) 2021-11-03T18:37:56.521 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.516+0000 7f9836ffd700 1 -- 172.21.15.26:0/1748109059 learned_addr learned my addr 172.21.15.26:0/1748109059 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:37:56.521 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.516+0000 7f98377fe700 1 --2- 172.21.15.26:0/1748109059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98380f55e0 0x7f9838105e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:37:56.521 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.516+0000 7f9836ffd700 1 -- 172.21.15.26:0/1748109059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98380f55e0 msgr2=0x7f9838105e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:37:56.521 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.516+0000 7f9836ffd700 1 --2- 172.21.15.26:0/1748109059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98380f55e0 0x7f9838105e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:56.522 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.517+0000 7f9836ffd700 1 -- 172.21.15.26:0/1748109059 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f982c005040 con 0x7f98380f5ef0 2021-11-03T18:37:56.522 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.517+0000 7f98377fe700 1 --2- 172.21.15.26:0/1748109059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98380f55e0 0x7f9838105e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:37:56.522 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.517+0000 7f9836ffd700 1 --2- 172.21.15.26:0/1748109059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98380f5ef0 0x7f9838106350 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 rx=0x7f982c000c00 tx=0x7f982c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:37:56.522 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.517+0000 7f981ffff700 1 -- 172.21.15.26:0/1748109059 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f982c019070 con 0x7f98380f5ef0 2021-11-03T18:37:56.522 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.517+0000 7f981ffff700 1 -- 172.21.15.26:0/1748109059 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f982c007e70 con 0x7f98380f5ef0 2021-11-03T18:37:56.523 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.517+0000 7f983e252700 1 -- 172.21.15.26:0/1748109059 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9838107380 con 0x7f98380f5ef0 2021-11-03T18:37:56.524 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.517+0000 7f981ffff700 1 -- 172.21.15.26:0/1748109059 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f982c014d90 con 0x7f98380f5ef0 2021-11-03T18:37:56.524 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.517+0000 7f983e252700 1 -- 172.21.15.26:0/1748109059 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98381078e0 con 0x7f98380f5ef0 2021-11-03T18:37:56.524 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.518+0000 7f983e252700 1 -- 172.21.15.26:0/1748109059 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98380f4a70 con 0x7f98380f5ef0 2021-11-03T18:37:56.525 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.518+0000 7f981ffff700 1 -- 172.21.15.26:0/1748109059 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f982c025070 con 0x7f98380f5ef0 2021-11-03T18:37:56.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.519+0000 7f981ffff700 1 --2- 172.21.15.26:0/1748109059 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f98200640b0 0x7f9820066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:37:56.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.519+0000 7f981ffff700 1 -- 172.21.15.26:0/1748109059 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f982c0817a0 con 0x7f98380f5ef0 2021-11-03T18:37:56.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.519+0000 7f98377fe700 1 --2- 172.21.15.26:0/1748109059 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f98200640b0 0x7f9820066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:37:56.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.519+0000 7f98377fe700 1 --2- 172.21.15.26:0/1748109059 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f98200640b0 0x7f9820066570 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 rx=0x7f9828009da0 tx=0x7f982800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:37:56.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.523+0000 7f981ffff700 1 -- 172.21.15.26:0/1748109059 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f982c053b00 con 0x7f98380f5ef0 2021-11-03T18:37:56.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.695+0000 7f983e252700 1 -- 172.21.15.26:0/1748109059 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f98380fdf10 con 0x7f98200640b0 2021-11-03T18:37:56.710 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.710+0000 7f981ffff700 1 -- 172.21.15.26:0/1748109059 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7f98380fdf10 con 0x7f98200640b0 2021-11-03T18:37:56.711 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:37:56.711 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (109m) 7m ago 110m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:37:56.711 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (101m) 7m ago 110m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:37:56.712 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (101m) 6m ago 109m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:37:56.712 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (108m) 7m ago 110m 42.3M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:37:56.712 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (102m) 7m ago 105m 26.2M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:37:56.712 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (102m) 7m ago 105m 26.8M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:37:56.713 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (105m) 6m ago 105m 27.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:37:56.714 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (105m) 6m ago 105m 27.4M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:37:56.714 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (102m) 7m ago 111m 601M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:37:56.714 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (102m) 6m ago 109m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:37:56.715 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (102m) 7m ago 111m 374M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:37:56.715 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (101m) 6m ago 109m 171M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:37:56.715 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (110m) 7m ago 110m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:37:56.715 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (109m) 6m ago 109m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:37:56.715 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (101m) 7m ago 108m 352M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:37:56.716 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (100m) 7m ago 108m 379M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:37:56.716 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (99m) 7m ago 108m 314M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:37:56.716 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (99m) 6m ago 107m 413M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:37:56.716 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (99m) 6m ago 107m 339M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:37:56.717 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (98m) 6m ago 107m 337M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:37:56.717 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (108m) 7m ago 109m 68.0M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:37:56.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.712+0000 7f983e252700 1 -- 172.21.15.26:0/1748109059 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f98200640b0 msgr2=0x7f9820066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:37:56.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.712+0000 7f983e252700 1 --2- 172.21.15.26:0/1748109059 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f98200640b0 0x7f9820066570 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 rx=0x7f9828009da0 tx=0x7f982800b040).stop 2021-11-03T18:37:56.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.712+0000 7f983e252700 1 -- 172.21.15.26:0/1748109059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98380f5ef0 msgr2=0x7f9838106350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:37:56.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.712+0000 7f983e252700 1 --2- 172.21.15.26:0/1748109059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98380f5ef0 0x7f9838106350 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 rx=0x7f982c000c00 tx=0x7f982c00b040).stop 2021-11-03T18:37:56.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.712+0000 7f983e252700 1 -- 172.21.15.26:0/1748109059 shutdown_connections 2021-11-03T18:37:56.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.712+0000 7f983e252700 1 --2- 172.21.15.26:0/1748109059 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f98200640b0 0x7f9820066570 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:56.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.712+0000 7f983e252700 1 --2- 172.21.15.26:0/1748109059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98380f55e0 0x7f9838105e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:56.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.712+0000 7f983e252700 1 --2- 172.21.15.26:0/1748109059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98380f5ef0 0x7f9838106350 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:56.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.712+0000 7f983e252700 1 -- 172.21.15.26:0/1748109059 >> 172.21.15.26:0/1748109059 conn(0x7f98380f0de0 msgr2=0x7f98380fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:37:56.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.712+0000 7f983e252700 1 -- 172.21.15.26:0/1748109059 shutdown_connections 2021-11-03T18:37:56.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.712+0000 7f983e252700 1 -- 172.21.15.26:0/1748109059 wait complete. 2021-11-03T18:37:56.812 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.811+0000 7f9e7f1e5700 1 -- 172.21.15.26:0/2845042753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e780f55c0 msgr2=0x7f9e780f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:37:56.813 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.811+0000 7f9e7f1e5700 1 --2- 172.21.15.26:0/2845042753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e780f55c0 0x7f9e780f59e0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 rx=0x7f9e70004660 tx=0x7f9e70009b30).stop 2021-11-03T18:37:56.813 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.811+0000 7f9e7f1e5700 1 -- 172.21.15.26:0/2845042753 shutdown_connections 2021-11-03T18:37:56.813 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.811+0000 7f9e7f1e5700 1 --2- 172.21.15.26:0/2845042753 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e780f6860 0x7f9e780f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:56.814 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.811+0000 7f9e7f1e5700 1 --2- 172.21.15.26:0/2845042753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e780f55c0 0x7f9e780f59e0 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:56.814 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.811+0000 7f9e7f1e5700 1 -- 172.21.15.26:0/2845042753 >> 172.21.15.26:0/2845042753 conn(0x7f9e780f0d40 msgr2=0x7f9e780f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:37:56.814 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.811+0000 7f9e7f1e5700 1 -- 172.21.15.26:0/2845042753 shutdown_connections 2021-11-03T18:37:56.814 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.811+0000 7f9e7f1e5700 1 -- 172.21.15.26:0/2845042753 wait complete. 2021-11-03T18:37:56.815 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.811+0000 7f9e7f1e5700 1 Processor -- start 2021-11-03T18:37:56.815 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.812+0000 7f9e7f1e5700 1 -- start start 2021-11-03T18:37:56.815 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.812+0000 7f9e7f1e5700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e780f55c0 0x7f9e78109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:37:56.816 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.812+0000 7f9e7f1e5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e780f6860 0x7f9e7810c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:37:56.816 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.812+0000 7f9e7f1e5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e780603e0 con 0x7f9e780f6860 2021-11-03T18:37:56.816 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.812+0000 7f9e7f1e5700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e78060520 con 0x7f9e780f55c0 2021-11-03T18:37:56.816 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.812+0000 7f9e77fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e780f6860 0x7f9e7810c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:37:56.817 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.812+0000 7f9e77fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e780f6860 0x7f9e7810c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32886/0 (socket says 172.21.15.26:32886) 2021-11-03T18:37:56.817 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.812+0000 7f9e77fff700 1 -- 172.21.15.26:0/1085719214 learned_addr learned my addr 172.21.15.26:0/1085719214 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:37:56.817 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.812+0000 7f9e7cf81700 1 --2- 172.21.15.26:0/1085719214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e780f55c0 0x7f9e78109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:37:56.817 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.812+0000 7f9e77fff700 1 -- 172.21.15.26:0/1085719214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e780f55c0 msgr2=0x7f9e78109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:37:56.817 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.812+0000 7f9e77fff700 1 --2- 172.21.15.26:0/1085719214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e780f55c0 0x7f9e78109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:56.818 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.812+0000 7f9e77fff700 1 -- 172.21.15.26:0/1085719214 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e70005040 con 0x7f9e780f6860 2021-11-03T18:37:56.818 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.812+0000 7f9e77fff700 1 --2- 172.21.15.26:0/1085719214 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e780f6860 0x7f9e7810c170 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 rx=0x7f9e68007fd0 tx=0x7f9e68004ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:37:56.819 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.813+0000 7f9e757fa700 1 -- 172.21.15.26:0/1085719214 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e6800b4f0 con 0x7f9e780f6860 2021-11-03T18:37:56.819 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.813+0000 7f9e757fa700 1 -- 172.21.15.26:0/1085719214 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9e6800f040 con 0x7f9e780f6860 2021-11-03T18:37:56.819 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.813+0000 7f9e757fa700 1 -- 172.21.15.26:0/1085719214 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e68013a50 con 0x7f9e780f6860 2021-11-03T18:37:56.819 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.813+0000 7f9e7f1e5700 1 -- 172.21.15.26:0/1085719214 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e7810c720 con 0x7f9e780f6860 2021-11-03T18:37:56.820 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.813+0000 7f9e7f1e5700 1 -- 172.21.15.26:0/1085719214 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e7810cc90 con 0x7f9e780f6860 2021-11-03T18:37:56.820 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.814+0000 7f9e7f1e5700 1 -- 172.21.15.26:0/1085719214 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e78045ad0 con 0x7f9e780f6860 2021-11-03T18:37:56.821 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.814+0000 7f9e757fa700 1 -- 172.21.15.26:0/1085719214 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f9e6801a030 con 0x7f9e780f6860 2021-11-03T18:37:56.822 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.814+0000 7f9e757fa700 1 --2- 172.21.15.26:0/1085719214 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9e64064090 0x7f9e64066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:37:56.822 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.814+0000 7f9e757fa700 1 -- 172.21.15.26:0/1085719214 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f9e68080710 con 0x7f9e780f6860 2021-11-03T18:37:56.822 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.815+0000 7f9e7cf81700 1 --2- 172.21.15.26:0/1085719214 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9e64064090 0x7f9e64066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:37:56.823 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.815+0000 7f9e7cf81700 1 --2- 172.21.15.26:0/1085719214 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9e64064090 0x7f9e64066550 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7f9e78060060 tx=0x7f9e70009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:37:56.823 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:56.819+0000 7f9e757fa700 1 -- 172.21.15.26:0/1085719214 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f9e68052af0 con 0x7f9e780f6860 2021-11-03T18:37:57.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.052+0000 7f9e7f1e5700 1 -- 172.21.15.26:0/1085719214 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9e78027a00 con 0x7f9e780f6860 2021-11-03T18:37:57.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.052+0000 7f9e757fa700 1 -- 172.21.15.26:0/1085719214 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f9e68018070 con 0x7f9e780f6860 2021-11-03T18:37:57.052 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:37:57.053 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:37:57.053 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:37:57.053 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:37:57.053 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:37:57.053 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:37:57.054 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:37:57.054 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:37:57.054 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:37:57.054 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:37:57.055 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:37:57.055 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:37:57.055 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:37:57.055 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:37:57.056 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:37:57.056 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:37:57.056 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:37:57.056 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:37:57.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.054+0000 7f9e7f1e5700 1 -- 172.21.15.26:0/1085719214 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9e64064090 msgr2=0x7f9e64066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:37:57.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.054+0000 7f9e7f1e5700 1 --2- 172.21.15.26:0/1085719214 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9e64064090 0x7f9e64066550 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7f9e78060060 tx=0x7f9e70009b30).stop 2021-11-03T18:37:57.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.054+0000 7f9e7f1e5700 1 -- 172.21.15.26:0/1085719214 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e780f6860 msgr2=0x7f9e7810c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:37:57.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.054+0000 7f9e7f1e5700 1 --2- 172.21.15.26:0/1085719214 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e780f6860 0x7f9e7810c170 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 rx=0x7f9e68007fd0 tx=0x7f9e68004ee0).stop 2021-11-03T18:37:57.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.054+0000 7f9e7f1e5700 1 -- 172.21.15.26:0/1085719214 shutdown_connections 2021-11-03T18:37:57.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.054+0000 7f9e7f1e5700 1 --2- 172.21.15.26:0/1085719214 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9e64064090 0x7f9e64066550 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:57.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.054+0000 7f9e7f1e5700 1 --2- 172.21.15.26:0/1085719214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e780f55c0 0x7f9e78109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:57.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.054+0000 7f9e7f1e5700 1 --2- 172.21.15.26:0/1085719214 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e780f6860 0x7f9e7810c170 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:57.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.054+0000 7f9e7f1e5700 1 -- 172.21.15.26:0/1085719214 >> 172.21.15.26:0/1085719214 conn(0x7f9e780f0d40 msgr2=0x7f9e780fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:37:57.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.054+0000 7f9e7f1e5700 1 -- 172.21.15.26:0/1085719214 shutdown_connections 2021-11-03T18:37:57.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.054+0000 7f9e7f1e5700 1 -- 172.21.15.26:0/1085719214 wait complete. 2021-11-03T18:37:57.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.154+0000 7fec88dde700 1 -- 172.21.15.26:0/484329374 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec840f9830 msgr2=0x7fec840fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:37:57.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.154+0000 7fec88dde700 1 --2- 172.21.15.26:0/484329374 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec840f9830 0x7fec840fbc80 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 rx=0x7fec78004660 tx=0x7fec78009b30).stop 2021-11-03T18:37:57.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.154+0000 7fec88dde700 1 -- 172.21.15.26:0/484329374 shutdown_connections 2021-11-03T18:37:57.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.154+0000 7fec88dde700 1 --2- 172.21.15.26:0/484329374 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec840f9830 0x7fec840fbc80 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:57.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.154+0000 7fec88dde700 1 --2- 172.21.15.26:0/484329374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec84060270 0x7fec840f9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:57.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.154+0000 7fec88dde700 1 -- 172.21.15.26:0/484329374 >> 172.21.15.26:0/484329374 conn(0x7fec840f0d40 msgr2=0x7fec840f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:37:57.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.154+0000 7fec88dde700 1 -- 172.21.15.26:0/484329374 shutdown_connections 2021-11-03T18:37:57.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.154+0000 7fec88dde700 1 -- 172.21.15.26:0/484329374 wait complete. 2021-11-03T18:37:57.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.155+0000 7fec88dde700 1 Processor -- start 2021-11-03T18:37:57.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.155+0000 7fec88dde700 1 -- start start 2021-11-03T18:37:57.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.155+0000 7fec88dde700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec84060270 0x7fec84106ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:37:57.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.155+0000 7fec88dde700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec840f9830 0x7fec841073b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:37:57.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.155+0000 7fec88dde700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec84107960 con 0x7fec840f9830 2021-11-03T18:37:57.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.155+0000 7fec88dde700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec84107aa0 con 0x7fec84060270 2021-11-03T18:37:57.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.155+0000 7fec81d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec840f9830 0x7fec841073b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:37:57.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.155+0000 7fec81d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec840f9830 0x7fec841073b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32896/0 (socket says 172.21.15.26:32896) 2021-11-03T18:37:57.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.155+0000 7fec81d9b700 1 -- 172.21.15.26:0/1861695585 learned_addr learned my addr 172.21.15.26:0/1861695585 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:37:57.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.155+0000 7fec8259c700 1 --2- 172.21.15.26:0/1861695585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec84060270 0x7fec84106ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:37:57.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.155+0000 7fec81d9b700 1 -- 172.21.15.26:0/1861695585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec84060270 msgr2=0x7fec84106ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:37:57.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.155+0000 7fec81d9b700 1 --2- 172.21.15.26:0/1861695585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec84060270 0x7fec84106ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:57.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.155+0000 7fec81d9b700 1 -- 172.21.15.26:0/1861695585 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec78005040 con 0x7fec840f9830 2021-11-03T18:37:57.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.155+0000 7fec81d9b700 1 --2- 172.21.15.26:0/1861695585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec840f9830 0x7fec841073b0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 rx=0x7fec78013a70 tx=0x7fec78009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:37:57.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.156+0000 7fec72ffd700 1 -- 172.21.15.26:0/1861695585 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec78018070 con 0x7fec840f9830 2021-11-03T18:37:57.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.156+0000 7fec72ffd700 1 -- 172.21.15.26:0/1861695585 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fec78007ba0 con 0x7fec840f9830 2021-11-03T18:37:57.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.156+0000 7fec88dde700 1 -- 172.21.15.26:0/1861695585 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec841083e0 con 0x7fec840f9830 2021-11-03T18:37:57.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.156+0000 7fec72ffd700 1 -- 172.21.15.26:0/1861695585 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec7801c3c0 con 0x7fec840f9830 2021-11-03T18:37:57.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.156+0000 7fec88dde700 1 -- 172.21.15.26:0/1861695585 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec84108940 con 0x7fec840f9830 2021-11-03T18:37:57.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.156+0000 7fec88dde700 1 -- 172.21.15.26:0/1861695585 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec84045ad0 con 0x7fec840f9830 2021-11-03T18:37:57.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.157+0000 7fec72ffd700 1 -- 172.21.15.26:0/1861695585 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fec7801d420 con 0x7fec840f9830 2021-11-03T18:37:57.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.157+0000 7fec72ffd700 1 --2- 172.21.15.26:0/1861695585 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fec6c0640b0 0x7fec6c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:37:57.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.157+0000 7fec72ffd700 1 -- 172.21.15.26:0/1861695585 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fec78082590 con 0x7fec840f9830 2021-11-03T18:37:57.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.157+0000 7fec8259c700 1 --2- 172.21.15.26:0/1861695585 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fec6c0640b0 0x7fec6c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:37:57.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.158+0000 7fec8259c700 1 --2- 172.21.15.26:0/1861695585 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fec6c0640b0 0x7fec6c066570 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7fec7c007df0 tx=0x7fec7c004d80).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:37:57.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.161+0000 7fec72ffd700 1 -- 172.21.15.26:0/1861695585 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fec780549b0 con 0x7fec840f9830 2021-11-03T18:37:57.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.365+0000 7fec88dde700 1 -- 172.21.15.26:0/1861695585 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fec84027a00 con 0x7fec840f9830 2021-11-03T18:37:57.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.365+0000 7fec72ffd700 1 -- 172.21.15.26:0/1861695585 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fec780545a0 con 0x7fec840f9830 2021-11-03T18:37:57.367 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:37:57.368 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:37:57.368 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:37:57.368 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:37:57.368 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:37:57.369 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:37:57.369 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:37:57.369 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:37:57.369 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:37:57.369 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:37:57.370 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:37:57.370 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:37:57.371 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:37:57.371 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:37:57.371 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:37:57.371 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:37:57.371 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:37:57.372 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:37:57.372 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:37:57.372 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:37:57.372 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:37:57.373 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:37:57.373 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:37:57.373 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:37:57.374 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:37:57.374 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:37:57.374 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:37:57.374 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:37:57.375 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:37:57.375 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:37:57.375 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:37:57.376 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:37:57.376 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:37:57.376 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:37:57.377 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:37:57.377 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:37:57.377 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:37:57.378 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:37:57.378 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:37:57.379 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.367+0000 7fec88dde700 1 -- 172.21.15.26:0/1861695585 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fec6c0640b0 msgr2=0x7fec6c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:37:57.379 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.367+0000 7fec88dde700 1 --2- 172.21.15.26:0/1861695585 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fec6c0640b0 0x7fec6c066570 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7fec7c007df0 tx=0x7fec7c004d80).stop 2021-11-03T18:37:57.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.367+0000 7fec88dde700 1 -- 172.21.15.26:0/1861695585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec840f9830 msgr2=0x7fec841073b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:37:57.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.367+0000 7fec88dde700 1 --2- 172.21.15.26:0/1861695585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec840f9830 0x7fec841073b0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 rx=0x7fec78013a70 tx=0x7fec78009b30).stop 2021-11-03T18:37:57.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.367+0000 7fec88dde700 1 -- 172.21.15.26:0/1861695585 shutdown_connections 2021-11-03T18:37:57.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.367+0000 7fec88dde700 1 --2- 172.21.15.26:0/1861695585 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fec6c0640b0 0x7fec6c066570 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:57.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.367+0000 7fec88dde700 1 --2- 172.21.15.26:0/1861695585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec84060270 0x7fec84106ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:57.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.367+0000 7fec88dde700 1 --2- 172.21.15.26:0/1861695585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fec840f9830 0x7fec841073b0 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:37:57.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.367+0000 7fec88dde700 1 -- 172.21.15.26:0/1861695585 >> 172.21.15.26:0/1861695585 conn(0x7fec840f0d40 msgr2=0x7fec840f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:37:57.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.367+0000 7fec88dde700 1 -- 172.21.15.26:0/1861695585 shutdown_connections 2021-11-03T18:37:57.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:37:57.367+0000 7fec88dde700 1 -- 172.21.15.26:0/1861695585 wait complete. 2021-11-03T18:37:57.382 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:37:57.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:57 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:37:57.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:57 smithi026 ceph-mon[96795]: pgmap v3098: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:57.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:57 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1085719214' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:37:57.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:57 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:37:57.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:57 smithi194 ceph-mon[65619]: pgmap v3098: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:57.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:57 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1085719214' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:37:58.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:58 smithi026 ceph-mon[96795]: from='client.37324 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:37:58.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:58 smithi026 ceph-mon[96795]: from='client.37328 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:37:58.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:58 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1861695585' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:37:58.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:58 smithi194 ceph-mon[65619]: from='client.37324 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:37:58.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:58 smithi194 ceph-mon[65619]: from='client.37328 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:37:58.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:58 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1861695585' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:37:59.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:37:59 smithi026 ceph-mon[96795]: pgmap v3099: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:37:59.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:37:59 smithi194 ceph-mon[65619]: pgmap v3099: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:01.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:01 smithi026 ceph-mon[96795]: pgmap v3100: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:01.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:01 smithi194 ceph-mon[65619]: pgmap v3100: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:03.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:03 smithi026 ceph-mon[96795]: pgmap v3101: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:03.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:03 smithi194 ceph-mon[65619]: pgmap v3101: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:05.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:05 smithi026 ceph-mon[96795]: pgmap v3102: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:05.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:05 smithi194 ceph-mon[65619]: pgmap v3102: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:07.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:07 smithi026 ceph-mon[96795]: pgmap v3103: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:07.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:07 smithi194 ceph-mon[65619]: pgmap v3103: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:09.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:09 smithi026 ceph-mon[96795]: pgmap v3104: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:09.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:09 smithi194 ceph-mon[65619]: pgmap v3104: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:11.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:11 smithi026 ceph-mon[96795]: pgmap v3105: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:11.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:11 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:38:11.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:11 smithi194 ceph-mon[65619]: pgmap v3105: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:11.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:11 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:38:12.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:12 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:38:12.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:12 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:38:13.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:13 smithi026 ceph-mon[96795]: pgmap v3106: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:13.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:13 smithi194 ceph-mon[65619]: pgmap v3106: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:15.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:15 smithi026 ceph-mon[96795]: pgmap v3107: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:15.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:15 smithi194 ceph-mon[65619]: pgmap v3107: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:17.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:17 smithi026 ceph-mon[96795]: pgmap v3108: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:17.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:17 smithi194 ceph-mon[65619]: pgmap v3108: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:19.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:19 smithi026 ceph-mon[96795]: pgmap v3109: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:19.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:19 smithi194 ceph-mon[65619]: pgmap v3109: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:21.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:21 smithi026 ceph-mon[96795]: pgmap v3110: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:21.558 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:21 smithi194 ceph-mon[65619]: pgmap v3110: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:23.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:23 smithi026 ceph-mon[96795]: pgmap v3111: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:23.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:23 smithi194 ceph-mon[65619]: pgmap v3111: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:25.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:25 smithi026 ceph-mon[96795]: pgmap v3112: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:25.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:25 smithi194 ceph-mon[65619]: pgmap v3112: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:26.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:26 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:38:26.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:26 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:38:27.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:27 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:38:27.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:27 smithi026 ceph-mon[96795]: pgmap v3113: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:27.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.483+0000 7f2ad74f4700 1 -- 172.21.15.26:0/342987630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ad00f6ff0 msgr2=0x7f2ad00f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:38:27.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.484+0000 7f2ad74f4700 1 --2- 172.21.15.26:0/342987630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ad00f6ff0 0x7f2ad00f7a20 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 rx=0x7f2ac0004660 tx=0x7f2ac0009b30).stop 2021-11-03T18:38:27.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.484+0000 7f2ad74f4700 1 -- 172.21.15.26:0/342987630 shutdown_connections 2021-11-03T18:38:27.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.484+0000 7f2ad74f4700 1 --2- 172.21.15.26:0/342987630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ad00f6ff0 0x7f2ad00f7a20 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:27.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.484+0000 7f2ad74f4700 1 --2- 172.21.15.26:0/342987630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ad00f66e0 0x7f2ad00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:27.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.484+0000 7f2ad74f4700 1 -- 172.21.15.26:0/342987630 >> 172.21.15.26:0/342987630 conn(0x7f2ad00f1f00 msgr2=0x7f2ad00f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:38:27.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.484+0000 7f2ad74f4700 1 -- 172.21.15.26:0/342987630 shutdown_connections 2021-11-03T18:38:27.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.484+0000 7f2ad74f4700 1 -- 172.21.15.26:0/342987630 wait complete. 2021-11-03T18:38:27.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.484+0000 7f2ad74f4700 1 Processor -- start 2021-11-03T18:38:27.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.484+0000 7f2ad74f4700 1 -- start start 2021-11-03T18:38:27.486 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.485+0000 7f2ad74f4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ad00f66e0 0x7f2ad006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:38:27.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.485+0000 7f2ad74f4700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ad00f6ff0 0x7f2ad0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:38:27.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.485+0000 7f2ad74f4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad006a380 con 0x7f2ad00f66e0 2021-11-03T18:38:27.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.485+0000 7f2ad74f4700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad006a4c0 con 0x7f2ad00f6ff0 2021-11-03T18:38:27.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.485+0000 7f2ad5290700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ad00f66e0 0x7f2ad006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:38:27.487 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.485+0000 7f2ad5290700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ad00f66e0 0x7f2ad006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32912/0 (socket says 172.21.15.26:32912) 2021-11-03T18:38:27.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.485+0000 7f2ad5290700 1 -- 172.21.15.26:0/4025700651 learned_addr learned my addr 172.21.15.26:0/4025700651 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:38:27.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.485+0000 7f2ad4a8f700 1 --2- 172.21.15.26:0/4025700651 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ad00f6ff0 0x7f2ad0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:38:27.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.485+0000 7f2ad5290700 1 -- 172.21.15.26:0/4025700651 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ad00f6ff0 msgr2=0x7f2ad0069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:38:27.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.485+0000 7f2ad5290700 1 --2- 172.21.15.26:0/4025700651 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ad00f6ff0 0x7f2ad0069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:27.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.485+0000 7f2ad5290700 1 -- 172.21.15.26:0/4025700651 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac0005040 con 0x7f2ad00f66e0 2021-11-03T18:38:27.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.485+0000 7f2ad4a8f700 1 --2- 172.21.15.26:0/4025700651 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ad00f6ff0 0x7f2ad0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:38:27.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.485+0000 7f2ad5290700 1 --2- 172.21.15.26:0/4025700651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ad00f66e0 0x7f2ad006b9a0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 rx=0x7f2acc0026d0 tx=0x7f2acc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:38:27.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.485+0000 7f2ac5ffb700 1 -- 172.21.15.26:0/4025700651 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2acc009320 con 0x7f2ad00f66e0 2021-11-03T18:38:27.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.485+0000 7f2ac5ffb700 1 -- 172.21.15.26:0/4025700651 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2acc00f040 con 0x7f2ad00f66e0 2021-11-03T18:38:27.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.485+0000 7f2ac5ffb700 1 -- 172.21.15.26:0/4025700651 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2acc0147e0 con 0x7f2ad00f66e0 2021-11-03T18:38:27.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.485+0000 7f2ad74f4700 1 -- 172.21.15.26:0/4025700651 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad006a7a0 con 0x7f2ad00f66e0 2021-11-03T18:38:27.490 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.486+0000 7f2ad74f4700 1 -- 172.21.15.26:0/4025700651 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad010efa0 con 0x7f2ad00f66e0 2021-11-03T18:38:27.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.487+0000 7f2ad74f4700 1 -- 172.21.15.26:0/4025700651 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad0045ad0 con 0x7f2ad00f66e0 2021-11-03T18:38:27.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.487+0000 7f2ac5ffb700 1 -- 172.21.15.26:0/4025700651 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f2acc009480 con 0x7f2ad00f66e0 2021-11-03T18:38:27.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.487+0000 7f2ac5ffb700 1 --2- 172.21.15.26:0/4025700651 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2abc0640b0 0x7f2abc066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:38:27.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.488+0000 7f2ac5ffb700 1 -- 172.21.15.26:0/4025700651 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f2acc080ec0 con 0x7f2ad00f66e0 2021-11-03T18:38:27.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.488+0000 7f2ad4a8f700 1 --2- 172.21.15.26:0/4025700651 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2abc0640b0 0x7f2abc066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:38:27.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.488+0000 7f2ad4a8f700 1 --2- 172.21.15.26:0/4025700651 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2abc0640b0 0x7f2abc066570 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7f2ac0004630 tx=0x7f2ac0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:38:27.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.492+0000 7f2ac5ffb700 1 -- 172.21.15.26:0/4025700651 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f2acc053220 con 0x7f2ad00f66e0 2021-11-03T18:38:27.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:27 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:38:27.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:27 smithi194 ceph-mon[65619]: pgmap v3113: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:27.667 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.669+0000 7f2ad74f4700 1 -- 172.21.15.26:0/4025700651 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ad0057f10 con 0x7f2abc0640b0 2021-11-03T18:38:27.668 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.670+0000 7f2ac5ffb700 1 -- 172.21.15.26:0/4025700651 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f2ad0057f10 con 0x7f2abc0640b0 2021-11-03T18:38:27.670 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.672+0000 7f2ad74f4700 1 -- 172.21.15.26:0/4025700651 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2abc0640b0 msgr2=0x7f2abc066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:38:27.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.672+0000 7f2ad74f4700 1 --2- 172.21.15.26:0/4025700651 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2abc0640b0 0x7f2abc066570 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7f2ac0004630 tx=0x7f2ac0009b30).stop 2021-11-03T18:38:27.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.672+0000 7f2ad74f4700 1 -- 172.21.15.26:0/4025700651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ad00f66e0 msgr2=0x7f2ad006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:38:27.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.672+0000 7f2ad74f4700 1 --2- 172.21.15.26:0/4025700651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ad00f66e0 0x7f2ad006b9a0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 rx=0x7f2acc0026d0 tx=0x7f2acc009de0).stop 2021-11-03T18:38:27.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.672+0000 7f2ad74f4700 1 -- 172.21.15.26:0/4025700651 shutdown_connections 2021-11-03T18:38:27.671 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.672+0000 7f2ad74f4700 1 --2- 172.21.15.26:0/4025700651 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2abc0640b0 0x7f2abc066570 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:27.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.672+0000 7f2ad74f4700 1 --2- 172.21.15.26:0/4025700651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ad00f66e0 0x7f2ad006b9a0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:27.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.672+0000 7f2ad74f4700 1 --2- 172.21.15.26:0/4025700651 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ad00f6ff0 0x7f2ad0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:27.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.672+0000 7f2ad74f4700 1 -- 172.21.15.26:0/4025700651 >> 172.21.15.26:0/4025700651 conn(0x7f2ad00f1f00 msgr2=0x7f2ad00fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:38:27.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.672+0000 7f2ad74f4700 1 -- 172.21.15.26:0/4025700651 shutdown_connections 2021-11-03T18:38:27.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.672+0000 7f2ad74f4700 1 -- 172.21.15.26:0/4025700651 wait complete. 2021-11-03T18:38:27.680 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:38:27.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.772+0000 7fb289e09700 1 -- 172.21.15.26:0/1401246950 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb284060270 msgr2=0x7fb2840f91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:38:27.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.772+0000 7fb289e09700 1 --2- 172.21.15.26:0/1401246950 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb284060270 0x7fb2840f91c0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 rx=0x7fb278004660 tx=0x7fb278009b30).stop 2021-11-03T18:38:27.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.772+0000 7fb289e09700 1 -- 172.21.15.26:0/1401246950 shutdown_connections 2021-11-03T18:38:27.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.772+0000 7fb289e09700 1 --2- 172.21.15.26:0/1401246950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2840f96b0 0x7fb2840fbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:27.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.772+0000 7fb289e09700 1 --2- 172.21.15.26:0/1401246950 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb284060270 0x7fb2840f91c0 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:27.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.772+0000 7fb289e09700 1 -- 172.21.15.26:0/1401246950 >> 172.21.15.26:0/1401246950 conn(0x7fb2840f0ba0 msgr2=0x7fb2840f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:38:27.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.772+0000 7fb289e09700 1 -- 172.21.15.26:0/1401246950 shutdown_connections 2021-11-03T18:38:27.774 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.772+0000 7fb289e09700 1 -- 172.21.15.26:0/1401246950 wait complete. 2021-11-03T18:38:27.774 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.773+0000 7fb289e09700 1 Processor -- start 2021-11-03T18:38:27.774 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.773+0000 7fb289e09700 1 -- start start 2021-11-03T18:38:27.774 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.773+0000 7fb289e09700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb284060270 0x7fb284106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:38:27.775 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.773+0000 7fb289e09700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2840f96b0 0x7fb284107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:38:27.775 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.773+0000 7fb289e09700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb284107910 con 0x7fb284060270 2021-11-03T18:38:27.775 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.773+0000 7fb289e09700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb284108120 con 0x7fb2840f96b0 2021-11-03T18:38:27.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.773+0000 7fb288e07700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb284060270 0x7fb284106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:38:27.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.773+0000 7fb288e07700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb284060270 0x7fb284106e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32922/0 (socket says 172.21.15.26:32922) 2021-11-03T18:38:27.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.773+0000 7fb288e07700 1 -- 172.21.15.26:0/3330925605 learned_addr learned my addr 172.21.15.26:0/3330925605 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:38:27.777 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.774+0000 7fb288e07700 1 -- 172.21.15.26:0/3330925605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2840f96b0 msgr2=0x7fb284107310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:38:27.777 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.774+0000 7fb288e07700 1 --2- 172.21.15.26:0/3330925605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2840f96b0 0x7fb284107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:38:27.777 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.774+0000 7fb288e07700 1 -- 172.21.15.26:0/3330925605 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb278005040 con 0x7fb284060270 2021-11-03T18:38:27.777 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.774+0000 7fb288e07700 1 --2- 172.21.15.26:0/3330925605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb284060270 0x7fb284106e20 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 rx=0x7fb278009990 tx=0x7fb278009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:38:27.778 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.774+0000 7fb2817fa700 1 -- 172.21.15.26:0/3330925605 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb278018070 con 0x7fb284060270 2021-11-03T18:38:27.778 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.774+0000 7fb289e09700 1 -- 172.21.15.26:0/3330925605 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb284108340 con 0x7fb284060270 2021-11-03T18:38:27.778 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.774+0000 7fb2817fa700 1 -- 172.21.15.26:0/3330925605 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb278007ba0 con 0x7fb284060270 2021-11-03T18:38:27.778 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.774+0000 7fb2817fa700 1 -- 172.21.15.26:0/3330925605 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb27801c3c0 con 0x7fb284060270 2021-11-03T18:38:27.778 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.774+0000 7fb289e09700 1 -- 172.21.15.26:0/3330925605 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2841088a0 con 0x7fb284060270 2021-11-03T18:38:27.780 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.775+0000 7fb289e09700 1 -- 172.21.15.26:0/3330925605 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb284059100 con 0x7fb284060270 2021-11-03T18:38:27.780 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.775+0000 7fb2817fa700 1 -- 172.21.15.26:0/3330925605 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fb27801d420 con 0x7fb284060270 2021-11-03T18:38:27.780 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.776+0000 7fb2817fa700 1 --2- 172.21.15.26:0/3330925605 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb274064100 0x7fb2740665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:38:27.780 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.776+0000 7fb2817fa700 1 -- 172.21.15.26:0/3330925605 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fb2780825e0 con 0x7fb284060270 2021-11-03T18:38:27.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.776+0000 7fb283fff700 1 --2- 172.21.15.26:0/3330925605 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb274064100 0x7fb2740665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:38:27.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.776+0000 7fb283fff700 1 --2- 172.21.15.26:0/3330925605 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb274064100 0x7fb2740665c0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7fb284060040 tx=0x7fb2700099e0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:38:27.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.780+0000 7fb2817fa700 1 -- 172.21.15.26:0/3330925605 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fb278054940 con 0x7fb284060270 2021-11-03T18:38:27.952 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.953+0000 7fb289e09700 1 -- 172.21.15.26:0/3330925605 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2840feda0 con 0x7fb274064100 2021-11-03T18:38:27.966 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.968+0000 7fb2817fa700 1 -- 172.21.15.26:0/3330925605 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7fb2840feda0 con 0x7fb274064100 2021-11-03T18:38:27.966 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:38:27.967 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (109m) 7m ago 110m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:38:27.967 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (101m) 7m ago 110m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:38:27.967 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (101m) 6m ago 110m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:38:27.967 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (109m) 7m ago 110m 42.3M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:38:27.968 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (102m) 7m ago 106m 26.2M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:38:27.968 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (103m) 7m ago 105m 26.8M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:38:27.968 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (106m) 6m ago 106m 27.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:38:27.968 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (106m) 6m ago 106m 27.4M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:38:27.969 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (103m) 7m ago 112m 601M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:38:27.969 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (103m) 6m ago 110m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:38:27.969 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (102m) 7m ago 112m 374M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:38:27.969 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (102m) 6m ago 110m 171M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:38:27.969 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (110m) 7m ago 110m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:38:27.970 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (109m) 6m ago 109m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:38:27.970 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (101m) 7m ago 109m 352M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:38:27.970 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (101m) 7m ago 108m 379M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:38:27.970 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (100m) 7m ago 108m 314M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:38:27.971 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (100m) 6m ago 108m 413M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:38:27.971 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (99m) 6m ago 107m 339M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:38:27.971 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (99m) 6m ago 107m 337M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:38:27.971 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (109m) 7m ago 110m 68.0M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:38:27.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.970+0000 7fb289e09700 1 -- 172.21.15.26:0/3330925605 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb274064100 msgr2=0x7fb2740665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:38:27.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.970+0000 7fb289e09700 1 --2- 172.21.15.26:0/3330925605 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb274064100 0x7fb2740665c0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7fb284060040 tx=0x7fb2700099e0).stop 2021-11-03T18:38:27.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.970+0000 7fb289e09700 1 -- 172.21.15.26:0/3330925605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb284060270 msgr2=0x7fb284106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:38:27.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.970+0000 7fb289e09700 1 --2- 172.21.15.26:0/3330925605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb284060270 0x7fb284106e20 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 rx=0x7fb278009990 tx=0x7fb278009b30).stop 2021-11-03T18:38:27.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.970+0000 7fb289e09700 1 -- 172.21.15.26:0/3330925605 shutdown_connections 2021-11-03T18:38:27.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.970+0000 7fb289e09700 1 --2- 172.21.15.26:0/3330925605 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb274064100 0x7fb2740665c0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:27.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.970+0000 7fb289e09700 1 --2- 172.21.15.26:0/3330925605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb284060270 0x7fb284106e20 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:27.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.970+0000 7fb289e09700 1 --2- 172.21.15.26:0/3330925605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2840f96b0 0x7fb284107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:38:27.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.970+0000 7fb289e09700 1 -- 172.21.15.26:0/3330925605 >> 172.21.15.26:0/3330925605 conn(0x7fb2840f0ba0 msgr2=0x7fb2840f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:38:27.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.970+0000 7fb289e09700 1 -- 172.21.15.26:0/3330925605 shutdown_connections 2021-11-03T18:38:27.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:27.970+0000 7fb289e09700 1 -- 172.21.15.26:0/3330925605 wait complete. 2021-11-03T18:38:28.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.069+0000 7f82ed486700 1 -- 172.21.15.26:0/2541065988 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82e80f51a0 msgr2=0x7f82e80f7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:38:28.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.069+0000 7f82ed486700 1 --2- 172.21.15.26:0/2541065988 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82e80f51a0 0x7f82e80f7920 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 rx=0x7f82d8004660 tx=0x7f82d8009b30).stop 2021-11-03T18:38:28.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.069+0000 7f82ed486700 1 -- 172.21.15.26:0/2541065988 shutdown_connections 2021-11-03T18:38:28.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.069+0000 7f82ed486700 1 --2- 172.21.15.26:0/2541065988 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82e80f51a0 0x7f82e80f7920 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:28.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.069+0000 7f82ed486700 1 --2- 172.21.15.26:0/2541065988 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82e80f4800 0x7f82e80f4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:28.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.069+0000 7f82ed486700 1 -- 172.21.15.26:0/2541065988 >> 172.21.15.26:0/2541065988 conn(0x7f82e80f0320 msgr2=0x7f82e80f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:38:28.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.069+0000 7f82ed486700 1 -- 172.21.15.26:0/2541065988 shutdown_connections 2021-11-03T18:38:28.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.069+0000 7f82ed486700 1 -- 172.21.15.26:0/2541065988 wait complete. 2021-11-03T18:38:28.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.070+0000 7f82ed486700 1 Processor -- start 2021-11-03T18:38:28.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.070+0000 7f82ed486700 1 -- start start 2021-11-03T18:38:28.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.070+0000 7f82ed486700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82e80f4800 0x7f82e8106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:38:28.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.070+0000 7f82ed486700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82e80f51a0 0x7f82e8107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:38:28.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.070+0000 7f82ed486700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e8107870 con 0x7f82e80f51a0 2021-11-03T18:38:28.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.070+0000 7f82ed486700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e8108080 con 0x7f82e80f4800 2021-11-03T18:38:28.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.070+0000 7f82e77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82e80f51a0 0x7f82e8107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:38:28.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.070+0000 7f82e77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82e80f51a0 0x7f82e8107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32934/0 (socket says 172.21.15.26:32934) 2021-11-03T18:38:28.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.070+0000 7f82e77fe700 1 -- 172.21.15.26:0/6669937 learned_addr learned my addr 172.21.15.26:0/6669937 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:38:28.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.071+0000 7f82e7fff700 1 --2- 172.21.15.26:0/6669937 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82e80f4800 0x7f82e8106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:38:28.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.071+0000 7f82e77fe700 1 -- 172.21.15.26:0/6669937 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82e80f4800 msgr2=0x7f82e8106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:38:28.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.071+0000 7f82e77fe700 1 --2- 172.21.15.26:0/6669937 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82e80f4800 0x7f82e8106d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:28.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.071+0000 7f82e77fe700 1 -- 172.21.15.26:0/6669937 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d8005040 con 0x7f82e80f51a0 2021-11-03T18:38:28.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.071+0000 7f82e77fe700 1 --2- 172.21.15.26:0/6669937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82e80f51a0 0x7f82e8107270 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 rx=0x7f82d8014040 tx=0x7f82d800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:38:28.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.071+0000 7f82e4ff9700 1 -- 172.21.15.26:0/6669937 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82d8019070 con 0x7f82e80f51a0 2021-11-03T18:38:28.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.071+0000 7f82e4ff9700 1 -- 172.21.15.26:0/6669937 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f82d8007e70 con 0x7f82e80f51a0 2021-11-03T18:38:28.075 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.071+0000 7f82ed486700 1 -- 172.21.15.26:0/6669937 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e81082a0 con 0x7f82e80f51a0 2021-11-03T18:38:28.075 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.071+0000 7f82e4ff9700 1 -- 172.21.15.26:0/6669937 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82d8014d10 con 0x7f82e80f51a0 2021-11-03T18:38:28.075 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.071+0000 7f82ed486700 1 -- 172.21.15.26:0/6669937 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e8108800 con 0x7f82e80f51a0 2021-11-03T18:38:28.076 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.072+0000 7f82ed486700 1 -- 172.21.15.26:0/6669937 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e8059100 con 0x7f82e80f51a0 2021-11-03T18:38:28.076 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.072+0000 7f82e4ff9700 1 -- 172.21.15.26:0/6669937 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f82d8025070 con 0x7f82e80f51a0 2021-11-03T18:38:28.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.073+0000 7f82e4ff9700 1 --2- 172.21.15.26:0/6669937 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f82d0064100 0x7f82d00665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:38:28.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.073+0000 7f82e4ff9700 1 -- 172.21.15.26:0/6669937 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f82d80817b0 con 0x7f82e80f51a0 2021-11-03T18:38:28.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.073+0000 7f82e7fff700 1 --2- 172.21.15.26:0/6669937 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f82d0064100 0x7f82d00665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:38:28.078 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.073+0000 7f82e7fff700 1 --2- 172.21.15.26:0/6669937 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f82d0064100 0x7f82d00665c0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7f82e8106af0 tx=0x7f82dc00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:38:28.078 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.077+0000 7f82e4ff9700 1 -- 172.21.15.26:0/6669937 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f82d8053b10 con 0x7f82e80f51a0 2021-11-03T18:38:28.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.307+0000 7f82ed486700 1 -- 172.21.15.26:0/6669937 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f82e80feeb0 con 0x7f82e80f51a0 2021-11-03T18:38:28.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.308+0000 7f82e4ff9700 1 -- 172.21.15.26:0/6669937 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f82d80232e0 con 0x7f82e80f51a0 2021-11-03T18:38:28.306 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:38:28.307 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:38:28.307 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:38:28.307 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:38:28.307 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:38:28.308 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:38:28.308 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:38:28.308 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:38:28.308 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:38:28.309 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:38:28.309 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:38:28.309 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:38:28.309 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:38:28.310 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:38:28.310 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:38:28.310 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:38:28.310 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:38:28.311 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:38:28.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.310+0000 7f82ed486700 1 -- 172.21.15.26:0/6669937 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f82d0064100 msgr2=0x7f82d00665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:38:28.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.310+0000 7f82ed486700 1 --2- 172.21.15.26:0/6669937 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f82d0064100 0x7f82d00665c0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7f82e8106af0 tx=0x7f82dc00b040).stop 2021-11-03T18:38:28.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.310+0000 7f82ed486700 1 -- 172.21.15.26:0/6669937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82e80f51a0 msgr2=0x7f82e8107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:38:28.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.310+0000 7f82ed486700 1 --2- 172.21.15.26:0/6669937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82e80f51a0 0x7f82e8107270 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 rx=0x7f82d8014040 tx=0x7f82d800b040).stop 2021-11-03T18:38:28.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.310+0000 7f82ed486700 1 -- 172.21.15.26:0/6669937 shutdown_connections 2021-11-03T18:38:28.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.310+0000 7f82ed486700 1 --2- 172.21.15.26:0/6669937 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f82d0064100 0x7f82d00665c0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:28.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.310+0000 7f82ed486700 1 --2- 172.21.15.26:0/6669937 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82e80f4800 0x7f82e8106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:28.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.310+0000 7f82ed486700 1 --2- 172.21.15.26:0/6669937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82e80f51a0 0x7f82e8107270 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:28.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.310+0000 7f82ed486700 1 -- 172.21.15.26:0/6669937 >> 172.21.15.26:0/6669937 conn(0x7f82e80f0320 msgr2=0x7f82e80fb370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:38:28.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.310+0000 7f82ed486700 1 -- 172.21.15.26:0/6669937 shutdown_connections 2021-11-03T18:38:28.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.310+0000 7f82ed486700 1 -- 172.21.15.26:0/6669937 wait complete. 2021-11-03T18:38:28.410 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.410+0000 7fae0909d700 1 -- 172.21.15.26:0/2615600271 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae040f66e0 msgr2=0x7fae040f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:38:28.411 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.410+0000 7fae0909d700 1 --2- 172.21.15.26:0/2615600271 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae040f66e0 0x7fae040f6b00 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 rx=0x7fadf4004660 tx=0x7fadf4009b30).stop 2021-11-03T18:38:28.411 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.410+0000 7fae0909d700 1 -- 172.21.15.26:0/2615600271 shutdown_connections 2021-11-03T18:38:28.411 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.410+0000 7fae0909d700 1 --2- 172.21.15.26:0/2615600271 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae040f7980 0x7fae040f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:28.411 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.410+0000 7fae0909d700 1 --2- 172.21.15.26:0/2615600271 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae040f66e0 0x7fae040f6b00 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:28.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.410+0000 7fae0909d700 1 -- 172.21.15.26:0/2615600271 >> 172.21.15.26:0/2615600271 conn(0x7fae040f1e40 msgr2=0x7fae040f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:38:28.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.410+0000 7fae0909d700 1 -- 172.21.15.26:0/2615600271 shutdown_connections 2021-11-03T18:38:28.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.410+0000 7fae0909d700 1 -- 172.21.15.26:0/2615600271 wait complete. 2021-11-03T18:38:28.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.411+0000 7fae0909d700 1 Processor -- start 2021-11-03T18:38:28.413 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.411+0000 7fae0909d700 1 -- start start 2021-11-03T18:38:28.413 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.411+0000 7fae0909d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae040f66e0 0x7fae04106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:38:28.413 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.411+0000 7fae0909d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae040f7980 0x7fae041074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:38:28.413 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.411+0000 7fae0909d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae04107a50 con 0x7fae040f66e0 2021-11-03T18:38:28.414 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.411+0000 7fae0909d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae04107b90 con 0x7fae040f7980 2021-11-03T18:38:28.414 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.411+0000 7fae02d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae040f66e0 0x7fae04106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:38:28.414 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.411+0000 7fae02d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae040f66e0 0x7fae04106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32942/0 (socket says 172.21.15.26:32942) 2021-11-03T18:38:28.414 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.411+0000 7fae02d9d700 1 -- 172.21.15.26:0/505851072 learned_addr learned my addr 172.21.15.26:0/505851072 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:38:28.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.412+0000 7fae0259c700 1 --2- 172.21.15.26:0/505851072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae040f7980 0x7fae041074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:38:28.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.412+0000 7fae02d9d700 1 -- 172.21.15.26:0/505851072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae040f7980 msgr2=0x7fae041074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:38:28.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.412+0000 7fae02d9d700 1 --2- 172.21.15.26:0/505851072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae040f7980 0x7fae041074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:28.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.412+0000 7fae02d9d700 1 -- 172.21.15.26:0/505851072 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf4005040 con 0x7fae040f66e0 2021-11-03T18:38:28.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.412+0000 7fae02d9d700 1 --2- 172.21.15.26:0/505851072 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae040f66e0 0x7fae04106fb0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 rx=0x7fadf4000c00 tx=0x7fadf4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:38:28.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.412+0000 7fadeb7fe700 1 -- 172.21.15.26:0/505851072 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadf4018070 con 0x7fae040f66e0 2021-11-03T18:38:28.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.412+0000 7fadeb7fe700 1 -- 172.21.15.26:0/505851072 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fadf4007d70 con 0x7fae040f66e0 2021-11-03T18:38:28.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.412+0000 7fae0909d700 1 -- 172.21.15.26:0/505851072 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae041084d0 con 0x7fae040f66e0 2021-11-03T18:38:28.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.412+0000 7fae0909d700 1 -- 172.21.15.26:0/505851072 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae04108a30 con 0x7fae040f66e0 2021-11-03T18:38:28.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.412+0000 7fadeb7fe700 1 -- 172.21.15.26:0/505851072 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadf401c620 con 0x7fae040f66e0 2021-11-03T18:38:28.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.413+0000 7fae0909d700 1 -- 172.21.15.26:0/505851072 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae04045ad0 con 0x7fae040f66e0 2021-11-03T18:38:28.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.413+0000 7fadeb7fe700 1 -- 172.21.15.26:0/505851072 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fadf401c860 con 0x7fae040f66e0 2021-11-03T18:38:28.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.414+0000 7fadeb7fe700 1 --2- 172.21.15.26:0/505851072 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fadec064090 0x7fadec066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:38:28.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.414+0000 7fadeb7fe700 1 -- 172.21.15.26:0/505851072 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fadf4082650 con 0x7fae040f66e0 2021-11-03T18:38:28.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.414+0000 7fae0259c700 1 --2- 172.21.15.26:0/505851072 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fadec064090 0x7fadec066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:38:28.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.414+0000 7fae0259c700 1 --2- 172.21.15.26:0/505851072 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fadec064090 0x7fadec066550 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7fadf80041d0 tx=0x7fadf8009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:38:28.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.418+0000 7fadeb7fe700 1 -- 172.21.15.26:0/505851072 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fadf40549b0 con 0x7fae040f66e0 2021-11-03T18:38:28.622 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.624+0000 7fae0909d700 1 -- 172.21.15.26:0/505851072 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fae040fef70 con 0x7fae040f66e0 2021-11-03T18:38:28.622 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.624+0000 7fadeb7fe700 1 -- 172.21.15.26:0/505851072 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fadf40545a0 con 0x7fae040f66e0 2021-11-03T18:38:28.623 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:38:28.623 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:38:28.623 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:38:28.624 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:38:28.624 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:38:28.624 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:38:28.624 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:38:28.625 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:38:28.625 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:38:28.626 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:38:28.626 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:38:28.626 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:38:28.627 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:38:28.627 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:38:28.628 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:38:28.628 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:38:28.628 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:38:28.629 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:38:28.629 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:38:28.630 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:38:28.630 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:38:28.631 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:38:28.631 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:38:28.631 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:38:28.632 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:38:28.632 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:38:28.633 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:38:28.633 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:38:28.634 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:38:28.634 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:38:28.635 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:38:28.635 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:38:28.636 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:38:28.636 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:38:28.636 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:38:28.637 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:38:28.637 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:38:28.638 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:38:28.638 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:38:28.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.626+0000 7fae0909d700 1 -- 172.21.15.26:0/505851072 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fadec064090 msgr2=0x7fadec066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:38:28.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.626+0000 7fae0909d700 1 --2- 172.21.15.26:0/505851072 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fadec064090 0x7fadec066550 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7fadf80041d0 tx=0x7fadf8009040).stop 2021-11-03T18:38:28.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.626+0000 7fae0909d700 1 -- 172.21.15.26:0/505851072 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae040f66e0 msgr2=0x7fae04106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:38:28.641 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.626+0000 7fae0909d700 1 --2- 172.21.15.26:0/505851072 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae040f66e0 0x7fae04106fb0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 rx=0x7fadf4000c00 tx=0x7fadf4009b30).stop 2021-11-03T18:38:28.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.626+0000 7fae0909d700 1 -- 172.21.15.26:0/505851072 shutdown_connections 2021-11-03T18:38:28.642 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.626+0000 7fae0909d700 1 --2- 172.21.15.26:0/505851072 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fadec064090 0x7fadec066550 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:28.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.626+0000 7fae0909d700 1 --2- 172.21.15.26:0/505851072 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae040f66e0 0x7fae04106fb0 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:28.643 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.626+0000 7fae0909d700 1 --2- 172.21.15.26:0/505851072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae040f7980 0x7fae041074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:28.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.626+0000 7fae0909d700 1 -- 172.21.15.26:0/505851072 >> 172.21.15.26:0/505851072 conn(0x7fae040f1e40 msgr2=0x7fae040fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:38:28.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.626+0000 7fae0909d700 1 -- 172.21.15.26:0/505851072 shutdown_connections 2021-11-03T18:38:28.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:28.626+0000 7fae0909d700 1 -- 172.21.15.26:0/505851072 wait complete. 2021-11-03T18:38:28.645 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:38:29.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:29 smithi026 ceph-mon[96795]: from='client.37340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:38:29.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:29 smithi026 ceph-mon[96795]: from='client.37344 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:38:29.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:29 smithi026 ceph-mon[96795]: pgmap v3114: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:29.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:29 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/6669937' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:38:29.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:29 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/505851072' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:38:29.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:29 smithi194 ceph-mon[65619]: from='client.37340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:38:29.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:29 smithi194 ceph-mon[65619]: from='client.37344 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:38:29.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:29 smithi194 ceph-mon[65619]: pgmap v3114: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:29.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:29 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/6669937' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:38:29.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:29 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/505851072' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:38:31.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:31 smithi026 ceph-mon[96795]: pgmap v3115: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:31.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:31 smithi194 ceph-mon[65619]: pgmap v3115: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:33.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:33 smithi026 ceph-mon[96795]: pgmap v3116: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:33.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:33 smithi194 ceph-mon[65619]: pgmap v3116: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:35.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:35 smithi026 ceph-mon[96795]: pgmap v3117: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:35.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:35 smithi194 ceph-mon[65619]: pgmap v3117: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:37.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:37 smithi026 ceph-mon[96795]: pgmap v3118: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:37.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:37 smithi194 ceph-mon[65619]: pgmap v3118: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:39.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:39 smithi026 ceph-mon[96795]: pgmap v3119: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:39.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:39 smithi194 ceph-mon[65619]: pgmap v3119: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:41.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:41 smithi026 ceph-mon[96795]: pgmap v3120: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:41.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:38:41.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2021-11-03T18:38:41.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi026", "name": "osd_memory_target"}]: dispatch 2021-11-03T18:38:41.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:38:41.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:38:41.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:38:41.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:38:41.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:38:41.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:38:41.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:38:41.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:41 smithi194 ceph-mon[65619]: pgmap v3120: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:41.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:38:41.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2021-11-03T18:38:41.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi026", "name": "osd_memory_target"}]: dispatch 2021-11-03T18:38:41.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:38:41.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:38:41.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:38:41.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:38:41.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:38:41.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:38:41.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:38:42.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:42 smithi026 ceph-mon[96795]: poll took 60056.488 ms: 1 events 2021-11-03T18:38:42.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:42 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:38:42.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:42 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:38:42.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:42 smithi194 ceph-mon[65619]: poll took 60056.488 ms: 1 events 2021-11-03T18:38:42.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:42 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:38:42.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:42 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:38:43.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:43 smithi026 ceph-mon[96795]: pgmap v3121: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:43.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:43 smithi194 ceph-mon[65619]: pgmap v3121: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:45.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:45 smithi026 ceph-mon[96795]: pgmap v3122: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:45.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:45 smithi194 ceph-mon[65619]: pgmap v3122: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:47.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:47 smithi026 ceph-mon[96795]: pgmap v3123: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:47.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:47 smithi194 ceph-mon[65619]: pgmap v3123: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:49 smithi026 ceph-mon[96795]: pgmap v3124: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:38:49.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:38:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:49 smithi194 ceph-mon[65619]: pgmap v3124: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:38:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:38:51.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:51 smithi026 ceph-mon[96795]: pgmap v3125: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:51.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:51 smithi194 ceph-mon[65619]: pgmap v3125: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:53.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:53 smithi026 ceph-mon[96795]: pgmap v3126: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:53.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:53 smithi194 ceph-mon[65619]: pgmap v3126: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:55.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:55 smithi026 ceph-mon[96795]: pgmap v3127: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:55.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:55 smithi194 ceph-mon[65619]: pgmap v3127: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:56.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:56 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:38:56.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:56 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:38:57.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:57 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:38:57.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:57 smithi026 ceph-mon[96795]: pgmap v3128: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:57.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:57 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:38:57.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:57 smithi194 ceph-mon[65619]: pgmap v3128: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:58.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.740+0000 7f327c4c9700 1 -- 172.21.15.26:0/410232341 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32740f66e0 msgr2=0x7f32740f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:38:58.741 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.740+0000 7f327c4c9700 1 --2- 172.21.15.26:0/410232341 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32740f66e0 0x7f32740f6b00 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 rx=0x7f326c0099e0 tx=0x7f326c004d10).stop 2021-11-03T18:38:58.742 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.740+0000 7f327c4c9700 1 -- 172.21.15.26:0/410232341 shutdown_connections 2021-11-03T18:38:58.742 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.740+0000 7f327c4c9700 1 --2- 172.21.15.26:0/410232341 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32740f6ff0 0x7f32740f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:38:58.742 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.740+0000 7f327c4c9700 1 --2- 172.21.15.26:0/410232341 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32740f66e0 0x7f32740f6b00 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:58.742 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.740+0000 7f327c4c9700 1 -- 172.21.15.26:0/410232341 >> 172.21.15.26:0/410232341 conn(0x7f32740f1f00 msgr2=0x7f32740f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:38:58.743 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.740+0000 7f327c4c9700 1 -- 172.21.15.26:0/410232341 shutdown_connections 2021-11-03T18:38:58.743 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.740+0000 7f327c4c9700 1 -- 172.21.15.26:0/410232341 wait complete. 2021-11-03T18:38:58.743 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.740+0000 7f327c4c9700 1 Processor -- start 2021-11-03T18:38:58.743 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.741+0000 7f327c4c9700 1 -- start start 2021-11-03T18:38:58.744 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.741+0000 7f327c4c9700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32740f66e0 0x7f32741070f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:38:58.744 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.741+0000 7f327c4c9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32740f6ff0 0x7f32741075e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:38:58.744 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.741+0000 7f327c4c9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3274107c20 con 0x7f32740f6ff0 2021-11-03T18:38:58.744 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.741+0000 7f327c4c9700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32741084d0 con 0x7f32740f66e0 2021-11-03T18:38:58.744 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.741+0000 7f3279a64700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32740f6ff0 0x7f32741075e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:38:58.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.741+0000 7f3279a64700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32740f6ff0 0x7f32741075e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32966/0 (socket says 172.21.15.26:32966) 2021-11-03T18:38:58.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.741+0000 7f3279a64700 1 -- 172.21.15.26:0/849715999 learned_addr learned my addr 172.21.15.26:0/849715999 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:38:58.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.741+0000 7f327a265700 1 --2- 172.21.15.26:0/849715999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32740f66e0 0x7f32741070f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:38:58.745 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.741+0000 7f3279a64700 1 -- 172.21.15.26:0/849715999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32740f66e0 msgr2=0x7f32741070f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:38:58.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.741+0000 7f3279a64700 1 --2- 172.21.15.26:0/849715999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32740f66e0 0x7f32741070f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:58.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.741+0000 7f3279a64700 1 -- 172.21.15.26:0/849715999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f326c009640 con 0x7f32740f6ff0 2021-11-03T18:38:58.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.741+0000 7f3279a64700 1 --2- 172.21.15.26:0/849715999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32740f6ff0 0x7f32741075e0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 rx=0x7f326800b410 tx=0x7f3268006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:38:58.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.741+0000 7f3272ffd700 1 -- 172.21.15.26:0/849715999 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32680125f0 con 0x7f32740f6ff0 2021-11-03T18:38:58.747 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.742+0000 7f3272ffd700 1 -- 172.21.15.26:0/849715999 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f326800be30 con 0x7f32740f6ff0 2021-11-03T18:38:58.747 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.742+0000 7f327c4c9700 1 -- 172.21.15.26:0/849715999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32741087b0 con 0x7f32740f6ff0 2021-11-03T18:38:58.747 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.742+0000 7f3272ffd700 1 -- 172.21.15.26:0/849715999 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3268002a70 con 0x7f32740f6ff0 2021-11-03T18:38:58.747 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.742+0000 7f327c4c9700 1 -- 172.21.15.26:0/849715999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3274108cf0 con 0x7f32740f6ff0 2021-11-03T18:38:58.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.743+0000 7f3272ffd700 1 -- 172.21.15.26:0/849715999 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f326800f030 con 0x7f32740f6ff0 2021-11-03T18:38:58.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.743+0000 7f327c4c9700 1 -- 172.21.15.26:0/849715999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32740f5b70 con 0x7f32740f6ff0 2021-11-03T18:38:58.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.744+0000 7f3272ffd700 1 --2- 172.21.15.26:0/849715999 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f325c0640b0 0x7f325c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:38:58.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.744+0000 7f3272ffd700 1 -- 172.21.15.26:0/849715999 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f3268080b20 con 0x7f32740f6ff0 2021-11-03T18:38:58.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.744+0000 7f327a265700 1 --2- 172.21.15.26:0/849715999 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f325c0640b0 0x7f325c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:38:58.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.744+0000 7f327a265700 1 --2- 172.21.15.26:0/849715999 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f325c0640b0 0x7f325c066570 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7f326c003380 tx=0x7f326c004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:38:58.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.748+0000 7f3272ffd700 1 -- 172.21.15.26:0/849715999 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f3268052e80 con 0x7f32740f6ff0 2021-11-03T18:38:58.927 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.928+0000 7f327c4c9700 1 -- 172.21.15.26:0/849715999 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f32740fefc0 con 0x7f325c0640b0 2021-11-03T18:38:58.928 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.929+0000 7f3272ffd700 1 -- 172.21.15.26:0/849715999 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f32740fefc0 con 0x7f325c0640b0 2021-11-03T18:38:58.931 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.931+0000 7f327c4c9700 1 -- 172.21.15.26:0/849715999 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f325c0640b0 msgr2=0x7f325c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:38:58.931 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.931+0000 7f327c4c9700 1 --2- 172.21.15.26:0/849715999 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f325c0640b0 0x7f325c066570 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7f326c003380 tx=0x7f326c004d10).stop 2021-11-03T18:38:58.931 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.931+0000 7f327c4c9700 1 -- 172.21.15.26:0/849715999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32740f6ff0 msgr2=0x7f32741075e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:38:58.931 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.931+0000 7f327c4c9700 1 --2- 172.21.15.26:0/849715999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32740f6ff0 0x7f32741075e0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 rx=0x7f326800b410 tx=0x7f3268006ef0).stop 2021-11-03T18:38:58.932 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.932+0000 7f327c4c9700 1 -- 172.21.15.26:0/849715999 shutdown_connections 2021-11-03T18:38:58.932 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.932+0000 7f327c4c9700 1 --2- 172.21.15.26:0/849715999 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f325c0640b0 0x7f325c066570 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:58.932 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.932+0000 7f327c4c9700 1 --2- 172.21.15.26:0/849715999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32740f66e0 0x7f32741070f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:58.932 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.932+0000 7f327c4c9700 1 --2- 172.21.15.26:0/849715999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32740f6ff0 0x7f32741075e0 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:58.932 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.932+0000 7f327c4c9700 1 -- 172.21.15.26:0/849715999 >> 172.21.15.26:0/849715999 conn(0x7f32740f1f00 msgr2=0x7f32740fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:38:58.933 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.932+0000 7f327c4c9700 1 -- 172.21.15.26:0/849715999 shutdown_connections 2021-11-03T18:38:58.933 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:58.932+0000 7f327c4c9700 1 -- 172.21.15.26:0/849715999 wait complete. 2021-11-03T18:38:58.940 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:38:59.033 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.032+0000 7f98eeb08700 1 -- 172.21.15.26:0/3596541855 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98e80f5ef0 msgr2=0x7f98e80f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:38:59.033 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.032+0000 7f98eeb08700 1 --2- 172.21.15.26:0/3596541855 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98e80f5ef0 0x7f98e80f6920 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 rx=0x7f98d80099e0 tx=0x7f98d8004d10).stop 2021-11-03T18:38:59.033 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.032+0000 7f98eeb08700 1 -- 172.21.15.26:0/3596541855 shutdown_connections 2021-11-03T18:38:59.033 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.032+0000 7f98eeb08700 1 --2- 172.21.15.26:0/3596541855 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98e80f5ef0 0x7f98e80f6920 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:59.034 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.032+0000 7f98eeb08700 1 --2- 172.21.15.26:0/3596541855 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98e80f55e0 0x7f98e80f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:38:59.034 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.032+0000 7f98eeb08700 1 -- 172.21.15.26:0/3596541855 >> 172.21.15.26:0/3596541855 conn(0x7f98e80f0de0 msgr2=0x7f98e80f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:38:59.034 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.032+0000 7f98eeb08700 1 -- 172.21.15.26:0/3596541855 shutdown_connections 2021-11-03T18:38:59.034 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.032+0000 7f98eeb08700 1 -- 172.21.15.26:0/3596541855 wait complete. 2021-11-03T18:38:59.035 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.032+0000 7f98eeb08700 1 Processor -- start 2021-11-03T18:38:59.035 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.032+0000 7f98eeb08700 1 -- start start 2021-11-03T18:38:59.035 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.033+0000 7f98eeb08700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98e80f55e0 0x7f98e8109e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:38:59.035 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.033+0000 7f98eeb08700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98e80f5ef0 0x7f98e810c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:38:59.036 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.033+0000 7f98eeb08700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e8060570 con 0x7f98e80f5ef0 2021-11-03T18:38:59.036 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.033+0000 7f98eeb08700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e80606b0 con 0x7f98e80f55e0 2021-11-03T18:38:59.036 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.033+0000 7f98e7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98e80f5ef0 0x7f98e810c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:38:59.036 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.033+0000 7f98e7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98e80f5ef0 0x7f98e810c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32976/0 (socket says 172.21.15.26:32976) 2021-11-03T18:38:59.037 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.033+0000 7f98e7fff700 1 -- 172.21.15.26:0/3709320109 learned_addr learned my addr 172.21.15.26:0/3709320109 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:38:59.037 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.033+0000 7f98ec8a4700 1 --2- 172.21.15.26:0/3709320109 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98e80f55e0 0x7f98e8109e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:38:59.037 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.033+0000 7f98e7fff700 1 -- 172.21.15.26:0/3709320109 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98e80f55e0 msgr2=0x7f98e8109e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:38:59.038 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.033+0000 7f98e7fff700 1 --2- 172.21.15.26:0/3709320109 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98e80f55e0 0x7f98e8109e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:59.038 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.033+0000 7f98e7fff700 1 -- 172.21.15.26:0/3709320109 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d8009640 con 0x7f98e80f5ef0 2021-11-03T18:38:59.038 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.033+0000 7f98ec8a4700 1 --2- 172.21.15.26:0/3709320109 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98e80f55e0 0x7f98e8109e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:38:59.039 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.033+0000 7f98e7fff700 1 --2- 172.21.15.26:0/3709320109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98e80f5ef0 0x7f98e810c320 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 rx=0x7f98d8004b70 tx=0x7f98d8004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:38:59.039 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.033+0000 7f98e57fa700 1 -- 172.21.15.26:0/3709320109 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98d800e030 con 0x7f98e80f5ef0 2021-11-03T18:38:59.039 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.033+0000 7f98eeb08700 1 -- 172.21.15.26:0/3709320109 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e810c8d0 con 0x7f98e80f5ef0 2021-11-03T18:38:59.039 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.033+0000 7f98e57fa700 1 -- 172.21.15.26:0/3709320109 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f98d80049b0 con 0x7f98e80f5ef0 2021-11-03T18:38:59.040 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.033+0000 7f98eeb08700 1 -- 172.21.15.26:0/3709320109 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e810cdb0 con 0x7f98e80f5ef0 2021-11-03T18:38:59.040 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.033+0000 7f98e57fa700 1 -- 172.21.15.26:0/3709320109 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98d8018070 con 0x7f98e80f5ef0 2021-11-03T18:38:59.041 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.034+0000 7f98eeb08700 1 -- 172.21.15.26:0/3709320109 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98e8045ad0 con 0x7f98e80f5ef0 2021-11-03T18:38:59.041 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.035+0000 7f98e57fa700 1 -- 172.21.15.26:0/3709320109 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f98d801db40 con 0x7f98e80f5ef0 2021-11-03T18:38:59.042 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.035+0000 7f98e57fa700 1 --2- 172.21.15.26:0/3709320109 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f98d40640a0 0x7f98d4066560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:38:59.042 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.035+0000 7f98e57fa700 1 -- 172.21.15.26:0/3709320109 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f98d80827a0 con 0x7f98e80f5ef0 2021-11-03T18:38:59.042 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.035+0000 7f98ec8a4700 1 --2- 172.21.15.26:0/3709320109 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f98d40640a0 0x7f98d4066560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:38:59.042 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.036+0000 7f98ec8a4700 1 --2- 172.21.15.26:0/3709320109 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f98d40640a0 0x7f98d4066560 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7f98e8060160 tx=0x7f98e0008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:38:59.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.039+0000 7f98e57fa700 1 -- 172.21.15.26:0/3709320109 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f98d8054aa0 con 0x7f98e80f5ef0 2021-11-03T18:38:59.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.213+0000 7f98eeb08700 1 -- 172.21.15.26:0/3709320109 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f98e80fdf60 con 0x7f98d40640a0 2021-11-03T18:38:59.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.227+0000 7f98e57fa700 1 -- 172.21.15.26:0/3709320109 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7f98e80fdf60 con 0x7f98d40640a0 2021-11-03T18:38:59.226 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:38:59.227 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (110m) 8m ago 111m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:38:59.227 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (102m) 8m ago 111m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:38:59.227 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (102m) 7m ago 110m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:38:59.227 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (110m) 8m ago 111m 42.3M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:38:59.228 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (103m) 8m ago 106m 26.2M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:38:59.228 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (103m) 8m ago 106m 26.8M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:38:59.228 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (106m) 7m ago 106m 27.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:38:59.228 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (106m) 7m ago 106m 27.4M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:38:59.228 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (103m) 8m ago 112m 601M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:38:59.229 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (103m) 7m ago 110m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:38:59.229 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (103m) 8m ago 112m 374M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:38:59.229 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (102m) 7m ago 110m 171M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:38:59.229 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (111m) 8m ago 111m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:38:59.229 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (110m) 7m ago 110m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:38:59.230 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (102m) 8m ago 109m 352M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:38:59.230 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (101m) 8m ago 109m 379M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:38:59.230 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (101m) 8m ago 109m 314M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:38:59.230 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (100m) 7m ago 108m 413M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:38:59.231 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (100m) 7m ago 108m 339M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:38:59.231 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (99m) 7m ago 108m 337M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:38:59.231 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (109m) 8m ago 110m 68.0M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:38:59.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.229+0000 7f98eeb08700 1 -- 172.21.15.26:0/3709320109 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f98d40640a0 msgr2=0x7f98d4066560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:38:59.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.229+0000 7f98eeb08700 1 --2- 172.21.15.26:0/3709320109 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f98d40640a0 0x7f98d4066560 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7f98e8060160 tx=0x7f98e0008040).stop 2021-11-03T18:38:59.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.229+0000 7f98eeb08700 1 -- 172.21.15.26:0/3709320109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98e80f5ef0 msgr2=0x7f98e810c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:38:59.233 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.229+0000 7f98eeb08700 1 --2- 172.21.15.26:0/3709320109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98e80f5ef0 0x7f98e810c320 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 rx=0x7f98d8004b70 tx=0x7f98d8004d10).stop 2021-11-03T18:38:59.233 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.229+0000 7f98eeb08700 1 -- 172.21.15.26:0/3709320109 shutdown_connections 2021-11-03T18:38:59.233 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.229+0000 7f98eeb08700 1 --2- 172.21.15.26:0/3709320109 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f98d40640a0 0x7f98d4066560 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:59.233 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.229+0000 7f98eeb08700 1 --2- 172.21.15.26:0/3709320109 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98e80f55e0 0x7f98e8109e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:59.233 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.229+0000 7f98eeb08700 1 --2- 172.21.15.26:0/3709320109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98e80f5ef0 0x7f98e810c320 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:59.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.229+0000 7f98eeb08700 1 -- 172.21.15.26:0/3709320109 >> 172.21.15.26:0/3709320109 conn(0x7f98e80f0de0 msgr2=0x7f98e80fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:38:59.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.229+0000 7f98eeb08700 1 -- 172.21.15.26:0/3709320109 shutdown_connections 2021-11-03T18:38:59.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.229+0000 7f98eeb08700 1 -- 172.21.15.26:0/3709320109 wait complete. 2021-11-03T18:38:59.327 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.328+0000 7fc0f99d7700 1 -- 172.21.15.26:0/2749534987 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0f40f5ef0 msgr2=0x7fc0f40f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:38:59.327 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.328+0000 7fc0f99d7700 1 --2- 172.21.15.26:0/2749534987 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0f40f5ef0 0x7fc0f40f6920 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 rx=0x7fc0dc004660 tx=0x7fc0dc009b30).stop 2021-11-03T18:38:59.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.328+0000 7fc0f99d7700 1 -- 172.21.15.26:0/2749534987 shutdown_connections 2021-11-03T18:38:59.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.328+0000 7fc0f99d7700 1 --2- 172.21.15.26:0/2749534987 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0f40f5ef0 0x7fc0f40f6920 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:59.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.328+0000 7fc0f99d7700 1 --2- 172.21.15.26:0/2749534987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0f40f55e0 0x7fc0f40f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:59.328 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.328+0000 7fc0f99d7700 1 -- 172.21.15.26:0/2749534987 >> 172.21.15.26:0/2749534987 conn(0x7fc0f40f0de0 msgr2=0x7fc0f40f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:38:59.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.328+0000 7fc0f99d7700 1 -- 172.21.15.26:0/2749534987 shutdown_connections 2021-11-03T18:38:59.329 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.328+0000 7fc0f99d7700 1 -- 172.21.15.26:0/2749534987 wait complete. 2021-11-03T18:38:59.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.329+0000 7fc0f99d7700 1 Processor -- start 2021-11-03T18:38:59.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.329+0000 7fc0f99d7700 1 -- start start 2021-11-03T18:38:59.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.329+0000 7fc0f99d7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0f40f55e0 0x7fc0f4105e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:38:59.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.329+0000 7fc0f99d7700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0f40f5ef0 0x7fc0f4106350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:38:59.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.329+0000 7fc0f99d7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f4106950 con 0x7fc0f40f55e0 2021-11-03T18:38:59.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.329+0000 7fc0f99d7700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f4107160 con 0x7fc0f40f5ef0 2021-11-03T18:38:59.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.329+0000 7fc0f2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0f40f55e0 0x7fc0f4105e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:38:59.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.329+0000 7fc0f2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0f40f55e0 0x7fc0f4105e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32986/0 (socket says 172.21.15.26:32986) 2021-11-03T18:38:59.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.329+0000 7fc0f2ffd700 1 -- 172.21.15.26:0/3685576307 learned_addr learned my addr 172.21.15.26:0/3685576307 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:38:59.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.329+0000 7fc0f27fc700 1 --2- 172.21.15.26:0/3685576307 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0f40f5ef0 0x7fc0f4106350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:38:59.334 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.329+0000 7fc0f2ffd700 1 -- 172.21.15.26:0/3685576307 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0f40f5ef0 msgr2=0x7fc0f4106350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:38:59.334 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.329+0000 7fc0f2ffd700 1 --2- 172.21.15.26:0/3685576307 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0f40f5ef0 0x7fc0f4106350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:59.334 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.329+0000 7fc0f2ffd700 1 -- 172.21.15.26:0/3685576307 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0dc005040 con 0x7fc0f40f55e0 2021-11-03T18:38:59.334 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.329+0000 7fc0f2ffd700 1 --2- 172.21.15.26:0/3685576307 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0f40f55e0 0x7fc0f4105e60 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 rx=0x7fc0ec00e7f0 tx=0x7fc0ec00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:38:59.334 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.330+0000 7fc0eb7fe700 1 -- 172.21.15.26:0/3685576307 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0ec0092e0 con 0x7fc0f40f55e0 2021-11-03T18:38:59.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.330+0000 7fc0eb7fe700 1 -- 172.21.15.26:0/3685576307 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc0ec00f040 con 0x7fc0f40f55e0 2021-11-03T18:38:59.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.330+0000 7fc0f99d7700 1 -- 172.21.15.26:0/3685576307 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0f41073e0 con 0x7fc0f40f55e0 2021-11-03T18:38:59.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.330+0000 7fc0eb7fe700 1 -- 172.21.15.26:0/3685576307 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0ec014750 con 0x7fc0f40f55e0 2021-11-03T18:38:59.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.330+0000 7fc0f99d7700 1 -- 172.21.15.26:0/3685576307 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0f41079a0 con 0x7fc0f40f55e0 2021-11-03T18:38:59.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.331+0000 7fc0f99d7700 1 -- 172.21.15.26:0/3685576307 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0f40f4a70 con 0x7fc0f40f55e0 2021-11-03T18:38:59.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.331+0000 7fc0eb7fe700 1 -- 172.21.15.26:0/3685576307 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc0ec01b030 con 0x7fc0f40f55e0 2021-11-03T18:38:59.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.331+0000 7fc0eb7fe700 1 --2- 172.21.15.26:0/3685576307 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc0e00640b0 0x7fc0e0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:38:59.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.331+0000 7fc0eb7fe700 1 -- 172.21.15.26:0/3685576307 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc0ec080580 con 0x7fc0f40f55e0 2021-11-03T18:38:59.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.332+0000 7fc0f27fc700 1 --2- 172.21.15.26:0/3685576307 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc0e00640b0 0x7fc0e0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:38:59.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.332+0000 7fc0f27fc700 1 --2- 172.21.15.26:0/3685576307 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc0e00640b0 0x7fc0e0066570 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7fc0dc0043d0 tx=0x7fc0dc00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:38:59.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.336+0000 7fc0eb7fe700 1 -- 172.21.15.26:0/3685576307 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc0ec0528a0 con 0x7fc0f40f55e0 2021-11-03T18:38:59.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:38:59 smithi026 ceph-mon[96795]: pgmap v3129: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:59.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:38:59 smithi194 ceph-mon[65619]: pgmap v3129: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:38:59.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.569+0000 7fc0f99d7700 1 -- 172.21.15.26:0/3685576307 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc0f40fddd0 con 0x7fc0f40f55e0 2021-11-03T18:38:59.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.569+0000 7fc0eb7fe700 1 -- 172.21.15.26:0/3685576307 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fc0ec0192e0 con 0x7fc0f40f55e0 2021-11-03T18:38:59.569 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:38:59.569 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:38:59.570 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:38:59.570 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:38:59.570 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:38:59.570 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:38:59.571 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:38:59.571 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:38:59.571 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:38:59.571 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:38:59.572 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:38:59.572 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:38:59.572 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:38:59.573 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:38:59.573 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:38:59.573 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:38:59.573 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:38:59.573 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:38:59.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.571+0000 7fc0f99d7700 1 -- 172.21.15.26:0/3685576307 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc0e00640b0 msgr2=0x7fc0e0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:38:59.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.571+0000 7fc0f99d7700 1 --2- 172.21.15.26:0/3685576307 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc0e00640b0 0x7fc0e0066570 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7fc0dc0043d0 tx=0x7fc0dc00b040).stop 2021-11-03T18:38:59.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.571+0000 7fc0f99d7700 1 -- 172.21.15.26:0/3685576307 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0f40f55e0 msgr2=0x7fc0f4105e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:38:59.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.571+0000 7fc0f99d7700 1 --2- 172.21.15.26:0/3685576307 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0f40f55e0 0x7fc0f4105e60 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 rx=0x7fc0ec00e7f0 tx=0x7fc0ec00b040).stop 2021-11-03T18:38:59.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.571+0000 7fc0f99d7700 1 -- 172.21.15.26:0/3685576307 shutdown_connections 2021-11-03T18:38:59.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.571+0000 7fc0f99d7700 1 --2- 172.21.15.26:0/3685576307 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc0e00640b0 0x7fc0e0066570 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:59.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.571+0000 7fc0f99d7700 1 --2- 172.21.15.26:0/3685576307 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0f40f55e0 0x7fc0f4105e60 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:59.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.571+0000 7fc0f99d7700 1 --2- 172.21.15.26:0/3685576307 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0f40f5ef0 0x7fc0f4106350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:59.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.571+0000 7fc0f99d7700 1 -- 172.21.15.26:0/3685576307 >> 172.21.15.26:0/3685576307 conn(0x7fc0f40f0de0 msgr2=0x7fc0f40fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:38:59.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.572+0000 7fc0f99d7700 1 -- 172.21.15.26:0/3685576307 shutdown_connections 2021-11-03T18:38:59.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.572+0000 7fc0f99d7700 1 -- 172.21.15.26:0/3685576307 wait complete. 2021-11-03T18:38:59.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.671+0000 7fbd9cdb5700 1 -- 172.21.15.26:0/382424028 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd980f51a0 msgr2=0x7fbd980f7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:38:59.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.671+0000 7fbd9cdb5700 1 --2- 172.21.15.26:0/382424028 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd980f51a0 0x7fbd980f7920 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 rx=0x7fbd8c004660 tx=0x7fbd8c009b30).stop 2021-11-03T18:38:59.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.671+0000 7fbd9cdb5700 1 -- 172.21.15.26:0/382424028 shutdown_connections 2021-11-03T18:38:59.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.671+0000 7fbd9cdb5700 1 --2- 172.21.15.26:0/382424028 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd980f51a0 0x7fbd980f7920 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:59.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.671+0000 7fbd9cdb5700 1 --2- 172.21.15.26:0/382424028 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd980f4800 0x7fbd980f4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:59.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.671+0000 7fbd9cdb5700 1 -- 172.21.15.26:0/382424028 >> 172.21.15.26:0/382424028 conn(0x7fbd980f0320 msgr2=0x7fbd980f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:38:59.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.671+0000 7fbd9cdb5700 1 -- 172.21.15.26:0/382424028 shutdown_connections 2021-11-03T18:38:59.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.671+0000 7fbd9cdb5700 1 -- 172.21.15.26:0/382424028 wait complete. 2021-11-03T18:38:59.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.672+0000 7fbd9cdb5700 1 Processor -- start 2021-11-03T18:38:59.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.672+0000 7fbd9cdb5700 1 -- start start 2021-11-03T18:38:59.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.672+0000 7fbd9cdb5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd980f4800 0x7fbd98106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:38:59.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.672+0000 7fbd9cdb5700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd980f51a0 0x7fbd98107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:38:59.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.672+0000 7fbd9cdb5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd98107910 con 0x7fbd980f4800 2021-11-03T18:38:59.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.672+0000 7fbd9cdb5700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd98108120 con 0x7fbd980f51a0 2021-11-03T18:38:59.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.672+0000 7fbd977fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd980f4800 0x7fbd98106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:38:59.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.672+0000 7fbd977fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd980f4800 0x7fbd98106e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32996/0 (socket says 172.21.15.26:32996) 2021-11-03T18:38:59.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.672+0000 7fbd977fe700 1 -- 172.21.15.26:0/3977267665 learned_addr learned my addr 172.21.15.26:0/3977267665 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:38:59.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.672+0000 7fbd96ffd700 1 --2- 172.21.15.26:0/3977267665 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd980f51a0 0x7fbd98107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:38:59.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.673+0000 7fbd977fe700 1 -- 172.21.15.26:0/3977267665 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd980f51a0 msgr2=0x7fbd98107310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:38:59.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.673+0000 7fbd977fe700 1 --2- 172.21.15.26:0/3977267665 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd980f51a0 0x7fbd98107310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:59.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.673+0000 7fbd977fe700 1 -- 172.21.15.26:0/3977267665 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8c005040 con 0x7fbd980f4800 2021-11-03T18:38:59.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.673+0000 7fbd977fe700 1 --2- 172.21.15.26:0/3977267665 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd980f4800 0x7fbd98106e20 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 rx=0x7fbd88002700 tx=0x7fbd88009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:38:59.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.673+0000 7fbd7ffff700 1 -- 172.21.15.26:0/3977267665 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd88009320 con 0x7fbd980f4800 2021-11-03T18:38:59.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.673+0000 7fbd7ffff700 1 -- 172.21.15.26:0/3977267665 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbd8800f040 con 0x7fbd980f4800 2021-11-03T18:38:59.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.673+0000 7fbd7ffff700 1 -- 172.21.15.26:0/3977267665 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd88014900 con 0x7fbd980f4800 2021-11-03T18:38:59.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.673+0000 7fbd9cdb5700 1 -- 172.21.15.26:0/3977267665 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd981083a0 con 0x7fbd980f4800 2021-11-03T18:38:59.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.673+0000 7fbd9cdb5700 1 -- 172.21.15.26:0/3977267665 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd98108960 con 0x7fbd980f4800 2021-11-03T18:38:59.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.674+0000 7fbd9cdb5700 1 -- 172.21.15.26:0/3977267665 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd98059100 con 0x7fbd980f4800 2021-11-03T18:38:59.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.674+0000 7fbd7ffff700 1 -- 172.21.15.26:0/3977267665 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fbd88009480 con 0x7fbd980f4800 2021-11-03T18:38:59.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.675+0000 7fbd7ffff700 1 --2- 172.21.15.26:0/3977267665 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbd80064100 0x7fbd800665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:38:59.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.675+0000 7fbd7ffff700 1 -- 172.21.15.26:0/3977267665 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fbd88080970 con 0x7fbd980f4800 2021-11-03T18:38:59.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.675+0000 7fbd96ffd700 1 --2- 172.21.15.26:0/3977267665 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbd80064100 0x7fbd800665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:38:59.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.675+0000 7fbd96ffd700 1 --2- 172.21.15.26:0/3977267665 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbd80064100 0x7fbd800665c0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 rx=0x7fbd8c004630 tx=0x7fbd8c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:38:59.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.679+0000 7fbd7ffff700 1 -- 172.21.15.26:0/3977267665 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fbd88052cd0 con 0x7fbd980f4800 2021-11-03T18:38:59.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.881+0000 7fbd9cdb5700 1 -- 172.21.15.26:0/3977267665 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbd98045ad0 con 0x7fbd980f4800 2021-11-03T18:38:59.881 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.882+0000 7fbd7ffff700 1 -- 172.21.15.26:0/3977267665 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fbd880528c0 con 0x7fbd980f4800 2021-11-03T18:38:59.882 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:38:59.882 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:38:59.882 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:38:59.882 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:38:59.883 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:38:59.883 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:38:59.883 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:38:59.883 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:38:59.883 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:38:59.884 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:38:59.884 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:38:59.884 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:38:59.884 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:38:59.885 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:38:59.885 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:38:59.885 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:38:59.885 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:38:59.885 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:38:59.886 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:38:59.886 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:38:59.886 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:38:59.886 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:38:59.887 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:38:59.887 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:38:59.887 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:38:59.887 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:38:59.887 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:38:59.888 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:38:59.888 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:38:59.888 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:38:59.888 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:38:59.889 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:38:59.889 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:38:59.889 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:38:59.889 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:38:59.889 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:38:59.890 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:38:59.890 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:38:59.890 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:38:59.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.884+0000 7fbd9cdb5700 1 -- 172.21.15.26:0/3977267665 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbd80064100 msgr2=0x7fbd800665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:38:59.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.884+0000 7fbd9cdb5700 1 --2- 172.21.15.26:0/3977267665 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbd80064100 0x7fbd800665c0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 rx=0x7fbd8c004630 tx=0x7fbd8c009b30).stop 2021-11-03T18:38:59.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.884+0000 7fbd9cdb5700 1 -- 172.21.15.26:0/3977267665 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd980f4800 msgr2=0x7fbd98106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:38:59.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.884+0000 7fbd9cdb5700 1 --2- 172.21.15.26:0/3977267665 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd980f4800 0x7fbd98106e20 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 rx=0x7fbd88002700 tx=0x7fbd88009d80).stop 2021-11-03T18:38:59.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.884+0000 7fbd9cdb5700 1 -- 172.21.15.26:0/3977267665 shutdown_connections 2021-11-03T18:38:59.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.884+0000 7fbd9cdb5700 1 --2- 172.21.15.26:0/3977267665 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbd80064100 0x7fbd800665c0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:59.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.884+0000 7fbd9cdb5700 1 --2- 172.21.15.26:0/3977267665 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd980f4800 0x7fbd98106e20 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:59.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.884+0000 7fbd9cdb5700 1 --2- 172.21.15.26:0/3977267665 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd980f51a0 0x7fbd98107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:38:59.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.884+0000 7fbd9cdb5700 1 -- 172.21.15.26:0/3977267665 >> 172.21.15.26:0/3977267665 conn(0x7fbd980f0320 msgr2=0x7fbd980fb370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:38:59.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.884+0000 7fbd9cdb5700 1 -- 172.21.15.26:0/3977267665 shutdown_connections 2021-11-03T18:38:59.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:38:59.884+0000 7fbd9cdb5700 1 -- 172.21.15.26:0/3977267665 wait complete. 2021-11-03T18:38:59.894 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:39:00.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:00 smithi026 ceph-mon[96795]: from='client.37356 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:39:00.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:00 smithi026 ceph-mon[96795]: from='client.37360 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:39:00.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:00 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3685576307' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:39:00.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:00 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3977267665' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:39:00.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:00 smithi194 ceph-mon[65619]: from='client.37356 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:39:00.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:00 smithi194 ceph-mon[65619]: from='client.37360 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:39:00.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:00 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3685576307' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:39:00.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:00 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3977267665' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:39:01.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:01 smithi026 ceph-mon[96795]: pgmap v3130: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:01.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:01 smithi194 ceph-mon[65619]: pgmap v3130: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:03.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:03 smithi026 ceph-mon[96795]: pgmap v3131: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:03.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:03 smithi194 ceph-mon[65619]: pgmap v3131: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:05.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:05 smithi026 ceph-mon[96795]: pgmap v3132: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:05.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:05 smithi194 ceph-mon[65619]: pgmap v3132: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:07.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:07 smithi026 ceph-mon[96795]: pgmap v3133: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:07.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:07 smithi194 ceph-mon[65619]: pgmap v3133: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:09.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:09 smithi026 ceph-mon[96795]: pgmap v3134: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:09.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:09 smithi194 ceph-mon[65619]: pgmap v3134: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:11.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:11 smithi026 ceph-mon[96795]: pgmap v3135: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:11.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:11 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:39:11.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:11 smithi194 ceph-mon[65619]: pgmap v3135: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:11.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:11 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:39:12.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:12 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:39:12.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:12 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:39:13.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:13 smithi026 ceph-mon[96795]: pgmap v3136: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:13.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:13 smithi194 ceph-mon[65619]: pgmap v3136: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:15.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:15 smithi026 ceph-mon[96795]: pgmap v3137: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:15.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:15 smithi194 ceph-mon[65619]: pgmap v3137: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:17.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:17 smithi026 ceph-mon[96795]: pgmap v3138: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:17.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:17 smithi194 ceph-mon[65619]: pgmap v3138: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:19.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:19 smithi026 ceph-mon[96795]: pgmap v3139: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:19.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:19 smithi194 ceph-mon[65619]: pgmap v3139: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:21.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:21 smithi026 ceph-mon[96795]: pgmap v3140: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:21.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:21 smithi194 ceph-mon[65619]: pgmap v3140: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:23.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:23 smithi026 ceph-mon[96795]: pgmap v3141: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:23.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:23 smithi194 ceph-mon[65619]: pgmap v3141: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:25.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:25 smithi026 ceph-mon[96795]: pgmap v3142: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:25.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:25 smithi194 ceph-mon[65619]: pgmap v3142: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:26.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:26 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:39:26.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:26 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:39:27.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:27 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:39:27.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:27 smithi026 ceph-mon[96795]: pgmap v3143: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:27.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:27 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:39:27.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:27 smithi194 ceph-mon[65619]: pgmap v3143: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:29.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:29 smithi026 ceph-mon[96795]: pgmap v3144: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:29.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:29 smithi194 ceph-mon[65619]: pgmap v3144: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:30.000 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:29.999+0000 7fe9a1243700 1 -- 172.21.15.26:0/1275157165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe99c060310 msgr2=0x7fe99c0f93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:39:30.001 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:29.999+0000 7fe9a1243700 1 --2- 172.21.15.26:0/1275157165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe99c060310 0x7fe99c0f93c0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 rx=0x7fe9940099e0 tx=0x7fe994004d10).stop 2021-11-03T18:39:30.001 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:29.999+0000 7fe9a1243700 1 -- 172.21.15.26:0/1275157165 shutdown_connections 2021-11-03T18:39:30.001 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:29.999+0000 7fe9a1243700 1 --2- 172.21.15.26:0/1275157165 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe99c0f98b0 0x7fe99c0fbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:39:30.002 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:29.999+0000 7fe9a1243700 1 --2- 172.21.15.26:0/1275157165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe99c060310 0x7fe99c0f93c0 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:39:30.002 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:29.999+0000 7fe9a1243700 1 -- 172.21.15.26:0/1275157165 >> 172.21.15.26:0/1275157165 conn(0x7fe99c0f0de0 msgr2=0x7fe99c0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:39:30.002 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.000+0000 7fe9a1243700 1 -- 172.21.15.26:0/1275157165 shutdown_connections 2021-11-03T18:39:30.003 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.000+0000 7fe9a1243700 1 -- 172.21.15.26:0/1275157165 wait complete. 2021-11-03T18:39:30.003 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.000+0000 7fe9a1243700 1 Processor -- start 2021-11-03T18:39:30.003 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.000+0000 7fe9a1243700 1 -- start start 2021-11-03T18:39:30.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.001+0000 7fe9a1243700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe99c060310 0x7fe99c1070c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:39:30.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.001+0000 7fe9a1243700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe99c0f98b0 0x7fe99c1075b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:39:30.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.001+0000 7fe9a1243700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c107b60 con 0x7fe99c0f98b0 2021-11-03T18:39:30.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.001+0000 7fe9a1243700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c107ca0 con 0x7fe99c060310 2021-11-03T18:39:30.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.001+0000 7fe99a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe99c0f98b0 0x7fe99c1075b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:39:30.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.001+0000 7fe99a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe99c0f98b0 0x7fe99c1075b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33016/0 (socket says 172.21.15.26:33016) 2021-11-03T18:39:30.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.001+0000 7fe99a59c700 1 -- 172.21.15.26:0/1473734196 learned_addr learned my addr 172.21.15.26:0/1473734196 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:39:30.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.001+0000 7fe99ad9d700 1 --2- 172.21.15.26:0/1473734196 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe99c060310 0x7fe99c1070c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:39:30.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.001+0000 7fe99a59c700 1 -- 172.21.15.26:0/1473734196 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe99c060310 msgr2=0x7fe99c1070c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:39:30.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.001+0000 7fe99a59c700 1 --2- 172.21.15.26:0/1473734196 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe99c060310 0x7fe99c1070c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:39:30.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.001+0000 7fe99a59c700 1 -- 172.21.15.26:0/1473734196 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe994009640 con 0x7fe99c0f98b0 2021-11-03T18:39:30.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.001+0000 7fe99a59c700 1 --2- 172.21.15.26:0/1473734196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe99c0f98b0 0x7fe99c1075b0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 rx=0x7fe984002700 tx=0x7fe984009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:39:30.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.001+0000 7fe9937fe700 1 -- 172.21.15.26:0/1473734196 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe984009320 con 0x7fe99c0f98b0 2021-11-03T18:39:30.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.001+0000 7fe9937fe700 1 -- 172.21.15.26:0/1473734196 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe98400f040 con 0x7fe99c0f98b0 2021-11-03T18:39:30.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.001+0000 7fe9937fe700 1 -- 172.21.15.26:0/1473734196 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe984014870 con 0x7fe99c0f98b0 2021-11-03T18:39:30.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.001+0000 7fe9a1243700 1 -- 172.21.15.26:0/1473734196 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe99c108640 con 0x7fe99c0f98b0 2021-11-03T18:39:30.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.002+0000 7fe9a1243700 1 -- 172.21.15.26:0/1473734196 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe99c108b30 con 0x7fe99c0f98b0 2021-11-03T18:39:30.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.002+0000 7fe9a1243700 1 -- 172.21.15.26:0/1473734196 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe99c045ad0 con 0x7fe99c0f98b0 2021-11-03T18:39:30.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.003+0000 7fe9937fe700 1 -- 172.21.15.26:0/1473734196 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fe984009480 con 0x7fe99c0f98b0 2021-11-03T18:39:30.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.003+0000 7fe9937fe700 1 --2- 172.21.15.26:0/1473734196 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe9880640b0 0x7fe988066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:39:30.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.003+0000 7fe9937fe700 1 -- 172.21.15.26:0/1473734196 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fe984080a70 con 0x7fe99c0f98b0 2021-11-03T18:39:30.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.003+0000 7fe99ad9d700 1 --2- 172.21.15.26:0/1473734196 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe9880640b0 0x7fe988066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:39:30.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.004+0000 7fe99ad9d700 1 --2- 172.21.15.26:0/1473734196 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe9880640b0 0x7fe988066570 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7fe99400b730 tx=0x7fe994004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:39:30.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.008+0000 7fe9937fe700 1 -- 172.21.15.26:0/1473734196 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fe984052dd0 con 0x7fe99c0f98b0 2021-11-03T18:39:30.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.186+0000 7fe9a1243700 1 -- 172.21.15.26:0/1473734196 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe99c0ff030 con 0x7fe9880640b0 2021-11-03T18:39:30.186 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.188+0000 7fe9937fe700 1 -- 172.21.15.26:0/1473734196 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fe99c0ff030 con 0x7fe9880640b0 2021-11-03T18:39:30.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.189+0000 7fe9a1243700 1 -- 172.21.15.26:0/1473734196 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe9880640b0 msgr2=0x7fe988066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:39:30.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.189+0000 7fe9a1243700 1 --2- 172.21.15.26:0/1473734196 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe9880640b0 0x7fe988066570 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7fe99400b730 tx=0x7fe994004d10).stop 2021-11-03T18:39:30.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.189+0000 7fe9a1243700 1 -- 172.21.15.26:0/1473734196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe99c0f98b0 msgr2=0x7fe99c1075b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:39:30.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.189+0000 7fe9a1243700 1 --2- 172.21.15.26:0/1473734196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe99c0f98b0 0x7fe99c1075b0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 rx=0x7fe984002700 tx=0x7fe984009e00).stop 2021-11-03T18:39:30.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.190+0000 7fe9a1243700 1 -- 172.21.15.26:0/1473734196 shutdown_connections 2021-11-03T18:39:30.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.190+0000 7fe9a1243700 1 --2- 172.21.15.26:0/1473734196 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe9880640b0 0x7fe988066570 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:39:30.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.190+0000 7fe9a1243700 1 --2- 172.21.15.26:0/1473734196 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe99c060310 0x7fe99c1070c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:39:30.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.190+0000 7fe9a1243700 1 --2- 172.21.15.26:0/1473734196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe99c0f98b0 0x7fe99c1075b0 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:39:30.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.190+0000 7fe9a1243700 1 -- 172.21.15.26:0/1473734196 >> 172.21.15.26:0/1473734196 conn(0x7fe99c0f0de0 msgr2=0x7fe99c0f31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:39:30.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.190+0000 7fe9a1243700 1 -- 172.21.15.26:0/1473734196 shutdown_connections 2021-11-03T18:39:30.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.190+0000 7fe9a1243700 1 -- 172.21.15.26:0/1473734196 wait complete. 2021-11-03T18:39:30.197 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:39:30.291 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.293+0000 7fd775c29700 1 -- 172.21.15.26:0/1789797296 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7700f7980 msgr2=0x7fd7700f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:39:30.291 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.293+0000 7fd775c29700 1 --2- 172.21.15.26:0/1789797296 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7700f7980 0x7fd7700f7de0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 rx=0x7fd764004660 tx=0x7fd764009b30).stop 2021-11-03T18:39:30.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.293+0000 7fd775c29700 1 -- 172.21.15.26:0/1789797296 shutdown_connections 2021-11-03T18:39:30.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.293+0000 7fd775c29700 1 --2- 172.21.15.26:0/1789797296 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7700f7980 0x7fd7700f7de0 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:39:30.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.293+0000 7fd775c29700 1 --2- 172.21.15.26:0/1789797296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7700f66e0 0x7fd7700f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:39:30.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.293+0000 7fd775c29700 1 -- 172.21.15.26:0/1789797296 >> 172.21.15.26:0/1789797296 conn(0x7fd7700f1e40 msgr2=0x7fd7700f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:39:30.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.293+0000 7fd775c29700 1 -- 172.21.15.26:0/1789797296 shutdown_connections 2021-11-03T18:39:30.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.293+0000 7fd775c29700 1 -- 172.21.15.26:0/1789797296 wait complete. 2021-11-03T18:39:30.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.293+0000 7fd775c29700 1 Processor -- start 2021-11-03T18:39:30.296 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.294+0000 7fd775c29700 1 -- start start 2021-11-03T18:39:30.296 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.294+0000 7fd775c29700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7700f66e0 0x7fd77006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:39:30.296 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.294+0000 7fd775c29700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7700f7980 0x7fd770069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:39:30.297 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.294+0000 7fd775c29700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77006a410 con 0x7fd7700f66e0 2021-11-03T18:39:30.297 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.294+0000 7fd775c29700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77006a550 con 0x7fd7700f7980 2021-11-03T18:39:30.297 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.294+0000 7fd76f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7700f66e0 0x7fd77006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:39:30.297 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.294+0000 7fd76f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7700f66e0 0x7fd77006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33024/0 (socket says 172.21.15.26:33024) 2021-11-03T18:39:30.298 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.294+0000 7fd76f7fe700 1 -- 172.21.15.26:0/4143365151 learned_addr learned my addr 172.21.15.26:0/4143365151 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:39:30.298 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.294+0000 7fd76effd700 1 --2- 172.21.15.26:0/4143365151 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7700f7980 0x7fd770069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:39:30.298 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.294+0000 7fd76f7fe700 1 -- 172.21.15.26:0/4143365151 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7700f7980 msgr2=0x7fd770069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:39:30.298 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.294+0000 7fd76f7fe700 1 --2- 172.21.15.26:0/4143365151 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7700f7980 0x7fd770069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:39:30.298 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.294+0000 7fd76f7fe700 1 -- 172.21.15.26:0/4143365151 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd764005040 con 0x7fd7700f66e0 2021-11-03T18:39:30.299 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.294+0000 7fd76effd700 1 --2- 172.21.15.26:0/4143365151 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7700f7980 0x7fd770069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:39:30.299 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.294+0000 7fd76f7fe700 1 --2- 172.21.15.26:0/4143365151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7700f66e0 0x7fd77006b9a0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 rx=0x7fd7600093f0 tx=0x7fd760006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:39:30.299 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.294+0000 7fd757fff700 1 -- 172.21.15.26:0/4143365151 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd760009ea0 con 0x7fd7700f66e0 2021-11-03T18:39:30.299 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.295+0000 7fd757fff700 1 -- 172.21.15.26:0/4143365151 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd760013af0 con 0x7fd7700f66e0 2021-11-03T18:39:30.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.295+0000 7fd775c29700 1 -- 172.21.15.26:0/4143365151 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd77006a830 con 0x7fd7700f66e0 2021-11-03T18:39:30.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.295+0000 7fd757fff700 1 -- 172.21.15.26:0/4143365151 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd76000db10 con 0x7fd7700f66e0 2021-11-03T18:39:30.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.295+0000 7fd775c29700 1 -- 172.21.15.26:0/4143365151 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd77010efe0 con 0x7fd7700f66e0 2021-11-03T18:39:30.300 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.295+0000 7fd775c29700 1 -- 172.21.15.26:0/4143365151 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd770045ad0 con 0x7fd7700f66e0 2021-11-03T18:39:30.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.296+0000 7fd757fff700 1 -- 172.21.15.26:0/4143365151 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fd76001a060 con 0x7fd7700f66e0 2021-11-03T18:39:30.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.296+0000 7fd757fff700 1 --2- 172.21.15.26:0/4143365151 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd7580640b0 0x7fd758066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:39:30.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.296+0000 7fd757fff700 1 -- 172.21.15.26:0/4143365151 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fd7600808f0 con 0x7fd7700f66e0 2021-11-03T18:39:30.301 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.296+0000 7fd76effd700 1 --2- 172.21.15.26:0/4143365151 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd7580640b0 0x7fd758066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:39:30.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.297+0000 7fd76effd700 1 --2- 172.21.15.26:0/4143365151 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd7580640b0 0x7fd758066570 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7fd764009da0 tx=0x7fd764009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:39:30.302 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.300+0000 7fd757fff700 1 -- 172.21.15.26:0/4143365151 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fd760052b60 con 0x7fd7700f66e0 2021-11-03T18:39:30.474 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.476+0000 7fd775c29700 1 -- 172.21.15.26:0/4143365151 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd7700ff0f0 con 0x7fd7580640b0 2021-11-03T18:39:30.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.491+0000 7fd757fff700 1 -- 172.21.15.26:0/4143365151 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7fd764013410 con 0x7fd7580640b0 2021-11-03T18:39:30.490 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:39:30.490 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (110m) 8m ago 112m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:39:30.490 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (102m) 8m ago 111m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:39:30.490 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (102m) 7m ago 111m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:39:30.491 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (110m) 8m ago 111m 42.3M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:39:30.491 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (103m) 8m ago 107m 26.2M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:39:30.491 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (104m) 8m ago 107m 26.8M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:39:30.491 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (107m) 7m ago 107m 27.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:39:30.492 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (107m) 7m ago 107m 27.4M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:39:30.492 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (104m) 8m ago 113m 601M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:39:30.492 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (104m) 7m ago 111m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:39:30.492 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (103m) 8m ago 113m 374M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:39:30.492 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (103m) 7m ago 111m 171M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:39:30.493 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (111m) 8m ago 111m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:39:30.493 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (110m) 7m ago 110m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:39:30.493 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (102m) 8m ago 110m 352M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:39:30.493 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (102m) 8m ago 110m 379M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:39:30.494 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (101m) 8m ago 109m 314M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:39:30.494 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (101m) 7m ago 109m 413M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:39:30.494 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (100m) 7m ago 109m 339M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:39:30.494 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (100m) 7m ago 108m 337M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:39:30.494 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (110m) 8m ago 111m 68.0M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:39:30.495 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.493+0000 7fd775c29700 1 -- 172.21.15.26:0/4143365151 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd7580640b0 msgr2=0x7fd758066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:39:30.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.493+0000 7fd775c29700 1 --2- 172.21.15.26:0/4143365151 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd7580640b0 0x7fd758066570 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7fd764009da0 tx=0x7fd764009b30).stop 2021-11-03T18:39:30.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.493+0000 7fd775c29700 1 -- 172.21.15.26:0/4143365151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7700f66e0 msgr2=0x7fd77006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:39:30.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.493+0000 7fd775c29700 1 --2- 172.21.15.26:0/4143365151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7700f66e0 0x7fd77006b9a0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 rx=0x7fd7600093f0 tx=0x7fd760006ec0).stop 2021-11-03T18:39:30.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.493+0000 7fd775c29700 1 -- 172.21.15.26:0/4143365151 shutdown_connections 2021-11-03T18:39:30.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.493+0000 7fd775c29700 1 --2- 172.21.15.26:0/4143365151 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd7580640b0 0x7fd758066570 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:39:30.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.493+0000 7fd775c29700 1 --2- 172.21.15.26:0/4143365151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7700f66e0 0x7fd77006b9a0 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:39:30.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.493+0000 7fd775c29700 1 --2- 172.21.15.26:0/4143365151 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7700f7980 0x7fd770069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:39:30.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.493+0000 7fd775c29700 1 -- 172.21.15.26:0/4143365151 >> 172.21.15.26:0/4143365151 conn(0x7fd7700f1e40 msgr2=0x7fd7700fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:39:30.497 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.493+0000 7fd775c29700 1 -- 172.21.15.26:0/4143365151 shutdown_connections 2021-11-03T18:39:30.498 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.493+0000 7fd775c29700 1 -- 172.21.15.26:0/4143365151 wait complete. 2021-11-03T18:39:30.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.593+0000 7fc88993c700 1 -- 172.21.15.26:0/2295529939 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8840f6ff0 msgr2=0x7fc8840f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:39:30.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.593+0000 7fc88993c700 1 --2- 172.21.15.26:0/2295529939 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8840f6ff0 0x7fc8840f7a20 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 rx=0x7fc878004660 tx=0x7fc878009b30).stop 2021-11-03T18:39:30.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.593+0000 7fc88993c700 1 -- 172.21.15.26:0/2295529939 shutdown_connections 2021-11-03T18:39:30.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.593+0000 7fc88993c700 1 --2- 172.21.15.26:0/2295529939 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8840f6ff0 0x7fc8840f7a20 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:39:30.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.593+0000 7fc88993c700 1 --2- 172.21.15.26:0/2295529939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8840f66e0 0x7fc8840f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:39:30.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.593+0000 7fc88993c700 1 -- 172.21.15.26:0/2295529939 >> 172.21.15.26:0/2295529939 conn(0x7fc8840f1f00 msgr2=0x7fc8840f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:39:30.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.593+0000 7fc88993c700 1 -- 172.21.15.26:0/2295529939 shutdown_connections 2021-11-03T18:39:30.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.593+0000 7fc88993c700 1 -- 172.21.15.26:0/2295529939 wait complete. 2021-11-03T18:39:30.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.593+0000 7fc88993c700 1 Processor -- start 2021-11-03T18:39:30.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.593+0000 7fc88993c700 1 -- start start 2021-11-03T18:39:30.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.594+0000 7fc88993c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8840f66e0 0x7fc884106f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:39:30.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.594+0000 7fc88993c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8840f6ff0 0x7fc8841073f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:39:30.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.594+0000 7fc88993c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8841079a0 con 0x7fc8840f66e0 2021-11-03T18:39:30.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.594+0000 7fc88993c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc884107ae0 con 0x7fc8840f6ff0 2021-11-03T18:39:30.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.594+0000 7fc882ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8840f66e0 0x7fc884106f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:39:30.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.594+0000 7fc882ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8840f66e0 0x7fc884106f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33034/0 (socket says 172.21.15.26:33034) 2021-11-03T18:39:30.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.594+0000 7fc882ffd700 1 -- 172.21.15.26:0/1262646215 learned_addr learned my addr 172.21.15.26:0/1262646215 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:39:30.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.594+0000 7fc8827fc700 1 --2- 172.21.15.26:0/1262646215 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8840f6ff0 0x7fc8841073f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:39:30.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.594+0000 7fc882ffd700 1 -- 172.21.15.26:0/1262646215 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8840f6ff0 msgr2=0x7fc8841073f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:39:30.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.594+0000 7fc882ffd700 1 --2- 172.21.15.26:0/1262646215 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8840f6ff0 0x7fc8841073f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:39:30.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.594+0000 7fc882ffd700 1 -- 172.21.15.26:0/1262646215 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc878005040 con 0x7fc8840f66e0 2021-11-03T18:39:30.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.594+0000 7fc8827fc700 1 --2- 172.21.15.26:0/1262646215 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8840f6ff0 0x7fc8841073f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:39:30.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.594+0000 7fc882ffd700 1 --2- 172.21.15.26:0/1262646215 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8840f66e0 0x7fc884106f00 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 rx=0x7fc87c007fd0 tx=0x7fc87c004ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:39:30.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.594+0000 7fc86b7fe700 1 -- 172.21.15.26:0/1262646215 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc87c00b5a0 con 0x7fc8840f66e0 2021-11-03T18:39:30.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.594+0000 7fc86b7fe700 1 -- 172.21.15.26:0/1262646215 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc87c00f040 con 0x7fc8840f66e0 2021-11-03T18:39:30.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.594+0000 7fc88993c700 1 -- 172.21.15.26:0/1262646215 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc884108480 con 0x7fc8840f66e0 2021-11-03T18:39:30.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.594+0000 7fc86b7fe700 1 -- 172.21.15.26:0/1262646215 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc87c013b60 con 0x7fc8840f66e0 2021-11-03T18:39:30.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.594+0000 7fc88993c700 1 -- 172.21.15.26:0/1262646215 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc884108a40 con 0x7fc8840f66e0 2021-11-03T18:39:30.600 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.595+0000 7fc88993c700 1 -- 172.21.15.26:0/1262646215 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc884045ad0 con 0x7fc8840f66e0 2021-11-03T18:39:30.601 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.596+0000 7fc86b7fe700 1 -- 172.21.15.26:0/1262646215 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc87c01a030 con 0x7fc8840f66e0 2021-11-03T18:39:30.601 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.596+0000 7fc86b7fe700 1 --2- 172.21.15.26:0/1262646215 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc86c0640b0 0x7fc86c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:39:30.601 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.596+0000 7fc86b7fe700 1 -- 172.21.15.26:0/1262646215 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc87c080740 con 0x7fc8840f66e0 2021-11-03T18:39:30.601 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.596+0000 7fc8827fc700 1 --2- 172.21.15.26:0/1262646215 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc86c0640b0 0x7fc86c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:39:30.601 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.597+0000 7fc8827fc700 1 --2- 172.21.15.26:0/1262646215 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc86c0640b0 0x7fc86c066570 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7fc878004630 tx=0x7fc878009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:39:30.602 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.600+0000 7fc86b7fe700 1 -- 172.21.15.26:0/1262646215 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc87c052a60 con 0x7fc8840f66e0 2021-11-03T18:39:30.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.829+0000 7fc88993c700 1 -- 172.21.15.26:0/1262646215 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc8840fefe0 con 0x7fc8840f66e0 2021-11-03T18:39:30.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.830+0000 7fc86b7fe700 1 -- 172.21.15.26:0/1262646215 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fc87c018070 con 0x7fc8840f66e0 2021-11-03T18:39:30.828 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:39:30.829 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:39:30.829 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:39:30.829 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:39:30.829 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:39:30.829 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:39:30.830 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:39:30.830 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:39:30.830 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:39:30.830 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:39:30.831 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:39:30.831 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:39:30.831 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:39:30.831 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:39:30.832 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:39:30.832 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:39:30.832 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:39:30.832 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:39:30.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.832+0000 7fc88993c700 1 -- 172.21.15.26:0/1262646215 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc86c0640b0 msgr2=0x7fc86c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:39:30.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.832+0000 7fc88993c700 1 --2- 172.21.15.26:0/1262646215 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc86c0640b0 0x7fc86c066570 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7fc878004630 tx=0x7fc878009b30).stop 2021-11-03T18:39:30.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.832+0000 7fc88993c700 1 -- 172.21.15.26:0/1262646215 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8840f66e0 msgr2=0x7fc884106f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:39:30.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.832+0000 7fc88993c700 1 --2- 172.21.15.26:0/1262646215 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8840f66e0 0x7fc884106f00 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 rx=0x7fc87c007fd0 tx=0x7fc87c004ee0).stop 2021-11-03T18:39:30.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.832+0000 7fc88993c700 1 -- 172.21.15.26:0/1262646215 shutdown_connections 2021-11-03T18:39:30.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.832+0000 7fc88993c700 1 --2- 172.21.15.26:0/1262646215 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc86c0640b0 0x7fc86c066570 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:39:30.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.832+0000 7fc88993c700 1 --2- 172.21.15.26:0/1262646215 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8840f66e0 0x7fc884106f00 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:39:30.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.832+0000 7fc88993c700 1 --2- 172.21.15.26:0/1262646215 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8840f6ff0 0x7fc8841073f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:39:30.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.832+0000 7fc88993c700 1 -- 172.21.15.26:0/1262646215 >> 172.21.15.26:0/1262646215 conn(0x7fc8840f1f00 msgr2=0x7fc8840fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:39:30.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.832+0000 7fc88993c700 1 -- 172.21.15.26:0/1262646215 shutdown_connections 2021-11-03T18:39:30.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.832+0000 7fc88993c700 1 -- 172.21.15.26:0/1262646215 wait complete. 2021-11-03T18:39:30.932 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.932+0000 7fd6d66ea700 1 -- 172.21.15.26:0/2691395310 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6d00f6860 msgr2=0x7fd6d00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:39:30.932 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.932+0000 7fd6d66ea700 1 --2- 172.21.15.26:0/2691395310 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6d00f6860 0x7fd6d00f6cc0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 rx=0x7fd6b8004660 tx=0x7fd6b8009b30).stop 2021-11-03T18:39:30.932 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.932+0000 7fd6d66ea700 1 -- 172.21.15.26:0/2691395310 shutdown_connections 2021-11-03T18:39:30.933 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.932+0000 7fd6d66ea700 1 --2- 172.21.15.26:0/2691395310 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6d00f6860 0x7fd6d00f6cc0 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:39:30.933 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.932+0000 7fd6d66ea700 1 --2- 172.21.15.26:0/2691395310 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6d00f55c0 0x7fd6d00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:39:30.933 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.932+0000 7fd6d66ea700 1 -- 172.21.15.26:0/2691395310 >> 172.21.15.26:0/2691395310 conn(0x7fd6d00f0d40 msgr2=0x7fd6d00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:39:30.933 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.932+0000 7fd6d66ea700 1 -- 172.21.15.26:0/2691395310 shutdown_connections 2021-11-03T18:39:30.934 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.932+0000 7fd6d66ea700 1 -- 172.21.15.26:0/2691395310 wait complete. 2021-11-03T18:39:30.934 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.932+0000 7fd6d66ea700 1 Processor -- start 2021-11-03T18:39:30.934 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.933+0000 7fd6d66ea700 1 -- start start 2021-11-03T18:39:30.934 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.933+0000 7fd6d66ea700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6d00f55c0 0x7fd6d0109bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:39:30.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.933+0000 7fd6d66ea700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6d00f6860 0x7fd6d010c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:39:30.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.933+0000 7fd6d66ea700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d00603e0 con 0x7fd6d00f55c0 2021-11-03T18:39:30.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.933+0000 7fd6d66ea700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d0060520 con 0x7fd6d00f6860 2021-11-03T18:39:30.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.933+0000 7fd6cffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6d00f55c0 0x7fd6d0109bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:39:30.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.933+0000 7fd6cffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6d00f55c0 0x7fd6d0109bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33044/0 (socket says 172.21.15.26:33044) 2021-11-03T18:39:30.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.933+0000 7fd6cffff700 1 -- 172.21.15.26:0/1924500454 learned_addr learned my addr 172.21.15.26:0/1924500454 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:39:30.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.933+0000 7fd6c7fff700 1 --2- 172.21.15.26:0/1924500454 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6d00f6860 0x7fd6d010c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:39:30.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.933+0000 7fd6cffff700 1 -- 172.21.15.26:0/1924500454 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6d00f6860 msgr2=0x7fd6d010c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:39:30.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.933+0000 7fd6cffff700 1 --2- 172.21.15.26:0/1924500454 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6d00f6860 0x7fd6d010c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:39:30.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.933+0000 7fd6cffff700 1 -- 172.21.15.26:0/1924500454 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b8005040 con 0x7fd6d00f55c0 2021-11-03T18:39:30.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.933+0000 7fd6cffff700 1 --2- 172.21.15.26:0/1924500454 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6d00f55c0 0x7fd6d0109bc0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 rx=0x7fd6c0002700 tx=0x7fd6c0009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:39:30.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.933+0000 7fd6cd7fa700 1 -- 172.21.15.26:0/1924500454 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6c00079c0 con 0x7fd6d00f55c0 2021-11-03T18:39:30.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.933+0000 7fd6cd7fa700 1 -- 172.21.15.26:0/1924500454 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd6c000f040 con 0x7fd6d00f55c0 2021-11-03T18:39:30.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.933+0000 7fd6d66ea700 1 -- 172.21.15.26:0/1924500454 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d010c670 con 0x7fd6d00f55c0 2021-11-03T18:39:30.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.933+0000 7fd6cd7fa700 1 -- 172.21.15.26:0/1924500454 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6c0014850 con 0x7fd6d00f55c0 2021-11-03T18:39:30.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.933+0000 7fd6d66ea700 1 -- 172.21.15.26:0/1924500454 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d010cc30 con 0x7fd6d00f55c0 2021-11-03T18:39:30.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.934+0000 7fd6d66ea700 1 -- 172.21.15.26:0/1924500454 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d0045ad0 con 0x7fd6d00f55c0 2021-11-03T18:39:30.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.935+0000 7fd6cd7fa700 1 -- 172.21.15.26:0/1924500454 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fd6c001b060 con 0x7fd6d00f55c0 2021-11-03T18:39:30.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.935+0000 7fd6cd7fa700 1 --2- 172.21.15.26:0/1924500454 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd6bc0640b0 0x7fd6bc066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:39:30.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.935+0000 7fd6cd7fa700 1 -- 172.21.15.26:0/1924500454 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fd6c00805a0 con 0x7fd6d00f55c0 2021-11-03T18:39:30.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.935+0000 7fd6c7fff700 1 --2- 172.21.15.26:0/1924500454 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd6bc0640b0 0x7fd6bc066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:39:30.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.936+0000 7fd6c7fff700 1 --2- 172.21.15.26:0/1924500454 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd6bc0640b0 0x7fd6bc066570 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7fd6b8004630 tx=0x7fd6b8009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:39:30.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:30.939+0000 7fd6cd7fa700 1 -- 172.21.15.26:0/1924500454 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fd6c0052900 con 0x7fd6d00f55c0 2021-11-03T18:39:31.143 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:31.145+0000 7fd6d66ea700 1 -- 172.21.15.26:0/1924500454 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd6d0027a00 con 0x7fd6d00f55c0 2021-11-03T18:39:31.143 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:31.145+0000 7fd6cd7fa700 1 -- 172.21.15.26:0/1924500454 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fd6c00524f0 con 0x7fd6d00f55c0 2021-11-03T18:39:31.144 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:39:31.144 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:39:31.144 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:39:31.144 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:39:31.145 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:39:31.145 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:39:31.145 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:39:31.145 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:39:31.145 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:39:31.146 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:39:31.146 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:39:31.146 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:39:31.146 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:39:31.146 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:39:31.147 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:39:31.147 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:39:31.147 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:39:31.147 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:39:31.148 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:39:31.148 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:39:31.148 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:39:31.148 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:39:31.148 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:39:31.149 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:39:31.149 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:39:31.149 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:39:31.149 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:39:31.150 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:39:31.150 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:39:31.150 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:39:31.150 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:39:31.151 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:39:31.151 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:39:31.151 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:39:31.151 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:39:31.151 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:39:31.152 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:39:31.152 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:39:31.152 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:39:31.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:31.147+0000 7fd6d66ea700 1 -- 172.21.15.26:0/1924500454 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd6bc0640b0 msgr2=0x7fd6bc066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:39:31.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:31.147+0000 7fd6d66ea700 1 --2- 172.21.15.26:0/1924500454 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd6bc0640b0 0x7fd6bc066570 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7fd6b8004630 tx=0x7fd6b8009b30).stop 2021-11-03T18:39:31.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:31.147+0000 7fd6d66ea700 1 -- 172.21.15.26:0/1924500454 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6d00f55c0 msgr2=0x7fd6d0109bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:39:31.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:31.147+0000 7fd6d66ea700 1 --2- 172.21.15.26:0/1924500454 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6d00f55c0 0x7fd6d0109bc0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 rx=0x7fd6c0002700 tx=0x7fd6c0009e00).stop 2021-11-03T18:39:31.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:31.147+0000 7fd6d66ea700 1 -- 172.21.15.26:0/1924500454 shutdown_connections 2021-11-03T18:39:31.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:31.147+0000 7fd6d66ea700 1 --2- 172.21.15.26:0/1924500454 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd6bc0640b0 0x7fd6bc066570 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:39:31.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:31.147+0000 7fd6d66ea700 1 --2- 172.21.15.26:0/1924500454 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6d00f55c0 0x7fd6d0109bc0 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:39:31.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:31.147+0000 7fd6d66ea700 1 --2- 172.21.15.26:0/1924500454 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6d00f6860 0x7fd6d010c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:39:31.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:31.147+0000 7fd6d66ea700 1 -- 172.21.15.26:0/1924500454 >> 172.21.15.26:0/1924500454 conn(0x7fd6d00f0d40 msgr2=0x7fd6d00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:39:31.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:31.147+0000 7fd6d66ea700 1 -- 172.21.15.26:0/1924500454 shutdown_connections 2021-11-03T18:39:31.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:39:31.147+0000 7fd6d66ea700 1 -- 172.21.15.26:0/1924500454 wait complete. 2021-11-03T18:39:31.155 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:39:31.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:31 smithi026 ceph-mon[96795]: pgmap v3145: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:31.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:31 smithi026 ceph-mon[96795]: from='client.37372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:39:31.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:31 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1262646215' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:39:31.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:31 smithi194 ceph-mon[65619]: pgmap v3145: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:31.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:31 smithi194 ceph-mon[65619]: from='client.37372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:39:31.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:31 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1262646215' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:39:32.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:32 smithi026 ceph-mon[96795]: from='client.37376 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:39:32.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:32 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1924500454' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:39:32.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:32 smithi194 ceph-mon[65619]: from='client.37376 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:39:32.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:32 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1924500454' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:39:33.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:33 smithi026 ceph-mon[96795]: pgmap v3146: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:33.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:33 smithi194 ceph-mon[65619]: pgmap v3146: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:35.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:35 smithi026 ceph-mon[96795]: pgmap v3147: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:35.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:35 smithi194 ceph-mon[65619]: pgmap v3147: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:37.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:37 smithi026 ceph-mon[96795]: pgmap v3148: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:37.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:37 smithi194 ceph-mon[65619]: pgmap v3148: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:39.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:39 smithi026 ceph-mon[96795]: pgmap v3149: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:39.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:39 smithi194 ceph-mon[65619]: pgmap v3149: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:41.286 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:41 smithi026 ceph-mon[96795]: pgmap v3150: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:41.287 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:41 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:39:41.318 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:41 smithi194 ceph-mon[65619]: pgmap v3150: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:41.318 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:41 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:39:42.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:42 smithi026 ceph-mon[96795]: poll took 60066.133 ms: 1 events 2021-11-03T18:39:42.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:39:42.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:39:42.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:39:42.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:39:42.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:39:42.677 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:39:42.679 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:39:42.679 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:39:42.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:42 smithi194 ceph-mon[65619]: poll took 60066.133 ms: 1 events 2021-11-03T18:39:42.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:39:42.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:39:42.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:39:42.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:39:42.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:39:42.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:39:42.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:39:42.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:39:43.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:43 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:39:43.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:43 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:39:43.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:43 smithi026 ceph-mon[96795]: pgmap v3151: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:43.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:43 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:39:43.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:43 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:39:43.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:43 smithi194 ceph-mon[65619]: pgmap v3151: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:45.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:45 smithi026 ceph-mon[96795]: pgmap v3152: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:45.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:45 smithi194 ceph-mon[65619]: pgmap v3152: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:47.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:47 smithi026 ceph-mon[96795]: pgmap v3153: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:47.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:47 smithi194 ceph-mon[65619]: pgmap v3153: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:49.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:49 smithi026 ceph-mon[96795]: pgmap v3154: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:49.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:39:49.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:39:49.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:49 smithi194 ceph-mon[65619]: pgmap v3154: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:49.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:39:49.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:39:51.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:51 smithi026 ceph-mon[96795]: pgmap v3155: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:51.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:51 smithi194 ceph-mon[65619]: pgmap v3155: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:53.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:53 smithi026 ceph-mon[96795]: pgmap v3156: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:53.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:53 smithi194 ceph-mon[65619]: pgmap v3156: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:55.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:55 smithi026 ceph-mon[96795]: pgmap v3157: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:55.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:55 smithi194 ceph-mon[65619]: pgmap v3157: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:57.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:57 smithi026 ceph-mon[96795]: pgmap v3158: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:57.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:57 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:39:57.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:57 smithi194 ceph-mon[65619]: pgmap v3158: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:57.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:57 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:39:58.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:58 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:39:58.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:58 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:39:59.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:39:59 smithi026 ceph-mon[96795]: pgmap v3159: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:39:59.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:39:59 smithi194 ceph-mon[65619]: pgmap v3159: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:00.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:00 smithi026 conmon[96772]: 2021-11-03T18:40:00.000+0000 7f27986f6700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 2 daemons have recently crashed 2021-11-03T18:40:00.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:00 smithi026 ceph-mon[96795]: overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 2 daemons have recently crashed 2021-11-03T18:40:00.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:00 smithi194 ceph-mon[65619]: overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 2 daemons have recently crashed 2021-11-03T18:40:01.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.263+0000 7f6f5d6d6700 1 -- 172.21.15.26:0/1790197310 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f580f6ff0 msgr2=0x7f6f580f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:40:01.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.263+0000 7f6f5d6d6700 1 --2- 172.21.15.26:0/1790197310 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f580f6ff0 0x7f6f580f7a20 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 rx=0x7f6f4c004660 tx=0x7f6f4c009b30).stop 2021-11-03T18:40:01.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.263+0000 7f6f5d6d6700 1 -- 172.21.15.26:0/1790197310 shutdown_connections 2021-11-03T18:40:01.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.263+0000 7f6f5d6d6700 1 --2- 172.21.15.26:0/1790197310 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f580f6ff0 0x7f6f580f7a20 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:01.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.263+0000 7f6f5d6d6700 1 --2- 172.21.15.26:0/1790197310 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f580f66e0 0x7f6f580f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:01.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.263+0000 7f6f5d6d6700 1 -- 172.21.15.26:0/1790197310 >> 172.21.15.26:0/1790197310 conn(0x7f6f580f1f00 msgr2=0x7f6f580f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:40:01.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.263+0000 7f6f5d6d6700 1 -- 172.21.15.26:0/1790197310 shutdown_connections 2021-11-03T18:40:01.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.263+0000 7f6f5d6d6700 1 -- 172.21.15.26:0/1790197310 wait complete. 2021-11-03T18:40:01.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.263+0000 7f6f5d6d6700 1 Processor -- start 2021-11-03T18:40:01.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.263+0000 7f6f5d6d6700 1 -- start start 2021-11-03T18:40:01.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.264+0000 7f6f5d6d6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f580f66e0 0x7f6f5806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:40:01.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.264+0000 7f6f5d6d6700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f580f6ff0 0x7f6f58069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:40:01.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.264+0000 7f6f5d6d6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5806a380 con 0x7f6f580f66e0 2021-11-03T18:40:01.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.264+0000 7f6f5d6d6700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5806a4c0 con 0x7f6f580f6ff0 2021-11-03T18:40:01.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.264+0000 7f6f56ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f580f66e0 0x7f6f5806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:40:01.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.264+0000 7f6f56ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f580f66e0 0x7f6f5806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33062/0 (socket says 172.21.15.26:33062) 2021-11-03T18:40:01.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.264+0000 7f6f56ffd700 1 -- 172.21.15.26:0/4136041754 learned_addr learned my addr 172.21.15.26:0/4136041754 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:40:01.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.264+0000 7f6f567fc700 1 --2- 172.21.15.26:0/4136041754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f580f6ff0 0x7f6f58069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:40:01.268 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.264+0000 7f6f56ffd700 1 -- 172.21.15.26:0/4136041754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f580f6ff0 msgr2=0x7f6f58069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:40:01.268 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.264+0000 7f6f56ffd700 1 --2- 172.21.15.26:0/4136041754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f580f6ff0 0x7f6f58069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:01.268 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.264+0000 7f6f56ffd700 1 -- 172.21.15.26:0/4136041754 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f4c005040 con 0x7f6f580f66e0 2021-11-03T18:40:01.268 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.264+0000 7f6f56ffd700 1 --2- 172.21.15.26:0/4136041754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f580f66e0 0x7f6f5806b9a0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 rx=0x7f6f480026d0 tx=0x7f6f48009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:40:01.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.264+0000 7f6f3f7fe700 1 -- 172.21.15.26:0/4136041754 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f480079c0 con 0x7f6f580f66e0 2021-11-03T18:40:01.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.265+0000 7f6f3f7fe700 1 -- 172.21.15.26:0/4136041754 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6f4800f040 con 0x7f6f580f66e0 2021-11-03T18:40:01.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.265+0000 7f6f5d6d6700 1 -- 172.21.15.26:0/4136041754 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f5806a7a0 con 0x7f6f580f66e0 2021-11-03T18:40:01.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.265+0000 7f6f3f7fe700 1 -- 172.21.15.26:0/4136041754 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f480148b0 con 0x7f6f580f66e0 2021-11-03T18:40:01.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.265+0000 7f6f5d6d6700 1 -- 172.21.15.26:0/4136041754 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f5810efa0 con 0x7f6f580f66e0 2021-11-03T18:40:01.270 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.266+0000 7f6f5d6d6700 1 -- 172.21.15.26:0/4136041754 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f58045ad0 con 0x7f6f580f66e0 2021-11-03T18:40:01.270 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.266+0000 7f6f3f7fe700 1 -- 172.21.15.26:0/4136041754 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f6f48007b20 con 0x7f6f580f66e0 2021-11-03T18:40:01.270 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.266+0000 7f6f3f7fe700 1 --2- 172.21.15.26:0/4136041754 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6f400640b0 0x7f6f40066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:40:01.270 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.266+0000 7f6f3f7fe700 1 -- 172.21.15.26:0/4136041754 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f6f48080730 con 0x7f6f580f66e0 2021-11-03T18:40:01.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.267+0000 7f6f567fc700 1 --2- 172.21.15.26:0/4136041754 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6f400640b0 0x7f6f40066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:40:01.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.267+0000 7f6f567fc700 1 --2- 172.21.15.26:0/4136041754 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6f400640b0 0x7f6f40066570 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7f6f4c004630 tx=0x7f6f4c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:40:01.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.271+0000 7f6f3f7fe700 1 -- 172.21.15.26:0/4136041754 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f6f480529d0 con 0x7f6f580f66e0 2021-11-03T18:40:01.424 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:01 smithi026 ceph-mon[96795]: pgmap v3160: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:01.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.451+0000 7f6f5d6d6700 1 -- 172.21.15.26:0/4136041754 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f580fefe0 con 0x7f6f400640b0 2021-11-03T18:40:01.451 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.452+0000 7f6f3f7fe700 1 -- 172.21.15.26:0/4136041754 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f6f580fefe0 con 0x7f6f400640b0 2021-11-03T18:40:01.453 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.454+0000 7f6f5d6d6700 1 -- 172.21.15.26:0/4136041754 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6f400640b0 msgr2=0x7f6f40066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:40:01.453 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.454+0000 7f6f5d6d6700 1 --2- 172.21.15.26:0/4136041754 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6f400640b0 0x7f6f40066570 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7f6f4c004630 tx=0x7f6f4c009b30).stop 2021-11-03T18:40:01.453 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.454+0000 7f6f5d6d6700 1 -- 172.21.15.26:0/4136041754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f580f66e0 msgr2=0x7f6f5806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:40:01.453 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.454+0000 7f6f5d6d6700 1 --2- 172.21.15.26:0/4136041754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f580f66e0 0x7f6f5806b9a0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 rx=0x7f6f480026d0 tx=0x7f6f48009de0).stop 2021-11-03T18:40:01.454 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.454+0000 7f6f5d6d6700 1 -- 172.21.15.26:0/4136041754 shutdown_connections 2021-11-03T18:40:01.454 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.454+0000 7f6f5d6d6700 1 --2- 172.21.15.26:0/4136041754 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6f400640b0 0x7f6f40066570 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:01.454 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.454+0000 7f6f5d6d6700 1 --2- 172.21.15.26:0/4136041754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f580f66e0 0x7f6f5806b9a0 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:01.454 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.454+0000 7f6f5d6d6700 1 --2- 172.21.15.26:0/4136041754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f580f6ff0 0x7f6f58069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:01.455 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.454+0000 7f6f5d6d6700 1 -- 172.21.15.26:0/4136041754 >> 172.21.15.26:0/4136041754 conn(0x7f6f580f1f00 msgr2=0x7f6f580fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:40:01.455 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.454+0000 7f6f5d6d6700 1 -- 172.21.15.26:0/4136041754 shutdown_connections 2021-11-03T18:40:01.455 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.455+0000 7f6f5d6d6700 1 -- 172.21.15.26:0/4136041754 wait complete. 2021-11-03T18:40:01.462 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:40:01.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:01 smithi194 ceph-mon[65619]: pgmap v3160: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:01.552 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.554+0000 7ff1ada33700 1 -- 172.21.15.26:0/1796290540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1a80602b0 msgr2=0x7ff1a80f91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:40:01.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.554+0000 7ff1ada33700 1 --2- 172.21.15.26:0/1796290540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1a80602b0 0x7ff1a80f91a0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 rx=0x7ff198004660 tx=0x7ff198009b30).stop 2021-11-03T18:40:01.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.554+0000 7ff1ada33700 1 -- 172.21.15.26:0/1796290540 shutdown_connections 2021-11-03T18:40:01.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.554+0000 7ff1ada33700 1 --2- 172.21.15.26:0/1796290540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1a80f9720 0x7ff1a80fbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:01.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.554+0000 7ff1ada33700 1 --2- 172.21.15.26:0/1796290540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1a80602b0 0x7ff1a80f91a0 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:01.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.554+0000 7ff1ada33700 1 -- 172.21.15.26:0/1796290540 >> 172.21.15.26:0/1796290540 conn(0x7ff1a80f0bc0 msgr2=0x7ff1a80f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:40:01.554 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.554+0000 7ff1ada33700 1 -- 172.21.15.26:0/1796290540 shutdown_connections 2021-11-03T18:40:01.555 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.554+0000 7ff1ada33700 1 -- 172.21.15.26:0/1796290540 wait complete. 2021-11-03T18:40:01.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.555+0000 7ff1ada33700 1 Processor -- start 2021-11-03T18:40:01.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.555+0000 7ff1ada33700 1 -- start start 2021-11-03T18:40:01.558 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.555+0000 7ff1ada33700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1a80602b0 0x7ff1a80f6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:40:01.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.555+0000 7ff1ada33700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1a80f9720 0x7ff1a80f50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:40:01.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.555+0000 7ff1ada33700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a80f5600 con 0x7ff1a80602b0 2021-11-03T18:40:01.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.555+0000 7ff1ada33700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a80f5740 con 0x7ff1a80f9720 2021-11-03T18:40:01.559 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.555+0000 7ff1a6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1a80602b0 0x7ff1a80f6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:40:01.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.555+0000 7ff1a6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1a80602b0 0x7ff1a80f6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33072/0 (socket says 172.21.15.26:33072) 2021-11-03T18:40:01.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.555+0000 7ff1a6ffd700 1 -- 172.21.15.26:0/879869223 learned_addr learned my addr 172.21.15.26:0/879869223 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:40:01.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.556+0000 7ff1a67fc700 1 --2- 172.21.15.26:0/879869223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1a80f9720 0x7ff1a80f50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:40:01.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.556+0000 7ff1a6ffd700 1 -- 172.21.15.26:0/879869223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1a80f9720 msgr2=0x7ff1a80f50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:40:01.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.556+0000 7ff1a6ffd700 1 --2- 172.21.15.26:0/879869223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1a80f9720 0x7ff1a80f50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:01.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.556+0000 7ff1a6ffd700 1 -- 172.21.15.26:0/879869223 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff198005040 con 0x7ff1a80602b0 2021-11-03T18:40:01.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.556+0000 7ff1a6ffd700 1 --2- 172.21.15.26:0/879869223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1a80602b0 0x7ff1a80f6c20 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 rx=0x7ff198009990 tx=0x7ff198009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:40:01.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.556+0000 7ff18f7fe700 1 -- 172.21.15.26:0/879869223 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff198018070 con 0x7ff1a80602b0 2021-11-03T18:40:01.562 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.556+0000 7ff18f7fe700 1 -- 172.21.15.26:0/879869223 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff198007ba0 con 0x7ff1a80602b0 2021-11-03T18:40:01.562 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.556+0000 7ff1ada33700 1 -- 172.21.15.26:0/879869223 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1a80f59c0 con 0x7ff1a80602b0 2021-11-03T18:40:01.562 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.556+0000 7ff18f7fe700 1 -- 172.21.15.26:0/879869223 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff19801c3c0 con 0x7ff1a80602b0 2021-11-03T18:40:01.562 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.556+0000 7ff1ada33700 1 -- 172.21.15.26:0/879869223 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1a80f5f20 con 0x7ff1a80602b0 2021-11-03T18:40:01.563 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.557+0000 7ff1ada33700 1 -- 172.21.15.26:0/879869223 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1a8045ad0 con 0x7ff1a80602b0 2021-11-03T18:40:01.563 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.557+0000 7ff18f7fe700 1 -- 172.21.15.26:0/879869223 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ff19801d420 con 0x7ff1a80602b0 2021-11-03T18:40:01.563 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.558+0000 7ff18f7fe700 1 --2- 172.21.15.26:0/879869223 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff190064100 0x7ff1900665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:40:01.563 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.558+0000 7ff18f7fe700 1 -- 172.21.15.26:0/879869223 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ff198082610 con 0x7ff1a80602b0 2021-11-03T18:40:01.564 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.558+0000 7ff1a67fc700 1 --2- 172.21.15.26:0/879869223 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff190064100 0x7ff1900665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:40:01.564 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.558+0000 7ff1a67fc700 1 --2- 172.21.15.26:0/879869223 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff190064100 0x7ff1900665c0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7ff1a8060080 tx=0x7ff19c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:40:01.564 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.562+0000 7ff18f7fe700 1 -- 172.21.15.26:0/879869223 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ff198054a30 con 0x7ff1a80602b0 2021-11-03T18:40:01.731 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.733+0000 7ff1ada33700 1 -- 172.21.15.26:0/879869223 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff1a8057f10 con 0x7ff190064100 2021-11-03T18:40:01.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.748+0000 7ff18f7fe700 1 -- 172.21.15.26:0/879869223 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7ff1a8057f10 con 0x7ff190064100 2021-11-03T18:40:01.746 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:40:01.746 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (111m) 9m ago 112m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:40:01.747 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (103m) 9m ago 112m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:40:01.747 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (103m) 8m ago 111m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:40:01.747 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (111m) 9m ago 112m 42.3M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:40:01.747 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (104m) 9m ago 107m 26.2M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:40:01.748 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (104m) 9m ago 107m 26.8M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:40:01.748 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (107m) 8m ago 107m 27.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:40:01.748 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (107m) 8m ago 107m 27.4M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:40:01.748 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (104m) 9m ago 113m 601M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:40:01.749 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (104m) 8m ago 111m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:40:01.749 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (104m) 9m ago 113m 374M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:40:01.749 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (104m) 8m ago 111m 171M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:40:01.749 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (112m) 9m ago 112m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:40:01.749 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (111m) 8m ago 111m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:40:01.750 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (103m) 9m ago 110m 352M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:40:01.750 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (102m) 9m ago 110m 379M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:40:01.750 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (102m) 9m ago 110m 314M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:40:01.750 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (101m) 8m ago 109m 413M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:40:01.751 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (101m) 8m ago 109m 339M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:40:01.751 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (100m) 8m ago 109m 337M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:40:01.751 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (110m) 9m ago 111m 68.0M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:40:01.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.750+0000 7ff1ada33700 1 -- 172.21.15.26:0/879869223 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff190064100 msgr2=0x7ff1900665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:40:01.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.750+0000 7ff1ada33700 1 --2- 172.21.15.26:0/879869223 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff190064100 0x7ff1900665c0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7ff1a8060080 tx=0x7ff19c00b040).stop 2021-11-03T18:40:01.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.750+0000 7ff1ada33700 1 -- 172.21.15.26:0/879869223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1a80602b0 msgr2=0x7ff1a80f6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:40:01.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.750+0000 7ff1ada33700 1 --2- 172.21.15.26:0/879869223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1a80602b0 0x7ff1a80f6c20 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 rx=0x7ff198009990 tx=0x7ff198009b30).stop 2021-11-03T18:40:01.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.750+0000 7ff1ada33700 1 -- 172.21.15.26:0/879869223 shutdown_connections 2021-11-03T18:40:01.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.750+0000 7ff1ada33700 1 --2- 172.21.15.26:0/879869223 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff190064100 0x7ff1900665c0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:01.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.750+0000 7ff1ada33700 1 --2- 172.21.15.26:0/879869223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1a80602b0 0x7ff1a80f6c20 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:01.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.750+0000 7ff1ada33700 1 --2- 172.21.15.26:0/879869223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1a80f9720 0x7ff1a80f50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:01.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.750+0000 7ff1ada33700 1 -- 172.21.15.26:0/879869223 >> 172.21.15.26:0/879869223 conn(0x7ff1a80f0bc0 msgr2=0x7ff1a80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:40:01.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.750+0000 7ff1ada33700 1 -- 172.21.15.26:0/879869223 shutdown_connections 2021-11-03T18:40:01.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.750+0000 7ff1ada33700 1 -- 172.21.15.26:0/879869223 wait complete. 2021-11-03T18:40:01.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.848+0000 7f98f9061700 1 -- 172.21.15.26:0/2949115539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98f40f9700 msgr2=0x7f98f40fbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:40:01.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.848+0000 7f98f9061700 1 --2- 172.21.15.26:0/2949115539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98f40f9700 0x7f98f40fbaf0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 rx=0x7f98e8004660 tx=0x7f98e8009b30).stop 2021-11-03T18:40:01.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.848+0000 7f98f9061700 1 -- 172.21.15.26:0/2949115539 shutdown_connections 2021-11-03T18:40:01.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.848+0000 7f98f9061700 1 --2- 172.21.15.26:0/2949115539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98f40f9700 0x7f98f40fbaf0 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:01.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.848+0000 7f98f9061700 1 --2- 172.21.15.26:0/2949115539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98f40602b0 0x7f98f40f9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:01.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.848+0000 7f98f9061700 1 -- 172.21.15.26:0/2949115539 >> 172.21.15.26:0/2949115539 conn(0x7f98f40f0ba0 msgr2=0x7f98f40f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:40:01.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.848+0000 7f98f9061700 1 -- 172.21.15.26:0/2949115539 shutdown_connections 2021-11-03T18:40:01.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.848+0000 7f98f9061700 1 -- 172.21.15.26:0/2949115539 wait complete. 2021-11-03T18:40:01.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.849+0000 7f98f9061700 1 Processor -- start 2021-11-03T18:40:01.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.849+0000 7f98f9061700 1 -- start start 2021-11-03T18:40:01.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.849+0000 7f98f9061700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98f40602b0 0x7f98f40f6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:40:01.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.849+0000 7f98f9061700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98f40f9700 0x7f98f40f5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:40:01.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.849+0000 7f98f9061700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f40f55e0 con 0x7f98f40f9700 2021-11-03T18:40:01.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.849+0000 7f98f9061700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f40f5720 con 0x7f98f40602b0 2021-11-03T18:40:01.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.849+0000 7f98f37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98f40f9700 0x7f98f40f5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:40:01.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.849+0000 7f98f37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98f40f9700 0x7f98f40f5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33084/0 (socket says 172.21.15.26:33084) 2021-11-03T18:40:01.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.849+0000 7f98f37fe700 1 -- 172.21.15.26:0/4228846740 learned_addr learned my addr 172.21.15.26:0/4228846740 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:40:01.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.850+0000 7f98f3fff700 1 --2- 172.21.15.26:0/4228846740 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98f40602b0 0x7f98f40f6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:40:01.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.850+0000 7f98f37fe700 1 -- 172.21.15.26:0/4228846740 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98f40602b0 msgr2=0x7f98f40f6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:40:01.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.850+0000 7f98f37fe700 1 --2- 172.21.15.26:0/4228846740 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98f40602b0 0x7f98f40f6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:01.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.850+0000 7f98f37fe700 1 -- 172.21.15.26:0/4228846740 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e8005040 con 0x7f98f40f9700 2021-11-03T18:40:01.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.850+0000 7f98f37fe700 1 --2- 172.21.15.26:0/4228846740 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98f40f9700 0x7f98f40f5080 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 rx=0x7f98e8014040 tx=0x7f98e800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:40:01.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.850+0000 7f98f0ff9700 1 -- 172.21.15.26:0/4228846740 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98e8019070 con 0x7f98f40f9700 2021-11-03T18:40:01.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.850+0000 7f98f9061700 1 -- 172.21.15.26:0/4228846740 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98f40f59a0 con 0x7f98f40f9700 2021-11-03T18:40:01.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.850+0000 7f98f0ff9700 1 -- 172.21.15.26:0/4228846740 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f98e8007e70 con 0x7f98f40f9700 2021-11-03T18:40:01.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.850+0000 7f98f0ff9700 1 -- 172.21.15.26:0/4228846740 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98e8014d10 con 0x7f98f40f9700 2021-11-03T18:40:01.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.850+0000 7f98f9061700 1 -- 172.21.15.26:0/4228846740 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f40f5f00 con 0x7f98f40f9700 2021-11-03T18:40:01.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.851+0000 7f98f9061700 1 -- 172.21.15.26:0/4228846740 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98f4045ad0 con 0x7f98f40f9700 2021-11-03T18:40:01.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.851+0000 7f98f0ff9700 1 -- 172.21.15.26:0/4228846740 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f98e8025070 con 0x7f98f40f9700 2021-11-03T18:40:01.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.852+0000 7f98f0ff9700 1 --2- 172.21.15.26:0/4228846740 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f98dc064100 0x7f98dc0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:40:01.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.852+0000 7f98f0ff9700 1 -- 172.21.15.26:0/4228846740 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f98e80817b0 con 0x7f98f40f9700 2021-11-03T18:40:01.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.852+0000 7f98f3fff700 1 --2- 172.21.15.26:0/4228846740 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f98dc064100 0x7f98dc0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:40:01.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.852+0000 7f98f3fff700 1 --2- 172.21.15.26:0/4228846740 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f98dc064100 0x7f98dc0665c0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 rx=0x7f98f40f6990 tx=0x7f98e400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:40:01.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:01.856+0000 7f98f0ff9700 1 -- 172.21.15.26:0/4228846740 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f98e8053b10 con 0x7f98f40f9700 2021-11-03T18:40:02.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.085+0000 7f98f9061700 1 -- 172.21.15.26:0/4228846740 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f98f4027a00 con 0x7f98f40f9700 2021-11-03T18:40:02.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.085+0000 7f98f0ff9700 1 -- 172.21.15.26:0/4228846740 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f98e80232e0 con 0x7f98f40f9700 2021-11-03T18:40:02.084 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:40:02.084 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:40:02.084 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:40:02.085 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:40:02.085 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:40:02.085 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:40:02.085 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:40:02.086 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:40:02.086 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:40:02.086 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:40:02.086 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:40:02.086 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:40:02.087 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:40:02.087 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:40:02.087 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:40:02.087 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:40:02.088 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:40:02.088 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:40:02.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.087+0000 7f98f9061700 1 -- 172.21.15.26:0/4228846740 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f98dc064100 msgr2=0x7f98dc0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:40:02.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.087+0000 7f98f9061700 1 --2- 172.21.15.26:0/4228846740 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f98dc064100 0x7f98dc0665c0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 rx=0x7f98f40f6990 tx=0x7f98e400b040).stop 2021-11-03T18:40:02.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.087+0000 7f98f9061700 1 -- 172.21.15.26:0/4228846740 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98f40f9700 msgr2=0x7f98f40f5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:40:02.089 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.087+0000 7f98f9061700 1 --2- 172.21.15.26:0/4228846740 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98f40f9700 0x7f98f40f5080 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 rx=0x7f98e8014040 tx=0x7f98e800b040).stop 2021-11-03T18:40:02.090 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.087+0000 7f98f9061700 1 -- 172.21.15.26:0/4228846740 shutdown_connections 2021-11-03T18:40:02.090 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.087+0000 7f98f9061700 1 --2- 172.21.15.26:0/4228846740 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f98dc064100 0x7f98dc0665c0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:02.090 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.087+0000 7f98f9061700 1 --2- 172.21.15.26:0/4228846740 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98f40602b0 0x7f98f40f6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:02.090 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.087+0000 7f98f9061700 1 --2- 172.21.15.26:0/4228846740 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98f40f9700 0x7f98f40f5080 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:02.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.087+0000 7f98f9061700 1 -- 172.21.15.26:0/4228846740 >> 172.21.15.26:0/4228846740 conn(0x7f98f40f0ba0 msgr2=0x7f98f40f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:40:02.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.087+0000 7f98f9061700 1 -- 172.21.15.26:0/4228846740 shutdown_connections 2021-11-03T18:40:02.091 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.087+0000 7f98f9061700 1 -- 172.21.15.26:0/4228846740 wait complete. 2021-11-03T18:40:02.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.189+0000 7fe6be9a3700 1 -- 172.21.15.26:0/1275754394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6b80f7540 msgr2=0x7fe6b80fdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:40:02.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.189+0000 7fe6be9a3700 1 --2- 172.21.15.26:0/1275754394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6b80f7540 0x7fe6b80fdf60 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 rx=0x7fe6a8004690 tx=0x7fe6a8009b30).stop 2021-11-03T18:40:02.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.190+0000 7fe6be9a3700 1 -- 172.21.15.26:0/1275754394 shutdown_connections 2021-11-03T18:40:02.190 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.190+0000 7fe6be9a3700 1 --2- 172.21.15.26:0/1275754394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6b80f7540 0x7fe6b80fdf60 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:02.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.190+0000 7fe6be9a3700 1 --2- 172.21.15.26:0/1275754394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6b80f6c30 0x7fe6b80f7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:02.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.190+0000 7fe6be9a3700 1 -- 172.21.15.26:0/1275754394 >> 172.21.15.26:0/1275754394 conn(0x7fe6b80f0540 msgr2=0x7fe6b80f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:40:02.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.190+0000 7fe6be9a3700 1 -- 172.21.15.26:0/1275754394 shutdown_connections 2021-11-03T18:40:02.191 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.190+0000 7fe6be9a3700 1 -- 172.21.15.26:0/1275754394 wait complete. 2021-11-03T18:40:02.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.190+0000 7fe6be9a3700 1 Processor -- start 2021-11-03T18:40:02.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.190+0000 7fe6be9a3700 1 -- start start 2021-11-03T18:40:02.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.191+0000 7fe6be9a3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6b80f6c30 0x7fe6b8109070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:40:02.192 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.191+0000 7fe6be9a3700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6b80f7540 0x7fe6b8109560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:40:02.193 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.191+0000 7fe6be9a3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b8109b10 con 0x7fe6b80f6c30 2021-11-03T18:40:02.193 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.191+0000 7fe6be9a3700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b8109c50 con 0x7fe6b80f7540 2021-11-03T18:40:02.193 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.191+0000 7fe6b7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6b80f6c30 0x7fe6b8109070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:40:02.193 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.191+0000 7fe6b7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6b80f6c30 0x7fe6b8109070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33092/0 (socket says 172.21.15.26:33092) 2021-11-03T18:40:02.194 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.191+0000 7fe6b7fff700 1 -- 172.21.15.26:0/1258467370 learned_addr learned my addr 172.21.15.26:0/1258467370 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:40:02.194 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.191+0000 7fe6b77fe700 1 --2- 172.21.15.26:0/1258467370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6b80f7540 0x7fe6b8109560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:40:02.194 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.191+0000 7fe6b7fff700 1 -- 172.21.15.26:0/1258467370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6b80f7540 msgr2=0x7fe6b8109560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:40:02.194 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.191+0000 7fe6b7fff700 1 --2- 172.21.15.26:0/1258467370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6b80f7540 0x7fe6b8109560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:02.194 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.191+0000 7fe6b7fff700 1 -- 172.21.15.26:0/1258467370 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a8005040 con 0x7fe6b80f6c30 2021-11-03T18:40:02.195 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.191+0000 7fe6b7fff700 1 --2- 172.21.15.26:0/1258467370 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6b80f6c30 0x7fe6b8109070 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 rx=0x7fe6ac0026d0 tx=0x7fe6ac009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:40:02.195 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.191+0000 7fe6b4ff9700 1 -- 172.21.15.26:0/1258467370 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6ac0079c0 con 0x7fe6b80f6c30 2021-11-03T18:40:02.195 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.191+0000 7fe6b4ff9700 1 -- 172.21.15.26:0/1258467370 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe6ac00f040 con 0x7fe6b80f6c30 2021-11-03T18:40:02.195 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.191+0000 7fe6be9a3700 1 -- 172.21.15.26:0/1258467370 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6b810a5f0 con 0x7fe6b80f6c30 2021-11-03T18:40:02.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.191+0000 7fe6b4ff9700 1 -- 172.21.15.26:0/1258467370 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6ac0148b0 con 0x7fe6b80f6c30 2021-11-03T18:40:02.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.191+0000 7fe6be9a3700 1 -- 172.21.15.26:0/1258467370 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6b810abb0 con 0x7fe6b80f6c30 2021-11-03T18:40:02.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.192+0000 7fe6be9a3700 1 -- 172.21.15.26:0/1258467370 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6b8045ad0 con 0x7fe6b80f6c30 2021-11-03T18:40:02.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.193+0000 7fe6b4ff9700 1 -- 172.21.15.26:0/1258467370 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fe6ac007b20 con 0x7fe6b80f6c30 2021-11-03T18:40:02.198 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.194+0000 7fe6b4ff9700 1 --2- 172.21.15.26:0/1258467370 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe6a00640b0 0x7fe6a0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:40:02.198 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.194+0000 7fe6b4ff9700 1 -- 172.21.15.26:0/1258467370 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fe6ac080b90 con 0x7fe6b80f6c30 2021-11-03T18:40:02.198 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.194+0000 7fe6b77fe700 1 --2- 172.21.15.26:0/1258467370 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe6a00640b0 0x7fe6a0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:40:02.198 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.194+0000 7fe6b77fe700 1 --2- 172.21.15.26:0/1258467370 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe6a00640b0 0x7fe6a0066570 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7fe6a8005010 tx=0x7fe6a8009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:40:02.199 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.197+0000 7fe6b4ff9700 1 -- 172.21.15.26:0/1258467370 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fe6ac052ef0 con 0x7fe6b80f6c30 2021-11-03T18:40:02.402 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.404+0000 7fe6be9a3700 1 -- 172.21.15.26:0/1258467370 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe6b8101230 con 0x7fe6b80f6c30 2021-11-03T18:40:02.403 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.404+0000 7fe6b4ff9700 1 -- 172.21.15.26:0/1258467370 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fe6ac052ae0 con 0x7fe6b80f6c30 2021-11-03T18:40:02.404 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:40:02.404 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:40:02.405 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:40:02.405 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:40:02.406 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:40:02.406 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:40:02.407 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:40:02.407 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:40:02.408 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:40:02.409 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:40:02.409 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:40:02.409 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:40:02.410 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:40:02.410 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:40:02.411 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:40:02.411 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:40:02.412 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:40:02.412 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:40:02.413 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:40:02.413 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:40:02.413 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:40:02.414 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:40:02.414 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:40:02.415 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:40:02.415 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:40:02.416 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:40:02.416 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:40:02.417 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:40:02.417 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:40:02.417 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:40:02.418 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:40:02.418 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:40:02.419 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:40:02.419 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:40:02.420 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:40:02.420 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:40:02.421 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:40:02.421 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:40:02.422 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:40:02.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.406+0000 7fe6be9a3700 1 -- 172.21.15.26:0/1258467370 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe6a00640b0 msgr2=0x7fe6a0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:40:02.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.406+0000 7fe6be9a3700 1 --2- 172.21.15.26:0/1258467370 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe6a00640b0 0x7fe6a0066570 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7fe6a8005010 tx=0x7fe6a8009b30).stop 2021-11-03T18:40:02.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.406+0000 7fe6be9a3700 1 -- 172.21.15.26:0/1258467370 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6b80f6c30 msgr2=0x7fe6b8109070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:40:02.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.406+0000 7fe6be9a3700 1 --2- 172.21.15.26:0/1258467370 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6b80f6c30 0x7fe6b8109070 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 rx=0x7fe6ac0026d0 tx=0x7fe6ac009de0).stop 2021-11-03T18:40:02.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.406+0000 7fe6be9a3700 1 -- 172.21.15.26:0/1258467370 shutdown_connections 2021-11-03T18:40:02.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.406+0000 7fe6be9a3700 1 --2- 172.21.15.26:0/1258467370 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fe6a00640b0 0x7fe6a0066570 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:02.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.406+0000 7fe6be9a3700 1 --2- 172.21.15.26:0/1258467370 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6b80f6c30 0x7fe6b8109070 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:02.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.406+0000 7fe6be9a3700 1 --2- 172.21.15.26:0/1258467370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6b80f7540 0x7fe6b8109560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:02.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.406+0000 7fe6be9a3700 1 -- 172.21.15.26:0/1258467370 >> 172.21.15.26:0/1258467370 conn(0x7fe6b80f0540 msgr2=0x7fe6b80f2930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:40:02.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.406+0000 7fe6be9a3700 1 -- 172.21.15.26:0/1258467370 shutdown_connections 2021-11-03T18:40:02.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:02.406+0000 7fe6be9a3700 1 -- 172.21.15.26:0/1258467370 wait complete. 2021-11-03T18:40:02.428 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:40:02.428 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:02 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/4228846740' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:40:02.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:02 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/4228846740' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:40:03.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:03 smithi026 ceph-mon[96795]: from='client.37388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:40:03.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:03 smithi026 ceph-mon[96795]: from='client.37392 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:40:03.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:03 smithi026 ceph-mon[96795]: pgmap v3161: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:03.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:03 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1258467370' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:40:03.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:03 smithi194 ceph-mon[65619]: from='client.37388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:40:03.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:03 smithi194 ceph-mon[65619]: from='client.37392 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:40:03.475 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:03 smithi194 ceph-mon[65619]: pgmap v3161: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:03.475 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:03 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1258467370' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:40:05.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:05 smithi026 ceph-mon[96795]: pgmap v3162: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:05.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:05 smithi194 ceph-mon[65619]: pgmap v3162: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:07.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:07 smithi194 ceph-mon[65619]: pgmap v3163: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:07.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:07 smithi026 ceph-mon[96795]: pgmap v3163: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:09.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:09 smithi194 ceph-mon[65619]: pgmap v3164: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:09.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:09 smithi026 ceph-mon[96795]: pgmap v3164: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:11.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:11 smithi026 ceph-mon[96795]: pgmap v3165: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:11.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:11 smithi194 ceph-mon[65619]: pgmap v3165: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:12.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:12 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:40:12.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:12 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:40:13.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:13 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:40:13.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:13 smithi026 ceph-mon[96795]: pgmap v3166: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:13.475 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:13 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:40:13.475 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:13 smithi194 ceph-mon[65619]: pgmap v3166: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:15.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:15 smithi026 ceph-mon[96795]: pgmap v3167: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:15.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:15 smithi194 ceph-mon[65619]: pgmap v3167: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:17.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:17 smithi026 ceph-mon[96795]: pgmap v3168: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:17.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:17 smithi194 ceph-mon[65619]: pgmap v3168: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:19.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:19 smithi026 ceph-mon[96795]: pgmap v3169: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:19.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:19 smithi194 ceph-mon[65619]: pgmap v3169: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:21.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:21 smithi026 ceph-mon[96795]: pgmap v3170: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:21.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:21 smithi194 ceph-mon[65619]: pgmap v3170: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:23.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:23 smithi026 ceph-mon[96795]: pgmap v3171: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:23.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:23 smithi194 ceph-mon[65619]: pgmap v3171: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:25.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:25 smithi026 ceph-mon[96795]: pgmap v3172: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:25.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:25 smithi194 ceph-mon[65619]: pgmap v3172: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:27.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:27 smithi026 ceph-mon[96795]: pgmap v3173: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:27.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:27 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:40:27.505 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:27 smithi194 ceph-mon[65619]: pgmap v3173: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:27.505 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:27 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:40:28.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:28 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:40:28.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:28 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:40:29.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:29 smithi026 ceph-mon[96795]: pgmap v3174: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:29.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:29 smithi194 ceph-mon[65619]: pgmap v3174: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:31.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:31 smithi026 ceph-mon[96795]: pgmap v3175: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:31.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:31 smithi194 ceph-mon[65619]: pgmap v3175: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:32.518 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.520+0000 7f7d3d5a0700 1 -- 172.21.15.26:0/864528300 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d380f4d60 msgr2=0x7f7d380f5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:40:32.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.520+0000 7f7d3d5a0700 1 --2- 172.21.15.26:0/864528300 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d380f4d60 0x7f7d380f5180 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 rx=0x7f7d300099e0 tx=0x7f7d30004d10).stop 2021-11-03T18:40:32.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.520+0000 7f7d3d5a0700 1 -- 172.21.15.26:0/864528300 shutdown_connections 2021-11-03T18:40:32.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.520+0000 7f7d3d5a0700 1 --2- 172.21.15.26:0/864528300 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d380f5f60 0x7f7d380f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:32.520 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.520+0000 7f7d3d5a0700 1 --2- 172.21.15.26:0/864528300 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d380f4d60 0x7f7d380f5180 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:32.520 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.520+0000 7f7d3d5a0700 1 -- 172.21.15.26:0/864528300 >> 172.21.15.26:0/864528300 conn(0x7f7d380f04c0 msgr2=0x7f7d380f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:40:32.520 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.520+0000 7f7d3d5a0700 1 -- 172.21.15.26:0/864528300 shutdown_connections 2021-11-03T18:40:32.520 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.520+0000 7f7d3d5a0700 1 -- 172.21.15.26:0/864528300 wait complete. 2021-11-03T18:40:32.523 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.521+0000 7f7d3d5a0700 1 Processor -- start 2021-11-03T18:40:32.524 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.521+0000 7f7d3d5a0700 1 -- start start 2021-11-03T18:40:32.524 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.521+0000 7f7d3d5a0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d380f4d60 0x7f7d38109d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:40:32.524 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.521+0000 7f7d3d5a0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d380f5f60 0x7f7d3810c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:40:32.525 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.521+0000 7f7d3d5a0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d380f7fb0 con 0x7f7d380f5f60 2021-11-03T18:40:32.525 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.521+0000 7f7d3d5a0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d380f80f0 con 0x7f7d380f4d60 2021-11-03T18:40:32.525 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.521+0000 7f7d367fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d380f5f60 0x7f7d3810c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:40:32.525 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.521+0000 7f7d367fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d380f5f60 0x7f7d3810c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33112/0 (socket says 172.21.15.26:33112) 2021-11-03T18:40:32.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.521+0000 7f7d367fc700 1 -- 172.21.15.26:0/717569881 learned_addr learned my addr 172.21.15.26:0/717569881 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:40:32.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.522+0000 7f7d36ffd700 1 --2- 172.21.15.26:0/717569881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d380f4d60 0x7f7d38109d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:40:32.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.522+0000 7f7d367fc700 1 -- 172.21.15.26:0/717569881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d380f4d60 msgr2=0x7f7d38109d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:40:32.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.522+0000 7f7d367fc700 1 --2- 172.21.15.26:0/717569881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d380f4d60 0x7f7d38109d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:32.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.522+0000 7f7d367fc700 1 -- 172.21.15.26:0/717569881 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d30009640 con 0x7f7d380f5f60 2021-11-03T18:40:32.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.522+0000 7f7d36ffd700 1 --2- 172.21.15.26:0/717569881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d380f4d60 0x7f7d38109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:40:32.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.522+0000 7f7d367fc700 1 --2- 172.21.15.26:0/717569881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d380f5f60 0x7f7d3810c250 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 rx=0x7f7d20002700 tx=0x7f7d20009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:40:32.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.522+0000 7f7d2f7fe700 1 -- 172.21.15.26:0/717569881 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d20009320 con 0x7f7d380f5f60 2021-11-03T18:40:32.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.522+0000 7f7d3d5a0700 1 -- 172.21.15.26:0/717569881 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d3810c800 con 0x7f7d380f5f60 2021-11-03T18:40:32.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.522+0000 7f7d2f7fe700 1 -- 172.21.15.26:0/717569881 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7d2000f040 con 0x7f7d380f5f60 2021-11-03T18:40:32.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.522+0000 7f7d2f7fe700 1 -- 172.21.15.26:0/717569881 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d20014820 con 0x7f7d380f5f60 2021-11-03T18:40:32.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.522+0000 7f7d3d5a0700 1 -- 172.21.15.26:0/717569881 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d3810cd10 con 0x7f7d380f5f60 2021-11-03T18:40:32.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.523+0000 7f7d3d5a0700 1 -- 172.21.15.26:0/717569881 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d380f4150 con 0x7f7d380f5f60 2021-11-03T18:40:32.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.524+0000 7f7d2f7fe700 1 -- 172.21.15.26:0/717569881 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f7d20009480 con 0x7f7d380f5f60 2021-11-03T18:40:32.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.524+0000 7f7d2f7fe700 1 --2- 172.21.15.26:0/717569881 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7d240640b0 0x7f7d24066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:40:32.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.524+0000 7f7d2f7fe700 1 -- 172.21.15.26:0/717569881 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f7d20080a40 con 0x7f7d380f5f60 2021-11-03T18:40:32.530 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.524+0000 7f7d36ffd700 1 --2- 172.21.15.26:0/717569881 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7d240640b0 0x7f7d24066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:40:32.530 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.525+0000 7f7d36ffd700 1 --2- 172.21.15.26:0/717569881 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7d240640b0 0x7f7d24066570 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7f7d30009f50 tx=0x7f7d30004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:40:32.530 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.528+0000 7f7d2f7fe700 1 -- 172.21.15.26:0/717569881 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f7d20052da0 con 0x7f7d380f5f60 2021-11-03T18:40:32.705 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.707+0000 7f7d3d5a0700 1 -- 172.21.15.26:0/717569881 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7d380faa40 con 0x7f7d240640b0 2021-11-03T18:40:32.706 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.709+0000 7f7d2f7fe700 1 -- 172.21.15.26:0/717569881 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f7d380faa40 con 0x7f7d240640b0 2021-11-03T18:40:32.708 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.710+0000 7f7d3d5a0700 1 -- 172.21.15.26:0/717569881 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7d240640b0 msgr2=0x7f7d24066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:40:32.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.710+0000 7f7d3d5a0700 1 --2- 172.21.15.26:0/717569881 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7d240640b0 0x7f7d24066570 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7f7d30009f50 tx=0x7f7d30004d10).stop 2021-11-03T18:40:32.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.710+0000 7f7d3d5a0700 1 -- 172.21.15.26:0/717569881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d380f5f60 msgr2=0x7f7d3810c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:40:32.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.710+0000 7f7d3d5a0700 1 --2- 172.21.15.26:0/717569881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d380f5f60 0x7f7d3810c250 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 rx=0x7f7d20002700 tx=0x7f7d20009e00).stop 2021-11-03T18:40:32.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.710+0000 7f7d3d5a0700 1 -- 172.21.15.26:0/717569881 shutdown_connections 2021-11-03T18:40:32.710 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.710+0000 7f7d3d5a0700 1 --2- 172.21.15.26:0/717569881 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7d240640b0 0x7f7d24066570 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:32.710 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.710+0000 7f7d3d5a0700 1 --2- 172.21.15.26:0/717569881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d380f4d60 0x7f7d38109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:32.710 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.710+0000 7f7d3d5a0700 1 --2- 172.21.15.26:0/717569881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d380f5f60 0x7f7d3810c250 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:32.710 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.710+0000 7f7d3d5a0700 1 -- 172.21.15.26:0/717569881 >> 172.21.15.26:0/717569881 conn(0x7f7d380f04c0 msgr2=0x7f7d380fa330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:40:32.710 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.710+0000 7f7d3d5a0700 1 -- 172.21.15.26:0/717569881 shutdown_connections 2021-11-03T18:40:32.711 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.711+0000 7f7d3d5a0700 1 -- 172.21.15.26:0/717569881 wait complete. 2021-11-03T18:40:32.718 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:40:32.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.810+0000 7fc3e08c4700 1 -- 172.21.15.26:0/276787132 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3dc0f66e0 msgr2=0x7fc3dc0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:40:32.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.810+0000 7fc3e08c4700 1 --2- 172.21.15.26:0/276787132 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3dc0f66e0 0x7fc3dc0f6b00 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 rx=0x7fc3cc004660 tx=0x7fc3cc009b30).stop 2021-11-03T18:40:32.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.810+0000 7fc3e08c4700 1 -- 172.21.15.26:0/276787132 shutdown_connections 2021-11-03T18:40:32.811 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.810+0000 7fc3e08c4700 1 --2- 172.21.15.26:0/276787132 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3dc0f6ff0 0x7fc3dc0f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:32.811 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.810+0000 7fc3e08c4700 1 --2- 172.21.15.26:0/276787132 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3dc0f66e0 0x7fc3dc0f6b00 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:32.811 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.810+0000 7fc3e08c4700 1 -- 172.21.15.26:0/276787132 >> 172.21.15.26:0/276787132 conn(0x7fc3dc0f1f00 msgr2=0x7fc3dc0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:40:32.811 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.810+0000 7fc3e08c4700 1 -- 172.21.15.26:0/276787132 shutdown_connections 2021-11-03T18:40:32.812 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.810+0000 7fc3e08c4700 1 -- 172.21.15.26:0/276787132 wait complete. 2021-11-03T18:40:32.812 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.811+0000 7fc3e08c4700 1 Processor -- start 2021-11-03T18:40:32.812 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.811+0000 7fc3e08c4700 1 -- start start 2021-11-03T18:40:32.812 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.811+0000 7fc3e08c4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3dc0f66e0 0x7fc3dc106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:40:32.812 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.811+0000 7fc3e08c4700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3dc0f6ff0 0x7fc3dc107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:40:32.813 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.811+0000 7fc3e08c4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc107a00 con 0x7fc3dc0f66e0 2021-11-03T18:40:32.813 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.811+0000 7fc3e08c4700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc107b40 con 0x7fc3dc0f6ff0 2021-11-03T18:40:32.813 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.811+0000 7fc3da59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3dc0f66e0 0x7fc3dc106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:40:32.813 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.811+0000 7fc3da59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3dc0f66e0 0x7fc3dc106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33120/0 (socket says 172.21.15.26:33120) 2021-11-03T18:40:32.814 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.811+0000 7fc3da59c700 1 -- 172.21.15.26:0/1021825735 learned_addr learned my addr 172.21.15.26:0/1021825735 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:40:32.814 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.811+0000 7fc3d9d9b700 1 --2- 172.21.15.26:0/1021825735 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3dc0f6ff0 0x7fc3dc107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:40:32.814 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.811+0000 7fc3da59c700 1 -- 172.21.15.26:0/1021825735 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3dc0f6ff0 msgr2=0x7fc3dc107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:40:32.814 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.811+0000 7fc3da59c700 1 --2- 172.21.15.26:0/1021825735 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3dc0f6ff0 0x7fc3dc107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:32.815 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.811+0000 7fc3da59c700 1 -- 172.21.15.26:0/1021825735 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3cc005040 con 0x7fc3dc0f66e0 2021-11-03T18:40:32.815 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.811+0000 7fc3da59c700 1 --2- 172.21.15.26:0/1021825735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3dc0f66e0 0x7fc3dc106f60 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 rx=0x7fc3cc009990 tx=0x7fc3cc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:40:32.815 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.812+0000 7fc3caffd700 1 -- 172.21.15.26:0/1021825735 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3cc018070 con 0x7fc3dc0f66e0 2021-11-03T18:40:32.815 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.812+0000 7fc3caffd700 1 -- 172.21.15.26:0/1021825735 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc3cc007ca0 con 0x7fc3dc0f66e0 2021-11-03T18:40:32.816 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.812+0000 7fc3caffd700 1 -- 172.21.15.26:0/1021825735 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3cc01c620 con 0x7fc3dc0f66e0 2021-11-03T18:40:32.816 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.812+0000 7fc3e08c4700 1 -- 172.21.15.26:0/1021825735 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3dc108480 con 0x7fc3dc0f66e0 2021-11-03T18:40:32.816 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.812+0000 7fc3e08c4700 1 -- 172.21.15.26:0/1021825735 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3dc108990 con 0x7fc3dc0f66e0 2021-11-03T18:40:32.817 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.813+0000 7fc3e08c4700 1 -- 172.21.15.26:0/1021825735 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3dc045ad0 con 0x7fc3dc0f66e0 2021-11-03T18:40:32.817 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.813+0000 7fc3caffd700 1 -- 172.21.15.26:0/1021825735 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc3cc01d960 con 0x7fc3dc0f66e0 2021-11-03T18:40:32.818 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.814+0000 7fc3caffd700 1 --2- 172.21.15.26:0/1021825735 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3c40640b0 0x7fc3c4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:40:32.818 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.814+0000 7fc3caffd700 1 -- 172.21.15.26:0/1021825735 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc3cc082710 con 0x7fc3dc0f66e0 2021-11-03T18:40:32.818 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.814+0000 7fc3d9d9b700 1 --2- 172.21.15.26:0/1021825735 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3c40640b0 0x7fc3c4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:40:32.818 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.814+0000 7fc3d9d9b700 1 --2- 172.21.15.26:0/1021825735 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3c40640b0 0x7fc3c4066570 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7fc3d00041d0 tx=0x7fc3d0009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:40:32.819 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.818+0000 7fc3caffd700 1 -- 172.21.15.26:0/1021825735 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc3cc0549f0 con 0x7fc3dc0f66e0 2021-11-03T18:40:32.987 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:32.988+0000 7fc3e08c4700 1 -- 172.21.15.26:0/1021825735 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3dc108c00 con 0x7fc3c40640b0 2021-11-03T18:40:33.001 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.003+0000 7fc3caffd700 1 -- 172.21.15.26:0/1021825735 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7fc3dc108c00 con 0x7fc3c40640b0 2021-11-03T18:40:33.001 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:40:33.002 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (111m) 9m ago 113m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:40:33.002 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (104m) 9m ago 113m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:40:33.002 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (103m) 8m ago 112m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:40:33.002 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (111m) 9m ago 112m 42.3M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:40:33.003 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (104m) 9m ago 108m 26.2M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:40:33.003 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (105m) 9m ago 108m 26.8M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:40:33.003 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (108m) 8m ago 108m 27.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:40:33.003 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (108m) 8m ago 108m 27.4M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:40:33.004 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (105m) 9m ago 114m 601M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:40:33.004 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (105m) 8m ago 112m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:40:33.004 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (104m) 9m ago 114m 374M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:40:33.004 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (104m) 8m ago 112m 171M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:40:33.004 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (112m) 9m ago 112m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:40:33.005 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (112m) 8m ago 112m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:40:33.005 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (103m) 9m ago 111m 352M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:40:33.005 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (103m) 9m ago 111m 379M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:40:33.005 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (102m) 9m ago 110m 314M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:40:33.006 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (102m) 8m ago 110m 413M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:40:33.006 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (101m) 8m ago 110m 339M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:40:33.006 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (101m) 8m ago 109m 337M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:40:33.006 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (111m) 9m ago 112m 68.0M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:40:33.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.005+0000 7fc3e08c4700 1 -- 172.21.15.26:0/1021825735 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3c40640b0 msgr2=0x7fc3c4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:40:33.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.005+0000 7fc3e08c4700 1 --2- 172.21.15.26:0/1021825735 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3c40640b0 0x7fc3c4066570 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7fc3d00041d0 tx=0x7fc3d0009040).stop 2021-11-03T18:40:33.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.005+0000 7fc3e08c4700 1 -- 172.21.15.26:0/1021825735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3dc0f66e0 msgr2=0x7fc3dc106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:40:33.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.005+0000 7fc3e08c4700 1 --2- 172.21.15.26:0/1021825735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3dc0f66e0 0x7fc3dc106f60 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 rx=0x7fc3cc009990 tx=0x7fc3cc009b30).stop 2021-11-03T18:40:33.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.005+0000 7fc3e08c4700 1 -- 172.21.15.26:0/1021825735 shutdown_connections 2021-11-03T18:40:33.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.005+0000 7fc3e08c4700 1 --2- 172.21.15.26:0/1021825735 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3c40640b0 0x7fc3c4066570 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:33.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.005+0000 7fc3e08c4700 1 --2- 172.21.15.26:0/1021825735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3dc0f66e0 0x7fc3dc106f60 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:33.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.005+0000 7fc3e08c4700 1 --2- 172.21.15.26:0/1021825735 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3dc0f6ff0 0x7fc3dc107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:33.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.005+0000 7fc3e08c4700 1 -- 172.21.15.26:0/1021825735 >> 172.21.15.26:0/1021825735 conn(0x7fc3dc0f1f00 msgr2=0x7fc3dc0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:40:33.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.005+0000 7fc3e08c4700 1 -- 172.21.15.26:0/1021825735 shutdown_connections 2021-11-03T18:40:33.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.005+0000 7fc3e08c4700 1 -- 172.21.15.26:0/1021825735 wait complete. 2021-11-03T18:40:33.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.105+0000 7f26f6b97700 1 -- 172.21.15.26:0/2891993927 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26f00f5340 msgr2=0x7f26f00f7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:40:33.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.105+0000 7f26f6b97700 1 --2- 172.21.15.26:0/2891993927 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26f00f5340 0x7f26f00f7ac0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 rx=0x7f26dc004660 tx=0x7f26dc009b30).stop 2021-11-03T18:40:33.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.105+0000 7f26f6b97700 1 -- 172.21.15.26:0/2891993927 shutdown_connections 2021-11-03T18:40:33.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.105+0000 7f26f6b97700 1 --2- 172.21.15.26:0/2891993927 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26f00f5340 0x7f26f00f7ac0 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:33.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.105+0000 7f26f6b97700 1 --2- 172.21.15.26:0/2891993927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26f00f49a0 0x7f26f00f4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:33.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.105+0000 7f26f6b97700 1 -- 172.21.15.26:0/2891993927 >> 172.21.15.26:0/2891993927 conn(0x7f26f00f04c0 msgr2=0x7f26f00f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:40:33.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.105+0000 7f26f6b97700 1 -- 172.21.15.26:0/2891993927 shutdown_connections 2021-11-03T18:40:33.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.105+0000 7f26f6b97700 1 -- 172.21.15.26:0/2891993927 wait complete. 2021-11-03T18:40:33.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.105+0000 7f26f6b97700 1 Processor -- start 2021-11-03T18:40:33.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.105+0000 7f26f6b97700 1 -- start start 2021-11-03T18:40:33.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.106+0000 7f26f6b97700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26f00f49a0 0x7f26f0106fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:40:33.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.106+0000 7f26f6b97700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26f00f5340 0x7f26f01074b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:40:33.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.106+0000 7f26f6b97700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f0107a60 con 0x7f26f00f49a0 2021-11-03T18:40:33.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.106+0000 7f26f6b97700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f0107ba0 con 0x7f26f00f5340 2021-11-03T18:40:33.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.106+0000 7f26f4933700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26f00f49a0 0x7f26f0106fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:40:33.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.106+0000 7f26f4933700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26f00f49a0 0x7f26f0106fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33130/0 (socket says 172.21.15.26:33130) 2021-11-03T18:40:33.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.106+0000 7f26f4933700 1 -- 172.21.15.26:0/3570910050 learned_addr learned my addr 172.21.15.26:0/3570910050 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:40:33.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.106+0000 7f26effff700 1 --2- 172.21.15.26:0/3570910050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26f00f5340 0x7f26f01074b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:40:33.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.106+0000 7f26f4933700 1 -- 172.21.15.26:0/3570910050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26f00f5340 msgr2=0x7f26f01074b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:40:33.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.106+0000 7f26f4933700 1 --2- 172.21.15.26:0/3570910050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26f00f5340 0x7f26f01074b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:33.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.106+0000 7f26f4933700 1 -- 172.21.15.26:0/3570910050 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26dc005040 con 0x7f26f00f49a0 2021-11-03T18:40:33.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.106+0000 7f26effff700 1 --2- 172.21.15.26:0/3570910050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26f00f5340 0x7f26f01074b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:40:33.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.106+0000 7f26f4933700 1 --2- 172.21.15.26:0/3570910050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26f00f49a0 0x7f26f0106fc0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 rx=0x7f26e4002700 tx=0x7f26e4009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:40:33.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.106+0000 7f26ed7fa700 1 -- 172.21.15.26:0/3570910050 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26e4009320 con 0x7f26f00f49a0 2021-11-03T18:40:33.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.106+0000 7f26f6b97700 1 -- 172.21.15.26:0/3570910050 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26f0108540 con 0x7f26f00f49a0 2021-11-03T18:40:33.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.106+0000 7f26ed7fa700 1 -- 172.21.15.26:0/3570910050 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f26e400f040 con 0x7f26f00f49a0 2021-11-03T18:40:33.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.106+0000 7f26ed7fa700 1 -- 172.21.15.26:0/3570910050 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26e40148e0 con 0x7f26f00f49a0 2021-11-03T18:40:33.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.106+0000 7f26f6b97700 1 -- 172.21.15.26:0/3570910050 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26f0108b00 con 0x7f26f00f49a0 2021-11-03T18:40:33.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.107+0000 7f26f6b97700 1 -- 172.21.15.26:0/3570910050 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26f0045ad0 con 0x7f26f00f49a0 2021-11-03T18:40:33.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.108+0000 7f26ed7fa700 1 -- 172.21.15.26:0/3570910050 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f26e4009480 con 0x7f26f00f49a0 2021-11-03T18:40:33.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.108+0000 7f26ed7fa700 1 --2- 172.21.15.26:0/3570910050 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f26e0064090 0x7f26e0066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:40:33.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.108+0000 7f26ed7fa700 1 -- 172.21.15.26:0/3570910050 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f26e4080af0 con 0x7f26f00f49a0 2021-11-03T18:40:33.112 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.108+0000 7f26effff700 1 --2- 172.21.15.26:0/3570910050 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f26e0064090 0x7f26e0066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:40:33.113 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.109+0000 7f26effff700 1 --2- 172.21.15.26:0/3570910050 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f26e0064090 0x7f26e0066550 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7f26dc004630 tx=0x7f26dc009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:40:33.113 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.112+0000 7f26ed7fa700 1 -- 172.21.15.26:0/3570910050 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f26e4052e50 con 0x7f26f00f49a0 2021-11-03T18:40:33.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.348+0000 7f26f6b97700 1 -- 172.21.15.26:0/3570910050 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f26f0108d80 con 0x7f26f00f49a0 2021-11-03T18:40:33.347 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.348+0000 7f26ed7fa700 1 -- 172.21.15.26:0/3570910050 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f26e4052a40 con 0x7f26f00f49a0 2021-11-03T18:40:33.347 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:40:33.347 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:40:33.348 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:40:33.348 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:40:33.348 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:40:33.348 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:40:33.349 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:40:33.349 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:40:33.349 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:40:33.349 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:40:33.350 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:40:33.350 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:40:33.350 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:40:33.350 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:40:33.351 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:40:33.351 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:40:33.351 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:40:33.351 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:40:33.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.350+0000 7f26f6b97700 1 -- 172.21.15.26:0/3570910050 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f26e0064090 msgr2=0x7f26e0066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:40:33.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.350+0000 7f26f6b97700 1 --2- 172.21.15.26:0/3570910050 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f26e0064090 0x7f26e0066550 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7f26dc004630 tx=0x7f26dc009b30).stop 2021-11-03T18:40:33.353 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.350+0000 7f26f6b97700 1 -- 172.21.15.26:0/3570910050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26f00f49a0 msgr2=0x7f26f0106fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:40:33.353 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.350+0000 7f26f6b97700 1 --2- 172.21.15.26:0/3570910050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26f00f49a0 0x7f26f0106fc0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 rx=0x7f26e4002700 tx=0x7f26e4009e00).stop 2021-11-03T18:40:33.353 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.350+0000 7f26f6b97700 1 -- 172.21.15.26:0/3570910050 shutdown_connections 2021-11-03T18:40:33.353 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.350+0000 7f26f6b97700 1 --2- 172.21.15.26:0/3570910050 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f26e0064090 0x7f26e0066550 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:33.354 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.350+0000 7f26f6b97700 1 --2- 172.21.15.26:0/3570910050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26f00f49a0 0x7f26f0106fc0 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:33.354 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.350+0000 7f26f6b97700 1 --2- 172.21.15.26:0/3570910050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26f00f5340 0x7f26f01074b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:33.354 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.350+0000 7f26f6b97700 1 -- 172.21.15.26:0/3570910050 >> 172.21.15.26:0/3570910050 conn(0x7f26f00f04c0 msgr2=0x7f26f00fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:40:33.354 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.351+0000 7f26f6b97700 1 -- 172.21.15.26:0/3570910050 shutdown_connections 2021-11-03T18:40:33.355 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.351+0000 7f26f6b97700 1 -- 172.21.15.26:0/3570910050 wait complete. 2021-11-03T18:40:33.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:33 smithi026 ceph-mon[96795]: pgmap v3176: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:33.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.450+0000 7fcbcec93700 1 -- 172.21.15.26:0/4122848187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbc8060310 msgr2=0x7fcbc80f6f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:40:33.449 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.450+0000 7fcbcec93700 1 --2- 172.21.15.26:0/4122848187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbc8060310 0x7fcbc80f6f10 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 rx=0x7fcbc4004660 tx=0x7fcbc4009b30).stop 2021-11-03T18:40:33.450 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.450+0000 7fcbcec93700 1 -- 172.21.15.26:0/4122848187 shutdown_connections 2021-11-03T18:40:33.450 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.450+0000 7fcbcec93700 1 --2- 172.21.15.26:0/4122848187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbc80f7490 0x7fcbc80f9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:33.450 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.450+0000 7fcbcec93700 1 --2- 172.21.15.26:0/4122848187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbc8060310 0x7fcbc80f6f10 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:33.450 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.450+0000 7fcbcec93700 1 -- 172.21.15.26:0/4122848187 >> 172.21.15.26:0/4122848187 conn(0x7fcbc80f0ba0 msgr2=0x7fcbc80f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:40:33.451 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.451+0000 7fcbcec93700 1 -- 172.21.15.26:0/4122848187 shutdown_connections 2021-11-03T18:40:33.451 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.451+0000 7fcbcec93700 1 -- 172.21.15.26:0/4122848187 wait complete. 2021-11-03T18:40:33.451 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.451+0000 7fcbcec93700 1 Processor -- start 2021-11-03T18:40:33.451 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.451+0000 7fcbcec93700 1 -- start start 2021-11-03T18:40:33.451 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.451+0000 7fcbcec93700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbc8060310 0x7fcbc810d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:40:33.452 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.451+0000 7fcbcec93700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbc80f7490 0x7fcbc810d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:40:33.452 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.451+0000 7fcbcec93700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc810de30 con 0x7fcbc80f7490 2021-11-03T18:40:33.452 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.451+0000 7fcbcec93700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc810df70 con 0x7fcbc8060310 2021-11-03T18:40:33.454 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.451+0000 7fcbcd490700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbc80f7490 0x7fcbc810d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:40:33.454 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.451+0000 7fcbcd490700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbc80f7490 0x7fcbc810d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33142/0 (socket says 172.21.15.26:33142) 2021-11-03T18:40:33.455 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.452+0000 7fcbcd490700 1 -- 172.21.15.26:0/2141730179 learned_addr learned my addr 172.21.15.26:0/2141730179 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:40:33.455 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.452+0000 7fcbcdc91700 1 --2- 172.21.15.26:0/2141730179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbc8060310 0x7fcbc810d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:40:33.455 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.452+0000 7fcbcd490700 1 -- 172.21.15.26:0/2141730179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbc8060310 msgr2=0x7fcbc810d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:40:33.455 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.452+0000 7fcbcd490700 1 --2- 172.21.15.26:0/2141730179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbc8060310 0x7fcbc810d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:33.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.452+0000 7fcbcd490700 1 -- 172.21.15.26:0/2141730179 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc4005040 con 0x7fcbc80f7490 2021-11-03T18:40:33.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.452+0000 7fcbcd490700 1 --2- 172.21.15.26:0/2141730179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbc80f7490 0x7fcbc810d880 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 rx=0x7fcbb800c510 tx=0x7fcbb8007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:40:33.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.452+0000 7fcbbe7fc700 1 -- 172.21.15.26:0/2141730179 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbb800f650 con 0x7fcbc80f7490 2021-11-03T18:40:33.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.452+0000 7fcbbe7fc700 1 -- 172.21.15.26:0/2141730179 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcbb800fc60 con 0x7fcbc80f7490 2021-11-03T18:40:33.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.452+0000 7fcbbe7fc700 1 -- 172.21.15.26:0/2141730179 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbb8012c50 con 0x7fcbc80f7490 2021-11-03T18:40:33.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.452+0000 7fcbcec93700 1 -- 172.21.15.26:0/2141730179 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbc810e910 con 0x7fcbc80f7490 2021-11-03T18:40:33.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.452+0000 7fcbcec93700 1 -- 172.21.15.26:0/2141730179 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc810eed0 con 0x7fcbc80f7490 2021-11-03T18:40:33.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.453+0000 7fcbcec93700 1 -- 172.21.15.26:0/2141730179 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbc8045ad0 con 0x7fcbc80f7490 2021-11-03T18:40:33.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.453+0000 7fcbbe7fc700 1 -- 172.21.15.26:0/2141730179 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fcbb8010070 con 0x7fcbc80f7490 2021-11-03T18:40:33.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.454+0000 7fcbbe7fc700 1 --2- 172.21.15.26:0/2141730179 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcbb4064100 0x7fcbb40665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:40:33.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.454+0000 7fcbbe7fc700 1 -- 172.21.15.26:0/2141730179 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fcbb80805e0 con 0x7fcbc80f7490 2021-11-03T18:40:33.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.454+0000 7fcbcdc91700 1 --2- 172.21.15.26:0/2141730179 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcbb4064100 0x7fcbb40665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:40:33.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.454+0000 7fcbcdc91700 1 --2- 172.21.15.26:0/2141730179 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcbb4064100 0x7fcbb40665c0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7fcbc4004630 tx=0x7fcbc4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:40:33.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.458+0000 7fcbbe7fc700 1 -- 172.21.15.26:0/2141730179 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fcbb8052850 con 0x7fcbc80f7490 2021-11-03T18:40:33.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:33 smithi194 ceph-mon[65619]: pgmap v3176: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:33.661 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.662+0000 7fcbcec93700 1 -- 172.21.15.26:0/2141730179 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcbc8027a00 con 0x7fcbc80f7490 2021-11-03T18:40:33.661 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.663+0000 7fcbbe7fc700 1 -- 172.21.15.26:0/2141730179 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fcbb8052440 con 0x7fcbc80f7490 2021-11-03T18:40:33.661 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:40:33.662 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:40:33.662 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:40:33.662 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:40:33.662 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:40:33.663 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:40:33.663 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:40:33.663 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:40:33.664 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:40:33.664 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:40:33.664 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:40:33.664 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:40:33.664 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:40:33.665 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:40:33.665 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:40:33.665 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:40:33.665 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:40:33.666 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:40:33.666 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:40:33.666 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:40:33.666 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:40:33.667 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:40:33.667 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:40:33.667 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:40:33.667 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:40:33.667 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:40:33.668 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:40:33.668 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:40:33.668 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:40:33.668 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:40:33.669 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:40:33.669 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:40:33.669 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:40:33.669 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:40:33.670 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:40:33.670 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:40:33.670 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:40:33.670 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:40:33.671 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:40:33.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.665+0000 7fcbcec93700 1 -- 172.21.15.26:0/2141730179 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcbb4064100 msgr2=0x7fcbb40665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:40:33.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.665+0000 7fcbcec93700 1 --2- 172.21.15.26:0/2141730179 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcbb4064100 0x7fcbb40665c0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7fcbc4004630 tx=0x7fcbc4009b30).stop 2021-11-03T18:40:33.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.665+0000 7fcbcec93700 1 -- 172.21.15.26:0/2141730179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbc80f7490 msgr2=0x7fcbc810d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:40:33.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.665+0000 7fcbcec93700 1 --2- 172.21.15.26:0/2141730179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbc80f7490 0x7fcbc810d880 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 rx=0x7fcbb800c510 tx=0x7fcbb8007e00).stop 2021-11-03T18:40:33.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.665+0000 7fcbcec93700 1 -- 172.21.15.26:0/2141730179 shutdown_connections 2021-11-03T18:40:33.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.665+0000 7fcbcec93700 1 --2- 172.21.15.26:0/2141730179 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcbb4064100 0x7fcbb40665c0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:33.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.665+0000 7fcbcec93700 1 --2- 172.21.15.26:0/2141730179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbc8060310 0x7fcbc810d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:33.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.665+0000 7fcbcec93700 1 --2- 172.21.15.26:0/2141730179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbc80f7490 0x7fcbc810d880 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:40:33.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.665+0000 7fcbcec93700 1 -- 172.21.15.26:0/2141730179 >> 172.21.15.26:0/2141730179 conn(0x7fcbc80f0ba0 msgr2=0x7fcbc80f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:40:33.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.665+0000 7fcbcec93700 1 -- 172.21.15.26:0/2141730179 shutdown_connections 2021-11-03T18:40:33.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:40:33.665+0000 7fcbcec93700 1 -- 172.21.15.26:0/2141730179 wait complete. 2021-11-03T18:40:33.674 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:40:34.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:34 smithi026 ceph-mon[96795]: from='client.37404 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:40:34.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:34 smithi026 ceph-mon[96795]: from='client.37408 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:40:34.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:34 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3570910050' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:40:34.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:34 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2141730179' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:40:34.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:34 smithi194 ceph-mon[65619]: from='client.37404 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:40:34.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:34 smithi194 ceph-mon[65619]: from='client.37408 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:40:34.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:34 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3570910050' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:40:34.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:34 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2141730179' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:40:35.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:35 smithi026 ceph-mon[96795]: pgmap v3177: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:35.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:35 smithi194 ceph-mon[65619]: pgmap v3177: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:37.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:37 smithi026 ceph-mon[96795]: pgmap v3178: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:37.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:37 smithi194 ceph-mon[65619]: pgmap v3178: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:39.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:39 smithi026 ceph-mon[96795]: pgmap v3179: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:39.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:39 smithi194 ceph-mon[65619]: pgmap v3179: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:41.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:41 smithi026 ceph-mon[96795]: pgmap v3180: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:41.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:41 smithi194 ceph-mon[65619]: pgmap v3180: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:42.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:40:42.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:42 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:40:42.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:40:42.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:42 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:40:43.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:43 smithi026 ceph-mon[96795]: poll took 60062.316 ms: 1 events 2021-11-03T18:40:43.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:43 smithi026 ceph-mon[96795]: pgmap v3181: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:43.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:43 smithi194 ceph-mon[65619]: poll took 60062.316 ms: 1 events 2021-11-03T18:40:43.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:43 smithi194 ceph-mon[65619]: pgmap v3181: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:45.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:45 smithi026 ceph-mon[96795]: pgmap v3182: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:45.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:45 smithi194 ceph-mon[65619]: pgmap v3182: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:47.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:47 smithi026 ceph-mon[96795]: pgmap v3183: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:47.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:47 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:40:47.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:47 smithi194 ceph-mon[65619]: pgmap v3183: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:47.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:47 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:40:48.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:48 smithi194 ceph-mon[65619]: poll took 4476.209 ms: 1 events 2021-11-03T18:40:48.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:40:48.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:40:48.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:40:48.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:40:48.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:40:48.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:40:48.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:48 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:40:48.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:40:48.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:48 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:40:48.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:48 smithi026 ceph-mon[96795]: poll took 4476.209 ms: 1 events 2021-11-03T18:40:48.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:40:48.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:40:48.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:40:48.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:40:48.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:40:48.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:40:48.677 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:48 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:40:48.677 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:40:48.677 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:48 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:40:49.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:49 smithi194 ceph-mon[65619]: pgmap v3184: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:40:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:40:49.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:49 smithi026 ceph-mon[96795]: pgmap v3184: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:49.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:40:49.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:40:51.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:51 smithi026 ceph-mon[96795]: pgmap v3185: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:51.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:51 smithi194 ceph-mon[65619]: pgmap v3185: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:53.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:53 smithi026 ceph-mon[96795]: pgmap v3186: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:53.475 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:53 smithi194 ceph-mon[65619]: pgmap v3186: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:55.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:55 smithi026 ceph-mon[96795]: pgmap v3187: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:55.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:55 smithi194 ceph-mon[65619]: pgmap v3187: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:57.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:57 smithi026 ceph-mon[96795]: pgmap v3188: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:57.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:57 smithi194 ceph-mon[65619]: pgmap v3188: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:59.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:40:59 smithi194 ceph-mon[65619]: pgmap v3189: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:40:59.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:40:59 smithi026 ceph-mon[96795]: pgmap v3189: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:01.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:01 smithi026 ceph-mon[96795]: pgmap v3190: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:01.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:01 smithi194 ceph-mon[65619]: pgmap v3190: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:03.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:03 smithi026 ceph-mon[96795]: pgmap v3191: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:03.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:03 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:41:03.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:03 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:41:03.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:03 smithi194 ceph-mon[65619]: pgmap v3191: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:03.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:03 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:41:03.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:03 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:41:03.780 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.780+0000 7fa5ebb78700 1 -- 172.21.15.26:0/1877805606 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5e40fbcb0 msgr2=0x7fa5e40fe0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:41:03.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.780+0000 7fa5ebb78700 1 --2- 172.21.15.26:0/1877805606 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5e40fbcb0 0x7fa5e40fe0a0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 rx=0x7fa5d4004660 tx=0x7fa5d4009b30).stop 2021-11-03T18:41:03.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.780+0000 7fa5ebb78700 1 -- 172.21.15.26:0/1877805606 shutdown_connections 2021-11-03T18:41:03.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.780+0000 7fa5ebb78700 1 --2- 172.21.15.26:0/1877805606 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5e40fbcb0 0x7fa5e40fe0a0 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:03.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.780+0000 7fa5ebb78700 1 --2- 172.21.15.26:0/1877805606 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5e4060310 0x7fa5e40fb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:03.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.780+0000 7fa5ebb78700 1 -- 172.21.15.26:0/1877805606 >> 172.21.15.26:0/1877805606 conn(0x7fa5e40f0de0 msgr2=0x7fa5e40f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:41:03.782 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.780+0000 7fa5ebb78700 1 -- 172.21.15.26:0/1877805606 shutdown_connections 2021-11-03T18:41:03.782 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.780+0000 7fa5ebb78700 1 -- 172.21.15.26:0/1877805606 wait complete. 2021-11-03T18:41:03.782 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.781+0000 7fa5ebb78700 1 Processor -- start 2021-11-03T18:41:03.782 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.781+0000 7fa5ebb78700 1 -- start start 2021-11-03T18:41:03.783 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.781+0000 7fa5ebb78700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5e4060310 0x7fa5e41090d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:41:03.783 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.781+0000 7fa5ebb78700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5e40fbcb0 0x7fa5e41095c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:41:03.783 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.781+0000 7fa5ebb78700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e4109b70 con 0x7fa5e40fbcb0 2021-11-03T18:41:03.783 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.781+0000 7fa5ebb78700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e4109cb0 con 0x7fa5e4060310 2021-11-03T18:41:03.784 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.781+0000 7fa5e9113700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5e40fbcb0 0x7fa5e41095c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:41:03.784 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.781+0000 7fa5e9113700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5e40fbcb0 0x7fa5e41095c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33174/0 (socket says 172.21.15.26:33174) 2021-11-03T18:41:03.784 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.781+0000 7fa5e9113700 1 -- 172.21.15.26:0/3547712494 learned_addr learned my addr 172.21.15.26:0/3547712494 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:41:03.784 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.782+0000 7fa5e9914700 1 --2- 172.21.15.26:0/3547712494 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5e4060310 0x7fa5e41090d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:41:03.784 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.782+0000 7fa5e9113700 1 -- 172.21.15.26:0/3547712494 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5e4060310 msgr2=0x7fa5e41090d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:41:03.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.782+0000 7fa5e9113700 1 --2- 172.21.15.26:0/3547712494 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5e4060310 0x7fa5e41090d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:03.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.782+0000 7fa5e9113700 1 -- 172.21.15.26:0/3547712494 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d4005040 con 0x7fa5e40fbcb0 2021-11-03T18:41:03.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.782+0000 7fa5e9113700 1 --2- 172.21.15.26:0/3547712494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5e40fbcb0 0x7fa5e41095c0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 rx=0x7fa5d4000c00 tx=0x7fa5d400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:41:03.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.782+0000 7fa5da7fc700 1 -- 172.21.15.26:0/3547712494 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5d4019070 con 0x7fa5e40fbcb0 2021-11-03T18:41:03.786 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.782+0000 7fa5da7fc700 1 -- 172.21.15.26:0/3547712494 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa5d4007e70 con 0x7fa5e40fbcb0 2021-11-03T18:41:03.786 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.782+0000 7fa5ebb78700 1 -- 172.21.15.26:0/3547712494 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5e410a5f0 con 0x7fa5e40fbcb0 2021-11-03T18:41:03.786 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.782+0000 7fa5da7fc700 1 -- 172.21.15.26:0/3547712494 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5d4014d90 con 0x7fa5e40fbcb0 2021-11-03T18:41:03.786 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.782+0000 7fa5ebb78700 1 -- 172.21.15.26:0/3547712494 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e410ab50 con 0x7fa5e40fbcb0 2021-11-03T18:41:03.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.783+0000 7fa5ebb78700 1 -- 172.21.15.26:0/3547712494 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5e4045ad0 con 0x7fa5e40fbcb0 2021-11-03T18:41:03.791 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.783+0000 7fa5da7fc700 1 -- 172.21.15.26:0/3547712494 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fa5d4025070 con 0x7fa5e40fbcb0 2021-11-03T18:41:03.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.784+0000 7fa5da7fc700 1 --2- 172.21.15.26:0/3547712494 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa5d00640b0 0x7fa5d0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:41:03.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.784+0000 7fa5da7fc700 1 -- 172.21.15.26:0/3547712494 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fa5d40817a0 con 0x7fa5e40fbcb0 2021-11-03T18:41:03.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.784+0000 7fa5e9914700 1 --2- 172.21.15.26:0/3547712494 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa5d00640b0 0x7fa5d0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:41:03.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.784+0000 7fa5e9914700 1 --2- 172.21.15.26:0/3547712494 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa5d00640b0 0x7fa5d0066570 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7fa5e0009da0 tx=0x7fa5e000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:41:03.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.788+0000 7fa5da7fc700 1 -- 172.21.15.26:0/3547712494 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fa5d4053b00 con 0x7fa5e40fbcb0 2021-11-03T18:41:03.965 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.967+0000 7fa5ebb78700 1 -- 172.21.15.26:0/3547712494 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa5e410ad70 con 0x7fa5d00640b0 2021-11-03T18:41:03.966 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.969+0000 7fa5da7fc700 1 -- 172.21.15.26:0/3547712494 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fa5e410ad70 con 0x7fa5d00640b0 2021-11-03T18:41:03.969 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.970+0000 7fa5ebb78700 1 -- 172.21.15.26:0/3547712494 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa5d00640b0 msgr2=0x7fa5d0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:41:03.969 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.970+0000 7fa5ebb78700 1 --2- 172.21.15.26:0/3547712494 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa5d00640b0 0x7fa5d0066570 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7fa5e0009da0 tx=0x7fa5e000b040).stop 2021-11-03T18:41:03.969 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.970+0000 7fa5ebb78700 1 -- 172.21.15.26:0/3547712494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5e40fbcb0 msgr2=0x7fa5e41095c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:41:03.969 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.970+0000 7fa5ebb78700 1 --2- 172.21.15.26:0/3547712494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5e40fbcb0 0x7fa5e41095c0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 rx=0x7fa5d4000c00 tx=0x7fa5d400b040).stop 2021-11-03T18:41:03.970 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.971+0000 7fa5ebb78700 1 -- 172.21.15.26:0/3547712494 shutdown_connections 2021-11-03T18:41:03.970 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.971+0000 7fa5ebb78700 1 --2- 172.21.15.26:0/3547712494 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa5d00640b0 0x7fa5d0066570 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:03.970 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.971+0000 7fa5ebb78700 1 --2- 172.21.15.26:0/3547712494 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5e4060310 0x7fa5e41090d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:03.970 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.971+0000 7fa5ebb78700 1 --2- 172.21.15.26:0/3547712494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5e40fbcb0 0x7fa5e41095c0 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:03.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.971+0000 7fa5ebb78700 1 -- 172.21.15.26:0/3547712494 >> 172.21.15.26:0/3547712494 conn(0x7fa5e40f0de0 msgr2=0x7fa5e40f31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:41:03.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.971+0000 7fa5ebb78700 1 -- 172.21.15.26:0/3547712494 shutdown_connections 2021-11-03T18:41:03.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:03.971+0000 7fa5ebb78700 1 -- 172.21.15.26:0/3547712494 wait complete. 2021-11-03T18:41:03.978 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:41:04.071 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.071+0000 7fddbebfe700 1 -- 172.21.15.26:0/718987442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddb80f6530 msgr2=0x7fddb80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:41:04.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.071+0000 7fddbebfe700 1 --2- 172.21.15.26:0/718987442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddb80f6530 0x7fddb80f6950 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 rx=0x7fddb4004660 tx=0x7fddb4009b30).stop 2021-11-03T18:41:04.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.071+0000 7fddbebfe700 1 -- 172.21.15.26:0/718987442 shutdown_connections 2021-11-03T18:41:04.072 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.071+0000 7fddbebfe700 1 --2- 172.21.15.26:0/718987442 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddb80f77d0 0x7fddb80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:04.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.071+0000 7fddbebfe700 1 --2- 172.21.15.26:0/718987442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddb80f6530 0x7fddb80f6950 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:04.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.071+0000 7fddbebfe700 1 -- 172.21.15.26:0/718987442 >> 172.21.15.26:0/718987442 conn(0x7fddb80f1cd0 msgr2=0x7fddb80f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:41:04.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.071+0000 7fddbebfe700 1 -- 172.21.15.26:0/718987442 shutdown_connections 2021-11-03T18:41:04.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.072+0000 7fddbebfe700 1 -- 172.21.15.26:0/718987442 wait complete. 2021-11-03T18:41:04.073 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.072+0000 7fddbebfe700 1 Processor -- start 2021-11-03T18:41:04.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.072+0000 7fddbebfe700 1 -- start start 2021-11-03T18:41:04.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.072+0000 7fddbebfe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddb80f6530 0x7fddb8106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:41:04.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.072+0000 7fddbebfe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddb80f77d0 0x7fddb8107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:41:04.074 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.072+0000 7fddbebfe700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb8107880 con 0x7fddb80f77d0 2021-11-03T18:41:04.075 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.072+0000 7fddbebfe700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb81080c0 con 0x7fddb80f6530 2021-11-03T18:41:04.075 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.072+0000 7fddbd3fb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddb80f77d0 0x7fddb8107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:41:04.075 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.072+0000 7fddbd3fb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddb80f77d0 0x7fddb8107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33184/0 (socket says 172.21.15.26:33184) 2021-11-03T18:41:04.075 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.072+0000 7fddbd3fb700 1 -- 172.21.15.26:0/4174114611 learned_addr learned my addr 172.21.15.26:0/4174114611 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:41:04.075 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.072+0000 7fddbdbfc700 1 --2- 172.21.15.26:0/4174114611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddb80f6530 0x7fddb8106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:41:04.076 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.073+0000 7fddbd3fb700 1 -- 172.21.15.26:0/4174114611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddb80f6530 msgr2=0x7fddb8106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:41:04.076 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.073+0000 7fddbd3fb700 1 --2- 172.21.15.26:0/4174114611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddb80f6530 0x7fddb8106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:04.076 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.073+0000 7fddbd3fb700 1 -- 172.21.15.26:0/4174114611 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb4005040 con 0x7fddb80f77d0 2021-11-03T18:41:04.076 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.073+0000 7fddbdbfc700 1 --2- 172.21.15.26:0/4174114611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddb80f6530 0x7fddb8106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:41:04.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.073+0000 7fddbd3fb700 1 --2- 172.21.15.26:0/4174114611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddb80f77d0 0x7fddb8107280 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 rx=0x7fdda80026d0 tx=0x7fdda8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:41:04.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.073+0000 7fddae7fc700 1 -- 172.21.15.26:0/4174114611 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdda8009320 con 0x7fddb80f77d0 2021-11-03T18:41:04.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.073+0000 7fddae7fc700 1 -- 172.21.15.26:0/4174114611 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdda800f040 con 0x7fddb80f77d0 2021-11-03T18:41:04.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.073+0000 7fddbebfe700 1 -- 172.21.15.26:0/4174114611 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb81083a0 con 0x7fddb80f77d0 2021-11-03T18:41:04.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.073+0000 7fddae7fc700 1 -- 172.21.15.26:0/4174114611 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdda80147e0 con 0x7fddb80f77d0 2021-11-03T18:41:04.078 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.073+0000 7fddbebfe700 1 -- 172.21.15.26:0/4174114611 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb81088e0 con 0x7fddb80f77d0 2021-11-03T18:41:04.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.074+0000 7fddbebfe700 1 -- 172.21.15.26:0/4174114611 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddb8059100 con 0x7fddb80f77d0 2021-11-03T18:41:04.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.074+0000 7fddae7fc700 1 -- 172.21.15.26:0/4174114611 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fdda8009480 con 0x7fddb80f77d0 2021-11-03T18:41:04.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.075+0000 7fddae7fc700 1 --2- 172.21.15.26:0/4174114611 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdda4064100 0x7fdda40665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:41:04.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.075+0000 7fddae7fc700 1 -- 172.21.15.26:0/4174114611 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fdda8080eb0 con 0x7fddb80f77d0 2021-11-03T18:41:04.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.075+0000 7fddbdbfc700 1 --2- 172.21.15.26:0/4174114611 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdda4064100 0x7fdda40665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:41:04.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.075+0000 7fddbdbfc700 1 --2- 172.21.15.26:0/4174114611 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdda4064100 0x7fdda40665c0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7fddb4004e30 tx=0x7fddb4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:41:04.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.079+0000 7fddae7fc700 1 -- 172.21.15.26:0/4174114611 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fdda8053210 con 0x7fddb80f77d0 2021-11-03T18:41:04.253 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.255+0000 7fddbebfe700 1 -- 172.21.15.26:0/4174114611 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fddb80fee80 con 0x7fdda4064100 2021-11-03T18:41:04.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.269+0000 7fddae7fc700 1 -- 172.21.15.26:0/4174114611 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7fddb80fee80 con 0x7fdda4064100 2021-11-03T18:41:04.268 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:41:04.268 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (112m) 17s ago 113m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:41:04.268 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (104m) 17s ago 113m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:41:04.268 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (104m) 9m ago 112m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:41:04.269 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (112m) 17s ago 113m 42.4M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:41:04.269 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (105m) 17s ago 108m 26.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:41:04.269 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (105m) 17s ago 108m 27.0M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:41:04.269 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (108m) 9m ago 108m 27.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:41:04.269 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (108m) 9m ago 108m 27.4M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:41:04.270 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (106m) 17s ago 114m 615M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:41:04.270 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (105m) 9m ago 112m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:41:04.270 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (105m) 17s ago 115m 407M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:41:04.270 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (105m) 9m ago 112m 171M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:41:04.271 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (113m) 17s ago 113m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:41:04.271 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (112m) 9m ago 112m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:41:04.271 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (104m) 17s ago 111m 372M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:41:04.271 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (103m) 17s ago 111m 400M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:41:04.272 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (103m) 17s ago 111m 332M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:41:04.272 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (102m) 9m ago 110m 413M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:41:04.272 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (102m) 9m ago 110m 339M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:41:04.272 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (101m) 9m ago 110m 337M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:41:04.273 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (112m) 17s ago 112m 70.2M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:41:04.273 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.271+0000 7fddbebfe700 1 -- 172.21.15.26:0/4174114611 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdda4064100 msgr2=0x7fdda40665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:41:04.274 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.271+0000 7fddbebfe700 1 --2- 172.21.15.26:0/4174114611 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdda4064100 0x7fdda40665c0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7fddb4004e30 tx=0x7fddb4009b30).stop 2021-11-03T18:41:04.274 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.271+0000 7fddbebfe700 1 -- 172.21.15.26:0/4174114611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddb80f77d0 msgr2=0x7fddb8107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:41:04.274 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.271+0000 7fddbebfe700 1 --2- 172.21.15.26:0/4174114611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddb80f77d0 0x7fddb8107280 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 rx=0x7fdda80026d0 tx=0x7fdda8009de0).stop 2021-11-03T18:41:04.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.271+0000 7fddbebfe700 1 -- 172.21.15.26:0/4174114611 shutdown_connections 2021-11-03T18:41:04.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.271+0000 7fddbebfe700 1 --2- 172.21.15.26:0/4174114611 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdda4064100 0x7fdda40665c0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:04.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.271+0000 7fddbebfe700 1 --2- 172.21.15.26:0/4174114611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddb80f6530 0x7fddb8106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:04.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.271+0000 7fddbebfe700 1 --2- 172.21.15.26:0/4174114611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddb80f77d0 0x7fddb8107280 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:04.275 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.271+0000 7fddbebfe700 1 -- 172.21.15.26:0/4174114611 >> 172.21.15.26:0/4174114611 conn(0x7fddb80f1cd0 msgr2=0x7fddb80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:41:04.276 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.271+0000 7fddbebfe700 1 -- 172.21.15.26:0/4174114611 shutdown_connections 2021-11-03T18:41:04.276 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.271+0000 7fddbebfe700 1 -- 172.21.15.26:0/4174114611 wait complete. 2021-11-03T18:41:04.372 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.371+0000 7fb5fb389700 1 -- 172.21.15.26:0/2410585825 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5f40f66e0 msgr2=0x7fb5f40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:41:04.372 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.371+0000 7fb5fb389700 1 --2- 172.21.15.26:0/2410585825 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5f40f66e0 0x7fb5f40f6b00 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 rx=0x7fb5f0004660 tx=0x7fb5f0009b30).stop 2021-11-03T18:41:04.372 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.371+0000 7fb5fb389700 1 -- 172.21.15.26:0/2410585825 shutdown_connections 2021-11-03T18:41:04.372 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.371+0000 7fb5fb389700 1 --2- 172.21.15.26:0/2410585825 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5f40f7980 0x7fb5f40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:04.373 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.371+0000 7fb5fb389700 1 --2- 172.21.15.26:0/2410585825 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5f40f66e0 0x7fb5f40f6b00 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:04.373 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.371+0000 7fb5fb389700 1 -- 172.21.15.26:0/2410585825 >> 172.21.15.26:0/2410585825 conn(0x7fb5f40f1e40 msgr2=0x7fb5f40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:41:04.373 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.372+0000 7fb5fb389700 1 -- 172.21.15.26:0/2410585825 shutdown_connections 2021-11-03T18:41:04.373 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.372+0000 7fb5fb389700 1 -- 172.21.15.26:0/2410585825 wait complete. 2021-11-03T18:41:04.374 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.372+0000 7fb5fb389700 1 Processor -- start 2021-11-03T18:41:04.374 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.372+0000 7fb5fb389700 1 -- start start 2021-11-03T18:41:04.374 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.372+0000 7fb5fb389700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5f40f66e0 0x7fb5f4106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:41:04.374 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.372+0000 7fb5fb389700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5f40f7980 0x7fb5f41074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:41:04.375 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.372+0000 7fb5fb389700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f4107a50 con 0x7fb5f40f66e0 2021-11-03T18:41:04.375 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.372+0000 7fb5fb389700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f4107b90 con 0x7fb5f40f7980 2021-11-03T18:41:04.375 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.372+0000 7fb5f9125700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5f40f66e0 0x7fb5f4106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:41:04.375 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.372+0000 7fb5f9125700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5f40f66e0 0x7fb5f4106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33192/0 (socket says 172.21.15.26:33192) 2021-11-03T18:41:04.376 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.372+0000 7fb5f9125700 1 -- 172.21.15.26:0/3053403415 learned_addr learned my addr 172.21.15.26:0/3053403415 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:41:04.376 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.373+0000 7fb5f9125700 1 -- 172.21.15.26:0/3053403415 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5f40f7980 msgr2=0x7fb5f41074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:41:04.376 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.373+0000 7fb5f8924700 1 --2- 172.21.15.26:0/3053403415 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5f40f7980 0x7fb5f41074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:41:04.376 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.373+0000 7fb5f9125700 1 --2- 172.21.15.26:0/3053403415 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5f40f7980 0x7fb5f41074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:04.377 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.373+0000 7fb5f9125700 1 -- 172.21.15.26:0/3053403415 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f0005040 con 0x7fb5f40f66e0 2021-11-03T18:41:04.377 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.373+0000 7fb5f9125700 1 --2- 172.21.15.26:0/3053403415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5f40f66e0 0x7fb5f4106fb0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 rx=0x7fb5f0013a70 tx=0x7fb5f0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:41:04.377 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.373+0000 7fb5e9ffb700 1 -- 172.21.15.26:0/3053403415 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5f0018070 con 0x7fb5f40f66e0 2021-11-03T18:41:04.377 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.373+0000 7fb5fb389700 1 -- 172.21.15.26:0/3053403415 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5f41084d0 con 0x7fb5f40f66e0 2021-11-03T18:41:04.378 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.373+0000 7fb5e9ffb700 1 -- 172.21.15.26:0/3053403415 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb5f00097d0 con 0x7fb5f40f66e0 2021-11-03T18:41:04.378 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.373+0000 7fb5e9ffb700 1 -- 172.21.15.26:0/3053403415 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5f001c3c0 con 0x7fb5f40f66e0 2021-11-03T18:41:04.378 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.373+0000 7fb5fb389700 1 -- 172.21.15.26:0/3053403415 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f4108a30 con 0x7fb5f40f66e0 2021-11-03T18:41:04.379 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.374+0000 7fb5fb389700 1 -- 172.21.15.26:0/3053403415 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5f4045ad0 con 0x7fb5f40f66e0 2021-11-03T18:41:04.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.375+0000 7fb5e9ffb700 1 -- 172.21.15.26:0/3053403415 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fb5f0007ba0 con 0x7fb5f40f66e0 2021-11-03T18:41:04.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.375+0000 7fb5e9ffb700 1 --2- 172.21.15.26:0/3053403415 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb5e00640b0 0x7fb5e0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:41:04.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.375+0000 7fb5e9ffb700 1 -- 172.21.15.26:0/3053403415 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fb5f0082470 con 0x7fb5f40f66e0 2021-11-03T18:41:04.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.375+0000 7fb5f8924700 1 --2- 172.21.15.26:0/3053403415 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb5e00640b0 0x7fb5e0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:41:04.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.376+0000 7fb5f8924700 1 --2- 172.21.15.26:0/3053403415 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb5e00640b0 0x7fb5e0066570 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7fb5e4004a70 tx=0x7fb5e400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:41:04.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.379+0000 7fb5e9ffb700 1 -- 172.21.15.26:0/3053403415 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fb5f00547d0 con 0x7fb5f40f66e0 2021-11-03T18:41:04.607 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.608+0000 7fb5fb389700 1 -- 172.21.15.26:0/3053403415 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb5f40feea0 con 0x7fb5f40f66e0 2021-11-03T18:41:04.607 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.609+0000 7fb5e9ffb700 1 -- 172.21.15.26:0/3053403415 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fb5f00543c0 con 0x7fb5f40f66e0 2021-11-03T18:41:04.607 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:41:04.608 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:41:04.608 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:41:04.608 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:41:04.608 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:41:04.609 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:41:04.609 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:41:04.609 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:41:04.609 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:41:04.609 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:41:04.610 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:41:04.610 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:41:04.610 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:41:04.610 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:41:04.611 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:41:04.611 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:41:04.611 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:41:04.611 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:41:04.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.610+0000 7fb5fb389700 1 -- 172.21.15.26:0/3053403415 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb5e00640b0 msgr2=0x7fb5e0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:41:04.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.610+0000 7fb5fb389700 1 --2- 172.21.15.26:0/3053403415 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb5e00640b0 0x7fb5e0066570 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7fb5e4004a70 tx=0x7fb5e400b040).stop 2021-11-03T18:41:04.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.610+0000 7fb5fb389700 1 -- 172.21.15.26:0/3053403415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5f40f66e0 msgr2=0x7fb5f4106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:41:04.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.610+0000 7fb5fb389700 1 --2- 172.21.15.26:0/3053403415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5f40f66e0 0x7fb5f4106fb0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 rx=0x7fb5f0013a70 tx=0x7fb5f0009b30).stop 2021-11-03T18:41:04.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.610+0000 7fb5fb389700 1 -- 172.21.15.26:0/3053403415 shutdown_connections 2021-11-03T18:41:04.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.610+0000 7fb5fb389700 1 --2- 172.21.15.26:0/3053403415 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb5e00640b0 0x7fb5e0066570 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:04.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.610+0000 7fb5fb389700 1 --2- 172.21.15.26:0/3053403415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5f40f66e0 0x7fb5f4106fb0 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:04.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.610+0000 7fb5fb389700 1 --2- 172.21.15.26:0/3053403415 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5f40f7980 0x7fb5f41074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:04.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.611+0000 7fb5fb389700 1 -- 172.21.15.26:0/3053403415 >> 172.21.15.26:0/3053403415 conn(0x7fb5f40f1e40 msgr2=0x7fb5f40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:41:04.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.611+0000 7fb5fb389700 1 -- 172.21.15.26:0/3053403415 shutdown_connections 2021-11-03T18:41:04.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.611+0000 7fb5fb389700 1 -- 172.21.15.26:0/3053403415 wait complete. 2021-11-03T18:41:04.710 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.710+0000 7f1d1095a700 1 -- 172.21.15.26:0/729889331 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d0c0f5710 msgr2=0x7f1d0c0f5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:41:04.711 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.710+0000 7f1d1095a700 1 --2- 172.21.15.26:0/729889331 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d0c0f5710 0x7f1d0c0f5b90 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 rx=0x7f1d00004660 tx=0x7f1d00009b30).stop 2021-11-03T18:41:04.711 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.710+0000 7f1d1095a700 1 -- 172.21.15.26:0/729889331 shutdown_connections 2021-11-03T18:41:04.711 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.710+0000 7f1d1095a700 1 --2- 172.21.15.26:0/729889331 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d0c0f5710 0x7f1d0c0f5b90 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:04.711 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.710+0000 7f1d1095a700 1 --2- 172.21.15.26:0/729889331 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d0c0f6a10 0x7f1d0c0f6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:04.712 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.710+0000 7f1d1095a700 1 -- 172.21.15.26:0/729889331 >> 172.21.15.26:0/729889331 conn(0x7f1d0c0f0320 msgr2=0x7f1d0c0f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:41:04.712 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.710+0000 7f1d1095a700 1 -- 172.21.15.26:0/729889331 shutdown_connections 2021-11-03T18:41:04.712 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.710+0000 7f1d1095a700 1 -- 172.21.15.26:0/729889331 wait complete. 2021-11-03T18:41:04.712 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.711+0000 7f1d1095a700 1 Processor -- start 2021-11-03T18:41:04.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.711+0000 7f1d1095a700 1 -- start start 2021-11-03T18:41:04.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.711+0000 7f1d1095a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d0c0f5710 0x7f1d0c109a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:41:04.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.711+0000 7f1d1095a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d0c0f6a10 0x7f1d0c10bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:41:04.713 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.711+0000 7f1d1095a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0c0f53c0 con 0x7f1d0c0f6a10 2021-11-03T18:41:04.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.711+0000 7f1d1095a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0c0f5500 con 0x7f1d0c0f5710 2021-11-03T18:41:04.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.711+0000 7f1d0a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d0c0f6a10 0x7f1d0c10bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:41:04.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.711+0000 7f1d0a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d0c0f6a10 0x7f1d0c10bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33204/0 (socket says 172.21.15.26:33204) 2021-11-03T18:41:04.714 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.711+0000 7f1d0a59c700 1 -- 172.21.15.26:0/919019697 learned_addr learned my addr 172.21.15.26:0/919019697 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:41:04.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.712+0000 7f1d0ad9d700 1 --2- 172.21.15.26:0/919019697 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d0c0f5710 0x7f1d0c109a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:41:04.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.712+0000 7f1d0a59c700 1 -- 172.21.15.26:0/919019697 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d0c0f5710 msgr2=0x7f1d0c109a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:41:04.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.712+0000 7f1d0a59c700 1 --2- 172.21.15.26:0/919019697 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d0c0f5710 0x7f1d0c109a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:04.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.712+0000 7f1d0a59c700 1 -- 172.21.15.26:0/919019697 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d00005040 con 0x7f1d0c0f6a10 2021-11-03T18:41:04.715 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.712+0000 7f1d0a59c700 1 --2- 172.21.15.26:0/919019697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d0c0f6a10 0x7f1d0c10bf00 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 rx=0x7f1d00013a70 tx=0x7f1d00009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:41:04.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.712+0000 7f1cf37fe700 1 -- 172.21.15.26:0/919019697 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d00018070 con 0x7f1d0c0f6a10 2021-11-03T18:41:04.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.712+0000 7f1cf37fe700 1 -- 172.21.15.26:0/919019697 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1d000097d0 con 0x7f1d0c0f6a10 2021-11-03T18:41:04.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.712+0000 7f1d1095a700 1 -- 172.21.15.26:0/919019697 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d0c10c450 con 0x7f1d0c0f6a10 2021-11-03T18:41:04.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.712+0000 7f1cf37fe700 1 -- 172.21.15.26:0/919019697 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d0001c3c0 con 0x7f1d0c0f6a10 2021-11-03T18:41:04.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.712+0000 7f1d1095a700 1 -- 172.21.15.26:0/919019697 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d0c10c9b0 con 0x7f1d0c0f6a10 2021-11-03T18:41:04.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.713+0000 7f1d1095a700 1 -- 172.21.15.26:0/919019697 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d0c045ad0 con 0x7f1d0c0f6a10 2021-11-03T18:41:04.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.714+0000 7f1cf37fe700 1 -- 172.21.15.26:0/919019697 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f1d00007ba0 con 0x7f1d0c0f6a10 2021-11-03T18:41:04.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.714+0000 7f1cf37fe700 1 --2- 172.21.15.26:0/919019697 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1cf4064100 0x7f1cf40665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:41:04.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.714+0000 7f1cf37fe700 1 -- 172.21.15.26:0/919019697 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f1d00082470 con 0x7f1d0c0f6a10 2021-11-03T18:41:04.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.714+0000 7f1d0ad9d700 1 --2- 172.21.15.26:0/919019697 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1cf4064100 0x7f1cf40665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:41:04.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.714+0000 7f1d0ad9d700 1 --2- 172.21.15.26:0/919019697 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1cf4064100 0x7f1cf40665c0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7f1d0c0f5040 tx=0x7f1cfc009c80).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:41:04.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.718+0000 7f1cf37fe700 1 -- 172.21.15.26:0/919019697 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f1d000547d0 con 0x7f1d0c0f6a10 2021-11-03T18:41:04.924 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.925+0000 7f1d1095a700 1 -- 172.21.15.26:0/919019697 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1d0c0fdd40 con 0x7f1d0c0f6a10 2021-11-03T18:41:04.924 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.926+0000 7f1cf37fe700 1 -- 172.21.15.26:0/919019697 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f1d000543c0 con 0x7f1d0c0f6a10 2021-11-03T18:41:04.925 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:41:04.925 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:41:04.925 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:41:04.926 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:41:04.926 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:41:04.927 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:41:04.927 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:41:04.927 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:41:04.928 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:41:04.929 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:41:04.929 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:41:04.929 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:41:04.929 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:41:04.930 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:41:04.930 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:41:04.930 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:41:04.930 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:41:04.931 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:41:04.931 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:41:04.931 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:41:04.931 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:41:04.932 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:41:04.932 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:41:04.932 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:41:04.932 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:41:04.932 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:41:04.933 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:41:04.933 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:41:04.933 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:41:04.933 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:41:04.934 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:41:04.934 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:41:04.934 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:41:04.934 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:41:04.935 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:41:04.935 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:41:04.935 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:41:04.935 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:41:04.935 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:41:04.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.927+0000 7f1d1095a700 1 -- 172.21.15.26:0/919019697 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1cf4064100 msgr2=0x7f1cf40665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:41:04.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.927+0000 7f1d1095a700 1 --2- 172.21.15.26:0/919019697 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1cf4064100 0x7f1cf40665c0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7f1d0c0f5040 tx=0x7f1cfc009c80).stop 2021-11-03T18:41:04.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.927+0000 7f1d1095a700 1 -- 172.21.15.26:0/919019697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d0c0f6a10 msgr2=0x7f1d0c10bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:41:04.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.927+0000 7f1d1095a700 1 --2- 172.21.15.26:0/919019697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d0c0f6a10 0x7f1d0c10bf00 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 rx=0x7f1d00013a70 tx=0x7f1d00009b30).stop 2021-11-03T18:41:04.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.927+0000 7f1d1095a700 1 -- 172.21.15.26:0/919019697 shutdown_connections 2021-11-03T18:41:04.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.927+0000 7f1d1095a700 1 --2- 172.21.15.26:0/919019697 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1cf4064100 0x7f1cf40665c0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:04.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.927+0000 7f1d1095a700 1 --2- 172.21.15.26:0/919019697 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d0c0f5710 0x7f1d0c109a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:04.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.927+0000 7f1d1095a700 1 --2- 172.21.15.26:0/919019697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d0c0f6a10 0x7f1d0c10bf00 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:04.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.927+0000 7f1d1095a700 1 -- 172.21.15.26:0/919019697 >> 172.21.15.26:0/919019697 conn(0x7f1d0c0f0320 msgr2=0x7f1d0c0fa170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:41:04.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.927+0000 7f1d1095a700 1 -- 172.21.15.26:0/919019697 shutdown_connections 2021-11-03T18:41:04.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:04.928+0000 7f1d1095a700 1 -- 172.21.15.26:0/919019697 wait complete. 2021-11-03T18:41:04.939 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:41:05.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:05 smithi026 ceph-mon[96795]: from='client.37420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:41:05.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:05 smithi026 ceph-mon[96795]: pgmap v3192: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:05.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:05 smithi026 ceph-mon[96795]: from='client.37424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:41:05.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:05 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3053403415' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:41:05.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:05 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/919019697' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:41:05.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:05 smithi194 ceph-mon[65619]: from='client.37420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:41:05.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:05 smithi194 ceph-mon[65619]: pgmap v3192: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:05.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:05 smithi194 ceph-mon[65619]: from='client.37424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:41:05.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:05 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3053403415' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:41:05.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:05 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/919019697' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:41:07.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:07 smithi194 ceph-mon[65619]: pgmap v3193: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:07.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:07 smithi026 ceph-mon[96795]: pgmap v3193: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:09.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:09 smithi194 ceph-mon[65619]: pgmap v3194: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:09.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:09 smithi026 ceph-mon[96795]: pgmap v3194: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:11.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:11 smithi026 ceph-mon[96795]: pgmap v3195: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:11.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:11 smithi194 ceph-mon[65619]: pgmap v3195: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:13.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:13 smithi026 ceph-mon[96795]: pgmap v3196: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:13.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:13 smithi194 ceph-mon[65619]: pgmap v3196: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:15.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:15 smithi194 ceph-mon[65619]: pgmap v3197: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:15.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:15 smithi026 ceph-mon[96795]: pgmap v3197: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:17.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:17 smithi194 ceph-mon[65619]: pgmap v3198: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:17.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:17 smithi026 ceph-mon[96795]: pgmap v3198: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:18.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:18 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:41:18.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:18 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:41:18.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:18 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:41:18.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:18 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:41:19.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:19 smithi194 ceph-mon[65619]: pgmap v3199: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:19.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:19 smithi026 ceph-mon[96795]: pgmap v3199: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:21.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:21 smithi026 ceph-mon[96795]: pgmap v3200: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:21.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:21 smithi194 ceph-mon[65619]: pgmap v3200: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:23.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:23 smithi194 ceph-mon[65619]: pgmap v3201: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:23.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:23 smithi026 ceph-mon[96795]: pgmap v3201: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:25.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:25 smithi194 ceph-mon[65619]: pgmap v3202: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:25.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:25 smithi026 ceph-mon[96795]: pgmap v3202: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:27.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:27 smithi194 ceph-mon[65619]: pgmap v3203: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:27.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:27 smithi026 ceph-mon[96795]: pgmap v3203: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:29.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:29 smithi194 ceph-mon[65619]: pgmap v3204: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:29.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:29 smithi026 ceph-mon[96795]: pgmap v3204: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:31.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:31 smithi026 ceph-mon[96795]: pgmap v3205: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:31.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:31 smithi194 ceph-mon[65619]: pgmap v3205: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:33.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:33 smithi194 ceph-mon[65619]: pgmap v3206: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:33.475 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:33 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:41:33.475 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:33 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:41:33.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:33 smithi026 ceph-mon[96795]: pgmap v3206: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:33.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:33 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:41:33.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:33 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:41:35.042 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.041+0000 7f2592353700 1 -- 172.21.15.26:0/2702452990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f258c0f6ff0 msgr2=0x7f258c0f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:41:35.042 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.041+0000 7f2592353700 1 --2- 172.21.15.26:0/2702452990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f258c0f6ff0 0x7f258c0f7a20 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 rx=0x7f2574004660 tx=0x7f2574009b30).stop 2021-11-03T18:41:35.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.041+0000 7f2592353700 1 -- 172.21.15.26:0/2702452990 shutdown_connections 2021-11-03T18:41:35.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.041+0000 7f2592353700 1 --2- 172.21.15.26:0/2702452990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f258c0f6ff0 0x7f258c0f7a20 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:35.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.041+0000 7f2592353700 1 --2- 172.21.15.26:0/2702452990 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f258c0f66e0 0x7f258c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:35.043 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.041+0000 7f2592353700 1 -- 172.21.15.26:0/2702452990 >> 172.21.15.26:0/2702452990 conn(0x7f258c0f1f00 msgr2=0x7f258c0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:41:35.044 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.041+0000 7f2592353700 1 -- 172.21.15.26:0/2702452990 shutdown_connections 2021-11-03T18:41:35.044 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.041+0000 7f2592353700 1 -- 172.21.15.26:0/2702452990 wait complete. 2021-11-03T18:41:35.044 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.042+0000 7f2592353700 1 Processor -- start 2021-11-03T18:41:35.044 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.042+0000 7f2592353700 1 -- start start 2021-11-03T18:41:35.044 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.042+0000 7f2592353700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f258c0f66e0 0x7f258c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:41:35.045 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.042+0000 7f2592353700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f258c0f6ff0 0x7f258c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:41:35.045 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.042+0000 7f2592353700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258c06a380 con 0x7f258c0f66e0 2021-11-03T18:41:35.045 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.042+0000 7f2592353700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258c06a4c0 con 0x7f258c0f6ff0 2021-11-03T18:41:35.045 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.042+0000 7f258bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f258c0f66e0 0x7f258c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:41:35.046 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.042+0000 7f258bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f258c0f66e0 0x7f258c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33220/0 (socket says 172.21.15.26:33220) 2021-11-03T18:41:35.046 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.042+0000 7f258bfff700 1 -- 172.21.15.26:0/2439961810 learned_addr learned my addr 172.21.15.26:0/2439961810 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:41:35.046 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.042+0000 7f258b7fe700 1 --2- 172.21.15.26:0/2439961810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f258c0f6ff0 0x7f258c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:41:35.046 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.043+0000 7f258bfff700 1 -- 172.21.15.26:0/2439961810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f258c0f6ff0 msgr2=0x7f258c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:41:35.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.043+0000 7f258bfff700 1 --2- 172.21.15.26:0/2439961810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f258c0f6ff0 0x7f258c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:35.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.043+0000 7f258bfff700 1 -- 172.21.15.26:0/2439961810 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2574005040 con 0x7f258c0f66e0 2021-11-03T18:41:35.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.043+0000 7f258bfff700 1 --2- 172.21.15.26:0/2439961810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f258c0f66e0 0x7f258c06b9a0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 rx=0x7f257c002700 tx=0x7f257c009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:41:35.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.043+0000 7f2588ff9700 1 -- 172.21.15.26:0/2439961810 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f257c009320 con 0x7f258c0f66e0 2021-11-03T18:41:35.047 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.043+0000 7f2588ff9700 1 -- 172.21.15.26:0/2439961810 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f257c00f040 con 0x7f258c0f66e0 2021-11-03T18:41:35.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.043+0000 7f2588ff9700 1 -- 172.21.15.26:0/2439961810 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f257c014820 con 0x7f258c0f66e0 2021-11-03T18:41:35.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.043+0000 7f2592353700 1 -- 172.21.15.26:0/2439961810 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f258c06a7a0 con 0x7f258c0f66e0 2021-11-03T18:41:35.048 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.043+0000 7f2592353700 1 -- 172.21.15.26:0/2439961810 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f258c10ef20 con 0x7f258c0f66e0 2021-11-03T18:41:35.049 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.044+0000 7f2592353700 1 -- 172.21.15.26:0/2439961810 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f258c045ad0 con 0x7f258c0f66e0 2021-11-03T18:41:35.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.044+0000 7f2588ff9700 1 -- 172.21.15.26:0/2439961810 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f257c009480 con 0x7f258c0f66e0 2021-11-03T18:41:35.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.045+0000 7f2588ff9700 1 --2- 172.21.15.26:0/2439961810 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f25780640b0 0x7f2578066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:41:35.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.045+0000 7f2588ff9700 1 -- 172.21.15.26:0/2439961810 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f257c080a30 con 0x7f258c0f66e0 2021-11-03T18:41:35.050 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.045+0000 7f258b7fe700 1 --2- 172.21.15.26:0/2439961810 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f25780640b0 0x7f2578066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:41:35.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.045+0000 7f258b7fe700 1 --2- 172.21.15.26:0/2439961810 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f25780640b0 0x7f2578066570 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7f2574004630 tx=0x7f2574009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:41:35.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.049+0000 7f2588ff9700 1 -- 172.21.15.26:0/2439961810 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f257c052d90 con 0x7f258c0f66e0 2021-11-03T18:41:35.226 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.227+0000 7f2592353700 1 -- 172.21.15.26:0/2439961810 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f258c0ff010 con 0x7f25780640b0 2021-11-03T18:41:35.227 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.228+0000 7f2588ff9700 1 -- 172.21.15.26:0/2439961810 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f258c0ff010 con 0x7f25780640b0 2021-11-03T18:41:35.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.230+0000 7f2592353700 1 -- 172.21.15.26:0/2439961810 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f25780640b0 msgr2=0x7f2578066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:41:35.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.230+0000 7f2592353700 1 --2- 172.21.15.26:0/2439961810 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f25780640b0 0x7f2578066570 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7f2574004630 tx=0x7f2574009b30).stop 2021-11-03T18:41:35.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.230+0000 7f2592353700 1 -- 172.21.15.26:0/2439961810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f258c0f66e0 msgr2=0x7f258c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:41:35.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.230+0000 7f2592353700 1 --2- 172.21.15.26:0/2439961810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f258c0f66e0 0x7f258c06b9a0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 rx=0x7f257c002700 tx=0x7f257c009e00).stop 2021-11-03T18:41:35.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.230+0000 7f2592353700 1 -- 172.21.15.26:0/2439961810 shutdown_connections 2021-11-03T18:41:35.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.230+0000 7f2592353700 1 --2- 172.21.15.26:0/2439961810 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f25780640b0 0x7f2578066570 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:35.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.230+0000 7f2592353700 1 --2- 172.21.15.26:0/2439961810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f258c0f66e0 0x7f258c06b9a0 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:35.233 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.230+0000 7f2592353700 1 --2- 172.21.15.26:0/2439961810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f258c0f6ff0 0x7f258c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:35.233 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.230+0000 7f2592353700 1 -- 172.21.15.26:0/2439961810 >> 172.21.15.26:0/2439961810 conn(0x7f258c0f1f00 msgr2=0x7f258c0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:41:35.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.230+0000 7f2592353700 1 -- 172.21.15.26:0/2439961810 shutdown_connections 2021-11-03T18:41:35.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.230+0000 7f2592353700 1 -- 172.21.15.26:0/2439961810 wait complete. 2021-11-03T18:41:35.239 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:41:35.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.330+0000 7f0873abb700 1 -- 172.21.15.26:0/1243587815 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f086c0f6860 msgr2=0x7f086c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:41:35.331 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.330+0000 7f0873abb700 1 --2- 172.21.15.26:0/1243587815 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f086c0f6860 0x7f086c0f6cc0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 rx=0x7f0868004660 tx=0x7f0868009b30).stop 2021-11-03T18:41:35.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.330+0000 7f0873abb700 1 -- 172.21.15.26:0/1243587815 shutdown_connections 2021-11-03T18:41:35.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.330+0000 7f0873abb700 1 --2- 172.21.15.26:0/1243587815 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f086c0f6860 0x7f086c0f6cc0 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:35.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.330+0000 7f0873abb700 1 --2- 172.21.15.26:0/1243587815 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f086c0f55c0 0x7f086c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:35.332 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.330+0000 7f0873abb700 1 -- 172.21.15.26:0/1243587815 >> 172.21.15.26:0/1243587815 conn(0x7f086c0f0d20 msgr2=0x7f086c0f3140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:41:35.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.330+0000 7f0873abb700 1 -- 172.21.15.26:0/1243587815 shutdown_connections 2021-11-03T18:41:35.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.330+0000 7f0873abb700 1 -- 172.21.15.26:0/1243587815 wait complete. 2021-11-03T18:41:35.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.331+0000 7f0873abb700 1 Processor -- start 2021-11-03T18:41:35.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.331+0000 7f0873abb700 1 -- start start 2021-11-03T18:41:35.333 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.331+0000 7f0873abb700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f086c0f55c0 0x7f086c106f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:41:35.334 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.331+0000 7f0873abb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f086c0f6860 0x7f086c107420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:41:35.334 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.331+0000 7f0873abb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c1079d0 con 0x7f086c0f6860 2021-11-03T18:41:35.334 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.331+0000 7f0873abb700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c107b10 con 0x7f086c0f55c0 2021-11-03T18:41:35.334 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.331+0000 7f0871056700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f086c0f6860 0x7f086c107420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:41:35.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.331+0000 7f0871056700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f086c0f6860 0x7f086c107420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33232/0 (socket says 172.21.15.26:33232) 2021-11-03T18:41:35.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.331+0000 7f0871056700 1 -- 172.21.15.26:0/2457190613 learned_addr learned my addr 172.21.15.26:0/2457190613 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:41:35.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.331+0000 7f0871857700 1 --2- 172.21.15.26:0/2457190613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f086c0f55c0 0x7f086c106f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:41:35.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.331+0000 7f0871056700 1 -- 172.21.15.26:0/2457190613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f086c0f55c0 msgr2=0x7f086c106f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:41:35.335 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.331+0000 7f0871056700 1 --2- 172.21.15.26:0/2457190613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f086c0f55c0 0x7f086c106f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:35.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.331+0000 7f0871056700 1 -- 172.21.15.26:0/2457190613 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0868005040 con 0x7f086c0f6860 2021-11-03T18:41:35.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.331+0000 7f0871056700 1 --2- 172.21.15.26:0/2457190613 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f086c0f6860 0x7f086c107420 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 rx=0x7f0868009990 tx=0x7f0868009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:41:35.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.332+0000 7f085e7fc700 1 -- 172.21.15.26:0/2457190613 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0868018070 con 0x7f086c0f6860 2021-11-03T18:41:35.336 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.332+0000 7f0873abb700 1 -- 172.21.15.26:0/2457190613 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f086c108450 con 0x7f086c0f6860 2021-11-03T18:41:35.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.332+0000 7f085e7fc700 1 -- 172.21.15.26:0/2457190613 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0868007ca0 con 0x7f086c0f6860 2021-11-03T18:41:35.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.332+0000 7f085e7fc700 1 -- 172.21.15.26:0/2457190613 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f086801c620 con 0x7f086c0f6860 2021-11-03T18:41:35.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.332+0000 7f0873abb700 1 -- 172.21.15.26:0/2457190613 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f086c1089b0 con 0x7f086c0f6860 2021-11-03T18:41:35.338 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.333+0000 7f0873abb700 1 -- 172.21.15.26:0/2457190613 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f086c045ad0 con 0x7f086c0f6860 2021-11-03T18:41:35.338 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.333+0000 7f085e7fc700 1 -- 172.21.15.26:0/2457190613 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f086801d960 con 0x7f086c0f6860 2021-11-03T18:41:35.339 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.333+0000 7f085e7fc700 1 --2- 172.21.15.26:0/2457190613 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f08580640b0 0x7f0858066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:41:35.339 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.334+0000 7f085e7fc700 1 -- 172.21.15.26:0/2457190613 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f0868082520 con 0x7f086c0f6860 2021-11-03T18:41:35.339 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.334+0000 7f0871857700 1 --2- 172.21.15.26:0/2457190613 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f08580640b0 0x7f0858066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:41:35.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.334+0000 7f0871857700 1 --2- 172.21.15.26:0/2457190613 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f08580640b0 0x7f0858066570 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7f086c0f66c0 tx=0x7f0860009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:41:35.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.338+0000 7f085e7fc700 1 -- 172.21.15.26:0/2457190613 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f0868054940 con 0x7f086c0f6860 2021-11-03T18:41:35.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:35 smithi194 ceph-mon[65619]: pgmap v3207: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:35.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.511+0000 7f0873abb700 1 -- 172.21.15.26:0/2457190613 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f086c0faca0 con 0x7f08580640b0 2021-11-03T18:41:35.524 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.526+0000 7f085e7fc700 1 -- 172.21.15.26:0/2457190613 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7f086c0faca0 con 0x7f08580640b0 2021-11-03T18:41:35.525 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:41:35.525 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (112m) 48s ago 114m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:41:35.525 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (105m) 48s ago 114m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:41:35.526 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (104m) 9m ago 113m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:41:35.526 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (112m) 48s ago 113m 42.4M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:41:35.526 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (105m) 48s ago 109m 26.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:41:35.526 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (106m) 48s ago 109m 27.0M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:41:35.527 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (109m) 9m ago 109m 27.0M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:41:35.527 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (109m) 9m ago 109m 27.4M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:41:35.527 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (106m) 48s ago 115m 615M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:41:35.528 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (106m) 9m ago 113m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:41:35.528 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (105m) 48s ago 115m 407M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:41:35.528 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (105m) 9m ago 113m 171M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:41:35.529 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (113m) 48s ago 113m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:41:35.529 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (113m) 9m ago 113m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:41:35.529 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (104m) 48s ago 112m 372M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:41:35.529 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (104m) 48s ago 112m 400M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:41:35.529 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (103m) 48s ago 111m 332M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:41:35.530 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (103m) 9m ago 111m 413M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:41:35.530 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (102m) 9m ago 111m 339M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:41:35.530 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (102m) 9m ago 110m 337M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:41:35.530 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (112m) 48s ago 113m 70.2M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:41:35.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.527+0000 7f0873abb700 1 -- 172.21.15.26:0/2457190613 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f08580640b0 msgr2=0x7f0858066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:41:35.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.527+0000 7f0873abb700 1 --2- 172.21.15.26:0/2457190613 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f08580640b0 0x7f0858066570 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7f086c0f66c0 tx=0x7f0860009040).stop 2021-11-03T18:41:35.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.527+0000 7f0873abb700 1 -- 172.21.15.26:0/2457190613 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f086c0f6860 msgr2=0x7f086c107420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:41:35.532 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.527+0000 7f0873abb700 1 --2- 172.21.15.26:0/2457190613 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f086c0f6860 0x7f086c107420 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 rx=0x7f0868009990 tx=0x7f0868009b30).stop 2021-11-03T18:41:35.533 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.527+0000 7f0873abb700 1 -- 172.21.15.26:0/2457190613 shutdown_connections 2021-11-03T18:41:35.533 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.527+0000 7f0873abb700 1 --2- 172.21.15.26:0/2457190613 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f08580640b0 0x7f0858066570 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:35.533 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.527+0000 7f0873abb700 1 --2- 172.21.15.26:0/2457190613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f086c0f55c0 0x7f086c106f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:35.533 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.527+0000 7f0873abb700 1 --2- 172.21.15.26:0/2457190613 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f086c0f6860 0x7f086c107420 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:35.533 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.527+0000 7f0873abb700 1 -- 172.21.15.26:0/2457190613 >> 172.21.15.26:0/2457190613 conn(0x7f086c0f0d20 msgr2=0x7f086c05ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:41:35.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.528+0000 7f0873abb700 1 -- 172.21.15.26:0/2457190613 shutdown_connections 2021-11-03T18:41:35.534 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.528+0000 7f0873abb700 1 -- 172.21.15.26:0/2457190613 wait complete. 2021-11-03T18:41:35.576 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:35 smithi026 ceph-mon[96795]: pgmap v3207: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:35.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.627+0000 7f68c9548700 1 -- 172.21.15.26:0/2455301168 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68c40f7960 msgr2=0x7f68c40f7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:41:35.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.627+0000 7f68c9548700 1 --2- 172.21.15.26:0/2455301168 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68c40f7960 0x7f68c40f7dc0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 rx=0x7f68ac004660 tx=0x7f68ac009b30).stop 2021-11-03T18:41:35.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.627+0000 7f68c9548700 1 -- 172.21.15.26:0/2455301168 shutdown_connections 2021-11-03T18:41:35.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.627+0000 7f68c9548700 1 --2- 172.21.15.26:0/2455301168 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68c40f7960 0x7f68c40f7dc0 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:35.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.627+0000 7f68c9548700 1 --2- 172.21.15.26:0/2455301168 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68c40f66c0 0x7f68c40f6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:35.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.627+0000 7f68c9548700 1 -- 172.21.15.26:0/2455301168 >> 172.21.15.26:0/2455301168 conn(0x7f68c40f1e20 msgr2=0x7f68c40f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:41:35.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.627+0000 7f68c9548700 1 -- 172.21.15.26:0/2455301168 shutdown_connections 2021-11-03T18:41:35.629 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.627+0000 7f68c9548700 1 -- 172.21.15.26:0/2455301168 wait complete. 2021-11-03T18:41:35.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.628+0000 7f68c9548700 1 Processor -- start 2021-11-03T18:41:35.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.628+0000 7f68c9548700 1 -- start start 2021-11-03T18:41:35.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.628+0000 7f68c9548700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68c40f66c0 0x7f68c4106f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:41:35.630 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.628+0000 7f68c9548700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68c40f7960 0x7f68c4107440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:41:35.631 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.628+0000 7f68c9548700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c41079f0 con 0x7f68c40f7960 2021-11-03T18:41:35.631 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.628+0000 7f68c9548700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c4107b30 con 0x7f68c40f66c0 2021-11-03T18:41:35.631 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.628+0000 7f68c27fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68c40f7960 0x7f68c4107440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:41:35.631 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.628+0000 7f68c27fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68c40f7960 0x7f68c4107440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33242/0 (socket says 172.21.15.26:33242) 2021-11-03T18:41:35.631 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.628+0000 7f68c27fc700 1 -- 172.21.15.26:0/188202958 learned_addr learned my addr 172.21.15.26:0/188202958 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:41:35.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.628+0000 7f68c2ffd700 1 --2- 172.21.15.26:0/188202958 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68c40f66c0 0x7f68c4106f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:41:35.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.628+0000 7f68c27fc700 1 -- 172.21.15.26:0/188202958 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68c40f66c0 msgr2=0x7f68c4106f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:41:35.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.628+0000 7f68c27fc700 1 --2- 172.21.15.26:0/188202958 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68c40f66c0 0x7f68c4106f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:35.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.628+0000 7f68c27fc700 1 -- 172.21.15.26:0/188202958 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ac005040 con 0x7f68c40f7960 2021-11-03T18:41:35.632 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.628+0000 7f68c27fc700 1 --2- 172.21.15.26:0/188202958 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68c40f7960 0x7f68c4107440 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 rx=0x7f68ac009990 tx=0x7f68ac009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:41:35.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.629+0000 7f68bb7fe700 1 -- 172.21.15.26:0/188202958 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68ac018070 con 0x7f68c40f7960 2021-11-03T18:41:35.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.629+0000 7f68bb7fe700 1 -- 172.21.15.26:0/188202958 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f68ac007ba0 con 0x7f68c40f7960 2021-11-03T18:41:35.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.629+0000 7f68bb7fe700 1 -- 172.21.15.26:0/188202958 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68ac01c620 con 0x7f68c40f7960 2021-11-03T18:41:35.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.629+0000 7f68c9548700 1 -- 172.21.15.26:0/188202958 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c4108470 con 0x7f68c40f7960 2021-11-03T18:41:35.633 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.629+0000 7f68c9548700 1 -- 172.21.15.26:0/188202958 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c4108980 con 0x7f68c40f7960 2021-11-03T18:41:35.635 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.630+0000 7f68c9548700 1 -- 172.21.15.26:0/188202958 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68c4045ad0 con 0x7f68c40f7960 2021-11-03T18:41:35.635 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.630+0000 7f68bb7fe700 1 -- 172.21.15.26:0/188202958 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f68ac01c850 con 0x7f68c40f7960 2021-11-03T18:41:35.635 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.631+0000 7f68bb7fe700 1 --2- 172.21.15.26:0/188202958 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f68b00640b0 0x7f68b0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:41:35.635 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.631+0000 7f68bb7fe700 1 -- 172.21.15.26:0/188202958 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f68ac082610 con 0x7f68c40f7960 2021-11-03T18:41:35.636 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.631+0000 7f68c2ffd700 1 --2- 172.21.15.26:0/188202958 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f68b00640b0 0x7f68b0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:41:35.636 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.631+0000 7f68c2ffd700 1 --2- 172.21.15.26:0/188202958 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f68b00640b0 0x7f68b0066570 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7f68c40f77c0 tx=0x7f68bc009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:41:35.636 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.635+0000 7f68bb7fe700 1 -- 172.21.15.26:0/188202958 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f68ac054a30 con 0x7f68c40f7960 2021-11-03T18:41:35.867 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.868+0000 7f68c9548700 1 -- 172.21.15.26:0/188202958 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f68c4027a00 con 0x7f68c40f7960 2021-11-03T18:41:35.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.869+0000 7f68bb7fe700 1 -- 172.21.15.26:0/188202958 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f68ac054620 con 0x7f68c40f7960 2021-11-03T18:41:35.868 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:41:35.869 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:41:35.869 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:41:35.869 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:41:35.869 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:41:35.870 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:41:35.870 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:41:35.870 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:41:35.870 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:41:35.871 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:41:35.871 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:41:35.871 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:41:35.871 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:41:35.872 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:41:35.872 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:41:35.872 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:41:35.872 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:41:35.873 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:41:35.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.871+0000 7f68c9548700 1 -- 172.21.15.26:0/188202958 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f68b00640b0 msgr2=0x7f68b0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:41:35.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.871+0000 7f68c9548700 1 --2- 172.21.15.26:0/188202958 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f68b00640b0 0x7f68b0066570 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7f68c40f77c0 tx=0x7f68bc009040).stop 2021-11-03T18:41:35.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.871+0000 7f68c9548700 1 -- 172.21.15.26:0/188202958 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68c40f7960 msgr2=0x7f68c4107440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:41:35.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.871+0000 7f68c9548700 1 --2- 172.21.15.26:0/188202958 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68c40f7960 0x7f68c4107440 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 rx=0x7f68ac009990 tx=0x7f68ac009b30).stop 2021-11-03T18:41:35.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.871+0000 7f68c9548700 1 -- 172.21.15.26:0/188202958 shutdown_connections 2021-11-03T18:41:35.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.871+0000 7f68c9548700 1 --2- 172.21.15.26:0/188202958 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f68b00640b0 0x7f68b0066570 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:35.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.871+0000 7f68c9548700 1 --2- 172.21.15.26:0/188202958 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68c40f66c0 0x7f68c4106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:35.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.871+0000 7f68c9548700 1 --2- 172.21.15.26:0/188202958 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68c40f7960 0x7f68c4107440 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:35.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.871+0000 7f68c9548700 1 -- 172.21.15.26:0/188202958 >> 172.21.15.26:0/188202958 conn(0x7f68c40f1e20 msgr2=0x7f68c40fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:41:35.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.871+0000 7f68c9548700 1 -- 172.21.15.26:0/188202958 shutdown_connections 2021-11-03T18:41:35.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.871+0000 7f68c9548700 1 -- 172.21.15.26:0/188202958 wait complete. 2021-11-03T18:41:35.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.971+0000 7fc60fe92700 1 -- 172.21.15.26:0/378764325 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6080f4d60 msgr2=0x7fc6080f5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:41:35.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.971+0000 7fc60fe92700 1 --2- 172.21.15.26:0/378764325 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6080f4d60 0x7fc6080f5180 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 rx=0x7fc5f8004660 tx=0x7fc5f8009b30).stop 2021-11-03T18:41:35.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.971+0000 7fc60fe92700 1 -- 172.21.15.26:0/378764325 shutdown_connections 2021-11-03T18:41:35.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.971+0000 7fc60fe92700 1 --2- 172.21.15.26:0/378764325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6080f5f60 0x7fc6080f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:35.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.971+0000 7fc60fe92700 1 --2- 172.21.15.26:0/378764325 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6080f4d60 0x7fc6080f5180 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:35.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.971+0000 7fc60fe92700 1 -- 172.21.15.26:0/378764325 >> 172.21.15.26:0/378764325 conn(0x7fc6080f04c0 msgr2=0x7fc6080f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:41:35.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.971+0000 7fc60fe92700 1 -- 172.21.15.26:0/378764325 shutdown_connections 2021-11-03T18:41:35.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.971+0000 7fc60fe92700 1 -- 172.21.15.26:0/378764325 wait complete. 2021-11-03T18:41:35.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.971+0000 7fc60fe92700 1 Processor -- start 2021-11-03T18:41:35.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.973+0000 7fc60fe92700 1 -- start start 2021-11-03T18:41:35.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.973+0000 7fc60fe92700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6080f4d60 0x7fc608107030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:41:35.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.973+0000 7fc60fe92700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6080f5f60 0x7fc608107520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:41:35.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.973+0000 7fc60fe92700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc608107ad0 con 0x7fc6080f5f60 2021-11-03T18:41:35.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.973+0000 7fc60fe92700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc608107c10 con 0x7fc6080f4d60 2021-11-03T18:41:35.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.973+0000 7fc60d42d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6080f5f60 0x7fc608107520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:41:35.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.973+0000 7fc60d42d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6080f5f60 0x7fc608107520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33252/0 (socket says 172.21.15.26:33252) 2021-11-03T18:41:35.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.973+0000 7fc60d42d700 1 -- 172.21.15.26:0/2682496501 learned_addr learned my addr 172.21.15.26:0/2682496501 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:41:35.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.973+0000 7fc60dc2e700 1 --2- 172.21.15.26:0/2682496501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6080f4d60 0x7fc608107030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:41:35.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.973+0000 7fc60d42d700 1 -- 172.21.15.26:0/2682496501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6080f4d60 msgr2=0x7fc608107030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:41:35.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.973+0000 7fc60d42d700 1 --2- 172.21.15.26:0/2682496501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6080f4d60 0x7fc608107030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:35.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.973+0000 7fc60d42d700 1 -- 172.21.15.26:0/2682496501 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f8005040 con 0x7fc6080f5f60 2021-11-03T18:41:35.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.973+0000 7fc60d42d700 1 --2- 172.21.15.26:0/2682496501 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6080f5f60 0x7fc608107520 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 rx=0x7fc60400c530 tx=0x7fc604007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:41:35.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.973+0000 7fc5fe7fc700 1 -- 172.21.15.26:0/2682496501 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc60400f650 con 0x7fc6080f5f60 2021-11-03T18:41:35.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.973+0000 7fc5fe7fc700 1 -- 172.21.15.26:0/2682496501 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc60400fc60 con 0x7fc6080f5f60 2021-11-03T18:41:35.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.973+0000 7fc60fe92700 1 -- 172.21.15.26:0/2682496501 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6081085b0 con 0x7fc6080f5f60 2021-11-03T18:41:35.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.973+0000 7fc5fe7fc700 1 -- 172.21.15.26:0/2682496501 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc604012c20 con 0x7fc6080f5f60 2021-11-03T18:41:35.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.973+0000 7fc60fe92700 1 -- 172.21.15.26:0/2682496501 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc608108af0 con 0x7fc6080f5f60 2021-11-03T18:41:35.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.973+0000 7fc60fe92700 1 -- 172.21.15.26:0/2682496501 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc608045ad0 con 0x7fc6080f5f60 2021-11-03T18:41:35.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.974+0000 7fc5fe7fc700 1 -- 172.21.15.26:0/2682496501 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc604010070 con 0x7fc6080f5f60 2021-11-03T18:41:35.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.974+0000 7fc5fe7fc700 1 --2- 172.21.15.26:0/2682496501 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc5f40640b0 0x7fc5f4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:41:35.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.974+0000 7fc5fe7fc700 1 -- 172.21.15.26:0/2682496501 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc604080630 con 0x7fc6080f5f60 2021-11-03T18:41:35.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.974+0000 7fc60dc2e700 1 --2- 172.21.15.26:0/2682496501 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc5f40640b0 0x7fc5f4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:41:35.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.975+0000 7fc60dc2e700 1 --2- 172.21.15.26:0/2682496501 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc5f40640b0 0x7fc5f4066570 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 rx=0x7fc5f8004630 tx=0x7fc5f8009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:41:35.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:35.978+0000 7fc5fe7fc700 1 -- 172.21.15.26:0/2682496501 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc6040528a0 con 0x7fc6080f5f60 2021-11-03T18:41:36.184 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:36.185+0000 7fc60fe92700 1 -- 172.21.15.26:0/2682496501 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc6080fd5e0 con 0x7fc6080f5f60 2021-11-03T18:41:36.185 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:36.186+0000 7fc5fe7fc700 1 -- 172.21.15.26:0/2682496501 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fc604052490 con 0x7fc6080f5f60 2021-11-03T18:41:36.185 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:41:36.185 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:41:36.186 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:41:36.186 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:41:36.186 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:41:36.186 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:41:36.187 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:41:36.187 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:41:36.187 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:41:36.187 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:41:36.188 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:41:36.188 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:41:36.188 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:41:36.188 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:41:36.188 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:41:36.189 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:41:36.189 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:41:36.189 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:41:36.189 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:41:36.190 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:41:36.190 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:41:36.190 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:41:36.190 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:41:36.190 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:41:36.191 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:41:36.191 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:41:36.191 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:41:36.191 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:41:36.192 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:41:36.192 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:41:36.192 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:41:36.192 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:41:36.193 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:41:36.193 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:41:36.193 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:41:36.193 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:41:36.193 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:41:36.194 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:41:36.194 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:41:36.195 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:36.187+0000 7fc60fe92700 1 -- 172.21.15.26:0/2682496501 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc5f40640b0 msgr2=0x7fc5f4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:41:36.195 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:36.187+0000 7fc60fe92700 1 --2- 172.21.15.26:0/2682496501 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc5f40640b0 0x7fc5f4066570 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 rx=0x7fc5f8004630 tx=0x7fc5f8009b30).stop 2021-11-03T18:41:36.195 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:36.187+0000 7fc60fe92700 1 -- 172.21.15.26:0/2682496501 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6080f5f60 msgr2=0x7fc608107520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:41:36.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:36.187+0000 7fc60fe92700 1 --2- 172.21.15.26:0/2682496501 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6080f5f60 0x7fc608107520 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 rx=0x7fc60400c530 tx=0x7fc604007e20).stop 2021-11-03T18:41:36.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:36.187+0000 7fc60fe92700 1 -- 172.21.15.26:0/2682496501 shutdown_connections 2021-11-03T18:41:36.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:36.188+0000 7fc60fe92700 1 --2- 172.21.15.26:0/2682496501 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc5f40640b0 0x7fc5f4066570 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:36.196 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:36.188+0000 7fc60fe92700 1 --2- 172.21.15.26:0/2682496501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6080f4d60 0x7fc608107030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:36.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:36.188+0000 7fc60fe92700 1 --2- 172.21.15.26:0/2682496501 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6080f5f60 0x7fc608107520 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:41:36.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:36.188+0000 7fc60fe92700 1 -- 172.21.15.26:0/2682496501 >> 172.21.15.26:0/2682496501 conn(0x7fc6080f04c0 msgr2=0x7fc6080f9420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:41:36.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:36.188+0000 7fc60fe92700 1 -- 172.21.15.26:0/2682496501 shutdown_connections 2021-11-03T18:41:36.197 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:41:36.188+0000 7fc60fe92700 1 -- 172.21.15.26:0/2682496501 wait complete. 2021-11-03T18:41:36.197 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:41:36.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:36 smithi194 ceph-mon[65619]: from='client.37436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:41:36.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:36 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/188202958' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:41:36.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:36 smithi026 ceph-mon[96795]: from='client.37436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:41:36.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:36 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/188202958' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:41:37.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:37 smithi194 ceph-mon[65619]: from='client.37440 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:41:37.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:37 smithi194 ceph-mon[65619]: pgmap v3208: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:37.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:37 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2682496501' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:41:37.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:37 smithi026 ceph-mon[96795]: from='client.37440 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:41:37.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:37 smithi026 ceph-mon[96795]: pgmap v3208: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:37.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:37 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2682496501' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:41:39.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:39 smithi194 ceph-mon[65619]: pgmap v3209: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:39.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:39 smithi026 ceph-mon[96795]: pgmap v3209: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:41.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:41 smithi026 ceph-mon[96795]: pgmap v3210: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:41.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:41 smithi194 ceph-mon[65619]: pgmap v3210: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:43.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:43 smithi194 ceph-mon[65619]: pgmap v3211: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:43.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:43 smithi026 ceph-mon[96795]: pgmap v3211: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:45.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:45 smithi194 ceph-mon[65619]: pgmap v3212: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:45.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:45 smithi026 ceph-mon[96795]: pgmap v3212: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:47.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:47 smithi194 ceph-mon[65619]: pgmap v3213: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:47.615 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:47 smithi026 ceph-mon[96795]: pgmap v3213: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:48.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:41:48.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:48 smithi194 ceph-mon[65619]: poll took 60070.042 ms: 1 events 2021-11-03T18:41:48.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:41:48.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:48 smithi026 ceph-mon[96795]: poll took 60070.042 ms: 1 events 2021-11-03T18:41:49.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:49 smithi194 ceph-mon[65619]: pgmap v3214: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:49.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:41:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:41:49.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:49 smithi026 ceph-mon[96795]: pgmap v3214: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:49.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:41:49.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:41:51.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:51 smithi194 ceph-mon[65619]: pgmap v3215: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:51.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:51 smithi194 ceph-mon[65619]: poll took 2559.701 ms: 1 events 2021-11-03T18:41:51.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:51 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:41:51.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:51 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:41:51.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:51 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:41:51.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:51 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:41:51.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:51 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:41:51.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:51 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:41:51.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:51 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:41:51.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:51 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:41:51.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:51 smithi026 ceph-mon[96795]: pgmap v3215: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:51.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:51 smithi026 ceph-mon[96795]: poll took 2559.701 ms: 1 events 2021-11-03T18:41:51.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:51 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:41:51.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:51 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:41:51.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:51 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:41:51.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:51 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:41:51.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:51 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:41:51.677 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:51 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:41:51.677 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:51 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:41:51.677 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:51 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:41:52.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:52 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:41:52.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:52 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:41:52.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:52 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:41:52.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:52 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:41:53.476 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:53 smithi194 ceph-mon[65619]: pgmap v3216: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:53.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:53 smithi026 ceph-mon[96795]: pgmap v3216: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:55.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:55 smithi194 ceph-mon[65619]: pgmap v3217: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:55.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:55 smithi026 ceph-mon[96795]: pgmap v3217: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:57.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:57 smithi194 ceph-mon[65619]: pgmap v3218: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:57.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:57 smithi026 ceph-mon[96795]: pgmap v3218: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:59.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:41:59 smithi194 ceph-mon[65619]: pgmap v3219: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:41:59.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:41:59 smithi026 ceph-mon[96795]: pgmap v3219: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:01.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:01 smithi026 ceph-mon[96795]: pgmap v3220: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:01.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:01 smithi194 ceph-mon[65619]: pgmap v3220: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:03.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:03 smithi194 ceph-mon[65619]: pgmap v3221: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:03.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:03 smithi026 ceph-mon[96795]: pgmap v3221: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:05.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:05 smithi194 ceph-mon[65619]: pgmap v3222: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:05.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:05 smithi026 ceph-mon[96795]: pgmap v3222: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:06.303 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.302+0000 7f6c0de97700 1 -- 172.21.15.26:0/3197526258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c080602f0 msgr2=0x7f6c080f9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:42:06.303 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.302+0000 7f6c0de97700 1 --2- 172.21.15.26:0/3197526258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c080602f0 0x7f6c080f9400 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 rx=0x7f6bf8004660 tx=0x7f6bf8009b30).stop 2021-11-03T18:42:06.303 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.302+0000 7f6c0de97700 1 -- 172.21.15.26:0/3197526258 shutdown_connections 2021-11-03T18:42:06.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.302+0000 7f6c0de97700 1 --2- 172.21.15.26:0/3197526258 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c080f98f0 0x7f6c080fbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:06.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.302+0000 7f6c0de97700 1 --2- 172.21.15.26:0/3197526258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c080602f0 0x7f6c080f9400 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:06.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.302+0000 7f6c0de97700 1 -- 172.21.15.26:0/3197526258 >> 172.21.15.26:0/3197526258 conn(0x7f6c080f0de0 msgr2=0x7f6c080f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:42:06.304 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.302+0000 7f6c0de97700 1 -- 172.21.15.26:0/3197526258 shutdown_connections 2021-11-03T18:42:06.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.302+0000 7f6c0de97700 1 -- 172.21.15.26:0/3197526258 wait complete. 2021-11-03T18:42:06.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.303+0000 7f6c0de97700 1 Processor -- start 2021-11-03T18:42:06.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.303+0000 7f6c0de97700 1 -- start start 2021-11-03T18:42:06.305 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.303+0000 7f6c0de97700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c080602f0 0x7f6c08106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:42:06.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.303+0000 7f6c0de97700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c080f98f0 0x7f6c08107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:42:06.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.303+0000 7f6c0de97700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c08107a10 con 0x7f6c080f98f0 2021-11-03T18:42:06.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.303+0000 7f6c0de97700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c08107b50 con 0x7f6c080602f0 2021-11-03T18:42:06.306 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.304+0000 7f6c06ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c080f98f0 0x7f6c08107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:42:06.307 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.304+0000 7f6c06ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c080f98f0 0x7f6c08107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33270/0 (socket says 172.21.15.26:33270) 2021-11-03T18:42:06.307 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.304+0000 7f6c06ffd700 1 -- 172.21.15.26:0/148367735 learned_addr learned my addr 172.21.15.26:0/148367735 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:42:06.307 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.304+0000 7f6c077fe700 1 --2- 172.21.15.26:0/148367735 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c080602f0 0x7f6c08106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:42:06.307 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.304+0000 7f6c06ffd700 1 -- 172.21.15.26:0/148367735 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c080602f0 msgr2=0x7f6c08106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:42:06.308 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.304+0000 7f6c06ffd700 1 --2- 172.21.15.26:0/148367735 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c080602f0 0x7f6c08106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:06.308 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.304+0000 7f6c06ffd700 1 -- 172.21.15.26:0/148367735 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf8005040 con 0x7f6c080f98f0 2021-11-03T18:42:06.308 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.304+0000 7f6c06ffd700 1 --2- 172.21.15.26:0/148367735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c080f98f0 0x7f6c08107460 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 rx=0x7f6bfc0026d0 tx=0x7f6bfc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:42:06.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.304+0000 7f6beffff700 1 -- 172.21.15.26:0/148367735 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bfc009320 con 0x7f6c080f98f0 2021-11-03T18:42:06.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.304+0000 7f6beffff700 1 -- 172.21.15.26:0/148367735 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6bfc00f040 con 0x7f6c080f98f0 2021-11-03T18:42:06.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.304+0000 7f6c0de97700 1 -- 172.21.15.26:0/148367735 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c081084f0 con 0x7f6c080f98f0 2021-11-03T18:42:06.310 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.304+0000 7f6beffff700 1 -- 172.21.15.26:0/148367735 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bfc0147e0 con 0x7f6c080f98f0 2021-11-03T18:42:06.310 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.304+0000 7f6c0de97700 1 -- 172.21.15.26:0/148367735 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c08108ab0 con 0x7f6c080f98f0 2021-11-03T18:42:06.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.306+0000 7f6c0de97700 1 -- 172.21.15.26:0/148367735 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c08045ad0 con 0x7f6c080f98f0 2021-11-03T18:42:06.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.306+0000 7f6beffff700 1 -- 172.21.15.26:0/148367735 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f6bfc0077b0 con 0x7f6c080f98f0 2021-11-03T18:42:06.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.306+0000 7f6beffff700 1 --2- 172.21.15.26:0/148367735 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6bf00640b0 0x7f6bf0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:42:06.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.306+0000 7f6beffff700 1 -- 172.21.15.26:0/148367735 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f6bfc080de0 con 0x7f6c080f98f0 2021-11-03T18:42:06.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.306+0000 7f6c077fe700 1 --2- 172.21.15.26:0/148367735 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6bf00640b0 0x7f6bf0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:42:06.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.307+0000 7f6c077fe700 1 --2- 172.21.15.26:0/148367735 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6bf00640b0 0x7f6bf0066570 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7f6bf8004630 tx=0x7f6bf8009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:42:06.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.311+0000 7f6beffff700 1 -- 172.21.15.26:0/148367735 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f6bfc053140 con 0x7f6c080f98f0 2021-11-03T18:42:06.488 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.490+0000 7f6c0de97700 1 -- 172.21.15.26:0/148367735 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c08108d80 con 0x7f6bf00640b0 2021-11-03T18:42:06.489 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.491+0000 7f6beffff700 1 -- 172.21.15.26:0/148367735 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f6c08108d80 con 0x7f6bf00640b0 2021-11-03T18:42:06.491 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.493+0000 7f6c0de97700 1 -- 172.21.15.26:0/148367735 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6bf00640b0 msgr2=0x7f6bf0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:42:06.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.493+0000 7f6c0de97700 1 --2- 172.21.15.26:0/148367735 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6bf00640b0 0x7f6bf0066570 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7f6bf8004630 tx=0x7f6bf8009b30).stop 2021-11-03T18:42:06.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.493+0000 7f6c0de97700 1 -- 172.21.15.26:0/148367735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c080f98f0 msgr2=0x7f6c08107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:42:06.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.493+0000 7f6c0de97700 1 --2- 172.21.15.26:0/148367735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c080f98f0 0x7f6c08107460 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 rx=0x7f6bfc0026d0 tx=0x7f6bfc009de0).stop 2021-11-03T18:42:06.492 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.493+0000 7f6c0de97700 1 -- 172.21.15.26:0/148367735 shutdown_connections 2021-11-03T18:42:06.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.493+0000 7f6c0de97700 1 --2- 172.21.15.26:0/148367735 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6bf00640b0 0x7f6bf0066570 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:06.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.493+0000 7f6c0de97700 1 --2- 172.21.15.26:0/148367735 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c080602f0 0x7f6c08106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:06.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.493+0000 7f6c0de97700 1 --2- 172.21.15.26:0/148367735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c080f98f0 0x7f6c08107460 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:06.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.493+0000 7f6c0de97700 1 -- 172.21.15.26:0/148367735 >> 172.21.15.26:0/148367735 conn(0x7f6c080f0de0 msgr2=0x7f6c080f31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:42:06.493 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.493+0000 7f6c0de97700 1 -- 172.21.15.26:0/148367735 shutdown_connections 2021-11-03T18:42:06.494 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.493+0000 7f6c0de97700 1 -- 172.21.15.26:0/148367735 wait complete. 2021-11-03T18:42:06.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:06 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:42:06.502 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:42:06.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.593+0000 7f759569e700 1 -- 172.21.15.26:0/511677956 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75900f6ff0 msgr2=0x7f75900f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:42:06.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.593+0000 7f759569e700 1 --2- 172.21.15.26:0/511677956 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75900f6ff0 0x7f75900f7a20 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 rx=0x7f7584004660 tx=0x7f7584009b30).stop 2021-11-03T18:42:06.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.593+0000 7f759569e700 1 -- 172.21.15.26:0/511677956 shutdown_connections 2021-11-03T18:42:06.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.593+0000 7f759569e700 1 --2- 172.21.15.26:0/511677956 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75900f6ff0 0x7f75900f7a20 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:06.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.593+0000 7f759569e700 1 --2- 172.21.15.26:0/511677956 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75900f66e0 0x7f75900f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:06.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.593+0000 7f759569e700 1 -- 172.21.15.26:0/511677956 >> 172.21.15.26:0/511677956 conn(0x7f75900f1f00 msgr2=0x7f75900f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:42:06.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.593+0000 7f759569e700 1 -- 172.21.15.26:0/511677956 shutdown_connections 2021-11-03T18:42:06.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.593+0000 7f759569e700 1 -- 172.21.15.26:0/511677956 wait complete. 2021-11-03T18:42:06.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.594+0000 7f759569e700 1 Processor -- start 2021-11-03T18:42:06.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.594+0000 7f759569e700 1 -- start start 2021-11-03T18:42:06.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.594+0000 7f759569e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75900f66e0 0x7f759006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:42:06.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.594+0000 7f759569e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75900f6ff0 0x7f7590069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:42:06.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.594+0000 7f759569e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759006a380 con 0x7f75900f66e0 2021-11-03T18:42:06.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.594+0000 7f759569e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759006a4c0 con 0x7f75900f6ff0 2021-11-03T18:42:06.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.594+0000 7f758effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75900f66e0 0x7f759006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:42:06.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.594+0000 7f758effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75900f66e0 0x7f759006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33278/0 (socket says 172.21.15.26:33278) 2021-11-03T18:42:06.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.594+0000 7f758effd700 1 -- 172.21.15.26:0/1297260842 learned_addr learned my addr 172.21.15.26:0/1297260842 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:42:06.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.595+0000 7f758effd700 1 -- 172.21.15.26:0/1297260842 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75900f6ff0 msgr2=0x7f7590069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:42:06.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.595+0000 7f758effd700 1 --2- 172.21.15.26:0/1297260842 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75900f6ff0 0x7f7590069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:42:06.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.595+0000 7f758effd700 1 -- 172.21.15.26:0/1297260842 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7584005040 con 0x7f75900f66e0 2021-11-03T18:42:06.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.595+0000 7f758effd700 1 --2- 172.21.15.26:0/1297260842 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75900f66e0 0x7f759006b9a0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 rx=0x7f75800026d0 tx=0x7f7580009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:42:06.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.595+0000 7f75777fe700 1 -- 172.21.15.26:0/1297260842 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7580009320 con 0x7f75900f66e0 2021-11-03T18:42:06.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.595+0000 7f759569e700 1 -- 172.21.15.26:0/1297260842 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f759006a7a0 con 0x7f75900f66e0 2021-11-03T18:42:06.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.595+0000 7f75777fe700 1 -- 172.21.15.26:0/1297260842 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f758000f040 con 0x7f75900f66e0 2021-11-03T18:42:06.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.595+0000 7f75777fe700 1 -- 172.21.15.26:0/1297260842 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75800147e0 con 0x7f75900f66e0 2021-11-03T18:42:06.600 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.595+0000 7f759569e700 1 -- 172.21.15.26:0/1297260842 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f759010efa0 con 0x7f75900f66e0 2021-11-03T18:42:06.600 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.596+0000 7f759569e700 1 -- 172.21.15.26:0/1297260842 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7590045ad0 con 0x7f75900f66e0 2021-11-03T18:42:06.600 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.596+0000 7f75777fe700 1 -- 172.21.15.26:0/1297260842 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f7580009480 con 0x7f75900f66e0 2021-11-03T18:42:06.600 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.597+0000 7f75777fe700 1 --2- 172.21.15.26:0/1297260842 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f75780640b0 0x7f7578066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:42:06.600 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.597+0000 7f75777fe700 1 -- 172.21.15.26:0/1297260842 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f7580080ee0 con 0x7f75900f66e0 2021-11-03T18:42:06.601 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.597+0000 7f758e7fc700 1 --2- 172.21.15.26:0/1297260842 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f75780640b0 0x7f7578066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:42:06.601 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.597+0000 7f758e7fc700 1 --2- 172.21.15.26:0/1297260842 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f75780640b0 0x7f7578066570 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7f7584004e30 tx=0x7f7584009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:42:06.602 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.601+0000 7f75777fe700 1 -- 172.21.15.26:0/1297260842 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f7580053240 con 0x7f75900f66e0 2021-11-03T18:42:06.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:06 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:42:06.772 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.773+0000 7f759569e700 1 -- 172.21.15.26:0/1297260842 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f75900ff090 con 0x7f75780640b0 2021-11-03T18:42:06.786 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.788+0000 7f75777fe700 1 -- 172.21.15.26:0/1297260842 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7f75900ff090 con 0x7f75780640b0 2021-11-03T18:42:06.786 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:42:06.787 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (113m) 79s ago 114m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:42:06.787 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (105m) 79s ago 114m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:42:06.787 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (105m) 16s ago 113m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:42:06.787 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (113m) 79s ago 114m 42.4M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:42:06.788 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (106m) 79s ago 109m 26.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:42:06.788 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (106m) 79s ago 109m 27.0M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:42:06.788 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (109m) 16s ago 109m 27.2M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:42:06.788 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (109m) 16s ago 109m 27.6M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:42:06.789 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (107m) 79s ago 115m 615M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:42:06.789 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (106m) 16s ago 113m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:42:06.789 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (106m) 79s ago 116m 407M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:42:06.789 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (106m) 16s ago 113m 187M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:42:06.789 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (114m) 79s ago 114m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:42:06.789 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (113m) 16s ago 113m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:42:06.790 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (105m) 79s ago 112m 372M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:42:06.790 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (104m) 79s ago 112m 400M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:42:06.790 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (104m) 79s ago 112m 332M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:42:06.790 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (103m) 16s ago 111m 438M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:42:06.791 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (103m) 16s ago 111m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:42:06.791 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (102m) 16s ago 111m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:42:06.791 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (113m) 79s ago 113m 70.2M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:42:06.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.790+0000 7f759569e700 1 -- 172.21.15.26:0/1297260842 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f75780640b0 msgr2=0x7f7578066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:42:06.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.790+0000 7f759569e700 1 --2- 172.21.15.26:0/1297260842 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f75780640b0 0x7f7578066570 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7f7584004e30 tx=0x7f7584009b30).stop 2021-11-03T18:42:06.792 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.790+0000 7f759569e700 1 -- 172.21.15.26:0/1297260842 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75900f66e0 msgr2=0x7f759006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:42:06.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.790+0000 7f759569e700 1 --2- 172.21.15.26:0/1297260842 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75900f66e0 0x7f759006b9a0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 rx=0x7f75800026d0 tx=0x7f7580009de0).stop 2021-11-03T18:42:06.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.790+0000 7f759569e700 1 -- 172.21.15.26:0/1297260842 shutdown_connections 2021-11-03T18:42:06.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.790+0000 7f759569e700 1 --2- 172.21.15.26:0/1297260842 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f75780640b0 0x7f7578066570 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:06.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.790+0000 7f759569e700 1 --2- 172.21.15.26:0/1297260842 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75900f66e0 0x7f759006b9a0 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:06.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.790+0000 7f759569e700 1 --2- 172.21.15.26:0/1297260842 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75900f6ff0 0x7f7590069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:42:06.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.790+0000 7f759569e700 1 -- 172.21.15.26:0/1297260842 >> 172.21.15.26:0/1297260842 conn(0x7f75900f1f00 msgr2=0x7f75900fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:42:06.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.790+0000 7f759569e700 1 -- 172.21.15.26:0/1297260842 shutdown_connections 2021-11-03T18:42:06.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.790+0000 7f759569e700 1 -- 172.21.15.26:0/1297260842 wait complete. 2021-11-03T18:42:06.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.890+0000 7f2b70968700 1 -- 172.21.15.26:0/3715744810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b6c0f5430 msgr2=0x7f2b6c0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:42:06.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.890+0000 7f2b70968700 1 --2- 172.21.15.26:0/3715744810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b6c0f5430 0x7f2b6c0f5850 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 rx=0x7f2b5c004660 tx=0x7f2b5c009b30).stop 2021-11-03T18:42:06.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.890+0000 7f2b70968700 1 -- 172.21.15.26:0/3715744810 shutdown_connections 2021-11-03T18:42:06.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.890+0000 7f2b70968700 1 --2- 172.21.15.26:0/3715744810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b6c0f66d0 0x7f2b6c0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:06.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.890+0000 7f2b70968700 1 --2- 172.21.15.26:0/3715744810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b6c0f5430 0x7f2b6c0f5850 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:06.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.890+0000 7f2b70968700 1 -- 172.21.15.26:0/3715744810 >> 172.21.15.26:0/3715744810 conn(0x7f2b6c0f0b90 msgr2=0x7f2b6c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:42:06.891 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.890+0000 7f2b70968700 1 -- 172.21.15.26:0/3715744810 shutdown_connections 2021-11-03T18:42:06.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.890+0000 7f2b70968700 1 -- 172.21.15.26:0/3715744810 wait complete. 2021-11-03T18:42:06.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.891+0000 7f2b70968700 1 Processor -- start 2021-11-03T18:42:06.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.891+0000 7f2b70968700 1 -- start start 2021-11-03T18:42:06.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.891+0000 7f2b70968700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b6c0f5430 0x7f2b6c109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:42:06.892 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.891+0000 7f2b70968700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b6c0f66d0 0x7f2b6c10bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:42:06.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.891+0000 7f2b70968700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c0603e0 con 0x7f2b6c0f5430 2021-11-03T18:42:06.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.891+0000 7f2b70968700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c060520 con 0x7f2b6c0f66d0 2021-11-03T18:42:06.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.891+0000 7f2b6ad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b6c0f5430 0x7f2b6c109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:42:06.893 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.891+0000 7f2b6ad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b6c0f5430 0x7f2b6c109a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33288/0 (socket says 172.21.15.26:33288) 2021-11-03T18:42:06.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.891+0000 7f2b6ad9d700 1 -- 172.21.15.26:0/2622585772 learned_addr learned my addr 172.21.15.26:0/2622585772 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:42:06.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.892+0000 7f2b6ad9d700 1 -- 172.21.15.26:0/2622585772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b6c0f66d0 msgr2=0x7f2b6c10bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:42:06.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.892+0000 7f2b6ad9d700 1 --2- 172.21.15.26:0/2622585772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b6c0f66d0 0x7f2b6c10bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:42:06.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.892+0000 7f2b6ad9d700 1 -- 172.21.15.26:0/2622585772 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b5c005040 con 0x7f2b6c0f5430 2021-11-03T18:42:06.894 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.892+0000 7f2b6ad9d700 1 --2- 172.21.15.26:0/2622585772 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b6c0f5430 0x7f2b6c109a90 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 rx=0x7f2b5c004f60 tx=0x7f2b5c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:42:06.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.892+0000 7f2b537fe700 1 -- 172.21.15.26:0/2622585772 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b5c018070 con 0x7f2b6c0f5430 2021-11-03T18:42:06.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.892+0000 7f2b537fe700 1 -- 172.21.15.26:0/2622585772 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2b5c007ba0 con 0x7f2b6c0f5430 2021-11-03T18:42:06.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.892+0000 7f2b70968700 1 -- 172.21.15.26:0/2622585772 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b6c10c4e0 con 0x7f2b6c0f5430 2021-11-03T18:42:06.895 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.892+0000 7f2b537fe700 1 -- 172.21.15.26:0/2622585772 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b5c01c620 con 0x7f2b6c0f5430 2021-11-03T18:42:06.896 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.892+0000 7f2b70968700 1 -- 172.21.15.26:0/2622585772 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b6c10ca40 con 0x7f2b6c0f5430 2021-11-03T18:42:06.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.893+0000 7f2b70968700 1 -- 172.21.15.26:0/2622585772 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b6c045ad0 con 0x7f2b6c0f5430 2021-11-03T18:42:06.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.893+0000 7f2b537fe700 1 -- 172.21.15.26:0/2622585772 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f2b5c01d420 con 0x7f2b6c0f5430 2021-11-03T18:42:06.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.894+0000 7f2b537fe700 1 --2- 172.21.15.26:0/2622585772 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2b54064100 0x7f2b540665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:42:06.897 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.894+0000 7f2b537fe700 1 -- 172.21.15.26:0/2622585772 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f2b5c082620 con 0x7f2b6c0f5430 2021-11-03T18:42:06.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.894+0000 7f2b6a59c700 1 --2- 172.21.15.26:0/2622585772 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2b54064100 0x7f2b540665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:42:06.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.894+0000 7f2b6a59c700 1 --2- 172.21.15.26:0/2622585772 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2b54064100 0x7f2b540665c0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 rx=0x7f2b600047d0 tx=0x7f2b60007a40).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:42:06.898 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:06.898+0000 7f2b537fe700 1 -- 172.21.15.26:0/2622585772 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f2b5c054a40 con 0x7f2b6c0f5430 2021-11-03T18:42:07.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.132+0000 7f2b70968700 1 -- 172.21.15.26:0/2622585772 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2b6c0586e0 con 0x7f2b6c0f5430 2021-11-03T18:42:07.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.132+0000 7f2b537fe700 1 -- 172.21.15.26:0/2622585772 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f2b5c054630 con 0x7f2b6c0f5430 2021-11-03T18:42:07.131 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:42:07.131 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:42:07.131 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:42:07.132 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:42:07.132 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:42:07.132 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:42:07.132 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:42:07.133 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:42:07.133 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:42:07.133 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:42:07.133 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:42:07.133 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:42:07.134 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:42:07.134 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:42:07.134 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:42:07.134 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:42:07.135 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:42:07.135 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:42:07.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.134+0000 7f2b70968700 1 -- 172.21.15.26:0/2622585772 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2b54064100 msgr2=0x7f2b540665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:42:07.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.134+0000 7f2b70968700 1 --2- 172.21.15.26:0/2622585772 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2b54064100 0x7f2b540665c0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 rx=0x7f2b600047d0 tx=0x7f2b60007a40).stop 2021-11-03T18:42:07.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.134+0000 7f2b70968700 1 -- 172.21.15.26:0/2622585772 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b6c0f5430 msgr2=0x7f2b6c109a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:42:07.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.134+0000 7f2b70968700 1 --2- 172.21.15.26:0/2622585772 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b6c0f5430 0x7f2b6c109a90 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 rx=0x7f2b5c004f60 tx=0x7f2b5c009b30).stop 2021-11-03T18:42:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.134+0000 7f2b70968700 1 -- 172.21.15.26:0/2622585772 shutdown_connections 2021-11-03T18:42:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.134+0000 7f2b70968700 1 --2- 172.21.15.26:0/2622585772 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2b54064100 0x7f2b540665c0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.134+0000 7f2b70968700 1 --2- 172.21.15.26:0/2622585772 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b6c0f5430 0x7f2b6c109a90 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.134+0000 7f2b70968700 1 --2- 172.21.15.26:0/2622585772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b6c0f66d0 0x7f2b6c10bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:42:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.134+0000 7f2b70968700 1 -- 172.21.15.26:0/2622585772 >> 172.21.15.26:0/2622585772 conn(0x7f2b6c0f0b90 msgr2=0x7f2b6c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:42:07.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.134+0000 7f2b70968700 1 -- 172.21.15.26:0/2622585772 shutdown_connections 2021-11-03T18:42:07.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.134+0000 7f2b70968700 1 -- 172.21.15.26:0/2622585772 wait complete. 2021-11-03T18:42:07.233 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.235+0000 7f17a9996700 1 -- 172.21.15.26:0/4206852337 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17a40f55c0 msgr2=0x7f17a40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:42:07.233 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.235+0000 7f17a9996700 1 --2- 172.21.15.26:0/4206852337 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17a40f55c0 0x7f17a40f59e0 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 rx=0x7f179c004660 tx=0x7f179c009b30).stop 2021-11-03T18:42:07.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.235+0000 7f17a9996700 1 -- 172.21.15.26:0/4206852337 shutdown_connections 2021-11-03T18:42:07.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.235+0000 7f17a9996700 1 --2- 172.21.15.26:0/4206852337 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17a40f6860 0x7f17a40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:07.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.235+0000 7f17a9996700 1 --2- 172.21.15.26:0/4206852337 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17a40f55c0 0x7f17a40f59e0 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:07.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.235+0000 7f17a9996700 1 -- 172.21.15.26:0/4206852337 >> 172.21.15.26:0/4206852337 conn(0x7f17a40f0d20 msgr2=0x7f17a40f3140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:42:07.235 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.235+0000 7f17a9996700 1 -- 172.21.15.26:0/4206852337 shutdown_connections 2021-11-03T18:42:07.235 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.235+0000 7f17a9996700 1 -- 172.21.15.26:0/4206852337 wait complete. 2021-11-03T18:42:07.237 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.236+0000 7f17a9996700 1 Processor -- start 2021-11-03T18:42:07.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.236+0000 7f17a9996700 1 -- start start 2021-11-03T18:42:07.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.236+0000 7f17a9996700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17a40f55c0 0x7f17a4106fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:42:07.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.236+0000 7f17a9996700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17a40f6860 0x7f17a41074c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:42:07.238 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.236+0000 7f17a9996700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a4107a70 con 0x7f17a40f6860 2021-11-03T18:42:07.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.236+0000 7f17a9996700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a4107bb0 con 0x7f17a40f55c0 2021-11-03T18:42:07.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.236+0000 7f17a27fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17a40f6860 0x7f17a41074c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:42:07.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.236+0000 7f17a27fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17a40f6860 0x7f17a41074c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33300/0 (socket says 172.21.15.26:33300) 2021-11-03T18:42:07.239 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.236+0000 7f17a27fc700 1 -- 172.21.15.26:0/508043622 learned_addr learned my addr 172.21.15.26:0/508043622 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:42:07.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.236+0000 7f17a2ffd700 1 --2- 172.21.15.26:0/508043622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17a40f55c0 0x7f17a4106fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:42:07.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.236+0000 7f17a27fc700 1 -- 172.21.15.26:0/508043622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17a40f55c0 msgr2=0x7f17a4106fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:42:07.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.236+0000 7f17a27fc700 1 --2- 172.21.15.26:0/508043622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17a40f55c0 0x7f17a4106fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:07.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.236+0000 7f17a27fc700 1 -- 172.21.15.26:0/508043622 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f179c005040 con 0x7f17a40f6860 2021-11-03T18:42:07.240 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.236+0000 7f17a27fc700 1 --2- 172.21.15.26:0/508043622 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17a40f6860 0x7f17a41074c0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 rx=0x7f178c00c530 tx=0x7f178c007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:42:07.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.236+0000 7f179b7fe700 1 -- 172.21.15.26:0/508043622 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f178c00f650 con 0x7f17a40f6860 2021-11-03T18:42:07.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.237+0000 7f179b7fe700 1 -- 172.21.15.26:0/508043622 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f178c00fc60 con 0x7f17a40f6860 2021-11-03T18:42:07.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.237+0000 7f17a9996700 1 -- 172.21.15.26:0/508043622 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a4108550 con 0x7f17a40f6860 2021-11-03T18:42:07.241 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.237+0000 7f179b7fe700 1 -- 172.21.15.26:0/508043622 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f178c012cd0 con 0x7f17a40f6860 2021-11-03T18:42:07.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.237+0000 7f17a9996700 1 -- 172.21.15.26:0/508043622 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17a4108b10 con 0x7f17a40f6860 2021-11-03T18:42:07.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.237+0000 7f17a9996700 1 -- 172.21.15.26:0/508043622 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17a4045ad0 con 0x7f17a40f6860 2021-11-03T18:42:07.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.238+0000 7f179b7fe700 1 -- 172.21.15.26:0/508043622 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f178c010070 con 0x7f17a40f6860 2021-11-03T18:42:07.242 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.238+0000 7f179b7fe700 1 --2- 172.21.15.26:0/508043622 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f17900640b0 0x7f1790066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:42:07.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.238+0000 7f179b7fe700 1 -- 172.21.15.26:0/508043622 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f178c080640 con 0x7f17a40f6860 2021-11-03T18:42:07.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.238+0000 7f17a2ffd700 1 --2- 172.21.15.26:0/508043622 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f17900640b0 0x7f1790066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:42:07.243 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.239+0000 7f17a2ffd700 1 --2- 172.21.15.26:0/508043622 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f17900640b0 0x7f1790066570 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7f179c004e30 tx=0x7f179c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:42:07.244 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.242+0000 7f179b7fe700 1 -- 172.21.15.26:0/508043622 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f178c0528b0 con 0x7f17a40f6860 2021-11-03T18:42:07.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.444+0000 7f17a9996700 1 -- 172.21.15.26:0/508043622 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f17a41091a0 con 0x7f17a40f6860 2021-11-03T18:42:07.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.444+0000 7f179b7fe700 1 -- 172.21.15.26:0/508043622 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f178c0524a0 con 0x7f17a40f6860 2021-11-03T18:42:07.444 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:42:07.444 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:42:07.444 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:42:07.445 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:42:07.445 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:42:07.445 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:42:07.446 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:42:07.446 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:42:07.446 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:42:07.447 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:42:07.447 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:42:07.447 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:42:07.448 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:42:07.448 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:42:07.448 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:42:07.448 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:42:07.449 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:42:07.449 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:42:07.449 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:42:07.450 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:42:07.450 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:42:07.450 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:42:07.451 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:42:07.451 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:42:07.452 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:42:07.452 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:42:07.452 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:42:07.453 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:42:07.453 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:42:07.453 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:42:07.454 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:42:07.454 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:42:07.454 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:42:07.454 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:42:07.455 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:42:07.455 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:42:07.455 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:42:07.456 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:42:07.456 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:42:07.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.446+0000 7f17a9996700 1 -- 172.21.15.26:0/508043622 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f17900640b0 msgr2=0x7f1790066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:42:07.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.446+0000 7f17a9996700 1 --2- 172.21.15.26:0/508043622 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f17900640b0 0x7f1790066570 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7f179c004e30 tx=0x7f179c009b30).stop 2021-11-03T18:42:07.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.446+0000 7f17a9996700 1 -- 172.21.15.26:0/508043622 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17a40f6860 msgr2=0x7f17a41074c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:42:07.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.446+0000 7f17a9996700 1 --2- 172.21.15.26:0/508043622 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17a40f6860 0x7f17a41074c0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 rx=0x7f178c00c530 tx=0x7f178c007e20).stop 2021-11-03T18:42:07.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.446+0000 7f17a9996700 1 -- 172.21.15.26:0/508043622 shutdown_connections 2021-11-03T18:42:07.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.446+0000 7f17a9996700 1 --2- 172.21.15.26:0/508043622 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f17900640b0 0x7f1790066570 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:07.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.446+0000 7f17a9996700 1 --2- 172.21.15.26:0/508043622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17a40f55c0 0x7f17a4106fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:07.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.446+0000 7f17a9996700 1 --2- 172.21.15.26:0/508043622 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17a40f6860 0x7f17a41074c0 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:07.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.446+0000 7f17a9996700 1 -- 172.21.15.26:0/508043622 >> 172.21.15.26:0/508043622 conn(0x7f17a40f0d20 msgr2=0x7f17a405f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:42:07.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.446+0000 7f17a9996700 1 -- 172.21.15.26:0/508043622 shutdown_connections 2021-11-03T18:42:07.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:07.446+0000 7f17a9996700 1 -- 172.21.15.26:0/508043622 wait complete. 2021-11-03T18:42:07.461 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:42:07.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:07 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:42:07.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:07 smithi194 ceph-mon[65619]: pgmap v3223: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:07.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:07 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2622585772' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:42:07.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:07 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:42:07.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:07 smithi026 ceph-mon[96795]: pgmap v3223: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:07.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:07 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2622585772' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:42:08.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:08 smithi194 ceph-mon[65619]: from='client.37452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:42:08.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:08 smithi194 ceph-mon[65619]: from='client.37456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:42:08.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:08 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/508043622' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:42:08.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:08 smithi026 ceph-mon[96795]: from='client.37452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:42:08.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:08 smithi026 ceph-mon[96795]: from='client.37456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:42:08.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:08 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/508043622' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:42:09.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:09 smithi194 ceph-mon[65619]: pgmap v3224: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:09.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:09 smithi026 ceph-mon[96795]: pgmap v3224: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:11.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:11 smithi026 ceph-mon[96795]: pgmap v3225: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:11.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:11 smithi194 ceph-mon[65619]: pgmap v3225: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:13.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:13 smithi194 ceph-mon[65619]: pgmap v3226: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:13.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:13 smithi026 ceph-mon[96795]: pgmap v3226: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:15.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:15 smithi194 ceph-mon[65619]: pgmap v3227: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:15.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:15 smithi026 ceph-mon[96795]: pgmap v3227: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:17.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:17 smithi194 ceph-mon[65619]: pgmap v3228: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:17.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:17 smithi026 ceph-mon[96795]: pgmap v3228: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:19.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:19 smithi194 ceph-mon[65619]: pgmap v3229: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:19.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:19 smithi026 ceph-mon[96795]: pgmap v3229: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:21.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:21 smithi026 ceph-mon[96795]: pgmap v3230: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:21.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:21 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:42:21.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:21 smithi194 ceph-mon[65619]: pgmap v3230: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:21.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:21 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:42:22.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:22 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:42:22.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:22 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:42:23.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:23 smithi026 ceph-mon[96795]: pgmap v3231: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:23.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:23 smithi194 ceph-mon[65619]: pgmap v3231: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:25.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:25 smithi194 ceph-mon[65619]: pgmap v3232: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:25.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:25 smithi026 ceph-mon[96795]: pgmap v3232: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:27.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:27 smithi194 ceph-mon[65619]: pgmap v3233: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:27.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:27 smithi026 ceph-mon[96795]: pgmap v3233: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:29.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:29 smithi194 ceph-mon[65619]: pgmap v3234: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:29.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:29 smithi026 ceph-mon[96795]: pgmap v3234: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:31.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:31 smithi026 ceph-mon[96795]: pgmap v3235: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:31.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:31 smithi194 ceph-mon[65619]: pgmap v3235: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:33.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:33 smithi194 ceph-mon[65619]: pgmap v3236: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:33.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:33 smithi026 ceph-mon[96795]: pgmap v3236: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:35.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:35 smithi194 ceph-mon[65619]: pgmap v3237: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:35.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:35 smithi026 ceph-mon[96795]: pgmap v3237: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:36.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:36 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:42:36.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:36 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:42:37.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:37 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:42:37.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:37 smithi194 ceph-mon[65619]: pgmap v3238: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:37.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.560+0000 7f65adb71700 1 -- 172.21.15.26:0/2424352695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65a80f7980 msgr2=0x7f65a80f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:42:37.560 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.560+0000 7f65adb71700 1 --2- 172.21.15.26:0/2424352695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65a80f7980 0x7f65a80f7de0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 rx=0x7f659c004660 tx=0x7f659c009b30).stop 2021-11-03T18:42:37.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.560+0000 7f65adb71700 1 -- 172.21.15.26:0/2424352695 shutdown_connections 2021-11-03T18:42:37.561 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.560+0000 7f65adb71700 1 --2- 172.21.15.26:0/2424352695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65a80f7980 0x7f65a80f7de0 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:37.562 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.560+0000 7f65adb71700 1 --2- 172.21.15.26:0/2424352695 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65a80f66e0 0x7f65a80f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:37.562 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.560+0000 7f65adb71700 1 -- 172.21.15.26:0/2424352695 >> 172.21.15.26:0/2424352695 conn(0x7f65a80f1e40 msgr2=0x7f65a80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:42:37.562 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.560+0000 7f65adb71700 1 -- 172.21.15.26:0/2424352695 shutdown_connections 2021-11-03T18:42:37.562 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.560+0000 7f65adb71700 1 -- 172.21.15.26:0/2424352695 wait complete. 2021-11-03T18:42:37.563 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.561+0000 7f65adb71700 1 Processor -- start 2021-11-03T18:42:37.563 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.561+0000 7f65adb71700 1 -- start start 2021-11-03T18:42:37.565 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.561+0000 7f65adb71700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65a80f66e0 0x7f65a806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:42:37.565 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.561+0000 7f65adb71700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65a80f7980 0x7f65a8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:42:37.565 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.561+0000 7f65adb71700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a806a380 con 0x7f65a80f66e0 2021-11-03T18:42:37.566 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.561+0000 7f65adb71700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a806a4c0 con 0x7f65a80f7980 2021-11-03T18:42:37.566 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.562+0000 7f65a77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65a80f66e0 0x7f65a806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:42:37.566 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.562+0000 7f65a77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65a80f66e0 0x7f65a806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33318/0 (socket says 172.21.15.26:33318) 2021-11-03T18:42:37.566 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.562+0000 7f65a77fe700 1 -- 172.21.15.26:0/4049708114 learned_addr learned my addr 172.21.15.26:0/4049708114 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:42:37.567 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.562+0000 7f65a6ffd700 1 --2- 172.21.15.26:0/4049708114 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65a80f7980 0x7f65a8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:42:37.567 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.562+0000 7f65a77fe700 1 -- 172.21.15.26:0/4049708114 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65a80f7980 msgr2=0x7f65a8069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:42:37.567 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.562+0000 7f65a77fe700 1 --2- 172.21.15.26:0/4049708114 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65a80f7980 0x7f65a8069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:37.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.562+0000 7f65a77fe700 1 -- 172.21.15.26:0/4049708114 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659c005040 con 0x7f65a80f66e0 2021-11-03T18:42:37.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.562+0000 7f65a77fe700 1 --2- 172.21.15.26:0/4049708114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65a80f66e0 0x7f65a806b9a0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 rx=0x7f659800c530 tx=0x7f6598007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:42:37.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.562+0000 7f658ffff700 1 -- 172.21.15.26:0/4049708114 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f659800f650 con 0x7f65a80f66e0 2021-11-03T18:42:37.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.562+0000 7f658ffff700 1 -- 172.21.15.26:0/4049708114 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f659800fc60 con 0x7f65a80f66e0 2021-11-03T18:42:37.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.562+0000 7f65adb71700 1 -- 172.21.15.26:0/4049708114 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65a806a7a0 con 0x7f65a80f66e0 2021-11-03T18:42:37.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.562+0000 7f658ffff700 1 -- 172.21.15.26:0/4049708114 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6598012cb0 con 0x7f65a80f66e0 2021-11-03T18:42:37.569 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.562+0000 7f65adb71700 1 -- 172.21.15.26:0/4049708114 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a810ef90 con 0x7f65a80f66e0 2021-11-03T18:42:37.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.563+0000 7f65adb71700 1 -- 172.21.15.26:0/4049708114 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65a8045ad0 con 0x7f65a80f66e0 2021-11-03T18:42:37.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.564+0000 7f658ffff700 1 -- 172.21.15.26:0/4049708114 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f6598019030 con 0x7f65a80f66e0 2021-11-03T18:42:37.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.564+0000 7f658ffff700 1 --2- 172.21.15.26:0/4049708114 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f65900640b0 0x7f6590066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:42:37.570 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.564+0000 7f658ffff700 1 -- 172.21.15.26:0/4049708114 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f6598080930 con 0x7f65a80f66e0 2021-11-03T18:42:37.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.564+0000 7f65a6ffd700 1 --2- 172.21.15.26:0/4049708114 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f65900640b0 0x7f6590066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:42:37.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.565+0000 7f65a6ffd700 1 --2- 172.21.15.26:0/4049708114 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f65900640b0 0x7f6590066570 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 rx=0x7f659c004630 tx=0x7f659c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:42:37.572 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.569+0000 7f658ffff700 1 -- 172.21.15.26:0/4049708114 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f6598052ac0 con 0x7f65a80f66e0 2021-11-03T18:42:37.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:37 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:42:37.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:37 smithi026 ceph-mon[96795]: pgmap v3238: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:37.746 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.747+0000 7f65adb71700 1 -- 172.21.15.26:0/4049708114 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f65a80fef80 con 0x7f65900640b0 2021-11-03T18:42:37.747 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.748+0000 7f658ffff700 1 -- 172.21.15.26:0/4049708114 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f65a80fef80 con 0x7f65900640b0 2021-11-03T18:42:37.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.750+0000 7f65adb71700 1 -- 172.21.15.26:0/4049708114 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f65900640b0 msgr2=0x7f6590066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:42:37.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.750+0000 7f65adb71700 1 --2- 172.21.15.26:0/4049708114 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f65900640b0 0x7f6590066570 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 rx=0x7f659c004630 tx=0x7f659c009b30).stop 2021-11-03T18:42:37.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.750+0000 7f65adb71700 1 -- 172.21.15.26:0/4049708114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65a80f66e0 msgr2=0x7f65a806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:42:37.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.750+0000 7f65adb71700 1 --2- 172.21.15.26:0/4049708114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65a80f66e0 0x7f65a806b9a0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 rx=0x7f659800c530 tx=0x7f6598007e10).stop 2021-11-03T18:42:37.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.750+0000 7f65adb71700 1 -- 172.21.15.26:0/4049708114 shutdown_connections 2021-11-03T18:42:37.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.750+0000 7f65adb71700 1 --2- 172.21.15.26:0/4049708114 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f65900640b0 0x7f6590066570 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:37.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.750+0000 7f65adb71700 1 --2- 172.21.15.26:0/4049708114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65a80f66e0 0x7f65a806b9a0 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:37.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.750+0000 7f65adb71700 1 --2- 172.21.15.26:0/4049708114 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65a80f7980 0x7f65a8069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:37.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.750+0000 7f65adb71700 1 -- 172.21.15.26:0/4049708114 >> 172.21.15.26:0/4049708114 conn(0x7f65a80f1e40 msgr2=0x7f65a80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:42:37.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.750+0000 7f65adb71700 1 -- 172.21.15.26:0/4049708114 shutdown_connections 2021-11-03T18:42:37.752 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.750+0000 7f65adb71700 1 -- 172.21.15.26:0/4049708114 wait complete. 2021-11-03T18:42:37.759 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:42:37.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.850+0000 7f103e2cc700 1 -- 172.21.15.26:0/3076301637 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10380f7980 msgr2=0x7f10380f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:42:37.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.850+0000 7f103e2cc700 1 --2- 172.21.15.26:0/3076301637 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10380f7980 0x7f10380f7de0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 rx=0x7f1028004660 tx=0x7f1028009b30).stop 2021-11-03T18:42:37.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.850+0000 7f103e2cc700 1 -- 172.21.15.26:0/3076301637 shutdown_connections 2021-11-03T18:42:37.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.850+0000 7f103e2cc700 1 --2- 172.21.15.26:0/3076301637 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10380f7980 0x7f10380f7de0 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:37.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.850+0000 7f103e2cc700 1 --2- 172.21.15.26:0/3076301637 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10380f66e0 0x7f10380f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:37.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.850+0000 7f103e2cc700 1 -- 172.21.15.26:0/3076301637 >> 172.21.15.26:0/3076301637 conn(0x7f10380f1e40 msgr2=0x7f10380f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:42:37.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.850+0000 7f103e2cc700 1 -- 172.21.15.26:0/3076301637 shutdown_connections 2021-11-03T18:42:37.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.850+0000 7f103e2cc700 1 -- 172.21.15.26:0/3076301637 wait complete. 2021-11-03T18:42:37.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.850+0000 7f103e2cc700 1 Processor -- start 2021-11-03T18:42:37.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.851+0000 7f103e2cc700 1 -- start start 2021-11-03T18:42:37.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.851+0000 7f103e2cc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10380f66e0 0x7f103806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:42:37.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.851+0000 7f103e2cc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10380f7980 0x7f1038069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:42:37.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.851+0000 7f103e2cc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103806a380 con 0x7f10380f66e0 2021-11-03T18:42:37.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.851+0000 7f103e2cc700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103806a4c0 con 0x7f10380f7980 2021-11-03T18:42:37.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.851+0000 7f1037fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10380f66e0 0x7f103806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:42:37.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.851+0000 7f1037fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10380f66e0 0x7f103806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33328/0 (socket says 172.21.15.26:33328) 2021-11-03T18:42:37.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.851+0000 7f1037fff700 1 -- 172.21.15.26:0/82549119 learned_addr learned my addr 172.21.15.26:0/82549119 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:42:37.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.851+0000 7f10377fe700 1 --2- 172.21.15.26:0/82549119 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10380f7980 0x7f1038069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:42:37.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.851+0000 7f1037fff700 1 -- 172.21.15.26:0/82549119 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10380f7980 msgr2=0x7f1038069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:42:37.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.851+0000 7f1037fff700 1 --2- 172.21.15.26:0/82549119 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10380f7980 0x7f1038069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:37.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.851+0000 7f1037fff700 1 -- 172.21.15.26:0/82549119 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1028005040 con 0x7f10380f66e0 2021-11-03T18:42:37.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.851+0000 7f10377fe700 1 --2- 172.21.15.26:0/82549119 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10380f7980 0x7f1038069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:42:37.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.851+0000 7f1037fff700 1 --2- 172.21.15.26:0/82549119 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10380f66e0 0x7f103806b9a0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 rx=0x7f102000c790 tx=0x7f1020007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:42:37.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.852+0000 7f1034ff9700 1 -- 172.21.15.26:0/82549119 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f102000e680 con 0x7f10380f66e0 2021-11-03T18:42:37.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.852+0000 7f103e2cc700 1 -- 172.21.15.26:0/82549119 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f103806a7a0 con 0x7f10380f66e0 2021-11-03T18:42:37.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.852+0000 7f1034ff9700 1 -- 172.21.15.26:0/82549119 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f102000ec90 con 0x7f10380f66e0 2021-11-03T18:42:37.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.852+0000 7f1034ff9700 1 -- 172.21.15.26:0/82549119 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1020012d00 con 0x7f10380f66e0 2021-11-03T18:42:37.857 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.852+0000 7f103e2cc700 1 -- 172.21.15.26:0/82549119 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f103810ef90 con 0x7f10380f66e0 2021-11-03T18:42:37.858 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.852+0000 7f103e2cc700 1 -- 172.21.15.26:0/82549119 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1038045ad0 con 0x7f10380f66e0 2021-11-03T18:42:37.859 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.853+0000 7f1034ff9700 1 -- 172.21.15.26:0/82549119 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f1020010070 con 0x7f10380f66e0 2021-11-03T18:42:37.859 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.854+0000 7f1034ff9700 1 --2- 172.21.15.26:0/82549119 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f10240640b0 0x7f1024066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:42:37.859 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.854+0000 7f1034ff9700 1 -- 172.21.15.26:0/82549119 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f10200809a0 con 0x7f10380f66e0 2021-11-03T18:42:37.860 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.854+0000 7f10377fe700 1 --2- 172.21.15.26:0/82549119 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f10240640b0 0x7f1024066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:42:37.860 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.854+0000 7f10377fe700 1 --2- 172.21.15.26:0/82549119 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f10240640b0 0x7f1024066570 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7f1028004e30 tx=0x7f1028009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:42:37.860 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:37.857+0000 7f1034ff9700 1 -- 172.21.15.26:0/82549119 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f1020052c10 con 0x7f10380f66e0 2021-11-03T18:42:38.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.031+0000 7f103e2cc700 1 -- 172.21.15.26:0/82549119 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f10380ff010 con 0x7f10240640b0 2021-11-03T18:42:38.045 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.046+0000 7f1034ff9700 1 -- 172.21.15.26:0/82549119 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7f10380ff010 con 0x7f10240640b0 2021-11-03T18:42:38.046 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:42:38.046 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (113m) 111s ago 115m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:42:38.046 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (106m) 111s ago 115m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:42:38.046 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (105m) 47s ago 114m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:42:38.046 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (113m) 111s ago 114m 42.4M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:42:38.047 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (106m) 111s ago 110m 26.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:42:38.047 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (107m) 111s ago 110m 27.0M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:42:38.047 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (110m) 47s ago 110m 27.2M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:42:38.047 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (110m) 47s ago 110m 27.6M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:42:38.048 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (107m) 111s ago 116m 615M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:42:38.048 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (107m) 47s ago 114m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:42:38.048 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (106m) 111s ago 116m 407M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:42:38.048 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (106m) 47s ago 114m 187M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:42:38.048 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (114m) 111s ago 114m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:42:38.049 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (114m) 47s ago 114m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:42:38.049 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (105m) 111s ago 113m 372M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:42:38.049 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (105m) 111s ago 113m 400M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:42:38.049 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (104m) 111s ago 112m 332M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:42:38.049 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (104m) 47s ago 112m 438M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:42:38.050 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (103m) 47s ago 112m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:42:38.050 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (103m) 47s ago 111m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:42:38.050 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (113m) 111s ago 114m 70.2M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:42:38.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.048+0000 7f103e2cc700 1 -- 172.21.15.26:0/82549119 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f10240640b0 msgr2=0x7f1024066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:42:38.051 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.048+0000 7f103e2cc700 1 --2- 172.21.15.26:0/82549119 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f10240640b0 0x7f1024066570 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7f1028004e30 tx=0x7f1028009b30).stop 2021-11-03T18:42:38.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.048+0000 7f103e2cc700 1 -- 172.21.15.26:0/82549119 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10380f66e0 msgr2=0x7f103806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:42:38.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.048+0000 7f103e2cc700 1 --2- 172.21.15.26:0/82549119 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10380f66e0 0x7f103806b9a0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 rx=0x7f102000c790 tx=0x7f1020007d90).stop 2021-11-03T18:42:38.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.048+0000 7f103e2cc700 1 -- 172.21.15.26:0/82549119 shutdown_connections 2021-11-03T18:42:38.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.048+0000 7f103e2cc700 1 --2- 172.21.15.26:0/82549119 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f10240640b0 0x7f1024066570 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:38.052 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.048+0000 7f103e2cc700 1 --2- 172.21.15.26:0/82549119 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10380f66e0 0x7f103806b9a0 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:38.053 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.048+0000 7f103e2cc700 1 --2- 172.21.15.26:0/82549119 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10380f7980 0x7f1038069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:38.053 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.048+0000 7f103e2cc700 1 -- 172.21.15.26:0/82549119 >> 172.21.15.26:0/82549119 conn(0x7f10380f1e40 msgr2=0x7f10380fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:42:38.053 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.048+0000 7f103e2cc700 1 -- 172.21.15.26:0/82549119 shutdown_connections 2021-11-03T18:42:38.053 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.048+0000 7f103e2cc700 1 -- 172.21.15.26:0/82549119 wait complete. 2021-11-03T18:42:38.149 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.148+0000 7f2a376fd700 1 -- 172.21.15.26:0/1272991086 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a300f7dc0 msgr2=0x7f2a300f81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:42:38.149 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.148+0000 7f2a376fd700 1 --2- 172.21.15.26:0/1272991086 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a300f7dc0 0x7f2a300f81e0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 rx=0x7f2a2c004660 tx=0x7f2a2c009b30).stop 2021-11-03T18:42:38.149 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.148+0000 7f2a376fd700 1 -- 172.21.15.26:0/1272991086 shutdown_connections 2021-11-03T18:42:38.150 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.148+0000 7f2a376fd700 1 --2- 172.21.15.26:0/1272991086 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a300f86d0 0x7f2a300f48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:42:38.150 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.148+0000 7f2a376fd700 1 --2- 172.21.15.26:0/1272991086 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a300f7dc0 0x7f2a300f81e0 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:38.150 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.148+0000 7f2a376fd700 1 -- 172.21.15.26:0/1272991086 >> 172.21.15.26:0/1272991086 conn(0x7f2a300f0540 msgr2=0x7f2a300f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:42:38.150 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.148+0000 7f2a376fd700 1 -- 172.21.15.26:0/1272991086 shutdown_connections 2021-11-03T18:42:38.150 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.148+0000 7f2a376fd700 1 -- 172.21.15.26:0/1272991086 wait complete. 2021-11-03T18:42:38.151 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.148+0000 7f2a376fd700 1 Processor -- start 2021-11-03T18:42:38.151 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.148+0000 7f2a376fd700 1 -- start start 2021-11-03T18:42:38.151 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.149+0000 7f2a376fd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a300f7dc0 0x7f2a300f7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:42:38.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.149+0000 7f2a376fd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a300f86d0 0x7f2a300f5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:42:38.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.149+0000 7f2a376fd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a300f6100 con 0x7f2a300f86d0 2021-11-03T18:42:38.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.149+0000 7f2a376fd700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a300f6240 con 0x7f2a300f7dc0 2021-11-03T18:42:38.152 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.149+0000 7f2a34c98700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a300f86d0 0x7f2a300f5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:42:38.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.149+0000 7f2a34c98700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a300f86d0 0x7f2a300f5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33342/0 (socket says 172.21.15.26:33342) 2021-11-03T18:42:38.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.149+0000 7f2a34c98700 1 -- 172.21.15.26:0/2022787231 learned_addr learned my addr 172.21.15.26:0/2022787231 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:42:38.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.149+0000 7f2a35499700 1 --2- 172.21.15.26:0/2022787231 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a300f7dc0 0x7f2a300f7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:42:38.153 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.149+0000 7f2a34c98700 1 -- 172.21.15.26:0/2022787231 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a300f7dc0 msgr2=0x7f2a300f7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:42:38.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.149+0000 7f2a34c98700 1 --2- 172.21.15.26:0/2022787231 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a300f7dc0 0x7f2a300f7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:38.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.149+0000 7f2a34c98700 1 -- 172.21.15.26:0/2022787231 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2c005040 con 0x7f2a300f86d0 2021-11-03T18:42:38.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.149+0000 7f2a34c98700 1 --2- 172.21.15.26:0/2022787231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a300f86d0 0x7f2a300f5b10 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 rx=0x7f2a2400b410 tx=0x7f2a24006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:42:38.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.149+0000 7f2a21ffb700 1 -- 172.21.15.26:0/2022787231 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a240125f0 con 0x7f2a300f86d0 2021-11-03T18:42:38.154 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.149+0000 7f2a21ffb700 1 -- 172.21.15.26:0/2022787231 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2a2400be30 con 0x7f2a300f86d0 2021-11-03T18:42:38.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.149+0000 7f2a376fd700 1 -- 172.21.15.26:0/2022787231 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a300f6520 con 0x7f2a300f86d0 2021-11-03T18:42:38.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.149+0000 7f2a21ffb700 1 -- 172.21.15.26:0/2022787231 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a24002a70 con 0x7f2a300f86d0 2021-11-03T18:42:38.155 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.150+0000 7f2a376fd700 1 -- 172.21.15.26:0/2022787231 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a3010efa0 con 0x7f2a300f86d0 2021-11-03T18:42:38.156 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.150+0000 7f2a376fd700 1 -- 172.21.15.26:0/2022787231 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a30045ad0 con 0x7f2a300f86d0 2021-11-03T18:42:38.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.151+0000 7f2a21ffb700 1 -- 172.21.15.26:0/2022787231 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f2a2400f030 con 0x7f2a300f86d0 2021-11-03T18:42:38.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.151+0000 7f2a21ffb700 1 --2- 172.21.15.26:0/2022787231 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2a1c0640b0 0x7f2a1c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:42:38.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.151+0000 7f2a21ffb700 1 -- 172.21.15.26:0/2022787231 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f2a24080b10 con 0x7f2a300f86d0 2021-11-03T18:42:38.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.151+0000 7f2a35499700 1 --2- 172.21.15.26:0/2022787231 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2a1c0640b0 0x7f2a1c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:42:38.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.152+0000 7f2a35499700 1 --2- 172.21.15.26:0/2022787231 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2a1c0640b0 0x7f2a1c066570 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 rx=0x7f2a2c004630 tx=0x7f2a2c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:42:38.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.155+0000 7f2a21ffb700 1 -- 172.21.15.26:0/2022787231 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f2a24052e70 con 0x7f2a300f86d0 2021-11-03T18:42:38.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.392+0000 7f2a376fd700 1 -- 172.21.15.26:0/2022787231 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2a30027a00 con 0x7f2a300f86d0 2021-11-03T18:42:38.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.392+0000 7f2a21ffb700 1 -- 172.21.15.26:0/2022787231 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f2a24052a60 con 0x7f2a300f86d0 2021-11-03T18:42:38.392 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:42:38.393 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:42:38.393 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:42:38.393 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:42:38.393 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:42:38.394 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:42:38.394 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:42:38.394 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:42:38.394 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:42:38.395 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:42:38.395 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:42:38.395 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:42:38.395 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:42:38.395 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:42:38.396 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:42:38.396 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:42:38.396 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:42:38.396 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:42:38.397 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.394+0000 7f2a376fd700 1 -- 172.21.15.26:0/2022787231 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2a1c0640b0 msgr2=0x7f2a1c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:42:38.398 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.394+0000 7f2a376fd700 1 --2- 172.21.15.26:0/2022787231 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2a1c0640b0 0x7f2a1c066570 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 rx=0x7f2a2c004630 tx=0x7f2a2c009b30).stop 2021-11-03T18:42:38.398 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.394+0000 7f2a376fd700 1 -- 172.21.15.26:0/2022787231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a300f86d0 msgr2=0x7f2a300f5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:42:38.398 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.394+0000 7f2a376fd700 1 --2- 172.21.15.26:0/2022787231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a300f86d0 0x7f2a300f5b10 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 rx=0x7f2a2400b410 tx=0x7f2a24006ef0).stop 2021-11-03T18:42:38.398 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.394+0000 7f2a376fd700 1 -- 172.21.15.26:0/2022787231 shutdown_connections 2021-11-03T18:42:38.399 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.394+0000 7f2a376fd700 1 --2- 172.21.15.26:0/2022787231 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2a1c0640b0 0x7f2a1c066570 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:38.399 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.394+0000 7f2a376fd700 1 --2- 172.21.15.26:0/2022787231 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a300f7dc0 0x7f2a300f7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:38.399 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.394+0000 7f2a376fd700 1 --2- 172.21.15.26:0/2022787231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a300f86d0 0x7f2a300f5b10 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:38.399 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.394+0000 7f2a376fd700 1 -- 172.21.15.26:0/2022787231 >> 172.21.15.26:0/2022787231 conn(0x7f2a300f0540 msgr2=0x7f2a300fb650 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:42:38.400 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.394+0000 7f2a376fd700 1 -- 172.21.15.26:0/2022787231 shutdown_connections 2021-11-03T18:42:38.400 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.394+0000 7f2a376fd700 1 -- 172.21.15.26:0/2022787231 wait complete. 2021-11-03T18:42:38.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.495+0000 7f2c17bb1700 1 -- 172.21.15.26:0/1643732072 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c100f74a0 msgr2=0x7f2c100f5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:42:38.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.495+0000 7f2c17bb1700 1 --2- 172.21.15.26:0/1643732072 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c100f74a0 0x7f2c100f5930 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 rx=0x7f2c04004660 tx=0x7f2c04009b30).stop 2021-11-03T18:42:38.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.495+0000 7f2c17bb1700 1 -- 172.21.15.26:0/1643732072 shutdown_connections 2021-11-03T18:42:38.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.495+0000 7f2c17bb1700 1 --2- 172.21.15.26:0/1643732072 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c100f74a0 0x7f2c100f5930 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:38.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.495+0000 7f2c17bb1700 1 --2- 172.21.15.26:0/1643732072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c100f6b90 0x7f2c100f6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:42:38.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.495+0000 7f2c17bb1700 1 -- 172.21.15.26:0/1643732072 >> 172.21.15.26:0/1643732072 conn(0x7f2c100f0540 msgr2=0x7f2c100f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:42:38.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.495+0000 7f2c17bb1700 1 -- 172.21.15.26:0/1643732072 shutdown_connections 2021-11-03T18:42:38.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.495+0000 7f2c17bb1700 1 -- 172.21.15.26:0/1643732072 wait complete. 2021-11-03T18:42:38.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.495+0000 7f2c17bb1700 1 Processor -- start 2021-11-03T18:42:38.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.495+0000 7f2c17bb1700 1 -- start start 2021-11-03T18:42:38.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.495+0000 7f2c17bb1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c100f6b90 0x7f2c10105ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:42:38.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.496+0000 7f2c17bb1700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c100f74a0 0x7f2c101063c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:42:38.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.496+0000 7f2c17bb1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c10106a50 con 0x7f2c100f6b90 2021-11-03T18:42:38.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.496+0000 7f2c17bb1700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c101071d0 con 0x7f2c100f74a0 2021-11-03T18:42:38.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.496+0000 7f2c1594d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c100f6b90 0x7f2c10105ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:42:38.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.496+0000 7f2c1594d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c100f6b90 0x7f2c10105ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33350/0 (socket says 172.21.15.26:33350) 2021-11-03T18:42:38.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.496+0000 7f2c1594d700 1 -- 172.21.15.26:0/3289493393 learned_addr learned my addr 172.21.15.26:0/3289493393 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:42:38.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.496+0000 7f2c1514c700 1 --2- 172.21.15.26:0/3289493393 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c100f74a0 0x7f2c101063c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:42:38.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.496+0000 7f2c1594d700 1 -- 172.21.15.26:0/3289493393 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c100f74a0 msgr2=0x7f2c101063c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:42:38.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.496+0000 7f2c1594d700 1 --2- 172.21.15.26:0/3289493393 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c100f74a0 0x7f2c101063c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:38.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.496+0000 7f2c1594d700 1 -- 172.21.15.26:0/3289493393 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c04005040 con 0x7f2c100f6b90 2021-11-03T18:42:38.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.496+0000 7f2c1594d700 1 --2- 172.21.15.26:0/3289493393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c100f6b90 0x7f2c10105ed0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 rx=0x7f2c0800dd20 tx=0x7f2c0800b550).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:42:38.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.496+0000 7f2c0e7fc700 1 -- 172.21.15.26:0/3289493393 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c0800ede0 con 0x7f2c100f6b90 2021-11-03T18:42:38.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.496+0000 7f2c0e7fc700 1 -- 172.21.15.26:0/3289493393 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2c080178d0 con 0x7f2c100f6b90 2021-11-03T18:42:38.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.496+0000 7f2c0e7fc700 1 -- 172.21.15.26:0/3289493393 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c08016900 con 0x7f2c100f6b90 2021-11-03T18:42:38.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.496+0000 7f2c17bb1700 1 -- 172.21.15.26:0/3289493393 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c10107450 con 0x7f2c100f6b90 2021-11-03T18:42:38.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.496+0000 7f2c17bb1700 1 -- 172.21.15.26:0/3289493393 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c10107a10 con 0x7f2c100f6b90 2021-11-03T18:42:38.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.497+0000 7f2c17bb1700 1 -- 172.21.15.26:0/3289493393 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c10045ad0 con 0x7f2c100f6b90 2021-11-03T18:42:38.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.498+0000 7f2c0e7fc700 1 -- 172.21.15.26:0/3289493393 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f2c08017a40 con 0x7f2c100f6b90 2021-11-03T18:42:38.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.498+0000 7f2c0e7fc700 1 --2- 172.21.15.26:0/3289493393 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2bf80640b0 0x7f2bf8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:42:38.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.499+0000 7f2c0e7fc700 1 -- 172.21.15.26:0/3289493393 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f2c08083cd0 con 0x7f2c100f6b90 2021-11-03T18:42:38.517 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.499+0000 7f2c1514c700 1 --2- 172.21.15.26:0/3289493393 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2bf80640b0 0x7f2bf8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:42:38.517 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.499+0000 7f2c1514c700 1 --2- 172.21.15.26:0/3289493393 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2bf80640b0 0x7f2bf8066570 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7f2c04004e30 tx=0x7f2c04009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:42:38.518 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.502+0000 7f2c0e7fc700 1 -- 172.21.15.26:0/3289493393 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f2c08055f00 con 0x7f2c100f6b90 2021-11-03T18:42:38.708 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.708+0000 7f2c17bb1700 1 -- 172.21.15.26:0/3289493393 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2c100ff920 con 0x7f2c100f6b90 2021-11-03T18:42:38.708 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.709+0000 7f2c0e7fc700 1 -- 172.21.15.26:0/3289493393 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f2c08017cd0 con 0x7f2c100f6b90 2021-11-03T18:42:38.709 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:42:38.709 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:42:38.709 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:42:38.709 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:42:38.710 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:42:38.710 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:42:38.710 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:42:38.710 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:42:38.711 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:42:38.711 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:42:38.711 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:42:38.711 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:42:38.712 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:42:38.712 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:42:38.712 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:42:38.712 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:42:38.712 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:42:38.713 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:42:38.713 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:42:38.713 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:42:38.713 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:42:38.713 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:42:38.714 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:42:38.714 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:42:38.714 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:42:38.714 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:42:38.715 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:42:38.715 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:42:38.715 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:42:38.715 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:42:38.716 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:42:38.716 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:42:38.716 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:42:38.716 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:42:38.716 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:42:38.717 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:42:38.717 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:42:38.717 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:42:38.717 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:42:38.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.711+0000 7f2c17bb1700 1 -- 172.21.15.26:0/3289493393 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2bf80640b0 msgr2=0x7f2bf8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:42:38.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.711+0000 7f2c17bb1700 1 --2- 172.21.15.26:0/3289493393 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2bf80640b0 0x7f2bf8066570 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7f2c04004e30 tx=0x7f2c04009b30).stop 2021-11-03T18:42:38.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.711+0000 7f2c17bb1700 1 -- 172.21.15.26:0/3289493393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c100f6b90 msgr2=0x7f2c10105ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:42:38.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.711+0000 7f2c17bb1700 1 --2- 172.21.15.26:0/3289493393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c100f6b90 0x7f2c10105ed0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 rx=0x7f2c0800dd20 tx=0x7f2c0800b550).stop 2021-11-03T18:42:38.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.711+0000 7f2c17bb1700 1 -- 172.21.15.26:0/3289493393 shutdown_connections 2021-11-03T18:42:38.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.711+0000 7f2c17bb1700 1 --2- 172.21.15.26:0/3289493393 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2bf80640b0 0x7f2bf8066570 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:38.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.711+0000 7f2c17bb1700 1 --2- 172.21.15.26:0/3289493393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c100f6b90 0x7f2c10105ed0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:38.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.711+0000 7f2c17bb1700 1 --2- 172.21.15.26:0/3289493393 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c100f74a0 0x7f2c101063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:42:38.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.711+0000 7f2c17bb1700 1 -- 172.21.15.26:0/3289493393 >> 172.21.15.26:0/3289493393 conn(0x7f2c100f0540 msgr2=0x7f2c100fa390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:42:38.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.711+0000 7f2c17bb1700 1 -- 172.21.15.26:0/3289493393 shutdown_connections 2021-11-03T18:42:38.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:42:38.711+0000 7f2c17bb1700 1 -- 172.21.15.26:0/3289493393 wait complete. 2021-11-03T18:42:38.721 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:42:39.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:39 smithi194 ceph-mon[65619]: from='client.37468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:42:39.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:39 smithi194 ceph-mon[65619]: from='client.37472 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:42:39.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:39 smithi194 ceph-mon[65619]: pgmap v3239: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:39.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:39 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2022787231' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:42:39.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:39 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3289493393' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:42:39.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:39 smithi026 ceph-mon[96795]: from='client.37468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:42:39.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:39 smithi026 ceph-mon[96795]: from='client.37472 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:42:39.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:39 smithi026 ceph-mon[96795]: pgmap v3239: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:39.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:39 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2022787231' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:42:39.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:39 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3289493393' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:42:41.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:41 smithi026 ceph-mon[96795]: pgmap v3240: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:41.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:41 smithi194 ceph-mon[65619]: pgmap v3240: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:43.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:43 smithi194 ceph-mon[65619]: pgmap v3241: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:43.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:43 smithi026 ceph-mon[96795]: pgmap v3241: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:45.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:45 smithi194 ceph-mon[65619]: pgmap v3242: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:45.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:45 smithi026 ceph-mon[96795]: pgmap v3242: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:47.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:47 smithi194 ceph-mon[65619]: pgmap v3243: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:47.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:47 smithi026 ceph-mon[96795]: pgmap v3243: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:49.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:49 smithi194 ceph-mon[65619]: pgmap v3244: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:42:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:42:49.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:49 smithi026 ceph-mon[96795]: pgmap v3244: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:49.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:42:49.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:42:51.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:51 smithi194 ceph-mon[65619]: pgmap v3245: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:51.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:51 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:42:51.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:51 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:42:51.255 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:51 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:42:51.255 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:51 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:42:51.255 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:51 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:42:51.256 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:51 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:42:51.256 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:51 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:42:51.256 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:51 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:42:51.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:51 smithi026 ceph-mon[96795]: pgmap v3245: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:51.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:51 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:42:51.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:51 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:42:51.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:51 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:42:51.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:51 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:42:51.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:51 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:42:51.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:51 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:42:51.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:51 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:42:51.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:51 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:42:52.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:52 smithi026 ceph-mon[96795]: poll took 60081.051 ms: 1 events 2021-11-03T18:42:52.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:52 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:42:52.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:52 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:42:52.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:52 smithi194 ceph-mon[65619]: poll took 60081.051 ms: 1 events 2021-11-03T18:42:52.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:52 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:42:52.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:52 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:42:53.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:53 smithi026 ceph-mon[96795]: pgmap v3246: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:53.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:53 smithi194 ceph-mon[65619]: pgmap v3246: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:55.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:55 smithi194 ceph-mon[65619]: pgmap v3247: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:55.579 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:55 smithi026 ceph-mon[96795]: pgmap v3247: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:57.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:57 smithi194 ceph-mon[65619]: pgmap v3248: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:57.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:57 smithi026 ceph-mon[96795]: pgmap v3248: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:59.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:42:59 smithi194 ceph-mon[65619]: pgmap v3249: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:42:59.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:42:59 smithi026 ceph-mon[96795]: pgmap v3249: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:01.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:01 smithi026 ceph-mon[96795]: pgmap v3250: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:01.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:01 smithi194 ceph-mon[65619]: pgmap v3250: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:03.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:03 smithi194 ceph-mon[65619]: pgmap v3251: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:03.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:03 smithi026 ceph-mon[96795]: pgmap v3251: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:05.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:05 smithi194 ceph-mon[65619]: pgmap v3252: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:05.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:05 smithi026 ceph-mon[96795]: pgmap v3252: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:06.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:06 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:43:06.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:06 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:43:07.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:07 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:43:07.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:07 smithi194 ceph-mon[65619]: pgmap v3253: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:07.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:07 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:43:07.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:07 smithi026 ceph-mon[96795]: pgmap v3253: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:08.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:08.826+0000 7f9db4435700 1 -- 172.21.15.26:0/1194573105 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dac0f55e0 msgr2=0x7f9dac0f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:43:08.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:08.826+0000 7f9db4435700 1 --2- 172.21.15.26:0/1194573105 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dac0f55e0 0x7f9dac0f5a00 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 rx=0x7f9d9c004660 tx=0x7f9d9c009b30).stop 2021-11-03T18:43:08.825 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:08.826+0000 7f9db4435700 1 -- 172.21.15.26:0/1194573105 shutdown_connections 2021-11-03T18:43:08.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:08.826+0000 7f9db4435700 1 --2- 172.21.15.26:0/1194573105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9dac0f5ef0 0x7f9dac0f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:08.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:08.826+0000 7f9db4435700 1 --2- 172.21.15.26:0/1194573105 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dac0f55e0 0x7f9dac0f5a00 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:08.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:08.826+0000 7f9db4435700 1 -- 172.21.15.26:0/1194573105 >> 172.21.15.26:0/1194573105 conn(0x7f9dac0f0de0 msgr2=0x7f9dac0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:43:08.826 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:08.826+0000 7f9db4435700 1 -- 172.21.15.26:0/1194573105 shutdown_connections 2021-11-03T18:43:08.827 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:08.826+0000 7f9db4435700 1 -- 172.21.15.26:0/1194573105 wait complete. 2021-11-03T18:43:08.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:08.827+0000 7f9db4435700 1 Processor -- start 2021-11-03T18:43:08.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:08.827+0000 7f9db4435700 1 -- start start 2021-11-03T18:43:08.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:08.827+0000 7f9db4435700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dac0f55e0 0x7f9dac109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:43:08.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:08.827+0000 7f9db4435700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9dac0f5ef0 0x7f9dac10c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:43:08.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:08.827+0000 7f9db4435700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac060500 con 0x7f9dac0f55e0 2021-11-03T18:43:08.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:08.827+0000 7f9db4435700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac060640 con 0x7f9dac0f5ef0 2021-11-03T18:43:08.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:08.827+0000 7f9db21d1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dac0f55e0 0x7f9dac109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:43:08.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:08.828+0000 7f9db21d1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dac0f55e0 0x7f9dac109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33368/0 (socket says 172.21.15.26:33368) 2021-11-03T18:43:08.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:08.828+0000 7f9db21d1700 1 -- 172.21.15.26:0/2385896533 learned_addr learned my addr 172.21.15.26:0/2385896533 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:43:08.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:08.828+0000 7f9db19d0700 1 --2- 172.21.15.26:0/2385896533 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9dac0f5ef0 0x7f9dac10c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:43:08.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:08.828+0000 7f9db21d1700 1 -- 172.21.15.26:0/2385896533 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9dac0f5ef0 msgr2=0x7f9dac10c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:43:08.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:08.828+0000 7f9db21d1700 1 --2- 172.21.15.26:0/2385896533 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9dac0f5ef0 0x7f9dac10c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:08.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:08.828+0000 7f9db21d1700 1 -- 172.21.15.26:0/2385896533 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d9c005040 con 0x7f9dac0f55e0 2021-11-03T18:43:08.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:08.828+0000 7f9db21d1700 1 --2- 172.21.15.26:0/2385896533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dac0f55e0 0x7f9dac109c90 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 rx=0x7f9d9c009990 tx=0x7f9d9c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:43:08.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:08.828+0000 7f9da2ffd700 1 -- 172.21.15.26:0/2385896533 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d9c018070 con 0x7f9dac0f55e0 2021-11-03T18:43:08.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:08.828+0000 7f9db4435700 1 -- 172.21.15.26:0/2385896533 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dac10c6e0 con 0x7f9dac0f55e0 2021-11-03T18:43:08.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:08.828+0000 7f9db4435700 1 -- 172.21.15.26:0/2385896533 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dac10cc40 con 0x7f9dac0f55e0 2021-11-03T18:43:08.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:08.828+0000 7f9da2ffd700 1 -- 172.21.15.26:0/2385896533 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9d9c007ba0 con 0x7f9dac0f55e0 2021-11-03T18:43:08.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:08.828+0000 7f9da2ffd700 1 -- 172.21.15.26:0/2385896533 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d9c01c3c0 con 0x7f9dac0f55e0 2021-11-03T18:43:08.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:08.829+0000 7f9db4435700 1 -- 172.21.15.26:0/2385896533 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d94004fa0 con 0x7f9dac0f55e0 2021-11-03T18:43:08.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:08.830+0000 7f9da2ffd700 1 -- 172.21.15.26:0/2385896533 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f9d9c01d420 con 0x7f9dac0f55e0 2021-11-03T18:43:08.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:08.830+0000 7f9da2ffd700 1 --2- 172.21.15.26:0/2385896533 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9d980640b0 0x7f9d98066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:43:08.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:08.830+0000 7f9da2ffd700 1 -- 172.21.15.26:0/2385896533 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f9d9c0822d0 con 0x7f9dac0f55e0 2021-11-03T18:43:08.834 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:08.830+0000 7f9db19d0700 1 --2- 172.21.15.26:0/2385896533 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9d980640b0 0x7f9d98066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:43:08.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:08.831+0000 7f9db19d0700 1 --2- 172.21.15.26:0/2385896533 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9d980640b0 0x7f9d98066570 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 rx=0x7f9da8004c40 tx=0x7f9da800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:43:08.835 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:08.834+0000 7f9da2ffd700 1 -- 172.21.15.26:0/2385896533 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f9d9c054690 con 0x7f9dac0f55e0 2021-11-03T18:43:09.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.014+0000 7f9db4435700 1 -- 172.21.15.26:0/2385896533 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9d94000bc0 con 0x7f9d980640b0 2021-11-03T18:43:09.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.015+0000 7f9da2ffd700 1 -- 172.21.15.26:0/2385896533 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f9d94000bc0 con 0x7f9d980640b0 2021-11-03T18:43:09.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.017+0000 7f9db4435700 1 -- 172.21.15.26:0/2385896533 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9d980640b0 msgr2=0x7f9d98066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:43:09.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.017+0000 7f9db4435700 1 --2- 172.21.15.26:0/2385896533 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9d980640b0 0x7f9d98066570 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 rx=0x7f9da8004c40 tx=0x7f9da800b040).stop 2021-11-03T18:43:09.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.017+0000 7f9db4435700 1 -- 172.21.15.26:0/2385896533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dac0f55e0 msgr2=0x7f9dac109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:43:09.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.017+0000 7f9db4435700 1 --2- 172.21.15.26:0/2385896533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dac0f55e0 0x7f9dac109c90 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 rx=0x7f9d9c009990 tx=0x7f9d9c009b30).stop 2021-11-03T18:43:09.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.017+0000 7f9db4435700 1 -- 172.21.15.26:0/2385896533 shutdown_connections 2021-11-03T18:43:09.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.017+0000 7f9db4435700 1 --2- 172.21.15.26:0/2385896533 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9d980640b0 0x7f9d98066570 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:09.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.017+0000 7f9db4435700 1 --2- 172.21.15.26:0/2385896533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dac0f55e0 0x7f9dac109c90 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:09.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.017+0000 7f9db4435700 1 --2- 172.21.15.26:0/2385896533 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9dac0f5ef0 0x7f9dac10c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:09.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.017+0000 7f9db4435700 1 -- 172.21.15.26:0/2385896533 >> 172.21.15.26:0/2385896533 conn(0x7f9dac0f0de0 msgr2=0x7f9dac0fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:43:09.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.017+0000 7f9db4435700 1 -- 172.21.15.26:0/2385896533 shutdown_connections 2021-11-03T18:43:09.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.017+0000 7f9db4435700 1 -- 172.21.15.26:0/2385896533 wait complete. 2021-11-03T18:43:09.025 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:43:09.118 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.117+0000 7f7c07fff700 1 -- 172.21.15.26:0/1957908754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c080f6530 msgr2=0x7f7c080f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:43:09.119 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.117+0000 7f7c07fff700 1 --2- 172.21.15.26:0/1957908754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c080f6530 0x7f7c080f6950 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 rx=0x7f7bf8004660 tx=0x7f7bf8009b30).stop 2021-11-03T18:43:09.119 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.117+0000 7f7c07fff700 1 -- 172.21.15.26:0/1957908754 shutdown_connections 2021-11-03T18:43:09.119 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.117+0000 7f7c07fff700 1 --2- 172.21.15.26:0/1957908754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c080f77d0 0x7f7c080f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:09.119 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.117+0000 7f7c07fff700 1 --2- 172.21.15.26:0/1957908754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c080f6530 0x7f7c080f6950 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:09.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.117+0000 7f7c07fff700 1 -- 172.21.15.26:0/1957908754 >> 172.21.15.26:0/1957908754 conn(0x7f7c080f1cd0 msgr2=0x7f7c080f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:43:09.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.117+0000 7f7c07fff700 1 -- 172.21.15.26:0/1957908754 shutdown_connections 2021-11-03T18:43:09.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.117+0000 7f7c07fff700 1 -- 172.21.15.26:0/1957908754 wait complete. 2021-11-03T18:43:09.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.118+0000 7f7c07fff700 1 Processor -- start 2021-11-03T18:43:09.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.118+0000 7f7c07fff700 1 -- start start 2021-11-03T18:43:09.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.118+0000 7f7c07fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c080f6530 0x7f7c0806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:43:09.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.118+0000 7f7c07fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c080f77d0 0x7f7c08069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:43:09.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.118+0000 7f7c07fff700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0806a380 con 0x7f7c080f6530 2021-11-03T18:43:09.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.118+0000 7f7c07fff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0806a4c0 con 0x7f7c080f77d0 2021-11-03T18:43:09.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.118+0000 7f7c06ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c080f6530 0x7f7c0806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:43:09.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.119+0000 7f7c06ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c080f6530 0x7f7c0806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33378/0 (socket says 172.21.15.26:33378) 2021-11-03T18:43:09.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.119+0000 7f7c06ffd700 1 -- 172.21.15.26:0/727122573 learned_addr learned my addr 172.21.15.26:0/727122573 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:43:09.122 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.119+0000 7f7c067fc700 1 --2- 172.21.15.26:0/727122573 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c080f77d0 0x7f7c08069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:43:09.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.119+0000 7f7c06ffd700 1 -- 172.21.15.26:0/727122573 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c080f77d0 msgr2=0x7f7c08069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:43:09.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.119+0000 7f7c06ffd700 1 --2- 172.21.15.26:0/727122573 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c080f77d0 0x7f7c08069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:09.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.119+0000 7f7c06ffd700 1 -- 172.21.15.26:0/727122573 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf8005040 con 0x7f7c080f6530 2021-11-03T18:43:09.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.119+0000 7f7c06ffd700 1 --2- 172.21.15.26:0/727122573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c080f6530 0x7f7c0806b9a0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 rx=0x7f7bf8013a70 tx=0x7f7bf8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:43:09.123 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.119+0000 7f7bef7fe700 1 -- 172.21.15.26:0/727122573 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bf8018070 con 0x7f7c080f6530 2021-11-03T18:43:09.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.119+0000 7f7bef7fe700 1 -- 172.21.15.26:0/727122573 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7bf80097d0 con 0x7f7c080f6530 2021-11-03T18:43:09.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.119+0000 7f7bef7fe700 1 -- 172.21.15.26:0/727122573 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bf801c3c0 con 0x7f7c080f6530 2021-11-03T18:43:09.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.119+0000 7f7c07fff700 1 -- 172.21.15.26:0/727122573 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c0806a740 con 0x7f7c080f6530 2021-11-03T18:43:09.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.119+0000 7f7c07fff700 1 -- 172.21.15.26:0/727122573 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c0806aca0 con 0x7f7c080f6530 2021-11-03T18:43:09.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.120+0000 7f7c07fff700 1 -- 172.21.15.26:0/727122573 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c08045ad0 con 0x7f7c080f6530 2021-11-03T18:43:09.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.120+0000 7f7bef7fe700 1 -- 172.21.15.26:0/727122573 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f7bf8007ba0 con 0x7f7c080f6530 2021-11-03T18:43:09.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.121+0000 7f7bef7fe700 1 --2- 172.21.15.26:0/727122573 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7bf0064100 0x7f7bf00665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:43:09.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.121+0000 7f7bef7fe700 1 -- 172.21.15.26:0/727122573 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f7bf8082470 con 0x7f7c080f6530 2021-11-03T18:43:09.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.121+0000 7f7c067fc700 1 --2- 172.21.15.26:0/727122573 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7bf0064100 0x7f7bf00665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:43:09.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.121+0000 7f7c067fc700 1 --2- 172.21.15.26:0/727122573 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7bf0064100 0x7f7bf00665c0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7f7bfc004b00 tx=0x7f7bfc00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:43:09.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.125+0000 7f7bef7fe700 1 -- 172.21.15.26:0/727122573 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f7bf80547d0 con 0x7f7c080f6530 2021-11-03T18:43:09.298 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.299+0000 7f7c07fff700 1 -- 172.21.15.26:0/727122573 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c080fee50 con 0x7f7bf0064100 2021-11-03T18:43:09.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.314+0000 7f7bef7fe700 1 -- 172.21.15.26:0/727122573 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7f7c080fee50 con 0x7f7bf0064100 2021-11-03T18:43:09.312 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:43:09.313 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (114m) 2m ago 115m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:43:09.313 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (106m) 2m ago 115m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:43:09.313 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (106m) 79s ago 114m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:43:09.313 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (114m) 2m ago 115m 42.4M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:43:09.314 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (107m) 2m ago 110m 26.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:43:09.314 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (107m) 2m ago 110m 27.0M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:43:09.314 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (110m) 79s ago 110m 27.2M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:43:09.314 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (110m) 79s ago 110m 27.6M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:43:09.315 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (108m) 2m ago 116m 615M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:43:09.315 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (107m) 79s ago 114m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:43:09.315 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (107m) 2m ago 117m 407M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:43:09.315 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (107m) 79s ago 114m 187M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:43:09.315 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (115m) 2m ago 115m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:43:09.316 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (114m) 79s ago 114m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:43:09.316 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (106m) 2m ago 114m 372M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:43:09.316 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (105m) 2m ago 113m 400M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:43:09.317 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (105m) 2m ago 113m 332M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:43:09.317 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (104m) 79s ago 112m 438M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:43:09.318 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (104m) 79s ago 112m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:43:09.318 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (103m) 79s ago 112m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:43:09.318 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (114m) 2m ago 115m 70.2M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:43:09.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.316+0000 7f7c07fff700 1 -- 172.21.15.26:0/727122573 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7bf0064100 msgr2=0x7f7bf00665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:43:09.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.316+0000 7f7c07fff700 1 --2- 172.21.15.26:0/727122573 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7bf0064100 0x7f7bf00665c0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7f7bfc004b00 tx=0x7f7bfc00b040).stop 2021-11-03T18:43:09.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.316+0000 7f7c07fff700 1 -- 172.21.15.26:0/727122573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c080f6530 msgr2=0x7f7c0806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:43:09.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.316+0000 7f7c07fff700 1 --2- 172.21.15.26:0/727122573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c080f6530 0x7f7c0806b9a0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 rx=0x7f7bf8013a70 tx=0x7f7bf8009b30).stop 2021-11-03T18:43:09.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.316+0000 7f7c07fff700 1 -- 172.21.15.26:0/727122573 shutdown_connections 2021-11-03T18:43:09.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.316+0000 7f7c07fff700 1 --2- 172.21.15.26:0/727122573 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7bf0064100 0x7f7bf00665c0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:09.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.316+0000 7f7c07fff700 1 --2- 172.21.15.26:0/727122573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c080f6530 0x7f7c0806b9a0 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:09.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.316+0000 7f7c07fff700 1 --2- 172.21.15.26:0/727122573 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c080f77d0 0x7f7c08069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:09.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.316+0000 7f7c07fff700 1 -- 172.21.15.26:0/727122573 >> 172.21.15.26:0/727122573 conn(0x7f7c080f1cd0 msgr2=0x7f7c080fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:43:09.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.316+0000 7f7c07fff700 1 -- 172.21.15.26:0/727122573 shutdown_connections 2021-11-03T18:43:09.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.316+0000 7f7c07fff700 1 -- 172.21.15.26:0/727122573 wait complete. 2021-11-03T18:43:09.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.415+0000 7f959ed1d700 1 -- 172.21.15.26:0/239502661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95980f5ef0 msgr2=0x7f95980f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:43:09.415 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.415+0000 7f959ed1d700 1 --2- 172.21.15.26:0/239502661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95980f5ef0 0x7f95980f6920 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 rx=0x7f958c004660 tx=0x7f958c009b30).stop 2021-11-03T18:43:09.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.415+0000 7f959ed1d700 1 -- 172.21.15.26:0/239502661 shutdown_connections 2021-11-03T18:43:09.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.415+0000 7f959ed1d700 1 --2- 172.21.15.26:0/239502661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95980f5ef0 0x7f95980f6920 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:09.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.415+0000 7f959ed1d700 1 --2- 172.21.15.26:0/239502661 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95980f55e0 0x7f95980f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:09.416 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.415+0000 7f959ed1d700 1 -- 172.21.15.26:0/239502661 >> 172.21.15.26:0/239502661 conn(0x7f95980f0de0 msgr2=0x7f95980f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:43:09.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.415+0000 7f959ed1d700 1 -- 172.21.15.26:0/239502661 shutdown_connections 2021-11-03T18:43:09.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.415+0000 7f959ed1d700 1 -- 172.21.15.26:0/239502661 wait complete. 2021-11-03T18:43:09.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.415+0000 7f959ed1d700 1 Processor -- start 2021-11-03T18:43:09.417 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.416+0000 7f959ed1d700 1 -- start start 2021-11-03T18:43:09.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.416+0000 7f959ed1d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95980f55e0 0x7f959810c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:43:09.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.416+0000 7f959ed1d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95980f5ef0 0x7f959810e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:43:09.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.416+0000 7f959ed1d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95980603d0 con 0x7f95980f55e0 2021-11-03T18:43:09.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.416+0000 7f959ed1d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9598060510 con 0x7f95980f5ef0 2021-11-03T18:43:09.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.416+0000 7f959cab9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95980f55e0 0x7f959810c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:43:09.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.416+0000 7f959cab9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95980f55e0 0x7f959810c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33388/0 (socket says 172.21.15.26:33388) 2021-11-03T18:43:09.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.416+0000 7f959cab9700 1 -- 172.21.15.26:0/1092217984 learned_addr learned my addr 172.21.15.26:0/1092217984 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:43:09.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.416+0000 7f9597fff700 1 --2- 172.21.15.26:0/1092217984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95980f5ef0 0x7f959810e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:43:09.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.416+0000 7f959cab9700 1 -- 172.21.15.26:0/1092217984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95980f5ef0 msgr2=0x7f959810e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:43:09.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.416+0000 7f959cab9700 1 --2- 172.21.15.26:0/1092217984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95980f5ef0 0x7f959810e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:09.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.416+0000 7f959cab9700 1 -- 172.21.15.26:0/1092217984 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f958c005040 con 0x7f95980f55e0 2021-11-03T18:43:09.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.416+0000 7f9597fff700 1 --2- 172.21.15.26:0/1092217984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95980f5ef0 0x7f959810e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:43:09.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.416+0000 7f959cab9700 1 --2- 172.21.15.26:0/1092217984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95980f55e0 0x7f959810c0b0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 rx=0x7f9590007fd0 tx=0x7f9590004ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:43:09.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.417+0000 7f95957fa700 1 -- 172.21.15.26:0/1092217984 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f959000b5a0 con 0x7f95980f55e0 2021-11-03T18:43:09.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.417+0000 7f959ed1d700 1 -- 172.21.15.26:0/1092217984 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f959810eaa0 con 0x7f95980f55e0 2021-11-03T18:43:09.421 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.417+0000 7f95957fa700 1 -- 172.21.15.26:0/1092217984 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f959000f040 con 0x7f95980f55e0 2021-11-03T18:43:09.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.417+0000 7f95957fa700 1 -- 172.21.15.26:0/1092217984 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9590013b60 con 0x7f95980f55e0 2021-11-03T18:43:09.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.417+0000 7f959ed1d700 1 -- 172.21.15.26:0/1092217984 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f959810ef20 con 0x7f95980f55e0 2021-11-03T18:43:09.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.418+0000 7f959ed1d700 1 -- 172.21.15.26:0/1092217984 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9598045ad0 con 0x7f95980f55e0 2021-11-03T18:43:09.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.418+0000 7f95957fa700 1 -- 172.21.15.26:0/1092217984 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f959001a030 con 0x7f95980f55e0 2021-11-03T18:43:09.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.418+0000 7f95957fa700 1 --2- 172.21.15.26:0/1092217984 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f95800640b0 0x7f9580066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:43:09.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.418+0000 7f95957fa700 1 -- 172.21.15.26:0/1092217984 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f9590080740 con 0x7f95980f55e0 2021-11-03T18:43:09.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.419+0000 7f9597fff700 1 --2- 172.21.15.26:0/1092217984 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f95800640b0 0x7f9580066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:43:09.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.419+0000 7f9597fff700 1 --2- 172.21.15.26:0/1092217984 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f95800640b0 0x7f9580066570 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7f958c004630 tx=0x7f958c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:43:09.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.422+0000 7f95957fa700 1 -- 172.21.15.26:0/1092217984 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f9590052a60 con 0x7f95980f55e0 2021-11-03T18:43:09.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:09 smithi194 ceph-mon[65619]: pgmap v3254: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:09.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.652+0000 7f959ed1d700 1 -- 172.21.15.26:0/1092217984 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f95980fdf50 con 0x7f95980f55e0 2021-11-03T18:43:09.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.652+0000 7f95957fa700 1 -- 172.21.15.26:0/1092217984 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f9590018070 con 0x7f95980f55e0 2021-11-03T18:43:09.651 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:43:09.651 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:43:09.651 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:43:09.652 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:43:09.652 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:43:09.652 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:43:09.653 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:43:09.653 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:43:09.653 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:43:09.653 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:43:09.654 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:43:09.654 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:43:09.654 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:43:09.654 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:43:09.655 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:43:09.655 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:43:09.655 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:43:09.655 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:43:09.656 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.654+0000 7f959ed1d700 1 -- 172.21.15.26:0/1092217984 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f95800640b0 msgr2=0x7f9580066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:43:09.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.654+0000 7f959ed1d700 1 --2- 172.21.15.26:0/1092217984 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f95800640b0 0x7f9580066570 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7f958c004630 tx=0x7f958c009b30).stop 2021-11-03T18:43:09.657 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.654+0000 7f959ed1d700 1 -- 172.21.15.26:0/1092217984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95980f55e0 msgr2=0x7f959810c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:43:09.658 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.654+0000 7f959ed1d700 1 --2- 172.21.15.26:0/1092217984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95980f55e0 0x7f959810c0b0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 rx=0x7f9590007fd0 tx=0x7f9590004ee0).stop 2021-11-03T18:43:09.658 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.654+0000 7f959ed1d700 1 -- 172.21.15.26:0/1092217984 shutdown_connections 2021-11-03T18:43:09.658 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.654+0000 7f959ed1d700 1 --2- 172.21.15.26:0/1092217984 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f95800640b0 0x7f9580066570 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:09.659 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.654+0000 7f959ed1d700 1 --2- 172.21.15.26:0/1092217984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95980f55e0 0x7f959810c0b0 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:09.659 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.654+0000 7f959ed1d700 1 --2- 172.21.15.26:0/1092217984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95980f5ef0 0x7f959810e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:09.659 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.654+0000 7f959ed1d700 1 -- 172.21.15.26:0/1092217984 >> 172.21.15.26:0/1092217984 conn(0x7f95980f0de0 msgr2=0x7f95980fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:43:09.659 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.654+0000 7f959ed1d700 1 -- 172.21.15.26:0/1092217984 shutdown_connections 2021-11-03T18:43:09.660 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.654+0000 7f959ed1d700 1 -- 172.21.15.26:0/1092217984 wait complete. 2021-11-03T18:43:09.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:09 smithi026 ceph-mon[96795]: pgmap v3254: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:09.753 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.753+0000 7fc20a92d700 1 -- 172.21.15.26:0/3184299330 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2040f5440 msgr2=0x7fc2040f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:43:09.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.753+0000 7fc20a92d700 1 --2- 172.21.15.26:0/3184299330 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2040f5440 0x7fc2040f5860 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 rx=0x7fc200004660 tx=0x7fc200009b30).stop 2021-11-03T18:43:09.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.753+0000 7fc20a92d700 1 -- 172.21.15.26:0/3184299330 shutdown_connections 2021-11-03T18:43:09.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.753+0000 7fc20a92d700 1 --2- 172.21.15.26:0/3184299330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2040f66e0 0x7fc2040f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:09.754 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.753+0000 7fc20a92d700 1 --2- 172.21.15.26:0/3184299330 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2040f5440 0x7fc2040f5860 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:09.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.753+0000 7fc20a92d700 1 -- 172.21.15.26:0/3184299330 >> 172.21.15.26:0/3184299330 conn(0x7fc2040f0ba0 msgr2=0x7fc2040f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:43:09.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.754+0000 7fc20a92d700 1 -- 172.21.15.26:0/3184299330 shutdown_connections 2021-11-03T18:43:09.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.754+0000 7fc20a92d700 1 -- 172.21.15.26:0/3184299330 wait complete. 2021-11-03T18:43:09.755 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.754+0000 7fc20a92d700 1 Processor -- start 2021-11-03T18:43:09.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.754+0000 7fc20a92d700 1 -- start start 2021-11-03T18:43:09.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.754+0000 7fc20a92d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2040f5440 0x7fc204105d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:43:09.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.754+0000 7fc20a92d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2040f66e0 0x7fc204106230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:43:09.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.754+0000 7fc20a92d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2041067e0 con 0x7fc2040f5440 2021-11-03T18:43:09.756 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.754+0000 7fc20a92d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc204106fe0 con 0x7fc2040f66e0 2021-11-03T18:43:09.757 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.754+0000 7fc20992b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2040f5440 0x7fc204105d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:43:09.757 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.754+0000 7fc20992b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2040f5440 0x7fc204105d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33398/0 (socket says 172.21.15.26:33398) 2021-11-03T18:43:09.757 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.754+0000 7fc20992b700 1 -- 172.21.15.26:0/4124975025 learned_addr learned my addr 172.21.15.26:0/4124975025 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:43:09.757 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.755+0000 7fc20992b700 1 -- 172.21.15.26:0/4124975025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2040f66e0 msgr2=0x7fc204106230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:43:09.758 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.755+0000 7fc20992b700 1 --2- 172.21.15.26:0/4124975025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2040f66e0 0x7fc204106230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:43:09.758 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.755+0000 7fc20992b700 1 -- 172.21.15.26:0/4124975025 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc200005040 con 0x7fc2040f5440 2021-11-03T18:43:09.758 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.755+0000 7fc20992b700 1 --2- 172.21.15.26:0/4124975025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2040f5440 0x7fc204105d40 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 rx=0x7fc200004f60 tx=0x7fc200009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:43:09.759 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.755+0000 7fc1fa7fc700 1 -- 172.21.15.26:0/4124975025 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc200018070 con 0x7fc2040f5440 2021-11-03T18:43:09.759 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.755+0000 7fc1fa7fc700 1 -- 172.21.15.26:0/4124975025 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc200007ba0 con 0x7fc2040f5440 2021-11-03T18:43:09.759 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.755+0000 7fc20a92d700 1 -- 172.21.15.26:0/4124975025 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc204107260 con 0x7fc2040f5440 2021-11-03T18:43:09.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.755+0000 7fc1fa7fc700 1 -- 172.21.15.26:0/4124975025 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc20001c620 con 0x7fc2040f5440 2021-11-03T18:43:09.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.755+0000 7fc20a92d700 1 -- 172.21.15.26:0/4124975025 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2041077c0 con 0x7fc2040f5440 2021-11-03T18:43:09.761 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.756+0000 7fc20a92d700 1 -- 172.21.15.26:0/4124975025 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc204059100 con 0x7fc2040f5440 2021-11-03T18:43:09.761 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.756+0000 7fc1fa7fc700 1 -- 172.21.15.26:0/4124975025 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc20001d420 con 0x7fc2040f5440 2021-11-03T18:43:09.762 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.757+0000 7fc1fa7fc700 1 --2- 172.21.15.26:0/4124975025 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc1f0064100 0x7fc1f00665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:43:09.762 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.757+0000 7fc1fa7fc700 1 -- 172.21.15.26:0/4124975025 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc200082610 con 0x7fc2040f5440 2021-11-03T18:43:09.762 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.757+0000 7fc20912a700 1 --2- 172.21.15.26:0/4124975025 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc1f0064100 0x7fc1f00665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:43:09.762 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.757+0000 7fc20912a700 1 --2- 172.21.15.26:0/4124975025 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc1f0064100 0x7fc1f00665c0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 rx=0x7fc1f40047d0 tx=0x7fc1f4007a40).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:43:09.763 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.761+0000 7fc1fa7fc700 1 -- 172.21.15.26:0/4124975025 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc200054a30 con 0x7fc2040f5440 2021-11-03T18:43:09.961 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.962+0000 7fc20a92d700 1 -- 172.21.15.26:0/4124975025 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc2040fdd00 con 0x7fc2040f5440 2021-11-03T18:43:09.962 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.963+0000 7fc1fa7fc700 1 -- 172.21.15.26:0/4124975025 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fc200054620 con 0x7fc2040f5440 2021-11-03T18:43:09.962 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:43:09.963 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:43:09.963 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:43:09.963 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:43:09.963 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:43:09.964 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:43:09.964 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:43:09.964 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:43:09.964 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:43:09.965 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:43:09.965 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:43:09.965 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:43:09.965 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:43:09.966 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:43:09.966 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:43:09.966 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:43:09.967 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:43:09.967 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:43:09.967 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:43:09.968 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:43:09.968 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:43:09.968 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:43:09.968 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:43:09.969 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:43:09.969 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:43:09.969 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:43:09.969 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:43:09.970 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:43:09.970 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:43:09.970 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:43:09.970 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:43:09.971 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:43:09.971 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:43:09.971 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:43:09.971 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:43:09.972 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:43:09.972 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:43:09.972 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:43:09.972 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:43:09.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.964+0000 7fc20a92d700 1 -- 172.21.15.26:0/4124975025 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc1f0064100 msgr2=0x7fc1f00665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:43:09.973 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.964+0000 7fc20a92d700 1 --2- 172.21.15.26:0/4124975025 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc1f0064100 0x7fc1f00665c0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 rx=0x7fc1f40047d0 tx=0x7fc1f4007a40).stop 2021-11-03T18:43:09.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.964+0000 7fc20a92d700 1 -- 172.21.15.26:0/4124975025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2040f5440 msgr2=0x7fc204105d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:43:09.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.964+0000 7fc20a92d700 1 --2- 172.21.15.26:0/4124975025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2040f5440 0x7fc204105d40 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 rx=0x7fc200004f60 tx=0x7fc200009b30).stop 2021-11-03T18:43:09.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.964+0000 7fc20a92d700 1 -- 172.21.15.26:0/4124975025 shutdown_connections 2021-11-03T18:43:09.974 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.964+0000 7fc20a92d700 1 --2- 172.21.15.26:0/4124975025 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc1f0064100 0x7fc1f00665c0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:09.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.964+0000 7fc20a92d700 1 --2- 172.21.15.26:0/4124975025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2040f5440 0x7fc204105d40 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:09.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.964+0000 7fc20a92d700 1 --2- 172.21.15.26:0/4124975025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2040f66e0 0x7fc204106230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:43:09.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.964+0000 7fc20a92d700 1 -- 172.21.15.26:0/4124975025 >> 172.21.15.26:0/4124975025 conn(0x7fc2040f0ba0 msgr2=0x7fc2040fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:43:09.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.965+0000 7fc20a92d700 1 -- 172.21.15.26:0/4124975025 shutdown_connections 2021-11-03T18:43:09.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:09.965+0000 7fc20a92d700 1 -- 172.21.15.26:0/4124975025 wait complete. 2021-11-03T18:43:09.976 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:43:10.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:10 smithi194 ceph-mon[65619]: from='client.37484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:43:10.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:10 smithi194 ceph-mon[65619]: from='client.37488 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:43:10.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:10 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1092217984' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:43:10.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:10 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/4124975025' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:43:10.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:10 smithi026 ceph-mon[96795]: from='client.37484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:43:10.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:10 smithi026 ceph-mon[96795]: from='client.37488 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:43:10.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:10 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1092217984' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:43:10.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:10 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/4124975025' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:43:11.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:11 smithi194 ceph-mon[65619]: pgmap v3255: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:11.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:11 smithi026 ceph-mon[96795]: pgmap v3255: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:13.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:13 smithi194 ceph-mon[65619]: pgmap v3256: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:13.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:13 smithi026 ceph-mon[96795]: pgmap v3256: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:15.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:15 smithi194 ceph-mon[65619]: pgmap v3257: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:15.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:15 smithi026 ceph-mon[96795]: pgmap v3257: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:17.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:17 smithi194 ceph-mon[65619]: pgmap v3258: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:17.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:17 smithi026 ceph-mon[96795]: pgmap v3258: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:19.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:19 smithi194 ceph-mon[65619]: pgmap v3259: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:19.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:19 smithi026 ceph-mon[96795]: pgmap v3259: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:21.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:21 smithi026 ceph-mon[96795]: pgmap v3260: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:21.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:21 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:43:21.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:21 smithi194 ceph-mon[65619]: pgmap v3260: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:21.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:21 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:43:22.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:22 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:43:22.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:22 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:43:23.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:23 smithi026 ceph-mon[96795]: pgmap v3261: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:23.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:23 smithi194 ceph-mon[65619]: pgmap v3261: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:25.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:25 smithi194 ceph-mon[65619]: pgmap v3262: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:25.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:25 smithi026 ceph-mon[96795]: pgmap v3262: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:27.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:27 smithi194 ceph-mon[65619]: pgmap v3263: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:27.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:27 smithi026 ceph-mon[96795]: pgmap v3263: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:29.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:29 smithi194 ceph-mon[65619]: pgmap v3264: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:29.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:29 smithi026 ceph-mon[96795]: pgmap v3264: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:31.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:31 smithi026 ceph-mon[96795]: pgmap v3265: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:31.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:31 smithi194 ceph-mon[65619]: pgmap v3265: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:33.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:33 smithi194 ceph-mon[65619]: pgmap v3266: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:33.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:33 smithi026 ceph-mon[96795]: pgmap v3266: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:35.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:35 smithi194 ceph-mon[65619]: pgmap v3267: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:35.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:35 smithi026 ceph-mon[96795]: pgmap v3267: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:36.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:36 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:43:36.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:36 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:43:37.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:37 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:43:37.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:37 smithi194 ceph-mon[65619]: pgmap v3268: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:37.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:37 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:43:37.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:37 smithi026 ceph-mon[96795]: pgmap v3268: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:39.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:39 smithi194 ceph-mon[65619]: pgmap v3269: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:39.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:39 smithi026 ceph-mon[96795]: pgmap v3269: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:40.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.078+0000 7f2be3e53700 1 -- 172.21.15.26:0/1138988062 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2bdc0f6ff0 msgr2=0x7f2bdc0f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:43:40.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.078+0000 7f2be3e53700 1 --2- 172.21.15.26:0/1138988062 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2bdc0f6ff0 0x7f2bdc0f7a20 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 rx=0x7f2bd0004660 tx=0x7f2bd0009b30).stop 2021-11-03T18:43:40.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.078+0000 7f2be3e53700 1 -- 172.21.15.26:0/1138988062 shutdown_connections 2021-11-03T18:43:40.079 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.078+0000 7f2be3e53700 1 --2- 172.21.15.26:0/1138988062 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2bdc0f6ff0 0x7f2bdc0f7a20 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:40.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.078+0000 7f2be3e53700 1 --2- 172.21.15.26:0/1138988062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2bdc0f66e0 0x7f2bdc0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:43:40.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.078+0000 7f2be3e53700 1 -- 172.21.15.26:0/1138988062 >> 172.21.15.26:0/1138988062 conn(0x7f2bdc0f1f00 msgr2=0x7f2bdc0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:43:40.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.078+0000 7f2be3e53700 1 -- 172.21.15.26:0/1138988062 shutdown_connections 2021-11-03T18:43:40.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.078+0000 7f2be3e53700 1 -- 172.21.15.26:0/1138988062 wait complete. 2021-11-03T18:43:40.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.078+0000 7f2be3e53700 1 Processor -- start 2021-11-03T18:43:40.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.078+0000 7f2be3e53700 1 -- start start 2021-11-03T18:43:40.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.079+0000 7f2be3e53700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2bdc0f66e0 0x7f2bdc106fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:43:40.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.079+0000 7f2be3e53700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2bdc0f6ff0 0x7f2bdc107490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:43:40.081 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.079+0000 7f2be3e53700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc107ad0 con 0x7f2bdc0f6ff0 2021-11-03T18:43:40.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.079+0000 7f2be3e53700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc108380 con 0x7f2bdc0f66e0 2021-11-03T18:43:40.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.079+0000 7f2be13ee700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2bdc0f6ff0 0x7f2bdc107490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:43:40.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.079+0000 7f2be13ee700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2bdc0f6ff0 0x7f2bdc107490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33418/0 (socket says 172.21.15.26:33418) 2021-11-03T18:43:40.082 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.079+0000 7f2be13ee700 1 -- 172.21.15.26:0/4123939594 learned_addr learned my addr 172.21.15.26:0/4123939594 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:43:40.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.079+0000 7f2be1bef700 1 --2- 172.21.15.26:0/4123939594 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2bdc0f66e0 0x7f2bdc106fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:43:40.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.079+0000 7f2be13ee700 1 -- 172.21.15.26:0/4123939594 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2bdc0f66e0 msgr2=0x7f2bdc106fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:43:40.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.079+0000 7f2be13ee700 1 --2- 172.21.15.26:0/4123939594 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2bdc0f66e0 0x7f2bdc106fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:40.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.079+0000 7f2be13ee700 1 -- 172.21.15.26:0/4123939594 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd0005040 con 0x7f2bdc0f6ff0 2021-11-03T18:43:40.083 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.079+0000 7f2be13ee700 1 --2- 172.21.15.26:0/4123939594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2bdc0f6ff0 0x7f2bdc107490 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 rx=0x7f2bd0009990 tx=0x7f2bd0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:43:40.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.079+0000 7f2bda7fc700 1 -- 172.21.15.26:0/4123939594 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2bd0018070 con 0x7f2bdc0f6ff0 2021-11-03T18:43:40.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.079+0000 7f2bda7fc700 1 -- 172.21.15.26:0/4123939594 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2bd0007ba0 con 0x7f2bdc0f6ff0 2021-11-03T18:43:40.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.079+0000 7f2be3e53700 1 -- 172.21.15.26:0/4123939594 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bdc108600 con 0x7f2bdc0f6ff0 2021-11-03T18:43:40.084 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.079+0000 7f2bda7fc700 1 -- 172.21.15.26:0/4123939594 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2bd001c620 con 0x7f2bdc0f6ff0 2021-11-03T18:43:40.085 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.079+0000 7f2be3e53700 1 -- 172.21.15.26:0/4123939594 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bdc108b60 con 0x7f2bdc0f6ff0 2021-11-03T18:43:40.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.081+0000 7f2be3e53700 1 -- 172.21.15.26:0/4123939594 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bdc0f5b70 con 0x7f2bdc0f6ff0 2021-11-03T18:43:40.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.081+0000 7f2bda7fc700 1 -- 172.21.15.26:0/4123939594 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f2bd001c890 con 0x7f2bdc0f6ff0 2021-11-03T18:43:40.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.081+0000 7f2bda7fc700 1 --2- 172.21.15.26:0/4123939594 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2bc40640b0 0x7f2bc4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:43:40.086 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.081+0000 7f2bda7fc700 1 -- 172.21.15.26:0/4123939594 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f2bd0082520 con 0x7f2bdc0f6ff0 2021-11-03T18:43:40.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.081+0000 7f2be1bef700 1 --2- 172.21.15.26:0/4123939594 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2bc40640b0 0x7f2bc4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:43:40.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.082+0000 7f2be1bef700 1 --2- 172.21.15.26:0/4123939594 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2bc40640b0 0x7f2bc4066570 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7f2bd4009c70 tx=0x7f2bd4009220).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:43:40.087 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.086+0000 7f2bda7fc700 1 -- 172.21.15.26:0/4123939594 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f2bd0054940 con 0x7f2bdc0f6ff0 2021-11-03T18:43:40.268 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.268+0000 7f2be3e53700 1 -- 172.21.15.26:0/4123939594 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2bdc0fefc0 con 0x7f2bc40640b0 2021-11-03T18:43:40.268 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.270+0000 7f2bda7fc700 1 -- 172.21.15.26:0/4123939594 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f2bdc0fefc0 con 0x7f2bc40640b0 2021-11-03T18:43:40.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.271+0000 7f2be3e53700 1 -- 172.21.15.26:0/4123939594 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2bc40640b0 msgr2=0x7f2bc4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:43:40.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.271+0000 7f2be3e53700 1 --2- 172.21.15.26:0/4123939594 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2bc40640b0 0x7f2bc4066570 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7f2bd4009c70 tx=0x7f2bd4009220).stop 2021-11-03T18:43:40.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.271+0000 7f2be3e53700 1 -- 172.21.15.26:0/4123939594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2bdc0f6ff0 msgr2=0x7f2bdc107490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:43:40.271 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.271+0000 7f2be3e53700 1 --2- 172.21.15.26:0/4123939594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2bdc0f6ff0 0x7f2bdc107490 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 rx=0x7f2bd0009990 tx=0x7f2bd0009b30).stop 2021-11-03T18:43:40.272 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.272+0000 7f2be3e53700 1 -- 172.21.15.26:0/4123939594 shutdown_connections 2021-11-03T18:43:40.272 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.272+0000 7f2be3e53700 1 --2- 172.21.15.26:0/4123939594 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2bc40640b0 0x7f2bc4066570 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:40.272 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.272+0000 7f2be3e53700 1 --2- 172.21.15.26:0/4123939594 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2bdc0f66e0 0x7f2bdc106fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:40.272 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.272+0000 7f2be3e53700 1 --2- 172.21.15.26:0/4123939594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2bdc0f6ff0 0x7f2bdc107490 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:40.273 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.272+0000 7f2be3e53700 1 -- 172.21.15.26:0/4123939594 >> 172.21.15.26:0/4123939594 conn(0x7f2bdc0f1f00 msgr2=0x7f2bdc0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:43:40.273 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.272+0000 7f2be3e53700 1 -- 172.21.15.26:0/4123939594 shutdown_connections 2021-11-03T18:43:40.273 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.272+0000 7f2be3e53700 1 -- 172.21.15.26:0/4123939594 wait complete. 2021-11-03T18:43:40.281 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:43:40.373 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.373+0000 7feaae16c700 1 -- 172.21.15.26:0/2589513236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feaa80f5ef0 msgr2=0x7feaa80f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:43:40.373 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.373+0000 7feaae16c700 1 --2- 172.21.15.26:0/2589513236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feaa80f5ef0 0x7feaa80f6920 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 rx=0x7fea9c004660 tx=0x7fea9c009b30).stop 2021-11-03T18:43:40.373 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.373+0000 7feaae16c700 1 -- 172.21.15.26:0/2589513236 shutdown_connections 2021-11-03T18:43:40.373 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.373+0000 7feaae16c700 1 --2- 172.21.15.26:0/2589513236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feaa80f5ef0 0x7feaa80f6920 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:40.374 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.373+0000 7feaae16c700 1 --2- 172.21.15.26:0/2589513236 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feaa80f55e0 0x7feaa80f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:40.374 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.373+0000 7feaae16c700 1 -- 172.21.15.26:0/2589513236 >> 172.21.15.26:0/2589513236 conn(0x7feaa80f0de0 msgr2=0x7feaa80f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:43:40.375 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.373+0000 7feaae16c700 1 -- 172.21.15.26:0/2589513236 shutdown_connections 2021-11-03T18:43:40.375 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.373+0000 7feaae16c700 1 -- 172.21.15.26:0/2589513236 wait complete. 2021-11-03T18:43:40.375 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.373+0000 7feaae16c700 1 Processor -- start 2021-11-03T18:43:40.375 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.374+0000 7feaae16c700 1 -- start start 2021-11-03T18:43:40.376 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.374+0000 7feaae16c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feaa80f55e0 0x7feaa8106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:43:40.376 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.374+0000 7feaae16c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feaa80f5ef0 0x7feaa8107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:43:40.376 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.374+0000 7feaae16c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa8107a10 con 0x7feaa80f5ef0 2021-11-03T18:43:40.376 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.374+0000 7feaae16c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa8107b50 con 0x7feaa80f55e0 2021-11-03T18:43:40.376 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.374+0000 7feaa6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feaa80f5ef0 0x7feaa8107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:43:40.377 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.374+0000 7feaa6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feaa80f5ef0 0x7feaa8107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33428/0 (socket says 172.21.15.26:33428) 2021-11-03T18:43:40.377 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.374+0000 7feaa6ffd700 1 -- 172.21.15.26:0/3612074554 learned_addr learned my addr 172.21.15.26:0/3612074554 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:43:40.379 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.374+0000 7feaa77fe700 1 --2- 172.21.15.26:0/3612074554 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feaa80f55e0 0x7feaa8106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:43:40.379 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.374+0000 7feaa6ffd700 1 -- 172.21.15.26:0/3612074554 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feaa80f55e0 msgr2=0x7feaa8106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:43:40.379 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.374+0000 7feaa6ffd700 1 --2- 172.21.15.26:0/3612074554 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feaa80f55e0 0x7feaa8106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:40.379 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.374+0000 7feaa6ffd700 1 -- 172.21.15.26:0/3612074554 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea9c005040 con 0x7feaa80f5ef0 2021-11-03T18:43:40.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.374+0000 7feaa6ffd700 1 --2- 172.21.15.26:0/3612074554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feaa80f5ef0 0x7feaa8107460 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 rx=0x7fea9c009990 tx=0x7fea9c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:43:40.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.374+0000 7fea8ffff700 1 -- 172.21.15.26:0/3612074554 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea9c018070 con 0x7feaa80f5ef0 2021-11-03T18:43:40.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.375+0000 7fea8ffff700 1 -- 172.21.15.26:0/3612074554 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fea9c007ba0 con 0x7feaa80f5ef0 2021-11-03T18:43:40.380 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.375+0000 7fea8ffff700 1 -- 172.21.15.26:0/3612074554 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea9c01c3c0 con 0x7feaa80f5ef0 2021-11-03T18:43:40.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.375+0000 7feaae16c700 1 -- 172.21.15.26:0/3612074554 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa8108490 con 0x7feaa80f5ef0 2021-11-03T18:43:40.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.375+0000 7feaae16c700 1 -- 172.21.15.26:0/3612074554 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa81089f0 con 0x7feaa80f5ef0 2021-11-03T18:43:40.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.376+0000 7feaae16c700 1 -- 172.21.15.26:0/3612074554 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaa8045ad0 con 0x7feaa80f5ef0 2021-11-03T18:43:40.381 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.376+0000 7fea8ffff700 1 -- 172.21.15.26:0/3612074554 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fea9c01d420 con 0x7feaa80f5ef0 2021-11-03T18:43:40.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.376+0000 7fea8ffff700 1 --2- 172.21.15.26:0/3612074554 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fea900640b0 0x7fea90066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:43:40.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.377+0000 7fea8ffff700 1 -- 172.21.15.26:0/3612074554 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fea9c082430 con 0x7feaa80f5ef0 2021-11-03T18:43:40.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.377+0000 7feaa77fe700 1 --2- 172.21.15.26:0/3612074554 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fea900640b0 0x7fea90066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:43:40.382 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.377+0000 7feaa77fe700 1 --2- 172.21.15.26:0/3612074554 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fea900640b0 0x7fea90066570 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 rx=0x7fea98004a70 tx=0x7fea9800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:43:40.383 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.381+0000 7fea8ffff700 1 -- 172.21.15.26:0/3612074554 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fea9c0547f0 con 0x7feaa80f5ef0 2021-11-03T18:43:40.553 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.554+0000 7feaae16c700 1 -- 172.21.15.26:0/3612074554 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7feaa805fe50 con 0x7fea900640b0 2021-11-03T18:43:40.568 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.569+0000 7fea8ffff700 1 -- 172.21.15.26:0/3612074554 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7feaa805fe50 con 0x7fea900640b0 2021-11-03T18:43:40.569 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:43:40.569 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (114m) 2m ago 116m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:43:40.569 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (107m) 2m ago 116m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:43:40.569 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (106m) 110s ago 115m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:43:40.570 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (114m) 2m ago 115m 42.4M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:43:40.570 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (107m) 2m ago 111m 26.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:43:40.570 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (108m) 2m ago 111m 27.0M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:43:40.570 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (111m) 110s ago 111m 27.2M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:43:40.571 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (111m) 110s ago 111m 27.6M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:43:40.571 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (108m) 2m ago 117m 615M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:43:40.571 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (108m) 110s ago 115m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:43:40.571 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (108m) 2m ago 117m 407M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:43:40.572 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (107m) 110s ago 115m 187M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:43:40.572 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (115m) 2m ago 115m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:43:40.572 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (115m) 110s ago 115m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:43:40.572 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (106m) 2m ago 114m 372M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:43:40.572 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (106m) 2m ago 114m 400M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:43:40.573 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (105m) 2m ago 113m 332M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:43:40.573 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (105m) 110s ago 113m 438M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:43:40.573 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (104m) 110s ago 113m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:43:40.573 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (104m) 110s ago 112m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:43:40.574 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (114m) 2m ago 115m 70.2M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:43:40.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.571+0000 7feaae16c700 1 -- 172.21.15.26:0/3612074554 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fea900640b0 msgr2=0x7fea90066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:43:40.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.571+0000 7feaae16c700 1 --2- 172.21.15.26:0/3612074554 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fea900640b0 0x7fea90066570 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 rx=0x7fea98004a70 tx=0x7fea9800b040).stop 2021-11-03T18:43:40.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.571+0000 7feaae16c700 1 -- 172.21.15.26:0/3612074554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feaa80f5ef0 msgr2=0x7feaa8107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:43:40.575 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.571+0000 7feaae16c700 1 --2- 172.21.15.26:0/3612074554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feaa80f5ef0 0x7feaa8107460 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 rx=0x7fea9c009990 tx=0x7fea9c009b30).stop 2021-11-03T18:43:40.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.571+0000 7feaae16c700 1 -- 172.21.15.26:0/3612074554 shutdown_connections 2021-11-03T18:43:40.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.571+0000 7feaae16c700 1 --2- 172.21.15.26:0/3612074554 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fea900640b0 0x7fea90066570 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:40.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.571+0000 7feaae16c700 1 --2- 172.21.15.26:0/3612074554 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feaa80f55e0 0x7feaa8106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:40.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.571+0000 7feaae16c700 1 --2- 172.21.15.26:0/3612074554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feaa80f5ef0 0x7feaa8107460 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:40.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.571+0000 7feaae16c700 1 -- 172.21.15.26:0/3612074554 >> 172.21.15.26:0/3612074554 conn(0x7feaa80f0de0 msgr2=0x7feaa805f740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:43:40.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.571+0000 7feaae16c700 1 -- 172.21.15.26:0/3612074554 shutdown_connections 2021-11-03T18:43:40.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.571+0000 7feaae16c700 1 -- 172.21.15.26:0/3612074554 wait complete. 2021-11-03T18:43:40.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.670+0000 7f108b4b4700 1 -- 172.21.15.26:0/2492143796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10840f7b30 msgr2=0x7f10840f7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:43:40.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.670+0000 7f108b4b4700 1 --2- 172.21.15.26:0/2492143796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10840f7b30 0x7f10840f7f90 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 rx=0x7f1078004660 tx=0x7f1078009b30).stop 2021-11-03T18:43:40.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.670+0000 7f108b4b4700 1 -- 172.21.15.26:0/2492143796 shutdown_connections 2021-11-03T18:43:40.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.670+0000 7f108b4b4700 1 --2- 172.21.15.26:0/2492143796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10840f7b30 0x7f10840f7f90 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:40.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.670+0000 7f108b4b4700 1 --2- 172.21.15.26:0/2492143796 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10840f6890 0x7f10840f6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:40.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.670+0000 7f108b4b4700 1 -- 172.21.15.26:0/2492143796 >> 172.21.15.26:0/2492143796 conn(0x7f10840f1ff0 msgr2=0x7f10840f4410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:43:40.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.670+0000 7f108b4b4700 1 -- 172.21.15.26:0/2492143796 shutdown_connections 2021-11-03T18:43:40.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.670+0000 7f108b4b4700 1 -- 172.21.15.26:0/2492143796 wait complete. 2021-11-03T18:43:40.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.671+0000 7f108b4b4700 1 Processor -- start 2021-11-03T18:43:40.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.671+0000 7f108b4b4700 1 -- start start 2021-11-03T18:43:40.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.671+0000 7f108b4b4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10840f6890 0x7f10841070b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:43:40.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.671+0000 7f108b4b4700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10840f7b30 0x7f10841075a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:43:40.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.671+0000 7f108b4b4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1084107b50 con 0x7f10840f6890 2021-11-03T18:43:40.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.671+0000 7f108b4b4700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1084107c90 con 0x7f10840f7b30 2021-11-03T18:43:40.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.671+0000 7f1089250700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10840f6890 0x7f10841070b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:43:40.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.671+0000 7f1089250700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10840f6890 0x7f10841070b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33436/0 (socket says 172.21.15.26:33436) 2021-11-03T18:43:40.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.671+0000 7f1089250700 1 -- 172.21.15.26:0/2345521182 learned_addr learned my addr 172.21.15.26:0/2345521182 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:43:40.676 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.671+0000 7f1088a4f700 1 --2- 172.21.15.26:0/2345521182 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10840f7b30 0x7f10841075a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:43:40.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.672+0000 7f1089250700 1 -- 172.21.15.26:0/2345521182 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10840f7b30 msgr2=0x7f10841075a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:43:40.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.672+0000 7f1089250700 1 --2- 172.21.15.26:0/2345521182 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10840f7b30 0x7f10841075a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:40.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.672+0000 7f1089250700 1 -- 172.21.15.26:0/2345521182 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1078005040 con 0x7f10840f6890 2021-11-03T18:43:40.677 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.672+0000 7f1089250700 1 --2- 172.21.15.26:0/2345521182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10840f6890 0x7f10841070b0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 rx=0x7f107c00d7f0 tx=0x7f107c004e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:43:40.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.672+0000 7f1081ffb700 1 -- 172.21.15.26:0/2345521182 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f107c00b4f0 con 0x7f10840f6890 2021-11-03T18:43:40.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.672+0000 7f108b4b4700 1 -- 172.21.15.26:0/2345521182 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1084108630 con 0x7f10840f6890 2021-11-03T18:43:40.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.672+0000 7f1081ffb700 1 -- 172.21.15.26:0/2345521182 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f107c00f040 con 0x7f10840f6890 2021-11-03T18:43:40.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.672+0000 7f1081ffb700 1 -- 172.21.15.26:0/2345521182 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f107c013980 con 0x7f10840f6890 2021-11-03T18:43:40.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.672+0000 7f108b4b4700 1 -- 172.21.15.26:0/2345521182 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1084108bf0 con 0x7f10840f6890 2021-11-03T18:43:40.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.673+0000 7f108b4b4700 1 -- 172.21.15.26:0/2345521182 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1084045ad0 con 0x7f10840f6890 2021-11-03T18:43:40.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.673+0000 7f1081ffb700 1 -- 172.21.15.26:0/2345521182 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f107c01a030 con 0x7f10840f6890 2021-11-03T18:43:40.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.674+0000 7f1081ffb700 1 --2- 172.21.15.26:0/2345521182 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f106c064100 0x7f106c0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:43:40.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.674+0000 7f1081ffb700 1 -- 172.21.15.26:0/2345521182 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f107c080830 con 0x7f10840f6890 2021-11-03T18:43:40.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.674+0000 7f1088a4f700 1 --2- 172.21.15.26:0/2345521182 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f106c064100 0x7f106c0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:43:40.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.674+0000 7f1088a4f700 1 --2- 172.21.15.26:0/2345521182 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f106c064100 0x7f106c0665c0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7f1078004630 tx=0x7f1078009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:43:40.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.678+0000 7f1081ffb700 1 -- 172.21.15.26:0/2345521182 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f107c052aa0 con 0x7f10840f6890 2021-11-03T18:43:40.909 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.910+0000 7f108b4b4700 1 -- 172.21.15.26:0/2345521182 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f10840ff050 con 0x7f10840f6890 2021-11-03T18:43:40.909 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.910+0000 7f1081ffb700 1 -- 172.21.15.26:0/2345521182 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f107c0182e0 con 0x7f10840f6890 2021-11-03T18:43:40.910 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:43:40.910 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:43:40.911 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:43:40.911 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:43:40.911 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:43:40.911 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:43:40.912 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:43:40.912 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:43:40.912 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:43:40.912 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:43:40.912 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:43:40.913 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:43:40.913 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:43:40.913 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:43:40.913 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:43:40.914 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:43:40.914 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:43:40.914 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:43:40.915 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.912+0000 7f108b4b4700 1 -- 172.21.15.26:0/2345521182 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f106c064100 msgr2=0x7f106c0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:43:40.915 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.912+0000 7f108b4b4700 1 --2- 172.21.15.26:0/2345521182 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f106c064100 0x7f106c0665c0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7f1078004630 tx=0x7f1078009b30).stop 2021-11-03T18:43:40.916 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.912+0000 7f108b4b4700 1 -- 172.21.15.26:0/2345521182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10840f6890 msgr2=0x7f10841070b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:43:40.916 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.912+0000 7f108b4b4700 1 --2- 172.21.15.26:0/2345521182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10840f6890 0x7f10841070b0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 rx=0x7f107c00d7f0 tx=0x7f107c004e80).stop 2021-11-03T18:43:40.916 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.912+0000 7f108b4b4700 1 -- 172.21.15.26:0/2345521182 shutdown_connections 2021-11-03T18:43:40.916 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.912+0000 7f108b4b4700 1 --2- 172.21.15.26:0/2345521182 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f106c064100 0x7f106c0665c0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:40.916 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.912+0000 7f108b4b4700 1 --2- 172.21.15.26:0/2345521182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10840f6890 0x7f10841070b0 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:40.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.912+0000 7f108b4b4700 1 --2- 172.21.15.26:0/2345521182 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10840f7b30 0x7f10841075a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:40.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.912+0000 7f108b4b4700 1 -- 172.21.15.26:0/2345521182 >> 172.21.15.26:0/2345521182 conn(0x7f10840f1ff0 msgr2=0x7f10840fb580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:43:40.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.912+0000 7f108b4b4700 1 -- 172.21.15.26:0/2345521182 shutdown_connections 2021-11-03T18:43:40.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:40.912+0000 7f108b4b4700 1 -- 172.21.15.26:0/2345521182 wait complete. 2021-11-03T18:43:41.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.012+0000 7fdeb940a700 1 -- 172.21.15.26:0/180595903 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdeb40f66e0 msgr2=0x7fdeb40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:43:41.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.012+0000 7fdeb940a700 1 --2- 172.21.15.26:0/180595903 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdeb40f66e0 0x7fdeb40f6b00 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 rx=0x7fdea4004660 tx=0x7fdea4009b30).stop 2021-11-03T18:43:41.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.012+0000 7fdeb940a700 1 -- 172.21.15.26:0/180595903 shutdown_connections 2021-11-03T18:43:41.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.012+0000 7fdeb940a700 1 --2- 172.21.15.26:0/180595903 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdeb40f6ff0 0x7fdeb40f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:41.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.012+0000 7fdeb940a700 1 --2- 172.21.15.26:0/180595903 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdeb40f66e0 0x7fdeb40f6b00 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:41.012 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.012+0000 7fdeb940a700 1 -- 172.21.15.26:0/180595903 >> 172.21.15.26:0/180595903 conn(0x7fdeb40f1f00 msgr2=0x7fdeb40f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:43:41.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.012+0000 7fdeb940a700 1 -- 172.21.15.26:0/180595903 shutdown_connections 2021-11-03T18:43:41.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.012+0000 7fdeb940a700 1 -- 172.21.15.26:0/180595903 wait complete. 2021-11-03T18:43:41.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.012+0000 7fdeb940a700 1 Processor -- start 2021-11-03T18:43:41.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.013+0000 7fdeb940a700 1 -- start start 2021-11-03T18:43:41.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.013+0000 7fdeb940a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdeb40f66e0 0x7fdeb406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:43:41.016 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.013+0000 7fdeb940a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdeb40f6ff0 0x7fdeb4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:43:41.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.013+0000 7fdeb940a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb406a380 con 0x7fdeb40f6ff0 2021-11-03T18:43:41.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.013+0000 7fdeb940a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb406a4c0 con 0x7fdeb40f66e0 2021-11-03T18:43:41.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.013+0000 7fdeb27fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdeb40f6ff0 0x7fdeb4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:43:41.017 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.013+0000 7fdeb27fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdeb40f6ff0 0x7fdeb4069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33448/0 (socket says 172.21.15.26:33448) 2021-11-03T18:43:41.018 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.013+0000 7fdeb27fc700 1 -- 172.21.15.26:0/2543008726 learned_addr learned my addr 172.21.15.26:0/2543008726 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:43:41.018 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.013+0000 7fdeb2ffd700 1 --2- 172.21.15.26:0/2543008726 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdeb40f66e0 0x7fdeb406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:43:41.018 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.013+0000 7fdeb27fc700 1 -- 172.21.15.26:0/2543008726 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdeb40f66e0 msgr2=0x7fdeb406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:43:41.018 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.013+0000 7fdeb27fc700 1 --2- 172.21.15.26:0/2543008726 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdeb40f66e0 0x7fdeb406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:41.019 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.013+0000 7fdeb27fc700 1 -- 172.21.15.26:0/2543008726 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea4005040 con 0x7fdeb40f6ff0 2021-11-03T18:43:41.019 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.013+0000 7fdeb27fc700 1 --2- 172.21.15.26:0/2543008726 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdeb40f6ff0 0x7fdeb4069e20 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 rx=0x7fdea80026d0 tx=0x7fdea8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:43:41.019 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.013+0000 7fde9b7fe700 1 -- 172.21.15.26:0/2543008726 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdea80079c0 con 0x7fdeb40f6ff0 2021-11-03T18:43:41.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.013+0000 7fdeb940a700 1 -- 172.21.15.26:0/2543008726 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeb406a7a0 con 0x7fdeb40f6ff0 2021-11-03T18:43:41.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.013+0000 7fdeb940a700 1 -- 172.21.15.26:0/2543008726 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeb410ef90 con 0x7fdeb40f6ff0 2021-11-03T18:43:41.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.013+0000 7fde9b7fe700 1 -- 172.21.15.26:0/2543008726 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdea800f040 con 0x7fdeb40f6ff0 2021-11-03T18:43:41.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.014+0000 7fde9b7fe700 1 -- 172.21.15.26:0/2543008726 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdea80148b0 con 0x7fdeb40f6ff0 2021-11-03T18:43:41.021 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.014+0000 7fdeb940a700 1 -- 172.21.15.26:0/2543008726 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeb4045ad0 con 0x7fdeb40f6ff0 2021-11-03T18:43:41.021 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.015+0000 7fde9b7fe700 1 -- 172.21.15.26:0/2543008726 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fdea8007b20 con 0x7fdeb40f6ff0 2021-11-03T18:43:41.021 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.015+0000 7fde9b7fe700 1 --2- 172.21.15.26:0/2543008726 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fde9c0640b0 0x7fde9c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:43:41.021 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.015+0000 7fde9b7fe700 1 -- 172.21.15.26:0/2543008726 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fdea80806e0 con 0x7fdeb40f6ff0 2021-11-03T18:43:41.022 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.015+0000 7fdeb2ffd700 1 --2- 172.21.15.26:0/2543008726 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fde9c0640b0 0x7fde9c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:43:41.022 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.016+0000 7fdeb2ffd700 1 --2- 172.21.15.26:0/2543008726 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fde9c0640b0 0x7fde9c066570 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7fdea4004630 tx=0x7fdea4009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:43:41.022 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.019+0000 7fde9b7fe700 1 -- 172.21.15.26:0/2543008726 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fdea80529c0 con 0x7fdeb40f6ff0 2021-11-03T18:43:41.222 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.223+0000 7fdeb940a700 1 -- 172.21.15.26:0/2543008726 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdeb4027a00 con 0x7fdeb40f6ff0 2021-11-03T18:43:41.223 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.223+0000 7fde9b7fe700 1 -- 172.21.15.26:0/2543008726 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fdea80525b0 con 0x7fdeb40f6ff0 2021-11-03T18:43:41.224 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:43:41.224 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:43:41.224 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:43:41.224 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:43:41.225 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:43:41.225 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:43:41.225 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:43:41.225 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:43:41.226 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:43:41.226 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:43:41.226 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:43:41.226 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:43:41.226 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:43:41.227 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:43:41.227 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:43:41.227 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:43:41.227 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:43:41.228 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:43:41.228 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:43:41.228 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:43:41.228 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:43:41.228 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:43:41.229 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:43:41.229 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:43:41.229 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:43:41.229 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:43:41.230 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:43:41.230 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:43:41.230 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:43:41.230 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:43:41.231 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:43:41.231 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:43:41.231 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:43:41.231 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:43:41.232 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:43:41.232 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:43:41.232 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:43:41.232 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:43:41.233 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:43:41.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.225+0000 7fdeb940a700 1 -- 172.21.15.26:0/2543008726 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fde9c0640b0 msgr2=0x7fde9c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:43:41.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.225+0000 7fdeb940a700 1 --2- 172.21.15.26:0/2543008726 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fde9c0640b0 0x7fde9c066570 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7fdea4004630 tx=0x7fdea4009b30).stop 2021-11-03T18:43:41.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.225+0000 7fdeb940a700 1 -- 172.21.15.26:0/2543008726 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdeb40f6ff0 msgr2=0x7fdeb4069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:43:41.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.225+0000 7fdeb940a700 1 --2- 172.21.15.26:0/2543008726 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdeb40f6ff0 0x7fdeb4069e20 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 rx=0x7fdea80026d0 tx=0x7fdea8009de0).stop 2021-11-03T18:43:41.235 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.225+0000 7fdeb940a700 1 -- 172.21.15.26:0/2543008726 shutdown_connections 2021-11-03T18:43:41.235 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.225+0000 7fdeb940a700 1 --2- 172.21.15.26:0/2543008726 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fde9c0640b0 0x7fde9c066570 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:41.235 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.225+0000 7fdeb940a700 1 --2- 172.21.15.26:0/2543008726 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdeb40f66e0 0x7fdeb406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:41.235 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.225+0000 7fdeb940a700 1 --2- 172.21.15.26:0/2543008726 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdeb40f6ff0 0x7fdeb4069e20 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:43:41.236 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.225+0000 7fdeb940a700 1 -- 172.21.15.26:0/2543008726 >> 172.21.15.26:0/2543008726 conn(0x7fdeb40f1f00 msgr2=0x7fdeb40fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:43:41.236 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.225+0000 7fdeb940a700 1 -- 172.21.15.26:0/2543008726 shutdown_connections 2021-11-03T18:43:41.236 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:43:41.225+0000 7fdeb940a700 1 -- 172.21.15.26:0/2543008726 wait complete. 2021-11-03T18:43:41.236 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:43:41.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:41 smithi026 ceph-mon[96795]: pgmap v3270: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:41.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:41 smithi026 ceph-mon[96795]: from='client.37500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:43:41.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:41 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2345521182' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:43:41.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:41 smithi194 ceph-mon[65619]: pgmap v3270: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:41.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:41 smithi194 ceph-mon[65619]: from='client.37500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:43:41.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:41 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2345521182' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:43:42.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:42 smithi026 ceph-mon[96795]: from='client.37504 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:43:42.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:42 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2543008726' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:43:42.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:42 smithi194 ceph-mon[65619]: from='client.37504 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:43:42.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:42 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2543008726' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:43:43.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:43 smithi026 ceph-mon[96795]: pgmap v3271: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:43.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:43 smithi194 ceph-mon[65619]: pgmap v3271: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:45.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:45 smithi194 ceph-mon[65619]: pgmap v3272: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:45.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:45 smithi026 ceph-mon[96795]: pgmap v3272: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:47.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:47 smithi194 ceph-mon[65619]: pgmap v3273: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:47.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:47 smithi026 ceph-mon[96795]: pgmap v3273: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:49.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:49 smithi194 ceph-mon[65619]: pgmap v3274: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:43:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:43:49.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:49 smithi026 ceph-mon[96795]: pgmap v3274: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:49.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:43:49.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:43:51.409 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:51 smithi194 ceph-mon[65619]: pgmap v3275: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:51.410 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:51 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:43:51.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:51 smithi026 ceph-mon[96795]: pgmap v3275: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:51.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:51 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:43:52.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:52 smithi026 ceph-mon[96795]: poll took 60082.061 ms: 1 events 2021-11-03T18:43:52.615 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:52 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:43:52.615 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:52 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:43:52.615 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:52 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:43:52.616 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:52 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:43:52.616 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:52 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:43:52.616 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:52 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:43:52.616 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:52 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:43:52.617 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:52 smithi194 ceph-mon[65619]: poll took 60082.061 ms: 1 events 2021-11-03T18:43:52.617 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:52 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:43:52.618 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:52 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:43:52.618 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:52 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:43:52.618 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:52 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:43:52.618 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:52 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:43:52.619 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:52 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:43:52.621 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:52 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:43:53.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:53 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:43:53.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:53 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:43:53.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:53 smithi026 ceph-mon[96795]: pgmap v3276: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:53.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:53 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:43:53.475 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:53 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:43:53.475 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:53 smithi194 ceph-mon[65619]: pgmap v3276: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:55.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:55 smithi194 ceph-mon[65619]: pgmap v3277: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:55.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:55 smithi026 ceph-mon[96795]: pgmap v3277: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:57.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:57 smithi194 ceph-mon[65619]: pgmap v3278: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:57.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:57 smithi026 ceph-mon[96795]: pgmap v3278: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:59.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:43:59 smithi194 ceph-mon[65619]: pgmap v3279: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:43:59.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:43:59 smithi026 ceph-mon[96795]: pgmap v3279: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:01.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:01 smithi026 ceph-mon[96795]: pgmap v3280: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:01.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:01 smithi194 ceph-mon[65619]: pgmap v3280: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:03.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:03 smithi194 ceph-mon[65619]: pgmap v3281: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:03.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:03 smithi026 ceph-mon[96795]: pgmap v3281: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:05.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:05 smithi194 ceph-mon[65619]: pgmap v3282: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:05.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:05 smithi026 ceph-mon[96795]: pgmap v3282: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:07.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:07 smithi194 ceph-mon[65619]: pgmap v3283: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:07.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:07 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:44:07.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:07 smithi026 ceph-mon[96795]: pgmap v3283: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:07.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:07 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:44:08.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:08 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:44:08.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:08 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:44:09.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:09 smithi194 ceph-mon[65619]: pgmap v3284: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:09.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:09 smithi026 ceph-mon[96795]: pgmap v3284: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:11.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.341+0000 7f7019316700 1 -- 172.21.15.26:0/1977936535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70140f55e0 msgr2=0x7f70140f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:44:11.341 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.341+0000 7f7019316700 1 --2- 172.21.15.26:0/1977936535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70140f55e0 0x7f70140f5a00 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 rx=0x7f7004004660 tx=0x7f7004009b30).stop 2021-11-03T18:44:11.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.341+0000 7f7019316700 1 -- 172.21.15.26:0/1977936535 shutdown_connections 2021-11-03T18:44:11.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.341+0000 7f7019316700 1 --2- 172.21.15.26:0/1977936535 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70140f5ef0 0x7f70140f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:11.342 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.341+0000 7f7019316700 1 --2- 172.21.15.26:0/1977936535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70140f55e0 0x7f70140f5a00 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:11.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.341+0000 7f7019316700 1 -- 172.21.15.26:0/1977936535 >> 172.21.15.26:0/1977936535 conn(0x7f70140f0de0 msgr2=0x7f70140f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:44:11.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.341+0000 7f7019316700 1 -- 172.21.15.26:0/1977936535 shutdown_connections 2021-11-03T18:44:11.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.341+0000 7f7019316700 1 -- 172.21.15.26:0/1977936535 wait complete. 2021-11-03T18:44:11.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.342+0000 7f7019316700 1 Processor -- start 2021-11-03T18:44:11.343 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.342+0000 7f7019316700 1 -- start start 2021-11-03T18:44:11.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.342+0000 7f7019316700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70140f55e0 0x7f7014106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:44:11.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.342+0000 7f7019316700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70140f5ef0 0x7f7014107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:44:11.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.342+0000 7f7019316700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7014107a10 con 0x7f70140f5ef0 2021-11-03T18:44:11.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.342+0000 7f7019316700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7014107b50 con 0x7f70140f55e0 2021-11-03T18:44:11.344 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.342+0000 7f70127fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70140f5ef0 0x7f7014107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:44:11.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.342+0000 7f70127fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70140f5ef0 0x7f7014107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33466/0 (socket says 172.21.15.26:33466) 2021-11-03T18:44:11.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.342+0000 7f70127fc700 1 -- 172.21.15.26:0/1022036404 learned_addr learned my addr 172.21.15.26:0/1022036404 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:44:11.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.342+0000 7f7012ffd700 1 --2- 172.21.15.26:0/1022036404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70140f55e0 0x7f7014106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:44:11.345 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.343+0000 7f70127fc700 1 -- 172.21.15.26:0/1022036404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70140f55e0 msgr2=0x7f7014106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:44:11.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.343+0000 7f70127fc700 1 --2- 172.21.15.26:0/1022036404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70140f55e0 0x7f7014106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:11.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.343+0000 7f70127fc700 1 -- 172.21.15.26:0/1022036404 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7004005040 con 0x7f70140f5ef0 2021-11-03T18:44:11.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.343+0000 7f70127fc700 1 --2- 172.21.15.26:0/1022036404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70140f5ef0 0x7f7014107460 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 rx=0x7f6ffc00c530 tx=0x7f6ffc007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:44:11.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.343+0000 7f700b7fe700 1 -- 172.21.15.26:0/1022036404 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ffc00f650 con 0x7f70140f5ef0 2021-11-03T18:44:11.346 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.343+0000 7f700b7fe700 1 -- 172.21.15.26:0/1022036404 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6ffc00fc60 con 0x7f70140f5ef0 2021-11-03T18:44:11.347 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.343+0000 7f7019316700 1 -- 172.21.15.26:0/1022036404 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70141084f0 con 0x7f70140f5ef0 2021-11-03T18:44:11.347 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.343+0000 7f700b7fe700 1 -- 172.21.15.26:0/1022036404 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ffc012c20 con 0x7f70140f5ef0 2021-11-03T18:44:11.347 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.343+0000 7f7019316700 1 -- 172.21.15.26:0/1022036404 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7014108ab0 con 0x7f70140f5ef0 2021-11-03T18:44:11.348 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.344+0000 7f7019316700 1 -- 172.21.15.26:0/1022036404 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7014045ad0 con 0x7f70140f5ef0 2021-11-03T18:44:11.348 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.345+0000 7f700b7fe700 1 -- 172.21.15.26:0/1022036404 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f6ffc010070 con 0x7f70140f5ef0 2021-11-03T18:44:11.349 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.345+0000 7f700b7fe700 1 --2- 172.21.15.26:0/1022036404 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f70000640b0 0x7f7000066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:44:11.349 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.345+0000 7f700b7fe700 1 -- 172.21.15.26:0/1022036404 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f6ffc080660 con 0x7f70140f5ef0 2021-11-03T18:44:11.349 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.345+0000 7f7012ffd700 1 --2- 172.21.15.26:0/1022036404 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f70000640b0 0x7f7000066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:44:11.349 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.345+0000 7f7012ffd700 1 --2- 172.21.15.26:0/1022036404 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f70000640b0 0x7f7000066570 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7f7004004630 tx=0x7f7004009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:44:11.349 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.349+0000 7f700b7fe700 1 -- 172.21.15.26:0/1022036404 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f6ffc0528d0 con 0x7f70140f5ef0 2021-11-03T18:44:11.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:11 smithi026 ceph-mon[96795]: pgmap v3285: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:11.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:11 smithi194 ceph-mon[65619]: pgmap v3285: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:11.523 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.525+0000 7f7019316700 1 -- 172.21.15.26:0/1022036404 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f701405fe30 con 0x7f70000640b0 2021-11-03T18:44:11.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.527+0000 7f700b7fe700 1 -- 172.21.15.26:0/1022036404 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f701405fe30 con 0x7f70000640b0 2021-11-03T18:44:11.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.529+0000 7f7019316700 1 -- 172.21.15.26:0/1022036404 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f70000640b0 msgr2=0x7f7000066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:44:11.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.529+0000 7f7019316700 1 --2- 172.21.15.26:0/1022036404 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f70000640b0 0x7f7000066570 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7f7004004630 tx=0x7f7004009b30).stop 2021-11-03T18:44:11.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.529+0000 7f7019316700 1 -- 172.21.15.26:0/1022036404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70140f5ef0 msgr2=0x7f7014107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:44:11.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.529+0000 7f7019316700 1 --2- 172.21.15.26:0/1022036404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70140f5ef0 0x7f7014107460 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 rx=0x7f6ffc00c530 tx=0x7f6ffc007e20).stop 2021-11-03T18:44:11.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.529+0000 7f7019316700 1 -- 172.21.15.26:0/1022036404 shutdown_connections 2021-11-03T18:44:11.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.529+0000 7f7019316700 1 --2- 172.21.15.26:0/1022036404 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f70000640b0 0x7f7000066570 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:11.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.529+0000 7f7019316700 1 --2- 172.21.15.26:0/1022036404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70140f55e0 0x7f7014106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:11.528 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.529+0000 7f7019316700 1 --2- 172.21.15.26:0/1022036404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70140f5ef0 0x7f7014107460 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:11.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.529+0000 7f7019316700 1 -- 172.21.15.26:0/1022036404 >> 172.21.15.26:0/1022036404 conn(0x7f70140f0de0 msgr2=0x7f701405f720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:44:11.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.529+0000 7f7019316700 1 -- 172.21.15.26:0/1022036404 shutdown_connections 2021-11-03T18:44:11.529 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.529+0000 7f7019316700 1 -- 172.21.15.26:0/1022036404 wait complete. 2021-11-03T18:44:11.537 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:44:11.627 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.629+0000 7f90297ef700 1 -- 172.21.15.26:0/834805045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90240f66c0 msgr2=0x7f90240f6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:44:11.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.629+0000 7f90297ef700 1 --2- 172.21.15.26:0/834805045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90240f66c0 0x7f90240f6ae0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 rx=0x7f9014004660 tx=0x7f9014009b30).stop 2021-11-03T18:44:11.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.629+0000 7f90297ef700 1 -- 172.21.15.26:0/834805045 shutdown_connections 2021-11-03T18:44:11.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.629+0000 7f90297ef700 1 --2- 172.21.15.26:0/834805045 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90240f7960 0x7f90240f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:11.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.629+0000 7f90297ef700 1 --2- 172.21.15.26:0/834805045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90240f66c0 0x7f90240f6ae0 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:11.628 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.629+0000 7f90297ef700 1 -- 172.21.15.26:0/834805045 >> 172.21.15.26:0/834805045 conn(0x7f90240f1e20 msgr2=0x7f90240f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:44:11.639 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.629+0000 7f90297ef700 1 -- 172.21.15.26:0/834805045 shutdown_connections 2021-11-03T18:44:11.640 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.629+0000 7f90297ef700 1 -- 172.21.15.26:0/834805045 wait complete. 2021-11-03T18:44:11.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.630+0000 7f90297ef700 1 Processor -- start 2021-11-03T18:44:11.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.630+0000 7f90297ef700 1 -- start start 2021-11-03T18:44:11.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.630+0000 7f90297ef700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90240f66c0 0x7f902406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:44:11.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.630+0000 7f90297ef700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90240f7960 0x7f9024069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:44:11.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.630+0000 7f90297ef700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902406a380 con 0x7f90240f66c0 2021-11-03T18:44:11.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.630+0000 7f90297ef700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902406a4c0 con 0x7f90240f7960 2021-11-03T18:44:11.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.630+0000 7f9022ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90240f66c0 0x7f902406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:44:11.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.630+0000 7f9022ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90240f66c0 0x7f902406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33474/0 (socket says 172.21.15.26:33474) 2021-11-03T18:44:11.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.630+0000 7f9022ffd700 1 -- 172.21.15.26:0/2570143461 learned_addr learned my addr 172.21.15.26:0/2570143461 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:44:11.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.630+0000 7f90227fc700 1 --2- 172.21.15.26:0/2570143461 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90240f7960 0x7f9024069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:44:11.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.630+0000 7f9022ffd700 1 -- 172.21.15.26:0/2570143461 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90240f7960 msgr2=0x7f9024069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:44:11.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.630+0000 7f9022ffd700 1 --2- 172.21.15.26:0/2570143461 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90240f7960 0x7f9024069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:11.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.630+0000 7f9022ffd700 1 -- 172.21.15.26:0/2570143461 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9014005040 con 0x7f90240f66c0 2021-11-03T18:44:11.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.630+0000 7f9022ffd700 1 --2- 172.21.15.26:0/2570143461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90240f66c0 0x7f902406b9a0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 rx=0x7f9014013a70 tx=0x7f9014009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:44:11.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.631+0000 7f900b7fe700 1 -- 172.21.15.26:0/2570143461 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9014018070 con 0x7f90240f66c0 2021-11-03T18:44:11.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.631+0000 7f900b7fe700 1 -- 172.21.15.26:0/2570143461 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f90140097d0 con 0x7f90240f66c0 2021-11-03T18:44:11.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.631+0000 7f90297ef700 1 -- 172.21.15.26:0/2570143461 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f902406a740 con 0x7f90240f66c0 2021-11-03T18:44:11.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.631+0000 7f900b7fe700 1 -- 172.21.15.26:0/2570143461 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f901401de80 con 0x7f90240f66c0 2021-11-03T18:44:11.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.631+0000 7f90297ef700 1 -- 172.21.15.26:0/2570143461 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f902406aca0 con 0x7f90240f66c0 2021-11-03T18:44:11.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.632+0000 7f90297ef700 1 -- 172.21.15.26:0/2570143461 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9024045ad0 con 0x7f90240f66c0 2021-11-03T18:44:11.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.632+0000 7f900b7fe700 1 -- 172.21.15.26:0/2570143461 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f9014007ba0 con 0x7f90240f66c0 2021-11-03T18:44:11.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.632+0000 7f900b7fe700 1 --2- 172.21.15.26:0/2570143461 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f900c0640b0 0x7f900c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:44:11.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.633+0000 7f900b7fe700 1 -- 172.21.15.26:0/2570143461 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f9014082300 con 0x7f90240f66c0 2021-11-03T18:44:11.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.633+0000 7f90227fc700 1 --2- 172.21.15.26:0/2570143461 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f900c0640b0 0x7f900c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:44:11.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.633+0000 7f90227fc700 1 --2- 172.21.15.26:0/2570143461 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f900c0640b0 0x7f900c066570 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7f9018004e20 tx=0x7f901800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:44:11.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.637+0000 7f900b7fe700 1 -- 172.21.15.26:0/2570143461 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f9014054720 con 0x7f90240f66c0 2021-11-03T18:44:11.805 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.807+0000 7f90297ef700 1 -- 172.21.15.26:0/2570143461 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f90240fefc0 con 0x7f900c0640b0 2021-11-03T18:44:11.820 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.822+0000 7f900b7fe700 1 -- 172.21.15.26:0/2570143461 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7f90240fefc0 con 0x7f900c0640b0 2021-11-03T18:44:11.821 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:44:11.821 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (115m) 3m ago 116m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:44:11.821 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (107m) 3m ago 116m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:44:11.821 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (107m) 2m ago 115m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:44:11.822 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (115m) 3m ago 116m 42.4M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:44:11.822 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (108m) 3m ago 111m 26.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:44:11.822 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (108m) 3m ago 111m 27.0M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:44:11.822 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (111m) 2m ago 111m 27.2M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:44:11.823 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (111m) 2m ago 111m 27.6M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:44:11.823 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (109m) 3m ago 118m 615M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:44:11.823 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (108m) 2m ago 115m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:44:11.823 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (108m) 3m ago 118m 407M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:44:11.824 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (108m) 2m ago 115m 187M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:44:11.824 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (116m) 3m ago 116m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:44:11.824 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (115m) 2m ago 115m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:44:11.824 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (107m) 3m ago 115m 372M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:44:11.824 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (106m) 3m ago 114m 400M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:44:11.825 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (106m) 3m ago 114m 332M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:44:11.826 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (105m) 2m ago 114m 438M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:44:11.826 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (105m) 2m ago 113m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:44:11.826 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (104m) 2m ago 113m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:44:11.827 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (115m) 3m ago 116m 70.2M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:44:11.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.824+0000 7f90297ef700 1 -- 172.21.15.26:0/2570143461 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f900c0640b0 msgr2=0x7f900c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:44:11.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.824+0000 7f90297ef700 1 --2- 172.21.15.26:0/2570143461 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f900c0640b0 0x7f900c066570 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7f9018004e20 tx=0x7f901800b040).stop 2021-11-03T18:44:11.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.824+0000 7f90297ef700 1 -- 172.21.15.26:0/2570143461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90240f66c0 msgr2=0x7f902406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:44:11.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.824+0000 7f90297ef700 1 --2- 172.21.15.26:0/2570143461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90240f66c0 0x7f902406b9a0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 rx=0x7f9014013a70 tx=0x7f9014009b30).stop 2021-11-03T18:44:11.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.824+0000 7f90297ef700 1 -- 172.21.15.26:0/2570143461 shutdown_connections 2021-11-03T18:44:11.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.824+0000 7f90297ef700 1 --2- 172.21.15.26:0/2570143461 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f900c0640b0 0x7f900c066570 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:11.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.824+0000 7f90297ef700 1 --2- 172.21.15.26:0/2570143461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90240f66c0 0x7f902406b9a0 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:11.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.824+0000 7f90297ef700 1 --2- 172.21.15.26:0/2570143461 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90240f7960 0x7f9024069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:11.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.824+0000 7f90297ef700 1 -- 172.21.15.26:0/2570143461 >> 172.21.15.26:0/2570143461 conn(0x7f90240f1e20 msgr2=0x7f90240fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:44:11.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.824+0000 7f90297ef700 1 -- 172.21.15.26:0/2570143461 shutdown_connections 2021-11-03T18:44:11.830 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.824+0000 7f90297ef700 1 -- 172.21.15.26:0/2570143461 wait complete. 2021-11-03T18:44:11.934 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.923+0000 7fb1d4f50700 1 -- 172.21.15.26:0/2758702496 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1d00f7980 msgr2=0x7fb1d00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:44:11.934 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.923+0000 7fb1d4f50700 1 --2- 172.21.15.26:0/2758702496 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1d00f7980 0x7fb1d00f7de0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 rx=0x7fb1b8004660 tx=0x7fb1b8009b30).stop 2021-11-03T18:44:11.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.923+0000 7fb1d4f50700 1 -- 172.21.15.26:0/2758702496 shutdown_connections 2021-11-03T18:44:11.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.923+0000 7fb1d4f50700 1 --2- 172.21.15.26:0/2758702496 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1d00f7980 0x7fb1d00f7de0 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:11.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.923+0000 7fb1d4f50700 1 --2- 172.21.15.26:0/2758702496 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1d00f66e0 0x7fb1d00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:11.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.923+0000 7fb1d4f50700 1 -- 172.21.15.26:0/2758702496 >> 172.21.15.26:0/2758702496 conn(0x7fb1d00f1e40 msgr2=0x7fb1d00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:44:11.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.923+0000 7fb1d4f50700 1 -- 172.21.15.26:0/2758702496 shutdown_connections 2021-11-03T18:44:11.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.923+0000 7fb1d4f50700 1 -- 172.21.15.26:0/2758702496 wait complete. 2021-11-03T18:44:11.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.924+0000 7fb1d4f50700 1 Processor -- start 2021-11-03T18:44:11.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.924+0000 7fb1d4f50700 1 -- start start 2021-11-03T18:44:11.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.924+0000 7fb1d4f50700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1d00f66e0 0x7fb1d0106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:44:11.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.924+0000 7fb1d4f50700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1d00f7980 0x7fb1d0107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:44:11.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.924+0000 7fb1d4f50700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d0107a00 con 0x7fb1d00f66e0 2021-11-03T18:44:11.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.924+0000 7fb1d4f50700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d0107b40 con 0x7fb1d00f7980 2021-11-03T18:44:11.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.924+0000 7fb1ce59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1d00f66e0 0x7fb1d0106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:44:11.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.924+0000 7fb1ce59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1d00f66e0 0x7fb1d0106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33484/0 (socket says 172.21.15.26:33484) 2021-11-03T18:44:11.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.924+0000 7fb1ce59c700 1 -- 172.21.15.26:0/2668826022 learned_addr learned my addr 172.21.15.26:0/2668826022 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:44:11.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.924+0000 7fb1cdd9b700 1 --2- 172.21.15.26:0/2668826022 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1d00f7980 0x7fb1d0107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:44:11.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.924+0000 7fb1ce59c700 1 -- 172.21.15.26:0/2668826022 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1d00f7980 msgr2=0x7fb1d0107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:44:11.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.924+0000 7fb1ce59c700 1 --2- 172.21.15.26:0/2668826022 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1d00f7980 0x7fb1d0107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:11.943 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.924+0000 7fb1ce59c700 1 -- 172.21.15.26:0/2668826022 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b8005040 con 0x7fb1d00f66e0 2021-11-03T18:44:11.943 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.924+0000 7fb1ce59c700 1 --2- 172.21.15.26:0/2668826022 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1d00f66e0 0x7fb1d0106f60 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 rx=0x7fb1c800c710 tx=0x7fb1c8004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:44:11.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.924+0000 7fb1c6ffd700 1 -- 172.21.15.26:0/2668826022 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1c80106f0 con 0x7fb1d00f66e0 2021-11-03T18:44:11.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.925+0000 7fb1c6ffd700 1 -- 172.21.15.26:0/2668826022 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb1c8010d00 con 0x7fb1d00f66e0 2021-11-03T18:44:11.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.925+0000 7fb1c6ffd700 1 -- 172.21.15.26:0/2668826022 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1c8012d90 con 0x7fb1d00f66e0 2021-11-03T18:44:11.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.925+0000 7fb1d4f50700 1 -- 172.21.15.26:0/2668826022 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d01084e0 con 0x7fb1d00f66e0 2021-11-03T18:44:11.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.925+0000 7fb1d4f50700 1 -- 172.21.15.26:0/2668826022 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d0108a50 con 0x7fb1d00f66e0 2021-11-03T18:44:11.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.925+0000 7fb1d4f50700 1 -- 172.21.15.26:0/2668826022 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1d0045ad0 con 0x7fb1d00f66e0 2021-11-03T18:44:11.946 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.926+0000 7fb1c6ffd700 1 -- 172.21.15.26:0/2668826022 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fb1c8010070 con 0x7fb1d00f66e0 2021-11-03T18:44:11.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.926+0000 7fb1c6ffd700 1 --2- 172.21.15.26:0/2668826022 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb1bc0640b0 0x7fb1bc066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:44:11.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.926+0000 7fb1c6ffd700 1 -- 172.21.15.26:0/2668826022 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fb1c8080e10 con 0x7fb1d00f66e0 2021-11-03T18:44:11.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.926+0000 7fb1cdd9b700 1 --2- 172.21.15.26:0/2668826022 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb1bc0640b0 0x7fb1bc066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:44:11.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.927+0000 7fb1cdd9b700 1 --2- 172.21.15.26:0/2668826022 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb1bc0640b0 0x7fb1bc066570 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7fb1b8004e30 tx=0x7fb1b8009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:44:11.949 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:11.930+0000 7fb1c6ffd700 1 -- 172.21.15.26:0/2668826022 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fb1c8053140 con 0x7fb1d00f66e0 2021-11-03T18:44:12.157 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.159+0000 7fb1d4f50700 1 -- 172.21.15.26:0/2668826022 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb1d00ff020 con 0x7fb1d00f66e0 2021-11-03T18:44:12.158 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.159+0000 7fb1c6ffd700 1 -- 172.21.15.26:0/2668826022 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fb1c8052d30 con 0x7fb1d00f66e0 2021-11-03T18:44:12.158 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:44:12.158 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:44:12.159 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:44:12.159 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:44:12.159 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:44:12.159 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:44:12.159 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:44:12.160 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:44:12.160 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:44:12.160 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:44:12.160 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:44:12.161 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:44:12.161 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:44:12.161 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:44:12.161 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:44:12.162 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:44:12.162 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:44:12.162 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:44:12.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.161+0000 7fb1d4f50700 1 -- 172.21.15.26:0/2668826022 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb1bc0640b0 msgr2=0x7fb1bc066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:44:12.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.161+0000 7fb1d4f50700 1 --2- 172.21.15.26:0/2668826022 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb1bc0640b0 0x7fb1bc066570 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7fb1b8004e30 tx=0x7fb1b8009b30).stop 2021-11-03T18:44:12.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.161+0000 7fb1d4f50700 1 -- 172.21.15.26:0/2668826022 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1d00f66e0 msgr2=0x7fb1d0106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:44:12.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.161+0000 7fb1d4f50700 1 --2- 172.21.15.26:0/2668826022 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1d00f66e0 0x7fb1d0106f60 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 rx=0x7fb1c800c710 tx=0x7fb1c8004d10).stop 2021-11-03T18:44:12.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.161+0000 7fb1d4f50700 1 -- 172.21.15.26:0/2668826022 shutdown_connections 2021-11-03T18:44:12.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.161+0000 7fb1d4f50700 1 --2- 172.21.15.26:0/2668826022 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb1bc0640b0 0x7fb1bc066570 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:12.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.161+0000 7fb1d4f50700 1 --2- 172.21.15.26:0/2668826022 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1d00f66e0 0x7fb1d0106f60 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:12.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.161+0000 7fb1d4f50700 1 --2- 172.21.15.26:0/2668826022 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1d00f7980 0x7fb1d0107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:12.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.161+0000 7fb1d4f50700 1 -- 172.21.15.26:0/2668826022 >> 172.21.15.26:0/2668826022 conn(0x7fb1d00f1e40 msgr2=0x7fb1d00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:44:12.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.161+0000 7fb1d4f50700 1 -- 172.21.15.26:0/2668826022 shutdown_connections 2021-11-03T18:44:12.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.161+0000 7fb1d4f50700 1 -- 172.21.15.26:0/2668826022 wait complete. 2021-11-03T18:44:12.261 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.261+0000 7f6c80bc3700 1 -- 172.21.15.26:0/2071070621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c7c0f49a0 msgr2=0x7f6c7c0f4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:44:12.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.261+0000 7f6c80bc3700 1 --2- 172.21.15.26:0/2071070621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c7c0f49a0 0x7f6c7c0f4dc0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 rx=0x7f6c6c004660 tx=0x7f6c6c009b30).stop 2021-11-03T18:44:12.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.262+0000 7f6c80bc3700 1 -- 172.21.15.26:0/2071070621 shutdown_connections 2021-11-03T18:44:12.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.262+0000 7f6c80bc3700 1 --2- 172.21.15.26:0/2071070621 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c7c0f5340 0x7f6c7c0f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:12.262 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.262+0000 7f6c80bc3700 1 --2- 172.21.15.26:0/2071070621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c7c0f49a0 0x7f6c7c0f4dc0 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:12.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.262+0000 7f6c80bc3700 1 -- 172.21.15.26:0/2071070621 >> 172.21.15.26:0/2071070621 conn(0x7f6c7c0f04c0 msgr2=0x7f6c7c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:44:12.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.262+0000 7f6c80bc3700 1 -- 172.21.15.26:0/2071070621 shutdown_connections 2021-11-03T18:44:12.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.262+0000 7f6c80bc3700 1 -- 172.21.15.26:0/2071070621 wait complete. 2021-11-03T18:44:12.263 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.262+0000 7f6c80bc3700 1 Processor -- start 2021-11-03T18:44:12.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.262+0000 7f6c80bc3700 1 -- start start 2021-11-03T18:44:12.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.262+0000 7f6c80bc3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c7c0f49a0 0x7f6c7c106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:44:12.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.262+0000 7f6c80bc3700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c7c0f5340 0x7f6c7c1074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:44:12.264 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.262+0000 7f6c80bc3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c107a50 con 0x7f6c7c0f49a0 2021-11-03T18:44:12.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.262+0000 7f6c80bc3700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c107b90 con 0x7f6c7c0f5340 2021-11-03T18:44:12.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.262+0000 7f6c7a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c7c0f49a0 0x7f6c7c106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:44:12.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.262+0000 7f6c7a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c7c0f49a0 0x7f6c7c106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33492/0 (socket says 172.21.15.26:33492) 2021-11-03T18:44:12.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.262+0000 7f6c7a59c700 1 -- 172.21.15.26:0/2512859244 learned_addr learned my addr 172.21.15.26:0/2512859244 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:44:12.265 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.262+0000 7f6c79d9b700 1 --2- 172.21.15.26:0/2512859244 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c7c0f5340 0x7f6c7c1074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:44:12.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.263+0000 7f6c7a59c700 1 -- 172.21.15.26:0/2512859244 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c7c0f5340 msgr2=0x7f6c7c1074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:44:12.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.263+0000 7f6c7a59c700 1 --2- 172.21.15.26:0/2512859244 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c7c0f5340 0x7f6c7c1074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:12.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.263+0000 7f6c7a59c700 1 -- 172.21.15.26:0/2512859244 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c6c005040 con 0x7f6c7c0f49a0 2021-11-03T18:44:12.266 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.263+0000 7f6c7a59c700 1 --2- 172.21.15.26:0/2512859244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c7c0f49a0 0x7f6c7c106fb0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 rx=0x7f6c6c013a70 tx=0x7f6c6c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:44:12.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.263+0000 7f6c6affd700 1 -- 172.21.15.26:0/2512859244 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c6c018070 con 0x7f6c7c0f49a0 2021-11-03T18:44:12.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.263+0000 7f6c6affd700 1 -- 172.21.15.26:0/2512859244 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6c6c0097d0 con 0x7f6c7c0f49a0 2021-11-03T18:44:12.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.263+0000 7f6c80bc3700 1 -- 172.21.15.26:0/2512859244 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c7c1084d0 con 0x7f6c7c0f49a0 2021-11-03T18:44:12.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.263+0000 7f6c80bc3700 1 -- 172.21.15.26:0/2512859244 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c7c108a30 con 0x7f6c7c0f49a0 2021-11-03T18:44:12.267 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.263+0000 7f6c6affd700 1 -- 172.21.15.26:0/2512859244 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c6c01de80 con 0x7f6c7c0f49a0 2021-11-03T18:44:12.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.264+0000 7f6c80bc3700 1 -- 172.21.15.26:0/2512859244 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c7c045ad0 con 0x7f6c7c0f49a0 2021-11-03T18:44:12.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.265+0000 7f6c6affd700 1 -- 172.21.15.26:0/2512859244 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f6c6c007ba0 con 0x7f6c7c0f49a0 2021-11-03T18:44:12.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.265+0000 7f6c6affd700 1 --2- 172.21.15.26:0/2512859244 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6c640640b0 0x7f6c64066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:44:12.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.265+0000 7f6c6affd700 1 -- 172.21.15.26:0/2512859244 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f6c6c0824b0 con 0x7f6c7c0f49a0 2021-11-03T18:44:12.270 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.265+0000 7f6c79d9b700 1 --2- 172.21.15.26:0/2512859244 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6c640640b0 0x7f6c64066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:44:12.270 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.265+0000 7f6c79d9b700 1 --2- 172.21.15.26:0/2512859244 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6c640640b0 0x7f6c64066570 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7f6c7c0f5780 tx=0x7f6c7000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:44:12.270 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.269+0000 7f6c6affd700 1 -- 172.21.15.26:0/2512859244 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f6c6c0548d0 con 0x7f6c7c0f49a0 2021-11-03T18:44:12.473 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.474+0000 7f6c80bc3700 1 -- 172.21.15.26:0/2512859244 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6c7c0ff060 con 0x7f6c7c0f49a0 2021-11-03T18:44:12.473 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.475+0000 7f6c6affd700 1 -- 172.21.15.26:0/2512859244 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f6c6c0544c0 con 0x7f6c7c0f49a0 2021-11-03T18:44:12.474 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:44:12.474 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:44:12.474 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:44:12.474 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:44:12.475 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:44:12.475 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:44:12.475 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:44:12.475 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:44:12.475 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:44:12.476 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:44:12.476 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:44:12.476 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:44:12.476 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:44:12.476 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:44:12.477 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:44:12.477 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:44:12.477 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:44:12.477 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:44:12.477 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:44:12.478 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:44:12.478 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:44:12.478 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:44:12.478 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:44:12.479 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:44:12.479 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:44:12.479 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:44:12.479 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:44:12.479 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:44:12.480 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:44:12.480 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:44:12.480 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:44:12.480 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:44:12.481 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:44:12.481 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:44:12.481 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:44:12.481 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:44:12.481 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:44:12.482 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:44:12.482 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:44:12.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.477+0000 7f6c80bc3700 1 -- 172.21.15.26:0/2512859244 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6c640640b0 msgr2=0x7f6c64066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:44:12.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.477+0000 7f6c80bc3700 1 --2- 172.21.15.26:0/2512859244 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6c640640b0 0x7f6c64066570 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7f6c7c0f5780 tx=0x7f6c7000b040).stop 2021-11-03T18:44:12.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.477+0000 7f6c80bc3700 1 -- 172.21.15.26:0/2512859244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c7c0f49a0 msgr2=0x7f6c7c106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:44:12.483 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.477+0000 7f6c80bc3700 1 --2- 172.21.15.26:0/2512859244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c7c0f49a0 0x7f6c7c106fb0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 rx=0x7f6c6c013a70 tx=0x7f6c6c009b30).stop 2021-11-03T18:44:12.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.477+0000 7f6c80bc3700 1 -- 172.21.15.26:0/2512859244 shutdown_connections 2021-11-03T18:44:12.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.477+0000 7f6c80bc3700 1 --2- 172.21.15.26:0/2512859244 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6c640640b0 0x7f6c64066570 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:12.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.477+0000 7f6c80bc3700 1 --2- 172.21.15.26:0/2512859244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c7c0f49a0 0x7f6c7c106fb0 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:12.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.477+0000 7f6c80bc3700 1 --2- 172.21.15.26:0/2512859244 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c7c0f5340 0x7f6c7c1074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:12.484 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.477+0000 7f6c80bc3700 1 -- 172.21.15.26:0/2512859244 >> 172.21.15.26:0/2512859244 conn(0x7f6c7c0f04c0 msgr2=0x7f6c7c0fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:44:12.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.477+0000 7f6c80bc3700 1 -- 172.21.15.26:0/2512859244 shutdown_connections 2021-11-03T18:44:12.485 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:12.477+0000 7f6c80bc3700 1 -- 172.21.15.26:0/2512859244 wait complete. 2021-11-03T18:44:12.485 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:44:12.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:12 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2668826022' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:44:12.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:12 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2668826022' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:44:13.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:13 smithi194 ceph-mon[65619]: from='client.37516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:44:13.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:13 smithi194 ceph-mon[65619]: from='client.37520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:44:13.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:13 smithi194 ceph-mon[65619]: pgmap v3286: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:13.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:13 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2512859244' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:44:13.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:13 smithi026 ceph-mon[96795]: from='client.37516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:44:13.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:13 smithi026 ceph-mon[96795]: from='client.37520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:44:13.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:13 smithi026 ceph-mon[96795]: pgmap v3286: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:13.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:13 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2512859244' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:44:15.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:15 smithi194 ceph-mon[65619]: pgmap v3287: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:15.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:15 smithi026 ceph-mon[96795]: pgmap v3287: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:17.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:17 smithi194 ceph-mon[65619]: pgmap v3288: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:17.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:17 smithi026 ceph-mon[96795]: pgmap v3288: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:19.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:19 smithi194 ceph-mon[65619]: pgmap v3289: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:19.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:19 smithi026 ceph-mon[96795]: pgmap v3289: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:21.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:21 smithi026 ceph-mon[96795]: pgmap v3290: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:21.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:21 smithi194 ceph-mon[65619]: pgmap v3290: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:22.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:22 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:44:22.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:22 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:44:23.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:23 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:44:23.476 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:23 smithi026 ceph-mon[96795]: pgmap v3291: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:23.477 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:23 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:44:23.478 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:23 smithi194 ceph-mon[65619]: pgmap v3291: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:25.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:25 smithi194 ceph-mon[65619]: pgmap v3292: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:25.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:25 smithi026 ceph-mon[96795]: pgmap v3292: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:27.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:27 smithi194 ceph-mon[65619]: pgmap v3293: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:27.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:27 smithi026 ceph-mon[96795]: pgmap v3293: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:29.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:29 smithi194 ceph-mon[65619]: pgmap v3294: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:29.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:29 smithi026 ceph-mon[96795]: pgmap v3294: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:31.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:31 smithi026 ceph-mon[96795]: pgmap v3295: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:31.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:31 smithi194 ceph-mon[65619]: pgmap v3295: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:33.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:33 smithi194 ceph-mon[65619]: pgmap v3296: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:33.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:33 smithi026 ceph-mon[96795]: pgmap v3296: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:35.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:35 smithi194 ceph-mon[65619]: pgmap v3297: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:35.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:35 smithi026 ceph-mon[96795]: pgmap v3297: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:37.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:37 smithi194 ceph-mon[65619]: pgmap v3298: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:37.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:37 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:44:37.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:37 smithi026 ceph-mon[96795]: pgmap v3298: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:37.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:37 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:44:38.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:38 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:44:38.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:38 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:44:39.505 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:39 smithi194 ceph-mon[65619]: pgmap v3299: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:39.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:39 smithi026 ceph-mon[96795]: pgmap v3299: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:41.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:41 smithi026 ceph-mon[96795]: pgmap v3300: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:41.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:41 smithi194 ceph-mon[65619]: pgmap v3300: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:42.591 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.590+0000 7fdb83dc6700 1 -- 172.21.15.26:0/3912795720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb7c0f66e0 msgr2=0x7fdb7c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:44:42.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.590+0000 7fdb83dc6700 1 --2- 172.21.15.26:0/3912795720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb7c0f66e0 0x7fdb7c0f6b00 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 rx=0x7fdb78004660 tx=0x7fdb78009b30).stop 2021-11-03T18:44:42.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.590+0000 7fdb83dc6700 1 -- 172.21.15.26:0/3912795720 shutdown_connections 2021-11-03T18:44:42.592 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.590+0000 7fdb83dc6700 1 --2- 172.21.15.26:0/3912795720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb7c0f7980 0x7fdb7c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:42.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.590+0000 7fdb83dc6700 1 --2- 172.21.15.26:0/3912795720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb7c0f66e0 0x7fdb7c0f6b00 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:42.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.590+0000 7fdb83dc6700 1 -- 172.21.15.26:0/3912795720 >> 172.21.15.26:0/3912795720 conn(0x7fdb7c0f1e40 msgr2=0x7fdb7c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:44:42.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.590+0000 7fdb83dc6700 1 -- 172.21.15.26:0/3912795720 shutdown_connections 2021-11-03T18:44:42.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.590+0000 7fdb83dc6700 1 -- 172.21.15.26:0/3912795720 wait complete. 2021-11-03T18:44:42.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.591+0000 7fdb83dc6700 1 Processor -- start 2021-11-03T18:44:42.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.591+0000 7fdb83dc6700 1 -- start start 2021-11-03T18:44:42.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.591+0000 7fdb83dc6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb7c0f66e0 0x7fdb7c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:44:42.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.591+0000 7fdb83dc6700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb7c0f7980 0x7fdb7c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:44:42.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.591+0000 7fdb83dc6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c10ac40 con 0x7fdb7c0f66e0 2021-11-03T18:44:42.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.591+0000 7fdb83dc6700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c10ad80 con 0x7fdb7c0f7980 2021-11-03T18:44:42.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.591+0000 7fdb81b62700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb7c0f66e0 0x7fdb7c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:44:42.596 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.591+0000 7fdb81b62700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb7c0f66e0 0x7fdb7c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33510/0 (socket says 172.21.15.26:33510) 2021-11-03T18:44:42.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.591+0000 7fdb81b62700 1 -- 172.21.15.26:0/296124683 learned_addr learned my addr 172.21.15.26:0/296124683 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:44:42.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.591+0000 7fdb81361700 1 --2- 172.21.15.26:0/296124683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb7c0f7980 0x7fdb7c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:44:42.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.591+0000 7fdb81b62700 1 -- 172.21.15.26:0/296124683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb7c0f7980 msgr2=0x7fdb7c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:44:42.597 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.591+0000 7fdb81b62700 1 --2- 172.21.15.26:0/296124683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb7c0f7980 0x7fdb7c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:42.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.591+0000 7fdb81b62700 1 -- 172.21.15.26:0/296124683 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb78005040 con 0x7fdb7c0f66e0 2021-11-03T18:44:42.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.591+0000 7fdb81361700 1 --2- 172.21.15.26:0/296124683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb7c0f7980 0x7fdb7c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:44:42.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.592+0000 7fdb81b62700 1 --2- 172.21.15.26:0/296124683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb7c0f66e0 0x7fdb7c06b9a0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 rx=0x7fdb78004f60 tx=0x7fdb78009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:44:42.598 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.592+0000 7fdb6e7fc700 1 -- 172.21.15.26:0/296124683 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb78018070 con 0x7fdb7c0f66e0 2021-11-03T18:44:42.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.592+0000 7fdb6e7fc700 1 -- 172.21.15.26:0/296124683 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdb78007ba0 con 0x7fdb7c0f66e0 2021-11-03T18:44:42.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.592+0000 7fdb83dc6700 1 -- 172.21.15.26:0/296124683 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb7c06a370 con 0x7fdb7c0f66e0 2021-11-03T18:44:42.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.592+0000 7fdb6e7fc700 1 -- 172.21.15.26:0/296124683 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb7801c620 con 0x7fdb7c0f66e0 2021-11-03T18:44:42.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.592+0000 7fdb83dc6700 1 -- 172.21.15.26:0/296124683 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb7c06a8d0 con 0x7fdb7c0f66e0 2021-11-03T18:44:42.601 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.593+0000 7fdb83dc6700 1 -- 172.21.15.26:0/296124683 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb7c045ad0 con 0x7fdb7c0f66e0 2021-11-03T18:44:42.601 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.593+0000 7fdb6e7fc700 1 -- 172.21.15.26:0/296124683 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fdb7801d420 con 0x7fdb7c0f66e0 2021-11-03T18:44:42.601 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.594+0000 7fdb6e7fc700 1 --2- 172.21.15.26:0/296124683 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdb680640b0 0x7fdb68066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:44:42.601 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.594+0000 7fdb81361700 1 --2- 172.21.15.26:0/296124683 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdb680640b0 0x7fdb68066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:44:42.602 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.594+0000 7fdb6e7fc700 1 -- 172.21.15.26:0/296124683 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fdb78082610 con 0x7fdb7c0f66e0 2021-11-03T18:44:42.602 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.594+0000 7fdb81361700 1 --2- 172.21.15.26:0/296124683 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdb680640b0 0x7fdb68066570 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7fdb700041d0 tx=0x7fdb70009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:44:42.602 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.598+0000 7fdb6e7fc700 1 -- 172.21.15.26:0/296124683 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fdb78054a30 con 0x7fdb7c0f66e0 2021-11-03T18:44:42.774 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.775+0000 7fdb83dc6700 1 -- 172.21.15.26:0/296124683 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdb7c06ab40 con 0x7fdb680640b0 2021-11-03T18:44:42.775 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.776+0000 7fdb6e7fc700 1 -- 172.21.15.26:0/296124683 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fdb7c06ab40 con 0x7fdb680640b0 2021-11-03T18:44:42.777 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.778+0000 7fdb83dc6700 1 -- 172.21.15.26:0/296124683 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdb680640b0 msgr2=0x7fdb68066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:44:42.778 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.778+0000 7fdb83dc6700 1 --2- 172.21.15.26:0/296124683 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdb680640b0 0x7fdb68066570 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7fdb700041d0 tx=0x7fdb70009040).stop 2021-11-03T18:44:42.778 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.778+0000 7fdb83dc6700 1 -- 172.21.15.26:0/296124683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb7c0f66e0 msgr2=0x7fdb7c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:44:42.778 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.778+0000 7fdb83dc6700 1 --2- 172.21.15.26:0/296124683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb7c0f66e0 0x7fdb7c06b9a0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 rx=0x7fdb78004f60 tx=0x7fdb78009b30).stop 2021-11-03T18:44:42.778 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.778+0000 7fdb83dc6700 1 -- 172.21.15.26:0/296124683 shutdown_connections 2021-11-03T18:44:42.778 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.778+0000 7fdb83dc6700 1 --2- 172.21.15.26:0/296124683 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdb680640b0 0x7fdb68066570 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:42.779 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.778+0000 7fdb83dc6700 1 --2- 172.21.15.26:0/296124683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb7c0f66e0 0x7fdb7c06b9a0 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:42.779 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.778+0000 7fdb83dc6700 1 --2- 172.21.15.26:0/296124683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb7c0f7980 0x7fdb7c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:42.779 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.778+0000 7fdb83dc6700 1 -- 172.21.15.26:0/296124683 >> 172.21.15.26:0/296124683 conn(0x7fdb7c0f1e40 msgr2=0x7fdb7c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:44:42.779 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.778+0000 7fdb83dc6700 1 -- 172.21.15.26:0/296124683 shutdown_connections 2021-11-03T18:44:42.780 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.778+0000 7fdb83dc6700 1 -- 172.21.15.26:0/296124683 wait complete. 2021-11-03T18:44:42.787 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:44:42.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.878+0000 7f54b8247700 1 -- 172.21.15.26:0/2298057259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54b00f5ef0 msgr2=0x7f54b00f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:44:42.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.878+0000 7f54b8247700 1 --2- 172.21.15.26:0/2298057259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54b00f5ef0 0x7f54b00f6920 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 rx=0x7f54a0004660 tx=0x7f54a0009b30).stop 2021-11-03T18:44:42.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.878+0000 7f54b8247700 1 -- 172.21.15.26:0/2298057259 shutdown_connections 2021-11-03T18:44:42.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.878+0000 7f54b8247700 1 --2- 172.21.15.26:0/2298057259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54b00f5ef0 0x7f54b00f6920 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:42.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.878+0000 7f54b8247700 1 --2- 172.21.15.26:0/2298057259 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54b00f55e0 0x7f54b00f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:44:42.879 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.878+0000 7f54b8247700 1 -- 172.21.15.26:0/2298057259 >> 172.21.15.26:0/2298057259 conn(0x7f54b00f0de0 msgr2=0x7f54b00f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:44:42.879 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.878+0000 7f54b8247700 1 -- 172.21.15.26:0/2298057259 shutdown_connections 2021-11-03T18:44:42.879 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.878+0000 7f54b8247700 1 -- 172.21.15.26:0/2298057259 wait complete. 2021-11-03T18:44:42.883 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.879+0000 7f54b8247700 1 Processor -- start 2021-11-03T18:44:42.883 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.879+0000 7f54b8247700 1 -- start start 2021-11-03T18:44:42.883 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.879+0000 7f54b8247700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54b00f55e0 0x7f54b00f97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:44:42.884 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.879+0000 7f54b8247700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54b00f5ef0 0x7f54b00f7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:44:42.884 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.879+0000 7f54b8247700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b00f8250 con 0x7f54b00f55e0 2021-11-03T18:44:42.884 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.879+0000 7f54b8247700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b00f8390 con 0x7f54b00f5ef0 2021-11-03T18:44:42.884 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.879+0000 7f54b5fe3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54b00f55e0 0x7f54b00f97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:44:42.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.879+0000 7f54b5fe3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54b00f55e0 0x7f54b00f97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33520/0 (socket says 172.21.15.26:33520) 2021-11-03T18:44:42.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.879+0000 7f54b5fe3700 1 -- 172.21.15.26:0/3638073837 learned_addr learned my addr 172.21.15.26:0/3638073837 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:44:42.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.879+0000 7f54b57e2700 1 --2- 172.21.15.26:0/3638073837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54b00f5ef0 0x7f54b00f7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:44:42.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.879+0000 7f54b5fe3700 1 -- 172.21.15.26:0/3638073837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54b00f5ef0 msgr2=0x7f54b00f7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:44:42.885 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.879+0000 7f54b5fe3700 1 --2- 172.21.15.26:0/3638073837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54b00f5ef0 0x7f54b00f7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:42.886 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.879+0000 7f54b5fe3700 1 -- 172.21.15.26:0/3638073837 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a0005040 con 0x7f54b00f55e0 2021-11-03T18:44:42.886 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.879+0000 7f54b57e2700 1 --2- 172.21.15.26:0/3638073837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54b00f5ef0 0x7f54b00f7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:44:42.886 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.879+0000 7f54b5fe3700 1 --2- 172.21.15.26:0/3638073837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54b00f55e0 0x7f54b00f97e0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 rx=0x7f54a800b790 tx=0x7f54a80092d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:44:42.886 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.879+0000 7f54a67fc700 1 -- 172.21.15.26:0/3638073837 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54a800d780 con 0x7f54b00f55e0 2021-11-03T18:44:42.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.880+0000 7f54b8247700 1 -- 172.21.15.26:0/3638073837 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b00f8670 con 0x7f54b00f55e0 2021-11-03T18:44:42.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.880+0000 7f54a67fc700 1 -- 172.21.15.26:0/3638073837 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f54a800dd90 con 0x7f54b00f55e0 2021-11-03T18:44:42.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.880+0000 7f54a67fc700 1 -- 172.21.15.26:0/3638073837 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54a800e360 con 0x7f54b00f55e0 2021-11-03T18:44:42.887 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.880+0000 7f54b8247700 1 -- 172.21.15.26:0/3638073837 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b010efd0 con 0x7f54b00f55e0 2021-11-03T18:44:42.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.881+0000 7f54b8247700 1 -- 172.21.15.26:0/3638073837 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54b0045ad0 con 0x7f54b00f55e0 2021-11-03T18:44:42.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.881+0000 7f54a67fc700 1 -- 172.21.15.26:0/3638073837 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f54a800d8e0 con 0x7f54b00f55e0 2021-11-03T18:44:42.888 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.881+0000 7f54a67fc700 1 --2- 172.21.15.26:0/3638073837 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f549c064090 0x7f549c066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:44:42.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.881+0000 7f54a67fc700 1 -- 172.21.15.26:0/3638073837 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f54a8081310 con 0x7f54b00f55e0 2021-11-03T18:44:42.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.881+0000 7f54b57e2700 1 --2- 172.21.15.26:0/3638073837 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f549c064090 0x7f549c066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:44:42.889 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.882+0000 7f54b57e2700 1 --2- 172.21.15.26:0/3638073837 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f549c064090 0x7f549c066550 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7f54a0004e30 tx=0x7f54a0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:44:42.890 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:42.885+0000 7f54a67fc700 1 -- 172.21.15.26:0/3638073837 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f54a8053580 con 0x7f54b00f55e0 2021-11-03T18:44:43.055 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.055+0000 7f54b8247700 1 -- 172.21.15.26:0/3638073837 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f54b00fad60 con 0x7f549c064090 2021-11-03T18:44:43.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.070+0000 7f54a67fc700 1 -- 172.21.15.26:0/3638073837 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7f54b00fad60 con 0x7f549c064090 2021-11-03T18:44:43.070 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:44:43.070 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (115m) 3m ago 117m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:44:43.070 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (108m) 3m ago 117m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:44:43.071 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (108m) 2m ago 116m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:44:43.071 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (115m) 3m ago 116m 42.4M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:44:43.071 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (108m) 3m ago 112m 26.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:44:43.071 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (109m) 3m ago 112m 27.0M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:44:43.071 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (112m) 2m ago 112m 27.2M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:44:43.072 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (112m) 2m ago 112m 27.6M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:44:43.072 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (109m) 3m ago 118m 615M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:44:43.072 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (109m) 2m ago 116m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:44:43.072 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (109m) 3m ago 118m 407M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:44:43.073 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (108m) 2m ago 116m 187M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:44:43.073 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (116m) 3m ago 116m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:44:43.073 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (116m) 2m ago 116m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:44:43.073 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (107m) 3m ago 115m 372M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:44:43.074 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (107m) 3m ago 115m 400M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:44:43.074 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (106m) 3m ago 114m 332M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:44:43.074 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (106m) 2m ago 114m 438M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:44:43.074 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (105m) 2m ago 114m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:44:43.075 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (105m) 2m ago 113m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:44:43.075 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (115m) 3m ago 116m 70.2M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:44:43.076 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.072+0000 7f54b8247700 1 -- 172.21.15.26:0/3638073837 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f549c064090 msgr2=0x7f549c066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:44:43.076 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.072+0000 7f54b8247700 1 --2- 172.21.15.26:0/3638073837 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f549c064090 0x7f549c066550 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7f54a0004e30 tx=0x7f54a0009b30).stop 2021-11-03T18:44:43.076 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.072+0000 7f54b8247700 1 -- 172.21.15.26:0/3638073837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54b00f55e0 msgr2=0x7f54b00f97e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:44:43.076 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.072+0000 7f54b8247700 1 --2- 172.21.15.26:0/3638073837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54b00f55e0 0x7f54b00f97e0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 rx=0x7f54a800b790 tx=0x7f54a80092d0).stop 2021-11-03T18:44:43.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.072+0000 7f54b8247700 1 -- 172.21.15.26:0/3638073837 shutdown_connections 2021-11-03T18:44:43.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.072+0000 7f54b8247700 1 --2- 172.21.15.26:0/3638073837 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f549c064090 0x7f549c066550 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:43.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.072+0000 7f54b8247700 1 --2- 172.21.15.26:0/3638073837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54b00f55e0 0x7f54b00f97e0 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:43.077 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.072+0000 7f54b8247700 1 --2- 172.21.15.26:0/3638073837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54b00f5ef0 0x7f54b00f7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:43.078 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.072+0000 7f54b8247700 1 -- 172.21.15.26:0/3638073837 >> 172.21.15.26:0/3638073837 conn(0x7f54b00f0de0 msgr2=0x7f54b005ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:44:43.078 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.072+0000 7f54b8247700 1 -- 172.21.15.26:0/3638073837 shutdown_connections 2021-11-03T18:44:43.078 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.072+0000 7f54b8247700 1 -- 172.21.15.26:0/3638073837 wait complete. 2021-11-03T18:44:43.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.172+0000 7fc39929f700 1 -- 172.21.15.26:0/3096272615 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3940f6b90 msgr2=0x7fc3940f6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:44:43.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.172+0000 7fc39929f700 1 --2- 172.21.15.26:0/3096272615 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3940f6b90 0x7fc3940f6fb0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 rx=0x7fc38c004660 tx=0x7fc38c009b30).stop 2021-11-03T18:44:43.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.172+0000 7fc39929f700 1 -- 172.21.15.26:0/3096272615 shutdown_connections 2021-11-03T18:44:43.172 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.172+0000 7fc39929f700 1 --2- 172.21.15.26:0/3096272615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3940f74a0 0x7fc3940f5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:43.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.172+0000 7fc39929f700 1 --2- 172.21.15.26:0/3096272615 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3940f6b90 0x7fc3940f6fb0 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:43.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.172+0000 7fc39929f700 1 -- 172.21.15.26:0/3096272615 >> 172.21.15.26:0/3096272615 conn(0x7fc3940f0540 msgr2=0x7fc3940f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:44:43.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.172+0000 7fc39929f700 1 -- 172.21.15.26:0/3096272615 shutdown_connections 2021-11-03T18:44:43.173 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.172+0000 7fc39929f700 1 -- 172.21.15.26:0/3096272615 wait complete. 2021-11-03T18:44:43.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.173+0000 7fc39929f700 1 Processor -- start 2021-11-03T18:44:43.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.173+0000 7fc39929f700 1 -- start start 2021-11-03T18:44:43.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.173+0000 7fc39929f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3940f6b90 0x7fc394105e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:44:43.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.173+0000 7fc39929f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3940f74a0 0x7fc394106370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:44:43.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.173+0000 7fc39929f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc394106920 con 0x7fc3940f6b90 2021-11-03T18:44:43.175 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.173+0000 7fc39929f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc394106a60 con 0x7fc3940f74a0 2021-11-03T18:44:43.176 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.173+0000 7fc392ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3940f6b90 0x7fc394105e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:44:43.177 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.173+0000 7fc392ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3940f6b90 0x7fc394105e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33530/0 (socket says 172.21.15.26:33530) 2021-11-03T18:44:43.177 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.173+0000 7fc392ffd700 1 -- 172.21.15.26:0/3238541531 learned_addr learned my addr 172.21.15.26:0/3238541531 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:44:43.177 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.173+0000 7fc3927fc700 1 --2- 172.21.15.26:0/3238541531 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3940f74a0 0x7fc394106370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:44:43.177 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.173+0000 7fc392ffd700 1 -- 172.21.15.26:0/3238541531 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3940f74a0 msgr2=0x7fc394106370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:44:43.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.173+0000 7fc392ffd700 1 --2- 172.21.15.26:0/3238541531 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3940f74a0 0x7fc394106370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:43.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.173+0000 7fc392ffd700 1 -- 172.21.15.26:0/3238541531 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc38c005040 con 0x7fc3940f6b90 2021-11-03T18:44:43.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.173+0000 7fc392ffd700 1 --2- 172.21.15.26:0/3238541531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3940f6b90 0x7fc394105e80 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 rx=0x7fc38c009830 tx=0x7fc38c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:44:43.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.173+0000 7fc38b7fe700 1 -- 172.21.15.26:0/3238541531 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc38c018070 con 0x7fc3940f6b90 2021-11-03T18:44:43.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.174+0000 7fc39929f700 1 -- 172.21.15.26:0/3238541531 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3941073a0 con 0x7fc3940f6b90 2021-11-03T18:44:43.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.174+0000 7fc38b7fe700 1 -- 172.21.15.26:0/3238541531 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc38c007ba0 con 0x7fc3940f6b90 2021-11-03T18:44:43.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.174+0000 7fc38b7fe700 1 -- 172.21.15.26:0/3238541531 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc38c01c620 con 0x7fc3940f6b90 2021-11-03T18:44:43.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.174+0000 7fc39929f700 1 -- 172.21.15.26:0/3238541531 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc394107900 con 0x7fc3940f6b90 2021-11-03T18:44:43.180 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.174+0000 7fc39929f700 1 -- 172.21.15.26:0/3238541531 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc394045ad0 con 0x7fc3940f6b90 2021-11-03T18:44:43.180 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.175+0000 7fc38b7fe700 1 -- 172.21.15.26:0/3238541531 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc38c007d10 con 0x7fc3940f6b90 2021-11-03T18:44:43.180 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.175+0000 7fc38b7fe700 1 --2- 172.21.15.26:0/3238541531 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc380064090 0x7fc380066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:44:43.180 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.175+0000 7fc38b7fe700 1 -- 172.21.15.26:0/3238541531 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc38c082600 con 0x7fc3940f6b90 2021-11-03T18:44:43.181 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.175+0000 7fc3927fc700 1 --2- 172.21.15.26:0/3238541531 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc380064090 0x7fc380066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:44:43.181 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.176+0000 7fc3927fc700 1 --2- 172.21.15.26:0/3238541531 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc380064090 0x7fc380066550 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 rx=0x7fc37c0096c0 tx=0x7fc37c009be0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:44:43.181 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.179+0000 7fc38b7fe700 1 -- 172.21.15.26:0/3238541531 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc38c054960 con 0x7fc3940f6b90 2021-11-03T18:44:43.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.413+0000 7fc39929f700 1 -- 172.21.15.26:0/3238541531 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc3940fdda0 con 0x7fc3940f6b90 2021-11-03T18:44:43.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.413+0000 7fc38b7fe700 1 -- 172.21.15.26:0/3238541531 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fc38c054550 con 0x7fc3940f6b90 2021-11-03T18:44:43.413 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:44:43.413 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:44:43.414 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:44:43.414 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:44:43.414 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:44:43.414 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:44:43.415 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:44:43.415 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:44:43.415 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:44:43.415 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:44:43.415 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:44:43.416 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:44:43.416 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:44:43.416 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:44:43.416 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:44:43.417 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:44:43.417 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:44:43.417 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:44:43.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.415+0000 7fc39929f700 1 -- 172.21.15.26:0/3238541531 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc380064090 msgr2=0x7fc380066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:44:43.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.415+0000 7fc39929f700 1 --2- 172.21.15.26:0/3238541531 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc380064090 0x7fc380066550 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 rx=0x7fc37c0096c0 tx=0x7fc37c009be0).stop 2021-11-03T18:44:43.418 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.415+0000 7fc39929f700 1 -- 172.21.15.26:0/3238541531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3940f6b90 msgr2=0x7fc394105e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:44:43.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.415+0000 7fc39929f700 1 --2- 172.21.15.26:0/3238541531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3940f6b90 0x7fc394105e80 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 rx=0x7fc38c009830 tx=0x7fc38c009b30).stop 2021-11-03T18:44:43.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.415+0000 7fc39929f700 1 -- 172.21.15.26:0/3238541531 shutdown_connections 2021-11-03T18:44:43.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.415+0000 7fc39929f700 1 --2- 172.21.15.26:0/3238541531 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc380064090 0x7fc380066550 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:43.419 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.415+0000 7fc39929f700 1 --2- 172.21.15.26:0/3238541531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3940f6b90 0x7fc394105e80 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:43.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.415+0000 7fc39929f700 1 --2- 172.21.15.26:0/3238541531 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3940f74a0 0x7fc394106370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:43.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.415+0000 7fc39929f700 1 -- 172.21.15.26:0/3238541531 >> 172.21.15.26:0/3238541531 conn(0x7fc3940f0540 msgr2=0x7fc3940fa390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:44:43.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.415+0000 7fc39929f700 1 -- 172.21.15.26:0/3238541531 shutdown_connections 2021-11-03T18:44:43.420 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.415+0000 7fc39929f700 1 -- 172.21.15.26:0/3238541531 wait complete. 2021-11-03T18:44:43.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:43 smithi194 ceph-mon[65619]: pgmap v3301: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:43.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.515+0000 7f6f2f59e700 1 -- 172.21.15.26:0/386512259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f300f4bc0 msgr2=0x7f6f300f4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:44:43.517 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.515+0000 7f6f2f59e700 1 --2- 172.21.15.26:0/386512259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f300f4bc0 0x7f6f300f4fe0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 rx=0x7f6f24004660 tx=0x7f6f24009b30).stop 2021-11-03T18:44:43.517 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.515+0000 7f6f2f59e700 1 -- 172.21.15.26:0/386512259 shutdown_connections 2021-11-03T18:44:43.518 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.515+0000 7f6f2f59e700 1 --2- 172.21.15.26:0/386512259 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f300f5e60 0x7f6f300f62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:43.518 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.515+0000 7f6f2f59e700 1 --2- 172.21.15.26:0/386512259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f300f4bc0 0x7f6f300f4fe0 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:43.518 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.515+0000 7f6f2f59e700 1 -- 172.21.15.26:0/386512259 >> 172.21.15.26:0/386512259 conn(0x7f6f300f0320 msgr2=0x7f6f300f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:44:43.518 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.515+0000 7f6f2f59e700 1 -- 172.21.15.26:0/386512259 shutdown_connections 2021-11-03T18:44:43.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.515+0000 7f6f2f59e700 1 -- 172.21.15.26:0/386512259 wait complete. 2021-11-03T18:44:43.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.516+0000 7f6f2f59e700 1 Processor -- start 2021-11-03T18:44:43.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.516+0000 7f6f2f59e700 1 -- start start 2021-11-03T18:44:43.519 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.516+0000 7f6f2f59e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f300f4bc0 0x7f6f30109ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:44:43.520 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.516+0000 7f6f2f59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f300f5e60 0x7f6f3010bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:44:43.520 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.516+0000 7f6f2f59e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f300fe950 con 0x7f6f300f5e60 2021-11-03T18:44:43.520 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.516+0000 7f6f2f59e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f300fea90 con 0x7f6f300f4bc0 2021-11-03T18:44:43.520 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.516+0000 7f6f2dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f300f5e60 0x7f6f3010bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:44:43.521 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.516+0000 7f6f2dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f300f5e60 0x7f6f3010bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33540/0 (socket says 172.21.15.26:33540) 2021-11-03T18:44:43.521 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.516+0000 7f6f2dd9b700 1 -- 172.21.15.26:0/2515038250 learned_addr learned my addr 172.21.15.26:0/2515038250 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:44:43.521 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.516+0000 7f6f2e59c700 1 --2- 172.21.15.26:0/2515038250 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f300f4bc0 0x7f6f30109ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:44:43.521 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.517+0000 7f6f2dd9b700 1 -- 172.21.15.26:0/2515038250 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f300f4bc0 msgr2=0x7f6f30109ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:44:43.522 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.517+0000 7f6f2dd9b700 1 --2- 172.21.15.26:0/2515038250 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f300f4bc0 0x7f6f30109ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:43.522 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.517+0000 7f6f2dd9b700 1 -- 172.21.15.26:0/2515038250 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f24005040 con 0x7f6f300f5e60 2021-11-03T18:44:43.522 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.517+0000 7f6f2dd9b700 1 --2- 172.21.15.26:0/2515038250 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f300f5e60 0x7f6f3010bfe0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 rx=0x7f6f200026d0 tx=0x7f6f20009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:44:43.522 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.517+0000 7f6f1effd700 1 -- 172.21.15.26:0/2515038250 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f200079c0 con 0x7f6f300f5e60 2021-11-03T18:44:43.523 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.517+0000 7f6f2f59e700 1 -- 172.21.15.26:0/2515038250 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f3010c590 con 0x7f6f300f5e60 2021-11-03T18:44:43.523 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.517+0000 7f6f1effd700 1 -- 172.21.15.26:0/2515038250 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6f2000f040 con 0x7f6f300f5e60 2021-11-03T18:44:43.524 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.517+0000 7f6f1effd700 1 -- 172.21.15.26:0/2515038250 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f200148b0 con 0x7f6f300f5e60 2021-11-03T18:44:43.524 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.517+0000 7f6f2f59e700 1 -- 172.21.15.26:0/2515038250 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f3010cad0 con 0x7f6f300f5e60 2021-11-03T18:44:43.525 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.518+0000 7f6f2f59e700 1 -- 172.21.15.26:0/2515038250 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f30045ad0 con 0x7f6f300f5e60 2021-11-03T18:44:43.525 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.518+0000 7f6f1effd700 1 -- 172.21.15.26:0/2515038250 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f6f20007b20 con 0x7f6f300f5e60 2021-11-03T18:44:43.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.519+0000 7f6f1effd700 1 --2- 172.21.15.26:0/2515038250 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6f18064100 0x7f6f180665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:44:43.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.519+0000 7f6f1effd700 1 -- 172.21.15.26:0/2515038250 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f6f20080730 con 0x7f6f300f5e60 2021-11-03T18:44:43.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.519+0000 7f6f2e59c700 1 --2- 172.21.15.26:0/2515038250 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6f18064100 0x7f6f180665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:44:43.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.519+0000 7f6f2e59c700 1 --2- 172.21.15.26:0/2515038250 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6f18064100 0x7f6f180665c0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7f6f24013690 tx=0x7f6f24009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:44:43.527 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.523+0000 7f6f1effd700 1 -- 172.21.15.26:0/2515038250 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f6f20052a90 con 0x7f6f300f5e60 2021-11-03T18:44:43.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:43 smithi026 ceph-mon[96795]: pgmap v3301: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:43.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.726+0000 7f6f2f59e700 1 -- 172.21.15.26:0/2515038250 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6f3010d300 con 0x7f6f300f5e60 2021-11-03T18:44:43.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.726+0000 7f6f1effd700 1 -- 172.21.15.26:0/2515038250 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f6f20052680 con 0x7f6f300f5e60 2021-11-03T18:44:43.726 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:44:43.726 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:44:43.726 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:44:43.727 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:44:43.727 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:44:43.727 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:44:43.727 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:44:43.728 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:44:43.728 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:44:43.728 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:44:43.728 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:44:43.728 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:44:43.729 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:44:43.729 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:44:43.729 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:44:43.729 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:44:43.730 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:44:43.730 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:44:43.730 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:44:43.730 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:44:43.730 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:44:43.731 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:44:43.731 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:44:43.731 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:44:43.731 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:44:43.732 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:44:43.732 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:44:43.732 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:44:43.732 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:44:43.732 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:44:43.733 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:44:43.733 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:44:43.733 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:44:43.733 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:44:43.734 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:44:43.734 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:44:43.734 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:44:43.734 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:44:43.735 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:44:43.735 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.728+0000 7f6f2f59e700 1 -- 172.21.15.26:0/2515038250 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6f18064100 msgr2=0x7f6f180665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:44:43.736 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.728+0000 7f6f2f59e700 1 --2- 172.21.15.26:0/2515038250 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6f18064100 0x7f6f180665c0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7f6f24013690 tx=0x7f6f24009b30).stop 2021-11-03T18:44:43.736 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.728+0000 7f6f2f59e700 1 -- 172.21.15.26:0/2515038250 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f300f5e60 msgr2=0x7f6f3010bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:44:43.736 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.728+0000 7f6f2f59e700 1 --2- 172.21.15.26:0/2515038250 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f300f5e60 0x7f6f3010bfe0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 rx=0x7f6f200026d0 tx=0x7f6f20009de0).stop 2021-11-03T18:44:43.736 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.728+0000 7f6f2f59e700 1 -- 172.21.15.26:0/2515038250 shutdown_connections 2021-11-03T18:44:43.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.728+0000 7f6f2f59e700 1 --2- 172.21.15.26:0/2515038250 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6f18064100 0x7f6f180665c0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:43.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.728+0000 7f6f2f59e700 1 --2- 172.21.15.26:0/2515038250 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f300f4bc0 0x7f6f30109ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:43.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.728+0000 7f6f2f59e700 1 --2- 172.21.15.26:0/2515038250 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f300f5e60 0x7f6f3010bfe0 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:44:43.737 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.728+0000 7f6f2f59e700 1 -- 172.21.15.26:0/2515038250 >> 172.21.15.26:0/2515038250 conn(0x7f6f300f0320 msgr2=0x7f6f300f2600 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:44:43.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.728+0000 7f6f2f59e700 1 -- 172.21.15.26:0/2515038250 shutdown_connections 2021-11-03T18:44:43.738 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:44:43.728+0000 7f6f2f59e700 1 -- 172.21.15.26:0/2515038250 wait complete. 2021-11-03T18:44:43.738 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:44:44.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:44 smithi194 ceph-mon[65619]: from='client.37532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:44:44.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:44 smithi194 ceph-mon[65619]: from='client.37536 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:44:44.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:44 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3238541531' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:44:44.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:44 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2515038250' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:44:44.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:44 smithi026 ceph-mon[96795]: from='client.37532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:44:44.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:44 smithi026 ceph-mon[96795]: from='client.37536 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:44:44.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:44 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3238541531' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:44:44.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:44 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2515038250' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:44:45.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:45 smithi194 ceph-mon[65619]: pgmap v3302: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:45.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:45 smithi026 ceph-mon[96795]: pgmap v3302: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:47.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:47 smithi194 ceph-mon[65619]: pgmap v3303: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:47.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:47 smithi026 ceph-mon[96795]: pgmap v3303: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:49.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:49 smithi194 ceph-mon[65619]: pgmap v3304: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:44:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:44:49.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:49 smithi026 ceph-mon[96795]: pgmap v3304: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:49.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:44:49.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:44:51.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:51 smithi026 ceph-mon[96795]: pgmap v3305: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:51.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:51 smithi194 ceph-mon[65619]: pgmap v3305: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:52.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:52 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:44:52.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:52 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:44:52.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:52 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:44:52.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:52 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:44:52.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:52 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:44:52.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:52 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:44:52.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:52 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:44:52.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:52 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:44:52.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:52 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:44:52.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:52 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:44:52.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:52 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:44:52.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:52 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:44:52.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:52 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:44:52.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:52 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:44:52.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:52 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:44:52.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:52 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:44:53.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:53 smithi026 ceph-mon[96795]: poll took 60071.694 ms: 1 events 2021-11-03T18:44:53.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:53 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:44:53.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:53 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:44:53.427 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:53 smithi026 ceph-mon[96795]: pgmap v3306: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:53.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:53 smithi194 ceph-mon[65619]: poll took 60071.694 ms: 1 events 2021-11-03T18:44:53.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:53 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:44:53.475 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:53 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:44:53.475 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:53 smithi194 ceph-mon[65619]: pgmap v3306: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:55.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:55 smithi194 ceph-mon[65619]: pgmap v3307: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:55.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:55 smithi026 ceph-mon[96795]: pgmap v3307: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:57.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:57 smithi194 ceph-mon[65619]: pgmap v3308: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:57.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:57 smithi026 ceph-mon[96795]: pgmap v3308: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:59.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:44:59 smithi194 ceph-mon[65619]: pgmap v3309: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:44:59.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:44:59 smithi026 ceph-mon[96795]: pgmap v3309: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:01.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:01 smithi026 ceph-mon[96795]: pgmap v3310: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:01.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:01 smithi194 ceph-mon[65619]: pgmap v3310: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:03.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:03 smithi194 ceph-mon[65619]: pgmap v3311: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:03.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:03 smithi026 ceph-mon[96795]: pgmap v3311: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:05.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:05 smithi194 ceph-mon[65619]: pgmap v3312: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:05.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:05 smithi026 ceph-mon[96795]: pgmap v3312: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:07.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:07 smithi194 ceph-mon[65619]: pgmap v3313: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:07.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:07 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:45:07.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:07 smithi026 ceph-mon[96795]: pgmap v3313: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:07.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:07 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:45:08.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:08 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:45:08.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:08 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:45:09.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:09 smithi026 ceph-mon[96795]: pgmap v3314: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:09.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:09 smithi194 ceph-mon[65619]: pgmap v3314: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:11.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:11 smithi026 ceph-mon[96795]: pgmap v3315: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:11.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:11 smithi194 ceph-mon[65619]: pgmap v3315: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:13.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:13 smithi194 ceph-mon[65619]: pgmap v3316: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:13.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:13 smithi026 ceph-mon[96795]: pgmap v3316: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:13.845 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:13.844+0000 7f1b67b0a700 1 -- 172.21.15.26:0/3694196031 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b600f5ed0 msgr2=0x7f1b600f6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:45:13.845 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:13.844+0000 7f1b67b0a700 1 --2- 172.21.15.26:0/3694196031 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b600f5ed0 0x7f1b600f6900 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 rx=0x7f1b54004660 tx=0x7f1b54009b30).stop 2021-11-03T18:45:13.845 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:13.844+0000 7f1b67b0a700 1 -- 172.21.15.26:0/3694196031 shutdown_connections 2021-11-03T18:45:13.846 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:13.844+0000 7f1b67b0a700 1 --2- 172.21.15.26:0/3694196031 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b600f5ed0 0x7f1b600f6900 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:13.846 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:13.844+0000 7f1b67b0a700 1 --2- 172.21.15.26:0/3694196031 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b600f55c0 0x7f1b600f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:13.846 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:13.844+0000 7f1b67b0a700 1 -- 172.21.15.26:0/3694196031 >> 172.21.15.26:0/3694196031 conn(0x7f1b600f0de0 msgr2=0x7f1b600f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:45:13.846 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:13.844+0000 7f1b67b0a700 1 -- 172.21.15.26:0/3694196031 shutdown_connections 2021-11-03T18:45:13.847 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:13.844+0000 7f1b67b0a700 1 -- 172.21.15.26:0/3694196031 wait complete. 2021-11-03T18:45:13.847 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:13.845+0000 7f1b67b0a700 1 Processor -- start 2021-11-03T18:45:13.847 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:13.845+0000 7f1b67b0a700 1 -- start start 2021-11-03T18:45:13.847 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:13.845+0000 7f1b67b0a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b600f55c0 0x7f1b6010c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:45:13.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:13.845+0000 7f1b67b0a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b600f5ed0 0x7f1b6010e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:45:13.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:13.845+0000 7f1b67b0a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b60060390 con 0x7f1b600f55c0 2021-11-03T18:45:13.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:13.845+0000 7f1b67b0a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b600604d0 con 0x7f1b600f5ed0 2021-11-03T18:45:13.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:13.845+0000 7f1b658a6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b600f55c0 0x7f1b6010c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:45:13.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:13.845+0000 7f1b658a6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b600f55c0 0x7f1b6010c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33556/0 (socket says 172.21.15.26:33556) 2021-11-03T18:45:13.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:13.845+0000 7f1b658a6700 1 -- 172.21.15.26:0/3084063386 learned_addr learned my addr 172.21.15.26:0/3084063386 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:45:13.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:13.845+0000 7f1b650a5700 1 --2- 172.21.15.26:0/3084063386 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b600f5ed0 0x7f1b6010e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:45:13.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:13.846+0000 7f1b658a6700 1 -- 172.21.15.26:0/3084063386 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b600f5ed0 msgr2=0x7f1b6010e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:45:13.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:13.846+0000 7f1b658a6700 1 --2- 172.21.15.26:0/3084063386 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b600f5ed0 0x7f1b6010e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:13.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:13.846+0000 7f1b658a6700 1 -- 172.21.15.26:0/3084063386 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b54005040 con 0x7f1b600f55c0 2021-11-03T18:45:13.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:13.846+0000 7f1b658a6700 1 --2- 172.21.15.26:0/3084063386 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b600f55c0 0x7f1b6010c090 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 rx=0x7f1b5800c760 tx=0x7f1b58004d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:45:13.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:13.846+0000 7f1b5e7fc700 1 -- 172.21.15.26:0/3084063386 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b58004200 con 0x7f1b600f55c0 2021-11-03T18:45:13.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:13.846+0000 7f1b5e7fc700 1 -- 172.21.15.26:0/3084063386 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1b580109c0 con 0x7f1b600f55c0 2021-11-03T18:45:13.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:13.846+0000 7f1b67b0a700 1 -- 172.21.15.26:0/3084063386 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b6010ea80 con 0x7f1b600f55c0 2021-11-03T18:45:13.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:13.846+0000 7f1b5e7fc700 1 -- 172.21.15.26:0/3084063386 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b58003980 con 0x7f1b600f55c0 2021-11-03T18:45:13.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:13.846+0000 7f1b67b0a700 1 -- 172.21.15.26:0/3084063386 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b6010ef00 con 0x7f1b600f55c0 2021-11-03T18:45:13.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:13.847+0000 7f1b67b0a700 1 -- 172.21.15.26:0/3084063386 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b60045ad0 con 0x7f1b600f55c0 2021-11-03T18:45:13.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:13.847+0000 7f1b5e7fc700 1 -- 172.21.15.26:0/3084063386 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f1b58018020 con 0x7f1b600f55c0 2021-11-03T18:45:13.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:13.848+0000 7f1b5e7fc700 1 --2- 172.21.15.26:0/3084063386 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1b480640b0 0x7f1b48066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:45:13.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:13.848+0000 7f1b5e7fc700 1 -- 172.21.15.26:0/3084063386 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f1b580805e0 con 0x7f1b600f55c0 2021-11-03T18:45:13.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:13.848+0000 7f1b650a5700 1 --2- 172.21.15.26:0/3084063386 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1b480640b0 0x7f1b48066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:45:13.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:13.848+0000 7f1b650a5700 1 --2- 172.21.15.26:0/3084063386 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1b480640b0 0x7f1b48066570 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7f1b54004630 tx=0x7f1b54009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:45:13.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:13.852+0000 7f1b5e7fc700 1 -- 172.21.15.26:0/3084063386 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f1b58052850 con 0x7f1b600f55c0 2021-11-03T18:45:14.030 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.032+0000 7f1b67b0a700 1 -- 172.21.15.26:0/3084063386 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b600fdef0 con 0x7f1b480640b0 2021-11-03T18:45:14.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.033+0000 7f1b5e7fc700 1 -- 172.21.15.26:0/3084063386 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f1b600fdef0 con 0x7f1b480640b0 2021-11-03T18:45:14.033 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.035+0000 7f1b67b0a700 1 -- 172.21.15.26:0/3084063386 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1b480640b0 msgr2=0x7f1b48066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:45:14.034 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.035+0000 7f1b67b0a700 1 --2- 172.21.15.26:0/3084063386 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1b480640b0 0x7f1b48066570 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7f1b54004630 tx=0x7f1b54009b30).stop 2021-11-03T18:45:14.034 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.035+0000 7f1b67b0a700 1 -- 172.21.15.26:0/3084063386 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b600f55c0 msgr2=0x7f1b6010c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:45:14.034 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.035+0000 7f1b67b0a700 1 --2- 172.21.15.26:0/3084063386 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b600f55c0 0x7f1b6010c090 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 rx=0x7f1b5800c760 tx=0x7f1b58004d20).stop 2021-11-03T18:45:14.034 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.035+0000 7f1b67b0a700 1 -- 172.21.15.26:0/3084063386 shutdown_connections 2021-11-03T18:45:14.035 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.035+0000 7f1b67b0a700 1 --2- 172.21.15.26:0/3084063386 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1b480640b0 0x7f1b48066570 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:14.035 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.035+0000 7f1b67b0a700 1 --2- 172.21.15.26:0/3084063386 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b600f55c0 0x7f1b6010c090 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:14.035 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.035+0000 7f1b67b0a700 1 --2- 172.21.15.26:0/3084063386 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b600f5ed0 0x7f1b6010e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:14.035 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.035+0000 7f1b67b0a700 1 -- 172.21.15.26:0/3084063386 >> 172.21.15.26:0/3084063386 conn(0x7f1b600f0de0 msgr2=0x7f1b600fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:45:14.035 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.035+0000 7f1b67b0a700 1 -- 172.21.15.26:0/3084063386 shutdown_connections 2021-11-03T18:45:14.036 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.035+0000 7f1b67b0a700 1 -- 172.21.15.26:0/3084063386 wait complete. 2021-11-03T18:45:14.043 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:45:14.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.135+0000 7f769cd20700 1 -- 172.21.15.26:0/2296095393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76980f6ff0 msgr2=0x7f76980f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:45:14.135 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.135+0000 7f769cd20700 1 --2- 172.21.15.26:0/2296095393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76980f6ff0 0x7f76980f7a20 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 rx=0x7f7680004660 tx=0x7f7680009b30).stop 2021-11-03T18:45:14.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.135+0000 7f769cd20700 1 -- 172.21.15.26:0/2296095393 shutdown_connections 2021-11-03T18:45:14.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.135+0000 7f769cd20700 1 --2- 172.21.15.26:0/2296095393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76980f6ff0 0x7f76980f7a20 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:14.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.135+0000 7f769cd20700 1 --2- 172.21.15.26:0/2296095393 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76980f66e0 0x7f76980f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:14.136 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.135+0000 7f769cd20700 1 -- 172.21.15.26:0/2296095393 >> 172.21.15.26:0/2296095393 conn(0x7f76980f1f00 msgr2=0x7f76980f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:45:14.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.135+0000 7f769cd20700 1 -- 172.21.15.26:0/2296095393 shutdown_connections 2021-11-03T18:45:14.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.135+0000 7f769cd20700 1 -- 172.21.15.26:0/2296095393 wait complete. 2021-11-03T18:45:14.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.136+0000 7f769cd20700 1 Processor -- start 2021-11-03T18:45:14.137 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.136+0000 7f769cd20700 1 -- start start 2021-11-03T18:45:14.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.136+0000 7f769cd20700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76980f66e0 0x7f769806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:45:14.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.136+0000 7f769cd20700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76980f6ff0 0x7f7698069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:45:14.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.136+0000 7f769cd20700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769806a380 con 0x7f76980f6ff0 2021-11-03T18:45:14.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.136+0000 7f769cd20700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769806a4c0 con 0x7f76980f66e0 2021-11-03T18:45:14.138 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.136+0000 7f7695d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76980f6ff0 0x7f7698069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:45:14.139 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.136+0000 7f7695d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76980f6ff0 0x7f7698069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33568/0 (socket says 172.21.15.26:33568) 2021-11-03T18:45:14.139 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.136+0000 7f7695d9b700 1 -- 172.21.15.26:0/2787185786 learned_addr learned my addr 172.21.15.26:0/2787185786 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:45:14.139 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.136+0000 7f769659c700 1 --2- 172.21.15.26:0/2787185786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76980f66e0 0x7f769806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:45:14.139 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.136+0000 7f7695d9b700 1 -- 172.21.15.26:0/2787185786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76980f66e0 msgr2=0x7f769806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:45:14.140 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.136+0000 7f7695d9b700 1 --2- 172.21.15.26:0/2787185786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76980f66e0 0x7f769806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:14.140 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.136+0000 7f7695d9b700 1 -- 172.21.15.26:0/2787185786 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7680005040 con 0x7f76980f6ff0 2021-11-03T18:45:14.140 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.136+0000 7f7695d9b700 1 --2- 172.21.15.26:0/2787185786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76980f6ff0 0x7f7698069e20 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 rx=0x7f7680009990 tx=0x7f7680009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:45:14.140 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.136+0000 7f768effd700 1 -- 172.21.15.26:0/2787185786 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7680018070 con 0x7f76980f6ff0 2021-11-03T18:45:14.141 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.136+0000 7f769cd20700 1 -- 172.21.15.26:0/2787185786 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f769806a740 con 0x7f76980f6ff0 2021-11-03T18:45:14.141 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.137+0000 7f768effd700 1 -- 172.21.15.26:0/2787185786 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7680007ba0 con 0x7f76980f6ff0 2021-11-03T18:45:14.141 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.137+0000 7f768effd700 1 -- 172.21.15.26:0/2787185786 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f768001c3c0 con 0x7f76980f6ff0 2021-11-03T18:45:14.141 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.137+0000 7f769cd20700 1 -- 172.21.15.26:0/2787185786 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f769806aca0 con 0x7f76980f6ff0 2021-11-03T18:45:14.142 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.137+0000 7f769cd20700 1 -- 172.21.15.26:0/2787185786 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7698045ad0 con 0x7f76980f6ff0 2021-11-03T18:45:14.143 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.138+0000 7f768effd700 1 -- 172.21.15.26:0/2787185786 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f768001d420 con 0x7f76980f6ff0 2021-11-03T18:45:14.143 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.138+0000 7f768effd700 1 --2- 172.21.15.26:0/2787185786 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f76840640b0 0x7f7684066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:45:14.143 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.138+0000 7f768effd700 1 -- 172.21.15.26:0/2787185786 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f76800825d0 con 0x7f76980f6ff0 2021-11-03T18:45:14.143 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.138+0000 7f769659c700 1 --2- 172.21.15.26:0/2787185786 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f76840640b0 0x7f7684066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:45:14.144 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.139+0000 7f769659c700 1 --2- 172.21.15.26:0/2787185786 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f76840640b0 0x7f7684066570 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7f769806b730 tx=0x7f7688009c60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:45:14.144 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.143+0000 7f768effd700 1 -- 172.21.15.26:0/2787185786 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f7680054990 con 0x7f76980f6ff0 2021-11-03T18:45:14.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.317+0000 7f769cd20700 1 -- 172.21.15.26:0/2787185786 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f76980ff040 con 0x7f76840640b0 2021-11-03T18:45:14.330 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.332+0000 7f768effd700 1 -- 172.21.15.26:0/2787185786 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7f76980ff040 con 0x7f76840640b0 2021-11-03T18:45:14.331 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:45:14.331 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (116m) 4m ago 117m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:45:14.331 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (108m) 4m ago 117m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:45:14.331 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (108m) 3m ago 116m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:45:14.332 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (116m) 4m ago 117m 42.4M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:45:14.332 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (109m) 4m ago 112m 26.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:45:14.332 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (109m) 4m ago 112m 27.0M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:45:14.332 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (112m) 3m ago 112m 27.2M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:45:14.333 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (112m) 3m ago 112m 27.6M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:45:14.333 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (110m) 4m ago 119m 615M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:45:14.333 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (109m) 3m ago 116m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:45:14.333 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (109m) 4m ago 119m 407M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:45:14.334 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (109m) 3m ago 116m 187M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:45:14.334 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (117m) 4m ago 117m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:45:14.334 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (116m) 3m ago 116m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:45:14.334 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (108m) 4m ago 116m 372M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:45:14.335 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (107m) 4m ago 115m 400M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:45:14.335 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (107m) 4m ago 115m 332M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:45:14.336 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (106m) 3m ago 115m 438M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:45:14.336 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (106m) 3m ago 114m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:45:14.336 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (105m) 3m ago 114m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:45:14.336 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (116m) 4m ago 117m 70.2M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:45:14.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.334+0000 7f769cd20700 1 -- 172.21.15.26:0/2787185786 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f76840640b0 msgr2=0x7f7684066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:45:14.337 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.334+0000 7f769cd20700 1 --2- 172.21.15.26:0/2787185786 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f76840640b0 0x7f7684066570 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7f769806b730 tx=0x7f7688009c60).stop 2021-11-03T18:45:14.338 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.334+0000 7f769cd20700 1 -- 172.21.15.26:0/2787185786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76980f6ff0 msgr2=0x7f7698069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:45:14.338 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.334+0000 7f769cd20700 1 --2- 172.21.15.26:0/2787185786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76980f6ff0 0x7f7698069e20 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 rx=0x7f7680009990 tx=0x7f7680009b30).stop 2021-11-03T18:45:14.338 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.334+0000 7f769cd20700 1 -- 172.21.15.26:0/2787185786 shutdown_connections 2021-11-03T18:45:14.339 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.334+0000 7f769cd20700 1 --2- 172.21.15.26:0/2787185786 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f76840640b0 0x7f7684066570 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:14.339 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.334+0000 7f769cd20700 1 --2- 172.21.15.26:0/2787185786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76980f66e0 0x7f769806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:14.339 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.334+0000 7f769cd20700 1 --2- 172.21.15.26:0/2787185786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76980f6ff0 0x7f7698069e20 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:14.339 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.334+0000 7f769cd20700 1 -- 172.21.15.26:0/2787185786 >> 172.21.15.26:0/2787185786 conn(0x7f76980f1f00 msgr2=0x7f76980fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:45:14.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.334+0000 7f769cd20700 1 -- 172.21.15.26:0/2787185786 shutdown_connections 2021-11-03T18:45:14.340 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.334+0000 7f769cd20700 1 -- 172.21.15.26:0/2787185786 wait complete. 2021-11-03T18:45:14.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.433+0000 7f4fedf47700 1 -- 172.21.15.26:0/1574309097 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fe80f66e0 msgr2=0x7f4fe80f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:45:14.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.433+0000 7f4fedf47700 1 --2- 172.21.15.26:0/1574309097 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fe80f66e0 0x7f4fe80f6b00 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 rx=0x7f4fdc004660 tx=0x7f4fdc009b30).stop 2021-11-03T18:45:14.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.433+0000 7f4fedf47700 1 -- 172.21.15.26:0/1574309097 shutdown_connections 2021-11-03T18:45:14.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.433+0000 7f4fedf47700 1 --2- 172.21.15.26:0/1574309097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4fe80f6ff0 0x7f4fe80f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:14.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.433+0000 7f4fedf47700 1 --2- 172.21.15.26:0/1574309097 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fe80f66e0 0x7f4fe80f6b00 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:14.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.433+0000 7f4fedf47700 1 -- 172.21.15.26:0/1574309097 >> 172.21.15.26:0/1574309097 conn(0x7f4fe80f1f00 msgr2=0x7f4fe80f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:45:14.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.433+0000 7f4fedf47700 1 -- 172.21.15.26:0/1574309097 shutdown_connections 2021-11-03T18:45:14.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.433+0000 7f4fedf47700 1 -- 172.21.15.26:0/1574309097 wait complete. 2021-11-03T18:45:14.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.434+0000 7f4fedf47700 1 Processor -- start 2021-11-03T18:45:14.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.434+0000 7f4fedf47700 1 -- start start 2021-11-03T18:45:14.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.434+0000 7f4fedf47700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fe80f66e0 0x7f4fe8106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:45:14.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.434+0000 7f4fedf47700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4fe80f6ff0 0x7f4fe8107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:45:14.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.434+0000 7f4fedf47700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe8107a00 con 0x7f4fe80f66e0 2021-11-03T18:45:14.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.434+0000 7f4fedf47700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe8107b40 con 0x7f4fe80f6ff0 2021-11-03T18:45:14.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.434+0000 7f4fe77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fe80f66e0 0x7f4fe8106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:45:14.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.434+0000 7f4fe77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fe80f66e0 0x7f4fe8106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33578/0 (socket says 172.21.15.26:33578) 2021-11-03T18:45:14.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.434+0000 7f4fe77fe700 1 -- 172.21.15.26:0/3544180449 learned_addr learned my addr 172.21.15.26:0/3544180449 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:45:14.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.434+0000 7f4fe6ffd700 1 --2- 172.21.15.26:0/3544180449 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4fe80f6ff0 0x7f4fe8107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:45:14.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.434+0000 7f4fe77fe700 1 -- 172.21.15.26:0/3544180449 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4fe80f6ff0 msgr2=0x7f4fe8107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:45:14.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.434+0000 7f4fe77fe700 1 --2- 172.21.15.26:0/3544180449 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4fe80f6ff0 0x7f4fe8107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:14.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.434+0000 7f4fe77fe700 1 -- 172.21.15.26:0/3544180449 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fdc005040 con 0x7f4fe80f66e0 2021-11-03T18:45:14.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.435+0000 7f4fe77fe700 1 --2- 172.21.15.26:0/3544180449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fe80f66e0 0x7f4fe8106f60 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 rx=0x7f4fdc009990 tx=0x7f4fdc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:45:14.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.435+0000 7f4fcffff700 1 -- 172.21.15.26:0/3544180449 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fdc018070 con 0x7f4fe80f66e0 2021-11-03T18:45:14.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.435+0000 7f4fedf47700 1 -- 172.21.15.26:0/3544180449 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fe8108480 con 0x7f4fe80f66e0 2021-11-03T18:45:14.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.435+0000 7f4fcffff700 1 -- 172.21.15.26:0/3544180449 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4fdc007ca0 con 0x7f4fe80f66e0 2021-11-03T18:45:14.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.435+0000 7f4fcffff700 1 -- 172.21.15.26:0/3544180449 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fdc01c620 con 0x7f4fe80f66e0 2021-11-03T18:45:14.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.435+0000 7f4fedf47700 1 -- 172.21.15.26:0/3544180449 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fe81089e0 con 0x7f4fe80f66e0 2021-11-03T18:45:14.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.436+0000 7f4fedf47700 1 -- 172.21.15.26:0/3544180449 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fe8045ad0 con 0x7f4fe80f66e0 2021-11-03T18:45:14.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.436+0000 7f4fcffff700 1 -- 172.21.15.26:0/3544180449 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f4fdc01d960 con 0x7f4fe80f66e0 2021-11-03T18:45:14.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.437+0000 7f4fcffff700 1 --2- 172.21.15.26:0/3544180449 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4fd00640b0 0x7f4fd0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:45:14.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.437+0000 7f4fcffff700 1 -- 172.21.15.26:0/3544180449 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f4fdc082520 con 0x7f4fe80f66e0 2021-11-03T18:45:14.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.437+0000 7f4fe6ffd700 1 --2- 172.21.15.26:0/3544180449 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4fd00640b0 0x7f4fd0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:45:14.444 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.437+0000 7f4fe6ffd700 1 --2- 172.21.15.26:0/3544180449 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4fd00640b0 0x7f4fd0066570 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7f4fd80041d0 tx=0x7f4fd8009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:45:14.444 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.441+0000 7f4fcffff700 1 -- 172.21.15.26:0/3544180449 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f4fdc054940 con 0x7f4fe80f66e0 2021-11-03T18:45:14.667 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.668+0000 7f4fedf47700 1 -- 172.21.15.26:0/3544180449 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4fe80feed0 con 0x7f4fe80f66e0 2021-11-03T18:45:14.667 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.669+0000 7f4fcffff700 1 -- 172.21.15.26:0/3544180449 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f4fdc054530 con 0x7f4fe80f66e0 2021-11-03T18:45:14.668 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:45:14.668 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:45:14.668 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:45:14.669 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:45:14.669 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:45:14.669 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:45:14.669 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:45:14.669 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:45:14.670 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:45:14.670 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:45:14.670 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:45:14.670 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:45:14.671 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:45:14.671 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:45:14.671 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:45:14.671 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:45:14.671 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:45:14.672 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:45:14.672 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.671+0000 7f4fedf47700 1 -- 172.21.15.26:0/3544180449 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4fd00640b0 msgr2=0x7f4fd0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:45:14.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.671+0000 7f4fedf47700 1 --2- 172.21.15.26:0/3544180449 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4fd00640b0 0x7f4fd0066570 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7f4fd80041d0 tx=0x7f4fd8009040).stop 2021-11-03T18:45:14.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.671+0000 7f4fedf47700 1 -- 172.21.15.26:0/3544180449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fe80f66e0 msgr2=0x7f4fe8106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:45:14.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.671+0000 7f4fedf47700 1 --2- 172.21.15.26:0/3544180449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fe80f66e0 0x7f4fe8106f60 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 rx=0x7f4fdc009990 tx=0x7f4fdc009b30).stop 2021-11-03T18:45:14.673 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.671+0000 7f4fedf47700 1 -- 172.21.15.26:0/3544180449 shutdown_connections 2021-11-03T18:45:14.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.671+0000 7f4fedf47700 1 --2- 172.21.15.26:0/3544180449 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4fd00640b0 0x7f4fd0066570 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:14.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.671+0000 7f4fedf47700 1 --2- 172.21.15.26:0/3544180449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fe80f66e0 0x7f4fe8106f60 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:14.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.671+0000 7f4fedf47700 1 --2- 172.21.15.26:0/3544180449 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4fe80f6ff0 0x7f4fe8107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:14.674 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.671+0000 7f4fedf47700 1 -- 172.21.15.26:0/3544180449 >> 172.21.15.26:0/3544180449 conn(0x7f4fe80f1f00 msgr2=0x7f4fe80fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:45:14.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.671+0000 7f4fedf47700 1 -- 172.21.15.26:0/3544180449 shutdown_connections 2021-11-03T18:45:14.675 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.671+0000 7f4fedf47700 1 -- 172.21.15.26:0/3544180449 wait complete. 2021-11-03T18:45:14.773 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.771+0000 7fa3f4150700 1 -- 172.21.15.26:0/811987448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3ec0f5ed0 msgr2=0x7fa3ec0f6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:45:14.774 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.771+0000 7fa3f4150700 1 --2- 172.21.15.26:0/811987448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3ec0f5ed0 0x7fa3ec0f6900 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 rx=0x7fa3e8004660 tx=0x7fa3e8009b30).stop 2021-11-03T18:45:14.775 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.771+0000 7fa3f4150700 1 -- 172.21.15.26:0/811987448 shutdown_connections 2021-11-03T18:45:14.775 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.771+0000 7fa3f4150700 1 --2- 172.21.15.26:0/811987448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3ec0f5ed0 0x7fa3ec0f6900 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:14.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.771+0000 7fa3f4150700 1 --2- 172.21.15.26:0/811987448 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3ec0f55c0 0x7fa3ec0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:14.776 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.771+0000 7fa3f4150700 1 -- 172.21.15.26:0/811987448 >> 172.21.15.26:0/811987448 conn(0x7fa3ec0f0de0 msgr2=0x7fa3ec0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:45:14.777 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.771+0000 7fa3f4150700 1 -- 172.21.15.26:0/811987448 shutdown_connections 2021-11-03T18:45:14.777 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.771+0000 7fa3f4150700 1 -- 172.21.15.26:0/811987448 wait complete. 2021-11-03T18:45:14.778 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.771+0000 7fa3f4150700 1 Processor -- start 2021-11-03T18:45:14.778 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.772+0000 7fa3f4150700 1 -- start start 2021-11-03T18:45:14.778 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.772+0000 7fa3f4150700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3ec0f55c0 0x7fa3ec109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:45:14.779 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.772+0000 7fa3f4150700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3ec0f5ed0 0x7fa3ec10c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:45:14.779 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.772+0000 7fa3f4150700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec060540 con 0x7fa3ec0f5ed0 2021-11-03T18:45:14.780 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.772+0000 7fa3f4150700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec060680 con 0x7fa3ec0f55c0 2021-11-03T18:45:14.780 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.772+0000 7fa3f16eb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3ec0f5ed0 0x7fa3ec10c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:45:14.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.772+0000 7fa3f16eb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3ec0f5ed0 0x7fa3ec10c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33590/0 (socket says 172.21.15.26:33590) 2021-11-03T18:45:14.781 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.772+0000 7fa3f16eb700 1 -- 172.21.15.26:0/1092548352 learned_addr learned my addr 172.21.15.26:0/1092548352 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:45:14.782 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.772+0000 7fa3f1eec700 1 --2- 172.21.15.26:0/1092548352 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3ec0f55c0 0x7fa3ec109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:45:14.782 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.772+0000 7fa3f16eb700 1 -- 172.21.15.26:0/1092548352 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3ec0f55c0 msgr2=0x7fa3ec109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:45:14.782 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.772+0000 7fa3f16eb700 1 --2- 172.21.15.26:0/1092548352 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3ec0f55c0 0x7fa3ec109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:14.783 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.772+0000 7fa3f16eb700 1 -- 172.21.15.26:0/1092548352 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e8005040 con 0x7fa3ec0f5ed0 2021-11-03T18:45:14.783 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.772+0000 7fa3f16eb700 1 --2- 172.21.15.26:0/1092548352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3ec0f5ed0 0x7fa3ec10c170 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 rx=0x7fa3e8009990 tx=0x7fa3e8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:45:14.784 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.772+0000 7fa3e27fc700 1 -- 172.21.15.26:0/1092548352 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3e8018070 con 0x7fa3ec0f5ed0 2021-11-03T18:45:14.784 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.772+0000 7fa3e27fc700 1 -- 172.21.15.26:0/1092548352 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa3e8007ba0 con 0x7fa3ec0f5ed0 2021-11-03T18:45:14.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.772+0000 7fa3f4150700 1 -- 172.21.15.26:0/1092548352 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3ec10c6c0 con 0x7fa3ec0f5ed0 2021-11-03T18:45:14.785 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.773+0000 7fa3e27fc700 1 -- 172.21.15.26:0/1092548352 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3e801c3c0 con 0x7fa3ec0f5ed0 2021-11-03T18:45:14.786 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.773+0000 7fa3f4150700 1 -- 172.21.15.26:0/1092548352 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3ec10cc20 con 0x7fa3ec0f5ed0 2021-11-03T18:45:14.786 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.773+0000 7fa3f4150700 1 -- 172.21.15.26:0/1092548352 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3ec045ad0 con 0x7fa3ec0f5ed0 2021-11-03T18:45:14.786 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.774+0000 7fa3e27fc700 1 -- 172.21.15.26:0/1092548352 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fa3e801d420 con 0x7fa3ec0f5ed0 2021-11-03T18:45:14.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.774+0000 7fa3e27fc700 1 --2- 172.21.15.26:0/1092548352 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa3d80640b0 0x7fa3d8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:45:14.787 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.774+0000 7fa3e27fc700 1 -- 172.21.15.26:0/1092548352 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fa3e8082410 con 0x7fa3ec0f5ed0 2021-11-03T18:45:14.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.774+0000 7fa3f1eec700 1 --2- 172.21.15.26:0/1092548352 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa3d80640b0 0x7fa3d8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:45:14.788 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.775+0000 7fa3f1eec700 1 --2- 172.21.15.26:0/1092548352 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa3d80640b0 0x7fa3d8066570 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7fa3ec0601c0 tx=0x7fa3dc00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:45:14.789 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.779+0000 7fa3e27fc700 1 -- 172.21.15.26:0/1092548352 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fa3e8054710 con 0x7fa3ec0f5ed0 2021-11-03T18:45:14.984 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.986+0000 7fa3f4150700 1 -- 172.21.15.26:0/1092548352 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa3ec0fde50 con 0x7fa3ec0f5ed0 2021-11-03T18:45:14.985 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.986+0000 7fa3e27fc700 1 -- 172.21.15.26:0/1092548352 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fa3e8054300 con 0x7fa3ec0f5ed0 2021-11-03T18:45:14.985 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:45:14.985 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:45:14.986 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:45:14.986 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:45:14.986 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:45:14.986 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:45:14.987 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:45:14.987 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:45:14.987 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:45:14.987 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:45:14.988 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:45:14.988 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:45:14.988 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:45:14.988 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:45:14.988 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:45:14.989 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:45:14.989 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:45:14.989 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:45:14.989 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:45:14.990 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:45:14.990 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:45:14.990 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:45:14.990 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:45:14.991 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:45:14.991 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:45:14.991 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:45:14.991 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:45:14.992 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:45:14.992 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:45:14.992 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:45:14.992 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:45:14.992 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:45:14.993 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:45:14.993 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:45:14.993 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:45:14.993 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:45:14.994 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:45:14.994 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:45:14.994 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:45:14.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.988+0000 7fa3f4150700 1 -- 172.21.15.26:0/1092548352 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa3d80640b0 msgr2=0x7fa3d8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:45:14.995 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.988+0000 7fa3f4150700 1 --2- 172.21.15.26:0/1092548352 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa3d80640b0 0x7fa3d8066570 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7fa3ec0601c0 tx=0x7fa3dc00b040).stop 2021-11-03T18:45:14.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.988+0000 7fa3f4150700 1 -- 172.21.15.26:0/1092548352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3ec0f5ed0 msgr2=0x7fa3ec10c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:45:14.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.988+0000 7fa3f4150700 1 --2- 172.21.15.26:0/1092548352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3ec0f5ed0 0x7fa3ec10c170 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 rx=0x7fa3e8009990 tx=0x7fa3e8009b30).stop 2021-11-03T18:45:14.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.988+0000 7fa3f4150700 1 -- 172.21.15.26:0/1092548352 shutdown_connections 2021-11-03T18:45:14.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.988+0000 7fa3f4150700 1 --2- 172.21.15.26:0/1092548352 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa3d80640b0 0x7fa3d8066570 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:14.996 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.988+0000 7fa3f4150700 1 --2- 172.21.15.26:0/1092548352 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3ec0f55c0 0x7fa3ec109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:14.997 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.988+0000 7fa3f4150700 1 --2- 172.21.15.26:0/1092548352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3ec0f5ed0 0x7fa3ec10c170 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:14.997 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.988+0000 7fa3f4150700 1 -- 172.21.15.26:0/1092548352 >> 172.21.15.26:0/1092548352 conn(0x7fa3ec0f0de0 msgr2=0x7fa3ec0fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:45:14.997 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.988+0000 7fa3f4150700 1 -- 172.21.15.26:0/1092548352 shutdown_connections 2021-11-03T18:45:14.997 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:14.988+0000 7fa3f4150700 1 -- 172.21.15.26:0/1092548352 wait complete. 2021-11-03T18:45:14.997 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:45:15.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:15 smithi194 ceph-mon[65619]: from='client.37548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:45:15.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:15 smithi194 ceph-mon[65619]: pgmap v3317: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:15.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:15 smithi194 ceph-mon[65619]: from='client.37552 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:45:15.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:15 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3544180449' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:45:15.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:15 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1092548352' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:45:15.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:15 smithi026 ceph-mon[96795]: from='client.37548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:45:15.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:15 smithi026 ceph-mon[96795]: pgmap v3317: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:15.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:15 smithi026 ceph-mon[96795]: from='client.37552 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:45:15.578 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:15 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3544180449' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:45:15.578 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:15 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1092548352' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:45:17.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:17 smithi194 ceph-mon[65619]: pgmap v3318: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:17.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:17 smithi026 ceph-mon[96795]: pgmap v3318: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:19.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:19 smithi026 ceph-mon[96795]: pgmap v3319: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:19.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:19 smithi194 ceph-mon[65619]: pgmap v3319: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:21.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:21 smithi026 ceph-mon[96795]: pgmap v3320: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:21.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:21 smithi194 ceph-mon[65619]: pgmap v3320: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:22.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:22 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:45:22.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:22 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:45:23.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:23 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:45:23.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:23 smithi026 ceph-mon[96795]: pgmap v3321: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:23.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:23 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:45:23.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:23 smithi194 ceph-mon[65619]: pgmap v3321: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:25.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:25 smithi194 ceph-mon[65619]: pgmap v3322: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:25.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:25 smithi026 ceph-mon[96795]: pgmap v3322: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:27.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:27 smithi026 ceph-mon[96795]: pgmap v3323: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:27.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:27 smithi194 ceph-mon[65619]: pgmap v3323: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:29.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:29 smithi026 ceph-mon[96795]: pgmap v3324: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:29.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:29 smithi194 ceph-mon[65619]: pgmap v3324: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:31.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:31 smithi026 ceph-mon[96795]: pgmap v3325: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:31.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:31 smithi194 ceph-mon[65619]: pgmap v3325: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:33.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:33 smithi194 ceph-mon[65619]: pgmap v3326: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:33.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:33 smithi026 ceph-mon[96795]: pgmap v3326: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:35.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:35 smithi026 ceph-mon[96795]: pgmap v3327: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:35.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:35 smithi194 ceph-mon[65619]: pgmap v3327: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:37.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:37 smithi026 ceph-mon[96795]: pgmap v3328: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:37.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:37 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:45:37.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:37 smithi194 ceph-mon[65619]: pgmap v3328: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:37.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:37 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:45:38.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:38 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:45:38.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:38 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:45:39.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:39 smithi026 ceph-mon[96795]: pgmap v3329: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:39.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:39 smithi194 ceph-mon[65619]: pgmap v3329: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:41.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:41 smithi026 ceph-mon[96795]: pgmap v3330: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:41.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:41 smithi194 ceph-mon[65619]: pgmap v3330: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:43.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:43 smithi026 ceph-mon[96795]: pgmap v3331: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:43.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:43 smithi194 ceph-mon[65619]: pgmap v3331: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:45.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.101+0000 7f48499d5700 1 -- 172.21.15.26:0/788810096 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48440f49a0 msgr2=0x7f48440f4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:45:45.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.101+0000 7f48499d5700 1 --2- 172.21.15.26:0/788810096 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48440f49a0 0x7f48440f4dc0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 rx=0x7f482c004660 tx=0x7f482c009b30).stop 2021-11-03T18:45:45.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.101+0000 7f48499d5700 1 -- 172.21.15.26:0/788810096 shutdown_connections 2021-11-03T18:45:45.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.101+0000 7f48499d5700 1 --2- 172.21.15.26:0/788810096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48440f5340 0x7f48440f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:45.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.101+0000 7f48499d5700 1 --2- 172.21.15.26:0/788810096 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48440f49a0 0x7f48440f4dc0 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:45.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.101+0000 7f48499d5700 1 -- 172.21.15.26:0/788810096 >> 172.21.15.26:0/788810096 conn(0x7f48440f04c0 msgr2=0x7f48440f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:45:45.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.101+0000 7f48499d5700 1 -- 172.21.15.26:0/788810096 shutdown_connections 2021-11-03T18:45:45.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.101+0000 7f48499d5700 1 -- 172.21.15.26:0/788810096 wait complete. 2021-11-03T18:45:45.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.102+0000 7f48499d5700 1 Processor -- start 2021-11-03T18:45:45.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.102+0000 7f48499d5700 1 -- start start 2021-11-03T18:45:45.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.102+0000 7f48499d5700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48440f49a0 0x7f4844106fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:45:45.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.102+0000 7f48499d5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48440f5340 0x7f48441074b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:45:45.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.102+0000 7f48499d5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4844107a60 con 0x7f48440f5340 2021-11-03T18:45:45.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.102+0000 7f48499d5700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4844107ba0 con 0x7f48440f49a0 2021-11-03T18:45:45.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.102+0000 7f48427fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48440f5340 0x7f48441074b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:45:45.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.102+0000 7f48427fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48440f5340 0x7f48441074b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33608/0 (socket says 172.21.15.26:33608) 2021-11-03T18:45:45.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.102+0000 7f48427fc700 1 -- 172.21.15.26:0/2111341002 learned_addr learned my addr 172.21.15.26:0/2111341002 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:45:45.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.103+0000 7f4842ffd700 1 --2- 172.21.15.26:0/2111341002 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48440f49a0 0x7f4844106fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:45:45.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.103+0000 7f48427fc700 1 -- 172.21.15.26:0/2111341002 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48440f49a0 msgr2=0x7f4844106fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:45:45.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.103+0000 7f48427fc700 1 --2- 172.21.15.26:0/2111341002 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48440f49a0 0x7f4844106fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:45.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.103+0000 7f48427fc700 1 -- 172.21.15.26:0/2111341002 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f482c005040 con 0x7f48440f5340 2021-11-03T18:45:45.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.103+0000 7f48427fc700 1 --2- 172.21.15.26:0/2111341002 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48440f5340 0x7f48441074b0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 rx=0x7f483400c790 tx=0x7f4834007d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:45:45.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.103+0000 7f483b7fe700 1 -- 172.21.15.26:0/2111341002 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f483400e680 con 0x7f48440f5340 2021-11-03T18:45:45.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.103+0000 7f48499d5700 1 -- 172.21.15.26:0/2111341002 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4844108540 con 0x7f48440f5340 2021-11-03T18:45:45.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.103+0000 7f48499d5700 1 -- 172.21.15.26:0/2111341002 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4844108b00 con 0x7f48440f5340 2021-11-03T18:45:45.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.103+0000 7f483b7fe700 1 -- 172.21.15.26:0/2111341002 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f483400ec90 con 0x7f48440f5340 2021-11-03T18:45:45.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.103+0000 7f483b7fe700 1 -- 172.21.15.26:0/2111341002 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4834013cd0 con 0x7f48440f5340 2021-11-03T18:45:45.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.105+0000 7f48499d5700 1 -- 172.21.15.26:0/2111341002 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4828004fa0 con 0x7f48440f5340 2021-11-03T18:45:45.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.108+0000 7f483b7fe700 1 -- 172.21.15.26:0/2111341002 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f483401a060 con 0x7f48440f5340 2021-11-03T18:45:45.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.108+0000 7f483b7fe700 1 --2- 172.21.15.26:0/2111341002 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f48300640b0 0x7f4830066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:45:45.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.108+0000 7f483b7fe700 1 -- 172.21.15.26:0/2111341002 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f4834080a60 con 0x7f48440f5340 2021-11-03T18:45:45.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.108+0000 7f4842ffd700 1 --2- 172.21.15.26:0/2111341002 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f48300640b0 0x7f4830066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:45:45.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.109+0000 7f4842ffd700 1 --2- 172.21.15.26:0/2111341002 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f48300640b0 0x7f4830066570 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7f482c004e30 tx=0x7f482c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:45:45.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.110+0000 7f483b7fe700 1 -- 172.21.15.26:0/2111341002 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f4834052e00 con 0x7f48440f5340 2021-11-03T18:45:45.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.289+0000 7f48499d5700 1 -- 172.21.15.26:0/2111341002 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4828000bc0 con 0x7f48300640b0 2021-11-03T18:45:45.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.290+0000 7f483b7fe700 1 -- 172.21.15.26:0/2111341002 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f4828000bc0 con 0x7f48300640b0 2021-11-03T18:45:45.291 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.292+0000 7f48499d5700 1 -- 172.21.15.26:0/2111341002 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f48300640b0 msgr2=0x7f4830066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:45:45.291 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.292+0000 7f48499d5700 1 --2- 172.21.15.26:0/2111341002 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f48300640b0 0x7f4830066570 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7f482c004e30 tx=0x7f482c009b30).stop 2021-11-03T18:45:45.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.292+0000 7f48499d5700 1 -- 172.21.15.26:0/2111341002 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48440f5340 msgr2=0x7f48441074b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:45:45.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.292+0000 7f48499d5700 1 --2- 172.21.15.26:0/2111341002 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48440f5340 0x7f48441074b0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 rx=0x7f483400c790 tx=0x7f4834007d40).stop 2021-11-03T18:45:45.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.292+0000 7f48499d5700 1 -- 172.21.15.26:0/2111341002 shutdown_connections 2021-11-03T18:45:45.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.292+0000 7f48499d5700 1 --2- 172.21.15.26:0/2111341002 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f48300640b0 0x7f4830066570 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:45.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.292+0000 7f48499d5700 1 --2- 172.21.15.26:0/2111341002 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48440f49a0 0x7f4844106fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:45.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.292+0000 7f48499d5700 1 --2- 172.21.15.26:0/2111341002 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48440f5340 0x7f48441074b0 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:45.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.292+0000 7f48499d5700 1 -- 172.21.15.26:0/2111341002 >> 172.21.15.26:0/2111341002 conn(0x7f48440f04c0 msgr2=0x7f48440fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:45:45.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.292+0000 7f48499d5700 1 -- 172.21.15.26:0/2111341002 shutdown_connections 2021-11-03T18:45:45.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.292+0000 7f48499d5700 1 -- 172.21.15.26:0/2111341002 wait complete. 2021-11-03T18:45:45.301 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:45:45.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.392+0000 7f968467e700 1 -- 172.21.15.26:0/790106418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f967c0f49a0 msgr2=0x7f967c0f4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:45:45.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.392+0000 7f968467e700 1 --2- 172.21.15.26:0/790106418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f967c0f49a0 0x7f967c0f4dc0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 rx=0x7f9678004660 tx=0x7f9678009b30).stop 2021-11-03T18:45:45.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.392+0000 7f968467e700 1 -- 172.21.15.26:0/790106418 shutdown_connections 2021-11-03T18:45:45.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.392+0000 7f968467e700 1 --2- 172.21.15.26:0/790106418 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f967c0f5340 0x7f967c0f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:45.395 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.392+0000 7f968467e700 1 --2- 172.21.15.26:0/790106418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f967c0f49a0 0x7f967c0f4dc0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:45.395 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.392+0000 7f968467e700 1 -- 172.21.15.26:0/790106418 >> 172.21.15.26:0/790106418 conn(0x7f967c0f04c0 msgr2=0x7f967c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:45:45.395 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.393+0000 7f968467e700 1 -- 172.21.15.26:0/790106418 shutdown_connections 2021-11-03T18:45:45.395 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.393+0000 7f968467e700 1 -- 172.21.15.26:0/790106418 wait complete. 2021-11-03T18:45:45.396 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.393+0000 7f968467e700 1 Processor -- start 2021-11-03T18:45:45.396 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.393+0000 7f968467e700 1 -- start start 2021-11-03T18:45:45.396 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.393+0000 7f968467e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f967c0f49a0 0x7f967c106fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:45:45.396 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.393+0000 7f968467e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f967c0f5340 0x7f967c107490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:45:45.397 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.393+0000 7f968467e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967c107a40 con 0x7f967c0f49a0 2021-11-03T18:45:45.397 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.393+0000 7f968467e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967c107b80 con 0x7f967c0f5340 2021-11-03T18:45:45.397 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.393+0000 7f968241a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f967c0f49a0 0x7f967c106fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:45:45.397 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.393+0000 7f968241a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f967c0f49a0 0x7f967c106fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33614/0 (socket says 172.21.15.26:33614) 2021-11-03T18:45:45.398 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.393+0000 7f968241a700 1 -- 172.21.15.26:0/1687166833 learned_addr learned my addr 172.21.15.26:0/1687166833 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:45:45.398 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.394+0000 7f9681c19700 1 --2- 172.21.15.26:0/1687166833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f967c0f5340 0x7f967c107490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:45:45.398 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.394+0000 7f968241a700 1 -- 172.21.15.26:0/1687166833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f967c0f5340 msgr2=0x7f967c107490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:45:45.398 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.394+0000 7f968241a700 1 --2- 172.21.15.26:0/1687166833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f967c0f5340 0x7f967c107490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:45.399 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.394+0000 7f968241a700 1 -- 172.21.15.26:0/1687166833 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9678005040 con 0x7f967c0f49a0 2021-11-03T18:45:45.399 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.394+0000 7f9681c19700 1 --2- 172.21.15.26:0/1687166833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f967c0f5340 0x7f967c107490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:45:45.399 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.394+0000 7f968241a700 1 --2- 172.21.15.26:0/1687166833 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f967c0f49a0 0x7f967c106fa0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 rx=0x7f9678000c00 tx=0x7f9678009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:45:45.399 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.394+0000 7f9672ffd700 1 -- 172.21.15.26:0/1687166833 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9678018070 con 0x7f967c0f49a0 2021-11-03T18:45:45.399 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.394+0000 7f9672ffd700 1 -- 172.21.15.26:0/1687166833 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9678007d70 con 0x7f967c0f49a0 2021-11-03T18:45:45.400 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.394+0000 7f968467e700 1 -- 172.21.15.26:0/1687166833 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f967c1084c0 con 0x7f967c0f49a0 2021-11-03T18:45:45.400 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.394+0000 7f9672ffd700 1 -- 172.21.15.26:0/1687166833 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f967801c620 con 0x7f967c0f49a0 2021-11-03T18:45:45.400 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.394+0000 7f968467e700 1 -- 172.21.15.26:0/1687166833 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f967c108a20 con 0x7f967c0f49a0 2021-11-03T18:45:45.401 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.395+0000 7f968467e700 1 -- 172.21.15.26:0/1687166833 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f967c045ad0 con 0x7f967c0f49a0 2021-11-03T18:45:45.402 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.395+0000 7f9672ffd700 1 -- 172.21.15.26:0/1687166833 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f967801d420 con 0x7f967c0f49a0 2021-11-03T18:45:45.402 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.396+0000 7f9672ffd700 1 --2- 172.21.15.26:0/1687166833 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9668064090 0x7f9668066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:45:45.402 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.396+0000 7f9672ffd700 1 -- 172.21.15.26:0/1687166833 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f9678082620 con 0x7f967c0f49a0 2021-11-03T18:45:45.402 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.396+0000 7f9681c19700 1 --2- 172.21.15.26:0/1687166833 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9668064090 0x7f9668066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:45:45.403 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.396+0000 7f9681c19700 1 --2- 172.21.15.26:0/1687166833 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9668064090 0x7f9668066550 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7f967c0f5780 tx=0x7f966c009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:45:45.403 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.400+0000 7f9672ffd700 1 -- 172.21.15.26:0/1687166833 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f9678054980 con 0x7f967c0f49a0 2021-11-03T18:45:45.571 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.572+0000 7f968467e700 1 -- 172.21.15.26:0/1687166833 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f967c0fef50 con 0x7f9668064090 2021-11-03T18:45:45.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:45 smithi026 ceph-mon[96795]: pgmap v3332: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:45.587 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.588+0000 7f9672ffd700 1 -- 172.21.15.26:0/1687166833 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7f967c0fef50 con 0x7f9668064090 2021-11-03T18:45:45.588 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:45:45.588 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (116m) 4m ago 118m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:45:45.588 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (109m) 4m ago 118m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:45:45.588 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (109m) 3m ago 117m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:45:45.588 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (116m) 4m ago 117m 42.4M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:45:45.589 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (109m) 4m ago 113m 26.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:45:45.589 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (110m) 4m ago 113m 27.0M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:45:45.589 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (113m) 3m ago 113m 27.2M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:45:45.589 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (113m) 3m ago 113m 27.6M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:45:45.590 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (110m) 4m ago 119m 615M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:45:45.590 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (110m) 3m ago 117m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:45:45.590 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (110m) 4m ago 119m 407M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:45:45.590 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (109m) 3m ago 117m 187M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:45:45.591 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (117m) 4m ago 117m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:45:45.591 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (117m) 3m ago 117m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:45:45.591 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (108m) 4m ago 116m 372M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:45:45.591 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (108m) 4m ago 116m 400M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:45:45.591 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (107m) 4m ago 115m 332M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:45:45.592 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (107m) 3m ago 115m 438M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:45:45.592 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (106m) 3m ago 115m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:45:45.592 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (106m) 3m ago 114m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:45:45.592 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (116m) 4m ago 117m 70.2M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:45:45.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.590+0000 7f968467e700 1 -- 172.21.15.26:0/1687166833 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9668064090 msgr2=0x7f9668066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:45:45.593 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.590+0000 7f968467e700 1 --2- 172.21.15.26:0/1687166833 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9668064090 0x7f9668066550 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7f967c0f5780 tx=0x7f966c009040).stop 2021-11-03T18:45:45.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.590+0000 7f968467e700 1 -- 172.21.15.26:0/1687166833 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f967c0f49a0 msgr2=0x7f967c106fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:45:45.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.590+0000 7f968467e700 1 --2- 172.21.15.26:0/1687166833 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f967c0f49a0 0x7f967c106fa0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 rx=0x7f9678000c00 tx=0x7f9678009b30).stop 2021-11-03T18:45:45.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.590+0000 7f968467e700 1 -- 172.21.15.26:0/1687166833 shutdown_connections 2021-11-03T18:45:45.594 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.590+0000 7f968467e700 1 --2- 172.21.15.26:0/1687166833 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f9668064090 0x7f9668066550 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:45.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.590+0000 7f968467e700 1 --2- 172.21.15.26:0/1687166833 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f967c0f49a0 0x7f967c106fa0 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:45.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.590+0000 7f968467e700 1 --2- 172.21.15.26:0/1687166833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f967c0f5340 0x7f967c107490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:45.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.590+0000 7f968467e700 1 -- 172.21.15.26:0/1687166833 >> 172.21.15.26:0/1687166833 conn(0x7f967c0f04c0 msgr2=0x7f967c0fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:45:45.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.590+0000 7f968467e700 1 -- 172.21.15.26:0/1687166833 shutdown_connections 2021-11-03T18:45:45.595 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.590+0000 7f968467e700 1 -- 172.21.15.26:0/1687166833 wait complete. 2021-11-03T18:45:45.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.688+0000 7f46cb59e700 1 -- 172.21.15.26:0/70486478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46cc06b9c0 msgr2=0x7f46cc069ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:45:45.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.688+0000 7f46cb59e700 1 --2- 172.21.15.26:0/70486478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46cc06b9c0 0x7f46cc069ec0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 rx=0x7f46bc004660 tx=0x7f46bc009b30).stop 2021-11-03T18:45:45.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.689+0000 7f46cb59e700 1 -- 172.21.15.26:0/70486478 shutdown_connections 2021-11-03T18:45:45.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.689+0000 7f46cb59e700 1 --2- 172.21.15.26:0/70486478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46cc06a3b0 0x7f46cc06a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:45.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.689+0000 7f46cb59e700 1 --2- 172.21.15.26:0/70486478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46cc06b9c0 0x7f46cc069ec0 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:45.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.689+0000 7f46cb59e700 1 -- 172.21.15.26:0/70486478 >> 172.21.15.26:0/70486478 conn(0x7f46cc0f1cd0 msgr2=0x7f46cc0f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:45:45.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.689+0000 7f46cb59e700 1 -- 172.21.15.26:0/70486478 shutdown_connections 2021-11-03T18:45:45.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.689+0000 7f46cb59e700 1 -- 172.21.15.26:0/70486478 wait complete. 2021-11-03T18:45:45.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.689+0000 7f46cb59e700 1 Processor -- start 2021-11-03T18:45:45.692 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.689+0000 7f46cb59e700 1 -- start start 2021-11-03T18:45:45.692 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.689+0000 7f46cb59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46cc06a3b0 0x7f46cc10d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:45:45.692 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.689+0000 7f46cb59e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46cc06b9c0 0x7f46cc10d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:45:45.692 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.689+0000 7f46cb59e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46cc10ddc0 con 0x7f46cc06a3b0 2021-11-03T18:45:45.693 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.689+0000 7f46cb59e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46cc10df00 con 0x7f46cc06b9c0 2021-11-03T18:45:45.693 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.689+0000 7f46ca59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46cc06a3b0 0x7f46cc10d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:45:45.693 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.689+0000 7f46ca59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46cc06a3b0 0x7f46cc10d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33624/0 (socket says 172.21.15.26:33624) 2021-11-03T18:45:45.693 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.689+0000 7f46ca59c700 1 -- 172.21.15.26:0/780674523 learned_addr learned my addr 172.21.15.26:0/780674523 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:45:45.693 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.690+0000 7f46c9d9b700 1 --2- 172.21.15.26:0/780674523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46cc06b9c0 0x7f46cc10d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:45:45.694 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.690+0000 7f46ca59c700 1 -- 172.21.15.26:0/780674523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46cc06b9c0 msgr2=0x7f46cc10d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:45:45.694 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.690+0000 7f46ca59c700 1 --2- 172.21.15.26:0/780674523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46cc06b9c0 0x7f46cc10d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:45.694 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.690+0000 7f46ca59c700 1 -- 172.21.15.26:0/780674523 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46bc005040 con 0x7f46cc06a3b0 2021-11-03T18:45:45.694 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.690+0000 7f46c9d9b700 1 --2- 172.21.15.26:0/780674523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46cc06b9c0 0x7f46cc10d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:45:45.694 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.690+0000 7f46ca59c700 1 --2- 172.21.15.26:0/780674523 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46cc06a3b0 0x7f46cc10d320 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 rx=0x7f46bc009990 tx=0x7f46bc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:45:45.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.690+0000 7f46baffd700 1 -- 172.21.15.26:0/780674523 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46bc018070 con 0x7f46cc06a3b0 2021-11-03T18:45:45.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.690+0000 7f46baffd700 1 -- 172.21.15.26:0/780674523 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f46bc007ba0 con 0x7f46cc06a3b0 2021-11-03T18:45:45.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.690+0000 7f46cb59e700 1 -- 172.21.15.26:0/780674523 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46cc10e840 con 0x7f46cc06a3b0 2021-11-03T18:45:45.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.690+0000 7f46baffd700 1 -- 172.21.15.26:0/780674523 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46bc01c3c0 con 0x7f46cc06a3b0 2021-11-03T18:45:45.696 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.690+0000 7f46cb59e700 1 -- 172.21.15.26:0/780674523 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46cc10eda0 con 0x7f46cc06a3b0 2021-11-03T18:45:45.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.691+0000 7f46cb59e700 1 -- 172.21.15.26:0/780674523 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46cc045ad0 con 0x7f46cc06a3b0 2021-11-03T18:45:45.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.691+0000 7f46baffd700 1 -- 172.21.15.26:0/780674523 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f46bc01d420 con 0x7f46cc06a3b0 2021-11-03T18:45:45.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.692+0000 7f46baffd700 1 --2- 172.21.15.26:0/780674523 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f46b4064100 0x7f46b40665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:45:45.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.692+0000 7f46baffd700 1 -- 172.21.15.26:0/780674523 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f46bc082500 con 0x7f46cc06a3b0 2021-11-03T18:45:45.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.692+0000 7f46c9d9b700 1 --2- 172.21.15.26:0/780674523 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f46b4064100 0x7f46b40665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:45:45.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.692+0000 7f46c9d9b700 1 --2- 172.21.15.26:0/780674523 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f46b4064100 0x7f46b40665c0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 rx=0x7f46c0009740 tx=0x7f46c0009be0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:45:45.698 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.696+0000 7f46baffd700 1 -- 172.21.15.26:0/780674523 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f46bc0548c0 con 0x7f46cc06a3b0 2021-11-03T18:45:45.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:45 smithi194 ceph-mon[65619]: pgmap v3332: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:45.922 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.923+0000 7f46cb59e700 1 -- 172.21.15.26:0/780674523 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f46cc105460 con 0x7f46cc06a3b0 2021-11-03T18:45:45.923 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.924+0000 7f46baffd700 1 -- 172.21.15.26:0/780674523 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f46bc0544b0 con 0x7f46cc06a3b0 2021-11-03T18:45:45.924 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:45:45.924 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:45:45.924 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:45:45.924 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:45:45.924 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:45:45.925 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:45:45.925 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:45:45.925 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:45:45.925 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:45:45.926 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:45:45.926 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:45:45.926 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:45:45.926 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:45:45.927 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:45:45.927 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:45:45.927 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:45:45.927 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:45:45.927 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:45:45.928 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.926+0000 7f46cb59e700 1 -- 172.21.15.26:0/780674523 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f46b4064100 msgr2=0x7f46b40665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:45:45.928 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.926+0000 7f46cb59e700 1 --2- 172.21.15.26:0/780674523 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f46b4064100 0x7f46b40665c0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 rx=0x7f46c0009740 tx=0x7f46c0009be0).stop 2021-11-03T18:45:45.929 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.926+0000 7f46cb59e700 1 -- 172.21.15.26:0/780674523 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46cc06a3b0 msgr2=0x7f46cc10d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:45:45.929 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.926+0000 7f46cb59e700 1 --2- 172.21.15.26:0/780674523 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46cc06a3b0 0x7f46cc10d320 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 rx=0x7f46bc009990 tx=0x7f46bc009b30).stop 2021-11-03T18:45:45.929 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.926+0000 7f46cb59e700 1 -- 172.21.15.26:0/780674523 shutdown_connections 2021-11-03T18:45:45.929 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.926+0000 7f46cb59e700 1 --2- 172.21.15.26:0/780674523 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f46b4064100 0x7f46b40665c0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:45.929 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.926+0000 7f46cb59e700 1 --2- 172.21.15.26:0/780674523 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46cc06a3b0 0x7f46cc10d320 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:45.930 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.926+0000 7f46cb59e700 1 --2- 172.21.15.26:0/780674523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46cc06b9c0 0x7f46cc10d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:45.930 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.926+0000 7f46cb59e700 1 -- 172.21.15.26:0/780674523 >> 172.21.15.26:0/780674523 conn(0x7f46cc0f1cd0 msgr2=0x7f46cc0f8820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:45:45.930 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.926+0000 7f46cb59e700 1 -- 172.21.15.26:0/780674523 shutdown_connections 2021-11-03T18:45:45.930 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:45.926+0000 7f46cb59e700 1 -- 172.21.15.26:0/780674523 wait complete. 2021-11-03T18:45:46.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.026+0000 7f1e7c499700 1 -- 172.21.15.26:0/1561204363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e740f5ef0 msgr2=0x7f1e740f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:45:46.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.026+0000 7f1e7c499700 1 --2- 172.21.15.26:0/1561204363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e740f5ef0 0x7f1e740f6920 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 rx=0x7f1e70004660 tx=0x7f1e70009b30).stop 2021-11-03T18:45:46.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.026+0000 7f1e7c499700 1 -- 172.21.15.26:0/1561204363 shutdown_connections 2021-11-03T18:45:46.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.026+0000 7f1e7c499700 1 --2- 172.21.15.26:0/1561204363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e740f5ef0 0x7f1e740f6920 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:46.028 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.026+0000 7f1e7c499700 1 --2- 172.21.15.26:0/1561204363 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e740f55e0 0x7f1e740f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:46.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.026+0000 7f1e7c499700 1 -- 172.21.15.26:0/1561204363 >> 172.21.15.26:0/1561204363 conn(0x7f1e740f0de0 msgr2=0x7f1e740f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:45:46.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.026+0000 7f1e7c499700 1 -- 172.21.15.26:0/1561204363 shutdown_connections 2021-11-03T18:45:46.029 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.026+0000 7f1e7c499700 1 -- 172.21.15.26:0/1561204363 wait complete. 2021-11-03T18:45:46.030 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.026+0000 7f1e7c499700 1 Processor -- start 2021-11-03T18:45:46.030 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.026+0000 7f1e7c499700 1 -- start start 2021-11-03T18:45:46.030 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.027+0000 7f1e7c499700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e740f55e0 0x7f1e74105e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:45:46.030 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.027+0000 7f1e7c499700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e740f5ef0 0x7f1e74106380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:45:46.030 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.027+0000 7f1e7c499700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e74106930 con 0x7f1e740f55e0 2021-11-03T18:45:46.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.027+0000 7f1e7c499700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e74106a70 con 0x7f1e740f5ef0 2021-11-03T18:45:46.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.027+0000 7f1e7a235700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e740f55e0 0x7f1e74105e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:45:46.031 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.027+0000 7f1e7a235700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e740f55e0 0x7f1e74105e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33634/0 (socket says 172.21.15.26:33634) 2021-11-03T18:45:46.037 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.027+0000 7f1e7a235700 1 -- 172.21.15.26:0/1919930755 learned_addr learned my addr 172.21.15.26:0/1919930755 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:45:46.037 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.027+0000 7f1e79a34700 1 --2- 172.21.15.26:0/1919930755 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e740f5ef0 0x7f1e74106380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:45:46.037 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.027+0000 7f1e7a235700 1 -- 172.21.15.26:0/1919930755 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e740f5ef0 msgr2=0x7f1e74106380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:45:46.037 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.027+0000 7f1e7a235700 1 --2- 172.21.15.26:0/1919930755 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e740f5ef0 0x7f1e74106380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:46.038 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.027+0000 7f1e7a235700 1 -- 172.21.15.26:0/1919930755 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e70005040 con 0x7f1e740f55e0 2021-11-03T18:45:46.038 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.027+0000 7f1e7a235700 1 --2- 172.21.15.26:0/1919930755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e740f55e0 0x7f1e74105e90 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 rx=0x7f1e6400c530 tx=0x7f1e64007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:45:46.038 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.027+0000 7f1e6affd700 1 -- 172.21.15.26:0/1919930755 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e6400f650 con 0x7f1e740f55e0 2021-11-03T18:45:46.038 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.027+0000 7f1e6affd700 1 -- 172.21.15.26:0/1919930755 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1e6400fc60 con 0x7f1e740f55e0 2021-11-03T18:45:46.039 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.027+0000 7f1e7c499700 1 -- 172.21.15.26:0/1919930755 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e74107410 con 0x7f1e740f55e0 2021-11-03T18:45:46.039 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.027+0000 7f1e6affd700 1 -- 172.21.15.26:0/1919930755 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e64012cd0 con 0x7f1e740f55e0 2021-11-03T18:45:46.039 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.027+0000 7f1e7c499700 1 -- 172.21.15.26:0/1919930755 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e741079d0 con 0x7f1e740f55e0 2021-11-03T18:45:46.040 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.028+0000 7f1e7c499700 1 -- 172.21.15.26:0/1919930755 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e74045ad0 con 0x7f1e740f55e0 2021-11-03T18:45:46.041 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.029+0000 7f1e6affd700 1 -- 172.21.15.26:0/1919930755 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f1e64010070 con 0x7f1e740f55e0 2021-11-03T18:45:46.041 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.029+0000 7f1e6affd700 1 --2- 172.21.15.26:0/1919930755 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1e600640b0 0x7f1e60066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:45:46.041 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.029+0000 7f1e6affd700 1 -- 172.21.15.26:0/1919930755 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f1e640806e0 con 0x7f1e740f55e0 2021-11-03T18:45:46.041 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.029+0000 7f1e79a34700 1 --2- 172.21.15.26:0/1919930755 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1e600640b0 0x7f1e60066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:45:46.042 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.030+0000 7f1e79a34700 1 --2- 172.21.15.26:0/1919930755 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1e600640b0 0x7f1e60066570 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 rx=0x7f1e70004e30 tx=0x7f1e70009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:45:46.042 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.033+0000 7f1e6affd700 1 -- 172.21.15.26:0/1919930755 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f1e64052950 con 0x7f1e740f55e0 2021-11-03T18:45:46.235 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.236+0000 7f1e7c499700 1 -- 172.21.15.26:0/1919930755 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1e740fdee0 con 0x7f1e740f55e0 2021-11-03T18:45:46.235 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.236+0000 7f1e6affd700 1 -- 172.21.15.26:0/1919930755 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f1e64052540 con 0x7f1e740f55e0 2021-11-03T18:45:46.236 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:45:46.236 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:45:46.236 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:45:46.237 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:45:46.237 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:45:46.237 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:45:46.237 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:45:46.237 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:45:46.238 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:45:46.238 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:45:46.238 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:45:46.238 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:45:46.239 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:45:46.239 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:45:46.239 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:45:46.239 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:45:46.240 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:45:46.240 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:45:46.240 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:45:46.240 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:45:46.240 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:45:46.241 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:45:46.241 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:45:46.241 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:45:46.241 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:45:46.241 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:45:46.242 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:45:46.242 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:45:46.242 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:45:46.242 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:45:46.243 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:45:46.243 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:45:46.243 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:45:46.243 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:45:46.243 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:45:46.244 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:45:46.244 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:45:46.244 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:45:46.245 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:45:46.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.238+0000 7f1e7c499700 1 -- 172.21.15.26:0/1919930755 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1e600640b0 msgr2=0x7f1e60066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:45:46.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.238+0000 7f1e7c499700 1 --2- 172.21.15.26:0/1919930755 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1e600640b0 0x7f1e60066570 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 rx=0x7f1e70004e30 tx=0x7f1e70009b30).stop 2021-11-03T18:45:46.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.238+0000 7f1e7c499700 1 -- 172.21.15.26:0/1919930755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e740f55e0 msgr2=0x7f1e74105e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:45:46.246 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.238+0000 7f1e7c499700 1 --2- 172.21.15.26:0/1919930755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e740f55e0 0x7f1e74105e90 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 rx=0x7f1e6400c530 tx=0x7f1e64007e20).stop 2021-11-03T18:45:46.247 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.238+0000 7f1e7c499700 1 -- 172.21.15.26:0/1919930755 shutdown_connections 2021-11-03T18:45:46.247 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.238+0000 7f1e7c499700 1 --2- 172.21.15.26:0/1919930755 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1e600640b0 0x7f1e60066570 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:46.247 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.238+0000 7f1e7c499700 1 --2- 172.21.15.26:0/1919930755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1e740f55e0 0x7f1e74105e90 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:46.247 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.238+0000 7f1e7c499700 1 --2- 172.21.15.26:0/1919930755 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e740f5ef0 0x7f1e74106380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:45:46.247 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.238+0000 7f1e7c499700 1 -- 172.21.15.26:0/1919930755 >> 172.21.15.26:0/1919930755 conn(0x7f1e740f0de0 msgr2=0x7f1e740fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:45:46.248 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.238+0000 7f1e7c499700 1 -- 172.21.15.26:0/1919930755 shutdown_connections 2021-11-03T18:45:46.248 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:45:46.238+0000 7f1e7c499700 1 -- 172.21.15.26:0/1919930755 wait complete. 2021-11-03T18:45:46.248 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:45:46.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:46 smithi026 ceph-mon[96795]: from='client.37564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:45:46.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:46 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/780674523' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:45:46.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:46 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1919930755' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:45:46.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:46 smithi194 ceph-mon[65619]: from='client.37564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:45:46.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:46 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/780674523' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:45:46.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:46 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1919930755' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:45:47.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:47 smithi026 ceph-mon[96795]: from='client.37568 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:45:47.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:47 smithi026 ceph-mon[96795]: pgmap v3333: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:47.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:47 smithi194 ceph-mon[65619]: from='client.37568 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:45:47.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:47 smithi194 ceph-mon[65619]: pgmap v3333: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:49.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:49 smithi026 ceph-mon[96795]: pgmap v3334: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:49.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:45:49.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:45:49.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:49 smithi194 ceph-mon[65619]: pgmap v3334: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:49.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:45:49.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:45:51.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:51 smithi026 ceph-mon[96795]: pgmap v3335: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:51.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:51 smithi194 ceph-mon[65619]: pgmap v3335: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:52.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:52 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:45:52.319 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:52 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:45:53.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:53 smithi026 ceph-mon[96795]: poll took 60070.800 ms: 1 events 2021-11-03T18:45:53.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:53 smithi026 ceph-mon[96795]: pgmap v3336: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:53.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:53 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:45:53.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:53 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:45:53.677 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:53 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:45:53.677 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:53 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:45:53.677 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:53 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:45:53.678 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:53 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:45:53.678 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:53 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:45:53.678 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:53 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:45:53.679 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:53 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:45:53.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:53 smithi194 ceph-mon[65619]: poll took 60070.800 ms: 1 events 2021-11-03T18:45:53.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:53 smithi194 ceph-mon[65619]: pgmap v3336: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:53.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:53 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:45:53.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:53 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:45:53.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:53 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:45:53.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:53 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:45:53.754 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:53 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:45:53.754 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:53 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:45:53.754 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:53 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:45:53.754 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:53 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:45:53.755 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:53 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:45:55.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:55 smithi026 ceph-mon[96795]: pgmap v3337: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:55.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:55 smithi194 ceph-mon[65619]: pgmap v3337: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:57.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:57 smithi026 ceph-mon[96795]: pgmap v3338: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:57.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:57 smithi194 ceph-mon[65619]: pgmap v3338: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:59.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:45:59 smithi026 ceph-mon[96795]: pgmap v3339: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:45:59.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:45:59 smithi194 ceph-mon[65619]: pgmap v3339: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:01.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:01 smithi026 ceph-mon[96795]: pgmap v3340: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:01.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:01 smithi194 ceph-mon[65619]: pgmap v3340: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:03.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:03 smithi026 ceph-mon[96795]: pgmap v3341: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:03.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:03 smithi194 ceph-mon[65619]: pgmap v3341: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:05.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:05 smithi026 ceph-mon[96795]: pgmap v3342: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:05.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:05 smithi194 ceph-mon[65619]: pgmap v3342: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:07.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:07 smithi026 ceph-mon[96795]: pgmap v3343: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:07.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:07 smithi194 ceph-mon[65619]: pgmap v3343: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:08.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:08 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:46:08.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:08 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:46:08.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:08 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:46:08.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:08 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:46:09.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:09 smithi026 ceph-mon[96795]: pgmap v3344: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:09.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:09 smithi194 ceph-mon[65619]: pgmap v3344: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:11.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:11 smithi026 ceph-mon[96795]: pgmap v3345: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:11.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:11 smithi194 ceph-mon[65619]: pgmap v3345: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:13.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:13 smithi026 ceph-mon[96795]: pgmap v3346: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:13.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:13 smithi194 ceph-mon[65619]: pgmap v3346: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:15.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:15 smithi026 ceph-mon[96795]: pgmap v3347: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:15.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:15 smithi194 ceph-mon[65619]: pgmap v3347: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:16.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.355+0000 7f7053459700 1 -- 172.21.15.26:0/2231197162 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f704c0f77d0 msgr2=0x7f704c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:46:16.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.355+0000 7f7053459700 1 --2- 172.21.15.26:0/2231197162 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f704c0f77d0 0x7f704c0f7c30 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 rx=0x7f703c004660 tx=0x7f703c009b30).stop 2021-11-03T18:46:16.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.356+0000 7f7053459700 1 -- 172.21.15.26:0/2231197162 shutdown_connections 2021-11-03T18:46:16.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.356+0000 7f7053459700 1 --2- 172.21.15.26:0/2231197162 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f704c0f77d0 0x7f704c0f7c30 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:16.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.356+0000 7f7053459700 1 --2- 172.21.15.26:0/2231197162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f704c0f6530 0x7f704c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:16.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.356+0000 7f7053459700 1 -- 172.21.15.26:0/2231197162 >> 172.21.15.26:0/2231197162 conn(0x7f704c0f1cd0 msgr2=0x7f704c0f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:46:16.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.356+0000 7f7053459700 1 -- 172.21.15.26:0/2231197162 shutdown_connections 2021-11-03T18:46:16.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.356+0000 7f7053459700 1 -- 172.21.15.26:0/2231197162 wait complete. 2021-11-03T18:46:16.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.356+0000 7f7053459700 1 Processor -- start 2021-11-03T18:46:16.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.356+0000 7f7053459700 1 -- start start 2021-11-03T18:46:16.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.356+0000 7f7053459700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f704c0f6530 0x7f704c106d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:46:16.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.356+0000 7f7053459700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f704c0f77d0 0x7f704c107230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:46:16.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.356+0000 7f7053459700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704c1077e0 con 0x7f704c0f77d0 2021-11-03T18:46:16.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.356+0000 7f7053459700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704c107fe0 con 0x7f704c0f6530 2021-11-03T18:46:16.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.357+0000 7f7051c56700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f704c0f77d0 0x7f704c107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:46:16.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.357+0000 7f7051c56700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f704c0f77d0 0x7f704c107230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33654/0 (socket says 172.21.15.26:33654) 2021-11-03T18:46:16.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.357+0000 7f7051c56700 1 -- 172.21.15.26:0/347882050 learned_addr learned my addr 172.21.15.26:0/347882050 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:46:16.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.357+0000 7f7052457700 1 --2- 172.21.15.26:0/347882050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f704c0f6530 0x7f704c106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:46:16.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.357+0000 7f7051c56700 1 -- 172.21.15.26:0/347882050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f704c0f6530 msgr2=0x7f704c106d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:46:16.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.357+0000 7f7051c56700 1 --2- 172.21.15.26:0/347882050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f704c0f6530 0x7f704c106d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:16.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.357+0000 7f7051c56700 1 -- 172.21.15.26:0/347882050 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f703c005040 con 0x7f704c0f77d0 2021-11-03T18:46:16.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.357+0000 7f7051c56700 1 --2- 172.21.15.26:0/347882050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f704c0f77d0 0x7f704c107230 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 rx=0x7f703c009990 tx=0x7f703c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:46:16.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.357+0000 7f7042ffd700 1 -- 172.21.15.26:0/347882050 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f703c018070 con 0x7f704c0f77d0 2021-11-03T18:46:16.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.357+0000 7f7042ffd700 1 -- 172.21.15.26:0/347882050 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f703c007ba0 con 0x7f704c0f77d0 2021-11-03T18:46:16.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.357+0000 7f7053459700 1 -- 172.21.15.26:0/347882050 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f704c108260 con 0x7f704c0f77d0 2021-11-03T18:46:16.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.357+0000 7f7042ffd700 1 -- 172.21.15.26:0/347882050 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f703c01c3c0 con 0x7f704c0f77d0 2021-11-03T18:46:16.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.357+0000 7f7053459700 1 -- 172.21.15.26:0/347882050 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f704c1087c0 con 0x7f704c0f77d0 2021-11-03T18:46:16.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.358+0000 7f7053459700 1 -- 172.21.15.26:0/347882050 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f704c059100 con 0x7f704c0f77d0 2021-11-03T18:46:16.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.359+0000 7f7042ffd700 1 -- 172.21.15.26:0/347882050 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f703c01d420 con 0x7f704c0f77d0 2021-11-03T18:46:16.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.359+0000 7f7042ffd700 1 --2- 172.21.15.26:0/347882050 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7038064100 0x7f70380665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:46:16.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.359+0000 7f7042ffd700 1 -- 172.21.15.26:0/347882050 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f703c082360 con 0x7f704c0f77d0 2021-11-03T18:46:16.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.359+0000 7f7052457700 1 --2- 172.21.15.26:0/347882050 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7038064100 0x7f70380665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:46:16.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.360+0000 7f7052457700 1 --2- 172.21.15.26:0/347882050 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7038064100 0x7f70380665c0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7f704c0f7630 tx=0x7f7048009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:46:16.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.363+0000 7f7042ffd700 1 -- 172.21.15.26:0/347882050 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f703c054720 con 0x7f704c0f77d0 2021-11-03T18:46:16.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.542+0000 7f7053459700 1 -- 172.21.15.26:0/347882050 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f704c0fed60 con 0x7f7038064100 2021-11-03T18:46:16.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.543+0000 7f7042ffd700 1 -- 172.21.15.26:0/347882050 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f704c0fed60 con 0x7f7038064100 2021-11-03T18:46:16.543 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.545+0000 7f7053459700 1 -- 172.21.15.26:0/347882050 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7038064100 msgr2=0x7f70380665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:46:16.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.545+0000 7f7053459700 1 --2- 172.21.15.26:0/347882050 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7038064100 0x7f70380665c0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7f704c0f7630 tx=0x7f7048009040).stop 2021-11-03T18:46:16.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.545+0000 7f7053459700 1 -- 172.21.15.26:0/347882050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f704c0f77d0 msgr2=0x7f704c107230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:46:16.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.545+0000 7f7053459700 1 --2- 172.21.15.26:0/347882050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f704c0f77d0 0x7f704c107230 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 rx=0x7f703c009990 tx=0x7f703c009b30).stop 2021-11-03T18:46:16.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.545+0000 7f7053459700 1 -- 172.21.15.26:0/347882050 shutdown_connections 2021-11-03T18:46:16.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.545+0000 7f7053459700 1 --2- 172.21.15.26:0/347882050 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7038064100 0x7f70380665c0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:16.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.545+0000 7f7053459700 1 --2- 172.21.15.26:0/347882050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f704c0f6530 0x7f704c106d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:16.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.545+0000 7f7053459700 1 --2- 172.21.15.26:0/347882050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f704c0f77d0 0x7f704c107230 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:16.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.545+0000 7f7053459700 1 -- 172.21.15.26:0/347882050 >> 172.21.15.26:0/347882050 conn(0x7f704c0f1cd0 msgr2=0x7f704c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:46:16.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.545+0000 7f7053459700 1 -- 172.21.15.26:0/347882050 shutdown_connections 2021-11-03T18:46:16.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.545+0000 7f7053459700 1 -- 172.21.15.26:0/347882050 wait complete. 2021-11-03T18:46:16.553 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:46:16.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.645+0000 7ffa5a477700 1 -- 172.21.15.26:0/368643155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa540f77d0 msgr2=0x7ffa540f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:46:16.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.645+0000 7ffa5a477700 1 --2- 172.21.15.26:0/368643155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa540f77d0 0x7ffa540f7c30 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 rx=0x7ffa48004660 tx=0x7ffa48009b30).stop 2021-11-03T18:46:16.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.645+0000 7ffa5a477700 1 -- 172.21.15.26:0/368643155 shutdown_connections 2021-11-03T18:46:16.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.645+0000 7ffa5a477700 1 --2- 172.21.15.26:0/368643155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa540f77d0 0x7ffa540f7c30 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:16.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.645+0000 7ffa5a477700 1 --2- 172.21.15.26:0/368643155 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa540f6530 0x7ffa540f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:16.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.645+0000 7ffa5a477700 1 -- 172.21.15.26:0/368643155 >> 172.21.15.26:0/368643155 conn(0x7ffa540f1cd0 msgr2=0x7ffa540f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:46:16.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.645+0000 7ffa5a477700 1 -- 172.21.15.26:0/368643155 shutdown_connections 2021-11-03T18:46:16.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.645+0000 7ffa5a477700 1 -- 172.21.15.26:0/368643155 wait complete. 2021-11-03T18:46:16.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.646+0000 7ffa5a477700 1 Processor -- start 2021-11-03T18:46:16.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.646+0000 7ffa5a477700 1 -- start start 2021-11-03T18:46:16.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.646+0000 7ffa5a477700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa540f6530 0x7ffa54106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:46:16.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.646+0000 7ffa5a477700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa540f77d0 0x7ffa54107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:46:16.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.646+0000 7ffa5a477700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa54107870 con 0x7ffa540f77d0 2021-11-03T18:46:16.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.646+0000 7ffa5a477700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa54108080 con 0x7ffa540f6530 2021-11-03T18:46:16.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.646+0000 7ffa58c74700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa540f77d0 0x7ffa54107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:46:16.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.646+0000 7ffa58c74700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa540f77d0 0x7ffa54107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33664/0 (socket says 172.21.15.26:33664) 2021-11-03T18:46:16.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.646+0000 7ffa58c74700 1 -- 172.21.15.26:0/757450462 learned_addr learned my addr 172.21.15.26:0/757450462 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:46:16.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.646+0000 7ffa58c74700 1 -- 172.21.15.26:0/757450462 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa540f6530 msgr2=0x7ffa54106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:46:16.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.646+0000 7ffa58c74700 1 --2- 172.21.15.26:0/757450462 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa540f6530 0x7ffa54106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:46:16.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.646+0000 7ffa58c74700 1 -- 172.21.15.26:0/757450462 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa48005040 con 0x7ffa540f77d0 2021-11-03T18:46:16.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.646+0000 7ffa58c74700 1 --2- 172.21.15.26:0/757450462 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa540f77d0 0x7ffa54107270 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 rx=0x7ffa48009990 tx=0x7ffa48009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:46:16.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.647+0000 7ffa45ffb700 1 -- 172.21.15.26:0/757450462 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa48018070 con 0x7ffa540f77d0 2021-11-03T18:46:16.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.647+0000 7ffa45ffb700 1 -- 172.21.15.26:0/757450462 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ffa48007ba0 con 0x7ffa540f77d0 2021-11-03T18:46:16.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.647+0000 7ffa5a477700 1 -- 172.21.15.26:0/757450462 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa541082a0 con 0x7ffa540f77d0 2021-11-03T18:46:16.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.647+0000 7ffa45ffb700 1 -- 172.21.15.26:0/757450462 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa4801c3c0 con 0x7ffa540f77d0 2021-11-03T18:46:16.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.647+0000 7ffa5a477700 1 -- 172.21.15.26:0/757450462 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa54108800 con 0x7ffa540f77d0 2021-11-03T18:46:16.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.648+0000 7ffa5a477700 1 -- 172.21.15.26:0/757450462 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa54059100 con 0x7ffa540f77d0 2021-11-03T18:46:16.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.648+0000 7ffa45ffb700 1 -- 172.21.15.26:0/757450462 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ffa4801d420 con 0x7ffa540f77d0 2021-11-03T18:46:16.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.649+0000 7ffa45ffb700 1 --2- 172.21.15.26:0/757450462 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffa40064100 0x7ffa400665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:46:16.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.649+0000 7ffa45ffb700 1 -- 172.21.15.26:0/757450462 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ffa48082430 con 0x7ffa540f77d0 2021-11-03T18:46:16.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.649+0000 7ffa59475700 1 --2- 172.21.15.26:0/757450462 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffa40064100 0x7ffa400665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:46:16.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.649+0000 7ffa59475700 1 --2- 172.21.15.26:0/757450462 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffa40064100 0x7ffa400665c0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7ffa54106af0 tx=0x7ffa500099e0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:46:16.653 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.653+0000 7ffa45ffb700 1 -- 172.21.15.26:0/757450462 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ffa480547f0 con 0x7ffa540f77d0 2021-11-03T18:46:16.822 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.823+0000 7ffa5a477700 1 -- 172.21.15.26:0/757450462 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa540fee30 con 0x7ffa40064100 2021-11-03T18:46:16.836 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.838+0000 7ffa45ffb700 1 -- 172.21.15.26:0/757450462 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7ffa540fee30 con 0x7ffa40064100 2021-11-03T18:46:16.837 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:46:16.837 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (117m) 5m ago 118m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:46:16.837 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (109m) 5m ago 118m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:46:16.838 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (109m) 4m ago 117m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:46:16.838 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (117m) 5m ago 118m 42.4M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:46:16.838 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (110m) 5m ago 113m 26.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:46:16.838 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (110m) 5m ago 113m 27.0M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:46:16.839 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (113m) 4m ago 113m 27.2M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:46:16.839 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (113m) 4m ago 113m 27.6M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:46:16.839 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (111m) 5m ago 2h 615M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:46:16.839 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (110m) 4m ago 117m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:46:16.840 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (110m) 5m ago 2h 407M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:46:16.840 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (110m) 4m ago 117m 187M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:46:16.840 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (118m) 5m ago 118m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:46:16.840 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (117m) 4m ago 117m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:46:16.840 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (109m) 5m ago 117m 372M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:46:16.841 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (108m) 5m ago 116m 400M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:46:16.841 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (108m) 5m ago 116m 332M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:46:16.841 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (107m) 4m ago 116m 438M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:46:16.841 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (107m) 4m ago 115m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:46:16.841 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (106m) 4m ago 115m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:46:16.842 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (117m) 5m ago 118m 70.2M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:46:16.843 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.840+0000 7ffa5a477700 1 -- 172.21.15.26:0/757450462 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffa40064100 msgr2=0x7ffa400665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:46:16.843 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.840+0000 7ffa5a477700 1 --2- 172.21.15.26:0/757450462 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffa40064100 0x7ffa400665c0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7ffa54106af0 tx=0x7ffa500099e0).stop 2021-11-03T18:46:16.843 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.840+0000 7ffa5a477700 1 -- 172.21.15.26:0/757450462 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa540f77d0 msgr2=0x7ffa54107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:46:16.843 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.840+0000 7ffa5a477700 1 --2- 172.21.15.26:0/757450462 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa540f77d0 0x7ffa54107270 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 rx=0x7ffa48009990 tx=0x7ffa48009b30).stop 2021-11-03T18:46:16.844 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.840+0000 7ffa5a477700 1 -- 172.21.15.26:0/757450462 shutdown_connections 2021-11-03T18:46:16.844 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.840+0000 7ffa5a477700 1 --2- 172.21.15.26:0/757450462 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ffa40064100 0x7ffa400665c0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:16.844 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.840+0000 7ffa5a477700 1 --2- 172.21.15.26:0/757450462 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa540f6530 0x7ffa54106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:46:16.844 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.840+0000 7ffa5a477700 1 --2- 172.21.15.26:0/757450462 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa540f77d0 0x7ffa54107270 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:16.844 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.840+0000 7ffa5a477700 1 -- 172.21.15.26:0/757450462 >> 172.21.15.26:0/757450462 conn(0x7ffa540f1cd0 msgr2=0x7ffa540fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:46:16.845 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.840+0000 7ffa5a477700 1 -- 172.21.15.26:0/757450462 shutdown_connections 2021-11-03T18:46:16.845 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.840+0000 7ffa5a477700 1 -- 172.21.15.26:0/757450462 wait complete. 2021-11-03T18:46:16.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.939+0000 7fd2ab0a4700 1 -- 172.21.15.26:0/1363510592 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2a4060270 msgr2=0x7fd2a40f91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:46:16.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.939+0000 7fd2ab0a4700 1 --2- 172.21.15.26:0/1363510592 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2a4060270 0x7fd2a40f91c0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 rx=0x7fd2a0004660 tx=0x7fd2a0009b30).stop 2021-11-03T18:46:16.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.939+0000 7fd2ab0a4700 1 -- 172.21.15.26:0/1363510592 shutdown_connections 2021-11-03T18:46:16.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.939+0000 7fd2ab0a4700 1 --2- 172.21.15.26:0/1363510592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2a40f96b0 0x7fd2a40fbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:16.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.939+0000 7fd2ab0a4700 1 --2- 172.21.15.26:0/1363510592 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2a4060270 0x7fd2a40f91c0 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:16.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.939+0000 7fd2ab0a4700 1 -- 172.21.15.26:0/1363510592 >> 172.21.15.26:0/1363510592 conn(0x7fd2a40f0ba0 msgr2=0x7fd2a40f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:46:16.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.940+0000 7fd2ab0a4700 1 -- 172.21.15.26:0/1363510592 shutdown_connections 2021-11-03T18:46:16.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.940+0000 7fd2ab0a4700 1 -- 172.21.15.26:0/1363510592 wait complete. 2021-11-03T18:46:16.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.940+0000 7fd2ab0a4700 1 Processor -- start 2021-11-03T18:46:16.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.940+0000 7fd2ab0a4700 1 -- start start 2021-11-03T18:46:16.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.940+0000 7fd2ab0a4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2a4060270 0x7fd2a4106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:46:16.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.940+0000 7fd2ab0a4700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2a40f96b0 0x7fd2a4107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:46:16.943 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.940+0000 7fd2ab0a4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a4107910 con 0x7fd2a4060270 2021-11-03T18:46:16.943 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.940+0000 7fd2ab0a4700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a4108120 con 0x7fd2a40f96b0 2021-11-03T18:46:16.943 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.940+0000 7fd2aa0a2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2a4060270 0x7fd2a4106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:46:16.943 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.940+0000 7fd2aa0a2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2a4060270 0x7fd2a4106e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33672/0 (socket says 172.21.15.26:33672) 2021-11-03T18:46:16.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.940+0000 7fd2aa0a2700 1 -- 172.21.15.26:0/3973748119 learned_addr learned my addr 172.21.15.26:0/3973748119 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:46:16.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.941+0000 7fd2aa0a2700 1 -- 172.21.15.26:0/3973748119 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2a40f96b0 msgr2=0x7fd2a4107310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:46:16.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.941+0000 7fd2aa0a2700 1 --2- 172.21.15.26:0/3973748119 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2a40f96b0 0x7fd2a4107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:46:16.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.941+0000 7fd2aa0a2700 1 -- 172.21.15.26:0/3973748119 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a0005040 con 0x7fd2a4060270 2021-11-03T18:46:16.944 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.941+0000 7fd2aa0a2700 1 --2- 172.21.15.26:0/3973748119 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2a4060270 0x7fd2a4106e20 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 rx=0x7fd2a0009990 tx=0x7fd2a0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:46:16.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.941+0000 7fd29affd700 1 -- 172.21.15.26:0/3973748119 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2a0018070 con 0x7fd2a4060270 2021-11-03T18:46:16.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.941+0000 7fd29affd700 1 -- 172.21.15.26:0/3973748119 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd2a0007ba0 con 0x7fd2a4060270 2021-11-03T18:46:16.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.941+0000 7fd2ab0a4700 1 -- 172.21.15.26:0/3973748119 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2a4108340 con 0x7fd2a4060270 2021-11-03T18:46:16.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.941+0000 7fd29affd700 1 -- 172.21.15.26:0/3973748119 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2a001c3c0 con 0x7fd2a4060270 2021-11-03T18:46:16.945 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.941+0000 7fd2ab0a4700 1 -- 172.21.15.26:0/3973748119 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2a41088a0 con 0x7fd2a4060270 2021-11-03T18:46:16.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.942+0000 7fd2ab0a4700 1 -- 172.21.15.26:0/3973748119 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2a4059100 con 0x7fd2a4060270 2021-11-03T18:46:16.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.942+0000 7fd29affd700 1 -- 172.21.15.26:0/3973748119 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fd2a001d420 con 0x7fd2a4060270 2021-11-03T18:46:16.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.943+0000 7fd29affd700 1 --2- 172.21.15.26:0/3973748119 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd290064100 0x7fd2900665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:46:16.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.943+0000 7fd29affd700 1 -- 172.21.15.26:0/3973748119 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fd2a00825d0 con 0x7fd2a4060270 2021-11-03T18:46:16.947 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.943+0000 7fd2a98a1700 1 --2- 172.21.15.26:0/3973748119 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd290064100 0x7fd2900665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:46:16.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.943+0000 7fd2a98a1700 1 --2- 172.21.15.26:0/3973748119 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd290064100 0x7fd2900665c0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7fd2a4060040 tx=0x7fd2940099e0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:46:16.948 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:16.947+0000 7fd29affd700 1 -- 172.21.15.26:0/3973748119 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fd2a00549f0 con 0x7fd2a4060270 2021-11-03T18:46:17.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.181+0000 7fd2ab0a4700 1 -- 172.21.15.26:0/3973748119 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd2a40fed30 con 0x7fd2a4060270 2021-11-03T18:46:17.180 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.181+0000 7fd29affd700 1 -- 172.21.15.26:0/3973748119 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fd2a00545e0 con 0x7fd2a4060270 2021-11-03T18:46:17.180 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:46:17.180 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:46:17.181 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:46:17.182 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:46:17.182 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:46:17.183 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:46:17.183 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:46:17.183 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:46:17.183 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:46:17.184 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:46:17.184 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:46:17.184 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:46:17.184 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:46:17.185 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:46:17.185 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:46:17.185 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:46:17.185 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:46:17.186 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:46:17.186 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.183+0000 7fd2ab0a4700 1 -- 172.21.15.26:0/3973748119 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd290064100 msgr2=0x7fd2900665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:46:17.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.183+0000 7fd2ab0a4700 1 --2- 172.21.15.26:0/3973748119 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd290064100 0x7fd2900665c0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7fd2a4060040 tx=0x7fd2940099e0).stop 2021-11-03T18:46:17.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.183+0000 7fd2ab0a4700 1 -- 172.21.15.26:0/3973748119 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2a4060270 msgr2=0x7fd2a4106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:46:17.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.183+0000 7fd2ab0a4700 1 --2- 172.21.15.26:0/3973748119 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2a4060270 0x7fd2a4106e20 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 rx=0x7fd2a0009990 tx=0x7fd2a0009b30).stop 2021-11-03T18:46:17.187 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.183+0000 7fd2ab0a4700 1 -- 172.21.15.26:0/3973748119 shutdown_connections 2021-11-03T18:46:17.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.183+0000 7fd2ab0a4700 1 --2- 172.21.15.26:0/3973748119 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd290064100 0x7fd2900665c0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:17.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.183+0000 7fd2ab0a4700 1 --2- 172.21.15.26:0/3973748119 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2a4060270 0x7fd2a4106e20 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:17.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.183+0000 7fd2ab0a4700 1 --2- 172.21.15.26:0/3973748119 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2a40f96b0 0x7fd2a4107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:46:17.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.183+0000 7fd2ab0a4700 1 -- 172.21.15.26:0/3973748119 >> 172.21.15.26:0/3973748119 conn(0x7fd2a40f0ba0 msgr2=0x7fd2a40f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:46:17.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.183+0000 7fd2ab0a4700 1 -- 172.21.15.26:0/3973748119 shutdown_connections 2021-11-03T18:46:17.189 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.183+0000 7fd2ab0a4700 1 -- 172.21.15.26:0/3973748119 wait complete. 2021-11-03T18:46:17.284 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.284+0000 7ff94c050700 1 -- 172.21.15.26:0/3608697605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9440f66e0 msgr2=0x7ff9440f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:46:17.284 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.284+0000 7ff94c050700 1 --2- 172.21.15.26:0/3608697605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9440f66e0 0x7ff9440f6b00 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 rx=0x7ff940004660 tx=0x7ff940009b30).stop 2021-11-03T18:46:17.285 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.284+0000 7ff94c050700 1 -- 172.21.15.26:0/3608697605 shutdown_connections 2021-11-03T18:46:17.285 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.284+0000 7ff94c050700 1 --2- 172.21.15.26:0/3608697605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9440f7980 0x7ff9440f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:17.285 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.284+0000 7ff94c050700 1 --2- 172.21.15.26:0/3608697605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9440f66e0 0x7ff9440f6b00 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:17.286 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.284+0000 7ff94c050700 1 -- 172.21.15.26:0/3608697605 >> 172.21.15.26:0/3608697605 conn(0x7ff9440f1e40 msgr2=0x7ff9440f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:46:17.286 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.284+0000 7ff94c050700 1 -- 172.21.15.26:0/3608697605 shutdown_connections 2021-11-03T18:46:17.286 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.284+0000 7ff94c050700 1 -- 172.21.15.26:0/3608697605 wait complete. 2021-11-03T18:46:17.286 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.285+0000 7ff94c050700 1 Processor -- start 2021-11-03T18:46:17.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.285+0000 7ff94c050700 1 -- start start 2021-11-03T18:46:17.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.285+0000 7ff94c050700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9440f66e0 0x7ff944106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:46:17.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.285+0000 7ff94c050700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9440f7980 0x7ff9441074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:46:17.287 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.285+0000 7ff94c050700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff944107a50 con 0x7ff9440f66e0 2021-11-03T18:46:17.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.285+0000 7ff94c050700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff944107b90 con 0x7ff9440f7980 2021-11-03T18:46:17.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.285+0000 7ff949dec700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9440f66e0 0x7ff944106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:46:17.288 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.285+0000 7ff949dec700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9440f66e0 0x7ff944106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33682/0 (socket says 172.21.15.26:33682) 2021-11-03T18:46:17.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.285+0000 7ff949dec700 1 -- 172.21.15.26:0/1091025768 learned_addr learned my addr 172.21.15.26:0/1091025768 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:46:17.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.285+0000 7ff9495eb700 1 --2- 172.21.15.26:0/1091025768 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9440f7980 0x7ff9441074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:46:17.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.285+0000 7ff949dec700 1 -- 172.21.15.26:0/1091025768 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9440f7980 msgr2=0x7ff9441074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:46:17.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.285+0000 7ff949dec700 1 --2- 172.21.15.26:0/1091025768 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9440f7980 0x7ff9441074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:17.289 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.285+0000 7ff949dec700 1 -- 172.21.15.26:0/1091025768 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff940005040 con 0x7ff9440f66e0 2021-11-03T18:46:17.290 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.285+0000 7ff949dec700 1 --2- 172.21.15.26:0/1091025768 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9440f66e0 0x7ff944106fb0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 rx=0x7ff940013a70 tx=0x7ff940009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:46:17.290 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.285+0000 7ff93a7fc700 1 -- 172.21.15.26:0/1091025768 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff940018070 con 0x7ff9440f66e0 2021-11-03T18:46:17.290 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.286+0000 7ff94c050700 1 -- 172.21.15.26:0/1091025768 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9441084d0 con 0x7ff9440f66e0 2021-11-03T18:46:17.290 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.286+0000 7ff93a7fc700 1 -- 172.21.15.26:0/1091025768 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff9400097d0 con 0x7ff9440f66e0 2021-11-03T18:46:17.291 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.286+0000 7ff93a7fc700 1 -- 172.21.15.26:0/1091025768 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff94001c3c0 con 0x7ff9440f66e0 2021-11-03T18:46:17.291 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.286+0000 7ff94c050700 1 -- 172.21.15.26:0/1091025768 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff944108a30 con 0x7ff9440f66e0 2021-11-03T18:46:17.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.286+0000 7ff94c050700 1 -- 172.21.15.26:0/1091025768 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff944045ad0 con 0x7ff9440f66e0 2021-11-03T18:46:17.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.287+0000 7ff93a7fc700 1 -- 172.21.15.26:0/1091025768 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ff940007ba0 con 0x7ff9440f66e0 2021-11-03T18:46:17.292 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.287+0000 7ff93a7fc700 1 --2- 172.21.15.26:0/1091025768 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff9300640b0 0x7ff930066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:46:17.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.287+0000 7ff93a7fc700 1 -- 172.21.15.26:0/1091025768 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ff9400824b0 con 0x7ff9440f66e0 2021-11-03T18:46:17.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.287+0000 7ff9495eb700 1 --2- 172.21.15.26:0/1091025768 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff9300640b0 0x7ff930066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:46:17.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.288+0000 7ff9495eb700 1 --2- 172.21.15.26:0/1091025768 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff9300640b0 0x7ff930066570 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7ff9340096c0 tx=0x7ff934009be0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:46:17.293 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.291+0000 7ff93a7fc700 1 -- 172.21.15.26:0/1091025768 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ff940054810 con 0x7ff9440f66e0 2021-11-03T18:46:17.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.497+0000 7ff94c050700 1 -- 172.21.15.26:0/1091025768 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff9440fefb0 con 0x7ff9440f66e0 2021-11-03T18:46:17.496 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.498+0000 7ff93a7fc700 1 -- 172.21.15.26:0/1091025768 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7ff940054400 con 0x7ff9440f66e0 2021-11-03T18:46:17.496 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:46:17.497 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:46:17.497 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:46:17.497 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:46:17.497 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:46:17.498 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:46:17.498 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:46:17.498 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:46:17.498 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:46:17.499 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:46:17.499 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:46:17.499 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:46:17.499 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:46:17.500 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:46:17.500 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:46:17.500 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:46:17.500 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:46:17.501 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:46:17.501 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:46:17.501 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:46:17.501 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:46:17.502 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:46:17.502 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:46:17.502 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:46:17.502 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:46:17.502 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:46:17.503 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:46:17.503 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:46:17.503 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:46:17.503 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:46:17.504 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:46:17.504 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:46:17.504 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:46:17.504 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:46:17.505 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:46:17.505 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:46:17.505 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:46:17.505 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:46:17.505 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:46:17.507 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.499+0000 7ff94c050700 1 -- 172.21.15.26:0/1091025768 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff9300640b0 msgr2=0x7ff930066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:46:17.507 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.499+0000 7ff94c050700 1 --2- 172.21.15.26:0/1091025768 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff9300640b0 0x7ff930066570 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7ff9340096c0 tx=0x7ff934009be0).stop 2021-11-03T18:46:17.507 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.499+0000 7ff94c050700 1 -- 172.21.15.26:0/1091025768 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9440f66e0 msgr2=0x7ff944106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:46:17.507 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.499+0000 7ff94c050700 1 --2- 172.21.15.26:0/1091025768 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9440f66e0 0x7ff944106fb0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 rx=0x7ff940013a70 tx=0x7ff940009b30).stop 2021-11-03T18:46:17.508 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.499+0000 7ff94c050700 1 -- 172.21.15.26:0/1091025768 shutdown_connections 2021-11-03T18:46:17.508 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.499+0000 7ff94c050700 1 --2- 172.21.15.26:0/1091025768 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff9300640b0 0x7ff930066570 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:17.508 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.499+0000 7ff94c050700 1 --2- 172.21.15.26:0/1091025768 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9440f66e0 0x7ff944106fb0 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:17.508 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.499+0000 7ff94c050700 1 --2- 172.21.15.26:0/1091025768 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9440f7980 0x7ff9441074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:17.508 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.499+0000 7ff94c050700 1 -- 172.21.15.26:0/1091025768 >> 172.21.15.26:0/1091025768 conn(0x7ff9440f1e40 msgr2=0x7ff9440fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:46:17.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.499+0000 7ff94c050700 1 -- 172.21.15.26:0/1091025768 shutdown_connections 2021-11-03T18:46:17.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:17.499+0000 7ff94c050700 1 -- 172.21.15.26:0/1091025768 wait complete. 2021-11-03T18:46:17.509 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:46:17.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:17 smithi026 ceph-mon[96795]: pgmap v3348: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:17.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:17 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3973748119' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:46:17.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:17 smithi194 ceph-mon[65619]: pgmap v3348: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:17.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:17 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3973748119' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:46:18.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:18 smithi026 ceph-mon[96795]: from='client.37580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:46:18.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:18 smithi026 ceph-mon[96795]: from='client.37584 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:46:18.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:18 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1091025768' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:46:18.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:18 smithi194 ceph-mon[65619]: from='client.37580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:46:18.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:18 smithi194 ceph-mon[65619]: from='client.37584 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:46:18.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:18 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1091025768' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:46:19.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:19 smithi026 ceph-mon[96795]: pgmap v3349: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:19.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:19 smithi194 ceph-mon[65619]: pgmap v3349: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:21.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:21 smithi026 ceph-mon[96795]: pgmap v3350: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:21.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:21 smithi194 ceph-mon[65619]: pgmap v3350: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:23.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:23 smithi026 ceph-mon[96795]: pgmap v3351: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:23.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:23 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:46:23.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:23 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:46:23.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:23 smithi194 ceph-mon[65619]: pgmap v3351: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:23.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:23 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:46:23.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:23 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:46:25.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:25 smithi026 ceph-mon[96795]: pgmap v3352: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:25.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:25 smithi194 ceph-mon[65619]: pgmap v3352: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:27.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:27 smithi026 ceph-mon[96795]: pgmap v3353: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:27.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:27 smithi194 ceph-mon[65619]: pgmap v3353: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:29.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:29 smithi026 ceph-mon[96795]: pgmap v3354: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:29.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:29 smithi194 ceph-mon[65619]: pgmap v3354: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:31.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:31 smithi026 ceph-mon[96795]: pgmap v3355: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:31.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:31 smithi194 ceph-mon[65619]: pgmap v3355: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:33.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:33 smithi026 ceph-mon[96795]: pgmap v3356: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:33.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:33 smithi194 ceph-mon[65619]: pgmap v3356: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:35.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:35 smithi026 ceph-mon[96795]: pgmap v3357: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:35.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:35 smithi194 ceph-mon[65619]: pgmap v3357: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:37.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:37 smithi026 ceph-mon[96795]: pgmap v3358: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:37.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:37 smithi194 ceph-mon[65619]: pgmap v3358: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:38.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:38 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:46:38.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:38 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:46:38.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:38 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:46:38.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:38 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:46:39.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:39 smithi026 ceph-mon[96795]: pgmap v3359: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:39.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:39 smithi194 ceph-mon[65619]: pgmap v3359: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:41.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:41 smithi026 ceph-mon[96795]: pgmap v3360: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:41.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:41 smithi194 ceph-mon[65619]: pgmap v3360: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:43.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:43 smithi026 ceph-mon[96795]: pgmap v3361: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:43.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:43 smithi194 ceph-mon[65619]: pgmap v3361: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:45.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:45 smithi026 ceph-mon[96795]: pgmap v3362: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:45.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:45 smithi194 ceph-mon[65619]: pgmap v3362: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:47.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.612+0000 7fda20afa700 1 -- 172.21.15.26:0/1322094839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda1c0f6ff0 msgr2=0x7fda1c0f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:46:47.612 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.612+0000 7fda20afa700 1 --2- 172.21.15.26:0/1322094839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda1c0f6ff0 0x7fda1c0f7a20 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 rx=0x7fda04004660 tx=0x7fda04009b30).stop 2021-11-03T18:46:47.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.612+0000 7fda20afa700 1 -- 172.21.15.26:0/1322094839 shutdown_connections 2021-11-03T18:46:47.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.612+0000 7fda20afa700 1 --2- 172.21.15.26:0/1322094839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda1c0f6ff0 0x7fda1c0f7a20 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:47.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.612+0000 7fda20afa700 1 --2- 172.21.15.26:0/1322094839 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda1c0f66e0 0x7fda1c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:47.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.612+0000 7fda20afa700 1 -- 172.21.15.26:0/1322094839 >> 172.21.15.26:0/1322094839 conn(0x7fda1c0f1f00 msgr2=0x7fda1c0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:46:47.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.612+0000 7fda20afa700 1 -- 172.21.15.26:0/1322094839 shutdown_connections 2021-11-03T18:46:47.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.613+0000 7fda20afa700 1 -- 172.21.15.26:0/1322094839 wait complete. 2021-11-03T18:46:47.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.613+0000 7fda20afa700 1 Processor -- start 2021-11-03T18:46:47.614 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.613+0000 7fda20afa700 1 -- start start 2021-11-03T18:46:47.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.613+0000 7fda20afa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda1c0f66e0 0x7fda1c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:46:47.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.613+0000 7fda20afa700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda1c0f6ff0 0x7fda1c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:46:47.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.613+0000 7fda20afa700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c06a380 con 0x7fda1c0f66e0 2021-11-03T18:46:47.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.613+0000 7fda20afa700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c06a4c0 con 0x7fda1c0f6ff0 2021-11-03T18:46:47.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.613+0000 7fda1a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda1c0f66e0 0x7fda1c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:46:47.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.613+0000 7fda1a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda1c0f66e0 0x7fda1c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33700/0 (socket says 172.21.15.26:33700) 2021-11-03T18:46:47.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.613+0000 7fda1a59c700 1 -- 172.21.15.26:0/561252699 learned_addr learned my addr 172.21.15.26:0/561252699 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:46:47.618 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.614+0000 7fda19d9b700 1 --2- 172.21.15.26:0/561252699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda1c0f6ff0 0x7fda1c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:46:47.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.614+0000 7fda1a59c700 1 -- 172.21.15.26:0/561252699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda1c0f6ff0 msgr2=0x7fda1c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:46:47.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.614+0000 7fda1a59c700 1 --2- 172.21.15.26:0/561252699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda1c0f6ff0 0x7fda1c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:47.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.614+0000 7fda1a59c700 1 -- 172.21.15.26:0/561252699 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda04005040 con 0x7fda1c0f66e0 2021-11-03T18:46:47.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.614+0000 7fda1a59c700 1 --2- 172.21.15.26:0/561252699 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda1c0f66e0 0x7fda1c06b9a0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 rx=0x7fda140026d0 tx=0x7fda14009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:46:47.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.614+0000 7fda12ffd700 1 -- 172.21.15.26:0/561252699 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda140079c0 con 0x7fda1c0f66e0 2021-11-03T18:46:47.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.614+0000 7fda12ffd700 1 -- 172.21.15.26:0/561252699 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fda1400f040 con 0x7fda1c0f66e0 2021-11-03T18:46:47.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.614+0000 7fda20afa700 1 -- 172.21.15.26:0/561252699 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda1c06a7a0 con 0x7fda1c0f66e0 2021-11-03T18:46:47.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.614+0000 7fda12ffd700 1 -- 172.21.15.26:0/561252699 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda140148b0 con 0x7fda1c0f66e0 2021-11-03T18:46:47.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.614+0000 7fda20afa700 1 -- 172.21.15.26:0/561252699 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda1c10efa0 con 0x7fda1c0f66e0 2021-11-03T18:46:47.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.615+0000 7fda20afa700 1 -- 172.21.15.26:0/561252699 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda1c045ad0 con 0x7fda1c0f66e0 2021-11-03T18:46:47.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.616+0000 7fda12ffd700 1 -- 172.21.15.26:0/561252699 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fda14007b20 con 0x7fda1c0f66e0 2021-11-03T18:46:47.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.616+0000 7fda12ffd700 1 --2- 172.21.15.26:0/561252699 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fda08064180 0x7fda08066640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:46:47.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.616+0000 7fda12ffd700 1 -- 172.21.15.26:0/561252699 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fda14080640 con 0x7fda1c0f66e0 2021-11-03T18:46:47.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.616+0000 7fda19d9b700 1 --2- 172.21.15.26:0/561252699 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fda08064180 0x7fda08066640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:46:47.622 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.617+0000 7fda19d9b700 1 --2- 172.21.15.26:0/561252699 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fda08064180 0x7fda08066640 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 rx=0x7fda04004630 tx=0x7fda04009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:46:47.622 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.620+0000 7fda12ffd700 1 -- 172.21.15.26:0/561252699 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fda14052ad0 con 0x7fda1c0f66e0 2021-11-03T18:46:47.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:47 smithi026 ceph-mon[96795]: pgmap v3363: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:47.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:47 smithi194 ceph-mon[65619]: pgmap v3363: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:47.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.799+0000 7fda20afa700 1 -- 172.21.15.26:0/561252699 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fda1c0ff010 con 0x7fda08064180 2021-11-03T18:46:47.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.801+0000 7fda12ffd700 1 -- 172.21.15.26:0/561252699 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fda1c0ff010 con 0x7fda08064180 2021-11-03T18:46:47.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.802+0000 7fda20afa700 1 -- 172.21.15.26:0/561252699 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fda08064180 msgr2=0x7fda08066640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:46:47.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.802+0000 7fda20afa700 1 --2- 172.21.15.26:0/561252699 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fda08064180 0x7fda08066640 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 rx=0x7fda04004630 tx=0x7fda04009b30).stop 2021-11-03T18:46:47.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.802+0000 7fda20afa700 1 -- 172.21.15.26:0/561252699 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda1c0f66e0 msgr2=0x7fda1c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:46:47.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.802+0000 7fda20afa700 1 --2- 172.21.15.26:0/561252699 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda1c0f66e0 0x7fda1c06b9a0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 rx=0x7fda140026d0 tx=0x7fda14009de0).stop 2021-11-03T18:46:47.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.802+0000 7fda20afa700 1 -- 172.21.15.26:0/561252699 shutdown_connections 2021-11-03T18:46:47.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.802+0000 7fda20afa700 1 --2- 172.21.15.26:0/561252699 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fda08064180 0x7fda08066640 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:47.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.802+0000 7fda20afa700 1 --2- 172.21.15.26:0/561252699 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda1c0f66e0 0x7fda1c06b9a0 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:47.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.802+0000 7fda20afa700 1 --2- 172.21.15.26:0/561252699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda1c0f6ff0 0x7fda1c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:47.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.802+0000 7fda20afa700 1 -- 172.21.15.26:0/561252699 >> 172.21.15.26:0/561252699 conn(0x7fda1c0f1f00 msgr2=0x7fda1c0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:46:47.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.803+0000 7fda20afa700 1 -- 172.21.15.26:0/561252699 shutdown_connections 2021-11-03T18:46:47.804 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.803+0000 7fda20afa700 1 -- 172.21.15.26:0/561252699 wait complete. 2021-11-03T18:46:47.811 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:46:47.903 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.902+0000 7f74a0810700 1 -- 172.21.15.26:0/2528021932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f749c0f6530 msgr2=0x7f749c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:46:47.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.902+0000 7f74a0810700 1 --2- 172.21.15.26:0/2528021932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f749c0f6530 0x7f749c0f6950 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 rx=0x7f7490004660 tx=0x7f7490009b30).stop 2021-11-03T18:46:47.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.902+0000 7f74a0810700 1 -- 172.21.15.26:0/2528021932 shutdown_connections 2021-11-03T18:46:47.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.902+0000 7f74a0810700 1 --2- 172.21.15.26:0/2528021932 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f749c0f77d0 0x7f749c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:47.904 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.902+0000 7f74a0810700 1 --2- 172.21.15.26:0/2528021932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f749c0f6530 0x7f749c0f6950 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:47.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.902+0000 7f74a0810700 1 -- 172.21.15.26:0/2528021932 >> 172.21.15.26:0/2528021932 conn(0x7f749c0f1cd0 msgr2=0x7f749c0f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:46:47.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.902+0000 7f74a0810700 1 -- 172.21.15.26:0/2528021932 shutdown_connections 2021-11-03T18:46:47.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.902+0000 7f74a0810700 1 -- 172.21.15.26:0/2528021932 wait complete. 2021-11-03T18:46:47.905 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.903+0000 7f74a0810700 1 Processor -- start 2021-11-03T18:46:47.906 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.903+0000 7f74a0810700 1 -- start start 2021-11-03T18:46:47.906 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.903+0000 7f74a0810700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f749c0f6530 0x7f749c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:46:47.906 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.903+0000 7f74a0810700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f749c0f77d0 0x7f749c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:46:47.906 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.903+0000 7f74a0810700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749c06a380 con 0x7f749c0f6530 2021-11-03T18:46:47.906 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.903+0000 7f74a0810700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749c06a4c0 con 0x7f749c0f77d0 2021-11-03T18:46:47.907 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.903+0000 7f749b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f749c0f6530 0x7f749c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:46:47.907 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.903+0000 7f749b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f749c0f6530 0x7f749c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33710/0 (socket says 172.21.15.26:33710) 2021-11-03T18:46:47.907 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.903+0000 7f749b7fe700 1 -- 172.21.15.26:0/238135638 learned_addr learned my addr 172.21.15.26:0/238135638 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:46:47.907 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.904+0000 7f749affd700 1 --2- 172.21.15.26:0/238135638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f749c0f77d0 0x7f749c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:46:47.908 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.904+0000 7f749b7fe700 1 -- 172.21.15.26:0/238135638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f749c0f77d0 msgr2=0x7f749c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:46:47.908 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.904+0000 7f749b7fe700 1 --2- 172.21.15.26:0/238135638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f749c0f77d0 0x7f749c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:47.908 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.904+0000 7f749b7fe700 1 -- 172.21.15.26:0/238135638 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7490005040 con 0x7f749c0f6530 2021-11-03T18:46:47.908 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.904+0000 7f749affd700 1 --2- 172.21.15.26:0/238135638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f749c0f77d0 0x7f749c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:46:47.909 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.904+0000 7f749b7fe700 1 --2- 172.21.15.26:0/238135638 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f749c0f6530 0x7f749c06b9a0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 rx=0x7f7490004f60 tx=0x7f7490009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:46:47.909 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.904+0000 7f7483fff700 1 -- 172.21.15.26:0/238135638 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7490018070 con 0x7f749c0f6530 2021-11-03T18:46:47.909 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.904+0000 7f7483fff700 1 -- 172.21.15.26:0/238135638 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7490007ba0 con 0x7f749c0f6530 2021-11-03T18:46:47.909 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.904+0000 7f74a0810700 1 -- 172.21.15.26:0/238135638 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f749c06a740 con 0x7f749c0f6530 2021-11-03T18:46:47.909 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.904+0000 7f7483fff700 1 -- 172.21.15.26:0/238135638 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f749001c620 con 0x7f749c0f6530 2021-11-03T18:46:47.910 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.904+0000 7f74a0810700 1 -- 172.21.15.26:0/238135638 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f749c06aca0 con 0x7f749c0f6530 2021-11-03T18:46:47.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.905+0000 7f74a0810700 1 -- 172.21.15.26:0/238135638 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f749c045ad0 con 0x7f749c0f6530 2021-11-03T18:46:47.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.906+0000 7f7483fff700 1 -- 172.21.15.26:0/238135638 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f749001c8e0 con 0x7f749c0f6530 2021-11-03T18:46:47.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.906+0000 7f7483fff700 1 --2- 172.21.15.26:0/238135638 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7484064100 0x7f74840665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:46:47.911 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.906+0000 7f7483fff700 1 -- 172.21.15.26:0/238135638 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f74900826c0 con 0x7f749c0f6530 2021-11-03T18:46:47.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.906+0000 7f749affd700 1 --2- 172.21.15.26:0/238135638 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7484064100 0x7f74840665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:46:47.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.906+0000 7f749affd700 1 --2- 172.21.15.26:0/238135638 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7484064100 0x7f74840665c0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7f748c0041d0 tx=0x7f748c009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:46:47.912 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:47.910+0000 7f7483fff700 1 -- 172.21.15.26:0/238135638 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f7490054a20 con 0x7f749c0f6530 2021-11-03T18:46:48.080 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.081+0000 7f74a0810700 1 -- 172.21.15.26:0/238135638 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f749c0feea0 con 0x7f7484064100 2021-11-03T18:46:48.095 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.096+0000 7f7483fff700 1 -- 172.21.15.26:0/238135638 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7f748c004660 con 0x7f7484064100 2021-11-03T18:46:48.095 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:46:48.095 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (118m) 6m ago 119m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:46:48.096 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (110m) 6m ago 119m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:46:48.096 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (110m) 4m ago 118m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:46:48.096 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (117m) 6m ago 118m 42.4M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:46:48.096 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (111m) 6m ago 114m 26.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:46:48.097 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (111m) 6m ago 114m 27.0M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:46:48.097 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (114m) 4m ago 114m 27.2M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:46:48.097 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (114m) 4m ago 114m 27.6M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:46:48.097 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (111m) 6m ago 2h 615M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:46:48.097 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (111m) 4m ago 118m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:46:48.098 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (111m) 6m ago 2h 407M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:46:48.098 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (110m) 4m ago 118m 187M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:46:48.098 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (118m) 6m ago 118m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:46:48.098 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (118m) 4m ago 118m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:46:48.099 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (109m) 6m ago 117m 372M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:46:48.099 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (109m) 6m ago 117m 400M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:46:48.099 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (108m) 6m ago 116m 332M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:46:48.099 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (108m) 4m ago 116m 438M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:46:48.099 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (107m) 4m ago 116m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:46:48.100 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (107m) 4m ago 116m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:46:48.100 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (117m) 6m ago 118m 70.2M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:46:48.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.097+0000 7f74a0810700 1 -- 172.21.15.26:0/238135638 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7484064100 msgr2=0x7f74840665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:46:48.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.097+0000 7f74a0810700 1 --2- 172.21.15.26:0/238135638 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7484064100 0x7f74840665c0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7f748c0041d0 tx=0x7f748c009040).stop 2021-11-03T18:46:48.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.097+0000 7f74a0810700 1 -- 172.21.15.26:0/238135638 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f749c0f6530 msgr2=0x7f749c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:46:48.101 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.097+0000 7f74a0810700 1 --2- 172.21.15.26:0/238135638 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f749c0f6530 0x7f749c06b9a0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 rx=0x7f7490004f60 tx=0x7f7490009b30).stop 2021-11-03T18:46:48.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.097+0000 7f74a0810700 1 -- 172.21.15.26:0/238135638 shutdown_connections 2021-11-03T18:46:48.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.097+0000 7f74a0810700 1 --2- 172.21.15.26:0/238135638 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f7484064100 0x7f74840665c0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:48.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.097+0000 7f74a0810700 1 --2- 172.21.15.26:0/238135638 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f749c0f6530 0x7f749c06b9a0 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:48.102 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.097+0000 7f74a0810700 1 --2- 172.21.15.26:0/238135638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f749c0f77d0 0x7f749c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:48.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.097+0000 7f74a0810700 1 -- 172.21.15.26:0/238135638 >> 172.21.15.26:0/238135638 conn(0x7f749c0f1cd0 msgr2=0x7f749c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:46:48.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.098+0000 7f74a0810700 1 -- 172.21.15.26:0/238135638 shutdown_connections 2021-11-03T18:46:48.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.098+0000 7f74a0810700 1 -- 172.21.15.26:0/238135638 wait complete. 2021-11-03T18:46:48.198 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.197+0000 7fd659310700 1 -- 172.21.15.26:0/3840444973 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6540f66e0 msgr2=0x7fd6540f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:46:48.198 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.197+0000 7fd659310700 1 --2- 172.21.15.26:0/3840444973 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6540f66e0 0x7fd6540f6b00 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 rx=0x7fd63c004660 tx=0x7fd63c009b30).stop 2021-11-03T18:46:48.198 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.197+0000 7fd659310700 1 -- 172.21.15.26:0/3840444973 shutdown_connections 2021-11-03T18:46:48.199 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.197+0000 7fd659310700 1 --2- 172.21.15.26:0/3840444973 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6540f6ff0 0x7fd6540f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:48.199 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.197+0000 7fd659310700 1 --2- 172.21.15.26:0/3840444973 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6540f66e0 0x7fd6540f6b00 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:48.199 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.197+0000 7fd659310700 1 -- 172.21.15.26:0/3840444973 >> 172.21.15.26:0/3840444973 conn(0x7fd6540f1f00 msgr2=0x7fd6540f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:46:48.199 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.197+0000 7fd659310700 1 -- 172.21.15.26:0/3840444973 shutdown_connections 2021-11-03T18:46:48.200 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.197+0000 7fd659310700 1 -- 172.21.15.26:0/3840444973 wait complete. 2021-11-03T18:46:48.200 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.198+0000 7fd659310700 1 Processor -- start 2021-11-03T18:46:48.200 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.198+0000 7fd659310700 1 -- start start 2021-11-03T18:46:48.200 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.198+0000 7fd659310700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6540f66e0 0x7fd654106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:46:48.200 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.198+0000 7fd659310700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6540f6ff0 0x7fd654107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:46:48.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.198+0000 7fd659310700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd654107a00 con 0x7fd6540f66e0 2021-11-03T18:46:48.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.198+0000 7fd659310700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd654107b40 con 0x7fd6540f6ff0 2021-11-03T18:46:48.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.198+0000 7fd652ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6540f66e0 0x7fd654106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:46:48.201 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.198+0000 7fd652ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6540f66e0 0x7fd654106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33720/0 (socket says 172.21.15.26:33720) 2021-11-03T18:46:48.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.198+0000 7fd652ffd700 1 -- 172.21.15.26:0/2472007317 learned_addr learned my addr 172.21.15.26:0/2472007317 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:46:48.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.198+0000 7fd652ffd700 1 -- 172.21.15.26:0/2472007317 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6540f6ff0 msgr2=0x7fd654107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:46:48.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.198+0000 7fd652ffd700 1 --2- 172.21.15.26:0/2472007317 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6540f6ff0 0x7fd654107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:46:48.202 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.198+0000 7fd652ffd700 1 -- 172.21.15.26:0/2472007317 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd63c005040 con 0x7fd6540f66e0 2021-11-03T18:46:48.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.198+0000 7fd652ffd700 1 --2- 172.21.15.26:0/2472007317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6540f66e0 0x7fd654106f60 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 rx=0x7fd63c009830 tx=0x7fd63c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:46:48.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.198+0000 7fd64b7fe700 1 -- 172.21.15.26:0/2472007317 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd63c018070 con 0x7fd6540f66e0 2021-11-03T18:46:48.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.199+0000 7fd659310700 1 -- 172.21.15.26:0/2472007317 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd654108480 con 0x7fd6540f66e0 2021-11-03T18:46:48.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.199+0000 7fd64b7fe700 1 -- 172.21.15.26:0/2472007317 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd63c007ba0 con 0x7fd6540f66e0 2021-11-03T18:46:48.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.199+0000 7fd64b7fe700 1 -- 172.21.15.26:0/2472007317 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd63c01c620 con 0x7fd6540f66e0 2021-11-03T18:46:48.204 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.199+0000 7fd659310700 1 -- 172.21.15.26:0/2472007317 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6541089e0 con 0x7fd6540f66e0 2021-11-03T18:46:48.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.200+0000 7fd659310700 1 -- 172.21.15.26:0/2472007317 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd654045ad0 con 0x7fd6540f66e0 2021-11-03T18:46:48.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.200+0000 7fd64b7fe700 1 -- 172.21.15.26:0/2472007317 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fd63c01c850 con 0x7fd6540f66e0 2021-11-03T18:46:48.205 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.200+0000 7fd64b7fe700 1 --2- 172.21.15.26:0/2472007317 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd640064090 0x7fd640066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:46:48.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.200+0000 7fd64b7fe700 1 -- 172.21.15.26:0/2472007317 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fd63c082440 con 0x7fd6540f66e0 2021-11-03T18:46:48.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.201+0000 7fd6527fc700 1 --2- 172.21.15.26:0/2472007317 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd640064090 0x7fd640066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:46:48.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.201+0000 7fd6527fc700 1 --2- 172.21.15.26:0/2472007317 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd640064090 0x7fd640066550 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7fd644004a10 tx=0x7fd6440099e0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:46:48.206 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.205+0000 7fd64b7fe700 1 -- 172.21.15.26:0/2472007317 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fd63c054860 con 0x7fd6540f66e0 2021-11-03T18:46:48.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.436+0000 7fd659310700 1 -- 172.21.15.26:0/2472007317 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd654108c50 con 0x7fd6540f66e0 2021-11-03T18:46:48.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.436+0000 7fd64b7fe700 1 -- 172.21.15.26:0/2472007317 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fd63c054450 con 0x7fd6540f66e0 2021-11-03T18:46:48.436 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:46:48.436 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:46:48.437 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:46:48.437 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:46:48.437 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:46:48.437 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:46:48.438 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:46:48.438 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:46:48.438 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:46:48.438 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:46:48.438 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:46:48.439 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:46:48.439 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:46:48.439 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:46:48.439 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:46:48.440 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:46:48.440 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:46:48.440 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:46:48.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.438+0000 7fd659310700 1 -- 172.21.15.26:0/2472007317 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd640064090 msgr2=0x7fd640066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:46:48.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.438+0000 7fd659310700 1 --2- 172.21.15.26:0/2472007317 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd640064090 0x7fd640066550 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7fd644004a10 tx=0x7fd6440099e0).stop 2021-11-03T18:46:48.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.438+0000 7fd659310700 1 -- 172.21.15.26:0/2472007317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6540f66e0 msgr2=0x7fd654106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:46:48.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.438+0000 7fd659310700 1 --2- 172.21.15.26:0/2472007317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6540f66e0 0x7fd654106f60 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 rx=0x7fd63c009830 tx=0x7fd63c009b30).stop 2021-11-03T18:46:48.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.438+0000 7fd659310700 1 -- 172.21.15.26:0/2472007317 shutdown_connections 2021-11-03T18:46:48.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.438+0000 7fd659310700 1 --2- 172.21.15.26:0/2472007317 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fd640064090 0x7fd640066550 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:48.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.438+0000 7fd659310700 1 --2- 172.21.15.26:0/2472007317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6540f66e0 0x7fd654106f60 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:48.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.438+0000 7fd659310700 1 --2- 172.21.15.26:0/2472007317 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6540f6ff0 0x7fd654107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:46:48.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.438+0000 7fd659310700 1 -- 172.21.15.26:0/2472007317 >> 172.21.15.26:0/2472007317 conn(0x7fd6540f1f00 msgr2=0x7fd6540fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:46:48.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.438+0000 7fd659310700 1 -- 172.21.15.26:0/2472007317 shutdown_connections 2021-11-03T18:46:48.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.438+0000 7fd659310700 1 -- 172.21.15.26:0/2472007317 wait complete. 2021-11-03T18:46:48.539 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.540+0000 7f87421c1700 1 -- 172.21.15.26:0/2835660111 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f873c0602d0 msgr2=0x7f873c0f9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:46:48.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.540+0000 7f87421c1700 1 --2- 172.21.15.26:0/2835660111 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f873c0602d0 0x7f873c0f9400 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 rx=0x7f872c004660 tx=0x7f872c009b30).stop 2021-11-03T18:46:48.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.540+0000 7f87421c1700 1 -- 172.21.15.26:0/2835660111 shutdown_connections 2021-11-03T18:46:48.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.540+0000 7f87421c1700 1 --2- 172.21.15.26:0/2835660111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f873c0f98f0 0x7f873c0fbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:48.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.540+0000 7f87421c1700 1 --2- 172.21.15.26:0/2835660111 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f873c0602d0 0x7f873c0f9400 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:48.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.540+0000 7f87421c1700 1 -- 172.21.15.26:0/2835660111 >> 172.21.15.26:0/2835660111 conn(0x7f873c0f0de0 msgr2=0x7f873c0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:46:48.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.540+0000 7f87421c1700 1 -- 172.21.15.26:0/2835660111 shutdown_connections 2021-11-03T18:46:48.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.540+0000 7f87421c1700 1 -- 172.21.15.26:0/2835660111 wait complete. 2021-11-03T18:46:48.541 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.540+0000 7f87421c1700 1 Processor -- start 2021-11-03T18:46:48.542 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.540+0000 7f87421c1700 1 -- start start 2021-11-03T18:46:48.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.541+0000 7f87421c1700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f873c0602d0 0x7f873c106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:46:48.544 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.541+0000 7f87421c1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f873c0f98f0 0x7f873c107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:46:48.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.541+0000 7f87421c1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873c107a10 con 0x7f873c0f98f0 2021-11-03T18:46:48.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.541+0000 7f87421c1700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873c107b50 con 0x7f873c0602d0 2021-11-03T18:46:48.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.541+0000 7f873affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f873c0f98f0 0x7f873c107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:46:48.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.541+0000 7f873affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f873c0f98f0 0x7f873c107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33732/0 (socket says 172.21.15.26:33732) 2021-11-03T18:46:48.545 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.541+0000 7f873affd700 1 -- 172.21.15.26:0/3309149295 learned_addr learned my addr 172.21.15.26:0/3309149295 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:46:48.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.541+0000 7f873b7fe700 1 --2- 172.21.15.26:0/3309149295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f873c0602d0 0x7f873c106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:46:48.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.541+0000 7f873affd700 1 -- 172.21.15.26:0/3309149295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f873c0602d0 msgr2=0x7f873c106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:46:48.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.541+0000 7f873affd700 1 --2- 172.21.15.26:0/3309149295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f873c0602d0 0x7f873c106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:48.546 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.541+0000 7f873affd700 1 -- 172.21.15.26:0/3309149295 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872c005040 con 0x7f873c0f98f0 2021-11-03T18:46:48.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.541+0000 7f873affd700 1 --2- 172.21.15.26:0/3309149295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f873c0f98f0 0x7f873c107460 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 rx=0x7f87300026d0 tx=0x7f8730009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:46:48.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.541+0000 7f8723fff700 1 -- 172.21.15.26:0/3309149295 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87300079c0 con 0x7f873c0f98f0 2021-11-03T18:46:48.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.541+0000 7f8723fff700 1 -- 172.21.15.26:0/3309149295 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f873000f040 con 0x7f873c0f98f0 2021-11-03T18:46:48.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.541+0000 7f8723fff700 1 -- 172.21.15.26:0/3309149295 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87300148b0 con 0x7f873c0f98f0 2021-11-03T18:46:48.547 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.542+0000 7f87421c1700 1 -- 172.21.15.26:0/3309149295 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f873c1084f0 con 0x7f873c0f98f0 2021-11-03T18:46:48.548 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.542+0000 7f87421c1700 1 -- 172.21.15.26:0/3309149295 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f873c108ab0 con 0x7f873c0f98f0 2021-11-03T18:46:48.548 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.543+0000 7f87421c1700 1 -- 172.21.15.26:0/3309149295 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f873c045ad0 con 0x7f873c0f98f0 2021-11-03T18:46:48.548 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.543+0000 7f8723fff700 1 -- 172.21.15.26:0/3309149295 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f8730007b20 con 0x7f873c0f98f0 2021-11-03T18:46:48.548 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.543+0000 7f8723fff700 1 --2- 172.21.15.26:0/3309149295 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f87240640b0 0x7f8724066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:46:48.549 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.543+0000 7f8723fff700 1 -- 172.21.15.26:0/3309149295 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f8730080730 con 0x7f873c0f98f0 2021-11-03T18:46:48.549 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.543+0000 7f873b7fe700 1 --2- 172.21.15.26:0/3309149295 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f87240640b0 0x7f8724066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:46:48.549 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.544+0000 7f873b7fe700 1 --2- 172.21.15.26:0/3309149295 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f87240640b0 0x7f8724066570 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 rx=0x7f872c004630 tx=0x7f872c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:46:48.550 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.548+0000 7f8723fff700 1 -- 172.21.15.26:0/3309149295 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f8730052a90 con 0x7f873c0f98f0 2021-11-03T18:46:48.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.749+0000 7f87421c1700 1 -- 172.21.15.26:0/3309149295 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f873c027a00 con 0x7f873c0f98f0 2021-11-03T18:46:48.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.749+0000 7f8723fff700 1 -- 172.21.15.26:0/3309149295 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f8730052680 con 0x7f873c0f98f0 2021-11-03T18:46:48.750 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:46:48.750 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:46:48.750 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:46:48.750 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:46:48.751 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:46:48.751 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:46:48.751 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:46:48.752 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:46:48.752 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:46:48.752 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:46:48.752 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:46:48.753 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:46:48.753 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:46:48.753 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:46:48.754 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:46:48.754 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:46:48.754 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:46:48.754 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:46:48.755 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:46:48.755 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:46:48.755 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:46:48.755 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:46:48.756 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:46:48.756 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:46:48.756 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:46:48.756 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:46:48.756 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:46:48.757 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:46:48.757 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:46:48.757 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:46:48.757 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:46:48.757 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:46:48.758 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:46:48.758 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:46:48.758 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:46:48.758 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:46:48.758 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:46:48.759 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:46:48.759 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:46:48.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.751+0000 7f87421c1700 1 -- 172.21.15.26:0/3309149295 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f87240640b0 msgr2=0x7f8724066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:46:48.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.751+0000 7f87421c1700 1 --2- 172.21.15.26:0/3309149295 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f87240640b0 0x7f8724066570 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 rx=0x7f872c004630 tx=0x7f872c009b30).stop 2021-11-03T18:46:48.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.751+0000 7f87421c1700 1 -- 172.21.15.26:0/3309149295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f873c0f98f0 msgr2=0x7f873c107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:46:48.761 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.751+0000 7f87421c1700 1 --2- 172.21.15.26:0/3309149295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f873c0f98f0 0x7f873c107460 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 rx=0x7f87300026d0 tx=0x7f8730009de0).stop 2021-11-03T18:46:48.761 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.751+0000 7f87421c1700 1 -- 172.21.15.26:0/3309149295 shutdown_connections 2021-11-03T18:46:48.761 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.751+0000 7f87421c1700 1 --2- 172.21.15.26:0/3309149295 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f87240640b0 0x7f8724066570 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:48.761 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.751+0000 7f87421c1700 1 --2- 172.21.15.26:0/3309149295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f873c0602d0 0x7f873c106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:48.762 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.751+0000 7f87421c1700 1 --2- 172.21.15.26:0/3309149295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f873c0f98f0 0x7f873c107460 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:46:48.762 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.751+0000 7f87421c1700 1 -- 172.21.15.26:0/3309149295 >> 172.21.15.26:0/3309149295 conn(0x7f873c0f0de0 msgr2=0x7f873c0f31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:46:48.762 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.752+0000 7f87421c1700 1 -- 172.21.15.26:0/3309149295 shutdown_connections 2021-11-03T18:46:48.762 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:46:48.752+0000 7f87421c1700 1 -- 172.21.15.26:0/3309149295 wait complete. 2021-11-03T18:46:48.763 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:46:49.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:49 smithi026 ceph-mon[96795]: from='client.37596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:46:49.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:49 smithi026 ceph-mon[96795]: from='client.37600 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:46:49.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:49 smithi026 ceph-mon[96795]: pgmap v3364: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:49.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:49 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2472007317' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:46:49.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:46:49.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:46:49.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:49 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3309149295' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:46:49.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:49 smithi194 ceph-mon[65619]: from='client.37596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:46:49.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:49 smithi194 ceph-mon[65619]: from='client.37600 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:46:49.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:49 smithi194 ceph-mon[65619]: pgmap v3364: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:49.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:49 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2472007317' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:46:49.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:46:49.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:46:49.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:49 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3309149295' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:46:51.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:51 smithi026 ceph-mon[96795]: pgmap v3365: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:51.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:51 smithi194 ceph-mon[65619]: pgmap v3365: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:53.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:53 smithi026 ceph-mon[96795]: pgmap v3366: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:53.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:53 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:46:53.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:53 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:46:53.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:53 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:46:53.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:53 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:46:53.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:53 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:46:53.677 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:53 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:46:53.677 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:53 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:46:53.677 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:53 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:46:53.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:53 smithi194 ceph-mon[65619]: pgmap v3366: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:53.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:53 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:46:53.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:53 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:46:53.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:53 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:46:53.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:53 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:46:53.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:53 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:46:53.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:53 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:46:53.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:53 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:46:53.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:53 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:46:54.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:54 smithi026 ceph-mon[96795]: poll took 60064.853 ms: 1 events 2021-11-03T18:46:54.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:54 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:46:54.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:54 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:46:54.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:54 smithi194 ceph-mon[65619]: poll took 60064.853 ms: 1 events 2021-11-03T18:46:54.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:54 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:46:54.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:54 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:46:55.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:55 smithi026 ceph-mon[96795]: pgmap v3367: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:55.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:55 smithi194 ceph-mon[65619]: pgmap v3367: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:57.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:57 smithi026 ceph-mon[96795]: pgmap v3368: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:57.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:57 smithi194 ceph-mon[65619]: pgmap v3368: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:59.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:46:59 smithi026 ceph-mon[96795]: pgmap v3369: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:46:59.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:46:59 smithi194 ceph-mon[65619]: pgmap v3369: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:01.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:01 smithi026 ceph-mon[96795]: pgmap v3370: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:01.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:01 smithi194 ceph-mon[65619]: pgmap v3370: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:03.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:03 smithi026 ceph-mon[96795]: pgmap v3371: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:03.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:03 smithi194 ceph-mon[65619]: pgmap v3371: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:05.578 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:05 smithi026 ceph-mon[96795]: pgmap v3372: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:05.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:05 smithi194 ceph-mon[65619]: pgmap v3372: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:07.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:07 smithi026 ceph-mon[96795]: pgmap v3373: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:07.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:07 smithi194 ceph-mon[65619]: pgmap v3373: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:08.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:08 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:47:08.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:08 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:47:09.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:09 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:47:09.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:09 smithi026 ceph-mon[96795]: pgmap v3374: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:09.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:09 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:47:09.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:09 smithi194 ceph-mon[65619]: pgmap v3374: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:11.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:11 smithi026 ceph-mon[96795]: pgmap v3375: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:11.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:11 smithi194 ceph-mon[65619]: pgmap v3375: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:13.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:13 smithi026 ceph-mon[96795]: pgmap v3376: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:13.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:13 smithi194 ceph-mon[65619]: pgmap v3376: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:15.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:15 smithi026 ceph-mon[96795]: pgmap v3377: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:15.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:15 smithi194 ceph-mon[65619]: pgmap v3377: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:17.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:17 smithi026 ceph-mon[96795]: pgmap v3378: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:17.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:17 smithi194 ceph-mon[65619]: pgmap v3378: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:18.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:18.868+0000 7f2a3c2a1700 1 -- 172.21.15.26:0/642252282 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a340f55e0 msgr2=0x7f2a340f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:47:18.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:18.868+0000 7f2a3c2a1700 1 --2- 172.21.15.26:0/642252282 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a340f55e0 0x7f2a340f5a00 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 rx=0x7f2a2c0099e0 tx=0x7f2a2c004d10).stop 2021-11-03T18:47:18.868 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:18.868+0000 7f2a3c2a1700 1 -- 172.21.15.26:0/642252282 shutdown_connections 2021-11-03T18:47:18.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:18.868+0000 7f2a3c2a1700 1 --2- 172.21.15.26:0/642252282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a340f5ef0 0x7f2a340f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:18.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:18.868+0000 7f2a3c2a1700 1 --2- 172.21.15.26:0/642252282 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a340f55e0 0x7f2a340f5a00 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:18.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:18.868+0000 7f2a3c2a1700 1 -- 172.21.15.26:0/642252282 >> 172.21.15.26:0/642252282 conn(0x7f2a340f0de0 msgr2=0x7f2a340f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:47:18.869 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:18.868+0000 7f2a3c2a1700 1 -- 172.21.15.26:0/642252282 shutdown_connections 2021-11-03T18:47:18.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:18.869+0000 7f2a3c2a1700 1 -- 172.21.15.26:0/642252282 wait complete. 2021-11-03T18:47:18.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:18.869+0000 7f2a3c2a1700 1 Processor -- start 2021-11-03T18:47:18.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:18.869+0000 7f2a3c2a1700 1 -- start start 2021-11-03T18:47:18.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:18.869+0000 7f2a3c2a1700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a340f55e0 0x7f2a34109d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:47:18.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:18.869+0000 7f2a3c2a1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a340f5ef0 0x7f2a3410c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:47:18.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:18.869+0000 7f2a3c2a1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a34060500 con 0x7f2a340f5ef0 2021-11-03T18:47:18.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:18.869+0000 7f2a3c2a1700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a34060640 con 0x7f2a340f55e0 2021-11-03T18:47:18.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:18.869+0000 7f2a3983c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a340f5ef0 0x7f2a3410c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:47:18.871 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:18.869+0000 7f2a3983c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a340f5ef0 0x7f2a3410c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33750/0 (socket says 172.21.15.26:33750) 2021-11-03T18:47:18.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:18.869+0000 7f2a3983c700 1 -- 172.21.15.26:0/4064393758 learned_addr learned my addr 172.21.15.26:0/4064393758 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:47:18.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:18.870+0000 7f2a3a03d700 1 --2- 172.21.15.26:0/4064393758 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a340f55e0 0x7f2a34109d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:47:18.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:18.870+0000 7f2a3983c700 1 -- 172.21.15.26:0/4064393758 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a340f55e0 msgr2=0x7f2a34109d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:47:18.872 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:18.870+0000 7f2a3983c700 1 --2- 172.21.15.26:0/4064393758 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a340f55e0 0x7f2a34109d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:18.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:18.870+0000 7f2a3983c700 1 -- 172.21.15.26:0/4064393758 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2c009640 con 0x7f2a340f5ef0 2021-11-03T18:47:18.873 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:18.870+0000 7f2a3983c700 1 --2- 172.21.15.26:0/4064393758 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a340f5ef0 0x7f2a3410c260 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 rx=0x7f2a2800c530 tx=0x7f2a28007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:47:18.874 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:18.870+0000 7f2a32ffd700 1 -- 172.21.15.26:0/4064393758 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a2800f650 con 0x7f2a340f5ef0 2021-11-03T18:47:18.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:18.870+0000 7f2a3c2a1700 1 -- 172.21.15.26:0/4064393758 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a3410c810 con 0x7f2a340f5ef0 2021-11-03T18:47:18.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:18.870+0000 7f2a32ffd700 1 -- 172.21.15.26:0/4064393758 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2a2800fc60 con 0x7f2a340f5ef0 2021-11-03T18:47:18.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:18.870+0000 7f2a32ffd700 1 -- 172.21.15.26:0/4064393758 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a28012c20 con 0x7f2a340f5ef0 2021-11-03T18:47:18.875 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:18.870+0000 7f2a3c2a1700 1 -- 172.21.15.26:0/4064393758 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a3410cd50 con 0x7f2a340f5ef0 2021-11-03T18:47:18.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:18.871+0000 7f2a3c2a1700 1 -- 172.21.15.26:0/4064393758 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a34045ad0 con 0x7f2a340f5ef0 2021-11-03T18:47:18.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:18.871+0000 7f2a32ffd700 1 -- 172.21.15.26:0/4064393758 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f2a28010070 con 0x7f2a340f5ef0 2021-11-03T18:47:18.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:18.872+0000 7f2a32ffd700 1 --2- 172.21.15.26:0/4064393758 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2a1c0640b0 0x7f2a1c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:47:18.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:18.872+0000 7f2a32ffd700 1 -- 172.21.15.26:0/4064393758 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f2a28080640 con 0x7f2a340f5ef0 2021-11-03T18:47:18.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:18.872+0000 7f2a3a03d700 1 --2- 172.21.15.26:0/4064393758 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2a1c0640b0 0x7f2a1c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:47:18.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:18.872+0000 7f2a3a03d700 1 --2- 172.21.15.26:0/4064393758 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2a1c0640b0 0x7f2a1c066570 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7f2a2c00b730 tx=0x7f2a2c004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:47:18.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:18.876+0000 7f2a32ffd700 1 -- 172.21.15.26:0/4064393758 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f2a280528b0 con 0x7f2a340f5ef0 2021-11-03T18:47:19.053 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.055+0000 7f2a3c2a1700 1 -- 172.21.15.26:0/4064393758 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a340fde40 con 0x7f2a1c0640b0 2021-11-03T18:47:19.054 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.056+0000 7f2a32ffd700 1 -- 172.21.15.26:0/4064393758 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f2a340fde40 con 0x7f2a1c0640b0 2021-11-03T18:47:19.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.058+0000 7f2a3c2a1700 1 -- 172.21.15.26:0/4064393758 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2a1c0640b0 msgr2=0x7f2a1c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:47:19.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.058+0000 7f2a3c2a1700 1 --2- 172.21.15.26:0/4064393758 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2a1c0640b0 0x7f2a1c066570 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7f2a2c00b730 tx=0x7f2a2c004d10).stop 2021-11-03T18:47:19.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.058+0000 7f2a3c2a1700 1 -- 172.21.15.26:0/4064393758 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a340f5ef0 msgr2=0x7f2a3410c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:47:19.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.058+0000 7f2a3c2a1700 1 --2- 172.21.15.26:0/4064393758 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a340f5ef0 0x7f2a3410c260 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 rx=0x7f2a2800c530 tx=0x7f2a28007e20).stop 2021-11-03T18:47:19.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.058+0000 7f2a3c2a1700 1 -- 172.21.15.26:0/4064393758 shutdown_connections 2021-11-03T18:47:19.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.058+0000 7f2a3c2a1700 1 --2- 172.21.15.26:0/4064393758 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f2a1c0640b0 0x7f2a1c066570 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:19.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.058+0000 7f2a3c2a1700 1 --2- 172.21.15.26:0/4064393758 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a340f55e0 0x7f2a34109d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:19.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.058+0000 7f2a3c2a1700 1 --2- 172.21.15.26:0/4064393758 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a340f5ef0 0x7f2a3410c260 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:19.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.058+0000 7f2a3c2a1700 1 -- 172.21.15.26:0/4064393758 >> 172.21.15.26:0/4064393758 conn(0x7f2a340f0de0 msgr2=0x7f2a340fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:47:19.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.058+0000 7f2a3c2a1700 1 -- 172.21.15.26:0/4064393758 shutdown_connections 2021-11-03T18:47:19.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.058+0000 7f2a3c2a1700 1 -- 172.21.15.26:0/4064393758 wait complete. 2021-11-03T18:47:19.066 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:47:19.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.158+0000 7fa8471a0700 1 -- 172.21.15.26:0/1870880252 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8400f77d0 msgr2=0x7fa8400f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:47:19.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.158+0000 7fa8471a0700 1 --2- 172.21.15.26:0/1870880252 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8400f77d0 0x7fa8400f7c30 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 rx=0x7fa830004660 tx=0x7fa830009b30).stop 2021-11-03T18:47:19.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.159+0000 7fa8471a0700 1 -- 172.21.15.26:0/1870880252 shutdown_connections 2021-11-03T18:47:19.159 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.159+0000 7fa8471a0700 1 --2- 172.21.15.26:0/1870880252 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8400f77d0 0x7fa8400f7c30 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:19.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.159+0000 7fa8471a0700 1 --2- 172.21.15.26:0/1870880252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8400f6530 0x7fa8400f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:19.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.159+0000 7fa8471a0700 1 -- 172.21.15.26:0/1870880252 >> 172.21.15.26:0/1870880252 conn(0x7fa8400f1cd0 msgr2=0x7fa8400f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:47:19.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.159+0000 7fa8471a0700 1 -- 172.21.15.26:0/1870880252 shutdown_connections 2021-11-03T18:47:19.160 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.159+0000 7fa8471a0700 1 -- 172.21.15.26:0/1870880252 wait complete. 2021-11-03T18:47:19.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.159+0000 7fa8471a0700 1 Processor -- start 2021-11-03T18:47:19.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.159+0000 7fa8471a0700 1 -- start start 2021-11-03T18:47:19.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.159+0000 7fa8471a0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8400f6530 0x7fa840106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:47:19.161 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.159+0000 7fa8471a0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8400f77d0 0x7fa840107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:47:19.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.159+0000 7fa8471a0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa840107870 con 0x7fa8400f77d0 2021-11-03T18:47:19.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.159+0000 7fa8471a0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa840108080 con 0x7fa8400f6530 2021-11-03T18:47:19.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.159+0000 7fa84599d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8400f77d0 0x7fa840107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:47:19.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.159+0000 7fa84599d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8400f77d0 0x7fa840107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33760/0 (socket says 172.21.15.26:33760) 2021-11-03T18:47:19.162 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.160+0000 7fa84599d700 1 -- 172.21.15.26:0/192359378 learned_addr learned my addr 172.21.15.26:0/192359378 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:47:19.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.160+0000 7fa84599d700 1 -- 172.21.15.26:0/192359378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8400f6530 msgr2=0x7fa840106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:47:19.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.160+0000 7fa84619e700 1 --2- 172.21.15.26:0/192359378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8400f6530 0x7fa840106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:47:19.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.160+0000 7fa84599d700 1 --2- 172.21.15.26:0/192359378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8400f6530 0x7fa840106d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:19.163 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.160+0000 7fa84599d700 1 -- 172.21.15.26:0/192359378 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa830005040 con 0x7fa8400f77d0 2021-11-03T18:47:19.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.160+0000 7fa84619e700 1 --2- 172.21.15.26:0/192359378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8400f6530 0x7fa840106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:47:19.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.160+0000 7fa84599d700 1 --2- 172.21.15.26:0/192359378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8400f77d0 0x7fa840107270 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 rx=0x7fa830009990 tx=0x7fa830009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:47:19.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.160+0000 7fa836ffd700 1 -- 172.21.15.26:0/192359378 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa830018070 con 0x7fa8400f77d0 2021-11-03T18:47:19.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.160+0000 7fa836ffd700 1 -- 172.21.15.26:0/192359378 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa830007ca0 con 0x7fa8400f77d0 2021-11-03T18:47:19.164 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.160+0000 7fa8471a0700 1 -- 172.21.15.26:0/192359378 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8401082a0 con 0x7fa8400f77d0 2021-11-03T18:47:19.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.160+0000 7fa836ffd700 1 -- 172.21.15.26:0/192359378 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa83001c620 con 0x7fa8400f77d0 2021-11-03T18:47:19.165 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.160+0000 7fa8471a0700 1 -- 172.21.15.26:0/192359378 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa840108800 con 0x7fa8400f77d0 2021-11-03T18:47:19.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.161+0000 7fa8471a0700 1 -- 172.21.15.26:0/192359378 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa840059100 con 0x7fa8400f77d0 2021-11-03T18:47:19.166 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.161+0000 7fa836ffd700 1 -- 172.21.15.26:0/192359378 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fa83001d960 con 0x7fa8400f77d0 2021-11-03T18:47:19.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.162+0000 7fa836ffd700 1 --2- 172.21.15.26:0/192359378 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa82c064100 0x7fa82c0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:47:19.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.162+0000 7fa836ffd700 1 -- 172.21.15.26:0/192359378 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fa830082480 con 0x7fa8400f77d0 2021-11-03T18:47:19.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.162+0000 7fa84619e700 1 --2- 172.21.15.26:0/192359378 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa82c064100 0x7fa82c0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:47:19.167 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.162+0000 7fa84619e700 1 --2- 172.21.15.26:0/192359378 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa82c064100 0x7fa82c0665c0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7fa83c007fd0 tx=0x7fa83c009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:47:19.168 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.166+0000 7fa836ffd700 1 -- 172.21.15.26:0/192359378 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fa8300548a0 con 0x7fa8400f77d0 2021-11-03T18:47:19.338 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.339+0000 7fa8471a0700 1 -- 172.21.15.26:0/192359378 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8400fee80 con 0x7fa82c064100 2021-11-03T18:47:19.352 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.354+0000 7fa836ffd700 1 -- 172.21.15.26:0/192359378 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7fa8400fee80 con 0x7fa82c064100 2021-11-03T18:47:19.353 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:47:19.353 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (118m) 6m ago 119m 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:47:19.353 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (110m) 6m ago 119m 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:47:19.353 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (110m) 5m ago 119m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:47:19.354 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (118m) 6m ago 119m 42.4M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:47:19.354 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (111m) 6m ago 114m 26.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:47:19.354 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (111m) 6m ago 114m 27.0M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:47:19.354 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (115m) 5m ago 114m 27.2M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:47:19.354 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (114m) 5m ago 114m 27.6M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:47:19.355 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (112m) 6m ago 2h 615M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:47:19.355 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (111m) 5m ago 118m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:47:19.355 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (111m) 6m ago 2h 407M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:47:19.355 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (111m) 5m ago 118m 187M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:47:19.356 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (119m) 6m ago 119m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:47:19.356 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (118m) 5m ago 118m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:47:19.356 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (110m) 6m ago 118m 372M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:47:19.356 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (109m) 6m ago 117m 400M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:47:19.357 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (109m) 6m ago 117m 332M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:47:19.357 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (108m) 5m ago 117m 438M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:47:19.357 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (108m) 5m ago 116m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:47:19.357 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (107m) 5m ago 116m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:47:19.357 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (118m) 6m ago 119m 70.2M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:47:19.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.356+0000 7fa8471a0700 1 -- 172.21.15.26:0/192359378 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa82c064100 msgr2=0x7fa82c0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:47:19.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.356+0000 7fa8471a0700 1 --2- 172.21.15.26:0/192359378 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa82c064100 0x7fa82c0665c0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7fa83c007fd0 tx=0x7fa83c009040).stop 2021-11-03T18:47:19.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.356+0000 7fa8471a0700 1 -- 172.21.15.26:0/192359378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8400f77d0 msgr2=0x7fa840107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:47:19.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.356+0000 7fa8471a0700 1 --2- 172.21.15.26:0/192359378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8400f77d0 0x7fa840107270 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 rx=0x7fa830009990 tx=0x7fa830009b30).stop 2021-11-03T18:47:19.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.356+0000 7fa8471a0700 1 -- 172.21.15.26:0/192359378 shutdown_connections 2021-11-03T18:47:19.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.356+0000 7fa8471a0700 1 --2- 172.21.15.26:0/192359378 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa82c064100 0x7fa82c0665c0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:19.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.356+0000 7fa8471a0700 1 --2- 172.21.15.26:0/192359378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8400f6530 0x7fa840106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:19.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.356+0000 7fa8471a0700 1 --2- 172.21.15.26:0/192359378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8400f77d0 0x7fa840107270 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:19.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.356+0000 7fa8471a0700 1 -- 172.21.15.26:0/192359378 >> 172.21.15.26:0/192359378 conn(0x7fa8400f1cd0 msgr2=0x7fa8400fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:47:19.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.356+0000 7fa8471a0700 1 -- 172.21.15.26:0/192359378 shutdown_connections 2021-11-03T18:47:19.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.356+0000 7fa8471a0700 1 -- 172.21.15.26:0/192359378 wait complete. 2021-11-03T18:47:19.455 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.455+0000 7f68d04cf700 1 -- 172.21.15.26:0/2138707458 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68c80f5ef0 msgr2=0x7f68c80f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:47:19.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.455+0000 7f68d04cf700 1 --2- 172.21.15.26:0/2138707458 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68c80f5ef0 0x7f68c80f6920 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 rx=0x7f68b8004660 tx=0x7f68b8009b30).stop 2021-11-03T18:47:19.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.455+0000 7f68d04cf700 1 -- 172.21.15.26:0/2138707458 shutdown_connections 2021-11-03T18:47:19.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.455+0000 7f68d04cf700 1 --2- 172.21.15.26:0/2138707458 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68c80f5ef0 0x7f68c80f6920 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:19.456 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.455+0000 7f68d04cf700 1 --2- 172.21.15.26:0/2138707458 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68c80f55e0 0x7f68c80f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:19.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.455+0000 7f68d04cf700 1 -- 172.21.15.26:0/2138707458 >> 172.21.15.26:0/2138707458 conn(0x7f68c80f0de0 msgr2=0x7f68c80f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:47:19.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.455+0000 7f68d04cf700 1 -- 172.21.15.26:0/2138707458 shutdown_connections 2021-11-03T18:47:19.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.455+0000 7f68d04cf700 1 -- 172.21.15.26:0/2138707458 wait complete. 2021-11-03T18:47:19.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.456+0000 7f68d04cf700 1 Processor -- start 2021-11-03T18:47:19.457 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.456+0000 7f68d04cf700 1 -- start start 2021-11-03T18:47:19.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.456+0000 7f68d04cf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68c80f55e0 0x7f68c80fd800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:47:19.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.456+0000 7f68d04cf700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68c80f5ef0 0x7f68c80fbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:47:19.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.456+0000 7f68d04cf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c80fc1e0 con 0x7f68c80f55e0 2021-11-03T18:47:19.458 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.456+0000 7f68d04cf700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c80fc320 con 0x7f68c80f5ef0 2021-11-03T18:47:19.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.456+0000 7f68ce26b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68c80f55e0 0x7f68c80fd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:47:19.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.456+0000 7f68ce26b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68c80f55e0 0x7f68c80fd800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33768/0 (socket says 172.21.15.26:33768) 2021-11-03T18:47:19.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.456+0000 7f68ce26b700 1 -- 172.21.15.26:0/1178819623 learned_addr learned my addr 172.21.15.26:0/1178819623 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:47:19.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.456+0000 7f68ce26b700 1 -- 172.21.15.26:0/1178819623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68c80f5ef0 msgr2=0x7f68c80fbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:47:19.459 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.456+0000 7f68ce26b700 1 --2- 172.21.15.26:0/1178819623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68c80f5ef0 0x7f68c80fbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:47:19.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.456+0000 7f68ce26b700 1 -- 172.21.15.26:0/1178819623 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b8005040 con 0x7f68c80f55e0 2021-11-03T18:47:19.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.456+0000 7f68ce26b700 1 --2- 172.21.15.26:0/1178819623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68c80f55e0 0x7f68c80fd800 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 rx=0x7f68c400c790 tx=0x7f68c4007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:47:19.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.457+0000 7f68beffd700 1 -- 172.21.15.26:0/1178819623 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68c400e680 con 0x7f68c80f55e0 2021-11-03T18:47:19.460 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.457+0000 7f68beffd700 1 -- 172.21.15.26:0/1178819623 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f68c400ec90 con 0x7f68c80f55e0 2021-11-03T18:47:19.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.457+0000 7f68d04cf700 1 -- 172.21.15.26:0/1178819623 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c80fc600 con 0x7f68c80f55e0 2021-11-03T18:47:19.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.457+0000 7f68beffd700 1 -- 172.21.15.26:0/1178819623 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68c4013d60 con 0x7f68c80f55e0 2021-11-03T18:47:19.461 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.457+0000 7f68d04cf700 1 -- 172.21.15.26:0/1178819623 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c810efb0 con 0x7f68c80f55e0 2021-11-03T18:47:19.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.458+0000 7f68d04cf700 1 -- 172.21.15.26:0/1178819623 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68c8045ad0 con 0x7f68c80f55e0 2021-11-03T18:47:19.462 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.458+0000 7f68beffd700 1 -- 172.21.15.26:0/1178819623 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f68c401a060 con 0x7f68c80f55e0 2021-11-03T18:47:19.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.459+0000 7f68beffd700 1 --2- 172.21.15.26:0/1178819623 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f68b40640b0 0x7f68b4066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:47:19.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.459+0000 7f68beffd700 1 -- 172.21.15.26:0/1178819623 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f68c4080bb0 con 0x7f68c80f55e0 2021-11-03T18:47:19.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.459+0000 7f68cda6a700 1 --2- 172.21.15.26:0/1178819623 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f68b40640b0 0x7f68b4066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:47:19.463 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.459+0000 7f68cda6a700 1 --2- 172.21.15.26:0/1178819623 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f68b40640b0 0x7f68b4066570 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7f68b8004e30 tx=0x7f68b8009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:47:19.464 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.463+0000 7f68beffd700 1 -- 172.21.15.26:0/1178819623 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f68c4052ed0 con 0x7f68c80f55e0 2021-11-03T18:47:19.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:19 smithi026 ceph-mon[96795]: pgmap v3379: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:19.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.691+0000 7f68d04cf700 1 -- 172.21.15.26:0/1178819623 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f68c8027a00 con 0x7f68c80f55e0 2021-11-03T18:47:19.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.692+0000 7f68beffd700 1 -- 172.21.15.26:0/1178819623 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f68c40182e0 con 0x7f68c80f55e0 2021-11-03T18:47:19.690 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:47:19.691 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:47:19.691 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:47:19.691 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:47:19.691 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:47:19.692 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:47:19.692 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:47:19.692 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:47:19.692 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:47:19.693 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:47:19.693 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:47:19.693 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:47:19.693 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:47:19.693 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:47:19.694 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:47:19.694 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:47:19.694 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:47:19.694 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:47:19.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.694+0000 7f68d04cf700 1 -- 172.21.15.26:0/1178819623 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f68b40640b0 msgr2=0x7f68b4066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:47:19.695 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.694+0000 7f68d04cf700 1 --2- 172.21.15.26:0/1178819623 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f68b40640b0 0x7f68b4066570 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7f68b8004e30 tx=0x7f68b8009b30).stop 2021-11-03T18:47:19.696 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.694+0000 7f68d04cf700 1 -- 172.21.15.26:0/1178819623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68c80f55e0 msgr2=0x7f68c80fd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:47:19.696 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.694+0000 7f68d04cf700 1 --2- 172.21.15.26:0/1178819623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68c80f55e0 0x7f68c80fd800 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 rx=0x7f68c400c790 tx=0x7f68c4007d70).stop 2021-11-03T18:47:19.696 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.694+0000 7f68d04cf700 1 -- 172.21.15.26:0/1178819623 shutdown_connections 2021-11-03T18:47:19.696 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.694+0000 7f68d04cf700 1 --2- 172.21.15.26:0/1178819623 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f68b40640b0 0x7f68b4066570 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:19.696 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.694+0000 7f68d04cf700 1 --2- 172.21.15.26:0/1178819623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68c80f55e0 0x7f68c80fd800 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:19.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.694+0000 7f68d04cf700 1 --2- 172.21.15.26:0/1178819623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68c80f5ef0 0x7f68c80fbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:47:19.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.694+0000 7f68d04cf700 1 -- 172.21.15.26:0/1178819623 >> 172.21.15.26:0/1178819623 conn(0x7f68c80f0de0 msgr2=0x7f68c80fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:47:19.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.694+0000 7f68d04cf700 1 -- 172.21.15.26:0/1178819623 shutdown_connections 2021-11-03T18:47:19.697 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.694+0000 7f68d04cf700 1 -- 172.21.15.26:0/1178819623 wait complete. 2021-11-03T18:47:19.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:19 smithi194 ceph-mon[65619]: pgmap v3379: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:19.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.794+0000 7fbd35314700 1 -- 172.21.15.26:0/3794420868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd30060250 msgr2=0x7fbd300f9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:47:19.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.794+0000 7fbd35314700 1 --2- 172.21.15.26:0/3794420868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd30060250 0x7fbd300f9200 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 rx=0x7fbd20004660 tx=0x7fbd20009b30).stop 2021-11-03T18:47:19.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.794+0000 7fbd35314700 1 -- 172.21.15.26:0/3794420868 shutdown_connections 2021-11-03T18:47:19.793 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.794+0000 7fbd35314700 1 --2- 172.21.15.26:0/3794420868 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd300f96f0 0x7fbd300fbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:19.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.794+0000 7fbd35314700 1 --2- 172.21.15.26:0/3794420868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd30060250 0x7fbd300f9200 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:19.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.794+0000 7fbd35314700 1 -- 172.21.15.26:0/3794420868 >> 172.21.15.26:0/3794420868 conn(0x7fbd300f0bc0 msgr2=0x7fbd300f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:47:19.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.794+0000 7fbd35314700 1 -- 172.21.15.26:0/3794420868 shutdown_connections 2021-11-03T18:47:19.794 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.794+0000 7fbd35314700 1 -- 172.21.15.26:0/3794420868 wait complete. 2021-11-03T18:47:19.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.795+0000 7fbd35314700 1 Processor -- start 2021-11-03T18:47:19.797 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.795+0000 7fbd35314700 1 -- start start 2021-11-03T18:47:19.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.795+0000 7fbd35314700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd30060250 0x7fbd30106e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:47:19.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.795+0000 7fbd35314700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd300f96f0 0x7fbd30107320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:47:19.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.795+0000 7fbd35314700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd30107920 con 0x7fbd300f96f0 2021-11-03T18:47:19.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.795+0000 7fbd35314700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd30108130 con 0x7fbd30060250 2021-11-03T18:47:19.798 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.795+0000 7fbd2e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd300f96f0 0x7fbd30107320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:47:19.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.795+0000 7fbd2e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd300f96f0 0x7fbd30107320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33780/0 (socket says 172.21.15.26:33780) 2021-11-03T18:47:19.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.795+0000 7fbd2e7fc700 1 -- 172.21.15.26:0/3143604822 learned_addr learned my addr 172.21.15.26:0/3143604822 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:47:19.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.796+0000 7fbd2effd700 1 --2- 172.21.15.26:0/3143604822 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd30060250 0x7fbd30106e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:47:19.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.796+0000 7fbd2e7fc700 1 -- 172.21.15.26:0/3143604822 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd30060250 msgr2=0x7fbd30106e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:47:19.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.796+0000 7fbd2e7fc700 1 --2- 172.21.15.26:0/3143604822 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd30060250 0x7fbd30106e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:19.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.796+0000 7fbd2e7fc700 1 -- 172.21.15.26:0/3143604822 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd20005040 con 0x7fbd300f96f0 2021-11-03T18:47:19.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.796+0000 7fbd2e7fc700 1 --2- 172.21.15.26:0/3143604822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd300f96f0 0x7fbd30107320 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 rx=0x7fbd240026d0 tx=0x7fbd24009d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:47:19.800 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.796+0000 7fbd177fe700 1 -- 172.21.15.26:0/3143604822 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd24009320 con 0x7fbd300f96f0 2021-11-03T18:47:19.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.796+0000 7fbd177fe700 1 -- 172.21.15.26:0/3143604822 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbd2400f040 con 0x7fbd300f96f0 2021-11-03T18:47:19.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.796+0000 7fbd35314700 1 -- 172.21.15.26:0/3143604822 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd301083b0 con 0x7fbd300f96f0 2021-11-03T18:47:19.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.796+0000 7fbd177fe700 1 -- 172.21.15.26:0/3143604822 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd24014760 con 0x7fbd300f96f0 2021-11-03T18:47:19.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.796+0000 7fbd35314700 1 -- 172.21.15.26:0/3143604822 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd30108970 con 0x7fbd300f96f0 2021-11-03T18:47:19.801 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.797+0000 7fbd35314700 1 -- 172.21.15.26:0/3143604822 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd30059100 con 0x7fbd300f96f0 2021-11-03T18:47:19.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.797+0000 7fbd177fe700 1 -- 172.21.15.26:0/3143604822 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fbd24009480 con 0x7fbd300f96f0 2021-11-03T18:47:19.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.798+0000 7fbd177fe700 1 --2- 172.21.15.26:0/3143604822 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbd18064100 0x7fbd180665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:47:19.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.798+0000 7fbd177fe700 1 -- 172.21.15.26:0/3143604822 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fbd24080e50 con 0x7fbd300f96f0 2021-11-03T18:47:19.802 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.798+0000 7fbd2effd700 1 --2- 172.21.15.26:0/3143604822 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbd18064100 0x7fbd180665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:47:19.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.798+0000 7fbd2effd700 1 --2- 172.21.15.26:0/3143604822 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbd18064100 0x7fbd180665c0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 rx=0x7fbd20009da0 tx=0x7fbd20009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:47:19.803 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:19.802+0000 7fbd177fe700 1 -- 172.21.15.26:0/3143604822 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fbd24053150 con 0x7fbd300f96f0 2021-11-03T18:47:20.002 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:20.003+0000 7fbd35314700 1 -- 172.21.15.26:0/3143604822 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbd300fed70 con 0x7fbd300f96f0 2021-11-03T18:47:20.003 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:20.004+0000 7fbd177fe700 1 -- 172.21.15.26:0/3143604822 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fbd24052d40 con 0x7fbd300f96f0 2021-11-03T18:47:20.003 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:47:20.003 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:47:20.004 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:47:20.004 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:47:20.004 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:47:20.004 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:47:20.005 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:47:20.005 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:47:20.005 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:47:20.005 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:47:20.006 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:47:20.006 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:47:20.006 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:47:20.006 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:47:20.006 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:47:20.007 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:47:20.007 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:47:20.007 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:47:20.007 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:47:20.007 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:47:20.008 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:47:20.008 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:47:20.008 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:47:20.008 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:47:20.009 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:47:20.009 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:47:20.009 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:47:20.009 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:47:20.009 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:47:20.010 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:47:20.010 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:47:20.010 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:47:20.010 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:47:20.010 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:47:20.011 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:47:20.011 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:47:20.011 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:47:20.011 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:47:20.012 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:47:20.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:20.006+0000 7fbd35314700 1 -- 172.21.15.26:0/3143604822 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbd18064100 msgr2=0x7fbd180665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:47:20.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:20.006+0000 7fbd35314700 1 --2- 172.21.15.26:0/3143604822 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbd18064100 0x7fbd180665c0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 rx=0x7fbd20009da0 tx=0x7fbd20009b30).stop 2021-11-03T18:47:20.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:20.006+0000 7fbd35314700 1 -- 172.21.15.26:0/3143604822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd300f96f0 msgr2=0x7fbd30107320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:47:20.013 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:20.006+0000 7fbd35314700 1 --2- 172.21.15.26:0/3143604822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd300f96f0 0x7fbd30107320 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 rx=0x7fbd240026d0 tx=0x7fbd24009d40).stop 2021-11-03T18:47:20.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:20.006+0000 7fbd35314700 1 -- 172.21.15.26:0/3143604822 shutdown_connections 2021-11-03T18:47:20.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:20.006+0000 7fbd35314700 1 --2- 172.21.15.26:0/3143604822 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fbd18064100 0x7fbd180665c0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:20.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:20.006+0000 7fbd35314700 1 --2- 172.21.15.26:0/3143604822 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd30060250 0x7fbd30106e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:20.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:20.006+0000 7fbd35314700 1 --2- 172.21.15.26:0/3143604822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd300f96f0 0x7fbd30107320 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:20.014 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:20.006+0000 7fbd35314700 1 -- 172.21.15.26:0/3143604822 >> 172.21.15.26:0/3143604822 conn(0x7fbd300f0bc0 msgr2=0x7fbd300f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:47:20.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:20.006+0000 7fbd35314700 1 -- 172.21.15.26:0/3143604822 shutdown_connections 2021-11-03T18:47:20.015 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:20.006+0000 7fbd35314700 1 -- 172.21.15.26:0/3143604822 wait complete. 2021-11-03T18:47:20.015 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:47:20.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:20 smithi026 ceph-mon[96795]: from='client.37612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:47:20.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:20 smithi026 ceph-mon[96795]: from='client.37616 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:47:20.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:20 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1178819623' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:47:20.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:20 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3143604822' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:47:20.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:20 smithi194 ceph-mon[65619]: from='client.37612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:47:20.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:20 smithi194 ceph-mon[65619]: from='client.37616 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:47:20.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:20 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1178819623' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:47:20.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:20 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3143604822' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:47:21.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:21 smithi026 ceph-mon[96795]: pgmap v3380: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:21.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:21 smithi194 ceph-mon[65619]: pgmap v3380: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:23.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:23 smithi026 ceph-mon[96795]: pgmap v3381: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:23.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:23 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:47:23.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:23 smithi194 ceph-mon[65619]: pgmap v3381: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:23.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:23 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:47:24.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:24 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:47:24.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:24 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:47:25.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:25 smithi026 ceph-mon[96795]: pgmap v3382: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:25.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:25 smithi194 ceph-mon[65619]: pgmap v3382: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:27.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:27 smithi026 ceph-mon[96795]: pgmap v3383: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:27.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:27 smithi194 ceph-mon[65619]: pgmap v3383: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:29.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:29 smithi026 ceph-mon[96795]: pgmap v3384: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:29.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:29 smithi194 ceph-mon[65619]: pgmap v3384: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:31.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:31 smithi026 ceph-mon[96795]: pgmap v3385: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:31.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:31 smithi194 ceph-mon[65619]: pgmap v3385: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:33.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:33 smithi026 ceph-mon[96795]: pgmap v3386: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:33.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:33 smithi194 ceph-mon[65619]: pgmap v3386: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:35.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:35 smithi026 ceph-mon[96795]: pgmap v3387: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:35.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:35 smithi194 ceph-mon[65619]: pgmap v3387: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:37.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:37 smithi026 ceph-mon[96795]: pgmap v3388: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:37.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:37 smithi194 ceph-mon[65619]: pgmap v3388: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:38.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:38 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:47:38.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:38 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:47:39.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:39 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:47:39.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:39 smithi026 ceph-mon[96795]: pgmap v3389: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:39.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:39 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:47:39.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:39 smithi194 ceph-mon[65619]: pgmap v3389: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:41.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:41 smithi026 ceph-mon[96795]: pgmap v3390: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:41.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:41 smithi194 ceph-mon[65619]: pgmap v3390: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:43.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:43 smithi026 ceph-mon[96795]: pgmap v3391: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:43.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:43 smithi194 ceph-mon[65619]: pgmap v3391: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:45.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:45 smithi026 ceph-mon[96795]: pgmap v3392: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:45.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:45 smithi194 ceph-mon[65619]: pgmap v3392: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:47.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:47 smithi026 ceph-mon[96795]: pgmap v3393: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:47.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:47 smithi194 ceph-mon[65619]: pgmap v3393: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:49.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:49 smithi026 ceph-mon[96795]: pgmap v3394: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:49.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:47:49.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:47:49.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:49 smithi194 ceph-mon[65619]: pgmap v3394: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:49.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:47:49.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:47:50.119 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.119+0000 7f51b15bf700 1 -- 172.21.15.26:0/1335272516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51ac0f6ff0 msgr2=0x7f51ac0f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:47:50.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.119+0000 7f51b15bf700 1 --2- 172.21.15.26:0/1335272516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51ac0f6ff0 0x7f51ac0f7a20 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 rx=0x7f5194004660 tx=0x7f5194009b30).stop 2021-11-03T18:47:50.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.119+0000 7f51b15bf700 1 -- 172.21.15.26:0/1335272516 shutdown_connections 2021-11-03T18:47:50.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.119+0000 7f51b15bf700 1 --2- 172.21.15.26:0/1335272516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51ac0f6ff0 0x7f51ac0f7a20 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:50.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.119+0000 7f51b15bf700 1 --2- 172.21.15.26:0/1335272516 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51ac0f66e0 0x7f51ac0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:50.120 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.119+0000 7f51b15bf700 1 -- 172.21.15.26:0/1335272516 >> 172.21.15.26:0/1335272516 conn(0x7f51ac0f1f00 msgr2=0x7f51ac0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:47:50.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.119+0000 7f51b15bf700 1 -- 172.21.15.26:0/1335272516 shutdown_connections 2021-11-03T18:47:50.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.119+0000 7f51b15bf700 1 -- 172.21.15.26:0/1335272516 wait complete. 2021-11-03T18:47:50.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.120+0000 7f51b15bf700 1 Processor -- start 2021-11-03T18:47:50.121 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.120+0000 7f51b15bf700 1 -- start start 2021-11-03T18:47:50.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.120+0000 7f51b15bf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51ac0f66e0 0x7f51ac106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:47:50.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.120+0000 7f51b15bf700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51ac0f6ff0 0x7f51ac1073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:47:50.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.120+0000 7f51b15bf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac107990 con 0x7f51ac0f66e0 2021-11-03T18:47:50.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.120+0000 7f51b15bf700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac107ad0 con 0x7f51ac0f6ff0 2021-11-03T18:47:50.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.121+0000 7f51aaffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51ac0f66e0 0x7f51ac106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:47:50.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.121+0000 7f51aaffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51ac0f66e0 0x7f51ac106ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33796/0 (socket says 172.21.15.26:33796) 2021-11-03T18:47:50.125 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.121+0000 7f51aaffd700 1 -- 172.21.15.26:0/245456184 learned_addr learned my addr 172.21.15.26:0/245456184 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:47:50.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.121+0000 7f51a27fc700 1 --2- 172.21.15.26:0/245456184 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51ac0f6ff0 0x7f51ac1073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:47:50.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.121+0000 7f51aaffd700 1 -- 172.21.15.26:0/245456184 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51ac0f6ff0 msgr2=0x7f51ac1073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:47:50.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.121+0000 7f51aaffd700 1 --2- 172.21.15.26:0/245456184 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51ac0f6ff0 0x7f51ac1073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:50.126 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.121+0000 7f51aaffd700 1 -- 172.21.15.26:0/245456184 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5194005040 con 0x7f51ac0f66e0 2021-11-03T18:47:50.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.121+0000 7f51aaffd700 1 --2- 172.21.15.26:0/245456184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51ac0f66e0 0x7f51ac106ef0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 rx=0x7f519c00e7f0 tx=0x7f519c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:47:50.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.121+0000 7f51a3fff700 1 -- 172.21.15.26:0/245456184 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f519c0092e0 con 0x7f51ac0f66e0 2021-11-03T18:47:50.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.121+0000 7f51a3fff700 1 -- 172.21.15.26:0/245456184 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f519c00f040 con 0x7f51ac0f66e0 2021-11-03T18:47:50.127 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.121+0000 7f51b15bf700 1 -- 172.21.15.26:0/245456184 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51ac108470 con 0x7f51ac0f66e0 2021-11-03T18:47:50.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.121+0000 7f51a3fff700 1 -- 172.21.15.26:0/245456184 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f519c014750 con 0x7f51ac0f66e0 2021-11-03T18:47:50.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.121+0000 7f51b15bf700 1 -- 172.21.15.26:0/245456184 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ac108a30 con 0x7f51ac0f66e0 2021-11-03T18:47:50.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.122+0000 7f51b15bf700 1 -- 172.21.15.26:0/245456184 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51ac045ad0 con 0x7f51ac0f66e0 2021-11-03T18:47:50.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.123+0000 7f51a3fff700 1 -- 172.21.15.26:0/245456184 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f519c01b030 con 0x7f51ac0f66e0 2021-11-03T18:47:50.128 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.123+0000 7f51a3fff700 1 --2- 172.21.15.26:0/245456184 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f51980640b0 0x7f5198066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:47:50.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.123+0000 7f51a3fff700 1 -- 172.21.15.26:0/245456184 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f519c080680 con 0x7f51ac0f66e0 2021-11-03T18:47:50.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.123+0000 7f51a27fc700 1 --2- 172.21.15.26:0/245456184 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f51980640b0 0x7f5198066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:47:50.129 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.124+0000 7f51a27fc700 1 --2- 172.21.15.26:0/245456184 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f51980640b0 0x7f5198066570 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7f5194005010 tx=0x7f5194016040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:47:50.130 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.127+0000 7f51a3fff700 1 -- 172.21.15.26:0/245456184 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f519c0529a0 con 0x7f51ac0f66e0 2021-11-03T18:47:50.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.316+0000 7f51b15bf700 1 -- 172.21.15.26:0/245456184 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f51ac0ff050 con 0x7f51980640b0 2021-11-03T18:47:50.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.318+0000 7f51a3fff700 1 -- 172.21.15.26:0/245456184 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f51ac0ff050 con 0x7f51980640b0 2021-11-03T18:47:50.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.320+0000 7f51b15bf700 1 -- 172.21.15.26:0/245456184 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f51980640b0 msgr2=0x7f5198066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:47:50.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.320+0000 7f51b15bf700 1 --2- 172.21.15.26:0/245456184 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f51980640b0 0x7f5198066570 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7f5194005010 tx=0x7f5194016040).stop 2021-11-03T18:47:50.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.320+0000 7f51b15bf700 1 -- 172.21.15.26:0/245456184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51ac0f66e0 msgr2=0x7f51ac106ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:47:50.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.320+0000 7f51b15bf700 1 --2- 172.21.15.26:0/245456184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51ac0f66e0 0x7f51ac106ef0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 rx=0x7f519c00e7f0 tx=0x7f519c00b040).stop 2021-11-03T18:47:50.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.320+0000 7f51b15bf700 1 -- 172.21.15.26:0/245456184 shutdown_connections 2021-11-03T18:47:50.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.320+0000 7f51b15bf700 1 --2- 172.21.15.26:0/245456184 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f51980640b0 0x7f5198066570 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:50.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.320+0000 7f51b15bf700 1 --2- 172.21.15.26:0/245456184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51ac0f66e0 0x7f51ac106ef0 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:50.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.320+0000 7f51b15bf700 1 --2- 172.21.15.26:0/245456184 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51ac0f6ff0 0x7f51ac1073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:50.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.320+0000 7f51b15bf700 1 -- 172.21.15.26:0/245456184 >> 172.21.15.26:0/245456184 conn(0x7f51ac0f1f00 msgr2=0x7f51ac0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:47:50.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.320+0000 7f51b15bf700 1 -- 172.21.15.26:0/245456184 shutdown_connections 2021-11-03T18:47:50.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.320+0000 7f51b15bf700 1 -- 172.21.15.26:0/245456184 wait complete. 2021-11-03T18:47:50.329 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:47:50.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.421+0000 7f8ff56e0700 1 -- 172.21.15.26:0/1695124714 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ff00f6ff0 msgr2=0x7f8ff00f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:47:50.422 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.421+0000 7f8ff56e0700 1 --2- 172.21.15.26:0/1695124714 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ff00f6ff0 0x7f8ff00f7a20 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 rx=0x7f8fe0004660 tx=0x7f8fe0009b30).stop 2021-11-03T18:47:50.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.421+0000 7f8ff56e0700 1 -- 172.21.15.26:0/1695124714 shutdown_connections 2021-11-03T18:47:50.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.421+0000 7f8ff56e0700 1 --2- 172.21.15.26:0/1695124714 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ff00f6ff0 0x7f8ff00f7a20 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:50.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.421+0000 7f8ff56e0700 1 --2- 172.21.15.26:0/1695124714 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ff00f66e0 0x7f8ff00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:50.423 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.421+0000 7f8ff56e0700 1 -- 172.21.15.26:0/1695124714 >> 172.21.15.26:0/1695124714 conn(0x7f8ff00f1f00 msgr2=0x7f8ff00f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:47:50.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.421+0000 7f8ff56e0700 1 -- 172.21.15.26:0/1695124714 shutdown_connections 2021-11-03T18:47:50.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.421+0000 7f8ff56e0700 1 -- 172.21.15.26:0/1695124714 wait complete. 2021-11-03T18:47:50.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.422+0000 7f8ff56e0700 1 Processor -- start 2021-11-03T18:47:50.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.422+0000 7f8ff56e0700 1 -- start start 2021-11-03T18:47:50.424 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.422+0000 7f8ff56e0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ff00f66e0 0x7f8ff0106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:47:50.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.422+0000 7f8ff56e0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ff00f6ff0 0x7f8ff0107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:47:50.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.422+0000 7f8ff56e0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff0107a10 con 0x7f8ff00f66e0 2021-11-03T18:47:50.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.422+0000 7f8ff56e0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff0107b50 con 0x7f8ff00f6ff0 2021-11-03T18:47:50.425 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.422+0000 7f8feeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ff00f66e0 0x7f8ff0106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:47:50.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.422+0000 7f8feeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ff00f66e0 0x7f8ff0106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33806/0 (socket says 172.21.15.26:33806) 2021-11-03T18:47:50.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.422+0000 7f8feeffd700 1 -- 172.21.15.26:0/2371378235 learned_addr learned my addr 172.21.15.26:0/2371378235 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:47:50.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.422+0000 7f8fee7fc700 1 --2- 172.21.15.26:0/2371378235 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ff00f6ff0 0x7f8ff0107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:47:50.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.422+0000 7f8feeffd700 1 -- 172.21.15.26:0/2371378235 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ff00f6ff0 msgr2=0x7f8ff0107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:47:50.426 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.422+0000 7f8feeffd700 1 --2- 172.21.15.26:0/2371378235 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ff00f6ff0 0x7f8ff0107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:50.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.422+0000 7f8feeffd700 1 -- 172.21.15.26:0/2371378235 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe0005040 con 0x7f8ff00f66e0 2021-11-03T18:47:50.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.422+0000 7f8fee7fc700 1 --2- 172.21.15.26:0/2371378235 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ff00f6ff0 0x7f8ff0107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:47:50.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.422+0000 7f8feeffd700 1 --2- 172.21.15.26:0/2371378235 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ff00f66e0 0x7f8ff0106f70 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 rx=0x7f8fe400c530 tx=0x7f8fe4007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:47:50.427 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.423+0000 7f8fd77fe700 1 -- 172.21.15.26:0/2371378235 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fe400f650 con 0x7f8ff00f66e0 2021-11-03T18:47:50.428 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.423+0000 7f8fd77fe700 1 -- 172.21.15.26:0/2371378235 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8fe400fc60 con 0x7f8ff00f66e0 2021-11-03T18:47:50.428 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.423+0000 7f8ff56e0700 1 -- 172.21.15.26:0/2371378235 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ff01084f0 con 0x7f8ff00f66e0 2021-11-03T18:47:50.428 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.423+0000 7f8fd77fe700 1 -- 172.21.15.26:0/2371378235 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fe4012cd0 con 0x7f8ff00f66e0 2021-11-03T18:47:50.428 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.423+0000 7f8ff56e0700 1 -- 172.21.15.26:0/2371378235 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ff0108ab0 con 0x7f8ff00f66e0 2021-11-03T18:47:50.429 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.423+0000 7f8ff56e0700 1 -- 172.21.15.26:0/2371378235 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ff0045ad0 con 0x7f8ff00f66e0 2021-11-03T18:47:50.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.424+0000 7f8fd77fe700 1 -- 172.21.15.26:0/2371378235 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f8fe4010070 con 0x7f8ff00f66e0 2021-11-03T18:47:50.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.425+0000 7f8fd77fe700 1 --2- 172.21.15.26:0/2371378235 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8fd80640b0 0x7f8fd8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:47:50.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.425+0000 7f8fd77fe700 1 -- 172.21.15.26:0/2371378235 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f8fe4080e50 con 0x7f8ff00f66e0 2021-11-03T18:47:50.430 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.425+0000 7f8fee7fc700 1 --2- 172.21.15.26:0/2371378235 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8fd80640b0 0x7f8fd8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:47:50.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.425+0000 7f8fee7fc700 1 --2- 172.21.15.26:0/2371378235 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8fd80640b0 0x7f8fd8066570 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7f8fe0004e30 tx=0x7f8fe0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:47:50.431 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.428+0000 7f8fd77fe700 1 -- 172.21.15.26:0/2371378235 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f8fe4053140 con 0x7f8ff00f66e0 2021-11-03T18:47:50.599 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.600+0000 7f8ff56e0700 1 -- 172.21.15.26:0/2371378235 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ff0108d20 con 0x7f8fd80640b0 2021-11-03T18:47:50.613 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.614+0000 7f8fd77fe700 1 -- 172.21.15.26:0/2371378235 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7f8ff0108d20 con 0x7f8fd80640b0 2021-11-03T18:47:50.614 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:47:50.614 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (119m) 7m ago 2h 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:47:50.614 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (111m) 7m ago 2h 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:47:50.615 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (111m) 6m ago 119m 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:47:50.615 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (118m) 7m ago 2h 42.4M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:47:50.615 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (112m) 7m ago 115m 26.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:47:50.615 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (112m) 7m ago 115m 27.0M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:47:50.615 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (115m) 6m ago 115m 27.2M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:47:50.616 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (115m) 6m ago 115m 27.6M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:47:50.616 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (112m) 7m ago 2h 615M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:47:50.616 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (112m) 6m ago 119m 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:47:50.616 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (112m) 7m ago 2h 407M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:47:50.617 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (111m) 6m ago 119m 187M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:47:50.617 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (119m) 7m ago 119m 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:47:50.617 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (119m) 6m ago 119m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:47:50.617 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (110m) 7m ago 118m 372M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:47:50.617 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (110m) 7m ago 118m 400M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:47:50.618 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (109m) 7m ago 117m 332M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:47:50.618 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (109m) 6m ago 117m 438M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:47:50.618 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (108m) 6m ago 117m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:47:50.618 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (108m) 6m ago 117m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:47:50.619 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (118m) 7m ago 119m 70.2M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:47:50.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.616+0000 7f8ff56e0700 1 -- 172.21.15.26:0/2371378235 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8fd80640b0 msgr2=0x7f8fd8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:47:50.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.616+0000 7f8ff56e0700 1 --2- 172.21.15.26:0/2371378235 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8fd80640b0 0x7f8fd8066570 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7f8fe0004e30 tx=0x7f8fe0009b30).stop 2021-11-03T18:47:50.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.616+0000 7f8ff56e0700 1 -- 172.21.15.26:0/2371378235 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ff00f66e0 msgr2=0x7f8ff0106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:47:50.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.616+0000 7f8ff56e0700 1 --2- 172.21.15.26:0/2371378235 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ff00f66e0 0x7f8ff0106f70 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 rx=0x7f8fe400c530 tx=0x7f8fe4007e20).stop 2021-11-03T18:47:50.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.616+0000 7f8ff56e0700 1 -- 172.21.15.26:0/2371378235 shutdown_connections 2021-11-03T18:47:50.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.616+0000 7f8ff56e0700 1 --2- 172.21.15.26:0/2371378235 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f8fd80640b0 0x7f8fd8066570 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:50.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.616+0000 7f8ff56e0700 1 --2- 172.21.15.26:0/2371378235 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ff00f66e0 0x7f8ff0106f70 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:50.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.616+0000 7f8ff56e0700 1 --2- 172.21.15.26:0/2371378235 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ff00f6ff0 0x7f8ff0107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:50.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.616+0000 7f8ff56e0700 1 -- 172.21.15.26:0/2371378235 >> 172.21.15.26:0/2371378235 conn(0x7f8ff00f1f00 msgr2=0x7f8ff00fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:47:50.622 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.616+0000 7f8ff56e0700 1 -- 172.21.15.26:0/2371378235 shutdown_connections 2021-11-03T18:47:50.622 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.616+0000 7f8ff56e0700 1 -- 172.21.15.26:0/2371378235 wait complete. 2021-11-03T18:47:50.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.715+0000 7f1fce0c0700 1 -- 172.21.15.26:0/3991029242 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fc80f96b0 msgr2=0x7f1fc80fbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:47:50.716 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.715+0000 7f1fce0c0700 1 --2- 172.21.15.26:0/3991029242 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fc80f96b0 0x7f1fc80fbb00 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 rx=0x7f1fbc004660 tx=0x7f1fbc009b30).stop 2021-11-03T18:47:50.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.715+0000 7f1fce0c0700 1 -- 172.21.15.26:0/3991029242 shutdown_connections 2021-11-03T18:47:50.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.715+0000 7f1fce0c0700 1 --2- 172.21.15.26:0/3991029242 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fc80f96b0 0x7f1fc80fbb00 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:50.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.715+0000 7f1fce0c0700 1 --2- 172.21.15.26:0/3991029242 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fc8060270 0x7f1fc80f91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:50.717 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.715+0000 7f1fce0c0700 1 -- 172.21.15.26:0/3991029242 >> 172.21.15.26:0/3991029242 conn(0x7f1fc80f0ba0 msgr2=0x7f1fc80f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:47:50.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.715+0000 7f1fce0c0700 1 -- 172.21.15.26:0/3991029242 shutdown_connections 2021-11-03T18:47:50.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.716+0000 7f1fce0c0700 1 -- 172.21.15.26:0/3991029242 wait complete. 2021-11-03T18:47:50.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.716+0000 7f1fce0c0700 1 Processor -- start 2021-11-03T18:47:50.718 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.716+0000 7f1fce0c0700 1 -- start start 2021-11-03T18:47:50.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.716+0000 7f1fce0c0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fc8060270 0x7f1fc8106db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:47:50.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.716+0000 7f1fce0c0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fc80f96b0 0x7f1fc81072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:47:50.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.716+0000 7f1fce0c0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc81078a0 con 0x7f1fc80f96b0 2021-11-03T18:47:50.719 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.716+0000 7f1fce0c0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc81080e0 con 0x7f1fc8060270 2021-11-03T18:47:50.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.716+0000 7f1fcc8bd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fc80f96b0 0x7f1fc81072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:47:50.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.716+0000 7f1fcc8bd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fc80f96b0 0x7f1fc81072a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33818/0 (socket says 172.21.15.26:33818) 2021-11-03T18:47:50.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.716+0000 7f1fcc8bd700 1 -- 172.21.15.26:0/2199867799 learned_addr learned my addr 172.21.15.26:0/2199867799 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:47:50.720 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.716+0000 7f1fcd0be700 1 --2- 172.21.15.26:0/2199867799 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fc8060270 0x7f1fc8106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:47:50.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.717+0000 7f1fcc8bd700 1 -- 172.21.15.26:0/2199867799 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fc8060270 msgr2=0x7f1fc8106db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:47:50.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.717+0000 7f1fcc8bd700 1 --2- 172.21.15.26:0/2199867799 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fc8060270 0x7f1fc8106db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:50.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.717+0000 7f1fcc8bd700 1 -- 172.21.15.26:0/2199867799 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fbc005040 con 0x7f1fc80f96b0 2021-11-03T18:47:50.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.717+0000 7f1fcc8bd700 1 --2- 172.21.15.26:0/2199867799 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fc80f96b0 0x7f1fc81072a0 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 rx=0x7f1fbc013a70 tx=0x7f1fbc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:47:50.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.717+0000 7f1fc5ffb700 1 -- 172.21.15.26:0/2199867799 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fbc018070 con 0x7f1fc80f96b0 2021-11-03T18:47:50.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.717+0000 7f1fce0c0700 1 -- 172.21.15.26:0/2199867799 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fc8108360 con 0x7f1fc80f96b0 2021-11-03T18:47:50.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.717+0000 7f1fc5ffb700 1 -- 172.21.15.26:0/2199867799 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1fbc007ba0 con 0x7f1fc80f96b0 2021-11-03T18:47:50.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.717+0000 7f1fc5ffb700 1 -- 172.21.15.26:0/2199867799 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fbc01c3c0 con 0x7f1fc80f96b0 2021-11-03T18:47:50.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.717+0000 7f1fce0c0700 1 -- 172.21.15.26:0/2199867799 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fc8108840 con 0x7f1fc80f96b0 2021-11-03T18:47:50.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.718+0000 7f1fce0c0700 1 -- 172.21.15.26:0/2199867799 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fc8059100 con 0x7f1fc80f96b0 2021-11-03T18:47:50.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.719+0000 7f1fc5ffb700 1 -- 172.21.15.26:0/2199867799 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f1fbc01d420 con 0x7f1fc80f96b0 2021-11-03T18:47:50.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.719+0000 7f1fc5ffb700 1 --2- 172.21.15.26:0/2199867799 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1fb0064100 0x7f1fb00665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:47:50.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.719+0000 7f1fc5ffb700 1 -- 172.21.15.26:0/2199867799 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f1fbc082520 con 0x7f1fc80f96b0 2021-11-03T18:47:50.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.719+0000 7f1fcd0be700 1 --2- 172.21.15.26:0/2199867799 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1fb0064100 0x7f1fb00665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:47:50.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.719+0000 7f1fcd0be700 1 --2- 172.21.15.26:0/2199867799 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1fb0064100 0x7f1fb00665c0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7f1fc8107b70 tx=0x7f1fc0009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:47:50.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.723+0000 7f1fc5ffb700 1 -- 172.21.15.26:0/2199867799 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f1fbc054880 con 0x7f1fc80f96b0 2021-11-03T18:47:50.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.954+0000 7f1fce0c0700 1 -- 172.21.15.26:0/2199867799 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1fc80008d0 con 0x7f1fc80f96b0 2021-11-03T18:47:50.953 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.954+0000 7f1fc5ffb700 1 -- 172.21.15.26:0/2199867799 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f1fbc054470 con 0x7f1fc80f96b0 2021-11-03T18:47:50.954 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:47:50.954 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:47:50.954 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:47:50.955 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:47:50.955 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:47:50.955 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:47:50.955 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:47:50.956 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:47:50.956 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:47:50.956 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:47:50.956 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:47:50.957 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:47:50.957 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:47:50.957 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:47:50.957 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:47:50.957 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:47:50.958 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:47:50.958 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:47:50.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.956+0000 7f1fce0c0700 1 -- 172.21.15.26:0/2199867799 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1fb0064100 msgr2=0x7f1fb00665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:47:50.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.956+0000 7f1fce0c0700 1 --2- 172.21.15.26:0/2199867799 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1fb0064100 0x7f1fb00665c0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7f1fc8107b70 tx=0x7f1fc0009040).stop 2021-11-03T18:47:50.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.956+0000 7f1fce0c0700 1 -- 172.21.15.26:0/2199867799 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fc80f96b0 msgr2=0x7f1fc81072a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:47:50.959 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.956+0000 7f1fce0c0700 1 --2- 172.21.15.26:0/2199867799 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fc80f96b0 0x7f1fc81072a0 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 rx=0x7f1fbc013a70 tx=0x7f1fbc009b30).stop 2021-11-03T18:47:50.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.956+0000 7f1fce0c0700 1 -- 172.21.15.26:0/2199867799 shutdown_connections 2021-11-03T18:47:50.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.956+0000 7f1fce0c0700 1 --2- 172.21.15.26:0/2199867799 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1fb0064100 0x7f1fb00665c0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:50.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.956+0000 7f1fce0c0700 1 --2- 172.21.15.26:0/2199867799 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fc8060270 0x7f1fc8106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:50.960 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.956+0000 7f1fce0c0700 1 --2- 172.21.15.26:0/2199867799 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fc80f96b0 0x7f1fc81072a0 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:50.961 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.956+0000 7f1fce0c0700 1 -- 172.21.15.26:0/2199867799 >> 172.21.15.26:0/2199867799 conn(0x7f1fc80f0ba0 msgr2=0x7f1fc80f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:47:50.961 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.956+0000 7f1fce0c0700 1 -- 172.21.15.26:0/2199867799 shutdown_connections 2021-11-03T18:47:50.961 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:50.956+0000 7f1fce0c0700 1 -- 172.21.15.26:0/2199867799 wait complete. 2021-11-03T18:47:51.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.056+0000 7f62cb9e1700 1 -- 172.21.15.26:0/1534245922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62c40f55e0 msgr2=0x7f62c40f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:47:51.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.056+0000 7f62cb9e1700 1 --2- 172.21.15.26:0/1534245922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62c40f55e0 0x7f62c40f5a00 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 rx=0x7f62bc0099e0 tx=0x7f62bc004d10).stop 2021-11-03T18:47:51.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.056+0000 7f62cb9e1700 1 -- 172.21.15.26:0/1534245922 shutdown_connections 2021-11-03T18:47:51.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.056+0000 7f62cb9e1700 1 --2- 172.21.15.26:0/1534245922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62c40f5ef0 0x7f62c40f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:51.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.056+0000 7f62cb9e1700 1 --2- 172.21.15.26:0/1534245922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62c40f55e0 0x7f62c40f5a00 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:51.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.056+0000 7f62cb9e1700 1 -- 172.21.15.26:0/1534245922 >> 172.21.15.26:0/1534245922 conn(0x7f62c40f0de0 msgr2=0x7f62c40f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:47:51.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.056+0000 7f62cb9e1700 1 -- 172.21.15.26:0/1534245922 shutdown_connections 2021-11-03T18:47:51.058 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.056+0000 7f62cb9e1700 1 -- 172.21.15.26:0/1534245922 wait complete. 2021-11-03T18:47:51.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.056+0000 7f62cb9e1700 1 Processor -- start 2021-11-03T18:47:51.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.056+0000 7f62cb9e1700 1 -- start start 2021-11-03T18:47:51.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.056+0000 7f62cb9e1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62c40f55e0 0x7f62c4109260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:47:51.059 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.056+0000 7f62cb9e1700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62c40f5ef0 0x7f62c4109750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:47:51.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.056+0000 7f62cb9e1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c4109d00 con 0x7f62c40f55e0 2021-11-03T18:47:51.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.056+0000 7f62cb9e1700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c4109e40 con 0x7f62c40f5ef0 2021-11-03T18:47:51.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.057+0000 7f62c977d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62c40f55e0 0x7f62c4109260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:47:51.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.057+0000 7f62c977d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62c40f55e0 0x7f62c4109260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33826/0 (socket says 172.21.15.26:33826) 2021-11-03T18:47:51.060 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.057+0000 7f62c977d700 1 -- 172.21.15.26:0/1472301670 learned_addr learned my addr 172.21.15.26:0/1472301670 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:47:51.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.057+0000 7f62c8f7c700 1 --2- 172.21.15.26:0/1472301670 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62c40f5ef0 0x7f62c4109750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:47:51.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.057+0000 7f62c977d700 1 -- 172.21.15.26:0/1472301670 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62c40f5ef0 msgr2=0x7f62c4109750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:47:51.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.057+0000 7f62c977d700 1 --2- 172.21.15.26:0/1472301670 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62c40f5ef0 0x7f62c4109750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:51.061 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.057+0000 7f62c977d700 1 -- 172.21.15.26:0/1472301670 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62bc009640 con 0x7f62c40f55e0 2021-11-03T18:47:51.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.057+0000 7f62c977d700 1 --2- 172.21.15.26:0/1472301670 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62c40f55e0 0x7f62c4109260 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 rx=0x7f62bc004b70 tx=0x7f62bc004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:47:51.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.057+0000 7f62c1ffb700 1 -- 172.21.15.26:0/1472301670 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62bc00e030 con 0x7f62c40f55e0 2021-11-03T18:47:51.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.057+0000 7f62c1ffb700 1 -- 172.21.15.26:0/1472301670 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f62bc0049b0 con 0x7f62c40f55e0 2021-11-03T18:47:51.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.057+0000 7f62c1ffb700 1 -- 172.21.15.26:0/1472301670 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62bc018070 con 0x7f62c40f55e0 2021-11-03T18:47:51.062 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.057+0000 7f62cb9e1700 1 -- 172.21.15.26:0/1472301670 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62c410a780 con 0x7f62c40f55e0 2021-11-03T18:47:51.063 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.057+0000 7f62cb9e1700 1 -- 172.21.15.26:0/1472301670 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c410ac60 con 0x7f62c40f55e0 2021-11-03T18:47:51.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.058+0000 7f62cb9e1700 1 -- 172.21.15.26:0/1472301670 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c4045ad0 con 0x7f62c40f55e0 2021-11-03T18:47:51.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.059+0000 7f62c1ffb700 1 -- 172.21.15.26:0/1472301670 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f62bc01db40 con 0x7f62c40f55e0 2021-11-03T18:47:51.064 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.059+0000 7f62c1ffb700 1 --2- 172.21.15.26:0/1472301670 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f62ac0640b0 0x7f62ac066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:47:51.065 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.059+0000 7f62c1ffb700 1 -- 172.21.15.26:0/1472301670 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f62bc0826b0 con 0x7f62c40f55e0 2021-11-03T18:47:51.065 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.059+0000 7f62c8f7c700 1 --2- 172.21.15.26:0/1472301670 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f62ac0640b0 0x7f62ac066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:47:51.065 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.060+0000 7f62c8f7c700 1 --2- 172.21.15.26:0/1472301670 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f62ac0640b0 0x7f62ac066570 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 rx=0x7f62b8007fd0 tx=0x7f62b8009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:47:51.065 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.063+0000 7f62c1ffb700 1 -- 172.21.15.26:0/1472301670 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f62bc054a70 con 0x7f62c40f55e0 2021-11-03T18:47:51.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.269+0000 7f62cb9e1700 1 -- 172.21.15.26:0/1472301670 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f62c40fcd90 con 0x7f62c40f55e0 2021-11-03T18:47:51.269 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.269+0000 7f62c1ffb700 1 -- 172.21.15.26:0/1472301670 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f62bc054660 con 0x7f62c40f55e0 2021-11-03T18:47:51.269 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:47:51.270 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:47:51.270 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:47:51.270 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:47:51.270 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:47:51.270 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:47:51.271 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:47:51.271 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:47:51.271 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:47:51.271 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:47:51.271 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:47:51.272 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:47:51.272 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:47:51.272 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:47:51.272 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:47:51.273 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:47:51.273 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:47:51.273 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:47:51.273 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:47:51.273 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:47:51.274 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:47:51.274 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:47:51.274 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:47:51.274 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:47:51.274 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:47:51.275 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:47:51.275 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:47:51.275 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:47:51.275 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:47:51.275 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:47:51.276 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:47:51.276 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:47:51.276 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:47:51.276 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:47:51.277 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:47:51.277 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:47:51.277 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:47:51.277 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:47:51.277 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:47:51.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.271+0000 7f62cb9e1700 1 -- 172.21.15.26:0/1472301670 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f62ac0640b0 msgr2=0x7f62ac066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:47:51.278 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.271+0000 7f62cb9e1700 1 --2- 172.21.15.26:0/1472301670 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f62ac0640b0 0x7f62ac066570 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 rx=0x7f62b8007fd0 tx=0x7f62b8009040).stop 2021-11-03T18:47:51.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.271+0000 7f62cb9e1700 1 -- 172.21.15.26:0/1472301670 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62c40f55e0 msgr2=0x7f62c4109260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:47:51.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.271+0000 7f62cb9e1700 1 --2- 172.21.15.26:0/1472301670 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62c40f55e0 0x7f62c4109260 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 rx=0x7f62bc004b70 tx=0x7f62bc004d10).stop 2021-11-03T18:47:51.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.271+0000 7f62cb9e1700 1 -- 172.21.15.26:0/1472301670 shutdown_connections 2021-11-03T18:47:51.279 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.271+0000 7f62cb9e1700 1 --2- 172.21.15.26:0/1472301670 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f62ac0640b0 0x7f62ac066570 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:51.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.271+0000 7f62cb9e1700 1 --2- 172.21.15.26:0/1472301670 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62c40f55e0 0x7f62c4109260 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:51.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.271+0000 7f62cb9e1700 1 --2- 172.21.15.26:0/1472301670 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62c40f5ef0 0x7f62c4109750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:47:51.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.272+0000 7f62cb9e1700 1 -- 172.21.15.26:0/1472301670 >> 172.21.15.26:0/1472301670 conn(0x7f62c40f0de0 msgr2=0x7f62c40f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:47:51.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.272+0000 7f62cb9e1700 1 -- 172.21.15.26:0/1472301670 shutdown_connections 2021-11-03T18:47:51.280 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:47:51.272+0000 7f62cb9e1700 1 -- 172.21.15.26:0/1472301670 wait complete. 2021-11-03T18:47:51.281 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:47:51.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:51 smithi026 ceph-mon[96795]: pgmap v3395: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:51.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:51 smithi026 ceph-mon[96795]: from='client.37628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:47:51.426 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:51 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2199867799' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:47:51.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:51 smithi194 ceph-mon[65619]: pgmap v3395: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:51.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:51 smithi194 ceph-mon[65619]: from='client.37628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:47:51.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:51 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2199867799' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:47:52.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:52 smithi026 ceph-mon[96795]: from='client.37632 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:47:52.425 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:52 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1472301670' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:47:52.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:52 smithi194 ceph-mon[65619]: from='client.37632 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:47:52.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:52 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1472301670' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:47:53.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:53 smithi194 ceph-mon[65619]: pgmap v3396: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:53.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:53 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:47:53.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:53 smithi026 ceph-mon[96795]: pgmap v3396: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:53.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:53 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:47:54.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:54 smithi194 ceph-mon[65619]: poll took 60051.786 ms: 1 events 2021-11-03T18:47:54.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:47:54.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:47:54.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:47:54.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:47:54.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:47:54.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:47:54.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:54 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:47:54.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:47:54.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:54 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:47:54.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:54 smithi026 ceph-mon[96795]: poll took 60051.786 ms: 1 events 2021-11-03T18:47:54.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:47:54.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:47:54.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:47:54.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:47:54.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:47:54.677 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:47:54.677 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:54 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:47:54.677 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:47:54.677 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:54 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:47:55.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:55 smithi194 ceph-mon[65619]: pgmap v3397: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:55.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:55 smithi026 ceph-mon[96795]: pgmap v3397: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:57.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:57 smithi026 ceph-mon[96795]: pgmap v3398: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:57.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:57 smithi194 ceph-mon[65619]: pgmap v3398: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:59.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:47:59 smithi026 ceph-mon[96795]: pgmap v3399: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:47:59.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:47:59 smithi194 ceph-mon[65619]: pgmap v3399: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:01.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:01 smithi194 ceph-mon[65619]: pgmap v3400: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:01.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:01 smithi026 ceph-mon[96795]: pgmap v3400: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:03.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:03 smithi026 ceph-mon[96795]: pgmap v3401: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:03.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:03 smithi194 ceph-mon[65619]: pgmap v3401: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:05.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:05 smithi026 ceph-mon[96795]: pgmap v3402: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:05.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:05 smithi194 ceph-mon[65619]: pgmap v3402: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:07.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:07 smithi026 ceph-mon[96795]: pgmap v3403: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:07.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:07 smithi194 ceph-mon[65619]: pgmap v3403: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:08.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:08 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:48:08.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:08 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:48:09.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:09 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:48:09.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:09 smithi026 ceph-mon[96795]: pgmap v3404: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:09.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:09 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:48:09.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:09 smithi194 ceph-mon[65619]: pgmap v3404: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:11.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:11 smithi194 ceph-mon[65619]: pgmap v3405: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:11.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:11 smithi026 ceph-mon[96795]: pgmap v3405: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:13.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:13 smithi026 ceph-mon[96795]: pgmap v3406: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:13.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:13 smithi194 ceph-mon[65619]: pgmap v3406: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:15.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:15 smithi026 ceph-mon[96795]: pgmap v3407: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:15.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:15 smithi194 ceph-mon[65619]: pgmap v3407: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:17.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:17 smithi026 ceph-mon[96795]: pgmap v3408: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:17.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:17 smithi194 ceph-mon[65619]: pgmap v3408: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:19.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:19 smithi026 ceph-mon[96795]: pgmap v3409: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:19.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:19 smithi194 ceph-mon[65619]: pgmap v3409: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:21.388 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.388+0000 7fa58ffff700 1 -- 172.21.15.26:0/1966261829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5900f77d0 msgr2=0x7fa5900f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:48:21.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.388+0000 7fa58ffff700 1 --2- 172.21.15.26:0/1966261829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5900f77d0 0x7fa5900f7c30 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 rx=0x7fa578004660 tx=0x7fa578009b30).stop 2021-11-03T18:48:21.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.388+0000 7fa58ffff700 1 -- 172.21.15.26:0/1966261829 shutdown_connections 2021-11-03T18:48:21.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.388+0000 7fa58ffff700 1 --2- 172.21.15.26:0/1966261829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5900f77d0 0x7fa5900f7c30 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:21.389 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.388+0000 7fa58ffff700 1 --2- 172.21.15.26:0/1966261829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5900f6530 0x7fa5900f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:21.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.388+0000 7fa58ffff700 1 -- 172.21.15.26:0/1966261829 >> 172.21.15.26:0/1966261829 conn(0x7fa5900f1cd0 msgr2=0x7fa5900f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:48:21.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.388+0000 7fa58ffff700 1 -- 172.21.15.26:0/1966261829 shutdown_connections 2021-11-03T18:48:21.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.388+0000 7fa58ffff700 1 -- 172.21.15.26:0/1966261829 wait complete. 2021-11-03T18:48:21.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.388+0000 7fa58ffff700 1 Processor -- start 2021-11-03T18:48:21.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.389+0000 7fa58ffff700 1 -- start start 2021-11-03T18:48:21.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.389+0000 7fa58ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5900f6530 0x7fa590106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:48:21.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.389+0000 7fa58ffff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5900f77d0 0x7fa590107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:48:21.391 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.389+0000 7fa58ffff700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa590107870 con 0x7fa5900f6530 2021-11-03T18:48:21.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.389+0000 7fa58ffff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa590108080 con 0x7fa5900f77d0 2021-11-03T18:48:21.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.389+0000 7fa58effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5900f6530 0x7fa590106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:48:21.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.389+0000 7fa58effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5900f6530 0x7fa590106d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33844/0 (socket says 172.21.15.26:33844) 2021-11-03T18:48:21.392 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.389+0000 7fa58effd700 1 -- 172.21.15.26:0/4291684102 learned_addr learned my addr 172.21.15.26:0/4291684102 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:48:21.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.389+0000 7fa58e7fc700 1 --2- 172.21.15.26:0/4291684102 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5900f77d0 0x7fa590107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:48:21.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.389+0000 7fa58effd700 1 -- 172.21.15.26:0/4291684102 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5900f77d0 msgr2=0x7fa590107270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:48:21.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.389+0000 7fa58effd700 1 --2- 172.21.15.26:0/4291684102 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5900f77d0 0x7fa590107270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:21.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.389+0000 7fa58effd700 1 -- 172.21.15.26:0/4291684102 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa578005040 con 0x7fa5900f6530 2021-11-03T18:48:21.393 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.389+0000 7fa58e7fc700 1 --2- 172.21.15.26:0/4291684102 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5900f77d0 0x7fa590107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:48:21.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.389+0000 7fa58effd700 1 --2- 172.21.15.26:0/4291684102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5900f6530 0x7fa590106d80 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 rx=0x7fa58800c710 tx=0x7fa588004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:48:21.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.389+0000 7fa5877fe700 1 -- 172.21.15.26:0/4291684102 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5880106f0 con 0x7fa5900f6530 2021-11-03T18:48:21.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.390+0000 7fa5877fe700 1 -- 172.21.15.26:0/4291684102 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa588010d00 con 0x7fa5900f6530 2021-11-03T18:48:21.394 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.390+0000 7fa58ffff700 1 -- 172.21.15.26:0/4291684102 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa590108300 con 0x7fa5900f6530 2021-11-03T18:48:21.395 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.390+0000 7fa5877fe700 1 -- 172.21.15.26:0/4291684102 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa588012d90 con 0x7fa5900f6530 2021-11-03T18:48:21.395 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.390+0000 7fa58ffff700 1 -- 172.21.15.26:0/4291684102 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5901088c0 con 0x7fa5900f6530 2021-11-03T18:48:21.396 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.391+0000 7fa58ffff700 1 -- 172.21.15.26:0/4291684102 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa590059100 con 0x7fa5900f6530 2021-11-03T18:48:21.396 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.391+0000 7fa5877fe700 1 -- 172.21.15.26:0/4291684102 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fa588010070 con 0x7fa5900f6530 2021-11-03T18:48:21.397 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.391+0000 7fa5877fe700 1 --2- 172.21.15.26:0/4291684102 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa57c064100 0x7fa57c0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:48:21.397 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.392+0000 7fa5877fe700 1 -- 172.21.15.26:0/4291684102 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fa588080ce0 con 0x7fa5900f6530 2021-11-03T18:48:21.397 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.392+0000 7fa58e7fc700 1 --2- 172.21.15.26:0/4291684102 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa57c064100 0x7fa57c0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:48:21.397 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.392+0000 7fa58e7fc700 1 --2- 172.21.15.26:0/4291684102 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa57c064100 0x7fa57c0665c0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7fa578009da0 tx=0x7fa578009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:48:21.397 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.396+0000 7fa5877fe700 1 -- 172.21.15.26:0/4291684102 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fa588052f50 con 0x7fa5900f6530 2021-11-03T18:48:21.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:21 smithi194 ceph-mon[65619]: pgmap v3410: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:21.573 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.575+0000 7fa58ffff700 1 -- 172.21.15.26:0/4291684102 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa5900fee00 con 0x7fa57c064100 2021-11-03T18:48:21.574 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.576+0000 7fa5877fe700 1 -- 172.21.15.26:0/4291684102 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fa5900fee00 con 0x7fa57c064100 2021-11-03T18:48:21.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.578+0000 7fa58ffff700 1 -- 172.21.15.26:0/4291684102 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa57c064100 msgr2=0x7fa57c0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:48:21.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.578+0000 7fa58ffff700 1 --2- 172.21.15.26:0/4291684102 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa57c064100 0x7fa57c0665c0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7fa578009da0 tx=0x7fa578009b30).stop 2021-11-03T18:48:21.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.578+0000 7fa58ffff700 1 -- 172.21.15.26:0/4291684102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5900f6530 msgr2=0x7fa590106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:48:21.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.578+0000 7fa58ffff700 1 --2- 172.21.15.26:0/4291684102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5900f6530 0x7fa590106d80 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 rx=0x7fa58800c710 tx=0x7fa588004d10).stop 2021-11-03T18:48:21.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.578+0000 7fa58ffff700 1 -- 172.21.15.26:0/4291684102 shutdown_connections 2021-11-03T18:48:21.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.578+0000 7fa58ffff700 1 --2- 172.21.15.26:0/4291684102 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa57c064100 0x7fa57c0665c0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:21.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.578+0000 7fa58ffff700 1 --2- 172.21.15.26:0/4291684102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5900f6530 0x7fa590106d80 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:21.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.578+0000 7fa58ffff700 1 --2- 172.21.15.26:0/4291684102 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5900f77d0 0x7fa590107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:21.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.578+0000 7fa58ffff700 1 -- 172.21.15.26:0/4291684102 >> 172.21.15.26:0/4291684102 conn(0x7fa5900f1cd0 msgr2=0x7fa5900fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:48:21.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.578+0000 7fa58ffff700 1 -- 172.21.15.26:0/4291684102 shutdown_connections 2021-11-03T18:48:21.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.579+0000 7fa58ffff700 1 -- 172.21.15.26:0/4291684102 wait complete. 2021-11-03T18:48:21.586 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:48:21.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:21 smithi026 ceph-mon[96795]: pgmap v3410: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:21.678 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.678+0000 7f4d1f57b700 1 -- 172.21.15.26:0/1711167504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d180f66e0 msgr2=0x7f4d180f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:48:21.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.678+0000 7f4d1f57b700 1 --2- 172.21.15.26:0/1711167504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d180f66e0 0x7f4d180f6b40 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 rx=0x7f4d14004660 tx=0x7f4d14009b30).stop 2021-11-03T18:48:21.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.678+0000 7f4d1f57b700 1 -- 172.21.15.26:0/1711167504 shutdown_connections 2021-11-03T18:48:21.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.678+0000 7f4d1f57b700 1 --2- 172.21.15.26:0/1711167504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d180f66e0 0x7f4d180f6b40 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:21.679 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.678+0000 7f4d1f57b700 1 --2- 172.21.15.26:0/1711167504 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d180f5440 0x7f4d180f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:21.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.678+0000 7f4d1f57b700 1 -- 172.21.15.26:0/1711167504 >> 172.21.15.26:0/1711167504 conn(0x7f4d180f0ba0 msgr2=0x7f4d180f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:48:21.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.678+0000 7f4d1f57b700 1 -- 172.21.15.26:0/1711167504 shutdown_connections 2021-11-03T18:48:21.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.678+0000 7f4d1f57b700 1 -- 172.21.15.26:0/1711167504 wait complete. 2021-11-03T18:48:21.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.679+0000 7f4d1f57b700 1 Processor -- start 2021-11-03T18:48:21.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.679+0000 7f4d1f57b700 1 -- start start 2021-11-03T18:48:21.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.679+0000 7f4d1f57b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d180f5440 0x7f4d18105d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:48:21.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.679+0000 7f4d1f57b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d180f66e0 0x7f4d18106220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:48:21.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.679+0000 7f4d1f57b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d181067d0 con 0x7f4d180f5440 2021-11-03T18:48:21.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.679+0000 7f4d1f57b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d18106fd0 con 0x7f4d180f66e0 2021-11-03T18:48:21.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.679+0000 7f4d1e579700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d180f5440 0x7f4d18105d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:48:21.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.679+0000 7f4d1e579700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d180f5440 0x7f4d18105d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33854/0 (socket says 172.21.15.26:33854) 2021-11-03T18:48:21.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.679+0000 7f4d1e579700 1 -- 172.21.15.26:0/552451585 learned_addr learned my addr 172.21.15.26:0/552451585 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:48:21.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.679+0000 7f4d1dd78700 1 --2- 172.21.15.26:0/552451585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d180f66e0 0x7f4d18106220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:48:21.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.679+0000 7f4d1e579700 1 -- 172.21.15.26:0/552451585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d180f66e0 msgr2=0x7f4d18106220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:48:21.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.679+0000 7f4d1e579700 1 --2- 172.21.15.26:0/552451585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d180f66e0 0x7f4d18106220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:21.683 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.679+0000 7f4d1e579700 1 -- 172.21.15.26:0/552451585 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d14005040 con 0x7f4d180f5440 2021-11-03T18:48:21.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.679+0000 7f4d1dd78700 1 --2- 172.21.15.26:0/552451585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d180f66e0 0x7f4d18106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:48:21.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.680+0000 7f4d1e579700 1 --2- 172.21.15.26:0/552451585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d180f5440 0x7f4d18105d30 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 rx=0x7f4d08002700 tx=0x7f4d08009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:48:21.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.680+0000 7f4d0effd700 1 -- 172.21.15.26:0/552451585 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d08009320 con 0x7f4d180f5440 2021-11-03T18:48:21.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.680+0000 7f4d1f57b700 1 -- 172.21.15.26:0/552451585 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d18107230 con 0x7f4d180f5440 2021-11-03T18:48:21.684 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.680+0000 7f4d0effd700 1 -- 172.21.15.26:0/552451585 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4d0800f040 con 0x7f4d180f5440 2021-11-03T18:48:21.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.680+0000 7f4d0effd700 1 -- 172.21.15.26:0/552451585 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d08014900 con 0x7f4d180f5440 2021-11-03T18:48:21.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.680+0000 7f4d1f57b700 1 -- 172.21.15.26:0/552451585 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d181077c0 con 0x7f4d180f5440 2021-11-03T18:48:21.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.681+0000 7f4d1f57b700 1 -- 172.21.15.26:0/552451585 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d18059100 con 0x7f4d180f5440 2021-11-03T18:48:21.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.681+0000 7f4d0effd700 1 -- 172.21.15.26:0/552451585 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f4d08009480 con 0x7f4d180f5440 2021-11-03T18:48:21.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.682+0000 7f4d0effd700 1 --2- 172.21.15.26:0/552451585 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4d04064100 0x7f4d040665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:48:21.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.682+0000 7f4d0effd700 1 -- 172.21.15.26:0/552451585 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f4d08080a50 con 0x7f4d180f5440 2021-11-03T18:48:21.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.682+0000 7f4d1dd78700 1 --2- 172.21.15.26:0/552451585 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4d04064100 0x7f4d040665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:48:21.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.682+0000 7f4d1dd78700 1 --2- 172.21.15.26:0/552451585 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4d04064100 0x7f4d040665c0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7f4d14004630 tx=0x7f4d14009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:48:21.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.686+0000 7f4d0effd700 1 -- 172.21.15.26:0/552451585 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f4d08052db0 con 0x7f4d180f5440 2021-11-03T18:48:21.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.857+0000 7f4d1f57b700 1 -- 172.21.15.26:0/552451585 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d180ff6b0 con 0x7f4d04064100 2021-11-03T18:48:21.870 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.871+0000 7f4d0effd700 1 -- 172.21.15.26:0/552451585 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7f4d180ff6b0 con 0x7f4d04064100 2021-11-03T18:48:21.870 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:48:21.870 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (119m) 7m ago 2h 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:48:21.871 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (111m) 7m ago 2h 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:48:21.871 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (111m) 6m ago 2h 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:48:21.872 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (119m) 7m ago 2h 42.4M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:48:21.872 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (112m) 7m ago 115m 26.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:48:21.872 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (112m) 7m ago 115m 27.0M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:48:21.872 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (116m) 6m ago 116m 27.2M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:48:21.872 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (115m) 6m ago 115m 27.6M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:48:21.873 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (113m) 7m ago 2h 615M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:48:21.873 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (112m) 6m ago 2h 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:48:21.873 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (112m) 7m ago 2h 407M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:48:21.873 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (112m) 6m ago 119m 187M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:48:21.873 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (2h) 7m ago 2h 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:48:21.874 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (119m) 6m ago 119m 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:48:21.874 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (111m) 7m ago 119m 372M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:48:21.874 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (110m) 7m ago 118m 400M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:48:21.874 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (110m) 7m ago 118m 332M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:48:21.875 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (109m) 6m ago 118m 438M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:48:21.875 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (109m) 6m ago 117m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:48:21.875 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (109m) 6m ago 117m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:48:21.875 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (119m) 7m ago 2h 70.2M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:48:21.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.873+0000 7f4d1f57b700 1 -- 172.21.15.26:0/552451585 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4d04064100 msgr2=0x7f4d040665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:48:21.876 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.873+0000 7f4d1f57b700 1 --2- 172.21.15.26:0/552451585 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4d04064100 0x7f4d040665c0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7f4d14004630 tx=0x7f4d14009b30).stop 2021-11-03T18:48:21.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.873+0000 7f4d1f57b700 1 -- 172.21.15.26:0/552451585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d180f5440 msgr2=0x7f4d18105d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:48:21.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.873+0000 7f4d1f57b700 1 --2- 172.21.15.26:0/552451585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d180f5440 0x7f4d18105d30 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 rx=0x7f4d08002700 tx=0x7f4d08009d80).stop 2021-11-03T18:48:21.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.873+0000 7f4d1f57b700 1 -- 172.21.15.26:0/552451585 shutdown_connections 2021-11-03T18:48:21.877 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.873+0000 7f4d1f57b700 1 --2- 172.21.15.26:0/552451585 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f4d04064100 0x7f4d040665c0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:21.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.873+0000 7f4d1f57b700 1 --2- 172.21.15.26:0/552451585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d180f5440 0x7f4d18105d30 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:21.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.873+0000 7f4d1f57b700 1 --2- 172.21.15.26:0/552451585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d180f66e0 0x7f4d18106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:21.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.873+0000 7f4d1f57b700 1 -- 172.21.15.26:0/552451585 >> 172.21.15.26:0/552451585 conn(0x7f4d180f0ba0 msgr2=0x7f4d180fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:48:21.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.874+0000 7f4d1f57b700 1 -- 172.21.15.26:0/552451585 shutdown_connections 2021-11-03T18:48:21.878 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.874+0000 7f4d1f57b700 1 -- 172.21.15.26:0/552451585 wait complete. 2021-11-03T18:48:21.970 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.972+0000 7f0e01952700 1 -- 172.21.15.26:0/1483519412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dfc0f55e0 msgr2=0x7f0dfc0f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:48:21.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.972+0000 7f0e01952700 1 --2- 172.21.15.26:0/1483519412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dfc0f55e0 0x7f0dfc0f5a00 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 rx=0x7f0df40099e0 tx=0x7f0df4004d10).stop 2021-11-03T18:48:21.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.972+0000 7f0e01952700 1 -- 172.21.15.26:0/1483519412 shutdown_connections 2021-11-03T18:48:21.971 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.972+0000 7f0e01952700 1 --2- 172.21.15.26:0/1483519412 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0dfc0f5ef0 0x7f0dfc0f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:21.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.972+0000 7f0e01952700 1 --2- 172.21.15.26:0/1483519412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dfc0f55e0 0x7f0dfc0f5a00 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:21.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.972+0000 7f0e01952700 1 -- 172.21.15.26:0/1483519412 >> 172.21.15.26:0/1483519412 conn(0x7f0dfc0f0de0 msgr2=0x7f0dfc0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:48:21.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.972+0000 7f0e01952700 1 -- 172.21.15.26:0/1483519412 shutdown_connections 2021-11-03T18:48:21.972 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.972+0000 7f0e01952700 1 -- 172.21.15.26:0/1483519412 wait complete. 2021-11-03T18:48:21.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.973+0000 7f0e01952700 1 Processor -- start 2021-11-03T18:48:21.975 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.973+0000 7f0e01952700 1 -- start start 2021-11-03T18:48:21.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.973+0000 7f0e01952700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0dfc0f55e0 0x7f0dfc10c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:48:21.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.973+0000 7f0e01952700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dfc0f5ef0 0x7f0dfc10e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:48:21.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.973+0000 7f0e01952700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc0603b0 con 0x7f0dfc0f5ef0 2021-11-03T18:48:21.976 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.973+0000 7f0e01952700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc0604f0 con 0x7f0dfc0f55e0 2021-11-03T18:48:21.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.973+0000 7f0dfa7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dfc0f5ef0 0x7f0dfc10e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:48:21.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.973+0000 7f0dfa7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dfc0f5ef0 0x7f0dfc10e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33864/0 (socket says 172.21.15.26:33864) 2021-11-03T18:48:21.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.973+0000 7f0dfa7fc700 1 -- 172.21.15.26:0/387113933 learned_addr learned my addr 172.21.15.26:0/387113933 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:48:21.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.973+0000 7f0dfaffd700 1 --2- 172.21.15.26:0/387113933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0dfc0f55e0 0x7f0dfc10c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:48:21.977 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.973+0000 7f0dfa7fc700 1 -- 172.21.15.26:0/387113933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0dfc0f55e0 msgr2=0x7f0dfc10c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:48:21.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.973+0000 7f0dfa7fc700 1 --2- 172.21.15.26:0/387113933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0dfc0f55e0 0x7f0dfc10c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:21.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.973+0000 7f0dfa7fc700 1 -- 172.21.15.26:0/387113933 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df4009640 con 0x7f0dfc0f5ef0 2021-11-03T18:48:21.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.973+0000 7f0dfaffd700 1 --2- 172.21.15.26:0/387113933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0dfc0f55e0 0x7f0dfc10c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:48:21.978 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.974+0000 7f0dfa7fc700 1 --2- 172.21.15.26:0/387113933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dfc0f5ef0 0x7f0dfc10e680 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 rx=0x7f0de4002700 tx=0x7f0de4009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:48:21.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.974+0000 7f0df37fe700 1 -- 172.21.15.26:0/387113933 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0de4009320 con 0x7f0dfc0f5ef0 2021-11-03T18:48:21.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.974+0000 7f0df37fe700 1 -- 172.21.15.26:0/387113933 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0de400f040 con 0x7f0dfc0f5ef0 2021-11-03T18:48:21.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.974+0000 7f0e01952700 1 -- 172.21.15.26:0/387113933 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dfc10eb70 con 0x7f0dfc0f5ef0 2021-11-03T18:48:21.979 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.974+0000 7f0df37fe700 1 -- 172.21.15.26:0/387113933 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0de4014820 con 0x7f0dfc0f5ef0 2021-11-03T18:48:21.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.974+0000 7f0e01952700 1 -- 172.21.15.26:0/387113933 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dfc10ef70 con 0x7f0dfc0f5ef0 2021-11-03T18:48:21.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.975+0000 7f0e01952700 1 -- 172.21.15.26:0/387113933 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dfc045ad0 con 0x7f0dfc0f5ef0 2021-11-03T18:48:21.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.975+0000 7f0df37fe700 1 -- 172.21.15.26:0/387113933 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f0de4009480 con 0x7f0dfc0f5ef0 2021-11-03T18:48:21.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.976+0000 7f0df37fe700 1 --2- 172.21.15.26:0/387113933 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0de80640b0 0x7f0de8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:48:21.980 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.976+0000 7f0df37fe700 1 -- 172.21.15.26:0/387113933 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f0de4080b20 con 0x7f0dfc0f5ef0 2021-11-03T18:48:21.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.976+0000 7f0dfaffd700 1 --2- 172.21.15.26:0/387113933 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0de80640b0 0x7f0de8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:48:21.981 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.976+0000 7f0dfaffd700 1 --2- 172.21.15.26:0/387113933 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0de80640b0 0x7f0de8066570 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7f0df400b3b0 tx=0x7f0df4004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:48:21.982 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:21.980+0000 7f0df37fe700 1 -- 172.21.15.26:0/387113933 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f0de4052e80 con 0x7f0dfc0f5ef0 2021-11-03T18:48:22.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.212+0000 7f0e01952700 1 -- 172.21.15.26:0/387113933 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0dfc0fdf50 con 0x7f0dfc0f5ef0 2021-11-03T18:48:22.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.212+0000 7f0df37fe700 1 -- 172.21.15.26:0/387113933 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f0de4080070 con 0x7f0dfc0f5ef0 2021-11-03T18:48:22.211 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:48:22.211 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:48:22.212 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:48:22.212 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:48:22.212 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:48:22.212 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:48:22.213 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:48:22.213 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:48:22.213 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:48:22.213 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:48:22.213 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:48:22.214 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:48:22.214 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:48:22.214 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:48:22.214 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:48:22.215 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:48:22.215 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:48:22.215 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:48:22.216 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.214+0000 7f0e01952700 1 -- 172.21.15.26:0/387113933 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0de80640b0 msgr2=0x7f0de8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:48:22.216 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.214+0000 7f0e01952700 1 --2- 172.21.15.26:0/387113933 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0de80640b0 0x7f0de8066570 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7f0df400b3b0 tx=0x7f0df4004d10).stop 2021-11-03T18:48:22.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.214+0000 7f0e01952700 1 -- 172.21.15.26:0/387113933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dfc0f5ef0 msgr2=0x7f0dfc10e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:48:22.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.214+0000 7f0e01952700 1 --2- 172.21.15.26:0/387113933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dfc0f5ef0 0x7f0dfc10e680 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 rx=0x7f0de4002700 tx=0x7f0de4009e00).stop 2021-11-03T18:48:22.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.214+0000 7f0e01952700 1 -- 172.21.15.26:0/387113933 shutdown_connections 2021-11-03T18:48:22.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.214+0000 7f0e01952700 1 --2- 172.21.15.26:0/387113933 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0de80640b0 0x7f0de8066570 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:22.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.214+0000 7f0e01952700 1 --2- 172.21.15.26:0/387113933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0dfc0f55e0 0x7f0dfc10c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:22.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.214+0000 7f0e01952700 1 --2- 172.21.15.26:0/387113933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0dfc0f5ef0 0x7f0dfc10e680 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:22.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.214+0000 7f0e01952700 1 -- 172.21.15.26:0/387113933 >> 172.21.15.26:0/387113933 conn(0x7f0dfc0f0de0 msgr2=0x7f0dfc0fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:48:22.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.214+0000 7f0e01952700 1 -- 172.21.15.26:0/387113933 shutdown_connections 2021-11-03T18:48:22.219 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.214+0000 7f0e01952700 1 -- 172.21.15.26:0/387113933 wait complete. 2021-11-03T18:48:22.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.318+0000 7f37a4049700 1 -- 172.21.15.26:0/3344930494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f379c0f55e0 msgr2=0x7f379c0f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:48:22.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.318+0000 7f37a4049700 1 --2- 172.21.15.26:0/3344930494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f379c0f55e0 0x7f379c0f5a00 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 rx=0x7f378c004660 tx=0x7f378c009b30).stop 2021-11-03T18:48:22.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.318+0000 7f37a4049700 1 -- 172.21.15.26:0/3344930494 shutdown_connections 2021-11-03T18:48:22.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.318+0000 7f37a4049700 1 --2- 172.21.15.26:0/3344930494 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f379c0f5ef0 0x7f379c0f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:48:22.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.318+0000 7f37a4049700 1 --2- 172.21.15.26:0/3344930494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f379c0f55e0 0x7f379c0f5a00 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:22.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.318+0000 7f37a4049700 1 -- 172.21.15.26:0/3344930494 >> 172.21.15.26:0/3344930494 conn(0x7f379c0f0de0 msgr2=0x7f379c0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:48:22.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.318+0000 7f37a4049700 1 -- 172.21.15.26:0/3344930494 shutdown_connections 2021-11-03T18:48:22.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.318+0000 7f37a4049700 1 -- 172.21.15.26:0/3344930494 wait complete. 2021-11-03T18:48:22.320 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.319+0000 7f37a4049700 1 Processor -- start 2021-11-03T18:48:22.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.319+0000 7f37a4049700 1 -- start start 2021-11-03T18:48:22.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.319+0000 7f37a4049700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f379c0f55e0 0x7f379c106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:48:22.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.319+0000 7f37a4049700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f379c0f5ef0 0x7f379c107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:48:22.321 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.319+0000 7f37a4049700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379c107aa0 con 0x7f379c0f5ef0 2021-11-03T18:48:22.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.319+0000 7f37a4049700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379c108350 con 0x7f379c0f55e0 2021-11-03T18:48:22.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.319+0000 7f37a15e4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f379c0f5ef0 0x7f379c107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:48:22.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.319+0000 7f37a15e4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f379c0f5ef0 0x7f379c107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33874/0 (socket says 172.21.15.26:33874) 2021-11-03T18:48:22.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.319+0000 7f37a15e4700 1 -- 172.21.15.26:0/2850146996 learned_addr learned my addr 172.21.15.26:0/2850146996 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:48:22.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.320+0000 7f37a1de5700 1 --2- 172.21.15.26:0/2850146996 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f379c0f55e0 0x7f379c106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:48:22.323 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.320+0000 7f37a15e4700 1 -- 172.21.15.26:0/2850146996 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f379c0f55e0 msgr2=0x7f379c106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:48:22.323 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.320+0000 7f37a15e4700 1 --2- 172.21.15.26:0/2850146996 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f379c0f55e0 0x7f379c106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:22.323 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.320+0000 7f37a15e4700 1 -- 172.21.15.26:0/2850146996 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f378c005040 con 0x7f379c0f5ef0 2021-11-03T18:48:22.323 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.320+0000 7f37a1de5700 1 --2- 172.21.15.26:0/2850146996 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f379c0f55e0 0x7f379c106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:48:22.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.320+0000 7f37a15e4700 1 --2- 172.21.15.26:0/2850146996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f379c0f5ef0 0x7f379c107460 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 rx=0x7f379800b410 tx=0x7f3798006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:48:22.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.320+0000 7f37927fc700 1 -- 172.21.15.26:0/2850146996 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37980125f0 con 0x7f379c0f5ef0 2021-11-03T18:48:22.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.320+0000 7f37927fc700 1 -- 172.21.15.26:0/2850146996 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3798012c00 con 0x7f379c0f5ef0 2021-11-03T18:48:22.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.320+0000 7f37a4049700 1 -- 172.21.15.26:0/2850146996 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f379c108630 con 0x7f379c0f5ef0 2021-11-03T18:48:22.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.320+0000 7f37927fc700 1 -- 172.21.15.26:0/2850146996 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3798002ae0 con 0x7f379c0f5ef0 2021-11-03T18:48:22.325 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.320+0000 7f37a4049700 1 -- 172.21.15.26:0/2850146996 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f379c108bf0 con 0x7f379c0f5ef0 2021-11-03T18:48:22.326 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.321+0000 7f37a4049700 1 -- 172.21.15.26:0/2850146996 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f379c0f4a70 con 0x7f379c0f5ef0 2021-11-03T18:48:22.326 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.321+0000 7f37927fc700 1 -- 172.21.15.26:0/2850146996 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f379800f030 con 0x7f379c0f5ef0 2021-11-03T18:48:22.326 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.322+0000 7f37927fc700 1 --2- 172.21.15.26:0/2850146996 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3788064090 0x7f3788066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:48:22.327 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.322+0000 7f37927fc700 1 -- 172.21.15.26:0/2850146996 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f3798080c40 con 0x7f379c0f5ef0 2021-11-03T18:48:22.327 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.322+0000 7f37a1de5700 1 --2- 172.21.15.26:0/2850146996 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3788064090 0x7f3788066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:48:22.327 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.322+0000 7f37a1de5700 1 --2- 172.21.15.26:0/2850146996 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3788064090 0x7f3788066550 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 rx=0x7f378c004630 tx=0x7f378c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:48:22.327 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.326+0000 7f37927fc700 1 -- 172.21.15.26:0/2850146996 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f3798052fa0 con 0x7f379c0f5ef0 2021-11-03T18:48:22.525 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.527+0000 7f37a4049700 1 -- 172.21.15.26:0/2850146996 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f379c045ad0 con 0x7f379c0f5ef0 2021-11-03T18:48:22.526 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.527+0000 7f37927fc700 1 -- 172.21.15.26:0/2850146996 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f3798052b90 con 0x7f379c0f5ef0 2021-11-03T18:48:22.526 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:48:22.526 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:48:22.527 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:48:22.527 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:48:22.527 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:48:22.528 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:48:22.528 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:48:22.528 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:48:22.529 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:48:22.529 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:48:22.529 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:48:22.530 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:48:22.530 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:48:22.530 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:48:22.530 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:48:22.531 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:48:22.531 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:48:22.531 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:48:22.531 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:48:22.532 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:48:22.532 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:48:22.532 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:48:22.532 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:48:22.533 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:48:22.533 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:48:22.533 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:48:22.533 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:48:22.534 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:48:22.534 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:48:22.534 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:48:22.534 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:48:22.535 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:48:22.535 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:48:22.535 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:48:22.535 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:48:22.536 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:48:22.536 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:48:22.536 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:48:22.536 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:48:22.538 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.529+0000 7f37a4049700 1 -- 172.21.15.26:0/2850146996 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3788064090 msgr2=0x7f3788066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:48:22.538 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.529+0000 7f37a4049700 1 --2- 172.21.15.26:0/2850146996 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3788064090 0x7f3788066550 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 rx=0x7f378c004630 tx=0x7f378c009b30).stop 2021-11-03T18:48:22.538 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.529+0000 7f37a4049700 1 -- 172.21.15.26:0/2850146996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f379c0f5ef0 msgr2=0x7f379c107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:48:22.538 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.529+0000 7f37a4049700 1 --2- 172.21.15.26:0/2850146996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f379c0f5ef0 0x7f379c107460 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 rx=0x7f379800b410 tx=0x7f3798006ef0).stop 2021-11-03T18:48:22.539 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.529+0000 7f37a4049700 1 -- 172.21.15.26:0/2850146996 shutdown_connections 2021-11-03T18:48:22.539 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.529+0000 7f37a4049700 1 --2- 172.21.15.26:0/2850146996 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f3788064090 0x7f3788066550 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:22.539 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.529+0000 7f37a4049700 1 --2- 172.21.15.26:0/2850146996 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f379c0f55e0 0x7f379c106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:22.539 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.529+0000 7f37a4049700 1 --2- 172.21.15.26:0/2850146996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f379c0f5ef0 0x7f379c107460 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:22.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.529+0000 7f37a4049700 1 -- 172.21.15.26:0/2850146996 >> 172.21.15.26:0/2850146996 conn(0x7f379c0f0de0 msgr2=0x7f379c05ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:48:22.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.530+0000 7f37a4049700 1 -- 172.21.15.26:0/2850146996 shutdown_connections 2021-11-03T18:48:22.540 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:22.530+0000 7f37a4049700 1 -- 172.21.15.26:0/2850146996 wait complete. 2021-11-03T18:48:22.540 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:48:22.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:22 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/387113933' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:48:22.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:22 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/387113933' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:48:23.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:23 smithi026 ceph-mon[96795]: from='client.37644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:48:23.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:23 smithi026 ceph-mon[96795]: from='client.37648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:48:23.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:23 smithi026 ceph-mon[96795]: pgmap v3411: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:23.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:23 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2850146996' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:48:23.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:23 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:48:23.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:23 smithi194 ceph-mon[65619]: from='client.37644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:48:23.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:23 smithi194 ceph-mon[65619]: from='client.37648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:48:23.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:23 smithi194 ceph-mon[65619]: pgmap v3411: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:23.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:23 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2850146996' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:48:23.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:23 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:48:24.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:24 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:48:24.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:24 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:48:25.578 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:25 smithi026 ceph-mon[96795]: pgmap v3412: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:25.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:25 smithi194 ceph-mon[65619]: pgmap v3412: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:27.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:27 smithi026 ceph-mon[96795]: pgmap v3413: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:27.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:27 smithi194 ceph-mon[65619]: pgmap v3413: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:29.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:29 smithi026 ceph-mon[96795]: pgmap v3414: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:29.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:29 smithi194 ceph-mon[65619]: pgmap v3414: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:31.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:31 smithi194 ceph-mon[65619]: pgmap v3415: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:31.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:31 smithi026 ceph-mon[96795]: pgmap v3415: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:33.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:33 smithi026 ceph-mon[96795]: pgmap v3416: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:33.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:33 smithi194 ceph-mon[65619]: pgmap v3416: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:35.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:35 smithi026 ceph-mon[96795]: pgmap v3417: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:35.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:35 smithi194 ceph-mon[65619]: pgmap v3417: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:37.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:37 smithi026 ceph-mon[96795]: pgmap v3418: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:37.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:37 smithi194 ceph-mon[65619]: pgmap v3418: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:38.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:38 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:48:38.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:38 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:48:39.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:39 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:48:39.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:39 smithi026 ceph-mon[96795]: pgmap v3419: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:39.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:39 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:48:39.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:39 smithi194 ceph-mon[65619]: pgmap v3419: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:41.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:41 smithi194 ceph-mon[65619]: pgmap v3420: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:41.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:41 smithi026 ceph-mon[96795]: pgmap v3420: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:43.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:43 smithi026 ceph-mon[96795]: pgmap v3421: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:43.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:43 smithi194 ceph-mon[65619]: pgmap v3421: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:45.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:45 smithi026 ceph-mon[96795]: pgmap v3422: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:45.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:45 smithi194 ceph-mon[65619]: pgmap v3422: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:47.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:47 smithi026 ceph-mon[96795]: pgmap v3423: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:47.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:47 smithi194 ceph-mon[65619]: pgmap v3423: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:49.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:49 smithi026 ceph-mon[96795]: pgmap v3424: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:49.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:48:49.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:48:49.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:49 smithi194 ceph-mon[65619]: pgmap v3424: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:49.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:48:49.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:48:51.504 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:51 smithi194 ceph-mon[65619]: pgmap v3425: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:51.884 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:51 smithi026 ceph-mon[96795]: pgmap v3425: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:52.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.643+0000 7f0ccffff700 1 -- 172.21.15.26:0/3099804193 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0cd0060310 msgr2=0x7f0cd00f9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:48:52.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.643+0000 7f0ccffff700 1 --2- 172.21.15.26:0/3099804193 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0cd0060310 0x7f0cd00f9120 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 rx=0x7f0cc8004660 tx=0x7f0cc8009b30).stop 2021-11-03T18:48:52.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.643+0000 7f0ccffff700 1 -- 172.21.15.26:0/3099804193 shutdown_connections 2021-11-03T18:48:52.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.643+0000 7f0ccffff700 1 --2- 172.21.15.26:0/3099804193 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cd00f96a0 0x7f0cd00fbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:52.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.643+0000 7f0ccffff700 1 --2- 172.21.15.26:0/3099804193 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0cd0060310 0x7f0cd00f9120 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:52.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.643+0000 7f0ccffff700 1 -- 172.21.15.26:0/3099804193 >> 172.21.15.26:0/3099804193 conn(0x7f0cd00f0ba0 msgr2=0x7f0cd00f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:48:52.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.643+0000 7f0ccffff700 1 -- 172.21.15.26:0/3099804193 shutdown_connections 2021-11-03T18:48:52.645 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.643+0000 7f0ccffff700 1 -- 172.21.15.26:0/3099804193 wait complete. 2021-11-03T18:48:52.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.644+0000 7f0ccffff700 1 Processor -- start 2021-11-03T18:48:52.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.644+0000 7f0ccffff700 1 -- start start 2021-11-03T18:48:52.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.644+0000 7f0ccffff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cd0060310 0x7f0cd00f6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:48:52.646 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.644+0000 7f0ccffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0cd00f96a0 0x7f0cd00f5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:48:52.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.644+0000 7f0ccffff700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd00f5580 con 0x7f0cd00f96a0 2021-11-03T18:48:52.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.644+0000 7f0ccffff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd00f56c0 con 0x7f0cd0060310 2021-11-03T18:48:52.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.644+0000 7f0cce7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0cd00f96a0 0x7f0cd00f5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:48:52.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.644+0000 7f0cce7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0cd00f96a0 0x7f0cd00f5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33892/0 (socket says 172.21.15.26:33892) 2021-11-03T18:48:52.647 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.644+0000 7f0cce7fc700 1 -- 172.21.15.26:0/987086627 learned_addr learned my addr 172.21.15.26:0/987086627 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:48:52.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.644+0000 7f0cceffd700 1 --2- 172.21.15.26:0/987086627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cd0060310 0x7f0cd00f6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:48:52.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.644+0000 7f0cce7fc700 1 -- 172.21.15.26:0/987086627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cd0060310 msgr2=0x7f0cd00f6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:48:52.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.644+0000 7f0cce7fc700 1 --2- 172.21.15.26:0/987086627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cd0060310 0x7f0cd00f6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:52.648 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.644+0000 7f0cce7fc700 1 -- 172.21.15.26:0/987086627 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc8005040 con 0x7f0cd00f96a0 2021-11-03T18:48:52.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.644+0000 7f0cce7fc700 1 --2- 172.21.15.26:0/987086627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0cd00f96a0 0x7f0cd00f5020 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 rx=0x7f0cb8002700 tx=0x7f0cb8009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:48:52.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.645+0000 7f0cc77fe700 1 -- 172.21.15.26:0/987086627 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cb80079c0 con 0x7f0cd00f96a0 2021-11-03T18:48:52.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.645+0000 7f0cc77fe700 1 -- 172.21.15.26:0/987086627 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0cb800f040 con 0x7f0cd00f96a0 2021-11-03T18:48:52.649 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.645+0000 7f0ccffff700 1 -- 172.21.15.26:0/987086627 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cd00f59a0 con 0x7f0cd00f96a0 2021-11-03T18:48:52.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.645+0000 7f0cc77fe700 1 -- 172.21.15.26:0/987086627 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cb8014740 con 0x7f0cd00f96a0 2021-11-03T18:48:52.650 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.645+0000 7f0ccffff700 1 -- 172.21.15.26:0/987086627 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cd010ed80 con 0x7f0cd00f96a0 2021-11-03T18:48:52.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.646+0000 7f0ccffff700 1 -- 172.21.15.26:0/987086627 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cd0045ad0 con 0x7f0cd00f96a0 2021-11-03T18:48:52.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.646+0000 7f0cc77fe700 1 -- 172.21.15.26:0/987086627 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f0cb801b060 con 0x7f0cd00f96a0 2021-11-03T18:48:52.651 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.646+0000 7f0cc77fe700 1 --2- 172.21.15.26:0/987086627 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0cbc064100 0x7f0cbc0665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:48:52.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.647+0000 7f0cc77fe700 1 -- 172.21.15.26:0/987086627 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f0cb8080670 con 0x7f0cd00f96a0 2021-11-03T18:48:52.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.647+0000 7f0cceffd700 1 --2- 172.21.15.26:0/987086627 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0cbc064100 0x7f0cbc0665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:48:52.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.647+0000 7f0cceffd700 1 --2- 172.21.15.26:0/987086627 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0cbc064100 0x7f0cbc0665c0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7f0cc8013690 tx=0x7f0cc8009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:48:52.652 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.651+0000 7f0cc77fe700 1 -- 172.21.15.26:0/987086627 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f0cb8052a80 con 0x7f0cd00f96a0 2021-11-03T18:48:52.828 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.828+0000 7f0ccffff700 1 -- 172.21.15.26:0/987086627 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0cd00fee30 con 0x7f0cbc064100 2021-11-03T18:48:52.829 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.830+0000 7f0cc77fe700 1 -- 172.21.15.26:0/987086627 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f0cd00fee30 con 0x7f0cbc064100 2021-11-03T18:48:52.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.831+0000 7f0ccffff700 1 -- 172.21.15.26:0/987086627 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0cbc064100 msgr2=0x7f0cbc0665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:48:52.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.832+0000 7f0ccffff700 1 --2- 172.21.15.26:0/987086627 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0cbc064100 0x7f0cbc0665c0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7f0cc8013690 tx=0x7f0cc8009b30).stop 2021-11-03T18:48:52.831 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.832+0000 7f0ccffff700 1 -- 172.21.15.26:0/987086627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0cd00f96a0 msgr2=0x7f0cd00f5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:48:52.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.832+0000 7f0ccffff700 1 --2- 172.21.15.26:0/987086627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0cd00f96a0 0x7f0cd00f5020 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 rx=0x7f0cb8002700 tx=0x7f0cb8009d60).stop 2021-11-03T18:48:52.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.832+0000 7f0ccffff700 1 -- 172.21.15.26:0/987086627 shutdown_connections 2021-11-03T18:48:52.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.832+0000 7f0ccffff700 1 --2- 172.21.15.26:0/987086627 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f0cbc064100 0x7f0cbc0665c0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:52.832 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.832+0000 7f0ccffff700 1 --2- 172.21.15.26:0/987086627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cd0060310 0x7f0cd00f6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:52.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.832+0000 7f0ccffff700 1 --2- 172.21.15.26:0/987086627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0cd00f96a0 0x7f0cd00f5020 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:52.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.832+0000 7f0ccffff700 1 -- 172.21.15.26:0/987086627 >> 172.21.15.26:0/987086627 conn(0x7f0cd00f0ba0 msgr2=0x7f0cd00f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:48:52.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.832+0000 7f0ccffff700 1 -- 172.21.15.26:0/987086627 shutdown_connections 2021-11-03T18:48:52.833 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.832+0000 7f0ccffff700 1 -- 172.21.15.26:0/987086627 wait complete. 2021-11-03T18:48:52.841 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:48:52.933 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.932+0000 7f6745109700 1 -- 172.21.15.26:0/3171699356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67400f55d0 msgr2=0x7f67400f59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:48:52.933 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.932+0000 7f6745109700 1 --2- 172.21.15.26:0/3171699356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67400f55d0 0x7f67400f59f0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 rx=0x7f6728004660 tx=0x7f6728009b30).stop 2021-11-03T18:48:52.934 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.932+0000 7f6745109700 1 -- 172.21.15.26:0/3171699356 shutdown_connections 2021-11-03T18:48:52.934 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.932+0000 7f6745109700 1 --2- 172.21.15.26:0/3171699356 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67400f6870 0x7f67400f6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:52.934 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.932+0000 7f6745109700 1 --2- 172.21.15.26:0/3171699356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67400f55d0 0x7f67400f59f0 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:52.934 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.932+0000 7f6745109700 1 -- 172.21.15.26:0/3171699356 >> 172.21.15.26:0/3171699356 conn(0x7f67400f0d70 msgr2=0x7f67400f3190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:48:52.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.932+0000 7f6745109700 1 -- 172.21.15.26:0/3171699356 shutdown_connections 2021-11-03T18:48:52.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.932+0000 7f6745109700 1 -- 172.21.15.26:0/3171699356 wait complete. 2021-11-03T18:48:52.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.932+0000 7f6745109700 1 Processor -- start 2021-11-03T18:48:52.935 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.932+0000 7f6745109700 1 -- start start 2021-11-03T18:48:52.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.933+0000 7f6745109700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67400f55d0 0x7f6740105ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:48:52.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.933+0000 7f6745109700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67400f6870 0x7f6740106390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:48:52.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.933+0000 7f6745109700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6740106940 con 0x7f67400f6870 2021-11-03T18:48:52.936 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.933+0000 7f6745109700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6740107140 con 0x7f67400f55d0 2021-11-03T18:48:52.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.933+0000 7f673e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67400f6870 0x7f6740106390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:48:52.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.933+0000 7f673e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67400f6870 0x7f6740106390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33902/0 (socket says 172.21.15.26:33902) 2021-11-03T18:48:52.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.933+0000 7f673e59c700 1 -- 172.21.15.26:0/1517141876 learned_addr learned my addr 172.21.15.26:0/1517141876 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:48:52.937 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.933+0000 7f673ed9d700 1 --2- 172.21.15.26:0/1517141876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67400f55d0 0x7f6740105ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:48:52.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.933+0000 7f673e59c700 1 -- 172.21.15.26:0/1517141876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67400f55d0 msgr2=0x7f6740105ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:48:52.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.933+0000 7f673e59c700 1 --2- 172.21.15.26:0/1517141876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67400f55d0 0x7f6740105ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:52.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.933+0000 7f673e59c700 1 -- 172.21.15.26:0/1517141876 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6728005040 con 0x7f67400f6870 2021-11-03T18:48:52.938 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.933+0000 7f673ed9d700 1 --2- 172.21.15.26:0/1517141876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67400f55d0 0x7f6740105ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:48:52.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.933+0000 7f673e59c700 1 --2- 172.21.15.26:0/1517141876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67400f6870 0x7f6740106390 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 rx=0x7f67300026d0 tx=0x7f6730009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:48:52.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.933+0000 7f67377fe700 1 -- 172.21.15.26:0/1517141876 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6730009320 con 0x7f67400f6870 2021-11-03T18:48:52.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.933+0000 7f67377fe700 1 -- 172.21.15.26:0/1517141876 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f673000f040 con 0x7f67400f6870 2021-11-03T18:48:52.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.933+0000 7f6745109700 1 -- 172.21.15.26:0/1517141876 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6740107420 con 0x7f67400f6870 2021-11-03T18:48:52.939 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.933+0000 7f67377fe700 1 -- 172.21.15.26:0/1517141876 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67300147e0 con 0x7f67400f6870 2021-11-03T18:48:52.940 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.933+0000 7f6745109700 1 -- 172.21.15.26:0/1517141876 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67401079e0 con 0x7f67400f6870 2021-11-03T18:48:52.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.934+0000 7f6745109700 1 -- 172.21.15.26:0/1517141876 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67400f49c0 con 0x7f67400f6870 2021-11-03T18:48:52.941 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.935+0000 7f67377fe700 1 -- 172.21.15.26:0/1517141876 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f6730009480 con 0x7f67400f6870 2021-11-03T18:48:52.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.935+0000 7f67377fe700 1 --2- 172.21.15.26:0/1517141876 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f672c0640b0 0x7f672c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:48:52.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.935+0000 7f67377fe700 1 -- 172.21.15.26:0/1517141876 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f6730080eb0 con 0x7f67400f6870 2021-11-03T18:48:52.942 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.935+0000 7f673ed9d700 1 --2- 172.21.15.26:0/1517141876 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f672c0640b0 0x7f672c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:48:52.943 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.936+0000 7f673ed9d700 1 --2- 172.21.15.26:0/1517141876 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f672c0640b0 0x7f672c066570 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 rx=0x7f6728005010 tx=0x7f6728009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:48:52.943 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:52.939+0000 7f67377fe700 1 -- 172.21.15.26:0/1517141876 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f6730053210 con 0x7f67400f6870 2021-11-03T18:48:53.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.110+0000 7f6745109700 1 -- 172.21.15.26:0/1517141876 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f67400fdea0 con 0x7f672c0640b0 2021-11-03T18:48:53.124 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.125+0000 7f67377fe700 1 -- 172.21.15.26:0/1517141876 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7f67400fdea0 con 0x7f672c0640b0 2021-11-03T18:48:53.125 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:48:53.125 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (2h) 8m ago 2h 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:48:53.125 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (112m) 8m ago 2h 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:48:53.126 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (112m) 7m ago 2h 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:48:53.126 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (119m) 8m ago 2h 42.4M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:48:53.126 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (113m) 8m ago 116m 26.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:48:53.127 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (113m) 8m ago 116m 27.0M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:48:53.127 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (116m) 7m ago 116m 27.2M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:48:53.127 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (116m) 7m ago 116m 27.6M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:48:53.127 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (113m) 8m ago 2h 615M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:48:53.128 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (113m) 7m ago 2h 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:48:53.128 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (113m) 8m ago 2h 407M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:48:53.128 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (112m) 7m ago 2h 187M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:48:53.128 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (2h) 8m ago 2h 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:48:53.129 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (2h) 7m ago 2h 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:48:53.129 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (111m) 8m ago 119m 372M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:48:53.129 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (111m) 8m ago 119m 400M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:48:53.129 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (110m) 8m ago 119m 332M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:48:53.130 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (110m) 7m ago 118m 438M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:48:53.130 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (109m) 7m ago 118m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:48:53.130 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (109m) 7m ago 118m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:48:53.130 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (119m) 8m ago 2h 70.2M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:48:53.131 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.127+0000 7f6745109700 1 -- 172.21.15.26:0/1517141876 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f672c0640b0 msgr2=0x7f672c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:48:53.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.127+0000 7f6745109700 1 --2- 172.21.15.26:0/1517141876 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f672c0640b0 0x7f672c066570 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 rx=0x7f6728005010 tx=0x7f6728009b30).stop 2021-11-03T18:48:53.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.127+0000 7f6745109700 1 -- 172.21.15.26:0/1517141876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67400f6870 msgr2=0x7f6740106390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:48:53.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.127+0000 7f6745109700 1 --2- 172.21.15.26:0/1517141876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67400f6870 0x7f6740106390 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 rx=0x7f67300026d0 tx=0x7f6730009de0).stop 2021-11-03T18:48:53.132 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.127+0000 7f6745109700 1 -- 172.21.15.26:0/1517141876 shutdown_connections 2021-11-03T18:48:53.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.127+0000 7f6745109700 1 --2- 172.21.15.26:0/1517141876 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f672c0640b0 0x7f672c066570 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:53.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.127+0000 7f6745109700 1 --2- 172.21.15.26:0/1517141876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67400f55d0 0x7f6740105ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:53.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.127+0000 7f6745109700 1 --2- 172.21.15.26:0/1517141876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67400f6870 0x7f6740106390 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:53.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.127+0000 7f6745109700 1 -- 172.21.15.26:0/1517141876 >> 172.21.15.26:0/1517141876 conn(0x7f67400f0d70 msgr2=0x7f67400fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:48:53.133 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.127+0000 7f6745109700 1 -- 172.21.15.26:0/1517141876 shutdown_connections 2021-11-03T18:48:53.134 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.127+0000 7f6745109700 1 -- 172.21.15.26:0/1517141876 wait complete. 2021-11-03T18:48:53.228 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.227+0000 7f651cd35700 1 -- 172.21.15.26:0/2485155292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65180f6880 msgr2=0x7f65180f6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:48:53.228 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.227+0000 7f651cd35700 1 --2- 172.21.15.26:0/2485155292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65180f6880 0x7f65180f6ce0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 rx=0x7f6500004660 tx=0x7f6500009b30).stop 2021-11-03T18:48:53.228 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.227+0000 7f651cd35700 1 -- 172.21.15.26:0/2485155292 shutdown_connections 2021-11-03T18:48:53.229 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.227+0000 7f651cd35700 1 --2- 172.21.15.26:0/2485155292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65180f6880 0x7f65180f6ce0 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:53.229 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.227+0000 7f651cd35700 1 --2- 172.21.15.26:0/2485155292 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65180f55e0 0x7f65180f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:53.229 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.227+0000 7f651cd35700 1 -- 172.21.15.26:0/2485155292 >> 172.21.15.26:0/2485155292 conn(0x7f65180f0d40 msgr2=0x7f65180f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:48:53.229 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.227+0000 7f651cd35700 1 -- 172.21.15.26:0/2485155292 shutdown_connections 2021-11-03T18:48:53.229 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.227+0000 7f651cd35700 1 -- 172.21.15.26:0/2485155292 wait complete. 2021-11-03T18:48:53.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.227+0000 7f651cd35700 1 Processor -- start 2021-11-03T18:48:53.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.227+0000 7f651cd35700 1 -- start start 2021-11-03T18:48:53.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.228+0000 7f651cd35700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65180f55e0 0x7f6518105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:48:53.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.228+0000 7f651cd35700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65180f6880 0x7f65181063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:48:53.230 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.228+0000 7f651cd35700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65181069b0 con 0x7f65180f55e0 2021-11-03T18:48:53.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.228+0000 7f651cd35700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65181071c0 con 0x7f65180f6880 2021-11-03T18:48:53.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.228+0000 7f651659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65180f55e0 0x7f6518105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:48:53.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.228+0000 7f651659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65180f55e0 0x7f6518105ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33912/0 (socket says 172.21.15.26:33912) 2021-11-03T18:48:53.231 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.228+0000 7f651659c700 1 -- 172.21.15.26:0/1155082871 learned_addr learned my addr 172.21.15.26:0/1155082871 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:48:53.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.228+0000 7f6515d9b700 1 --2- 172.21.15.26:0/1155082871 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65180f6880 0x7f65181063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:48:53.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.228+0000 7f651659c700 1 -- 172.21.15.26:0/1155082871 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65180f6880 msgr2=0x7f65181063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:48:53.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.228+0000 7f651659c700 1 --2- 172.21.15.26:0/1155082871 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65180f6880 0x7f65181063b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:53.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.228+0000 7f651659c700 1 -- 172.21.15.26:0/1155082871 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6500005040 con 0x7f65180f55e0 2021-11-03T18:48:53.232 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.228+0000 7f651659c700 1 --2- 172.21.15.26:0/1155082871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65180f55e0 0x7f6518105ec0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 rx=0x7f651000f910 tx=0x7f6510009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:48:53.233 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.228+0000 7f650effd700 1 -- 172.21.15.26:0/1155082871 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6510009500 con 0x7f65180f55e0 2021-11-03T18:48:53.233 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.228+0000 7f650effd700 1 -- 172.21.15.26:0/1155082871 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6510009660 con 0x7f65180f55e0 2021-11-03T18:48:53.233 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.228+0000 7f651cd35700 1 -- 172.21.15.26:0/1155082871 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65181073e0 con 0x7f65180f55e0 2021-11-03T18:48:53.233 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.228+0000 7f650effd700 1 -- 172.21.15.26:0/1155082871 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f651000dd30 con 0x7f65180f55e0 2021-11-03T18:48:53.233 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.228+0000 7f651cd35700 1 -- 172.21.15.26:0/1155082871 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6518107970 con 0x7f65180f55e0 2021-11-03T18:48:53.234 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.229+0000 7f651cd35700 1 -- 172.21.15.26:0/1155082871 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6518045ad0 con 0x7f65180f55e0 2021-11-03T18:48:53.235 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.230+0000 7f650effd700 1 -- 172.21.15.26:0/1155082871 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f651000e040 con 0x7f65180f55e0 2021-11-03T18:48:53.235 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.230+0000 7f650effd700 1 --2- 172.21.15.26:0/1155082871 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f65040640b0 0x7f6504066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:48:53.235 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.230+0000 7f650effd700 1 -- 172.21.15.26:0/1155082871 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f65100830b0 con 0x7f65180f55e0 2021-11-03T18:48:53.235 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.230+0000 7f6515d9b700 1 --2- 172.21.15.26:0/1155082871 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f65040640b0 0x7f6504066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:48:53.236 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.231+0000 7f6515d9b700 1 --2- 172.21.15.26:0/1155082871 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f65040640b0 0x7f6504066570 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7f6500004630 tx=0x7f6500009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:48:53.236 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.234+0000 7f650effd700 1 -- 172.21.15.26:0/1155082871 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f6510055320 con 0x7f65180f55e0 2021-11-03T18:48:53.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.469+0000 7f651cd35700 1 -- 172.21.15.26:0/1155082871 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f65180ff7b0 con 0x7f65180f55e0 2021-11-03T18:48:53.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.470+0000 7f650effd700 1 -- 172.21.15.26:0/1155082871 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f6510054f10 con 0x7f65180f55e0 2021-11-03T18:48:53.470 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:48:53.470 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:48:53.470 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:48:53.470 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:48:53.471 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:48:53.471 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:48:53.471 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:48:53.471 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:48:53.471 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:48:53.472 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:48:53.472 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:48:53.472 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:48:53.472 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:48:53.472 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:48:53.473 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:48:53.473 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:48:53.473 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:48:53.473 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:48:53.474 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.472+0000 7f651cd35700 1 -- 172.21.15.26:0/1155082871 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f65040640b0 msgr2=0x7f6504066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:48:53.474 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.472+0000 7f651cd35700 1 --2- 172.21.15.26:0/1155082871 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f65040640b0 0x7f6504066570 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7f6500004630 tx=0x7f6500009b30).stop 2021-11-03T18:48:53.474 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.472+0000 7f651cd35700 1 -- 172.21.15.26:0/1155082871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65180f55e0 msgr2=0x7f6518105ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:48:53.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.472+0000 7f651cd35700 1 --2- 172.21.15.26:0/1155082871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65180f55e0 0x7f6518105ec0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 rx=0x7f651000f910 tx=0x7f6510009d80).stop 2021-11-03T18:48:53.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.472+0000 7f651cd35700 1 -- 172.21.15.26:0/1155082871 shutdown_connections 2021-11-03T18:48:53.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.472+0000 7f651cd35700 1 --2- 172.21.15.26:0/1155082871 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f65040640b0 0x7f6504066570 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:53.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.472+0000 7f651cd35700 1 --2- 172.21.15.26:0/1155082871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65180f55e0 0x7f6518105ec0 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:53.476 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.472+0000 7f651cd35700 1 --2- 172.21.15.26:0/1155082871 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65180f6880 0x7f65181063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:53.476 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.472+0000 7f651cd35700 1 -- 172.21.15.26:0/1155082871 >> 172.21.15.26:0/1155082871 conn(0x7f65180f0d40 msgr2=0x7f65180fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:48:53.476 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.472+0000 7f651cd35700 1 -- 172.21.15.26:0/1155082871 shutdown_connections 2021-11-03T18:48:53.476 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.472+0000 7f651cd35700 1 -- 172.21.15.26:0/1155082871 wait complete. 2021-11-03T18:48:53.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.578+0000 7f1f1b4f0700 1 -- 172.21.15.26:0/2692674245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f14068850 msgr2=0x7f1f14068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:48:53.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.578+0000 7f1f1b4f0700 1 --2- 172.21.15.26:0/2692674245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f14068850 0x7f1f14068c70 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 rx=0x7f1f10004660 tx=0x7f1f10009b30).stop 2021-11-03T18:48:53.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.579+0000 7f1f1b4f0700 1 -- 172.21.15.26:0/2692674245 shutdown_connections 2021-11-03T18:48:53.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.579+0000 7f1f1b4f0700 1 --2- 172.21.15.26:0/2692674245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f14069230 0x7f1f14102b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:53.580 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.579+0000 7f1f1b4f0700 1 --2- 172.21.15.26:0/2692674245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f14068850 0x7f1f14068c70 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:53.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.579+0000 7f1f1b4f0700 1 -- 172.21.15.26:0/2692674245 >> 172.21.15.26:0/2692674245 conn(0x7f1f14063b10 msgr2=0x7f1f14065f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:48:53.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.579+0000 7f1f1b4f0700 1 -- 172.21.15.26:0/2692674245 shutdown_connections 2021-11-03T18:48:53.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.579+0000 7f1f1b4f0700 1 -- 172.21.15.26:0/2692674245 wait complete. 2021-11-03T18:48:53.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.579+0000 7f1f1b4f0700 1 Processor -- start 2021-11-03T18:48:53.581 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.579+0000 7f1f1b4f0700 1 -- start start 2021-11-03T18:48:53.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.579+0000 7f1f1b4f0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f14068850 0x7f1f14112430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:48:53.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.579+0000 7f1f1b4f0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f14069230 0x7f1f14114930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:48:53.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.579+0000 7f1f1b4f0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f140ff890 con 0x7f1f14068850 2021-11-03T18:48:53.582 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.579+0000 7f1f1b4f0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f140ff9d0 con 0x7f1f14069230 2021-11-03T18:48:53.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.580+0000 7f1f1928c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f14068850 0x7f1f14112430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:48:53.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.580+0000 7f1f1928c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f14068850 0x7f1f14112430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33922/0 (socket says 172.21.15.26:33922) 2021-11-03T18:48:53.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.580+0000 7f1f1928c700 1 -- 172.21.15.26:0/2416806035 learned_addr learned my addr 172.21.15.26:0/2416806035 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:48:53.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.580+0000 7f1f18a8b700 1 --2- 172.21.15.26:0/2416806035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f14069230 0x7f1f14114930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:48:53.583 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.580+0000 7f1f1928c700 1 -- 172.21.15.26:0/2416806035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f14069230 msgr2=0x7f1f14114930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:48:53.584 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.580+0000 7f1f1928c700 1 --2- 172.21.15.26:0/2416806035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f14069230 0x7f1f14114930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:53.584 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.580+0000 7f1f1928c700 1 -- 172.21.15.26:0/2416806035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f10005040 con 0x7f1f14068850 2021-11-03T18:48:53.584 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.580+0000 7f1f1928c700 1 --2- 172.21.15.26:0/2416806035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f14068850 0x7f1f14112430 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 rx=0x7f1f10009990 tx=0x7f1f10009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:48:53.585 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.580+0000 7f1f09ffb700 1 -- 172.21.15.26:0/2416806035 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f10018070 con 0x7f1f14068850 2021-11-03T18:48:53.586 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.580+0000 7f1f09ffb700 1 -- 172.21.15.26:0/2416806035 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1f10007ba0 con 0x7f1f14068850 2021-11-03T18:48:53.586 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.580+0000 7f1f1b4f0700 1 -- 172.21.15.26:0/2416806035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f14114e80 con 0x7f1f14068850 2021-11-03T18:48:53.586 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.580+0000 7f1f09ffb700 1 -- 172.21.15.26:0/2416806035 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f1001c620 con 0x7f1f14068850 2021-11-03T18:48:53.586 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.581+0000 7f1f1b4f0700 1 -- 172.21.15.26:0/2416806035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f14115360 con 0x7f1f14068850 2021-11-03T18:48:53.587 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.582+0000 7f1f1b4f0700 1 -- 172.21.15.26:0/2416806035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f14045ad0 con 0x7f1f14068850 2021-11-03T18:48:53.587 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.582+0000 7f1f09ffb700 1 -- 172.21.15.26:0/2416806035 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f1f1001c890 con 0x7f1f14068850 2021-11-03T18:48:53.587 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.582+0000 7f1f09ffb700 1 --2- 172.21.15.26:0/2416806035 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1f000640b0 0x7f1f00066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:48:53.587 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.583+0000 7f1f09ffb700 1 -- 172.21.15.26:0/2416806035 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f1f10082520 con 0x7f1f14068850 2021-11-03T18:48:53.588 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.583+0000 7f1f18a8b700 1 --2- 172.21.15.26:0/2416806035 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1f000640b0 0x7f1f00066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:48:53.588 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.583+0000 7f1f18a8b700 1 --2- 172.21.15.26:0/2416806035 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1f000640b0 0x7f1f00066570 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7f1f04007fd0 tx=0x7f1f04009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:48:53.589 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.590+0000 7f1f09ffb700 1 -- 172.21.15.26:0/2416806035 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f1f10054940 con 0x7f1f14068850 2021-11-03T18:48:53.605 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:53 smithi194 ceph-mon[65619]: pgmap v3426: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:53.605 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:53 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:48:53.617 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:53 smithi026 ceph-mon[96795]: pgmap v3426: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:53.617 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:53 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:48:53.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.799+0000 7f1f1b4f0700 1 -- 172.21.15.26:0/2416806035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1f14105d10 con 0x7f1f14068850 2021-11-03T18:48:53.799 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.800+0000 7f1f09ffb700 1 -- 172.21.15.26:0/2416806035 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f1f10054530 con 0x7f1f14068850 2021-11-03T18:48:53.800 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:48:53.800 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:48:53.800 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:48:53.800 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:48:53.801 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:48:53.801 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:48:53.801 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:48:53.801 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:48:53.801 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:48:53.802 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:48:53.802 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:48:53.802 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:48:53.802 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:48:53.803 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:48:53.803 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:48:53.803 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:48:53.803 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:48:53.803 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:48:53.804 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:48:53.804 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:48:53.804 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:48:53.805 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:48:53.805 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:48:53.805 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:48:53.805 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:48:53.805 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:48:53.806 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:48:53.806 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:48:53.806 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:48:53.806 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:48:53.807 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:48:53.807 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:48:53.807 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:48:53.807 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:48:53.807 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:48:53.808 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:48:53.808 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:48:53.808 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:48:53.808 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:48:53.809 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.802+0000 7f1f1b4f0700 1 -- 172.21.15.26:0/2416806035 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1f000640b0 msgr2=0x7f1f00066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:48:53.809 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.802+0000 7f1f1b4f0700 1 --2- 172.21.15.26:0/2416806035 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1f000640b0 0x7f1f00066570 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7f1f04007fd0 tx=0x7f1f04009040).stop 2021-11-03T18:48:53.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.802+0000 7f1f1b4f0700 1 -- 172.21.15.26:0/2416806035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f14068850 msgr2=0x7f1f14112430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:48:53.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.802+0000 7f1f1b4f0700 1 --2- 172.21.15.26:0/2416806035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f14068850 0x7f1f14112430 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 rx=0x7f1f10009990 tx=0x7f1f10009b30).stop 2021-11-03T18:48:53.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.802+0000 7f1f1b4f0700 1 -- 172.21.15.26:0/2416806035 shutdown_connections 2021-11-03T18:48:53.810 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.802+0000 7f1f1b4f0700 1 --2- 172.21.15.26:0/2416806035 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f1f000640b0 0x7f1f00066570 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:53.811 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.802+0000 7f1f1b4f0700 1 --2- 172.21.15.26:0/2416806035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f14068850 0x7f1f14112430 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:53.811 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.802+0000 7f1f1b4f0700 1 --2- 172.21.15.26:0/2416806035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f14069230 0x7f1f14114930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:48:53.811 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.802+0000 7f1f1b4f0700 1 -- 172.21.15.26:0/2416806035 >> 172.21.15.26:0/2416806035 conn(0x7f1f14063b10 msgr2=0x7f1f14067f80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:48:53.811 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.802+0000 7f1f1b4f0700 1 -- 172.21.15.26:0/2416806035 shutdown_connections 2021-11-03T18:48:53.811 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:48:53.802+0000 7f1f1b4f0700 1 -- 172.21.15.26:0/2416806035 wait complete. 2021-11-03T18:48:53.812 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:48:54.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:54 smithi026 ceph-mon[96795]: from='client.37660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:48:54.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:54 smithi026 ceph-mon[96795]: from='client.37664 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:48:54.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:54 smithi026 ceph-mon[96795]: poll took 60060.053 ms: 1 events 2021-11-03T18:48:54.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:54 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1155082871' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:48:54.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2021-11-03T18:48:54.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi026", "name": "osd_memory_target"}]: dispatch 2021-11-03T18:48:54.677 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:48:54.677 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:48:54.677 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:48:54.677 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:48:54.678 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:48:54.678 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:48:54.678 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:48:54.678 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:54 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2416806035' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:48:54.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:54 smithi194 ceph-mon[65619]: from='client.37660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:48:54.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:54 smithi194 ceph-mon[65619]: from='client.37664 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:48:54.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:54 smithi194 ceph-mon[65619]: poll took 60060.053 ms: 1 events 2021-11-03T18:48:54.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:54 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1155082871' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:48:54.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2021-11-03T18:48:54.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config rm", "who": "osd/host:smithi026", "name": "osd_memory_target"}]: dispatch 2021-11-03T18:48:54.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:48:54.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:48:54.754 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:48:54.754 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:48:54.754 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:48:54.754 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:48:54.755 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:48:54.755 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:54 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2416806035' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:48:55.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:55 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:48:55.578 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:55 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:48:55.578 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:55 smithi026 ceph-mon[96795]: pgmap v3427: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:55.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:55 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:48:55.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:55 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:48:55.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:55 smithi194 ceph-mon[65619]: pgmap v3427: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:57.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:57 smithi026 ceph-mon[96795]: pgmap v3428: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:57.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:57 smithi194 ceph-mon[65619]: pgmap v3428: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:59.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:48:59 smithi026 ceph-mon[96795]: pgmap v3429: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:48:59.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:48:59 smithi194 ceph-mon[65619]: pgmap v3429: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:01.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:01 smithi194 ceph-mon[65619]: pgmap v3430: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:01.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:01 smithi026 ceph-mon[96795]: pgmap v3430: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:03.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:03 smithi026 ceph-mon[96795]: pgmap v3431: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:03.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:03 smithi194 ceph-mon[65619]: pgmap v3431: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:05.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:05 smithi026 ceph-mon[96795]: pgmap v3432: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:05.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:05 smithi194 ceph-mon[65619]: pgmap v3432: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:07.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:07 smithi026 ceph-mon[96795]: pgmap v3433: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:07.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:07 smithi194 ceph-mon[65619]: pgmap v3433: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:09.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:09 smithi026 ceph-mon[96795]: pgmap v3434: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:09.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:09 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:49:09.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:09 smithi194 ceph-mon[65619]: pgmap v3434: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:09.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:09 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:49:10.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:10 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:49:10.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:10 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:49:11.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:11 smithi026 ceph-mon[96795]: pgmap v3435: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:11.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:11 smithi194 ceph-mon[65619]: pgmap v3435: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:13.680 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:13 smithi026 ceph-mon[96795]: pgmap v3436: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:13.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:13 smithi194 ceph-mon[65619]: pgmap v3436: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:15.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:15 smithi026 ceph-mon[96795]: pgmap v3437: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:15.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:15 smithi194 ceph-mon[65619]: pgmap v3437: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:17.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:17 smithi026 ceph-mon[96795]: pgmap v3438: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:17.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:17 smithi194 ceph-mon[65619]: pgmap v3438: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:19.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:19 smithi026 ceph-mon[96795]: pgmap v3439: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:19.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:19 smithi194 ceph-mon[65619]: pgmap v3439: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:21.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:21 smithi194 ceph-mon[65619]: pgmap v3440: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:21.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:21 smithi026 ceph-mon[96795]: pgmap v3440: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:23.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:23 smithi026 ceph-mon[96795]: pgmap v3441: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:23.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:23 smithi194 ceph-mon[65619]: pgmap v3441: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:23.917 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:23.917+0000 7f5d57c1f700 1 -- 172.21.15.26:0/3614564488 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d500f6ff0 msgr2=0x7f5d500f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:49:23.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:23.917+0000 7f5d57c1f700 1 --2- 172.21.15.26:0/3614564488 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d500f6ff0 0x7f5d500f7a20 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 rx=0x7f5d44004660 tx=0x7f5d44009b30).stop 2021-11-03T18:49:23.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:23.917+0000 7f5d57c1f700 1 -- 172.21.15.26:0/3614564488 shutdown_connections 2021-11-03T18:49:23.918 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:23.917+0000 7f5d57c1f700 1 --2- 172.21.15.26:0/3614564488 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d500f6ff0 0x7f5d500f7a20 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:23.919 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:23.917+0000 7f5d57c1f700 1 --2- 172.21.15.26:0/3614564488 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d500f66e0 0x7f5d500f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:23.919 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:23.917+0000 7f5d57c1f700 1 -- 172.21.15.26:0/3614564488 >> 172.21.15.26:0/3614564488 conn(0x7f5d500f1f00 msgr2=0x7f5d500f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:49:23.919 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:23.918+0000 7f5d57c1f700 1 -- 172.21.15.26:0/3614564488 shutdown_connections 2021-11-03T18:49:23.919 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:23.918+0000 7f5d57c1f700 1 -- 172.21.15.26:0/3614564488 wait complete. 2021-11-03T18:49:23.919 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:23.918+0000 7f5d57c1f700 1 Processor -- start 2021-11-03T18:49:23.920 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:23.918+0000 7f5d57c1f700 1 -- start start 2021-11-03T18:49:23.920 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:23.918+0000 7f5d57c1f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d500f66e0 0x7f5d50106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:49:23.920 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:23.918+0000 7f5d57c1f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d500f6ff0 0x7f5d50107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:49:23.920 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:23.918+0000 7f5d57c1f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d50107a10 con 0x7f5d500f6ff0 2021-11-03T18:49:23.921 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:23.918+0000 7f5d57c1f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d50107b50 con 0x7f5d500f66e0 2021-11-03T18:49:23.921 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:23.918+0000 7f5d551ba700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d500f6ff0 0x7f5d50107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:49:23.921 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:23.918+0000 7f5d551ba700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d500f6ff0 0x7f5d50107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33946/0 (socket says 172.21.15.26:33946) 2021-11-03T18:49:23.921 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:23.918+0000 7f5d551ba700 1 -- 172.21.15.26:0/608058593 learned_addr learned my addr 172.21.15.26:0/608058593 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:49:23.921 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:23.919+0000 7f5d559bb700 1 --2- 172.21.15.26:0/608058593 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d500f66e0 0x7f5d50106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:49:23.922 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:23.919+0000 7f5d551ba700 1 -- 172.21.15.26:0/608058593 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d500f66e0 msgr2=0x7f5d50106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:49:23.922 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:23.919+0000 7f5d551ba700 1 --2- 172.21.15.26:0/608058593 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d500f66e0 0x7f5d50106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:23.922 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:23.919+0000 7f5d551ba700 1 -- 172.21.15.26:0/608058593 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d44005040 con 0x7f5d500f6ff0 2021-11-03T18:49:23.922 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:23.919+0000 7f5d551ba700 1 --2- 172.21.15.26:0/608058593 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d500f6ff0 0x7f5d50107460 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 rx=0x7f5d44009da0 tx=0x7f5d44009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:49:23.923 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:23.919+0000 7f5d4e7fc700 1 -- 172.21.15.26:0/608058593 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d44018070 con 0x7f5d500f6ff0 2021-11-03T18:49:23.923 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:23.919+0000 7f5d57c1f700 1 -- 172.21.15.26:0/608058593 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d50108490 con 0x7f5d500f6ff0 2021-11-03T18:49:23.923 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:23.919+0000 7f5d4e7fc700 1 -- 172.21.15.26:0/608058593 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5d44007d70 con 0x7f5d500f6ff0 2021-11-03T18:49:23.923 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:23.919+0000 7f5d4e7fc700 1 -- 172.21.15.26:0/608058593 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d4401dea0 con 0x7f5d500f6ff0 2021-11-03T18:49:23.924 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:23.919+0000 7f5d57c1f700 1 -- 172.21.15.26:0/608058593 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d501089f0 con 0x7f5d500f6ff0 2021-11-03T18:49:23.925 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:23.920+0000 7f5d57c1f700 1 -- 172.21.15.26:0/608058593 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d50045ad0 con 0x7f5d500f6ff0 2021-11-03T18:49:23.925 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:23.921+0000 7f5d4e7fc700 1 -- 172.21.15.26:0/608058593 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f5d4401d420 con 0x7f5d500f6ff0 2021-11-03T18:49:23.925 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:23.921+0000 7f5d4e7fc700 1 --2- 172.21.15.26:0/608058593 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5d38064090 0x7f5d38066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:49:23.925 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:23.921+0000 7f5d4e7fc700 1 -- 172.21.15.26:0/608058593 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f5d44082690 con 0x7f5d500f6ff0 2021-11-03T18:49:23.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:23.921+0000 7f5d559bb700 1 --2- 172.21.15.26:0/608058593 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5d38064090 0x7f5d38066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:49:23.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:23.922+0000 7f5d559bb700 1 --2- 172.21.15.26:0/608058593 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5d38064090 0x7f5d38066550 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 rx=0x7f5d48007bd0 tx=0x7f5d48009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:49:23.926 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:23.925+0000 7f5d4e7fc700 1 -- 172.21.15.26:0/608058593 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f5d44054ab0 con 0x7f5d500f6ff0 2021-11-03T18:49:24.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.105+0000 7f5d57c1f700 1 -- 172.21.15.26:0/608058593 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d500008d0 con 0x7f5d38064090 2021-11-03T18:49:24.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.106+0000 7f5d4e7fc700 1 -- 172.21.15.26:0/608058593 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f5d500008d0 con 0x7f5d38064090 2021-11-03T18:49:24.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.108+0000 7f5d57c1f700 1 -- 172.21.15.26:0/608058593 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5d38064090 msgr2=0x7f5d38066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:49:24.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.108+0000 7f5d57c1f700 1 --2- 172.21.15.26:0/608058593 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5d38064090 0x7f5d38066550 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 rx=0x7f5d48007bd0 tx=0x7f5d48009040).stop 2021-11-03T18:49:24.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.108+0000 7f5d57c1f700 1 -- 172.21.15.26:0/608058593 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d500f6ff0 msgr2=0x7f5d50107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:49:24.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.108+0000 7f5d57c1f700 1 --2- 172.21.15.26:0/608058593 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d500f6ff0 0x7f5d50107460 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 rx=0x7f5d44009da0 tx=0x7f5d44009b30).stop 2021-11-03T18:49:24.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.108+0000 7f5d57c1f700 1 -- 172.21.15.26:0/608058593 shutdown_connections 2021-11-03T18:49:24.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.108+0000 7f5d57c1f700 1 --2- 172.21.15.26:0/608058593 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f5d38064090 0x7f5d38066550 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:24.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.108+0000 7f5d57c1f700 1 --2- 172.21.15.26:0/608058593 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d500f66e0 0x7f5d50106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:24.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.108+0000 7f5d57c1f700 1 --2- 172.21.15.26:0/608058593 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d500f6ff0 0x7f5d50107460 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:24.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.108+0000 7f5d57c1f700 1 -- 172.21.15.26:0/608058593 >> 172.21.15.26:0/608058593 conn(0x7f5d500f1f00 msgr2=0x7f5d500fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:49:24.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.108+0000 7f5d57c1f700 1 -- 172.21.15.26:0/608058593 shutdown_connections 2021-11-03T18:49:24.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.108+0000 7f5d57c1f700 1 -- 172.21.15.26:0/608058593 wait complete. 2021-11-03T18:49:24.116 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:49:24.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.209+0000 7faed6076700 1 -- 172.21.15.26:0/2661029533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faed00f5ef0 msgr2=0x7faed00f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:49:24.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.209+0000 7faed6076700 1 --2- 172.21.15.26:0/2661029533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faed00f5ef0 0x7faed00f6920 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 rx=0x7faec4004660 tx=0x7faec4009b30).stop 2021-11-03T18:49:24.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.209+0000 7faed6076700 1 -- 172.21.15.26:0/2661029533 shutdown_connections 2021-11-03T18:49:24.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.209+0000 7faed6076700 1 --2- 172.21.15.26:0/2661029533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faed00f5ef0 0x7faed00f6920 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:24.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.209+0000 7faed6076700 1 --2- 172.21.15.26:0/2661029533 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faed00f55e0 0x7faed00f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:24.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.209+0000 7faed6076700 1 -- 172.21.15.26:0/2661029533 >> 172.21.15.26:0/2661029533 conn(0x7faed00f0de0 msgr2=0x7faed00f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:49:24.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.209+0000 7faed6076700 1 -- 172.21.15.26:0/2661029533 shutdown_connections 2021-11-03T18:49:24.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.209+0000 7faed6076700 1 -- 172.21.15.26:0/2661029533 wait complete. 2021-11-03T18:49:24.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.209+0000 7faed6076700 1 Processor -- start 2021-11-03T18:49:24.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.210+0000 7faed6076700 1 -- start start 2021-11-03T18:49:24.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.210+0000 7faed6076700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faed00f55e0 0x7faed00fa000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:49:24.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.210+0000 7faed6076700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faed00f5ef0 0x7faed00f8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:49:24.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.210+0000 7faed6076700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed00f89e0 con 0x7faed00f5ef0 2021-11-03T18:49:24.212 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.210+0000 7faed6076700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed00f8b20 con 0x7faed00f55e0 2021-11-03T18:49:24.213 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.210+0000 7faeceffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faed00f5ef0 0x7faed00f8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:49:24.213 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.210+0000 7faeceffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faed00f5ef0 0x7faed00f8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33956/0 (socket says 172.21.15.26:33956) 2021-11-03T18:49:24.213 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.210+0000 7faeceffd700 1 -- 172.21.15.26:0/2880431113 learned_addr learned my addr 172.21.15.26:0/2880431113 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:49:24.213 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.210+0000 7faecf7fe700 1 --2- 172.21.15.26:0/2880431113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faed00f55e0 0x7faed00fa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:49:24.214 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.210+0000 7faeceffd700 1 -- 172.21.15.26:0/2880431113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faed00f55e0 msgr2=0x7faed00fa000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:49:24.214 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.210+0000 7faeceffd700 1 --2- 172.21.15.26:0/2880431113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faed00f55e0 0x7faed00fa000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:24.214 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.210+0000 7faeceffd700 1 -- 172.21.15.26:0/2880431113 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec4005040 con 0x7faed00f5ef0 2021-11-03T18:49:24.214 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.210+0000 7faeceffd700 1 --2- 172.21.15.26:0/2880431113 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faed00f5ef0 0x7faed00f8480 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 rx=0x7faec4009990 tx=0x7faec4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:49:24.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.211+0000 7faeb7fff700 1 -- 172.21.15.26:0/2880431113 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faec4018070 con 0x7faed00f5ef0 2021-11-03T18:49:24.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.211+0000 7faeb7fff700 1 -- 172.21.15.26:0/2880431113 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7faec4007ca0 con 0x7faed00f5ef0 2021-11-03T18:49:24.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.211+0000 7faed6076700 1 -- 172.21.15.26:0/2880431113 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed00f8da0 con 0x7faed00f5ef0 2021-11-03T18:49:24.215 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.211+0000 7faeb7fff700 1 -- 172.21.15.26:0/2880431113 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faec401c620 con 0x7faed00f5ef0 2021-11-03T18:49:24.216 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.211+0000 7faed6076700 1 -- 172.21.15.26:0/2880431113 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed00f9300 con 0x7faed00f5ef0 2021-11-03T18:49:24.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.211+0000 7faed6076700 1 -- 172.21.15.26:0/2880431113 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faed0045ad0 con 0x7faed00f5ef0 2021-11-03T18:49:24.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.212+0000 7faeb7fff700 1 -- 172.21.15.26:0/2880431113 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7faec401d960 con 0x7faed00f5ef0 2021-11-03T18:49:24.217 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.212+0000 7faeb7fff700 1 --2- 172.21.15.26:0/2880431113 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faeb80640b0 0x7faeb8066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:49:24.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.212+0000 7faeb7fff700 1 -- 172.21.15.26:0/2880431113 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7faec4082540 con 0x7faed00f5ef0 2021-11-03T18:49:24.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.212+0000 7faecf7fe700 1 --2- 172.21.15.26:0/2880431113 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faeb80640b0 0x7faeb8066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:49:24.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.213+0000 7faecf7fe700 1 --2- 172.21.15.26:0/2880431113 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faeb80640b0 0x7faeb8066570 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7faec00041d0 tx=0x7faec0009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:49:24.218 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.217+0000 7faeb7fff700 1 -- 172.21.15.26:0/2880431113 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7faec4054960 con 0x7faed00f5ef0 2021-11-03T18:49:24.390 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.392+0000 7faed6076700 1 -- 172.21.15.26:0/2880431113 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7faed005fe50 con 0x7faeb80640b0 2021-11-03T18:49:24.405 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.406+0000 7faeb7fff700 1 -- 172.21.15.26:0/2880431113 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7faed005fe50 con 0x7faeb80640b0 2021-11-03T18:49:24.405 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:49:24.406 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (2h) 8m ago 2h 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:49:24.406 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (112m) 8m ago 2h 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:49:24.406 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (112m) 7m ago 2h 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:49:24.407 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (2h) 8m ago 2h 42.4M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:49:24.407 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (113m) 8m ago 117m 26.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:49:24.407 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (113m) 8m ago 116m 27.0M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:49:24.407 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (117m) 7m ago 117m 27.2M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:49:24.407 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (116m) 7m ago 116m 27.6M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:49:24.408 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (114m) 8m ago 2h 615M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:49:24.408 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (113m) 7m ago 2h 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:49:24.408 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (113m) 8m ago 2h 407M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:49:24.408 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (113m) 7m ago 2h 187M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:49:24.409 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (2h) 8m ago 2h 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:49:24.409 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (2h) 7m ago 2h 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:49:24.409 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (112m) 8m ago 2h 372M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:49:24.409 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (111m) 8m ago 119m 400M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:49:24.409 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (111m) 8m ago 119m 332M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:49:24.410 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (110m) 7m ago 119m 438M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:49:24.410 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (110m) 7m ago 118m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:49:24.410 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (110m) 7m ago 118m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:49:24.410 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (2h) 8m ago 2h 70.2M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:49:24.411 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.408+0000 7faed6076700 1 -- 172.21.15.26:0/2880431113 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faeb80640b0 msgr2=0x7faeb8066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:49:24.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.408+0000 7faed6076700 1 --2- 172.21.15.26:0/2880431113 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faeb80640b0 0x7faeb8066570 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7faec00041d0 tx=0x7faec0009040).stop 2021-11-03T18:49:24.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.408+0000 7faed6076700 1 -- 172.21.15.26:0/2880431113 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faed00f5ef0 msgr2=0x7faed00f8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:49:24.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.408+0000 7faed6076700 1 --2- 172.21.15.26:0/2880431113 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faed00f5ef0 0x7faed00f8480 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 rx=0x7faec4009990 tx=0x7faec4009b30).stop 2021-11-03T18:49:24.412 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.408+0000 7faed6076700 1 -- 172.21.15.26:0/2880431113 shutdown_connections 2021-11-03T18:49:24.413 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.408+0000 7faed6076700 1 --2- 172.21.15.26:0/2880431113 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7faeb80640b0 0x7faeb8066570 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:24.413 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.408+0000 7faed6076700 1 --2- 172.21.15.26:0/2880431113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faed00f55e0 0x7faed00fa000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:24.413 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.409+0000 7faed6076700 1 --2- 172.21.15.26:0/2880431113 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faed00f5ef0 0x7faed00f8480 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:24.413 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.409+0000 7faed6076700 1 -- 172.21.15.26:0/2880431113 >> 172.21.15.26:0/2880431113 conn(0x7faed00f0de0 msgr2=0x7faed005f740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:49:24.413 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.409+0000 7faed6076700 1 -- 172.21.15.26:0/2880431113 shutdown_connections 2021-11-03T18:49:24.414 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.409+0000 7faed6076700 1 -- 172.21.15.26:0/2880431113 wait complete. 2021-11-03T18:49:24.508 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.508+0000 7fac31550700 1 -- 172.21.15.26:0/1461454666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac2c0f66e0 msgr2=0x7fac2c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:49:24.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.508+0000 7fac31550700 1 --2- 172.21.15.26:0/1461454666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac2c0f66e0 0x7fac2c0f6b00 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 rx=0x7fac240099e0 tx=0x7fac24004d10).stop 2021-11-03T18:49:24.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.508+0000 7fac31550700 1 -- 172.21.15.26:0/1461454666 shutdown_connections 2021-11-03T18:49:24.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.508+0000 7fac31550700 1 --2- 172.21.15.26:0/1461454666 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac2c0f6ff0 0x7fac2c0f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:24.509 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.508+0000 7fac31550700 1 --2- 172.21.15.26:0/1461454666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac2c0f66e0 0x7fac2c0f6b00 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:24.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.508+0000 7fac31550700 1 -- 172.21.15.26:0/1461454666 >> 172.21.15.26:0/1461454666 conn(0x7fac2c0f1f00 msgr2=0x7fac2c0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:49:24.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.508+0000 7fac31550700 1 -- 172.21.15.26:0/1461454666 shutdown_connections 2021-11-03T18:49:24.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.508+0000 7fac31550700 1 -- 172.21.15.26:0/1461454666 wait complete. 2021-11-03T18:49:24.510 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.508+0000 7fac31550700 1 Processor -- start 2021-11-03T18:49:24.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.508+0000 7fac31550700 1 -- start start 2021-11-03T18:49:24.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.509+0000 7fac31550700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac2c0f66e0 0x7fac2c107070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:49:24.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.509+0000 7fac31550700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac2c0f6ff0 0x7fac2c107560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:49:24.511 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.509+0000 7fac31550700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c107b10 con 0x7fac2c0f66e0 2021-11-03T18:49:24.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.509+0000 7fac31550700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c107c50 con 0x7fac2c0f6ff0 2021-11-03T18:49:24.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.509+0000 7fac2affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac2c0f66e0 0x7fac2c107070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:49:24.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.509+0000 7fac2affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac2c0f66e0 0x7fac2c107070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33964/0 (socket says 172.21.15.26:33964) 2021-11-03T18:49:24.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.509+0000 7fac2affd700 1 -- 172.21.15.26:0/4171293717 learned_addr learned my addr 172.21.15.26:0/4171293717 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:49:24.512 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.509+0000 7fac2a7fc700 1 --2- 172.21.15.26:0/4171293717 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac2c0f6ff0 0x7fac2c107560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:49:24.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.509+0000 7fac2affd700 1 -- 172.21.15.26:0/4171293717 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac2c0f6ff0 msgr2=0x7fac2c107560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:49:24.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.509+0000 7fac2affd700 1 --2- 172.21.15.26:0/4171293717 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac2c0f6ff0 0x7fac2c107560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:24.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.509+0000 7fac2affd700 1 -- 172.21.15.26:0/4171293717 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac24009640 con 0x7fac2c0f66e0 2021-11-03T18:49:24.513 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.509+0000 7fac2a7fc700 1 --2- 172.21.15.26:0/4171293717 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac2c0f6ff0 0x7fac2c107560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:49:24.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.509+0000 7fac2affd700 1 --2- 172.21.15.26:0/4171293717 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac2c0f66e0 0x7fac2c107070 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 rx=0x7fac24004b70 tx=0x7fac24004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:49:24.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.509+0000 7fac237fe700 1 -- 172.21.15.26:0/4171293717 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac2400e030 con 0x7fac2c0f66e0 2021-11-03T18:49:24.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.509+0000 7fac31550700 1 -- 172.21.15.26:0/4171293717 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac2c108590 con 0x7fac2c0f66e0 2021-11-03T18:49:24.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.509+0000 7fac237fe700 1 -- 172.21.15.26:0/4171293717 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fac240049b0 con 0x7fac2c0f66e0 2021-11-03T18:49:24.514 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.509+0000 7fac237fe700 1 -- 172.21.15.26:0/4171293717 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac24018070 con 0x7fac2c0f66e0 2021-11-03T18:49:24.515 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.510+0000 7fac31550700 1 -- 172.21.15.26:0/4171293717 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac2c108a70 con 0x7fac2c0f66e0 2021-11-03T18:49:24.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.510+0000 7fac31550700 1 -- 172.21.15.26:0/4171293717 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac2c045ad0 con 0x7fac2c0f66e0 2021-11-03T18:49:24.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.511+0000 7fac237fe700 1 -- 172.21.15.26:0/4171293717 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fac2401db40 con 0x7fac2c0f66e0 2021-11-03T18:49:24.516 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.511+0000 7fac237fe700 1 --2- 172.21.15.26:0/4171293717 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fac180640b0 0x7fac18066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:49:24.517 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.511+0000 7fac237fe700 1 -- 172.21.15.26:0/4171293717 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fac240826b0 con 0x7fac2c0f66e0 2021-11-03T18:49:24.517 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.511+0000 7fac2a7fc700 1 --2- 172.21.15.26:0/4171293717 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fac180640b0 0x7fac18066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:49:24.517 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.512+0000 7fac2a7fc700 1 --2- 172.21.15.26:0/4171293717 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fac180640b0 0x7fac18066570 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7fac14004a90 tx=0x7fac14009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:49:24.517 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.515+0000 7fac237fe700 1 -- 172.21.15.26:0/4171293717 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fac24054a70 con 0x7fac2c0f66e0 2021-11-03T18:49:24.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:24 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:49:24.743 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.745+0000 7fac31550700 1 -- 172.21.15.26:0/4171293717 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fac2c0fef70 con 0x7fac2c0f66e0 2021-11-03T18:49:24.744 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.745+0000 7fac237fe700 1 -- 172.21.15.26:0/4171293717 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fac24054660 con 0x7fac2c0f66e0 2021-11-03T18:49:24.744 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:49:24.744 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:49:24.745 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:49:24.745 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:49:24.745 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:49:24.745 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:49:24.746 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:49:24.746 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:49:24.746 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:49:24.746 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:49:24.747 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:49:24.747 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:49:24.747 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:49:24.747 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:49:24.748 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:49:24.748 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:49:24.748 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:49:24.748 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:49:24.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.747+0000 7fac31550700 1 -- 172.21.15.26:0/4171293717 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fac180640b0 msgr2=0x7fac18066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:49:24.749 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.747+0000 7fac31550700 1 --2- 172.21.15.26:0/4171293717 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fac180640b0 0x7fac18066570 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7fac14004a90 tx=0x7fac14009040).stop 2021-11-03T18:49:24.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.747+0000 7fac31550700 1 -- 172.21.15.26:0/4171293717 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac2c0f66e0 msgr2=0x7fac2c107070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:49:24.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.747+0000 7fac31550700 1 --2- 172.21.15.26:0/4171293717 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac2c0f66e0 0x7fac2c107070 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 rx=0x7fac24004b70 tx=0x7fac24004d10).stop 2021-11-03T18:49:24.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.747+0000 7fac31550700 1 -- 172.21.15.26:0/4171293717 shutdown_connections 2021-11-03T18:49:24.750 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.747+0000 7fac31550700 1 --2- 172.21.15.26:0/4171293717 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fac180640b0 0x7fac18066570 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:24.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.747+0000 7fac31550700 1 --2- 172.21.15.26:0/4171293717 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac2c0f66e0 0x7fac2c107070 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:24.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.747+0000 7fac31550700 1 --2- 172.21.15.26:0/4171293717 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac2c0f6ff0 0x7fac2c107560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:24.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.747+0000 7fac31550700 1 -- 172.21.15.26:0/4171293717 >> 172.21.15.26:0/4171293717 conn(0x7fac2c0f1f00 msgr2=0x7fac2c0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:49:24.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.747+0000 7fac31550700 1 -- 172.21.15.26:0/4171293717 shutdown_connections 2021-11-03T18:49:24.751 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.747+0000 7fac31550700 1 -- 172.21.15.26:0/4171293717 wait complete. 2021-11-03T18:49:24.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:24 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:49:24.847 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.847+0000 7fb1a0318700 1 -- 172.21.15.26:0/4178450033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1980f7580 msgr2=0x7fb1980f59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:49:24.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.847+0000 7fb1a0318700 1 --2- 172.21.15.26:0/4178450033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1980f7580 0x7fb1980f59d0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 rx=0x7fb194004660 tx=0x7fb194009b30).stop 2021-11-03T18:49:24.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.847+0000 7fb1a0318700 1 -- 172.21.15.26:0/4178450033 shutdown_connections 2021-11-03T18:49:24.848 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.847+0000 7fb1a0318700 1 --2- 172.21.15.26:0/4178450033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1980f7580 0x7fb1980f59d0 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:24.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.847+0000 7fb1a0318700 1 --2- 172.21.15.26:0/4178450033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1980f6be0 0x7fb1980f7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:24.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.847+0000 7fb1a0318700 1 -- 172.21.15.26:0/4178450033 >> 172.21.15.26:0/4178450033 conn(0x7fb1980f04c0 msgr2=0x7fb1980f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:49:24.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.847+0000 7fb1a0318700 1 -- 172.21.15.26:0/4178450033 shutdown_connections 2021-11-03T18:49:24.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.847+0000 7fb1a0318700 1 -- 172.21.15.26:0/4178450033 wait complete. 2021-11-03T18:49:24.849 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.848+0000 7fb1a0318700 1 Processor -- start 2021-11-03T18:49:24.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.848+0000 7fb1a0318700 1 -- start start 2021-11-03T18:49:24.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.848+0000 7fb1a0318700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1980f6be0 0x7fb198109c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:49:24.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.848+0000 7fb1a0318700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1980f7580 0x7fb19810c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:49:24.850 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.848+0000 7fb1a0318700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1980f5680 con 0x7fb1980f7580 2021-11-03T18:49:24.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.848+0000 7fb1a0318700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1980f57c0 con 0x7fb1980f6be0 2021-11-03T18:49:24.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.848+0000 7fb19d8b3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1980f7580 0x7fb19810c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:49:24.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.848+0000 7fb19d8b3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1980f7580 0x7fb19810c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33976/0 (socket says 172.21.15.26:33976) 2021-11-03T18:49:24.851 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.848+0000 7fb19d8b3700 1 -- 172.21.15.26:0/893288013 learned_addr learned my addr 172.21.15.26:0/893288013 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:49:24.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.848+0000 7fb19e0b4700 1 --2- 172.21.15.26:0/893288013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1980f6be0 0x7fb198109c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:49:24.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.848+0000 7fb19d8b3700 1 -- 172.21.15.26:0/893288013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1980f6be0 msgr2=0x7fb198109c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:49:24.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.848+0000 7fb19d8b3700 1 --2- 172.21.15.26:0/893288013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1980f6be0 0x7fb198109c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:24.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.848+0000 7fb19d8b3700 1 -- 172.21.15.26:0/893288013 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb194005040 con 0x7fb1980f7580 2021-11-03T18:49:24.852 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.848+0000 7fb19d8b3700 1 --2- 172.21.15.26:0/893288013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1980f7580 0x7fb19810c160 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 rx=0x7fb194013a70 tx=0x7fb194009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:49:24.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.849+0000 7fb18affd700 1 -- 172.21.15.26:0/893288013 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb194018070 con 0x7fb1980f7580 2021-11-03T18:49:24.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.849+0000 7fb18affd700 1 -- 172.21.15.26:0/893288013 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb1940097d0 con 0x7fb1980f7580 2021-11-03T18:49:24.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.849+0000 7fb1a0318700 1 -- 172.21.15.26:0/893288013 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb19810c6b0 con 0x7fb1980f7580 2021-11-03T18:49:24.853 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.849+0000 7fb18affd700 1 -- 172.21.15.26:0/893288013 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb19401de80 con 0x7fb1980f7580 2021-11-03T18:49:24.854 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.849+0000 7fb1a0318700 1 -- 172.21.15.26:0/893288013 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb19810cc10 con 0x7fb1980f7580 2021-11-03T18:49:24.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.850+0000 7fb1a0318700 1 -- 172.21.15.26:0/893288013 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb198045ad0 con 0x7fb1980f7580 2021-11-03T18:49:24.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.850+0000 7fb18affd700 1 -- 172.21.15.26:0/893288013 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fb194007ba0 con 0x7fb1980f7580 2021-11-03T18:49:24.855 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.850+0000 7fb18affd700 1 --2- 172.21.15.26:0/893288013 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb1840640b0 0x7fb184066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:49:24.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.851+0000 7fb18affd700 1 -- 172.21.15.26:0/893288013 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fb1940823d0 con 0x7fb1980f7580 2021-11-03T18:49:24.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.851+0000 7fb19e0b4700 1 --2- 172.21.15.26:0/893288013 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb1840640b0 0x7fb184066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:49:24.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.851+0000 7fb19e0b4700 1 --2- 172.21.15.26:0/893288013 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb1840640b0 0x7fb184066570 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7fb1980f5300 tx=0x7fb18c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:49:24.856 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:24.855+0000 7fb18affd700 1 -- 172.21.15.26:0/893288013 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fb1940547f0 con 0x7fb1980f7580 2021-11-03T18:49:25.056 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:25.058+0000 7fb1a0318700 1 -- 172.21.15.26:0/893288013 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb1980fde50 con 0x7fb1980f7580 2021-11-03T18:49:25.057 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:25.058+0000 7fb18affd700 1 -- 172.21.15.26:0/893288013 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fb1940543e0 con 0x7fb1980f7580 2021-11-03T18:49:25.057 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:49:25.057 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:49:25.058 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:49:25.058 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:49:25.058 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:49:25.058 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:49:25.059 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:49:25.059 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:49:25.059 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:49:25.059 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:49:25.059 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:49:25.060 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:49:25.060 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:49:25.060 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:49:25.060 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:49:25.061 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:49:25.061 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:49:25.061 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:49:25.061 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:49:25.061 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:49:25.062 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:49:25.062 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:49:25.062 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:49:25.063 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:49:25.063 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:49:25.063 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:49:25.064 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:49:25.064 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:49:25.064 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:49:25.064 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:49:25.064 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:49:25.065 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:49:25.065 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:49:25.065 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:49:25.065 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:49:25.066 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:49:25.066 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:49:25.066 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:49:25.066 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:49:25.067 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:25.060+0000 7fb1a0318700 1 -- 172.21.15.26:0/893288013 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb1840640b0 msgr2=0x7fb184066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:49:25.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:25.060+0000 7fb1a0318700 1 --2- 172.21.15.26:0/893288013 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb1840640b0 0x7fb184066570 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7fb1980f5300 tx=0x7fb18c00b040).stop 2021-11-03T18:49:25.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:25.060+0000 7fb1a0318700 1 -- 172.21.15.26:0/893288013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1980f7580 msgr2=0x7fb19810c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:49:25.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:25.060+0000 7fb1a0318700 1 --2- 172.21.15.26:0/893288013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1980f7580 0x7fb19810c160 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 rx=0x7fb194013a70 tx=0x7fb194009b30).stop 2021-11-03T18:49:25.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:25.060+0000 7fb1a0318700 1 -- 172.21.15.26:0/893288013 shutdown_connections 2021-11-03T18:49:25.068 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:25.060+0000 7fb1a0318700 1 --2- 172.21.15.26:0/893288013 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fb1840640b0 0x7fb184066570 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:25.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:25.060+0000 7fb1a0318700 1 --2- 172.21.15.26:0/893288013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1980f6be0 0x7fb198109c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:25.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:25.060+0000 7fb1a0318700 1 --2- 172.21.15.26:0/893288013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1980f7580 0x7fb19810c160 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:25.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:25.060+0000 7fb1a0318700 1 -- 172.21.15.26:0/893288013 >> 172.21.15.26:0/893288013 conn(0x7fb1980f04c0 msgr2=0x7fb1980fa430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:49:25.069 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:25.060+0000 7fb1a0318700 1 -- 172.21.15.26:0/893288013 shutdown_connections 2021-11-03T18:49:25.070 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:25.060+0000 7fb1a0318700 1 -- 172.21.15.26:0/893288013 wait complete. 2021-11-03T18:49:25.070 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:49:25.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:25 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:49:25.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:25 smithi026 ceph-mon[96795]: from='client.37676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:49:25.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:25 smithi026 ceph-mon[96795]: pgmap v3442: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:25.578 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:25 smithi026 ceph-mon[96795]: from='client.37680 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:49:25.578 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:25 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/4171293717' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:49:25.578 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:25 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/893288013' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:49:25.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:25 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:49:25.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:25 smithi194 ceph-mon[65619]: from='client.37676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:49:25.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:25 smithi194 ceph-mon[65619]: pgmap v3442: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:25.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:25 smithi194 ceph-mon[65619]: from='client.37680 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:49:25.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:25 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/4171293717' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:49:25.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:25 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/893288013' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:49:27.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:27 smithi026 ceph-mon[96795]: pgmap v3443: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:27.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:27 smithi194 ceph-mon[65619]: pgmap v3443: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:29.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:29 smithi026 ceph-mon[96795]: pgmap v3444: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:29.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:29 smithi194 ceph-mon[65619]: pgmap v3444: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:31.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:31 smithi194 ceph-mon[65619]: pgmap v3445: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:31.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:31 smithi026 ceph-mon[96795]: pgmap v3445: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:33.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:33 smithi026 ceph-mon[96795]: pgmap v3446: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:33.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:33 smithi194 ceph-mon[65619]: pgmap v3446: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:35.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:35 smithi026 ceph-mon[96795]: pgmap v3447: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:35.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:35 smithi194 ceph-mon[65619]: pgmap v3447: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:37.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:37 smithi026 ceph-mon[96795]: pgmap v3448: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:37.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:37 smithi194 ceph-mon[65619]: pgmap v3448: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:39.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:39 smithi026 ceph-mon[96795]: pgmap v3449: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:39.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:39 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:49:39.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:39 smithi194 ceph-mon[65619]: pgmap v3449: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:39.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:39 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:49:40.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:40 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:49:40.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:40 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:49:41.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:41 smithi026 ceph-mon[96795]: pgmap v3450: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:41.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:41 smithi194 ceph-mon[65619]: pgmap v3450: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:43.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:43 smithi026 ceph-mon[96795]: pgmap v3451: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:43.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:43 smithi194 ceph-mon[65619]: pgmap v3451: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:45.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:45 smithi026 ceph-mon[96795]: pgmap v3452: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:45.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:45 smithi194 ceph-mon[65619]: pgmap v3452: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:47.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:47 smithi026 ceph-mon[96795]: pgmap v3453: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:47.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:47 smithi194 ceph-mon[65619]: pgmap v3453: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:49.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:49 smithi026 ceph-mon[96795]: pgmap v3454: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:49.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:49:49.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:49 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:49:49.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:49 smithi194 ceph-mon[65619]: pgmap v3454: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:49.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:49:49.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:49 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:49:51.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:51 smithi194 ceph-mon[65619]: pgmap v3455: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:51.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:51 smithi026 ceph-mon[96795]: pgmap v3455: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:53.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:53 smithi026 ceph-mon[96795]: pgmap v3456: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:53.722 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:53 smithi194 ceph-mon[65619]: pgmap v3456: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:54.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:49:54.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:49:54.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:49:54.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:49:55.174 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.173+0000 7f6e2b61e700 1 -- 172.21.15.26:0/1975211669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e240f66e0 msgr2=0x7f6e240f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:49:55.175 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.173+0000 7f6e2b61e700 1 --2- 172.21.15.26:0/1975211669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e240f66e0 0x7f6e240f6b00 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 rx=0x7f6e1c0099e0 tx=0x7f6e1c004d10).stop 2021-11-03T18:49:55.175 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.173+0000 7f6e2b61e700 1 -- 172.21.15.26:0/1975211669 shutdown_connections 2021-11-03T18:49:55.175 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.173+0000 7f6e2b61e700 1 --2- 172.21.15.26:0/1975211669 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e240f7980 0x7f6e240f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:55.176 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.173+0000 7f6e2b61e700 1 --2- 172.21.15.26:0/1975211669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e240f66e0 0x7f6e240f6b00 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:55.176 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.173+0000 7f6e2b61e700 1 -- 172.21.15.26:0/1975211669 >> 172.21.15.26:0/1975211669 conn(0x7f6e240f1e40 msgr2=0x7f6e240f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:49:55.176 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.173+0000 7f6e2b61e700 1 -- 172.21.15.26:0/1975211669 shutdown_connections 2021-11-03T18:49:55.176 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.174+0000 7f6e2b61e700 1 -- 172.21.15.26:0/1975211669 wait complete. 2021-11-03T18:49:55.176 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.174+0000 7f6e2b61e700 1 Processor -- start 2021-11-03T18:49:55.177 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.174+0000 7f6e2b61e700 1 -- start start 2021-11-03T18:49:55.177 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.174+0000 7f6e2b61e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e240f66e0 0x7f6e241070d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:49:55.177 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.174+0000 7f6e2b61e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e240f7980 0x7f6e241075c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:49:55.177 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.174+0000 7f6e2b61e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e24107b70 con 0x7f6e240f7980 2021-11-03T18:49:55.177 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.174+0000 7f6e2b61e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e24107cb0 con 0x7f6e240f66e0 2021-11-03T18:49:55.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.174+0000 7f6e28bb9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e240f7980 0x7f6e241075c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:49:55.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.174+0000 7f6e28bb9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e240f7980 0x7f6e241075c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33992/0 (socket says 172.21.15.26:33992) 2021-11-03T18:49:55.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.174+0000 7f6e28bb9700 1 -- 172.21.15.26:0/481153362 learned_addr learned my addr 172.21.15.26:0/481153362 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:49:55.178 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.175+0000 7f6e293ba700 1 --2- 172.21.15.26:0/481153362 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e240f66e0 0x7f6e241070d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:49:55.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.175+0000 7f6e28bb9700 1 -- 172.21.15.26:0/481153362 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e240f66e0 msgr2=0x7f6e241070d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:49:55.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.175+0000 7f6e28bb9700 1 --2- 172.21.15.26:0/481153362 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e240f66e0 0x7f6e241070d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:55.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.175+0000 7f6e28bb9700 1 -- 172.21.15.26:0/481153362 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e1c009640 con 0x7f6e240f7980 2021-11-03T18:49:55.179 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.175+0000 7f6e28bb9700 1 --2- 172.21.15.26:0/481153362 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e240f7980 0x7f6e241075c0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 rx=0x7f6e180026d0 tx=0x7f6e18009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:49:55.180 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.175+0000 7f6e21ffb700 1 -- 172.21.15.26:0/481153362 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e180079c0 con 0x7f6e240f7980 2021-11-03T18:49:55.180 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.175+0000 7f6e21ffb700 1 -- 172.21.15.26:0/481153362 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6e1800f040 con 0x7f6e240f7980 2021-11-03T18:49:55.180 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.175+0000 7f6e21ffb700 1 -- 172.21.15.26:0/481153362 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e180148b0 con 0x7f6e240f7980 2021-11-03T18:49:55.180 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.175+0000 7f6e2b61e700 1 -- 172.21.15.26:0/481153362 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e24108650 con 0x7f6e240f7980 2021-11-03T18:49:55.180 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.175+0000 7f6e2b61e700 1 -- 172.21.15.26:0/481153362 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e24108b90 con 0x7f6e240f7980 2021-11-03T18:49:55.182 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.176+0000 7f6e2b61e700 1 -- 172.21.15.26:0/481153362 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e24045ad0 con 0x7f6e240f7980 2021-11-03T18:49:55.182 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.177+0000 7f6e21ffb700 1 -- 172.21.15.26:0/481153362 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f6e18007b20 con 0x7f6e240f7980 2021-11-03T18:49:55.182 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.177+0000 7f6e21ffb700 1 --2- 172.21.15.26:0/481153362 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6e0c0640b0 0x7f6e0c066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:49:55.182 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.177+0000 7f6e21ffb700 1 -- 172.21.15.26:0/481153362 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f6e18080660 con 0x7f6e240f7980 2021-11-03T18:49:55.183 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.177+0000 7f6e293ba700 1 --2- 172.21.15.26:0/481153362 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6e0c0640b0 0x7f6e0c066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:49:55.183 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.178+0000 7f6e293ba700 1 --2- 172.21.15.26:0/481153362 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6e0c0640b0 0x7f6e0c066570 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x7f6e1c00b730 tx=0x7f6e1c004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:49:55.183 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.181+0000 7f6e21ffb700 1 -- 172.21.15.26:0/481153362 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f6e180529c0 con 0x7f6e240f7980 2021-11-03T18:49:55.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.361+0000 7f6e2b61e700 1 -- 172.21.15.26:0/481153362 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e24108e60 con 0x7f6e0c0640b0 2021-11-03T18:49:55.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.362+0000 7f6e21ffb700 1 -- 172.21.15.26:0/481153362 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f6e24108e60 con 0x7f6e0c0640b0 2021-11-03T18:49:55.363 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.364+0000 7f6e2b61e700 1 -- 172.21.15.26:0/481153362 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6e0c0640b0 msgr2=0x7f6e0c066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:49:55.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.364+0000 7f6e2b61e700 1 --2- 172.21.15.26:0/481153362 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6e0c0640b0 0x7f6e0c066570 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x7f6e1c00b730 tx=0x7f6e1c004d10).stop 2021-11-03T18:49:55.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.364+0000 7f6e2b61e700 1 -- 172.21.15.26:0/481153362 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e240f7980 msgr2=0x7f6e241075c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:49:55.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.364+0000 7f6e2b61e700 1 --2- 172.21.15.26:0/481153362 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e240f7980 0x7f6e241075c0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 rx=0x7f6e180026d0 tx=0x7f6e18009de0).stop 2021-11-03T18:49:55.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.364+0000 7f6e2b61e700 1 -- 172.21.15.26:0/481153362 shutdown_connections 2021-11-03T18:49:55.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.364+0000 7f6e2b61e700 1 --2- 172.21.15.26:0/481153362 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f6e0c0640b0 0x7f6e0c066570 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:55.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.364+0000 7f6e2b61e700 1 --2- 172.21.15.26:0/481153362 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e240f66e0 0x7f6e241070d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:55.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.364+0000 7f6e2b61e700 1 --2- 172.21.15.26:0/481153362 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e240f7980 0x7f6e241075c0 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:55.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.364+0000 7f6e2b61e700 1 -- 172.21.15.26:0/481153362 >> 172.21.15.26:0/481153362 conn(0x7f6e240f1e40 msgr2=0x7f6e240fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:49:55.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.364+0000 7f6e2b61e700 1 -- 172.21.15.26:0/481153362 shutdown_connections 2021-11-03T18:49:55.366 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.364+0000 7f6e2b61e700 1 -- 172.21.15.26:0/481153362 wait complete. 2021-11-03T18:49:55.373 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:49:55.466 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.465+0000 7fc3d4b3a700 1 -- 172.21.15.26:0/932885214 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3d00f55e0 msgr2=0x7fc3d00f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:49:55.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.465+0000 7fc3d4b3a700 1 --2- 172.21.15.26:0/932885214 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3d00f55e0 0x7fc3d00f5a00 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 rx=0x7fc3c0004660 tx=0x7fc3c0009b30).stop 2021-11-03T18:49:55.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.465+0000 7fc3d4b3a700 1 -- 172.21.15.26:0/932885214 shutdown_connections 2021-11-03T18:49:55.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.465+0000 7fc3d4b3a700 1 --2- 172.21.15.26:0/932885214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3d00f5ef0 0x7fc3d00f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:55.467 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.465+0000 7fc3d4b3a700 1 --2- 172.21.15.26:0/932885214 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3d00f55e0 0x7fc3d00f5a00 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:55.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.465+0000 7fc3d4b3a700 1 -- 172.21.15.26:0/932885214 >> 172.21.15.26:0/932885214 conn(0x7fc3d00f0de0 msgr2=0x7fc3d00f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:49:55.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.465+0000 7fc3d4b3a700 1 -- 172.21.15.26:0/932885214 shutdown_connections 2021-11-03T18:49:55.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.465+0000 7fc3d4b3a700 1 -- 172.21.15.26:0/932885214 wait complete. 2021-11-03T18:49:55.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.466+0000 7fc3d4b3a700 1 Processor -- start 2021-11-03T18:49:55.468 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.466+0000 7fc3d4b3a700 1 -- start start 2021-11-03T18:49:55.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.466+0000 7fc3d4b3a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3d00f55e0 0x7fc3d00fa000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:49:55.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.466+0000 7fc3d4b3a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3d00f5ef0 0x7fc3d00f8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:49:55.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.466+0000 7fc3d4b3a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d00f89e0 con 0x7fc3d00f5ef0 2021-11-03T18:49:55.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.466+0000 7fc3d4b3a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d00f8b20 con 0x7fc3d00f55e0 2021-11-03T18:49:55.469 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.466+0000 7fc3cdd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3d00f5ef0 0x7fc3d00f8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:49:55.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.466+0000 7fc3cdd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3d00f5ef0 0x7fc3d00f8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34002/0 (socket says 172.21.15.26:34002) 2021-11-03T18:49:55.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.466+0000 7fc3cdd9b700 1 -- 172.21.15.26:0/1922007793 learned_addr learned my addr 172.21.15.26:0/1922007793 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:49:55.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.466+0000 7fc3ce59c700 1 --2- 172.21.15.26:0/1922007793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3d00f55e0 0x7fc3d00fa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:49:55.470 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.466+0000 7fc3cdd9b700 1 -- 172.21.15.26:0/1922007793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3d00f55e0 msgr2=0x7fc3d00fa000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:49:55.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.466+0000 7fc3cdd9b700 1 --2- 172.21.15.26:0/1922007793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3d00f55e0 0x7fc3d00fa000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:55.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.466+0000 7fc3cdd9b700 1 -- 172.21.15.26:0/1922007793 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c0005040 con 0x7fc3d00f5ef0 2021-11-03T18:49:55.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.466+0000 7fc3cdd9b700 1 --2- 172.21.15.26:0/1922007793 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3d00f5ef0 0x7fc3d00f8480 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 rx=0x7fc3b8002700 tx=0x7fc3b8009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:49:55.471 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.466+0000 7fc3c6ffd700 1 -- 172.21.15.26:0/1922007793 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3b8009320 con 0x7fc3d00f5ef0 2021-11-03T18:49:55.472 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.467+0000 7fc3c6ffd700 1 -- 172.21.15.26:0/1922007793 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc3b800f040 con 0x7fc3d00f5ef0 2021-11-03T18:49:55.472 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.467+0000 7fc3d4b3a700 1 -- 172.21.15.26:0/1922007793 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3d00f8e00 con 0x7fc3d00f5ef0 2021-11-03T18:49:55.472 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.467+0000 7fc3c6ffd700 1 -- 172.21.15.26:0/1922007793 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3b8014820 con 0x7fc3d00f5ef0 2021-11-03T18:49:55.472 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.467+0000 7fc3d4b3a700 1 -- 172.21.15.26:0/1922007793 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3d010ef50 con 0x7fc3d00f5ef0 2021-11-03T18:49:55.473 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.467+0000 7fc3d4b3a700 1 -- 172.21.15.26:0/1922007793 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3d0045ad0 con 0x7fc3d00f5ef0 2021-11-03T18:49:55.474 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.468+0000 7fc3c6ffd700 1 -- 172.21.15.26:0/1922007793 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fc3b8009480 con 0x7fc3d00f5ef0 2021-11-03T18:49:55.474 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.468+0000 7fc3c6ffd700 1 --2- 172.21.15.26:0/1922007793 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3bc0640b0 0x7fc3bc066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:49:55.474 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.468+0000 7fc3c6ffd700 1 -- 172.21.15.26:0/1922007793 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fc3b8080b10 con 0x7fc3d00f5ef0 2021-11-03T18:49:55.474 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.469+0000 7fc3ce59c700 1 --2- 172.21.15.26:0/1922007793 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3bc0640b0 0x7fc3bc066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:49:55.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.469+0000 7fc3ce59c700 1 --2- 172.21.15.26:0/1922007793 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3bc0640b0 0x7fc3bc066570 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7fc3c0004630 tx=0x7fc3c0009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:49:55.475 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.473+0000 7fc3c6ffd700 1 -- 172.21.15.26:0/1922007793 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fc3b8052e70 con 0x7fc3d00f5ef0 2021-11-03T18:49:55.644 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.644+0000 7fc3d4b3a700 1 -- 172.21.15.26:0/1922007793 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3d005fe50 con 0x7fc3bc0640b0 2021-11-03T18:49:55.658 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.659+0000 7fc3c6ffd700 1 -- 172.21.15.26:0/1922007793 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7fc3d005fe50 con 0x7fc3bc0640b0 2021-11-03T18:49:55.659 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:49:55.659 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (2h) 9m ago 2h 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:49:55.659 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (113m) 9m ago 2h 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:49:55.659 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (113m) 8m ago 2h 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:49:55.660 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (2h) 9m ago 2h 42.4M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:49:55.660 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (114m) 9m ago 117m 26.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:49:55.660 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (114m) 9m ago 117m 27.0M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:49:55.660 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (117m) 8m ago 117m 27.2M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:49:55.660 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (117m) 8m ago 117m 27.6M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:49:55.661 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (114m) 9m ago 2h 615M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:49:55.661 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (114m) 8m ago 2h 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:49:55.661 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (114m) 9m ago 2h 407M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:49:55.661 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (113m) 8m ago 2h 187M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:49:55.661 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (2h) 9m ago 2h 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:49:55.662 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (2h) 8m ago 2h 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:49:55.662 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (112m) 9m ago 2h 372M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:49:55.662 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (112m) 9m ago 2h 400M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:49:55.662 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (111m) 9m ago 2h 332M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:49:55.663 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (111m) 8m ago 119m 438M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:49:55.663 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (111m) 8m ago 119m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:49:55.663 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (110m) 8m ago 119m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:49:55.663 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (2h) 9m ago 2h 70.2M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:49:55.664 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.660+0000 7fc3d4b3a700 1 -- 172.21.15.26:0/1922007793 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3bc0640b0 msgr2=0x7fc3bc066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:49:55.664 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.660+0000 7fc3d4b3a700 1 --2- 172.21.15.26:0/1922007793 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3bc0640b0 0x7fc3bc066570 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7fc3c0004630 tx=0x7fc3c0009b30).stop 2021-11-03T18:49:55.664 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.660+0000 7fc3d4b3a700 1 -- 172.21.15.26:0/1922007793 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3d00f5ef0 msgr2=0x7fc3d00f8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:49:55.665 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.660+0000 7fc3d4b3a700 1 --2- 172.21.15.26:0/1922007793 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3d00f5ef0 0x7fc3d00f8480 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 rx=0x7fc3b8002700 tx=0x7fc3b8009e00).stop 2021-11-03T18:49:55.665 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.661+0000 7fc3d4b3a700 1 -- 172.21.15.26:0/1922007793 shutdown_connections 2021-11-03T18:49:55.665 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.661+0000 7fc3d4b3a700 1 --2- 172.21.15.26:0/1922007793 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fc3bc0640b0 0x7fc3bc066570 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:55.665 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.661+0000 7fc3d4b3a700 1 --2- 172.21.15.26:0/1922007793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3d00f55e0 0x7fc3d00fa000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:55.666 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.661+0000 7fc3d4b3a700 1 --2- 172.21.15.26:0/1922007793 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3d00f5ef0 0x7fc3d00f8480 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:55.666 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.661+0000 7fc3d4b3a700 1 -- 172.21.15.26:0/1922007793 >> 172.21.15.26:0/1922007793 conn(0x7fc3d00f0de0 msgr2=0x7fc3d005f740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:49:55.666 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.661+0000 7fc3d4b3a700 1 -- 172.21.15.26:0/1922007793 shutdown_connections 2021-11-03T18:49:55.666 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.661+0000 7fc3d4b3a700 1 -- 172.21.15.26:0/1922007793 wait complete. 2021-11-03T18:49:55.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:55 smithi026 ceph-mon[96795]: poll took 60072.518 ms: 1 events 2021-11-03T18:49:55.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:55 smithi026 ceph-mon[96795]: pgmap v3457: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:55.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:49:55.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:49:55.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:49:55.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:49:55.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:49:55.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:49:55.677 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:55 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:49:55.677 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:49:55.677 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:55 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:49:55.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:55 smithi194 ceph-mon[65619]: poll took 60072.518 ms: 1 events 2021-11-03T18:49:55.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:55 smithi194 ceph-mon[65619]: pgmap v3457: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:55.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:49:55.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:49:55.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:49:55.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:49:55.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:49:55.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:49:55.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:55 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:49:55.754 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:49:55.754 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:55 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:49:55.759 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.759+0000 7f2514f38700 1 -- 172.21.15.26:0/164068433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25100f55e0 msgr2=0x7f25100f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:49:55.759 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.759+0000 7f2514f38700 1 --2- 172.21.15.26:0/164068433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25100f55e0 0x7f25100f5a00 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 rx=0x7f2500004660 tx=0x7f2500009b30).stop 2021-11-03T18:49:55.759 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.759+0000 7f2514f38700 1 -- 172.21.15.26:0/164068433 shutdown_connections 2021-11-03T18:49:55.759 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.759+0000 7f2514f38700 1 --2- 172.21.15.26:0/164068433 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25100f5ef0 0x7f25100f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-03T18:49:55.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.759+0000 7f2514f38700 1 --2- 172.21.15.26:0/164068433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25100f55e0 0x7f25100f5a00 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:55.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.759+0000 7f2514f38700 1 -- 172.21.15.26:0/164068433 >> 172.21.15.26:0/164068433 conn(0x7f25100f0de0 msgr2=0x7f25100f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:49:55.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.759+0000 7f2514f38700 1 -- 172.21.15.26:0/164068433 shutdown_connections 2021-11-03T18:49:55.760 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.759+0000 7f2514f38700 1 -- 172.21.15.26:0/164068433 wait complete. 2021-11-03T18:49:55.763 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.760+0000 7f2514f38700 1 Processor -- start 2021-11-03T18:49:55.763 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.760+0000 7f2514f38700 1 -- start start 2021-11-03T18:49:55.763 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.760+0000 7f2514f38700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25100f55e0 0x7f2510109c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:49:55.764 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.760+0000 7f2514f38700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25100f5ef0 0x7f251010c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:49:55.764 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.760+0000 7f2514f38700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25100605b0 con 0x7f25100f5ef0 2021-11-03T18:49:55.764 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.760+0000 7f2514f38700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25100606f0 con 0x7f25100f55e0 2021-11-03T18:49:55.764 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.760+0000 7f2505d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25100f5ef0 0x7f251010c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:49:55.765 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.760+0000 7f2505d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25100f5ef0 0x7f251010c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34012/0 (socket says 172.21.15.26:34012) 2021-11-03T18:49:55.765 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.760+0000 7f2505d9b700 1 -- 172.21.15.26:0/2960416424 learned_addr learned my addr 172.21.15.26:0/2960416424 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:49:55.765 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.761+0000 7f250e59c700 1 --2- 172.21.15.26:0/2960416424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25100f55e0 0x7f2510109c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:49:55.765 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.761+0000 7f2505d9b700 1 -- 172.21.15.26:0/2960416424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25100f55e0 msgr2=0x7f2510109c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:49:55.765 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.761+0000 7f2505d9b700 1 --2- 172.21.15.26:0/2960416424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25100f55e0 0x7f2510109c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:55.766 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.761+0000 7f2505d9b700 1 -- 172.21.15.26:0/2960416424 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2500005040 con 0x7f25100f5ef0 2021-11-03T18:49:55.766 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.761+0000 7f250e59c700 1 --2- 172.21.15.26:0/2960416424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25100f55e0 0x7f2510109c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:49:55.766 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.761+0000 7f2505d9b700 1 --2- 172.21.15.26:0/2960416424 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25100f5ef0 0x7f251010c130 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 rx=0x7f24f800b410 tx=0x7f24f8006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:49:55.766 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.761+0000 7f25077fe700 1 -- 172.21.15.26:0/2960416424 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24f80125f0 con 0x7f25100f5ef0 2021-11-03T18:49:55.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.761+0000 7f2514f38700 1 -- 172.21.15.26:0/2960416424 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f251010c790 con 0x7f25100f5ef0 2021-11-03T18:49:55.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.761+0000 7f25077fe700 1 -- 172.21.15.26:0/2960416424 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f24f8012c00 con 0x7f25100f5ef0 2021-11-03T18:49:55.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.761+0000 7f25077fe700 1 -- 172.21.15.26:0/2960416424 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24f8002ae0 con 0x7f25100f5ef0 2021-11-03T18:49:55.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.761+0000 7f2514f38700 1 -- 172.21.15.26:0/2960416424 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f251010cd50 con 0x7f25100f5ef0 2021-11-03T18:49:55.767 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.762+0000 7f2514f38700 1 -- 172.21.15.26:0/2960416424 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2510045ad0 con 0x7f25100f5ef0 2021-11-03T18:49:55.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.762+0000 7f25077fe700 1 -- 172.21.15.26:0/2960416424 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f24f800f030 con 0x7f25100f5ef0 2021-11-03T18:49:55.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.763+0000 7f25077fe700 1 --2- 172.21.15.26:0/2960416424 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f24fc0640b0 0x7f24fc066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:49:55.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.763+0000 7f25077fe700 1 -- 172.21.15.26:0/2960416424 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f24f8080c80 con 0x7f25100f5ef0 2021-11-03T18:49:55.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.763+0000 7f250e59c700 1 --2- 172.21.15.26:0/2960416424 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f24fc0640b0 0x7f24fc066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:49:55.768 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.763+0000 7f250e59c700 1 --2- 172.21.15.26:0/2960416424 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f24fc0640b0 0x7f24fc066570 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 rx=0x7f2500004e30 tx=0x7f2500009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:49:55.769 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.767+0000 7f25077fe700 1 -- 172.21.15.26:0/2960416424 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f24f8052fe0 con 0x7f25100f5ef0 2021-11-03T18:49:55.997 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.997+0000 7f2514f38700 1 -- 172.21.15.26:0/2960416424 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2510027a00 con 0x7f25100f5ef0 2021-11-03T18:49:55.997 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.998+0000 7f25077fe700 1 -- 172.21.15.26:0/2960416424 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7f24f8052bd0 con 0x7f25100f5ef0 2021-11-03T18:49:55.998 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:49:55.998 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:49:55.998 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:49:55.999 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:49:55.999 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:49:55.999 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:49:55.999 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:49:56.000 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:49:56.000 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:49:56.000 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:49:56.000 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:49:56.000 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:49:56.001 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:49:56.001 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:49:56.001 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:49:56.001 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:49:56.002 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:49:56.002 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:49:56.003 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.999+0000 7f2514f38700 1 -- 172.21.15.26:0/2960416424 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f24fc0640b0 msgr2=0x7f24fc066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:49:56.003 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.999+0000 7f2514f38700 1 --2- 172.21.15.26:0/2960416424 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f24fc0640b0 0x7f24fc066570 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 rx=0x7f2500004e30 tx=0x7f2500009b30).stop 2021-11-03T18:49:56.003 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.999+0000 7f2514f38700 1 -- 172.21.15.26:0/2960416424 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25100f5ef0 msgr2=0x7f251010c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:49:56.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.999+0000 7f2514f38700 1 --2- 172.21.15.26:0/2960416424 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25100f5ef0 0x7f251010c130 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 rx=0x7f24f800b410 tx=0x7f24f8006ef0).stop 2021-11-03T18:49:56.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.999+0000 7f2514f38700 1 -- 172.21.15.26:0/2960416424 shutdown_connections 2021-11-03T18:49:56.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.999+0000 7f2514f38700 1 --2- 172.21.15.26:0/2960416424 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f24fc0640b0 0x7f24fc066570 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:56.004 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.999+0000 7f2514f38700 1 --2- 172.21.15.26:0/2960416424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25100f55e0 0x7f2510109c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:56.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.999+0000 7f2514f38700 1 --2- 172.21.15.26:0/2960416424 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25100f5ef0 0x7f251010c130 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:56.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:55.999+0000 7f2514f38700 1 -- 172.21.15.26:0/2960416424 >> 172.21.15.26:0/2960416424 conn(0x7f25100f0de0 msgr2=0x7f25100fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:49:56.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.000+0000 7f2514f38700 1 -- 172.21.15.26:0/2960416424 shutdown_connections 2021-11-03T18:49:56.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.000+0000 7f2514f38700 1 -- 172.21.15.26:0/2960416424 wait complete. 2021-11-03T18:49:56.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.100+0000 7ff038b07700 1 -- 172.21.15.26:0/1233486297 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0340f66d0 msgr2=0x7ff0340f6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:49:56.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.100+0000 7ff038b07700 1 --2- 172.21.15.26:0/1233486297 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0340f66d0 0x7ff0340f6af0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 rx=0x7ff024004660 tx=0x7ff024009b30).stop 2021-11-03T18:49:56.103 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.100+0000 7ff038b07700 1 -- 172.21.15.26:0/1233486297 shutdown_connections 2021-11-03T18:49:56.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.100+0000 7ff038b07700 1 --2- 172.21.15.26:0/1233486297 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0340f7970 0x7ff0340f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:56.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.100+0000 7ff038b07700 1 --2- 172.21.15.26:0/1233486297 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0340f66d0 0x7ff0340f6af0 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:56.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.100+0000 7ff038b07700 1 -- 172.21.15.26:0/1233486297 >> 172.21.15.26:0/1233486297 conn(0x7ff0340f1e10 msgr2=0x7ff0340f4250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:49:56.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.100+0000 7ff038b07700 1 -- 172.21.15.26:0/1233486297 shutdown_connections 2021-11-03T18:49:56.104 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.100+0000 7ff038b07700 1 -- 172.21.15.26:0/1233486297 wait complete. 2021-11-03T18:49:56.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.100+0000 7ff038b07700 1 Processor -- start 2021-11-03T18:49:56.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.100+0000 7ff038b07700 1 -- start start 2021-11-03T18:49:56.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.101+0000 7ff038b07700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0340f66d0 0x7ff03406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:49:56.105 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.101+0000 7ff038b07700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0340f7970 0x7ff034069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:49:56.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.101+0000 7ff038b07700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03406a380 con 0x7ff0340f7970 2021-11-03T18:49:56.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.101+0000 7ff038b07700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03406a4c0 con 0x7ff0340f66d0 2021-11-03T18:49:56.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.101+0000 7ff031d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0340f7970 0x7ff034069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:49:56.106 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.101+0000 7ff031d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0340f7970 0x7ff034069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34022/0 (socket says 172.21.15.26:34022) 2021-11-03T18:49:56.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.101+0000 7ff031d9b700 1 -- 172.21.15.26:0/1242547350 learned_addr learned my addr 172.21.15.26:0/1242547350 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:49:56.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.101+0000 7ff03259c700 1 --2- 172.21.15.26:0/1242547350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0340f66d0 0x7ff03406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:49:56.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.101+0000 7ff031d9b700 1 -- 172.21.15.26:0/1242547350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0340f66d0 msgr2=0x7ff03406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:49:56.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.101+0000 7ff031d9b700 1 --2- 172.21.15.26:0/1242547350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0340f66d0 0x7ff03406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:56.107 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.101+0000 7ff031d9b700 1 -- 172.21.15.26:0/1242547350 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff024005040 con 0x7ff0340f7970 2021-11-03T18:49:56.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.101+0000 7ff031d9b700 1 --2- 172.21.15.26:0/1242547350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0340f7970 0x7ff034069e20 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 rx=0x7ff01c00c530 tx=0x7ff01c007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:49:56.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.101+0000 7ff02affd700 1 -- 172.21.15.26:0/1242547350 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff01c00f650 con 0x7ff0340f7970 2021-11-03T18:49:56.108 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.101+0000 7ff02affd700 1 -- 172.21.15.26:0/1242547350 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff01c00fc60 con 0x7ff0340f7970 2021-11-03T18:49:56.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.101+0000 7ff038b07700 1 -- 172.21.15.26:0/1242547350 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff03406a7a0 con 0x7ff0340f7970 2021-11-03T18:49:56.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.101+0000 7ff02affd700 1 -- 172.21.15.26:0/1242547350 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff01c012cd0 con 0x7ff0340f7970 2021-11-03T18:49:56.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.101+0000 7ff038b07700 1 -- 172.21.15.26:0/1242547350 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff03410efa0 con 0x7ff0340f7970 2021-11-03T18:49:56.109 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.102+0000 7ff038b07700 1 -- 172.21.15.26:0/1242547350 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff034045ad0 con 0x7ff0340f7970 2021-11-03T18:49:56.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.103+0000 7ff02affd700 1 -- 172.21.15.26:0/1242547350 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7ff01c010070 con 0x7ff0340f7970 2021-11-03T18:49:56.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.103+0000 7ff02affd700 1 --2- 172.21.15.26:0/1242547350 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff0200640b0 0x7ff020066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:49:56.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.103+0000 7ff02affd700 1 -- 172.21.15.26:0/1242547350 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7ff01c0806e0 con 0x7ff0340f7970 2021-11-03T18:49:56.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.103+0000 7ff03259c700 1 --2- 172.21.15.26:0/1242547350 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff0200640b0 0x7ff020066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:49:56.110 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.104+0000 7ff03259c700 1 --2- 172.21.15.26:0/1242547350 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff0200640b0 0x7ff020066570 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7ff024004e30 tx=0x7ff024009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:49:56.111 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.107+0000 7ff02affd700 1 -- 172.21.15.26:0/1242547350 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7ff01c052950 con 0x7ff0340f7970 2021-11-03T18:49:56.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.312+0000 7ff038b07700 1 -- 172.21.15.26:0/1242547350 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff034027a00 con 0x7ff0340f7970 2021-11-03T18:49:56.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.312+0000 7ff02affd700 1 -- 172.21.15.26:0/1242547350 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7ff01c052540 con 0x7ff0340f7970 2021-11-03T18:49:56.312 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:49:56.313 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:49:56.313 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:49:56.313 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:49:56.313 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:49:56.314 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:49:56.314 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:49:56.314 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:49:56.314 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:49:56.315 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:49:56.315 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:49:56.315 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:49:56.315 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:49:56.315 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:49:56.316 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:49:56.316 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:49:56.316 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:49:56.316 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:49:56.317 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:49:56.317 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:49:56.317 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:49:56.317 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:49:56.318 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:49:56.318 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:49:56.318 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:49:56.318 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:49:56.318 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:49:56.319 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:49:56.319 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:49:56.319 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:49:56.319 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:49:56.320 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:49:56.320 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:49:56.320 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:49:56.320 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:49:56.320 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:49:56.321 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:49:56.321 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:49:56.321 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:49:56.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.314+0000 7ff038b07700 1 -- 172.21.15.26:0/1242547350 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff0200640b0 msgr2=0x7ff020066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:49:56.322 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.314+0000 7ff038b07700 1 --2- 172.21.15.26:0/1242547350 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff0200640b0 0x7ff020066570 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7ff024004e30 tx=0x7ff024009b30).stop 2021-11-03T18:49:56.323 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.314+0000 7ff038b07700 1 -- 172.21.15.26:0/1242547350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0340f7970 msgr2=0x7ff034069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:49:56.323 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.314+0000 7ff038b07700 1 --2- 172.21.15.26:0/1242547350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0340f7970 0x7ff034069e20 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 rx=0x7ff01c00c530 tx=0x7ff01c007e20).stop 2021-11-03T18:49:56.323 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.314+0000 7ff038b07700 1 -- 172.21.15.26:0/1242547350 shutdown_connections 2021-11-03T18:49:56.323 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.314+0000 7ff038b07700 1 --2- 172.21.15.26:0/1242547350 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7ff0200640b0 0x7ff020066570 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:56.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.314+0000 7ff038b07700 1 --2- 172.21.15.26:0/1242547350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0340f66d0 0x7ff03406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:56.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.314+0000 7ff038b07700 1 --2- 172.21.15.26:0/1242547350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0340f7970 0x7ff034069e20 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:49:56.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.314+0000 7ff038b07700 1 -- 172.21.15.26:0/1242547350 >> 172.21.15.26:0/1242547350 conn(0x7ff0340f1e10 msgr2=0x7ff0340fb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:49:56.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.314+0000 7ff038b07700 1 -- 172.21.15.26:0/1242547350 shutdown_connections 2021-11-03T18:49:56.324 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:49:56.314+0000 7ff038b07700 1 -- 172.21.15.26:0/1242547350 wait complete. 2021-11-03T18:49:56.325 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:49:56.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:56 smithi026 ceph-mon[96795]: from='client.37692 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:49:56.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:56 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2960416424' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:49:56.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:56 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1242547350' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:49:56.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:56 smithi194 ceph-mon[65619]: from='client.37692 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:49:56.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:56 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2960416424' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:49:56.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:56 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1242547350' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:49:57.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:57 smithi026 ceph-mon[96795]: from='client.37696 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:49:57.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:57 smithi026 ceph-mon[96795]: pgmap v3458: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:57.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:57 smithi194 ceph-mon[65619]: from='client.37696 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:49:57.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:57 smithi194 ceph-mon[65619]: pgmap v3458: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:59.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:49:59 smithi026 ceph-mon[96795]: pgmap v3459: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:49:59.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:49:59 smithi194 ceph-mon[65619]: pgmap v3459: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:00.365 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:00 smithi026 conmon[96772]: 2021-11-03T18:49:59.999+0000 7f27986f6700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 2 daemons have recently crashed 2021-11-03T18:50:00.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:00 smithi026 ceph-mon[96795]: overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 2 daemons have recently crashed 2021-11-03T18:50:00.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:00 smithi194 ceph-mon[65619]: overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 2 daemons have recently crashed 2021-11-03T18:50:01.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:01 smithi026 ceph-mon[96795]: pgmap v3460: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:01.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:01 smithi194 ceph-mon[65619]: pgmap v3460: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:03.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:03 smithi026 ceph-mon[96795]: pgmap v3461: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:03.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:03 smithi194 ceph-mon[65619]: pgmap v3461: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:05.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:05 smithi026 ceph-mon[96795]: pgmap v3462: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:05.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:05 smithi194 ceph-mon[65619]: pgmap v3462: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:07.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:07 smithi026 ceph-mon[96795]: pgmap v3463: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:07.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:07 smithi194 ceph-mon[65619]: pgmap v3463: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:09.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:09 smithi026 ceph-mon[96795]: pgmap v3464: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:09.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:09 smithi194 ceph-mon[65619]: pgmap v3464: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:10.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:10 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:50:10.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:10 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:50:10.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:10 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:50:10.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:10 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:50:11.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:11 smithi026 ceph-mon[96795]: pgmap v3465: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:11.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:11 smithi194 ceph-mon[65619]: pgmap v3465: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:13.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:13 smithi026 ceph-mon[96795]: pgmap v3466: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:13.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:13 smithi194 ceph-mon[65619]: pgmap v3466: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:15.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:15 smithi026 ceph-mon[96795]: pgmap v3467: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:15.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:15 smithi194 ceph-mon[65619]: pgmap v3467: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:17.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:17 smithi026 ceph-mon[96795]: pgmap v3468: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:17.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:17 smithi194 ceph-mon[65619]: pgmap v3468: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:19.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:19 smithi026 ceph-mon[96795]: pgmap v3469: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:19.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:19 smithi194 ceph-mon[65619]: pgmap v3469: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:21.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:21 smithi194 ceph-mon[65619]: pgmap v3470: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:21.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:21 smithi026 ceph-mon[96795]: pgmap v3470: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:23.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:23 smithi026 ceph-mon[96795]: pgmap v3471: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:23.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:23 smithi194 ceph-mon[65619]: pgmap v3471: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:25.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:25 smithi026 ceph-mon[96795]: pgmap v3472: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:25.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:25 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:50:25.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:25 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:50:25.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:25 smithi194 ceph-mon[65619]: pgmap v3472: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:25.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:25 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:50:25.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:25 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:50:26.432 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.431+0000 7f94da9b8700 1 -- 172.21.15.26:0/1435818269 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d40f6ff0 msgr2=0x7f94d40f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:50:26.432 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.431+0000 7f94da9b8700 1 --2- 172.21.15.26:0/1435818269 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d40f6ff0 0x7f94d40f7a20 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 rx=0x7f94bc004660 tx=0x7f94bc009b30).stop 2021-11-03T18:50:26.433 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.431+0000 7f94da9b8700 1 -- 172.21.15.26:0/1435818269 shutdown_connections 2021-11-03T18:50:26.433 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.431+0000 7f94da9b8700 1 --2- 172.21.15.26:0/1435818269 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d40f6ff0 0x7f94d40f7a20 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:26.433 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.431+0000 7f94da9b8700 1 --2- 172.21.15.26:0/1435818269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94d40f66e0 0x7f94d40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:26.434 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.431+0000 7f94da9b8700 1 -- 172.21.15.26:0/1435818269 >> 172.21.15.26:0/1435818269 conn(0x7f94d40f1f00 msgr2=0x7f94d40f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:50:26.434 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.431+0000 7f94da9b8700 1 -- 172.21.15.26:0/1435818269 shutdown_connections 2021-11-03T18:50:26.434 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.431+0000 7f94da9b8700 1 -- 172.21.15.26:0/1435818269 wait complete. 2021-11-03T18:50:26.434 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.432+0000 7f94da9b8700 1 Processor -- start 2021-11-03T18:50:26.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.432+0000 7f94da9b8700 1 -- start start 2021-11-03T18:50:26.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.432+0000 7f94da9b8700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94d40f66e0 0x7f94d4106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:50:26.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.432+0000 7f94da9b8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d40f6ff0 0x7f94d4107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:50:26.435 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.432+0000 7f94da9b8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d4107a10 con 0x7f94d40f6ff0 2021-11-03T18:50:26.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.432+0000 7f94da9b8700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d4107b50 con 0x7f94d40f66e0 2021-11-03T18:50:26.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.432+0000 7f94d37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d40f6ff0 0x7f94d4107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:50:26.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.432+0000 7f94d37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d40f6ff0 0x7f94d4107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34040/0 (socket says 172.21.15.26:34040) 2021-11-03T18:50:26.436 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.432+0000 7f94d37fe700 1 -- 172.21.15.26:0/2684460312 learned_addr learned my addr 172.21.15.26:0/2684460312 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:50:26.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.433+0000 7f94d3fff700 1 --2- 172.21.15.26:0/2684460312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94d40f66e0 0x7f94d4106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:50:26.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.433+0000 7f94d37fe700 1 -- 172.21.15.26:0/2684460312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94d40f66e0 msgr2=0x7f94d4106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:50:26.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.433+0000 7f94d37fe700 1 --2- 172.21.15.26:0/2684460312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94d40f66e0 0x7f94d4106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:26.437 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.433+0000 7f94d37fe700 1 -- 172.21.15.26:0/2684460312 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94bc005040 con 0x7f94d40f6ff0 2021-11-03T18:50:26.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.433+0000 7f94d3fff700 1 --2- 172.21.15.26:0/2684460312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94d40f66e0 0x7f94d4106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:50:26.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.433+0000 7f94d37fe700 1 --2- 172.21.15.26:0/2684460312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d40f6ff0 0x7f94d4107460 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 rx=0x7f94bc009990 tx=0x7f94bc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:50:26.438 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.433+0000 7f94d0ff9700 1 -- 172.21.15.26:0/2684460312 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94bc018070 con 0x7f94d40f6ff0 2021-11-03T18:50:26.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.433+0000 7f94da9b8700 1 -- 172.21.15.26:0/2684460312 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94d4108490 con 0x7f94d40f6ff0 2021-11-03T18:50:26.439 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.433+0000 7f94da9b8700 1 -- 172.21.15.26:0/2684460312 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94d41089f0 con 0x7f94d40f6ff0 2021-11-03T18:50:26.440 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.433+0000 7f94d0ff9700 1 -- 172.21.15.26:0/2684460312 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f94bc007ba0 con 0x7f94d40f6ff0 2021-11-03T18:50:26.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.433+0000 7f94d0ff9700 1 -- 172.21.15.26:0/2684460312 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94bc01dd70 con 0x7f94d40f6ff0 2021-11-03T18:50:26.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.434+0000 7f94da9b8700 1 -- 172.21.15.26:0/2684460312 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94d4045ad0 con 0x7f94d40f6ff0 2021-11-03T18:50:26.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.435+0000 7f94d0ff9700 1 -- 172.21.15.26:0/2684460312 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f94bc01d420 con 0x7f94d40f6ff0 2021-11-03T18:50:26.441 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.435+0000 7f94d0ff9700 1 --2- 172.21.15.26:0/2684460312 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f94c00640b0 0x7f94c0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:50:26.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.435+0000 7f94d0ff9700 1 -- 172.21.15.26:0/2684460312 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f94bc0821f0 con 0x7f94d40f6ff0 2021-11-03T18:50:26.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.435+0000 7f94d3fff700 1 --2- 172.21.15.26:0/2684460312 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f94c00640b0 0x7f94c0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:50:26.442 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.436+0000 7f94d3fff700 1 --2- 172.21.15.26:0/2684460312 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f94c00640b0 0x7f94c0066570 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7f94c4009fd0 tx=0x7f94c400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:50:26.443 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.440+0000 7f94d0ff9700 1 -- 172.21.15.26:0/2684460312 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f94bc0544f0 con 0x7f94d40f6ff0 2021-11-03T18:50:26.616 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.617+0000 7f94da9b8700 1 -- 172.21.15.26:0/2684460312 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f94d4108c60 con 0x7f94c00640b0 2021-11-03T18:50:26.617 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.619+0000 7f94d0ff9700 1 -- 172.21.15.26:0/2684460312 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f94d4108c60 con 0x7f94c00640b0 2021-11-03T18:50:26.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.620+0000 7f94da9b8700 1 -- 172.21.15.26:0/2684460312 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f94c00640b0 msgr2=0x7f94c0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:50:26.619 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.621+0000 7f94da9b8700 1 --2- 172.21.15.26:0/2684460312 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f94c00640b0 0x7f94c0066570 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7f94c4009fd0 tx=0x7f94c400b040).stop 2021-11-03T18:50:26.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.621+0000 7f94da9b8700 1 -- 172.21.15.26:0/2684460312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d40f6ff0 msgr2=0x7f94d4107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:50:26.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.621+0000 7f94da9b8700 1 --2- 172.21.15.26:0/2684460312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d40f6ff0 0x7f94d4107460 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 rx=0x7f94bc009990 tx=0x7f94bc009b30).stop 2021-11-03T18:50:26.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.621+0000 7f94da9b8700 1 -- 172.21.15.26:0/2684460312 shutdown_connections 2021-11-03T18:50:26.620 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.621+0000 7f94da9b8700 1 --2- 172.21.15.26:0/2684460312 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f94c00640b0 0x7f94c0066570 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:26.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.621+0000 7f94da9b8700 1 --2- 172.21.15.26:0/2684460312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94d40f66e0 0x7f94d4106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:26.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.621+0000 7f94da9b8700 1 --2- 172.21.15.26:0/2684460312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d40f6ff0 0x7f94d4107460 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:26.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.621+0000 7f94da9b8700 1 -- 172.21.15.26:0/2684460312 >> 172.21.15.26:0/2684460312 conn(0x7f94d40f1f00 msgr2=0x7f94d40fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:50:26.621 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.621+0000 7f94da9b8700 1 -- 172.21.15.26:0/2684460312 shutdown_connections 2021-11-03T18:50:26.622 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.621+0000 7f94da9b8700 1 -- 172.21.15.26:0/2684460312 wait complete. 2021-11-03T18:50:26.629 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:50:26.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.721+0000 7fee4ad5a700 1 -- 172.21.15.26:0/2787046052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee440f55c0 msgr2=0x7fee440f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:50:26.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.721+0000 7fee4ad5a700 1 --2- 172.21.15.26:0/2787046052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee440f55c0 0x7fee440f59e0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 rx=0x7fee3c0099e0 tx=0x7fee3c004d10).stop 2021-11-03T18:50:26.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.721+0000 7fee4ad5a700 1 -- 172.21.15.26:0/2787046052 shutdown_connections 2021-11-03T18:50:26.721 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.721+0000 7fee4ad5a700 1 --2- 172.21.15.26:0/2787046052 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee440f6860 0x7fee440f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:26.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.721+0000 7fee4ad5a700 1 --2- 172.21.15.26:0/2787046052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee440f55c0 0x7fee440f59e0 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:26.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.721+0000 7fee4ad5a700 1 -- 172.21.15.26:0/2787046052 >> 172.21.15.26:0/2787046052 conn(0x7fee440f0d40 msgr2=0x7fee440f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:50:26.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.721+0000 7fee4ad5a700 1 -- 172.21.15.26:0/2787046052 shutdown_connections 2021-11-03T18:50:26.722 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.721+0000 7fee4ad5a700 1 -- 172.21.15.26:0/2787046052 wait complete. 2021-11-03T18:50:26.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.721+0000 7fee4ad5a700 1 Processor -- start 2021-11-03T18:50:26.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.721+0000 7fee4ad5a700 1 -- start start 2021-11-03T18:50:26.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.722+0000 7fee4ad5a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee440f55c0 0x7fee44109270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:50:26.723 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.722+0000 7fee4ad5a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee440f6860 0x7fee44109760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:50:26.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.722+0000 7fee4ad5a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee44109d10 con 0x7fee440f6860 2021-11-03T18:50:26.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.722+0000 7fee4ad5a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee44109e50 con 0x7fee440f55c0 2021-11-03T18:50:26.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.722+0000 7fee43fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee440f6860 0x7fee44109760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:50:26.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.722+0000 7fee43fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee440f6860 0x7fee44109760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34050/0 (socket says 172.21.15.26:34050) 2021-11-03T18:50:26.724 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.722+0000 7fee43fff700 1 -- 172.21.15.26:0/3254255538 learned_addr learned my addr 172.21.15.26:0/3254255538 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:50:26.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.722+0000 7fee48af6700 1 --2- 172.21.15.26:0/3254255538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee440f55c0 0x7fee44109270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:50:26.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.722+0000 7fee43fff700 1 -- 172.21.15.26:0/3254255538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee440f55c0 msgr2=0x7fee44109270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:50:26.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.722+0000 7fee43fff700 1 --2- 172.21.15.26:0/3254255538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee440f55c0 0x7fee44109270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:26.725 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.722+0000 7fee43fff700 1 -- 172.21.15.26:0/3254255538 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee3c009640 con 0x7fee440f6860 2021-11-03T18:50:26.726 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.722+0000 7fee43fff700 1 --2- 172.21.15.26:0/3254255538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee440f6860 0x7fee44109760 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 rx=0x7fee2c0026d0 tx=0x7fee2c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:50:26.726 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.722+0000 7fee417fa700 1 -- 172.21.15.26:0/3254255538 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee2c0079c0 con 0x7fee440f6860 2021-11-03T18:50:26.726 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.722+0000 7fee417fa700 1 -- 172.21.15.26:0/3254255538 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fee2c00f040 con 0x7fee440f6860 2021-11-03T18:50:26.726 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.722+0000 7fee4ad5a700 1 -- 172.21.15.26:0/3254255538 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee4410a7f0 con 0x7fee440f6860 2021-11-03T18:50:26.727 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.722+0000 7fee417fa700 1 -- 172.21.15.26:0/3254255538 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee2c0148b0 con 0x7fee440f6860 2021-11-03T18:50:26.727 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.723+0000 7fee4ad5a700 1 -- 172.21.15.26:0/3254255538 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee4410ad30 con 0x7fee440f6860 2021-11-03T18:50:26.728 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.723+0000 7fee4ad5a700 1 -- 172.21.15.26:0/3254255538 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee44045ad0 con 0x7fee440f6860 2021-11-03T18:50:26.728 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.724+0000 7fee417fa700 1 -- 172.21.15.26:0/3254255538 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fee2c007b20 con 0x7fee440f6860 2021-11-03T18:50:26.728 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.724+0000 7fee417fa700 1 --2- 172.21.15.26:0/3254255538 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fee300640b0 0x7fee30066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:50:26.729 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.724+0000 7fee417fa700 1 -- 172.21.15.26:0/3254255538 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fee2c080730 con 0x7fee440f6860 2021-11-03T18:50:26.729 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.724+0000 7fee48af6700 1 --2- 172.21.15.26:0/3254255538 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fee300640b0 0x7fee30066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:50:26.729 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.725+0000 7fee48af6700 1 --2- 172.21.15.26:0/3254255538 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fee300640b0 0x7fee30066570 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 rx=0x7fee3c00b730 tx=0x7fee3c004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:50:26.729 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.728+0000 7fee417fa700 1 -- 172.21.15.26:0/3254255538 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fee2c052a90 con 0x7fee440f6860 2021-11-03T18:50:26.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.902+0000 7fee4ad5a700 1 -- 172.21.15.26:0/3254255538 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fee440faaa0 con 0x7fee300640b0 2021-11-03T18:50:26.915 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.917+0000 7fee417fa700 1 -- 172.21.15.26:0/3254255538 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7fee440faaa0 con 0x7fee300640b0 2021-11-03T18:50:26.916 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:50:26.916 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (2h) 9m ago 2h 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:50:26.916 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (113m) 9m ago 2h 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:50:26.916 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (113m) 8m ago 2h 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:50:26.917 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (2h) 9m ago 2h 42.4M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:50:26.917 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (114m) 9m ago 118m 26.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:50:26.917 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (114m) 9m ago 117m 27.0M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:50:26.917 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (118m) 8m ago 118m 27.2M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:50:26.918 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (118m) 8m ago 118m 27.6M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:50:26.918 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (115m) 9m ago 2h 615M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:50:26.918 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (115m) 8m ago 2h 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:50:26.918 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (114m) 9m ago 2h 407M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:50:26.919 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (114m) 8m ago 2h 187M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:50:26.919 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (2h) 9m ago 2h 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:50:26.919 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (2h) 8m ago 2h 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:50:26.919 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (113m) 9m ago 2h 372M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:50:26.919 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (112m) 9m ago 2h 400M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:50:26.920 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (112m) 9m ago 2h 332M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:50:26.920 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (111m) 8m ago 2h 438M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:50:26.920 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (111m) 8m ago 119m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:50:26.920 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (111m) 8m ago 119m 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:50:26.921 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (2h) 9m ago 2h 70.2M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:50:26.921 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.919+0000 7fee4ad5a700 1 -- 172.21.15.26:0/3254255538 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fee300640b0 msgr2=0x7fee30066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:50:26.922 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.919+0000 7fee4ad5a700 1 --2- 172.21.15.26:0/3254255538 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fee300640b0 0x7fee30066570 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 rx=0x7fee3c00b730 tx=0x7fee3c004d10).stop 2021-11-03T18:50:26.922 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.919+0000 7fee4ad5a700 1 -- 172.21.15.26:0/3254255538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee440f6860 msgr2=0x7fee44109760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:50:26.922 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.919+0000 7fee4ad5a700 1 --2- 172.21.15.26:0/3254255538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee440f6860 0x7fee44109760 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 rx=0x7fee2c0026d0 tx=0x7fee2c009de0).stop 2021-11-03T18:50:26.922 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.919+0000 7fee4ad5a700 1 -- 172.21.15.26:0/3254255538 shutdown_connections 2021-11-03T18:50:26.923 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.919+0000 7fee4ad5a700 1 --2- 172.21.15.26:0/3254255538 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fee300640b0 0x7fee30066570 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:26.923 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.919+0000 7fee4ad5a700 1 --2- 172.21.15.26:0/3254255538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee440f55c0 0x7fee44109270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:26.923 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.919+0000 7fee4ad5a700 1 --2- 172.21.15.26:0/3254255538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee440f6860 0x7fee44109760 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:26.923 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.919+0000 7fee4ad5a700 1 -- 172.21.15.26:0/3254255538 >> 172.21.15.26:0/3254255538 conn(0x7fee440f0d40 msgr2=0x7fee4405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:50:26.924 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.919+0000 7fee4ad5a700 1 -- 172.21.15.26:0/3254255538 shutdown_connections 2021-11-03T18:50:26.924 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:26.919+0000 7fee4ad5a700 1 -- 172.21.15.26:0/3254255538 wait complete. 2021-11-03T18:50:27.019 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.018+0000 7fdfc529c700 1 -- 172.21.15.26:0/3952617084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfc00f6ff0 msgr2=0x7fdfc00f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:50:27.019 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.018+0000 7fdfc529c700 1 --2- 172.21.15.26:0/3952617084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfc00f6ff0 0x7fdfc00f7a20 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 rx=0x7fdfa8004660 tx=0x7fdfa8009b30).stop 2021-11-03T18:50:27.019 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.018+0000 7fdfc529c700 1 -- 172.21.15.26:0/3952617084 shutdown_connections 2021-11-03T18:50:27.019 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.018+0000 7fdfc529c700 1 --2- 172.21.15.26:0/3952617084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfc00f6ff0 0x7fdfc00f7a20 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:27.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.018+0000 7fdfc529c700 1 --2- 172.21.15.26:0/3952617084 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdfc00f66e0 0x7fdfc00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:27.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.018+0000 7fdfc529c700 1 -- 172.21.15.26:0/3952617084 >> 172.21.15.26:0/3952617084 conn(0x7fdfc00f1f00 msgr2=0x7fdfc00f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:50:27.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.018+0000 7fdfc529c700 1 -- 172.21.15.26:0/3952617084 shutdown_connections 2021-11-03T18:50:27.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.018+0000 7fdfc529c700 1 -- 172.21.15.26:0/3952617084 wait complete. 2021-11-03T18:50:27.020 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.019+0000 7fdfc529c700 1 Processor -- start 2021-11-03T18:50:27.021 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.019+0000 7fdfc529c700 1 -- start start 2021-11-03T18:50:27.021 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.019+0000 7fdfc529c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdfc00f66e0 0x7fdfc0106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:50:27.021 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.019+0000 7fdfc529c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfc00f6ff0 0x7fdfc0107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:50:27.021 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.019+0000 7fdfc529c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc0107a10 con 0x7fdfc00f6ff0 2021-11-03T18:50:27.021 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.019+0000 7fdfc529c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc0107b50 con 0x7fdfc00f66e0 2021-11-03T18:50:27.022 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.019+0000 7fdfbe7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfc00f6ff0 0x7fdfc0107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:50:27.022 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.019+0000 7fdfbe7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfc00f6ff0 0x7fdfc0107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34060/0 (socket says 172.21.15.26:34060) 2021-11-03T18:50:27.022 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.019+0000 7fdfbe7fc700 1 -- 172.21.15.26:0/2104910779 learned_addr learned my addr 172.21.15.26:0/2104910779 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:50:27.022 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.020+0000 7fdfbe7fc700 1 -- 172.21.15.26:0/2104910779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdfc00f66e0 msgr2=0x7fdfc0106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:50:27.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.020+0000 7fdfbeffd700 1 --2- 172.21.15.26:0/2104910779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdfc00f66e0 0x7fdfc0106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:50:27.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.020+0000 7fdfbe7fc700 1 --2- 172.21.15.26:0/2104910779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdfc00f66e0 0x7fdfc0106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:27.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.020+0000 7fdfbe7fc700 1 -- 172.21.15.26:0/2104910779 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa8005040 con 0x7fdfc00f6ff0 2021-11-03T18:50:27.023 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.020+0000 7fdfbeffd700 1 --2- 172.21.15.26:0/2104910779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdfc00f66e0 0x7fdfc0106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:50:27.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.020+0000 7fdfbe7fc700 1 --2- 172.21.15.26:0/2104910779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfc00f6ff0 0x7fdfc0107460 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 rx=0x7fdfa8009990 tx=0x7fdfa8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:50:27.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.020+0000 7fdfb77fe700 1 -- 172.21.15.26:0/2104910779 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfa8018070 con 0x7fdfc00f6ff0 2021-11-03T18:50:27.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.020+0000 7fdfb77fe700 1 -- 172.21.15.26:0/2104910779 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdfa8007ca0 con 0x7fdfc00f6ff0 2021-11-03T18:50:27.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.020+0000 7fdfc529c700 1 -- 172.21.15.26:0/2104910779 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc0108490 con 0x7fdfc00f6ff0 2021-11-03T18:50:27.024 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.020+0000 7fdfb77fe700 1 -- 172.21.15.26:0/2104910779 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfa801c620 con 0x7fdfc00f6ff0 2021-11-03T18:50:27.025 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.020+0000 7fdfc529c700 1 -- 172.21.15.26:0/2104910779 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc01089f0 con 0x7fdfc00f6ff0 2021-11-03T18:50:27.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.021+0000 7fdfc529c700 1 -- 172.21.15.26:0/2104910779 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc0045ad0 con 0x7fdfc00f6ff0 2021-11-03T18:50:27.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.021+0000 7fdfb77fe700 1 -- 172.21.15.26:0/2104910779 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fdfa801d960 con 0x7fdfc00f6ff0 2021-11-03T18:50:27.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.022+0000 7fdfb77fe700 1 --2- 172.21.15.26:0/2104910779 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdfac0640b0 0x7fdfac066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:50:27.026 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.022+0000 7fdfb77fe700 1 -- 172.21.15.26:0/2104910779 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fdfa8082540 con 0x7fdfc00f6ff0 2021-11-03T18:50:27.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.022+0000 7fdfbeffd700 1 --2- 172.21.15.26:0/2104910779 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdfac0640b0 0x7fdfac066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:50:27.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.022+0000 7fdfbeffd700 1 --2- 172.21.15.26:0/2104910779 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdfac0640b0 0x7fdfac066570 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7fdfb8004fd0 tx=0x7fdfb8009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:50:27.027 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.026+0000 7fdfb77fe700 1 -- 172.21.15.26:0/2104910779 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fdfa8054960 con 0x7fdfc00f6ff0 2021-11-03T18:50:27.251 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.253+0000 7fdfc529c700 1 -- 172.21.15.26:0/2104910779 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdfc0027a00 con 0x7fdfc00f6ff0 2021-11-03T18:50:27.252 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.253+0000 7fdfb77fe700 1 -- 172.21.15.26:0/2104910779 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fdfa8054550 con 0x7fdfc00f6ff0 2021-11-03T18:50:27.252 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:50:27.252 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:50:27.253 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:50:27.253 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:50:27.253 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:50:27.253 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:50:27.253 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:50:27.254 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:50:27.254 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:50:27.254 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:50:27.254 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:50:27.254 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:50:27.255 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:50:27.255 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:50:27.255 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:50:27.255 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:50:27.256 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:50:27.256 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:50:27.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.255+0000 7fdfc529c700 1 -- 172.21.15.26:0/2104910779 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdfac0640b0 msgr2=0x7fdfac066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:50:27.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.255+0000 7fdfc529c700 1 --2- 172.21.15.26:0/2104910779 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdfac0640b0 0x7fdfac066570 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7fdfb8004fd0 tx=0x7fdfb8009040).stop 2021-11-03T18:50:27.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.255+0000 7fdfc529c700 1 -- 172.21.15.26:0/2104910779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfc00f6ff0 msgr2=0x7fdfc0107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:50:27.257 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.255+0000 7fdfc529c700 1 --2- 172.21.15.26:0/2104910779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfc00f6ff0 0x7fdfc0107460 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 rx=0x7fdfa8009990 tx=0x7fdfa8009b30).stop 2021-11-03T18:50:27.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.255+0000 7fdfc529c700 1 -- 172.21.15.26:0/2104910779 shutdown_connections 2021-11-03T18:50:27.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.255+0000 7fdfc529c700 1 --2- 172.21.15.26:0/2104910779 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fdfac0640b0 0x7fdfac066570 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:27.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.255+0000 7fdfc529c700 1 --2- 172.21.15.26:0/2104910779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdfc00f66e0 0x7fdfc0106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:27.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.255+0000 7fdfc529c700 1 --2- 172.21.15.26:0/2104910779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfc00f6ff0 0x7fdfc0107460 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:27.258 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.255+0000 7fdfc529c700 1 -- 172.21.15.26:0/2104910779 >> 172.21.15.26:0/2104910779 conn(0x7fdfc00f1f00 msgr2=0x7fdfc00fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:50:27.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.255+0000 7fdfc529c700 1 -- 172.21.15.26:0/2104910779 shutdown_connections 2021-11-03T18:50:27.259 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.255+0000 7fdfc529c700 1 -- 172.21.15.26:0/2104910779 wait complete. 2021-11-03T18:50:27.356 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.356+0000 7fee0052a700 1 -- 172.21.15.26:0/3791559882 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedf80f66e0 msgr2=0x7fedf80f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:50:27.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.356+0000 7fee0052a700 1 --2- 172.21.15.26:0/3791559882 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedf80f66e0 0x7fedf80f6b00 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 rx=0x7fedf00099e0 tx=0x7fedf0004d10).stop 2021-11-03T18:50:27.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.356+0000 7fee0052a700 1 -- 172.21.15.26:0/3791559882 shutdown_connections 2021-11-03T18:50:27.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.356+0000 7fee0052a700 1 --2- 172.21.15.26:0/3791559882 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fedf80f6ff0 0x7fedf80f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:27.357 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.356+0000 7fee0052a700 1 --2- 172.21.15.26:0/3791559882 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedf80f66e0 0x7fedf80f6b00 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:27.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.356+0000 7fee0052a700 1 -- 172.21.15.26:0/3791559882 >> 172.21.15.26:0/3791559882 conn(0x7fedf80f1f00 msgr2=0x7fedf80f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:50:27.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.356+0000 7fee0052a700 1 -- 172.21.15.26:0/3791559882 shutdown_connections 2021-11-03T18:50:27.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.356+0000 7fee0052a700 1 -- 172.21.15.26:0/3791559882 wait complete. 2021-11-03T18:50:27.358 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.357+0000 7fee0052a700 1 Processor -- start 2021-11-03T18:50:27.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.357+0000 7fee0052a700 1 -- start start 2021-11-03T18:50:27.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.357+0000 7fee0052a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fedf80f66e0 0x7fedf8107070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:50:27.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.357+0000 7fee0052a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedf80f6ff0 0x7fedf8107560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:50:27.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.357+0000 7fee0052a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf8107b10 con 0x7fedf80f6ff0 2021-11-03T18:50:27.359 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.357+0000 7fee0052a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf8107c50 con 0x7fedf80f66e0 2021-11-03T18:50:27.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.357+0000 7fedfdac5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedf80f6ff0 0x7fedf8107560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:50:27.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.357+0000 7fedfdac5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedf80f6ff0 0x7fedf8107560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34070/0 (socket says 172.21.15.26:34070) 2021-11-03T18:50:27.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.357+0000 7fedfdac5700 1 -- 172.21.15.26:0/1608812127 learned_addr learned my addr 172.21.15.26:0/1608812127 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:50:27.360 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.357+0000 7fedfe2c6700 1 --2- 172.21.15.26:0/1608812127 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fedf80f66e0 0x7fedf8107070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:50:27.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.357+0000 7fedfdac5700 1 -- 172.21.15.26:0/1608812127 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fedf80f66e0 msgr2=0x7fedf8107070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:50:27.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.357+0000 7fedfdac5700 1 --2- 172.21.15.26:0/1608812127 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fedf80f66e0 0x7fedf8107070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:27.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.357+0000 7fedfdac5700 1 -- 172.21.15.26:0/1608812127 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf0009640 con 0x7fedf80f6ff0 2021-11-03T18:50:27.361 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.357+0000 7fedfdac5700 1 --2- 172.21.15.26:0/1608812127 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedf80f6ff0 0x7fedf8107560 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 rx=0x7fedec00e7f0 tx=0x7fedec00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:50:27.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.358+0000 7fedf6ffd700 1 -- 172.21.15.26:0/1608812127 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedec0092e0 con 0x7fedf80f6ff0 2021-11-03T18:50:27.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.358+0000 7fedf6ffd700 1 -- 172.21.15.26:0/1608812127 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fedec00f040 con 0x7fedf80f6ff0 2021-11-03T18:50:27.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.358+0000 7fedf6ffd700 1 -- 172.21.15.26:0/1608812127 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedec014750 con 0x7fedf80f6ff0 2021-11-03T18:50:27.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.358+0000 7fee0052a700 1 -- 172.21.15.26:0/1608812127 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf81085f0 con 0x7fedf80f6ff0 2021-11-03T18:50:27.362 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.358+0000 7fee0052a700 1 -- 172.21.15.26:0/1608812127 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf8108b80 con 0x7fedf80f6ff0 2021-11-03T18:50:27.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.359+0000 7fee0052a700 1 -- 172.21.15.26:0/1608812127 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf80f5b70 con 0x7fedf80f6ff0 2021-11-03T18:50:27.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.360+0000 7fedf6ffd700 1 -- 172.21.15.26:0/1608812127 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fedec0077b0 con 0x7fedf80f6ff0 2021-11-03T18:50:27.364 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.360+0000 7fedf6ffd700 1 --2- 172.21.15.26:0/1608812127 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fede00640b0 0x7fede0066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:50:27.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.360+0000 7fedf6ffd700 1 -- 172.21.15.26:0/1608812127 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fedec0809a0 con 0x7fedf80f6ff0 2021-11-03T18:50:27.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.360+0000 7fedfe2c6700 1 --2- 172.21.15.26:0/1608812127 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fede00640b0 0x7fede0066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:50:27.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.360+0000 7fedfe2c6700 1 --2- 172.21.15.26:0/1608812127 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fede00640b0 0x7fede0066570 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 rx=0x7fedf000b3b0 tx=0x7fedf0015040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:50:27.365 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.364+0000 7fedf6ffd700 1 -- 172.21.15.26:0/1608812127 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fedec052d00 con 0x7fedf80f6ff0 2021-11-03T18:50:27.567 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.568+0000 7fee0052a700 1 -- 172.21.15.26:0/1608812127 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fedf80ff010 con 0x7fedf80f6ff0 2021-11-03T18:50:27.567 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.569+0000 7fedf6ffd700 1 -- 172.21.15.26:0/1608812127 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fedec019070 con 0x7fedf80f6ff0 2021-11-03T18:50:27.567 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:50:27.568 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:50:27.568 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:50:27.568 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:50:27.568 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:50:27.569 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:50:27.569 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:50:27.569 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:50:27.569 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:50:27.569 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:50:27.570 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:50:27.570 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:50:27.570 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:50:27.570 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:50:27.571 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:50:27.571 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:50:27.571 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:50:27.571 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:50:27.571 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:50:27.572 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:50:27.572 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:50:27.572 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:50:27.572 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:50:27.572 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:50:27.573 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:50:27.573 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:50:27.573 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:50:27.573 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:50:27.573 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:50:27.574 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:50:27.574 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:50:27.574 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:50:27.574 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:50:27.575 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:50:27.575 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:50:27.575 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:50:27.575 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:50:27.575 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:50:27.576 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:50:27.576 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.571+0000 7fee0052a700 1 -- 172.21.15.26:0/1608812127 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fede00640b0 msgr2=0x7fede0066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:50:27.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.571+0000 7fee0052a700 1 --2- 172.21.15.26:0/1608812127 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fede00640b0 0x7fede0066570 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 rx=0x7fedf000b3b0 tx=0x7fedf0015040).stop 2021-11-03T18:50:27.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.571+0000 7fee0052a700 1 -- 172.21.15.26:0/1608812127 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedf80f6ff0 msgr2=0x7fedf8107560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:50:27.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.571+0000 7fee0052a700 1 --2- 172.21.15.26:0/1608812127 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedf80f6ff0 0x7fedf8107560 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 rx=0x7fedec00e7f0 tx=0x7fedec00b040).stop 2021-11-03T18:50:27.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.571+0000 7fee0052a700 1 -- 172.21.15.26:0/1608812127 shutdown_connections 2021-11-03T18:50:27.577 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.571+0000 7fee0052a700 1 --2- 172.21.15.26:0/1608812127 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fede00640b0 0x7fede0066570 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:27.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.571+0000 7fee0052a700 1 --2- 172.21.15.26:0/1608812127 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fedf80f66e0 0x7fedf8107070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:27.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.571+0000 7fee0052a700 1 --2- 172.21.15.26:0/1608812127 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedf80f6ff0 0x7fedf8107560 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:27.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.571+0000 7fee0052a700 1 -- 172.21.15.26:0/1608812127 >> 172.21.15.26:0/1608812127 conn(0x7fedf80f1f00 msgr2=0x7fedf80fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:50:27.578 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.571+0000 7fee0052a700 1 -- 172.21.15.26:0/1608812127 shutdown_connections 2021-11-03T18:50:27.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:27.571+0000 7fee0052a700 1 -- 172.21.15.26:0/1608812127 wait complete. 2021-11-03T18:50:27.579 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:50:27.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:27 smithi026 ceph-mon[96795]: pgmap v3473: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:27.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:27 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/2104910779' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:50:27.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:27 smithi194 ceph-mon[65619]: pgmap v3473: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:27.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:27 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/2104910779' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:50:28.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:28 smithi026 ceph-mon[96795]: from='client.37708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:50:28.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:28 smithi026 ceph-mon[96795]: from='client.37712 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:50:28.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:28 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/1608812127' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:50:28.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:28 smithi194 ceph-mon[65619]: from='client.37708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:50:28.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:28 smithi194 ceph-mon[65619]: from='client.37712 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:50:28.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:28 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/1608812127' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:50:29.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:29 smithi026 ceph-mon[96795]: pgmap v3474: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:29.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:29 smithi194 ceph-mon[65619]: pgmap v3474: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:31.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:31 smithi194 ceph-mon[65619]: pgmap v3475: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:31.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:31 smithi026 ceph-mon[96795]: pgmap v3475: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:33.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:33 smithi026 ceph-mon[96795]: pgmap v3476: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:33.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:33 smithi194 ceph-mon[65619]: pgmap v3476: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:35.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:35 smithi026 ceph-mon[96795]: pgmap v3477: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:35.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:35 smithi194 ceph-mon[65619]: pgmap v3477: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:37.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:37 smithi026 ceph-mon[96795]: pgmap v3478: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:37.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:37 smithi194 ceph-mon[65619]: pgmap v3478: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:39.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:39 smithi026 ceph-mon[96795]: pgmap v3479: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:39.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:39 smithi194 ceph-mon[65619]: pgmap v3479: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:40.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:40 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:50:40.676 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:40 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:50:40.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:40 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:50:40.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:40 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:50:41.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:41 smithi026 ceph-mon[96795]: pgmap v3480: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:41.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:41 smithi194 ceph-mon[65619]: pgmap v3480: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:43.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:43 smithi026 ceph-mon[96795]: pgmap v3481: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:43.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:43 smithi194 ceph-mon[65619]: pgmap v3481: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:45.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:45 smithi026 ceph-mon[96795]: pgmap v3482: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:45.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:45 smithi194 ceph-mon[65619]: pgmap v3482: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:47.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:47 smithi026 ceph-mon[96795]: pgmap v3483: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:47.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:47 smithi194 ceph-mon[65619]: pgmap v3483: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:48.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:48 smithi194 ceph-mon[65619]: pgmap v3484: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:48.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:50:48.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:48 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:50:48.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:48 smithi026 ceph-mon[96795]: pgmap v3484: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:48.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/mirror_snapshot_schedule"}]: dispatch 2021-11-03T18:50:48.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:48 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.cnrxli/trash_purge_schedule"}]: dispatch 2021-11-03T18:50:51.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:51 smithi194 ceph-mon[65619]: pgmap v3485: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:51.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:51 smithi026 ceph-mon[96795]: pgmap v3485: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:52.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:52 smithi194 ceph-mon[65619]: pgmap v3486: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:52.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:52 smithi026 ceph-mon[96795]: pgmap v3486: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:54.723 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:54 smithi194 ceph-mon[65619]: pgmap v3487: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:54.724 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:54 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:50:54.724 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:54 smithi194 ceph-mon[65619]: poll took 60068.340 ms: 1 events 2021-11-03T18:50:54.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:54 smithi026 ceph-mon[96795]: pgmap v3487: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:54.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:54 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:50:54.926 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:54 smithi026 ceph-mon[96795]: poll took 60068.340 ms: 1 events 2021-11-03T18:50:55.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:55 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:50:56.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:55 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:50:57.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:56 smithi194 ceph-mon[65619]: pgmap v3488: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:57.175 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:56 smithi026 ceph-mon[96795]: pgmap v3488: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:57.680 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.680+0000 7f91162b0700 1 -- 172.21.15.26:0/2654349735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91100f9890 msgr2=0x7f91100fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:50:57.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.680+0000 7f91162b0700 1 --2- 172.21.15.26:0/2654349735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91100f9890 0x7f91100fbc80 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 rx=0x7f9104004660 tx=0x7f9104009b30).stop 2021-11-03T18:50:57.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.681+0000 7f91162b0700 1 -- 172.21.15.26:0/2654349735 shutdown_connections 2021-11-03T18:50:57.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.681+0000 7f91162b0700 1 --2- 172.21.15.26:0/2654349735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91100f9890 0x7f91100fbc80 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:57.681 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.681+0000 7f91162b0700 1 --2- 172.21.15.26:0/2654349735 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9110060390 0x7f91100f9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:57.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.681+0000 7f91162b0700 1 -- 172.21.15.26:0/2654349735 >> 172.21.15.26:0/2654349735 conn(0x7f91100f0d70 msgr2=0x7f91100f3190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:50:57.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.681+0000 7f91162b0700 1 -- 172.21.15.26:0/2654349735 shutdown_connections 2021-11-03T18:50:57.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.681+0000 7f91162b0700 1 -- 172.21.15.26:0/2654349735 wait complete. 2021-11-03T18:50:57.682 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.681+0000 7f91162b0700 1 Processor -- start 2021-11-03T18:50:57.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.681+0000 7f91162b0700 1 -- start start 2021-11-03T18:50:57.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.682+0000 7f91162b0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9110060390 0x7f91100f6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:50:57.685 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.682+0000 7f91162b0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91100f9890 0x7f91100f5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:50:57.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.682+0000 7f91162b0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91100f5770 con 0x7f9110060390 2021-11-03T18:50:57.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.682+0000 7f91162b0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91100f58b0 con 0x7f91100f9890 2021-11-03T18:50:57.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.682+0000 7f910ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9110060390 0x7f91100f6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:50:57.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.682+0000 7f910ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9110060390 0x7f91100f6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34086/0 (socket says 172.21.15.26:34086) 2021-11-03T18:50:57.686 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.682+0000 7f910ffff700 1 -- 172.21.15.26:0/2575571917 learned_addr learned my addr 172.21.15.26:0/2575571917 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:50:57.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.682+0000 7f910f7fe700 1 --2- 172.21.15.26:0/2575571917 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91100f9890 0x7f91100f5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:50:57.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.682+0000 7f910ffff700 1 -- 172.21.15.26:0/2575571917 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91100f9890 msgr2=0x7f91100f5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:50:57.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.682+0000 7f910ffff700 1 --2- 172.21.15.26:0/2575571917 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91100f9890 0x7f91100f5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:57.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.682+0000 7f910ffff700 1 -- 172.21.15.26:0/2575571917 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9104005040 con 0x7f9110060390 2021-11-03T18:50:57.687 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.682+0000 7f910f7fe700 1 --2- 172.21.15.26:0/2575571917 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91100f9890 0x7f91100f5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-03T18:50:57.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.682+0000 7f910ffff700 1 --2- 172.21.15.26:0/2575571917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9110060390 0x7f91100f6d90 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 rx=0x7f91000026d0 tx=0x7f9100009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:50:57.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.682+0000 7f910cff9700 1 -- 172.21.15.26:0/2575571917 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9100009320 con 0x7f9110060390 2021-11-03T18:50:57.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.682+0000 7f910cff9700 1 -- 172.21.15.26:0/2575571917 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f910000f040 con 0x7f9110060390 2021-11-03T18:50:57.688 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.682+0000 7f91162b0700 1 -- 172.21.15.26:0/2575571917 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91100f5b90 con 0x7f9110060390 2021-11-03T18:50:57.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.683+0000 7f910cff9700 1 -- 172.21.15.26:0/2575571917 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91000147e0 con 0x7f9110060390 2021-11-03T18:50:57.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.683+0000 7f91162b0700 1 -- 172.21.15.26:0/2575571917 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f911010efb0 con 0x7f9110060390 2021-11-03T18:50:57.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.684+0000 7f91162b0700 1 -- 172.21.15.26:0/2575571917 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9110045ad0 con 0x7f9110060390 2021-11-03T18:50:57.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.684+0000 7f910cff9700 1 -- 172.21.15.26:0/2575571917 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7f9100009480 con 0x7f9110060390 2021-11-03T18:50:57.689 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.684+0000 7f910cff9700 1 --2- 172.21.15.26:0/2575571917 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f90f8064090 0x7f90f8066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:50:57.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.685+0000 7f910cff9700 1 -- 172.21.15.26:0/2575571917 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f9100080eb0 con 0x7f9110060390 2021-11-03T18:50:57.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.685+0000 7f910f7fe700 1 --2- 172.21.15.26:0/2575571917 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f90f8064090 0x7f90f8066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:50:57.690 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.685+0000 7f910f7fe700 1 --2- 172.21.15.26:0/2575571917 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f90f8064090 0x7f90f8066550 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7f9104013690 tx=0x7f9104009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:50:57.691 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.689+0000 7f910cff9700 1 -- 172.21.15.26:0/2575571917 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7f9100053210 con 0x7f9110060390 2021-11-03T18:50:57.883 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.884+0000 7f91162b0700 1 -- 172.21.15.26:0/2575571917 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9110057f10 con 0x7f90f8064090 2021-11-03T18:50:57.884 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.885+0000 7f910cff9700 1 -- 172.21.15.26:0/2575571917 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f9110057f10 con 0x7f90f8064090 2021-11-03T18:50:57.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.899+0000 7f90f67fc700 1 -- 172.21.15.26:0/2575571917 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f90f8064090 msgr2=0x7f90f8066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:50:57.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.899+0000 7f90f67fc700 1 --2- 172.21.15.26:0/2575571917 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f90f8064090 0x7f90f8066550 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7f9104013690 tx=0x7f9104009b30).stop 2021-11-03T18:50:57.899 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.899+0000 7f90f67fc700 1 -- 172.21.15.26:0/2575571917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9110060390 msgr2=0x7f91100f6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:50:57.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.899+0000 7f90f67fc700 1 --2- 172.21.15.26:0/2575571917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9110060390 0x7f91100f6d90 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 rx=0x7f91000026d0 tx=0x7f9100009de0).stop 2021-11-03T18:50:57.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.899+0000 7f90f67fc700 1 -- 172.21.15.26:0/2575571917 shutdown_connections 2021-11-03T18:50:57.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.899+0000 7f90f67fc700 1 --2- 172.21.15.26:0/2575571917 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7f90f8064090 0x7f90f8066550 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:57.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.899+0000 7f90f67fc700 1 --2- 172.21.15.26:0/2575571917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9110060390 0x7f91100f6d90 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:57.900 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.899+0000 7f90f67fc700 1 --2- 172.21.15.26:0/2575571917 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91100f9890 0x7f91100f5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:57.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.899+0000 7f90f67fc700 1 -- 172.21.15.26:0/2575571917 >> 172.21.15.26:0/2575571917 conn(0x7f91100f0d70 msgr2=0x7f91100f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:50:57.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.899+0000 7f90f67fc700 1 -- 172.21.15.26:0/2575571917 shutdown_connections 2021-11-03T18:50:57.901 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:57.899+0000 7f90f67fc700 1 -- 172.21.15.26:0/2575571917 wait complete. 2021-11-03T18:50:57.909 INFO:teuthology.orchestra.run.smithi026.stdout:true 2021-11-03T18:50:58.001 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.001+0000 7fcf1d5a1700 1 -- 172.21.15.26:0/867713623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf180fba60 msgr2=0x7fcf180fde50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:50:58.001 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.001+0000 7fcf1d5a1700 1 --2- 172.21.15.26:0/867713623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf180fba60 0x7fcf180fde50 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 rx=0x7fcf00004660 tx=0x7fcf00009b30).stop 2021-11-03T18:50:58.002 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.001+0000 7fcf1d5a1700 1 -- 172.21.15.26:0/867713623 shutdown_connections 2021-11-03T18:50:58.002 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.001+0000 7fcf1d5a1700 1 --2- 172.21.15.26:0/867713623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf180fba60 0x7fcf180fde50 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:58.002 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.001+0000 7fcf1d5a1700 1 --2- 172.21.15.26:0/867713623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf180602b0 0x7fcf180fb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:58.002 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.001+0000 7fcf1d5a1700 1 -- 172.21.15.26:0/867713623 >> 172.21.15.26:0/867713623 conn(0x7fcf180f0b90 msgr2=0x7fcf180f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:50:58.002 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.001+0000 7fcf1d5a1700 1 -- 172.21.15.26:0/867713623 shutdown_connections 2021-11-03T18:50:58.003 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.001+0000 7fcf1d5a1700 1 -- 172.21.15.26:0/867713623 wait complete. 2021-11-03T18:50:58.003 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.002+0000 7fcf1d5a1700 1 Processor -- start 2021-11-03T18:50:58.003 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.002+0000 7fcf1d5a1700 1 -- start start 2021-11-03T18:50:58.005 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.002+0000 7fcf1d5a1700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf180602b0 0x7fcf18108ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:50:58.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.002+0000 7fcf1d5a1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf180fba60 0x7fcf181093b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:50:58.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.002+0000 7fcf1d5a1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf18109960 con 0x7fcf180fba60 2021-11-03T18:50:58.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.002+0000 7fcf1d5a1700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf18109aa0 con 0x7fcf180602b0 2021-11-03T18:50:58.006 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.002+0000 7fcf177fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf180fba60 0x7fcf181093b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:50:58.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.002+0000 7fcf177fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf180fba60 0x7fcf181093b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34098/0 (socket says 172.21.15.26:34098) 2021-11-03T18:50:58.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.002+0000 7fcf177fe700 1 -- 172.21.15.26:0/1984982010 learned_addr learned my addr 172.21.15.26:0/1984982010 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:50:58.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.002+0000 7fcf17fff700 1 --2- 172.21.15.26:0/1984982010 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf180602b0 0x7fcf18108ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:50:58.007 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.003+0000 7fcf177fe700 1 -- 172.21.15.26:0/1984982010 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf180602b0 msgr2=0x7fcf18108ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:50:58.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.003+0000 7fcf177fe700 1 --2- 172.21.15.26:0/1984982010 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf180602b0 0x7fcf18108ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:58.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.003+0000 7fcf177fe700 1 -- 172.21.15.26:0/1984982010 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf00005040 con 0x7fcf180fba60 2021-11-03T18:50:58.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.003+0000 7fcf17fff700 1 --2- 172.21.15.26:0/1984982010 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf180602b0 0x7fcf18108ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-03T18:50:58.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.003+0000 7fcf177fe700 1 --2- 172.21.15.26:0/1984982010 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf180fba60 0x7fcf181093b0 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 rx=0x7fcf00014040 tx=0x7fcf0000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:50:58.008 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.003+0000 7fcf14ff9700 1 -- 172.21.15.26:0/1984982010 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf00019070 con 0x7fcf180fba60 2021-11-03T18:50:58.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.003+0000 7fcf1d5a1700 1 -- 172.21.15.26:0/1984982010 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf1810a3e0 con 0x7fcf180fba60 2021-11-03T18:50:58.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.003+0000 7fcf14ff9700 1 -- 172.21.15.26:0/1984982010 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcf00007e70 con 0x7fcf180fba60 2021-11-03T18:50:58.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.003+0000 7fcf14ff9700 1 -- 172.21.15.26:0/1984982010 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf00014d50 con 0x7fcf180fba60 2021-11-03T18:50:58.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.003+0000 7fcf1d5a1700 1 -- 172.21.15.26:0/1984982010 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf1810a940 con 0x7fcf180fba60 2021-11-03T18:50:58.009 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.004+0000 7fcf1d5a1700 1 -- 172.21.15.26:0/1984982010 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf18045ad0 con 0x7fcf180fba60 2021-11-03T18:50:58.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.004+0000 7fcf14ff9700 1 -- 172.21.15.26:0/1984982010 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fcf00025070 con 0x7fcf180fba60 2021-11-03T18:50:58.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.005+0000 7fcf14ff9700 1 --2- 172.21.15.26:0/1984982010 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcf04064100 0x7fcf040665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:50:58.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.005+0000 7fcf14ff9700 1 -- 172.21.15.26:0/1984982010 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fcf000817c0 con 0x7fcf180fba60 2021-11-03T18:50:58.010 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.005+0000 7fcf17fff700 1 --2- 172.21.15.26:0/1984982010 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcf04064100 0x7fcf040665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:50:58.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.005+0000 7fcf17fff700 1 --2- 172.21.15.26:0/1984982010 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcf04064100 0x7fcf040665c0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7fcf08009da0 tx=0x7fcf0800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:50:58.011 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.009+0000 7fcf14ff9700 1 -- 172.21.15.26:0/1984982010 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fcf00053b20 con 0x7fcf180fba60 2021-11-03T18:50:58.188 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.189+0000 7fcf1d5a1700 1 -- 172.21.15.26:0/1984982010 --> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf18101000 con 0x7fcf04064100 2021-11-03T18:50:58.203 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.204+0000 7fcf14ff9700 1 -- 172.21.15.26:0/1984982010 <== mgr.34104 v2:172.21.15.26:6826/3790195271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7fcf18101000 con 0x7fcf04064100 2021-11-03T18:50:58.203 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-11-03T18:50:58.204 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (2h) 10m ago 2h 20.0M - 0.20.0 0881eb8f169f 58cbae14674c 2021-11-03T18:50:58.204 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (114m) 10m ago 2h 7226k - 17.0.0-8776-g6e90212d 50416d063274 b515ced8d80b 2021-11-03T18:50:58.204 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi194 smithi194 running (114m) 9m ago 2h 7142k - 17.0.0-8776-g6e90212d 50416d063274 b35fb7c9028d 2021-11-03T18:50:58.204 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (2h) 10m ago 2h 42.4M - 6.7.4 557c83e11646 8bc0222bc7dd 2021-11-03T18:50:58.204 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.ltacyh smithi026 running (115m) 10m ago 118m 26.4M - 16.2.4 8d91d370c2b8 3d7941327605 2021-11-03T18:50:58.205 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.yfxlxl smithi026 running (115m) 10m ago 118m 27.0M - 16.2.4 8d91d370c2b8 6636fd2f36e0 2021-11-03T18:50:58.205 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.kwikhp smithi194 running (118m) 9m ago 118m 27.2M - 16.2.4 8d91d370c2b8 0d85ee5a8de6 2021-11-03T18:50:58.205 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi194.mpotdl smithi194 running (118m) 9m ago 118m 27.6M - 16.2.4 8d91d370c2b8 1185d8c47887 2021-11-03T18:50:58.205 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.cnrxli smithi026 *:8499,8443,9283 running (115m) 10m ago 2h 615M - 17.0.0-8776-g6e90212d 50416d063274 a4336f2c9e22 2021-11-03T18:50:58.205 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi194.wnexas smithi194 *:8499,8443,9283 running (115m) 9m ago 2h 422M - 17.0.0-8776-g6e90212d 50416d063274 46e4c728152f 2021-11-03T18:50:58.206 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (115m) 10m ago 2h 407M 2048M 17.0.0-8776-g6e90212d 50416d063274 bcdc30249f1b 2021-11-03T18:50:58.206 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi194 smithi194 running (114m) 9m ago 2h 187M 2048M 17.0.0-8776-g6e90212d 50416d063274 5493b248c16b 2021-11-03T18:50:58.206 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (2h) 10m ago 2h 18.2M - 0.18.1 e5a616e4b9cf 5130555c7714 2021-11-03T18:50:58.206 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi194 smithi194 *:9100 running (2h) 9m ago 2h 18.6M - 0.18.1 e5a616e4b9cf dfff6005bb7f 2021-11-03T18:50:58.207 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (114m) 10m ago 2h 372M 4096M 17.0.0-8776-g6e90212d 50416d063274 21671cfb3b98 2021-11-03T18:50:58.207 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (113m) 10m ago 2h 400M 4096M 17.0.0-8776-g6e90212d 50416d063274 bb29e0ca66f8 2021-11-03T18:50:58.207 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (113m) 10m ago 2h 332M 4096M 17.0.0-8776-g6e90212d 50416d063274 7a89d0afe620 2021-11-03T18:50:58.207 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi194 running (112m) 9m ago 2h 438M 4096M 17.0.0-8776-g6e90212d 50416d063274 76d9dbfc8845 2021-11-03T18:50:58.207 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi194 running (112m) 9m ago 2h 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 6fda828ba514 2021-11-03T18:50:58.208 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi194 running (111m) 9m ago 2h 357M 4096M 17.0.0-8776-g6e90212d 50416d063274 8b9b1a31c890 2021-11-03T18:50:58.208 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi026 smithi026 *:9095 running (2h) 10m ago 2h 70.2M - 2.18.1 de242295e225 d183afa8c1d2 2021-11-03T18:50:58.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.205+0000 7fcf1d5a1700 1 -- 172.21.15.26:0/1984982010 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcf04064100 msgr2=0x7fcf040665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:50:58.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.205+0000 7fcf1d5a1700 1 --2- 172.21.15.26:0/1984982010 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcf04064100 0x7fcf040665c0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7fcf08009da0 tx=0x7fcf0800b040).stop 2021-11-03T18:50:58.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.205+0000 7fcf1d5a1700 1 -- 172.21.15.26:0/1984982010 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf180fba60 msgr2=0x7fcf181093b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:50:58.209 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.205+0000 7fcf1d5a1700 1 --2- 172.21.15.26:0/1984982010 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf180fba60 0x7fcf181093b0 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 rx=0x7fcf00014040 tx=0x7fcf0000b040).stop 2021-11-03T18:50:58.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.206+0000 7fcf1d5a1700 1 -- 172.21.15.26:0/1984982010 shutdown_connections 2021-11-03T18:50:58.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.206+0000 7fcf1d5a1700 1 --2- 172.21.15.26:0/1984982010 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fcf04064100 0x7fcf040665c0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:58.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.206+0000 7fcf1d5a1700 1 --2- 172.21.15.26:0/1984982010 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf180602b0 0x7fcf18108ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:58.210 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.206+0000 7fcf1d5a1700 1 --2- 172.21.15.26:0/1984982010 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf180fba60 0x7fcf181093b0 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:58.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.206+0000 7fcf1d5a1700 1 -- 172.21.15.26:0/1984982010 >> 172.21.15.26:0/1984982010 conn(0x7fcf180f0b90 msgr2=0x7fcf180f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:50:58.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.206+0000 7fcf1d5a1700 1 -- 172.21.15.26:0/1984982010 shutdown_connections 2021-11-03T18:50:58.211 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.206+0000 7fcf1d5a1700 1 -- 172.21.15.26:0/1984982010 wait complete. 2021-11-03T18:50:58.308 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.309+0000 7fa18269b700 1 -- 172.21.15.26:0/2648276857 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa17c0f66d0 msgr2=0x7fa17c0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:50:58.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.309+0000 7fa18269b700 1 --2- 172.21.15.26:0/2648276857 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa17c0f66d0 0x7fa17c0f6b30 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 rx=0x7fa16c004660 tx=0x7fa16c009b30).stop 2021-11-03T18:50:58.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.309+0000 7fa18269b700 1 -- 172.21.15.26:0/2648276857 shutdown_connections 2021-11-03T18:50:58.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.309+0000 7fa18269b700 1 --2- 172.21.15.26:0/2648276857 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa17c0f66d0 0x7fa17c0f6b30 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:58.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.309+0000 7fa18269b700 1 --2- 172.21.15.26:0/2648276857 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa17c0f5430 0x7fa17c0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:58.309 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.309+0000 7fa18269b700 1 -- 172.21.15.26:0/2648276857 >> 172.21.15.26:0/2648276857 conn(0x7fa17c0f0b90 msgr2=0x7fa17c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:50:58.310 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.309+0000 7fa18269b700 1 -- 172.21.15.26:0/2648276857 shutdown_connections 2021-11-03T18:50:58.310 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.309+0000 7fa18269b700 1 -- 172.21.15.26:0/2648276857 wait complete. 2021-11-03T18:50:58.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.310+0000 7fa18269b700 1 Processor -- start 2021-11-03T18:50:58.312 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.310+0000 7fa18269b700 1 -- start start 2021-11-03T18:50:58.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.310+0000 7fa18269b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa17c0f5430 0x7fa17c109a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:50:58.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.310+0000 7fa18269b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa17c0f66d0 0x7fa17c10bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:50:58.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.310+0000 7fa18269b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17c0603e0 con 0x7fa17c0f5430 2021-11-03T18:50:58.313 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.310+0000 7fa18269b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17c060520 con 0x7fa17c0f66d0 2021-11-03T18:50:58.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.310+0000 7fa181699700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa17c0f5430 0x7fa17c109a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:50:58.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.310+0000 7fa181699700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa17c0f5430 0x7fa17c109a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34106/0 (socket says 172.21.15.26:34106) 2021-11-03T18:50:58.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.310+0000 7fa181699700 1 -- 172.21.15.26:0/3710574878 learned_addr learned my addr 172.21.15.26:0/3710574878 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:50:58.314 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.310+0000 7fa180e98700 1 --2- 172.21.15.26:0/3710574878 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa17c0f66d0 0x7fa17c10bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:50:58.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.310+0000 7fa181699700 1 -- 172.21.15.26:0/3710574878 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa17c0f66d0 msgr2=0x7fa17c10bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:50:58.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.310+0000 7fa181699700 1 --2- 172.21.15.26:0/3710574878 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa17c0f66d0 0x7fa17c10bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:58.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.310+0000 7fa181699700 1 -- 172.21.15.26:0/3710574878 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa16c005040 con 0x7fa17c0f5430 2021-11-03T18:50:58.315 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.310+0000 7fa181699700 1 --2- 172.21.15.26:0/3710574878 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa17c0f5430 0x7fa17c109a20 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 rx=0x7fa17800c530 tx=0x7fa178007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:50:58.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.311+0000 7fa171ffb700 1 -- 172.21.15.26:0/3710574878 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa17800f650 con 0x7fa17c0f5430 2021-11-03T18:50:58.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.311+0000 7fa18269b700 1 -- 172.21.15.26:0/3710574878 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa17c10c4d0 con 0x7fa17c0f5430 2021-11-03T18:50:58.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.311+0000 7fa171ffb700 1 -- 172.21.15.26:0/3710574878 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa17800fc60 con 0x7fa17c0f5430 2021-11-03T18:50:58.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.311+0000 7fa171ffb700 1 -- 172.21.15.26:0/3710574878 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa178012d20 con 0x7fa17c0f5430 2021-11-03T18:50:58.316 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.311+0000 7fa18269b700 1 -- 172.21.15.26:0/3710574878 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa17c10ca90 con 0x7fa17c0f5430 2021-11-03T18:50:58.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.312+0000 7fa18269b700 1 -- 172.21.15.26:0/3710574878 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa17c045ad0 con 0x7fa17c0f5430 2021-11-03T18:50:58.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.312+0000 7fa171ffb700 1 -- 172.21.15.26:0/3710574878 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fa178019030 con 0x7fa17c0f5430 2021-11-03T18:50:58.317 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.313+0000 7fa171ffb700 1 --2- 172.21.15.26:0/3710574878 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa168064100 0x7fa1680665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:50:58.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.313+0000 7fa171ffb700 1 -- 172.21.15.26:0/3710574878 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fa178080620 con 0x7fa17c0f5430 2021-11-03T18:50:58.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.313+0000 7fa180e98700 1 --2- 172.21.15.26:0/3710574878 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa168064100 0x7fa1680665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:50:58.318 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.313+0000 7fa180e98700 1 --2- 172.21.15.26:0/3710574878 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa168064100 0x7fa1680665c0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7fa16c004e30 tx=0x7fa16c009b30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:50:58.319 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.317+0000 7fa171ffb700 1 -- 172.21.15.26:0/3710574878 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fa1780528e0 con 0x7fa17c0f5430 2021-11-03T18:50:58.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.578+0000 7fa18269b700 1 -- 172.21.15.26:0/3710574878 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa17c027a00 con 0x7fa17c0f5430 2021-11-03T18:50:58.579 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.579+0000 7fa171ffb700 1 -- 172.21.15.26:0/3710574878 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fa1780524d0 con 0x7fa17c0f5430 2021-11-03T18:50:58.579 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2021-11-03T18:50:58.580 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2021-11-03T18:50:58.580 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:50:58.580 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:50:58.580 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2021-11-03T18:50:58.581 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 2 2021-11-03T18:50:58.581 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:50:58.581 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2021-11-03T18:50:58.581 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 6 2021-11-03T18:50:58.582 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:50:58.582 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2021-11-03T18:50:58.582 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2021-11-03T18:50:58.582 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2021-11-03T18:50:58.582 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2021-11-03T18:50:58.583 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4, 2021-11-03T18:50:58.583 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 17.0.0-8776-g6e90212d (6e90212d8510e2d506395a8c82057d0d1787f3a4) quincy (dev)": 10 2021-11-03T18:50:58.583 INFO:teuthology.orchestra.run.smithi026.stdout: } 2021-11-03T18:50:58.583 INFO:teuthology.orchestra.run.smithi026.stdout:} 2021-11-03T18:50:58.584 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.581+0000 7fa18269b700 1 -- 172.21.15.26:0/3710574878 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa168064100 msgr2=0x7fa1680665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:50:58.584 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.581+0000 7fa18269b700 1 --2- 172.21.15.26:0/3710574878 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa168064100 0x7fa1680665c0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7fa16c004e30 tx=0x7fa16c009b30).stop 2021-11-03T18:50:58.585 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.581+0000 7fa18269b700 1 -- 172.21.15.26:0/3710574878 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa17c0f5430 msgr2=0x7fa17c109a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:50:58.585 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.581+0000 7fa18269b700 1 --2- 172.21.15.26:0/3710574878 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa17c0f5430 0x7fa17c109a20 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 rx=0x7fa17800c530 tx=0x7fa178007e10).stop 2021-11-03T18:50:58.585 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.581+0000 7fa18269b700 1 -- 172.21.15.26:0/3710574878 shutdown_connections 2021-11-03T18:50:58.585 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.581+0000 7fa18269b700 1 --2- 172.21.15.26:0/3710574878 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fa168064100 0x7fa1680665c0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:58.586 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.581+0000 7fa18269b700 1 --2- 172.21.15.26:0/3710574878 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa17c0f5430 0x7fa17c109a20 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:58.586 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.581+0000 7fa18269b700 1 --2- 172.21.15.26:0/3710574878 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa17c0f66d0 0x7fa17c10bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:58.586 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.581+0000 7fa18269b700 1 -- 172.21.15.26:0/3710574878 >> 172.21.15.26:0/3710574878 conn(0x7fa17c0f0b90 msgr2=0x7fa17c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:50:58.586 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.581+0000 7fa18269b700 1 -- 172.21.15.26:0/3710574878 shutdown_connections 2021-11-03T18:50:58.587 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.581+0000 7fa18269b700 1 -- 172.21.15.26:0/3710574878 wait complete. 2021-11-03T18:50:58.701 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.699+0000 7fee4f82c700 1 -- 172.21.15.26:0/3748334952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee480f66e0 msgr2=0x7fee480f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:50:58.701 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.699+0000 7fee4f82c700 1 --2- 172.21.15.26:0/3748334952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee480f66e0 0x7fee480f6b00 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 rx=0x7fee44004660 tx=0x7fee44009b30).stop 2021-11-03T18:50:58.701 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.699+0000 7fee4f82c700 1 -- 172.21.15.26:0/3748334952 shutdown_connections 2021-11-03T18:50:58.702 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.699+0000 7fee4f82c700 1 --2- 172.21.15.26:0/3748334952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee480f7980 0x7fee480f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:58.702 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.699+0000 7fee4f82c700 1 --2- 172.21.15.26:0/3748334952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee480f66e0 0x7fee480f6b00 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:58.702 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.699+0000 7fee4f82c700 1 -- 172.21.15.26:0/3748334952 >> 172.21.15.26:0/3748334952 conn(0x7fee480f1e40 msgr2=0x7fee480f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:50:58.702 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.699+0000 7fee4f82c700 1 -- 172.21.15.26:0/3748334952 shutdown_connections 2021-11-03T18:50:58.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.699+0000 7fee4f82c700 1 -- 172.21.15.26:0/3748334952 wait complete. 2021-11-03T18:50:58.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.700+0000 7fee4f82c700 1 Processor -- start 2021-11-03T18:50:58.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.700+0000 7fee4f82c700 1 -- start start 2021-11-03T18:50:58.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.700+0000 7fee4f82c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee480f66e0 0x7fee4806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:50:58.703 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.700+0000 7fee4f82c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee480f7980 0x7fee48069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:50:58.704 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.700+0000 7fee4f82c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4806a380 con 0x7fee480f66e0 2021-11-03T18:50:58.704 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.700+0000 7fee4f82c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4806a4c0 con 0x7fee480f7980 2021-11-03T18:50:58.704 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.700+0000 7fee4d5c8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee480f66e0 0x7fee4806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:50:58.704 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.700+0000 7fee4d5c8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee480f66e0 0x7fee4806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34116/0 (socket says 172.21.15.26:34116) 2021-11-03T18:50:58.705 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.700+0000 7fee4d5c8700 1 -- 172.21.15.26:0/72156624 learned_addr learned my addr 172.21.15.26:0/72156624 (peer_addr_for_me v2:172.21.15.26:0/0) 2021-11-03T18:50:58.705 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.701+0000 7fee4d5c8700 1 -- 172.21.15.26:0/72156624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee480f7980 msgr2=0x7fee48069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:50:58.705 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.701+0000 7fee4d5c8700 1 --2- 172.21.15.26:0/72156624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee480f7980 0x7fee48069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:50:58.705 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.701+0000 7fee4d5c8700 1 -- 172.21.15.26:0/72156624 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee44005040 con 0x7fee480f66e0 2021-11-03T18:50:58.705 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.701+0000 7fee4d5c8700 1 --2- 172.21.15.26:0/72156624 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee480f66e0 0x7fee4806b9a0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 rx=0x7fee44004f60 tx=0x7fee44009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:50:58.706 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.701+0000 7fee3dffb700 1 -- 172.21.15.26:0/72156624 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee44018070 con 0x7fee480f66e0 2021-11-03T18:50:58.706 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.701+0000 7fee4f82c700 1 -- 172.21.15.26:0/72156624 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee4806a740 con 0x7fee480f66e0 2021-11-03T18:50:58.706 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.701+0000 7fee3dffb700 1 -- 172.21.15.26:0/72156624 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fee44007ba0 con 0x7fee480f66e0 2021-11-03T18:50:58.706 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.701+0000 7fee3dffb700 1 -- 172.21.15.26:0/72156624 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee4401c620 con 0x7fee480f66e0 2021-11-03T18:50:58.706 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.701+0000 7fee4f82c700 1 -- 172.21.15.26:0/72156624 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee4806aca0 con 0x7fee480f66e0 2021-11-03T18:50:58.708 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.702+0000 7fee4f82c700 1 -- 172.21.15.26:0/72156624 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee48045ad0 con 0x7fee480f66e0 2021-11-03T18:50:58.708 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.703+0000 7fee3dffb700 1 -- 172.21.15.26:0/72156624 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 81917+0+0 (secure 0 0 0) 0x7fee4401c8e0 con 0x7fee480f66e0 2021-11-03T18:50:58.708 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.703+0000 7fee3dffb700 1 --2- 172.21.15.26:0/72156624 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fee340640b0 0x7fee34066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-03T18:50:58.708 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.703+0000 7fee3dffb700 1 -- 172.21.15.26:0/72156624 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fee440827d0 con 0x7fee480f66e0 2021-11-03T18:50:58.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.703+0000 7fee4cdc7700 1 --2- 172.21.15.26:0/72156624 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fee340640b0 0x7fee34066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-11-03T18:50:58.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.704+0000 7fee4cdc7700 1 --2- 172.21.15.26:0/72156624 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fee340640b0 0x7fee34066570 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 rx=0x7fee38004970 tx=0x7fee38007a60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-03T18:50:58.709 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.708+0000 7fee3dffb700 1 -- 172.21.15.26:0/72156624 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155104 (secure 0 0 0) 0x7fee44054a70 con 0x7fee480f66e0 2021-11-03T18:50:58.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:58 smithi194 ceph-mon[65619]: from='client.37724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:50:58.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:58 smithi194 ceph-mon[65619]: from='client.37728 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:50:58.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:58 smithi194 ceph-mon[65619]: pgmap v3489: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:58.919 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.919+0000 7fee4f82c700 1 -- 172.21.15.26:0/72156624 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fee480fef40 con 0x7fee480f66e0 2021-11-03T18:50:58.919 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.919+0000 7fee3dffb700 1 -- 172.21.15.26:0/72156624 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1777 (secure 0 0 0) 0x7fee44054660 con 0x7fee480f66e0 2021-11-03T18:50:58.919 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2021-11-03T18:50:58.920 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2021-11-03T18:50:58.920 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:50:58.920 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2021-11-03T18:50:58.920 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:50:58.921 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2021-11-03T18:50:58.921 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2021-11-03T18:50:58.921 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2021-11-03T18:50:58.921 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2021-11-03T18:50:58.921 INFO:teuthology.orchestra.run.smithi026.stdout:created 2021-11-03T16:52:17.109901+0000 2021-11-03T18:50:58.922 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2021-11-03T16:55:48.261162+0000 2021-11-03T18:50:58.922 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2021-11-03T18:50:58.922 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2021-11-03T18:50:58.922 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2021-11-03T18:50:58.923 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2021-11-03T18:50:58.923 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2021-11-03T18:50:58.923 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2021-11-03T18:50:58.923 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2021-11-03T18:50:58.924 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 52 2021-11-03T18:50:58.924 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-11-03T18:50:58.924 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2021-11-03T18:50:58.924 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2021-11-03T18:50:58.924 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2021-11-03T18:50:58.925 INFO:teuthology.orchestra.run.smithi026.stdout:failed 0 2021-11-03T18:50:58.925 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2021-11-03T18:50:58.925 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2021-11-03T18:50:58.925 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2021-11-03T18:50:58.925 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2021-11-03T18:50:58.926 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2021-11-03T18:50:58.926 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2021-11-03T18:50:58.926 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2021-11-03T18:50:58.926 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:50:58.927 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:50:58.927 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2021-11-03T18:50:58.927 INFO:teuthology.orchestra.run.smithi026.stdout: 2021-11-03T18:50:58.927 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.yfxlxl{-1:14642} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.26:6828/3558713282,v1:172.21.15.26:6829/3558713282] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:50:58.928 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.kwikhp{-1:24249} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/1229057921,v1:172.21.15.194:6825/1229057921] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:50:58.928 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi194.mpotdl{-1:24263} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6826/1394135844,v1:172.21.15.194:6827/1394135844] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:50:58.928 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.ltacyh{-1:34112} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6800/3996504153,v1:172.21.15.26:6801/3996504153] compat {c=[1],r=[1],i=[1]}] 2021-11-03T18:50:58.929 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.921+0000 7fee4f82c700 1 -- 172.21.15.26:0/72156624 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fee340640b0 msgr2=0x7fee34066570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:50:58.929 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.921+0000 7fee4f82c700 1 --2- 172.21.15.26:0/72156624 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fee340640b0 0x7fee34066570 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 rx=0x7fee38004970 tx=0x7fee38007a60).stop 2021-11-03T18:50:58.929 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.921+0000 7fee4f82c700 1 -- 172.21.15.26:0/72156624 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee480f66e0 msgr2=0x7fee4806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-03T18:50:58.930 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.921+0000 7fee4f82c700 1 --2- 172.21.15.26:0/72156624 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee480f66e0 0x7fee4806b9a0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 rx=0x7fee44004f60 tx=0x7fee44009b30).stop 2021-11-03T18:50:58.930 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.921+0000 7fee4f82c700 1 -- 172.21.15.26:0/72156624 shutdown_connections 2021-11-03T18:50:58.930 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.921+0000 7fee4f82c700 1 --2- 172.21.15.26:0/72156624 >> [v2:172.21.15.26:6826/3790195271,v1:172.21.15.26:6827/3790195271] conn(0x7fee340640b0 0x7fee34066570 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:58.930 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.921+0000 7fee4f82c700 1 --2- 172.21.15.26:0/72156624 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee480f66e0 0x7fee4806b9a0 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-03T18:50:58.930 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.921+0000 7fee4f82c700 1 --2- 172.21.15.26:0/72156624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee480f7980 0x7fee48069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-03T18:50:58.931 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.921+0000 7fee4f82c700 1 -- 172.21.15.26:0/72156624 >> 172.21.15.26:0/72156624 conn(0x7fee480f1e40 msgr2=0x7fee480fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-03T18:50:58.931 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.922+0000 7fee4f82c700 1 -- 172.21.15.26:0/72156624 shutdown_connections 2021-11-03T18:50:58.931 INFO:teuthology.orchestra.run.smithi026.stderr:2021-11-03T18:50:58.922+0000 7fee4f82c700 1 -- 172.21.15.26:0/72156624 wait complete. 2021-11-03T18:50:58.931 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2021-11-03T18:50:58.932 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:58 smithi026 ceph-mon[96795]: from='client.37724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:50:58.932 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:58 smithi026 ceph-mon[96795]: from='client.37728 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-11-03T18:50:58.932 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:58 smithi026 ceph-mon[96795]: pgmap v3489: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:50:59.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:59 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/3710574878' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:50:59.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:59 smithi194 ceph-mon[65619]: from='client.? 172.21.15.26:0/72156624' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:50:59.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:59 smithi194 ceph-mon[65619]: poll took 4362.567 ms: 1 events 2021-11-03T18:50:59.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:50:59 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:50:59.780 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:59 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/3710574878' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:50:59.780 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:59 smithi026 ceph-mon[96795]: from='client.? 172.21.15.26:0/72156624' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2021-11-03T18:50:59.781 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:59 smithi026 ceph-mon[96795]: poll took 4362.567 ms: 1 events 2021-11-03T18:50:59.781 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:50:59 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:51:01.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:51:00 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:51:01.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:51:00 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:51:01.176 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:51:00 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:51:01.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:51:00 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:51:01.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:51:00 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:51:01.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:51:00 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:51:01.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:51:00 smithi026 ceph-mon[96795]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:51:01.177 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:51:00 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:51:01.178 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:51:00 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:51:01.178 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:51:00 smithi026 ceph-mon[96795]: pgmap v3490: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:51:01.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:51:00 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' 2021-11-03T18:51:01.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:51:00 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-11-03T18:51:01.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:51:00 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:51:01.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:51:00 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:51:01.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:51:00 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:51:01.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:51:00 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "versions"}]: dispatch 2021-11-03T18:51:01.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:51:00 smithi194 ceph-mon[65619]: Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction 2021-11-03T18:51:01.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:51:00 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:51:01.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:51:00 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:51:01.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:51:00 smithi194 ceph-mon[65619]: pgmap v3490: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:51:02.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:51:02 smithi194 ceph-mon[65619]: pgmap v3491: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:51:02.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:51:02 smithi026 ceph-mon[96795]: pgmap v3491: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:51:04.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:51:04 smithi194 ceph-mon[65619]: pgmap v3492: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:51:04.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:51:04 smithi026 ceph-mon[96795]: pgmap v3492: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:51:06.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:51:06 smithi194 ceph-mon[65619]: pgmap v3493: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:51:06.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:51:06 smithi026 ceph-mon[96795]: pgmap v3493: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:51:08.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:51:08 smithi194 ceph-mon[65619]: pgmap v3494: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:51:08.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:51:08 smithi026 ceph-mon[96795]: pgmap v3494: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:51:11.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:51:11 smithi194 ceph-mon[65619]: pgmap v3495: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:51:11.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:51:11 smithi026 ceph-mon[96795]: pgmap v3495: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:51:12.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:51:12 smithi194 ceph-mon[65619]: pgmap v3496: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:51:12.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:51:12 smithi026 ceph-mon[96795]: pgmap v3496: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:51:14.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:51:14 smithi194 ceph-mon[65619]: pgmap v3497: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:51:14.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:51:14 smithi026 ceph-mon[96795]: pgmap v3497: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:51:15.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:51:15 smithi194 ceph-mon[65619]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:51:15.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:51:15 smithi194 ceph-mon[65619]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:51:15.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:51:15 smithi026 ceph-mon[96795]: from='mgr.34104 172.21.15.26:0/543360195' entity='mgr.smithi026.cnrxli' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.ltacyh"]}]: dispatch 2021-11-03T18:51:15.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:51:15 smithi026 ceph-mon[96795]: Upgrade: It is NOT safe to stop mds.cephfs.smithi026.ltacyh at this time: one or more filesystems is currently degraded 2021-11-03T18:51:16.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:51:16 smithi194 ceph-mon[65619]: pgmap v3498: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:51:16.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:51:16 smithi026 ceph-mon[96795]: pgmap v3498: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:51:18.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:51:18 smithi194 ceph-mon[65619]: pgmap v3499: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:51:18.925 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:51:18 smithi026 ceph-mon[96795]: pgmap v3499: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:51:21.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Nov 03 18:51:21 smithi194 ceph-mon[65619]: pgmap v3500: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:51:21.675 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:Nov 03 18:51:21 smithi026 ceph-mon[96795]: pgmap v3500: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2021-11-03T18:51:22.037 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2021-11-03T18:51:22.039 DEBUG:teuthology.task.console_log:Killing console logger for smithi026 2021-11-03T18:51:22.040 DEBUG:teuthology.task.console_log:Killing console logger for smithi194 2021-11-03T18:51:22.040 DEBUG:teuthology.exit:Finished running handlers